2023-09-13T09:17:56.712 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-13T09:17:56.713 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} --name rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi --owner scheduled_rishabh@teuthology --archive /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924 -- /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/orig.config.yaml 2023-09-13T09:17:56.772 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T09:17:56.867 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924 branch: wip-rishabh-2023sep12-b2 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} email: null first_in_suite: false job_id: '7394924' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023sep12-b2 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - wsync syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023sep12-b2 sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 2531 sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 sleep_before_teardown: 0 subset: 165/256 suite: fs suite_branch: wip-rishabh-2023sep12-b2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi053.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - kclient: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - workunit: clients: all: - suites/dbench.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-12_12:12:15 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1394 2023-09-13T09:17:56.867 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa; will attempt to use it 2023-09-13T09:17:56.868 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks 2023-09-13T09:17:56.869 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-13T09:17:56.871 INFO:teuthology.task.internal:Checking packages... 2023-09-13T09:17:56.896 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5' 2023-09-13T09:17:56.896 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-13T09:17:56.897 INFO:teuthology.packaging:ref: None 2023-09-13T09:17:56.897 INFO:teuthology.packaging:tag: None 2023-09-13T09:17:56.898 INFO:teuthology.packaging:branch: wip-rishabh-2023sep12-b2 2023-09-13T09:17:56.898 INFO:teuthology.packaging:sha1: 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:17:56.898 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023sep12-b2 2023-09-13T09:17:57.133 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6083.g4a754ac9 2023-09-13T09:17:57.134 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-13T09:17:57.144 INFO:teuthology.task.internal:no buildpackages task found 2023-09-13T09:17:57.144 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-13T09:17:57.297 INFO:teuthology.task.internal:Saving configuration 2023-09-13T09:17:57.323 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-13T09:17:57.330 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T09:17:57.353 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 09:12:57.113098', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T09:17:57.376 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 09:12:57.114468', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T09:17:57.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 09:12:57.115668', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T09:17:57.398 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-13T09:17:57.406 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-09-13T09:17:57.406 INFO:teuthology.task.internal:roles: ubuntu@smithi053.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-09-13T09:17:57.407 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-09-13T09:17:57.407 INFO:teuthology.run_tasks:Running task console_log... 2023-09-13T09:17:57.529 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3421f16b80>, signals=[15]) 2023-09-13T09:17:57.530 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-13T09:17:57.538 INFO:teuthology.task.internal:Opening connections... 2023-09-13T09:17:57.538 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2023-09-13T09:17:57.540 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T09:17:57.611 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi053.front.sepia.ceph.com 2023-09-13T09:17:57.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T09:17:57.679 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2023-09-13T09:17:57.680 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T09:17:57.745 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-13T09:17:57.755 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2023-09-13T09:17:57.776 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2023-09-13T09:17:57.777 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2023-09-13T09:17:57.837 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T09:17:57.837 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T09:17:57.837 INFO:teuthology.orchestra.run.smithi006.stdout:ID="rhel" 2023-09-13T09:17:57.837 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="fedora" 2023-09-13T09:17:57.838 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8.6" 2023-09-13T09:17:57.838 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2023-09-13T09:17:57.838 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T09:17:57.838 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2023-09-13T09:17:57.839 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T09:17:57.839 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T09:17:57.839 INFO:teuthology.orchestra.run.smithi006.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T09:17:57.839 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T09:17:57.840 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:17:57.840 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T09:17:57.840 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T09:17:57.841 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T09:17:57.841 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T09:17:57.841 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2023-09-13T09:17:57.869 DEBUG:teuthology.orchestra.run.smithi053:> uname -m 2023-09-13T09:17:57.891 INFO:teuthology.orchestra.run.smithi053.stdout:x86_64 2023-09-13T09:17:57.891 DEBUG:teuthology.orchestra.run.smithi053:> cat /etc/os-release 2023-09-13T09:17:57.951 INFO:teuthology.orchestra.run.smithi053.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T09:17:57.951 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T09:17:57.951 INFO:teuthology.orchestra.run.smithi053.stdout:ID="rhel" 2023-09-13T09:17:57.952 INFO:teuthology.orchestra.run.smithi053.stdout:ID_LIKE="fedora" 2023-09-13T09:17:57.952 INFO:teuthology.orchestra.run.smithi053.stdout:VERSION_ID="8.6" 2023-09-13T09:17:57.952 INFO:teuthology.orchestra.run.smithi053.stdout:PLATFORM_ID="platform:el8" 2023-09-13T09:17:57.952 INFO:teuthology.orchestra.run.smithi053.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T09:17:57.952 INFO:teuthology.orchestra.run.smithi053.stdout:ANSI_COLOR="0;31" 2023-09-13T09:17:57.953 INFO:teuthology.orchestra.run.smithi053.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T09:17:57.953 INFO:teuthology.orchestra.run.smithi053.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T09:17:57.953 INFO:teuthology.orchestra.run.smithi053.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T09:17:57.953 INFO:teuthology.orchestra.run.smithi053.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T09:17:57.953 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:17:57.953 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T09:17:57.954 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T09:17:57.954 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T09:17:57.954 INFO:teuthology.orchestra.run.smithi053.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T09:17:57.955 INFO:teuthology.lock.ops:Updating smithi053.front.sepia.ceph.com on lock server 2023-09-13T09:17:57.977 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-09-13T09:17:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-09-13T09:17:58.075 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-09-13T09:17:58.098 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Red Hat Enterprise Linux" 2023-09-13T09:17:58.098 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="8.6 (Ootpa)" 2023-09-13T09:17:58.098 INFO:teuthology.orchestra.run.smithi131.stdout:ID="rhel" 2023-09-13T09:17:58.098 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="fedora" 2023-09-13T09:17:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="8.6" 2023-09-13T09:17:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el8" 2023-09-13T09:17:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-13T09:17:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2023-09-13T09:17:58.099 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-13T09:17:58.100 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.redhat.com/" 2023-09-13T09:17:58.100 INFO:teuthology.orchestra.run.smithi131.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-13T09:17:58.100 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-13T09:17:58.100 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:17:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-13T09:17:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-13T09:17:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-13T09:17:58.101 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-13T09:17:58.102 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-09-13T09:17:58.128 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-13T09:17:58.155 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-13T09:17:58.166 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-13T09:17:58.166 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2023-09-13T09:17:58.169 DEBUG:teuthology.orchestra.run.smithi053:> test '!' -e /home/ubuntu/cephtest 2023-09-13T09:17:58.172 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2023-09-13T09:17:58.190 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-13T09:17:58.196 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-13T09:17:58.196 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2023-09-13T09:17:58.229 DEBUG:teuthology.orchestra.run.smithi053:> test -z $(ls -A /var/lib/ceph) 2023-09-13T09:17:58.231 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2023-09-13T09:17:58.262 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-13T09:17:58.338 INFO:teuthology.run_tasks:Running task kernel... 2023-09-13T09:17:58.355 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-09-13T09:17:58.355 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2023-09-13T09:17:58.356 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2023-09-13T09:17:58.356 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T09:17:58.376 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T09:17:58.376 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2023-09-13T09:17:58.437 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-13T09:17:58.437 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-372.9.1.el8.x86_64 2023-09-13T09:17:58.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2023-09-13T09:17:59.676 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-09-13T09:17:59.676 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-09-13T09:18:01.278 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2023-09-13T09:18:02.071 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 21 MB/s | 16 MB 00:00 2023-09-13T09:18:05.771 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 394 kB/s | 24 kB 00:00 2023-09-13T09:18:06.474 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-13T09:18:06.528 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-09-13T09:18:06.529 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2023-09-13T09:18:06.529 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-09-13T09:18:06.654 DEBUG:teuthology.orchestra.run.smithi006:> echo no | sudo yum reinstall kernel || true 2023-09-13T09:18:07.004 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-09-13T09:18:07.005 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-09-13T09:18:07.278 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:02 ago on Wed 13 Sep 2023 09:18:05 AM UTC. 2023-09-13T09:18:07.324 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-13T09:18:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-09-13T09:18:07.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum reinstall -y kernel || true 2023-09-13T09:18:07.746 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-09-13T09:18:07.747 INFO:teuthology.orchestra.run.smithi006.stdout:Unable to read consumer identity 2023-09-13T09:18:08.011 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:03 ago on Wed 13 Sep 2023 09:18:05 AM UTC. 2023-09-13T09:18:08.056 INFO:teuthology.orchestra.run.smithi006.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-13T09:18:08.078 INFO:teuthology.orchestra.run.smithi006.stderr:Error: No packages marked for reinstall. 2023-09-13T09:18:08.126 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2023-09-13T09:18:08.209 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-13T09:18:08.210 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-13T09:18:08.210 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-13T09:18:08.211 DEBUG:teuthology.parallel:result is None 2023-09-13T09:18:08.211 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-13T09:18:08.219 INFO:teuthology.task.internal:Creating test directory... 2023-09-13T09:18:08.220 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T09:18:08.222 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T09:18:08.225 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-13T09:18:08.245 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-13T09:18:08.256 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-13T09:18:08.270 INFO:teuthology.task.internal:Creating archive directory... 2023-09-13T09:18:08.271 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T09:18:08.279 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T09:18:08.286 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-13T09:18:08.330 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-13T09:18:08.339 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-13T09:18:08.339 DEBUG:teuthology.orchestra.run.smithi053:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T09:18:08.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T09:18:08.373 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-13T09:18:08.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T09:18:08.392 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T09:18:08.395 DEBUG:teuthology.orchestra.run.smithi053:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T09:18:08.416 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-13T09:18:08.420 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T09:18:08.440 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T09:18:08.448 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T09:18:08.471 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T09:18:08.487 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T09:18:08.496 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-13T09:18:08.498 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-13T09:18:08.505 INFO:teuthology.task.internal:Configuring sudo... 2023-09-13T09:18:08.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T09:18:08.508 DEBUG:teuthology.orchestra.run.smithi053:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T09:18:08.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-13T09:18:08.570 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-13T09:18:08.580 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-13T09:18:08.581 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T09:18:08.583 DEBUG:teuthology.orchestra.run.smithi053:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T09:18:08.611 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-13T09:18:08.629 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T09:18:08.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T09:18:08.732 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T09:18:08.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T09:18:08.859 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:18:08.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T09:18:08.928 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T09:18:08.976 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T09:18:09.030 DEBUG:teuthology.orchestra.run.smithi053:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T09:18:09.117 DEBUG:teuthology.orchestra.run.smithi053:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T09:18:09.161 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:18:09.162 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T09:18:09.232 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T09:18:09.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-13T09:18:09.339 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T09:18:09.425 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-13T09:18:09.468 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:18:09.468 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-13T09:18:09.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2023-09-13T09:18:09.540 DEBUG:teuthology.orchestra.run.smithi053:> sudo service rsyslog restart 2023-09-13T09:18:09.543 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2023-09-13T09:18:09.615 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T09:18:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T09:18:09.693 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T09:18:10.029 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-13T09:18:10.037 INFO:teuthology.task.internal:Starting timer... 2023-09-13T09:18:10.038 INFO:teuthology.run_tasks:Running task pcp... 2023-09-13T09:18:10.051 INFO:teuthology.run_tasks:Running task selinux... 2023-09-13T09:18:10.063 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-09-13T09:18:10.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2023-09-13T09:18:10.125 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2023-09-13T09:18:10.127 DEBUG:teuthology.orchestra.run.smithi053:> sudo service auditd rotate 2023-09-13T09:18:10.195 INFO:teuthology.orchestra.run.smithi053.stdout:Rotating logs: 2023-09-13T09:18:10.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2023-09-13T09:18:10.272 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2023-09-13T09:18:10.273 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-13T09:18:10.274 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2023-09-13T09:18:10.298 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2023-09-13T09:18:10.299 DEBUG:teuthology.orchestra.run.smithi053:> /usr/sbin/getenforce 2023-09-13T09:18:10.318 INFO:teuthology.orchestra.run.smithi053.stdout:Permissive 2023-09-13T09:18:10.319 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2023-09-13T09:18:10.341 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2023-09-13T09:18:10.341 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi053.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2023-09-13T09:18:10.342 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T09:18:10.372 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T09:18:10.373 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T09:18:10.402 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T09:18:10.403 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T09:18:10.430 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T09:18:10.431 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-13T09:18:10.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2023-09-13T09:18:10.460 DEBUG:teuthology.orchestra.run.smithi053:> sudo /usr/sbin/setenforce permissive 2023-09-13T09:18:10.488 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2023-09-13T09:18:10.516 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-13T09:18:10.526 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-13T09:18:10.533 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-13T09:18:10.672 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-13T09:18:10.718 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-13T09:18:10.719 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi053.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-13T09:27:22.778 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi053.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2023-09-13T09:27:22.804 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-09-13T09:27:22.806 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T09:27:22.876 DEBUG:teuthology.orchestra.run.smithi006:> true 2023-09-13T09:27:22.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2023-09-13T09:27:22.949 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-09-13T09:27:22.950 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi053.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T09:27:23.019 DEBUG:teuthology.orchestra.run.smithi053:> true 2023-09-13T09:27:23.089 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi053.front.sepia.ceph.com' 2023-09-13T09:27:23.089 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-09-13T09:27:23.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-13T09:27:23.160 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-09-13T09:27:23.233 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-09-13T09:27:23.233 INFO:teuthology.run_tasks:Running task clock... 2023-09-13T09:27:23.245 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-13T09:27:23.245 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T09:27:23.246 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T09:27:23.248 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T09:27:23.249 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T09:27:23.252 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-13T09:27:23.252 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T09:27:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-13T09:27:23.286 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-13T09:27:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-13T09:27:23.303 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-13T09:27:23.306 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-13T09:27:23.321 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-13T09:27:23.371 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2023-09-13T09:27:23.378 INFO:teuthology.orchestra.run.smithi053.stderr:sudo: ntpd: command not found 2023-09-13T09:27:23.384 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2023-09-13T09:27:23.391 INFO:teuthology.orchestra.run.smithi053.stdout:506 Cannot talk to daemon 2023-09-13T09:27:23.396 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2023-09-13T09:27:23.399 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-13T09:27:23.408 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-13T09:27:23.409 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2023-09-13T09:27:23.414 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-13T09:27:23.423 INFO:teuthology.orchestra.run.smithi053.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-13T09:27:23.424 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-13T09:27:23.437 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-13T09:27:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-09-13T09:27:23.493 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-09-13T09:27:23.494 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T09:27:23.494 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-09-13T09:27:23.495 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.495 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.495 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.496 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.497 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T09:27:23.497 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-09-13T09:27:23.498 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.498 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.498 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.498 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.517 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-09-13T09:27:23.521 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T09:27:23.521 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-09-13T09:27:23.521 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.521 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.522 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.522 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T09:27:23.523 INFO:teuthology.run_tasks:Running task pexec... 2023-09-13T09:27:23.533 INFO:teuthology.task.pexec:Executing custom commands... 2023-09-13T09:27:23.534 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi006.front.sepia.ceph.com 2023-09-13T09:27:23.535 DEBUG:teuthology.orchestra.run.smithi006:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-13T09:27:23.535 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi053.front.sepia.ceph.com 2023-09-13T09:27:23.536 DEBUG:teuthology.orchestra.run.smithi053:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-13T09:27:23.536 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi131.front.sepia.ceph.com 2023-09-13T09:27:23.537 DEBUG:teuthology.orchestra.run.smithi131:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-09-13T09:27:23.929 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:23.929 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:23.935 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:24.812 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:47 ago on Wed 13 Sep 2023 09:25:37 AM UTC. 2023-09-13T09:27:24.830 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:30 ago on Wed 13 Sep 2023 09:25:54 AM UTC. 2023-09-13T09:27:24.831 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:35 ago on Wed 13 Sep 2023 09:25:49 AM UTC. 2023-09-13T09:27:26.554 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-09-13T09:27:26.555 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-09-13T09:27:26.556 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2023-09-13T09:27:26.556 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-09-13T09:27:26.556 INFO:teuthology.orchestra.run.smithi131.stdout:Resetting modules: 2023-09-13T09:27:26.556 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools 2023-09-13T09:27:26.556 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:27:26.557 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-09-13T09:27:26.557 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2023-09-13T09:27:26.557 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:27:26.819 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-09-13T09:27:26.820 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-09-13T09:27:26.821 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2023-09-13T09:27:26.821 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-09-13T09:27:26.821 INFO:teuthology.orchestra.run.smithi006.stdout:Resetting modules: 2023-09-13T09:27:26.821 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools 2023-09-13T09:27:26.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:27:26.822 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-09-13T09:27:26.822 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2023-09-13T09:27:26.822 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:27:26.840 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-09-13T09:27:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2023-09-13T09:27:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: Package Architecture Version Repository Size 2023-09-13T09:27:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2023-09-13T09:27:26.842 INFO:teuthology.orchestra.run.smithi053.stdout:Resetting modules: 2023-09-13T09:27:26.842 INFO:teuthology.orchestra.run.smithi053.stdout: container-tools 2023-09-13T09:27:26.843 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:27:26.843 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2023-09-13T09:27:26.843 INFO:teuthology.orchestra.run.smithi053.stdout:================================================================================ 2023-09-13T09:27:26.843 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:27:27.517 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:50 ago on Wed 13 Sep 2023 09:25:37 AM UTC. 2023-09-13T09:27:27.816 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:38 ago on Wed 13 Sep 2023 09:25:49 AM UTC. 2023-09-13T09:27:27.858 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:33 ago on Wed 13 Sep 2023 09:25:54 AM UTC. 2023-09-13T09:27:30.052 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-09-13T09:27:30.534 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:30.631 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-09-13T09:27:30.822 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-09-13T09:27:31.117 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:31.317 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:31.389 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:53 ago on Wed 13 Sep 2023 09:25:37 AM UTC. 2023-09-13T09:27:31.920 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:42 ago on Wed 13 Sep 2023 09:25:49 AM UTC. 2023-09-13T09:27:32.139 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:37 ago on Wed 13 Sep 2023 09:25:54 AM UTC. 2023-09-13T09:27:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-09-13T09:27:33.254 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================================ 2023-09-13T09:27:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-09-13T09:27:33.255 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================================ 2023-09-13T09:27:33.255 INFO:teuthology.orchestra.run.smithi131.stdout:Installing group/module packages: 2023-09-13T09:27:33.255 INFO:teuthology.orchestra.run.smithi131.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-13T09:27:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-13T09:27:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-13T09:27:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-13T09:27:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-13T09:27:33.256 INFO:teuthology.orchestra.run.smithi131.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-13T09:27:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-13T09:27:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-09-13T09:27:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-13T09:27:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-13T09:27:33.257 INFO:teuthology.orchestra.run.smithi131.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-13T09:27:33.257 INFO:teuthology.orchestra.run.smithi131.stdout:Installing module profiles: 2023-09-13T09:27:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools/common 2023-09-13T09:27:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:27:33.258 INFO:teuthology.orchestra.run.smithi131.stdout:Enabling module streams: 2023-09-13T09:27:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: container-tools rhel8 2023-09-13T09:27:33.258 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:27:33.259 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-09-13T09:27:33.259 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================================================ 2023-09-13T09:27:33.259 INFO:teuthology.orchestra.run.smithi131.stdout:Install 10 Packages 2023-09-13T09:27:33.259 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:27:33.260 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 18 M 2023-09-13T09:27:33.260 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 65 M 2023-09-13T09:27:33.261 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-09-13T09:27:33.334 INFO:teuthology.orchestra.run.smithi131.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-09-13T09:27:33.359 INFO:teuthology.orchestra.run.smithi131.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 243 kB/s | 25 kB 00:00 2023-09-13T09:27:33.384 INFO:teuthology.orchestra.run.smithi131.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 321 kB/s | 41 kB 00:00 2023-09-13T09:27:33.409 INFO:teuthology.orchestra.run.smithi131.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 655 kB/s | 49 kB 00:00 2023-09-13T09:27:33.444 INFO:teuthology.orchestra.run.smithi131.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-09-13T09:27:33.495 INFO:teuthology.orchestra.run.smithi131.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.7 MB/s | 149 kB 00:00 2023-09-13T09:27:33.527 INFO:teuthology.orchestra.run.smithi131.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 2.5 MB/s | 213 kB 00:00 2023-09-13T09:27:33.644 INFO:teuthology.orchestra.run.smithi131.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 19 MB/s | 2.2 MB 00:00 2023-09-13T09:27:33.753 INFO:teuthology.orchestra.run.smithi131.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 27 MB/s | 7.0 MB 00:00 2023-09-13T09:27:33.864 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-09-13T09:27:33.886 INFO:teuthology.orchestra.run.smithi131.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-09-13T09:27:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-09-13T09:27:33.887 INFO:teuthology.orchestra.run.smithi131.stdout:Total 29 MB/s | 18 MB 00:00 2023-09-13T09:27:33.968 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================================ 2023-09-13T09:27:33.969 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-09-13T09:27:33.969 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================================ 2023-09-13T09:27:33.969 INFO:teuthology.orchestra.run.smithi006.stdout:Installing group/module packages: 2023-09-13T09:27:33.969 INFO:teuthology.orchestra.run.smithi006.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-13T09:27:33.970 INFO:teuthology.orchestra.run.smithi006.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-13T09:27:33.970 INFO:teuthology.orchestra.run.smithi006.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-13T09:27:33.970 INFO:teuthology.orchestra.run.smithi006.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-13T09:27:33.970 INFO:teuthology.orchestra.run.smithi006.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-13T09:27:33.970 INFO:teuthology.orchestra.run.smithi006.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-13T09:27:33.971 INFO:teuthology.orchestra.run.smithi006.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-13T09:27:33.971 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-09-13T09:27:33.971 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-13T09:27:33.971 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-13T09:27:33.971 INFO:teuthology.orchestra.run.smithi006.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-13T09:27:33.972 INFO:teuthology.orchestra.run.smithi006.stdout:Installing module profiles: 2023-09-13T09:27:33.972 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools/common 2023-09-13T09:27:33.972 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:27:33.972 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2023-09-13T09:27:33.972 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools rhel8 2023-09-13T09:27:33.973 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:27:33.973 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-09-13T09:27:33.973 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================================ 2023-09-13T09:27:33.973 INFO:teuthology.orchestra.run.smithi006.stdout:Install 10 Packages 2023-09-13T09:27:33.973 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:27:33.974 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 18 M 2023-09-13T09:27:33.975 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 65 M 2023-09-13T09:27:33.975 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-09-13T09:27:34.038 INFO:teuthology.orchestra.run.smithi006.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 369 kB/s | 25 kB 00:00 2023-09-13T09:27:34.064 INFO:teuthology.orchestra.run.smithi006.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 440 kB/s | 41 kB 00:00 2023-09-13T09:27:34.088 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-09-13T09:27:34.090 INFO:teuthology.orchestra.run.smithi006.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 796 kB/s | 94 kB 00:00 2023-09-13T09:27:34.106 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-09-13T09:27:34.106 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-09-13T09:27:34.107 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-09-13T09:27:34.114 INFO:teuthology.orchestra.run.smithi006.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 654 kB/s | 49 kB 00:00 2023-09-13T09:27:34.148 INFO:teuthology.orchestra.run.smithi006.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-09-13T09:27:34.173 INFO:teuthology.orchestra.run.smithi006.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-09-13T09:27:34.198 INFO:teuthology.orchestra.run.smithi006.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 4.1 MB/s | 213 kB 00:00 2023-09-13T09:27:34.210 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================================================ 2023-09-13T09:27:34.210 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2023-09-13T09:27:34.210 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================================================ 2023-09-13T09:27:34.210 INFO:teuthology.orchestra.run.smithi053.stdout:Installing group/module packages: 2023-09-13T09:27:34.211 INFO:teuthology.orchestra.run.smithi053.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-09-13T09:27:34.211 INFO:teuthology.orchestra.run.smithi053.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-09-13T09:27:34.211 INFO:teuthology.orchestra.run.smithi053.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-09-13T09:27:34.211 INFO:teuthology.orchestra.run.smithi053.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-09-13T09:27:34.211 INFO:teuthology.orchestra.run.smithi053.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-09-13T09:27:34.212 INFO:teuthology.orchestra.run.smithi053.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-09-13T09:27:34.212 INFO:teuthology.orchestra.run.smithi053.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-09-13T09:27:34.212 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2023-09-13T09:27:34.212 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-09-13T09:27:34.212 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-09-13T09:27:34.213 INFO:teuthology.orchestra.run.smithi053.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-09-13T09:27:34.213 INFO:teuthology.orchestra.run.smithi053.stdout:Installing module profiles: 2023-09-13T09:27:34.213 INFO:teuthology.orchestra.run.smithi053.stdout: container-tools/common 2023-09-13T09:27:34.213 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:27:34.213 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling module streams: 2023-09-13T09:27:34.213 INFO:teuthology.orchestra.run.smithi053.stdout: container-tools rhel8 2023-09-13T09:27:34.214 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:27:34.214 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2023-09-13T09:27:34.214 INFO:teuthology.orchestra.run.smithi053.stdout:============================================================================================================ 2023-09-13T09:27:34.214 INFO:teuthology.orchestra.run.smithi053.stdout:Install 10 Packages 2023-09-13T09:27:34.214 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:27:34.215 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 18 M 2023-09-13T09:27:34.215 INFO:teuthology.orchestra.run.smithi053.stdout:Installed size: 65 M 2023-09-13T09:27:34.216 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2023-09-13T09:27:34.275 INFO:teuthology.orchestra.run.smithi053.stdout:(1/10): python3-pytoml-0.1.14-5.git7dea353.el8. 398 kB/s | 25 kB 00:00 2023-09-13T09:27:34.287 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-09-13T09:27:34.291 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-09-13T09:27:34.300 INFO:teuthology.orchestra.run.smithi053.stdout:(2/10): yajl-2.1.0-10.el8.x86_64.rpm 466 kB/s | 41 kB 00:00 2023-09-13T09:27:34.307 INFO:teuthology.orchestra.run.smithi006.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 20 MB/s | 2.2 MB 00:00 2023-09-13T09:27:34.334 INFO:teuthology.orchestra.run.smithi053.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 774 kB/s | 94 kB 00:00 2023-09-13T09:27:34.359 INFO:teuthology.orchestra.run.smithi053.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 590 kB/s | 49 kB 00:00 2023-09-13T09:27:34.392 INFO:teuthology.orchestra.run.smithi053.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 5.6 MB/s | 524 kB 00:00 2023-09-13T09:27:34.418 INFO:teuthology.orchestra.run.smithi053.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-09-13T09:27:34.435 INFO:teuthology.orchestra.run.smithi053.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 5.0 MB/s | 213 kB 00:00 2023-09-13T09:27:34.441 INFO:teuthology.orchestra.run.smithi006.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 26 MB/s | 7.0 MB 00:00 2023-09-13T09:27:34.525 INFO:teuthology.orchestra.run.smithi006.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-09-13T09:27:34.525 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-09-13T09:27:34.525 INFO:teuthology.orchestra.run.smithi006.stdout:Total 33 MB/s | 18 MB 00:00 2023-09-13T09:27:34.535 INFO:teuthology.orchestra.run.smithi053.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 22 MB/s | 2.2 MB 00:00 2023-09-13T09:27:34.669 INFO:teuthology.orchestra.run.smithi053.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 28 MB/s | 7.0 MB 00:00 2023-09-13T09:27:34.735 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-09-13T09:27:34.754 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-09-13T09:27:34.755 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-09-13T09:27:34.769 INFO:teuthology.orchestra.run.smithi053.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 18 MB/s | 8.0 MB 00:00 2023-09-13T09:27:34.769 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2023-09-13T09:27:34.770 INFO:teuthology.orchestra.run.smithi053.stdout:Total 33 MB/s | 18 MB 00:00 2023-09-13T09:27:34.829 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-09-13T09:27:34.950 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-09-13T09:27:34.955 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-09-13T09:27:34.976 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2023-09-13T09:27:34.997 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2023-09-13T09:27:34.997 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2023-09-13T09:27:35.029 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-13T09:27:35.191 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2023-09-13T09:27:35.195 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2023-09-13T09:27:35.201 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-13T09:27:35.412 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-13T09:27:35.489 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-09-13T09:27:35.598 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-13T09:27:35.664 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-13T09:27:35.739 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2023-09-13T09:27:35.864 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-13T09:27:35.896 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-09-13T09:27:35.980 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-13T09:27:36.048 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-13T09:27:36.061 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-13T09:27:36.262 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-09-13T09:27:36.293 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-13T09:27:36.442 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-09-13T09:27:36.671 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-13T09:27:36.758 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-13T09:27:36.789 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-09-13T09:27:37.503 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-13T09:27:37.603 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-09-13T09:27:37.632 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-13T09:27:37.863 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-13T09:27:38.042 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-13T09:27:38.194 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-13T09:27:38.440 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-13T09:27:38.459 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-13T09:27:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-13T09:27:38.460 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-13T09:27:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-13T09:27:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-13T09:27:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-13T09:27:38.461 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-13T09:27:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-13T09:27:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-13T09:27:38.462 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-13T09:27:38.492 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-09-13T09:27:38.667 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-13T09:27:38.688 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-09-13T09:27:38.829 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-13T09:27:38.837 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-09-13T09:27:39.013 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-13T09:27:39.029 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-13T09:27:39.294 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-13T09:27:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-13T09:27:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-13T09:27:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-13T09:27:39.295 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-13T09:27:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-13T09:27:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-13T09:27:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-13T09:27:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-13T09:27:39.296 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-13T09:27:39.302 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-09-13T09:27:39.302 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-09-13T09:27:39.303 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-09-13T09:27:39.303 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-09-13T09:27:39.303 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-09-13T09:27:39.303 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-09-13T09:27:39.303 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-09-13T09:27:39.303 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-09-13T09:27:39.304 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-09-13T09:27:39.304 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-09-13T09:27:39.594 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-13T09:27:39.595 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:02:02 ago on Wed 13 Sep 2023 09:25:37 AM UTC. 2023-09-13T09:27:40.420 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-13T09:27:40.420 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:45 ago on Wed 13 Sep 2023 09:25:54 AM UTC. 2023-09-13T09:27:40.460 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-09-13T09:27:40.461 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:51 ago on Wed 13 Sep 2023 09:25:49 AM UTC. 2023-09-13T09:27:42.135 INFO:teuthology.orchestra.run.smithi131.stdout:Installed products updated. 2023-09-13T09:27:42.330 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:27:42.331 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-09-13T09:27:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-13T09:27:42.331 INFO:teuthology.orchestra.run.smithi131.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-13T09:27:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-13T09:27:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-13T09:27:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:42.332 INFO:teuthology.orchestra.run.smithi131.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-13T09:27:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-13T09:27:42.333 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:27:42.333 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-09-13T09:27:42.472 DEBUG:teuthology.parallel:result is None 2023-09-13T09:27:44.082 INFO:teuthology.orchestra.run.smithi053.stdout:Installed products updated. 2023-09-13T09:27:44.115 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-09-13T09:27:44.286 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:27:44.287 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2023-09-13T09:27:44.287 INFO:teuthology.orchestra.run.smithi053.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.288 INFO:teuthology.orchestra.run.smithi053.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-13T09:27:44.288 INFO:teuthology.orchestra.run.smithi053.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.288 INFO:teuthology.orchestra.run.smithi053.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-13T09:27:44.289 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-13T09:27:44.289 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-13T09:27:44.290 INFO:teuthology.orchestra.run.smithi053.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.290 INFO:teuthology.orchestra.run.smithi053.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.290 INFO:teuthology.orchestra.run.smithi053.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-13T09:27:44.291 INFO:teuthology.orchestra.run.smithi053.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-13T09:27:44.291 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:27:44.291 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-09-13T09:27:44.330 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:27:44.330 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-09-13T09:27:44.330 INFO:teuthology.orchestra.run.smithi006.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.330 INFO:teuthology.orchestra.run.smithi006.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-09-13T09:27:44.331 INFO:teuthology.orchestra.run.smithi006.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.331 INFO:teuthology.orchestra.run.smithi006.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-09-13T09:27:44.331 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-09-13T09:27:44.331 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-09-13T09:27:44.331 INFO:teuthology.orchestra.run.smithi006.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.332 INFO:teuthology.orchestra.run.smithi006.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-09-13T09:27:44.332 INFO:teuthology.orchestra.run.smithi006.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-09-13T09:27:44.332 INFO:teuthology.orchestra.run.smithi006.stdout: yajl-2.1.0-10.el8.x86_64 2023-09-13T09:27:44.332 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:27:44.332 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-09-13T09:27:44.426 DEBUG:teuthology.parallel:result is None 2023-09-13T09:27:44.476 DEBUG:teuthology.parallel:result is None 2023-09-13T09:27:44.476 INFO:teuthology.run_tasks:Running task install... 2023-09-13T09:27:44.485 DEBUG:teuthology.task.install:project ceph 2023-09-13T09:27:44.485 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'}} 2023-09-13T09:27:44.486 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'} 2023-09-13T09:27:44.486 INFO:teuthology.task.install:Using flavor: default 2023-09-13T09:27:44.492 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-13T09:27:44.492 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-09-13T09:27:44.493 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'tag': None, 'wait_for_package': False} 2023-09-13T09:27:44.494 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:27:44.496 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'tag': None, 'wait_for_package': False} 2023-09-13T09:27:44.496 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:27:44.497 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'tag': None, 'wait_for_package': False} 2023-09-13T09:27:44.497 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:27:44.646 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/ 2023-09-13T09:27:44.646 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6083.g4a754ac9 2023-09-13T09:27:44.656 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/ 2023-09-13T09:27:44.656 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6083.g4a754ac9 2023-09-13T09:27:44.743 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/ 2023-09-13T09:27:44.744 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6083.g4a754ac9 2023-09-13T09:27:44.766 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-13T09:27:44.766 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:27:44.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-13T09:27:44.799 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-13T09:27:44.800 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-13T09:27:44.833 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-13T09:27:44.834 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:27:44.834 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-13T09:27:44.863 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-13T09:27:44.864 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-13T09:27:44.870 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-13T09:27:44.920 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-13T09:27:44.920 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:27:44.921 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-13T09:27:44.934 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-13T09:27:44.950 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-13T09:27:44.952 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-09-13T09:27:44.952 DEBUG:teuthology.orchestra.run.smithi053:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-13T09:27:45.014 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-13T09:27:45.018 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2023-09-13T09:27:45.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2023-09-13T09:27:45.022 DEBUG:teuthology.orchestra.run.smithi053:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-13T09:27:45.082 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2023-09-13T09:27:45.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2023-09-13T09:27:45.102 DEBUG:teuthology.orchestra.run.smithi053:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-13T09:27:45.170 INFO:teuthology.orchestra.run.smithi053.stdout:check_obsoletes = 1 2023-09-13T09:27:45.172 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum clean all 2023-09-13T09:27:45.393 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:45.474 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:45.565 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:45.704 INFO:teuthology.orchestra.run.smithi131.stdout:44 files removed 2023-09-13T09:27:45.751 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-13T09:27:45.765 INFO:teuthology.orchestra.run.smithi006.stdout:44 files removed 2023-09-13T09:27:45.813 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-13T09:27:45.848 INFO:teuthology.orchestra.run.smithi053.stdout:44 files removed 2023-09-13T09:27:45.896 DEBUG:teuthology.orchestra.run.smithi053:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-09-13T09:27:46.083 INFO:teuthology.orchestra.run.smithi131.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:46.165 INFO:teuthology.orchestra.run.smithi006.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:46.248 INFO:teuthology.orchestra.run.smithi053.stdout:Updating Subscription Management repositories. 2023-09-13T09:27:46.932 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 186 kB/s | 81 kB 00:00 2023-09-13T09:27:46.997 INFO:teuthology.orchestra.run.smithi053.stdout:ceph packages for x86_64 257 kB/s | 81 kB 00:00 2023-09-13T09:27:47.038 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 219 kB/s | 81 kB 00:00 2023-09-13T09:27:47.325 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-09-13T09:27:47.331 INFO:teuthology.orchestra.run.smithi053.stdout:ceph noarch packages 32 kB/s | 9.4 kB 00:00 2023-09-13T09:27:47.414 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 28 kB/s | 9.4 kB 00:00 2023-09-13T09:27:47.665 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 6.6 kB/s | 1.5 kB 00:00 2023-09-13T09:27:47.673 INFO:teuthology.orchestra.run.smithi053.stdout:ceph source packages 4.7 kB/s | 1.5 kB 00:00 2023-09-13T09:27:47.775 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 3.5 kB/s | 1.5 kB 00:00 2023-09-13T09:27:47.874 INFO:teuthology.orchestra.run.smithi053.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-09-13T09:27:47.951 INFO:teuthology.orchestra.run.smithi131.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2023-09-13T09:27:47.974 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 12 kB/s | 3.5 kB 00:00 2023-09-13T09:27:48.791 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 20 MB/s | 16 MB 00:00 2023-09-13T09:27:49.161 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 13 MB/s | 16 MB 00:01 2023-09-13T09:27:52.599 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 546 kB/s | 24 kB 00:00 2023-09-13T09:27:52.611 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 327 kB/s | 24 kB 00:00 2023-09-13T09:27:53.580 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-09-13T09:27:53.610 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 57 MB/s | 53 MB 00:00 2023-09-13T09:28:01.447 INFO:teuthology.orchestra.run.smithi131.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 61 MB/s | 53 MB 00:00 2023-09-13T09:28:02.594 INFO:teuthology.orchestra.run.smithi006.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 53 MB/s | 47 MB 00:00 2023-09-13T09:28:08.692 INFO:teuthology.orchestra.run.smithi053.stdout:Extra Packages for Enterprise Linux 780 kB/s | 16 MB 00:20 2023-09-13T09:28:12.464 INFO:teuthology.orchestra.run.smithi053.stdout:lab-extras 411 kB/s | 24 kB 00:00 2023-09-13T09:28:12.538 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T09:28:12.539 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T09:28:12.553 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-13T09:28:12.554 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-13T09:28:12.555 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-13T09:28:12.557 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-13T09:28:12.559 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-13T09:28:12.562 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-13T09:28:12.563 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T09:28:12.695 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2023-09-13T09:28:12.707 INFO:teuthology.orchestra.run.smithi131.stdout:=========================================================================================================================== 2023-09-13T09:28:12.707 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2023-09-13T09:28:12.708 INFO:teuthology.orchestra.run.smithi131.stdout:=========================================================================================================================== 2023-09-13T09:28:12.708 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2023-09-13T09:28:12.708 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-13T09:28:12.709 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-13T09:28:12.709 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.4 k 2023-09-13T09:28:12.709 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 5.4 M 2023-09-13T09:28:12.709 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 919 k 2023-09-13T09:28:12.710 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 167 k 2023-09-13T09:28:12.710 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 1.6 M 2023-09-13T09:28:12.710 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 132 k 2023-09-13T09:28:12.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 1.7 M 2023-09-13T09:28:12.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 7.4 M 2023-09-13T09:28:12.711 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 47 k 2023-09-13T09:28:12.712 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 14 M 2023-09-13T09:28:12.712 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 49 M 2023-09-13T09:28:12.712 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 261 k 2023-09-13T09:28:12.712 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 179 k 2023-09-13T09:28:12.712 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 260 k 2023-09-13T09:28:12.713 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 18 k 2023-09-13T09:28:12.713 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-13T09:28:12.713 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-13T09:28:12.713 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-13T09:28:12.713 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 31 k 2023-09-13T09:28:12.714 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 839 k 2023-09-13T09:28:12.714 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 139 k 2023-09-13T09:28:12.714 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-13T09:28:12.714 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-13T09:28:12.714 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-13T09:28:12.715 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-13T09:28:12.715 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-13T09:28:12.715 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-13T09:28:12.715 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 197 k 2023-09-13T09:28:12.715 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 370 k 2023-09-13T09:28:12.716 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 365 k 2023-09-13T09:28:12.716 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 107 k 2023-09-13T09:28:12.716 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 93 k 2023-09-13T09:28:12.716 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.6 M 2023-09-13T09:28:12.716 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 179 k 2023-09-13T09:28:12.716 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-13T09:28:12.717 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2023-09-13T09:28:12.717 INFO:teuthology.orchestra.run.smithi131.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-13T09:28:12.717 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T09:28:12.717 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T09:28:12.717 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2023-09-13T09:28:12.718 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-13T09:28:12.718 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 22 M 2023-09-13T09:28:12.718 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 23 k 2023-09-13T09:28:12.718 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 2.3 M 2023-09-13T09:28:12.719 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 242 k 2023-09-13T09:28:12.719 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 4.6 M 2023-09-13T09:28:12.719 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 18 M 2023-09-13T09:28:12.719 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 15 k 2023-09-13T09:28:12.719 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 24 k 2023-09-13T09:28:12.720 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-13T09:28:12.720 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-13T09:28:12.720 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-13T09:28:12.720 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-13T09:28:12.720 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-13T09:28:12.720 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 183 k 2023-09-13T09:28:12.721 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-13T09:28:12.721 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-13T09:28:12.721 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-13T09:28:12.721 INFO:teuthology.orchestra.run.smithi131.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-13T09:28:12.721 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-13T09:28:12.722 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-13T09:28:12.722 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 518 k 2023-09-13T09:28:12.722 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-13T09:28:12.722 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.8 M 2023-09-13T09:28:12.722 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-13T09:28:12.723 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-13T09:28:12.723 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-13T09:28:12.723 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-13T09:28:12.723 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-13T09:28:12.723 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-13T09:28:12.724 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-13T09:28:12.724 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-13T09:28:12.724 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-13T09:28:12.724 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-13T09:28:12.724 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-13T09:28:12.725 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-13T09:28:12.725 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-13T09:28:12.725 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-13T09:28:12.725 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-13T09:28:12.725 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-13T09:28:12.725 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 45 k 2023-09-13T09:28:12.726 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 125 k 2023-09-13T09:28:12.726 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-13T09:28:12.726 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-13T09:28:12.726 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-13T09:28:12.726 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-13T09:28:12.727 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-13T09:28:12.727 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-13T09:28:12.727 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-13T09:28:12.727 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-13T09:28:12.728 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-13T09:28:12.728 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-13T09:28:12.728 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-13T09:28:12.728 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T09:28:12.728 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-13T09:28:12.729 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-13T09:28:12.729 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-13T09:28:12.729 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-13T09:28:12.729 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-13T09:28:12.729 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-13T09:28:12.729 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-13T09:28:12.730 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-13T09:28:12.730 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-13T09:28:12.730 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-13T09:28:12.730 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-13T09:28:12.731 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-13T09:28:12.731 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-13T09:28:12.731 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-13T09:28:12.731 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-13T09:28:12.731 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-13T09:28:12.732 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-13T09:28:12.732 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-13T09:28:12.732 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T09:28:12.732 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-13T09:28:12.732 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-13T09:28:12.732 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-13T09:28:12.733 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-13T09:28:12.733 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-13T09:28:12.733 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-13T09:28:12.733 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-13T09:28:12.733 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-13T09:28:12.734 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-13T09:28:12.734 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-13T09:28:12.734 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-13T09:28:12.734 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-13T09:28:12.734 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-13T09:28:12.735 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-13T09:28:12.735 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-13T09:28:12.735 INFO:teuthology.orchestra.run.smithi131.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-13T09:28:12.735 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-13T09:28:12.735 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-13T09:28:12.736 INFO:teuthology.orchestra.run.smithi131.stdout:Enabling module streams: 2023-09-13T09:28:12.736 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql 10 2023-09-13T09:28:12.736 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:28:12.736 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2023-09-13T09:28:12.736 INFO:teuthology.orchestra.run.smithi131.stdout:=========================================================================================================================== 2023-09-13T09:28:12.736 INFO:teuthology.orchestra.run.smithi131.stdout:Install 128 Packages 2023-09-13T09:28:12.737 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 3 Packages 2023-09-13T09:28:12.737 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:28:12.738 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 208 M 2023-09-13T09:28:12.738 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2023-09-13T09:28:13.148 INFO:teuthology.orchestra.run.smithi131.stdout:(1/131): ceph-18.0.0-6083.g4a754ac9.el8.x86_64. 54 kB/s | 6.4 kB 00:00 2023-09-13T09:28:13.455 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 52 MB/s | 47 MB 00:00 2023-09-13T09:28:13.565 INFO:teuthology.orchestra.run.smithi131.stdout:(2/131): ceph-fuse-18.0.0-6083.g4a754ac9.el8.x8 2.2 MB/s | 919 kB 00:00 2023-09-13T09:28:13.641 INFO:teuthology.orchestra.run.smithi131.stdout:(3/131): ceph-base-18.0.0-6083.g4a754ac9.el8.x8 8.8 MB/s | 5.4 MB 00:00 2023-09-13T09:28:13.666 INFO:teuthology.orchestra.run.smithi131.stdout:(4/131): ceph-immutable-object-cache-18.0.0-608 1.6 MB/s | 167 kB 00:00 2023-09-13T09:28:13.891 INFO:teuthology.orchestra.run.smithi131.stdout:(5/131): ceph-mds-18.0.0-6083.g4a754ac9.el8.x86 9.3 MB/s | 2.3 MB 00:00 2023-09-13T09:28:14.250 INFO:teuthology.orchestra.run.smithi131.stdout:(6/131): ceph-mgr-18.0.0-6083.g4a754ac9.el8.x86 2.8 MB/s | 1.6 MB 00:00 2023-09-13T09:28:14.366 INFO:teuthology.orchestra.run.smithi131.stdout:(7/131): ceph-mon-18.0.0-6083.g4a754ac9.el8.x86 9.7 MB/s | 4.6 MB 00:00 2023-09-13T09:28:14.569 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T09:28:14.570 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T09:28:14.585 INFO:teuthology.orchestra.run.smithi006.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-13T09:28:14.586 INFO:teuthology.orchestra.run.smithi006.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-13T09:28:14.588 INFO:teuthology.orchestra.run.smithi006.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-13T09:28:14.589 INFO:teuthology.orchestra.run.smithi006.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-13T09:28:14.591 INFO:teuthology.orchestra.run.smithi006.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-13T09:28:14.594 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-13T09:28:14.596 INFO:teuthology.orchestra.run.smithi006.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T09:28:14.737 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2023-09-13T09:28:14.750 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-09-13T09:28:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2023-09-13T09:28:14.751 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-09-13T09:28:14.751 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2023-09-13T09:28:14.751 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-13T09:28:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-13T09:28:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.4 k 2023-09-13T09:28:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 5.4 M 2023-09-13T09:28:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 919 k 2023-09-13T09:28:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 167 k 2023-09-13T09:28:14.752 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 1.6 M 2023-09-13T09:28:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 132 k 2023-09-13T09:28:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 1.7 M 2023-09-13T09:28:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 7.4 M 2023-09-13T09:28:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 47 k 2023-09-13T09:28:14.753 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 14 M 2023-09-13T09:28:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 49 M 2023-09-13T09:28:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 261 k 2023-09-13T09:28:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 179 k 2023-09-13T09:28:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 260 k 2023-09-13T09:28:14.754 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 18 k 2023-09-13T09:28:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-13T09:28:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-13T09:28:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-13T09:28:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 31 k 2023-09-13T09:28:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 839 k 2023-09-13T09:28:14.755 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 139 k 2023-09-13T09:28:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-13T09:28:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-13T09:28:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-13T09:28:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-13T09:28:14.756 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-13T09:28:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-13T09:28:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 197 k 2023-09-13T09:28:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 370 k 2023-09-13T09:28:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 365 k 2023-09-13T09:28:14.757 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 107 k 2023-09-13T09:28:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 93 k 2023-09-13T09:28:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.6 M 2023-09-13T09:28:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 179 k 2023-09-13T09:28:14.758 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-13T09:28:14.758 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2023-09-13T09:28:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-13T09:28:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T09:28:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T09:28:14.759 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2023-09-13T09:28:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-13T09:28:14.759 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 22 M 2023-09-13T09:28:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 23 k 2023-09-13T09:28:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 2.3 M 2023-09-13T09:28:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 242 k 2023-09-13T09:28:14.760 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 4.6 M 2023-09-13T09:28:14.761 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 18 M 2023-09-13T09:28:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 15 k 2023-09-13T09:28:14.762 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 24 k 2023-09-13T09:28:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-13T09:28:14.763 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-13T09:28:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-13T09:28:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-13T09:28:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-13T09:28:14.764 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 183 k 2023-09-13T09:28:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-13T09:28:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-13T09:28:14.765 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-13T09:28:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-13T09:28:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-13T09:28:14.766 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-13T09:28:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 518 k 2023-09-13T09:28:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-13T09:28:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.8 M 2023-09-13T09:28:14.767 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-13T09:28:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-13T09:28:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-13T09:28:14.768 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-13T09:28:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-13T09:28:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-13T09:28:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-13T09:28:14.769 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-13T09:28:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-13T09:28:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-13T09:28:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-13T09:28:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-13T09:28:14.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-13T09:28:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-13T09:28:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-13T09:28:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-13T09:28:14.771 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 45 k 2023-09-13T09:28:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 125 k 2023-09-13T09:28:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-13T09:28:14.772 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-13T09:28:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-13T09:28:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-13T09:28:14.773 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-13T09:28:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-13T09:28:14.774 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-13T09:28:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-13T09:28:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-13T09:28:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-13T09:28:14.775 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-13T09:28:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T09:28:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-13T09:28:14.776 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-13T09:28:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-13T09:28:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-13T09:28:14.777 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-13T09:28:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-13T09:28:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-13T09:28:14.778 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-13T09:28:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-13T09:28:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-13T09:28:14.779 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-13T09:28:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-13T09:28:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-13T09:28:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-13T09:28:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-13T09:28:14.780 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-13T09:28:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-13T09:28:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-13T09:28:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T09:28:14.781 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-13T09:28:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-13T09:28:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-13T09:28:14.782 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-13T09:28:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-13T09:28:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-13T09:28:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-13T09:28:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-13T09:28:14.783 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-13T09:28:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-13T09:28:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-13T09:28:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-13T09:28:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-13T09:28:14.784 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-13T09:28:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-13T09:28:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-13T09:28:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-13T09:28:14.785 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-13T09:28:14.785 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2023-09-13T09:28:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql 10 2023-09-13T09:28:14.786 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:28:14.786 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2023-09-13T09:28:14.786 INFO:teuthology.orchestra.run.smithi006.stdout:=========================================================================================================================== 2023-09-13T09:28:14.787 INFO:teuthology.orchestra.run.smithi006.stdout:Install 128 Packages 2023-09-13T09:28:14.787 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 3 Packages 2023-09-13T09:28:14.787 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:28:14.788 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 208 M 2023-09-13T09:28:14.788 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2023-09-13T09:28:14.892 INFO:teuthology.orchestra.run.smithi131.stdout:(8/131): ceph-common-18.0.0-6083.g4a754ac9.el8. 12 MB/s | 22 MB 00:01 2023-09-13T09:28:14.943 INFO:teuthology.orchestra.run.smithi131.stdout:(9/131): ceph-selinux-18.0.0-6083.g4a754ac9.el8 488 kB/s | 24 kB 00:00 2023-09-13T09:28:15.428 INFO:teuthology.orchestra.run.smithi006.stdout:(1/131): ceph-18.0.0-6083.g4a754ac9.el8.x86_64. 19 kB/s | 6.4 kB 00:00 2023-09-13T09:28:15.726 INFO:teuthology.orchestra.run.smithi131.stdout:(10/131): ceph-radosgw-18.0.0-6083.g4a754ac9.el 10 MB/s | 14 MB 00:01 2023-09-13T09:28:15.834 INFO:teuthology.orchestra.run.smithi131.stdout:(11/131): cephfs-mirror-18.0.0-6083.g4a754ac9.e 2.4 MB/s | 260 kB 00:00 2023-09-13T09:28:15.837 INFO:teuthology.orchestra.run.smithi006.stdout:(2/131): ceph-fuse-18.0.0-6083.g4a754ac9.el8.x8 2.2 MB/s | 919 kB 00:00 2023-09-13T09:28:15.929 INFO:teuthology.orchestra.run.smithi131.stdout:(12/131): libcephfs-devel-18.0.0-6083.g4a754ac9 339 kB/s | 31 kB 00:00 2023-09-13T09:28:15.929 INFO:teuthology.orchestra.run.smithi006.stdout:(3/131): ceph-immutable-object-cache-18.0.0-608 1.8 MB/s | 167 kB 00:00 2023-09-13T09:28:16.262 INFO:teuthology.orchestra.run.smithi006.stdout:(4/131): ceph-base-18.0.0-6083.g4a754ac9.el8.x8 4.6 MB/s | 5.4 MB 00:01 2023-09-13T09:28:16.335 INFO:teuthology.orchestra.run.smithi131.stdout:(13/131): libcephfs2-18.0.0-6083.g4a754ac9.el8. 2.0 MB/s | 839 kB 00:00 2023-09-13T09:28:16.444 INFO:teuthology.orchestra.run.smithi131.stdout:(14/131): libcephsqlite-18.0.0-6083.g4a754ac9.e 1.7 MB/s | 183 kB 00:00 2023-09-13T09:28:16.536 INFO:teuthology.orchestra.run.smithi131.stdout:(15/131): librados-devel-18.0.0-6083.g4a754ac9. 1.5 MB/s | 139 kB 00:00 2023-09-13T09:28:16.639 INFO:teuthology.orchestra.run.smithi006.stdout:(5/131): ceph-mds-18.0.0-6083.g4a754ac9.el8.x86 3.3 MB/s | 2.3 MB 00:00 2023-09-13T09:28:16.671 INFO:teuthology.orchestra.run.smithi006.stdout:(6/131): ceph-mgr-18.0.0-6083.g4a754ac9.el8.x86 4.0 MB/s | 1.6 MB 00:00 2023-09-13T09:28:16.697 INFO:teuthology.orchestra.run.smithi131.stdout:(16/131): libradosstriper1-18.0.0-6083.g4a754ac 3.1 MB/s | 518 kB 00:00 2023-09-13T09:28:17.103 INFO:teuthology.orchestra.run.smithi131.stdout:(17/131): ceph-osd-18.0.0-6083.g4a754ac9.el8.x8 6.3 MB/s | 18 MB 00:02 2023-09-13T09:28:17.187 INFO:teuthology.orchestra.run.smithi131.stdout:(18/131): python3-ceph-argparse-18.0.0-6083.g4a 539 kB/s | 45 kB 00:00 2023-09-13T09:28:17.279 INFO:teuthology.orchestra.run.smithi131.stdout:(19/131): python3-ceph-common-18.0.0-6083.g4a75 1.3 MB/s | 125 kB 00:00 2023-09-13T09:28:17.371 INFO:teuthology.orchestra.run.smithi131.stdout:(20/131): python3-cephfs-18.0.0-6083.g4a754ac9. 2.1 MB/s | 197 kB 00:00 2023-09-13T09:28:17.479 INFO:teuthology.orchestra.run.smithi131.stdout:(21/131): python3-rados-18.0.0-6083.g4a754ac9.e 3.3 MB/s | 370 kB 00:00 2023-09-13T09:28:17.513 INFO:teuthology.orchestra.run.smithi006.stdout:(7/131): ceph-mon-18.0.0-6083.g4a754ac9.el8.x86 5.3 MB/s | 4.6 MB 00:00 2023-09-13T09:28:17.563 INFO:teuthology.orchestra.run.smithi131.stdout:(22/131): python3-rbd-18.0.0-6083.g4a754ac9.el8 4.3 MB/s | 365 kB 00:00 2023-09-13T09:28:17.647 INFO:teuthology.orchestra.run.smithi131.stdout:(23/131): python3-rgw-18.0.0-6083.g4a754ac9.el8 1.3 MB/s | 107 kB 00:00 2023-09-13T09:28:17.730 INFO:teuthology.orchestra.run.smithi131.stdout:(24/131): rbd-fuse-18.0.0-6083.g4a754ac9.el8.x8 1.1 MB/s | 93 kB 00:00 2023-09-13T09:28:18.322 INFO:teuthology.orchestra.run.smithi131.stdout:(25/131): librgw2-18.0.0-6083.g4a754ac9.el8.x86 4.2 MB/s | 6.8 MB 00:01 2023-09-13T09:28:18.390 INFO:teuthology.orchestra.run.smithi131.stdout:(26/131): rbd-mirror-18.0.0-6083.g4a754ac9.el8. 5.4 MB/s | 3.6 MB 00:00 2023-09-13T09:28:18.415 INFO:teuthology.orchestra.run.smithi131.stdout:(27/131): rbd-nbd-18.0.0-6083.g4a754ac9.el8.x86 1.9 MB/s | 179 kB 00:00 2023-09-13T09:28:18.440 INFO:teuthology.orchestra.run.smithi131.stdout:(28/131): ceph-grafana-dashboards-18.0.0-6083.g 458 kB/s | 23 kB 00:00 2023-09-13T09:28:18.482 INFO:teuthology.orchestra.run.smithi131.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6083.g4a754ac 1.9 MB/s | 132 kB 00:00 2023-09-13T09:28:18.732 INFO:teuthology.orchestra.run.smithi131.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6083.g4a754 6.0 MB/s | 1.7 MB 00:00 2023-09-13T09:28:18.816 INFO:teuthology.orchestra.run.smithi131.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6083.g4a 2.8 MB/s | 242 kB 00:00 2023-09-13T09:28:18.900 INFO:teuthology.orchestra.run.smithi131.stdout:(32/131): ceph-mgr-rook-18.0.0-6083.g4a754ac9.e 569 kB/s | 47 kB 00:00 2023-09-13T09:28:18.966 INFO:teuthology.orchestra.run.smithi131.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6083.g4 218 kB/s | 15 kB 00:00 2023-09-13T09:28:19.050 INFO:teuthology.orchestra.run.smithi131.stdout:(34/131): ceph-volume-18.0.0-6083.g4a754ac9.el8 3.1 MB/s | 261 kB 00:00 2023-09-13T09:28:19.134 INFO:teuthology.orchestra.run.smithi131.stdout:(35/131): cephadm-18.0.0-6083.g4a754ac9.el8.noa 2.1 MB/s | 179 kB 00:00 2023-09-13T09:28:19.209 INFO:teuthology.orchestra.run.smithi131.stdout:(36/131): cephfs-top-18.0.0-6083.g4a754ac9.el8. 240 kB/s | 18 kB 00:00 2023-09-13T09:28:19.489 INFO:teuthology.orchestra.run.smithi006.stdout:(8/131): ceph-osd-18.0.0-6083.g4a754ac9.el8.x86 6.3 MB/s | 18 MB 00:02 2023-09-13T09:28:19.556 INFO:teuthology.orchestra.run.smithi006.stdout:(9/131): ceph-selinux-18.0.0-6083.g4a754ac9.el8 366 kB/s | 24 kB 00:00 2023-09-13T09:28:19.668 INFO:teuthology.orchestra.run.smithi131.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 6.2 MB/s | 7.4 MB 00:01 2023-09-13T09:28:19.793 INFO:teuthology.orchestra.run.smithi131.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 525 kB/s | 306 kB 00:00 2023-09-13T09:28:19.910 INFO:teuthology.orchestra.run.smithi131.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 644 kB/s | 75 kB 00:00 2023-09-13T09:28:20.026 INFO:teuthology.orchestra.run.smithi006.stdout:(10/131): ceph-radosgw-18.0.0-6083.g4a754ac9.el 5.5 MB/s | 14 MB 00:02 2023-09-13T09:28:20.029 INFO:teuthology.orchestra.run.smithi131.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 163 kB/s | 59 kB 00:00 2023-09-13T09:28:20.081 INFO:teuthology.orchestra.run.smithi006.stdout:(11/131): cephfs-mirror-18.0.0-6083.g4a754ac9.e 4.4 MB/s | 260 kB 00:00 2023-09-13T09:28:20.140 INFO:teuthology.orchestra.run.smithi006.stdout:(12/131): libcephfs-devel-18.0.0-6083.g4a754ac9 534 kB/s | 31 kB 00:00 2023-09-13T09:28:20.146 INFO:teuthology.orchestra.run.smithi131.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 2.0 MB/s | 476 kB 00:00 2023-09-13T09:28:20.171 INFO:teuthology.orchestra.run.smithi131.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 307 kB/s | 44 kB 00:00 2023-09-13T09:28:20.264 INFO:teuthology.orchestra.run.smithi131.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.5 MB/s | 185 kB 00:00 2023-09-13T09:28:20.282 INFO:teuthology.orchestra.run.smithi006.stdout:(13/131): libcephfs2-18.0.0-6083.g4a754ac9.el8. 5.8 MB/s | 839 kB 00:00 2023-09-13T09:28:20.323 INFO:teuthology.orchestra.run.smithi131.stdout:(44/131): python3-cachetools-3.1.1-4.el8.noarch 218 kB/s | 33 kB 00:00 2023-09-13T09:28:20.341 INFO:teuthology.orchestra.run.smithi006.stdout:(14/131): libcephsqlite-18.0.0-6083.g4a754ac9.e 3.1 MB/s | 183 kB 00:00 2023-09-13T09:28:20.364 INFO:teuthology.orchestra.run.smithi131.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-09-13T09:28:20.391 INFO:teuthology.orchestra.run.smithi006.stdout:(15/131): librados-devel-18.0.0-6083.g4a754ac9. 2.7 MB/s | 139 kB 00:00 2023-09-13T09:28:20.498 INFO:teuthology.orchestra.run.smithi131.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 2.8 MB/s | 384 kB 00:00 2023-09-13T09:28:20.499 INFO:teuthology.orchestra.run.smithi006.stdout:(16/131): libradosstriper1-18.0.0-6083.g4a754ac 4.7 MB/s | 518 kB 00:00 2023-09-13T09:28:20.581 INFO:teuthology.orchestra.run.smithi131.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 668 kB/s | 173 kB 00:00 2023-09-13T09:28:20.607 INFO:teuthology.orchestra.run.smithi131.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 747 kB/s | 81 kB 00:00 2023-09-13T09:28:20.699 INFO:teuthology.orchestra.run.smithi131.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 95 kB/s | 11 kB 00:00 2023-09-13T09:28:20.716 INFO:teuthology.orchestra.run.smithi131.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 162 kB/s | 18 kB 00:00 2023-09-13T09:28:20.808 INFO:teuthology.orchestra.run.smithi131.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 532 kB/s | 49 kB 00:00 2023-09-13T09:28:20.908 INFO:teuthology.orchestra.run.smithi131.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 588 kB/s | 59 kB 00:00 2023-09-13T09:28:21.039 INFO:teuthology.orchestra.run.smithi131.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 3.4 MB/s | 1.2 MB 00:00 2023-09-13T09:28:21.059 INFO:teuthology.orchestra.run.smithi131.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 401 kB/s | 60 kB 00:00 2023-09-13T09:28:21.167 INFO:teuthology.orchestra.run.smithi131.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.2 MB/s | 283 kB 00:00 2023-09-13T09:28:21.184 INFO:teuthology.orchestra.run.smithi131.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 124 kB/s | 16 kB 00:00 2023-09-13T09:28:21.285 INFO:teuthology.orchestra.run.smithi131.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 288 kB/s | 34 kB 00:00 2023-09-13T09:28:21.310 INFO:teuthology.orchestra.run.smithi131.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.5 MB/s | 196 kB 00:00 2023-09-13T09:28:21.410 INFO:teuthology.orchestra.run.smithi131.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 512 kB/s | 64 kB 00:00 2023-09-13T09:28:21.436 INFO:teuthology.orchestra.run.smithi131.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2023-09-13T09:28:21.516 INFO:teuthology.orchestra.run.smithi006.stdout:(17/131): librgw2-18.0.0-6083.g4a754ac9.el8.x86 6.7 MB/s | 6.8 MB 00:01 2023-09-13T09:28:21.567 INFO:teuthology.orchestra.run.smithi006.stdout:(18/131): python3-ceph-argparse-18.0.0-6083.g4a 898 kB/s | 45 kB 00:00 2023-09-13T09:28:21.625 INFO:teuthology.orchestra.run.smithi006.stdout:(19/131): python3-ceph-common-18.0.0-6083.g4a75 2.1 MB/s | 125 kB 00:00 2023-09-13T09:28:21.692 INFO:teuthology.orchestra.run.smithi006.stdout:(20/131): python3-cephfs-18.0.0-6083.g4a754ac9. 2.9 MB/s | 197 kB 00:00 2023-09-13T09:28:21.751 INFO:teuthology.orchestra.run.smithi053.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 60 MB/s | 53 MB 00:00 2023-09-13T09:28:21.894 INFO:teuthology.orchestra.run.smithi131.stdout:(61/131): ceph-test-18.0.0-6083.g4a754ac9.el8.x 7.0 MB/s | 49 MB 00:06 2023-09-13T09:28:21.919 INFO:teuthology.orchestra.run.smithi131.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 47 kB/s | 24 kB 00:00 2023-09-13T09:28:21.935 INFO:teuthology.orchestra.run.smithi006.stdout:(21/131): ceph-common-18.0.0-6083.g4a754ac9.el8 3.3 MB/s | 22 MB 00:06 2023-09-13T09:28:21.945 INFO:teuthology.orchestra.run.smithi131.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 57 kB/s | 29 kB 00:00 2023-09-13T09:28:21.976 INFO:teuthology.orchestra.run.smithi006.stdout:(22/131): python3-rados-18.0.0-6083.g4a754ac9.e 1.3 MB/s | 370 kB 00:00 2023-09-13T09:28:22.027 INFO:teuthology.orchestra.run.smithi006.stdout:(23/131): python3-rgw-18.0.0-6083.g4a754ac9.el8 2.1 MB/s | 107 kB 00:00 2023-09-13T09:28:22.077 INFO:teuthology.orchestra.run.smithi006.stdout:(24/131): rbd-fuse-18.0.0-6083.g4a754ac9.el8.x8 1.8 MB/s | 93 kB 00:00 2023-09-13T09:28:22.095 INFO:teuthology.orchestra.run.smithi131.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.7 MB/s | 255 kB 00:00 2023-09-13T09:28:22.102 INFO:teuthology.orchestra.run.smithi006.stdout:(25/131): python3-rbd-18.0.0-6083.g4a754ac9.el8 2.1 MB/s | 365 kB 00:00 2023-09-13T09:28:22.120 INFO:teuthology.orchestra.run.smithi131.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.4 MB/s | 251 kB 00:00 2023-09-13T09:28:22.186 INFO:teuthology.orchestra.run.smithi006.stdout:(26/131): rbd-nbd-18.0.0-6083.g4a754ac9.el8.x86 2.1 MB/s | 179 kB 00:00 2023-09-13T09:28:22.187 INFO:teuthology.orchestra.run.smithi131.stdout:(66/131): python3-trustme-0.6.0-4.el8.noarch.rp 94 kB/s | 27 kB 00:00 2023-09-13T09:28:22.242 INFO:teuthology.orchestra.run.smithi131.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 417 kB/s | 61 kB 00:00 2023-09-13T09:28:22.269 INFO:teuthology.orchestra.run.smithi006.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6083.g 277 kB/s | 23 kB 00:00 2023-09-13T09:28:22.271 INFO:teuthology.orchestra.run.smithi131.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 566 kB/s | 85 kB 00:00 2023-09-13T09:28:22.297 INFO:teuthology.orchestra.run.smithi131.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-13T09:28:22.330 INFO:teuthology.orchestra.run.smithi131.stdout:(70/131): python3-zc-lockfile-2.0-2.el8.noarch. 161 kB/s | 23 kB 00:00 2023-09-13T09:28:22.379 INFO:teuthology.orchestra.run.smithi006.stdout:(28/131): ceph-mgr-cephadm-18.0.0-6083.g4a754ac 1.2 MB/s | 132 kB 00:00 2023-09-13T09:28:22.389 INFO:teuthology.orchestra.run.smithi131.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-09-13T09:28:22.423 INFO:teuthology.orchestra.run.smithi131.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-09-13T09:28:22.465 INFO:teuthology.orchestra.run.smithi131.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-09-13T09:28:22.504 INFO:teuthology.orchestra.run.smithi006.stdout:(29/131): rbd-mirror-18.0.0-6083.g4a754ac9.el8. 8.4 MB/s | 3.6 MB 00:00 2023-09-13T09:28:22.506 INFO:teuthology.orchestra.run.smithi131.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-09-13T09:28:22.549 INFO:teuthology.orchestra.run.smithi131.stdout:(75/131): thrift-0.13.0-2.el8.x86_64.rpm 5.7 MB/s | 1.7 MB 00:00 2023-09-13T09:28:22.574 INFO:teuthology.orchestra.run.smithi131.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 579 kB/s | 39 kB 00:00 2023-09-13T09:28:22.633 INFO:teuthology.orchestra.run.smithi131.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 9.9 MB/s | 538 kB 00:00 2023-09-13T09:28:22.658 INFO:teuthology.orchestra.run.smithi131.stdout:(78/131): bison-3.0.4-10.el8.x86_64.rpm 6.2 MB/s | 688 kB 00:00 2023-09-13T09:28:22.683 INFO:teuthology.orchestra.run.smithi131.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.1 MB/s | 157 kB 00:00 2023-09-13T09:28:22.708 INFO:teuthology.orchestra.run.smithi131.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-09-13T09:28:22.742 INFO:teuthology.orchestra.run.smithi131.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-09-13T09:28:22.792 INFO:teuthology.orchestra.run.smithi131.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 531 kB/s | 27 kB 00:00 2023-09-13T09:28:22.810 INFO:teuthology.orchestra.run.smithi006.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6083.g4a754 4.1 MB/s | 1.7 MB 00:00 2023-09-13T09:28:22.835 INFO:teuthology.orchestra.run.smithi131.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-13T09:28:22.876 INFO:teuthology.orchestra.run.smithi131.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-09-13T09:28:22.896 INFO:teuthology.orchestra.run.smithi006.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6083.g4a 2.8 MB/s | 242 kB 00:00 2023-09-13T09:28:22.963 INFO:teuthology.orchestra.run.smithi006.stdout:(32/131): ceph-mgr-rook-18.0.0-6083.g4a754ac9.e 715 kB/s | 47 kB 00:00 2023-09-13T09:28:23.021 INFO:teuthology.orchestra.run.smithi006.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6083.g4 249 kB/s | 15 kB 00:00 2023-09-13T09:28:23.052 INFO:teuthology.orchestra.run.smithi131.stdout:(85/131): python3-scipy-1.0.0-21.module+el8.5.0 18 MB/s | 14 MB 00:00 2023-09-13T09:28:23.147 INFO:teuthology.orchestra.run.smithi006.stdout:(34/131): ceph-volume-18.0.0-6083.g4a754ac9.el8 2.0 MB/s | 261 kB 00:00 2023-09-13T09:28:23.194 INFO:teuthology.orchestra.run.smithi131.stdout:(86/131): python3-babel-2.5.1-7.el8.noarch.rpm 9.9 MB/s | 4.8 MB 00:00 2023-09-13T09:28:23.230 INFO:teuthology.orchestra.run.smithi006.stdout:(35/131): cephadm-18.0.0-6083.g4a754ac9.el8.noa 2.1 MB/s | 179 kB 00:00 2023-09-13T09:28:23.423 INFO:teuthology.orchestra.run.smithi131.stdout:(87/131): python3-werkzeug-0.12.2-4.el8.noarch. 1.2 MB/s | 457 kB 00:00 2023-09-13T09:28:23.456 INFO:teuthology.orchestra.run.smithi006.stdout:(36/131): ceph-mgr-diskprediction-local-18.0.0- 7.8 MB/s | 7.4 MB 00:00 2023-09-13T09:28:23.481 INFO:teuthology.orchestra.run.smithi006.stdout:(37/131): cephfs-top-18.0.0-6083.g4a754ac9.el8. 72 kB/s | 18 kB 00:00 2023-09-13T09:28:23.561 INFO:teuthology.orchestra.run.smithi131.stdout:(88/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 614 kB/s | 225 kB 00:00 2023-09-13T09:28:23.586 INFO:teuthology.orchestra.run.smithi131.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 391 kB/s | 64 kB 00:00 2023-09-13T09:28:23.612 INFO:teuthology.orchestra.run.smithi131.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-09-13T09:28:23.637 INFO:teuthology.orchestra.run.smithi131.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 398 kB/s | 20 kB 00:00 2023-09-13T09:28:23.656 INFO:teuthology.orchestra.run.smithi006.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 336 kB/s | 59 kB 00:00 2023-09-13T09:28:23.662 INFO:teuthology.orchestra.run.smithi131.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-09-13T09:28:23.705 INFO:teuthology.orchestra.run.smithi131.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-09-13T09:28:23.732 INFO:teuthology.orchestra.run.smithi006.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-09-13T09:28:23.747 INFO:teuthology.orchestra.run.smithi131.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-09-13T09:28:23.774 INFO:teuthology.orchestra.run.smithi006.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2023-09-13T09:28:23.825 INFO:teuthology.orchestra.run.smithi131.stdout:(95/131): python3-numpy-1.14.3-10.el8.x86_64.rp 3.9 MB/s | 3.7 MB 00:00 2023-09-13T09:28:23.872 INFO:teuthology.orchestra.run.smithi131.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.3 MB/s | 202 kB 00:00 2023-09-13T09:28:23.914 INFO:teuthology.orchestra.run.smithi131.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-09-13T09:28:23.990 INFO:teuthology.orchestra.run.smithi131.stdout:(98/131): openblas-threads-0.3.15-3.el8.x86_64. 15 MB/s | 4.9 MB 00:00 2023-09-13T09:28:24.013 INFO:teuthology.orchestra.run.smithi006.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-09-13T09:28:24.040 INFO:teuthology.orchestra.run.smithi131.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-09-13T09:28:24.041 INFO:teuthology.orchestra.run.smithi006.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 163 kB/s | 44 kB 00:00 2023-09-13T09:28:24.074 INFO:teuthology.orchestra.run.smithi006.stdout:(43/131): python3-beautifulsoup4-4.6.3-2.el8.1. 2.9 MB/s | 185 kB 00:00 2023-09-13T09:28:24.107 INFO:teuthology.orchestra.run.smithi131.stdout:(100/131): openblas-0.3.15-3.el8.x86_64.rpm 13 MB/s | 4.7 MB 00:00 2023-09-13T09:28:24.140 INFO:teuthology.orchestra.run.smithi131.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-09-13T09:28:24.216 INFO:teuthology.orchestra.run.smithi131.stdout:(102/131): postgresql-10.21-2.module+el8.6.0+15 8.6 MB/s | 1.5 MB 00:00 2023-09-13T09:28:24.241 INFO:teuthology.orchestra.run.smithi131.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.9 MB/s | 200 kB 00:00 2023-09-13T09:28:24.266 INFO:teuthology.orchestra.run.smithi131.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 848 kB/s | 43 kB 00:00 2023-09-13T09:28:24.292 INFO:teuthology.orchestra.run.smithi131.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-09-13T09:28:24.317 INFO:teuthology.orchestra.run.smithi131.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 955 kB/s | 48 kB 00:00 2023-09-13T09:28:24.351 INFO:teuthology.orchestra.run.smithi131.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.5 MB/s | 87 kB 00:00 2023-09-13T09:28:24.376 INFO:teuthology.orchestra.run.smithi131.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 731 kB/s | 43 kB 00:00 2023-09-13T09:28:24.401 INFO:teuthology.orchestra.run.smithi131.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-09-13T09:28:24.427 INFO:teuthology.orchestra.run.smithi131.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.4 MB/s | 229 kB 00:00 2023-09-13T09:28:24.460 INFO:teuthology.orchestra.run.smithi131.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-09-13T09:28:24.485 INFO:teuthology.orchestra.run.smithi131.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 319 kB/s | 19 kB 00:00 2023-09-13T09:28:24.511 INFO:teuthology.orchestra.run.smithi131.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-09-13T09:28:24.575 INFO:teuthology.orchestra.run.smithi006.stdout:(44/131): ceph-test-18.0.0-6083.g4a754ac9.el8.x 9.7 MB/s | 49 MB 00:05 2023-09-13T09:28:24.595 INFO:teuthology.orchestra.run.smithi131.stdout:(114/131): postgresql-server-10.21-2.module+el8 7.4 MB/s | 5.1 MB 00:00 2023-09-13T09:28:24.620 INFO:teuthology.orchestra.run.smithi131.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 165 kB/s | 18 kB 00:00 2023-09-13T09:28:24.634 INFO:teuthology.orchestra.run.smithi006.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 56 kB/s | 33 kB 00:00 2023-09-13T09:28:24.653 INFO:teuthology.orchestra.run.smithi131.stdout:(116/131): python3-cryptography-3.2.1-5.el8.x86 3.3 MB/s | 559 kB 00:00 2023-09-13T09:28:24.659 INFO:teuthology.orchestra.run.smithi006.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 28 kB/s | 16 kB 00:00 2023-09-13T09:28:24.676 INFO:teuthology.orchestra.run.smithi006.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-09-13T09:28:24.679 INFO:teuthology.orchestra.run.smithi131.stdout:(117/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.1 MB/s | 605 kB 00:00 2023-09-13T09:28:24.704 INFO:teuthology.orchestra.run.smithi131.stdout:(118/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-09-13T09:28:24.709 INFO:teuthology.orchestra.run.smithi006.stdout:(48/131): python3-cherrypy-18.4.0-1.el8.noarch. 5.0 MB/s | 384 kB 00:00 2023-09-13T09:28:24.735 INFO:teuthology.orchestra.run.smithi006.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 189 kB/s | 11 kB 00:00 2023-09-13T09:28:24.738 INFO:teuthology.orchestra.run.smithi131.stdout:(119/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.2 MB/s | 72 kB 00:00 2023-09-13T09:28:24.768 INFO:teuthology.orchestra.run.smithi006.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 300 kB/s | 18 kB 00:00 2023-09-13T09:28:24.772 INFO:teuthology.orchestra.run.smithi131.stdout:(120/131): fuse-2.9.7-15.el8.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2023-09-13T09:28:24.797 INFO:teuthology.orchestra.run.smithi131.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 1.0 MB/s | 60 kB 00:00 2023-09-13T09:28:24.822 INFO:teuthology.orchestra.run.smithi131.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-09-13T09:28:24.827 INFO:teuthology.orchestra.run.smithi006.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 836 kB/s | 49 kB 00:00 2023-09-13T09:28:24.847 INFO:teuthology.orchestra.run.smithi131.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-13T09:28:24.869 INFO:teuthology.orchestra.run.smithi006.stdout:(52/131): python3-google-auth-1.1.1-10.el8.noar 388 kB/s | 81 kB 00:00 2023-09-13T09:28:24.873 INFO:teuthology.orchestra.run.smithi131.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 769 kB/s | 39 kB 00:00 2023-09-13T09:28:24.894 INFO:teuthology.orchestra.run.smithi006.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 880 kB/s | 59 kB 00:00 2023-09-13T09:28:24.933 INFO:teuthology.orchestra.run.smithi131.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 7.5 MB/s | 644 kB 00:00 2023-09-13T09:28:24.936 INFO:teuthology.orchestra.run.smithi006.stdout:(54/131): python3-kubernetes-11.0.0-6.el8.noarc 5.8 MB/s | 1.2 MB 00:00 2023-09-13T09:28:24.957 INFO:teuthology.orchestra.run.smithi131.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.0 MB/s | 171 kB 00:00 2023-09-13T09:28:24.962 INFO:teuthology.orchestra.run.smithi006.stdout:(55/131): python3-natsort-7.1.1-2.el8.noarch.rp 655 kB/s | 60 kB 00:00 2023-09-13T09:28:24.982 INFO:teuthology.orchestra.run.smithi131.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-09-13T09:28:24.987 INFO:teuthology.orchestra.run.smithi006.stdout:(56/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.0 MB/s | 283 kB 00:00 2023-09-13T09:28:25.012 INFO:teuthology.orchestra.run.smithi006.stdout:(57/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-09-13T09:28:25.050 INFO:teuthology.orchestra.run.smithi131.stdout:(128/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 5.9 MB/s | 2.3 MB 00:00 2023-09-13T09:28:25.060 INFO:teuthology.orchestra.run.smithi006.stdout:(58/131): python3-repoze-lru-0.7-6.el8.noarch.r 341 kB/s | 34 kB 00:00 2023-09-13T09:28:25.079 INFO:teuthology.orchestra.run.smithi006.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 958 kB/s | 64 kB 00:00 2023-09-13T09:28:25.099 INFO:teuthology.orchestra.run.smithi131.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 16 MB/s | 798 kB 00:00 2023-09-13T09:28:25.104 INFO:teuthology.orchestra.run.smithi006.stdout:(60/131): python3-routes-2.4.1-12.el8.noarch.rp 1.6 MB/s | 196 kB 00:00 2023-09-13T09:28:25.122 INFO:teuthology.orchestra.run.smithi006.stdout:(61/131): python3-simplegeneric-0.8.1-17.el8.no 308 kB/s | 19 kB 00:00 2023-09-13T09:28:25.139 INFO:teuthology.orchestra.run.smithi006.stdout:(62/131): python3-singledispatch-3.4.0.3-18.el8 405 kB/s | 24 kB 00:00 2023-09-13T09:28:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:(63/131): python3-tempora-1.14.1-5.el8.noarch.r 576 kB/s | 29 kB 00:00 2023-09-13T09:28:25.181 INFO:teuthology.orchestra.run.smithi006.stdout:(64/131): python3-trustme-0.6.0-4.el8.noarch.rp 464 kB/s | 27 kB 00:00 2023-09-13T09:28:25.206 INFO:teuthology.orchestra.run.smithi006.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-09-13T09:28:25.232 INFO:teuthology.orchestra.run.smithi006.stdout:(66/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.2 MB/s | 251 kB 00:00 2023-09-13T09:28:25.257 INFO:teuthology.orchestra.run.smithi006.stdout:(67/131): python3-websocket-client-0.56.0-5.el8 813 kB/s | 61 kB 00:00 2023-09-13T09:28:25.282 INFO:teuthology.orchestra.run.smithi006.stdout:(68/131): python3-webtest-2.0.33-1.el8.noarch.r 1.1 MB/s | 85 kB 00:00 2023-09-13T09:28:25.299 INFO:teuthology.orchestra.run.smithi006.stdout:(69/131): python3-zc-lockfile-2.0-2.el8.noarch. 342 kB/s | 23 kB 00:00 2023-09-13T09:28:25.324 INFO:teuthology.orchestra.run.smithi006.stdout:(70/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.6 MB/s | 70 kB 00:00 2023-09-13T09:28:25.366 INFO:teuthology.orchestra.run.smithi006.stdout:(71/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 700 kB/s | 47 kB 00:00 2023-09-13T09:28:25.375 INFO:teuthology.orchestra.run.smithi131.stdout:(130/131): librados2-18.0.0-6083.g4a754ac9.el8. 9.0 MB/s | 3.7 MB 00:00 2023-09-13T09:28:25.392 INFO:teuthology.orchestra.run.smithi006.stdout:(72/131): libselinux-devel-2.9-5.el8.x86_64.rpm 3.4 MB/s | 200 kB 00:00 2023-09-13T09:28:25.409 INFO:teuthology.orchestra.run.smithi006.stdout:(73/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-09-13T09:28:25.434 INFO:teuthology.orchestra.run.smithi006.stdout:(74/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.2 MB/s | 220 kB 00:00 2023-09-13T09:28:25.449 INFO:teuthology.orchestra.run.smithi131.stdout:(131/131): librbd1-18.0.0-6083.g4a754ac9.el8.x8 7.9 MB/s | 3.7 MB 00:00 2023-09-13T09:28:25.452 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2023-09-13T09:28:25.453 INFO:teuthology.orchestra.run.smithi131.stdout:Total 16 MB/s | 208 MB 00:12 2023-09-13T09:28:25.459 INFO:teuthology.orchestra.run.smithi006.stdout:(75/131): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-09-13T09:28:25.484 INFO:teuthology.orchestra.run.smithi006.stdout:(76/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-13T09:28:25.543 INFO:teuthology.orchestra.run.smithi006.stdout:(77/131): python3-requests-oauthlib-1.0.0-1.el8 510 kB/s | 43 kB 00:00 2023-09-13T09:28:25.560 INFO:teuthology.orchestra.run.smithi006.stdout:(78/131): python3-pycparser-2.14-14.el8.noarch. 1.4 MB/s | 109 kB 00:00 2023-09-13T09:28:25.602 INFO:teuthology.orchestra.run.smithi006.stdout:(79/131): thrift-0.13.0-2.el8.x86_64.rpm 5.0 MB/s | 1.7 MB 00:00 2023-09-13T09:28:25.627 INFO:teuthology.orchestra.run.smithi006.stdout:(80/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-09-13T09:28:25.669 INFO:teuthology.orchestra.run.smithi006.stdout:(81/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 5.0 MB/s | 560 kB 00:00 2023-09-13T09:28:25.695 INFO:teuthology.orchestra.run.smithi006.stdout:(82/131): libaio-devel-0.3.112-1.el8.x86_64.rpm 202 kB/s | 19 kB 00:00 2023-09-13T09:28:25.720 INFO:teuthology.orchestra.run.smithi006.stdout:(83/131): python3-oauthlib-2.1.0-1.el8.noarch.r 1.8 MB/s | 155 kB 00:00 2023-09-13T09:28:25.745 INFO:teuthology.orchestra.run.smithi006.stdout:(84/131): libverto-devel-0.3.0-5.el8.x86_64.rpm 357 kB/s | 18 kB 00:00 2023-09-13T09:28:25.778 INFO:teuthology.orchestra.run.smithi006.stdout:(85/131): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-09-13T09:28:25.812 INFO:teuthology.orchestra.run.smithi006.stdout:(86/131): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-09-13T09:28:25.838 INFO:teuthology.orchestra.run.smithi006.stdout:(87/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-09-13T09:28:25.863 INFO:teuthology.orchestra.run.smithi006.stdout:(88/131): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-09-13T09:28:25.888 INFO:teuthology.orchestra.run.smithi006.stdout:(89/131): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-09-13T09:28:25.913 INFO:teuthology.orchestra.run.smithi006.stdout:(90/131): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-09-13T09:28:25.981 INFO:teuthology.orchestra.run.smithi006.stdout:(91/131): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.0 MB/s | 98 kB 00:00 2023-09-13T09:28:26.006 INFO:teuthology.orchestra.run.smithi006.stdout:(92/131): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 627 kB/s | 58 kB 00:00 2023-09-13T09:28:26.031 INFO:teuthology.orchestra.run.smithi006.stdout:(93/131): libcom_err-devel-1.45.6-4.el8.x86_64. 769 kB/s | 39 kB 00:00 2023-09-13T09:28:26.073 INFO:teuthology.orchestra.run.smithi006.stdout:(94/131): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-09-13T09:28:26.098 INFO:teuthology.orchestra.run.smithi006.stdout:(95/131): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-09-13T09:28:26.124 INFO:teuthology.orchestra.run.smithi006.stdout:(96/131): NetworkManager-initscripts-updown-1.3 2.7 MB/s | 138 kB 00:00 2023-09-13T09:28:26.166 INFO:teuthology.orchestra.run.smithi006.stdout:(97/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-09-13T09:28:26.216 INFO:teuthology.orchestra.run.smithi006.stdout:(98/131): openssl-devel-1.1.1k-7.el8_6.x86_64.r 5.3 MB/s | 2.3 MB 00:00 2023-09-13T09:28:26.241 INFO:teuthology.orchestra.run.smithi006.stdout:(99/131): python3-pytz-2017.2-9.el8.noarch.rpm 721 kB/s | 54 kB 00:00 2023-09-13T09:28:26.271 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2023-09-13T09:28:26.275 INFO:teuthology.orchestra.run.smithi006.stdout:(100/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-09-13T09:28:26.308 INFO:teuthology.orchestra.run.smithi006.stdout:(101/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-09-13T09:28:26.333 INFO:teuthology.orchestra.run.smithi006.stdout:(102/131): python3-markupsafe-0.23-19.el8.x86_6 663 kB/s | 39 kB 00:00 2023-09-13T09:28:26.384 INFO:teuthology.orchestra.run.smithi006.stdout:(103/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-09-13T09:28:26.391 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2023-09-13T09:28:26.391 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2023-09-13T09:28:26.451 INFO:teuthology.orchestra.run.smithi006.stdout:(104/131): python3-jinja2-2.10.1-3.el8.noarch.r 4.5 MB/s | 538 kB 00:00 2023-09-13T09:28:26.476 INFO:teuthology.orchestra.run.smithi006.stdout:(105/131): python3-mako-1.0.6-13.el8.noarch.rpm 1.7 MB/s | 157 kB 00:00 2023-09-13T09:28:26.502 INFO:teuthology.orchestra.run.smithi006.stdout:(106/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-09-13T09:28:26.544 INFO:teuthology.orchestra.run.smithi006.stdout:(107/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-09-13T09:28:26.577 INFO:teuthology.orchestra.run.smithi006.stdout:(108/131): python3-jsonpatch-1.21-2.el8.noarch. 804 kB/s | 27 kB 00:00 2023-09-13T09:28:26.619 INFO:teuthology.orchestra.run.smithi006.stdout:(109/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-13T09:28:26.653 INFO:teuthology.orchestra.run.smithi006.stdout:(110/131): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-09-13T09:28:26.761 INFO:teuthology.orchestra.run.smithi006.stdout:(111/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-09-13T09:28:26.820 INFO:teuthology.orchestra.run.smithi006.stdout:(112/131): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-09-13T09:28:26.890 INFO:teuthology.orchestra.run.smithi006.stdout:(113/131): python3-numpy-f2py-1.14.3-10.el8.x86 3.1 MB/s | 225 kB 00:00 2023-09-13T09:28:26.962 INFO:teuthology.orchestra.run.smithi006.stdout:(114/131): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-09-13T09:28:26.987 INFO:teuthology.orchestra.run.smithi006.stdout:(115/131): uuid-1.6.2-43.el8.x86_64.rpm 660 kB/s | 64 kB 00:00 2023-09-13T09:28:27.013 INFO:teuthology.orchestra.run.smithi006.stdout:(116/131): python3-pyasn1-0.3.7-6.el8.noarch.rp 2.5 MB/s | 126 kB 00:00 2023-09-13T09:28:27.038 INFO:teuthology.orchestra.run.smithi006.stdout:(117/131): python3-jsonpointer-1.10-11.el8.noar 400 kB/s | 20 kB 00:00 2023-09-13T09:28:27.063 INFO:teuthology.orchestra.run.smithi006.stdout:(118/131): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-09-13T09:28:27.106 INFO:teuthology.orchestra.run.smithi006.stdout:(119/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-09-13T09:28:27.148 INFO:teuthology.orchestra.run.smithi006.stdout:(120/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-09-13T09:28:27.306 INFO:teuthology.orchestra.run.smithi006.stdout:(121/131): python3-scipy-1.0.0-21.module+el8.5. 11 MB/s | 14 MB 00:01 2023-09-13T09:28:27.365 INFO:teuthology.orchestra.run.smithi006.stdout:(122/131): jq-1.6-3.el8.x86_64.rpm 3.4 MB/s | 202 kB 00:00 2023-09-13T09:28:27.407 INFO:teuthology.orchestra.run.smithi006.stdout:(123/131): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-09-13T09:28:27.499 INFO:teuthology.orchestra.run.smithi006.stdout:(124/131): openblas-threads-0.3.15-3.el8.x86_64 11 MB/s | 4.9 MB 00:00 2023-09-13T09:28:27.513 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2023-09-13T09:28:27.517 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2023-09-13T09:28:27.557 INFO:teuthology.orchestra.run.smithi006.stdout:(125/131): postgresql-contrib-10.21-2.module+el 14 MB/s | 808 kB 00:00 2023-09-13T09:28:27.624 INFO:teuthology.orchestra.run.smithi006.stdout:(126/131): openblas-0.3.15-3.el8.x86_64.rpm 9.9 MB/s | 4.7 MB 00:00 2023-09-13T09:28:27.683 INFO:teuthology.orchestra.run.smithi006.stdout:(127/131): postgresql-10.21-2.module+el8.6.0+15 12 MB/s | 1.5 MB 00:00 2023-09-13T09:28:27.788 INFO:teuthology.orchestra.run.smithi006.stdout:(128/131): postgresql-server-10.21-2.module+el8 13 MB/s | 5.1 MB 00:00 2023-09-13T09:28:27.842 INFO:teuthology.orchestra.run.smithi006.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 15 MB/s | 798 kB 00:00 2023-09-13T09:28:28.100 INFO:teuthology.orchestra.run.smithi006.stdout:(130/131): librados2-18.0.0-6083.g4a754ac9.el8. 7.9 MB/s | 3.7 MB 00:00 2023-09-13T09:28:28.150 INFO:teuthology.orchestra.run.smithi006.stdout:(131/131): librbd1-18.0.0-6083.g4a754ac9.el8.x8 7.9 MB/s | 3.7 MB 00:00 2023-09-13T09:28:28.153 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-09-13T09:28:28.153 INFO:teuthology.orchestra.run.smithi006.stdout:Total 16 MB/s | 208 MB 00:13 2023-09-13T09:28:28.991 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2023-09-13T09:28:29.124 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2023-09-13T09:28:29.124 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2023-09-13T09:28:30.316 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2023-09-13T09:28:30.321 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2023-09-13T09:28:32.652 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2023-09-13T09:28:32.819 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-13T09:28:33.002 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-13T09:28:33.194 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-13T09:28:33.388 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-13T09:28:33.491 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-13T09:28:33.559 INFO:teuthology.orchestra.run.smithi053.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T09:28:33.560 INFO:teuthology.orchestra.run.smithi053.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-13T09:28:33.575 INFO:teuthology.orchestra.run.smithi053.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-09-13T09:28:33.576 INFO:teuthology.orchestra.run.smithi053.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-09-13T09:28:33.578 INFO:teuthology.orchestra.run.smithi053.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-09-13T09:28:33.579 INFO:teuthology.orchestra.run.smithi053.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-09-13T09:28:33.581 INFO:teuthology.orchestra.run.smithi053.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-09-13T09:28:33.584 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-09-13T09:28:33.585 INFO:teuthology.orchestra.run.smithi053.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-09-13T09:28:33.728 INFO:teuthology.orchestra.run.smithi053.stdout:Dependencies resolved. 2023-09-13T09:28:33.741 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-09-13T09:28:33.741 INFO:teuthology.orchestra.run.smithi053.stdout: Package Arch Version Repository Size 2023-09-13T09:28:33.742 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-09-13T09:28:33.742 INFO:teuthology.orchestra.run.smithi053.stdout:Installing: 2023-09-13T09:28:33.742 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-09-13T09:28:33.742 INFO:teuthology.orchestra.run.smithi053.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-13T09:28:33.743 INFO:teuthology.orchestra.run.smithi053.stdout: ceph x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.4 k 2023-09-13T09:28:33.743 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 5.4 M 2023-09-13T09:28:33.743 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 919 k 2023-09-13T09:28:33.743 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 167 k 2023-09-13T09:28:33.743 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 1.6 M 2023-09-13T09:28:33.744 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 132 k 2023-09-13T09:28:33.744 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 1.7 M 2023-09-13T09:28:33.744 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 7.4 M 2023-09-13T09:28:33.744 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 47 k 2023-09-13T09:28:33.744 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 14 M 2023-09-13T09:28:33.745 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 49 M 2023-09-13T09:28:33.745 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 261 k 2023-09-13T09:28:33.745 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 179 k 2023-09-13T09:28:33.745 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 260 k 2023-09-13T09:28:33.745 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 18 k 2023-09-13T09:28:33.745 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-13T09:28:33.746 INFO:teuthology.orchestra.run.smithi053.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-13T09:28:33.746 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-13T09:28:33.746 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 31 k 2023-09-13T09:28:33.746 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 839 k 2023-09-13T09:28:33.746 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 139 k 2023-09-13T09:28:33.747 INFO:teuthology.orchestra.run.smithi053.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-13T09:28:33.747 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-13T09:28:33.747 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-13T09:28:33.747 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-09-13T09:28:33.747 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-09-13T09:28:33.748 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-09-13T09:28:33.748 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 197 k 2023-09-13T09:28:33.748 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 370 k 2023-09-13T09:28:33.748 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 365 k 2023-09-13T09:28:33.749 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 107 k 2023-09-13T09:28:33.749 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 93 k 2023-09-13T09:28:33.749 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.6 M 2023-09-13T09:28:33.749 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 179 k 2023-09-13T09:28:33.749 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-13T09:28:33.750 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrading: 2023-09-13T09:28:33.750 INFO:teuthology.orchestra.run.smithi053.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-09-13T09:28:33.750 INFO:teuthology.orchestra.run.smithi053.stdout: librados2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T09:28:33.750 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 3.7 M 2023-09-13T09:28:33.750 INFO:teuthology.orchestra.run.smithi053.stdout:Installing dependencies: 2023-09-13T09:28:33.751 INFO:teuthology.orchestra.run.smithi053.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-13T09:28:33.751 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 22 M 2023-09-13T09:28:33.751 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 23 k 2023-09-13T09:28:33.751 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 2.3 M 2023-09-13T09:28:33.751 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 242 k 2023-09-13T09:28:33.752 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 4.6 M 2023-09-13T09:28:33.752 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 18 M 2023-09-13T09:28:33.752 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6083.g4a754ac9.el8 ceph-noarch 15 k 2023-09-13T09:28:33.752 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 24 k 2023-09-13T09:28:33.752 INFO:teuthology.orchestra.run.smithi053.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-13T09:28:33.752 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-13T09:28:33.753 INFO:teuthology.orchestra.run.smithi053.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-13T09:28:33.753 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-13T09:28:33.753 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-13T09:28:33.753 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 183 k 2023-09-13T09:28:33.753 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-13T09:28:33.754 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-13T09:28:33.754 INFO:teuthology.orchestra.run.smithi053.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-13T09:28:33.754 INFO:teuthology.orchestra.run.smithi053.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-09-13T09:28:33.754 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-13T09:28:33.754 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-13T09:28:33.755 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 518 k 2023-09-13T09:28:33.755 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-13T09:28:33.755 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2 x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 6.8 M 2023-09-13T09:28:33.755 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-13T09:28:33.755 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-13T09:28:33.756 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-13T09:28:33.756 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-13T09:28:33.756 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-13T09:28:33.756 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-13T09:28:33.756 INFO:teuthology.orchestra.run.smithi053.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-13T09:28:33.757 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-13T09:28:33.757 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-13T09:28:33.757 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-13T09:28:33.757 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-13T09:28:33.758 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-13T09:28:33.758 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-13T09:28:33.758 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-13T09:28:33.758 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-13T09:28:33.758 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-13T09:28:33.759 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 45 k 2023-09-13T09:28:33.759 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common x86_64 2:18.0.0-6083.g4a754ac9.el8 ceph 125 k 2023-09-13T09:28:33.759 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-13T09:28:33.759 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-13T09:28:33.759 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-13T09:28:33.759 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-13T09:28:33.760 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-13T09:28:33.760 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-13T09:28:33.760 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-13T09:28:33.760 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-13T09:28:33.760 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-13T09:28:33.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-13T09:28:33.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-13T09:28:33.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T09:28:33.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-13T09:28:33.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-13T09:28:33.761 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-13T09:28:33.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-13T09:28:33.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-13T09:28:33.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-13T09:28:33.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-13T09:28:33.762 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-13T09:28:33.763 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-13T09:28:33.763 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-13T09:28:33.763 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-13T09:28:33.763 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-13T09:28:33.763 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-13T09:28:33.764 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-13T09:28:33.764 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-13T09:28:33.764 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-13T09:28:33.764 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-13T09:28:33.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-13T09:28:33.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-13T09:28:33.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-13T09:28:33.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-13T09:28:33.765 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-13T09:28:33.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-13T09:28:33.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-13T09:28:33.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-13T09:28:33.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-13T09:28:33.766 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-13T09:28:33.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-13T09:28:33.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-13T09:28:33.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-13T09:28:33.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-13T09:28:33.767 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-13T09:28:33.768 INFO:teuthology.orchestra.run.smithi053.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-13T09:28:33.768 INFO:teuthology.orchestra.run.smithi053.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-13T09:28:33.768 INFO:teuthology.orchestra.run.smithi053.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-09-13T09:28:33.768 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-13T09:28:33.768 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-13T09:28:33.769 INFO:teuthology.orchestra.run.smithi053.stdout:Enabling module streams: 2023-09-13T09:28:33.769 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql 10 2023-09-13T09:28:33.769 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:28:33.769 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction Summary 2023-09-13T09:28:33.769 INFO:teuthology.orchestra.run.smithi053.stdout:=========================================================================================================================== 2023-09-13T09:28:33.769 INFO:teuthology.orchestra.run.smithi053.stdout:Install 128 Packages 2023-09-13T09:28:33.770 INFO:teuthology.orchestra.run.smithi053.stdout:Upgrade 3 Packages 2023-09-13T09:28:33.770 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:28:33.771 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-13T09:28:33.771 INFO:teuthology.orchestra.run.smithi053.stdout:Total download size: 208 M 2023-09-13T09:28:33.771 INFO:teuthology.orchestra.run.smithi053.stdout:Downloading Packages: 2023-09-13T09:28:34.018 INFO:teuthology.orchestra.run.smithi053.stdout:(1/131): ceph-18.0.0-6083.g4a754ac9.el8.x86_64. 58 kB/s | 6.4 kB 00:00 2023-09-13T09:28:34.162 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-13T09:28:34.327 INFO:teuthology.orchestra.run.smithi053.stdout:(2/131): ceph-fuse-18.0.0-6083.g4a754ac9.el8.x8 2.9 MB/s | 919 kB 00:00 2023-09-13T09:28:34.393 INFO:teuthology.orchestra.run.smithi053.stdout:(3/131): ceph-immutable-object-cache-18.0.0-608 2.5 MB/s | 167 kB 00:00 2023-09-13T09:28:34.429 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:28:34.694 INFO:teuthology.orchestra.run.smithi053.stdout:(4/131): ceph-base-18.0.0-6083.g4a754ac9.el8.x8 6.8 MB/s | 5.4 MB 00:00 2023-09-13T09:28:34.840 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:28:34.903 INFO:teuthology.orchestra.run.smithi053.stdout:(5/131): ceph-mgr-18.0.0-6083.g4a754ac9.el8.x86 7.8 MB/s | 1.6 MB 00:00 2023-09-13T09:28:34.961 INFO:teuthology.orchestra.run.smithi053.stdout:(6/131): ceph-mds-18.0.0-6083.g4a754ac9.el8.x86 4.1 MB/s | 2.3 MB 00:00 2023-09-13T09:28:35.030 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:28:35.163 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:28:35.348 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:28:35.378 INFO:teuthology.orchestra.run.smithi053.stdout:(7/131): ceph-mon-18.0.0-6083.g4a754ac9.el8.x86 9.7 MB/s | 4.6 MB 00:00 2023-09-13T09:28:35.447 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2023-09-13T09:28:35.448 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:28:35.640 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T09:28:35.656 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-13T09:28:35.850 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-13T09:28:35.851 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-13T09:28:36.050 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-13T09:28:36.083 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-13T09:28:36.145 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/134 2023-09-13T09:28:36.421 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-13T09:28:36.500 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-13T09:28:36.664 INFO:teuthology.orchestra.run.smithi053.stdout:(8/131): ceph-radosgw-18.0.0-6083.g4a754ac9.el8 11 MB/s | 14 MB 00:01 2023-09-13T09:28:36.721 INFO:teuthology.orchestra.run.smithi053.stdout:(9/131): ceph-selinux-18.0.0-6083.g4a754ac9.el8 431 kB/s | 24 kB 00:00 2023-09-13T09:28:36.762 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-13T09:28:36.861 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/134 2023-09-13T09:28:36.904 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T09:28:37.042 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T09:28:37.100 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 5/134 2023-09-13T09:28:37.163 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T09:28:37.251 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T09:28:37.404 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-13T09:28:37.534 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 5/134 2023-09-13T09:28:37.561 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-13T09:28:37.716 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:28:37.737 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-13T09:28:37.863 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:28:38.041 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:28:38.124 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:28:38.170 INFO:teuthology.orchestra.run.smithi053.stdout:(10/131): ceph-osd-18.0.0-6083.g4a754ac9.el8.x8 5.6 MB/s | 18 MB 00:03 2023-09-13T09:28:38.254 INFO:teuthology.orchestra.run.smithi053.stdout:(11/131): cephfs-mirror-18.0.0-6083.g4a754ac9.e 3.1 MB/s | 260 kB 00:00 2023-09-13T09:28:38.321 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:28:38.338 INFO:teuthology.orchestra.run.smithi053.stdout:(12/131): libcephfs-devel-18.0.0-6083.g4a754ac9 372 kB/s | 31 kB 00:00 2023-09-13T09:28:38.350 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-13T09:28:38.493 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/134 2023-09-13T09:28:38.554 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-13T09:28:38.571 INFO:teuthology.orchestra.run.smithi053.stdout:(13/131): libcephfs2-18.0.0-6083.g4a754ac9.el8. 3.5 MB/s | 839 kB 00:00 2023-09-13T09:28:38.663 INFO:teuthology.orchestra.run.smithi053.stdout:(14/131): libcephsqlite-18.0.0-6083.g4a754ac9.e 2.0 MB/s | 183 kB 00:00 2023-09-13T09:28:38.747 INFO:teuthology.orchestra.run.smithi053.stdout:(15/131): librados-devel-18.0.0-6083.g4a754ac9. 1.6 MB/s | 139 kB 00:00 2023-09-13T09:28:38.776 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-13T09:28:38.914 INFO:teuthology.orchestra.run.smithi053.stdout:(16/131): libradosstriper1-18.0.0-6083.g4a754ac 3.0 MB/s | 518 kB 00:00 2023-09-13T09:28:39.013 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-13T09:28:39.151 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-13T09:28:39.345 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-13T09:28:39.452 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-13T09:28:39.725 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-13T09:28:39.866 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T09:28:39.976 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T09:28:40.114 INFO:teuthology.orchestra.run.smithi053.stdout:(17/131): librgw2-18.0.0-6083.g4a754ac9.el8.x86 5.7 MB/s | 6.8 MB 00:01 2023-09-13T09:28:40.132 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-13T09:28:40.173 INFO:teuthology.orchestra.run.smithi053.stdout:(18/131): python3-ceph-argparse-18.0.0-6083.g4a 770 kB/s | 45 kB 00:00 2023-09-13T09:28:40.256 INFO:teuthology.orchestra.run.smithi053.stdout:(19/131): python3-ceph-common-18.0.0-6083.g4a75 1.5 MB/s | 125 kB 00:00 2023-09-13T09:28:40.274 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T09:28:40.427 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-13T09:28:40.485 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T09:28:40.637 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-13T09:28:40.690 INFO:teuthology.orchestra.run.smithi053.stdout:(20/131): ceph-test-18.0.0-6083.g4a754ac9.el8.x 12 MB/s | 49 MB 00:03 2023-09-13T09:28:40.713 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 16/134 2023-09-13T09:28:40.715 INFO:teuthology.orchestra.run.smithi053.stdout:(21/131): python3-cephfs-18.0.0-6083.g4a754ac9. 429 kB/s | 197 kB 00:00 2023-09-13T09:28:40.741 INFO:teuthology.orchestra.run.smithi053.stdout:(22/131): python3-rados-18.0.0-6083.g4a754ac9.e 7.2 MB/s | 370 kB 00:00 2023-09-13T09:28:40.782 INFO:teuthology.orchestra.run.smithi053.stdout:(23/131): python3-rbd-18.0.0-6083.g4a754ac9.el8 5.3 MB/s | 365 kB 00:00 2023-09-13T09:28:40.808 INFO:teuthology.orchestra.run.smithi053.stdout:(24/131): python3-rgw-18.0.0-6083.g4a754ac9.el8 1.6 MB/s | 107 kB 00:00 2023-09-13T09:28:40.833 INFO:teuthology.orchestra.run.smithi053.stdout:(25/131): rbd-fuse-18.0.0-6083.g4a754ac9.el8.x8 1.8 MB/s | 93 kB 00:00 2023-09-13T09:28:40.857 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-13T09:28:40.894 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/134 2023-09-13T09:28:40.908 INFO:teuthology.orchestra.run.smithi053.stdout:(26/131): rbd-nbd-18.0.0-6083.g4a754ac9.el8.x86 2.3 MB/s | 179 kB 00:00 2023-09-13T09:28:40.984 INFO:teuthology.orchestra.run.smithi053.stdout:(27/131): ceph-grafana-dashboards-18.0.0-6083.g 308 kB/s | 23 kB 00:00 2023-09-13T09:28:41.067 INFO:teuthology.orchestra.run.smithi053.stdout:(28/131): rbd-mirror-18.0.0-6083.g4a754ac9.el8. 14 MB/s | 3.6 MB 00:00 2023-09-13T09:28:41.076 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-13T09:28:41.093 INFO:teuthology.orchestra.run.smithi053.stdout:(29/131): ceph-mgr-cephadm-18.0.0-6083.g4a754ac 1.2 MB/s | 132 kB 00:00 2023-09-13T09:28:41.108 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/134 2023-09-13T09:28:41.209 INFO:teuthology.orchestra.run.smithi053.stdout:(30/131): ceph-mgr-dashboard-18.0.0-6083.g4a754 12 MB/s | 1.7 MB 00:00 2023-09-13T09:28:41.265 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-13T09:28:41.268 INFO:teuthology.orchestra.run.smithi053.stdout:(31/131): ceph-mgr-modules-core-18.0.0-6083.g4a 4.1 MB/s | 242 kB 00:00 2023-09-13T09:28:41.292 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-13T09:28:41.310 INFO:teuthology.orchestra.run.smithi053.stdout:(32/131): ceph-mgr-rook-18.0.0-6083.g4a754ac9.e 1.1 MB/s | 47 kB 00:00 2023-09-13T09:28:41.352 INFO:teuthology.orchestra.run.smithi053.stdout:(33/131): ceph-prometheus-alerts-18.0.0-6083.g4 349 kB/s | 15 kB 00:00 2023-09-13T09:28:41.410 INFO:teuthology.orchestra.run.smithi053.stdout:(34/131): ceph-volume-18.0.0-6083.g4a754ac9.el8 4.4 MB/s | 261 kB 00:00 2023-09-13T09:28:41.443 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 19/134 2023-09-13T09:28:41.469 INFO:teuthology.orchestra.run.smithi053.stdout:(35/131): cephadm-18.0.0-6083.g4a754ac9.el8.noa 3.0 MB/s | 179 kB 00:00 2023-09-13T09:28:41.519 INFO:teuthology.orchestra.run.smithi053.stdout:(36/131): cephfs-top-18.0.0-6083.g4a754ac9.el8. 361 kB/s | 18 kB 00:00 2023-09-13T09:28:41.546 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-13T09:28:41.591 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-13T09:28:41.745 INFO:teuthology.orchestra.run.smithi053.stdout:(37/131): ceph-mgr-diskprediction-local-18.0.0- 11 MB/s | 7.4 MB 00:00 2023-09-13T09:28:41.769 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 26/134 2023-09-13T09:28:41.795 INFO:teuthology.orchestra.run.smithi053.stdout:(38/131): gperftools-libs-2.7-9.el8.x86_64.rpm 1.1 MB/s | 306 kB 00:00 2023-09-13T09:28:41.878 INFO:teuthology.orchestra.run.smithi053.stdout:(39/131): libunwind-1.3.1-3.el8.x86_64.rpm 902 kB/s | 75 kB 00:00 2023-09-13T09:28:41.907 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 27/134 2023-09-13T09:28:41.913 INFO:teuthology.orchestra.run.smithi053.stdout:(40/131): liboath-2.6.2-3.el8.x86_64.rpm 352 kB/s | 59 kB 00:00 2023-09-13T09:28:41.979 INFO:teuthology.orchestra.run.smithi053.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 657 kB/s | 44 kB 00:00 2023-09-13T09:28:42.005 INFO:teuthology.orchestra.run.smithi053.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 3.7 MB/s | 476 kB 00:00 2023-09-13T09:28:42.063 INFO:teuthology.orchestra.run.smithi053.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 567 kB/s | 33 kB 00:00 2023-09-13T09:28:42.089 INFO:teuthology.orchestra.run.smithi053.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 1.7 MB/s | 185 kB 00:00 2023-09-13T09:28:42.139 INFO:teuthology.orchestra.run.smithi053.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 217 kB/s | 16 kB 00:00 2023-09-13T09:28:42.197 INFO:teuthology.orchestra.run.smithi053.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.6 MB/s | 173 kB 00:00 2023-09-13T09:28:42.243 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 20/134 2023-09-13T09:28:42.256 INFO:teuthology.orchestra.run.smithi053.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2023-09-13T09:28:42.281 INFO:teuthology.orchestra.run.smithi053.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 973 kB/s | 81 kB 00:00 2023-09-13T09:28:42.323 INFO:teuthology.orchestra.run.smithi053.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 166 kB/s | 11 kB 00:00 2023-09-13T09:28:42.374 INFO:teuthology.orchestra.run.smithi053.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 191 kB/s | 18 kB 00:00 2023-09-13T09:28:42.432 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-13T09:28:42.449 INFO:teuthology.orchestra.run.smithi053.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 650 kB/s | 49 kB 00:00 2023-09-13T09:28:42.516 INFO:teuthology.orchestra.run.smithi053.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 882 kB/s | 59 kB 00:00 2023-09-13T09:28:42.550 INFO:teuthology.orchestra.run.smithi053.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 5.2 MB/s | 1.2 MB 00:00 2023-09-13T09:28:42.583 INFO:teuthology.orchestra.run.smithi053.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 902 kB/s | 60 kB 00:00 2023-09-13T09:28:42.633 INFO:teuthology.orchestra.run.smithi053.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2023-09-13T09:28:42.659 INFO:teuthology.orchestra.run.smithi053.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-09-13T09:28:42.709 INFO:teuthology.orchestra.run.smithi053.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 447 kB/s | 34 kB 00:00 2023-09-13T09:28:42.768 INFO:teuthology.orchestra.run.smithi053.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-09-13T09:28:42.793 INFO:teuthology.orchestra.run.smithi053.stdout:(59/131): python3-rsa-4.9-2.el8.noarch.rpm 768 kB/s | 64 kB 00:00 2023-09-13T09:28:42.826 INFO:teuthology.orchestra.run.smithi053.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 320 kB/s | 19 kB 00:00 2023-09-13T09:28:42.827 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 28/134 2023-09-13T09:28:42.852 INFO:teuthology.orchestra.run.smithi053.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 409 kB/s | 24 kB 00:00 2023-09-13T09:28:42.885 INFO:teuthology.orchestra.run.smithi053.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 498 kB/s | 29 kB 00:00 2023-09-13T09:28:42.944 INFO:teuthology.orchestra.run.smithi053.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2023-09-13T09:28:43.019 INFO:teuthology.orchestra.run.smithi053.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 3.3 MB/s | 251 kB 00:00 2023-09-13T09:28:43.064 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 21/134 2023-09-13T09:28:43.069 INFO:teuthology.orchestra.run.smithi053.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 1.4 MB/s | 255 kB 00:00 2023-09-13T09:28:43.095 INFO:teuthology.orchestra.run.smithi053.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 814 kB/s | 61 kB 00:00 2023-09-13T09:28:43.124 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-13T09:28:43.129 INFO:teuthology.orchestra.run.smithi053.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 1.4 MB/s | 85 kB 00:00 2023-09-13T09:28:43.162 INFO:teuthology.orchestra.run.smithi053.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 341 kB/s | 23 kB 00:00 2023-09-13T09:28:43.188 INFO:teuthology.orchestra.run.smithi053.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-09-13T09:28:43.265 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.15-3.el8.x86_64 22/134 2023-09-13T09:28:43.421 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-13T09:28:43.538 INFO:teuthology.orchestra.run.smithi053.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 39 MB/s | 14 MB 00:00 2023-09-13T09:28:43.588 INFO:teuthology.orchestra.run.smithi053.stdout:(71/131): thrift-0.13.0-2.el8.x86_64.rpm 3.8 MB/s | 1.7 MB 00:00 2023-09-13T09:28:43.614 INFO:teuthology.orchestra.run.smithi053.stdout:(72/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.4 MB/s | 110 kB 00:00 2023-09-13T09:28:43.655 INFO:teuthology.orchestra.run.smithi053.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 809 kB/s | 54 kB 00:00 2023-09-13T09:28:43.681 INFO:teuthology.orchestra.run.smithi053.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-09-13T09:28:43.692 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-13T09:28:43.706 INFO:teuthology.orchestra.run.smithi053.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 6.3 MB/s | 323 kB 00:00 2023-09-13T09:28:43.764 INFO:teuthology.orchestra.run.smithi053.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 468 kB/s | 39 kB 00:00 2023-09-13T09:28:43.807 INFO:teuthology.orchestra.run.smithi053.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 6.7 MB/s | 688 kB 00:00 2023-09-13T09:28:43.840 INFO:teuthology.orchestra.run.smithi053.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.9 MB/s | 538 kB 00:00 2023-09-13T09:28:43.866 INFO:teuthology.orchestra.run.smithi053.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-13T09:28:43.891 INFO:teuthology.orchestra.run.smithi053.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.6 MB/s | 187 kB 00:00 2023-09-13T09:28:43.933 INFO:teuthology.orchestra.run.smithi053.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-09-13T09:28:43.934 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-13T09:28:43.966 INFO:teuthology.orchestra.run.smithi053.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 797 kB/s | 27 kB 00:00 2023-09-13T09:28:44.005 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 22/134 2023-09-13T09:28:44.008 INFO:teuthology.orchestra.run.smithi053.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-13T09:28:44.042 INFO:teuthology.orchestra.run.smithi053.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-09-13T09:28:44.117 INFO:teuthology.orchestra.run.smithi053.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 21 MB/s | 4.8 MB 00:00 2023-09-13T09:28:44.281 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 23/134 2023-09-13T09:28:44.326 INFO:teuthology.orchestra.run.smithi053.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 2.1 MB/s | 457 kB 00:00 2023-09-13T09:28:44.368 INFO:teuthology.orchestra.run.smithi053.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-09-13T09:28:44.401 INFO:teuthology.orchestra.run.smithi053.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.9 MB/s | 64 kB 00:00 2023-09-13T09:28:44.485 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 24/134 2023-09-13T09:28:44.485 INFO:teuthology.orchestra.run.smithi053.stdout:(89/131): python3-numpy-1.14.3-10.el8.x86_64.rp 8.4 MB/s | 3.7 MB 00:00 2023-09-13T09:28:44.512 INFO:teuthology.orchestra.run.smithi053.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-09-13T09:28:44.536 INFO:teuthology.orchestra.run.smithi053.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-09-13T09:28:44.569 INFO:teuthology.orchestra.run.smithi053.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.7 MB/s | 103 kB 00:00 2023-09-13T09:28:44.603 INFO:teuthology.orchestra.run.smithi053.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-09-13T09:28:44.645 INFO:teuthology.orchestra.run.smithi053.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-09-13T09:28:44.755 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-13T09:28:44.770 INFO:teuthology.orchestra.run.smithi053.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 24 MB/s | 4.9 MB 00:00 2023-09-13T09:28:44.812 INFO:teuthology.orchestra.run.smithi053.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-09-13T09:28:44.888 INFO:teuthology.orchestra.run.smithi053.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 20 MB/s | 4.7 MB 00:00 2023-09-13T09:28:44.921 INFO:teuthology.orchestra.run.smithi053.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-09-13T09:28:44.964 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 26/134 2023-09-13T09:28:44.972 INFO:teuthology.orchestra.run.smithi053.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 16 MB/s | 808 kB 00:00 2023-09-13T09:28:45.038 INFO:teuthology.orchestra.run.smithi053.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 23 MB/s | 1.5 MB 00:00 2023-09-13T09:28:45.114 INFO:teuthology.orchestra.run.smithi053.stdout:(101/131): postgresql-server-10.21-2.module+el8 22 MB/s | 5.1 MB 00:00 2023-09-13T09:28:45.128 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 27/134 2023-09-13T09:28:45.130 INFO:teuthology.orchestra.run.smithi053.stdout:(102/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 510 kB/s | 47 kB 00:00 2023-09-13T09:28:45.181 INFO:teuthology.orchestra.run.smithi053.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.9 MB/s | 200 kB 00:00 2023-09-13T09:28:45.198 INFO:teuthology.orchestra.run.smithi053.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 636 kB/s | 43 kB 00:00 2023-09-13T09:28:45.223 INFO:teuthology.orchestra.run.smithi053.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-09-13T09:28:45.240 INFO:teuthology.orchestra.run.smithi053.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-09-13T09:28:45.265 INFO:teuthology.orchestra.run.smithi053.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-09-13T09:28:45.282 INFO:teuthology.orchestra.run.smithi053.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 1.0 MB/s | 43 kB 00:00 2023-09-13T09:28:45.307 INFO:teuthology.orchestra.run.smithi053.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.6 MB/s | 109 kB 00:00 2023-09-13T09:28:45.333 INFO:teuthology.orchestra.run.smithi053.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-13T09:28:45.353 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 28/134 2023-09-13T09:28:45.366 INFO:teuthology.orchestra.run.smithi053.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.3 MB/s | 560 kB 00:00 2023-09-13T09:28:45.392 INFO:teuthology.orchestra.run.smithi053.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 318 kB/s | 19 kB 00:00 2023-09-13T09:28:45.417 INFO:teuthology.orchestra.run.smithi053.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-09-13T09:28:45.451 INFO:teuthology.orchestra.run.smithi053.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-09-13T09:28:45.476 INFO:teuthology.orchestra.run.smithi053.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-09-13T09:28:45.509 INFO:teuthology.orchestra.run.smithi053.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-09-13T09:28:45.535 INFO:teuthology.orchestra.run.smithi053.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-09-13T09:28:45.568 INFO:teuthology.orchestra.run.smithi053.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-09-13T09:28:45.573 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-13T09:28:45.602 INFO:teuthology.orchestra.run.smithi053.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-09-13T09:28:45.661 INFO:teuthology.orchestra.run.smithi053.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 15 MB/s | 2.3 MB 00:00 2023-09-13T09:28:45.681 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-13T09:28:45.686 INFO:teuthology.orchestra.run.smithi053.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 716 kB/s | 60 kB 00:00 2023-09-13T09:28:45.711 INFO:teuthology.orchestra.run.smithi053.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-09-13T09:28:45.736 INFO:teuthology.orchestra.run.smithi053.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-09-13T09:28:45.762 INFO:teuthology.orchestra.run.smithi053.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 768 kB/s | 39 kB 00:00 2023-09-13T09:28:45.795 INFO:teuthology.orchestra.run.smithi053.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 11 MB/s | 644 kB 00:00 2023-09-13T09:28:45.821 INFO:teuthology.orchestra.run.smithi053.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.9 MB/s | 171 kB 00:00 2023-09-13T09:28:45.878 INFO:teuthology.orchestra.run.smithi053.stdout:(127/131): NetworkManager-initscripts-updown-1. 1.6 MB/s | 138 kB 00:00 2023-09-13T09:28:46.003 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-13T09:28:46.222 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-13T09:28:46.321 INFO:teuthology.orchestra.run.smithi053.stdout:(128/131): librbd1-18.0.0-6083.g4a754ac9.el8.x8 8.4 MB/s | 3.7 MB 00:00 2023-09-13T09:28:46.380 INFO:teuthology.orchestra.run.smithi053.stdout:(129/131): librados2-18.0.0-6083.g4a754ac9.el8. 6.7 MB/s | 3.7 MB 00:00 2023-09-13T09:28:46.405 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-13T09:28:46.421 INFO:teuthology.orchestra.run.smithi053.stdout:(130/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 7.8 MB/s | 798 kB 00:00 2023-09-13T09:28:46.626 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 36/134 2023-09-13T09:28:46.714 INFO:teuthology.orchestra.run.smithi053.stdout:(131/131): ceph-common-18.0.0-6083.g4a754ac9.el 1.7 MB/s | 22 MB 00:12 2023-09-13T09:28:46.717 INFO:teuthology.orchestra.run.smithi053.stdout:-------------------------------------------------------------------------------- 2023-09-13T09:28:46.717 INFO:teuthology.orchestra.run.smithi053.stdout:Total 16 MB/s | 208 MB 00:12 2023-09-13T09:28:46.773 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 37/134 2023-09-13T09:28:46.960 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-13T09:28:47.129 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-13T09:28:47.356 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-13T09:28:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 29/134 2023-09-13T09:28:47.491 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-13T09:28:47.561 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction check 2023-09-13T09:28:47.694 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction check succeeded. 2023-09-13T09:28:47.694 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction test 2023-09-13T09:28:47.727 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-13T09:28:47.901 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-13T09:28:48.291 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-13T09:28:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 30/134 2023-09-13T09:28:48.597 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-13T09:28:48.820 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-13T09:28:48.863 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 31/134 2023-09-13T09:28:48.879 INFO:teuthology.orchestra.run.smithi053.stdout:Transaction test succeeded. 2023-09-13T09:28:48.883 INFO:teuthology.orchestra.run.smithi053.stdout:Running transaction 2023-09-13T09:28:49.013 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-13T09:28:49.138 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 32/134 2023-09-13T09:28:49.315 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-13T09:28:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/134 2023-09-13T09:28:49.580 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-13T09:28:49.642 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-13T09:28:49.812 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-13T09:28:49.851 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-13T09:28:49.989 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 36/134 2023-09-13T09:28:50.011 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-13T09:28:50.164 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 37/134 2023-09-13T09:28:50.248 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-13T09:28:50.324 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 38/134 2023-09-13T09:28:50.397 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-13T09:28:50.476 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 39/134 2023-09-13T09:28:50.555 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-13T09:28:50.690 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : uuid-1.6.2-43.el8.x86_64 40/134 2023-09-13T09:28:50.765 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 40/134 2023-09-13T09:28:50.856 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-13T09:28:51.041 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 41/134 2023-09-13T09:28:51.130 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-13T09:28:51.395 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : automake-1.16.1-7.el8.noarch 42/134 2023-09-13T09:28:51.414 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-13T09:28:51.581 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-13T09:28:51.633 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-13T09:28:51.669 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 43/134 2023-09-13T09:28:51.826 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-13T09:28:51.875 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-3.el8.x86_64 44/134 2023-09-13T09:28:51.994 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-13T09:28:52.019 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 45/134 2023-09-13T09:28:52.182 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 46/134 2023-09-13T09:28:52.184 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-13T09:28:52.255 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-13T09:28:52.384 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 47/134 2023-09-13T09:28:52.530 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-13T09:28:52.543 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-15.el8.x86_64 48/134 2023-09-13T09:28:52.703 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 49/134 2023-09-13T09:28:52.721 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-13T09:28:52.910 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-13T09:28:52.934 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 50/134 2023-09-13T09:28:52.992 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-13T09:28:53.150 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 51/134 2023-09-13T09:28:53.231 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-13T09:28:53.385 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-13T09:28:53.570 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 52/134 2023-09-13T09:28:53.593 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-13T09:28:53.762 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-13T09:28:53.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 53/134 2023-09-13T09:28:54.053 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-13T09:28:54.124 INFO:teuthology.orchestra.run.smithi053.stdout: Preparing : 1/1 2023-09-13T09:28:54.128 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 54/134 2023-09-13T09:28:54.287 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-09-13T09:28:54.300 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-13T09:28:54.376 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 55/134 2023-09-13T09:28:54.455 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-13T09:28:54.479 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-09-13T09:28:54.596 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 56/134 2023-09-13T09:28:54.636 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-13T09:28:54.673 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-09-13T09:28:54.826 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-13T09:28:54.839 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-13T09:28:54.937 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 57/134 2023-09-13T09:28:54.942 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-09-13T09:28:55.062 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-13T09:28:55.156 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 58/134 2023-09-13T09:28:55.189 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-13T09:28:55.236 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-13T09:28:55.324 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 59/134 2023-09-13T09:28:55.597 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 60/134 2023-09-13T09:28:55.609 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-09-13T09:28:55.770 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 61/134 2023-09-13T09:28:55.830 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-13T09:28:55.839 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:28:55.937 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 62/134 2023-09-13T09:28:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-13T09:28:56.203 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-13T09:28:56.269 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:28:56.307 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 63/134 2023-09-13T09:28:56.463 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-13T09:28:56.464 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:28:56.595 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/134 2023-09-13T09:28:56.598 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:28:56.657 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-13T09:28:56.764 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:28:56.848 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/134 2023-09-13T09:28:56.862 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:28:56.930 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-13T09:28:57.040 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T09:28:57.116 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 66/134 2023-09-13T09:28:57.125 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-13T09:28:57.263 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-09-13T09:28:57.281 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-13T09:28:57.340 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-13T09:28:57.451 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-09-13T09:28:57.495 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-13T09:28:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-13T09:28:57.760 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-13T09:28:57.863 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-09-13T09:28:58.005 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-13T09:28:58.114 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-09-13T09:28:58.144 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-13T09:28:58.238 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T09:28:58.335 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-13T09:28:58.347 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 14/134 2023-09-13T09:28:58.472 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T09:28:58.519 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-13T09:28:58.588 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 15/134 2023-09-13T09:28:58.652 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-13T09:28:58.704 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-13T09:28:58.713 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-13T09:28:58.840 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-09-13T09:28:58.920 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-13T09:28:58.929 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-13T09:28:58.980 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-13T09:28:59.101 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-13T09:28:59.216 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-13T09:28:59.287 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-13T09:28:59.513 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-13T09:28:59.559 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-13T09:28:59.635 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-09-13T09:28:59.811 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-13T09:28:59.813 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-13T09:28:59.828 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-13T09:29:00.003 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-13T09:29:00.011 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-13T09:29:00.267 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-13T09:29:00.450 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-09-13T09:29:00.472 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-13T09:29:00.664 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-13T09:29:00.828 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-13T09:29:00.863 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-09-13T09:29:00.901 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-13T09:29:01.017 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T09:29:01.089 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T09:29:01.276 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 93/134 2023-09-13T09:29:01.606 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-09-13T09:29:01.828 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-09-13T09:29:02.022 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-09-13T09:29:02.130 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-13T09:29:02.243 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-09-13T09:29:02.411 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-09-13T09:29:02.438 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-13T09:29:02.599 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-09-13T09:29:02.689 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-13T09:29:02.818 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-09-13T09:29:02.978 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 26/134 2023-09-13T09:29:03.049 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-13T09:29:03.092 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 27/134 2023-09-13T09:29:03.308 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-13T09:29:03.532 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-13T09:29:04.023 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 28/134 2023-09-13T09:29:04.327 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-09-13T09:29:04.351 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-13T09:29:04.530 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T09:29:04.561 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-09-13T09:29:04.608 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T09:29:04.762 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-09-13T09:29:04.805 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 93/134 2023-09-13T09:29:04.963 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-13T09:29:05.048 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:05.292 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:05.912 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:06.846 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-09-13T09:29:06.915 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T09:29:06.998 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T09:29:07.107 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T09:29:07.192 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-09-13T09:29:07.387 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rsa-4.9-2.el8.noarch 34/134 2023-09-13T09:29:07.551 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-09-13T09:29:07.731 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 36/134 2023-09-13T09:29:07.892 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 37/134 2023-09-13T09:29:08.028 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-09-13T09:29:08.181 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-09-13T09:29:08.357 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-09-13T09:29:08.534 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-09-13T09:29:08.740 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-09-13T09:29:08.814 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:08.931 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-09-13T09:29:09.029 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:09.301 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-09-13T09:29:09.566 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-09-13T09:29:09.664 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:09.748 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-09-13T09:29:09.945 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T09:29:09.980 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-09-13T09:29:10.028 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T09:29:10.211 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-09-13T09:29:10.220 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T09:29:10.505 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-09-13T09:29:10.737 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-09-13T09:29:10.905 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-09-13T09:29:11.102 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-09-13T09:29:11.242 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-09-13T09:29:11.423 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-09-13T09:29:11.715 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-09-13T09:29:11.944 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-09-13T09:29:12.187 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-09-13T09:29:12.411 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-09-13T09:29:12.561 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-09-13T09:29:12.722 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-09-13T09:29:12.878 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-09-13T09:29:12.939 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-09-13T09:29:13.183 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-09-13T09:29:13.365 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-09-13T09:29:13.520 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-13T09:29:13.609 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-09-13T09:29:13.811 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-09-13T09:29:13.980 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-09-13T09:29:14.162 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-09-13T09:29:14.344 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-09-13T09:29:14.591 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-09-13T09:29:14.819 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-09-13T09:29:14.966 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-09-13T09:29:15.116 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-09-13T09:29:15.283 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-09-13T09:29:15.460 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-09-13T09:29:15.642 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-09-13T09:29:15.823 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-09-13T09:29:15.961 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-09-13T09:29:16.184 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-09-13T09:29:16.425 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-09-13T09:29:16.617 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-09-13T09:29:16.866 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-09-13T09:29:17.136 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-09-13T09:29:17.304 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-09-13T09:29:17.508 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-09-13T09:29:18.673 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-09-13T09:29:18.935 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-09-13T09:29:19.198 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-09-13T09:29:19.520 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-09-13T09:29:19.807 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-09-13T09:29:19.995 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-09-13T09:29:20.806 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-09-13T09:29:20.960 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T09:29:21.038 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 92/134 2023-09-13T09:29:21.228 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 93/134 2023-09-13T09:29:25.169 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:25.411 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:26.037 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 94/134 2023-09-13T09:29:26.199 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T09:29:26.199 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2023-09-13T09:29:26.199 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2023-09-13T09:29:26.200 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-09-13T09:29:26.200 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /run 2023-09-13T09:29:26.200 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2023-09-13T09:29:26.200 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2023-09-13T09:29:26.200 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2023-09-13T09:29:26.200 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2023-09-13T09:29:26.201 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /dev 2023-09-13T09:29:26.201 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:29:26.317 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T09:29:26.390 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 95/134 2023-09-13T09:29:26.526 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T09:29:26.555 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T09:29:28.148 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T09:29:28.349 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T09:29:28.570 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T09:29:28.771 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T09:29:29.224 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T09:29:29.421 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T09:29:29.438 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T09:29:30.568 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T09:29:30.568 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2023-09-13T09:29:30.569 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2023-09-13T09:29:30.569 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-09-13T09:29:30.569 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2023-09-13T09:29:30.569 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2023-09-13T09:29:30.569 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2023-09-13T09:29:30.570 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2023-09-13T09:29:30.570 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2023-09-13T09:29:30.570 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2023-09-13T09:29:30.570 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:29:30.952 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T09:29:31.250 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T09:29:31.443 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T09:29:31.601 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 102/134 2023-09-13T09:29:31.770 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 103/134 2023-09-13T09:29:31.962 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T09:29:32.182 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T09:29:32.490 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T09:29:32.652 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T09:29:32.825 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T09:29:33.058 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T09:29:33.276 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T09:29:33.447 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T09:29:33.637 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T09:29:33.727 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T09:29:33.765 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T09:29:33.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T09:29:33.910 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T09:29:34.091 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 107/134 2023-09-13T09:29:34.315 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T09:29:34.350 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T09:29:34.537 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T09:29:34.548 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T09:29:35.793 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T09:29:35.852 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 110/134 2023-09-13T09:29:35.994 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T09:29:36.051 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T09:29:36.084 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T09:29:36.124 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 102/134 2023-09-13T09:29:36.229 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T09:29:36.270 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T09:29:36.319 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 103/134 2023-09-13T09:29:36.420 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T09:29:36.550 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T09:29:36.776 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T09:29:36.778 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T09:29:36.929 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T09:29:37.042 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T09:29:38.065 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T09:29:38.268 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T09:29:38.363 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T09:29:38.710 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 107/134 2023-09-13T09:29:38.921 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T09:29:38.957 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T09:29:39.151 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T09:29:39.163 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T09:29:40.557 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 110/134 2023-09-13T09:29:40.753 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T09:29:40.788 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T09:29:40.967 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T09:29:41.010 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T09:29:41.159 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T09:29:41.539 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T09:29:41.541 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T09:29:41.692 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T09:29:41.854 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 115/134 2023-09-13T09:29:42.019 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-13T09:29:42.206 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-13T09:29:43.109 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-13T09:29:43.464 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-13T09:29:43.663 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 119/134 2023-09-13T09:29:43.914 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-13T09:29:44.064 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 121/134 2023-09-13T09:29:44.203 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T09:29:46.052 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 96/134 2023-09-13T09:29:46.053 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /sys 2023-09-13T09:29:46.053 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /proc 2023-09-13T09:29:46.053 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-09-13T09:29:46.053 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /run 2023-09-13T09:29:46.053 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /mnt 2023-09-13T09:29:46.054 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /var/tmp 2023-09-13T09:29:46.054 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /home 2023-09-13T09:29:46.054 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /tmp 2023-09-13T09:29:46.054 INFO:teuthology.orchestra.run.smithi053.stdout:skipping the directory /dev 2023-09-13T09:29:46.054 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:29:46.399 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T09:29:46.429 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:29:46.625 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T09:29:46.668 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:29:46.685 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:29:46.889 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 124/134 2023-09-13T09:29:47.159 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 125/134 2023-09-13T09:29:47.458 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 126/134 2023-09-13T09:29:47.563 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 115/134 2023-09-13T09:29:47.778 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-13T09:29:47.916 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 116/134 2023-09-13T09:29:47.968 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T09:29:47.976 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T09:29:48.096 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 97/134 2023-09-13T09:29:48.103 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 117/134 2023-09-13T09:29:48.159 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-13T09:29:48.247 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T09:29:48.376 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 118/134 2023-09-13T09:29:48.393 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-13T09:29:48.479 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-13T09:29:48.481 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 98/134 2023-09-13T09:29:48.541 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libtool-2.4.6-25.el8.x86_64 119/134 2023-09-13T09:29:48.666 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T09:29:48.709 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-13T09:29:48.722 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-13T09:29:48.722 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:29:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 119/134 2023-09-13T09:29:48.912 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:29:48.913 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T09:29:48.996 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 120/134 2023-09-13T09:29:49.150 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 99/134 2023-09-13T09:29:49.164 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T09:29:49.212 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 121/134 2023-09-13T09:29:49.307 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T09:29:49.324 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 100/134 2023-09-13T09:29:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T09:29:49.376 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:29:49.886 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:29:49.887 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 1/134 2023-09-13T09:29:49.887 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2/134 2023-09-13T09:29:49.887 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 3/134 2023-09-13T09:29:49.887 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 4/134 2023-09-13T09:29:49.887 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 5/134 2023-09-13T09:29:49.888 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:29:49.888 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:29:49.888 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:29:49.888 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T09:29:49.889 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 10/134 2023-09-13T09:29:49.889 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 11/134 2023-09-13T09:29:49.889 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 12/134 2023-09-13T09:29:49.889 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 13/134 2023-09-13T09:29:49.889 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 14/134 2023-09-13T09:29:49.890 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 15/134 2023-09-13T09:29:49.890 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 16/134 2023-09-13T09:29:49.890 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 17/134 2023-09-13T09:29:49.890 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 18/134 2023-09-13T09:29:49.890 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 19/134 2023-09-13T09:29:49.891 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 20/134 2023-09-13T09:29:49.891 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 21/134 2023-09-13T09:29:49.891 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 22/134 2023-09-13T09:29:49.891 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 23/134 2023-09-13T09:29:49.892 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 24/134 2023-09-13T09:29:49.892 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 25/134 2023-09-13T09:29:49.892 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 26/134 2023-09-13T09:29:49.892 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 27/134 2023-09-13T09:29:49.892 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 28/134 2023-09-13T09:29:49.893 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 29/134 2023-09-13T09:29:49.903 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 30/134 2023-09-13T09:29:49.903 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 31/134 2023-09-13T09:29:49.903 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 32/134 2023-09-13T09:29:49.903 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 33/134 2023-09-13T09:29:49.904 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 34/134 2023-09-13T09:29:49.904 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 35/134 2023-09-13T09:29:49.904 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 36/134 2023-09-13T09:29:49.904 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 37/134 2023-09-13T09:29:49.904 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 38/134 2023-09-13T09:29:49.905 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-13T09:29:49.905 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-13T09:29:49.905 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-13T09:29:49.905 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-13T09:29:49.906 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-13T09:29:49.906 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-13T09:29:49.906 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-13T09:29:49.906 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-13T09:29:49.906 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-13T09:29:49.907 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-13T09:29:49.907 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-13T09:29:49.907 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-13T09:29:49.907 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-13T09:29:49.907 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-13T09:29:49.908 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-13T09:29:49.908 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-13T09:29:49.908 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-13T09:29:49.908 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-13T09:29:49.909 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-13T09:29:49.909 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-13T09:29:49.909 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-13T09:29:49.909 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-13T09:29:49.909 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-13T09:29:49.910 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-13T09:29:49.910 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-13T09:29:49.910 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-13T09:29:49.910 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-13T09:29:49.910 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-13T09:29:49.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-13T09:29:49.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-13T09:29:49.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-13T09:29:49.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-13T09:29:49.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-13T09:29:49.912 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-13T09:29:49.912 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-13T09:29:49.912 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-13T09:29:49.912 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-13T09:29:49.912 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-13T09:29:49.913 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-13T09:29:49.913 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-13T09:29:49.913 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-13T09:29:49.913 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-13T09:29:49.913 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-13T09:29:49.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-13T09:29:49.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-13T09:29:49.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-13T09:29:49.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-13T09:29:49.914 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-13T09:29:49.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-13T09:29:49.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-13T09:29:49.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-13T09:29:49.915 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-13T09:29:49.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-13T09:29:49.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-13T09:29:49.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-13T09:29:49.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-13T09:29:49.916 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-13T09:29:49.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-13T09:29:49.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-13T09:29:49.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-13T09:29:49.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-13T09:29:49.917 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-13T09:29:49.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-13T09:29:49.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-13T09:29:49.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-13T09:29:49.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-13T09:29:49.918 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-13T09:29:49.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-13T09:29:49.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-13T09:29:49.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-13T09:29:49.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-13T09:29:49.919 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-13T09:29:49.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-13T09:29:49.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-13T09:29:49.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-13T09:29:49.920 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-13T09:29:49.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-13T09:29:49.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-13T09:29:49.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-13T09:29:49.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-13T09:29:49.921 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-13T09:29:49.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-13T09:29:49.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-13T09:29:49.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T09:29:49.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-13T09:29:49.922 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-13T09:29:49.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-13T09:29:49.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-13T09:29:49.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-13T09:29:49.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T09:29:49.923 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 129/134 2023-09-13T09:29:49.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-13T09:29:49.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 131/134 2023-09-13T09:29:49.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:29:49.924 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-13T09:29:51.131 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T09:29:51.316 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 101/134 2023-09-13T09:29:51.421 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 102/134 2023-09-13T09:29:51.617 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 103/134 2023-09-13T09:29:51.803 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:29:51.823 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T09:29:52.050 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 104/134 2023-09-13T09:29:52.066 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:29:52.084 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:29:52.338 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T09:29:52.350 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 124/134 2023-09-13T09:29:52.420 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:29:52.420 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:51 ago on Wed 13 Sep 2023 09:28:01 AM UTC. 2023-09-13T09:29:52.541 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 125/134 2023-09-13T09:29:52.858 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 126/134 2023-09-13T09:29:53.228 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-13T09:29:53.361 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 105/134 2023-09-13T09:29:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : flex-2.6.1-9.el8.x86_64 128/134 2023-09-13T09:29:53.465 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 128/134 2023-09-13T09:29:53.540 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T09:29:53.636 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 106/134 2023-09-13T09:29:53.707 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : bison-3.0.4-10.el8.x86_64 129/134 2023-09-13T09:29:53.720 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 129/134 2023-09-13T09:29:53.890 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-13T09:29:53.899 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 130/134 2023-09-13T09:29:53.981 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 107/134 2023-09-13T09:29:54.067 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/134 2023-09-13T09:29:54.068 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:29:54.182 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T09:29:54.220 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 108/134 2023-09-13T09:29:54.260 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:29:54.261 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T09:29:54.398 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T09:29:54.410 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 109/134 2023-09-13T09:29:54.521 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T09:29:54.706 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:29:55.236 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:29:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 1/134 2023-09-13T09:29:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2/134 2023-09-13T09:29:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 3/134 2023-09-13T09:29:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 4/134 2023-09-13T09:29:55.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 5/134 2023-09-13T09:29:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:29:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:29:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:29:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T09:29:55.238 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 10/134 2023-09-13T09:29:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 11/134 2023-09-13T09:29:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 12/134 2023-09-13T09:29:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 13/134 2023-09-13T09:29:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 14/134 2023-09-13T09:29:55.239 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 15/134 2023-09-13T09:29:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 16/134 2023-09-13T09:29:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 17/134 2023-09-13T09:29:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 18/134 2023-09-13T09:29:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 19/134 2023-09-13T09:29:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 20/134 2023-09-13T09:29:55.240 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 21/134 2023-09-13T09:29:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 22/134 2023-09-13T09:29:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 23/134 2023-09-13T09:29:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 24/134 2023-09-13T09:29:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 25/134 2023-09-13T09:29:55.241 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 26/134 2023-09-13T09:29:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 27/134 2023-09-13T09:29:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 28/134 2023-09-13T09:29:55.242 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 29/134 2023-09-13T09:29:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 30/134 2023-09-13T09:29:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 31/134 2023-09-13T09:29:55.252 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 32/134 2023-09-13T09:29:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 33/134 2023-09-13T09:29:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 34/134 2023-09-13T09:29:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 35/134 2023-09-13T09:29:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 36/134 2023-09-13T09:29:55.253 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 37/134 2023-09-13T09:29:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 38/134 2023-09-13T09:29:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-13T09:29:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-13T09:29:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-13T09:29:55.254 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-13T09:29:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-13T09:29:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-13T09:29:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-13T09:29:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-13T09:29:55.255 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-13T09:29:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-13T09:29:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-13T09:29:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-13T09:29:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-13T09:29:55.256 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-13T09:29:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-13T09:29:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-13T09:29:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-13T09:29:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-13T09:29:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-13T09:29:55.257 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-13T09:29:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-13T09:29:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-13T09:29:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-13T09:29:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-13T09:29:55.258 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-13T09:29:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-13T09:29:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-13T09:29:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-13T09:29:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-13T09:29:55.259 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-13T09:29:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-13T09:29:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-13T09:29:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-13T09:29:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 72/134 2023-09-13T09:29:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 73/134 2023-09-13T09:29:55.260 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/134 2023-09-13T09:29:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/134 2023-09-13T09:29:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 76/134 2023-09-13T09:29:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 77/134 2023-09-13T09:29:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/134 2023-09-13T09:29:55.261 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 79/134 2023-09-13T09:29:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 80/134 2023-09-13T09:29:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 81/134 2023-09-13T09:29:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/134 2023-09-13T09:29:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 83/134 2023-09-13T09:29:55.262 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 84/134 2023-09-13T09:29:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 85/134 2023-09-13T09:29:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 86/134 2023-09-13T09:29:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 87/134 2023-09-13T09:29:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 88/134 2023-09-13T09:29:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 89/134 2023-09-13T09:29:55.263 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 90/134 2023-09-13T09:29:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 91/134 2023-09-13T09:29:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 92/134 2023-09-13T09:29:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 93/134 2023-09-13T09:29:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 94/134 2023-09-13T09:29:55.264 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 95/134 2023-09-13T09:29:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 96/134 2023-09-13T09:29:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 97/134 2023-09-13T09:29:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 98/134 2023-09-13T09:29:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 99/134 2023-09-13T09:29:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 100/134 2023-09-13T09:29:55.265 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 101/134 2023-09-13T09:29:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 102/134 2023-09-13T09:29:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 103/134 2023-09-13T09:29:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : bison-3.0.4-10.el8.x86_64 104/134 2023-09-13T09:29:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 105/134 2023-09-13T09:29:55.266 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 106/134 2023-09-13T09:29:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/134 2023-09-13T09:29:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : automake-1.16.1-7.el8.noarch 108/134 2023-09-13T09:29:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 109/134 2023-09-13T09:29:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 110/134 2023-09-13T09:29:55.267 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : flex-2.6.1-9.el8.x86_64 111/134 2023-09-13T09:29:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/134 2023-09-13T09:29:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 113/134 2023-09-13T09:29:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 114/134 2023-09-13T09:29:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 115/134 2023-09-13T09:29:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 116/134 2023-09-13T09:29:55.268 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 117/134 2023-09-13T09:29:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 118/134 2023-09-13T09:29:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 119/134 2023-09-13T09:29:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 120/134 2023-09-13T09:29:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 121/134 2023-09-13T09:29:55.269 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libpq-13.5-1.el8.x86_64 122/134 2023-09-13T09:29:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 123/134 2023-09-13T09:29:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-3.el8.x86_64 124/134 2023-09-13T09:29:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 125/134 2023-09-13T09:29:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 126/134 2023-09-13T09:29:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 127/134 2023-09-13T09:29:55.270 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 128/134 2023-09-13T09:29:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 129/134 2023-09-13T09:29:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-13T09:29:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 131/134 2023-09-13T09:29:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:29:55.271 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-13T09:29:55.690 INFO:teuthology.orchestra.run.smithi131.stdout:Installed products updated. 2023-09-13T09:29:55.772 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 110/134 2023-09-13T09:29:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:29:55.946 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2023-09-13T09:29:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-13T09:29:55.946 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.947 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2023-09-13T09:29:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-13T09:29:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.1-7.el8.noarch 2023-09-13T09:29:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.0.4-10.el8.x86_64 2023-09-13T09:29:55.947 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.948 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.949 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.950 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.951 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:29:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-13T09:29:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.1-9.el8.x86_64 2023-09-13T09:29:55.952 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-13T09:29:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-13T09:29:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: jq-1.6-3.el8.x86_64 2023-09-13T09:29:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-13T09:29:55.953 INFO:teuthology.orchestra.run.smithi131.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-13T09:29:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-13T09:29:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.954 INFO:teuthology.orchestra.run.smithi131.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-13T09:29:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-13T09:29:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-13T09:29:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: libpq-13.5-1.el8.x86_64 2023-09-13T09:29:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-13T09:29:55.955 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-13T09:29:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-13T09:29:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.956 INFO:teuthology.orchestra.run.smithi131.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-13T09:29:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-13T09:29:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-13T09:29:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-13T09:29:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-13T09:29:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-13T09:29:55.957 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-13T09:29:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-13T09:29:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-13T09:29:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-13T09:29:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-13T09:29:55.958 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-13T09:29:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-13T09:29:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-13T09:29:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:29:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:29:55.959 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:29:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-13T09:29:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-13T09:29:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-13T09:29:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-13T09:29:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-13T09:29:55.960 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-13T09:29:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-13T09:29:55.961 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-13T09:29:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-13T09:29:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-13T09:29:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-13T09:29:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-13T09:29:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-13T09:29:55.962 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-13T09:29:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-13T09:29:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-13T09:29:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-13T09:29:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-13T09:29:55.963 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-13T09:29:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-13T09:29:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-13T09:29:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-13T09:29:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-13T09:29:55.964 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-13T09:29:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-13T09:29:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-13T09:29:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-13T09:29:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-2.6-1.el8.noarch 2023-09-13T09:29:55.965 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-13T09:29:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-13T09:29:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-13T09:29:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-13T09:29:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-13T09:29:55.966 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-13T09:29:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-13T09:29:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-13T09:29:55.967 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-13T09:29:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-13T09:29:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-13T09:29:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-13T09:29:55.968 INFO:teuthology.orchestra.run.smithi131.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-13T09:29:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-13T09:29:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-13T09:29:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-13T09:29:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-13T09:29:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-13T09:29:55.969 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-13T09:29:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-13T09:29:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-13T09:29:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.970 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:29:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-13T09:29:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-13T09:29:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-13T09:29:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-13T09:29:55.971 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-13T09:29:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-13T09:29:55.972 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:29:55.972 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2023-09-13T09:29:55.974 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T09:29:56.010 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 111/134 2023-09-13T09:29:56.137 DEBUG:teuthology.parallel:result is None 2023-09-13T09:29:56.148 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T09:29:56.192 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6083.g4a754 112/134 2023-09-13T09:29:56.331 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T09:29:56.714 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 113/134 2023-09-13T09:29:56.864 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T09:29:57.800 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:29:57.801 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:55 ago on Wed 13 Sep 2023 09:28:02 AM UTC. 2023-09-13T09:30:01.301 INFO:teuthology.orchestra.run.smithi006.stdout:Installed products updated. 2023-09-13T09:30:01.532 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:30:01.532 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2023-09-13T09:30:01.532 INFO:teuthology.orchestra.run.smithi006.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-13T09:30:01.533 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.533 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.533 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2023-09-13T09:30:01.533 INFO:teuthology.orchestra.run.smithi006.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-13T09:30:01.533 INFO:teuthology.orchestra.run.smithi006.stdout: automake-1.16.1-7.el8.noarch 2023-09-13T09:30:01.534 INFO:teuthology.orchestra.run.smithi006.stdout: bison-3.0.4-10.el8.x86_64 2023-09-13T09:30:01.534 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.534 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.534 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.535 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.535 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.535 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.535 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.535 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.536 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.536 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.536 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.536 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.536 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.537 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.537 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.537 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.537 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.537 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.538 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.538 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.538 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.538 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.538 INFO:teuthology.orchestra.run.smithi006.stdout: cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:01.539 INFO:teuthology.orchestra.run.smithi006.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-13T09:30:01.539 INFO:teuthology.orchestra.run.smithi006.stdout: flex-2.6.1-9.el8.x86_64 2023-09-13T09:30:01.539 INFO:teuthology.orchestra.run.smithi006.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-13T09:30:01.539 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-13T09:30:01.539 INFO:teuthology.orchestra.run.smithi006.stdout: jq-1.6-3.el8.x86_64 2023-09-13T09:30:01.540 INFO:teuthology.orchestra.run.smithi006.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-13T09:30:01.540 INFO:teuthology.orchestra.run.smithi006.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-13T09:30:01.540 INFO:teuthology.orchestra.run.smithi006.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-13T09:30:01.540 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.540 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-13T09:30:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-13T09:30:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-13T09:30:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: libpq-13.5-1.el8.x86_64 2023-09-13T09:30:01.542 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-13T09:30:01.542 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-13T09:30:01.542 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.542 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.542 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-13T09:30:01.543 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.543 INFO:teuthology.orchestra.run.smithi006.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-13T09:30:01.543 INFO:teuthology.orchestra.run.smithi006.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-13T09:30:01.543 INFO:teuthology.orchestra.run.smithi006.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-13T09:30:01.543 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-13T09:30:01.543 INFO:teuthology.orchestra.run.smithi006.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-13T09:30:01.544 INFO:teuthology.orchestra.run.smithi006.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-13T09:30:01.544 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-13T09:30:01.544 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-13T09:30:01.544 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-13T09:30:01.544 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-13T09:30:01.545 INFO:teuthology.orchestra.run.smithi006.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-13T09:30:01.545 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-13T09:30:01.545 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-13T09:30:01.545 INFO:teuthology.orchestra.run.smithi006.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-13T09:30:01.545 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:30:01.546 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:30:01.546 INFO:teuthology.orchestra.run.smithi006.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:30:01.546 INFO:teuthology.orchestra.run.smithi006.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-13T09:30:01.546 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-13T09:30:01.546 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-13T09:30:01.547 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-13T09:30:01.547 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-13T09:30:01.547 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.547 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.547 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.548 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-13T09:30:01.548 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-13T09:30:01.548 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-13T09:30:01.548 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-13T09:30:01.548 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-13T09:30:01.548 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-13T09:30:01.549 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-13T09:30:01.549 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-13T09:30:01.549 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-13T09:30:01.549 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-13T09:30:01.549 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-13T09:30:01.550 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-13T09:30:01.550 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-13T09:30:01.550 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-13T09:30:01.550 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-13T09:30:01.550 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-13T09:30:01.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-13T09:30:01.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-13T09:30:01.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-13T09:30:01.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-13T09:30:01.551 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-13T09:30:01.552 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-13T09:30:01.552 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2023-09-13T09:30:01.552 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-13T09:30:01.552 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-13T09:30:01.552 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-13T09:30:01.553 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-13T09:30:01.553 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-13T09:30:01.553 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-13T09:30:01.553 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.553 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.553 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-13T09:30:01.554 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-13T09:30:01.554 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.554 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-13T09:30:01.554 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-13T09:30:01.554 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-13T09:30:01.555 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-13T09:30:01.555 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-13T09:30:01.555 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-13T09:30:01.555 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-13T09:30:01.555 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-13T09:30:01.556 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-13T09:30:01.556 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-13T09:30:01.556 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-13T09:30:01.556 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-13T09:30:01.556 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-13T09:30:01.557 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.557 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.557 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:01.557 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-13T09:30:01.557 INFO:teuthology.orchestra.run.smithi006.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-13T09:30:01.557 INFO:teuthology.orchestra.run.smithi006.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-13T09:30:01.558 INFO:teuthology.orchestra.run.smithi006.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-13T09:30:01.558 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-13T09:30:01.558 INFO:teuthology.orchestra.run.smithi006.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-13T09:30:01.559 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:30:01.559 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2023-09-13T09:30:01.773 DEBUG:teuthology.parallel:result is None 2023-09-13T09:30:01.794 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 114/134 2023-09-13T09:30:02.080 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 115/134 2023-09-13T09:30:02.230 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-09-13T09:30:02.437 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-09-13T09:30:03.383 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-09-13T09:30:03.730 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-09-13T09:30:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 119/134 2023-09-13T09:30:04.084 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-13T09:30:04.251 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 121/134 2023-09-13T09:30:04.381 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T09:30:06.759 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:30:07.038 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:30:07.058 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-09-13T09:30:07.188 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 124/134 2023-09-13T09:30:07.463 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 125/134 2023-09-13T09:30:07.763 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 126/134 2023-09-13T09:30:08.048 INFO:teuthology.orchestra.run.smithi053.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-09-13T09:30:08.190 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T09:30:08.196 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T09:30:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-09-13T09:30:08.596 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-09-13T09:30:08.683 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-09-13T09:30:08.882 INFO:teuthology.orchestra.run.smithi053.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-09-13T09:30:08.893 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-09-13T09:30:08.893 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:30:09.071 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:30:09.071 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T09:30:09.294 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-09-13T09:30:09.488 INFO:teuthology.orchestra.run.smithi053.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:30:10.043 INFO:teuthology.orchestra.run.smithi053.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:30:10.044 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 1/134 2023-09-13T09:30:10.044 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2/134 2023-09-13T09:30:10.044 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 3/134 2023-09-13T09:30:10.044 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 4/134 2023-09-13T09:30:10.045 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6083.g4a754 5/134 2023-09-13T09:30:10.045 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 6/134 2023-09-13T09:30:10.045 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 7/134 2023-09-13T09:30:10.045 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 8/134 2023-09-13T09:30:10.045 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 9/134 2023-09-13T09:30:10.046 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 10/134 2023-09-13T09:30:10.046 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 11/134 2023-09-13T09:30:10.046 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 12/134 2023-09-13T09:30:10.046 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 13/134 2023-09-13T09:30:10.046 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_ 14/134 2023-09-13T09:30:10.047 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 15/134 2023-09-13T09:30:10.047 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 16/134 2023-09-13T09:30:10.047 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_6 17/134 2023-09-13T09:30:10.047 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86 18/134 2023-09-13T09:30:10.047 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 19/134 2023-09-13T09:30:10.048 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el 20/134 2023-09-13T09:30:10.048 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8. 21/134 2023-09-13T09:30:10.048 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_6 22/134 2023-09-13T09:30:10.048 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 23/134 2023-09-13T09:30:10.048 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 24/134 2023-09-13T09:30:10.049 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 25/134 2023-09-13T09:30:10.049 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 26/134 2023-09-13T09:30:10.049 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 27/134 2023-09-13T09:30:10.049 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 28/134 2023-09-13T09:30:10.049 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9. 29/134 2023-09-13T09:30:10.050 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noa 30/134 2023-09-13T09:30:10.050 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.n 31/134 2023-09-13T09:30:10.050 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a7 32/134 2023-09-13T09:30:10.050 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el 33/134 2023-09-13T09:30:10.050 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 34/134 2023-09-13T09:30:10.051 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.e 35/134 2023-09-13T09:30:10.051 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 36/134 2023-09-13T09:30:10.051 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 37/134 2023-09-13T09:30:10.051 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 38/134 2023-09-13T09:30:10.051 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-09-13T09:30:10.052 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-09-13T09:30:10.052 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-09-13T09:30:10.052 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-09-13T09:30:10.052 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-09-13T09:30:10.052 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-09-13T09:30:10.052 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-09-13T09:30:10.053 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-09-13T09:30:10.053 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-09-13T09:30:10.053 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-09-13T09:30:10.053 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-09-13T09:30:10.053 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-09-13T09:30:10.054 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-09-13T09:30:10.054 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-09-13T09:30:10.054 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-09-13T09:30:10.054 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-09-13T09:30:10.054 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-09-13T09:30:10.055 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-09-13T09:30:10.055 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-09-13T09:30:10.055 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-09-13T09:30:10.055 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-09-13T09:30:10.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/134 2023-09-13T09:30:10.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-09-13T09:30:10.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-09-13T09:30:10.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-09-13T09:30:10.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-09-13T09:30:10.056 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-09-13T09:30:10.057 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-09-13T09:30:10.057 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-09-13T09:30:10.057 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-09-13T09:30:10.057 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-09-13T09:30:10.057 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-09-13T09:30:10.058 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-09-13T09:30:10.058 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-09-13T09:30:10.058 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-09-13T09:30:10.058 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-09-13T09:30:10.058 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-09-13T09:30:10.059 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-09-13T09:30:10.059 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-09-13T09:30:10.059 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-09-13T09:30:10.059 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-09-13T09:30:10.059 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-09-13T09:30:10.059 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-09-13T09:30:10.060 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-09-13T09:30:10.060 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-09-13T09:30:10.060 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-09-13T09:30:10.060 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-09-13T09:30:10.060 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-09-13T09:30:10.061 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-09-13T09:30:10.061 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-09-13T09:30:10.061 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-09-13T09:30:10.061 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-09-13T09:30:10.061 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-09-13T09:30:10.062 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-09-13T09:30:10.062 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-09-13T09:30:10.062 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-09-13T09:30:10.062 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-09-13T09:30:10.062 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-09-13T09:30:10.063 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-09-13T09:30:10.063 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-09-13T09:30:10.063 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-09-13T09:30:10.063 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-09-13T09:30:10.063 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-09-13T09:30:10.064 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-09-13T09:30:10.064 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-09-13T09:30:10.064 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-09-13T09:30:10.064 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-09-13T09:30:10.064 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-09-13T09:30:10.064 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-09-13T09:30:10.065 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-09-13T09:30:10.065 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-09-13T09:30:10.065 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-09-13T09:30:10.065 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-09-13T09:30:10.065 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-09-13T09:30:10.066 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-09-13T09:30:10.066 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-09-13T09:30:10.066 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-09-13T09:30:10.066 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-09-13T09:30:10.066 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-09-13T09:30:10.067 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-09-13T09:30:10.067 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-09-13T09:30:10.067 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-09-13T09:30:10.067 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-09-13T09:30:10.067 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-09-13T09:30:10.068 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-09-13T09:30:10.068 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-09-13T09:30:10.068 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-09-13T09:30:10.068 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-09-13T09:30:10.068 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-09-13T09:30:10.068 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-09-13T09:30:10.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 129/134 2023-09-13T09:30:10.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-09-13T09:30:10.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 131/134 2023-09-13T09:30:10.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-09-13T09:30:10.069 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-09-13T09:30:12.643 INFO:teuthology.orchestra.run.smithi053.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-09-13T09:30:12.643 INFO:teuthology.orchestra.run.smithi053.stdout:Last metadata expiration check: 0:01:51 ago on Wed 13 Sep 2023 09:28:21 AM UTC. 2023-09-13T09:30:16.945 INFO:teuthology.orchestra.run.smithi053.stdout:Installed products updated. 2023-09-13T09:30:17.177 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:30:17.178 INFO:teuthology.orchestra.run.smithi053.stdout:Upgraded: 2023-09-13T09:30:17.178 INFO:teuthology.orchestra.run.smithi053.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-09-13T09:30:17.178 INFO:teuthology.orchestra.run.smithi053.stdout: librados2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.178 INFO:teuthology.orchestra.run.smithi053.stdout: librbd1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.179 INFO:teuthology.orchestra.run.smithi053.stdout:Installed: 2023-09-13T09:30:17.179 INFO:teuthology.orchestra.run.smithi053.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-09-13T09:30:17.179 INFO:teuthology.orchestra.run.smithi053.stdout: automake-1.16.1-7.el8.noarch 2023-09-13T09:30:17.179 INFO:teuthology.orchestra.run.smithi053.stdout: bison-3.0.4-10.el8.x86_64 2023-09-13T09:30:17.180 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.180 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-base-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.180 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.180 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.180 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-grafana-dashboards-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.181 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-immutable-object-cache-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.181 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mds-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.181 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.181 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.181 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-dashboard-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.182 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.182 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-modules-core-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.182 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mgr-rook-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.182 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-mon-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.183 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-osd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.183 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-prometheus-alerts-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.183 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-radosgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.183 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-selinux-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.183 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-test-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.184 INFO:teuthology.orchestra.run.smithi053.stdout: ceph-volume-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.184 INFO:teuthology.orchestra.run.smithi053.stdout: cephadm-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.184 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.184 INFO:teuthology.orchestra.run.smithi053.stdout: cephfs-top-2:18.0.0-6083.g4a754ac9.el8.noarch 2023-09-13T09:30:17.184 INFO:teuthology.orchestra.run.smithi053.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-13T09:30:17.185 INFO:teuthology.orchestra.run.smithi053.stdout: flex-2.6.1-9.el8.x86_64 2023-09-13T09:30:17.185 INFO:teuthology.orchestra.run.smithi053.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-13T09:30:17.185 INFO:teuthology.orchestra.run.smithi053.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-13T09:30:17.185 INFO:teuthology.orchestra.run.smithi053.stdout: jq-1.6-3.el8.x86_64 2023-09-13T09:30:17.185 INFO:teuthology.orchestra.run.smithi053.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-13T09:30:17.186 INFO:teuthology.orchestra.run.smithi053.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-13T09:30:17.186 INFO:teuthology.orchestra.run.smithi053.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-13T09:30:17.186 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.186 INFO:teuthology.orchestra.run.smithi053.stdout: libcephfs2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.187 INFO:teuthology.orchestra.run.smithi053.stdout: libcephsqlite-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.187 INFO:teuthology.orchestra.run.smithi053.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-13T09:30:17.187 INFO:teuthology.orchestra.run.smithi053.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-13T09:30:17.187 INFO:teuthology.orchestra.run.smithi053.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-13T09:30:17.187 INFO:teuthology.orchestra.run.smithi053.stdout: libpq-13.5-1.el8.x86_64 2023-09-13T09:30:17.188 INFO:teuthology.orchestra.run.smithi053.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-13T09:30:17.188 INFO:teuthology.orchestra.run.smithi053.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-13T09:30:17.188 INFO:teuthology.orchestra.run.smithi053.stdout: librados-devel-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.188 INFO:teuthology.orchestra.run.smithi053.stdout: libradosstriper1-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.188 INFO:teuthology.orchestra.run.smithi053.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-13T09:30:17.189 INFO:teuthology.orchestra.run.smithi053.stdout: librgw2-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.189 INFO:teuthology.orchestra.run.smithi053.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-13T09:30:17.189 INFO:teuthology.orchestra.run.smithi053.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-13T09:30:17.189 INFO:teuthology.orchestra.run.smithi053.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-13T09:30:17.189 INFO:teuthology.orchestra.run.smithi053.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-13T09:30:17.190 INFO:teuthology.orchestra.run.smithi053.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-13T09:30:17.190 INFO:teuthology.orchestra.run.smithi053.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-13T09:30:17.190 INFO:teuthology.orchestra.run.smithi053.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-13T09:30:17.190 INFO:teuthology.orchestra.run.smithi053.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-13T09:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-13T09:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-13T09:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-13T09:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-13T09:30:17.191 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-13T09:30:17.192 INFO:teuthology.orchestra.run.smithi053.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-13T09:30:17.192 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:30:17.192 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:30:17.192 INFO:teuthology.orchestra.run.smithi053.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-09-13T09:30:17.192 INFO:teuthology.orchestra.run.smithi053.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-13T09:30:17.193 INFO:teuthology.orchestra.run.smithi053.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-13T09:30:17.193 INFO:teuthology.orchestra.run.smithi053.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-13T09:30:17.193 INFO:teuthology.orchestra.run.smithi053.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-13T09:30:17.193 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-13T09:30:17.193 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-argparse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.194 INFO:teuthology.orchestra.run.smithi053.stdout: python3-ceph-common-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.194 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cephfs-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.194 INFO:teuthology.orchestra.run.smithi053.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-13T09:30:17.194 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-13T09:30:17.194 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-13T09:30:17.195 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-13T09:30:17.195 INFO:teuthology.orchestra.run.smithi053.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-13T09:30:17.195 INFO:teuthology.orchestra.run.smithi053.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-13T09:30:17.195 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-13T09:30:17.196 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-13T09:30:17.196 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-13T09:30:17.196 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-13T09:30:17.196 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-13T09:30:17.196 INFO:teuthology.orchestra.run.smithi053.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-13T09:30:17.197 INFO:teuthology.orchestra.run.smithi053.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-13T09:30:17.197 INFO:teuthology.orchestra.run.smithi053.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-13T09:30:17.197 INFO:teuthology.orchestra.run.smithi053.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-13T09:30:17.197 INFO:teuthology.orchestra.run.smithi053.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-13T09:30:17.197 INFO:teuthology.orchestra.run.smithi053.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-13T09:30:17.198 INFO:teuthology.orchestra.run.smithi053.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-13T09:30:17.198 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-13T09:30:17.198 INFO:teuthology.orchestra.run.smithi053.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-13T09:30:17.198 INFO:teuthology.orchestra.run.smithi053.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-13T09:30:17.199 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-13T09:30:17.199 INFO:teuthology.orchestra.run.smithi053.stdout: python3-portend-2.6-1.el8.noarch 2023-09-13T09:30:17.199 INFO:teuthology.orchestra.run.smithi053.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-13T09:30:17.199 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-13T09:30:17.199 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-13T09:30:17.200 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-13T09:30:17.200 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-13T09:30:17.200 INFO:teuthology.orchestra.run.smithi053.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-13T09:30:17.200 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rados-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.200 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.201 INFO:teuthology.orchestra.run.smithi053.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-13T09:30:17.201 INFO:teuthology.orchestra.run.smithi053.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-13T09:30:17.201 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rgw-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.201 INFO:teuthology.orchestra.run.smithi053.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-13T09:30:17.202 INFO:teuthology.orchestra.run.smithi053.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-13T09:30:17.202 INFO:teuthology.orchestra.run.smithi053.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-13T09:30:17.202 INFO:teuthology.orchestra.run.smithi053.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-13T09:30:17.202 INFO:teuthology.orchestra.run.smithi053.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-13T09:30:17.203 INFO:teuthology.orchestra.run.smithi053.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-13T09:30:17.203 INFO:teuthology.orchestra.run.smithi053.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-13T09:30:17.203 INFO:teuthology.orchestra.run.smithi053.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-13T09:30:17.203 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-13T09:30:17.203 INFO:teuthology.orchestra.run.smithi053.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-13T09:30:17.204 INFO:teuthology.orchestra.run.smithi053.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-13T09:30:17.204 INFO:teuthology.orchestra.run.smithi053.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-13T09:30:17.204 INFO:teuthology.orchestra.run.smithi053.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-13T09:30:17.204 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-fuse-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.204 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-mirror-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.205 INFO:teuthology.orchestra.run.smithi053.stdout: rbd-nbd-2:18.0.0-6083.g4a754ac9.el8.x86_64 2023-09-13T09:30:17.205 INFO:teuthology.orchestra.run.smithi053.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-13T09:30:17.205 INFO:teuthology.orchestra.run.smithi053.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-13T09:30:17.205 INFO:teuthology.orchestra.run.smithi053.stdout: uuid-1.6.2-43.el8.x86_64 2023-09-13T09:30:17.205 INFO:teuthology.orchestra.run.smithi053.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-13T09:30:17.206 INFO:teuthology.orchestra.run.smithi053.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-13T09:30:17.206 INFO:teuthology.orchestra.run.smithi053.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-13T09:30:17.206 INFO:teuthology.orchestra.run.smithi053.stdout: 2023-09-13T09:30:17.207 INFO:teuthology.orchestra.run.smithi053.stdout:Complete! 2023-09-13T09:30:17.358 DEBUG:teuthology.parallel:result is None 2023-09-13T09:30:17.359 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:30:17.575 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-13T09:30:17.606 INFO:teuthology.orchestra.run.smithi006.stdout:18.0.0-6083.g4a754ac9.el8 2023-09-13T09:30:17.607 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6083.g4a754ac9.el8 2023-09-13T09:30:17.607 INFO:teuthology.task.install:The correct ceph version 18.0.0-6083.g4a754ac9 is installed. 2023-09-13T09:30:17.608 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:30:17.746 DEBUG:teuthology.orchestra.run.smithi053:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-13T09:30:17.772 INFO:teuthology.orchestra.run.smithi053.stdout:18.0.0-6083.g4a754ac9.el8 2023-09-13T09:30:17.772 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6083.g4a754ac9.el8 2023-09-13T09:30:17.773 INFO:teuthology.task.install:The correct ceph version 18.0.0-6083.g4a754ac9 is installed. 2023-09-13T09:30:17.774 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:30:17.914 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-13T09:30:17.943 INFO:teuthology.orchestra.run.smithi131.stdout:18.0.0-6083.g4a754ac9.el8 2023-09-13T09:30:17.944 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6083.g4a754ac9.el8 2023-09-13T09:30:17.944 INFO:teuthology.task.install:The correct ceph version 18.0.0-6083.g4a754ac9 is installed. 2023-09-13T09:30:17.945 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-13T09:30:17.945 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:30:17.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T09:30:17.996 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:30:17.996 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T09:30:18.043 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:30:18.044 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-13T09:30:18.093 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-13T09:30:18.093 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:30:18.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T09:30:18.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T09:30:18.228 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:30:18.229 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T09:30:18.260 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T09:30:18.330 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:30:18.330 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2023-09-13T09:30:18.362 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-13T09:30:18.431 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-13T09:30:18.432 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:30:18.432 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T09:30:18.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T09:30:18.537 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:30:18.538 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T09:30:18.569 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T09:30:18.640 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:30:18.640 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-13T09:30:18.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-13T09:30:18.743 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-13T09:30:18.744 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:30:18.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T09:30:18.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T09:30:18.849 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:30:18.850 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T09:30:18.886 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T09:30:18.958 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:30:18.958 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2023-09-13T09:30:18.990 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-13T09:30:19.061 INFO:teuthology.run_tasks:Running task cephadm... 2023-09-13T09:30:19.271 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-09-13T09:30:19.272 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:30:19.273 INFO:tasks.cephadm:Cluster fsid is 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:30:19.273 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-09-13T09:30:19.274 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.6', 'mon.b': '172.21.15.53', 'mon.c': '172.21.15.131'} 2023-09-13T09:30:19.274 INFO:tasks.cephadm:First mon is mon.a on smithi006 2023-09-13T09:30:19.275 INFO:tasks.cephadm:First mgr is x 2023-09-13T09:30:19.275 INFO:tasks.cephadm:Normalizing hostnames... 2023-09-13T09:30:19.275 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname $(hostname -s) 2023-09-13T09:30:19.313 DEBUG:teuthology.orchestra.run.smithi053:> sudo hostname $(hostname -s) 2023-09-13T09:30:19.348 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname $(hostname -s) 2023-09-13T09:30:19.381 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-09-13T09:30:19.382 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:30:19.523 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/72555/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-6083-g4a754ac9', 'node_name': '172.21.2.5+braggi05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-6083.g4a754ac9'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-09-12 09:50:44.139622', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-2023sep12-b2', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-09-13T09:30:19.759 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-rishabh-2023sep12-b2, sha1 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:30:19.760 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/x86_64/flavors/default/cephadm 2023-09-13T09:30:19.760 DEBUG:teuthology.orchestra.run.smithi006:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:20.464 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-rw-r--. 1 ubuntu ubuntu 728366 Sep 13 09:30 /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:20.465 DEBUG:teuthology.orchestra.run.smithi053:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:20.879 INFO:teuthology.orchestra.run.smithi053.stdout:-rw-rw-r--. 1 ubuntu ubuntu 728366 Sep 13 09:30 /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:20.880 DEBUG:teuthology.orchestra.run.smithi131:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-rishabh-2023sep12-b2/4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:21.304 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-rw-r--. 1 ubuntu ubuntu 728366 Sep 13 09:30 /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:21.305 DEBUG:teuthology.orchestra.run.smithi006:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:21.327 DEBUG:teuthology.orchestra.run.smithi053:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:21.350 DEBUG:teuthology.orchestra.run.smithi131:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-09-13T09:30:21.387 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 on all hosts... 2023-09-13T09:30:21.387 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 pull 2023-09-13T09:30:21.390 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 pull 2023-09-13T09:30:21.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 pull 2023-09-13T09:30:22.795 INFO:teuthology.orchestra.run.smithi131.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5... 2023-09-13T09:30:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5... 2023-09-13T09:30:27.085 INFO:teuthology.orchestra.run.smithi053.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5... 2023-09-13T09:30:51.876 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-09-13T09:30:51.876 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev)", 2023-09-13T09:30:51.876 INFO:teuthology.orchestra.run.smithi131.stdout: "image_id": "ac82d04f119cd3d453966b1e12977b81535381fb4e22ee1754e33c107a26ea70", 2023-09-13T09:30:51.877 INFO:teuthology.orchestra.run.smithi131.stdout: "repo_digests": [ 2023-09-13T09:30:51.877 INFO:teuthology.orchestra.run.smithi131.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:eb90da591c5598a9ef0b91a8a434a296d6fd7e7f7757865710c99a2f150ff6a7" 2023-09-13T09:30:51.877 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2023-09-13T09:30:51.877 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-09-13T09:30:52.724 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:30:52.724 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev)", 2023-09-13T09:30:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "image_id": "ac82d04f119cd3d453966b1e12977b81535381fb4e22ee1754e33c107a26ea70", 2023-09-13T09:30:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "repo_digests": [ 2023-09-13T09:30:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:eb90da591c5598a9ef0b91a8a434a296d6fd7e7f7757865710c99a2f150ff6a7" 2023-09-13T09:30:52.725 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T09:30:52.726 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:30:56.384 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-13T09:30:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_version": "ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev)", 2023-09-13T09:30:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "image_id": "ac82d04f119cd3d453966b1e12977b81535381fb4e22ee1754e33c107a26ea70", 2023-09-13T09:30:56.384 INFO:teuthology.orchestra.run.smithi053.stdout: "repo_digests": [ 2023-09-13T09:30:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:eb90da591c5598a9ef0b91a8a434a296d6fd7e7f7757865710c99a2f150ff6a7" 2023-09-13T09:30:56.385 INFO:teuthology.orchestra.run.smithi053.stdout: ] 2023-09-13T09:30:56.385 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-13T09:30:56.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph 2023-09-13T09:30:56.445 DEBUG:teuthology.orchestra.run.smithi053:> sudo mkdir -p /etc/ceph 2023-09-13T09:30:56.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph 2023-09-13T09:30:56.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /etc/ceph 2023-09-13T09:30:56.546 DEBUG:teuthology.orchestra.run.smithi053:> sudo chmod 777 /etc/ceph 2023-09-13T09:30:56.574 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /etc/ceph 2023-09-13T09:30:56.607 INFO:tasks.cephadm:Writing seed config... 2023-09-13T09:30:56.611 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-09-13T09:30:56.612 INFO:tasks.cephadm: override: [client] debug client = 20 2023-09-13T09:30:56.612 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-09-13T09:30:56.612 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-09-13T09:30:56.612 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-09-13T09:30:56.613 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2023-09-13T09:30:56.613 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-09-13T09:30:56.613 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-09-13T09:30:56.613 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-09-13T09:30:56.614 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-09-13T09:30:56.614 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-09-13T09:30:56.614 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-09-13T09:30:56.614 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-09-13T09:30:56.615 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-09-13T09:30:56.615 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-09-13T09:30:56.615 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-09-13T09:30:56.616 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-09-13T09:30:56.616 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-09-13T09:30:56.616 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-09-13T09:30:56.616 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-09-13T09:30:56.617 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-09-13T09:30:56.617 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-09-13T09:30:56.617 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-09-13T09:30:56.617 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-09-13T09:30:56.618 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-09-13T09:30:56.618 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-09-13T09:30:56.618 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-09-13T09:30:56.619 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2023-09-13T09:30:56.619 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2023-09-13T09:30:56.619 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2023-09-13T09:30:56.619 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-09-13T09:30:56.620 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-09-13T09:30:56.620 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2023-09-13T09:30:56.620 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2023-09-13T09:30:56.620 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-09-13T09:30:56.621 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-09-13T09:30:56.621 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2023-09-13T09:30:56.621 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-09-13T09:30:56.621 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-09-13T09:30:56.622 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-09-13T09:30:56.622 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-09-13T09:30:56.622 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-09-13T09:30:56.622 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-09-13T09:30:56.623 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-09-13T09:30:56.623 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-09-13T09:30:56.624 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:30:56.624 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-09-13T09:30:56.646 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-09-13T09:30:56.646 DEBUG:teuthology.orchestra.run.smithi006:mon.a> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a.service 2023-09-13T09:30:56.688 DEBUG:teuthology.orchestra.run.smithi006:mgr.x> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.x.service 2023-09-13T09:30:56.719 INFO:journalctl@ceph.mon.a.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:30:56.719 INFO:tasks.cephadm:Bootstrapping... 2023-09-13T09:30:56.720 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 -v bootstrap --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.6 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-09-13T09:30:56.748 INFO:journalctl@ceph.mgr.x.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:30:56.893 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2023-09-13T09:30:56.893 INFO:teuthology.orchestra.run.smithi006.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5', '-v', 'bootstrap', '--fsid', '27a2bbd4-5218-11ee-9ab8-7b867c8bd7da', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.6', '--skip-admin-label'] 2023-09-13T09:30:57.042 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 4.1.1 2023-09-13T09:30:57.042 INFO:teuthology.orchestra.run.smithi006.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-09-13T09:30:57.043 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying podman|docker is present... 2023-09-13T09:30:57.190 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 4.1.1 2023-09-13T09:30:57.190 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying lvm2 is present... 2023-09-13T09:30:57.191 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying time synchronization is in place... 2023-09-13T09:30:57.195 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-09-13T09:30:57.195 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-09-13T09:30:57.201 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-09-13T09:30:57.201 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-09-13T09:30:57.207 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2023-09-13T09:30:57.213 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2023-09-13T09:30:57.213 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2023-09-13T09:30:57.213 INFO:teuthology.orchestra.run.smithi006.stdout:Repeating the final host check... 2023-09-13T09:30:57.358 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout 4.1.1 2023-09-13T09:30:57.358 INFO:teuthology.orchestra.run.smithi006.stdout:podman (/bin/podman) version 4.1.1 is present 2023-09-13T09:30:57.358 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl is present 2023-09-13T09:30:57.359 INFO:teuthology.orchestra.run.smithi006.stdout:lvcreate is present 2023-09-13T09:30:57.364 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-09-13T09:30:57.364 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-09-13T09:30:57.370 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-09-13T09:30:57.370 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-09-13T09:30:57.376 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout enabled 2023-09-13T09:30:57.382 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout active 2023-09-13T09:30:57.382 INFO:teuthology.orchestra.run.smithi006.stdout:Unit chronyd.service is enabled and running 2023-09-13T09:30:57.382 INFO:teuthology.orchestra.run.smithi006.stdout:Host looks OK 2023-09-13T09:30:57.383 INFO:teuthology.orchestra.run.smithi006.stdout:Cluster fsid: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:30:57.383 INFO:teuthology.orchestra.run.smithi006.stdout:Acquiring lock 139990360642560 on /run/cephadm/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.lock 2023-09-13T09:30:57.383 INFO:teuthology.orchestra.run.smithi006.stdout:Lock 139990360642560 acquired on /run/cephadm/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.lock 2023-09-13T09:30:57.384 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 3300 ... 2023-09-13T09:30:57.384 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying IP 172.21.15.6 port 6789 ... 2023-09-13T09:30:57.384 INFO:teuthology.orchestra.run.smithi006.stdout:Base mon IP(s) is [172.21.15.6:3300, 172.21.15.6:6789], mon addrv is [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2023-09-13T09:30:57.387 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-09-13T09:30:57.387 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.6 metric 100 2023-09-13T09:30:57.389 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-09-13T09:30:57.390 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-09-13T09:30:57.390 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1757sec hoplimit 64 pref medium 2023-09-13T09:30:57.392 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-09-13T09:30:57.392 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-09-13T09:30:57.392 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-09-13T09:30:57.393 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-09-13T09:30:57.393 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-09-13T09:30:57.393 INFO:teuthology.orchestra.run.smithi006.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-09-13T09:30:57.394 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2023-09-13T09:30:57.394 INFO:teuthology.orchestra.run.smithi006.stdout:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2023-09-13T09:30:57.394 INFO:teuthology.orchestra.run.smithi006.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-09-13T09:30:57.394 INFO:teuthology.orchestra.run.smithi006.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-09-13T09:30:57.395 INFO:teuthology.orchestra.run.smithi006.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5... 2023-09-13T09:30:57.843 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stdout ac82d04f119cd3d453966b1e12977b81535381fb4e22ee1754e33c107a26ea70 2023-09-13T09:30:57.844 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5... 2023-09-13T09:30:57.844 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Getting image source signatures 2023-09-13T09:30:57.844 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:0b53ffc1534070466eed446ff3128d72b2b3e0d7ba8de1a754a39e0b329d99bb 2023-09-13T09:30:57.845 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying blob sha256:aba40bcce7ff9e06f5f6d056b94d79b3c5f9fa5aba1a4d6d95b68b2cadf32b62 2023-09-13T09:30:57.845 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Copying config sha256:ac82d04f119cd3d453966b1e12977b81535381fb4e22ee1754e33c107a26ea70 2023-09-13T09:30:57.845 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Writing manifest to image destination 2023-09-13T09:30:57.846 INFO:teuthology.orchestra.run.smithi006.stdout:/bin/podman: stderr Storing signatures 2023-09-13T09:30:58.691 INFO:teuthology.orchestra.run.smithi006.stdout:ceph: stdout ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T09:30:58.691 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph version: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev) 2023-09-13T09:30:58.692 INFO:teuthology.orchestra.run.smithi006.stdout:Extracting ceph user uid/gid from container image... 2023-09-13T09:30:59.445 INFO:teuthology.orchestra.run.smithi006.stdout:stat: stdout 167 167 2023-09-13T09:30:59.446 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial keys... 2023-09-13T09:31:00.093 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQBTgQFlLv/TLxAAQi3++6gf/V5S8TUHJOcXWQ== 2023-09-13T09:31:00.842 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQBUgQFlYuD7HBAA9xu3XByMYkAIzrynmEpRWA== 2023-09-13T09:31:01.490 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph-authtool: stdout AQBVgQFlau2UCxAAtNT242OLZrbpWIljmON6lw== 2023-09-13T09:31:01.490 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial monmap... 2023-09-13T09:31:02.236 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-09-13T09:31:02.236 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-09-13T09:31:02.237 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:02.237 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-09-13T09:31:02.237 INFO:teuthology.orchestra.run.smithi006.stdout:monmaptool for a [v2:172.21.15.6:3300,v1:172.21.15.6:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-09-13T09:31:02.237 INFO:teuthology.orchestra.run.smithi006.stdout:setting min_mon_release = pacific 2023-09-13T09:31:02.238 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: set fsid to 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:02.238 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-09-13T09:31:02.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:31:02.238 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mon... 2023-09-13T09:31:02.984 INFO:teuthology.orchestra.run.smithi006.stdout:create mon.a on 2023-09-13T09:31:03.112 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-09-13T09:31:03.202 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-09-13T09:31:03.330 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.target → /etc/systemd/system/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.target. 2023-09-13T09:31:03.331 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.target → /etc/systemd/system/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.target. 2023-09-13T09:31:03.530 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a 2023-09-13T09:31:03.530 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a.service: Unit ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a.service not loaded. 2023-09-13T09:31:03.618 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.target.wants/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a.service → /etc/systemd/system/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@.service. 2023-09-13T09:31:03.911 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:03 smithi006 systemd[1]: Starting Ceph mon.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:31:04.125 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-13T09:31:04.126 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-09-13T09:31:04.134 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-13T09:31:04.134 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-09-13T09:31:04.134 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-09-13T09:31:04.135 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2023-09-13T09:31:04.135 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon to start... 2023-09-13T09:31:04.135 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mon... 2023-09-13T09:31:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:03 smithi006 podman[98112]: 2023-09-13T09:31:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:04 smithi006 bash[98112]: 30deb3155f75dfe54e038f6677dddb464d7296e401860a3b9e19aaf49c600729 2023-09-13T09:31:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:04 smithi006 systemd[1]: Started Ceph mon.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:31:04.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:04 smithi006 ceph-mon[98153]: mkfs 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:04.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:04 smithi006 ceph-mon[98153]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-13T09:31:05.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:05 smithi006 ceph-mon[98153]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-13T09:31:05.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:05 smithi006 ceph-mon[98153]: monmap e1: 1 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0]} removed_ranks: {} 2023-09-13T09:31:05.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:05 smithi006 ceph-mon[98153]: fsmap 2023-09-13T09:31:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:05 smithi006 ceph-mon[98153]: osdmap e1: 0 total, 0 up, 0 in 2023-09-13T09:31:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:05 smithi006 ceph-mon[98153]: mgrmap e1: no daemons active 2023-09-13T09:31:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:05 smithi006 ceph-mon[98153]: from='client.? 172.21.15.6:0/729221210' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-09-13T09:31:06.490 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout cluster: 2023-09-13T09:31:06.496 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout id: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:06.496 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-09-13T09:31:06.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:06.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout services: 2023-09-13T09:31:06.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.646133s) 2023-09-13T09:31:06.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-09-13T09:31:06.497 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-09-13T09:31:06.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:06.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout data: 2023-09-13T09:31:06.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-09-13T09:31:06.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-09-13T09:31:06.498 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-09-13T09:31:06.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout pgs: 2023-09-13T09:31:06.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:06.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.649+0000 7fe8e2f14700 1 Processor -- start 2023-09-13T09:31:06.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.649+0000 7fe8e2f14700 1 -- start start 2023-09-13T09:31:06.499 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.649+0000 7fe8e2f14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc1058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:06.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.649+0000 7fe8e2f14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc105e70 con 0x7fe8dc105480 2023-09-13T09:31:06.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.649+0000 7fe8e0cb0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc1058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:06.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.649+0000 7fe8e0cb0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc1058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59060/0 (socket says 172.21.15.6:59060) 2023-09-13T09:31:06.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.649+0000 7fe8e0cb0700 1 -- 172.21.15.6:0/1025532739 learned_addr learned my addr 172.21.15.6:0/1025532739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:06.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.650+0000 7fe8e0cb0700 1 -- 172.21.15.6:0/1025532739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8dc106680 con 0x7fe8dc105480 2023-09-13T09:31:06.500 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.650+0000 7fe8e0cb0700 1 --2- 172.21.15.6:0/1025532739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc1058a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00098a0 tx=0x7fe8d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eead5153aec0a7e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:06.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.650+0000 7fe8db7fe700 1 -- 172.21.15.6:0/1025532739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0004160 con 0x7fe8dc105480 2023-09-13T09:31:06.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.650+0000 7fe8db7fe700 1 -- 172.21.15.6:0/1025532739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d00042c0 con 0x7fe8dc105480 2023-09-13T09:31:06.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.650+0000 7fe8db7fe700 1 -- 172.21.15.6:0/1025532739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d00045a0 con 0x7fe8dc105480 2023-09-13T09:31:06.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 -- 172.21.15.6:0/1025532739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 msgr2=0x7fe8dc1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:06.501 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 --2- 172.21.15.6:0/1025532739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc1058a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fe8d00098a0 tx=0x7fe8d0009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:06.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 -- 172.21.15.6:0/1025532739 shutdown_connections 2023-09-13T09:31:06.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 --2- 172.21.15.6:0/1025532739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc1058a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:06.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 -- 172.21.15.6:0/1025532739 >> 172.21.15.6:0/1025532739 conn(0x7fe8dc100aa0 msgr2=0x7fe8dc102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:06.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 -- 172.21.15.6:0/1025532739 shutdown_connections 2023-09-13T09:31:06.502 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 -- 172.21.15.6:0/1025532739 wait complete. 2023-09-13T09:31:06.503 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 Processor -- start 2023-09-13T09:31:06.503 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 -- start start 2023-09-13T09:31:06.503 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:06.503 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.651+0000 7fe8e2f14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8dc19a5f0 con 0x7fe8dc105480 2023-09-13T09:31:06.503 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8e0cb0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8e0cb0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59062/0 (socket says 172.21.15.6:59062) 2023-09-13T09:31:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8e0cb0700 1 -- 172.21.15.6:0/729221210 learned_addr learned my addr 172.21.15.6:0/729221210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8e0cb0700 1 -- 172.21.15.6:0/729221210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8d0009550 con 0x7fe8dc105480 2023-09-13T09:31:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8e0cb0700 1 --2- 172.21.15.6:0/729221210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc074170 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004000 tx=0x7fe8d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8d9ffb700 1 -- 172.21.15.6:0/729221210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0011630 con 0x7fe8dc105480 2023-09-13T09:31:06.504 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8d9ffb700 1 -- 172.21.15.6:0/729221210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8d0011790 con 0x7fe8dc105480 2023-09-13T09:31:06.505 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8dc19ec00 con 0x7fe8dc105480 2023-09-13T09:31:06.505 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8d9ffb700 1 -- 172.21.15.6:0/729221210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe8d0011a30 con 0x7fe8dc105480 2023-09-13T09:31:06.505 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.652+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8dc19ef60 con 0x7fe8dc105480 2023-09-13T09:31:06.505 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.653+0000 7fe8d9ffb700 1 -- 172.21.15.6:0/729221210 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe8d0022070 con 0x7fe8dc105480 2023-09-13T09:31:06.505 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.653+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8dc192260 con 0x7fe8dc105480 2023-09-13T09:31:06.506 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.654+0000 7fe8d9ffb700 1 -- 172.21.15.6:0/729221210 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe8d001c450 con 0x7fe8dc105480 2023-09-13T09:31:06.506 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.656+0000 7fe8d9ffb700 1 -- 172.21.15.6:0/729221210 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe8d001b450 con 0x7fe8dc105480 2023-09-13T09:31:06.506 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.789+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fe8dc1069f0 con 0x7fe8dc105480 2023-09-13T09:31:06.506 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.789+0000 7fe8d9ffb700 1 -- 172.21.15.6:0/729221210 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fe8d001b5f0 con 0x7fe8dc105480 2023-09-13T09:31:06.506 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.790+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 msgr2=0x7fe8dc074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:06.507 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.790+0000 7fe8e2f14700 1 --2- 172.21.15.6:0/729221210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc074170 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fe8d0004000 tx=0x7fe8d0004750 comp rx=0 tx=0).stop 2023-09-13T09:31:06.507 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.790+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 shutdown_connections 2023-09-13T09:31:06.507 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.790+0000 7fe8e2f14700 1 --2- 172.21.15.6:0/729221210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8dc105480 0x7fe8dc074170 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:06.507 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.790+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 >> 172.21.15.6:0/729221210 conn(0x7fe8dc100aa0 msgr2=0x7fe8dc18ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:06.507 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.790+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 shutdown_connections 2023-09-13T09:31:06.508 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:04.790+0000 7fe8e2f14700 1 -- 172.21.15.6:0/729221210 wait complete. 2023-09-13T09:31:06.508 INFO:teuthology.orchestra.run.smithi006.stdout:mon is available 2023-09-13T09:31:06.508 INFO:teuthology.orchestra.run.smithi006.stdout:Assimilating anything we can from ceph.conf... 2023-09-13T09:31:08.755 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2023-09-13T09:31:08.756 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2023-09-13T09:31:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-09-13T09:31:08.757 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-09-13T09:31:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-09-13T09:31:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-09-13T09:31:08.758 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2023-09-13T09:31:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-09-13T09:31:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:08.759 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2023-09-13T09:31:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-09-13T09:31:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-09-13T09:31:08.760 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-09-13T09:31:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-09-13T09:31:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-09-13T09:31:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.197+0000 7f69f5bf2700 1 Processor -- start 2023-09-13T09:31:08.761 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.197+0000 7f69f5bf2700 1 -- start start 2023-09-13T09:31:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.197+0000 7f69f5bf2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f01069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.197+0000 7f69f5bf2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0106f70 con 0x7f69f0106580 2023-09-13T09:31:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.197+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f01069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.197+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f01069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59064/0 (socket says 172.21.15.6:59064) 2023-09-13T09:31:08.762 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.197+0000 7f69ef7fe700 1 -- 172.21.15.6:0/862384540 learned_addr learned my addr 172.21.15.6:0/862384540 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.198+0000 7f69ef7fe700 1 -- 172.21.15.6:0/862384540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f0107780 con 0x7f69f0106580 2023-09-13T09:31:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.198+0000 7f69ef7fe700 1 --2- 172.21.15.6:0/862384540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f01069a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f69e00098a0 tx=0x7f69e0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2930dd69e9a2bfd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.198+0000 7f69ee7fc700 1 -- 172.21.15.6:0/862384540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69e0004160 con 0x7f69f0106580 2023-09-13T09:31:08.763 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.198+0000 7f69ee7fc700 1 -- 172.21.15.6:0/862384540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e00042c0 con 0x7f69f0106580 2023-09-13T09:31:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.198+0000 7f69ee7fc700 1 -- 172.21.15.6:0/862384540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69e00045a0 con 0x7f69f0106580 2023-09-13T09:31:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 -- 172.21.15.6:0/862384540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 msgr2=0x7f69f01069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 --2- 172.21.15.6:0/862384540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f01069a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f69e00098a0 tx=0x7f69e0009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 -- 172.21.15.6:0/862384540 shutdown_connections 2023-09-13T09:31:08.764 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 --2- 172.21.15.6:0/862384540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f01069a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 -- 172.21.15.6:0/862384540 >> 172.21.15.6:0/862384540 conn(0x7f69f0101ba0 msgr2=0x7f69f0103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 -- 172.21.15.6:0/862384540 shutdown_connections 2023-09-13T09:31:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 -- 172.21.15.6:0/862384540 wait complete. 2023-09-13T09:31:08.765 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.199+0000 7f69f5bf2700 1 Processor -- start 2023-09-13T09:31:08.766 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69f5bf2700 1 -- start start 2023-09-13T09:31:08.766 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69f5bf2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f007ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:08.766 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69f5bf2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f007b070 con 0x7f69f0106580 2023-09-13T09:31:08.766 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f007ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:08.767 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f007ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59066/0 (socket says 172.21.15.6:59066) 2023-09-13T09:31:08.767 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ef7fe700 1 -- 172.21.15.6:0/1645318060 learned_addr learned my addr 172.21.15.6:0/1645318060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:08.767 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ef7fe700 1 -- 172.21.15.6:0/1645318060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e0009550 con 0x7f69f0106580 2023-09-13T09:31:08.767 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ef7fe700 1 --2- 172.21.15.6:0/1645318060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f007ab30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f69e0004000 tx=0x7f69e0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:08.768 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69e0011630 con 0x7f69f0106580 2023-09-13T09:31:08.768 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e0011790 con 0x7f69f0106580 2023-09-13T09:31:08.768 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f69e0011a30 con 0x7f69f0106580 2023-09-13T09:31:08.768 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.200+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f0079180 con 0x7f69f0106580 2023-09-13T09:31:08.768 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.201+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f00795a0 con 0x7f69f0106580 2023-09-13T09:31:08.769 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.201+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f69e0022070 con 0x7f69f0106580 2023-09-13T09:31:08.769 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.201+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f69e001c450 con 0x7f69f0106580 2023-09-13T09:31:08.769 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.202+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f0079fb0 con 0x7f69f0106580 2023-09-13T09:31:08.769 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.204+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f69e001b450 con 0x7f69f0106580 2023-09-13T09:31:08.769 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.330+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f69f0107af0 con 0x7f69f0106580 2023-09-13T09:31:08.770 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.334+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69e001b5f0 con 0x7f69f0106580 2023-09-13T09:31:08.770 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.334+0000 7f69ecff9700 1 -- 172.21.15.6:0/1645318060 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f69e0024630 con 0x7f69f0106580 2023-09-13T09:31:08.770 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.335+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 msgr2=0x7f69f007ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:08.770 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.335+0000 7f69f5bf2700 1 --2- 172.21.15.6:0/1645318060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f007ab30 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f69e0004000 tx=0x7f69e0004750 comp rx=0 tx=0).stop 2023-09-13T09:31:08.771 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.336+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 shutdown_connections 2023-09-13T09:31:08.771 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.336+0000 7f69f5bf2700 1 --2- 172.21.15.6:0/1645318060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69f0106580 0x7f69f007ab30 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:08.771 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.336+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 >> 172.21.15.6:0/1645318060 conn(0x7f69f0101ba0 msgr2=0x7f69f018df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:08.771 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.336+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 shutdown_connections 2023-09-13T09:31:08.772 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:08.336+0000 7f69f5bf2700 1 -- 172.21.15.6:0/1645318060 wait complete. 2023-09-13T09:31:08.772 INFO:teuthology.orchestra.run.smithi006.stdout:Generating new minimal ceph.conf... 2023-09-13T09:31:08.772 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:08 smithi006 ceph-mon[98153]: from='client.? 172.21.15.6:0/1645318060' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-09-13T09:31:08.772 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:08 smithi006 ceph-mon[98153]: from='client.? 172.21.15.6:0/1645318060' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-09-13T09:31:09.699 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.222+0000 7f8736bb8700 1 Processor -- start 2023-09-13T09:31:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.222+0000 7f8736bb8700 1 -- start start 2023-09-13T09:31:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.222+0000 7f8736bb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f8730105da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.222+0000 7f8736bb8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8730106370 con 0x7f8730105980 2023-09-13T09:31:09.700 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f8734954700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f8730105da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f8734954700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f8730105da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59068/0 (socket says 172.21.15.6:59068) 2023-09-13T09:31:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f8734954700 1 -- 172.21.15.6:0/578730063 learned_addr learned my addr 172.21.15.6:0/578730063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f8734954700 1 -- 172.21.15.6:0/578730063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87301066a0 con 0x7f8730105980 2023-09-13T09:31:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f8734954700 1 --2- 172.21.15.6:0/578730063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f8730105da0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f872400bb40 tx=0x7f872400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6f7e0b7bbcbcce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:09.701 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f872f7fe700 1 -- 172.21.15.6:0/578730063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f872400dbe0 con 0x7f8730105980 2023-09-13T09:31:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f872f7fe700 1 -- 172.21.15.6:0/578730063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87240044d0 con 0x7f8730105980 2023-09-13T09:31:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.223+0000 7f872f7fe700 1 -- 172.21.15.6:0/578730063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8724010470 con 0x7f8730105980 2023-09-13T09:31:09.702 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.224+0000 7f8736bb8700 1 -- 172.21.15.6:0/578730063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 msgr2=0x7f8730105da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.224+0000 7f8736bb8700 1 --2- 172.21.15.6:0/578730063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f8730105da0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f872400bb40 tx=0x7f872400be50 comp rx=0 tx=0).stop 2023-09-13T09:31:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.224+0000 7f8736bb8700 1 -- 172.21.15.6:0/578730063 shutdown_connections 2023-09-13T09:31:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.224+0000 7f8736bb8700 1 --2- 172.21.15.6:0/578730063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f8730105da0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:09.703 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.224+0000 7f8736bb8700 1 -- 172.21.15.6:0/578730063 >> 172.21.15.6:0/578730063 conn(0x7f87301001e0 msgr2=0x7f8730102600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.224+0000 7f8736bb8700 1 -- 172.21.15.6:0/578730063 shutdown_connections 2023-09-13T09:31:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.224+0000 7f8736bb8700 1 -- 172.21.15.6:0/578730063 wait complete. 2023-09-13T09:31:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.225+0000 7f8736bb8700 1 Processor -- start 2023-09-13T09:31:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.225+0000 7f8736bb8700 1 -- start start 2023-09-13T09:31:09.704 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.225+0000 7f8736bb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f873019c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.225+0000 7f8736bb8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873019c940 con 0x7f8730105980 2023-09-13T09:31:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.225+0000 7f8734954700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f873019c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.225+0000 7f8734954700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f873019c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59070/0 (socket says 172.21.15.6:59070) 2023-09-13T09:31:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.225+0000 7f8734954700 1 -- 172.21.15.6:0/3034693597 learned_addr learned my addr 172.21.15.6:0/3034693597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:09.705 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f8734954700 1 -- 172.21.15.6:0/3034693597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872400b7f0 con 0x7f8730105980 2023-09-13T09:31:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f8734954700 1 --2- 172.21.15.6:0/3034693597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f873019c400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f872400b340 tx=0x7f8724003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f872dffb700 1 -- 172.21.15.6:0/3034693597 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8724004340 con 0x7f8730105980 2023-09-13T09:31:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f872dffb700 1 -- 172.21.15.6:0/3034693597 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8724010bd0 con 0x7f8730105980 2023-09-13T09:31:09.706 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f873019cb40 con 0x7f8730105980 2023-09-13T09:31:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f872dffb700 1 -- 172.21.15.6:0/3034693597 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8724021c60 con 0x7f8730105980 2023-09-13T09:31:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f873019cf00 con 0x7f8730105980 2023-09-13T09:31:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f872dffb700 1 -- 172.21.15.6:0/3034693597 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f872402a6f0 con 0x7f8730105980 2023-09-13T09:31:09.707 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.226+0000 7f872dffb700 1 -- 172.21.15.6:0/3034693597 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f87240198a0 con 0x7f8730105980 2023-09-13T09:31:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.227+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8730191d30 con 0x7f8730105980 2023-09-13T09:31:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.230+0000 7f872dffb700 1 -- 172.21.15.6:0/3034693597 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f872402f060 con 0x7f8730105980 2023-09-13T09:31:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.357+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f87300622e0 con 0x7f8730105980 2023-09-13T09:31:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.358+0000 7f872dffb700 1 -- 172.21.15.6:0/3034693597 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f87240193f0 con 0x7f8730105980 2023-09-13T09:31:09.708 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.359+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 msgr2=0x7f873019c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.359+0000 7f8736bb8700 1 --2- 172.21.15.6:0/3034693597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f873019c400 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f872400b340 tx=0x7f8724003df0 comp rx=0 tx=0).stop 2023-09-13T09:31:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.359+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 shutdown_connections 2023-09-13T09:31:09.709 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.359+0000 7f8736bb8700 1 --2- 172.21.15.6:0/3034693597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8730105980 0x7f873019c400 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.359+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 >> 172.21.15.6:0/3034693597 conn(0x7f87301001e0 msgr2=0x7f873018ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.359+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 shutdown_connections 2023-09-13T09:31:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:09.359+0000 7f8736bb8700 1 -- 172.21.15.6:0/3034693597 wait complete. 2023-09-13T09:31:09.710 INFO:teuthology.orchestra.run.smithi006.stdout:Restarting the monitor... 2023-09-13T09:31:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:09 smithi006 systemd[1]: Stopping Ceph mon.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:31:10.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:10 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a[98128]: 2023-09-13T09:31:10.044+0000 7f5f7a3b7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T09:31:10.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:10 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a[98128]: 2023-09-13T09:31:10.044+0000 7f5f7a3b7700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-09-13T09:31:10.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:10 smithi006 bash[98488]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a 2023-09-13T09:31:11.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:10 smithi006 systemd[1]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a.service: Succeeded. 2023-09-13T09:31:11.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:10 smithi006 systemd[1]: Stopped Ceph mon.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:31:11.076 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:10 smithi006 systemd[1]: Starting Ceph mon.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:31:11.265 INFO:teuthology.orchestra.run.smithi006.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-09-13T09:31:11.348 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 podman[98625]: 2023-09-13T09:31:11.348 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 bash[98625]: 94ca336ee0b8d3ae8675f044e60f8858c49466bf21edf79f1529ae8eee5fee8c 2023-09-13T09:31:11.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: set uid:gid to 167:167 (ceph:ceph) 2023-09-13T09:31:11.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev), process ceph-mon, pid 7 2023-09-13T09:31:11.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: pidfile_write: ignore empty --pid-file 2023-09-13T09:31:11.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: load: jerasure load: lrc 2023-09-13T09:31:11.349 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: RocksDB version: 7.9.2 2023-09-13T09:31:11.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Git sha 0 2023-09-13T09:31:11.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Compile date 2023-09-12 08:33:53 2023-09-13T09:31:11.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: DB SUMMARY 2023-09-13T09:31:11.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: DB Session ID: ZGH197AADB3SJ2NOAML4 2023-09-13T09:31:11.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: CURRENT file: CURRENT 2023-09-13T09:31:11.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: IDENTITY file: IDENTITY 2023-09-13T09:31:11.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-09-13T09:31:11.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-09-13T09:31:11.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 98234 ; 2023-09-13T09:31:11.351 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.error_if_exists: 0 2023-09-13T09:31:11.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.create_if_missing: 0 2023-09-13T09:31:11.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.paranoid_checks: 1 2023-09-13T09:31:11.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-13T09:31:11.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-13T09:31:11.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-13T09:31:11.352 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.env: 0x5574b9f51da0 2023-09-13T09:31:11.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.fs: PosixFileSystem 2023-09-13T09:31:11.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.info_log: 0x5574bb2e74a0 2023-09-13T09:31:11.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_file_opening_threads: 16 2023-09-13T09:31:11.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.statistics: (nil) 2023-09-13T09:31:11.353 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.use_fsync: 0 2023-09-13T09:31:11.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_log_file_size: 0 2023-09-13T09:31:11.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-13T09:31:11.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-13T09:31:11.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.keep_log_file_num: 1000 2023-09-13T09:31:11.354 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.recycle_log_file_num: 0 2023-09-13T09:31:11.355 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.allow_fallocate: 1 2023-09-13T09:31:11.355 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.allow_mmap_reads: 0 2023-09-13T09:31:11.355 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.allow_mmap_writes: 0 2023-09-13T09:31:11.355 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.use_direct_reads: 0 2023-09-13T09:31:11.355 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-13T09:31:11.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.create_missing_column_families: 0 2023-09-13T09:31:11.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.db_log_dir: 2023-09-13T09:31:11.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.wal_dir: 2023-09-13T09:31:11.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-13T09:31:11.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-13T09:31:11.356 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-13T09:31:11.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-13T09:31:11.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-13T09:31:11.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-13T09:31:11.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.advise_random_on_open: 1 2023-09-13T09:31:11.357 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.db_write_buffer_size: 0 2023-09-13T09:31:11.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.write_buffer_manager: 0x5574bb2a14a0 2023-09-13T09:31:11.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-13T09:31:11.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-13T09:31:11.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-13T09:31:11.358 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.rate_limiter: (nil) 2023-09-13T09:31:11.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-13T09:31:11.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.wal_recovery_mode: 2 2023-09-13T09:31:11.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.enable_thread_tracking: 0 2023-09-13T09:31:11.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.enable_pipelined_write: 0 2023-09-13T09:31:11.359 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.unordered_write: 0 2023-09-13T09:31:11.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-13T09:31:11.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-13T09:31:11.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-13T09:31:11.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-13T09:31:11.360 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.row_cache: None 2023-09-13T09:31:11.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.wal_filter: None 2023-09-13T09:31:11.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-13T09:31:11.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.allow_ingest_behind: 0 2023-09-13T09:31:11.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.two_write_queues: 0 2023-09-13T09:31:11.361 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.manual_wal_flush: 0 2023-09-13T09:31:11.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.wal_compression: 0 2023-09-13T09:31:11.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.atomic_flush: 0 2023-09-13T09:31:11.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-13T09:31:11.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-13T09:31:11.362 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-13T09:31:11.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.log_readahead_size: 0 2023-09-13T09:31:11.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-13T09:31:11.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.best_efforts_recovery: 0 2023-09-13T09:31:11.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-13T09:31:11.363 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-13T09:31:11.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.allow_data_in_errors: 0 2023-09-13T09:31:11.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.db_host_id: __hostname__ 2023-09-13T09:31:11.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-13T09:31:11.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_background_jobs: 2 2023-09-13T09:31:11.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_background_compactions: -1 2023-09-13T09:31:11.364 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_subcompactions: 1 2023-09-13T09:31:11.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-13T09:31:11.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-13T09:31:11.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-13T09:31:11.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_total_wal_size: 0 2023-09-13T09:31:11.365 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-13T09:31:11.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-13T09:31:11.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-13T09:31:11.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-13T09:31:11.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_open_files: -1 2023-09-13T09:31:11.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bytes_per_sync: 0 2023-09-13T09:31:11.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-13T09:31:11.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-13T09:31:11.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_readahead_size: 0 2023-09-13T09:31:11.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_background_flushes: -1 2023-09-13T09:31:11.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Compression algorithms supported: 2023-09-13T09:31:11.367 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-13T09:31:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kZSTD supported: 0 2023-09-13T09:31:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kXpressCompression supported: 0 2023-09-13T09:31:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kLZ4HCCompression supported: 1 2023-09-13T09:31:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kZlibCompression supported: 1 2023-09-13T09:31:11.368 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kSnappyCompression supported: 1 2023-09-13T09:31:11.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kLZ4Compression supported: 1 2023-09-13T09:31:11.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: kBZip2Compression supported: 0 2023-09-13T09:31:11.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-13T09:31:11.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-13T09:31:11.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-09-13T09:31:11.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-13T09:31:11.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-13T09:31:11.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.merge_operator: 2023-09-13T09:31:11.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_filter: None 2023-09-13T09:31:11.370 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_filter_factory: None 2023-09-13T09:31:11.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.sst_partitioner_factory: None 2023-09-13T09:31:11.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-13T09:31:11.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-13T09:31:11.371 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5574bb2e75a0) 2023-09-13T09:31:11.372 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks: 1 2023-09-13T09:31:11.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-13T09:31:11.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-13T09:31:11.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: pin_top_level_index_and_filter: 1 2023-09-13T09:31:11.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_type: 0 2023-09-13T09:31:11.373 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_index_type: 0 2023-09-13T09:31:11.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_shortening: 1 2023-09-13T09:31:11.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-13T09:31:11.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: checksum: 4 2023-09-13T09:31:11.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: no_block_cache: 0 2023-09-13T09:31:11.374 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache: 0x5574bb33f1f0 2023-09-13T09:31:11.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_name: BinnedLRUCache 2023-09-13T09:31:11.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_options: 2023-09-13T09:31:11.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: capacity : 536870912 2023-09-13T09:31:11.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_shard_bits : 4 2023-09-13T09:31:11.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: strict_capacity_limit : 0 2023-09-13T09:31:11.375 INFO:journalctl@ceph.mon.a.smithi006.stdout: high_pri_pool_ratio: 0.000 2023-09-13T09:31:11.376 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_cache_compressed: (nil) 2023-09-13T09:31:11.376 INFO:journalctl@ceph.mon.a.smithi006.stdout: persistent_cache: (nil) 2023-09-13T09:31:11.376 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size: 4096 2023-09-13T09:31:11.376 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_size_deviation: 10 2023-09-13T09:31:11.376 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_restart_interval: 16 2023-09-13T09:31:11.376 INFO:journalctl@ceph.mon.a.smithi006.stdout: index_block_restart_interval: 1 2023-09-13T09:31:11.377 INFO:journalctl@ceph.mon.a.smithi006.stdout: metadata_block_size: 4096 2023-09-13T09:31:11.377 INFO:journalctl@ceph.mon.a.smithi006.stdout: partition_filters: 0 2023-09-13T09:31:11.377 INFO:journalctl@ceph.mon.a.smithi006.stdout: use_delta_encoding: 1 2023-09-13T09:31:11.377 INFO:journalctl@ceph.mon.a.smithi006.stdout: filter_policy: bloomfilter 2023-09-13T09:31:11.377 INFO:journalctl@ceph.mon.a.smithi006.stdout: whole_key_filtering: 1 2023-09-13T09:31:11.378 INFO:journalctl@ceph.mon.a.smithi006.stdout: verify_compression: 0 2023-09-13T09:31:11.378 INFO:journalctl@ceph.mon.a.smithi006.stdout: read_amp_bytes_per_bit: 0 2023-09-13T09:31:11.378 INFO:journalctl@ceph.mon.a.smithi006.stdout: format_version: 5 2023-09-13T09:31:11.378 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_index_compression: 1 2023-09-13T09:31:11.378 INFO:journalctl@ceph.mon.a.smithi006.stdout: block_align: 0 2023-09-13T09:31:11.379 INFO:journalctl@ceph.mon.a.smithi006.stdout: max_auto_readahead_size: 262144 2023-09-13T09:31:11.379 INFO:journalctl@ceph.mon.a.smithi006.stdout: prepopulate_block_cache: 0 2023-09-13T09:31:11.379 INFO:journalctl@ceph.mon.a.smithi006.stdout: initial_auto_readahead_size: 8192 2023-09-13T09:31:11.380 INFO:journalctl@ceph.mon.a.smithi006.stdout: num_file_reads_for_auto_readahead: 2 2023-09-13T09:31:11.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.write_buffer_size: 33554432 2023-09-13T09:31:11.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_write_buffer_number: 2 2023-09-13T09:31:11.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression: NoCompression 2023-09-13T09:31:11.380 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression: Disabled 2023-09-13T09:31:11.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.prefix_extractor: nullptr 2023-09-13T09:31:11.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-13T09:31:11.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.num_levels: 7 2023-09-13T09:31:11.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-13T09:31:11.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-13T09:31:11.381 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-13T09:31:11.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-13T09:31:11.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-13T09:31:11.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-13T09:31:11.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-13T09:31:11.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-13T09:31:11.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-13T09:31:11.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-13T09:31:11.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-13T09:31:11.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-13T09:31:11.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-13T09:31:11.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.level: 32767 2023-09-13T09:31:11.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.strategy: 0 2023-09-13T09:31:11.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-13T09:31:11.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-13T09:31:11.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-13T09:31:11.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-13T09:31:11.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.enabled: false 2023-09-13T09:31:11.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-13T09:31:11.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-13T09:31:11.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-13T09:31:11.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-13T09:31:11.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.target_file_size_base: 67108864 2023-09-13T09:31:11.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-13T09:31:11.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-13T09:31:11.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-13T09:31:11.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-13T09:31:11.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-13T09:31:11.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-13T09:31:11.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-13T09:31:11.387 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-13T09:31:11.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-13T09:31:11.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-13T09:31:11.388 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-13T09:31:11.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-13T09:31:11.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-13T09:31:11.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-13T09:31:11.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.arena_block_size: 1048576 2023-09-13T09:31:11.389 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-13T09:31:11.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-13T09:31:11.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.disable_auto_compactions: 0 2023-09-13T09:31:11.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-13T09:31:11.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-13T09:31:11.390 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-13T09:31:11.391 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-13T09:31:11.391 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-13T09:31:11.391 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-13T09:31:11.391 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-13T09:31:11.391 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-13T09:31:11.391 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-13T09:31:11.392 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-13T09:31:11.392 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.table_properties_collectors: 2023-09-13T09:31:11.392 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.inplace_update_support: 0 2023-09-13T09:31:11.392 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-13T09:31:11.392 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-13T09:31:11.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-13T09:31:11.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-13T09:31:11.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.bloom_locality: 0 2023-09-13T09:31:11.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.max_successive_merges: 0 2023-09-13T09:31:11.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-13T09:31:11.393 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.paranoid_file_checks: 0 2023-09-13T09:31:11.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.force_consistency_checks: 1 2023-09-13T09:31:11.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.report_bg_io_stats: 0 2023-09-13T09:31:11.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.ttl: 2592000 2023-09-13T09:31:11.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-13T09:31:11.394 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-13T09:31:11.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-13T09:31:11.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.enable_blob_files: false 2023-09-13T09:31:11.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.min_blob_size: 0 2023-09-13T09:31:11.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.blob_file_size: 268435456 2023-09-13T09:31:11.395 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-13T09:31:11.396 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-13T09:31:11.396 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-13T09:31:11.396 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-13T09:31:11.396 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-13T09:31:11.396 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.blob_file_starting_level: 0 2023-09-13T09:31:11.397 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-13T09:31:11.397 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-09-13T09:31:11.397 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-09-13T09:31:11.397 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6fc499fa-45a1-46ff-80bf-241b01dd7f04 2023-09-13T09:31:11.397 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597471258436, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-09-13T09:31:11.397 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-09-13T09:31:11.398 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597471259499, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93374, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 318, "table_properties": {"data_size": 91372, "index_size": 284, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13706, "raw_average_key_size": 50, "raw_value_size": 83895, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_filter_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1694597471, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6fc499fa-45a1-46ff-80bf-241b01dd7f04", "db_session_id": "ZGH197AADB3SJ2NOAML4", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-09-13T09:31:11.398 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597471259570, "job": 1, "event": "recovery_finished"} 2023-09-13T09:31:11.398 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-09-13T09:31:11.398 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 systemd[1]: Started Ceph mon.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:31:11.399 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-13T09:31:11.399 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5574bb3dc000 2023-09-13T09:31:11.399 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: DB pointer 0x5574bb3c8000 2023-09-13T09:31:11.399 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-13T09:31:11.399 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-13T09:31:11.399 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** DB Stats ** 2023-09-13T09:31:11.400 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-13T09:31:11.400 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-13T09:31:11.400 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-13T09:31:11.400 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-13T09:31:11.401 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-13T09:31:11.401 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-13T09:31:11.401 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-13T09:31:11.401 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-09-13T09:31:11.401 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2023-09-13T09:31:11.402 INFO:journalctl@ceph.mon.a.smithi006.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-13T09:31:11.402 INFO:journalctl@ceph.mon.a.smithi006.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-13T09:31:11.402 INFO:journalctl@ceph.mon.a.smithi006.stdout: L0 2/0 93.02 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:31:11.402 INFO:journalctl@ceph.mon.a.smithi006.stdout: Sum 2/0 93.02 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:31:11.402 INFO:journalctl@ceph.mon.a.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 131.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:31:11.403 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-09-13T09:31:11.403 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** Compaction Stats [default] ** 2023-09-13T09:31:11.403 INFO:journalctl@ceph.mon.a.smithi006.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-13T09:31:11.403 INFO:journalctl@ceph.mon.a.smithi006.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-13T09:31:11.403 INFO:journalctl@ceph.mon.a.smithi006.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 131.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:31:11.403 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-09-13T09:31:11.404 INFO:journalctl@ceph.mon.a.smithi006.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-13T09:31:11.404 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-09-13T09:31:11.404 INFO:journalctl@ceph.mon.a.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-13T09:31:11.404 INFO:journalctl@ceph.mon.a.smithi006.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-13T09:31:11.404 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-13T09:31:11.405 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-13T09:31:11.405 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-13T09:31:11.405 INFO:journalctl@ceph.mon.a.smithi006.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-13T09:31:11.405 INFO:journalctl@ceph.mon.a.smithi006.stdout: Cumulative compaction: 0.00 GB write, 14.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-13T09:31:11.405 INFO:journalctl@ceph.mon.a.smithi006.stdout: Interval compaction: 0.00 GB write, 14.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-13T09:31:11.405 INFO:journalctl@ceph.mon.a.smithi006.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-13T09:31:11.406 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache BinnedLRUCache@0x5574bb33f1f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-09-13T09:31:11.406 INFO:journalctl@ceph.mon.a.smithi006.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-09-13T09:31:11.406 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-09-13T09:31:11.406 INFO:journalctl@ceph.mon.a.smithi006.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-13T09:31:11.406 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: starting mon.a rank 0 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:11.407 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???) e1 preinit fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:11.407 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???).mds e1 new map 2023-09-13T09:31:11.407 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???).mds e1 print_map 2023-09-13T09:31:11.407 INFO:journalctl@ceph.mon.a.smithi006.stdout: e1 2023-09-13T09:31:11.407 INFO:journalctl@ceph.mon.a.smithi006.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-13T09:31:11.408 INFO:journalctl@ceph.mon.a.smithi006.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-13T09:31:11.408 INFO:journalctl@ceph.mon.a.smithi006.stdout: legacy client fscid: -1 2023-09-13T09:31:11.408 INFO:journalctl@ceph.mon.a.smithi006.stdout: 2023-09-13T09:31:11.408 INFO:journalctl@ceph.mon.a.smithi006.stdout: No filesystems configured 2023-09-13T09:31:11.408 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-13T09:31:11.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:31:11.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:31:11.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:31:11.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-09-13T09:31:11.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expand map: {default=false} 2023-09-13T09:31:11.410 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta from 'false' to 'false' 2023-09-13T09:31:11.410 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expanded map: {default=false} 2023-09-13T09:31:11.410 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expand map: {default=info} 2023-09-13T09:31:11.410 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta from 'info' to 'info' 2023-09-13T09:31:11.410 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expanded map: {default=info} 2023-09-13T09:31:11.411 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expand map: {default=daemon} 2023-09-13T09:31:11.411 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta from 'daemon' to 'daemon' 2023-09-13T09:31:11.411 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expanded map: {default=daemon} 2023-09-13T09:31:11.411 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expand map: {default=debug} 2023-09-13T09:31:11.411 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta from 'debug' to 'debug' 2023-09-13T09:31:11.411 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: expand_channel_meta expanded map: {default=debug} 2023-09-13T09:31:11.412 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mon.a is new leader, mons a in quorum (ranks 0) 2023-09-13T09:31:11.412 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: monmap e1: 1 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0]} removed_ranks: {} 2023-09-13T09:31:11.412 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: fsmap 2023-09-13T09:31:11.412 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: osdmap e1: 0 total, 0 up, 0 in 2023-09-13T09:31:11.412 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:11 smithi006 ceph-mon[98665]: mgrmap e1: no daemons active 2023-09-13T09:31:12.314 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.807+0000 7f0cda842700 1 Processor -- start 2023-09-13T09:31:12.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.807+0000 7f0cda842700 1 -- start start 2023-09-13T09:31:12.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.807+0000 7f0cda842700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4106e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:12.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.807+0000 7f0cda842700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4107440 con 0x7f0cd4106a50 2023-09-13T09:31:12.315 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:12.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4106e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59072/0 (socket says 172.21.15.6:59072) 2023-09-13T09:31:12.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd3fff700 1 -- 172.21.15.6:0/3693365685 learned_addr learned my addr 172.21.15.6:0/3693365685 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:12.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd3fff700 1 -- 172.21.15.6:0/3693365685 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cd41056b0 con 0x7f0cd4106a50 2023-09-13T09:31:12.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd3fff700 1 --2- 172.21.15.6:0/3693365685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4106e70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40098a0 tx=0x7f0cc4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3886f705676cba6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:12.316 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd2ffd700 1 -- 172.21.15.6:0/3693365685 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc4004160 con 0x7f0cd4106a50 2023-09-13T09:31:12.320 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd2ffd700 1 -- 172.21.15.6:0/3693365685 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cc40042c0 con 0x7f0cd4106a50 2023-09-13T09:31:12.320 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.808+0000 7f0cd2ffd700 1 -- 172.21.15.6:0/3693365685 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc4011a00 con 0x7f0cd4106a50 2023-09-13T09:31:12.320 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.809+0000 7f0cda842700 1 -- 172.21.15.6:0/3693365685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 msgr2=0x7f0cd4106e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:12.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.809+0000 7f0cda842700 1 --2- 172.21.15.6:0/3693365685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4106e70 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f0cc40098a0 tx=0x7f0cc4009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:12.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.809+0000 7f0cda842700 1 -- 172.21.15.6:0/3693365685 shutdown_connections 2023-09-13T09:31:12.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.809+0000 7f0cda842700 1 --2- 172.21.15.6:0/3693365685 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4106e70 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:12.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.809+0000 7f0cda842700 1 -- 172.21.15.6:0/3693365685 >> 172.21.15.6:0/3693365685 conn(0x7f0cd41001e0 msgr2=0x7f0cd4102600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:12.321 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.809+0000 7f0cda842700 1 -- 172.21.15.6:0/3693365685 shutdown_connections 2023-09-13T09:31:12.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.809+0000 7f0cda842700 1 -- 172.21.15.6:0/3693365685 wait complete. 2023-09-13T09:31:12.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.810+0000 7f0cda842700 1 Processor -- start 2023-09-13T09:31:12.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.810+0000 7f0cda842700 1 -- start start 2023-09-13T09:31:12.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.810+0000 7f0cda842700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4190690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:12.322 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.810+0000 7f0cda842700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cd4190bd0 con 0x7f0cd4106a50 2023-09-13T09:31:12.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.810+0000 7f0cd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4190690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:12.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.810+0000 7f0cd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4190690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59074/0 (socket says 172.21.15.6:59074) 2023-09-13T09:31:12.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.810+0000 7f0cd3fff700 1 -- 172.21.15.6:0/711334058 learned_addr learned my addr 172.21.15.6:0/711334058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:12.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cd3fff700 1 -- 172.21.15.6:0/711334058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cc4009550 con 0x7f0cd4106a50 2023-09-13T09:31:12.323 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cd3fff700 1 --2- 172.21.15.6:0/711334058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4190690 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4006af0 tx=0x7f0cc4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:12.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cd17fa700 1 -- 172.21.15.6:0/711334058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc4003a40 con 0x7f0cd4106a50 2023-09-13T09:31:12.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cd17fa700 1 -- 172.21.15.6:0/711334058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0cc4003ba0 con 0x7f0cd4106a50 2023-09-13T09:31:12.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd418ece0 con 0x7f0cd4106a50 2023-09-13T09:31:12.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cd17fa700 1 -- 172.21.15.6:0/711334058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0cc401a700 con 0x7f0cd4106a50 2023-09-13T09:31:12.324 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cd418f100 con 0x7f0cd4106a50 2023-09-13T09:31:12.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cd17fa700 1 -- 172.21.15.6:0/711334058 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0cc401ac80 con 0x7f0cd4106a50 2023-09-13T09:31:12.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.811+0000 7f0cd17fa700 1 -- 172.21.15.6:0/711334058 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0cc4019700 con 0x7f0cd4106a50 2023-09-13T09:31:12.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.812+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cd40622e0 con 0x7f0cd4106a50 2023-09-13T09:31:12.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.815+0000 7f0cd17fa700 1 -- 172.21.15.6:0/711334058 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f0cc4024ad0 con 0x7f0cd4106a50 2023-09-13T09:31:12.325 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.940+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f0cd418f340 con 0x7f0cd4106a50 2023-09-13T09:31:12.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.942+0000 7f0cd17fa700 1 -- 172.21.15.6:0/711334058 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0cc4024c70 con 0x7f0cd4106a50 2023-09-13T09:31:12.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.943+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 msgr2=0x7f0cd4190690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:12.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.943+0000 7f0cda842700 1 --2- 172.21.15.6:0/711334058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4190690 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f0cc4006af0 tx=0x7f0cc4011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:12.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.943+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 shutdown_connections 2023-09-13T09:31:12.326 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.943+0000 7f0cda842700 1 --2- 172.21.15.6:0/711334058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0cd4106a50 0x7f0cd4190690 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:12.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.943+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 >> 172.21.15.6:0/711334058 conn(0x7f0cd41001e0 msgr2=0x7f0cd4104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:12.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.943+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 shutdown_connections 2023-09-13T09:31:12.327 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:11.943+0000 7f0cda842700 1 -- 172.21.15.6:0/711334058 wait complete. 2023-09-13T09:31:12.327 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote config to /etc/ceph/ceph.conf 2023-09-13T09:31:12.369 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-09-13T09:31:12.369 INFO:teuthology.orchestra.run.smithi006.stdout:Creating mgr... 2023-09-13T09:31:12.370 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:9283 ... 2023-09-13T09:31:12.371 INFO:teuthology.orchestra.run.smithi006.stdout:Verifying port 0.0.0.0:8765 ... 2023-09-13T09:31:12.560 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.x 2023-09-13T09:31:12.560 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Failed to reset failed state of unit ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.x.service: Unit ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.x.service not loaded. 2023-09-13T09:31:12.652 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.target.wants/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.x.service → /etc/systemd/system/ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@.service. 2023-09-13T09:31:12.943 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:12 smithi006 systemd[1]: Starting Ceph mgr.x for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:31:13.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:12 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/711334058' entity='client.admin' 2023-09-13T09:31:13.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:12 smithi006 podman[98894]: 2023-09-13T09:31:13.359 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-13T09:31:13.359 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-09-13T09:31:13.367 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-13T09:31:13.368 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-09-13T09:31:13.368 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-09-13T09:31:13.369 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to enable service . firewalld.service is not available 2023-09-13T09:31:13.376 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-13T09:31:13.377 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-09-13T09:31:13.385 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-13T09:31:13.386 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-09-13T09:31:13.386 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-09-13T09:31:13.386 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-09-13T09:31:13.386 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr to start... 2023-09-13T09:31:13.387 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr... 2023-09-13T09:31:13.609 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:13 smithi006 bash[98894]: 9a3a1ccdc2a7d45effe0ec81a8222da10b8d93c52fb51df30c8b96598bca06e8 2023-09-13T09:31:13.610 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:13 smithi006 systemd[1]: Started Ceph mgr.x for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:31:13.610 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:13.473+0000 7f79a6052200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T09:31:13.611 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:13.571+0000 7f79a6052200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T09:31:14.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:13.685+0000 7f79a6052200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T09:31:14.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:13.799+0000 7f79a6052200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T09:31:14.348 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:14.348 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:31:14.348 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:31:14.348 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-09-13T09:31:14.349 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-13T09:31:14.349 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-13T09:31:14.349 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-13T09:31:14.349 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:14.349 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-13T09:31:14.350 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-13T09:31:14.350 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-09-13T09:31:14.350 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:14.350 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-13T09:31:14.351 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-09-13T09:31:14.351 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:14.351 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-09-13T09:31:14.351 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-13T09:31:14.351 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:14.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-13T09:31:14.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-13T09:31:14.352 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:14.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-13T09:31:14.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:14.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-13T09:31:14.353 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-13T09:31:14.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-13T09:31:14.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-13T09:31:14.354 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-13T09:31:14.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-13T09:31:14.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:14.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-13T09:31:14.355 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-13T09:31:14.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-13T09:31:14.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-13T09:31:14.356 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-13T09:31:14.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-13T09:31:14.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-13T09:31:14.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-13T09:31:14.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-13T09:31:14.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:14.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-13T09:31:14.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:14.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-13T09:31:14.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-13T09:31:14.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:14.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-13T09:31:14.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-13T09:31:14.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-13T09:31:14.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-13T09:31:14.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-13T09:31:14.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-13T09:31:14.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-09-13T09:31:14.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:14.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:14.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:14.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-13T09:31:14.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:14.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-09-13T09:31:04.147590+0000", 2023-09-13T09:31:14.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:14.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:14.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-13T09:31:14.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:31:14.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.891+0000 7f59cb340700 1 Processor -- start 2023-09-13T09:31:14.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.891+0000 7f59cb340700 1 -- start start 2023-09-13T09:31:14.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.891+0000 7f59cb340700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c4105260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:14.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.891+0000 7f59cb340700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c4074490 con 0x7f59c4104e40 2023-09-13T09:31:14.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.891+0000 7f59c90dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c4105260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:14.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.892+0000 7f59c90dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c4105260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59080/0 (socket says 172.21.15.6:59080) 2023-09-13T09:31:14.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.892+0000 7f59c90dc700 1 -- 172.21.15.6:0/282360120 learned_addr learned my addr 172.21.15.6:0/282360120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:14.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.892+0000 7f59c90dc700 1 -- 172.21.15.6:0/282360120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c41057a0 con 0x7f59c4104e40 2023-09-13T09:31:14.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.892+0000 7f59c90dc700 1 --2- 172.21.15.6:0/282360120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c4105260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f59c00098a0 tx=0x7f59c0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd5013ee335ca46a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:14.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.892+0000 7f59bbfff700 1 -- 172.21.15.6:0/282360120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c0004160 con 0x7f59c4104e40 2023-09-13T09:31:14.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.892+0000 7f59bbfff700 1 -- 172.21.15.6:0/282360120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59c00042c0 con 0x7f59c4104e40 2023-09-13T09:31:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.892+0000 7f59bbfff700 1 -- 172.21.15.6:0/282360120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c0011a00 con 0x7f59c4104e40 2023-09-13T09:31:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.893+0000 7f59cb340700 1 -- 172.21.15.6:0/282360120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 msgr2=0x7f59c4105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.893+0000 7f59cb340700 1 --2- 172.21.15.6:0/282360120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c4105260 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f59c00098a0 tx=0x7f59c0009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.893+0000 7f59cb340700 1 -- 172.21.15.6:0/282360120 shutdown_connections 2023-09-13T09:31:14.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.893+0000 7f59cb340700 1 --2- 172.21.15.6:0/282360120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c4105260 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:14.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.893+0000 7f59cb340700 1 -- 172.21.15.6:0/282360120 >> 172.21.15.6:0/282360120 conn(0x7f59c4100aa0 msgr2=0x7f59c4102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:14.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.893+0000 7f59cb340700 1 -- 172.21.15.6:0/282360120 shutdown_connections 2023-09-13T09:31:14.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.893+0000 7f59cb340700 1 -- 172.21.15.6:0/282360120 wait complete. 2023-09-13T09:31:14.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.894+0000 7f59cb340700 1 Processor -- start 2023-09-13T09:31:14.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.894+0000 7f59cb340700 1 -- start start 2023-09-13T09:31:14.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.894+0000 7f59cb340700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c419c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:14.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.894+0000 7f59cb340700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59c419c970 con 0x7f59c4104e40 2023-09-13T09:31:14.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59c90dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c419c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:14.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59c90dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c419c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59082/0 (socket says 172.21.15.6:59082) 2023-09-13T09:31:14.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59c90dc700 1 -- 172.21.15.6:0/1962792148 learned_addr learned my addr 172.21.15.6:0/1962792148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:14.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59c90dc700 1 -- 172.21.15.6:0/1962792148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59c0009550 con 0x7f59c4104e40 2023-09-13T09:31:14.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59c90dc700 1 --2- 172.21.15.6:0/1962792148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c419c430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009fb0 tx=0x7f59c0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:14.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59ba7fc700 1 -- 172.21.15.6:0/1962792148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c0003930 con 0x7f59c4104e40 2023-09-13T09:31:14.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59ba7fc700 1 -- 172.21.15.6:0/1962792148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f59c0003a90 con 0x7f59c4104e40 2023-09-13T09:31:14.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59c419cb70 con 0x7f59c4104e40 2023-09-13T09:31:14.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59ba7fc700 1 -- 172.21.15.6:0/1962792148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59c0019610 con 0x7f59c4104e40 2023-09-13T09:31:14.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.895+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59c419cf90 con 0x7f59c4104e40 2023-09-13T09:31:14.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.896+0000 7f59ba7fc700 1 -- 172.21.15.6:0/1962792148 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f59c0019ba0 con 0x7f59c4104e40 2023-09-13T09:31:14.371 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.896+0000 7f59ba7fc700 1 -- 172.21.15.6:0/1962792148 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f59c00243f0 con 0x7f59c4104e40 2023-09-13T09:31:14.371 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.896+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59c4195d50 con 0x7f59c4104e40 2023-09-13T09:31:14.371 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:13.899+0000 7f59ba7fc700 1 -- 172.21.15.6:0/1962792148 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7f59c0003c00 con 0x7f59c4104e40 2023-09-13T09:31:14.372 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.033+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f59c4106610 con 0x7f59c4104e40 2023-09-13T09:31:14.372 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.033+0000 7f59ba7fc700 1 -- 172.21.15.6:0/1962792148 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f59c001a9d0 con 0x7f59c4104e40 2023-09-13T09:31:14.372 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.034+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 msgr2=0x7f59c419c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:14.372 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.034+0000 7f59cb340700 1 --2- 172.21.15.6:0/1962792148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c419c430 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009fb0 tx=0x7f59c0011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:14.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.035+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 shutdown_connections 2023-09-13T09:31:14.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.035+0000 7f59cb340700 1 --2- 172.21.15.6:0/1962792148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59c4104e40 0x7f59c419c430 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:14.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.035+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 >> 172.21.15.6:0/1962792148 conn(0x7f59c4100aa0 msgr2=0x7f59c4190a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:14.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.035+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 shutdown_connections 2023-09-13T09:31:14.373 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:14.035+0000 7f59cb340700 1 -- 172.21.15.6:0/1962792148 wait complete. 2023-09-13T09:31:14.373 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (1/15)... 2023-09-13T09:31:14.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:14 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1962792148' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-13T09:31:14.375 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:14.012+0000 7f79a6052200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T09:31:14.665 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:14.505+0000 7f79a6052200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T09:31:15.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:14.663+0000 7f79a6052200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T09:31:15.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:14.772+0000 7f79a6052200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T09:31:15.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:14.887+0000 7f79a6052200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T09:31:15.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:15.400+0000 7f79a6052200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T09:31:16.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:16 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:16.196+0000 7f79a6052200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T09:31:16.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:16 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:16.295+0000 7f79a6052200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T09:31:17.303 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:17 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2750581330' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-13T09:31:17.387 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:17.388 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:31:17.388 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:31:17.388 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-09-13T09:31:17.388 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-13T09:31:17.388 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-13T09:31:17.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-13T09:31:17.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:17.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-13T09:31:17.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-13T09:31:17.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-09-13T09:31:17.389 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:17.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-13T09:31:17.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-09-13T09:31:17.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:17.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-09-13T09:31:17.390 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-13T09:31:17.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:17.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-13T09:31:17.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-13T09:31:17.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:17.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-13T09:31:17.391 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:17.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-13T09:31:17.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-13T09:31:17.392 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-13T09:31:17.399 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-13T09:31:17.399 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-13T09:31:17.400 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-13T09:31:17.400 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:17.400 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-13T09:31:17.400 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-13T09:31:17.400 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-13T09:31:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-13T09:31:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-13T09:31:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-13T09:31:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-13T09:31:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-13T09:31:17.401 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-13T09:31:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-13T09:31:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-13T09:31:17.402 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-13T09:31:17.403 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:17.403 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-13T09:31:17.403 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-13T09:31:17.403 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-13T09:31:17.403 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-13T09:31:17.404 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-13T09:31:17.404 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-13T09:31:17.404 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-09-13T09:31:17.404 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:17.404 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-13T09:31:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-09-13T09:31:04.147590+0000", 2023-09-13T09:31:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:17.405 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:17.406 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-13T09:31:17.406 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:31:17.406 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.880+0000 7fd6249dd700 1 Processor -- start 2023-09-13T09:31:17.406 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.880+0000 7fd6249dd700 1 -- start start 2023-09-13T09:31:17.406 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd6249dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd6201069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd6249dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd620106f70 con 0x7fd620106580 2023-09-13T09:31:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd61e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd6201069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd61e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd6201069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59084/0 (socket says 172.21.15.6:59084) 2023-09-13T09:31:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd61e59c700 1 -- 172.21.15.6:0/3728895828 learned_addr learned my addr 172.21.15.6:0/3728895828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd61e59c700 1 -- 172.21.15.6:0/3728895828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd620107780 con 0x7fd620106580 2023-09-13T09:31:17.407 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd61e59c700 1 --2- 172.21.15.6:0/3728895828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd6201069a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6100098a0 tx=0x7fd610009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c5e33e767e70b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:17.408 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.881+0000 7fd61d59a700 1 -- 172.21.15.6:0/3728895828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd610004160 con 0x7fd620106580 2023-09-13T09:31:17.408 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd61d59a700 1 -- 172.21.15.6:0/3728895828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd6100042c0 con 0x7fd620106580 2023-09-13T09:31:17.408 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd61d59a700 1 -- 172.21.15.6:0/3728895828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd610011a00 con 0x7fd620106580 2023-09-13T09:31:17.408 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd6249dd700 1 -- 172.21.15.6:0/3728895828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 msgr2=0x7fd6201069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:17.408 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd6249dd700 1 --2- 172.21.15.6:0/3728895828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd6201069a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fd6100098a0 tx=0x7fd610009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:17.409 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd6249dd700 1 -- 172.21.15.6:0/3728895828 shutdown_connections 2023-09-13T09:31:17.409 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd6249dd700 1 --2- 172.21.15.6:0/3728895828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd6201069a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:17.409 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd6249dd700 1 -- 172.21.15.6:0/3728895828 >> 172.21.15.6:0/3728895828 conn(0x7fd620101ba0 msgr2=0x7fd620103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:17.409 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd6249dd700 1 -- 172.21.15.6:0/3728895828 shutdown_connections 2023-09-13T09:31:17.409 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.882+0000 7fd6249dd700 1 -- 172.21.15.6:0/3728895828 wait complete. 2023-09-13T09:31:17.409 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.883+0000 7fd6249dd700 1 Processor -- start 2023-09-13T09:31:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.883+0000 7fd6249dd700 1 -- start start 2023-09-13T09:31:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.883+0000 7fd6249dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd62007ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.883+0000 7fd6249dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd62007b070 con 0x7fd620106580 2023-09-13T09:31:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.883+0000 7fd61e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd62007ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:17.410 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd61e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd62007ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59086/0 (socket says 172.21.15.6:59086) 2023-09-13T09:31:17.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd61e59c700 1 -- 172.21.15.6:0/2750581330 learned_addr learned my addr 172.21.15.6:0/2750581330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:17.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd61e59c700 1 -- 172.21.15.6:0/2750581330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd610009550 con 0x7fd620106580 2023-09-13T09:31:17.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd61e59c700 1 --2- 172.21.15.6:0/2750581330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd62007ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd610006af0 tx=0x7fd610011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:17.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd60f7fe700 1 -- 172.21.15.6:0/2750581330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd610003a40 con 0x7fd620106580 2023-09-13T09:31:17.411 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd60f7fe700 1 -- 172.21.15.6:0/2750581330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd610003ba0 con 0x7fd620106580 2023-09-13T09:31:17.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd620079180 con 0x7fd620106580 2023-09-13T09:31:17.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd60f7fe700 1 -- 172.21.15.6:0/2750581330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd61001a700 con 0x7fd620106580 2023-09-13T09:31:17.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.884+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6200795a0 con 0x7fd620106580 2023-09-13T09:31:17.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.885+0000 7fd60f7fe700 1 -- 172.21.15.6:0/2750581330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd61001ac30 con 0x7fd620106580 2023-09-13T09:31:17.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.885+0000 7fd60f7fe700 1 -- 172.21.15.6:0/2750581330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd610019700 con 0x7fd620106580 2023-09-13T09:31:17.412 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.885+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6200622e0 con 0x7fd620106580 2023-09-13T09:31:17.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:16.888+0000 7fd60f7fe700 1 -- 172.21.15.6:0/2750581330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fd61002de40 con 0x7fd620106580 2023-09-13T09:31:17.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.021+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd6200797e0 con 0x7fd620106580 2023-09-13T09:31:17.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.022+0000 7fd60f7fe700 1 -- 172.21.15.6:0/2750581330 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fd610024ad0 con 0x7fd620106580 2023-09-13T09:31:17.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.023+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 msgr2=0x7fd62007ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:17.413 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.023+0000 7fd6249dd700 1 --2- 172.21.15.6:0/2750581330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd62007ab30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd610006af0 tx=0x7fd610011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:17.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.023+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 shutdown_connections 2023-09-13T09:31:17.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.023+0000 7fd6249dd700 1 --2- 172.21.15.6:0/2750581330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd620106580 0x7fd62007ab30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:17.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.023+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 >> 172.21.15.6:0/2750581330 conn(0x7fd620101ba0 msgr2=0x7fd6201032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:17.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.023+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 shutdown_connections 2023-09-13T09:31:17.414 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:17.023+0000 7fd6249dd700 1 -- 172.21.15.6:0/2750581330 wait complete. 2023-09-13T09:31:17.415 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (2/15)... 2023-09-13T09:31:17.637 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:17.302+0000 7f79a6052200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:31:17.637 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:17.413+0000 7f79a6052200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T09:31:17.988 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:17.636+0000 7f79a6052200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:31:18.242 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:17.987+0000 7f79a6052200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T09:31:18.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:18.241+0000 7f79a6052200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T09:31:18.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:18.425+0000 7f79a6052200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T09:31:19.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:18.754+0000 7f79a6052200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T09:31:19.995 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:19.588+0000 7f79a6052200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T09:31:19.996 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:19.747+0000 7f79a6052200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T09:31:19.996 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:19.994+0000 7f79a6052200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T09:31:20.255 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:20.134+0000 7f79a6052200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T09:31:20.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:20.415+0000 7f79a6052200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T09:31:21.476 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:21 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3944565801' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-13T09:31:21.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:21.475+0000 7f79a6052200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T09:31:22.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: Activating manager daemon x 2023-09-13T09:31:22.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: mgrmap e2: x(active, starting, since 0.00314392s) 2023-09-13T09:31:22.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-13T09:31:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-13T09:31:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-13T09:31:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:31:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-13T09:31:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: Manager daemon x is now available 2023-09-13T09:31:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-13T09:31:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-13T09:31:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' 2023-09-13T09:31:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' 2023-09-13T09:31:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:22 smithi006 ceph-mon[98665]: from='mgr.14100 172.21.15.6:0/2694046325' entity='mgr.x' 2023-09-13T09:31:23.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:23 smithi006 ceph-mon[98665]: mgrmap e3: x(active, since 1.00746s) 2023-09-13T09:31:24.456 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:24.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:31:24.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:31:24.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-09-13T09:31:24.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-13T09:31:24.457 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-13T09:31:24.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-13T09:31:24.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:24.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-13T09:31:24.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-13T09:31:24.458 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-09-13T09:31:24.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:24.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-13T09:31:24.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-09-13T09:31:24.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:24.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2023-09-13T09:31:24.459 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-13T09:31:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-13T09:31:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-13T09:31:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:24.460 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-13T09:31:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-13T09:31:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-13T09:31:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-13T09:31:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-13T09:31:24.461 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-13T09:31:24.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-13T09:31:24.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:24.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-13T09:31:24.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-13T09:31:24.462 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-13T09:31:24.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-13T09:31:24.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-13T09:31:24.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-13T09:31:24.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-13T09:31:24.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-13T09:31:24.463 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-13T09:31:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-13T09:31:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-13T09:31:24.464 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-13T09:31:24.465 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:24.465 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-13T09:31:24.465 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": false, 2023-09-13T09:31:24.465 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-13T09:31:24.465 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-13T09:31:24.465 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-13T09:31:24.466 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-13T09:31:24.466 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-09-13T09:31:24.466 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:24.466 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:24.466 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-13T09:31:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-09-13T09:31:04.147590+0000", 2023-09-13T09:31:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:24.467 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-13T09:31:24.468 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:31:24.468 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.892+0000 7fe05c5a1700 1 Processor -- start 2023-09-13T09:31:24.468 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.892+0000 7fe05c5a1700 1 -- start start 2023-09-13T09:31:24.468 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05c5a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe0541080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:24.468 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05c5a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe054108670 con 0x7fe054107c80 2023-09-13T09:31:24.469 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05a33d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe0541080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:24.469 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05a33d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe0541080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59088/0 (socket says 172.21.15.6:59088) 2023-09-13T09:31:24.469 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05a33d700 1 -- 172.21.15.6:0/3822681434 learned_addr learned my addr 172.21.15.6:0/3822681434 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:24.469 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05a33d700 1 -- 172.21.15.6:0/3822681434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0541061c0 con 0x7fe054107c80 2023-09-13T09:31:24.469 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05a33d700 1 --2- 172.21.15.6:0/3822681434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe0541080a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe0500098a0 tx=0x7fe050009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe5ffa12a4d549f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:24.470 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05933b700 1 -- 172.21.15.6:0/3822681434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe050004160 con 0x7fe054107c80 2023-09-13T09:31:24.470 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05933b700 1 -- 172.21.15.6:0/3822681434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0500042c0 con 0x7fe054107c80 2023-09-13T09:31:24.470 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.893+0000 7fe05933b700 1 -- 172.21.15.6:0/3822681434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe050011a00 con 0x7fe054107c80 2023-09-13T09:31:24.470 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.894+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3822681434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 msgr2=0x7fe0541080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:24.470 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.894+0000 7fe05c5a1700 1 --2- 172.21.15.6:0/3822681434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe0541080a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe0500098a0 tx=0x7fe050009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:24.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.894+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3822681434 shutdown_connections 2023-09-13T09:31:24.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.894+0000 7fe05c5a1700 1 --2- 172.21.15.6:0/3822681434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe0541080a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:24.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.894+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3822681434 >> 172.21.15.6:0/3822681434 conn(0x7fe054101b40 msgr2=0x7fe054103f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:24.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.894+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3822681434 shutdown_connections 2023-09-13T09:31:24.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.894+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3822681434 wait complete. 2023-09-13T09:31:24.471 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.895+0000 7fe05c5a1700 1 Processor -- start 2023-09-13T09:31:24.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.895+0000 7fe05c5a1700 1 -- start start 2023-09-13T09:31:24.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.895+0000 7fe05c5a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe05419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:24.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.895+0000 7fe05c5a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05419a940 con 0x7fe054107c80 2023-09-13T09:31:24.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.895+0000 7fe05a33d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe05419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:24.472 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.895+0000 7fe05a33d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe05419a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59090/0 (socket says 172.21.15.6:59090) 2023-09-13T09:31:24.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.895+0000 7fe05a33d700 1 -- 172.21.15.6:0/3944565801 learned_addr learned my addr 172.21.15.6:0/3944565801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:24.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe05a33d700 1 -- 172.21.15.6:0/3944565801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050009550 con 0x7fe054107c80 2023-09-13T09:31:24.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe05a33d700 1 --2- 172.21.15.6:0/3944565801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe05419a400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe050009130 tx=0x7fe050011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:24.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe04b7fe700 1 -- 172.21.15.6:0/3944565801 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe050003ab0 con 0x7fe054107c80 2023-09-13T09:31:24.473 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe04b7fe700 1 -- 172.21.15.6:0/3944565801 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe050003c10 con 0x7fe054107c80 2023-09-13T09:31:24.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05419ab40 con 0x7fe054107c80 2023-09-13T09:31:24.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe04b7fe700 1 -- 172.21.15.6:0/3944565801 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0500247d0 con 0x7fe054107c80 2023-09-13T09:31:24.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05419af60 con 0x7fe054107c80 2023-09-13T09:31:24.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe04b7fe700 1 -- 172.21.15.6:0/3944565801 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe050024d50 con 0x7fe054107c80 2023-09-13T09:31:24.474 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.896+0000 7fe04b7fe700 1 -- 172.21.15.6:0/3944565801 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fe0500193c0 con 0x7fe054107c80 2023-09-13T09:31:24.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.897+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0540622e0 con 0x7fe054107c80 2023-09-13T09:31:24.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:20.899+0000 7fe04b7fe700 1 -- 172.21.15.6:0/3944565801 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72459 (secure 0 0 0) 0x7fe05001abb0 con 0x7fe054107c80 2023-09-13T09:31:24.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.037+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fe05419daa0 con 0x7fe054107c80 2023-09-13T09:31:24.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.037+0000 7fe04b7fe700 1 -- 172.21.15.6:0/3944565801 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fe050035090 con 0x7fe054107c80 2023-09-13T09:31:24.475 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.038+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 msgr2=0x7fe05419a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:24.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.038+0000 7fe05c5a1700 1 --2- 172.21.15.6:0/3944565801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe05419a400 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe050009130 tx=0x7fe050011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:24.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.038+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 shutdown_connections 2023-09-13T09:31:24.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.038+0000 7fe05c5a1700 1 --2- 172.21.15.6:0/3944565801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe054107c80 0x7fe05419a400 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:24.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.039+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 >> 172.21.15.6:0/3944565801 conn(0x7fe054101b40 msgr2=0x7fe054103290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:24.476 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.039+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 shutdown_connections 2023-09-13T09:31:24.477 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:21.039+0000 7fe05c5a1700 1 -- 172.21.15.6:0/3944565801 wait complete. 2023-09-13T09:31:24.477 INFO:teuthology.orchestra.run.smithi006.stdout:mgr not available, waiting (3/15)... 2023-09-13T09:31:25.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:25 smithi006 ceph-mon[98665]: mgrmap e4: x(active, since 3s) 2023-09-13T09:31:28.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:28.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:31:28.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:31:28.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "health": { 2023-09-13T09:31:28.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-09-13T09:31:28.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-09-13T09:31:28.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-09-13T09:31:28.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:28.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-09-13T09:31:28.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-09-13T09:31:28.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 0 2023-09-13T09:31:28.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:28.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-09-13T09:31:28.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "a" 2023-09-13T09:31:28.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:28.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2023-09-13T09:31:28.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "monmap": { 2023-09-13T09:31:28.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:28.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-09-13T09:31:28.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-09-13T09:31:28.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:28.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-09-13T09:31:28.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:28.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-09-13T09:31:28.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-09-13T09:31:28.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-09-13T09:31:28.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-09-13T09:31:28.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-09-13T09:31:28.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-09-13T09:31:28.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:28.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-09-13T09:31:28.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-09-13T09:31:28.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-09-13T09:31:28.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-09-13T09:31:28.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-09-13T09:31:28.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-09-13T09:31:28.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-09-13T09:31:28.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-09-13T09:31:28.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-09-13T09:31:28.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:28.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-09-13T09:31:28.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:28.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-09-13T09:31:28.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-09-13T09:31:28.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:28.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-09-13T09:31:28.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-13T09:31:28.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-09-13T09:31:28.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modules": [ 2023-09-13T09:31:28.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "iostat", 2023-09-13T09:31:28.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "nfs", 2023-09-13T09:31:28.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "restful" 2023-09-13T09:31:28.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ], 2023-09-13T09:31:28.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:28.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:28.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-09-13T09:31:28.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-09-13T09:31:28.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "modified": "2023-09-13T09:31:04.147590+0000", 2023-09-13T09:31:28.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "services": {} 2023-09-13T09:31:28.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout }, 2023-09-13T09:31:28.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-09-13T09:31:28.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:31:28.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.052+0000 7fd1b7c35700 1 Processor -- start 2023-09-13T09:31:28.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.052+0000 7fd1b7c35700 1 -- start start 2023-09-13T09:31:28.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.052+0000 7fd1b7c35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b01093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:28.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.052+0000 7fd1b7c35700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b00744f0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.052+0000 7fd1b59d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b01093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:28.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.052+0000 7fd1b59d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b01093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59118/0 (socket says 172.21.15.6:59118) 2023-09-13T09:31:28.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.052+0000 7fd1b59d1700 1 -- 172.21.15.6:0/1535329353 learned_addr learned my addr 172.21.15.6:0/1535329353 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:28.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.053+0000 7fd1b59d1700 1 -- 172.21.15.6:0/1535329353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1b0109920 con 0x7fd1b0106ff0 2023-09-13T09:31:28.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.053+0000 7fd1b59d1700 1 --2- 172.21.15.6:0/1535329353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b01093e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0098a0 tx=0x7fd1ac009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b8d5e60ce2948f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:28.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.053+0000 7fd1b49cf700 1 -- 172.21.15.6:0/1535329353 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1ac004160 con 0x7fd1b0106ff0 2023-09-13T09:31:28.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.053+0000 7fd1b49cf700 1 -- 172.21.15.6:0/1535329353 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1ac0042c0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.053+0000 7fd1b49cf700 1 -- 172.21.15.6:0/1535329353 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1ac011a00 con 0x7fd1b0106ff0 2023-09-13T09:31:28.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 -- 172.21.15.6:0/1535329353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 msgr2=0x7fd1b01093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:28.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 --2- 172.21.15.6:0/1535329353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b01093e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac0098a0 tx=0x7fd1ac009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:28.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 -- 172.21.15.6:0/1535329353 shutdown_connections 2023-09-13T09:31:28.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 --2- 172.21.15.6:0/1535329353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b01093e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:28.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 -- 172.21.15.6:0/1535329353 >> 172.21.15.6:0/1535329353 conn(0x7fd1b0100aa0 msgr2=0x7fd1b0102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:28.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 -- 172.21.15.6:0/1535329353 shutdown_connections 2023-09-13T09:31:28.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 -- 172.21.15.6:0/1535329353 wait complete. 2023-09-13T09:31:28.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 Processor -- start 2023-09-13T09:31:28.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.054+0000 7fd1b7c35700 1 -- start start 2023-09-13T09:31:28.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b7c35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b0106950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:28.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b7c35700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1b0106e90 con 0x7fd1b0106ff0 2023-09-13T09:31:28.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b59d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b0106950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:28.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b59d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b0106950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59120/0 (socket says 172.21.15.6:59120) 2023-09-13T09:31:28.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b59d1700 1 -- 172.21.15.6:0/4161493162 learned_addr learned my addr 172.21.15.6:0/4161493162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:28.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b59d1700 1 -- 172.21.15.6:0/4161493162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1ac009550 con 0x7fd1b0106ff0 2023-09-13T09:31:28.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b59d1700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b0106950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac006af0 tx=0x7fd1ac011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:28.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1a6ffd700 1 -- 172.21.15.6:0/4161493162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1ac003a40 con 0x7fd1b0106ff0 2023-09-13T09:31:28.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1a6ffd700 1 -- 172.21.15.6:0/4161493162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd1ac003ba0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1b0104fa0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1a6ffd700 1 -- 172.21.15.6:0/4161493162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd1ac01a6e0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.055+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1b01053c0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.056+0000 7fd1a6ffd700 1 -- 172.21.15.6:0/4161493162 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 45320+0+0 (secure 0 0 0) 0x7fd1ac024a60 con 0x7fd1b0106ff0 2023-09-13T09:31:28.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.057+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1b010a720 con 0x7fd1b0106ff0 2023-09-13T09:31:28.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.057+0000 7fd1a6ffd700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7fd19c038360 0x7fd19c03a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:28.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.057+0000 7fd1a6ffd700 1 -- 172.21.15.6:0/4161493162 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd1ac04c1f0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.057+0000 7fd1b51d0700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7fd19c038360 0x7fd19c03a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:28.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.057+0000 7fd1b51d0700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7fd19c038360 0x7fd19c03a820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006fd0 tx=0x7fd1a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:28.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.062+0000 7fd1a6ffd700 1 -- 172.21.15.6:0/4161493162 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd1ac018db0 con 0x7fd1b0106ff0 2023-09-13T09:31:28.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.581+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fd1b010a990 con 0x7fd1b0106ff0 2023-09-13T09:31:28.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.581+0000 7fd1a6ffd700 1 -- 172.21.15.6:0/4161493162 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7fd1ac018350 con 0x7fd1b0106ff0 2023-09-13T09:31:28.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7fd19c038360 msgr2=0x7fd19c03a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:28.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7fd19c038360 0x7fd19c03a820 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd1a0006fd0 tx=0x7fd1a0006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:28.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 msgr2=0x7fd1b0106950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:28.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b0106950 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd1ac006af0 tx=0x7fd1ac011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:28.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 shutdown_connections 2023-09-13T09:31:28.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7fd19c038360 0x7fd19c03a820 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:28.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 --2- 172.21.15.6:0/4161493162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1b0106ff0 0x7fd1b0106950 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:28.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 >> 172.21.15.6:0/4161493162 conn(0x7fd1b0100aa0 msgr2=0x7fd1b0102140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:28.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.583+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 shutdown_connections 2023-09-13T09:31:28.947 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:28.584+0000 7fd1b7c35700 1 -- 172.21.15.6:0/4161493162 wait complete. 2023-09-13T09:31:28.947 INFO:teuthology.orchestra.run.smithi006.stdout:mgr is available 2023-09-13T09:31:28.948 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:28 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4161493162' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-09-13T09:31:30.163 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [global] 2023-09-13T09:31:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout fsid = 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-09-13T09:31:30.164 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-09-13T09:31:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-09-13T09:31:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-09-13T09:31:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:30.165 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [mgr] 2023-09-13T09:31:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-09-13T09:31:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 2023-09-13T09:31:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout [osd] 2023-09-13T09:31:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-09-13T09:31:30.166 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-09-13T09:31:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-09-13T09:31:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-09-13T09:31:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-09-13T09:31:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.412+0000 7f320f495700 1 Processor -- start 2023-09-13T09:31:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.412+0000 7f320f495700 1 -- start start 2023-09-13T09:31:30.167 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.412+0000 7f320f495700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f32081058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.412+0000 7f320f495700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3208105e70 con 0x7f3208105480 2023-09-13T09:31:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f320d231700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f32081058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f320d231700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f32081058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59124/0 (socket says 172.21.15.6:59124) 2023-09-13T09:31:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f320d231700 1 -- 172.21.15.6:0/126424911 learned_addr learned my addr 172.21.15.6:0/126424911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:30.168 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f320d231700 1 -- 172.21.15.6:0/126424911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3208106680 con 0x7f3208105480 2023-09-13T09:31:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f320d231700 1 --2- 172.21.15.6:0/126424911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f32081058a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31f80098a0 tx=0x7f31f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6958de14ef52a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f31fffff700 1 -- 172.21.15.6:0/126424911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f8004160 con 0x7f3208105480 2023-09-13T09:31:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f31fffff700 1 -- 172.21.15.6:0/126424911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31f80042c0 con 0x7f3208105480 2023-09-13T09:31:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.413+0000 7f31fffff700 1 -- 172.21.15.6:0/126424911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f8011a00 con 0x7f3208105480 2023-09-13T09:31:30.169 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.414+0000 7f320f495700 1 -- 172.21.15.6:0/126424911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 msgr2=0x7f32081058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.414+0000 7f320f495700 1 --2- 172.21.15.6:0/126424911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f32081058a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f31f80098a0 tx=0x7f31f8009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.414+0000 7f320f495700 1 -- 172.21.15.6:0/126424911 shutdown_connections 2023-09-13T09:31:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.414+0000 7f320f495700 1 --2- 172.21.15.6:0/126424911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f32081058a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:30.170 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.414+0000 7f320f495700 1 -- 172.21.15.6:0/126424911 >> 172.21.15.6:0/126424911 conn(0x7f3208100aa0 msgr2=0x7f3208102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.414+0000 7f320f495700 1 -- 172.21.15.6:0/126424911 shutdown_connections 2023-09-13T09:31:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.414+0000 7f320f495700 1 -- 172.21.15.6:0/126424911 wait complete. 2023-09-13T09:31:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320f495700 1 Processor -- start 2023-09-13T09:31:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320f495700 1 -- start start 2023-09-13T09:31:30.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320f495700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f3208074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320f495700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320819cfd0 con 0x7f3208105480 2023-09-13T09:31:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320d231700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f3208074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:30.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320d231700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f3208074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59126/0 (socket says 172.21.15.6:59126) 2023-09-13T09:31:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320d231700 1 -- 172.21.15.6:0/2235062599 learned_addr learned my addr 172.21.15.6:0/2235062599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320d231700 1 -- 172.21.15.6:0/2235062599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f8009550 con 0x7f3208105480 2023-09-13T09:31:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.415+0000 7f320d231700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f3208074170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009fb0 tx=0x7f31f8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.416+0000 7f31fe7fc700 1 -- 172.21.15.6:0/2235062599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f8003930 con 0x7f3208105480 2023-09-13T09:31:30.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.416+0000 7f31fe7fc700 1 -- 172.21.15.6:0/2235062599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31f8003a90 con 0x7f3208105480 2023-09-13T09:31:30.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.416+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320819d110 con 0x7f3208105480 2023-09-13T09:31:30.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.416+0000 7f31fe7fc700 1 -- 172.21.15.6:0/2235062599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f31f80195e0 con 0x7f3208105480 2023-09-13T09:31:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.416+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320819d530 con 0x7f3208105480 2023-09-13T09:31:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.416+0000 7f31fe7fc700 1 -- 172.21.15.6:0/2235062599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 45320+0+0 (secure 0 0 0) 0x7f31f80198a0 con 0x7f3208105480 2023-09-13T09:31:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.417+0000 7f31fe7fc700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f31f40382c0 0x7f31f403a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.417+0000 7f31fe7fc700 1 -- 172.21.15.6:0/2235062599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f31f804bfd0 con 0x7f3208105480 2023-09-13T09:31:30.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.417+0000 7f320ca30700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f31f40382c0 0x7f31f403a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.417+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32080622e0 con 0x7f3208105480 2023-09-13T09:31:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.417+0000 7f320ca30700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f31f40382c0 0x7f31f403a780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3204006fd0 tx=0x7f3204006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.422+0000 7f31fe7fc700 1 -- 172.21.15.6:0/2235062599 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f31f8019b50 con 0x7f3208105480 2023-09-13T09:31:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.783+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f32081098b0 con 0x7f3208105480 2023-09-13T09:31:30.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.784+0000 7f31fe7fc700 1 -- 172.21.15.6:0/2235062599 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f31f8018b40 con 0x7f3208105480 2023-09-13T09:31:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f31f40382c0 msgr2=0x7f31f403a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f31f40382c0 0x7f31f403a780 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f3204006fd0 tx=0x7f3204006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 msgr2=0x7f3208074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:30.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f3208074170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009fb0 tx=0x7f31f8011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 shutdown_connections 2023-09-13T09:31:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f31f40382c0 0x7f31f403a780 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 --2- 172.21.15.6:0/2235062599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3208105480 0x7f3208074170 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 >> 172.21.15.6:0/2235062599 conn(0x7f3208100aa0 msgr2=0x7f3208102190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:30.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.786+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 shutdown_connections 2023-09-13T09:31:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:29.787+0000 7f320f495700 1 -- 172.21.15.6:0/2235062599 wait complete. 2023-09-13T09:31:30.182 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling cephadm module... 2023-09-13T09:31:30.191 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:29 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2235062599' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-09-13T09:31:31.603 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:31 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3648440078' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-09-13T09:31:31.603 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: ignoring --setuser ceph since I am not root 2023-09-13T09:31:31.603 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: ignoring --setgroup ceph since I am not root 2023-09-13T09:31:31.604 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:31.505+0000 7f5b31afb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T09:31:31.604 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:31.602+0000 7f5b31afb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T09:31:31.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.781+0000 7f13ece10700 1 Processor -- start 2023-09-13T09:31:31.714 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.781+0000 7f13ece10700 1 -- start start 2023-09-13T09:31:31.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.781+0000 7f13ece10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e8109460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:31.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.781+0000 7f13ece10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e8074470 con 0x7f13e8107070 2023-09-13T09:31:31.715 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e8109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:31.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e8109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59130/0 (socket says 172.21.15.6:59130) 2023-09-13T09:31:31.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e659c700 1 -- 172.21.15.6:0/2275321832 learned_addr learned my addr 172.21.15.6:0/2275321832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:31.716 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e659c700 1 -- 172.21.15.6:0/2275321832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e81099a0 con 0x7f13e8107070 2023-09-13T09:31:31.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e659c700 1 --2- 172.21.15.6:0/2275321832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e8109460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0098a0 tx=0x7f13dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a62cf8298bffb024 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:31.717 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e559a700 1 -- 172.21.15.6:0/2275321832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13dc004160 con 0x7f13e8107070 2023-09-13T09:31:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e559a700 1 -- 172.21.15.6:0/2275321832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f13dc0042c0 con 0x7f13e8107070 2023-09-13T09:31:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.782+0000 7f13e559a700 1 -- 172.21.15.6:0/2275321832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13dc011a00 con 0x7f13e8107070 2023-09-13T09:31:31.718 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.783+0000 7f13ece10700 1 -- 172.21.15.6:0/2275321832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 msgr2=0x7f13e8109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.783+0000 7f13ece10700 1 --2- 172.21.15.6:0/2275321832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e8109460 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f13dc0098a0 tx=0x7f13dc009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:31.719 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.783+0000 7f13ece10700 1 -- 172.21.15.6:0/2275321832 shutdown_connections 2023-09-13T09:31:31.720 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.783+0000 7f13ece10700 1 --2- 172.21.15.6:0/2275321832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e8109460 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:31.720 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.783+0000 7f13ece10700 1 -- 172.21.15.6:0/2275321832 >> 172.21.15.6:0/2275321832 conn(0x7f13e8100aa0 msgr2=0x7f13e8102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:31.721 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.783+0000 7f13ece10700 1 -- 172.21.15.6:0/2275321832 shutdown_connections 2023-09-13T09:31:31.721 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.783+0000 7f13ece10700 1 -- 172.21.15.6:0/2275321832 wait complete. 2023-09-13T09:31:31.722 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13ece10700 1 Processor -- start 2023-09-13T09:31:31.722 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13ece10700 1 -- start start 2023-09-13T09:31:31.722 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13ece10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e819a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:31.723 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13ece10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e819a780 con 0x7f13e8107070 2023-09-13T09:31:31.723 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e819a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:31.723 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13e659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e819a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59132/0 (socket says 172.21.15.6:59132) 2023-09-13T09:31:31.724 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13e659c700 1 -- 172.21.15.6:0/3648440078 learned_addr learned my addr 172.21.15.6:0/3648440078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:31.724 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13e659c700 1 -- 172.21.15.6:0/3648440078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc009550 con 0x7f13e8107070 2023-09-13T09:31:31.724 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.784+0000 7f13e659c700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e819a240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009fb0 tx=0x7f13dc011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:31.725 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.785+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13dc003930 con 0x7f13e8107070 2023-09-13T09:31:31.725 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.785+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e819a980 con 0x7f13e8107070 2023-09-13T09:31:31.726 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.785+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f13dc003a90 con 0x7f13e8107070 2023-09-13T09:31:31.726 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.785+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13dc019610 con 0x7f13e8107070 2023-09-13T09:31:31.726 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.785+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e819ada0 con 0x7f13e8107070 2023-09-13T09:31:31.727 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.786+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 45320+0+0 (secure 0 0 0) 0x7f13dc0198d0 con 0x7f13e8107070 2023-09-13T09:31:31.727 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.786+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e80622e0 con 0x7f13e8107070 2023-09-13T09:31:31.727 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.786+0000 7f13d77fe700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f13d00382c0 0x7f13d003a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:31.727 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.786+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f13dc04bf90 con 0x7f13e8107070 2023-09-13T09:31:31.728 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.786+0000 7f13e5d9b700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f13d00382c0 0x7f13d003a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:31.728 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.786+0000 7f13e5d9b700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f13d00382c0 0x7f13d003a780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13d8006fd0 tx=0x7f13d8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:31.728 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:30.791+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f13dc02b340 con 0x7f13e8107070 2023-09-13T09:31:31.729 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.259+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f13e810a6f0 con 0x7f13e8107070 2023-09-13T09:31:31.729 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.312+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 5) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f13dc02d960 con 0x7f13e8107070 2023-09-13T09:31:31.729 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.313+0000 7f13d77fe700 1 -- 172.21.15.6:0/3648440078 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f13dc003c00 con 0x7f13e8107070 2023-09-13T09:31:31.730 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f13d00382c0 msgr2=0x7f13d003a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:31.730 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f13d00382c0 0x7f13d003a780 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f13d8006fd0 tx=0x7f13d8006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:31.730 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 msgr2=0x7f13e819a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:31.730 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e819a240 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f13dc009fb0 tx=0x7f13dc011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:31.731 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 shutdown_connections 2023-09-13T09:31:31.731 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f13d00382c0 0x7f13d003a780 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:31.731 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 --2- 172.21.15.6:0/3648440078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13e8107070 0x7f13e819a240 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:31.731 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 >> 172.21.15.6:0/3648440078 conn(0x7f13e8100aa0 msgr2=0x7f13e8102150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:31.732 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.315+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 shutdown_connections 2023-09-13T09:31:31.732 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:31.316+0000 7f13ece10700 1 -- 172.21.15.6:0/3648440078 wait complete. 2023-09-13T09:31:31.905 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:31.716+0000 7f5b31afb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T09:31:31.906 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:31.836+0000 7f5b31afb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T09:31:32.255 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:32 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:32.050+0000 7f5b31afb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T09:31:32.676 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:32 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3648440078' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-09-13T09:31:32.677 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:32 smithi006 ceph-mon[98665]: mgrmap e5: x(active, since 9s) 2023-09-13T09:31:32.677 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:32 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:32.530+0000 7f5b31afb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T09:31:33.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:32 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:32.684+0000 7f5b31afb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T09:31:33.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:32 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:32.797+0000 7f5b31afb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T09:31:33.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:32 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:32.913+0000 7f5b31afb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T09:31:33.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:31:33.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-09-13T09:31:33.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-13T09:31:33.064 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-09-13T09:31:33.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-09-13T09:31:33.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:31:33.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.167+0000 7f2c8905f700 1 Processor -- start 2023-09-13T09:31:33.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c8905f700 1 -- start start 2023-09-13T09:31:33.065 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c8905f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c84105280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:33.066 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c8905f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c84074470 con 0x7f2c84104e60 2023-09-13T09:31:33.066 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c82d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c84105280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:33.066 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c82d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c84105280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59146/0 (socket says 172.21.15.6:59146) 2023-09-13T09:31:33.066 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c82d9d700 1 -- 172.21.15.6:0/1250499775 learned_addr learned my addr 172.21.15.6:0/1250499775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:33.066 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c82d9d700 1 -- 172.21.15.6:0/1250499775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c841057c0 con 0x7f2c84104e60 2023-09-13T09:31:33.067 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c82d9d700 1 --2- 172.21.15.6:0/1250499775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c84105280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c740098a0 tx=0x7f2c74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1813a18401539681 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:33.067 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.168+0000 7f2c81d9b700 1 -- 172.21.15.6:0/1250499775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c74004160 con 0x7f2c84104e60 2023-09-13T09:31:33.067 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c81d9b700 1 -- 172.21.15.6:0/1250499775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c740042c0 con 0x7f2c84104e60 2023-09-13T09:31:33.067 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c81d9b700 1 -- 172.21.15.6:0/1250499775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c74011a00 con 0x7f2c84104e60 2023-09-13T09:31:33.067 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c8905f700 1 -- 172.21.15.6:0/1250499775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 msgr2=0x7f2c84105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c8905f700 1 --2- 172.21.15.6:0/1250499775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c84105280 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2c740098a0 tx=0x7f2c74009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c8905f700 1 -- 172.21.15.6:0/1250499775 shutdown_connections 2023-09-13T09:31:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c8905f700 1 --2- 172.21.15.6:0/1250499775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c84105280 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c8905f700 1 -- 172.21.15.6:0/1250499775 >> 172.21.15.6:0/1250499775 conn(0x7f2c84100aa0 msgr2=0x7f2c84102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c8905f700 1 -- 172.21.15.6:0/1250499775 shutdown_connections 2023-09-13T09:31:33.068 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.169+0000 7f2c8905f700 1 -- 172.21.15.6:0/1250499775 wait complete. 2023-09-13T09:31:33.069 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.170+0000 7f2c8905f700 1 Processor -- start 2023-09-13T09:31:33.069 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.170+0000 7f2c8905f700 1 -- start start 2023-09-13T09:31:33.069 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.170+0000 7f2c8905f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c8419c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:33.069 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c8905f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c8419c9a0 con 0x7f2c84104e60 2023-09-13T09:31:33.069 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c82d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c8419c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:33.070 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c82d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c8419c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59148/0 (socket says 172.21.15.6:59148) 2023-09-13T09:31:33.070 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c82d9d700 1 -- 172.21.15.6:0/112845695 learned_addr learned my addr 172.21.15.6:0/112845695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:33.070 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c82d9d700 1 -- 172.21.15.6:0/112845695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c74009550 con 0x7f2c84104e60 2023-09-13T09:31:33.070 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c82d9d700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c8419c460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009fb0 tx=0x7f2c74011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:33.070 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c6bfff700 1 -- 172.21.15.6:0/112845695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c74003930 con 0x7f2c84104e60 2023-09-13T09:31:33.071 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c8419cba0 con 0x7f2c84104e60 2023-09-13T09:31:33.071 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c6bfff700 1 -- 172.21.15.6:0/112845695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c74003a90 con 0x7f2c84104e60 2023-09-13T09:31:33.071 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c6bfff700 1 -- 172.21.15.6:0/112845695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2c74019610 con 0x7f2c84104e60 2023-09-13T09:31:33.071 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.171+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c8419cfc0 con 0x7f2c84104e60 2023-09-13T09:31:33.071 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.172+0000 7f2c6bfff700 1 -- 172.21.15.6:0/112845695 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f2c740198d0 con 0x7f2c84104e60 2023-09-13T09:31:33.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.173+0000 7f2c6bfff700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 0x7f2c6c03a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:33.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.173+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c84195ce0 con 0x7f2c84104e60 2023-09-13T09:31:33.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.173+0000 7f2c6bfff700 1 -- 172.21.15.6:0/112845695 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2c7404c0a0 con 0x7f2c84104e60 2023-09-13T09:31:33.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.173+0000 7f2c8259c700 1 -- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 msgr2=0x7f2c6c03a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2818405814 2023-09-13T09:31:33.072 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.173+0000 7f2c8259c700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 0x7f2c6c03a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T09:31:33.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.178+0000 7f2c6bfff700 1 -- 172.21.15.6:0/112845695 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2c7402b340 con 0x7f2c84104e60 2023-09-13T09:31:33.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.374+0000 7f2c8259c700 1 -- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 msgr2=0x7f2c6c03a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2818405814 2023-09-13T09:31:33.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.374+0000 7f2c8259c700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 0x7f2c6c03a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T09:31:33.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.653+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f2c840622e0 con 0x7f2c84104e60 2023-09-13T09:31:33.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.654+0000 7f2c6bfff700 1 -- 172.21.15.6:0/112845695 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f2c74018b40 con 0x7f2c84104e60 2023-09-13T09:31:33.073 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 msgr2=0x7f2c6c03a7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:31:33.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 0x7f2c6c03a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:33.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 msgr2=0x7f2c8419c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:33.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c8419c460 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2c74009fb0 tx=0x7f2c74011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:33.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 shutdown_connections 2023-09-13T09:31:33.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2c6c038310 0x7f2c6c03a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:33.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 --2- 172.21.15.6:0/112845695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c84104e60 0x7f2c8419c460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:33.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 >> 172.21.15.6:0/112845695 conn(0x7f2c84100aa0 msgr2=0x7f2c84190a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:33.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 shutdown_connections 2023-09-13T09:31:33.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:32.656+0000 7f2c8905f700 1 -- 172.21.15.6:0/112845695 wait complete. 2023-09-13T09:31:33.075 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2023-09-13T09:31:33.076 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 5... 2023-09-13T09:31:33.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:33 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/112845695' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-09-13T09:31:33.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:33.443+0000 7f5b31afb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T09:31:34.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:34.227+0000 7f5b31afb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T09:31:34.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:34.326+0000 7f5b31afb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T09:31:35.629 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:35.298+0000 7f5b31afb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:31:35.630 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:35.409+0000 7f5b31afb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T09:31:35.980 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:35.629+0000 7f5b31afb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:31:36.233 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:35.980+0000 7f5b31afb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T09:31:36.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:36.232+0000 7f5b31afb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T09:31:36.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:36.416+0000 7f5b31afb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T09:31:37.005 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:36.745+0000 7f5b31afb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T09:31:37.972 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:37.568+0000 7f5b31afb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T09:31:37.972 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:37.726+0000 7f5b31afb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T09:31:38.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:37.971+0000 7f5b31afb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T09:31:38.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:38.108+0000 7f5b31afb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T09:31:38.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:38.381+0000 7f5b31afb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T09:31:39.755 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:39.425+0000 7f5b31afb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T09:31:39.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: Active manager daemon x restarted 2023-09-13T09:31:39.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: Activating manager daemon x 2023-09-13T09:31:39.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: osdmap e2: 0 total, 0 up, 0 in 2023-09-13T09:31:39.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: mgrmap e6: x(active, starting, since 0.00331866s) 2023-09-13T09:31:39.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:31:39.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-13T09:31:39.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-13T09:31:39.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-13T09:31:39.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-13T09:31:39.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: Manager daemon x is now available 2023-09-13T09:31:39.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:39.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:39.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:31:39.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:39 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:31:40.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: Found migration_current of "None". Setting to last migration. 2023-09-13T09:31:40.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:31:40.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-13T09:31:40.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-13T09:31:40.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:40.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:40.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: [13/Sep/2023:09:31:40] ENGINE Bus STARTING 2023-09-13T09:31:40.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:40 smithi006 ceph-mon[98665]: mgrmap e7: x(active, since 1.00571s) 2023-09-13T09:31:40.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:31:40.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-09-13T09:31:40.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2023-09-13T09:31:40.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:31:40.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.537+0000 7f2f74d0c700 1 Processor -- start 2023-09-13T09:31:40.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.537+0000 7f2f74d0c700 1 -- start start 2023-09-13T09:31:40.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.537+0000 7f2f74d0c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f70079200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:40.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.537+0000 7f2f74d0c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f700797d0 con 0x7f2f7007ada0 2023-09-13T09:31:40.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f70079200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:40.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f70079200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59156/0 (socket says 172.21.15.6:59156) 2023-09-13T09:31:40.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6e59c700 1 -- 172.21.15.6:0/2794641073 learned_addr learned my addr 172.21.15.6:0/2794641073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:40.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6e59c700 1 -- 172.21.15.6:0/2794641073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f70079910 con 0x7f2f7007ada0 2023-09-13T09:31:40.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6e59c700 1 --2- 172.21.15.6:0/2794641073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f70079200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f600098a0 tx=0x7f2f60009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff3d439e21765f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:40.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6d59a700 1 -- 172.21.15.6:0/2794641073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f60004160 con 0x7f2f7007ada0 2023-09-13T09:31:40.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6d59a700 1 -- 172.21.15.6:0/2794641073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f600042c0 con 0x7f2f7007ada0 2023-09-13T09:31:40.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.538+0000 7f2f6d59a700 1 -- 172.21.15.6:0/2794641073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f60011a00 con 0x7f2f7007ada0 2023-09-13T09:31:40.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.539+0000 7f2f74d0c700 1 -- 172.21.15.6:0/2794641073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 msgr2=0x7f2f70079200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:40.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.539+0000 7f2f74d0c700 1 --2- 172.21.15.6:0/2794641073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f70079200 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2f600098a0 tx=0x7f2f60009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:40.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.539+0000 7f2f74d0c700 1 -- 172.21.15.6:0/2794641073 shutdown_connections 2023-09-13T09:31:40.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.539+0000 7f2f74d0c700 1 --2- 172.21.15.6:0/2794641073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f70079200 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:40.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.539+0000 7f2f74d0c700 1 -- 172.21.15.6:0/2794641073 >> 172.21.15.6:0/2794641073 conn(0x7f2f70101ba0 msgr2=0x7f2f70103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:40.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.539+0000 7f2f74d0c700 1 -- 172.21.15.6:0/2794641073 shutdown_connections 2023-09-13T09:31:40.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.539+0000 7f2f74d0c700 1 -- 172.21.15.6:0/2794641073 wait complete. 2023-09-13T09:31:40.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.540+0000 7f2f74d0c700 1 Processor -- start 2023-09-13T09:31:40.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.540+0000 7f2f74d0c700 1 -- start start 2023-09-13T09:31:40.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.540+0000 7f2f74d0c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f7019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:40.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.540+0000 7f2f74d0c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f7019c9d0 con 0x7f2f7007ada0 2023-09-13T09:31:40.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.540+0000 7f2f6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f7019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:40.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.540+0000 7f2f6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f7019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59158/0 (socket says 172.21.15.6:59158) 2023-09-13T09:31:40.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.540+0000 7f2f6e59c700 1 -- 172.21.15.6:0/3972858583 learned_addr learned my addr 172.21.15.6:0/3972858583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:40.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.541+0000 7f2f6e59c700 1 -- 172.21.15.6:0/3972858583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60009550 con 0x7f2f7007ada0 2023-09-13T09:31:40.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.541+0000 7f2f6e59c700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f7019c490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009fb0 tx=0x7f2f60011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:40.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.541+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f60003930 con 0x7f2f7007ada0 2023-09-13T09:31:40.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.541+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f60003a90 con 0x7f2f7007ada0 2023-09-13T09:31:40.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.541+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f7019cbd0 con 0x7f2f7007ada0 2023-09-13T09:31:40.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.541+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2f600195e0 con 0x7f2f7007ada0 2023-09-13T09:31:40.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.541+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f7019cff0 con 0x7f2f7007ada0 2023-09-13T09:31:40.939 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.542+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f2f600198a0 con 0x7f2f7007ada0 2023-09-13T09:31:40.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.542+0000 7f2f5f7fe700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:40.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.542+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 --> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f5803aee0 con 0x7f2f58038310 2023-09-13T09:31:40.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.542+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2f6004bf90 con 0x7f2f7007ada0 2023-09-13T09:31:40.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.542+0000 7f2f6dd9b700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 msgr2=0x7f2f5803a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2818405814 2023-09-13T09:31:40.940 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.542+0000 7f2f6dd9b700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T09:31:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.743+0000 7f2f6dd9b700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 msgr2=0x7f2f5803a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2818405814 2023-09-13T09:31:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:33.743+0000 7f2f6dd9b700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T09:31:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:34.144+0000 7f2f6dd9b700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 msgr2=0x7f2f5803a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2818405814 2023-09-13T09:31:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:34.144+0000 7f2f6dd9b700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T09:31:40.941 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:34.945+0000 7f2f6dd9b700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 msgr2=0x7f2f5803a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2818405814 2023-09-13T09:31:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:34.945+0000 7f2f6dd9b700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-13T09:31:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:36.546+0000 7f2f6dd9b700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 msgr2=0x7f2f5803a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/2818405814 2023-09-13T09:31:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:36.546+0000 7f2f6dd9b700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-13T09:31:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:39.441+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 6) v1 ==== 45098+0+0 (secure 0 0 0) 0x7f2f6002d9b0 con 0x7f2f7007ada0 2023-09-13T09:31:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:39.441+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 msgr2=0x7f2f5803a7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:31:40.942 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:39.441+0000 7f2f5f7fe700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.442+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 7) v1 ==== 45225+0+0 (secure 0 0 0) 0x7f2f60019d80 con 0x7f2f7007ada0 2023-09-13T09:31:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.443+0000 7f2f5f7fe700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f2f5803bc40 0x7f2f5803e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.443+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2f5803aee0 con 0x7f2f5803bc40 2023-09-13T09:31:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.443+0000 7f2f6dd9b700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f2f5803bc40 0x7f2f5803e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:40.943 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.444+0000 7f2f6dd9b700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f2f5803bc40 0x7f2f5803e030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2f64003a10 tx=0x7f2f64009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:40.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.444+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f2f5803aee0 con 0x7f2f5803bc40 2023-09-13T09:31:40.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f2f7019d7d0 con 0x7f2f5803bc40 2023-09-13T09:31:40.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f5f7fe700 1 -- 172.21.15.6:0/3972858583 <== mgr.14120 v2:172.21.15.6:6800/1676430765 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f2f7019d7d0 con 0x7f2f5803bc40 2023-09-13T09:31:40.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f2f5803bc40 msgr2=0x7f2f5803e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:40.944 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f74d0c700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f2f5803bc40 0x7f2f5803e030 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f2f64003a10 tx=0x7f2f64009290 comp rx=0 tx=0).stop 2023-09-13T09:31:40.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 msgr2=0x7f2f7019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:40.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f74d0c700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f7019c490 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009fb0 tx=0x7f2f60011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:40.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 shutdown_connections 2023-09-13T09:31:40.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.455+0000 7f2f74d0c700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f2f5803bc40 0x7f2f5803e030 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:40.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.456+0000 7f2f74d0c700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f7007ada0 0x7f2f7019c490 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:40.945 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.456+0000 7f2f74d0c700 1 --2- 172.21.15.6:0/3972858583 >> [v2:172.21.15.6:6800/2818405814,v1:172.21.15.6:6801/2818405814] conn(0x7f2f58038310 0x7f2f5803a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:40.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.456+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 >> 172.21.15.6:0/3972858583 conn(0x7f2f70101ba0 msgr2=0x7f2f701032d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:40.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.456+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 shutdown_connections 2023-09-13T09:31:40.946 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:40.456+0000 7f2f74d0c700 1 -- 172.21.15.6:0/3972858583 wait complete. 2023-09-13T09:31:40.946 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 5 is available 2023-09-13T09:31:40.946 INFO:teuthology.orchestra.run.smithi006.stdout:Setting orchestrator backend to cephadm... 2023-09-13T09:31:41.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:41 smithi006 ceph-mon[98665]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-09-13T09:31:41.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:41 smithi006 ceph-mon[98665]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-09-13T09:31:41.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:41 smithi006 ceph-mon[98665]: [13/Sep/2023:09:31:40] ENGINE Serving on https://172.21.15.6:7150 2023-09-13T09:31:41.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:41 smithi006 ceph-mon[98665]: [13/Sep/2023:09:31:40] ENGINE Serving on http://172.21.15.6:8765 2023-09-13T09:31:41.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:41 smithi006 ceph-mon[98665]: [13/Sep/2023:09:31:40] ENGINE Bus STARTED 2023-09-13T09:31:41.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:41 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:31:42.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.343+0000 7f06c5dcd700 1 Processor -- start 2023-09-13T09:31:42.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.343+0000 7f06c5dcd700 1 -- start start 2023-09-13T09:31:42.074 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.343+0000 7f06c5dcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0109420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:42.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.343+0000 7f06c5dcd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c00744b0 con 0x7f06c0107030 2023-09-13T09:31:42.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.343+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:42.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.343+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59210/0 (socket says 172.21.15.6:59210) 2023-09-13T09:31:42.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.343+0000 7f06bf7fe700 1 -- 172.21.15.6:0/1954114609 learned_addr learned my addr 172.21.15.6:0/1954114609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:42.075 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06bf7fe700 1 -- 172.21.15.6:0/1954114609 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0109960 con 0x7f06c0107030 2023-09-13T09:31:42.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06bf7fe700 1 --2- 172.21.15.6:0/1954114609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0109420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06b00098a0 tx=0x7f06b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfd550e05c0fb87b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:42.076 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06be7fc700 1 -- 172.21.15.6:0/1954114609 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06b0004160 con 0x7f06c0107030 2023-09-13T09:31:42.080 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06be7fc700 1 -- 172.21.15.6:0/1954114609 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06b00042c0 con 0x7f06c0107030 2023-09-13T09:31:42.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06be7fc700 1 -- 172.21.15.6:0/1954114609 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06b0011a00 con 0x7f06c0107030 2023-09-13T09:31:42.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06c5dcd700 1 -- 172.21.15.6:0/1954114609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 msgr2=0x7f06c0109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:42.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06c5dcd700 1 --2- 172.21.15.6:0/1954114609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0109420 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f06b00098a0 tx=0x7f06b0009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:42.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06c5dcd700 1 -- 172.21.15.6:0/1954114609 shutdown_connections 2023-09-13T09:31:42.081 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.344+0000 7f06c5dcd700 1 --2- 172.21.15.6:0/1954114609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0109420 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:42.082 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.345+0000 7f06c5dcd700 1 -- 172.21.15.6:0/1954114609 >> 172.21.15.6:0/1954114609 conn(0x7f06c0100aa0 msgr2=0x7f06c0102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:42.082 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.345+0000 7f06c5dcd700 1 -- 172.21.15.6:0/1954114609 shutdown_connections 2023-09-13T09:31:42.082 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.345+0000 7f06c5dcd700 1 -- 172.21.15.6:0/1954114609 wait complete. 2023-09-13T09:31:42.082 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.345+0000 7f06c5dcd700 1 Processor -- start 2023-09-13T09:31:42.082 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.345+0000 7f06c5dcd700 1 -- start start 2023-09-13T09:31:42.083 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06c5dcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0106990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:42.083 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06c5dcd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c0106ed0 con 0x7f06c0107030 2023-09-13T09:31:42.083 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0106990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:42.083 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0106990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59212/0 (socket says 172.21.15.6:59212) 2023-09-13T09:31:42.083 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bf7fe700 1 -- 172.21.15.6:0/2637659114 learned_addr learned my addr 172.21.15.6:0/2637659114 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:42.084 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bf7fe700 1 -- 172.21.15.6:0/2637659114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b0009550 con 0x7f06c0107030 2023-09-13T09:31:42.084 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bf7fe700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0106990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009fb0 tx=0x7f06b0011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:42.084 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bcff9700 1 -- 172.21.15.6:0/2637659114 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06b0003930 con 0x7f06c0107030 2023-09-13T09:31:42.084 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bcff9700 1 -- 172.21.15.6:0/2637659114 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f06b0003a90 con 0x7f06c0107030 2023-09-13T09:31:42.084 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06bcff9700 1 -- 172.21.15.6:0/2637659114 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06b0019610 con 0x7f06c0107030 2023-09-13T09:31:42.085 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c0104fe0 con 0x7f06c0107030 2023-09-13T09:31:42.085 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.346+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c0105400 con 0x7f06c0107030 2023-09-13T09:31:42.085 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.347+0000 7f06bcff9700 1 -- 172.21.15.6:0/2637659114 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 7) v1 ==== 45225+0+0 (secure 0 0 0) 0x7f06b001a9d0 con 0x7f06c0107030 2023-09-13T09:31:42.085 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.348+0000 7f06bcff9700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f06a8038240 0x7f06a803a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:42.085 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.348+0000 7f06bcff9700 1 -- 172.21.15.6:0/2637659114 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f06b004c1c0 con 0x7f06c0107030 2023-09-13T09:31:42.086 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.348+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c010a700 con 0x7f06c0107030 2023-09-13T09:31:42.086 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.348+0000 7f06beffd700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f06a8038240 0x7f06a803a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:42.086 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.348+0000 7f06beffd700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f06a8038240 0x7f06a803a700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f06b4006fd0 tx=0x7f06b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:42.086 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.353+0000 7f06bcff9700 1 -- 172.21.15.6:0/2637659114 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f06b0019880 con 0x7f06c0107030 2023-09-13T09:31:42.086 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.745+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f06c0105b20 con 0x7f06a8038240 2023-09-13T09:31:42.087 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.753+0000 7f06bcff9700 1 -- 172.21.15.6:0/2637659114 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f06c0105b20 con 0x7f06a8038240 2023-09-13T09:31:42.087 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f06a8038240 msgr2=0x7f06a803a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:42.087 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f06a8038240 0x7f06a803a700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f06b4006fd0 tx=0x7f06b4006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:42.087 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 msgr2=0x7f06c0106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:42.087 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0106990 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f06b0009fb0 tx=0x7f06b0011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:42.087 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 shutdown_connections 2023-09-13T09:31:42.088 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f06a8038240 0x7f06a803a700 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:42.088 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 --2- 172.21.15.6:0/2637659114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06c0107030 0x7f06c0106990 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:42.088 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 >> 172.21.15.6:0/2637659114 conn(0x7f06c0100aa0 msgr2=0x7f06c0102180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:42.088 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 shutdown_connections 2023-09-13T09:31:42.088 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:41.756+0000 7f06c5dcd700 1 -- 172.21.15.6:0/2637659114 wait complete. 2023-09-13T09:31:43.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:42 smithi006 ceph-mon[98665]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:31:43.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:42 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:43.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:42 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:31:43.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:42 smithi006 ceph-mon[98665]: mgrmap e8: x(active, since 2s) 2023-09-13T09:31:43.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout value unchanged 2023-09-13T09:31:43.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.562+0000 7f45159c5700 1 Processor -- start 2023-09-13T09:31:43.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.562+0000 7f45159c5700 1 -- start start 2023-09-13T09:31:43.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.562+0000 7f45159c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f4510104c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:43.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.562+0000 7f45159c5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510105260 con 0x7f4510104870 2023-09-13T09:31:43.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.562+0000 7f450effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f4510104c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:43.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.562+0000 7f450effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f4510104c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59216/0 (socket says 172.21.15.6:59216) 2023-09-13T09:31:43.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.562+0000 7f450effd700 1 -- 172.21.15.6:0/930149302 learned_addr learned my addr 172.21.15.6:0/930149302 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:43.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.563+0000 7f450effd700 1 -- 172.21.15.6:0/930149302 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4510107800 con 0x7f4510104870 2023-09-13T09:31:43.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.563+0000 7f450effd700 1 --2- 172.21.15.6:0/930149302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f4510104c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44f80098a0 tx=0x7f44f8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=488e5558ced2461a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:43.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.563+0000 7f450dffb700 1 -- 172.21.15.6:0/930149302 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44f8004160 con 0x7f4510104870 2023-09-13T09:31:43.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.563+0000 7f450dffb700 1 -- 172.21.15.6:0/930149302 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f44f80042c0 con 0x7f4510104870 2023-09-13T09:31:43.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.563+0000 7f450dffb700 1 -- 172.21.15.6:0/930149302 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44f8011a00 con 0x7f4510104870 2023-09-13T09:31:43.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 -- 172.21.15.6:0/930149302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 msgr2=0x7f4510104c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:43.530 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 --2- 172.21.15.6:0/930149302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f4510104c90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f44f80098a0 tx=0x7f44f8009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:43.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 -- 172.21.15.6:0/930149302 shutdown_connections 2023-09-13T09:31:43.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 --2- 172.21.15.6:0/930149302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f4510104c90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:43.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 -- 172.21.15.6:0/930149302 >> 172.21.15.6:0/930149302 conn(0x7f4510100220 msgr2=0x7f4510102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:43.531 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 -- 172.21.15.6:0/930149302 shutdown_connections 2023-09-13T09:31:43.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 -- 172.21.15.6:0/930149302 wait complete. 2023-09-13T09:31:43.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.564+0000 7f45159c5700 1 Processor -- start 2023-09-13T09:31:43.532 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f45159c5700 1 -- start start 2023-09-13T09:31:43.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f45159c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f451019a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:43.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f45159c5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f451019a7d0 con 0x7f4510104870 2023-09-13T09:31:43.533 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f450effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f451019a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:43.534 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f450effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f451019a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59218/0 (socket says 172.21.15.6:59218) 2023-09-13T09:31:43.534 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f450effd700 1 -- 172.21.15.6:0/2682569257 learned_addr learned my addr 172.21.15.6:0/2682569257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:43.534 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f450effd700 1 -- 172.21.15.6:0/2682569257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8009550 con 0x7f4510104870 2023-09-13T09:31:43.534 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f450effd700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f451019a290 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009fb0 tx=0x7f44f8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:43.535 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f45149c3700 1 -- 172.21.15.6:0/2682569257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44f8003930 con 0x7f4510104870 2023-09-13T09:31:43.535 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451019a9d0 con 0x7f4510104870 2023-09-13T09:31:43.535 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.565+0000 7f45149c3700 1 -- 172.21.15.6:0/2682569257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f44f8003a90 con 0x7f4510104870 2023-09-13T09:31:43.535 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.566+0000 7f45149c3700 1 -- 172.21.15.6:0/2682569257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44f80195e0 con 0x7f4510104870 2023-09-13T09:31:43.536 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.566+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451019adf0 con 0x7f4510104870 2023-09-13T09:31:43.536 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.566+0000 7f45149c3700 1 -- 172.21.15.6:0/2682569257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f44f80198e0 con 0x7f4510104870 2023-09-13T09:31:43.536 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.566+0000 7f45149c3700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f44fc038310 0x7f44fc03a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:43.536 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.567+0000 7f45149c3700 1 -- 172.21.15.6:0/2682569257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f44f804c3c0 con 0x7f4510104870 2023-09-13T09:31:43.536 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.567+0000 7f450e7fc700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f44fc038310 0x7f44fc03a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:43.537 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.567+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100622e0 con 0x7f4510104870 2023-09-13T09:31:43.537 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.567+0000 7f450e7fc700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f44fc038310 0x7f44fc03a7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4500006fd0 tx=0x7f4500006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:43.537 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.572+0000 7f45149c3700 1 -- 172.21.15.6:0/2682569257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f44f8019be0 con 0x7f4510104870 2023-09-13T09:31:43.537 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.940+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f4510102520 con 0x7f44fc038310 2023-09-13T09:31:43.538 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.940+0000 7f45149c3700 1 -- 172.21.15.6:0/2682569257 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f4510102520 con 0x7f44fc038310 2023-09-13T09:31:43.538 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f44fc038310 msgr2=0x7f44fc03a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:43.538 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f44fc038310 0x7f44fc03a7d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4500006fd0 tx=0x7f4500006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:43.539 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 msgr2=0x7f451019a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:43.539 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f451019a290 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009fb0 tx=0x7f44f8011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:43.539 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 shutdown_connections 2023-09-13T09:31:43.540 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f44fc038310 0x7f44fc03a7d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:43.540 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 --2- 172.21.15.6:0/2682569257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4510104870 0x7f451019a290 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:43.540 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 >> 172.21.15.6:0/2682569257 conn(0x7f4510100220 msgr2=0x7f45101018c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:43.540 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 shutdown_connections 2023-09-13T09:31:43.541 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:42.943+0000 7f45159c5700 1 -- 172.21.15.6:0/2682569257 wait complete. 2023-09-13T09:31:43.541 INFO:teuthology.orchestra.run.smithi006.stdout:Generating ssh key... 2023-09-13T09:31:44.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:43 smithi006 ceph-mon[98665]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:31:45.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83cda04700 1 Processor -- start 2023-09-13T09:31:45.171 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83cda04700 1 -- start start 2023-09-13T09:31:45.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83cda04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8105720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:45.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83cda04700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c8105cf0 con 0x7f83c8105300 2023-09-13T09:31:45.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8105720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:45.172 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8105720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59222/0 (socket says 172.21.15.6:59222) 2023-09-13T09:31:45.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83c6ffd700 1 -- 172.21.15.6:0/191899409 learned_addr learned my addr 172.21.15.6:0/191899409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:45.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83c6ffd700 1 -- 172.21.15.6:0/191899409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83c8106500 con 0x7f83c8105300 2023-09-13T09:31:45.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.024+0000 7f83c6ffd700 1 --2- 172.21.15.6:0/191899409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8105720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00bb40 tx=0x7f83bc00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ab5fa48d7b01e57 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:45.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83c5ffb700 1 -- 172.21.15.6:0/191899409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83bc00dbe0 con 0x7f83c8105300 2023-09-13T09:31:45.173 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83c5ffb700 1 -- 172.21.15.6:0/191899409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83bc0044d0 con 0x7f83c8105300 2023-09-13T09:31:45.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83c5ffb700 1 -- 172.21.15.6:0/191899409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83bc010470 con 0x7f83c8105300 2023-09-13T09:31:45.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83cda04700 1 -- 172.21.15.6:0/191899409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 msgr2=0x7f83c8105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:45.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83cda04700 1 --2- 172.21.15.6:0/191899409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8105720 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f83bc00bb40 tx=0x7f83bc00be50 comp rx=0 tx=0).stop 2023-09-13T09:31:45.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83cda04700 1 -- 172.21.15.6:0/191899409 shutdown_connections 2023-09-13T09:31:45.174 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83cda04700 1 --2- 172.21.15.6:0/191899409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8105720 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:45.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83cda04700 1 -- 172.21.15.6:0/191899409 >> 172.21.15.6:0/191899409 conn(0x7f83c81008c0 msgr2=0x7f83c8102ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:45.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83cda04700 1 -- 172.21.15.6:0/191899409 shutdown_connections 2023-09-13T09:31:45.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.025+0000 7f83cda04700 1 -- 172.21.15.6:0/191899409 wait complete. 2023-09-13T09:31:45.175 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.026+0000 7f83cda04700 1 Processor -- start 2023-09-13T09:31:45.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.026+0000 7f83cda04700 1 -- start start 2023-09-13T09:31:45.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.026+0000 7f83cda04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:45.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.026+0000 7f83cda04700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83c81984a0 con 0x7f83c8105300 2023-09-13T09:31:45.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.026+0000 7f83c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:45.176 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.026+0000 7f83c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59224/0 (socket says 172.21.15.6:59224) 2023-09-13T09:31:45.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.026+0000 7f83c6ffd700 1 -- 172.21.15.6:0/2122690629 learned_addr learned my addr 172.21.15.6:0/2122690629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:45.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.027+0000 7f83c6ffd700 1 -- 172.21.15.6:0/2122690629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83bc00b7f0 con 0x7f83c8105300 2023-09-13T09:31:45.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.027+0000 7f83c6ffd700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8197f60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f83bc003b20 tx=0x7f83bc003980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:45.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.027+0000 7f83cca02700 1 -- 172.21.15.6:0/2122690629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83bc01e070 con 0x7f83c8105300 2023-09-13T09:31:45.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.027+0000 7f83cca02700 1 -- 172.21.15.6:0/2122690629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f83bc004300 con 0x7f83c8105300 2023-09-13T09:31:45.177 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.027+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83c81986a0 con 0x7f83c8105300 2023-09-13T09:31:45.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.027+0000 7f83cca02700 1 -- 172.21.15.6:0/2122690629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f83bc022a50 con 0x7f83c8105300 2023-09-13T09:31:45.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.027+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83c8198ac0 con 0x7f83c8105300 2023-09-13T09:31:45.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.028+0000 7f83cca02700 1 -- 172.21.15.6:0/2122690629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f83bc02c440 con 0x7f83c8105300 2023-09-13T09:31:45.178 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.028+0000 7f83cca02700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f83b00383b0 0x7f83b003a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:45.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.028+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83c8191b90 con 0x7f83c8105300 2023-09-13T09:31:45.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.028+0000 7f83cca02700 1 -- 172.21.15.6:0/2122690629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f83bc04e8d0 con 0x7f83c8105300 2023-09-13T09:31:45.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.028+0000 7f83c67fc700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f83b00383b0 0x7f83b003a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:45.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.029+0000 7f83c67fc700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f83b00383b0 0x7f83b003a870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006fd0 tx=0x7f83b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:45.179 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.033+0000 7f83cca02700 1 -- 172.21.15.6:0/2122690629 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f83bc027030 con 0x7f83c8105300 2023-09-13T09:31:45.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.397+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f83c802ce80 con 0x7f83b00383b0 2023-09-13T09:31:45.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.800+0000 7f83cca02700 1 -- 172.21.15.6:0/2122690629 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f83c802ce80 con 0x7f83b00383b0 2023-09-13T09:31:45.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f83b00383b0 msgr2=0x7f83b003a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:45.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f83b00383b0 0x7f83b003a870 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f83b8006fd0 tx=0x7f83b8006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:45.180 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 msgr2=0x7f83c8197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:45.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8197f60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f83bc003b20 tx=0x7f83bc003980 comp rx=0 tx=0).stop 2023-09-13T09:31:45.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 shutdown_connections 2023-09-13T09:31:45.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f83b00383b0 0x7f83b003a870 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:45.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 --2- 172.21.15.6:0/2122690629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83c8105300 0x7f83c8197f60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:45.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.802+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 >> 172.21.15.6:0/2122690629 conn(0x7f83c81008c0 msgr2=0x7f83c818ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:45.181 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.803+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 shutdown_connections 2023-09-13T09:31:45.182 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:44.803+0000 7f83cda04700 1 -- 172.21.15.6:0/2122690629 wait complete. 2023-09-13T09:31:45.198 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: Generating public/private rsa key pair. 2023-09-13T09:31:45.198 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: Your identification has been saved in /tmp/tmpap1ua0i6/key. 2023-09-13T09:31:45.198 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: Your public key has been saved in /tmp/tmpap1ua0i6/key.pub. 2023-09-13T09:31:45.199 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: The key fingerprint is: 2023-09-13T09:31:45.199 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: SHA256:md23pW9FZvL67nO30TsDHF9sea5pFRO5Bpr9MaNJrGY ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:45.199 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: The key's randomart image is: 2023-09-13T09:31:45.199 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: +---[RSA 3072]----+ 2023-09-13T09:31:45.200 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | .| 2023-09-13T09:31:45.200 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | . o | 2023-09-13T09:31:45.200 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | = ..+| 2023-09-13T09:31:45.200 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | + + =.XO| 2023-09-13T09:31:45.200 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | S . = OOX| 2023-09-13T09:31:45.201 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | E * **| 2023-09-13T09:31:45.201 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | o +*o| 2023-09-13T09:31:45.201 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | ==*| 2023-09-13T09:31:45.201 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: | . B%| 2023-09-13T09:31:45.201 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: +----[SHA256]-----+ 2023-09-13T09:31:46.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:45 smithi006 ceph-mon[98665]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:31:46.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:45 smithi006 ceph-mon[98665]: Generating ssh key... 2023-09-13T09:31:46.052 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:45 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:46.053 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:45 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:46.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmfiV6K8Dk0C7tV48JFm6mZVNTcnxZhFZZVdOyFtliIFV1ajIs/068jczU1uVhmXMTcrWC4SiBTQcJtWwbav2/Krun2y8JMwczRfj8Wd1JmcfGYRT0VfPB9T0c+NCflpxOrFp/QWBDf7EF58sos9e8//xLNSvXctJoKWCH5jJrc+/fCGeJIUaUxll2ug8ppw+OEvajS0pE0jlBokd+BpHg9O4BMm04f/7utzKy/l66SsYQQI6cgyth/Dply3IBufaLikbDbZ7ZuO8F8NfSZ3HIthIuARzt/S3w/IIsv4UsvD+sHFyAXI3h8t9xTibyrXDv94lDr7cRHo8jdQ7RGA+rEq1Myp2wwvX+p5ZsMy15rZfjvQ2wFpJxA2aIOykk9Z1VQ2bf/7H9eb115bf20xRmlo4o7i3KuxlIzW7hT0QhnbzNd7jk8elE9ATwEkgpm+ROST0IgmwUzQncbSBqf/Gaf9pBgDrGKK2/sb2jF4df2YmjDgws7J6V7K2e5a+7xR0= ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:31:46.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.643+0000 7f395e57a700 1 Processor -- start 2023-09-13T09:31:46.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.643+0000 7f395e57a700 1 -- start start 2023-09-13T09:31:46.418 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f395e57a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f39581093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:46.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f395e57a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39580744f0 con 0x7f3958106ff0 2023-09-13T09:31:46.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f3957fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f39581093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:46.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f3957fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f39581093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59228/0 (socket says 172.21.15.6:59228) 2023-09-13T09:31:46.419 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f3957fff700 1 -- 172.21.15.6:0/2118876235 learned_addr learned my addr 172.21.15.6:0/2118876235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:46.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f3957fff700 1 -- 172.21.15.6:0/2118876235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3958109920 con 0x7f3958106ff0 2023-09-13T09:31:46.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f3957fff700 1 --2- 172.21.15.6:0/2118876235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f39581093e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39480098a0 tx=0x7f3948009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ee87cdc8747047 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:46.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f3956ffd700 1 -- 172.21.15.6:0/2118876235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3948004160 con 0x7f3958106ff0 2023-09-13T09:31:46.420 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.644+0000 7f3956ffd700 1 -- 172.21.15.6:0/2118876235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f39480042c0 con 0x7f3958106ff0 2023-09-13T09:31:46.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f3956ffd700 1 -- 172.21.15.6:0/2118876235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3948011a00 con 0x7f3958106ff0 2023-09-13T09:31:46.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f395e57a700 1 -- 172.21.15.6:0/2118876235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 msgr2=0x7f39581093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:46.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f395e57a700 1 --2- 172.21.15.6:0/2118876235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f39581093e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f39480098a0 tx=0x7f3948009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:46.421 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f395e57a700 1 -- 172.21.15.6:0/2118876235 shutdown_connections 2023-09-13T09:31:46.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f395e57a700 1 --2- 172.21.15.6:0/2118876235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f39581093e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:46.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f395e57a700 1 -- 172.21.15.6:0/2118876235 >> 172.21.15.6:0/2118876235 conn(0x7f3958100aa0 msgr2=0x7f3958102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:46.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f395e57a700 1 -- 172.21.15.6:0/2118876235 shutdown_connections 2023-09-13T09:31:46.422 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.645+0000 7f395e57a700 1 -- 172.21.15.6:0/2118876235 wait complete. 2023-09-13T09:31:46.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.646+0000 7f395e57a700 1 Processor -- start 2023-09-13T09:31:46.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.646+0000 7f395e57a700 1 -- start start 2023-09-13T09:31:46.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.646+0000 7f395e57a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f395819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:46.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.646+0000 7f395e57a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f395819a790 con 0x7f3958106ff0 2023-09-13T09:31:46.423 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.646+0000 7f3957fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f395819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:46.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.646+0000 7f3957fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f395819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59230/0 (socket says 172.21.15.6:59230) 2023-09-13T09:31:46.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.646+0000 7f3957fff700 1 -- 172.21.15.6:0/3661335095 learned_addr learned my addr 172.21.15.6:0/3661335095 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:46.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.647+0000 7f3957fff700 1 -- 172.21.15.6:0/3661335095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3948009550 con 0x7f3958106ff0 2023-09-13T09:31:46.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.647+0000 7f3957fff700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f395819a250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3948006af0 tx=0x7f3948011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:46.424 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.647+0000 7f39557fa700 1 -- 172.21.15.6:0/3661335095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3948003a40 con 0x7f3958106ff0 2023-09-13T09:31:46.425 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.647+0000 7f39557fa700 1 -- 172.21.15.6:0/3661335095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3948003ba0 con 0x7f3958106ff0 2023-09-13T09:31:46.425 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.647+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f395819a990 con 0x7f3958106ff0 2023-09-13T09:31:46.425 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.647+0000 7f39557fa700 1 -- 172.21.15.6:0/3661335095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f394801a6e0 con 0x7f3958106ff0 2023-09-13T09:31:46.426 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.647+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f395819adb0 con 0x7f3958106ff0 2023-09-13T09:31:46.426 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.648+0000 7f39557fa700 1 -- 172.21.15.6:0/3661335095 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f394801a950 con 0x7f3958106ff0 2023-09-13T09:31:46.427 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.648+0000 7f39557fa700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f3940038360 0x7f394003a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:46.427 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.648+0000 7f39557fa700 1 -- 172.21.15.6:0/3661335095 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f394804c580 con 0x7f3958106ff0 2023-09-13T09:31:46.427 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.648+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39580622e0 con 0x7f3958106ff0 2023-09-13T09:31:46.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.648+0000 7f39577fe700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f3940038360 0x7f394003a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:46.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.649+0000 7f39577fe700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f3940038360 0x7f394003a820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f394c006fd0 tx=0x7f394c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:46.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:45.653+0000 7f39557fa700 1 -- 172.21.15.6:0/3661335095 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f394801ac00 con 0x7f3958106ff0 2023-09-13T09:31:46.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.019+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f3958102d60 con 0x7f3940038360 2023-09-13T09:31:46.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.019+0000 7f39557fa700 1 -- 172.21.15.6:0/3661335095 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f3958102d60 con 0x7f3940038360 2023-09-13T09:31:46.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f3940038360 msgr2=0x7f394003a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:46.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f3940038360 0x7f394003a820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f394c006fd0 tx=0x7f394c006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:46.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 msgr2=0x7f395819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:46.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f395819a250 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3948006af0 tx=0x7f3948011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:46.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 shutdown_connections 2023-09-13T09:31:46.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f3940038360 0x7f394003a820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:46.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 --2- 172.21.15.6:0/3661335095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3958106ff0 0x7f395819a250 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:46.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 >> 172.21.15.6:0/3661335095 conn(0x7f3958100aa0 msgr2=0x7f3958102140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:46.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 shutdown_connections 2023-09-13T09:31:46.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.022+0000 7f395e57a700 1 -- 172.21.15.6:0/3661335095 wait complete. 2023-09-13T09:31:46.433 INFO:teuthology.orchestra.run.smithi006.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-09-13T09:31:46.433 INFO:teuthology.orchestra.run.smithi006.stdout:Adding key to root@localhost authorized_keys... 2023-09-13T09:31:46.433 INFO:teuthology.orchestra.run.smithi006.stdout:Adding host smithi006... 2023-09-13T09:31:47.538 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:47 smithi006 ceph-mon[98665]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:31:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:48 smithi006 ceph-mon[98665]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:31:49.524 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:49 smithi006 ceph-mon[98665]: Deploying cephadm binary to smithi006 2023-09-13T09:31:50.569 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Added host 'smithi006' with addr '172.21.15.6' 2023-09-13T09:31:50.569 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.904+0000 7f9ad889c700 1 Processor -- start 2023-09-13T09:31:50.569 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.904+0000 7f9ad889c700 1 -- start start 2023-09-13T09:31:50.570 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad889c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad41069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:50.570 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad889c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad4106f70 con 0x7f9ad4106580 2023-09-13T09:31:50.570 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad41069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:50.570 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad41069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59234/0 (socket says 172.21.15.6:59234) 2023-09-13T09:31:50.570 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad259c700 1 -- 172.21.15.6:0/3568339344 learned_addr learned my addr 172.21.15.6:0/3568339344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:50.571 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad259c700 1 -- 172.21.15.6:0/3568339344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ad4107780 con 0x7f9ad4106580 2023-09-13T09:31:50.571 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad259c700 1 --2- 172.21.15.6:0/3568339344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad41069a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098a0 tx=0x7f9ac8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67385fd92f5971d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:50.571 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad159a700 1 -- 172.21.15.6:0/3568339344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac8004160 con 0x7f9ad4106580 2023-09-13T09:31:50.571 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad159a700 1 -- 172.21.15.6:0/3568339344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ac80042c0 con 0x7f9ad4106580 2023-09-13T09:31:50.571 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.905+0000 7f9ad159a700 1 -- 172.21.15.6:0/3568339344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac8011a00 con 0x7f9ad4106580 2023-09-13T09:31:50.572 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.906+0000 7f9ad889c700 1 -- 172.21.15.6:0/3568339344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 msgr2=0x7f9ad41069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:50.572 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.906+0000 7f9ad889c700 1 --2- 172.21.15.6:0/3568339344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad41069a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f9ac80098a0 tx=0x7f9ac8009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:50.572 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.906+0000 7f9ad889c700 1 -- 172.21.15.6:0/3568339344 shutdown_connections 2023-09-13T09:31:50.572 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.906+0000 7f9ad889c700 1 --2- 172.21.15.6:0/3568339344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad41069a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:50.572 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.906+0000 7f9ad889c700 1 -- 172.21.15.6:0/3568339344 >> 172.21.15.6:0/3568339344 conn(0x7f9ad4101ba0 msgr2=0x7f9ad4103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:50.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.906+0000 7f9ad889c700 1 -- 172.21.15.6:0/3568339344 shutdown_connections 2023-09-13T09:31:50.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.906+0000 7f9ad889c700 1 -- 172.21.15.6:0/3568339344 wait complete. 2023-09-13T09:31:50.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.907+0000 7f9ad889c700 1 Processor -- start 2023-09-13T09:31:50.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.907+0000 7f9ad889c700 1 -- start start 2023-09-13T09:31:50.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad889c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad419a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:50.573 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad889c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ad419a820 con 0x7f9ad4106580 2023-09-13T09:31:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad419a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad419a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59236/0 (socket says 172.21.15.6:59236) 2023-09-13T09:31:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad259c700 1 -- 172.21.15.6:0/1551903786 learned_addr learned my addr 172.21.15.6:0/1551903786 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad259c700 1 -- 172.21.15.6:0/1551903786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8009550 con 0x7f9ad4106580 2023-09-13T09:31:50.574 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad259c700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad419a2e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009fb0 tx=0x7f9ac8011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:50.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ac37fe700 1 -- 172.21.15.6:0/1551903786 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac8003930 con 0x7f9ad4106580 2023-09-13T09:31:50.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ac37fe700 1 -- 172.21.15.6:0/1551903786 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ac8003a90 con 0x7f9ad4106580 2023-09-13T09:31:50.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ad419aa20 con 0x7f9ad4106580 2023-09-13T09:31:50.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ac37fe700 1 -- 172.21.15.6:0/1551903786 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ac80195e0 con 0x7f9ad4106580 2023-09-13T09:31:50.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.908+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ad419ae40 con 0x7f9ad4106580 2023-09-13T09:31:50.575 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.909+0000 7f9ac37fe700 1 -- 172.21.15.6:0/1551903786 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f9ac8019850 con 0x7f9ad4106580 2023-09-13T09:31:50.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.909+0000 7f9ac37fe700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f9abc038360 0x7f9abc03a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:50.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.909+0000 7f9ac37fe700 1 -- 172.21.15.6:0/1551903786 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f9ac804c430 con 0x7f9ad4106580 2023-09-13T09:31:50.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.909+0000 7f9ad1d9b700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f9abc038360 0x7f9abc03a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:50.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.910+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ad40622e0 con 0x7f9ad4106580 2023-09-13T09:31:50.576 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.910+0000 7f9ad1d9b700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f9abc038360 0x7f9abc03a820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006fd0 tx=0x7f9ac4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:50.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:46.915+0000 7f9ac37fe700 1 -- 172.21.15.6:0/1551903786 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9ac8019b50 con 0x7f9ad4106580 2023-09-13T09:31:50.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:47.285+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ad4103f00 con 0x7f9abc038360 2023-09-13T09:31:50.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.133+0000 7f9ac37fe700 1 -- 172.21.15.6:0/1551903786 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f9ad4103f00 con 0x7f9abc038360 2023-09-13T09:31:50.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f9abc038360 msgr2=0x7f9abc03a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:50.577 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f9abc038360 0x7f9abc03a820 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4006fd0 tx=0x7f9ac4006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:50.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 msgr2=0x7f9ad419a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:50.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad419a2e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009fb0 tx=0x7f9ac8011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:50.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 shutdown_connections 2023-09-13T09:31:50.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f9abc038360 0x7f9abc03a820 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:50.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 --2- 172.21.15.6:0/1551903786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ad4106580 0x7f9ad419a2e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:50.578 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 >> 172.21.15.6:0/1551903786 conn(0x7f9ad4101ba0 msgr2=0x7f9ad41032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:50.579 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 shutdown_connections 2023-09-13T09:31:50.579 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:50.136+0000 7f9ad889c700 1 -- 172.21.15.6:0/1551903786 wait complete. 2023-09-13T09:31:50.579 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mon service... 2023-09-13T09:31:51.444 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:51 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:51.444 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:51 smithi006 ceph-mon[98665]: Added host smithi006 2023-09-13T09:31:51.444 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:51 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:31:51.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-09-13T09:31:51.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.012+0000 7f67d02f6700 1 Processor -- start 2023-09-13T09:31:51.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.012+0000 7f67d02f6700 1 -- start start 2023-09-13T09:31:51.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.012+0000 7f67d02f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c8109480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:51.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.012+0000 7f67d02f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c8079e80 con 0x7f67c8107090 2023-09-13T09:31:51.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.012+0000 7f67ce092700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c8109480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:51.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.012+0000 7f67ce092700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c8109480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59270/0 (socket says 172.21.15.6:59270) 2023-09-13T09:31:51.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.012+0000 7f67ce092700 1 -- 172.21.15.6:0/2267514276 learned_addr learned my addr 172.21.15.6:0/2267514276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:51.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.013+0000 7f67ce092700 1 -- 172.21.15.6:0/2267514276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c81099c0 con 0x7f67c8107090 2023-09-13T09:31:51.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.013+0000 7f67ce092700 1 --2- 172.21.15.6:0/2267514276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c8109480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67c40098a0 tx=0x7f67c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=318b6368a629ebd3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:51.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.013+0000 7f67cd090700 1 -- 172.21.15.6:0/2267514276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67c4004160 con 0x7f67c8107090 2023-09-13T09:31:51.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.013+0000 7f67cd090700 1 -- 172.21.15.6:0/2267514276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f67c40042c0 con 0x7f67c8107090 2023-09-13T09:31:51.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.013+0000 7f67cd090700 1 -- 172.21.15.6:0/2267514276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67c4011a00 con 0x7f67c8107090 2023-09-13T09:31:51.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 -- 172.21.15.6:0/2267514276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 msgr2=0x7f67c8109480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:51.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 --2- 172.21.15.6:0/2267514276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c8109480 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f67c40098a0 tx=0x7f67c4009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:51.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 -- 172.21.15.6:0/2267514276 shutdown_connections 2023-09-13T09:31:51.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 --2- 172.21.15.6:0/2267514276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c8109480 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:51.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 -- 172.21.15.6:0/2267514276 >> 172.21.15.6:0/2267514276 conn(0x7f67c8100b00 msgr2=0x7f67c8102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:51.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 -- 172.21.15.6:0/2267514276 shutdown_connections 2023-09-13T09:31:51.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 -- 172.21.15.6:0/2267514276 wait complete. 2023-09-13T09:31:51.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.014+0000 7f67d02f6700 1 Processor -- start 2023-09-13T09:31:51.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67d02f6700 1 -- start start 2023-09-13T09:31:51.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67d02f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c819a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:51.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67d02f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c819a790 con 0x7f67c8107090 2023-09-13T09:31:51.920 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67ce092700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c819a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:51.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67ce092700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c819a250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59272/0 (socket says 172.21.15.6:59272) 2023-09-13T09:31:51.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67ce092700 1 -- 172.21.15.6:0/1165577419 learned_addr learned my addr 172.21.15.6:0/1165577419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:51.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67ce092700 1 -- 172.21.15.6:0/1165577419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c4009550 con 0x7f67c8107090 2023-09-13T09:31:51.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67ce092700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c819a250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009fb0 tx=0x7f67c4011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:51.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67bf7fe700 1 -- 172.21.15.6:0/1165577419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67c4003930 con 0x7f67c8107090 2023-09-13T09:31:51.921 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67bf7fe700 1 -- 172.21.15.6:0/1165577419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f67c4003a90 con 0x7f67c8107090 2023-09-13T09:31:51.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67bf7fe700 1 -- 172.21.15.6:0/1165577419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f67c4019610 con 0x7f67c8107090 2023-09-13T09:31:51.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c819a990 con 0x7f67c8107090 2023-09-13T09:31:51.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.015+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c819adb0 con 0x7f67c8107090 2023-09-13T09:31:51.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.016+0000 7f67bf7fe700 1 -- 172.21.15.6:0/1165577419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f67c4019880 con 0x7f67c8107090 2023-09-13T09:31:51.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.016+0000 7f67bf7fe700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f67b4038360 0x7f67b403a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:51.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.016+0000 7f67bf7fe700 1 -- 172.21.15.6:0/1165577419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f67c404c590 con 0x7f67c8107090 2023-09-13T09:31:51.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.017+0000 7f67cd891700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f67b4038360 0x7f67b403a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:51.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.017+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c80622e0 con 0x7f67c8107090 2023-09-13T09:31:51.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.017+0000 7f67cd891700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f67b4038360 0x7f67b403a820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67b8006fd0 tx=0x7f67b8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:51.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.022+0000 7f67bf7fe700 1 -- 172.21.15.6:0/1165577419 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f67c4018530 con 0x7f67c8107090 2023-09-13T09:31:51.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.413+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f67c8101fb0 con 0x7f67b4038360 2023-09-13T09:31:51.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.421+0000 7f67bf7fe700 1 -- 172.21.15.6:0/1165577419 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f67c8101fb0 con 0x7f67b4038360 2023-09-13T09:31:51.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f67b4038360 msgr2=0x7f67b403a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:51.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f67b4038360 0x7f67b403a820 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f67b8006fd0 tx=0x7f67b8006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:51.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 msgr2=0x7f67c819a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:51.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c819a250 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f67c4009fb0 tx=0x7f67c4011ad0 comp rx=0 tx=0).stop 2023-09-13T09:31:51.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 shutdown_connections 2023-09-13T09:31:51.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f67b4038360 0x7f67b403a820 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:51.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 --2- 172.21.15.6:0/1165577419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67c8107090 0x7f67c819a250 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:51.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 >> 172.21.15.6:0/1165577419 conn(0x7f67c8100b00 msgr2=0x7f67c81018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:51.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 shutdown_connections 2023-09-13T09:31:51.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:51.423+0000 7f67d02f6700 1 -- 172.21.15.6:0/1165577419 wait complete. 2023-09-13T09:31:51.926 INFO:teuthology.orchestra.run.smithi006.stdout:Deploying unmanaged mgr service... 2023-09-13T09:31:52.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:52 smithi006 ceph-mon[98665]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:31:52.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:52 smithi006 ceph-mon[98665]: Saving service mon spec with placement count:5 2023-09-13T09:31:52.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:52 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-09-13T09:31:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.821+0000 7f9648bc2700 1 Processor -- start 2023-09-13T09:31:53.663 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.821+0000 7f9648bc2700 1 -- start start 2023-09-13T09:31:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.821+0000 7f9648bc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f9644105020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.821+0000 7f9648bc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96441055f0 con 0x7f9644104c00 2023-09-13T09:31:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f9644105020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f9644105020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59276/0 (socket says 172.21.15.6:59276) 2023-09-13T09:31:53.664 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964259c700 1 -- 172.21.15.6:0/2127491833 learned_addr learned my addr 172.21.15.6:0/2127491833 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:53.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964259c700 1 -- 172.21.15.6:0/2127491833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9644105e00 con 0x7f9644104c00 2023-09-13T09:31:53.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964259c700 1 --2- 172.21.15.6:0/2127491833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f9644105020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96340098a0 tx=0x7f9634009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9199d937d0a2d315 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:53.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964159a700 1 -- 172.21.15.6:0/2127491833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9634004160 con 0x7f9644104c00 2023-09-13T09:31:53.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964159a700 1 -- 172.21.15.6:0/2127491833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96340042c0 con 0x7f9644104c00 2023-09-13T09:31:53.665 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.822+0000 7f964159a700 1 -- 172.21.15.6:0/2127491833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96340119b0 con 0x7f9644104c00 2023-09-13T09:31:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.823+0000 7f9648bc2700 1 -- 172.21.15.6:0/2127491833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 msgr2=0x7f9644105020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.823+0000 7f9648bc2700 1 --2- 172.21.15.6:0/2127491833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f9644105020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f96340098a0 tx=0x7f9634009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.823+0000 7f9648bc2700 1 -- 172.21.15.6:0/2127491833 shutdown_connections 2023-09-13T09:31:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.823+0000 7f9648bc2700 1 --2- 172.21.15.6:0/2127491833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f9644105020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:53.666 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.823+0000 7f9648bc2700 1 -- 172.21.15.6:0/2127491833 >> 172.21.15.6:0/2127491833 conn(0x7f9644100220 msgr2=0x7f9644102640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:53.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.823+0000 7f9648bc2700 1 -- 172.21.15.6:0/2127491833 shutdown_connections 2023-09-13T09:31:53.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.823+0000 7f9648bc2700 1 -- 172.21.15.6:0/2127491833 wait complete. 2023-09-13T09:31:53.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f9648bc2700 1 Processor -- start 2023-09-13T09:31:53.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f9648bc2700 1 -- start start 2023-09-13T09:31:53.667 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f9648bc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f964419a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:53.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f9648bc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964419a830 con 0x7f9644104c00 2023-09-13T09:31:53.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f964259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f964419a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:53.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f964259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f964419a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59278/0 (socket says 172.21.15.6:59278) 2023-09-13T09:31:53.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f964259c700 1 -- 172.21.15.6:0/1303924136 learned_addr learned my addr 172.21.15.6:0/1303924136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:53.668 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.824+0000 7f964259c700 1 -- 172.21.15.6:0/1303924136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9634009550 con 0x7f9644104c00 2023-09-13T09:31:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.825+0000 7f964259c700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f964419a2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9634000c00 tx=0x7f9634011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.825+0000 7f96337fe700 1 -- 172.21.15.6:0/1303924136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f96340039f0 con 0x7f9644104c00 2023-09-13T09:31:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.825+0000 7f96337fe700 1 -- 172.21.15.6:0/1303924136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9634003b50 con 0x7f9644104c00 2023-09-13T09:31:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.825+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f964419aa30 con 0x7f9644104c00 2023-09-13T09:31:53.669 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.825+0000 7f96337fe700 1 -- 172.21.15.6:0/1303924136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f963401a780 con 0x7f9644104c00 2023-09-13T09:31:53.670 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.825+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f964419ae50 con 0x7f9644104c00 2023-09-13T09:31:53.670 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.826+0000 7f96337fe700 1 -- 172.21.15.6:0/1303924136 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f963401aa40 con 0x7f9644104c00 2023-09-13T09:31:53.670 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.826+0000 7f96337fe700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f962c038360 0x7f962c03a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:53.670 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.826+0000 7f96337fe700 1 -- 172.21.15.6:0/1303924136 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f963404c2b0 con 0x7f9644104c00 2023-09-13T09:31:53.670 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.826+0000 7f9641d9b700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f962c038360 0x7f962c03a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:53.671 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.826+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96440622e0 con 0x7f9644104c00 2023-09-13T09:31:53.671 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.827+0000 7f9641d9b700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f962c038360 0x7f962c03a820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9638006fd0 tx=0x7f9638006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:53.671 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:52.831+0000 7f96337fe700 1 -- 172.21.15.6:0/1303924136 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f96340237b0 con 0x7f9644104c00 2023-09-13T09:31:53.671 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.230+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9644101f80 con 0x7f962c038360 2023-09-13T09:31:53.671 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.235+0000 7f96337fe700 1 -- 172.21.15.6:0/1303924136 <== mgr.14120 v2:172.21.15.6:6800/1676430765 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9644101f80 con 0x7f962c038360 2023-09-13T09:31:53.671 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f962c038360 msgr2=0x7f962c03a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:53.672 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f962c038360 0x7f962c03a820 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9638006fd0 tx=0x7f9638006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:53.672 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 msgr2=0x7f964419a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:53.672 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f964419a2f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9634000c00 tx=0x7f9634011a30 comp rx=0 tx=0).stop 2023-09-13T09:31:53.672 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 shutdown_connections 2023-09-13T09:31:53.672 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f962c038360 0x7f962c03a820 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:53.673 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 --2- 172.21.15.6:0/1303924136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9644104c00 0x7f964419a2f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:53.673 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 >> 172.21.15.6:0/1303924136 conn(0x7f9644100220 msgr2=0x7f9644101870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:53.673 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 shutdown_connections 2023-09-13T09:31:53.673 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:53.238+0000 7f9648bc2700 1 -- 172.21.15.6:0/1303924136 wait complete. 2023-09-13T09:31:53.861 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:53 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:53.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:53 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:53.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:53 smithi006 ceph-mon[98665]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:31:53.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:53 smithi006 ceph-mon[98665]: Saving service mgr spec with placement count:2 2023-09-13T09:31:53.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:53 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:54.909 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.149+0000 7f1c5891b700 1 Processor -- start 2023-09-13T09:31:54.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.149+0000 7f1c5891b700 1 -- start start 2023-09-13T09:31:54.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.149+0000 7f1c5891b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c54109420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:54.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.149+0000 7f1c5891b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c540744b0 con 0x7f1c54107030 2023-09-13T09:31:54.910 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.149+0000 7f1c5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c54109420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:54.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.149+0000 7f1c5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c54109420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59282/0 (socket says 172.21.15.6:59282) 2023-09-13T09:31:54.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.149+0000 7f1c5259c700 1 -- 172.21.15.6:0/3664504363 learned_addr learned my addr 172.21.15.6:0/3664504363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:54.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.150+0000 7f1c5259c700 1 -- 172.21.15.6:0/3664504363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c54109960 con 0x7f1c54107030 2023-09-13T09:31:54.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.150+0000 7f1c5259c700 1 --2- 172.21.15.6:0/3664504363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c54109420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098a0 tx=0x7f1c44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=706382f0e8c6e831 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:54.911 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.150+0000 7f1c5159a700 1 -- 172.21.15.6:0/3664504363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c44004160 con 0x7f1c54107030 2023-09-13T09:31:54.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.150+0000 7f1c5159a700 1 -- 172.21.15.6:0/3664504363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c440042c0 con 0x7f1c54107030 2023-09-13T09:31:54.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.150+0000 7f1c5159a700 1 -- 172.21.15.6:0/3664504363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c440119b0 con 0x7f1c54107030 2023-09-13T09:31:54.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.151+0000 7f1c5891b700 1 -- 172.21.15.6:0/3664504363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 msgr2=0x7f1c54109420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:54.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.151+0000 7f1c5891b700 1 --2- 172.21.15.6:0/3664504363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c54109420 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098a0 tx=0x7f1c44009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:54.912 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.151+0000 7f1c5891b700 1 -- 172.21.15.6:0/3664504363 shutdown_connections 2023-09-13T09:31:54.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.151+0000 7f1c5891b700 1 --2- 172.21.15.6:0/3664504363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c54109420 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:54.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.151+0000 7f1c5891b700 1 -- 172.21.15.6:0/3664504363 >> 172.21.15.6:0/3664504363 conn(0x7f1c54100aa0 msgr2=0x7f1c54102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:54.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.151+0000 7f1c5891b700 1 -- 172.21.15.6:0/3664504363 shutdown_connections 2023-09-13T09:31:54.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.151+0000 7f1c5891b700 1 -- 172.21.15.6:0/3664504363 wait complete. 2023-09-13T09:31:54.913 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5891b700 1 Processor -- start 2023-09-13T09:31:54.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5891b700 1 -- start start 2023-09-13T09:31:54.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5891b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c5419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:54.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5891b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c5419a7b0 con 0x7f1c54107030 2023-09-13T09:31:54.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c5419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:54.914 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c5419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59284/0 (socket says 172.21.15.6:59284) 2023-09-13T09:31:54.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5259c700 1 -- 172.21.15.6:0/2643510028 learned_addr learned my addr 172.21.15.6:0/2643510028 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:54.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5259c700 1 -- 172.21.15.6:0/2643510028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009550 con 0x7f1c54107030 2023-09-13T09:31:54.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c5259c700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c5419a270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c44003e60 tx=0x7f1c44011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:54.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.152+0000 7f1c437fe700 1 -- 172.21.15.6:0/2643510028 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c44003970 con 0x7f1c54107030 2023-09-13T09:31:54.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.153+0000 7f1c437fe700 1 -- 172.21.15.6:0/2643510028 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c44003ad0 con 0x7f1c54107030 2023-09-13T09:31:54.915 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.153+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c5419a9b0 con 0x7f1c54107030 2023-09-13T09:31:54.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.153+0000 7f1c437fe700 1 -- 172.21.15.6:0/2643510028 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c440195e0 con 0x7f1c54107030 2023-09-13T09:31:54.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.153+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c5419add0 con 0x7f1c54107030 2023-09-13T09:31:54.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.153+0000 7f1c437fe700 1 -- 172.21.15.6:0/2643510028 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f1c440198a0 con 0x7f1c54107030 2023-09-13T09:31:54.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.154+0000 7f1c437fe700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f1c3c038310 0x7f1c3c03a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:54.916 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.154+0000 7f1c437fe700 1 -- 172.21.15.6:0/2643510028 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f1c4404c500 con 0x7f1c54107030 2023-09-13T09:31:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.154+0000 7f1c51d9b700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f1c3c038310 0x7f1c3c03a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.154+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c540622e0 con 0x7f1c54107030 2023-09-13T09:31:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.154+0000 7f1c51d9b700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f1c3c038310 0x7f1c3c03a7d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c48006fd0 tx=0x7f1c48006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.159+0000 7f1c437fe700 1 -- 172.21.15.6:0/2643510028 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1c44019ba0 con 0x7f1c54107030 2023-09-13T09:31:54.917 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.533+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f1c5410a740 con 0x7f1c54107030 2023-09-13T09:31:54.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.536+0000 7f1c437fe700 1 -- 172.21.15.6:0/2643510028 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f1c44018b40 con 0x7f1c54107030 2023-09-13T09:31:54.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f1c3c038310 msgr2=0x7f1c3c03a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:54.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f1c3c038310 0x7f1c3c03a7d0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1c48006fd0 tx=0x7f1c48006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:54.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 msgr2=0x7f1c5419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:54.918 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c5419a270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1c44003e60 tx=0x7f1c44011aa0 comp rx=0 tx=0).stop 2023-09-13T09:31:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 shutdown_connections 2023-09-13T09:31:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f1c3c038310 0x7f1c3c03a7d0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 --2- 172.21.15.6:0/2643510028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c54107030 0x7f1c5419a270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 >> 172.21.15.6:0/2643510028 conn(0x7f1c54100aa0 msgr2=0x7f1c54102180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 shutdown_connections 2023-09-13T09:31:54.919 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:54.539+0000 7f1c5891b700 1 -- 172.21.15.6:0/2643510028 wait complete. 2023-09-13T09:31:55.897 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:55 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2643510028' entity='client.admin' 2023-09-13T09:31:55.897 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:55 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:56.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.484+0000 7ff55c041700 1 Processor -- start 2023-09-13T09:31:56.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.484+0000 7ff55c041700 1 -- start start 2023-09-13T09:31:56.357 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.485+0000 7ff55c041700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff5541058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:56.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.485+0000 7ff55c041700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff554105e70 con 0x7ff554105480 2023-09-13T09:31:56.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.485+0000 7ff559ddd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff5541058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:56.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.485+0000 7ff559ddd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff5541058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59288/0 (socket says 172.21.15.6:59288) 2023-09-13T09:31:56.358 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.485+0000 7ff559ddd700 1 -- 172.21.15.6:0/1323782819 learned_addr learned my addr 172.21.15.6:0/1323782819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:56.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.485+0000 7ff559ddd700 1 -- 172.21.15.6:0/1323782819 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff554106680 con 0x7ff554105480 2023-09-13T09:31:56.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.485+0000 7ff559ddd700 1 --2- 172.21.15.6:0/1323782819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff5541058a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5440098a0 tx=0x7ff544009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=decf40a57600d560 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:56.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff558ddb700 1 -- 172.21.15.6:0/1323782819 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff544004160 con 0x7ff554105480 2023-09-13T09:31:56.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff558ddb700 1 -- 172.21.15.6:0/1323782819 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5440042c0 con 0x7ff554105480 2023-09-13T09:31:56.359 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff558ddb700 1 -- 172.21.15.6:0/1323782819 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5440119b0 con 0x7ff554105480 2023-09-13T09:31:56.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff55c041700 1 -- 172.21.15.6:0/1323782819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 msgr2=0x7ff5541058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:56.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff55c041700 1 --2- 172.21.15.6:0/1323782819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff5541058a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5440098a0 tx=0x7ff544009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:56.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff55c041700 1 -- 172.21.15.6:0/1323782819 shutdown_connections 2023-09-13T09:31:56.360 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff55c041700 1 --2- 172.21.15.6:0/1323782819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff5541058a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:56.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff55c041700 1 -- 172.21.15.6:0/1323782819 >> 172.21.15.6:0/1323782819 conn(0x7ff554100aa0 msgr2=0x7ff554102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:56.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.486+0000 7ff55c041700 1 -- 172.21.15.6:0/1323782819 shutdown_connections 2023-09-13T09:31:56.361 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff55c041700 1 -- 172.21.15.6:0/1323782819 wait complete. 2023-09-13T09:31:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff55c041700 1 Processor -- start 2023-09-13T09:31:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff55c041700 1 -- start start 2023-09-13T09:31:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff55c041700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff554074170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff55c041700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff55419ae40 con 0x7ff554105480 2023-09-13T09:31:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff559ddd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff554074170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:56.362 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff559ddd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff554074170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59290/0 (socket says 172.21.15.6:59290) 2023-09-13T09:31:56.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.487+0000 7ff559ddd700 1 -- 172.21.15.6:0/1527159446 learned_addr learned my addr 172.21.15.6:0/1527159446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:56.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.488+0000 7ff559ddd700 1 -- 172.21.15.6:0/1527159446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff544009550 con 0x7ff554105480 2023-09-13T09:31:56.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.488+0000 7ff559ddd700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff554074170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff544000c00 tx=0x7ff544011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:56.363 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.488+0000 7ff54affd700 1 -- 172.21.15.6:0/1527159446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5440039f0 con 0x7ff554105480 2023-09-13T09:31:56.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.488+0000 7ff54affd700 1 -- 172.21.15.6:0/1527159446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff544003b50 con 0x7ff554105480 2023-09-13T09:31:56.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.488+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff55419f450 con 0x7ff554105480 2023-09-13T09:31:56.364 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.488+0000 7ff54affd700 1 -- 172.21.15.6:0/1527159446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff54401a780 con 0x7ff554105480 2023-09-13T09:31:56.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.488+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff55419f7b0 con 0x7ff554105480 2023-09-13T09:31:56.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.489+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5541098b0 con 0x7ff554105480 2023-09-13T09:31:56.365 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.489+0000 7ff54affd700 1 -- 172.21.15.6:0/1527159446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7ff544024440 con 0x7ff554105480 2023-09-13T09:31:56.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.490+0000 7ff54affd700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7ff540038360 0x7ff54003a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:56.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.490+0000 7ff54affd700 1 -- 172.21.15.6:0/1527159446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff54404c2e0 con 0x7ff554105480 2023-09-13T09:31:56.366 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.490+0000 7ff5595dc700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7ff540038360 0x7ff54003a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:56.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.490+0000 7ff5595dc700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7ff540038360 0x7ff54003a820 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff550006fd0 tx=0x7ff550006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:56.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.494+0000 7ff54affd700 1 -- 172.21.15.6:0/1527159446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff5440246f0 con 0x7ff554105480 2023-09-13T09:31:56.367 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.857+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7ff554109af0 con 0x7ff554105480 2023-09-13T09:31:56.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.863+0000 7ff54affd700 1 -- 172.21.15.6:0/1527159446 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7ff544018350 con 0x7ff554105480 2023-09-13T09:31:56.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7ff540038360 msgr2=0x7ff54003a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:56.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7ff540038360 0x7ff54003a820 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff550006fd0 tx=0x7ff550006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:56.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 msgr2=0x7ff554074170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:56.368 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff554074170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff544000c00 tx=0x7ff544011a30 comp rx=0 tx=0).stop 2023-09-13T09:31:56.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 shutdown_connections 2023-09-13T09:31:56.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7ff540038360 0x7ff54003a820 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:56.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 --2- 172.21.15.6:0/1527159446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff554105480 0x7ff554074170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:56.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 >> 172.21.15.6:0/1527159446 conn(0x7ff554100aa0 msgr2=0x7ff5541021a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:56.369 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 shutdown_connections 2023-09-13T09:31:56.370 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:55.866+0000 7ff55c041700 1 -- 172.21.15.6:0/1527159446 wait complete. 2023-09-13T09:31:56.370 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling the dashboard module... 2023-09-13T09:31:57.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:56 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1527159446' entity='client.admin' 2023-09-13T09:31:57.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:56 smithi006 ceph-mon[98665]: from='mgr.14120 172.21.15.6:0/3990778399' entity='mgr.x' 2023-09-13T09:31:58.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:57 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3819964708' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-09-13T09:31:58.006 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:57 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: ignoring --setuser ceph since I am not root 2023-09-13T09:31:58.007 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:57 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: ignoring --setgroup ceph since I am not root 2023-09-13T09:31:58.280 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:58.073+0000 7fc3de8ba200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T09:31:58.280 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:58.170+0000 7fc3de8ba200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T09:31:58.295 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.839+0000 7f50f842b700 1 Processor -- start 2023-09-13T09:31:58.301 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.839+0000 7f50f842b700 1 -- start start 2023-09-13T09:31:58.301 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f842b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f0105240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:58.301 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f842b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00744b0 con 0x7f50f0104e20 2023-09-13T09:31:58.302 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f61c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f0105240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:58.302 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f61c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f0105240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59294/0 (socket says 172.21.15.6:59294) 2023-09-13T09:31:58.302 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f61c7700 1 -- 172.21.15.6:0/889303402 learned_addr learned my addr 172.21.15.6:0/889303402 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:58.302 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f61c7700 1 -- 172.21.15.6:0/889303402 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f0105780 con 0x7f50f0104e20 2023-09-13T09:31:58.302 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f61c7700 1 --2- 172.21.15.6:0/889303402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f0105240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0098a0 tx=0x7f50ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ad72aa67d42fd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:58.303 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.840+0000 7f50f51c5700 1 -- 172.21.15.6:0/889303402 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50ec004160 con 0x7f50f0104e20 2023-09-13T09:31:58.303 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.841+0000 7f50f51c5700 1 -- 172.21.15.6:0/889303402 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50ec0042c0 con 0x7f50f0104e20 2023-09-13T09:31:58.303 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.841+0000 7f50f51c5700 1 -- 172.21.15.6:0/889303402 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50ec0119b0 con 0x7f50f0104e20 2023-09-13T09:31:58.303 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.841+0000 7f50f842b700 1 -- 172.21.15.6:0/889303402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 msgr2=0x7f50f0105240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:58.305 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.841+0000 7f50f842b700 1 --2- 172.21.15.6:0/889303402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f0105240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f50ec0098a0 tx=0x7f50ec009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:58.305 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.841+0000 7f50f842b700 1 -- 172.21.15.6:0/889303402 shutdown_connections 2023-09-13T09:31:58.305 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.841+0000 7f50f842b700 1 --2- 172.21.15.6:0/889303402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f0105240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:58.305 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.841+0000 7f50f842b700 1 -- 172.21.15.6:0/889303402 >> 172.21.15.6:0/889303402 conn(0x7f50f0100aa0 msgr2=0x7f50f0102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:58.306 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.842+0000 7f50f842b700 1 -- 172.21.15.6:0/889303402 shutdown_connections 2023-09-13T09:31:58.306 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.842+0000 7f50f842b700 1 -- 172.21.15.6:0/889303402 wait complete. 2023-09-13T09:31:58.306 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.842+0000 7f50f842b700 1 Processor -- start 2023-09-13T09:31:58.306 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.842+0000 7f50f842b700 1 -- start start 2023-09-13T09:31:58.306 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f842b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f019c490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:58.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f842b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f019c9d0 con 0x7f50f0104e20 2023-09-13T09:31:58.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f61c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f019c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:58.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f61c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f019c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59296/0 (socket says 172.21.15.6:59296) 2023-09-13T09:31:58.307 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f61c7700 1 -- 172.21.15.6:0/3819964708 learned_addr learned my addr 172.21.15.6:0/3819964708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:58.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f61c7700 1 -- 172.21.15.6:0/3819964708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50ec009550 con 0x7f50f0104e20 2023-09-13T09:31:58.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f61c7700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f019c490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50ec003e60 tx=0x7f50ec011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:58.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50ec003970 con 0x7f50f0104e20 2023-09-13T09:31:58.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50ec003ad0 con 0x7f50f0104e20 2023-09-13T09:31:58.308 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.843+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f019cbd0 con 0x7f50f0104e20 2023-09-13T09:31:58.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.844+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f019cff0 con 0x7f50f0104e20 2023-09-13T09:31:58.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.844+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50ec0195e0 con 0x7f50f0104e20 2023-09-13T09:31:58.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.845+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 45331+0+0 (secure 0 0 0) 0x7f50ec019920 con 0x7f50f0104e20 2023-09-13T09:31:58.309 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.845+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50d4005320 con 0x7f50f0104e20 2023-09-13T09:31:58.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.845+0000 7f50e77fe700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f50dc038360 0x7f50dc03a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:58.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.845+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f50ec04d4d0 con 0x7f50f0104e20 2023-09-13T09:31:58.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.845+0000 7f50f59c6700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f50dc038360 0x7f50dc03a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:58.310 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.846+0000 7f50f59c6700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f50dc038360 0x7f50dc03a820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50e0006fd0 tx=0x7f50e0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:58.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:56.851+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f50ec02b340 con 0x7f50f0104e20 2023-09-13T09:31:58.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.343+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f50d40055d0 con 0x7f50f0104e20 2023-09-13T09:31:58.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.867+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 9) v1 ==== 45344+0+0 (secure 0 0 0) 0x7f50ec02d9b0 con 0x7f50f0104e20 2023-09-13T09:31:58.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.868+0000 7f50e77fe700 1 -- 172.21.15.6:0/3819964708 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f50ec016d80 con 0x7f50f0104e20 2023-09-13T09:31:58.311 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f50dc038360 msgr2=0x7f50dc03a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:58.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f50dc038360 0x7f50dc03a820 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f50e0006fd0 tx=0x7f50e0006e40 comp rx=0 tx=0).stop 2023-09-13T09:31:58.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 msgr2=0x7f50f019c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:58.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f019c490 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f50ec003e60 tx=0x7f50ec011aa0 comp rx=0 tx=0).stop 2023-09-13T09:31:58.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 shutdown_connections 2023-09-13T09:31:58.312 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f50dc038360 0x7f50dc03a820 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:58.313 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 --2- 172.21.15.6:0/3819964708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50f0104e20 0x7f50f019c490 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:58.313 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 >> 172.21.15.6:0/3819964708 conn(0x7f50f0100aa0 msgr2=0x7f50f01909e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:58.313 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 shutdown_connections 2023-09-13T09:31:58.313 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:57.872+0000 7f50f842b700 1 -- 172.21.15.6:0/3819964708 wait complete. 2023-09-13T09:31:58.556 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:58.280+0000 7fc3de8ba200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T09:31:58.557 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:58.405+0000 7fc3de8ba200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T09:31:58.866 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:58.619+0000 7fc3de8ba200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T09:31:59.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:59 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:59.102+0000 7fc3de8ba200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T09:31:59.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:58 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3819964708' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-09-13T09:31:59.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:58 smithi006 ceph-mon[98665]: mgrmap e9: x(active, since 18s) 2023-09-13T09:31:59.755 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:59 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:59.262+0000 7fc3de8ba200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T09:31:59.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:59 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:59.381+0000 7fc3de8ba200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T09:31:59.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:31:59 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:31:59.499+0000 7fc3de8ba200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T09:31:59.851 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:31:59.857 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-09-13T09:31:59.857 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "available": true, 2023-09-13T09:31:59.858 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-09-13T09:31:59.858 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-09-13T09:31:59.858 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:31:59.858 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.787+0000 7f00946e7700 1 Processor -- start 2023-09-13T09:31:59.858 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.787+0000 7f00946e7700 1 -- start start 2023-09-13T09:31:59.859 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.788+0000 7f00946e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c1093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:59.859 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.788+0000 7f00946e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c0744f0 con 0x7f008c106ff0 2023-09-13T09:31:59.859 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.788+0000 7f0092483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c1093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:59.859 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.788+0000 7f0092483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c1093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59310/0 (socket says 172.21.15.6:59310) 2023-09-13T09:31:59.859 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.788+0000 7f0092483700 1 -- 172.21.15.6:0/1338308083 learned_addr learned my addr 172.21.15.6:0/1338308083 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:59.860 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.788+0000 7f0092483700 1 -- 172.21.15.6:0/1338308083 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f008c109920 con 0x7f008c106ff0 2023-09-13T09:31:59.860 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.789+0000 7f0092483700 1 --2- 172.21.15.6:0/1338308083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c1093e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00880098a0 tx=0x7f0088009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f491ef275fa71ef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:59.860 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.789+0000 7f0091481700 1 -- 172.21.15.6:0/1338308083 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0088004160 con 0x7f008c106ff0 2023-09-13T09:31:59.860 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.789+0000 7f0091481700 1 -- 172.21.15.6:0/1338308083 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00880042c0 con 0x7f008c106ff0 2023-09-13T09:31:59.860 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.789+0000 7f0091481700 1 -- 172.21.15.6:0/1338308083 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00880119b0 con 0x7f008c106ff0 2023-09-13T09:31:59.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.789+0000 7f00946e7700 1 -- 172.21.15.6:0/1338308083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 msgr2=0x7f008c1093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:59.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.789+0000 7f00946e7700 1 --2- 172.21.15.6:0/1338308083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c1093e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00880098a0 tx=0x7f0088009bb0 comp rx=0 tx=0).stop 2023-09-13T09:31:59.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 -- 172.21.15.6:0/1338308083 shutdown_connections 2023-09-13T09:31:59.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 --2- 172.21.15.6:0/1338308083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c1093e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:59.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 -- 172.21.15.6:0/1338308083 >> 172.21.15.6:0/1338308083 conn(0x7f008c100aa0 msgr2=0x7f008c102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:59.861 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 -- 172.21.15.6:0/1338308083 shutdown_connections 2023-09-13T09:31:59.862 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 -- 172.21.15.6:0/1338308083 wait complete. 2023-09-13T09:31:59.862 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 Processor -- start 2023-09-13T09:31:59.862 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 -- start start 2023-09-13T09:31:59.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c19a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:59.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.790+0000 7f00946e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f008c19a7b0 con 0x7f008c106ff0 2023-09-13T09:31:59.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f0092483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c19a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:31:59.863 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f0092483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c19a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59312/0 (socket says 172.21.15.6:59312) 2023-09-13T09:31:59.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f0092483700 1 -- 172.21.15.6:0/2066298062 learned_addr learned my addr 172.21.15.6:0/2066298062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:31:59.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f0092483700 1 -- 172.21.15.6:0/2066298062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0088009550 con 0x7f008c106ff0 2023-09-13T09:31:59.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f0092483700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c19a270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0088003e60 tx=0x7f0088011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:31:59.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f007f7fe700 1 -- 172.21.15.6:0/2066298062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0088003970 con 0x7f008c106ff0 2023-09-13T09:31:59.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f007f7fe700 1 -- 172.21.15.6:0/2066298062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0088003ad0 con 0x7f008c106ff0 2023-09-13T09:31:59.864 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f008c19a9b0 con 0x7f008c106ff0 2023-09-13T09:31:59.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f007f7fe700 1 -- 172.21.15.6:0/2066298062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00880195e0 con 0x7f008c106ff0 2023-09-13T09:31:59.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.791+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f008c19add0 con 0x7f008c106ff0 2023-09-13T09:31:59.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.792+0000 7f007f7fe700 1 -- 172.21.15.6:0/2066298062 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 45344+0+0 (secure 0 0 0) 0x7f00880198a0 con 0x7f008c106ff0 2023-09-13T09:31:59.865 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.792+0000 7f007f7fe700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 0x7f007803a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:31:59.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.792+0000 7f007f7fe700 1 -- 172.21.15.6:0/2066298062 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f008804c440 con 0x7f008c106ff0 2023-09-13T09:31:59.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.792+0000 7f0091c82700 1 -- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 msgr2=0x7f007803a820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1676430765 2023-09-13T09:31:59.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.792+0000 7f0091c82700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 0x7f007803a820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T09:31:59.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.793+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f008c10a760 con 0x7f008c106ff0 2023-09-13T09:31:59.866 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.797+0000 7f007f7fe700 1 -- 172.21.15.6:0/2066298062 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f008802b340 con 0x7f008c106ff0 2023-09-13T09:31:59.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.993+0000 7f0091c82700 1 -- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 msgr2=0x7f007803a820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1676430765 2023-09-13T09:31:59.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:58.993+0000 7f0091c82700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 0x7f007803a820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T09:31:59.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.275+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f008c10a950 con 0x7f008c106ff0 2023-09-13T09:31:59.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.275+0000 7f007f7fe700 1 -- 172.21.15.6:0/2066298062 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f0088018b40 con 0x7f008c106ff0 2023-09-13T09:31:59.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 msgr2=0x7f007803a820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:31:59.867 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 0x7f007803a820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 msgr2=0x7f008c19a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:31:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c19a270 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f0088003e60 tx=0x7f0088011aa0 comp rx=0 tx=0).stop 2023-09-13T09:31:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 shutdown_connections 2023-09-13T09:31:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f0078038360 0x7f007803a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:59.868 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 --2- 172.21.15.6:0/2066298062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f008c106ff0 0x7f008c19a270 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:31:59.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.277+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 >> 172.21.15.6:0/2066298062 conn(0x7f008c100aa0 msgr2=0x7f008c102140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:31:59.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.278+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 shutdown_connections 2023-09-13T09:31:59.869 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:31:59.278+0000 7f00946e7700 1 -- 172.21.15.6:0/2066298062 wait complete. 2023-09-13T09:31:59.869 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for the mgr to restart... 2023-09-13T09:31:59.869 INFO:teuthology.orchestra.run.smithi006.stdout:Waiting for mgr epoch 9... 2023-09-13T09:32:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:31:59 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2066298062' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-09-13T09:32:00.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:00 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:00.022+0000 7fc3de8ba200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T09:32:01.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:00 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:00.817+0000 7fc3de8ba200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T09:32:01.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:00 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:00.916+0000 7fc3de8ba200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T09:32:02.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:01 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:01.894+0000 7fc3de8ba200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:32:02.231 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:02 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:02.007+0000 7fc3de8ba200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T09:32:02.839 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:02 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:02.230+0000 7fc3de8ba200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:32:02.840 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:02 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:02.584+0000 7fc3de8ba200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T09:32:02.840 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:02 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:02.839+0000 7fc3de8ba200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T09:32:03.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:03 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:03.023+0000 7fc3de8ba200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T09:32:03.756 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:03 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:03.355+0000 7fc3de8ba200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T09:32:04.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:04 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:04.184+0000 7fc3de8ba200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T09:32:04.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:04 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:04.342+0000 7fc3de8ba200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T09:32:05.000 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:04 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:04.589+0000 7fc3de8ba200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T09:32:05.000 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:04 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:04.726+0000 7fc3de8ba200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T09:32:05.000 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:05 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:05.000+0000 7fc3de8ba200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T09:32:06.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:32:06.048+0000 7fc3de8ba200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T09:32:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: Active manager daemon x restarted 2023-09-13T09:32:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: Activating manager daemon x 2023-09-13T09:32:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: osdmap e3: 0 total, 0 up, 0 in 2023-09-13T09:32:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: mgrmap e10: x(active, starting, since 0.00337242s) 2023-09-13T09:32:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:32:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-09-13T09:32:06.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-09-13T09:32:06.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-09-13T09:32:06.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-09-13T09:32:06.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: Manager daemon x is now available 2023-09-13T09:32:06.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:06.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:07.383 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-09-13T09:32:07.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-09-13T09:32:07.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:07 smithi006 ceph-mon[98665]: [13/Sep/2023:09:32:06] ENGINE Bus STARTING 2023-09-13T09:32:07.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:07 smithi006 ceph-mon[98665]: [13/Sep/2023:09:32:06] ENGINE Serving on https://172.21.15.6:7150 2023-09-13T09:32:07.384 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:07 smithi006 ceph-mon[98665]: [13/Sep/2023:09:32:06] ENGINE Serving on http://172.21.15.6:8765 2023-09-13T09:32:07.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:07 smithi006 ceph-mon[98665]: [13/Sep/2023:09:32:06] ENGINE Bus STARTED 2023-09-13T09:32:07.385 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:07 smithi006 ceph-mon[98665]: mgrmap e11: x(active, since 1.00555s) 2023-09-13T09:32:07.427 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout { 2023-09-13T09:32:07.427 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-09-13T09:32:07.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout "initialized": true 2023-09-13T09:32:07.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout } 2023-09-13T09:32:07.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.307+0000 7f18a8143700 1 Processor -- start 2023-09-13T09:32:07.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.307+0000 7f18a8143700 1 -- start start 2023-09-13T09:32:07.428 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.307+0000 7f18a8143700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a0105280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:07.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.307+0000 7f18a8143700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0074470 con 0x7f18a0104e60 2023-09-13T09:32:07.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.307+0000 7f18a5edf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a0105280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:07.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.307+0000 7f18a5edf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a0105280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59320/0 (socket says 172.21.15.6:59320) 2023-09-13T09:32:07.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.307+0000 7f18a5edf700 1 -- 172.21.15.6:0/1410438472 learned_addr learned my addr 172.21.15.6:0/1410438472 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:07.429 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.308+0000 7f18a5edf700 1 -- 172.21.15.6:0/1410438472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a01057c0 con 0x7f18a0104e60 2023-09-13T09:32:07.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.308+0000 7f18a5edf700 1 --2- 172.21.15.6:0/1410438472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a0105280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f189c0098a0 tx=0x7f189c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dab7fa0f5e2f9af server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:07.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.308+0000 7f18a4edd700 1 -- 172.21.15.6:0/1410438472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c004160 con 0x7f18a0104e60 2023-09-13T09:32:07.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.308+0000 7f18a4edd700 1 -- 172.21.15.6:0/1410438472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f189c0042c0 con 0x7f18a0104e60 2023-09-13T09:32:07.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.308+0000 7f18a4edd700 1 -- 172.21.15.6:0/1410438472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c0119b0 con 0x7f18a0104e60 2023-09-13T09:32:07.430 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 -- 172.21.15.6:0/1410438472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 msgr2=0x7f18a0105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:07.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 --2- 172.21.15.6:0/1410438472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a0105280 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f189c0098a0 tx=0x7f189c009bb0 comp rx=0 tx=0).stop 2023-09-13T09:32:07.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 -- 172.21.15.6:0/1410438472 shutdown_connections 2023-09-13T09:32:07.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 --2- 172.21.15.6:0/1410438472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a0105280 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:07.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 -- 172.21.15.6:0/1410438472 >> 172.21.15.6:0/1410438472 conn(0x7f18a0100aa0 msgr2=0x7f18a0102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:07.431 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 -- 172.21.15.6:0/1410438472 shutdown_connections 2023-09-13T09:32:07.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 -- 172.21.15.6:0/1410438472 wait complete. 2023-09-13T09:32:07.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.309+0000 7f18a8143700 1 Processor -- start 2023-09-13T09:32:07.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a8143700 1 -- start start 2023-09-13T09:32:07.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a8143700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a019c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:07.432 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a8143700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a019c9b0 con 0x7f18a0104e60 2023-09-13T09:32:07.433 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a5edf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a019c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:07.433 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a5edf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a019c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59322/0 (socket says 172.21.15.6:59322) 2023-09-13T09:32:07.433 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a5edf700 1 -- 172.21.15.6:0/3351405313 learned_addr learned my addr 172.21.15.6:0/3351405313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:07.433 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a5edf700 1 -- 172.21.15.6:0/3351405313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c009550 con 0x7f18a0104e60 2023-09-13T09:32:07.433 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.310+0000 7f18a5edf700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a019c470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f189c011980 tx=0x7f189c011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:07.434 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.311+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c003a60 con 0x7f18a0104e60 2023-09-13T09:32:07.434 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.311+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a019cbb0 con 0x7f18a0104e60 2023-09-13T09:32:07.434 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.311+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f189c003bc0 con 0x7f18a0104e60 2023-09-13T09:32:07.434 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.311+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f189c01a670 con 0x7f18a0104e60 2023-09-13T09:32:07.434 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.311+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a019cfd0 con 0x7f18a0104e60 2023-09-13T09:32:07.435 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.312+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 45344+0+0 (secure 0 0 0) 0x7f189c01a930 con 0x7f18a0104e60 2023-09-13T09:32:07.435 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.312+0000 7f1896ffd700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:07.435 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.312+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 --> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f188c03af80 con 0x7f188c0383b0 2023-09-13T09:32:07.435 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.312+0000 7f18a56de700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 msgr2=0x7f188c03a870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1676430765 2023-09-13T09:32:07.435 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.312+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f189c04c5e0 con 0x7f18a0104e60 2023-09-13T09:32:07.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.312+0000 7f18a56de700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T09:32:07.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.513+0000 7f18a56de700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 msgr2=0x7f188c03a870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1676430765 2023-09-13T09:32:07.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.513+0000 7f18a56de700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-13T09:32:07.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.914+0000 7f18a56de700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 msgr2=0x7f188c03a870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1676430765 2023-09-13T09:32:07.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:00.914+0000 7f18a56de700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-13T09:32:07.436 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:01.715+0000 7f18a56de700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 msgr2=0x7f188c03a870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1676430765 2023-09-13T09:32:07.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:01.715+0000 7f18a56de700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-13T09:32:07.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:03.316+0000 7f18a56de700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 msgr2=0x7f188c03a870 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/1676430765 2023-09-13T09:32:07.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:03.316+0000 7f18a56de700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-09-13T09:32:07.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:06.063+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 10) v1 ==== 45111+0+0 (secure 0 0 0) 0x7f189c02d960 con 0x7f18a0104e60 2023-09-13T09:32:07.437 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:06.063+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 msgr2=0x7f188c03a870 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:32:07.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:06.063+0000 7f1896ffd700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:07.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.064+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 11) v1 ==== 45238+0+0 (secure 0 0 0) 0x7f189c04e2a0 con 0x7f18a0104e60 2023-09-13T09:32:07.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.065+0000 7f1896ffd700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f188c03be20 0x7f188c03e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:07.438 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.065+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f188c03af80 con 0x7f188c03be20 2023-09-13T09:32:07.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.065+0000 7f18a56de700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f188c03be20 0x7f188c03e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:07.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.066+0000 7f18a56de700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f188c03be20 0x7f188c03e210 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1890003a10 tx=0x7f18900092b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:07.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.066+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f188c03af80 con 0x7f188c03be20 2023-09-13T09:32:07.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.077+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f18a019d7b0 con 0x7f188c03be20 2023-09-13T09:32:07.439 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f1896ffd700 1 -- 172.21.15.6:0/3351405313 <== mgr.14152 v2:172.21.15.6:6800/1364175161 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f18a019d7b0 con 0x7f188c03be20 2023-09-13T09:32:07.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f188c03be20 msgr2=0x7f188c03e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:07.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f188c03be20 0x7f188c03e210 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f1890003a10 tx=0x7f18900092b0 comp rx=0 tx=0).stop 2023-09-13T09:32:07.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 msgr2=0x7f18a019c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:07.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a019c470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f189c011980 tx=0x7f189c011a60 comp rx=0 tx=0).stop 2023-09-13T09:32:07.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 shutdown_connections 2023-09-13T09:32:07.440 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f188c03be20 0x7f188c03e210 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:07.441 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18a0104e60 0x7f18a019c470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:07.441 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 --2- 172.21.15.6:0/3351405313 >> [v2:172.21.15.6:6800/1676430765,v1:172.21.15.6:6801/1676430765] conn(0x7f188c0383b0 0x7f188c03a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:07.441 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 >> 172.21.15.6:0/3351405313 conn(0x7f18a0100aa0 msgr2=0x7f18a0190a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:07.441 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 shutdown_connections 2023-09-13T09:32:07.441 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.078+0000 7f18a8143700 1 -- 172.21.15.6:0/3351405313 wait complete. 2023-09-13T09:32:07.442 INFO:teuthology.orchestra.run.smithi006.stdout:mgr epoch 9 is available 2023-09-13T09:32:07.442 INFO:teuthology.orchestra.run.smithi006.stdout:Generating a dashboard self-signed certificate... 2023-09-13T09:32:08.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:08 smithi006 ceph-mon[98665]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-09-13T09:32:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:08 smithi006 ceph-mon[98665]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-09-13T09:32:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:08.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-09-13T09:32:08.873 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.984+0000 7fad010c9700 1 Processor -- start 2023-09-13T09:32:08.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.984+0000 7fad010c9700 1 -- start start 2023-09-13T09:32:08.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.984+0000 7fad010c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:08.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.984+0000 7fad010c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc105e70 con 0x7facfc105480 2023-09-13T09:32:08.874 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.984+0000 7facfad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:08.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.984+0000 7facfad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59376/0 (socket says 172.21.15.6:59376) 2023-09-13T09:32:08.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.984+0000 7facfad9d700 1 -- 172.21.15.6:0/1901459409 learned_addr learned my addr 172.21.15.6:0/1901459409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:08.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.985+0000 7facfad9d700 1 -- 172.21.15.6:0/1901459409 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc106680 con 0x7facfc105480 2023-09-13T09:32:08.875 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.985+0000 7facfad9d700 1 --2- 172.21.15.6:0/1901459409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1058a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7face40098a0 tx=0x7face4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af76772ed73e41c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:08.876 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.985+0000 7facf9d9b700 1 -- 172.21.15.6:0/1901459409 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face4004160 con 0x7facfc105480 2023-09-13T09:32:08.876 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.985+0000 7facf9d9b700 1 -- 172.21.15.6:0/1901459409 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7face40042c0 con 0x7facfc105480 2023-09-13T09:32:08.876 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.985+0000 7facf9d9b700 1 -- 172.21.15.6:0/1901459409 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face40119b0 con 0x7facfc105480 2023-09-13T09:32:08.876 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 -- 172.21.15.6:0/1901459409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 msgr2=0x7facfc1058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:08.877 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 --2- 172.21.15.6:0/1901459409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1058a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7face40098a0 tx=0x7face4009bb0 comp rx=0 tx=0).stop 2023-09-13T09:32:08.877 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 -- 172.21.15.6:0/1901459409 shutdown_connections 2023-09-13T09:32:08.877 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 --2- 172.21.15.6:0/1901459409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1058a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:08.877 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 -- 172.21.15.6:0/1901459409 >> 172.21.15.6:0/1901459409 conn(0x7facfc100aa0 msgr2=0x7facfc102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:08.877 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 -- 172.21.15.6:0/1901459409 shutdown_connections 2023-09-13T09:32:08.878 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 -- 172.21.15.6:0/1901459409 wait complete. 2023-09-13T09:32:08.878 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.986+0000 7fad010c9700 1 Processor -- start 2023-09-13T09:32:08.878 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7fad010c9700 1 -- start start 2023-09-13T09:32:08.878 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7fad010c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1906d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:08.879 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7fad010c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facfc190c10 con 0x7facfc105480 2023-09-13T09:32:08.879 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7facfad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:08.879 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7facfad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1906d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59378/0 (socket says 172.21.15.6:59378) 2023-09-13T09:32:08.879 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7facfad9d700 1 -- 172.21.15.6:0/2338577927 learned_addr learned my addr 172.21.15.6:0/2338577927 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7facfad9d700 1 -- 172.21.15.6:0/2338577927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7face4009550 con 0x7facfc105480 2023-09-13T09:32:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.987+0000 7facfad9d700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1906d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7face4003e60 tx=0x7face4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.988+0000 7facf3fff700 1 -- 172.21.15.6:0/2338577927 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face4003970 con 0x7facfc105480 2023-09-13T09:32:08.880 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.988+0000 7facf3fff700 1 -- 172.21.15.6:0/2338577927 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7face4003ad0 con 0x7facfc105480 2023-09-13T09:32:08.881 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.988+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facfc18ed20 con 0x7facfc105480 2023-09-13T09:32:08.881 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.988+0000 7facf3fff700 1 -- 172.21.15.6:0/2338577927 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7face40195e0 con 0x7facfc105480 2023-09-13T09:32:08.881 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.988+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facfc18f140 con 0x7facfc105480 2023-09-13T09:32:08.882 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.988+0000 7facf3fff700 1 -- 172.21.15.6:0/2338577927 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 11) v1 ==== 45238+0+0 (secure 0 0 0) 0x7face40198a0 con 0x7facfc105480 2023-09-13T09:32:08.882 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.989+0000 7facf3fff700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7face8038240 0x7face803a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:08.882 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.989+0000 7facf3fff700 1 -- 172.21.15.6:0/2338577927 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7face404c360 con 0x7facfc105480 2023-09-13T09:32:08.882 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.989+0000 7facfa59c700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7face8038240 0x7face803a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:08.883 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.989+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facfc1098b0 con 0x7facfc105480 2023-09-13T09:32:08.883 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.989+0000 7facfa59c700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7face8038240 0x7face803a700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7facec006fd0 tx=0x7facec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:08.883 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:07.994+0000 7facf3fff700 1 -- 172.21.15.6:0/2338577927 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7face4019bf0 con 0x7facfc105480 2023-09-13T09:32:08.883 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.371+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7facfc18f7f0 con 0x7face8038240 2023-09-13T09:32:08.884 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.519+0000 7facf3fff700 1 -- 172.21.15.6:0/2338577927 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7facfc18f7f0 con 0x7face8038240 2023-09-13T09:32:08.884 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7face8038240 msgr2=0x7face803a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:08.884 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7face8038240 0x7face803a700 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7facec006fd0 tx=0x7facec006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:08.884 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 msgr2=0x7facfc1906d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:08.885 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1906d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7face4003e60 tx=0x7face4011aa0 comp rx=0 tx=0).stop 2023-09-13T09:32:08.885 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 shutdown_connections 2023-09-13T09:32:08.885 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7face8038240 0x7face803a700 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:08.885 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 --2- 172.21.15.6:0/2338577927 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7facfc105480 0x7facfc1906d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:08.885 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 >> 172.21.15.6:0/2338577927 conn(0x7facfc100aa0 msgr2=0x7facfc073ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:08.886 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 shutdown_connections 2023-09-13T09:32:08.886 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:08.522+0000 7fad010c9700 1 -- 172.21.15.6:0/2338577927 wait complete. 2023-09-13T09:32:08.886 INFO:teuthology.orchestra.run.smithi006.stdout:Creating initial admin user... 2023-09-13T09:32:09.909 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:09 smithi006 ceph-mon[98665]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:09.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:09.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:09.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:09 smithi006 ceph-mon[98665]: mgrmap e12: x(active, since 2s) 2023-09-13T09:32:09.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:10.514 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$KzDaORlEeAVy0K0zSk9u/O0Wo5z.YehskQGn8vP1/x8JuCYOT37HO", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1694597530, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-09-13T09:32:10.519 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.392+0000 7f9166310700 1 Processor -- start 2023-09-13T09:32:10.520 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.392+0000 7f9166310700 1 -- start start 2023-09-13T09:32:10.520 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.392+0000 7f9166310700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160106e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:10.520 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.392+0000 7f9166310700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160107450 con 0x7f9160106a60 2023-09-13T09:32:10.520 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.392+0000 7f915ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160106e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:10.520 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.392+0000 7f915ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160106e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59382/0 (socket says 172.21.15.6:59382) 2023-09-13T09:32:10.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.392+0000 7f915ffff700 1 -- 172.21.15.6:0/415437580 learned_addr learned my addr 172.21.15.6:0/415437580 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:10.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.393+0000 7f915ffff700 1 -- 172.21.15.6:0/415437580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9160107590 con 0x7f9160106a60 2023-09-13T09:32:10.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.393+0000 7f915ffff700 1 --2- 172.21.15.6:0/415437580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160106e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91500098a0 tx=0x7f9150009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ab1a7bc805e25b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:10.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.393+0000 7f915effd700 1 -- 172.21.15.6:0/415437580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9150004160 con 0x7f9160106a60 2023-09-13T09:32:10.521 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.393+0000 7f915effd700 1 -- 172.21.15.6:0/415437580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91500042c0 con 0x7f9160106a60 2023-09-13T09:32:10.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.393+0000 7f915effd700 1 -- 172.21.15.6:0/415437580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91500119b0 con 0x7f9160106a60 2023-09-13T09:32:10.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.393+0000 7f9166310700 1 -- 172.21.15.6:0/415437580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 msgr2=0x7f9160106e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:10.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.393+0000 7f9166310700 1 --2- 172.21.15.6:0/415437580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160106e80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f91500098a0 tx=0x7f9150009bb0 comp rx=0 tx=0).stop 2023-09-13T09:32:10.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.394+0000 7f9166310700 1 -- 172.21.15.6:0/415437580 shutdown_connections 2023-09-13T09:32:10.522 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.394+0000 7f9166310700 1 --2- 172.21.15.6:0/415437580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160106e80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:10.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.394+0000 7f9166310700 1 -- 172.21.15.6:0/415437580 >> 172.21.15.6:0/415437580 conn(0x7f91601001e0 msgr2=0x7f9160102600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:10.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.394+0000 7f9166310700 1 -- 172.21.15.6:0/415437580 shutdown_connections 2023-09-13T09:32:10.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.394+0000 7f9166310700 1 -- 172.21.15.6:0/415437580 wait complete. 2023-09-13T09:32:10.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.394+0000 7f9166310700 1 Processor -- start 2023-09-13T09:32:10.523 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.394+0000 7f9166310700 1 -- start start 2023-09-13T09:32:10.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f9166310700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160190640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:10.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f9166310700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9160190b80 con 0x7f9160106a60 2023-09-13T09:32:10.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160190640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:10.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160190640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59384/0 (socket says 172.21.15.6:59384) 2023-09-13T09:32:10.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915ffff700 1 -- 172.21.15.6:0/3671763852 learned_addr learned my addr 172.21.15.6:0/3671763852 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:10.524 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915ffff700 1 -- 172.21.15.6:0/3671763852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9150009550 con 0x7f9160106a60 2023-09-13T09:32:10.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915ffff700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160190640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9150000c00 tx=0x7f9150011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:10.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915d7fa700 1 -- 172.21.15.6:0/3671763852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91500039f0 con 0x7f9160106a60 2023-09-13T09:32:10.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915d7fa700 1 -- 172.21.15.6:0/3671763852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9150003b50 con 0x7f9160106a60 2023-09-13T09:32:10.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916018ec90 con 0x7f9160106a60 2023-09-13T09:32:10.525 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f915d7fa700 1 -- 172.21.15.6:0/3671763852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f915001a780 con 0x7f9160106a60 2023-09-13T09:32:10.526 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.395+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916018f0b0 con 0x7f9160106a60 2023-09-13T09:32:10.526 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.396+0000 7f915d7fa700 1 -- 172.21.15.6:0/3671763852 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 45344+0+0 (secure 0 0 0) 0x7f915001a9f0 con 0x7f9160106a60 2023-09-13T09:32:10.526 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.396+0000 7f915d7fa700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f914c038400 0x7f914c03a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:10.526 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.397+0000 7f915d7fa700 1 -- 172.21.15.6:0/3671763852 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f915004c2a0 con 0x7f9160106a60 2023-09-13T09:32:10.526 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.397+0000 7f915f7fe700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f914c038400 0x7f914c03a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:10.527 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.397+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9160107590 con 0x7f9160106a60 2023-09-13T09:32:10.527 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.397+0000 7f915f7fe700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f914c038400 0x7f914c03a8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9148006fd0 tx=0x7f9148006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:10.527 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.402+0000 7f915d7fa700 1 -- 172.21.15.6:0/3671763852 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9160107590 con 0x7f9160106a60 2023-09-13T09:32:10.527 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:09.813+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f9160062100 con 0x7f914c038400 2023-09-13T09:32:10.527 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.060+0000 7f915d7fa700 1 -- 172.21.15.6:0/3671763852 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7f9160062100 con 0x7f914c038400 2023-09-13T09:32:10.528 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f914c038400 msgr2=0x7f914c03a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:10.528 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f914c038400 0x7f914c03a8c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9148006fd0 tx=0x7f9148006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:10.528 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 msgr2=0x7f9160190640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:10.528 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160190640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9150000c00 tx=0x7f9150011a30 comp rx=0 tx=0).stop 2023-09-13T09:32:10.528 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 shutdown_connections 2023-09-13T09:32:10.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f914c038400 0x7f914c03a8c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:10.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 --2- 172.21.15.6:0/3671763852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9160106a60 0x7f9160190640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:10.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 >> 172.21.15.6:0/3671763852 conn(0x7f91601001e0 msgr2=0x7f9160104ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:10.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 shutdown_connections 2023-09-13T09:32:10.529 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:10.063+0000 7f9166310700 1 -- 172.21.15.6:0/3671763852 wait complete. 2023-09-13T09:32:10.530 INFO:teuthology.orchestra.run.smithi006.stdout:Fetching dashboard port number... 2023-09-13T09:32:10.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:10 smithi006 ceph-mon[98665]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:10.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:11.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stdout 8443 2023-09-13T09:32:11.922 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.126+0000 7f369f9a1700 1 Processor -- start 2023-09-13T09:32:11.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.126+0000 7f369f9a1700 1 -- start start 2023-09-13T09:32:11.923 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.126+0000 7f369f9a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981058a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:11.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.126+0000 7f369f9a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3698105e70 con 0x7f3698105480 2023-09-13T09:32:11.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f369d73d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981058a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:11.924 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f369d73d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981058a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59388/0 (socket says 172.21.15.6:59388) 2023-09-13T09:32:11.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f369d73d700 1 -- 172.21.15.6:0/3933873208 learned_addr learned my addr 172.21.15.6:0/3933873208 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:11.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f369d73d700 1 -- 172.21.15.6:0/3933873208 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698106680 con 0x7f3698105480 2023-09-13T09:32:11.925 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f369d73d700 1 --2- 172.21.15.6:0/3933873208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981058a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36880098a0 tx=0x7f3688009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df9eedeef7b7973 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:11.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f368ffff700 1 -- 172.21.15.6:0/3933873208 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3688004160 con 0x7f3698105480 2023-09-13T09:32:11.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f368ffff700 1 -- 172.21.15.6:0/3933873208 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f36880042c0 con 0x7f3698105480 2023-09-13T09:32:11.926 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.127+0000 7f368ffff700 1 -- 172.21.15.6:0/3933873208 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36880119b0 con 0x7f3698105480 2023-09-13T09:32:11.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.128+0000 7f369f9a1700 1 -- 172.21.15.6:0/3933873208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 msgr2=0x7f36981058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:11.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.128+0000 7f369f9a1700 1 --2- 172.21.15.6:0/3933873208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981058a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f36880098a0 tx=0x7f3688009bb0 comp rx=0 tx=0).stop 2023-09-13T09:32:11.927 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.128+0000 7f369f9a1700 1 -- 172.21.15.6:0/3933873208 shutdown_connections 2023-09-13T09:32:11.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.128+0000 7f369f9a1700 1 --2- 172.21.15.6:0/3933873208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981058a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:11.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.128+0000 7f369f9a1700 1 -- 172.21.15.6:0/3933873208 >> 172.21.15.6:0/3933873208 conn(0x7f3698100aa0 msgr2=0x7f3698102ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:11.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.128+0000 7f369f9a1700 1 -- 172.21.15.6:0/3933873208 shutdown_connections 2023-09-13T09:32:11.928 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.128+0000 7f369f9a1700 1 -- 172.21.15.6:0/3933873208 wait complete. 2023-09-13T09:32:11.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.129+0000 7f369f9a1700 1 Processor -- start 2023-09-13T09:32:11.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.129+0000 7f369f9a1700 1 -- start start 2023-09-13T09:32:11.929 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.129+0000 7f369f9a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981906d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:11.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.129+0000 7f369f9a1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3698190c10 con 0x7f3698105480 2023-09-13T09:32:11.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.129+0000 7f369d73d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981906d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:11.930 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.129+0000 7f369d73d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981906d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59390/0 (socket says 172.21.15.6:59390) 2023-09-13T09:32:11.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.129+0000 7f369d73d700 1 -- 172.21.15.6:0/2067384457 learned_addr learned my addr 172.21.15.6:0/2067384457 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:11.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.130+0000 7f369d73d700 1 -- 172.21.15.6:0/2067384457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3688009550 con 0x7f3698105480 2023-09-13T09:32:11.931 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.130+0000 7f369d73d700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981906d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3688000c00 tx=0x7f3688011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:11.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.130+0000 7f368e7fc700 1 -- 172.21.15.6:0/2067384457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36880039f0 con 0x7f3698105480 2023-09-13T09:32:11.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.130+0000 7f368e7fc700 1 -- 172.21.15.6:0/2067384457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3688003b50 con 0x7f3698105480 2023-09-13T09:32:11.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.130+0000 7f368e7fc700 1 -- 172.21.15.6:0/2067384457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f368801a780 con 0x7f3698105480 2023-09-13T09:32:11.932 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.130+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369818ed20 con 0x7f3698105480 2023-09-13T09:32:11.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.130+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369818f140 con 0x7f3698105480 2023-09-13T09:32:11.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.131+0000 7f368e7fc700 1 -- 172.21.15.6:0/2067384457 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 45344+0+0 (secure 0 0 0) 0x7f368801a9f0 con 0x7f3698105480 2023-09-13T09:32:11.933 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.131+0000 7f368e7fc700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3684038400 0x7f368403a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:11.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.131+0000 7f368e7fc700 1 -- 172.21.15.6:0/2067384457 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f368804c390 con 0x7f3698105480 2023-09-13T09:32:11.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.131+0000 7f369cf3c700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3684038400 0x7f368403a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:11.934 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.131+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36981098b0 con 0x7f3698105480 2023-09-13T09:32:11.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.132+0000 7f369cf3c700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3684038400 0x7f368403a8c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3694006fd0 tx=0x7f3694006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:11.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.136+0000 7f368e7fc700 1 -- 172.21.15.6:0/2067384457 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f368801acf0 con 0x7f3698105480 2023-09-13T09:32:11.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.500+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f3698109a70 con 0x7f3698105480 2023-09-13T09:32:11.935 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.500+0000 7f368e7fc700 1 -- 172.21.15.6:0/2067384457 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f368804a0b0 con 0x7f3698105480 2023-09-13T09:32:11.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3684038400 msgr2=0x7f368403a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:11.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3684038400 0x7f368403a8c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3694006fd0 tx=0x7f3694006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:11.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 msgr2=0x7f36981906d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:11.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981906d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3688000c00 tx=0x7f3688011a30 comp rx=0 tx=0).stop 2023-09-13T09:32:11.936 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 shutdown_connections 2023-09-13T09:32:11.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3684038400 0x7f368403a8c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:11.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 --2- 172.21.15.6:0/2067384457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3698105480 0x7f36981906d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:11.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 >> 172.21.15.6:0/2067384457 conn(0x7f3698100aa0 msgr2=0x7f3698073fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:11.937 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 shutdown_connections 2023-09-13T09:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:11.503+0000 7f369f9a1700 1 -- 172.21.15.6:0/2067384457 wait complete. 2023-09-13T09:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-09-13T09:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout disabled 2023-09-13T09:32:11.940 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-09-13T09:32:11.940 INFO:teuthology.orchestra.run.smithi006.stdout:systemctl: stdout inactive 2023-09-13T09:32:11.940 INFO:teuthology.orchestra.run.smithi006.stdout:firewalld.service is not enabled 2023-09-13T09:32:11.940 INFO:teuthology.orchestra.run.smithi006.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-09-13T09:32:11.940 INFO:teuthology.orchestra.run.smithi006.stdout:Ceph Dashboard is now available at: 2023-09-13T09:32:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: URL: https://smithi006:8443/ 2023-09-13T09:32:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: User: admin 2023-09-13T09:32:11.941 INFO:teuthology.orchestra.run.smithi006.stdout: Password: ecm7nva6cd 2023-09-13T09:32:11.942 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:11.942 INFO:teuthology.orchestra.run.smithi006.stdout:Saving cluster configuration to /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config directory 2023-09-13T09:32:11.942 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling autotune for osd_memory_target 2023-09-13T09:32:12.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:12 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2067384457' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-09-13T09:32:13.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.434+0000 7f3c1c0ed700 1 Processor -- start 2023-09-13T09:32:13.188 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.434+0000 7f3c1c0ed700 1 -- start start 2023-09-13T09:32:13.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c1c0ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c14109460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:13.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c1c0ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c14079ea0 con 0x7f3c14107070 2023-09-13T09:32:13.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c19e89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c14109460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:13.189 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c19e89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c14109460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59398/0 (socket says 172.21.15.6:59398) 2023-09-13T09:32:13.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c19e89700 1 -- 172.21.15.6:0/1977291598 learned_addr learned my addr 172.21.15.6:0/1977291598 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:13.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c19e89700 1 -- 172.21.15.6:0/1977291598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c141099a0 con 0x7f3c14107070 2023-09-13T09:32:13.190 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c19e89700 1 --2- 172.21.15.6:0/1977291598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c14109460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c100098a0 tx=0x7f3c10009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95002b79a84e2200 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:13.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c18e87700 1 -- 172.21.15.6:0/1977291598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c10004160 con 0x7f3c14107070 2023-09-13T09:32:13.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.435+0000 7f3c18e87700 1 -- 172.21.15.6:0/1977291598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c100042c0 con 0x7f3c14107070 2023-09-13T09:32:13.191 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c18e87700 1 -- 172.21.15.6:0/1977291598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c100119b0 con 0x7f3c14107070 2023-09-13T09:32:13.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/1977291598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 msgr2=0x7f3c14109460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:13.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c1c0ed700 1 --2- 172.21.15.6:0/1977291598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c14109460 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3c100098a0 tx=0x7f3c10009bb0 comp rx=0 tx=0).stop 2023-09-13T09:32:13.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/1977291598 shutdown_connections 2023-09-13T09:32:13.192 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c1c0ed700 1 --2- 172.21.15.6:0/1977291598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c14109460 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:13.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/1977291598 >> 172.21.15.6:0/1977291598 conn(0x7f3c14100b00 msgr2=0x7f3c14102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:13.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/1977291598 shutdown_connections 2023-09-13T09:32:13.193 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.436+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/1977291598 wait complete. 2023-09-13T09:32:13.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c1c0ed700 1 Processor -- start 2023-09-13T09:32:13.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c1c0ed700 1 -- start start 2023-09-13T09:32:13.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c1c0ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c1419a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:13.194 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c1c0ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1419a7b0 con 0x7f3c14107070 2023-09-13T09:32:13.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c19e89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c1419a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:13.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c19e89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c1419a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59400/0 (socket says 172.21.15.6:59400) 2023-09-13T09:32:13.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c19e89700 1 -- 172.21.15.6:0/2207935397 learned_addr learned my addr 172.21.15.6:0/2207935397 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:13.195 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.437+0000 7f3c19e89700 1 -- 172.21.15.6:0/2207935397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c10009550 con 0x7f3c14107070 2023-09-13T09:32:13.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.438+0000 7f3c19e89700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c1419a270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c10011980 tx=0x7f3c10011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:13.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.438+0000 7f3c06ffd700 1 -- 172.21.15.6:0/2207935397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c10003a60 con 0x7f3c14107070 2023-09-13T09:32:13.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.438+0000 7f3c06ffd700 1 -- 172.21.15.6:0/2207935397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c10003bc0 con 0x7f3c14107070 2023-09-13T09:32:13.196 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.438+0000 7f3c06ffd700 1 -- 172.21.15.6:0/2207935397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3c1001a670 con 0x7f3c14107070 2023-09-13T09:32:13.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.438+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1419a9b0 con 0x7f3c14107070 2023-09-13T09:32:13.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.438+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1419add0 con 0x7f3c14107070 2023-09-13T09:32:13.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.439+0000 7f3c06ffd700 1 -- 172.21.15.6:0/2207935397 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f3c1001a8e0 con 0x7f3c14107070 2023-09-13T09:32:13.197 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.439+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c140622e0 con 0x7f3c14107070 2023-09-13T09:32:13.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.439+0000 7f3c06ffd700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c000384a0 0x7f3c0003a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:13.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.439+0000 7f3c06ffd700 1 -- 172.21.15.6:0/2207935397 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3c1004c6a0 con 0x7f3c14107070 2023-09-13T09:32:13.198 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.439+0000 7f3c19688700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c000384a0 0x7f3c0003a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:13.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.439+0000 7f3c19688700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c000384a0 0x7f3c0003a960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c08006fd0 tx=0x7f3c08006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:13.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.444+0000 7f3c06ffd700 1 -- 172.21.15.6:0/2207935397 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3c10018b40 con 0x7f3c14107070 2023-09-13T09:32:13.199 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.802+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f3c1410a7e0 con 0x7f3c14107070 2023-09-13T09:32:13.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.803+0000 7f3c06ffd700 1 -- 172.21.15.6:0/2207935397 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f3c10018b40 con 0x7f3c14107070 2023-09-13T09:32:13.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c000384a0 msgr2=0x7f3c0003a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:13.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c000384a0 0x7f3c0003a960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c08006fd0 tx=0x7f3c08006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:13.200 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 msgr2=0x7f3c1419a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:13.201 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c1419a270 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3c10011980 tx=0x7f3c10011a60 comp rx=0 tx=0).stop 2023-09-13T09:32:13.201 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 shutdown_connections 2023-09-13T09:32:13.202 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c000384a0 0x7f3c0003a960 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:13.202 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 --2- 172.21.15.6:0/2207935397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c14107070 0x7f3c1419a270 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:13.203 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 >> 172.21.15.6:0/2207935397 conn(0x7f3c14100b00 msgr2=0x7f3c141018a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:13.203 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 shutdown_connections 2023-09-13T09:32:13.203 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:12.805+0000 7f3c1c0ed700 1 -- 172.21.15.6:0/2207935397 wait complete. 2023-09-13T09:32:13.428 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:13 smithi006 ceph-mon[98665]: mgrmap e13: x(active, since 6s) 2023-09-13T09:32:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.660+0000 7f38f76c4700 1 Processor -- start 2023-09-13T09:32:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.660+0000 7f38f76c4700 1 -- start start 2023-09-13T09:32:14.626 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.660+0000 7f38f76c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f01069a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:14.627 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.660+0000 7f38f76c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f0106f70 con 0x7f38f0106580 2023-09-13T09:32:14.627 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.660+0000 7f38f5460700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f01069a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:14.627 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.660+0000 7f38f5460700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f01069a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59404/0 (socket says 172.21.15.6:59404) 2023-09-13T09:32:14.627 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.660+0000 7f38f5460700 1 -- 172.21.15.6:0/3424335882 learned_addr learned my addr 172.21.15.6:0/3424335882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:14.627 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.661+0000 7f38f5460700 1 -- 172.21.15.6:0/3424335882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0107780 con 0x7f38f0106580 2023-09-13T09:32:14.628 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.661+0000 7f38f5460700 1 --2- 172.21.15.6:0/3424335882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f01069a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0098a0 tx=0x7f38ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d37ff0379d7d88 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:14.628 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.661+0000 7f38e7fff700 1 -- 172.21.15.6:0/3424335882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec004160 con 0x7f38f0106580 2023-09-13T09:32:14.632 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.661+0000 7f38e7fff700 1 -- 172.21.15.6:0/3424335882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38ec0042c0 con 0x7f38f0106580 2023-09-13T09:32:14.633 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.661+0000 7f38e7fff700 1 -- 172.21.15.6:0/3424335882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec0119b0 con 0x7f38f0106580 2023-09-13T09:32:14.633 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.661+0000 7f38f76c4700 1 -- 172.21.15.6:0/3424335882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 msgr2=0x7f38f01069a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:14.633 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.661+0000 7f38f76c4700 1 --2- 172.21.15.6:0/3424335882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f01069a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0098a0 tx=0x7f38ec009bb0 comp rx=0 tx=0).stop 2023-09-13T09:32:14.633 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 -- 172.21.15.6:0/3424335882 shutdown_connections 2023-09-13T09:32:14.633 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 --2- 172.21.15.6:0/3424335882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f01069a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:14.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 -- 172.21.15.6:0/3424335882 >> 172.21.15.6:0/3424335882 conn(0x7f38f0101ba0 msgr2=0x7f38f0103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:14.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 -- 172.21.15.6:0/3424335882 shutdown_connections 2023-09-13T09:32:14.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 -- 172.21.15.6:0/3424335882 wait complete. 2023-09-13T09:32:14.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 Processor -- start 2023-09-13T09:32:14.634 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 -- start start 2023-09-13T09:32:14.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f019a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:14.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.662+0000 7f38f76c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f019a840 con 0x7f38f0106580 2023-09-13T09:32:14.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38f5460700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f019a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:14.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38f5460700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f019a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59406/0 (socket says 172.21.15.6:59406) 2023-09-13T09:32:14.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38f5460700 1 -- 172.21.15.6:0/4008428691 learned_addr learned my addr 172.21.15.6:0/4008428691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:14.635 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38f5460700 1 -- 172.21.15.6:0/4008428691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38ec009550 con 0x7f38f0106580 2023-09-13T09:32:14.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38f5460700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f019a300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38ec003e60 tx=0x7f38ec011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:14.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38e67fc700 1 -- 172.21.15.6:0/4008428691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec003970 con 0x7f38f0106580 2023-09-13T09:32:14.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38e67fc700 1 -- 172.21.15.6:0/4008428691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38ec003ad0 con 0x7f38f0106580 2023-09-13T09:32:14.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38f019aa40 con 0x7f38f0106580 2023-09-13T09:32:14.636 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38e67fc700 1 -- 172.21.15.6:0/4008428691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38ec0195e0 con 0x7f38f0106580 2023-09-13T09:32:14.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.663+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38f019ae60 con 0x7f38f0106580 2023-09-13T09:32:14.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.664+0000 7f38e67fc700 1 -- 172.21.15.6:0/4008428691 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f38ec0198a0 con 0x7f38f0106580 2023-09-13T09:32:14.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.664+0000 7f38e67fc700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38dc038400 0x7f38dc03a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:14.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.664+0000 7f38e67fc700 1 -- 172.21.15.6:0/4008428691 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f38ec04c670 con 0x7f38f0106580 2023-09-13T09:32:14.637 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.665+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38f00622e0 con 0x7f38f0106580 2023-09-13T09:32:14.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.665+0000 7f38f4c5f700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38dc038400 0x7f38dc03a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:14.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.665+0000 7f38f4c5f700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38dc038400 0x7f38dc03a8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38e0006fd0 tx=0x7f38e0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:14.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:13.669+0000 7f38e67fc700 1 -- 172.21.15.6:0/4008428691 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f38ec003c40 con 0x7f38f0106580 2023-09-13T09:32:14.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.244+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f38f010a9b0 con 0x7f38f0106580 2023-09-13T09:32:14.638 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.247+0000 7f38e67fc700 1 -- 172.21.15.6:0/4008428691 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f38ec0212a0 con 0x7f38f0106580 2023-09-13T09:32:14.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38dc038400 msgr2=0x7f38dc03a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:14.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38dc038400 0x7f38dc03a8c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f38e0006fd0 tx=0x7f38e0006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:14.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 msgr2=0x7f38f019a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:14.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f019a300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f38ec003e60 tx=0x7f38ec011aa0 comp rx=0 tx=0).stop 2023-09-13T09:32:14.639 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 shutdown_connections 2023-09-13T09:32:14.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38dc038400 0x7f38dc03a8c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:14.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 --2- 172.21.15.6:0/4008428691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38f0106580 0x7f38f019a300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:14.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 >> 172.21.15.6:0/4008428691 conn(0x7f38f0101ba0 msgr2=0x7f38f01032a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:14.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 shutdown_connections 2023-09-13T09:32:14.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr 2023-09-13T09:32:14.249+0000 7f38f76c4700 1 -- 172.21.15.6:0/4008428691 wait complete. 2023-09-13T09:32:14.640 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-09-13T09:32:14.641 INFO:teuthology.orchestra.run.smithi006.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-09-13T09:32:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:14.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.641 INFO:teuthology.orchestra.run.smithi006.stdout:Or, if you are only running a single cluster on this host: 2023-09-13T09:32:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-09-13T09:32:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.642 INFO:teuthology.orchestra.run.smithi006.stdout:Please consider enabling telemetry to help improve Ceph: 2023-09-13T09:32:14.642 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: ceph telemetry on 2023-09-13T09:32:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.643 INFO:teuthology.orchestra.run.smithi006.stdout:For more information see: 2023-09-13T09:32:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-09-13T09:32:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:14.644 INFO:teuthology.orchestra.run.smithi006.stdout:Bootstrap complete. 2023-09-13T09:32:14.663 INFO:tasks.cephadm:Fetching config... 2023-09-13T09:32:14.664 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:32:14.664 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-09-13T09:32:14.683 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-09-13T09:32:14.683 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:32:14.684 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-09-13T09:32:14.749 INFO:tasks.cephadm:Fetching mon keyring... 2023-09-13T09:32:14.750 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:32:14.750 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/keyring of=/dev/stdout 2023-09-13T09:32:14.820 INFO:tasks.cephadm:Fetching pub ssh key... 2023-09-13T09:32:14.820 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:32:14.821 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-09-13T09:32:14.879 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-09-13T09:32:14.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmfiV6K8Dk0C7tV48JFm6mZVNTcnxZhFZZVdOyFtliIFV1ajIs/068jczU1uVhmXMTcrWC4SiBTQcJtWwbav2/Krun2y8JMwczRfj8Wd1JmcfGYRT0VfPB9T0c+NCflpxOrFp/QWBDf7EF58sos9e8//xLNSvXctJoKWCH5jJrc+/fCGeJIUaUxll2ug8ppw+OEvajS0pE0jlBokd+BpHg9O4BMm04f/7utzKy/l66SsYQQI6cgyth/Dply3IBufaLikbDbZ7ZuO8F8NfSZ3HIthIuARzt/S3w/IIsv4UsvD+sHFyAXI3h8t9xTibyrXDv94lDr7cRHo8jdQ7RGA+rEq1Myp2wwvX+p5ZsMy15rZfjvQ2wFpJxA2aIOykk9Z1VQ2bf/7H9eb115bf20xRmlo4o7i3KuxlIzW7hT0QhnbzNd7jk8elE9ATwEkgpm+ROST0IgmwUzQncbSBqf/Gaf9pBgDrGKK2/sb2jF4df2YmjDgws7J6V7K2e5a+7xR0= ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-13T09:32:14.962 INFO:teuthology.orchestra.run.smithi006.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmfiV6K8Dk0C7tV48JFm6mZVNTcnxZhFZZVdOyFtliIFV1ajIs/068jczU1uVhmXMTcrWC4SiBTQcJtWwbav2/Krun2y8JMwczRfj8Wd1JmcfGYRT0VfPB9T0c+NCflpxOrFp/QWBDf7EF58sos9e8//xLNSvXctJoKWCH5jJrc+/fCGeJIUaUxll2ug8ppw+OEvajS0pE0jlBokd+BpHg9O4BMm04f/7utzKy/l66SsYQQI6cgyth/Dply3IBufaLikbDbZ7ZuO8F8NfSZ3HIthIuARzt/S3w/IIsv4UsvD+sHFyAXI3h8t9xTibyrXDv94lDr7cRHo8jdQ7RGA+rEq1Myp2wwvX+p5ZsMy15rZfjvQ2wFpJxA2aIOykk9Z1VQ2bf/7H9eb115bf20xRmlo4o7i3KuxlIzW7hT0QhnbzNd7jk8elE9ATwEkgpm+ROST0IgmwUzQncbSBqf/Gaf9pBgDrGKK2/sb2jF4df2YmjDgws7J6V7K2e5a+7xR0= ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:32:14.975 DEBUG:teuthology.orchestra.run.smithi053:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmfiV6K8Dk0C7tV48JFm6mZVNTcnxZhFZZVdOyFtliIFV1ajIs/068jczU1uVhmXMTcrWC4SiBTQcJtWwbav2/Krun2y8JMwczRfj8Wd1JmcfGYRT0VfPB9T0c+NCflpxOrFp/QWBDf7EF58sos9e8//xLNSvXctJoKWCH5jJrc+/fCGeJIUaUxll2ug8ppw+OEvajS0pE0jlBokd+BpHg9O4BMm04f/7utzKy/l66SsYQQI6cgyth/Dply3IBufaLikbDbZ7ZuO8F8NfSZ3HIthIuARzt/S3w/IIsv4UsvD+sHFyAXI3h8t9xTibyrXDv94lDr7cRHo8jdQ7RGA+rEq1Myp2wwvX+p5ZsMy15rZfjvQ2wFpJxA2aIOykk9Z1VQ2bf/7H9eb115bf20xRmlo4o7i3KuxlIzW7hT0QhnbzNd7jk8elE9ATwEkgpm+ROST0IgmwUzQncbSBqf/Gaf9pBgDrGKK2/sb2jF4df2YmjDgws7J6V7K2e5a+7xR0= ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-13T09:32:15.025 INFO:teuthology.orchestra.run.smithi053.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmfiV6K8Dk0C7tV48JFm6mZVNTcnxZhFZZVdOyFtliIFV1ajIs/068jczU1uVhmXMTcrWC4SiBTQcJtWwbav2/Krun2y8JMwczRfj8Wd1JmcfGYRT0VfPB9T0c+NCflpxOrFp/QWBDf7EF58sos9e8//xLNSvXctJoKWCH5jJrc+/fCGeJIUaUxll2ug8ppw+OEvajS0pE0jlBokd+BpHg9O4BMm04f/7utzKy/l66SsYQQI6cgyth/Dply3IBufaLikbDbZ7ZuO8F8NfSZ3HIthIuARzt/S3w/IIsv4UsvD+sHFyAXI3h8t9xTibyrXDv94lDr7cRHo8jdQ7RGA+rEq1Myp2wwvX+p5ZsMy15rZfjvQ2wFpJxA2aIOykk9Z1VQ2bf/7H9eb115bf20xRmlo4o7i3KuxlIzW7hT0QhnbzNd7jk8elE9ATwEkgpm+ROST0IgmwUzQncbSBqf/Gaf9pBgDrGKK2/sb2jF4df2YmjDgws7J6V7K2e5a+7xR0= ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:32:15.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmfiV6K8Dk0C7tV48JFm6mZVNTcnxZhFZZVdOyFtliIFV1ajIs/068jczU1uVhmXMTcrWC4SiBTQcJtWwbav2/Krun2y8JMwczRfj8Wd1JmcfGYRT0VfPB9T0c+NCflpxOrFp/QWBDf7EF58sos9e8//xLNSvXctJoKWCH5jJrc+/fCGeJIUaUxll2ug8ppw+OEvajS0pE0jlBokd+BpHg9O4BMm04f/7utzKy/l66SsYQQI6cgyth/Dply3IBufaLikbDbZ7ZuO8F8NfSZ3HIthIuARzt/S3w/IIsv4UsvD+sHFyAXI3h8t9xTibyrXDv94lDr7cRHo8jdQ7RGA+rEq1Myp2wwvX+p5ZsMy15rZfjvQ2wFpJxA2aIOykk9Z1VQ2bf/7H9eb115bf20xRmlo4o7i3KuxlIzW7hT0QhnbzNd7jk8elE9ATwEkgpm+ROST0IgmwUzQncbSBqf/Gaf9pBgDrGKK2/sb2jF4df2YmjDgws7J6V7K2e5a+7xR0= ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-09-13T09:32:15.086 INFO:teuthology.orchestra.run.smithi131.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCmfiV6K8Dk0C7tV48JFm6mZVNTcnxZhFZZVdOyFtliIFV1ajIs/068jczU1uVhmXMTcrWC4SiBTQcJtWwbav2/Krun2y8JMwczRfj8Wd1JmcfGYRT0VfPB9T0c+NCflpxOrFp/QWBDf7EF58sos9e8//xLNSvXctJoKWCH5jJrc+/fCGeJIUaUxll2ug8ppw+OEvajS0pE0jlBokd+BpHg9O4BMm04f/7utzKy/l66SsYQQI6cgyth/Dply3IBufaLikbDbZ7ZuO8F8NfSZ3HIthIuARzt/S3w/IIsv4UsvD+sHFyAXI3h8t9xTibyrXDv94lDr7cRHo8jdQ7RGA+rEq1Myp2wwvX+p5ZsMy15rZfjvQ2wFpJxA2aIOykk9Z1VQ2bf/7H9eb115bf20xRmlo4o7i3KuxlIzW7hT0QhnbzNd7jk8elE9ATwEkgpm+ROST0IgmwUzQncbSBqf/Gaf9pBgDrGKK2/sb2jF4df2YmjDgws7J6V7K2e5a+7xR0= ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:32:15.099 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-09-13T09:32:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:15 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4008428691' entity='client.admin' 2023-09-13T09:32:15.669 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:32:17.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.403+0000 7f130564c700 1 -- 172.21.15.6:0/3278278063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 msgr2=0x7f13000ffaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.403+0000 7f130564c700 1 --2- 172.21.15.6:0/3278278063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f13000ffaf0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009910 tx=0x7f12f0009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.403+0000 7f130564c700 1 -- 172.21.15.6:0/3278278063 shutdown_connections 2023-09-13T09:32:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.403+0000 7f130564c700 1 --2- 172.21.15.6:0/3278278063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f13000ffaf0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.403+0000 7f130564c700 1 -- 172.21.15.6:0/3278278063 >> 172.21.15.6:0/3278278063 conn(0x7f13000fac90 msgr2=0x7f13000fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.403+0000 7f130564c700 1 -- 172.21.15.6:0/3278278063 shutdown_connections 2023-09-13T09:32:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.403+0000 7f130564c700 1 -- 172.21.15.6:0/3278278063 wait complete. 2023-09-13T09:32:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.404+0000 7f130564c700 1 Processor -- start 2023-09-13T09:32:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.404+0000 7f130564c700 1 -- start start 2023-09-13T09:32:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.404+0000 7f130564c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f130018c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.404+0000 7f130564c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130018ac50 con 0x7f13000ff6d0 2023-09-13T09:32:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.404+0000 7f12feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f130018c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.404+0000 7f12feffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f130018c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59412/0 (socket says 172.21.15.6:59412) 2023-09-13T09:32:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.404+0000 7f12feffd700 1 -- 172.21.15.6:0/4170084769 learned_addr learned my addr 172.21.15.6:0/4170084769 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.405+0000 7f12feffd700 1 -- 172.21.15.6:0/4170084769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f00095f0 con 0x7f13000ff6d0 2023-09-13T09:32:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.405+0000 7f12feffd700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f130018c600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12f0004f40 tx=0x7f12f00057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.405+0000 7f12e7fff700 1 -- 172.21.15.6:0/4170084769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12f001d070 con 0x7f13000ff6d0 2023-09-13T09:32:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.405+0000 7f12e7fff700 1 -- 172.21.15.6:0/4170084769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12f000bc10 con 0x7f13000ff6d0 2023-09-13T09:32:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.405+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130018ad90 con 0x7f13000ff6d0 2023-09-13T09:32:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.405+0000 7f12e7fff700 1 -- 172.21.15.6:0/4170084769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f12f0003a70 con 0x7f13000ff6d0 2023-09-13T09:32:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.405+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130018b230 con 0x7f13000ff6d0 2023-09-13T09:32:17.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.406+0000 7f12e7fff700 1 -- 172.21.15.6:0/4170084769 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f12f0003d30 con 0x7f13000ff6d0 2023-09-13T09:32:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.406+0000 7f12e7fff700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12e8038400 0x7f12e803a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.406+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13000622e0 con 0x7f13000ff6d0 2023-09-13T09:32:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.406+0000 7f12e7fff700 1 -- 172.21.15.6:0/4170084769 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f12f004c0f0 con 0x7f13000ff6d0 2023-09-13T09:32:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.406+0000 7f12fe7fc700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12e8038400 0x7f12e803a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.406+0000 7f12fe7fc700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12e8038400 0x7f12e803a8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12f4006fd0 tx=0x7f12f4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.411+0000 7f12e7fff700 1 -- 172.21.15.6:0/4170084769 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f12f002b440 con 0x7f13000ff6d0 2023-09-13T09:32:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.616+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f1300105420 con 0x7f13000ff6d0 2023-09-13T09:32:17.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.621+0000 7f12e7fff700 1 -- 172.21.15.6:0/4170084769 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f12f0029360 con 0x7f13000ff6d0 2023-09-13T09:32:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12e8038400 msgr2=0x7f12e803a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12e8038400 0x7f12e803a8c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f12f4006fd0 tx=0x7f12f4006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 msgr2=0x7f130018c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f130018c600 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f12f0004f40 tx=0x7f12f00057c0 comp rx=0 tx=0).stop 2023-09-13T09:32:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 shutdown_connections 2023-09-13T09:32:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12e8038400 0x7f12e803a8c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 --2- 172.21.15.6:0/4170084769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13000ff6d0 0x7f130018c600 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 >> 172.21.15.6:0/4170084769 conn(0x7f13000fac90 msgr2=0x7f13000fb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 shutdown_connections 2023-09-13T09:32:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:17.624+0000 7f130564c700 1 -- 172.21.15.6:0/4170084769 wait complete. 2023-09-13T09:32:18.058 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-09-13T09:32:18.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-09-13T09:32:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:32:18.909 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:18 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4170084769' entity='client.admin' 2023-09-13T09:32:18.909 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:18.909 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:18.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:32:18.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:18.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:18.910 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.924+0000 7f3b8a024700 1 -- 172.21.15.6:0/2169702619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 msgr2=0x7f3b84100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.924+0000 7f3b8a024700 1 --2- 172.21.15.6:0/2169702619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84100c20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b74009910 tx=0x7f3b74009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.924+0000 7f3b8a024700 1 -- 172.21.15.6:0/2169702619 shutdown_connections 2023-09-13T09:32:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.924+0000 7f3b8a024700 1 --2- 172.21.15.6:0/2169702619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84100c20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.924+0000 7f3b8a024700 1 -- 172.21.15.6:0/2169702619 >> 172.21.15.6:0/2169702619 conn(0x7f3b840fbd80 msgr2=0x7f3b840fe1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.924+0000 7f3b8a024700 1 -- 172.21.15.6:0/2169702619 shutdown_connections 2023-09-13T09:32:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.925+0000 7f3b8a024700 1 -- 172.21.15.6:0/2169702619 wait complete. 2023-09-13T09:32:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.925+0000 7f3b8a024700 1 Processor -- start 2023-09-13T09:32:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.925+0000 7f3b8a024700 1 -- start start 2023-09-13T09:32:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.925+0000 7f3b8a024700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.925+0000 7f3b8a024700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b84195e50 con 0x7f3b84100800 2023-09-13T09:32:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.925+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.925+0000 7f3b837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59418/0 (socket says 172.21.15.6:59418) 2023-09-13T09:32:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b837fe700 1 -- 172.21.15.6:0/494106914 learned_addr learned my addr 172.21.15.6:0/494106914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b837fe700 1 -- 172.21.15.6:0/494106914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b740095f0 con 0x7f3b84100800 2023-09-13T09:32:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b837fe700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84195910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b74006010 tx=0x7f3b740057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b80ff9700 1 -- 172.21.15.6:0/494106914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b7401d070 con 0x7f3b84100800 2023-09-13T09:32:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b84196050 con 0x7f3b84100800 2023-09-13T09:32:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b80ff9700 1 -- 172.21.15.6:0/494106914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b740044e0 con 0x7f3b84100800 2023-09-13T09:32:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b80ff9700 1 -- 172.21.15.6:0/494106914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3b740039b0 con 0x7f3b84100800 2023-09-13T09:32:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.926+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b84196490 con 0x7f3b84100800 2023-09-13T09:32:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.927+0000 7f3b80ff9700 1 -- 172.21.15.6:0/494106914 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f3b74003c70 con 0x7f3b84100800 2023-09-13T09:32:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.927+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b8418f310 con 0x7f3b84100800 2023-09-13T09:32:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.927+0000 7f3b80ff9700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b70038400 0x7f3b7003a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.927+0000 7f3b80ff9700 1 -- 172.21.15.6:0/494106914 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3b7404c3d0 con 0x7f3b84100800 2023-09-13T09:32:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.927+0000 7f3b82ffd700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b70038400 0x7f3b7003a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.928+0000 7f3b82ffd700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b70038400 0x7f3b7003a8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006fd0 tx=0x7f3b6c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:19.933+0000 7f3b80ff9700 1 -- 172.21.15.6:0/494106914 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3b7402a950 con 0x7f3b84100800 2023-09-13T09:32:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.136+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f3b8402cf60 con 0x7f3b70038400 2023-09-13T09:32:20.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.139+0000 7f3b80ff9700 1 -- 172.21.15.6:0/494106914 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3b8402cf60 con 0x7f3b70038400 2023-09-13T09:32:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b70038400 msgr2=0x7f3b7003a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:20.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b70038400 0x7f3b7003a8c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c006fd0 tx=0x7f3b6c006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 msgr2=0x7f3b84195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84195910 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b74006010 tx=0x7f3b740057c0 comp rx=0 tx=0).stop 2023-09-13T09:32:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 shutdown_connections 2023-09-13T09:32:20.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b70038400 0x7f3b7003a8c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 --2- 172.21.15.6:0/494106914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b84100800 0x7f3b84195910 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.141+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 >> 172.21.15.6:0/494106914 conn(0x7f3b840fbd80 msgr2=0x7f3b840fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.142+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 shutdown_connections 2023-09-13T09:32:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:20.142+0000 7f3b8a024700 1 -- 172.21.15.6:0/494106914 wait complete. 2023-09-13T09:32:20.574 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi053 2023-09-13T09:32:20.575 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:32:20.576 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/etc/ceph/ceph.conf 2023-09-13T09:32:20.599 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:32:20.599 DEBUG:teuthology.orchestra.run.smithi053:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:20.660 INFO:tasks.cephadm:Adding host smithi053 to orchestrator... 2023-09-13T09:32:20.661 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch host add smithi053 2023-09-13T09:32:21.233 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:32:21.433 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:21.433 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:21.434 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:21.434 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:21.434 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:21.434 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: Updating smithi006:/etc/ceph/ceph.conf 2023-09-13T09:32:21.435 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: Updating smithi006:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:21.435 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:21 smithi006 ceph-mon[98665]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:22.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 -- 172.21.15.6:0/144337110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 msgr2=0x7f10e8106b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:22.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 --2- 172.21.15.6:0/144337110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e8106b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009910 tx=0x7f10dc009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:22.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 -- 172.21.15.6:0/144337110 shutdown_connections 2023-09-13T09:32:22.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 --2- 172.21.15.6:0/144337110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e8106b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:22.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 -- 172.21.15.6:0/144337110 >> 172.21.15.6:0/144337110 conn(0x7f10e80fc240 msgr2=0x7f10e80fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:22.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 -- 172.21.15.6:0/144337110 shutdown_connections 2023-09-13T09:32:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 -- 172.21.15.6:0/144337110 wait complete. 2023-09-13T09:32:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 Processor -- start 2023-09-13T09:32:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.393+0000 7f10eebbd700 1 -- start start 2023-09-13T09:32:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10eebbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e819bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:22.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10eebbd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e819c060 con 0x7f10e8106750 2023-09-13T09:32:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10ec959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e819bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10ec959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e819bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59424/0 (socket says 172.21.15.6:59424) 2023-09-13T09:32:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10ec959700 1 -- 172.21.15.6:0/1467549022 learned_addr learned my addr 172.21.15.6:0/1467549022 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10ec959700 1 -- 172.21.15.6:0/1467549022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc0095f0 con 0x7f10e8106750 2023-09-13T09:32:22.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10ec959700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e819bb20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f10dc006010 tx=0x7f10dc004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:22.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10e5ffb700 1 -- 172.21.15.6:0/1467549022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10dc01d070 con 0x7f10e8106750 2023-09-13T09:32:22.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e819c2c0 con 0x7f10e8106750 2023-09-13T09:32:22.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10e5ffb700 1 -- 172.21.15.6:0/1467549022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10dc00bbb0 con 0x7f10e8106750 2023-09-13T09:32:22.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.394+0000 7f10e5ffb700 1 -- 172.21.15.6:0/1467549022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10dc003930 con 0x7f10e8106750 2023-09-13T09:32:22.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.395+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e8195b10 con 0x7f10e8106750 2023-09-13T09:32:22.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.395+0000 7f10e5ffb700 1 -- 172.21.15.6:0/1467549022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f10dc003b70 con 0x7f10e8106750 2023-09-13T09:32:22.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.395+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e80622e0 con 0x7f10e8106750 2023-09-13T09:32:22.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.395+0000 7f10e5ffb700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10d8038400 0x7f10d803a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:22.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.395+0000 7f10e5ffb700 1 -- 172.21.15.6:0/1467549022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f10dc04c200 con 0x7f10e8106750 2023-09-13T09:32:22.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.396+0000 7f10e7fff700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10d8038400 0x7f10d803a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:22.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.396+0000 7f10e7fff700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10d8038400 0x7f10d803a8c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f10d4006fd0 tx=0x7f10d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:22.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.400+0000 7f10e5ffb700 1 -- 172.21.15.6:0/1467549022 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f10dc029950 con 0x7f10e8106750 2023-09-13T09:32:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:22 smithi006 ceph-mon[98665]: Updating smithi006:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-13T09:32:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:22.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:22.608+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi053", "target": ["mon-mgr", ""]}) v1 -- 0x7f10e810aa50 con 0x7f10d8038400 2023-09-13T09:32:23.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:23 smithi006 ceph-mon[98665]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi053", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:24.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:24 smithi006 ceph-mon[98665]: Deploying cephadm binary to smithi053 2023-09-13T09:32:25.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.462+0000 7f10e5ffb700 1 -- 172.21.15.6:0/1467549022 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7f10e810aa50 con 0x7f10d8038400 2023-09-13T09:32:25.463 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi053' with addr '172.21.15.53' 2023-09-13T09:32:25.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10d8038400 msgr2=0x7f10d803a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:25.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10d8038400 0x7f10d803a8c0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f10d4006fd0 tx=0x7f10d4006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:25.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 msgr2=0x7f10e819bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:25.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e819bb20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f10dc006010 tx=0x7f10dc004ff0 comp rx=0 tx=0).stop 2023-09-13T09:32:25.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 shutdown_connections 2023-09-13T09:32:25.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10d8038400 0x7f10d803a8c0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:25.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 --2- 172.21.15.6:0/1467549022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e8106750 0x7f10e819bb20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 >> 172.21.15.6:0/1467549022 conn(0x7f10e80fc240 msgr2=0x7f10e8108be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 shutdown_connections 2023-09-13T09:32:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:25.465+0000 7f10eebbd700 1 -- 172.21.15.6:0/1467549022 wait complete. 2023-09-13T09:32:25.901 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch host ls --format=json 2023-09-13T09:32:26.466 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:32:26.719 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:26.719 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:26 smithi006 ceph-mon[98665]: Added host smithi053 2023-09-13T09:32:26.720 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:26.720 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 -- 172.21.15.6:0/3030909586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 msgr2=0x7f3850105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 --2- 172.21.15.6:0/3030909586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850105a50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3840009910 tx=0x7f3840009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:27.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 -- 172.21.15.6:0/3030909586 shutdown_connections 2023-09-13T09:32:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 --2- 172.21.15.6:0/3030909586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850105a50 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 -- 172.21.15.6:0/3030909586 >> 172.21.15.6:0/3030909586 conn(0x7f38500fb180 msgr2=0x7f38500fd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 -- 172.21.15.6:0/3030909586 shutdown_connections 2023-09-13T09:32:27.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 -- 172.21.15.6:0/3030909586 wait complete. 2023-09-13T09:32:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.682+0000 7f38556f0700 1 Processor -- start 2023-09-13T09:32:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f38556f0700 1 -- start start 2023-09-13T09:32:27.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f38556f0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:27.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f38556f0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3850196ff0 con 0x7f3850105670 2023-09-13T09:32:27.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f384effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:27.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f384effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59450/0 (socket says 172.21.15.6:59450) 2023-09-13T09:32:27.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f384effd700 1 -- 172.21.15.6:0/2113784305 learned_addr learned my addr 172.21.15.6:0/2113784305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:27.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f384effd700 1 -- 172.21.15.6:0/2113784305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38400095f0 con 0x7f3850105670 2023-09-13T09:32:27.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f384effd700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850196ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3840004f40 tx=0x7f3840005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:27.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f3847fff700 1 -- 172.21.15.6:0/2113784305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f384001d070 con 0x7f3850105670 2023-09-13T09:32:27.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.683+0000 7f3847fff700 1 -- 172.21.15.6:0/2113784305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3840004370 con 0x7f3850105670 2023-09-13T09:32:27.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.684+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3850197250 con 0x7f3850105670 2023-09-13T09:32:27.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.684+0000 7f3847fff700 1 -- 172.21.15.6:0/2113784305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3840003970 con 0x7f3850105670 2023-09-13T09:32:27.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.684+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38501976d0 con 0x7f3850105670 2023-09-13T09:32:27.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.684+0000 7f3847fff700 1 -- 172.21.15.6:0/2113784305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f3840003c30 con 0x7f3850105670 2023-09-13T09:32:27.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.684+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3850197910 con 0x7f3850105670 2023-09-13T09:32:27.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.685+0000 7f3847fff700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f383c038400 0x7f383c03a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:27.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.685+0000 7f3847fff700 1 -- 172.21.15.6:0/2113784305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f384004c0c0 con 0x7f3850105670 2023-09-13T09:32:27.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.685+0000 7f384e7fc700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f383c038400 0x7f383c03a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:27.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.685+0000 7f384e7fc700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f383c038400 0x7f383c03a8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3838006fd0 tx=0x7f3838006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:27.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.690+0000 7f3847fff700 1 -- 172.21.15.6:0/2113784305 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f384002a590 con 0x7f3850105670 2023-09-13T09:32:27.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:27 smithi006 ceph-mon[98665]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:27.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.894+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3850068eb0 con 0x7f383c038400 2023-09-13T09:32:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.895+0000 7f3847fff700 1 -- 172.21.15.6:0/2113784305 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+158 (secure 0 0 0) 0x7f3850068eb0 con 0x7f383c038400 2023-09-13T09:32:27.896 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:27.897 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.53", "hostname": "smithi053", "labels": [], "status": ""}] 2023-09-13T09:32:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f383c038400 msgr2=0x7f383c03a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f383c038400 0x7f383c03a8c0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3838006fd0 tx=0x7f3838006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 msgr2=0x7f3850196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850196ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3840004f40 tx=0x7f3840005020 comp rx=0 tx=0).stop 2023-09-13T09:32:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 shutdown_connections 2023-09-13T09:32:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f383c038400 0x7f383c03a8c0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 --2- 172.21.15.6:0/2113784305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3850105670 0x7f3850196ab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 >> 172.21.15.6:0/2113784305 conn(0x7f38500fb180 msgr2=0x7f3850107b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 shutdown_connections 2023-09-13T09:32:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:27.897+0000 7f38556f0700 1 -- 172.21.15.6:0/2113784305 wait complete. 2023-09-13T09:32:28.315 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi131 2023-09-13T09:32:28.316 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:32:28.316 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.conf 2023-09-13T09:32:28.336 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:32:28.337 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:28.396 INFO:tasks.cephadm:Adding host smithi131 to orchestrator... 2023-09-13T09:32:28.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch host add smithi131 2023-09-13T09:32:28.959 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:32:29.174 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:28 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:29.175 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:28 smithi006 ceph-mon[98665]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:32:30.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.115+0000 7f9c2e23b700 1 -- 172.21.15.6:0/3646025246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 msgr2=0x7f9c28105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.115+0000 7f9c2e23b700 1 --2- 172.21.15.6:0/3646025246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28105a40 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c18009910 tx=0x7f9c18009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.115+0000 7f9c2e23b700 1 -- 172.21.15.6:0/3646025246 shutdown_connections 2023-09-13T09:32:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.115+0000 7f9c2e23b700 1 --2- 172.21.15.6:0/3646025246 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28105a40 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.115+0000 7f9c2e23b700 1 -- 172.21.15.6:0/3646025246 >> 172.21.15.6:0/3646025246 conn(0x7f9c280751b0 msgr2=0x7f9c280755c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.115+0000 7f9c2e23b700 1 -- 172.21.15.6:0/3646025246 shutdown_connections 2023-09-13T09:32:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.115+0000 7f9c2e23b700 1 -- 172.21.15.6:0/3646025246 wait complete. 2023-09-13T09:32:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.116+0000 7f9c2e23b700 1 Processor -- start 2023-09-13T09:32:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.116+0000 7f9c2e23b700 1 -- start start 2023-09-13T09:32:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.116+0000 7f9c2e23b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.116+0000 7f9c2e23b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c28197040 con 0x7f9c28105660 2023-09-13T09:32:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59456/0 (socket says 172.21.15.6:59456) 2023-09-13T09:32:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c277fe700 1 -- 172.21.15.6:0/384403998 learned_addr learned my addr 172.21.15.6:0/384403998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c277fe700 1 -- 172.21.15.6:0/384403998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c180095f0 con 0x7f9c28105660 2023-09-13T09:32:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c277fe700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28196b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c18004f40 tx=0x7f9c18005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c24ff9700 1 -- 172.21.15.6:0/384403998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c1801d070 con 0x7f9c28105660 2023-09-13T09:32:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c24ff9700 1 -- 172.21.15.6:0/384403998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c18004370 con 0x7f9c28105660 2023-09-13T09:32:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c281972a0 con 0x7f9c28105660 2023-09-13T09:32:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c24ff9700 1 -- 172.21.15.6:0/384403998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c18003970 con 0x7f9c28105660 2023-09-13T09:32:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.117+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c28197720 con 0x7f9c28105660 2023-09-13T09:32:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.118+0000 7f9c24ff9700 1 -- 172.21.15.6:0/384403998 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f9c18003c30 con 0x7f9c28105660 2023-09-13T09:32:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.118+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c28104910 con 0x7f9c28105660 2023-09-13T09:32:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.118+0000 7f9c24ff9700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c14038400 0x7f9c1403a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.118+0000 7f9c24ff9700 1 -- 172.21.15.6:0/384403998 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f9c1804bfe0 con 0x7f9c28105660 2023-09-13T09:32:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.118+0000 7f9c26ffd700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c14038400 0x7f9c1403a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.119+0000 7f9c26ffd700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c14038400 0x7f9c1403a8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9c10006fd0 tx=0x7f9c10006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.123+0000 7f9c24ff9700 1 -- 172.21.15.6:0/384403998 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9c18029360 con 0x7f9c28105660 2023-09-13T09:32:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:29 smithi006 ceph-mon[98665]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:30.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:30.331+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c28068560 con 0x7f9c14038400 2023-09-13T09:32:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:32.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:32.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:32.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:32:32.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:32.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:32.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: Updating smithi053:/etc/ceph/ceph.conf 2023-09-13T09:32:32.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:31 smithi006 ceph-mon[98665]: Deploying cephadm binary to smithi131 2023-09-13T09:32:33.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.240+0000 7f9c24ff9700 1 -- 172.21.15.6:0/384403998 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f9c28068560 con 0x7f9c14038400 2023-09-13T09:32:33.241 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi131' with addr '172.21.15.131' 2023-09-13T09:32:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c14038400 msgr2=0x7f9c1403a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c14038400 0x7f9c1403a8c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9c10006fd0 tx=0x7f9c10006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:33.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 msgr2=0x7f9c28196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28196b00 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9c18004f40 tx=0x7f9c18005020 comp rx=0 tx=0).stop 2023-09-13T09:32:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 shutdown_connections 2023-09-13T09:32:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c14038400 0x7f9c1403a8c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 --2- 172.21.15.6:0/384403998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c28105660 0x7f9c28196b00 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:33.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 >> 172.21.15.6:0/384403998 conn(0x7f9c280751b0 msgr2=0x7f9c280fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 shutdown_connections 2023-09-13T09:32:33.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:33.242+0000 7f9c2e23b700 1 -- 172.21.15.6:0/384403998 wait complete. 2023-09-13T09:32:33.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:32 smithi006 ceph-mon[98665]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:33.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:32 smithi006 ceph-mon[98665]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:33.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch host ls --format=json 2023-09-13T09:32:34.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:34.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-13T09:32:34.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:34.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:34.191 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:32:35.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:34 smithi006 ceph-mon[98665]: Added host smithi131 2023-09-13T09:32:35.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:34 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:35.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 -- 172.21.15.6:0/1248195210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 msgr2=0x7f7464106b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:35.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 --2- 172.21.15.6:0/1248195210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f7464106b40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7458009910 tx=0x7f7458009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 -- 172.21.15.6:0/1248195210 shutdown_connections 2023-09-13T09:32:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 --2- 172.21.15.6:0/1248195210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f7464106b40 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:35.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 -- 172.21.15.6:0/1248195210 >> 172.21.15.6:0/1248195210 conn(0x7f74640fc270 msgr2=0x7f74640fe690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:35.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 -- 172.21.15.6:0/1248195210 shutdown_connections 2023-09-13T09:32:35.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 -- 172.21.15.6:0/1248195210 wait complete. 2023-09-13T09:32:35.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.434+0000 7f7468c1d700 1 Processor -- start 2023-09-13T09:32:35.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f7468c1d700 1 -- start start 2023-09-13T09:32:35.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f7468c1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f746419b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:35.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f7468c1d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746419bf20 con 0x7f7464106760 2023-09-13T09:32:35.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f746259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f746419b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:35.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f746259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f746419b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59482/0 (socket says 172.21.15.6:59482) 2023-09-13T09:32:35.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f746259c700 1 -- 172.21.15.6:0/506532671 learned_addr learned my addr 172.21.15.6:0/506532671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:35.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f746259c700 1 -- 172.21.15.6:0/506532671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74580095f0 con 0x7f7464106760 2023-09-13T09:32:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f746259c700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f746419b9e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7458006010 tx=0x7f7458004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:35.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f74537fe700 1 -- 172.21.15.6:0/506532671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f745801d070 con 0x7f7464106760 2023-09-13T09:32:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f74537fe700 1 -- 172.21.15.6:0/506532671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f745800bbb0 con 0x7f7464106760 2023-09-13T09:32:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f746419c180 con 0x7f7464106760 2023-09-13T09:32:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.435+0000 7f74537fe700 1 -- 172.21.15.6:0/506532671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7458003930 con 0x7f7464106760 2023-09-13T09:32:35.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.436+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7464195a60 con 0x7f7464106760 2023-09-13T09:32:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.436+0000 7f74537fe700 1 -- 172.21.15.6:0/506532671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f7458003b20 con 0x7f7464106760 2023-09-13T09:32:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.436+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74640622e0 con 0x7f7464106760 2023-09-13T09:32:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.437+0000 7f74537fe700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f744c038450 0x7f744c03a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.437+0000 7f74537fe700 1 -- 172.21.15.6:0/506532671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f745804c1a0 con 0x7f7464106760 2023-09-13T09:32:35.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.437+0000 7f7461d9b700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f744c038450 0x7f744c03a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:35.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.437+0000 7f7461d9b700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f744c038450 0x7f744c03a910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7454006fd0 tx=0x7f7454006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:35.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.442+0000 7f74537fe700 1 -- 172.21.15.6:0/506532671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7458029360 con 0x7f7464106760 2023-09-13T09:32:35.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.661+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f746410aa60 con 0x7f744c038450 2023-09-13T09:32:35.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.662+0000 7f74537fe700 1 -- 172.21.15.6:0/506532671 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+238 (secure 0 0 0) 0x7f746410aa60 con 0x7f744c038450 2023-09-13T09:32:35.664 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:32:35.664 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.53", "hostname": "smithi053", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}] 2023-09-13T09:32:35.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f744c038450 msgr2=0x7f744c03a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:35.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f744c038450 0x7f744c03a910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7454006fd0 tx=0x7f7454006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:35.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 msgr2=0x7f746419b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:35.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f746419b9e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7458006010 tx=0x7f7458004ff0 comp rx=0 tx=0).stop 2023-09-13T09:32:35.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 shutdown_connections 2023-09-13T09:32:35.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f744c038450 0x7f744c03a910 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:35.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 --2- 172.21.15.6:0/506532671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7464106760 0x7f746419b9e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:35.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 >> 172.21.15.6:0/506532671 conn(0x7f74640fc270 msgr2=0x7f7464108c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:35.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 shutdown_connections 2023-09-13T09:32:35.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:35.665+0000 7f7468c1d700 1 -- 172.21.15.6:0/506532671 wait complete. 2023-09-13T09:32:36.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:35 smithi006 ceph-mon[98665]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:36.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:36.053 INFO:tasks.cephadm:Setting crush tunables to default 2023-09-13T09:32:36.053 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd crush tunables default 2023-09-13T09:32:36.615 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:32:37.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:36 smithi006 ceph-mon[98665]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:32:37.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.724+0000 7f91bc513700 1 -- 172.21.15.6:0/1134063116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 msgr2=0x7f91b4105a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:37.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.724+0000 7f91bc513700 1 --2- 172.21.15.6:0/1134063116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b4105a40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f91a4009910 tx=0x7f91a4009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:37.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.724+0000 7f91bc513700 1 -- 172.21.15.6:0/1134063116 shutdown_connections 2023-09-13T09:32:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.724+0000 7f91bc513700 1 --2- 172.21.15.6:0/1134063116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b4105a40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.724+0000 7f91bc513700 1 -- 172.21.15.6:0/1134063116 >> 172.21.15.6:0/1134063116 conn(0x7f91b40751b0 msgr2=0x7f91b40755c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.724+0000 7f91bc513700 1 -- 172.21.15.6:0/1134063116 shutdown_connections 2023-09-13T09:32:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.724+0000 7f91bc513700 1 -- 172.21.15.6:0/1134063116 wait complete. 2023-09-13T09:32:37.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.725+0000 7f91bc513700 1 Processor -- start 2023-09-13T09:32:37.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.725+0000 7f91bc513700 1 -- start start 2023-09-13T09:32:37.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.725+0000 7f91bc513700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.725+0000 7f91bc513700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91b419aec0 con 0x7f91b4105660 2023-09-13T09:32:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.725+0000 7f91ba2af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.725+0000 7f91ba2af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b419a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59488/0 (socket says 172.21.15.6:59488) 2023-09-13T09:32:37.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.725+0000 7f91ba2af700 1 -- 172.21.15.6:0/3384882690 learned_addr learned my addr 172.21.15.6:0/3384882690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:32:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.726+0000 7f91ba2af700 1 -- 172.21.15.6:0/3384882690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91a40095f0 con 0x7f91b4105660 2023-09-13T09:32:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.726+0000 7f91ba2af700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b419a980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91a4004f40 tx=0x7f91a4005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.726+0000 7f91ab7fe700 1 -- 172.21.15.6:0/3384882690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91a401d070 con 0x7f91b4105660 2023-09-13T09:32:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.726+0000 7f91ab7fe700 1 -- 172.21.15.6:0/3384882690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91a4004370 con 0x7f91b4105660 2023-09-13T09:32:37.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.726+0000 7f91ab7fe700 1 -- 172.21.15.6:0/3384882690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f91a4003970 con 0x7f91b4105660 2023-09-13T09:32:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.726+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91b419b120 con 0x7f91b4105660 2023-09-13T09:32:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.726+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91b4194a00 con 0x7f91b4105660 2023-09-13T09:32:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.727+0000 7f91ab7fe700 1 -- 172.21.15.6:0/3384882690 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f91a4003be0 con 0x7f91b4105660 2023-09-13T09:32:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.727+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91b40622e0 con 0x7f91b4105660 2023-09-13T09:32:37.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.727+0000 7f91ab7fe700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91a0038450 0x7f91a003a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.727+0000 7f91ab7fe700 1 -- 172.21.15.6:0/3384882690 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f91a404c020 con 0x7f91b4105660 2023-09-13T09:32:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.727+0000 7f91b9aae700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91a0038450 0x7f91a003a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.727+0000 7f91b9aae700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91a0038450 0x7f91a003a910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:37.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.733+0000 7f91ab7fe700 1 -- 172.21.15.6:0/3384882690 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f91a400bcd0 con 0x7f91b4105660 2023-09-13T09:32:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:37.942+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f91b4195f10 con 0x7f91b4105660 2023-09-13T09:32:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:37 smithi006 ceph-mon[98665]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:38.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.808+0000 7f91ab7fe700 1 -- 172.21.15.6:0/3384882690 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f91a4026070 con 0x7f91b4105660 2023-09-13T09:32:38.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91a0038450 msgr2=0x7f91a003a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:38.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91a0038450 0x7f91a003a910 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f91b0006fd0 tx=0x7f91b0006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:38.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 msgr2=0x7f91b419a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:38.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b419a980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f91a4004f40 tx=0x7f91a4005020 comp rx=0 tx=0).stop 2023-09-13T09:32:38.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 shutdown_connections 2023-09-13T09:32:38.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91a0038450 0x7f91a003a910 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:38.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 --2- 172.21.15.6:0/3384882690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f91b4105660 0x7f91b419a980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:38.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.810+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 >> 172.21.15.6:0/3384882690 conn(0x7f91b40751b0 msgr2=0x7f91b40fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:38.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.811+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 shutdown_connections 2023-09-13T09:32:38.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:32:38.811+0000 7f91bc513700 1 -- 172.21.15.6:0/3384882690 wait complete. 2023-09-13T09:32:38.814 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2023-09-13T09:32:39.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3384882690' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-13T09:32:39.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:39.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:39.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:39.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:39.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:32:39.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:39.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:39.281 INFO:tasks.cephadm:Adding mon.a on smithi006 2023-09-13T09:32:39.282 INFO:tasks.cephadm:Adding mon.b on smithi053 2023-09-13T09:32:39.282 INFO:tasks.cephadm:Adding mon.c on smithi131 2023-09-13T09:32:39.282 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch apply mon '3;smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c' 2023-09-13T09:32:39.867 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: Updating smithi131:/etc/ceph/ceph.conf 2023-09-13T09:32:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3384882690' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-13T09:32:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:41.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 -- 172.21.15.131:0/1087107079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 msgr2=0x7f7bc0106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:41.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 --2- 172.21.15.131:0/1087107079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc0106b20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009910 tx=0x7f7bb0009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:41.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 -- 172.21.15.131:0/1087107079 shutdown_connections 2023-09-13T09:32:41.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 --2- 172.21.15.131:0/1087107079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc0106b20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:41.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 -- 172.21.15.131:0/1087107079 >> 172.21.15.131:0/1087107079 conn(0x7f7bc0075da0 msgr2=0x7f7bc00761b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:41.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 -- 172.21.15.131:0/1087107079 shutdown_connections 2023-09-13T09:32:41.053 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 -- 172.21.15.131:0/1087107079 wait complete. 2023-09-13T09:32:41.053 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.049+0000 7f7bc5e88700 1 Processor -- start 2023-09-13T09:32:41.053 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.050+0000 7f7bc5e88700 1 -- start start 2023-09-13T09:32:41.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.050+0000 7f7bc5e88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc00ffe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:41.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.050+0000 7f7bc5e88700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bc0101dd0 con 0x7f7bc0106740 2023-09-13T09:32:41.056 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.050+0000 7f7bbf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc00ffe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:41.056 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.050+0000 7f7bbf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc00ffe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.131:40450/0 (socket says 172.21.15.131:40450) 2023-09-13T09:32:41.056 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.050+0000 7f7bbf7fe700 1 -- 172.21.15.131:0/2908158022 learned_addr learned my addr 172.21.15.131:0/2908158022 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:32:41.056 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.050+0000 7f7bbf7fe700 1 -- 172.21.15.131:0/2908158022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb00095f0 con 0x7f7bc0106740 2023-09-13T09:32:41.057 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.051+0000 7f7bbf7fe700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc00ffe50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0006010 tx=0x7f7bb0004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:41.057 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.051+0000 7f7bbcff9700 1 -- 172.21.15.131:0/2908158022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb001d070 con 0x7f7bc0106740 2023-09-13T09:32:41.057 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.051+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bc0100390 con 0x7f7bc0106740 2023-09-13T09:32:41.057 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.051+0000 7f7bbcff9700 1 -- 172.21.15.131:0/2908158022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7bb000bc10 con 0x7f7bc0106740 2023-09-13T09:32:41.057 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.051+0000 7f7bbcff9700 1 -- 172.21.15.131:0/2908158022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bb0003910 con 0x7f7bc0106740 2023-09-13T09:32:41.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.051+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bc0100810 con 0x7f7bc0106740 2023-09-13T09:32:41.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.052+0000 7f7bbcff9700 1 -- 172.21.15.131:0/2908158022 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f7bb000bd80 con 0x7f7bc0106740 2023-09-13T09:32:41.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.052+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bc0105a30 con 0x7f7bc0106740 2023-09-13T09:32:41.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.052+0000 7f7bbcff9700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7bac038400 0x7f7bac03a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:41.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.052+0000 7f7bbcff9700 1 -- 172.21.15.131:0/2908158022 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7bb004c190 con 0x7f7bc0106740 2023-09-13T09:32:41.058 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.052+0000 7f7bbeffd700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7bac038400 0x7f7bac03a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:41.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.053+0000 7f7bbeffd700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7bac038400 0x7f7bac03a8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006fd0 tx=0x7f7ba8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:41.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.057+0000 7f7bbcff9700 1 -- 172.21.15.131:0/2908158022 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7bb0029360 con 0x7f7bc0106740 2023-09-13T09:32:41.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:40 smithi006 ceph-mon[98665]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:41.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:40 smithi006 ceph-mon[98665]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-13T09:32:41.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.256+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f7bc0100b10 con 0x7f7bac038400 2023-09-13T09:32:41.267 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.267+0000 7f7bbcff9700 1 -- 172.21.15.131:0/2908158022 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f7bc0100b10 con 0x7f7bac038400 2023-09-13T09:32:41.268 INFO:teuthology.orchestra.run.smithi131.stdout:Scheduled mon update... 2023-09-13T09:32:41.269 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7bac038400 msgr2=0x7f7bac03a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:41.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7bac038400 0x7f7bac03a8c0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8006fd0 tx=0x7f7ba8006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:41.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 msgr2=0x7f7bc00ffe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:41.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc00ffe50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0006010 tx=0x7f7bb0004ff0 comp rx=0 tx=0).stop 2023-09-13T09:32:41.270 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 shutdown_connections 2023-09-13T09:32:41.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7bac038400 0x7f7bac03a8c0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:41.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 --2- 172.21.15.131:0/2908158022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7bc0106740 0x7f7bc00ffe50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:41.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 >> 172.21.15.131:0/2908158022 conn(0x7f7bc0075da0 msgr2=0x7f7bc00fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:41.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 shutdown_connections 2023-09-13T09:32:41.271 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:41.269+0000 7f7bc5e88700 1 -- 172.21.15.131:0/2908158022 wait complete. 2023-09-13T09:32:41.735 DEBUG:teuthology.orchestra.run.smithi053:mon.b> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.b.service 2023-09-13T09:32:41.738 DEBUG:teuthology.orchestra.run.smithi131:mon.c> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.c.service 2023-09-13T09:32:41.741 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-13T09:32:41.741 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph mon dump -f json 2023-09-13T09:32:41.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:32:41.775 INFO:journalctl@ceph.mon.b.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:32:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:42.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:42.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:42.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:32:42.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:42.329 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:43.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:42 smithi006 ceph-mon[98665]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:43.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:42 smithi006 ceph-mon[98665]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c;count:3 2023-09-13T09:32:43.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:42 smithi006 ceph-mon[98665]: Deploying daemon mon.c on smithi131 2023-09-13T09:32:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:43 smithi006 ceph-mon[98665]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:44.276 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.274+0000 7f88fdfd3700 1 -- 172.21.15.131:0/4250288215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 msgr2=0x7f88f8106b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:44.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.274+0000 7f88fdfd3700 1 --2- 172.21.15.131:0/4250288215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f8106b20 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f88ec009910 tx=0x7f88ec009c20 comp rx=0 tx=0).stop 2023-09-13T09:32:44.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.274+0000 7f88fdfd3700 1 -- 172.21.15.131:0/4250288215 shutdown_connections 2023-09-13T09:32:44.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.274+0000 7f88fdfd3700 1 --2- 172.21.15.131:0/4250288215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f8106b20 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:44.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.274+0000 7f88fdfd3700 1 -- 172.21.15.131:0/4250288215 >> 172.21.15.131:0/4250288215 conn(0x7f88f8075da0 msgr2=0x7f88f80761b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:44.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.274+0000 7f88fdfd3700 1 -- 172.21.15.131:0/4250288215 shutdown_connections 2023-09-13T09:32:44.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.274+0000 7f88fdfd3700 1 -- 172.21.15.131:0/4250288215 wait complete. 2023-09-13T09:32:44.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.275+0000 7f88fdfd3700 1 Processor -- start 2023-09-13T09:32:44.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.275+0000 7f88fdfd3700 1 -- start start 2023-09-13T09:32:44.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.275+0000 7f88fdfd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f819b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:44.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.275+0000 7f88fdfd3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f819bed0 con 0x7f88f8106740 2023-09-13T09:32:44.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.275+0000 7f88f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f819b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:44.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.275+0000 7f88f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f819b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.131:40456/0 (socket says 172.21.15.131:40456) 2023-09-13T09:32:44.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.275+0000 7f88f77fe700 1 -- 172.21.15.131:0/1777236860 learned_addr learned my addr 172.21.15.131:0/1777236860 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:32:44.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.276+0000 7f88f77fe700 1 -- 172.21.15.131:0/1777236860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0095f0 con 0x7f88f8106740 2023-09-13T09:32:44.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.276+0000 7f88f77fe700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f819b990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88ec006010 tx=0x7f88ec004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:44.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.276+0000 7f88f4ff9700 1 -- 172.21.15.131:0/1777236860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88ec01d070 con 0x7f88f8106740 2023-09-13T09:32:44.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.276+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f819c130 con 0x7f88f8106740 2023-09-13T09:32:44.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.276+0000 7f88f4ff9700 1 -- 172.21.15.131:0/1777236860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f88ec00bbb0 con 0x7f88f8106740 2023-09-13T09:32:44.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.276+0000 7f88f4ff9700 1 -- 172.21.15.131:0/1777236860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88ec003930 con 0x7f88f8106740 2023-09-13T09:32:44.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.276+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f8195a10 con 0x7f88f8106740 2023-09-13T09:32:44.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.277+0000 7f88f4ff9700 1 -- 172.21.15.131:0/1777236860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f88ec00bd20 con 0x7f88f8106740 2023-09-13T09:32:44.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.277+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f80622e0 con 0x7f88f8106740 2023-09-13T09:32:44.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.277+0000 7f88f4ff9700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f88e0038400 0x7f88e003a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:44.282 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.277+0000 7f88f4ff9700 1 -- 172.21.15.131:0/1777236860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f88ec04c0b0 con 0x7f88f8106740 2023-09-13T09:32:44.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.278+0000 7f88f6ffd700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f88e0038400 0x7f88e003a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:44.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.278+0000 7f88f6ffd700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f88e0038400 0x7f88e003a8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006fd0 tx=0x7f88e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:44.283 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.283+0000 7f88f4ff9700 1 -- 172.21.15.131:0/1777236860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f88ec029770 con 0x7f88f8106740 2023-09-13T09:32:44.582 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.581+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f88f8196f20 con 0x7f88f8106740 2023-09-13T09:32:44.583 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.582+0000 7f88f4ff9700 1 -- 172.21.15.131:0/1777236860 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7f88ec026070 con 0x7f88f8106740 2023-09-13T09:32:44.584 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:32:44.584 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","modified":"2023-09-13T09:31:01.875589Z","created":"2023-09-13T09:31:01.875589Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-09-13T09:32:44.585 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f88e0038400 msgr2=0x7f88e003a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:44.585 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f88e0038400 0x7f88e003a8c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f88e8006fd0 tx=0x7f88e8006e40 comp rx=0 tx=0).stop 2023-09-13T09:32:44.585 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 msgr2=0x7f88f819b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:44.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f819b990 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f88ec006010 tx=0x7f88ec004ff0 comp rx=0 tx=0).stop 2023-09-13T09:32:44.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 shutdown_connections 2023-09-13T09:32:44.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f88e0038400 0x7f88e003a8c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:44.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 --2- 172.21.15.131:0/1777236860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f8106740 0x7f88f819b990 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:44.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 >> 172.21.15.131:0/1777236860 conn(0x7f88f8075da0 msgr2=0x7f88f80fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:44.587 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 shutdown_connections 2023-09-13T09:32:44.587 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:44.584+0000 7f88fdfd3700 1 -- 172.21.15.131:0/1777236860 wait complete. 2023-09-13T09:32:44.587 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2023-09-13T09:32:44.612 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:44 smithi131 systemd[1]: Starting Ceph mon.c for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:32:45.226 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 podman[102743]: 2023-09-13T09:32:45.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:44 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/1777236860' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:45.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 bash[102743]: d8d85c2381b6554450e4194261e90983e9053604efb48fc1b3abcff8d24cb86d 2023-09-13T09:32:45.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: set uid:gid to 167:167 (ceph:ceph) 2023-09-13T09:32:45.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev), process ceph-mon, pid 7 2023-09-13T09:32:45.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pidfile_write: ignore empty --pid-file 2023-09-13T09:32:45.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: load: jerasure load: lrc 2023-09-13T09:32:45.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: RocksDB version: 7.9.2 2023-09-13T09:32:45.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Git sha 0 2023-09-13T09:32:45.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Compile date 2023-09-12 08:33:53 2023-09-13T09:32:45.774 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: DB SUMMARY 2023-09-13T09:32:45.774 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: DB Session ID: 7SBCRXTS7G2CM1SE9GJ1 2023-09-13T09:32:45.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: CURRENT file: CURRENT 2023-09-13T09:32:45.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: IDENTITY file: IDENTITY 2023-09-13T09:32:45.776 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-09-13T09:32:45.776 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-09-13T09:32:45.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-09-13T09:32:45.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.error_if_exists: 0 2023-09-13T09:32:45.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.create_if_missing: 0 2023-09-13T09:32:45.778 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.paranoid_checks: 1 2023-09-13T09:32:45.778 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-13T09:32:45.778 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-13T09:32:45.779 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-13T09:32:45.779 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.env: 0x56219c007da0 2023-09-13T09:32:45.779 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.fs: PosixFileSystem 2023-09-13T09:32:45.780 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.info_log: 0x56219d30d4a0 2023-09-13T09:32:45.780 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_file_opening_threads: 16 2023-09-13T09:32:45.780 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.statistics: (nil) 2023-09-13T09:32:45.780 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.use_fsync: 0 2023-09-13T09:32:45.781 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_log_file_size: 0 2023-09-13T09:32:45.781 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-13T09:32:45.781 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-13T09:32:45.786 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.keep_log_file_num: 1000 2023-09-13T09:32:45.786 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.recycle_log_file_num: 0 2023-09-13T09:32:45.786 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.allow_fallocate: 1 2023-09-13T09:32:45.786 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.allow_mmap_reads: 0 2023-09-13T09:32:45.787 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.allow_mmap_writes: 0 2023-09-13T09:32:45.787 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.use_direct_reads: 0 2023-09-13T09:32:45.787 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-13T09:32:45.787 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.create_missing_column_families: 0 2023-09-13T09:32:45.787 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.db_log_dir: 2023-09-13T09:32:45.788 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.wal_dir: 2023-09-13T09:32:45.788 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-13T09:32:45.788 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-13T09:32:45.788 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-13T09:32:45.789 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-13T09:32:45.789 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-13T09:32:45.789 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-13T09:32:45.789 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.advise_random_on_open: 1 2023-09-13T09:32:45.789 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.db_write_buffer_size: 0 2023-09-13T09:32:45.790 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.write_buffer_manager: 0x56219d2c74a0 2023-09-13T09:32:45.790 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-13T09:32:45.790 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-13T09:32:45.790 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-13T09:32:45.790 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.rate_limiter: (nil) 2023-09-13T09:32:45.791 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-13T09:32:45.791 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.wal_recovery_mode: 2 2023-09-13T09:32:45.791 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.enable_thread_tracking: 0 2023-09-13T09:32:45.791 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.enable_pipelined_write: 0 2023-09-13T09:32:45.791 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.unordered_write: 0 2023-09-13T09:32:45.792 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-13T09:32:45.792 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-13T09:32:45.792 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-13T09:32:45.792 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-13T09:32:45.792 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.row_cache: None 2023-09-13T09:32:45.792 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.wal_filter: None 2023-09-13T09:32:45.793 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-13T09:32:45.793 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.allow_ingest_behind: 0 2023-09-13T09:32:45.793 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.two_write_queues: 0 2023-09-13T09:32:45.793 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.manual_wal_flush: 0 2023-09-13T09:32:45.793 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.wal_compression: 0 2023-09-13T09:32:45.794 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.atomic_flush: 0 2023-09-13T09:32:45.794 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-13T09:32:45.794 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-13T09:32:45.794 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-13T09:32:45.794 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.log_readahead_size: 0 2023-09-13T09:32:45.795 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-13T09:32:45.795 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.best_efforts_recovery: 0 2023-09-13T09:32:45.795 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-13T09:32:45.795 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-13T09:32:45.795 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.allow_data_in_errors: 0 2023-09-13T09:32:45.796 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.db_host_id: __hostname__ 2023-09-13T09:32:45.796 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-13T09:32:45.796 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_background_jobs: 2 2023-09-13T09:32:45.796 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_background_compactions: -1 2023-09-13T09:32:45.796 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_subcompactions: 1 2023-09-13T09:32:45.797 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-13T09:32:45.797 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-13T09:32:45.797 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-13T09:32:45.797 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_total_wal_size: 0 2023-09-13T09:32:45.797 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-13T09:32:45.798 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-13T09:32:45.798 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-13T09:32:45.798 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-13T09:32:45.798 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_open_files: -1 2023-09-13T09:32:45.798 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bytes_per_sync: 0 2023-09-13T09:32:45.799 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-13T09:32:45.799 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-13T09:32:45.799 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_readahead_size: 0 2023-09-13T09:32:45.799 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_background_flushes: -1 2023-09-13T09:32:45.800 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Compression algorithms supported: 2023-09-13T09:32:45.800 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-13T09:32:45.800 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kZSTD supported: 0 2023-09-13T09:32:45.800 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kXpressCompression supported: 0 2023-09-13T09:32:45.801 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kLZ4HCCompression supported: 1 2023-09-13T09:32:45.801 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kZlibCompression supported: 1 2023-09-13T09:32:45.801 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kSnappyCompression supported: 1 2023-09-13T09:32:45.801 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kLZ4Compression supported: 1 2023-09-13T09:32:45.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: kBZip2Compression supported: 0 2023-09-13T09:32:45.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-13T09:32:45.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-13T09:32:45.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-09-13T09:32:45.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-13T09:32:45.803 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-13T09:32:45.803 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.merge_operator: 2023-09-13T09:32:45.803 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_filter: None 2023-09-13T09:32:45.803 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_filter_factory: None 2023-09-13T09:32:45.804 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.sst_partitioner_factory: None 2023-09-13T09:32:45.804 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-13T09:32:45.804 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-13T09:32:45.804 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56219d30d5a0) 2023-09-13T09:32:45.805 INFO:journalctl@ceph.mon.c.smithi131.stdout: cache_index_and_filter_blocks: 1 2023-09-13T09:32:45.805 INFO:journalctl@ceph.mon.c.smithi131.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-13T09:32:45.805 INFO:journalctl@ceph.mon.c.smithi131.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-13T09:32:45.805 INFO:journalctl@ceph.mon.c.smithi131.stdout: pin_top_level_index_and_filter: 1 2023-09-13T09:32:45.805 INFO:journalctl@ceph.mon.c.smithi131.stdout: index_type: 0 2023-09-13T09:32:45.806 INFO:journalctl@ceph.mon.c.smithi131.stdout: data_block_index_type: 0 2023-09-13T09:32:45.806 INFO:journalctl@ceph.mon.c.smithi131.stdout: index_shortening: 1 2023-09-13T09:32:45.806 INFO:journalctl@ceph.mon.c.smithi131.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-13T09:32:45.806 INFO:journalctl@ceph.mon.c.smithi131.stdout: checksum: 4 2023-09-13T09:32:45.807 INFO:journalctl@ceph.mon.c.smithi131.stdout: no_block_cache: 0 2023-09-13T09:32:45.807 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_cache: 0x56219d3651f0 2023-09-13T09:32:45.807 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_cache_name: BinnedLRUCache 2023-09-13T09:32:45.808 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_cache_options: 2023-09-13T09:32:45.808 INFO:journalctl@ceph.mon.c.smithi131.stdout: capacity : 536870912 2023-09-13T09:32:45.808 INFO:journalctl@ceph.mon.c.smithi131.stdout: num_shard_bits : 4 2023-09-13T09:32:45.808 INFO:journalctl@ceph.mon.c.smithi131.stdout: strict_capacity_limit : 0 2023-09-13T09:32:45.809 INFO:journalctl@ceph.mon.c.smithi131.stdout: high_pri_pool_ratio: 0.000 2023-09-13T09:32:45.809 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_cache_compressed: (nil) 2023-09-13T09:32:45.809 INFO:journalctl@ceph.mon.c.smithi131.stdout: persistent_cache: (nil) 2023-09-13T09:32:45.809 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_size: 4096 2023-09-13T09:32:45.811 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_size_deviation: 10 2023-09-13T09:32:45.812 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_restart_interval: 16 2023-09-13T09:32:45.813 INFO:journalctl@ceph.mon.c.smithi131.stdout: index_block_restart_interval: 1 2023-09-13T09:32:45.813 INFO:journalctl@ceph.mon.c.smithi131.stdout: metadata_block_size: 4096 2023-09-13T09:32:45.813 INFO:journalctl@ceph.mon.c.smithi131.stdout: partition_filters: 0 2023-09-13T09:32:45.814 INFO:journalctl@ceph.mon.c.smithi131.stdout: use_delta_encoding: 1 2023-09-13T09:32:45.814 INFO:journalctl@ceph.mon.c.smithi131.stdout: filter_policy: bloomfilter 2023-09-13T09:32:45.814 INFO:journalctl@ceph.mon.c.smithi131.stdout: whole_key_filtering: 1 2023-09-13T09:32:45.814 INFO:journalctl@ceph.mon.c.smithi131.stdout: verify_compression: 0 2023-09-13T09:32:45.815 INFO:journalctl@ceph.mon.c.smithi131.stdout: read_amp_bytes_per_bit: 0 2023-09-13T09:32:45.815 INFO:journalctl@ceph.mon.c.smithi131.stdout: format_version: 5 2023-09-13T09:32:45.815 INFO:journalctl@ceph.mon.c.smithi131.stdout: enable_index_compression: 1 2023-09-13T09:32:45.815 INFO:journalctl@ceph.mon.c.smithi131.stdout: block_align: 0 2023-09-13T09:32:45.815 INFO:journalctl@ceph.mon.c.smithi131.stdout: max_auto_readahead_size: 262144 2023-09-13T09:32:45.816 INFO:journalctl@ceph.mon.c.smithi131.stdout: prepopulate_block_cache: 0 2023-09-13T09:32:45.816 INFO:journalctl@ceph.mon.c.smithi131.stdout: initial_auto_readahead_size: 8192 2023-09-13T09:32:45.816 INFO:journalctl@ceph.mon.c.smithi131.stdout: num_file_reads_for_auto_readahead: 2 2023-09-13T09:32:45.816 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.write_buffer_size: 33554432 2023-09-13T09:32:45.817 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_write_buffer_number: 2 2023-09-13T09:32:45.817 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression: NoCompression 2023-09-13T09:32:45.817 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression: Disabled 2023-09-13T09:32:45.817 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.prefix_extractor: nullptr 2023-09-13T09:32:45.817 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-13T09:32:45.818 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.num_levels: 7 2023-09-13T09:32:45.818 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-13T09:32:45.818 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-13T09:32:45.819 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-13T09:32:45.819 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-13T09:32:45.819 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-13T09:32:45.819 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-13T09:32:45.820 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-13T09:32:45.820 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-13T09:32:45.820 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-13T09:32:45.820 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-13T09:32:45.820 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-13T09:32:45.821 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-13T09:32:45.821 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-13T09:32:45.821 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.level: 32767 2023-09-13T09:32:45.821 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.strategy: 0 2023-09-13T09:32:45.822 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-13T09:32:45.822 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-13T09:32:45.822 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-13T09:32:45.822 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-13T09:32:45.822 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.enabled: false 2023-09-13T09:32:45.823 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-13T09:32:45.823 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-13T09:32:45.823 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-13T09:32:45.823 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-13T09:32:45.824 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.target_file_size_base: 67108864 2023-09-13T09:32:45.824 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-13T09:32:45.824 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-13T09:32:45.824 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-13T09:32:45.825 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-13T09:32:45.825 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-13T09:32:45.825 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-13T09:32:45.825 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-13T09:32:45.825 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-13T09:32:45.826 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-13T09:32:45.826 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-13T09:32:45.826 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-13T09:32:45.827 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-13T09:32:45.827 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-13T09:32:45.827 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-13T09:32:45.827 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.arena_block_size: 1048576 2023-09-13T09:32:45.828 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-13T09:32:45.828 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-13T09:32:45.828 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.disable_auto_compactions: 0 2023-09-13T09:32:45.830 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-13T09:32:45.830 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-13T09:32:45.830 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-13T09:32:45.830 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-13T09:32:45.830 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-13T09:32:45.831 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-13T09:32:45.831 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-13T09:32:45.831 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-13T09:32:45.831 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-13T09:32:45.831 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-13T09:32:45.832 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.table_properties_collectors: 2023-09-13T09:32:45.832 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.inplace_update_support: 0 2023-09-13T09:32:45.832 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-13T09:32:45.833 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-13T09:32:45.833 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-13T09:32:45.833 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-13T09:32:45.833 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.bloom_locality: 0 2023-09-13T09:32:45.833 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.max_successive_merges: 0 2023-09-13T09:32:45.834 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-13T09:32:45.834 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.paranoid_file_checks: 0 2023-09-13T09:32:45.834 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.force_consistency_checks: 1 2023-09-13T09:32:45.835 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.report_bg_io_stats: 0 2023-09-13T09:32:45.835 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.ttl: 2592000 2023-09-13T09:32:45.836 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-13T09:32:45.836 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-13T09:32:45.836 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-13T09:32:45.837 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.enable_blob_files: false 2023-09-13T09:32:45.837 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.min_blob_size: 0 2023-09-13T09:32:45.837 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.blob_file_size: 268435456 2023-09-13T09:32:45.838 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-13T09:32:45.838 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-13T09:32:45.839 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-13T09:32:45.839 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-13T09:32:45.839 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-13T09:32:45.839 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.blob_file_starting_level: 0 2023-09-13T09:32:45.840 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-13T09:32:45.840 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-09-13T09:32:45.840 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-09-13T09:32:45.840 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8cd8ddb1-6d61-4a03-a5c0-56eaf5ed1fba 2023-09-13T09:32:45.841 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597565299969, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-09-13T09:32:45.841 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-09-13T09:32:45.841 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597565300550, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1694597565, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8cd8ddb1-6d61-4a03-a5c0-56eaf5ed1fba", "db_session_id": "7SBCRXTS7G2CM1SE9GJ1", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-09-13T09:32:45.842 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597565300639, "job": 1, "event": "recovery_finished"} 2023-09-13T09:32:45.842 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-09-13T09:32:45.842 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-13T09:32:45.842 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56219d402000 2023-09-13T09:32:45.843 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: DB pointer 0x56219d3ee000 2023-09-13T09:32:45.843 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-13T09:32:45.843 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-13T09:32:45.843 INFO:journalctl@ceph.mon.c.smithi131.stdout: ** DB Stats ** 2023-09-13T09:32:45.844 INFO:journalctl@ceph.mon.c.smithi131.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-13T09:32:45.844 INFO:journalctl@ceph.mon.c.smithi131.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-13T09:32:45.844 INFO:journalctl@ceph.mon.c.smithi131.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-13T09:32:45.844 INFO:journalctl@ceph.mon.c.smithi131.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-13T09:32:45.844 INFO:journalctl@ceph.mon.c.smithi131.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-13T09:32:45.845 INFO:journalctl@ceph.mon.c.smithi131.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-13T09:32:45.845 INFO:journalctl@ceph.mon.c.smithi131.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-13T09:32:45.845 INFO:journalctl@ceph.mon.c.smithi131.stdout: 2023-09-13T09:32:45.845 INFO:journalctl@ceph.mon.c.smithi131.stdout: ** Compaction Stats [default] ** 2023-09-13T09:32:45.845 INFO:journalctl@ceph.mon.c.smithi131.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-13T09:32:45.846 INFO:journalctl@ceph.mon.c.smithi131.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-13T09:32:45.846 INFO:journalctl@ceph.mon.c.smithi131.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:32:45.846 INFO:journalctl@ceph.mon.c.smithi131.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:32:45.846 INFO:journalctl@ceph.mon.c.smithi131.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:32:45.847 INFO:journalctl@ceph.mon.c.smithi131.stdout: 2023-09-13T09:32:45.847 INFO:journalctl@ceph.mon.c.smithi131.stdout: ** Compaction Stats [default] ** 2023-09-13T09:32:45.847 INFO:journalctl@ceph.mon.c.smithi131.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-13T09:32:45.848 INFO:journalctl@ceph.mon.c.smithi131.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-13T09:32:45.848 INFO:journalctl@ceph.mon.c.smithi131.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-09-13T09:32:45.848 INFO:journalctl@ceph.mon.c.smithi131.stdout: 2023-09-13T09:32:45.849 INFO:journalctl@ceph.mon.c.smithi131.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-13T09:32:45.849 INFO:journalctl@ceph.mon.c.smithi131.stdout: 2023-09-13T09:32:45.850 INFO:journalctl@ceph.mon.c.smithi131.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-13T09:32:45.850 INFO:journalctl@ceph.mon.c.smithi131.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-13T09:32:45.851 INFO:journalctl@ceph.mon.c.smithi131.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-13T09:32:45.851 INFO:journalctl@ceph.mon.c.smithi131.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-13T09:32:45.851 INFO:journalctl@ceph.mon.c.smithi131.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-13T09:32:45.852 INFO:journalctl@ceph.mon.c.smithi131.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-13T09:32:45.852 INFO:journalctl@ceph.mon.c.smithi131.stdout: Cumulative compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-13T09:32:45.852 INFO:journalctl@ceph.mon.c.smithi131.stdout: Interval compaction: 0.00 GB write, 0.46 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-13T09:32:45.853 INFO:journalctl@ceph.mon.c.smithi131.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-13T09:32:45.853 INFO:journalctl@ceph.mon.c.smithi131.stdout: Block cache BinnedLRUCache@0x56219d3651f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-09-13T09:32:45.853 INFO:journalctl@ceph.mon.c.smithi131.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-09-13T09:32:45.854 INFO:journalctl@ceph.mon.c.smithi131.stdout: 2023-09-13T09:32:45.854 INFO:journalctl@ceph.mon.c.smithi131.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-13T09:32:45.854 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-09-13T09:32:45.854 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: using public_addr v2:172.21.15.131:0/0 -> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-09-13T09:32:45.855 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 systemd[1]: Started Ceph mon.c for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:32:45.855 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: starting mon.c rank -1 at public addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] at bind addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:32:45.855 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(???) e0 preinit fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:32:45.856 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).mds e1 new map 2023-09-13T09:32:45.856 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).mds e1 print_map 2023-09-13T09:32:45.856 INFO:journalctl@ceph.mon.c.smithi131.stdout: e1 2023-09-13T09:32:45.856 INFO:journalctl@ceph.mon.c.smithi131.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-13T09:32:45.857 INFO:journalctl@ceph.mon.c.smithi131.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-13T09:32:45.857 INFO:journalctl@ceph.mon.c.smithi131.stdout: legacy client fscid: -1 2023-09-13T09:32:45.857 INFO:journalctl@ceph.mon.c.smithi131.stdout: 2023-09-13T09:32:45.857 INFO:journalctl@ceph.mon.c.smithi131.stdout: No filesystems configured 2023-09-13T09:32:45.857 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-09-13T09:32:45.858 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-09-13T09:32:45.858 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-09-13T09:32:45.858 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-09-13T09:32:45.859 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-09-13T09:32:45.859 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-09-13T09:32:45.859 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-13T09:32:45.859 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:32:45.859 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:32:45.860 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:32:45.860 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:45.860 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:45.860 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.860 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.861 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.861 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.861 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:32:45.861 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:45.861 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:45.862 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi053:/etc/ceph/ceph.conf 2023-09-13T09:32:45.862 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Deploying cephadm binary to smithi131 2023-09-13T09:32:45.862 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:45.863 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:45.863 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:45.863 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-13T09:32:45.863 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.864 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.864 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.864 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.865 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:45.865 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.865 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Added host smithi131 2023-09-13T09:32:45.865 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.866 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:45.866 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.866 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:32:45.866 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:45.866 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3384882690' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-13T09:32:45.867 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.867 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.867 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.867 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.868 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:32:45.868 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:45.868 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:45.868 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:45.868 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi131:/etc/ceph/ceph.conf 2023-09-13T09:32:45.869 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:45.869 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3384882690' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-13T09:32:45.869 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:45.869 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.870 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.870 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.870 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:45.871 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-13T09:32:45.871 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:45.871 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.871 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:45.872 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:45.872 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:45.872 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:45.872 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:32:45.872 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:45.873 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:45.873 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c;count:3 2023-09-13T09:32:45.873 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: Deploying daemon mon.c on smithi131 2023-09-13T09:32:45.873 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:45.874 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/1777236860' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:45.874 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-09-13T09:32:45.874 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expand map: {default=false} 2023-09-13T09:32:45.874 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta from 'false' to 'false' 2023-09-13T09:32:45.875 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expanded map: {default=false} 2023-09-13T09:32:45.875 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expand map: {default=info} 2023-09-13T09:32:45.875 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta from 'info' to 'info' 2023-09-13T09:32:45.875 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expanded map: {default=info} 2023-09-13T09:32:45.875 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expand map: {default=daemon} 2023-09-13T09:32:45.876 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta from 'daemon' to 'daemon' 2023-09-13T09:32:45.876 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expanded map: {default=daemon} 2023-09-13T09:32:45.876 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expand map: {default=debug} 2023-09-13T09:32:45.876 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta from 'debug' to 'debug' 2023-09-13T09:32:45.876 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: expand_channel_meta expanded map: {default=debug} 2023-09-13T09:32:45.876 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:45 smithi131 ceph-mon[102785]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-09-13T09:32:46.021 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-13T09:32:46.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph mon dump -f json 2023-09-13T09:32:46.582 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:32:50.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:32:50.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: mon.a calling monitor election 2023-09-13T09:32:50.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:50.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: mon.c calling monitor election 2023-09-13T09:32:50.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:50.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-13T09:32:50.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: monmap e2: 2 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:32:50.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: fsmap 2023-09-13T09:32:50.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:50.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: mgrmap e13: x(active, since 44s) 2023-09-13T09:32:50.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: overall HEALTH_OK 2023-09-13T09:32:50.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:50.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:50.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:32:50.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: mon.a calling monitor election 2023-09-13T09:32:50.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:50.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: mon.c calling monitor election 2023-09-13T09:32:50.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:50.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:50.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-13T09:32:50.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: monmap e2: 2 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:32:50.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: fsmap 2023-09-13T09:32:50.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:50.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: mgrmap e13: x(active, since 44s) 2023-09-13T09:32:50.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: overall HEALTH_OK 2023-09-13T09:32:50.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:50.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:50.804 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.803+0000 7f18eb555700 1 -- 172.21.15.131:0/1888640575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41057b0 msgr2=0x7f18d0005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:50.804 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.803+0000 7f18eb555700 1 --2- 172.21.15.131:0/1888640575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41057b0 0x7f18d0005610 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f18d4005fa0 tx=0x7f18d400ffc0 comp rx=0 tx=0).stop 2023-09-13T09:32:50.805 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.803+0000 7f18eb555700 1 -- 172.21.15.131:0/1888640575 shutdown_connections 2023-09-13T09:32:50.805 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.803+0000 7f18eb555700 1 --2- 172.21.15.131:0/1888640575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41057b0 0x7f18d0005610 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:50.805 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.803+0000 7f18eb555700 1 -- 172.21.15.131:0/1888640575 >> 172.21.15.131:0/1888640575 conn(0x7f18e40752c0 msgr2=0x7f18e40756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:50.805 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.803+0000 7f18eb555700 1 -- 172.21.15.131:0/1888640575 shutdown_connections 2023-09-13T09:32:50.805 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.803+0000 7f18eb555700 1 -- 172.21.15.131:0/1888640575 wait complete. 2023-09-13T09:32:50.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.804+0000 7f18eb555700 1 Processor -- start 2023-09-13T09:32:50.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.804+0000 7f18eb555700 1 -- start start 2023-09-13T09:32:50.807 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18eb555700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 0x7f18e4101370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:50.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18eb555700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41018b0 0x7f18e4101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:50.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18eb555700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41032f0 con 0x7f18e41018b0 2023-09-13T09:32:50.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18eb555700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e41a1f10 con 0x7f18e41057b0 2023-09-13T09:32:50.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e92f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 0x7f18e4101370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:50.808 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e92f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 0x7f18e4101370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33460/0 (socket says 172.21.15.131:33460) 2023-09-13T09:32:50.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e92f1700 1 -- 172.21.15.131:0/4116021460 learned_addr learned my addr 172.21.15.131:0/4116021460 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:32:50.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e8af0700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41018b0 0x7f18e4101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:50.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e92f1700 1 -- 172.21.15.131:0/4116021460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 msgr2=0x7f18e4101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-09-13T09:32:50.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e92f1700 1 -- 172.21.15.131:0/4116021460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 msgr2=0x7f18e4101370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-13T09:32:50.809 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e92f1700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 0x7f18e4101370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T09:32:50.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e92f1700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 0x7f18e4101370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T09:32:50.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e8af0700 1 -- 172.21.15.131:0/4116021460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 msgr2=0x7f18e4101370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:32:50.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e8af0700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 0x7f18e4101370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:50.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.805+0000 7f18e8af0700 1 -- 172.21.15.131:0/4116021460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d400f9c0 con 0x7f18e41018b0 2023-09-13T09:32:50.810 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.806+0000 7f18e8af0700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41018b0 0x7f18e4101d30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18e000b4d0 tx=0x7f18e000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:50.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.806+0000 7f18da7fc700 1 -- 172.21.15.131:0/4116021460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f18e0011630 con 0x7f18e41018b0 2023-09-13T09:32:50.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.806+0000 7f18da7fc700 1 -- 172.21.15.131:0/4116021460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f18e0011c50 con 0x7f18e41018b0 2023-09-13T09:32:50.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.806+0000 7f18da7fc700 1 -- 172.21.15.131:0/4116021460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f18e0010c60 con 0x7f18e41018b0 2023-09-13T09:32:50.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.806+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e41a2110 con 0x7f18e41018b0 2023-09-13T09:32:50.811 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.806+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e41a25e0 con 0x7f18e41018b0 2023-09-13T09:32:50.812 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.807+0000 7f18da7fc700 1 -- 172.21.15.131:0/4116021460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f18e001a410 con 0x7f18e41018b0 2023-09-13T09:32:50.812 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.807+0000 7f18da7fc700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18c8038240 0x7f18c803a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:50.813 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.807+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e40622e0 con 0x7f18e41018b0 2023-09-13T09:32:50.813 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.807+0000 7f18da7fc700 1 -- 172.21.15.131:0/4116021460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f18e004a3a0 con 0x7f18e41018b0 2023-09-13T09:32:50.813 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.807+0000 7f18e92f1700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18c8038240 0x7f18c803a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:50.813 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.808+0000 7f18e92f1700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18c8038240 0x7f18c803a700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18d40059d0 tx=0x7f18d4005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:50.814 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:50.813+0000 7f18da7fc700 1 -- 172.21.15.131:0/4116021460 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f18e00193b0 con 0x7f18e41018b0 2023-09-13T09:32:51.083 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.082+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f18e41028a0 con 0x7f18e41018b0 2023-09-13T09:32:51.084 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.083+0000 7f18da7fc700 1 -- 172.21.15.131:0/4116021460 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7f18e0030640 con 0x7f18e41018b0 2023-09-13T09:32:51.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:32:51.085 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":2,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","modified":"2023-09-13T09:32:45.333832Z","created":"2023-09-13T09:31:01.875589Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-09-13T09:32:51.086 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18c8038240 msgr2=0x7f18c803a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:51.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18c8038240 0x7f18c803a700 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f18d40059d0 tx=0x7f18d4005940 comp rx=0 tx=0).stop 2023-09-13T09:32:51.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41018b0 msgr2=0x7f18e4101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:51.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41018b0 0x7f18e4101d30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18e000b4d0 tx=0x7f18e000b890 comp rx=0 tx=0).stop 2023-09-13T09:32:51.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 shutdown_connections 2023-09-13T09:32:51.087 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18e41057b0 0x7f18e4101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:51.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18c8038240 0x7f18c803a700 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:51.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 --2- 172.21.15.131:0/4116021460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18e41018b0 0x7f18e4101d30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:51.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 >> 172.21.15.131:0/4116021460 conn(0x7f18e40752c0 msgr2=0x7f18e4068440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:51.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 shutdown_connections 2023-09-13T09:32:51.088 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:51.086+0000 7f18eb555700 1 -- 172.21.15.131:0/4116021460 wait complete. 2023-09-13T09:32:51.089 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 2 2023-09-13T09:32:51.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:51 smithi006 ceph-mon[98665]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:51.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:51.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:32:51.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:51 smithi006 ceph-mon[98665]: Deploying daemon mon.b on smithi053 2023-09-13T09:32:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:51 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/4116021460' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:51.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:51 smithi131 ceph-mon[102785]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:51.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:51.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:32:51.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:51.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:51 smithi131 ceph-mon[102785]: Deploying daemon mon.b on smithi053 2023-09-13T09:32:51.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:51 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/4116021460' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:51.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:52.537 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-09-13T09:32:52.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph mon dump -f json 2023-09-13T09:32:53.099 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:32:53.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 systemd[1]: Starting Ceph mon.b for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:32:53.575 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:53 smithi131 ceph-mon[102785]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:53 smithi006 ceph-mon[98665]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 podman[102333]: 2023-09-13T09:32:53.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 bash[102333]: a2cb28b0b378b33dcce44d7a3b452d430448bfc7e45b5d0c681cbc51c21ba7d1 2023-09-13T09:32:53.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: set uid:gid to 167:167 (ceph:ceph) 2023-09-13T09:32:53.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: ceph version 18.0.0-6083-g4a754ac9 (4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5) reef (dev), process ceph-mon, pid 7 2023-09-13T09:32:53.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pidfile_write: ignore empty --pid-file 2023-09-13T09:32:53.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: load: jerasure load: lrc 2023-09-13T09:32:53.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: RocksDB version: 7.9.2 2023-09-13T09:32:53.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Git sha 0 2023-09-13T09:32:53.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Compile date 2023-09-12 08:33:53 2023-09-13T09:32:53.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: DB SUMMARY 2023-09-13T09:32:53.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: DB Session ID: ETWOIXKY93OH429RWZWI 2023-09-13T09:32:53.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: CURRENT file: CURRENT 2023-09-13T09:32:53.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: IDENTITY file: IDENTITY 2023-09-13T09:32:53.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-09-13T09:32:53.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-09-13T09:32:53.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-09-13T09:32:53.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.error_if_exists: 0 2023-09-13T09:32:53.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.create_if_missing: 0 2023-09-13T09:32:53.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.paranoid_checks: 1 2023-09-13T09:32:53.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.flush_verify_memtable_count: 1 2023-09-13T09:32:53.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-09-13T09:32:53.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-09-13T09:32:53.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.env: 0x55be69cc0da0 2023-09-13T09:32:53.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.fs: PosixFileSystem 2023-09-13T09:32:53.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.info_log: 0x55be6a6854a0 2023-09-13T09:32:53.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_file_opening_threads: 16 2023-09-13T09:32:53.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.statistics: (nil) 2023-09-13T09:32:53.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.use_fsync: 0 2023-09-13T09:32:53.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_log_file_size: 0 2023-09-13T09:32:53.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-09-13T09:32:53.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.log_file_time_to_roll: 0 2023-09-13T09:32:53.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.keep_log_file_num: 1000 2023-09-13T09:32:53.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.recycle_log_file_num: 0 2023-09-13T09:32:53.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.allow_fallocate: 1 2023-09-13T09:32:53.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.allow_mmap_reads: 0 2023-09-13T09:32:53.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.allow_mmap_writes: 0 2023-09-13T09:32:53.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.use_direct_reads: 0 2023-09-13T09:32:53.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-09-13T09:32:53.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.create_missing_column_families: 0 2023-09-13T09:32:53.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.db_log_dir: 2023-09-13T09:32:53.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.wal_dir: 2023-09-13T09:32:53.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.table_cache_numshardbits: 6 2023-09-13T09:32:53.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.WAL_ttl_seconds: 0 2023-09-13T09:32:53.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.WAL_size_limit_MB: 0 2023-09-13T09:32:53.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-09-13T09:32:53.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-09-13T09:32:53.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.is_fd_close_on_exec: 1 2023-09-13T09:32:53.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.advise_random_on_open: 1 2023-09-13T09:32:53.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.db_write_buffer_size: 0 2023-09-13T09:32:53.766 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.write_buffer_manager: 0x55be6a63f4a0 2023-09-13T09:32:53.766 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-09-13T09:32:53.766 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-09-13T09:32:53.766 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.use_adaptive_mutex: 0 2023-09-13T09:32:53.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.rate_limiter: (nil) 2023-09-13T09:32:53.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-09-13T09:32:53.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.wal_recovery_mode: 2 2023-09-13T09:32:53.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.enable_thread_tracking: 0 2023-09-13T09:32:53.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.enable_pipelined_write: 0 2023-09-13T09:32:53.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.unordered_write: 0 2023-09-13T09:32:53.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-09-13T09:32:53.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-09-13T09:32:53.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-09-13T09:32:53.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-09-13T09:32:53.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.row_cache: None 2023-09-13T09:32:53.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.wal_filter: None 2023-09-13T09:32:53.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-09-13T09:32:53.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.allow_ingest_behind: 0 2023-09-13T09:32:53.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.two_write_queues: 0 2023-09-13T09:32:53.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.manual_wal_flush: 0 2023-09-13T09:32:53.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.wal_compression: 0 2023-09-13T09:32:53.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.atomic_flush: 0 2023-09-13T09:32:53.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-09-13T09:32:53.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.persist_stats_to_disk: 0 2023-09-13T09:32:53.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.write_dbid_to_manifest: 0 2023-09-13T09:32:53.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.log_readahead_size: 0 2023-09-13T09:32:53.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-09-13T09:32:53.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.best_efforts_recovery: 0 2023-09-13T09:32:53.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-09-13T09:32:53.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-09-13T09:32:53.773 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.allow_data_in_errors: 0 2023-09-13T09:32:53.773 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.db_host_id: __hostname__ 2023-09-13T09:32:53.773 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.enforce_single_del_contracts: true 2023-09-13T09:32:53.774 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_background_jobs: 2 2023-09-13T09:32:53.774 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_background_compactions: -1 2023-09-13T09:32:53.774 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_subcompactions: 1 2023-09-13T09:32:53.774 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-09-13T09:32:53.774 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-09-13T09:32:53.775 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.delayed_write_rate : 16777216 2023-09-13T09:32:53.775 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_total_wal_size: 0 2023-09-13T09:32:53.775 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-09-13T09:32:53.775 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.stats_dump_period_sec: 600 2023-09-13T09:32:53.775 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.stats_persist_period_sec: 600 2023-09-13T09:32:53.775 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-09-13T09:32:53.776 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_open_files: -1 2023-09-13T09:32:53.776 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bytes_per_sync: 0 2023-09-13T09:32:53.776 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.wal_bytes_per_sync: 0 2023-09-13T09:32:53.776 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.strict_bytes_per_sync: 0 2023-09-13T09:32:53.776 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_readahead_size: 0 2023-09-13T09:32:53.777 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_background_flushes: -1 2023-09-13T09:32:53.777 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Compression algorithms supported: 2023-09-13T09:32:53.777 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-09-13T09:32:53.777 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kZSTD supported: 0 2023-09-13T09:32:53.777 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kXpressCompression supported: 0 2023-09-13T09:32:53.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kLZ4HCCompression supported: 1 2023-09-13T09:32:53.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kZlibCompression supported: 1 2023-09-13T09:32:53.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kSnappyCompression supported: 1 2023-09-13T09:32:53.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kLZ4Compression supported: 1 2023-09-13T09:32:53.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: kBZip2Compression supported: 0 2023-09-13T09:32:53.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Fast CRC32 supported: Supported on x86 2023-09-13T09:32:53.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: DMutex implementation: pthread_mutex_t 2023-09-13T09:32:53.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-09-13T09:32:53.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-09-13T09:32:53.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-09-13T09:32:53.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.merge_operator: 2023-09-13T09:32:53.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_filter: None 2023-09-13T09:32:53.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_filter_factory: None 2023-09-13T09:32:53.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.sst_partitioner_factory: None 2023-09-13T09:32:53.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.memtable_factory: SkipListFactory 2023-09-13T09:32:53.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.table_factory: BlockBasedTable 2023-09-13T09:32:53.781 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55be6a6855a0) 2023-09-13T09:32:53.781 INFO:journalctl@ceph.mon.b.smithi053.stdout: cache_index_and_filter_blocks: 1 2023-09-13T09:32:53.781 INFO:journalctl@ceph.mon.b.smithi053.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-09-13T09:32:53.781 INFO:journalctl@ceph.mon.b.smithi053.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-09-13T09:32:53.781 INFO:journalctl@ceph.mon.b.smithi053.stdout: pin_top_level_index_and_filter: 1 2023-09-13T09:32:53.781 INFO:journalctl@ceph.mon.b.smithi053.stdout: index_type: 0 2023-09-13T09:32:53.782 INFO:journalctl@ceph.mon.b.smithi053.stdout: data_block_index_type: 0 2023-09-13T09:32:53.782 INFO:journalctl@ceph.mon.b.smithi053.stdout: index_shortening: 1 2023-09-13T09:32:53.782 INFO:journalctl@ceph.mon.b.smithi053.stdout: data_block_hash_table_util_ratio: 0.750000 2023-09-13T09:32:53.782 INFO:journalctl@ceph.mon.b.smithi053.stdout: checksum: 4 2023-09-13T09:32:53.782 INFO:journalctl@ceph.mon.b.smithi053.stdout: no_block_cache: 0 2023-09-13T09:32:53.783 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_cache: 0x55be6a6dd1f0 2023-09-13T09:32:53.783 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_cache_name: BinnedLRUCache 2023-09-13T09:32:53.783 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_cache_options: 2023-09-13T09:32:53.783 INFO:journalctl@ceph.mon.b.smithi053.stdout: capacity : 536870912 2023-09-13T09:32:53.783 INFO:journalctl@ceph.mon.b.smithi053.stdout: num_shard_bits : 4 2023-09-13T09:32:53.784 INFO:journalctl@ceph.mon.b.smithi053.stdout: strict_capacity_limit : 0 2023-09-13T09:32:53.784 INFO:journalctl@ceph.mon.b.smithi053.stdout: high_pri_pool_ratio: 0.000 2023-09-13T09:32:53.784 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_cache_compressed: (nil) 2023-09-13T09:32:53.784 INFO:journalctl@ceph.mon.b.smithi053.stdout: persistent_cache: (nil) 2023-09-13T09:32:53.784 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_size: 4096 2023-09-13T09:32:53.784 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_size_deviation: 10 2023-09-13T09:32:53.785 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_restart_interval: 16 2023-09-13T09:32:53.785 INFO:journalctl@ceph.mon.b.smithi053.stdout: index_block_restart_interval: 1 2023-09-13T09:32:53.785 INFO:journalctl@ceph.mon.b.smithi053.stdout: metadata_block_size: 4096 2023-09-13T09:32:53.785 INFO:journalctl@ceph.mon.b.smithi053.stdout: partition_filters: 0 2023-09-13T09:32:53.785 INFO:journalctl@ceph.mon.b.smithi053.stdout: use_delta_encoding: 1 2023-09-13T09:32:53.786 INFO:journalctl@ceph.mon.b.smithi053.stdout: filter_policy: bloomfilter 2023-09-13T09:32:53.786 INFO:journalctl@ceph.mon.b.smithi053.stdout: whole_key_filtering: 1 2023-09-13T09:32:53.786 INFO:journalctl@ceph.mon.b.smithi053.stdout: verify_compression: 0 2023-09-13T09:32:53.786 INFO:journalctl@ceph.mon.b.smithi053.stdout: read_amp_bytes_per_bit: 0 2023-09-13T09:32:53.786 INFO:journalctl@ceph.mon.b.smithi053.stdout: format_version: 5 2023-09-13T09:32:53.787 INFO:journalctl@ceph.mon.b.smithi053.stdout: enable_index_compression: 1 2023-09-13T09:32:53.787 INFO:journalctl@ceph.mon.b.smithi053.stdout: block_align: 0 2023-09-13T09:32:53.787 INFO:journalctl@ceph.mon.b.smithi053.stdout: max_auto_readahead_size: 262144 2023-09-13T09:32:53.787 INFO:journalctl@ceph.mon.b.smithi053.stdout: prepopulate_block_cache: 0 2023-09-13T09:32:53.787 INFO:journalctl@ceph.mon.b.smithi053.stdout: initial_auto_readahead_size: 8192 2023-09-13T09:32:53.788 INFO:journalctl@ceph.mon.b.smithi053.stdout: num_file_reads_for_auto_readahead: 2 2023-09-13T09:32:53.788 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.write_buffer_size: 33554432 2023-09-13T09:32:53.788 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_write_buffer_number: 2 2023-09-13T09:32:53.788 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression: NoCompression 2023-09-13T09:32:53.788 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression: Disabled 2023-09-13T09:32:53.788 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.prefix_extractor: nullptr 2023-09-13T09:32:53.789 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-09-13T09:32:53.789 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.num_levels: 7 2023-09-13T09:32:53.789 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-09-13T09:32:53.789 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-09-13T09:32:53.789 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-09-13T09:32:53.790 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-09-13T09:32:53.790 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-09-13T09:32:53.790 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-09-13T09:32:53.790 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-09-13T09:32:53.790 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-09-13T09:32:53.791 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-09-13T09:32:53.791 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-09-13T09:32:53.791 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-09-13T09:32:53.791 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-09-13T09:32:53.791 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.window_bits: -14 2023-09-13T09:32:53.792 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.level: 32767 2023-09-13T09:32:53.792 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.strategy: 0 2023-09-13T09:32:53.792 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-09-13T09:32:53.792 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-09-13T09:32:53.792 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-09-13T09:32:53.792 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-09-13T09:32:53.793 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.enabled: false 2023-09-13T09:32:53.793 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-09-13T09:32:53.793 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-09-13T09:32:53.793 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-09-13T09:32:53.793 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-09-13T09:32:53.793 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.target_file_size_base: 67108864 2023-09-13T09:32:53.794 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.target_file_size_multiplier: 1 2023-09-13T09:32:53.794 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-09-13T09:32:53.794 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-09-13T09:32:53.794 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-09-13T09:32:53.794 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-09-13T09:32:53.795 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-09-13T09:32:53.795 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-09-13T09:32:53.795 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-09-13T09:32:53.795 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-09-13T09:32:53.795 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-09-13T09:32:53.796 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-09-13T09:32:53.796 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-09-13T09:32:53.796 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-09-13T09:32:53.796 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-09-13T09:32:53.796 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.arena_block_size: 1048576 2023-09-13T09:32:53.796 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-09-13T09:32:53.797 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-09-13T09:32:53.797 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.disable_auto_compactions: 0 2023-09-13T09:32:53.797 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-09-13T09:32:53.797 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-09-13T09:32:53.797 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-09-13T09:32:53.798 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-09-13T09:32:53.798 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-09-13T09:32:53.798 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-09-13T09:32:53.798 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-09-13T09:32:53.798 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-09-13T09:32:53.799 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-09-13T09:32:53.799 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-09-13T09:32:53.799 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.table_properties_collectors: 2023-09-13T09:32:53.799 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.inplace_update_support: 0 2023-09-13T09:32:53.799 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.inplace_update_num_locks: 10000 2023-09-13T09:32:53.799 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-09-13T09:32:53.800 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-09-13T09:32:53.800 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.memtable_huge_page_size: 0 2023-09-13T09:32:53.800 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.bloom_locality: 0 2023-09-13T09:32:53.800 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.max_successive_merges: 0 2023-09-13T09:32:53.800 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.optimize_filters_for_hits: 0 2023-09-13T09:32:53.800 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.paranoid_file_checks: 0 2023-09-13T09:32:53.801 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.force_consistency_checks: 1 2023-09-13T09:32:53.801 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.report_bg_io_stats: 0 2023-09-13T09:32:53.801 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.ttl: 2592000 2023-09-13T09:32:53.801 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.periodic_compaction_seconds: 0 2023-09-13T09:32:53.801 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-09-13T09:32:53.802 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-09-13T09:32:53.802 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.enable_blob_files: false 2023-09-13T09:32:53.802 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.min_blob_size: 0 2023-09-13T09:32:53.802 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.blob_file_size: 268435456 2023-09-13T09:32:53.802 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.blob_compression_type: NoCompression 2023-09-13T09:32:53.803 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.enable_blob_garbage_collection: false 2023-09-13T09:32:53.803 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-09-13T09:32:53.803 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-09-13T09:32:53.803 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-09-13T09:32:53.803 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.blob_file_starting_level: 0 2023-09-13T09:32:53.803 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-09-13T09:32:53.804 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-09-13T09:32:53.804 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-09-13T09:32:53.804 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bfc90a50-b3f6-4f6c-a5f5-a3174da65396 2023-09-13T09:32:53.804 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597573502055, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-09-13T09:32:53.804 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-09-13T09:32:53.805 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597573502482, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1694597573, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bfc90a50-b3f6-4f6c-a5f5-a3174da65396", "db_session_id": "ETWOIXKY93OH429RWZWI", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-09-13T09:32:53.805 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: EVENT_LOG_v1 {"time_micros": 1694597573502550, "job": 1, "event": "recovery_finished"} 2023-09-13T09:32:53.805 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-09-13T09:32:53.805 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-09-13T09:32:53.805 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55be6a77a000 2023-09-13T09:32:53.805 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: DB pointer 0x55be6a766000 2023-09-13T09:32:53.806 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-09-13T09:32:53.806 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-09-13T09:32:53.806 INFO:journalctl@ceph.mon.b.smithi053.stdout: ** DB Stats ** 2023-09-13T09:32:53.806 INFO:journalctl@ceph.mon.b.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-13T09:32:53.806 INFO:journalctl@ceph.mon.b.smithi053.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-09-13T09:32:53.807 INFO:journalctl@ceph.mon.b.smithi053.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-13T09:32:53.807 INFO:journalctl@ceph.mon.b.smithi053.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-13T09:32:53.807 INFO:journalctl@ceph.mon.b.smithi053.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-09-13T09:32:53.807 INFO:journalctl@ceph.mon.b.smithi053.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-09-13T09:32:53.807 INFO:journalctl@ceph.mon.b.smithi053.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-09-13T09:32:53.807 INFO:journalctl@ceph.mon.b.smithi053.stdout: 2023-09-13T09:32:53.808 INFO:journalctl@ceph.mon.b.smithi053.stdout: ** Compaction Stats [default] ** 2023-09-13T09:32:53.808 INFO:journalctl@ceph.mon.b.smithi053.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-13T09:32:53.808 INFO:journalctl@ceph.mon.b.smithi053.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-09-13T09:32:53.808 INFO:journalctl@ceph.mon.b.smithi053.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-13T09:32:53.808 INFO:journalctl@ceph.mon.b.smithi053.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-13T09:32:53.809 INFO:journalctl@ceph.mon.b.smithi053.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-13T09:32:53.809 INFO:journalctl@ceph.mon.b.smithi053.stdout: 2023-09-13T09:32:53.809 INFO:journalctl@ceph.mon.b.smithi053.stdout: ** Compaction Stats [default] ** 2023-09-13T09:32:53.809 INFO:journalctl@ceph.mon.b.smithi053.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-09-13T09:32:53.809 INFO:journalctl@ceph.mon.b.smithi053.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-09-13T09:32:53.810 INFO:journalctl@ceph.mon.b.smithi053.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.1 0.00 0.00 1 0.000 0 0 0.0 0.0 2023-09-13T09:32:53.810 INFO:journalctl@ceph.mon.b.smithi053.stdout: 2023-09-13T09:32:53.810 INFO:journalctl@ceph.mon.b.smithi053.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-09-13T09:32:53.810 INFO:journalctl@ceph.mon.b.smithi053.stdout: 2023-09-13T09:32:53.810 INFO:journalctl@ceph.mon.b.smithi053.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-09-13T09:32:53.810 INFO:journalctl@ceph.mon.b.smithi053.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-09-13T09:32:53.811 INFO:journalctl@ceph.mon.b.smithi053.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-09-13T09:32:53.811 INFO:journalctl@ceph.mon.b.smithi053.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-09-13T09:32:53.811 INFO:journalctl@ceph.mon.b.smithi053.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-09-13T09:32:53.811 INFO:journalctl@ceph.mon.b.smithi053.stdout: AddFile(Keys): cumulative 0, interval 0 2023-09-13T09:32:53.811 INFO:journalctl@ceph.mon.b.smithi053.stdout: Cumulative compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-13T09:32:53.812 INFO:journalctl@ceph.mon.b.smithi053.stdout: Interval compaction: 0.00 GB write, 0.64 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-09-13T09:32:53.812 INFO:journalctl@ceph.mon.b.smithi053.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-09-13T09:32:53.812 INFO:journalctl@ceph.mon.b.smithi053.stdout: Block cache BinnedLRUCache@0x55be6a6dd1f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2023-09-13T09:32:53.812 INFO:journalctl@ceph.mon.b.smithi053.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-09-13T09:32:53.812 INFO:journalctl@ceph.mon.b.smithi053.stdout: 2023-09-13T09:32:53.813 INFO:journalctl@ceph.mon.b.smithi053.stdout: ** File Read Latency Histogram By Level [default] ** 2023-09-13T09:32:53.813 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-09-13T09:32:53.813 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: using public_addr v2:172.21.15.53:0/0 -> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] 2023-09-13T09:32:53.813 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: starting mon.b rank -1 at public addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] at bind addrs [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:32:53.813 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(???) e0 preinit fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:32:53.813 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 systemd[1]: Started Ceph mon.b for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:32:53.814 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).mds e1 new map 2023-09-13T09:32:53.814 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).mds e1 print_map 2023-09-13T09:32:53.814 INFO:journalctl@ceph.mon.b.smithi053.stdout: e1 2023-09-13T09:32:53.814 INFO:journalctl@ceph.mon.b.smithi053.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-09-13T09:32:53.814 INFO:journalctl@ceph.mon.b.smithi053.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-13T09:32:53.815 INFO:journalctl@ceph.mon.b.smithi053.stdout: legacy client fscid: -1 2023-09-13T09:32:53.815 INFO:journalctl@ceph.mon.b.smithi053.stdout: 2023-09-13T09:32:53.815 INFO:journalctl@ceph.mon.b.smithi053.stdout: No filesystems configured 2023-09-13T09:32:53.815 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-09-13T09:32:53.815 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-09-13T09:32:53.816 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-09-13T09:32:53.816 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-09-13T09:32:53.816 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-09-13T09:32:53.816 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-09-13T09:32:53.816 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-09-13T09:32:53.817 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:32:53.817 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:32:53.817 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-09-13T09:32:53.817 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.817 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:53.817 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.818 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.818 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.818 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.818 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi053", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:32:53.818 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:53.819 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:53.819 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi053:/etc/ceph/ceph.conf 2023-09-13T09:32:53.819 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Deploying cephadm binary to smithi131 2023-09-13T09:32:53.819 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:53.819 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi053:/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:53.820 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.820 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-13T09:32:53.820 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.820 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.820 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.820 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.821 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:53.821 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.821 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Added host smithi131 2023-09-13T09:32:53.821 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.821 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.822 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.822 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:32:53.822 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.822 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3384882690' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-09-13T09:32:53.822 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.823 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.823 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.823 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.823 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:32:53.823 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:53.823 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:53.824 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.824 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi131:/etc/ceph/ceph.conf 2023-09-13T09:32:53.824 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:32:53.824 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3384882690' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-09-13T09:32:53.824 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:53.825 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.825 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.825 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.825 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:32:53.825 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.client.admin.keyring 2023-09-13T09:32:53.826 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.826 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.826 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:53.826 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:53.826 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:32:53.827 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.827 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:32:53.827 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:53.827 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:32:53.827 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Saving service mon spec with placement smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c;count:3 2023-09-13T09:32:53.827 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Deploying daemon mon.c on smithi131 2023-09-13T09:32:53.828 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.828 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/1777236860' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:53.828 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:32:53.828 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.a calling monitor election 2023-09-13T09:32:53.828 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:53.829 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.829 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:53.829 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:53.829 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.c calling monitor election 2023-09-13T09:32:53.829 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.830 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:53.830 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:53.830 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:53.830 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-13T09:32:53.830 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: monmap e2: 2 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:32:53.831 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: fsmap 2023-09-13T09:32:53.831 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:53.831 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mgrmap e13: x(active, since 44s) 2023-09-13T09:32:53.831 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: overall HEALTH_OK 2023-09-13T09:32:53.831 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.831 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.832 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.832 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:53.832 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:32:53.832 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:32:53.832 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: Deploying daemon mon.b on smithi053 2023-09-13T09:32:53.833 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/4116021460' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:53.833 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:53.833 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:53.833 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-09-13T09:32:53.833 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-09-13T09:32:53.833 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expand map: {default=false} 2023-09-13T09:32:53.834 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta from 'false' to 'false' 2023-09-13T09:32:53.834 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expanded map: {default=false} 2023-09-13T09:32:53.834 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expand map: {default=info} 2023-09-13T09:32:53.834 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta from 'info' to 'info' 2023-09-13T09:32:53.834 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expanded map: {default=info} 2023-09-13T09:32:53.835 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expand map: {default=daemon} 2023-09-13T09:32:53.835 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta from 'daemon' to 'daemon' 2023-09-13T09:32:53.835 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expanded map: {default=daemon} 2023-09-13T09:32:53.835 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expand map: {default=debug} 2023-09-13T09:32:53.835 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta from 'debug' to 'debug' 2023-09-13T09:32:53.835 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:32:53 smithi053 ceph-mon[102373]: expand_channel_meta expanded map: {default=debug} 2023-09-13T09:32:58.687 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.685+0000 7fcba776b700 1 -- 172.21.15.131:0/1239876301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 msgr2=0x7fcb8c005a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:58.687 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.685+0000 7fcba776b700 1 --2- 172.21.15.131:0/1239876301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 0x7fcb8c005a50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fcba00766e0 tx=0x7fcb9000fe60 comp rx=0 tx=0).stop 2023-09-13T09:32:58.688 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.685+0000 7fcba776b700 1 -- 172.21.15.131:0/1239876301 shutdown_connections 2023-09-13T09:32:58.688 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.685+0000 7fcba776b700 1 --2- 172.21.15.131:0/1239876301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 0x7fcb8c005a50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.688 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.685+0000 7fcba776b700 1 -- 172.21.15.131:0/1239876301 >> 172.21.15.131:0/1239876301 conn(0x7fcba00752c0 msgr2=0x7fcba00756d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:58.689 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.685+0000 7fcba776b700 1 -- 172.21.15.131:0/1239876301 shutdown_connections 2023-09-13T09:32:58.689 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.685+0000 7fcba776b700 1 -- 172.21.15.131:0/1239876301 wait complete. 2023-09-13T09:32:58.689 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.686+0000 7fcba776b700 1 Processor -- start 2023-09-13T09:32:58.689 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.686+0000 7fcba776b700 1 -- start start 2023-09-13T09:32:58.693 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba776b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 0x7fcba0194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:58.693 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba776b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 0x7fcba0199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:58.693 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba776b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 0x7fcba019a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:58.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba776b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01959f0 con 0x7fcb8c0035c0 2023-09-13T09:32:58.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba776b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01a1a20 con 0x7fcba0199cb0 2023-09-13T09:32:58.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba776b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcba01a1b60 con 0x7fcba0195300 2023-09-13T09:32:58.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba4d06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 0x7fcba0199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:58.694 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba4d06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 0x7fcba0199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33490/0 (socket says 172.21.15.131:33490) 2023-09-13T09:32:58.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba4d06700 1 -- 172.21.15.131:0/2407467442 learned_addr learned my addr 172.21.15.131:0/2407467442 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:32:58.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5507700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 0x7fcba0194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:58.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5d08700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 0x7fcba019a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:58.695 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba4d06700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 msgr2=0x7fcba0199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-09-13T09:32:58.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba4d06700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 msgr2=0x7fcba0199770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-13T09:32:58.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba4d06700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 0x7fcba0199770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T09:32:58.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba4d06700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 0x7fcba0199770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T09:32:58.696 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5d08700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 msgr2=0x7fcba019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-09-13T09:32:58.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5d08700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 msgr2=0x7fcba019a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-09-13T09:32:58.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5d08700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 0x7fcba019a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-09-13T09:32:58.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5d08700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 0x7fcba019a160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-13T09:32:58.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5507700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 msgr2=0x7fcba0199770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:32:58.697 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5507700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 0x7fcba0199770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5507700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 msgr2=0x7fcba019a160 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:32:58.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.687+0000 7fcba5507700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 0x7fcba019a160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.688+0000 7fcba5507700 1 -- 172.21.15.131:0/2407467442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb9000f8b0 con 0x7fcb8c0035c0 2023-09-13T09:32:58.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.688+0000 7fcba5507700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 0x7fcba0194dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb9001f000 tx=0x7fcb90012df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:58.698 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.688+0000 7fcb967fc700 1 -- 172.21.15.131:0/2407467442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb900040b0 con 0x7fcb8c0035c0 2023-09-13T09:32:58.699 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.688+0000 7fcb967fc700 1 -- 172.21.15.131:0/2407467442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb90004210 con 0x7fcb8c0035c0 2023-09-13T09:32:58.699 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.688+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcba0068440 con 0x7fcb8c0035c0 2023-09-13T09:32:58.699 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.688+0000 7fcb967fc700 1 -- 172.21.15.131:0/2407467442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb90027780 con 0x7fcb8c0035c0 2023-09-13T09:32:58.699 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.688+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcba0068990 con 0x7fcb8c0035c0 2023-09-13T09:32:58.700 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.689+0000 7fcb967fc700 1 -- 172.21.15.131:0/2407467442 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7fcb90024070 con 0x7fcb8c0035c0 2023-09-13T09:32:58.700 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.689+0000 7fcb967fc700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb840388d0 0x7fcb8403ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:32:58.700 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.689+0000 7fcb967fc700 1 -- 172.21.15.131:0/2407467442 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcb9004dd40 con 0x7fcb8c0035c0 2023-09-13T09:32:58.700 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.689+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcba00622e0 con 0x7fcb8c0035c0 2023-09-13T09:32:58.700 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.689+0000 7fcba4d06700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb840388d0 0x7fcb8403ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:32:58.701 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.690+0000 7fcba4d06700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb840388d0 0x7fcb8403ad90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c006b20 tx=0x7fcb9c006ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:32:58.701 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.695+0000 7fcb967fc700 1 -- 172.21.15.131:0/2407467442 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcb9002b020 con 0x7fcb8c0035c0 2023-09-13T09:32:58.993 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.992+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcba01074a0 con 0x7fcb8c0035c0 2023-09-13T09:32:58.994 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.993+0000 7fcb967fc700 1 -- 172.21.15.131:0/2407467442 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1266 (secure 0 0 0) 0x7fcb90011440 con 0x7fcb8c0035c0 2023-09-13T09:32:58.994 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-09-13T09:32:58.994 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":3,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","modified":"2023-09-13T09:32:53.526121Z","created":"2023-09-13T09:31:01.875589Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:3300","nonce":0},{"type":"v1","addr":"172.21.15.53:6789","nonce":0}]},"addr":"172.21.15.53:6789/0","public_addr":"172.21.15.53:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-09-13T09:32:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb840388d0 msgr2=0x7fcb8403ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb840388d0 0x7fcb8403ad90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcb9c006b20 tx=0x7fcb9c006ab0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.996 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 msgr2=0x7fcba0194dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:32:58.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 0x7fcba0194dc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb9001f000 tx=0x7fcb90012df0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 shutdown_connections 2023-09-13T09:32:58.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcba0199cb0 0x7fcba019a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb840388d0 0x7fcb8403ad90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb8c0035c0 0x7fcba0194dc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 --2- 172.21.15.131:0/2407467442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcba0195300 0x7fcba0199770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:32:58.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 >> 172.21.15.131:0/2407467442 conn(0x7fcba00752c0 msgr2=0x7fcba01012a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:32:58.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 shutdown_connections 2023-09-13T09:32:58.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:32:58.995+0000 7fcba776b700 1 -- 172.21.15.131:0/2407467442 wait complete. 2023-09-13T09:32:58.999 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 3 2023-09-13T09:32:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:32:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: mon.c calling monitor election 2023-09-13T09:32:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: mon.a calling monitor election 2023-09-13T09:32:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:59.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-13T09:32:59.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:32:59.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: fsmap 2023-09-13T09:32:59.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:59.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: mgrmap e13: x(active, since 52s) 2023-09-13T09:32:59.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-13T09:32:59.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-13T09:32:59.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-13T09:32:59.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: mon.b (rank 2) addr [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] is down (out of quorum) 2023-09-13T09:32:59.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:32:59.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: mon.c calling monitor election 2023-09-13T09:32:59.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: mon.a calling monitor election 2023-09-13T09:32:59.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:32:59.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:59.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:59.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-13T09:32:59.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:32:59.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: fsmap 2023-09-13T09:32:59.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:32:59.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: mgrmap e13: x(active, since 52s) 2023-09-13T09:32:59.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-13T09:32:59.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-13T09:32:59.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-13T09:32:59.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: mon.b (rank 2) addr [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] is down (out of quorum) 2023-09-13T09:32:59.023 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.023 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.023 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.023 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:32:59.466 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-09-13T09:32:59.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph config generate-minimal-conf 2023-09-13T09:32:59.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:59 smithi006 ceph-mon[98665]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:59.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:59.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:59 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/2407467442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:59.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:32:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:32:59.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:59 smithi131 ceph-mon[102785]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:32:59.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:32:59.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:59 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/2407467442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:32:59.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:32:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:00.044 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:33:01.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:33:01.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: mon.c calling monitor election 2023-09-13T09:33:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: mon.a calling monitor election 2023-09-13T09:33:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:33:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-09-13T09:33:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:33:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: fsmap 2023-09-13T09:33:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:33:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: mgrmap e13: x(active, since 52s) 2023-09-13T09:33:01.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-09-13T09:33:01.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-09-13T09:33:01.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-09-13T09:33:01.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: mon.b (rank 2) addr [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] is down (out of quorum) 2023-09-13T09:33:01.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:01.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:01.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/2407467442' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-09-13T09:33:01.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.242+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/1083381585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea0106770 msgr2=0x7f3ea0106b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:01.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.242+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/1083381585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea0106770 0x7f3ea0106b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009910 tx=0x7f3e90009c20 comp rx=0 tx=0).stop 2023-09-13T09:33:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.242+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/1083381585 shutdown_connections 2023-09-13T09:33:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.242+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/1083381585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea0106770 0x7f3ea0106b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.242+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/1083381585 >> 172.21.15.6:0/1083381585 conn(0x7f3ea00751b0 msgr2=0x7f3ea00755c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.242+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/1083381585 shutdown_connections 2023-09-13T09:33:01.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.242+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/1083381585 wait complete. 2023-09-13T09:33:01.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 Processor -- start 2023-09-13T09:33:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 -- start start 2023-09-13T09:33:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ea0106770 0x7f3ea0195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea01963b0 0x7f3ea019a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:01.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ea019ad60 0x7f3ea019b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea0196aa0 con 0x7f3ea01963b0 2023-09-13T09:33:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01a2ad0 con 0x7f3ea0106770 2023-09-13T09:33:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3ea5f5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea01a2c10 con 0x7f3ea019ad60 2023-09-13T09:33:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3e9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea01963b0 0x7f3ea019a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:01.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3e9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea01963b0 0x7f3ea019a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59496/0 (socket says 172.21.15.6:59496) 2023-09-13T09:33:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3e9effd700 1 -- 172.21.15.6:0/778840572 learned_addr learned my addr 172.21.15.6:0/778840572 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:33:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3e9f7fe700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ea0106770 0x7f3ea0195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3e9ffff700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ea019ad60 0x7f3ea019b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:01.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.243+0000 7f3e9effd700 1 -- 172.21.15.6:0/778840572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ea019ad60 msgr2=0x7f3ea019b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9effd700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ea019ad60 0x7f3ea019b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9effd700 1 -- 172.21.15.6:0/778840572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ea0106770 msgr2=0x7f3ea0195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9effd700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ea0106770 0x7f3ea0195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9effd700 1 -- 172.21.15.6:0/778840572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900095f0 con 0x7f3ea01963b0 2023-09-13T09:33:01.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9ffff700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ea019ad60 0x7f3ea019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:33:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9effd700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea01963b0 0x7f3ea019a820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400b780 tx=0x7f3e9400ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9cff9700 1 -- 172.21.15.6:0/778840572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94004230 con 0x7f3ea01963b0 2023-09-13T09:33:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9cff9700 1 -- 172.21.15.6:0/778840572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e94004390 con 0x7f3ea01963b0 2023-09-13T09:33:01.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ea01a2ef0 con 0x7f3ea01963b0 2023-09-13T09:33:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3e9cff9700 1 -- 172.21.15.6:0/778840572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e94011ad0 con 0x7f3ea01963b0 2023-09-13T09:33:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.244+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ea01a3360 con 0x7f3ea01963b0 2023-09-13T09:33:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.245+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea00622e0 con 0x7f3ea01963b0 2023-09-13T09:33:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.245+0000 7f3e9cff9700 1 -- 172.21.15.6:0/778840572 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f3e940036a0 con 0x7f3ea01963b0 2023-09-13T09:33:01.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.246+0000 7f3e9cff9700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e880388d0 0x7f3e8803ad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:01.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.246+0000 7f3e9cff9700 1 -- 172.21.15.6:0/778840572 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f3e9404afb0 con 0x7f3ea01963b0 2023-09-13T09:33:01.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.246+0000 7f3e9f7fe700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e880388d0 0x7f3e8803ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:01.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.246+0000 7f3e9f7fe700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e880388d0 0x7f3e8803ad90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009fd0 tx=0x7f3e900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:01.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.250+0000 7f3e9cff9700 1 -- 172.21.15.6:0/778840572 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3e94077e10 con 0x7f3ea01963b0 2023-09-13T09:33:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.465+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f3ea010aca0 con 0x7f3ea01963b0 2023-09-13T09:33:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.466+0000 7f3e9cff9700 1 -- 172.21.15.6:0/778840572 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+271 (secure 0 0 0) 0x7f3e9403e090 con 0x7f3ea01963b0 2023-09-13T09:33:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:# minimal ceph.conf for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:33:01.467 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2023-09-13T09:33:01.467 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:33:01.467 INFO:teuthology.orchestra.run.smithi006.stdout: mon_host = [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2023-09-13T09:33:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e880388d0 msgr2=0x7f3e8803ad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e880388d0 0x7f3e8803ad90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e90009fd0 tx=0x7f3e900058e0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea01963b0 msgr2=0x7f3ea019a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea01963b0 0x7f3ea019a820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3e9400b780 tx=0x7f3e9400ba90 comp rx=0 tx=0).stop 2023-09-13T09:33:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 shutdown_connections 2023-09-13T09:33:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ea019ad60 0x7f3ea019b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ea0106770 0x7f3ea0195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e880388d0 0x7f3e8803ad90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 --2- 172.21.15.6:0/778840572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ea01963b0 0x7f3ea019a820 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 >> 172.21.15.6:0/778840572 conn(0x7f3ea00751b0 msgr2=0x7f3ea00fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 shutdown_connections 2023-09-13T09:33:01.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:01.468+0000 7f3ea5f5a700 1 -- 172.21.15.6:0/778840572 wait complete. 2023-09-13T09:33:01.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: mon.b calling monitor election 2023-09-13T09:33:01.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:01.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Updating smithi006:/etc/ceph/ceph.conf 2023-09-13T09:33:01.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Updating smithi053:/etc/ceph/ceph.conf 2023-09-13T09:33:01.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Updating smithi131:/etc/ceph/ceph.conf 2023-09-13T09:33:01.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: mon.b calling monitor election 2023-09-13T09:33:01.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: mon.a calling monitor election 2023-09-13T09:33:01.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: mon.c calling monitor election 2023-09-13T09:33:01.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-13T09:33:01.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:33:01.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: fsmap 2023-09-13T09:33:01.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:33:01.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: mgrmap e13: x(active, since 54s) 2023-09-13T09:33:01.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-13T09:33:01.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Cluster is now healthy 2023-09-13T09:33:01.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: overall HEALTH_OK 2023-09-13T09:33:01.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Updating smithi006:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.762 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:01.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:01.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:01.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: mon.b calling monitor election 2023-09-13T09:33:01.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:01.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Updating smithi006:/etc/ceph/ceph.conf 2023-09-13T09:33:01.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Updating smithi053:/etc/ceph/ceph.conf 2023-09-13T09:33:01.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Updating smithi131:/etc/ceph/ceph.conf 2023-09-13T09:33:01.764 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: mon.b calling monitor election 2023-09-13T09:33:01.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: mon.a calling monitor election 2023-09-13T09:33:01.765 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: mon.c calling monitor election 2023-09-13T09:33:01.766 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-13T09:33:01.766 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:33:01.766 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: fsmap 2023-09-13T09:33:01.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:33:01.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: mgrmap e13: x(active, since 54s) 2023-09-13T09:33:01.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-13T09:33:01.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Cluster is now healthy 2023-09-13T09:33:01.767 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: overall HEALTH_OK 2023-09-13T09:33:01.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Updating smithi006:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.768 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.769 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.770 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:01.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:01.771 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:01.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: mon.b calling monitor election 2023-09-13T09:33:01.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:01.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Updating smithi006:/etc/ceph/ceph.conf 2023-09-13T09:33:01.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Updating smithi053:/etc/ceph/ceph.conf 2023-09-13T09:33:01.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Updating smithi131:/etc/ceph/ceph.conf 2023-09-13T09:33:01.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: mon.b calling monitor election 2023-09-13T09:33:01.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: mon.a calling monitor election 2023-09-13T09:33:01.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: mon.c calling monitor election 2023-09-13T09:33:01.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-09-13T09:33:01.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: monmap e3: 3 mons at {a=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],b=[v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0],c=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} 2023-09-13T09:33:01.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: fsmap 2023-09-13T09:33:01.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: osdmap e4: 0 total, 0 up, 0 in 2023-09-13T09:33:01.774 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: mgrmap e13: x(active, since 54s) 2023-09-13T09:33:01.774 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-09-13T09:33:01.774 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Cluster is now healthy 2023-09-13T09:33:01.774 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: overall HEALTH_OK 2023-09-13T09:33:01.774 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Updating smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Updating smithi006:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: Updating smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/config/ceph.conf 2023-09-13T09:33:01.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.775 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.776 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.776 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.776 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.776 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.776 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:01.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:01.777 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:01.778 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:01.931 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-09-13T09:33:01.931 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:33:01.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.conf 2023-09-13T09:33:01.963 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:33:01.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:33:02.036 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:33:02.037 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.conf 2023-09-13T09:33:02.075 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:33:02.075 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:33:02.146 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:33:02.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.conf 2023-09-13T09:33:02.184 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:33:02.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-09-13T09:33:02.255 INFO:tasks.cephadm:Adding mgr.x on smithi006 2023-09-13T09:33:02.255 INFO:tasks.cephadm:Adding mgr.y on smithi053 2023-09-13T09:33:02.256 INFO:tasks.cephadm:Adding mgr.z on smithi131 2023-09-13T09:33:02.256 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch apply mgr '3;smithi006=x;smithi053=y;smithi131=z' 2023-09-13T09:33:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:02 smithi006 ceph-mon[98665]: Reconfiguring mon.a (unknown last config time)... 2023-09-13T09:33:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:02 smithi006 ceph-mon[98665]: Reconfiguring daemon mon.a on smithi006 2023-09-13T09:33:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:02 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/778840572' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:02 smithi131 ceph-mon[102785]: Reconfiguring mon.a (unknown last config time)... 2023-09-13T09:33:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:02 smithi131 ceph-mon[102785]: Reconfiguring daemon mon.a on smithi006 2023-09-13T09:33:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:02 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/778840572' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:02.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:02 smithi053 ceph-mon[102373]: Reconfiguring mon.a (unknown last config time)... 2023-09-13T09:33:02.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:02 smithi053 ceph-mon[102373]: Reconfiguring daemon mon.a on smithi006 2023-09-13T09:33:02.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:02 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/778840572' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:02.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:33:02.851 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:33:03.656 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:03.657 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:03.657 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:03.658 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: Reconfiguring mon.b (monmap changed)... 2023-09-13T09:33:03.658 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:03.658 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:03.658 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:03.659 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:03 smithi053 ceph-mon[102373]: Reconfiguring daemon mon.b on smithi053 2023-09-13T09:33:03.664 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:03.664 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:03.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:03.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: Reconfiguring mon.b (monmap changed)... 2023-09-13T09:33:03.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:03.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:03.666 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:03.666 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:03 smithi131 ceph-mon[102785]: Reconfiguring daemon mon.b on smithi053 2023-09-13T09:33:04.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:04.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: Reconfiguring mon.b (monmap changed)... 2023-09-13T09:33:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:03 smithi006 ceph-mon[98665]: Reconfiguring daemon mon.b on smithi053 2023-09-13T09:33:04.108 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.106+0000 7fcd5baae700 1 -- 172.21.15.131:0/557318418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54101380 msgr2=0x7fcd54103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:04.109 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.106+0000 7fcd5baae700 1 --2- 172.21.15.131:0/557318418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54101380 0x7fcd54103770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcd50009910 tx=0x7fcd50009c20 comp rx=0 tx=0).stop 2023-09-13T09:33:04.109 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.106+0000 7fcd5baae700 1 -- 172.21.15.131:0/557318418 shutdown_connections 2023-09-13T09:33:04.109 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.106+0000 7fcd5baae700 1 --2- 172.21.15.131:0/557318418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54101380 0x7fcd54103770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:04.109 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.106+0000 7fcd5baae700 1 -- 172.21.15.131:0/557318418 >> 172.21.15.131:0/557318418 conn(0x7fcd540fad70 msgr2=0x7fcd540fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:04.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.106+0000 7fcd5baae700 1 -- 172.21.15.131:0/557318418 shutdown_connections 2023-09-13T09:33:04.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.106+0000 7fcd5baae700 1 -- 172.21.15.131:0/557318418 wait complete. 2023-09-13T09:33:04.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 Processor -- start 2023-09-13T09:33:04.110 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 -- start start 2023-09-13T09:33:04.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd54101380 0x7fcd54195b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:04.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54196050 0x7fcd5419b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:04.111 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd541964d0 0x7fcd5419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:04.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419ddf0 con 0x7fcd54196050 2023-09-13T09:33:04.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419df60 con 0x7fcd54101380 2023-09-13T09:33:04.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5baae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5419e120 con 0x7fcd541964d0 2023-09-13T09:33:04.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd541964d0 0x7fcd5419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:04.112 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd541964d0 0x7fcd5419d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33502/0 (socket says 172.21.15.131:33502) 2023-09-13T09:33:04.113 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 -- 172.21.15.131:0/4289960031 learned_addr learned my addr 172.21.15.131:0/4289960031 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:33:04.113 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd59049700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54196050 0x7fcd5419b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:04.113 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5984a700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd54101380 0x7fcd54195b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:04.113 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 -- 172.21.15.131:0/4289960031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd54101380 msgr2=0x7fcd54195b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:04.113 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd54101380 0x7fcd54195b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:04.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 -- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54196050 msgr2=0x7fcd5419b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:04.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54196050 0x7fcd5419b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:04.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 -- 172.21.15.131:0/4289960031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd500095f0 con 0x7fcd541964d0 2023-09-13T09:33:04.114 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.107+0000 7fcd5a04b700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd541964d0 0x7fcd5419d650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00ba50 tx=0x7fcd4c00bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:04.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.108+0000 7fcd4affd700 1 -- 172.21.15.131:0/4289960031 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c00c9b0 con 0x7fcd541964d0 2023-09-13T09:33:04.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.108+0000 7fcd4affd700 1 -- 172.21.15.131:0/4289960031 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd4c014440 con 0x7fcd541964d0 2023-09-13T09:33:04.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.108+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd5419e400 con 0x7fcd541964d0 2023-09-13T09:33:04.115 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.108+0000 7fcd4affd700 1 -- 172.21.15.131:0/4289960031 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4c007590 con 0x7fcd541964d0 2023-09-13T09:33:04.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.108+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd5419e930 con 0x7fcd541964d0 2023-09-13T09:33:04.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.108+0000 7fcd4affd700 1 -- 172.21.15.131:0/4289960031 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7fcd4c00cb10 con 0x7fcd541964d0 2023-09-13T09:33:04.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.109+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd5418f3b0 con 0x7fcd541964d0 2023-09-13T09:33:04.116 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.109+0000 7fcd4affd700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd40038880 0x7fcd4003ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:04.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.109+0000 7fcd4affd700 1 -- 172.21.15.131:0/4289960031 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fcd4c04a5a0 con 0x7fcd541964d0 2023-09-13T09:33:04.117 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.109+0000 7fcd5984a700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd40038880 0x7fcd4003ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:04.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.109+0000 7fcd5984a700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd40038880 0x7fcd4003ad40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd50000c00 tx=0x7fcd5000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:04.118 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.114+0000 7fcd4affd700 1 -- 172.21.15.131:0/4289960031 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcd4c0148d0 con 0x7fcd541964d0 2023-09-13T09:33:04.324 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.324+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi053=y;smithi131=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd5402d080 con 0x7fcd40038880 2023-09-13T09:33:04.331 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.331+0000 7fcd4affd700 1 -- 172.21.15.131:0/4289960031 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fcd5402d080 con 0x7fcd40038880 2023-09-13T09:33:04.332 INFO:teuthology.orchestra.run.smithi131.stdout:Scheduled mgr update... 2023-09-13T09:33:04.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd40038880 msgr2=0x7fcd4003ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:04.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd40038880 0x7fcd4003ad40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd50000c00 tx=0x7fcd5000b540 comp rx=0 tx=0).stop 2023-09-13T09:33:04.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd541964d0 msgr2=0x7fcd5419d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:04.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd541964d0 0x7fcd5419d650 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c00ba50 tx=0x7fcd4c00bd60 comp rx=0 tx=0).stop 2023-09-13T09:33:04.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 shutdown_connections 2023-09-13T09:33:04.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd541964d0 0x7fcd5419d650 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:04.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd54101380 0x7fcd54195b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:04.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd40038880 0x7fcd4003ad40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:04.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 --2- 172.21.15.131:0/4289960031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd54196050 0x7fcd5419b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:04.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 >> 172.21.15.131:0/4289960031 conn(0x7fcd540fad70 msgr2=0x7fcd540fba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:04.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 shutdown_connections 2023-09-13T09:33:04.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:04.334+0000 7fcd5baae700 1 -- 172.21.15.131:0/4289960031 wait complete. 2023-09-13T09:33:04.906 DEBUG:teuthology.orchestra.run.smithi053:mgr.y> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.y.service 2023-09-13T09:33:04.909 DEBUG:teuthology.orchestra.run.smithi131:mgr.z> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.z.service 2023-09-13T09:33:04.912 INFO:tasks.cephadm:Deploying OSDs... 2023-09-13T09:33:04.912 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:33:04.912 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T09:33:04.934 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T09:33:04.935 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2023-09-13T09:33:04.936 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.936 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.936 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: Reconfiguring mon.c (monmap changed)... 2023-09-13T09:33:04.936 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:04.936 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:04.937 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:04.937 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: Reconfiguring daemon mon.c on smithi131 2023-09-13T09:33:04.937 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.940 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.940 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.940 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: Reconfiguring mon.c (monmap changed)... 2023-09-13T09:33:04.941 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:04.941 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:04.941 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:04.941 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: Reconfiguring daemon mon.c on smithi131 2023-09-13T09:33:04.941 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:04.942 INFO:journalctl@ceph.mgr.z.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:33:04.946 INFO:journalctl@ceph.mgr.y.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:33:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T09:33:04.996 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:04.996 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 381929 Links: 1 2023-09-13T09:33:04.996 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:04.997 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:04.997 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-09-13 09:32:17.567103594 +0000 2023-09-13T09:33:04.997 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-09-13 09:26:46.968375494 +0000 2023-09-13T09:33:04.997 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-09-13 09:26:46.968375494 +0000 2023-09-13T09:33:04.997 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-09-13T09:33:04.998 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T09:33:05.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:05.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:05.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: Reconfiguring mon.c (monmap changed)... 2023-09-13T09:33:05.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-09-13T09:33:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-09-13T09:33:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: Reconfiguring daemon mon.c on smithi131 2023-09-13T09:33:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:05.038 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-09-13T09:33:05.039 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-09-13T09:33:05.039 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000240633 s, 2.1 MB/s 2023-09-13T09:33:05.040 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T09:33:05.101 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2023-09-13T09:33:05.160 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T09:33:05.160 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:05.160 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 385590 Links: 1 2023-09-13T09:33:05.160 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:05.161 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:05.161 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-09-13 09:32:17.609103151 +0000 2023-09-13T09:33:05.161 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-09-13 09:26:47.519369976 +0000 2023-09-13T09:33:05.161 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-09-13 09:26:47.519369976 +0000 2023-09-13T09:33:05.161 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-09-13T09:33:05.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T09:33:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-09-13T09:33:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-09-13T09:33:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000228098 s, 2.2 MB/s 2023-09-13T09:33:05.229 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T09:33:05.289 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2023-09-13T09:33:05.348 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T09:33:05.364 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:05.365 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 389798 Links: 1 2023-09-13T09:33:05.365 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:05.365 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:05.365 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-09-13 09:32:17.659102624 +0000 2023-09-13T09:33:05.365 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-09-13 09:26:48.050364657 +0000 2023-09-13T09:33:05.366 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-09-13 09:26:48.050364657 +0000 2023-09-13T09:33:05.366 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-09-13T09:33:05.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T09:33:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-09-13T09:33:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-09-13T09:33:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000229788 s, 2.2 MB/s 2023-09-13T09:33:05.416 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T09:33:05.476 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2023-09-13T09:33:05.532 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T09:33:05.532 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:05.533 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 388864 Links: 1 2023-09-13T09:33:05.533 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:05.533 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:05.533 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-09-13 09:32:17.710102086 +0000 2023-09-13T09:33:05.533 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-09-13 09:26:48.573359419 +0000 2023-09-13T09:33:05.534 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-09-13 09:26:48.573359419 +0000 2023-09-13T09:33:05.534 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2023-09-13T09:33:05.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T09:33:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2023-09-13T09:33:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2023-09-13T09:33:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000184591 s, 2.8 MB/s 2023-09-13T09:33:05.601 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T09:33:05.659 DEBUG:teuthology.orchestra.run.smithi053:> set -ex 2023-09-13T09:33:05.659 DEBUG:teuthology.orchestra.run.smithi053:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T09:33:05.682 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T09:33:05.682 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_1 2023-09-13T09:33:05.744 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T09:33:05.745 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:05.745 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 388292 Links: 1 2023-09-13T09:33:05.745 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:05.745 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:05.745 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-13 09:32:52.969566755 +0000 2023-09-13T09:33:05.746 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-13 09:26:52.486788840 +0000 2023-09-13T09:33:05.746 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-13 09:26:52.486788840 +0000 2023-09-13T09:33:05.746 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-13T09:33:05.746 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T09:33:05.815 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-13T09:33:05.816 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-13T09:33:05.816 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000131157 s, 3.9 MB/s 2023-09-13T09:33:05.817 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T09:33:05.878 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_2 2023-09-13T09:33:05.941 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T09:33:05.942 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:05.942 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 387842 Links: 1 2023-09-13T09:33:05.942 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:05.942 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:05.943 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-13 09:32:52.969566755 +0000 2023-09-13T09:33:05.943 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-13 09:26:53.032778315 +0000 2023-09-13T09:33:05.943 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-13 09:26:53.032778315 +0000 2023-09-13T09:33:05.943 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-13T09:33:05.944 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T09:33:05.949 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:05.949 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi053=y;smithi131=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:05.949 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: Saving service mgr spec with placement smithi006=x;smithi053=y;smithi131=z;count:3 2023-09-13T09:33:05.950 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:05.950 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:05.950 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:05.950 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:05.950 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:05.951 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:05.951 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:05.951 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-13T09:33:05.951 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:05.951 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:06.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:06.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi053=y;smithi131=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:06.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: Saving service mgr spec with placement smithi006=x;smithi053=y;smithi131=z;count:3 2023-09-13T09:33:06.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:06.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:06.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:06.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:06.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:06.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:06.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:06.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-13T09:33:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:06.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:06.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi006=x;smithi053=y;smithi131=z", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:06.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: Saving service mgr spec with placement smithi006=x;smithi053=y;smithi131=z;count:3 2023-09-13T09:33:06.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:06.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:06.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:06.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:06.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:06.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:06.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:06.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-13T09:33:06.013 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:06.013 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:06.014 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-13T09:33:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-13T09:33:06.015 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000123919 s, 4.1 MB/s 2023-09-13T09:33:06.015 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T09:33:06.075 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_3 2023-09-13T09:33:06.135 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T09:33:06.135 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:06.136 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 387991 Links: 1 2023-09-13T09:33:06.136 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:06.136 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:06.136 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-13 09:32:52.969566755 +0000 2023-09-13T09:33:06.137 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-13 09:26:53.539768543 +0000 2023-09-13T09:33:06.137 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-13 09:26:53.539768543 +0000 2023-09-13T09:33:06.137 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-13T09:33:06.138 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T09:33:06.203 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-13T09:33:06.204 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-13T09:33:06.204 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000106167 s, 4.8 MB/s 2023-09-13T09:33:06.205 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T09:33:06.264 DEBUG:teuthology.orchestra.run.smithi053:> stat /dev/vg_nvme/lv_4 2023-09-13T09:33:06.323 INFO:teuthology.orchestra.run.smithi053.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T09:33:06.323 INFO:teuthology.orchestra.run.smithi053.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:06.324 INFO:teuthology.orchestra.run.smithi053.stdout:Device: 6h/6d Inode: 389409 Links: 1 2023-09-13T09:33:06.324 INFO:teuthology.orchestra.run.smithi053.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:06.324 INFO:teuthology.orchestra.run.smithi053.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:06.324 INFO:teuthology.orchestra.run.smithi053.stdout:Access: 2023-09-13 09:32:52.969566755 +0000 2023-09-13T09:33:06.324 INFO:teuthology.orchestra.run.smithi053.stdout:Modify: 2023-09-13 09:26:54.067758365 +0000 2023-09-13T09:33:06.325 INFO:teuthology.orchestra.run.smithi053.stdout:Change: 2023-09-13 09:26:54.067758365 +0000 2023-09-13T09:33:06.325 INFO:teuthology.orchestra.run.smithi053.stdout: Birth: - 2023-09-13T09:33:06.325 DEBUG:teuthology.orchestra.run.smithi053:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T09:33:06.391 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records in 2023-09-13T09:33:06.391 INFO:teuthology.orchestra.run.smithi053.stderr:1+0 records out 2023-09-13T09:33:06.391 INFO:teuthology.orchestra.run.smithi053.stderr:512 bytes copied, 0.000110999 s, 4.6 MB/s 2023-09-13T09:33:06.392 DEBUG:teuthology.orchestra.run.smithi053:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T09:33:06.451 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-09-13T09:33:06.451 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2023-09-13T09:33:06.469 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-13T09:33:06.470 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2023-09-13T09:33:06.528 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-13T09:33:06.529 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:06.529 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 391232 Links: 1 2023-09-13T09:33:06.530 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:06.530 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:06.530 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-09-13 09:32:44.491691259 +0000 2023-09-13T09:33:06.531 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-09-13 09:26:31.755609276 +0000 2023-09-13T09:33:06.531 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-09-13 09:26:31.755609276 +0000 2023-09-13T09:33:06.532 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-09-13T09:33:06.532 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-13T09:33:06.595 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-09-13T09:33:06.596 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-09-13T09:33:06.596 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000210486 s, 2.4 MB/s 2023-09-13T09:33:06.597 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-13T09:33:06.662 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2023-09-13T09:33:06.721 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-13T09:33:06.722 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:06.722 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 390005 Links: 1 2023-09-13T09:33:06.722 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:06.722 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:06.723 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-09-13 09:33:06.674232660 +0000 2023-09-13T09:33:06.723 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-09-13 09:26:32.481594317 +0000 2023-09-13T09:33:06.723 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-09-13 09:26:32.481594317 +0000 2023-09-13T09:33:06.723 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-09-13T09:33:06.723 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-13T09:33:06.749 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:06 smithi131 ceph-mon[102785]: Deploying daemon mgr.z on smithi131 2023-09-13T09:33:06.847 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-09-13T09:33:06.847 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-09-13T09:33:06.847 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000207389 s, 2.5 MB/s 2023-09-13T09:33:06.849 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-13T09:33:06.867 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2023-09-13T09:33:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-13T09:33:06.927 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:06.928 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 390035 Links: 1 2023-09-13T09:33:06.928 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:06.928 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:06.928 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-09-13 09:33:06.799230075 +0000 2023-09-13T09:33:06.929 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-09-13 09:26:32.992583788 +0000 2023-09-13T09:33:06.929 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-09-13 09:26:32.992583788 +0000 2023-09-13T09:33:06.929 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-09-13T09:33:06.929 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-13T09:33:06.996 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-09-13T09:33:06.997 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-09-13T09:33:06.997 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.00020385 s, 2.5 MB/s 2023-09-13T09:33:06.998 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-13T09:33:07.005 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:06 smithi053 ceph-mon[102373]: Deploying daemon mgr.z on smithi131 2023-09-13T09:33:07.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:06 smithi006 ceph-mon[98665]: Deploying daemon mgr.z on smithi131 2023-09-13T09:33:07.019 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:06 smithi131 systemd[1]: Starting Ceph mgr.z for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:33:07.037 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2023-09-13T09:33:07.095 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-13T09:33:07.095 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-13T09:33:07.095 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 390082 Links: 1 2023-09-13T09:33:07.095 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:33:07.096 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2023-09-13T09:33:07.096 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-09-13 09:33:06.799230075 +0000 2023-09-13T09:33:07.096 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-09-13 09:26:33.520572909 +0000 2023-09-13T09:33:07.096 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-09-13 09:26:33.520572909 +0000 2023-09-13T09:33:07.096 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-09-13T09:33:07.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-13T09:33:07.161 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-09-13T09:33:07.161 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-09-13T09:33:07.162 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000226351 s, 2.3 MB/s 2023-09-13T09:33:07.163 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-13T09:33:07.221 INFO:tasks.cephadm:Deploying osd.0 on smithi006 with /dev/vg_nvme/lv_4... 2023-09-13T09:33:07.221 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-13T09:33:07.413 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 podman[104791]: 2023-09-13T09:33:07.695 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 bash[104791]: 9bc7a867705f87ee0c8cb4e06c53309120508d50a76bfc36ba3adc8ec0e9c6a7 2023-09-13T09:33:07.695 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mgr[104915]: -- 172.21.15.131:0/1224573882 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f64231f1e0 con 0x55f6422f5000 2023-09-13T09:33:07.695 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 systemd[1]: Started Ceph mgr.z for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:33:07.696 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:07.547+0000 7fab49c40200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T09:33:07.696 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:07.626+0000 7fab49c40200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T09:33:07.797 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:33:07.975 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:07.715+0000 7fab49c40200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T09:33:07.975 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:07.807+0000 7fab49c40200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T09:33:07.976 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:07.976 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:07.976 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:07.976 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:07.977 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:07.977 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-13T09:33:07.977 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:07.977 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-13T09:33:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:08.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:08.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:08.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:08.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:08.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:08.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-09-13T09:33:08.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:08.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:08.268 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:07 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:07.975+0000 7fab49c40200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T09:33:08.648 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:08 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:08.338+0000 7fab49c40200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T09:33:08.649 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:08 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:08.466+0000 7fab49c40200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T09:33:08.649 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:08 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:08.554+0000 7fab49c40200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T09:33:08.649 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:08 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:08.648+0000 7fab49c40200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T09:33:08.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:08 smithi053 ceph-mon[102373]: Deploying daemon mgr.y on smithi053 2023-09-13T09:33:09.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:08 smithi006 ceph-mon[98665]: Deploying daemon mgr.y on smithi053 2023-09-13T09:33:09.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:08 smithi131 ceph-mon[102785]: Deploying daemon mgr.y on smithi053 2023-09-13T09:33:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-13T09:33:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-13T09:33:09.295 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-09-13T09:33:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-09-13T09:33:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109467 s, 958 MB/s 2023-09-13T09:33:09.296 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 2023-09-13T09:33:09.296 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-09-13T09:33:09.506 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:09 smithi053 systemd[1]: Starting Ceph mgr.y for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:33:09.519 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:09.069+0000 7fab49c40200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T09:33:09.647 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi006:vg_nvme/lv_4 2023-09-13T09:33:09.821 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:09 smithi053 ceph-mon[102373]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:09.822 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:09 smithi053 podman[103816]: 2023-09-13T09:33:09.822 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:09 smithi053 bash[103816]: a374379d7b805ae062bf248dd36f6c667b1547a4b828a3c0a03fb08c225bbd5d 2023-09-13T09:33:09.823 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:09 smithi053 ceph-mgr[103857]: -- 172.21.15.53:0/373462598 <== mon.2 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55afcd4091e0 con 0x55afcd3df000 2023-09-13T09:33:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:09 smithi006 ceph-mon[98665]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:10.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:09 smithi131 ceph-mon[102785]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:10.019 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:09.736+0000 7fab49c40200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T09:33:10.019 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:09.818+0000 7fab49c40200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T09:33:10.130 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:09 smithi053 systemd[1]: Started Ceph mgr.y for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:33:10.131 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:09 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:09.919+0000 7f61ecc59200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-13T09:33:10.131 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:10.019+0000 7f61ecc59200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-13T09:33:10.131 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:10.130+0000 7f61ecc59200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-13T09:33:10.211 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:33:10.463 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:10.247+0000 7f61ecc59200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-13T09:33:10.756 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:10.463+0000 7f61ecc59200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-13T09:33:10.887 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:10.636+0000 7fab49c40200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:33:10.887 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:10.728+0000 7fab49c40200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T09:33:11.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:11.135 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:10.977+0000 7f61ecc59200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-13T09:33:11.136 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.136 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.136 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.136 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.137 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:11.215 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:10.917+0000 7fab49c40200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:33:11.216 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:11.215+0000 7fab49c40200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T09:33:11.216 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.216 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.216 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.216 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:11.217 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:11.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 -- 172.21.15.6:0/2591378945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c0ffc70 msgr2=0x7f1b3c100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 --2- 172.21.15.6:0/2591378945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c100090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c0099c0 tx=0x7f1b2c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:33:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 -- 172.21.15.6:0/2591378945 shutdown_connections 2023-09-13T09:33:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 --2- 172.21.15.6:0/2591378945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c101810 0x7f1b3c1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 --2- 172.21.15.6:0/2591378945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c100090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:11.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 --2- 172.21.15.6:0/2591378945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b3c100e70 0x7f1b3c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 -- 172.21.15.6:0/2591378945 >> 172.21.15.6:0/2591378945 conn(0x7f1b3c0fb1f0 msgr2=0x7f1b3c0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 -- 172.21.15.6:0/2591378945 shutdown_connections 2023-09-13T09:33:11.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.415+0000 7f1b42a41700 1 -- 172.21.15.6:0/2591378945 wait complete. 2023-09-13T09:33:11.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.416+0000 7f1b42a41700 1 Processor -- start 2023-09-13T09:33:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.416+0000 7f1b42a41700 1 -- start start 2023-09-13T09:33:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b42a41700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c194840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b42a41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c100e70 0x7f1b3c194d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:11.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b42a41700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b3c101810 0x7f1b3c19be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:11.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b42a41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c19c3d0 con 0x7f1b3c100e70 2023-09-13T09:33:11.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b42a41700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c19c510 con 0x7f1b3c0ffc70 2023-09-13T09:33:11.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b42a41700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b3c19c6a0 con 0x7f1b3c101810 2023-09-13T09:33:11.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c100e70 0x7f1b3c194d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:11.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c194840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:11.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c100e70 0x7f1b3c194d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59508/0 (socket says 172.21.15.6:59508) 2023-09-13T09:33:11.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 -- 172.21.15.6:0/332730366 learned_addr learned my addr 172.21.15.6:0/332730366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:33:11.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3bfff700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c194840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:53030/0 (socket says 172.21.15.6:53030) 2023-09-13T09:33:11.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b40fde700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b3c101810 0x7f1b3c19be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:11.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 -- 172.21.15.6:0/332730366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b3c101810 msgr2=0x7f1b3c19be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b3c101810 0x7f1b3c19be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 -- 172.21.15.6:0/332730366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c0ffc70 msgr2=0x7f1b3c194840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c194840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 -- 172.21.15.6:0/332730366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b2c0095f0 con 0x7f1b3c100e70 2023-09-13T09:33:11.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b40fde700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b3c101810 0x7f1b3c19be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:33:11.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3bfff700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c194840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:33:11.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b3b7fe700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c100e70 0x7f1b3c194d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009ca0 tx=0x7f1b240071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:11.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.417+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b24007b90 con 0x7f1b3c100e70 2023-09-13T09:33:11.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.418+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1b24015040 con 0x7f1b3c100e70 2023-09-13T09:33:11.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.418+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b240185b0 con 0x7f1b3c100e70 2023-09-13T09:33:11.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.418+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b3c19c980 con 0x7f1b3c100e70 2023-09-13T09:33:11.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.418+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b3c19ce30 con 0x7f1b3c100e70 2023-09-13T09:33:11.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.418+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 45386+0+0 (secure 0 0 0) 0x7f1b24018710 con 0x7f1b3c100e70 2023-09-13T09:33:11.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.419+0000 7f1b397fa700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1b28038630 0x7f1b2803aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:11.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.419+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b3c107290 con 0x7f1b3c100e70 2023-09-13T09:33:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.419+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1b2404ee50 con 0x7f1b3c100e70 2023-09-13T09:33:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.419+0000 7f1b3bfff700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1b28038630 0x7f1b2803aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.419+0000 7f1b3bfff700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1b28038630 0x7f1b2803aaf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009990 tx=0x7f1b2c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:11.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.424+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1b24017ae0 con 0x7f1b3c100e70 2023-09-13T09:33:11.506 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:11.136+0000 7f61ecc59200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-13T09:33:11.506 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:11.251+0000 7f61ecc59200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-13T09:33:11.506 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:11.372+0000 7f61ecc59200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-13T09:33:11.518 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:11.453+0000 7fab49c40200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T09:33:11.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:11.633+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b3c02d0e0 con 0x7f1b28038630 2023-09-13T09:33:11.886 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:11.616+0000 7fab49c40200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T09:33:12.256 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:11.899+0000 7f61ecc59200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-13T09:33:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:12.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:12.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:12.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:12.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:12.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:12.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:12.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:12.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:12.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.269 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:11.886+0000 7fab49c40200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T09:33:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:12.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:12.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:12.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:12.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-09-13T09:33:12.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-09-13T09:33:12.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:12.906 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:12.587+0000 7fab49c40200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T09:33:12.907 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:12.717+0000 7fab49c40200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T09:33:12.996 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:12 smithi006 ceph-mon[98665]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:12.996 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:12 smithi006 ceph-mon[98665]: Reconfiguring mgr.x (unknown last config time)... 2023-09-13T09:33:12.997 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:12 smithi006 ceph-mon[98665]: Reconfiguring daemon mgr.x on smithi006 2023-09-13T09:33:13.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:12 smithi053 ceph-mon[102373]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:13.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:12 smithi053 ceph-mon[102373]: Reconfiguring mgr.x (unknown last config time)... 2023-09-13T09:33:13.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:12 smithi053 ceph-mon[102373]: Reconfiguring daemon mgr.x on smithi006 2023-09-13T09:33:13.008 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:12 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:12.699+0000 7f61ecc59200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-13T09:33:13.009 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:12 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:12.798+0000 7f61ecc59200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-13T09:33:13.235 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:12 smithi131 ceph-mon[102785]: from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:13.235 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:12 smithi131 ceph-mon[102785]: Reconfiguring mgr.x (unknown last config time)... 2023-09-13T09:33:13.236 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:12 smithi131 ceph-mon[102785]: Reconfiguring daemon mgr.x on smithi006 2023-09-13T09:33:13.236 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:12.907+0000 7fab49c40200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T09:33:13.236 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:13.021+0000 7fab49c40200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T09:33:13.236 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:13.235+0000 7fab49c40200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T09:33:14.106 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:13.774+0000 7f61ecc59200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:33:14.106 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:13.885+0000 7f61ecc59200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-13T09:33:14.106 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-mon[102373]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:14.107 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.107 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.107 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:14.107 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:14.108 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:14.108 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:13 smithi006 ceph-mon[98665]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:14.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:14.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:14.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.268 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z[104891]: 2023-09-13T09:33:14.130+0000 7fab49c40200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T09:33:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-mon[102785]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:14.710 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:14.106+0000 7f61ecc59200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-13T09:33:14.710 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:14.457+0000 7f61ecc59200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-13T09:33:14.710 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:14.710+0000 7f61ecc59200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-13T09:33:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:14.919+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 14) v1 ==== 90294+0+0 (secure 0 0 0) 0x7f1b24023980 con 0x7f1b3c100e70 2023-09-13T09:33:15.006 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:14.894+0000 7f61ecc59200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-13T09:33:15.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: Standby manager daemon z started 2023-09-13T09:33:15.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-13T09:33:15.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-13T09:33:15.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-13T09:33:15.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-13T09:33:15.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2587933465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14f623c2-a72c-4bae-a3d6-1655d183ae8d"}]: dispatch 2023-09-13T09:33:15.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2587933465' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14f623c2-a72c-4bae-a3d6-1655d183ae8d"}]': finished 2023-09-13T09:33:15.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: osdmap e5: 1 total, 0 up, 1 in 2023-09-13T09:33:15.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: Standby manager daemon z started 2023-09-13T09:33:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-13T09:33:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-13T09:33:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-13T09:33:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-13T09:33:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2587933465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14f623c2-a72c-4bae-a3d6-1655d183ae8d"}]: dispatch 2023-09-13T09:33:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2587933465' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14f623c2-a72c-4bae-a3d6-1655d183ae8d"}]': finished 2023-09-13T09:33:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: osdmap e5: 1 total, 0 up, 1 in 2023-09-13T09:33:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: Standby manager daemon z started 2023-09-13T09:33:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-09-13T09:33:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-13T09:33:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-09-13T09:33:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.131:0/2419356516' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-13T09:33:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2587933465' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14f623c2-a72c-4bae-a3d6-1655d183ae8d"}]: dispatch 2023-09-13T09:33:15.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2587933465' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14f623c2-a72c-4bae-a3d6-1655d183ae8d"}]': finished 2023-09-13T09:33:15.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: osdmap e5: 1 total, 0 up, 1 in 2023-09-13T09:33:15.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:15.506 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:15 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:15.223+0000 7f61ecc59200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-13T09:33:16.208 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:16.049+0000 7f61ecc59200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-13T09:33:16.208 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:15 smithi053 ceph-mon[102373]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:16.208 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:15 smithi053 ceph-mon[102373]: mgrmap e14: x(active, since 68s), standbys: z 2023-09-13T09:33:16.209 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-13T09:33:16.209 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:15 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2951672305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:15 smithi006 ceph-mon[98665]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:15 smithi006 ceph-mon[98665]: mgrmap e14: x(active, since 68s), standbys: z 2023-09-13T09:33:16.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-13T09:33:16.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:15 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2951672305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:15 smithi131 ceph-mon[102785]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:15 smithi131 ceph-mon[102785]: mgrmap e14: x(active, since 68s), standbys: z 2023-09-13T09:33:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-09-13T09:33:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:15 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2951672305' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:16.506 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:16.208+0000 7f61ecc59200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-13T09:33:16.506 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:16.453+0000 7f61ecc59200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-13T09:33:16.863 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:16.589+0000 7f61ecc59200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-13T09:33:17.257 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:16.862+0000 7f61ecc59200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-13T09:33:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:17 smithi006 ceph-mon[98665]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:17 smithi053 ceph-mon[102373]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:18.257 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 09:33:17 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y[103832]: 2023-09-13T09:33:17.909+0000 7f61ecc59200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-13T09:33:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:17 smithi131 ceph-mon[102785]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:18.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:18.931+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mgrmap(e 15) v1 ==== 135202+0+0 (secure 0 0 0) 0x7f1b24023460 con 0x7f1b3c100e70 2023-09-13T09:33:19.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:18 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-13T09:33:19.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:18 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-13T09:33:19.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:18 smithi053 ceph-mon[102373]: Standby manager daemon y started 2023-09-13T09:33:19.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:18 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-13T09:33:19.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:18 smithi053 ceph-mon[102373]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-13T09:33:19.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:18 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-13T09:33:19.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:18 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-13T09:33:19.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:18 smithi006 ceph-mon[98665]: Standby manager daemon y started 2023-09-13T09:33:19.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:18 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-13T09:33:19.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:18 smithi006 ceph-mon[98665]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-13T09:33:19.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:18 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-09-13T09:33:19.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:18 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-09-13T09:33:19.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:18 smithi131 ceph-mon[102785]: Standby manager daemon y started 2023-09-13T09:33:19.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:18 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-09-13T09:33:19.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:18 smithi131 ceph-mon[102785]: from='mgr.? 172.21.15.53:0/763439755' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-09-13T09:33:20.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:19 smithi006 ceph-mon[98665]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:20.128 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:19 smithi006 ceph-mon[98665]: mgrmap e15: x(active, since 72s), standbys: z, y 2023-09-13T09:33:20.129 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-13T09:33:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:19 smithi053 ceph-mon[102373]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:19 smithi053 ceph-mon[102373]: mgrmap e15: x(active, since 72s), standbys: z, y 2023-09-13T09:33:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-13T09:33:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:19 smithi131 ceph-mon[102785]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:19 smithi131 ceph-mon[102785]: mgrmap e15: x(active, since 72s), standbys: z, y 2023-09-13T09:33:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-09-13T09:33:22.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:21 smithi006 ceph-mon[98665]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:22.203 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-13T09:33:22.204 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:21 smithi053 ceph-mon[102373]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-13T09:33:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:21 smithi131 ceph-mon[102785]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-09-13T09:33:22.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:23.188 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:22 smithi006 ceph-mon[98665]: Deploying daemon osd.0 on smithi006 2023-09-13T09:33:23.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:22 smithi053 ceph-mon[102373]: Deploying daemon osd.0 on smithi006 2023-09-13T09:33:23.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:22 smithi131 ceph-mon[102785]: Deploying daemon osd.0 on smithi006 2023-09-13T09:33:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:23 smithi053 ceph-mon[102373]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:23 smithi006 ceph-mon[98665]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:23 smithi131 ceph-mon[102785]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:26.180 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:25 smithi006 ceph-mon[98665]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:26.180 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:26.181 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:26.181 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:25 smithi053 ceph-mon[102373]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:25 smithi131 ceph-mon[102785]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:27 smithi006 ceph-mon[98665]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:27 smithi053 ceph-mon[102373]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:28.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:28.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:27 smithi131 ceph-mon[102785]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:28.438 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 0 on host 'smithi006' 2023-09-13T09:33:28.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.438+0000 7f1b397fa700 1 -- 172.21.15.6:0/332730366 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1b3c02d0e0 con 0x7f1b28038630 2023-09-13T09:33:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.440+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1b28038630 msgr2=0x7f1b2803aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.440+0000 7f1b42a41700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1b28038630 0x7f1b2803aaf0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1b2c009990 tx=0x7f1b2c01a040 comp rx=0 tx=0).stop 2023-09-13T09:33:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.440+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c100e70 msgr2=0x7f1b3c194d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.440+0000 7f1b42a41700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c100e70 0x7f1b3c194d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b24009ca0 tx=0x7f1b240071c0 comp rx=0 tx=0).stop 2023-09-13T09:33:28.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 shutdown_connections 2023-09-13T09:33:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b3c101810 0x7f1b3c19be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1b3c0ffc70 0x7f1b3c194840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1b28038630 0x7f1b2803aaf0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:28.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 --2- 172.21.15.6:0/332730366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1b3c100e70 0x7f1b3c194d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 >> 172.21.15.6:0/332730366 conn(0x7f1b3c0fb1f0 msgr2=0x7f1b3c1043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 shutdown_connections 2023-09-13T09:33:28.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:33:28.441+0000 7f1b42a41700 1 -- 172.21.15.6:0/332730366 wait complete. 2023-09-13T09:33:28.806 DEBUG:teuthology.orchestra.run.smithi006:osd.0> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.0.service 2023-09-13T09:33:28.809 INFO:tasks.cephadm:Deploying osd.1 on smithi053 with /dev/vg_nvme/lv_4... 2023-09-13T09:33:28.809 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-13T09:33:28.839 INFO:journalctl@ceph.osd.0.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:33:29.370 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:33:29.660 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:29 smithi006 ceph-mon[98665]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:29.661 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:29.661 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:29.662 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:29.666 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:29 smithi053 ceph-mon[102373]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:29.667 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:29.667 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:29.668 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:29.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:29 smithi131 ceph-mon[102785]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:29.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:29.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:29.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:30.006 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:33:29 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-0[116505]: 2023-09-13T09:33:29.705+0000 7f398ef62640 -1 osd.0 0 log_to_monitors true 2023-09-13T09:33:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:30 smithi006 ceph-mon[98665]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-13T09:33:30.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:30 smithi053 ceph-mon[102373]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-13T09:33:30.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:30 smithi131 ceph-mon[102785]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-09-13T09:33:30.926 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-13T09:33:30.927 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-13T09:33:30.927 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2023-09-13T09:33:30.927 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2023-09-13T09:33:30.927 INFO:teuthology.orchestra.run.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0080635 s, 1.3 GB/s 2023-09-13T09:33:30.927 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 2023-09-13T09:33:30.928 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2023-09-13T09:33:31.331 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi053:vg_nvme/lv_4 2023-09-13T09:33:31.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:31 smithi006 ceph-mon[98665]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:31.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:31 smithi006 ceph-mon[98665]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-13T09:33:31.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:31 smithi006 ceph-mon[98665]: osdmap e6: 1 total, 0 up, 1 in 2023-09-13T09:33:31.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:31 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:31.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:31 smithi006 ceph-mon[98665]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:33:31.757 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:33:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-0[116505]: 2023-09-13T09:33:31.413+0000 7f3983dd8700 -1 osd.0 0 waiting for initial osdmap 2023-09-13T09:33:31.757 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:33:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-0[116505]: 2023-09-13T09:33:31.419+0000 7f397cbc7700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:33:31.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:31 smithi053 ceph-mon[102373]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:31.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:31 smithi053 ceph-mon[102373]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-13T09:33:31.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:31 smithi053 ceph-mon[102373]: osdmap e6: 1 total, 0 up, 1 in 2023-09-13T09:33:31.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:31 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:31.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:31 smithi053 ceph-mon[102373]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:33:31.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:31 smithi131 ceph-mon[102785]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:31.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:31 smithi131 ceph-mon[102785]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-09-13T09:33:31.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:31 smithi131 ceph-mon[102785]: osdmap e6: 1 total, 0 up, 1 in 2023-09-13T09:33:31.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:31 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:31.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:31 smithi131 ceph-mon[102785]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:33:31.894 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:33:32.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:33:32.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: osdmap e7: 1 total, 0 up, 1 in 2023-09-13T09:33:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi006 2023-09-13T09:33:32.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:33:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi006 to 17173M 2023-09-13T09:33:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:32.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:32.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:33:32.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: osdmap e7: 1 total, 0 up, 1 in 2023-09-13T09:33:32.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:32.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:32.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi006 2023-09-13T09:33:32.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:33:32.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi006 to 17173M 2023-09-13T09:33:32.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:32.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:32.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:33:32.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: osdmap e7: 1 total, 0 up, 1 in 2023-09-13T09:33:32.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:32.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:32.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi006 2023-09-13T09:33:32.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:33:32.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi006 to 17173M 2023-09-13T09:33:32.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:32.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:32.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:32.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:33.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 -- 172.21.15.53:0/124588288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 msgr2=0x7f4f981080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:33.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/124588288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f981080c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4f9000b0d0 tx=0x7f4f9000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:33:33.184 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 -- 172.21.15.53:0/124588288 shutdown_connections 2023-09-13T09:33:33.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/124588288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f981080c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:33.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/124588288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f980ffc70 0x7f4f98100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:33.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/124588288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f98100e70 0x7f4f981012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:33.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 -- 172.21.15.53:0/124588288 >> 172.21.15.53:0/124588288 conn(0x7f4f980fb1f0 msgr2=0x7f4f980fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:33.185 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 -- 172.21.15.53:0/124588288 shutdown_connections 2023-09-13T09:33:33.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.181+0000 7f4f9cb98700 1 -- 172.21.15.53:0/124588288 wait complete. 2023-09-13T09:33:33.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 Processor -- start 2023-09-13T09:33:33.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 -- start start 2023-09-13T09:33:33.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f980ffc70 0x7f4f98195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:33.186 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f98100e70 0x7f4f98195f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:33.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f9819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:33.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9819d5b0 con 0x7f4f980ffc70 2023-09-13T09:33:33.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9819d6f0 con 0x7f4f98101810 2023-09-13T09:33:33.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.182+0000 7f4f9cb98700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f9819d880 con 0x7f4f98100e70 2023-09-13T09:33:33.187 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f9819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:33.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f9819cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:59924/0 (socket says 172.21.15.53:59924) 2023-09-13T09:33:33.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 -- 172.21.15.53:0/2066600104 learned_addr learned my addr 172.21.15.53:0/2066600104 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-13T09:33:33.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f9659c700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f980ffc70 0x7f4f98195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:33.188 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f95d9b700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f98100e70 0x7f4f98195f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 -- 172.21.15.53:0/2066600104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f98100e70 msgr2=0x7f4f98195f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f98100e70 0x7f4f98195f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 -- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f980ffc70 msgr2=0x7f4f98195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f980ffc70 0x7f4f98195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 -- 172.21.15.53:0/2066600104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f90009d00 con 0x7f4f98101810 2023-09-13T09:33:33.189 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f9659c700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f980ffc70 0x7f4f98195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:33:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f96d9d700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f9819cfe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007a00 tx=0x7f4f900126d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f8f7fe700 1 -- 172.21.15.53:0/2066600104 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9000e040 con 0x7f4f98101810 2023-09-13T09:33:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f8f7fe700 1 -- 172.21.15.53:0/2066600104 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f9000ceb0 con 0x7f4f98101810 2023-09-13T09:33:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f9819db00 con 0x7f4f98101810 2023-09-13T09:33:33.190 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f8f7fe700 1 -- 172.21.15.53:0/2066600104 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9001bb90 con 0x7f4f98101810 2023-09-13T09:33:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.183+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f9819dff0 con 0x7f4f98101810 2023-09-13T09:33:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.184+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f9810b540 con 0x7f4f98101810 2023-09-13T09:33:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.186+0000 7f4f8f7fe700 1 -- 172.21.15.53:0/2066600104 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 15) v1 ==== 135202+0+0 (secure 0 0 0) 0x7f4f9001bcf0 con 0x7f4f98101810 2023-09-13T09:33:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.186+0000 7f4f8f7fe700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f840a05b0 0x7f4f840a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:33.192 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.186+0000 7f4f8f7fe700 1 -- 172.21.15.53:0/2066600104 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f4f900cc0c0 con 0x7f4f98101810 2023-09-13T09:33:33.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.186+0000 7f4f9659c700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f840a05b0 0x7f4f840a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:33.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.187+0000 7f4f9659c700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f840a05b0 0x7f4f840a2a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f98100cd0 tx=0x7f4f8000a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:33.193 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.190+0000 7f4f8f7fe700 1 -- 172.21.15.53:0/2066600104 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4f900976f0 con 0x7f4f98101810 2023-09-13T09:33:33.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:33.397+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f980610f0 con 0x7f4f840a05b0 2023-09-13T09:33:33.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:33:33.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:33:33.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:33.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:33.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] boot 2023-09-13T09:33:33.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: osdmap e8: 1 total, 1 up, 1 in 2023-09-13T09:33:33.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:33.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:33.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:33.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:33.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:33:33.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:33:33.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:33.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:33.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] boot 2023-09-13T09:33:33.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: osdmap e8: 1 total, 1 up, 1 in 2023-09-13T09:33:33.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:33.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:33.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:33.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:33.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:33:33.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:33:33.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-09-13T09:33:33.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:33.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: osd.0 [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] boot 2023-09-13T09:33:33.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: osdmap e8: 1 total, 1 up, 1 in 2023-09-13T09:33:33.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-09-13T09:33:33.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:33.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:33.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:34.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:34 smithi006 ceph-mon[98665]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:34.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:34 smithi006 ceph-mon[98665]: osdmap e9: 1 total, 1 up, 1 in 2023-09-13T09:33:34.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:34 smithi053 ceph-mon[102373]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:34.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:34 smithi053 ceph-mon[102373]: osdmap e9: 1 total, 1 up, 1 in 2023-09-13T09:33:34.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:34 smithi131 ceph-mon[102785]: from='client.24149 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:34.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:34 smithi131 ceph-mon[102785]: osdmap e9: 1 total, 1 up, 1 in 2023-09-13T09:33:35.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:35 smithi006 ceph-mon[98665]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:35.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:35 smithi053 ceph-mon[102373]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:35.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:35 smithi131 ceph-mon[102785]: pgmap v43: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:36.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:36 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/1868410418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]: dispatch 2023-09-13T09:33:36.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:36 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]: dispatch 2023-09-13T09:33:36.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:36 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]': finished 2023-09-13T09:33:36.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:36 smithi006 ceph-mon[98665]: osdmap e10: 2 total, 1 up, 2 in 2023-09-13T09:33:36.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:36 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:36.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:36 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/1868410418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]: dispatch 2023-09-13T09:33:36.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:36 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]: dispatch 2023-09-13T09:33:36.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:36 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]': finished 2023-09-13T09:33:36.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:36 smithi053 ceph-mon[102373]: osdmap e10: 2 total, 1 up, 2 in 2023-09-13T09:33:36.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:36 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:36.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:36 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/1868410418' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]: dispatch 2023-09-13T09:33:36.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:36 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]: dispatch 2023-09-13T09:33:36.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:36 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef1e644c-ae97-44af-9d69-43f58e7e946d"}]': finished 2023-09-13T09:33:36.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:36 smithi131 ceph-mon[102785]: osdmap e10: 2 total, 1 up, 2 in 2023-09-13T09:33:36.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:36 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:37.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:37 smithi006 ceph-mon[98665]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:37.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:37 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/707103064' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:37.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:37 smithi053 ceph-mon[102373]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:37.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:37 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/707103064' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:37.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:37 smithi131 ceph-mon[102785]: pgmap v45: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:37.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:37 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/707103064' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:39.728 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:39 smithi053 ceph-mon[102373]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:39.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:39 smithi006 ceph-mon[98665]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:39.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:39 smithi131 ceph-mon[102785]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:41.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:41 smithi006 ceph-mon[98665]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:41.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:41 smithi053 ceph-mon[102373]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:41.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:41 smithi131 ceph-mon[102785]: pgmap v47: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:43.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:43 smithi006 ceph-mon[98665]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:43.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-13T09:33:43.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:43.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:43 smithi006 ceph-mon[98665]: Deploying daemon osd.1 on smithi053 2023-09-13T09:33:43.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:43 smithi053 ceph-mon[102373]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:43.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-13T09:33:43.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:43.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:43 smithi053 ceph-mon[102373]: Deploying daemon osd.1 on smithi053 2023-09-13T09:33:43.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:43 smithi131 ceph-mon[102785]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:43.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-09-13T09:33:43.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:43.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:43 smithi131 ceph-mon[102785]: Deploying daemon osd.1 on smithi053 2023-09-13T09:33:45.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:45 smithi006 ceph-mon[98665]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:45.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:45 smithi053 ceph-mon[102373]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:45.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:45 smithi131 ceph-mon[102785]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:47.946 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:47 smithi053 ceph-mon[102373]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:47.946 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:47 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:47.947 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:47 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:47.947 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:47 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:48.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:47 smithi006 ceph-mon[98665]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:48.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:47 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:48.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:47 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:48.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:47 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:48.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:47 smithi131 ceph-mon[102785]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:48.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:47 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:48.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:47 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:48.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:47 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:49.512 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.511+0000 7f4f8f7fe700 1 -- 172.21.15.53:0/2066600104 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4f980610f0 con 0x7f4f840a05b0 2023-09-13T09:33:49.514 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 1 on host 'smithi053' 2023-09-13T09:33:49.516 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f840a05b0 msgr2=0x7f4f840a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f840a05b0 0x7f4f840a2a70 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4f98100cd0 tx=0x7f4f8000a680 comp rx=0 tx=0).stop 2023-09-13T09:33:49.518 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 msgr2=0x7f4f9819cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:49.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f9819cfe0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4f90007a00 tx=0x7f4f900126d0 comp rx=0 tx=0).stop 2023-09-13T09:33:49.520 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 shutdown_connections 2023-09-13T09:33:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f98101810 0x7f4f9819cfe0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:49.521 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f840a05b0 0x7f4f840a2a70 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:49.522 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f980ffc70 0x7f4f98195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 --2- 172.21.15.53:0/2066600104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f98100e70 0x7f4f98195f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 >> 172.21.15.53:0/2066600104 conn(0x7f4f980fb1f0 msgr2=0x7f4f980fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:49.523 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.513+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 shutdown_connections 2023-09-13T09:33:49.525 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:33:49.514+0000 7f4f9cb98700 1 -- 172.21.15.53:0/2066600104 wait complete. 2023-09-13T09:33:49.893 DEBUG:teuthology.orchestra.run.smithi053:osd.1> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.1.service 2023-09-13T09:33:49.895 INFO:tasks.cephadm:Deploying osd.2 on smithi131 with /dev/vg_nvme/lv_4... 2023-09-13T09:33:49.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-09-13T09:33:49.935 INFO:journalctl@ceph.osd.1.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:33:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:50.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:50.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:50.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:33:50.458 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:33:51.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:50 smithi053 ceph-mon[102373]: from='osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-13T09:33:51.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:50 smithi053 ceph-mon[102373]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-13T09:33:51.007 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:33:50 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-1[107437]: 2023-09-13T09:33:50.697+0000 7f394c991640 -1 osd.1 0 log_to_monitors true 2023-09-13T09:33:51.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:50 smithi131 ceph-mon[102785]: from='osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-13T09:33:51.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:50 smithi131 ceph-mon[102785]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-13T09:33:51.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:50 smithi006 ceph-mon[98665]: from='osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-13T09:33:51.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:50 smithi006 ceph-mon[98665]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-09-13T09:33:52.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:51 smithi131 ceph-mon[102785]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:52.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:51 smithi131 ceph-mon[102785]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-13T09:33:52.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:51 smithi131 ceph-mon[102785]: osdmap e11: 2 total, 1 up, 2 in 2023-09-13T09:33:52.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:52.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:51 smithi131 ceph-mon[102785]: from='osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:33:52.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:51 smithi131 ceph-mon[102785]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:33:52.045 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-09-13T09:33:52.045 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-09-13T09:33:52.046 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-09-13T09:33:52.046 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-09-13T09:33:52.047 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011173 s, 938 MB/s 2023-09-13T09:33:52.047 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-09-13T09:33:52.128 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-1[107437]: 2023-09-13T09:33:51.791+0000 7f3941807700 -1 osd.1 0 waiting for initial osdmap 2023-09-13T09:33:52.128 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-1[107437]: 2023-09-13T09:33:51.795+0000 7f393b5f8700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:33:52.129 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-mon[102373]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:52.129 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-mon[102373]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-13T09:33:52.129 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-mon[102373]: osdmap e11: 2 total, 1 up, 2 in 2023-09-13T09:33:52.129 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:52.129 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-mon[102373]: from='osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:33:52.130 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:51 smithi053 ceph-mon[102373]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:33:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:51 smithi006 ceph-mon[98665]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:51 smithi006 ceph-mon[98665]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-09-13T09:33:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:51 smithi006 ceph-mon[98665]: osdmap e11: 2 total, 1 up, 2 in 2023-09-13T09:33:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:52.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:51 smithi006 ceph-mon[98665]: from='osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:33:52.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:51 smithi006 ceph-mon[98665]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:33:52.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi131:vg_nvme/lv_4 2023-09-13T09:33:53.066 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:33:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:33:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: osdmap e12: 2 total, 1 up, 2 in 2023-09-13T09:33:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:33:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:33:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: osdmap e12: 2 total, 1 up, 2 in 2023-09-13T09:33:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:33:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:33:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: osdmap e12: 2 total, 1 up, 2 in 2023-09-13T09:33:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:33:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:33:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:33:54.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:33:54.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:33:54.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:54.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi053 2023-09-13T09:33:54.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi053 to 17173M 2023-09-13T09:33:54.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:54.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] boot 2023-09-13T09:33:54.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: osdmap e13: 2 total, 2 up, 2 in 2023-09-13T09:33:54.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:33:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:33:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi053 2023-09-13T09:33:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi053 to 17173M 2023-09-13T09:33:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] boot 2023-09-13T09:33:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: osdmap e13: 2 total, 2 up, 2 in 2023-09-13T09:33:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:54.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:33:54.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:33:54.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-09-13T09:33:54.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi053 2023-09-13T09:33:54.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi053 to 17173M 2023-09-13T09:33:54.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:54.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: osd.1 [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] boot 2023-09-13T09:33:54.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: osdmap e13: 2 total, 2 up, 2 in 2023-09-13T09:33:54.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-09-13T09:33:54.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.331+0000 7fcc8f58b700 1 -- 172.21.15.131:0/3975784240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 msgr2=0x7fcc881080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:54.333 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.331+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/3975784240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc881080c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fcc8000b0a0 tx=0x7fcc8000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:33:54.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.331+0000 7fcc8f58b700 1 -- 172.21.15.131:0/3975784240 shutdown_connections 2023-09-13T09:33:54.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.331+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/3975784240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc881080c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:54.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.331+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/3975784240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc880ffc70 0x7fcc88100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:54.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.331+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/3975784240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc88100e70 0x7fcc881012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:54.334 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.331+0000 7fcc8f58b700 1 -- 172.21.15.131:0/3975784240 >> 172.21.15.131:0/3975784240 conn(0x7fcc880fb1f0 msgr2=0x7fcc880fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:33:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 -- 172.21.15.131:0/3975784240 shutdown_connections 2023-09-13T09:33:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 -- 172.21.15.131:0/3975784240 wait complete. 2023-09-13T09:33:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 Processor -- start 2023-09-13T09:33:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 -- start start 2023-09-13T09:33:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc880ffc70 0x7fcc88103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:54.335 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88100e70 0x7fcc88102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc88102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88102f10 con 0x7fcc880ffc70 2023-09-13T09:33:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc88103080 con 0x7fcc88100e70 2023-09-13T09:33:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8f58b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc881a0be0 con 0x7fcc88101810 2023-09-13T09:33:54.336 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8db28700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc88102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8db28700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc88102790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33532/0 (socket says 172.21.15.131:33532) 2023-09-13T09:33:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8db28700 1 -- 172.21.15.131:0/711840951 learned_addr learned my addr 172.21.15.131:0/711840951 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:33:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.332+0000 7fcc8d327700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc880ffc70 0x7fcc88103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:54.337 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8cb26700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88100e70 0x7fcc88102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:54.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8db28700 1 -- 172.21.15.131:0/711840951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88100e70 msgr2=0x7fcc88102250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:54.341 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8db28700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88100e70 0x7fcc88102250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:54.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8db28700 1 -- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc880ffc70 msgr2=0x7fcc88103c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:33:54.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8db28700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc880ffc70 0x7fcc88103c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:33:54.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8db28700 1 -- 172.21.15.131:0/711840951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc80009d00 con 0x7fcc88101810 2023-09-13T09:33:54.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8cb26700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88100e70 0x7fcc88102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:33:54.342 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8db28700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc88102790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc800062a0 tx=0x7fcc80004d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc7a7fc700 1 -- 172.21.15.131:0/711840951 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc8000e040 con 0x7fcc88101810 2023-09-13T09:33:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc7a7fc700 1 -- 172.21.15.131:0/711840951 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc80009440 con 0x7fcc88101810 2023-09-13T09:33:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc881a0e60 con 0x7fcc88101810 2023-09-13T09:33:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc7a7fc700 1 -- 172.21.15.131:0/711840951 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc80004020 con 0x7fcc88101810 2023-09-13T09:33:54.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.333+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc881a12f0 con 0x7fcc88101810 2023-09-13T09:33:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.334+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc8810b510 con 0x7fcc88101810 2023-09-13T09:33:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.335+0000 7fcc7a7fc700 1 -- 172.21.15.131:0/711840951 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 15) v1 ==== 135202+0+0 (secure 0 0 0) 0x7fcc8001d690 con 0x7fcc88101810 2023-09-13T09:33:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.335+0000 7fcc7a7fc700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc740a0630 0x7fcc740a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:33:54.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.336+0000 7fcc7a7fc700 1 -- 172.21.15.131:0/711840951 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fcc800cbba0 con 0x7fcc88101810 2023-09-13T09:33:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.336+0000 7fcc8d327700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc740a0630 0x7fcc740a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:33:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.336+0000 7fcc8d327700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc740a0630 0x7fcc740a2af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcc88100cd0 tx=0x7fcc7c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:33:54.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.340+0000 7fcc7a7fc700 1 -- 172.21.15.131:0/711840951 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcc80096f10 con 0x7fcc88101810 2023-09-13T09:33:54.538 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:33:54.538+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc88068f30 con 0x7fcc740a0630 2023-09-13T09:33:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:54 smithi006 ceph-mon[98665]: osdmap e14: 2 total, 2 up, 2 in 2023-09-13T09:33:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:54 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:54 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:54 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:54 smithi053 ceph-mon[102373]: osdmap e14: 2 total, 2 up, 2 in 2023-09-13T09:33:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:54 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:54 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:55.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:54 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:54 smithi131 ceph-mon[102785]: osdmap e14: 2 total, 2 up, 2 in 2023-09-13T09:33:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:54 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:33:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:54 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:33:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:54 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:33:56.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:55 smithi131 ceph-mon[102785]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:33:56.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:55 smithi131 ceph-mon[102785]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:55 smithi006 ceph-mon[98665]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:33:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:55 smithi006 ceph-mon[98665]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:55 smithi053 ceph-mon[102373]: pgmap v58: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:33:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:55 smithi053 ceph-mon[102373]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:33:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:57 smithi006 ceph-mon[98665]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:33:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:57 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/1562885703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]: dispatch 2023-09-13T09:33:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:57 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]: dispatch 2023-09-13T09:33:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:57 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]': finished 2023-09-13T09:33:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:57 smithi006 ceph-mon[98665]: osdmap e15: 3 total, 2 up, 3 in 2023-09-13T09:33:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:33:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:57 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/244810930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:58.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:57 smithi053 ceph-mon[102373]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:33:58.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:57 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/1562885703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]: dispatch 2023-09-13T09:33:58.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:57 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]: dispatch 2023-09-13T09:33:58.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:57 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]': finished 2023-09-13T09:33:58.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:57 smithi053 ceph-mon[102373]: osdmap e15: 3 total, 2 up, 3 in 2023-09-13T09:33:58.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:33:58.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:57 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/244810930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:33:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:57 smithi131 ceph-mon[102785]: pgmap v59: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:33:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:57 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/1562885703' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]: dispatch 2023-09-13T09:33:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:57 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]: dispatch 2023-09-13T09:33:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:57 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cc5a4835-e11d-4ae2-b317-7a00e34f74a5"}]': finished 2023-09-13T09:33:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:57 smithi131 ceph-mon[102785]: osdmap e15: 3 total, 2 up, 3 in 2023-09-13T09:33:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:33:58.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:57 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/244810930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:34:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:33:59 smithi053 ceph-mon[102373]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:00.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:33:59 smithi006 ceph-mon[98665]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:33:59 smithi131 ceph-mon[102785]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:02.103 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:01 smithi131 ceph-mon[102785]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:01 smithi006 ceph-mon[98665]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:01 smithi053 ceph-mon[102373]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:04.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:03 smithi131 ceph-mon[102785]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:04.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-13T09:34:04.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:03 smithi053 ceph-mon[102373]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-13T09:34:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:04.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:03 smithi006 ceph-mon[98665]: pgmap v63: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:04.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-09-13T09:34:04.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:05.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:04 smithi131 ceph-mon[102785]: Deploying daemon osd.2 on smithi131 2023-09-13T09:34:05.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:04 smithi053 ceph-mon[102373]: Deploying daemon osd.2 on smithi131 2023-09-13T09:34:05.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:04 smithi006 ceph-mon[98665]: Deploying daemon osd.2 on smithi131 2023-09-13T09:34:06.224 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:05 smithi131 ceph-mon[102785]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:05 smithi006 ceph-mon[98665]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:05 smithi053 ceph-mon[102373]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:08.125 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:07 smithi131 ceph-mon[102785]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:07 smithi006 ceph-mon[98665]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:07 smithi053 ceph-mon[102373]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:09.446 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:09 smithi131 ceph-mon[102785]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:09.447 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:09 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:09.447 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:09 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:09.447 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:09 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:09.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:09 smithi053 ceph-mon[102373]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:09.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:09 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:09.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:09 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:09.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:09 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:09 smithi006 ceph-mon[98665]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:09.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:09.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:10.902 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 2 on host 'smithi131' 2023-09-13T09:34:10.903 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.901+0000 7fcc7a7fc700 1 -- 172.21.15.131:0/711840951 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcc88068f30 con 0x7fcc740a0630 2023-09-13T09:34:10.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc740a0630 msgr2=0x7fcc740a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:10.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc740a0630 0x7fcc740a2af0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcc88100cd0 tx=0x7fcc7c009190 comp rx=0 tx=0).stop 2023-09-13T09:34:10.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 msgr2=0x7fcc88102790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:10.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc88102790 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc800062a0 tx=0x7fcc80004d00 comp rx=0 tx=0).stop 2023-09-13T09:34:10.905 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 shutdown_connections 2023-09-13T09:34:10.906 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc88101810 0x7fcc88102790 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:10.906 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc740a0630 0x7fcc740a2af0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:10.906 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc880ffc70 0x7fcc88103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:10.906 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 --2- 172.21.15.131:0/711840951 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc88100e70 0x7fcc88102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:10.907 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 >> 172.21.15.131:0/711840951 conn(0x7fcc880fb1f0 msgr2=0x7fcc88068820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:34:10.907 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 shutdown_connections 2023-09-13T09:34:10.907 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:10.904+0000 7fcc8f58b700 1 -- 172.21.15.131:0/711840951 wait complete. 2023-09-13T09:34:11.359 DEBUG:teuthology.orchestra.run.smithi131:osd.2> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.2.service 2023-09-13T09:34:11.361 INFO:tasks.cephadm:Deploying osd.3 on smithi006 with /dev/vg_nvme/lv_3... 2023-09-13T09:34:11.362 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-13T09:34:11.395 INFO:journalctl@ceph.osd.2.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:34:11.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:11.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:11.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:11.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:11.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:11.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:11.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:11.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:11.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:11.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:11.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:11.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:11.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:34:12.479 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-2[108588]: 2023-09-13T09:34:12.194+0000 7f19c12eb640 -1 osd.2 0 log_to_monitors true 2023-09-13T09:34:12.564 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:12 smithi006 ceph-mon[98665]: from='osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-13T09:34:12.564 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:12 smithi006 ceph-mon[98665]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-13T09:34:12.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:12 smithi053 ceph-mon[102373]: from='osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-13T09:34:12.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:12 smithi053 ceph-mon[102373]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-13T09:34:12.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:12 smithi131 ceph-mon[102785]: from='osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-13T09:34:12.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:12 smithi131 ceph-mon[102785]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-09-13T09:34:13.687 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-13T09:34:13.687 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-13T09:34:13.687 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-09-13T09:34:13.687 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-09-13T09:34:13.688 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0153434 s, 683 MB/s 2023-09-13T09:34:13.688 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 2023-09-13T09:34:13.688 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-09-13T09:34:13.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:13 smithi006 ceph-mon[98665]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:13.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:13 smithi006 ceph-mon[98665]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-13T09:34:13.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:13 smithi006 ceph-mon[98665]: osdmap e16: 3 total, 2 up, 3 in 2023-09-13T09:34:13.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:13.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:13 smithi006 ceph-mon[98665]: from='osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:34:13.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:13 smithi006 ceph-mon[98665]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:34:13.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:13 smithi053 ceph-mon[102373]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:13.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:13 smithi053 ceph-mon[102373]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-13T09:34:13.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:13 smithi053 ceph-mon[102373]: osdmap e16: 3 total, 2 up, 3 in 2023-09-13T09:34:13.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:13.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:13 smithi053 ceph-mon[102373]: from='osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:34:13.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:13 smithi053 ceph-mon[102373]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:34:13.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-mon[102785]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:13.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-mon[102785]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-09-13T09:34:13.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-mon[102785]: osdmap e16: 3 total, 2 up, 3 in 2023-09-13T09:34:13.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:13.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-mon[102785]: from='osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:34:13.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-mon[102785]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:34:13.771 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-2[108588]: 2023-09-13T09:34:13.496+0000 7f19b6161700 -1 osd.2 0 waiting for initial osdmap 2023-09-13T09:34:13.771 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-2[108588]: 2023-09-13T09:34:13.502+0000 7f19b0f54700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:34:14.076 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi006:vg_nvme/lv_3 2023-09-13T09:34:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:34:14.755 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:34:14.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: osdmap e17: 3 total, 2 up, 3 in 2023-09-13T09:34:14.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:14.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:14.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:14.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:14.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:14.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:14 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:34:14.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: osdmap e17: 3 total, 2 up, 3 in 2023-09-13T09:34:14.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:14.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:14.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:14.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:14.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:14.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:14 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:34:14.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: osdmap e17: 3 total, 2 up, 3 in 2023-09-13T09:34:14.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:14.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:14.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:14.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:14.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:14.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:14.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:14 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:15.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:34:15.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:34:15.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:15.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi131 2023-09-13T09:34:15.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi131 to 17168M 2023-09-13T09:34:15.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] boot 2023-09-13T09:34:15.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: osdmap e18: 3 total, 3 up, 3 in 2023-09-13T09:34:15.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.790+0000 7f5d05d07700 1 -- 172.21.15.6:0/2360214397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 msgr2=0x7f5d00100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.790+0000 7f5d05d07700 1 --2- 172.21.15.6:0/2360214397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00100090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00099c0 tx=0x7f5cf0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:34:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 -- 172.21.15.6:0/2360214397 shutdown_connections 2023-09-13T09:34:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 --2- 172.21.15.6:0/2360214397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d00101810 0x7f5d001080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 --2- 172.21.15.6:0/2360214397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00100090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 --2- 172.21.15.6:0/2360214397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d00100e70 0x7f5d001012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 -- 172.21.15.6:0/2360214397 >> 172.21.15.6:0/2360214397 conn(0x7f5d000fb1f0 msgr2=0x7f5d000fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:34:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 -- 172.21.15.6:0/2360214397 shutdown_connections 2023-09-13T09:34:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 -- 172.21.15.6:0/2360214397 wait complete. 2023-09-13T09:34:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 Processor -- start 2023-09-13T09:34:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.791+0000 7f5d05d07700 1 -- start start 2023-09-13T09:34:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5d05d07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5d05d07700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d00100e70 0x7f5d0019b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5d05d07700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d00101810 0x7f5d0019ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5d05d07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0019e560 con 0x7f5d000ffc70 2023-09-13T09:34:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5d05d07700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0019e6d0 con 0x7f5d00100e70 2023-09-13T09:34:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5d05d07700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d0019e890 con 0x7f5d00101810 2023-09-13T09:34:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00069320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59584/0 (socket says 172.21.15.6:59584) 2023-09-13T09:34:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 -- 172.21.15.6:0/1203581337 learned_addr learned my addr 172.21.15.6:0/1203581337 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:34:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cfeffd700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d00100e70 0x7f5d0019b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 -- 172.21.15.6:0/1203581337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d00101810 msgr2=0x7f5d0019ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cfffff700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d00101810 0x7f5d0019ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d00101810 0x7f5d0019ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 -- 172.21.15.6:0/1203581337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d00100e70 msgr2=0x7f5d0019b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d00100e70 0x7f5d0019b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 -- 172.21.15.6:0/1203581337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cf00095f0 con 0x7f5d000ffc70 2023-09-13T09:34:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cfeffd700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d00100e70 0x7f5d0019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:34:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cfffff700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d00101810 0x7f5d0019ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:34:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cff7fe700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00069320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00036f0 tx=0x7f5cf00038c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:34:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf001d070 con 0x7f5d000ffc70 2023-09-13T09:34:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d0019eb10 con 0x7f5d000ffc70 2023-09-13T09:34:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5cf0022470 con 0x7f5d000ffc70 2023-09-13T09:34:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.792+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cf000f6c0 con 0x7f5d000ffc70 2023-09-13T09:34:15.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.793+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d0019ef20 con 0x7f5d000ffc70 2023-09-13T09:34:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.793+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d001071f0 con 0x7f5d000ffc70 2023-09-13T09:34:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.795+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) v1 ==== 135202+0+0 (secure 0 0 0) 0x7f5cf00225e0 con 0x7f5d000ffc70 2023-09-13T09:34:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.795+0000 7f5cfcff9700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ce80a05b0 0x7f5ce80a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.795+0000 7f5cfeffd700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ce80a05b0 0x7f5ce80a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.795+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 2851+0+0 (secure 0 0 0) 0x7f5cf00cc2e0 con 0x7f5d000ffc70 2023-09-13T09:34:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.796+0000 7f5cfeffd700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ce80a05b0 0x7f5ce80a2a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4005fd0 tx=0x7f5cf4005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:34:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:15.799+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5cf00974d0 con 0x7f5d000ffc70 2023-09-13T09:34:16.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:34:16.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:34:16.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:16.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi131 2023-09-13T09:34:16.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi131 to 17168M 2023-09-13T09:34:16.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] boot 2023-09-13T09:34:16.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: osdmap e18: 3 total, 3 up, 3 in 2023-09-13T09:34:16.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:16.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:34:16.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:34:16.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-09-13T09:34:16.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi131 2023-09-13T09:34:16.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi131 to 17168M 2023-09-13T09:34:16.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: osd.2 [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] boot 2023-09-13T09:34:16.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: osdmap e18: 3 total, 3 up, 3 in 2023-09-13T09:34:16.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-09-13T09:34:16.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:16.006+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d0002d120 con 0x7f5ce80a05b0 2023-09-13T09:34:16.873 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:16 smithi006 ceph-mon[98665]: osdmap e19: 3 total, 3 up, 3 in 2023-09-13T09:34:16.873 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:16 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:16.873 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:16 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:16.874 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:16 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:17.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:16 smithi053 ceph-mon[102373]: osdmap e19: 3 total, 3 up, 3 in 2023-09-13T09:34:17.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:16 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:17.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:16 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:17.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:16 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:17.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:16 smithi131 ceph-mon[102785]: osdmap e19: 3 total, 3 up, 3 in 2023-09-13T09:34:17.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:16 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:17.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:16 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:17.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:16 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:18.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:17 smithi053 ceph-mon[102373]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:18.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:17 smithi053 ceph-mon[102373]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:18.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-13T09:34:18.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-13T09:34:18.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:17 smithi053 ceph-mon[102373]: osdmap e20: 3 total, 3 up, 3 in 2023-09-13T09:34:18.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T09:34:18.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:17 smithi006 ceph-mon[98665]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:17 smithi006 ceph-mon[98665]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-13T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-13T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:17 smithi006 ceph-mon[98665]: osdmap e20: 3 total, 3 up, 3 in 2023-09-13T09:34:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T09:34:18.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:17 smithi131 ceph-mon[102785]: from='client.14289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:18.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:17 smithi131 ceph-mon[102785]: pgmap v74: 0 pgs: ; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:18.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-09-13T09:34:18.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-09-13T09:34:18.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:17 smithi131 ceph-mon[102785]: osdmap e20: 3 total, 3 up, 3 in 2023-09-13T09:34:18.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T09:34:18.507 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122199]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-13T09:34:18.507 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:18.508 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122199]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:18.508 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122199]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:19.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:18 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-13T09:34:19.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:18 smithi053 ceph-mon[102373]: osdmap e21: 3 total, 3 up, 3 in 2023-09-13T09:34:19.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:18 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3786953737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b740401d-7c68-4954-9789-b811d2effbba"}]: dispatch 2023-09-13T09:34:19.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:18 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3786953737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b740401d-7c68-4954-9789-b811d2effbba"}]': finished 2023-09-13T09:34:19.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:18 smithi053 ceph-mon[102373]: osdmap e22: 4 total, 3 up, 4 in 2023-09-13T09:34:19.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:18 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:19.008 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122216]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-13T09:34:19.008 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122216]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:19.008 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122216]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:19.009 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 09:34:18 smithi006 sudo[122216]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:19.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-13T09:34:19.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:18 smithi006 ceph-mon[98665]: osdmap e21: 3 total, 3 up, 3 in 2023-09-13T09:34:19.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:18 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3786953737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b740401d-7c68-4954-9789-b811d2effbba"}]: dispatch 2023-09-13T09:34:19.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:18 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3786953737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b740401d-7c68-4954-9789-b811d2effbba"}]': finished 2023-09-13T09:34:19.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:18 smithi006 ceph-mon[98665]: osdmap e22: 4 total, 3 up, 4 in 2023-09-13T09:34:19.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:19.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:18 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-09-13T09:34:19.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:18 smithi131 ceph-mon[102785]: osdmap e21: 3 total, 3 up, 3 in 2023-09-13T09:34:19.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:18 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3786953737' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b740401d-7c68-4954-9789-b811d2effbba"}]: dispatch 2023-09-13T09:34:19.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:18 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3786953737' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b740401d-7c68-4954-9789-b811d2effbba"}]': finished 2023-09-13T09:34:19.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:18 smithi131 ceph-mon[102785]: osdmap e22: 4 total, 3 up, 4 in 2023-09-13T09:34:19.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:18 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:19.506 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112808]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-13T09:34:19.506 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112808]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:19.506 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112808]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:19.507 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112808]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:19.714+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5cf00978a0 con 0x7f5d000ffc70 2023-09-13T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:19 smithi006 ceph-mon[98665]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:19 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3205965016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:34:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:20.008 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112811]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-13T09:34:20.008 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112811]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:20.008 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112811]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:20.008 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 09:34:19 smithi053 sudo[112811]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:20.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:19 smithi053 ceph-mon[102373]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:20.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:20.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:19 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3205965016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:34:20.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:19 smithi131 ceph-mon[102785]: pgmap v77: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:19 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3205965016' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:34:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:20.020 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:19 smithi131 sudo[113867]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-13T09:34:20.020 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:19 smithi131 sudo[113867]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:20.020 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:19 smithi131 sudo[113867]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:20.021 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:19 smithi131 sudo[113867]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:20.518 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:20 smithi131 sudo[113870]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-13T09:34:20.519 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:20 smithi131 sudo[113870]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:20.519 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:20 smithi131 sudo[113870]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:20.519 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 09:34:20 smithi131 sudo[113870]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:21.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:20 smithi006 sudo[122668]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-13T09:34:21.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:20 smithi006 sudo[122668]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:21.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:20 smithi006 sudo[122668]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:21.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:20 smithi006 sudo[122668]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:21.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:21 smithi006 sudo[123043]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-13T09:34:21.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:21 smithi006 sudo[123043]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:21.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:21 smithi006 sudo[123043]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:21 smithi006 sudo[123043]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:21 smithi006 ceph-mon[98665]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-13T09:34:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:21 smithi006 ceph-mon[98665]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:21.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:21 smithi053 ceph-mon[102373]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-13T09:34:21.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:21.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:21 smithi053 ceph-mon[102373]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:21.560 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113873]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-13T09:34:21.560 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113873]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:21.560 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113873]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:21.561 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113873]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:22.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113876]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-13T09:34:22.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113876]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:22.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113876]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:22.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 sudo[113876]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:22.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 ceph-mon[102785]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-09-13T09:34:22.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:22.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:21 smithi131 ceph-mon[102785]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:22.460 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112814]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-09-13T09:34:22.460 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112814]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:22.460 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112814]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:22.460 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112814]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:22.655 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:22.655 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:22.655 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.655 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.656 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.656 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:22.656 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.656 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.656 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.657 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:22.657 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.657 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.657 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112817]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-09-13T09:34:22.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112817]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-09-13T09:34:22.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112817]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-09-13T09:34:22.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 sudo[112817]: pam_unix(sudo:session): session closed for user root 2023-09-13T09:34:22.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:22.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:22.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:22.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:22.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:22.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:22.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:22.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:22.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:22.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-09-13T09:34:22.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-09-13T09:34:22.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-09-13T09:34:23.754 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:23 smithi006 ceph-mon[98665]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:23.754 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:23 smithi006 ceph-mon[98665]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:23.754 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:23 smithi006 ceph-mon[98665]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:23.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:23 smithi053 ceph-mon[102373]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:23.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:23 smithi053 ceph-mon[102373]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:23.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:23 smithi053 ceph-mon[102373]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:23.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:23 smithi131 ceph-mon[102785]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-09-13T09:34:23.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:23 smithi131 ceph-mon[102785]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 81 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:23.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:23 smithi131 ceph-mon[102785]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-09-13T09:34:25.726 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:25 smithi006 ceph-mon[98665]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 326 KiB/s wr, 21 op/s 2023-09-13T09:34:25.726 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-13T09:34:25.726 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:25.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:25 smithi053 ceph-mon[102373]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 326 KiB/s wr, 21 op/s 2023-09-13T09:34:25.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-13T09:34:25.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:25.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:25 smithi131 ceph-mon[102785]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 6.7 KiB/s rd, 326 KiB/s wr, 21 op/s 2023-09-13T09:34:25.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-09-13T09:34:25.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:26.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:26 smithi006 ceph-mon[98665]: Deploying daemon osd.3 on smithi006 2023-09-13T09:34:26.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:26 smithi053 ceph-mon[102373]: Deploying daemon osd.3 on smithi006 2023-09-13T09:34:26.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:26 smithi131 ceph-mon[102785]: Deploying daemon osd.3 on smithi006 2023-09-13T09:34:28.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:27 smithi053 ceph-mon[102373]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-09-13T09:34:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:27 smithi006 ceph-mon[98665]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-09-13T09:34:28.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:27 smithi131 ceph-mon[102785]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2023-09-13T09:34:30.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:29 smithi053 ceph-mon[102373]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-09-13T09:34:30.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:30.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:30.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:30.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:29 smithi006 ceph-mon[98665]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-09-13T09:34:30.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:30.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:30.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:30.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:29 smithi131 ceph-mon[102785]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2023-09-13T09:34:30.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:30.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:30.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:31.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:31 smithi006 ceph-mon[98665]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-09-13T09:34:31.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.761+0000 7f5cfcff9700 1 -- 172.21.15.6:0/1203581337 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5d0002d120 con 0x7f5ce80a05b0 2023-09-13T09:34:31.762 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 3 on host 'smithi006' 2023-09-13T09:34:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ce80a05b0 msgr2=0x7f5ce80a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:31.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ce80a05b0 0x7f5ce80a2a70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5cf4005fd0 tx=0x7f5cf4005e20 comp rx=0 tx=0).stop 2023-09-13T09:34:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 msgr2=0x7f5d00069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00069320 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5cf00036f0 tx=0x7f5cf00038c0 comp rx=0 tx=0).stop 2023-09-13T09:34:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 shutdown_connections 2023-09-13T09:34:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5d00101810 0x7f5d0019ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:31.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ce80a05b0 0x7f5ce80a2a70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:31.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d000ffc70 0x7f5d00069320 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:31.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 --2- 172.21.15.6:0/1203581337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5d00100e70 0x7f5d0019b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:31.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.763+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 >> 172.21.15.6:0/1203581337 conn(0x7f5d000fb1f0 msgr2=0x7f5d00104330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:34:31.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.764+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 shutdown_connections 2023-09-13T09:34:31.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:34:31.764+0000 7f5d05d07700 1 -- 172.21.15.6:0/1203581337 wait complete. 2023-09-13T09:34:32.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:31 smithi053 ceph-mon[102373]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-09-13T09:34:32.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:31 smithi131 ceph-mon[102785]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2023-09-13T09:34:32.427 DEBUG:teuthology.orchestra.run.smithi006:osd.3> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.3.service 2023-09-13T09:34:32.430 INFO:tasks.cephadm:Deploying osd.4 on smithi053 with /dev/vg_nvme/lv_3... 2023-09-13T09:34:32.431 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-13T09:34:32.460 INFO:journalctl@ceph.osd.3.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:34:33.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.008 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:34:33.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:33.337 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 09:34:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T09:34:33.328+0000 7f7688825640 -1 osd.3 0 log_to_monitors true 2023-09-13T09:34:33.975 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:33 smithi053 ceph-mon[102373]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-09-13T09:34:33.975 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:33 smithi053 ceph-mon[102373]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-13T09:34:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:33 smithi006 ceph-mon[98665]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-09-13T09:34:34.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:33 smithi006 ceph-mon[98665]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-13T09:34:34.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:33 smithi131 ceph-mon[102785]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 109 KiB/s wr, 7 op/s 2023-09-13T09:34:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:33 smithi131 ceph-mon[102785]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-09-13T09:34:34.477 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-13T09:34:34.478 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-13T09:34:34.478 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2023-09-13T09:34:34.478 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2023-09-13T09:34:34.479 INFO:teuthology.orchestra.run.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00805031 s, 1.3 GB/s 2023-09-13T09:34:34.479 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 2023-09-13T09:34:34.479 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2023-09-13T09:34:34.832 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:34 smithi006 ceph-mon[98665]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-13T09:34:34.833 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:34 smithi006 ceph-mon[98665]: osdmap e23: 4 total, 3 up, 4 in 2023-09-13T09:34:34.833 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:34 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:34.833 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:34 smithi006 ceph-mon[98665]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:34:34.834 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 09:34:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T09:34:34.822+0000 7f767d69b700 -1 osd.3 0 waiting for initial osdmap 2023-09-13T09:34:34.861 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi053:vg_nvme/lv_3 2023-09-13T09:34:35.256 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 09:34:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T09:34:34.831+0000 7f767848e700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:34:35.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:34 smithi053 ceph-mon[102373]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-13T09:34:35.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:34 smithi053 ceph-mon[102373]: osdmap e23: 4 total, 3 up, 4 in 2023-09-13T09:34:35.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:34 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:35.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:34 smithi053 ceph-mon[102373]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:34:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:34 smithi131 ceph-mon[102785]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-09-13T09:34:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:34 smithi131 ceph-mon[102785]: osdmap e23: 4 total, 3 up, 4 in 2023-09-13T09:34:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:34 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:34 smithi131 ceph-mon[102785]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:34:35.430 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:34:35.923 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:35.924 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:34:35.924 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: osdmap e24: 4 total, 3 up, 4 in 2023-09-13T09:34:35.924 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:35.925 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:35.925 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:35.925 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:35.925 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:35.925 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:35.926 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:35.926 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:35.926 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:35.926 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:35.926 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:35.927 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:35.927 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:35.927 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:35.927 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] boot 2023-09-13T09:34:35.927 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: osdmap e25: 4 total, 4 up, 4 in 2023-09-13T09:34:35.928 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:36.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:34:36.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: osdmap e24: 4 total, 3 up, 4 in 2023-09-13T09:34:36.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:36.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:36.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:36.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:36.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:36.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:36.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:36.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:36.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:36.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] boot 2023-09-13T09:34:36.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: osdmap e25: 4 total, 4 up, 4 in 2023-09-13T09:34:36.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 82 MiB used, 268 GiB / 268 GiB avail 2023-09-13T09:34:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:34:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: osdmap e24: 4 total, 3 up, 4 in 2023-09-13T09:34:36.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:36.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:36.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:36.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:36.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:36.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:36.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:36.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:36.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:36.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:36.275 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: osd.3 [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] boot 2023-09-13T09:34:36.276 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: osdmap e25: 4 total, 4 up, 4 in 2023-09-13T09:34:36.276 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-09-13T09:34:36.659 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 -- 172.21.15.53:0/3946805268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40100e70 msgr2=0x7f4c401012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:36.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 --2- 172.21.15.53:0/3946805268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40100e70 0x7f4c401012d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4c300099c0 tx=0x7f4c30009cd0 comp rx=0 tx=0).stop 2023-09-13T09:34:36.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 -- 172.21.15.53:0/3946805268 shutdown_connections 2023-09-13T09:34:36.660 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 --2- 172.21.15.53:0/3946805268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c40101810 0x7f4c401080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:36.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 --2- 172.21.15.53:0/3946805268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c400ffc70 0x7f4c40100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:36.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 --2- 172.21.15.53:0/3946805268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40100e70 0x7f4c401012d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:36.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 -- 172.21.15.53:0/3946805268 >> 172.21.15.53:0/3946805268 conn(0x7f4c400fb1f0 msgr2=0x7f4c400fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:34:36.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 -- 172.21.15.53:0/3946805268 shutdown_connections 2023-09-13T09:34:36.661 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 -- 172.21.15.53:0/3946805268 wait complete. 2023-09-13T09:34:36.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 Processor -- start 2023-09-13T09:34:36.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.657+0000 7f4c486a6700 1 -- start start 2023-09-13T09:34:36.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c486a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c400ffc70 0x7f4c40196960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:36.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c486a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c40100e70 0x7f4c40196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:36.662 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c486a6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40101810 0x7f4c4019df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:36.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c486a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4019e4f0 con 0x7f4c40100e70 2023-09-13T09:34:36.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c486a6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4019e630 con 0x7f4c40101810 2023-09-13T09:34:36.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c486a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4019e7c0 con 0x7f4c400ffc70 2023-09-13T09:34:36.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c46442700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c400ffc70 0x7f4c40196960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:36.663 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c46442700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c400ffc70 0x7f4c40196960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.53:39818/0 (socket says 172.21.15.53:39818) 2023-09-13T09:34:36.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c46442700 1 -- 172.21.15.53:0/1839396896 learned_addr learned my addr 172.21.15.53:0/1839396896 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-13T09:34:36.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c45c41700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c40100e70 0x7f4c40196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:36.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c46c43700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40101810 0x7f4c4019df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:36.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c45c41700 1 -- 172.21.15.53:0/1839396896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c400ffc70 msgr2=0x7f4c40196960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:36.664 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c45c41700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c400ffc70 0x7f4c40196960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:36.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c45c41700 1 -- 172.21.15.53:0/1839396896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40101810 msgr2=0x7f4c4019df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:36.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c45c41700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40101810 0x7f4c4019df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:36.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c45c41700 1 -- 172.21.15.53:0/1839396896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c300095f0 con 0x7f4c40100e70 2023-09-13T09:34:36.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c46c43700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40101810 0x7f4c4019df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:34:36.665 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.658+0000 7f4c46442700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c400ffc70 0x7f4c40196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:34:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.659+0000 7f4c45c41700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c40100e70 0x7f4c40196ea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c300098e0 tx=0x7f4c30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:34:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.659+0000 7f4c377fe700 1 -- 172.21.15.53:0/1839396896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3001d070 con 0x7f4c40100e70 2023-09-13T09:34:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.659+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4019ea40 con 0x7f4c40100e70 2023-09-13T09:34:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.659+0000 7f4c377fe700 1 -- 172.21.15.53:0/1839396896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c30003f90 con 0x7f4c40100e70 2023-09-13T09:34:36.666 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.659+0000 7f4c377fe700 1 -- 172.21.15.53:0/1839396896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c30022bd0 con 0x7f4c40100e70 2023-09-13T09:34:36.667 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.659+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4019ef30 con 0x7f4c40100e70 2023-09-13T09:34:36.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.660+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4010b470 con 0x7f4c40100e70 2023-09-13T09:34:36.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.661+0000 7f4c377fe700 1 -- 172.21.15.53:0/1839396896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4c30003ad0 con 0x7f4c40100e70 2023-09-13T09:34:36.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.662+0000 7f4c377fe700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c2c0a06c0 0x7f4c2c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:36.668 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.662+0000 7f4c377fe700 1 -- 172.21.15.53:0/1839396896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f4c300cc120 con 0x7f4c40100e70 2023-09-13T09:34:36.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.662+0000 7f4c46442700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c2c0a06c0 0x7f4c2c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:36.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.662+0000 7f4c46442700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c2c0a06c0 0x7f4c2c0a2b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00f4d0 tx=0x7f4c3c00a430 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:34:36.669 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.666+0000 7f4c377fe700 1 -- 172.21.15.53:0/1839396896 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4c30096e40 con 0x7f4c40100e70 2023-09-13T09:34:36.878 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:36.878+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4c40068f70 con 0x7f4c2c0a06c0 2023-09-13T09:34:37.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:36 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:34:37.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:36 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:34:37.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:36 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi006 2023-09-13T09:34:37.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:36 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi006 to 8586M 2023-09-13T09:34:37.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:36 smithi006 ceph-mon[98665]: osdmap e26: 4 total, 4 up, 4 in 2023-09-13T09:34:37.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:36 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:34:37.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:36 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:34:37.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:36 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi006 2023-09-13T09:34:37.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:36 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi006 to 8586M 2023-09-13T09:34:37.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:36 smithi053 ceph-mon[102373]: osdmap e26: 4 total, 4 up, 4 in 2023-09-13T09:34:37.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:36 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:34:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:36 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:34:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:36 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi006 2023-09-13T09:34:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:36 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi006 to 8586M 2023-09-13T09:34:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:36 smithi131 ceph-mon[102785]: osdmap e26: 4 total, 4 up, 4 in 2023-09-13T09:34:37.945 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:37 smithi053 ceph-mon[102373]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:37.945 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:37 smithi053 ceph-mon[102373]: from='client.14322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:37.945 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:37.945 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:37.946 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:37.946 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:37 smithi053 ceph-mon[102373]: osdmap e27: 4 total, 4 up, 4 in 2023-09-13T09:34:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:37 smithi006 ceph-mon[98665]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:37 smithi006 ceph-mon[98665]: from='client.14322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:38.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:38.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:38.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:37 smithi006 ceph-mon[98665]: osdmap e27: 4 total, 4 up, 4 in 2023-09-13T09:34:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:37 smithi131 ceph-mon[102785]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:37 smithi131 ceph-mon[102785]: from='client.14322 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:37 smithi131 ceph-mon[102785]: osdmap e27: 4 total, 4 up, 4 in 2023-09-13T09:34:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:39 smithi006 ceph-mon[98665]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:39 smithi006 ceph-mon[98665]: osdmap e28: 4 total, 4 up, 4 in 2023-09-13T09:34:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:39 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/613745187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]: dispatch 2023-09-13T09:34:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:39 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]: dispatch 2023-09-13T09:34:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:39 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]': finished 2023-09-13T09:34:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:39 smithi006 ceph-mon[98665]: osdmap e29: 5 total, 4 up, 5 in 2023-09-13T09:34:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:40.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:39 smithi053 ceph-mon[102373]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:40.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:39 smithi053 ceph-mon[102373]: osdmap e28: 4 total, 4 up, 4 in 2023-09-13T09:34:40.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:39 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/613745187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]: dispatch 2023-09-13T09:34:40.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:39 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]: dispatch 2023-09-13T09:34:40.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:39 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]': finished 2023-09-13T09:34:40.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:39 smithi053 ceph-mon[102373]: osdmap e29: 5 total, 4 up, 5 in 2023-09-13T09:34:40.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:39 smithi131 ceph-mon[102785]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:39 smithi131 ceph-mon[102785]: osdmap e28: 4 total, 4 up, 4 in 2023-09-13T09:34:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:39 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/613745187' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]: dispatch 2023-09-13T09:34:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:39 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]: dispatch 2023-09-13T09:34:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:39 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8cd56f57-462e-434f-ba13-a93b66fca25c"}]': finished 2023-09-13T09:34:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:39 smithi131 ceph-mon[102785]: osdmap e29: 5 total, 4 up, 5 in 2023-09-13T09:34:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:41.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:40 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/4016939376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:34:41.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:40 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/4016939376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:34:41.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:40 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/4016939376' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:34:42.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:41 smithi006 ceph-mon[98665]: pgmap v96: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-13T09:34:42.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:41 smithi053 ceph-mon[102373]: pgmap v96: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-13T09:34:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:41 smithi131 ceph-mon[102785]: pgmap v96: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-13T09:34:44.104 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:43 smithi053 ceph-mon[102373]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-09-13T09:34:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:43 smithi006 ceph-mon[98665]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-09-13T09:34:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:43 smithi131 ceph-mon[102785]: pgmap v97: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 109 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-09-13T09:34:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:45 smithi053 ceph-mon[102373]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-09-13T09:34:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-13T09:34:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:45 smithi006 ceph-mon[98665]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-09-13T09:34:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-13T09:34:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:45 smithi131 ceph-mon[102785]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-09-13T09:34:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-09-13T09:34:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:47.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:46 smithi006 ceph-mon[98665]: Deploying daemon osd.4 on smithi053 2023-09-13T09:34:47.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:46 smithi053 ceph-mon[102373]: Deploying daemon osd.4 on smithi053 2023-09-13T09:34:47.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:46 smithi131 ceph-mon[102785]: Deploying daemon osd.4 on smithi053 2023-09-13T09:34:48.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:47 smithi053 ceph-mon[102373]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-13T09:34:48.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:47 smithi006 ceph-mon[98665]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-13T09:34:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:47 smithi131 ceph-mon[102785]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-13T09:34:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:49 smithi006 ceph-mon[98665]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:49 smithi053 ceph-mon[102373]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:49 smithi131 ceph-mon[102785]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:52.146 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:51 smithi053 ceph-mon[102373]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:51 smithi006 ceph-mon[98665]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:51 smithi131 ceph-mon[102785]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:52.395 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.396+0000 7f4c377fe700 1 -- 172.21.15.53:0/1839396896 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4c40068f70 con 0x7f4c2c0a06c0 2023-09-13T09:34:52.396 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 4 on host 'smithi053' 2023-09-13T09:34:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c2c0a06c0 msgr2=0x7f4c2c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c2c0a06c0 0x7f4c2c0a2b80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c00f4d0 tx=0x7f4c3c00a430 comp rx=0 tx=0).stop 2023-09-13T09:34:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c40100e70 msgr2=0x7f4c40196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c40100e70 0x7f4c40196ea0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4c300098e0 tx=0x7f4c30004730 comp rx=0 tx=0).stop 2023-09-13T09:34:52.398 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 shutdown_connections 2023-09-13T09:34:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4c40101810 0x7f4c4019df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4c400ffc70 0x7f4c40196960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c2c0a06c0 0x7f4c2c0a2b80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:52.399 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 --2- 172.21.15.53:0/1839396896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4c40100e70 0x7f4c40196ea0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 >> 172.21.15.53:0/1839396896 conn(0x7f4c400fb1f0 msgr2=0x7f4c40068860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:34:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 shutdown_connections 2023-09-13T09:34:52.400 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:34:52.398+0000 7f4c486a6700 1 -- 172.21.15.53:0/1839396896 wait complete. 2023-09-13T09:34:52.825 DEBUG:teuthology.orchestra.run.smithi053:osd.4> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.4.service 2023-09-13T09:34:52.828 INFO:tasks.cephadm:Deploying osd.5 on smithi131 with /dev/vg_nvme/lv_3... 2023-09-13T09:34:52.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-09-13T09:34:52.857 INFO:journalctl@ceph.osd.4.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:34:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:53.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:53.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:34:53.392 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:34:53.953 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 09:34:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-4[115961]: 2023-09-13T09:34:53.794+0000 7f8abcf6f640 -1 osd.4 0 log_to_monitors true 2023-09-13T09:34:54.175 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:53 smithi131 ceph-mon[102785]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:54.175 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:53 smithi131 ceph-mon[102785]: from='osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-13T09:34:54.175 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:53 smithi131 ceph-mon[102785]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-13T09:34:54.217 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:53 smithi053 ceph-mon[102373]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:54.217 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:53 smithi053 ceph-mon[102373]: from='osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-13T09:34:54.218 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:53 smithi053 ceph-mon[102373]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-13T09:34:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:53 smithi006 ceph-mon[98665]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:53 smithi006 ceph-mon[98665]: from='osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-13T09:34:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:53 smithi006 ceph-mon[98665]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-09-13T09:34:54.989 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-09-13T09:34:54.989 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-09-13T09:34:54.990 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-09-13T09:34:54.990 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-09-13T09:34:54.990 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0146455 s, 716 MB/s 2023-09-13T09:34:54.990 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-09-13T09:34:55.246 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 09:34:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-4[115961]: 2023-09-13T09:34:54.961+0000 7f8ab1de5700 -1 osd.4 0 waiting for initial osdmap 2023-09-13T09:34:55.246 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 09:34:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-4[115961]: 2023-09-13T09:34:54.967+0000 7f8aabbd6700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:34:55.246 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:54 smithi053 ceph-mon[102373]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-13T09:34:55.247 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:54 smithi053 ceph-mon[102373]: osdmap e30: 5 total, 4 up, 5 in 2023-09-13T09:34:55.247 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:54 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:55.247 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:54 smithi053 ceph-mon[102373]: from='osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:34:55.247 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:54 smithi053 ceph-mon[102373]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:34:55.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:54 smithi006 ceph-mon[98665]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-13T09:34:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:54 smithi006 ceph-mon[98665]: osdmap e30: 5 total, 4 up, 5 in 2023-09-13T09:34:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:54 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:54 smithi006 ceph-mon[98665]: from='osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:34:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:54 smithi006 ceph-mon[98665]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:34:55.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:54 smithi131 ceph-mon[102785]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-09-13T09:34:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:54 smithi131 ceph-mon[102785]: osdmap e30: 5 total, 4 up, 5 in 2023-09-13T09:34:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:54 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:54 smithi131 ceph-mon[102785]: from='osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:34:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:54 smithi131 ceph-mon[102785]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:34:55.434 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi131:vg_nvme/lv_3 2023-09-13T09:34:55.992 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:34:56.229 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:56.229 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:34:56.230 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: osdmap e31: 5 total, 4 up, 5 in 2023-09-13T09:34:56.230 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:56.230 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:56.230 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.231 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.231 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:56.231 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:56.231 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.231 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:56.232 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:56.232 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:34:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: osdmap e31: 5 total, 4 up, 5 in 2023-09-13T09:34:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:34:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: osdmap e31: 5 total, 4 up, 5 in 2023-09-13T09:34:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:34:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:56.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:34:56.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:34:57.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:56 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:34:57.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:56 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:34:57.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:56 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi053 2023-09-13T09:34:57.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:56 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi053 to 8586M 2023-09-13T09:34:57.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:56 smithi131 ceph-mon[102785]: osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] boot 2023-09-13T09:34:57.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:56 smithi131 ceph-mon[102785]: osdmap e32: 5 total, 5 up, 5 in 2023-09-13T09:34:57.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:56 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:57.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 -- 172.21.15.131:0/2558078854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900ff5f0 msgr2=0x7f22900ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:57.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 --2- 172.21.15.131:0/2558078854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900ff5f0 0x7f22900ffa10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2284009990 tx=0x7f2284009ca0 comp rx=0 tx=0).stop 2023-09-13T09:34:57.239 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 -- 172.21.15.131:0/2558078854 shutdown_connections 2023-09-13T09:34:57.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 --2- 172.21.15.131:0/2558078854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2290100910 0x7f2290100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:57.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 --2- 172.21.15.131:0/2558078854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900ff5f0 0x7f22900ffa10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:57.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 --2- 172.21.15.131:0/2558078854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22900fff50 0x7f22901003d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:57.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 -- 172.21.15.131:0/2558078854 >> 172.21.15.131:0/2558078854 conn(0x7f22900fb1f0 msgr2=0x7f22900fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:34:57.240 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 -- 172.21.15.131:0/2558078854 shutdown_connections 2023-09-13T09:34:57.241 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.238+0000 7f2296f50700 1 -- 172.21.15.131:0/2558078854 wait complete. 2023-09-13T09:34:57.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 Processor -- start 2023-09-13T09:34:57.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 -- start start 2023-09-13T09:34:57.243 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22900ff5f0 0x7f2290198bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:57.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900fff50 0x7f2290199110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:57.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2290100910 0x7f22901a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:57.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901a0760 con 0x7f22900ff5f0 2023-09-13T09:34:57.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901a08a0 con 0x7f2290100910 2023-09-13T09:34:57.244 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2296f50700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22901a0a30 con 0x7f22900fff50 2023-09-13T09:34:57.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f228ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900fff50 0x7f2290199110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:57.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f228ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900fff50 0x7f2290199110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33616/0 (socket says 172.21.15.131:33616) 2023-09-13T09:34:57.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f228ffff700 1 -- 172.21.15.131:0/3285147587 learned_addr learned my addr 172.21.15.131:0/3285147587 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:34:57.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f2294cec700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22900ff5f0 0x7f2290198bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:57.245 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.239+0000 7f22954ed700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2290100910 0x7f22901a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:57.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228ffff700 1 -- 172.21.15.131:0/3285147587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2290100910 msgr2=0x7f22901a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:57.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228ffff700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2290100910 0x7f22901a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:57.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228ffff700 1 -- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22900ff5f0 msgr2=0x7f2290198bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:34:57.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228ffff700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22900ff5f0 0x7f2290198bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:34:57.246 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228ffff700 1 -- 172.21.15.131:0/3285147587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22840095f0 con 0x7f22900fff50 2023-09-13T09:34:57.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228ffff700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900fff50 0x7f2290199110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d980 tx=0x7f227c00dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:34:57.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228dffb700 1 -- 172.21.15.131:0/3285147587 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c0098d0 con 0x7f22900fff50 2023-09-13T09:34:57.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228dffb700 1 -- 172.21.15.131:0/3285147587 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f227c010460 con 0x7f22900fff50 2023-09-13T09:34:57.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22901a0d10 con 0x7f22900fff50 2023-09-13T09:34:57.247 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f228dffb700 1 -- 172.21.15.131:0/3285147587 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227c00f620 con 0x7f22900fff50 2023-09-13T09:34:57.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.240+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22901a11c0 con 0x7f22900fff50 2023-09-13T09:34:57.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.241+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f229010a3d0 con 0x7f22900fff50 2023-09-13T09:34:57.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.242+0000 7f228dffb700 1 -- 172.21.15.131:0/3285147587 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f227c010860 con 0x7f22900fff50 2023-09-13T09:34:57.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.242+0000 7f228dffb700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f22800a0640 0x7f22800a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:34:57.248 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.243+0000 7f228dffb700 1 -- 172.21.15.131:0/3285147587 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f227c0ca880 con 0x7f22900fff50 2023-09-13T09:34:57.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.243+0000 7f2294cec700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f22800a0640 0x7f22800a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:34:57.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.243+0000 7f2294cec700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f22800a0640 0x7f22800a2b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f228400b5c0 tx=0x7f2284005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:34:57.249 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.247+0000 7f228dffb700 1 -- 172.21.15.131:0/3285147587 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f227c095420 con 0x7f22900fff50 2023-09-13T09:34:57.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:56 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:34:57.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:56 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:34:57.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:56 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi053 2023-09-13T09:34:57.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:56 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi053 to 8586M 2023-09-13T09:34:57.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:56 smithi053 ceph-mon[102373]: osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] boot 2023-09-13T09:34:57.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:56 smithi053 ceph-mon[102373]: osdmap e32: 5 total, 5 up, 5 in 2023-09-13T09:34:57.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:56 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:57.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:56 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:34:57.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:56 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:34:57.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:56 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi053 2023-09-13T09:34:57.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:56 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi053 to 8586M 2023-09-13T09:34:57.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:56 smithi006 ceph-mon[98665]: osd.4 [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] boot 2023-09-13T09:34:57.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:56 smithi006 ceph-mon[98665]: osdmap e32: 5 total, 5 up, 5 in 2023-09-13T09:34:57.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:56 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-09-13T09:34:57.443 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:34:57.442+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f229002d0b0 con 0x7f22800a0640 2023-09-13T09:34:58.244 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:57 smithi131 ceph-mon[102785]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:58.244 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:57 smithi131 ceph-mon[102785]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:58.245 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:58.245 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:58.245 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:58.245 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:57 smithi131 ceph-mon[102785]: osdmap e33: 5 total, 5 up, 5 in 2023-09-13T09:34:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:57 smithi006 ceph-mon[98665]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:57 smithi006 ceph-mon[98665]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:58.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:57 smithi006 ceph-mon[98665]: osdmap e33: 5 total, 5 up, 5 in 2023-09-13T09:34:58.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:57 smithi053 ceph-mon[102373]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 108 MiB used, 358 GiB / 358 GiB avail 2023-09-13T09:34:58.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:57 smithi053 ceph-mon[102373]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:34:58.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:34:58.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:34:58.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:34:58.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:57 smithi053 ceph-mon[102373]: osdmap e33: 5 total, 5 up, 5 in 2023-09-13T09:34:59.161 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:58 smithi131 ceph-mon[102785]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:34:59.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:58 smithi006 ceph-mon[98665]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:34:59.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:58 smithi053 ceph-mon[102373]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:59 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/3096999103' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]: dispatch 2023-09-13T09:35:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:59 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]: dispatch 2023-09-13T09:35:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:59 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]': finished 2023-09-13T09:35:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:59 smithi053 ceph-mon[102373]: osdmap e34: 6 total, 5 up, 6 in 2023-09-13T09:35:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:34:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:00.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:59 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/3096999103' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]: dispatch 2023-09-13T09:35:00.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:59 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]: dispatch 2023-09-13T09:35:00.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:59 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]': finished 2023-09-13T09:35:00.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:59 smithi006 ceph-mon[98665]: osdmap e34: 6 total, 5 up, 6 in 2023-09-13T09:35:00.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:34:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:59 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/3096999103' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]: dispatch 2023-09-13T09:35:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:59 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]: dispatch 2023-09-13T09:35:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:59 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ead82706-9475-49d1-9e7c-f39c498e8b42"}]': finished 2023-09-13T09:35:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:59 smithi131 ceph-mon[102785]: osdmap e34: 6 total, 5 up, 6 in 2023-09-13T09:35:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:34:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:01.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:00 smithi006 ceph-mon[98665]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:01.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:00 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/247209915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:00 smithi053 ceph-mon[102373]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:01.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:00 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/247209915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:00 smithi131 ceph-mon[102785]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:00 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/247209915' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:03.996 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:03 smithi131 ceph-mon[102785]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:04.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:03 smithi006 ceph-mon[98665]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:04.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:03 smithi053 ceph-mon[102373]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:05.916 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:05 smithi131 ceph-mon[102785]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:06.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:05 smithi006 ceph-mon[98665]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:06.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:05 smithi053 ceph-mon[102373]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:07 smithi006 ceph-mon[98665]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-13T09:35:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:07 smithi006 ceph-mon[98665]: Deploying daemon osd.5 on smithi131 2023-09-13T09:35:08.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:07 smithi053 ceph-mon[102373]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:08.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-13T09:35:08.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:08.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:07 smithi053 ceph-mon[102373]: Deploying daemon osd.5 on smithi131 2023-09-13T09:35:08.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:07 smithi131 ceph-mon[102785]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:08.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-09-13T09:35:08.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:08.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:07 smithi131 ceph-mon[102785]: Deploying daemon osd.5 on smithi131 2023-09-13T09:35:10.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:09 smithi053 ceph-mon[102373]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:09 smithi006 ceph-mon[98665]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:10.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:09 smithi131 ceph-mon[102785]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:12.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:11 smithi053 ceph-mon[102373]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:12.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:12.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:12.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:12.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:11 smithi006 ceph-mon[98665]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:12.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:12.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:12.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:12.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:11 smithi131 ceph-mon[102785]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:12.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:12.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:12.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:13.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:13 smithi131 ceph-mon[102785]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:13.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:13.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:13.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:13.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:13.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:14.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:13 smithi006 ceph-mon[98665]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:14.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:14.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:14.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:14.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:14.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:14.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:13 smithi053 ceph-mon[102373]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:14.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:14.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:14.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:14.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:14.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:14.254 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 5 on host 'smithi131' 2023-09-13T09:35:14.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.253+0000 7f228dffb700 1 -- 172.21.15.131:0/3285147587 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f229002d0b0 con 0x7f22800a0640 2023-09-13T09:35:14.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f22800a0640 msgr2=0x7f22800a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:14.257 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f22800a0640 0x7f22800a2b00 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f228400b5c0 tx=0x7f2284005fd0 comp rx=0 tx=0).stop 2023-09-13T09:35:14.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900fff50 msgr2=0x7f2290199110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:14.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900fff50 0x7f2290199110 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f227c00d980 tx=0x7f227c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:35:14.258 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 shutdown_connections 2023-09-13T09:35:14.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2290100910 0x7f22901a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:14.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f22800a0640 0x7f22800a2b00 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:14.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f22900ff5f0 0x7f2290198bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:14.259 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 --2- 172.21.15.131:0/3285147587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22900fff50 0x7f2290199110 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:14.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 >> 172.21.15.131:0/3285147587 conn(0x7f22900fb1f0 msgr2=0x7f22900fcf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:35:14.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 shutdown_connections 2023-09-13T09:35:14.260 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:35:14.256+0000 7f2296f50700 1 -- 172.21.15.131:0/3285147587 wait complete. 2023-09-13T09:35:14.673 DEBUG:teuthology.orchestra.run.smithi131:osd.5> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.5.service 2023-09-13T09:35:14.676 INFO:tasks.cephadm:Deploying osd.6 on smithi006 with /dev/vg_nvme/lv_2... 2023-09-13T09:35:14.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-13T09:35:14.704 INFO:journalctl@ceph.osd.5.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:35:15.240 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:35:15.465 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 09:35:15 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T09:35:15.150+0000 7f4eed6e6640 -1 osd.5 0 log_to_monitors true 2023-09-13T09:35:15.466 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:15 smithi131 ceph-mon[102785]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:15.467 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:15.467 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:15.468 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:15.468 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:15 smithi131 ceph-mon[102785]: from='osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-13T09:35:15.469 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:15 smithi131 ceph-mon[102785]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-13T09:35:15.474 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:15 smithi006 ceph-mon[98665]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:15.474 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:15.475 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:15.475 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:15.476 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:15 smithi006 ceph-mon[98665]: from='osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-13T09:35:15.477 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:15 smithi006 ceph-mon[98665]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-13T09:35:15.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:15 smithi053 ceph-mon[102373]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:15.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:15 smithi053 ceph-mon[102373]: from='osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-13T09:35:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:15 smithi053 ceph-mon[102373]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-09-13T09:35:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-13T09:35:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-13T09:35:16.902 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-09-13T09:35:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-09-13T09:35:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0108572 s, 966 MB/s 2023-09-13T09:35:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-09-13T09:35:16.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:16 smithi006 ceph-mon[98665]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-13T09:35:16.940 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:16 smithi006 ceph-mon[98665]: osdmap e35: 6 total, 5 up, 6 in 2023-09-13T09:35:16.941 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:16 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:16.941 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:16 smithi006 ceph-mon[98665]: from='osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:35:16.941 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:16 smithi006 ceph-mon[98665]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:35:17.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:16 smithi053 ceph-mon[102373]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-13T09:35:17.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:16 smithi053 ceph-mon[102373]: osdmap e35: 6 total, 5 up, 6 in 2023-09-13T09:35:17.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:16 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:17.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:16 smithi053 ceph-mon[102373]: from='osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:35:17.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:16 smithi053 ceph-mon[102373]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:35:17.019 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 09:35:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T09:35:16.659+0000 7f4ee255c700 -1 osd.5 0 waiting for initial osdmap 2023-09-13T09:35:17.019 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 09:35:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T09:35:16.667+0000 7f4edab4a700 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:35:17.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:16 smithi131 ceph-mon[102785]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-09-13T09:35:17.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:16 smithi131 ceph-mon[102785]: osdmap e35: 6 total, 5 up, 6 in 2023-09-13T09:35:17.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:16 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:17.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:16 smithi131 ceph-mon[102785]: from='osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:35:17.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:16 smithi131 ceph-mon[102785]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:35:17.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi006:vg_nvme/lv_2 2023-09-13T09:35:17.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:17.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:35:17.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: osdmap e36: 6 total, 5 up, 6 in 2023-09-13T09:35:17.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:17.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:17.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:17.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:17.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:17.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:17.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:17.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:17.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:17.772 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:18.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:35:18.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: osdmap e36: 6 total, 5 up, 6 in 2023-09-13T09:35:18.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:18.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:18.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:18.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:18.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:18.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:35:18.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: osdmap e36: 6 total, 5 up, 6 in 2023-09-13T09:35:18.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:18.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:18.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:18.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:18.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:18.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:18.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:18.153 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:35:19.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:35:19.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:35:19.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi131 2023-09-13T09:35:19.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi131 to 8584M 2023-09-13T09:35:19.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:19.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] boot 2023-09-13T09:35:19.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: osdmap e37: 6 total, 6 up, 6 in 2023-09-13T09:35:19.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:18 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:19.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:35:19.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:35:19.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi131 2023-09-13T09:35:19.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi131 to 8584M 2023-09-13T09:35:19.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:19.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] boot 2023-09-13T09:35:19.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: osdmap e37: 6 total, 6 up, 6 in 2023-09-13T09:35:19.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:18 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:19.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:35:19.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:35:19.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi131 2023-09-13T09:35:19.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi131 to 8584M 2023-09-13T09:35:19.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:19.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: osd.5 [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] boot 2023-09-13T09:35:19.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: osdmap e37: 6 total, 6 up, 6 in 2023-09-13T09:35:19.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:18 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-09-13T09:35:19.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 -- 172.21.15.6:0/2674722272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570100da0 msgr2=0x7fc5701011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:19.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 --2- 172.21.15.6:0/2674722272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570100da0 0x7fc5701011c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc56c0099c0 tx=0x7fc56c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:35:19.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 -- 172.21.15.6:0/2674722272 shutdown_connections 2023-09-13T09:35:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 --2- 172.21.15.6:0/2674722272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc570102940 0x7fc5701091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 --2- 172.21.15.6:0/2674722272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570100da0 0x7fc5701011c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 --2- 172.21.15.6:0/2674722272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc570101fa0 0x7fc570102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 -- 172.21.15.6:0/2674722272 >> 172.21.15.6:0/2674722272 conn(0x7fc5700fc340 msgr2=0x7fc5700fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:35:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 -- 172.21.15.6:0/2674722272 shutdown_connections 2023-09-13T09:35:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.373+0000 7fc5776d7700 1 -- 172.21.15.6:0/2674722272 wait complete. 2023-09-13T09:35:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 Processor -- start 2023-09-13T09:35:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 -- start start 2023-09-13T09:35:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc570100da0 0x7fc570074a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc570101fa0 0x7fc5700730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570102940 0x7fc5700735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc570073d60 con 0x7fc570102940 2023-09-13T09:35:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc570073ed0 con 0x7fc570100da0 2023-09-13T09:35:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc5776d7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5701a0ad0 con 0x7fc570101fa0 2023-09-13T09:35:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570102940 0x7fc5700735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570102940 0x7fc5700735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59720/0 (socket says 172.21.15.6:59720) 2023-09-13T09:35:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 -- 172.21.15.6:0/3924642441 learned_addr learned my addr 172.21.15.6:0/3924642441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:35:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575473700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc570100da0 0x7fc570074a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc574c72700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc570101fa0 0x7fc5700730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 -- 172.21.15.6:0/3924642441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc570101fa0 msgr2=0x7fc5700730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc570101fa0 0x7fc5700730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 -- 172.21.15.6:0/3924642441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc570100da0 msgr2=0x7fc570074a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc570100da0 0x7fc570074a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc575c74700 1 -- 172.21.15.6:0/3924642441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c0095f0 con 0x7fc570102940 2023-09-13T09:35:19.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.374+0000 7fc574c72700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc570101fa0 0x7fc5700730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:35:19.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.375+0000 7fc575c74700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570102940 0x7fc5700735e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc568007ee0 tx=0x7fc56800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:35:19.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.375+0000 7fc5667fc700 1 -- 172.21.15.6:0/3924642441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568017070 con 0x7fc570102940 2023-09-13T09:35:19.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.375+0000 7fc5667fc700 1 -- 172.21.15.6:0/3924642441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc56800f040 con 0x7fc570102940 2023-09-13T09:35:19.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.375+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5701a0db0 con 0x7fc570102940 2023-09-13T09:35:19.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.375+0000 7fc5667fc700 1 -- 172.21.15.6:0/3924642441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568005740 con 0x7fc570102940 2023-09-13T09:35:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.375+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5701a1250 con 0x7fc570102940 2023-09-13T09:35:19.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.376+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5701083c0 con 0x7fc570102940 2023-09-13T09:35:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.377+0000 7fc5667fc700 1 -- 172.21.15.6:0/3924642441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc56800dc60 con 0x7fc570102940 2023-09-13T09:35:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.377+0000 7fc5667fc700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc55c0a06c0 0x7fc55c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.378+0000 7fc575473700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc55c0a06c0 0x7fc55c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.378+0000 7fc5667fc700 1 -- 172.21.15.6:0/3924642441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4562+0+0 (secure 0 0 0) 0x7fc5680ca560 con 0x7fc570102940 2023-09-13T09:35:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.378+0000 7fc575473700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc55c0a06c0 0x7fc55c0a2b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009f50 tx=0x7fc56c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:35:19.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.382+0000 7fc5667fc700 1 -- 172.21.15.6:0/3924642441 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc568094e90 con 0x7fc570102940 2023-09-13T09:35:19.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:19.590+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fc57002d0b0 con 0x7fc55c0a06c0 2023-09-13T09:35:20.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:19 smithi053 ceph-mon[102373]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:20.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:19 smithi053 ceph-mon[102373]: osdmap e38: 6 total, 6 up, 6 in 2023-09-13T09:35:20.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:35:20.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:35:20.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:19 smithi006 ceph-mon[98665]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:19 smithi006 ceph-mon[98665]: osdmap e38: 6 total, 6 up, 6 in 2023-09-13T09:35:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:35:20.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:35:20.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:20.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:19 smithi131 ceph-mon[102785]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 447 GiB / 447 GiB avail 2023-09-13T09:35:20.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:19 smithi131 ceph-mon[102785]: osdmap e38: 6 total, 6 up, 6 in 2023-09-13T09:35:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:35:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:35:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:21.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:20 smithi006 ceph-mon[98665]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:35:21.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:20 smithi006 ceph-mon[98665]: osdmap e39: 6 total, 6 up, 6 in 2023-09-13T09:35:21.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:20 smithi053 ceph-mon[102373]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:35:21.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:20 smithi053 ceph-mon[102373]: osdmap e39: 6 total, 6 up, 6 in 2023-09-13T09:35:21.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:20 smithi131 ceph-mon[102785]: from='client.14370 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:35:21.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:20 smithi131 ceph-mon[102785]: osdmap e39: 6 total, 6 up, 6 in 2023-09-13T09:35:22.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:21 smithi053 ceph-mon[102373]: pgmap v126: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:22.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:21 smithi053 ceph-mon[102373]: osdmap e40: 6 total, 6 up, 6 in 2023-09-13T09:35:22.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:21 smithi006 ceph-mon[98665]: pgmap v126: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:22.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:21 smithi006 ceph-mon[98665]: osdmap e40: 6 total, 6 up, 6 in 2023-09-13T09:35:22.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:21 smithi131 ceph-mon[102785]: pgmap v126: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:22.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:21 smithi131 ceph-mon[102785]: osdmap e40: 6 total, 6 up, 6 in 2023-09-13T09:35:23.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:22 smithi053 ceph-mon[102373]: osdmap e41: 6 total, 6 up, 6 in 2023-09-13T09:35:23.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:22 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2315366053' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6340a542-4e1e-4a78-800c-e087c081a161"}]: dispatch 2023-09-13T09:35:23.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:22 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2315366053' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6340a542-4e1e-4a78-800c-e087c081a161"}]': finished 2023-09-13T09:35:23.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:22 smithi053 ceph-mon[102373]: osdmap e42: 7 total, 6 up, 7 in 2023-09-13T09:35:23.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:23.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:22 smithi006 ceph-mon[98665]: osdmap e41: 6 total, 6 up, 6 in 2023-09-13T09:35:23.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:22 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2315366053' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6340a542-4e1e-4a78-800c-e087c081a161"}]: dispatch 2023-09-13T09:35:23.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:22 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2315366053' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6340a542-4e1e-4a78-800c-e087c081a161"}]': finished 2023-09-13T09:35:23.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:22 smithi006 ceph-mon[98665]: osdmap e42: 7 total, 6 up, 7 in 2023-09-13T09:35:23.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:23.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:22 smithi131 ceph-mon[102785]: osdmap e41: 6 total, 6 up, 6 in 2023-09-13T09:35:23.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:22 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2315366053' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6340a542-4e1e-4a78-800c-e087c081a161"}]: dispatch 2023-09-13T09:35:23.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:22 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2315366053' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6340a542-4e1e-4a78-800c-e087c081a161"}]': finished 2023-09-13T09:35:23.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:22 smithi131 ceph-mon[102785]: osdmap e42: 7 total, 6 up, 7 in 2023-09-13T09:35:23.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:24.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:23 smithi053 ceph-mon[102373]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:24.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:23 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1251460674' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:24.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:23 smithi006 ceph-mon[98665]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:24.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:23 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1251460674' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:23 smithi131 ceph-mon[102785]: pgmap v130: 1 pgs: 1 remapped+peering; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:23 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1251460674' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:26.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:25 smithi006 ceph-mon[98665]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-09-13T09:35:26.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:25 smithi053 ceph-mon[102373]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-09-13T09:35:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:25 smithi131 ceph-mon[102785]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 536 GiB / 536 GiB avail; 130 KiB/s, 0 objects/s recovering 2023-09-13T09:35:28.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:27 smithi053 ceph-mon[102373]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-13T09:35:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:27 smithi006 ceph-mon[98665]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-13T09:35:28.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:27 smithi131 ceph-mon[102785]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-13T09:35:29.837 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:29 smithi006 ceph-mon[98665]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-09-13T09:35:29.837 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-13T09:35:29.837 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:29.838 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:29 smithi006 ceph-mon[98665]: Deploying daemon osd.6 on smithi006 2023-09-13T09:35:30.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:29 smithi053 ceph-mon[102373]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-09-13T09:35:30.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-13T09:35:30.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:30.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:29 smithi053 ceph-mon[102373]: Deploying daemon osd.6 on smithi006 2023-09-13T09:35:30.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:29 smithi131 ceph-mon[102785]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-09-13T09:35:30.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-09-13T09:35:30.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:30.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:29 smithi131 ceph-mon[102785]: Deploying daemon osd.6 on smithi006 2023-09-13T09:35:32.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:31 smithi053 ceph-mon[102373]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-09-13T09:35:32.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:31 smithi006 ceph-mon[98665]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-09-13T09:35:32.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:31 smithi131 ceph-mon[102785]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-09-13T09:35:34.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:33 smithi053 ceph-mon[102373]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-09-13T09:35:34.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:34.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:34.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:33 smithi006 ceph-mon[98665]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-09-13T09:35:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:34.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:34.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:33 smithi131 ceph-mon[102785]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 57 KiB/s, 0 objects/s recovering 2023-09-13T09:35:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:35.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:35 smithi006 ceph-mon[98665]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-09-13T09:35:35.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:35.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:35.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:35.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:35.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:35.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.940+0000 7fc5667fc700 1 -- 172.21.15.6:0/3924642441 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fc57002d0b0 con 0x7fc55c0a06c0 2023-09-13T09:35:35.941 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 6 on host 'smithi006' 2023-09-13T09:35:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc55c0a06c0 msgr2=0x7fc55c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc55c0a06c0 0x7fc55c0a2b80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fc56c009f50 tx=0x7fc56c00b540 comp rx=0 tx=0).stop 2023-09-13T09:35:35.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570102940 msgr2=0x7fc5700735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570102940 0x7fc5700735e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc568007ee0 tx=0x7fc56800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:35:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 shutdown_connections 2023-09-13T09:35:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc55c0a06c0 0x7fc55c0a2b80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc570102940 0x7fc5700735e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc570100da0 0x7fc570074a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 --2- 172.21.15.6:0/3924642441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc570101fa0 0x7fc5700730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 >> 172.21.15.6:0/3924642441 conn(0x7fc5700fc340 msgr2=0x7fc570105500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:35:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 shutdown_connections 2023-09-13T09:35:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:35:35.943+0000 7fc5776d7700 1 -- 172.21.15.6:0/3924642441 wait complete. 2023-09-13T09:35:36.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:35 smithi053 ceph-mon[102373]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-09-13T09:35:36.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:36.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:36.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:36.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:36.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:36.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:35 smithi131 ceph-mon[102785]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-09-13T09:35:36.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:36.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:36.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:36.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:36.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:36.337 DEBUG:teuthology.orchestra.run.smithi006:osd.6> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.6.service 2023-09-13T09:35:36.340 INFO:tasks.cephadm:Deploying osd.7 on smithi053 with /dev/vg_nvme/lv_2... 2023-09-13T09:35:36.341 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-13T09:35:36.383 INFO:journalctl@ceph.osd.6.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:35:36.929 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:35:37.147 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:36 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:37.147 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:36 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:37.148 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:36 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:37.194 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:36 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:37.195 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:36 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:37.195 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:36 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:37.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:36 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:36 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:36 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:37.471 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 09:35:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T09:35:37.237+0000 7f686f2e9640 -1 osd.6 0 log_to_monitors true 2023-09-13T09:35:38.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:37 smithi006 ceph-mon[98665]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:38.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:37 smithi006 ceph-mon[98665]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-13T09:35:38.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:37 smithi053 ceph-mon[102373]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:38.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:37 smithi053 ceph-mon[102373]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-13T09:35:38.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:37 smithi131 ceph-mon[102785]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:37 smithi131 ceph-mon[102785]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-09-13T09:35:38.440 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-13T09:35:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-13T09:35:38.441 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2023-09-13T09:35:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2023-09-13T09:35:38.441 INFO:teuthology.orchestra.run.smithi053.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00803972 s, 1.3 GB/s 2023-09-13T09:35:38.442 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2023-09-13T09:35:38.787 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi053:vg_nvme/lv_2 2023-09-13T09:35:38.918 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 09:35:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T09:35:38.905+0000 7f686415f700 -1 osd.6 0 waiting for initial osdmap 2023-09-13T09:35:38.918 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:38 smithi006 ceph-mon[98665]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-13T09:35:38.919 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:38 smithi006 ceph-mon[98665]: osdmap e43: 7 total, 6 up, 7 in 2023-09-13T09:35:38.919 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:38.919 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:38 smithi006 ceph-mon[98665]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:35:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:38 smithi053 ceph-mon[102373]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-13T09:35:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:38 smithi053 ceph-mon[102373]: osdmap e43: 7 total, 6 up, 7 in 2023-09-13T09:35:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:38 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:38 smithi053 ceph-mon[102373]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:35:39.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 09:35:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T09:35:38.917+0000 7f685ef52700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:35:39.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:38 smithi131 ceph-mon[102785]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-09-13T09:35:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:38 smithi131 ceph-mon[102785]: osdmap e43: 7 total, 6 up, 7 in 2023-09-13T09:35:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:38 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:38 smithi131 ceph-mon[102785]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:35:39.354 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:35:40.095 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:40.095 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:35:40.095 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: osdmap e44: 7 total, 6 up, 7 in 2023-09-13T09:35:40.096 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.096 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.096 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.096 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.096 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.097 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.097 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.097 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.097 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:40.097 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:40.098 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.098 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:35:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: osdmap e44: 7 total, 6 up, 7 in 2023-09-13T09:35:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:35:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: osdmap e44: 7 total, 6 up, 7 in 2023-09-13T09:35:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:35:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:40.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:40.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:40.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:40.544 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 -- 172.21.15.53:0/1096681647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 msgr2=0x7fd3c41012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 --2- 172.21.15.53:0/1096681647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c41012d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0099c0 tx=0x7fd3ac009cd0 comp rx=0 tx=0).stop 2023-09-13T09:35:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 -- 172.21.15.53:0/1096681647 shutdown_connections 2023-09-13T09:35:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 --2- 172.21.15.53:0/1096681647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3c4101810 0x7fd3c41080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 --2- 172.21.15.53:0/1096681647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c40ffc70 0x7fd3c4100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:40.545 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 --2- 172.21.15.53:0/1096681647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c41012d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 -- 172.21.15.53:0/1096681647 >> 172.21.15.53:0/1096681647 conn(0x7fd3c40fb1f0 msgr2=0x7fd3c40fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:35:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 -- 172.21.15.53:0/1096681647 shutdown_connections 2023-09-13T09:35:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.544+0000 7fd3ca60d700 1 -- 172.21.15.53:0/1096681647 wait complete. 2023-09-13T09:35:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 Processor -- start 2023-09-13T09:35:40.546 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 -- start start 2023-09-13T09:35:40.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3c40ffc70 0x7fd3c4103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:40.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c4102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:40.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c4101810 0x7fd3c4102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:40.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4102f10 con 0x7fd3c40ffc70 2023-09-13T09:35:40.549 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4103080 con 0x7fd3c4100e70 2023-09-13T09:35:40.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3ca60d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c41a0aa0 con 0x7fd3c4101810 2023-09-13T09:35:40.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c4102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:40.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c4102250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60110/0 (socket says 172.21.15.53:60110) 2023-09-13T09:35:40.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3c37fe700 1 -- 172.21.15.53:0/1143273379 learned_addr learned my addr 172.21.15.53:0/1143273379 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-13T09:35:40.550 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.545+0000 7fd3c3fff700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3c40ffc70 0x7fd3c4103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:40.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c37fe700 1 -- 172.21.15.53:0/1143273379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c4101810 msgr2=0x7fd3c4102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:40.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c8baa700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c4101810 0x7fd3c4102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:40.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c37fe700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c4101810 0x7fd3c4102790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:40.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c37fe700 1 -- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3c40ffc70 msgr2=0x7fd3c4103c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:40.551 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c37fe700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3c40ffc70 0x7fd3c4103c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:40.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c37fe700 1 -- 172.21.15.53:0/1143273379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac0095f0 con 0x7fd3c4100e70 2023-09-13T09:35:40.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c37fe700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c4102250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0036f0 tx=0x7fd3ac005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:35:40.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c17fa700 1 -- 172.21.15.53:0/1143273379 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac01d070 con 0x7fd3c4100e70 2023-09-13T09:35:40.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c17fa700 1 -- 172.21.15.53:0/1143273379 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3ac004010 con 0x7fd3c4100e70 2023-09-13T09:35:40.552 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3ca60d700 1 -- 172.21.15.53:0/1143273379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c41a0d20 con 0x7fd3c4100e70 2023-09-13T09:35:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3c17fa700 1 -- 172.21.15.53:0/1143273379 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac022da0 con 0x7fd3c4100e70 2023-09-13T09:35:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.546+0000 7fd3ca60d700 1 -- 172.21.15.53:0/1143273379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c41a1190 con 0x7fd3c4100e70 2023-09-13T09:35:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.547+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a80052f0 con 0x7fd3c4100e70 2023-09-13T09:35:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.548+0000 7fd3c17fa700 1 -- 172.21.15.53:0/1143273379 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd3ac022500 con 0x7fd3c4100e70 2023-09-13T09:35:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.549+0000 7fd3c17fa700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3b00a06c0 0x7fd3b00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:35:40.553 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.549+0000 7fd3c17fa700 1 -- 172.21.15.53:0/1143273379 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 4965+0+0 (secure 0 0 0) 0x7fd3ac0cc1f0 con 0x7fd3c4100e70 2023-09-13T09:35:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.549+0000 7fd3c3fff700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3b00a06c0 0x7fd3b00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:35:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.549+0000 7fd3c3fff700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3b00a06c0 0x7fd3b00a2b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4100cd0 tx=0x7fd3b4007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:35:40.554 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.553+0000 7fd3c17fa700 1 -- 172.21.15.53:0/1143273379 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd3ac096ac0 con 0x7fd3c4100e70 2023-09-13T09:35:40.761 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:40.762+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3a8000bc0 con 0x7fd3b00a06c0 2023-09-13T09:35:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:35:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:35:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi006 2023-09-13T09:35:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi006 to 5724M 2023-09-13T09:35:41.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] boot 2023-09-13T09:35:41.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: osdmap e45: 7 total, 7 up, 7 in 2023-09-13T09:35:41.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:41.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:35:41.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:35:41.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:40 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:41.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:35:41.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:35:41.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi006 2023-09-13T09:35:41.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi006 to 5724M 2023-09-13T09:35:41.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] boot 2023-09-13T09:35:41.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: osdmap e45: 7 total, 7 up, 7 in 2023-09-13T09:35:41.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:41.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:35:41.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:35:41.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:40 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:35:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:35:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi006 2023-09-13T09:35:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi006 to 5724M 2023-09-13T09:35:41.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: osd.6 [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] boot 2023-09-13T09:35:41.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: osdmap e45: 7 total, 7 up, 7 in 2023-09-13T09:35:41.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-09-13T09:35:41.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:35:41.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:35:41.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:40 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:41 smithi006 ceph-mon[98665]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:41 smithi006 ceph-mon[98665]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:35:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:41 smithi006 ceph-mon[98665]: osdmap e46: 7 total, 7 up, 7 in 2023-09-13T09:35:42.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:41 smithi053 ceph-mon[102373]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:42.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:41 smithi053 ceph-mon[102373]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:35:42.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:41 smithi053 ceph-mon[102373]: osdmap e46: 7 total, 7 up, 7 in 2023-09-13T09:35:42.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:41 smithi131 ceph-mon[102785]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 536 GiB / 536 GiB avail 2023-09-13T09:35:42.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:41 smithi131 ceph-mon[102785]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:35:42.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:41 smithi131 ceph-mon[102785]: osdmap e46: 7 total, 7 up, 7 in 2023-09-13T09:35:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:43 smithi006 ceph-mon[98665]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:44.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:43 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/235478427' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]: dispatch 2023-09-13T09:35:44.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:43 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]: dispatch 2023-09-13T09:35:44.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:43 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]': finished 2023-09-13T09:35:44.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:43 smithi006 ceph-mon[98665]: osdmap e47: 8 total, 7 up, 8 in 2023-09-13T09:35:44.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:35:44.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:43 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/1111118074' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:44.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:43 smithi053 ceph-mon[102373]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:44.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:43 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/235478427' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]: dispatch 2023-09-13T09:35:44.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:43 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]: dispatch 2023-09-13T09:35:44.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:43 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]': finished 2023-09-13T09:35:44.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:43 smithi053 ceph-mon[102373]: osdmap e47: 8 total, 7 up, 8 in 2023-09-13T09:35:44.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:35:44.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:43 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/1111118074' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:43 smithi131 ceph-mon[102785]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:43 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/235478427' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]: dispatch 2023-09-13T09:35:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:43 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]: dispatch 2023-09-13T09:35:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:43 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "fa7b97d8-bb41-4f66-b13a-30bd0b6304b8"}]': finished 2023-09-13T09:35:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:43 smithi131 ceph-mon[102785]: osdmap e47: 8 total, 7 up, 8 in 2023-09-13T09:35:44.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:35:44.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:43 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/1111118074' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:35:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:45 smithi006 ceph-mon[98665]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:45 smithi053 ceph-mon[102373]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:45 smithi131 ceph-mon[102785]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:48.204 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:47 smithi053 ceph-mon[102373]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:47 smithi006 ceph-mon[98665]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:47 smithi131 ceph-mon[102785]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:49 smithi053 ceph-mon[102373]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-13T09:35:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:49 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:49 smithi006 ceph-mon[98665]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-13T09:35:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:49 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:49 smithi131 ceph-mon[102785]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-09-13T09:35:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:49 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:51.186 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:50 smithi053 ceph-mon[102373]: Deploying daemon osd.7 on smithi053 2023-09-13T09:35:51.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:50 smithi006 ceph-mon[98665]: Deploying daemon osd.7 on smithi053 2023-09-13T09:35:51.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:50 smithi131 ceph-mon[102785]: Deploying daemon osd.7 on smithi053 2023-09-13T09:35:52.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:51 smithi053 ceph-mon[102373]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:51 smithi006 ceph-mon[98665]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:51 smithi131 ceph-mon[102785]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:53 smithi053 ceph-mon[102373]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:53 smithi006 ceph-mon[98665]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:54.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:53 smithi131 ceph-mon[102785]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:55.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:55.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:55 smithi053 ceph-mon[102373]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:55 smithi006 ceph-mon[98665]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:55.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:55 smithi131 ceph-mon[102785]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:56.928 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 7 on host 'smithi053' 2023-09-13T09:35:56.929 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.928+0000 7fd3c17fa700 1 -- 172.21.15.53:0/1143273379 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd3a8000bc0 con 0x7fd3b00a06c0 2023-09-13T09:35:56.930 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.930+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3b00a06c0 msgr2=0x7fd3b00a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.930+0000 7fd3baffd700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3b00a06c0 0x7fd3b00a2b80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd3c4100cd0 tx=0x7fd3b4007400 comp rx=0 tx=0).stop 2023-09-13T09:35:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.930+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 msgr2=0x7fd3c4102250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:35:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.930+0000 7fd3baffd700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c4102250 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0036f0 tx=0x7fd3ac005740 comp rx=0 tx=0).stop 2023-09-13T09:35:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.931+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 shutdown_connections 2023-09-13T09:35:56.931 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.931+0000 7fd3baffd700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c4101810 0x7fd3c4102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.931+0000 7fd3baffd700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3b00a06c0 0x7fd3b00a2b80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.931+0000 7fd3baffd700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3c40ffc70 0x7fd3c4103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.931+0000 7fd3baffd700 1 --2- 172.21.15.53:0/1143273379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd3c4100e70 0x7fd3c4102250 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:35:56.932 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.931+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 >> 172.21.15.53:0/1143273379 conn(0x7fd3c40fb1f0 msgr2=0x7fd3c40690b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:35:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.931+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 shutdown_connections 2023-09-13T09:35:56.933 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:35:56.932+0000 7fd3baffd700 1 -- 172.21.15.53:0/1143273379 wait complete. 2023-09-13T09:35:57.349 DEBUG:teuthology.orchestra.run.smithi053:osd.7> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.7.service 2023-09-13T09:35:57.351 INFO:tasks.cephadm:Deploying osd.8 on smithi131 with /dev/vg_nvme/lv_2... 2023-09-13T09:35:57.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-09-13T09:35:57.386 INFO:journalctl@ceph.osd.7.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:35:57.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:57.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:57.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:57.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:57.877 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:57.878 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.878 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.878 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:57.878 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:57.879 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.879 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.879 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:57.879 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:57.927 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:35:58.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:58.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:58.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:58.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:35:58.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:35:58.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:58.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:58.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:35:58.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:35:58.137 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 09:35:57 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T09:35:57.988+0000 7f5c3a285640 -1 osd.7 0 log_to_monitors true 2023-09-13T09:35:58.673 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:58 smithi053 ceph-mon[102373]: from='osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-13T09:35:58.674 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:58 smithi053 ceph-mon[102373]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-13T09:35:58.854 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:58 smithi131 ceph-mon[102785]: from='osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-13T09:35:58.855 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:58 smithi131 ceph-mon[102785]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-13T09:35:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:58 smithi006 ceph-mon[98665]: from='osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-13T09:35:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:58 smithi006 ceph-mon[98665]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-09-13T09:35:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-09-13T09:35:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-09-13T09:35:59.623 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-09-13T09:35:59.623 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-09-13T09:35:59.624 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0143894 s, 729 MB/s 2023-09-13T09:35:59.624 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-09-13T09:35:59.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-mon[102373]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:35:59.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-mon[102373]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-13T09:35:59.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-mon[102373]: osdmap e48: 8 total, 7 up, 8 in 2023-09-13T09:35:59.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:35:59.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-mon[102373]: from='osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:35:59.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-mon[102373]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:35:59.759 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T09:35:59.629+0000 7f5c2f0fb700 -1 osd.7 0 waiting for initial osdmap 2023-09-13T09:35:59.760 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 09:35:59 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T09:35:59.639+0000 7f5c276e9700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:36:00.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:59 smithi006 ceph-mon[98665]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:36:00.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:59 smithi006 ceph-mon[98665]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-13T09:36:00.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:59 smithi006 ceph-mon[98665]: osdmap e48: 8 total, 7 up, 8 in 2023-09-13T09:36:00.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:00.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:59 smithi006 ceph-mon[98665]: from='osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:36:00.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:35:59 smithi006 ceph-mon[98665]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:36:00.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:59 smithi131 ceph-mon[102785]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:36:00.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:59 smithi131 ceph-mon[102785]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-09-13T09:36:00.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:59 smithi131 ceph-mon[102785]: osdmap e48: 8 total, 7 up, 8 in 2023-09-13T09:36:00.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:00.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:59 smithi131 ceph-mon[102785]: from='osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:36:00.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:35:59 smithi131 ceph-mon[102785]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:36:00.068 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi131:vg_nvme/lv_2 2023-09-13T09:36:00.626 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:36:00.883 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:36:00.883 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: osdmap e49: 8 total, 7 up, 8 in 2023-09-13T09:36:00.883 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:00.883 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:00.884 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi053 2023-09-13T09:36:00.884 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:00.884 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:00.884 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:00.884 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:00.885 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:00.885 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi053 to 5724M 2023-09-13T09:36:00.885 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:00.885 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:00.885 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:00.886 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:00.886 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:00 smithi131 ceph-mon[102785]: osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] boot 2023-09-13T09:36:01.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:36:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: osdmap e49: 8 total, 7 up, 8 in 2023-09-13T09:36:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:01.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi053 2023-09-13T09:36:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:01.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi053 to 5724M 2023-09-13T09:36:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:01.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:01.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:00 smithi053 ceph-mon[102373]: osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] boot 2023-09-13T09:36:01.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:36:01.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: osdmap e49: 8 total, 7 up, 8 in 2023-09-13T09:36:01.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:01.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:01.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi053 2023-09-13T09:36:01.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.012 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.012 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:01.012 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:01.012 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:01.012 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi053 to 5724M 2023-09-13T09:36:01.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:01.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:01.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:01.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:00 smithi006 ceph-mon[98665]: osd.7 [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] boot 2023-09-13T09:36:01.761 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:01 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:36:01.761 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:01 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:36:01.761 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:01 smithi131 ceph-mon[102785]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:36:01.762 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:01 smithi131 ceph-mon[102785]: osdmap e50: 8 total, 8 up, 8 in 2023-09-13T09:36:01.762 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:01.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.969+0000 7f4d4c051700 1 -- 172.21.15.131:0/65197524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d441008a0 msgr2=0x7f4d44108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:01.972 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.969+0000 7f4d4c051700 1 --2- 172.21.15.131:0/65197524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d441008a0 0x7f4d44108160 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c00b0a0 tx=0x7f4d3c00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:36:01.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.969+0000 7f4d4c051700 1 -- 172.21.15.131:0/65197524 shutdown_connections 2023-09-13T09:36:01.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.969+0000 7f4d4c051700 1 --2- 172.21.15.131:0/65197524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d441008a0 0x7f4d44108160 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:01.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.969+0000 7f4d4c051700 1 --2- 172.21.15.131:0/65197524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d44101250 0x7f4d44101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:01.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 --2- 172.21.15.131:0/65197524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d440fff00 0x7f4d44100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:01.973 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 -- 172.21.15.131:0/65197524 >> 172.21.15.131:0/65197524 conn(0x7f4d440fa970 msgr2=0x7f4d440fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:36:01.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 -- 172.21.15.131:0/65197524 shutdown_connections 2023-09-13T09:36:01.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 -- 172.21.15.131:0/65197524 wait complete. 2023-09-13T09:36:01.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 Processor -- start 2023-09-13T09:36:01.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 -- start start 2023-09-13T09:36:01.974 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d440fff00 0x7f4d44103ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:01.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d441008a0 0x7f4d441022f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:01.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d44101250 0x7f4d44102830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:01.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44102fb0 con 0x7f4d441008a0 2023-09-13T09:36:01.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d44103120 con 0x7f4d44101250 2023-09-13T09:36:01.975 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d4c051700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d441a0bb0 con 0x7f4d440fff00 2023-09-13T09:36:01.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d49ded700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d440fff00 0x7f4d44103ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:01.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.970+0000 7f4d49ded700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d440fff00 0x7f4d44103ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33730/0 (socket says 172.21.15.131:33730) 2023-09-13T09:36:01.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d49ded700 1 -- 172.21.15.131:0/3612194468 learned_addr learned my addr 172.21.15.131:0/3612194468 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:36:01.976 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d495ec700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d441008a0 0x7f4d441022f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:01.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d4a5ee700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d44101250 0x7f4d44102830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:01.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d49ded700 1 -- 172.21.15.131:0/3612194468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d44101250 msgr2=0x7f4d44102830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:01.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d49ded700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d44101250 0x7f4d44102830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:01.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d49ded700 1 -- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d441008a0 msgr2=0x7f4d441022f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:01.977 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d49ded700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d441008a0 0x7f4d441022f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d49ded700 1 -- 172.21.15.131:0/3612194468 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d3c009d00 con 0x7f4d440fff00 2023-09-13T09:36:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d495ec700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d441008a0 0x7f4d441022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:36:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d49ded700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d440fff00 0x7f4d44103ca0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400d980 tx=0x7f4d3400dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:36:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d3affd700 1 -- 172.21.15.131:0/3612194468 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400de60 con 0x7f4d440fff00 2023-09-13T09:36:01.978 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d3affd700 1 -- 172.21.15.131:0/3612194468 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d340044e0 con 0x7f4d440fff00 2023-09-13T09:36:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d441a0e90 con 0x7f4d440fff00 2023-09-13T09:36:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d3affd700 1 -- 172.21.15.131:0/3612194468 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d34003be0 con 0x7f4d440fff00 2023-09-13T09:36:01.979 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.971+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d441a12a0 con 0x7f4d440fff00 2023-09-13T09:36:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.972+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4410b4e0 con 0x7f4d440fff00 2023-09-13T09:36:01.980 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.973+0000 7f4d3affd700 1 -- 172.21.15.131:0/3612194468 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4d34009bb0 con 0x7f4d440fff00 2023-09-13T09:36:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.974+0000 7f4d3affd700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d300a0640 0x7f4d300a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.974+0000 7f4d3affd700 1 -- 172.21.15.131:0/3612194468 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f4d340cae10 con 0x7f4d440fff00 2023-09-13T09:36:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.974+0000 7f4d495ec700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d300a0640 0x7f4d300a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.975+0000 7f4d495ec700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d300a0640 0x7f4d300a2b00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d40005950 tx=0x7f4d40005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:36:01.981 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:01.978+0000 7f4d3affd700 1 -- 172.21.15.131:0/3612194468 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4d34095480 con 0x7f4d440fff00 2023-09-13T09:36:02.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:01 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:36:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:01 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:36:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:01 smithi006 ceph-mon[98665]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:36:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:01 smithi006 ceph-mon[98665]: osdmap e50: 8 total, 8 up, 8 in 2023-09-13T09:36:02.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:02.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:01 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:36:02.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:01 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:36:02.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:01 smithi053 ceph-mon[102373]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 189 MiB used, 626 GiB / 626 GiB avail 2023-09-13T09:36:02.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:01 smithi053 ceph-mon[102373]: osdmap e50: 8 total, 8 up, 8 in 2023-09-13T09:36:02.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-09-13T09:36:02.176 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:02.175+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d440ff5a0 con 0x7f4d300a0640 2023-09-13T09:36:02.992 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:02 smithi131 ceph-mon[102785]: osdmap e51: 8 total, 8 up, 8 in 2023-09-13T09:36:02.993 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:02.993 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:02.993 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:02.993 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:02 smithi131 ceph-mon[102785]: osdmap e52: 8 total, 8 up, 8 in 2023-09-13T09:36:03.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:02 smithi053 ceph-mon[102373]: osdmap e51: 8 total, 8 up, 8 in 2023-09-13T09:36:03.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:03.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:03.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:03.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:02 smithi053 ceph-mon[102373]: osdmap e52: 8 total, 8 up, 8 in 2023-09-13T09:36:03.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:02 smithi006 ceph-mon[98665]: osdmap e51: 8 total, 8 up, 8 in 2023-09-13T09:36:03.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:03.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:03.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:03.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:02 smithi006 ceph-mon[98665]: osdmap e52: 8 total, 8 up, 8 in 2023-09-13T09:36:04.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:03 smithi006 ceph-mon[98665]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:04.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:03 smithi006 ceph-mon[98665]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:04.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:03 smithi053 ceph-mon[102373]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:04.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:03 smithi053 ceph-mon[102373]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:04.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:03 smithi131 ceph-mon[102785]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 216 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:04.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:03 smithi131 ceph-mon[102785]: from='client.24295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:05.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:04 smithi053 ceph-mon[102373]: osdmap e53: 8 total, 8 up, 8 in 2023-09-13T09:36:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:04 smithi006 ceph-mon[98665]: osdmap e53: 8 total, 8 up, 8 in 2023-09-13T09:36:05.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:04 smithi131 ceph-mon[102785]: osdmap e53: 8 total, 8 up, 8 in 2023-09-13T09:36:06.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:06.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: osdmap e54: 8 total, 8 up, 8 in 2023-09-13T09:36:06.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/1158462531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]: dispatch 2023-09-13T09:36:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]: dispatch 2023-09-13T09:36:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]': finished 2023-09-13T09:36:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: osdmap e55: 9 total, 8 up, 9 in 2023-09-13T09:36:06.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:06.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:05 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/1018063492' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:06.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: osdmap e54: 8 total, 8 up, 8 in 2023-09-13T09:36:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/1158462531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]: dispatch 2023-09-13T09:36:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]: dispatch 2023-09-13T09:36:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]': finished 2023-09-13T09:36:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: osdmap e55: 9 total, 8 up, 9 in 2023-09-13T09:36:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:05 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/1018063492' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:06.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:06.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: osdmap e54: 8 total, 8 up, 8 in 2023-09-13T09:36:06.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/1158462531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]: dispatch 2023-09-13T09:36:06.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]: dispatch 2023-09-13T09:36:06.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "489e288d-c0f6-43f0-b2c3-38ac78ae9d97"}]': finished 2023-09-13T09:36:06.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: osdmap e55: 9 total, 8 up, 9 in 2023-09-13T09:36:06.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:06.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:05 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/1018063492' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:08.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:07 smithi053 ceph-mon[102373]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:07 smithi006 ceph-mon[98665]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:08.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:07 smithi131 ceph-mon[102785]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:09.958 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:09 smithi131 ceph-mon[102785]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:10.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:09 smithi053 ceph-mon[102373]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:09 smithi006 ceph-mon[98665]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:12.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:11 smithi006 ceph-mon[98665]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:12.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:11 smithi053 ceph-mon[102373]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:12.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:11 smithi131 ceph-mon[102785]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:13.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:12 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-13T09:36:13.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:12 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:13.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:12 smithi053 ceph-mon[102373]: Deploying daemon osd.8 on smithi131 2023-09-13T09:36:13.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:12 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-13T09:36:13.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:12 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:13.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:12 smithi006 ceph-mon[98665]: Deploying daemon osd.8 on smithi131 2023-09-13T09:36:13.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:12 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-09-13T09:36:13.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:12 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:13.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:12 smithi131 ceph-mon[102785]: Deploying daemon osd.8 on smithi131 2023-09-13T09:36:13.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:13 smithi131 ceph-mon[102785]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:14.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:13 smithi006 ceph-mon[98665]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:14.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:13 smithi053 ceph-mon[102373]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:16.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:15 smithi006 ceph-mon[98665]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:16.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:15 smithi053 ceph-mon[102373]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:16.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:15 smithi131 ceph-mon[102785]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:17.653 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:17 smithi131 ceph-mon[102785]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:17.653 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:17.653 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:17.653 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:17.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:17 smithi053 ceph-mon[102373]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:17.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:17.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:17.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:17.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:17 smithi006 ceph-mon[98665]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:17.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:17.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:17.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:19.293 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.293+0000 7f4d3affd700 1 -- 172.21.15.131:0/3612194468 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4d440ff5a0 con 0x7f4d300a0640 2023-09-13T09:36:19.293 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 8 on host 'smithi131' 2023-09-13T09:36:19.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d300a0640 msgr2=0x7f4d300a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:19.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d300a0640 0x7f4d300a2b00 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4d40005950 tx=0x7f4d40005f50 comp rx=0 tx=0).stop 2023-09-13T09:36:19.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d440fff00 msgr2=0x7f4d44103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:19.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d440fff00 0x7f4d44103ca0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4d3400d980 tx=0x7f4d3400dd40 comp rx=0 tx=0).stop 2023-09-13T09:36:19.295 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 shutdown_connections 2023-09-13T09:36:19.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d44101250 0x7f4d44102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:19.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d440fff00 0x7f4d44103ca0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:19.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d300a0640 0x7f4d300a2b00 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:19.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 --2- 172.21.15.131:0/3612194468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d441008a0 0x7f4d441022f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:19.296 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 >> 172.21.15.131:0/3612194468 conn(0x7f4d440fa970 msgr2=0x7f4d440fee90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:36:19.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 shutdown_connections 2023-09-13T09:36:19.297 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:36:19.295+0000 7f4d4c051700 1 -- 172.21.15.131:0/3612194468 wait complete. 2023-09-13T09:36:19.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:19 smithi131 ceph-mon[102785]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.724 DEBUG:teuthology.orchestra.run.smithi131:osd.8> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.8.service 2023-09-13T09:36:19.726 INFO:tasks.cephadm:Deploying osd.9 on smithi006 with /dev/vg_nvme/lv_1... 2023-09-13T09:36:19.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-13T09:36:19.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:19 smithi053 ceph-mon[102373]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:19.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:19 smithi006 ceph-mon[98665]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:19.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:19.758 INFO:journalctl@ceph.osd.8.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:36:20.301 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:36:20.650 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:20 smithi131 ceph-mon[102785]: from='osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-13T09:36:20.651 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:20 smithi131 ceph-mon[102785]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-13T09:36:20.651 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 09:36:20 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T09:36:20.423+0000 7f5a7ab4f640 -1 osd.8 0 log_to_monitors true 2023-09-13T09:36:20.755 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:20 smithi006 ceph-mon[98665]: from='osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-13T09:36:20.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:20 smithi006 ceph-mon[98665]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-13T09:36:20.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:20 smithi053 ceph-mon[102373]: from='osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-13T09:36:20.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:20 smithi053 ceph-mon[102373]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-09-13T09:36:21.494 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-mon[102785]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:21.494 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-mon[102785]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-13T09:36:21.495 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-mon[102785]: osdmap e56: 9 total, 8 up, 9 in 2023-09-13T09:36:21.495 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:21.495 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-mon[102785]: from='osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:36:21.495 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-mon[102785]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:36:21.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:21 smithi053 ceph-mon[102373]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:21.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:21 smithi053 ceph-mon[102373]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-13T09:36:21.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:21 smithi053 ceph-mon[102373]: osdmap e56: 9 total, 8 up, 9 in 2023-09-13T09:36:21.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:21.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:21 smithi053 ceph-mon[102373]: from='osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:36:21.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:21 smithi053 ceph-mon[102373]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:36:21.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:21 smithi006 ceph-mon[98665]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:21.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:21 smithi006 ceph-mon[98665]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-09-13T09:36:21.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:21 smithi006 ceph-mon[98665]: osdmap e56: 9 total, 8 up, 9 in 2023-09-13T09:36:21.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:21.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:21 smithi006 ceph-mon[98665]: from='osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:36:21.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:21 smithi006 ceph-mon[98665]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:36:21.768 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T09:36:21.498+0000 7f5a6f9c5700 -1 osd.8 0 waiting for initial osdmap 2023-09-13T09:36:21.768 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 09:36:21 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T09:36:21.511+0000 7f5a6afb9700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:36:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-13T09:36:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-13T09:36:21.853 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2023-09-13T09:36:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2023-09-13T09:36:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110028 s, 953 MB/s 2023-09-13T09:36:21.854 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2023-09-13T09:36:22.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi006:vg_nvme/lv_1 2023-09-13T09:36:22.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:22 smithi006 ceph-mon[98665]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:36:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:22 smithi006 ceph-mon[98665]: osdmap e57: 9 total, 8 up, 9 in 2023-09-13T09:36:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:22 smithi006 ceph-mon[98665]: osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] boot 2023-09-13T09:36:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:22 smithi006 ceph-mon[98665]: osdmap e58: 9 total, 9 up, 9 in 2023-09-13T09:36:22.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:22 smithi053 ceph-mon[102373]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:36:22.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:22 smithi053 ceph-mon[102373]: osdmap e57: 9 total, 8 up, 9 in 2023-09-13T09:36:22.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:22 smithi053 ceph-mon[102373]: osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] boot 2023-09-13T09:36:22.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:22 smithi053 ceph-mon[102373]: osdmap e58: 9 total, 9 up, 9 in 2023-09-13T09:36:22.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:22 smithi131 ceph-mon[102785]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:36:22.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:22 smithi131 ceph-mon[102785]: osdmap e57: 9 total, 8 up, 9 in 2023-09-13T09:36:22.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:22 smithi131 ceph-mon[102785]: osd.8 [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] boot 2023-09-13T09:36:22.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:22 smithi131 ceph-mon[102785]: osdmap e58: 9 total, 9 up, 9 in 2023-09-13T09:36:22.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-09-13T09:36:22.873 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:36:23.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:36:23.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:36:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi131 2023-09-13T09:36:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi131 to 5722M 2023-09-13T09:36:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:23.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:23.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:23.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: osdmap e59: 9 total, 9 up, 9 in 2023-09-13T09:36:23.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:23.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:23.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:23.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:23.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 -- 172.21.15.6:0/2667131315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 msgr2=0x7f0d94103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 --2- 172.21.15.6:0/2667131315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94103c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c009990 tx=0x7f0d7c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:36:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 -- 172.21.15.6:0/2667131315 shutdown_connections 2023-09-13T09:36:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 --2- 172.21.15.6:0/2667131315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d94106ac0 0x7f0d94108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 --2- 172.21.15.6:0/2667131315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94103c50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:23.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 --2- 172.21.15.6:0/2667131315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d94104190 0x7f0d94106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 -- 172.21.15.6:0/2667131315 >> 172.21.15.6:0/2667131315 conn(0x7f0d940fb1f0 msgr2=0x7f0d940fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:36:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 -- 172.21.15.6:0/2667131315 shutdown_connections 2023-09-13T09:36:23.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.968+0000 7f0d9960b700 1 -- 172.21.15.6:0/2667131315 wait complete. 2023-09-13T09:36:23.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 Processor -- start 2023-09-13T09:36:23.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 -- start start 2023-09-13T09:36:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d94104190 0x7f0d94196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d94106ac0 0x7f0d9419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9419e5b0 con 0x7f0d94101860 2023-09-13T09:36:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9419e6f0 con 0x7f0d94104190 2023-09-13T09:36:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d9960b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d9419e880 con 0x7f0d94106ac0 2023-09-13T09:36:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d92ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d92ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94196a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59856/0 (socket says 172.21.15.6:59856) 2023-09-13T09:36:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d92ffd700 1 -- 172.21.15.6:0/586172468 learned_addr learned my addr 172.21.15.6:0/586172468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:36:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d927fc700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d94104190 0x7f0d94196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.969+0000 7f0d937fe700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d94106ac0 0x7f0d9419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d92ffd700 1 -- 172.21.15.6:0/586172468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d94106ac0 msgr2=0x7f0d9419dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d92ffd700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d94106ac0 0x7f0d9419dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d92ffd700 1 -- 172.21.15.6:0/586172468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d94104190 msgr2=0x7f0d94196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d92ffd700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d94104190 0x7f0d94196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d92ffd700 1 -- 172.21.15.6:0/586172468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0095f0 con 0x7f0d94101860 2023-09-13T09:36:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d937fe700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d94106ac0 0x7f0d9419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:36:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d927fc700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d94104190 0x7f0d94196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:36:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d92ffd700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94196a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c005910 tx=0x7f0d7c00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:36:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d8bfff700 1 -- 172.21.15.6:0/586172468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c01d070 con 0x7f0d94101860 2023-09-13T09:36:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d8bfff700 1 -- 172.21.15.6:0/586172468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d7c00fbc0 con 0x7f0d94101860 2023-09-13T09:36:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d8bfff700 1 -- 172.21.15.6:0/586172468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c017650 con 0x7f0d94101860 2023-09-13T09:36:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d9419eb00 con 0x7f0d94101860 2023-09-13T09:36:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.970+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d9419ef50 con 0x7f0d94101860 2023-09-13T09:36:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.971+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d940fcd70 con 0x7f0d94101860 2023-09-13T09:36:23.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.972+0000 7f0d8bfff700 1 -- 172.21.15.6:0/586172468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0d7c022470 con 0x7f0d94101860 2023-09-13T09:36:23.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.973+0000 7f0d8bfff700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d800a0640 0x7f0d800a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:23.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.973+0000 7f0d8bfff700 1 -- 172.21.15.6:0/586172468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f0d7c0cc8b0 con 0x7f0d94101860 2023-09-13T09:36:23.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.973+0000 7f0d927fc700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d800a0640 0x7f0d800a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:23.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.973+0000 7f0d927fc700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d800a0640 0x7f0d800a2b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d84005950 tx=0x7f0d84005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:36:23.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:23.976+0000 7f0d8bfff700 1 -- 172.21.15.6:0/586172468 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0d7c096e00 con 0x7f0d94101860 2023-09-13T09:36:24.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:36:24.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:36:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi131 2023-09-13T09:36:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:24.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:24.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:24.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi131 to 5722M 2023-09-13T09:36:24.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:24.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:24.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: osdmap e59: 9 total, 9 up, 9 in 2023-09-13T09:36:24.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:24.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:24.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:24.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:36:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:36:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 217 MiB used, 715 GiB / 715 GiB avail 2023-09-13T09:36:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi131 2023-09-13T09:36:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:24.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi131 to 5722M 2023-09-13T09:36:24.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:24.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:24.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: osdmap e59: 9 total, 9 up, 9 in 2023-09-13T09:36:24.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:24.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:24.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:24.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:24.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:24.187+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d9402d080 con 0x7f0d800a0640 2023-09-13T09:36:25.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:24 smithi006 ceph-mon[98665]: osdmap e60: 9 total, 9 up, 9 in 2023-09-13T09:36:25.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:25.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:25.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:25.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:24 smithi053 ceph-mon[102373]: osdmap e60: 9 total, 9 up, 9 in 2023-09-13T09:36:25.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:25.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:25.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:25.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:24 smithi131 ceph-mon[102785]: osdmap e60: 9 total, 9 up, 9 in 2023-09-13T09:36:25.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:25.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:25.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:25.990 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:25 smithi006 ceph-mon[98665]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:25.990 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:25 smithi006 ceph-mon[98665]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:25.991 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:25 smithi006 ceph-mon[98665]: osdmap e61: 9 total, 9 up, 9 in 2023-09-13T09:36:26.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:25 smithi053 ceph-mon[102373]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:26.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:25 smithi053 ceph-mon[102373]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:26.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:25 smithi053 ceph-mon[102373]: osdmap e61: 9 total, 9 up, 9 in 2023-09-13T09:36:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:25 smithi131 ceph-mon[102785]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:26.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:25 smithi131 ceph-mon[102785]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:26.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:25 smithi131 ceph-mon[102785]: osdmap e61: 9 total, 9 up, 9 in 2023-09-13T09:36:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:26 smithi006 ceph-mon[98665]: osdmap e62: 9 total, 9 up, 9 in 2023-09-13T09:36:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2372238408' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ff38aca-937b-4412-8179-dd5de05c99cc"}]: dispatch 2023-09-13T09:36:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2372238408' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ff38aca-937b-4412-8179-dd5de05c99cc"}]': finished 2023-09-13T09:36:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:26 smithi006 ceph-mon[98665]: osdmap e63: 10 total, 9 up, 10 in 2023-09-13T09:36:27.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:27.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:26 smithi053 ceph-mon[102373]: osdmap e62: 9 total, 9 up, 9 in 2023-09-13T09:36:27.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2372238408' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ff38aca-937b-4412-8179-dd5de05c99cc"}]: dispatch 2023-09-13T09:36:27.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2372238408' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ff38aca-937b-4412-8179-dd5de05c99cc"}]': finished 2023-09-13T09:36:27.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:26 smithi053 ceph-mon[102373]: osdmap e63: 10 total, 9 up, 10 in 2023-09-13T09:36:27.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:27.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:26 smithi131 ceph-mon[102785]: osdmap e62: 9 total, 9 up, 9 in 2023-09-13T09:36:27.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2372238408' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ff38aca-937b-4412-8179-dd5de05c99cc"}]: dispatch 2023-09-13T09:36:27.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2372238408' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ff38aca-937b-4412-8179-dd5de05c99cc"}]': finished 2023-09-13T09:36:27.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:26 smithi131 ceph-mon[102785]: osdmap e63: 10 total, 9 up, 10 in 2023-09-13T09:36:27.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:27 smithi006 ceph-mon[98665]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-13T09:36:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:27 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3486975563' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:28.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:27 smithi053 ceph-mon[102373]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-13T09:36:28.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:27 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3486975563' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:28.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:27 smithi131 ceph-mon[102785]: pgmap v182: 1 pgs: 1 peering; 577 KiB data, 244 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-09-13T09:36:28.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:27 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3486975563' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:30.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:29 smithi006 ceph-mon[98665]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-09-13T09:36:30.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:29 smithi053 ceph-mon[102373]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-09-13T09:36:30.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:29 smithi131 ceph-mon[102785]: pgmap v184: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2023-09-13T09:36:31.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:31 smithi006 ceph-mon[98665]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-13T09:36:32.005 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:31 smithi053 ceph-mon[102373]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-13T09:36:32.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:31 smithi131 ceph-mon[102785]: pgmap v185: 1 pgs: 1 peering; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-09-13T09:36:34.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:33 smithi006 ceph-mon[98665]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-09-13T09:36:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-13T09:36:34.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:34.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:33 smithi053 ceph-mon[102373]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-09-13T09:36:34.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-13T09:36:34.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:34.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:33 smithi131 ceph-mon[102785]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-09-13T09:36:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-09-13T09:36:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:34.981 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:34 smithi006 ceph-mon[98665]: Deploying daemon osd.9 on smithi006 2023-09-13T09:36:35.005 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:34 smithi053 ceph-mon[102373]: Deploying daemon osd.9 on smithi006 2023-09-13T09:36:35.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:34 smithi131 ceph-mon[102785]: Deploying daemon osd.9 on smithi006 2023-09-13T09:36:36.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:35 smithi006 ceph-mon[98665]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:36.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:35 smithi053 ceph-mon[102373]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:36.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:35 smithi131 ceph-mon[102785]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:38.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:37 smithi006 ceph-mon[98665]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:38.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:37 smithi053 ceph-mon[102373]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:38.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:37 smithi131 ceph-mon[102785]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:39.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:39.079 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:39.080 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:38 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:38 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:38 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:39.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:38 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:38 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:38 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:40.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:39 smithi006 ceph-mon[98665]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:39 smithi053 ceph-mon[102373]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:39 smithi131 ceph-mon[102785]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.546+0000 7f0d8bfff700 1 -- 172.21.15.6:0/586172468 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0d9402d080 con 0x7f0d800a0640 2023-09-13T09:36:40.547 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 9 on host 'smithi006' 2023-09-13T09:36:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d800a0640 msgr2=0x7f0d800a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d800a0640 0x7f0d800a2b00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0d84005950 tx=0x7f0d84005f50 comp rx=0 tx=0).stop 2023-09-13T09:36:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 msgr2=0x7f0d94196a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94196a20 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0d7c005910 tx=0x7f0d7c00f710 comp rx=0 tx=0).stop 2023-09-13T09:36:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 shutdown_connections 2023-09-13T09:36:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d94106ac0 0x7f0d9419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d800a0640 0x7f0d800a2b00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d94101860 0x7f0d94196a20 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 --2- 172.21.15.6:0/586172468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d94104190 0x7f0d94196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 >> 172.21.15.6:0/586172468 conn(0x7f0d940fb1f0 msgr2=0x7f0d941024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:36:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 shutdown_connections 2023-09-13T09:36:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:36:40.548+0000 7f0d9960b700 1 -- 172.21.15.6:0/586172468 wait complete. 2023-09-13T09:36:40.970 DEBUG:teuthology.orchestra.run.smithi006:osd.9> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.9.service 2023-09-13T09:36:40.973 INFO:tasks.cephadm:Deploying osd.10 on smithi053 with /dev/vg_nvme/lv_1... 2023-09-13T09:36:40.973 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-13T09:36:41.003 INFO:journalctl@ceph.osd.9.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:36:41.549 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:36:41.843 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:41 smithi006 ceph-mon[98665]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:41.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:41.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:41.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:41.844 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:41.915 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:41 smithi053 ceph-mon[102373]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:41.915 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:41.915 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:41.915 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:41.916 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:41 smithi131 ceph-mon[102785]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:42.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:42.170 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 09:36:41 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T09:36:41.879+0000 7ff635fa5640 -1 osd.9 0 log_to_monitors true 2023-09-13T09:36:43.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:42 smithi053 ceph-mon[102373]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-13T09:36:43.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:42 smithi006 ceph-mon[98665]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-13T09:36:43.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:42 smithi131 ceph-mon[102785]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-09-13T09:36:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-13T09:36:43.075 INFO:teuthology.orchestra.run.smithi053.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-13T09:36:43.075 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10+0 records in 2023-09-13T09:36:43.076 INFO:teuthology.orchestra.run.smithi053.stderr:10+0 records out 2023-09-13T09:36:43.076 INFO:teuthology.orchestra.run.smithi053.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00815587 s, 1.3 GB/s 2023-09-13T09:36:43.076 INFO:teuthology.orchestra.run.smithi053.stderr:--> Zapping successful for: 2023-09-13T09:36:43.497 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi053:vg_nvme/lv_1 2023-09-13T09:36:43.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:43 smithi053 ceph-mon[102373]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:43.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:43 smithi053 ceph-mon[102373]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-13T09:36:43.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:43 smithi053 ceph-mon[102373]: osdmap e64: 10 total, 9 up, 10 in 2023-09-13T09:36:43.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:43.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:43 smithi053 ceph-mon[102373]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:36:44.006 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 09:36:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T09:36:43.665+0000 7ff62c61e700 -1 osd.9 0 waiting for initial osdmap 2023-09-13T09:36:44.006 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 09:36:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T09:36:43.681+0000 7ff623c0a700 -1 osd.9 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:36:44.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:43 smithi006 ceph-mon[98665]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:44.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:43 smithi006 ceph-mon[98665]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-13T09:36:44.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:43 smithi006 ceph-mon[98665]: osdmap e64: 10 total, 9 up, 10 in 2023-09-13T09:36:44.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:44.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:43 smithi006 ceph-mon[98665]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:36:44.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:43 smithi131 ceph-mon[102785]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:44.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:43 smithi131 ceph-mon[102785]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-09-13T09:36:44.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:43 smithi131 ceph-mon[102785]: osdmap e64: 10 total, 9 up, 10 in 2023-09-13T09:36:44.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:44.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:43 smithi131 ceph-mon[102785]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2023-09-13T09:36:44.063 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T09:36:44.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:36:44.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: osdmap e65: 10 total, 9 up, 10 in 2023-09-13T09:36:44.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:44.778 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:44.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:44.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:44.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:44.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:44.779 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:44.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:44.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:44.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:44.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:44.780 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:44.781 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:44.781 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:44.781 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:44.781 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:36:45.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: osdmap e65: 10 total, 9 up, 10 in 2023-09-13T09:36:45.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:45.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:45.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:45.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:45.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:45.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:45.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:45.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2023-09-13T09:36:45.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: osdmap e65: 10 total, 9 up, 10 in 2023-09-13T09:36:45.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:45.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:45.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:36:45.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:45.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:45.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:36:45.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:45.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:36:45.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:45.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 -- 172.21.15.53:0/3067449155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 msgr2=0x7fc8c41012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:45.232 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/3067449155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c41012d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80099c0 tx=0x7fc8b8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:36:45.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 -- 172.21.15.53:0/3067449155 shutdown_connections 2023-09-13T09:36:45.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/3067449155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8c4101810 0x7fc8c41080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:45.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/3067449155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8c40ffc70 0x7fc8c4100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:45.233 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/3067449155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c41012d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:45.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 -- 172.21.15.53:0/3067449155 >> 172.21.15.53:0/3067449155 conn(0x7fc8c40fb1f0 msgr2=0x7fc8c40fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:36:45.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 -- 172.21.15.53:0/3067449155 shutdown_connections 2023-09-13T09:36:45.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.231+0000 7fc8c8e25700 1 -- 172.21.15.53:0/3067449155 wait complete. 2023-09-13T09:36:45.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.232+0000 7fc8c8e25700 1 Processor -- start 2023-09-13T09:36:45.234 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.232+0000 7fc8c8e25700 1 -- start start 2023-09-13T09:36:45.237 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c8e25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8c40ffc70 0x7fc8c4069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c8e25700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c419b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c8e25700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8c4101810 0x7fc8c419dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c8e25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c419e4c0 con 0x7fc8c40ffc70 2023-09-13T09:36:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c8e25700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c419e630 con 0x7fc8c4100e70 2023-09-13T09:36:45.238 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c8e25700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8c419e7f0 con 0x7fc8c4101810 2023-09-13T09:36:45.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c419b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:45.239 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c419b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.53:60252/0 (socket says 172.21.15.53:60252) 2023-09-13T09:36:45.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 -- 172.21.15.53:0/1603263169 learned_addr learned my addr 172.21.15.53:0/1603263169 (peer_addr_for_me v2:172.21.15.53:0/0) 2023-09-13T09:36:45.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c2d9d700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8c4101810 0x7fc8c419dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:45.240 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c259c700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8c40ffc70 0x7fc8c4069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:45.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 -- 172.21.15.53:0/1603263169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8c4101810 msgr2=0x7fc8c419dd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:45.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8c4101810 0x7fc8c419dd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:45.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 -- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8c40ffc70 msgr2=0x7fc8c4069320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:36:45.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8c40ffc70 0x7fc8c4069320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:36:45.241 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 -- 172.21.15.53:0/1603263169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b80095f0 con 0x7fc8c4100e70 2023-09-13T09:36:45.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c259c700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8c40ffc70 0x7fc8c4069320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:36:45.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8c1d9b700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c419b6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80036f0 tx=0x7fc8b8005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:36:45.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.233+0000 7fc8b37fe700 1 -- 172.21.15.53:0/1603263169 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b801d070 con 0x7fc8c4100e70 2023-09-13T09:36:45.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.234+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8c419ea70 con 0x7fc8c4100e70 2023-09-13T09:36:45.242 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.234+0000 7fc8b37fe700 1 -- 172.21.15.53:0/1603263169 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc8b8004200 con 0x7fc8c4100e70 2023-09-13T09:36:45.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.234+0000 7fc8b37fe700 1 -- 172.21.15.53:0/1603263169 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8b800f460 con 0x7fc8c4100e70 2023-09-13T09:36:45.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.234+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8c419ee80 con 0x7fc8c4100e70 2023-09-13T09:36:45.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.235+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8c4107210 con 0x7fc8c4100e70 2023-09-13T09:36:45.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.236+0000 7fc8b37fe700 1 -- 172.21.15.53:0/1603263169 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc8b8022650 con 0x7fc8c4100e70 2023-09-13T09:36:45.243 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.236+0000 7fc8b37fe700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc8ac0a0640 0x7fc8ac0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:36:45.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.236+0000 7fc8b37fe700 1 -- 172.21.15.53:0/1603263169 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6261+0+0 (secure 0 0 0) 0x7fc8b80cd080 con 0x7fc8c4100e70 2023-09-13T09:36:45.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.237+0000 7fc8c259c700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc8ac0a0640 0x7fc8ac0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:36:45.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.237+0000 7fc8c259c700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc8ac0a0640 0x7fc8ac0a2b00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4100cd0 tx=0x7fc8b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:36:45.244 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.240+0000 7fc8b37fe700 1 -- 172.21.15.53:0/1603263169 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc8b8097440 con 0x7fc8c4100e70 2023-09-13T09:36:45.448 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:36:45.449+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8c410b470 con 0x7fc8ac0a0640 2023-09-13T09:36:46.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:36:46.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:36:46.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi006 2023-09-13T09:36:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi006 to 4293M 2023-09-13T09:36:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] boot 2023-09-13T09:36:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: osdmap e66: 10 total, 10 up, 10 in 2023-09-13T09:36:46.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:46.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:46.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:46.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:46.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:36:46.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:36:46.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi006 2023-09-13T09:36:46.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi006 to 4293M 2023-09-13T09:36:46.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:46.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] boot 2023-09-13T09:36:46.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: osdmap e66: 10 total, 10 up, 10 in 2023-09-13T09:36:46.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:46.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:46.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:46.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:46.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:36:46.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:36:46.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi006 2023-09-13T09:36:46.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi006 to 4293M 2023-09-13T09:36:46.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 804 GiB / 805 GiB avail 2023-09-13T09:36:46.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: osd.9 [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] boot 2023-09-13T09:36:46.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: osdmap e66: 10 total, 10 up, 10 in 2023-09-13T09:36:46.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-09-13T09:36:46.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:36:46.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:36:46.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:47.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:46 smithi006 ceph-mon[98665]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:47.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:46 smithi006 ceph-mon[98665]: osdmap e67: 10 total, 10 up, 10 in 2023-09-13T09:36:47.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:46 smithi053 ceph-mon[102373]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:47.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:46 smithi053 ceph-mon[102373]: osdmap e67: 10 total, 10 up, 10 in 2023-09-13T09:36:47.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:46 smithi131 ceph-mon[102785]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi053:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:36:47.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:46 smithi131 ceph-mon[102785]: osdmap e67: 10 total, 10 up, 10 in 2023-09-13T09:36:48.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:47 smithi006 ceph-mon[98665]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:48.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:47 smithi053 ceph-mon[102373]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:48.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:47 smithi131 ceph-mon[102785]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:49.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:48 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/501937273' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]: dispatch 2023-09-13T09:36:49.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:48 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]: dispatch 2023-09-13T09:36:49.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:48 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]': finished 2023-09-13T09:36:49.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:48 smithi006 ceph-mon[98665]: osdmap e68: 11 total, 10 up, 11 in 2023-09-13T09:36:49.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:36:49.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:48 smithi006 ceph-mon[98665]: from='client.? 172.21.15.53:0/894983737' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:49.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:48 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/501937273' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]: dispatch 2023-09-13T09:36:49.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:48 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]: dispatch 2023-09-13T09:36:49.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:48 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]': finished 2023-09-13T09:36:49.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:48 smithi053 ceph-mon[102373]: osdmap e68: 11 total, 10 up, 11 in 2023-09-13T09:36:49.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:36:49.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:48 smithi053 ceph-mon[102373]: from='client.? 172.21.15.53:0/894983737' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:49.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:48 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/501937273' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]: dispatch 2023-09-13T09:36:49.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:48 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]: dispatch 2023-09-13T09:36:49.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:48 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0df1df73-c7bd-4263-8c5e-6e3b5183bd8c"}]': finished 2023-09-13T09:36:49.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:48 smithi131 ceph-mon[102785]: osdmap e68: 11 total, 10 up, 11 in 2023-09-13T09:36:49.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:36:49.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:48 smithi131 ceph-mon[102785]: from='client.? 172.21.15.53:0/894983737' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:36:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:49 smithi053 ceph-mon[102373]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:49 smithi006 ceph-mon[98665]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:49 smithi131 ceph-mon[102785]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:51 smithi006 ceph-mon[98665]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:51 smithi053 ceph-mon[102373]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:51 smithi131 ceph-mon[102785]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:53 smithi006 ceph-mon[98665]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:54.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:53 smithi053 ceph-mon[102373]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:54.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:53 smithi131 ceph-mon[102785]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:55.083 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:54 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-13T09:36:55.083 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:54 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:54 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-13T09:36:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:54 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:54 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-09-13T09:36:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:54 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:36:56.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:55 smithi053 ceph-mon[102373]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:56.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:55 smithi053 ceph-mon[102373]: Deploying daemon osd.10 on smithi053 2023-09-13T09:36:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:55 smithi006 ceph-mon[98665]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:55 smithi006 ceph-mon[98665]: Deploying daemon osd.10 on smithi053 2023-09-13T09:36:56.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:55 smithi131 ceph-mon[102785]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:55 smithi131 ceph-mon[102785]: Deploying daemon osd.10 on smithi053 2023-09-13T09:36:58.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:57 smithi053 ceph-mon[102373]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:57 smithi006 ceph-mon[98665]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:57 smithi131 ceph-mon[102785]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:59.662 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:59 smithi053 ceph-mon[102373]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:36:59.663 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:59.663 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:36:59.663 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:36:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:00.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:59 smithi006 ceph-mon[98665]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:00.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:00.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:00.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:36:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:00.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:59 smithi131 ceph-mon[102785]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:00.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:00.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:00.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:36:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:01.163 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.162+0000 7fc8b37fe700 1 -- 172.21.15.53:0/1603263169 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fc8c410b470 con 0x7fc8ac0a0640 2023-09-13T09:37:01.164 INFO:teuthology.orchestra.run.smithi053.stdout:Created osd(s) 10 on host 'smithi053' 2023-09-13T09:37:01.165 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc8ac0a0640 msgr2=0x7fc8ac0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:01.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc8ac0a0640 0x7fc8ac0a2b00 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc8c4100cd0 tx=0x7fc8b4005f90 comp rx=0 tx=0).stop 2023-09-13T09:37:01.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 msgr2=0x7fc8c419b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:01.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c419b6d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc8b80036f0 tx=0x7fc8b8005f10 comp rx=0 tx=0).stop 2023-09-13T09:37:01.166 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 shutdown_connections 2023-09-13T09:37:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8c4101810 0x7fc8c419dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc8ac0a0640 0x7fc8ac0a2b00 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8c40ffc70 0x7fc8c4069320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 --2- 172.21.15.53:0/1603263169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc8c4100e70 0x7fc8c419b6d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:01.167 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 >> 172.21.15.53:0/1603263169 conn(0x7fc8c40fb1f0 msgr2=0x7fc8c4104350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 shutdown_connections 2023-09-13T09:37:01.168 INFO:teuthology.orchestra.run.smithi053.stderr:2023-09-13T09:37:01.165+0000 7fc8c8e25700 1 -- 172.21.15.53:0/1603263169 wait complete. 2023-09-13T09:37:01.547 DEBUG:teuthology.orchestra.run.smithi053:osd.10> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.10.service 2023-09-13T09:37:01.550 INFO:tasks.cephadm:Deploying osd.11 on smithi131 with /dev/vg_nvme/lv_1... 2023-09-13T09:37:01.550 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-09-13T09:37:01.582 INFO:journalctl@ceph.osd.10.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:37:01.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:01 smithi053 ceph-mon[102373]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:01.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:01.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:01 smithi006 ceph-mon[98665]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:01 smithi131 ceph-mon[102785]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:02.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.118 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:37:02.729 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 09:37:02 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T09:37:02.493+0000 7ff6905ee640 -1 osd.10 0 log_to_monitors true 2023-09-13T09:37:02.730 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.730 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.730 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:02 smithi053 ceph-mon[102373]: from='osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-13T09:37:02.730 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:02 smithi053 ceph-mon[102373]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-13T09:37:02.941 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.941 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:02.942 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:02 smithi131 ceph-mon[102785]: from='osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-13T09:37:02.942 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:02 smithi131 ceph-mon[102785]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-13T09:37:03.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:03.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:03.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:02 smithi006 ceph-mon[98665]: from='osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-13T09:37:03.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:02 smithi006 ceph-mon[98665]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-09-13T09:37:03.797 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-09-13T09:37:03.797 INFO:teuthology.orchestra.run.smithi131.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-09-13T09:37:03.797 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10+0 records in 2023-09-13T09:37:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:10+0 records out 2023-09-13T09:37:03.798 INFO:teuthology.orchestra.run.smithi131.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0215227 s, 487 MB/s 2023-09-13T09:37:03.798 INFO:teuthology.orchestra.run.smithi131.stderr:--> Zapping successful for: 2023-09-13T09:37:03.961 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:03 smithi131 ceph-mon[102785]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:03.961 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:03 smithi131 ceph-mon[102785]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-13T09:37:03.961 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:03 smithi131 ceph-mon[102785]: osdmap e69: 11 total, 10 up, 11 in 2023-09-13T09:37:03.961 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:03 smithi131 ceph-mon[102785]: from='osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:37:03.962 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:03.962 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:03 smithi131 ceph-mon[102785]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:37:04.006 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T09:37:03.676+0000 7ff685464700 -1 osd.10 0 waiting for initial osdmap 2023-09-13T09:37:04.006 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T09:37:03.693+0000 7ff680a58700 -1 osd.10 70 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:37:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:03 smithi006 ceph-mon[98665]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:03 smithi006 ceph-mon[98665]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-13T09:37:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:03 smithi006 ceph-mon[98665]: osdmap e69: 11 total, 10 up, 11 in 2023-09-13T09:37:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:03 smithi006 ceph-mon[98665]: from='osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:37:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:04.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:03 smithi006 ceph-mon[98665]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:37:04.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-mon[102373]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:04.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-mon[102373]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-09-13T09:37:04.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-mon[102373]: osdmap e69: 11 total, 10 up, 11 in 2023-09-13T09:37:04.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-mon[102373]: from='osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:37:04.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:04.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:03 smithi053 ceph-mon[102373]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]: dispatch 2023-09-13T09:37:04.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch daemon add osd smithi131:vg_nvme/lv_1 2023-09-13T09:37:04.833 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:37:05.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:37:05.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: osdmap e70: 11 total, 10 up, 11 in 2023-09-13T09:37:05.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:05.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:05.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:37:05.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: osdmap e70: 11 total, 10 up, 11 in 2023-09-13T09:37:05.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:05.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:05.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:05.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:05.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi053", "root=default"]}]': finished 2023-09-13T09:37:05.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: osdmap e70: 11 total, 10 up, 11 in 2023-09-13T09:37:05.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:05.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:05.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:05.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:05.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:05.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:05.942 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:37:05.942 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:37:05.942 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:05.942 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi053 2023-09-13T09:37:05.943 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi053 to 4293M 2023-09-13T09:37:05.943 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] boot 2023-09-13T09:37:05.943 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: osdmap e71: 11 total, 11 up, 11 in 2023-09-13T09:37:05.943 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:05.943 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:05.944 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:05.944 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:05.944 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:06.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:37:06.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:37:06.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi053 2023-09-13T09:37:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi053 to 4293M 2023-09-13T09:37:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] boot 2023-09-13T09:37:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: osdmap e71: 11 total, 11 up, 11 in 2023-09-13T09:37:06.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:06.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:06.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:06.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:06.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:06.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:37:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:37:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 272 MiB used, 894 GiB / 894 GiB avail 2023-09-13T09:37:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi053 2023-09-13T09:37:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi053 to 4293M 2023-09-13T09:37:06.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: osd.10 [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] boot 2023-09-13T09:37:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: osdmap e71: 11 total, 11 up, 11 in 2023-09-13T09:37:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-09-13T09:37:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:06.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:06.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:06.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 -- 172.21.15.131:0/2357837709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a80fff10 msgr2=0x7fa4a8100390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:06.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2357837709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a80fff10 0x7fa4a8100390 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa498009990 tx=0x7fa498009ca0 comp rx=0 tx=0).stop 2023-09-13T09:37:06.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 -- 172.21.15.131:0/2357837709 shutdown_connections 2023-09-13T09:37:06.159 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2357837709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a81008d0 0x7fa4a8108170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:06.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2357837709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4a81012b0 0x7fa4a81016d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:06.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2357837709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a80fff10 0x7fa4a8100390 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:06.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 -- 172.21.15.131:0/2357837709 >> 172.21.15.131:0/2357837709 conn(0x7fa4a80faa00 msgr2=0x7fa4a80fce40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:06.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 -- 172.21.15.131:0/2357837709 shutdown_connections 2023-09-13T09:37:06.160 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.157+0000 7fa4ad888700 1 -- 172.21.15.131:0/2357837709 wait complete. 2023-09-13T09:37:06.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 Processor -- start 2023-09-13T09:37:06.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 -- start start 2023-09-13T09:37:06.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4a80fff10 0x7fa4a8103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:06.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a81008d0 0x7fa4a8102300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:06.161 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a81012b0 0x7fa4a8102840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:06.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8102fc0 con 0x7fa4a81008d0 2023-09-13T09:37:06.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a8103130 con 0x7fa4a80fff10 2023-09-13T09:37:06.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4ad888700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a81a0a70 con 0x7fa4a81012b0 2023-09-13T09:37:06.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a81012b0 0x7fa4a8102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:06.162 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4a77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a81012b0 0x7fa4a8102840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:33882/0 (socket says 172.21.15.131:33882) 2023-09-13T09:37:06.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4a77fe700 1 -- 172.21.15.131:0/2703493070 learned_addr learned my addr 172.21.15.131:0/2703493070 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:37:06.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4a6ffd700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4a80fff10 0x7fa4a8103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:06.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.158+0000 7fa4a67fc700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a81008d0 0x7fa4a8102300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:06.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4a77fe700 1 -- 172.21.15.131:0/2703493070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4a80fff10 msgr2=0x7fa4a8103cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:06.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4a77fe700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4a80fff10 0x7fa4a8103cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:06.163 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4a77fe700 1 -- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a81008d0 msgr2=0x7fa4a8102300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:06.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4a77fe700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a81008d0 0x7fa4a8102300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:06.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4a77fe700 1 -- 172.21.15.131:0/2703493070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4980095f0 con 0x7fa4a81012b0 2023-09-13T09:37:06.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4a77fe700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a81012b0 0x7fa4a8102840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0007d70 tx=0x7fa4a000a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:06.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4ac886700 1 -- 172.21.15.131:0/2703493070 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a000ac90 con 0x7fa4a81012b0 2023-09-13T09:37:06.164 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4ac886700 1 -- 172.21.15.131:0/2703493070 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4a000adf0 con 0x7fa4a81012b0 2023-09-13T09:37:06.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a81a0d50 con 0x7fa4a81012b0 2023-09-13T09:37:06.165 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4ac886700 1 -- 172.21.15.131:0/2703493070 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4a00115e0 con 0x7fa4a81012b0 2023-09-13T09:37:06.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.159+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a81a11a0 con 0x7fa4a81012b0 2023-09-13T09:37:06.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.160+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a810b4a0 con 0x7fa4a81012b0 2023-09-13T09:37:06.166 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.161+0000 7fa4ac886700 1 -- 172.21.15.131:0/2703493070 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa4a0012420 con 0x7fa4a81012b0 2023-09-13T09:37:06.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.161+0000 7fa4ac886700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4940a0640 0x7fa4940a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:06.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.162+0000 7fa4ac886700 1 -- 172.21.15.131:0/2703493070 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 6723+0+0 (secure 0 0 0) 0x7fa4a00cb770 con 0x7fa4a81012b0 2023-09-13T09:37:06.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.162+0000 7fa4a6ffd700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4940a0640 0x7fa4940a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:06.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.162+0000 7fa4a6ffd700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4940a0640 0x7fa4940a2b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8068bd0 tx=0x7fa49000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:06.167 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.166+0000 7fa4ac886700 1 -- 172.21.15.131:0/2703493070 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa4a00958d0 con 0x7fa4a81012b0 2023-09-13T09:37:06.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:06.364+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a80ff530 con 0x7fa4940a0640 2023-09-13T09:37:07.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:06 smithi053 ceph-mon[102373]: osdmap e72: 11 total, 11 up, 11 in 2023-09-13T09:37:07.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:37:07.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:37:07.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:07.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:06 smithi006 ceph-mon[98665]: osdmap e72: 11 total, 11 up, 11 in 2023-09-13T09:37:07.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:37:07.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:37:07.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:07.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:06 smithi131 ceph-mon[102785]: osdmap e72: 11 total, 11 up, 11 in 2023-09-13T09:37:07.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-09-13T09:37:07.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-09-13T09:37:07.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:07 smithi006 ceph-mon[98665]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:07 smithi006 ceph-mon[98665]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:37:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:07 smithi006 ceph-mon[98665]: osdmap e73: 11 total, 11 up, 11 in 2023-09-13T09:37:08.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:07 smithi053 ceph-mon[102373]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:08.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:07 smithi053 ceph-mon[102373]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:37:08.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:07 smithi053 ceph-mon[102373]: osdmap e73: 11 total, 11 up, 11 in 2023-09-13T09:37:08.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:07 smithi131 ceph-mon[102785]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:08.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:07 smithi131 ceph-mon[102785]: from='client.24358 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:37:08.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:07 smithi131 ceph-mon[102785]: osdmap e73: 11 total, 11 up, 11 in 2023-09-13T09:37:09.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:08 smithi006 ceph-mon[98665]: osdmap e74: 11 total, 11 up, 11 in 2023-09-13T09:37:09.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:08 smithi053 ceph-mon[102373]: osdmap e74: 11 total, 11 up, 11 in 2023-09-13T09:37:09.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:08 smithi131 ceph-mon[102785]: osdmap e74: 11 total, 11 up, 11 in 2023-09-13T09:37:10.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:10.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: osdmap e75: 11 total, 11 up, 11 in 2023-09-13T09:37:10.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/4161846657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]: dispatch 2023-09-13T09:37:10.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]: dispatch 2023-09-13T09:37:10.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]': finished 2023-09-13T09:37:10.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: osdmap e76: 12 total, 11 up, 12 in 2023-09-13T09:37:10.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:10.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:09 smithi053 ceph-mon[102373]: from='client.? 172.21.15.131:0/1103037424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:37:10.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:10.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: osdmap e75: 11 total, 11 up, 11 in 2023-09-13T09:37:10.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/4161846657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]: dispatch 2023-09-13T09:37:10.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]: dispatch 2023-09-13T09:37:10.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]': finished 2023-09-13T09:37:10.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: osdmap e76: 12 total, 11 up, 12 in 2023-09-13T09:37:10.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:10.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:09 smithi006 ceph-mon[98665]: from='client.? 172.21.15.131:0/1103037424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:37:10.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: osdmap e75: 11 total, 11 up, 11 in 2023-09-13T09:37:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/4161846657' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]: dispatch 2023-09-13T09:37:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]: dispatch 2023-09-13T09:37:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ea94feef-e76d-4855-a60a-8fdf41e23135"}]': finished 2023-09-13T09:37:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: osdmap e76: 12 total, 11 up, 12 in 2023-09-13T09:37:10.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:10.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:09 smithi131 ceph-mon[102785]: from='client.? 172.21.15.131:0/1103037424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-09-13T09:37:12.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:11 smithi006 ceph-mon[98665]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:12.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:11 smithi053 ceph-mon[102373]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:12.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:11 smithi131 ceph-mon[102785]: pgmap v218: 1 pgs: 1 remapped+peering; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:14.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:13 smithi053 ceph-mon[102373]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2023-09-13T09:37:14.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:13 smithi006 ceph-mon[98665]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2023-09-13T09:37:14.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:13 smithi131 ceph-mon[102785]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 301 MiB used, 983 GiB / 983 GiB avail; 106 KiB/s, 0 objects/s recovering 2023-09-13T09:37:16.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:15 smithi006 ceph-mon[98665]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-09-13T09:37:16.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:15 smithi053 ceph-mon[102373]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-09-13T09:37:16.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:15 smithi131 ceph-mon[102785]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 90 KiB/s, 0 objects/s recovering 2023-09-13T09:37:17.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:16 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-13T09:37:17.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:16 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:17.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:16 smithi006 ceph-mon[98665]: Deploying daemon osd.11 on smithi131 2023-09-13T09:37:17.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:16 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-13T09:37:17.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:16 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:17.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:16 smithi053 ceph-mon[102373]: Deploying daemon osd.11 on smithi131 2023-09-13T09:37:17.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:16 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-09-13T09:37:17.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:16 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:17.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:16 smithi131 ceph-mon[102785]: Deploying daemon osd.11 on smithi131 2023-09-13T09:37:18.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:17 smithi006 ceph-mon[98665]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-13T09:37:18.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:17 smithi053 ceph-mon[102373]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-13T09:37:18.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:17 smithi131 ceph-mon[102785]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-09-13T09:37:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:19 smithi006 ceph-mon[98665]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-09-13T09:37:20.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:19 smithi053 ceph-mon[102373]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-09-13T09:37:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:19 smithi131 ceph-mon[102785]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-09-13T09:37:21.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:21 smithi131 ceph-mon[102785]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-09-13T09:37:21.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:21.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:21.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:22.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:21 smithi053 ceph-mon[102373]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-09-13T09:37:22.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:22.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:22.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:22.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:21 smithi006 ceph-mon[98665]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2023-09-13T09:37:22.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:22.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:22.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:23.631 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 11 on host 'smithi131' 2023-09-13T09:37:23.631 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.630+0000 7fa4ac886700 1 -- 172.21.15.131:0/2703493070 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7fa4a80ff530 con 0x7fa4940a0640 2023-09-13T09:37:23.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4940a0640 msgr2=0x7fa4940a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:23.633 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4940a0640 0x7fa4940a2b00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa4a8068bd0 tx=0x7fa49000b410 comp rx=0 tx=0).stop 2023-09-13T09:37:23.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a81012b0 msgr2=0x7fa4a8102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:23.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a81012b0 0x7fa4a8102840 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa4a0007d70 tx=0x7fa4a000a340 comp rx=0 tx=0).stop 2023-09-13T09:37:23.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 shutdown_connections 2023-09-13T09:37:23.634 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4a81012b0 0x7fa4a8102840 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:23.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4a80fff10 0x7fa4a8103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:23.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4940a0640 0x7fa4940a2b00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:23.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 --2- 172.21.15.131:0/2703493070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a81008d0 0x7fa4a8102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:23.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 >> 172.21.15.131:0/2703493070 conn(0x7fa4a80faa00 msgr2=0x7fa4a80fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:23.635 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 shutdown_connections 2023-09-13T09:37:23.636 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:23.632+0000 7fa4ad888700 1 -- 172.21.15.131:0/2703493070 wait complete. 2023-09-13T09:37:23.766 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-09-13T09:37:23.767 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:23.767 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:23.767 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:23.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:23.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:23.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:23.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:23.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-09-13T09:37:24.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:24.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-09-13T09:37:24.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:24.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:24.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:24.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:24.018 DEBUG:teuthology.orchestra.run.smithi131:osd.11> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.11.service 2023-09-13T09:37:24.021 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-09-13T09:37:24.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd stat -f json 2023-09-13T09:37:24.051 INFO:journalctl@ceph.osd.11.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:37:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:37:24.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:24 smithi131 ceph-mon[102785]: from='osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-13T09:37:24.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:24 smithi131 ceph-mon[102785]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-13T09:37:24.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 09:37:24 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T09:37:24.496+0000 7f9b1d111640 -1 osd.11 0 log_to_monitors true 2023-09-13T09:37:25.004 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:24 smithi006 ceph-mon[98665]: from='osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-13T09:37:25.004 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:24 smithi006 ceph-mon[98665]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-13T09:37:25.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:24 smithi053 ceph-mon[102373]: from='osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-13T09:37:25.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:24 smithi053 ceph-mon[102373]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-09-13T09:37:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 -- 172.21.15.6:0/2031824164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94100e80 msgr2=0x7f9d941012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 --2- 172.21.15.6:0/2031824164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94100e80 0x7f9d941012e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9d880099c0 tx=0x7f9d88009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 -- 172.21.15.6:0/2031824164 shutdown_connections 2023-09-13T09:37:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 --2- 172.21.15.6:0/2031824164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94101820 0x7f9d941080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 --2- 172.21.15.6:0/2031824164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 0x7f9d941000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 --2- 172.21.15.6:0/2031824164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94100e80 0x7f9d941012e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 -- 172.21.15.6:0/2031824164 >> 172.21.15.6:0/2031824164 conn(0x7f9d940fb220 msgr2=0x7f9d940fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 -- 172.21.15.6:0/2031824164 shutdown_connections 2023-09-13T09:37:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.749+0000 7f9d9938e700 1 -- 172.21.15.6:0/2031824164 wait complete. 2023-09-13T09:37:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.750+0000 7f9d9938e700 1 Processor -- start 2023-09-13T09:37:25.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.750+0000 7f9d9938e700 1 -- start start 2023-09-13T09:37:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.750+0000 7f9d9938e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 0x7f9d94195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.750+0000 7f9d9938e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94100e80 0x7f9d94195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d9938e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94101820 0x7f9d9419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:25.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d9938e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419d500 con 0x7f9d94101820 2023-09-13T09:37:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d9938e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419d640 con 0x7f9d940ffc80 2023-09-13T09:37:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d9938e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9419d7d0 con 0x7f9d94100e80 2023-09-13T09:37:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94101820 0x7f9d9419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d92ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 0x7f9d94195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:25.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d92ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 0x7f9d94195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:53530/0 (socket says 172.21.15.6:53530) 2023-09-13T09:37:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94101820 0x7f9d9419cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60010/0 (socket says 172.21.15.6:60010) 2023-09-13T09:37:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d92ffd700 1 -- 172.21.15.6:0/931788602 learned_addr learned my addr 172.21.15.6:0/931788602 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d927fc700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94100e80 0x7f9d94195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 -- 172.21.15.6:0/931788602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94100e80 msgr2=0x7f9d94195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:25.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94100e80 0x7f9d94195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 -- 172.21.15.6:0/931788602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 msgr2=0x7f9d94195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 0x7f9d94195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 -- 172.21.15.6:0/931788602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d880095f0 con 0x7f9d94101820 2023-09-13T09:37:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d92ffd700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 0x7f9d94195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:37:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d937fe700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94101820 0x7f9d9419cf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00be50 tx=0x7f9d8c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:25.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d7bfff700 1 -- 172.21.15.6:0/931788602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c00cb90 con 0x7f9d94101820 2023-09-13T09:37:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9419dab0 con 0x7f9d94101820 2023-09-13T09:37:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d7bfff700 1 -- 172.21.15.6:0/931788602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d8c00ccf0 con 0x7f9d94101820 2023-09-13T09:37:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d7bfff700 1 -- 172.21.15.6:0/931788602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c012650 con 0x7f9d94101820 2023-09-13T09:37:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.751+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9419dfb0 con 0x7f9d94101820 2023-09-13T09:37:25.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.752+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9410b500 con 0x7f9d94101820 2023-09-13T09:37:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.753+0000 7f9d7bfff700 1 -- 172.21.15.6:0/931788602 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9d8c014440 con 0x7f9d94101820 2023-09-13T09:37:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.754+0000 7f9d7bfff700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d7c0a0640 0x7f9d7c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.754+0000 7f9d92ffd700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d7c0a0640 0x7f9d7c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.754+0000 7f9d7bfff700 1 -- 172.21.15.6:0/931788602 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f9d8c006e40 con 0x7f9d94101820 2023-09-13T09:37:25.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.755+0000 7f9d92ffd700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d7c0a0640 0x7f9d7c0a2b00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d840105c0 tx=0x7f9d8400b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:25.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.758+0000 7f9d7bfff700 1 -- 172.21.15.6:0/931788602 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9d8c095370 con 0x7f9d94101820 2023-09-13T09:37:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.959+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9d9419dc40 con 0x7f9d94101820 2023-09-13T09:37:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.959+0000 7f9d7bfff700 1 -- 172.21.15.6:0/931788602 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v78) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9d9419dc40 con 0x7f9d94101820 2023-09-13T09:37:25.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d7c0a0640 msgr2=0x7f9d7c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d7c0a0640 0x7f9d7c0a2b00 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f9d840105c0 tx=0x7f9d8400b4a0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94101820 msgr2=0x7f9d9419cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94101820 0x7f9d9419cf30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d8c00be50 tx=0x7f9d8c009ed0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 shutdown_connections 2023-09-13T09:37:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d7c0a0640 0x7f9d7c0a2b00 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d94101820 0x7f9d9419cf30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.961+0000 7f9d9938e700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d940ffc80 0x7f9d94195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.962+0000 7f9d9938e700 1 --2- 172.21.15.6:0/931788602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d94100e80 0x7f9d94195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.962+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 >> 172.21.15.6:0/931788602 conn(0x7f9d940fb220 msgr2=0x7f9d940fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.962+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 shutdown_connections 2023-09-13T09:37:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:25.962+0000 7f9d9938e700 1 -- 172.21.15.6:0/931788602 wait complete. 2023-09-13T09:37:25.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:25 smithi006 ceph-mon[98665]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:25.988 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:25 smithi006 ceph-mon[98665]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-13T09:37:25.988 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:25 smithi006 ceph-mon[98665]: osdmap e77: 12 total, 11 up, 12 in 2023-09-13T09:37:25.988 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:25.988 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:25 smithi006 ceph-mon[98665]: from='osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:37:25.989 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:25 smithi006 ceph-mon[98665]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:37:26.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:25 smithi053 ceph-mon[102373]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:26.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:25 smithi053 ceph-mon[102373]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-13T09:37:26.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:25 smithi053 ceph-mon[102373]: osdmap e77: 12 total, 11 up, 12 in 2023-09-13T09:37:26.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:26.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:25 smithi053 ceph-mon[102373]: from='osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:37:26.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:25 smithi053 ceph-mon[102373]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:37:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-mon[102785]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-mon[102785]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-09-13T09:37:26.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-mon[102785]: osdmap e77: 12 total, 11 up, 12 in 2023-09-13T09:37:26.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:26.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-mon[102785]: from='osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:37:26.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-mon[102785]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2023-09-13T09:37:26.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T09:37:25.683+0000 7f9b11f87700 -1 osd.11 0 waiting for initial osdmap 2023-09-13T09:37:26.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 09:37:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T09:37:25.703+0000 7f9b0c579700 -1 osd.11 78 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-13T09:37:26.351 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":78,"num_osds":12,"num_up_osds":11,"osd_up_since":1694597824,"num_in_osds":12,"osd_in_since":1694597828,"num_remapped_pgs":0} 2023-09-13T09:37:26.893 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:26 smithi131 ceph-mon[102785]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:37:26.894 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:26 smithi131 ceph-mon[102785]: osdmap e78: 12 total, 11 up, 12 in 2023-09-13T09:37:26.894 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:26.897 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:26.897 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/931788602' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-13T09:37:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:26 smithi006 ceph-mon[98665]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:37:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:26 smithi006 ceph-mon[98665]: osdmap e78: 12 total, 11 up, 12 in 2023-09-13T09:37:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:27.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/931788602' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-13T09:37:27.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:26 smithi053 ceph-mon[102373]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2023-09-13T09:37:27.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:26 smithi053 ceph-mon[102373]: osdmap e78: 12 total, 11 up, 12 in 2023-09-13T09:37:27.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:27.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:27.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/931788602' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-13T09:37:27.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd stat -f json 2023-09-13T09:37:27.925 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:37:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: purged_snaps scrub starts 2023-09-13T09:37:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: purged_snaps scrub ok 2023-09-13T09:37:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:28.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] boot 2023-09-13T09:37:28.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: osdmap e79: 12 total, 12 up, 12 in 2023-09-13T09:37:28.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:28.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: Detected new or changed devices on smithi131 2023-09-13T09:37:28.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi131 to 4292M 2023-09-13T09:37:28.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:28.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:28.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: purged_snaps scrub starts 2023-09-13T09:37:28.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: purged_snaps scrub ok 2023-09-13T09:37:28.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:28.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] boot 2023-09-13T09:37:28.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: osdmap e79: 12 total, 12 up, 12 in 2023-09-13T09:37:28.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:28.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: Detected new or changed devices on smithi131 2023-09-13T09:37:28.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.012 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.013 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi131 to 4292M 2023-09-13T09:37:28.013 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.013 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:28.013 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:28.013 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: purged_snaps scrub starts 2023-09-13T09:37:28.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: purged_snaps scrub ok 2023-09-13T09:37:28.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 983 GiB / 983 GiB avail 2023-09-13T09:37:28.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: osd.11 [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] boot 2023-09-13T09:37:28.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: osdmap e79: 12 total, 12 up, 12 in 2023-09-13T09:37:28.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-09-13T09:37:28.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: Detected new or changed devices on smithi131 2023-09-13T09:37:28.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:37:28.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi131 to 4292M 2023-09-13T09:37:28.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:28.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:28.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:28.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:29.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 -- 172.21.15.6:0/2262189931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784101810 msgr2=0x7fb7841080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:29.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2262189931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784101810 0x7fb7841080c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb77c0099c0 tx=0x7fb77c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 -- 172.21.15.6:0/2262189931 shutdown_connections 2023-09-13T09:37:29.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2262189931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784101810 0x7fb7841080c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2262189931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7840ffc70 0x7fb784100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2262189931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb784100e70 0x7fb7841012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 -- 172.21.15.6:0/2262189931 >> 172.21.15.6:0/2262189931 conn(0x7fb7840fb1f0 msgr2=0x7fb7840fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:29.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 -- 172.21.15.6:0/2262189931 shutdown_connections 2023-09-13T09:37:29.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.170+0000 7fb788ee6700 1 -- 172.21.15.6:0/2262189931 wait complete. 2023-09-13T09:37:29.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.171+0000 7fb788ee6700 1 Processor -- start 2023-09-13T09:37:29.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb788ee6700 1 -- start start 2023-09-13T09:37:29.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb788ee6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7840ffc70 0x7fb7841959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:29.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb788ee6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784100e70 0x7fb784195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:29.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb788ee6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb784101810 0x7fb78419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:29.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb788ee6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78419d560 con 0x7fb784100e70 2023-09-13T09:37:29.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb788ee6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78419d6a0 con 0x7fb7840ffc70 2023-09-13T09:37:29.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb788ee6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb78419d830 con 0x7fb784101810 2023-09-13T09:37:29.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784100e70 0x7fb784195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:29.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784100e70 0x7fb784195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60024/0 (socket says 172.21.15.6:60024) 2023-09-13T09:37:29.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 -- 172.21.15.6:0/2460979875 learned_addr learned my addr 172.21.15.6:0/2460979875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:29.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb78259c700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7840ffc70 0x7fb7841959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb782d9d700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb784101810 0x7fb78419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 -- 172.21.15.6:0/2460979875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb784101810 msgr2=0x7fb78419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb784101810 0x7fb78419cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 -- 172.21.15.6:0/2460979875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7840ffc70 msgr2=0x7fb7841959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:29.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7840ffc70 0x7fb7841959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.172+0000 7fb779d9b700 1 -- 172.21.15.6:0/2460979875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb77c0095f0 con 0x7fb784100e70 2023-09-13T09:37:29.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.173+0000 7fb779d9b700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784100e70 0x7fb784195f10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b560 tx=0x7fb76c00b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:29.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.173+0000 7fb77bfff700 1 -- 172.21.15.6:0/2460979875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c011830 con 0x7fb784100e70 2023-09-13T09:37:29.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.173+0000 7fb77bfff700 1 -- 172.21.15.6:0/2460979875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb76c011e50 con 0x7fb784100e70 2023-09-13T09:37:29.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.173+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb784068800 con 0x7fb784100e70 2023-09-13T09:37:29.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.173+0000 7fb77bfff700 1 -- 172.21.15.6:0/2460979875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb76c010db0 con 0x7fb784100e70 2023-09-13T09:37:29.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.173+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb784068d80 con 0x7fb784100e70 2023-09-13T09:37:29.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.174+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb78404e9b0 con 0x7fb784100e70 2023-09-13T09:37:29.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.175+0000 7fb77bfff700 1 -- 172.21.15.6:0/2460979875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb76c011990 con 0x7fb784100e70 2023-09-13T09:37:29.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.175+0000 7fb77bfff700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7700a0640 0x7fb7700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:29.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.176+0000 7fb78259c700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7700a0640 0x7fb7700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:29.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.176+0000 7fb77bfff700 1 -- 172.21.15.6:0/2460979875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb76c0cb070 con 0x7fb784100e70 2023-09-13T09:37:29.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.176+0000 7fb78259c700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7700a0640 0x7fb7700a2b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb784100cd0 tx=0x7fb77400d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:29.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.180+0000 7fb77bfff700 1 -- 172.21.15.6:0/2460979875 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb76c095040 con 0x7fb784100e70 2023-09-13T09:37:29.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:28 smithi006 ceph-mon[98665]: osdmap e80: 12 total, 12 up, 12 in 2023-09-13T09:37:29.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:28 smithi053 ceph-mon[102373]: osdmap e80: 12 total, 12 up, 12 in 2023-09-13T09:37:29.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:28 smithi131 ceph-mon[102785]: osdmap e80: 12 total, 12 up, 12 in 2023-09-13T09:37:29.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.382+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fb78410b790 con 0x7fb784100e70 2023-09-13T09:37:29.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.382+0000 7fb77bfff700 1 -- 172.21.15.6:0/2460979875 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v80) v1 ==== 74+0+133 (secure 0 0 0) 0x7fb76c098660 con 0x7fb784100e70 2023-09-13T09:37:29.384 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:29.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7700a0640 msgr2=0x7fb7700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:29.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7700a0640 0x7fb7700a2b00 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb784100cd0 tx=0x7fb77400d040 comp rx=0 tx=0).stop 2023-09-13T09:37:29.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784100e70 msgr2=0x7fb784195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:29.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784100e70 0x7fb784195f10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb76c00b560 tx=0x7fb76c00b870 comp rx=0 tx=0).stop 2023-09-13T09:37:29.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 shutdown_connections 2023-09-13T09:37:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb784101810 0x7fb78419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7840ffc70 0x7fb7841959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7700a0640 0x7fb7700a2b00 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 --2- 172.21.15.6:0/2460979875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb784100e70 0x7fb784195f10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:29.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 >> 172.21.15.6:0/2460979875 conn(0x7fb7840fb1f0 msgr2=0x7fb784104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 shutdown_connections 2023-09-13T09:37:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:29.384+0000 7fb788ee6700 1 -- 172.21.15.6:0/2460979875 wait complete. 2023-09-13T09:37:29.784 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"num_osds":12,"num_up_osds":12,"osd_up_since":1694597846,"num_in_osds":12,"osd_in_since":1694597828,"num_remapped_pgs":0} 2023-09-13T09:37:29.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd dump --format=json 2023-09-13T09:37:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:29 smithi053 ceph-mon[102373]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:29 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2460979875' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-13T09:37:30.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:29 smithi006 ceph-mon[98665]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:30.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:29 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2460979875' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-13T09:37:30.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:29 smithi131 ceph-mon[102785]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:29 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2460979875' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-09-13T09:37:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:37:31.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 -- 172.21.15.6:0/2484880328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 msgr2=0x7fefac106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:31.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/2484880328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac106050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fef9c0099c0 tx=0x7fef9c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 -- 172.21.15.6:0/2484880328 shutdown_connections 2023-09-13T09:37:31.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/2484880328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefac100620 0x7fefac10ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/2484880328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac106050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/2484880328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefac0ffc60 0x7fefac1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 -- 172.21.15.6:0/2484880328 >> 172.21.15.6:0/2484880328 conn(0x7fefac075c00 msgr2=0x7fefac076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 -- 172.21.15.6:0/2484880328 shutdown_connections 2023-09-13T09:37:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.573+0000 7fefb0e4d700 1 -- 172.21.15.6:0/2484880328 wait complete. 2023-09-13T09:37:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 Processor -- start 2023-09-13T09:37:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 -- start start 2023-09-13T09:37:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefac0ffc60 0x7fefac1018e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefac100620 0x7fefac101e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac1023a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1a5210 con 0x7fefac105c70 2023-09-13T09:37:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1a5380 con 0x7fefac100620 2023-09-13T09:37:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefb0e4d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefac1a5540 con 0x7fefac0ffc60 2023-09-13T09:37:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac1023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac1023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60048/0 (socket says 172.21.15.6:60048) 2023-09-13T09:37:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 -- 172.21.15.6:0/1251704768 learned_addr learned my addr 172.21.15.6:0/1251704768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaa59c700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefac0ffc60 0x7fefac1018e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefa9d9b700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefac100620 0x7fefac101e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 -- 172.21.15.6:0/1251704768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefac0ffc60 msgr2=0x7fefac1018e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefac0ffc60 0x7fefac1018e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 -- 172.21.15.6:0/1251704768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefac100620 msgr2=0x7fefac101e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefac100620 0x7fefac101e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 -- 172.21.15.6:0/1251704768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c0095f0 con 0x7fefac105c70 2023-09-13T09:37:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaa59c700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefac0ffc60 0x7fefac1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:37:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.574+0000 7fefaad9d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac1023a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefa4007ee0 tx=0x7fefa400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.575+0000 7fef9b7fe700 1 -- 172.21.15.6:0/1251704768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa400ddd0 con 0x7fefac105c70 2023-09-13T09:37:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.575+0000 7fef9b7fe700 1 -- 172.21.15.6:0/1251704768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fefa400f040 con 0x7fefac105c70 2023-09-13T09:37:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.575+0000 7fef9b7fe700 1 -- 172.21.15.6:0/1251704768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4015400 con 0x7fefac105c70 2023-09-13T09:37:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.575+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefac1a5820 con 0x7fefac105c70 2023-09-13T09:37:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.575+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefac1a5cd0 con 0x7fefac105c70 2023-09-13T09:37:31.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.576+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefac04e9b0 con 0x7fefac105c70 2023-09-13T09:37:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.577+0000 7fef9b7fe700 1 -- 172.21.15.6:0/1251704768 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fefa4004000 con 0x7fefac105c70 2023-09-13T09:37:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.577+0000 7fef9b7fe700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef940a06c0 0x7fef940a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.578+0000 7fef9b7fe700 1 -- 172.21.15.6:0/1251704768 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fefa40cb810 con 0x7fefac105c70 2023-09-13T09:37:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.578+0000 7fefaa59c700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef940a06c0 0x7fef940a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.578+0000 7fefaa59c700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef940a06c0 0x7fef940a2b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef9c006010 tx=0x7fef9c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.581+0000 7fef9b7fe700 1 -- 172.21.15.6:0/1251704768 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fefa40957e0 con 0x7fefac105c70 2023-09-13T09:37:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.794+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fefac102e10 con 0x7fefac105c70 2023-09-13T09:37:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.795+0000 7fef9b7fe700 1 -- 172.21.15.6:0/1251704768 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fefa4098e00 con 0x7fefac105c70 2023-09-13T09:37:31.796 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:31.797 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:37:27.977847+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef940a06c0 msgr2=0x7fef940a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef940a06c0 0x7fef940a2b80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fef9c006010 tx=0x7fef9c000bc0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 msgr2=0x7fefac1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:31.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac1023a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefa4007ee0 tx=0x7fefa400d3b0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 shutdown_connections 2023-09-13T09:37:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef940a06c0 0x7fef940a2b80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefac105c70 0x7fefac1023a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fefac0ffc60 0x7fefac1018e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 --2- 172.21.15.6:0/1251704768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fefac100620 0x7fefac101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 >> 172.21.15.6:0/1251704768 conn(0x7fefac075c00 msgr2=0x7fefac103a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 shutdown_connections 2023-09-13T09:37:31.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:31.797+0000 7fefb0e4d700 1 -- 172.21.15.6:0/1251704768 wait complete. 2023-09-13T09:37:32.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:31 smithi006 ceph-mon[98665]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:32.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:31 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1251704768' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:37:32.195 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:37:32.195 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd pool get .mgr pg_num 2023-09-13T09:37:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:31 smithi053 ceph-mon[102373]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:31 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1251704768' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:37:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:31 smithi131 ceph-mon[102785]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:31 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1251704768' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:37:32.754 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 -- 172.21.15.6:0/3419418023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40687a0 msgr2=0x7f27d4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 --2- 172.21.15.6:0/3419418023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40687a0 0x7f27d4068c20 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f27d00099c0 tx=0x7f27d0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 -- 172.21.15.6:0/3419418023 shutdown_connections 2023-09-13T09:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 --2- 172.21.15.6:0/3419418023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27d4069160 0x7f27d410dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 --2- 172.21.15.6:0/3419418023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d4106d90 0x7f27d4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 --2- 172.21.15.6:0/3419418023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d40687a0 0x7f27d4068c20 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 -- 172.21.15.6:0/3419418023 >> 172.21.15.6:0/3419418023 conn(0x7f27d4075c00 msgr2=0x7f27d4076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 -- 172.21.15.6:0/3419418023 shutdown_connections 2023-09-13T09:37:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.955+0000 7f27dbf94700 1 -- 172.21.15.6:0/3419418023 wait complete. 2023-09-13T09:37:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.956+0000 7f27dbf94700 1 Processor -- start 2023-09-13T09:37:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.956+0000 7f27dbf94700 1 -- start start 2023-09-13T09:37:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27dbf94700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d40687a0 0x7f27d419ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27dbf94700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27d4069160 0x7f27d419cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27dbf94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4106d90 0x7f27d4196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27dbf94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4197140 con 0x7f27d4106d90 2023-09-13T09:37:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27dbf94700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4197280 con 0x7f27d40687a0 2023-09-13T09:37:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27dbf94700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4197440 con 0x7f27d4069160 2023-09-13T09:37:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4106d90 0x7f27d4196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4106d90 0x7f27d4196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60062/0 (socket says 172.21.15.6:60062) 2023-09-13T09:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 -- 172.21.15.6:0/1930015245 learned_addr learned my addr 172.21.15.6:0/1930015245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27d9d30700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d40687a0 0x7f27d419ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27d952f700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27d4069160 0x7f27d419cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 -- 172.21.15.6:0/1930015245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27d4069160 msgr2=0x7f27d419cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27d4069160 0x7f27d419cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 -- 172.21.15.6:0/1930015245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d40687a0 msgr2=0x7f27d419ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d40687a0 0x7f27d419ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 -- 172.21.15.6:0/1930015245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00095f0 con 0x7f27d4106d90 2023-09-13T09:37:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27d952f700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27d4069160 0x7f27d419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27da531700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4106d90 0x7f27d4196ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27cc007d70 tx=0x7f27cc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27caffd700 1 -- 172.21.15.6:0/1930015245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc00ad40 con 0x7f27d4106d90 2023-09-13T09:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d4197720 con 0x7f27d4106d90 2023-09-13T09:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27caffd700 1 -- 172.21.15.6:0/1930015245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f27cc0128e0 con 0x7f27d4106d90 2023-09-13T09:37:33.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.957+0000 7f27caffd700 1 -- 172.21.15.6:0/1930015245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27cc0116b0 con 0x7f27d4106d90 2023-09-13T09:37:33.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.958+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d41a3aa0 con 0x7f27d4106d90 2023-09-13T09:37:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.958+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d404e9b0 con 0x7f27d4106d90 2023-09-13T09:37:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.959+0000 7f27caffd700 1 -- 172.21.15.6:0/1930015245 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f27cc012420 con 0x7f27d4106d90 2023-09-13T09:37:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.960+0000 7f27caffd700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f27c00a0640 0x7f27c00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.960+0000 7f27d9d30700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f27c00a0640 0x7f27c00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.960+0000 7f27caffd700 1 -- 172.21.15.6:0/1930015245 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f27cc0cb940 con 0x7f27d4106d90 2023-09-13T09:37:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.961+0000 7f27d9d30700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f27c00a0640 0x7f27c00a2b00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005950 tx=0x7f27c400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:33.965+0000 7f27caffd700 1 -- 172.21.15.6:0/1930015245 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f27cc095910 con 0x7f27d4106d90 2023-09-13T09:37:34.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:33 smithi006 ceph-mon[98665]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.166+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f27d4110e90 con 0x7f27d4106d90 2023-09-13T09:37:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.166+0000 7f27caffd700 1 -- 172.21.15.6:0/1930015245 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f27cc098f30 con 0x7f27d4106d90 2023-09-13T09:37:34.168 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:37:34.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f27c00a0640 msgr2=0x7f27c00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f27c00a0640 0x7f27c00a2b00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f27c4005950 tx=0x7f27c400b410 comp rx=0 tx=0).stop 2023-09-13T09:37:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4106d90 msgr2=0x7f27d4196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4106d90 0x7f27d4196ae0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f27cc007d70 tx=0x7f27cc00a340 comp rx=0 tx=0).stop 2023-09-13T09:37:34.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 shutdown_connections 2023-09-13T09:37:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f27c00a0640 0x7f27c00a2b00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27d4106d90 0x7f27d4196ae0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f27d40687a0 0x7f27d419ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.168+0000 7f27dbf94700 1 --2- 172.21.15.6:0/1930015245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27d4069160 0x7f27d419cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:34.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.169+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 >> 172.21.15.6:0/1930015245 conn(0x7f27d4075c00 msgr2=0x7f27d40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.169+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 shutdown_connections 2023-09-13T09:37:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:34.169+0000 7f27dbf94700 1 -- 172.21.15.6:0/1930015245 wait complete. 2023-09-13T09:37:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:33 smithi053 ceph-mon[102373]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:34.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:33 smithi131 ceph-mon[102785]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:34.518 INFO:tasks.cephadm:Adding mds.a on smithi006 2023-09-13T09:37:34.519 INFO:tasks.cephadm:Adding mds.d on smithi006 2023-09-13T09:37:34.519 INFO:tasks.cephadm:Adding mds.g on smithi006 2023-09-13T09:37:34.519 INFO:tasks.cephadm:Adding mds.j on smithi006 2023-09-13T09:37:34.520 INFO:tasks.cephadm:Adding mds.b on smithi053 2023-09-13T09:37:34.520 INFO:tasks.cephadm:Adding mds.e on smithi053 2023-09-13T09:37:34.520 INFO:tasks.cephadm:Adding mds.h on smithi053 2023-09-13T09:37:34.520 INFO:tasks.cephadm:Adding mds.k on smithi053 2023-09-13T09:37:34.521 INFO:tasks.cephadm:Adding mds.c on smithi131 2023-09-13T09:37:34.521 INFO:tasks.cephadm:Adding mds.f on smithi131 2023-09-13T09:37:34.521 INFO:tasks.cephadm:Adding mds.i on smithi131 2023-09-13T09:37:34.521 INFO:tasks.cephadm:Adding mds.l on smithi131 2023-09-13T09:37:34.522 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph orch apply mds all '12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l' 2023-09-13T09:37:35.088 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T09:37:35.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:35 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1930015245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:37:35.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:35 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1930015245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:37:35.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:35 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1930015245' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:37:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:36 smithi006 ceph-mon[98665]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:36 smithi053 ceph-mon[102373]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:36 smithi131 ceph-mon[102785]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 -- 172.21.15.131:0/641205619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 msgr2=0x7f8b8c1012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 --2- 172.21.15.131:0/641205619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c1012d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f8b80009990 tx=0x7f8b80009ca0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 -- 172.21.15.131:0/641205619 shutdown_connections 2023-09-13T09:37:36.389 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 --2- 172.21.15.131:0/641205619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c101810 0x7f8b8c1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.389 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 --2- 172.21.15.131:0/641205619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b8c0ffc70 0x7f8b8c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.389 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 --2- 172.21.15.131:0/641205619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c1012d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.389 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 -- 172.21.15.131:0/641205619 >> 172.21.15.131:0/641205619 conn(0x7f8b8c0fb1f0 msgr2=0x7f8b8c0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:36.389 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 -- 172.21.15.131:0/641205619 shutdown_connections 2023-09-13T09:37:36.390 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 -- 172.21.15.131:0/641205619 wait complete. 2023-09-13T09:37:36.390 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.387+0000 7f8b912f3700 1 Processor -- start 2023-09-13T09:37:36.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 -- start start 2023-09-13T09:37:36.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b8c0ffc70 0x7f8b8c069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:36.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c19b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:36.392 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c101810 0x7f8b8c19de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c19e5e0 con 0x7f8b8c101810 2023-09-13T09:37:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c19e750 con 0x7f8b8c0ffc70 2023-09-13T09:37:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c19e910 con 0x7f8b8c100e70 2023-09-13T09:37:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c19b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c19b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:34008/0 (socket says 172.21.15.131:34008) 2023-09-13T09:37:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 -- 172.21.15.131:0/1202019846 learned_addr learned my addr 172.21.15.131:0/1202019846 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-09-13T09:37:36.395 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8affd700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b8c0ffc70 0x7f8b8c069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:36.395 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 -- 172.21.15.131:0/1202019846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b8c0ffc70 msgr2=0x7f8b8c069bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:36.395 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b8c0ffc70 0x7f8b8c069bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.395 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 -- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c101810 msgr2=0x7f8b8c19de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c101810 0x7f8b8c19de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 -- 172.21.15.131:0/1202019846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800095f0 con 0x7f8b8c100e70 2023-09-13T09:37:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b8a7fc700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c19b7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b800036f0 tx=0x7f8b8000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b73fff700 1 -- 172.21.15.131:0/1202019846 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b8001d070 con 0x7f8b8c100e70 2023-09-13T09:37:36.396 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c19eb90 con 0x7f8b8c100e70 2023-09-13T09:37:36.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b73fff700 1 -- 172.21.15.131:0/1202019846 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8b80003e20 con 0x7f8b8c100e70 2023-09-13T09:37:36.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.388+0000 7f8b73fff700 1 -- 172.21.15.131:0/1202019846 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b800173f0 con 0x7f8b8c100e70 2023-09-13T09:37:36.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.389+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c19f080 con 0x7f8b8c100e70 2023-09-13T09:37:36.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.389+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c1072c0 con 0x7f8b8c100e70 2023-09-13T09:37:36.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.390+0000 7f8b73fff700 1 -- 172.21.15.131:0/1202019846 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8b80003960 con 0x7f8b8c100e70 2023-09-13T09:37:36.397 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.391+0000 7f8b73fff700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8b740a0640 0x7f8b740a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:36.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.391+0000 7f8b73fff700 1 -- 172.21.15.131:0/1202019846 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8b800ccc40 con 0x7f8b8c100e70 2023-09-13T09:37:36.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.391+0000 7f8b8affd700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8b740a0640 0x7f8b740a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:36.398 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.392+0000 7f8b8affd700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8b740a0640 0x7f8b740a2b00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c005950 tx=0x7f8b7c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:36.399 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.395+0000 7f8b73fff700 1 -- 172.21.15.131:0/1202019846 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8b80096d20 con 0x7f8b8c100e70 2023-09-13T09:37:36.591 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.590+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b8c02d100 con 0x7f8b740a0640 2023-09-13T09:37:36.600 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.599+0000 7f8b73fff700 1 -- 172.21.15.131:0/1202019846 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f8b8c02d100 con 0x7f8b740a0640 2023-09-13T09:37:36.600 INFO:teuthology.orchestra.run.smithi131.stdout:Scheduled mds.all update... 2023-09-13T09:37:36.602 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8b740a0640 msgr2=0x7f8b740a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:36.602 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8b740a0640 0x7f8b740a2b00 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c005950 tx=0x7f8b7c0058e0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.602 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 msgr2=0x7f8b8c19b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:36.603 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c19b7f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8b800036f0 tx=0x7f8b8000f690 comp rx=0 tx=0).stop 2023-09-13T09:37:36.603 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 shutdown_connections 2023-09-13T09:37:36.603 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8b740a0640 0x7f8b740a2b00 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.603 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b8c101810 0x7f8b8c19de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.603 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b8c0ffc70 0x7f8b8c069bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.603 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 --2- 172.21.15.131:0/1202019846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b8c100e70 0x7f8b8c19b7f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:36.604 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 >> 172.21.15.131:0/1202019846 conn(0x7f8b8c0fb1f0 msgr2=0x7f8b8c104400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:36.604 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 shutdown_connections 2023-09-13T09:37:36.604 INFO:teuthology.orchestra.run.smithi131.stderr:2023-09-13T09:37:36.601+0000 7f8b912f3700 1 -- 172.21.15.131:0/1202019846 wait complete. 2023-09-13T09:37:37.136 DEBUG:teuthology.orchestra.run.smithi006:mds.a> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.a.service 2023-09-13T09:37:37.139 DEBUG:teuthology.orchestra.run.smithi006:mds.d> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.d.service 2023-09-13T09:37:37.178 INFO:journalctl@ceph.mds.a.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:37:37.179 DEBUG:teuthology.orchestra.run.smithi006:mds.g> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.g.service 2023-09-13T09:37:37.209 INFO:journalctl@ceph.mds.d.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:37:37.210 DEBUG:teuthology.orchestra.run.smithi006:mds.j> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.j.service 2023-09-13T09:37:37.238 INFO:journalctl@ceph.mds.g.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:37:37.239 DEBUG:teuthology.orchestra.run.smithi053:mds.b> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.b.service 2023-09-13T09:37:37.242 DEBUG:teuthology.orchestra.run.smithi053:mds.e> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.e.service 2023-09-13T09:37:37.267 INFO:journalctl@ceph.mds.j.smithi006.stdout:-- Logs begin at Wed 2023-09-13 09:16:55 UTC. -- 2023-09-13T09:37:37.280 INFO:journalctl@ceph.mds.b.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:37:37.281 DEBUG:teuthology.orchestra.run.smithi053:mds.h> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.h.service 2023-09-13T09:37:37.312 INFO:journalctl@ceph.mds.e.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:37:37.313 DEBUG:teuthology.orchestra.run.smithi053:mds.k> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.k.service 2023-09-13T09:37:37.341 INFO:journalctl@ceph.mds.h.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:37:37.342 DEBUG:teuthology.orchestra.run.smithi131:mds.c> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.c.service 2023-09-13T09:37:37.345 DEBUG:teuthology.orchestra.run.smithi131:mds.f> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.f.service 2023-09-13T09:37:37.370 INFO:journalctl@ceph.mds.k.smithi053.stdout:-- Logs begin at Wed 2023-09-13 09:16:54 UTC. -- 2023-09-13T09:37:37.374 INFO:journalctl@ceph.mds.c.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:37:37.376 DEBUG:teuthology.orchestra.run.smithi131:mds.i> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.i.service 2023-09-13T09:37:37.401 INFO:journalctl@ceph.mds.f.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:37:37.402 DEBUG:teuthology.orchestra.run.smithi131:mds.l> sudo journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.l.service 2023-09-13T09:37:37.427 INFO:journalctl@ceph.mds.i.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:37:37.431 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-09-13T09:37:37.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:37:37.453 INFO:journalctl@ceph.mds.l.smithi131.stdout:-- Logs begin at Wed 2023-09-13 09:17:02 UTC. -- 2023-09-13T09:37:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 -- 172.21.15.6:0/3618640960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488101fa0 msgr2=0x7f4488102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 --2- 172.21.15.6:0/3618640960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488101fa0 0x7f4488102400 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f44700099c0 tx=0x7f4470009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 -- 172.21.15.6:0/3618640960 shutdown_connections 2023-09-13T09:37:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 --2- 172.21.15.6:0/3618640960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4488102940 0x7f44881091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 --2- 172.21.15.6:0/3618640960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4488100db0 0x7f44881011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 --2- 172.21.15.6:0/3618640960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488101fa0 0x7f4488102400 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 -- 172.21.15.6:0/3618640960 >> 172.21.15.6:0/3618640960 conn(0x7f44880fc320 msgr2=0x7f44880fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 -- 172.21.15.6:0/3618640960 shutdown_connections 2023-09-13T09:37:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.574+0000 7f448dbe8700 1 -- 172.21.15.6:0/3618640960 wait complete. 2023-09-13T09:37:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 Processor -- start 2023-09-13T09:37:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 -- start start 2023-09-13T09:37:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4488100db0 0x7f4488074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4488101fa0 0x7f44880730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488102940 0x7f44880735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4488073d80 con 0x7f4488102940 2023-09-13T09:37:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4488073ef0 con 0x7f4488100db0 2023-09-13T09:37:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f448dbe8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44881a0a70 con 0x7f4488101fa0 2023-09-13T09:37:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.575+0000 7f4487fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488102940 0x7f44880735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488102940 0x7f44880735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60074/0 (socket says 172.21.15.6:60074) 2023-09-13T09:37:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 -- 172.21.15.6:0/4247150791 learned_addr learned my addr 172.21.15.6:0/4247150791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f44877fe700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4488100db0 0x7f4488074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4486ffd700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4488101fa0 0x7f44880730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 -- 172.21.15.6:0/4247150791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4488101fa0 msgr2=0x7f44880730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4488101fa0 0x7f44880730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 -- 172.21.15.6:0/4247150791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4488100db0 msgr2=0x7f4488074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4488100db0 0x7f4488074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 -- 172.21.15.6:0/4247150791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44700095f0 con 0x7f4488102940 2023-09-13T09:37:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f44877fe700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4488100db0 0x7f4488074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:37:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4486ffd700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4488101fa0 0x7f44880730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:37:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4487fff700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488102940 0x7f44880735e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f447800c900 tx=0x7f447800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4484ff9700 1 -- 172.21.15.6:0/4247150791 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478007b00 con 0x7f4488102940 2023-09-13T09:37:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4484ff9700 1 -- 172.21.15.6:0/4247150791 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4478007c60 con 0x7f4488102940 2023-09-13T09:37:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44881a0d50 con 0x7f4488102940 2023-09-13T09:37:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f4484ff9700 1 -- 172.21.15.6:0/4247150791 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4478018660 con 0x7f4488102940 2023-09-13T09:37:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.576+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44881a1200 con 0x7f4488102940 2023-09-13T09:37:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.577+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4488108340 con 0x7f4488102940 2023-09-13T09:37:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.578+0000 7f4484ff9700 1 -- 172.21.15.6:0/4247150791 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f447800f450 con 0x7f4488102940 2023-09-13T09:37:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.579+0000 7f4484ff9700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f44740a06c0 0x7f44740a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.579+0000 7f4484ff9700 1 -- 172.21.15.6:0/4247150791 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f44780cb750 con 0x7f4488102940 2023-09-13T09:37:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.579+0000 7f44877fe700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f44740a06c0 0x7f44740a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.579+0000 7f44877fe700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f44740a06c0 0x7f44740a2b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4488101e00 tx=0x7f4480009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:37.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.582+0000 7f4484ff9700 1 -- 172.21.15.6:0/4247150791 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4478095700 con 0x7f4488102940 2023-09-13T09:37:37.663 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:37.663 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:37:37.663 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l;count:12 2023-09-13T09:37:37.664 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:37.664 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:37.664 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:37.664 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:37.664 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:37.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:37.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:37.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:37.665 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:37 smithi131 ceph-mon[102785]: Deploying daemon mds.l on smithi131 2023-09-13T09:37:37.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:37.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:37:37.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l;count:12 2023-09-13T09:37:37.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:37.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:37.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:37.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:37.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:37.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:37.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:37.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:37.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:37 smithi006 ceph-mon[98665]: Deploying daemon mds.l on smithi131 2023-09-13T09:37:37.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.786+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f448810c810 con 0x7f4488102940 2023-09-13T09:37:37.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.787+0000 7f4484ff9700 1 -- 172.21.15.6:0/4247150791 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18304 (secure 0 0 0) 0x7f4478098d20 con 0x7f4488102940 2023-09-13T09:37:37.788 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:37.788 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:37:27.977847+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:37:37.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f44740a06c0 msgr2=0x7f44740a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f44740a06c0 0x7f44740a2b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4488101e00 tx=0x7f4480009040 comp rx=0 tx=0).stop 2023-09-13T09:37:37.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488102940 msgr2=0x7f44880735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488102940 0x7f44880735e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f447800c900 tx=0x7f447800ccc0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 shutdown_connections 2023-09-13T09:37:37.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f44740a06c0 0x7f44740a2b80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4488102940 0x7f44880735e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4488100db0 0x7f4488074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 --2- 172.21.15.6:0/4247150791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4488101fa0 0x7f44880730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 >> 172.21.15.6:0/4247150791 conn(0x7f44880fc320 msgr2=0x7f4488105480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:37.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 shutdown_connections 2023-09-13T09:37:37.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.789+0000 7f448dbe8700 1 -- 172.21.15.6:0/4247150791 wait complete. 2023-09-13T09:37:37.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:37:37.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:37:37.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 -- 172.21.15.6:0/1502902343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c101860 msgr2=0x7fd45c103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 --2- 172.21.15.6:0/1502902343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c101860 0x7fd45c103c50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd450009990 tx=0x7fd450009ca0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 -- 172.21.15.6:0/1502902343 shutdown_connections 2023-09-13T09:37:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 --2- 172.21.15.6:0/1502902343 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c106ba0 0x7fd45c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 --2- 172.21.15.6:0/1502902343 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c101860 0x7fd45c103c50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 --2- 172.21.15.6:0/1502902343 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd45c104190 0x7fd45c106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 -- 172.21.15.6:0/1502902343 >> 172.21.15.6:0/1502902343 conn(0x7fd45c0fb250 msgr2=0x7fd45c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 -- 172.21.15.6:0/1502902343 shutdown_connections 2023-09-13T09:37:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.931+0000 7fd46318e700 1 -- 172.21.15.6:0/1502902343 wait complete. 2023-09-13T09:37:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 Processor -- start 2023-09-13T09:37:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 -- start start 2023-09-13T09:37:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c101860 0x7fd45c1011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd45c104190 0x7fd45c0ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c106ba0 0x7fd45c0ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1004f0 con 0x7fd45c106ba0 2023-09-13T09:37:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c100660 con 0x7fd45c101860 2023-09-13T09:37:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46318e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd45c1a0ce0 con 0x7fd45c104190 2023-09-13T09:37:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c106ba0 0x7fd45c0ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd460f2a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c101860 0x7fd45c1011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c106ba0 0x7fd45c0ffd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60088/0 (socket says 172.21.15.6:60088) 2023-09-13T09:37:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 -- 172.21.15.6:0/3814157547 learned_addr learned my addr 172.21.15.6:0/3814157547 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd45bfff700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd45c104190 0x7fd45c0ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 -- 172.21.15.6:0/3814157547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd45c104190 msgr2=0x7fd45c0ff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd45c104190 0x7fd45c0ff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 -- 172.21.15.6:0/3814157547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c101860 msgr2=0x7fd45c1011d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c101860 0x7fd45c1011d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.932+0000 7fd46172b700 1 -- 172.21.15.6:0/3814157547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4500095f0 con 0x7fd45c106ba0 2023-09-13T09:37:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.933+0000 7fd46172b700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c106ba0 0x7fd45c0ffd50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd45400ada0 tx=0x7fd45400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.933+0000 7fd459ffb700 1 -- 172.21.15.6:0/3814157547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45400f070 con 0x7fd45c106ba0 2023-09-13T09:37:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.933+0000 7fd459ffb700 1 -- 172.21.15.6:0/3814157547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd454007b30 con 0x7fd45c106ba0 2023-09-13T09:37:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.933+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd45c1a0fc0 con 0x7fd45c106ba0 2023-09-13T09:37:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.933+0000 7fd459ffb700 1 -- 172.21.15.6:0/3814157547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4540053e0 con 0x7fd45c106ba0 2023-09-13T09:37:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.933+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45c1a1440 con 0x7fd45c106ba0 2023-09-13T09:37:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.934+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45c0fcdd0 con 0x7fd45c106ba0 2023-09-13T09:37:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.935+0000 7fd459ffb700 1 -- 172.21.15.6:0/3814157547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd45400c980 con 0x7fd45c106ba0 2023-09-13T09:37:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.936+0000 7fd459ffb700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd44c0a06c0 0x7fd44c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.936+0000 7fd460f2a700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd44c0a06c0 0x7fd44c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.936+0000 7fd459ffb700 1 -- 172.21.15.6:0/3814157547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd4540cacf0 con 0x7fd45c106ba0 2023-09-13T09:37:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.936+0000 7fd460f2a700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd44c0a06c0 0x7fd44c0a2b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd45000b5c0 tx=0x7fd450005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:37.940+0000 7fd459ffb700 1 -- 172.21.15.6:0/3814157547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd454094cb0 con 0x7fd45c106ba0 2023-09-13T09:37:38.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:38.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:37:38.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: Saving service mds.all spec with placement smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l;count:12 2023-09-13T09:37:38.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:38.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:37:38.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:38.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:37:38.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:38.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:38.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:38.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:38.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:37 smithi053 ceph-mon[102373]: Deploying daemon mds.l on smithi131 2023-09-13T09:37:38.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.141+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd45c02ce70 con 0x7fd45c106ba0 2023-09-13T09:37:38.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.142+0000 7fd459ffb700 1 -- 172.21.15.6:0/3814157547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd4540982d0 con 0x7fd45c106ba0 2023-09-13T09:37:38.143 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:37:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd44c0a06c0 msgr2=0x7fd44c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd44c0a06c0 0x7fd44c0a2b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fd45000b5c0 tx=0x7fd450005fb0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c106ba0 msgr2=0x7fd45c0ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:38.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c106ba0 0x7fd45c0ffd50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd45400ada0 tx=0x7fd45400c330 comp rx=0 tx=0).stop 2023-09-13T09:37:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 shutdown_connections 2023-09-13T09:37:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd44c0a06c0 0x7fd44c0a2b80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd45c106ba0 0x7fd45c0ffd50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd45c101860 0x7fd45c1011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 --2- 172.21.15.6:0/3814157547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd45c104190 0x7fd45c0ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 >> 172.21.15.6:0/3814157547 conn(0x7fd45c0fb250 msgr2=0x7fd45c1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 shutdown_connections 2023-09-13T09:37:38.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.144+0000 7fd46318e700 1 -- 172.21.15.6:0/3814157547 wait complete. 2023-09-13T09:37:38.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:38.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 -- 172.21.15.6:0/2166364316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 msgr2=0x7f8a941000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 --2- 172.21.15.6:0/2166364316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a941000b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a840099c0 tx=0x7f8a84009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 -- 172.21.15.6:0/2166364316 shutdown_connections 2023-09-13T09:37:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 --2- 172.21.15.6:0/2166364316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a94101820 0x7f8a941080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 --2- 172.21.15.6:0/2166364316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a941000b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 --2- 172.21.15.6:0/2166364316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a94100e80 0x7f8a941012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 -- 172.21.15.6:0/2166364316 >> 172.21.15.6:0/2166364316 conn(0x7f8a940fb220 msgr2=0x7f8a940fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 -- 172.21.15.6:0/2166364316 shutdown_connections 2023-09-13T09:37:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.282+0000 7f8a99633700 1 -- 172.21.15.6:0/2166364316 wait complete. 2023-09-13T09:37:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 Processor -- start 2023-09-13T09:37:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 -- start start 2023-09-13T09:37:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a94068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a94100e80 0x7f8a9419b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:38.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a94101820 0x7f8a9419de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9419e630 con 0x7f8a940ffc90 2023-09-13T09:37:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9419e7a0 con 0x7f8a94101820 2023-09-13T09:37:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a99633700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a9419e960 con 0x7f8a94100e80 2023-09-13T09:37:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a94068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:38.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a92ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a94068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60098/0 (socket says 172.21.15.6:60098) 2023-09-13T09:37:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a92ffd700 1 -- 172.21.15.6:0/3637333768 learned_addr learned my addr 172.21.15.6:0/3637333768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a927fc700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a94100e80 0x7f8a9419b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a937fe700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a94101820 0x7f8a9419de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.283+0000 7f8a92ffd700 1 -- 172.21.15.6:0/3637333768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a94100e80 msgr2=0x7f8a9419b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:38.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a92ffd700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a94100e80 0x7f8a9419b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a92ffd700 1 -- 172.21.15.6:0/3637333768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a94101820 msgr2=0x7f8a9419de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a92ffd700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a94101820 0x7f8a9419de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a92ffd700 1 -- 172.21.15.6:0/3637333768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a840095f0 con 0x7f8a940ffc90 2023-09-13T09:37:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a937fe700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a94101820 0x7f8a9419de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:37:38.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a92ffd700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a94068b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009fd0 tx=0x7f8a8400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a7bfff700 1 -- 172.21.15.6:0/3637333768 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a8401d070 con 0x7f8a940ffc90 2023-09-13T09:37:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a7bfff700 1 -- 172.21.15.6:0/3637333768 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a840054f0 con 0x7f8a940ffc90 2023-09-13T09:37:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9419ebe0 con 0x7f8a940ffc90 2023-09-13T09:37:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a7bfff700 1 -- 172.21.15.6:0/3637333768 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84004bd0 con 0x7f8a940ffc90 2023-09-13T09:37:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.284+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9419f060 con 0x7f8a940ffc90 2023-09-13T09:37:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.285+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a94106c10 con 0x7f8a940ffc90 2023-09-13T09:37:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.286+0000 7f8a7bfff700 1 -- 172.21.15.6:0/3637333768 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8a8400fb80 con 0x7f8a940ffc90 2023-09-13T09:37:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.287+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a7c0a06c0 0x7f8a7c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.287+0000 7f8a927fc700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a7c0a06c0 0x7f8a7c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.287+0000 7f8a7bfff700 1 -- 172.21.15.6:0/3637333768 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8a840cc5f0 con 0x7f8a940ffc90 2023-09-13T09:37:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.287+0000 7f8a927fc700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a7c0a06c0 0x7f8a7c0a2b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a940688b0 tx=0x7f8a88009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.291+0000 7f8a7bfff700 1 -- 172.21.15.6:0/3637333768 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8a840965b0 con 0x7f8a940ffc90 2023-09-13T09:37:38.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.539+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a9410b520 con 0x7f8a940ffc90 2023-09-13T09:37:38.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.540+0000 7f8a7bfff700 1 -- 172.21.15.6:0/3637333768 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f8a84099bd0 con 0x7f8a940ffc90 2023-09-13T09:37:38.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:38.541 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-09-13T09:37:38.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a7c0a06c0 msgr2=0x7f8a7c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a7c0a06c0 0x7f8a7c0a2b80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f8a940688b0 tx=0x7f8a88009190 comp rx=0 tx=0).stop 2023-09-13T09:37:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 msgr2=0x7f8a94068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a94068b40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f8a84009fd0 tx=0x7f8a8400f690 comp rx=0 tx=0).stop 2023-09-13T09:37:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 shutdown_connections 2023-09-13T09:37:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a94101820 0x7f8a9419de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a7c0a06c0 0x7f8a7c0a2b80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a940ffc90 0x7f8a94068b40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 --2- 172.21.15.6:0/3637333768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a94100e80 0x7f8a9419b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 >> 172.21.15.6:0/3637333768 conn(0x7f8a940fb220 msgr2=0x7f8a940fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 shutdown_connections 2023-09-13T09:37:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:38.542+0000 7f8a99633700 1 -- 172.21.15.6:0/3637333768 wait complete. 2023-09-13T09:37:38.547 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 1 2023-09-13T09:37:38.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:38 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4247150791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:37:38.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:38 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3814157547' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:37:38.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:38 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3637333768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:38.770 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 09:37:38 smithi131 systemd[1]: Starting Ceph mds.l for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:39.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:38 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4247150791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:37:39.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:38 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3814157547' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:37:39.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:38 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3637333768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:39.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:38 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4247150791' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:37:39.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:38 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3814157547' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:37:39.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:38 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3637333768' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:39.095 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 09:37:38 smithi131 podman[140282]: 2023-09-13T09:37:39.518 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mds[140322]: -- 172.21.15.131:0/1202260639 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555b5bf791e0 con 0x555b5bf4e800 2023-09-13T09:37:39.519 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-l[140298]: starting mds.l at 2023-09-13T09:37:39.519 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 09:37:39 smithi131 bash[140282]: e62586f83c18b1461b583803d6b0fbec048eff4b4591e98595bcd527f96fa8d6 2023-09-13T09:37:39.519 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 09:37:39 smithi131 systemd[1]: Started Ceph mds.l for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:39.880 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:39.880 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6832/4209861668,v1:172.21.15.131:6833/4209861668] up:boot 2023-09-13T09:37:39.880 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: fsmap 1 up:standby 2023-09-13T09:37:39.881 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-13T09:37:39.881 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:39.881 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:39.881 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:39.881 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:39.882 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:39.882 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:40.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:40.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6832/4209861668,v1:172.21.15.131:6833/4209861668] up:boot 2023-09-13T09:37:40.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: fsmap 1 up:standby 2023-09-13T09:37:40.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-13T09:37:40.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:40.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:40.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:40.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:40.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:40.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6832/4209861668,v1:172.21.15.131:6833/4209861668] up:boot 2023-09-13T09:37:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: fsmap 1 up:standby 2023-09-13T09:37:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-13T09:37:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:40.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:40.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:40.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:40.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:40.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:40.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 -- 172.21.15.6:0/3682154908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64106af0 msgr2=0x7fca64108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 --2- 172.21.15.6:0/3682154908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64106af0 0x7fca64108ee0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fca5c00b0a0 tx=0x7fca5c00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 -- 172.21.15.6:0/3682154908 shutdown_connections 2023-09-13T09:37:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 --2- 172.21.15.6:0/3682154908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64106af0 0x7fca64108ee0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 --2- 172.21.15.6:0/3682154908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca64101890 0x7fca64103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 --2- 172.21.15.6:0/3682154908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca641041c0 0x7fca641065b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 -- 172.21.15.6:0/3682154908 >> 172.21.15.6:0/3682154908 conn(0x7fca640fb220 msgr2=0x7fca640fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.696+0000 7fca6a41c700 1 -- 172.21.15.6:0/3682154908 shutdown_connections 2023-09-13T09:37:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.697+0000 7fca6a41c700 1 -- 172.21.15.6:0/3682154908 wait complete. 2023-09-13T09:37:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.697+0000 7fca6a41c700 1 Processor -- start 2023-09-13T09:37:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.697+0000 7fca6a41c700 1 -- start start 2023-09-13T09:37:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.697+0000 7fca6a41c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64101890 0x7fca64101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.697+0000 7fca6a41c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca641041c0 0x7fca640ff840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca6a41c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca64106af0 0x7fca640ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca6a41c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca64100520 con 0x7fca64101890 2023-09-13T09:37:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca6a41c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca64100690 con 0x7fca64106af0 2023-09-13T09:37:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca6a41c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca641a0b90 con 0x7fca641041c0 2023-09-13T09:37:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64101890 0x7fca64101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64101890 0x7fca64101200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60110/0 (socket says 172.21.15.6:60110) 2023-09-13T09:37:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 -- 172.21.15.6:0/686559948 learned_addr learned my addr 172.21.15.6:0/686559948 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca689b9700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca64106af0 0x7fca640ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca637fe700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca641041c0 0x7fca640ff840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 -- 172.21.15.6:0/686559948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca641041c0 msgr2=0x7fca640ff840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca641041c0 0x7fca640ff840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 -- 172.21.15.6:0/686559948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca64106af0 msgr2=0x7fca640ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca64106af0 0x7fca640ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 -- 172.21.15.6:0/686559948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5c009d00 con 0x7fca64101890 2023-09-13T09:37:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca63fff700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64101890 0x7fca64101200 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca5400e9a0 tx=0x7fca5400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca617fa700 1 -- 172.21.15.6:0/686559948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54009790 con 0x7fca64101890 2023-09-13T09:37:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca617fa700 1 -- 172.21.15.6:0/686559948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca54010430 con 0x7fca64101890 2023-09-13T09:37:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca641a0e70 con 0x7fca64101890 2023-09-13T09:37:40.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca617fa700 1 -- 172.21.15.6:0/686559948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca54018680 con 0x7fca64101890 2023-09-13T09:37:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.698+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca641a12f0 con 0x7fca64101890 2023-09-13T09:37:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.699+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca640fcda0 con 0x7fca64101890 2023-09-13T09:37:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.701+0000 7fca617fa700 1 -- 172.21.15.6:0/686559948 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fca540105a0 con 0x7fca64101890 2023-09-13T09:37:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.701+0000 7fca617fa700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca4c0a06c0 0x7fca4c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:40.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.701+0000 7fca637fe700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca4c0a06c0 0x7fca4c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.701+0000 7fca617fa700 1 -- 172.21.15.6:0/686559948 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fca54014070 con 0x7fca64101890 2023-09-13T09:37:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.702+0000 7fca637fe700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca4c0a06c0 0x7fca4c0a2b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca58005950 tx=0x7fca5800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:40.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.705+0000 7fca617fa700 1 -- 172.21.15.6:0/686559948 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fca54095a30 con 0x7fca64101890 2023-09-13T09:37:40.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:40 smithi053 ceph-mon[102373]: Deploying daemon mds.k on smithi053 2023-09-13T09:37:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.949+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fca6410c7c0 con 0x7fca64101890 2023-09-13T09:37:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.949+0000 7fca617fa700 1 -- 172.21.15.6:0/686559948 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1328 (secure 0 0 0) 0x7fca54026540 con 0x7fca64101890 2023-09-13T09:37:40.951 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:40.951 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-13T09:37:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca4c0a06c0 msgr2=0x7fca4c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca4c0a06c0 0x7fca4c0a2b80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fca58005950 tx=0x7fca5800b410 comp rx=0 tx=0).stop 2023-09-13T09:37:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64101890 msgr2=0x7fca64101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64101890 0x7fca64101200 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca5400e9a0 tx=0x7fca5400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 shutdown_connections 2023-09-13T09:37:40.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca64106af0 0x7fca640ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca4c0a06c0 0x7fca4c0a2b80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca64101890 0x7fca64101200 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 --2- 172.21.15.6:0/686559948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca641041c0 0x7fca640ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 >> 172.21.15.6:0/686559948 conn(0x7fca640fb220 msgr2=0x7fca64102500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 shutdown_connections 2023-09-13T09:37:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:40.951+0000 7fca6a41c700 1 -- 172.21.15.6:0/686559948 wait complete. 2023-09-13T09:37:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2023-09-13T09:37:40.963 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:40 smithi006 ceph-mon[98665]: Deploying daemon mds.k on smithi053 2023-09-13T09:37:41.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:40 smithi131 ceph-mon[102785]: Deploying daemon mds.k on smithi053 2023-09-13T09:37:41.052 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 09:37:40 smithi053 systemd[1]: Starting Ceph mds.k for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:41.305 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 09:37:41 smithi053 podman[138727]: 2023-09-13T09:37:41.612 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 09:37:41 smithi053 bash[138727]: dbac5a5428cec393dd5dc048f077c0de0309d1544d9c3ff7ae956d18d57d9030 2023-09-13T09:37:41.612 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mds[138767]: -- 172.21.15.53:0/59700609 <== mon.2 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d705bf11e0 con 0x55d705bc7000 2023-09-13T09:37:41.612 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-k[138743]: starting mds.k at 2023-09-13T09:37:41.612 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 09:37:41 smithi053 systemd[1]: Started Ceph mds.k for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:42.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:42.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/686559948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:42.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:42.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:42.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:42.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:42.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/686559948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:42.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:42.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:42.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:42.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/686559948' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:42.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:42.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:42.687 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:42 smithi006 ceph-mon[98665]: Deploying daemon mds.j on smithi006 2023-09-13T09:37:42.688 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:42 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6832/162812581,v1:172.21.15.53:6833/162812581] up:boot 2023-09-13T09:37:42.688 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:42 smithi006 ceph-mon[98665]: fsmap 2 up:standby 2023-09-13T09:37:42.688 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:42 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-13T09:37:42.938 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 09:37:42 smithi006 systemd[1]: Starting Ceph mds.j for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:42.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:43.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:42 smithi053 ceph-mon[102373]: Deploying daemon mds.j on smithi006 2023-09-13T09:37:43.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:42 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6832/162812581,v1:172.21.15.53:6833/162812581] up:boot 2023-09-13T09:37:43.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:42 smithi053 ceph-mon[102373]: fsmap 2 up:standby 2023-09-13T09:37:43.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:42 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-13T09:37:43.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:42 smithi131 ceph-mon[102785]: Deploying daemon mds.j on smithi006 2023-09-13T09:37:43.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:42 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6832/162812581,v1:172.21.15.53:6833/162812581] up:boot 2023-09-13T09:37:43.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:42 smithi131 ceph-mon[102785]: fsmap 2 up:standby 2023-09-13T09:37:43.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:42 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-13T09:37:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 -- 172.21.15.6:0/2652091883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd40ff7e0 msgr2=0x7effd40ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 --2- 172.21.15.6:0/2652091883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd40ff7e0 0x7effd40ffc90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7effcc00b0a0 tx=0x7effcc00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 -- 172.21.15.6:0/2652091883 shutdown_connections 2023-09-13T09:37:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 --2- 172.21.15.6:0/2652091883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd40ff7e0 0x7effd40ffc90 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 --2- 172.21.15.6:0/2652091883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effd4101250 0x7effd4101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 --2- 172.21.15.6:0/2652091883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40fee20 0x7effd40ff2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 -- 172.21.15.6:0/2652091883 >> 172.21.15.6:0/2652091883 conn(0x7effd40fa990 msgr2=0x7effd40fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 -- 172.21.15.6:0/2652091883 shutdown_connections 2023-09-13T09:37:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.108+0000 7effda097700 1 -- 172.21.15.6:0/2652091883 wait complete. 2023-09-13T09:37:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.109+0000 7effda097700 1 Processor -- start 2023-09-13T09:37:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.109+0000 7effda097700 1 -- start start 2023-09-13T09:37:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effda097700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40fee20 0x7effd4198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effda097700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effd40ff7e0 0x7effd4199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effda097700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd4101250 0x7effd41a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effda097700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd41a08c0 con 0x7effd4101250 2023-09-13T09:37:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effda097700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd41a0a00 con 0x7effd40ff7e0 2023-09-13T09:37:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effda097700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd41a0b90 con 0x7effd40fee20 2023-09-13T09:37:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd4101250 0x7effd41a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd4101250 0x7effd41a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60126/0 (socket says 172.21.15.6:60126) 2023-09-13T09:37:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 -- 172.21.15.6:0/881341454 learned_addr learned my addr 172.21.15.6:0/881341454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd37fe700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40fee20 0x7effd4198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd2ffd700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effd40ff7e0 0x7effd4199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 -- 172.21.15.6:0/881341454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40fee20 msgr2=0x7effd4198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40fee20 0x7effd4198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 -- 172.21.15.6:0/881341454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effd40ff7e0 msgr2=0x7effd4199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effd40ff7e0 0x7effd4199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 -- 172.21.15.6:0/881341454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc009d00 con 0x7effd4101250 2023-09-13T09:37:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd3fff700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd4101250 0x7effd41a02f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effcc0062a0 tx=0x7effcc004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd0ff9700 1 -- 172.21.15.6:0/881341454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc00e040 con 0x7effd4101250 2023-09-13T09:37:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.110+0000 7effd0ff9700 1 -- 172.21.15.6:0/881341454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7effcc01db50 con 0x7effd4101250 2023-09-13T09:37:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.111+0000 7effda097700 1 -- 172.21.15.6:0/881341454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd41a0e10 con 0x7effd4101250 2023-09-13T09:37:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.111+0000 7effd0ff9700 1 -- 172.21.15.6:0/881341454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effcc01bc40 con 0x7effd4101250 2023-09-13T09:37:43.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.111+0000 7effda097700 1 -- 172.21.15.6:0/881341454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd41a1280 con 0x7effd4101250 2023-09-13T09:37:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.112+0000 7effda097700 1 -- 172.21.15.6:0/881341454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd410ac80 con 0x7effd4101250 2023-09-13T09:37:43.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.113+0000 7effd0ff9700 1 -- 172.21.15.6:0/881341454 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7effcc01d690 con 0x7effd4101250 2023-09-13T09:37:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.114+0000 7effd0ff9700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7effbc0a06c0 0x7effbc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.114+0000 7effd0ff9700 1 -- 172.21.15.6:0/881341454 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7effcc0cd9f0 con 0x7effd4101250 2023-09-13T09:37:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.114+0000 7effd37fe700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7effbc0a06c0 0x7effbc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:43.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.115+0000 7effd37fe700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7effbc0a06c0 0x7effbc0a2b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7effd4067aa0 tx=0x7effc400bef0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.118+0000 7effd0ff9700 1 -- 172.21.15.6:0/881341454 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7effcc097a50 con 0x7effd4101250 2023-09-13T09:37:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.381+0000 7effda097700 1 -- 172.21.15.6:0/881341454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7effd410ea00 con 0x7effd4101250 2023-09-13T09:37:43.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.382+0000 7effd0ff9700 1 -- 172.21.15.6:0/881341454 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7effcc09b070 con 0x7effd4101250 2023-09-13T09:37:43.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:43.384 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-13T09:37:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 -- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7effbc0a06c0 msgr2=0x7effbc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:43.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7effbc0a06c0 0x7effbc0a2b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7effd4067aa0 tx=0x7effc400bef0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 -- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd4101250 msgr2=0x7effd41a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd4101250 0x7effd41a02f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7effcc0062a0 tx=0x7effcc004db0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 -- 172.21.15.6:0/881341454 shutdown_connections 2023-09-13T09:37:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7effbc0a06c0 0x7effbc0a2b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effd4101250 0x7effd41a02f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effd40fee20 0x7effd4198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 --2- 172.21.15.6:0/881341454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effd40ff7e0 0x7effd4199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 -- 172.21.15.6:0/881341454 >> 172.21.15.6:0/881341454 conn(0x7effd40fa990 msgr2=0x7effd40fc5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 -- 172.21.15.6:0/881341454 shutdown_connections 2023-09-13T09:37:43.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:43.384+0000 7effda097700 1 -- 172.21.15.6:0/881341454 wait complete. 2023-09-13T09:37:43.388 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 3 2023-09-13T09:37:43.519 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 09:37:43 smithi006 podman[149242]: 2023-09-13T09:37:44.006 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 09:37:43 smithi006 bash[149242]: e3b61731da5ea8ac6dc0be99a98a8d8ebab469d86d205d7c9bf626b1ff6f13bd 2023-09-13T09:37:44.006 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mds[149303]: -- 172.21.15.6:0/1496358469 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c38058b1e0 con 0x55c380561000 2023-09-13T09:37:44.006 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-j[149277]: starting mds.j at 2023-09-13T09:37:44.007 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 09:37:43 smithi006 systemd[1]: Started Ceph mds.j for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:44.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:44.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/881341454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:44.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:44.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:44.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:44.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:44.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/881341454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:44.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:44.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:44.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:44.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:44.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/881341454' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:44.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:44.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:44.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:44.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:44.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:44 smithi006 ceph-mon[98665]: Deploying daemon mds.d on smithi006 2023-09-13T09:37:44.862 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:44 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.6:6834/1678170367,v1:172.21.15.6:6835/1678170367] up:boot 2023-09-13T09:37:44.863 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:44 smithi006 ceph-mon[98665]: fsmap 3 up:standby 2023-09-13T09:37:44.863 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-13T09:37:45.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:44 smithi053 ceph-mon[102373]: Deploying daemon mds.d on smithi006 2023-09-13T09:37:45.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:44 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.6:6834/1678170367,v1:172.21.15.6:6835/1678170367] up:boot 2023-09-13T09:37:45.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:44 smithi053 ceph-mon[102373]: fsmap 3 up:standby 2023-09-13T09:37:45.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-13T09:37:45.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:44 smithi131 ceph-mon[102785]: Deploying daemon mds.d on smithi006 2023-09-13T09:37:45.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:44 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.6:6834/1678170367,v1:172.21.15.6:6835/1678170367] up:boot 2023-09-13T09:37:45.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:44 smithi131 ceph-mon[102785]: fsmap 3 up:standby 2023-09-13T09:37:45.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-09-13T09:37:45.113 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 09:37:45 smithi006 systemd[1]: Starting Ceph mds.d for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:45.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/894118039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38101fa0 msgr2=0x7fbe38102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:45.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/894118039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38101fa0 0x7fbe38102400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbe240099c0 tx=0x7fbe24009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/894118039 shutdown_connections 2023-09-13T09:37:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/894118039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe38102940 0x7fbe381091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/894118039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe38100db0 0x7fbe381011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/894118039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38101fa0 0x7fbe38102400 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/894118039 >> 172.21.15.6:0/894118039 conn(0x7fbe380fc320 msgr2=0x7fbe380fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/894118039 shutdown_connections 2023-09-13T09:37:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.537+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/894118039 wait complete. 2023-09-13T09:37:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 Processor -- start 2023-09-13T09:37:45.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 -- start start 2023-09-13T09:37:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe38100db0 0x7fbe38196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe38101fa0 0x7fbe38197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38102940 0x7fbe3819e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3819e650 con 0x7fbe38102940 2023-09-13T09:37:45.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3819e790 con 0x7fbe38101fa0 2023-09-13T09:37:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ecb7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe3819e920 con 0x7fbe38100db0 2023-09-13T09:37:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38102940 0x7fbe3819e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38102940 0x7fbe3819e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60154/0 (socket says 172.21.15.6:60154) 2023-09-13T09:37:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 -- 172.21.15.6:0/774193144 learned_addr learned my addr 172.21.15.6:0/774193144 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe37fff700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe38101fa0 0x7fbe38197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3ca53700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe38100db0 0x7fbe38196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 -- 172.21.15.6:0/774193144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe38100db0 msgr2=0x7fbe38196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe38100db0 0x7fbe38196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 -- 172.21.15.6:0/774193144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe38101fa0 msgr2=0x7fbe38197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe38101fa0 0x7fbe38197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.538+0000 7fbe3d254700 1 -- 172.21.15.6:0/774193144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240095f0 con 0x7fbe38102940 2023-09-13T09:37:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.539+0000 7fbe3d254700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38102940 0x7fbe3819e080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe30007ee0 tx=0x7fbe3000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.539+0000 7fbe35ffb700 1 -- 172.21.15.6:0/774193144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30017070 con 0x7fbe38102940 2023-09-13T09:37:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.539+0000 7fbe35ffb700 1 -- 172.21.15.6:0/774193144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe3000f040 con 0x7fbe38102940 2023-09-13T09:37:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.539+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe3819ec00 con 0x7fbe38102940 2023-09-13T09:37:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.539+0000 7fbe35ffb700 1 -- 172.21.15.6:0/774193144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe30005580 con 0x7fbe38102940 2023-09-13T09:37:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.539+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe3819f0c0 con 0x7fbe38102940 2023-09-13T09:37:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.540+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe38107d30 con 0x7fbe38102940 2023-09-13T09:37:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.541+0000 7fbe35ffb700 1 -- 172.21.15.6:0/774193144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbe3000db20 con 0x7fbe38102940 2023-09-13T09:37:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.541+0000 7fbe35ffb700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe280a0640 0x7fbe280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.541+0000 7fbe3ca53700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe280a0640 0x7fbe280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:45.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.541+0000 7fbe35ffb700 1 -- 172.21.15.6:0/774193144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbe300cae70 con 0x7fbe38102940 2023-09-13T09:37:45.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.542+0000 7fbe3ca53700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe280a0640 0x7fbe280a2b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe38101e00 tx=0x7fbe2c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:45.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.546+0000 7fbe35ffb700 1 -- 172.21.15.6:0/774193144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbe30094e40 con 0x7fbe38102940 2023-09-13T09:37:45.683 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 09:37:45 smithi006 podman[149603]: 2023-09-13T09:37:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.804+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe3810c630 con 0x7fbe38102940 2023-09-13T09:37:45.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.804+0000 7fbe35ffb700 1 -- 172.21.15.6:0/774193144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2904 (secure 0 0 0) 0x7fbe30098460 con 0x7fbe38102940 2023-09-13T09:37:45.821 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:45.821 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-13T09:37:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.806+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe280a0640 msgr2=0x7fbe280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:45.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.806+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe280a0640 0x7fbe280a2b00 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbe38101e00 tx=0x7fbe2c00b410 comp rx=0 tx=0).stop 2023-09-13T09:37:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.806+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38102940 msgr2=0x7fbe3819e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.806+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38102940 0x7fbe3819e080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fbe30007ee0 tx=0x7fbe3000d3b0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.806+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 shutdown_connections 2023-09-13T09:37:45.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.806+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe280a0640 0x7fbe280a2b00 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.806+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe38102940 0x7fbe3819e080 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.807+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe38100db0 0x7fbe38196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.807+0000 7fbe3ecb7700 1 --2- 172.21.15.6:0/774193144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe38101fa0 0x7fbe38197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.807+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 >> 172.21.15.6:0/774193144 conn(0x7fbe380fc320 msgr2=0x7fbe380fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:45.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.807+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 shutdown_connections 2023-09-13T09:37:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:45.807+0000 7fbe3ecb7700 1 -- 172.21.15.6:0/774193144 wait complete. 2023-09-13T09:37:45.826 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 4 2023-09-13T09:37:46.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:45 smithi006 ceph-mon[98665]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:46.006 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 09:37:45 smithi006 bash[149603]: 69264e1ad935625d9cbec8e5e66a4644356598bd0223282d3322852d9562d4b3 2023-09-13T09:37:46.006 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 09:37:45 smithi006 ceph-mds[149686]: -- 172.21.15.6:0/2539735479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55db3cf5b1e0 con 0x55db3cf30800 2023-09-13T09:37:46.007 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 09:37:45 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-d[149642]: starting mds.d at 2023-09-13T09:37:46.007 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 09:37:45 smithi006 systemd[1]: Started Ceph mds.d for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:46.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:45 smithi053 ceph-mon[102373]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:46.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:45 smithi131 ceph-mon[102785]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:47.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:47.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:47.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:47.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: Deploying daemon mds.e on smithi053 2023-09-13T09:37:47.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/774193144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:47.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.6:6836/1215201331,v1:172.21.15.6:6837/1215201331] up:boot 2023-09-13T09:37:47.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: fsmap 4 up:standby 2023-09-13T09:37:47.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-13T09:37:47.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:47.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:47.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:47.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: Deploying daemon mds.e on smithi053 2023-09-13T09:37:47.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/774193144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:47.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.6:6836/1215201331,v1:172.21.15.6:6837/1215201331] up:boot 2023-09-13T09:37:47.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: fsmap 4 up:standby 2023-09-13T09:37:47.011 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-13T09:37:47.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:47.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:47.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:47.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:47.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: Deploying daemon mds.e on smithi053 2023-09-13T09:37:47.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/774193144' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:47.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.6:6836/1215201331,v1:172.21.15.6:6837/1215201331] up:boot 2023-09-13T09:37:47.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: fsmap 4 up:standby 2023-09-13T09:37:47.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-09-13T09:37:47.625 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 09:37:47 smithi053 systemd[1]: Starting Ceph mds.e for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:47.827 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:47.919 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:47 smithi053 ceph-mon[102373]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:47.919 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 09:37:47 smithi053 podman[139068]: 2023-09-13T09:37:47.919 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 09:37:47 smithi053 bash[139068]: 99cf0e39ecf0b06b610c130e760f2db70f75d0eaa9c32bdd4f034e24fbde518a 2023-09-13T09:37:47.920 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 09:37:47 smithi053 ceph-mds[139108]: -- 172.21.15.53:0/3341292584 <== mon.2 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557151f1d1e0 con 0x557151ef2c00 2023-09-13T09:37:47.920 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 09:37:47 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-e[139084]: starting mds.e at 2023-09-13T09:37:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.969+0000 7f530eb04700 1 -- 172.21.15.6:0/3108834023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308101820 msgr2=0x7f53081080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.969+0000 7f530eb04700 1 --2- 172.21.15.6:0/3108834023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308101820 0x7f53081080d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f530000b0d0 tx=0x7f530000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:37:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 -- 172.21.15.6:0/3108834023 shutdown_connections 2023-09-13T09:37:47.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 --2- 172.21.15.6:0/3108834023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308101820 0x7f53081080d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 --2- 172.21.15.6:0/3108834023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53080ffc90 0x7f53081000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 --2- 172.21.15.6:0/3108834023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5308100e80 0x7f53081012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 -- 172.21.15.6:0/3108834023 >> 172.21.15.6:0/3108834023 conn(0x7f53080fb220 msgr2=0x7f53080fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 -- 172.21.15.6:0/3108834023 shutdown_connections 2023-09-13T09:37:47.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 -- 172.21.15.6:0/3108834023 wait complete. 2023-09-13T09:37:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 Processor -- start 2023-09-13T09:37:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 -- start start 2023-09-13T09:37:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53080ffc90 0x7f5308068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308100e80 0x7f530819b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:47.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.970+0000 7f530eb04700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5308101820 0x7f530819df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f530eb04700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530819e6e0 con 0x7f5308100e80 2023-09-13T09:37:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f530eb04700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530819e850 con 0x7f53080ffc90 2023-09-13T09:37:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f530eb04700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f530819ea10 con 0x7f5308101820 2023-09-13T09:37:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308100e80 0x7f530819b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:47.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308100e80 0x7f530819b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60180/0 (socket says 172.21.15.6:60180) 2023-09-13T09:37:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 -- 172.21.15.6:0/1239903487 learned_addr learned my addr 172.21.15.6:0/1239903487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f530c8a0700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53080ffc90 0x7f5308068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f530d0a1700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5308101820 0x7f530819df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 -- 172.21.15.6:0/1239903487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5308101820 msgr2=0x7f530819df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:47.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5308101820 0x7f530819df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:47.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 -- 172.21.15.6:0/1239903487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53080ffc90 msgr2=0x7f5308068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:47.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53080ffc90 0x7f5308068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:47.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 -- 172.21.15.6:0/1239903487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52fc009520 con 0x7f5308100e80 2023-09-13T09:37:47.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5307fff700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308100e80 0x7f530819b900 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52f400e9a0 tx=0x7f52f400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:47.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5305ffb700 1 -- 172.21.15.6:0/1239903487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4009790 con 0x7f5308100e80 2023-09-13T09:37:47.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5300009d00 con 0x7f5308100e80 2023-09-13T09:37:47.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5305ffb700 1 -- 172.21.15.6:0/1239903487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52f400cbd0 con 0x7f5308100e80 2023-09-13T09:37:47.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.971+0000 7f5305ffb700 1 -- 172.21.15.6:0/1239903487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f4018680 con 0x7f5308100e80 2023-09-13T09:37:47.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.972+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f530819f070 con 0x7f5308100e80 2023-09-13T09:37:47.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.972+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f530810b500 con 0x7f5308100e80 2023-09-13T09:37:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.974+0000 7f5305ffb700 1 -- 172.21.15.6:0/1239903487 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f52f400cd40 con 0x7f5308100e80 2023-09-13T09:37:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.974+0000 7f5305ffb700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52f80a0640 0x7f52f80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.974+0000 7f5305ffb700 1 -- 172.21.15.6:0/1239903487 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f52f4014070 con 0x7f5308100e80 2023-09-13T09:37:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.974+0000 7f530c8a0700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52f80a0640 0x7f52f80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:47.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.975+0000 7f530c8a0700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52f80a0640 0x7f52f80a2b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5308100ce0 tx=0x7f52fc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:47.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:47.979+0000 7f5305ffb700 1 -- 172.21.15.6:0/1239903487 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f52f4051e10 con 0x7f5308100e80 2023-09-13T09:37:48.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.245+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5308106b20 con 0x7f5308100e80 2023-09-13T09:37:48.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.245+0000 7f5305ffb700 1 -- 172.21.15.6:0/1239903487 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7f52f4095920 con 0x7f5308100e80 2023-09-13T09:37:48.246 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:48.246 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-09-13T09:37:48.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52f80a0640 msgr2=0x7f52f80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:48.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52f80a0640 0x7f52f80a2b00 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5308100ce0 tx=0x7f52fc009260 comp rx=0 tx=0).stop 2023-09-13T09:37:48.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308100e80 msgr2=0x7f530819b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:48.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308100e80 0x7f530819b900 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52f400e9a0 tx=0x7f52f400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:37:48.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 shutdown_connections 2023-09-13T09:37:48.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5308101820 0x7f530819df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53080ffc90 0x7f5308068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52f80a0640 0x7f52f80a2b00 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 --2- 172.21.15.6:0/1239903487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5308100e80 0x7f530819b900 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:48.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 >> 172.21.15.6:0/1239903487 conn(0x7f53080fb220 msgr2=0x7f53080fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 shutdown_connections 2023-09-13T09:37:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:48.248+0000 7f530eb04700 1 -- 172.21.15.6:0/1239903487 wait complete. 2023-09-13T09:37:48.251 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 5 2023-09-13T09:37:48.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:47 smithi006 ceph-mon[98665]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:48.256 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 09:37:47 smithi053 systemd[1]: Started Ceph mds.e for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:47 smithi131 ceph-mon[102785]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:49.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:49.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:49.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:49.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1239903487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:49.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] up:boot 2023-09-13T09:37:49.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: fsmap 5 up:standby 2023-09-13T09:37:49.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:48 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-13T09:37:49.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:49.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:49.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:49.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1239903487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:49.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] up:boot 2023-09-13T09:37:49.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: fsmap 5 up:standby 2023-09-13T09:37:49.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:48 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-13T09:37:49.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:49.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:49.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:49.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:49.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1239903487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:49.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] up:boot 2023-09-13T09:37:49.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: fsmap 5 up:standby 2023-09-13T09:37:49.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:48 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-13T09:37:49.624 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 09:37:49 smithi131 systemd[1]: Starting Ceph mds.f for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:50.210 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 09:37:49 smithi131 podman[140620]: 2023-09-13T09:37:50.210 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:49 smithi131 ceph-mon[102785]: Deploying daemon mds.f on smithi131 2023-09-13T09:37:50.211 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:49 smithi131 ceph-mon[102785]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:49 smithi006 ceph-mon[98665]: Deploying daemon mds.f on smithi131 2023-09-13T09:37:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:49 smithi006 ceph-mon[98665]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:49 smithi053 ceph-mon[102373]: Deploying daemon mds.f on smithi131 2023-09-13T09:37:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:49 smithi053 ceph-mon[102373]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:50.262 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:50.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 -- 172.21.15.6:0/500432439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d00100e80 msgr2=0x7f2d001012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:50.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 --2- 172.21.15.6:0/500432439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d00100e80 0x7f2d001012e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2cf40099c0 tx=0x7f2cf4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 -- 172.21.15.6:0/500432439 shutdown_connections 2023-09-13T09:37:50.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 --2- 172.21.15.6:0/500432439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d00101820 0x7f2d001080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 --2- 172.21.15.6:0/500432439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d000ffc90 0x7f2d001000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 --2- 172.21.15.6:0/500432439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d00100e80 0x7f2d001012e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 -- 172.21.15.6:0/500432439 >> 172.21.15.6:0/500432439 conn(0x7f2d000fb220 msgr2=0x7f2d000fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:50.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 -- 172.21.15.6:0/500432439 shutdown_connections 2023-09-13T09:37:50.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.408+0000 7f2d0589c700 1 -- 172.21.15.6:0/500432439 wait complete. 2023-09-13T09:37:50.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 Processor -- start 2023-09-13T09:37:50.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 -- start start 2023-09-13T09:37:50.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d000ffc90 0x7f2d00068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d00100e80 0x7f2d0019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d00101820 0x7f2d0019dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0019e5b0 con 0x7f2d000ffc90 2023-09-13T09:37:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0019e720 con 0x7f2d00100e80 2023-09-13T09:37:50.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2d0589c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d0019e8e0 con 0x7f2d00101820 2023-09-13T09:37:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2cfeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d000ffc90 0x7f2d00068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2cfeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d000ffc90 0x7f2d00068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60192/0 (socket says 172.21.15.6:60192) 2023-09-13T09:37:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2cfeffd700 1 -- 172.21.15.6:0/1613593638 learned_addr learned my addr 172.21.15.6:0/1613593638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.409+0000 7f2cff7fe700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d00101820 0x7f2d0019dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:50.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfe7fc700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d00100e80 0x7f2d0019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:50.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfeffd700 1 -- 172.21.15.6:0/1613593638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d00101820 msgr2=0x7f2d0019dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:50.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfeffd700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d00101820 0x7f2d0019dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfeffd700 1 -- 172.21.15.6:0/1613593638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d00100e80 msgr2=0x7f2d0019b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:50.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfeffd700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d00100e80 0x7f2d0019b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfeffd700 1 -- 172.21.15.6:0/1613593638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf40095f0 con 0x7f2d000ffc90 2023-09-13T09:37:50.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfe7fc700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d00100e80 0x7f2d0019b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:37:50.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2cfeffd700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d000ffc90 0x7f2d00068b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000d980 tx=0x7f2cf000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:50.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2d0489a700 1 -- 172.21.15.6:0/1613593638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0004020 con 0x7f2d000ffc90 2023-09-13T09:37:50.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d0019ebc0 con 0x7f2d000ffc90 2023-09-13T09:37:50.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2d0489a700 1 -- 172.21.15.6:0/1613593638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2cf0009730 con 0x7f2d000ffc90 2023-09-13T09:37:50.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2d0489a700 1 -- 172.21.15.6:0/1613593638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cf0003a30 con 0x7f2d000ffc90 2023-09-13T09:37:50.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.410+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d0019f0f0 con 0x7f2d000ffc90 2023-09-13T09:37:50.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.411+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d00106c10 con 0x7f2d000ffc90 2023-09-13T09:37:50.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.413+0000 7f2d0489a700 1 -- 172.21.15.6:0/1613593638 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2cf00098a0 con 0x7f2d000ffc90 2023-09-13T09:37:50.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.413+0000 7f2d0489a700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ce80a0640 0x7f2ce80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:50.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.413+0000 7f2d0489a700 1 -- 172.21.15.6:0/1613593638 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2cf00cb740 con 0x7f2d000ffc90 2023-09-13T09:37:50.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.413+0000 7f2cfe7fc700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ce80a0640 0x7f2ce80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:50.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.414+0000 7f2cfe7fc700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ce80a0640 0x7f2ce80a2b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4000c00 tx=0x7f2cf4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:50.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.417+0000 7f2d0489a700 1 -- 172.21.15.6:0/1613593638 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2cf0095710 con 0x7f2d000ffc90 2023-09-13T09:37:50.518 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 09:37:50 smithi131 bash[140620]: ec807e29d50921b45b6d6001e972eb9ba33fd06755796825af61ba935336cf88 2023-09-13T09:37:50.519 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 09:37:50 smithi131 ceph-mds[140660]: -- 172.21.15.131:0/505182341 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a7dc2c91e0 con 0x55a7dc29e800 2023-09-13T09:37:50.519 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 09:37:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-f[140636]: starting mds.f at 2023-09-13T09:37:50.519 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 09:37:50 smithi131 systemd[1]: Started Ceph mds.f for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:50.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.666+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d0002cfc0 con 0x7f2d000ffc90 2023-09-13T09:37:50.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.667+0000 7f2d0489a700 1 -- 172.21.15.6:0/1613593638 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4480 (secure 0 0 0) 0x7f2cf0098d30 con 0x7f2d000ffc90 2023-09-13T09:37:50.668 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:50.668 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-09-13T09:37:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ce80a0640 msgr2=0x7f2ce80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:50.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ce80a0640 0x7f2ce80a2b00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2cf4000c00 tx=0x7f2cf4005fb0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d000ffc90 msgr2=0x7f2d00068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d000ffc90 0x7f2d00068b40 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f2cf000d980 tx=0x7f2cf000dc90 comp rx=0 tx=0).stop 2023-09-13T09:37:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 shutdown_connections 2023-09-13T09:37:50.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d00101820 0x7f2d0019dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ce80a0640 0x7f2ce80a2b00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d000ffc90 0x7f2d00068b40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 --2- 172.21.15.6:0/1613593638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d00100e80 0x7f2d0019b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 >> 172.21.15.6:0/1613593638 conn(0x7f2d000fb220 msgr2=0x7f2d000fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:50.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 shutdown_connections 2023-09-13T09:37:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:50.669+0000 7f2d0589c700 1 -- 172.21.15.6:0/1613593638 wait complete. 2023-09-13T09:37:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 6 2023-09-13T09:37:51.631 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:51.632 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.632 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.632 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.632 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:51.632 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:51.633 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:51.633 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: Deploying daemon mds.c on smithi131 2023-09-13T09:37:51.633 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1613593638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:51.633 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6834/487237413,v1:172.21.15.131:6835/487237413] up:boot 2023-09-13T09:37:51.633 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: fsmap 6 up:standby 2023-09-13T09:37:51.633 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:51 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-13T09:37:51.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:51.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:51.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: Deploying daemon mds.c on smithi131 2023-09-13T09:37:51.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1613593638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:51.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6834/487237413,v1:172.21.15.131:6835/487237413] up:boot 2023-09-13T09:37:51.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: fsmap 6 up:standby 2023-09-13T09:37:51.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:51 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-13T09:37:51.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:51.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:51.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:51.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:51.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:51.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: Deploying daemon mds.c on smithi131 2023-09-13T09:37:51.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1613593638' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:51.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6834/487237413,v1:172.21.15.131:6835/487237413] up:boot 2023-09-13T09:37:51.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: fsmap 6 up:standby 2023-09-13T09:37:51.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:51 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-13T09:37:52.269 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 09:37:51 smithi131 systemd[1]: Starting Ceph mds.c for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:52.548 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 09:37:52 smithi131 podman[140959]: 2023-09-13T09:37:52.549 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 09:37:52 smithi131 ceph-mds[140999]: -- 172.21.15.131:0/1150231230 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a26b6f31e0 con 0x55a26b6c8800 2023-09-13T09:37:52.549 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 09:37:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-c[140975]: starting mds.c at 2023-09-13T09:37:52.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.826+0000 7f206e5b0700 1 -- 172.21.15.6:0/535725189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 msgr2=0x7f20680730e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.826+0000 7f206e5b0700 1 --2- 172.21.15.6:0/535725189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20680730e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2058009990 tx=0x7f2058009ca0 comp rx=0 tx=0).stop 2023-09-13T09:37:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.826+0000 7f206e5b0700 1 -- 172.21.15.6:0/535725189 shutdown_connections 2023-09-13T09:37:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.826+0000 7f206e5b0700 1 --2- 172.21.15.6:0/535725189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2068108c80 0x7f206810b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.826+0000 7f206e5b0700 1 --2- 172.21.15.6:0/535725189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20680730e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.826+0000 7f206e5b0700 1 --2- 172.21.15.6:0/535725189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20680736b0 0x7f2068073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:52.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.826+0000 7f206e5b0700 1 -- 172.21.15.6:0/535725189 >> 172.21.15.6:0/535725189 conn(0x7f20680fc320 msgr2=0x7f20680fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.827+0000 7f206e5b0700 1 -- 172.21.15.6:0/535725189 shutdown_connections 2023-09-13T09:37:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.827+0000 7f206e5b0700 1 -- 172.21.15.6:0/535725189 wait complete. 2023-09-13T09:37:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.827+0000 7f206e5b0700 1 Processor -- start 2023-09-13T09:37:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.827+0000 7f206e5b0700 1 -- start start 2023-09-13T09:37:52.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.827+0000 7f206e5b0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20680736b0 0x7f2068198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:52.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.827+0000 7f206e5b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20681991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:52.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.827+0000 7f206e5b0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2068108c80 0x7f20681a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:52.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f206e5b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20681a07e0 con 0x7f2068074c90 2023-09-13T09:37:52.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f206e5b0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20681a0950 con 0x7f20680736b0 2023-09-13T09:37:52.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f206e5b0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20681a0b10 con 0x7f2068108c80 2023-09-13T09:37:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20681991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20681991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60208/0 (socket says 172.21.15.6:60208) 2023-09-13T09:37:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 -- 172.21.15.6:0/2666943135 learned_addr learned my addr 172.21.15.6:0/2666943135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f2067fff700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20680736b0 0x7f2068198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:52.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f206cb4d700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2068108c80 0x7f20681a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:52.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 -- 172.21.15.6:0/2666943135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2068108c80 msgr2=0x7f20681a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:52.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2068108c80 0x7f20681a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:52.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 -- 172.21.15.6:0/2666943135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20680736b0 msgr2=0x7f2068198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:52.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20680736b0 0x7f2068198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:52.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 -- 172.21.15.6:0/2666943135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20580095f0 con 0x7f2068074c90 2023-09-13T09:37:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f206cb4d700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2068108c80 0x7f20681a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:37:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20677fe700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20681991b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f205c00e9a0 tx=0x7f205c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20657fa700 1 -- 172.21.15.6:0/2666943135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c009790 con 0x7f2068074c90 2023-09-13T09:37:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20657fa700 1 -- 172.21.15.6:0/2666943135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f205c00cbd0 con 0x7f2068074c90 2023-09-13T09:37:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20681a0df0 con 0x7f2068074c90 2023-09-13T09:37:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f20657fa700 1 -- 172.21.15.6:0/2666943135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f205c018680 con 0x7f2068074c90 2023-09-13T09:37:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.828+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20681a1270 con 0x7f2068074c90 2023-09-13T09:37:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.829+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2068107380 con 0x7f2068074c90 2023-09-13T09:37:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.831+0000 7f20657fa700 1 -- 172.21.15.6:0/2666943135 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f205c00cd40 con 0x7f2068074c90 2023-09-13T09:37:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.832+0000 7f20657fa700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20500a0640 0x7f20500a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.832+0000 7f2067fff700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20500a0640 0x7f20500a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.832+0000 7f20657fa700 1 -- 172.21.15.6:0/2666943135 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f205c014070 con 0x7f2068074c90 2023-09-13T09:37:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.832+0000 7f2067fff700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20500a0640 0x7f20500a2b00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f205800b2e0 tx=0x7f2058005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:52.835+0000 7f20657fa700 1 -- 172.21.15.6:0/2666943135 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f205c095c30 con 0x7f2068074c90 2023-09-13T09:37:53.018 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 09:37:52 smithi131 bash[140959]: cb8070ae49add5f3b4c4cd0a9d57aa12eeab9c7a8f95982288e4a1f2ec620f3d 2023-09-13T09:37:53.019 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 09:37:52 smithi131 systemd[1]: Started Ceph mds.c for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:53.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.085+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f206802cfc0 con 0x7f2068074c90 2023-09-13T09:37:53.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.085+0000 7f20657fa700 1 -- 172.21.15.6:0/2666943135 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6062 (secure 0 0 0) 0x7f205c099250 con 0x7f2068074c90 2023-09-13T09:37:53.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:53.086 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-09-13T09:37:53.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.087+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20500a0640 msgr2=0x7f20500a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:53.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.087+0000 7f206e5b0700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20500a0640 0x7f20500a2b00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f205800b2e0 tx=0x7f2058005fb0 comp rx=0 tx=0).stop 2023-09-13T09:37:53.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.087+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 msgr2=0x7f20681991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:53.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.087+0000 7f206e5b0700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20681991b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f205c00e9a0 tx=0x7f205c00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:37:53.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 shutdown_connections 2023-09-13T09:37:53.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2068108c80 0x7f20681a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:53.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20680736b0 0x7f2068198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:53.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20500a0640 0x7f20500a2b00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:53.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 --2- 172.21.15.6:0/2666943135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2068074c90 0x7f20681991b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:53.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 >> 172.21.15.6:0/2666943135 conn(0x7f20680fc320 msgr2=0x7f20680fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:53.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 shutdown_connections 2023-09-13T09:37:53.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:53.088+0000 7f206e5b0700 1 -- 172.21.15.6:0/2666943135 wait complete. 2023-09-13T09:37:53.090 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-09-13T09:37:53.705 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:53.706 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:53.706 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:53.706 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:53.706 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:53.706 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:53.707 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:53.707 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: Deploying daemon mds.h on smithi053 2023-09-13T09:37:53.707 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] up:boot 2023-09-13T09:37:53.707 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: fsmap 7 up:standby 2023-09-13T09:37:53.707 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-13T09:37:53.707 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:53 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2666943135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:54.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:54.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:54.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:54.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:54.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:54.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:54.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:54.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: Deploying daemon mds.h on smithi053 2023-09-13T09:37:54.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] up:boot 2023-09-13T09:37:54.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: fsmap 7 up:standby 2023-09-13T09:37:54.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-13T09:37:54.010 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:53 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2666943135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:54.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:54.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:54.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:54.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:54.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:54.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:54.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:54.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: Deploying daemon mds.h on smithi053 2023-09-13T09:37:54.022 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] up:boot 2023-09-13T09:37:54.023 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: fsmap 7 up:standby 2023-09-13T09:37:54.023 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-13T09:37:54.023 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:53 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2666943135' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:54.254 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 09:37:54 smithi053 systemd[1]: Starting Ceph mds.h for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:54.806 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 09:37:54 smithi053 podman[139408]: 2023-09-13T09:37:55.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:55.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 -- 172.21.15.6:0/3292709475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03901020f0 msgr2=0x7f0390102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 --2- 172.21.15.6:0/3292709475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03901020f0 0x7f0390102550 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0384009990 tx=0x7f0384009ca0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 -- 172.21.15.6:0/3292709475 shutdown_connections 2023-09-13T09:37:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 --2- 172.21.15.6:0/3292709475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0390102a90 0x7f0390109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 --2- 172.21.15.6:0/3292709475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03900ff080 0x7f03900ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 --2- 172.21.15.6:0/3292709475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03901020f0 0x7f0390102550 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 -- 172.21.15.6:0/3292709475 >> 172.21.15.6:0/3292709475 conn(0x7f03900fa990 msgr2=0x7f03900fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 -- 172.21.15.6:0/3292709475 shutdown_connections 2023-09-13T09:37:55.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.242+0000 7f0398620700 1 -- 172.21.15.6:0/3292709475 wait complete. 2023-09-13T09:37:55.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 Processor -- start 2023-09-13T09:37:55.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 -- start start 2023-09-13T09:37:55.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03900ff080 0x7f0390196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03901020f0 0x7f0390197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390102a90 0x7f039019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039019e650 con 0x7f0390102a90 2023-09-13T09:37:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039019e790 con 0x7f03900ff080 2023-09-13T09:37:55.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.243+0000 7f0398620700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039019e920 con 0x7f03901020f0 2023-09-13T09:37:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390102a90 0x7f039019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390102a90 0x7f039019e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60224/0 (socket says 172.21.15.6:60224) 2023-09-13T09:37:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 -- 172.21.15.6:0/3044989813 learned_addr learned my addr 172.21.15.6:0/3044989813 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f03963bc700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03900ff080 0x7f0390196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:55.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0395bbb700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03901020f0 0x7f0390197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 -- 172.21.15.6:0/3044989813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03901020f0 msgr2=0x7f0390197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03901020f0 0x7f0390197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 -- 172.21.15.6:0/3044989813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03900ff080 msgr2=0x7f0390196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03900ff080 0x7f0390196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 -- 172.21.15.6:0/3044989813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03840095f0 con 0x7f0390102a90 2023-09-13T09:37:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0395bbb700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03901020f0 0x7f0390197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:37:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0396bbd700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390102a90 0x7f039019e080 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0388007ee0 tx=0x7f038800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f03837fe700 1 -- 172.21.15.6:0/3044989813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388017070 con 0x7f0390102a90 2023-09-13T09:37:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f03837fe700 1 -- 172.21.15.6:0/3044989813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f038800f040 con 0x7f0390102a90 2023-09-13T09:37:55.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039019ec00 con 0x7f0390102a90 2023-09-13T09:37:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f03837fe700 1 -- 172.21.15.6:0/3044989813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388005740 con 0x7f0390102a90 2023-09-13T09:37:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.244+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039019f0c0 con 0x7f0390102a90 2023-09-13T09:37:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.245+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f039010c5e0 con 0x7f0390102a90 2023-09-13T09:37:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.246+0000 7f03837fe700 1 -- 172.21.15.6:0/3044989813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f038800dc60 con 0x7f0390102a90 2023-09-13T09:37:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.247+0000 7f03837fe700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f037c0a0640 0x7f037c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:55.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.247+0000 7f03837fe700 1 -- 172.21.15.6:0/3044989813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f03880cb540 con 0x7f0390102a90 2023-09-13T09:37:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.247+0000 7f03963bc700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f037c0a0640 0x7f037c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:55.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.248+0000 7f03963bc700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f037c0a0640 0x7f037c0a2b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0390067cf0 tx=0x7f038c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:55.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.251+0000 7f03837fe700 1 -- 172.21.15.6:0/3044989813 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0388095510 con 0x7f0390102a90 2023-09-13T09:37:55.256 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 09:37:54 smithi053 ceph-mds[139448]: -- 172.21.15.53:0/1704702163 <== mon.2 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5621ddcad1e0 con 0x5621ddc82800 2023-09-13T09:37:55.256 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 09:37:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: starting mds.h at 2023-09-13T09:37:55.256 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 09:37:54 smithi053 bash[139408]: af2ce7fe1e4784ed0fbcdba6a1971754ec5375c4308847152fc657f535941314 2023-09-13T09:37:55.256 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 09:37:54 smithi053 systemd[1]: Started Ceph mds.h for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:55.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.503+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0390107e80 con 0x7f0390102a90 2023-09-13T09:37:55.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.504+0000 7f03837fe700 1 -- 172.21.15.6:0/3044989813 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6062 (secure 0 0 0) 0x7f0388098b30 con 0x7f0390102a90 2023-09-13T09:37:55.504 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:55.505 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-09-13T09:37:55.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f037c0a0640 msgr2=0x7f037c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f037c0a0640 0x7f037c0a2b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0390067cf0 tx=0x7f038c009260 comp rx=0 tx=0).stop 2023-09-13T09:37:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390102a90 msgr2=0x7f039019e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390102a90 0x7f039019e080 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0388007ee0 tx=0x7f038800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 shutdown_connections 2023-09-13T09:37:55.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f037c0a0640 0x7f037c0a2b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0390102a90 0x7f039019e080 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f03900ff080 0x7f0390196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 --2- 172.21.15.6:0/3044989813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f03901020f0 0x7f0390197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 >> 172.21.15.6:0/3044989813 conn(0x7f03900fa990 msgr2=0x7f03900fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 shutdown_connections 2023-09-13T09:37:55.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:55.506+0000 7f0398620700 1 -- 172.21.15.6:0/3044989813 wait complete. 2023-09-13T09:37:55.509 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 8 2023-09-13T09:37:56.222 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:56.222 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.223 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.223 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.223 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:56.223 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:56.223 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:56.224 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: Deploying daemon mds.i on smithi131 2023-09-13T09:37:56.224 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3044989813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:56.224 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:boot 2023-09-13T09:37:56.224 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: fsmap 8 up:standby 2023-09-13T09:37:56.224 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:55 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-13T09:37:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: Deploying daemon mds.i on smithi131 2023-09-13T09:37:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3044989813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:boot 2023-09-13T09:37:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: fsmap 8 up:standby 2023-09-13T09:37:56.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:55 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-13T09:37:56.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:56.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:56.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:56.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:56.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:56.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: Deploying daemon mds.i on smithi131 2023-09-13T09:37:56.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3044989813' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:56.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:boot 2023-09-13T09:37:56.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: fsmap 8 up:standby 2023-09-13T09:37:56.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:55 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-13T09:37:56.769 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 09:37:56 smithi131 systemd[1]: Starting Ceph mds.i for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:57.117 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 09:37:56 smithi131 podman[141297]: 2023-09-13T09:37:57.519 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mds[141337]: -- 172.21.15.131:0/712738951 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5619aa1791e0 con 0x5619aa14f000 2023-09-13T09:37:57.519 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 09:37:57 smithi131 bash[141297]: d356db53a602ce5222740d4e0428fb6edc57a0ce2b58330db9e6e7cba4a4f5ba 2023-09-13T09:37:57.519 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-i[141313]: starting mds.i at 2023-09-13T09:37:57.519 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 09:37:57 smithi131 systemd[1]: Started Ceph mds.i for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:57.520 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:37:57.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 -- 172.21.15.6:0/45200506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8081041a0 msgr2=0x7fb808106590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/45200506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8081041a0 0x7fb808106590 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc009990 tx=0x7fb7fc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 -- 172.21.15.6:0/45200506 shutdown_connections 2023-09-13T09:37:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/45200506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb808106ad0 0x7fb808108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/45200506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb808101870 0x7fb808103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/45200506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8081041a0 0x7fb808106590 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 -- 172.21.15.6:0/45200506 >> 172.21.15.6:0/45200506 conn(0x7fb8080fb220 msgr2=0x7fb8080fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 -- 172.21.15.6:0/45200506 shutdown_connections 2023-09-13T09:37:57.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.647+0000 7fb80cbcd700 1 -- 172.21.15.6:0/45200506 wait complete. 2023-09-13T09:37:57.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 Processor -- start 2023-09-13T09:37:57.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 -- start start 2023-09-13T09:37:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb808101870 0x7fb8081011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081041a0 0x7fb8080ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb808106ad0 0x7fb8080ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb808100500 con 0x7fb808101870 2023-09-13T09:37:57.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb808100670 con 0x7fb808106ad0 2023-09-13T09:37:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80cbcd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8081a0a90 con 0x7fb8081041a0 2023-09-13T09:37:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb808101870 0x7fb8081011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb808101870 0x7fb8081011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60234/0 (socket says 172.21.15.6:60234) 2023-09-13T09:37:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.648+0000 7fb80659c700 1 -- 172.21.15.6:0/737564677 learned_addr learned my addr 172.21.15.6:0/737564677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:37:57.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb805d9b700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081041a0 0x7fb8080ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb806d9d700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb808106ad0 0x7fb8080ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80659c700 1 -- 172.21.15.6:0/737564677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081041a0 msgr2=0x7fb8080ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80659c700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081041a0 0x7fb8080ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80659c700 1 -- 172.21.15.6:0/737564677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb808106ad0 msgr2=0x7fb8080ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:57.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80659c700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb808106ad0 0x7fb8080ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80659c700 1 -- 172.21.15.6:0/737564677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7fc0095f0 con 0x7fb808101870 2023-09-13T09:37:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb806d9d700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb808106ad0 0x7fb8080ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:37:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb805d9b700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081041a0 0x7fb8080ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:37:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80659c700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb808101870 0x7fb8081011e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800e9a0 tx=0x7fb7f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:57.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb7f77fe700 1 -- 172.21.15.6:0/737564677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8009790 con 0x7fb808101870 2023-09-13T09:37:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb7f77fe700 1 -- 172.21.15.6:0/737564677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7f800cbd0 con 0x7fb808101870 2023-09-13T09:37:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb7f77fe700 1 -- 172.21.15.6:0/737564677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8018680 con 0x7fb808101870 2023-09-13T09:37:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8081a0d70 con 0x7fb808101870 2023-09-13T09:37:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.649+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8081a11d0 con 0x7fb808101870 2023-09-13T09:37:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.650+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8080fcda0 con 0x7fb808101870 2023-09-13T09:37:57.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.651+0000 7fb7f77fe700 1 -- 172.21.15.6:0/737564677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb7f800cd40 con 0x7fb808101870 2023-09-13T09:37:57.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.652+0000 7fb7f77fe700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7f00a0640 0x7fb7f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:37:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.652+0000 7fb7f77fe700 1 -- 172.21.15.6:0/737564677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb7f8014070 con 0x7fb808101870 2023-09-13T09:37:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.652+0000 7fb805d9b700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7f00a0640 0x7fb7f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:37:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.653+0000 7fb805d9b700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7f00a0640 0x7fb7f00a2b00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00b2e0 tx=0x7fb7fc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:37:57.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.656+0000 7fb7f77fe700 1 -- 172.21.15.6:0/737564677 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb7f8095e80 con 0x7fb808101870 2023-09-13T09:37:57.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.934+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb80810c7f0 con 0x7fb808101870 2023-09-13T09:37:57.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.934+0000 7fb7f77fe700 1 -- 172.21.15.6:0/737564677 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7646 (secure 0 0 0) 0x7fb7f80994a0 con 0x7fb808101870 2023-09-13T09:37:57.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:37:57.935 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-13T09:37:57.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.936+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7f00a0640 msgr2=0x7fb7f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:57.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.936+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7f00a0640 0x7fb7f00a2b00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb7fc00b2e0 tx=0x7fb7fc005fb0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.936+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb808101870 msgr2=0x7fb8081011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:37:57.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.936+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb808101870 0x7fb8081011e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800e9a0 tx=0x7fb7f800ed60 comp rx=0 tx=0).stop 2023-09-13T09:37:57.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 shutdown_connections 2023-09-13T09:37:57.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb808106ad0 0x7fb8080ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7f00a0640 0x7fb7f00a2b00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb808101870 0x7fb8081011e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 --2- 172.21.15.6:0/737564677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8081041a0 0x7fb8080ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:37:57.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 >> 172.21.15.6:0/737564677 conn(0x7fb8080fb220 msgr2=0x7fb8081024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:37:57.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 shutdown_connections 2023-09-13T09:37:57.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:37:57.937+0000 7fb80cbcd700 1 -- 172.21.15.6:0/737564677 wait complete. 2023-09-13T09:37:57.939 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 10 2023-09-13T09:37:58.160 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:57 smithi006 ceph-mon[98665]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:58.161 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.161 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.161 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.162 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:58.162 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:58.163 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:57 smithi053 ceph-mon[102373]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mon[102785]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:37:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:37:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:37:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:37:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:37:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:58 smithi006 ceph-mon[98665]: Deploying daemon mds.g on smithi006 2023-09-13T09:37:59.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:58 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] up:boot 2023-09-13T09:37:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:58 smithi006 ceph-mon[98665]: fsmap 9 up:standby 2023-09-13T09:37:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:58 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T09:37:59.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:58 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/737564677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:59.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:58 smithi053 ceph-mon[102373]: Deploying daemon mds.g on smithi006 2023-09-13T09:37:59.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:58 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] up:boot 2023-09-13T09:37:59.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:58 smithi053 ceph-mon[102373]: fsmap 9 up:standby 2023-09-13T09:37:59.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:58 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T09:37:59.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:58 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/737564677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:59.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:58 smithi131 ceph-mon[102785]: Deploying daemon mds.g on smithi006 2023-09-13T09:37:59.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:58 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] up:boot 2023-09-13T09:37:59.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:58 smithi131 ceph-mon[102785]: fsmap 9 up:standby 2023-09-13T09:37:59.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:58 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T09:37:59.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:58 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/737564677' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:37:59.323 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 09:37:59 smithi006 systemd[1]: Starting Ceph mds.g for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:37:59.612 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 09:37:59 smithi006 podman[150212]: 2023-09-13T09:37:59.613 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 09:37:59 smithi006 bash[150212]: 8e49170413baf6857a1444822bc32f952f9e17b9948a005bf7b39362309ab388 2023-09-13T09:37:59.613 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mds[150252]: -- 172.21.15.6:0/3284762618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5584307691e0 con 0x55843073e800 2023-09-13T09:37:59.613 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-g[150228]: starting mds.g at 2023-09-13T09:37:59.909 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 09:37:59 smithi006 systemd[1]: Started Ceph mds.g for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:37:59.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:38:00.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 -- 172.21.15.6:0/1465272972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c40100e80 msgr2=0x7f5c401012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:00.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1465272972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c40100e80 0x7f5c401012e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5c300099c0 tx=0x7f5c30009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 -- 172.21.15.6:0/1465272972 shutdown_connections 2023-09-13T09:38:00.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1465272972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c40101820 0x7f5c401080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1465272972 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c400ffc90 0x7f5c401000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1465272972 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c40100e80 0x7f5c401012e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 -- 172.21.15.6:0/1465272972 >> 172.21.15.6:0/1465272972 conn(0x7f5c400fb1c0 msgr2=0x7f5c400fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 -- 172.21.15.6:0/1465272972 shutdown_connections 2023-09-13T09:38:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.091+0000 7f5c47b66700 1 -- 172.21.15.6:0/1465272972 wait complete. 2023-09-13T09:38:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 Processor -- start 2023-09-13T09:38:00.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 -- start start 2023-09-13T09:38:00.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c400ffc90 0x7f5c40103c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:00.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c40100e80 0x7f5c40102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:00.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c40101820 0x7f5c401027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:00.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c40102f40 con 0x7f5c400ffc90 2023-09-13T09:38:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401030b0 con 0x7f5c40100e80 2023-09-13T09:38:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c47b66700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c401a0b20 con 0x7f5c40101820 2023-09-13T09:38:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c45902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c400ffc90 0x7f5c40103c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c45902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c400ffc90 0x7f5c40103c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60262/0 (socket says 172.21.15.6:60262) 2023-09-13T09:38:00.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c45902700 1 -- 172.21.15.6:0/1289613882 learned_addr learned my addr 172.21.15.6:0/1289613882 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c45101700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c40100e80 0x7f5c40102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c46103700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c40101820 0x7f5c401027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:00.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c45902700 1 -- 172.21.15.6:0/1289613882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c40101820 msgr2=0x7f5c401027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:00.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.092+0000 7f5c45902700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c40101820 0x7f5c401027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c45902700 1 -- 172.21.15.6:0/1289613882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c40100e80 msgr2=0x7f5c40102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:00.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c45902700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c40100e80 0x7f5c40102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c45902700 1 -- 172.21.15.6:0/1289613882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c300095f0 con 0x7f5c400ffc90 2023-09-13T09:38:00.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c45902700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c400ffc90 0x7f5c40103c20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00e970 tx=0x7f5c3c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:00.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c36ffd700 1 -- 172.21.15.6:0/1289613882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c009790 con 0x7f5c400ffc90 2023-09-13T09:38:00.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c36ffd700 1 -- 172.21.15.6:0/1289613882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5c3c00c7e0 con 0x7f5c400ffc90 2023-09-13T09:38:00.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c36ffd700 1 -- 172.21.15.6:0/1289613882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c003c70 con 0x7f5c400ffc90 2023-09-13T09:38:00.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c401a0e00 con 0x7f5c400ffc90 2023-09-13T09:38:00.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.093+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c401a1230 con 0x7f5c400ffc90 2023-09-13T09:38:00.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.094+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4010b4f0 con 0x7f5c400ffc90 2023-09-13T09:38:00.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.095+0000 7f5c36ffd700 1 -- 172.21.15.6:0/1289613882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5c3c00cc50 con 0x7f5c400ffc90 2023-09-13T09:38:00.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.096+0000 7f5c36ffd700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5c2c0a0640 0x7f5c2c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:00.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.096+0000 7f5c36ffd700 1 -- 172.21.15.6:0/1289613882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5c3c014070 con 0x7f5c400ffc90 2023-09-13T09:38:00.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.096+0000 7f5c45101700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5c2c0a0640 0x7f5c2c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:00.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.096+0000 7f5c45101700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5c2c0a0640 0x7f5c2c0a2b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b580 tx=0x7f5c30005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:00.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.100+0000 7f5c36ffd700 1 -- 172.21.15.6:0/1289613882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5c3c095890 con 0x7f5c400ffc90 2023-09-13T09:38:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mon[98665]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:38:00.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:38:00.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:37:59 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:59 smithi053 ceph-mon[102373]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:38:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:38:00.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:37:59 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:59 smithi131 ceph-mon[102785]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:38:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:38:00.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:37:59 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.364+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c4010b6e0 con 0x7f5c400ffc90 2023-09-13T09:38:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.365+0000 7f5c36ffd700 1 -- 172.21.15.6:0/1289613882 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8432 (secure 0 0 0) 0x7f5c3c003dd0 con 0x7f5c400ffc90 2023-09-13T09:38:00.365 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:00.366 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-13T09:38:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5c2c0a0640 msgr2=0x7f5c2c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5c2c0a0640 0x7f5c2c0a2b00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000b580 tx=0x7f5c30005fb0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c400ffc90 msgr2=0x7f5c40103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c400ffc90 0x7f5c40103c20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00e970 tx=0x7f5c3c00ec80 comp rx=0 tx=0).stop 2023-09-13T09:38:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 shutdown_connections 2023-09-13T09:38:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c40101820 0x7f5c401027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5c2c0a0640 0x7f5c2c0a2b00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c400ffc90 0x7f5c40103c20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 --2- 172.21.15.6:0/1289613882 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5c40100e80 0x7f5c40102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 >> 172.21.15.6:0/1289613882 conn(0x7f5c400fb1c0 msgr2=0x7f5c400691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 shutdown_connections 2023-09-13T09:38:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:00.367+0000 7f5c47b66700 1 -- 172.21.15.6:0/1289613882 wait complete. 2023-09-13T09:38:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 11 2023-09-13T09:38:01.185 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:00 smithi006 ceph-mon[98665]: Deploying daemon mds.a on smithi006 2023-09-13T09:38:01.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:00 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.6:6838/565321366,v1:172.21.15.6:6839/565321366] up:boot 2023-09-13T09:38:01.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:00 smithi006 ceph-mon[98665]: fsmap 10 up:standby 2023-09-13T09:38:01.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-13T09:38:01.186 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:00 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1289613882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:00 smithi053 ceph-mon[102373]: Deploying daemon mds.a on smithi006 2023-09-13T09:38:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:00 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.6:6838/565321366,v1:172.21.15.6:6839/565321366] up:boot 2023-09-13T09:38:01.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:00 smithi053 ceph-mon[102373]: fsmap 10 up:standby 2023-09-13T09:38:01.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-13T09:38:01.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:00 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1289613882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:00 smithi131 ceph-mon[102785]: Deploying daemon mds.a on smithi006 2023-09-13T09:38:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:00 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.6:6838/565321366,v1:172.21.15.6:6839/565321366] up:boot 2023-09-13T09:38:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:00 smithi131 ceph-mon[102785]: fsmap 10 up:standby 2023-09-13T09:38:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-13T09:38:01.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:00 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1289613882' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:01.480 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 09:38:01 smithi006 systemd[1]: Starting Ceph mds.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:38:01.756 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 09:38:01 smithi006 podman[150594]: 2023-09-13T09:38:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:01 smithi006 ceph-mon[98665]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:02.256 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 09:38:01 smithi006 ceph-mds[150635]: -- 172.21.15.6:0/2319074622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56356852d1e0 con 0x563568502c00 2023-09-13T09:38:02.256 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 09:38:01 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-a[150610]: starting mds.a at 2023-09-13T09:38:02.257 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 09:38:01 smithi006 bash[150594]: c5f48f7445ccef3b0a9e27642fb11b27cab4b4e34f9a821041afc2c80ea6d4c1 2023-09-13T09:38:02.257 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 09:38:01 smithi006 systemd[1]: Started Ceph mds.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:38:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:01 smithi053 ceph-mon[102373]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:02.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:01 smithi131 ceph-mon[102785]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:02.382 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:38:02.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 -- 172.21.15.6:0/3988629371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 msgr2=0x7f8f541080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:02.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/3988629371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f541080d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00b0d0 tx=0x7f8f4c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 -- 172.21.15.6:0/3988629371 shutdown_connections 2023-09-13T09:38:02.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/3988629371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f541080d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/3988629371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f540ffc90 0x7f8f541000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/3988629371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f54100e80 0x7f8f541012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 -- 172.21.15.6:0/3988629371 >> 172.21.15.6:0/3988629371 conn(0x7f8f540fb220 msgr2=0x7f8f540fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:02.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 -- 172.21.15.6:0/3988629371 shutdown_connections 2023-09-13T09:38:02.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.517+0000 7f8f58ef2700 1 -- 172.21.15.6:0/3988629371 wait complete. 2023-09-13T09:38:02.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 Processor -- start 2023-09-13T09:38:02.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 -- start start 2023-09-13T09:38:02.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f540ffc90 0x7f8f54195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:02.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f54100e80 0x7f8f54196010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:02.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f5419d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:02.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5419d650 con 0x7f8f54101820 2023-09-13T09:38:02.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5419d790 con 0x7f8f540ffc90 2023-09-13T09:38:02.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f58ef2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f5419d920 con 0x7f8f54100e80 2023-09-13T09:38:02.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f52d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f5419d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:02.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f52d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f5419d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60292/0 (socket says 172.21.15.6:60292) 2023-09-13T09:38:02.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f52d9d700 1 -- 172.21.15.6:0/1458934206 learned_addr learned my addr 172.21.15.6:0/1458934206 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:02.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f5259c700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f540ffc90 0x7f8f54195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:02.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f51d9b700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f54100e80 0x7f8f54196010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:02.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f52d9d700 1 -- 172.21.15.6:0/1458934206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f54100e80 msgr2=0x7f8f54196010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:02.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f52d9d700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f54100e80 0x7f8f54196010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f52d9d700 1 -- 172.21.15.6:0/1458934206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f540ffc90 msgr2=0x7f8f54195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:02.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.518+0000 7f8f52d9d700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f540ffc90 0x7f8f54195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.519+0000 7f8f52d9d700 1 -- 172.21.15.6:0/1458934206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f4c009d00 con 0x7f8f54101820 2023-09-13T09:38:02.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.519+0000 7f8f52d9d700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f5419d080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c007a00 tx=0x7f8f4c009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:02.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.519+0000 7f8f437fe700 1 -- 172.21.15.6:0/1458934206 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c00e040 con 0x7f8f54101820 2023-09-13T09:38:02.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.519+0000 7f8f437fe700 1 -- 172.21.15.6:0/1458934206 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4c01dd50 con 0x7f8f54101820 2023-09-13T09:38:02.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.519+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f5419dba0 con 0x7f8f54101820 2023-09-13T09:38:02.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.519+0000 7f8f437fe700 1 -- 172.21.15.6:0/1458934206 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0123f0 con 0x7f8f54101820 2023-09-13T09:38:02.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.519+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f5419e020 con 0x7f8f54101820 2023-09-13T09:38:02.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.520+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f541071d0 con 0x7f8f54101820 2023-09-13T09:38:02.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.521+0000 7f8f437fe700 1 -- 172.21.15.6:0/1458934206 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8f4c01b450 con 0x7f8f54101820 2023-09-13T09:38:02.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.521+0000 7f8f437fe700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f3c0a0640 0x7f8f3c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:02.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.522+0000 7f8f5259c700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f3c0a0640 0x7f8f3c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:02.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.522+0000 7f8f437fe700 1 -- 172.21.15.6:0/1458934206 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8f4c0cd490 con 0x7f8f54101820 2023-09-13T09:38:02.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.522+0000 7f8f5259c700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f3c0a0640 0x7f8f3c0a2b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005950 tx=0x7f8f4400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:02.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.526+0000 7f8f437fe700 1 -- 172.21.15.6:0/1458934206 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8f4c097450 con 0x7f8f54101820 2023-09-13T09:38:02.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.776+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f5410b520 con 0x7f8f54101820 2023-09-13T09:38:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.777+0000 7f8f437fe700 1 -- 172.21.15.6:0/1458934206 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9221 (secure 0 0 0) 0x7f8f4c09aa70 con 0x7f8f54101820 2023-09-13T09:38:02.777 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:02.778 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-09-13T09:38:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f3c0a0640 msgr2=0x7f8f3c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f3c0a0640 0x7f8f3c0a2b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f8f44005950 tx=0x7f8f4400a300 comp rx=0 tx=0).stop 2023-09-13T09:38:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 msgr2=0x7f8f5419d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f5419d080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c007a00 tx=0x7f8f4c009440 comp rx=0 tx=0).stop 2023-09-13T09:38:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 shutdown_connections 2023-09-13T09:38:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f3c0a0640 0x7f8f3c0a2b00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f54101820 0x7f8f5419d080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f540ffc90 0x7f8f54195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 --2- 172.21.15.6:0/1458934206 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f54100e80 0x7f8f54196010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 >> 172.21.15.6:0/1458934206 conn(0x7f8f540fb220 msgr2=0x7f8f54104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 shutdown_connections 2023-09-13T09:38:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:02.779+0000 7f8f58ef2700 1 -- 172.21.15.6:0/1458934206 wait complete. 2023-09-13T09:38:02.782 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2023-09-13T09:38:03.178 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.178 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.178 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.179 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:38:03.179 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:38:03.179 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:03.179 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: Deploying daemon mds.b on smithi053 2023-09-13T09:38:03.179 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.6:6840/1420340613,v1:172.21.15.6:6841/1420340613] up:boot 2023-09-13T09:38:03.180 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: fsmap 11 up:standby 2023-09-13T09:38:03.180 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-13T09:38:03.180 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:02 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1458934206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:03.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:38:03.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:38:03.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:03.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: Deploying daemon mds.b on smithi053 2023-09-13T09:38:03.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.6:6840/1420340613,v1:172.21.15.6:6841/1420340613] up:boot 2023-09-13T09:38:03.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: fsmap 11 up:standby 2023-09-13T09:38:03.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-13T09:38:03.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:02 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1458934206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:03.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:03.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-09-13T09:38:03.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-09-13T09:38:03.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:03.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: Deploying daemon mds.b on smithi053 2023-09-13T09:38:03.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.6:6840/1420340613,v1:172.21.15.6:6841/1420340613] up:boot 2023-09-13T09:38:03.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: fsmap 11 up:standby 2023-09-13T09:38:03.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-13T09:38:03.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:02 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1458934206' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:03.755 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:03 smithi053 systemd[1]: Starting Ceph mds.b for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T09:38:04.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:03 smithi053 ceph-mon[102373]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:04.007 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:03 smithi053 podman[139754]: 2023-09-13T09:38:04.007 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:04 smithi053 ceph-mds[139795]: -- 172.21.15.53:0/1482824677 <== mon.2 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56261c9971e0 con 0x56261c96d000 2023-09-13T09:38:04.008 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:04 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: starting mds.b at 2023-09-13T09:38:04.008 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:04 smithi053 bash[139754]: b39aa141888c13c7b12cbd7ca67d53f38e3b2f5717a161b3096ae0cf2b4ca3ba 2023-09-13T09:38:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:03 smithi006 ceph-mon[98665]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:04.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:03 smithi131 ceph-mon[102785]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:04.506 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:04 smithi053 systemd[1]: Started Ceph mds.b for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da. 2023-09-13T09:38:04.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:38:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.924+0000 7fe938683700 1 -- 172.21.15.6:0/1003337610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9300ff600 msgr2=0x7fe9300ffa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.924+0000 7fe938683700 1 --2- 172.21.15.6:0/1003337610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9300ff600 0x7fe9300ffa20 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe92c009990 tx=0x7fe92c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 -- 172.21.15.6:0/1003337610 shutdown_connections 2023-09-13T09:38:04.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 --2- 172.21.15.6:0/1003337610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe930100920 0x7fe930100da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 --2- 172.21.15.6:0/1003337610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9300ff600 0x7fe9300ffa20 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 --2- 172.21.15.6:0/1003337610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9300fff60 0x7fe9301003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 -- 172.21.15.6:0/1003337610 >> 172.21.15.6:0/1003337610 conn(0x7fe9300fb220 msgr2=0x7fe9300fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 -- 172.21.15.6:0/1003337610 shutdown_connections 2023-09-13T09:38:04.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 -- 172.21.15.6:0/1003337610 wait complete. 2023-09-13T09:38:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 Processor -- start 2023-09-13T09:38:04.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.925+0000 7fe938683700 1 -- start start 2023-09-13T09:38:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe938683700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9300ff600 0x7fe930198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe938683700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9300fff60 0x7fe9301991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe938683700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe930100920 0x7fe9301a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:04.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe938683700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9301a07a0 con 0x7fe930100920 2023-09-13T09:38:04.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe938683700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9301a0910 con 0x7fe9300ff600 2023-09-13T09:38:04.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe938683700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9301a0ad0 con 0x7fe9300fff60 2023-09-13T09:38:04.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe930100920 0x7fe9301a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:04.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe930100920 0x7fe9301a01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60308/0 (socket says 172.21.15.6:60308) 2023-09-13T09:38:04.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe93641f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9300ff600 0x7fe930198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:04.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 -- 172.21.15.6:0/1209535698 learned_addr learned my addr 172.21.15.6:0/1209535698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:04.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe935c1e700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9300fff60 0x7fe9301991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:04.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 -- 172.21.15.6:0/1209535698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9300fff60 msgr2=0x7fe9301991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:04.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9300fff60 0x7fe9301991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:04.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 -- 172.21.15.6:0/1209535698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9300ff600 msgr2=0x7fe930198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:04.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9300ff600 0x7fe930198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:04.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 -- 172.21.15.6:0/1209535698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0095f0 con 0x7fe930100920 2023-09-13T09:38:04.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe935c1e700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9300fff60 0x7fe9301991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:04.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe936c20700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe930100920 0x7fe9301a01d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe928007ee0 tx=0x7fe92800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:04.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe9277fe700 1 -- 172.21.15.6:0/1209535698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928017070 con 0x7fe930100920 2023-09-13T09:38:04.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9301a0db0 con 0x7fe930100920 2023-09-13T09:38:04.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.926+0000 7fe9277fe700 1 -- 172.21.15.6:0/1209535698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe92800f040 con 0x7fe930100920 2023-09-13T09:38:04.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.927+0000 7fe9277fe700 1 -- 172.21.15.6:0/1209535698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928005740 con 0x7fe930100920 2023-09-13T09:38:04.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.927+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9301a1200 con 0x7fe930100920 2023-09-13T09:38:04.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.927+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93010a3e0 con 0x7fe930100920 2023-09-13T09:38:04.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.928+0000 7fe9277fe700 1 -- 172.21.15.6:0/1209535698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe92800dc60 con 0x7fe930100920 2023-09-13T09:38:04.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.929+0000 7fe9277fe700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe91c0a0640 0x7fe91c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:04.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.929+0000 7fe93641f700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe91c0a0640 0x7fe91c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:04.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.929+0000 7fe9277fe700 1 -- 172.21.15.6:0/1209535698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe9280caf60 con 0x7fe930100920 2023-09-13T09:38:04.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.930+0000 7fe93641f700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe91c0a0640 0x7fe91c0a2b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe93019a130 tx=0x7fe92c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:04.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:04.934+0000 7fe9277fe700 1 -- 172.21.15.6:0/1209535698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe928094e90 con 0x7fe930100920 2023-09-13T09:38:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.199+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe93010e770 con 0x7fe930100920 2023-09-13T09:38:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.200+0000 7fe9277fe700 1 -- 172.21.15.6:0/1209535698 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10013 (secure 0 0 0) 0x7fe9280984b0 con 0x7fe930100920 2023-09-13T09:38:05.201 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:05.201 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14634,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24412,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24428,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24454,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24455,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24466,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24482,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24484,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24521,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-09-13T09:38:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe91c0a0640 msgr2=0x7fe91c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe91c0a0640 0x7fe91c0a2b00 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe93019a130 tx=0x7fe92c005fd0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe930100920 msgr2=0x7fe9301a01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe930100920 0x7fe9301a01d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe928007ee0 tx=0x7fe92800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 shutdown_connections 2023-09-13T09:38:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe91c0a0640 0x7fe91c0a2b00 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe930100920 0x7fe9301a01d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe9300ff600 0x7fe930198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 --2- 172.21.15.6:0/1209535698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9300fff60 0x7fe9301991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 >> 172.21.15.6:0/1209535698 conn(0x7fe9300fb220 msgr2=0x7fe9300fcf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 shutdown_connections 2023-09-13T09:38:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.202+0000 7fe938683700 1 -- 172.21.15.6:0/1209535698 wait complete. 2023-09-13T09:38:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 13 2023-09-13T09:38:05.215 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:38:05.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 -- 172.21.15.6:0/651057645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660100da0 msgr2=0x7fa6601011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 --2- 172.21.15.6:0/651057645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660100da0 0x7fa6601011c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa6500099c0 tx=0x7fa650009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 -- 172.21.15.6:0/651057645 shutdown_connections 2023-09-13T09:38:05.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 --2- 172.21.15.6:0/651057645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660102930 0x7fa6601091e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 --2- 172.21.15.6:0/651057645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660100da0 0x7fa6601011c0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 --2- 172.21.15.6:0/651057645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa660101f90 0x7fa6601023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 -- 172.21.15.6:0/651057645 >> 172.21.15.6:0/651057645 conn(0x7fa6600fc2f0 msgr2=0x7fa6600fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 -- 172.21.15.6:0/651057645 shutdown_connections 2023-09-13T09:38:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.348+0000 7fa664e85700 1 -- 172.21.15.6:0/651057645 wait complete. 2023-09-13T09:38:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 Processor -- start 2023-09-13T09:38:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 -- start start 2023-09-13T09:38:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660100da0 0x7fa660196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660101f90 0x7fa660196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa660102930 0x7fa66019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66019e5d0 con 0x7fa660101f90 2023-09-13T09:38:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66019e710 con 0x7fa660100da0 2023-09-13T09:38:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa664e85700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66019e8a0 con 0x7fa660102930 2023-09-13T09:38:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa65dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660101f90 0x7fa660196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa65e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660100da0 0x7fa660196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa65e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660100da0 0x7fa660196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:53842/0 (socket says 172.21.15.6:53842) 2023-09-13T09:38:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa65dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660101f90 0x7fa660196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60320/0 (socket says 172.21.15.6:60320) 2023-09-13T09:38:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.349+0000 7fa65e59c700 1 -- 172.21.15.6:0/3950807183 learned_addr learned my addr 172.21.15.6:0/3950807183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65ed9d700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa660102930 0x7fa66019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65dd9b700 1 -- 172.21.15.6:0/3950807183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa660102930 msgr2=0x7fa66019e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65dd9b700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa660102930 0x7fa66019e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65dd9b700 1 -- 172.21.15.6:0/3950807183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660100da0 msgr2=0x7fa660196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65dd9b700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660100da0 0x7fa660196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65dd9b700 1 -- 172.21.15.6:0/3950807183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500095f0 con 0x7fa660101f90 2023-09-13T09:38:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65e59c700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660100da0 0x7fa660196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:38:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa65dd9b700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660101f90 0x7fa660196f90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e9f0 tx=0x7fa64800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:05.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa6577fe700 1 -- 172.21.15.6:0/3950807183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800c9c0 con 0x7fa660101f90 2023-09-13T09:38:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa6577fe700 1 -- 172.21.15.6:0/3950807183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa648010430 con 0x7fa660101f90 2023-09-13T09:38:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa6577fe700 1 -- 172.21.15.6:0/3950807183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648018680 con 0x7fa660101f90 2023-09-13T09:38:05.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66019eb80 con 0x7fa660101f90 2023-09-13T09:38:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.350+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66019f040 con 0x7fa660101f90 2023-09-13T09:38:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.351+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa660108360 con 0x7fa660101f90 2023-09-13T09:38:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.352+0000 7fa6577fe700 1 -- 172.21.15.6:0/3950807183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa648010860 con 0x7fa660101f90 2023-09-13T09:38:05.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.353+0000 7fa6577fe700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa64c0a0640 0x7fa64c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.353+0000 7fa6577fe700 1 -- 172.21.15.6:0/3950807183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa648014070 con 0x7fa660101f90 2023-09-13T09:38:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.353+0000 7fa65e59c700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa64c0a0640 0x7fa64c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:05.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.353+0000 7fa65e59c700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa64c0a0640 0x7fa64c0a2b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa650004800 tx=0x7fa65001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.356+0000 7fa6577fe700 1 -- 172.21.15.6:0/3950807183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa6480959e0 con 0x7fa660101f90 2023-09-13T09:38:05.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:38:05.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] up:boot 2023-09-13T09:38:05.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: fsmap 12 up:standby 2023-09-13T09:38:05.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-13T09:38:05.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:05.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:38:05.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] up:boot 2023-09-13T09:38:05.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: fsmap 12 up:standby 2023-09-13T09:38:05.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-13T09:38:05.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:38:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] up:boot 2023-09-13T09:38:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: fsmap 12 up:standby 2023-09-13T09:38:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-13T09:38:05.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.568+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa66010c800 con 0x7fa660101f90 2023-09-13T09:38:05.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.569+0000 7fa6577fe700 1 -- 172.21.15.6:0/3950807183 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v80) v1 ==== 74+0+18304 (secure 0 0 0) 0x7fa648099000 con 0x7fa660101f90 2023-09-13T09:38:05.569 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:05.570 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":80,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:37:27.977847+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:38:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa64c0a0640 msgr2=0x7fa64c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa64c0a0640 0x7fa64c0a2b00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa650004800 tx=0x7fa65001a040 comp rx=0 tx=0).stop 2023-09-13T09:38:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660101f90 msgr2=0x7fa660196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660101f90 0x7fa660196f90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa64800e9f0 tx=0x7fa64800ed00 comp rx=0 tx=0).stop 2023-09-13T09:38:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 shutdown_connections 2023-09-13T09:38:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa660102930 0x7fa66019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa660100da0 0x7fa660196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa64c0a0640 0x7fa64c0a2b00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 --2- 172.21.15.6:0/3950807183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa660101f90 0x7fa660196f90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.571+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 >> 172.21.15.6:0/3950807183 conn(0x7fa6600fc2f0 msgr2=0x7fa6601054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:05.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.572+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 shutdown_connections 2023-09-13T09:38:05.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.572+0000 7fa664e85700 1 -- 172.21.15.6:0/3950807183 wait complete. 2023-09-13T09:38:05.584 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:38:05.585 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:38:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 -- 172.21.15.6:0/3421707250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 msgr2=0x7f6210101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 --2- 172.21.15.6:0/3421707250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210101370 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f62040099c0 tx=0x7f6204009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 -- 172.21.15.6:0/3421707250 shutdown_connections 2023-09-13T09:38:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 --2- 172.21.15.6:0/3421707250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62101018b0 0x7f6210108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 --2- 172.21.15.6:0/3421707250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62100ffd20 0x7f6210100140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 --2- 172.21.15.6:0/3421707250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210101370 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 -- 172.21.15.6:0/3421707250 >> 172.21.15.6:0/3421707250 conn(0x7f62100fb290 msgr2=0x7f62100fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 -- 172.21.15.6:0/3421707250 shutdown_connections 2023-09-13T09:38:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.722+0000 7f621735b700 1 -- 172.21.15.6:0/3421707250 wait complete. 2023-09-13T09:38:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 Processor -- start 2023-09-13T09:38:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 -- start start 2023-09-13T09:38:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62100ffd20 0x7f6210196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62101018b0 0x7f621019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621019e5d0 con 0x7f6210100f10 2023-09-13T09:38:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621019e710 con 0x7f62100ffd20 2023-09-13T09:38:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f621735b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621019e8a0 con 0x7f62101018b0 2023-09-13T09:38:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60334/0 (socket says 172.21.15.6:60334) 2023-09-13T09:38:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 -- 172.21.15.6:0/1153795475 learned_addr learned my addr 172.21.15.6:0/1153795475 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62158f8700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62101018b0 0x7f621019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 -- 172.21.15.6:0/1153795475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62101018b0 msgr2=0x7f621019e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62101018b0 0x7f621019e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 -- 172.21.15.6:0/1153795475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62100ffd20 msgr2=0x7f6210196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62100ffd20 0x7f6210196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.723+0000 7f62148f6700 1 -- 172.21.15.6:0/1153795475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040095f0 con 0x7f6210100f10 2023-09-13T09:38:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.724+0000 7f62148f6700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210196f90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6204009fd0 tx=0x7f6204009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.724+0000 7f620e7fc700 1 -- 172.21.15.6:0/1153795475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620401d070 con 0x7f6210100f10 2023-09-13T09:38:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.724+0000 7f620e7fc700 1 -- 172.21.15.6:0/1153795475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6204005030 con 0x7f6210100f10 2023-09-13T09:38:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.724+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621019eb20 con 0x7f6210100f10 2023-09-13T09:38:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.724+0000 7f620e7fc700 1 -- 172.21.15.6:0/1153795475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204004b30 con 0x7f6210100f10 2023-09-13T09:38:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.724+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621019efa0 con 0x7f6210100f10 2023-09-13T09:38:05.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.725+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f621010b4c0 con 0x7f6210100f10 2023-09-13T09:38:05.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.726+0000 7f620e7fc700 1 -- 172.21.15.6:0/1153795475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f62040051a0 con 0x7f6210100f10 2023-09-13T09:38:05.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.726+0000 7f620e7fc700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61f80a06c0 0x7f61f80a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:05.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.726+0000 7f62150f7700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61f80a06c0 0x7f61f80a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:05.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.726+0000 7f620e7fc700 1 -- 172.21.15.6:0/1153795475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f62040cc480 con 0x7f6210100f10 2023-09-13T09:38:05.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.727+0000 7f62150f7700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61f80a06c0 0x7f61f80a2b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6210100d70 tx=0x7f62000096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:05.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.731+0000 7f620e7fc700 1 -- 172.21.15.6:0/1153795475 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f62040964e0 con 0x7f6210100f10 2023-09-13T09:38:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.946+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f621019f190 con 0x7f6210100f10 2023-09-13T09:38:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.947+0000 7f620e7fc700 1 -- 172.21.15.6:0/1153795475 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v80) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6204099b00 con 0x7f6210100f10 2023-09-13T09:38:05.947 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:38:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61f80a06c0 msgr2=0x7f61f80a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61f80a06c0 0x7f61f80a2b80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6210100d70 tx=0x7f62000096c0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 msgr2=0x7f6210196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210196f90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6204009fd0 tx=0x7f6204009580 comp rx=0 tx=0).stop 2023-09-13T09:38:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 shutdown_connections 2023-09-13T09:38:05.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62101018b0 0x7f621019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62100ffd20 0x7f6210196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61f80a06c0 0x7f61f80a2b80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 --2- 172.21.15.6:0/1153795475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6210100f10 0x7f6210196f90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 >> 172.21.15.6:0/1153795475 conn(0x7f62100fb290 msgr2=0x7f6210069240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:05.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 shutdown_connections 2023-09-13T09:38:05.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:05.950+0000 7f621735b700 1 -- 172.21.15.6:0/1153795475 wait complete. 2023-09-13T09:38:05.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-13T09:38:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 -- 172.21.15.6:0/4075122058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 msgr2=0x7f8fc0106540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 --2- 172.21.15.6:0/4075122058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc0106540 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009990 tx=0x7f8fb4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 -- 172.21.15.6:0/4075122058 shutdown_connections 2023-09-13T09:38:06.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 --2- 172.21.15.6:0/4075122058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fc0106a80 0x7f8fc0108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 --2- 172.21.15.6:0/4075122058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc0101820 0x7f8fc0103c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 --2- 172.21.15.6:0/4075122058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc0106540 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 -- 172.21.15.6:0/4075122058 >> 172.21.15.6:0/4075122058 conn(0x7f8fc00fb250 msgr2=0x7f8fc00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 -- 172.21.15.6:0/4075122058 shutdown_connections 2023-09-13T09:38:06.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.092+0000 7f8fc487a700 1 -- 172.21.15.6:0/4075122058 wait complete. 2023-09-13T09:38:06.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 Processor -- start 2023-09-13T09:38:06.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 -- start start 2023-09-13T09:38:06.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc0101820 0x7f8fc0101190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc00ff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fc0106a80 0x7f8fc00ffd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01004b0 con 0x7f8fc0104150 2023-09-13T09:38:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc0100620 con 0x7f8fc0101820 2023-09-13T09:38:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fc487a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc01a0b00 con 0x7f8fc0106a80 2023-09-13T09:38:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fbdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc00ff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fbdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc00ff7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60348/0 (socket says 172.21.15.6:60348) 2023-09-13T09:38:06.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.093+0000 7f8fbdd9b700 1 -- 172.21.15.6:0/2807874265 learned_addr learned my addr 172.21.15.6:0/2807874265 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:06.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbe59c700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc0101820 0x7f8fc0101190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbed9d700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fc0106a80 0x7f8fc00ffd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbdd9b700 1 -- 172.21.15.6:0/2807874265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fc0106a80 msgr2=0x7f8fc00ffd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbdd9b700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fc0106a80 0x7f8fc00ffd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbdd9b700 1 -- 172.21.15.6:0/2807874265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc0101820 msgr2=0x7f8fc0101190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbdd9b700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc0101820 0x7f8fc0101190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbdd9b700 1 -- 172.21.15.6:0/2807874265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb40095f0 con 0x7f8fc0104150 2023-09-13T09:38:06.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbed9d700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fc0106a80 0x7f8fc00ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:38:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fbdd9b700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc00ff7d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4004730 tx=0x7f8fb4004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8faf7fe700 1 -- 172.21.15.6:0/2807874265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb401d070 con 0x7f8fc0104150 2023-09-13T09:38:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8faf7fe700 1 -- 172.21.15.6:0/2807874265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8fb4004c90 con 0x7f8fc0104150 2023-09-13T09:38:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8faf7fe700 1 -- 172.21.15.6:0/2807874265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb40054b0 con 0x7f8fc0104150 2023-09-13T09:38:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fc487a700 1 -- 172.21.15.6:0/2807874265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc01a0d80 con 0x7f8fc0104150 2023-09-13T09:38:06.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.094+0000 7f8fc487a700 1 -- 172.21.15.6:0/2807874265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc01a10f0 con 0x7f8fc0104150 2023-09-13T09:38:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.095+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa40052f0 con 0x7f8fc0104150 2023-09-13T09:38:06.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.097+0000 7f8faf7fe700 1 -- 172.21.15.6:0/2807874265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8fb400fbc0 con 0x7f8fc0104150 2023-09-13T09:38:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.098+0000 7f8faf7fe700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8fa80a0640 0x7f8fa80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.098+0000 7f8fbe59c700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8fa80a0640 0x7f8fa80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.098+0000 7f8faf7fe700 1 -- 172.21.15.6:0/2807874265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8fb40ccdb0 con 0x7f8fc0104150 2023-09-13T09:38:06.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.098+0000 7f8fbe59c700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8fa80a0640 0x7f8fa80a2b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0005950 tx=0x7f8fb000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:06.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.102+0000 7f8faf7fe700 1 -- 172.21.15.6:0/2807874265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8fb4096e10 con 0x7f8fc0104150 2023-09-13T09:38:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:06 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1209535698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:06 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3950807183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:06 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1153795475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:38:06.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.323+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8fa4005160 con 0x7f8fc0104150 2023-09-13T09:38:06.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.324+0000 7f8faf7fe700 1 -- 172.21.15.6:0/2807874265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v80) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8fb409a430 con 0x7f8fc0104150 2023-09-13T09:38:06.324 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:06.325 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-09-13T09:38:06.325 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T09:38:06.325 INFO:teuthology.orchestra.run.smithi006.stdout: "poolnum": 1, 2023-09-13T09:38:06.325 INFO:teuthology.orchestra.run.smithi006.stdout: "poolname": ".mgr" 2023-09-13T09:38:06.325 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:38:06.326 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-09-13T09:38:06.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8fa80a0640 msgr2=0x7f8fa80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8fa80a0640 0x7f8fa80a2b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8fb0005950 tx=0x7f8fb000b410 comp rx=0 tx=0).stop 2023-09-13T09:38:06.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 msgr2=0x7f8fc00ff7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc00ff7d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4004730 tx=0x7f8fb4004760 comp rx=0 tx=0).stop 2023-09-13T09:38:06.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 shutdown_connections 2023-09-13T09:38:06.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fc0106a80 0x7f8fc00ffd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8fc0101820 0x7f8fc0101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8fa80a0640 0x7f8fa80a2b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 --2- 172.21.15.6:0/2807874265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8fc0104150 0x7f8fc00ff7d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 >> 172.21.15.6:0/2807874265 conn(0x7f8fc00fb250 msgr2=0x7f8fc0102490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 shutdown_connections 2023-09-13T09:38:06.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.326+0000 7f8fad7fa700 1 -- 172.21.15.6:0/2807874265 wait complete. 2023-09-13T09:38:06.339 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-13T09:38:06.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-13T09:38:06.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 -- 172.21.15.6:0/3601445094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d480ffcc0 msgr2=0x7f3d481000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 --2- 172.21.15.6:0/3601445094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d480ffcc0 0x7f3d481000e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d380099c0 tx=0x7f3d38009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 -- 172.21.15.6:0/3601445094 shutdown_connections 2023-09-13T09:38:06.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 --2- 172.21.15.6:0/3601445094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d48101850 0x7f3d48108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 --2- 172.21.15.6:0/3601445094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d480ffcc0 0x7f3d481000e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 --2- 172.21.15.6:0/3601445094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d48100eb0 0x7f3d48101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 -- 172.21.15.6:0/3601445094 >> 172.21.15.6:0/3601445094 conn(0x7f3d480fb250 msgr2=0x7f3d480fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 -- 172.21.15.6:0/3601445094 shutdown_connections 2023-09-13T09:38:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 -- 172.21.15.6:0/3601445094 wait complete. 2023-09-13T09:38:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.474+0000 7f3d4d294700 1 Processor -- start 2023-09-13T09:38:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d4d294700 1 -- start start 2023-09-13T09:38:06.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d4d294700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d480ffcc0 0x7f3d48068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d4d294700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d48100eb0 0x7f3d4819b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d4d294700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48101850 0x7f3d4819de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d4d294700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4819e620 con 0x7f3d48101850 2023-09-13T09:38:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d4d294700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4819e790 con 0x7f3d48100eb0 2023-09-13T09:38:06.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d4d294700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d4819e950 con 0x7f3d480ffcc0 2023-09-13T09:38:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48101850 0x7f3d4819de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48101850 0x7f3d4819de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60364/0 (socket says 172.21.15.6:60364) 2023-09-13T09:38:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 -- 172.21.15.6:0/709430835 learned_addr learned my addr 172.21.15.6:0/709430835 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d467fc700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d48100eb0 0x7f3d4819b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d46ffd700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d480ffcc0 0x7f3d48068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 -- 172.21.15.6:0/709430835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d480ffcc0 msgr2=0x7f3d48068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d480ffcc0 0x7f3d48068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 -- 172.21.15.6:0/709430835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d48100eb0 msgr2=0x7f3d4819b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d48100eb0 0x7f3d4819b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:06.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 -- 172.21.15.6:0/709430835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380095f0 con 0x7f3d48101850 2023-09-13T09:38:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.475+0000 7f3d477fe700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48101850 0x7f3d4819de50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3d40007ee0 tx=0x7f3d4000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.476+0000 7f3d3ffff700 1 -- 172.21.15.6:0/709430835 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40017070 con 0x7f3d48101850 2023-09-13T09:38:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.476+0000 7f3d3ffff700 1 -- 172.21.15.6:0/709430835 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d4000f040 con 0x7f3d48101850 2023-09-13T09:38:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.476+0000 7f3d3ffff700 1 -- 172.21.15.6:0/709430835 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d40005580 con 0x7f3d48101850 2023-09-13T09:38:06.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.476+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d4819ec30 con 0x7f3d48101850 2023-09-13T09:38:06.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.476+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d4819f0f0 con 0x7f3d48101850 2023-09-13T09:38:06.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.477+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d4810b520 con 0x7f3d48101850 2023-09-13T09:38:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.478+0000 7f3d3ffff700 1 -- 172.21.15.6:0/709430835 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3d4000db20 con 0x7f3d48101850 2023-09-13T09:38:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.478+0000 7f3d3ffff700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d340a06c0 0x7f3d340a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.478+0000 7f3d3ffff700 1 -- 172.21.15.6:0/709430835 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f3d400cae00 con 0x7f3d48101850 2023-09-13T09:38:06.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.478+0000 7f3d46ffd700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d340a06c0 0x7f3d340a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.479+0000 7f3d46ffd700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d340a06c0 0x7f3d340a2b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800b580 tx=0x7f3d38009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:06.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.483+0000 7f3d3ffff700 1 -- 172.21.15.6:0/709430835 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3d40094dd0 con 0x7f3d48101850 2023-09-13T09:38:06.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:06 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1209535698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:06.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:06 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3950807183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:06.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:06 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1153795475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:38:06.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:06 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1209535698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:06 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3950807183' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:06 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1153795475' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:38:06.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:06.694+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3d4810b730 con 0x7f3d48101850 2023-09-13T09:38:07.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:07 smithi053 ceph-mon[102373]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:07.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:07 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2807874265' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-13T09:38:07.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:07 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/709430835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-13T09:38:07.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:07 smithi006 ceph-mon[98665]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:07 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2807874265' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-13T09:38:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:07 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/709430835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-13T09:38:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:07 smithi131 ceph-mon[102785]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:07.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:07 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2807874265' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-09-13T09:38:07.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:07 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/709430835' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-09-13T09:38:07.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:07.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.678+0000 7f3d3ffff700 1 -- 172.21.15.6:0/709430835 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v81) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3d400983f0 con 0x7f3d48101850 2023-09-13T09:38:07.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.683+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d340a06c0 msgr2=0x7f3d340a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:07.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.683+0000 7f3d4d294700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d340a06c0 0x7f3d340a2b80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d3800b580 tx=0x7f3d38009f10 comp rx=0 tx=0).stop 2023-09-13T09:38:07.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.683+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48101850 msgr2=0x7f3d4819de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:07.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.683+0000 7f3d4d294700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48101850 0x7f3d4819de50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3d40007ee0 tx=0x7f3d4000d3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 shutdown_connections 2023-09-13T09:38:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d340a06c0 0x7f3d340a2b80 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d48101850 0x7f3d4819de50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d480ffcc0 0x7f3d48068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 --2- 172.21.15.6:0/709430835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d48100eb0 0x7f3d4819b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 >> 172.21.15.6:0/709430835 conn(0x7f3d480fb250 msgr2=0x7f3d480fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:07.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 shutdown_connections 2023-09-13T09:38:07.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.684+0000 7f3d4d294700 1 -- 172.21.15.6:0/709430835 wait complete. 2023-09-13T09:38:07.686 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' created 2023-09-13T09:38:07.697 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-13T09:38:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 -- 172.21.15.6:0/4053216656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c100eb0 msgr2=0x7fcd7c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4053216656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c100eb0 0x7fcd7c101310 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c0099c0 tx=0x7fcd6c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 -- 172.21.15.6:0/4053216656 shutdown_connections 2023-09-13T09:38:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4053216656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c101850 0x7fcd7c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4053216656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd7c0ffcc0 0x7fcd7c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4053216656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c100eb0 0x7fcd7c101310 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 -- 172.21.15.6:0/4053216656 >> 172.21.15.6:0/4053216656 conn(0x7fcd7c0fb250 msgr2=0x7fcd7c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:07.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 -- 172.21.15.6:0/4053216656 shutdown_connections 2023-09-13T09:38:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 -- 172.21.15.6:0/4053216656 wait complete. 2023-09-13T09:38:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.835+0000 7fcd83a10700 1 Processor -- start 2023-09-13T09:38:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd83a10700 1 -- start start 2023-09-13T09:38:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd83a10700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c0ffcc0 0x7fcd7c068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:07.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd83a10700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd7c100eb0 0x7fcd7c19b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd83a10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c101850 0x7fcd7c19ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd83a10700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c19e590 con 0x7fcd7c101850 2023-09-13T09:38:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd83a10700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c19e700 con 0x7fcd7c100eb0 2023-09-13T09:38:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd83a10700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7c19e8c0 con 0x7fcd7c0ffcc0 2023-09-13T09:38:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c101850 0x7fcd7c19ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:07.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c101850 0x7fcd7c19ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60378/0 (socket says 172.21.15.6:60378) 2023-09-13T09:38:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 -- 172.21.15.6:0/4281906102 learned_addr learned my addr 172.21.15.6:0/4281906102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd817ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c0ffcc0 0x7fcd7c068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd80fab700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd7c100eb0 0x7fcd7c19b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 -- 172.21.15.6:0/4281906102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c0ffcc0 msgr2=0x7fcd7c068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:07.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c0ffcc0 0x7fcd7c068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 -- 172.21.15.6:0/4281906102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd7c100eb0 msgr2=0x7fcd7c19b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd7c100eb0 0x7fcd7c19b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:07.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 -- 172.21.15.6:0/4281906102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd6c0095f0 con 0x7fcd7c101850 2023-09-13T09:38:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd81fad700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c101850 0x7fcd7c19ddc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcd74007ee0 tx=0x7fcd7400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.836+0000 7fcd727fc700 1 -- 172.21.15.6:0/4281906102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74017070 con 0x7fcd7c101850 2023-09-13T09:38:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.837+0000 7fcd727fc700 1 -- 172.21.15.6:0/4281906102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcd7400f040 con 0x7fcd7c101850 2023-09-13T09:38:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.837+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7c19eba0 con 0x7fcd7c101850 2023-09-13T09:38:07.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.837+0000 7fcd727fc700 1 -- 172.21.15.6:0/4281906102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd74005740 con 0x7fcd7c101850 2023-09-13T09:38:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.837+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd7c19f080 con 0x7fcd7c101850 2023-09-13T09:38:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.837+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd7c106bf0 con 0x7fcd7c101850 2023-09-13T09:38:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.839+0000 7fcd727fc700 1 -- 172.21.15.6:0/4281906102 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcd7400dc60 con 0x7fcd7c101850 2023-09-13T09:38:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.839+0000 7fcd727fc700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd680a06c0 0x7fcd680a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.840+0000 7fcd817ac700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd680a06c0 0x7fcd680a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.840+0000 7fcd727fc700 1 -- 172.21.15.6:0/4281906102 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fcd740cb6d0 con 0x7fcd7c101850 2023-09-13T09:38:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.840+0000 7fcd817ac700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd680a06c0 0x7fcd680a2b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c100d10 tx=0x7fcd7800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:07.843+0000 7fcd727fc700 1 -- 172.21.15.6:0/4281906102 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fcd74095490 con 0x7fcd7c101850 2023-09-13T09:38:08.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.049+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcd7c10b4d0 con 0x7fcd7c101850 2023-09-13T09:38:08.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.680+0000 7fcd727fc700 1 -- 172.21.15.6:0/4281906102 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v82) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcd74098ab0 con 0x7fcd7c101850 2023-09-13T09:38:08.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.688+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd680a06c0 msgr2=0x7fcd680a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:08.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.688+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd680a06c0 0x7fcd680a2b80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c100d10 tx=0x7fcd7800b410 comp rx=0 tx=0).stop 2023-09-13T09:38:08.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.688+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c101850 msgr2=0x7fcd7c19ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:08.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.688+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c101850 0x7fcd7c19ddc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fcd74007ee0 tx=0x7fcd7400d3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.695+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 shutdown_connections 2023-09-13T09:38:08.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.695+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcd680a06c0 0x7fcd680a2b80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.695+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd7c101850 0x7fcd7c19ddc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.695+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcd7c0ffcc0 0x7fcd7c068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.695+0000 7fcd83a10700 1 --2- 172.21.15.6:0/4281906102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcd7c100eb0 0x7fcd7c19b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.695+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 >> 172.21.15.6:0/4281906102 conn(0x7fcd7c0fb250 msgr2=0x7fcd7c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:08.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.696+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 shutdown_connections 2023-09-13T09:38:08.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.697+0000 7fcd83a10700 1 -- 172.21.15.6:0/4281906102 wait complete. 2023-09-13T09:38:08.699 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' created 2023-09-13T09:38:08.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-13T09:38:08.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/709430835' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-13T09:38:08.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: osdmap e81: 12 total, 12 up, 12 in 2023-09-13T09:38:08.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:08.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:38:08.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:38:08.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:08 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4281906102' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-13T09:38:08.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/709430835' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-13T09:38:08.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: osdmap e81: 12 total, 12 up, 12 in 2023-09-13T09:38:08.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:08.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:38:08.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:38:08.763 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:08 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4281906102' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-13T09:38:08.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/709430835' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-09-13T09:38:08.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: osdmap e81: 12 total, 12 up, 12 in 2023-09-13T09:38:08.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:08.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:38:08.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:08.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:38:08.771 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:08 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4281906102' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-09-13T09:38:08.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 -- 172.21.15.6:0/498968394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c100920 msgr2=0x7fab7c1081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:08.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 --2- 172.21.15.6:0/498968394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c100920 0x7fab7c1081e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fab7400b0a0 tx=0x7fab7400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 -- 172.21.15.6:0/498968394 shutdown_connections 2023-09-13T09:38:08.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 --2- 172.21.15.6:0/498968394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c100920 0x7fab7c1081e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 --2- 172.21.15.6:0/498968394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c101250 0x7fab7c101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 --2- 172.21.15.6:0/498968394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c0fff80 0x7fab7c1003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 -- 172.21.15.6:0/498968394 >> 172.21.15.6:0/498968394 conn(0x7fab7c0fa9b0 msgr2=0x7fab7c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:08.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 -- 172.21.15.6:0/498968394 shutdown_connections 2023-09-13T09:38:08.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 -- 172.21.15.6:0/498968394 wait complete. 2023-09-13T09:38:08.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 Processor -- start 2023-09-13T09:38:08.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.845+0000 7fab83025700 1 -- start start 2023-09-13T09:38:08.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab83025700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c0fff80 0x7fab7c0ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:08.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab83025700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c100920 0x7fab7c19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:08.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab83025700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c101250 0x7fab7c19ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:08.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab83025700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c19e670 con 0x7fab7c101250 2023-09-13T09:38:08.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab83025700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c19e7e0 con 0x7fab7c100920 2023-09-13T09:38:08.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab83025700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7c19e9a0 con 0x7fab7c0fff80 2023-09-13T09:38:08.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c0fff80 0x7fab7c0ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:08.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab815c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c101250 0x7fab7c19ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:08.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c0fff80 0x7fab7c0ff9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:35210/0 (socket says 172.21.15.6:35210) 2023-09-13T09:38:08.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 -- 172.21.15.6:0/1818257909 learned_addr learned my addr 172.21.15.6:0/1818257909 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:08.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab7bfff700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c100920 0x7fab7c19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:08.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 -- 172.21.15.6:0/1818257909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c100920 msgr2=0x7fab7c19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:08.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c100920 0x7fab7c19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 -- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c101250 msgr2=0x7fab7c19ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:08.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c101250 0x7fab7c19ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:08.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 -- 172.21.15.6:0/1818257909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab74009d00 con 0x7fab7c0fff80 2023-09-13T09:38:08.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab815c2700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c101250 0x7fab7c19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:38:08.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab80dc1700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c0fff80 0x7fab7c0ff9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e970 tx=0x7fab7000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:08.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab79ffb700 1 -- 172.21.15.6:0/1818257909 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70009790 con 0x7fab7c0fff80 2023-09-13T09:38:08.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.846+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab7c19ec80 con 0x7fab7c0fff80 2023-09-13T09:38:08.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.847+0000 7fab79ffb700 1 -- 172.21.15.6:0/1818257909 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab7000c7e0 con 0x7fab7c0fff80 2023-09-13T09:38:08.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.847+0000 7fab79ffb700 1 -- 172.21.15.6:0/1818257909 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70003c70 con 0x7fab7c0fff80 2023-09-13T09:38:08.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.847+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7c19f190 con 0x7fab7c0fff80 2023-09-13T09:38:08.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.848+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab7c106cd0 con 0x7fab7c0fff80 2023-09-13T09:38:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.849+0000 7fab79ffb700 1 -- 172.21.15.6:0/1818257909 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fab7000cc50 con 0x7fab7c0fff80 2023-09-13T09:38:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.849+0000 7fab79ffb700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab6c0a0640 0x7fab6c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.849+0000 7fab7bfff700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab6c0a0640 0x7fab6c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.849+0000 7fab79ffb700 1 -- 172.21.15.6:0/1818257909 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fab70014070 con 0x7fab7c0fff80 2023-09-13T09:38:08.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.850+0000 7fab7bfff700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab6c0a0640 0x7fab6c0a2b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fab68009c60 tx=0x7fab68009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:08.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:08.857+0000 7fab79ffb700 1 -- 172.21.15.6:0/1818257909 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fab70095b00 con 0x7fab7c0fff80 2023-09-13T09:38:09.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.114+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fab7c19ee10 con 0x7fab7c0fff80 2023-09-13T09:38:09.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.735+0000 7fab79ffb700 1 -- 172.21.15.6:0/1818257909 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fab7c19ee10 con 0x7fab7c0fff80 2023-09-13T09:38:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab6c0a0640 msgr2=0x7fab6c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab6c0a0640 0x7fab6c0a2b00 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fab68009c60 tx=0x7fab68009260 comp rx=0 tx=0).stop 2023-09-13T09:38:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c0fff80 msgr2=0x7fab7c0ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c0fff80 0x7fab7c0ff9e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e970 tx=0x7fab7000ec80 comp rx=0 tx=0).stop 2023-09-13T09:38:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 shutdown_connections 2023-09-13T09:38:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab6c0a0640 0x7fab6c0a2b00 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab7c101250 0x7fab7c19ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab7c0fff80 0x7fab7c0ff9e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 --2- 172.21.15.6:0/1818257909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab7c100920 0x7fab7c19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 >> 172.21.15.6:0/1818257909 conn(0x7fab7c0fa9b0 msgr2=0x7fab7c0fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 shutdown_connections 2023-09-13T09:38:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.738+0000 7fab83025700 1 -- 172.21.15.6:0/1818257909 wait complete. 2023-09-13T09:38:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:new fs with metadata pool 2 and data pool 3 2023-09-13T09:38:09.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:38:09.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 -- 172.21.15.6:0/1814479015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 msgr2=0x7f1bd0103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/1814479015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0103c60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0009990 tx=0x7f1bc0009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 -- 172.21.15.6:0/1814479015 shutdown_connections 2023-09-13T09:38:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/1814479015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd0106ad0 0x7f1bd0108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/1814479015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0103c60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/1814479015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bd01041a0 0x7f1bd0106590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 -- 172.21.15.6:0/1814479015 >> 172.21.15.6:0/1814479015 conn(0x7f1bd00fb220 msgr2=0x7f1bd00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 -- 172.21.15.6:0/1814479015 shutdown_connections 2023-09-13T09:38:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.892+0000 7f1bd5f33700 1 -- 172.21.15.6:0/1814479015 wait complete. 2023-09-13T09:38:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 Processor -- start 2023-09-13T09:38:09.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 -- start start 2023-09-13T09:38:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bd01041a0 0x7f1bd0196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd0106ad0 0x7f1bd019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd019e600 con 0x7f1bd0101870 2023-09-13T09:38:09.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd019e740 con 0x7f1bd0106ad0 2023-09-13T09:38:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bd5f33700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd019e8d0 con 0x7f1bd01041a0 2023-09-13T09:38:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bcf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bcf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60408/0 (socket says 172.21.15.6:60408) 2023-09-13T09:38:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bcf7fe700 1 -- 172.21.15.6:0/2553676543 learned_addr learned my addr 172.21.15.6:0/2553676543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:09.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bceffd700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bd01041a0 0x7f1bd0196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.893+0000 7f1bcffff700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd0106ad0 0x7f1bd019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bcf7fe700 1 -- 172.21.15.6:0/2553676543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bd01041a0 msgr2=0x7f1bd0196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bcf7fe700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bd01041a0 0x7f1bd0196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bcf7fe700 1 -- 172.21.15.6:0/2553676543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd0106ad0 msgr2=0x7f1bd019e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:09.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bcf7fe700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd0106ad0 0x7f1bd019e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:09.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bcf7fe700 1 -- 172.21.15.6:0/2553676543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc00095f0 con 0x7f1bd0101870 2023-09-13T09:38:09.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bcf7fe700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0196a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0004730 tx=0x7f1bc0004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:09.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bccff9700 1 -- 172.21.15.6:0/2553676543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc001d070 con 0x7f1bd0101870 2023-09-13T09:38:09.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd019eb50 con 0x7f1bd0101870 2023-09-13T09:38:09.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bccff9700 1 -- 172.21.15.6:0/2553676543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1bc0004c90 con 0x7f1bd0101870 2023-09-13T09:38:09.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bccff9700 1 -- 172.21.15.6:0/2553676543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc00054b0 con 0x7f1bd0101870 2023-09-13T09:38:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.894+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd019ef70 con 0x7f1bd0101870 2023-09-13T09:38:09.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.895+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd00fcda0 con 0x7f1bd0101870 2023-09-13T09:38:09.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.896+0000 7f1bccff9700 1 -- 172.21.15.6:0/2553676543 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1bc000fbc0 con 0x7f1bd0101870 2023-09-13T09:38:09.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.897+0000 7f1bccff9700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bb80a0640 0x7f1bb80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:09.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.897+0000 7f1bccff9700 1 -- 172.21.15.6:0/2553676543 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f1bc00cd1a0 con 0x7f1bd0101870 2023-09-13T09:38:09.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.897+0000 7f1bceffd700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bb80a0640 0x7f1bb80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:09.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.897+0000 7f1bceffd700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bb80a0640 0x7f1bb80a2b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4005950 tx=0x7f1bc400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:09.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:09.901+0000 7f1bccff9700 1 -- 172.21.15.6:0/2553676543 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1bc0096e10 con 0x7f1bd0101870 2023-09-13T09:38:10.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:09 smithi006 ceph-mon[98665]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:09 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4281906102' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-13T09:38:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:09 smithi006 ceph-mon[98665]: osdmap e82: 12 total, 12 up, 12 in 2023-09-13T09:38:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:09 smithi006 ceph-mon[98665]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-13T09:38:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:09 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1818257909' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-13T09:38:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:09 smithi006 ceph-mon[98665]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-13T09:38:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:09 smithi006 ceph-mon[98665]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-13T09:38:10.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:09 smithi053 ceph-mon[102373]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:10.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:09 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4281906102' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-13T09:38:10.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:09 smithi053 ceph-mon[102373]: osdmap e82: 12 total, 12 up, 12 in 2023-09-13T09:38:10.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:09 smithi053 ceph-mon[102373]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-13T09:38:10.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:09 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1818257909' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-13T09:38:10.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:09 smithi053 ceph-mon[102373]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-13T09:38:10.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:09 smithi053 ceph-mon[102373]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-13T09:38:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:09 smithi131 ceph-mon[102785]: pgmap v252: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:09 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4281906102' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-09-13T09:38:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:09 smithi131 ceph-mon[102785]: osdmap e82: 12 total, 12 up, 12 in 2023-09-13T09:38:10.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:09 smithi131 ceph-mon[102785]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-09-13T09:38:10.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:09 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1818257909' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-13T09:38:10.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:09 smithi131 ceph-mon[102785]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-09-13T09:38:10.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:09 smithi131 ceph-mon[102785]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-09-13T09:38:10.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.109+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1bd010c790 con 0x7f1bd0101870 2023-09-13T09:38:10.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.111+0000 7f1bccff9700 1 -- 172.21.15.6:0/2553676543 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22014 (secure 0 0 0) 0x7f1bc009a430 con 0x7f1bd0101870 2023-09-13T09:38:10.111 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:10.112 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:09.115893+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:38:10.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bb80a0640 msgr2=0x7f1bb80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bb80a0640 0x7f1bb80a2b00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1bc4005950 tx=0x7f1bc400b410 comp rx=0 tx=0).stop 2023-09-13T09:38:10.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 msgr2=0x7f1bd0196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0196a80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1bc0004730 tx=0x7f1bc0004760 comp rx=0 tx=0).stop 2023-09-13T09:38:10.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 shutdown_connections 2023-09-13T09:38:10.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1bd0106ad0 0x7f1bd019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bb80a0640 0x7f1bb80a2b00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd0101870 0x7f1bd0196a80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 --2- 172.21.15.6:0/2553676543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bd01041a0 0x7f1bd0196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 >> 172.21.15.6:0/2553676543 conn(0x7f1bd00fb220 msgr2=0x7f1bd01024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:10.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 shutdown_connections 2023-09-13T09:38:10.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.113+0000 7f1bd5f33700 1 -- 172.21.15.6:0/2553676543 wait complete. 2023-09-13T09:38:10.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:38:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.255+0000 7f327ebe8700 1 -- 172.21.15.6:0/3261464885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3278102a90 msgr2=0x7f3278109340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.255+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3261464885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3278102a90 0x7f3278109340 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f327000b0a0 tx=0x7f327000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- 172.21.15.6:0/3261464885 shutdown_connections 2023-09-13T09:38:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3261464885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3278102a90 0x7f3278109340 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3261464885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32780ff080 0x7f32780ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3261464885 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32781020f0 0x7f3278102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- 172.21.15.6:0/3261464885 >> 172.21.15.6:0/3261464885 conn(0x7f32780fa990 msgr2=0x7f32780fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- 172.21.15.6:0/3261464885 shutdown_connections 2023-09-13T09:38:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- 172.21.15.6:0/3261464885 wait complete. 2023-09-13T09:38:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 Processor -- start 2023-09-13T09:38:10.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- start start 2023-09-13T09:38:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32780ff080 0x7f3278196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781020f0 0x7f32781970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3278102a90 0x7f327819e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327819e720 con 0x7f32781020f0 2023-09-13T09:38:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327819e860 con 0x7f32780ff080 2023-09-13T09:38:10.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.256+0000 7f327ebe8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327819e9f0 con 0x7f3278102a90 2023-09-13T09:38:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781020f0 0x7f32781970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781020f0 0x7f32781970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60424/0 (socket says 172.21.15.6:60424) 2023-09-13T09:38:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 -- 172.21.15.6:0/3607208783 learned_addr learned my addr 172.21.15.6:0/3607208783 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f327c984700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32780ff080 0x7f3278196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f327d185700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3278102a90 0x7f327819e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 -- 172.21.15.6:0/3607208783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3278102a90 msgr2=0x7f327819e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3278102a90 0x7f327819e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 -- 172.21.15.6:0/3607208783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32780ff080 msgr2=0x7f3278196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32780ff080 0x7f3278196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 -- 172.21.15.6:0/3607208783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009d00 con 0x7f32781020f0 2023-09-13T09:38:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3277fff700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781020f0 0x7f32781970e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f326400d950 tx=0x7f326400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3275ffb700 1 -- 172.21.15.6:0/3607208783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3264009b40 con 0x7f32781020f0 2023-09-13T09:38:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3275ffb700 1 -- 172.21.15.6:0/3607208783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3264009ca0 con 0x7f32781020f0 2023-09-13T09:38:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327819ecd0 con 0x7f32781020f0 2023-09-13T09:38:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f3275ffb700 1 -- 172.21.15.6:0/3607208783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326400f620 con 0x7f32781020f0 2023-09-13T09:38:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.257+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327819f190 con 0x7f32781020f0 2023-09-13T09:38:10.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.258+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3278108440 con 0x7f32781020f0 2023-09-13T09:38:10.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.259+0000 7f3275ffb700 1 -- 172.21.15.6:0/3607208783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3264010460 con 0x7f32781020f0 2023-09-13T09:38:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.260+0000 7f3275ffb700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32680a0640 0x7f32680a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.260+0000 7f3275ffb700 1 -- 172.21.15.6:0/3607208783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f32640cbd60 con 0x7f32781020f0 2023-09-13T09:38:10.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.260+0000 7f327c984700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32680a0640 0x7f32680a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.261+0000 7f327c984700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32680a0640 0x7f32680a2b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3278067cf0 tx=0x7f326c00b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:10.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.264+0000 7f3275ffb700 1 -- 172.21.15.6:0/3607208783 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f32640959e0 con 0x7f32781020f0 2023-09-13T09:38:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.479+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f327810c7c0 con 0x7f32781020f0 2023-09-13T09:38:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.480+0000 7f3275ffb700 1 -- 172.21.15.6:0/3607208783 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22014 (secure 0 0 0) 0x7f3264099000 con 0x7f32781020f0 2023-09-13T09:38:10.481 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:10.481 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":83,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:09.115893+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:38:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32680a0640 msgr2=0x7f32680a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32680a0640 0x7f32680a2b00 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3278067cf0 tx=0x7f326c00b5b0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781020f0 msgr2=0x7f32781970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781020f0 0x7f32781970e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f326400d950 tx=0x7f326400dd10 comp rx=0 tx=0).stop 2023-09-13T09:38:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 shutdown_connections 2023-09-13T09:38:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3278102a90 0x7f327819e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32780ff080 0x7f3278196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32680a0640 0x7f32680a2b00 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 --2- 172.21.15.6:0/3607208783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32781020f0 0x7f32781970e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 >> 172.21.15.6:0/3607208783 conn(0x7f32780fa990 msgr2=0x7f3278105580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 shutdown_connections 2023-09-13T09:38:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.483+0000 7f327ebe8700 1 -- 172.21.15.6:0/3607208783 wait complete. 2023-09-13T09:38:10.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-13T09:38:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2562269502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c104190 msgr2=0x7f8e5c106580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2562269502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c104190 0x7f8e5c106580 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f8e50009990 tx=0x7f8e50009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2562269502 shutdown_connections 2023-09-13T09:38:10.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2562269502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c106ba0 0x7f8e5c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2562269502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e5c101860 0x7f8e5c103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2562269502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c104190 0x7f8e5c106580 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2562269502 >> 172.21.15.6:0/2562269502 conn(0x7f8e5c0fb250 msgr2=0x7f8e5c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:10.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2562269502 shutdown_connections 2023-09-13T09:38:10.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.626+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2562269502 wait complete. 2023-09-13T09:38:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.627+0000 7f8e60b5a700 1 Processor -- start 2023-09-13T09:38:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.627+0000 7f8e60b5a700 1 -- start start 2023-09-13T09:38:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.627+0000 7f8e60b5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c101860 0x7f8e5c1011d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.627+0000 7f8e60b5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e5c104190 0x7f8e5c0ff810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e60b5a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c106ba0 0x7f8e5c0ffd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e60b5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1004f0 con 0x7f8e5c101860 2023-09-13T09:38:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e60b5a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c100660 con 0x7f8e5c106ba0 2023-09-13T09:38:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e60b5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1a0c00 con 0x7f8e5c104190 2023-09-13T09:38:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c101860 0x7f8e5c1011d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c101860 0x7f8e5c1011d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60436/0 (socket says 172.21.15.6:60436) 2023-09-13T09:38:10.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 -- 172.21.15.6:0/2261652724 learned_addr learned my addr 172.21.15.6:0/2261652724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5ad9d700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c106ba0 0x7f8e5c0ffd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e59d9b700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e5c104190 0x7f8e5c0ff810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 -- 172.21.15.6:0/2261652724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e5c104190 msgr2=0x7f8e5c0ff810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e5c104190 0x7f8e5c0ff810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 -- 172.21.15.6:0/2261652724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c106ba0 msgr2=0x7f8e5c0ffd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c106ba0 0x7f8e5c0ffd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 -- 172.21.15.6:0/2261652724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500095f0 con 0x7f8e5c101860 2023-09-13T09:38:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e5a59c700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c101860 0x7f8e5c1011d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d980 tx=0x7f8e4c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:10.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e4b7fe700 1 -- 172.21.15.6:0/2261652724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c004220 con 0x7f8e5c101860 2023-09-13T09:38:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c1a0ee0 con 0x7f8e5c101860 2023-09-13T09:38:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e4b7fe700 1 -- 172.21.15.6:0/2261652724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e4c007640 con 0x7f8e5c101860 2023-09-13T09:38:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e4b7fe700 1 -- 172.21.15.6:0/2261652724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c005690 con 0x7f8e5c101860 2023-09-13T09:38:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.628+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c1a1310 con 0x7f8e5c101860 2023-09-13T09:38:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.629+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c0fcdd0 con 0x7f8e5c101860 2023-09-13T09:38:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.631+0000 7f8e4b7fe700 1 -- 172.21.15.6:0/2261652724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8e4c004750 con 0x7f8e5c101860 2023-09-13T09:38:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.632+0000 7f8e4b7fe700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e440a0640 0x7f8e440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.632+0000 7f8e59d9b700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e440a0640 0x7f8e440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.632+0000 7f8e4b7fe700 1 -- 172.21.15.6:0/2261652724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8e4c0cbd90 con 0x7f8e5c101860 2023-09-13T09:38:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.632+0000 7f8e59d9b700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e440a0640 0x7f8e440a2b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b2e0 tx=0x7f8e50005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.635+0000 7f8e4b7fe700 1 -- 172.21.15.6:0/2261652724 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8e4c095a10 con 0x7f8e5c101860 2023-09-13T09:38:10.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: osdmap e83: 12 total, 12 up, 12 in 2023-09-13T09:38:10.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-13T09:38:10.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-13T09:38:10.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-13T09:38:10.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2553676543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:10.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3607208783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:10.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:10.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:10.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:10.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:10.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:10.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:10.895+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8e5c10c6c0 con 0x7f8e5c101860 2023-09-13T09:38:11.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: osdmap e83: 12 total, 12 up, 12 in 2023-09-13T09:38:11.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-13T09:38:11.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-13T09:38:11.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-13T09:38:11.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2553676543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:11.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3607208783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:11.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: osdmap e83: 12 total, 12 up, 12 in 2023-09-13T09:38:11.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-09-13T09:38:11.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-09-13T09:38:11.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-09-13T09:38:11.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2553676543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:11.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3607208783' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:11.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:11.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.741+0000 7f8e4b7fe700 1 -- 172.21.15.6:0/2261652724 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8e4c0160b0 con 0x7f8e5c101860 2023-09-13T09:38:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e440a0640 msgr2=0x7f8e440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:11.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e440a0640 0x7f8e440a2b00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8e5000b2e0 tx=0x7f8e50005fb0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c101860 msgr2=0x7f8e5c1011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c101860 0x7f8e5c1011d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00d980 tx=0x7f8e4c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:38:11.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 shutdown_connections 2023-09-13T09:38:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e5c106ba0 0x7f8e5c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e440a0640 0x7f8e440a2b00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e5c101860 0x7f8e5c1011d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 --2- 172.21.15.6:0/2261652724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e5c104190 0x7f8e5c0ff810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.744+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 >> 172.21.15.6:0/2261652724 conn(0x7f8e5c0fb250 msgr2=0x7f8e5c1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:11.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.745+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 shutdown_connections 2023-09-13T09:38:11.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.745+0000 7f8e60b5a700 1 -- 172.21.15.6:0/2261652724 wait complete. 2023-09-13T09:38:11.761 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2023-09-13T09:38:11.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-09-13T09:38:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3824848674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a84100eb0 msgr2=0x7f9a84101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3824848674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a84100eb0 0x7f9a84101310 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9a780099c0 tx=0x7f9a78009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3824848674 shutdown_connections 2023-09-13T09:38:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3824848674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a84101850 0x7f9a84108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3824848674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a840ffcc0 0x7f9a841000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3824848674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a84100eb0 0x7f9a84101310 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3824848674 >> 172.21.15.6:0/3824848674 conn(0x7f9a840fb250 msgr2=0x7f9a840fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3824848674 shutdown_connections 2023-09-13T09:38:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3824848674 wait complete. 2023-09-13T09:38:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.900+0000 7f9a89c0d700 1 Processor -- start 2023-09-13T09:38:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 -- start start 2023-09-13T09:38:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840ffcc0 0x7f9a841969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a84100eb0 0x7f9a84196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a84101850 0x7f9a8419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8419e530 con 0x7f9a840ffcc0 2023-09-13T09:38:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8419e670 con 0x7f9a84100eb0 2023-09-13T09:38:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8419e800 con 0x7f9a84101850 2023-09-13T09:38:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840ffcc0 0x7f9a841969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840ffcc0 0x7f9a841969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60450/0 (socket says 172.21.15.6:60450) 2023-09-13T09:38:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 -- 172.21.15.6:0/3002610876 learned_addr learned my addr 172.21.15.6:0/3002610876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:11.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 -- 172.21.15.6:0/3002610876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a84101850 msgr2=0x7f9a8419df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:11.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a84101850 0x7f9a8419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 -- 172.21.15.6:0/3002610876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a84100eb0 msgr2=0x7f9a84196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:11.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a84100eb0 0x7f9a84196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:11.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 -- 172.21.15.6:0/3002610876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a780095f0 con 0x7f9a840ffcc0 2023-09-13T09:38:11.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a837fe700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840ffcc0 0x7f9a841969b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c990 tx=0x7f9a7400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:11.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a80ff9700 1 -- 172.21.15.6:0/3002610876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74007b00 con 0x7f9a840ffcc0 2023-09-13T09:38:11.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a80ff9700 1 -- 172.21.15.6:0/3002610876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9a74007c60 con 0x7f9a840ffcc0 2023-09-13T09:38:11.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8419eae0 con 0x7f9a840ffcc0 2023-09-13T09:38:11.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a80ff9700 1 -- 172.21.15.6:0/3002610876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a74018660 con 0x7f9a840ffcc0 2023-09-13T09:38:11.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.901+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8419eff0 con 0x7f9a840ffcc0 2023-09-13T09:38:11.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.902+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a8410b520 con 0x7f9a840ffcc0 2023-09-13T09:38:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.904+0000 7f9a80ff9700 1 -- 172.21.15.6:0/3002610876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9a74004020 con 0x7f9a840ffcc0 2023-09-13T09:38:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.904+0000 7f9a80ff9700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9a6c0a0640 0x7f9a6c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.904+0000 7f9a80ff9700 1 -- 172.21.15.6:0/3002610876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9a740cbb50 con 0x7f9a840ffcc0 2023-09-13T09:38:11.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.904+0000 7f9a82ffd700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9a6c0a0640 0x7f9a6c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:11.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.905+0000 7f9a82ffd700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9a6c0a0640 0x7f9a6c0a2b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009fd0 tx=0x7f9a78000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:11.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:11.908+0000 7f9a80ff9700 1 -- 172.21.15.6:0/3002610876 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9a74095860 con 0x7f9a840ffcc0 2023-09-13T09:38:12.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: pgmap v255: 97 pgs: 11 creating+peering, 2 active+clean, 84 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:12.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:12.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: osdmap e84: 12 total, 12 up, 12 in 2023-09-13T09:38:12.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:38:12.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:12.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-09-13T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: Cluster is now healthy 2023-09-13T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] up:active 2023-09-13T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:12.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:11 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2261652724' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-13T09:38:12.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: pgmap v255: 97 pgs: 11 creating+peering, 2 active+clean, 84 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:12.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:12.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: osdmap e84: 12 total, 12 up, 12 in 2023-09-13T09:38:12.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:38:12.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:12.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-09-13T09:38:12.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: Cluster is now healthy 2023-09-13T09:38:12.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] up:active 2023-09-13T09:38:12.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:12.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:12.011 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:11 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2261652724' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-13T09:38:12.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: pgmap v255: 97 pgs: 11 creating+peering, 2 active+clean, 84 unknown; 577 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T09:38:12.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:38:12.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: osdmap e84: 12 total, 12 up, 12 in 2023-09-13T09:38:12.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:38:12.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:38:12.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-09-13T09:38:12.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: Cluster is now healthy 2023-09-13T09:38:12.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] up:active 2023-09-13T09:38:12.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:12.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:12.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:11 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2261652724' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-09-13T09:38:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.157+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f9a8419f2a0 con 0x7f9a840ffcc0 2023-09-13T09:38:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.744+0000 7f9a80ff9700 1 -- 172.21.15.6:0/3002610876 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f9a74098e80 con 0x7f9a840ffcc0 2023-09-13T09:38:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9a6c0a0640 msgr2=0x7f9a6c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9a6c0a0640 0x7f9a6c0a2b00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a78009fd0 tx=0x7f9a78000bc0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840ffcc0 msgr2=0x7f9a841969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840ffcc0 0x7f9a841969b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9a7400c990 tx=0x7f9a7400cd50 comp rx=0 tx=0).stop 2023-09-13T09:38:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 shutdown_connections 2023-09-13T09:38:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a84101850 0x7f9a8419df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9a6c0a0640 0x7f9a6c0a2b00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a840ffcc0 0x7f9a841969b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 --2- 172.21.15.6:0/3002610876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9a84100eb0 0x7f9a84196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 >> 172.21.15.6:0/3002610876 conn(0x7f9a840fb250 msgr2=0x7f9a84068090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.747+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 shutdown_connections 2023-09-13T09:38:12.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.748+0000 7f9a89c0d700 1 -- 172.21.15.6:0/3002610876 wait complete. 2023-09-13T09:38:12.765 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-09-13T09:38:12.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 -- 172.21.15.6:0/2280864271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 msgr2=0x7f867c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:12.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 --2- 172.21.15.6:0/2280864271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c108100 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f867400b0d0 tx=0x7f867400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 -- 172.21.15.6:0/2280864271 shutdown_connections 2023-09-13T09:38:12.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 --2- 172.21.15.6:0/2280864271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c108100 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 --2- 172.21.15.6:0/2280864271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0ffcc0 0x7f867c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 --2- 172.21.15.6:0/2280864271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f867c100eb0 0x7f867c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 -- 172.21.15.6:0/2280864271 >> 172.21.15.6:0/2280864271 conn(0x7f867c0fb250 msgr2=0x7f867c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:12.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 -- 172.21.15.6:0/2280864271 shutdown_connections 2023-09-13T09:38:12.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.901+0000 7f8680f32700 1 -- 172.21.15.6:0/2280864271 wait complete. 2023-09-13T09:38:12.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 Processor -- start 2023-09-13T09:38:12.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 -- start start 2023-09-13T09:38:12.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0ffcc0 0x7f867c195af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:12.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f867c100eb0 0x7f867c196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:12.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c19d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:12.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c19d670 con 0x7f867c101850 2023-09-13T09:38:12.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c19d7b0 con 0x7f867c100eb0 2023-09-13T09:38:12.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8680f32700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c19d940 con 0x7f867c0ffcc0 2023-09-13T09:38:12.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c19d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:12.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c19d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60468/0 (socket says 172.21.15.6:60468) 2023-09-13T09:38:12.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 -- 172.21.15.6:0/3851769782 learned_addr learned my addr 172.21.15.6:0/3851769782 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:12.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f8679d9b700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f867c100eb0 0x7f867c196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:12.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867a59c700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0ffcc0 0x7f867c195af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:12.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 -- 172.21.15.6:0/3851769782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0ffcc0 msgr2=0x7f867c195af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:12.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0ffcc0 0x7f867c195af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 -- 172.21.15.6:0/3851769782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f867c100eb0 msgr2=0x7f867c196030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f867c100eb0 0x7f867c196030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 -- 172.21.15.6:0/3851769782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009d00 con 0x7f867c101850 2023-09-13T09:38:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867a59c700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0ffcc0 0x7f867c195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.902+0000 7f867ad9d700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c19d0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8674008f10 tx=0x7f8674008f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.903+0000 7f866b7fe700 1 -- 172.21.15.6:0/3851769782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400e040 con 0x7f867c101850 2023-09-13T09:38:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.903+0000 7f866b7fe700 1 -- 172.21.15.6:0/3851769782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f867400be60 con 0x7f867c101850 2023-09-13T09:38:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.903+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c19dbc0 con 0x7f867c101850 2023-09-13T09:38:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.903+0000 7f866b7fe700 1 -- 172.21.15.6:0/3851769782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867401b6a0 con 0x7f867c101850 2023-09-13T09:38:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.903+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c19dfe0 con 0x7f867c101850 2023-09-13T09:38:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.904+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c107230 con 0x7f867c101850 2023-09-13T09:38:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.905+0000 7f866b7fe700 1 -- 172.21.15.6:0/3851769782 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8674024410 con 0x7f867c101850 2023-09-13T09:38:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.905+0000 7f866b7fe700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86640a0640 0x7f86640a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.905+0000 7f867a59c700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86640a0640 0x7f86640a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.905+0000 7f866b7fe700 1 -- 172.21.15.6:0/3851769782 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f86740ccc70 con 0x7f867c101850 2023-09-13T09:38:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.906+0000 7f867a59c700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86640a0640 0x7f86640a2b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f867c100d10 tx=0x7f866c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:12.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:12.910+0000 7f866b7fe700 1 -- 172.21.15.6:0/3851769782 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8674096980 con 0x7f867c101850 2023-09-13T09:38:13.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:12 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2261652724' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-13T09:38:13.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:12 smithi006 ceph-mon[98665]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:13.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:12 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3002610876' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-09-13T09:38:13.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:12 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2261652724' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-13T09:38:13.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:12 smithi053 ceph-mon[102373]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:13.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:12 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3002610876' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-09-13T09:38:13.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:12 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2261652724' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-09-13T09:38:13.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:12 smithi131 ceph-mon[102785]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:13.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:12 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3002610876' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-09-13T09:38:13.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.162+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7f867c10b670 con 0x7f867c101850 2023-09-13T09:38:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.750+0000 7f866b7fe700 1 -- 172.21.15.6:0/3851769782 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7f8674099fa0 con 0x7f867c101850 2023-09-13T09:38:13.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86640a0640 msgr2=0x7f86640a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86640a0640 0x7f86640a2b00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f867c100d10 tx=0x7f866c009260 comp rx=0 tx=0).stop 2023-09-13T09:38:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 msgr2=0x7f867c19d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c19d0a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8674008f10 tx=0x7f8674008f40 comp rx=0 tx=0).stop 2023-09-13T09:38:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 shutdown_connections 2023-09-13T09:38:13.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86640a0640 0x7f86640a2b00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f867c101850 0x7f867c19d0a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f867c0ffcc0 0x7f867c195af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 --2- 172.21.15.6:0/3851769782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f867c100eb0 0x7f867c196030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.753+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 >> 172.21.15.6:0/3851769782 conn(0x7f867c0fb250 msgr2=0x7f867c104370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:13.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.754+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 shutdown_connections 2023-09-13T09:38:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.754+0000 7f8680f32700 1 -- 172.21.15.6:0/3851769782 wait complete. 2023-09-13T09:38:13.774 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-09-13T09:38:13.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 -- 172.21.15.6:0/2666933399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740100dc0 msgr2=0x7f07401011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:13.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 --2- 172.21.15.6:0/2666933399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740100dc0 0x7f07401011e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f07300099c0 tx=0x7f0730009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 -- 172.21.15.6:0/2666933399 shutdown_connections 2023-09-13T09:38:13.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 --2- 172.21.15.6:0/2666933399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0740102950 0x7f0740109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 --2- 172.21.15.6:0/2666933399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740100dc0 0x7f07401011e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 --2- 172.21.15.6:0/2666933399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740101fb0 0x7f0740102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 -- 172.21.15.6:0/2666933399 >> 172.21.15.6:0/2666933399 conn(0x7f07400fc330 msgr2=0x7f07400fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:13.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.909+0000 7f074628b700 1 -- 172.21.15.6:0/2666933399 shutdown_connections 2023-09-13T09:38:13.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 -- 172.21.15.6:0/2666933399 wait complete. 2023-09-13T09:38:13.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 Processor -- start 2023-09-13T09:38:13.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 -- start start 2023-09-13T09:38:13.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740100dc0 0x7f0740196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:13.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0740101fb0 0x7f0740197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:13.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740102950 0x7f074019e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:13.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074019e650 con 0x7f0740102950 2023-09-13T09:38:13.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074019e790 con 0x7f0740101fb0 2023-09-13T09:38:13.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.910+0000 7f074628b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074019e920 con 0x7f0740100dc0 2023-09-13T09:38:13.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740102950 0x7f074019e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:13.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740102950 0x7f074019e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60482/0 (socket says 172.21.15.6:60482) 2023-09-13T09:38:13.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 -- 172.21.15.6:0/1386448945 learned_addr learned my addr 172.21.15.6:0/1386448945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:13.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f073ffff700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740100dc0 0x7f0740196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:13.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f073f7fe700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0740101fb0 0x7f0740197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:13.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 -- 172.21.15.6:0/1386448945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740100dc0 msgr2=0x7f0740196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:13.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740100dc0 0x7f0740196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 -- 172.21.15.6:0/1386448945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0740101fb0 msgr2=0x7f0740197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:13.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0740101fb0 0x7f0740197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:13.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 -- 172.21.15.6:0/1386448945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07300095f0 con 0x7f0740102950 2023-09-13T09:38:13.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f073ffff700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740100dc0 0x7f0740196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:13.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f073f7fe700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0740101fb0 0x7f0740197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:13.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f0744828700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740102950 0x7f074019e080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0738007ee0 tx=0x7f073800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:13.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f073d7fa700 1 -- 172.21.15.6:0/1386448945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073800ddd0 con 0x7f0740102950 2023-09-13T09:38:13.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f073d7fa700 1 -- 172.21.15.6:0/1386448945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f073800f040 con 0x7f0740102950 2023-09-13T09:38:13.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f074019ec00 con 0x7f0740102950 2023-09-13T09:38:13.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f073d7fa700 1 -- 172.21.15.6:0/1386448945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738015400 con 0x7f0740102950 2023-09-13T09:38:13.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.911+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f074019f160 con 0x7f0740102950 2023-09-13T09:38:13.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.912+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0740108350 con 0x7f0740102950 2023-09-13T09:38:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.913+0000 7f073d7fa700 1 -- 172.21.15.6:0/1386448945 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0738004020 con 0x7f0740102950 2023-09-13T09:38:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.914+0000 7f073d7fa700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07280a06c0 0x7f07280a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.914+0000 7f073ffff700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07280a06c0 0x7f07280a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.914+0000 7f073d7fa700 1 -- 172.21.15.6:0/1386448945 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f07380cb320 con 0x7f0740102950 2023-09-13T09:38:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.915+0000 7f073ffff700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07280a06c0 0x7f07280a2b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f073000b580 tx=0x7f0730005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:13.919+0000 7f073d7fa700 1 -- 172.21.15.6:0/1386448945 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f073804ee10 con 0x7f0740102950 2023-09-13T09:38:14.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: pgmap v257: 97 pgs: 11 creating+peering, 56 active+clean, 30 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2023-09-13T09:38:14.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-13T09:38:14.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3002610876' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-09-13T09:38:14.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-13T09:38:14.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:14.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-09-13T09:38:14.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-09-13T09:38:14.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:13 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3851769782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-13T09:38:14.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: pgmap v257: 97 pgs: 11 creating+peering, 56 active+clean, 30 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2023-09-13T09:38:14.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-13T09:38:14.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3002610876' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-09-13T09:38:14.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-13T09:38:14.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:14.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-09-13T09:38:14.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-09-13T09:38:14.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:13 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3851769782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-13T09:38:14.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: pgmap v257: 97 pgs: 11 creating+peering, 56 active+clean, 30 unknown; 579 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s wr, 4 op/s 2023-09-13T09:38:14.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-09-13T09:38:14.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3002610876' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-09-13T09:38:14.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-09-13T09:38:14.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-09-13T09:38:14.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-09-13T09:38:14.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-09-13T09:38:14.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:13 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3851769782' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-09-13T09:38:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.169+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f074010c620 con 0x7f0740102950 2023-09-13T09:38:14.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.765+0000 7f073d7fa700 1 -- 172.21.15.6:0/1386448945 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f0738094fa0 con 0x7f0740102950 2023-09-13T09:38:14.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.768+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07280a06c0 msgr2=0x7f07280a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:14.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.768+0000 7f074628b700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07280a06c0 0x7f07280a2b80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f073000b580 tx=0x7f0730005fb0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.768+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740102950 msgr2=0x7f074019e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:14.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.768+0000 7f074628b700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740102950 0x7f074019e080 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0738007ee0 tx=0x7f073800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.768+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 shutdown_connections 2023-09-13T09:38:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.768+0000 7f074628b700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07280a06c0 0x7f07280a2b80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.769+0000 7f074628b700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0740102950 0x7f074019e080 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.769+0000 7f074628b700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0740100dc0 0x7f0740196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.769+0000 7f074628b700 1 --2- 172.21.15.6:0/1386448945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0740101fb0 0x7f0740197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.769+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 >> 172.21.15.6:0/1386448945 conn(0x7f07400fc330 msgr2=0x7f0740105490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.769+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 shutdown_connections 2023-09-13T09:38:14.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.769+0000 7f074628b700 1 -- 172.21.15.6:0/1386448945 wait complete. 2023-09-13T09:38:14.788 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2023-09-13T09:38:14.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-09-13T09:38:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.925+0000 7f36256e5700 1 -- 172.21.15.6:0/2705568563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620101f60 msgr2=0x7f36201023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.925+0000 7f36256e5700 1 --2- 172.21.15.6:0/2705568563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620101f60 0x7f36201023c0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f36100099c0 tx=0x7f3610009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 -- 172.21.15.6:0/2705568563 shutdown_connections 2023-09-13T09:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 --2- 172.21.15.6:0/2705568563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3620102900 0x7f36201091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 --2- 172.21.15.6:0/2705568563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3620100d70 0x7f3620101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 --2- 172.21.15.6:0/2705568563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620101f60 0x7f36201023c0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 -- 172.21.15.6:0/2705568563 >> 172.21.15.6:0/2705568563 conn(0x7f36200fc2e0 msgr2=0x7f36200fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 -- 172.21.15.6:0/2705568563 shutdown_connections 2023-09-13T09:38:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 -- 172.21.15.6:0/2705568563 wait complete. 2023-09-13T09:38:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.926+0000 7f36256e5700 1 Processor -- start 2023-09-13T09:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f36256e5700 1 -- start start 2023-09-13T09:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f36256e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620100d70 0x7f3620196980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f36256e5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3620101f60 0x7f3620196ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f36256e5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3620102900 0x7f362019df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f36256e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362019e500 con 0x7f3620100d70 2023-09-13T09:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f36256e5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362019e640 con 0x7f3620101f60 2023-09-13T09:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f36256e5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362019e7d0 con 0x7f3620102900 2023-09-13T09:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620100d70 0x7f3620196980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620100d70 0x7f3620196980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60490/0 (socket says 172.21.15.6:60490) 2023-09-13T09:38:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 -- 172.21.15.6:0/3075815541 learned_addr learned my addr 172.21.15.6:0/3075815541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361e7fc700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3620101f60 0x7f3620196ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361f7fe700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3620102900 0x7f362019df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 -- 172.21.15.6:0/3075815541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3620102900 msgr2=0x7f362019df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3620102900 0x7f362019df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 -- 172.21.15.6:0/3075815541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3620101f60 msgr2=0x7f3620196ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3620101f60 0x7f3620196ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 -- 172.21.15.6:0/3075815541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36100095f0 con 0x7f3620100d70 2023-09-13T09:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.927+0000 7f361effd700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620100d70 0x7f3620196980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f361400c990 tx=0x7f361400cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:14.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.928+0000 7f3607fff700 1 -- 172.21.15.6:0/3075815541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614007b00 con 0x7f3620100d70 2023-09-13T09:38:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.928+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362019eab0 con 0x7f3620100d70 2023-09-13T09:38:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.928+0000 7f3607fff700 1 -- 172.21.15.6:0/3075815541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3614007c60 con 0x7f3620100d70 2023-09-13T09:38:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.928+0000 7f3607fff700 1 -- 172.21.15.6:0/3075815541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f361400fea0 con 0x7f3620100d70 2023-09-13T09:38:14.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.928+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362019efc0 con 0x7f3620100d70 2023-09-13T09:38:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.929+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3620108270 con 0x7f3620100d70 2023-09-13T09:38:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.930+0000 7f3607fff700 1 -- 172.21.15.6:0/3075815541 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f361400f450 con 0x7f3620100d70 2023-09-13T09:38:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.930+0000 7f3607fff700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36080a0640 0x7f36080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.930+0000 7f3607fff700 1 -- 172.21.15.6:0/3075815541 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f36140cbb10 con 0x7f3620100d70 2023-09-13T09:38:14.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.930+0000 7f361e7fc700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36080a0640 0x7f36080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.931+0000 7f361e7fc700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36080a0640 0x7f36080a2b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3610000c00 tx=0x7f3610009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:14.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:14.934+0000 7f3607fff700 1 -- 172.21.15.6:0/3075815541 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3614095820 con 0x7f3620100d70 2023-09-13T09:38:15.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:14 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] up:active 2023-09-13T09:38:15.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:14 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3851769782' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-13T09:38:15.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:14 smithi131 ceph-mon[102785]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-13T09:38:15.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:14 smithi131 ceph-mon[102785]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-09-13T09:38:15.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:14 smithi131 ceph-mon[102785]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-09-13T09:38:15.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:14 smithi131 ceph-mon[102785]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-09-13T09:38:15.021 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:14 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1386448945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-13T09:38:15.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.168+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f362002cf20 con 0x7f36080a0640 2023-09-13T09:38:15.175 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:14 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] up:active 2023-09-13T09:38:15.175 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:14 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3851769782' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-13T09:38:15.175 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:14 smithi006 ceph-mon[98665]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-13T09:38:15.175 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:14 smithi006 ceph-mon[98665]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-09-13T09:38:15.176 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:14 smithi006 ceph-mon[98665]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-09-13T09:38:15.176 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:14 smithi006 ceph-mon[98665]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-09-13T09:38:15.176 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:14 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1386448945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-13T09:38:15.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.222+0000 7f3607fff700 1 -- 172.21.15.6:0/3075815541 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f362002cf20 con 0x7f36080a0640 2023-09-13T09:38:15.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36080a0640 msgr2=0x7f36080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36080a0640 0x7f36080a2b00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f3610000c00 tx=0x7f3610009f10 comp rx=0 tx=0).stop 2023-09-13T09:38:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620100d70 msgr2=0x7f3620196980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620100d70 0x7f3620196980 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f361400c990 tx=0x7f361400cca0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 shutdown_connections 2023-09-13T09:38:15.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3620102900 0x7f362019df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36080a0640 0x7f36080a2b00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3620100d70 0x7f3620196980 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 --2- 172.21.15.6:0/3075815541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3620101f60 0x7f3620196ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 >> 172.21.15.6:0/3075815541 conn(0x7f36200fc2e0 msgr2=0x7f36201053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:15.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 shutdown_connections 2023-09-13T09:38:15.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.225+0000 7f36256e5700 1 -- 172.21.15.6:0/3075815541 wait complete. 2023-09-13T09:38:15.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-09-13T09:38:15.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] up:active 2023-09-13T09:38:15.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3851769782' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-09-13T09:38:15.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-mon[102373]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-09-13T09:38:15.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-mon[102373]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-09-13T09:38:15.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-mon[102373]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-09-13T09:38:15.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-mon[102373]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-09-13T09:38:15.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1386448945' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-09-13T09:38:15.258 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: 2023-09-13T09:38:14.962+0000 7f5d6c5fb700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-13T09:38:15.258 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: 2023-09-13T09:38:14.962+0000 7f5d6c5fb700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-09-13T09:38:15.258 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: 2023-09-13T09:38:14.962+0000 7f5d6c5fb700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2023-09-13T09:38:15.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.366+0000 7fbc319c2700 1 -- 172.21.15.6:0/2286582726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c100e90 msgr2=0x7fbc2c1012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.366+0000 7fbc319c2700 1 --2- 172.21.15.6:0/2286582726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c100e90 0x7fbc2c1012f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbc200099c0 tx=0x7fbc20009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.366+0000 7fbc319c2700 1 -- 172.21.15.6:0/2286582726 shutdown_connections 2023-09-13T09:38:15.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.366+0000 7fbc319c2700 1 --2- 172.21.15.6:0/2286582726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc2c101830 0x7fbc2c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.366+0000 7fbc319c2700 1 --2- 172.21.15.6:0/2286582726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc2c0ffca0 0x7fbc2c1000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.366+0000 7fbc319c2700 1 --2- 172.21.15.6:0/2286582726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c100e90 0x7fbc2c1012f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.366+0000 7fbc319c2700 1 -- 172.21.15.6:0/2286582726 >> 172.21.15.6:0/2286582726 conn(0x7fbc2c0fb1f0 msgr2=0x7fbc2c0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 -- 172.21.15.6:0/2286582726 shutdown_connections 2023-09-13T09:38:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 -- 172.21.15.6:0/2286582726 wait complete. 2023-09-13T09:38:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 Processor -- start 2023-09-13T09:38:15.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 -- start start 2023-09-13T09:38:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc2c0ffca0 0x7fbc2c069d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc2c100e90 0x7fbc2c19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c101830 0x7fbc2c19ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c19e560 con 0x7fbc2c101830 2023-09-13T09:38:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c19e6d0 con 0x7fbc2c100e90 2023-09-13T09:38:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.367+0000 7fbc319c2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c19e890 con 0x7fbc2c0ffca0 2023-09-13T09:38:15.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c101830 0x7fbc2c19ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c101830 0x7fbc2c19ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60528/0 (socket says 172.21.15.6:60528) 2023-09-13T09:38:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 -- 172.21.15.6:0/248227912 learned_addr learned my addr 172.21.15.6:0/248227912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2a7fc700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc2c100e90 0x7fbc2c19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2affd700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc2c0ffca0 0x7fbc2c069d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 -- 172.21.15.6:0/248227912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc2c0ffca0 msgr2=0x7fbc2c069d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc2c0ffca0 0x7fbc2c069d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 -- 172.21.15.6:0/248227912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc2c100e90 msgr2=0x7fbc2c19b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc2c100e90 0x7fbc2c19b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 -- 172.21.15.6:0/248227912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc200095f0 con 0x7fbc2c101830 2023-09-13T09:38:15.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2a7fc700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc2c100e90 0x7fbc2c19b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc2b7fe700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c101830 0x7fbc2c19ddc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc24007ee0 tx=0x7fbc2400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc309c0700 1 -- 172.21.15.6:0/248227912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24017070 con 0x7fbc2c101830 2023-09-13T09:38:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc309c0700 1 -- 172.21.15.6:0/248227912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc2400f040 con 0x7fbc2c101830 2023-09-13T09:38:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc2c19eb70 con 0x7fbc2c101830 2023-09-13T09:38:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc309c0700 1 -- 172.21.15.6:0/248227912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc24005740 con 0x7fbc2c101830 2023-09-13T09:38:15.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.368+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc2c19f080 con 0x7fbc2c101830 2023-09-13T09:38:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.369+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc2c107280 con 0x7fbc2c101830 2023-09-13T09:38:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.370+0000 7fbc309c0700 1 -- 172.21.15.6:0/248227912 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbc240058a0 con 0x7fbc2c101830 2023-09-13T09:38:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.371+0000 7fbc309c0700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc140a06c0 0x7fbc140a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.371+0000 7fbc309c0700 1 -- 172.21.15.6:0/248227912 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbc240cb8e0 con 0x7fbc2c101830 2023-09-13T09:38:15.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.371+0000 7fbc2affd700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc140a06c0 0x7fbc140a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.371+0000 7fbc2affd700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc140a06c0 0x7fbc140a2b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c005950 tx=0x7fbc1c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:15.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.374+0000 7fbc309c0700 1 -- 172.21.15.6:0/248227912 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbc24095560 con 0x7fbc2c101830 2023-09-13T09:38:15.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:38:15.174+0000 7fc3414cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-13T09:38:15.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:38:15.174+0000 7fc3414cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-13T09:38:15.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:38:15.174+0000 7fc3414cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-13T09:38:15.506 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:38:15.174+0000 7fc3414cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-13T09:38:15.507 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T09:38:15.174+0000 7fc3414cb700 -1 client.0 error registering admin socket command: (17) File exists 2023-09-13T09:38:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.610+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc2c02d010 con 0x7fbc140a06c0 2023-09-13T09:38:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.615+0000 7fbc309c0700 1 -- 172.21.15.6:0/248227912 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fbc2c02d010 con 0x7fbc140a06c0 2023-09-13T09:38:15.615 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/_nogroup/sv_0/f2d28c1e-7669-4a24-beff-dd2ebfb28ac4 2023-09-13T09:38:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc140a06c0 msgr2=0x7fbc140a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc140a06c0 0x7fbc140a2b80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbc1c005950 tx=0x7fbc1c0058e0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c101830 msgr2=0x7fbc2c19ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c101830 0x7fbc2c19ddc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbc24007ee0 tx=0x7fbc2400d3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 shutdown_connections 2023-09-13T09:38:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc140a06c0 0x7fbc140a2b80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc2c101830 0x7fbc2c19ddc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc2c0ffca0 0x7fbc2c069d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 --2- 172.21.15.6:0/248227912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc2c100e90 0x7fbc2c19b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.617+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 >> 172.21.15.6:0/248227912 conn(0x7fbc2c0fb1f0 msgr2=0x7fbc2c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.618+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 shutdown_connections 2023-09-13T09:38:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.618+0000 7fbc319c2700 1 -- 172.21.15.6:0/248227912 wait complete. 2023-09-13T09:38:15.630 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-09-13T09:38:15.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 -- 172.21.15.6:0/3199276287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 msgr2=0x7f16c8108ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 --2- 172.21.15.6:0/3199276287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c8108ec0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f16c000b0a0 tx=0x7f16c000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 -- 172.21.15.6:0/3199276287 shutdown_connections 2023-09-13T09:38:15.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 --2- 172.21.15.6:0/3199276287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c8108ec0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 --2- 172.21.15.6:0/3199276287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c81017f0 0x7f16c8103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 --2- 172.21.15.6:0/3199276287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c8104120 0x7f16c8106510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 -- 172.21.15.6:0/3199276287 >> 172.21.15.6:0/3199276287 conn(0x7f16c80fb1c0 msgr2=0x7f16c80fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:15.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 -- 172.21.15.6:0/3199276287 shutdown_connections 2023-09-13T09:38:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.761+0000 7f16cd98d700 1 -- 172.21.15.6:0/3199276287 wait complete. 2023-09-13T09:38:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 Processor -- start 2023-09-13T09:38:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 -- start start 2023-09-13T09:38:15.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c81017f0 0x7f16c8101160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c8104120 0x7f16c80ff7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c80ffce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c8100480 con 0x7f16c8106a50 2023-09-13T09:38:15.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81005f0 con 0x7f16c81017f0 2023-09-13T09:38:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.762+0000 7f16cd98d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c81a0ba0 con 0x7f16c8104120 2023-09-13T09:38:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c80ffce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c80ffce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60542/0 (socket says 172.21.15.6:60542) 2023-09-13T09:38:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 -- 172.21.15.6:0/2878331042 learned_addr learned my addr 172.21.15.6:0/2878331042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c6ffd700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c81017f0 0x7f16c8101160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c67fc700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c8104120 0x7f16c80ff7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 -- 172.21.15.6:0/2878331042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c8104120 msgr2=0x7f16c80ff7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c8104120 0x7f16c80ff7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 -- 172.21.15.6:0/2878331042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c81017f0 msgr2=0x7f16c8101160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c81017f0 0x7f16c8101160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 -- 172.21.15.6:0/2878331042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c0009d00 con 0x7f16c8106a50 2023-09-13T09:38:15.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.763+0000 7f16c77fe700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c80ffce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f16c000b780 tx=0x7f16c000bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.768+0000 7f16cc98b700 1 -- 172.21.15.6:0/2878331042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000e040 con 0x7f16c8106a50 2023-09-13T09:38:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.768+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c81a0e20 con 0x7f16c8106a50 2023-09-13T09:38:15.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.768+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c81a1240 con 0x7f16c8106a50 2023-09-13T09:38:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.768+0000 7f16cc98b700 1 -- 172.21.15.6:0/2878331042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16c00094a0 con 0x7f16c8106a50 2023-09-13T09:38:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.768+0000 7f16cc98b700 1 -- 172.21.15.6:0/2878331042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c00053b0 con 0x7f16c8106a50 2023-09-13T09:38:15.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.769+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16a8005320 con 0x7f16c8106a50 2023-09-13T09:38:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.770+0000 7f16cc98b700 1 -- 172.21.15.6:0/2878331042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f16c0005530 con 0x7f16c8106a50 2023-09-13T09:38:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.771+0000 7f16cc98b700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16b40a0640 0x7f16b40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:15.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.771+0000 7f16c6ffd700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16b40a0640 0x7f16b40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.771+0000 7f16cc98b700 1 -- 172.21.15.6:0/2878331042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f16c00cca40 con 0x7f16c8106a50 2023-09-13T09:38:15.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.771+0000 7f16c6ffd700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16b40a0640 0x7f16b40a2b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009c60 tx=0x7f16b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:15.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:15.778+0000 7f16cc98b700 1 -- 172.21.15.6:0/2878331042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f16c00cee60 con 0x7f16c8106a50 2023-09-13T09:38:16.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-mon[98665]: pgmap v258: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2023-09-13T09:38:16.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:active 2023-09-13T09:38:16.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1386448945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-13T09:38:16.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-mon[98665]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-09-13T09:38:16.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-mon[98665]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-09-13T09:38:16.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-mon[98665]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-09-13T09:38:16.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:15 smithi006 ceph-mon[98665]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-09-13T09:38:16.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:15 smithi131 ceph-mon[102785]: pgmap v258: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2023-09-13T09:38:16.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:15 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:active 2023-09-13T09:38:16.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:15 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1386448945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-13T09:38:16.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:15 smithi131 ceph-mon[102785]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-09-13T09:38:16.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:15 smithi131 ceph-mon[102785]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-09-13T09:38:16.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:15 smithi131 ceph-mon[102785]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-09-13T09:38:16.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:15 smithi131 ceph-mon[102785]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-09-13T09:38:16.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.019+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f16a8000bf0 con 0x7f16b40a0640 2023-09-13T09:38:16.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.053+0000 7f16cc98b700 1 -- 172.21.15.6:0/2878331042 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f16a8000bf0 con 0x7f16b40a0640 2023-09-13T09:38:16.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16b40a0640 msgr2=0x7f16b40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16b40a0640 0x7f16b40a2b00 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f16b8009c60 tx=0x7f16b8009260 comp rx=0 tx=0).stop 2023-09-13T09:38:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 msgr2=0x7f16c80ffce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c80ffce0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f16c000b780 tx=0x7f16c000bd60 comp rx=0 tx=0).stop 2023-09-13T09:38:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 shutdown_connections 2023-09-13T09:38:16.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16b40a0640 0x7f16b40a2b00 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16c8106a50 0x7f16c80ffce0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16c81017f0 0x7f16c8101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 --2- 172.21.15.6:0/2878331042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16c8104120 0x7f16c80ff7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 >> 172.21.15.6:0/2878331042 conn(0x7f16c80fb1c0 msgr2=0x7f16c8102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 shutdown_connections 2023-09-13T09:38:16.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.055+0000 7f16cd98d700 1 -- 172.21.15.6:0/2878331042 wait complete. 2023-09-13T09:38:16.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-09-13T09:38:16.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 -- 172.21.15.6:0/742125428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 msgr2=0x7fab441000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/742125428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441000e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab380099c0 tx=0x7fab38009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 -- 172.21.15.6:0/742125428 shutdown_connections 2023-09-13T09:38:16.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/742125428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab44101850 0x7fab44108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/742125428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441000e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/742125428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab44100eb0 0x7fab44101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 -- 172.21.15.6:0/742125428 >> 172.21.15.6:0/742125428 conn(0x7fab440fb250 msgr2=0x7fab440fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:16.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 -- 172.21.15.6:0/742125428 shutdown_connections 2023-09-13T09:38:16.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 -- 172.21.15.6:0/742125428 wait complete. 2023-09-13T09:38:16.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 Processor -- start 2023-09-13T09:38:16.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 -- start start 2023-09-13T09:38:16.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab44100eb0 0x7fab44195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.197+0000 7fab4ba3c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab44101850 0x7fab4419cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab4ba3c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4419d560 con 0x7fab440ffcc0 2023-09-13T09:38:16.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab4ba3c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4419d6a0 con 0x7fab44101850 2023-09-13T09:38:16.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab4ba3c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4419d830 con 0x7fab44100eb0 2023-09-13T09:38:16.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60554/0 (socket says 172.21.15.6:60554) 2023-09-13T09:38:16.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 -- 172.21.15.6:0/3482909861 learned_addr learned my addr 172.21.15.6:0/3482909861 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:16.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab49fd9700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab44101850 0x7fab4419cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab48fd7700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab44100eb0 0x7fab44195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 -- 172.21.15.6:0/3482909861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab44100eb0 msgr2=0x7fab44195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab44100eb0 0x7fab44195f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 -- 172.21.15.6:0/3482909861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab44101850 msgr2=0x7fab4419cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab44101850 0x7fab4419cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 -- 172.21.15.6:0/3482909861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab380095f0 con 0x7fab440ffcc0 2023-09-13T09:38:16.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab497d8700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441959e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fab38009990 tx=0x7fab38005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:16.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab367fc700 1 -- 172.21.15.6:0/3482909861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3801d070 con 0x7fab440ffcc0 2023-09-13T09:38:16.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab367fc700 1 -- 172.21.15.6:0/3482909861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab38004200 con 0x7fab440ffcc0 2023-09-13T09:38:16.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4419dab0 con 0x7fab440ffcc0 2023-09-13T09:38:16.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab367fc700 1 -- 172.21.15.6:0/3482909861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab38022e30 con 0x7fab440ffcc0 2023-09-13T09:38:16.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.198+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4419df60 con 0x7fab440ffcc0 2023-09-13T09:38:16.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.199+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4410b4d0 con 0x7fab440ffcc0 2023-09-13T09:38:16.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.201+0000 7fab367fc700 1 -- 172.21.15.6:0/3482909861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fab38003d40 con 0x7fab440ffcc0 2023-09-13T09:38:16.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.201+0000 7fab367fc700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab300a0640 0x7fab300a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.202+0000 7fab48fd7700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab300a0640 0x7fab300a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.202+0000 7fab367fc700 1 -- 172.21.15.6:0/3482909861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fab380cd120 con 0x7fab440ffcc0 2023-09-13T09:38:16.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.202+0000 7fab48fd7700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab300a0640 0x7fab300a2b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab40005fd0 tx=0x7fab40005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:16.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.205+0000 7fab367fc700 1 -- 172.21.15.6:0/3482909861 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fab38096d90 con 0x7fab440ffcc0 2023-09-13T09:38:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:15 smithi053 ceph-mon[102373]: pgmap v258: 97 pgs: 97 active+clean; 580 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2023-09-13T09:38:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:15 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:active 2023-09-13T09:38:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:15 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1386448945' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-09-13T09:38:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:15 smithi053 ceph-mon[102373]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-09-13T09:38:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:15 smithi053 ceph-mon[102373]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-09-13T09:38:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:15 smithi053 ceph-mon[102373]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2023-09-13T09:38:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:15 smithi053 ceph-mon[102373]: daemon mds.c is now active in filesystem cephfs as rank 3 2023-09-13T09:38:16.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.440+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7fab440610f0 con 0x7fab300a0640 2023-09-13T09:38:16.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.444+0000 7fab367fc700 1 -- 172.21.15.6:0/3482909861 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fab440610f0 con 0x7fab300a0640 2023-09-13T09:38:16.445 INFO:teuthology.orchestra.run.smithi006.stdout:/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 2023-09-13T09:38:16.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.446+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab300a0640 msgr2=0x7fab300a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.446+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab300a0640 0x7fab300a2b00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fab40005fd0 tx=0x7fab40005f60 comp rx=0 tx=0).stop 2023-09-13T09:38:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.446+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 msgr2=0x7fab441959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.446+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441959e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fab38009990 tx=0x7fab38005e80 comp rx=0 tx=0).stop 2023-09-13T09:38:16.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.446+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 shutdown_connections 2023-09-13T09:38:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.446+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab44101850 0x7fab4419cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.446+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab300a0640 0x7fab300a2b00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.447+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab440ffcc0 0x7fab441959e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.447+0000 7fab4ba3c700 1 --2- 172.21.15.6:0/3482909861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab44100eb0 0x7fab44195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.447+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 >> 172.21.15.6:0/3482909861 conn(0x7fab440fb250 msgr2=0x7fab440fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:16.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.447+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 shutdown_connections 2023-09-13T09:38:16.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.447+0000 7fab4ba3c700 1 -- 172.21.15.6:0/3482909861 wait complete. 2023-09-13T09:38:16.459 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:38:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 -- 172.21.15.6:0/4010219508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19400ff430 msgr2=0x7f19400ff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 --2- 172.21.15.6:0/4010219508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19400ff430 0x7f19400ff850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f19300099c0 tx=0x7f1930009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 -- 172.21.15.6:0/4010219508 shutdown_connections 2023-09-13T09:38:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 --2- 172.21.15.6:0/4010219508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1940100fc0 0x7f1940107870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 --2- 172.21.15.6:0/4010219508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19400ff430 0x7f19400ff850 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 --2- 172.21.15.6:0/4010219508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1940100620 0x7f1940100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 -- 172.21.15.6:0/4010219508 >> 172.21.15.6:0/4010219508 conn(0x7f19400fa9a0 msgr2=0x7f19400fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 -- 172.21.15.6:0/4010219508 shutdown_connections 2023-09-13T09:38:16.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.585+0000 7f194588f700 1 -- 172.21.15.6:0/4010219508 wait complete. 2023-09-13T09:38:16.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 Processor -- start 2023-09-13T09:38:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 -- start start 2023-09-13T09:38:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19400ff430 0x7f19401033c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1940100620 0x7f1940101a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1940100fc0 0x7f1940101f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19401026e0 con 0x7f1940100fc0 2023-09-13T09:38:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1940102850 con 0x7f1940100620 2023-09-13T09:38:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.586+0000 7f194588f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19401a0b30 con 0x7f19400ff430 2023-09-13T09:38:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1940100fc0 0x7f1940101f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1940100fc0 0x7f1940101f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60572/0 (socket says 172.21.15.6:60572) 2023-09-13T09:38:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 -- 172.21.15.6:0/2894558348 learned_addr learned my addr 172.21.15.6:0/2894558348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193effd700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19400ff430 0x7f19401033c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193e7fc700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1940100620 0x7f1940101a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 -- 172.21.15.6:0/2894558348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19400ff430 msgr2=0x7f19401033c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19400ff430 0x7f19401033c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 -- 172.21.15.6:0/2894558348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1940100620 msgr2=0x7f1940101a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1940100620 0x7f1940101a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 -- 172.21.15.6:0/2894558348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19300095f0 con 0x7f1940100fc0 2023-09-13T09:38:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f193f7fe700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1940100fc0 0x7f1940101f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f193800d370 tx=0x7f193800d680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938017070 con 0x7f1940100fc0 2023-09-13T09:38:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f193800dea0 con 0x7f1940100fc0 2023-09-13T09:38:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19401a0db0 con 0x7f1940100fc0 2023-09-13T09:38:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800f040 con 0x7f1940100fc0 2023-09-13T09:38:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.587+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19401a1210 con 0x7f1940100fc0 2023-09-13T09:38:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.588+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f194010a3f0 con 0x7f1940100fc0 2023-09-13T09:38:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.589+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 16) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1938008c00 con 0x7f1940100fc0 2023-09-13T09:38:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.590+0000 7f194488d700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19280a0640 0x7f19280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.590+0000 7f193effd700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19280a0640 0x7f19280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.590+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f19380cb980 con 0x7f1940100fc0 2023-09-13T09:38:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.590+0000 7f193effd700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19280a0640 0x7f19280a2b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1930009f50 tx=0x7f193000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:16.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.594+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1938095600 con 0x7f1940100fc0 2023-09-13T09:38:16.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.793+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f19380959d0 con 0x7f1940100fc0 2023-09-13T09:38:16.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.856+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19401a1400 con 0x7f1940100fc0 2023-09-13T09:38:16.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.857+0000 7f194488d700 1 -- 172.21.15.6:0/2894558348 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f1938099090 con 0x7f1940100fc0 2023-09-13T09:38:16.857 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:16.857 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:38:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19280a0640 msgr2=0x7f19280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19280a0640 0x7f19280a2b00 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1930009f50 tx=0x7f193000b540 comp rx=0 tx=0).stop 2023-09-13T09:38:16.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1940100fc0 msgr2=0x7f1940101f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:16.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1940100fc0 0x7f1940101f40 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f193800d370 tx=0x7f193800d680 comp rx=0 tx=0).stop 2023-09-13T09:38:16.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 shutdown_connections 2023-09-13T09:38:16.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19280a0640 0x7f19280a2b00 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1940100fc0 0x7f1940101f40 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19400ff430 0x7f19401033c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 --2- 172.21.15.6:0/2894558348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1940100620 0x7f1940101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 >> 172.21.15.6:0/2894558348 conn(0x7f19400fa9a0 msgr2=0x7f1940105d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:16.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 shutdown_connections 2023-09-13T09:38:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.859+0000 7f194588f700 1 -- 172.21.15.6:0/2894558348 wait complete. 2023-09-13T09:38:16.862 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:38:16.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:38:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 -- 172.21.15.6:0/3628356742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501018b0 msgr2=0x7f3d50103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 --2- 172.21.15.6:0/3628356742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501018b0 0x7f3d50103ca0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3d44009990 tx=0x7f3d44009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 -- 172.21.15.6:0/3628356742 shutdown_connections 2023-09-13T09:38:17.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 --2- 172.21.15.6:0/3628356742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d50106b10 0x7f3d50108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 --2- 172.21.15.6:0/3628356742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501018b0 0x7f3d50103ca0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 --2- 172.21.15.6:0/3628356742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d501041e0 0x7f3d501065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 -- 172.21.15.6:0/3628356742 >> 172.21.15.6:0/3628356742 conn(0x7f3d500fb220 msgr2=0x7f3d500fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 -- 172.21.15.6:0/3628356742 shutdown_connections 2023-09-13T09:38:17.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.997+0000 7f3d56af3700 1 -- 172.21.15.6:0/3628356742 wait complete. 2023-09-13T09:38:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 Processor -- start 2023-09-13T09:38:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 -- start start 2023-09-13T09:38:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d501018b0 0x7f3d50196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501041e0 0x7f3d50196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d50106b10 0x7f3d5019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5019e5d0 con 0x7f3d501041e0 2023-09-13T09:38:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5019e710 con 0x7f3d501018b0 2023-09-13T09:38:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d56af3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d5019e8a0 con 0x7f3d50106b10 2023-09-13T09:38:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501041e0 0x7f3d50196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501041e0 0x7f3d50196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60604/0 (socket says 172.21.15.6:60604) 2023-09-13T09:38:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d5488f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d501018b0 0x7f3d50196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d4ffff700 1 -- 172.21.15.6:0/2258697889 learned_addr learned my addr 172.21.15.6:0/2258697889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.998+0000 7f3d55090700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d50106b10 0x7f3d5019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4ffff700 1 -- 172.21.15.6:0/2258697889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d50106b10 msgr2=0x7f3d5019e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4ffff700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d50106b10 0x7f3d5019e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4ffff700 1 -- 172.21.15.6:0/2258697889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d501018b0 msgr2=0x7f3d50196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4ffff700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d501018b0 0x7f3d50196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4ffff700 1 -- 172.21.15.6:0/2258697889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d440095f0 con 0x7f3d501041e0 2023-09-13T09:38:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4ffff700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501041e0 0x7f3d50196f90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00d950 tx=0x7f3d3c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:17.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4dffb700 1 -- 172.21.15.6:0/2258697889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00f890 con 0x7f3d501041e0 2023-09-13T09:38:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4dffb700 1 -- 172.21.15.6:0/2258697889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d3c010460 con 0x7f3d501041e0 2023-09-13T09:38:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d5019eb80 con 0x7f3d501041e0 2023-09-13T09:38:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d4dffb700 1 -- 172.21.15.6:0/2258697889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3c00e610 con 0x7f3d501041e0 2023-09-13T09:38:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:16.999+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d5019f090 con 0x7f3d501041e0 2023-09-13T09:38:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.000+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d500fcda0 con 0x7f3d501041e0 2023-09-13T09:38:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.001+0000 7f3d4dffb700 1 -- 172.21.15.6:0/2258697889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f3d3c0108d0 con 0x7f3d501041e0 2023-09-13T09:38:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.002+0000 7f3d4dffb700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d400a06d0 0x7f3d400a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.002+0000 7f3d5488f700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d400a06d0 0x7f3d400a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.002+0000 7f3d4dffb700 1 -- 172.21.15.6:0/2258697889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3d3c0cb920 con 0x7f3d501041e0 2023-09-13T09:38:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.002+0000 7f3d5488f700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d400a06d0 0x7f3d400a2b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400b5c0 tx=0x7f3d44005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:17.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.006+0000 7f3d4dffb700 1 -- 172.21.15.6:0/2258697889 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3d3c0954a0 con 0x7f3d501041e0 2023-09-13T09:38:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.210+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3d5010c790 con 0x7f3d501041e0 2023-09-13T09:38:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.211+0000 7f3d4dffb700 1 -- 172.21.15.6:0/2258697889 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22001 (secure 0 0 0) 0x7f3d3c016090 con 0x7f3d501041e0 2023-09-13T09:38:17.212 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:17.212 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:10.679583+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:38:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d400a06d0 msgr2=0x7f3d400a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d400a06d0 0x7f3d400a2b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400b5c0 tx=0x7f3d44005fd0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501041e0 msgr2=0x7f3d50196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501041e0 0x7f3d50196f90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3d3c00d950 tx=0x7f3d3c00dc60 comp rx=0 tx=0).stop 2023-09-13T09:38:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 shutdown_connections 2023-09-13T09:38:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d50106b10 0x7f3d5019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d501018b0 0x7f3d50196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d400a06d0 0x7f3d400a2b90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 --2- 172.21.15.6:0/2258697889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d501041e0 0x7f3d50196f90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.213+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 >> 172.21.15.6:0/2258697889 conn(0x7f3d500fb220 msgr2=0x7f3d50102520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.214+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 shutdown_connections 2023-09-13T09:38:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.214+0000 7f3d56af3700 1 -- 172.21.15.6:0/2258697889 wait complete. 2023-09-13T09:38:17.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] up:active 2023-09-13T09:38:17.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-09-13T09:38:17.225 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-13T09:38:17.226 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: Cluster is now healthy 2023-09-13T09:38:17.226 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2023-09-13T09:38:17.226 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-09-13T09:38:17.226 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-09-13T09:38:17.226 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] up:active 2023-09-13T09:38:17.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:16 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:38:17.228 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-13T09:38:17.228 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T09:38:17.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] up:active 2023-09-13T09:38:17.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-09-13T09:38:17.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-13T09:38:17.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: Cluster is now healthy 2023-09-13T09:38:17.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2023-09-13T09:38:17.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-09-13T09:38:17.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-09-13T09:38:17.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] up:active 2023-09-13T09:38:17.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:16 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:38:17.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: from='client.14754 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] up:active 2023-09-13T09:38:17.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: daemon mds.e assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-09-13T09:38:17.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-09-13T09:38:17.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: Cluster is now healthy 2023-09-13T09:38:17.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2023-09-13T09:38:17.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2023-09-13T09:38:17.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: daemon mds.e is now active in filesystem cephfs as rank 4 2023-09-13T09:38:17.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] up:active 2023-09-13T09:38:17.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:16 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:38:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 -- 172.21.15.6:0/4224407574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 msgr2=0x7f7254103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 --2- 172.21.15.6:0/4224407574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f7254103c60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7248009990 tx=0x7f7248009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 -- 172.21.15.6:0/4224407574 shutdown_connections 2023-09-13T09:38:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 --2- 172.21.15.6:0/4224407574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7254106ad0 0x7f7254108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 --2- 172.21.15.6:0/4224407574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f7254103c60 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 --2- 172.21.15.6:0/4224407574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72541041a0 0x7f7254106590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 -- 172.21.15.6:0/4224407574 >> 172.21.15.6:0/4224407574 conn(0x7f72540fb220 msgr2=0x7f72540fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 -- 172.21.15.6:0/4224407574 shutdown_connections 2023-09-13T09:38:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 -- 172.21.15.6:0/4224407574 wait complete. 2023-09-13T09:38:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 Processor -- start 2023-09-13T09:38:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 -- start start 2023-09-13T09:38:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.354+0000 7f725b0b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f72541011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f725b0b4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72541041a0 0x7f72540ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f725b0b4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7254106ad0 0x7f72540ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f725b0b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254100500 con 0x7f7254101870 2023-09-13T09:38:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f725b0b4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7254100670 con 0x7f7254106ad0 2023-09-13T09:38:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f725b0b4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72541a0b80 con 0x7f72541041a0 2023-09-13T09:38:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f72541011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f72541011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60616/0 (socket says 172.21.15.6:60616) 2023-09-13T09:38:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 -- 172.21.15.6:0/1602390916 learned_addr learned my addr 172.21.15.6:0/1602390916 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 -- 172.21.15.6:0/1602390916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72541041a0 msgr2=0x7f72540ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72541041a0 0x7f72540ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 -- 172.21.15.6:0/1602390916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7254106ad0 msgr2=0x7f72540ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7259651700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7254106ad0 0x7f72540ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7254106ad0 0x7f72540ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 -- 172.21.15.6:0/1602390916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72480095f0 con 0x7f7254101870 2023-09-13T09:38:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7259651700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7254106ad0 0x7f72540ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7258e50700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f72541011e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7248000c00 tx=0x7f724800f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7251ffb700 1 -- 172.21.15.6:0/1602390916 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724801d070 con 0x7f7254101870 2023-09-13T09:38:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72541a0e00 con 0x7f7254101870 2023-09-13T09:38:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7251ffb700 1 -- 172.21.15.6:0/1602390916 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f724800fce0 con 0x7f7254101870 2023-09-13T09:38:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.355+0000 7f7251ffb700 1 -- 172.21.15.6:0/1602390916 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72480176e0 con 0x7f7254101870 2023-09-13T09:38:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.356+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72541a1270 con 0x7f7254101870 2023-09-13T09:38:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.356+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72540fcda0 con 0x7f7254101870 2023-09-13T09:38:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.358+0000 7f7251ffb700 1 -- 172.21.15.6:0/1602390916 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f7248022470 con 0x7f7254101870 2023-09-13T09:38:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.358+0000 7f7251ffb700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f72440a06d0 0x7f72440a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.358+0000 7f7251ffb700 1 -- 172.21.15.6:0/1602390916 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f72480cd420 con 0x7f7254101870 2023-09-13T09:38:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.358+0000 7f7253fff700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f72440a06d0 0x7f72440a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.359+0000 7f7253fff700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f72440a06d0 0x7f72440a2b90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72400097b0 tx=0x7f7240006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.362+0000 7f7251ffb700 1 -- 172.21.15.6:0/1602390916 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7248097030 con 0x7f7254101870 2023-09-13T09:38:17.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.562+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f725402d010 con 0x7f72440a06d0 2023-09-13T09:38:17.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.575+0000 7f7251ffb700 1 -- 172.21.15.6:0/1602390916 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335411 (secure 0 0 0) 0x7f725402d010 con 0x7f72440a06d0 2023-09-13T09:38:17.579 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f72440a06d0 msgr2=0x7f72440a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f72440a06d0 0x7f72440a2b90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f72400097b0 tx=0x7f7240006d20 comp rx=0 tx=0).stop 2023-09-13T09:38:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 msgr2=0x7f72541011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f72541011e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7248000c00 tx=0x7f724800f830 comp rx=0 tx=0).stop 2023-09-13T09:38:17.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 shutdown_connections 2023-09-13T09:38:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7254106ad0 0x7f72540ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f72440a06d0 0x7f72440a2b90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7254101870 0x7f72541011e0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 --2- 172.21.15.6:0/1602390916 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72541041a0 0x7f72540ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 >> 172.21.15.6:0/1602390916 conn(0x7f72540fb220 msgr2=0x7f72541024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 shutdown_connections 2023-09-13T09:38:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.578+0000 7f725b0b4700 1 -- 172.21.15.6:0/1602390916 wait complete. 2023-09-13T09:38:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-09-13T09:38:17.591 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-09-13T09:38:16.139902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":613056,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":318,"num_write_kb":2988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":282,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336804,"kb_used_data":12580,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605020,"statfs":{"total":1151940427776,"available":1151595540480,"internally_reserved":0,"allocated":12881920,"data_stored":7002784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22688,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.461379"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233536+0000","last_change":"2023-09-13T09:38:09.701485+0000","last_active":"2023-09-13T09:38:12.233536+0000","last_peered":"2023-09-13T09:38:12.233536+0000","last_clean":"2023-09-13T09:38:12.233536+0000","last_became_active":"2023-09-13T09:38:09.701160+0000","last_became_peered":"2023-09-13T09:38:09.701160+0000","last_unstale":"2023-09-13T09:38:12.233536+0000","last_undegraded":"2023-09-13T09:38:12.233536+0000","last_fullsized":"2023-09-13T09:38:12.233536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:10.089322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171037+0000","last_change":"2023-09-13T09:38:09.697198+0000","last_active":"2023-09-13T09:38:11.171037+0000","last_peered":"2023-09-13T09:38:11.171037+0000","last_clean":"2023-09-13T09:38:11.171037+0000","last_became_active":"2023-09-13T09:38:09.696859+0000","last_became_peered":"2023-09-13T09:38:09.696859+0000","last_unstale":"2023-09-13T09:38:11.171037+0000","last_undegraded":"2023-09-13T09:38:11.171037+0000","last_fullsized":"2023-09-13T09:38:11.171037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:53.601426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170662+0000","last_change":"2023-09-13T09:38:09.696150+0000","last_active":"2023-09-13T09:38:11.170662+0000","last_peered":"2023-09-13T09:38:11.170662+0000","last_clean":"2023-09-13T09:38:11.170662+0000","last_became_active":"2023-09-13T09:38:09.695893+0000","last_became_peered":"2023-09-13T09:38:09.695893+0000","last_unstale":"2023-09-13T09:38:11.170662+0000","last_undegraded":"2023-09-13T09:38:11.170662+0000","last_fullsized":"2023-09-13T09:38:11.170662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:51.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171082+0000","last_change":"2023-09-13T09:38:09.697564+0000","last_active":"2023-09-13T09:38:11.171082+0000","last_peered":"2023-09-13T09:38:11.171082+0000","last_clean":"2023-09-13T09:38:11.171082+0000","last_became_active":"2023-09-13T09:38:09.697235+0000","last_became_peered":"2023-09-13T09:38:09.697235+0000","last_unstale":"2023-09-13T09:38:11.171082+0000","last_undegraded":"2023-09-13T09:38:11.171082+0000","last_fullsized":"2023-09-13T09:38:11.171082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:49.705452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170159+0000","last_change":"2023-09-13T09:38:09.702889+0000","last_active":"2023-09-13T09:38:11.170159+0000","last_peered":"2023-09-13T09:38:11.170159+0000","last_clean":"2023-09-13T09:38:11.170159+0000","last_became_active":"2023-09-13T09:38:09.702589+0000","last_became_peered":"2023-09-13T09:38:09.702589+0000","last_unstale":"2023-09-13T09:38:11.170159+0000","last_undegraded":"2023-09-13T09:38:11.170159+0000","last_fullsized":"2023-09-13T09:38:11.170159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:56:05.432576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683357+0000","last_change":"2023-09-13T09:38:09.697097+0000","last_active":"2023-09-13T09:38:10.683357+0000","last_peered":"2023-09-13T09:38:10.683357+0000","last_clean":"2023-09-13T09:38:10.683357+0000","last_became_active":"2023-09-13T09:38:09.696770+0000","last_became_peered":"2023-09-13T09:38:09.696770+0000","last_unstale":"2023-09-13T09:38:10.683357+0000","last_undegraded":"2023-09-13T09:38:10.683357+0000","last_fullsized":"2023-09-13T09:38:10.683357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:46.305472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171571+0000","last_change":"2023-09-13T09:38:09.700506+0000","last_active":"2023-09-13T09:38:11.171571+0000","last_peered":"2023-09-13T09:38:11.171571+0000","last_clean":"2023-09-13T09:38:11.171571+0000","last_became_active":"2023-09-13T09:38:09.700178+0000","last_became_peered":"2023-09-13T09:38:09.700178+0000","last_unstale":"2023-09-13T09:38:11.171571+0000","last_undegraded":"2023-09-13T09:38:11.171571+0000","last_fullsized":"2023-09-13T09:38:11.171571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:04.261443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170488+0000","last_change":"2023-09-13T09:38:09.703191+0000","last_active":"2023-09-13T09:38:11.170488+0000","last_peered":"2023-09-13T09:38:11.170488+0000","last_clean":"2023-09-13T09:38:11.170488+0000","last_became_active":"2023-09-13T09:38:09.702874+0000","last_became_peered":"2023-09-13T09:38:09.702874+0000","last_unstale":"2023-09-13T09:38:11.170488+0000","last_undegraded":"2023-09-13T09:38:11.170488+0000","last_fullsized":"2023-09-13T09:38:11.170488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:50:25.759861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171171+0000","last_change":"2023-09-13T09:38:09.700416+0000","last_active":"2023-09-13T09:38:11.171171+0000","last_peered":"2023-09-13T09:38:11.171171+0000","last_clean":"2023-09-13T09:38:11.171171+0000","last_became_active":"2023-09-13T09:38:09.700102+0000","last_became_peered":"2023-09-13T09:38:09.700102+0000","last_unstale":"2023-09-13T09:38:11.171171+0000","last_undegraded":"2023-09-13T09:38:11.171171+0000","last_fullsized":"2023-09-13T09:38:11.171171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:53.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683677+0000","last_change":"2023-09-13T09:38:09.702609+0000","last_active":"2023-09-13T09:38:10.683677+0000","last_peered":"2023-09-13T09:38:10.683677+0000","last_clean":"2023-09-13T09:38:10.683677+0000","last_became_active":"2023-09-13T09:38:09.702244+0000","last_became_peered":"2023-09-13T09:38:09.702244+0000","last_unstale":"2023-09-13T09:38:10.683677+0000","last_undegraded":"2023-09-13T09:38:10.683677+0000","last_fullsized":"2023-09-13T09:38:10.683677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:08:30.911492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171785+0000","last_change":"2023-09-13T09:38:09.694245+0000","last_active":"2023-09-13T09:38:11.171785+0000","last_peered":"2023-09-13T09:38:11.171785+0000","last_clean":"2023-09-13T09:38:11.171785+0000","last_became_active":"2023-09-13T09:38:09.693939+0000","last_became_peered":"2023-09-13T09:38:09.693939+0000","last_unstale":"2023-09-13T09:38:11.171785+0000","last_undegraded":"2023-09-13T09:38:11.171785+0000","last_fullsized":"2023-09-13T09:38:11.171785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:08.383075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171904+0000","last_change":"2023-09-13T09:38:09.696680+0000","last_active":"2023-09-13T09:38:11.171904+0000","last_peered":"2023-09-13T09:38:11.171904+0000","last_clean":"2023-09-13T09:38:11.171904+0000","last_became_active":"2023-09-13T09:38:09.696369+0000","last_became_peered":"2023-09-13T09:38:09.696369+0000","last_unstale":"2023-09-13T09:38:11.171904+0000","last_undegraded":"2023-09-13T09:38:11.171904+0000","last_fullsized":"2023-09-13T09:38:11.171904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:48.111921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683082+0000","last_change":"2023-09-13T09:38:09.703214+0000","last_active":"2023-09-13T09:38:10.683082+0000","last_peered":"2023-09-13T09:38:10.683082+0000","last_clean":"2023-09-13T09:38:10.683082+0000","last_became_active":"2023-09-13T09:38:09.702815+0000","last_became_peered":"2023-09-13T09:38:09.702815+0000","last_unstale":"2023-09-13T09:38:10.683082+0000","last_undegraded":"2023-09-13T09:38:10.683082+0000","last_fullsized":"2023-09-13T09:38:10.683082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:46.437548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171130+0000","last_change":"2023-09-13T09:38:09.699968+0000","last_active":"2023-09-13T09:38:11.171130+0000","last_peered":"2023-09-13T09:38:11.171130+0000","last_clean":"2023-09-13T09:38:11.171130+0000","last_became_active":"2023-09-13T09:38:09.699643+0000","last_became_peered":"2023-09-13T09:38:09.699643+0000","last_unstale":"2023-09-13T09:38:11.171130+0000","last_undegraded":"2023-09-13T09:38:11.171130+0000","last_fullsized":"2023-09-13T09:38:11.171130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:41:40.550328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.694517+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.691295+0000","last_became_peered":"2023-09-13T09:38:09.691295+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:48:40.291170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170268+0000","last_change":"2023-09-13T09:38:09.695903+0000","last_active":"2023-09-13T09:38:11.170268+0000","last_peered":"2023-09-13T09:38:11.170268+0000","last_clean":"2023-09-13T09:38:11.170268+0000","last_became_active":"2023-09-13T09:38:09.695585+0000","last_became_peered":"2023-09-13T09:38:09.695585+0000","last_unstale":"2023-09-13T09:38:11.170268+0000","last_undegraded":"2023-09-13T09:38:11.170268+0000","last_fullsized":"2023-09-13T09:38:11.170268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:13.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233581+0000","last_change":"2023-09-13T09:38:09.702485+0000","last_active":"2023-09-13T09:38:12.233581+0000","last_peered":"2023-09-13T09:38:12.233581+0000","last_clean":"2023-09-13T09:38:12.233581+0000","last_became_active":"2023-09-13T09:38:09.701989+0000","last_became_peered":"2023-09-13T09:38:09.701989+0000","last_unstale":"2023-09-13T09:38:12.233581+0000","last_undegraded":"2023-09-13T09:38:12.233581+0000","last_fullsized":"2023-09-13T09:38:12.233581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:58.832560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170815+0000","last_change":"2023-09-13T09:38:09.695080+0000","last_active":"2023-09-13T09:38:11.170815+0000","last_peered":"2023-09-13T09:38:11.170815+0000","last_clean":"2023-09-13T09:38:11.170815+0000","last_became_active":"2023-09-13T09:38:09.694782+0000","last_became_peered":"2023-09-13T09:38:09.694782+0000","last_unstale":"2023-09-13T09:38:11.170815+0000","last_undegraded":"2023-09-13T09:38:11.170815+0000","last_fullsized":"2023-09-13T09:38:11.170815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:15.146156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170850+0000","last_change":"2023-09-13T09:38:09.702456+0000","last_active":"2023-09-13T09:38:11.170850+0000","last_peered":"2023-09-13T09:38:11.170850+0000","last_clean":"2023-09-13T09:38:11.170850+0000","last_became_active":"2023-09-13T09:38:09.702171+0000","last_became_peered":"2023-09-13T09:38:09.702171+0000","last_unstale":"2023-09-13T09:38:11.170850+0000","last_undegraded":"2023-09-13T09:38:11.170850+0000","last_fullsized":"2023-09-13T09:38:11.170850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:32.995619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'11","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.779585+0000","last_change":"2023-09-13T09:38:08.692389+0000","last_active":"2023-09-13T09:38:14.779585+0000","last_peered":"2023-09-13T09:38:14.779585+0000","last_clean":"2023-09-13T09:38:14.779585+0000","last_became_active":"2023-09-13T09:38:08.692022+0000","last_became_peered":"2023-09-13T09:38:08.692022+0000","last_unstale":"2023-09-13T09:38:14.779585+0000","last_undegraded":"2023-09-13T09:38:14.779585+0000","last_fullsized":"2023-09-13T09:38:14.779585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:58:40.288839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170755+0000","last_change":"2023-09-13T09:38:09.704712+0000","last_active":"2023-09-13T09:38:11.170755+0000","last_peered":"2023-09-13T09:38:11.170755+0000","last_clean":"2023-09-13T09:38:11.170755+0000","last_became_active":"2023-09-13T09:38:09.704379+0000","last_became_peered":"2023-09-13T09:38:09.704379+0000","last_unstale":"2023-09-13T09:38:11.170755+0000","last_undegraded":"2023-09-13T09:38:11.170755+0000","last_fullsized":"2023-09-13T09:38:11.170755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:47.605987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170899+0000","last_change":"2023-09-13T09:38:08.694408+0000","last_active":"2023-09-13T09:38:11.170899+0000","last_peered":"2023-09-13T09:38:11.170899+0000","last_clean":"2023-09-13T09:38:11.170899+0000","last_became_active":"2023-09-13T09:38:08.693140+0000","last_became_peered":"2023-09-13T09:38:08.693140+0000","last_unstale":"2023-09-13T09:38:11.170899+0000","last_undegraded":"2023-09-13T09:38:11.170899+0000","last_fullsized":"2023-09-13T09:38:11.170899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:27:22.637489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171299+0000","last_change":"2023-09-13T09:38:09.705381+0000","last_active":"2023-09-13T09:38:11.171299+0000","last_peered":"2023-09-13T09:38:11.171299+0000","last_clean":"2023-09-13T09:38:11.171299+0000","last_became_active":"2023-09-13T09:38:09.705059+0000","last_became_peered":"2023-09-13T09:38:09.705059+0000","last_unstale":"2023-09-13T09:38:11.171299+0000","last_undegraded":"2023-09-13T09:38:11.171299+0000","last_fullsized":"2023-09-13T09:38:11.171299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:11.294362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170734+0000","last_change":"2023-09-13T09:38:08.695077+0000","last_active":"2023-09-13T09:38:11.170734+0000","last_peered":"2023-09-13T09:38:11.170734+0000","last_clean":"2023-09-13T09:38:11.170734+0000","last_became_active":"2023-09-13T09:38:08.694778+0000","last_became_peered":"2023-09-13T09:38:08.694778+0000","last_unstale":"2023-09-13T09:38:11.170734+0000","last_undegraded":"2023-09-13T09:38:11.170734+0000","last_fullsized":"2023-09-13T09:38:11.170734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:31.517739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170421+0000","last_change":"2023-09-13T09:38:09.696875+0000","last_active":"2023-09-13T09:38:11.170421+0000","last_peered":"2023-09-13T09:38:11.170421+0000","last_clean":"2023-09-13T09:38:11.170421+0000","last_became_active":"2023-09-13T09:38:09.696060+0000","last_became_peered":"2023-09-13T09:38:09.696060+0000","last_unstale":"2023-09-13T09:38:11.170421+0000","last_undegraded":"2023-09-13T09:38:11.170421+0000","last_fullsized":"2023-09-13T09:38:11.170421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:55.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170218+0000","last_change":"2023-09-13T09:38:08.692583+0000","last_active":"2023-09-13T09:38:11.170218+0000","last_peered":"2023-09-13T09:38:11.170218+0000","last_clean":"2023-09-13T09:38:11.170218+0000","last_became_active":"2023-09-13T09:38:08.692266+0000","last_became_peered":"2023-09-13T09:38:08.692266+0000","last_unstale":"2023-09-13T09:38:11.170218+0000","last_undegraded":"2023-09-13T09:38:11.170218+0000","last_fullsized":"2023-09-13T09:38:11.170218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:37.827191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683948+0000","last_change":"2023-09-13T09:38:09.705855+0000","last_active":"2023-09-13T09:38:10.683948+0000","last_peered":"2023-09-13T09:38:10.683948+0000","last_clean":"2023-09-13T09:38:10.683948+0000","last_became_active":"2023-09-13T09:38:09.705518+0000","last_became_peered":"2023-09-13T09:38:09.705518+0000","last_unstale":"2023-09-13T09:38:10.683948+0000","last_undegraded":"2023-09-13T09:38:10.683948+0000","last_fullsized":"2023-09-13T09:38:10.683948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:02.403984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.757996+0000","last_change":"2023-09-13T09:38:08.697396+0000","last_active":"2023-09-13T09:38:12.757996+0000","last_peered":"2023-09-13T09:38:12.757996+0000","last_clean":"2023-09-13T09:38:12.757996+0000","last_became_active":"2023-09-13T09:38:08.697067+0000","last_became_peered":"2023-09-13T09:38:08.697067+0000","last_unstale":"2023-09-13T09:38:12.757996+0000","last_undegraded":"2023-09-13T09:38:12.757996+0000","last_fullsized":"2023-09-13T09:38:12.757996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:59.971250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170184+0000","last_change":"2023-09-13T09:38:09.701311+0000","last_active":"2023-09-13T09:38:11.170184+0000","last_peered":"2023-09-13T09:38:11.170184+0000","last_clean":"2023-09-13T09:38:11.170184+0000","last_became_active":"2023-09-13T09:38:09.700995+0000","last_became_peered":"2023-09-13T09:38:09.700995+0000","last_unstale":"2023-09-13T09:38:11.170184+0000","last_undegraded":"2023-09-13T09:38:11.170184+0000","last_fullsized":"2023-09-13T09:38:11.170184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:08.744780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.780227+0000","last_change":"2023-09-13T09:38:08.691337+0000","last_active":"2023-09-13T09:38:14.780227+0000","last_peered":"2023-09-13T09:38:14.780227+0000","last_clean":"2023-09-13T09:38:14.780227+0000","last_became_active":"2023-09-13T09:38:08.690948+0000","last_became_peered":"2023-09-13T09:38:08.690948+0000","last_unstale":"2023-09-13T09:38:14.780227+0000","last_undegraded":"2023-09-13T09:38:14.780227+0000","last_fullsized":"2023-09-13T09:38:14.780227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:33.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683697+0000","last_change":"2023-09-13T09:38:09.706627+0000","last_active":"2023-09-13T09:38:10.683697+0000","last_peered":"2023-09-13T09:38:10.683697+0000","last_clean":"2023-09-13T09:38:10.683697+0000","last_became_active":"2023-09-13T09:38:09.706328+0000","last_became_peered":"2023-09-13T09:38:09.706328+0000","last_unstale":"2023-09-13T09:38:10.683697+0000","last_undegraded":"2023-09-13T09:38:10.683697+0000","last_fullsized":"2023-09-13T09:38:10.683697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:09.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.767182+0000","last_change":"2023-09-13T09:38:08.692201+0000","last_active":"2023-09-13T09:38:13.767182+0000","last_peered":"2023-09-13T09:38:13.767182+0000","last_clean":"2023-09-13T09:38:13.767182+0000","last_became_active":"2023-09-13T09:38:08.691334+0000","last_became_peered":"2023-09-13T09:38:08.691334+0000","last_unstale":"2023-09-13T09:38:13.767182+0000","last_undegraded":"2023-09-13T09:38:13.767182+0000","last_fullsized":"2023-09-13T09:38:13.767182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:13.098275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170633+0000","last_change":"2023-09-13T09:38:09.701125+0000","last_active":"2023-09-13T09:38:11.170633+0000","last_peered":"2023-09-13T09:38:11.170633+0000","last_clean":"2023-09-13T09:38:11.170633+0000","last_became_active":"2023-09-13T09:38:09.700055+0000","last_became_peered":"2023-09-13T09:38:09.700055+0000","last_unstale":"2023-09-13T09:38:11.170633+0000","last_undegraded":"2023-09-13T09:38:11.170633+0000","last_fullsized":"2023-09-13T09:38:11.170633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:17.787363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683395+0000","last_change":"2023-09-13T09:38:08.696797+0000","last_active":"2023-09-13T09:38:10.683395+0000","last_peered":"2023-09-13T09:38:10.683395+0000","last_clean":"2023-09-13T09:38:10.683395+0000","last_became_active":"2023-09-13T09:38:08.696494+0000","last_became_peered":"2023-09-13T09:38:08.696494+0000","last_unstale":"2023-09-13T09:38:10.683395+0000","last_undegraded":"2023-09-13T09:38:10.683395+0000","last_fullsized":"2023-09-13T09:38:10.683395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:29.454184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170422+0000","last_change":"2023-09-13T09:38:09.694166+0000","last_active":"2023-09-13T09:38:11.170422+0000","last_peered":"2023-09-13T09:38:11.170422+0000","last_clean":"2023-09-13T09:38:11.170422+0000","last_became_active":"2023-09-13T09:38:09.693894+0000","last_became_peered":"2023-09-13T09:38:09.693894+0000","last_unstale":"2023-09-13T09:38:11.170422+0000","last_undegraded":"2023-09-13T09:38:11.170422+0000","last_fullsized":"2023-09-13T09:38:11.170422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:27:35.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.757883+0000","last_change":"2023-09-13T09:38:08.693649+0000","last_active":"2023-09-13T09:38:12.757883+0000","last_peered":"2023-09-13T09:38:12.757883+0000","last_clean":"2023-09-13T09:38:12.757883+0000","last_became_active":"2023-09-13T09:38:08.693289+0000","last_became_peered":"2023-09-13T09:38:08.693289+0000","last_unstale":"2023-09-13T09:38:12.757883+0000","last_undegraded":"2023-09-13T09:38:12.757883+0000","last_fullsized":"2023-09-13T09:38:12.757883+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:39:27.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170787+0000","last_change":"2023-09-13T09:38:09.693872+0000","last_active":"2023-09-13T09:38:11.170787+0000","last_peered":"2023-09-13T09:38:11.170787+0000","last_clean":"2023-09-13T09:38:11.170787+0000","last_became_active":"2023-09-13T09:38:09.693445+0000","last_became_peered":"2023-09-13T09:38:09.693445+0000","last_unstale":"2023-09-13T09:38:11.170787+0000","last_undegraded":"2023-09-13T09:38:11.170787+0000","last_fullsized":"2023-09-13T09:38:11.170787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:29:35.717276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.757941+0000","last_change":"2023-09-13T09:38:08.696375+0000","last_active":"2023-09-13T09:38:12.757941+0000","last_peered":"2023-09-13T09:38:12.757941+0000","last_clean":"2023-09-13T09:38:12.757941+0000","last_became_active":"2023-09-13T09:38:08.695799+0000","last_became_peered":"2023-09-13T09:38:08.695799+0000","last_unstale":"2023-09-13T09:38:12.757941+0000","last_undegraded":"2023-09-13T09:38:12.757941+0000","last_fullsized":"2023-09-13T09:38:12.757941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:09.255704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171326+0000","last_change":"2023-09-13T09:38:09.706518+0000","last_active":"2023-09-13T09:38:11.171326+0000","last_peered":"2023-09-13T09:38:11.171326+0000","last_clean":"2023-09-13T09:38:11.171326+0000","last_became_active":"2023-09-13T09:38:09.706083+0000","last_became_peered":"2023-09-13T09:38:09.706083+0000","last_unstale":"2023-09-13T09:38:11.171326+0000","last_undegraded":"2023-09-13T09:38:11.171326+0000","last_fullsized":"2023-09-13T09:38:11.171326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:21:53.831430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683917+0000","last_change":"2023-09-13T09:38:08.697878+0000","last_active":"2023-09-13T09:38:10.683917+0000","last_peered":"2023-09-13T09:38:10.683917+0000","last_clean":"2023-09-13T09:38:10.683917+0000","last_became_active":"2023-09-13T09:38:08.697476+0000","last_became_peered":"2023-09-13T09:38:08.697476+0000","last_unstale":"2023-09-13T09:38:10.683917+0000","last_undegraded":"2023-09-13T09:38:10.683917+0000","last_fullsized":"2023-09-13T09:38:10.683917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:09.021111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170664+0000","last_change":"2023-09-13T09:38:09.697144+0000","last_active":"2023-09-13T09:38:11.170664+0000","last_peered":"2023-09-13T09:38:11.170664+0000","last_clean":"2023-09-13T09:38:11.170664+0000","last_became_active":"2023-09-13T09:38:09.696521+0000","last_became_peered":"2023-09-13T09:38:09.696521+0000","last_unstale":"2023-09-13T09:38:11.170664+0000","last_undegraded":"2023-09-13T09:38:11.170664+0000","last_fullsized":"2023-09-13T09:38:11.170664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:36:17.096644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'14","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.212064+0000","last_change":"2023-09-13T09:38:08.694981+0000","last_active":"2023-09-13T09:38:15.212064+0000","last_peered":"2023-09-13T09:38:15.212064+0000","last_clean":"2023-09-13T09:38:15.212064+0000","last_became_active":"2023-09-13T09:38:08.694630+0000","last_became_peered":"2023-09-13T09:38:08.694630+0000","last_unstale":"2023-09-13T09:38:15.212064+0000","last_undegraded":"2023-09-13T09:38:15.212064+0000","last_fullsized":"2023-09-13T09:38:15.212064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:56:58.204622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170585+0000","last_change":"2023-09-13T09:38:09.700927+0000","last_active":"2023-09-13T09:38:11.170585+0000","last_peered":"2023-09-13T09:38:11.170585+0000","last_clean":"2023-09-13T09:38:11.170585+0000","last_became_active":"2023-09-13T09:38:09.700608+0000","last_became_peered":"2023-09-13T09:38:09.700608+0000","last_unstale":"2023-09-13T09:38:11.170585+0000","last_undegraded":"2023-09-13T09:38:11.170585+0000","last_fullsized":"2023-09-13T09:38:11.170585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:24.177293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.766066+0000","last_change":"2023-09-13T09:38:08.699130+0000","last_active":"2023-09-13T09:38:13.766066+0000","last_peered":"2023-09-13T09:38:13.766066+0000","last_clean":"2023-09-13T09:38:13.766066+0000","last_became_active":"2023-09-13T09:38:08.698802+0000","last_became_peered":"2023-09-13T09:38:08.698802+0000","last_unstale":"2023-09-13T09:38:13.766066+0000","last_undegraded":"2023-09-13T09:38:13.766066+0000","last_fullsized":"2023-09-13T09:38:13.766066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:36.539846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682921+0000","last_change":"2023-09-13T09:38:09.697387+0000","last_active":"2023-09-13T09:38:10.682921+0000","last_peered":"2023-09-13T09:38:10.682921+0000","last_clean":"2023-09-13T09:38:10.682921+0000","last_became_active":"2023-09-13T09:38:09.697081+0000","last_became_peered":"2023-09-13T09:38:09.697081+0000","last_unstale":"2023-09-13T09:38:10.682921+0000","last_undegraded":"2023-09-13T09:38:10.682921+0000","last_fullsized":"2023-09-13T09:38:10.682921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:28:59.473258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.758222+0000","last_change":"2023-09-13T09:38:08.696609+0000","last_active":"2023-09-13T09:38:12.758222+0000","last_peered":"2023-09-13T09:38:12.758222+0000","last_clean":"2023-09-13T09:38:12.758222+0000","last_became_active":"2023-09-13T09:38:08.696286+0000","last_became_peered":"2023-09-13T09:38:08.696286+0000","last_unstale":"2023-09-13T09:38:12.758222+0000","last_undegraded":"2023-09-13T09:38:12.758222+0000","last_fullsized":"2023-09-13T09:38:12.758222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:06:51.121661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171465+0000","last_change":"2023-09-13T09:38:09.698374+0000","last_active":"2023-09-13T09:38:11.171465+0000","last_peered":"2023-09-13T09:38:11.171465+0000","last_clean":"2023-09-13T09:38:11.171465+0000","last_became_active":"2023-09-13T09:38:09.698050+0000","last_became_peered":"2023-09-13T09:38:09.698050+0000","last_unstale":"2023-09-13T09:38:11.171465+0000","last_undegraded":"2023-09-13T09:38:11.171465+0000","last_fullsized":"2023-09-13T09:38:11.171465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:37:24.089861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170863+0000","last_change":"2023-09-13T09:38:08.692717+0000","last_active":"2023-09-13T09:38:11.170863+0000","last_peered":"2023-09-13T09:38:11.170863+0000","last_clean":"2023-09-13T09:38:11.170863+0000","last_became_active":"2023-09-13T09:38:08.692340+0000","last_became_peered":"2023-09-13T09:38:08.692340+0000","last_unstale":"2023-09-13T09:38:11.170863+0000","last_undegraded":"2023-09-13T09:38:11.170863+0000","last_fullsized":"2023-09-13T09:38:11.170863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:22.280879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170823+0000","last_change":"2023-09-13T09:38:09.701623+0000","last_active":"2023-09-13T09:38:11.170823+0000","last_peered":"2023-09-13T09:38:11.170823+0000","last_clean":"2023-09-13T09:38:11.170823+0000","last_became_active":"2023-09-13T09:38:09.701338+0000","last_became_peered":"2023-09-13T09:38:09.701338+0000","last_unstale":"2023-09-13T09:38:11.170823+0000","last_undegraded":"2023-09-13T09:38:11.170823+0000","last_fullsized":"2023-09-13T09:38:11.170823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:49:58.937293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.169881+0000","last_change":"2023-09-13T09:38:08.691968+0000","last_active":"2023-09-13T09:38:11.169881+0000","last_peered":"2023-09-13T09:38:11.169881+0000","last_clean":"2023-09-13T09:38:11.169881+0000","last_became_active":"2023-09-13T09:38:08.691668+0000","last_became_peered":"2023-09-13T09:38:08.691668+0000","last_unstale":"2023-09-13T09:38:11.169881+0000","last_undegraded":"2023-09-13T09:38:11.169881+0000","last_fullsized":"2023-09-13T09:38:11.169881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:43.767948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683621+0000","last_change":"2023-09-13T09:38:09.698123+0000","last_active":"2023-09-13T09:38:10.683621+0000","last_peered":"2023-09-13T09:38:10.683621+0000","last_clean":"2023-09-13T09:38:10.683621+0000","last_became_active":"2023-09-13T09:38:09.697729+0000","last_became_peered":"2023-09-13T09:38:09.697729+0000","last_unstale":"2023-09-13T09:38:10.683621+0000","last_undegraded":"2023-09-13T09:38:10.683621+0000","last_fullsized":"2023-09-13T09:38:10.683621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:25.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170380+0000","last_change":"2023-09-13T09:38:08.691091+0000","last_active":"2023-09-13T09:38:11.170380+0000","last_peered":"2023-09-13T09:38:11.170380+0000","last_clean":"2023-09-13T09:38:11.170380+0000","last_became_active":"2023-09-13T09:38:08.689128+0000","last_became_peered":"2023-09-13T09:38:08.689128+0000","last_unstale":"2023-09-13T09:38:11.170380+0000","last_undegraded":"2023-09-13T09:38:11.170380+0000","last_fullsized":"2023-09-13T09:38:11.170380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:32.133388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233326+0000","last_change":"2023-09-13T09:38:09.706041+0000","last_active":"2023-09-13T09:38:12.233326+0000","last_peered":"2023-09-13T09:38:12.233326+0000","last_clean":"2023-09-13T09:38:12.233326+0000","last_became_active":"2023-09-13T09:38:09.705707+0000","last_became_peered":"2023-09-13T09:38:09.705707+0000","last_unstale":"2023-09-13T09:38:12.233326+0000","last_undegraded":"2023-09-13T09:38:12.233326+0000","last_fullsized":"2023-09-13T09:38:12.233326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:57.018000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170284+0000","last_change":"2023-09-13T09:38:08.695552+0000","last_active":"2023-09-13T09:38:11.170284+0000","last_peered":"2023-09-13T09:38:11.170284+0000","last_clean":"2023-09-13T09:38:11.170284+0000","last_became_active":"2023-09-13T09:38:08.695236+0000","last_became_peered":"2023-09-13T09:38:08.695236+0000","last_unstale":"2023-09-13T09:38:11.170284+0000","last_undegraded":"2023-09-13T09:38:11.170284+0000","last_fullsized":"2023-09-13T09:38:11.170284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:41.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.687208+0000","last_change":"2023-09-13T09:38:09.699864+0000","last_active":"2023-09-13T09:38:10.687208+0000","last_peered":"2023-09-13T09:38:10.687208+0000","last_clean":"2023-09-13T09:38:10.687208+0000","last_became_active":"2023-09-13T09:38:09.699522+0000","last_became_peered":"2023-09-13T09:38:09.699522+0000","last_unstale":"2023-09-13T09:38:10.687208+0000","last_undegraded":"2023-09-13T09:38:10.687208+0000","last_fullsized":"2023-09-13T09:38:10.687208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:51.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171282+0000","last_change":"2023-09-13T09:38:08.695651+0000","last_active":"2023-09-13T09:38:11.171282+0000","last_peered":"2023-09-13T09:38:11.171282+0000","last_clean":"2023-09-13T09:38:11.171282+0000","last_became_active":"2023-09-13T09:38:08.695074+0000","last_became_peered":"2023-09-13T09:38:08.695074+0000","last_unstale":"2023-09-13T09:38:11.171282+0000","last_undegraded":"2023-09-13T09:38:11.171282+0000","last_fullsized":"2023-09-13T09:38:11.171282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:40.974436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683373+0000","last_change":"2023-09-13T09:38:09.698193+0000","last_active":"2023-09-13T09:38:10.683373+0000","last_peered":"2023-09-13T09:38:10.683373+0000","last_clean":"2023-09-13T09:38:10.683373+0000","last_became_active":"2023-09-13T09:38:09.697874+0000","last_became_peered":"2023-09-13T09:38:09.697874+0000","last_unstale":"2023-09-13T09:38:10.683373+0000","last_undegraded":"2023-09-13T09:38:10.683373+0000","last_fullsized":"2023-09-13T09:38:10.683373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:48.908322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683532+0000","last_change":"2023-09-13T09:38:09.705768+0000","last_active":"2023-09-13T09:38:10.683532+0000","last_peered":"2023-09-13T09:38:10.683532+0000","last_clean":"2023-09-13T09:38:10.683532+0000","last_became_active":"2023-09-13T09:38:09.705403+0000","last_became_peered":"2023-09-13T09:38:09.705403+0000","last_unstale":"2023-09-13T09:38:10.683532+0000","last_undegraded":"2023-09-13T09:38:10.683532+0000","last_fullsized":"2023-09-13T09:38:10.683532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:14:07.171229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.767633+0000","last_change":"2023-09-13T09:38:08.695499+0000","last_active":"2023-09-13T09:38:13.767633+0000","last_peered":"2023-09-13T09:38:13.767633+0000","last_clean":"2023-09-13T09:38:13.767633+0000","last_became_active":"2023-09-13T09:38:08.695167+0000","last_became_peered":"2023-09-13T09:38:08.695167+0000","last_unstale":"2023-09-13T09:38:13.767633+0000","last_undegraded":"2023-09-13T09:38:13.767633+0000","last_fullsized":"2023-09-13T09:38:13.767633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.561408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170842+0000","last_change":"2023-09-13T09:38:09.702273+0000","last_active":"2023-09-13T09:38:11.170842+0000","last_peered":"2023-09-13T09:38:11.170842+0000","last_clean":"2023-09-13T09:38:11.170842+0000","last_became_active":"2023-09-13T09:38:09.701944+0000","last_became_peered":"2023-09-13T09:38:09.701944+0000","last_unstale":"2023-09-13T09:38:11.170842+0000","last_undegraded":"2023-09-13T09:38:11.170842+0000","last_fullsized":"2023-09-13T09:38:11.170842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:56.548720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171070+0000","last_change":"2023-09-13T09:38:08.692966+0000","last_active":"2023-09-13T09:38:11.171070+0000","last_peered":"2023-09-13T09:38:11.171070+0000","last_clean":"2023-09-13T09:38:11.171070+0000","last_became_active":"2023-09-13T09:38:08.692613+0000","last_became_peered":"2023-09-13T09:38:08.692613+0000","last_unstale":"2023-09-13T09:38:11.171070+0000","last_undegraded":"2023-09-13T09:38:11.171070+0000","last_fullsized":"2023-09-13T09:38:11.171070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:37.327846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":307,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T09:38:09.688801+0000","last_change":"2023-09-13T09:37:08.710441+0000","last_active":"2023-09-13T09:38:09.688801+0000","last_peered":"2023-09-13T09:38:09.688801+0000","last_clean":"2023-09-13T09:38:09.688801+0000","last_became_active":"2023-09-13T09:37:08.709939+0000","last_became_peered":"2023-09-13T09:37:08.709939+0000","last_unstale":"2023-09-13T09:38:09.688801+0000","last_undegraded":"2023-09-13T09:38:09.688801+0000","last_fullsized":"2023-09-13T09:38:09.688801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_clean_scrub_stamp":"2023-09-13T09:34:16.664369+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:00.964039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682890+0000","last_change":"2023-09-13T09:38:09.697244+0000","last_active":"2023-09-13T09:38:10.682890+0000","last_peered":"2023-09-13T09:38:10.682890+0000","last_clean":"2023-09-13T09:38:10.682890+0000","last_became_active":"2023-09-13T09:38:09.696925+0000","last_became_peered":"2023-09-13T09:38:09.696925+0000","last_unstale":"2023-09-13T09:38:10.682890+0000","last_undegraded":"2023-09-13T09:38:10.682890+0000","last_fullsized":"2023-09-13T09:38:10.682890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:39.566528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.765958+0000","last_change":"2023-09-13T09:38:08.702070+0000","last_active":"2023-09-13T09:38:13.765958+0000","last_peered":"2023-09-13T09:38:13.765958+0000","last_clean":"2023-09-13T09:38:13.765958+0000","last_became_active":"2023-09-13T09:38:08.701647+0000","last_became_peered":"2023-09-13T09:38:08.701647+0000","last_unstale":"2023-09-13T09:38:13.765958+0000","last_undegraded":"2023-09-13T09:38:13.765958+0000","last_fullsized":"2023-09-13T09:38:13.765958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:30:22.405675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170664+0000","last_change":"2023-09-13T09:38:08.696935+0000","last_active":"2023-09-13T09:38:11.170664+0000","last_peered":"2023-09-13T09:38:11.170664+0000","last_clean":"2023-09-13T09:38:11.170664+0000","last_became_active":"2023-09-13T09:38:08.696534+0000","last_became_peered":"2023-09-13T09:38:08.696534+0000","last_unstale":"2023-09-13T09:38:11.170664+0000","last_undegraded":"2023-09-13T09:38:11.170664+0000","last_fullsized":"2023-09-13T09:38:11.170664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:49:13.883043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683062+0000","last_change":"2023-09-13T09:38:09.695829+0000","last_active":"2023-09-13T09:38:10.683062+0000","last_peered":"2023-09-13T09:38:10.683062+0000","last_clean":"2023-09-13T09:38:10.683062+0000","last_became_active":"2023-09-13T09:38:09.695479+0000","last_became_peered":"2023-09-13T09:38:09.695479+0000","last_unstale":"2023-09-13T09:38:10.683062+0000","last_undegraded":"2023-09-13T09:38:10.683062+0000","last_fullsized":"2023-09-13T09:38:10.683062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:24:00.042236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.781302+0000","last_change":"2023-09-13T09:38:08.698530+0000","last_active":"2023-09-13T09:38:14.781302+0000","last_peered":"2023-09-13T09:38:14.781302+0000","last_clean":"2023-09-13T09:38:14.781302+0000","last_became_active":"2023-09-13T09:38:08.698206+0000","last_became_peered":"2023-09-13T09:38:08.698206+0000","last_unstale":"2023-09-13T09:38:14.781302+0000","last_undegraded":"2023-09-13T09:38:14.781302+0000","last_fullsized":"2023-09-13T09:38:14.781302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:09.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171580+0000","last_change":"2023-09-13T09:38:09.700993+0000","last_active":"2023-09-13T09:38:11.171580+0000","last_peered":"2023-09-13T09:38:11.171580+0000","last_clean":"2023-09-13T09:38:11.171580+0000","last_became_active":"2023-09-13T09:38:09.700677+0000","last_became_peered":"2023-09-13T09:38:09.700677+0000","last_unstale":"2023-09-13T09:38:11.171580+0000","last_undegraded":"2023-09-13T09:38:11.171580+0000","last_fullsized":"2023-09-13T09:38:11.171580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:32.209248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170980+0000","last_change":"2023-09-13T09:38:08.684326+0000","last_active":"2023-09-13T09:38:11.170980+0000","last_peered":"2023-09-13T09:38:11.170980+0000","last_clean":"2023-09-13T09:38:11.170980+0000","last_became_active":"2023-09-13T09:38:08.683972+0000","last_became_peered":"2023-09-13T09:38:08.683972+0000","last_unstale":"2023-09-13T09:38:11.170980+0000","last_undegraded":"2023-09-13T09:38:11.170980+0000","last_fullsized":"2023-09-13T09:38:11.170980+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:22.702277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170943+0000","last_change":"2023-09-13T09:38:09.706237+0000","last_active":"2023-09-13T09:38:11.170943+0000","last_peered":"2023-09-13T09:38:11.170943+0000","last_clean":"2023-09-13T09:38:11.170943+0000","last_became_active":"2023-09-13T09:38:09.705706+0000","last_became_peered":"2023-09-13T09:38:09.705706+0000","last_unstale":"2023-09-13T09:38:11.170943+0000","last_undegraded":"2023-09-13T09:38:11.170943+0000","last_fullsized":"2023-09-13T09:38:11.170943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:18.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.756655+0000","last_change":"2023-09-13T09:38:08.695641+0000","last_active":"2023-09-13T09:38:12.756655+0000","last_peered":"2023-09-13T09:38:12.756655+0000","last_clean":"2023-09-13T09:38:12.756655+0000","last_became_active":"2023-09-13T09:38:08.695090+0000","last_became_peered":"2023-09-13T09:38:08.695090+0000","last_unstale":"2023-09-13T09:38:12.756655+0000","last_undegraded":"2023-09-13T09:38:12.756655+0000","last_fullsized":"2023-09-13T09:38:12.756655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:16:13.987022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.169943+0000","last_change":"2023-09-13T09:38:09.702254+0000","last_active":"2023-09-13T09:38:11.169943+0000","last_peered":"2023-09-13T09:38:11.169943+0000","last_clean":"2023-09-13T09:38:11.169943+0000","last_became_active":"2023-09-13T09:38:09.701946+0000","last_became_peered":"2023-09-13T09:38:09.701946+0000","last_unstale":"2023-09-13T09:38:11.169943+0000","last_undegraded":"2023-09-13T09:38:11.169943+0000","last_fullsized":"2023-09-13T09:38:11.169943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:41.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.790992+0000","last_change":"2023-09-13T09:38:08.694692+0000","last_active":"2023-09-13T09:38:15.790992+0000","last_peered":"2023-09-13T09:38:15.790992+0000","last_clean":"2023-09-13T09:38:15.790992+0000","last_became_active":"2023-09-13T09:38:08.693799+0000","last_became_peered":"2023-09-13T09:38:08.693799+0000","last_unstale":"2023-09-13T09:38:15.790992+0000","last_undegraded":"2023-09-13T09:38:15.790992+0000","last_fullsized":"2023-09-13T09:38:15.790992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:53:57.188153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233050+0000","last_change":"2023-09-13T09:38:09.707954+0000","last_active":"2023-09-13T09:38:12.233050+0000","last_peered":"2023-09-13T09:38:12.233050+0000","last_clean":"2023-09-13T09:38:12.233050+0000","last_became_active":"2023-09-13T09:38:09.707659+0000","last_became_peered":"2023-09-13T09:38:09.707659+0000","last_unstale":"2023-09-13T09:38:12.233050+0000","last_undegraded":"2023-09-13T09:38:12.233050+0000","last_fullsized":"2023-09-13T09:38:12.233050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:34.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170497+0000","last_change":"2023-09-13T09:38:08.696505+0000","last_active":"2023-09-13T09:38:11.170497+0000","last_peered":"2023-09-13T09:38:11.170497+0000","last_clean":"2023-09-13T09:38:11.170497+0000","last_became_active":"2023-09-13T09:38:08.696106+0000","last_became_peered":"2023-09-13T09:38:08.696106+0000","last_unstale":"2023-09-13T09:38:11.170497+0000","last_undegraded":"2023-09-13T09:38:11.170497+0000","last_fullsized":"2023-09-13T09:38:11.170497+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:52:57.306234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171023+0000","last_change":"2023-09-13T09:38:09.700593+0000","last_active":"2023-09-13T09:38:11.171023+0000","last_peered":"2023-09-13T09:38:11.171023+0000","last_clean":"2023-09-13T09:38:11.171023+0000","last_became_active":"2023-09-13T09:38:09.700263+0000","last_became_peered":"2023-09-13T09:38:09.700263+0000","last_unstale":"2023-09-13T09:38:11.171023+0000","last_undegraded":"2023-09-13T09:38:11.171023+0000","last_fullsized":"2023-09-13T09:38:11.171023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:17:38.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170246+0000","last_change":"2023-09-13T09:38:08.692455+0000","last_active":"2023-09-13T09:38:11.170246+0000","last_peered":"2023-09-13T09:38:11.170246+0000","last_clean":"2023-09-13T09:38:11.170246+0000","last_became_active":"2023-09-13T09:38:08.692118+0000","last_became_peered":"2023-09-13T09:38:08.692118+0000","last_unstale":"2023-09-13T09:38:11.170246+0000","last_undegraded":"2023-09-13T09:38:11.170246+0000","last_fullsized":"2023-09-13T09:38:11.170246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:33.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.695783+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.695473+0000","last_became_peered":"2023-09-13T09:38:09.695473+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:59.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.780464+0000","last_change":"2023-09-13T09:38:08.697468+0000","last_active":"2023-09-13T09:38:14.780464+0000","last_peered":"2023-09-13T09:38:14.780464+0000","last_clean":"2023-09-13T09:38:14.780464+0000","last_became_active":"2023-09-13T09:38:08.697141+0000","last_became_peered":"2023-09-13T09:38:08.697141+0000","last_unstale":"2023-09-13T09:38:14.780464+0000","last_undegraded":"2023-09-13T09:38:14.780464+0000","last_fullsized":"2023-09-13T09:38:14.780464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:33:26.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171808+0000","last_change":"2023-09-13T09:38:09.703754+0000","last_active":"2023-09-13T09:38:11.171808+0000","last_peered":"2023-09-13T09:38:11.171808+0000","last_clean":"2023-09-13T09:38:11.171808+0000","last_became_active":"2023-09-13T09:38:09.703438+0000","last_became_peered":"2023-09-13T09:38:09.703438+0000","last_unstale":"2023-09-13T09:38:11.171808+0000","last_undegraded":"2023-09-13T09:38:11.171808+0000","last_fullsized":"2023-09-13T09:38:11.171808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:19.298385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T09:38:09.746765+0000","last_change":"2023-09-13T09:38:08.698973+0000","last_active":"2023-09-13T09:38:09.746765+0000","last_peered":"2023-09-13T09:38:09.746765+0000","last_clean":"2023-09-13T09:38:09.746765+0000","last_became_active":"2023-09-13T09:38:08.698329+0000","last_became_peered":"2023-09-13T09:38:08.698329+0000","last_unstale":"2023-09-13T09:38:09.746765+0000","last_undegraded":"2023-09-13T09:38:09.746765+0000","last_fullsized":"2023-09-13T09:38:09.746765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:10.684590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171494+0000","last_change":"2023-09-13T09:38:09.700216+0000","last_active":"2023-09-13T09:38:11.171494+0000","last_peered":"2023-09-13T09:38:11.171494+0000","last_clean":"2023-09-13T09:38:11.171494+0000","last_became_active":"2023-09-13T09:38:09.699876+0000","last_became_peered":"2023-09-13T09:38:09.699876+0000","last_unstale":"2023-09-13T09:38:11.171494+0000","last_undegraded":"2023-09-13T09:38:11.171494+0000","last_fullsized":"2023-09-13T09:38:11.171494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:33.347155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.788169+0000","last_change":"2023-09-13T09:38:08.696200+0000","last_active":"2023-09-13T09:38:15.788169+0000","last_peered":"2023-09-13T09:38:15.788169+0000","last_clean":"2023-09-13T09:38:15.788169+0000","last_became_active":"2023-09-13T09:38:08.695880+0000","last_became_peered":"2023-09-13T09:38:08.695880+0000","last_unstale":"2023-09-13T09:38:15.788169+0000","last_undegraded":"2023-09-13T09:38:15.788169+0000","last_fullsized":"2023-09-13T09:38:15.788169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:38.222209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171897+0000","last_change":"2023-09-13T09:38:09.703022+0000","last_active":"2023-09-13T09:38:11.171897+0000","last_peered":"2023-09-13T09:38:11.171897+0000","last_clean":"2023-09-13T09:38:11.171897+0000","last_became_active":"2023-09-13T09:38:09.702665+0000","last_became_peered":"2023-09-13T09:38:09.702665+0000","last_unstale":"2023-09-13T09:38:11.171897+0000","last_undegraded":"2023-09-13T09:38:11.171897+0000","last_fullsized":"2023-09-13T09:38:11.171897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:59.284385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233158+0000","last_change":"2023-09-13T09:38:09.708137+0000","last_active":"2023-09-13T09:38:12.233158+0000","last_peered":"2023-09-13T09:38:12.233158+0000","last_clean":"2023-09-13T09:38:12.233158+0000","last_became_active":"2023-09-13T09:38:09.707829+0000","last_became_peered":"2023-09-13T09:38:09.707829+0000","last_unstale":"2023-09-13T09:38:12.233158+0000","last_undegraded":"2023-09-13T09:38:12.233158+0000","last_fullsized":"2023-09-13T09:38:12.233158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:15.976098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170521+0000","last_change":"2023-09-13T09:38:09.703131+0000","last_active":"2023-09-13T09:38:11.170521+0000","last_peered":"2023-09-13T09:38:11.170521+0000","last_clean":"2023-09-13T09:38:11.170521+0000","last_became_active":"2023-09-13T09:38:09.702850+0000","last_became_peered":"2023-09-13T09:38:09.702850+0000","last_unstale":"2023-09-13T09:38:11.170521+0000","last_undegraded":"2023-09-13T09:38:11.170521+0000","last_fullsized":"2023-09-13T09:38:11.170521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:08.422038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170418+0000","last_change":"2023-09-13T09:38:09.701691+0000","last_active":"2023-09-13T09:38:11.170418+0000","last_peered":"2023-09-13T09:38:11.170418+0000","last_clean":"2023-09-13T09:38:11.170418+0000","last_became_active":"2023-09-13T09:38:09.701395+0000","last_became_peered":"2023-09-13T09:38:09.701395+0000","last_unstale":"2023-09-13T09:38:11.170418+0000","last_undegraded":"2023-09-13T09:38:11.170418+0000","last_fullsized":"2023-09-13T09:38:11.170418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:02.916712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170550+0000","last_change":"2023-09-13T09:38:09.706885+0000","last_active":"2023-09-13T09:38:11.170550+0000","last_peered":"2023-09-13T09:38:11.170550+0000","last_clean":"2023-09-13T09:38:11.170550+0000","last_became_active":"2023-09-13T09:38:09.706569+0000","last_became_peered":"2023-09-13T09:38:09.706569+0000","last_unstale":"2023-09-13T09:38:11.170550+0000","last_undegraded":"2023-09-13T09:38:11.170550+0000","last_fullsized":"2023-09-13T09:38:11.170550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:02.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683123+0000","last_change":"2023-09-13T09:38:09.698547+0000","last_active":"2023-09-13T09:38:10.683123+0000","last_peered":"2023-09-13T09:38:10.683123+0000","last_clean":"2023-09-13T09:38:10.683123+0000","last_became_active":"2023-09-13T09:38:09.698180+0000","last_became_peered":"2023-09-13T09:38:09.698180+0000","last_unstale":"2023-09-13T09:38:10.683123+0000","last_undegraded":"2023-09-13T09:38:10.683123+0000","last_fullsized":"2023-09-13T09:38:10.683123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:12.988597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233293+0000","last_change":"2023-09-13T09:38:09.706780+0000","last_active":"2023-09-13T09:38:12.233293+0000","last_peered":"2023-09-13T09:38:12.233293+0000","last_clean":"2023-09-13T09:38:12.233293+0000","last_became_active":"2023-09-13T09:38:09.706487+0000","last_became_peered":"2023-09-13T09:38:09.706487+0000","last_unstale":"2023-09-13T09:38:12.233293+0000","last_undegraded":"2023-09-13T09:38:12.233293+0000","last_fullsized":"2023-09-13T09:38:12.233293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:18:29.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170952+0000","last_change":"2023-09-13T09:38:09.695277+0000","last_active":"2023-09-13T09:38:11.170952+0000","last_peered":"2023-09-13T09:38:11.170952+0000","last_clean":"2023-09-13T09:38:11.170952+0000","last_became_active":"2023-09-13T09:38:09.694959+0000","last_became_peered":"2023-09-13T09:38:09.694959+0000","last_unstale":"2023-09-13T09:38:11.170952+0000","last_undegraded":"2023-09-13T09:38:11.170952+0000","last_fullsized":"2023-09-13T09:38:11.170952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:35:17.321069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171496+0000","last_change":"2023-09-13T09:38:09.702030+0000","last_active":"2023-09-13T09:38:11.171496+0000","last_peered":"2023-09-13T09:38:11.171496+0000","last_clean":"2023-09-13T09:38:11.171496+0000","last_became_active":"2023-09-13T09:38:09.701712+0000","last_became_peered":"2023-09-13T09:38:09.701712+0000","last_unstale":"2023-09-13T09:38:11.171496+0000","last_undegraded":"2023-09-13T09:38:11.171496+0000","last_fullsized":"2023-09-13T09:38:11.171496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:38.909533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683499+0000","last_change":"2023-09-13T09:38:09.706625+0000","last_active":"2023-09-13T09:38:10.683499+0000","last_peered":"2023-09-13T09:38:10.683499+0000","last_clean":"2023-09-13T09:38:10.683499+0000","last_became_active":"2023-09-13T09:38:09.706315+0000","last_became_peered":"2023-09-13T09:38:09.706315+0000","last_unstale":"2023-09-13T09:38:10.683499+0000","last_undegraded":"2023-09-13T09:38:10.683499+0000","last_fullsized":"2023-09-13T09:38:10.683499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:21.653592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171694+0000","last_change":"2023-09-13T09:38:09.703544+0000","last_active":"2023-09-13T09:38:11.171694+0000","last_peered":"2023-09-13T09:38:11.171694+0000","last_clean":"2023-09-13T09:38:11.171694+0000","last_became_active":"2023-09-13T09:38:09.702015+0000","last_became_peered":"2023-09-13T09:38:09.702015+0000","last_unstale":"2023-09-13T09:38:11.171694+0000","last_undegraded":"2023-09-13T09:38:11.171694+0000","last_fullsized":"2023-09-13T09:38:11.171694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:46:49.166965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170600+0000","last_change":"2023-09-13T09:38:09.694224+0000","last_active":"2023-09-13T09:38:11.170600+0000","last_peered":"2023-09-13T09:38:11.170600+0000","last_clean":"2023-09-13T09:38:11.170600+0000","last_became_active":"2023-09-13T09:38:09.693562+0000","last_became_peered":"2023-09-13T09:38:09.693562+0000","last_unstale":"2023-09-13T09:38:11.170600+0000","last_undegraded":"2023-09-13T09:38:11.170600+0000","last_fullsized":"2023-09-13T09:38:11.170600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:41:07.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683159+0000","last_change":"2023-09-13T09:38:09.698919+0000","last_active":"2023-09-13T09:38:10.683159+0000","last_peered":"2023-09-13T09:38:10.683159+0000","last_clean":"2023-09-13T09:38:10.683159+0000","last_became_active":"2023-09-13T09:38:09.698637+0000","last_became_peered":"2023-09-13T09:38:09.698637+0000","last_unstale":"2023-09-13T09:38:10.683159+0000","last_undegraded":"2023-09-13T09:38:10.683159+0000","last_fullsized":"2023-09-13T09:38:10.683159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:50.277687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233181+0000","last_change":"2023-09-13T09:38:09.705194+0000","last_active":"2023-09-13T09:38:12.233181+0000","last_peered":"2023-09-13T09:38:12.233181+0000","last_clean":"2023-09-13T09:38:12.233181+0000","last_became_active":"2023-09-13T09:38:09.704888+0000","last_became_peered":"2023-09-13T09:38:09.704888+0000","last_unstale":"2023-09-13T09:38:12.233181+0000","last_undegraded":"2023-09-13T09:38:12.233181+0000","last_fullsized":"2023-09-13T09:38:12.233181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:07.995177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22565,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":52120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416395,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":10,"up_from":71,"seq":304942678033,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1045283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.627},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58699999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63900000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841556,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":434962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.373}]},{"osd":1,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.438}]},{"osd":4,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.50800000000000001}]},{"osd":5,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.60899999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.71899999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86699999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103192,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":434327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48499999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.79100000000000004}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.86799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":7,"up_from":50,"seq":214748364829,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1523712,"data_stored":1026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69699999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84399999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.755}]},{"osd":4,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.095,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77300000000000002}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82199999999999995}]},{"osd":9,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.91800000000000004}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.90000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]}]},{"osd":6,"up_from":45,"seq":193273528354,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":434289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39400000000000002,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.249,"15min":0.249},"max":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.39800000000000002},"min":{"1min":0.29699999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.34599999999999997}]},{"osd":1,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59399999999999997,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91200000000000003,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.504}]},{"osd":3,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.47499999999999998,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.36599999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88800000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.54000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94599999999999995,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.753,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.55700000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.60999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.113,"5min":1.143,"15min":1.143},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56799999999999995}]},{"osd":9,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.435},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51600000000000001}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.73399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.52100000000000002},"min":{"1min":0.44700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.495}]},{"osd":2,"last update":"Wed Sep 13 09:37:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.61699999999999999,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.51900000000000002,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.628}]},{"osd":5,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65400000000000003,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60299999999999998}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81899999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.91800000000000004}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.747},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.95099999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.89700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":434144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36299999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91100000000000003,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"min":{"1min":0.38700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.86199999999999999,"5min":1.47,"15min":1.47},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.54000000000000004,"15min":0.51300000000000001},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.878,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed Sep 13 09:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58799999999999997,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.97599999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.751,"5min":1.288,"15min":1.288},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.502},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.375},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.39700000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69299999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.79900000000000004}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58499999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":437638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.498,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.51300000000000001,"15min":0.48699999999999999},"min":{"1min":0.45100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003}]},{"osd":1,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.496},{"interface":"front","average":{"1min":0.625,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.627,"15min":0.60099999999999998},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51400000000000001}]},{"osd":5,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.29699999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.80500000000000005}]},{"osd":6,"last update":"Wed Sep 13 09:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65600000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.753},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76300000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58799999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":434131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.371,"15min":0.34399999999999997},"min":{"1min":0.315,"5min":0.219,"15min":0.219},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.39600000000000002,"15min":0.379},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.54200000000000004,"15min":0.51500000000000001},"min":{"1min":0.45200000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.61099999999999999,"15min":0.58899999999999997},"min":{"1min":0.49099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1220000000000001,"5min":2.238,"15min":2.238},"last":0.82099999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.56100000000000005},"min":{"1min":0.47099999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.746}]},{"osd":5,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.377,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97999999999999998,"5min":1.071,"15min":1.071},"last":0.89500000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.60899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.175,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.84199999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.875}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.92000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953513,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":425506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.53100000000000003},"min":{"1min":0.44700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.335,"5min":3.335,"15min":3.335},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.41399999999999998,"15min":0.38900000000000001},"min":{"1min":0.34000000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.372},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34499999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.622},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60499999999999998,"15min":0.57099999999999995},"min":{"1min":0.51100000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5230000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53400000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.46500000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.502},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.48199999999999998}]},{"osd":8,"last update":"Wed Sep 13 09:37:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61199999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64400000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":37,"seq":158913789990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1025898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.503,"15min":0.495},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.35799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.623}]},{"osd":1,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.39000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.42299999999999999,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.495},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.749}]},{"osd":6,"last update":"Wed Sep 13 09:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79200000000000004}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":1.044,"15min":1.044},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92500000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.88600000000000001}]},{"osd":8,"last update":"Wed Sep 13 09:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70399999999999996}]},{"osd":9,"last update":"Wed Sep 13 09:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.90400000000000003}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.92500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":21339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":21069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T09:38:17.599 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T09:38:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 -- 172.21.15.6:0/272346929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 msgr2=0x7f89c0106640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 --2- 172.21.15.6:0/272346929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0106640 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009990 tx=0x7f89b4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 -- 172.21.15.6:0/272346929 shutdown_connections 2023-09-13T09:38:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 --2- 172.21.15.6:0/272346929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c0106b80 0x7f89c0108f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 --2- 172.21.15.6:0/272346929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89c0101920 0x7f89c0103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 --2- 172.21.15.6:0/272346929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0106640 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 -- 172.21.15.6:0/272346929 >> 172.21.15.6:0/272346929 conn(0x7f89c00fb230 msgr2=0x7f89c00fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 -- 172.21.15.6:0/272346929 shutdown_connections 2023-09-13T09:38:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 -- 172.21.15.6:0/272346929 wait complete. 2023-09-13T09:38:17.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 Processor -- start 2023-09-13T09:38:17.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.760+0000 7f89c56b0700 1 -- start start 2023-09-13T09:38:17.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89c56b0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89c0101920 0x7f89c0196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89c56b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89c56b0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c0106b80 0x7f89c019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89c56b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c019e590 con 0x7f89c0104250 2023-09-13T09:38:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89c56b0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c019e6d0 con 0x7f89c0106b80 2023-09-13T09:38:17.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89c56b0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c019e860 con 0x7f89c0101920 2023-09-13T09:38:17.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60632/0 (socket says 172.21.15.6:60632) 2023-09-13T09:38:17.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 -- 172.21.15.6:0/118206323 learned_addr learned my addr 172.21.15.6:0/118206323 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:17.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89bf7fe700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c0106b80 0x7f89c019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89beffd700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89c0101920 0x7f89c0196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 -- 172.21.15.6:0/118206323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89c0101920 msgr2=0x7f89c0196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89c0101920 0x7f89c0196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 -- 172.21.15.6:0/118206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c0106b80 msgr2=0x7f89c019dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c0106b80 0x7f89c019dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 -- 172.21.15.6:0/118206323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40095f0 con 0x7f89c0104250 2023-09-13T09:38:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89be7fc700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0196f50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89b4000c00 tx=0x7f89b400f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.761+0000 7f89a7fff700 1 -- 172.21.15.6:0/118206323 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b401d070 con 0x7f89c0104250 2023-09-13T09:38:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.762+0000 7f89a7fff700 1 -- 172.21.15.6:0/118206323 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f89b400fb50 con 0x7f89c0104250 2023-09-13T09:38:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.762+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c019eae0 con 0x7f89c0104250 2023-09-13T09:38:17.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.762+0000 7f89a7fff700 1 -- 172.21.15.6:0/118206323 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4017650 con 0x7f89c0104250 2023-09-13T09:38:17.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.762+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c019ef90 con 0x7f89c0104250 2023-09-13T09:38:17.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.762+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c010c550 con 0x7f89c0104250 2023-09-13T09:38:17.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.763+0000 7f89a7fff700 1 -- 172.21.15.6:0/118206323 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f89b400fcc0 con 0x7f89c0104250 2023-09-13T09:38:17.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.764+0000 7f89a7fff700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89a80a06d0 0x7f89a80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:17.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.764+0000 7f89a7fff700 1 -- 172.21.15.6:0/118206323 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f89b40cceb0 con 0x7f89c0104250 2023-09-13T09:38:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.764+0000 7f89beffd700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89a80a06d0 0x7f89a80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.765+0000 7f89beffd700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89a80a06d0 0x7f89a80a2b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f89b0005950 tx=0x7f89b00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:17.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.769+0000 7f89a7fff700 1 -- 172.21.15.6:0/118206323 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f89b4096ac0 con 0x7f89c0104250 2023-09-13T09:38:17.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.968+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89c019f180 con 0x7f89a80a06d0 2023-09-13T09:38:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.980+0000 7f89a7fff700 1 -- 172.21.15.6:0/118206323 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+335411 (secure 0 0 0) 0x7f89c019f180 con 0x7f89a80a06d0 2023-09-13T09:38:17.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89a80a06d0 msgr2=0x7f89a80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89a80a06d0 0x7f89a80a2b90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f89b0005950 tx=0x7f89b00058e0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 msgr2=0x7f89c0196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0196f50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f89b4000c00 tx=0x7f89b400f710 comp rx=0 tx=0).stop 2023-09-13T09:38:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 shutdown_connections 2023-09-13T09:38:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89c0106b80 0x7f89c019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89c0101920 0x7f89c0196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89a80a06d0 0x7f89a80a2b90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 --2- 172.21.15.6:0/118206323 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89c0104250 0x7f89c0196f50 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 >> 172.21.15.6:0/118206323 conn(0x7f89c00fb230 msgr2=0x7f89c0102d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.983+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 shutdown_connections 2023-09-13T09:38:17.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:17.984+0000 7f89c56b0700 1 -- 172.21.15.6:0/118206323 wait complete. 2023-09-13T09:38:17.989 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-09-13T09:38:17.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:17 smithi006 ceph-mon[98665]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:17 smithi006 ceph-mon[98665]: pgmap v259: 97 pgs: 97 active+clean; 599 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s wr, 18 op/s 2023-09-13T09:38:17.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:17 smithi006 ceph-mon[98665]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:17.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:17 smithi006 ceph-mon[98665]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-09-13T09:38:17.996 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:17 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2894558348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:17.996 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:17 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2258697889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:17.997 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2023-09-13T09:38:16.139902+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":613056,"num_objects":61,"num_object_clones":0,"num_object_copies":183,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":318,"num_write_kb":2988,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":282,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":336804,"kb_used_data":12580,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124605020,"statfs":{"total":1151940427776,"available":1151595540480,"internally_reserved":0,"allocated":12881920,"data_stored":7002784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":22688,"num_objects":59,"num_object_clones":0,"num_object_copies":177,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":137,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.461379"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233536+0000","last_change":"2023-09-13T09:38:09.701485+0000","last_active":"2023-09-13T09:38:12.233536+0000","last_peered":"2023-09-13T09:38:12.233536+0000","last_clean":"2023-09-13T09:38:12.233536+0000","last_became_active":"2023-09-13T09:38:09.701160+0000","last_became_peered":"2023-09-13T09:38:09.701160+0000","last_unstale":"2023-09-13T09:38:12.233536+0000","last_undegraded":"2023-09-13T09:38:12.233536+0000","last_fullsized":"2023-09-13T09:38:12.233536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:10.089322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171037+0000","last_change":"2023-09-13T09:38:09.697198+0000","last_active":"2023-09-13T09:38:11.171037+0000","last_peered":"2023-09-13T09:38:11.171037+0000","last_clean":"2023-09-13T09:38:11.171037+0000","last_became_active":"2023-09-13T09:38:09.696859+0000","last_became_peered":"2023-09-13T09:38:09.696859+0000","last_unstale":"2023-09-13T09:38:11.171037+0000","last_undegraded":"2023-09-13T09:38:11.171037+0000","last_fullsized":"2023-09-13T09:38:11.171037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:53.601426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170662+0000","last_change":"2023-09-13T09:38:09.696150+0000","last_active":"2023-09-13T09:38:11.170662+0000","last_peered":"2023-09-13T09:38:11.170662+0000","last_clean":"2023-09-13T09:38:11.170662+0000","last_became_active":"2023-09-13T09:38:09.695893+0000","last_became_peered":"2023-09-13T09:38:09.695893+0000","last_unstale":"2023-09-13T09:38:11.170662+0000","last_undegraded":"2023-09-13T09:38:11.170662+0000","last_fullsized":"2023-09-13T09:38:11.170662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:51.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171082+0000","last_change":"2023-09-13T09:38:09.697564+0000","last_active":"2023-09-13T09:38:11.171082+0000","last_peered":"2023-09-13T09:38:11.171082+0000","last_clean":"2023-09-13T09:38:11.171082+0000","last_became_active":"2023-09-13T09:38:09.697235+0000","last_became_peered":"2023-09-13T09:38:09.697235+0000","last_unstale":"2023-09-13T09:38:11.171082+0000","last_undegraded":"2023-09-13T09:38:11.171082+0000","last_fullsized":"2023-09-13T09:38:11.171082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:49.705452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170159+0000","last_change":"2023-09-13T09:38:09.702889+0000","last_active":"2023-09-13T09:38:11.170159+0000","last_peered":"2023-09-13T09:38:11.170159+0000","last_clean":"2023-09-13T09:38:11.170159+0000","last_became_active":"2023-09-13T09:38:09.702589+0000","last_became_peered":"2023-09-13T09:38:09.702589+0000","last_unstale":"2023-09-13T09:38:11.170159+0000","last_undegraded":"2023-09-13T09:38:11.170159+0000","last_fullsized":"2023-09-13T09:38:11.170159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:56:05.432576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683357+0000","last_change":"2023-09-13T09:38:09.697097+0000","last_active":"2023-09-13T09:38:10.683357+0000","last_peered":"2023-09-13T09:38:10.683357+0000","last_clean":"2023-09-13T09:38:10.683357+0000","last_became_active":"2023-09-13T09:38:09.696770+0000","last_became_peered":"2023-09-13T09:38:09.696770+0000","last_unstale":"2023-09-13T09:38:10.683357+0000","last_undegraded":"2023-09-13T09:38:10.683357+0000","last_fullsized":"2023-09-13T09:38:10.683357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:46.305472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171571+0000","last_change":"2023-09-13T09:38:09.700506+0000","last_active":"2023-09-13T09:38:11.171571+0000","last_peered":"2023-09-13T09:38:11.171571+0000","last_clean":"2023-09-13T09:38:11.171571+0000","last_became_active":"2023-09-13T09:38:09.700178+0000","last_became_peered":"2023-09-13T09:38:09.700178+0000","last_unstale":"2023-09-13T09:38:11.171571+0000","last_undegraded":"2023-09-13T09:38:11.171571+0000","last_fullsized":"2023-09-13T09:38:11.171571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:04.261443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170488+0000","last_change":"2023-09-13T09:38:09.703191+0000","last_active":"2023-09-13T09:38:11.170488+0000","last_peered":"2023-09-13T09:38:11.170488+0000","last_clean":"2023-09-13T09:38:11.170488+0000","last_became_active":"2023-09-13T09:38:09.702874+0000","last_became_peered":"2023-09-13T09:38:09.702874+0000","last_unstale":"2023-09-13T09:38:11.170488+0000","last_undegraded":"2023-09-13T09:38:11.170488+0000","last_fullsized":"2023-09-13T09:38:11.170488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:50:25.759861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171171+0000","last_change":"2023-09-13T09:38:09.700416+0000","last_active":"2023-09-13T09:38:11.171171+0000","last_peered":"2023-09-13T09:38:11.171171+0000","last_clean":"2023-09-13T09:38:11.171171+0000","last_became_active":"2023-09-13T09:38:09.700102+0000","last_became_peered":"2023-09-13T09:38:09.700102+0000","last_unstale":"2023-09-13T09:38:11.171171+0000","last_undegraded":"2023-09-13T09:38:11.171171+0000","last_fullsized":"2023-09-13T09:38:11.171171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:53.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683677+0000","last_change":"2023-09-13T09:38:09.702609+0000","last_active":"2023-09-13T09:38:10.683677+0000","last_peered":"2023-09-13T09:38:10.683677+0000","last_clean":"2023-09-13T09:38:10.683677+0000","last_became_active":"2023-09-13T09:38:09.702244+0000","last_became_peered":"2023-09-13T09:38:09.702244+0000","last_unstale":"2023-09-13T09:38:10.683677+0000","last_undegraded":"2023-09-13T09:38:10.683677+0000","last_fullsized":"2023-09-13T09:38:10.683677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:08:30.911492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171785+0000","last_change":"2023-09-13T09:38:09.694245+0000","last_active":"2023-09-13T09:38:11.171785+0000","last_peered":"2023-09-13T09:38:11.171785+0000","last_clean":"2023-09-13T09:38:11.171785+0000","last_became_active":"2023-09-13T09:38:09.693939+0000","last_became_peered":"2023-09-13T09:38:09.693939+0000","last_unstale":"2023-09-13T09:38:11.171785+0000","last_undegraded":"2023-09-13T09:38:11.171785+0000","last_fullsized":"2023-09-13T09:38:11.171785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:08.383075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171904+0000","last_change":"2023-09-13T09:38:09.696680+0000","last_active":"2023-09-13T09:38:11.171904+0000","last_peered":"2023-09-13T09:38:11.171904+0000","last_clean":"2023-09-13T09:38:11.171904+0000","last_became_active":"2023-09-13T09:38:09.696369+0000","last_became_peered":"2023-09-13T09:38:09.696369+0000","last_unstale":"2023-09-13T09:38:11.171904+0000","last_undegraded":"2023-09-13T09:38:11.171904+0000","last_fullsized":"2023-09-13T09:38:11.171904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:48.111921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683082+0000","last_change":"2023-09-13T09:38:09.703214+0000","last_active":"2023-09-13T09:38:10.683082+0000","last_peered":"2023-09-13T09:38:10.683082+0000","last_clean":"2023-09-13T09:38:10.683082+0000","last_became_active":"2023-09-13T09:38:09.702815+0000","last_became_peered":"2023-09-13T09:38:09.702815+0000","last_unstale":"2023-09-13T09:38:10.683082+0000","last_undegraded":"2023-09-13T09:38:10.683082+0000","last_fullsized":"2023-09-13T09:38:10.683082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:46.437548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171130+0000","last_change":"2023-09-13T09:38:09.699968+0000","last_active":"2023-09-13T09:38:11.171130+0000","last_peered":"2023-09-13T09:38:11.171130+0000","last_clean":"2023-09-13T09:38:11.171130+0000","last_became_active":"2023-09-13T09:38:09.699643+0000","last_became_peered":"2023-09-13T09:38:09.699643+0000","last_unstale":"2023-09-13T09:38:11.171130+0000","last_undegraded":"2023-09-13T09:38:11.171130+0000","last_fullsized":"2023-09-13T09:38:11.171130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:41:40.550328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.694517+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.691295+0000","last_became_peered":"2023-09-13T09:38:09.691295+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:48:40.291170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170268+0000","last_change":"2023-09-13T09:38:09.695903+0000","last_active":"2023-09-13T09:38:11.170268+0000","last_peered":"2023-09-13T09:38:11.170268+0000","last_clean":"2023-09-13T09:38:11.170268+0000","last_became_active":"2023-09-13T09:38:09.695585+0000","last_became_peered":"2023-09-13T09:38:09.695585+0000","last_unstale":"2023-09-13T09:38:11.170268+0000","last_undegraded":"2023-09-13T09:38:11.170268+0000","last_fullsized":"2023-09-13T09:38:11.170268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:13.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233581+0000","last_change":"2023-09-13T09:38:09.702485+0000","last_active":"2023-09-13T09:38:12.233581+0000","last_peered":"2023-09-13T09:38:12.233581+0000","last_clean":"2023-09-13T09:38:12.233581+0000","last_became_active":"2023-09-13T09:38:09.701989+0000","last_became_peered":"2023-09-13T09:38:09.701989+0000","last_unstale":"2023-09-13T09:38:12.233581+0000","last_undegraded":"2023-09-13T09:38:12.233581+0000","last_fullsized":"2023-09-13T09:38:12.233581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:58.832560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170815+0000","last_change":"2023-09-13T09:38:09.695080+0000","last_active":"2023-09-13T09:38:11.170815+0000","last_peered":"2023-09-13T09:38:11.170815+0000","last_clean":"2023-09-13T09:38:11.170815+0000","last_became_active":"2023-09-13T09:38:09.694782+0000","last_became_peered":"2023-09-13T09:38:09.694782+0000","last_unstale":"2023-09-13T09:38:11.170815+0000","last_undegraded":"2023-09-13T09:38:11.170815+0000","last_fullsized":"2023-09-13T09:38:11.170815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:15.146156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170850+0000","last_change":"2023-09-13T09:38:09.702456+0000","last_active":"2023-09-13T09:38:11.170850+0000","last_peered":"2023-09-13T09:38:11.170850+0000","last_clean":"2023-09-13T09:38:11.170850+0000","last_became_active":"2023-09-13T09:38:09.702171+0000","last_became_peered":"2023-09-13T09:38:09.702171+0000","last_unstale":"2023-09-13T09:38:11.170850+0000","last_undegraded":"2023-09-13T09:38:11.170850+0000","last_fullsized":"2023-09-13T09:38:11.170850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:32.995619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'11","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.779585+0000","last_change":"2023-09-13T09:38:08.692389+0000","last_active":"2023-09-13T09:38:14.779585+0000","last_peered":"2023-09-13T09:38:14.779585+0000","last_clean":"2023-09-13T09:38:14.779585+0000","last_became_active":"2023-09-13T09:38:08.692022+0000","last_became_peered":"2023-09-13T09:38:08.692022+0000","last_unstale":"2023-09-13T09:38:14.779585+0000","last_undegraded":"2023-09-13T09:38:14.779585+0000","last_fullsized":"2023-09-13T09:38:14.779585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:58:40.288839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170755+0000","last_change":"2023-09-13T09:38:09.704712+0000","last_active":"2023-09-13T09:38:11.170755+0000","last_peered":"2023-09-13T09:38:11.170755+0000","last_clean":"2023-09-13T09:38:11.170755+0000","last_became_active":"2023-09-13T09:38:09.704379+0000","last_became_peered":"2023-09-13T09:38:09.704379+0000","last_unstale":"2023-09-13T09:38:11.170755+0000","last_undegraded":"2023-09-13T09:38:11.170755+0000","last_fullsized":"2023-09-13T09:38:11.170755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:47.605987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170899+0000","last_change":"2023-09-13T09:38:08.694408+0000","last_active":"2023-09-13T09:38:11.170899+0000","last_peered":"2023-09-13T09:38:11.170899+0000","last_clean":"2023-09-13T09:38:11.170899+0000","last_became_active":"2023-09-13T09:38:08.693140+0000","last_became_peered":"2023-09-13T09:38:08.693140+0000","last_unstale":"2023-09-13T09:38:11.170899+0000","last_undegraded":"2023-09-13T09:38:11.170899+0000","last_fullsized":"2023-09-13T09:38:11.170899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:27:22.637489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171299+0000","last_change":"2023-09-13T09:38:09.705381+0000","last_active":"2023-09-13T09:38:11.171299+0000","last_peered":"2023-09-13T09:38:11.171299+0000","last_clean":"2023-09-13T09:38:11.171299+0000","last_became_active":"2023-09-13T09:38:09.705059+0000","last_became_peered":"2023-09-13T09:38:09.705059+0000","last_unstale":"2023-09-13T09:38:11.171299+0000","last_undegraded":"2023-09-13T09:38:11.171299+0000","last_fullsized":"2023-09-13T09:38:11.171299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:11.294362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170734+0000","last_change":"2023-09-13T09:38:08.695077+0000","last_active":"2023-09-13T09:38:11.170734+0000","last_peered":"2023-09-13T09:38:11.170734+0000","last_clean":"2023-09-13T09:38:11.170734+0000","last_became_active":"2023-09-13T09:38:08.694778+0000","last_became_peered":"2023-09-13T09:38:08.694778+0000","last_unstale":"2023-09-13T09:38:11.170734+0000","last_undegraded":"2023-09-13T09:38:11.170734+0000","last_fullsized":"2023-09-13T09:38:11.170734+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:31.517739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170421+0000","last_change":"2023-09-13T09:38:09.696875+0000","last_active":"2023-09-13T09:38:11.170421+0000","last_peered":"2023-09-13T09:38:11.170421+0000","last_clean":"2023-09-13T09:38:11.170421+0000","last_became_active":"2023-09-13T09:38:09.696060+0000","last_became_peered":"2023-09-13T09:38:09.696060+0000","last_unstale":"2023-09-13T09:38:11.170421+0000","last_undegraded":"2023-09-13T09:38:11.170421+0000","last_fullsized":"2023-09-13T09:38:11.170421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:55.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170218+0000","last_change":"2023-09-13T09:38:08.692583+0000","last_active":"2023-09-13T09:38:11.170218+0000","last_peered":"2023-09-13T09:38:11.170218+0000","last_clean":"2023-09-13T09:38:11.170218+0000","last_became_active":"2023-09-13T09:38:08.692266+0000","last_became_peered":"2023-09-13T09:38:08.692266+0000","last_unstale":"2023-09-13T09:38:11.170218+0000","last_undegraded":"2023-09-13T09:38:11.170218+0000","last_fullsized":"2023-09-13T09:38:11.170218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:37.827191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683948+0000","last_change":"2023-09-13T09:38:09.705855+0000","last_active":"2023-09-13T09:38:10.683948+0000","last_peered":"2023-09-13T09:38:10.683948+0000","last_clean":"2023-09-13T09:38:10.683948+0000","last_became_active":"2023-09-13T09:38:09.705518+0000","last_became_peered":"2023-09-13T09:38:09.705518+0000","last_unstale":"2023-09-13T09:38:10.683948+0000","last_undegraded":"2023-09-13T09:38:10.683948+0000","last_fullsized":"2023-09-13T09:38:10.683948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:02.403984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.757996+0000","last_change":"2023-09-13T09:38:08.697396+0000","last_active":"2023-09-13T09:38:12.757996+0000","last_peered":"2023-09-13T09:38:12.757996+0000","last_clean":"2023-09-13T09:38:12.757996+0000","last_became_active":"2023-09-13T09:38:08.697067+0000","last_became_peered":"2023-09-13T09:38:08.697067+0000","last_unstale":"2023-09-13T09:38:12.757996+0000","last_undegraded":"2023-09-13T09:38:12.757996+0000","last_fullsized":"2023-09-13T09:38:12.757996+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:59.971250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170184+0000","last_change":"2023-09-13T09:38:09.701311+0000","last_active":"2023-09-13T09:38:11.170184+0000","last_peered":"2023-09-13T09:38:11.170184+0000","last_clean":"2023-09-13T09:38:11.170184+0000","last_became_active":"2023-09-13T09:38:09.700995+0000","last_became_peered":"2023-09-13T09:38:09.700995+0000","last_unstale":"2023-09-13T09:38:11.170184+0000","last_undegraded":"2023-09-13T09:38:11.170184+0000","last_fullsized":"2023-09-13T09:38:11.170184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:08.744780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.780227+0000","last_change":"2023-09-13T09:38:08.691337+0000","last_active":"2023-09-13T09:38:14.780227+0000","last_peered":"2023-09-13T09:38:14.780227+0000","last_clean":"2023-09-13T09:38:14.780227+0000","last_became_active":"2023-09-13T09:38:08.690948+0000","last_became_peered":"2023-09-13T09:38:08.690948+0000","last_unstale":"2023-09-13T09:38:14.780227+0000","last_undegraded":"2023-09-13T09:38:14.780227+0000","last_fullsized":"2023-09-13T09:38:14.780227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:33.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683697+0000","last_change":"2023-09-13T09:38:09.706627+0000","last_active":"2023-09-13T09:38:10.683697+0000","last_peered":"2023-09-13T09:38:10.683697+0000","last_clean":"2023-09-13T09:38:10.683697+0000","last_became_active":"2023-09-13T09:38:09.706328+0000","last_became_peered":"2023-09-13T09:38:09.706328+0000","last_unstale":"2023-09-13T09:38:10.683697+0000","last_undegraded":"2023-09-13T09:38:10.683697+0000","last_fullsized":"2023-09-13T09:38:10.683697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:09.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.767182+0000","last_change":"2023-09-13T09:38:08.692201+0000","last_active":"2023-09-13T09:38:13.767182+0000","last_peered":"2023-09-13T09:38:13.767182+0000","last_clean":"2023-09-13T09:38:13.767182+0000","last_became_active":"2023-09-13T09:38:08.691334+0000","last_became_peered":"2023-09-13T09:38:08.691334+0000","last_unstale":"2023-09-13T09:38:13.767182+0000","last_undegraded":"2023-09-13T09:38:13.767182+0000","last_fullsized":"2023-09-13T09:38:13.767182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:13.098275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170633+0000","last_change":"2023-09-13T09:38:09.701125+0000","last_active":"2023-09-13T09:38:11.170633+0000","last_peered":"2023-09-13T09:38:11.170633+0000","last_clean":"2023-09-13T09:38:11.170633+0000","last_became_active":"2023-09-13T09:38:09.700055+0000","last_became_peered":"2023-09-13T09:38:09.700055+0000","last_unstale":"2023-09-13T09:38:11.170633+0000","last_undegraded":"2023-09-13T09:38:11.170633+0000","last_fullsized":"2023-09-13T09:38:11.170633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:17.787363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683395+0000","last_change":"2023-09-13T09:38:08.696797+0000","last_active":"2023-09-13T09:38:10.683395+0000","last_peered":"2023-09-13T09:38:10.683395+0000","last_clean":"2023-09-13T09:38:10.683395+0000","last_became_active":"2023-09-13T09:38:08.696494+0000","last_became_peered":"2023-09-13T09:38:08.696494+0000","last_unstale":"2023-09-13T09:38:10.683395+0000","last_undegraded":"2023-09-13T09:38:10.683395+0000","last_fullsized":"2023-09-13T09:38:10.683395+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:29.454184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170422+0000","last_change":"2023-09-13T09:38:09.694166+0000","last_active":"2023-09-13T09:38:11.170422+0000","last_peered":"2023-09-13T09:38:11.170422+0000","last_clean":"2023-09-13T09:38:11.170422+0000","last_became_active":"2023-09-13T09:38:09.693894+0000","last_became_peered":"2023-09-13T09:38:09.693894+0000","last_unstale":"2023-09-13T09:38:11.170422+0000","last_undegraded":"2023-09-13T09:38:11.170422+0000","last_fullsized":"2023-09-13T09:38:11.170422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:27:35.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.757883+0000","last_change":"2023-09-13T09:38:08.693649+0000","last_active":"2023-09-13T09:38:12.757883+0000","last_peered":"2023-09-13T09:38:12.757883+0000","last_clean":"2023-09-13T09:38:12.757883+0000","last_became_active":"2023-09-13T09:38:08.693289+0000","last_became_peered":"2023-09-13T09:38:08.693289+0000","last_unstale":"2023-09-13T09:38:12.757883+0000","last_undegraded":"2023-09-13T09:38:12.757883+0000","last_fullsized":"2023-09-13T09:38:12.757883+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:39:27.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170787+0000","last_change":"2023-09-13T09:38:09.693872+0000","last_active":"2023-09-13T09:38:11.170787+0000","last_peered":"2023-09-13T09:38:11.170787+0000","last_clean":"2023-09-13T09:38:11.170787+0000","last_became_active":"2023-09-13T09:38:09.693445+0000","last_became_peered":"2023-09-13T09:38:09.693445+0000","last_unstale":"2023-09-13T09:38:11.170787+0000","last_undegraded":"2023-09-13T09:38:11.170787+0000","last_fullsized":"2023-09-13T09:38:11.170787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:29:35.717276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.757941+0000","last_change":"2023-09-13T09:38:08.696375+0000","last_active":"2023-09-13T09:38:12.757941+0000","last_peered":"2023-09-13T09:38:12.757941+0000","last_clean":"2023-09-13T09:38:12.757941+0000","last_became_active":"2023-09-13T09:38:08.695799+0000","last_became_peered":"2023-09-13T09:38:08.695799+0000","last_unstale":"2023-09-13T09:38:12.757941+0000","last_undegraded":"2023-09-13T09:38:12.757941+0000","last_fullsized":"2023-09-13T09:38:12.757941+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:09.255704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171326+0000","last_change":"2023-09-13T09:38:09.706518+0000","last_active":"2023-09-13T09:38:11.171326+0000","last_peered":"2023-09-13T09:38:11.171326+0000","last_clean":"2023-09-13T09:38:11.171326+0000","last_became_active":"2023-09-13T09:38:09.706083+0000","last_became_peered":"2023-09-13T09:38:09.706083+0000","last_unstale":"2023-09-13T09:38:11.171326+0000","last_undegraded":"2023-09-13T09:38:11.171326+0000","last_fullsized":"2023-09-13T09:38:11.171326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:21:53.831430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683917+0000","last_change":"2023-09-13T09:38:08.697878+0000","last_active":"2023-09-13T09:38:10.683917+0000","last_peered":"2023-09-13T09:38:10.683917+0000","last_clean":"2023-09-13T09:38:10.683917+0000","last_became_active":"2023-09-13T09:38:08.697476+0000","last_became_peered":"2023-09-13T09:38:08.697476+0000","last_unstale":"2023-09-13T09:38:10.683917+0000","last_undegraded":"2023-09-13T09:38:10.683917+0000","last_fullsized":"2023-09-13T09:38:10.683917+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:09.021111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170664+0000","last_change":"2023-09-13T09:38:09.697144+0000","last_active":"2023-09-13T09:38:11.170664+0000","last_peered":"2023-09-13T09:38:11.170664+0000","last_clean":"2023-09-13T09:38:11.170664+0000","last_became_active":"2023-09-13T09:38:09.696521+0000","last_became_peered":"2023-09-13T09:38:09.696521+0000","last_unstale":"2023-09-13T09:38:11.170664+0000","last_undegraded":"2023-09-13T09:38:11.170664+0000","last_fullsized":"2023-09-13T09:38:11.170664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:36:17.096644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'14","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.212064+0000","last_change":"2023-09-13T09:38:08.694981+0000","last_active":"2023-09-13T09:38:15.212064+0000","last_peered":"2023-09-13T09:38:15.212064+0000","last_clean":"2023-09-13T09:38:15.212064+0000","last_became_active":"2023-09-13T09:38:08.694630+0000","last_became_peered":"2023-09-13T09:38:08.694630+0000","last_unstale":"2023-09-13T09:38:15.212064+0000","last_undegraded":"2023-09-13T09:38:15.212064+0000","last_fullsized":"2023-09-13T09:38:15.212064+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:56:58.204622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18977,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170585+0000","last_change":"2023-09-13T09:38:09.700927+0000","last_active":"2023-09-13T09:38:11.170585+0000","last_peered":"2023-09-13T09:38:11.170585+0000","last_clean":"2023-09-13T09:38:11.170585+0000","last_became_active":"2023-09-13T09:38:09.700608+0000","last_became_peered":"2023-09-13T09:38:09.700608+0000","last_unstale":"2023-09-13T09:38:11.170585+0000","last_undegraded":"2023-09-13T09:38:11.170585+0000","last_fullsized":"2023-09-13T09:38:11.170585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:24.177293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.766066+0000","last_change":"2023-09-13T09:38:08.699130+0000","last_active":"2023-09-13T09:38:13.766066+0000","last_peered":"2023-09-13T09:38:13.766066+0000","last_clean":"2023-09-13T09:38:13.766066+0000","last_became_active":"2023-09-13T09:38:08.698802+0000","last_became_peered":"2023-09-13T09:38:08.698802+0000","last_unstale":"2023-09-13T09:38:13.766066+0000","last_undegraded":"2023-09-13T09:38:13.766066+0000","last_fullsized":"2023-09-13T09:38:13.766066+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:36.539846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682921+0000","last_change":"2023-09-13T09:38:09.697387+0000","last_active":"2023-09-13T09:38:10.682921+0000","last_peered":"2023-09-13T09:38:10.682921+0000","last_clean":"2023-09-13T09:38:10.682921+0000","last_became_active":"2023-09-13T09:38:09.697081+0000","last_became_peered":"2023-09-13T09:38:09.697081+0000","last_unstale":"2023-09-13T09:38:10.682921+0000","last_undegraded":"2023-09-13T09:38:10.682921+0000","last_fullsized":"2023-09-13T09:38:10.682921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:28:59.473258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.758222+0000","last_change":"2023-09-13T09:38:08.696609+0000","last_active":"2023-09-13T09:38:12.758222+0000","last_peered":"2023-09-13T09:38:12.758222+0000","last_clean":"2023-09-13T09:38:12.758222+0000","last_became_active":"2023-09-13T09:38:08.696286+0000","last_became_peered":"2023-09-13T09:38:08.696286+0000","last_unstale":"2023-09-13T09:38:12.758222+0000","last_undegraded":"2023-09-13T09:38:12.758222+0000","last_fullsized":"2023-09-13T09:38:12.758222+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:06:51.121661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171465+0000","last_change":"2023-09-13T09:38:09.698374+0000","last_active":"2023-09-13T09:38:11.171465+0000","last_peered":"2023-09-13T09:38:11.171465+0000","last_clean":"2023-09-13T09:38:11.171465+0000","last_became_active":"2023-09-13T09:38:09.698050+0000","last_became_peered":"2023-09-13T09:38:09.698050+0000","last_unstale":"2023-09-13T09:38:11.171465+0000","last_undegraded":"2023-09-13T09:38:11.171465+0000","last_fullsized":"2023-09-13T09:38:11.171465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:37:24.089861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170863+0000","last_change":"2023-09-13T09:38:08.692717+0000","last_active":"2023-09-13T09:38:11.170863+0000","last_peered":"2023-09-13T09:38:11.170863+0000","last_clean":"2023-09-13T09:38:11.170863+0000","last_became_active":"2023-09-13T09:38:08.692340+0000","last_became_peered":"2023-09-13T09:38:08.692340+0000","last_unstale":"2023-09-13T09:38:11.170863+0000","last_undegraded":"2023-09-13T09:38:11.170863+0000","last_fullsized":"2023-09-13T09:38:11.170863+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:22.280879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170823+0000","last_change":"2023-09-13T09:38:09.701623+0000","last_active":"2023-09-13T09:38:11.170823+0000","last_peered":"2023-09-13T09:38:11.170823+0000","last_clean":"2023-09-13T09:38:11.170823+0000","last_became_active":"2023-09-13T09:38:09.701338+0000","last_became_peered":"2023-09-13T09:38:09.701338+0000","last_unstale":"2023-09-13T09:38:11.170823+0000","last_undegraded":"2023-09-13T09:38:11.170823+0000","last_fullsized":"2023-09-13T09:38:11.170823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:49:58.937293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'8","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.169881+0000","last_change":"2023-09-13T09:38:08.691968+0000","last_active":"2023-09-13T09:38:11.169881+0000","last_peered":"2023-09-13T09:38:11.169881+0000","last_clean":"2023-09-13T09:38:11.169881+0000","last_became_active":"2023-09-13T09:38:08.691668+0000","last_became_peered":"2023-09-13T09:38:08.691668+0000","last_unstale":"2023-09-13T09:38:11.169881+0000","last_undegraded":"2023-09-13T09:38:11.169881+0000","last_fullsized":"2023-09-13T09:38:11.169881+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:43.767948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683621+0000","last_change":"2023-09-13T09:38:09.698123+0000","last_active":"2023-09-13T09:38:10.683621+0000","last_peered":"2023-09-13T09:38:10.683621+0000","last_clean":"2023-09-13T09:38:10.683621+0000","last_became_active":"2023-09-13T09:38:09.697729+0000","last_became_peered":"2023-09-13T09:38:09.697729+0000","last_unstale":"2023-09-13T09:38:10.683621+0000","last_undegraded":"2023-09-13T09:38:10.683621+0000","last_fullsized":"2023-09-13T09:38:10.683621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:25.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170380+0000","last_change":"2023-09-13T09:38:08.691091+0000","last_active":"2023-09-13T09:38:11.170380+0000","last_peered":"2023-09-13T09:38:11.170380+0000","last_clean":"2023-09-13T09:38:11.170380+0000","last_became_active":"2023-09-13T09:38:08.689128+0000","last_became_peered":"2023-09-13T09:38:08.689128+0000","last_unstale":"2023-09-13T09:38:11.170380+0000","last_undegraded":"2023-09-13T09:38:11.170380+0000","last_fullsized":"2023-09-13T09:38:11.170380+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:32.133388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233326+0000","last_change":"2023-09-13T09:38:09.706041+0000","last_active":"2023-09-13T09:38:12.233326+0000","last_peered":"2023-09-13T09:38:12.233326+0000","last_clean":"2023-09-13T09:38:12.233326+0000","last_became_active":"2023-09-13T09:38:09.705707+0000","last_became_peered":"2023-09-13T09:38:09.705707+0000","last_unstale":"2023-09-13T09:38:12.233326+0000","last_undegraded":"2023-09-13T09:38:12.233326+0000","last_fullsized":"2023-09-13T09:38:12.233326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:57.018000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170284+0000","last_change":"2023-09-13T09:38:08.695552+0000","last_active":"2023-09-13T09:38:11.170284+0000","last_peered":"2023-09-13T09:38:11.170284+0000","last_clean":"2023-09-13T09:38:11.170284+0000","last_became_active":"2023-09-13T09:38:08.695236+0000","last_became_peered":"2023-09-13T09:38:08.695236+0000","last_unstale":"2023-09-13T09:38:11.170284+0000","last_undegraded":"2023-09-13T09:38:11.170284+0000","last_fullsized":"2023-09-13T09:38:11.170284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:41.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.687208+0000","last_change":"2023-09-13T09:38:09.699864+0000","last_active":"2023-09-13T09:38:10.687208+0000","last_peered":"2023-09-13T09:38:10.687208+0000","last_clean":"2023-09-13T09:38:10.687208+0000","last_became_active":"2023-09-13T09:38:09.699522+0000","last_became_peered":"2023-09-13T09:38:09.699522+0000","last_unstale":"2023-09-13T09:38:10.687208+0000","last_undegraded":"2023-09-13T09:38:10.687208+0000","last_fullsized":"2023-09-13T09:38:10.687208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:51.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171282+0000","last_change":"2023-09-13T09:38:08.695651+0000","last_active":"2023-09-13T09:38:11.171282+0000","last_peered":"2023-09-13T09:38:11.171282+0000","last_clean":"2023-09-13T09:38:11.171282+0000","last_became_active":"2023-09-13T09:38:08.695074+0000","last_became_peered":"2023-09-13T09:38:08.695074+0000","last_unstale":"2023-09-13T09:38:11.171282+0000","last_undegraded":"2023-09-13T09:38:11.171282+0000","last_fullsized":"2023-09-13T09:38:11.171282+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:40.974436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683373+0000","last_change":"2023-09-13T09:38:09.698193+0000","last_active":"2023-09-13T09:38:10.683373+0000","last_peered":"2023-09-13T09:38:10.683373+0000","last_clean":"2023-09-13T09:38:10.683373+0000","last_became_active":"2023-09-13T09:38:09.697874+0000","last_became_peered":"2023-09-13T09:38:09.697874+0000","last_unstale":"2023-09-13T09:38:10.683373+0000","last_undegraded":"2023-09-13T09:38:10.683373+0000","last_fullsized":"2023-09-13T09:38:10.683373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:48.908322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683532+0000","last_change":"2023-09-13T09:38:09.705768+0000","last_active":"2023-09-13T09:38:10.683532+0000","last_peered":"2023-09-13T09:38:10.683532+0000","last_clean":"2023-09-13T09:38:10.683532+0000","last_became_active":"2023-09-13T09:38:09.705403+0000","last_became_peered":"2023-09-13T09:38:09.705403+0000","last_unstale":"2023-09-13T09:38:10.683532+0000","last_undegraded":"2023-09-13T09:38:10.683532+0000","last_fullsized":"2023-09-13T09:38:10.683532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:14:07.171229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.767633+0000","last_change":"2023-09-13T09:38:08.695499+0000","last_active":"2023-09-13T09:38:13.767633+0000","last_peered":"2023-09-13T09:38:13.767633+0000","last_clean":"2023-09-13T09:38:13.767633+0000","last_became_active":"2023-09-13T09:38:08.695167+0000","last_became_peered":"2023-09-13T09:38:08.695167+0000","last_unstale":"2023-09-13T09:38:13.767633+0000","last_undegraded":"2023-09-13T09:38:13.767633+0000","last_fullsized":"2023-09-13T09:38:13.767633+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.561408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170842+0000","last_change":"2023-09-13T09:38:09.702273+0000","last_active":"2023-09-13T09:38:11.170842+0000","last_peered":"2023-09-13T09:38:11.170842+0000","last_clean":"2023-09-13T09:38:11.170842+0000","last_became_active":"2023-09-13T09:38:09.701944+0000","last_became_peered":"2023-09-13T09:38:09.701944+0000","last_unstale":"2023-09-13T09:38:11.170842+0000","last_undegraded":"2023-09-13T09:38:11.170842+0000","last_fullsized":"2023-09-13T09:38:11.170842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:56.548720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171070+0000","last_change":"2023-09-13T09:38:08.692966+0000","last_active":"2023-09-13T09:38:11.171070+0000","last_peered":"2023-09-13T09:38:11.171070+0000","last_clean":"2023-09-13T09:38:11.171070+0000","last_became_active":"2023-09-13T09:38:08.692613+0000","last_became_peered":"2023-09-13T09:38:08.692613+0000","last_unstale":"2023-09-13T09:38:11.171070+0000","last_undegraded":"2023-09-13T09:38:11.171070+0000","last_fullsized":"2023-09-13T09:38:11.171070+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:37.327846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":307,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T09:38:09.688801+0000","last_change":"2023-09-13T09:37:08.710441+0000","last_active":"2023-09-13T09:38:09.688801+0000","last_peered":"2023-09-13T09:38:09.688801+0000","last_clean":"2023-09-13T09:38:09.688801+0000","last_became_active":"2023-09-13T09:37:08.709939+0000","last_became_peered":"2023-09-13T09:37:08.709939+0000","last_unstale":"2023-09-13T09:38:09.688801+0000","last_undegraded":"2023-09-13T09:38:09.688801+0000","last_fullsized":"2023-09-13T09:38:09.688801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_clean_scrub_stamp":"2023-09-13T09:34:16.664369+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:00.964039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682890+0000","last_change":"2023-09-13T09:38:09.697244+0000","last_active":"2023-09-13T09:38:10.682890+0000","last_peered":"2023-09-13T09:38:10.682890+0000","last_clean":"2023-09-13T09:38:10.682890+0000","last_became_active":"2023-09-13T09:38:09.696925+0000","last_became_peered":"2023-09-13T09:38:09.696925+0000","last_unstale":"2023-09-13T09:38:10.682890+0000","last_undegraded":"2023-09-13T09:38:10.682890+0000","last_fullsized":"2023-09-13T09:38:10.682890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:39.566528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.765958+0000","last_change":"2023-09-13T09:38:08.702070+0000","last_active":"2023-09-13T09:38:13.765958+0000","last_peered":"2023-09-13T09:38:13.765958+0000","last_clean":"2023-09-13T09:38:13.765958+0000","last_became_active":"2023-09-13T09:38:08.701647+0000","last_became_peered":"2023-09-13T09:38:08.701647+0000","last_unstale":"2023-09-13T09:38:13.765958+0000","last_undegraded":"2023-09-13T09:38:13.765958+0000","last_fullsized":"2023-09-13T09:38:13.765958+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:30:22.405675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170664+0000","last_change":"2023-09-13T09:38:08.696935+0000","last_active":"2023-09-13T09:38:11.170664+0000","last_peered":"2023-09-13T09:38:11.170664+0000","last_clean":"2023-09-13T09:38:11.170664+0000","last_became_active":"2023-09-13T09:38:08.696534+0000","last_became_peered":"2023-09-13T09:38:08.696534+0000","last_unstale":"2023-09-13T09:38:11.170664+0000","last_undegraded":"2023-09-13T09:38:11.170664+0000","last_fullsized":"2023-09-13T09:38:11.170664+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:49:13.883043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683062+0000","last_change":"2023-09-13T09:38:09.695829+0000","last_active":"2023-09-13T09:38:10.683062+0000","last_peered":"2023-09-13T09:38:10.683062+0000","last_clean":"2023-09-13T09:38:10.683062+0000","last_became_active":"2023-09-13T09:38:09.695479+0000","last_became_peered":"2023-09-13T09:38:09.695479+0000","last_unstale":"2023-09-13T09:38:10.683062+0000","last_undegraded":"2023-09-13T09:38:10.683062+0000","last_fullsized":"2023-09-13T09:38:10.683062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:24:00.042236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.781302+0000","last_change":"2023-09-13T09:38:08.698530+0000","last_active":"2023-09-13T09:38:14.781302+0000","last_peered":"2023-09-13T09:38:14.781302+0000","last_clean":"2023-09-13T09:38:14.781302+0000","last_became_active":"2023-09-13T09:38:08.698206+0000","last_became_peered":"2023-09-13T09:38:08.698206+0000","last_unstale":"2023-09-13T09:38:14.781302+0000","last_undegraded":"2023-09-13T09:38:14.781302+0000","last_fullsized":"2023-09-13T09:38:14.781302+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:09.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171580+0000","last_change":"2023-09-13T09:38:09.700993+0000","last_active":"2023-09-13T09:38:11.171580+0000","last_peered":"2023-09-13T09:38:11.171580+0000","last_clean":"2023-09-13T09:38:11.171580+0000","last_became_active":"2023-09-13T09:38:09.700677+0000","last_became_peered":"2023-09-13T09:38:09.700677+0000","last_unstale":"2023-09-13T09:38:11.171580+0000","last_undegraded":"2023-09-13T09:38:11.171580+0000","last_fullsized":"2023-09-13T09:38:11.171580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:32.209248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170980+0000","last_change":"2023-09-13T09:38:08.684326+0000","last_active":"2023-09-13T09:38:11.170980+0000","last_peered":"2023-09-13T09:38:11.170980+0000","last_clean":"2023-09-13T09:38:11.170980+0000","last_became_active":"2023-09-13T09:38:08.683972+0000","last_became_peered":"2023-09-13T09:38:08.683972+0000","last_unstale":"2023-09-13T09:38:11.170980+0000","last_undegraded":"2023-09-13T09:38:11.170980+0000","last_fullsized":"2023-09-13T09:38:11.170980+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:22.702277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170943+0000","last_change":"2023-09-13T09:38:09.706237+0000","last_active":"2023-09-13T09:38:11.170943+0000","last_peered":"2023-09-13T09:38:11.170943+0000","last_clean":"2023-09-13T09:38:11.170943+0000","last_became_active":"2023-09-13T09:38:09.705706+0000","last_became_peered":"2023-09-13T09:38:09.705706+0000","last_unstale":"2023-09-13T09:38:11.170943+0000","last_undegraded":"2023-09-13T09:38:11.170943+0000","last_fullsized":"2023-09-13T09:38:11.170943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:18.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.756655+0000","last_change":"2023-09-13T09:38:08.695641+0000","last_active":"2023-09-13T09:38:12.756655+0000","last_peered":"2023-09-13T09:38:12.756655+0000","last_clean":"2023-09-13T09:38:12.756655+0000","last_became_active":"2023-09-13T09:38:08.695090+0000","last_became_peered":"2023-09-13T09:38:08.695090+0000","last_unstale":"2023-09-13T09:38:12.756655+0000","last_undegraded":"2023-09-13T09:38:12.756655+0000","last_fullsized":"2023-09-13T09:38:12.756655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:16:13.987022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.169943+0000","last_change":"2023-09-13T09:38:09.702254+0000","last_active":"2023-09-13T09:38:11.169943+0000","last_peered":"2023-09-13T09:38:11.169943+0000","last_clean":"2023-09-13T09:38:11.169943+0000","last_became_active":"2023-09-13T09:38:09.701946+0000","last_became_peered":"2023-09-13T09:38:09.701946+0000","last_unstale":"2023-09-13T09:38:11.169943+0000","last_undegraded":"2023-09-13T09:38:11.169943+0000","last_fullsized":"2023-09-13T09:38:11.169943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:41.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.790992+0000","last_change":"2023-09-13T09:38:08.694692+0000","last_active":"2023-09-13T09:38:15.790992+0000","last_peered":"2023-09-13T09:38:15.790992+0000","last_clean":"2023-09-13T09:38:15.790992+0000","last_became_active":"2023-09-13T09:38:08.693799+0000","last_became_peered":"2023-09-13T09:38:08.693799+0000","last_unstale":"2023-09-13T09:38:15.790992+0000","last_undegraded":"2023-09-13T09:38:15.790992+0000","last_fullsized":"2023-09-13T09:38:15.790992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:53:57.188153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233050+0000","last_change":"2023-09-13T09:38:09.707954+0000","last_active":"2023-09-13T09:38:12.233050+0000","last_peered":"2023-09-13T09:38:12.233050+0000","last_clean":"2023-09-13T09:38:12.233050+0000","last_became_active":"2023-09-13T09:38:09.707659+0000","last_became_peered":"2023-09-13T09:38:09.707659+0000","last_unstale":"2023-09-13T09:38:12.233050+0000","last_undegraded":"2023-09-13T09:38:12.233050+0000","last_fullsized":"2023-09-13T09:38:12.233050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:34.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170497+0000","last_change":"2023-09-13T09:38:08.696505+0000","last_active":"2023-09-13T09:38:11.170497+0000","last_peered":"2023-09-13T09:38:11.170497+0000","last_clean":"2023-09-13T09:38:11.170497+0000","last_became_active":"2023-09-13T09:38:08.696106+0000","last_became_peered":"2023-09-13T09:38:08.696106+0000","last_unstale":"2023-09-13T09:38:11.170497+0000","last_undegraded":"2023-09-13T09:38:11.170497+0000","last_fullsized":"2023-09-13T09:38:11.170497+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:52:57.306234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171023+0000","last_change":"2023-09-13T09:38:09.700593+0000","last_active":"2023-09-13T09:38:11.171023+0000","last_peered":"2023-09-13T09:38:11.171023+0000","last_clean":"2023-09-13T09:38:11.171023+0000","last_became_active":"2023-09-13T09:38:09.700263+0000","last_became_peered":"2023-09-13T09:38:09.700263+0000","last_unstale":"2023-09-13T09:38:11.171023+0000","last_undegraded":"2023-09-13T09:38:11.171023+0000","last_fullsized":"2023-09-13T09:38:11.171023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:17:38.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170246+0000","last_change":"2023-09-13T09:38:08.692455+0000","last_active":"2023-09-13T09:38:11.170246+0000","last_peered":"2023-09-13T09:38:11.170246+0000","last_clean":"2023-09-13T09:38:11.170246+0000","last_became_active":"2023-09-13T09:38:08.692118+0000","last_became_peered":"2023-09-13T09:38:08.692118+0000","last_unstale":"2023-09-13T09:38:11.170246+0000","last_undegraded":"2023-09-13T09:38:11.170246+0000","last_fullsized":"2023-09-13T09:38:11.170246+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:33.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.695783+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.695473+0000","last_became_peered":"2023-09-13T09:38:09.695473+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:59.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.780464+0000","last_change":"2023-09-13T09:38:08.697468+0000","last_active":"2023-09-13T09:38:14.780464+0000","last_peered":"2023-09-13T09:38:14.780464+0000","last_clean":"2023-09-13T09:38:14.780464+0000","last_became_active":"2023-09-13T09:38:08.697141+0000","last_became_peered":"2023-09-13T09:38:08.697141+0000","last_unstale":"2023-09-13T09:38:14.780464+0000","last_undegraded":"2023-09-13T09:38:14.780464+0000","last_fullsized":"2023-09-13T09:38:14.780464+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:33:26.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171808+0000","last_change":"2023-09-13T09:38:09.703754+0000","last_active":"2023-09-13T09:38:11.171808+0000","last_peered":"2023-09-13T09:38:11.171808+0000","last_clean":"2023-09-13T09:38:11.171808+0000","last_became_active":"2023-09-13T09:38:09.703438+0000","last_became_peered":"2023-09-13T09:38:09.703438+0000","last_unstale":"2023-09-13T09:38:11.171808+0000","last_undegraded":"2023-09-13T09:38:11.171808+0000","last_fullsized":"2023-09-13T09:38:11.171808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:19.298385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T09:38:09.746765+0000","last_change":"2023-09-13T09:38:08.698973+0000","last_active":"2023-09-13T09:38:09.746765+0000","last_peered":"2023-09-13T09:38:09.746765+0000","last_clean":"2023-09-13T09:38:09.746765+0000","last_became_active":"2023-09-13T09:38:08.698329+0000","last_became_peered":"2023-09-13T09:38:08.698329+0000","last_unstale":"2023-09-13T09:38:09.746765+0000","last_undegraded":"2023-09-13T09:38:09.746765+0000","last_fullsized":"2023-09-13T09:38:09.746765+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:10.684590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171494+0000","last_change":"2023-09-13T09:38:09.700216+0000","last_active":"2023-09-13T09:38:11.171494+0000","last_peered":"2023-09-13T09:38:11.171494+0000","last_clean":"2023-09-13T09:38:11.171494+0000","last_became_active":"2023-09-13T09:38:09.699876+0000","last_became_peered":"2023-09-13T09:38:09.699876+0000","last_unstale":"2023-09-13T09:38:11.171494+0000","last_undegraded":"2023-09-13T09:38:11.171494+0000","last_fullsized":"2023-09-13T09:38:11.171494+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:33.347155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.788169+0000","last_change":"2023-09-13T09:38:08.696200+0000","last_active":"2023-09-13T09:38:15.788169+0000","last_peered":"2023-09-13T09:38:15.788169+0000","last_clean":"2023-09-13T09:38:15.788169+0000","last_became_active":"2023-09-13T09:38:08.695880+0000","last_became_peered":"2023-09-13T09:38:08.695880+0000","last_unstale":"2023-09-13T09:38:15.788169+0000","last_undegraded":"2023-09-13T09:38:15.788169+0000","last_fullsized":"2023-09-13T09:38:15.788169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:38.222209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171897+0000","last_change":"2023-09-13T09:38:09.703022+0000","last_active":"2023-09-13T09:38:11.171897+0000","last_peered":"2023-09-13T09:38:11.171897+0000","last_clean":"2023-09-13T09:38:11.171897+0000","last_became_active":"2023-09-13T09:38:09.702665+0000","last_became_peered":"2023-09-13T09:38:09.702665+0000","last_unstale":"2023-09-13T09:38:11.171897+0000","last_undegraded":"2023-09-13T09:38:11.171897+0000","last_fullsized":"2023-09-13T09:38:11.171897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:59.284385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233158+0000","last_change":"2023-09-13T09:38:09.708137+0000","last_active":"2023-09-13T09:38:12.233158+0000","last_peered":"2023-09-13T09:38:12.233158+0000","last_clean":"2023-09-13T09:38:12.233158+0000","last_became_active":"2023-09-13T09:38:09.707829+0000","last_became_peered":"2023-09-13T09:38:09.707829+0000","last_unstale":"2023-09-13T09:38:12.233158+0000","last_undegraded":"2023-09-13T09:38:12.233158+0000","last_fullsized":"2023-09-13T09:38:12.233158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:15.976098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170521+0000","last_change":"2023-09-13T09:38:09.703131+0000","last_active":"2023-09-13T09:38:11.170521+0000","last_peered":"2023-09-13T09:38:11.170521+0000","last_clean":"2023-09-13T09:38:11.170521+0000","last_became_active":"2023-09-13T09:38:09.702850+0000","last_became_peered":"2023-09-13T09:38:09.702850+0000","last_unstale":"2023-09-13T09:38:11.170521+0000","last_undegraded":"2023-09-13T09:38:11.170521+0000","last_fullsized":"2023-09-13T09:38:11.170521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:08.422038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170418+0000","last_change":"2023-09-13T09:38:09.701691+0000","last_active":"2023-09-13T09:38:11.170418+0000","last_peered":"2023-09-13T09:38:11.170418+0000","last_clean":"2023-09-13T09:38:11.170418+0000","last_became_active":"2023-09-13T09:38:09.701395+0000","last_became_peered":"2023-09-13T09:38:09.701395+0000","last_unstale":"2023-09-13T09:38:11.170418+0000","last_undegraded":"2023-09-13T09:38:11.170418+0000","last_fullsized":"2023-09-13T09:38:11.170418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:02.916712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170550+0000","last_change":"2023-09-13T09:38:09.706885+0000","last_active":"2023-09-13T09:38:11.170550+0000","last_peered":"2023-09-13T09:38:11.170550+0000","last_clean":"2023-09-13T09:38:11.170550+0000","last_became_active":"2023-09-13T09:38:09.706569+0000","last_became_peered":"2023-09-13T09:38:09.706569+0000","last_unstale":"2023-09-13T09:38:11.170550+0000","last_undegraded":"2023-09-13T09:38:11.170550+0000","last_fullsized":"2023-09-13T09:38:11.170550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:02.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683123+0000","last_change":"2023-09-13T09:38:09.698547+0000","last_active":"2023-09-13T09:38:10.683123+0000","last_peered":"2023-09-13T09:38:10.683123+0000","last_clean":"2023-09-13T09:38:10.683123+0000","last_became_active":"2023-09-13T09:38:09.698180+0000","last_became_peered":"2023-09-13T09:38:09.698180+0000","last_unstale":"2023-09-13T09:38:10.683123+0000","last_undegraded":"2023-09-13T09:38:10.683123+0000","last_fullsized":"2023-09-13T09:38:10.683123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:12.988597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233293+0000","last_change":"2023-09-13T09:38:09.706780+0000","last_active":"2023-09-13T09:38:12.233293+0000","last_peered":"2023-09-13T09:38:12.233293+0000","last_clean":"2023-09-13T09:38:12.233293+0000","last_became_active":"2023-09-13T09:38:09.706487+0000","last_became_peered":"2023-09-13T09:38:09.706487+0000","last_unstale":"2023-09-13T09:38:12.233293+0000","last_undegraded":"2023-09-13T09:38:12.233293+0000","last_fullsized":"2023-09-13T09:38:12.233293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:18:29.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170952+0000","last_change":"2023-09-13T09:38:09.695277+0000","last_active":"2023-09-13T09:38:11.170952+0000","last_peered":"2023-09-13T09:38:11.170952+0000","last_clean":"2023-09-13T09:38:11.170952+0000","last_became_active":"2023-09-13T09:38:09.694959+0000","last_became_peered":"2023-09-13T09:38:09.694959+0000","last_unstale":"2023-09-13T09:38:11.170952+0000","last_undegraded":"2023-09-13T09:38:11.170952+0000","last_fullsized":"2023-09-13T09:38:11.170952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:35:17.321069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171496+0000","last_change":"2023-09-13T09:38:09.702030+0000","last_active":"2023-09-13T09:38:11.171496+0000","last_peered":"2023-09-13T09:38:11.171496+0000","last_clean":"2023-09-13T09:38:11.171496+0000","last_became_active":"2023-09-13T09:38:09.701712+0000","last_became_peered":"2023-09-13T09:38:09.701712+0000","last_unstale":"2023-09-13T09:38:11.171496+0000","last_undegraded":"2023-09-13T09:38:11.171496+0000","last_fullsized":"2023-09-13T09:38:11.171496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:38.909533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683499+0000","last_change":"2023-09-13T09:38:09.706625+0000","last_active":"2023-09-13T09:38:10.683499+0000","last_peered":"2023-09-13T09:38:10.683499+0000","last_clean":"2023-09-13T09:38:10.683499+0000","last_became_active":"2023-09-13T09:38:09.706315+0000","last_became_peered":"2023-09-13T09:38:09.706315+0000","last_unstale":"2023-09-13T09:38:10.683499+0000","last_undegraded":"2023-09-13T09:38:10.683499+0000","last_fullsized":"2023-09-13T09:38:10.683499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:21.653592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171694+0000","last_change":"2023-09-13T09:38:09.703544+0000","last_active":"2023-09-13T09:38:11.171694+0000","last_peered":"2023-09-13T09:38:11.171694+0000","last_clean":"2023-09-13T09:38:11.171694+0000","last_became_active":"2023-09-13T09:38:09.702015+0000","last_became_peered":"2023-09-13T09:38:09.702015+0000","last_unstale":"2023-09-13T09:38:11.171694+0000","last_undegraded":"2023-09-13T09:38:11.171694+0000","last_fullsized":"2023-09-13T09:38:11.171694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:46:49.166965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170600+0000","last_change":"2023-09-13T09:38:09.694224+0000","last_active":"2023-09-13T09:38:11.170600+0000","last_peered":"2023-09-13T09:38:11.170600+0000","last_clean":"2023-09-13T09:38:11.170600+0000","last_became_active":"2023-09-13T09:38:09.693562+0000","last_became_peered":"2023-09-13T09:38:09.693562+0000","last_unstale":"2023-09-13T09:38:11.170600+0000","last_undegraded":"2023-09-13T09:38:11.170600+0000","last_fullsized":"2023-09-13T09:38:11.170600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:41:07.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683159+0000","last_change":"2023-09-13T09:38:09.698919+0000","last_active":"2023-09-13T09:38:10.683159+0000","last_peered":"2023-09-13T09:38:10.683159+0000","last_clean":"2023-09-13T09:38:10.683159+0000","last_became_active":"2023-09-13T09:38:09.698637+0000","last_became_peered":"2023-09-13T09:38:09.698637+0000","last_unstale":"2023-09-13T09:38:10.683159+0000","last_undegraded":"2023-09-13T09:38:10.683159+0000","last_fullsized":"2023-09-13T09:38:10.683159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:50.277687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233181+0000","last_change":"2023-09-13T09:38:09.705194+0000","last_active":"2023-09-13T09:38:12.233181+0000","last_peered":"2023-09-13T09:38:12.233181+0000","last_clean":"2023-09-13T09:38:12.233181+0000","last_became_active":"2023-09-13T09:38:09.704888+0000","last_became_peered":"2023-09-13T09:38:09.704888+0000","last_unstale":"2023-09-13T09:38:12.233181+0000","last_undegraded":"2023-09-13T09:38:12.233181+0000","last_fullsized":"2023-09-13T09:38:12.233181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:07.995177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":22565,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":136,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":290816,"data_stored":52120,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416395,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":905216,"data_stored":434054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]}]},{"osd":10,"up_from":71,"seq":304942678033,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1045283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.65700000000000003}]},{"osd":3,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.46600000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.73599999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.79900000000000004}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.627},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58699999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.59799999999999998}]},{"osd":9,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.63900000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841556,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":929792,"data_stored":434962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.373}]},{"osd":1,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.69699999999999995}]},{"osd":2,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.0740000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.74199999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.438}]},{"osd":4,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.62,"5min":0.62,"15min":0.62},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.256,"5min":1.256,"15min":1.256},"last":0.50800000000000001}]},{"osd":5,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79600000000000004}]},{"osd":7,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.60899999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.71899999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.86699999999999999}]}]},{"osd":8,"up_from":58,"seq":249108103192,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":434327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.66400000000000003}]},{"osd":2,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.77600000000000002}]},{"osd":5,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.48499999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.79100000000000004}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.86799999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]}]},{"osd":7,"up_from":50,"seq":214748364829,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1488,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1523712,"data_stored":1026886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69699999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83999999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84399999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.67900000000000005}]},{"osd":3,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.755}]},{"osd":4,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.55000000000000004}]},{"osd":5,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.79900000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.095,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.77300000000000002}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.82199999999999995}]},{"osd":9,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.91800000000000004}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.90000000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]}]},{"osd":6,"up_from":45,"seq":193273528354,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":434289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39400000000000002,"15min":0.38600000000000001},"min":{"1min":0.252,"5min":0.249,"15min":0.249},"max":{"1min":0.59799999999999998,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.40999999999999998,"15min":0.39800000000000002},"min":{"1min":0.29699999999999999,"5min":0.255,"15min":0.255},"max":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"last":0.34599999999999997}]},{"osd":1,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.59399999999999997,"15min":0.58099999999999996},"min":{"1min":0.47499999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.622,"15min":0.60799999999999998},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.91200000000000003,"5min":1.3919999999999999,"15min":1.3919999999999999},"last":0.48299999999999998}]},{"osd":2,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58799999999999997,"15min":0.57799999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.58999999999999997,"15min":0.57999999999999996},"min":{"1min":0.47299999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.504}]},{"osd":3,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.47499999999999998,"15min":0.45800000000000002},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.51400000000000001,"15min":0.501},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.36599999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.88800000000000001,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.65100000000000002,"15min":0.63400000000000001},"min":{"1min":0.54000000000000004,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Sep 13 09:37:40 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.66300000000000003,"15min":0.65400000000000003},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.94599999999999995,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.628},{"interface":"front","average":{"1min":0.753,"5min":0.66600000000000004,"15min":0.65200000000000002},"min":{"1min":0.433,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.55700000000000005}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.55700000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.60999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.113,"5min":1.143,"15min":1.143},"last":0.65900000000000003}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.56799999999999995}]},{"osd":9,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.435},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.51600000000000001}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.73399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.52100000000000002},"min":{"1min":0.44700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.495}]},{"osd":2,"last update":"Wed Sep 13 09:37:16 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.53600000000000003,"15min":0.52300000000000002},"min":{"1min":0.377,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.54300000000000004,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.69199999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:37:39 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.61699999999999999,"15min":0.58599999999999997},"min":{"1min":0.42499999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.76500000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.51900000000000002,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.628}]},{"osd":5,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.56299999999999994,"15min":0.55300000000000005},"min":{"1min":0.40000000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.59999999999999998},"min":{"1min":0.495,"5min":0.38,"15min":0.38},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78800000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.65400000000000003,"15min":0.64100000000000001},"min":{"1min":0.40200000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.65000000000000002,"15min":0.64000000000000001},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.60299999999999998}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":0.81899999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.75600000000000001,"15min":0.75600000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.91800000000000004}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.747},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.95099999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.89700000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":909312,"data_stored":434144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36299999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91100000000000003,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"min":{"1min":0.38700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.86199999999999999,"5min":1.47,"15min":1.47},"last":0.48499999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.54000000000000004,"15min":0.51300000000000001},"min":{"1min":0.39600000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.56499999999999995,"15min":0.53700000000000003},"min":{"1min":0.47199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.878,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed Sep 13 09:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.53400000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58799999999999997,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.97599999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.751,"5min":1.288,"15min":1.288},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.627,"15min":0.61399999999999999},"min":{"1min":0.45000000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.502},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.63,"15min":0.61699999999999999},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.58299999999999996,"15min":0.56999999999999995},"min":{"1min":0.36399999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.375},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.64900000000000002,"15min":0.63500000000000001},"min":{"1min":0.46600000000000003,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.39700000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69299999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:37:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.79900000000000004}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.58499999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.74299999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72999999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411379,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":437638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.498,"15min":0.47299999999999998},"min":{"1min":0.35499999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.51300000000000001,"15min":0.48699999999999999},"min":{"1min":0.45100000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53900000000000003}]},{"osd":1,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.496},{"interface":"front","average":{"1min":0.625,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.374,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:37:38 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.60599999999999998,"15min":0.59199999999999997},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.57499999999999996,"15min":0.56599999999999995},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.42999999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.627,"15min":0.60099999999999998},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.51400000000000001}]},{"osd":5,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.45200000000000001,"15min":0.44400000000000001},"min":{"1min":0.29699999999999999,"5min":0.252,"15min":0.252},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.497,"5min":0.442,"15min":0.433},"min":{"1min":0.29199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.80500000000000005}]},{"osd":6,"last update":"Wed Sep 13 09:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.44600000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.65500000000000003,"15min":0.64600000000000002},"min":{"1min":0.44400000000000001,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1,"5min":1,"15min":1},"last":0.71799999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65600000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.753},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76300000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:37:45 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.58799999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":434131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.371,"15min":0.34399999999999997},"min":{"1min":0.315,"5min":0.219,"15min":0.219},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.39600000000000002,"15min":0.379},"min":{"1min":0.34699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.65100000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.52100000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.36199999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.54200000000000004,"15min":0.51500000000000001},"min":{"1min":0.45200000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.649,"5min":1.649,"15min":1.649},"last":0.60999999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.61099999999999999,"15min":0.58899999999999997},"min":{"1min":0.49099999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.67100000000000004,"15min":0.66500000000000004},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.1220000000000001,"5min":2.238,"15min":2.238},"last":0.82099999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.56100000000000005},"min":{"1min":0.47099999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.746}]},{"osd":5,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.60699999999999998,"15min":0.60099999999999998},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.65300000000000002,"15min":0.64500000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.77300000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.41199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.60399999999999998,"15min":0.60199999999999998},"min":{"1min":0.377,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.97999999999999998,"5min":1.071,"15min":1.071},"last":0.89500000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.60899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.175,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.84199999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.875}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.92000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]}]},{"osd":4,"up_from":32,"seq":137438953513,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":425506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.53100000000000003},"min":{"1min":0.44700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.335,"5min":3.335,"15min":3.335},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.41399999999999998,"15min":0.38900000000000001},"min":{"1min":0.34000000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.372},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.34499999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.622},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59999999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60499999999999998,"15min":0.57099999999999995},"min":{"1min":0.51100000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5230000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Sep 13 09:37:19 2023","interfaces":[{"interface":"back","average":{"1min":0.65900000000000003,"5min":0.64300000000000002,"15min":0.64000000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.63700000000000001,"15min":0.629},"min":{"1min":0.42999999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.85999999999999999,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.53400000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:37:42 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.67800000000000005,"15min":0.67600000000000005},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71499999999999997,"15min":0.71099999999999997},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.46500000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.502},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.48199999999999998}]},{"osd":8,"last update":"Wed Sep 13 09:37:25 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.61199999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:37:48 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64400000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.57299999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]}]},{"osd":5,"up_from":37,"seq":158913789990,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28508,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716644,"statfs":{"total":95995035648,"available":95965843456,"internally_reserved":0,"allocated":1527808,"data_stored":1025898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.503,"15min":0.495},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.49199999999999999,"15min":0.48399999999999999},"min":{"1min":0.35799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.623}]},{"osd":1,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.53000000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.40000000000000002,"15min":0.39000000000000001},"min":{"1min":0.26800000000000002,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.42299999999999999,"15min":0.40899999999999997},"min":{"1min":0.27700000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.495},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:37:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.57899999999999996,"15min":0.56299999999999994},"min":{"1min":0.41399999999999998,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.96899999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.45800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.749}]},{"osd":6,"last update":"Wed Sep 13 09:37:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.66800000000000004,"15min":0.66300000000000003},"min":{"1min":0.45000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.79200000000000004}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":1.044,"15min":1.044},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92500000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.88600000000000001}]},{"osd":8,"last update":"Wed Sep 13 09:37:24 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70399999999999996}]},{"osd":9,"last update":"Wed Sep 13 09:37:47 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.90400000000000003}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.92500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":21339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":3244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":21069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T09:38:18.005 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-13T09:38:18.006 INFO:tasks.cephadm:Setting up client nodes... 2023-09-13T09:38:18.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-09-13T09:38:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:17 smithi053 ceph-mon[102373]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:17 smithi053 ceph-mon[102373]: pgmap v259: 97 pgs: 97 active+clean; 599 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s wr, 18 op/s 2023-09-13T09:38:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:17 smithi053 ceph-mon[102373]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:18.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:17 smithi053 ceph-mon[102373]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-09-13T09:38:18.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:17 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2894558348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:18.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:17 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2258697889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:17 smithi131 ceph-mon[102785]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:17 smithi131 ceph-mon[102785]: pgmap v259: 97 pgs: 97 active+clean; 599 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s wr, 18 op/s 2023-09-13T09:38:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:17 smithi131 ceph-mon[102785]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:38:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:17 smithi131 ceph-mon[102785]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-09-13T09:38:18.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:17 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2894558348' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:38:18.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:17 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2258697889' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:19.091 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:18 smithi006 ceph-mon[98665]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:19.092 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:18 smithi006 ceph-mon[98665]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:19.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:18 smithi053 ceph-mon[102373]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:19.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:18 smithi053 ceph-mon[102373]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:19.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:18 smithi131 ceph-mon[102785]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:19.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:18 smithi131 ceph-mon[102785]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 -- 172.21.15.6:0/3311575740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4101840 msgr2=0x7f10d41080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3311575740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4101840 0x7f10d41080f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00b0d0 tx=0x7f10cc00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 -- 172.21.15.6:0/3311575740 shutdown_connections 2023-09-13T09:38:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3311575740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4101840 0x7f10d41080f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3311575740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10d40ffca0 0x7f10d41000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3311575740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d4100ea0 0x7f10d4101300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 -- 172.21.15.6:0/3311575740 >> 172.21.15.6:0/3311575740 conn(0x7f10d40fb220 msgr2=0x7f10d40fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 -- 172.21.15.6:0/3311575740 shutdown_connections 2023-09-13T09:38:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 -- 172.21.15.6:0/3311575740 wait complete. 2023-09-13T09:38:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.825+0000 7f10d9af4700 1 Processor -- start 2023-09-13T09:38:19.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d9af4700 1 -- start start 2023-09-13T09:38:19.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d9af4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10d40ffca0 0x7f10d4103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:19.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d9af4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4100ea0 0x7f10d4102280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:19.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d9af4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d4101840 0x7f10d41027c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:19.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d9af4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d4102f40 con 0x7f10d4100ea0 2023-09-13T09:38:19.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d9af4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d41030b0 con 0x7f10d40ffca0 2023-09-13T09:38:19.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d9af4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d41a0af0 con 0x7f10d4101840 2023-09-13T09:38:19.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4100ea0 0x7f10d4102280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:19.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4100ea0 0x7f10d4102280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60646/0 (socket says 172.21.15.6:60646) 2023-09-13T09:38:19.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 -- 172.21.15.6:0/3140316129 learned_addr learned my addr 172.21.15.6:0/3140316129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:19.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d3fff700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d4101840 0x7f10d41027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:19.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d37fe700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10d40ffca0 0x7f10d4103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:19.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 -- 172.21.15.6:0/3140316129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d4101840 msgr2=0x7f10d41027c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:19.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d4101840 0x7f10d41027c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:19.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 -- 172.21.15.6:0/3140316129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10d40ffca0 msgr2=0x7f10d4103c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:19.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10d40ffca0 0x7f10d4103c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:19.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 -- 172.21.15.6:0/3140316129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10cc009d00 con 0x7f10d4100ea0 2023-09-13T09:38:19.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d37fe700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10d40ffca0 0x7f10d4103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:19.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.826+0000 7f10d2ffd700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4100ea0 0x7f10d4102280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c9b0 tx=0x7f10bc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:19.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.827+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3140316129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc007b00 con 0x7f10d4100ea0 2023-09-13T09:38:19.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.827+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d41a0dd0 con 0x7f10d4100ea0 2023-09-13T09:38:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.827+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3140316129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10bc007c60 con 0x7f10d4100ea0 2023-09-13T09:38:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.827+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3140316129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc018660 con 0x7f10d4100ea0 2023-09-13T09:38:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.827+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d41a1270 con 0x7f10d4100ea0 2023-09-13T09:38:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.828+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d410b4b0 con 0x7f10d4100ea0 2023-09-13T09:38:19.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.829+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3140316129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f10bc018880 con 0x7f10d4100ea0 2023-09-13T09:38:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.829+0000 7f10d0ff9700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c00a06d0 0x7f10c00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.829+0000 7f10d37fe700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c00a06d0 0x7f10c00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.829+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3140316129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f10bc0cbde0 con 0x7f10d4100ea0 2023-09-13T09:38:19.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.830+0000 7f10d37fe700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c00a06d0 0x7f10c00a2b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10d4100d00 tx=0x7f10c4009670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:19.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:19.833+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3140316129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f10bc0959f0 con 0x7f10d4100ea0 2023-09-13T09:38:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:19 smithi006 ceph-mon[98665]: pgmap v260: 97 pgs: 97 active+clean; 601 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2023-09-13T09:38:20.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.115+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f10d41a14c0 con 0x7f10d4100ea0 2023-09-13T09:38:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.120+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3140316129 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f10bc099010 con 0x7f10d4100ea0 2023-09-13T09:38:20.120 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2023-09-13T09:38:20.120 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQAMgwFl/N35BhAAQ7Oze3H2ZiCThwzJWl7j5g== 2023-09-13T09:38:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c00a06d0 msgr2=0x7f10c00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c00a06d0 0x7f10c00a2b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f10d4100d00 tx=0x7f10c4009670 comp rx=0 tx=0).stop 2023-09-13T09:38:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4100ea0 msgr2=0x7f10d4102280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4100ea0 0x7f10d4102280 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f10bc00c9b0 tx=0x7f10bc00cd70 comp rx=0 tx=0).stop 2023-09-13T09:38:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 shutdown_connections 2023-09-13T09:38:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d4101840 0x7f10d41027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10d40ffca0 0x7f10d4103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c00a06d0 0x7f10c00a2b90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 --2- 172.21.15.6:0/3140316129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10d4100ea0 0x7f10d4102280 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 >> 172.21.15.6:0/3140316129 conn(0x7f10d40fb220 msgr2=0x7f10d40687e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 shutdown_connections 2023-09-13T09:38:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:20.122+0000 7f10d9af4700 1 -- 172.21.15.6:0/3140316129 wait complete. 2023-09-13T09:38:20.256 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:19 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: 2023-09-13T09:38:19.963+0000 7f5d6c5fb700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-09-13T09:38:20.256 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 09:38:19 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: 2023-09-13T09:38:19.963+0000 7f5d6c5fb700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-09-13T09:38:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:19 smithi053 ceph-mon[102373]: pgmap v260: 97 pgs: 97 active+clean; 601 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2023-09-13T09:38:20.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:19 smithi131 ceph-mon[102785]: pgmap v260: 97 pgs: 97 active+clean; 601 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 1.9 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2023-09-13T09:38:20.551 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:38:20.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-09-13T09:38:20.552 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-13T09:38:20.595 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-13T09:38:20.596 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-09-13T09:38:20.597 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph mgr dump --format=json 2023-09-13T09:38:21.195 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:21.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:20 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3140316129' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-13T09:38:21.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:20 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3140316129' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-13T09:38:21.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:20 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3140316129' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-13T09:38:21.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:20 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3140316129' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-13T09:38:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:20 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3140316129' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-09-13T09:38:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:20 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3140316129' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-09-13T09:38:21.985 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:21 smithi006 ceph-mon[98665]: pgmap v261: 97 pgs: 97 active+clean; 602 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2023-09-13T09:38:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:21 smithi053 ceph-mon[102373]: pgmap v261: 97 pgs: 97 active+clean; 602 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2023-09-13T09:38:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:21 smithi131 ceph-mon[102785]: pgmap v261: 97 pgs: 97 active+clean; 602 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 8.1 KiB/s wr, 22 op/s 2023-09-13T09:38:22.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/3927660257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58101740 msgr2=0x7f4a5810dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:22.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/3927660257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58101740 0x7f4a5810dbb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000b0d0 tx=0x7f4a5000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/3927660257 shutdown_connections 2023-09-13T09:38:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/3927660257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58101740 0x7f4a5810dbb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/3927660257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58106d90 0x7f4a58107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/3927660257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a58100d80 0x7f4a58101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/3927660257 >> 172.21.15.6:0/3927660257 conn(0x7f4a58077ea0 msgr2=0x7f4a580782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/3927660257 shutdown_connections 2023-09-13T09:38:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.363+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/3927660257 wait complete. 2023-09-13T09:38:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 Processor -- start 2023-09-13T09:38:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 -- start start 2023-09-13T09:38:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58100d80 0x7f4a58072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58101740 0x7f4a580734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a58106d90 0x7f4a58073a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581a52a0 con 0x7f4a58100d80 2023-09-13T09:38:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581a5410 con 0x7f4a58101740 2023-09-13T09:38:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5c9a2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a581a55d0 con 0x7f4a58106d90 2023-09-13T09:38:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58100d80 0x7f4a58072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58100d80 0x7f4a58072fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60656/0 (socket says 172.21.15.6:60656) 2023-09-13T09:38:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a5659c700 1 -- 172.21.15.6:0/1875669889 learned_addr learned my addr 172.21.15.6:0/1875669889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a55d9b700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58101740 0x7f4a580734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.364+0000 7f4a56d9d700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a58106d90 0x7f4a58073a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5659c700 1 -- 172.21.15.6:0/1875669889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a58106d90 msgr2=0x7f4a58073a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5659c700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a58106d90 0x7f4a58073a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5659c700 1 -- 172.21.15.6:0/1875669889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58101740 msgr2=0x7f4a580734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5659c700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58101740 0x7f4a580734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5659c700 1 -- 172.21.15.6:0/1875669889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a50009d00 con 0x7f4a58100d80 2023-09-13T09:38:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5659c700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58100d80 0x7f4a58072fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c9b0 tx=0x7f4a4000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a4f7fe700 1 -- 172.21.15.6:0/1875669889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40007b00 con 0x7f4a58100d80 2023-09-13T09:38:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a581a58b0 con 0x7f4a58100d80 2023-09-13T09:38:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a4f7fe700 1 -- 172.21.15.6:0/1875669889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a40007c60 con 0x7f4a58100d80 2023-09-13T09:38:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a4f7fe700 1 -- 172.21.15.6:0/1875669889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a40018660 con 0x7f4a58100d80 2023-09-13T09:38:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.365+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a581a5e80 con 0x7f4a58100d80 2023-09-13T09:38:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.366+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a5804e9b0 con 0x7f4a58100d80 2023-09-13T09:38:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.367+0000 7f4a4f7fe700 1 -- 172.21.15.6:0/1875669889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f4a4000f450 con 0x7f4a58100d80 2023-09-13T09:38:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.368+0000 7f4a4f7fe700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a440a06d0 0x7f4a440a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.368+0000 7f4a55d9b700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a440a06d0 0x7f4a440a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:22.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.368+0000 7f4a4f7fe700 1 -- 172.21.15.6:0/1875669889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4a400cbc40 con 0x7f4a58100d80 2023-09-13T09:38:22.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.368+0000 7f4a55d9b700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a440a06d0 0x7f4a440a2b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a58074750 tx=0x7f4a48009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:22.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.372+0000 7f4a4f7fe700 1 -- 172.21.15.6:0/1875669889 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4a400956c0 con 0x7f4a58100d80 2023-09-13T09:38:22.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.637+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f4a58110ed0 con 0x7f4a58100d80 2023-09-13T09:38:22.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.641+0000 7f4a4f7fe700 1 -- 172.21.15.6:0/1875669889 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+259006 (secure 0 0 0) 0x7f4a40098ce0 con 0x7f4a58100d80 2023-09-13T09:38:22.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a440a06d0 msgr2=0x7f4a440a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a440a06d0 0x7f4a440a2b90 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4a58074750 tx=0x7f4a48009190 comp rx=0 tx=0).stop 2023-09-13T09:38:22.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58100d80 msgr2=0x7f4a58072fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58100d80 0x7f4a58072fb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f4a4000c9b0 tx=0x7f4a4000ccc0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 shutdown_connections 2023-09-13T09:38:22.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a58106d90 0x7f4a58073a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a440a06d0 0x7f4a440a2b90 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a58100d80 0x7f4a58072fb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 --2- 172.21.15.6:0/1875669889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a58101740 0x7f4a580734f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 >> 172.21.15.6:0/1875669889 conn(0x7f4a58077ea0 msgr2=0x7f4a580ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:22.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 shutdown_connections 2023-09-13T09:38:22.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:22.644+0000 7f4a5c9a2700 1 -- 172.21.15.6:0/1875669889 wait complete. 2023-09-13T09:38:23.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:22 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1875669889' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-13T09:38:23.057 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":1364175161},{"type":"v1","addr":"172.21.15.6:6801","nonce":1364175161}]},"active_addr":"172.21.15.6:6801/1364175161","active_change":"2023-09-13T09:32:06.061995+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.6:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":387840949}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":2304956462}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":806949827}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":4283798169}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":15068942}]}]} 2023-09-13T09:38:23.064 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-09-13T09:38:23.064 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-09-13T09:38:23.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd dump --format=json 2023-09-13T09:38:23.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:22 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1875669889' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-13T09:38:23.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:22 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1875669889' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-09-13T09:38:23.626 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:24.051 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:23 smithi006 ceph-mon[98665]: pgmap v262: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-09-13T09:38:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:23 smithi053 ceph-mon[102373]: pgmap v262: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-09-13T09:38:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:23 smithi131 ceph-mon[102785]: pgmap v262: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 8.6 KiB/s wr, 25 op/s 2023-09-13T09:38:25.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 -- 172.21.15.6:0/4187309533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78069140 msgr2=0x7f6c7810dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/4187309533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78069140 0x7f6c7810dbe0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6c7000b0d0 tx=0x7f6c7000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 -- 172.21.15.6:0/4187309533 shutdown_connections 2023-09-13T09:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/4187309533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78069140 0x7f6c7810dbe0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/4187309533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c78106da0 0x7f6c78107180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/4187309533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c780687a0 0x7f6c78068c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 -- 172.21.15.6:0/4187309533 >> 172.21.15.6:0/4187309533 conn(0x7f6c78075c00 msgr2=0x7f6c78076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 -- 172.21.15.6:0/4187309533 shutdown_connections 2023-09-13T09:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.004+0000 7f6c7d35d700 1 -- 172.21.15.6:0/4187309533 wait complete. 2023-09-13T09:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 Processor -- start 2023-09-13T09:38:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 -- start start 2023-09-13T09:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c780687a0 0x7f6c78196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c78069140 0x7f6c78197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78106da0 0x7f6c7819b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7819bec0 con 0x7f6c78106da0 2023-09-13T09:38:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7819c030 con 0x7f6c780687a0 2023-09-13T09:38:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c7d35d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7819c1f0 con 0x7f6c78069140 2023-09-13T09:38:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.005+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78106da0 0x7f6c7819b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:25.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78106da0 0x7f6c7819b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60672/0 (socket says 172.21.15.6:60672) 2023-09-13T09:38:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 -- 172.21.15.6:0/1028041841 learned_addr learned my addr 172.21.15.6:0/1028041841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c767fc700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c78069140 0x7f6c78197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c76ffd700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c780687a0 0x7f6c78196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 -- 172.21.15.6:0/1028041841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c78069140 msgr2=0x7f6c78197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:25.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c78069140 0x7f6c78197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 -- 172.21.15.6:0/1028041841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c780687a0 msgr2=0x7f6c78196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c780687a0 0x7f6c78196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 -- 172.21.15.6:0/1028041841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c70009d00 con 0x7f6c78106da0 2023-09-13T09:38:25.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c76ffd700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c780687a0 0x7f6c78196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c777fe700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78106da0 0x7f6c7819b8b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c70007870 tx=0x7f6c700078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c6ffff700 1 -- 172.21.15.6:0/1028041841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7000e040 con 0x7f6c78106da0 2023-09-13T09:38:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7819c470 con 0x7f6c78106da0 2023-09-13T09:38:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c6ffff700 1 -- 172.21.15.6:0/1028041841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c70003e10 con 0x7f6c78106da0 2023-09-13T09:38:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c6ffff700 1 -- 172.21.15.6:0/1028041841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7001b980 con 0x7f6c78106da0 2023-09-13T09:38:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.006+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c781a3d30 con 0x7f6c78106da0 2023-09-13T09:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.007+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7804e9b0 con 0x7f6c78106da0 2023-09-13T09:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.008+0000 7f6c6ffff700 1 -- 172.21.15.6:0/1028041841 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f6c700050d0 con 0x7f6c78106da0 2023-09-13T09:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.009+0000 7f6c6ffff700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c640a06d0 0x7f6c640a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.009+0000 7f6c6ffff700 1 -- 172.21.15.6:0/1028041841 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6c700cda30 con 0x7f6c78106da0 2023-09-13T09:38:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.009+0000 7f6c76ffd700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c640a06d0 0x7f6c640a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.009+0000 7f6c76ffd700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c640a06d0 0x7f6c640a2b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c68005e10 tx=0x7f6c68005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.012+0000 7f6c6ffff700 1 -- 172.21.15.6:0/1028041841 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6c70097540 con 0x7f6c78106da0 2023-09-13T09:38:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.213+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c78110c90 con 0x7f6c78106da0 2023-09-13T09:38:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.215+0000 7f6c6ffff700 1 -- 172.21.15.6:0/1028041841 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22001 (secure 0 0 0) 0x7f6c7009ab60 con 0x7f6c78106da0 2023-09-13T09:38:25.215 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:25.215 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:10.679583+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:38:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.216+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c640a06d0 msgr2=0x7f6c640a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c640a06d0 0x7f6c640a2b90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6c68005e10 tx=0x7f6c68005d60 comp rx=0 tx=0).stop 2023-09-13T09:38:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78106da0 msgr2=0x7f6c7819b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78106da0 0x7f6c7819b8b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f6c70007870 tx=0x7f6c700078a0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 shutdown_connections 2023-09-13T09:38:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c640a06d0 0x7f6c640a2b90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c78106da0 0x7f6c7819b8b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c780687a0 0x7f6c78196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 --2- 172.21.15.6:0/1028041841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c78069140 0x7f6c78197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 >> 172.21.15.6:0/1028041841 conn(0x7f6c78075c00 msgr2=0x7f6c780fe890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 shutdown_connections 2023-09-13T09:38:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:25.217+0000 7f6c7d35d700 1 -- 172.21.15.6:0/1028041841 wait complete. 2023-09-13T09:38:25.590 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-09-13T09:38:25.590 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd dump --format=json 2023-09-13T09:38:26.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:25 smithi006 ceph-mon[98665]: pgmap v263: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2023-09-13T09:38:26.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:25 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1028041841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:26.155 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:25 smithi053 ceph-mon[102373]: pgmap v263: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2023-09-13T09:38:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:25 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1028041841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:25 smithi131 ceph-mon[102785]: pgmap v263: 97 pgs: 97 active+clean; 624 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 8.0 KiB/s wr, 23 op/s 2023-09-13T09:38:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:25 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1028041841' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/941284070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb78100800 msgr2=0x7fbb78104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/941284070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb78100800 0x7fbb78104850 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009990 tx=0x7fbb68009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/941284070 shutdown_connections 2023-09-13T09:38:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/941284070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb78104f30 0x7fbb7810cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/941284070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb780ffe50 0x7fbb78100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/941284070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb78100800 0x7fbb78104850 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/941284070 >> 172.21.15.6:0/941284070 conn(0x7fbb780fb720 msgr2=0x7fbb780fdb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/941284070 shutdown_connections 2023-09-13T09:38:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/941284070 wait complete. 2023-09-13T09:38:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.346+0000 7fbb7d8bc700 1 Processor -- start 2023-09-13T09:38:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb7d8bc700 1 -- start start 2023-09-13T09:38:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb7d8bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb780ffe50 0x7fbb78196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb7d8bc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb78100800 0x7fbb78197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb7d8bc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb78104f30 0x7fbb7819b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb7d8bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7819beb0 con 0x7fbb780ffe50 2023-09-13T09:38:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb7d8bc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7819c020 con 0x7fbb78100800 2023-09-13T09:38:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb7d8bc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7819c1e0 con 0x7fbb78104f30 2023-09-13T09:38:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb780ffe50 0x7fbb78196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb780ffe50 0x7fbb78196ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60682/0 (socket says 172.21.15.6:60682) 2023-09-13T09:38:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 -- 172.21.15.6:0/3651076451 learned_addr learned my addr 172.21.15.6:0/3651076451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb767fc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb78100800 0x7fbb78197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb777fe700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb78104f30 0x7fbb7819b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 -- 172.21.15.6:0/3651076451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb78104f30 msgr2=0x7fbb7819b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb78104f30 0x7fbb7819b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 -- 172.21.15.6:0/3651076451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb78100800 msgr2=0x7fbb78197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb78100800 0x7fbb78197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.347+0000 7fbb76ffd700 1 -- 172.21.15.6:0/3651076451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb680095f0 con 0x7fbb780ffe50 2023-09-13T09:38:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.348+0000 7fbb76ffd700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb780ffe50 0x7fbb78196ef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00b530 tx=0x7fbb6c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.348+0000 7fbb7c8ba700 1 -- 172.21.15.6:0/3651076451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c011830 con 0x7fbb780ffe50 2023-09-13T09:38:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.348+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7819c4c0 con 0x7fbb780ffe50 2023-09-13T09:38:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.348+0000 7fbb7c8ba700 1 -- 172.21.15.6:0/3651076451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb6c011e50 con 0x7fbb780ffe50 2023-09-13T09:38:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.348+0000 7fbb7c8ba700 1 -- 172.21.15.6:0/3651076451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6c00f2e0 con 0x7fbb780ffe50 2023-09-13T09:38:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.348+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb781a3d20 con 0x7fbb780ffe50 2023-09-13T09:38:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.349+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb78109160 con 0x7fbb780ffe50 2023-09-13T09:38:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.350+0000 7fbb7c8ba700 1 -- 172.21.15.6:0/3651076451 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fbb6c010380 con 0x7fbb780ffe50 2023-09-13T09:38:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.350+0000 7fbb7c8ba700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb600a06d0 0x7fbb600a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.350+0000 7fbb767fc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb600a06d0 0x7fbb600a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.350+0000 7fbb7c8ba700 1 -- 172.21.15.6:0/3651076451 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbb6c0cb600 con 0x7fbb780ffe50 2023-09-13T09:38:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.351+0000 7fbb767fc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb600a06d0 0x7fbb600a2b90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb78198510 tx=0x7fbb68005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.355+0000 7fbb7c8ba700 1 -- 172.21.15.6:0/3651076451 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbb6c095290 con 0x7fbb780ffe50 2023-09-13T09:38:27.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.554+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb7804e9b0 con 0x7fbb780ffe50 2023-09-13T09:38:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.555+0000 7fbb7c8ba700 1 -- 172.21.15.6:0/3651076451 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22001 (secure 0 0 0) 0x7fbb6c0988b0 con 0x7fbb780ffe50 2023-09-13T09:38:27.557 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:27.557 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:10.679583+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:38:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb600a06d0 msgr2=0x7fbb600a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb600a06d0 0x7fbb600a2b90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fbb78198510 tx=0x7fbb68005fb0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb780ffe50 msgr2=0x7fbb78196ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb780ffe50 0x7fbb78196ef0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fbb6c00b530 tx=0x7fbb6c00b840 comp rx=0 tx=0).stop 2023-09-13T09:38:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 shutdown_connections 2023-09-13T09:38:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb78104f30 0x7fbb7819b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb600a06d0 0x7fbb600a2b90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb780ffe50 0x7fbb78196ef0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 --2- 172.21.15.6:0/3651076451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb78100800 0x7fbb78197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:27.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.557+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 >> 172.21.15.6:0/3651076451 conn(0x7fbb780fb720 msgr2=0x7fbb78103a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:27.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.558+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 shutdown_connections 2023-09-13T09:38:27.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:27.558+0000 7fbb7d8bc700 1 -- 172.21.15.6:0/3651076451 wait complete. 2023-09-13T09:38:28.003 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:27 smithi006 ceph-mon[98665]: pgmap v264: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2023-09-13T09:38:28.003 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:27 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3651076451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:28.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.0 flush_pg_stats 2023-09-13T09:38:28.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.1 flush_pg_stats 2023-09-13T09:38:28.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.2 flush_pg_stats 2023-09-13T09:38:28.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.3 flush_pg_stats 2023-09-13T09:38:28.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.4 flush_pg_stats 2023-09-13T09:38:28.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.5 flush_pg_stats 2023-09-13T09:38:28.009 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.6 flush_pg_stats 2023-09-13T09:38:28.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.7 flush_pg_stats 2023-09-13T09:38:28.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.8 flush_pg_stats 2023-09-13T09:38:28.011 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.9 flush_pg_stats 2023-09-13T09:38:28.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.10 flush_pg_stats 2023-09-13T09:38:28.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph tell osd.11 flush_pg_stats 2023-09-13T09:38:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:27 smithi053 ceph-mon[102373]: pgmap v264: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2023-09-13T09:38:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:27 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3651076451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:27 smithi131 ceph-mon[102785]: pgmap v264: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 KiB/s wr, 24 op/s 2023-09-13T09:38:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:27 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3651076451' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:38:28.819 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:29.004 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:29.295 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:29.380 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:29.401 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:29.904 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:29 smithi006 ceph-mon[98665]: pgmap v265: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2023-09-13T09:38:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:29 smithi053 ceph-mon[102373]: pgmap v265: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2023-09-13T09:38:30.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:29 smithi131 ceph-mon[102785]: pgmap v265: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.1 KiB/s wr, 18 op/s 2023-09-13T09:38:30.746 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:31.133 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:31.162 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:31.430 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:31.699 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:32.129 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:31 smithi006 ceph-mon[98665]: pgmap v266: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2023-09-13T09:38:32.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 -- 172.21.15.6:0/765149188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 msgr2=0x7f76b810ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 --2- 172.21.15.6:0/765149188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 0x7f76b810ca90 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f76b000b0d0 tx=0x7f76b000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 -- 172.21.15.6:0/765149188 shutdown_connections 2023-09-13T09:38:32.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 --2- 172.21.15.6:0/765149188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 0x7f76b810ca90 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 --2- 172.21.15.6:0/765149188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76b8105c70 0x7f76b8106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 --2- 172.21.15.6:0/765149188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76b80ffc60 0x7f76b81000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 -- 172.21.15.6:0/765149188 >> 172.21.15.6:0/765149188 conn(0x7f76b8075c00 msgr2=0x7f76b8076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 -- 172.21.15.6:0/765149188 shutdown_connections 2023-09-13T09:38:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.171+0000 7f76bd627700 1 -- 172.21.15.6:0/765149188 wait complete. 2023-09-13T09:38:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.172+0000 7f76bd627700 1 Processor -- start 2023-09-13T09:38:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.172+0000 7f76bd627700 1 -- start start 2023-09-13T09:38:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76bd627700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76b80ffc60 0x7f76b8197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76bd627700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 0x7f76b81982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76bd627700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76b8105c70 0x7f76b81a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76bd627700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b8198bd0 con 0x7f76b8100620 2023-09-13T09:38:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76bd627700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b81a3340 con 0x7f76b80ffc60 2023-09-13T09:38:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76bd627700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b81a34b0 con 0x7f76b8105c70 2023-09-13T09:38:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 0x7f76b81982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76b80ffc60 0x7f76b8197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 0x7f76b81982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60712/0 (socket says 172.21.15.6:60712) 2023-09-13T09:38:32.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76b80ffc60 0x7f76b8197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:54234/0 (socket says 172.21.15.6:54234) 2023-09-13T09:38:32.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 -- 172.21.15.6:0/2560608222 learned_addr learned my addr 172.21.15.6:0/2560608222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:32.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 -- 172.21.15.6:0/2560608222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76b8105c70 msgr2=0x7f76b81a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76b8105c70 0x7f76b81a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 -- 172.21.15.6:0/2560608222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76b80ffc60 msgr2=0x7f76b8197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76b80ffc60 0x7f76b8197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 -- 172.21.15.6:0/2560608222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0009d00 con 0x7f76b8100620 2023-09-13T09:38:32.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f76b67fc700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 0x7f76b81982c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00d980 tx=0x7f76ac00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:32.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.173+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac004220 con 0x7f76b8100620 2023-09-13T09:38:32.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.174+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76ac007640 con 0x7f76b8100620 2023-09-13T09:38:32.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.174+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac005610 con 0x7f76b8100620 2023-09-13T09:38:32.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.174+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b81a3790 con 0x7f76b8100620 2023-09-13T09:38:32.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.174+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b81a3c40 con 0x7f76b8100620 2023-09-13T09:38:32.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.175+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f76b810fe00 con 0x7f76b8100620 2023-09-13T09:38:32.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.176+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f76ac004750 con 0x7f76b8100620 2023-09-13T09:38:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.176+0000 7f769ffff700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76a00a0750 0x7f76a00a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.177+0000 7f76b6ffd700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76a00a0750 0x7f76a00a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.177+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f76ac0cb960 con 0x7f76b8100620 2023-09-13T09:38:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.177+0000 7f769ffff700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] conn(0x7f76a00a9f30 0x7f76a00ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.177+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 --> [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f76a00aca00 con 0x7f76a00a9f30 2023-09-13T09:38:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.177+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ac0d02c0 con 0x7f76b8100620 2023-09-13T09:38:32.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.177+0000 7f76b6ffd700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76a00a0750 0x7f76a00a2c10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f76a8005950 tx=0x7f76a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:32.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.177+0000 7f76b77fe700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] conn(0x7f76a00a9f30 0x7f76a00ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.178+0000 7f76b77fe700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] conn(0x7f76a00a9f30 0x7f76a00ac350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:32.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.179+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== osd.5 v2:172.21.15.131:6808/2492626170 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f76a00aca00 con 0x7f76a00a9f30 2023-09-13T09:38:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 -- 172.21.15.6:0/3423148683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0106d90 msgr2=0x7fc0f0107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 --2- 172.21.15.6:0/3423148683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0106d90 0x7fc0f0107170 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fc0e00099c0 tx=0x7fc0e0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 -- 172.21.15.6:0/3423148683 shutdown_connections 2023-09-13T09:38:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 --2- 172.21.15.6:0/3423148683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f0101740 0x7fc0f010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 --2- 172.21.15.6:0/3423148683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0106d90 0x7fc0f0107170 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 --2- 172.21.15.6:0/3423148683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0f0100d80 0x7fc0f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 -- 172.21.15.6:0/3423148683 >> 172.21.15.6:0/3423148683 conn(0x7fc0f0077ea0 msgr2=0x7fc0f00782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:32.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 -- 172.21.15.6:0/3423148683 shutdown_connections 2023-09-13T09:38:32.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.922+0000 7fc0f663c700 1 -- 172.21.15.6:0/3423148683 wait complete. 2023-09-13T09:38:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 Processor -- start 2023-09-13T09:38:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 -- start start 2023-09-13T09:38:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0f0100d80 0x7fc0f0196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0101740 0x7fc0f0197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f0106d90 0x7fc0f019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f019bd00 con 0x7fc0f0101740 2023-09-13T09:38:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f019be70 con 0x7fc0f0106d90 2023-09-13T09:38:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0f663c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f019c030 con 0x7fc0f0100d80 2023-09-13T09:38:32.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0101740 0x7fc0f0197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0101740 0x7fc0f0197280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60698/0 (socket says 172.21.15.6:60698) 2023-09-13T09:38:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0ef7fe700 1 -- 172.21.15.6:0/966439595 learned_addr learned my addr 172.21.15.6:0/966439595 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.923+0000 7fc0effff700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0f0100d80 0x7fc0f0196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0f4bd9700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f0106d90 0x7fc0f019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ef7fe700 1 -- 172.21.15.6:0/966439595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0f0100d80 msgr2=0x7fc0f0196d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ef7fe700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0f0100d80 0x7fc0f0196d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ef7fe700 1 -- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f0106d90 msgr2=0x7fc0f019b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ef7fe700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc0f0106d90 0x7fc0f019b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ef7fe700 1 -- 172.21.15.6:0/966439595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00095f0 con 0x7fc0f0101740 2023-09-13T09:38:32.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ef7fe700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0101740 0x7fc0f0197280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400c9b0 tx=0x7fc0e400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4007b00 con 0x7fc0f0101740 2023-09-13T09:38:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc0e400ce50 con 0x7fc0f0101740 2023-09-13T09:38:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0f019c310 con 0x7fc0f0101740 2023-09-13T09:38:32.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4018660 con 0x7fc0f0101740 2023-09-13T09:38:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.924+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f01a3b70 con 0x7fc0f0101740 2023-09-13T09:38:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.925+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc0f004e9b0 con 0x7fc0f0101740 2023-09-13T09:38:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.926+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fc0e400f450 con 0x7fc0f0101740 2023-09-13T09:38:32.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0ed7fa700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc0d80a06d0 0x7fc0d80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0effff700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc0d80a06d0 0x7fc0d80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc0e40cbf10 con 0x7fc0f0101740 2023-09-13T09:38:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0ed7fa700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] conn(0x7fc0d80a9eb0 0x7fc0d80ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:32.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 --> [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc0d80ac980 con 0x7fc0d80a9eb0 2023-09-13T09:38:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0e40cc3b0 con 0x7fc0f0101740 2023-09-13T09:38:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0effff700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc0d80a06d0 0x7fc0d80a2b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009990 tx=0x7fc0e0003680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.927+0000 7fc0f4bd9700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] conn(0x7fc0d80a9eb0 0x7fc0d80ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:32.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.928+0000 7fc0f4bd9700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] conn(0x7fc0d80a9eb0 0x7fc0d80ac2d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.929+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== osd.1 v2:172.21.15.53:6800/1769951158 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fc0d80ac980 con 0x7fc0d80a9eb0 2023-09-13T09:38:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.947+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 --> [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc0f0110ee0 con 0x7fc0d80a9eb0 2023-09-13T09:38:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0ed7fa700 1 -- 172.21.15.6:0/966439595 <== osd.1 v2:172.21.15.53:6800/1769951158 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc0f0110ee0 con 0x7fc0d80a9eb0 2023-09-13T09:38:32.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] conn(0x7fc0d80a9eb0 msgr2=0x7fc0d80ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] conn(0x7fc0d80a9eb0 0x7fc0d80ac2d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc0d80a06d0 msgr2=0x7fc0d80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc0d80a06d0 0x7fc0d80a2b90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009990 tx=0x7fc0e0003680 comp rx=0 tx=0).stop 2023-09-13T09:38:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0101740 msgr2=0x7fc0f0197280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 --2- 172.21.15.6:0/966439595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc0f0101740 0x7fc0f0197280 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400c9b0 tx=0x7fc0e400ccc0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f4bd9700 1 -- 172.21.15.6:0/966439595 reap_dead start 2023-09-13T09:38:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 shutdown_connections 2023-09-13T09:38:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 >> 172.21.15.6:0/966439595 conn(0x7fc0f0077ea0 msgr2=0x7fc0f0104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:32.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 shutdown_connections 2023-09-13T09:38:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:31.948+0000 7fc0f663c700 1 -- 172.21.15.6:0/966439595 wait complete. 2023-09-13T09:38:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.196+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 --> [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f76b804e9b0 con 0x7f76a00a9f30 2023-09-13T09:38:32.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.196+0000 7f769ffff700 1 -- 172.21.15.6:0/2560608222 <== osd.5 v2:172.21.15.131:6808/2492626170 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f76b804e9b0 con 0x7f76a00a9f30 2023-09-13T09:38:32.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 >> [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] conn(0x7f76a00a9f30 msgr2=0x7f76a00ac350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] conn(0x7f76a00a9f30 0x7f76a00ac350 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76a00a0750 msgr2=0x7f76a00a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76a00a0750 0x7f76a00a2c10 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f76a8005950 tx=0x7f76a800b410 comp rx=0 tx=0).stop 2023-09-13T09:38:32.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 msgr2=0x7f76b81982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 --2- 172.21.15.6:0/2560608222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b8100620 0x7f76b81982c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f76ac00d980 tx=0x7f76ac00dc90 comp rx=0 tx=0).stop 2023-09-13T09:38:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76b77fe700 1 -- 172.21.15.6:0/2560608222 reap_dead start 2023-09-13T09:38:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 shutdown_connections 2023-09-13T09:38:32.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 >> 172.21.15.6:0/2560608222 conn(0x7f76b8075c00 msgr2=0x7f76b8103970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 shutdown_connections 2023-09-13T09:38:32.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:32.197+0000 7f76bd627700 1 -- 172.21.15.6:0/2560608222 wait complete. 2023-09-13T09:38:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:31 smithi053 ceph-mon[102373]: pgmap v266: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2023-09-13T09:38:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:31 smithi131 ceph-mon[102785]: pgmap v266: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 4.2 KiB/s wr, 12 op/s 2023-09-13T09:38:33.738 INFO:teuthology.orchestra.run.smithi006.stdout:158913789994 2023-09-13T09:38:33.739 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.5 2023-09-13T09:38:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/2008506126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d381084b0 msgr2=0x7f6d38114170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 --2- 172.21.15.6:0/2008506126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d381084b0 0x7f6d38114170 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000b0d0 tx=0x7f6d3000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/2008506126 shutdown_connections 2023-09-13T09:38:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 --2- 172.21.15.6:0/2008506126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d381084b0 0x7f6d38114170 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 --2- 172.21.15.6:0/2008506126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d3810d4b0 0x7f6d3810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 --2- 172.21.15.6:0/2008506126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d38107af0 0x7f6d38107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/2008506126 >> 172.21.15.6:0/2008506126 conn(0x7f6d38076c20 msgr2=0x7f6d38079040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.979+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/2008506126 shutdown_connections 2023-09-13T09:38:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.980+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/2008506126 wait complete. 2023-09-13T09:38:33.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 Processor -- start 2023-09-13T09:38:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 -- start start 2023-09-13T09:38:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d38107af0 0x7f6d3819d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d381084b0 0x7f6d3819d990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d3810d4b0 0x7f6d381a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d381a2410 con 0x7f6d3810d4b0 2023-09-13T09:38:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d381a2580 con 0x7f6d38107af0 2023-09-13T09:38:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d3cbb7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d381a2740 con 0x7f6d381084b0 2023-09-13T09:38:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d3810d4b0 0x7f6d381a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d3810d4b0 0x7f6d381a1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60738/0 (socket says 172.21.15.6:60738) 2023-09-13T09:38:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.981+0000 7f6d36d9d700 1 -- 172.21.15.6:0/1907939350 learned_addr learned my addr 172.21.15.6:0/1907939350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d36d9d700 1 -- 172.21.15.6:0/1907939350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d381084b0 msgr2=0x7f6d3819d990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:38:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d36d9d700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d381084b0 0x7f6d3819d990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d36d9d700 1 -- 172.21.15.6:0/1907939350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d38107af0 msgr2=0x7f6d3819d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d36d9d700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d38107af0 0x7f6d3819d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d36d9d700 1 -- 172.21.15.6:0/1907939350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d20009520 con 0x7f6d3810d4b0 2023-09-13T09:38:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d36d9d700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d3810d4b0 0x7f6d381a1e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d30007870 tx=0x7f6d30007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000e040 con 0x7f6d3810d4b0 2023-09-13T09:38:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.982+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d28009520 con 0x7f6d3810d4b0 2023-09-13T09:38:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.983+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d30005070 con 0x7f6d3810d4b0 2023-09-13T09:38:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.983+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3001b6c0 con 0x7f6d3810d4b0 2023-09-13T09:38:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.983+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d30009d00 con 0x7f6d3810d4b0 2023-09-13T09:38:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.985+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f6d300051e0 con 0x7f6d3810d4b0 2023-09-13T09:38:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.985+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6d381175c0 con 0x7f6d3810d4b0 2023-09-13T09:38:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.986+0000 7f6d2f7fe700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d240a0750 0x7f6d240a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.986+0000 7f6d3659c700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d240a0750 0x7f6d240a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.986+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6d300ccc20 con 0x7f6d3810d4b0 2023-09-13T09:38:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.987+0000 7f6d2f7fe700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] conn(0x7f6d240a9f30 0x7f6d240ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.987+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 --> [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6d240aca00 con 0x7f6d240a9f30 2023-09-13T09:38:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.987+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d300cf330 con 0x7f6d3810d4b0 2023-09-13T09:38:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.987+0000 7f6d2ffff700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] conn(0x7f6d240a9f30 0x7f6d240ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.987+0000 7f6d3659c700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d240a0750 0x7f6d240a2c10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005d90 tx=0x7f6d28005ce0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.987+0000 7f6d2ffff700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] conn(0x7f6d240a9f30 0x7f6d240ac350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.988+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== osd.3 v2:172.21.15.6:6810/1518323952 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6d240aca00 con 0x7f6d240a9f30 2023-09-13T09:38:34.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.004+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 --> [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6d3804e9b0 con 0x7f6d240a9f30 2023-09-13T09:38:34.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d2f7fe700 1 -- 172.21.15.6:0/1907939350 <== osd.3 v2:172.21.15.6:6810/1518323952 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6d3804e9b0 con 0x7f6d240a9f30 2023-09-13T09:38:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] conn(0x7f6d240a9f30 msgr2=0x7f6d240ac350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] conn(0x7f6d240a9f30 0x7f6d240ac350 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d240a0750 msgr2=0x7f6d240a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d240a0750 0x7f6d240a2c10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f6d28005d90 tx=0x7f6d28005ce0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d3810d4b0 msgr2=0x7f6d381a1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 --2- 172.21.15.6:0/1907939350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d3810d4b0 0x7f6d381a1e00 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6d30007870 tx=0x7f6d30007950 comp rx=0 tx=0).stop 2023-09-13T09:38:34.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d36d9d700 1 -- 172.21.15.6:0/1907939350 reap_dead start 2023-09-13T09:38:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 shutdown_connections 2023-09-13T09:38:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.005+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 >> 172.21.15.6:0/1907939350 conn(0x7f6d38076c20 msgr2=0x7f6d3810e120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.006+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 shutdown_connections 2023-09-13T09:38:34.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:34.006+0000 7f6d3cbb7700 1 -- 172.21.15.6:0/1907939350 wait complete. 2023-09-13T09:38:34.016 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:33 smithi006 ceph-mon[98665]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2023-09-13T09:38:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:33 smithi053 ceph-mon[102373]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2023-09-13T09:38:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:33 smithi131 ceph-mon[102785]: pgmap v267: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 KiB/s wr, 15 op/s 2023-09-13T09:38:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 -- 172.21.15.6:0/1075491039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c0ffc10 msgr2=0x7fa99c100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 --2- 172.21.15.6:0/1075491039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c0ffc10 0x7fa99c100090 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa990009990 tx=0x7fa990009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 -- 172.21.15.6:0/1075491039 shutdown_connections 2023-09-13T09:38:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 --2- 172.21.15.6:0/1075491039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa99c1005d0 0x7fa99c10ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 --2- 172.21.15.6:0/1075491039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c105cc0 0x7fa99c1060a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 --2- 172.21.15.6:0/1075491039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c0ffc10 0x7fa99c100090 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 -- 172.21.15.6:0/1075491039 >> 172.21.15.6:0/1075491039 conn(0x7fa99c076bc0 msgr2=0x7fa99c076fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:34.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 -- 172.21.15.6:0/1075491039 shutdown_connections 2023-09-13T09:38:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.875+0000 7fa9a2341700 1 -- 172.21.15.6:0/1075491039 wait complete. 2023-09-13T09:38:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 Processor -- start 2023-09-13T09:38:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 -- start start 2023-09-13T09:38:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c0ffc10 0x7fa99c196e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:34.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa99c1005d0 0x7fa99c197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c105cc0 0x7fa99c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c19be10 con 0x7fa99c105cc0 2023-09-13T09:38:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c19bf80 con 0x7fa99c1005d0 2023-09-13T09:38:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a2341700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa99c19c140 con 0x7fa99c0ffc10 2023-09-13T09:38:34.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a08de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c105cc0 0x7fa99c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa99b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa99c1005d0 0x7fa99c197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a08de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c105cc0 0x7fa99c19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60728/0 (socket says 172.21.15.6:60728) 2023-09-13T09:38:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa9a08de700 1 -- 172.21.15.6:0/3714733326 learned_addr learned my addr 172.21.15.6:0/3714733326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.876+0000 7fa99bfff700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c0ffc10 0x7fa99c196e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa99b7fe700 1 -- 172.21.15.6:0/3714733326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c0ffc10 msgr2=0x7fa99c196e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa99b7fe700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa99c0ffc10 0x7fa99c196e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa99b7fe700 1 -- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c105cc0 msgr2=0x7fa99c19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa99b7fe700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c105cc0 0x7fa99c19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa99b7fe700 1 -- 172.21.15.6:0/3714733326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9900095f0 con 0x7fa99c1005d0 2023-09-13T09:38:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa9a08de700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa99c105cc0 0x7fa99c19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:38:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa99b7fe700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa99c1005d0 0x7fa99c197390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa99000b2e0 tx=0x7fa990004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990021070 con 0x7fa99c1005d0 2023-09-13T09:38:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa99c19c3c0 con 0x7fa99c1005d0 2023-09-13T09:38:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa99c19c680 con 0x7fa99c1005d0 2023-09-13T09:38:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa99000bcb0 con 0x7fa99c1005d0 2023-09-13T09:38:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.877+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa990004c10 con 0x7fa99c1005d0 2023-09-13T09:38:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.878+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa99c10fdf0 con 0x7fa99c1005d0 2023-09-13T09:38:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.879+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fa990025070 con 0x7fa99c1005d0 2023-09-13T09:38:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.880+0000 7fa9997fa700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9840a06d0 0x7fa9840a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.880+0000 7fa99bfff700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9840a06d0 0x7fa9840a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.880+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa9900d15b0 con 0x7fa99c1005d0 2023-09-13T09:38:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.881+0000 7fa9997fa700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] conn(0x7fa9840a9eb0 0x7fa9840ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.881+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 --> [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa9840ac980 con 0x7fa9840a9eb0 2023-09-13T09:38:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.881+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9900d1a50 con 0x7fa99c1005d0 2023-09-13T09:38:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.881+0000 7fa99bfff700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9840a06d0 0x7fa9840a2b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa98c005950 tx=0x7fa98c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.881+0000 7fa9a08de700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] conn(0x7fa9840a9eb0 0x7fa9840ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.881+0000 7fa9a08de700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] conn(0x7fa9840a9eb0 0x7fa9840ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.882+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== osd.4 v2:172.21.15.53:6808/2094793371 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fa9840ac980 con 0x7fa9840a9eb0 2023-09-13T09:38:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.899+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 --> [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa99c04e9b0 con 0x7fa9840a9eb0 2023-09-13T09:38:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.899+0000 7fa9997fa700 1 -- 172.21.15.6:0/3714733326 <== osd.4 v2:172.21.15.53:6808/2094793371 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa99c04e9b0 con 0x7fa9840a9eb0 2023-09-13T09:38:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] conn(0x7fa9840a9eb0 msgr2=0x7fa9840ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] conn(0x7fa9840a9eb0 0x7fa9840ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9840a06d0 msgr2=0x7fa9840a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9840a06d0 0x7fa9840a2b90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa98c005950 tx=0x7fa98c00b410 comp rx=0 tx=0).stop 2023-09-13T09:38:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa99c1005d0 msgr2=0x7fa99c197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 --2- 172.21.15.6:0/3714733326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa99c1005d0 0x7fa99c197390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa99000b2e0 tx=0x7fa990004730 comp rx=0 tx=0).stop 2023-09-13T09:38:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a08de700 1 -- 172.21.15.6:0/3714733326 reap_dead start 2023-09-13T09:38:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 shutdown_connections 2023-09-13T09:38:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 >> 172.21.15.6:0/3714733326 conn(0x7fa99c076bc0 msgr2=0x7fa99c103bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 shutdown_connections 2023-09-13T09:38:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:33.900+0000 7fa9a2341700 1 -- 172.21.15.6:0/3714733326 wait complete. 2023-09-13T09:38:35.000 INFO:teuthology.orchestra.run.smithi006.stdout:107374182450 2023-09-13T09:38:35.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.3 2023-09-13T09:38:35.130 INFO:teuthology.orchestra.run.smithi006.stdout:55834574907 2023-09-13T09:38:35.131 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.1 2023-09-13T09:38:35.609 INFO:teuthology.orchestra.run.smithi006.stdout:137438953518 2023-09-13T09:38:35.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.4 2023-09-13T09:38:35.809 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:36.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:35 smithi006 ceph-mon[98665]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-09-13T09:38:36.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 -- 172.21.15.6:0/572823045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c4100800 msgr2=0x7f09c4104850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:36.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 --2- 172.21.15.6:0/572823045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c4100800 0x7f09c4104850 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009990 tx=0x7f09ac009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 -- 172.21.15.6:0/572823045 shutdown_connections 2023-09-13T09:38:36.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 --2- 172.21.15.6:0/572823045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c4104f30 0x7f09c410cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 --2- 172.21.15.6:0/572823045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09c40ffe50 0x7f09c4100230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 --2- 172.21.15.6:0/572823045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c4100800 0x7f09c4104850 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 -- 172.21.15.6:0/572823045 >> 172.21.15.6:0/572823045 conn(0x7f09c40fb6a0 msgr2=0x7f09c40fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 -- 172.21.15.6:0/572823045 shutdown_connections 2023-09-13T09:38:36.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.068+0000 7f09ca9d5700 1 -- 172.21.15.6:0/572823045 wait complete. 2023-09-13T09:38:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 Processor -- start 2023-09-13T09:38:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 -- start start 2023-09-13T09:38:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c40ffe50 0x7f09c4196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c4100800 0x7f09c4197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:36.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09c4104f30 0x7f09c419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c419bde0 con 0x7f09c40ffe50 2023-09-13T09:38:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c419bf50 con 0x7f09c4100800 2023-09-13T09:38:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09ca9d5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09c419c110 con 0x7f09c4104f30 2023-09-13T09:38:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c40ffe50 0x7f09c4196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:36.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c40ffe50 0x7f09c4196e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60748/0 (socket says 172.21.15.6:60748) 2023-09-13T09:38:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09c3fff700 1 -- 172.21.15.6:0/2177705776 learned_addr learned my addr 172.21.15.6:0/2177705776 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.069+0000 7f09bbfff700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c4100800 0x7f09c4197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c8f72700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09c4104f30 0x7f09c419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c3fff700 1 -- 172.21.15.6:0/2177705776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09c4104f30 msgr2=0x7f09c419b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:36.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c3fff700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09c4104f30 0x7f09c419b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c3fff700 1 -- 172.21.15.6:0/2177705776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c4100800 msgr2=0x7f09c4197360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:36.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c3fff700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09c4100800 0x7f09c4197360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c3fff700 1 -- 172.21.15.6:0/2177705776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac0095f0 con 0x7f09c40ffe50 2023-09-13T09:38:36.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c8f72700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f09c4104f30 0x7f09c419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:36.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c3fff700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c40ffe50 0x7f09c4196e20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c920 tx=0x7f09b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:36.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b4007b00 con 0x7f09c40ffe50 2023-09-13T09:38:36.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f09b400ce70 con 0x7f09c40ffe50 2023-09-13T09:38:36.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40054e0 con 0x7f09c40ffe50 2023-09-13T09:38:36.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09c419c3f0 con 0x7f09c40ffe50 2023-09-13T09:38:36.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.070+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09c41a3c50 con 0x7f09c40ffe50 2023-09-13T09:38:36.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.071+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f09c404e9b0 con 0x7f09c40ffe50 2023-09-13T09:38:36.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.072+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f09b4004750 con 0x7f09c40ffe50 2023-09-13T09:38:36.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09c1ffb700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09b00a0750 0x7f09b00a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:36.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f09b40cba90 con 0x7f09c40ffe50 2023-09-13T09:38:36.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09bbfff700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09b00a0750 0x7f09b00a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:36.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09c1ffb700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] conn(0x7f09b00a9f30 0x7f09b00ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:36.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 --> [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f09b00aca00 con 0x7f09b00a9f30 2023-09-13T09:38:36.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09b40cbf30 con 0x7f09c40ffe50 2023-09-13T09:38:36.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09c8f72700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] conn(0x7f09b00a9f30 0x7f09b00ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:36.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.073+0000 7f09bbfff700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09b00a0750 0x7f09b00a2c10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09c4198440 tx=0x7f09ac005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:36.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.074+0000 7f09c8f72700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] conn(0x7f09b00a9f30 0x7f09b00ac350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:36.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.074+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== osd.0 v2:172.21.15.6:6802/84174625 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f09b00aca00 con 0x7f09b00a9f30 2023-09-13T09:38:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.090+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 --> [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f09c410fe40 con 0x7f09b00a9f30 2023-09-13T09:38:36.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09c1ffb700 1 -- 172.21.15.6:0/2177705776 <== osd.0 v2:172.21.15.6:6802/84174625 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f09bc010040 con 0x7f09b00a9f30 2023-09-13T09:38:36.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] conn(0x7f09b00a9f30 msgr2=0x7f09b00ac350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:36.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] conn(0x7f09b00a9f30 0x7f09b00ac350 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09b00a0750 msgr2=0x7f09b00a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:36.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09b00a0750 0x7f09b00a2c10 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f09c4198440 tx=0x7f09ac005fd0 comp rx=0 tx=0).stop 2023-09-13T09:38:36.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c40ffe50 msgr2=0x7f09c4196e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 --2- 172.21.15.6:0/2177705776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f09c40ffe50 0x7f09c4196e20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f09b400c920 tx=0x7f09b400cc30 comp rx=0 tx=0).stop 2023-09-13T09:38:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09c8f72700 1 -- 172.21.15.6:0/2177705776 reap_dead start 2023-09-13T09:38:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 shutdown_connections 2023-09-13T09:38:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 >> 172.21.15.6:0/2177705776 conn(0x7f09c40fb6a0 msgr2=0x7f09c4103830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:36.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 shutdown_connections 2023-09-13T09:38:36.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:36.091+0000 7f09ca9d5700 1 -- 172.21.15.6:0/2177705776 wait complete. 2023-09-13T09:38:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:35 smithi053 ceph-mon[102373]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-09-13T09:38:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:35 smithi131 ceph-mon[102785]: pgmap v268: 97 pgs: 97 active+clean; 636 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 9 op/s 2023-09-13T09:38:37.311 INFO:teuthology.orchestra.run.smithi006.stdout:34359738432 2023-09-13T09:38:37.312 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.0 2023-09-13T09:38:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 -- 172.21.15.6:0/148200797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c106d90 msgr2=0x7ff50c107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 --2- 172.21.15.6:0/148200797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c106d90 0x7ff50c107170 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff5080099c0 tx=0x7ff508009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 -- 172.21.15.6:0/148200797 shutdown_connections 2023-09-13T09:38:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 --2- 172.21.15.6:0/148200797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff50c101740 0x7ff50c10dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 --2- 172.21.15.6:0/148200797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c106d90 0x7ff50c107170 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 --2- 172.21.15.6:0/148200797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50c100d80 0x7ff50c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 -- 172.21.15.6:0/148200797 >> 172.21.15.6:0/148200797 conn(0x7ff50c077ea0 msgr2=0x7ff50c0782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 -- 172.21.15.6:0/148200797 shutdown_connections 2023-09-13T09:38:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 -- 172.21.15.6:0/148200797 wait complete. 2023-09-13T09:38:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 Processor -- start 2023-09-13T09:38:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.535+0000 7ff513ab1700 1 -- start start 2023-09-13T09:38:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff513ab1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c100d80 0x7ff50c196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff513ab1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff50c101740 0x7ff50c197280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff513ab1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50c106d90 0x7ff50c19b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff513ab1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c19bd00 con 0x7ff50c100d80 2023-09-13T09:38:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff513ab1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c19be70 con 0x7ff50c106d90 2023-09-13T09:38:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff513ab1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50c19c030 con 0x7ff50c101740 2023-09-13T09:38:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c100d80 0x7ff50c196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c100d80 0x7ff50c196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60764/0 (socket says 172.21.15.6:60764) 2023-09-13T09:38:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 -- 172.21.15.6:0/978254118 learned_addr learned my addr 172.21.15.6:0/978254118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51104c700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff50c101740 0x7ff50c197280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51204e700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50c106d90 0x7ff50c19b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 -- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff50c101740 msgr2=0x7ff50c197280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff50c101740 0x7ff50c197280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 -- 172.21.15.6:0/978254118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50c106d90 msgr2=0x7ff50c19b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50c106d90 0x7ff50c19b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 -- 172.21.15.6:0/978254118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5080095f0 con 0x7ff50c100d80 2023-09-13T09:38:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51204e700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff50c106d90 0x7ff50c19b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff51184d700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c100d80 0x7ff50c196d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff50800b580 tx=0x7ff5080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.536+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50801d070 con 0x7ff50c100d80 2023-09-13T09:38:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.537+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff508004010 con 0x7ff50c100d80 2023-09-13T09:38:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.537+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50c19c2b0 con 0x7ff50c100d80 2023-09-13T09:38:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.537+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508022db0 con 0x7ff50c100d80 2023-09-13T09:38:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.537+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50c1a3b70 con 0x7ff50c100d80 2023-09-13T09:38:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.537+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff50c19c580 con 0x7ff50c100d80 2023-09-13T09:38:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.539+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7ff508022470 con 0x7ff50c100d80 2023-09-13T09:38:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.539+0000 7ff4feffd700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff4f80a06d0 0x7ff4f80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.539+0000 7ff51104c700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff4f80a06d0 0x7ff4f80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.539+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff5080cda00 con 0x7ff50c100d80 2023-09-13T09:38:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.540+0000 7ff4feffd700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] conn(0x7ff4f80a9eb0 0x7ff4f80ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.540+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 --> [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4f80ac980 con 0x7ff4f80a9eb0 2023-09-13T09:38:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.540+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5080cdea0 con 0x7ff50c100d80 2023-09-13T09:38:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.540+0000 7ff51104c700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff4f80a06d0 0x7ff4f80a2b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff500005950 tx=0x7ff5000058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.540+0000 7ff51204e700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] conn(0x7ff4f80a9eb0 0x7ff4f80ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.540+0000 7ff51204e700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] conn(0x7ff4f80a9eb0 0x7ff4f80ac2d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.541+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== osd.11 v2:172.21.15.131:6824/4273429519 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff4f80ac980 con 0x7ff4f80a9eb0 2023-09-13T09:38:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.558+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 --> [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff50c110f60 con 0x7ff4f80a9eb0 2023-09-13T09:38:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.558+0000 7ff4feffd700 1 -- 172.21.15.6:0/978254118 <== osd.11 v2:172.21.15.131:6824/4273429519 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff504007ce0 con 0x7ff4f80a9eb0 2023-09-13T09:38:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] conn(0x7ff4f80a9eb0 msgr2=0x7ff4f80ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] conn(0x7ff4f80a9eb0 0x7ff4f80ac2d0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff4f80a06d0 msgr2=0x7ff4f80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff4f80a06d0 0x7ff4f80a2b90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff500005950 tx=0x7ff5000058e0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c100d80 msgr2=0x7ff50c196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 --2- 172.21.15.6:0/978254118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff50c100d80 0x7ff50c196d40 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff50800b580 tx=0x7ff5080057f0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff51204e700 1 -- 172.21.15.6:0/978254118 reap_dead start 2023-09-13T09:38:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 shutdown_connections 2023-09-13T09:38:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 >> 172.21.15.6:0/978254118 conn(0x7ff50c077ea0 msgr2=0x7ff50c104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 shutdown_connections 2023-09-13T09:38:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.559+0000 7ff513ab1700 1 -- 172.21.15.6:0/978254118 wait complete. 2023-09-13T09:38:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 -- 172.21.15.6:0/344917508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0100d80 msgr2=0x7f7ef0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 --2- 172.21.15.6:0/344917508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0100d80 0x7f7ef0101200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40099c0 tx=0x7f7ee4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 -- 172.21.15.6:0/344917508 shutdown_connections 2023-09-13T09:38:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 --2- 172.21.15.6:0/344917508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef0101740 0x7f7ef010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 --2- 172.21.15.6:0/344917508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef0106d90 0x7f7ef0107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 --2- 172.21.15.6:0/344917508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0100d80 0x7f7ef0101200 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 -- 172.21.15.6:0/344917508 >> 172.21.15.6:0/344917508 conn(0x7f7ef0077ea0 msgr2=0x7f7ef00782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.935+0000 7f7ef5e76700 1 -- 172.21.15.6:0/344917508 shutdown_connections 2023-09-13T09:38:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.936+0000 7f7ef5e76700 1 -- 172.21.15.6:0/344917508 wait complete. 2023-09-13T09:38:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.936+0000 7f7ef5e76700 1 Processor -- start 2023-09-13T09:38:37.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.936+0000 7f7ef5e76700 1 -- start start 2023-09-13T09:38:37.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7ef5e76700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef0100d80 0x7f7ef0196d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7ef5e76700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef0101740 0x7f7ef01972a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7ef5e76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0106d90 0x7f7ef019b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7ef5e76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef019bd20 con 0x7f7ef0106d90 2023-09-13T09:38:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7ef5e76700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef019be90 con 0x7f7ef0100d80 2023-09-13T09:38:37.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7ef5e76700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef019c050 con 0x7f7ef0101740 2023-09-13T09:38:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0106d90 0x7f7ef019b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0106d90 0x7f7ef019b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60784/0 (socket says 172.21.15.6:60784) 2023-09-13T09:38:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 -- 172.21.15.6:0/396368453 learned_addr learned my addr 172.21.15.6:0/396368453 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeeffd700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef0101740 0x7f7ef01972a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eef7fe700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef0100d80 0x7f7ef0196d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 -- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef0101740 msgr2=0x7f7ef01972a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef0101740 0x7f7ef01972a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 -- 172.21.15.6:0/396368453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef0100d80 msgr2=0x7f7ef0196d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef0100d80 0x7f7ef0196d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 -- 172.21.15.6:0/396368453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee40095f0 con 0x7f7ef0106d90 2023-09-13T09:38:37.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eeffff700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0106d90 0x7f7ef019b710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800ab50 tx=0x7f7ee800ae60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:37.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800f070 con 0x7f7ef0106d90 2023-09-13T09:38:37.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ee8007a80 con 0x7f7ef0106d90 2023-09-13T09:38:37.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef019c330 con 0x7f7ef0106d90 2023-09-13T09:38:37.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.937+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8005280 con 0x7f7ef0106d90 2023-09-13T09:38:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.938+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef01a3b90 con 0x7f7ef0106d90 2023-09-13T09:38:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.939+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f7ef004e9b0 con 0x7f7ef0106d90 2023-09-13T09:38:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.939+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f7ee800c620 con 0x7f7ef0106d90 2023-09-13T09:38:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.940+0000 7f7eecff9700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ed80a06d0 0x7f7ed80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.940+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7ee80cb010 con 0x7f7ef0106d90 2023-09-13T09:38:37.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.940+0000 7f7eef7fe700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ed80a06d0 0x7f7ed80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.940+0000 7f7eecff9700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] conn(0x7f7ed80a9eb0 0x7f7ed80ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.940+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 --> [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7ed80ac980 con 0x7f7ed80a9eb0 2023-09-13T09:38:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.940+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ee80cd720 con 0x7f7ef0106d90 2023-09-13T09:38:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.941+0000 7f7eef7fe700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ed80a06d0 0x7f7ed80a2b90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0005950 tx=0x7f7ee00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:37.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.941+0000 7f7eeeffd700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] conn(0x7f7ed80a9eb0 0x7f7ed80ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:37.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.941+0000 7f7eeeffd700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] conn(0x7f7ed80a9eb0 0x7f7ed80ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:37.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.942+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== osd.2 v2:172.21.15.131:6800/2103696562 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f7ed80ac980 con 0x7f7ed80a9eb0 2023-09-13T09:38:37.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.958+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 --> [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f7ef0110f50 con 0x7f7ed80a9eb0 2023-09-13T09:38:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7eecff9700 1 -- 172.21.15.6:0/396368453 <== osd.2 v2:172.21.15.131:6800/2103696562 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f7ee401e040 con 0x7f7ed80a9eb0 2023-09-13T09:38:37.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] conn(0x7f7ed80a9eb0 msgr2=0x7f7ed80ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] conn(0x7f7ed80a9eb0 0x7f7ed80ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ed80a06d0 msgr2=0x7f7ed80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ed80a06d0 0x7f7ed80a2b90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0005950 tx=0x7f7ee00058e0 comp rx=0 tx=0).stop 2023-09-13T09:38:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0106d90 msgr2=0x7f7ef019b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:37.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 --2- 172.21.15.6:0/396368453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef0106d90 0x7f7ef019b710 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800ab50 tx=0x7f7ee800ae60 comp rx=0 tx=0).stop 2023-09-13T09:38:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7eeffff700 1 -- 172.21.15.6:0/396368453 reap_dead start 2023-09-13T09:38:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 shutdown_connections 2023-09-13T09:38:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 >> 172.21.15.6:0/396368453 conn(0x7f7ef0077ea0 msgr2=0x7f7ef00ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.959+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 shutdown_connections 2023-09-13T09:38:37.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:37.960+0000 7f7ef5e76700 1 -- 172.21.15.6:0/396368453 wait complete. 2023-09-13T09:38:37.987 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:37 smithi006 ceph-mon[98665]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-09-13T09:38:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:37 smithi053 ceph-mon[102373]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-09-13T09:38:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:37 smithi131 ceph-mon[102785]: pgmap v269: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.6 KiB/s wr, 12 op/s 2023-09-13T09:38:38.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 -- 172.21.15.6:0/3464239883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 msgr2=0x7f0058068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 --2- 172.21.15.6:0/3464239883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 0x7f0058068de0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f0054009990 tx=0x7f0054009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 -- 172.21.15.6:0/3464239883 shutdown_connections 2023-09-13T09:38:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 --2- 172.21.15.6:0/3464239883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00581060b0 0x7f005810dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 --2- 172.21.15.6:0/3464239883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 0x7f0058068de0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 --2- 172.21.15.6:0/3464239883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00580693b0 0x7f0058105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 -- 172.21.15.6:0/3464239883 >> 172.21.15.6:0/3464239883 conn(0x7f0058075c00 msgr2=0x7f0058076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 -- 172.21.15.6:0/3464239883 shutdown_connections 2023-09-13T09:38:38.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 -- 172.21.15.6:0/3464239883 wait complete. 2023-09-13T09:38:38.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 Processor -- start 2023-09-13T09:38:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.312+0000 7f005f64e700 1 -- start start 2023-09-13T09:38:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005f64e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 0x7f00580ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005f64e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580693b0 0x7f0058100270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005f64e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00581060b0 0x7f00581007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005f64e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00581a5200 con 0x7f0058068a00 2023-09-13T09:38:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005f64e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00581a5370 con 0x7f00580693b0 2023-09-13T09:38:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005f64e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00581a5530 con 0x7f00581060b0 2023-09-13T09:38:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 0x7f00580ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 0x7f00580ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60796/0 (socket says 172.21.15.6:60796) 2023-09-13T09:38:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 -- 172.21.15.6:0/1381778313 learned_addr learned my addr 172.21.15.6:0/1381778313 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005cbe9700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580693b0 0x7f0058100270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 -- 172.21.15.6:0/1381778313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00581060b0 msgr2=0x7f00581007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005dbeb700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00581060b0 0x7f00581007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00581060b0 0x7f00581007f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 -- 172.21.15.6:0/1381778313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580693b0 msgr2=0x7f0058100270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580693b0 0x7f0058100270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 -- 172.21.15.6:0/1381778313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00540095f0 con 0x7f0058068a00 2023-09-13T09:38:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005cbe9700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f00580693b0 0x7f0058100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.313+0000 7f005d3ea700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 0x7f00580ffd30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0054000c00 tx=0x7f005400f830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.314+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005401d070 con 0x7f0058068a00 2023-09-13T09:38:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.314+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f005400fce0 con 0x7f0058068a00 2023-09-13T09:38:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.314+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00581a57b0 con 0x7f0058068a00 2023-09-13T09:38:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.314+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00540176e0 con 0x7f0058068a00 2023-09-13T09:38:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.314+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00581a5ca0 con 0x7f0058068a00 2023-09-13T09:38:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.315+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f005804e9b0 con 0x7f0058068a00 2023-09-13T09:38:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.316+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f0054022470 con 0x7f0058068a00 2023-09-13T09:38:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.317+0000 7f004e7fc700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00440a0750 0x7f00440a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.317+0000 7f005cbe9700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00440a0750 0x7f00440a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.317+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f00540ccfe0 con 0x7f0058068a00 2023-09-13T09:38:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.318+0000 7f004e7fc700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] conn(0x7f00440a9f30 0x7f00440ac350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.318+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 --> [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00440aca00 con 0x7f00440a9f30 2023-09-13T09:38:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.318+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00540cf6f0 con 0x7f0058068a00 2023-09-13T09:38:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.318+0000 7f005cbe9700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00440a0750 0x7f00440a2c10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0048005fd0 tx=0x7f0048005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.318+0000 7f005dbeb700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] conn(0x7f00440a9f30 0x7f00440ac350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.318+0000 7f005dbeb700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] conn(0x7f00440a9f30 0x7f00440ac350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.319+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== osd.9 v2:172.21.15.6:6826/3414335215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f00440aca00 con 0x7f00440a9f30 2023-09-13T09:38:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 --> [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0058110f70 con 0x7f00440a9f30 2023-09-13T09:38:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f004e7fc700 1 -- 172.21.15.6:0/1381778313 <== osd.9 v2:172.21.15.6:6826/3414335215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0050008b30 con 0x7f00440a9f30 2023-09-13T09:38:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] conn(0x7f00440a9f30 msgr2=0x7f00440ac350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] conn(0x7f00440a9f30 0x7f00440ac350 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00440a0750 msgr2=0x7f00440a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00440a0750 0x7f00440a2c10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f0048005fd0 tx=0x7f0048005e30 comp rx=0 tx=0).stop 2023-09-13T09:38:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 msgr2=0x7f00580ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 --2- 172.21.15.6:0/1381778313 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0058068a00 0x7f00580ffd30 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0054000c00 tx=0x7f005400f830 comp rx=0 tx=0).stop 2023-09-13T09:38:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005dbeb700 1 -- 172.21.15.6:0/1381778313 reap_dead start 2023-09-13T09:38:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 shutdown_connections 2023-09-13T09:38:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.335+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 >> 172.21.15.6:0/1381778313 conn(0x7f0058075c00 msgr2=0x7f00580fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.336+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 shutdown_connections 2023-09-13T09:38:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.336+0000 7f005f64e700 1 -- 172.21.15.6:0/1381778313 wait complete. 2023-09-13T09:38:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 -- 172.21.15.6:0/550830671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe888105c70 msgr2=0x7fe888106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 --2- 172.21.15.6:0/550830671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe888105c70 0x7fe888106050 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe8780099c0 tx=0x7fe878009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 -- 172.21.15.6:0/550830671 shutdown_connections 2023-09-13T09:38:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 --2- 172.21.15.6:0/550830671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888100620 0x7fe88810ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 --2- 172.21.15.6:0/550830671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe888105c70 0x7fe888106050 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 --2- 172.21.15.6:0/550830671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8880ffc60 0x7fe8881000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 -- 172.21.15.6:0/550830671 >> 172.21.15.6:0/550830671 conn(0x7fe888075c00 msgr2=0x7fe888076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 -- 172.21.15.6:0/550830671 shutdown_connections 2023-09-13T09:38:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.559+0000 7fe88e02f700 1 -- 172.21.15.6:0/550830671 wait complete. 2023-09-13T09:38:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 Processor -- start 2023-09-13T09:38:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 -- start start 2023-09-13T09:38:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8880ffc60 0x7fe888197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888100620 0x7fe8881980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe888105c70 0x7fe8881a2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe888198980 con 0x7fe8880ffc60 2023-09-13T09:38:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8881a3130 con 0x7fe888100620 2023-09-13T09:38:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe88e02f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8881a3270 con 0x7fe888105c70 2023-09-13T09:38:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe8877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8880ffc60 0x7fe888197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe8877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8880ffc60 0x7fe888197b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60812/0 (socket says 172.21.15.6:60812) 2023-09-13T09:38:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe8877fe700 1 -- 172.21.15.6:0/2891853219 learned_addr learned my addr 172.21.15.6:0/2891853219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.560+0000 7fe886ffd700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888100620 0x7fe8881980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe887fff700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe888105c70 0x7fe8881a2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe8877fe700 1 -- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe888105c70 msgr2=0x7fe8881a2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe8877fe700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe888105c70 0x7fe8881a2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe8877fe700 1 -- 172.21.15.6:0/2891853219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888100620 msgr2=0x7fe8881980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe8877fe700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe888100620 0x7fe8881980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe8877fe700 1 -- 172.21.15.6:0/2891853219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8780095f0 con 0x7fe8880ffc60 2023-09-13T09:38:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe8877fe700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8880ffc60 0x7fe888197b70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe87800b580 tx=0x7fe878004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87801d070 con 0x7fe8880ffc60 2023-09-13T09:38:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe8780041c0 con 0x7fe8880ffc60 2023-09-13T09:38:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8881a34f0 con 0x7fe8880ffc60 2023-09-13T09:38:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87800f460 con 0x7fe8880ffc60 2023-09-13T09:38:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.561+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8881a3900 con 0x7fe8880ffc60 2023-09-13T09:38:38.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.562+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe88804e9b0 con 0x7fe8880ffc60 2023-09-13T09:38:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.564+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fe8780225e0 con 0x7fe8880ffc60 2023-09-13T09:38:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.564+0000 7fe884ff9700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe8700a06d0 0x7fe8700a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.564+0000 7fe886ffd700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe8700a06d0 0x7fe8700a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.564+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fe8780cdb50 con 0x7fe8880ffc60 2023-09-13T09:38:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.564+0000 7fe884ff9700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] conn(0x7fe8700a9eb0 0x7fe8700ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.564+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 --> [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8700ac980 con 0x7fe8700a9eb0 2023-09-13T09:38:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.565+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe8780cdff0 con 0x7fe8880ffc60 2023-09-13T09:38:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.565+0000 7fe886ffd700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe8700a06d0 0x7fe8700a2b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe888069020 tx=0x7fe87c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.565+0000 7fe887fff700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] conn(0x7fe8700a9eb0 0x7fe8700ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.565+0000 7fe887fff700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] conn(0x7fe8700a9eb0 0x7fe8700ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.566+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== osd.8 v2:172.21.15.131:6816/2882379120 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fe8700ac980 con 0x7fe8700a9eb0 2023-09-13T09:38:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.582+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 --> [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe88810fe40 con 0x7fe8700a9eb0 2023-09-13T09:38:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe884ff9700 1 -- 172.21.15.6:0/2891853219 <== osd.8 v2:172.21.15.131:6816/2882379120 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe880007cc0 con 0x7fe8700a9eb0 2023-09-13T09:38:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] conn(0x7fe8700a9eb0 msgr2=0x7fe8700ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe88e02f700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] conn(0x7fe8700a9eb0 0x7fe8700ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe8700a06d0 msgr2=0x7fe8700a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe88e02f700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe8700a06d0 0x7fe8700a2b90 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe888069020 tx=0x7fe87c00a300 comp rx=0 tx=0).stop 2023-09-13T09:38:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8880ffc60 msgr2=0x7fe888197b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe88e02f700 1 --2- 172.21.15.6:0/2891853219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8880ffc60 0x7fe888197b70 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe87800b580 tx=0x7fe878004730 comp rx=0 tx=0).stop 2023-09-13T09:38:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.583+0000 7fe887fff700 1 -- 172.21.15.6:0/2891853219 reap_dead start 2023-09-13T09:38:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.584+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 shutdown_connections 2023-09-13T09:38:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.584+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 >> 172.21.15.6:0/2891853219 conn(0x7fe888075c00 msgr2=0x7fe888103970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.584+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 shutdown_connections 2023-09-13T09:38:38.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.584+0000 7fe88e02f700 1 -- 172.21.15.6:0/2891853219 wait complete. 2023-09-13T09:38:38.990 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:39.271 INFO:teuthology.orchestra.run.smithi006.stdout:249108103198 2023-09-13T09:38:39.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.8 2023-09-13T09:38:39.444 INFO:teuthology.orchestra.run.smithi006.stdout:339302416400 2023-09-13T09:38:39.445 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.11 2023-09-13T09:38:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 -- 172.21.15.6:0/1267565575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38100d80 msgr2=0x7f6b38101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 --2- 172.21.15.6:0/1267565575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38100d80 0x7f6b38101200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c0099c0 tx=0x7f6b2c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 -- 172.21.15.6:0/1267565575 shutdown_connections 2023-09-13T09:38:39.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 --2- 172.21.15.6:0/1267565575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b38101740 0x7f6b3810dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:39.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 --2- 172.21.15.6:0/1267565575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b38106d90 0x7f6b38107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:39.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 --2- 172.21.15.6:0/1267565575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38100d80 0x7f6b38101200 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:39.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 -- 172.21.15.6:0/1267565575 >> 172.21.15.6:0/1267565575 conn(0x7f6b38077ea0 msgr2=0x7f6b380782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:39.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 -- 172.21.15.6:0/1267565575 shutdown_connections 2023-09-13T09:38:39.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.787+0000 7f6b3e25b700 1 -- 172.21.15.6:0/1267565575 wait complete. 2023-09-13T09:38:39.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 Processor -- start 2023-09-13T09:38:39.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 -- start start 2023-09-13T09:38:39.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b38100d80 0x7f6b38072fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:39.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b38101740 0x7f6b380734f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:39.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38106d90 0x7f6b38073a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381a51f0 con 0x7f6b38106d90 2023-09-13T09:38:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381a5360 con 0x7f6b38101740 2023-09-13T09:38:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b3e25b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b381a5520 con 0x7f6b38100d80 2023-09-13T09:38:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38106d90 0x7f6b38073a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:39.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38106d90 0x7f6b38073a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60832/0 (socket says 172.21.15.6:60832) 2023-09-13T09:38:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b37fff700 1 -- 172.21.15.6:0/933971502 learned_addr learned my addr 172.21.15.6:0/933971502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.788+0000 7f6b377fe700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b38100d80 0x7f6b38072fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:39.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b36ffd700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b38101740 0x7f6b380734f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b37fff700 1 -- 172.21.15.6:0/933971502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b38100d80 msgr2=0x7f6b38072fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b37fff700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b38100d80 0x7f6b38072fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:39.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b37fff700 1 -- 172.21.15.6:0/933971502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b38101740 msgr2=0x7f6b380734f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b37fff700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6b38101740 0x7f6b380734f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b37fff700 1 -- 172.21.15.6:0/933971502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2c0095f0 con 0x7f6b38106d90 2023-09-13T09:38:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b37fff700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38106d90 0x7f6b38073a70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000cca0 tx=0x7f6b3000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:39.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3000aba0 con 0x7f6b38106d90 2023-09-13T09:38:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6b3000ad00 con 0x7f6b38106d90 2023-09-13T09:38:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b381a5800 con 0x7f6b38106d90 2023-09-13T09:38:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b300115e0 con 0x7f6b38106d90 2023-09-13T09:38:39.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.789+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b381a5cb0 con 0x7f6b38106d90 2023-09-13T09:38:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.790+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b3804e9b0 con 0x7f6b38106d90 2023-09-13T09:38:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.791+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f6b30012420 con 0x7f6b38106d90 2023-09-13T09:38:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b34ff9700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6b200a06d0 0x7f6b200a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f6b300cc1c0 con 0x7f6b38106d90 2023-09-13T09:38:39.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b377fe700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6b200a06d0 0x7f6b200a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b34ff9700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] conn(0x7f6b200a9eb0 0x7f6b200ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 --> [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b200ac980 con 0x7f6b200a9eb0 2023-09-13T09:38:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b300cc660 con 0x7f6b38106d90 2023-09-13T09:38:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b36ffd700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] conn(0x7f6b200a9eb0 0x7f6b200ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:39.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b377fe700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6b200a06d0 0x7f6b200a2b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005950 tx=0x7f6b2800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.792+0000 7f6b36ffd700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] conn(0x7f6b200a9eb0 0x7f6b200ac2d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.793+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== osd.6 v2:172.21.15.6:6818/830400555 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7f6b200ac980 con 0x7f6b200a9eb0 2023-09-13T09:38:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.809+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 --> [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b38110f50 con 0x7f6b200a9eb0 2023-09-13T09:38:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b34ff9700 1 -- 172.21.15.6:0/933971502 <== osd.6 v2:172.21.15.6:6818/830400555 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f6b2c01e040 con 0x7f6b200a9eb0 2023-09-13T09:38:39.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] conn(0x7f6b200a9eb0 msgr2=0x7f6b200ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] conn(0x7f6b200a9eb0 0x7f6b200ac2d0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6b200a06d0 msgr2=0x7f6b200a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6b200a06d0 0x7f6b200a2b90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6b28005950 tx=0x7f6b2800b410 comp rx=0 tx=0).stop 2023-09-13T09:38:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38106d90 msgr2=0x7f6b38073a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:39.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 --2- 172.21.15.6:0/933971502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b38106d90 0x7f6b38073a70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6b3000cca0 tx=0x7f6b3000a060 comp rx=0 tx=0).stop 2023-09-13T09:38:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b37fff700 1 -- 172.21.15.6:0/933971502 reap_dead start 2023-09-13T09:38:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 shutdown_connections 2023-09-13T09:38:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 >> 172.21.15.6:0/933971502 conn(0x7f6b38077ea0 msgr2=0x7f6b38104a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 shutdown_connections 2023-09-13T09:38:39.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:38.810+0000 7f6b3e25b700 1 -- 172.21.15.6:0/933971502 wait complete. 2023-09-13T09:38:39.662 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:39.681 INFO:teuthology.orchestra.run.smithi006.stdout:77309411384 2023-09-13T09:38:39.681 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.2 2023-09-13T09:38:39.860 INFO:teuthology.orchestra.run.smithi006.stdout:283467841561 2023-09-13T09:38:39.861 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.9 2023-09-13T09:38:39.882 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:40.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 -- 172.21.15.6:0/833052052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 msgr2=0x7fde0c0ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:40.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 --2- 172.21.15.6:0/833052052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 0x7fde0c0ff9c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00b0a0 tx=0x7fddfc00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 -- 172.21.15.6:0/833052052 shutdown_connections 2023-09-13T09:38:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 --2- 172.21.15.6:0/833052052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c1046c0 0x7fde0c10c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 --2- 172.21.15.6:0/833052052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 0x7fde0c0ff9c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 --2- 172.21.15.6:0/833052052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde0c0fff90 0x7fde0c103fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:40.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 -- 172.21.15.6:0/833052052 >> 172.21.15.6:0/833052052 conn(0x7fde0c076190 msgr2=0x7fde0c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 -- 172.21.15.6:0/833052052 shutdown_connections 2023-09-13T09:38:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.120+0000 7fde139a6700 1 -- 172.21.15.6:0/833052052 wait complete. 2023-09-13T09:38:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 Processor -- start 2023-09-13T09:38:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 -- start start 2023-09-13T09:38:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 0x7fde0c195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0fff90 0x7fde0c1963f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde0c1046c0 0x7fde0c19a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c19ae60 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c19afd0 con 0x7fde0c0fff90 2023-09-13T09:38:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde139a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde0c19b190 con 0x7fde0c1046c0 2023-09-13T09:38:40.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde11742700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 0x7fde0c195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:40.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde11742700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 0x7fde0c195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60842/0 (socket says 172.21.15.6:60842) 2023-09-13T09:38:40.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde11742700 1 -- 172.21.15.6:0/3437348988 learned_addr learned my addr 172.21.15.6:0/3437348988 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:40.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde11f43700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde0c1046c0 0x7fde0c19a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:40.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde10f41700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0fff90 0x7fde0c1963f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.121+0000 7fde11742700 1 -- 172.21.15.6:0/3437348988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde0c1046c0 msgr2=0x7fde0c19a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde11742700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde0c1046c0 0x7fde0c19a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde11742700 1 -- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0fff90 msgr2=0x7fde0c1963f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde11742700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0fff90 0x7fde0c1963f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde11742700 1 -- 172.21.15.6:0/3437348988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddfc009d00 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde10f41700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde0c0fff90 0x7fde0c1963f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde11742700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 0x7fde0c195eb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00b070 tx=0x7fddfc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc00e040 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fddfc003c00 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde0c19b410 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddfc01a8a0 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.122+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde0c10fe60 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.123+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde0c10f610 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.124+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fddfc004020 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.124+0000 7fde0a7fc700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fddf40a06d0 0x7fddf40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:40.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.125+0000 7fde10f41700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fddf40a06d0 0x7fddf40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:40.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.125+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fddfc0cf220 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.125+0000 7fde0a7fc700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] conn(0x7fddf40a9eb0 0x7fddf40ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:40.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.125+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 --> [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fddf40ac980 con 0x7fddf40a9eb0 2023-09-13T09:38:40.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.125+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7fddfc0d1930 con 0x7fde0c0ff5e0 2023-09-13T09:38:40.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.125+0000 7fde10f41700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fddf40a06d0 0x7fddf40a2b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde00005fd0 tx=0x7fde00005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:40.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.125+0000 7fde11f43700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] conn(0x7fddf40a9eb0 0x7fddf40ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:40.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.126+0000 7fde11f43700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] conn(0x7fddf40a9eb0 0x7fddf40ac2d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:40.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.126+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== osd.7 v2:172.21.15.53:6816/1921263469 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7fddf40ac980 con 0x7fddf40a9eb0 2023-09-13T09:38:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.142+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 --> [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fde0c04e9b0 con 0x7fddf40a9eb0 2023-09-13T09:38:40.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde0a7fc700 1 -- 172.21.15.6:0/3437348988 <== osd.7 v2:172.21.15.53:6816/1921263469 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fde0c04e9b0 con 0x7fddf40a9eb0 2023-09-13T09:38:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] conn(0x7fddf40a9eb0 msgr2=0x7fddf40ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] conn(0x7fddf40a9eb0 0x7fddf40ac2d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fddf40a06d0 msgr2=0x7fddf40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:40.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fddf40a06d0 0x7fddf40a2b90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fde00005fd0 tx=0x7fde00005e30 comp rx=0 tx=0).stop 2023-09-13T09:38:40.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 msgr2=0x7fde0c195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:40.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 --2- 172.21.15.6:0/3437348988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde0c0ff5e0 0x7fde0c195eb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fddfc00b070 tx=0x7fddfc00cf90 comp rx=0 tx=0).stop 2023-09-13T09:38:40.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde11f43700 1 -- 172.21.15.6:0/3437348988 reap_dead start 2023-09-13T09:38:40.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 shutdown_connections 2023-09-13T09:38:40.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.143+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 >> 172.21.15.6:0/3437348988 conn(0x7fde0c076190 msgr2=0x7fde0c103740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:40.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.144+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 shutdown_connections 2023-09-13T09:38:40.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:40.144+0000 7fde139a6700 1 -- 172.21.15.6:0/3437348988 wait complete. 2023-09-13T09:38:40.167 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:39 smithi006 ceph-mon[98665]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2023-09-13T09:38:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:39 smithi053 ceph-mon[102373]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2023-09-13T09:38:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:39 smithi131 ceph-mon[102785]: pgmap v270: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 255 B/s wr, 9 op/s 2023-09-13T09:38:40.412 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:40.967 INFO:teuthology.orchestra.run.smithi006.stdout:214748364834 2023-09-13T09:38:40.968 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.7 2023-09-13T09:38:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 -- 172.21.15.6:0/486292975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700687a0 msgr2=0x7ff970068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 --2- 172.21.15.6:0/486292975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700687a0 0x7ff970068b80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff964009990 tx=0x7ff964009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:41.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 -- 172.21.15.6:0/486292975 shutdown_connections 2023-09-13T09:38:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 --2- 172.21.15.6:0/486292975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff97010d810 0x7ff97010fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 --2- 172.21.15.6:0/486292975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700687a0 0x7ff970068b80 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 --2- 172.21.15.6:0/486292975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9700690c0 0x7ff97010d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 -- 172.21.15.6:0/486292975 >> 172.21.15.6:0/486292975 conn(0x7ff970075c00 msgr2=0x7ff970076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:41.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 -- 172.21.15.6:0/486292975 shutdown_connections 2023-09-13T09:38:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.064+0000 7ff9771cb700 1 -- 172.21.15.6:0/486292975 wait complete. 2023-09-13T09:38:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 Processor -- start 2023-09-13T09:38:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 -- start start 2023-09-13T09:38:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9700687a0 0x7ff970199030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:41.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700690c0 0x7ff970199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:41.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff97010d810 0x7ff97019d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:41.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97019dff0 con 0x7ff9700690c0 2023-09-13T09:38:41.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97019e160 con 0x7ff9700687a0 2023-09-13T09:38:41.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff9771cb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff97019e320 con 0x7ff97010d810 2023-09-13T09:38:41.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700690c0 0x7ff970199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:41.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff974f67700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9700687a0 0x7ff970199030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:41.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff96ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700690c0 0x7ff970199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60858/0 (socket says 172.21.15.6:60858) 2023-09-13T09:38:41.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.065+0000 7ff96ffff700 1 -- 172.21.15.6:0/3794214876 learned_addr learned my addr 172.21.15.6:0/3794214876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:41.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff975768700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff97010d810 0x7ff97019d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96ffff700 1 -- 172.21.15.6:0/3794214876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff97010d810 msgr2=0x7ff97019d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96ffff700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff97010d810 0x7ff97019d9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96ffff700 1 -- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9700687a0 msgr2=0x7ff970199030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96ffff700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9700687a0 0x7ff970199030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:41.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96ffff700 1 -- 172.21.15.6:0/3794214876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9640095f0 con 0x7ff9700690c0 2023-09-13T09:38:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff974f67700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff9700687a0 0x7ff970199030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:38:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96ffff700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700690c0 0x7ff970199570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b530 tx=0x7ff95c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c011830 con 0x7ff9700690c0 2023-09-13T09:38:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff97019e600 con 0x7ff9700690c0 2023-09-13T09:38:41.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff95c011e50 con 0x7ff9700690c0 2023-09-13T09:38:41.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff95c00f2e0 con 0x7ff9700690c0 2023-09-13T09:38:41.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.066+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9701a5e60 con 0x7ff9700690c0 2023-09-13T09:38:41.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.067+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff970113160 con 0x7ff9700690c0 2023-09-13T09:38:41.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.069+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7ff95c0105a0 con 0x7ff9700690c0 2023-09-13T09:38:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff96dffb700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff9600a06d0 0x7ff9600a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff95c0cbbc0 con 0x7ff9700690c0 2023-09-13T09:38:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff974f67700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff9600a06d0 0x7ff9600a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff96dffb700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] conn(0x7ff9600a9eb0 0x7ff9600ac2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:41.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 --> [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff9600ac980 con 0x7ff9600a9eb0 2023-09-13T09:38:41.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff95c0cbf30 con 0x7ff9700690c0 2023-09-13T09:38:41.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff974f67700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff9600a06d0 0x7ff9600a2b90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff96400b5c0 tx=0x7ff964005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:41.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.070+0000 7ff975768700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] conn(0x7ff9600a9eb0 0x7ff9600ac2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:41.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.071+0000 7ff975768700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] conn(0x7ff9600a9eb0 0x7ff9600ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:41.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.072+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== osd.10 v2:172.21.15.53:6824/382405178 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25607 (crc 0 0 0) 0x7ff9600ac980 con 0x7ff9600a9eb0 2023-09-13T09:38:41.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.088+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 --> [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff97004e9b0 con 0x7ff9600a9eb0 2023-09-13T09:38:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.088+0000 7ff96dffb700 1 -- 172.21.15.6:0/3794214876 <== osd.10 v2:172.21.15.53:6824/382405178 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff97004e9b0 con 0x7ff9600a9eb0 2023-09-13T09:38:41.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] conn(0x7ff9600a9eb0 msgr2=0x7ff9600ac2d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] conn(0x7ff9600a9eb0 0x7ff9600ac2d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff9600a06d0 msgr2=0x7ff9600a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff9600a06d0 0x7ff9600a2b90 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff96400b5c0 tx=0x7ff964005960 comp rx=0 tx=0).stop 2023-09-13T09:38:41.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700690c0 msgr2=0x7ff970199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 --2- 172.21.15.6:0/3794214876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9700690c0 0x7ff970199570 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7ff95c00b530 tx=0x7ff95c00b840 comp rx=0 tx=0).stop 2023-09-13T09:38:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff975768700 1 -- 172.21.15.6:0/3794214876 reap_dead start 2023-09-13T09:38:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 shutdown_connections 2023-09-13T09:38:41.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 >> 172.21.15.6:0/3794214876 conn(0x7ff970075c00 msgr2=0x7ff97010ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:41.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 shutdown_connections 2023-09-13T09:38:41.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:41.089+0000 7ff9771cb700 1 -- 172.21.15.6:0/3794214876 wait complete. 2023-09-13T09:38:41.430 INFO:teuthology.orchestra.run.smithi006.stdout:193273528359 2023-09-13T09:38:41.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.6 2023-09-13T09:38:41.854 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:41 smithi006 ceph-mon[98665]: pgmap v271: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2023-09-13T09:38:42.007 INFO:teuthology.orchestra.run.smithi006.stdout:304942678039 2023-09-13T09:38:42.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph osd last-stat-seq osd.10 2023-09-13T09:38:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:41 smithi053 ceph-mon[102373]: pgmap v271: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2023-09-13T09:38:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:41 smithi131 ceph-mon[102785]: pgmap v271: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 255 B/s wr, 10 op/s 2023-09-13T09:38:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:43.310 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 -- 172.21.15.6:0/2450228026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 msgr2=0x7fdcf0107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/2450228026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf0107170 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fdce00099c0 tx=0x7fdce0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 -- 172.21.15.6:0/2450228026 shutdown_connections 2023-09-13T09:38:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/2450228026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcf0101740 0x7fdcf010dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/2450228026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf0107170 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/2450228026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcf0100d80 0x7fdcf0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 -- 172.21.15.6:0/2450228026 >> 172.21.15.6:0/2450228026 conn(0x7fdcf0077ea0 msgr2=0x7fdcf00782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 -- 172.21.15.6:0/2450228026 shutdown_connections 2023-09-13T09:38:43.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.331+0000 7fdcf5b07700 1 -- 172.21.15.6:0/2450228026 wait complete. 2023-09-13T09:38:43.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.332+0000 7fdcf5b07700 1 Processor -- start 2023-09-13T09:38:43.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.332+0000 7fdcf5b07700 1 -- start start 2023-09-13T09:38:43.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdcf5b07700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcf0100d80 0x7fdcf0196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdcf5b07700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcf0101740 0x7fdcf01971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdcf5b07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdcf5b07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf019aba0 con 0x7fdcf0106d90 2023-09-13T09:38:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdcf5b07700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf019ad10 con 0x7fdcf0100d80 2023-09-13T09:38:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdcf5b07700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcf019aed0 con 0x7fdcf0101740 2023-09-13T09:38:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60876/0 (socket says 172.21.15.6:60876) 2023-09-13T09:38:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 -- 172.21.15.6:0/1081039658 learned_addr learned my addr 172.21.15.6:0/1081039658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceeffd700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcf0101740 0x7fdcf01971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdcef7fe700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcf0100d80 0x7fdcf0196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 -- 172.21.15.6:0/1081039658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcf0101740 msgr2=0x7fdcf01971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcf0101740 0x7fdcf01971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 -- 172.21.15.6:0/1081039658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcf0100d80 msgr2=0x7fdcf0196ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcf0100d80 0x7fdcf0196ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 -- 172.21.15.6:0/1081039658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce00095f0 con 0x7fdcf0106d90 2023-09-13T09:38:43.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.333+0000 7fdceffff700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf019a5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdce800cca0 tx=0x7fdce800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:43.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.334+0000 7fdcecff9700 1 -- 172.21.15.6:0/1081039658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce800aba0 con 0x7fdcf0106d90 2023-09-13T09:38:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.334+0000 7fdcecff9700 1 -- 172.21.15.6:0/1081039658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdce800ad00 con 0x7fdcf0106d90 2023-09-13T09:38:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.334+0000 7fdcecff9700 1 -- 172.21.15.6:0/1081039658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdce80115e0 con 0x7fdcf0106d90 2023-09-13T09:38:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.334+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcf019b1b0 con 0x7fdcf0106d90 2023-09-13T09:38:43.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.334+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcf01a3b00 con 0x7fdcf0106d90 2023-09-13T09:38:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.335+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcf004e9b0 con 0x7fdcf0106d90 2023-09-13T09:38:43.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.337+0000 7fdcecff9700 1 -- 172.21.15.6:0/1081039658 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fdce8012420 con 0x7fdcf0106d90 2023-09-13T09:38:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.338+0000 7fdcecff9700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdcd80a06d0 0x7fdcd80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.338+0000 7fdcecff9700 1 -- 172.21.15.6:0/1081039658 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdce80cc160 con 0x7fdcf0106d90 2023-09-13T09:38:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.339+0000 7fdcef7fe700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdcd80a06d0 0x7fdcd80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.340+0000 7fdcef7fe700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdcd80a06d0 0x7fdcd80a2b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdce0000c00 tx=0x7fdce0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:43.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.345+0000 7fdcecff9700 1 -- 172.21.15.6:0/1081039658 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fdce8095cf0 con 0x7fdcf0106d90 2023-09-13T09:38:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 -- 172.21.15.6:0/2089164064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 msgr2=0x7f076810dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 --2- 172.21.15.6:0/2089164064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f076810dbb0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f076000b0d0 tx=0x7f076000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 -- 172.21.15.6:0/2089164064 shutdown_connections 2023-09-13T09:38:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 --2- 172.21.15.6:0/2089164064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f076810dbb0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 --2- 172.21.15.6:0/2089164064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0768106d90 0x7f0768107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 --2- 172.21.15.6:0/2089164064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0768100d80 0x7f0768101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 -- 172.21.15.6:0/2089164064 >> 172.21.15.6:0/2089164064 conn(0x7f0768077ea0 msgr2=0x7f07680782b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:43.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 -- 172.21.15.6:0/2089164064 shutdown_connections 2023-09-13T09:38:43.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.511+0000 7f076dd4a700 1 -- 172.21.15.6:0/2089164064 wait complete. 2023-09-13T09:38:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.512+0000 7f076dd4a700 1 Processor -- start 2023-09-13T09:38:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.512+0000 7f076dd4a700 1 -- start start 2023-09-13T09:38:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.512+0000 7f076dd4a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0768100d80 0x7f0768196e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.512+0000 7f076dd4a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f0768197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.512+0000 7f076dd4a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0768106d90 0x7f076819b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f076dd4a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076819be00 con 0x7f0768101740 2023-09-13T09:38:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f076dd4a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076819bf70 con 0x7f0768106d90 2023-09-13T09:38:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f076dd4a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f076819c130 con 0x7f0768100d80 2023-09-13T09:38:43.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f0768197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f0768197380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60890/0 (socket says 172.21.15.6:60890) 2023-09-13T09:38:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 -- 172.21.15.6:0/319308551 learned_addr learned my addr 172.21.15.6:0/319308551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f07677fe700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0768100d80 0x7f0768196e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0767fff700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0768106d90 0x7f076819b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 -- 172.21.15.6:0/319308551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0768100d80 msgr2=0x7f0768196e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0768100d80 0x7f0768196e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 -- 172.21.15.6:0/319308551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0768106d90 msgr2=0x7f076819b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0768106d90 0x7f076819b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 -- 172.21.15.6:0/319308551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0760009d00 con 0x7f0768101740 2023-09-13T09:38:43.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0767fff700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0768106d90 0x7f076819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0766ffd700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f0768197380 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f075c00d950 tx=0x7f075c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.513+0000 7f0764ff9700 1 -- 172.21.15.6:0/319308551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c009940 con 0x7f0768101740 2023-09-13T09:38:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.514+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f076819c410 con 0x7f0768101740 2023-09-13T09:38:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.514+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07681a3c70 con 0x7f0768101740 2023-09-13T09:38:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.514+0000 7f0764ff9700 1 -- 172.21.15.6:0/319308551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f075c010460 con 0x7f0768101740 2023-09-13T09:38:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.514+0000 7f0764ff9700 1 -- 172.21.15.6:0/319308551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075c00f620 con 0x7f0768101740 2023-09-13T09:38:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.516+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0754005320 con 0x7f0768101740 2023-09-13T09:38:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.516+0000 7f0764ff9700 1 -- 172.21.15.6:0/319308551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f075c009aa0 con 0x7f0768101740 2023-09-13T09:38:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.516+0000 7f0764ff9700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07500a0750 0x7f07500a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.517+0000 7f07677fe700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07500a0750 0x7f07500a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.517+0000 7f0764ff9700 1 -- 172.21.15.6:0/319308551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f075c0cbc40 con 0x7f0768101740 2023-09-13T09:38:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.517+0000 7f07677fe700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07500a0750 0x7f07500a2c10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0758009c60 tx=0x7f0758009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.521+0000 7f0764ff9700 1 -- 172.21.15.6:0/319308551 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f075c0957c0 con 0x7f0768101740 2023-09-13T09:38:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.566+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdcf0197fc0 con 0x7fdcf0106d90 2023-09-13T09:38:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.566+0000 7fdcecff9700 1 -- 172.21.15.6:0/1081039658 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fdce8099310 con 0x7fdcf0106d90 2023-09-13T09:38:43.567 INFO:teuthology.orchestra.run.smithi006.stdout:137438953520 2023-09-13T09:38:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdcd80a06d0 msgr2=0x7fdcd80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdcd80a06d0 0x7fdcd80a2b90 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fdce0000c00 tx=0x7fdce0005fb0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 msgr2=0x7fdcf019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf019a5a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdce800cca0 tx=0x7fdce800a060 comp rx=0 tx=0).stop 2023-09-13T09:38:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 shutdown_connections 2023-09-13T09:38:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdcd80a06d0 0x7fdcd80a2b90 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdcf0106d90 0x7fdcf019a5a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdcf0100d80 0x7fdcf0196ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.568+0000 7fdcf5b07700 1 --2- 172.21.15.6:0/1081039658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcf0101740 0x7fdcf01971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.569+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 >> 172.21.15.6:0/1081039658 conn(0x7fdcf0077ea0 msgr2=0x7fdcf00ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.569+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 shutdown_connections 2023-09-13T09:38:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.569+0000 7fdcf5b07700 1 -- 172.21.15.6:0/1081039658 wait complete. 2023-09-13T09:38:43.604 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:43.605 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:43.607 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:43.610 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:43.610 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:43.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.785+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f07540058a0 con 0x7f0768101740 2023-09-13T09:38:43.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.786+0000 7f0764ff9700 1 -- 172.21.15.6:0/319308551 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f075c098de0 con 0x7f0768101740 2023-09-13T09:38:43.786 INFO:teuthology.orchestra.run.smithi006.stdout:55834574909 2023-09-13T09:38:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07500a0750 msgr2=0x7f07500a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07500a0750 0x7f07500a2c10 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0758009c60 tx=0x7f0758009260 comp rx=0 tx=0).stop 2023-09-13T09:38:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 msgr2=0x7f0768197380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f0768197380 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f075c00d950 tx=0x7f075c00dc60 comp rx=0 tx=0).stop 2023-09-13T09:38:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 shutdown_connections 2023-09-13T09:38:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0768106d90 0x7f076819b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0768100d80 0x7f0768196e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f07500a0750 0x7f07500a2c10 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 --2- 172.21.15.6:0/319308551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0768101740 0x7f0768197380 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 >> 172.21.15.6:0/319308551 conn(0x7f0768077ea0 msgr2=0x7f07680ff8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 shutdown_connections 2023-09-13T09:38:43.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.788+0000 7f076dd4a700 1 -- 172.21.15.6:0/319308551 wait complete. 2023-09-13T09:38:43.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 -- 172.21.15.6:0/2340151669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80106120 msgr2=0x7fed8010dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 --2- 172.21.15.6:0/2340151669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80106120 0x7fed8010dc60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fed7800b0d0 tx=0x7fed7800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 -- 172.21.15.6:0/2340151669 shutdown_connections 2023-09-13T09:38:43.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 --2- 172.21.15.6:0/2340151669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80106120 0x7fed8010dc60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 --2- 172.21.15.6:0/2340151669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed80069320 0x7fed80069700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 --2- 172.21.15.6:0/2340151669 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed80069cd0 0x7fed801059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 -- 172.21.15.6:0/2340151669 >> 172.21.15.6:0/2340151669 conn(0x7fed80076af0 msgr2=0x7fed80076f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:43.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.796+0000 7fed86c96700 1 -- 172.21.15.6:0/2340151669 shutdown_connections 2023-09-13T09:38:43.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 -- 172.21.15.6:0/2340151669 wait complete. 2023-09-13T09:38:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 Processor -- start 2023-09-13T09:38:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 -- start start 2023-09-13T09:38:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed80069320 0x7fed800fff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80069cd0 0x7fed80100470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed80106120 0x7fed801009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed801a53e0 con 0x7fed80069cd0 2023-09-13T09:38:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed801a5550 con 0x7fed80069320 2023-09-13T09:38:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.797+0000 7fed86c96700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed801a5710 con 0x7fed80106120 2023-09-13T09:38:43.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80069cd0 0x7fed80100470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80069cd0 0x7fed80100470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60902/0 (socket says 172.21.15.6:60902) 2023-09-13T09:38:43.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 -- 172.21.15.6:0/1086433289 learned_addr learned my addr 172.21.15.6:0/1086433289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:43.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed85233700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed80106120 0x7fed801009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed84a32700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed80069320 0x7fed800fff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 -- 172.21.15.6:0/1086433289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed80106120 msgr2=0x7fed801009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed80106120 0x7fed801009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 -- 172.21.15.6:0/1086433289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed80069320 msgr2=0x7fed800fff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:43.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed80069320 0x7fed800fff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:43.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 -- 172.21.15.6:0/1086433289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78009d00 con 0x7fed80069cd0 2023-09-13T09:38:43.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7ffff700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80069cd0 0x7fed80100470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00d950 tx=0x7fed6c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7dffb700 1 -- 172.21.15.6:0/1086433289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c00f890 con 0x7fed80069cd0 2023-09-13T09:38:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed801a59f0 con 0x7fed80069cd0 2023-09-13T09:38:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7dffb700 1 -- 172.21.15.6:0/1086433289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fed6c010460 con 0x7fed80069cd0 2023-09-13T09:38:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.798+0000 7fed7dffb700 1 -- 172.21.15.6:0/1086433289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6c00e610 con 0x7fed80069cd0 2023-09-13T09:38:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.799+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed801a5f40 con 0x7fed80069cd0 2023-09-13T09:38:43.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.800+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8004e9b0 con 0x7fed80069cd0 2023-09-13T09:38:43.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.801+0000 7fed7dffb700 1 -- 172.21.15.6:0/1086433289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fed6c010860 con 0x7fed80069cd0 2023-09-13T09:38:43.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.802+0000 7fed7dffb700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fed700a06d0 0x7fed700a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:43.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.802+0000 7fed84a32700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fed700a06d0 0x7fed700a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:43.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.802+0000 7fed7dffb700 1 -- 172.21.15.6:0/1086433289 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fed6c0cb570 con 0x7fed80069cd0 2023-09-13T09:38:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.802+0000 7fed84a32700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fed700a06d0 0x7fed700a2b90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed74005950 tx=0x7fed7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:43.805+0000 7fed7dffb700 1 -- 172.21.15.6:0/1086433289 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fed6c0950f0 con 0x7fed80069cd0 2023-09-13T09:38:43.971 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:43 smithi006 ceph-mon[98665]: pgmap v272: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2023-09-13T09:38:43.971 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:43 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1081039658' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-13T09:38:43.971 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:43 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/319308551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-13T09:38:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.029+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fed80110f90 con 0x7fed80069cd0 2023-09-13T09:38:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.030+0000 7fed7dffb700 1 -- 172.21.15.6:0/1086433289 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fed6c017020 con 0x7fed80069cd0 2023-09-13T09:38:44.031 INFO:teuthology.orchestra.run.smithi006.stdout:158913789996 2023-09-13T09:38:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fed700a06d0 msgr2=0x7fed700a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fed700a06d0 0x7fed700a2b90 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fed74005950 tx=0x7fed7400b410 comp rx=0 tx=0).stop 2023-09-13T09:38:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80069cd0 msgr2=0x7fed80100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80069cd0 0x7fed80100470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00d950 tx=0x7fed6c00dc60 comp rx=0 tx=0).stop 2023-09-13T09:38:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 shutdown_connections 2023-09-13T09:38:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed80106120 0x7fed801009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fed80069320 0x7fed800fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fed700a06d0 0x7fed700a2b90 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 --2- 172.21.15.6:0/1086433289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fed80069cd0 0x7fed80100470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 >> 172.21.15.6:0/1086433289 conn(0x7fed80076af0 msgr2=0x7fed800fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 shutdown_connections 2023-09-13T09:38:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.032+0000 7fed86c96700 1 -- 172.21.15.6:0/1086433289 wait complete. 2023-09-13T09:38:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 -- 172.21.15.6:0/346849966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069a10 msgr2=0x7fb7c010dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/346849966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069a10 0x7fb7c010dbc0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb7b800b0a0 tx=0x7fb7b800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 -- 172.21.15.6:0/346849966 shutdown_connections 2023-09-13T09:38:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/346849966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069a10 0x7fb7c010dbc0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/346849966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7c0106d80 0x7fb7c0107160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/346849966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c0069070 0x7fb7c00694d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 -- 172.21.15.6:0/346849966 >> 172.21.15.6:0/346849966 conn(0x7fb7c0076bc0 msgr2=0x7fb7c0076fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:44.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 -- 172.21.15.6:0/346849966 shutdown_connections 2023-09-13T09:38:44.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.007+0000 7fb7c66f3700 1 -- 172.21.15.6:0/346849966 wait complete. 2023-09-13T09:38:44.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 Processor -- start 2023-09-13T09:38:44.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 -- start start 2023-09-13T09:38:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069070 0x7fb7c00ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7c0069a10 0x7fb7c01001e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c0106d80 0x7fb7c0100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c01a52a0 con 0x7fb7c0069070 2023-09-13T09:38:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c01a5410 con 0x7fb7c0106d80 2023-09-13T09:38:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.008+0000 7fb7c66f3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c01a55d0 con 0x7fb7c0069a10 2023-09-13T09:38:44.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069070 0x7fb7c00ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:44.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069070 0x7fb7c00ffca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60912/0 (socket says 172.21.15.6:60912) 2023-09-13T09:38:44.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 -- 172.21.15.6:0/3868811356 learned_addr learned my addr 172.21.15.6:0/3868811356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:44.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bf7fe700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7c0069a10 0x7fb7c01001e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:44.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7c4c90700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c0106d80 0x7fb7c0100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:44.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 -- 172.21.15.6:0/3868811356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7c0069a10 msgr2=0x7fb7c01001e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:44.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7c0069a10 0x7fb7c01001e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 -- 172.21.15.6:0/3868811356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c0106d80 msgr2=0x7fb7c0100760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:44.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c0106d80 0x7fb7c0100760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 -- 172.21.15.6:0/3868811356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b8009d00 con 0x7fb7c0069070 2023-09-13T09:38:44.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bffff700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069070 0x7fb7c00ffca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c920 tx=0x7fb7b000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:44.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bd7fa700 1 -- 172.21.15.6:0/3868811356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0004a30 con 0x7fb7c0069070 2023-09-13T09:38:44.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bd7fa700 1 -- 172.21.15.6:0/3868811356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7b00054e0 con 0x7fb7c0069070 2023-09-13T09:38:44.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c01a58b0 con 0x7fb7c0069070 2023-09-13T09:38:44.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7bd7fa700 1 -- 172.21.15.6:0/3868811356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7b0007bd0 con 0x7fb7c0069070 2023-09-13T09:38:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.009+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c01a5db0 con 0x7fb7c0069070 2023-09-13T09:38:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.011+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c004e9b0 con 0x7fb7c0069070 2023-09-13T09:38:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.012+0000 7fb7bd7fa700 1 -- 172.21.15.6:0/3868811356 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fb7b0005000 con 0x7fb7c0069070 2023-09-13T09:38:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.012+0000 7fb7bd7fa700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7a80a06d0 0x7fb7a80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:44.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.012+0000 7fb7bf7fe700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7a80a06d0 0x7fb7a80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.012+0000 7fb7bd7fa700 1 -- 172.21.15.6:0/3868811356 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb7b00cb650 con 0x7fb7c0069070 2023-09-13T09:38:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.013+0000 7fb7bf7fe700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7a80a06d0 0x7fb7a80a2b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0101490 tx=0x7fb7b400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:44.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.017+0000 7fb7bd7fa700 1 -- 172.21.15.6:0/3868811356 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb7b00951d0 con 0x7fb7c0069070 2023-09-13T09:38:44.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.236+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb7c0110e80 con 0x7fb7c0069070 2023-09-13T09:38:44.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.236+0000 7fb7bd7fa700 1 -- 172.21.15.6:0/3868811356 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fb7b00987f0 con 0x7fb7c0069070 2023-09-13T09:38:44.237 INFO:teuthology.orchestra.run.smithi006.stdout:107374182452 2023-09-13T09:38:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7a80a06d0 msgr2=0x7fb7a80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7a80a06d0 0x7fb7a80a2b90 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fb7c0101490 tx=0x7fb7b400a380 comp rx=0 tx=0).stop 2023-09-13T09:38:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069070 msgr2=0x7fb7c00ffca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069070 0x7fb7c00ffca0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb7b000c920 tx=0x7fb7b000cc30 comp rx=0 tx=0).stop 2023-09-13T09:38:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 shutdown_connections 2023-09-13T09:38:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb7c0106d80 0x7fb7c0100760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7a80a06d0 0x7fb7a80a2b90 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c0069070 0x7fb7c00ffca0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 --2- 172.21.15.6:0/3868811356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7c0069a10 0x7fb7c01001e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.239+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 >> 172.21.15.6:0/3868811356 conn(0x7fb7c0076bc0 msgr2=0x7fb7c00fe680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.240+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 shutdown_connections 2023-09-13T09:38:44.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:44.240+0000 7fb7c66f3700 1 -- 172.21.15.6:0/3868811356 wait complete. 2023-09-13T09:38:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:43 smithi053 ceph-mon[102373]: pgmap v272: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2023-09-13T09:38:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:43 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1081039658' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-13T09:38:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:43 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/319308551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-13T09:38:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:43 smithi131 ceph-mon[102785]: pgmap v272: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 255 B/s wr, 12 op/s 2023-09-13T09:38:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:43 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1081039658' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-09-13T09:38:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:43 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/319308551' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-09-13T09:38:45.147 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:44 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1086433289' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-13T09:38:45.148 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:44 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3868811356' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-13T09:38:45.177 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953518 got 137438953520 for osd.4 2023-09-13T09:38:45.178 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:45.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:44 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1086433289' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-13T09:38:45.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:44 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3868811356' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-13T09:38:45.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:44 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1086433289' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-09-13T09:38:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:44 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3868811356' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-09-13T09:38:45.958 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:45 smithi006 ceph-mon[98665]: pgmap v273: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-09-13T09:38:45.993 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:45 smithi053 ceph-mon[102373]: pgmap v273: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-09-13T09:38:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:45 smithi131 ceph-mon[102785]: pgmap v273: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 255 B/s wr, 9 op/s 2023-09-13T09:38:46.495 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789994 got 158913789996 for osd.5 2023-09-13T09:38:46.496 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:46.598 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182450 got 107374182452 for osd.3 2023-09-13T09:38:46.598 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:46.811 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574907 got 55834574909 for osd.1 2023-09-13T09:38:46.811 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:46.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 -- 172.21.15.6:0/3910629239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc105c70 msgr2=0x7f42cc106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:46.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 --2- 172.21.15.6:0/3910629239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc105c70 0x7f42cc106050 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f42c00099c0 tx=0x7f42c0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:46.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 -- 172.21.15.6:0/3910629239 shutdown_connections 2023-09-13T09:38:46.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 --2- 172.21.15.6:0/3910629239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42cc100620 0x7f42cc10ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:46.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 --2- 172.21.15.6:0/3910629239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc105c70 0x7f42cc106050 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:46.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 --2- 172.21.15.6:0/3910629239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42cc0ffc60 0x7f42cc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 -- 172.21.15.6:0/3910629239 >> 172.21.15.6:0/3910629239 conn(0x7f42cc075c00 msgr2=0x7f42cc076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 -- 172.21.15.6:0/3910629239 shutdown_connections 2023-09-13T09:38:46.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.946+0000 7f42d30ef700 1 -- 172.21.15.6:0/3910629239 wait complete. 2023-09-13T09:38:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 Processor -- start 2023-09-13T09:38:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 -- start start 2023-09-13T09:38:46.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42cc0ffc60 0x7f42cc197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc100620 0x7f42cc1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42cc105c70 0x7f42cc1a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc198b00 con 0x7f42cc100620 2023-09-13T09:38:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc1a3270 con 0x7f42cc105c70 2023-09-13T09:38:46.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d30ef700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42cc1a33e0 con 0x7f42cc0ffc60 2023-09-13T09:38:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc100620 0x7f42cc1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc100620 0x7f42cc1981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60928/0 (socket says 172.21.15.6:60928) 2023-09-13T09:38:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42cbfff700 1 -- 172.21.15.6:0/1687563016 learned_addr learned my addr 172.21.15.6:0/1687563016 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:46.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d0e8b700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42cc0ffc60 0x7f42cc197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:46.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42d168c700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42cc105c70 0x7f42cc1a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:46.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.947+0000 7f42cbfff700 1 -- 172.21.15.6:0/1687563016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42cc0ffc60 msgr2=0x7f42cc197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:46.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42cbfff700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42cc0ffc60 0x7f42cc197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:46.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42cbfff700 1 -- 172.21.15.6:0/1687563016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42cc105c70 msgr2=0x7f42cc1a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:46.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42cbfff700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42cc105c70 0x7f42cc1a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:46.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42cbfff700 1 -- 172.21.15.6:0/1687563016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c00095f0 con 0x7f42cc100620 2023-09-13T09:38:46.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42d168c700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42cc105c70 0x7f42cc1a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:46.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42cbfff700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc100620 0x7f42cc1981f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c920 tx=0x7f42b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:46.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42c9ffb700 1 -- 172.21.15.6:0/1687563016 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8007b00 con 0x7f42cc100620 2023-09-13T09:38:46.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42c9ffb700 1 -- 172.21.15.6:0/1687563016 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42b800ce70 con 0x7f42cc100620 2023-09-13T09:38:46.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42cc1a36c0 con 0x7f42cc100620 2023-09-13T09:38:46.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42c9ffb700 1 -- 172.21.15.6:0/1687563016 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80054e0 con 0x7f42cc100620 2023-09-13T09:38:46.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.948+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42cc1a3c10 con 0x7f42cc100620 2023-09-13T09:38:46.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.950+0000 7f42c9ffb700 1 -- 172.21.15.6:0/1687563016 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f42b8004750 con 0x7f42cc100620 2023-09-13T09:38:46.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.950+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42cc04e9b0 con 0x7f42cc100620 2023-09-13T09:38:46.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.951+0000 7f42c9ffb700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42bc0a0750 0x7f42bc0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:46.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.951+0000 7f42d0e8b700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42bc0a0750 0x7f42bc0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.951+0000 7f42c9ffb700 1 -- 172.21.15.6:0/1687563016 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f42b80cb7b0 con 0x7f42cc100620 2023-09-13T09:38:46.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.951+0000 7f42d0e8b700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42bc0a0750 0x7f42bc0a2c10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42c0000c00 tx=0x7f42c0005c40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:46.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:46.955+0000 7f42c9ffb700 1 -- 172.21.15.6:0/1687563016 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f42b8095230 con 0x7f42cc100620 2023-09-13T09:38:47.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.163+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f42cc10fc10 con 0x7f42cc100620 2023-09-13T09:38:47.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.163+0000 7f42c9ffb700 1 -- 172.21.15.6:0/1687563016 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f42b8098850 con 0x7f42cc100620 2023-09-13T09:38:47.164 INFO:teuthology.orchestra.run.smithi006.stdout:339302416402 2023-09-13T09:38:47.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42bc0a0750 msgr2=0x7f42bc0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:47.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42bc0a0750 0x7f42bc0a2c10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f42c0000c00 tx=0x7f42c0005c40 comp rx=0 tx=0).stop 2023-09-13T09:38:47.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc100620 msgr2=0x7f42cc1981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:47.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc100620 0x7f42cc1981f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c920 tx=0x7f42b800cc30 comp rx=0 tx=0).stop 2023-09-13T09:38:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 shutdown_connections 2023-09-13T09:38:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42cc105c70 0x7f42cc1a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42cc0ffc60 0x7f42cc197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42bc0a0750 0x7f42bc0a2c10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:47.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 --2- 172.21.15.6:0/1687563016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42cc100620 0x7f42cc1981f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 >> 172.21.15.6:0/1687563016 conn(0x7f42cc075c00 msgr2=0x7f42cc0fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 shutdown_connections 2023-09-13T09:38:47.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:47.166+0000 7f42d30ef700 1 -- 172.21.15.6:0/1687563016 wait complete. 2023-09-13T09:38:47.994 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:47 smithi006 ceph-mon[98665]: pgmap v274: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2023-09-13T09:38:47.995 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:47 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1687563016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-13T09:38:48.008 INFO:tasks.cephadm.ceph_manager.ceph:need seq 339302416400 got 339302416402 for osd.11 2023-09-13T09:38:48.008 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:47 smithi053 ceph-mon[102373]: pgmap v274: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2023-09-13T09:38:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:47 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1687563016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-13T09:38:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:47 smithi131 ceph-mon[102785]: pgmap v274: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 255 B/s wr, 11 op/s 2023-09-13T09:38:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:47 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1687563016' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-09-13T09:38:49.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 -- 172.21.15.6:0/2005928969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890105c70 msgr2=0x7fd890106050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:49.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 --2- 172.21.15.6:0/2005928969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890105c70 0x7fd890106050 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd8800099c0 tx=0x7fd880009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:49.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 -- 172.21.15.6:0/2005928969 shutdown_connections 2023-09-13T09:38:49.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 --2- 172.21.15.6:0/2005928969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd890100620 0x7fd89010ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:49.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 --2- 172.21.15.6:0/2005928969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd890105c70 0x7fd890106050 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:49.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 --2- 172.21.15.6:0/2005928969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd8900ffc60 0x7fd8901000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:49.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 -- 172.21.15.6:0/2005928969 >> 172.21.15.6:0/2005928969 conn(0x7fd890075c00 msgr2=0x7fd890076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:49.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 -- 172.21.15.6:0/2005928969 shutdown_connections 2023-09-13T09:38:49.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.824+0000 7fd895e17700 1 -- 172.21.15.6:0/2005928969 wait complete. 2023-09-13T09:38:49.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 Processor -- start 2023-09-13T09:38:49.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 -- start start 2023-09-13T09:38:49.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900ffc60 0x7fd890197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd890100620 0x7fd8901981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd890105c70 0x7fd8901a2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd890198b00 con 0x7fd8900ffc60 2023-09-13T09:38:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8901a3270 con 0x7fd890100620 2023-09-13T09:38:49.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd895e17700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8901a33e0 con 0x7fd890105c70 2023-09-13T09:38:49.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd88f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900ffc60 0x7fd890197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:49.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd88f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900ffc60 0x7fd890197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60938/0 (socket says 172.21.15.6:60938) 2023-09-13T09:38:49.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd88f7fe700 1 -- 172.21.15.6:0/833146112 learned_addr learned my addr 172.21.15.6:0/833146112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:49.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd88effd700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd890100620 0x7fd8901981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:49.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.825+0000 7fd88ffff700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd890105c70 0x7fd8901a2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88f7fe700 1 -- 172.21.15.6:0/833146112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd890105c70 msgr2=0x7fd8901a2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88f7fe700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd890105c70 0x7fd8901a2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88f7fe700 1 -- 172.21.15.6:0/833146112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd890100620 msgr2=0x7fd8901981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88f7fe700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd890100620 0x7fd8901981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:49.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88f7fe700 1 -- 172.21.15.6:0/833146112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8800095f0 con 0x7fd8900ffc60 2023-09-13T09:38:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88f7fe700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900ffc60 0x7fd890197cb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd880009990 tx=0x7fd880009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88cff9700 1 -- 172.21.15.6:0/833146112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88001d070 con 0x7fd8900ffc60 2023-09-13T09:38:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88cff9700 1 -- 172.21.15.6:0/833146112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd880004cb0 con 0x7fd8900ffc60 2023-09-13T09:38:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8901a3660 con 0x7fd8900ffc60 2023-09-13T09:38:49.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd88cff9700 1 -- 172.21.15.6:0/833146112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd880003b30 con 0x7fd8900ffc60 2023-09-13T09:38:49.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.826+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8901a3a70 con 0x7fd8900ffc60 2023-09-13T09:38:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.827+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89004e9b0 con 0x7fd8900ffc60 2023-09-13T09:38:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.828+0000 7fd88cff9700 1 -- 172.21.15.6:0/833146112 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd8800047f0 con 0x7fd8900ffc60 2023-09-13T09:38:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.829+0000 7fd88cff9700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd8780a06d0 0x7fd8780a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.829+0000 7fd88effd700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd8780a06d0 0x7fd8780a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:49.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.829+0000 7fd88cff9700 1 -- 172.21.15.6:0/833146112 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd8800cc980 con 0x7fd8900ffc60 2023-09-13T09:38:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.829+0000 7fd88effd700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd8780a06d0 0x7fd8780a2b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd890069050 tx=0x7fd88400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:49.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:49.833+0000 7fd88cff9700 1 -- 172.21.15.6:0/833146112 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd8800966b0 con 0x7fd8900ffc60 2023-09-13T09:38:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.048+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fd89010fc80 con 0x7fd8900ffc60 2023-09-13T09:38:50.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.048+0000 7fd88cff9700 1 -- 172.21.15.6:0/833146112 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd880026020 con 0x7fd8900ffc60 2023-09-13T09:38:50.050 INFO:teuthology.orchestra.run.smithi006.stdout:77309411386 2023-09-13T09:38:50.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd8780a06d0 msgr2=0x7fd8780a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd8780a06d0 0x7fd8780a2b90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd890069050 tx=0x7fd88400b410 comp rx=0 tx=0).stop 2023-09-13T09:38:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900ffc60 msgr2=0x7fd890197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900ffc60 0x7fd890197cb0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fd880009990 tx=0x7fd880009580 comp rx=0 tx=0).stop 2023-09-13T09:38:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 shutdown_connections 2023-09-13T09:38:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd890105c70 0x7fd8901a2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd8780a06d0 0x7fd8780a2b90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8900ffc60 0x7fd890197cb0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 --2- 172.21.15.6:0/833146112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd890100620 0x7fd8901981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 >> 172.21.15.6:0/833146112 conn(0x7fd890075c00 msgr2=0x7fd8900fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 shutdown_connections 2023-09-13T09:38:50.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.051+0000 7fd895e17700 1 -- 172.21.15.6:0/833146112 wait complete. 2023-09-13T09:38:50.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 -- 172.21.15.6:0/711057425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 msgr2=0x7f0e28103fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/711057425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28103fe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c009990 tx=0x7f0e1c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 -- 172.21.15.6:0/711057425 shutdown_connections 2023-09-13T09:38:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/711057425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e281046c0 0x7f0e2810c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/711057425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e280ff5e0 0x7f0e280ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/711057425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28103fe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 -- 172.21.15.6:0/711057425 >> 172.21.15.6:0/711057425 conn(0x7f0e28076190 msgr2=0x7f0e280fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 -- 172.21.15.6:0/711057425 shutdown_connections 2023-09-13T09:38:50.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.067+0000 7f0e2cd14700 1 -- 172.21.15.6:0/711057425 wait complete. 2023-09-13T09:38:50.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.068+0000 7f0e2cd14700 1 Processor -- start 2023-09-13T09:38:50.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.068+0000 7f0e2cd14700 1 -- start start 2023-09-13T09:38:50.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e2cd14700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e280ff5e0 0x7f0e28196df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e2cd14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e2cd14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e281046c0 0x7f0e2819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e2cd14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2819bdb0 con 0x7f0e280fff90 2023-09-13T09:38:50.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e2cd14700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2819bf20 con 0x7f0e281046c0 2023-09-13T09:38:50.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e2cd14700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2819c0e0 con 0x7f0e280ff5e0 2023-09-13T09:38:50.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60954/0 (socket says 172.21.15.6:60954) 2023-09-13T09:38:50.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 -- 172.21.15.6:0/295968701 learned_addr learned my addr 172.21.15.6:0/295968701 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:50.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e2659c700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e280ff5e0 0x7f0e28196df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e26d9d700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e281046c0 0x7f0e2819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 -- 172.21.15.6:0/295968701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e280ff5e0 msgr2=0x7f0e28196df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e280ff5e0 0x7f0e28196df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 -- 172.21.15.6:0/295968701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e281046c0 msgr2=0x7f0e2819b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e281046c0 0x7f0e2819b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e25d9b700 1 -- 172.21.15.6:0/295968701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e1c0095f0 con 0x7f0e280fff90 2023-09-13T09:38:50.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.069+0000 7f0e26d9d700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e281046c0 0x7f0e2819b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:50.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.070+0000 7f0e25d9b700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28197330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b2e0 tx=0x7f0e1c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:50.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.070+0000 7f0e177fe700 1 -- 172.21.15.6:0/295968701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c01d070 con 0x7f0e280fff90 2023-09-13T09:38:50.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.070+0000 7f0e177fe700 1 -- 172.21.15.6:0/295968701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e1c005030 con 0x7f0e280fff90 2023-09-13T09:38:50.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.070+0000 7f0e177fe700 1 -- 172.21.15.6:0/295968701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1c004b40 con 0x7f0e280fff90 2023-09-13T09:38:50.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.070+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2819c360 con 0x7f0e280fff90 2023-09-13T09:38:50.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.070+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e281a3a50 con 0x7f0e280fff90 2023-09-13T09:38:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.071+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2804e9b0 con 0x7f0e280fff90 2023-09-13T09:38:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.074+0000 7f0e177fe700 1 -- 172.21.15.6:0/295968701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f0e1c005430 con 0x7f0e280fff90 2023-09-13T09:38:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.075+0000 7f0e177fe700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e100a06d0 0x7f0e100a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.075+0000 7f0e177fe700 1 -- 172.21.15.6:0/295968701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0e1c0cd080 con 0x7f0e280fff90 2023-09-13T09:38:50.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.075+0000 7f0e2659c700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e100a06d0 0x7f0e100a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.075+0000 7f0e2659c700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e100a06d0 0x7f0e100a2b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e18005950 tx=0x7f0e1800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:50.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.081+0000 7f0e177fe700 1 -- 172.21.15.6:0/295968701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0e1c096c10 con 0x7f0e280fff90 2023-09-13T09:38:50.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.097+0000 7fbc49c61700 1 -- 172.21.15.6:0/700040218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 msgr2=0x7fbc44105970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.097+0000 7fbc49c61700 1 --2- 172.21.15.6:0/700040218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 0x7fbc44105970 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbc380098f0 tx=0x7fbc38009c00 comp rx=0 tx=0).stop 2023-09-13T09:38:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.097+0000 7fbc49c61700 1 -- 172.21.15.6:0/700040218 shutdown_connections 2023-09-13T09:38:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.097+0000 7fbc49c61700 1 --2- 172.21.15.6:0/700040218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44106050 0x7fbc4410dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.097+0000 7fbc49c61700 1 --2- 172.21.15.6:0/700040218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc44100f70 0x7fbc44101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.097+0000 7fbc49c61700 1 --2- 172.21.15.6:0/700040218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 0x7fbc44105970 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.097+0000 7fbc49c61700 1 -- 172.21.15.6:0/700040218 >> 172.21.15.6:0/700040218 conn(0x7fbc440fc820 msgr2=0x7fbc440fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.098+0000 7fbc49c61700 1 -- 172.21.15.6:0/700040218 shutdown_connections 2023-09-13T09:38:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.098+0000 7fbc49c61700 1 -- 172.21.15.6:0/700040218 wait complete. 2023-09-13T09:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 Processor -- start 2023-09-13T09:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 -- start start 2023-09-13T09:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44100f70 0x7fbc4419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 0x7fbc4419af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc44106050 0x7fbc44194a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc441950f0 con 0x7fbc44106050 2023-09-13T09:38:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44195260 con 0x7fbc44100f70 2023-09-13T09:38:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.099+0000 7fbc49c61700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44195420 con 0x7fbc44101920 2023-09-13T09:38:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44100f70 0x7fbc4419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc44106050 0x7fbc44194a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44100f70 0x7fbc4419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:54490/0 (socket says 172.21.15.6:54490) 2023-09-13T09:38:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 -- 172.21.15.6:0/4113114253 learned_addr learned my addr 172.21.15.6:0/4113114253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc42ffd700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 0x7fbc4419af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 -- 172.21.15.6:0/4113114253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 msgr2=0x7fbc4419af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 0x7fbc4419af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 -- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc44106050 msgr2=0x7fbc44194a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc44106050 0x7fbc44194a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 -- 172.21.15.6:0/4113114253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc38009520 con 0x7fbc44100f70 2023-09-13T09:38:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc43fff700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc44106050 0x7fbc44194a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:38:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.100+0000 7fbc437fe700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44100f70 0x7fbc4419aa00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400e9c0 tx=0x7fbc3400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.101+0000 7fbc40ff9700 1 -- 172.21.15.6:0/4113114253 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3400cbd0 con 0x7fbc44100f70 2023-09-13T09:38:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.101+0000 7fbc40ff9700 1 -- 172.21.15.6:0/4113114253 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc3400eeb0 con 0x7fbc44100f70 2023-09-13T09:38:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.101+0000 7fbc40ff9700 1 -- 172.21.15.6:0/4113114253 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34005580 con 0x7fbc44100f70 2023-09-13T09:38:50.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.101+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc44195700 con 0x7fbc44100f70 2023-09-13T09:38:50.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.101+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc441a19f0 con 0x7fbc44100f70 2023-09-13T09:38:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.102+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4404e9b0 con 0x7fbc44100f70 2023-09-13T09:38:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.103+0000 7fbc40ff9700 1 -- 172.21.15.6:0/4113114253 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fbc34004750 con 0x7fbc44100f70 2023-09-13T09:38:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.103+0000 7fbc40ff9700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc2c0a0750 0x7fbc2c0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.104+0000 7fbc40ff9700 1 -- 172.21.15.6:0/4113114253 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fbc34014070 con 0x7fbc44100f70 2023-09-13T09:38:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.104+0000 7fbc42ffd700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc2c0a0750 0x7fbc2c0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.104+0000 7fbc42ffd700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc2c0a0750 0x7fbc2c0a2c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbc380098c0 tx=0x7fbc38019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:50.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.107+0000 7fbc40ff9700 1 -- 172.21.15.6:0/4113114253 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbc34096080 con 0x7fbc44100f70 2023-09-13T09:38:50.123 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:49 smithi006 ceph-mon[98665]: pgmap v275: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:38:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:49 smithi053 ceph-mon[102373]: pgmap v275: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:38:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:49 smithi131 ceph-mon[102785]: pgmap v275: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:38:50.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.315+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f0e28110e30 con 0x7f0e280fff90 2023-09-13T09:38:50.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.315+0000 7f0e177fe700 1 -- 172.21.15.6:0/295968701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0e1c09a230 con 0x7f0e280fff90 2023-09-13T09:38:50.317 INFO:teuthology.orchestra.run.smithi006.stdout:283467841563 2023-09-13T09:38:50.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e100a06d0 msgr2=0x7f0e100a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e100a06d0 0x7f0e100a2b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0e18005950 tx=0x7f0e1800b410 comp rx=0 tx=0).stop 2023-09-13T09:38:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 msgr2=0x7f0e28197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28197330 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f0e1c00b2e0 tx=0x7f0e1c004730 comp rx=0 tx=0).stop 2023-09-13T09:38:50.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 shutdown_connections 2023-09-13T09:38:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0e281046c0 0x7f0e2819b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e280ff5e0 0x7f0e28196df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e100a06d0 0x7f0e100a2b90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 --2- 172.21.15.6:0/295968701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0e280fff90 0x7f0e28197330 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.317+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 >> 172.21.15.6:0/295968701 conn(0x7f0e28076190 msgr2=0x7f0e28102f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.318+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 shutdown_connections 2023-09-13T09:38:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.318+0000 7f0e2cd14700 1 -- 172.21.15.6:0/295968701 wait complete. 2023-09-13T09:38:50.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.327+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbc4410ec10 con 0x7fbc44100f70 2023-09-13T09:38:50.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.327+0000 7fbc40ff9700 1 -- 172.21.15.6:0/4113114253 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fbc340996a0 con 0x7fbc44100f70 2023-09-13T09:38:50.328 INFO:teuthology.orchestra.run.smithi006.stdout:193273528361 2023-09-13T09:38:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc2c0a0750 msgr2=0x7fbc2c0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc2c0a0750 0x7fbc2c0a2c10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbc380098c0 tx=0x7fbc38019040 comp rx=0 tx=0).stop 2023-09-13T09:38:50.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44100f70 msgr2=0x7fbc4419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44100f70 0x7fbc4419aa00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400e9c0 tx=0x7fbc3400ecd0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 shutdown_connections 2023-09-13T09:38:50.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc2c0a0750 0x7fbc2c0a2c10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc44106050 0x7fbc44194a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc44100f70 0x7fbc4419aa00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 --2- 172.21.15.6:0/4113114253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc44101920 0x7fbc4419af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.329+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 >> 172.21.15.6:0/4113114253 conn(0x7fbc440fc820 msgr2=0x7fbc440fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:50.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.330+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 shutdown_connections 2023-09-13T09:38:50.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.330+0000 7fbc49c61700 1 -- 172.21.15.6:0/4113114253 wait complete. 2023-09-13T09:38:50.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 -- 172.21.15.6:0/2635959521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 msgr2=0x7f7b48068de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/2635959521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b48068de0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7b38009990 tx=0x7f7b38009ca0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 -- 172.21.15.6:0/2635959521 shutdown_connections 2023-09-13T09:38:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/2635959521 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b481060b0 0x7f7b4810dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/2635959521 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b48068de0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/2635959521 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b480693b0 0x7f7b48105980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 -- 172.21.15.6:0/2635959521 >> 172.21.15.6:0/2635959521 conn(0x7f7b48075c00 msgr2=0x7f7b48076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 -- 172.21.15.6:0/2635959521 shutdown_connections 2023-09-13T09:38:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 -- 172.21.15.6:0/2635959521 wait complete. 2023-09-13T09:38:50.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.500+0000 7f7b4f20f700 1 Processor -- start 2023-09-13T09:38:50.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4f20f700 1 -- start start 2023-09-13T09:38:50.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4f20f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b480ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4f20f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b480693b0 0x7f7b48100270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4f20f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b481060b0 0x7f7b481007f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4f20f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b481a5290 con 0x7f7b48068a00 2023-09-13T09:38:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4f20f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b481a5400 con 0x7f7b481060b0 2023-09-13T09:38:50.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4f20f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b481a55c0 con 0x7f7b480693b0 2023-09-13T09:38:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b480ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b480ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60980/0 (socket says 172.21.15.6:60980) 2023-09-13T09:38:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 -- 172.21.15.6:0/3488884662 learned_addr learned my addr 172.21.15.6:0/3488884662 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b47fff700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b480693b0 0x7f7b48100270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4d7ac700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b481060b0 0x7f7b481007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 -- 172.21.15.6:0/3488884662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b480693b0 msgr2=0x7f7b48100270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b480693b0 0x7f7b48100270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 -- 172.21.15.6:0/3488884662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b481060b0 msgr2=0x7f7b481007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b481060b0 0x7f7b481007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 -- 172.21.15.6:0/3488884662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b380095f0 con 0x7f7b48068a00 2023-09-13T09:38:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4d7ac700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b481060b0 0x7f7b481007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b4cfab700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b480ffd30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b38000c00 tx=0x7f7b3800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.501+0000 7f7b45ffb700 1 -- 172.21.15.6:0/3488884662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3801d070 con 0x7f7b48068a00 2023-09-13T09:38:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.502+0000 7f7b45ffb700 1 -- 172.21.15.6:0/3488884662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7b3800fc20 con 0x7f7b48068a00 2023-09-13T09:38:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.502+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b481a5840 con 0x7f7b48068a00 2023-09-13T09:38:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.502+0000 7f7b45ffb700 1 -- 172.21.15.6:0/3488884662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b38017650 con 0x7f7b48068a00 2023-09-13T09:38:50.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.502+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b481a5ce0 con 0x7f7b48068a00 2023-09-13T09:38:50.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.503+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4804e9b0 con 0x7f7b48068a00 2023-09-13T09:38:50.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.504+0000 7f7b45ffb700 1 -- 172.21.15.6:0/3488884662 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f7b38021410 con 0x7f7b48068a00 2023-09-13T09:38:50.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.505+0000 7f7b45ffb700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7b340a06d0 0x7f7b340a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:50.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.505+0000 7f7b45ffb700 1 -- 172.21.15.6:0/3488884662 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7b380cd890 con 0x7f7b48068a00 2023-09-13T09:38:50.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.505+0000 7f7b47fff700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7b340a06d0 0x7f7b340a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.506+0000 7f7b47fff700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7b340a06d0 0x7f7b340a2b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b48101520 tx=0x7f7b30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.508+0000 7f7b45ffb700 1 -- 172.21.15.6:0/3488884662 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7b380973a0 con 0x7f7b48068a00 2023-09-13T09:38:50.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.718+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f7b48101260 con 0x7f7b48068a00 2023-09-13T09:38:50.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.718+0000 7f7b45ffb700 1 -- 172.21.15.6:0/3488884662 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7b3809a9c0 con 0x7f7b48068a00 2023-09-13T09:38:50.719 INFO:teuthology.orchestra.run.smithi006.stdout:214748364836 2023-09-13T09:38:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7b340a06d0 msgr2=0x7f7b340a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7b340a06d0 0x7f7b340a2b90 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f7b48101520 tx=0x7f7b30009260 comp rx=0 tx=0).stop 2023-09-13T09:38:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 msgr2=0x7f7b480ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b480ffd30 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7b38000c00 tx=0x7f7b3800f510 comp rx=0 tx=0).stop 2023-09-13T09:38:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 shutdown_connections 2023-09-13T09:38:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7b481060b0 0x7f7b481007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7b340a06d0 0x7f7b340a2b90 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7b48068a00 0x7f7b480ffd30 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 --2- 172.21.15.6:0/3488884662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b480693b0 0x7f7b48100270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:50.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 >> 172.21.15.6:0/3488884662 conn(0x7f7b48075c00 msgr2=0x7f7b480fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 shutdown_connections 2023-09-13T09:38:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:50.720+0000 7f7b4f20f700 1 -- 172.21.15.6:0/3488884662 wait complete. 2023-09-13T09:38:51.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 -- 172.21.15.6:0/759333984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6020100620 msgr2=0x7f602010ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 --2- 172.21.15.6:0/759333984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6020100620 0x7f602010ca90 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f601800b0d0 tx=0x7f601800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 -- 172.21.15.6:0/759333984 shutdown_connections 2023-09-13T09:38:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 --2- 172.21.15.6:0/759333984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6020100620 0x7f602010ca90 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 --2- 172.21.15.6:0/759333984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020105c70 0x7f6020106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 --2- 172.21.15.6:0/759333984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f60200ffc60 0x7f60201000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 -- 172.21.15.6:0/759333984 >> 172.21.15.6:0/759333984 conn(0x7f6020075c00 msgr2=0x7f6020076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 -- 172.21.15.6:0/759333984 shutdown_connections 2023-09-13T09:38:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.050+0000 7f6025ba9700 1 -- 172.21.15.6:0/759333984 wait complete. 2023-09-13T09:38:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 Processor -- start 2023-09-13T09:38:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 -- start start 2023-09-13T09:38:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60200ffc60 0x7f6020197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6020100620 0x7f60201982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020105c70 0x7f60201a2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020198bd0 con 0x7f60200ffc60 2023-09-13T09:38:51.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201a3340 con 0x7f6020100620 2023-09-13T09:38:51.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f6025ba9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201a34b0 con 0x7f6020105c70 2023-09-13T09:38:51.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60200ffc60 0x7f6020197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f601f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60200ffc60 0x7f6020197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60994/0 (socket says 172.21.15.6:60994) 2023-09-13T09:38:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f601f7fe700 1 -- 172.21.15.6:0/1789949766 learned_addr learned my addr 172.21.15.6:0/1789949766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f601effd700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6020100620 0x7f60201982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.051+0000 7f601ffff700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020105c70 0x7f60201a2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601f7fe700 1 -- 172.21.15.6:0/1789949766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020105c70 msgr2=0x7f60201a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601f7fe700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020105c70 0x7f60201a2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601f7fe700 1 -- 172.21.15.6:0/1789949766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6020100620 msgr2=0x7f60201982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601f7fe700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6020100620 0x7f60201982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601f7fe700 1 -- 172.21.15.6:0/1789949766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009d00 con 0x7f60200ffc60 2023-09-13T09:38:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601f7fe700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60200ffc60 0x7f6020197d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6010007f10 tx=0x7f6010009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601cff9700 1 -- 172.21.15.6:0/1789949766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010018070 con 0x7f60200ffc60 2023-09-13T09:38:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6020195c90 con 0x7f60200ffc60 2023-09-13T09:38:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601cff9700 1 -- 172.21.15.6:0/1789949766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6010013e10 con 0x7f60200ffc60 2023-09-13T09:38:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f601cff9700 1 -- 172.21.15.6:0/1789949766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010004e60 con 0x7f60200ffc60 2023-09-13T09:38:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.052+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6020196190 con 0x7f60200ffc60 2023-09-13T09:38:51.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.053+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602004e9b0 con 0x7f60200ffc60 2023-09-13T09:38:51.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.054+0000 7f601cff9700 1 -- 172.21.15.6:0/1789949766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f601001c070 con 0x7f60200ffc60 2023-09-13T09:38:51.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.055+0000 7f601cff9700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60080a06d0 0x7f60080a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.055+0000 7f601effd700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60080a06d0 0x7f60080a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.055+0000 7f601cff9700 1 -- 172.21.15.6:0/1789949766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f60100d2fd0 con 0x7f60200ffc60 2023-09-13T09:38:51.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.056+0000 7f601effd700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60080a06d0 0x7f60080a2b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6020069050 tx=0x7f6014009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:51.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.060+0000 7f601cff9700 1 -- 172.21.15.6:0/1789949766 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f601009cb50 con 0x7f60200ffc60 2023-09-13T09:38:51.229 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:50 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/833146112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-13T09:38:51.230 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:50 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/295968701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-13T09:38:51.230 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:50 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4113114253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-13T09:38:51.230 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:50 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3488884662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-13T09:38:51.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:50 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/833146112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-13T09:38:51.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:50 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/295968701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-13T09:38:51.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:50 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4113114253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-13T09:38:51.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:50 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3488884662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-13T09:38:51.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:50 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/833146112' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-09-13T09:38:51.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:50 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/295968701' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-09-13T09:38:51.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:50 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4113114253' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-09-13T09:38:51.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:50 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3488884662' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-09-13T09:38:51.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.275+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f6020068d90 con 0x7f60200ffc60 2023-09-13T09:38:51.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.275+0000 7f601cff9700 1 -- 172.21.15.6:0/1789949766 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f60100a0170 con 0x7f60200ffc60 2023-09-13T09:38:51.279 INFO:teuthology.orchestra.run.smithi006.stdout:304942678040 2023-09-13T09:38:51.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60080a06d0 msgr2=0x7f60080a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60080a06d0 0x7f60080a2b90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6020069050 tx=0x7f6014009260 comp rx=0 tx=0).stop 2023-09-13T09:38:51.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60200ffc60 msgr2=0x7f6020197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60200ffc60 0x7f6020197d80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f6010007f10 tx=0x7f6010009520 comp rx=0 tx=0).stop 2023-09-13T09:38:51.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 shutdown_connections 2023-09-13T09:38:51.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6020105c70 0x7f60201a2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60080a06d0 0x7f60080a2b90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60200ffc60 0x7f6020197d80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 --2- 172.21.15.6:0/1789949766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6020100620 0x7f60201982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 >> 172.21.15.6:0/1789949766 conn(0x7f6020075c00 msgr2=0x7f60200fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:51.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 shutdown_connections 2023-09-13T09:38:51.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.277+0000 7f6025ba9700 1 -- 172.21.15.6:0/1789949766 wait complete. 2023-09-13T09:38:51.307 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411384 got 77309411386 for osd.2 2023-09-13T09:38:51.307 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:51.499 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841561 got 283467841563 for osd.9 2023-09-13T09:38:51.500 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:51.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.165+0000 7f484c64d700 1 -- 172.21.15.6:0/3917488288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48440ffc60 msgr2=0x7f48441000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.165+0000 7f484c64d700 1 --2- 172.21.15.6:0/3917488288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48440ffc60 0x7f48441000e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f48340099c0 tx=0x7f4834009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 -- 172.21.15.6:0/3917488288 shutdown_connections 2023-09-13T09:38:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 --2- 172.21.15.6:0/3917488288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844100620 0x7f484410ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 --2- 172.21.15.6:0/3917488288 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4844105c70 0x7f4844106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 --2- 172.21.15.6:0/3917488288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48440ffc60 0x7f48441000e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 -- 172.21.15.6:0/3917488288 >> 172.21.15.6:0/3917488288 conn(0x7f4844075c00 msgr2=0x7f4844076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 -- 172.21.15.6:0/3917488288 shutdown_connections 2023-09-13T09:38:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 -- 172.21.15.6:0/3917488288 wait complete. 2023-09-13T09:38:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 Processor -- start 2023-09-13T09:38:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 -- start start 2023-09-13T09:38:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48440ffc60 0x7f4844195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844100620 0x7f48441962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4844105c70 0x7f484419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.166+0000 7f484c64d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484419ad20 con 0x7f4844105c70 2023-09-13T09:38:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484c64d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484419ae90 con 0x7f48440ffc60 2023-09-13T09:38:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484c64d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484419b050 con 0x7f4844100620 2023-09-13T09:38:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4844105c70 0x7f484419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4844105c70 0x7f484419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32780/0 (socket says 172.21.15.6:32780) 2023-09-13T09:38:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 -- 172.21.15.6:0/4148613591 learned_addr learned my addr 172.21.15.6:0/4148613591 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484a3e9700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48440ffc60 0x7f4844195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f4849be8700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844100620 0x7f48441962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 -- 172.21.15.6:0/4148613591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844100620 msgr2=0x7f48441962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844100620 0x7f48441962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 -- 172.21.15.6:0/4148613591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48440ffc60 msgr2=0x7f4844195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48440ffc60 0x7f4844195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 -- 172.21.15.6:0/4148613591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48340095f0 con 0x7f4844105c70 2023-09-13T09:38:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f4849be8700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844100620 0x7f48441962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484abea700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4844105c70 0x7f484419a710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f483c007ee0 tx=0x7f483c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f483b7fe700 1 -- 172.21.15.6:0/4148613591 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c017070 con 0x7f4844105c70 2023-09-13T09:38:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484419b330 con 0x7f4844105c70 2023-09-13T09:38:51.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f483b7fe700 1 -- 172.21.15.6:0/4148613591 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f483c00f040 con 0x7f4844105c70 2023-09-13T09:38:51.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f483b7fe700 1 -- 172.21.15.6:0/4148613591 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c005740 con 0x7f4844105c70 2023-09-13T09:38:51.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.167+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48441a2b90 con 0x7f4844105c70 2023-09-13T09:38:51.577 INFO:teuthology.orchestra.run.smithi006.stdout:34359738435 2023-09-13T09:38:51.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.169+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484404e9b0 con 0x7f4844105c70 2023-09-13T09:38:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.169+0000 7f483b7fe700 1 -- 172.21.15.6:0/4148613591 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f483c0058a0 con 0x7f4844105c70 2023-09-13T09:38:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.170+0000 7f483b7fe700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48300a06d0 0x7f48300a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.170+0000 7f484a3e9700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48300a06d0 0x7f48300a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.170+0000 7f483b7fe700 1 -- 172.21.15.6:0/4148613591 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f483c0cb410 con 0x7f4844105c70 2023-09-13T09:38:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.171+0000 7f484a3e9700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48300a06d0 0x7f48300a2b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4840009bd0 tx=0x7f4840009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.175+0000 7f483b7fe700 1 -- 172.21.15.6:0/4148613591 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f483c094f90 con 0x7f4844105c70 2023-09-13T09:38:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.386+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f484410fb70 con 0x7f4844105c70 2023-09-13T09:38:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.387+0000 7f483b7fe700 1 -- 172.21.15.6:0/4148613591 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f483c0985b0 con 0x7f4844105c70 2023-09-13T09:38:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48300a06d0 msgr2=0x7f48300a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48300a06d0 0x7f48300a2b90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f4840009bd0 tx=0x7f4840009260 comp rx=0 tx=0).stop 2023-09-13T09:38:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4844105c70 msgr2=0x7f484419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4844105c70 0x7f484419a710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f483c007ee0 tx=0x7f483c00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 shutdown_connections 2023-09-13T09:38:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48300a06d0 0x7f48300a2b90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4844105c70 0x7f484419a710 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48440ffc60 0x7f4844195d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 --2- 172.21.15.6:0/4148613591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4844100620 0x7f48441962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 >> 172.21.15.6:0/4148613591 conn(0x7f4844075c00 msgr2=0x7f48440fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 shutdown_connections 2023-09-13T09:38:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:51.389+0000 7f484c64d700 1 -- 172.21.15.6:0/4148613591 wait complete. 2023-09-13T09:38:51.707 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364834 got 214748364836 for osd.7 2023-09-13T09:38:51.708 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:51.973 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528359 got 193273528361 for osd.6 2023-09-13T09:38:51.973 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:52.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:51 smithi006 ceph-mon[98665]: pgmap v276: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:38:52.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:51 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1789949766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-13T09:38:52.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:51 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4148613591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-13T09:38:52.132 INFO:tasks.cephadm.ceph_manager.ceph:need seq 304942678039 got 304942678040 for osd.10 2023-09-13T09:38:52.133 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:51 smithi053 ceph-mon[102373]: pgmap v276: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:38:52.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:51 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1789949766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-13T09:38:52.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:51 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4148613591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-13T09:38:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:51 smithi131 ceph-mon[102785]: pgmap v276: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:38:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:51 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1789949766' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-09-13T09:38:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:51 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4148613591' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-09-13T09:38:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.295+0000 7fd670718700 1 -- 172.21.15.6:0/2163922177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 msgr2=0x7fd66810ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:52.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.295+0000 7fd670718700 1 --2- 172.21.15.6:0/2163922177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd66810ca90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd66000b0d0 tx=0x7fd66000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 -- 172.21.15.6:0/2163922177 shutdown_connections 2023-09-13T09:38:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 --2- 172.21.15.6:0/2163922177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd66810ca90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 --2- 172.21.15.6:0/2163922177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd668105c70 0x7fd668106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 --2- 172.21.15.6:0/2163922177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6680ffc60 0x7fd6681000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 -- 172.21.15.6:0/2163922177 >> 172.21.15.6:0/2163922177 conn(0x7fd668075c00 msgr2=0x7fd668076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 -- 172.21.15.6:0/2163922177 shutdown_connections 2023-09-13T09:38:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 -- 172.21.15.6:0/2163922177 wait complete. 2023-09-13T09:38:52.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 Processor -- start 2023-09-13T09:38:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 -- start start 2023-09-13T09:38:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.296+0000 7fd670718700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6680ffc60 0x7fd668196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd670718700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd6681973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd670718700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd668105c70 0x7fd66819b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:52.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd670718700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66819be30 con 0x7fd668100620 2023-09-13T09:38:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd670718700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66819bfa0 con 0x7fd668105c70 2023-09-13T09:38:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd670718700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd66819c160 con 0x7fd6680ffc60 2023-09-13T09:38:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd6681973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:52.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd6681973b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32792/0 (socket says 172.21.15.6:32792) 2023-09-13T09:38:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 -- 172.21.15.6:0/2627297614 learned_addr learned my addr 172.21.15.6:0/2627297614 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66e4b4700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6680ffc60 0x7fd668196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66ecb5700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd668105c70 0x7fd66819b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 -- 172.21.15.6:0/2627297614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6680ffc60 msgr2=0x7fd668196e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:52.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6680ffc60 0x7fd668196e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 -- 172.21.15.6:0/2627297614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd668105c70 msgr2=0x7fd66819b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd668105c70 0x7fd66819b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 -- 172.21.15.6:0/2627297614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd660009d00 con 0x7fd668100620 2023-09-13T09:38:52.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66ecb5700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd668105c70 0x7fd66819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66e4b4700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6680ffc60 0x7fd668196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:38:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd66dcb3700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd6681973b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd65800d980 tx=0x7fd65800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd65f7fe700 1 -- 172.21.15.6:0/2627297614 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65800bb60 con 0x7fd668100620 2023-09-13T09:38:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd65f7fe700 1 -- 172.21.15.6:0/2627297614 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd658007640 con 0x7fd668100620 2023-09-13T09:38:52.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd66819c440 con 0x7fd668100620 2023-09-13T09:38:52.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd65f7fe700 1 -- 172.21.15.6:0/2627297614 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658004e90 con 0x7fd668100620 2023-09-13T09:38:52.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.297+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6681a3ca0 con 0x7fd668100620 2023-09-13T09:38:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.298+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd66804e9b0 con 0x7fd668100620 2023-09-13T09:38:52.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.299+0000 7fd65f7fe700 1 -- 172.21.15.6:0/2627297614 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd65800bcc0 con 0x7fd668100620 2023-09-13T09:38:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.300+0000 7fd65f7fe700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6540a0750 0x7fd6540a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.300+0000 7fd66e4b4700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6540a0750 0x7fd6540a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.301+0000 7fd65f7fe700 1 -- 172.21.15.6:0/2627297614 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd6580cbf00 con 0x7fd668100620 2023-09-13T09:38:52.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.301+0000 7fd66e4b4700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6540a0750 0x7fd6540a2c10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd664005e10 tx=0x7fd664005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:52.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.304+0000 7fd65f7fe700 1 -- 172.21.15.6:0/2627297614 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd658099510 con 0x7fd668100620 2023-09-13T09:38:52.367 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738432 got 34359738435 for osd.0 2023-09-13T09:38:52.367 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.505+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7fd66810fc80 con 0x7fd668100620 2023-09-13T09:38:52.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.505+0000 7fd65f7fe700 1 -- 172.21.15.6:0/2627297614 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fd658016070 con 0x7fd668100620 2023-09-13T09:38:52.506 INFO:teuthology.orchestra.run.smithi006.stdout:249108103200 2023-09-13T09:38:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6540a0750 msgr2=0x7fd6540a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:52.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6540a0750 0x7fd6540a2c10 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd664005e10 tx=0x7fd664005d60 comp rx=0 tx=0).stop 2023-09-13T09:38:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 msgr2=0x7fd6681973b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd6681973b0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fd65800d980 tx=0x7fd65800dd40 comp rx=0 tx=0).stop 2023-09-13T09:38:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 shutdown_connections 2023-09-13T09:38:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd668105c70 0x7fd66819b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6680ffc60 0x7fd668196e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6540a0750 0x7fd6540a2c10 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 --2- 172.21.15.6:0/2627297614 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668100620 0x7fd6681973b0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 >> 172.21.15.6:0/2627297614 conn(0x7fd668075c00 msgr2=0x7fd6680687a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 shutdown_connections 2023-09-13T09:38:52.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:52.507+0000 7fd670718700 1 -- 172.21.15.6:0/2627297614 wait complete. 2023-09-13T09:38:52.909 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103198 got 249108103200 for osd.8 2023-09-13T09:38:52.910 DEBUG:teuthology.parallel:result is None 2023-09-13T09:38:52.911 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-09-13T09:38:52.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph pg dump --format=json 2023-09-13T09:38:52.941 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:52 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2627297614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-13T09:38:53.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:52 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2627297614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-13T09:38:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:52 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2627297614' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-09-13T09:38:53.479 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:54.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:53 smithi006 ceph-mon[98665]: pgmap v277: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-13T09:38:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:53 smithi053 ceph-mon[102373]: pgmap v277: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-13T09:38:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:53 smithi131 ceph-mon[102785]: pgmap v277: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-09-13T09:38:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 -- 172.21.15.6:0/2892736431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05340ffc60 msgr2=0x7f05341000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 --2- 172.21.15.6:0/2892736431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05340ffc60 0x7f05341000e0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f05280099c0 tx=0x7f0528009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 -- 172.21.15.6:0/2892736431 shutdown_connections 2023-09-13T09:38:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 --2- 172.21.15.6:0/2892736431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0534100620 0x7f053410ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 --2- 172.21.15.6:0/2892736431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0534105c70 0x7f0534106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 --2- 172.21.15.6:0/2892736431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05340ffc60 0x7f05341000e0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 -- 172.21.15.6:0/2892736431 >> 172.21.15.6:0/2892736431 conn(0x7f0534075c00 msgr2=0x7f0534076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 -- 172.21.15.6:0/2892736431 shutdown_connections 2023-09-13T09:38:54.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 -- 172.21.15.6:0/2892736431 wait complete. 2023-09-13T09:38:54.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.721+0000 7f053a1a6700 1 Processor -- start 2023-09-13T09:38:54.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f053a1a6700 1 -- start start 2023-09-13T09:38:54.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f053a1a6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05340ffc60 0x7f053419ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:54.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f053a1a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0534100620 0x7f053419bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:54.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f053a1a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0534105c70 0x7f0534195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:54.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f053a1a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0534196270 con 0x7f0534100620 2023-09-13T09:38:54.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f053a1a6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341963e0 con 0x7f05340ffc60 2023-09-13T09:38:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f053a1a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05341965a0 con 0x7f0534105c70 2023-09-13T09:38:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0534100620 0x7f053419bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0534100620 0x7f053419bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32804/0 (socket says 172.21.15.6:32804) 2023-09-13T09:38:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 -- 172.21.15.6:0/1892749899 learned_addr learned my addr 172.21.15.6:0/1892749899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:54.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f05337fe700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05340ffc60 0x7f053419ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:54.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0533fff700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0534105c70 0x7f0534195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:54.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 -- 172.21.15.6:0/1892749899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0534105c70 msgr2=0x7f0534195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:54.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0534105c70 0x7f0534195ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 -- 172.21.15.6:0/1892749899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05340ffc60 msgr2=0x7f053419ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:54.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05340ffc60 0x7f053419ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.722+0000 7f0532ffd700 1 -- 172.21.15.6:0/1892749899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05280095f0 con 0x7f0534100620 2023-09-13T09:38:54.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.723+0000 7f0532ffd700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0534100620 0x7f053419bfc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0528009990 tx=0x7f0528009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:54.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.723+0000 7f0530ff9700 1 -- 172.21.15.6:0/1892749899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052801d070 con 0x7f0534100620 2023-09-13T09:38:54.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.723+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0534196820 con 0x7f0534100620 2023-09-13T09:38:54.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.723+0000 7f0530ff9700 1 -- 172.21.15.6:0/1892749899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0528004010 con 0x7f0534100620 2023-09-13T09:38:54.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.723+0000 7f0530ff9700 1 -- 172.21.15.6:0/1892749899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528022d40 con 0x7f0534100620 2023-09-13T09:38:54.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.723+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05341a2a00 con 0x7f0534100620 2023-09-13T09:38:54.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.724+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053404e9b0 con 0x7f0534100620 2023-09-13T09:38:54.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.725+0000 7f0530ff9700 1 -- 172.21.15.6:0/1892749899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f0528022470 con 0x7f0534100620 2023-09-13T09:38:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.726+0000 7f0530ff9700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f051c0a06d0 0x7f051c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.726+0000 7f05337fe700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f051c0a06d0 0x7f051c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.726+0000 7f0530ff9700 1 -- 172.21.15.6:0/1892749899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f05280ccff0 con 0x7f0534100620 2023-09-13T09:38:54.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.726+0000 7f05337fe700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f051c0a06d0 0x7f051c0a2b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0524005950 tx=0x7f05240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:54.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.730+0000 7f0530ff9700 1 -- 172.21.15.6:0/1892749899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0528096b00 con 0x7f0534100620 2023-09-13T09:38:54.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.925+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f053410fc20 con 0x7f051c0a06d0 2023-09-13T09:38:54.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.937+0000 7f0530ff9700 1 -- 172.21.15.6:0/1892749899 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340345 (secure 0 0 0) 0x7f053410fc20 con 0x7f051c0a06d0 2023-09-13T09:38:54.942 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f051c0a06d0 msgr2=0x7f051c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f051c0a06d0 0x7f051c0a2b90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0524005950 tx=0x7f05240058e0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0534100620 msgr2=0x7f053419bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0534100620 0x7f053419bfc0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0528009990 tx=0x7f0528009580 comp rx=0 tx=0).stop 2023-09-13T09:38:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 shutdown_connections 2023-09-13T09:38:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0534105c70 0x7f0534195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05340ffc60 0x7f053419ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f051c0a06d0 0x7f051c0a2b90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 --2- 172.21.15.6:0/1892749899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0534100620 0x7f053419bfc0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:54.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 >> 172.21.15.6:0/1892749899 conn(0x7f0534075c00 msgr2=0x7f05340fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:54.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.940+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 shutdown_connections 2023-09-13T09:38:54.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:54.941+0000 7f053a1a6700 1 -- 172.21.15.6:0/1892749899 wait complete. 2023-09-13T09:38:54.947 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-09-13T09:38:55.323 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2023-09-13T09:38:54.150358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652524,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":507,"num_read_kb":366,"num_write":412,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337092,"kb_used_data":12900,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604732,"statfs":{"total":1151940427776,"available":1151595245568,"internally_reserved":0,"allocated":13209600,"data_stored":7165227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":101,"num_read_kb":47,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003188"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233536+0000","last_change":"2023-09-13T09:38:09.701485+0000","last_active":"2023-09-13T09:38:12.233536+0000","last_peered":"2023-09-13T09:38:12.233536+0000","last_clean":"2023-09-13T09:38:12.233536+0000","last_became_active":"2023-09-13T09:38:09.701160+0000","last_became_peered":"2023-09-13T09:38:09.701160+0000","last_unstale":"2023-09-13T09:38:12.233536+0000","last_undegraded":"2023-09-13T09:38:12.233536+0000","last_fullsized":"2023-09-13T09:38:12.233536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:10.089322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171037+0000","last_change":"2023-09-13T09:38:09.697198+0000","last_active":"2023-09-13T09:38:11.171037+0000","last_peered":"2023-09-13T09:38:11.171037+0000","last_clean":"2023-09-13T09:38:11.171037+0000","last_became_active":"2023-09-13T09:38:09.696859+0000","last_became_peered":"2023-09-13T09:38:09.696859+0000","last_unstale":"2023-09-13T09:38:11.171037+0000","last_undegraded":"2023-09-13T09:38:11.171037+0000","last_fullsized":"2023-09-13T09:38:11.171037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:53.601426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170662+0000","last_change":"2023-09-13T09:38:09.696150+0000","last_active":"2023-09-13T09:38:11.170662+0000","last_peered":"2023-09-13T09:38:11.170662+0000","last_clean":"2023-09-13T09:38:11.170662+0000","last_became_active":"2023-09-13T09:38:09.695893+0000","last_became_peered":"2023-09-13T09:38:09.695893+0000","last_unstale":"2023-09-13T09:38:11.170662+0000","last_undegraded":"2023-09-13T09:38:11.170662+0000","last_fullsized":"2023-09-13T09:38:11.170662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:51.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171082+0000","last_change":"2023-09-13T09:38:09.697564+0000","last_active":"2023-09-13T09:38:11.171082+0000","last_peered":"2023-09-13T09:38:11.171082+0000","last_clean":"2023-09-13T09:38:11.171082+0000","last_became_active":"2023-09-13T09:38:09.697235+0000","last_became_peered":"2023-09-13T09:38:09.697235+0000","last_unstale":"2023-09-13T09:38:11.171082+0000","last_undegraded":"2023-09-13T09:38:11.171082+0000","last_fullsized":"2023-09-13T09:38:11.171082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:49.705452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170159+0000","last_change":"2023-09-13T09:38:09.702889+0000","last_active":"2023-09-13T09:38:11.170159+0000","last_peered":"2023-09-13T09:38:11.170159+0000","last_clean":"2023-09-13T09:38:11.170159+0000","last_became_active":"2023-09-13T09:38:09.702589+0000","last_became_peered":"2023-09-13T09:38:09.702589+0000","last_unstale":"2023-09-13T09:38:11.170159+0000","last_undegraded":"2023-09-13T09:38:11.170159+0000","last_fullsized":"2023-09-13T09:38:11.170159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:56:05.432576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683357+0000","last_change":"2023-09-13T09:38:09.697097+0000","last_active":"2023-09-13T09:38:10.683357+0000","last_peered":"2023-09-13T09:38:10.683357+0000","last_clean":"2023-09-13T09:38:10.683357+0000","last_became_active":"2023-09-13T09:38:09.696770+0000","last_became_peered":"2023-09-13T09:38:09.696770+0000","last_unstale":"2023-09-13T09:38:10.683357+0000","last_undegraded":"2023-09-13T09:38:10.683357+0000","last_fullsized":"2023-09-13T09:38:10.683357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:46.305472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171571+0000","last_change":"2023-09-13T09:38:09.700506+0000","last_active":"2023-09-13T09:38:11.171571+0000","last_peered":"2023-09-13T09:38:11.171571+0000","last_clean":"2023-09-13T09:38:11.171571+0000","last_became_active":"2023-09-13T09:38:09.700178+0000","last_became_peered":"2023-09-13T09:38:09.700178+0000","last_unstale":"2023-09-13T09:38:11.171571+0000","last_undegraded":"2023-09-13T09:38:11.171571+0000","last_fullsized":"2023-09-13T09:38:11.171571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:04.261443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170488+0000","last_change":"2023-09-13T09:38:09.703191+0000","last_active":"2023-09-13T09:38:11.170488+0000","last_peered":"2023-09-13T09:38:11.170488+0000","last_clean":"2023-09-13T09:38:11.170488+0000","last_became_active":"2023-09-13T09:38:09.702874+0000","last_became_peered":"2023-09-13T09:38:09.702874+0000","last_unstale":"2023-09-13T09:38:11.170488+0000","last_undegraded":"2023-09-13T09:38:11.170488+0000","last_fullsized":"2023-09-13T09:38:11.170488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:50:25.759861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171171+0000","last_change":"2023-09-13T09:38:09.700416+0000","last_active":"2023-09-13T09:38:11.171171+0000","last_peered":"2023-09-13T09:38:11.171171+0000","last_clean":"2023-09-13T09:38:11.171171+0000","last_became_active":"2023-09-13T09:38:09.700102+0000","last_became_peered":"2023-09-13T09:38:09.700102+0000","last_unstale":"2023-09-13T09:38:11.171171+0000","last_undegraded":"2023-09-13T09:38:11.171171+0000","last_fullsized":"2023-09-13T09:38:11.171171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:53.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683677+0000","last_change":"2023-09-13T09:38:09.702609+0000","last_active":"2023-09-13T09:38:10.683677+0000","last_peered":"2023-09-13T09:38:10.683677+0000","last_clean":"2023-09-13T09:38:10.683677+0000","last_became_active":"2023-09-13T09:38:09.702244+0000","last_became_peered":"2023-09-13T09:38:09.702244+0000","last_unstale":"2023-09-13T09:38:10.683677+0000","last_undegraded":"2023-09-13T09:38:10.683677+0000","last_fullsized":"2023-09-13T09:38:10.683677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:08:30.911492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171785+0000","last_change":"2023-09-13T09:38:09.694245+0000","last_active":"2023-09-13T09:38:11.171785+0000","last_peered":"2023-09-13T09:38:11.171785+0000","last_clean":"2023-09-13T09:38:11.171785+0000","last_became_active":"2023-09-13T09:38:09.693939+0000","last_became_peered":"2023-09-13T09:38:09.693939+0000","last_unstale":"2023-09-13T09:38:11.171785+0000","last_undegraded":"2023-09-13T09:38:11.171785+0000","last_fullsized":"2023-09-13T09:38:11.171785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:08.383075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171904+0000","last_change":"2023-09-13T09:38:09.696680+0000","last_active":"2023-09-13T09:38:11.171904+0000","last_peered":"2023-09-13T09:38:11.171904+0000","last_clean":"2023-09-13T09:38:11.171904+0000","last_became_active":"2023-09-13T09:38:09.696369+0000","last_became_peered":"2023-09-13T09:38:09.696369+0000","last_unstale":"2023-09-13T09:38:11.171904+0000","last_undegraded":"2023-09-13T09:38:11.171904+0000","last_fullsized":"2023-09-13T09:38:11.171904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:48.111921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683082+0000","last_change":"2023-09-13T09:38:09.703214+0000","last_active":"2023-09-13T09:38:10.683082+0000","last_peered":"2023-09-13T09:38:10.683082+0000","last_clean":"2023-09-13T09:38:10.683082+0000","last_became_active":"2023-09-13T09:38:09.702815+0000","last_became_peered":"2023-09-13T09:38:09.702815+0000","last_unstale":"2023-09-13T09:38:10.683082+0000","last_undegraded":"2023-09-13T09:38:10.683082+0000","last_fullsized":"2023-09-13T09:38:10.683082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:46.437548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171130+0000","last_change":"2023-09-13T09:38:09.699968+0000","last_active":"2023-09-13T09:38:11.171130+0000","last_peered":"2023-09-13T09:38:11.171130+0000","last_clean":"2023-09-13T09:38:11.171130+0000","last_became_active":"2023-09-13T09:38:09.699643+0000","last_became_peered":"2023-09-13T09:38:09.699643+0000","last_unstale":"2023-09-13T09:38:11.171130+0000","last_undegraded":"2023-09-13T09:38:11.171130+0000","last_fullsized":"2023-09-13T09:38:11.171130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:41:40.550328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.694517+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.691295+0000","last_became_peered":"2023-09-13T09:38:09.691295+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:48:40.291170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170268+0000","last_change":"2023-09-13T09:38:09.695903+0000","last_active":"2023-09-13T09:38:11.170268+0000","last_peered":"2023-09-13T09:38:11.170268+0000","last_clean":"2023-09-13T09:38:11.170268+0000","last_became_active":"2023-09-13T09:38:09.695585+0000","last_became_peered":"2023-09-13T09:38:09.695585+0000","last_unstale":"2023-09-13T09:38:11.170268+0000","last_undegraded":"2023-09-13T09:38:11.170268+0000","last_fullsized":"2023-09-13T09:38:11.170268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:13.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233581+0000","last_change":"2023-09-13T09:38:09.702485+0000","last_active":"2023-09-13T09:38:12.233581+0000","last_peered":"2023-09-13T09:38:12.233581+0000","last_clean":"2023-09-13T09:38:12.233581+0000","last_became_active":"2023-09-13T09:38:09.701989+0000","last_became_peered":"2023-09-13T09:38:09.701989+0000","last_unstale":"2023-09-13T09:38:12.233581+0000","last_undegraded":"2023-09-13T09:38:12.233581+0000","last_fullsized":"2023-09-13T09:38:12.233581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:58.832560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170815+0000","last_change":"2023-09-13T09:38:09.695080+0000","last_active":"2023-09-13T09:38:11.170815+0000","last_peered":"2023-09-13T09:38:11.170815+0000","last_clean":"2023-09-13T09:38:11.170815+0000","last_became_active":"2023-09-13T09:38:09.694782+0000","last_became_peered":"2023-09-13T09:38:09.694782+0000","last_unstale":"2023-09-13T09:38:11.170815+0000","last_undegraded":"2023-09-13T09:38:11.170815+0000","last_fullsized":"2023-09-13T09:38:11.170815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:15.146156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170850+0000","last_change":"2023-09-13T09:38:09.702456+0000","last_active":"2023-09-13T09:38:11.170850+0000","last_peered":"2023-09-13T09:38:11.170850+0000","last_clean":"2023-09-13T09:38:11.170850+0000","last_became_active":"2023-09-13T09:38:09.702171+0000","last_became_peered":"2023-09-13T09:38:09.702171+0000","last_unstale":"2023-09-13T09:38:11.170850+0000","last_undegraded":"2023-09-13T09:38:11.170850+0000","last_fullsized":"2023-09-13T09:38:11.170850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:32.995619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":61,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:48.731379+0000","last_change":"2023-09-13T09:38:08.692389+0000","last_active":"2023-09-13T09:38:48.731379+0000","last_peered":"2023-09-13T09:38:48.731379+0000","last_clean":"2023-09-13T09:38:48.731379+0000","last_became_active":"2023-09-13T09:38:08.692022+0000","last_became_peered":"2023-09-13T09:38:08.692022+0000","last_unstale":"2023-09-13T09:38:48.731379+0000","last_undegraded":"2023-09-13T09:38:48.731379+0000","last_fullsized":"2023-09-13T09:38:48.731379+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:58:40.288839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170755+0000","last_change":"2023-09-13T09:38:09.704712+0000","last_active":"2023-09-13T09:38:11.170755+0000","last_peered":"2023-09-13T09:38:11.170755+0000","last_clean":"2023-09-13T09:38:11.170755+0000","last_became_active":"2023-09-13T09:38:09.704379+0000","last_became_peered":"2023-09-13T09:38:09.704379+0000","last_unstale":"2023-09-13T09:38:11.170755+0000","last_undegraded":"2023-09-13T09:38:11.170755+0000","last_fullsized":"2023-09-13T09:38:11.170755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:47.605987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170899+0000","last_change":"2023-09-13T09:38:08.694408+0000","last_active":"2023-09-13T09:38:11.170899+0000","last_peered":"2023-09-13T09:38:11.170899+0000","last_clean":"2023-09-13T09:38:11.170899+0000","last_became_active":"2023-09-13T09:38:08.693140+0000","last_became_peered":"2023-09-13T09:38:08.693140+0000","last_unstale":"2023-09-13T09:38:11.170899+0000","last_undegraded":"2023-09-13T09:38:11.170899+0000","last_fullsized":"2023-09-13T09:38:11.170899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:27:22.637489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171299+0000","last_change":"2023-09-13T09:38:09.705381+0000","last_active":"2023-09-13T09:38:11.171299+0000","last_peered":"2023-09-13T09:38:11.171299+0000","last_clean":"2023-09-13T09:38:11.171299+0000","last_became_active":"2023-09-13T09:38:09.705059+0000","last_became_peered":"2023-09-13T09:38:09.705059+0000","last_unstale":"2023-09-13T09:38:11.171299+0000","last_undegraded":"2023-09-13T09:38:11.171299+0000","last_fullsized":"2023-09-13T09:38:11.171299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:11.294362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:16.681499+0000","last_change":"2023-09-13T09:38:08.695077+0000","last_active":"2023-09-13T09:38:16.681499+0000","last_peered":"2023-09-13T09:38:16.681499+0000","last_clean":"2023-09-13T09:38:16.681499+0000","last_became_active":"2023-09-13T09:38:08.694778+0000","last_became_peered":"2023-09-13T09:38:08.694778+0000","last_unstale":"2023-09-13T09:38:16.681499+0000","last_undegraded":"2023-09-13T09:38:16.681499+0000","last_fullsized":"2023-09-13T09:38:16.681499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:31.517739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170421+0000","last_change":"2023-09-13T09:38:09.696875+0000","last_active":"2023-09-13T09:38:11.170421+0000","last_peered":"2023-09-13T09:38:11.170421+0000","last_clean":"2023-09-13T09:38:11.170421+0000","last_became_active":"2023-09-13T09:38:09.696060+0000","last_became_peered":"2023-09-13T09:38:09.696060+0000","last_unstale":"2023-09-13T09:38:11.170421+0000","last_undegraded":"2023-09-13T09:38:11.170421+0000","last_fullsized":"2023-09-13T09:38:11.170421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:55.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.790670+0000","last_change":"2023-09-13T09:38:08.692583+0000","last_active":"2023-09-13T09:38:15.790670+0000","last_peered":"2023-09-13T09:38:15.790670+0000","last_clean":"2023-09-13T09:38:15.790670+0000","last_became_active":"2023-09-13T09:38:08.692266+0000","last_became_peered":"2023-09-13T09:38:08.692266+0000","last_unstale":"2023-09-13T09:38:15.790670+0000","last_undegraded":"2023-09-13T09:38:15.790670+0000","last_fullsized":"2023-09-13T09:38:15.790670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:37.827191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683948+0000","last_change":"2023-09-13T09:38:09.705855+0000","last_active":"2023-09-13T09:38:10.683948+0000","last_peered":"2023-09-13T09:38:10.683948+0000","last_clean":"2023-09-13T09:38:10.683948+0000","last_became_active":"2023-09-13T09:38:09.705518+0000","last_became_peered":"2023-09-13T09:38:09.705518+0000","last_unstale":"2023-09-13T09:38:10.683948+0000","last_undegraded":"2023-09-13T09:38:10.683948+0000","last_fullsized":"2023-09-13T09:38:10.683948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:02.403984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:51.736899+0000","last_change":"2023-09-13T09:38:08.697396+0000","last_active":"2023-09-13T09:38:51.736899+0000","last_peered":"2023-09-13T09:38:51.736899+0000","last_clean":"2023-09-13T09:38:51.736899+0000","last_became_active":"2023-09-13T09:38:08.697067+0000","last_became_peered":"2023-09-13T09:38:08.697067+0000","last_unstale":"2023-09-13T09:38:51.736899+0000","last_undegraded":"2023-09-13T09:38:51.736899+0000","last_fullsized":"2023-09-13T09:38:51.736899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:59.971250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170184+0000","last_change":"2023-09-13T09:38:09.701311+0000","last_active":"2023-09-13T09:38:11.170184+0000","last_peered":"2023-09-13T09:38:11.170184+0000","last_clean":"2023-09-13T09:38:11.170184+0000","last_became_active":"2023-09-13T09:38:09.700995+0000","last_became_peered":"2023-09-13T09:38:09.700995+0000","last_unstale":"2023-09-13T09:38:11.170184+0000","last_undegraded":"2023-09-13T09:38:11.170184+0000","last_fullsized":"2023-09-13T09:38:11.170184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:08.744780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.780227+0000","last_change":"2023-09-13T09:38:08.691337+0000","last_active":"2023-09-13T09:38:14.780227+0000","last_peered":"2023-09-13T09:38:14.780227+0000","last_clean":"2023-09-13T09:38:14.780227+0000","last_became_active":"2023-09-13T09:38:08.690948+0000","last_became_peered":"2023-09-13T09:38:08.690948+0000","last_unstale":"2023-09-13T09:38:14.780227+0000","last_undegraded":"2023-09-13T09:38:14.780227+0000","last_fullsized":"2023-09-13T09:38:14.780227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:33.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683697+0000","last_change":"2023-09-13T09:38:09.706627+0000","last_active":"2023-09-13T09:38:10.683697+0000","last_peered":"2023-09-13T09:38:10.683697+0000","last_clean":"2023-09-13T09:38:10.683697+0000","last_became_active":"2023-09-13T09:38:09.706328+0000","last_became_peered":"2023-09-13T09:38:09.706328+0000","last_unstale":"2023-09-13T09:38:10.683697+0000","last_undegraded":"2023-09-13T09:38:10.683697+0000","last_fullsized":"2023-09-13T09:38:10.683697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:09.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.767182+0000","last_change":"2023-09-13T09:38:08.692201+0000","last_active":"2023-09-13T09:38:13.767182+0000","last_peered":"2023-09-13T09:38:13.767182+0000","last_clean":"2023-09-13T09:38:13.767182+0000","last_became_active":"2023-09-13T09:38:08.691334+0000","last_became_peered":"2023-09-13T09:38:08.691334+0000","last_unstale":"2023-09-13T09:38:13.767182+0000","last_undegraded":"2023-09-13T09:38:13.767182+0000","last_fullsized":"2023-09-13T09:38:13.767182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:13.098275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170633+0000","last_change":"2023-09-13T09:38:09.701125+0000","last_active":"2023-09-13T09:38:11.170633+0000","last_peered":"2023-09-13T09:38:11.170633+0000","last_clean":"2023-09-13T09:38:11.170633+0000","last_became_active":"2023-09-13T09:38:09.700055+0000","last_became_peered":"2023-09-13T09:38:09.700055+0000","last_unstale":"2023-09-13T09:38:11.170633+0000","last_undegraded":"2023-09-13T09:38:11.170633+0000","last_fullsized":"2023-09-13T09:38:11.170633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:17.787363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.792594+0000","last_change":"2023-09-13T09:38:08.696797+0000","last_active":"2023-09-13T09:38:15.792594+0000","last_peered":"2023-09-13T09:38:15.792594+0000","last_clean":"2023-09-13T09:38:15.792594+0000","last_became_active":"2023-09-13T09:38:08.696494+0000","last_became_peered":"2023-09-13T09:38:08.696494+0000","last_unstale":"2023-09-13T09:38:15.792594+0000","last_undegraded":"2023-09-13T09:38:15.792594+0000","last_fullsized":"2023-09-13T09:38:15.792594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:29.454184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170422+0000","last_change":"2023-09-13T09:38:09.694166+0000","last_active":"2023-09-13T09:38:11.170422+0000","last_peered":"2023-09-13T09:38:11.170422+0000","last_clean":"2023-09-13T09:38:11.170422+0000","last_became_active":"2023-09-13T09:38:09.693894+0000","last_became_peered":"2023-09-13T09:38:09.693894+0000","last_unstale":"2023-09-13T09:38:11.170422+0000","last_undegraded":"2023-09-13T09:38:11.170422+0000","last_fullsized":"2023-09-13T09:38:11.170422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:27:35.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":85,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:49.733489+0000","last_change":"2023-09-13T09:38:08.693649+0000","last_active":"2023-09-13T09:38:49.733489+0000","last_peered":"2023-09-13T09:38:49.733489+0000","last_clean":"2023-09-13T09:38:49.733489+0000","last_became_active":"2023-09-13T09:38:08.693289+0000","last_became_peered":"2023-09-13T09:38:08.693289+0000","last_unstale":"2023-09-13T09:38:49.733489+0000","last_undegraded":"2023-09-13T09:38:49.733489+0000","last_fullsized":"2023-09-13T09:38:49.733489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:39:27.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":68,"num_read_kb":68,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170787+0000","last_change":"2023-09-13T09:38:09.693872+0000","last_active":"2023-09-13T09:38:11.170787+0000","last_peered":"2023-09-13T09:38:11.170787+0000","last_clean":"2023-09-13T09:38:11.170787+0000","last_became_active":"2023-09-13T09:38:09.693445+0000","last_became_peered":"2023-09-13T09:38:09.693445+0000","last_unstale":"2023-09-13T09:38:11.170787+0000","last_undegraded":"2023-09-13T09:38:11.170787+0000","last_fullsized":"2023-09-13T09:38:11.170787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:29:35.717276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.791218+0000","last_change":"2023-09-13T09:38:08.696375+0000","last_active":"2023-09-13T09:38:15.791218+0000","last_peered":"2023-09-13T09:38:15.791218+0000","last_clean":"2023-09-13T09:38:15.791218+0000","last_became_active":"2023-09-13T09:38:08.695799+0000","last_became_peered":"2023-09-13T09:38:08.695799+0000","last_unstale":"2023-09-13T09:38:15.791218+0000","last_undegraded":"2023-09-13T09:38:15.791218+0000","last_fullsized":"2023-09-13T09:38:15.791218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:09.255704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171326+0000","last_change":"2023-09-13T09:38:09.706518+0000","last_active":"2023-09-13T09:38:11.171326+0000","last_peered":"2023-09-13T09:38:11.171326+0000","last_clean":"2023-09-13T09:38:11.171326+0000","last_became_active":"2023-09-13T09:38:09.706083+0000","last_became_peered":"2023-09-13T09:38:09.706083+0000","last_unstale":"2023-09-13T09:38:11.171326+0000","last_undegraded":"2023-09-13T09:38:11.171326+0000","last_fullsized":"2023-09-13T09:38:11.171326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:21:53.831430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.779289+0000","last_change":"2023-09-13T09:38:08.697878+0000","last_active":"2023-09-13T09:38:14.779289+0000","last_peered":"2023-09-13T09:38:14.779289+0000","last_clean":"2023-09-13T09:38:14.779289+0000","last_became_active":"2023-09-13T09:38:08.697476+0000","last_became_peered":"2023-09-13T09:38:08.697476+0000","last_unstale":"2023-09-13T09:38:14.779289+0000","last_undegraded":"2023-09-13T09:38:14.779289+0000","last_fullsized":"2023-09-13T09:38:14.779289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:09.021111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170664+0000","last_change":"2023-09-13T09:38:09.697144+0000","last_active":"2023-09-13T09:38:11.170664+0000","last_peered":"2023-09-13T09:38:11.170664+0000","last_clean":"2023-09-13T09:38:11.170664+0000","last_became_active":"2023-09-13T09:38:09.696521+0000","last_became_peered":"2023-09-13T09:38:09.696521+0000","last_unstale":"2023-09-13T09:38:11.170664+0000","last_undegraded":"2023-09-13T09:38:11.170664+0000","last_fullsized":"2023-09-13T09:38:11.170664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:36:17.096644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":114,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:49.733779+0000","last_change":"2023-09-13T09:38:08.694981+0000","last_active":"2023-09-13T09:38:49.733779+0000","last_peered":"2023-09-13T09:38:49.733779+0000","last_clean":"2023-09-13T09:38:49.733779+0000","last_became_active":"2023-09-13T09:38:08.694630+0000","last_became_peered":"2023-09-13T09:38:08.694630+0000","last_unstale":"2023-09-13T09:38:49.733779+0000","last_undegraded":"2023-09-13T09:38:49.733779+0000","last_fullsized":"2023-09-13T09:38:49.733779+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:56:58.204622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54708,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":73,"num_read_kb":90,"num_write":30,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170585+0000","last_change":"2023-09-13T09:38:09.700927+0000","last_active":"2023-09-13T09:38:11.170585+0000","last_peered":"2023-09-13T09:38:11.170585+0000","last_clean":"2023-09-13T09:38:11.170585+0000","last_became_active":"2023-09-13T09:38:09.700608+0000","last_became_peered":"2023-09-13T09:38:09.700608+0000","last_unstale":"2023-09-13T09:38:11.170585+0000","last_undegraded":"2023-09-13T09:38:11.170585+0000","last_fullsized":"2023-09-13T09:38:11.170585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:24.177293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:16.681269+0000","last_change":"2023-09-13T09:38:08.699130+0000","last_active":"2023-09-13T09:38:16.681269+0000","last_peered":"2023-09-13T09:38:16.681269+0000","last_clean":"2023-09-13T09:38:16.681269+0000","last_became_active":"2023-09-13T09:38:08.698802+0000","last_became_peered":"2023-09-13T09:38:08.698802+0000","last_unstale":"2023-09-13T09:38:16.681269+0000","last_undegraded":"2023-09-13T09:38:16.681269+0000","last_fullsized":"2023-09-13T09:38:16.681269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:36.539846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682921+0000","last_change":"2023-09-13T09:38:09.697387+0000","last_active":"2023-09-13T09:38:10.682921+0000","last_peered":"2023-09-13T09:38:10.682921+0000","last_clean":"2023-09-13T09:38:10.682921+0000","last_became_active":"2023-09-13T09:38:09.697081+0000","last_became_peered":"2023-09-13T09:38:09.697081+0000","last_unstale":"2023-09-13T09:38:10.682921+0000","last_undegraded":"2023-09-13T09:38:10.682921+0000","last_fullsized":"2023-09-13T09:38:10.682921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:28:59.473258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.792585+0000","last_change":"2023-09-13T09:38:08.696609+0000","last_active":"2023-09-13T09:38:15.792585+0000","last_peered":"2023-09-13T09:38:15.792585+0000","last_clean":"2023-09-13T09:38:15.792585+0000","last_became_active":"2023-09-13T09:38:08.696286+0000","last_became_peered":"2023-09-13T09:38:08.696286+0000","last_unstale":"2023-09-13T09:38:15.792585+0000","last_undegraded":"2023-09-13T09:38:15.792585+0000","last_fullsized":"2023-09-13T09:38:15.792585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:06:51.121661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171465+0000","last_change":"2023-09-13T09:38:09.698374+0000","last_active":"2023-09-13T09:38:11.171465+0000","last_peered":"2023-09-13T09:38:11.171465+0000","last_clean":"2023-09-13T09:38:11.171465+0000","last_became_active":"2023-09-13T09:38:09.698050+0000","last_became_peered":"2023-09-13T09:38:09.698050+0000","last_unstale":"2023-09-13T09:38:11.171465+0000","last_undegraded":"2023-09-13T09:38:11.171465+0000","last_fullsized":"2023-09-13T09:38:11.171465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:37:24.089861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:50.735226+0000","last_change":"2023-09-13T09:38:08.692717+0000","last_active":"2023-09-13T09:38:50.735226+0000","last_peered":"2023-09-13T09:38:50.735226+0000","last_clean":"2023-09-13T09:38:50.735226+0000","last_became_active":"2023-09-13T09:38:08.692340+0000","last_became_peered":"2023-09-13T09:38:08.692340+0000","last_unstale":"2023-09-13T09:38:50.735226+0000","last_undegraded":"2023-09-13T09:38:50.735226+0000","last_fullsized":"2023-09-13T09:38:50.735226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:22.280879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170823+0000","last_change":"2023-09-13T09:38:09.701623+0000","last_active":"2023-09-13T09:38:11.170823+0000","last_peered":"2023-09-13T09:38:11.170823+0000","last_clean":"2023-09-13T09:38:11.170823+0000","last_became_active":"2023-09-13T09:38:09.701338+0000","last_became_peered":"2023-09-13T09:38:09.701338+0000","last_unstale":"2023-09-13T09:38:11.170823+0000","last_undegraded":"2023-09-13T09:38:11.170823+0000","last_fullsized":"2023-09-13T09:38:11.170823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:49:58.937293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.788808+0000","last_change":"2023-09-13T09:38:08.691968+0000","last_active":"2023-09-13T09:38:15.788808+0000","last_peered":"2023-09-13T09:38:15.788808+0000","last_clean":"2023-09-13T09:38:15.788808+0000","last_became_active":"2023-09-13T09:38:08.691668+0000","last_became_peered":"2023-09-13T09:38:08.691668+0000","last_unstale":"2023-09-13T09:38:15.788808+0000","last_undegraded":"2023-09-13T09:38:15.788808+0000","last_fullsized":"2023-09-13T09:38:15.788808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:43.767948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683621+0000","last_change":"2023-09-13T09:38:09.698123+0000","last_active":"2023-09-13T09:38:10.683621+0000","last_peered":"2023-09-13T09:38:10.683621+0000","last_clean":"2023-09-13T09:38:10.683621+0000","last_became_active":"2023-09-13T09:38:09.697729+0000","last_became_peered":"2023-09-13T09:38:09.697729+0000","last_unstale":"2023-09-13T09:38:10.683621+0000","last_undegraded":"2023-09-13T09:38:10.683621+0000","last_fullsized":"2023-09-13T09:38:10.683621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:25.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.813823+0000","last_change":"2023-09-13T09:38:08.691091+0000","last_active":"2023-09-13T09:38:14.813823+0000","last_peered":"2023-09-13T09:38:14.813823+0000","last_clean":"2023-09-13T09:38:14.813823+0000","last_became_active":"2023-09-13T09:38:08.689128+0000","last_became_peered":"2023-09-13T09:38:08.689128+0000","last_unstale":"2023-09-13T09:38:14.813823+0000","last_undegraded":"2023-09-13T09:38:14.813823+0000","last_fullsized":"2023-09-13T09:38:14.813823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:32.133388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233326+0000","last_change":"2023-09-13T09:38:09.706041+0000","last_active":"2023-09-13T09:38:12.233326+0000","last_peered":"2023-09-13T09:38:12.233326+0000","last_clean":"2023-09-13T09:38:12.233326+0000","last_became_active":"2023-09-13T09:38:09.705707+0000","last_became_peered":"2023-09-13T09:38:09.705707+0000","last_unstale":"2023-09-13T09:38:12.233326+0000","last_undegraded":"2023-09-13T09:38:12.233326+0000","last_fullsized":"2023-09-13T09:38:12.233326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:57.018000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170284+0000","last_change":"2023-09-13T09:38:08.695552+0000","last_active":"2023-09-13T09:38:11.170284+0000","last_peered":"2023-09-13T09:38:11.170284+0000","last_clean":"2023-09-13T09:38:11.170284+0000","last_became_active":"2023-09-13T09:38:08.695236+0000","last_became_peered":"2023-09-13T09:38:08.695236+0000","last_unstale":"2023-09-13T09:38:11.170284+0000","last_undegraded":"2023-09-13T09:38:11.170284+0000","last_fullsized":"2023-09-13T09:38:11.170284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:41.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.687208+0000","last_change":"2023-09-13T09:38:09.699864+0000","last_active":"2023-09-13T09:38:10.687208+0000","last_peered":"2023-09-13T09:38:10.687208+0000","last_clean":"2023-09-13T09:38:10.687208+0000","last_became_active":"2023-09-13T09:38:09.699522+0000","last_became_peered":"2023-09-13T09:38:09.699522+0000","last_unstale":"2023-09-13T09:38:10.687208+0000","last_undegraded":"2023-09-13T09:38:10.687208+0000","last_fullsized":"2023-09-13T09:38:10.687208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:51.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":53,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:48.732042+0000","last_change":"2023-09-13T09:38:08.695651+0000","last_active":"2023-09-13T09:38:48.732042+0000","last_peered":"2023-09-13T09:38:48.732042+0000","last_clean":"2023-09-13T09:38:48.732042+0000","last_became_active":"2023-09-13T09:38:08.695074+0000","last_became_peered":"2023-09-13T09:38:08.695074+0000","last_unstale":"2023-09-13T09:38:48.732042+0000","last_undegraded":"2023-09-13T09:38:48.732042+0000","last_fullsized":"2023-09-13T09:38:48.732042+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:40.974436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":35,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683373+0000","last_change":"2023-09-13T09:38:09.698193+0000","last_active":"2023-09-13T09:38:10.683373+0000","last_peered":"2023-09-13T09:38:10.683373+0000","last_clean":"2023-09-13T09:38:10.683373+0000","last_became_active":"2023-09-13T09:38:09.697874+0000","last_became_peered":"2023-09-13T09:38:09.697874+0000","last_unstale":"2023-09-13T09:38:10.683373+0000","last_undegraded":"2023-09-13T09:38:10.683373+0000","last_fullsized":"2023-09-13T09:38:10.683373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:48.908322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683532+0000","last_change":"2023-09-13T09:38:09.705768+0000","last_active":"2023-09-13T09:38:10.683532+0000","last_peered":"2023-09-13T09:38:10.683532+0000","last_clean":"2023-09-13T09:38:10.683532+0000","last_became_active":"2023-09-13T09:38:09.705403+0000","last_became_peered":"2023-09-13T09:38:09.705403+0000","last_unstale":"2023-09-13T09:38:10.683532+0000","last_undegraded":"2023-09-13T09:38:10.683532+0000","last_fullsized":"2023-09-13T09:38:10.683532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:14:07.171229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:49.733080+0000","last_change":"2023-09-13T09:38:08.695499+0000","last_active":"2023-09-13T09:38:49.733080+0000","last_peered":"2023-09-13T09:38:49.733080+0000","last_clean":"2023-09-13T09:38:49.733080+0000","last_became_active":"2023-09-13T09:38:08.695167+0000","last_became_peered":"2023-09-13T09:38:08.695167+0000","last_unstale":"2023-09-13T09:38:49.733080+0000","last_undegraded":"2023-09-13T09:38:49.733080+0000","last_fullsized":"2023-09-13T09:38:49.733080+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.561408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":36,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170842+0000","last_change":"2023-09-13T09:38:09.702273+0000","last_active":"2023-09-13T09:38:11.170842+0000","last_peered":"2023-09-13T09:38:11.170842+0000","last_clean":"2023-09-13T09:38:11.170842+0000","last_became_active":"2023-09-13T09:38:09.701944+0000","last_became_peered":"2023-09-13T09:38:09.701944+0000","last_unstale":"2023-09-13T09:38:11.170842+0000","last_undegraded":"2023-09-13T09:38:11.170842+0000","last_fullsized":"2023-09-13T09:38:11.170842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:56.548720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:16.681762+0000","last_change":"2023-09-13T09:38:08.692966+0000","last_active":"2023-09-13T09:38:16.681762+0000","last_peered":"2023-09-13T09:38:16.681762+0000","last_clean":"2023-09-13T09:38:16.681762+0000","last_became_active":"2023-09-13T09:38:08.692613+0000","last_became_peered":"2023-09-13T09:38:08.692613+0000","last_unstale":"2023-09-13T09:38:16.681762+0000","last_undegraded":"2023-09-13T09:38:16.681762+0000","last_fullsized":"2023-09-13T09:38:16.681762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:37.327846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":307,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T09:38:09.688801+0000","last_change":"2023-09-13T09:37:08.710441+0000","last_active":"2023-09-13T09:38:09.688801+0000","last_peered":"2023-09-13T09:38:09.688801+0000","last_clean":"2023-09-13T09:38:09.688801+0000","last_became_active":"2023-09-13T09:37:08.709939+0000","last_became_peered":"2023-09-13T09:37:08.709939+0000","last_unstale":"2023-09-13T09:38:09.688801+0000","last_undegraded":"2023-09-13T09:38:09.688801+0000","last_fullsized":"2023-09-13T09:38:09.688801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_clean_scrub_stamp":"2023-09-13T09:34:16.664369+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:00.964039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682890+0000","last_change":"2023-09-13T09:38:09.697244+0000","last_active":"2023-09-13T09:38:10.682890+0000","last_peered":"2023-09-13T09:38:10.682890+0000","last_clean":"2023-09-13T09:38:10.682890+0000","last_became_active":"2023-09-13T09:38:09.696925+0000","last_became_peered":"2023-09-13T09:38:09.696925+0000","last_unstale":"2023-09-13T09:38:10.682890+0000","last_undegraded":"2023-09-13T09:38:10.682890+0000","last_fullsized":"2023-09-13T09:38:10.682890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:39.566528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.766096+0000","last_change":"2023-09-13T09:38:08.702070+0000","last_active":"2023-09-13T09:38:13.766096+0000","last_peered":"2023-09-13T09:38:13.766096+0000","last_clean":"2023-09-13T09:38:13.766096+0000","last_became_active":"2023-09-13T09:38:08.701647+0000","last_became_peered":"2023-09-13T09:38:08.701647+0000","last_unstale":"2023-09-13T09:38:13.766096+0000","last_undegraded":"2023-09-13T09:38:13.766096+0000","last_fullsized":"2023-09-13T09:38:13.766096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:30:22.405675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.789684+0000","last_change":"2023-09-13T09:38:08.696935+0000","last_active":"2023-09-13T09:38:15.789684+0000","last_peered":"2023-09-13T09:38:15.789684+0000","last_clean":"2023-09-13T09:38:15.789684+0000","last_became_active":"2023-09-13T09:38:08.696534+0000","last_became_peered":"2023-09-13T09:38:08.696534+0000","last_unstale":"2023-09-13T09:38:15.789684+0000","last_undegraded":"2023-09-13T09:38:15.789684+0000","last_fullsized":"2023-09-13T09:38:15.789684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:49:13.883043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683062+0000","last_change":"2023-09-13T09:38:09.695829+0000","last_active":"2023-09-13T09:38:10.683062+0000","last_peered":"2023-09-13T09:38:10.683062+0000","last_clean":"2023-09-13T09:38:10.683062+0000","last_became_active":"2023-09-13T09:38:09.695479+0000","last_became_peered":"2023-09-13T09:38:09.695479+0000","last_unstale":"2023-09-13T09:38:10.683062+0000","last_undegraded":"2023-09-13T09:38:10.683062+0000","last_fullsized":"2023-09-13T09:38:10.683062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:24:00.042236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:19.008259+0000","last_change":"2023-09-13T09:38:08.698530+0000","last_active":"2023-09-13T09:38:19.008259+0000","last_peered":"2023-09-13T09:38:19.008259+0000","last_clean":"2023-09-13T09:38:19.008259+0000","last_became_active":"2023-09-13T09:38:08.698206+0000","last_became_peered":"2023-09-13T09:38:08.698206+0000","last_unstale":"2023-09-13T09:38:19.008259+0000","last_undegraded":"2023-09-13T09:38:19.008259+0000","last_fullsized":"2023-09-13T09:38:19.008259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:09.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171580+0000","last_change":"2023-09-13T09:38:09.700993+0000","last_active":"2023-09-13T09:38:11.171580+0000","last_peered":"2023-09-13T09:38:11.171580+0000","last_clean":"2023-09-13T09:38:11.171580+0000","last_became_active":"2023-09-13T09:38:09.700677+0000","last_became_peered":"2023-09-13T09:38:09.700677+0000","last_unstale":"2023-09-13T09:38:11.171580+0000","last_undegraded":"2023-09-13T09:38:11.171580+0000","last_fullsized":"2023-09-13T09:38:11.171580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:32.209248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.789640+0000","last_change":"2023-09-13T09:38:08.684326+0000","last_active":"2023-09-13T09:38:15.789640+0000","last_peered":"2023-09-13T09:38:15.789640+0000","last_clean":"2023-09-13T09:38:15.789640+0000","last_became_active":"2023-09-13T09:38:08.683972+0000","last_became_peered":"2023-09-13T09:38:08.683972+0000","last_unstale":"2023-09-13T09:38:15.789640+0000","last_undegraded":"2023-09-13T09:38:15.789640+0000","last_fullsized":"2023-09-13T09:38:15.789640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:22.702277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170943+0000","last_change":"2023-09-13T09:38:09.706237+0000","last_active":"2023-09-13T09:38:11.170943+0000","last_peered":"2023-09-13T09:38:11.170943+0000","last_clean":"2023-09-13T09:38:11.170943+0000","last_became_active":"2023-09-13T09:38:09.705706+0000","last_became_peered":"2023-09-13T09:38:09.705706+0000","last_unstale":"2023-09-13T09:38:11.170943+0000","last_undegraded":"2023-09-13T09:38:11.170943+0000","last_fullsized":"2023-09-13T09:38:11.170943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:18.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.756655+0000","last_change":"2023-09-13T09:38:08.695641+0000","last_active":"2023-09-13T09:38:12.756655+0000","last_peered":"2023-09-13T09:38:12.756655+0000","last_clean":"2023-09-13T09:38:12.756655+0000","last_became_active":"2023-09-13T09:38:08.695090+0000","last_became_peered":"2023-09-13T09:38:08.695090+0000","last_unstale":"2023-09-13T09:38:12.756655+0000","last_undegraded":"2023-09-13T09:38:12.756655+0000","last_fullsized":"2023-09-13T09:38:12.756655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:16:13.987022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.169943+0000","last_change":"2023-09-13T09:38:09.702254+0000","last_active":"2023-09-13T09:38:11.169943+0000","last_peered":"2023-09-13T09:38:11.169943+0000","last_clean":"2023-09-13T09:38:11.169943+0000","last_became_active":"2023-09-13T09:38:09.701946+0000","last_became_peered":"2023-09-13T09:38:09.701946+0000","last_unstale":"2023-09-13T09:38:11.169943+0000","last_undegraded":"2023-09-13T09:38:11.169943+0000","last_fullsized":"2023-09-13T09:38:11.169943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:41.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.790992+0000","last_change":"2023-09-13T09:38:08.694692+0000","last_active":"2023-09-13T09:38:15.790992+0000","last_peered":"2023-09-13T09:38:15.790992+0000","last_clean":"2023-09-13T09:38:15.790992+0000","last_became_active":"2023-09-13T09:38:08.693799+0000","last_became_peered":"2023-09-13T09:38:08.693799+0000","last_unstale":"2023-09-13T09:38:15.790992+0000","last_undegraded":"2023-09-13T09:38:15.790992+0000","last_fullsized":"2023-09-13T09:38:15.790992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:53:57.188153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233050+0000","last_change":"2023-09-13T09:38:09.707954+0000","last_active":"2023-09-13T09:38:12.233050+0000","last_peered":"2023-09-13T09:38:12.233050+0000","last_clean":"2023-09-13T09:38:12.233050+0000","last_became_active":"2023-09-13T09:38:09.707659+0000","last_became_peered":"2023-09-13T09:38:09.707659+0000","last_unstale":"2023-09-13T09:38:12.233050+0000","last_undegraded":"2023-09-13T09:38:12.233050+0000","last_fullsized":"2023-09-13T09:38:12.233050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:34.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:17.123693+0000","last_change":"2023-09-13T09:38:08.696505+0000","last_active":"2023-09-13T09:38:17.123693+0000","last_peered":"2023-09-13T09:38:17.123693+0000","last_clean":"2023-09-13T09:38:17.123693+0000","last_became_active":"2023-09-13T09:38:08.696106+0000","last_became_peered":"2023-09-13T09:38:08.696106+0000","last_unstale":"2023-09-13T09:38:17.123693+0000","last_undegraded":"2023-09-13T09:38:17.123693+0000","last_fullsized":"2023-09-13T09:38:17.123693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:52:57.306234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171023+0000","last_change":"2023-09-13T09:38:09.700593+0000","last_active":"2023-09-13T09:38:11.171023+0000","last_peered":"2023-09-13T09:38:11.171023+0000","last_clean":"2023-09-13T09:38:11.171023+0000","last_became_active":"2023-09-13T09:38:09.700263+0000","last_became_peered":"2023-09-13T09:38:09.700263+0000","last_unstale":"2023-09-13T09:38:11.171023+0000","last_undegraded":"2023-09-13T09:38:11.171023+0000","last_fullsized":"2023-09-13T09:38:11.171023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:17:38.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.759212+0000","last_change":"2023-09-13T09:38:08.692455+0000","last_active":"2023-09-13T09:38:12.759212+0000","last_peered":"2023-09-13T09:38:12.759212+0000","last_clean":"2023-09-13T09:38:12.759212+0000","last_became_active":"2023-09-13T09:38:08.692118+0000","last_became_peered":"2023-09-13T09:38:08.692118+0000","last_unstale":"2023-09-13T09:38:12.759212+0000","last_undegraded":"2023-09-13T09:38:12.759212+0000","last_fullsized":"2023-09-13T09:38:12.759212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:33.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.695783+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.695473+0000","last_became_peered":"2023-09-13T09:38:09.695473+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:59.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":54,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:48.732817+0000","last_change":"2023-09-13T09:38:08.697468+0000","last_active":"2023-09-13T09:38:48.732817+0000","last_peered":"2023-09-13T09:38:48.732817+0000","last_clean":"2023-09-13T09:38:48.732817+0000","last_became_active":"2023-09-13T09:38:08.697141+0000","last_became_peered":"2023-09-13T09:38:08.697141+0000","last_unstale":"2023-09-13T09:38:48.732817+0000","last_undegraded":"2023-09-13T09:38:48.732817+0000","last_fullsized":"2023-09-13T09:38:48.732817+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:33:26.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":36,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171808+0000","last_change":"2023-09-13T09:38:09.703754+0000","last_active":"2023-09-13T09:38:11.171808+0000","last_peered":"2023-09-13T09:38:11.171808+0000","last_clean":"2023-09-13T09:38:11.171808+0000","last_became_active":"2023-09-13T09:38:09.703438+0000","last_became_peered":"2023-09-13T09:38:09.703438+0000","last_unstale":"2023-09-13T09:38:11.171808+0000","last_undegraded":"2023-09-13T09:38:11.171808+0000","last_fullsized":"2023-09-13T09:38:11.171808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:19.298385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.791780+0000","last_change":"2023-09-13T09:38:08.698973+0000","last_active":"2023-09-13T09:38:15.791780+0000","last_peered":"2023-09-13T09:38:15.791780+0000","last_clean":"2023-09-13T09:38:15.791780+0000","last_became_active":"2023-09-13T09:38:08.698329+0000","last_became_peered":"2023-09-13T09:38:08.698329+0000","last_unstale":"2023-09-13T09:38:15.791780+0000","last_undegraded":"2023-09-13T09:38:15.791780+0000","last_fullsized":"2023-09-13T09:38:15.791780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:10.684590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171550+0000","last_change":"2023-09-13T09:38:09.700216+0000","last_active":"2023-09-13T09:38:11.171550+0000","last_peered":"2023-09-13T09:38:11.171550+0000","last_clean":"2023-09-13T09:38:11.171550+0000","last_became_active":"2023-09-13T09:38:09.699876+0000","last_became_peered":"2023-09-13T09:38:09.699876+0000","last_unstale":"2023-09-13T09:38:11.171550+0000","last_undegraded":"2023-09-13T09:38:11.171550+0000","last_fullsized":"2023-09-13T09:38:11.171550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:33.347155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.788169+0000","last_change":"2023-09-13T09:38:08.696200+0000","last_active":"2023-09-13T09:38:15.788169+0000","last_peered":"2023-09-13T09:38:15.788169+0000","last_clean":"2023-09-13T09:38:15.788169+0000","last_became_active":"2023-09-13T09:38:08.695880+0000","last_became_peered":"2023-09-13T09:38:08.695880+0000","last_unstale":"2023-09-13T09:38:15.788169+0000","last_undegraded":"2023-09-13T09:38:15.788169+0000","last_fullsized":"2023-09-13T09:38:15.788169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:38.222209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171897+0000","last_change":"2023-09-13T09:38:09.703022+0000","last_active":"2023-09-13T09:38:11.171897+0000","last_peered":"2023-09-13T09:38:11.171897+0000","last_clean":"2023-09-13T09:38:11.171897+0000","last_became_active":"2023-09-13T09:38:09.702665+0000","last_became_peered":"2023-09-13T09:38:09.702665+0000","last_unstale":"2023-09-13T09:38:11.171897+0000","last_undegraded":"2023-09-13T09:38:11.171897+0000","last_fullsized":"2023-09-13T09:38:11.171897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:59.284385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233158+0000","last_change":"2023-09-13T09:38:09.708137+0000","last_active":"2023-09-13T09:38:12.233158+0000","last_peered":"2023-09-13T09:38:12.233158+0000","last_clean":"2023-09-13T09:38:12.233158+0000","last_became_active":"2023-09-13T09:38:09.707829+0000","last_became_peered":"2023-09-13T09:38:09.707829+0000","last_unstale":"2023-09-13T09:38:12.233158+0000","last_undegraded":"2023-09-13T09:38:12.233158+0000","last_fullsized":"2023-09-13T09:38:12.233158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:15.976098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170521+0000","last_change":"2023-09-13T09:38:09.703131+0000","last_active":"2023-09-13T09:38:11.170521+0000","last_peered":"2023-09-13T09:38:11.170521+0000","last_clean":"2023-09-13T09:38:11.170521+0000","last_became_active":"2023-09-13T09:38:09.702850+0000","last_became_peered":"2023-09-13T09:38:09.702850+0000","last_unstale":"2023-09-13T09:38:11.170521+0000","last_undegraded":"2023-09-13T09:38:11.170521+0000","last_fullsized":"2023-09-13T09:38:11.170521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:08.422038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170418+0000","last_change":"2023-09-13T09:38:09.701691+0000","last_active":"2023-09-13T09:38:11.170418+0000","last_peered":"2023-09-13T09:38:11.170418+0000","last_clean":"2023-09-13T09:38:11.170418+0000","last_became_active":"2023-09-13T09:38:09.701395+0000","last_became_peered":"2023-09-13T09:38:09.701395+0000","last_unstale":"2023-09-13T09:38:11.170418+0000","last_undegraded":"2023-09-13T09:38:11.170418+0000","last_fullsized":"2023-09-13T09:38:11.170418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:02.916712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170550+0000","last_change":"2023-09-13T09:38:09.706885+0000","last_active":"2023-09-13T09:38:11.170550+0000","last_peered":"2023-09-13T09:38:11.170550+0000","last_clean":"2023-09-13T09:38:11.170550+0000","last_became_active":"2023-09-13T09:38:09.706569+0000","last_became_peered":"2023-09-13T09:38:09.706569+0000","last_unstale":"2023-09-13T09:38:11.170550+0000","last_undegraded":"2023-09-13T09:38:11.170550+0000","last_fullsized":"2023-09-13T09:38:11.170550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:02.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683123+0000","last_change":"2023-09-13T09:38:09.698547+0000","last_active":"2023-09-13T09:38:10.683123+0000","last_peered":"2023-09-13T09:38:10.683123+0000","last_clean":"2023-09-13T09:38:10.683123+0000","last_became_active":"2023-09-13T09:38:09.698180+0000","last_became_peered":"2023-09-13T09:38:09.698180+0000","last_unstale":"2023-09-13T09:38:10.683123+0000","last_undegraded":"2023-09-13T09:38:10.683123+0000","last_fullsized":"2023-09-13T09:38:10.683123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:12.988597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233293+0000","last_change":"2023-09-13T09:38:09.706780+0000","last_active":"2023-09-13T09:38:12.233293+0000","last_peered":"2023-09-13T09:38:12.233293+0000","last_clean":"2023-09-13T09:38:12.233293+0000","last_became_active":"2023-09-13T09:38:09.706487+0000","last_became_peered":"2023-09-13T09:38:09.706487+0000","last_unstale":"2023-09-13T09:38:12.233293+0000","last_undegraded":"2023-09-13T09:38:12.233293+0000","last_fullsized":"2023-09-13T09:38:12.233293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:18:29.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170952+0000","last_change":"2023-09-13T09:38:09.695277+0000","last_active":"2023-09-13T09:38:11.170952+0000","last_peered":"2023-09-13T09:38:11.170952+0000","last_clean":"2023-09-13T09:38:11.170952+0000","last_became_active":"2023-09-13T09:38:09.694959+0000","last_became_peered":"2023-09-13T09:38:09.694959+0000","last_unstale":"2023-09-13T09:38:11.170952+0000","last_undegraded":"2023-09-13T09:38:11.170952+0000","last_fullsized":"2023-09-13T09:38:11.170952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:35:17.321069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171496+0000","last_change":"2023-09-13T09:38:09.702030+0000","last_active":"2023-09-13T09:38:11.171496+0000","last_peered":"2023-09-13T09:38:11.171496+0000","last_clean":"2023-09-13T09:38:11.171496+0000","last_became_active":"2023-09-13T09:38:09.701712+0000","last_became_peered":"2023-09-13T09:38:09.701712+0000","last_unstale":"2023-09-13T09:38:11.171496+0000","last_undegraded":"2023-09-13T09:38:11.171496+0000","last_fullsized":"2023-09-13T09:38:11.171496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:38.909533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683499+0000","last_change":"2023-09-13T09:38:09.706625+0000","last_active":"2023-09-13T09:38:10.683499+0000","last_peered":"2023-09-13T09:38:10.683499+0000","last_clean":"2023-09-13T09:38:10.683499+0000","last_became_active":"2023-09-13T09:38:09.706315+0000","last_became_peered":"2023-09-13T09:38:09.706315+0000","last_unstale":"2023-09-13T09:38:10.683499+0000","last_undegraded":"2023-09-13T09:38:10.683499+0000","last_fullsized":"2023-09-13T09:38:10.683499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:21.653592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171694+0000","last_change":"2023-09-13T09:38:09.703544+0000","last_active":"2023-09-13T09:38:11.171694+0000","last_peered":"2023-09-13T09:38:11.171694+0000","last_clean":"2023-09-13T09:38:11.171694+0000","last_became_active":"2023-09-13T09:38:09.702015+0000","last_became_peered":"2023-09-13T09:38:09.702015+0000","last_unstale":"2023-09-13T09:38:11.171694+0000","last_undegraded":"2023-09-13T09:38:11.171694+0000","last_fullsized":"2023-09-13T09:38:11.171694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:46:49.166965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170600+0000","last_change":"2023-09-13T09:38:09.694224+0000","last_active":"2023-09-13T09:38:11.170600+0000","last_peered":"2023-09-13T09:38:11.170600+0000","last_clean":"2023-09-13T09:38:11.170600+0000","last_became_active":"2023-09-13T09:38:09.693562+0000","last_became_peered":"2023-09-13T09:38:09.693562+0000","last_unstale":"2023-09-13T09:38:11.170600+0000","last_undegraded":"2023-09-13T09:38:11.170600+0000","last_fullsized":"2023-09-13T09:38:11.170600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:41:07.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683159+0000","last_change":"2023-09-13T09:38:09.698919+0000","last_active":"2023-09-13T09:38:10.683159+0000","last_peered":"2023-09-13T09:38:10.683159+0000","last_clean":"2023-09-13T09:38:10.683159+0000","last_became_active":"2023-09-13T09:38:09.698637+0000","last_became_peered":"2023-09-13T09:38:09.698637+0000","last_unstale":"2023-09-13T09:38:10.683159+0000","last_undegraded":"2023-09-13T09:38:10.683159+0000","last_fullsized":"2023-09-13T09:38:10.683159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:50.277687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233181+0000","last_change":"2023-09-13T09:38:09.705194+0000","last_active":"2023-09-13T09:38:12.233181+0000","last_peered":"2023-09-13T09:38:12.233181+0000","last_clean":"2023-09-13T09:38:12.233181+0000","last_became_active":"2023-09-13T09:38:09.704888+0000","last_became_peered":"2023-09-13T09:38:09.704888+0000","last_unstale":"2023-09-13T09:38:12.233181+0000","last_undegraded":"2023-09-13T09:38:12.233181+0000","last_fullsized":"2023-09-13T09:38:12.233181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:07.995177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61910,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":381,"num_read_kb":257,"num_write":229,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":185730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416404,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58199999999999996}]},{"osd":2,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":9,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.495}]},{"osd":10,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81799999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678041,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1081048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":1,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.878}]},{"osd":2,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.92000000000000004}]},{"osd":3,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.746}]},{"osd":4,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79900000000000004}]},{"osd":5,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":1.016}]},{"osd":6,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.96299999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.627},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58699999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.1000000000000001},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.90500000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":1.0589999999999999},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.94399999999999995}]},{"osd":11,"last update":"Wed Sep 13 09:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":1.141},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.98799999999999999}]}]},{"osd":9,"up_from":66,"seq":283467841564,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":435176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.438,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82999999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.74299999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.873}]},{"osd":3,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.32000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65300000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.378},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60499999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82499999999999996,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88,"5min":1.256,"15min":1.256},"last":0.66200000000000003}]},{"osd":5,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86699999999999999,"5min":1.117,"15min":1.117},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.70399999999999996,"15min":0.71799999999999997},"min":{"1min":0.496,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83499999999999996,"5min":1.002,"15min":1.002},"last":0.64200000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88200000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81399999999999995,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.53100000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.83199999999999996,"5min":1.204,"15min":1.204},"last":0.626},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85399999999999998,"5min":1.276,"15min":1.276},"last":0.55600000000000005}]},{"osd":8,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.85099999999999998},"min":{"1min":0.59999999999999998,"5min":0.501,"15min":0.501},"max":{"1min":0.86699999999999999,"5min":1.224,"15min":1.224},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.84999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.75900000000000001}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.91900000000000004}]}]},{"osd":8,"up_from":58,"seq":249108103201,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":435223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68600000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.755}]},{"osd":1,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.48299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65500000000000003}]},{"osd":2,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46500000000000002},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.64200000000000002,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.9850000000000003,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78800000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.38900000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72599999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":6.0179999999999998,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.754,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.77100000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80900000000000005}]},{"osd":9,"last update":"Wed Sep 13 09:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.872},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90600000000000003}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]}]},{"osd":7,"up_from":50,"seq":214748364837,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1536000,"data_stored":1028467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69699999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53400000000000003}]},{"osd":2,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84399999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.81100000000000005}]},{"osd":3,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.629}]},{"osd":4,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.50700000000000001}]},{"osd":5,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.93100000000000005}]},{"osd":6,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.095,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.61499999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.56799999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.84599999999999997}]},{"osd":9,"last update":"Wed Sep 13 09:37:49 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"min":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.76500000000000001}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.97899999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.026}]}]},{"osd":6,"up_from":45,"seq":193273528362,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":434899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.40200000000000002},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.38500000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63500000000000001,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.442,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.58699999999999997}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.40899999999999997}]},{"osd":4,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.63900000000000001},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.496},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95299999999999996,"5min":1.101,"15min":1.101},"last":0.50900000000000001}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.55700000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.60999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.113,"5min":1.143,"15min":1.143},"last":0.66400000000000003}]},{"osd":8,"last update":"Wed Sep 13 09:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":0.624},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.121,"15min":1.121},"last":0.52800000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.81899999999999995},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92900000000000005,"5min":1.264,"15min":1.264},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.45400000000000001}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.70399999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":490514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.52100000000000002},"min":{"1min":0.44700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Sep 13 09:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.57599999999999996,"15min":0.53600000000000003},"min":{"1min":0.499,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Wed Sep 13 09:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64900000000000002,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.83399999999999996}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":1.077},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.51900000000000002,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.90100000000000002}]},{"osd":5,"last update":"Wed Sep 13 09:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.59099999999999997,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89400000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.64800000000000002,"15min":0.61299999999999999},"min":{"1min":0.48199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.1000000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":1.026}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.276},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.159}]},{"osd":8,"last update":"Wed Sep 13 09:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.80100000000000005,"15min":0.78600000000000003},"min":{"1min":0.61599999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.141}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81899999999999995,"15min":0.81699999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.238}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.1679999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":436232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36299999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91100000000000003,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"min":{"1min":0.38700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.86199999999999999,"5min":1.47,"15min":1.47},"last":0.433}]},{"osd":2,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.54400000000000004},"min":{"1min":0.42699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58799999999999997,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.97599999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.751,"5min":1.288,"15min":1.288},"last":0.501}]},{"osd":5,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.57799999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69299999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.143,"15min":1.143},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.056,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68700000000000006}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.629,"5min":0.80000000000000004,"15min":0.82799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60099999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53100000000000003}]},{"osd":11,"last update":"Wed Sep 13 09:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64900000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411387,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":491124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51600000000000001,"15min":0.47899999999999998},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.53500000000000003,"15min":0.49399999999999999},"min":{"1min":0.40799999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.70999999999999996}]},{"osd":1,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.51600000000000001},"min":{"1min":0.42299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91800000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.878}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.751,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.48899999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.627,"15min":0.60099999999999998},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.83599999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.45000000000000001},"min":{"1min":0.35099999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.81999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.752},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.57199999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.56000000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1,"15min":1},"last":0.78500000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65600000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751}]},{"osd":8,"last update":"Wed Sep 13 09:38:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.82699999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60899999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.59299999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.91000000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]}]},{"osd":3,"up_from":25,"seq":107374182454,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":434399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.55600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81699999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.51900000000000002},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69899999999999995,"5min":1.649,"15min":1.649},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":2.238,"15min":2.238},"last":0.59999999999999998}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.56100000000000005},"min":{"1min":0.47099999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.57299999999999995}]},{"osd":5,"last update":"Wed Sep 13 09:38:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.626},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90200000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53800000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98899999999999999,"5min":1.02,"15min":1.02},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":1.071,"15min":1.071},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.60899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.175,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73799999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":1.109,"15min":1.109},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.55200000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.748},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.79000000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":32,"seq":137438953522,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.53100000000000003},"min":{"1min":0.44700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.335,"5min":3.335,"15min":3.335},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.41399999999999998,"15min":0.38900000000000001},"min":{"1min":0.34000000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.495}]},{"osd":2,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60499999999999998,"15min":0.57099999999999995},"min":{"1min":0.51100000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5230000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.504,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66500000000000004,"15min":0.63900000000000001},"min":{"1min":0.53400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71999999999999997}]},{"osd":6,"last update":"Wed Sep 13 09:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98399999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.87,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66100000000000003}]},{"osd":8,"last update":"Wed Sep 13 09:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.61199999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.048,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85999999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.4470000000000001},"last":0.70499999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1548288,"data_stored":1027755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50600000000000001,"15min":0.48799999999999999},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.77800000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83199999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.39600000000000002},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44,"15min":0.41399999999999998},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.433}]},{"osd":3,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81000000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.59999999999999998,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76600000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":1.044,"15min":1.044},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92500000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.73399999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.5},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.81999999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63100000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.57999999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82899999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T09:38:55.331 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph pg dump --format=json 2023-09-13T09:38:55.894 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:56.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:55 smithi006 ceph-mon[98665]: pgmap v278: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2023-09-13T09:38:56.126 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:55 smithi006 ceph-mon[98665]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:55 smithi053 ceph-mon[102373]: pgmap v278: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2023-09-13T09:38:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:55 smithi053 ceph-mon[102373]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:55 smithi131 ceph-mon[102785]: pgmap v278: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2023-09-13T09:38:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:55 smithi131 ceph-mon[102785]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:57.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 -- 172.21.15.6:0/1026530511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 msgr2=0x7f3f6010ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 --2- 172.21.15.6:0/1026530511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f6010ca90 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f3f5800b0d0 tx=0x7f3f5800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 -- 172.21.15.6:0/1026530511 shutdown_connections 2023-09-13T09:38:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 --2- 172.21.15.6:0/1026530511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f6010ca90 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 --2- 172.21.15.6:0/1026530511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f60105c70 0x7f3f60106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 --2- 172.21.15.6:0/1026530511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f600ffc60 0x7f3f601000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 -- 172.21.15.6:0/1026530511 >> 172.21.15.6:0/1026530511 conn(0x7f3f60075c00 msgr2=0x7f3f60076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 -- 172.21.15.6:0/1026530511 shutdown_connections 2023-09-13T09:38:57.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.117+0000 7f3f675f4700 1 -- 172.21.15.6:0/1026530511 wait complete. 2023-09-13T09:38:57.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 Processor -- start 2023-09-13T09:38:57.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 -- start start 2023-09-13T09:38:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f600ffc60 0x7f3f60195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f60196310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f60105c70 0x7f3f6019a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6019ad90 con 0x7f3f60100620 2023-09-13T09:38:57.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6019af00 con 0x7f3f60105c70 2023-09-13T09:38:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f675f4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f6019b0c0 con 0x7f3f600ffc60 2023-09-13T09:38:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f60196310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f60196310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32818/0 (socket says 172.21.15.6:32818) 2023-09-13T09:38:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 -- 172.21.15.6:0/3617045175 learned_addr learned my addr 172.21.15.6:0/3617045175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:57.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f65b91700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f60105c70 0x7f3f6019a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 -- 172.21.15.6:0/3617045175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f600ffc60 msgr2=0x7f3f60195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f65390700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f600ffc60 0x7f3f60195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f600ffc60 0x7f3f60195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 -- 172.21.15.6:0/3617045175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f60105c70 msgr2=0x7f3f6019a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:57.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f60105c70 0x7f3f6019a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f64b8f700 1 -- 172.21.15.6:0/3617045175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f58009d00 con 0x7f3f60100620 2023-09-13T09:38:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f65b91700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f60105c70 0x7f3f6019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.118+0000 7f3f65390700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f600ffc60 0x7f3f60195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:38:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.119+0000 7f3f64b8f700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f60196310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009970 tx=0x7f3f5c009d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:57.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.119+0000 7f3f527fc700 1 -- 172.21.15.6:0/3617045175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c012070 con 0x7f3f60100620 2023-09-13T09:38:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.119+0000 7f3f527fc700 1 -- 172.21.15.6:0/3617045175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3f5c00d260 con 0x7f3f60100620 2023-09-13T09:38:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.119+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f6019b3a0 con 0x7f3f60100620 2023-09-13T09:38:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.119+0000 7f3f527fc700 1 -- 172.21.15.6:0/3617045175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5c017a60 con 0x7f3f60100620 2023-09-13T09:38:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.119+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f60068970 con 0x7f3f60100620 2023-09-13T09:38:57.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.120+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f6004e9b0 con 0x7f3f60100620 2023-09-13T09:38:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.121+0000 7f3f527fc700 1 -- 172.21.15.6:0/3617045175 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f3f5c017bc0 con 0x7f3f60100620 2023-09-13T09:38:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.121+0000 7f3f527fc700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3f4c0a0750 0x7f3f4c0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.121+0000 7f3f527fc700 1 -- 172.21.15.6:0/3617045175 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3f5c0ccf20 con 0x7f3f60100620 2023-09-13T09:38:57.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.121+0000 7f3f65390700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3f4c0a0750 0x7f3f4c0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.122+0000 7f3f65390700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3f4c0a0750 0x7f3f4c0a2c10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f54005fd0 tx=0x7f3f54005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:57.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.125+0000 7f3f527fc700 1 -- 172.21.15.6:0/3617045175 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3f5c096aa0 con 0x7f3f60100620 2023-09-13T09:38:57.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.321+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f6010fd30 con 0x7f3f4c0a0750 2023-09-13T09:38:57.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.334+0000 7f3f527fc700 1 -- 172.21.15.6:0/3617045175 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+340315 (secure 0 0 0) 0x7f3f6010fd30 con 0x7f3f4c0a0750 2023-09-13T09:38:57.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3f4c0a0750 msgr2=0x7f3f4c0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3f4c0a0750 0x7f3f4c0a2c10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f54005fd0 tx=0x7f3f54005ee0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 msgr2=0x7f3f60196310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f60196310 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3f5c009970 tx=0x7f3f5c009d30 comp rx=0 tx=0).stop 2023-09-13T09:38:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 shutdown_connections 2023-09-13T09:38:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3f60105c70 0x7f3f6019a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f600ffc60 0x7f3f60195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3f4c0a0750 0x7f3f4c0a2c10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 --2- 172.21.15.6:0/3617045175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f60100620 0x7f3f60196310 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 >> 172.21.15.6:0/3617045175 conn(0x7f3f60075c00 msgr2=0x7f3f601039d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 shutdown_connections 2023-09-13T09:38:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:57.337+0000 7f3f675f4700 1 -- 172.21.15.6:0/3617045175 wait complete. 2023-09-13T09:38:57.344 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-09-13T09:38:57.754 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2023-09-13T09:38:56.150863+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":652524,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":547,"num_read_kb":391,"num_write":412,"num_write_kb":3064,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":340,"ondisk_log_size":340,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337092,"kb_used_data":12900,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604732,"statfs":{"total":1151940427776,"available":1151595245568,"internally_reserved":0,"allocated":13209600,"data_stored":7165227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":72,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003156"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233536+0000","last_change":"2023-09-13T09:38:09.701485+0000","last_active":"2023-09-13T09:38:12.233536+0000","last_peered":"2023-09-13T09:38:12.233536+0000","last_clean":"2023-09-13T09:38:12.233536+0000","last_became_active":"2023-09-13T09:38:09.701160+0000","last_became_peered":"2023-09-13T09:38:09.701160+0000","last_unstale":"2023-09-13T09:38:12.233536+0000","last_undegraded":"2023-09-13T09:38:12.233536+0000","last_fullsized":"2023-09-13T09:38:12.233536+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:10.089322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171037+0000","last_change":"2023-09-13T09:38:09.697198+0000","last_active":"2023-09-13T09:38:11.171037+0000","last_peered":"2023-09-13T09:38:11.171037+0000","last_clean":"2023-09-13T09:38:11.171037+0000","last_became_active":"2023-09-13T09:38:09.696859+0000","last_became_peered":"2023-09-13T09:38:09.696859+0000","last_unstale":"2023-09-13T09:38:11.171037+0000","last_undegraded":"2023-09-13T09:38:11.171037+0000","last_fullsized":"2023-09-13T09:38:11.171037+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:53.601426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170662+0000","last_change":"2023-09-13T09:38:09.696150+0000","last_active":"2023-09-13T09:38:11.170662+0000","last_peered":"2023-09-13T09:38:11.170662+0000","last_clean":"2023-09-13T09:38:11.170662+0000","last_became_active":"2023-09-13T09:38:09.695893+0000","last_became_peered":"2023-09-13T09:38:09.695893+0000","last_unstale":"2023-09-13T09:38:11.170662+0000","last_undegraded":"2023-09-13T09:38:11.170662+0000","last_fullsized":"2023-09-13T09:38:11.170662+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:51.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171082+0000","last_change":"2023-09-13T09:38:09.697564+0000","last_active":"2023-09-13T09:38:11.171082+0000","last_peered":"2023-09-13T09:38:11.171082+0000","last_clean":"2023-09-13T09:38:11.171082+0000","last_became_active":"2023-09-13T09:38:09.697235+0000","last_became_peered":"2023-09-13T09:38:09.697235+0000","last_unstale":"2023-09-13T09:38:11.171082+0000","last_undegraded":"2023-09-13T09:38:11.171082+0000","last_fullsized":"2023-09-13T09:38:11.171082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:49.705452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170159+0000","last_change":"2023-09-13T09:38:09.702889+0000","last_active":"2023-09-13T09:38:11.170159+0000","last_peered":"2023-09-13T09:38:11.170159+0000","last_clean":"2023-09-13T09:38:11.170159+0000","last_became_active":"2023-09-13T09:38:09.702589+0000","last_became_peered":"2023-09-13T09:38:09.702589+0000","last_unstale":"2023-09-13T09:38:11.170159+0000","last_undegraded":"2023-09-13T09:38:11.170159+0000","last_fullsized":"2023-09-13T09:38:11.170159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:56:05.432576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683357+0000","last_change":"2023-09-13T09:38:09.697097+0000","last_active":"2023-09-13T09:38:10.683357+0000","last_peered":"2023-09-13T09:38:10.683357+0000","last_clean":"2023-09-13T09:38:10.683357+0000","last_became_active":"2023-09-13T09:38:09.696770+0000","last_became_peered":"2023-09-13T09:38:09.696770+0000","last_unstale":"2023-09-13T09:38:10.683357+0000","last_undegraded":"2023-09-13T09:38:10.683357+0000","last_fullsized":"2023-09-13T09:38:10.683357+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:48:46.305472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171571+0000","last_change":"2023-09-13T09:38:09.700506+0000","last_active":"2023-09-13T09:38:11.171571+0000","last_peered":"2023-09-13T09:38:11.171571+0000","last_clean":"2023-09-13T09:38:11.171571+0000","last_became_active":"2023-09-13T09:38:09.700178+0000","last_became_peered":"2023-09-13T09:38:09.700178+0000","last_unstale":"2023-09-13T09:38:11.171571+0000","last_undegraded":"2023-09-13T09:38:11.171571+0000","last_fullsized":"2023-09-13T09:38:11.171571+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:04.261443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170488+0000","last_change":"2023-09-13T09:38:09.703191+0000","last_active":"2023-09-13T09:38:11.170488+0000","last_peered":"2023-09-13T09:38:11.170488+0000","last_clean":"2023-09-13T09:38:11.170488+0000","last_became_active":"2023-09-13T09:38:09.702874+0000","last_became_peered":"2023-09-13T09:38:09.702874+0000","last_unstale":"2023-09-13T09:38:11.170488+0000","last_undegraded":"2023-09-13T09:38:11.170488+0000","last_fullsized":"2023-09-13T09:38:11.170488+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:50:25.759861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171171+0000","last_change":"2023-09-13T09:38:09.700416+0000","last_active":"2023-09-13T09:38:11.171171+0000","last_peered":"2023-09-13T09:38:11.171171+0000","last_clean":"2023-09-13T09:38:11.171171+0000","last_became_active":"2023-09-13T09:38:09.700102+0000","last_became_peered":"2023-09-13T09:38:09.700102+0000","last_unstale":"2023-09-13T09:38:11.171171+0000","last_undegraded":"2023-09-13T09:38:11.171171+0000","last_fullsized":"2023-09-13T09:38:11.171171+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:53.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683677+0000","last_change":"2023-09-13T09:38:09.702609+0000","last_active":"2023-09-13T09:38:10.683677+0000","last_peered":"2023-09-13T09:38:10.683677+0000","last_clean":"2023-09-13T09:38:10.683677+0000","last_became_active":"2023-09-13T09:38:09.702244+0000","last_became_peered":"2023-09-13T09:38:09.702244+0000","last_unstale":"2023-09-13T09:38:10.683677+0000","last_undegraded":"2023-09-13T09:38:10.683677+0000","last_fullsized":"2023-09-13T09:38:10.683677+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:08:30.911492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171785+0000","last_change":"2023-09-13T09:38:09.694245+0000","last_active":"2023-09-13T09:38:11.171785+0000","last_peered":"2023-09-13T09:38:11.171785+0000","last_clean":"2023-09-13T09:38:11.171785+0000","last_became_active":"2023-09-13T09:38:09.693939+0000","last_became_peered":"2023-09-13T09:38:09.693939+0000","last_unstale":"2023-09-13T09:38:11.171785+0000","last_undegraded":"2023-09-13T09:38:11.171785+0000","last_fullsized":"2023-09-13T09:38:11.171785+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:08.383075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171904+0000","last_change":"2023-09-13T09:38:09.696680+0000","last_active":"2023-09-13T09:38:11.171904+0000","last_peered":"2023-09-13T09:38:11.171904+0000","last_clean":"2023-09-13T09:38:11.171904+0000","last_became_active":"2023-09-13T09:38:09.696369+0000","last_became_peered":"2023-09-13T09:38:09.696369+0000","last_unstale":"2023-09-13T09:38:11.171904+0000","last_undegraded":"2023-09-13T09:38:11.171904+0000","last_fullsized":"2023-09-13T09:38:11.171904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:48.111921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683082+0000","last_change":"2023-09-13T09:38:09.703214+0000","last_active":"2023-09-13T09:38:10.683082+0000","last_peered":"2023-09-13T09:38:10.683082+0000","last_clean":"2023-09-13T09:38:10.683082+0000","last_became_active":"2023-09-13T09:38:09.702815+0000","last_became_peered":"2023-09-13T09:38:09.702815+0000","last_unstale":"2023-09-13T09:38:10.683082+0000","last_undegraded":"2023-09-13T09:38:10.683082+0000","last_fullsized":"2023-09-13T09:38:10.683082+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:46.437548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171130+0000","last_change":"2023-09-13T09:38:09.699968+0000","last_active":"2023-09-13T09:38:11.171130+0000","last_peered":"2023-09-13T09:38:11.171130+0000","last_clean":"2023-09-13T09:38:11.171130+0000","last_became_active":"2023-09-13T09:38:09.699643+0000","last_became_peered":"2023-09-13T09:38:09.699643+0000","last_unstale":"2023-09-13T09:38:11.171130+0000","last_undegraded":"2023-09-13T09:38:11.171130+0000","last_fullsized":"2023-09-13T09:38:11.171130+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:41:40.550328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.694517+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.691295+0000","last_became_peered":"2023-09-13T09:38:09.691295+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:48:40.291170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170268+0000","last_change":"2023-09-13T09:38:09.695903+0000","last_active":"2023-09-13T09:38:11.170268+0000","last_peered":"2023-09-13T09:38:11.170268+0000","last_clean":"2023-09-13T09:38:11.170268+0000","last_became_active":"2023-09-13T09:38:09.695585+0000","last_became_peered":"2023-09-13T09:38:09.695585+0000","last_unstale":"2023-09-13T09:38:11.170268+0000","last_undegraded":"2023-09-13T09:38:11.170268+0000","last_fullsized":"2023-09-13T09:38:11.170268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:13.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233581+0000","last_change":"2023-09-13T09:38:09.702485+0000","last_active":"2023-09-13T09:38:12.233581+0000","last_peered":"2023-09-13T09:38:12.233581+0000","last_clean":"2023-09-13T09:38:12.233581+0000","last_became_active":"2023-09-13T09:38:09.701989+0000","last_became_peered":"2023-09-13T09:38:09.701989+0000","last_unstale":"2023-09-13T09:38:12.233581+0000","last_undegraded":"2023-09-13T09:38:12.233581+0000","last_fullsized":"2023-09-13T09:38:12.233581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:58.832560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170815+0000","last_change":"2023-09-13T09:38:09.695080+0000","last_active":"2023-09-13T09:38:11.170815+0000","last_peered":"2023-09-13T09:38:11.170815+0000","last_clean":"2023-09-13T09:38:11.170815+0000","last_became_active":"2023-09-13T09:38:09.694782+0000","last_became_peered":"2023-09-13T09:38:09.694782+0000","last_unstale":"2023-09-13T09:38:11.170815+0000","last_undegraded":"2023-09-13T09:38:11.170815+0000","last_fullsized":"2023-09-13T09:38:11.170815+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:15.146156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170850+0000","last_change":"2023-09-13T09:38:09.702456+0000","last_active":"2023-09-13T09:38:11.170850+0000","last_peered":"2023-09-13T09:38:11.170850+0000","last_clean":"2023-09-13T09:38:11.170850+0000","last_became_active":"2023-09-13T09:38:09.702171+0000","last_became_peered":"2023-09-13T09:38:09.702171+0000","last_unstale":"2023-09-13T09:38:11.170850+0000","last_undegraded":"2023-09-13T09:38:11.170850+0000","last_fullsized":"2023-09-13T09:38:11.170850+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:32.995619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"84'13","reported_seq":66,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:53.738208+0000","last_change":"2023-09-13T09:38:08.692389+0000","last_active":"2023-09-13T09:38:53.738208+0000","last_peered":"2023-09-13T09:38:53.738208+0000","last_clean":"2023-09-13T09:38:53.738208+0000","last_became_active":"2023-09-13T09:38:08.692022+0000","last_became_peered":"2023-09-13T09:38:08.692022+0000","last_unstale":"2023-09-13T09:38:53.738208+0000","last_undegraded":"2023-09-13T09:38:53.738208+0000","last_fullsized":"2023-09-13T09:38:53.738208+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:58:40.288839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170755+0000","last_change":"2023-09-13T09:38:09.704712+0000","last_active":"2023-09-13T09:38:11.170755+0000","last_peered":"2023-09-13T09:38:11.170755+0000","last_clean":"2023-09-13T09:38:11.170755+0000","last_became_active":"2023-09-13T09:38:09.704379+0000","last_became_peered":"2023-09-13T09:38:09.704379+0000","last_unstale":"2023-09-13T09:38:11.170755+0000","last_undegraded":"2023-09-13T09:38:11.170755+0000","last_fullsized":"2023-09-13T09:38:11.170755+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:47.605987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170899+0000","last_change":"2023-09-13T09:38:08.694408+0000","last_active":"2023-09-13T09:38:11.170899+0000","last_peered":"2023-09-13T09:38:11.170899+0000","last_clean":"2023-09-13T09:38:11.170899+0000","last_became_active":"2023-09-13T09:38:08.693140+0000","last_became_peered":"2023-09-13T09:38:08.693140+0000","last_unstale":"2023-09-13T09:38:11.170899+0000","last_undegraded":"2023-09-13T09:38:11.170899+0000","last_fullsized":"2023-09-13T09:38:11.170899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:27:22.637489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171299+0000","last_change":"2023-09-13T09:38:09.705381+0000","last_active":"2023-09-13T09:38:11.171299+0000","last_peered":"2023-09-13T09:38:11.171299+0000","last_clean":"2023-09-13T09:38:11.171299+0000","last_became_active":"2023-09-13T09:38:09.705059+0000","last_became_peered":"2023-09-13T09:38:09.705059+0000","last_unstale":"2023-09-13T09:38:11.171299+0000","last_undegraded":"2023-09-13T09:38:11.171299+0000","last_fullsized":"2023-09-13T09:38:11.171299+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:11.294362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:16.681499+0000","last_change":"2023-09-13T09:38:08.695077+0000","last_active":"2023-09-13T09:38:16.681499+0000","last_peered":"2023-09-13T09:38:16.681499+0000","last_clean":"2023-09-13T09:38:16.681499+0000","last_became_active":"2023-09-13T09:38:08.694778+0000","last_became_peered":"2023-09-13T09:38:08.694778+0000","last_unstale":"2023-09-13T09:38:16.681499+0000","last_undegraded":"2023-09-13T09:38:16.681499+0000","last_fullsized":"2023-09-13T09:38:16.681499+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:31.517739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170421+0000","last_change":"2023-09-13T09:38:09.696875+0000","last_active":"2023-09-13T09:38:11.170421+0000","last_peered":"2023-09-13T09:38:11.170421+0000","last_clean":"2023-09-13T09:38:11.170421+0000","last_became_active":"2023-09-13T09:38:09.696060+0000","last_became_peered":"2023-09-13T09:38:09.696060+0000","last_unstale":"2023-09-13T09:38:11.170421+0000","last_undegraded":"2023-09-13T09:38:11.170421+0000","last_fullsized":"2023-09-13T09:38:11.170421+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:55.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.790670+0000","last_change":"2023-09-13T09:38:08.692583+0000","last_active":"2023-09-13T09:38:15.790670+0000","last_peered":"2023-09-13T09:38:15.790670+0000","last_clean":"2023-09-13T09:38:15.790670+0000","last_became_active":"2023-09-13T09:38:08.692266+0000","last_became_peered":"2023-09-13T09:38:08.692266+0000","last_unstale":"2023-09-13T09:38:15.790670+0000","last_undegraded":"2023-09-13T09:38:15.790670+0000","last_fullsized":"2023-09-13T09:38:15.790670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:37.827191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683948+0000","last_change":"2023-09-13T09:38:09.705855+0000","last_active":"2023-09-13T09:38:10.683948+0000","last_peered":"2023-09-13T09:38:10.683948+0000","last_clean":"2023-09-13T09:38:10.683948+0000","last_became_active":"2023-09-13T09:38:09.705518+0000","last_became_peered":"2023-09-13T09:38:09.705518+0000","last_unstale":"2023-09-13T09:38:10.683948+0000","last_undegraded":"2023-09-13T09:38:10.683948+0000","last_fullsized":"2023-09-13T09:38:10.683948+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:02.403984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:51.736899+0000","last_change":"2023-09-13T09:38:08.697396+0000","last_active":"2023-09-13T09:38:51.736899+0000","last_peered":"2023-09-13T09:38:51.736899+0000","last_clean":"2023-09-13T09:38:51.736899+0000","last_became_active":"2023-09-13T09:38:08.697067+0000","last_became_peered":"2023-09-13T09:38:08.697067+0000","last_unstale":"2023-09-13T09:38:51.736899+0000","last_undegraded":"2023-09-13T09:38:51.736899+0000","last_fullsized":"2023-09-13T09:38:51.736899+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:59.971250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":39,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170184+0000","last_change":"2023-09-13T09:38:09.701311+0000","last_active":"2023-09-13T09:38:11.170184+0000","last_peered":"2023-09-13T09:38:11.170184+0000","last_clean":"2023-09-13T09:38:11.170184+0000","last_became_active":"2023-09-13T09:38:09.700995+0000","last_became_peered":"2023-09-13T09:38:09.700995+0000","last_unstale":"2023-09-13T09:38:11.170184+0000","last_undegraded":"2023-09-13T09:38:11.170184+0000","last_fullsized":"2023-09-13T09:38:11.170184+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:08.744780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.780227+0000","last_change":"2023-09-13T09:38:08.691337+0000","last_active":"2023-09-13T09:38:14.780227+0000","last_peered":"2023-09-13T09:38:14.780227+0000","last_clean":"2023-09-13T09:38:14.780227+0000","last_became_active":"2023-09-13T09:38:08.690948+0000","last_became_peered":"2023-09-13T09:38:08.690948+0000","last_unstale":"2023-09-13T09:38:14.780227+0000","last_undegraded":"2023-09-13T09:38:14.780227+0000","last_fullsized":"2023-09-13T09:38:14.780227+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:33.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683697+0000","last_change":"2023-09-13T09:38:09.706627+0000","last_active":"2023-09-13T09:38:10.683697+0000","last_peered":"2023-09-13T09:38:10.683697+0000","last_clean":"2023-09-13T09:38:10.683697+0000","last_became_active":"2023-09-13T09:38:09.706328+0000","last_became_peered":"2023-09-13T09:38:09.706328+0000","last_unstale":"2023-09-13T09:38:10.683697+0000","last_undegraded":"2023-09-13T09:38:10.683697+0000","last_fullsized":"2023-09-13T09:38:10.683697+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:22:09.785744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.767182+0000","last_change":"2023-09-13T09:38:08.692201+0000","last_active":"2023-09-13T09:38:13.767182+0000","last_peered":"2023-09-13T09:38:13.767182+0000","last_clean":"2023-09-13T09:38:13.767182+0000","last_became_active":"2023-09-13T09:38:08.691334+0000","last_became_peered":"2023-09-13T09:38:08.691334+0000","last_unstale":"2023-09-13T09:38:13.767182+0000","last_undegraded":"2023-09-13T09:38:13.767182+0000","last_fullsized":"2023-09-13T09:38:13.767182+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:13.098275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170633+0000","last_change":"2023-09-13T09:38:09.701125+0000","last_active":"2023-09-13T09:38:11.170633+0000","last_peered":"2023-09-13T09:38:11.170633+0000","last_clean":"2023-09-13T09:38:11.170633+0000","last_became_active":"2023-09-13T09:38:09.700055+0000","last_became_peered":"2023-09-13T09:38:09.700055+0000","last_unstale":"2023-09-13T09:38:11.170633+0000","last_undegraded":"2023-09-13T09:38:11.170633+0000","last_fullsized":"2023-09-13T09:38:11.170633+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:17.787363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.792594+0000","last_change":"2023-09-13T09:38:08.696797+0000","last_active":"2023-09-13T09:38:15.792594+0000","last_peered":"2023-09-13T09:38:15.792594+0000","last_clean":"2023-09-13T09:38:15.792594+0000","last_became_active":"2023-09-13T09:38:08.696494+0000","last_became_peered":"2023-09-13T09:38:08.696494+0000","last_unstale":"2023-09-13T09:38:15.792594+0000","last_undegraded":"2023-09-13T09:38:15.792594+0000","last_fullsized":"2023-09-13T09:38:15.792594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:29.454184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170422+0000","last_change":"2023-09-13T09:38:09.694166+0000","last_active":"2023-09-13T09:38:11.170422+0000","last_peered":"2023-09-13T09:38:11.170422+0000","last_clean":"2023-09-13T09:38:11.170422+0000","last_became_active":"2023-09-13T09:38:09.693894+0000","last_became_peered":"2023-09-13T09:38:09.693894+0000","last_unstale":"2023-09-13T09:38:11.170422+0000","last_undegraded":"2023-09-13T09:38:11.170422+0000","last_fullsized":"2023-09-13T09:38:11.170422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:27:35.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":95,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:54.740245+0000","last_change":"2023-09-13T09:38:08.693649+0000","last_active":"2023-09-13T09:38:54.740245+0000","last_peered":"2023-09-13T09:38:54.740245+0000","last_clean":"2023-09-13T09:38:54.740245+0000","last_became_active":"2023-09-13T09:38:08.693289+0000","last_became_peered":"2023-09-13T09:38:08.693289+0000","last_unstale":"2023-09-13T09:38:54.740245+0000","last_undegraded":"2023-09-13T09:38:54.740245+0000","last_fullsized":"2023-09-13T09:38:54.740245+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:39:27.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170787+0000","last_change":"2023-09-13T09:38:09.693872+0000","last_active":"2023-09-13T09:38:11.170787+0000","last_peered":"2023-09-13T09:38:11.170787+0000","last_clean":"2023-09-13T09:38:11.170787+0000","last_became_active":"2023-09-13T09:38:09.693445+0000","last_became_peered":"2023-09-13T09:38:09.693445+0000","last_unstale":"2023-09-13T09:38:11.170787+0000","last_undegraded":"2023-09-13T09:38:11.170787+0000","last_fullsized":"2023-09-13T09:38:11.170787+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:29:35.717276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.791218+0000","last_change":"2023-09-13T09:38:08.696375+0000","last_active":"2023-09-13T09:38:15.791218+0000","last_peered":"2023-09-13T09:38:15.791218+0000","last_clean":"2023-09-13T09:38:15.791218+0000","last_became_active":"2023-09-13T09:38:08.695799+0000","last_became_peered":"2023-09-13T09:38:08.695799+0000","last_unstale":"2023-09-13T09:38:15.791218+0000","last_undegraded":"2023-09-13T09:38:15.791218+0000","last_fullsized":"2023-09-13T09:38:15.791218+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:09.255704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171326+0000","last_change":"2023-09-13T09:38:09.706518+0000","last_active":"2023-09-13T09:38:11.171326+0000","last_peered":"2023-09-13T09:38:11.171326+0000","last_clean":"2023-09-13T09:38:11.171326+0000","last_became_active":"2023-09-13T09:38:09.706083+0000","last_became_peered":"2023-09-13T09:38:09.706083+0000","last_unstale":"2023-09-13T09:38:11.171326+0000","last_undegraded":"2023-09-13T09:38:11.171326+0000","last_fullsized":"2023-09-13T09:38:11.171326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:21:53.831430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.779289+0000","last_change":"2023-09-13T09:38:08.697878+0000","last_active":"2023-09-13T09:38:14.779289+0000","last_peered":"2023-09-13T09:38:14.779289+0000","last_clean":"2023-09-13T09:38:14.779289+0000","last_became_active":"2023-09-13T09:38:08.697476+0000","last_became_peered":"2023-09-13T09:38:08.697476+0000","last_unstale":"2023-09-13T09:38:14.779289+0000","last_undegraded":"2023-09-13T09:38:14.779289+0000","last_fullsized":"2023-09-13T09:38:14.779289+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:09.021111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170664+0000","last_change":"2023-09-13T09:38:09.697144+0000","last_active":"2023-09-13T09:38:11.170664+0000","last_peered":"2023-09-13T09:38:11.170664+0000","last_clean":"2023-09-13T09:38:11.170664+0000","last_became_active":"2023-09-13T09:38:09.696521+0000","last_became_peered":"2023-09-13T09:38:09.696521+0000","last_unstale":"2023-09-13T09:38:11.170664+0000","last_undegraded":"2023-09-13T09:38:11.170664+0000","last_fullsized":"2023-09-13T09:38:11.170664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:36:17.096644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'28","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:54.740333+0000","last_change":"2023-09-13T09:38:08.694981+0000","last_active":"2023-09-13T09:38:54.740333+0000","last_peered":"2023-09-13T09:38:54.740333+0000","last_clean":"2023-09-13T09:38:54.740333+0000","last_became_active":"2023-09-13T09:38:08.694630+0000","last_became_peered":"2023-09-13T09:38:08.694630+0000","last_unstale":"2023-09-13T09:38:54.740333+0000","last_undegraded":"2023-09-13T09:38:54.740333+0000","last_fullsized":"2023-09-13T09:38:54.740333+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:56:58.204622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54708,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":83,"num_read_kb":95,"num_write":30,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170585+0000","last_change":"2023-09-13T09:38:09.700927+0000","last_active":"2023-09-13T09:38:11.170585+0000","last_peered":"2023-09-13T09:38:11.170585+0000","last_clean":"2023-09-13T09:38:11.170585+0000","last_became_active":"2023-09-13T09:38:09.700608+0000","last_became_peered":"2023-09-13T09:38:09.700608+0000","last_unstale":"2023-09-13T09:38:11.170585+0000","last_undegraded":"2023-09-13T09:38:11.170585+0000","last_fullsized":"2023-09-13T09:38:11.170585+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:24.177293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:16.681269+0000","last_change":"2023-09-13T09:38:08.699130+0000","last_active":"2023-09-13T09:38:16.681269+0000","last_peered":"2023-09-13T09:38:16.681269+0000","last_clean":"2023-09-13T09:38:16.681269+0000","last_became_active":"2023-09-13T09:38:08.698802+0000","last_became_peered":"2023-09-13T09:38:08.698802+0000","last_unstale":"2023-09-13T09:38:16.681269+0000","last_undegraded":"2023-09-13T09:38:16.681269+0000","last_fullsized":"2023-09-13T09:38:16.681269+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:36.539846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682921+0000","last_change":"2023-09-13T09:38:09.697387+0000","last_active":"2023-09-13T09:38:10.682921+0000","last_peered":"2023-09-13T09:38:10.682921+0000","last_clean":"2023-09-13T09:38:10.682921+0000","last_became_active":"2023-09-13T09:38:09.697081+0000","last_became_peered":"2023-09-13T09:38:09.697081+0000","last_unstale":"2023-09-13T09:38:10.682921+0000","last_undegraded":"2023-09-13T09:38:10.682921+0000","last_fullsized":"2023-09-13T09:38:10.682921+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:28:59.473258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.792585+0000","last_change":"2023-09-13T09:38:08.696609+0000","last_active":"2023-09-13T09:38:15.792585+0000","last_peered":"2023-09-13T09:38:15.792585+0000","last_clean":"2023-09-13T09:38:15.792585+0000","last_became_active":"2023-09-13T09:38:08.696286+0000","last_became_peered":"2023-09-13T09:38:08.696286+0000","last_unstale":"2023-09-13T09:38:15.792585+0000","last_undegraded":"2023-09-13T09:38:15.792585+0000","last_fullsized":"2023-09-13T09:38:15.792585+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:06:51.121661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171465+0000","last_change":"2023-09-13T09:38:09.698374+0000","last_active":"2023-09-13T09:38:11.171465+0000","last_peered":"2023-09-13T09:38:11.171465+0000","last_clean":"2023-09-13T09:38:11.171465+0000","last_became_active":"2023-09-13T09:38:09.698050+0000","last_became_peered":"2023-09-13T09:38:09.698050+0000","last_unstale":"2023-09-13T09:38:11.171465+0000","last_undegraded":"2023-09-13T09:38:11.171465+0000","last_fullsized":"2023-09-13T09:38:11.171465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:37:24.089861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":57,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:50.735226+0000","last_change":"2023-09-13T09:38:08.692717+0000","last_active":"2023-09-13T09:38:50.735226+0000","last_peered":"2023-09-13T09:38:50.735226+0000","last_clean":"2023-09-13T09:38:50.735226+0000","last_became_active":"2023-09-13T09:38:08.692340+0000","last_became_peered":"2023-09-13T09:38:08.692340+0000","last_unstale":"2023-09-13T09:38:50.735226+0000","last_undegraded":"2023-09-13T09:38:50.735226+0000","last_fullsized":"2023-09-13T09:38:50.735226+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:22.280879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":39,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170823+0000","last_change":"2023-09-13T09:38:09.701623+0000","last_active":"2023-09-13T09:38:11.170823+0000","last_peered":"2023-09-13T09:38:11.170823+0000","last_clean":"2023-09-13T09:38:11.170823+0000","last_became_active":"2023-09-13T09:38:09.701338+0000","last_became_peered":"2023-09-13T09:38:09.701338+0000","last_unstale":"2023-09-13T09:38:11.170823+0000","last_undegraded":"2023-09-13T09:38:11.170823+0000","last_fullsized":"2023-09-13T09:38:11.170823+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:49:58.937293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.788808+0000","last_change":"2023-09-13T09:38:08.691968+0000","last_active":"2023-09-13T09:38:15.788808+0000","last_peered":"2023-09-13T09:38:15.788808+0000","last_clean":"2023-09-13T09:38:15.788808+0000","last_became_active":"2023-09-13T09:38:08.691668+0000","last_became_peered":"2023-09-13T09:38:08.691668+0000","last_unstale":"2023-09-13T09:38:15.788808+0000","last_undegraded":"2023-09-13T09:38:15.788808+0000","last_fullsized":"2023-09-13T09:38:15.788808+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:43.767948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683621+0000","last_change":"2023-09-13T09:38:09.698123+0000","last_active":"2023-09-13T09:38:10.683621+0000","last_peered":"2023-09-13T09:38:10.683621+0000","last_clean":"2023-09-13T09:38:10.683621+0000","last_became_active":"2023-09-13T09:38:09.697729+0000","last_became_peered":"2023-09-13T09:38:09.697729+0000","last_unstale":"2023-09-13T09:38:10.683621+0000","last_undegraded":"2023-09-13T09:38:10.683621+0000","last_fullsized":"2023-09-13T09:38:10.683621+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:25.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:14.813823+0000","last_change":"2023-09-13T09:38:08.691091+0000","last_active":"2023-09-13T09:38:14.813823+0000","last_peered":"2023-09-13T09:38:14.813823+0000","last_clean":"2023-09-13T09:38:14.813823+0000","last_became_active":"2023-09-13T09:38:08.689128+0000","last_became_peered":"2023-09-13T09:38:08.689128+0000","last_unstale":"2023-09-13T09:38:14.813823+0000","last_undegraded":"2023-09-13T09:38:14.813823+0000","last_fullsized":"2023-09-13T09:38:14.813823+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:32.133388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233326+0000","last_change":"2023-09-13T09:38:09.706041+0000","last_active":"2023-09-13T09:38:12.233326+0000","last_peered":"2023-09-13T09:38:12.233326+0000","last_clean":"2023-09-13T09:38:12.233326+0000","last_became_active":"2023-09-13T09:38:09.705707+0000","last_became_peered":"2023-09-13T09:38:09.705707+0000","last_unstale":"2023-09-13T09:38:12.233326+0000","last_undegraded":"2023-09-13T09:38:12.233326+0000","last_fullsized":"2023-09-13T09:38:12.233326+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:57.018000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170284+0000","last_change":"2023-09-13T09:38:08.695552+0000","last_active":"2023-09-13T09:38:11.170284+0000","last_peered":"2023-09-13T09:38:11.170284+0000","last_clean":"2023-09-13T09:38:11.170284+0000","last_became_active":"2023-09-13T09:38:08.695236+0000","last_became_peered":"2023-09-13T09:38:08.695236+0000","last_unstale":"2023-09-13T09:38:11.170284+0000","last_undegraded":"2023-09-13T09:38:11.170284+0000","last_fullsized":"2023-09-13T09:38:11.170284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:41.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.687208+0000","last_change":"2023-09-13T09:38:09.699864+0000","last_active":"2023-09-13T09:38:10.687208+0000","last_peered":"2023-09-13T09:38:10.687208+0000","last_clean":"2023-09-13T09:38:10.687208+0000","last_became_active":"2023-09-13T09:38:09.699522+0000","last_became_peered":"2023-09-13T09:38:09.699522+0000","last_unstale":"2023-09-13T09:38:10.687208+0000","last_undegraded":"2023-09-13T09:38:10.687208+0000","last_fullsized":"2023-09-13T09:38:10.687208+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:51.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"84'5","reported_seq":58,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:53.738921+0000","last_change":"2023-09-13T09:38:08.695651+0000","last_active":"2023-09-13T09:38:53.738921+0000","last_peered":"2023-09-13T09:38:53.738921+0000","last_clean":"2023-09-13T09:38:53.738921+0000","last_became_active":"2023-09-13T09:38:08.695074+0000","last_became_peered":"2023-09-13T09:38:08.695074+0000","last_unstale":"2023-09-13T09:38:53.738921+0000","last_undegraded":"2023-09-13T09:38:53.738921+0000","last_fullsized":"2023-09-13T09:38:53.738921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:40.974436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":40,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683373+0000","last_change":"2023-09-13T09:38:09.698193+0000","last_active":"2023-09-13T09:38:10.683373+0000","last_peered":"2023-09-13T09:38:10.683373+0000","last_clean":"2023-09-13T09:38:10.683373+0000","last_became_active":"2023-09-13T09:38:09.697874+0000","last_became_peered":"2023-09-13T09:38:09.697874+0000","last_unstale":"2023-09-13T09:38:10.683373+0000","last_undegraded":"2023-09-13T09:38:10.683373+0000","last_fullsized":"2023-09-13T09:38:10.683373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:48.908322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683532+0000","last_change":"2023-09-13T09:38:09.705768+0000","last_active":"2023-09-13T09:38:10.683532+0000","last_peered":"2023-09-13T09:38:10.683532+0000","last_clean":"2023-09-13T09:38:10.683532+0000","last_became_active":"2023-09-13T09:38:09.705403+0000","last_became_peered":"2023-09-13T09:38:09.705403+0000","last_unstale":"2023-09-13T09:38:10.683532+0000","last_undegraded":"2023-09-13T09:38:10.683532+0000","last_fullsized":"2023-09-13T09:38:10.683532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:14:07.171229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":59,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:54.739992+0000","last_change":"2023-09-13T09:38:08.695499+0000","last_active":"2023-09-13T09:38:54.739992+0000","last_peered":"2023-09-13T09:38:54.739992+0000","last_clean":"2023-09-13T09:38:54.739992+0000","last_became_active":"2023-09-13T09:38:08.695167+0000","last_became_peered":"2023-09-13T09:38:08.695167+0000","last_unstale":"2023-09-13T09:38:54.739992+0000","last_undegraded":"2023-09-13T09:38:54.739992+0000","last_fullsized":"2023-09-13T09:38:54.739992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.561408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170842+0000","last_change":"2023-09-13T09:38:09.702273+0000","last_active":"2023-09-13T09:38:11.170842+0000","last_peered":"2023-09-13T09:38:11.170842+0000","last_clean":"2023-09-13T09:38:11.170842+0000","last_became_active":"2023-09-13T09:38:09.701944+0000","last_became_peered":"2023-09-13T09:38:09.701944+0000","last_unstale":"2023-09-13T09:38:11.170842+0000","last_undegraded":"2023-09-13T09:38:11.170842+0000","last_fullsized":"2023-09-13T09:38:11.170842+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:56.548720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:16.681762+0000","last_change":"2023-09-13T09:38:08.692966+0000","last_active":"2023-09-13T09:38:16.681762+0000","last_peered":"2023-09-13T09:38:16.681762+0000","last_clean":"2023-09-13T09:38:16.681762+0000","last_became_active":"2023-09-13T09:38:08.692613+0000","last_became_peered":"2023-09-13T09:38:08.692613+0000","last_unstale":"2023-09-13T09:38:16.681762+0000","last_undegraded":"2023-09-13T09:38:16.681762+0000","last_fullsized":"2023-09-13T09:38:16.681762+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:37.327846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":307,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-09-13T09:38:09.688801+0000","last_change":"2023-09-13T09:37:08.710441+0000","last_active":"2023-09-13T09:38:09.688801+0000","last_peered":"2023-09-13T09:38:09.688801+0000","last_clean":"2023-09-13T09:38:09.688801+0000","last_became_active":"2023-09-13T09:37:08.709939+0000","last_became_peered":"2023-09-13T09:37:08.709939+0000","last_unstale":"2023-09-13T09:38:09.688801+0000","last_undegraded":"2023-09-13T09:38:09.688801+0000","last_fullsized":"2023-09-13T09:38:09.688801+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_clean_scrub_stamp":"2023-09-13T09:34:16.664369+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:00.964039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.682890+0000","last_change":"2023-09-13T09:38:09.697244+0000","last_active":"2023-09-13T09:38:10.682890+0000","last_peered":"2023-09-13T09:38:10.682890+0000","last_clean":"2023-09-13T09:38:10.682890+0000","last_became_active":"2023-09-13T09:38:09.696925+0000","last_became_peered":"2023-09-13T09:38:09.696925+0000","last_unstale":"2023-09-13T09:38:10.682890+0000","last_undegraded":"2023-09-13T09:38:10.682890+0000","last_fullsized":"2023-09-13T09:38:10.682890+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:39.566528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:13.766096+0000","last_change":"2023-09-13T09:38:08.702070+0000","last_active":"2023-09-13T09:38:13.766096+0000","last_peered":"2023-09-13T09:38:13.766096+0000","last_clean":"2023-09-13T09:38:13.766096+0000","last_became_active":"2023-09-13T09:38:08.701647+0000","last_became_peered":"2023-09-13T09:38:08.701647+0000","last_unstale":"2023-09-13T09:38:13.766096+0000","last_undegraded":"2023-09-13T09:38:13.766096+0000","last_fullsized":"2023-09-13T09:38:13.766096+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:30:22.405675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.789684+0000","last_change":"2023-09-13T09:38:08.696935+0000","last_active":"2023-09-13T09:38:15.789684+0000","last_peered":"2023-09-13T09:38:15.789684+0000","last_clean":"2023-09-13T09:38:15.789684+0000","last_became_active":"2023-09-13T09:38:08.696534+0000","last_became_peered":"2023-09-13T09:38:08.696534+0000","last_unstale":"2023-09-13T09:38:15.789684+0000","last_undegraded":"2023-09-13T09:38:15.789684+0000","last_fullsized":"2023-09-13T09:38:15.789684+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:49:13.883043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683062+0000","last_change":"2023-09-13T09:38:09.695829+0000","last_active":"2023-09-13T09:38:10.683062+0000","last_peered":"2023-09-13T09:38:10.683062+0000","last_clean":"2023-09-13T09:38:10.683062+0000","last_became_active":"2023-09-13T09:38:09.695479+0000","last_became_peered":"2023-09-13T09:38:09.695479+0000","last_unstale":"2023-09-13T09:38:10.683062+0000","last_undegraded":"2023-09-13T09:38:10.683062+0000","last_fullsized":"2023-09-13T09:38:10.683062+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:24:00.042236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:19.008259+0000","last_change":"2023-09-13T09:38:08.698530+0000","last_active":"2023-09-13T09:38:19.008259+0000","last_peered":"2023-09-13T09:38:19.008259+0000","last_clean":"2023-09-13T09:38:19.008259+0000","last_became_active":"2023-09-13T09:38:08.698206+0000","last_became_peered":"2023-09-13T09:38:08.698206+0000","last_unstale":"2023-09-13T09:38:19.008259+0000","last_undegraded":"2023-09-13T09:38:19.008259+0000","last_fullsized":"2023-09-13T09:38:19.008259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:09.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171580+0000","last_change":"2023-09-13T09:38:09.700993+0000","last_active":"2023-09-13T09:38:11.171580+0000","last_peered":"2023-09-13T09:38:11.171580+0000","last_clean":"2023-09-13T09:38:11.171580+0000","last_became_active":"2023-09-13T09:38:09.700677+0000","last_became_peered":"2023-09-13T09:38:09.700677+0000","last_unstale":"2023-09-13T09:38:11.171580+0000","last_undegraded":"2023-09-13T09:38:11.171580+0000","last_fullsized":"2023-09-13T09:38:11.171580+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:32.209248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.789640+0000","last_change":"2023-09-13T09:38:08.684326+0000","last_active":"2023-09-13T09:38:15.789640+0000","last_peered":"2023-09-13T09:38:15.789640+0000","last_clean":"2023-09-13T09:38:15.789640+0000","last_became_active":"2023-09-13T09:38:08.683972+0000","last_became_peered":"2023-09-13T09:38:08.683972+0000","last_unstale":"2023-09-13T09:38:15.789640+0000","last_undegraded":"2023-09-13T09:38:15.789640+0000","last_fullsized":"2023-09-13T09:38:15.789640+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:22.702277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170943+0000","last_change":"2023-09-13T09:38:09.706237+0000","last_active":"2023-09-13T09:38:11.170943+0000","last_peered":"2023-09-13T09:38:11.170943+0000","last_clean":"2023-09-13T09:38:11.170943+0000","last_became_active":"2023-09-13T09:38:09.705706+0000","last_became_peered":"2023-09-13T09:38:09.705706+0000","last_unstale":"2023-09-13T09:38:11.170943+0000","last_undegraded":"2023-09-13T09:38:11.170943+0000","last_fullsized":"2023-09-13T09:38:11.170943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:18.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.756655+0000","last_change":"2023-09-13T09:38:08.695641+0000","last_active":"2023-09-13T09:38:12.756655+0000","last_peered":"2023-09-13T09:38:12.756655+0000","last_clean":"2023-09-13T09:38:12.756655+0000","last_became_active":"2023-09-13T09:38:08.695090+0000","last_became_peered":"2023-09-13T09:38:08.695090+0000","last_unstale":"2023-09-13T09:38:12.756655+0000","last_undegraded":"2023-09-13T09:38:12.756655+0000","last_fullsized":"2023-09-13T09:38:12.756655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:16:13.987022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.169943+0000","last_change":"2023-09-13T09:38:09.702254+0000","last_active":"2023-09-13T09:38:11.169943+0000","last_peered":"2023-09-13T09:38:11.169943+0000","last_clean":"2023-09-13T09:38:11.169943+0000","last_became_active":"2023-09-13T09:38:09.701946+0000","last_became_peered":"2023-09-13T09:38:09.701946+0000","last_unstale":"2023-09-13T09:38:11.169943+0000","last_undegraded":"2023-09-13T09:38:11.169943+0000","last_fullsized":"2023-09-13T09:38:11.169943+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:41.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.790992+0000","last_change":"2023-09-13T09:38:08.694692+0000","last_active":"2023-09-13T09:38:15.790992+0000","last_peered":"2023-09-13T09:38:15.790992+0000","last_clean":"2023-09-13T09:38:15.790992+0000","last_became_active":"2023-09-13T09:38:08.693799+0000","last_became_peered":"2023-09-13T09:38:08.693799+0000","last_unstale":"2023-09-13T09:38:15.790992+0000","last_undegraded":"2023-09-13T09:38:15.790992+0000","last_fullsized":"2023-09-13T09:38:15.790992+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:53:57.188153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233050+0000","last_change":"2023-09-13T09:38:09.707954+0000","last_active":"2023-09-13T09:38:12.233050+0000","last_peered":"2023-09-13T09:38:12.233050+0000","last_clean":"2023-09-13T09:38:12.233050+0000","last_became_active":"2023-09-13T09:38:09.707659+0000","last_became_peered":"2023-09-13T09:38:09.707659+0000","last_unstale":"2023-09-13T09:38:12.233050+0000","last_undegraded":"2023-09-13T09:38:12.233050+0000","last_fullsized":"2023-09-13T09:38:12.233050+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:34.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:17.123693+0000","last_change":"2023-09-13T09:38:08.696505+0000","last_active":"2023-09-13T09:38:17.123693+0000","last_peered":"2023-09-13T09:38:17.123693+0000","last_clean":"2023-09-13T09:38:17.123693+0000","last_became_active":"2023-09-13T09:38:08.696106+0000","last_became_peered":"2023-09-13T09:38:08.696106+0000","last_unstale":"2023-09-13T09:38:17.123693+0000","last_undegraded":"2023-09-13T09:38:17.123693+0000","last_fullsized":"2023-09-13T09:38:17.123693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:52:57.306234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171023+0000","last_change":"2023-09-13T09:38:09.700593+0000","last_active":"2023-09-13T09:38:11.171023+0000","last_peered":"2023-09-13T09:38:11.171023+0000","last_clean":"2023-09-13T09:38:11.171023+0000","last_became_active":"2023-09-13T09:38:09.700263+0000","last_became_peered":"2023-09-13T09:38:09.700263+0000","last_unstale":"2023-09-13T09:38:11.171023+0000","last_undegraded":"2023-09-13T09:38:11.171023+0000","last_fullsized":"2023-09-13T09:38:11.171023+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:17:38.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.759212+0000","last_change":"2023-09-13T09:38:08.692455+0000","last_active":"2023-09-13T09:38:12.759212+0000","last_peered":"2023-09-13T09:38:12.759212+0000","last_clean":"2023-09-13T09:38:12.759212+0000","last_became_active":"2023-09-13T09:38:08.692118+0000","last_became_peered":"2023-09-13T09:38:08.692118+0000","last_unstale":"2023-09-13T09:38:12.759212+0000","last_undegraded":"2023-09-13T09:38:12.759212+0000","last_fullsized":"2023-09-13T09:38:12.759212+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:33.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171339+0000","last_change":"2023-09-13T09:38:09.695783+0000","last_active":"2023-09-13T09:38:11.171339+0000","last_peered":"2023-09-13T09:38:11.171339+0000","last_clean":"2023-09-13T09:38:11.171339+0000","last_became_active":"2023-09-13T09:38:09.695473+0000","last_became_peered":"2023-09-13T09:38:09.695473+0000","last_unstale":"2023-09-13T09:38:11.171339+0000","last_undegraded":"2023-09-13T09:38:11.171339+0000","last_fullsized":"2023-09-13T09:38:11.171339+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:59.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":59,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:53.739525+0000","last_change":"2023-09-13T09:38:08.697468+0000","last_active":"2023-09-13T09:38:53.739525+0000","last_peered":"2023-09-13T09:38:53.739525+0000","last_clean":"2023-09-13T09:38:53.739525+0000","last_became_active":"2023-09-13T09:38:08.697141+0000","last_became_peered":"2023-09-13T09:38:08.697141+0000","last_unstale":"2023-09-13T09:38:53.739525+0000","last_undegraded":"2023-09-13T09:38:53.739525+0000","last_fullsized":"2023-09-13T09:38:53.739525+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:33:26.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171808+0000","last_change":"2023-09-13T09:38:09.703754+0000","last_active":"2023-09-13T09:38:11.171808+0000","last_peered":"2023-09-13T09:38:11.171808+0000","last_clean":"2023-09-13T09:38:11.171808+0000","last_became_active":"2023-09-13T09:38:09.703438+0000","last_became_peered":"2023-09-13T09:38:09.703438+0000","last_unstale":"2023-09-13T09:38:11.171808+0000","last_undegraded":"2023-09-13T09:38:11.171808+0000","last_fullsized":"2023-09-13T09:38:11.171808+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:19.298385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.791780+0000","last_change":"2023-09-13T09:38:08.698973+0000","last_active":"2023-09-13T09:38:15.791780+0000","last_peered":"2023-09-13T09:38:15.791780+0000","last_clean":"2023-09-13T09:38:15.791780+0000","last_became_active":"2023-09-13T09:38:08.698329+0000","last_became_peered":"2023-09-13T09:38:08.698329+0000","last_unstale":"2023-09-13T09:38:15.791780+0000","last_undegraded":"2023-09-13T09:38:15.791780+0000","last_fullsized":"2023-09-13T09:38:15.791780+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:10.684590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":13,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171550+0000","last_change":"2023-09-13T09:38:09.700216+0000","last_active":"2023-09-13T09:38:11.171550+0000","last_peered":"2023-09-13T09:38:11.171550+0000","last_clean":"2023-09-13T09:38:11.171550+0000","last_became_active":"2023-09-13T09:38:09.699876+0000","last_became_peered":"2023-09-13T09:38:09.699876+0000","last_unstale":"2023-09-13T09:38:11.171550+0000","last_undegraded":"2023-09-13T09:38:11.171550+0000","last_fullsized":"2023-09-13T09:38:11.171550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:33.347155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:15.788169+0000","last_change":"2023-09-13T09:38:08.696200+0000","last_active":"2023-09-13T09:38:15.788169+0000","last_peered":"2023-09-13T09:38:15.788169+0000","last_clean":"2023-09-13T09:38:15.788169+0000","last_became_active":"2023-09-13T09:38:08.695880+0000","last_became_peered":"2023-09-13T09:38:08.695880+0000","last_unstale":"2023-09-13T09:38:15.788169+0000","last_undegraded":"2023-09-13T09:38:15.788169+0000","last_fullsized":"2023-09-13T09:38:15.788169+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:38.222209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171897+0000","last_change":"2023-09-13T09:38:09.703022+0000","last_active":"2023-09-13T09:38:11.171897+0000","last_peered":"2023-09-13T09:38:11.171897+0000","last_clean":"2023-09-13T09:38:11.171897+0000","last_became_active":"2023-09-13T09:38:09.702665+0000","last_became_peered":"2023-09-13T09:38:09.702665+0000","last_unstale":"2023-09-13T09:38:11.171897+0000","last_undegraded":"2023-09-13T09:38:11.171897+0000","last_fullsized":"2023-09-13T09:38:11.171897+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:59.284385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233158+0000","last_change":"2023-09-13T09:38:09.708137+0000","last_active":"2023-09-13T09:38:12.233158+0000","last_peered":"2023-09-13T09:38:12.233158+0000","last_clean":"2023-09-13T09:38:12.233158+0000","last_became_active":"2023-09-13T09:38:09.707829+0000","last_became_peered":"2023-09-13T09:38:09.707829+0000","last_unstale":"2023-09-13T09:38:12.233158+0000","last_undegraded":"2023-09-13T09:38:12.233158+0000","last_fullsized":"2023-09-13T09:38:12.233158+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:15.976098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170521+0000","last_change":"2023-09-13T09:38:09.703131+0000","last_active":"2023-09-13T09:38:11.170521+0000","last_peered":"2023-09-13T09:38:11.170521+0000","last_clean":"2023-09-13T09:38:11.170521+0000","last_became_active":"2023-09-13T09:38:09.702850+0000","last_became_peered":"2023-09-13T09:38:09.702850+0000","last_unstale":"2023-09-13T09:38:11.170521+0000","last_undegraded":"2023-09-13T09:38:11.170521+0000","last_fullsized":"2023-09-13T09:38:11.170521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:08.422038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170418+0000","last_change":"2023-09-13T09:38:09.701691+0000","last_active":"2023-09-13T09:38:11.170418+0000","last_peered":"2023-09-13T09:38:11.170418+0000","last_clean":"2023-09-13T09:38:11.170418+0000","last_became_active":"2023-09-13T09:38:09.701395+0000","last_became_peered":"2023-09-13T09:38:09.701395+0000","last_unstale":"2023-09-13T09:38:11.170418+0000","last_undegraded":"2023-09-13T09:38:11.170418+0000","last_fullsized":"2023-09-13T09:38:11.170418+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:02.916712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170550+0000","last_change":"2023-09-13T09:38:09.706885+0000","last_active":"2023-09-13T09:38:11.170550+0000","last_peered":"2023-09-13T09:38:11.170550+0000","last_clean":"2023-09-13T09:38:11.170550+0000","last_became_active":"2023-09-13T09:38:09.706569+0000","last_became_peered":"2023-09-13T09:38:09.706569+0000","last_unstale":"2023-09-13T09:38:11.170550+0000","last_undegraded":"2023-09-13T09:38:11.170550+0000","last_fullsized":"2023-09-13T09:38:11.170550+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:02.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683123+0000","last_change":"2023-09-13T09:38:09.698547+0000","last_active":"2023-09-13T09:38:10.683123+0000","last_peered":"2023-09-13T09:38:10.683123+0000","last_clean":"2023-09-13T09:38:10.683123+0000","last_became_active":"2023-09-13T09:38:09.698180+0000","last_became_peered":"2023-09-13T09:38:09.698180+0000","last_unstale":"2023-09-13T09:38:10.683123+0000","last_undegraded":"2023-09-13T09:38:10.683123+0000","last_fullsized":"2023-09-13T09:38:10.683123+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:12.988597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233293+0000","last_change":"2023-09-13T09:38:09.706780+0000","last_active":"2023-09-13T09:38:12.233293+0000","last_peered":"2023-09-13T09:38:12.233293+0000","last_clean":"2023-09-13T09:38:12.233293+0000","last_became_active":"2023-09-13T09:38:09.706487+0000","last_became_peered":"2023-09-13T09:38:09.706487+0000","last_unstale":"2023-09-13T09:38:12.233293+0000","last_undegraded":"2023-09-13T09:38:12.233293+0000","last_fullsized":"2023-09-13T09:38:12.233293+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:18:29.386412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170952+0000","last_change":"2023-09-13T09:38:09.695277+0000","last_active":"2023-09-13T09:38:11.170952+0000","last_peered":"2023-09-13T09:38:11.170952+0000","last_clean":"2023-09-13T09:38:11.170952+0000","last_became_active":"2023-09-13T09:38:09.694959+0000","last_became_peered":"2023-09-13T09:38:09.694959+0000","last_unstale":"2023-09-13T09:38:11.170952+0000","last_undegraded":"2023-09-13T09:38:11.170952+0000","last_fullsized":"2023-09-13T09:38:11.170952+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:35:17.321069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171496+0000","last_change":"2023-09-13T09:38:09.702030+0000","last_active":"2023-09-13T09:38:11.171496+0000","last_peered":"2023-09-13T09:38:11.171496+0000","last_clean":"2023-09-13T09:38:11.171496+0000","last_became_active":"2023-09-13T09:38:09.701712+0000","last_became_peered":"2023-09-13T09:38:09.701712+0000","last_unstale":"2023-09-13T09:38:11.171496+0000","last_undegraded":"2023-09-13T09:38:11.171496+0000","last_fullsized":"2023-09-13T09:38:11.171496+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:38.909533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683499+0000","last_change":"2023-09-13T09:38:09.706625+0000","last_active":"2023-09-13T09:38:10.683499+0000","last_peered":"2023-09-13T09:38:10.683499+0000","last_clean":"2023-09-13T09:38:10.683499+0000","last_became_active":"2023-09-13T09:38:09.706315+0000","last_became_peered":"2023-09-13T09:38:09.706315+0000","last_unstale":"2023-09-13T09:38:10.683499+0000","last_undegraded":"2023-09-13T09:38:10.683499+0000","last_fullsized":"2023-09-13T09:38:10.683499+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:06:21.653592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.171694+0000","last_change":"2023-09-13T09:38:09.703544+0000","last_active":"2023-09-13T09:38:11.171694+0000","last_peered":"2023-09-13T09:38:11.171694+0000","last_clean":"2023-09-13T09:38:11.171694+0000","last_became_active":"2023-09-13T09:38:09.702015+0000","last_became_peered":"2023-09-13T09:38:09.702015+0000","last_unstale":"2023-09-13T09:38:11.171694+0000","last_undegraded":"2023-09-13T09:38:11.171694+0000","last_fullsized":"2023-09-13T09:38:11.171694+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:46:49.166965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:11.170600+0000","last_change":"2023-09-13T09:38:09.694224+0000","last_active":"2023-09-13T09:38:11.170600+0000","last_peered":"2023-09-13T09:38:11.170600+0000","last_clean":"2023-09-13T09:38:11.170600+0000","last_became_active":"2023-09-13T09:38:09.693562+0000","last_became_peered":"2023-09-13T09:38:09.693562+0000","last_unstale":"2023-09-13T09:38:11.170600+0000","last_undegraded":"2023-09-13T09:38:11.170600+0000","last_fullsized":"2023-09-13T09:38:11.170600+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:41:07.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:10.683159+0000","last_change":"2023-09-13T09:38:09.698919+0000","last_active":"2023-09-13T09:38:10.683159+0000","last_peered":"2023-09-13T09:38:10.683159+0000","last_clean":"2023-09-13T09:38:10.683159+0000","last_became_active":"2023-09-13T09:38:09.698637+0000","last_became_peered":"2023-09-13T09:38:09.698637+0000","last_unstale":"2023-09-13T09:38:10.683159+0000","last_undegraded":"2023-09-13T09:38:10.683159+0000","last_fullsized":"2023-09-13T09:38:10.683159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:50.277687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-09-13T09:38:12.233181+0000","last_change":"2023-09-13T09:38:09.705194+0000","last_active":"2023-09-13T09:38:12.233181+0000","last_peered":"2023-09-13T09:38:12.233181+0000","last_clean":"2023-09-13T09:38:12.233181+0000","last_became_active":"2023-09-13T09:38:09.704888+0000","last_became_peered":"2023-09-13T09:38:09.704888+0000","last_unstale":"2023-09-13T09:38:12.233181+0000","last_undegraded":"2023-09-13T09:38:12.233181+0000","last_fullsized":"2023-09-13T09:38:12.233181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:07.995177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":61910,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":421,"num_read_kb":282,"num_write":229,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":552960,"data_stored":185730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":201,"ondisk_log_size":201,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416404,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":435246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.36299999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.58199999999999996}]},{"osd":2,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.41399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]},{"osd":4,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.53700000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.72799999999999998}]},{"osd":7,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.54900000000000004}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":9,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.495}]},{"osd":10,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.63},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.81799999999999995}]}]},{"osd":10,"up_from":71,"seq":304942678042,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28588,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716564,"statfs":{"total":95995035648,"available":95965761536,"internally_reserved":0,"allocated":1609728,"data_stored":1081048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":1,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.624,"15min":0.624},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.67700000000000005}]},{"osd":3,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.84599999999999997},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.86299999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95599999999999996,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.436},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.751,"5min":0.751,"15min":0.751},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.61299999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.92700000000000005}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.627},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.58699999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.65700000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.91400000000000003}]},{"osd":11,"last update":"Wed Sep 13 09:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.101,"5min":1.101,"15min":1.101},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1839999999999999,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.748}]}]},{"osd":9,"up_from":66,"seq":283467841565,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27936,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717216,"statfs":{"total":95995035648,"available":95966429184,"internally_reserved":0,"allocated":942080,"data_stored":435176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82999999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.628,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.75}]},{"osd":2,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.63400000000000001}]},{"osd":3,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.32000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65300000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60499999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82499999999999996,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88,"5min":1.256,"15min":1.256},"last":0.81599999999999995}]},{"osd":5,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86699999999999999,"5min":1.117,"15min":1.117},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.623,"5min":0.70399999999999996,"15min":0.71799999999999997},"min":{"1min":0.496,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83499999999999996,"5min":1.002,"15min":1.002},"last":0.626}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88200000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.502},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81399999999999995,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.83199999999999996,"5min":1.204,"15min":1.204},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85399999999999998,"5min":1.276,"15min":1.276},"last":0.85699999999999998}]},{"osd":8,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.85099999999999998},"min":{"1min":0.59999999999999998,"5min":0.501,"15min":0.501},"max":{"1min":0.86699999999999999,"5min":1.224,"15min":1.224},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.84999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.59799999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.3879999999999999,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.83199999999999996}]}]},{"osd":8,"up_from":58,"seq":249108103201,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":933888,"data_stored":435223,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.58199999999999996,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68600000000000005,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.55000000000000004,"15min":0.55400000000000005},"min":{"1min":0.376,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.755}]},{"osd":1,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.622,"15min":0.61299999999999999},"min":{"1min":0.48299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.65500000000000003}]},{"osd":2,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.28199999999999997,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.46200000000000002,"15min":0.46500000000000002},"min":{"1min":0.33000000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67500000000000004,"5min":0.74099999999999999,"15min":0.74099999999999999},"last":0.47099999999999997}]},{"osd":3,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.90400000000000003,"5min":0.64200000000000002,"15min":0.59799999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.9850000000000003,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.59699999999999998,"15min":0.60599999999999998},"min":{"1min":0.45700000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.77600000000000002,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.78800000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61099999999999999,"15min":0.60299999999999998},"min":{"1min":0.44900000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.63800000000000001,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.83599999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.38900000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.72599999999999998,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55600000000000005,"15min":0.55700000000000005},"min":{"1min":0.34399999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.69699999999999995,"15min":0.65500000000000003},"min":{"1min":0.49399999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":6.0179999999999998,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.96999999999999997,"5min":0.754,"15min":0.71799999999999997},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":6.0430000000000001,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.77100000000000002}]},{"osd":7,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.72199999999999998,"15min":0.71799999999999997},"min":{"1min":0.53600000000000003,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.68999999999999995,"15min":0.68000000000000005},"min":{"1min":0.499,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.80900000000000005}]},{"osd":9,"last update":"Wed Sep 13 09:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.872},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.90600000000000003}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.82099999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86199999999999999}]}]},{"osd":7,"up_from":50,"seq":214748364838,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28516,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716636,"statfs":{"total":95995035648,"available":95965835264,"internally_reserved":0,"allocated":1536000,"data_stored":1028467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48799999999999999,"15min":0.48899999999999999},"min":{"1min":0.35599999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.373},{"interface":"front","average":{"1min":0.498,"5min":0.48699999999999999,"15min":0.48499999999999999},"min":{"1min":0.309,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.69699999999999995,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63700000000000001,"15min":0.63800000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.84399999999999997,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.66400000000000003,"15min":0.66700000000000004},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.56999999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.63500000000000001,"15min":0.63300000000000001},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.629,"15min":0.628},"min":{"1min":0.39500000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59799999999999998,"15min":0.59699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.499},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.60799999999999998},"min":{"1min":0.41099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.754,"15min":0.76200000000000001},"min":{"1min":0.56599999999999995,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.72599999999999998,"15min":0.73099999999999998},"min":{"1min":0.54800000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.095,"5min":1.6160000000000001,"15min":1.6160000000000001},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.76900000000000002,"15min":0.77000000000000002},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.46700000000000003}]},{"osd":8,"last update":"Wed Sep 13 09:38:23 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.79400000000000004,"15min":0.79800000000000004},"min":{"1min":0.56799999999999995,"5min":0.497,"15min":0.497},"max":{"1min":0.94999999999999996,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.81000000000000005,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.78400000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.81899999999999995,"15min":0.78200000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.82699999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.76900000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":6,"up_from":45,"seq":193273528363,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":434899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.40200000000000002},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.34300000000000003}]},{"osd":1,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63500000000000001,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.66300000000000003}]},{"osd":2,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.442,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.624}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.45300000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.63900000000000001},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95299999999999996,"5min":1.101,"15min":1.101},"last":0.59399999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.69899999999999995,"15min":0.68500000000000005},"min":{"1min":0.55700000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0029999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.752,"15min":0.73999999999999999},"min":{"1min":0.60999999999999999,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.113,"5min":1.143,"15min":1.143},"last":0.73799999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.747,"15min":0.753},"min":{"1min":0.51300000000000001,"5min":0.502,"15min":0.502},"max":{"1min":0.93600000000000005,"5min":1.214,"15min":1.214},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.74199999999999999,"15min":0.73799999999999999},"min":{"1min":0.56799999999999995,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.96899999999999997,"5min":1.121,"15min":1.121},"last":0.63900000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.81899999999999995},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92900000000000005,"5min":1.264,"15min":1.264},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.58199999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.75}]}]},{"osd":1,"up_from":13,"seq":55834574912,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":983040,"data_stored":490514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.55000000000000004,"15min":0.53500000000000003},"min":{"1min":0.40300000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.54600000000000004,"15min":0.52100000000000002},"min":{"1min":0.44700000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.56899999999999995}]},{"osd":2,"last update":"Wed Sep 13 09:38:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.57599999999999996,"15min":0.53600000000000003},"min":{"1min":0.499,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.69499999999999995,"5min":0.57599999999999996,"15min":0.54400000000000004},"min":{"1min":0.46400000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.70999999999999996}]},{"osd":3,"last update":"Wed Sep 13 09:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64900000000000002,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.83399999999999996}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.495,"15min":0.47299999999999998},"min":{"1min":0.29199999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":1.077},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.51900000000000002,"15min":0.495},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.90100000000000002}]},{"osd":5,"last update":"Wed Sep 13 09:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.59099999999999997,"15min":0.56299999999999994},"min":{"1min":0.40999999999999998,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89400000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.64800000000000002,"15min":0.61299999999999999},"min":{"1min":0.48199999999999998,"5min":0.38,"15min":0.38},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":1.1000000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":1.026}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.63900000000000001,"15min":0.61599999999999999},"min":{"1min":0.42399999999999999,"5min":0.317,"15min":0.317},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":1.276},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.65000000000000002,"15min":0.63},"min":{"1min":0.41099999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.151,"5min":1.151,"15min":1.151},"last":1.159}]},{"osd":8,"last update":"Wed Sep 13 09:38:24 2023","interfaces":[{"interface":"back","average":{"1min":0.81000000000000005,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.56699999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.80100000000000005,"15min":0.78600000000000003},"min":{"1min":0.61599999999999999,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1919999999999999,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.141}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81899999999999995,"15min":0.81699999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":1.1819999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.238}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":1.1919999999999999},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":1.1679999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":436232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.52500000000000002,"15min":0.47499999999999998},"min":{"1min":0.36299999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.91100000000000003,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.54200000000000004,"15min":0.49099999999999999},"min":{"1min":0.38700000000000001,"5min":0.316,"15min":0.316},"max":{"1min":0.86199999999999999,"5min":1.47,"15min":1.47},"last":0.433}]},{"osd":2,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.38600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.82499999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.54400000000000004},"min":{"1min":0.42699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.89200000000000002,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.48099999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:36:38 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.435,"15min":0.42899999999999999},"min":{"1min":0.30399999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45500000000000002,"15min":0.44900000000000001},"min":{"1min":0.315,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.51600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:37:59 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.58799999999999997,"15min":0.56799999999999995},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.97599999999999998,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58099999999999996,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.751,"5min":1.288,"15min":1.288},"last":0.501}]},{"osd":5,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.63,"15min":0.61499999999999999},"min":{"1min":0.45600000000000002,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64400000000000002,"15min":0.622},"min":{"1min":0.41799999999999998,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.66900000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.57799999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69299999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.77200000000000002,"15min":0.78700000000000003},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.0509999999999999,"5min":1.143,"15min":1.143},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.81200000000000006,"15min":0.82399999999999995},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.056,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.68700000000000006}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.629,"5min":0.80000000000000004,"15min":0.82799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60099999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.621},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.53100000000000003}]},{"osd":11,"last update":"Wed Sep 13 09:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.64900000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411388,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":1003520,"data_stored":491124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.51600000000000001,"15min":0.47899999999999998},"min":{"1min":0.39400000000000002,"5min":0.316,"15min":0.316},"max":{"1min":0.76900000000000002,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.373},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.53500000000000003,"15min":0.49399999999999999},"min":{"1min":0.40799999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.81299999999999994,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.53600000000000003,"15min":0.52400000000000002},"min":{"1min":0.40799999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.83999999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.54600000000000004,"15min":0.51600000000000001},"min":{"1min":0.42299999999999999,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.91800000000000004,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.745}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.438},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.751,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.58199999999999996,"15min":0.55700000000000005},"min":{"1min":0.46000000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82999999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.627,"15min":0.60099999999999998},"min":{"1min":0.48099999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.47099999999999997,"15min":0.45000000000000001},"min":{"1min":0.35099999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.81999999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.46000000000000002,"15min":0.439},"min":{"1min":0.35799999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.40200000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.56000000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1,"15min":1},"last":0.67400000000000004}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65600000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751}]},{"osd":8,"last update":"Wed Sep 13 09:38:27 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.82699999999999996,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.63800000000000001,"15min":0.63600000000000001},"min":{"1min":0.42499999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79200000000000004,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69099999999999995}]},{"osd":9,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.56299999999999994}]},{"osd":10,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.625},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.77400000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182455,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":937984,"data_stored":434399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.55600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81699999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.51900000000000002},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69899999999999995,"5min":1.649,"15min":1.649},"last":0.46200000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":2.238,"15min":2.238},"last":0.64700000000000002}]},{"osd":4,"last update":"Wed Sep 13 09:38:00 2023","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.58999999999999997,"15min":0.56100000000000005},"min":{"1min":0.47099999999999997,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.38},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.623,"15min":0.60599999999999998},"min":{"1min":0.47899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.47799999999999998}]},{"osd":5,"last update":"Wed Sep 13 09:38:25 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.61499999999999999,"15min":0.60399999999999998},"min":{"1min":0.42699999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.85699999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.65400000000000003,"15min":0.64600000000000002},"min":{"1min":0.45300000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.90200000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.52500000000000002}]},{"osd":6,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98899999999999999,"5min":1.02,"15min":1.02},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":1.071,"15min":1.071},"last":0.57599999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.50800000000000001,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.595,"5min":1.595,"15min":1.595},"last":0.499},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.74399999999999999,"15min":0.72899999999999998},"min":{"1min":0.60899999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.175,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.61499999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":1.109,"15min":1.109},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.55800000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.73,"5min":1.73,"15min":1.73},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.63700000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]}]},{"osd":4,"up_from":32,"seq":137438953522,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":925696,"data_stored":435144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.53100000000000003},"min":{"1min":0.44700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.335,"5min":3.335,"15min":3.335},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.41399999999999998,"15min":0.38900000000000001},"min":{"1min":0.34000000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.42299999999999999,"15min":0.40100000000000002},"min":{"1min":0.33700000000000002,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.495}]},{"osd":2,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.622,"15min":0.60899999999999999},"min":{"1min":0.46100000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.51500000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.64200000000000002}]},{"osd":3,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.60499999999999998,"15min":0.57099999999999995},"min":{"1min":0.51100000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.05,"5min":1.05,"15min":1.05},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.61399999999999999,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.5230000000000001,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:19 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.65300000000000002,"15min":0.64300000000000002},"min":{"1min":0.504,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.66500000000000004,"15min":0.63900000000000001},"min":{"1min":0.53400000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.71999999999999997}]},{"osd":6,"last update":"Wed Sep 13 09:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98399999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.87,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.68400000000000005,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.377,"15min":0.377},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.68400000000000005,"15min":0.66800000000000004},"min":{"1min":0.48899999999999999,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.66100000000000003}]},{"osd":8,"last update":"Wed Sep 13 09:38:28 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.75800000000000001,"15min":0.748},"min":{"1min":0.59799999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.871,"5min":0.81999999999999995,"15min":0.81200000000000006},"min":{"1min":0.61199999999999999,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.048,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85999999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.4470000000000001},"last":0.70499999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.753},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.73899999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":5,"up_from":37,"seq":158913789999,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28528,"kb_used_data":1512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716624,"statfs":{"total":95995035648,"available":95965822976,"internally_reserved":0,"allocated":1548288,"data_stored":1027755,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.51100000000000001,"15min":0.497},"min":{"1min":0.35899999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.50600000000000001,"15min":0.48799999999999999},"min":{"1min":0.36599999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.77800000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.55000000000000004,"15min":0.52400000000000002},"min":{"1min":0.38,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.83199999999999996,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.54400000000000004,"15min":0.52200000000000002},"min":{"1min":0.35299999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.748,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.71699999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.39600000000000002},"min":{"1min":0.29899999999999999,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.73199999999999998,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.44,"15min":0.41399999999999998},"min":{"1min":0.27900000000000003,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.81000000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.433}]},{"osd":3,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52800000000000002,"15min":0.52400000000000002},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.73699999999999999,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59299999999999997,"15min":0.58299999999999996},"min":{"1min":0.41499999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81000000000000005,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.67400000000000004}]},{"osd":4,"last update":"Wed Sep 13 09:38:21 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.59999999999999998,"15min":0.56999999999999995},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.44600000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.76600000000000001,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.54400000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.85899999999999999}]},{"osd":7,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.72499999999999998,"15min":0.72599999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.93500000000000005,"5min":1.044,"15min":1.044},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.92500000000000004,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.73399999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:38:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.64600000000000002,"15min":0.63900000000000001},"min":{"1min":0.45600000000000002,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94999999999999996,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.5},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.59699999999999998,"15min":0.59499999999999997},"min":{"1min":0.40899999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.81999999999999995,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63100000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.57999999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.82899999999999996}]},{"osd":10,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":56460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":57070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3922,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":56834,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T09:38:57.764 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-09-13T09:38:57.764 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-13T09:38:57.765 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-09-13T09:38:57.766 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph health --format=json 2023-09-13T09:38:58.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:57 smithi006 ceph-mon[98665]: pgmap v279: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2023-09-13T09:38:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:57 smithi053 ceph-mon[102373]: pgmap v279: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2023-09-13T09:38:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:57 smithi131 ceph-mon[102785]: pgmap v279: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 11 op/s 2023-09-13T09:38:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:38:59.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:58 smithi053 ceph-mon[102373]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:59.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:58 smithi006 ceph-mon[98665]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:59.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:58 smithi131 ceph-mon[102785]: from='client.14970 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:38:59.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 -- 172.21.15.6:0/1850488848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43940ffc60 msgr2=0x7f43941000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:59.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1850488848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43940ffc60 0x7f43941000e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f43900099c0 tx=0x7f4390009cd0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 -- 172.21.15.6:0/1850488848 shutdown_connections 2023-09-13T09:38:59.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1850488848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4394100620 0x7f439410ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1850488848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4394105c70 0x7f4394106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1850488848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43940ffc60 0x7f43941000e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 -- 172.21.15.6:0/1850488848 >> 172.21.15.6:0/1850488848 conn(0x7f4394075c00 msgr2=0x7f4394076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 -- 172.21.15.6:0/1850488848 shutdown_connections 2023-09-13T09:38:59.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.685+0000 7f439c2ae700 1 -- 172.21.15.6:0/1850488848 wait complete. 2023-09-13T09:38:59.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 Processor -- start 2023-09-13T09:38:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 -- start start 2023-09-13T09:38:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43940ffc60 0x7f43941959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4394100620 0x7f4394195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:59.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4394105c70 0x7f4394196470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43941a51c0 con 0x7f4394100620 2023-09-13T09:38:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43941a5330 con 0x7f43940ffc60 2023-09-13T09:38:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439c2ae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43941a54f0 con 0x7f4394105c70 2023-09-13T09:38:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f4399849700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4394100620 0x7f4394195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f4399849700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4394100620 0x7f4394195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32830/0 (socket says 172.21.15.6:32830) 2023-09-13T09:38:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f4399849700 1 -- 172.21.15.6:0/1932085296 learned_addr learned my addr 172.21.15.6:0/1932085296 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:38:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439a04a700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43940ffc60 0x7f43941959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.686+0000 7f439a84b700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4394105c70 0x7f4394196470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f4399849700 1 -- 172.21.15.6:0/1932085296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4394105c70 msgr2=0x7f4394196470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f4399849700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4394105c70 0x7f4394196470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f4399849700 1 -- 172.21.15.6:0/1932085296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43940ffc60 msgr2=0x7f43941959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f4399849700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43940ffc60 0x7f43941959f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f4399849700 1 -- 172.21.15.6:0/1932085296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43900095f0 con 0x7f4394100620 2023-09-13T09:38:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f4399849700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4394100620 0x7f4394195f30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4390005910 tx=0x7f4390004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f438b7fe700 1 -- 172.21.15.6:0/1932085296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439001d070 con 0x7f4394100620 2023-09-13T09:38:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f438b7fe700 1 -- 172.21.15.6:0/1932085296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4390004090 con 0x7f4394100620 2023-09-13T09:38:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43941a5770 con 0x7f4394100620 2023-09-13T09:38:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f438b7fe700 1 -- 172.21.15.6:0/1932085296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4390022e70 con 0x7f4394100620 2023-09-13T09:38:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.687+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43941a5b80 con 0x7f4394100620 2023-09-13T09:38:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.688+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f439404e9b0 con 0x7f4394100620 2023-09-13T09:38:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.689+0000 7f438b7fe700 1 -- 172.21.15.6:0/1932085296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f4390022570 con 0x7f4394100620 2023-09-13T09:38:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.690+0000 7f438b7fe700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43800a06d0 0x7f43800a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:38:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.690+0000 7f439a04a700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43800a06d0 0x7f43800a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:38:59.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.690+0000 7f438b7fe700 1 -- 172.21.15.6:0/1932085296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f43900cd350 con 0x7f4394100620 2023-09-13T09:38:59.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.690+0000 7f439a04a700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43800a06d0 0x7f43800a2b90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4384005950 tx=0x7f438400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:38:59.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.693+0000 7f438b7fe700 1 -- 172.21.15.6:0/1932085296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4390096f60 con 0x7f4394100620 2023-09-13T09:38:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.939+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4394068d40 con 0x7f4394100620 2023-09-13T09:38:59.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.939+0000 7f438b7fe700 1 -- 172.21.15.6:0/1932085296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f439009a580 con 0x7f4394100620 2023-09-13T09:38:59.941 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:38:59.941 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-13T09:38:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43800a06d0 msgr2=0x7f43800a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43800a06d0 0x7f43800a2b90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f4384005950 tx=0x7f438400a300 comp rx=0 tx=0).stop 2023-09-13T09:38:59.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4394100620 msgr2=0x7f4394195f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:38:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4394100620 0x7f4394195f30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4390005910 tx=0x7f4390004730 comp rx=0 tx=0).stop 2023-09-13T09:38:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 shutdown_connections 2023-09-13T09:38:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4394105c70 0x7f4394196470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43940ffc60 0x7f43941959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43800a06d0 0x7f43800a2b90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 --2- 172.21.15.6:0/1932085296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4394100620 0x7f4394195f30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:38:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 >> 172.21.15.6:0/1932085296 conn(0x7f4394075c00 msgr2=0x7f43940fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:38:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 shutdown_connections 2023-09-13T09:38:59.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:38:59.941+0000 7f439c2ae700 1 -- 172.21.15.6:0/1932085296 wait complete. 2023-09-13T09:39:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:38:59 smithi006 ceph-mon[98665]: pgmap v280: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:38:59 smithi053 ceph-mon[102373]: pgmap v280: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:38:59 smithi131 ceph-mon[102785]: pgmap v280: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:00.294 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-09-13T09:39:00.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:00.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 -- 172.21.15.6:0/1292553378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c101830 msgr2=0x7f9d8c1080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 --2- 172.21.15.6:0/1292553378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c101830 0x7f9d8c1080e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9d8400b0d0 tx=0x7f9d8400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 -- 172.21.15.6:0/1292553378 shutdown_connections 2023-09-13T09:39:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 --2- 172.21.15.6:0/1292553378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c101830 0x7f9d8c1080e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 --2- 172.21.15.6:0/1292553378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c0ffca0 0x7f9d8c1000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 --2- 172.21.15.6:0/1292553378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d8c100e90 0x7f9d8c1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 -- 172.21.15.6:0/1292553378 >> 172.21.15.6:0/1292553378 conn(0x7f9d8c0fb1f0 msgr2=0x7f9d8c0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 -- 172.21.15.6:0/1292553378 shutdown_connections 2023-09-13T09:39:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.424+0000 7f9d92780700 1 -- 172.21.15.6:0/1292553378 wait complete. 2023-09-13T09:39:00.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 Processor -- start 2023-09-13T09:39:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 -- start start 2023-09-13T09:39:00.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c0ffca0 0x7f9d8c103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c100e90 0x7f9d8c102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d8c101830 0x7f9d8c1027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c102f50 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1030c0 con 0x7f9d8c101830 2023-09-13T09:39:00.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d92780700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8c1a0b80 con 0x7f9d8c100e90 2023-09-13T09:39:00.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c0ffca0 0x7f9d8c103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c0ffca0 0x7f9d8c103c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32842/0 (socket says 172.21.15.6:32842) 2023-09-13T09:39:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 -- 172.21.15.6:0/3143086631 learned_addr learned my addr 172.21.15.6:0/3143086631 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8b7fe700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c100e90 0x7f9d8c102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d90d1d700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d8c101830 0x7f9d8c1027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 -- 172.21.15.6:0/3143086631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c100e90 msgr2=0x7f9d8c102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c100e90 0x7f9d8c102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 -- 172.21.15.6:0/3143086631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d8c101830 msgr2=0x7f9d8c1027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d8c101830 0x7f9d8c1027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d8bfff700 1 -- 172.21.15.6:0/3143086631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d84009d00 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.425+0000 7f9d90d1d700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d8c101830 0x7f9d8c1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.426+0000 7f9d8bfff700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c0ffca0 0x7f9d8c103c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00d980 tx=0x7f9d7c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.426+0000 7f9d897fa700 1 -- 172.21.15.6:0/3143086631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c004020 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.426+0000 7f9d897fa700 1 -- 172.21.15.6:0/3143086631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9d7c009730 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.426+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d8c1a0e60 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.426+0000 7f9d897fa700 1 -- 172.21.15.6:0/3143086631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c003a30 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.426+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d8c1a1280 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.427+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8c10b4c0 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.428+0000 7f9d897fa700 1 -- 172.21.15.6:0/3143086631 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f9d7c0098a0 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.428+0000 7f9d897fa700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d780a06d0 0x7f9d780a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.429+0000 7f9d8b7fe700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d780a06d0 0x7f9d780a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.429+0000 7f9d897fa700 1 -- 172.21.15.6:0/3143086631 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9d7c0cb960 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.429+0000 7f9d8b7fe700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d780a06d0 0x7f9d780a2b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9d74005950 tx=0x7f9d7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:00.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.433+0000 7f9d897fa700 1 -- 172.21.15.6:0/3143086631 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9d7c0953e0 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.636+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d8c1a1500 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.638+0000 7f9d897fa700 1 -- 172.21.15.6:0/3143086631 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22001 (secure 0 0 0) 0x7f9d7c098a00 con 0x7f9d8c0ffca0 2023-09-13T09:39:00.639 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:00.640 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:10.679583+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d780a06d0 msgr2=0x7f9d780a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d780a06d0 0x7f9d780a2b90 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f9d74005950 tx=0x7f9d7400b410 comp rx=0 tx=0).stop 2023-09-13T09:39:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c0ffca0 msgr2=0x7f9d8c103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c0ffca0 0x7f9d8c103c30 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c00d980 tx=0x7f9d7c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:39:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 shutdown_connections 2023-09-13T09:39:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9d8c101830 0x7f9d8c1027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9d780a06d0 0x7f9d780a2b90 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9d8c0ffca0 0x7f9d8c103c30 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 --2- 172.21.15.6:0/3143086631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d8c100e90 0x7f9d8c102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 >> 172.21.15.6:0/3143086631 conn(0x7f9d8c0fb1f0 msgr2=0x7f9d8c0691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 shutdown_connections 2023-09-13T09:39:00.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.640+0000 7f9d92780700 1 -- 172.21.15.6:0/3143086631 wait complete. 2023-09-13T09:39:00.655 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:39:00.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:39:00.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3716702277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d98100990 msgr2=0x7f3d98100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3716702277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d98100990 0x7f3d98100e10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000b0a0 tx=0x7f3d9000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3716702277 shutdown_connections 2023-09-13T09:39:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3716702277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d98100990 0x7f3d98100e10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3716702277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d980ff670 0x7f3d980ffa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3716702277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d980fffd0 0x7f3d98100450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3716702277 >> 172.21.15.6:0/3716702277 conn(0x7f3d980fb250 msgr2=0x7f3d980fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3716702277 shutdown_connections 2023-09-13T09:39:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.784+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3716702277 wait complete. 2023-09-13T09:39:00.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 Processor -- start 2023-09-13T09:39:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 -- start start 2023-09-13T09:39:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d980ff670 0x7f3d98198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d980fffd0 0x7f3d98199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d98100990 0x7f3d981a04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981a0a80 con 0x7f3d980ff670 2023-09-13T09:39:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981a0bc0 con 0x7f3d980fffd0 2023-09-13T09:39:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9fcaa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d981a0d50 con 0x7f3d98100990 2023-09-13T09:39:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d980ff670 0x7f3d98198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d980ff670 0x7f3d98198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32854/0 (socket says 172.21.15.6:32854) 2023-09-13T09:39:00.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 -- 172.21.15.6:0/3110275239 learned_addr learned my addr 172.21.15.6:0/3110275239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9e247700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d98100990 0x7f3d981a04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 -- 172.21.15.6:0/3110275239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d98100990 msgr2=0x7f3d981a04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d98100990 0x7f3d981a04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 -- 172.21.15.6:0/3110275239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d980fffd0 msgr2=0x7f3d98199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9d245700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d980fffd0 0x7f3d98199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d980fffd0 0x7f3d98199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 -- 172.21.15.6:0/3110275239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d90009d00 con 0x7f3d980ff670 2023-09-13T09:39:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9d245700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d980fffd0 0x7f3d98199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.785+0000 7f3d9da46700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d980ff670 0x7f3d98198f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400b530 tx=0x7f3d9400b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:00.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.786+0000 7f3d8effd700 1 -- 172.21.15.6:0/3110275239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94011830 con 0x7f3d980ff670 2023-09-13T09:39:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.786+0000 7f3d8effd700 1 -- 172.21.15.6:0/3110275239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d94011e50 con 0x7f3d980ff670 2023-09-13T09:39:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.786+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d981a0fd0 con 0x7f3d980ff670 2023-09-13T09:39:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.786+0000 7f3d8effd700 1 -- 172.21.15.6:0/3110275239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400f2e0 con 0x7f3d980ff670 2023-09-13T09:39:00.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.786+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d981a14d0 con 0x7f3d980ff670 2023-09-13T09:39:00.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.787+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9810a450 con 0x7f3d980ff670 2023-09-13T09:39:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.788+0000 7f3d8effd700 1 -- 172.21.15.6:0/3110275239 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f3d94010580 con 0x7f3d980ff670 2023-09-13T09:39:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.788+0000 7f3d8effd700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d840a06d0 0x7f3d840a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:00.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.788+0000 7f3d9d245700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d840a06d0 0x7f3d840a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:00.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.788+0000 7f3d8effd700 1 -- 172.21.15.6:0/3110275239 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3d940cb5a0 con 0x7f3d980ff670 2023-09-13T09:39:00.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.789+0000 7f3d9d245700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d840a06d0 0x7f3d840a2b90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d88007900 tx=0x7f3d88008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:00.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.792+0000 7f3d8effd700 1 -- 172.21.15.6:0/3110275239 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f3d94095230 con 0x7f3d980ff670 2023-09-13T09:39:00.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.991+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d9810ea70 con 0x7f3d980ff670 2023-09-13T09:39:00.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.991+0000 7f3d8effd700 1 -- 172.21.15.6:0/3110275239 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d94098850 con 0x7f3d980ff670 2023-09-13T09:39:00.993 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:39:00.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d840a06d0 msgr2=0x7f3d840a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d840a06d0 0x7f3d840a2b90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3d88007900 tx=0x7f3d88008040 comp rx=0 tx=0).stop 2023-09-13T09:39:00.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d980ff670 msgr2=0x7f3d98198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:00.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d980ff670 0x7f3d98198f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3d9400b530 tx=0x7f3d9400b8f0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 shutdown_connections 2023-09-13T09:39:00.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d98100990 0x7f3d981a04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d840a06d0 0x7f3d840a2b90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3d980ff670 0x7f3d98198f00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 --2- 172.21.15.6:0/3110275239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3d980fffd0 0x7f3d98199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:00.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.993+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 >> 172.21.15.6:0/3110275239 conn(0x7f3d980fb250 msgr2=0x7f3d980fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:00.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.994+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 shutdown_connections 2023-09-13T09:39:00.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:00.994+0000 7f3d9fcaa700 1 -- 172.21.15.6:0/3110275239 wait complete. 2023-09-13T09:39:01.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:00 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1932085296' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-13T09:39:01.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:00 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3143086631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:01.007 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T09:39:01.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- 172.21.15.6:0/3388327977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7104101850 msgr2=0x7f7104108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 --2- 172.21.15.6:0/3388327977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7104101850 0x7f7104108100 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f70fc00b0d0 tx=0x7f70fc00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- 172.21.15.6:0/3388327977 shutdown_connections 2023-09-13T09:39:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 --2- 172.21.15.6:0/3388327977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7104101850 0x7f7104108100 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 --2- 172.21.15.6:0/3388327977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f71040ffcc0 0x7f71041000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 --2- 172.21.15.6:0/3388327977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104100eb0 0x7f7104101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- 172.21.15.6:0/3388327977 >> 172.21.15.6:0/3388327977 conn(0x7f71040fb250 msgr2=0x7f71040fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- 172.21.15.6:0/3388327977 shutdown_connections 2023-09-13T09:39:01.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- 172.21.15.6:0/3388327977 wait complete. 2023-09-13T09:39:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 Processor -- start 2023-09-13T09:39:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- start start 2023-09-13T09:39:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71040ffcc0 0x7f7104196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7104100eb0 0x7f7104196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104101850 0x7f710419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710419e620 con 0x7f71040ffcc0 2023-09-13T09:39:01.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710419e760 con 0x7f7104101850 2023-09-13T09:39:01.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.135+0000 7f710b0ae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710419e8f0 con 0x7f7104100eb0 2023-09-13T09:39:01.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71040ffcc0 0x7f7104196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71040ffcc0 0x7f7104196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32868/0 (socket says 172.21.15.6:32868) 2023-09-13T09:39:01.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 -- 172.21.15.6:0/1543369785 learned_addr learned my addr 172.21.15.6:0/1543369785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:01.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f710964b700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104101850 0x7f710419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7103fff700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7104100eb0 0x7f7104196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 -- 172.21.15.6:0/1543369785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7104100eb0 msgr2=0x7f7104196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7104100eb0 0x7f7104196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 -- 172.21.15.6:0/1543369785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104101850 msgr2=0x7f710419e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104101850 0x7f710419e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 -- 172.21.15.6:0/1543369785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc009d00 con 0x7f71040ffcc0 2023-09-13T09:39:01.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7103fff700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7104100eb0 0x7f7104196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:01.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7108e4a700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71040ffcc0 0x7f7104196aa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f70f800c8f0 tx=0x7f70f800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:01.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7101ffb700 1 -- 172.21.15.6:0/1543369785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8004220 con 0x7f71040ffcc0 2023-09-13T09:39:01.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7101ffb700 1 -- 172.21.15.6:0/1543369785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70f8004380 con 0x7f71040ffcc0 2023-09-13T09:39:01.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710419ebd0 con 0x7f71040ffcc0 2023-09-13T09:39:01.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f7101ffb700 1 -- 172.21.15.6:0/1543369785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70f8003c40 con 0x7f71040ffcc0 2023-09-13T09:39:01.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.136+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710419f090 con 0x7f71040ffcc0 2023-09-13T09:39:01.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.137+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710410b500 con 0x7f71040ffcc0 2023-09-13T09:39:01.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.138+0000 7f7101ffb700 1 -- 172.21.15.6:0/1543369785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f70f8007740 con 0x7f71040ffcc0 2023-09-13T09:39:01.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.139+0000 7f7101ffb700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70f40a06d0 0x7f70f40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.139+0000 7f7101ffb700 1 -- 172.21.15.6:0/1543369785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f70f80cb850 con 0x7f71040ffcc0 2023-09-13T09:39:01.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.139+0000 7f7103fff700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70f40a06d0 0x7f70f40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.139+0000 7f7103fff700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70f40a06d0 0x7f70f40a2b90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005fd0 tx=0x7f70f0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:01.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.143+0000 7f7101ffb700 1 -- 172.21.15.6:0/1543369785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f70f80952d0 con 0x7f71040ffcc0 2023-09-13T09:39:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:00 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1932085296' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-13T09:39:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:00 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3143086631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:00 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1932085296' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-09-13T09:39:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:00 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3143086631' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.341+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f710419f220 con 0x7f71040ffcc0 2023-09-13T09:39:01.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.342+0000 7f7101ffb700 1 -- 172.21.15.6:0/1543369785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70f80988f0 con 0x7f71040ffcc0 2023-09-13T09:39:01.343 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T09:39:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70f40a06d0 msgr2=0x7f70f40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70f40a06d0 0x7f70f40a2b90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f70f0005fd0 tx=0x7f70f0005e30 comp rx=0 tx=0).stop 2023-09-13T09:39:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71040ffcc0 msgr2=0x7f7104196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71040ffcc0 0x7f7104196aa0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f70f800c8f0 tx=0x7f70f800cc00 comp rx=0 tx=0).stop 2023-09-13T09:39:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 shutdown_connections 2023-09-13T09:39:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7104101850 0x7f710419e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70f40a06d0 0x7f70f40a2b90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f71040ffcc0 0x7f7104196aa0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 --2- 172.21.15.6:0/1543369785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7104100eb0 0x7f7104196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 >> 172.21.15.6:0/1543369785 conn(0x7f71040fb250 msgr2=0x7f7104068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 shutdown_connections 2023-09-13T09:39:01.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.344+0000 7f710b0ae700 1 -- 172.21.15.6:0/1543369785 wait complete. 2023-09-13T09:39:01.357 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T09:39:01.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 -- 172.21.15.6:0/1078797459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 msgr2=0x7fd0cc108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/1078797459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc108100 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd0c400b0d0 tx=0x7fd0c400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 -- 172.21.15.6:0/1078797459 shutdown_connections 2023-09-13T09:39:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/1078797459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc108100 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/1078797459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0cc0ffcc0 0x7fd0cc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/1078797459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0cc100eb0 0x7fd0cc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 -- 172.21.15.6:0/1078797459 >> 172.21.15.6:0/1078797459 conn(0x7fd0cc0fb250 msgr2=0x7fd0cc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 -- 172.21.15.6:0/1078797459 shutdown_connections 2023-09-13T09:39:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 -- 172.21.15.6:0/1078797459 wait complete. 2023-09-13T09:39:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.485+0000 7fd0d43a5700 1 Processor -- start 2023-09-13T09:39:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d43a5700 1 -- start start 2023-09-13T09:39:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d43a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0cc0ffcc0 0x7fd0cc068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d43a5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0cc100eb0 0x7fd0cc19b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d43a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc19dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d43a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19e6b0 con 0x7fd0cc101850 2023-09-13T09:39:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d43a5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19e820 con 0x7fd0cc100eb0 2023-09-13T09:39:01.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d43a5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0cc19e9e0 con 0x7fd0cc0ffcc0 2023-09-13T09:39:01.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc19dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc19dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32884/0 (socket says 172.21.15.6:32884) 2023-09-13T09:39:01.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 -- 172.21.15.6:0/2174120269 learned_addr learned my addr 172.21.15.6:0/2174120269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:01.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2141700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0cc0ffcc0 0x7fd0cc068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d1940700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0cc100eb0 0x7fd0cc19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 -- 172.21.15.6:0/2174120269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0cc0ffcc0 msgr2=0x7fd0cc068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0cc0ffcc0 0x7fd0cc068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 -- 172.21.15.6:0/2174120269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0cc100eb0 msgr2=0x7fd0cc19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0cc100eb0 0x7fd0cc19b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 -- 172.21.15.6:0/2174120269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4009d00 con 0x7fd0cc101850 2023-09-13T09:39:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2141700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0cc0ffcc0 0x7fd0cc068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0d2942700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc19dee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4007a00 tx=0x7fd0c4009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.486+0000 7fd0c37fe700 1 -- 172.21.15.6:0/2174120269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c400e040 con 0x7fd0cc101850 2023-09-13T09:39:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.487+0000 7fd0c37fe700 1 -- 172.21.15.6:0/2174120269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0c4003e10 con 0x7fd0cc101850 2023-09-13T09:39:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.487+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0cc19ec60 con 0x7fd0cc101850 2023-09-13T09:39:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.487+0000 7fd0c37fe700 1 -- 172.21.15.6:0/2174120269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c4005610 con 0x7fd0cc101850 2023-09-13T09:39:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.487+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0cc19f0e0 con 0x7fd0cc101850 2023-09-13T09:39:01.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.488+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0cc10b4e0 con 0x7fd0cc101850 2023-09-13T09:39:01.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.489+0000 7fd0c37fe700 1 -- 172.21.15.6:0/2174120269 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd0c4005770 con 0x7fd0cc101850 2023-09-13T09:39:01.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.489+0000 7fd0c37fe700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0b80a0750 0x7fd0b80a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.489+0000 7fd0c37fe700 1 -- 172.21.15.6:0/2174120269 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd0c40cda00 con 0x7fd0cc101850 2023-09-13T09:39:01.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.489+0000 7fd0d2141700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0b80a0750 0x7fd0b80a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.490+0000 7fd0d2141700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0b80a0750 0x7fd0b80a2c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc100d10 tx=0x7fd0bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:01.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.493+0000 7fd0c37fe700 1 -- 172.21.15.6:0/2174120269 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd0c4097610 con 0x7fd0cc101850 2023-09-13T09:39:01.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.694+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd0cc106b20 con 0x7fd0cc101850 2023-09-13T09:39:01.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.695+0000 7fd0c37fe700 1 -- 172.21.15.6:0/2174120269 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd0c409ac30 con 0x7fd0cc101850 2023-09-13T09:39:01.696 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T09:39:01.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0b80a0750 msgr2=0x7fd0b80a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0b80a0750 0x7fd0b80a2c10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd0cc100d10 tx=0x7fd0bc005f90 comp rx=0 tx=0).stop 2023-09-13T09:39:01.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 msgr2=0x7fd0cc19dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc19dee0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd0c4007a00 tx=0x7fd0c4009570 comp rx=0 tx=0).stop 2023-09-13T09:39:01.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 shutdown_connections 2023-09-13T09:39:01.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0b80a0750 0x7fd0b80a2c10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0cc101850 0x7fd0cc19dee0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0cc0ffcc0 0x7fd0cc068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 --2- 172.21.15.6:0/2174120269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0cc100eb0 0x7fd0cc19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 >> 172.21.15.6:0/2174120269 conn(0x7fd0cc0fb250 msgr2=0x7fd0cc0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:01.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 shutdown_connections 2023-09-13T09:39:01.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.697+0000 7fd0d43a5700 1 -- 172.21.15.6:0/2174120269 wait complete. 2023-09-13T09:39:01.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:39:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 -- 172.21.15.6:0/393750738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c102950 msgr2=0x7f8b0c109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/393750738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c102950 0x7f8b0c109200 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8b0400b0d0 tx=0x7f8b0400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 -- 172.21.15.6:0/393750738 shutdown_connections 2023-09-13T09:39:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/393750738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c102950 0x7f8b0c109200 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/393750738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b0c100dc0 0x7f8b0c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/393750738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b0c101fb0 0x7f8b0c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 -- 172.21.15.6:0/393750738 >> 172.21.15.6:0/393750738 conn(0x7f8b0c0fc330 msgr2=0x7f8b0c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 -- 172.21.15.6:0/393750738 shutdown_connections 2023-09-13T09:39:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.837+0000 7f8b11f4c700 1 -- 172.21.15.6:0/393750738 wait complete. 2023-09-13T09:39:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 Processor -- start 2023-09-13T09:39:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 -- start start 2023-09-13T09:39:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b0c100dc0 0x7f8b0c196bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c101fb0 0x7f8b0c1970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b0c102950 0x7f8b0c19e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c19e730 con 0x7f8b0c101fb0 2023-09-13T09:39:01.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c19e870 con 0x7f8b0c102950 2023-09-13T09:39:01.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b11f4c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c19ea00 con 0x7f8b0c100dc0 2023-09-13T09:39:01.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b0affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c101fb0 0x7f8b0c1970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b0affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c101fb0 0x7f8b0c1970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32896/0 (socket says 172.21.15.6:32896) 2023-09-13T09:39:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b0affd700 1 -- 172.21.15.6:0/2120186457 learned_addr learned my addr 172.21.15.6:0/2120186457 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b0b7fe700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b0c100dc0 0x7f8b0c196bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.838+0000 7f8b0bfff700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b0c102950 0x7f8b0c19e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b0affd700 1 -- 172.21.15.6:0/2120186457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b0c100dc0 msgr2=0x7f8b0c196bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b0affd700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b0c100dc0 0x7f8b0c196bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b0affd700 1 -- 172.21.15.6:0/2120186457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b0c102950 msgr2=0x7f8b0c19e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b0affd700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b0c102950 0x7f8b0c19e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b0affd700 1 -- 172.21.15.6:0/2120186457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b04009d00 con 0x7f8b0c101fb0 2023-09-13T09:39:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b0affd700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c101fb0 0x7f8b0c1970f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00c920 tx=0x7f8afc00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b08ff9700 1 -- 172.21.15.6:0/2120186457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc004a30 con 0x7f8b0c101fb0 2023-09-13T09:39:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c19ece0 con 0x7f8b0c101fb0 2023-09-13T09:39:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b08ff9700 1 -- 172.21.15.6:0/2120186457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8afc0054e0 con 0x7f8b0c101fb0 2023-09-13T09:39:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b08ff9700 1 -- 172.21.15.6:0/2120186457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8afc007c10 con 0x7f8b0c101fb0 2023-09-13T09:39:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.839+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c19f1a0 con 0x7f8b0c101fb0 2023-09-13T09:39:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.840+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c108300 con 0x7f8b0c101fb0 2023-09-13T09:39:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.841+0000 7f8b08ff9700 1 -- 172.21.15.6:0/2120186457 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f8afc005000 con 0x7f8b0c101fb0 2023-09-13T09:39:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.842+0000 7f8b08ff9700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8af40a06d0 0x7f8af40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.842+0000 7f8b08ff9700 1 -- 172.21.15.6:0/2120186457 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8afc0cba30 con 0x7f8b0c101fb0 2023-09-13T09:39:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.842+0000 7f8b0b7fe700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8af40a06d0 0x7f8af40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.842+0000 7f8b0b7fe700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8af40a06d0 0x7f8af40a2b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c101e10 tx=0x7f8b0000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:01.845+0000 7f8b08ff9700 1 -- 172.21.15.6:0/2120186457 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8afc0955b0 con 0x7f8b0c101fb0 2023-09-13T09:39:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:01 smithi006 ceph-mon[98665]: pgmap v281: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:01 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3110275239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:01 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1543369785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:01 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2174120269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.090+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b0c02cf50 con 0x7f8b0c101fb0 2023-09-13T09:39:02.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.090+0000 7f8b08ff9700 1 -- 172.21.15.6:0/2120186457 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f8afc01d090 con 0x7f8b0c101fb0 2023-09-13T09:39:02.092 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:02.092 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:39:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8af40a06d0 msgr2=0x7f8af40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8af40a06d0 0x7f8af40a2b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c101e10 tx=0x7f8b0000b410 comp rx=0 tx=0).stop 2023-09-13T09:39:02.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c101fb0 msgr2=0x7f8b0c1970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c101fb0 0x7f8b0c1970f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f8afc00c920 tx=0x7f8afc00cc30 comp rx=0 tx=0).stop 2023-09-13T09:39:02.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 shutdown_connections 2023-09-13T09:39:02.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8b0c102950 0x7f8b0c19e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b0c100dc0 0x7f8b0c196bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8af40a06d0 0x7f8af40a2b90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 --2- 172.21.15.6:0/2120186457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b0c101fb0 0x7f8b0c1970f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 >> 172.21.15.6:0/2120186457 conn(0x7f8b0c0fc330 msgr2=0x7f8b0c105440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:02.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 shutdown_connections 2023-09-13T09:39:02.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.093+0000 7f8b11f4c700 1 -- 172.21.15.6:0/2120186457 wait complete. 2023-09-13T09:39:02.097 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:02.107 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 -- 172.21.15.6:0/4100175042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4101820 msgr2=0x7f2eb41080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/4100175042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4101820 0x7f2eb41080d0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2eac00b0d0 tx=0x7f2eac00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 -- 172.21.15.6:0/4100175042 shutdown_connections 2023-09-13T09:39:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/4100175042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4101820 0x7f2eb41080d0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/4100175042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb40ffc90 0x7f2eb41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/4100175042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb4100e80 0x7f2eb41012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 -- 172.21.15.6:0/4100175042 >> 172.21.15.6:0/4100175042 conn(0x7f2eb40fb220 msgr2=0x7f2eb40fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 -- 172.21.15.6:0/4100175042 shutdown_connections 2023-09-13T09:39:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.231+0000 7f2ebaca8700 1 -- 172.21.15.6:0/4100175042 wait complete. 2023-09-13T09:39:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 Processor -- start 2023-09-13T09:39:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 -- start start 2023-09-13T09:39:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb40ffc90 0x7f2eb4196cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4100e80 0x7f2eb4197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb4101820 0x7f2eb419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb419e830 con 0x7f2eb4100e80 2023-09-13T09:39:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb419e9a0 con 0x7f2eb40ffc90 2023-09-13T09:39:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2ebaca8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb419eb60 con 0x7f2eb4101820 2023-09-13T09:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4100e80 0x7f2eb4197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4100e80 0x7f2eb4197200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32910/0 (socket says 172.21.15.6:32910) 2023-09-13T09:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 -- 172.21.15.6:0/761895741 learned_addr learned my addr 172.21.15.6:0/761895741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb9245700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb4101820 0x7f2eb419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb8a44700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb40ffc90 0x7f2eb4196cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 -- 172.21.15.6:0/761895741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb4101820 msgr2=0x7f2eb419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb4101820 0x7f2eb419e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 -- 172.21.15.6:0/761895741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb40ffc90 msgr2=0x7f2eb4196cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb40ffc90 0x7f2eb4196cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb3fff700 1 -- 172.21.15.6:0/761895741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac009d00 con 0x7f2eb4100e80 2023-09-13T09:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.232+0000 7f2eb8a44700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb40ffc90 0x7f2eb4196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.233+0000 7f2eb3fff700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4100e80 0x7f2eb4197200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000b530 tx=0x7f2ea000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.233+0000 7f2eb1ffb700 1 -- 172.21.15.6:0/761895741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0011830 con 0x7f2eb4100e80 2023-09-13T09:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.233+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb419ee40 con 0x7f2eb4100e80 2023-09-13T09:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.233+0000 7f2eb1ffb700 1 -- 172.21.15.6:0/761895741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea0011e50 con 0x7f2eb4100e80 2023-09-13T09:39:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.233+0000 7f2eb1ffb700 1 -- 172.21.15.6:0/761895741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea000f2e0 con 0x7f2eb4100e80 2023-09-13T09:39:02.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.233+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb419f340 con 0x7f2eb4100e80 2023-09-13T09:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.234+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb410b5c0 con 0x7f2eb4100e80 2023-09-13T09:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.235+0000 7f2eb1ffb700 1 -- 172.21.15.6:0/761895741 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f2ea0010580 con 0x7f2eb4100e80 2023-09-13T09:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.235+0000 7f2eb1ffb700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea40a06d0 0x7f2ea40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.236+0000 7f2eb1ffb700 1 -- 172.21.15.6:0/761895741 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2ea00cb5a0 con 0x7f2eb4100e80 2023-09-13T09:39:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.236+0000 7f2eb8a44700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea40a06d0 0x7f2ea40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.236+0000 7f2eb8a44700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea40a06d0 0x7f2ea40a2b90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4197b90 tx=0x7f2ea8008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.240+0000 7f2eb1ffb700 1 -- 172.21.15.6:0/761895741 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2ea0095230 con 0x7f2eb4100e80 2023-09-13T09:39:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:01 smithi053 ceph-mon[102373]: pgmap v281: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:01 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3110275239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:01 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1543369785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:01 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2174120269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:01 smithi131 ceph-mon[102785]: pgmap v281: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:01 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3110275239' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:01 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1543369785' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:01 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2174120269' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:02.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.445+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2eb419f880 con 0x7f2eb4100e80 2023-09-13T09:39:02.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.446+0000 7f2eb1ffb700 1 -- 172.21.15.6:0/761895741 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22001 (secure 0 0 0) 0x7f2ea0098850 con 0x7f2eb4100e80 2023-09-13T09:39:02.447 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:02.448 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:10.679583+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:02.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea40a06d0 msgr2=0x7f2ea40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea40a06d0 0x7f2ea40a2b90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f2eb4197b90 tx=0x7f2ea8008040 comp rx=0 tx=0).stop 2023-09-13T09:39:02.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4100e80 msgr2=0x7f2eb4197200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4100e80 0x7f2eb4197200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000b530 tx=0x7f2ea000b8f0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 shutdown_connections 2023-09-13T09:39:02.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb4101820 0x7f2eb419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb40ffc90 0x7f2eb4196cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea40a06d0 0x7f2ea40a2b90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 --2- 172.21.15.6:0/761895741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb4100e80 0x7f2eb4197200 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 >> 172.21.15.6:0/761895741 conn(0x7f2eb40fb220 msgr2=0x7f2eb4067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:02.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.448+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 shutdown_connections 2023-09-13T09:39:02.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.449+0000 7f2ebaca8700 1 -- 172.21.15.6:0/761895741 wait complete. 2023-09-13T09:39:02.462 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:39:02.463 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:39:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 -- 172.21.15.6:0/1239008806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 msgr2=0x7f62e4103bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 --2- 172.21.15.6:0/1239008806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4103bf0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f62cc009990 tx=0x7f62cc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 -- 172.21.15.6:0/1239008806 shutdown_connections 2023-09-13T09:39:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 --2- 172.21.15.6:0/1239008806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62e4106a60 0x7f62e4108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 --2- 172.21.15.6:0/1239008806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4103bf0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 --2- 172.21.15.6:0/1239008806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e4104130 0x7f62e4106520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 -- 172.21.15.6:0/1239008806 >> 172.21.15.6:0/1239008806 conn(0x7f62e40fb1f0 msgr2=0x7f62e40fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 -- 172.21.15.6:0/1239008806 shutdown_connections 2023-09-13T09:39:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 -- 172.21.15.6:0/1239008806 wait complete. 2023-09-13T09:39:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 Processor -- start 2023-09-13T09:39:02.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.594+0000 7f62e984b700 1 -- start start 2023-09-13T09:39:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e4104130 0x7f62e4196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62e4106a60 0x7f62e419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e419e5c0 con 0x7f62e4101800 2023-09-13T09:39:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e419e700 con 0x7f62e4104130 2023-09-13T09:39:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e419e890 con 0x7f62e4106a60 2023-09-13T09:39:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32920/0 (socket says 172.21.15.6:32920) 2023-09-13T09:39:02.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 -- 172.21.15.6:0/1034311679 learned_addr learned my addr 172.21.15.6:0/1034311679 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e37fe700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62e4106a60 0x7f62e419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e27fc700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e4104130 0x7f62e4196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 -- 172.21.15.6:0/1034311679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62e4106a60 msgr2=0x7f62e419dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62e4106a60 0x7f62e419dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 -- 172.21.15.6:0/1034311679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e4104130 msgr2=0x7f62e4196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e4104130 0x7f62e4196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 -- 172.21.15.6:0/1034311679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc0095f0 con 0x7f62e4101800 2023-09-13T09:39:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e27fc700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e4104130 0x7f62e4196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e2ffd700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4196a40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f62cc005910 tx=0x7f62cc00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:02.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e8849700 1 -- 172.21.15.6:0/1034311679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc01d070 con 0x7f62e4101800 2023-09-13T09:39:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e8849700 1 -- 172.21.15.6:0/1034311679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62cc00fc30 con 0x7f62e4101800 2023-09-13T09:39:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e419eb10 con 0x7f62e4101800 2023-09-13T09:39:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e8849700 1 -- 172.21.15.6:0/1034311679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62cc017650 con 0x7f62e4101800 2023-09-13T09:39:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.595+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e419ef30 con 0x7f62e4101800 2023-09-13T09:39:02.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.597+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e40fcd70 con 0x7f62e4101800 2023-09-13T09:39:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.598+0000 7f62e8849700 1 -- 172.21.15.6:0/1034311679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f62cc022470 con 0x7f62e4101800 2023-09-13T09:39:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.598+0000 7f62e8849700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f62d00a06d0 0x7f62d00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.599+0000 7f62e27fc700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f62d00a06d0 0x7f62d00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.599+0000 7f62e8849700 1 -- 172.21.15.6:0/1034311679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f62cc0cd0c0 con 0x7f62e4101800 2023-09-13T09:39:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.599+0000 7f62e27fc700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f62d00a06d0 0x7f62d00a2b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005fd0 tx=0x7f62d4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:02.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.603+0000 7f62e8849700 1 -- 172.21.15.6:0/1034311679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f62cc096cd0 con 0x7f62e4101800 2023-09-13T09:39:02.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.808+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f62e410c6a0 con 0x7f62e4101800 2023-09-13T09:39:02.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.809+0000 7f62e8849700 1 -- 172.21.15.6:0/1034311679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) v1 ==== 93+0+10 (secure 0 0 0) 0x7f62cc09a2f0 con 0x7f62e4101800 2023-09-13T09:39:02.810 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:39:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f62d00a06d0 msgr2=0x7f62d00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f62d00a06d0 0x7f62d00a2b90 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f62d4005fd0 tx=0x7f62d4005ee0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 msgr2=0x7f62e4196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4196a40 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f62cc005910 tx=0x7f62cc00f740 comp rx=0 tx=0).stop 2023-09-13T09:39:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 shutdown_connections 2023-09-13T09:39:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62e4106a60 0x7f62e419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f62d00a06d0 0x7f62d00a2b90 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e4101800 0x7f62e4196a40 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 --2- 172.21.15.6:0/1034311679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62e4104130 0x7f62e4196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 >> 172.21.15.6:0/1034311679 conn(0x7f62e40fb1f0 msgr2=0x7f62e4102490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 shutdown_connections 2023-09-13T09:39:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.811+0000 7f62e984b700 1 -- 172.21.15.6:0/1034311679 wait complete. 2023-09-13T09:39:02.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T09:39:02.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.954+0000 7fd21cf87700 1 -- 172.21.15.6:0/4134856541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2180ffcc0 msgr2=0x7fd2181000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.954+0000 7fd21cf87700 1 --2- 172.21.15.6:0/4134856541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2180ffcc0 0x7fd2181000e0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd2080099c0 tx=0x7fd208009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 -- 172.21.15.6:0/4134856541 shutdown_connections 2023-09-13T09:39:02.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 --2- 172.21.15.6:0/4134856541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218101850 0x7fd218108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 --2- 172.21.15.6:0/4134856541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2180ffcc0 0x7fd2181000e0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 --2- 172.21.15.6:0/4134856541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd218100eb0 0x7fd218101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 -- 172.21.15.6:0/4134856541 >> 172.21.15.6:0/4134856541 conn(0x7fd2180fb250 msgr2=0x7fd2180fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:02.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 -- 172.21.15.6:0/4134856541 shutdown_connections 2023-09-13T09:39:02.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 -- 172.21.15.6:0/4134856541 wait complete. 2023-09-13T09:39:02.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 Processor -- start 2023-09-13T09:39:02.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.955+0000 7fd21cf87700 1 -- start start 2023-09-13T09:39:02.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21cf87700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180ffcc0 0x7fd2180698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21cf87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218100eb0 0x7fd21819b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21cf87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd218101850 0x7fd21819dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21cf87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21819e4e0 con 0x7fd218101850 2023-09-13T09:39:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21cf87700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21819e650 con 0x7fd218100eb0 2023-09-13T09:39:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21cf87700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21819e810 con 0x7fd2180ffcc0 2023-09-13T09:39:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd218101850 0x7fd21819dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd218101850 0x7fd21819dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32938/0 (socket says 172.21.15.6:32938) 2023-09-13T09:39:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 -- 172.21.15.6:0/1199296142 learned_addr learned my addr 172.21.15.6:0/1199296142 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd215d9b700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218100eb0 0x7fd21819b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21659c700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180ffcc0 0x7fd2180698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 -- 172.21.15.6:0/1199296142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180ffcc0 msgr2=0x7fd2180698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180ffcc0 0x7fd2180698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 -- 172.21.15.6:0/1199296142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218100eb0 msgr2=0x7fd21819b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218100eb0 0x7fd21819b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 -- 172.21.15.6:0/1199296142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080095f0 con 0x7fd218101850 2023-09-13T09:39:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21659c700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180ffcc0 0x7fd2180698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:02.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd216d9d700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd218101850 0x7fd21819dd10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd210007d70 tx=0x7fd21000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:02.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd2077fe700 1 -- 172.21.15.6:0/1199296142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd21000ad40 con 0x7fd218101850 2023-09-13T09:39:02.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd2077fe700 1 -- 172.21.15.6:0/1199296142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2100128e0 con 0x7fd218101850 2023-09-13T09:39:02.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21819eaf0 con 0x7fd218101850 2023-09-13T09:39:02.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.956+0000 7fd2077fe700 1 -- 172.21.15.6:0/1199296142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd210011780 con 0x7fd218101850 2023-09-13T09:39:02.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.957+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21819efb0 con 0x7fd218101850 2023-09-13T09:39:02.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.957+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21810b520 con 0x7fd218101850 2023-09-13T09:39:02.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.958+0000 7fd2077fe700 1 -- 172.21.15.6:0/1199296142 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd210012a50 con 0x7fd218101850 2023-09-13T09:39:02.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.959+0000 7fd2077fe700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2000a06d0 0x7fd2000a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:02.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.959+0000 7fd21659c700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2000a06d0 0x7fd2000a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.959+0000 7fd2077fe700 1 -- 172.21.15.6:0/1199296142 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd2100cbdc0 con 0x7fd218101850 2023-09-13T09:39:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.960+0000 7fd21659c700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2000a06d0 0x7fd2000a2b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2080098e0 tx=0x7fd208000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:02.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:02.963+0000 7fd2077fe700 1 -- 172.21.15.6:0/1199296142 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd210095a50 con 0x7fd218101850 2023-09-13T09:39:03.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.168+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd218106ad0 con 0x7fd218101850 2023-09-13T09:39:03.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.168+0000 7fd2077fe700 1 -- 172.21.15.6:0/1199296142 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd210099070 con 0x7fd218101850 2023-09-13T09:39:03.170 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T09:39:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2000a06d0 msgr2=0x7fd2000a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2000a06d0 0x7fd2000a2b90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2080098e0 tx=0x7fd208000bc0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd218101850 msgr2=0x7fd21819dd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd218101850 0x7fd21819dd10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fd210007d70 tx=0x7fd21000a340 comp rx=0 tx=0).stop 2023-09-13T09:39:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 shutdown_connections 2023-09-13T09:39:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2000a06d0 0x7fd2000a2b90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd218101850 0x7fd21819dd10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180ffcc0 0x7fd2180698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 --2- 172.21.15.6:0/1199296142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd218100eb0 0x7fd21819b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 >> 172.21.15.6:0/1199296142 conn(0x7fd2180fb250 msgr2=0x7fd2180fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 shutdown_connections 2023-09-13T09:39:03.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.171+0000 7fd21cf87700 1 -- 172.21.15.6:0/1199296142 wait complete. 2023-09-13T09:39:03.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:02 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2120186457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:03.183 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:02 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/761895741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:03.184 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:02 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1034311679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:03.185 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T09:39:03.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:02 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2120186457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:03.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:02 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/761895741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:03.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:02 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1034311679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:03.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:02 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2120186457' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:03.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:02 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/761895741' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:03.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:02 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1034311679' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:03.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.312+0000 7fd40cce9700 1 -- 172.21.15.6:0/3509143531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408104170 msgr2=0x7fd408106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.312+0000 7fd40cce9700 1 --2- 172.21.15.6:0/3509143531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408104170 0x7fd408106560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009990 tx=0x7fd3f8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.312+0000 7fd40cce9700 1 -- 172.21.15.6:0/3509143531 shutdown_connections 2023-09-13T09:39:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.312+0000 7fd40cce9700 1 --2- 172.21.15.6:0/3509143531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd408106aa0 0x7fd408108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.312+0000 7fd40cce9700 1 --2- 172.21.15.6:0/3509143531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd408101840 0x7fd408103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.312+0000 7fd40cce9700 1 --2- 172.21.15.6:0/3509143531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408104170 0x7fd408106560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.312+0000 7fd40cce9700 1 -- 172.21.15.6:0/3509143531 >> 172.21.15.6:0/3509143531 conn(0x7fd4080fb250 msgr2=0x7fd4080fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 -- 172.21.15.6:0/3509143531 shutdown_connections 2023-09-13T09:39:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 -- 172.21.15.6:0/3509143531 wait complete. 2023-09-13T09:39:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 Processor -- start 2023-09-13T09:39:03.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 -- start start 2023-09-13T09:39:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408101840 0x7fd408196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd408104170 0x7fd408196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd408106aa0 0x7fd40819e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40819e600 con 0x7fd408101840 2023-09-13T09:39:03.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40819e740 con 0x7fd408104170 2023-09-13T09:39:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.313+0000 7fd40cce9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40819e8d0 con 0x7fd408106aa0 2023-09-13T09:39:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408101840 0x7fd408196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408101840 0x7fd408196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32948/0 (socket says 172.21.15.6:32948) 2023-09-13T09:39:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 -- 172.21.15.6:0/649845100 learned_addr learned my addr 172.21.15.6:0/649845100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:03.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd405d9b700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd408104170 0x7fd408196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd406d9d700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd408106aa0 0x7fd40819e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 -- 172.21.15.6:0/649845100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd408106aa0 msgr2=0x7fd40819e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd408106aa0 0x7fd40819e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 -- 172.21.15.6:0/649845100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd408104170 msgr2=0x7fd408196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd408104170 0x7fd408196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 -- 172.21.15.6:0/649845100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f80095f0 con 0x7fd408101840 2023-09-13T09:39:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd406d9d700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd408106aa0 0x7fd40819e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd405d9b700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd408104170 0x7fd408196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40659c700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408101840 0x7fd408196a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00d950 tx=0x7fd3fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd3f77fe700 1 -- 172.21.15.6:0/649845100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc009b40 con 0x7fd408101840 2023-09-13T09:39:03.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd3f77fe700 1 -- 172.21.15.6:0/649845100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd3fc009ca0 con 0x7fd408101840 2023-09-13T09:39:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40819ebb0 con 0x7fd408101840 2023-09-13T09:39:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd3f77fe700 1 -- 172.21.15.6:0/649845100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3fc00f620 con 0x7fd408101840 2023-09-13T09:39:03.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.314+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40819f0c0 con 0x7fd408101840 2023-09-13T09:39:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.315+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4080fcdd0 con 0x7fd408101840 2023-09-13T09:39:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.316+0000 7fd3f77fe700 1 -- 172.21.15.6:0/649845100 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd3fc010460 con 0x7fd408101840 2023-09-13T09:39:03.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.317+0000 7fd3f77fe700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3f00a06d0 0x7fd3f00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.317+0000 7fd405d9b700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3f00a06d0 0x7fd3f00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.317+0000 7fd3f77fe700 1 -- 172.21.15.6:0/649845100 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd3fc0cbf10 con 0x7fd408101840 2023-09-13T09:39:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.317+0000 7fd405d9b700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3f00a06d0 0x7fd3f00a2b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8006010 tx=0x7fd3f800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:03.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.320+0000 7fd3f77fe700 1 -- 172.21.15.6:0/649845100 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd3fc095a90 con 0x7fd408101840 2023-09-13T09:39:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.523+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd40810c760 con 0x7fd408101840 2023-09-13T09:39:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.523+0000 7fd3f77fe700 1 -- 172.21.15.6:0/649845100 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd3fc020020 con 0x7fd408101840 2023-09-13T09:39:03.525 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T09:39:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3f00a06d0 msgr2=0x7fd3f00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3f00a06d0 0x7fd3f00a2b90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8006010 tx=0x7fd3f800b540 comp rx=0 tx=0).stop 2023-09-13T09:39:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408101840 msgr2=0x7fd408196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408101840 0x7fd408196a80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd3fc00d950 tx=0x7fd3fc00dd10 comp rx=0 tx=0).stop 2023-09-13T09:39:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 shutdown_connections 2023-09-13T09:39:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd408106aa0 0x7fd40819e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd3f00a06d0 0x7fd3f00a2b90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd408101840 0x7fd408196a80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 --2- 172.21.15.6:0/649845100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd408104170 0x7fd408196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.525+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 >> 172.21.15.6:0/649845100 conn(0x7fd4080fb250 msgr2=0x7fd4081024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.526+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 shutdown_connections 2023-09-13T09:39:03.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.526+0000 7fd40cce9700 1 -- 172.21.15.6:0/649845100 wait complete. 2023-09-13T09:39:03.539 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:39:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 -- 172.21.15.6:0/2392418656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030102940 msgr2=0x7ff0301091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 --2- 172.21.15.6:0/2392418656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030102940 0x7ff0301091f0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff02800b0d0 tx=0x7ff02800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 -- 172.21.15.6:0/2392418656 shutdown_connections 2023-09-13T09:39:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 --2- 172.21.15.6:0/2392418656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030102940 0x7ff0301091f0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 --2- 172.21.15.6:0/2392418656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff030100db0 0x7ff0301011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 --2- 172.21.15.6:0/2392418656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff030101fa0 0x7ff030102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 -- 172.21.15.6:0/2392418656 >> 172.21.15.6:0/2392418656 conn(0x7ff0300fc320 msgr2=0x7ff0300fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 -- 172.21.15.6:0/2392418656 shutdown_connections 2023-09-13T09:39:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.663+0000 7ff0359fa700 1 -- 172.21.15.6:0/2392418656 wait complete. 2023-09-13T09:39:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 Processor -- start 2023-09-13T09:39:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 -- start start 2023-09-13T09:39:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030100db0 0x7ff030074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff030101fa0 0x7ff0300730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff030102940 0x7ff0300735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff030073d80 con 0x7ff030100db0 2023-09-13T09:39:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff030073ef0 con 0x7ff030102940 2023-09-13T09:39:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff0359fa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0301a0bc0 con 0x7ff030101fa0 2023-09-13T09:39:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030100db0 0x7ff030074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030100db0 0x7ff030074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32962/0 (socket says 172.21.15.6:32962) 2023-09-13T09:39:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 -- 172.21.15.6:0/493953873 learned_addr learned my addr 172.21.15.6:0/493953873 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02e7fc700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff030101fa0 0x7ff0300730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02f7fe700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff030102940 0x7ff0300735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 -- 172.21.15.6:0/493953873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff030101fa0 msgr2=0x7ff0300730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff030101fa0 0x7ff0300730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 -- 172.21.15.6:0/493953873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff030102940 msgr2=0x7ff0300735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff030102940 0x7ff0300735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.664+0000 7ff02effd700 1 -- 172.21.15.6:0/493953873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff028009d00 con 0x7ff030100db0 2023-09-13T09:39:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.665+0000 7ff02e7fc700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff030101fa0 0x7ff0300730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.665+0000 7ff02effd700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030100db0 0x7ff030074a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff02000d980 tx=0x7ff02000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.665+0000 7ff0349f8700 1 -- 172.21.15.6:0/493953873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02000de60 con 0x7ff030100db0 2023-09-13T09:39:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.665+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0301a0ea0 con 0x7ff030100db0 2023-09-13T09:39:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.665+0000 7ff0349f8700 1 -- 172.21.15.6:0/493953873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff0200044e0 con 0x7ff030100db0 2023-09-13T09:39:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.665+0000 7ff0349f8700 1 -- 172.21.15.6:0/493953873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff020003be0 con 0x7ff030100db0 2023-09-13T09:39:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.665+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0301a12c0 con 0x7ff030100db0 2023-09-13T09:39:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.666+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff030108320 con 0x7ff030100db0 2023-09-13T09:39:03.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.667+0000 7ff0349f8700 1 -- 172.21.15.6:0/493953873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7ff020009bb0 con 0x7ff030100db0 2023-09-13T09:39:03.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.667+0000 7ff0349f8700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff01c0a06d0 0x7ff01c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:03.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.668+0000 7ff02e7fc700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff01c0a06d0 0x7ff01c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:03.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.668+0000 7ff0349f8700 1 -- 172.21.15.6:0/493953873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff0200cb900 con 0x7ff030100db0 2023-09-13T09:39:03.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.668+0000 7ff02e7fc700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff01c0a06d0 0x7ff01c0a2b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff018009cb0 tx=0x7ff018009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:03.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.672+0000 7ff0349f8700 1 -- 172.21.15.6:0/493953873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff020095480 con 0x7ff030100db0 2023-09-13T09:39:03.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.920+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff03010c860 con 0x7ff030100db0 2023-09-13T09:39:03.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.920+0000 7ff0349f8700 1 -- 172.21.15.6:0/493953873 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7ff020009940 con 0x7ff030100db0 2023-09-13T09:39:03.922 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:03.922 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:39:03.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff01c0a06d0 msgr2=0x7ff01c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff01c0a06d0 0x7ff01c0a2b90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff018009cb0 tx=0x7ff018009260 comp rx=0 tx=0).stop 2023-09-13T09:39:03.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030100db0 msgr2=0x7ff030074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:03.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030100db0 0x7ff030074a60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7ff02000d980 tx=0x7ff02000dd40 comp rx=0 tx=0).stop 2023-09-13T09:39:03.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 shutdown_connections 2023-09-13T09:39:03.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff030102940 0x7ff0300735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff01c0a06d0 0x7ff01c0a2b90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff030100db0 0x7ff030074a60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 --2- 172.21.15.6:0/493953873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff030101fa0 0x7ff0300730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 >> 172.21.15.6:0/493953873 conn(0x7ff0300fc320 msgr2=0x7ff030105460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 shutdown_connections 2023-09-13T09:39:03.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:03.923+0000 7ff0359fa700 1 -- 172.21.15.6:0/493953873 wait complete. 2023-09-13T09:39:03.927 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:03.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 -- 172.21.15.6:0/2050727305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840ffc90 msgr2=0x7f05841000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 --2- 172.21.15.6:0/2050727305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840ffc90 0x7f05841000b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f05740099c0 tx=0x7f0574009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 -- 172.21.15.6:0/2050727305 shutdown_connections 2023-09-13T09:39:04.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 --2- 172.21.15.6:0/2050727305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0584101820 0x7f05841080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 --2- 172.21.15.6:0/2050727305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840ffc90 0x7f05841000b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 --2- 172.21.15.6:0/2050727305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0584100e80 0x7f05841012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 -- 172.21.15.6:0/2050727305 >> 172.21.15.6:0/2050727305 conn(0x7f05840fb220 msgr2=0x7f05840fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 -- 172.21.15.6:0/2050727305 shutdown_connections 2023-09-13T09:39:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.061+0000 7f05889bc700 1 -- 172.21.15.6:0/2050727305 wait complete. 2023-09-13T09:39:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 Processor -- start 2023-09-13T09:39:04.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 -- start start 2023-09-13T09:39:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05840ffc90 0x7f0584195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0584100e80 0x7f0584195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0584101820 0x7f058419cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058419d4f0 con 0x7f0584101820 2023-09-13T09:39:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058419d630 con 0x7f05840ffc90 2023-09-13T09:39:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f05889bc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058419d7c0 con 0x7f0584100e80 2023-09-13T09:39:04.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f0582d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0584101820 0x7f058419cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f0582d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0584101820 0x7f058419cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32980/0 (socket says 172.21.15.6:32980) 2023-09-13T09:39:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f0582d9d700 1 -- 172.21.15.6:0/3210585209 learned_addr learned my addr 172.21.15.6:0/3210585209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.062+0000 7f0581d9b700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0584100e80 0x7f0584195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f058259c700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05840ffc90 0x7f0584195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f0582d9d700 1 -- 172.21.15.6:0/3210585209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0584100e80 msgr2=0x7f0584195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f0582d9d700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0584100e80 0x7f0584195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f0582d9d700 1 -- 172.21.15.6:0/3210585209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05840ffc90 msgr2=0x7f0584195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f0582d9d700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05840ffc90 0x7f0584195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f0582d9d700 1 -- 172.21.15.6:0/3210585209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05740095f0 con 0x7f0584101820 2023-09-13T09:39:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f0582d9d700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0584101820 0x7f058419cf20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f057c00ada0 tx=0x7f057c00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f05737fe700 1 -- 172.21.15.6:0/3210585209 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00f070 con 0x7f0584101820 2023-09-13T09:39:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f05737fe700 1 -- 172.21.15.6:0/3210585209 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f057c007b30 con 0x7f0584101820 2023-09-13T09:39:04.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058419daa0 con 0x7f0584101820 2023-09-13T09:39:04.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f05737fe700 1 -- 172.21.15.6:0/3210585209 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c005280 con 0x7f0584101820 2023-09-13T09:39:04.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.063+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058419dfb0 con 0x7f0584101820 2023-09-13T09:39:04.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.064+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0584107280 con 0x7f0584101820 2023-09-13T09:39:04.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.065+0000 7f05737fe700 1 -- 172.21.15.6:0/3210585209 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f057c00a090 con 0x7f0584101820 2023-09-13T09:39:04.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.066+0000 7f05737fe700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f056c0a06d0 0x7f056c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.066+0000 7f058259c700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f056c0a06d0 0x7f056c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.066+0000 7f05737fe700 1 -- 172.21.15.6:0/3210585209 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f057c0cb650 con 0x7f0584101820 2023-09-13T09:39:04.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.066+0000 7f058259c700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f056c0a06d0 0x7f056c0a2b90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0574009f50 tx=0x7f057400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.069+0000 7f05737fe700 1 -- 172.21.15.6:0/3210585209 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f057c098cf0 con 0x7f0584101820 2023-09-13T09:39:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:03 smithi006 ceph-mon[98665]: pgmap v282: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:39:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:03 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1199296142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:03 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/649845100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:04.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:03 smithi053 ceph-mon[102373]: pgmap v282: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:39:04.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:03 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1199296142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:04.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:03 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/649845100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:03 smithi131 ceph-mon[102785]: pgmap v282: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:39:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:03 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1199296142' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:03 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/649845100' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:04.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.270+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f058402d020 con 0x7f0584101820 2023-09-13T09:39:04.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.272+0000 7f05737fe700 1 -- 172.21.15.6:0/3210585209 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22001 (secure 0 0 0) 0x7f057c098880 con 0x7f0584101820 2023-09-13T09:39:04.273 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:04.274 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":84,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:38:10.679583+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:04.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f056c0a06d0 msgr2=0x7f056c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f056c0a06d0 0x7f056c0a2b90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0574009f50 tx=0x7f057400b540 comp rx=0 tx=0).stop 2023-09-13T09:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0584101820 msgr2=0x7f058419cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0584101820 0x7f058419cf20 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f057c00ada0 tx=0x7f057c00c330 comp rx=0 tx=0).stop 2023-09-13T09:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 shutdown_connections 2023-09-13T09:39:04.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f056c0a06d0 0x7f056c0a2b90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0584101820 0x7f058419cf20 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05840ffc90 0x7f0584195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 --2- 172.21.15.6:0/3210585209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0584100e80 0x7f0584195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 >> 172.21.15.6:0/3210585209 conn(0x7f05840fb220 msgr2=0x7f05841043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 shutdown_connections 2023-09-13T09:39:04.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.274+0000 7f05889bc700 1 -- 172.21.15.6:0/3210585209 wait complete. 2023-09-13T09:39:04.288 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:39:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 -- 172.21.15.6:0/2226450090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0100eb0 msgr2=0x7f20e0101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 --2- 172.21.15.6:0/2226450090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0100eb0 0x7f20e0101310 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f20d00099c0 tx=0x7f20d0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 -- 172.21.15.6:0/2226450090 shutdown_connections 2023-09-13T09:39:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 --2- 172.21.15.6:0/2226450090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e0101850 0x7f20e0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 --2- 172.21.15.6:0/2226450090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00ffcc0 0x7f20e01000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 --2- 172.21.15.6:0/2226450090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0100eb0 0x7f20e0101310 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 -- 172.21.15.6:0/2226450090 >> 172.21.15.6:0/2226450090 conn(0x7f20e00fb250 msgr2=0x7f20e00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 -- 172.21.15.6:0/2226450090 shutdown_connections 2023-09-13T09:39:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.413+0000 7f20e766e700 1 -- 172.21.15.6:0/2226450090 wait complete. 2023-09-13T09:39:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 Processor -- start 2023-09-13T09:39:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 -- start start 2023-09-13T09:39:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00ffcc0 0x7f20e0069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e0100eb0 0x7f20e019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0101850 0x7f20e019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e019e640 con 0x7f20e0101850 2023-09-13T09:39:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e019e7b0 con 0x7f20e0100eb0 2023-09-13T09:39:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e766e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20e019e970 con 0x7f20e00ffcc0 2023-09-13T09:39:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e5c0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0101850 0x7f20e019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e5c0b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0101850 0x7f20e019dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32994/0 (socket says 172.21.15.6:32994) 2023-09-13T09:39:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e540a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00ffcc0 0x7f20e0069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.414+0000 7f20e5c0b700 1 -- 172.21.15.6:0/106423935 learned_addr learned my addr 172.21.15.6:0/106423935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e4c09700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e0100eb0 0x7f20e019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e5c0b700 1 -- 172.21.15.6:0/106423935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00ffcc0 msgr2=0x7f20e0069880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e5c0b700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00ffcc0 0x7f20e0069880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e5c0b700 1 -- 172.21.15.6:0/106423935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e0100eb0 msgr2=0x7f20e019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e5c0b700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e0100eb0 0x7f20e019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e5c0b700 1 -- 172.21.15.6:0/106423935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d00095f0 con 0x7f20e0101850 2023-09-13T09:39:04.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e4c09700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e0100eb0 0x7f20e019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e5c0b700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0101850 0x7f20e019dea0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20d800b970 tx=0x7f20d800bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20d67fc700 1 -- 172.21.15.6:0/106423935 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d800c930 con 0x7f20e0101850 2023-09-13T09:39:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20d67fc700 1 -- 172.21.15.6:0/106423935 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f20d8014440 con 0x7f20e0101850 2023-09-13T09:39:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20e019ec50 con 0x7f20e0101850 2023-09-13T09:39:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20d67fc700 1 -- 172.21.15.6:0/106423935 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20d80075d0 con 0x7f20e0101850 2023-09-13T09:39:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.415+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20e019f1e0 con 0x7f20e0101850 2023-09-13T09:39:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.416+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20e010b5f0 con 0x7f20e0101850 2023-09-13T09:39:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.417+0000 7f20d67fc700 1 -- 172.21.15.6:0/106423935 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f20d80145b0 con 0x7f20e0101850 2023-09-13T09:39:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.418+0000 7f20d67fc700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20cc0a0750 0x7f20cc0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.418+0000 7f20d67fc700 1 -- 172.21.15.6:0/106423935 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f20d8006e40 con 0x7f20e0101850 2023-09-13T09:39:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.418+0000 7f20e540a700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20cc0a0750 0x7f20cc0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.418+0000 7f20e540a700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20cc0a0750 0x7f20cc0a2c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20e0100d10 tx=0x7f20dc009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.422+0000 7f20d67fc700 1 -- 172.21.15.6:0/106423935 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f20d80951c0 con 0x7f20e0101850 2023-09-13T09:39:04.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.668+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f20e010b7e0 con 0x7f20e0101850 2023-09-13T09:39:04.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.669+0000 7f20d67fc700 1 -- 172.21.15.6:0/106423935 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f20d8019090 con 0x7f20e0101850 2023-09-13T09:39:04.671 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:04.671 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:39:04.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20cc0a0750 msgr2=0x7f20cc0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20cc0a0750 0x7f20cc0a2c10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f20e0100d10 tx=0x7f20dc009190 comp rx=0 tx=0).stop 2023-09-13T09:39:04.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0101850 msgr2=0x7f20e019dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0101850 0x7f20e019dea0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f20d800b970 tx=0x7f20d800bc80 comp rx=0 tx=0).stop 2023-09-13T09:39:04.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 shutdown_connections 2023-09-13T09:39:04.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f20cc0a0750 0x7f20cc0a2c10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20e0101850 0x7f20e019dea0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f20e00ffcc0 0x7f20e0069880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 --2- 172.21.15.6:0/106423935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f20e0100eb0 0x7f20e019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 >> 172.21.15.6:0/106423935 conn(0x7f20e00fb250 msgr2=0x7f20e00fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 shutdown_connections 2023-09-13T09:39:04.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.671+0000 7f20e766e700 1 -- 172.21.15.6:0/106423935 wait complete. 2023-09-13T09:39:04.675 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:04.685 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-09-13T09:38:09.116270+0000', 'modified': '2023-09-13T09:38:16.673454+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24521, 'mds_1': 24484, 'mds_2': 24482, 'mds_3': 24466, 'mds_4': 24455}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14634': {'gid': 14634, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/565321366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 565321366}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 565321366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14646': {'gid': 14646, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/1420340613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 1420340613}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 1420340613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6833/4209861668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6832', 'nonce': 4209861668}, {'type': 'v1', 'addr': '172.21.15.131:6833', 'nonce': 4209861668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24428': {'gid': 24428, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6833/162812581', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6832', 'nonce': 162812581}, {'type': 'v1', 'addr': '172.21.15.53:6833', 'nonce': 162812581}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6835/487237413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 487237413}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 487237413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.53:6835/460375736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 460375736}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 460375736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.131:6837/687345485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 687345485}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 687345485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.53:6837/1211463882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6836', 'nonce': 1211463882}, {'type': 'v1', 'addr': '172.21.15.53:6837', 'nonce': 1211463882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6839/381550019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6838', 'nonce': 381550019}, {'type': 'v1', 'addr': '172.21.15.131:6839', 'nonce': 381550019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24521': {'gid': 24521, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6839/1050659050', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6838', 'nonce': 1050659050}, {'type': 'v1', 'addr': '172.21.15.53:6839', 'nonce': 1050659050}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T09:39:04.686 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-09-13T09:39:04.686 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-09-13T09:39:04.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 -- 172.21.15.6:0/309958529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc100dd0 msgr2=0x7fc3cc1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 --2- 172.21.15.6:0/309958529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc100dd0 0x7fc3cc1011f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0099c0 tx=0x7fc3bc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 -- 172.21.15.6:0/309958529 shutdown_connections 2023-09-13T09:39:04.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 --2- 172.21.15.6:0/309958529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3cc102960 0x7fc3cc109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 --2- 172.21.15.6:0/309958529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc100dd0 0x7fc3cc1011f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 --2- 172.21.15.6:0/309958529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3cc101fc0 0x7fc3cc102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 -- 172.21.15.6:0/309958529 >> 172.21.15.6:0/309958529 conn(0x7fc3cc0fc320 msgr2=0x7fc3cc0fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 -- 172.21.15.6:0/309958529 shutdown_connections 2023-09-13T09:39:04.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.813+0000 7fc3d205d700 1 -- 172.21.15.6:0/309958529 wait complete. 2023-09-13T09:39:04.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 Processor -- start 2023-09-13T09:39:04.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 -- start start 2023-09-13T09:39:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3cc100dd0 0x7fc3cc196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3cc101fc0 0x7fc3cc197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc102960 0x7fc3cc19e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc19e6d0 con 0x7fc3cc102960 2023-09-13T09:39:04.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc19e810 con 0x7fc3cc100dd0 2023-09-13T09:39:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3d205d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3cc19e9a0 con 0x7fc3cc101fc0 2023-09-13T09:39:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc102960 0x7fc3cc19e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc102960 0x7fc3cc19e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33008/0 (socket says 172.21.15.6:33008) 2023-09-13T09:39:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.814+0000 7fc3cbfff700 1 -- 172.21.15.6:0/1896026832 learned_addr learned my addr 172.21.15.6:0/1896026832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:04.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3cc100dd0 0x7fc3cc196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3caffd700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3cc101fc0 0x7fc3cc197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3cbfff700 1 -- 172.21.15.6:0/1896026832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3cc101fc0 msgr2=0x7fc3cc197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3cc101fc0 0x7fc3cc197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3cbfff700 1 -- 172.21.15.6:0/1896026832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3cc100dd0 msgr2=0x7fc3cc196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3cc100dd0 0x7fc3cc196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3cbfff700 1 -- 172.21.15.6:0/1896026832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3bc0095f0 con 0x7fc3cc102960 2023-09-13T09:39:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc102960 0x7fc3cc19e100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400b970 tx=0x7fc3c400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3c8ff9700 1 -- 172.21.15.6:0/1896026832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c400c930 con 0x7fc3cc102960 2023-09-13T09:39:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3c8ff9700 1 -- 172.21.15.6:0/1896026832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3c4014440 con 0x7fc3cc102960 2023-09-13T09:39:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3cc19ec80 con 0x7fc3cc102960 2023-09-13T09:39:04.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3c8ff9700 1 -- 172.21.15.6:0/1896026832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40075d0 con 0x7fc3cc102960 2023-09-13T09:39:04.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.815+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc19f190 con 0x7fc3cc102960 2023-09-13T09:39:04.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.817+0000 7fc3c8ff9700 1 -- 172.21.15.6:0/1896026832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fc3c40145b0 con 0x7fc3cc102960 2023-09-13T09:39:04.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.818+0000 7fc3c8ff9700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3b80a06d0 0x7fc3b80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.818+0000 7fc3c8ff9700 1 -- 172.21.15.6:0/1896026832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc3c4006e40 con 0x7fc3cc102960 2023-09-13T09:39:04.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.818+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3b80a06d0 0x7fc3b80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.818+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3b80a06d0 0x7fc3b80a2b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009f50 tx=0x7fc3bc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 Processor -- start 2023-09-13T09:39:04.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 -- start start 2023-09-13T09:39:04.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ed6b0 0x55a4a75edad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ee010 0x55a4a75ec470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ec9b0 0x55a4a75ece30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a7545730 con 0x55a4a75ec9b0 2023-09-13T09:39:04.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a7543050 con 0x55a4a75ed6b0 2023-09-13T09:39:04.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3de242b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a753e940 con 0x55a4a75ee010 2023-09-13T09:39:04.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ec9b0 0x55a4a75ece30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ec9b0 0x55a4a75ece30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33016/0 (socket says 172.21.15.6:33016) 2023-09-13T09:39:04.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 -- 172.21.15.6:0/4204956461 learned_addr learned my addr 172.21.15.6:0/4204956461 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:04.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3caffd700 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ee010 0x55a4a75ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ed6b0 0x55a4a75edad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 -- 172.21.15.6:0/4204956461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ee010 msgr2=0x55a4a75ec470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ee010 0x55a4a75ec470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 -- 172.21.15.6:0/4204956461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ed6b0 msgr2=0x55a4a75edad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ed6b0 0x55a4a75edad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 -- 172.21.15.6:0/4204956461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4a73be5e0 con 0x55a4a75ec9b0 2023-09-13T09:39:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.819+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ec9b0 0x55a4a75ece30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40a0540 tx=0x7fc3c4004be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8742db24cf795c56 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3c1ffb700 1 -- 172.21.15.6:0/4204956461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4098a00 con 0x55a4a75ec9b0 2023-09-13T09:39:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3c1ffb700 1 -- 172.21.15.6:0/4204956461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3c409c830 con 0x55a4a75ec9b0 2023-09-13T09:39:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3c1ffb700 1 -- 172.21.15.6:0/4204956461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c4098150 con 0x55a4a75ec9b0 2023-09-13T09:39:04.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 -- 172.21.15.6:0/4204956461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ec9b0 msgr2=0x55a4a75ece30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ec9b0 0x55a4a75ece30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40a0540 tx=0x7fc3c4004be0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 -- 172.21.15.6:0/4204956461 shutdown_connections 2023-09-13T09:39:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ec9b0 0x55a4a75ece30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ed6b0 0x55a4a75edad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 --2- 172.21.15.6:0/4204956461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ee010 0x55a4a75ec470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 -- 172.21.15.6:0/4204956461 >> 172.21.15.6:0/4204956461 conn(0x55a4a754ac30 msgr2=0x55a4a75e6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 -- 172.21.15.6:0/4204956461 shutdown_connections 2023-09-13T09:39:04.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.820+0000 7fc3de242b80 1 -- 172.21.15.6:0/4204956461 wait complete. 2023-09-13T09:39:04.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 -- start start 2023-09-13T09:39:04.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 Processor -- start 2023-09-13T09:39:04.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ee010 0x55a4a75fd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a74dcb60 con 0x55a4a75ee010 2023-09-13T09:39:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a74dc860 con 0x55a4a75ec9b0 2023-09-13T09:39:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.821+0000 7fc3de242b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a73c08d0 con 0x55a4a75ed6b0 2023-09-13T09:39:04.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3de242b80 10 client.0 _ll_register_callbacks cb 0x55a4a74da630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:04.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ee010 0x55a4a75fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ee010 0x55a4a75fd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33022/0 (socket says 172.21.15.6:33022) 2023-09-13T09:39:04.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 -- 172.21.15.6:0/565165531 learned_addr learned my addr 172.21.15.6:0/565165531 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:04.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3caffd700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 -- 172.21.15.6:0/565165531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 msgr2=0x55a4a75f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 -- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 msgr2=0x55a4a75f5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f5eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 -- 172.21.15.6:0/565165531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc19f190 con 0x55a4a75ee010 2023-09-13T09:39:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3caffd700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ee010 0x55a4a75fd430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400b940 tx=0x7fc3c40098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b692580fa97a11f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3aaffd700 1 -- 172.21.15.6:0/565165531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40b80c0 con 0x55a4a75ee010 2023-09-13T09:39:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3aaffd700 1 -- 172.21.15.6:0/565165531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc3c40947f0 con 0x55a4a75ee010 2023-09-13T09:39:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a4a75df620 con 0x55a4a75ee010 2023-09-13T09:39:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3aaffd700 1 -- 172.21.15.6:0/565165531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c40949b0 con 0x55a4a75ee010 2023-09-13T09:39:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3de242b80 10 client.15060 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a4a7556750 con 0x55a4a75ee010 2023-09-13T09:39:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.822+0000 7fc3aaffd700 1 -- 172.21.15.6:0/565165531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a4a75df620 con 0x55a4a75ee010 2023-09-13T09:39:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3aaffd700 1 -- 172.21.15.6:0/565165531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc3c409d570 con 0x55a4a75ee010 2023-09-13T09:39:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3de242b80 10 client.15060 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3de242b80 10 client.15060 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-13T09:39:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3de242b80 20 client.15060 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3de242b80 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a7601600 0x55a4a7600360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3de242b80 4 client.15060 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4a7537920 con 0x55a4a7601600 2023-09-13T09:39:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.823+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a7601600 0x55a4a7600360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.824+0000 7fc3aaffd700 10 client.15060 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.824+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a7601600 0x55a4a7600360 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2e168115d69044ef server_cookie=ec69191f1e3fe498 in_seq=0 out_seq=0 2023-09-13T09:39:04.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.824+0000 7fc3aaffd700 1 -- 172.21.15.6:0/565165531 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a4a7537920 con 0x55a4a7601600 2023-09-13T09:39:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.824+0000 7fc3aaffd700 10 client.15060 handle_command_reply: tid=0 2023-09-13T09:39:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.824+0000 7fc3de242b80 1 client.15060 shutdown 2023-09-13T09:39:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ee010 msgr2=0x55a4a75fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ee010 0x55a4a75fd430 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400b940 tx=0x7fc3c40098b0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 shutdown_connections 2023-09-13T09:39:04.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a7601600 0x55a4a7600360 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ee010 0x55a4a75fd430 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3aaffd700 0 client.15060 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:04.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f5eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 --2- 172.21.15.6:0/565165531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 >> 172.21.15.6:0/565165531 conn(0x55a4a754ac30 msgr2=0x55a4a75e17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 shutdown_connections 2023-09-13T09:39:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 1 -- 172.21.15.6:0/565165531 wait complete. 2023-09-13T09:39:04.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.825+0000 7fc3de242b80 20 client.15060 trim_cache size 0 max 16384 2023-09-13T09:39:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 Processor -- start 2023-09-13T09:39:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 -- start start 2023-09-13T09:39:04.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a754ac30 0x55a4a75ec470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a74dcb60 con 0x55a4a754ac30 2023-09-13T09:39:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a75ff0a0 con 0x55a4a75ec9b0 2023-09-13T09:39:04.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.842+0000 7fc3de242b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a75f5390 con 0x55a4a75ed6b0 2023-09-13T09:39:04.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a754ac30 0x55a4a75ec470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a754ac30 0x55a4a75ec470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33026/0 (socket says 172.21.15.6:33026) 2023-09-13T09:39:04.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 -- 172.21.15.6:0/3411769161 learned_addr learned my addr 172.21.15.6:0/3411769161 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:04.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3caffd700 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 -- 172.21.15.6:0/3411769161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 msgr2=0x55a4a75f0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 -- 172.21.15.6:0/3411769161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 msgr2=0x55a4a75fd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75fd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 -- 172.21.15.6:0/3411769161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a4a736ad90 con 0x55a4a754ac30 2023-09-13T09:39:04.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:04.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3caffd700 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:04.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a754ac30 0x55a4a75ec470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0099c0 tx=0x7fc3bc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c023d4035fdc2771 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3c27fc700 1 -- 172.21.15.6:0/3411769161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc00bcd0 con 0x55a4a754ac30 2023-09-13T09:39:04.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3c27fc700 1 -- 172.21.15.6:0/3411769161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3bc02a040 con 0x55a4a754ac30 2023-09-13T09:39:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.843+0000 7fc3c27fc700 1 -- 172.21.15.6:0/3411769161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3bc003b20 con 0x55a4a754ac30 2023-09-13T09:39:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 -- 172.21.15.6:0/3411769161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a754ac30 msgr2=0x55a4a75ec470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a754ac30 0x55a4a75ec470 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc0099c0 tx=0x7fc3bc020000 comp rx=0 tx=0).stop 2023-09-13T09:39:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 -- 172.21.15.6:0/3411769161 shutdown_connections 2023-09-13T09:39:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ed6b0 0x55a4a75f0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a754ac30 0x55a4a75ec470 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3411769161 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a75ec9b0 0x55a4a75fd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 -- 172.21.15.6:0/3411769161 >> 172.21.15.6:0/3411769161 conn(0x55a4a75e71f0 msgr2=0x55a4a7600360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 -- 172.21.15.6:0/3411769161 shutdown_connections 2023-09-13T09:39:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 -- 172.21.15.6:0/3411769161 wait complete. 2023-09-13T09:39:04.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 -- start start 2023-09-13T09:39:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.844+0000 7fc3de242b80 1 Processor -- start 2023-09-13T09:39:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a754ac30 0x55a4a75f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ed6b0 0x55a4a7654ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a75f8d50 con 0x55a4a75ed6b0 2023-09-13T09:39:04.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a7655530 con 0x55a4a754ac30 2023-09-13T09:39:04.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4a7655670 con 0x55a4a75ec9b0 2023-09-13T09:39:04.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 10 client.0 _ll_register_callbacks cb 0x55a4a74da630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:04.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ed6b0 0x55a4a7654ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ed6b0 0x55a4a7654ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33036/0 (socket says 172.21.15.6:33036) 2023-09-13T09:39:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 -- 172.21.15.6:0/3476456621 learned_addr learned my addr 172.21.15.6:0/3476456621 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a754ac30 0x55a4a75f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3caffd700 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 -- 172.21.15.6:0/3476456621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ec9b0 msgr2=0x55a4a75f8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 -- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a754ac30 msgr2=0x55a4a75f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a754ac30 0x55a4a75f81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 -- 172.21.15.6:0/3476456621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3cc109b60 con 0x55a4a75ed6b0 2023-09-13T09:39:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3cbfff700 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ed6b0 0x55a4a7654ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4098990 tx=0x7fc3c4014ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d231e5c7cb052be9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:04.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3aaffd700 1 -- 172.21.15.6:0/3476456621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3c40a0a70 con 0x55a4a75ed6b0 2023-09-13T09:39:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3aaffd700 1 -- 172.21.15.6:0/3476456621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc3c40148d0 con 0x55a4a75ed6b0 2023-09-13T09:39:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.845+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc3c409c830 con 0x55a4a75ed6b0 2023-09-13T09:39:04.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3aaffd700 1 -- 172.21.15.6:0/3476456621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3c40947f0 con 0x55a4a75ed6b0 2023-09-13T09:39:04.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 10 client.15066 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:04.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a4a7353c10 con 0x55a4a75ed6b0 2023-09-13T09:39:04.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3aaffd700 1 -- 172.21.15.6:0/3476456621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc3c409c830 con 0x55a4a75ed6b0 2023-09-13T09:39:04.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3aaffd700 1 -- 172.21.15.6:0/3476456621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc3c4097bd0 con 0x55a4a75ed6b0 2023-09-13T09:39:04.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 10 client.15066 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 10 client.15066 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-13T09:39:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 20 client.15066 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a75ee010 0x55a4a76567c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 4 client.15066 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:04.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a4a74f8000 con 0x55a4a75ee010 2023-09-13T09:39:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.846+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a75ee010 0x55a4a76567c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3aaffd700 10 client.15066 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3cb7fe700 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a75ee010 0x55a4a76567c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=53bab07b3c4792af server_cookie=1db4664c667f17bc in_seq=0 out_seq=0 2023-09-13T09:39:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3aaffd700 1 -- 172.21.15.6:0/3476456621 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55a4a74f8000 con 0x55a4a75ee010 2023-09-13T09:39:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3aaffd700 10 client.15066 handle_command_reply: tid=0 2023-09-13T09:39:04.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 client.15066 shutdown 2023-09-13T09:39:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ed6b0 msgr2=0x55a4a7654ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ed6b0 0x55a4a7654ff0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc3c4098990 tx=0x7fc3c4014ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 shutdown_connections 2023-09-13T09:39:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4a75ee010 0x55a4a76567c0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a4a75ed6b0 0x55a4a7654ff0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3aaffd700 0 client.15066 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a4a754ac30 0x55a4a75f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 --2- 172.21.15.6:0/3476456621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a4a75ec9b0 0x55a4a75f8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 >> 172.21.15.6:0/3476456621 conn(0x55a4a75e71f0 msgr2=0x55a4a75f0970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 shutdown_connections 2023-09-13T09:39:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 1 -- 172.21.15.6:0/3476456621 wait complete. 2023-09-13T09:39:04.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.847+0000 7fc3de242b80 20 client.15066 trim_cache size 0 max 16384 2023-09-13T09:39:04.871 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:04.872 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:04.872 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2023-09-13T09:39:04.872 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24455, 2023-09-13T09:39:04.872 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:04.872 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:04.872 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:04.873 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 49.068502260999999, 2023-09-13T09:39:04.873 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:04.873 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-09-13T09:39:04.873 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:04.873 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 76.980736661999998 2023-09-13T09:39:04.874 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:04.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3b80a06d0 msgr2=0x7fc3b80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3b80a06d0 0x7fc3b80a2b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc3bc009f50 tx=0x7fc3bc00b540 comp rx=0 tx=0).stop 2023-09-13T09:39:04.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc102960 msgr2=0x7fc3cc19e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:04.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc102960 0x7fc3cc19e100 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400b970 tx=0x7fc3c400bc80 comp rx=0 tx=0).stop 2023-09-13T09:39:04.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 shutdown_connections 2023-09-13T09:39:04.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3b80a06d0 0x7fc3b80a2b90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc3cc102960 0x7fc3cc19e100 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc3cc100dd0 0x7fc3cc196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 --2- 172.21.15.6:0/1896026832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3cc101fc0 0x7fc3cc197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:04.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 >> 172.21.15.6:0/1896026832 conn(0x7fc3cc0fc320 msgr2=0x7fc3cc0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:04.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 shutdown_connections 2023-09-13T09:39:04.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:04.848+0000 7fc3d205d700 1 -- 172.21.15.6:0/1896026832 wait complete. 2023-09-13T09:39:04.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-13T09:39:05.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 -- 172.21.15.6:0/138332859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e00101820 msgr2=0x7f7e001080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 --2- 172.21.15.6:0/138332859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e00101820 0x7f7e001080d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f7df800b0d0 tx=0x7f7df800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 -- 172.21.15.6:0/138332859 shutdown_connections 2023-09-13T09:39:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 --2- 172.21.15.6:0/138332859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e00101820 0x7f7e001080d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 --2- 172.21.15.6:0/138332859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e000ffc90 0x7f7e001000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 --2- 172.21.15.6:0/138332859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e00100e80 0x7f7e001012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 -- 172.21.15.6:0/138332859 >> 172.21.15.6:0/138332859 conn(0x7f7e000fb220 msgr2=0x7f7e000fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 -- 172.21.15.6:0/138332859 shutdown_connections 2023-09-13T09:39:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 -- 172.21.15.6:0/138332859 wait complete. 2023-09-13T09:39:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.004+0000 7f7e06286700 1 Processor -- start 2023-09-13T09:39:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e06286700 1 -- start start 2023-09-13T09:39:05.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:04 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/493953873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:04 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3210585209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:04 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/106423935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e06286700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e000ffc90 0x7f7e00069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e06286700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e00100e80 0x7f7e0019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e06286700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e00101820 0x7f7e0019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e06286700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0019e670 con 0x7f7e000ffc90 2023-09-13T09:39:05.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e06286700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0019e7e0 con 0x7f7e00101820 2023-09-13T09:39:05.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e06286700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0019e9a0 con 0x7f7e00100e80 2023-09-13T09:39:05.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e000ffc90 0x7f7e00069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e000ffc90 0x7f7e00069cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33046/0 (socket says 172.21.15.6:33046) 2023-09-13T09:39:05.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 -- 172.21.15.6:0/3735010471 learned_addr learned my addr 172.21.15.6:0/3735010471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7e04823700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e00101820 0x7f7e0019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e00100e80 0x7f7e0019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 -- 172.21.15.6:0/3735010471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e00100e80 msgr2=0x7f7e0019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e00100e80 0x7f7e0019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 -- 172.21.15.6:0/3735010471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e00101820 msgr2=0x7f7e0019dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e00101820 0x7f7e0019dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dfffff700 1 -- 172.21.15.6:0/3735010471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df8009d00 con 0x7f7e000ffc90 2023-09-13T09:39:05.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.005+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e00100e80 0x7f7e0019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.006+0000 7f7dfffff700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e000ffc90 0x7f7e00069cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c990 tx=0x7f7df000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.006+0000 7f7dfd7fa700 1 -- 172.21.15.6:0/3735010471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0007b00 con 0x7f7e000ffc90 2023-09-13T09:39:05.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.006+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e0019ec80 con 0x7f7e000ffc90 2023-09-13T09:39:05.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.006+0000 7f7dfd7fa700 1 -- 172.21.15.6:0/3735010471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df0007c60 con 0x7f7e000ffc90 2023-09-13T09:39:05.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.006+0000 7f7dfd7fa700 1 -- 172.21.15.6:0/3735010471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0018660 con 0x7f7e000ffc90 2023-09-13T09:39:05.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.006+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0019f190 con 0x7f7e000ffc90 2023-09-13T09:39:05.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.008+0000 7f7dfd7fa700 1 -- 172.21.15.6:0/3735010471 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f7df000f450 con 0x7f7e000ffc90 2023-09-13T09:39:05.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.008+0000 7f7dfd7fa700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7de80a06d0 0x7f7de80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.009+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7de80a06d0 0x7f7de80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.009+0000 7f7dfd7fa700 1 -- 172.21.15.6:0/3735010471 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7df00cbca0 con 0x7f7e000ffc90 2023-09-13T09:39:05.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.009+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7de80a06d0 0x7f7de80a2b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7df4005fd0 tx=0x7f7df4005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.009+0000 7f7e1246bb80 1 Processor -- start 2023-09-13T09:39:05.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.009+0000 7f7e1246bb80 1 -- start start 2023-09-13T09:39:05.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981949ac0 0x559981949ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981948880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981949220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998189d730 con 0x55998194a420 2023-09-13T09:39:05.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998189b050 con 0x559981949ac0 2023-09-13T09:39:05.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559981896940 con 0x559981948dc0 2023-09-13T09:39:05.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981948880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981948880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33056/0 (socket says 172.21.15.6:33056) 2023-09-13T09:39:05.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 -- 172.21.15.6:0/1837312797 learned_addr learned my addr 172.21.15.6:0/1837312797 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dfffff700 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981949ac0 0x559981949ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e04823700 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981949220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 -- 172.21.15.6:0/1837312797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 msgr2=0x559981949220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981949220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 -- 172.21.15.6:0/1837312797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981949ac0 msgr2=0x559981949ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981949ac0 0x559981949ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 -- 172.21.15.6:0/1837312797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599817165e0 con 0x55998194a420 2023-09-13T09:39:05.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7e04823700 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981949220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981948880 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7df400db50 tx=0x7f7df4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175f3fc57f2ad937 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7de67fc700 1 -- 172.21.15.6:0/1837312797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df400f8b0 con 0x55998194a420 2023-09-13T09:39:05.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7de67fc700 1 -- 172.21.15.6:0/1837312797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df401c450 con 0x55998194a420 2023-09-13T09:39:05.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.010+0000 7f7de67fc700 1 -- 172.21.15.6:0/1837312797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df401b610 con 0x55998194a420 2023-09-13T09:39:05.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 -- 172.21.15.6:0/1837312797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 msgr2=0x559981948880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981948880 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f7df400db50 tx=0x7f7df4010000 comp rx=0 tx=0).stop 2023-09-13T09:39:05.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 -- 172.21.15.6:0/1837312797 shutdown_connections 2023-09-13T09:39:05.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981949220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981949ac0 0x559981949ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/1837312797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981948880 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 -- 172.21.15.6:0/1837312797 >> 172.21.15.6:0/1837312797 conn(0x5599818a2c30 msgr2=0x55998193eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 -- 172.21.15.6:0/1837312797 shutdown_connections 2023-09-13T09:39:05.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 -- 172.21.15.6:0/1837312797 wait complete. 2023-09-13T09:39:05.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.011+0000 7f7e1246bb80 1 -- start start 2023-09-13T09:39:05.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 1 Processor -- start 2023-09-13T09:39:05.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981948dc0 0x5599819522e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x559981952820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x559981959860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559981834b60 con 0x559981948dc0 2023-09-13T09:39:05.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559981834860 con 0x55998194a420 2023-09-13T09:39:05.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599817188d0 con 0x559981949ac0 2023-09-13T09:39:05.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e1246bb80 10 client.0 _ll_register_callbacks cb 0x559981832630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981948dc0 0x5599819522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981948dc0 0x5599819522e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33060/0 (socket says 172.21.15.6:33060) 2023-09-13T09:39:05.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 -- 172.21.15.6:0/894664772 learned_addr learned my addr 172.21.15.6:0/894664772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x559981952820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7e04823700 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x559981959860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 -- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 msgr2=0x559981952820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x559981952820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 -- 172.21.15.6:0/894664772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 msgr2=0x559981959860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x559981959860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.012+0000 7f7dfffff700 1 -- 172.21.15.6:0/894664772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df400d800 con 0x559981948dc0 2023-09-13T09:39:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7dfffff700 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981948dc0 0x5599819522e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7df00958e0 tx=0x7f7df0098d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84dffbed06ab2bc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7ddf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/894664772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df0099840 con 0x559981948dc0 2023-09-13T09:39:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/894664772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7df00840b0 con 0x559981948dc0 2023-09-13T09:39:05.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559981937620 con 0x559981948dc0 2023-09-13T09:39:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/894664772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7df00993e0 con 0x559981948dc0 2023-09-13T09:39:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 10 client.15078 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5599818ae750 con 0x559981948dc0 2023-09-13T09:39:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/894664772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df00b7030 con 0x559981948dc0 2023-09-13T09:39:05.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/894664772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7df00988d0 con 0x559981948dc0 2023-09-13T09:39:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 10 client.15078 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 10 client.15078 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T09:39:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 20 client.15078 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55998195dd00 0x55998195c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 4 client.15078 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:05.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.013+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55998188f920 con 0x55998195dd00 2023-09-13T09:39:05.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.014+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55998195dd00 0x55998195c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.014+0000 7f7ddf7fe700 10 client.15078 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:05.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.014+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55998195dd00 0x55998195c810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=36c91065b983aafb server_cookie=22868fad566bb5b8 in_seq=0 out_seq=0 2023-09-13T09:39:05.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/894664772 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55998188f920 con 0x55998195dd00 2023-09-13T09:39:05.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7ddf7fe700 10 client.15078 handle_command_reply: tid=0 2023-09-13T09:39:05.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 client.15078 shutdown 2023-09-13T09:39:05.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981948dc0 msgr2=0x5599819522e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981948dc0 0x5599819522e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f7df00958e0 tx=0x7f7df0098d40 comp rx=0 tx=0).stop 2023-09-13T09:39:05.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 shutdown_connections 2023-09-13T09:39:05.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55998195dd00 0x55998195c810 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x559981959860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7ddf7fe700 0 client.15078 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:05.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981948dc0 0x5599819522e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/894664772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x559981952820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 >> 172.21.15.6:0/894664772 conn(0x5599818a2c30 msgr2=0x5599819397a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 shutdown_connections 2023-09-13T09:39:05.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 1 -- 172.21.15.6:0/894664772 wait complete. 2023-09-13T09:39:05.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.015+0000 7f7e1246bb80 20 client.15078 trim_cache size 0 max 16384 2023-09-13T09:39:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.032+0000 7f7e1246bb80 1 Processor -- start 2023-09-13T09:39:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e1246bb80 1 -- start start 2023-09-13T09:39:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981948dc0 0x55998194cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x55998194d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981959820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559981950e20 con 0x55998194a420 2023-09-13T09:39:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55998193fd00 con 0x559981948dc0 2023-09-13T09:39:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559981950a40 con 0x559981949ac0 2023-09-13T09:39:05.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981959820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981959820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33072/0 (socket says 172.21.15.6:33072) 2023-09-13T09:39:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 -- 172.21.15.6:0/3752840903 learned_addr learned my addr 172.21.15.6:0/3752840903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x55998194d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7dfffff700 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981948dc0 0x55998194cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 -- 172.21.15.6:0/3752840903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 msgr2=0x55998194d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x55998194d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 -- 172.21.15.6:0/3752840903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981948dc0 msgr2=0x55998194cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981948dc0 0x55998194cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 -- 172.21.15.6:0/3752840903 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599816c2d90 con 0x55998194a420 2023-09-13T09:39:05.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x55998194d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7dfffff700 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981948dc0 0x55998194cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7e04823700 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981959820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7df8015000 tx=0x7f7df8007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5638ddbc087407 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7de6ffd700 1 -- 172.21.15.6:0/3752840903 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df800e070 con 0x55998194a420 2023-09-13T09:39:05.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7de6ffd700 1 -- 172.21.15.6:0/3752840903 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df8004a50 con 0x55998194a420 2023-09-13T09:39:05.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.033+0000 7f7de6ffd700 1 -- 172.21.15.6:0/3752840903 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8025b20 con 0x55998194a420 2023-09-13T09:39:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 -- 172.21.15.6:0/3752840903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 msgr2=0x559981959820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981959820 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7df8015000 tx=0x7f7df8007520 comp rx=0 tx=0).stop 2023-09-13T09:39:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 -- 172.21.15.6:0/3752840903 shutdown_connections 2023-09-13T09:39:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55998194a420 0x559981959820 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559981948dc0 0x55998194cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/3752840903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981949ac0 0x55998194d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 -- 172.21.15.6:0/3752840903 >> 172.21.15.6:0/3752840903 conn(0x5599818a2c30 msgr2=0x55998193ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 -- 172.21.15.6:0/3752840903 shutdown_connections 2023-09-13T09:39:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 -- 172.21.15.6:0/3752840903 wait complete. 2023-09-13T09:39:05.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.034+0000 7f7e1246bb80 1 -- start start 2023-09-13T09:39:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 1 Processor -- start 2023-09-13T09:39:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981954820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981949ac0 0x559981954d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x5599819b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599819b1c30 con 0x559981949ac0 2023-09-13T09:39:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599819b1d70 con 0x55998194a420 2023-09-13T09:39:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599819b1eb0 con 0x559981948dc0 2023-09-13T09:39:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e1246bb80 10 client.0 _ll_register_callbacks cb 0x559981832630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981949ac0 0x559981954d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981949ac0 0x559981954d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33076/0 (socket says 172.21.15.6:33076) 2023-09-13T09:39:05.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 -- 172.21.15.6:0/2843127921 learned_addr learned my addr 172.21.15.6:0/2843127921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e04823700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x5599819b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 -- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 msgr2=0x559981954820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dfffff700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981954820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981954820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 -- 172.21.15.6:0/2843127921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 msgr2=0x5599819b16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x5599819b16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7dff7fe700 1 -- 172.21.15.6:0/2843127921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e00108a20 con 0x559981949ac0 2023-09-13T09:39:05.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.035+0000 7f7e04823700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x5599819b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:05.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7dff7fe700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981949ac0 0x559981954d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7df400db50 tx=0x7f7df400d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f775711820d5c8e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7ddf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/2843127921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df401c5c0 con 0x559981949ac0 2023-09-13T09:39:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/2843127921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7df401c720 con 0x559981949ac0 2023-09-13T09:39:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7df401c450 con 0x559981949ac0 2023-09-13T09:39:05.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/2843127921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7df401c8e0 con 0x559981949ac0 2023-09-13T09:39:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 10 client.15084 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5599816abc10 con 0x559981949ac0 2023-09-13T09:39:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/2843127921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7df401c450 con 0x559981949ac0 2023-09-13T09:39:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/2843127921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7df4036020 con 0x559981949ac0 2023-09-13T09:39:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 10 client.15084 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 10 client.15084 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T09:39:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 20 client.15084 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5599819b6ff0 0x5599819b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 4 client.15084 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.036+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559981850000 con 0x5599819b6ff0 2023-09-13T09:39:05.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7dfffff700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5599819b6ff0 0x5599819b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7ddf7fe700 10 client.15084 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7dfffff700 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5599819b6ff0 0x5599819b3410 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ad691199e463a395 server_cookie=3bd3db2eb467295 in_seq=0 out_seq=0 2023-09-13T09:39:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7ddf7fe700 1 -- 172.21.15.6:0/2843127921 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x559981850000 con 0x5599819b6ff0 2023-09-13T09:39:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7ddf7fe700 10 client.15084 handle_command_reply: tid=0 2023-09-13T09:39:05.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 client.15084 shutdown 2023-09-13T09:39:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981949ac0 msgr2=0x559981954d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981949ac0 0x559981954d60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f7df400db50 tx=0x7f7df400d6d0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 shutdown_connections 2023-09-13T09:39:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5599819b6ff0 0x5599819b3410 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55998194a420 0x5599819b16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7ddf7fe700 0 client.15084 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559981948dc0 0x559981954820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 --2- 172.21.15.6:0/2843127921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559981949ac0 0x559981954d60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 >> 172.21.15.6:0/2843127921 conn(0x5599818a2c30 msgr2=0x55998194cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 shutdown_connections 2023-09-13T09:39:05.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.037+0000 7f7e1246bb80 1 -- 172.21.15.6:0/2843127921 wait complete. 2023-09-13T09:39:05.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e1246bb80 20 client.15084 trim_cache size 0 max 16384 2023-09-13T09:39:05.061 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:05.061 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2023-09-13T09:39:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24466, 2023-09-13T09:39:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:05.062 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 50.268645999999997, 2023-09-13T09:39:05.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:05.063 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-09-13T09:39:05.063 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:05.063 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 72.517871154000005 2023-09-13T09:39:05.063 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7de80a06d0 msgr2=0x7f7de80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7de80a06d0 0x7f7de80a2b90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7df4005fd0 tx=0x7f7df4005dc0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e000ffc90 msgr2=0x7f7e00069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e000ffc90 0x7f7e00069cf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7df000c990 tx=0x7f7df000cd50 comp rx=0 tx=0).stop 2023-09-13T09:39:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 shutdown_connections 2023-09-13T09:39:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7e00101820 0x7f7e0019dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7de80a06d0 0x7f7de80a2b90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e000ffc90 0x7f7e00069cf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 --2- 172.21.15.6:0/3735010471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e00100e80 0x7f7e0019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 >> 172.21.15.6:0/3735010471 conn(0x7f7e000fb220 msgr2=0x7f7e000fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 shutdown_connections 2023-09-13T09:39:05.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.038+0000 7f7e06286700 1 -- 172.21.15.6:0/3735010471 wait complete. 2023-09-13T09:39:05.070 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-09-13T09:39:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 -- 172.21.15.6:0/3905680005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 msgr2=0x7f92941000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 --2- 172.21.15.6:0/3905680005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f92941000e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92840099c0 tx=0x7f9284009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 -- 172.21.15.6:0/3905680005 shutdown_connections 2023-09-13T09:39:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 --2- 172.21.15.6:0/3905680005 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9294101850 0x7f9294108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 --2- 172.21.15.6:0/3905680005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f92941000e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 --2- 172.21.15.6:0/3905680005 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9294100eb0 0x7f9294101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 -- 172.21.15.6:0/3905680005 >> 172.21.15.6:0/3905680005 conn(0x7f92940fb250 msgr2=0x7f92940fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 -- 172.21.15.6:0/3905680005 shutdown_connections 2023-09-13T09:39:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.196+0000 7f9298ad6700 1 -- 172.21.15.6:0/3905680005 wait complete. 2023-09-13T09:39:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 Processor -- start 2023-09-13T09:39:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 -- start start 2023-09-13T09:39:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f9294195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9294100eb0 0x7f9294195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9294101850 0x7f929419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929419d4e0 con 0x7f92940ffcc0 2023-09-13T09:39:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929419d620 con 0x7f9294101850 2023-09-13T09:39:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9298ad6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f929419d7b0 con 0x7f9294100eb0 2023-09-13T09:39:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f929259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f9294195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f929259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f9294195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33088/0 (socket says 172.21.15.6:33088) 2023-09-13T09:39:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f929259c700 1 -- 172.21.15.6:0/1076877421 learned_addr learned my addr 172.21.15.6:0/1076877421 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.197+0000 7f9291d9b700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9294100eb0 0x7f9294195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f929259c700 1 -- 172.21.15.6:0/1076877421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9294100eb0 msgr2=0x7f9294195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f929259c700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9294100eb0 0x7f9294195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f9292d9d700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9294101850 0x7f929419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f929259c700 1 -- 172.21.15.6:0/1076877421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9294101850 msgr2=0x7f929419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f929259c700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9294101850 0x7f929419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f929259c700 1 -- 172.21.15.6:0/1076877421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92840095f0 con 0x7f92940ffcc0 2023-09-13T09:39:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f9292d9d700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9294101850 0x7f929419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f929259c700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f9294195960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9284009990 tx=0x7f9284004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f928b7fe700 1 -- 172.21.15.6:0/1076877421 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928401d070 con 0x7f92940ffcc0 2023-09-13T09:39:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f928b7fe700 1 -- 172.21.15.6:0/1076877421 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9284004090 con 0x7f92940ffcc0 2023-09-13T09:39:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f929419da30 con 0x7f92940ffcc0 2023-09-13T09:39:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f928b7fe700 1 -- 172.21.15.6:0/1076877421 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284022d00 con 0x7f92940ffcc0 2023-09-13T09:39:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.198+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929419dee0 con 0x7f92940ffcc0 2023-09-13T09:39:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.200+0000 7f928b7fe700 1 -- 172.21.15.6:0/1076877421 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f9284022470 con 0x7f92940ffcc0 2023-09-13T09:39:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.201+0000 7f928b7fe700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92800a06d0 0x7f92800a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.201+0000 7f9291d9b700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92800a06d0 0x7f92800a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.201+0000 7f928b7fe700 1 -- 172.21.15.6:0/1076877421 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f92840ccdc0 con 0x7f92940ffcc0 2023-09-13T09:39:05.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.201+0000 7f9291d9b700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92800a06d0 0x7f92800a2b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f927c005950 tx=0x7f927c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 Processor -- start 2023-09-13T09:39:05.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 -- start start 2023-09-13T09:39:05.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00cece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cf220 0x5577c00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cdbc0 0x5577c00ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577c0024730 con 0x5577c00cf220 2023-09-13T09:39:05.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577c0022050 con 0x5577c00cdbc0 2023-09-13T09:39:05.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577c001d940 con 0x5577c00ce8c0 2023-09-13T09:39:05.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f9291d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cf220 0x5577c00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f9291d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cf220 0x5577c00cd680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33098/0 (socket says 172.21.15.6:33098) 2023-09-13T09:39:05.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f9291d9b700 1 -- 172.21.15.6:0/3618081113 learned_addr learned my addr 172.21.15.6:0/3618081113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f9292d9d700 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cdbc0 0x5577c00ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.202+0000 7f929259c700 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00cece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9291d9b700 1 -- 172.21.15.6:0/3618081113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 msgr2=0x5577c00cece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9291d9b700 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00cece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9291d9b700 1 -- 172.21.15.6:0/3618081113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cdbc0 msgr2=0x5577c00ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9291d9b700 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cdbc0 0x5577c00ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9291d9b700 1 -- 172.21.15.6:0/3618081113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577bfe9d5e0 con 0x5577c00cf220 2023-09-13T09:39:05.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9291d9b700 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cf220 0x5577c00cd680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f927c010fa0 tx=0x7f927c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=600fd0f9dc83bf66 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9288ff9700 1 -- 172.21.15.6:0/3618081113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c01e620 con 0x5577c00cf220 2023-09-13T09:39:05.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9288ff9700 1 -- 172.21.15.6:0/3618081113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f927c015070 con 0x5577c00cf220 2023-09-13T09:39:05.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.203+0000 7f9288ff9700 1 -- 172.21.15.6:0/3618081113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c01c9b0 con 0x5577c00cf220 2023-09-13T09:39:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3618081113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cf220 msgr2=0x5577c00cd680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cf220 0x5577c00cd680 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f927c010fa0 tx=0x7f927c013000 comp rx=0 tx=0).stop 2023-09-13T09:39:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3618081113 shutdown_connections 2023-09-13T09:39:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cdbc0 0x5577c00ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00cece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3618081113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cf220 0x5577c00cd680 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3618081113 >> 172.21.15.6:0/3618081113 conn(0x5577c0029c30 msgr2=0x5577c00c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3618081113 shutdown_connections 2023-09-13T09:39:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3618081113 wait complete. 2023-09-13T09:39:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- start start 2023-09-13T09:39:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 Processor -- start 2023-09-13T09:39:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cdbc0 0x5577c00d70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00ce8c0 0x5577c00d7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577bffbbb60 con 0x5577c00ce8c0 2023-09-13T09:39:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577bffbb860 con 0x5577c00cf220 2023-09-13T09:39:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.204+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577bfe9f8d0 con 0x5577c00cdbc0 2023-09-13T09:39:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f92a4cbbb80 10 client.0 _ll_register_callbacks cb 0x5577bffb9630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00ce8c0 0x5577c00d7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00ce8c0 0x5577c00d7630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33104/0 (socket says 172.21.15.6:33104) 2023-09-13T09:39:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 -- 172.21.15.6:0/3971370417 learned_addr learned my addr 172.21.15.6:0/3971370417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9292d9d700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f929259c700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cdbc0 0x5577c00d70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 -- 172.21.15.6:0/3971370417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cdbc0 msgr2=0x5577c00d70f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cdbc0 0x5577c00d70f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 -- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 msgr2=0x5577c00de670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 -- 172.21.15.6:0/3971370417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f927c010c50 con 0x5577c00ce8c0 2023-09-13T09:39:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9292d9d700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f929259c700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cdbc0 0x5577c00d70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9291d9b700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00ce8c0 0x5577c00d7630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f927c01c410 tx=0x7f927c005390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78acba39c53b46cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9279ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9279ffb700 1 -- 172.21.15.6:0/3971370417 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f927c02d070 con 0x5577c00ce8c0 2023-09-13T09:39:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9279ffb700 1 -- 172.21.15.6:0/3971370417 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f927c017070 con 0x5577c00ce8c0 2023-09-13T09:39:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5577c00be620 con 0x5577c00ce8c0 2023-09-13T09:39:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9279ffb700 1 -- 172.21.15.6:0/3971370417 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f927c004710 con 0x5577c00ce8c0 2023-09-13T09:39:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f92a4cbbb80 10 client.15096 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5577c0035750 con 0x5577c00ce8c0 2023-09-13T09:39:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.205+0000 7f9279ffb700 1 -- 172.21.15.6:0/3971370417 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5577c00be620 con 0x5577c00ce8c0 2023-09-13T09:39:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f9279ffb700 1 -- 172.21.15.6:0/3971370417 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f927c01cd50 con 0x5577c00ce8c0 2023-09-13T09:39:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f92a4cbbb80 10 client.15096 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f92a4cbbb80 10 client.15096 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-13T09:39:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f92a4cbbb80 20 client.15096 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c00e2bb0 0x5577c00e16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f92a4cbbb80 4 client.15096 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577c0016920 con 0x5577c00e2bb0 2023-09-13T09:39:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f929259c700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c00e2bb0 0x5577c00e16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f9279ffb700 10 client.15096 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.206+0000 7f929259c700 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c00e2bb0 0x5577c00e16c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df4a93e4b54064ba server_cookie=aba26b2eb9ce842f in_seq=0 out_seq=0 2023-09-13T09:39:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.207+0000 7f9279ffb700 1 -- 172.21.15.6:0/3971370417 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5577c0016920 con 0x5577c00e2bb0 2023-09-13T09:39:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.207+0000 7f9279ffb700 10 client.15096 handle_command_reply: tid=0 2023-09-13T09:39:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.207+0000 7f92a4cbbb80 1 client.15096 shutdown 2023-09-13T09:39:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00ce8c0 msgr2=0x5577c00d7630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00ce8c0 0x5577c00d7630 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f927c01c410 tx=0x7f927c005390 comp rx=0 tx=0).stop 2023-09-13T09:39:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 shutdown_connections 2023-09-13T09:39:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c00e2bb0 0x5577c00e16c0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cdbc0 0x5577c00d70f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f9279ffb700 0 client.15096 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/3971370417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00ce8c0 0x5577c00d7630 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 >> 172.21.15.6:0/3971370417 conn(0x5577c0029c30 msgr2=0x5577c00c07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 shutdown_connections 2023-09-13T09:39:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/3971370417 wait complete. 2023-09-13T09:39:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.208+0000 7f92a4cbbb80 20 client.15096 trim_cache size 0 max 16384 2023-09-13T09:39:05.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.225+0000 7f92a4cbbb80 1 Processor -- start 2023-09-13T09:39:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.225+0000 7f92a4cbbb80 1 -- start start 2023-09-13T09:39:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.225+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d4f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.225+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00d54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577c00be620 con 0x5577c00cdbc0 2023-09-13T09:39:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577bffdddf0 con 0x5577c00cf220 2023-09-13T09:39:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577bfeabde0 con 0x5577c00ce8c0 2023-09-13T09:39:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33110/0 (socket says 172.21.15.6:33110) 2023-09-13T09:39:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 -- 172.21.15.6:0/1964161457 learned_addr learned my addr 172.21.15.6:0/1964161457 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f9291d9b700 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00d54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f9292d9d700 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 -- 172.21.15.6:0/1964161457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 msgr2=0x5577c00d54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00d54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 -- 172.21.15.6:0/1964161457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 msgr2=0x5577c00de630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 -- 172.21.15.6:0/1964161457 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577bfe49d90 con 0x5577c00cdbc0 2023-09-13T09:39:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f9291d9b700 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00d54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f929259c700 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d4f70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9284097100 tx=0x7f9284005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef19a4623c8b71b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f92897fa700 1 -- 172.21.15.6:0/1964161457 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f928409e4c0 con 0x5577c00cdbc0 2023-09-13T09:39:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f92897fa700 1 -- 172.21.15.6:0/1964161457 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f92840a2670 con 0x5577c00cdbc0 2023-09-13T09:39:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.226+0000 7f92897fa700 1 -- 172.21.15.6:0/1964161457 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92840a21e0 con 0x5577c00cdbc0 2023-09-13T09:39:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/1964161457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 msgr2=0x5577c00d4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d4f70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9284097100 tx=0x7f9284005fb0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/1964161457 shutdown_connections 2023-09-13T09:39:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00cf220 0x5577c00de630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d4f70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/1964161457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00ce8c0 0x5577c00d54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/1964161457 >> 172.21.15.6:0/1964161457 conn(0x5577c0029c30 msgr2=0x5577c00c5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/1964161457 shutdown_connections 2023-09-13T09:39:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/1964161457 wait complete. 2023-09-13T09:39:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 -- start start 2023-09-13T09:39:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 Processor -- start 2023-09-13T09:39:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.227+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00ce8c0 0x5577c00d9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f92a4cbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cf220 0x5577c00de0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577c00de610 con 0x5577c00cdbc0 2023-09-13T09:39:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577c00de780 con 0x5577c00ce8c0 2023-09-13T09:39:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f92a4cbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577c00de940 con 0x5577c00cf220 2023-09-13T09:39:05.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f92a4cbbb80 10 client.0 _ll_register_callbacks cb 0x5577bffb9630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33116/0 (socket says 172.21.15.6:33116) 2023-09-13T09:39:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 -- 172.21.15.6:0/103809921 learned_addr learned my addr 172.21.15.6:0/103809921 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f9291d9b700 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00ce8c0 0x5577c00d9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f9292d9d700 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cf220 0x5577c00de0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 -- 172.21.15.6:0/103809921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cf220 msgr2=0x5577c00de0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cf220 0x5577c00de0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 -- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00ce8c0 msgr2=0x5577c00d9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00ce8c0 0x5577c00d9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 -- 172.21.15.6:0/103809921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f929419dee0 con 0x5577c00cdbc0 2023-09-13T09:39:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f929259c700 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d8cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f928409e430 tx=0x7f9284000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a1f532d94a0bd49 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f9279ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f9279ffb700 1 -- 172.21.15.6:0/103809921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9284099df0 con 0x5577c00cdbc0 2023-09-13T09:39:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f9279ffb700 1 -- 172.21.15.6:0/103809921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f928409e4c0 con 0x5577c00cdbc0 2023-09-13T09:39:05.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f927c015070 con 0x5577c00cdbc0 2023-09-13T09:39:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f9279ffb700 1 -- 172.21.15.6:0/103809921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92840a21e0 con 0x5577c00cdbc0 2023-09-13T09:39:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.228+0000 7f92a4cbbb80 10 client.15102 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x5577bfe32c10 con 0x5577c00cdbc0 2023-09-13T09:39:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f9279ffb700 1 -- 172.21.15.6:0/103809921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f927c015070 con 0x5577c00cdbc0 2023-09-13T09:39:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f9279ffb700 1 -- 172.21.15.6:0/103809921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f92840cac00 con 0x5577c00cdbc0 2023-09-13T09:39:05.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f92a4cbbb80 10 client.15102 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f92a4cbbb80 10 client.15102 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-13T09:39:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f92a4cbbb80 20 client.15102 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c013b160 0x5577c01375e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f92a4cbbb80 4 client.15102 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:05.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5577bffd7000 con 0x5577c013b160 2023-09-13T09:39:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.229+0000 7f9291d9b700 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c013b160 0x5577c01375e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f9279ffb700 10 client.15102 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f9291d9b700 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c013b160 0x5577c01375e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bc90882c7778af6 server_cookie=4d36fc5375050070 in_seq=0 out_seq=0 2023-09-13T09:39:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f9279ffb700 1 -- 172.21.15.6:0/103809921 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5577bffd7000 con 0x5577c013b160 2023-09-13T09:39:05.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f9279ffb700 10 client.15102 handle_command_reply: tid=0 2023-09-13T09:39:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 client.15102 shutdown 2023-09-13T09:39:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 msgr2=0x5577c00d8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d8cc0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f928409e430 tx=0x7f9284000bc0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 shutdown_connections 2023-09-13T09:39:05.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5577c013b160 0x5577c01375e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5577c00cf220 0x5577c00de0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5577c00cdbc0 0x5577c00d8cc0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f9279ffb700 0 client.15102 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 --2- 172.21.15.6:0/103809921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5577c00ce8c0 0x5577c00d9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 >> 172.21.15.6:0/103809921 conn(0x5577c0029c30 msgr2=0x5577c00d1aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 shutdown_connections 2023-09-13T09:39:05.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 1 -- 172.21.15.6:0/103809921 wait complete. 2023-09-13T09:39:05.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.230+0000 7f92a4cbbb80 20 client.15102 trim_cache size 0 max 16384 2023-09-13T09:39:05.252 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:05.253 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:05.253 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2023-09-13T09:39:05.253 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24482, 2023-09-13T09:39:05.253 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:05.253 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:05.254 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:05.254 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 51.475766442000001, 2023-09-13T09:39:05.254 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:05.254 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-09-13T09:39:05.254 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:05.255 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 70.421959588000007 2023-09-13T09:39:05.255 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92800a06d0 msgr2=0x7f92800a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92800a06d0 0x7f92800a2b90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f927c005950 tx=0x7f927c00b410 comp rx=0 tx=0).stop 2023-09-13T09:39:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 msgr2=0x7f9294195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f9294195960 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f9284009990 tx=0x7f9284004730 comp rx=0 tx=0).stop 2023-09-13T09:39:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 shutdown_connections 2023-09-13T09:39:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9294101850 0x7f929419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92800a06d0 0x7f92800a2b90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92940ffcc0 0x7f9294195960 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 --2- 172.21.15.6:0/1076877421 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9294100eb0 0x7f9294195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 >> 172.21.15.6:0/1076877421 conn(0x7f92940fb250 msgr2=0x7f92940fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 shutdown_connections 2023-09-13T09:39:05.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.231+0000 7f9298ad6700 1 -- 172.21.15.6:0/1076877421 wait complete. 2023-09-13T09:39:05.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-09-13T09:39:05.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:04 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/493953873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:04 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3210585209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:04 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/106423935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:04 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/493953873' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:04 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3210585209' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:04 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/106423935' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/1496868048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d74100eb0 msgr2=0x7f2d74101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/1496868048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d74100eb0 0x7f2d74101310 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f2d680099c0 tx=0x7f2d68009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/1496868048 shutdown_connections 2023-09-13T09:39:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/1496868048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d74101850 0x7f2d74108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/1496868048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d740ffcc0 0x7f2d741000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/1496868048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d74100eb0 0x7f2d74101310 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/1496868048 >> 172.21.15.6:0/1496868048 conn(0x7f2d740fb250 msgr2=0x7f2d740fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/1496868048 shutdown_connections 2023-09-13T09:39:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.386+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/1496868048 wait complete. 2023-09-13T09:39:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 Processor -- start 2023-09-13T09:39:05.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 -- start start 2023-09-13T09:39:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d740ffcc0 0x7f2d74196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d74100eb0 0x7f2d74197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d74101850 0x7f2d7419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7419e640 con 0x7f2d740ffcc0 2023-09-13T09:39:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7419e780 con 0x7f2d74101850 2023-09-13T09:39:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d7a9b7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d7419e910 con 0x7f2d74100eb0 2023-09-13T09:39:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d740ffcc0 0x7f2d74196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d740ffcc0 0x7f2d74196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33130/0 (socket says 172.21.15.6:33130) 2023-09-13T09:39:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 -- 172.21.15.6:0/2440480399 learned_addr learned my addr 172.21.15.6:0/2440480399 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d78f54700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d74101850 0x7f2d7419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d737fe700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d74100eb0 0x7f2d74197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 -- 172.21.15.6:0/2440480399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d74100eb0 msgr2=0x7f2d74197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d74100eb0 0x7f2d74197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 -- 172.21.15.6:0/2440480399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d74101850 msgr2=0x7f2d7419e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d74101850 0x7f2d7419e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d73fff700 1 -- 172.21.15.6:0/2440480399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680095f0 con 0x7f2d740ffcc0 2023-09-13T09:39:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.387+0000 7f2d78f54700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d74101850 0x7f2d7419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.388+0000 7f2d73fff700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d740ffcc0 0x7f2d74196ac0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400e970 tx=0x7f2d6400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.388+0000 7f2d717fa700 1 -- 172.21.15.6:0/2440480399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64009790 con 0x7f2d740ffcc0 2023-09-13T09:39:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.388+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d7419ebf0 con 0x7f2d740ffcc0 2023-09-13T09:39:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.388+0000 7f2d717fa700 1 -- 172.21.15.6:0/2440480399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d640044e0 con 0x7f2d740ffcc0 2023-09-13T09:39:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.388+0000 7f2d717fa700 1 -- 172.21.15.6:0/2440480399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64003e30 con 0x7f2d740ffcc0 2023-09-13T09:39:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.388+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7419f100 con 0x7f2d740ffcc0 2023-09-13T09:39:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.390+0000 7f2d717fa700 1 -- 172.21.15.6:0/2440480399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f2d64003f90 con 0x7f2d740ffcc0 2023-09-13T09:39:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.391+0000 7f2d717fa700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d5c0a06d0 0x7f2d5c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.391+0000 7f2d737fe700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d5c0a06d0 0x7f2d5c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.391+0000 7f2d717fa700 1 -- 172.21.15.6:0/2440480399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2d64014070 con 0x7f2d740ffcc0 2023-09-13T09:39:05.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.391+0000 7f2d737fe700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d5c0a06d0 0x7f2d5c0a2b90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d680058e0 tx=0x7f2d68019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.391+0000 7f2d86b9cb80 1 Processor -- start 2023-09-13T09:39:05.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.391+0000 7f2d86b9cb80 1 -- start start 2023-09-13T09:39:05.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a198ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a197470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a0f0730 con 0x55d74a1979b0 2023-09-13T09:39:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a0ee050 con 0x55d74a199010 2023-09-13T09:39:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a0e9940 con 0x55d74a1986b0 2023-09-13T09:39:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33142/0 (socket says 172.21.15.6:33142) 2023-09-13T09:39:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 -- 172.21.15.6:0/2102647550 learned_addr learned my addr 172.21.15.6:0/2102647550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d73fff700 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a198ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 -- 172.21.15.6:0/2102647550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 msgr2=0x55d74a198ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a198ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 -- 172.21.15.6:0/2102647550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 msgr2=0x55d74a197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d737fe700 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 -- 172.21.15.6:0/2102647550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d749f695e0 con 0x55d74a1979b0 2023-09-13T09:39:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d78f54700 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197e30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009d50 tx=0x7f2d6c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb8243313c0d42df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d5a7fc700 1 -- 172.21.15.6:0/2102647550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c014600 con 0x55d74a1979b0 2023-09-13T09:39:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d5a7fc700 1 -- 172.21.15.6:0/2102647550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d6c014c20 con 0x55d74a1979b0 2023-09-13T09:39:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.392+0000 7f2d5a7fc700 1 -- 172.21.15.6:0/2102647550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c013b70 con 0x55d74a1979b0 2023-09-13T09:39:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/2102647550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 msgr2=0x55d74a197e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197e30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009d50 tx=0x7f2d6c0077e0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/2102647550 shutdown_connections 2023-09-13T09:39:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197e30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a198ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/2102647550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/2102647550 >> 172.21.15.6:0/2102647550 conn(0x55d74a0f5c30 msgr2=0x55d74a191ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/2102647550 shutdown_connections 2023-09-13T09:39:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/2102647550 wait complete. 2023-09-13T09:39:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.393+0000 7f2d86b9cb80 1 -- start start 2023-09-13T09:39:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 1 Processor -- start 2023-09-13T09:39:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a1a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a199010 0x55d74a1a8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a087b60 con 0x55d74a199010 2023-09-13T09:39:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a087860 con 0x55d74a1979b0 2023-09-13T09:39:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d749f6b8d0 con 0x55d74a1986b0 2023-09-13T09:39:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d86b9cb80 10 client.0 _ll_register_callbacks cb 0x55d74a085630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a199010 0x55d74a1a8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a199010 0x55d74a1a8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33148/0 (socket says 172.21.15.6:33148) 2023-09-13T09:39:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 -- 172.21.15.6:0/1984906294 learned_addr learned my addr 172.21.15.6:0/1984906294 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d737fe700 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a1a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d73fff700 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 -- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 msgr2=0x55d74a1a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a1a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 -- 172.21.15.6:0/1984906294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 msgr2=0x55d74a1a0eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a0eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.394+0000 7f2d78f54700 1 -- 172.21.15.6:0/1984906294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c009980 con 0x55d74a199010 2023-09-13T09:39:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d78f54700 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a199010 0x55d74a1a8430 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c013550 tx=0x7f2d6c013580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d906ec13477064 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d537fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d537fe700 1 -- 172.21.15.6:0/1984906294 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c013c80 con 0x55d74a199010 2023-09-13T09:39:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d537fe700 1 -- 172.21.15.6:0/1984906294 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2d6c013de0 con 0x55d74a199010 2023-09-13T09:39:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d74a18a620 con 0x55d74a199010 2023-09-13T09:39:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d537fe700 1 -- 172.21.15.6:0/1984906294 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d6c004e80 con 0x55d74a199010 2023-09-13T09:39:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 10 client.15114 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d74a101750 con 0x55d74a199010 2023-09-13T09:39:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d537fe700 1 -- 172.21.15.6:0/1984906294 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d74a18a620 con 0x55d74a199010 2023-09-13T09:39:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d537fe700 1 -- 172.21.15.6:0/1984906294 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d6c005590 con 0x55d74a199010 2023-09-13T09:39:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 10 client.15114 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 10 client.15114 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-13T09:39:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 20 client.15114 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a1ac9a0 0x55d74a1ab480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 4 client.15114 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.395+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d74a0e2920 con 0x55d74a1ac9a0 2023-09-13T09:39:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.396+0000 7f2d73fff700 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a1ac9a0 0x55d74a1ab480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.396+0000 7f2d537fe700 10 client.15114 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.396+0000 7f2d73fff700 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a1ac9a0 0x55d74a1ab480 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f532a4ec4b0c7f83 server_cookie=7d4a2b112b7e3d9 in_seq=0 out_seq=0 2023-09-13T09:39:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d537fe700 1 -- 172.21.15.6:0/1984906294 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d74a0e2920 con 0x55d74a1ac9a0 2023-09-13T09:39:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d537fe700 10 client.15114 handle_command_reply: tid=0 2023-09-13T09:39:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 client.15114 shutdown 2023-09-13T09:39:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a199010 msgr2=0x55d74a1a8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a199010 0x55d74a1a8430 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c013550 tx=0x7f2d6c013580 comp rx=0 tx=0).stop 2023-09-13T09:39:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 shutdown_connections 2023-09-13T09:39:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a1ac9a0 0x55d74a1ab480 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a199010 0x55d74a1a8430 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d537fe700 0 client.15114 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a0eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1984906294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a1a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 >> 172.21.15.6:0/1984906294 conn(0x55d74a0f5c30 msgr2=0x55d74a191e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 shutdown_connections 2023-09-13T09:39:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1984906294 wait complete. 2023-09-13T09:39:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.397+0000 7f2d86b9cb80 20 client.15114 trim_cache size 0 max 16384 2023-09-13T09:39:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 Processor -- start 2023-09-13T09:39:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 -- start start 2023-09-13T09:39:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a1a83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a19b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a18a620 con 0x55d74a1979b0 2023-09-13T09:39:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a1a20a0 con 0x55d74a199010 2023-09-13T09:39:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a0a9df0 con 0x55d74a1986b0 2023-09-13T09:39:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33152/0 (socket says 172.21.15.6:33152) 2023-09-13T09:39:05.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 -- 172.21.15.6:0/3206538419 learned_addr learned my addr 172.21.15.6:0/3206538419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 -- 172.21.15.6:0/3206538419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 msgr2=0x55d74a1a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a1a83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 -- 172.21.15.6:0/3206538419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 msgr2=0x55d74a19b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d78f54700 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a19b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a19b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d73fff700 1 -- 172.21.15.6:0/3206538419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d74a198060 con 0x55d74a1979b0 2023-09-13T09:39:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.415+0000 7f2d78f54700 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d73fff700 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2d64099630 tx=0x7f2d64084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b63269ae76c409d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d5affd700 1 -- 172.21.15.6:0/3206538419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64099e70 con 0x55d74a1979b0 2023-09-13T09:39:05.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d5affd700 1 -- 172.21.15.6:0/3206538419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d640996f0 con 0x55d74a1979b0 2023-09-13T09:39:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d5affd700 1 -- 172.21.15.6:0/3206538419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d64097a90 con 0x55d74a1979b0 2023-09-13T09:39:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/3206538419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 msgr2=0x55d74a197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197470 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2d64099630 tx=0x7f2d64084040 comp rx=0 tx=0).stop 2023-09-13T09:39:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/3206538419 shutdown_connections 2023-09-13T09:39:05.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a199010 0x55d74a19b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1979b0 0x55d74a197470 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/3206538419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a1986b0 0x55d74a1a83f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/3206538419 >> 172.21.15.6:0/3206538419 conn(0x55d74a0f5c30 msgr2=0x55d74a19fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/3206538419 shutdown_connections 2023-09-13T09:39:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.416+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/3206538419 wait complete. 2023-09-13T09:39:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 -- start start 2023-09-13T09:39:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 Processor -- start 2023-09-13T09:39:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1986b0 0x55d74a1a2f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a199010 0x55d74a1a7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a1a8300 con 0x55d74a1986b0 2023-09-13T09:39:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a1a8470 con 0x55d74a1979b0 2023-09-13T09:39:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d74a1a8630 con 0x55d74a199010 2023-09-13T09:39:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d86b9cb80 10 client.0 _ll_register_callbacks cb 0x55d74a085630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1986b0 0x55d74a1a2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1986b0 0x55d74a1a2f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33160/0 (socket says 172.21.15.6:33160) 2023-09-13T09:39:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d73fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.417+0000 7f2d737fe700 1 -- 172.21.15.6:0/1424198779 learned_addr learned my addr 172.21.15.6:0/1424198779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d78f54700 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a199010 0x55d74a1a7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d737fe700 1 -- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a199010 msgr2=0x55d74a1a7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d737fe700 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a199010 0x55d74a1a7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d737fe700 1 -- 172.21.15.6:0/1424198779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 msgr2=0x55d74a1a29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d737fe700 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d737fe700 1 -- 172.21.15.6:0/1424198779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d7419f100 con 0x55d74a1986b0 2023-09-13T09:39:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d78f54700 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a199010 0x55d74a1a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d737fe700 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1986b0 0x55d74a1a2f00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2d680099c0 tx=0x7f2d68000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1275b5d612136672 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d537fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d537fe700 1 -- 172.21.15.6:0/1424198779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68027070 con 0x55d74a1986b0 2023-09-13T09:39:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d537fe700 1 -- 172.21.15.6:0/1424198779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2d6802e850 con 0x55d74a1986b0 2023-09-13T09:39:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d6c014c20 con 0x55d74a1986b0 2023-09-13T09:39:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d537fe700 1 -- 172.21.15.6:0/1424198779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d6801c040 con 0x55d74a1986b0 2023-09-13T09:39:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d86b9cb80 10 client.15120 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d749f15d90 con 0x55d74a1986b0 2023-09-13T09:39:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.418+0000 7f2d537fe700 1 -- 172.21.15.6:0/1424198779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d6c014c20 con 0x55d74a1986b0 2023-09-13T09:39:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d537fe700 1 -- 172.21.15.6:0/1424198779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2d68022a30 con 0x55d74a1986b0 2023-09-13T09:39:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d86b9cb80 10 client.15120 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d86b9cb80 10 client.15120 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-13T09:39:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d86b9cb80 20 client.15120 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a205320 0x55d74a2017a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d86b9cb80 4 client.15120 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d74a0a3000 con 0x55d74a205320 2023-09-13T09:39:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d73fff700 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a205320 0x55d74a2017a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d537fe700 10 client.15120 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.419+0000 7f2d73fff700 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a205320 0x55d74a2017a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=110d960961b48e64 server_cookie=a35a6108f7ca5c5a in_seq=0 out_seq=0 2023-09-13T09:39:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d537fe700 1 -- 172.21.15.6:0/1424198779 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55d74a0a3000 con 0x55d74a205320 2023-09-13T09:39:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d537fe700 10 client.15120 handle_command_reply: tid=0 2023-09-13T09:39:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 client.15120 shutdown 2023-09-13T09:39:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1986b0 msgr2=0x55d74a1a2f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1986b0 0x55d74a1a2f00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f2d680099c0 tx=0x7f2d68000bc0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 shutdown_connections 2023-09-13T09:39:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55d74a205320 0x55d74a2017a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d74a199010 0x55d74a1a7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d74a1979b0 0x55d74a1a29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 --2- 172.21.15.6:0/1424198779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d74a1986b0 0x55d74a1a2f00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d537fe700 0 client.15120 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 >> 172.21.15.6:0/1424198779 conn(0x55d74a0f5c30 msgr2=0x55d74a19b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 shutdown_connections 2023-09-13T09:39:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 1 -- 172.21.15.6:0/1424198779 wait complete. 2023-09-13T09:39:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.420+0000 7f2d86b9cb80 20 client.15120 trim_cache size 0 max 16384 2023-09-13T09:39:05.443 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:05.443 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:05.444 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2023-09-13T09:39:05.444 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24484, 2023-09-13T09:39:05.444 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:05.444 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:05.444 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:05.445 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 52.673671583000001, 2023-09-13T09:39:05.445 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:05.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-09-13T09:39:05.445 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:05.445 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 68.301979068999998 2023-09-13T09:39:05.445 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d5c0a06d0 msgr2=0x7f2d5c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d5c0a06d0 0x7f2d5c0a2b90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2d680058e0 tx=0x7f2d68019040 comp rx=0 tx=0).stop 2023-09-13T09:39:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d740ffcc0 msgr2=0x7f2d74196ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d740ffcc0 0x7f2d74196ac0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f2d6400e970 tx=0x7f2d6400ed30 comp rx=0 tx=0).stop 2023-09-13T09:39:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 shutdown_connections 2023-09-13T09:39:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d74101850 0x7f2d7419e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d5c0a06d0 0x7f2d5c0a2b90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d740ffcc0 0x7f2d74196ac0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 --2- 172.21.15.6:0/2440480399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d74100eb0 0x7f2d74197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 >> 172.21.15.6:0/2440480399 conn(0x7f2d740fb250 msgr2=0x7f2d740fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 shutdown_connections 2023-09-13T09:39:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.421+0000 7f2d7a9b7700 1 -- 172.21.15.6:0/2440480399 wait complete. 2023-09-13T09:39:05.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-13T09:39:05.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 -- 172.21.15.6:0/4111254171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a0100eb0 msgr2=0x7f82a0101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/4111254171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a0100eb0 0x7f82a0101310 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f82940099c0 tx=0x7f8294009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 -- 172.21.15.6:0/4111254171 shutdown_connections 2023-09-13T09:39:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/4111254171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82a0101850 0x7f82a0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/4111254171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82a00ffcc0 0x7f82a01000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/4111254171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a0100eb0 0x7f82a0101310 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 -- 172.21.15.6:0/4111254171 >> 172.21.15.6:0/4111254171 conn(0x7f82a00fb250 msgr2=0x7f82a00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 -- 172.21.15.6:0/4111254171 shutdown_connections 2023-09-13T09:39:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.575+0000 7f82a7ee3700 1 -- 172.21.15.6:0/4111254171 wait complete. 2023-09-13T09:39:05.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 Processor -- start 2023-09-13T09:39:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 -- start start 2023-09-13T09:39:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a00ffcc0 0x7f82a0196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82a0100eb0 0x7f82a0197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82a0101850 0x7f82a019e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a019e640 con 0x7f82a00ffcc0 2023-09-13T09:39:05.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a019e780 con 0x7f82a0100eb0 2023-09-13T09:39:05.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a7ee3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82a019e910 con 0x7f82a0101850 2023-09-13T09:39:05.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a5c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a00ffcc0 0x7f82a0196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a5c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a00ffcc0 0x7f82a0196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33172/0 (socket says 172.21.15.6:33172) 2023-09-13T09:39:05.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a5c7f700 1 -- 172.21.15.6:0/890011889 learned_addr learned my addr 172.21.15.6:0/890011889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.576+0000 7f82a547e700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82a0100eb0 0x7f82a0197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a5c7f700 1 -- 172.21.15.6:0/890011889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82a0101850 msgr2=0x7f82a019e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82a0101850 0x7f82a019e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a5c7f700 1 -- 172.21.15.6:0/890011889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82a0100eb0 msgr2=0x7f82a0197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82a0100eb0 0x7f82a0197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a5c7f700 1 -- 172.21.15.6:0/890011889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82940095f0 con 0x7f82a00ffcc0 2023-09-13T09:39:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a00ffcc0 0x7f82a0196ac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f829c00d980 tx=0x7f829c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f8292ffd700 1 -- 172.21.15.6:0/890011889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c004020 con 0x7f82a00ffcc0 2023-09-13T09:39:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82a019ebf0 con 0x7f82a00ffcc0 2023-09-13T09:39:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f8292ffd700 1 -- 172.21.15.6:0/890011889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c009730 con 0x7f82a00ffcc0 2023-09-13T09:39:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f8292ffd700 1 -- 172.21.15.6:0/890011889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c003a30 con 0x7f82a00ffcc0 2023-09-13T09:39:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.577+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a019f150 con 0x7f82a00ffcc0 2023-09-13T09:39:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.579+0000 7f8292ffd700 1 -- 172.21.15.6:0/890011889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f829c0098a0 con 0x7f82a00ffcc0 2023-09-13T09:39:05.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.580+0000 7f8292ffd700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f828c0a06d0 0x7f828c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.580+0000 7f82a547e700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f828c0a06d0 0x7f828c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.580+0000 7f8292ffd700 1 -- 172.21.15.6:0/890011889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f829c0cb840 con 0x7f82a00ffcc0 2023-09-13T09:39:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82a547e700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f828c0a06d0 0x7f828c0a2b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8294000c00 tx=0x7f8294009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 Processor -- start 2023-09-13T09:39:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 -- start start 2023-09-13T09:39:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 0x55d0f289fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f289e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f289ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f27f7730 con 0x55d0f289e9b0 2023-09-13T09:39:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f27f5050 con 0x55d0f289f6b0 2023-09-13T09:39:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.581+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f27f0940 con 0x55d0f28a0010 2023-09-13T09:39:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f289ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f289ee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33184/0 (socket says 172.21.15.6:33184) 2023-09-13T09:39:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a5c7f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 0x55d0f289fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 -- 172.21.15.6:0/4241223144 learned_addr learned my addr 172.21.15.6:0/4241223144 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a547e700 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f289e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 -- 172.21.15.6:0/4241223144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 msgr2=0x55d0f289e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f289e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 -- 172.21.15.6:0/4241223144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 msgr2=0x55d0f289fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 0x55d0f289fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 -- 172.21.15.6:0/4241223144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0f26705e0 con 0x55d0f289e9b0 2023-09-13T09:39:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f82a6480700 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f289ee30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f829800a410 tx=0x7f829800a720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df8700d53276f3fd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f828bfff700 1 -- 172.21.15.6:0/4241223144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829800f070 con 0x55d0f289e9b0 2023-09-13T09:39:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f828bfff700 1 -- 172.21.15.6:0/4241223144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8298007b30 con 0x55d0f289e9b0 2023-09-13T09:39:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.582+0000 7f828bfff700 1 -- 172.21.15.6:0/4241223144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8298008630 con 0x55d0f289e9b0 2023-09-13T09:39:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4241223144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 msgr2=0x55d0f289ee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f289ee30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f829800a410 tx=0x7f829800a720 comp rx=0 tx=0).stop 2023-09-13T09:39:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4241223144 shutdown_connections 2023-09-13T09:39:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f289ee30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 0x55d0f289fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4241223144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f289e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4241223144 >> 172.21.15.6:0/4241223144 conn(0x55d0f27fcc30 msgr2=0x55d0f2898ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4241223144 shutdown_connections 2023-09-13T09:39:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4241223144 wait complete. 2023-09-13T09:39:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 -- start start 2023-09-13T09:39:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.583+0000 7f82b40c8b80 1 Processor -- start 2023-09-13T09:39:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f28a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f289f6b0 0x55d0f28a8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f28a0010 0x55d0f28af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f278eb60 con 0x55d0f28a0010 2023-09-13T09:39:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f278e860 con 0x55d0f289e9b0 2023-09-13T09:39:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f26728d0 con 0x55d0f289f6b0 2023-09-13T09:39:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82b40c8b80 10 client.0 _ll_register_callbacks cb 0x55d0f278c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f28a0010 0x55d0f28af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f28a0010 0x55d0f28af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33190/0 (socket says 172.21.15.6:33190) 2023-09-13T09:39:05.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 -- 172.21.15.6:0/4201199233 learned_addr learned my addr 172.21.15.6:0/4201199233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f28a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a547e700 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f289f6b0 0x55d0f28a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 -- 172.21.15.6:0/4201199233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f289f6b0 msgr2=0x55d0f28a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f289f6b0 0x55d0f28a8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 -- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 msgr2=0x55d0f28a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f28a7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.584+0000 7f82a6480700 1 -- 172.21.15.6:0/4201199233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8298007cb0 con 0x55d0f28a0010 2023-09-13T09:39:05.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82a6480700 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f28a0010 0x55d0f28af4c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82980060b0 tx=0x7f82980136f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4433c400347f730 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82897fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82897fa700 1 -- 172.21.15.6:0/4201199233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829800f050 con 0x55d0f28a0010 2023-09-13T09:39:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82897fa700 1 -- 172.21.15.6:0/4201199233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f829801c830 con 0x55d0f28a0010 2023-09-13T09:39:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0f27e9920 con 0x55d0f28a0010 2023-09-13T09:39:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82897fa700 1 -- 172.21.15.6:0/4201199233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8298007b30 con 0x55d0f28a0010 2023-09-13T09:39:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 10 client.15132 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d0f2808750 con 0x55d0f28a0010 2023-09-13T09:39:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82897fa700 1 -- 172.21.15.6:0/4201199233 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829802f080 con 0x55d0f28a0010 2023-09-13T09:39:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82897fa700 1 -- 172.21.15.6:0/4201199233 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f829801ea20 con 0x55d0f28a0010 2023-09-13T09:39:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 10 client.15132 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 10 client.15132 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T09:39:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 20 client.15132 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f28b3a40 0x55d0f28b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 4 client.15132 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:05.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.585+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d0f27aa000 con 0x55d0f28b3a40 2023-09-13T09:39:05.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.586+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f28b3a40 0x55d0f28b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.586+0000 7f82897fa700 10 client.15132 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:05.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.586+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f28b3a40 0x55d0f28b2500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=421f658e2e0c4f78 server_cookie=d3ef0826144736dd in_seq=0 out_seq=0 2023-09-13T09:39:05.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82897fa700 1 -- 172.21.15.6:0/4201199233 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d0f27aa000 con 0x55d0f28b3a40 2023-09-13T09:39:05.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82897fa700 10 client.15132 handle_command_reply: tid=0 2023-09-13T09:39:05.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 client.15132 shutdown 2023-09-13T09:39:05.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f28a0010 msgr2=0x55d0f28af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f28a0010 0x55d0f28af4c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f82980060b0 tx=0x7f82980136f0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 shutdown_connections 2023-09-13T09:39:05.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f28b3a40 0x55d0f28b2500 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f28a0010 0x55d0f28af4c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f28a7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4201199233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f289f6b0 0x55d0f28a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82897fa700 0 client.15132 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:05.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 >> 172.21.15.6:0/4201199233 conn(0x55d0f27fcc30 msgr2=0x55d0f2898e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 shutdown_connections 2023-09-13T09:39:05.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4201199233 wait complete. 2023-09-13T09:39:05.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.587+0000 7f82b40c8b80 20 client.15132 trim_cache size 0 max 16384 2023-09-13T09:39:05.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 Processor -- start 2023-09-13T09:39:05.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 -- start start 2023-09-13T09:39:05.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f289e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289f6b0 0x55d0f28a5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f28b2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f27b0df0 con 0x55d0f289f6b0 2023-09-13T09:39:05.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f267ede0 con 0x55d0f289e9b0 2023-09-13T09:39:05.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f27acf00 con 0x55d0f28a0010 2023-09-13T09:39:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82a547e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289f6b0 0x55d0f28a5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82a547e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289f6b0 0x55d0f28a5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33196/0 (socket says 172.21.15.6:33196) 2023-09-13T09:39:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82a547e700 1 -- 172.21.15.6:0/4271833758 learned_addr learned my addr 172.21.15.6:0/4271833758 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.605+0000 7f82a6480700 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f28b2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f289e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a547e700 1 -- 172.21.15.6:0/4271833758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 msgr2=0x55d0f28b2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a547e700 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f28b2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a547e700 1 -- 172.21.15.6:0/4271833758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 msgr2=0x55d0f289e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a547e700 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f289e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a547e700 1 -- 172.21.15.6:0/4271833758 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d0f28bc670 con 0x55d0f289f6b0 2023-09-13T09:39:05.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f289e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82a547e700 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289f6b0 0x55d0f28a5de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8294015000 tx=0x7f8294020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dc8b2ef6fcb578 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f8290ff9700 1 -- 172.21.15.6:0/4271833758 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8294005500 con 0x55d0f289f6b0 2023-09-13T09:39:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f8290ff9700 1 -- 172.21.15.6:0/4271833758 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829401e040 con 0x55d0f289f6b0 2023-09-13T09:39:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f8290ff9700 1 -- 172.21.15.6:0/4271833758 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829400f940 con 0x55d0f289f6b0 2023-09-13T09:39:05.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4271833758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289f6b0 msgr2=0x55d0f28a5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.606+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289f6b0 0x55d0f28a5de0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8294015000 tx=0x7f8294020000 comp rx=0 tx=0).stop 2023-09-13T09:39:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4271833758 shutdown_connections 2023-09-13T09:39:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f28b2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289e9b0 0x55d0f289e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/4271833758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289f6b0 0x55d0f28a5de0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4271833758 >> 172.21.15.6:0/4271833758 conn(0x55d0f27fcc30 msgr2=0x55d0f28a6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4271833758 shutdown_connections 2023-09-13T09:39:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 -- 172.21.15.6:0/4271833758 wait complete. 2023-09-13T09:39:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 -- start start 2023-09-13T09:39:05.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 Processor -- start 2023-09-13T09:39:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f28a4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.607+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 0x55d0f28a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f290b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f290b990 con 0x55d0f289e9b0 2023-09-13T09:39:05.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f290bad0 con 0x55d0f289f6b0 2023-09-13T09:39:05.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d0f290bc10 con 0x55d0f28a0010 2023-09-13T09:39:05.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 10 client.0 _ll_register_callbacks cb 0x55d0f278c630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:05.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f28a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f28a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33200/0 (socket says 172.21.15.6:33200) 2023-09-13T09:39:05.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 -- 172.21.15.6:0/2216991309 learned_addr learned my addr 172.21.15.6:0/2216991309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:05.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a6480700 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f290b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 -- 172.21.15.6:0/2216991309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 msgr2=0x55d0f290b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f290b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 -- 172.21.15.6:0/2216991309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 msgr2=0x55d0f28a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 0x55d0f28a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 -- 172.21.15.6:0/2216991309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f829402c040 con 0x55d0f289e9b0 2023-09-13T09:39:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82a5c7f700 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f28a4280 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f829c099010 tx=0x7f829c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54de613254064dc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82897fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82897fa700 1 -- 172.21.15.6:0/2216991309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c0992e0 con 0x55d0f289e9b0 2023-09-13T09:39:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d0f2891620 con 0x55d0f289e9b0 2023-09-13T09:39:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82897fa700 1 -- 172.21.15.6:0/2216991309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f829c099440 con 0x55d0f289e9b0 2023-09-13T09:39:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82897fa700 1 -- 172.21.15.6:0/2216991309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f829c098570 con 0x55d0f289e9b0 2023-09-13T09:39:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 10 client.15138 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.608+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55d0f261cd90 con 0x55d0f289e9b0 2023-09-13T09:39:05.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82897fa700 1 -- 172.21.15.6:0/2216991309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c07c020 con 0x55d0f289e9b0 2023-09-13T09:39:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82897fa700 1 -- 172.21.15.6:0/2216991309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f829c003b90 con 0x55d0f289e9b0 2023-09-13T09:39:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82b40c8b80 10 client.15138 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82b40c8b80 10 client.15138 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T09:39:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82b40c8b80 20 client.15138 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f2910e80 0x55d0f290d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82b40c8b80 4 client.15138 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d0f263df20 con 0x55d0f2910e80 2023-09-13T09:39:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.609+0000 7f82a547e700 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f2910e80 0x55d0f290d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82897fa700 10 client.15138 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82a547e700 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f2910e80 0x55d0f290d260 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaed7acbee7fa615 server_cookie=15fb3481e67c0bc7 in_seq=0 out_seq=0 2023-09-13T09:39:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82897fa700 1 -- 172.21.15.6:0/2216991309 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55d0f263df20 con 0x55d0f2910e80 2023-09-13T09:39:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82897fa700 10 client.15138 handle_command_reply: tid=0 2023-09-13T09:39:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 client.15138 shutdown 2023-09-13T09:39:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 msgr2=0x55d0f28a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f28a4280 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f829c099010 tx=0x7f829c009ee0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 shutdown_connections 2023-09-13T09:39:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d0f28a0010 0x55d0f290b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d0f2910e80 0x55d0f290d260 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d0f289e9b0 0x55d0f28a4280 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 --2- 172.21.15.6:0/2216991309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d0f289f6b0 0x55d0f28a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82897fa700 0 client.15138 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 >> 172.21.15.6:0/2216991309 conn(0x55d0f27fcc30 msgr2=0x55d0f28a28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 shutdown_connections 2023-09-13T09:39:05.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 1 -- 172.21.15.6:0/2216991309 wait complete. 2023-09-13T09:39:05.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.610+0000 7f82b40c8b80 20 client.15138 trim_cache size 0 max 16384 2023-09-13T09:39:05.633 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-09-13T09:39:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24521, 2023-09-13T09:39:05.633 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 55.876818464999999, 2023-09-13T09:39:05.634 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 84, 2023-09-13T09:39:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:05.635 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 61.607407723000001 2023-09-13T09:39:05.635 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f828c0a06d0 msgr2=0x7f828c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f828c0a06d0 0x7f828c0a2b90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8294000c00 tx=0x7f8294009f10 comp rx=0 tx=0).stop 2023-09-13T09:39:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a00ffcc0 msgr2=0x7f82a0196ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a00ffcc0 0x7f82a0196ac0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f829c00d980 tx=0x7f829c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:39:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 shutdown_connections 2023-09-13T09:39:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82a0101850 0x7f82a019e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f828c0a06d0 0x7f828c0a2b90 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82a00ffcc0 0x7f82a0196ac0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 --2- 172.21.15.6:0/890011889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82a0100eb0 0x7f82a0197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 >> 172.21.15.6:0/890011889 conn(0x7f82a00fb250 msgr2=0x7f82a00fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 shutdown_connections 2023-09-13T09:39:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:05.611+0000 7f82a7ee3700 1 -- 172.21.15.6:0/890011889 wait complete. 2023-09-13T09:39:05.640 INFO:tasks.cephadm:Setup complete, yielding 2023-09-13T09:39:05.640 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-09-13T09:39:05.650 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2023-09-13T09:39:05.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch status' 2023-09-13T09:39:06.216 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:06.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:05 smithi006 ceph-mon[98665]: pgmap v283: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:05 smithi053 ceph-mon[102373]: pgmap v283: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:05 smithi131 ceph-mon[102785]: pgmap v283: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:07.226 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-09-13T09:39:07.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-09-13T09:39:07.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9, 4, 8]}]: dispatch 2023-09-13T09:39:07.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-09-13T09:39:07.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-09-13T09:39:07.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-09-13T09:39:07.228 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2023-09-13T09:39:07.228 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2023-09-13T09:39:07.228 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-09-13T09:39:07.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-09-13T09:39:07.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-09-13T09:39:07.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9, 4, 8]}]: dispatch 2023-09-13T09:39:07.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-09-13T09:39:07.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-09-13T09:39:07.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-09-13T09:39:07.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2023-09-13T09:39:07.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2023-09-13T09:39:07.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-09-13T09:39:07.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-09-13T09:39:07.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2023-09-13T09:39:07.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9, 4, 8]}]: dispatch 2023-09-13T09:39:07.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]: dispatch 2023-09-13T09:39:07.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2023-09-13T09:39:07.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]: dispatch 2023-09-13T09:39:07.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]: dispatch 2023-09-13T09:39:07.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]: dispatch 2023-09-13T09:39:07.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-09-13T09:39:07.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.428+0000 7fd59f229700 1 -- 172.21.15.6:0/758118199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd598101810 msgr2=0x7fd5981080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:07.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.428+0000 7fd59f229700 1 --2- 172.21.15.6:0/758118199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd598101810 0x7fd5981080c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fd59000b0d0 tx=0x7fd59000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.428+0000 7fd59f229700 1 -- 172.21.15.6:0/758118199 shutdown_connections 2023-09-13T09:39:07.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.428+0000 7fd59f229700 1 --2- 172.21.15.6:0/758118199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd598101810 0x7fd5981080c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.428+0000 7fd59f229700 1 --2- 172.21.15.6:0/758118199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5980ffc70 0x7fd598100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.428+0000 7fd59f229700 1 --2- 172.21.15.6:0/758118199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd598100e70 0x7fd5981012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.428+0000 7fd59f229700 1 -- 172.21.15.6:0/758118199 >> 172.21.15.6:0/758118199 conn(0x7fd5980fb1f0 msgr2=0x7fd5980fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:07.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 -- 172.21.15.6:0/758118199 shutdown_connections 2023-09-13T09:39:07.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 -- 172.21.15.6:0/758118199 wait complete. 2023-09-13T09:39:07.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 Processor -- start 2023-09-13T09:39:07.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 -- start start 2023-09-13T09:39:07.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980ffc70 0x7fd598103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:07.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd598100e70 0x7fd598102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:07.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd598101810 0x7fd598102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:07.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598102f10 con 0x7fd5980ffc70 2023-09-13T09:39:07.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598103080 con 0x7fd598101810 2023-09-13T09:39:07.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59f229700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5981a0b70 con 0x7fd598100e70 2023-09-13T09:39:07.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.429+0000 7fd59cfc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980ffc70 0x7fd598103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:07.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980ffc70 0x7fd598103c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33214/0 (socket says 172.21.15.6:33214) 2023-09-13T09:39:07.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 -- 172.21.15.6:0/417565600 learned_addr learned my addr 172.21.15.6:0/417565600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:07.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59d7c6700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd598101810 0x7fd598102790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 -- 172.21.15.6:0/417565600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd598100e70 msgr2=0x7fd598102250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd597fff700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd598100e70 0x7fd598102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd598100e70 0x7fd598102250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 -- 172.21.15.6:0/417565600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd598101810 msgr2=0x7fd598102790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:07.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd598101810 0x7fd598102790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 -- 172.21.15.6:0/417565600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd590009d00 con 0x7fd5980ffc70 2023-09-13T09:39:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59cfc5700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980ffc70 0x7fd598103c00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00d980 tx=0x7fd58c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd595ffb700 1 -- 172.21.15.6:0/417565600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c00de60 con 0x7fd5980ffc70 2023-09-13T09:39:07.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5981a0e50 con 0x7fd5980ffc70 2023-09-13T09:39:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd595ffb700 1 -- 172.21.15.6:0/417565600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd58c0044e0 con 0x7fd5980ffc70 2023-09-13T09:39:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd595ffb700 1 -- 172.21.15.6:0/417565600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd58c003be0 con 0x7fd5980ffc70 2023-09-13T09:39:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.430+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5981a1260 con 0x7fd5980ffc70 2023-09-13T09:39:07.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.431+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd59810b480 con 0x7fd5980ffc70 2023-09-13T09:39:07.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.432+0000 7fd595ffb700 1 -- 172.21.15.6:0/417565600 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd58c009bb0 con 0x7fd5980ffc70 2023-09-13T09:39:07.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.433+0000 7fd595ffb700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd5880a06d0 0x7fd5880a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:07.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.433+0000 7fd597fff700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd5880a06d0 0x7fd5880a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:07.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.433+0000 7fd595ffb700 1 -- 172.21.15.6:0/417565600 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fd58c0cbb00 con 0x7fd5980ffc70 2023-09-13T09:39:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.434+0000 7fd597fff700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd5880a06d0 0x7fd5880a2b90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd584005950 tx=0x7fd584005cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:07.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.438+0000 7fd595ffb700 1 -- 172.21.15.6:0/417565600 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd58c0cde60 con 0x7fd5980ffc70 2023-09-13T09:39:07.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.656+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd598068ed0 con 0x7fd5880a06d0 2023-09-13T09:39:07.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.658+0000 7fd595ffb700 1 -- 172.21.15.6:0/417565600 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7fd598068ed0 con 0x7fd5880a06d0 2023-09-13T09:39:07.659 INFO:teuthology.orchestra.run.smithi006.stdout:Backend: cephadm 2023-09-13T09:39:07.659 INFO:teuthology.orchestra.run.smithi006.stdout:Available: Yes 2023-09-13T09:39:07.659 INFO:teuthology.orchestra.run.smithi006.stdout:Paused: No 2023-09-13T09:39:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd5880a06d0 msgr2=0x7fd5880a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd5880a06d0 0x7fd5880a2b90 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd584005950 tx=0x7fd584005cf0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980ffc70 msgr2=0x7fd598103c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980ffc70 0x7fd598103c00 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fd58c00d980 tx=0x7fd58c00dd40 comp rx=0 tx=0).stop 2023-09-13T09:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 shutdown_connections 2023-09-13T09:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd598101810 0x7fd598102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd5880a06d0 0x7fd5880a2b90 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd5980ffc70 0x7fd598103c00 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 --2- 172.21.15.6:0/417565600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd598100e70 0x7fd598102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 >> 172.21.15.6:0/417565600 conn(0x7fd5980fb1f0 msgr2=0x7fd5980687c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 shutdown_connections 2023-09-13T09:39:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:07.660+0000 7fd59f229700 1 -- 172.21.15.6:0/417565600 wait complete. 2023-09-13T09:39:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: pgmap v284: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-09-13T09:39:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-09-13T09:39:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9, 4, 8]}]': finished 2023-09-13T09:39:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-09-13T09:39:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-09-13T09:39:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-09-13T09:39:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2023-09-13T09:39:08.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2023-09-13T09:39:08.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-09-13T09:39:08.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:07 smithi006 ceph-mon[98665]: osdmap e85: 12 total, 12 up, 12 in 2023-09-13T09:39:08.077 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch ps' 2023-09-13T09:39:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: pgmap v284: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-09-13T09:39:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-09-13T09:39:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9, 4, 8]}]': finished 2023-09-13T09:39:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-09-13T09:39:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-09-13T09:39:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-09-13T09:39:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2023-09-13T09:39:08.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2023-09-13T09:39:08.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-09-13T09:39:08.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:07 smithi053 ceph-mon[102373]: osdmap e85: 12 total, 12 up, 12 in 2023-09-13T09:39:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: pgmap v284: 97 pgs: 97 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-09-13T09:39:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2023-09-13T09:39:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [5, 9, 4, 8]}]': finished 2023-09-13T09:39:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [4, 8]}]': finished 2023-09-13T09:39:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2023-09-13T09:39:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.25", "id": [5, 9]}]': finished 2023-09-13T09:39:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [3, 6]}]': finished 2023-09-13T09:39:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 6]}]': finished 2023-09-13T09:39:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-09-13T09:39:08.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:07 smithi131 ceph-mon[102785]: osdmap e85: 12 total, 12 up, 12 in 2023-09-13T09:39:08.645 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:09.169 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:08 smithi006 ceph-mon[98665]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:09.169 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:08 smithi006 ceph-mon[98665]: osdmap e86: 12 total, 12 up, 12 in 2023-09-13T09:39:09.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:08 smithi053 ceph-mon[102373]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:09.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:08 smithi053 ceph-mon[102373]: osdmap e86: 12 total, 12 up, 12 in 2023-09-13T09:39:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:08 smithi131 ceph-mon[102785]: from='client.15144 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:08 smithi131 ceph-mon[102785]: osdmap e86: 12 total, 12 up, 12 in 2023-09-13T09:39:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/1449001996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4100da0 msgr2=0x7ff3c41011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/1449001996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4100da0 0x7ff3c41011c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7ff3c00099c0 tx=0x7ff3c0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/1449001996 shutdown_connections 2023-09-13T09:39:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/1449001996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c4102940 0x7ff3c41091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/1449001996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4100da0 0x7ff3c41011c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/1449001996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c4101fa0 0x7ff3c4102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/1449001996 >> 172.21.15.6:0/1449001996 conn(0x7ff3c40fc340 msgr2=0x7ff3c40fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/1449001996 shutdown_connections 2023-09-13T09:39:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.841+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/1449001996 wait complete. 2023-09-13T09:39:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 Processor -- start 2023-09-13T09:39:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 -- start start 2023-09-13T09:39:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c4100da0 0x7ff3c4196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c4101fa0 0x7ff3c4196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4102940 0x7ff3c419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c419e5d0 con 0x7ff3c4102940 2023-09-13T09:39:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c419e710 con 0x7ff3c4100da0 2023-09-13T09:39:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3cc4cf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3c419e8a0 con 0x7ff3c4101fa0 2023-09-13T09:39:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4102940 0x7ff3c419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4102940 0x7ff3c419e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33232/0 (socket says 172.21.15.6:33232) 2023-09-13T09:39:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 -- 172.21.15.6:0/3335470465 learned_addr learned my addr 172.21.15.6:0/3335470465 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3ca26b700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c4100da0 0x7ff3c4196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3c9a6a700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c4101fa0 0x7ff3c4196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 -- 172.21.15.6:0/3335470465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c4101fa0 msgr2=0x7ff3c4196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c4101fa0 0x7ff3c4196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 -- 172.21.15.6:0/3335470465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c4100da0 msgr2=0x7ff3c4196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c4100da0 0x7ff3c4196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 -- 172.21.15.6:0/3335470465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3c00095f0 con 0x7ff3c4102940 2023-09-13T09:39:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.842+0000 7ff3caa6c700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4102940 0x7ff3c419e000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00add0 tx=0x7ff3bc00c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.843+0000 7ff3bb7fe700 1 -- 172.21.15.6:0/3335470465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc00f070 con 0x7ff3c4102940 2023-09-13T09:39:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.843+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3c419eb80 con 0x7ff3c4102940 2023-09-13T09:39:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.843+0000 7ff3bb7fe700 1 -- 172.21.15.6:0/3335470465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3bc007b30 con 0x7ff3c4102940 2023-09-13T09:39:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.843+0000 7ff3bb7fe700 1 -- 172.21.15.6:0/3335470465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3bc0053e0 con 0x7ff3c4102940 2023-09-13T09:39:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.843+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3c419f030 con 0x7ff3c4102940 2023-09-13T09:39:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.844+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3c410c5a0 con 0x7ff3c4102940 2023-09-13T09:39:09.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.845+0000 7ff3bb7fe700 1 -- 172.21.15.6:0/3335470465 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7ff3bc00c940 con 0x7ff3c4102940 2023-09-13T09:39:09.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.845+0000 7ff3bb7fe700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3b00a06d0 0x7ff3b00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:09.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.846+0000 7ff3ca26b700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3b00a06d0 0x7ff3b00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:09.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.846+0000 7ff3bb7fe700 1 -- 172.21.15.6:0/3335470465 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7ff3bc0cb9c0 con 0x7ff3c4102940 2023-09-13T09:39:09.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.846+0000 7ff3ca26b700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3b00a06d0 0x7ff3b00a2b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000b580 tx=0x7ff3c0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:09.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:09.849+0000 7ff3bb7fe700 1 -- 172.21.15.6:0/3335470465 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff3bc095410 con 0x7ff3c4102940 2023-09-13T09:39:10.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.059+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7ff3c40610f0 con 0x7ff3b00a06d0 2023-09-13T09:39:10.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.078+0000 7ff3bb7fe700 1 -- 172.21.15.6:0/3335470465 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7ff3c40610f0 con 0x7ff3b00a06d0 2023-09-13T09:39:10.080 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-09-13T09:39:10.080 INFO:teuthology.orchestra.run.smithi006.stdout:mds.a smithi006 running (68s) - 68s 13.2M - 18.0.0-6083-g4a754ac9 ac82d04f119c c5f48f7445cc 2023-09-13T09:39:10.080 INFO:teuthology.orchestra.run.smithi006.stdout:mds.b smithi053 running (66s) - 66s 14.3M - 18.0.0-6083-g4a754ac9 ac82d04f119c b39aa141888c 2023-09-13T09:39:10.081 INFO:teuthology.orchestra.run.smithi006.stdout:mds.c smithi131 running (77s) - 77s 13.5M - 18.0.0-6083-g4a754ac9 ac82d04f119c cb8070ae49ad 2023-09-13T09:39:10.081 INFO:teuthology.orchestra.run.smithi006.stdout:mds.d smithi006 running (84s) - 84s 14.4M - 18.0.0-6083-g4a754ac9 ac82d04f119c 69264e1ad935 2023-09-13T09:39:10.081 INFO:teuthology.orchestra.run.smithi006.stdout:mds.e smithi053 running (82s) - 82s 13.3M - 18.0.0-6083-g4a754ac9 ac82d04f119c 99cf0e39ecf0 2023-09-13T09:39:10.081 INFO:teuthology.orchestra.run.smithi006.stdout:mds.f smithi131 running (80s) - 79s 15.6M - 18.0.0-6083-g4a754ac9 ac82d04f119c ec807e29d509 2023-09-13T09:39:10.081 INFO:teuthology.orchestra.run.smithi006.stdout:mds.g smithi006 running (70s) - 70s 14.3M - 18.0.0-6083-g4a754ac9 ac82d04f119c 8e49170413ba 2023-09-13T09:39:10.081 INFO:teuthology.orchestra.run.smithi006.stdout:mds.h smithi053 running (75s) - 75s 15.7M - 18.0.0-6083-g4a754ac9 ac82d04f119c af2ce7fe1e47 2023-09-13T09:39:10.082 INFO:teuthology.orchestra.run.smithi006.stdout:mds.i smithi131 running (73s) - 72s 14.4M - 18.0.0-6083-g4a754ac9 ac82d04f119c d356db53a602 2023-09-13T09:39:10.082 INFO:teuthology.orchestra.run.smithi006.stdout:mds.j smithi006 running (86s) - 86s 14.4M - 18.0.0-6083-g4a754ac9 ac82d04f119c e3b61731da5e 2023-09-13T09:39:10.082 INFO:teuthology.orchestra.run.smithi006.stdout:mds.k smithi053 running (89s) - 88s 16.7M - 18.0.0-6083-g4a754ac9 ac82d04f119c dbac5a5428ce 2023-09-13T09:39:10.082 INFO:teuthology.orchestra.run.smithi006.stdout:mds.l smithi131 running (91s) - 90s 14.4M - 18.0.0-6083-g4a754ac9 ac82d04f119c e62586f83c18 2023-09-13T09:39:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.x smithi006 *:9283,8765 running (7m) - 7m 515M - 18.0.0-6083-g4a754ac9 ac82d04f119c 9a3a1ccdc2a7 2023-09-13T09:39:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.y smithi053 *:8443,8765 running (6m) - 6m 451M - 18.0.0-6083-g4a754ac9 ac82d04f119c a374379d7b80 2023-09-13T09:39:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.z smithi131 *:8443,8765 running (6m) - 6m 448M - 18.0.0-6083-g4a754ac9 ac82d04f119c 9bc7a867705f 2023-09-13T09:39:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:mon.a smithi006 running (7m) - 8m 87.0M 2048M 18.0.0-6083-g4a754ac9 ac82d04f119c 94ca336ee0b8 2023-09-13T09:39:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:mon.b smithi053 running (6m) - 6m 58.0M 2048M 18.0.0-6083-g4a754ac9 ac82d04f119c a2cb28b0b378 2023-09-13T09:39:10.083 INFO:teuthology.orchestra.run.smithi006.stdout:mon.c smithi131 running (6m) - 6m 58.6M 2048M 18.0.0-6083-g4a754ac9 ac82d04f119c d8d85c2381b6 2023-09-13T09:39:10.084 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (5m) - 5m 57.6M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c c02e115f1585 2023-09-13T09:39:10.084 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi053 running (5m) - 5m 62.8M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c 7d5a7bbad6df 2023-09-13T09:39:10.084 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi131 running (5m) - 5m 55.2M 4292M 18.0.0-6083-g4a754ac9 ac82d04f119c 71bf59d660f6 2023-09-13T09:39:10.084 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi006 running (4m) - 4m 51.6M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c aa4505740744 2023-09-13T09:39:10.084 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi053 running (4m) - 4m 50.8M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c 81f3b7e10951 2023-09-13T09:39:10.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi131 running (3m) - 3m 52.4M 4292M 18.0.0-6083-g4a754ac9 ac82d04f119c f022302c44d3 2023-09-13T09:39:10.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 smithi006 running (3m) - 3m 47.1M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c 66f3e49da5ed 2023-09-13T09:39:10.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 smithi053 running (3m) - 3m 53.1M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c e6deae150eec 2023-09-13T09:39:10.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 smithi131 running (2m) - 2m 53.2M 4292M 18.0.0-6083-g4a754ac9 ac82d04f119c 25dae91f0996 2023-09-13T09:39:10.085 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 smithi006 running (2m) - 2m 47.0M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c 766cf033b14e 2023-09-13T09:39:10.086 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 smithi053 running (2m) - 2m 49.0M 4293M 18.0.0-6083-g4a754ac9 ac82d04f119c ba95507895da 2023-09-13T09:39:10.086 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 smithi131 running (109s) - 109s 44.8M 4292M 18.0.0-6083-g4a754ac9 ac82d04f119c 7a63fcc3957f 2023-09-13T09:39:10.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3b00a06d0 msgr2=0x7ff3b00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:10.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3b00a06d0 0x7ff3b00a2b90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff3c000b580 tx=0x7ff3c0005fb0 comp rx=0 tx=0).stop 2023-09-13T09:39:10.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4102940 msgr2=0x7ff3c419e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:10.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4102940 0x7ff3c419e000 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7ff3bc00add0 tx=0x7ff3bc00c330 comp rx=0 tx=0).stop 2023-09-13T09:39:10.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 shutdown_connections 2023-09-13T09:39:10.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3b00a06d0 0x7ff3b00a2b90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:10.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3c4102940 0x7ff3c419e000 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:10.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3c4100da0 0x7ff3c4196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:10.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 --2- 172.21.15.6:0/3335470465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3c4101fa0 0x7ff3c4196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:10.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 >> 172.21.15.6:0/3335470465 conn(0x7ff3c40fc340 msgr2=0x7ff3c40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:10.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 shutdown_connections 2023-09-13T09:39:10.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:10.081+0000 7ff3cc4cf700 1 -- 172.21.15.6:0/3335470465 wait complete. 2023-09-13T09:39:10.210 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:09 smithi006 ceph-mon[98665]: pgmap v287: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:09 smithi053 ceph-mon[102373]: pgmap v287: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:10.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:09 smithi131 ceph-mon[102785]: pgmap v287: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:10.494 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch ls' 2023-09-13T09:39:11.059 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:11.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:10 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:39:11.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:10 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:39:11.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:10 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:39:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:11 smithi053 ceph-mon[102373]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:11 smithi053 ceph-mon[102373]: pgmap v288: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-09-13T09:39:12.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:11 smithi006 ceph-mon[98665]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:12.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:11 smithi006 ceph-mon[98665]: pgmap v288: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-09-13T09:39:12.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:11 smithi131 ceph-mon[102785]: from='client.15150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:11 smithi131 ceph-mon[102785]: pgmap v288: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 329 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 6 op/s 2023-09-13T09:39:12.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.542+0000 7fb9b65ee700 1 -- 172.21.15.6:0/74927697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b0101810 msgr2=0x7fb9b01080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:12.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.542+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/74927697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b0101810 0x7fb9b01080c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb9a800b0d0 tx=0x7fb9a800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.543+0000 7fb9b65ee700 1 -- 172.21.15.6:0/74927697 shutdown_connections 2023-09-13T09:39:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.543+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/74927697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b0101810 0x7fb9b01080c0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.543+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/74927697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b00ffc70 0x7fb9b0100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.543+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/74927697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9b0100e70 0x7fb9b01012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.543+0000 7fb9b65ee700 1 -- 172.21.15.6:0/74927697 >> 172.21.15.6:0/74927697 conn(0x7fb9b00fb1f0 msgr2=0x7fb9b00fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.543+0000 7fb9b65ee700 1 -- 172.21.15.6:0/74927697 shutdown_connections 2023-09-13T09:39:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.543+0000 7fb9b65ee700 1 -- 172.21.15.6:0/74927697 wait complete. 2023-09-13T09:39:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 Processor -- start 2023-09-13T09:39:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 -- start start 2023-09-13T09:39:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b00ffc70 0x7fb9b0069bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b0100e70 0x7fb9b019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9b0101810 0x7fb9b019df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b019e710 con 0x7fb9b00ffc70 2023-09-13T09:39:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b019e880 con 0x7fb9b0100e70 2023-09-13T09:39:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b65ee700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9b019ea40 con 0x7fb9b0101810 2023-09-13T09:39:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b00ffc70 0x7fb9b0069bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b00ffc70 0x7fb9b0069bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33242/0 (socket says 172.21.15.6:33242) 2023-09-13T09:39:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 -- 172.21.15.6:0/2312761728 learned_addr learned my addr 172.21.15.6:0/2312761728 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9af7fe700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b0100e70 0x7fb9b019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9b4b8b700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9b0101810 0x7fb9b019df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 -- 172.21.15.6:0/2312761728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9b0101810 msgr2=0x7fb9b019df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9b0101810 0x7fb9b019df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 -- 172.21.15.6:0/2312761728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b0100e70 msgr2=0x7fb9b019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b0100e70 0x7fb9b019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.544+0000 7fb9affff700 1 -- 172.21.15.6:0/2312761728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a8009d00 con 0x7fb9b00ffc70 2023-09-13T09:39:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.545+0000 7fb9b4b8b700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9b0101810 0x7fb9b019df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.545+0000 7fb9affff700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b00ffc70 0x7fb9b0069bb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000d980 tx=0x7fb9a000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.545+0000 7fb9ad7fa700 1 -- 172.21.15.6:0/2312761728 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0004020 con 0x7fb9b00ffc70 2023-09-13T09:39:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.545+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9b019ed20 con 0x7fb9b00ffc70 2023-09-13T09:39:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.545+0000 7fb9ad7fa700 1 -- 172.21.15.6:0/2312761728 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb9a0009730 con 0x7fb9b00ffc70 2023-09-13T09:39:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.545+0000 7fb9ad7fa700 1 -- 172.21.15.6:0/2312761728 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9a0003a30 con 0x7fb9b00ffc70 2023-09-13T09:39:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.545+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9b019f240 con 0x7fb9b00ffc70 2023-09-13T09:39:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.546+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9b010b5b0 con 0x7fb9b00ffc70 2023-09-13T09:39:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.547+0000 7fb9ad7fa700 1 -- 172.21.15.6:0/2312761728 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fb9a00098a0 con 0x7fb9b00ffc70 2023-09-13T09:39:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.548+0000 7fb9ad7fa700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb9980a06d0 0x7fb9980a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.548+0000 7fb9ad7fa700 1 -- 172.21.15.6:0/2312761728 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fb9a00cbdc0 con 0x7fb9b00ffc70 2023-09-13T09:39:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.550+0000 7fb9af7fe700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb9980a06d0 0x7fb9980a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.550+0000 7fb9af7fe700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb9980a06d0 0x7fb9980a2b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9b006a110 tx=0x7fb9a4009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.552+0000 7fb9ad7fa700 1 -- 172.21.15.6:0/2312761728 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb9a0095780 con 0x7fb9b00ffc70 2023-09-13T09:39:12.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.769+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9b00610f0 con 0x7fb9980a06d0 2023-09-13T09:39:12.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.776+0000 7fb9ad7fa700 1 -- 172.21.15.6:0/2312761728 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fb9b00610f0 con 0x7fb9980a06d0 2023-09-13T09:39:12.777 INFO:teuthology.orchestra.run.smithi006.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-09-13T09:39:12.777 INFO:teuthology.orchestra.run.smithi006.stdout:mds.all 12/12 - 96s smithi006=a;smithi006=d;smithi006=g;smithi006=j;smithi053=b;smithi053=e;smithi053=h;smithi053=k;smithi131=c;smithi131=f;smithi131=i;smithi131=l;count:12 2023-09-13T09:39:12.777 INFO:teuthology.orchestra.run.smithi006.stdout:mgr 3/3 - 6m smithi006=x;smithi053=y;smithi131=z;count:3 2023-09-13T09:39:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:mon 3/3 - 6m smithi006:172.21.15.6=a;smithi053:172.21.15.53=b;smithi131:172.21.15.131=c;count:3 2023-09-13T09:39:12.778 INFO:teuthology.orchestra.run.smithi006.stdout:osd 12 - - 2023-09-13T09:39:12.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb9980a06d0 msgr2=0x7fb9980a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:12.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb9980a06d0 0x7fb9980a2b90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb9b006a110 tx=0x7fb9a4009190 comp rx=0 tx=0).stop 2023-09-13T09:39:12.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b00ffc70 msgr2=0x7fb9b0069bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:12.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b00ffc70 0x7fb9b0069bb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb9a000d980 tx=0x7fb9a000dc90 comp rx=0 tx=0).stop 2023-09-13T09:39:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 shutdown_connections 2023-09-13T09:39:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9b0101810 0x7fb9b019df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb9980a06d0 0x7fb9980a2b90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9b00ffc70 0x7fb9b0069bb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 --2- 172.21.15.6:0/2312761728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb9b0100e70 0x7fb9b019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 >> 172.21.15.6:0/2312761728 conn(0x7fb9b00fb1f0 msgr2=0x7fb9b00fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 shutdown_connections 2023-09-13T09:39:12.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:12.778+0000 7fb9b65ee700 1 -- 172.21.15.6:0/2312761728 wait complete. 2023-09-13T09:39:13.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch host ls' 2023-09-13T09:39:13.734 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:13 smithi006 ceph-mon[98665]: pgmap v289: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:13 smithi006 ceph-mon[98665]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:14.235 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:13 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:13 smithi053 ceph-mon[102373]: pgmap v289: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:13 smithi053 ceph-mon[102373]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:13 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:13 smithi131 ceph-mon[102785]: pgmap v289: 97 pgs: 3 peering, 94 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:13 smithi131 ceph-mon[102785]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:13 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:14.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 -- 172.21.15.6:0/2186772499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840108ca0 msgr2=0x7f484010b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 --2- 172.21.15.6:0/2186772499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840108ca0 0x7f484010b110 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f483800b0a0 tx=0x7f483800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 -- 172.21.15.6:0/2186772499 shutdown_connections 2023-09-13T09:39:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 --2- 172.21.15.6:0/2186772499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840108ca0 0x7f484010b110 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 --2- 172.21.15.6:0/2186772499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4840074c60 0x7f48400730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:14.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 --2- 172.21.15.6:0/2186772499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4840073690 0x7f4840073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 -- 172.21.15.6:0/2186772499 >> 172.21.15.6:0/2186772499 conn(0x7f48400fc340 msgr2=0x7f48400fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 -- 172.21.15.6:0/2186772499 shutdown_connections 2023-09-13T09:39:14.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.920+0000 7f4847db3700 1 -- 172.21.15.6:0/2186772499 wait complete. 2023-09-13T09:39:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 Processor -- start 2023-09-13T09:39:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 -- start start 2023-09-13T09:39:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4840073690 0x7f4840198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:14.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840074c60 0x7f48401991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4840108ca0 0x7f48401a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48401a07a0 con 0x7f4840074c60 2023-09-13T09:39:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48401a08e0 con 0x7f4840108ca0 2023-09-13T09:39:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4847db3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48401a0aa0 con 0x7f4840073690 2023-09-13T09:39:14.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840074c60 0x7f48401991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840074c60 0x7f48401991e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33258/0 (socket says 172.21.15.6:33258) 2023-09-13T09:39:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 -- 172.21.15.6:0/349873044 learned_addr learned my addr 172.21.15.6:0/349873044 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4846350700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4840108ca0 0x7f48401a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4845b4f700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4840073690 0x7f4840198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:14.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 -- 172.21.15.6:0/349873044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4840073690 msgr2=0x7f4840198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4840073690 0x7f4840198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 -- 172.21.15.6:0/349873044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4840108ca0 msgr2=0x7f48401a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4840108ca0 0x7f48401a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f484534e700 1 -- 172.21.15.6:0/349873044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4838009d00 con 0x7f4840074c60 2023-09-13T09:39:14.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.921+0000 7f4845b4f700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4840073690 0x7f4840198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:14.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.922+0000 7f484534e700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840074c60 0x7f48401991e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f483c00d950 tx=0x7f483c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.922+0000 7f4836ffd700 1 -- 172.21.15.6:0/349873044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c009940 con 0x7f4840074c60 2023-09-13T09:39:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.922+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48401a0d80 con 0x7f4840074c60 2023-09-13T09:39:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.922+0000 7f4836ffd700 1 -- 172.21.15.6:0/349873044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f483c010460 con 0x7f4840074c60 2023-09-13T09:39:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.922+0000 7f4836ffd700 1 -- 172.21.15.6:0/349873044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00f620 con 0x7f4840074c60 2023-09-13T09:39:14.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.922+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48401a1210 con 0x7f4840074c60 2023-09-13T09:39:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.923+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4840107ab0 con 0x7f4840074c60 2023-09-13T09:39:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.924+0000 7f4836ffd700 1 -- 172.21.15.6:0/349873044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f483c0108d0 con 0x7f4840074c60 2023-09-13T09:39:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.924+0000 7f4836ffd700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f482c0a06d0 0x7f482c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.925+0000 7f4845b4f700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f482c0a06d0 0x7f482c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:14.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.925+0000 7f4836ffd700 1 -- 172.21.15.6:0/349873044 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f483c0cbbb0 con 0x7f4840074c60 2023-09-13T09:39:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.925+0000 7f4845b4f700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f482c0a06d0 0x7f482c0a2b90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f484019a130 tx=0x7f483000a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:14.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:14.928+0000 7f4836ffd700 1 -- 172.21.15.6:0/349873044 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f483c095510 con 0x7f4840074c60 2023-09-13T09:39:15.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.135+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f484002d170 con 0x7f482c0a06d0 2023-09-13T09:39:15.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.136+0000 7f4836ffd700 1 -- 172.21.15.6:0/349873044 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7f484002d170 con 0x7f482c0a06d0 2023-09-13T09:39:15.138 INFO:teuthology.orchestra.run.smithi006.stdout:HOST ADDR LABELS STATUS 2023-09-13T09:39:15.138 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 172.21.15.6 2023-09-13T09:39:15.138 INFO:teuthology.orchestra.run.smithi006.stdout:smithi053 172.21.15.53 2023-09-13T09:39:15.138 INFO:teuthology.orchestra.run.smithi006.stdout:smithi131 172.21.15.131 2023-09-13T09:39:15.138 INFO:teuthology.orchestra.run.smithi006.stdout:3 hosts in cluster 2023-09-13T09:39:15.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.138+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f482c0a06d0 msgr2=0x7f482c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:15.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.138+0000 7f4847db3700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f482c0a06d0 0x7f482c0a2b90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f484019a130 tx=0x7f483000a680 comp rx=0 tx=0).stop 2023-09-13T09:39:15.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.138+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840074c60 msgr2=0x7f48401991e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:15.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.138+0000 7f4847db3700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840074c60 0x7f48401991e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f483c00d950 tx=0x7f483c00dc60 comp rx=0 tx=0).stop 2023-09-13T09:39:15.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.138+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 shutdown_connections 2023-09-13T09:39:15.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.139+0000 7f4847db3700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4840108ca0 0x7f48401a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:15.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.139+0000 7f4847db3700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4840073690 0x7f4840198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:15.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.139+0000 7f4847db3700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f482c0a06d0 0x7f482c0a2b90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.139+0000 7f4847db3700 1 --2- 172.21.15.6:0/349873044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4840074c60 0x7f48401991e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.139+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 >> 172.21.15.6:0/349873044 conn(0x7f48400fc340 msgr2=0x7f4840104bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:15.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.139+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 shutdown_connections 2023-09-13T09:39:15.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:15.139+0000 7f4847db3700 1 -- 172.21.15.6:0/349873044 wait complete. 2023-09-13T09:39:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:15 smithi006 ceph-mon[98665]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-09-13T09:39:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:39:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:39:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:15 smithi053 ceph-mon[102373]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-09-13T09:39:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:39:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:39:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:15 smithi131 ceph-mon[102785]: pgmap v290: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2023-09-13T09:39:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:39:15.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:39:15.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:39:15.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph orch device ls' 2023-09-13T09:39:16.147 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:16 smithi006 ceph-mon[98665]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:16 smithi053 ceph-mon[102373]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:16.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:16 smithi131 ceph-mon[102785]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:17.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 -- 172.21.15.6:0/2748724591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650101810 msgr2=0x7f16501080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:17.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 --2- 172.21.15.6:0/2748724591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650101810 0x7f16501080c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f164800b0d0 tx=0x7f164800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 -- 172.21.15.6:0/2748724591 shutdown_connections 2023-09-13T09:39:17.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 --2- 172.21.15.6:0/2748724591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650101810 0x7f16501080c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 --2- 172.21.15.6:0/2748724591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16500ffc70 0x7f1650100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 --2- 172.21.15.6:0/2748724591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1650100e70 0x7f16501012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 -- 172.21.15.6:0/2748724591 >> 172.21.15.6:0/2748724591 conn(0x7f16500fb1f0 msgr2=0x7f16500fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 -- 172.21.15.6:0/2748724591 shutdown_connections 2023-09-13T09:39:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.465+0000 7f1657539700 1 -- 172.21.15.6:0/2748724591 wait complete. 2023-09-13T09:39:17.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 Processor -- start 2023-09-13T09:39:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 -- start start 2023-09-13T09:39:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16500ffc70 0x7f1650069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650100e70 0x7f165019ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1650101810 0x7f165019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:17.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165019e800 con 0x7f1650100e70 2023-09-13T09:39:17.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165019e970 con 0x7f16500ffc70 2023-09-13T09:39:17.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1657539700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f165019eb30 con 0x7f1650101810 2023-09-13T09:39:17.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1654ad4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650100e70 0x7f165019ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:17.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1654ad4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650100e70 0x7f165019ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33272/0 (socket says 172.21.15.6:33272) 2023-09-13T09:39:17.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f1654ad4700 1 -- 172.21.15.6:0/3499306187 learned_addr learned my addr 172.21.15.6:0/3499306187 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:17.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.466+0000 7f16552d5700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16500ffc70 0x7f1650069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:17.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1655ad6700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1650101810 0x7f165019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:17.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1654ad4700 1 -- 172.21.15.6:0/3499306187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1650101810 msgr2=0x7f165019e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:17.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1654ad4700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1650101810 0x7f165019e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1654ad4700 1 -- 172.21.15.6:0/3499306187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16500ffc70 msgr2=0x7f1650069320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:17.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1654ad4700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16500ffc70 0x7f1650069320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1654ad4700 1 -- 172.21.15.6:0/3499306187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1648009d00 con 0x7f1650100e70 2023-09-13T09:39:17.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1654ad4700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650100e70 0x7f165019ba10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b530 tx=0x7f164c00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:17.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f16427fc700 1 -- 172.21.15.6:0/3499306187 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c011830 con 0x7f1650100e70 2023-09-13T09:39:17.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f16427fc700 1 -- 172.21.15.6:0/3499306187 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f164c011e50 con 0x7f1650100e70 2023-09-13T09:39:17.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f165019ee10 con 0x7f1650100e70 2023-09-13T09:39:17.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f16427fc700 1 -- 172.21.15.6:0/3499306187 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f164c00f2e0 con 0x7f1650100e70 2023-09-13T09:39:17.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.467+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f165019f350 con 0x7f1650100e70 2023-09-13T09:39:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.468+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1650107270 con 0x7f1650100e70 2023-09-13T09:39:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.470+0000 7f16427fc700 1 -- 172.21.15.6:0/3499306187 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f164c010380 con 0x7f1650100e70 2023-09-13T09:39:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.470+0000 7f16427fc700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f163c0a0750 0x7f163c0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.470+0000 7f16427fc700 1 -- 172.21.15.6:0/3499306187 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f164c0cbca0 con 0x7f1650100e70 2023-09-13T09:39:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.470+0000 7f16552d5700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f163c0a0750 0x7f163c0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.471+0000 7f16552d5700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f163c0a0750 0x7f163c0a2c10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1650100cd0 tx=0x7f1644009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:17.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.474+0000 7f16427fc700 1 -- 172.21.15.6:0/3499306187 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f164c095770 con 0x7f1650100e70 2023-09-13T09:39:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.684+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f165002d0b0 con 0x7f163c0a0750 2023-09-13T09:39:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.686+0000 7f16427fc700 1 -- 172.21.15.6:0/3499306187 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f165002d0b0 con 0x7f163c0a0750 2023-09-13T09:39:17.687 INFO:teuthology.orchestra.run.smithi006.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-09-13T09:39:17.688 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330000H400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-09-13T09:39:17.688 INFO:teuthology.orchestra.run.smithi006.stdout:smithi053 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300G8480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-09-13T09:39:17.688 INFO:teuthology.orchestra.run.smithi006.stdout:smithi131 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300N4400BGN 372G No 110s ago Has a FileSystem, LVM detected 2023-09-13T09:39:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f163c0a0750 msgr2=0x7f163c0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f163c0a0750 0x7f163c0a2c10 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1650100cd0 tx=0x7f1644009190 comp rx=0 tx=0).stop 2023-09-13T09:39:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650100e70 msgr2=0x7f165019ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650100e70 0x7f165019ba10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f164c00b530 tx=0x7f164c00b840 comp rx=0 tx=0).stop 2023-09-13T09:39:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 shutdown_connections 2023-09-13T09:39:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1650101810 0x7f165019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16500ffc70 0x7f1650069320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f163c0a0750 0x7f163c0a2c10 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 --2- 172.21.15.6:0/3499306187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1650100e70 0x7f165019ba10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.688+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 >> 172.21.15.6:0/3499306187 conn(0x7f16500fb1f0 msgr2=0x7f16501043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:17.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.689+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 shutdown_connections 2023-09-13T09:39:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:17.689+0000 7f1657539700 1 -- 172.21.15.6:0/3499306187 wait complete. 2023-09-13T09:39:18.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:17 smithi006 ceph-mon[98665]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-09-13T09:39:18.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:17 smithi053 ceph-mon[102373]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-09-13T09:39:18.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:17 smithi131 ceph-mon[102785]: pgmap v291: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2023-09-13T09:39:18.097 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-09-13T09:39:18.106 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi006.front.sepia.ceph.com 2023-09-13T09:39:18.106 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph fs dump' 2023-09-13T09:39:18.671 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:19.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:18 smithi006 ceph-mon[98665]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:19.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:18 smithi053 ceph-mon[102373]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:19.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:18 smithi131 ceph-mon[102785]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-09-13T09:39:19.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- 172.21.15.6:0/4284641144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c101810 msgr2=0x7f696c1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 --2- 172.21.15.6:0/4284641144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c101810 0x7f696c1080c0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f696400b0d0 tx=0x7f696400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- 172.21.15.6:0/4284641144 shutdown_connections 2023-09-13T09:39:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 --2- 172.21.15.6:0/4284641144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c101810 0x7f696c1080c0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:19.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 --2- 172.21.15.6:0/4284641144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f696c0ffc70 0x7f696c100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 --2- 172.21.15.6:0/4284641144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f696c100e70 0x7f696c1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- 172.21.15.6:0/4284641144 >> 172.21.15.6:0/4284641144 conn(0x7f696c0fb1f0 msgr2=0x7f696c0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- 172.21.15.6:0/4284641144 shutdown_connections 2023-09-13T09:39:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- 172.21.15.6:0/4284641144 wait complete. 2023-09-13T09:39:19.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 Processor -- start 2023-09-13T09:39:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- start start 2023-09-13T09:39:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f696c0ffc70 0x7f696c069300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c100e70 0x7f696c19b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f696c101810 0x7f696c19dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:19.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c19e660 con 0x7f696c100e70 2023-09-13T09:39:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c19e7d0 con 0x7f696c0ffc70 2023-09-13T09:39:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f697216b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c19e990 con 0x7f696c101810 2023-09-13T09:39:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f696affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c100e70 0x7f696c19b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.858+0000 7f696b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f696c0ffc70 0x7f696c069300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:19.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f696c0ffc70 0x7f696c069300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:55040/0 (socket says 172.21.15.6:55040) 2023-09-13T09:39:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c100e70 0x7f696c19b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33286/0 (socket says 172.21.15.6:33286) 2023-09-13T09:39:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696b7fe700 1 -- 172.21.15.6:0/75058629 learned_addr learned my addr 172.21.15.6:0/75058629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696bfff700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f696c101810 0x7f696c19dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696affd700 1 -- 172.21.15.6:0/75058629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f696c101810 msgr2=0x7f696c19dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:19.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696affd700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f696c101810 0x7f696c19dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:19.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696affd700 1 -- 172.21.15.6:0/75058629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f696c0ffc70 msgr2=0x7f696c069300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:19.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696affd700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f696c0ffc70 0x7f696c069300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:19.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696affd700 1 -- 172.21.15.6:0/75058629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6964009d00 con 0x7f696c100e70 2023-09-13T09:39:19.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f696affd700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c100e70 0x7f696c19b880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f695400d950 tx=0x7f695400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:19.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f6968ff9700 1 -- 172.21.15.6:0/75058629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400f890 con 0x7f696c100e70 2023-09-13T09:39:19.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c19ec70 con 0x7f696c100e70 2023-09-13T09:39:19.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f6968ff9700 1 -- 172.21.15.6:0/75058629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6954010460 con 0x7f696c100e70 2023-09-13T09:39:19.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f6968ff9700 1 -- 172.21.15.6:0/75058629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695400e610 con 0x7f696c100e70 2023-09-13T09:39:19.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.859+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c19f170 con 0x7f696c100e70 2023-09-13T09:39:19.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.860+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c1071c0 con 0x7f696c100e70 2023-09-13T09:39:19.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.861+0000 7f6968ff9700 1 -- 172.21.15.6:0/75058629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f69540108d0 con 0x7f696c100e70 2023-09-13T09:39:19.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.862+0000 7f6968ff9700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69580a06d0 0x7f69580a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:19.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.862+0000 7f6968ff9700 1 -- 172.21.15.6:0/75058629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f69540cbec0 con 0x7f696c100e70 2023-09-13T09:39:19.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.862+0000 7f696b7fe700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69580a06d0 0x7f69580a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:19.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.862+0000 7f696b7fe700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69580a06d0 0x7f69580a2b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f695c00bd70 tx=0x7f695c00b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:19.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:19.866+0000 7f6968ff9700 1 -- 172.21.15.6:0/75058629 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6954095880 con 0x7f696c100e70 2023-09-13T09:39:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:19 smithi006 ceph-mon[98665]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:20.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:19 smithi053 ceph-mon[102373]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:19 smithi131 ceph-mon[102785]: pgmap v292: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.112+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f696c0009c0 con 0x7f696c100e70 2023-09-13T09:39:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.113+0000 7f6968ff9700 1 -- 172.21.15.6:0/75058629 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+2949 (secure 0 0 0) 0x7f6954020ba0 con 0x7f696c100e70 2023-09-13T09:39:20.113 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2023-09-13T09:39:20.113 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-09-13T09:39:20.113 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-13T09:39:20.114 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2023-09-13T09:39:20.114 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:20.114 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2023-09-13T09:39:20.114 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2023-09-13T09:39:20.114 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 26 2023-09-13T09:39:20.115 INFO:teuthology.orchestra.run.smithi006.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-09-13T09:39:20.115 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-09-13T09:38:09.116270+0000 2023-09-13T09:39:20.115 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2023-09-13T09:38:16.673454+0000 2023-09-13T09:39:20.115 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2023-09-13T09:39:20.115 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2023-09-13T09:39:20.116 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 300 2023-09-13T09:39:20.116 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2023-09-13T09:39:20.116 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2023-09-13T09:39:20.116 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2023-09-13T09:39:20.116 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2023-09-13T09:39:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2023-09-13T09:39:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2023-09-13T09:39:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-09-13T09:39:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 5 2023-09-13T09:39:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1,2,3,4 2023-09-13T09:39:20.117 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=24521,1=24484,2=24482,3=24466,4=24455} 2023-09-13T09:39:20.118 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2023-09-13T09:39:20.118 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2023-09-13T09:39:20.118 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2023-09-13T09:39:20.118 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2023-09-13T09:39:20.118 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2023-09-13T09:39:20.119 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2023-09-13T09:39:20.119 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2023-09-13T09:39:20.119 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2023-09-13T09:39:20.119 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 0 2023-09-13T09:39:20.119 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.b{0:24521} state up:active seq 3 addr [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.120 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.f{0:24454} state up:standby-replay seq 1 addr [v2:172.21.15.131:6834/487237413,v1:172.21.15.131:6835/487237413] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.120 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.i{1:24484} state up:active seq 5 addr [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.120 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.k{1:24428} state up:standby-replay seq 1 addr [v2:172.21.15.53:6832/162812581,v1:172.21.15.53:6833/162812581] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.120 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.h{2:24482} state up:active seq 6 addr [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.120 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.l{2:24412} state up:standby-replay seq 1 addr [v2:172.21.15.131:6832/4209861668,v1:172.21.15.131:6833/4209861668] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.121 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.c{3:24466} state up:active seq 7 addr [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.121 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.a{3:14646} state up:standby-replay seq 1 addr [v2:172.21.15.6:6840/1420340613,v1:172.21.15.6:6841/1420340613] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.121 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.e{4:24455} state up:active seq 8 addr [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.121 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.g{4:14634} state up:standby-replay seq 1 addr [v2:172.21.15.6:6838/565321366,v1:172.21.15.6:6839/565321366] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.121 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:20.121 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:20.122 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2023-09-13T09:39:20.122 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:20.122 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.j{-1:14568} state up:standby seq 1 addr [v2:172.21.15.6:6834/1678170367,v1:172.21.15.6:6835/1678170367] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.122 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.d{-1:14580} state up:standby seq 1 addr [v2:172.21.15.6:6836/1215201331,v1:172.21.15.6:6837/1215201331] compat {c=[1],r=[1],i=[fff]}] 2023-09-13T09:39:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69580a06d0 msgr2=0x7f69580a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69580a06d0 0x7f69580a2b90 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f695c00bd70 tx=0x7f695c00b4a0 comp rx=0 tx=0).stop 2023-09-13T09:39:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c100e70 msgr2=0x7f696c19b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c100e70 0x7f696c19b880 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f695400d950 tx=0x7f695400dc60 comp rx=0 tx=0).stop 2023-09-13T09:39:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 shutdown_connections 2023-09-13T09:39:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f696c101810 0x7f696c19dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f696c0ffc70 0x7f696c069300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69580a06d0 0x7f69580a2b90 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.114+0000 7f697216b700 1 --2- 172.21.15.6:0/75058629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f696c100e70 0x7f696c19b880 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.115+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 >> 172.21.15.6:0/75058629 conn(0x7f696c0fb1f0 msgr2=0x7f696c104300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.115+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 shutdown_connections 2023-09-13T09:39:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:20.115+0000 7f697216b700 1 -- 172.21.15.6:0/75058629 wait complete. 2023-09-13T09:39:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:20.521 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- bash -c 'ceph osd dump' 2023-09-13T09:39:21.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:20 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/75058629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-13T09:39:21.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:20 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/75058629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-13T09:39:21.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:20 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/75058629' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-09-13T09:39:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:22.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:21 smithi006 ceph-mon[98665]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:22.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:21 smithi053 ceph-mon[102373]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:22.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:21 smithi131 ceph-mon[102785]: pgmap v293: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:22.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 -- 172.21.15.6:0/1423365453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec106ac0 msgr2=0x7f61ec108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:22.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 --2- 172.21.15.6:0/1423365453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec106ac0 0x7f61ec108ed0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f61e400b0a0 tx=0x7f61e400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 -- 172.21.15.6:0/1423365453 shutdown_connections 2023-09-13T09:39:22.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 --2- 172.21.15.6:0/1423365453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec106ac0 0x7f61ec108ed0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 --2- 172.21.15.6:0/1423365453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ec101860 0x7f61ec103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 --2- 172.21.15.6:0/1423365453 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ec104190 0x7f61ec106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 -- 172.21.15.6:0/1423365453 >> 172.21.15.6:0/1423365453 conn(0x7f61ec0fb1d0 msgr2=0x7f61ec0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:22.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 -- 172.21.15.6:0/1423365453 shutdown_connections 2023-09-13T09:39:22.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.420+0000 7f61f1610700 1 -- 172.21.15.6:0/1423365453 wait complete. 2023-09-13T09:39:22.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 Processor -- start 2023-09-13T09:39:22.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 -- start start 2023-09-13T09:39:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ec101860 0x7f61ec196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec104190 0x7f61ec196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:22.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ec106ac0 0x7f61ec19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec19e5f0 con 0x7f61ec104190 2023-09-13T09:39:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec19e730 con 0x7f61ec106ac0 2023-09-13T09:39:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61f1610700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec19e8c0 con 0x7f61ec101860 2023-09-13T09:39:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec104190 0x7f61ec196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:22.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec104190 0x7f61ec196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33298/0 (socket says 172.21.15.6:33298) 2023-09-13T09:39:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61ea7fc700 1 -- 172.21.15.6:0/818759484 learned_addr learned my addr 172.21.15.6:0/818759484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.421+0000 7f61eb7fe700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ec106ac0 0x7f61ec19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61eaffd700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ec101860 0x7f61ec196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61ea7fc700 1 -- 172.21.15.6:0/818759484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ec101860 msgr2=0x7f61ec196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:22.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61ea7fc700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ec101860 0x7f61ec196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61ea7fc700 1 -- 172.21.15.6:0/818759484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ec106ac0 msgr2=0x7f61ec19e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61ea7fc700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ec106ac0 0x7f61ec19e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61ea7fc700 1 -- 172.21.15.6:0/818759484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e4009d00 con 0x7f61ec104190 2023-09-13T09:39:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61eaffd700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ec101860 0x7f61ec196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:22.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61eb7fe700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ec106ac0 0x7f61ec19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61ea7fc700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec104190 0x7f61ec196fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c950 tx=0x7f61e000cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61d3fff700 1 -- 172.21.15.6:0/818759484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0007ac0 con 0x7f61ec104190 2023-09-13T09:39:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61d3fff700 1 -- 172.21.15.6:0/818759484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61e0004cf0 con 0x7f61ec104190 2023-09-13T09:39:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec19eba0 con 0x7f61ec104190 2023-09-13T09:39:22.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61d3fff700 1 -- 172.21.15.6:0/818759484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0005550 con 0x7f61ec104190 2023-09-13T09:39:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.422+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec19f0a0 con 0x7f61ec104190 2023-09-13T09:39:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.423+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec0fcd50 con 0x7f61ec104190 2023-09-13T09:39:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.425+0000 7f61d3fff700 1 -- 172.21.15.6:0/818759484 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f61e0004750 con 0x7f61ec104190 2023-09-13T09:39:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.425+0000 7f61d3fff700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61d40a06d0 0x7f61d40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:22.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.425+0000 7f61eaffd700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61d40a06d0 0x7f61d40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.425+0000 7f61d3fff700 1 -- 172.21.15.6:0/818759484 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f61e00cbd60 con 0x7f61ec104190 2023-09-13T09:39:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.426+0000 7f61eaffd700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61d40a06d0 0x7f61d40a2b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005fd0 tx=0x7f61dc005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:22.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.428+0000 7f61d3fff700 1 -- 172.21.15.6:0/818759484 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f61e0095720 con 0x7f61ec104190 2023-09-13T09:39:22.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.631+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f61ec02d0b0 con 0x7f61ec104190 2023-09-13T09:39:22.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.632+0000 7f61d3fff700 1 -- 172.21.15.6:0/818759484 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v86) v1 ==== 56+0+5266 (secure 0 0 0) 0x7f61e001d070 con 0x7f61ec104190 2023-09-13T09:39:22.632 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 86 2023-09-13T09:39:22.633 INFO:teuthology.orchestra.run.smithi006.stdout:fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T09:39:22.633 INFO:teuthology.orchestra.run.smithi006.stdout:created 2023-09-13T09:31:04.146607+0000 2023-09-13T09:39:22.633 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2023-09-13T09:39:07.896691+0000 2023-09-13T09:39:22.633 INFO:teuthology.orchestra.run.smithi006.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-09-13T09:39:22.634 INFO:teuthology.orchestra.run.smithi006.stdout:crush_version 26 2023-09-13T09:39:22.634 INFO:teuthology.orchestra.run.smithi006.stdout:full_ratio 0.95 2023-09-13T09:39:22.634 INFO:teuthology.orchestra.run.smithi006.stdout:backfillfull_ratio 0.9 2023-09-13T09:39:22.634 INFO:teuthology.orchestra.run.smithi006.stdout:nearfull_ratio 0.85 2023-09-13T09:39:22.634 INFO:teuthology.orchestra.run.smithi006.stdout:require_min_compat_client luminous 2023-09-13T09:39:22.634 INFO:teuthology.orchestra.run.smithi006.stdout:min_compat_client luminous 2023-09-13T09:39:22.635 INFO:teuthology.orchestra.run.smithi006.stdout:require_osd_release reef 2023-09-13T09:39:22.635 INFO:teuthology.orchestra.run.smithi006.stdout:stretch_mode_enabled false 2023-09-13T09:39:22.635 INFO:teuthology.orchestra.run.smithi006.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-09-13T09:39:22.635 INFO:teuthology.orchestra.run.smithi006.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-09-13T09:39:22.635 INFO:teuthology.orchestra.run.smithi006.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-09-13T09:39:22.636 INFO:teuthology.orchestra.run.smithi006.stdout:max_osd 12 2023-09-13T09:39:22.636 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 up in weight 1 up_from 8 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6802/84174625,v1:172.21.15.6:6803/84174625] [v2:172.21.15.6:6804/84174625,v1:172.21.15.6:6805/84174625] exists,up 14f623c2-a72c-4bae-a3d6-1655d183ae8d 2023-09-13T09:39:22.636 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 up in weight 1 up_from 13 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6800/1769951158,v1:172.21.15.53:6801/1769951158] [v2:172.21.15.53:6802/1769951158,v1:172.21.15.53:6803/1769951158] exists,up ef1e644c-ae97-44af-9d69-43f58e7e946d 2023-09-13T09:39:22.636 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 up in weight 1 up_from 18 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6800/2103696562,v1:172.21.15.131:6801/2103696562] [v2:172.21.15.131:6802/2103696562,v1:172.21.15.131:6803/2103696562] exists,up cc5a4835-e11d-4ae2-b317-7a00e34f74a5 2023-09-13T09:39:22.637 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 up in weight 1 up_from 25 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6810/1518323952,v1:172.21.15.6:6811/1518323952] [v2:172.21.15.6:6812/1518323952,v1:172.21.15.6:6813/1518323952] exists,up b740401d-7c68-4954-9789-b811d2effbba 2023-09-13T09:39:22.637 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 up in weight 1 up_from 32 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6808/2094793371,v1:172.21.15.53:6809/2094793371] [v2:172.21.15.53:6810/2094793371,v1:172.21.15.53:6811/2094793371] exists,up 8cd56f57-462e-434f-ba13-a93b66fca25c 2023-09-13T09:39:22.637 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 up in weight 1 up_from 37 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6808/2492626170,v1:172.21.15.131:6809/2492626170] [v2:172.21.15.131:6810/2492626170,v1:172.21.15.131:6811/2492626170] exists,up ead82706-9475-49d1-9e7c-f39c498e8b42 2023-09-13T09:39:22.637 INFO:teuthology.orchestra.run.smithi006.stdout:osd.6 up in weight 1 up_from 45 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6818/830400555,v1:172.21.15.6:6819/830400555] [v2:172.21.15.6:6820/830400555,v1:172.21.15.6:6821/830400555] exists,up 6340a542-4e1e-4a78-800c-e087c081a161 2023-09-13T09:39:22.637 INFO:teuthology.orchestra.run.smithi006.stdout:osd.7 up in weight 1 up_from 50 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6816/1921263469,v1:172.21.15.53:6817/1921263469] [v2:172.21.15.53:6818/1921263469,v1:172.21.15.53:6819/1921263469] exists,up fa7b97d8-bb41-4f66-b13a-30bd0b6304b8 2023-09-13T09:39:22.638 INFO:teuthology.orchestra.run.smithi006.stdout:osd.8 up in weight 1 up_from 58 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6816/2882379120,v1:172.21.15.131:6817/2882379120] [v2:172.21.15.131:6818/2882379120,v1:172.21.15.131:6819/2882379120] exists,up 489e288d-c0f6-43f0-b2c3-38ac78ae9d97 2023-09-13T09:39:22.638 INFO:teuthology.orchestra.run.smithi006.stdout:osd.9 up in weight 1 up_from 66 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.6:6826/3414335215,v1:172.21.15.6:6827/3414335215] [v2:172.21.15.6:6828/3414335215,v1:172.21.15.6:6829/3414335215] exists,up 8ff38aca-937b-4412-8179-dd5de05c99cc 2023-09-13T09:39:22.638 INFO:teuthology.orchestra.run.smithi006.stdout:osd.10 up in weight 1 up_from 71 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.53:6824/382405178,v1:172.21.15.53:6825/382405178] [v2:172.21.15.53:6826/382405178,v1:172.21.15.53:6827/382405178] exists,up 0df1df73-c7bd-4263-8c5e-6e3b5183bd8c 2023-09-13T09:39:22.638 INFO:teuthology.orchestra.run.smithi006.stdout:osd.11 up in weight 1 up_from 79 up_thru 85 down_at 0 last_clean_interval [0,0) [v2:172.21.15.131:6824/4273429519,v1:172.21.15.131:6825/4273429519] [v2:172.21.15.131:6826/4273429519,v1:172.21.15.131:6827/4273429519] exists,up ea94feef-e76d-4855-a60a-8fdf41e23135 2023-09-13T09:39:22.639 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.a [2,11] 2023-09-13T09:39:22.639 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 2.1d [2,4] 2023-09-13T09:39:22.639 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.0 [5,9,4,8] 2023-09-13T09:39:22.639 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.1b [4,8] 2023-09-13T09:39:22.639 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.1e [3,9] 2023-09-13T09:39:22.640 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.25 [5,9] 2023-09-13T09:39:22.640 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.28 [3,6] 2023-09-13T09:39:22.640 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.31 [4,6] 2023-09-13T09:39:22.640 INFO:teuthology.orchestra.run.smithi006.stdout:pg_upmap_items 3.3a [4,7] 2023-09-13T09:39:22.640 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/1368467670 expires 2023-09-14T09:32:06.061871+0000 2023-09-13T09:39:22.641 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/1676430765 expires 2023-09-14T09:32:06.061871+0000 2023-09-13T09:39:22.641 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/4035146106 expires 2023-09-14T09:32:06.061871+0000 2023-09-13T09:39:22.641 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/788659299 expires 2023-09-14T09:31:39.439757+0000 2023-09-13T09:39:22.641 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/1844413257 expires 2023-09-14T09:31:39.439757+0000 2023-09-13T09:39:22.642 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/1602117516 expires 2023-09-14T09:31:39.439757+0000 2023-09-13T09:39:22.642 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6800/2818405814 expires 2023-09-14T09:31:39.439757+0000 2023-09-13T09:39:22.642 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/1676430765 expires 2023-09-14T09:32:06.061871+0000 2023-09-13T09:39:22.642 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:0/311769615 expires 2023-09-14T09:32:06.061871+0000 2023-09-13T09:39:22.643 INFO:teuthology.orchestra.run.smithi006.stdout:blocklist 172.21.15.6:6801/2818405814 expires 2023-09-14T09:31:39.439757+0000 2023-09-13T09:39:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61d40a06d0 msgr2=0x7f61d40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61d40a06d0 0x7f61d40a2b90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f61dc005fd0 tx=0x7f61dc005e30 comp rx=0 tx=0).stop 2023-09-13T09:39:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec104190 msgr2=0x7f61ec196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec104190 0x7f61ec196fa0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c950 tx=0x7f61e000cd10 comp rx=0 tx=0).stop 2023-09-13T09:39:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 shutdown_connections 2023-09-13T09:39:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61ec106ac0 0x7f61ec19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f61ec101860 0x7f61ec196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61d40a06d0 0x7f61d40a2b90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 --2- 172.21.15.6:0/818759484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61ec104190 0x7f61ec196fa0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.634+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 >> 172.21.15.6:0/818759484 conn(0x7f61ec0fb1d0 msgr2=0x7f61ec1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.635+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 shutdown_connections 2023-09-13T09:39:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:22.635+0000 7f61f1610700 1 -- 172.21.15.6:0/818759484 wait complete. 2023-09-13T09:39:23.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:22 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/818759484' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-13T09:39:23.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:22 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/818759484' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-13T09:39:23.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:22 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/818759484' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-09-13T09:39:23.040 INFO:teuthology.run_tasks:Running task fs.ready... 2023-09-13T09:39:23.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.278+0000 7f117bd7c700 1 -- 172.21.15.6:0/1487635909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174100e80 msgr2=0x7f11741012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.278+0000 7f117bd7c700 1 --2- 172.21.15.6:0/1487635909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174100e80 0x7f11741012e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f11640099c0 tx=0x7f1164009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.278+0000 7f117bd7c700 1 -- 172.21.15.6:0/1487635909 shutdown_connections 2023-09-13T09:39:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.278+0000 7f117bd7c700 1 --2- 172.21.15.6:0/1487635909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1174101820 0x7f11741080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.278+0000 7f117bd7c700 1 --2- 172.21.15.6:0/1487635909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11740ffc90 0x7f11741000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.278+0000 7f117bd7c700 1 --2- 172.21.15.6:0/1487635909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174100e80 0x7f11741012e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.278+0000 7f117bd7c700 1 -- 172.21.15.6:0/1487635909 >> 172.21.15.6:0/1487635909 conn(0x7f11740fb220 msgr2=0x7f11740fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 -- 172.21.15.6:0/1487635909 shutdown_connections 2023-09-13T09:39:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 -- 172.21.15.6:0/1487635909 wait complete. 2023-09-13T09:39:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 Processor -- start 2023-09-13T09:39:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 -- start start 2023-09-13T09:39:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11740ffc90 0x7f1174068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1174100e80 0x7f117419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174101820 0x7f117419de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117419e5f0 con 0x7f1174101820 2023-09-13T09:39:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117419e760 con 0x7f11740ffc90 2023-09-13T09:39:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117bd7c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f117419e920 con 0x7f1174100e80 2023-09-13T09:39:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.279+0000 7f117a319700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174101820 0x7f117419de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174101820 0x7f117419de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33312/0 (socket says 172.21.15.6:33312) 2023-09-13T09:39:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 -- 172.21.15.6:0/2264156111 learned_addr learned my addr 172.21.15.6:0/2264156111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f1179b18700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11740ffc90 0x7f1174068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f1179317700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1174100e80 0x7f117419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 -- 172.21.15.6:0/2264156111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1174100e80 msgr2=0x7f117419b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1174100e80 0x7f117419b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 -- 172.21.15.6:0/2264156111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11740ffc90 msgr2=0x7f1174068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11740ffc90 0x7f1174068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 -- 172.21.15.6:0/2264156111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11640095f0 con 0x7f1174101820 2023-09-13T09:39:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f1179317700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1174100e80 0x7f117419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f1179b18700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11740ffc90 0x7f1174068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117a319700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174101820 0x7f117419de20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f116c00b970 tx=0x7f116c00bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:23.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f116affd700 1 -- 172.21.15.6:0/2264156111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c00c9b0 con 0x7f1174101820 2023-09-13T09:39:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f117419ec00 con 0x7f1174101820 2023-09-13T09:39:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f116affd700 1 -- 172.21.15.6:0/2264156111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f116c014440 con 0x7f1174101820 2023-09-13T09:39:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f116affd700 1 -- 172.21.15.6:0/2264156111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116c0075d0 con 0x7f1174101820 2023-09-13T09:39:23.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.280+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117419f110 con 0x7f1174101820 2023-09-13T09:39:23.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.281+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1174106bc0 con 0x7f1174101820 2023-09-13T09:39:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.282+0000 7f116affd700 1 -- 172.21.15.6:0/2264156111 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f116c0145b0 con 0x7f1174101820 2023-09-13T09:39:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.283+0000 7f116affd700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11600a06d0 0x7f11600a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.283+0000 7f1179b18700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11600a06d0 0x7f11600a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.283+0000 7f116affd700 1 -- 172.21.15.6:0/2264156111 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f116c006e40 con 0x7f1174101820 2023-09-13T09:39:23.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.283+0000 7f1179b18700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11600a06d0 0x7f11600a2b90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1174100ce0 tx=0x7f1170005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:23.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.286+0000 7f116affd700 1 -- 172.21.15.6:0/2264156111 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f116c095080 con 0x7f1174101820 2023-09-13T09:39:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.491+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f117410b570 con 0x7f1174101820 2023-09-13T09:39:23.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.492+0000 7f116affd700 1 -- 172.21.15.6:0/2264156111 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22443 (secure 0 0 0) 0x7f116c0986a0 con 0x7f1174101820 2023-09-13T09:39:23.493 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:23.493 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:39:07.896691+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11600a06d0 msgr2=0x7f11600a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11600a06d0 0x7f11600a2b90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1174100ce0 tx=0x7f1170005f90 comp rx=0 tx=0).stop 2023-09-13T09:39:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174101820 msgr2=0x7f117419de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174101820 0x7f117419de20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f116c00b970 tx=0x7f116c00bd30 comp rx=0 tx=0).stop 2023-09-13T09:39:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 shutdown_connections 2023-09-13T09:39:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11600a06d0 0x7f11600a2b90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1174101820 0x7f117419de20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11740ffc90 0x7f1174068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 --2- 172.21.15.6:0/2264156111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1174100e80 0x7f117419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 >> 172.21.15.6:0/2264156111 conn(0x7f11740fb220 msgr2=0x7f11740fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 shutdown_connections 2023-09-13T09:39:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.495+0000 7f117bd7c700 1 -- 172.21.15.6:0/2264156111 wait complete. 2023-09-13T09:39:23.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:39:23.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:39:23.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 -- 172.21.15.6:0/314717911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0100cb0 msgr2=0x7f5ed01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 --2- 172.21.15.6:0/314717911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0100cb0 0x7f5ed01010d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5ec00099c0 tx=0x7f5ec0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 -- 172.21.15.6:0/314717911 shutdown_connections 2023-09-13T09:39:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 --2- 172.21.15.6:0/314717911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ed0102840 0x7f5ed01090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 --2- 172.21.15.6:0/314717911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0100cb0 0x7f5ed01010d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 --2- 172.21.15.6:0/314717911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed0101ea0 0x7f5ed0102300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 -- 172.21.15.6:0/314717911 >> 172.21.15.6:0/314717911 conn(0x7f5ed00fc240 msgr2=0x7f5ed00fe660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 -- 172.21.15.6:0/314717911 shutdown_connections 2023-09-13T09:39:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.638+0000 7f5ed733f700 1 -- 172.21.15.6:0/314717911 wait complete. 2023-09-13T09:39:23.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 Processor -- start 2023-09-13T09:39:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 -- start start 2023-09-13T09:39:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ed0100cb0 0x7f5ed0074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed0101ea0 0x7f5ed00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0102840 0x7f5ed00735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0073d80 con 0x7f5ed0102840 2023-09-13T09:39:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0073ef0 con 0x7f5ed0101ea0 2023-09-13T09:39:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed733f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed01a09d0 con 0x7f5ed0100cb0 2023-09-13T09:39:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0102840 0x7f5ed00735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0102840 0x7f5ed00735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33326/0 (socket says 172.21.15.6:33326) 2023-09-13T09:39:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 -- 172.21.15.6:0/17332043 learned_addr learned my addr 172.21.15.6:0/17332043 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed48da700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed0101ea0 0x7f5ed00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed50db700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ed0100cb0 0x7f5ed0074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 -- 172.21.15.6:0/17332043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ed0100cb0 msgr2=0x7f5ed0074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ed0100cb0 0x7f5ed0074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 -- 172.21.15.6:0/17332043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed0101ea0 msgr2=0x7f5ed00730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed0101ea0 0x7f5ed00730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.639+0000 7f5ed58dc700 1 -- 172.21.15.6:0/17332043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00095f0 con 0x7f5ed0102840 2023-09-13T09:39:23.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.640+0000 7f5ed58dc700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0102840 0x7f5ed00735e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8007d70 tx=0x7f5ec800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:23.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.640+0000 7f5ec67fc700 1 -- 172.21.15.6:0/17332043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800ad40 con 0x7f5ed0102840 2023-09-13T09:39:23.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.640+0000 7f5ec67fc700 1 -- 172.21.15.6:0/17332043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ec80128e0 con 0x7f5ed0102840 2023-09-13T09:39:23.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.640+0000 7f5ec67fc700 1 -- 172.21.15.6:0/17332043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec80116b0 con 0x7f5ed0102840 2023-09-13T09:39:23.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.640+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed01a0cb0 con 0x7f5ed0102840 2023-09-13T09:39:23.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.640+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed01a1170 con 0x7f5ed0102840 2023-09-13T09:39:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.641+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed010c510 con 0x7f5ed0102840 2023-09-13T09:39:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.642+0000 7f5ec67fc700 1 -- 172.21.15.6:0/17332043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f5ec8012420 con 0x7f5ed0102840 2023-09-13T09:39:23.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.643+0000 7f5ec67fc700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ebc0a0750 0x7f5ebc0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:23.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.643+0000 7f5ed50db700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ebc0a0750 0x7f5ebc0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:23.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.643+0000 7f5ec67fc700 1 -- 172.21.15.6:0/17332043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f5ec80cbe00 con 0x7f5ed0102840 2023-09-13T09:39:23.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.643+0000 7f5ed50db700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ebc0a0750 0x7f5ebc0a2c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009990 tx=0x7f5ec001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:23.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.647+0000 7f5ec67fc700 1 -- 172.21.15.6:0/17332043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5ec80958d0 con 0x7f5ed0102840 2023-09-13T09:39:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.850+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5ed0107b60 con 0x7f5ed0102840 2023-09-13T09:39:23.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.850+0000 7f5ec67fc700 1 -- 172.21.15.6:0/17332043 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5ec8098ef0 con 0x7f5ed0102840 2023-09-13T09:39:23.852 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:39:23.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ebc0a0750 msgr2=0x7f5ebc0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ebc0a0750 0x7f5ebc0a2c10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0009990 tx=0x7f5ec001a040 comp rx=0 tx=0).stop 2023-09-13T09:39:23.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0102840 msgr2=0x7f5ed00735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:23.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0102840 0x7f5ed00735e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5ec8007d70 tx=0x7f5ec800a340 comp rx=0 tx=0).stop 2023-09-13T09:39:23.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 shutdown_connections 2023-09-13T09:39:23.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5ebc0a0750 0x7f5ebc0a2c10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ed0102840 0x7f5ed00735e0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ed0100cb0 0x7f5ed0074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 --2- 172.21.15.6:0/17332043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ed0101ea0 0x7f5ed00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:23.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.852+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 >> 172.21.15.6:0/17332043 conn(0x7f5ed00fc240 msgr2=0x7f5ed00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:23.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.853+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 shutdown_connections 2023-09-13T09:39:23.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:23.853+0000 7f5ed733f700 1 -- 172.21.15.6:0/17332043 wait complete. 2023-09-13T09:39:23.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:23 smithi006 ceph-mon[98665]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:23.864 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:23 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2264156111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:23.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T09:39:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.002+0000 7f2ae0dda700 1 -- 172.21.15.6:0/3561153457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc0fee10 msgr2=0x7f2adc0ff270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.002+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/3561153457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc0fee10 0x7f2adc0ff270 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f2ad00099c0 tx=0x7f2ad0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.002+0000 7f2ae0dda700 1 -- 172.21.15.6:0/3561153457 shutdown_connections 2023-09-13T09:39:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.002+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/3561153457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2adc0ff7b0 0x7f2adc109380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.002+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/3561153457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2adc1023a0 0x7f2adc1027c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.002+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/3561153457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc0fee10 0x7f2adc0ff270 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.002+0000 7f2ae0dda700 1 -- 172.21.15.6:0/3561153457 >> 172.21.15.6:0/3561153457 conn(0x7f2adc0fa9b0 msgr2=0x7f2adc0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 -- 172.21.15.6:0/3561153457 shutdown_connections 2023-09-13T09:39:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 -- 172.21.15.6:0/3561153457 wait complete. 2023-09-13T09:39:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 Processor -- start 2023-09-13T09:39:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 -- start start 2023-09-13T09:39:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2adc0fee10 0x7f2adc196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2adc0ff7b0 0x7f2adc196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc1023a0 0x7f2adc19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc19e630 con 0x7f2adc1023a0 2023-09-13T09:39:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc19e770 con 0x7f2adc0fee10 2023-09-13T09:39:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.003+0000 7f2ae0dda700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2adc19e900 con 0x7f2adc0ff7b0 2023-09-13T09:39:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc1023a0 0x7f2adc19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc1023a0 0x7f2adc19e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33340/0 (socket says 172.21.15.6:33340) 2023-09-13T09:39:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 -- 172.21.15.6:0/2566624235 learned_addr learned my addr 172.21.15.6:0/2566624235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2ad9d9b700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2adc0ff7b0 0x7f2adc196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2ada59c700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2adc0fee10 0x7f2adc196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 -- 172.21.15.6:0/2566624235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2adc0ff7b0 msgr2=0x7f2adc196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:23 smithi053 ceph-mon[102373]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:24.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:23 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2264156111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2adc0ff7b0 0x7f2adc196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 -- 172.21.15.6:0/2566624235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2adc0fee10 msgr2=0x7f2adc196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2adc0fee10 0x7f2adc196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 -- 172.21.15.6:0/2566624235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad00095f0 con 0x7f2adc1023a0 2023-09-13T09:39:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2ad9d9b700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2adc0ff7b0 0x7f2adc196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2ada59c700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2adc0fee10 0x7f2adc196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2adad9d700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc1023a0 0x7f2adc19e060 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400ada0 tx=0x7f2ad400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2acb7fe700 1 -- 172.21.15.6:0/2566624235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad400f070 con 0x7f2adc1023a0 2023-09-13T09:39:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2acb7fe700 1 -- 172.21.15.6:0/2566624235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ad4007b30 con 0x7f2adc1023a0 2023-09-13T09:39:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc19ebe0 con 0x7f2adc1023a0 2023-09-13T09:39:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2acb7fe700 1 -- 172.21.15.6:0/2566624235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ad4005440 con 0x7f2adc1023a0 2023-09-13T09:39:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.004+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2adc19f0f0 con 0x7f2adc1023a0 2023-09-13T09:39:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.005+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2adc107ef0 con 0x7f2adc1023a0 2023-09-13T09:39:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.006+0000 7f2acb7fe700 1 -- 172.21.15.6:0/2566624235 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f2ad4004ad0 con 0x7f2adc1023a0 2023-09-13T09:39:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.007+0000 7f2acb7fe700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ac40a06d0 0x7f2ac40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.007+0000 7f2ada59c700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ac40a06d0 0x7f2ac40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.007+0000 7f2acb7fe700 1 -- 172.21.15.6:0/2566624235 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f2ad40cb380 con 0x7f2adc1023a0 2023-09-13T09:39:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.008+0000 7f2ada59c700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ac40a06d0 0x7f2ac40a2b90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2acc005950 tx=0x7f2acc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.012+0000 7f2acb7fe700 1 -- 172.21.15.6:0/2566624235 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2ad4094dd0 con 0x7f2adc1023a0 2023-09-13T09:39:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:23 smithi131 ceph-mon[102785]: pgmap v294: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:23 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2264156111' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.214+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2adc10c7d0 con 0x7f2adc1023a0 2023-09-13T09:39:24.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.215+0000 7f2acb7fe700 1 -- 172.21.15.6:0/2566624235 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2ad40983f0 con 0x7f2adc1023a0 2023-09-13T09:39:24.221 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T09:39:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ac40a06d0 msgr2=0x7f2ac40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ac40a06d0 0x7f2ac40a2b90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2acc005950 tx=0x7f2acc0058e0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc1023a0 msgr2=0x7f2adc19e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc1023a0 0x7f2adc19e060 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2ad400ada0 tx=0x7f2ad400c330 comp rx=0 tx=0).stop 2023-09-13T09:39:24.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 shutdown_connections 2023-09-13T09:39:24.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ac40a06d0 0x7f2ac40a2b90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2adc1023a0 0x7f2adc19e060 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2adc0fee10 0x7f2adc196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 --2- 172.21.15.6:0/2566624235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2adc0ff7b0 0x7f2adc196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 >> 172.21.15.6:0/2566624235 conn(0x7f2adc0fa9b0 msgr2=0x7f2adc0fcca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:24.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 shutdown_connections 2023-09-13T09:39:24.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.217+0000 7f2ae0dda700 1 -- 172.21.15.6:0/2566624235 wait complete. 2023-09-13T09:39:24.230 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T09:39:24.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 -- 172.21.15.6:0/2865615656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 msgr2=0x7f70cc1081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 --2- 172.21.15.6:0/2865615656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc1081e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f70c400b0a0 tx=0x7f70c400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 -- 172.21.15.6:0/2865615656 shutdown_connections 2023-09-13T09:39:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 --2- 172.21.15.6:0/2865615656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc1081e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 --2- 172.21.15.6:0/2865615656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70cc101250 0x7f70cc101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 --2- 172.21.15.6:0/2865615656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70cc0fff80 0x7f70cc1003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 -- 172.21.15.6:0/2865615656 >> 172.21.15.6:0/2865615656 conn(0x7f70cc0fa9b0 msgr2=0x7f70cc0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 -- 172.21.15.6:0/2865615656 shutdown_connections 2023-09-13T09:39:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.405+0000 7f70d1326700 1 -- 172.21.15.6:0/2865615656 wait complete. 2023-09-13T09:39:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 Processor -- start 2023-09-13T09:39:24.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 -- start start 2023-09-13T09:39:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70cc0fff80 0x7f70cc196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70cc101250 0x7f70cc19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc19e630 con 0x7f70cc100920 2023-09-13T09:39:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc19e770 con 0x7f70cc101250 2023-09-13T09:39:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70d1326700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc19e900 con 0x7f70cc0fff80 2023-09-13T09:39:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70ca7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70ca7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33352/0 (socket says 172.21.15.6:33352) 2023-09-13T09:39:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70ca7fc700 1 -- 172.21.15.6:0/3280927363 learned_addr learned my addr 172.21.15.6:0/3280927363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.406+0000 7f70caffd700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70cc0fff80 0x7f70cc196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70cb7fe700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70cc101250 0x7f70cc19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70ca7fc700 1 -- 172.21.15.6:0/3280927363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70cc0fff80 msgr2=0x7f70cc196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70ca7fc700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70cc0fff80 0x7f70cc196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70ca7fc700 1 -- 172.21.15.6:0/3280927363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70cc101250 msgr2=0x7f70cc19e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70ca7fc700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70cc101250 0x7f70cc19e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70ca7fc700 1 -- 172.21.15.6:0/3280927363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c4009d00 con 0x7f70cc100920 2023-09-13T09:39:24.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70ca7fc700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc196ff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c920 tx=0x7f70b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:24.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70c3fff700 1 -- 172.21.15.6:0/3280927363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4004a30 con 0x7f70cc100920 2023-09-13T09:39:24.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc19ebe0 con 0x7f70cc100920 2023-09-13T09:39:24.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70c3fff700 1 -- 172.21.15.6:0/3280927363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70b40054e0 con 0x7f70cc100920 2023-09-13T09:39:24.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70c3fff700 1 -- 172.21.15.6:0/3280927363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4007c10 con 0x7f70cc100920 2023-09-13T09:39:24.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.407+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc19f140 con 0x7f70cc100920 2023-09-13T09:39:24.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.408+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70cc10c640 con 0x7f70cc100920 2023-09-13T09:39:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.409+0000 7f70c3fff700 1 -- 172.21.15.6:0/3280927363 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f70b4005000 con 0x7f70cc100920 2023-09-13T09:39:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.410+0000 7f70c3fff700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70b80a06d0 0x7f70b80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.410+0000 7f70c3fff700 1 -- 172.21.15.6:0/3280927363 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f70b40cbbf0 con 0x7f70cc100920 2023-09-13T09:39:24.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.410+0000 7f70caffd700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70b80a06d0 0x7f70b80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.410+0000 7f70caffd700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70b80a06d0 0x7f70b80a2b90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70cc068f20 tx=0x7f70bc00a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.413+0000 7f70c3fff700 1 -- 172.21.15.6:0/3280927363 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f70b40955b0 con 0x7f70cc100920 2023-09-13T09:39:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.612+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f70cc106ba0 con 0x7f70cc100920 2023-09-13T09:39:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.613+0000 7f70c3fff700 1 -- 172.21.15.6:0/3280927363 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f70b401d0a0 con 0x7f70cc100920 2023-09-13T09:39:24.614 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T09:39:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70b80a06d0 msgr2=0x7f70b80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70b80a06d0 0x7f70b80a2b90 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f70cc068f20 tx=0x7f70bc00a3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 msgr2=0x7f70cc196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc196ff0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f70b400c920 tx=0x7f70b400cc30 comp rx=0 tx=0).stop 2023-09-13T09:39:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 shutdown_connections 2023-09-13T09:39:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70cc101250 0x7f70cc19e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70cc0fff80 0x7f70cc196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70b80a06d0 0x7f70b80a2b90 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 --2- 172.21.15.6:0/3280927363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc100920 0x7f70cc196ff0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 >> 172.21.15.6:0/3280927363 conn(0x7f70cc0fa9b0 msgr2=0x7f70cc0fcaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 shutdown_connections 2023-09-13T09:39:24.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.615+0000 7f70d1326700 1 -- 172.21.15.6:0/3280927363 wait complete. 2023-09-13T09:39:24.629 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:39:24.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 -- 172.21.15.6:0/3019402221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b200ffc90 msgr2=0x7f0b201000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 --2- 172.21.15.6:0/3019402221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b200ffc90 0x7f0b201000b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0b100099c0 tx=0x7f0b10009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 -- 172.21.15.6:0/3019402221 shutdown_connections 2023-09-13T09:39:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 --2- 172.21.15.6:0/3019402221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b20101820 0x7f0b201080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 --2- 172.21.15.6:0/3019402221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b200ffc90 0x7f0b201000b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 --2- 172.21.15.6:0/3019402221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b20100e80 0x7f0b201012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 -- 172.21.15.6:0/3019402221 >> 172.21.15.6:0/3019402221 conn(0x7f0b200fb220 msgr2=0x7f0b200fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 -- 172.21.15.6:0/3019402221 shutdown_connections 2023-09-13T09:39:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.759+0000 7f0b25b04700 1 -- 172.21.15.6:0/3019402221 wait complete. 2023-09-13T09:39:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 Processor -- start 2023-09-13T09:39:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 -- start start 2023-09-13T09:39:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b200ffc90 0x7f0b20195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b20100e80 0x7f0b20195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b20101820 0x7f0b2019cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2019d4d0 con 0x7f0b20101820 2023-09-13T09:39:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2019d610 con 0x7f0b200ffc90 2023-09-13T09:39:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b25b04700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b2019d7a0 con 0x7f0b20100e80 2023-09-13T09:39:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b20101820 0x7f0b2019cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b20101820 0x7f0b2019cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33368/0 (socket says 172.21.15.6:33368) 2023-09-13T09:39:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 -- 172.21.15.6:0/2030271351 learned_addr learned my addr 172.21.15.6:0/2030271351 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1effd700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b20100e80 0x7f0b20195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b200ffc90 0x7f0b20195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 -- 172.21.15.6:0/2030271351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b20100e80 msgr2=0x7f0b20195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b20100e80 0x7f0b20195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 -- 172.21.15.6:0/2030271351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b200ffc90 msgr2=0x7f0b20195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b200ffc90 0x7f0b20195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1ffff700 1 -- 172.21.15.6:0/2030271351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b100095f0 con 0x7f0b20101820 2023-09-13T09:39:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.760+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b200ffc90 0x7f0b20195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.761+0000 7f0b1ffff700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b20101820 0x7f0b2019cf00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0b18007d70 tx=0x7f0b1800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.761+0000 7f0b1cff9700 1 -- 172.21.15.6:0/2030271351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1800ad40 con 0x7f0b20101820 2023-09-13T09:39:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.761+0000 7f0b1cff9700 1 -- 172.21.15.6:0/2030271351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b180128e0 con 0x7f0b20101820 2023-09-13T09:39:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.761+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b2019da80 con 0x7f0b20101820 2023-09-13T09:39:24.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.761+0000 7f0b1cff9700 1 -- 172.21.15.6:0/2030271351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b180116b0 con 0x7f0b20101820 2023-09-13T09:39:24.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.761+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b2019df40 con 0x7f0b20101820 2023-09-13T09:39:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.762+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2010b4f0 con 0x7f0b20101820 2023-09-13T09:39:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.763+0000 7f0b1cff9700 1 -- 172.21.15.6:0/2030271351 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f0b18012420 con 0x7f0b20101820 2023-09-13T09:39:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.764+0000 7f0b1cff9700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b080a06d0 0x7f0b080a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.764+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b080a06d0 0x7f0b080a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.764+0000 7f0b1cff9700 1 -- 172.21.15.6:0/2030271351 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f0b180cc2b0 con 0x7f0b20101820 2023-09-13T09:39:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.764+0000 7f0b1f7fe700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b080a06d0 0x7f0b080a2b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009990 tx=0x7f0b1001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:24.768+0000 7f0b1cff9700 1 -- 172.21.15.6:0/2030271351 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0b18095d80 con 0x7f0b20101820 2023-09-13T09:39:25.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:24 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/17332043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:24 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2566624235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:24 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3280927363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:24 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/17332043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:24 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2566624235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:24 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3280927363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.018+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b2010b700 con 0x7f0b20101820 2023-09-13T09:39:25.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:24 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/17332043' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:24 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2566624235' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:24 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3280927363' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.019+0000 7f0b1cff9700 1 -- 172.21.15.6:0/2030271351 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f0b180993a0 con 0x7f0b20101820 2023-09-13T09:39:25.021 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:25.021 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:39:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b080a06d0 msgr2=0x7f0b080a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b080a06d0 0x7f0b080a2b90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0b10009990 tx=0x7f0b1001a040 comp rx=0 tx=0).stop 2023-09-13T09:39:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b20101820 msgr2=0x7f0b2019cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b20101820 0x7f0b2019cf00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f0b18007d70 tx=0x7f0b1800a340 comp rx=0 tx=0).stop 2023-09-13T09:39:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 shutdown_connections 2023-09-13T09:39:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b080a06d0 0x7f0b080a2b90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b20101820 0x7f0b2019cf00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b200ffc90 0x7f0b20195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 --2- 172.21.15.6:0/2030271351 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b20100e80 0x7f0b20195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 >> 172.21.15.6:0/2030271351 conn(0x7f0b200fb220 msgr2=0x7f0b200fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 shutdown_connections 2023-09-13T09:39:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.021+0000 7f0b25b04700 1 -- 172.21.15.6:0/2030271351 wait complete. 2023-09-13T09:39:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:25.035 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:25.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 -- 172.21.15.6:0/1585261820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 msgr2=0x7f96c41065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1585261820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c41065b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009990 tx=0x7f96b8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 -- 172.21.15.6:0/1585261820 shutdown_connections 2023-09-13T09:39:25.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1585261820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c4106af0 0x7f96c4108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1585261820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4101890 0x7f96c4103c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1585261820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c41065b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 -- 172.21.15.6:0/1585261820 >> 172.21.15.6:0/1585261820 conn(0x7f96c40fb220 msgr2=0x7f96c40fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:25.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 -- 172.21.15.6:0/1585261820 shutdown_connections 2023-09-13T09:39:25.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.161+0000 7f96c89a8700 1 -- 172.21.15.6:0/1585261820 wait complete. 2023-09-13T09:39:25.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 Processor -- start 2023-09-13T09:39:25.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 -- start start 2023-09-13T09:39:25.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4101890 0x7f96c4101200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c40ff840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c4106af0 0x7f96c40ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4100520 con 0x7f96c41041c0 2023-09-13T09:39:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c4100690 con 0x7f96c4101890 2023-09-13T09:39:25.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c89a8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c41a0a90 con 0x7f96c4106af0 2023-09-13T09:39:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c40ff840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c40ff840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33380/0 (socket says 172.21.15.6:33380) 2023-09-13T09:39:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 -- 172.21.15.6:0/1617858626 learned_addr learned my addr 172.21.15.6:0/1617858626 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c259c700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4101890 0x7f96c4101200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c2d9d700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c4106af0 0x7f96c40ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 -- 172.21.15.6:0/1617858626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c4106af0 msgr2=0x7f96c40ffd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c4106af0 0x7f96c40ffd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 -- 172.21.15.6:0/1617858626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4101890 msgr2=0x7f96c4101200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4101890 0x7f96c4101200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c1d9b700 1 -- 172.21.15.6:0/1617858626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b80095f0 con 0x7f96c41041c0 2023-09-13T09:39:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c2d9d700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c4106af0 0x7f96c40ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.162+0000 7f96c259c700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4101890 0x7f96c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.163+0000 7f96c1d9b700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c40ff840 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f96b80059d0 tx=0x7f96b800f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.163+0000 7f96b37fe700 1 -- 172.21.15.6:0/1617858626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b801d070 con 0x7f96c41041c0 2023-09-13T09:39:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.163+0000 7f96b37fe700 1 -- 172.21.15.6:0/1617858626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96b800fd60 con 0x7f96c41041c0 2023-09-13T09:39:25.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.163+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c41a0d10 con 0x7f96c41041c0 2023-09-13T09:39:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.163+0000 7f96b37fe700 1 -- 172.21.15.6:0/1617858626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8017650 con 0x7f96c41041c0 2023-09-13T09:39:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.163+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c41a1130 con 0x7f96c41041c0 2023-09-13T09:39:25.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.164+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c410c570 con 0x7f96c41041c0 2023-09-13T09:39:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.165+0000 7f96b37fe700 1 -- 172.21.15.6:0/1617858626 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f96b80177b0 con 0x7f96c41041c0 2023-09-13T09:39:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.165+0000 7f96b37fe700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a06d0 0x7f96ac0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.166+0000 7f96c259c700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a06d0 0x7f96ac0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.166+0000 7f96b37fe700 1 -- 172.21.15.6:0/1617858626 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f96b80cd2e0 con 0x7f96c41041c0 2023-09-13T09:39:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.166+0000 7f96c259c700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a06d0 0x7f96ac0a2b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009be0 tx=0x7f96b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:25.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.170+0000 7f96b37fe700 1 -- 172.21.15.6:0/1617858626 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f96b805ce10 con 0x7f96c41041c0 2023-09-13T09:39:25.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.371+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96c41a12c0 con 0x7f96c41041c0 2023-09-13T09:39:25.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.373+0000 7f96b37fe700 1 -- 172.21.15.6:0/1617858626 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22443 (secure 0 0 0) 0x7f96b8096d30 con 0x7f96c41041c0 2023-09-13T09:39:25.373 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:25.373 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:39:07.896691+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:25.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.374+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a06d0 msgr2=0x7f96ac0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.374+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a06d0 0x7f96ac0a2b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009be0 tx=0x7f96b4009260 comp rx=0 tx=0).stop 2023-09-13T09:39:25.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 msgr2=0x7f96c40ff840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c40ff840 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f96b80059d0 tx=0x7f96b800f510 comp rx=0 tx=0).stop 2023-09-13T09:39:25.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 shutdown_connections 2023-09-13T09:39:25.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c4106af0 0x7f96c40ffd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c4101890 0x7f96c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a06d0 0x7f96ac0a2b90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 --2- 172.21.15.6:0/1617858626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c41041c0 0x7f96c40ff840 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 >> 172.21.15.6:0/1617858626 conn(0x7f96c40fb220 msgr2=0x7f96c4102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:25.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 shutdown_connections 2023-09-13T09:39:25.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.375+0000 7f96c89a8700 1 -- 172.21.15.6:0/1617858626 wait complete. 2023-09-13T09:39:25.387 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:39:25.389 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:39:25.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 -- 172.21.15.6:0/1075442273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 msgr2=0x7f58c0108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1075442273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c0108100 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f58b800b0d0 tx=0x7f58b800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 -- 172.21.15.6:0/1075442273 shutdown_connections 2023-09-13T09:39:25.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1075442273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c0108100 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1075442273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58c00ffcc0 0x7f58c01000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1075442273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c0100eb0 0x7f58c0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 -- 172.21.15.6:0/1075442273 >> 172.21.15.6:0/1075442273 conn(0x7f58c00fb250 msgr2=0x7f58c00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:25.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 -- 172.21.15.6:0/1075442273 shutdown_connections 2023-09-13T09:39:25.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.518+0000 7f58c4f60700 1 -- 172.21.15.6:0/1075442273 wait complete. 2023-09-13T09:39:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 Processor -- start 2023-09-13T09:39:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 -- start start 2023-09-13T09:39:25.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c00ffcc0 0x7f58c0068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58c0100eb0 0x7f58c019b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c019dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c019e6b0 con 0x7f58c0101850 2023-09-13T09:39:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c019e820 con 0x7f58c0100eb0 2023-09-13T09:39:25.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58c4f60700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c019e9e0 con 0x7f58c00ffcc0 2023-09-13T09:39:25.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c019dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c019dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33394/0 (socket says 172.21.15.6:33394) 2023-09-13T09:39:25.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58bed9d700 1 -- 172.21.15.6:0/1366380843 learned_addr learned my addr 172.21.15.6:0/1366380843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:25.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58be59c700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c00ffcc0 0x7f58c0068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58bdd9b700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58c0100eb0 0x7f58c019b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58bed9d700 1 -- 172.21.15.6:0/1366380843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c00ffcc0 msgr2=0x7f58c0068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.519+0000 7f58bed9d700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c00ffcc0 0x7f58c0068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58bed9d700 1 -- 172.21.15.6:0/1366380843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58c0100eb0 msgr2=0x7f58c019b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58bed9d700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58c0100eb0 0x7f58c019b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58bed9d700 1 -- 172.21.15.6:0/1366380843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b8009d00 con 0x7f58c0101850 2023-09-13T09:39:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58bdd9b700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58c0100eb0 0x7f58c019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58bed9d700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c019dee0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f58b8007a00 tx=0x7f58b80094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58af7fe700 1 -- 172.21.15.6:0/1366380843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b800e040 con 0x7f58c0101850 2023-09-13T09:39:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58af7fe700 1 -- 172.21.15.6:0/1366380843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58b8003e10 con 0x7f58c0101850 2023-09-13T09:39:25.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c019ec60 con 0x7f58c0101850 2023-09-13T09:39:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58af7fe700 1 -- 172.21.15.6:0/1366380843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b8012a90 con 0x7f58c0101850 2023-09-13T09:39:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.520+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c019f0e0 con 0x7f58c0101850 2023-09-13T09:39:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.521+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c0106b50 con 0x7f58c0101850 2023-09-13T09:39:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.522+0000 7f58af7fe700 1 -- 172.21.15.6:0/1366380843 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f58b80056c0 con 0x7f58c0101850 2023-09-13T09:39:25.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.522+0000 7f58af7fe700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58a80a0750 0x7f58a80a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.523+0000 7f58be59c700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58a80a0750 0x7f58a80a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.523+0000 7f58af7fe700 1 -- 172.21.15.6:0/1366380843 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f58b80cd3d0 con 0x7f58c0101850 2023-09-13T09:39:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.523+0000 7f58be59c700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58a80a0750 0x7f58a80a2c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58c0100d10 tx=0x7f58b400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:25.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.527+0000 7f58af7fe700 1 -- 172.21.15.6:0/1366380843 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f58b8096dc0 con 0x7f58c0101850 2023-09-13T09:39:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.730+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f58c010b740 con 0x7f58c0101850 2023-09-13T09:39:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.731+0000 7f58af7fe700 1 -- 172.21.15.6:0/1366380843 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f58b809a3e0 con 0x7f58c0101850 2023-09-13T09:39:25.731 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:39:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58a80a0750 msgr2=0x7f58a80a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58a80a0750 0x7f58a80a2c10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f58c0100d10 tx=0x7f58b400b410 comp rx=0 tx=0).stop 2023-09-13T09:39:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 msgr2=0x7f58c019dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c019dee0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f58b8007a00 tx=0x7f58b80094c0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 shutdown_connections 2023-09-13T09:39:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58a80a0750 0x7f58a80a2c10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f58c0101850 0x7f58c019dee0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58c00ffcc0 0x7f58c0068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 --2- 172.21.15.6:0/1366380843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58c0100eb0 0x7f58c019b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 >> 172.21.15.6:0/1366380843 conn(0x7f58c00fb250 msgr2=0x7f58c00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 shutdown_connections 2023-09-13T09:39:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.733+0000 7f58c4f60700 1 -- 172.21.15.6:0/1366380843 wait complete. 2023-09-13T09:39:25.746 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T09:39:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 -- 172.21.15.6:0/2971031201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c0ffcc0 msgr2=0x7fb02c1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 --2- 172.21.15.6:0/2971031201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c0ffcc0 0x7fb02c1000e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0099c0 tx=0x7fb01c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 -- 172.21.15.6:0/2971031201 shutdown_connections 2023-09-13T09:39:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 --2- 172.21.15.6:0/2971031201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb02c101850 0x7fb02c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 --2- 172.21.15.6:0/2971031201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c0ffcc0 0x7fb02c1000e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 --2- 172.21.15.6:0/2971031201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02c100eb0 0x7fb02c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 -- 172.21.15.6:0/2971031201 >> 172.21.15.6:0/2971031201 conn(0x7fb02c0fb250 msgr2=0x7fb02c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:25.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 -- 172.21.15.6:0/2971031201 shutdown_connections 2023-09-13T09:39:25.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 -- 172.21.15.6:0/2971031201 wait complete. 2023-09-13T09:39:25.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.875+0000 7fb030976700 1 Processor -- start 2023-09-13T09:39:25.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb030976700 1 -- start start 2023-09-13T09:39:25.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb030976700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02c0ffcc0 0x7fb02c195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb030976700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c100eb0 0x7fb02c195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb030976700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb02c101850 0x7fb02c19cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb030976700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c19d4d0 con 0x7fb02c100eb0 2023-09-13T09:39:25.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb030976700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c19d610 con 0x7fb02c0ffcc0 2023-09-13T09:39:25.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb030976700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb02c19d7a0 con 0x7fb02c101850 2023-09-13T09:39:25.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c100eb0 0x7fb02c195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c100eb0 0x7fb02c195e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33406/0 (socket says 172.21.15.6:33406) 2023-09-13T09:39:25.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 -- 172.21.15.6:0/1339659450 learned_addr learned my addr 172.21.15.6:0/1339659450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:25.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb02a59c700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02c0ffcc0 0x7fb02c195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb02ad9d700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb02c101850 0x7fb02c19cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 -- 172.21.15.6:0/1339659450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb02c101850 msgr2=0x7fb02c19cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb02c101850 0x7fb02c19cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 -- 172.21.15.6:0/1339659450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02c0ffcc0 msgr2=0x7fb02c195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:25.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02c0ffcc0 0x7fb02c195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:25.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 -- 172.21.15.6:0/1339659450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c0095f0 con 0x7fb02c100eb0 2023-09-13T09:39:25.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.876+0000 7fb029d9b700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c100eb0 0x7fb02c195e90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb02000d950 tx=0x7fb02000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:25.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.877+0000 7fb01b7fe700 1 -- 172.21.15.6:0/1339659450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000f890 con 0x7fb02c100eb0 2023-09-13T09:39:25.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.877+0000 7fb01b7fe700 1 -- 172.21.15.6:0/1339659450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb020010460 con 0x7fb02c100eb0 2023-09-13T09:39:25.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.877+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c19da80 con 0x7fb02c100eb0 2023-09-13T09:39:25.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.877+0000 7fb01b7fe700 1 -- 172.21.15.6:0/1339659450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000e610 con 0x7fb02c100eb0 2023-09-13T09:39:25.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.877+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb02c19dfe0 con 0x7fb02c100eb0 2023-09-13T09:39:25.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.878+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb02c107200 con 0x7fb02c100eb0 2023-09-13T09:39:25.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.879+0000 7fb01b7fe700 1 -- 172.21.15.6:0/1339659450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fb0200108d0 con 0x7fb02c100eb0 2023-09-13T09:39:25.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.879+0000 7fb01b7fe700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0140a0750 0x7fb0140a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:25.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.879+0000 7fb02a59c700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0140a0750 0x7fb0140a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:25.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.879+0000 7fb01b7fe700 1 -- 172.21.15.6:0/1339659450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fb0200cbab0 con 0x7fb02c100eb0 2023-09-13T09:39:25.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.880+0000 7fb02a59c700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0140a0750 0x7fb0140a2c10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009f50 tx=0x7fb01c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:25.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:25.883+0000 7fb01b7fe700 1 -- 172.21.15.6:0/1339659450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb020095470 con 0x7fb02c100eb0 2023-09-13T09:39:26.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:25 smithi006 ceph-mon[98665]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:26.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:25 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2030271351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:26.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:25 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1617858626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:26.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:25 smithi053 ceph-mon[102373]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:26.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:25 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2030271351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:26.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:25 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1617858626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:25 smithi131 ceph-mon[102785]: pgmap v295: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2023-09-13T09:39:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:25 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2030271351' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:25 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1617858626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.086+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb02c10b6e0 con 0x7fb02c100eb0 2023-09-13T09:39:26.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.086+0000 7fb01b7fe700 1 -- 172.21.15.6:0/1339659450 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb0200160a0 con 0x7fb02c100eb0 2023-09-13T09:39:26.087 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T09:39:26.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0140a0750 msgr2=0x7fb0140a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0140a0750 0x7fb0140a2c10 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb01c009f50 tx=0x7fb01c00b540 comp rx=0 tx=0).stop 2023-09-13T09:39:26.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c100eb0 msgr2=0x7fb02c195e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c100eb0 0x7fb02c195e90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb02000d950 tx=0x7fb02000dc60 comp rx=0 tx=0).stop 2023-09-13T09:39:26.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 shutdown_connections 2023-09-13T09:39:26.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb02c101850 0x7fb02c19cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb02c0ffcc0 0x7fb02c195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0140a0750 0x7fb0140a2c10 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 --2- 172.21.15.6:0/1339659450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb02c100eb0 0x7fb02c195e90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 >> 172.21.15.6:0/1339659450 conn(0x7fb02c0fb250 msgr2=0x7fb02c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 shutdown_connections 2023-09-13T09:39:26.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.088+0000 7fb030976700 1 -- 172.21.15.6:0/1339659450 wait complete. 2023-09-13T09:39:26.101 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T09:39:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 -- 172.21.15.6:0/4213487415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad81023f0 msgr2=0x7ffad8102810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 --2- 172.21.15.6:0/4213487415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad81023f0 0x7ffad8102810 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009990 tx=0x7ffac8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 -- 172.21.15.6:0/4213487415 shutdown_connections 2023-09-13T09:39:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 --2- 172.21.15.6:0/4213487415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffad80ff800 0x7ffad81093d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 --2- 172.21.15.6:0/4213487415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad81023f0 0x7ffad8102810 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 --2- 172.21.15.6:0/4213487415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffad80fee60 0x7ffad80ff2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 -- 172.21.15.6:0/4213487415 >> 172.21.15.6:0/4213487415 conn(0x7ffad80fa9a0 msgr2=0x7ffad80fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:26.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 -- 172.21.15.6:0/4213487415 shutdown_connections 2023-09-13T09:39:26.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.231+0000 7ffadce2f700 1 -- 172.21.15.6:0/4213487415 wait complete. 2023-09-13T09:39:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 Processor -- start 2023-09-13T09:39:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 -- start start 2023-09-13T09:39:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffad80fee60 0x7ffad8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad80ff800 0x7ffad81970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffad81023f0 0x7ffad819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad819e6f0 con 0x7ffad80ff800 2023-09-13T09:39:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad819e830 con 0x7ffad80fee60 2023-09-13T09:39:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffadce2f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad819e9c0 con 0x7ffad81023f0 2023-09-13T09:39:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad80ff800 0x7ffad81970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad80ff800 0x7ffad81970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33420/0 (socket says 172.21.15.6:33420) 2023-09-13T09:39:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 -- 172.21.15.6:0/3717187042 learned_addr learned my addr 172.21.15.6:0/3717187042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad659c700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffad80fee60 0x7ffad8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad6d9d700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffad81023f0 0x7ffad819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 -- 172.21.15.6:0/3717187042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffad81023f0 msgr2=0x7ffad819e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffad81023f0 0x7ffad819e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 -- 172.21.15.6:0/3717187042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffad80fee60 msgr2=0x7ffad8196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffad80fee60 0x7ffad8196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad5d9b700 1 -- 172.21.15.6:0/3717187042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80095f0 con 0x7ffad80ff800 2023-09-13T09:39:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.232+0000 7ffad6d9d700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffad81023f0 0x7ffad819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.233+0000 7ffad5d9b700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad80ff800 0x7ffad81970b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00b530 tx=0x7ffacc00b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.233+0000 7ffac77fe700 1 -- 172.21.15.6:0/3717187042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc011830 con 0x7ffad80ff800 2023-09-13T09:39:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.233+0000 7ffac77fe700 1 -- 172.21.15.6:0/3717187042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffacc011e50 con 0x7ffad80ff800 2023-09-13T09:39:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.233+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad819eca0 con 0x7ffad80ff800 2023-09-13T09:39:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.233+0000 7ffac77fe700 1 -- 172.21.15.6:0/3717187042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc00f2e0 con 0x7ffad80ff800 2023-09-13T09:39:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.233+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad819f1b0 con 0x7ffad80ff800 2023-09-13T09:39:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.234+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad810c6c0 con 0x7ffad80ff800 2023-09-13T09:39:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.235+0000 7ffac77fe700 1 -- 172.21.15.6:0/3717187042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7ffacc010580 con 0x7ffad80ff800 2023-09-13T09:39:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.235+0000 7ffac77fe700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffac00a06d0 0x7ffac00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.236+0000 7ffad659c700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffac00a06d0 0x7ffac00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.236+0000 7ffac77fe700 1 -- 172.21.15.6:0/3717187042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7ffacc0cbd10 con 0x7ffad80ff800 2023-09-13T09:39:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.236+0000 7ffad659c700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffac00a06d0 0x7ffac00a2b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006010 tx=0x7ffac800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.239+0000 7ffac77fe700 1 -- 172.21.15.6:0/3717187042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ffacc0957e0 con 0x7ffad80ff800 2023-09-13T09:39:26.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.439+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffad8107e90 con 0x7ffad80ff800 2023-09-13T09:39:26.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.439+0000 7ffac77fe700 1 -- 172.21.15.6:0/3717187042 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffacc098e00 con 0x7ffad80ff800 2023-09-13T09:39:26.440 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T09:39:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffac00a06d0 msgr2=0x7ffac00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffac00a06d0 0x7ffac00a2b90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ffac8006010 tx=0x7ffac800b540 comp rx=0 tx=0).stop 2023-09-13T09:39:26.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad80ff800 msgr2=0x7ffad81970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad80ff800 0x7ffad81970b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ffacc00b530 tx=0x7ffacc00b8f0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 shutdown_connections 2023-09-13T09:39:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffad81023f0 0x7ffad819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffad80fee60 0x7ffad8196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffac00a06d0 0x7ffac00a2b90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 --2- 172.21.15.6:0/3717187042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad80ff800 0x7ffad81970b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 >> 172.21.15.6:0/3717187042 conn(0x7ffad80fa9a0 msgr2=0x7ffad80fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 shutdown_connections 2023-09-13T09:39:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.442+0000 7ffadce2f700 1 -- 172.21.15.6:0/3717187042 wait complete. 2023-09-13T09:39:26.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:39:26.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.579+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/2329200107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 msgr2=0x7fa3c41000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.579+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/2329200107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c41000e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40099c0 tx=0x7fa3b4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/2329200107 shutdown_connections 2023-09-13T09:39:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/2329200107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c4101850 0x7fa3c4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/2329200107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c41000e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/2329200107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4100eb0 0x7fa3c4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/2329200107 >> 172.21.15.6:0/2329200107 conn(0x7fa3c40fb250 msgr2=0x7fa3c40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:26.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/2329200107 shutdown_connections 2023-09-13T09:39:26.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/2329200107 wait complete. 2023-09-13T09:39:26.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 Processor -- start 2023-09-13T09:39:26.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.580+0000 7fa3c8bf7700 1 -- start start 2023-09-13T09:39:26.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c40698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c4100eb0 0x7fa3c419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4101850 0x7fa3c41a0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41a0810 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41a0980 con 0x7fa3c4101850 2023-09-13T09:39:26.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c41a0b40 con 0x7fa3c4100eb0 2023-09-13T09:39:26.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c40698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c40698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33432/0 (socket says 172.21.15.6:33432) 2023-09-13T09:39:26.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 -- 172.21.15.6:0/1611445200 learned_addr learned my addr 172.21.15.6:0/1611445200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:26.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c1d9b700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c4100eb0 0x7fa3c419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 -- 172.21.15.6:0/1611445200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c4100eb0 msgr2=0x7fa3c419dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c2d9d700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4101850 0x7fa3c41a0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c4100eb0 0x7fa3c419dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 -- 172.21.15.6:0/1611445200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4101850 msgr2=0x7fa3c41a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4101850 0x7fa3c41a0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 -- 172.21.15.6:0/1611445200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b40095f0 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c1d9b700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c4100eb0 0x7fa3c419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:26.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c259c700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c40698e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40036f0 tx=0x7fa3b4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3b37fe700 1 -- 172.21.15.6:0/1611445200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b401d070 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3b37fe700 1 -- 172.21.15.6:0/1611445200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa3b4004110 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c41a0dc0 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3b37fe700 1 -- 172.21.15.6:0/1611445200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b4021410 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.581+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c41a1190 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.582+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c4107280 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.583+0000 7fa3b37fe700 1 -- 172.21.15.6:0/1611445200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fa3b400f660 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.584+0000 7fa3b37fe700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa3ac0a06d0 0x7fa3ac0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.584+0000 7fa3c1d9b700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa3ac0a06d0 0x7fa3ac0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.584+0000 7fa3b37fe700 1 -- 172.21.15.6:0/1611445200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fa3b40ccd90 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.584+0000 7fa3c1d9b700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa3ac0a06d0 0x7fa3ac0a2b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8005fd0 tx=0x7fa3b8005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:26.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.588+0000 7fa3b37fe700 1 -- 172.21.15.6:0/1611445200 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa3b4096780 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.838+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3c410b520 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.839+0000 7fa3b37fe700 1 -- 172.21.15.6:0/1611445200 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fa3b4099da0 con 0x7fa3c40ffcc0 2023-09-13T09:39:26.839 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:26.839 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:39:26.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa3ac0a06d0 msgr2=0x7fa3ac0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa3ac0a06d0 0x7fa3ac0a2b90 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8005fd0 tx=0x7fa3b8005ee0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 msgr2=0x7fa3c40698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c40698e0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa3b40036f0 tx=0x7fa3b4009580 comp rx=0 tx=0).stop 2023-09-13T09:39:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 shutdown_connections 2023-09-13T09:39:26.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa3c4101850 0x7fa3c41a0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa3ac0a06d0 0x7fa3ac0a2b90 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3c40ffcc0 0x7fa3c40698e0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 --2- 172.21.15.6:0/1611445200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3c4100eb0 0x7fa3c419dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 >> 172.21.15.6:0/1611445200 conn(0x7fa3c40fb250 msgr2=0x7fa3c41043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 shutdown_connections 2023-09-13T09:39:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.841+0000 7fa3c8bf7700 1 -- 172.21.15.6:0/1611445200 wait complete. 2023-09-13T09:39:26.844 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:26.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:26.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.981+0000 7f5090094700 1 -- 172.21.15.6:0/1163013358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088100e80 msgr2=0x7f50881012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.981+0000 7f5090094700 1 --2- 172.21.15.6:0/1163013358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088100e80 0x7f50881012e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f50780099c0 tx=0x7f5078009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- 172.21.15.6:0/1163013358 shutdown_connections 2023-09-13T09:39:26.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 --2- 172.21.15.6:0/1163013358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5088101820 0x7f50881080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 --2- 172.21.15.6:0/1163013358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50880ffc90 0x7f50881000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 --2- 172.21.15.6:0/1163013358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088100e80 0x7f50881012e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- 172.21.15.6:0/1163013358 >> 172.21.15.6:0/1163013358 conn(0x7f50880fb220 msgr2=0x7f50880fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- 172.21.15.6:0/1163013358 shutdown_connections 2023-09-13T09:39:26.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- 172.21.15.6:0/1163013358 wait complete. 2023-09-13T09:39:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 Processor -- start 2023-09-13T09:39:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- start start 2023-09-13T09:39:26.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50880ffc90 0x7f5088196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5088100e80 0x7f5088197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088101820 0x7f508819e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508819e680 con 0x7f5088101820 2023-09-13T09:39:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508819e7c0 con 0x7f50880ffc90 2023-09-13T09:39:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.982+0000 7f5090094700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f508819e950 con 0x7f5088100e80 2023-09-13T09:39:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088101820 0x7f508819e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088101820 0x7f508819e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33450/0 (socket says 172.21.15.6:33450) 2023-09-13T09:39:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 -- 172.21.15.6:0/3339520892 learned_addr learned my addr 172.21.15.6:0/3339520892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508d62f700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5088100e80 0x7f5088197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508de30700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50880ffc90 0x7f5088196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 -- 172.21.15.6:0/3339520892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5088100e80 msgr2=0x7f5088197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5088100e80 0x7f5088197040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 -- 172.21.15.6:0/3339520892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50880ffc90 msgr2=0x7f5088196b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:26.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50880ffc90 0x7f5088196b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:26.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 -- 172.21.15.6:0/3339520892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780095f0 con 0x7f5088101820 2023-09-13T09:39:26.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508d62f700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5088100e80 0x7f5088197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:26.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f508e631700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088101820 0x7f508819e0b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5080007d70 tx=0x7f508000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:26.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f507effd700 1 -- 172.21.15.6:0/3339520892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f508000ad40 con 0x7f5088101820 2023-09-13T09:39:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f507effd700 1 -- 172.21.15.6:0/3339520892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50800128e0 con 0x7f5088101820 2023-09-13T09:39:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f508819ec30 con 0x7f5088101820 2023-09-13T09:39:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f507effd700 1 -- 172.21.15.6:0/3339520892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5080011780 con 0x7f5088101820 2023-09-13T09:39:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.983+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f508819f140 con 0x7f5088101820 2023-09-13T09:39:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.984+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5088107dc0 con 0x7f5088101820 2023-09-13T09:39:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.986+0000 7f507effd700 1 -- 172.21.15.6:0/3339520892 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f5080012a50 con 0x7f5088101820 2023-09-13T09:39:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.986+0000 7f507effd700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50740a0750 0x7f50740a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.987+0000 7f508de30700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50740a0750 0x7f50740a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.987+0000 7f507effd700 1 -- 172.21.15.6:0/3339520892 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f50800cc390 con 0x7f5088101820 2023-09-13T09:39:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.987+0000 7f508de30700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50740a0750 0x7f50740a2c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5084006fd0 tx=0x7f5084008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:26.990+0000 7f507effd700 1 -- 172.21.15.6:0/3339520892 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5080095e00 con 0x7f5088101820 2023-09-13T09:39:27.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1366380843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1339659450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3717187042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1366380843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1339659450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3717187042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1366380843' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1339659450' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3717187042' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:27.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.193+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f508810b590 con 0x7f5088101820 2023-09-13T09:39:27.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.195+0000 7f507effd700 1 -- 172.21.15.6:0/3339520892 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22443 (secure 0 0 0) 0x7f5080016020 con 0x7f5088101820 2023-09-13T09:39:27.200 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:27.200 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:39:07.896691+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:27.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50740a0750 msgr2=0x7f50740a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50740a0750 0x7f50740a2c10 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5084006fd0 tx=0x7f5084008040 comp rx=0 tx=0).stop 2023-09-13T09:39:27.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088101820 msgr2=0x7f508819e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088101820 0x7f508819e0b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5080007d70 tx=0x7f508000a340 comp rx=0 tx=0).stop 2023-09-13T09:39:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 shutdown_connections 2023-09-13T09:39:27.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50740a0750 0x7f50740a2c10 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5088101820 0x7f508819e0b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50880ffc90 0x7f5088196b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 --2- 172.21.15.6:0/3339520892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5088100e80 0x7f5088197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 >> 172.21.15.6:0/3339520892 conn(0x7f50880fb220 msgr2=0x7f50880fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 shutdown_connections 2023-09-13T09:39:27.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.197+0000 7f5090094700 1 -- 172.21.15.6:0/3339520892 wait complete. 2023-09-13T09:39:27.212 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-09-13T09:38:09.116270+0000', 'modified': '2023-09-13T09:38:16.673454+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24521, 'mds_1': 24484, 'mds_2': 24482, 'mds_3': 24466, 'mds_4': 24455}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14634': {'gid': 14634, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6839/565321366', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6838', 'nonce': 565321366}, {'type': 'v1', 'addr': '172.21.15.6:6839', 'nonce': 565321366}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14646': {'gid': 14646, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.6:6841/1420340613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.6:6840', 'nonce': 1420340613}, {'type': 'v1', 'addr': '172.21.15.6:6841', 'nonce': 1420340613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24412': {'gid': 24412, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6833/4209861668', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6832', 'nonce': 4209861668}, {'type': 'v1', 'addr': '172.21.15.131:6833', 'nonce': 4209861668}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24428': {'gid': 24428, 'name': 'k', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.53:6833/162812581', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6832', 'nonce': 162812581}, {'type': 'v1', 'addr': '172.21.15.53:6833', 'nonce': 162812581}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24454': {'gid': 24454, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.131:6835/487237413', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6834', 'nonce': 487237413}, {'type': 'v1', 'addr': '172.21.15.131:6835', 'nonce': 487237413}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24455': {'gid': 24455, 'name': 'e', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.53:6835/460375736', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6834', 'nonce': 460375736}, {'type': 'v1', 'addr': '172.21.15.53:6835', 'nonce': 460375736}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24466': {'gid': 24466, 'name': 'c', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.131:6837/687345485', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6836', 'nonce': 687345485}, {'type': 'v1', 'addr': '172.21.15.131:6837', 'nonce': 687345485}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24482': {'gid': 24482, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.53:6837/1211463882', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6836', 'nonce': 1211463882}, {'type': 'v1', 'addr': '172.21.15.53:6837', 'nonce': 1211463882}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24484': {'gid': 24484, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.131:6839/381550019', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.131:6838', 'nonce': 381550019}, {'type': 'v1', 'addr': '172.21.15.131:6839', 'nonce': 381550019}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24521': {'gid': 24521, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.53:6839/1050659050', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.53:6838', 'nonce': 1050659050}, {'type': 'v1', 'addr': '172.21.15.53:6839', 'nonce': 1050659050}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-13T09:39:27.213 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-09-13T09:39:27.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-09-13T09:39:27.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.340+0000 7f227b19e700 1 -- 172.21.15.6:0/465763038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274102910 msgr2=0x7f22741091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.340+0000 7f227b19e700 1 --2- 172.21.15.6:0/465763038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274102910 0x7f22741091c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f226c00b0d0 tx=0x7f226c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.340+0000 7f227b19e700 1 -- 172.21.15.6:0/465763038 shutdown_connections 2023-09-13T09:39:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.340+0000 7f227b19e700 1 --2- 172.21.15.6:0/465763038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274102910 0x7f22741091c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.340+0000 7f227b19e700 1 --2- 172.21.15.6:0/465763038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2274100d80 0x7f22741011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.340+0000 7f227b19e700 1 --2- 172.21.15.6:0/465763038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2274101f70 0x7f22741023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.340+0000 7f227b19e700 1 -- 172.21.15.6:0/465763038 >> 172.21.15.6:0/465763038 conn(0x7f22740fc310 msgr2=0x7f22740fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 -- 172.21.15.6:0/465763038 shutdown_connections 2023-09-13T09:39:27.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 -- 172.21.15.6:0/465763038 wait complete. 2023-09-13T09:39:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 Processor -- start 2023-09-13T09:39:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 -- start start 2023-09-13T09:39:27.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2274100d80 0x7f2274074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274101f70 0x7f22740730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2274102910 0x7f22740735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274073d80 con 0x7f2274101f70 2023-09-13T09:39:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274073ef0 con 0x7f2274100d80 2023-09-13T09:39:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f227b19e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22741a0bf0 con 0x7f2274102910 2023-09-13T09:39:27.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f2273fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274101f70 0x7f22740730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f2273fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274101f70 0x7f22740730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33462/0 (socket says 172.21.15.6:33462) 2023-09-13T09:39:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.341+0000 7f2273fff700 1 -- 172.21.15.6:0/3423259899 learned_addr learned my addr 172.21.15.6:0/3423259899 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2274100d80 0x7f2274074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f227973b700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2274102910 0x7f22740735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2273fff700 1 -- 172.21.15.6:0/3423259899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2274102910 msgr2=0x7f22740735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2273fff700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2274102910 0x7f22740735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2273fff700 1 -- 172.21.15.6:0/3423259899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2274100d80 msgr2=0x7f2274074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2273fff700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2274100d80 0x7f2274074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2273fff700 1 -- 172.21.15.6:0/3423259899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226c009d00 con 0x7f2274101f70 2023-09-13T09:39:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f227973b700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2274102910 0x7f22740735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2274100d80 0x7f2274074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2273fff700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274101f70 0x7f22740730a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f226800d950 tx=0x7f226800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2271ffb700 1 -- 172.21.15.6:0/3423259899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268009b40 con 0x7f2274101f70 2023-09-13T09:39:27.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2271ffb700 1 -- 172.21.15.6:0/3423259899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2268009ca0 con 0x7f2274101f70 2023-09-13T09:39:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22741a0ed0 con 0x7f2274101f70 2023-09-13T09:39:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f2271ffb700 1 -- 172.21.15.6:0/3423259899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226800f620 con 0x7f2274101f70 2023-09-13T09:39:27.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.342+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22741a1350 con 0x7f2274101f70 2023-09-13T09:39:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.344+0000 7f2271ffb700 1 -- 172.21.15.6:0/3423259899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f2268010460 con 0x7f2274101f70 2023-09-13T09:39:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.345+0000 7f2271ffb700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f225c0a06d0 0x7f225c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.345+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f225c0a06d0 0x7f225c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.345+0000 7f2271ffb700 1 -- 172.21.15.6:0/3423259899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f22680cc110 con 0x7f2274101f70 2023-09-13T09:39:27.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f225c0a06d0 0x7f225c0a2b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2264005fd0 tx=0x7f2264005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 Processor -- start 2023-09-13T09:39:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 -- start start 2023-09-13T09:39:27.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0e9f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0df8730 con 0x55cbe0ea1010 2023-09-13T09:39:27.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0df6050 con 0x55cbe0ea06b0 2023-09-13T09:39:27.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2287383b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0df1940 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2273fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0e9f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2273fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0e9f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33470/0 (socket says 172.21.15.6:33470) 2023-09-13T09:39:27.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.346+0000 7f2273fff700 1 -- 172.21.15.6:0/3116531013 learned_addr learned my addr 172.21.15.6:0/3116531013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f227973b700 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2273fff700 1 -- 172.21.15.6:0/3116531013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 msgr2=0x55cbe0e9fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2273fff700 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2273fff700 1 -- 172.21.15.6:0/3116531013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea06b0 msgr2=0x55cbe0ea0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2273fff700 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2273fff700 1 -- 172.21.15.6:0/3116531013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbe0c715e0 con 0x55cbe0ea1010 2023-09-13T09:39:27.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f2273fff700 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0e9f470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2268000c00 tx=0x7f22680990f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a27e4a3f98a6d13 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f225affd700 1 -- 172.21.15.6:0/3116531013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268099790 con 0x55cbe0ea1010 2023-09-13T09:39:27.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f225affd700 1 -- 172.21.15.6:0/3116531013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f226809d5c0 con 0x55cbe0ea1010 2023-09-13T09:39:27.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.347+0000 7f225affd700 1 -- 172.21.15.6:0/3116531013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268099bf0 con 0x55cbe0ea1010 2023-09-13T09:39:27.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 -- 172.21.15.6:0/3116531013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 msgr2=0x55cbe0e9f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0e9f470 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f2268000c00 tx=0x7f22680990f0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 -- 172.21.15.6:0/3116531013 shutdown_connections 2023-09-13T09:39:27.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 --2- 172.21.15.6:0/3116531013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0e9f470 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 -- 172.21.15.6:0/3116531013 >> 172.21.15.6:0/3116531013 conn(0x55cbe0dfdc30 msgr2=0x55cbe0e99ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 -- 172.21.15.6:0/3116531013 shutdown_connections 2023-09-13T09:39:27.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 -- 172.21.15.6:0/3116531013 wait complete. 2023-09-13T09:39:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 -- start start 2023-09-13T09:39:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.348+0000 7f2287383b80 1 Processor -- start 2023-09-13T09:39:27.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2287383b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0ea8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2287383b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2287383b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0eb0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2287383b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0d8fb60 con 0x55cbe0ea1010 2023-09-13T09:39:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2287383b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0d8f860 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2287383b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0c738d0 con 0x55cbe0ea06b0 2023-09-13T09:39:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0eb0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2287383b80 10 client.0 _ll_register_callbacks cb 0x55cbe0d8d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0eb0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33478/0 (socket says 172.21.15.6:33478) 2023-09-13T09:39:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 -- 172.21.15.6:0/3958287690 learned_addr learned my addr 172.21.15.6:0/3958287690 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0ea8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2273fff700 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 -- 172.21.15.6:0/3958287690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 msgr2=0x55cbe0ea93c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea93c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 -- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0e9f9b0 msgr2=0x55cbe0ea8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0ea8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 -- 172.21.15.6:0/3958287690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22741a1350 con 0x55cbe0ea1010 2023-09-13T09:39:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f227973b700 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0eb0400 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f226c009040 tx=0x7f226c007850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42645347079eb239 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.349+0000 7f2253fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:27.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2253fff700 1 -- 172.21.15.6:0/3958287690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c00e070 con 0x55cbe0ea1010 2023-09-13T09:39:27.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2253fff700 1 -- 172.21.15.6:0/3958287690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f226c009350 con 0x55cbe0ea1010 2023-09-13T09:39:27.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cbe0e92620 con 0x55cbe0ea1010 2023-09-13T09:39:27.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2253fff700 1 -- 172.21.15.6:0/3958287690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f226c004a50 con 0x55cbe0ea1010 2023-09-13T09:39:27.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 10 client.15258 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:27.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cbe0e09750 con 0x55cbe0ea1010 2023-09-13T09:39:27.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2253fff700 1 -- 172.21.15.6:0/3958287690 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cbe0e92620 con 0x55cbe0ea1010 2023-09-13T09:39:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2253fff700 1 -- 172.21.15.6:0/3958287690 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f226c00b100 con 0x55cbe0ea1010 2023-09-13T09:39:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 10 client.15258 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 10 client.15258 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-13T09:39:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 20 client.15258 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0eb3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 4 client.15258 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:27.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.350+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cbe0dea920 con 0x55cbe0eb4a70 2023-09-13T09:39:27.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.351+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0eb3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.351+0000 7f2278f3a700 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0eb3470 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=88ff0fd71ed7f137 server_cookie=fa235ffe685ccdc8 in_seq=0 out_seq=0 2023-09-13T09:39:27.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.351+0000 7f2253fff700 10 client.15258 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:27.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2253fff700 1 -- 172.21.15.6:0/3958287690 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cbe0dea920 con 0x55cbe0eb4a70 2023-09-13T09:39:27.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2253fff700 10 client.15258 handle_command_reply: tid=0 2023-09-13T09:39:27.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 client.15258 shutdown 2023-09-13T09:39:27.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 msgr2=0x55cbe0eb0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0eb0400 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f226c009040 tx=0x7f226c007850 comp rx=0 tx=0).stop 2023-09-13T09:39:27.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 shutdown_connections 2023-09-13T09:39:27.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0eb3470 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea1010 0x55cbe0eb0400 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2253fff700 0 client.15258 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:27.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0ea8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 --2- 172.21.15.6:0/3958287690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0ea93c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 >> 172.21.15.6:0/3958287690 conn(0x55cbe0dfdc30 msgr2=0x55cbe0e947a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 shutdown_connections 2023-09-13T09:39:27.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 1 -- 172.21.15.6:0/3958287690 wait complete. 2023-09-13T09:39:27.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.352+0000 7f2287383b80 20 client.15258 trim_cache size 0 max 16384 2023-09-13T09:39:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 Processor -- start 2023-09-13T09:39:27.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 -- start start 2023-09-13T09:39:27.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb0320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0ea3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0d8be40 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0ea8360 con 0x55cbe0ea1010 2023-09-13T09:39:27.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2287383b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0ea89f0 con 0x55cbe0ea06b0 2023-09-13T09:39:27.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2278f3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2278f3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33482/0 (socket says 172.21.15.6:33482) 2023-09-13T09:39:27.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2278f3a700 1 -- 172.21.15.6:0/757692229 learned_addr learned my addr 172.21.15.6:0/757692229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f2273fff700 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb0320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.370+0000 7f227973b700 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0ea3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f2278f3a700 1 -- 172.21.15.6:0/757692229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 msgr2=0x55cbe0eb0320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f2278f3a700 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb0320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f2278f3a700 1 -- 172.21.15.6:0/757692229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 msgr2=0x55cbe0ea3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f2278f3a700 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0ea3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f2278f3a700 1 -- 172.21.15.6:0/757692229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cbe0c1dd90 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f227973b700 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0ea3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:27.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f2278f3a700 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9f470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2274101dd0 tx=0x7f2264014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17156af621ed2670 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f225b7fe700 1 -- 172.21.15.6:0/757692229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264024040 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f225b7fe700 1 -- 172.21.15.6:0/757692229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2264011a30 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.371+0000 7f225b7fe700 1 -- 172.21.15.6:0/757692229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226401f950 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 -- 172.21.15.6:0/757692229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0e9f9b0 msgr2=0x55cbe0e9f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9f470 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f2274101dd0 tx=0x7f2264014000 comp rx=0 tx=0).stop 2023-09-13T09:39:27.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 -- 172.21.15.6:0/757692229 shutdown_connections 2023-09-13T09:39:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0ea3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0e9f470 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 --2- 172.21.15.6:0/757692229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb0320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 -- 172.21.15.6:0/757692229 >> 172.21.15.6:0/757692229 conn(0x55cbe0dfdc30 msgr2=0x55cbe0ea7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 -- 172.21.15.6:0/757692229 shutdown_connections 2023-09-13T09:39:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 -- 172.21.15.6:0/757692229 wait complete. 2023-09-13T09:39:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 -- start start 2023-09-13T09:39:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.372+0000 7f2287383b80 1 Processor -- start 2023-09-13T09:39:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0eaae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0eab400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0f08460 con 0x55cbe0ea06b0 2023-09-13T09:39:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0f085a0 con 0x55cbe0ea1010 2023-09-13T09:39:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cbe0f086e0 con 0x55cbe0e9f9b0 2023-09-13T09:39:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 10 client.0 _ll_register_callbacks cb 0x55cbe0d8d630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:27.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33490/0 (socket says 172.21.15.6:33490) 2023-09-13T09:39:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 -- 172.21.15.6:0/417164529 learned_addr learned my addr 172.21.15.6:0/417164529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2278f3a700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0eaae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f227973b700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0eab400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 -- 172.21.15.6:0/417164529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 msgr2=0x55cbe0eaae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0eaae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 -- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 msgr2=0x55cbe0eab400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0eab400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 -- 172.21.15.6:0/417164529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f226400edb0 con 0x55cbe0ea06b0 2023-09-13T09:39:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f227973b700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0eab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2278f3a700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0eaae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2273fff700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb03f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2268099440 tx=0x7f22680c99f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78f4136ddcac860 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2253fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:27.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2253fff700 1 -- 172.21.15.6:0/417164529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680a1800 con 0x55cbe0ea06b0 2023-09-13T09:39:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2253fff700 1 -- 172.21.15.6:0/417164529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f2268098c80 con 0x55cbe0ea06b0 2023-09-13T09:39:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f226809d5c0 con 0x55cbe0ea06b0 2023-09-13T09:39:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2253fff700 1 -- 172.21.15.6:0/417164529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2268098e40 con 0x55cbe0ea06b0 2023-09-13T09:39:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 10 client.15264 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:27.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.373+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55cbe0c06c10 con 0x55cbe0ea06b0 2023-09-13T09:39:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2253fff700 1 -- 172.21.15.6:0/417164529 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f226809d5c0 con 0x55cbe0ea06b0 2023-09-13T09:39:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2253fff700 1 -- 172.21.15.6:0/417164529 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f226809d120 con 0x55cbe0ea06b0 2023-09-13T09:39:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2287383b80 10 client.15264 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2287383b80 10 client.15264 resolve_mds: resolved name 'e' to daemon mds.e 2023-09-13T09:39:27.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2287383b80 20 client.15264 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2287383b80 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0f09950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2287383b80 4 client.15264 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cbe0dab000 con 0x55cbe0eb4a70 2023-09-13T09:39:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.374+0000 7f2278f3a700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0f09950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2253fff700 10 client.15264 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2278f3a700 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0f09950 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ecabf8eeea1c06fd server_cookie=ac5c8bbe2e455ce9 in_seq=0 out_seq=0 2023-09-13T09:39:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2253fff700 1 -- 172.21.15.6:0/417164529 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55cbe0dab000 con 0x55cbe0eb4a70 2023-09-13T09:39:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2253fff700 10 client.15264 handle_command_reply: tid=0 2023-09-13T09:39:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 client.15264 shutdown 2023-09-13T09:39:27.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea06b0 msgr2=0x55cbe0eb03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb03f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2268099440 tx=0x7f22680c99f0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 shutdown_connections 2023-09-13T09:39:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cbe0eb4a70 0x55cbe0f09950 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cbe0ea1010 0x55cbe0eab400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2253fff700 0 client.15264 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:39:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cbe0e9f9b0 0x55cbe0eaae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 --2- 172.21.15.6:0/417164529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cbe0ea06b0 0x55cbe0eb03f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 >> 172.21.15.6:0/417164529 conn(0x55cbe0dfdc30 msgr2=0x55cbe0ea3890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 shutdown_connections 2023-09-13T09:39:27.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 1 -- 172.21.15.6:0/417164529 wait complete. 2023-09-13T09:39:27.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.375+0000 7f2287383b80 20 client.15264 trim_cache size 0 max 16384 2023-09-13T09:39:27.428 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:27.428 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:27.428 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 4, 2023-09-13T09:39:27.429 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24455, 2023-09-13T09:39:27.429 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:27.429 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:27.429 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:27.429 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 71.595444369000006, 2023-09-13T09:39:27.430 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:27.430 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 86, 2023-09-13T09:39:27.430 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:27.431 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 99.507675579999997 2023-09-13T09:39:27.431 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:27.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f225c0a06d0 msgr2=0x7f225c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f225c0a06d0 0x7f225c0a2b90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2264005fd0 tx=0x7f2264005f00 comp rx=0 tx=0).stop 2023-09-13T09:39:27.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274101f70 msgr2=0x7f22740730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274101f70 0x7f22740730a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f226800d950 tx=0x7f226800dd10 comp rx=0 tx=0).stop 2023-09-13T09:39:27.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 shutdown_connections 2023-09-13T09:39:27.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2274102910 0x7f22740735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2274100d80 0x7f2274074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f225c0a06d0 0x7f225c0a2b90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 --2- 172.21.15.6:0/3423259899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2274101f70 0x7f22740730a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 >> 172.21.15.6:0/3423259899 conn(0x7f22740fc310 msgr2=0x7f2274105410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 shutdown_connections 2023-09-13T09:39:27.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.376+0000 7f227b19e700 1 -- 172.21.15.6:0/3423259899 wait complete. 2023-09-13T09:39:27.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-09-13T09:39:27.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/1158800011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080fff00 msgr2=0x7f4e08100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/1158800011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080fff00 0x7f4e08100380 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009990 tx=0x7f4dfc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/1158800011 shutdown_connections 2023-09-13T09:39:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/1158800011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e081008c0 0x7f4e08108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/1158800011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e08101340 0x7f4e08101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/1158800011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080fff00 0x7f4e08100380 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/1158800011 >> 172.21.15.6:0/1158800011 conn(0x7f4e080fa9b0 msgr2=0x7f4e080fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/1158800011 shutdown_connections 2023-09-13T09:39:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/1158800011 wait complete. 2023-09-13T09:39:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 Processor -- start 2023-09-13T09:39:27.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.563+0000 7f4e0e2f5700 1 -- start start 2023-09-13T09:39:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0e2f5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080fff00 0x7f4e081969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0e2f5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e081008c0 0x7f4e08196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0e2f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08101340 0x7f4e0819df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0e2f5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0819e530 con 0x7f4e08101340 2023-09-13T09:39:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0e2f5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0819e670 con 0x7f4e080fff00 2023-09-13T09:39:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0e2f5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0819e800 con 0x7f4e081008c0 2023-09-13T09:39:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08101340 0x7f4e0819df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08101340 0x7f4e0819df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33506/0 (socket says 172.21.15.6:33506) 2023-09-13T09:39:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 -- 172.21.15.6:0/2443044229 learned_addr learned my addr 172.21.15.6:0/2443044229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e07fff700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080fff00 0x7f4e081969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 -- 172.21.15.6:0/2443044229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e081008c0 msgr2=0x7f4e08196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e081008c0 0x7f4e08196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 -- 172.21.15.6:0/2443044229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080fff00 msgr2=0x7f4e081969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080fff00 0x7f4e081969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 -- 172.21.15.6:0/2443044229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc0095f0 con 0x7f4e08101340 2023-09-13T09:39:27.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e07fff700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080fff00 0x7f4e081969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e0c892700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08101340 0x7f4e0819df60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000ef30 tx=0x7f4e0000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.564+0000 7f4e057fa700 1 -- 172.21.15.6:0/2443044229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00018070 con 0x7f4e08101340 2023-09-13T09:39:27.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.565+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e0819ea80 con 0x7f4e08101340 2023-09-13T09:39:27.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.565+0000 7f4e057fa700 1 -- 172.21.15.6:0/2443044229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0000f040 con 0x7f4e08101340 2023-09-13T09:39:27.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.565+0000 7f4e057fa700 1 -- 172.21.15.6:0/2443044229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e00003dc0 con 0x7f4e08101340 2023-09-13T09:39:27.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.565+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0819ef40 con 0x7f4e08101340 2023-09-13T09:39:27.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.567+0000 7f4e057fa700 1 -- 172.21.15.6:0/2443044229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f4e0000caa0 con 0x7f4e08101340 2023-09-13T09:39:27.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.567+0000 7f4e057fa700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4df00a06d0 0x7f4df00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.567+0000 7f4e057fa700 1 -- 172.21.15.6:0/2443044229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f4e000cba10 con 0x7f4e08101340 2023-09-13T09:39:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.567+0000 7f4e07fff700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4df00a06d0 0x7f4df00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.568+0000 7f4e07fff700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4df00a06d0 0x7f4df00a2b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4df8005fd0 tx=0x7f4df8005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.568+0000 7f4e1a4dab80 1 Processor -- start 2023-09-13T09:39:27.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.568+0000 7f4e1a4dab80 1 -- start start 2023-09-13T09:39:27.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48a6b0 0x559ddf48aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf489470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf489e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf3e2730 con 0x559ddf4899b0 2023-09-13T09:39:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf3e0050 con 0x559ddf48a6b0 2023-09-13T09:39:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf3db940 con 0x559ddf48b010 2023-09-13T09:39:27.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf489e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf489e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33514/0 (socket says 172.21.15.6:33514) 2023-09-13T09:39:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 -- 172.21.15.6:0/791568495 learned_addr learned my addr 172.21.15.6:0/791568495 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e07fff700 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48a6b0 0x559ddf48aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e077fe700 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf489470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 -- 172.21.15.6:0/791568495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 msgr2=0x559ddf489470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf489470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 -- 172.21.15.6:0/791568495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48a6b0 msgr2=0x559ddf48aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48a6b0 0x559ddf48aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 -- 172.21.15.6:0/791568495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ddf25b5e0 con 0x559ddf4899b0 2023-09-13T09:39:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4e0c892700 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf489e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4e000a0bd0 tx=0x7f4e00098d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e11ac97646d95725 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4dee7fc700 1 -- 172.21.15.6:0/791568495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0009b070 con 0x559ddf4899b0 2023-09-13T09:39:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4dee7fc700 1 -- 172.21.15.6:0/791568495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0009f070 con 0x559ddf4899b0 2023-09-13T09:39:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.569+0000 7f4dee7fc700 1 -- 172.21.15.6:0/791568495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e000c9600 con 0x559ddf4899b0 2023-09-13T09:39:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/791568495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 msgr2=0x559ddf489e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf489e30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4e000a0bd0 tx=0x7f4e00098d30 comp rx=0 tx=0).stop 2023-09-13T09:39:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/791568495 shutdown_connections 2023-09-13T09:39:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf489e30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48a6b0 0x559ddf48aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/791568495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf489470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/791568495 >> 172.21.15.6:0/791568495 conn(0x559ddf3e7c30 msgr2=0x559ddf483ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/791568495 shutdown_connections 2023-09-13T09:39:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.570+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/791568495 wait complete. 2023-09-13T09:39:27.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 -- start start 2023-09-13T09:39:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 Processor -- start 2023-09-13T09:39:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf4899b0 0x559ddf492ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf493430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf49a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf379b60 con 0x559ddf48a6b0 2023-09-13T09:39:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf379860 con 0x559ddf48b010 2023-09-13T09:39:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf25d8d0 con 0x559ddf4899b0 2023-09-13T09:39:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf493430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e1a4dab80 10 client.0 _ll_register_callbacks cb 0x559ddf377630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:27.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf493430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33518/0 (socket says 172.21.15.6:33518) 2023-09-13T09:39:27.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e077fe700 1 -- 172.21.15.6:0/2465009143 learned_addr learned my addr 172.21.15.6:0/2465009143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e07fff700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf4899b0 0x559ddf492ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.571+0000 7f4e0c892700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf49a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e077fe700 1 -- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf4899b0 msgr2=0x559ddf492ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e077fe700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf4899b0 0x559ddf492ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e077fe700 1 -- 172.21.15.6:0/2465009143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 msgr2=0x559ddf49a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e077fe700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf49a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e077fe700 1 -- 172.21.15.6:0/2465009143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0819ef40 con 0x559ddf48a6b0 2023-09-13T09:39:27.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e0c892700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf49a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:27.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e077fe700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf493430 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc015000 tx=0x7f4dfc00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6edbd3ea88ff853 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4de77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:27.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4de77fe700 1 -- 172.21.15.6:0/2465009143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc004700 con 0x559ddf48a6b0 2023-09-13T09:39:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ddf47c620 con 0x559ddf48a6b0 2023-09-13T09:39:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4de77fe700 1 -- 172.21.15.6:0/2465009143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f4dfc004860 con 0x559ddf48a6b0 2023-09-13T09:39:27.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4de77fe700 1 -- 172.21.15.6:0/2465009143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4dfc005710 con 0x559ddf48a6b0 2023-09-13T09:39:27.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e1a4dab80 10 client.15276 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:27.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559ddf3f3750 con 0x559ddf48a6b0 2023-09-13T09:39:27.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.572+0000 7f4de77fe700 1 -- 172.21.15.6:0/2465009143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4dfc031080 con 0x559ddf48a6b0 2023-09-13T09:39:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4de77fe700 1 -- 172.21.15.6:0/2465009143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4dfc00fbb0 con 0x559ddf48a6b0 2023-09-13T09:39:27.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e1a4dab80 10 client.15276 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e1a4dab80 10 client.15276 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T09:39:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e1a4dab80 20 client.15276 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf49ea90 0x559ddf49d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e1a4dab80 4 client.15276 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:27.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ddf3d4920 con 0x559ddf49ea90 2023-09-13T09:39:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e07fff700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf49ea90 0x559ddf49d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4e07fff700 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf49ea90 0x559ddf49d570 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=58d3abd5fe1f8f92 server_cookie=cea5dc959bd5a82c in_seq=0 out_seq=0 2023-09-13T09:39:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.573+0000 7f4de77fe700 10 client.15276 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.574+0000 7f4de77fe700 1 -- 172.21.15.6:0/2465009143 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559ddf3d4920 con 0x559ddf49ea90 2023-09-13T09:39:27.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.574+0000 7f4de77fe700 10 client.15276 handle_command_reply: tid=0 2023-09-13T09:39:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.574+0000 7f4e1a4dab80 1 client.15276 shutdown 2023-09-13T09:39:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.574+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 msgr2=0x559ddf493430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.574+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf493430 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc015000 tx=0x7f4dfc00bf80 comp rx=0 tx=0).stop 2023-09-13T09:39:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 shutdown_connections 2023-09-13T09:39:27.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf49ea90 0x559ddf49d570 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf49a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4de77fe700 0 client.15276 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf4899b0 0x559ddf492ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/2465009143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf493430 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 >> 172.21.15.6:0/2465009143 conn(0x559ddf3e7c30 msgr2=0x559ddf47e7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 shutdown_connections 2023-09-13T09:39:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/2465009143 wait complete. 2023-09-13T09:39:27.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.575+0000 7f4e1a4dab80 20 client.15276 trim_cache size 0 max 16384 2023-09-13T09:39:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.592+0000 7f4e1a4dab80 1 Processor -- start 2023-09-13T09:39:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.592+0000 7f4e1a4dab80 1 -- start start 2023-09-13T09:39:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.592+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf4899b0 0x559ddf489470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf49a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf49d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf397f00 con 0x559ddf48a6b0 2023-09-13T09:39:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf375e00 con 0x559ddf4899b0 2023-09-13T09:39:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf383470 con 0x559ddf48b010 2023-09-13T09:39:27.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf49a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf49a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33526/0 (socket says 172.21.15.6:33526) 2023-09-13T09:39:27.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 -- 172.21.15.6:0/3003383000 learned_addr learned my addr 172.21.15.6:0/3003383000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e0c892700 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf49d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e07fff700 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf4899b0 0x559ddf489470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 -- 172.21.15.6:0/3003383000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 msgr2=0x559ddf49d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf49d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 -- 172.21.15.6:0/3003383000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf4899b0 msgr2=0x559ddf489470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf4899b0 0x559ddf489470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 -- 172.21.15.6:0/3003383000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ddf207d90 con 0x559ddf48a6b0 2023-09-13T09:39:27.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e07fff700 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf4899b0 0x559ddf489470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4e077fe700 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf49a430 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009990 tx=0x7f4dfc009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1e1df9300b6a3bd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4deeffd700 1 -- 172.21.15.6:0/3003383000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc005710 con 0x559ddf48a6b0 2023-09-13T09:39:27.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4deeffd700 1 -- 172.21.15.6:0/3003383000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559ddf47c620 con 0x559ddf48a6b0 2023-09-13T09:39:27.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.593+0000 7f4deeffd700 1 -- 172.21.15.6:0/3003383000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dfc00f8b0 con 0x559ddf48a6b0 2023-09-13T09:39:27.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/3003383000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 msgr2=0x559ddf49a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf49a430 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4dfc009990 tx=0x7f4dfc009510 comp rx=0 tx=0).stop 2023-09-13T09:39:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/3003383000 shutdown_connections 2023-09-13T09:39:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48b010 0x559ddf49d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf4899b0 0x559ddf489470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/3003383000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf48a6b0 0x559ddf49a430 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/3003383000 >> 172.21.15.6:0/3003383000 conn(0x559ddf3e7c30 msgr2=0x559ddf48d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/3003383000 shutdown_connections 2023-09-13T09:39:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/3003383000 wait complete. 2023-09-13T09:39:27.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 -- start start 2023-09-13T09:39:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.594+0000 7f4e1a4dab80 1 Processor -- start 2023-09-13T09:39:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf494cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48a6b0 0x559ddf49a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e1a4dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf495230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf495850 con 0x559ddf4899b0 2023-09-13T09:39:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf4f2480 con 0x559ddf48b010 2023-09-13T09:39:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e1a4dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ddf4f25c0 con 0x559ddf48a6b0 2023-09-13T09:39:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf494cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e1a4dab80 10 client.0 _ll_register_callbacks cb 0x559ddf484520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf494cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33530/0 (socket says 172.21.15.6:33530) 2023-09-13T09:39:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 -- 172.21.15.6:0/1791070643 learned_addr learned my addr 172.21.15.6:0/1791070643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e0c892700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf495230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e077fe700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48a6b0 0x559ddf49a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 -- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48a6b0 msgr2=0x559ddf49a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48a6b0 0x559ddf49a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 -- 172.21.15.6:0/1791070643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 msgr2=0x559ddf495230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf495230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 -- 172.21.15.6:0/1791070643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ddf3f3750 con 0x559ddf4899b0 2023-09-13T09:39:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e077fe700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48a6b0 0x559ddf49a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4e07fff700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf494cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x559ddf493a80 tx=0x7f4df8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a037401195c42b17 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.595+0000 7f4de77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4de77fe700 1 -- 172.21.15.6:0/1791070643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8022040 con 0x559ddf4899b0 2023-09-13T09:39:27.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e0009f070 con 0x559ddf4899b0 2023-09-13T09:39:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4de77fe700 1 -- 172.21.15.6:0/1791070643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f4df801d630 con 0x559ddf4899b0 2023-09-13T09:39:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4de77fe700 1 -- 172.21.15.6:0/1791070643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4df801d7f0 con 0x559ddf4899b0 2023-09-13T09:39:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 10 client.15282 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559ddf1f0c10 con 0x559ddf4899b0 2023-09-13T09:39:27.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4de77fe700 1 -- 172.21.15.6:0/1791070643 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e0009f070 con 0x559ddf4899b0 2023-09-13T09:39:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4de77fe700 1 -- 172.21.15.6:0/1791070643 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4df80319d0 con 0x559ddf4899b0 2023-09-13T09:39:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 10 client.15282 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 10 client.15282 resolve_mds: resolved name 'c' to daemon mds.c 2023-09-13T09:39:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 20 client.15282 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:27.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf4f7860 0x559ddf4f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 4 client.15282 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559ddf395000 con 0x559ddf4f7860 2023-09-13T09:39:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.596+0000 7f4e077fe700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf4f7860 0x559ddf4f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4de77fe700 10 client.15282 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:27.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e077fe700 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf4f7860 0x559ddf4f3ca0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5a9800f6786fce47 server_cookie=19663a992789d894 in_seq=0 out_seq=0 2023-09-13T09:39:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4de77fe700 1 -- 172.21.15.6:0/1791070643 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x559ddf395000 con 0x559ddf4f7860 2023-09-13T09:39:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4de77fe700 10 client.15282 handle_command_reply: tid=0 2023-09-13T09:39:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 client.15282 shutdown 2023-09-13T09:39:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 msgr2=0x559ddf494cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf494cf0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x559ddf493a80 tx=0x7f4df8004750 comp rx=0 tx=0).stop 2023-09-13T09:39:27.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 shutdown_connections 2023-09-13T09:39:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559ddf4f7860 0x559ddf4f3ca0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ddf48b010 0x559ddf495230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ddf4899b0 0x559ddf494cf0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 --2- 172.21.15.6:0/1791070643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ddf48a6b0 0x559ddf49a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4de77fe700 0 client.15282 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:39:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 >> 172.21.15.6:0/1791070643 conn(0x559ddf3e7c30 msgr2=0x559ddf49d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 shutdown_connections 2023-09-13T09:39:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.597+0000 7f4e1a4dab80 1 -- 172.21.15.6:0/1791070643 wait complete. 2023-09-13T09:39:27.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e1a4dab80 20 client.15282 trim_cache size 0 max 16384 2023-09-13T09:39:27.634 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:27.634 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 3, 2023-09-13T09:39:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24466, 2023-09-13T09:39:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 72.82752241, 2023-09-13T09:39:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 86, 2023-09-13T09:39:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:27.636 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 95.076744629000004 2023-09-13T09:39:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4df00a06d0 msgr2=0x7f4df00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4df00a06d0 0x7f4df00a2b90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4df8005fd0 tx=0x7f4df8005e20 comp rx=0 tx=0).stop 2023-09-13T09:39:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08101340 msgr2=0x7f4e0819df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08101340 0x7f4e0819df60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000ef30 tx=0x7f4e0000c450 comp rx=0 tx=0).stop 2023-09-13T09:39:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 shutdown_connections 2023-09-13T09:39:27.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4df00a06d0 0x7f4df00a2b90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e08101340 0x7f4e0819df60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e080fff00 0x7f4e081969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 --2- 172.21.15.6:0/2443044229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e081008c0 0x7f4e08196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 >> 172.21.15.6:0/2443044229 conn(0x7f4e080fa9b0 msgr2=0x7f4e080fee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 shutdown_connections 2023-09-13T09:39:27.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.598+0000 7f4e0e2f5700 1 -- 172.21.15.6:0/2443044229 wait complete. 2023-09-13T09:39:27.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-09-13T09:39:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 -- 172.21.15.6:0/4126252577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e0100630 msgr2=0x7f10e0100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 --2- 172.21.15.6:0/4126252577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e0100630 0x7f10e0100a90 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f10d000aad0 tx=0x7f10d000ade0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 -- 172.21.15.6:0/4126252577 shutdown_connections 2023-09-13T09:39:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 --2- 172.21.15.6:0/4126252577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e0100fd0 0x7f10e0107880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 --2- 172.21.15.6:0/4126252577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e00ff440 0x7f10e00ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 --2- 172.21.15.6:0/4126252577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e0100630 0x7f10e0100a90 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 -- 172.21.15.6:0/4126252577 >> 172.21.15.6:0/4126252577 conn(0x7f10e00fa9b0 msgr2=0x7f10e00fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 -- 172.21.15.6:0/4126252577 shutdown_connections 2023-09-13T09:39:27.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.771+0000 7f10e56f7700 1 -- 172.21.15.6:0/4126252577 wait complete. 2023-09-13T09:39:27.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 Processor -- start 2023-09-13T09:39:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 -- start start 2023-09-13T09:39:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e00ff440 0x7f10e01033d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0100630 0x7f10e0101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e0100fd0 0x7f10e0101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e01026f0 con 0x7f10e00ff440 2023-09-13T09:39:27.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e0102860 con 0x7f10e0100630 2023-09-13T09:39:27.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10e56f7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e01a0b40 con 0x7f10e0100fd0 2023-09-13T09:39:27.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e00ff440 0x7f10e01033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e00ff440 0x7f10e01033d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33544/0 (socket says 172.21.15.6:33544) 2023-09-13T09:39:27.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 -- 172.21.15.6:0/3415599824 learned_addr learned my addr 172.21.15.6:0/3415599824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 -- 172.21.15.6:0/3415599824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e0100fd0 msgr2=0x7f10e0101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0100630 0x7f10e0101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e0100fd0 0x7f10e0101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 -- 172.21.15.6:0/3415599824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0100630 msgr2=0x7f10e0101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0100630 0x7f10e0101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 -- 172.21.15.6:0/3415599824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d000a700 con 0x7f10e00ff440 2023-09-13T09:39:27.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0100630 0x7f10e0101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.772+0000 7f10deffd700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e00ff440 0x7f10e01033d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f10d400d900 tx=0x7f10d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.773+0000 7f10c7fff700 1 -- 172.21.15.6:0/3415599824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400b950 con 0x7f10e00ff440 2023-09-13T09:39:27.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.773+0000 7f10c7fff700 1 -- 172.21.15.6:0/3415599824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d4007620 con 0x7f10e00ff440 2023-09-13T09:39:27.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.773+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e01a0e20 con 0x7f10e00ff440 2023-09-13T09:39:27.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.773+0000 7f10c7fff700 1 -- 172.21.15.6:0/3415599824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d400f3c0 con 0x7f10e00ff440 2023-09-13T09:39:27.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.773+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e01a12a0 con 0x7f10e00ff440 2023-09-13T09:39:27.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.775+0000 7f10c7fff700 1 -- 172.21.15.6:0/3415599824 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f10d4010640 con 0x7f10e00ff440 2023-09-13T09:39:27.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.775+0000 7f10c7fff700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c80a06d0 0x7f10c80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.775+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c80a06d0 0x7f10c80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10c7fff700 1 -- 172.21.15.6:0/3415599824 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f10d40cc0f0 con 0x7f10e00ff440 2023-09-13T09:39:27.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c80a06d0 0x7f10c80a2b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006010 tx=0x7f10d0000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 Processor -- start 2023-09-13T09:39:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 -- start start 2023-09-13T09:39:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ada6b0 0x559f88adaad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88adb010 0x559f88ad9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f88a32730 con 0x559f88ada6b0 2023-09-13T09:39:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f88a30050 con 0x559f88adb010 2023-09-13T09:39:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f88a2b940 con 0x559f88ad99b0 2023-09-13T09:39:27.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ada6b0 0x559f88adaad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ada6b0 0x559f88adaad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33552/0 (socket says 172.21.15.6:33552) 2023-09-13T09:39:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.776+0000 7f10deffd700 1 -- 172.21.15.6:0/2799354078 learned_addr learned my addr 172.21.15.6:0/2799354078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10df7fe700 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10de7fc700 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88adb010 0x559f88ad9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10deffd700 1 -- 172.21.15.6:0/2799354078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 msgr2=0x559f88ad9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10deffd700 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10deffd700 1 -- 172.21.15.6:0/2799354078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88adb010 msgr2=0x559f88ad9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10deffd700 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88adb010 0x559f88ad9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10deffd700 1 -- 172.21.15.6:0/2799354078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f888ab5e0 con 0x559f88ada6b0 2023-09-13T09:39:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10deffd700 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ada6b0 0x559f88adaad0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f10d40a12b0 tx=0x7f10d4099200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fcc67e58a417f3a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10c57fa700 1 -- 172.21.15.6:0/2799354078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409d5a0 con 0x559f88ada6b0 2023-09-13T09:39:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10c57fa700 1 -- 172.21.15.6:0/2799354078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d40a17e0 con 0x559f88ada6b0 2023-09-13T09:39:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.777+0000 7f10c57fa700 1 -- 172.21.15.6:0/2799354078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d4099c30 con 0x559f88ada6b0 2023-09-13T09:39:27.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2799354078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ada6b0 msgr2=0x559f88adaad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ada6b0 0x559f88adaad0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f10d40a12b0 tx=0x7f10d4099200 comp rx=0 tx=0).stop 2023-09-13T09:39:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2799354078 shutdown_connections 2023-09-13T09:39:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ada6b0 0x559f88adaad0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2799354078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88adb010 0x559f88ad9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2799354078 >> 172.21.15.6:0/2799354078 conn(0x559f88a37c30 msgr2=0x559f88ad3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2799354078 shutdown_connections 2023-09-13T09:39:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2799354078 wait complete. 2023-09-13T09:39:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- start start 2023-09-13T09:39:27.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 Processor -- start 2023-09-13T09:39:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ad99b0 0x559f88ae2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88ae32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88adb010 0x559f88aea320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f889c9b60 con 0x559f88ad99b0 2023-09-13T09:39:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f889c9860 con 0x559f88ada6b0 2023-09-13T09:39:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.778+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f888ad8d0 con 0x559f88adb010 2023-09-13T09:39:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10f18dcb80 10 client.0 _ll_register_callbacks cb 0x559f889c7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ad99b0 0x559f88ae2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ad99b0 0x559f88ae2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33558/0 (socket says 172.21.15.6:33558) 2023-09-13T09:39:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 -- 172.21.15.6:0/3722687891 learned_addr learned my addr 172.21.15.6:0/3722687891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10df7fe700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88adb010 0x559f88aea320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88ae32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 -- 172.21.15.6:0/3722687891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88adb010 msgr2=0x559f88aea320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88adb010 0x559f88aea320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 -- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 msgr2=0x559f88ae32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88ae32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 -- 172.21.15.6:0/3722687891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e01a12a0 con 0x559f88ad99b0 2023-09-13T09:39:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88ae32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10deffd700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ad99b0 0x559f88ae2da0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f10d40961e0 tx=0x7f10d401a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98e03ce2f023ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10c2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10c2ff5700 1 -- 172.21.15.6:0/3722687891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409d5a0 con 0x559f88ad99b0 2023-09-13T09:39:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10c2ff5700 1 -- 172.21.15.6:0/3722687891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f10d40b0020 con 0x559f88ad99b0 2023-09-13T09:39:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f88acc620 con 0x559f88ad99b0 2023-09-13T09:39:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10c2ff5700 1 -- 172.21.15.6:0/3722687891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d40652c0 con 0x559f88ad99b0 2023-09-13T09:39:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10f18dcb80 10 client.15294 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f88a43750 con 0x559f88ad99b0 2023-09-13T09:39:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.779+0000 7f10c2ff5700 1 -- 172.21.15.6:0/3722687891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559f88acc620 con 0x559f88ad99b0 2023-09-13T09:39:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10c2ff5700 1 -- 172.21.15.6:0/3722687891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f10d40999d0 con 0x559f88ad99b0 2023-09-13T09:39:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10f18dcb80 10 client.15294 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10f18dcb80 10 client.15294 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-13T09:39:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10f18dcb80 20 client.15294 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88aee440 0x559f88aed250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10f18dcb80 4 client.15294 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f88a24920 con 0x559f88aee440 2023-09-13T09:39:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.780+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88aee440 0x559f88aed250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10de7fc700 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88aee440 0x559f88aed250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1447205dc21fcba0 server_cookie=efcdf5b136466047 in_seq=0 out_seq=0 2023-09-13T09:39:27.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10c2ff5700 10 client.15294 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:27.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10c2ff5700 1 -- 172.21.15.6:0/3722687891 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559f88a24920 con 0x559f88aee440 2023-09-13T09:39:27.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10c2ff5700 10 client.15294 handle_command_reply: tid=0 2023-09-13T09:39:27.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 client.15294 shutdown 2023-09-13T09:39:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ad99b0 msgr2=0x559f88ae2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ad99b0 0x559f88ae2da0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f10d40961e0 tx=0x7f10d401a710 comp rx=0 tx=0).stop 2023-09-13T09:39:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 shutdown_connections 2023-09-13T09:39:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88aee440 0x559f88aed250 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88adb010 0x559f88aea320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10c2ff5700 0 client.15294 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88ad99b0 0x559f88ae2da0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/3722687891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88ae32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 >> 172.21.15.6:0/3722687891 conn(0x559f88a37c30 msgr2=0x559f88ace7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 shutdown_connections 2023-09-13T09:39:27.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.781+0000 7f10f18dcb80 1 -- 172.21.15.6:0/3722687891 wait complete. 2023-09-13T09:39:27.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.782+0000 7f10f18dcb80 20 client.15294 trim_cache size 0 max 16384 2023-09-13T09:39:27.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 Processor -- start 2023-09-13T09:39:27.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 -- start start 2023-09-13T09:39:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88aea2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88add930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f88a24920 con 0x559f88adb010 2023-09-13T09:39:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f889d3470 con 0x559f88ada6b0 2023-09-13T09:39:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f889ebdf0 con 0x559f88ad99b0 2023-09-13T09:39:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.799+0000 7f10df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88add930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88add930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33570/0 (socket says 172.21.15.6:33570) 2023-09-13T09:39:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 -- 172.21.15.6:0/1620384902 learned_addr learned my addr 172.21.15.6:0/1620384902 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10deffd700 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10de7fc700 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88aea2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 -- 172.21.15.6:0/1620384902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 msgr2=0x559f88ad9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 -- 172.21.15.6:0/1620384902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 msgr2=0x559f88aea2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88aea2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 -- 172.21.15.6:0/1620384902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f88857d90 con 0x559f88adb010 2023-09-13T09:39:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10df7fe700 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88add930 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007530 tx=0x7f10d800d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6e0dd806e5b916c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10c5ffb700 1 -- 172.21.15.6:0/1620384902 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8010070 con 0x559f88adb010 2023-09-13T09:39:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10c5ffb700 1 -- 172.21.15.6:0/1620384902 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d8011040 con 0x559f88adb010 2023-09-13T09:39:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.800+0000 7f10c5ffb700 1 -- 172.21.15.6:0/1620384902 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8005260 con 0x559f88adb010 2023-09-13T09:39:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- 172.21.15.6:0/1620384902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 msgr2=0x559f88add930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88add930 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f10d8007530 tx=0x7f10d800d040 comp rx=0 tx=0).stop 2023-09-13T09:39:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- 172.21.15.6:0/1620384902 shutdown_connections 2023-09-13T09:39:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88add930 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ad99b0 0x559f88ad9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/1620384902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ada6b0 0x559f88aea2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- 172.21.15.6:0/1620384902 >> 172.21.15.6:0/1620384902 conn(0x559f88a37c30 msgr2=0x559f88ae0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- 172.21.15.6:0/1620384902 shutdown_connections 2023-09-13T09:39:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- 172.21.15.6:0/1620384902 wait complete. 2023-09-13T09:39:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- start start 2023-09-13T09:39:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 Processor -- start 2023-09-13T09:39:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ad99b0 0x559f88ae0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ada6b0 0x559f88aea240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88b41e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f88b42520 con 0x559f88adb010 2023-09-13T09:39:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f88b42690 con 0x559f88ad99b0 2023-09-13T09:39:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.801+0000 7f10f18dcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f88b42850 con 0x559f88ada6b0 2023-09-13T09:39:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10f18dcb80 10 client.0 _ll_register_callbacks cb 0x559f889c7630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88b41e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88b41e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33576/0 (socket says 172.21.15.6:33576) 2023-09-13T09:39:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 -- 172.21.15.6:0/2957520571 learned_addr learned my addr 172.21.15.6:0/2957520571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10de7fc700 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ada6b0 0x559f88aea240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10deffd700 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ad99b0 0x559f88ae0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 -- 172.21.15.6:0/2957520571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ada6b0 msgr2=0x559f88aea240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ada6b0 0x559f88aea240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 -- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ad99b0 msgr2=0x559f88ae0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ad99b0 0x559f88ae0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 -- 172.21.15.6:0/2957520571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d80091f0 con 0x559f88adb010 2023-09-13T09:39:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10df7fe700 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88b41e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f10d8004b10 tx=0x7f10d8017680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7375e01531bf43bf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10c2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10c2ff5700 1 -- 172.21.15.6:0/2957520571 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8010050 con 0x559f88adb010 2023-09-13T09:39:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10c2ff5700 1 -- 172.21.15.6:0/2957520571 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f10d8017b30 con 0x559f88adb010 2023-09-13T09:39:27.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10d40a17e0 con 0x559f88adb010 2023-09-13T09:39:27.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10c2ff5700 1 -- 172.21.15.6:0/2957520571 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d8005020 con 0x559f88adb010 2023-09-13T09:39:27.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10f18dcb80 10 client.15300 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:27.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.802+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559f88840c10 con 0x559f88adb010 2023-09-13T09:39:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10c2ff5700 1 -- 172.21.15.6:0/2957520571 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d40a17e0 con 0x559f88adb010 2023-09-13T09:39:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10c2ff5700 1 -- 172.21.15.6:0/2957520571 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f10d801f740 con 0x559f88adb010 2023-09-13T09:39:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10f18dcb80 10 client.15300 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10f18dcb80 10 client.15300 resolve_mds: resolved name 'h' to daemon mds.h 2023-09-13T09:39:27.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10f18dcb80 20 client.15300 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:27.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88b47a80 0x559f88b43ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10f18dcb80 4 client.15300 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:27.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559f889e5000 con 0x559f88b47a80 2023-09-13T09:39:27.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.803+0000 7f10deffd700 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88b47a80 0x559f88b43ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10c2ff5700 10 client.15300 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10deffd700 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88b47a80 0x559f88b43ee0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a2fefc3818c84492 server_cookie=7153fa41bb57d992 in_seq=0 out_seq=0 2023-09-13T09:39:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10c2ff5700 1 -- 172.21.15.6:0/2957520571 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x559f889e5000 con 0x559f88b47a80 2023-09-13T09:39:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10c2ff5700 10 client.15300 handle_command_reply: tid=0 2023-09-13T09:39:27.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 client.15300 shutdown 2023-09-13T09:39:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 msgr2=0x559f88b41e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88b41e30 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f10d8004b10 tx=0x7f10d8017680 comp rx=0 tx=0).stop 2023-09-13T09:39:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 shutdown_connections 2023-09-13T09:39:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559f88b47a80 0x559f88b43ee0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f88adb010 0x559f88b41e30 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10c2ff5700 0 client.15300 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:39:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f88ad99b0 0x559f88ae0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 --2- 172.21.15.6:0/2957520571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f88ada6b0 0x559f88aea240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 >> 172.21.15.6:0/2957520571 conn(0x559f88a37c30 msgr2=0x559f88add930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 shutdown_connections 2023-09-13T09:39:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 1 -- 172.21.15.6:0/2957520571 wait complete. 2023-09-13T09:39:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.804+0000 7f10f18dcb80 20 client.15300 trim_cache size 0 max 16384 2023-09-13T09:39:27.837 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:27.837 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:27.837 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 2, 2023-09-13T09:39:27.837 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24482, 2023-09-13T09:39:27.838 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:27.838 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:27.838 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:27.838 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 74.048772153000002, 2023-09-13T09:39:27.839 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:27.839 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 86, 2023-09-13T09:39:27.839 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:27.839 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 92.994964732 2023-09-13T09:39:27.839 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c80a06d0 msgr2=0x7f10c80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c80a06d0 0x7f10c80a2b90 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f10d0006010 tx=0x7f10d0000bc0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e00ff440 msgr2=0x7f10e01033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e00ff440 0x7f10e01033d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f10d400d900 tx=0x7f10d400dcc0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 shutdown_connections 2023-09-13T09:39:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e0100fd0 0x7f10e0101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10c80a06d0 0x7f10c80a2b90 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e00ff440 0x7f10e01033d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 --2- 172.21.15.6:0/3415599824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e0100630 0x7f10e0101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 >> 172.21.15.6:0/3415599824 conn(0x7f10e00fa9b0 msgr2=0x7f10e0105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 shutdown_connections 2023-09-13T09:39:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.805+0000 7f10e56f7700 1 -- 172.21.15.6:0/3415599824 wait complete. 2023-09-13T09:39:27.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-09-13T09:39:27.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 -- 172.21.15.6:0/1602797676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 msgr2=0x7f3ad4108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 --2- 172.21.15.6:0/1602797676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad4108100 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3acc00b0d0 tx=0x7f3acc00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 -- 172.21.15.6:0/1602797676 shutdown_connections 2023-09-13T09:39:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 --2- 172.21.15.6:0/1602797676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad4108100 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 --2- 172.21.15.6:0/1602797676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ad40ffcc0 0x7f3ad41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 --2- 172.21.15.6:0/1602797676 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad4100eb0 0x7f3ad4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 -- 172.21.15.6:0/1602797676 >> 172.21.15.6:0/1602797676 conn(0x7f3ad40fb250 msgr2=0x7f3ad40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 -- 172.21.15.6:0/1602797676 shutdown_connections 2023-09-13T09:39:27.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.972+0000 7f3adab3e700 1 -- 172.21.15.6:0/1602797676 wait complete. 2023-09-13T09:39:27.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 Processor -- start 2023-09-13T09:39:27.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 -- start start 2023-09-13T09:39:27.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad40ffcc0 0x7f3ad4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ad4100eb0 0x7f3ad4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad41a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad41a0900 con 0x7f3ad4101850 2023-09-13T09:39:27.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad41a0a70 con 0x7f3ad40ffcc0 2023-09-13T09:39:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3adab3e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ad41a0c30 con 0x7f3ad4100eb0 2023-09-13T09:39:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3ad90db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad41a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3ad90db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad41a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33590/0 (socket says 172.21.15.6:33590) 2023-09-13T09:39:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3ad88da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad40ffcc0 0x7f3ad4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3ad90db700 1 -- 172.21.15.6:0/3504317846 learned_addr learned my addr 172.21.15.6:0/3504317846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.973+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ad4100eb0 0x7f3ad4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad90db700 1 -- 172.21.15.6:0/3504317846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ad4100eb0 msgr2=0x7f3ad4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad90db700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ad4100eb0 0x7f3ad4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad90db700 1 -- 172.21.15.6:0/3504317846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad40ffcc0 msgr2=0x7f3ad4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad90db700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad40ffcc0 0x7f3ad4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad90db700 1 -- 172.21.15.6:0/3504317846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3acc009d00 con 0x7f3ad4101850 2023-09-13T09:39:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad90db700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad41a0330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3acc007a00 tx=0x7f3acc0094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad1ffb700 1 -- 172.21.15.6:0/3504317846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc00e040 con 0x7f3ad4101850 2023-09-13T09:39:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad1ffb700 1 -- 172.21.15.6:0/3504317846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3acc003e10 con 0x7f3ad4101850 2023-09-13T09:39:27.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ad41a0eb0 con 0x7f3ad4101850 2023-09-13T09:39:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3ad1ffb700 1 -- 172.21.15.6:0/3504317846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3acc012a90 con 0x7f3ad4101850 2023-09-13T09:39:27.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.974+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ad41a12f0 con 0x7f3ad4101850 2023-09-13T09:39:27.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.978+0000 7f3ae6d23b80 1 Processor -- start 2023-09-13T09:39:27.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.978+0000 7f3ad1ffb700 1 -- 172.21.15.6:0/3504317846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f3acc0056c0 con 0x7f3ad4101850 2023-09-13T09:39:27.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.978+0000 7f3ae6d23b80 1 -- start start 2023-09-13T09:39:27.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.978+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d1cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.978+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6c74730 con 0x55e2a6d1d010 2023-09-13T09:39:27.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6c72050 con 0x55e2a6d1c6b0 2023-09-13T09:39:27.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6c6d940 con 0x55e2a6d1b9b0 2023-09-13T09:39:27.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33594/0 (socket says 172.21.15.6:33594) 2023-09-13T09:39:27.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 -- 172.21.15.6:0/3667196778 learned_addr learned my addr 172.21.15.6:0/3667196778 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d1cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 -- 172.21.15.6:0/3667196778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1b9b0 msgr2=0x55e2a6d1be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad1ffb700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3ac40a06d0 0x7f3ac40a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 -- 172.21.15.6:0/3667196778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 msgr2=0x55e2a6d1cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d1cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 -- 172.21.15.6:0/3667196778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a6aed5e0 con 0x55e2a6d1d010 2023-09-13T09:39:27.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:27.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad90db700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3ac40a06d0 0x7f3ac40a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad88da700 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1b470 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800bd10 tx=0x7f3ac80106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b419c5613f76b89d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3ad1ffb700 1 -- 172.21.15.6:0/3504317846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f3acc0cd430 con 0x7f3ad4101850 2023-09-13T09:39:27.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3abeffd700 1 -- 172.21.15.6:0/3667196778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8010ec0 con 0x55e2a6d1d010 2023-09-13T09:39:27.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3abeffd700 1 -- 172.21.15.6:0/3667196778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ac8015070 con 0x55e2a6d1d010 2023-09-13T09:39:27.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.979+0000 7f3abeffd700 1 -- 172.21.15.6:0/3667196778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac8011440 con 0x55e2a6d1d010 2023-09-13T09:39:27.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ad90db700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3ac40a06d0 0x7f3ac40a2b90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3acc097040 tx=0x7f3acc090520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/3667196778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 msgr2=0x55e2a6d1b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1b470 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f3ac800bd10 tx=0x7f3ac80106b0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/3667196778 shutdown_connections 2023-09-13T09:39:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d1cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/3667196778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1b470 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/3667196778 >> 172.21.15.6:0/3667196778 conn(0x55e2a6c79c30 msgr2=0x55e2a6d15ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/3667196778 shutdown_connections 2023-09-13T09:39:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.980+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/3667196778 wait complete. 2023-09-13T09:39:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 -- start start 2023-09-13T09:39:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 Processor -- start 2023-09-13T09:39:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d24eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d253f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1d010 0x55e2a6d2c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6c0bb60 con 0x55e2a6d1b9b0 2023-09-13T09:39:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6c0b860 con 0x55e2a6d1d010 2023-09-13T09:39:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6aef8d0 con 0x55e2a6d1c6b0 2023-09-13T09:39:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ae6d23b80 10 client.0 _ll_register_callbacks cb 0x55e2a6c09630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d24eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d24eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33600/0 (socket says 172.21.15.6:33600) 2023-09-13T09:39:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1560064785 learned_addr learned my addr 172.21.15.6:0/1560064785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad88da700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1d010 0x55e2a6d2c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 msgr2=0x55e2a6d253f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d253f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1560064785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1d010 msgr2=0x55e2a6d2c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1d010 0x55e2a6d2c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1560064785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ac800b940 con 0x55e2a6d1b9b0 2023-09-13T09:39:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.981+0000 7f3ad88da700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d24eb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0017a20 tx=0x7f3ac000a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32133622ce4245c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ab3fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:27.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1560064785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0012890 con 0x55e2a6d1b9b0 2023-09-13T09:39:27.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1560064785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f3ac00129f0 con 0x55e2a6d1b9b0 2023-09-13T09:39:27.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2a6d0e620 con 0x55e2a6d1b9b0 2023-09-13T09:39:27.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1560064785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ac0012bb0 con 0x55e2a6d1b9b0 2023-09-13T09:39:27.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 10 client.15312 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:27.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e2a6c85750 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1560064785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e2a6d0e620 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1560064785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3ac0018c90 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 10 client.15312 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 10 client.15312 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-13T09:39:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 20 client.15312 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:28.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d2f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 4 client.15312 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:28.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.982+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2a6c66920 con 0x55e2a6d30a30 2023-09-13T09:39:28.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.983+0000 7f3ad88da700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d2f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.983+0000 7f3ab3fff700 10 client.15312 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:28.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.983+0000 7f3ad88da700 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d2f500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e1cc91f8f3efacc server_cookie=2c8a309b96d2506f in_seq=0 out_seq=0 2023-09-13T09:39:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1560064785 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2a6c66920 con 0x55e2a6d30a30 2023-09-13T09:39:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ab3fff700 10 client.15312 handle_command_reply: tid=0 2023-09-13T09:39:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 client.15312 shutdown 2023-09-13T09:39:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 msgr2=0x55e2a6d24eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d24eb0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0017a20 tx=0x7f3ac000a2b0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 shutdown_connections 2023-09-13T09:39:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d2f500 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1d010 0x55e2a6d2c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d24eb0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ab3fff700 0 client.15312 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1560064785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d253f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 >> 172.21.15.6:0/1560064785 conn(0x55e2a6c79c30 msgr2=0x55e2a6d107a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 shutdown_connections 2023-09-13T09:39:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1560064785 wait complete. 2023-09-13T09:39:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:27.984+0000 7f3ae6d23b80 20 client.15312 trim_cache size 0 max 16384 2023-09-13T09:39:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 Processor -- start 2023-09-13T09:39:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 -- start start 2023-09-13T09:39:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d2c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1f890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6c15470 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6c2ddf0 con 0x55e2a6d1c6b0 2023-09-13T09:39:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6afbde0 con 0x55e2a6d1d010 2023-09-13T09:39:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33608/0 (socket says 172.21.15.6:33608) 2023-09-13T09:39:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ad3fff700 1 -- 172.21.15.6:0/2059430424 learned_addr learned my addr 172.21.15.6:0/2059430424 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ad88da700 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d2c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.002+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ad3fff700 1 -- 172.21.15.6:0/2059430424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1d010 msgr2=0x55e2a6d1f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ad3fff700 1 -- 172.21.15.6:0/2059430424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 msgr2=0x55e2a6d2c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d2c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ad3fff700 1 -- 172.21.15.6:0/2059430424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2a6a99d90 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ad88da700 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d2c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1b470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0020640 tx=0x7f3ac000ab80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faebd66db6ea1951 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3abf7fe700 1 -- 172.21.15.6:0/2059430424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac000a5e0 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3abf7fe700 1 -- 172.21.15.6:0/2059430424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ac000c070 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3abf7fe700 1 -- 172.21.15.6:0/2059430424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0012df0 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/2059430424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 msgr2=0x55e2a6d1b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1b470 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0020640 tx=0x7f3ac000ab80 comp rx=0 tx=0).stop 2023-09-13T09:39:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.003+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/2059430424 shutdown_connections 2023-09-13T09:39:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1d010 0x55e2a6d1f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d1b470 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/2059430424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d2c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/2059430424 >> 172.21.15.6:0/2059430424 conn(0x55e2a6c79c30 msgr2=0x55e2a6d22d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/2059430424 shutdown_connections 2023-09-13T09:39:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/2059430424 wait complete. 2023-09-13T09:39:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 -- start start 2023-09-13T09:39:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 Processor -- start 2023-09-13T09:39:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d27110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d27650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d84420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6d2c680 con 0x55e2a6d1d010 2023-09-13T09:39:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6d2c7f0 con 0x55e2a6d1b9b0 2023-09-13T09:39:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2a6d84960 con 0x55e2a6d1c6b0 2023-09-13T09:39:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ae6d23b80 10 client.0 _ll_register_callbacks cb 0x55e2a6c09630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d84420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d84420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33618/0 (socket says 172.21.15.6:33618) 2023-09-13T09:39:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1617302904 learned_addr learned my addr 172.21.15.6:0/1617302904 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.004+0000 7f3ad88da700 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d27650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d27110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 msgr2=0x55e2a6d27650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d27650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1617302904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1b9b0 msgr2=0x55e2a6d27110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d27110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ad3fff700 1 -- 172.21.15.6:0/1617302904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e2a6c85750 con 0x55e2a6d1d010 2023-09-13T09:39:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ad3fff700 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d84420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000ac30 tx=0x7f3ac0004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c83ec13fff13b27 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ab3fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1617302904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ac0012bd0 con 0x55e2a6d1d010 2023-09-13T09:39:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1617302904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f3ac0000e40 con 0x55e2a6d1d010 2023-09-13T09:39:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ac8015070 con 0x55e2a6d1d010 2023-09-13T09:39:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1617302904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ac0012d30 con 0x55e2a6d1d010 2023-09-13T09:39:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ae6d23b80 10 client.15318 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55e2a6a82c10 con 0x55e2a6d1d010 2023-09-13T09:39:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1617302904 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3ac8015070 con 0x55e2a6d1d010 2023-09-13T09:39:28.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.005+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1617302904 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3ac0006020 con 0x55e2a6d1d010 2023-09-13T09:39:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ae6d23b80 10 client.15318 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ae6d23b80 10 client.15318 resolve_mds: resolved name 'i' to daemon mds.i 2023-09-13T09:39:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ae6d23b80 20 client.15318 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d85c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ae6d23b80 4 client.15318 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:28.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e2a6c27000 con 0x55e2a6d30a30 2023-09-13T09:39:28.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:27 smithi006 ceph-mon[98665]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:28.024 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:27 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1611445200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:28.025 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:27 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3339520892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:28.025 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:27 smithi131 ceph-mon[102785]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:28.026 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:27 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1611445200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:28.026 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:27 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3339520892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:28.026 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:27 smithi053 ceph-mon[102373]: pgmap v296: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:39:28.026 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:27 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1611445200' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:28.026 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:27 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3339520892' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ad88da700 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d85c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ab3fff700 10 client.15318 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.006+0000 7f3ad88da700 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d85c40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5cc20f2e1e054da server_cookie=eb5368cdb4c1376c in_seq=0 out_seq=0 2023-09-13T09:39:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ab3fff700 1 -- 172.21.15.6:0/1617302904 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55e2a6c27000 con 0x55e2a6d30a30 2023-09-13T09:39:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ab3fff700 10 client.15318 handle_command_reply: tid=0 2023-09-13T09:39:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 client.15318 shutdown 2023-09-13T09:39:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 msgr2=0x55e2a6d84420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d84420 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f3ac000ac30 tx=0x7f3ac0004860 comp rx=0 tx=0).stop 2023-09-13T09:39:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 shutdown_connections 2023-09-13T09:39:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e2a6d30a30 0x55e2a6d85c40 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2a6d1d010 0x55e2a6d84420 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ab3fff700 0 client.15318 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:39:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2a6d1b9b0 0x55e2a6d27110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 --2- 172.21.15.6:0/1617302904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2a6d1c6b0 0x55e2a6d27650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 >> 172.21.15.6:0/1617302904 conn(0x55e2a6c79c30 msgr2=0x55e2a6d1f890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 shutdown_connections 2023-09-13T09:39:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 1 -- 172.21.15.6:0/1617302904 wait complete. 2023-09-13T09:39:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.007+0000 7f3ae6d23b80 20 client.15318 trim_cache size 0 max 16384 2023-09-13T09:39:28.031 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:28.032 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:28.032 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 1, 2023-09-13T09:39:28.032 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24484, 2023-09-13T09:39:28.032 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:28.032 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:28.033 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:28.033 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 75.259651895000005, 2023-09-13T09:39:28.033 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:28.033 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 86, 2023-09-13T09:39:28.033 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:28.034 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 90.887959796999994 2023-09-13T09:39:28.034 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3ac40a06d0 msgr2=0x7f3ac40a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3ac40a06d0 0x7f3ac40a2b90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3acc097040 tx=0x7f3acc090520 comp rx=0 tx=0).stop 2023-09-13T09:39:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 msgr2=0x7f3ad41a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad41a0330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f3acc007a00 tx=0x7f3acc0094c0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 shutdown_connections 2023-09-13T09:39:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3ac40a06d0 0x7f3ac40a2b90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ad4101850 0x7f3ad41a0330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3ad40ffcc0 0x7f3ad4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 --2- 172.21.15.6:0/3504317846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3ad4100eb0 0x7f3ad4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 >> 172.21.15.6:0/3504317846 conn(0x7f3ad40fb250 msgr2=0x7f3ad40fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 shutdown_connections 2023-09-13T09:39:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.008+0000 7f3adab3e700 1 -- 172.21.15.6:0/3504317846 wait complete. 2023-09-13T09:39:28.038 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-09-13T09:39:28.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 -- 172.21.15.6:0/1044346156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e40ffcc0 msgr2=0x7f30e41000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 --2- 172.21.15.6:0/1044346156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e40ffcc0 0x7f30e41000e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0099c0 tx=0x7f30cc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 -- 172.21.15.6:0/1044346156 shutdown_connections 2023-09-13T09:39:28.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 --2- 172.21.15.6:0/1044346156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30e4101850 0x7f30e4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 --2- 172.21.15.6:0/1044346156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e40ffcc0 0x7f30e41000e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 --2- 172.21.15.6:0/1044346156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e4100eb0 0x7f30e4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 -- 172.21.15.6:0/1044346156 >> 172.21.15.6:0/1044346156 conn(0x7f30e40fb250 msgr2=0x7f30e40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 -- 172.21.15.6:0/1044346156 shutdown_connections 2023-09-13T09:39:28.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 -- 172.21.15.6:0/1044346156 wait complete. 2023-09-13T09:39:28.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.165+0000 7f30e9494700 1 Processor -- start 2023-09-13T09:39:28.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e9494700 1 -- start start 2023-09-13T09:39:28.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e9494700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30e40ffcc0 0x7f30e4196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e9494700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100eb0 0x7f30e4197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e9494700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e4101850 0x7f30e419e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e9494700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e419e670 con 0x7f30e4100eb0 2023-09-13T09:39:28.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e9494700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e419e7b0 con 0x7f30e4101850 2023-09-13T09:39:28.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e9494700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30e419e940 con 0x7f30e40ffcc0 2023-09-13T09:39:28.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100eb0 0x7f30e4197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100eb0 0x7f30e4197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33630/0 (socket says 172.21.15.6:33630) 2023-09-13T09:39:28.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 -- 172.21.15.6:0/330481628 learned_addr learned my addr 172.21.15.6:0/330481628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:28.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30e40ffcc0 0x7f30e4196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e37fe700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e4101850 0x7f30e419e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 -- 172.21.15.6:0/330481628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30e40ffcc0 msgr2=0x7f30e4196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30e40ffcc0 0x7f30e4196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 -- 172.21.15.6:0/330481628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e4101850 msgr2=0x7f30e419e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e4101850 0x7f30e419e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 -- 172.21.15.6:0/330481628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30cc0095f0 con 0x7f30e4100eb0 2023-09-13T09:39:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e37fe700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e4101850 0x7f30e419e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:28.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.166+0000 7f30e27fc700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100eb0 0x7f30e4197030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c920 tx=0x7f30d400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.167+0000 7f30dbfff700 1 -- 172.21.15.6:0/330481628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4007b00 con 0x7f30e4100eb0 2023-09-13T09:39:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.167+0000 7f30dbfff700 1 -- 172.21.15.6:0/330481628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30d400ce70 con 0x7f30e4100eb0 2023-09-13T09:39:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.167+0000 7f30dbfff700 1 -- 172.21.15.6:0/330481628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40054e0 con 0x7f30e4100eb0 2023-09-13T09:39:28.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.167+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30e419ec20 con 0x7f30e4100eb0 2023-09-13T09:39:28.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.167+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e419f0e0 con 0x7f30e4100eb0 2023-09-13T09:39:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.169+0000 7f30dbfff700 1 -- 172.21.15.6:0/330481628 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f30d4004750 con 0x7f30e4100eb0 2023-09-13T09:39:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.170+0000 7f30dbfff700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30d00a06d0 0x7f30d00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.170+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30d00a06d0 0x7f30d00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.170+0000 7f30dbfff700 1 -- 172.21.15.6:0/330481628 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f30d40cb8d0 con 0x7f30e4100eb0 2023-09-13T09:39:28.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.170+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30d00a06d0 0x7f30d00a2b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009f50 tx=0x7f30cc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 Processor -- start 2023-09-13T09:39:28.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 -- start start 2023-09-13T09:39:28.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7aac0 0x564f47f7aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7b420 0x564f47f79880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f79dc0 0x564f47f7a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47ece730 con 0x564f47f7b420 2023-09-13T09:39:28.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47ecc050 con 0x564f47f79dc0 2023-09-13T09:39:28.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30f5679b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47ec7940 con 0x564f47f7aac0 2023-09-13T09:39:28.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7b420 0x564f47f79880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7b420 0x564f47f79880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33638/0 (socket says 172.21.15.6:33638) 2023-09-13T09:39:28.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 -- 172.21.15.6:0/3105752892 learned_addr learned my addr 172.21.15.6:0/3105752892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:28.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7aac0 0x564f47f7aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e37fe700 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f79dc0 0x564f47f7a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 -- 172.21.15.6:0/3105752892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7aac0 msgr2=0x564f47f7aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7aac0 0x564f47f7aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 -- 172.21.15.6:0/3105752892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f79dc0 msgr2=0x564f47f7a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f79dc0 0x564f47f7a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e27fc700 1 -- 172.21.15.6:0/3105752892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f47d475e0 con 0x564f47f7b420 2023-09-13T09:39:28.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.171+0000 7f30e37fe700 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f79dc0 0x564f47f7a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:28.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.172+0000 7f30e27fc700 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7b420 0x564f47f79880 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f30d4004fa0 tx=0x7f30d4099670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec92642e4b984418 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.172+0000 7f30d97fa700 1 -- 172.21.15.6:0/3105752892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40a0fc0 con 0x564f47f7b420 2023-09-13T09:39:28.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.172+0000 7f30d97fa700 1 -- 172.21.15.6:0/3105752892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30d40c94c0 con 0x564f47f7b420 2023-09-13T09:39:28.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.172+0000 7f30d97fa700 1 -- 172.21.15.6:0/3105752892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40991b0 con 0x564f47f7b420 2023-09-13T09:39:28.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.172+0000 7f30f5679b80 1 -- 172.21.15.6:0/3105752892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7b420 msgr2=0x564f47f79880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.172+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7b420 0x564f47f79880 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f30d4004fa0 tx=0x7f30d4099670 comp rx=0 tx=0).stop 2023-09-13T09:39:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- 172.21.15.6:0/3105752892 shutdown_connections 2023-09-13T09:39:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f79dc0 0x564f47f7a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7aac0 0x564f47f7aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3105752892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7b420 0x564f47f79880 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- 172.21.15.6:0/3105752892 >> 172.21.15.6:0/3105752892 conn(0x564f47ed3c30 msgr2=0x564f47f6fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- 172.21.15.6:0/3105752892 shutdown_connections 2023-09-13T09:39:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- 172.21.15.6:0/3105752892 wait complete. 2023-09-13T09:39:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- start start 2023-09-13T09:39:28.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 Processor -- start 2023-09-13T09:39:28.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f83370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f838b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47e65b60 con 0x564f47f79dc0 2023-09-13T09:39:28.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47e65860 con 0x564f47f7aac0 2023-09-13T09:39:28.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47d498d0 con 0x564f47f7b420 2023-09-13T09:39:28.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30f5679b80 10 client.0 _ll_register_callbacks cb 0x564f47e63630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:28.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f83370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f83370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33640/0 (socket says 172.21.15.6:33640) 2023-09-13T09:39:28.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30e2ffd700 1 -- 172.21.15.6:0/705617992 learned_addr learned my addr 172.21.15.6:0/705617992 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:28.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.173+0000 7f30e27fc700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f838b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e37fe700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e2ffd700 1 -- 172.21.15.6:0/705617992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 msgr2=0x564f47f8a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e2ffd700 1 -- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 msgr2=0x564f47f838b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f838b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e2ffd700 1 -- 172.21.15.6:0/705617992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30e419f0e0 con 0x564f47f79dc0 2023-09-13T09:39:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e37fe700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f83370 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0099c0 tx=0x7f30cc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=350ef24dfc5131a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:28.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30ca7fc700 1 -- 172.21.15.6:0/705617992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00bec0 con 0x564f47f79dc0 2023-09-13T09:39:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30ca7fc700 1 -- 172.21.15.6:0/705617992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f30cc0056b0 con 0x564f47f79dc0 2023-09-13T09:39:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f47f68620 con 0x564f47f79dc0 2023-09-13T09:39:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30ca7fc700 1 -- 172.21.15.6:0/705617992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30cc004500 con 0x564f47f79dc0 2023-09-13T09:39:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30f5679b80 10 client.15330 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:28.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564f47edf750 con 0x564f47f79dc0 2023-09-13T09:39:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.174+0000 7f30ca7fc700 1 -- 172.21.15.6:0/705617992 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30cc03f020 con 0x564f47f79dc0 2023-09-13T09:39:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30ca7fc700 1 -- 172.21.15.6:0/705617992 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30cc02f070 con 0x564f47f79dc0 2023-09-13T09:39:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30f5679b80 10 client.15330 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30f5679b80 10 client.15330 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T09:39:28.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30f5679b80 20 client.15330 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30f5679b80 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47f8ef60 0x564f47f8d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30f5679b80 4 client.15330 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f47ec0920 con 0x564f47f8ef60 2023-09-13T09:39:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30e27fc700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47f8ef60 0x564f47f8d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30ca7fc700 10 client.15330 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:28.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.175+0000 7f30e27fc700 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47f8ef60 0x564f47f8d9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e70664a70d663f8 server_cookie=f31ca2cced99c1c4 in_seq=0 out_seq=0 2023-09-13T09:39:28.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30ca7fc700 1 -- 172.21.15.6:0/705617992 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564f47ec0920 con 0x564f47f8ef60 2023-09-13T09:39:28.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30ca7fc700 10 client.15330 handle_command_reply: tid=0 2023-09-13T09:39:28.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 client.15330 shutdown 2023-09-13T09:39:28.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 msgr2=0x564f47f83370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f83370 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0099c0 tx=0x7f30cc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 shutdown_connections 2023-09-13T09:39:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47f8ef60 0x564f47f8d9f0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f83370 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30ca7fc700 0 client.15330 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 --2- 172.21.15.6:0/705617992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f838b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 >> 172.21.15.6:0/705617992 conn(0x564f47ed3c30 msgr2=0x564f47f6a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 shutdown_connections 2023-09-13T09:39:28.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 1 -- 172.21.15.6:0/705617992 wait complete. 2023-09-13T09:39:28.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.176+0000 7f30f5679b80 20 client.15330 trim_cache size 0 max 16384 2023-09-13T09:39:28.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 Processor -- start 2023-09-13T09:39:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 -- start start 2023-09-13T09:39:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f79dc0 0x564f47f81fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7aac0 0x564f47f8a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7b420 0x564f47f7dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47e87df0 con 0x564f47f7aac0 2023-09-13T09:39:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47d55de0 con 0x564f47f7b420 2023-09-13T09:39:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.194+0000 7f30f5679b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47e61e00 con 0x564f47f79dc0 2023-09-13T09:39:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7aac0 0x564f47f8a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7aac0 0x564f47f8a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33650/0 (socket says 172.21.15.6:33650) 2023-09-13T09:39:28.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 -- 172.21.15.6:0/3512680146 learned_addr learned my addr 172.21.15.6:0/3512680146 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:28.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f79dc0 0x564f47f81fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e37fe700 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7b420 0x564f47f7dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 -- 172.21.15.6:0/3512680146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f79dc0 msgr2=0x564f47f81fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f79dc0 0x564f47f81fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 -- 172.21.15.6:0/3512680146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7b420 msgr2=0x564f47f7dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7b420 0x564f47f7dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 -- 172.21.15.6:0/3512680146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f47cf3d90 con 0x564f47f7aac0 2023-09-13T09:39:28.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e37fe700 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7b420 0x564f47f7dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:28.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30e27fc700 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7aac0 0x564f47f8a8b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f30d4098e90 tx=0x7f30d4099090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0dc48f9d908cf77 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30d9ffb700 1 -- 172.21.15.6:0/3512680146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d4005720 con 0x564f47f7aac0 2023-09-13T09:39:28.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30d9ffb700 1 -- 172.21.15.6:0/3512680146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30d4007c60 con 0x564f47f7aac0 2023-09-13T09:39:28.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.195+0000 7f30d9ffb700 1 -- 172.21.15.6:0/3512680146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30d40991b0 con 0x564f47f7aac0 2023-09-13T09:39:28.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 -- 172.21.15.6:0/3512680146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7aac0 msgr2=0x564f47f8a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7aac0 0x564f47f8a8b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f30d4098e90 tx=0x7f30d4099090 comp rx=0 tx=0).stop 2023-09-13T09:39:28.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 -- 172.21.15.6:0/3512680146 shutdown_connections 2023-09-13T09:39:28.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7b420 0x564f47f7dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f79dc0 0x564f47f81fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 --2- 172.21.15.6:0/3512680146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f7aac0 0x564f47f8a8b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 -- 172.21.15.6:0/3512680146 >> 172.21.15.6:0/3512680146 conn(0x564f47ed3c30 msgr2=0x564f47f6fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 -- 172.21.15.6:0/3512680146 shutdown_connections 2023-09-13T09:39:28.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 -- 172.21.15.6:0/3512680146 wait complete. 2023-09-13T09:39:28.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 -- start start 2023-09-13T09:39:28.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 Processor -- start 2023-09-13T09:39:28.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f84ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f84ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.196+0000 7f30f5679b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30f5679b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47f8a560 con 0x564f47f79dc0 2023-09-13T09:39:28.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30f5679b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47f8a6d0 con 0x564f47f7aac0 2023-09-13T09:39:28.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30f5679b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f47f8a890 con 0x564f47f7b420 2023-09-13T09:39:28.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30f5679b80 10 client.0 _ll_register_callbacks cb 0x564f47e63630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:28.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f84ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f84ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33654/0 (socket says 172.21.15.6:33654) 2023-09-13T09:39:28.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 -- 172.21.15.6:0/423460372 learned_addr learned my addr 172.21.15.6:0/423460372 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:28.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e37fe700 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 -- 172.21.15.6:0/423460372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 msgr2=0x564f47f8a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 -- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 msgr2=0x564f47f84ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:28.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e27fc700 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f84ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f84ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 -- 172.21.15.6:0/423460372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564f47d475e0 con 0x564f47f79dc0 2023-09-13T09:39:28.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30e2ffd700 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f84ab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0036f0 tx=0x7f30cc00bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97f875a4123efa9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:28.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30ca7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30ca7fc700 1 -- 172.21.15.6:0/423460372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30cc044680 con 0x564f47f79dc0 2023-09-13T09:39:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30ca7fc700 1 -- 172.21.15.6:0/423460372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f30cc040080 con 0x564f47f79dc0 2023-09-13T09:39:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30d40c94c0 con 0x564f47f79dc0 2023-09-13T09:39:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30ca7fc700 1 -- 172.21.15.6:0/423460372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30cc00f670 con 0x564f47f79dc0 2023-09-13T09:39:28.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30f5679b80 10 client.15336 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:28.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.197+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x564f47cdcc10 con 0x564f47f79dc0 2023-09-13T09:39:28.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30ca7fc700 1 -- 172.21.15.6:0/423460372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30d40c94c0 con 0x564f47f79dc0 2023-09-13T09:39:28.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30ca7fc700 1 -- 172.21.15.6:0/423460372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30cc0038c0 con 0x564f47f79dc0 2023-09-13T09:39:28.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30f5679b80 10 client.15336 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:28.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30f5679b80 10 client.15336 resolve_mds: resolved name 'b' to daemon mds.b 2023-09-13T09:39:28.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30f5679b80 20 client.15336 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:28.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30f5679b80 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47fe71d0 0x564f47fe36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:28.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30f5679b80 4 client.15336 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "status"}] 2023-09-13T09:39:28.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564f47e81000 con 0x564f47fe71d0 2023-09-13T09:39:28.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.198+0000 7f30e27fc700 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47fe71d0 0x564f47fe36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:28.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30ca7fc700 10 client.15336 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:28.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30e27fc700 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47fe71d0 0x564f47fe36b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2068e18409b860b3 server_cookie=ab068aa548d93f50 in_seq=0 out_seq=0 2023-09-13T09:39:28.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30ca7fc700 1 -- 172.21.15.6:0/423460372 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564f47e81000 con 0x564f47fe71d0 2023-09-13T09:39:28.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30ca7fc700 10 client.15336 handle_command_reply: tid=0 2023-09-13T09:39:28.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 client.15336 shutdown 2023-09-13T09:39:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 msgr2=0x564f47f84ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f84ab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0036f0 tx=0x7f30cc00bf70 comp rx=0 tx=0).stop 2023-09-13T09:39:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 shutdown_connections 2023-09-13T09:39:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564f47f7b420 0x564f47f8a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564f47fe71d0 0x564f47fe36b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564f47f79dc0 0x564f47f84ab0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 --2- 172.21.15.6:0/423460372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564f47f7aac0 0x564f47f84ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30ca7fc700 0 client.15336 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 >> 172.21.15.6:0/423460372 conn(0x564f47ed3c30 msgr2=0x564f47f81fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 shutdown_connections 2023-09-13T09:39:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 1 -- 172.21.15.6:0/423460372 wait complete. 2023-09-13T09:39:28.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30f5679b80 20 client.15336 trim_cache size 0 max 16384 2023-09-13T09:39:28.223 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:28.224 INFO:teuthology.orchestra.run.smithi006.stdout: "cluster_fsid": "27a2bbd4-5218-11ee-9ab8-7b867c8bd7da", 2023-09-13T09:39:28.224 INFO:teuthology.orchestra.run.smithi006.stdout: "whoami": 0, 2023-09-13T09:39:28.224 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 24521, 2023-09-13T09:39:28.224 INFO:teuthology.orchestra.run.smithi006.stdout: "want_state": "up:active", 2023-09-13T09:39:28.224 INFO:teuthology.orchestra.run.smithi006.stdout: "state": "up:active", 2023-09-13T09:39:28.225 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs", 2023-09-13T09:39:28.225 INFO:teuthology.orchestra.run.smithi006.stdout: "rank_uptime": 78.464819832000003, 2023-09-13T09:39:28.225 INFO:teuthology.orchestra.run.smithi006.stdout: "mdsmap_epoch": 26, 2023-09-13T09:39:28.225 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch": 86, 2023-09-13T09:39:28.225 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_epoch_barrier": 84, 2023-09-13T09:39:28.225 INFO:teuthology.orchestra.run.smithi006.stdout: "uptime": 84.195408544000003 2023-09-13T09:39:28.226 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30d00a06d0 msgr2=0x7f30d00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.199+0000 7f30e9494700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30d00a06d0 0x7f30d00a2b90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009f50 tx=0x7f30cc00b540 comp rx=0 tx=0).stop 2023-09-13T09:39:28.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100eb0 msgr2=0x7f30e4197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100eb0 0x7f30e4197030 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f30d400c920 tx=0x7f30d400cc30 comp rx=0 tx=0).stop 2023-09-13T09:39:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 shutdown_connections 2023-09-13T09:39:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30e4101850 0x7f30e419e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30e40ffcc0 0x7f30e4196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30d00a06d0 0x7f30d00a2b90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 --2- 172.21.15.6:0/330481628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30e4100eb0 0x7f30e4197030 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:28.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 >> 172.21.15.6:0/330481628 conn(0x7f30e40fb250 msgr2=0x7f30e4068050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:28.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 shutdown_connections 2023-09-13T09:39:28.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:28.200+0000 7f30e9494700 1 -- 172.21.15.6:0/330481628 wait complete. 2023-09-13T09:39:28.230 INFO:teuthology.run_tasks:Running task kclient... 2023-09-13T09:39:28.252 INFO:tasks.kclient:Mounting kernel clients... 2023-09-13T09:39:28.253 INFO:tasks.kclient:config is {'client.0': {}} 2023-09-13T09:39:28.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:28.254 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-09-13T09:39:28.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:28.272 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-09-13T09:39:28.341 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-09-13T09:39:28.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T09:39:28.343 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'wsync'], 'syntax': 'v1', 'mount_subvol_num': 1} 2023-09-13T09:39:28.343 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-13T09:39:28.344 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:28.344 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph fs ls 2023-09-13T09:39:28.944 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T09:39:30.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:29 smithi053 ceph-mon[102373]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:30.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:29 smithi006 ceph-mon[98665]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:30.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:29 smithi131 ceph-mon[102785]: pgmap v297: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:30.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 -- 172.21.15.6:0/655103189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 msgr2=0x7f53b410ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:30.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 --2- 172.21.15.6:0/655103189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b410ca90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f53ac00b0d0 tx=0x7f53ac00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 -- 172.21.15.6:0/655103189 shutdown_connections 2023-09-13T09:39:30.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 --2- 172.21.15.6:0/655103189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b410ca90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 --2- 172.21.15.6:0/655103189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4105c70 0x7f53b4106050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 --2- 172.21.15.6:0/655103189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b40ffc60 0x7f53b41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 -- 172.21.15.6:0/655103189 >> 172.21.15.6:0/655103189 conn(0x7f53b4075c00 msgr2=0x7f53b4076010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 -- 172.21.15.6:0/655103189 shutdown_connections 2023-09-13T09:39:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.116+0000 7f53bc327700 1 -- 172.21.15.6:0/655103189 wait complete. 2023-09-13T09:39:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 Processor -- start 2023-09-13T09:39:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 -- start start 2023-09-13T09:39:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b40ffc60 0x7f53b4199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b41995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4105c70 0x7f53b419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b419e040 con 0x7f53b4100620 2023-09-13T09:39:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b419e1b0 con 0x7f53b4105c70 2023-09-13T09:39:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53bc327700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b419e370 con 0x7f53b40ffc60 2023-09-13T09:39:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53b98c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b41995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53b98c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b41995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33668/0 (socket says 172.21.15.6:33668) 2023-09-13T09:39:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53b98c2700 1 -- 172.21.15.6:0/1324705870 learned_addr learned my addr 172.21.15.6:0/1324705870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53ba8c4700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4105c70 0x7f53b419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53ba0c3700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b40ffc60 0x7f53b4199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53b98c2700 1 -- 172.21.15.6:0/1324705870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b40ffc60 msgr2=0x7f53b4199080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53b98c2700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b40ffc60 0x7f53b4199080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.117+0000 7f53b98c2700 1 -- 172.21.15.6:0/1324705870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4105c70 msgr2=0x7f53b419da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53b98c2700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4105c70 0x7f53b419da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53b98c2700 1 -- 172.21.15.6:0/1324705870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53ac009d00 con 0x7f53b4100620 2023-09-13T09:39:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53b98c2700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b41995c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c920 tx=0x7f53b000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53ab7fe700 1 -- 172.21.15.6:0/1324705870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0004a30 con 0x7f53b4100620 2023-09-13T09:39:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b419e650 con 0x7f53b4100620 2023-09-13T09:39:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53ab7fe700 1 -- 172.21.15.6:0/1324705870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53b00054e0 con 0x7f53b4100620 2023-09-13T09:39:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53ab7fe700 1 -- 172.21.15.6:0/1324705870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b0007c10 con 0x7f53b4100620 2023-09-13T09:39:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.118+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b41a5eb0 con 0x7f53b4100620 2023-09-13T09:39:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.119+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b404e9b0 con 0x7f53b4100620 2023-09-13T09:39:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.120+0000 7f53ab7fe700 1 -- 172.21.15.6:0/1324705870 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f53b0005000 con 0x7f53b4100620 2023-09-13T09:39:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.121+0000 7f53ab7fe700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f53a00a06d0 0x7f53a00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.121+0000 7f53ba0c3700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f53a00a06d0 0x7f53a00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.121+0000 7f53ab7fe700 1 -- 172.21.15.6:0/1324705870 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f53b00cbc50 con 0x7f53b4100620 2023-09-13T09:39:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.121+0000 7f53ba0c3700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f53a00a06d0 0x7f53a00a2b90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f53a4004630 tx=0x7f53a400b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:30.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.125+0000 7f53ab7fe700 1 -- 172.21.15.6:0/1324705870 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f53b0095610 con 0x7f53b4100620 2023-09-13T09:39:30.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.374+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f53b419e7e0 con 0x7f53b4100620 2023-09-13T09:39:30.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.375+0000 7f53ab7fe700 1 -- 172.21.15.6:0/1324705870 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f53b001d060 con 0x7f53b4100620 2023-09-13T09:39:30.375 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-13T09:39:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f53a00a06d0 msgr2=0x7f53a00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f53a00a06d0 0x7f53a00a2b90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f53a4004630 tx=0x7f53a400b3c0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 msgr2=0x7f53b41995c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b41995c0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f53b000c920 tx=0x7f53b000cc30 comp rx=0 tx=0).stop 2023-09-13T09:39:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 shutdown_connections 2023-09-13T09:39:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4105c70 0x7f53b419da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b40ffc60 0x7f53b4199080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f53a00a06d0 0x7f53a00a2b90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 --2- 172.21.15.6:0/1324705870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100620 0x7f53b41995c0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 >> 172.21.15.6:0/1324705870 conn(0x7f53b4075c00 msgr2=0x7f53b40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 shutdown_connections 2023-09-13T09:39:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:30.377+0000 7f53bc327700 1 -- 172.21.15.6:0/1324705870 wait complete. 2023-09-13T09:39:30.793 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-13T09:39:30.794 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-13T09:39:30.794 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2023-09-13T09:39:30.794 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-13T09:39:30.795 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:30.795 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-13T09:39:30.795 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-13T09:39:30.796 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-13T09:39:30.796 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-13T09:39:30.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:30.797 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2023-09-13T09:39:30.815 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-13T09:39:30.815 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-13T09:39:30.816 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2023-09-13T09:39:30.816 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-09-13T09:39:30.816 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2023-09-13T09:39:30.817 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-09-13T09:39:30.817 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T09:39:30.817 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2023-09-13T09:39:30.817 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T09:39:30.817 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2023-09-13T09:39:30.818 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-13T09:39:30.818 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2023-09-13T09:39:30.818 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-13T09:39:30.818 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41856sec preferred_lft 41856sec 2023-09-13T09:39:30.818 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2023-09-13T09:39:30.819 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2023-09-13T09:39:30.819 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-13T09:39:30.819 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2023-09-13T09:39:30.820 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-13T09:39:30.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:30.820 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-09-13T09:39:30.821 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-09-13T09:39:30.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2023-09-13T09:39:30.821 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2023-09-13T09:39:30.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2023-09-13T09:39:30.822 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-13T09:39:30.822 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-09-13T09:39:30.987 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:30.988 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-13T09:39:30.991 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:30 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1324705870' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-13T09:39:31.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:30 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1324705870' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-13T09:39:31.018 INFO:teuthology.orchestra.run.smithi006.stdout:1 2023-09-13T09:39:31.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:30 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1324705870' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-09-13T09:39:31.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.020 DEBUG:teuthology.orchestra.run.smithi006:> route 2023-09-13T09:39:31.097 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2023-09-13T09:39:31.097 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-13T09:39:31.097 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-13T09:39:31.098 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-13T09:39:31.098 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-13T09:39:31.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.099 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-09-13T09:39:31.100 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-09-13T09:39:31.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-13T09:39:31.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-13T09:39:31.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-13T09:39:31.101 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-09-13T09:39:31.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.339 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-09-13T09:39:31.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.358 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2023-09-13T09:39:31.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.415 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-09-13T09:39:31.415 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-09-13T09:39:31.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T09:39:31.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-13T09:39:31.416 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-09-13T09:39:31.512 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-13T09:39:31.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.513 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-09-13T09:39:31.513 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-09-13T09:39:31.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-13T09:39:31.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-13T09:39:31.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-13T09:39:31.514 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-13T09:39:31.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-13T09:39:31.515 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-09-13T09:39:31.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.735 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2023-09-13T09:39:31.736 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2023-09-13T09:39:31.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2023-09-13T09:39:31.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2023-09-13T09:39:31.736 DEBUG:teuthology.orchestra.run.smithi006:> ') 2023-09-13T09:39:31.806 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:31 smithi006 ceph-mon[98665]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:31.838 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T09:39:31.838 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-13T09:39:31.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-13T09:39:31.856 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:31.913 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2023-09-13T09:39:31.913 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2023-09-13T09:39:31.914 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 2023-09-13T09:39:31.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:31.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2023-09-13T09:39:32.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:31 smithi053 ceph-mon[102373]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:32.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:31 smithi131 ceph-mon[102785]: pgmap v298: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:32.021 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2023-09-13T09:39:32.021 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2023-09-13T09:39:32.021 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-09-13T09:39:32.147 INFO:teuthology.orchestra.run.smithi006.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync 2023-09-13T09:39:32.147 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync". 2023-09-13T09:39:32.148 INFO:teuthology.orchestra.run.smithi006.stdout:invalid new device string format 2023-09-13T09:39:32.148 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: resolved to: "172.21.15.6:3300,172.21.15.53:3300,172.21.15.131:3300" 2023-09-13T09:39:32.148 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.6:3300,172.21.15.53:3300,172.21.15.131:3300:/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 2023-09-13T09:39:32.148 INFO:teuthology.orchestra.run.smithi006.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,wsync,key=0,fsid=27a2bbd4-5218-11ee-9ab8-7b867c8bd7da" will pass to kernel 2023-09-13T09:39:32.150 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-09-13T09:39:32.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:32.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:32.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:32.207 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T09:39:32.270 INFO:teuthology.orchestra.run.smithi006.stdout:client24971 2023-09-13T09:39:32.271 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:39:32.271 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T09:39:32.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:32.289 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T09:39:32.389 INFO:teuthology.orchestra.run.smithi006.stdout:client24971 2023-09-13T09:39:32.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:32.390 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-09-13T09:39:32.451 INFO:teuthology.orchestra.run.smithi006.stdout:client24971 2023-09-13T09:39:32.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T09:39:32.452 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da.client24971/status') 2023-09-13T09:39:32.518 INFO:teuthology.orchestra.run.smithi006.stdout:instance: client.24971 (3)172.21.15.6:0/1182429868 2023-09-13T09:39:32.518 INFO:teuthology.orchestra.run.smithi006.stdout:blocklisted: false 2023-09-13T09:39:32.519 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records in 2023-09-13T09:39:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:0+1 records out 2023-09-13T09:39:32.520 INFO:teuthology.orchestra.run.smithi006.stderr:70 bytes copied, 2.3936e-05 s, 2.9 MB/s 2023-09-13T09:39:32.520 INFO:teuthology.run_tasks:Running task check-counter... 2023-09-13T09:39:32.532 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-09-13T09:39:32.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:32.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 -- 172.21.15.6:0/3100463197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 msgr2=0x7f8cdc106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 --2- 172.21.15.6:0/3100463197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc106560 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc009990 tx=0x7f8ccc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 -- 172.21.15.6:0/3100463197 shutdown_connections 2023-09-13T09:39:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 --2- 172.21.15.6:0/3100463197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cdc106aa0 0x7f8cdc108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 --2- 172.21.15.6:0/3100463197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cdc101840 0x7f8cdc103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 --2- 172.21.15.6:0/3100463197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc106560 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 -- 172.21.15.6:0/3100463197 >> 172.21.15.6:0/3100463197 conn(0x7f8cdc0fb250 msgr2=0x7f8cdc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:32.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 -- 172.21.15.6:0/3100463197 shutdown_connections 2023-09-13T09:39:32.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.697+0000 7f8ce479a700 1 -- 172.21.15.6:0/3100463197 wait complete. 2023-09-13T09:39:32.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 Processor -- start 2023-09-13T09:39:32.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 -- start start 2023-09-13T09:39:32.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cdc101840 0x7f8cdc196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:32.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:32.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cdc106aa0 0x7f8cdc19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:32.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc19e5d0 con 0x7f8cdc104170 2023-09-13T09:39:32.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc19e710 con 0x7f8cdc101840 2023-09-13T09:39:32.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce479a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cdc19e8a0 con 0x7f8cdc106aa0 2023-09-13T09:39:32.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:32.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33696/0 (socket says 172.21.15.6:33696) 2023-09-13T09:39:32.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 -- 172.21.15.6:0/884370564 learned_addr learned my addr 172.21.15.6:0/884370564 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:32.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce2536700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cdc101840 0x7f8cdc196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:32.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce2d37700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cdc106aa0 0x7f8cdc19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:32.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 -- 172.21.15.6:0/884370564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cdc106aa0 msgr2=0x7f8cdc19e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:32.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cdc106aa0 0x7f8cdc19e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 -- 172.21.15.6:0/884370564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cdc101840 msgr2=0x7f8cdc196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cdc101840 0x7f8cdc196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 -- 172.21.15.6:0/884370564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ccc0095f0 con 0x7f8cdc104170 2023-09-13T09:39:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.698+0000 7f8ce1d35700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc196f90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc000c00 tx=0x7f8ccc00f710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.699+0000 7f8cd37fe700 1 -- 172.21.15.6:0/884370564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc01d070 con 0x7f8cdc104170 2023-09-13T09:39:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.699+0000 7f8cd37fe700 1 -- 172.21.15.6:0/884370564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ccc00fb50 con 0x7f8cdc104170 2023-09-13T09:39:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.699+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cdc19eb20 con 0x7f8cdc104170 2023-09-13T09:39:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.699+0000 7f8cd37fe700 1 -- 172.21.15.6:0/884370564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc017650 con 0x7f8cdc104170 2023-09-13T09:39:32.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.699+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cdc19efd0 con 0x7f8cdc104170 2023-09-13T09:39:32.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.700+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cdc0fcdd0 con 0x7f8cdc104170 2023-09-13T09:39:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.701+0000 7f8cd37fe700 1 -- 172.21.15.6:0/884370564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f8ccc00fcc0 con 0x7f8cdc104170 2023-09-13T09:39:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.701+0000 7f8cd37fe700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a06d0 0x7f8cc80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.702+0000 7f8ce2536700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a06d0 0x7f8cc80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:32.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.702+0000 7f8cd37fe700 1 -- 172.21.15.6:0/884370564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f8ccc0cd0b0 con 0x7f8cdc104170 2023-09-13T09:39:32.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.702+0000 7f8ce2536700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a06d0 0x7f8cc80a2b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8005950 tx=0x7f8cd800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:32.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.706+0000 7f8cd37fe700 1 -- 172.21.15.6:0/884370564 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8ccc096c20 con 0x7f8cdc104170 2023-09-13T09:39:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.911+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cdc10c790 con 0x7f8cdc104170 2023-09-13T09:39:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.912+0000 7f8cd37fe700 1 -- 172.21.15.6:0/884370564 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22443 (secure 0 0 0) 0x7f8ccc09a240 con 0x7f8cdc104170 2023-09-13T09:39:32.913 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:32.913 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:39:07.896691+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a06d0 msgr2=0x7f8cc80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a06d0 0x7f8cc80a2b90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8005950 tx=0x7f8cd800b410 comp rx=0 tx=0).stop 2023-09-13T09:39:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 msgr2=0x7f8cdc196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc196f90 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc000c00 tx=0x7f8ccc00f710 comp rx=0 tx=0).stop 2023-09-13T09:39:32.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 shutdown_connections 2023-09-13T09:39:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cdc106aa0 0x7f8cdc19e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cdc101840 0x7f8cdc196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a06d0 0x7f8cc80a2b90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 --2- 172.21.15.6:0/884370564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cdc104170 0x7f8cdc196f90 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:32.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 >> 172.21.15.6:0/884370564 conn(0x7f8cdc0fb250 msgr2=0x7f8cdc1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:32.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 shutdown_connections 2023-09-13T09:39:32.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:32.914+0000 7f8ce479a700 1 -- 172.21.15.6:0/884370564 wait complete. 2023-09-13T09:39:32.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:39:32.929 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:39:33.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 -- 172.21.15.6:0/3299094807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c101850 msgr2=0x7fbc5c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/3299094807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c101850 0x7fbc5c108100 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fbc5400b0d0 tx=0x7fbc5400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 -- 172.21.15.6:0/3299094807 shutdown_connections 2023-09-13T09:39:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/3299094807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c101850 0x7fbc5c108100 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/3299094807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc5c0ffcc0 0x7fbc5c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/3299094807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c100eb0 0x7fbc5c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 -- 172.21.15.6:0/3299094807 >> 172.21.15.6:0/3299094807 conn(0x7fbc5c0fb250 msgr2=0x7fbc5c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 -- 172.21.15.6:0/3299094807 shutdown_connections 2023-09-13T09:39:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 -- 172.21.15.6:0/3299094807 wait complete. 2023-09-13T09:39:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.059+0000 7fbc61fd4700 1 Processor -- start 2023-09-13T09:39:33.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc61fd4700 1 -- start start 2023-09-13T09:39:33.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc61fd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c0ffcc0 0x7fbc5c10a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc61fd4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc5c100eb0 0x7fbc5c108c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc61fd4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c101850 0x7fbc5c109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc61fd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c1098f0 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc61fd4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c109a60 con 0x7fbc5c101850 2023-09-13T09:39:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc61fd4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc5c1a0be0 con 0x7fbc5c100eb0 2023-09-13T09:39:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c0ffcc0 0x7fbc5c10a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c0ffcc0 0x7fbc5c10a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33708/0 (socket says 172.21.15.6:33708) 2023-09-13T09:39:33.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 -- 172.21.15.6:0/2279691392 learned_addr learned my addr 172.21.15.6:0/2279691392 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5affd700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc5c100eb0 0x7fbc5c108c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5bfff700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c101850 0x7fbc5c109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 -- 172.21.15.6:0/2279691392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc5c100eb0 msgr2=0x7fbc5c108c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc5c100eb0 0x7fbc5c108c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 -- 172.21.15.6:0/2279691392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c101850 msgr2=0x7fbc5c109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c101850 0x7fbc5c109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.060+0000 7fbc5b7fe700 1 -- 172.21.15.6:0/2279691392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc54009d00 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.061+0000 7fbc5b7fe700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c0ffcc0 0x7fbc5c10a5d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c970 tx=0x7fbc4400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.061+0000 7fbc58ff9700 1 -- 172.21.15.6:0/2279691392 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44004220 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.061+0000 7fbc58ff9700 1 -- 172.21.15.6:0/2279691392 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc44007d60 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.061+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc5c1a0ec0 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.061+0000 7fbc58ff9700 1 -- 172.21.15.6:0/2279691392 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc44003c90 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.061+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc5c1a12e0 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.062+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc5c106ba0 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.064+0000 7fbc58ff9700 1 -- 172.21.15.6:0/2279691392 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fbc44004380 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.064+0000 7fbc58ff9700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc480a06d0 0x7fbc480a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.064+0000 7fbc58ff9700 1 -- 172.21.15.6:0/2279691392 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fbc440cbc90 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.064+0000 7fbc5affd700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc480a06d0 0x7fbc480a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.065+0000 7fbc5affd700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc480a06d0 0x7fbc480a2b90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c005950 tx=0x7fbc4c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:33.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.068+0000 7fbc58ff9700 1 -- 172.21.15.6:0/2279691392 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbc44095650 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.271+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc5c10c8f0 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.272+0000 7fbc58ff9700 1 -- 172.21.15.6:0/2279691392 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc4401d020 con 0x7fbc5c0ffcc0 2023-09-13T09:39:33.272 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:39:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc480a06d0 msgr2=0x7fbc480a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc480a06d0 0x7fbc480a2b90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c005950 tx=0x7fbc4c00b410 comp rx=0 tx=0).stop 2023-09-13T09:39:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c0ffcc0 msgr2=0x7fbc5c10a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c0ffcc0 0x7fbc5c10a5d0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fbc4400c970 tx=0x7fbc4400cc80 comp rx=0 tx=0).stop 2023-09-13T09:39:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 shutdown_connections 2023-09-13T09:39:33.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc5c101850 0x7fbc5c109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc480a06d0 0x7fbc480a2b90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc5c0ffcc0 0x7fbc5c10a5d0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 --2- 172.21.15.6:0/2279691392 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc5c100eb0 0x7fbc5c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 >> 172.21.15.6:0/2279691392 conn(0x7fbc5c0fb250 msgr2=0x7fbc5c0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 shutdown_connections 2023-09-13T09:39:33.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.274+0000 7fbc61fd4700 1 -- 172.21.15.6:0/2279691392 wait complete. 2023-09-13T09:39:33.287 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T09:39:33.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 -- 172.21.15.6:0/1364602337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 msgr2=0x7f8c38108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/1364602337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c38108100 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f8c3000b0d0 tx=0x7f8c3000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 -- 172.21.15.6:0/1364602337 shutdown_connections 2023-09-13T09:39:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/1364602337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c38108100 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/1364602337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c380ffcc0 0x7f8c381000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/1364602337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c38100eb0 0x7f8c38101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 -- 172.21.15.6:0/1364602337 >> 172.21.15.6:0/1364602337 conn(0x7f8c380fb250 msgr2=0x7f8c380fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 -- 172.21.15.6:0/1364602337 shutdown_connections 2023-09-13T09:39:33.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.417+0000 7f8c3cc93700 1 -- 172.21.15.6:0/1364602337 wait complete. 2023-09-13T09:39:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 Processor -- start 2023-09-13T09:39:33.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 -- start start 2023-09-13T09:39:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c380ffcc0 0x7f8c38198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c38100eb0 0x7f8c38199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c381a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381a0960 con 0x7f8c38101850 2023-09-13T09:39:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381a0aa0 con 0x7f8c380ffcc0 2023-09-13T09:39:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3cc93700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c381a0c30 con 0x7f8c38100eb0 2023-09-13T09:39:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c381a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c381a0390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33726/0 (socket says 172.21.15.6:33726) 2023-09-13T09:39:33.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 -- 172.21.15.6:0/12390279 learned_addr learned my addr 172.21.15.6:0/12390279 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3659c700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c380ffcc0 0x7f8c38198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c35d9b700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c38100eb0 0x7f8c38199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 -- 172.21.15.6:0/12390279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c38100eb0 msgr2=0x7f8c38199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c38100eb0 0x7f8c38199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 -- 172.21.15.6:0/12390279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c380ffcc0 msgr2=0x7f8c38198de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c380ffcc0 0x7f8c38198de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 -- 172.21.15.6:0/12390279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c30009d00 con 0x7f8c38101850 2023-09-13T09:39:33.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c35d9b700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c38100eb0 0x7f8c38199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:33.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c3659c700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c380ffcc0 0x7f8c38198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:33.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.418+0000 7f8c36d9d700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c381a0390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8c30008f10 tx=0x7f8c30008ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.419+0000 7f8c277fe700 1 -- 172.21.15.6:0/12390279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3000e040 con 0x7f8c38101850 2023-09-13T09:39:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.419+0000 7f8c277fe700 1 -- 172.21.15.6:0/12390279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c30003c00 con 0x7f8c38101850 2023-09-13T09:39:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.419+0000 7f8c277fe700 1 -- 172.21.15.6:0/12390279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c3001b7d0 con 0x7f8c38101850 2023-09-13T09:39:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.419+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c381a0eb0 con 0x7f8c38101850 2023-09-13T09:39:33.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.419+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c381a1220 con 0x7f8c38101850 2023-09-13T09:39:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.420+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c3810b4e0 con 0x7f8c38101850 2023-09-13T09:39:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.421+0000 7f8c277fe700 1 -- 172.21.15.6:0/12390279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f8c30005090 con 0x7f8c38101850 2023-09-13T09:39:33.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.422+0000 7f8c277fe700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c200a06d0 0x7f8c200a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.422+0000 7f8c3659c700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c200a06d0 0x7f8c200a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.422+0000 7f8c277fe700 1 -- 172.21.15.6:0/12390279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f8c300cd800 con 0x7f8c38101850 2023-09-13T09:39:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.422+0000 7f8c3659c700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c200a06d0 0x7f8c200a2b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c38100d10 tx=0x7f8c2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:33.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.425+0000 7f8c277fe700 1 -- 172.21.15.6:0/12390279 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8c30097250 con 0x7f8c38101850 2023-09-13T09:39:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.626+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c381a1410 con 0x7f8c38101850 2023-09-13T09:39:33.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.627+0000 7f8c277fe700 1 -- 172.21.15.6:0/12390279 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8c3009a870 con 0x7f8c38101850 2023-09-13T09:39:33.628 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T09:39:33.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c200a06d0 msgr2=0x7f8c200a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c200a06d0 0x7f8c200a2b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c38100d10 tx=0x7f8c2c009260 comp rx=0 tx=0).stop 2023-09-13T09:39:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 msgr2=0x7f8c381a0390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c381a0390 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8c30008f10 tx=0x7f8c30008ff0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 shutdown_connections 2023-09-13T09:39:33.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c200a06d0 0x7f8c200a2b90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c38101850 0x7f8c381a0390 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c380ffcc0 0x7f8c38198de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 --2- 172.21.15.6:0/12390279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c38100eb0 0x7f8c38199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 >> 172.21.15.6:0/12390279 conn(0x7f8c380fb250 msgr2=0x7f8c38067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:33.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 shutdown_connections 2023-09-13T09:39:33.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.629+0000 7f8c3cc93700 1 -- 172.21.15.6:0/12390279 wait complete. 2023-09-13T09:39:33.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T09:39:33.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 -- 172.21.15.6:0/4078593347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454104170 msgr2=0x7f2454106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 --2- 172.21.15.6:0/4078593347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454104170 0x7f2454106560 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f2450009990 tx=0x7f2450009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 -- 172.21.15.6:0/4078593347 shutdown_connections 2023-09-13T09:39:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 --2- 172.21.15.6:0/4078593347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2454106aa0 0x7f2454108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 --2- 172.21.15.6:0/4078593347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2454101840 0x7f2454103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 --2- 172.21.15.6:0/4078593347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454104170 0x7f2454106560 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 -- 172.21.15.6:0/4078593347 >> 172.21.15.6:0/4078593347 conn(0x7f24540fb250 msgr2=0x7f24540fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 -- 172.21.15.6:0/4078593347 shutdown_connections 2023-09-13T09:39:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.771+0000 7f245b6b5700 1 -- 172.21.15.6:0/4078593347 wait complete. 2023-09-13T09:39:33.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 Processor -- start 2023-09-13T09:39:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 -- start start 2023-09-13T09:39:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2454101840 0x7f2454196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2454104170 0x7f2454196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454106aa0 0x7f245419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245419e600 con 0x7f2454106aa0 2023-09-13T09:39:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245419e740 con 0x7f2454104170 2023-09-13T09:39:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f245b6b5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245419e8d0 con 0x7f2454101840 2023-09-13T09:39:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454106aa0 0x7f245419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454106aa0 0x7f245419e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33738/0 (socket says 172.21.15.6:33738) 2023-09-13T09:39:33.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 -- 172.21.15.6:0/2137154452 learned_addr learned my addr 172.21.15.6:0/2137154452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:33.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459451700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2454101840 0x7f2454196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2458c50700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2454104170 0x7f2454196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 -- 172.21.15.6:0/2137154452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2454101840 msgr2=0x7f2454196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2454101840 0x7f2454196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 -- 172.21.15.6:0/2137154452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2454104170 msgr2=0x7f2454196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2454104170 0x7f2454196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459c52700 1 -- 172.21.15.6:0/2137154452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500095f0 con 0x7f2454106aa0 2023-09-13T09:39:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2459451700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2454101840 0x7f2454196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.772+0000 7f2458c50700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2454104170 0x7f2454196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.773+0000 7f2459c52700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454106aa0 0x7f245419e030 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f244c007ee0 tx=0x7f244c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:33.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.773+0000 7f24467fc700 1 -- 172.21.15.6:0/2137154452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c017070 con 0x7f2454106aa0 2023-09-13T09:39:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.773+0000 7f24467fc700 1 -- 172.21.15.6:0/2137154452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f244c00f040 con 0x7f2454106aa0 2023-09-13T09:39:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.773+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245419ebb0 con 0x7f2454106aa0 2023-09-13T09:39:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.773+0000 7f24467fc700 1 -- 172.21.15.6:0/2137154452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c005740 con 0x7f2454106aa0 2023-09-13T09:39:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.773+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245419f0c0 con 0x7f2454106aa0 2023-09-13T09:39:33.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.774+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24540fcdd0 con 0x7f2454106aa0 2023-09-13T09:39:33.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.775+0000 7f24467fc700 1 -- 172.21.15.6:0/2137154452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f244c0058a0 con 0x7f2454106aa0 2023-09-13T09:39:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.775+0000 7f24467fc700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24400a0750 0x7f24400a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.776+0000 7f24467fc700 1 -- 172.21.15.6:0/2137154452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f244c0cbbd0 con 0x7f2454106aa0 2023-09-13T09:39:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.776+0000 7f2459451700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24400a0750 0x7f24400a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.776+0000 7f2459451700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24400a0750 0x7f24400a2c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2448005950 tx=0x7f2448005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.779+0000 7f24467fc700 1 -- 172.21.15.6:0/2137154452 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f244c095590 con 0x7f2454106aa0 2023-09-13T09:39:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.983+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f245410c810 con 0x7f2454106aa0 2023-09-13T09:39:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.983+0000 7f24467fc700 1 -- 172.21.15.6:0/2137154452 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f244c093e60 con 0x7f2454106aa0 2023-09-13T09:39:33.984 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T09:39:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24400a0750 msgr2=0x7f24400a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24400a0750 0x7f24400a2c10 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2448005950 tx=0x7f2448005f50 comp rx=0 tx=0).stop 2023-09-13T09:39:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454106aa0 msgr2=0x7f245419e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454106aa0 0x7f245419e030 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f244c007ee0 tx=0x7f244c00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 shutdown_connections 2023-09-13T09:39:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24400a0750 0x7f24400a2c10 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2454106aa0 0x7f245419e030 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2454101840 0x7f2454196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 --2- 172.21.15.6:0/2137154452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2454104170 0x7f2454196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 >> 172.21.15.6:0/2137154452 conn(0x7f24540fb250 msgr2=0x7f2454102570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 shutdown_connections 2023-09-13T09:39:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:33.986+0000 7f245b6b5700 1 -- 172.21.15.6:0/2137154452 wait complete. 2023-09-13T09:39:33.997 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:33 smithi006 ceph-mon[98665]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:39:33.998 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:33 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/884370564' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:33.998 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:33 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2279691392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:33.998 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:33 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/12390279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:33.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:34.005 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:33 smithi053 ceph-mon[102373]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:39:34.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:33 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/884370564' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:34.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:33 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2279691392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:34.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:33 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/12390279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:34.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:33 smithi131 ceph-mon[102785]: pgmap v299: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:39:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:33 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/884370564' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:33 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2279691392' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:33 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/12390279' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 -- 172.21.15.6:0/2416629852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 msgr2=0x7f5940108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 --2- 172.21.15.6:0/2416629852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f5940108100 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f593800b0d0 tx=0x7f593800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 -- 172.21.15.6:0/2416629852 shutdown_connections 2023-09-13T09:39:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 --2- 172.21.15.6:0/2416629852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f5940108100 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 --2- 172.21.15.6:0/2416629852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59400ffcc0 0x7f59401000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 --2- 172.21.15.6:0/2416629852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5940100eb0 0x7f5940101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 -- 172.21.15.6:0/2416629852 >> 172.21.15.6:0/2416629852 conn(0x7f59400fb250 msgr2=0x7f59400fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 -- 172.21.15.6:0/2416629852 shutdown_connections 2023-09-13T09:39:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.125+0000 7f5945dd7700 1 -- 172.21.15.6:0/2416629852 wait complete. 2023-09-13T09:39:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 Processor -- start 2023-09-13T09:39:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 -- start start 2023-09-13T09:39:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59400ffcc0 0x7f5940196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5940100eb0 0x7f5940196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f594019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594019e5f0 con 0x7f5940101850 2023-09-13T09:39:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594019e730 con 0x7f5940100eb0 2023-09-13T09:39:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f5945dd7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f594019e8c0 con 0x7f59400ffcc0 2023-09-13T09:39:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f593ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f594019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f593ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f594019e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33752/0 (socket says 172.21.15.6:33752) 2023-09-13T09:39:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f593ffff700 1 -- 172.21.15.6:0/4082830157 learned_addr learned my addr 172.21.15.6:0/4082830157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.126+0000 7f593f7fe700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59400ffcc0 0x7f5940196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593effd700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5940100eb0 0x7f5940196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593ffff700 1 -- 172.21.15.6:0/4082830157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59400ffcc0 msgr2=0x7f5940196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593ffff700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59400ffcc0 0x7f5940196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593ffff700 1 -- 172.21.15.6:0/4082830157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5940100eb0 msgr2=0x7f5940196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593ffff700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5940100eb0 0x7f5940196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593ffff700 1 -- 172.21.15.6:0/4082830157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5938009d00 con 0x7f5940101850 2023-09-13T09:39:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593ffff700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f594019e020 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5938007a00 tx=0x7f59380094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593cff9700 1 -- 172.21.15.6:0/4082830157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593800e040 con 0x7f5940101850 2023-09-13T09:39:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594019eb40 con 0x7f5940101850 2023-09-13T09:39:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593cff9700 1 -- 172.21.15.6:0/4082830157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5938003e10 con 0x7f5940101850 2023-09-13T09:39:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f593cff9700 1 -- 172.21.15.6:0/4082830157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5938012a90 con 0x7f5940101850 2023-09-13T09:39:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.127+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f594019ef70 con 0x7f5940101850 2023-09-13T09:39:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.128+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5940107bb0 con 0x7f5940101850 2023-09-13T09:39:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.129+0000 7f593cff9700 1 -- 172.21.15.6:0/4082830157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f59380056c0 con 0x7f5940101850 2023-09-13T09:39:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.130+0000 7f593cff9700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f592c0a06d0 0x7f592c0a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.130+0000 7f593f7fe700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f592c0a06d0 0x7f592c0a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.130+0000 7f593cff9700 1 -- 172.21.15.6:0/4082830157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f59380cd3e0 con 0x7f5940101850 2023-09-13T09:39:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.130+0000 7f593f7fe700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f592c0a06d0 0x7f592c0a2b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5940100d10 tx=0x7f593000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.134+0000 7f593cff9700 1 -- 172.21.15.6:0/4082830157 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5938096e30 con 0x7f5940101850 2023-09-13T09:39:34.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.339+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f594010b720 con 0x7f5940101850 2023-09-13T09:39:34.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.340+0000 7f593cff9700 1 -- 172.21.15.6:0/4082830157 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22443 (secure 0 0 0) 0x7f593809a450 con 0x7f5940101850 2023-09-13T09:39:34.340 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:34.341 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:39:07.896691+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:34.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f592c0a06d0 msgr2=0x7f592c0a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f592c0a06d0 0x7f592c0a2b90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5940100d10 tx=0x7f593000a3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 msgr2=0x7f594019e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f594019e020 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5938007a00 tx=0x7f59380094c0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 shutdown_connections 2023-09-13T09:39:34.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f592c0a06d0 0x7f592c0a2b90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5940101850 0x7f594019e020 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59400ffcc0 0x7f5940196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 --2- 172.21.15.6:0/4082830157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5940100eb0 0x7f5940196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 >> 172.21.15.6:0/4082830157 conn(0x7f59400fb250 msgr2=0x7f59400fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:34.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 shutdown_connections 2023-09-13T09:39:34.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.342+0000 7f5945dd7700 1 -- 172.21.15.6:0/4082830157 wait complete. 2023-09-13T09:39:34.355 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:39:34.356 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:39:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/4270214998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98104170 msgr2=0x7f8d98106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/4270214998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98104170 0x7f8d98106560 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8d88009990 tx=0x7f8d88009ca0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/4270214998 shutdown_connections 2023-09-13T09:39:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/4270214998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98106aa0 0x7f8d98108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/4270214998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d98101840 0x7f8d98103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/4270214998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98104170 0x7f8d98106560 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/4270214998 >> 172.21.15.6:0/4270214998 conn(0x7f8d980fb250 msgr2=0x7f8d980fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/4270214998 shutdown_connections 2023-09-13T09:39:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.485+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/4270214998 wait complete. 2023-09-13T09:39:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 Processor -- start 2023-09-13T09:39:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 -- start start 2023-09-13T09:39:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98101840 0x7f8d98196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d98104170 0x7f8d98196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98106aa0 0x7f8d9819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9819e5d0 con 0x7f8d98106aa0 2023-09-13T09:39:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9819e710 con 0x7f8d98104170 2023-09-13T09:39:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d9e0f6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9819e8a0 con 0x7f8d98101840 2023-09-13T09:39:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98106aa0 0x7f8d9819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98106aa0 0x7f8d9819e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33766/0 (socket says 172.21.15.6:33766) 2023-09-13T09:39:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 -- 172.21.15.6:0/2922747997 learned_addr learned my addr 172.21.15.6:0/2922747997 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d96ffd700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d98104170 0x7f8d98196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d977fe700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98101840 0x7f8d98196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 -- 172.21.15.6:0/2922747997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98101840 msgr2=0x7f8d98196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98101840 0x7f8d98196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 -- 172.21.15.6:0/2922747997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d98104170 msgr2=0x7f8d98196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d98104170 0x7f8d98196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.486+0000 7f8d97fff700 1 -- 172.21.15.6:0/2922747997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d880095f0 con 0x7f8d98106aa0 2023-09-13T09:39:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.487+0000 7f8d97fff700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98106aa0 0x7f8d9819e000 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000ada0 tx=0x7f8d9000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.487+0000 7f8d94ff9700 1 -- 172.21.15.6:0/2922747997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9000f070 con 0x7f8d98106aa0 2023-09-13T09:39:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.487+0000 7f8d94ff9700 1 -- 172.21.15.6:0/2922747997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8d90007b30 con 0x7f8d98106aa0 2023-09-13T09:39:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.487+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9819eb80 con 0x7f8d98106aa0 2023-09-13T09:39:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.487+0000 7f8d94ff9700 1 -- 172.21.15.6:0/2922747997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d90005280 con 0x7f8d98106aa0 2023-09-13T09:39:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.487+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9819f040 con 0x7f8d98106aa0 2023-09-13T09:39:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.488+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d980fcdd0 con 0x7f8d98106aa0 2023-09-13T09:39:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.489+0000 7f8d94ff9700 1 -- 172.21.15.6:0/2922747997 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f8d9000a090 con 0x7f8d98106aa0 2023-09-13T09:39:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.490+0000 7f8d94ff9700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8d800a06d0 0x7f8d800a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.490+0000 7f8d977fe700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8d800a06d0 0x7f8d800a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.490+0000 7f8d94ff9700 1 -- 172.21.15.6:0/2922747997 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f8d900cb870 con 0x7f8d98106aa0 2023-09-13T09:39:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.491+0000 7f8d977fe700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8d800a06d0 0x7f8d800a2b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c005950 tx=0x7f8d8c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.494+0000 7f8d94ff9700 1 -- 172.21.15.6:0/2922747997 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8d90098d50 con 0x7f8d98106aa0 2023-09-13T09:39:34.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.691+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8d9810c7e0 con 0x7f8d98106aa0 2023-09-13T09:39:34.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.692+0000 7f8d94ff9700 1 -- 172.21.15.6:0/2922747997 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8d900988e0 con 0x7f8d98106aa0 2023-09-13T09:39:34.692 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:39:34.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8d800a06d0 msgr2=0x7f8d800a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8d800a06d0 0x7f8d800a2b90 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8d8c005950 tx=0x7f8d8c00b410 comp rx=0 tx=0).stop 2023-09-13T09:39:34.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98106aa0 msgr2=0x7f8d9819e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98106aa0 0x7f8d9819e000 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8d9000ada0 tx=0x7f8d9000c330 comp rx=0 tx=0).stop 2023-09-13T09:39:34.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 shutdown_connections 2023-09-13T09:39:34.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8d800a06d0 0x7f8d800a2b90 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d98106aa0 0x7f8d9819e000 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d98101840 0x7f8d98196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 --2- 172.21.15.6:0/2922747997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8d98104170 0x7f8d98196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 >> 172.21.15.6:0/2922747997 conn(0x7f8d980fb250 msgr2=0x7f8d981024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 shutdown_connections 2023-09-13T09:39:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.694+0000 7f8d9e0f6700 1 -- 172.21.15.6:0/2922747997 wait complete. 2023-09-13T09:39:34.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T09:39:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 -- 172.21.15.6:0/1300409205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88101850 msgr2=0x7faf88108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 --2- 172.21.15.6:0/1300409205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88101850 0x7faf88108100 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7faf8000b0d0 tx=0x7faf8000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 -- 172.21.15.6:0/1300409205 shutdown_connections 2023-09-13T09:39:34.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 --2- 172.21.15.6:0/1300409205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88101850 0x7faf88108100 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 --2- 172.21.15.6:0/1300409205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf880ffcc0 0x7faf881000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 --2- 172.21.15.6:0/1300409205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf88100eb0 0x7faf88101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 -- 172.21.15.6:0/1300409205 >> 172.21.15.6:0/1300409205 conn(0x7faf880fb250 msgr2=0x7faf880fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:34.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 -- 172.21.15.6:0/1300409205 shutdown_connections 2023-09-13T09:39:34.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.839+0000 7faf906b5700 1 -- 172.21.15.6:0/1300409205 wait complete. 2023-09-13T09:39:34.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 Processor -- start 2023-09-13T09:39:34.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 -- start start 2023-09-13T09:39:34.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf880ffcc0 0x7faf88198d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88100eb0 0x7faf881992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf88101850 0x7faf881a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf881a08e0 con 0x7faf88100eb0 2023-09-13T09:39:34.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf881a0a20 con 0x7faf880ffcc0 2023-09-13T09:39:34.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf906b5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf881a0bb0 con 0x7faf88101850 2023-09-13T09:39:34.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88100eb0 0x7faf881992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88100eb0 0x7faf881992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33778/0 (socket says 172.21.15.6:33778) 2023-09-13T09:39:34.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 -- 172.21.15.6:0/3856408361 learned_addr learned my addr 172.21.15.6:0/3856408361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:34.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8ec52700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf88101850 0x7faf881a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8e451700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf880ffcc0 0x7faf88198d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 -- 172.21.15.6:0/3856408361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf88101850 msgr2=0x7faf881a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf88101850 0x7faf881a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 -- 172.21.15.6:0/3856408361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf880ffcc0 msgr2=0x7faf88198d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:34.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf880ffcc0 0x7faf88198d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:34.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.840+0000 7faf8dc50700 1 -- 172.21.15.6:0/3856408361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009d00 con 0x7faf88100eb0 2023-09-13T09:39:34.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.841+0000 7faf8dc50700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88100eb0 0x7faf881992a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d950 tx=0x7faf7800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:34.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.841+0000 7faf7f7fe700 1 -- 172.21.15.6:0/3856408361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78009940 con 0x7faf88100eb0 2023-09-13T09:39:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.841+0000 7faf7f7fe700 1 -- 172.21.15.6:0/3856408361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faf78010460 con 0x7faf88100eb0 2023-09-13T09:39:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.841+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf881a0e90 con 0x7faf88100eb0 2023-09-13T09:39:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.841+0000 7faf7f7fe700 1 -- 172.21.15.6:0/3856408361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7800f620 con 0x7faf88100eb0 2023-09-13T09:39:34.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.841+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf881a1360 con 0x7faf88100eb0 2023-09-13T09:39:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.842+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8810b4e0 con 0x7faf88100eb0 2023-09-13T09:39:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.843+0000 7faf7f7fe700 1 -- 172.21.15.6:0/3856408361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7faf780108d0 con 0x7faf88100eb0 2023-09-13T09:39:34.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.843+0000 7faf7f7fe700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faf740a0750 0x7faf740a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.843+0000 7faf7f7fe700 1 -- 172.21.15.6:0/3856408361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7faf780cbb00 con 0x7faf88100eb0 2023-09-13T09:39:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.843+0000 7faf8e451700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faf740a0750 0x7faf740a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.844+0000 7faf8e451700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faf740a0750 0x7faf740a2c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf88100d10 tx=0x7faf84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:34.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:34.847+0000 7faf7f7fe700 1 -- 172.21.15.6:0/3856408361 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7faf780954c0 con 0x7faf88100eb0 2023-09-13T09:39:35.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:34 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2137154452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:35.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:34 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4082830157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:35.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:34 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2922747997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:35.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:34 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2137154452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:35.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:34 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4082830157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:35.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:34 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2922747997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:35.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:34 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2137154452' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:35.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:34 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4082830157' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:35.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:34 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2922747997' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:35.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.049+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf881a1550 con 0x7faf88100eb0 2023-09-13T09:39:35.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.050+0000 7faf7f7fe700 1 -- 172.21.15.6:0/3856408361 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf780200a0 con 0x7faf88100eb0 2023-09-13T09:39:35.050 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T09:39:35.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faf740a0750 msgr2=0x7faf740a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faf740a0750 0x7faf740a2c10 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7faf88100d10 tx=0x7faf84009260 comp rx=0 tx=0).stop 2023-09-13T09:39:35.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88100eb0 msgr2=0x7faf881992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88100eb0 0x7faf881992a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7faf7800d950 tx=0x7faf7800dc60 comp rx=0 tx=0).stop 2023-09-13T09:39:35.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 shutdown_connections 2023-09-13T09:39:35.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faf88101850 0x7faf881a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faf880ffcc0 0x7faf88198d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faf740a0750 0x7faf740a2c10 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 --2- 172.21.15.6:0/3856408361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faf88100eb0 0x7faf881992a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 >> 172.21.15.6:0/3856408361 conn(0x7faf880fb250 msgr2=0x7faf88068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 shutdown_connections 2023-09-13T09:39:35.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.052+0000 7faf906b5700 1 -- 172.21.15.6:0/3856408361 wait complete. 2023-09-13T09:39:35.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T09:39:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 -- 172.21.15.6:0/2915715085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5700101850 msgr2=0x7f5700108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 --2- 172.21.15.6:0/2915715085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5700101850 0x7f5700108100 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f56f800b0d0 tx=0x7f56f800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 -- 172.21.15.6:0/2915715085 shutdown_connections 2023-09-13T09:39:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 --2- 172.21.15.6:0/2915715085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5700101850 0x7f5700108100 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 --2- 172.21.15.6:0/2915715085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57000ffcc0 0x7f57001000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 --2- 172.21.15.6:0/2915715085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5700100eb0 0x7f5700101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 -- 172.21.15.6:0/2915715085 >> 172.21.15.6:0/2915715085 conn(0x7f57000fb250 msgr2=0x7f57000fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 -- 172.21.15.6:0/2915715085 shutdown_connections 2023-09-13T09:39:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.193+0000 7f5707d94700 1 -- 172.21.15.6:0/2915715085 wait complete. 2023-09-13T09:39:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 Processor -- start 2023-09-13T09:39:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 -- start start 2023-09-13T09:39:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57000ffcc0 0x7f5700196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5700100eb0 0x7f57001970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5700101850 0x7f570019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570019e720 con 0x7f57000ffcc0 2023-09-13T09:39:35.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570019e860 con 0x7f5700100eb0 2023-09-13T09:39:35.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5707d94700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f570019e9f0 con 0x7f5700101850 2023-09-13T09:39:35.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57000ffcc0 0x7f5700196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57000ffcc0 0x7f5700196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33790/0 (socket says 172.21.15.6:33790) 2023-09-13T09:39:35.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 -- 172.21.15.6:0/1496177124 learned_addr learned my addr 172.21.15.6:0/1496177124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:35.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5706331700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5700101850 0x7f570019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 -- 172.21.15.6:0/1496177124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5700101850 msgr2=0x7f570019e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5700101850 0x7f570019e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 -- 172.21.15.6:0/1496177124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5700100eb0 msgr2=0x7f57001970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5700100eb0 0x7f57001970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 -- 172.21.15.6:0/1496177124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8009d00 con 0x7f57000ffcc0 2023-09-13T09:39:35.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f5705b30700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57000ffcc0 0x7f5700196ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f56f400e970 tx=0x7f56f400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.194+0000 7f56f2ffd700 1 -- 172.21.15.6:0/1496177124 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4009790 con 0x7f57000ffcc0 2023-09-13T09:39:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.195+0000 7f56f2ffd700 1 -- 172.21.15.6:0/1496177124 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f56f40044e0 con 0x7f57000ffcc0 2023-09-13T09:39:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.195+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f570019ecd0 con 0x7f57000ffcc0 2023-09-13T09:39:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.195+0000 7f56f2ffd700 1 -- 172.21.15.6:0/1496177124 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f4003e30 con 0x7f57000ffcc0 2023-09-13T09:39:35.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.195+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570019f180 con 0x7f57000ffcc0 2023-09-13T09:39:35.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.196+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f570010b530 con 0x7f57000ffcc0 2023-09-13T09:39:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.197+0000 7f56f2ffd700 1 -- 172.21.15.6:0/1496177124 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f56f4003f90 con 0x7f57000ffcc0 2023-09-13T09:39:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.198+0000 7f56f2ffd700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f56ec0a0750 0x7f56ec0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.198+0000 7f570532f700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f56ec0a0750 0x7f56ec0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.198+0000 7f56f2ffd700 1 -- 172.21.15.6:0/1496177124 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f56f4014070 con 0x7f57000ffcc0 2023-09-13T09:39:35.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.198+0000 7f570532f700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f56ec0a0750 0x7f56ec0a2c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f56fc005fd0 tx=0x7f56fc005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:35.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.201+0000 7f56f2ffd700 1 -- 172.21.15.6:0/1496177124 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f56f4095b10 con 0x7f57000ffcc0 2023-09-13T09:39:35.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.404+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f570019f3d0 con 0x7f57000ffcc0 2023-09-13T09:39:35.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.404+0000 7f56f2ffd700 1 -- 172.21.15.6:0/1496177124 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56f4099130 con 0x7f57000ffcc0 2023-09-13T09:39:35.405 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T09:39:35.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f56ec0a0750 msgr2=0x7f56ec0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f56ec0a0750 0x7f56ec0a2c10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f56fc005fd0 tx=0x7f56fc005f60 comp rx=0 tx=0).stop 2023-09-13T09:39:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57000ffcc0 msgr2=0x7f5700196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57000ffcc0 0x7f5700196ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f56f400e970 tx=0x7f56f400ed30 comp rx=0 tx=0).stop 2023-09-13T09:39:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 shutdown_connections 2023-09-13T09:39:35.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5700101850 0x7f570019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f56ec0a0750 0x7f56ec0a2c10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57000ffcc0 0x7f5700196ba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 --2- 172.21.15.6:0/1496177124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5700100eb0 0x7f57001970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 >> 172.21.15.6:0/1496177124 conn(0x7f57000fb250 msgr2=0x7f5700068010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 shutdown_connections 2023-09-13T09:39:35.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.407+0000 7f5707d94700 1 -- 172.21.15.6:0/1496177124 wait complete. 2023-09-13T09:39:35.419 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-09-13T09:39:35.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:39:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 -- 172.21.15.6:0/1112506085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780106a70 msgr2=0x7fd780108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 --2- 172.21.15.6:0/1112506085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780106a70 0x7fd780108ee0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd77800b0a0 tx=0x7fd77800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 -- 172.21.15.6:0/1112506085 shutdown_connections 2023-09-13T09:39:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 --2- 172.21.15.6:0/1112506085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780106a70 0x7fd780108ee0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 --2- 172.21.15.6:0/1112506085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd780101810 0x7fd780103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 --2- 172.21.15.6:0/1112506085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd780104140 0x7fd780106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 -- 172.21.15.6:0/1112506085 >> 172.21.15.6:0/1112506085 conn(0x7fd7800fb220 msgr2=0x7fd7800fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 -- 172.21.15.6:0/1112506085 shutdown_connections 2023-09-13T09:39:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.546+0000 7fd787c02700 1 -- 172.21.15.6:0/1112506085 wait complete. 2023-09-13T09:39:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 Processor -- start 2023-09-13T09:39:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 -- start start 2023-09-13T09:39:35.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780101810 0x7fd780196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd780104140 0x7fd780197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd780106a70 0x7fd78019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78019e6c0 con 0x7fd780101810 2023-09-13T09:39:35.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78019e800 con 0x7fd780106a70 2023-09-13T09:39:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd787c02700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd78019e990 con 0x7fd780104140 2023-09-13T09:39:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780101810 0x7fd780196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780101810 0x7fd780196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33804/0 (socket says 172.21.15.6:33804) 2023-09-13T09:39:35.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 -- 172.21.15.6:0/4294778585 learned_addr learned my addr 172.21.15.6:0/4294778585 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78519d700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd780104140 0x7fd780197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78619f700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd780106a70 0x7fd78019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 -- 172.21.15.6:0/4294778585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd780104140 msgr2=0x7fd780197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd780104140 0x7fd780197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 -- 172.21.15.6:0/4294778585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd780106a70 msgr2=0x7fd78019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd780106a70 0x7fd78019e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.547+0000 7fd78599e700 1 -- 172.21.15.6:0/4294778585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd778009d00 con 0x7fd780101810 2023-09-13T09:39:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.548+0000 7fd78599e700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780101810 0x7fd780196b40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00d980 tx=0x7fd77c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:35.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.548+0000 7fd776ffd700 1 -- 172.21.15.6:0/4294778585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c009b40 con 0x7fd780101810 2023-09-13T09:39:35.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.548+0000 7fd776ffd700 1 -- 172.21.15.6:0/4294778585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd77c00de60 con 0x7fd780101810 2023-09-13T09:39:35.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.548+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd78019ec70 con 0x7fd780101810 2023-09-13T09:39:35.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.548+0000 7fd776ffd700 1 -- 172.21.15.6:0/4294778585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd77c005580 con 0x7fd780101810 2023-09-13T09:39:35.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.548+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd78019f180 con 0x7fd780101810 2023-09-13T09:39:35.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.549+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7800fcda0 con 0x7fd780101810 2023-09-13T09:39:35.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.550+0000 7fd776ffd700 1 -- 172.21.15.6:0/4294778585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd77c004750 con 0x7fd780101810 2023-09-13T09:39:35.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.551+0000 7fd776ffd700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd76c0a0750 0x7fd76c0a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.551+0000 7fd78519d700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd76c0a0750 0x7fd76c0a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.551+0000 7fd776ffd700 1 -- 172.21.15.6:0/4294778585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fd77c0cc0c0 con 0x7fd780101810 2023-09-13T09:39:35.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.551+0000 7fd78519d700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd76c0a0750 0x7fd76c0a2c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd770005950 tx=0x7fd7700058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:35.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.554+0000 7fd776ffd700 1 -- 172.21.15.6:0/4294778585 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd77c095b00 con 0x7fd780101810 2023-09-13T09:39:35.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.802+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd78010c800 con 0x7fd780101810 2023-09-13T09:39:35.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.803+0000 7fd776ffd700 1 -- 172.21.15.6:0/4294778585 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fd77c099120 con 0x7fd780101810 2023-09-13T09:39:35.803 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:35.804 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:39:35.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd76c0a0750 msgr2=0x7fd76c0a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd76c0a0750 0x7fd76c0a2c10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd770005950 tx=0x7fd7700058e0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780101810 msgr2=0x7fd780196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780101810 0x7fd780196b40 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00d980 tx=0x7fd77c00dd40 comp rx=0 tx=0).stop 2023-09-13T09:39:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 shutdown_connections 2023-09-13T09:39:35.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd780106a70 0x7fd78019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd76c0a0750 0x7fd76c0a2c10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd780101810 0x7fd780196b40 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 --2- 172.21.15.6:0/4294778585 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd780104140 0x7fd780197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.805+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 >> 172.21.15.6:0/4294778585 conn(0x7fd7800fb220 msgr2=0x7fd780102480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:35.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.806+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 shutdown_connections 2023-09-13T09:39:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.806+0000 7fd787c02700 1 -- 172.21.15.6:0/4294778585 wait complete. 2023-09-13T09:39:35.808 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:35.818 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-09-13T09:39:35.819 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-09-13T09:39:35.820 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T09:39:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 -- 172.21.15.6:0/3407176912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce80ffc90 msgr2=0x7f1ce81000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/3407176912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce80ffc90 0x7f1ce81000b0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80099c0 tx=0x7f1cd8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 -- 172.21.15.6:0/3407176912 shutdown_connections 2023-09-13T09:39:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/3407176912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce8101820 0x7f1ce81080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/3407176912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce80ffc90 0x7f1ce81000b0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/3407176912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ce8100e80 0x7f1ce81012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 -- 172.21.15.6:0/3407176912 >> 172.21.15.6:0/3407176912 conn(0x7f1ce80fb220 msgr2=0x7f1ce80fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:35.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 -- 172.21.15.6:0/3407176912 shutdown_connections 2023-09-13T09:39:35.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.946+0000 7f1cedb4c700 1 -- 172.21.15.6:0/3407176912 wait complete. 2023-09-13T09:39:35.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 Processor -- start 2023-09-13T09:39:35.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 -- start start 2023-09-13T09:39:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ce80ffc90 0x7f1ce8068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce8100e80 0x7f1ce819b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce8101820 0x7f1ce819ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce819e5a0 con 0x7f1ce8101820 2023-09-13T09:39:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce819e710 con 0x7f1ce8100e80 2023-09-13T09:39:35.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1cedb4c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce819e8d0 con 0x7f1ce80ffc90 2023-09-13T09:39:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce8101820 0x7f1ce819ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1ce7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce8101820 0x7f1ce819ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33822/0 (socket says 172.21.15.6:33822) 2023-09-13T09:39:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1ce7fff700 1 -- 172.21.15.6:0/2363139125 learned_addr learned my addr 172.21.15.6:0/2363139125 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1ce77fe700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ce80ffc90 0x7f1ce8068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.947+0000 7f1ce6ffd700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce8100e80 0x7f1ce819b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce7fff700 1 -- 172.21.15.6:0/2363139125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ce80ffc90 msgr2=0x7f1ce8068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce7fff700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ce80ffc90 0x7f1ce8068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce7fff700 1 -- 172.21.15.6:0/2363139125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce8100e80 msgr2=0x7f1ce819b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce7fff700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce8100e80 0x7f1ce819b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:35.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce7fff700 1 -- 172.21.15.6:0/2363139125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd80095f0 con 0x7f1ce8101820 2023-09-13T09:39:35.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce7fff700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce8101820 0x7f1ce819ddd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0007d70 tx=0x7f1ce000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:35.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce4ff9700 1 -- 172.21.15.6:0/2363139125 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce000ad40 con 0x7f1ce8101820 2023-09-13T09:39:35.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce4ff9700 1 -- 172.21.15.6:0/2363139125 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1ce00128e0 con 0x7f1ce8101820 2023-09-13T09:39:35.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1ce4ff9700 1 -- 172.21.15.6:0/2363139125 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce00116b0 con 0x7f1ce8101820 2023-09-13T09:39:35.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce819ebb0 con 0x7f1ce8101820 2023-09-13T09:39:35.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.948+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce819f070 con 0x7f1ce8101820 2023-09-13T09:39:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.949+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce810b4f0 con 0x7f1ce8101820 2023-09-13T09:39:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.950+0000 7f1ce4ff9700 1 -- 172.21.15.6:0/2363139125 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7f1ce0012420 con 0x7f1ce8101820 2023-09-13T09:39:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.951+0000 7f1ce4ff9700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1cd00a06d0 0x7f1cd00a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.951+0000 7f1ce77fe700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1cd00a06d0 0x7f1cd00a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:35.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.951+0000 7f1ce4ff9700 1 -- 172.21.15.6:0/2363139125 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f1ce00cc2f0 con 0x7f1ce8101820 2023-09-13T09:39:35.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.951+0000 7f1ce77fe700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1cd00a06d0 0x7f1cd00a2b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b580 tx=0x7f1cd8009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:35.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:35.954+0000 7f1ce4ff9700 1 -- 172.21.15.6:0/2363139125 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1ce0095d60 con 0x7f1ce8101820 2023-09-13T09:39:36.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:35 smithi006 ceph-mon[98665]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:36.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:35 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3856408361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:36.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:35 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1496177124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:36.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:35 smithi053 ceph-mon[102373]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:36.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:35 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3856408361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:36.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:35 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1496177124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:36.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:35 smithi131 ceph-mon[102785]: pgmap v300: 97 pgs: 97 active+clean; 637 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:39:36.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:35 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3856408361' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:36.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:35 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1496177124' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:36.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.167+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1ce80610f0 con 0x7f1cd00a06d0 2023-09-13T09:39:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.190+0000 7f1ce4ff9700 1 -- 172.21.15.6:0/2363139125 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343567 (secure 0 0 0) 0x7f1ce80610f0 con 0x7f1cd00a06d0 2023-09-13T09:39:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.193+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1cd00a06d0 msgr2=0x7f1cd00a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.193+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1cd00a06d0 0x7f1cd00a2b90 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800b580 tx=0x7f1cd8009f10 comp rx=0 tx=0).stop 2023-09-13T09:39:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.193+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce8101820 msgr2=0x7f1ce819ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.193+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce8101820 0x7f1ce819ddd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0007d70 tx=0x7f1ce000a340 comp rx=0 tx=0).stop 2023-09-13T09:39:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.193+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 shutdown_connections 2023-09-13T09:39:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.193+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1cd00a06d0 0x7f1cd00a2b90 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.193+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ce8101820 0x7f1ce819ddd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.194+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1ce80ffc90 0x7f1ce8068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.194+0000 7f1cedb4c700 1 --2- 172.21.15.6:0/2363139125 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1ce8100e80 0x7f1ce819b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.194+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 >> 172.21.15.6:0/2363139125 conn(0x7f1ce80fb220 msgr2=0x7f1ce80fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:36.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.194+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 shutdown_connections 2023-09-13T09:39:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.194+0000 7f1cedb4c700 1 -- 172.21.15.6:0/2363139125 wait complete. 2023-09-13T09:39:36.200 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-09-13T09:39:36.209 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-09-13T09:39:36.161308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657480,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":950,"num_read_kb":598,"num_write":417,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337540,"kb_used_data":13292,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604284,"statfs":{"total":1151940427776,"available":1151594786816,"internally_reserved":0,"allocated":13611008,"data_stored":7385559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4956,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":82,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003057"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904417+0000","last_change":"2023-09-13T09:38:09.701485+0000","last_active":"2023-09-13T09:39:06.904417+0000","last_peered":"2023-09-13T09:39:06.904417+0000","last_clean":"2023-09-13T09:39:06.904417+0000","last_became_active":"2023-09-13T09:38:09.701160+0000","last_became_peered":"2023-09-13T09:38:09.701160+0000","last_unstale":"2023-09-13T09:39:06.904417+0000","last_undegraded":"2023-09-13T09:39:06.904417+0000","last_fullsized":"2023-09-13T09:39:06.904417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:10.089322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901435+0000","last_change":"2023-09-13T09:38:09.697198+0000","last_active":"2023-09-13T09:39:06.901435+0000","last_peered":"2023-09-13T09:39:06.901435+0000","last_clean":"2023-09-13T09:39:06.901435+0000","last_became_active":"2023-09-13T09:38:09.696859+0000","last_became_peered":"2023-09-13T09:38:09.696859+0000","last_unstale":"2023-09-13T09:39:06.901435+0000","last_undegraded":"2023-09-13T09:39:06.901435+0000","last_fullsized":"2023-09-13T09:39:06.901435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:53.601426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901153+0000","last_change":"2023-09-13T09:38:09.696150+0000","last_active":"2023-09-13T09:39:06.901153+0000","last_peered":"2023-09-13T09:39:06.901153+0000","last_clean":"2023-09-13T09:39:06.901153+0000","last_became_active":"2023-09-13T09:38:09.695893+0000","last_became_peered":"2023-09-13T09:38:09.695893+0000","last_unstale":"2023-09-13T09:39:06.901153+0000","last_undegraded":"2023-09-13T09:39:06.901153+0000","last_fullsized":"2023-09-13T09:39:06.901153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:51.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903598+0000","last_change":"2023-09-13T09:38:09.697564+0000","last_active":"2023-09-13T09:39:06.903598+0000","last_peered":"2023-09-13T09:39:06.903598+0000","last_clean":"2023-09-13T09:39:06.903598+0000","last_became_active":"2023-09-13T09:38:09.697235+0000","last_became_peered":"2023-09-13T09:38:09.697235+0000","last_unstale":"2023-09-13T09:39:06.903598+0000","last_undegraded":"2023-09-13T09:39:06.903598+0000","last_fullsized":"2023-09-13T09:39:06.903598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:49.705452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902416+0000","last_change":"2023-09-13T09:38:09.702889+0000","last_active":"2023-09-13T09:39:06.902416+0000","last_peered":"2023-09-13T09:39:06.902416+0000","last_clean":"2023-09-13T09:39:06.902416+0000","last_became_active":"2023-09-13T09:38:09.702589+0000","last_became_peered":"2023-09-13T09:38:09.702589+0000","last_unstale":"2023-09-13T09:39:06.902416+0000","last_undegraded":"2023-09-13T09:39:06.902416+0000","last_fullsized":"2023-09-13T09:39:06.902416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:56:05.432576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.911965+0000","last_change":"2023-09-13T09:39:07.911965+0000","last_active":"2023-09-13T09:39:07.911965+0000","last_peered":"2023-09-13T09:39:07.911965+0000","last_clean":"2023-09-13T09:39:07.911965+0000","last_became_active":"2023-09-13T09:39:07.911381+0000","last_became_peered":"2023-09-13T09:39:07.911381+0000","last_unstale":"2023-09-13T09:39:07.911965+0000","last_undegraded":"2023-09-13T09:39:07.911965+0000","last_fullsized":"2023-09-13T09:39:07.911965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:57.993882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905407+0000","last_change":"2023-09-13T09:38:09.700506+0000","last_active":"2023-09-13T09:39:06.905407+0000","last_peered":"2023-09-13T09:39:06.905407+0000","last_clean":"2023-09-13T09:39:06.905407+0000","last_became_active":"2023-09-13T09:38:09.700178+0000","last_became_peered":"2023-09-13T09:38:09.700178+0000","last_unstale":"2023-09-13T09:39:06.905407+0000","last_undegraded":"2023-09-13T09:39:06.905407+0000","last_fullsized":"2023-09-13T09:39:06.905407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:04.261443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904341+0000","last_change":"2023-09-13T09:38:09.703191+0000","last_active":"2023-09-13T09:39:06.904341+0000","last_peered":"2023-09-13T09:39:06.904341+0000","last_clean":"2023-09-13T09:39:06.904341+0000","last_became_active":"2023-09-13T09:38:09.702874+0000","last_became_peered":"2023-09-13T09:38:09.702874+0000","last_unstale":"2023-09-13T09:39:06.904341+0000","last_undegraded":"2023-09-13T09:39:06.904341+0000","last_fullsized":"2023-09-13T09:39:06.904341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:50:25.759861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899611+0000","last_change":"2023-09-13T09:38:09.700416+0000","last_active":"2023-09-13T09:39:06.899611+0000","last_peered":"2023-09-13T09:39:06.899611+0000","last_clean":"2023-09-13T09:39:06.899611+0000","last_became_active":"2023-09-13T09:38:09.700102+0000","last_became_peered":"2023-09-13T09:38:09.700102+0000","last_unstale":"2023-09-13T09:39:06.899611+0000","last_undegraded":"2023-09-13T09:39:06.899611+0000","last_fullsized":"2023-09-13T09:39:06.899611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:53.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906839+0000","last_change":"2023-09-13T09:38:09.702609+0000","last_active":"2023-09-13T09:39:06.906839+0000","last_peered":"2023-09-13T09:39:06.906839+0000","last_clean":"2023-09-13T09:39:06.906839+0000","last_became_active":"2023-09-13T09:38:09.702244+0000","last_became_peered":"2023-09-13T09:38:09.702244+0000","last_unstale":"2023-09-13T09:39:06.906839+0000","last_undegraded":"2023-09-13T09:39:06.906839+0000","last_fullsized":"2023-09-13T09:39:06.906839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:08:30.911492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906189+0000","last_change":"2023-09-13T09:38:09.694245+0000","last_active":"2023-09-13T09:39:06.906189+0000","last_peered":"2023-09-13T09:39:06.906189+0000","last_clean":"2023-09-13T09:39:06.906189+0000","last_became_active":"2023-09-13T09:38:09.693939+0000","last_became_peered":"2023-09-13T09:38:09.693939+0000","last_unstale":"2023-09-13T09:39:06.906189+0000","last_undegraded":"2023-09-13T09:39:06.906189+0000","last_fullsized":"2023-09-13T09:39:06.906189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:08.383075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903501+0000","last_change":"2023-09-13T09:38:09.696680+0000","last_active":"2023-09-13T09:39:06.903501+0000","last_peered":"2023-09-13T09:39:06.903501+0000","last_clean":"2023-09-13T09:39:06.903501+0000","last_became_active":"2023-09-13T09:38:09.696369+0000","last_became_peered":"2023-09-13T09:38:09.696369+0000","last_unstale":"2023-09-13T09:39:06.903501+0000","last_undegraded":"2023-09-13T09:39:06.903501+0000","last_fullsized":"2023-09-13T09:39:06.903501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:48.111921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898581+0000","last_change":"2023-09-13T09:38:09.703214+0000","last_active":"2023-09-13T09:39:06.898581+0000","last_peered":"2023-09-13T09:39:06.898581+0000","last_clean":"2023-09-13T09:39:06.898581+0000","last_became_active":"2023-09-13T09:38:09.702815+0000","last_became_peered":"2023-09-13T09:38:09.702815+0000","last_unstale":"2023-09-13T09:39:06.898581+0000","last_undegraded":"2023-09-13T09:39:06.898581+0000","last_fullsized":"2023-09-13T09:39:06.898581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:46.437548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901215+0000","last_change":"2023-09-13T09:38:09.699968+0000","last_active":"2023-09-13T09:39:06.901215+0000","last_peered":"2023-09-13T09:39:06.901215+0000","last_clean":"2023-09-13T09:39:06.901215+0000","last_became_active":"2023-09-13T09:38:09.699643+0000","last_became_peered":"2023-09-13T09:38:09.699643+0000","last_unstale":"2023-09-13T09:39:06.901215+0000","last_undegraded":"2023-09-13T09:39:06.901215+0000","last_fullsized":"2023-09-13T09:39:06.901215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:41:40.550328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:08.159082+0000","last_change":"2023-09-13T09:39:08.159082+0000","last_active":"2023-09-13T09:39:08.159082+0000","last_peered":"2023-09-13T09:39:08.159082+0000","last_clean":"2023-09-13T09:39:08.159082+0000","last_became_active":"2023-09-13T09:39:08.158658+0000","last_became_peered":"2023-09-13T09:39:08.158658+0000","last_unstale":"2023-09-13T09:39:08.159082+0000","last_undegraded":"2023-09-13T09:39:08.159082+0000","last_fullsized":"2023-09-13T09:39:08.159082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:02:13.472201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899139+0000","last_change":"2023-09-13T09:38:09.695903+0000","last_active":"2023-09-13T09:39:06.899139+0000","last_peered":"2023-09-13T09:39:06.899139+0000","last_clean":"2023-09-13T09:39:06.899139+0000","last_became_active":"2023-09-13T09:38:09.695585+0000","last_became_peered":"2023-09-13T09:38:09.695585+0000","last_unstale":"2023-09-13T09:39:06.899139+0000","last_undegraded":"2023-09-13T09:39:06.899139+0000","last_fullsized":"2023-09-13T09:39:06.899139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:13.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904532+0000","last_change":"2023-09-13T09:38:09.702485+0000","last_active":"2023-09-13T09:39:06.904532+0000","last_peered":"2023-09-13T09:39:06.904532+0000","last_clean":"2023-09-13T09:39:06.904532+0000","last_became_active":"2023-09-13T09:38:09.701989+0000","last_became_peered":"2023-09-13T09:38:09.701989+0000","last_unstale":"2023-09-13T09:39:06.904532+0000","last_undegraded":"2023-09-13T09:39:06.904532+0000","last_fullsized":"2023-09-13T09:39:06.904532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:58.832560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905300+0000","last_change":"2023-09-13T09:38:09.695080+0000","last_active":"2023-09-13T09:39:06.905300+0000","last_peered":"2023-09-13T09:39:06.905300+0000","last_clean":"2023-09-13T09:39:06.905300+0000","last_became_active":"2023-09-13T09:38:09.694782+0000","last_became_peered":"2023-09-13T09:38:09.694782+0000","last_unstale":"2023-09-13T09:39:06.905300+0000","last_undegraded":"2023-09-13T09:39:06.905300+0000","last_fullsized":"2023-09-13T09:39:06.905300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:15.146156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899861+0000","last_change":"2023-09-13T09:38:09.702456+0000","last_active":"2023-09-13T09:39:06.899861+0000","last_peered":"2023-09-13T09:39:06.899861+0000","last_clean":"2023-09-13T09:39:06.899861+0000","last_became_active":"2023-09-13T09:38:09.702171+0000","last_became_peered":"2023-09-13T09:38:09.702171+0000","last_unstale":"2023-09-13T09:39:06.899861+0000","last_undegraded":"2023-09-13T09:39:06.899861+0000","last_fullsized":"2023-09-13T09:39:06.899861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:32.995619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.793889+0000","last_change":"2023-09-13T09:38:08.692389+0000","last_active":"2023-09-13T09:39:33.793889+0000","last_peered":"2023-09-13T09:39:33.793889+0000","last_clean":"2023-09-13T09:39:33.793889+0000","last_became_active":"2023-09-13T09:38:08.692022+0000","last_became_peered":"2023-09-13T09:38:08.692022+0000","last_unstale":"2023-09-13T09:39:33.793889+0000","last_undegraded":"2023-09-13T09:39:33.793889+0000","last_fullsized":"2023-09-13T09:39:33.793889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:58:40.288839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.908834+0000","last_change":"2023-09-13T09:39:07.908477+0000","last_active":"2023-09-13T09:39:07.908834+0000","last_peered":"2023-09-13T09:39:07.908834+0000","last_clean":"2023-09-13T09:39:07.908834+0000","last_became_active":"2023-09-13T09:39:07.908164+0000","last_became_peered":"2023-09-13T09:39:07.908164+0000","last_unstale":"2023-09-13T09:39:07.908834+0000","last_undegraded":"2023-09-13T09:39:07.908834+0000","last_fullsized":"2023-09-13T09:39:07.908834+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:39:35.434234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904577+0000","last_change":"2023-09-13T09:38:08.694408+0000","last_active":"2023-09-13T09:39:06.904577+0000","last_peered":"2023-09-13T09:39:06.904577+0000","last_clean":"2023-09-13T09:39:06.904577+0000","last_became_active":"2023-09-13T09:38:08.693140+0000","last_became_peered":"2023-09-13T09:38:08.693140+0000","last_unstale":"2023-09-13T09:39:06.904577+0000","last_undegraded":"2023-09-13T09:39:06.904577+0000","last_fullsized":"2023-09-13T09:39:06.904577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:27:22.637489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901477+0000","last_change":"2023-09-13T09:38:09.705381+0000","last_active":"2023-09-13T09:39:06.901477+0000","last_peered":"2023-09-13T09:39:06.901477+0000","last_clean":"2023-09-13T09:39:06.901477+0000","last_became_active":"2023-09-13T09:38:09.705059+0000","last_became_peered":"2023-09-13T09:38:09.705059+0000","last_unstale":"2023-09-13T09:39:06.901477+0000","last_undegraded":"2023-09-13T09:39:06.901477+0000","last_fullsized":"2023-09-13T09:39:06.901477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:11.294362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.922791+0000","last_change":"2023-09-13T09:39:07.922791+0000","last_active":"2023-09-13T09:39:07.922791+0000","last_peered":"2023-09-13T09:39:07.922791+0000","last_clean":"2023-09-13T09:39:07.922791+0000","last_became_active":"2023-09-13T09:39:07.911235+0000","last_became_peered":"2023-09-13T09:39:07.911235+0000","last_unstale":"2023-09-13T09:39:07.922791+0000","last_undegraded":"2023-09-13T09:39:07.922791+0000","last_fullsized":"2023-09-13T09:39:07.922791+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:07:58.363727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899223+0000","last_change":"2023-09-13T09:38:09.696875+0000","last_active":"2023-09-13T09:39:06.899223+0000","last_peered":"2023-09-13T09:39:06.899223+0000","last_clean":"2023-09-13T09:39:06.899223+0000","last_became_active":"2023-09-13T09:38:09.696060+0000","last_became_peered":"2023-09-13T09:38:09.696060+0000","last_unstale":"2023-09-13T09:39:06.899223+0000","last_undegraded":"2023-09-13T09:39:06.899223+0000","last_fullsized":"2023-09-13T09:39:06.899223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:55.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902875+0000","last_change":"2023-09-13T09:38:08.692583+0000","last_active":"2023-09-13T09:39:06.902875+0000","last_peered":"2023-09-13T09:39:06.902875+0000","last_clean":"2023-09-13T09:39:06.902875+0000","last_became_active":"2023-09-13T09:38:08.692266+0000","last_became_peered":"2023-09-13T09:38:08.692266+0000","last_unstale":"2023-09-13T09:39:06.902875+0000","last_undegraded":"2023-09-13T09:39:06.902875+0000","last_fullsized":"2023-09-13T09:39:06.902875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:37.827191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907073+0000","last_change":"2023-09-13T09:38:09.705855+0000","last_active":"2023-09-13T09:39:06.907073+0000","last_peered":"2023-09-13T09:39:06.907073+0000","last_clean":"2023-09-13T09:39:06.907073+0000","last_became_active":"2023-09-13T09:38:09.705518+0000","last_became_peered":"2023-09-13T09:38:09.705518+0000","last_unstale":"2023-09-13T09:39:06.907073+0000","last_undegraded":"2023-09-13T09:39:06.907073+0000","last_fullsized":"2023-09-13T09:39:06.907073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:02.403984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":100,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:31.792266+0000","last_change":"2023-09-13T09:38:08.697396+0000","last_active":"2023-09-13T09:39:31.792266+0000","last_peered":"2023-09-13T09:39:31.792266+0000","last_clean":"2023-09-13T09:39:31.792266+0000","last_became_active":"2023-09-13T09:38:08.697067+0000","last_became_peered":"2023-09-13T09:38:08.697067+0000","last_unstale":"2023-09-13T09:39:31.792266+0000","last_undegraded":"2023-09-13T09:39:31.792266+0000","last_fullsized":"2023-09-13T09:39:31.792266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:59.971250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903150+0000","last_change":"2023-09-13T09:38:09.701311+0000","last_active":"2023-09-13T09:39:06.903150+0000","last_peered":"2023-09-13T09:39:06.903150+0000","last_clean":"2023-09-13T09:39:06.903150+0000","last_became_active":"2023-09-13T09:38:09.700995+0000","last_became_peered":"2023-09-13T09:38:09.700995+0000","last_unstale":"2023-09-13T09:39:06.903150+0000","last_undegraded":"2023-09-13T09:39:06.903150+0000","last_fullsized":"2023-09-13T09:39:06.903150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:08.744780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907724+0000","last_change":"2023-09-13T09:38:08.691337+0000","last_active":"2023-09-13T09:39:06.907724+0000","last_peered":"2023-09-13T09:39:06.907724+0000","last_clean":"2023-09-13T09:39:06.907724+0000","last_became_active":"2023-09-13T09:38:08.690948+0000","last_became_peered":"2023-09-13T09:38:08.690948+0000","last_unstale":"2023-09-13T09:39:06.907724+0000","last_undegraded":"2023-09-13T09:39:06.907724+0000","last_fullsized":"2023-09-13T09:39:06.907724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:33.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.909477+0000","last_change":"2023-09-13T09:39:07.909477+0000","last_active":"2023-09-13T09:39:07.909477+0000","last_peered":"2023-09-13T09:39:07.909477+0000","last_clean":"2023-09-13T09:39:07.909477+0000","last_became_active":"2023-09-13T09:39:07.909034+0000","last_became_peered":"2023-09-13T09:39:07.909034+0000","last_unstale":"2023-09-13T09:39:07.909477+0000","last_undegraded":"2023-09-13T09:39:07.909477+0000","last_fullsized":"2023-09-13T09:39:07.909477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:01.975791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898467+0000","last_change":"2023-09-13T09:38:08.692201+0000","last_active":"2023-09-13T09:39:06.898467+0000","last_peered":"2023-09-13T09:39:06.898467+0000","last_clean":"2023-09-13T09:39:06.898467+0000","last_became_active":"2023-09-13T09:38:08.691334+0000","last_became_peered":"2023-09-13T09:38:08.691334+0000","last_unstale":"2023-09-13T09:39:06.898467+0000","last_undegraded":"2023-09-13T09:39:06.898467+0000","last_fullsized":"2023-09-13T09:39:06.898467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:13.098275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904429+0000","last_change":"2023-09-13T09:38:09.701125+0000","last_active":"2023-09-13T09:39:06.904429+0000","last_peered":"2023-09-13T09:39:06.904429+0000","last_clean":"2023-09-13T09:39:06.904429+0000","last_became_active":"2023-09-13T09:38:09.700055+0000","last_became_peered":"2023-09-13T09:38:09.700055+0000","last_unstale":"2023-09-13T09:39:06.904429+0000","last_undegraded":"2023-09-13T09:39:06.904429+0000","last_fullsized":"2023-09-13T09:39:06.904429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:17.787363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906298+0000","last_change":"2023-09-13T09:38:08.696797+0000","last_active":"2023-09-13T09:39:06.906298+0000","last_peered":"2023-09-13T09:39:06.906298+0000","last_clean":"2023-09-13T09:39:06.906298+0000","last_became_active":"2023-09-13T09:38:08.696494+0000","last_became_peered":"2023-09-13T09:38:08.696494+0000","last_unstale":"2023-09-13T09:39:06.906298+0000","last_undegraded":"2023-09-13T09:39:06.906298+0000","last_fullsized":"2023-09-13T09:39:06.906298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:29.454184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903049+0000","last_change":"2023-09-13T09:38:09.694166+0000","last_active":"2023-09-13T09:39:06.903049+0000","last_peered":"2023-09-13T09:39:06.903049+0000","last_clean":"2023-09-13T09:39:06.903049+0000","last_became_active":"2023-09-13T09:38:09.693894+0000","last_became_peered":"2023-09-13T09:38:09.693894+0000","last_unstale":"2023-09-13T09:39:06.903049+0000","last_undegraded":"2023-09-13T09:39:06.903049+0000","last_fullsized":"2023-09-13T09:39:06.903049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:27:35.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":177,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.795457+0000","last_change":"2023-09-13T09:38:08.693649+0000","last_active":"2023-09-13T09:39:34.795457+0000","last_peered":"2023-09-13T09:39:34.795457+0000","last_clean":"2023-09-13T09:39:34.795457+0000","last_became_active":"2023-09-13T09:38:08.693289+0000","last_became_peered":"2023-09-13T09:38:08.693289+0000","last_unstale":"2023-09-13T09:39:34.795457+0000","last_undegraded":"2023-09-13T09:39:34.795457+0000","last_fullsized":"2023-09-13T09:39:34.795457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:39:27.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899503+0000","last_change":"2023-09-13T09:38:09.693872+0000","last_active":"2023-09-13T09:39:06.899503+0000","last_peered":"2023-09-13T09:39:06.899503+0000","last_clean":"2023-09-13T09:39:06.899503+0000","last_became_active":"2023-09-13T09:38:09.693445+0000","last_became_peered":"2023-09-13T09:38:09.693445+0000","last_unstale":"2023-09-13T09:39:06.899503+0000","last_undegraded":"2023-09-13T09:39:06.899503+0000","last_fullsized":"2023-09-13T09:39:06.899503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:29:35.717276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905571+0000","last_change":"2023-09-13T09:38:08.696375+0000","last_active":"2023-09-13T09:39:06.905571+0000","last_peered":"2023-09-13T09:39:06.905571+0000","last_clean":"2023-09-13T09:39:06.905571+0000","last_became_active":"2023-09-13T09:38:08.695799+0000","last_became_peered":"2023-09-13T09:38:08.695799+0000","last_unstale":"2023-09-13T09:39:06.905571+0000","last_undegraded":"2023-09-13T09:39:06.905571+0000","last_fullsized":"2023-09-13T09:39:06.905571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:09.255704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901511+0000","last_change":"2023-09-13T09:38:09.706518+0000","last_active":"2023-09-13T09:39:06.901511+0000","last_peered":"2023-09-13T09:39:06.901511+0000","last_clean":"2023-09-13T09:39:06.901511+0000","last_became_active":"2023-09-13T09:38:09.706083+0000","last_became_peered":"2023-09-13T09:38:09.706083+0000","last_unstale":"2023-09-13T09:39:06.901511+0000","last_undegraded":"2023-09-13T09:39:06.901511+0000","last_fullsized":"2023-09-13T09:39:06.901511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:21:53.831430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907003+0000","last_change":"2023-09-13T09:38:08.697878+0000","last_active":"2023-09-13T09:39:06.907003+0000","last_peered":"2023-09-13T09:39:06.907003+0000","last_clean":"2023-09-13T09:39:06.907003+0000","last_became_active":"2023-09-13T09:38:08.697476+0000","last_became_peered":"2023-09-13T09:38:08.697476+0000","last_unstale":"2023-09-13T09:39:06.907003+0000","last_undegraded":"2023-09-13T09:39:06.907003+0000","last_fullsized":"2023-09-13T09:39:06.907003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:09.021111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899511+0000","last_change":"2023-09-13T09:38:09.697144+0000","last_active":"2023-09-13T09:39:06.899511+0000","last_peered":"2023-09-13T09:39:06.899511+0000","last_clean":"2023-09-13T09:39:06.899511+0000","last_became_active":"2023-09-13T09:38:09.696521+0000","last_became_peered":"2023-09-13T09:38:09.696521+0000","last_unstale":"2023-09-13T09:39:06.899511+0000","last_undegraded":"2023-09-13T09:39:06.899511+0000","last_fullsized":"2023-09-13T09:39:06.899511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:36:17.096644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":211,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.796451+0000","last_change":"2023-09-13T09:38:08.694981+0000","last_active":"2023-09-13T09:39:34.796451+0000","last_peered":"2023-09-13T09:39:34.796451+0000","last_clean":"2023-09-13T09:39:34.796451+0000","last_became_active":"2023-09-13T09:38:08.694630+0000","last_became_peered":"2023-09-13T09:38:08.694630+0000","last_unstale":"2023-09-13T09:39:34.796451+0000","last_undegraded":"2023-09-13T09:39:34.796451+0000","last_fullsized":"2023-09-13T09:39:34.796451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:56:58.204622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59346,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":141,"num_write":33,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902735+0000","last_change":"2023-09-13T09:38:09.700927+0000","last_active":"2023-09-13T09:39:06.902735+0000","last_peered":"2023-09-13T09:39:06.902735+0000","last_clean":"2023-09-13T09:39:06.902735+0000","last_became_active":"2023-09-13T09:38:09.700608+0000","last_became_peered":"2023-09-13T09:38:09.700608+0000","last_unstale":"2023-09-13T09:39:06.902735+0000","last_undegraded":"2023-09-13T09:39:06.902735+0000","last_fullsized":"2023-09-13T09:39:06.902735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:24.177293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899533+0000","last_change":"2023-09-13T09:38:08.699130+0000","last_active":"2023-09-13T09:39:06.899533+0000","last_peered":"2023-09-13T09:39:06.899533+0000","last_clean":"2023-09-13T09:39:06.899533+0000","last_became_active":"2023-09-13T09:38:08.698802+0000","last_became_peered":"2023-09-13T09:38:08.698802+0000","last_unstale":"2023-09-13T09:39:06.899533+0000","last_undegraded":"2023-09-13T09:39:06.899533+0000","last_fullsized":"2023-09-13T09:39:06.899533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:36.539846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898513+0000","last_change":"2023-09-13T09:38:09.697387+0000","last_active":"2023-09-13T09:39:06.898513+0000","last_peered":"2023-09-13T09:39:06.898513+0000","last_clean":"2023-09-13T09:39:06.898513+0000","last_became_active":"2023-09-13T09:38:09.697081+0000","last_became_peered":"2023-09-13T09:38:09.697081+0000","last_unstale":"2023-09-13T09:39:06.898513+0000","last_undegraded":"2023-09-13T09:39:06.898513+0000","last_fullsized":"2023-09-13T09:39:06.898513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:28:59.473258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905984+0000","last_change":"2023-09-13T09:38:08.696609+0000","last_active":"2023-09-13T09:39:06.905984+0000","last_peered":"2023-09-13T09:39:06.905984+0000","last_clean":"2023-09-13T09:39:06.905984+0000","last_became_active":"2023-09-13T09:38:08.696286+0000","last_became_peered":"2023-09-13T09:38:08.696286+0000","last_unstale":"2023-09-13T09:39:06.905984+0000","last_undegraded":"2023-09-13T09:39:06.905984+0000","last_fullsized":"2023-09-13T09:39:06.905984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:06:51.121661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905704+0000","last_change":"2023-09-13T09:38:09.698374+0000","last_active":"2023-09-13T09:39:06.905704+0000","last_peered":"2023-09-13T09:39:06.905704+0000","last_clean":"2023-09-13T09:39:06.905704+0000","last_became_active":"2023-09-13T09:38:09.698050+0000","last_became_peered":"2023-09-13T09:38:09.698050+0000","last_unstale":"2023-09-13T09:39:06.905704+0000","last_undegraded":"2023-09-13T09:39:06.905704+0000","last_fullsized":"2023-09-13T09:39:06.905704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:37:24.089861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:30.790063+0000","last_change":"2023-09-13T09:38:08.692717+0000","last_active":"2023-09-13T09:39:30.790063+0000","last_peered":"2023-09-13T09:39:30.790063+0000","last_clean":"2023-09-13T09:39:30.790063+0000","last_became_active":"2023-09-13T09:38:08.692340+0000","last_became_peered":"2023-09-13T09:38:08.692340+0000","last_unstale":"2023-09-13T09:39:30.790063+0000","last_undegraded":"2023-09-13T09:39:30.790063+0000","last_fullsized":"2023-09-13T09:39:30.790063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:22.280879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905278+0000","last_change":"2023-09-13T09:38:09.701623+0000","last_active":"2023-09-13T09:39:06.905278+0000","last_peered":"2023-09-13T09:39:06.905278+0000","last_clean":"2023-09-13T09:39:06.905278+0000","last_became_active":"2023-09-13T09:38:09.701338+0000","last_became_peered":"2023-09-13T09:38:09.701338+0000","last_unstale":"2023-09-13T09:39:06.905278+0000","last_undegraded":"2023-09-13T09:39:06.905278+0000","last_fullsized":"2023-09-13T09:39:06.905278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:49:58.937293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902190+0000","last_change":"2023-09-13T09:38:08.691968+0000","last_active":"2023-09-13T09:39:06.902190+0000","last_peered":"2023-09-13T09:39:06.902190+0000","last_clean":"2023-09-13T09:39:06.902190+0000","last_became_active":"2023-09-13T09:38:08.691668+0000","last_became_peered":"2023-09-13T09:38:08.691668+0000","last_unstale":"2023-09-13T09:39:06.902190+0000","last_undegraded":"2023-09-13T09:39:06.902190+0000","last_fullsized":"2023-09-13T09:39:06.902190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:43.767948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905422+0000","last_change":"2023-09-13T09:38:09.698123+0000","last_active":"2023-09-13T09:39:06.905422+0000","last_peered":"2023-09-13T09:39:06.905422+0000","last_clean":"2023-09-13T09:39:06.905422+0000","last_became_active":"2023-09-13T09:38:09.697729+0000","last_became_peered":"2023-09-13T09:38:09.697729+0000","last_unstale":"2023-09-13T09:39:06.905422+0000","last_undegraded":"2023-09-13T09:39:06.905422+0000","last_fullsized":"2023-09-13T09:39:06.905422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:25.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902535+0000","last_change":"2023-09-13T09:38:08.691091+0000","last_active":"2023-09-13T09:39:06.902535+0000","last_peered":"2023-09-13T09:39:06.902535+0000","last_clean":"2023-09-13T09:39:06.902535+0000","last_became_active":"2023-09-13T09:38:08.689128+0000","last_became_peered":"2023-09-13T09:38:08.689128+0000","last_unstale":"2023-09-13T09:39:06.902535+0000","last_undegraded":"2023-09-13T09:39:06.902535+0000","last_fullsized":"2023-09-13T09:39:06.902535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:32.133388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904092+0000","last_change":"2023-09-13T09:38:09.706041+0000","last_active":"2023-09-13T09:39:06.904092+0000","last_peered":"2023-09-13T09:39:06.904092+0000","last_clean":"2023-09-13T09:39:06.904092+0000","last_became_active":"2023-09-13T09:38:09.705707+0000","last_became_peered":"2023-09-13T09:38:09.705707+0000","last_unstale":"2023-09-13T09:39:06.904092+0000","last_undegraded":"2023-09-13T09:39:06.904092+0000","last_fullsized":"2023-09-13T09:39:06.904092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:57.018000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903595+0000","last_change":"2023-09-13T09:38:08.695552+0000","last_active":"2023-09-13T09:39:06.903595+0000","last_peered":"2023-09-13T09:39:06.903595+0000","last_clean":"2023-09-13T09:39:06.903595+0000","last_became_active":"2023-09-13T09:38:08.695236+0000","last_became_peered":"2023-09-13T09:38:08.695236+0000","last_unstale":"2023-09-13T09:39:06.903595+0000","last_undegraded":"2023-09-13T09:39:06.903595+0000","last_fullsized":"2023-09-13T09:39:06.903595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:41.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906623+0000","last_change":"2023-09-13T09:38:09.699864+0000","last_active":"2023-09-13T09:39:06.906623+0000","last_peered":"2023-09-13T09:39:06.906623+0000","last_clean":"2023-09-13T09:39:06.906623+0000","last_became_active":"2023-09-13T09:38:09.699522+0000","last_became_peered":"2023-09-13T09:38:09.699522+0000","last_unstale":"2023-09-13T09:39:06.906623+0000","last_undegraded":"2023-09-13T09:39:06.906623+0000","last_fullsized":"2023-09-13T09:39:06.906623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:51.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.794496+0000","last_change":"2023-09-13T09:38:08.695651+0000","last_active":"2023-09-13T09:39:33.794496+0000","last_peered":"2023-09-13T09:39:33.794496+0000","last_clean":"2023-09-13T09:39:33.794496+0000","last_became_active":"2023-09-13T09:38:08.695074+0000","last_became_peered":"2023-09-13T09:38:08.695074+0000","last_unstale":"2023-09-13T09:39:33.794496+0000","last_undegraded":"2023-09-13T09:39:33.794496+0000","last_fullsized":"2023-09-13T09:39:33.794496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:40.974436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906176+0000","last_change":"2023-09-13T09:38:09.698193+0000","last_active":"2023-09-13T09:39:06.906176+0000","last_peered":"2023-09-13T09:39:06.906176+0000","last_clean":"2023-09-13T09:39:06.906176+0000","last_became_active":"2023-09-13T09:38:09.697874+0000","last_became_peered":"2023-09-13T09:38:09.697874+0000","last_unstale":"2023-09-13T09:39:06.906176+0000","last_undegraded":"2023-09-13T09:39:06.906176+0000","last_fullsized":"2023-09-13T09:39:06.906176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:48.908322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.909872+0000","last_change":"2023-09-13T09:39:07.909324+0000","last_active":"2023-09-13T09:39:07.909872+0000","last_peered":"2023-09-13T09:39:07.909872+0000","last_clean":"2023-09-13T09:39:07.909872+0000","last_became_active":"2023-09-13T09:39:07.908877+0000","last_became_peered":"2023-09-13T09:39:07.908877+0000","last_unstale":"2023-09-13T09:39:07.909872+0000","last_undegraded":"2023-09-13T09:39:07.909872+0000","last_fullsized":"2023-09-13T09:39:07.909872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T21:15:28.983303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,8],"acting":[9,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.795111+0000","last_change":"2023-09-13T09:38:08.695499+0000","last_active":"2023-09-13T09:39:34.795111+0000","last_peered":"2023-09-13T09:39:34.795111+0000","last_clean":"2023-09-13T09:39:34.795111+0000","last_became_active":"2023-09-13T09:38:08.695167+0000","last_became_peered":"2023-09-13T09:38:08.695167+0000","last_unstale":"2023-09-13T09:39:34.795111+0000","last_undegraded":"2023-09-13T09:39:34.795111+0000","last_fullsized":"2023-09-13T09:39:34.795111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.561408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903974+0000","last_change":"2023-09-13T09:38:09.702273+0000","last_active":"2023-09-13T09:39:06.903974+0000","last_peered":"2023-09-13T09:39:06.903974+0000","last_clean":"2023-09-13T09:39:06.903974+0000","last_became_active":"2023-09-13T09:38:09.701944+0000","last_became_peered":"2023-09-13T09:38:09.701944+0000","last_unstale":"2023-09-13T09:39:06.903974+0000","last_undegraded":"2023-09-13T09:39:06.903974+0000","last_fullsized":"2023-09-13T09:39:06.903974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:56.548720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904162+0000","last_change":"2023-09-13T09:38:08.692966+0000","last_active":"2023-09-13T09:39:06.904162+0000","last_peered":"2023-09-13T09:39:06.904162+0000","last_clean":"2023-09-13T09:39:06.904162+0000","last_became_active":"2023-09-13T09:38:08.692613+0000","last_became_peered":"2023-09-13T09:38:08.692613+0000","last_unstale":"2023-09-13T09:39:06.904162+0000","last_undegraded":"2023-09-13T09:39:06.904162+0000","last_fullsized":"2023-09-13T09:39:06.904162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:37.327846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":309,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905572+0000","last_change":"2023-09-13T09:37:08.710441+0000","last_active":"2023-09-13T09:39:06.905572+0000","last_peered":"2023-09-13T09:39:06.905572+0000","last_clean":"2023-09-13T09:39:06.905572+0000","last_became_active":"2023-09-13T09:37:08.709939+0000","last_became_peered":"2023-09-13T09:37:08.709939+0000","last_unstale":"2023-09-13T09:39:06.905572+0000","last_undegraded":"2023-09-13T09:39:06.905572+0000","last_fullsized":"2023-09-13T09:39:06.905572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_clean_scrub_stamp":"2023-09-13T09:34:16.664369+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:00.964039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898360+0000","last_change":"2023-09-13T09:38:09.697244+0000","last_active":"2023-09-13T09:39:06.898360+0000","last_peered":"2023-09-13T09:39:06.898360+0000","last_clean":"2023-09-13T09:39:06.898360+0000","last_became_active":"2023-09-13T09:38:09.696925+0000","last_became_peered":"2023-09-13T09:38:09.696925+0000","last_unstale":"2023-09-13T09:39:06.898360+0000","last_undegraded":"2023-09-13T09:39:06.898360+0000","last_fullsized":"2023-09-13T09:39:06.898360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:39.566528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905693+0000","last_change":"2023-09-13T09:38:08.702070+0000","last_active":"2023-09-13T09:39:06.905693+0000","last_peered":"2023-09-13T09:39:06.905693+0000","last_clean":"2023-09-13T09:39:06.905693+0000","last_became_active":"2023-09-13T09:38:08.701647+0000","last_became_peered":"2023-09-13T09:38:08.701647+0000","last_unstale":"2023-09-13T09:39:06.905693+0000","last_undegraded":"2023-09-13T09:39:06.905693+0000","last_fullsized":"2023-09-13T09:39:06.905693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:30:22.405675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902844+0000","last_change":"2023-09-13T09:38:08.696935+0000","last_active":"2023-09-13T09:39:06.902844+0000","last_peered":"2023-09-13T09:39:06.902844+0000","last_clean":"2023-09-13T09:39:06.902844+0000","last_became_active":"2023-09-13T09:38:08.696534+0000","last_became_peered":"2023-09-13T09:38:08.696534+0000","last_unstale":"2023-09-13T09:39:06.902844+0000","last_undegraded":"2023-09-13T09:39:06.902844+0000","last_fullsized":"2023-09-13T09:39:06.902844+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:49:13.883043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898588+0000","last_change":"2023-09-13T09:38:09.695829+0000","last_active":"2023-09-13T09:39:06.898588+0000","last_peered":"2023-09-13T09:39:06.898588+0000","last_clean":"2023-09-13T09:39:06.898588+0000","last_became_active":"2023-09-13T09:38:09.695479+0000","last_became_peered":"2023-09-13T09:38:09.695479+0000","last_unstale":"2023-09-13T09:39:06.898588+0000","last_undegraded":"2023-09-13T09:39:06.898588+0000","last_fullsized":"2023-09-13T09:39:06.898588+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:24:00.042236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905259+0000","last_change":"2023-09-13T09:38:08.698530+0000","last_active":"2023-09-13T09:39:06.905259+0000","last_peered":"2023-09-13T09:39:06.905259+0000","last_clean":"2023-09-13T09:39:06.905259+0000","last_became_active":"2023-09-13T09:38:08.698206+0000","last_became_peered":"2023-09-13T09:38:08.698206+0000","last_unstale":"2023-09-13T09:39:06.905259+0000","last_undegraded":"2023-09-13T09:39:06.905259+0000","last_fullsized":"2023-09-13T09:39:06.905259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:09.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905026+0000","last_change":"2023-09-13T09:38:09.700993+0000","last_active":"2023-09-13T09:39:06.905026+0000","last_peered":"2023-09-13T09:39:06.905026+0000","last_clean":"2023-09-13T09:39:06.905026+0000","last_became_active":"2023-09-13T09:38:09.700677+0000","last_became_peered":"2023-09-13T09:38:09.700677+0000","last_unstale":"2023-09-13T09:39:06.905026+0000","last_undegraded":"2023-09-13T09:39:06.905026+0000","last_fullsized":"2023-09-13T09:39:06.905026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:32.209248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903706+0000","last_change":"2023-09-13T09:38:08.684326+0000","last_active":"2023-09-13T09:39:06.903706+0000","last_peered":"2023-09-13T09:39:06.903706+0000","last_clean":"2023-09-13T09:39:06.903706+0000","last_became_active":"2023-09-13T09:38:08.683972+0000","last_became_peered":"2023-09-13T09:38:08.683972+0000","last_unstale":"2023-09-13T09:39:06.903706+0000","last_undegraded":"2023-09-13T09:39:06.903706+0000","last_fullsized":"2023-09-13T09:39:06.903706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:22.702277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901365+0000","last_change":"2023-09-13T09:38:09.706237+0000","last_active":"2023-09-13T09:39:06.901365+0000","last_peered":"2023-09-13T09:39:06.901365+0000","last_clean":"2023-09-13T09:39:06.901365+0000","last_became_active":"2023-09-13T09:38:09.705706+0000","last_became_peered":"2023-09-13T09:38:09.705706+0000","last_unstale":"2023-09-13T09:39:06.901365+0000","last_undegraded":"2023-09-13T09:39:06.901365+0000","last_fullsized":"2023-09-13T09:39:06.901365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:18.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899139+0000","last_change":"2023-09-13T09:38:08.695641+0000","last_active":"2023-09-13T09:39:06.899139+0000","last_peered":"2023-09-13T09:39:06.899139+0000","last_clean":"2023-09-13T09:39:06.899139+0000","last_became_active":"2023-09-13T09:38:08.695090+0000","last_became_peered":"2023-09-13T09:38:08.695090+0000","last_unstale":"2023-09-13T09:39:06.899139+0000","last_undegraded":"2023-09-13T09:39:06.899139+0000","last_fullsized":"2023-09-13T09:39:06.899139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:16:13.987022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902335+0000","last_change":"2023-09-13T09:38:09.702254+0000","last_active":"2023-09-13T09:39:06.902335+0000","last_peered":"2023-09-13T09:39:06.902335+0000","last_clean":"2023-09-13T09:39:06.902335+0000","last_became_active":"2023-09-13T09:38:09.701946+0000","last_became_peered":"2023-09-13T09:38:09.701946+0000","last_unstale":"2023-09-13T09:39:06.902335+0000","last_undegraded":"2023-09-13T09:39:06.902335+0000","last_fullsized":"2023-09-13T09:39:06.902335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:41.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903489+0000","last_change":"2023-09-13T09:38:08.694692+0000","last_active":"2023-09-13T09:39:06.903489+0000","last_peered":"2023-09-13T09:39:06.903489+0000","last_clean":"2023-09-13T09:39:06.903489+0000","last_became_active":"2023-09-13T09:38:08.693799+0000","last_became_peered":"2023-09-13T09:38:08.693799+0000","last_unstale":"2023-09-13T09:39:06.903489+0000","last_undegraded":"2023-09-13T09:39:06.903489+0000","last_fullsized":"2023-09-13T09:39:06.903489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:53:57.188153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903647+0000","last_change":"2023-09-13T09:38:09.707954+0000","last_active":"2023-09-13T09:39:06.903647+0000","last_peered":"2023-09-13T09:39:06.903647+0000","last_clean":"2023-09-13T09:39:06.903647+0000","last_became_active":"2023-09-13T09:38:09.707659+0000","last_became_peered":"2023-09-13T09:38:09.707659+0000","last_unstale":"2023-09-13T09:39:06.903647+0000","last_undegraded":"2023-09-13T09:39:06.903647+0000","last_fullsized":"2023-09-13T09:39:06.903647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:34.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.914790+0000","last_change":"2023-09-13T09:39:07.914790+0000","last_active":"2023-09-13T09:39:07.914790+0000","last_peered":"2023-09-13T09:39:07.914790+0000","last_clean":"2023-09-13T09:39:07.914790+0000","last_became_active":"2023-09-13T09:39:07.909229+0000","last_became_peered":"2023-09-13T09:39:07.909229+0000","last_unstale":"2023-09-13T09:39:07.914790+0000","last_undegraded":"2023-09-13T09:39:07.914790+0000","last_fullsized":"2023-09-13T09:39:07.914790+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:06.947358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904695+0000","last_change":"2023-09-13T09:38:09.700593+0000","last_active":"2023-09-13T09:39:06.904695+0000","last_peered":"2023-09-13T09:39:06.904695+0000","last_clean":"2023-09-13T09:39:06.904695+0000","last_became_active":"2023-09-13T09:38:09.700263+0000","last_became_peered":"2023-09-13T09:38:09.700263+0000","last_unstale":"2023-09-13T09:39:06.904695+0000","last_undegraded":"2023-09-13T09:39:06.904695+0000","last_fullsized":"2023-09-13T09:39:06.904695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:17:38.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902522+0000","last_change":"2023-09-13T09:38:08.692455+0000","last_active":"2023-09-13T09:39:06.902522+0000","last_peered":"2023-09-13T09:39:06.902522+0000","last_clean":"2023-09-13T09:39:06.902522+0000","last_became_active":"2023-09-13T09:38:08.692118+0000","last_became_peered":"2023-09-13T09:38:08.692118+0000","last_unstale":"2023-09-13T09:39:06.902522+0000","last_undegraded":"2023-09-13T09:39:06.902522+0000","last_fullsized":"2023-09-13T09:39:06.902522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:33.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906384+0000","last_change":"2023-09-13T09:38:09.695783+0000","last_active":"2023-09-13T09:39:06.906384+0000","last_peered":"2023-09-13T09:39:06.906384+0000","last_clean":"2023-09-13T09:39:06.906384+0000","last_became_active":"2023-09-13T09:38:09.695473+0000","last_became_peered":"2023-09-13T09:38:09.695473+0000","last_unstale":"2023-09-13T09:39:06.906384+0000","last_undegraded":"2023-09-13T09:39:06.906384+0000","last_fullsized":"2023-09-13T09:39:06.906384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:59.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.794442+0000","last_change":"2023-09-13T09:38:08.697468+0000","last_active":"2023-09-13T09:39:33.794442+0000","last_peered":"2023-09-13T09:39:33.794442+0000","last_clean":"2023-09-13T09:39:33.794442+0000","last_became_active":"2023-09-13T09:38:08.697141+0000","last_became_peered":"2023-09-13T09:38:08.697141+0000","last_unstale":"2023-09-13T09:39:33.794442+0000","last_undegraded":"2023-09-13T09:39:33.794442+0000","last_fullsized":"2023-09-13T09:39:33.794442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:33:26.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906258+0000","last_change":"2023-09-13T09:38:09.703754+0000","last_active":"2023-09-13T09:39:06.906258+0000","last_peered":"2023-09-13T09:39:06.906258+0000","last_clean":"2023-09-13T09:39:06.906258+0000","last_became_active":"2023-09-13T09:38:09.703438+0000","last_became_peered":"2023-09-13T09:38:09.703438+0000","last_unstale":"2023-09-13T09:39:06.906258+0000","last_undegraded":"2023-09-13T09:39:06.906258+0000","last_fullsized":"2023-09-13T09:39:06.906258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:19.298385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906887+0000","last_change":"2023-09-13T09:38:08.698973+0000","last_active":"2023-09-13T09:39:06.906887+0000","last_peered":"2023-09-13T09:39:06.906887+0000","last_clean":"2023-09-13T09:39:06.906887+0000","last_became_active":"2023-09-13T09:38:08.698329+0000","last_became_peered":"2023-09-13T09:38:08.698329+0000","last_unstale":"2023-09-13T09:39:06.906887+0000","last_undegraded":"2023-09-13T09:39:06.906887+0000","last_fullsized":"2023-09-13T09:39:06.906887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:10.684590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905485+0000","last_change":"2023-09-13T09:38:09.700216+0000","last_active":"2023-09-13T09:39:06.905485+0000","last_peered":"2023-09-13T09:39:06.905485+0000","last_clean":"2023-09-13T09:39:06.905485+0000","last_became_active":"2023-09-13T09:38:09.699876+0000","last_became_peered":"2023-09-13T09:38:09.699876+0000","last_unstale":"2023-09-13T09:39:06.905485+0000","last_undegraded":"2023-09-13T09:39:06.905485+0000","last_fullsized":"2023-09-13T09:39:06.905485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:33.347155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898610+0000","last_change":"2023-09-13T09:38:08.696200+0000","last_active":"2023-09-13T09:39:06.898610+0000","last_peered":"2023-09-13T09:39:06.898610+0000","last_clean":"2023-09-13T09:39:06.898610+0000","last_became_active":"2023-09-13T09:38:08.695880+0000","last_became_peered":"2023-09-13T09:38:08.695880+0000","last_unstale":"2023-09-13T09:39:06.898610+0000","last_undegraded":"2023-09-13T09:39:06.898610+0000","last_fullsized":"2023-09-13T09:39:06.898610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:38.222209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905761+0000","last_change":"2023-09-13T09:38:09.703022+0000","last_active":"2023-09-13T09:39:06.905761+0000","last_peered":"2023-09-13T09:39:06.905761+0000","last_clean":"2023-09-13T09:39:06.905761+0000","last_became_active":"2023-09-13T09:38:09.702665+0000","last_became_peered":"2023-09-13T09:38:09.702665+0000","last_unstale":"2023-09-13T09:39:06.905761+0000","last_undegraded":"2023-09-13T09:39:06.905761+0000","last_fullsized":"2023-09-13T09:39:06.905761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:59.284385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903711+0000","last_change":"2023-09-13T09:38:09.708137+0000","last_active":"2023-09-13T09:39:06.903711+0000","last_peered":"2023-09-13T09:39:06.903711+0000","last_clean":"2023-09-13T09:39:06.903711+0000","last_became_active":"2023-09-13T09:38:09.707829+0000","last_became_peered":"2023-09-13T09:38:09.707829+0000","last_unstale":"2023-09-13T09:39:06.903711+0000","last_undegraded":"2023-09-13T09:39:06.903711+0000","last_fullsized":"2023-09-13T09:39:06.903711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:15.976098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899071+0000","last_change":"2023-09-13T09:38:09.703131+0000","last_active":"2023-09-13T09:39:06.899071+0000","last_peered":"2023-09-13T09:39:06.899071+0000","last_clean":"2023-09-13T09:39:06.899071+0000","last_became_active":"2023-09-13T09:38:09.702850+0000","last_became_peered":"2023-09-13T09:38:09.702850+0000","last_unstale":"2023-09-13T09:39:06.899071+0000","last_undegraded":"2023-09-13T09:39:06.899071+0000","last_fullsized":"2023-09-13T09:39:06.899071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:08.422038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899035+0000","last_change":"2023-09-13T09:38:09.701691+0000","last_active":"2023-09-13T09:39:06.899035+0000","last_peered":"2023-09-13T09:39:06.899035+0000","last_clean":"2023-09-13T09:39:06.899035+0000","last_became_active":"2023-09-13T09:38:09.701395+0000","last_became_peered":"2023-09-13T09:38:09.701395+0000","last_unstale":"2023-09-13T09:39:06.899035+0000","last_undegraded":"2023-09-13T09:39:06.899035+0000","last_fullsized":"2023-09-13T09:39:06.899035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:02.916712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901222+0000","last_change":"2023-09-13T09:38:09.706885+0000","last_active":"2023-09-13T09:39:06.901222+0000","last_peered":"2023-09-13T09:39:06.901222+0000","last_clean":"2023-09-13T09:39:06.901222+0000","last_became_active":"2023-09-13T09:38:09.706569+0000","last_became_peered":"2023-09-13T09:38:09.706569+0000","last_unstale":"2023-09-13T09:39:06.901222+0000","last_undegraded":"2023-09-13T09:39:06.901222+0000","last_fullsized":"2023-09-13T09:39:06.901222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:02.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898666+0000","last_change":"2023-09-13T09:38:09.698547+0000","last_active":"2023-09-13T09:39:06.898666+0000","last_peered":"2023-09-13T09:39:06.898666+0000","last_clean":"2023-09-13T09:39:06.898666+0000","last_became_active":"2023-09-13T09:38:09.698180+0000","last_became_peered":"2023-09-13T09:38:09.698180+0000","last_unstale":"2023-09-13T09:39:06.898666+0000","last_undegraded":"2023-09-13T09:39:06.898666+0000","last_fullsized":"2023-09-13T09:39:06.898666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:12.988597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.910066+0000","last_change":"2023-09-13T09:39:07.910066+0000","last_active":"2023-09-13T09:39:07.910066+0000","last_peered":"2023-09-13T09:39:07.910066+0000","last_clean":"2023-09-13T09:39:07.910066+0000","last_became_active":"2023-09-13T09:39:07.909109+0000","last_became_peered":"2023-09-13T09:39:07.909109+0000","last_unstale":"2023-09-13T09:39:07.910066+0000","last_undegraded":"2023-09-13T09:39:07.910066+0000","last_fullsized":"2023-09-13T09:39:07.910066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:51:07.559587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.900063+0000","last_change":"2023-09-13T09:38:09.695277+0000","last_active":"2023-09-13T09:39:06.900063+0000","last_peered":"2023-09-13T09:39:06.900063+0000","last_clean":"2023-09-13T09:39:06.900063+0000","last_became_active":"2023-09-13T09:38:09.694959+0000","last_became_peered":"2023-09-13T09:38:09.694959+0000","last_unstale":"2023-09-13T09:39:06.900063+0000","last_undegraded":"2023-09-13T09:39:06.900063+0000","last_fullsized":"2023-09-13T09:39:06.900063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:35:17.321069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903273+0000","last_change":"2023-09-13T09:38:09.702030+0000","last_active":"2023-09-13T09:39:06.903273+0000","last_peered":"2023-09-13T09:39:06.903273+0000","last_clean":"2023-09-13T09:39:06.903273+0000","last_became_active":"2023-09-13T09:38:09.701712+0000","last_became_peered":"2023-09-13T09:38:09.701712+0000","last_unstale":"2023-09-13T09:39:06.903273+0000","last_undegraded":"2023-09-13T09:39:06.903273+0000","last_fullsized":"2023-09-13T09:39:06.903273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:38.909533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:08.159049+0000","last_change":"2023-09-13T09:39:08.159049+0000","last_active":"2023-09-13T09:39:08.159049+0000","last_peered":"2023-09-13T09:39:08.159049+0000","last_clean":"2023-09-13T09:39:08.159049+0000","last_became_active":"2023-09-13T09:39:08.158719+0000","last_became_peered":"2023-09-13T09:39:08.158719+0000","last_unstale":"2023-09-13T09:39:08.159049+0000","last_undegraded":"2023-09-13T09:39:08.159049+0000","last_fullsized":"2023-09-13T09:39:08.159049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:52.336150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903267+0000","last_change":"2023-09-13T09:38:09.703544+0000","last_active":"2023-09-13T09:39:06.903267+0000","last_peered":"2023-09-13T09:39:06.903267+0000","last_clean":"2023-09-13T09:39:06.903267+0000","last_became_active":"2023-09-13T09:38:09.702015+0000","last_became_peered":"2023-09-13T09:38:09.702015+0000","last_unstale":"2023-09-13T09:39:06.903267+0000","last_undegraded":"2023-09-13T09:39:06.903267+0000","last_fullsized":"2023-09-13T09:39:06.903267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:46:49.166965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899447+0000","last_change":"2023-09-13T09:38:09.694224+0000","last_active":"2023-09-13T09:39:06.899447+0000","last_peered":"2023-09-13T09:39:06.899447+0000","last_clean":"2023-09-13T09:39:06.899447+0000","last_became_active":"2023-09-13T09:38:09.693562+0000","last_became_peered":"2023-09-13T09:38:09.693562+0000","last_unstale":"2023-09-13T09:39:06.899447+0000","last_undegraded":"2023-09-13T09:39:06.899447+0000","last_fullsized":"2023-09-13T09:39:06.899447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:41:07.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898674+0000","last_change":"2023-09-13T09:38:09.698919+0000","last_active":"2023-09-13T09:39:06.898674+0000","last_peered":"2023-09-13T09:39:06.898674+0000","last_clean":"2023-09-13T09:39:06.898674+0000","last_became_active":"2023-09-13T09:38:09.698637+0000","last_became_peered":"2023-09-13T09:38:09.698637+0000","last_unstale":"2023-09-13T09:39:06.898674+0000","last_undegraded":"2023-09-13T09:39:06.898674+0000","last_fullsized":"2023-09-13T09:39:06.898674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:50.277687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903854+0000","last_change":"2023-09-13T09:38:09.705194+0000","last_active":"2023-09-13T09:39:06.903854+0000","last_peered":"2023-09-13T09:39:06.903854+0000","last_clean":"2023-09-13T09:39:06.903854+0000","last_became_active":"2023-09-13T09:38:09.704888+0000","last_became_peered":"2023-09-13T09:38:09.704888+0000","last_unstale":"2023-09-13T09:39:06.903854+0000","last_undegraded":"2023-09-13T09:39:06.903854+0000","last_fullsized":"2023-09-13T09:39:06.903854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:07.995177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66866,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":824,"num_read_kb":489,"num_write":234,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":196278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416412,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":452728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.749}]},{"osd":2,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.376},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.41599999999999998}]},{"osd":6,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82099999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66000000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.79800000000000004}]},{"osd":10,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78200000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1646592,"data_stored":1103168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.503,"15min":0.501},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.621}]},{"osd":2,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79800000000000004}]},{"osd":3,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.47599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84599999999999997,"5min":0.995,"15min":0.995},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69499999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84899999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88700000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.161,"15min":1.161},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":1.026,"15min":1.026},"last":0.89000000000000001}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.875}]},{"osd":8,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.879},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0920000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.004}]},{"osd":9,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88,"15min":0.88600000000000001},"min":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.871,"15min":0.88100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0169999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.94799999999999995}]},{"osd":11,"last update":"Wed Sep 13 09:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.70799999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1120000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.97699999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841573,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":452658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.316},{"interface":"front","average":{"1min":0.438,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.38900000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82999999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.32000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65300000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60499999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.443}]},{"osd":4,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82499999999999996,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88,"5min":1.256,"15min":1.256},"last":0.5}]},{"osd":5,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86699999999999999,"5min":1.117,"15min":1.117},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.70399999999999996,"15min":0.71799999999999997},"min":{"1min":0.496,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83499999999999996,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88200000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81399999999999995,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.83199999999999996,"5min":1.204,"15min":1.204},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85399999999999998,"5min":1.276,"15min":1.276},"last":0.71099999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.85099999999999998},"min":{"1min":0.59999999999999998,"5min":0.501,"15min":0.501},"max":{"1min":0.86699999999999999,"5min":1.224,"15min":1.224},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.84999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60799999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90600000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91900000000000004,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.69399999999999995}]}]},{"osd":8,"up_from":58,"seq":249108103209,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":452705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73799999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.442,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.497}]},{"osd":1,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61299999999999999,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59599999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45800000000000002,"15min":0.44800000000000001},"min":{"1min":0.379,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.436},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.60099999999999998},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.498,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64000000000000001,"15min":0.61199999999999999},"min":{"1min":0.56000000000000005,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.66300000000000003,"15min":0.63600000000000001},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.45100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.57699999999999996,"15min":0.56399999999999995},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95199999999999996,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91600000000000004,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.72199999999999998,"15min":0.69099999999999995},"min":{"1min":0.51600000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.91100000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.88}]},{"osd":10,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.73899999999999999,"15min":0.71999999999999997},"min":{"1min":0.56499999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.77800000000000002,"15min":0.76200000000000001},"min":{"1min":0.57099999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84999999999999998}]},{"osd":11,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80600000000000005}]}]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1046267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.5},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.40400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.52900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66900000000000004},"min":{"1min":0.56499999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":1.024,"15min":1.024},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.69199999999999995,"15min":0.65200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.093,"5min":5.093,"15min":5.093},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.64400000000000002}]},{"osd":4,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.372,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77000000000000002,"5min":0.999,"15min":0.999},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88900000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.79800000000000004,"15min":0.77900000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.115,"5min":0.83699999999999997,"15min":0.79300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":8.1099999999999994},"last":0.67400000000000004}]},{"osd":8,"last update":"Wed Sep 13 09:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.66300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.93500000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.77300000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.81899999999999995,"15min":0.78200000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.81699999999999995}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.83699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94199999999999995}]},{"osd":11,"last update":"Wed Sep 13 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.85199999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":452699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.40200000000000002},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63500000000000001,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.442,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.63900000000000001},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.71399999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95299999999999996,"5min":1.101,"15min":1.101},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69399999999999995,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.014,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.754},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.143,"15min":1.143},"last":0.80900000000000005}]},{"osd":8,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81499999999999995,"5min":1.214,"15min":1.214},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.80500000000000005,"5min":1.121,"15min":1.121},"last":0.66600000000000004}]},{"osd":9,"last update":"Wed Sep 13 09:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.81899999999999995},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92900000000000005,"5min":1.264,"15min":1.264},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76900000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0880000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.80300000000000005,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":508632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.623,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0009999999999999,"5min":1.075,"15min":1.075},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.61599999999999999,"15min":0.55700000000000005},"min":{"1min":0.56200000000000006,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Wed Sep 13 09:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64900000000000002,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.54500000000000004,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.91800000000000004,"5min":1.117,"15min":1.117},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.626,"15min":0.57399999999999995},"min":{"1min":0.42699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.69399999999999995,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.81699999999999995}]},{"osd":7,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.68400000000000005,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.86699999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.78700000000000003,"15min":0.76600000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.83299999999999996,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.141,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.1339999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81899999999999995,"15min":0.81699999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.109}]},{"osd":10,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92400000000000004,"15min":0.91800000000000004},"min":{"1min":0.64400000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.873,"15min":0.86699999999999999},"min":{"1min":0.67500000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.006}]},{"osd":11,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.05},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.038}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":453714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 09:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.48199999999999998},"min":{"1min":0.39200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73999999999999999,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":1.47,"15min":1.47},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.58899999999999997,"15min":0.52900000000000003},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.436}]},{"osd":4,"last update":"Wed Sep 13 09:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.875,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":1.288,"15min":1.288},"last":0.505}]},{"osd":5,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.61899999999999999},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64800000000000002,"15min":0.623},"min":{"1min":0.46000000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85999999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69299999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.58299999999999996}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.80000000000000004,"15min":0.82799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68000000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97199999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.54800000000000004}]},{"osd":11,"last update":"Wed Sep 13 09:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":513244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.48399999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.503},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.58299999999999996,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.878,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81399999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.751,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.496,"15min":0.45800000000000002},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.44600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78200000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.56000000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1,"15min":1},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65600000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751}]},{"osd":8,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.91400000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42899999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.46300000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77800000000000002}]},{"osd":11,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.755},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.64900000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":451881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.55600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39900000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81699999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.51900000000000002},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69899999999999995,"5min":1.649,"15min":1.649},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":2.238,"15min":2.238},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":1.052,"15min":1.052},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.746,"5min":1.292,"15min":1.292},"last":0.622}]},{"osd":5,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.71499999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98899999999999999,"5min":1.02,"15min":1.02},"last":0.5},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":1.071,"15min":1.071},"last":0.437}]},{"osd":7,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68899999999999995,"15min":0.67400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84999999999999998,"5min":1.595,"15min":1.595},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84199999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.69699999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":1.109,"15min":1.109},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.60599999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.871},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.97099999999999997,"5min":1.73,"15min":1.73},"last":0.751},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83299999999999996,"15min":0.85899999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.399,"15min":1.399},"last":0.74099999999999999}]},{"osd":11,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66500000000000004}]}]},{"osd":4,"up_from":32,"seq":137438953530,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":452626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.53100000000000003},"min":{"1min":0.44700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.335,"5min":3.335,"15min":3.335},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.433,"15min":0.39500000000000002},"min":{"1min":0.28399999999999997,"5min":0.249,"15min":0.249},"max":{"1min":0.63600000000000001,"5min":0.745,"15min":0.745},"last":0.434},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.442,"15min":0.40699999999999997},"min":{"1min":0.34200000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66800000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93200000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59599999999999997}]},{"osd":3,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61899999999999999,"15min":0.57499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80500000000000005,"5min":1.05,"15min":1.05},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.68400000000000005,"15min":0.65400000000000003},"min":{"1min":0.52500000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.64700000000000002},"min":{"1min":0.60299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90900000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76000000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98399999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.87,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":1.03,"15min":1.03},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.05,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.69699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.052,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.83299999999999996,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88100000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.4470000000000001},"last":0.71499999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90200000000000002,"15min":0.90800000000000003},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.115,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86099999999999999}]},{"osd":11,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.94899999999999995}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1045237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.505},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.53500000000000003,"15min":0.498},"min":{"1min":0.45200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.42699999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80500000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.51400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.432,"15min":0.40000000000000002},"min":{"1min":0.35499999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61799999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.45800000000000002,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55100000000000005,"15min":0.53100000000000003},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.52900000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63100000000000001,"15min":0.58099999999999996},"min":{"1min":0.55800000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.504,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71399999999999997}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":1.044,"15min":1.044},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88600000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79200000000000004}]},{"osd":8,"last update":"Wed Sep 13 09:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.57999999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.80600000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.56799999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.754,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.92500000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T09:39:36.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T09:39:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 -- 172.21.15.6:0/2212302547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101700 msgr2=0x7fd70c107fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 --2- 172.21.15.6:0/2212302547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101700 0x7fd70c107fb0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fd70400b0d0 tx=0x7fd70400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 -- 172.21.15.6:0/2212302547 shutdown_connections 2023-09-13T09:39:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 --2- 172.21.15.6:0/2212302547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101700 0x7fd70c107fb0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 --2- 172.21.15.6:0/2212302547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c0ffb70 0x7fd70c0fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 --2- 172.21.15.6:0/2212302547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c100d60 0x7fd70c1011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 -- 172.21.15.6:0/2212302547 >> 172.21.15.6:0/2212302547 conn(0x7fd70c0fb0e0 msgr2=0x7fd70c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 -- 172.21.15.6:0/2212302547 shutdown_connections 2023-09-13T09:39:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.373+0000 7fd7120d9700 1 -- 172.21.15.6:0/2212302547 wait complete. 2023-09-13T09:39:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 Processor -- start 2023-09-13T09:39:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 -- start start 2023-09-13T09:39:36.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffb70 0x7fd70c196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100d60 0x7fd70c196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c101700 0x7fd70c19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19e5f0 con 0x7fd70c100d60 2023-09-13T09:39:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19e730 con 0x7fd70c101700 2023-09-13T09:39:36.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd7120d9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19e8c0 con 0x7fd70c0ffb70 2023-09-13T09:39:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100d60 0x7fd70c196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100d60 0x7fd70c196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33842/0 (socket says 172.21.15.6:33842) 2023-09-13T09:39:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 -- 172.21.15.6:0/3622362415 learned_addr learned my addr 172.21.15.6:0/3622362415 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffb70 0x7fd70c196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70bfff700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c101700 0x7fd70c19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 -- 172.21.15.6:0/3622362415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffb70 msgr2=0x7fd70c196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffb70 0x7fd70c196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 -- 172.21.15.6:0/3622362415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c101700 msgr2=0x7fd70c19e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c101700 0x7fd70c19e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70affd700 1 -- 172.21.15.6:0/3622362415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704009d00 con 0x7fd70c100d60 2023-09-13T09:39:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.374+0000 7fd70bfff700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c101700 0x7fd70c19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.375+0000 7fd70affd700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100d60 0x7fd70c196fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00d950 tx=0x7fd6fc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.375+0000 7fd708ff9700 1 -- 172.21.15.6:0/3622362415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc009940 con 0x7fd70c100d60 2023-09-13T09:39:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.375+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c19eba0 con 0x7fd70c100d60 2023-09-13T09:39:36.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.375+0000 7fd708ff9700 1 -- 172.21.15.6:0/3622362415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6fc010460 con 0x7fd70c100d60 2023-09-13T09:39:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.375+0000 7fd708ff9700 1 -- 172.21.15.6:0/3622362415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc00f620 con 0x7fd70c100d60 2023-09-13T09:39:36.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.375+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c19f0b0 con 0x7fd70c100d60 2023-09-13T09:39:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.376+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd70c10b390 con 0x7fd70c100d60 2023-09-13T09:39:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.377+0000 7fd708ff9700 1 -- 172.21.15.6:0/3622362415 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 135309+0+0 (secure 0 0 0) 0x7fd6fc0108d0 con 0x7fd70c100d60 2023-09-13T09:39:36.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.378+0000 7fd708ff9700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f80a06d0 0x7fd6f80a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.378+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f80a06d0 0x7fd6f80a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.378+0000 7fd708ff9700 1 -- 172.21.15.6:0/3622362415 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fd6fc0cbaf0 con 0x7fd70c100d60 2023-09-13T09:39:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.378+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f80a06d0 0x7fd6f80a2b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd70c100bc0 tx=0x7fd6f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:36.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.382+0000 7fd708ff9700 1 -- 172.21.15.6:0/3622362415 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd6fc0954b0 con 0x7fd70c100d60 2023-09-13T09:39:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.584+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd70c0686e0 con 0x7fd6f80a06d0 2023-09-13T09:39:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.596+0000 7fd708ff9700 1 -- 172.21.15.6:0/3622362415 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343567 (secure 0 0 0) 0x7fd70c0686e0 con 0x7fd6f80a06d0 2023-09-13T09:39:36.600 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:36.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f80a06d0 msgr2=0x7fd6f80a2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f80a06d0 0x7fd6f80a2b90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fd70c100bc0 tx=0x7fd6f4009260 comp rx=0 tx=0).stop 2023-09-13T09:39:36.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100d60 msgr2=0x7fd70c196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100d60 0x7fd70c196fb0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00d950 tx=0x7fd6fc00dc60 comp rx=0 tx=0).stop 2023-09-13T09:39:36.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 shutdown_connections 2023-09-13T09:39:36.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c101700 0x7fd70c19e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffb70 0x7fd70c196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f80a06d0 0x7fd6f80a2b90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 --2- 172.21.15.6:0/3622362415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100d60 0x7fd70c196fb0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 >> 172.21.15.6:0/3622362415 conn(0x7fd70c0fb0e0 msgr2=0x7fd70c067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:36.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 shutdown_connections 2023-09-13T09:39:36.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.600+0000 7fd7120d9700 1 -- 172.21.15.6:0/3622362415 wait complete. 2023-09-13T09:39:36.606 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-09-13T09:39:36.612 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-09-13T09:39:36.161308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657480,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":950,"num_read_kb":598,"num_write":417,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337540,"kb_used_data":13292,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604284,"statfs":{"total":1151940427776,"available":1151594786816,"internally_reserved":0,"allocated":13611008,"data_stored":7385559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4956,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":82,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003057"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904417+0000","last_change":"2023-09-13T09:38:09.701485+0000","last_active":"2023-09-13T09:39:06.904417+0000","last_peered":"2023-09-13T09:39:06.904417+0000","last_clean":"2023-09-13T09:39:06.904417+0000","last_became_active":"2023-09-13T09:38:09.701160+0000","last_became_peered":"2023-09-13T09:38:09.701160+0000","last_unstale":"2023-09-13T09:39:06.904417+0000","last_undegraded":"2023-09-13T09:39:06.904417+0000","last_fullsized":"2023-09-13T09:39:06.904417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:10.089322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901435+0000","last_change":"2023-09-13T09:38:09.697198+0000","last_active":"2023-09-13T09:39:06.901435+0000","last_peered":"2023-09-13T09:39:06.901435+0000","last_clean":"2023-09-13T09:39:06.901435+0000","last_became_active":"2023-09-13T09:38:09.696859+0000","last_became_peered":"2023-09-13T09:38:09.696859+0000","last_unstale":"2023-09-13T09:39:06.901435+0000","last_undegraded":"2023-09-13T09:39:06.901435+0000","last_fullsized":"2023-09-13T09:39:06.901435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:53.601426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901153+0000","last_change":"2023-09-13T09:38:09.696150+0000","last_active":"2023-09-13T09:39:06.901153+0000","last_peered":"2023-09-13T09:39:06.901153+0000","last_clean":"2023-09-13T09:39:06.901153+0000","last_became_active":"2023-09-13T09:38:09.695893+0000","last_became_peered":"2023-09-13T09:38:09.695893+0000","last_unstale":"2023-09-13T09:39:06.901153+0000","last_undegraded":"2023-09-13T09:39:06.901153+0000","last_fullsized":"2023-09-13T09:39:06.901153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:51.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903598+0000","last_change":"2023-09-13T09:38:09.697564+0000","last_active":"2023-09-13T09:39:06.903598+0000","last_peered":"2023-09-13T09:39:06.903598+0000","last_clean":"2023-09-13T09:39:06.903598+0000","last_became_active":"2023-09-13T09:38:09.697235+0000","last_became_peered":"2023-09-13T09:38:09.697235+0000","last_unstale":"2023-09-13T09:39:06.903598+0000","last_undegraded":"2023-09-13T09:39:06.903598+0000","last_fullsized":"2023-09-13T09:39:06.903598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:49.705452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902416+0000","last_change":"2023-09-13T09:38:09.702889+0000","last_active":"2023-09-13T09:39:06.902416+0000","last_peered":"2023-09-13T09:39:06.902416+0000","last_clean":"2023-09-13T09:39:06.902416+0000","last_became_active":"2023-09-13T09:38:09.702589+0000","last_became_peered":"2023-09-13T09:38:09.702589+0000","last_unstale":"2023-09-13T09:39:06.902416+0000","last_undegraded":"2023-09-13T09:39:06.902416+0000","last_fullsized":"2023-09-13T09:39:06.902416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:56:05.432576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.911965+0000","last_change":"2023-09-13T09:39:07.911965+0000","last_active":"2023-09-13T09:39:07.911965+0000","last_peered":"2023-09-13T09:39:07.911965+0000","last_clean":"2023-09-13T09:39:07.911965+0000","last_became_active":"2023-09-13T09:39:07.911381+0000","last_became_peered":"2023-09-13T09:39:07.911381+0000","last_unstale":"2023-09-13T09:39:07.911965+0000","last_undegraded":"2023-09-13T09:39:07.911965+0000","last_fullsized":"2023-09-13T09:39:07.911965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:57.993882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905407+0000","last_change":"2023-09-13T09:38:09.700506+0000","last_active":"2023-09-13T09:39:06.905407+0000","last_peered":"2023-09-13T09:39:06.905407+0000","last_clean":"2023-09-13T09:39:06.905407+0000","last_became_active":"2023-09-13T09:38:09.700178+0000","last_became_peered":"2023-09-13T09:38:09.700178+0000","last_unstale":"2023-09-13T09:39:06.905407+0000","last_undegraded":"2023-09-13T09:39:06.905407+0000","last_fullsized":"2023-09-13T09:39:06.905407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:04.261443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904341+0000","last_change":"2023-09-13T09:38:09.703191+0000","last_active":"2023-09-13T09:39:06.904341+0000","last_peered":"2023-09-13T09:39:06.904341+0000","last_clean":"2023-09-13T09:39:06.904341+0000","last_became_active":"2023-09-13T09:38:09.702874+0000","last_became_peered":"2023-09-13T09:38:09.702874+0000","last_unstale":"2023-09-13T09:39:06.904341+0000","last_undegraded":"2023-09-13T09:39:06.904341+0000","last_fullsized":"2023-09-13T09:39:06.904341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:50:25.759861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899611+0000","last_change":"2023-09-13T09:38:09.700416+0000","last_active":"2023-09-13T09:39:06.899611+0000","last_peered":"2023-09-13T09:39:06.899611+0000","last_clean":"2023-09-13T09:39:06.899611+0000","last_became_active":"2023-09-13T09:38:09.700102+0000","last_became_peered":"2023-09-13T09:38:09.700102+0000","last_unstale":"2023-09-13T09:39:06.899611+0000","last_undegraded":"2023-09-13T09:39:06.899611+0000","last_fullsized":"2023-09-13T09:39:06.899611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:53.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906839+0000","last_change":"2023-09-13T09:38:09.702609+0000","last_active":"2023-09-13T09:39:06.906839+0000","last_peered":"2023-09-13T09:39:06.906839+0000","last_clean":"2023-09-13T09:39:06.906839+0000","last_became_active":"2023-09-13T09:38:09.702244+0000","last_became_peered":"2023-09-13T09:38:09.702244+0000","last_unstale":"2023-09-13T09:39:06.906839+0000","last_undegraded":"2023-09-13T09:39:06.906839+0000","last_fullsized":"2023-09-13T09:39:06.906839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:08:30.911492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906189+0000","last_change":"2023-09-13T09:38:09.694245+0000","last_active":"2023-09-13T09:39:06.906189+0000","last_peered":"2023-09-13T09:39:06.906189+0000","last_clean":"2023-09-13T09:39:06.906189+0000","last_became_active":"2023-09-13T09:38:09.693939+0000","last_became_peered":"2023-09-13T09:38:09.693939+0000","last_unstale":"2023-09-13T09:39:06.906189+0000","last_undegraded":"2023-09-13T09:39:06.906189+0000","last_fullsized":"2023-09-13T09:39:06.906189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:08.383075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903501+0000","last_change":"2023-09-13T09:38:09.696680+0000","last_active":"2023-09-13T09:39:06.903501+0000","last_peered":"2023-09-13T09:39:06.903501+0000","last_clean":"2023-09-13T09:39:06.903501+0000","last_became_active":"2023-09-13T09:38:09.696369+0000","last_became_peered":"2023-09-13T09:38:09.696369+0000","last_unstale":"2023-09-13T09:39:06.903501+0000","last_undegraded":"2023-09-13T09:39:06.903501+0000","last_fullsized":"2023-09-13T09:39:06.903501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:48.111921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898581+0000","last_change":"2023-09-13T09:38:09.703214+0000","last_active":"2023-09-13T09:39:06.898581+0000","last_peered":"2023-09-13T09:39:06.898581+0000","last_clean":"2023-09-13T09:39:06.898581+0000","last_became_active":"2023-09-13T09:38:09.702815+0000","last_became_peered":"2023-09-13T09:38:09.702815+0000","last_unstale":"2023-09-13T09:39:06.898581+0000","last_undegraded":"2023-09-13T09:39:06.898581+0000","last_fullsized":"2023-09-13T09:39:06.898581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:46.437548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901215+0000","last_change":"2023-09-13T09:38:09.699968+0000","last_active":"2023-09-13T09:39:06.901215+0000","last_peered":"2023-09-13T09:39:06.901215+0000","last_clean":"2023-09-13T09:39:06.901215+0000","last_became_active":"2023-09-13T09:38:09.699643+0000","last_became_peered":"2023-09-13T09:38:09.699643+0000","last_unstale":"2023-09-13T09:39:06.901215+0000","last_undegraded":"2023-09-13T09:39:06.901215+0000","last_fullsized":"2023-09-13T09:39:06.901215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:41:40.550328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:08.159082+0000","last_change":"2023-09-13T09:39:08.159082+0000","last_active":"2023-09-13T09:39:08.159082+0000","last_peered":"2023-09-13T09:39:08.159082+0000","last_clean":"2023-09-13T09:39:08.159082+0000","last_became_active":"2023-09-13T09:39:08.158658+0000","last_became_peered":"2023-09-13T09:39:08.158658+0000","last_unstale":"2023-09-13T09:39:08.159082+0000","last_undegraded":"2023-09-13T09:39:08.159082+0000","last_fullsized":"2023-09-13T09:39:08.159082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:02:13.472201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899139+0000","last_change":"2023-09-13T09:38:09.695903+0000","last_active":"2023-09-13T09:39:06.899139+0000","last_peered":"2023-09-13T09:39:06.899139+0000","last_clean":"2023-09-13T09:39:06.899139+0000","last_became_active":"2023-09-13T09:38:09.695585+0000","last_became_peered":"2023-09-13T09:38:09.695585+0000","last_unstale":"2023-09-13T09:39:06.899139+0000","last_undegraded":"2023-09-13T09:39:06.899139+0000","last_fullsized":"2023-09-13T09:39:06.899139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:13.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904532+0000","last_change":"2023-09-13T09:38:09.702485+0000","last_active":"2023-09-13T09:39:06.904532+0000","last_peered":"2023-09-13T09:39:06.904532+0000","last_clean":"2023-09-13T09:39:06.904532+0000","last_became_active":"2023-09-13T09:38:09.701989+0000","last_became_peered":"2023-09-13T09:38:09.701989+0000","last_unstale":"2023-09-13T09:39:06.904532+0000","last_undegraded":"2023-09-13T09:39:06.904532+0000","last_fullsized":"2023-09-13T09:39:06.904532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:58.832560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905300+0000","last_change":"2023-09-13T09:38:09.695080+0000","last_active":"2023-09-13T09:39:06.905300+0000","last_peered":"2023-09-13T09:39:06.905300+0000","last_clean":"2023-09-13T09:39:06.905300+0000","last_became_active":"2023-09-13T09:38:09.694782+0000","last_became_peered":"2023-09-13T09:38:09.694782+0000","last_unstale":"2023-09-13T09:39:06.905300+0000","last_undegraded":"2023-09-13T09:39:06.905300+0000","last_fullsized":"2023-09-13T09:39:06.905300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:15.146156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899861+0000","last_change":"2023-09-13T09:38:09.702456+0000","last_active":"2023-09-13T09:39:06.899861+0000","last_peered":"2023-09-13T09:39:06.899861+0000","last_clean":"2023-09-13T09:39:06.899861+0000","last_became_active":"2023-09-13T09:38:09.702171+0000","last_became_peered":"2023-09-13T09:38:09.702171+0000","last_unstale":"2023-09-13T09:39:06.899861+0000","last_undegraded":"2023-09-13T09:39:06.899861+0000","last_fullsized":"2023-09-13T09:39:06.899861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:32.995619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.793889+0000","last_change":"2023-09-13T09:38:08.692389+0000","last_active":"2023-09-13T09:39:33.793889+0000","last_peered":"2023-09-13T09:39:33.793889+0000","last_clean":"2023-09-13T09:39:33.793889+0000","last_became_active":"2023-09-13T09:38:08.692022+0000","last_became_peered":"2023-09-13T09:38:08.692022+0000","last_unstale":"2023-09-13T09:39:33.793889+0000","last_undegraded":"2023-09-13T09:39:33.793889+0000","last_fullsized":"2023-09-13T09:39:33.793889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:58:40.288839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.908834+0000","last_change":"2023-09-13T09:39:07.908477+0000","last_active":"2023-09-13T09:39:07.908834+0000","last_peered":"2023-09-13T09:39:07.908834+0000","last_clean":"2023-09-13T09:39:07.908834+0000","last_became_active":"2023-09-13T09:39:07.908164+0000","last_became_peered":"2023-09-13T09:39:07.908164+0000","last_unstale":"2023-09-13T09:39:07.908834+0000","last_undegraded":"2023-09-13T09:39:07.908834+0000","last_fullsized":"2023-09-13T09:39:07.908834+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:39:35.434234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904577+0000","last_change":"2023-09-13T09:38:08.694408+0000","last_active":"2023-09-13T09:39:06.904577+0000","last_peered":"2023-09-13T09:39:06.904577+0000","last_clean":"2023-09-13T09:39:06.904577+0000","last_became_active":"2023-09-13T09:38:08.693140+0000","last_became_peered":"2023-09-13T09:38:08.693140+0000","last_unstale":"2023-09-13T09:39:06.904577+0000","last_undegraded":"2023-09-13T09:39:06.904577+0000","last_fullsized":"2023-09-13T09:39:06.904577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:27:22.637489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901477+0000","last_change":"2023-09-13T09:38:09.705381+0000","last_active":"2023-09-13T09:39:06.901477+0000","last_peered":"2023-09-13T09:39:06.901477+0000","last_clean":"2023-09-13T09:39:06.901477+0000","last_became_active":"2023-09-13T09:38:09.705059+0000","last_became_peered":"2023-09-13T09:38:09.705059+0000","last_unstale":"2023-09-13T09:39:06.901477+0000","last_undegraded":"2023-09-13T09:39:06.901477+0000","last_fullsized":"2023-09-13T09:39:06.901477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:11.294362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.922791+0000","last_change":"2023-09-13T09:39:07.922791+0000","last_active":"2023-09-13T09:39:07.922791+0000","last_peered":"2023-09-13T09:39:07.922791+0000","last_clean":"2023-09-13T09:39:07.922791+0000","last_became_active":"2023-09-13T09:39:07.911235+0000","last_became_peered":"2023-09-13T09:39:07.911235+0000","last_unstale":"2023-09-13T09:39:07.922791+0000","last_undegraded":"2023-09-13T09:39:07.922791+0000","last_fullsized":"2023-09-13T09:39:07.922791+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:07:58.363727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899223+0000","last_change":"2023-09-13T09:38:09.696875+0000","last_active":"2023-09-13T09:39:06.899223+0000","last_peered":"2023-09-13T09:39:06.899223+0000","last_clean":"2023-09-13T09:39:06.899223+0000","last_became_active":"2023-09-13T09:38:09.696060+0000","last_became_peered":"2023-09-13T09:38:09.696060+0000","last_unstale":"2023-09-13T09:39:06.899223+0000","last_undegraded":"2023-09-13T09:39:06.899223+0000","last_fullsized":"2023-09-13T09:39:06.899223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:55.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902875+0000","last_change":"2023-09-13T09:38:08.692583+0000","last_active":"2023-09-13T09:39:06.902875+0000","last_peered":"2023-09-13T09:39:06.902875+0000","last_clean":"2023-09-13T09:39:06.902875+0000","last_became_active":"2023-09-13T09:38:08.692266+0000","last_became_peered":"2023-09-13T09:38:08.692266+0000","last_unstale":"2023-09-13T09:39:06.902875+0000","last_undegraded":"2023-09-13T09:39:06.902875+0000","last_fullsized":"2023-09-13T09:39:06.902875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:37.827191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907073+0000","last_change":"2023-09-13T09:38:09.705855+0000","last_active":"2023-09-13T09:39:06.907073+0000","last_peered":"2023-09-13T09:39:06.907073+0000","last_clean":"2023-09-13T09:39:06.907073+0000","last_became_active":"2023-09-13T09:38:09.705518+0000","last_became_peered":"2023-09-13T09:38:09.705518+0000","last_unstale":"2023-09-13T09:39:06.907073+0000","last_undegraded":"2023-09-13T09:39:06.907073+0000","last_fullsized":"2023-09-13T09:39:06.907073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:02.403984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":100,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:31.792266+0000","last_change":"2023-09-13T09:38:08.697396+0000","last_active":"2023-09-13T09:39:31.792266+0000","last_peered":"2023-09-13T09:39:31.792266+0000","last_clean":"2023-09-13T09:39:31.792266+0000","last_became_active":"2023-09-13T09:38:08.697067+0000","last_became_peered":"2023-09-13T09:38:08.697067+0000","last_unstale":"2023-09-13T09:39:31.792266+0000","last_undegraded":"2023-09-13T09:39:31.792266+0000","last_fullsized":"2023-09-13T09:39:31.792266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:59.971250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903150+0000","last_change":"2023-09-13T09:38:09.701311+0000","last_active":"2023-09-13T09:39:06.903150+0000","last_peered":"2023-09-13T09:39:06.903150+0000","last_clean":"2023-09-13T09:39:06.903150+0000","last_became_active":"2023-09-13T09:38:09.700995+0000","last_became_peered":"2023-09-13T09:38:09.700995+0000","last_unstale":"2023-09-13T09:39:06.903150+0000","last_undegraded":"2023-09-13T09:39:06.903150+0000","last_fullsized":"2023-09-13T09:39:06.903150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:08.744780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907724+0000","last_change":"2023-09-13T09:38:08.691337+0000","last_active":"2023-09-13T09:39:06.907724+0000","last_peered":"2023-09-13T09:39:06.907724+0000","last_clean":"2023-09-13T09:39:06.907724+0000","last_became_active":"2023-09-13T09:38:08.690948+0000","last_became_peered":"2023-09-13T09:38:08.690948+0000","last_unstale":"2023-09-13T09:39:06.907724+0000","last_undegraded":"2023-09-13T09:39:06.907724+0000","last_fullsized":"2023-09-13T09:39:06.907724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:33.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.909477+0000","last_change":"2023-09-13T09:39:07.909477+0000","last_active":"2023-09-13T09:39:07.909477+0000","last_peered":"2023-09-13T09:39:07.909477+0000","last_clean":"2023-09-13T09:39:07.909477+0000","last_became_active":"2023-09-13T09:39:07.909034+0000","last_became_peered":"2023-09-13T09:39:07.909034+0000","last_unstale":"2023-09-13T09:39:07.909477+0000","last_undegraded":"2023-09-13T09:39:07.909477+0000","last_fullsized":"2023-09-13T09:39:07.909477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:01.975791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898467+0000","last_change":"2023-09-13T09:38:08.692201+0000","last_active":"2023-09-13T09:39:06.898467+0000","last_peered":"2023-09-13T09:39:06.898467+0000","last_clean":"2023-09-13T09:39:06.898467+0000","last_became_active":"2023-09-13T09:38:08.691334+0000","last_became_peered":"2023-09-13T09:38:08.691334+0000","last_unstale":"2023-09-13T09:39:06.898467+0000","last_undegraded":"2023-09-13T09:39:06.898467+0000","last_fullsized":"2023-09-13T09:39:06.898467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:13.098275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904429+0000","last_change":"2023-09-13T09:38:09.701125+0000","last_active":"2023-09-13T09:39:06.904429+0000","last_peered":"2023-09-13T09:39:06.904429+0000","last_clean":"2023-09-13T09:39:06.904429+0000","last_became_active":"2023-09-13T09:38:09.700055+0000","last_became_peered":"2023-09-13T09:38:09.700055+0000","last_unstale":"2023-09-13T09:39:06.904429+0000","last_undegraded":"2023-09-13T09:39:06.904429+0000","last_fullsized":"2023-09-13T09:39:06.904429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:17.787363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906298+0000","last_change":"2023-09-13T09:38:08.696797+0000","last_active":"2023-09-13T09:39:06.906298+0000","last_peered":"2023-09-13T09:39:06.906298+0000","last_clean":"2023-09-13T09:39:06.906298+0000","last_became_active":"2023-09-13T09:38:08.696494+0000","last_became_peered":"2023-09-13T09:38:08.696494+0000","last_unstale":"2023-09-13T09:39:06.906298+0000","last_undegraded":"2023-09-13T09:39:06.906298+0000","last_fullsized":"2023-09-13T09:39:06.906298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:29.454184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903049+0000","last_change":"2023-09-13T09:38:09.694166+0000","last_active":"2023-09-13T09:39:06.903049+0000","last_peered":"2023-09-13T09:39:06.903049+0000","last_clean":"2023-09-13T09:39:06.903049+0000","last_became_active":"2023-09-13T09:38:09.693894+0000","last_became_peered":"2023-09-13T09:38:09.693894+0000","last_unstale":"2023-09-13T09:39:06.903049+0000","last_undegraded":"2023-09-13T09:39:06.903049+0000","last_fullsized":"2023-09-13T09:39:06.903049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:27:35.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":177,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.795457+0000","last_change":"2023-09-13T09:38:08.693649+0000","last_active":"2023-09-13T09:39:34.795457+0000","last_peered":"2023-09-13T09:39:34.795457+0000","last_clean":"2023-09-13T09:39:34.795457+0000","last_became_active":"2023-09-13T09:38:08.693289+0000","last_became_peered":"2023-09-13T09:38:08.693289+0000","last_unstale":"2023-09-13T09:39:34.795457+0000","last_undegraded":"2023-09-13T09:39:34.795457+0000","last_fullsized":"2023-09-13T09:39:34.795457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:39:27.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899503+0000","last_change":"2023-09-13T09:38:09.693872+0000","last_active":"2023-09-13T09:39:06.899503+0000","last_peered":"2023-09-13T09:39:06.899503+0000","last_clean":"2023-09-13T09:39:06.899503+0000","last_became_active":"2023-09-13T09:38:09.693445+0000","last_became_peered":"2023-09-13T09:38:09.693445+0000","last_unstale":"2023-09-13T09:39:06.899503+0000","last_undegraded":"2023-09-13T09:39:06.899503+0000","last_fullsized":"2023-09-13T09:39:06.899503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:29:35.717276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905571+0000","last_change":"2023-09-13T09:38:08.696375+0000","last_active":"2023-09-13T09:39:06.905571+0000","last_peered":"2023-09-13T09:39:06.905571+0000","last_clean":"2023-09-13T09:39:06.905571+0000","last_became_active":"2023-09-13T09:38:08.695799+0000","last_became_peered":"2023-09-13T09:38:08.695799+0000","last_unstale":"2023-09-13T09:39:06.905571+0000","last_undegraded":"2023-09-13T09:39:06.905571+0000","last_fullsized":"2023-09-13T09:39:06.905571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:09.255704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901511+0000","last_change":"2023-09-13T09:38:09.706518+0000","last_active":"2023-09-13T09:39:06.901511+0000","last_peered":"2023-09-13T09:39:06.901511+0000","last_clean":"2023-09-13T09:39:06.901511+0000","last_became_active":"2023-09-13T09:38:09.706083+0000","last_became_peered":"2023-09-13T09:38:09.706083+0000","last_unstale":"2023-09-13T09:39:06.901511+0000","last_undegraded":"2023-09-13T09:39:06.901511+0000","last_fullsized":"2023-09-13T09:39:06.901511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:21:53.831430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907003+0000","last_change":"2023-09-13T09:38:08.697878+0000","last_active":"2023-09-13T09:39:06.907003+0000","last_peered":"2023-09-13T09:39:06.907003+0000","last_clean":"2023-09-13T09:39:06.907003+0000","last_became_active":"2023-09-13T09:38:08.697476+0000","last_became_peered":"2023-09-13T09:38:08.697476+0000","last_unstale":"2023-09-13T09:39:06.907003+0000","last_undegraded":"2023-09-13T09:39:06.907003+0000","last_fullsized":"2023-09-13T09:39:06.907003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:09.021111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899511+0000","last_change":"2023-09-13T09:38:09.697144+0000","last_active":"2023-09-13T09:39:06.899511+0000","last_peered":"2023-09-13T09:39:06.899511+0000","last_clean":"2023-09-13T09:39:06.899511+0000","last_became_active":"2023-09-13T09:38:09.696521+0000","last_became_peered":"2023-09-13T09:38:09.696521+0000","last_unstale":"2023-09-13T09:39:06.899511+0000","last_undegraded":"2023-09-13T09:39:06.899511+0000","last_fullsized":"2023-09-13T09:39:06.899511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:36:17.096644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":211,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.796451+0000","last_change":"2023-09-13T09:38:08.694981+0000","last_active":"2023-09-13T09:39:34.796451+0000","last_peered":"2023-09-13T09:39:34.796451+0000","last_clean":"2023-09-13T09:39:34.796451+0000","last_became_active":"2023-09-13T09:38:08.694630+0000","last_became_peered":"2023-09-13T09:38:08.694630+0000","last_unstale":"2023-09-13T09:39:34.796451+0000","last_undegraded":"2023-09-13T09:39:34.796451+0000","last_fullsized":"2023-09-13T09:39:34.796451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:56:58.204622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59346,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":141,"num_write":33,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902735+0000","last_change":"2023-09-13T09:38:09.700927+0000","last_active":"2023-09-13T09:39:06.902735+0000","last_peered":"2023-09-13T09:39:06.902735+0000","last_clean":"2023-09-13T09:39:06.902735+0000","last_became_active":"2023-09-13T09:38:09.700608+0000","last_became_peered":"2023-09-13T09:38:09.700608+0000","last_unstale":"2023-09-13T09:39:06.902735+0000","last_undegraded":"2023-09-13T09:39:06.902735+0000","last_fullsized":"2023-09-13T09:39:06.902735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:24.177293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899533+0000","last_change":"2023-09-13T09:38:08.699130+0000","last_active":"2023-09-13T09:39:06.899533+0000","last_peered":"2023-09-13T09:39:06.899533+0000","last_clean":"2023-09-13T09:39:06.899533+0000","last_became_active":"2023-09-13T09:38:08.698802+0000","last_became_peered":"2023-09-13T09:38:08.698802+0000","last_unstale":"2023-09-13T09:39:06.899533+0000","last_undegraded":"2023-09-13T09:39:06.899533+0000","last_fullsized":"2023-09-13T09:39:06.899533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:36.539846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898513+0000","last_change":"2023-09-13T09:38:09.697387+0000","last_active":"2023-09-13T09:39:06.898513+0000","last_peered":"2023-09-13T09:39:06.898513+0000","last_clean":"2023-09-13T09:39:06.898513+0000","last_became_active":"2023-09-13T09:38:09.697081+0000","last_became_peered":"2023-09-13T09:38:09.697081+0000","last_unstale":"2023-09-13T09:39:06.898513+0000","last_undegraded":"2023-09-13T09:39:06.898513+0000","last_fullsized":"2023-09-13T09:39:06.898513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:28:59.473258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905984+0000","last_change":"2023-09-13T09:38:08.696609+0000","last_active":"2023-09-13T09:39:06.905984+0000","last_peered":"2023-09-13T09:39:06.905984+0000","last_clean":"2023-09-13T09:39:06.905984+0000","last_became_active":"2023-09-13T09:38:08.696286+0000","last_became_peered":"2023-09-13T09:38:08.696286+0000","last_unstale":"2023-09-13T09:39:06.905984+0000","last_undegraded":"2023-09-13T09:39:06.905984+0000","last_fullsized":"2023-09-13T09:39:06.905984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:06:51.121661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905704+0000","last_change":"2023-09-13T09:38:09.698374+0000","last_active":"2023-09-13T09:39:06.905704+0000","last_peered":"2023-09-13T09:39:06.905704+0000","last_clean":"2023-09-13T09:39:06.905704+0000","last_became_active":"2023-09-13T09:38:09.698050+0000","last_became_peered":"2023-09-13T09:38:09.698050+0000","last_unstale":"2023-09-13T09:39:06.905704+0000","last_undegraded":"2023-09-13T09:39:06.905704+0000","last_fullsized":"2023-09-13T09:39:06.905704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:37:24.089861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:30.790063+0000","last_change":"2023-09-13T09:38:08.692717+0000","last_active":"2023-09-13T09:39:30.790063+0000","last_peered":"2023-09-13T09:39:30.790063+0000","last_clean":"2023-09-13T09:39:30.790063+0000","last_became_active":"2023-09-13T09:38:08.692340+0000","last_became_peered":"2023-09-13T09:38:08.692340+0000","last_unstale":"2023-09-13T09:39:30.790063+0000","last_undegraded":"2023-09-13T09:39:30.790063+0000","last_fullsized":"2023-09-13T09:39:30.790063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:22.280879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905278+0000","last_change":"2023-09-13T09:38:09.701623+0000","last_active":"2023-09-13T09:39:06.905278+0000","last_peered":"2023-09-13T09:39:06.905278+0000","last_clean":"2023-09-13T09:39:06.905278+0000","last_became_active":"2023-09-13T09:38:09.701338+0000","last_became_peered":"2023-09-13T09:38:09.701338+0000","last_unstale":"2023-09-13T09:39:06.905278+0000","last_undegraded":"2023-09-13T09:39:06.905278+0000","last_fullsized":"2023-09-13T09:39:06.905278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:49:58.937293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902190+0000","last_change":"2023-09-13T09:38:08.691968+0000","last_active":"2023-09-13T09:39:06.902190+0000","last_peered":"2023-09-13T09:39:06.902190+0000","last_clean":"2023-09-13T09:39:06.902190+0000","last_became_active":"2023-09-13T09:38:08.691668+0000","last_became_peered":"2023-09-13T09:38:08.691668+0000","last_unstale":"2023-09-13T09:39:06.902190+0000","last_undegraded":"2023-09-13T09:39:06.902190+0000","last_fullsized":"2023-09-13T09:39:06.902190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:43.767948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905422+0000","last_change":"2023-09-13T09:38:09.698123+0000","last_active":"2023-09-13T09:39:06.905422+0000","last_peered":"2023-09-13T09:39:06.905422+0000","last_clean":"2023-09-13T09:39:06.905422+0000","last_became_active":"2023-09-13T09:38:09.697729+0000","last_became_peered":"2023-09-13T09:38:09.697729+0000","last_unstale":"2023-09-13T09:39:06.905422+0000","last_undegraded":"2023-09-13T09:39:06.905422+0000","last_fullsized":"2023-09-13T09:39:06.905422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:25.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902535+0000","last_change":"2023-09-13T09:38:08.691091+0000","last_active":"2023-09-13T09:39:06.902535+0000","last_peered":"2023-09-13T09:39:06.902535+0000","last_clean":"2023-09-13T09:39:06.902535+0000","last_became_active":"2023-09-13T09:38:08.689128+0000","last_became_peered":"2023-09-13T09:38:08.689128+0000","last_unstale":"2023-09-13T09:39:06.902535+0000","last_undegraded":"2023-09-13T09:39:06.902535+0000","last_fullsized":"2023-09-13T09:39:06.902535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:32.133388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904092+0000","last_change":"2023-09-13T09:38:09.706041+0000","last_active":"2023-09-13T09:39:06.904092+0000","last_peered":"2023-09-13T09:39:06.904092+0000","last_clean":"2023-09-13T09:39:06.904092+0000","last_became_active":"2023-09-13T09:38:09.705707+0000","last_became_peered":"2023-09-13T09:38:09.705707+0000","last_unstale":"2023-09-13T09:39:06.904092+0000","last_undegraded":"2023-09-13T09:39:06.904092+0000","last_fullsized":"2023-09-13T09:39:06.904092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:57.018000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903595+0000","last_change":"2023-09-13T09:38:08.695552+0000","last_active":"2023-09-13T09:39:06.903595+0000","last_peered":"2023-09-13T09:39:06.903595+0000","last_clean":"2023-09-13T09:39:06.903595+0000","last_became_active":"2023-09-13T09:38:08.695236+0000","last_became_peered":"2023-09-13T09:38:08.695236+0000","last_unstale":"2023-09-13T09:39:06.903595+0000","last_undegraded":"2023-09-13T09:39:06.903595+0000","last_fullsized":"2023-09-13T09:39:06.903595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:41.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906623+0000","last_change":"2023-09-13T09:38:09.699864+0000","last_active":"2023-09-13T09:39:06.906623+0000","last_peered":"2023-09-13T09:39:06.906623+0000","last_clean":"2023-09-13T09:39:06.906623+0000","last_became_active":"2023-09-13T09:38:09.699522+0000","last_became_peered":"2023-09-13T09:38:09.699522+0000","last_unstale":"2023-09-13T09:39:06.906623+0000","last_undegraded":"2023-09-13T09:39:06.906623+0000","last_fullsized":"2023-09-13T09:39:06.906623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:51.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.794496+0000","last_change":"2023-09-13T09:38:08.695651+0000","last_active":"2023-09-13T09:39:33.794496+0000","last_peered":"2023-09-13T09:39:33.794496+0000","last_clean":"2023-09-13T09:39:33.794496+0000","last_became_active":"2023-09-13T09:38:08.695074+0000","last_became_peered":"2023-09-13T09:38:08.695074+0000","last_unstale":"2023-09-13T09:39:33.794496+0000","last_undegraded":"2023-09-13T09:39:33.794496+0000","last_fullsized":"2023-09-13T09:39:33.794496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:40.974436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906176+0000","last_change":"2023-09-13T09:38:09.698193+0000","last_active":"2023-09-13T09:39:06.906176+0000","last_peered":"2023-09-13T09:39:06.906176+0000","last_clean":"2023-09-13T09:39:06.906176+0000","last_became_active":"2023-09-13T09:38:09.697874+0000","last_became_peered":"2023-09-13T09:38:09.697874+0000","last_unstale":"2023-09-13T09:39:06.906176+0000","last_undegraded":"2023-09-13T09:39:06.906176+0000","last_fullsized":"2023-09-13T09:39:06.906176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:48.908322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.909872+0000","last_change":"2023-09-13T09:39:07.909324+0000","last_active":"2023-09-13T09:39:07.909872+0000","last_peered":"2023-09-13T09:39:07.909872+0000","last_clean":"2023-09-13T09:39:07.909872+0000","last_became_active":"2023-09-13T09:39:07.908877+0000","last_became_peered":"2023-09-13T09:39:07.908877+0000","last_unstale":"2023-09-13T09:39:07.909872+0000","last_undegraded":"2023-09-13T09:39:07.909872+0000","last_fullsized":"2023-09-13T09:39:07.909872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T21:15:28.983303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,8],"acting":[9,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.795111+0000","last_change":"2023-09-13T09:38:08.695499+0000","last_active":"2023-09-13T09:39:34.795111+0000","last_peered":"2023-09-13T09:39:34.795111+0000","last_clean":"2023-09-13T09:39:34.795111+0000","last_became_active":"2023-09-13T09:38:08.695167+0000","last_became_peered":"2023-09-13T09:38:08.695167+0000","last_unstale":"2023-09-13T09:39:34.795111+0000","last_undegraded":"2023-09-13T09:39:34.795111+0000","last_fullsized":"2023-09-13T09:39:34.795111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.561408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903974+0000","last_change":"2023-09-13T09:38:09.702273+0000","last_active":"2023-09-13T09:39:06.903974+0000","last_peered":"2023-09-13T09:39:06.903974+0000","last_clean":"2023-09-13T09:39:06.903974+0000","last_became_active":"2023-09-13T09:38:09.701944+0000","last_became_peered":"2023-09-13T09:38:09.701944+0000","last_unstale":"2023-09-13T09:39:06.903974+0000","last_undegraded":"2023-09-13T09:39:06.903974+0000","last_fullsized":"2023-09-13T09:39:06.903974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:56.548720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904162+0000","last_change":"2023-09-13T09:38:08.692966+0000","last_active":"2023-09-13T09:39:06.904162+0000","last_peered":"2023-09-13T09:39:06.904162+0000","last_clean":"2023-09-13T09:39:06.904162+0000","last_became_active":"2023-09-13T09:38:08.692613+0000","last_became_peered":"2023-09-13T09:38:08.692613+0000","last_unstale":"2023-09-13T09:39:06.904162+0000","last_undegraded":"2023-09-13T09:39:06.904162+0000","last_fullsized":"2023-09-13T09:39:06.904162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:37.327846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":309,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905572+0000","last_change":"2023-09-13T09:37:08.710441+0000","last_active":"2023-09-13T09:39:06.905572+0000","last_peered":"2023-09-13T09:39:06.905572+0000","last_clean":"2023-09-13T09:39:06.905572+0000","last_became_active":"2023-09-13T09:37:08.709939+0000","last_became_peered":"2023-09-13T09:37:08.709939+0000","last_unstale":"2023-09-13T09:39:06.905572+0000","last_undegraded":"2023-09-13T09:39:06.905572+0000","last_fullsized":"2023-09-13T09:39:06.905572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_clean_scrub_stamp":"2023-09-13T09:34:16.664369+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:00.964039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898360+0000","last_change":"2023-09-13T09:38:09.697244+0000","last_active":"2023-09-13T09:39:06.898360+0000","last_peered":"2023-09-13T09:39:06.898360+0000","last_clean":"2023-09-13T09:39:06.898360+0000","last_became_active":"2023-09-13T09:38:09.696925+0000","last_became_peered":"2023-09-13T09:38:09.696925+0000","last_unstale":"2023-09-13T09:39:06.898360+0000","last_undegraded":"2023-09-13T09:39:06.898360+0000","last_fullsized":"2023-09-13T09:39:06.898360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:39.566528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905693+0000","last_change":"2023-09-13T09:38:08.702070+0000","last_active":"2023-09-13T09:39:06.905693+0000","last_peered":"2023-09-13T09:39:06.905693+0000","last_clean":"2023-09-13T09:39:06.905693+0000","last_became_active":"2023-09-13T09:38:08.701647+0000","last_became_peered":"2023-09-13T09:38:08.701647+0000","last_unstale":"2023-09-13T09:39:06.905693+0000","last_undegraded":"2023-09-13T09:39:06.905693+0000","last_fullsized":"2023-09-13T09:39:06.905693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:30:22.405675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902844+0000","last_change":"2023-09-13T09:38:08.696935+0000","last_active":"2023-09-13T09:39:06.902844+0000","last_peered":"2023-09-13T09:39:06.902844+0000","last_clean":"2023-09-13T09:39:06.902844+0000","last_became_active":"2023-09-13T09:38:08.696534+0000","last_became_peered":"2023-09-13T09:38:08.696534+0000","last_unstale":"2023-09-13T09:39:06.902844+0000","last_undegraded":"2023-09-13T09:39:06.902844+0000","last_fullsized":"2023-09-13T09:39:06.902844+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:49:13.883043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898588+0000","last_change":"2023-09-13T09:38:09.695829+0000","last_active":"2023-09-13T09:39:06.898588+0000","last_peered":"2023-09-13T09:39:06.898588+0000","last_clean":"2023-09-13T09:39:06.898588+0000","last_became_active":"2023-09-13T09:38:09.695479+0000","last_became_peered":"2023-09-13T09:38:09.695479+0000","last_unstale":"2023-09-13T09:39:06.898588+0000","last_undegraded":"2023-09-13T09:39:06.898588+0000","last_fullsized":"2023-09-13T09:39:06.898588+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:24:00.042236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905259+0000","last_change":"2023-09-13T09:38:08.698530+0000","last_active":"2023-09-13T09:39:06.905259+0000","last_peered":"2023-09-13T09:39:06.905259+0000","last_clean":"2023-09-13T09:39:06.905259+0000","last_became_active":"2023-09-13T09:38:08.698206+0000","last_became_peered":"2023-09-13T09:38:08.698206+0000","last_unstale":"2023-09-13T09:39:06.905259+0000","last_undegraded":"2023-09-13T09:39:06.905259+0000","last_fullsized":"2023-09-13T09:39:06.905259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:09.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905026+0000","last_change":"2023-09-13T09:38:09.700993+0000","last_active":"2023-09-13T09:39:06.905026+0000","last_peered":"2023-09-13T09:39:06.905026+0000","last_clean":"2023-09-13T09:39:06.905026+0000","last_became_active":"2023-09-13T09:38:09.700677+0000","last_became_peered":"2023-09-13T09:38:09.700677+0000","last_unstale":"2023-09-13T09:39:06.905026+0000","last_undegraded":"2023-09-13T09:39:06.905026+0000","last_fullsized":"2023-09-13T09:39:06.905026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:32.209248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903706+0000","last_change":"2023-09-13T09:38:08.684326+0000","last_active":"2023-09-13T09:39:06.903706+0000","last_peered":"2023-09-13T09:39:06.903706+0000","last_clean":"2023-09-13T09:39:06.903706+0000","last_became_active":"2023-09-13T09:38:08.683972+0000","last_became_peered":"2023-09-13T09:38:08.683972+0000","last_unstale":"2023-09-13T09:39:06.903706+0000","last_undegraded":"2023-09-13T09:39:06.903706+0000","last_fullsized":"2023-09-13T09:39:06.903706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:22.702277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901365+0000","last_change":"2023-09-13T09:38:09.706237+0000","last_active":"2023-09-13T09:39:06.901365+0000","last_peered":"2023-09-13T09:39:06.901365+0000","last_clean":"2023-09-13T09:39:06.901365+0000","last_became_active":"2023-09-13T09:38:09.705706+0000","last_became_peered":"2023-09-13T09:38:09.705706+0000","last_unstale":"2023-09-13T09:39:06.901365+0000","last_undegraded":"2023-09-13T09:39:06.901365+0000","last_fullsized":"2023-09-13T09:39:06.901365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:18.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899139+0000","last_change":"2023-09-13T09:38:08.695641+0000","last_active":"2023-09-13T09:39:06.899139+0000","last_peered":"2023-09-13T09:39:06.899139+0000","last_clean":"2023-09-13T09:39:06.899139+0000","last_became_active":"2023-09-13T09:38:08.695090+0000","last_became_peered":"2023-09-13T09:38:08.695090+0000","last_unstale":"2023-09-13T09:39:06.899139+0000","last_undegraded":"2023-09-13T09:39:06.899139+0000","last_fullsized":"2023-09-13T09:39:06.899139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:16:13.987022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902335+0000","last_change":"2023-09-13T09:38:09.702254+0000","last_active":"2023-09-13T09:39:06.902335+0000","last_peered":"2023-09-13T09:39:06.902335+0000","last_clean":"2023-09-13T09:39:06.902335+0000","last_became_active":"2023-09-13T09:38:09.701946+0000","last_became_peered":"2023-09-13T09:38:09.701946+0000","last_unstale":"2023-09-13T09:39:06.902335+0000","last_undegraded":"2023-09-13T09:39:06.902335+0000","last_fullsized":"2023-09-13T09:39:06.902335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:41.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903489+0000","last_change":"2023-09-13T09:38:08.694692+0000","last_active":"2023-09-13T09:39:06.903489+0000","last_peered":"2023-09-13T09:39:06.903489+0000","last_clean":"2023-09-13T09:39:06.903489+0000","last_became_active":"2023-09-13T09:38:08.693799+0000","last_became_peered":"2023-09-13T09:38:08.693799+0000","last_unstale":"2023-09-13T09:39:06.903489+0000","last_undegraded":"2023-09-13T09:39:06.903489+0000","last_fullsized":"2023-09-13T09:39:06.903489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:53:57.188153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903647+0000","last_change":"2023-09-13T09:38:09.707954+0000","last_active":"2023-09-13T09:39:06.903647+0000","last_peered":"2023-09-13T09:39:06.903647+0000","last_clean":"2023-09-13T09:39:06.903647+0000","last_became_active":"2023-09-13T09:38:09.707659+0000","last_became_peered":"2023-09-13T09:38:09.707659+0000","last_unstale":"2023-09-13T09:39:06.903647+0000","last_undegraded":"2023-09-13T09:39:06.903647+0000","last_fullsized":"2023-09-13T09:39:06.903647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:34.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.914790+0000","last_change":"2023-09-13T09:39:07.914790+0000","last_active":"2023-09-13T09:39:07.914790+0000","last_peered":"2023-09-13T09:39:07.914790+0000","last_clean":"2023-09-13T09:39:07.914790+0000","last_became_active":"2023-09-13T09:39:07.909229+0000","last_became_peered":"2023-09-13T09:39:07.909229+0000","last_unstale":"2023-09-13T09:39:07.914790+0000","last_undegraded":"2023-09-13T09:39:07.914790+0000","last_fullsized":"2023-09-13T09:39:07.914790+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:06.947358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904695+0000","last_change":"2023-09-13T09:38:09.700593+0000","last_active":"2023-09-13T09:39:06.904695+0000","last_peered":"2023-09-13T09:39:06.904695+0000","last_clean":"2023-09-13T09:39:06.904695+0000","last_became_active":"2023-09-13T09:38:09.700263+0000","last_became_peered":"2023-09-13T09:38:09.700263+0000","last_unstale":"2023-09-13T09:39:06.904695+0000","last_undegraded":"2023-09-13T09:39:06.904695+0000","last_fullsized":"2023-09-13T09:39:06.904695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:17:38.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902522+0000","last_change":"2023-09-13T09:38:08.692455+0000","last_active":"2023-09-13T09:39:06.902522+0000","last_peered":"2023-09-13T09:39:06.902522+0000","last_clean":"2023-09-13T09:39:06.902522+0000","last_became_active":"2023-09-13T09:38:08.692118+0000","last_became_peered":"2023-09-13T09:38:08.692118+0000","last_unstale":"2023-09-13T09:39:06.902522+0000","last_undegraded":"2023-09-13T09:39:06.902522+0000","last_fullsized":"2023-09-13T09:39:06.902522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:33.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906384+0000","last_change":"2023-09-13T09:38:09.695783+0000","last_active":"2023-09-13T09:39:06.906384+0000","last_peered":"2023-09-13T09:39:06.906384+0000","last_clean":"2023-09-13T09:39:06.906384+0000","last_became_active":"2023-09-13T09:38:09.695473+0000","last_became_peered":"2023-09-13T09:38:09.695473+0000","last_unstale":"2023-09-13T09:39:06.906384+0000","last_undegraded":"2023-09-13T09:39:06.906384+0000","last_fullsized":"2023-09-13T09:39:06.906384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:59.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.794442+0000","last_change":"2023-09-13T09:38:08.697468+0000","last_active":"2023-09-13T09:39:33.794442+0000","last_peered":"2023-09-13T09:39:33.794442+0000","last_clean":"2023-09-13T09:39:33.794442+0000","last_became_active":"2023-09-13T09:38:08.697141+0000","last_became_peered":"2023-09-13T09:38:08.697141+0000","last_unstale":"2023-09-13T09:39:33.794442+0000","last_undegraded":"2023-09-13T09:39:33.794442+0000","last_fullsized":"2023-09-13T09:39:33.794442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:33:26.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906258+0000","last_change":"2023-09-13T09:38:09.703754+0000","last_active":"2023-09-13T09:39:06.906258+0000","last_peered":"2023-09-13T09:39:06.906258+0000","last_clean":"2023-09-13T09:39:06.906258+0000","last_became_active":"2023-09-13T09:38:09.703438+0000","last_became_peered":"2023-09-13T09:38:09.703438+0000","last_unstale":"2023-09-13T09:39:06.906258+0000","last_undegraded":"2023-09-13T09:39:06.906258+0000","last_fullsized":"2023-09-13T09:39:06.906258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:19.298385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906887+0000","last_change":"2023-09-13T09:38:08.698973+0000","last_active":"2023-09-13T09:39:06.906887+0000","last_peered":"2023-09-13T09:39:06.906887+0000","last_clean":"2023-09-13T09:39:06.906887+0000","last_became_active":"2023-09-13T09:38:08.698329+0000","last_became_peered":"2023-09-13T09:38:08.698329+0000","last_unstale":"2023-09-13T09:39:06.906887+0000","last_undegraded":"2023-09-13T09:39:06.906887+0000","last_fullsized":"2023-09-13T09:39:06.906887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:10.684590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905485+0000","last_change":"2023-09-13T09:38:09.700216+0000","last_active":"2023-09-13T09:39:06.905485+0000","last_peered":"2023-09-13T09:39:06.905485+0000","last_clean":"2023-09-13T09:39:06.905485+0000","last_became_active":"2023-09-13T09:38:09.699876+0000","last_became_peered":"2023-09-13T09:38:09.699876+0000","last_unstale":"2023-09-13T09:39:06.905485+0000","last_undegraded":"2023-09-13T09:39:06.905485+0000","last_fullsized":"2023-09-13T09:39:06.905485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:33.347155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898610+0000","last_change":"2023-09-13T09:38:08.696200+0000","last_active":"2023-09-13T09:39:06.898610+0000","last_peered":"2023-09-13T09:39:06.898610+0000","last_clean":"2023-09-13T09:39:06.898610+0000","last_became_active":"2023-09-13T09:38:08.695880+0000","last_became_peered":"2023-09-13T09:38:08.695880+0000","last_unstale":"2023-09-13T09:39:06.898610+0000","last_undegraded":"2023-09-13T09:39:06.898610+0000","last_fullsized":"2023-09-13T09:39:06.898610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:38.222209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905761+0000","last_change":"2023-09-13T09:38:09.703022+0000","last_active":"2023-09-13T09:39:06.905761+0000","last_peered":"2023-09-13T09:39:06.905761+0000","last_clean":"2023-09-13T09:39:06.905761+0000","last_became_active":"2023-09-13T09:38:09.702665+0000","last_became_peered":"2023-09-13T09:38:09.702665+0000","last_unstale":"2023-09-13T09:39:06.905761+0000","last_undegraded":"2023-09-13T09:39:06.905761+0000","last_fullsized":"2023-09-13T09:39:06.905761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:59.284385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903711+0000","last_change":"2023-09-13T09:38:09.708137+0000","last_active":"2023-09-13T09:39:06.903711+0000","last_peered":"2023-09-13T09:39:06.903711+0000","last_clean":"2023-09-13T09:39:06.903711+0000","last_became_active":"2023-09-13T09:38:09.707829+0000","last_became_peered":"2023-09-13T09:38:09.707829+0000","last_unstale":"2023-09-13T09:39:06.903711+0000","last_undegraded":"2023-09-13T09:39:06.903711+0000","last_fullsized":"2023-09-13T09:39:06.903711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:15.976098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899071+0000","last_change":"2023-09-13T09:38:09.703131+0000","last_active":"2023-09-13T09:39:06.899071+0000","last_peered":"2023-09-13T09:39:06.899071+0000","last_clean":"2023-09-13T09:39:06.899071+0000","last_became_active":"2023-09-13T09:38:09.702850+0000","last_became_peered":"2023-09-13T09:38:09.702850+0000","last_unstale":"2023-09-13T09:39:06.899071+0000","last_undegraded":"2023-09-13T09:39:06.899071+0000","last_fullsized":"2023-09-13T09:39:06.899071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:08.422038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899035+0000","last_change":"2023-09-13T09:38:09.701691+0000","last_active":"2023-09-13T09:39:06.899035+0000","last_peered":"2023-09-13T09:39:06.899035+0000","last_clean":"2023-09-13T09:39:06.899035+0000","last_became_active":"2023-09-13T09:38:09.701395+0000","last_became_peered":"2023-09-13T09:38:09.701395+0000","last_unstale":"2023-09-13T09:39:06.899035+0000","last_undegraded":"2023-09-13T09:39:06.899035+0000","last_fullsized":"2023-09-13T09:39:06.899035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:02.916712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901222+0000","last_change":"2023-09-13T09:38:09.706885+0000","last_active":"2023-09-13T09:39:06.901222+0000","last_peered":"2023-09-13T09:39:06.901222+0000","last_clean":"2023-09-13T09:39:06.901222+0000","last_became_active":"2023-09-13T09:38:09.706569+0000","last_became_peered":"2023-09-13T09:38:09.706569+0000","last_unstale":"2023-09-13T09:39:06.901222+0000","last_undegraded":"2023-09-13T09:39:06.901222+0000","last_fullsized":"2023-09-13T09:39:06.901222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:02.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898666+0000","last_change":"2023-09-13T09:38:09.698547+0000","last_active":"2023-09-13T09:39:06.898666+0000","last_peered":"2023-09-13T09:39:06.898666+0000","last_clean":"2023-09-13T09:39:06.898666+0000","last_became_active":"2023-09-13T09:38:09.698180+0000","last_became_peered":"2023-09-13T09:38:09.698180+0000","last_unstale":"2023-09-13T09:39:06.898666+0000","last_undegraded":"2023-09-13T09:39:06.898666+0000","last_fullsized":"2023-09-13T09:39:06.898666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:12.988597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.910066+0000","last_change":"2023-09-13T09:39:07.910066+0000","last_active":"2023-09-13T09:39:07.910066+0000","last_peered":"2023-09-13T09:39:07.910066+0000","last_clean":"2023-09-13T09:39:07.910066+0000","last_became_active":"2023-09-13T09:39:07.909109+0000","last_became_peered":"2023-09-13T09:39:07.909109+0000","last_unstale":"2023-09-13T09:39:07.910066+0000","last_undegraded":"2023-09-13T09:39:07.910066+0000","last_fullsized":"2023-09-13T09:39:07.910066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:51:07.559587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.900063+0000","last_change":"2023-09-13T09:38:09.695277+0000","last_active":"2023-09-13T09:39:06.900063+0000","last_peered":"2023-09-13T09:39:06.900063+0000","last_clean":"2023-09-13T09:39:06.900063+0000","last_became_active":"2023-09-13T09:38:09.694959+0000","last_became_peered":"2023-09-13T09:38:09.694959+0000","last_unstale":"2023-09-13T09:39:06.900063+0000","last_undegraded":"2023-09-13T09:39:06.900063+0000","last_fullsized":"2023-09-13T09:39:06.900063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:35:17.321069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903273+0000","last_change":"2023-09-13T09:38:09.702030+0000","last_active":"2023-09-13T09:39:06.903273+0000","last_peered":"2023-09-13T09:39:06.903273+0000","last_clean":"2023-09-13T09:39:06.903273+0000","last_became_active":"2023-09-13T09:38:09.701712+0000","last_became_peered":"2023-09-13T09:38:09.701712+0000","last_unstale":"2023-09-13T09:39:06.903273+0000","last_undegraded":"2023-09-13T09:39:06.903273+0000","last_fullsized":"2023-09-13T09:39:06.903273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:38.909533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:08.159049+0000","last_change":"2023-09-13T09:39:08.159049+0000","last_active":"2023-09-13T09:39:08.159049+0000","last_peered":"2023-09-13T09:39:08.159049+0000","last_clean":"2023-09-13T09:39:08.159049+0000","last_became_active":"2023-09-13T09:39:08.158719+0000","last_became_peered":"2023-09-13T09:39:08.158719+0000","last_unstale":"2023-09-13T09:39:08.159049+0000","last_undegraded":"2023-09-13T09:39:08.159049+0000","last_fullsized":"2023-09-13T09:39:08.159049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:52.336150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903267+0000","last_change":"2023-09-13T09:38:09.703544+0000","last_active":"2023-09-13T09:39:06.903267+0000","last_peered":"2023-09-13T09:39:06.903267+0000","last_clean":"2023-09-13T09:39:06.903267+0000","last_became_active":"2023-09-13T09:38:09.702015+0000","last_became_peered":"2023-09-13T09:38:09.702015+0000","last_unstale":"2023-09-13T09:39:06.903267+0000","last_undegraded":"2023-09-13T09:39:06.903267+0000","last_fullsized":"2023-09-13T09:39:06.903267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:46:49.166965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899447+0000","last_change":"2023-09-13T09:38:09.694224+0000","last_active":"2023-09-13T09:39:06.899447+0000","last_peered":"2023-09-13T09:39:06.899447+0000","last_clean":"2023-09-13T09:39:06.899447+0000","last_became_active":"2023-09-13T09:38:09.693562+0000","last_became_peered":"2023-09-13T09:38:09.693562+0000","last_unstale":"2023-09-13T09:39:06.899447+0000","last_undegraded":"2023-09-13T09:39:06.899447+0000","last_fullsized":"2023-09-13T09:39:06.899447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:41:07.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898674+0000","last_change":"2023-09-13T09:38:09.698919+0000","last_active":"2023-09-13T09:39:06.898674+0000","last_peered":"2023-09-13T09:39:06.898674+0000","last_clean":"2023-09-13T09:39:06.898674+0000","last_became_active":"2023-09-13T09:38:09.698637+0000","last_became_peered":"2023-09-13T09:38:09.698637+0000","last_unstale":"2023-09-13T09:39:06.898674+0000","last_undegraded":"2023-09-13T09:39:06.898674+0000","last_fullsized":"2023-09-13T09:39:06.898674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:50.277687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903854+0000","last_change":"2023-09-13T09:38:09.705194+0000","last_active":"2023-09-13T09:39:06.903854+0000","last_peered":"2023-09-13T09:39:06.903854+0000","last_clean":"2023-09-13T09:39:06.903854+0000","last_became_active":"2023-09-13T09:38:09.704888+0000","last_became_peered":"2023-09-13T09:38:09.704888+0000","last_unstale":"2023-09-13T09:39:06.903854+0000","last_undegraded":"2023-09-13T09:39:06.903854+0000","last_fullsized":"2023-09-13T09:39:06.903854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:07.995177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66866,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":824,"num_read_kb":489,"num_write":234,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":196278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416412,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":452728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.749}]},{"osd":2,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.376},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.41599999999999998}]},{"osd":6,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82099999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66000000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.79800000000000004}]},{"osd":10,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78200000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1646592,"data_stored":1103168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.503,"15min":0.501},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.621}]},{"osd":2,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79800000000000004}]},{"osd":3,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.47599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84599999999999997,"5min":0.995,"15min":0.995},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69499999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84899999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88700000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.161,"15min":1.161},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":1.026,"15min":1.026},"last":0.89000000000000001}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.875}]},{"osd":8,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.879},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0920000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.004}]},{"osd":9,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88,"15min":0.88600000000000001},"min":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.871,"15min":0.88100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0169999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.94799999999999995}]},{"osd":11,"last update":"Wed Sep 13 09:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.70799999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1120000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.97699999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841573,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":452658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.316},{"interface":"front","average":{"1min":0.438,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.38900000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82999999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.32000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65300000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60499999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.443}]},{"osd":4,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82499999999999996,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88,"5min":1.256,"15min":1.256},"last":0.5}]},{"osd":5,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86699999999999999,"5min":1.117,"15min":1.117},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.70399999999999996,"15min":0.71799999999999997},"min":{"1min":0.496,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83499999999999996,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88200000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81399999999999995,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.83199999999999996,"5min":1.204,"15min":1.204},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85399999999999998,"5min":1.276,"15min":1.276},"last":0.71099999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.85099999999999998},"min":{"1min":0.59999999999999998,"5min":0.501,"15min":0.501},"max":{"1min":0.86699999999999999,"5min":1.224,"15min":1.224},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.84999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60799999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90600000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91900000000000004,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.69399999999999995}]}]},{"osd":8,"up_from":58,"seq":249108103209,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":452705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73799999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.442,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.497}]},{"osd":1,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61299999999999999,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59599999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45800000000000002,"15min":0.44800000000000001},"min":{"1min":0.379,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.436},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.60099999999999998},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.498,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64000000000000001,"15min":0.61199999999999999},"min":{"1min":0.56000000000000005,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.66300000000000003,"15min":0.63600000000000001},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.45100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.57699999999999996,"15min":0.56399999999999995},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95199999999999996,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91600000000000004,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.72199999999999998,"15min":0.69099999999999995},"min":{"1min":0.51600000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.91100000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.88}]},{"osd":10,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.73899999999999999,"15min":0.71999999999999997},"min":{"1min":0.56499999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.77800000000000002,"15min":0.76200000000000001},"min":{"1min":0.57099999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84999999999999998}]},{"osd":11,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80600000000000005}]}]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1046267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.5},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.40400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.52900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66900000000000004},"min":{"1min":0.56499999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":1.024,"15min":1.024},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.69199999999999995,"15min":0.65200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.093,"5min":5.093,"15min":5.093},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.64400000000000002}]},{"osd":4,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.372,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77000000000000002,"5min":0.999,"15min":0.999},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88900000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.79800000000000004,"15min":0.77900000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.115,"5min":0.83699999999999997,"15min":0.79300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":8.1099999999999994},"last":0.67400000000000004}]},{"osd":8,"last update":"Wed Sep 13 09:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.66300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.93500000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.77300000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.81899999999999995,"15min":0.78200000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.81699999999999995}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.83699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94199999999999995}]},{"osd":11,"last update":"Wed Sep 13 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.85199999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":452699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.40200000000000002},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63500000000000001,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.442,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.63900000000000001},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.71399999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95299999999999996,"5min":1.101,"15min":1.101},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69399999999999995,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.014,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.754},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.143,"15min":1.143},"last":0.80900000000000005}]},{"osd":8,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81499999999999995,"5min":1.214,"15min":1.214},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.80500000000000005,"5min":1.121,"15min":1.121},"last":0.66600000000000004}]},{"osd":9,"last update":"Wed Sep 13 09:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.81899999999999995},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92900000000000005,"5min":1.264,"15min":1.264},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76900000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0880000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.80300000000000005,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":508632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.623,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0009999999999999,"5min":1.075,"15min":1.075},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.61599999999999999,"15min":0.55700000000000005},"min":{"1min":0.56200000000000006,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Wed Sep 13 09:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64900000000000002,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.54500000000000004,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.91800000000000004,"5min":1.117,"15min":1.117},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.626,"15min":0.57399999999999995},"min":{"1min":0.42699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.69399999999999995,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.81699999999999995}]},{"osd":7,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.68400000000000005,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.86699999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.78700000000000003,"15min":0.76600000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.83299999999999996,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.141,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.1339999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81899999999999995,"15min":0.81699999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.109}]},{"osd":10,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92400000000000004,"15min":0.91800000000000004},"min":{"1min":0.64400000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.873,"15min":0.86699999999999999},"min":{"1min":0.67500000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.006}]},{"osd":11,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.05},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.038}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":453714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 09:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.48199999999999998},"min":{"1min":0.39200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73999999999999999,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":1.47,"15min":1.47},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.58899999999999997,"15min":0.52900000000000003},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.436}]},{"osd":4,"last update":"Wed Sep 13 09:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.875,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":1.288,"15min":1.288},"last":0.505}]},{"osd":5,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.61899999999999999},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64800000000000002,"15min":0.623},"min":{"1min":0.46000000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85999999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69299999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.58299999999999996}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.80000000000000004,"15min":0.82799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68000000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97199999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.54800000000000004}]},{"osd":11,"last update":"Wed Sep 13 09:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":513244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.48399999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.503},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.58299999999999996,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.878,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81399999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.751,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.496,"15min":0.45800000000000002},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.44600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78200000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.56000000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1,"15min":1},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65600000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751}]},{"osd":8,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.91400000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42899999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.46300000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77800000000000002}]},{"osd":11,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.755},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.64900000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":451881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.55600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39900000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81699999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.51900000000000002},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69899999999999995,"5min":1.649,"15min":1.649},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":2.238,"15min":2.238},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":1.052,"15min":1.052},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.746,"5min":1.292,"15min":1.292},"last":0.622}]},{"osd":5,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.71499999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98899999999999999,"5min":1.02,"15min":1.02},"last":0.5},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":1.071,"15min":1.071},"last":0.437}]},{"osd":7,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68899999999999995,"15min":0.67400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84999999999999998,"5min":1.595,"15min":1.595},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84199999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.69699999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":1.109,"15min":1.109},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.60599999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.871},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.97099999999999997,"5min":1.73,"15min":1.73},"last":0.751},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83299999999999996,"15min":0.85899999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.399,"15min":1.399},"last":0.74099999999999999}]},{"osd":11,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66500000000000004}]}]},{"osd":4,"up_from":32,"seq":137438953530,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":452626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.53100000000000003},"min":{"1min":0.44700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.335,"5min":3.335,"15min":3.335},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.433,"15min":0.39500000000000002},"min":{"1min":0.28399999999999997,"5min":0.249,"15min":0.249},"max":{"1min":0.63600000000000001,"5min":0.745,"15min":0.745},"last":0.434},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.442,"15min":0.40699999999999997},"min":{"1min":0.34200000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66800000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93200000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59599999999999997}]},{"osd":3,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61899999999999999,"15min":0.57499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80500000000000005,"5min":1.05,"15min":1.05},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.68400000000000005,"15min":0.65400000000000003},"min":{"1min":0.52500000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.64700000000000002},"min":{"1min":0.60299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90900000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76000000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98399999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.87,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":1.03,"15min":1.03},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.05,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.69699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.052,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.83299999999999996,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88100000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.4470000000000001},"last":0.71499999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90200000000000002,"15min":0.90800000000000003},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.115,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86099999999999999}]},{"osd":11,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.94899999999999995}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1045237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.505},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.53500000000000003,"15min":0.498},"min":{"1min":0.45200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.42699999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80500000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.51400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.432,"15min":0.40000000000000002},"min":{"1min":0.35499999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61799999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.45800000000000002,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55100000000000005,"15min":0.53100000000000003},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.52900000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63100000000000001,"15min":0.58099999999999996},"min":{"1min":0.55800000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.504,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71399999999999997}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":1.044,"15min":1.044},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88600000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79200000000000004}]},{"osd":8,"last update":"Wed Sep 13 09:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.57999999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.80600000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.56799999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.754,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.92500000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T09:39:36.621 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-09-13T09:39:36.621 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-13T09:39:36.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 -- 172.21.15.6:0/828960478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 msgr2=0x7f83081012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 --2- 172.21.15.6:0/828960478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f83081012e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f82fc0099c0 tx=0x7f82fc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 -- 172.21.15.6:0/828960478 shutdown_connections 2023-09-13T09:39:36.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 --2- 172.21.15.6:0/828960478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8308101820 0x7f83081080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 --2- 172.21.15.6:0/828960478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83080ffc90 0x7f83081000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 --2- 172.21.15.6:0/828960478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f83081012e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 -- 172.21.15.6:0/828960478 >> 172.21.15.6:0/828960478 conn(0x7f83080fb220 msgr2=0x7f83080fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:36.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 -- 172.21.15.6:0/828960478 shutdown_connections 2023-09-13T09:39:36.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.786+0000 7f830e354700 1 -- 172.21.15.6:0/828960478 wait complete. 2023-09-13T09:39:36.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 Processor -- start 2023-09-13T09:39:36.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 -- start start 2023-09-13T09:39:36.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83080ffc90 0x7f8308195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f8308195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8308101820 0x7f830819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830819d500 con 0x7f8308100e80 2023-09-13T09:39:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830819d640 con 0x7f83080ffc90 2023-09-13T09:39:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830e354700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f830819d7d0 con 0x7f8308101820 2023-09-13T09:39:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f83077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f8308195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f83077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f8308195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33856/0 (socket says 172.21.15.6:33856) 2023-09-13T09:39:36.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f83077fe700 1 -- 172.21.15.6:0/522417426 learned_addr learned my addr 172.21.15.6:0/522417426 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f8307fff700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83080ffc90 0x7f8308195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.787+0000 7f830c8f1700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8308101820 0x7f830819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83077fe700 1 -- 172.21.15.6:0/522417426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8308101820 msgr2=0x7f830819cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83077fe700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8308101820 0x7f830819cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83077fe700 1 -- 172.21.15.6:0/522417426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83080ffc90 msgr2=0x7f8308195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:36.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83077fe700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83080ffc90 0x7f8308195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:36.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83077fe700 1 -- 172.21.15.6:0/522417426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82fc0095f0 con 0x7f8308100e80 2023-09-13T09:39:36.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83077fe700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f8308195ec0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009990 tx=0x7f82fc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83057fa700 1 -- 172.21.15.6:0/522417426 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc01d070 con 0x7f8308100e80 2023-09-13T09:39:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83057fa700 1 -- 172.21.15.6:0/522417426 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82fc005030 con 0x7f8308100e80 2023-09-13T09:39:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f830819da50 con 0x7f8308100e80 2023-09-13T09:39:36.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f83057fa700 1 -- 172.21.15.6:0/522417426 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82fc004a70 con 0x7f8308100e80 2023-09-13T09:39:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.788+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f830819de70 con 0x7f8308100e80 2023-09-13T09:39:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.789+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308106bc0 con 0x7f8308100e80 2023-09-13T09:39:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.790+0000 7f83057fa700 1 -- 172.21.15.6:0/522417426 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f82fc005410 con 0x7f8308100e80 2023-09-13T09:39:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.791+0000 7f83057fa700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82f00a0640 0x7f82f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:36.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.791+0000 7f8307fff700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82f00a0640 0x7f82f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:36.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.791+0000 7f83057fa700 1 -- 172.21.15.6:0/522417426 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f82fc0cc9e0 con 0x7f8308100e80 2023-09-13T09:39:36.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.791+0000 7f8307fff700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82f00a0640 0x7f82f00a2b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8308100ce0 tx=0x7f82f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:36.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.795+0000 7f83057fa700 1 -- 172.21.15.6:0/522417426 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f82fc096530 con 0x7f8308100e80 2023-09-13T09:39:36.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:36.990+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 --> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f830802d120 con 0x7f82f00a0640 2023-09-13T09:39:37.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.003+0000 7f83057fa700 1 -- 172.21.15.6:0/522417426 <== mgr.14152 v2:172.21.15.6:6800/1364175161 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343567 (secure 0 0 0) 0x7f830802d120 con 0x7f82f00a0640 2023-09-13T09:39:37.007 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:37.009 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:36 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4294778585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82f00a0640 msgr2=0x7f82f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82f00a0640 0x7f82f00a2b00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8308100ce0 tx=0x7f82f8009260 comp rx=0 tx=0).stop 2023-09-13T09:39:37.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 msgr2=0x7f8308195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f8308195ec0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009990 tx=0x7f82fc00f690 comp rx=0 tx=0).stop 2023-09-13T09:39:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 shutdown_connections 2023-09-13T09:39:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8308101820 0x7f830819cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83080ffc90 0x7f8308195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82f00a0640 0x7f82f00a2b00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 --2- 172.21.15.6:0/522417426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8308100e80 0x7f8308195ec0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 >> 172.21.15.6:0/522417426 conn(0x7f83080fb220 msgr2=0x7f83080fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 shutdown_connections 2023-09-13T09:39:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.006+0000 7f830e354700 1 -- 172.21.15.6:0/522417426 wait complete. 2023-09-13T09:39:37.012 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2023-09-13T09:39:37.019 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2023-09-13T09:39:36.161308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":657480,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":950,"num_read_kb":598,"num_write":417,"num_write_kb":3073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":1180736,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":345,"ondisk_log_size":345,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":337540,"kb_used_data":13292,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124604284,"statfs":{"total":1151940427776,"available":1151594786816,"internally_reserved":0,"allocated":13611008,"data_stored":7385559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19131,"internal_metadata":331855173},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4956,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":82,"num_write":5,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003057"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904417+0000","last_change":"2023-09-13T09:38:09.701485+0000","last_active":"2023-09-13T09:39:06.904417+0000","last_peered":"2023-09-13T09:39:06.904417+0000","last_clean":"2023-09-13T09:39:06.904417+0000","last_became_active":"2023-09-13T09:38:09.701160+0000","last_became_peered":"2023-09-13T09:38:09.701160+0000","last_unstale":"2023-09-13T09:39:06.904417+0000","last_undegraded":"2023-09-13T09:39:06.904417+0000","last_fullsized":"2023-09-13T09:39:06.904417+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:54:10.089322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901435+0000","last_change":"2023-09-13T09:38:09.697198+0000","last_active":"2023-09-13T09:39:06.901435+0000","last_peered":"2023-09-13T09:39:06.901435+0000","last_clean":"2023-09-13T09:39:06.901435+0000","last_became_active":"2023-09-13T09:38:09.696859+0000","last_became_peered":"2023-09-13T09:38:09.696859+0000","last_unstale":"2023-09-13T09:39:06.901435+0000","last_undegraded":"2023-09-13T09:39:06.901435+0000","last_fullsized":"2023-09-13T09:39:06.901435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:27:53.601426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901153+0000","last_change":"2023-09-13T09:38:09.696150+0000","last_active":"2023-09-13T09:39:06.901153+0000","last_peered":"2023-09-13T09:39:06.901153+0000","last_clean":"2023-09-13T09:39:06.901153+0000","last_became_active":"2023-09-13T09:38:09.695893+0000","last_became_peered":"2023-09-13T09:38:09.695893+0000","last_unstale":"2023-09-13T09:39:06.901153+0000","last_undegraded":"2023-09-13T09:39:06.901153+0000","last_fullsized":"2023-09-13T09:39:06.901153+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:51.298241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903598+0000","last_change":"2023-09-13T09:38:09.697564+0000","last_active":"2023-09-13T09:39:06.903598+0000","last_peered":"2023-09-13T09:39:06.903598+0000","last_clean":"2023-09-13T09:39:06.903598+0000","last_became_active":"2023-09-13T09:38:09.697235+0000","last_became_peered":"2023-09-13T09:38:09.697235+0000","last_unstale":"2023-09-13T09:39:06.903598+0000","last_undegraded":"2023-09-13T09:39:06.903598+0000","last_fullsized":"2023-09-13T09:39:06.903598+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:28:49.705452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902416+0000","last_change":"2023-09-13T09:38:09.702889+0000","last_active":"2023-09-13T09:39:06.902416+0000","last_peered":"2023-09-13T09:39:06.902416+0000","last_clean":"2023-09-13T09:39:06.902416+0000","last_became_active":"2023-09-13T09:38:09.702589+0000","last_became_peered":"2023-09-13T09:38:09.702589+0000","last_unstale":"2023-09-13T09:39:06.902416+0000","last_undegraded":"2023-09-13T09:39:06.902416+0000","last_fullsized":"2023-09-13T09:39:06.902416+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:56:05.432576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.911965+0000","last_change":"2023-09-13T09:39:07.911965+0000","last_active":"2023-09-13T09:39:07.911965+0000","last_peered":"2023-09-13T09:39:07.911965+0000","last_clean":"2023-09-13T09:39:07.911965+0000","last_became_active":"2023-09-13T09:39:07.911381+0000","last_became_peered":"2023-09-13T09:39:07.911381+0000","last_unstale":"2023-09-13T09:39:07.911965+0000","last_undegraded":"2023-09-13T09:39:07.911965+0000","last_fullsized":"2023-09-13T09:39:07.911965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:57.993882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905407+0000","last_change":"2023-09-13T09:38:09.700506+0000","last_active":"2023-09-13T09:39:06.905407+0000","last_peered":"2023-09-13T09:39:06.905407+0000","last_clean":"2023-09-13T09:39:06.905407+0000","last_became_active":"2023-09-13T09:38:09.700178+0000","last_became_peered":"2023-09-13T09:38:09.700178+0000","last_unstale":"2023-09-13T09:39:06.905407+0000","last_undegraded":"2023-09-13T09:39:06.905407+0000","last_fullsized":"2023-09-13T09:39:06.905407+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:41:04.261443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904341+0000","last_change":"2023-09-13T09:38:09.703191+0000","last_active":"2023-09-13T09:39:06.904341+0000","last_peered":"2023-09-13T09:39:06.904341+0000","last_clean":"2023-09-13T09:39:06.904341+0000","last_became_active":"2023-09-13T09:38:09.702874+0000","last_became_peered":"2023-09-13T09:38:09.702874+0000","last_unstale":"2023-09-13T09:39:06.904341+0000","last_undegraded":"2023-09-13T09:39:06.904341+0000","last_fullsized":"2023-09-13T09:39:06.904341+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:50:25.759861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899611+0000","last_change":"2023-09-13T09:38:09.700416+0000","last_active":"2023-09-13T09:39:06.899611+0000","last_peered":"2023-09-13T09:39:06.899611+0000","last_clean":"2023-09-13T09:39:06.899611+0000","last_became_active":"2023-09-13T09:38:09.700102+0000","last_became_peered":"2023-09-13T09:38:09.700102+0000","last_unstale":"2023-09-13T09:39:06.899611+0000","last_undegraded":"2023-09-13T09:39:06.899611+0000","last_fullsized":"2023-09-13T09:39:06.899611+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:27:53.988806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906839+0000","last_change":"2023-09-13T09:38:09.702609+0000","last_active":"2023-09-13T09:39:06.906839+0000","last_peered":"2023-09-13T09:39:06.906839+0000","last_clean":"2023-09-13T09:39:06.906839+0000","last_became_active":"2023-09-13T09:38:09.702244+0000","last_became_peered":"2023-09-13T09:38:09.702244+0000","last_unstale":"2023-09-13T09:39:06.906839+0000","last_undegraded":"2023-09-13T09:39:06.906839+0000","last_fullsized":"2023-09-13T09:39:06.906839+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:08:30.911492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906189+0000","last_change":"2023-09-13T09:38:09.694245+0000","last_active":"2023-09-13T09:39:06.906189+0000","last_peered":"2023-09-13T09:39:06.906189+0000","last_clean":"2023-09-13T09:39:06.906189+0000","last_became_active":"2023-09-13T09:38:09.693939+0000","last_became_peered":"2023-09-13T09:38:09.693939+0000","last_unstale":"2023-09-13T09:39:06.906189+0000","last_undegraded":"2023-09-13T09:39:06.906189+0000","last_fullsized":"2023-09-13T09:39:06.906189+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:36:08.383075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903501+0000","last_change":"2023-09-13T09:38:09.696680+0000","last_active":"2023-09-13T09:39:06.903501+0000","last_peered":"2023-09-13T09:39:06.903501+0000","last_clean":"2023-09-13T09:39:06.903501+0000","last_became_active":"2023-09-13T09:38:09.696369+0000","last_became_peered":"2023-09-13T09:38:09.696369+0000","last_unstale":"2023-09-13T09:39:06.903501+0000","last_undegraded":"2023-09-13T09:39:06.903501+0000","last_fullsized":"2023-09-13T09:39:06.903501+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:04:48.111921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898581+0000","last_change":"2023-09-13T09:38:09.703214+0000","last_active":"2023-09-13T09:39:06.898581+0000","last_peered":"2023-09-13T09:39:06.898581+0000","last_clean":"2023-09-13T09:39:06.898581+0000","last_became_active":"2023-09-13T09:38:09.702815+0000","last_became_peered":"2023-09-13T09:38:09.702815+0000","last_unstale":"2023-09-13T09:39:06.898581+0000","last_undegraded":"2023-09-13T09:39:06.898581+0000","last_fullsized":"2023-09-13T09:39:06.898581+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:33:46.437548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901215+0000","last_change":"2023-09-13T09:38:09.699968+0000","last_active":"2023-09-13T09:39:06.901215+0000","last_peered":"2023-09-13T09:39:06.901215+0000","last_clean":"2023-09-13T09:39:06.901215+0000","last_became_active":"2023-09-13T09:38:09.699643+0000","last_became_peered":"2023-09-13T09:38:09.699643+0000","last_unstale":"2023-09-13T09:39:06.901215+0000","last_undegraded":"2023-09-13T09:39:06.901215+0000","last_fullsized":"2023-09-13T09:39:06.901215+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:41:40.550328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:08.159082+0000","last_change":"2023-09-13T09:39:08.159082+0000","last_active":"2023-09-13T09:39:08.159082+0000","last_peered":"2023-09-13T09:39:08.159082+0000","last_clean":"2023-09-13T09:39:08.159082+0000","last_became_active":"2023-09-13T09:39:08.158658+0000","last_became_peered":"2023-09-13T09:39:08.158658+0000","last_unstale":"2023-09-13T09:39:08.159082+0000","last_undegraded":"2023-09-13T09:39:08.159082+0000","last_fullsized":"2023-09-13T09:39:08.159082+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:02:13.472201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,2],"acting":[0,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899139+0000","last_change":"2023-09-13T09:38:09.695903+0000","last_active":"2023-09-13T09:39:06.899139+0000","last_peered":"2023-09-13T09:39:06.899139+0000","last_clean":"2023-09-13T09:39:06.899139+0000","last_became_active":"2023-09-13T09:38:09.695585+0000","last_became_peered":"2023-09-13T09:38:09.695585+0000","last_unstale":"2023-09-13T09:39:06.899139+0000","last_undegraded":"2023-09-13T09:39:06.899139+0000","last_fullsized":"2023-09-13T09:39:06.899139+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:57:13.172943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904532+0000","last_change":"2023-09-13T09:38:09.702485+0000","last_active":"2023-09-13T09:39:06.904532+0000","last_peered":"2023-09-13T09:39:06.904532+0000","last_clean":"2023-09-13T09:39:06.904532+0000","last_became_active":"2023-09-13T09:38:09.701989+0000","last_became_peered":"2023-09-13T09:38:09.701989+0000","last_unstale":"2023-09-13T09:39:06.904532+0000","last_undegraded":"2023-09-13T09:39:06.904532+0000","last_fullsized":"2023-09-13T09:39:06.904532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:58.832560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905300+0000","last_change":"2023-09-13T09:38:09.695080+0000","last_active":"2023-09-13T09:39:06.905300+0000","last_peered":"2023-09-13T09:39:06.905300+0000","last_clean":"2023-09-13T09:39:06.905300+0000","last_became_active":"2023-09-13T09:38:09.694782+0000","last_became_peered":"2023-09-13T09:38:09.694782+0000","last_unstale":"2023-09-13T09:39:06.905300+0000","last_undegraded":"2023-09-13T09:39:06.905300+0000","last_fullsized":"2023-09-13T09:39:06.905300+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:53:15.146156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899861+0000","last_change":"2023-09-13T09:38:09.702456+0000","last_active":"2023-09-13T09:39:06.899861+0000","last_peered":"2023-09-13T09:39:06.899861+0000","last_clean":"2023-09-13T09:39:06.899861+0000","last_became_active":"2023-09-13T09:38:09.702171+0000","last_became_peered":"2023-09-13T09:38:09.702171+0000","last_unstale":"2023-09-13T09:39:06.899861+0000","last_undegraded":"2023-09-13T09:39:06.899861+0000","last_fullsized":"2023-09-13T09:39:06.899861+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:33:32.995619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"86'14","reported_seq":109,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.793889+0000","last_change":"2023-09-13T09:38:08.692389+0000","last_active":"2023-09-13T09:39:33.793889+0000","last_peered":"2023-09-13T09:39:33.793889+0000","last_clean":"2023-09-13T09:39:33.793889+0000","last_became_active":"2023-09-13T09:38:08.692022+0000","last_became_peered":"2023-09-13T09:38:08.692022+0000","last_unstale":"2023-09-13T09:39:33.793889+0000","last_undegraded":"2023-09-13T09:39:33.793889+0000","last_fullsized":"2023-09-13T09:39:33.793889+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:58:40.288839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.908834+0000","last_change":"2023-09-13T09:39:07.908477+0000","last_active":"2023-09-13T09:39:07.908834+0000","last_peered":"2023-09-13T09:39:07.908834+0000","last_clean":"2023-09-13T09:39:07.908834+0000","last_became_active":"2023-09-13T09:39:07.908164+0000","last_became_peered":"2023-09-13T09:39:07.908164+0000","last_unstale":"2023-09-13T09:39:07.908834+0000","last_undegraded":"2023-09-13T09:39:07.908834+0000","last_fullsized":"2023-09-13T09:39:07.908834+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:39:35.434234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1e","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904577+0000","last_change":"2023-09-13T09:38:08.694408+0000","last_active":"2023-09-13T09:39:06.904577+0000","last_peered":"2023-09-13T09:39:06.904577+0000","last_clean":"2023-09-13T09:39:06.904577+0000","last_became_active":"2023-09-13T09:38:08.693140+0000","last_became_peered":"2023-09-13T09:38:08.693140+0000","last_unstale":"2023-09-13T09:39:06.904577+0000","last_undegraded":"2023-09-13T09:39:06.904577+0000","last_fullsized":"2023-09-13T09:39:06.904577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:27:22.637489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901477+0000","last_change":"2023-09-13T09:38:09.705381+0000","last_active":"2023-09-13T09:39:06.901477+0000","last_peered":"2023-09-13T09:39:06.901477+0000","last_clean":"2023-09-13T09:39:06.901477+0000","last_became_active":"2023-09-13T09:38:09.705059+0000","last_became_peered":"2023-09-13T09:38:09.705059+0000","last_unstale":"2023-09-13T09:39:06.901477+0000","last_undegraded":"2023-09-13T09:39:06.901477+0000","last_fullsized":"2023-09-13T09:39:06.901477+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:11.294362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"84'12","reported_seq":52,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.922791+0000","last_change":"2023-09-13T09:39:07.922791+0000","last_active":"2023-09-13T09:39:07.922791+0000","last_peered":"2023-09-13T09:39:07.922791+0000","last_clean":"2023-09-13T09:39:07.922791+0000","last_became_active":"2023-09-13T09:39:07.911235+0000","last_became_peered":"2023-09-13T09:39:07.911235+0000","last_unstale":"2023-09-13T09:39:07.922791+0000","last_undegraded":"2023-09-13T09:39:07.922791+0000","last_fullsized":"2023-09-13T09:39:07.922791+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:07:58.363727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899223+0000","last_change":"2023-09-13T09:38:09.696875+0000","last_active":"2023-09-13T09:39:06.899223+0000","last_peered":"2023-09-13T09:39:06.899223+0000","last_clean":"2023-09-13T09:39:06.899223+0000","last_became_active":"2023-09-13T09:38:09.696060+0000","last_became_peered":"2023-09-13T09:38:09.696060+0000","last_unstale":"2023-09-13T09:39:06.899223+0000","last_undegraded":"2023-09-13T09:39:06.899223+0000","last_fullsized":"2023-09-13T09:39:06.899223+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:31:55.030823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902875+0000","last_change":"2023-09-13T09:38:08.692583+0000","last_active":"2023-09-13T09:39:06.902875+0000","last_peered":"2023-09-13T09:39:06.902875+0000","last_clean":"2023-09-13T09:39:06.902875+0000","last_became_active":"2023-09-13T09:38:08.692266+0000","last_became_peered":"2023-09-13T09:38:08.692266+0000","last_unstale":"2023-09-13T09:39:06.902875+0000","last_undegraded":"2023-09-13T09:39:06.902875+0000","last_fullsized":"2023-09-13T09:39:06.902875+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:37.827191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907073+0000","last_change":"2023-09-13T09:38:09.705855+0000","last_active":"2023-09-13T09:39:06.907073+0000","last_peered":"2023-09-13T09:39:06.907073+0000","last_clean":"2023-09-13T09:39:06.907073+0000","last_became_active":"2023-09-13T09:38:09.705518+0000","last_became_peered":"2023-09-13T09:38:09.705518+0000","last_unstale":"2023-09-13T09:39:06.907073+0000","last_undegraded":"2023-09-13T09:39:06.907073+0000","last_fullsized":"2023-09-13T09:39:06.907073+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:50:02.403984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"84'6","reported_seq":100,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:31.792266+0000","last_change":"2023-09-13T09:38:08.697396+0000","last_active":"2023-09-13T09:39:31.792266+0000","last_peered":"2023-09-13T09:39:31.792266+0000","last_clean":"2023-09-13T09:39:31.792266+0000","last_became_active":"2023-09-13T09:38:08.697067+0000","last_became_peered":"2023-09-13T09:38:08.697067+0000","last_unstale":"2023-09-13T09:39:31.792266+0000","last_undegraded":"2023-09-13T09:39:31.792266+0000","last_fullsized":"2023-09-13T09:39:31.792266+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:17:59.971250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":79,"num_read_kb":2,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903150+0000","last_change":"2023-09-13T09:38:09.701311+0000","last_active":"2023-09-13T09:39:06.903150+0000","last_peered":"2023-09-13T09:39:06.903150+0000","last_clean":"2023-09-13T09:39:06.903150+0000","last_became_active":"2023-09-13T09:38:09.700995+0000","last_became_peered":"2023-09-13T09:38:09.700995+0000","last_unstale":"2023-09-13T09:39:06.903150+0000","last_undegraded":"2023-09-13T09:39:06.903150+0000","last_fullsized":"2023-09-13T09:39:06.903150+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:08.744780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907724+0000","last_change":"2023-09-13T09:38:08.691337+0000","last_active":"2023-09-13T09:39:06.907724+0000","last_peered":"2023-09-13T09:39:06.907724+0000","last_clean":"2023-09-13T09:39:06.907724+0000","last_became_active":"2023-09-13T09:38:08.690948+0000","last_became_peered":"2023-09-13T09:38:08.690948+0000","last_unstale":"2023-09-13T09:39:06.907724+0000","last_undegraded":"2023-09-13T09:39:06.907724+0000","last_fullsized":"2023-09-13T09:39:06.907724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:27:33.109079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.909477+0000","last_change":"2023-09-13T09:39:07.909477+0000","last_active":"2023-09-13T09:39:07.909477+0000","last_peered":"2023-09-13T09:39:07.909477+0000","last_clean":"2023-09-13T09:39:07.909477+0000","last_became_active":"2023-09-13T09:39:07.909034+0000","last_became_peered":"2023-09-13T09:39:07.909034+0000","last_unstale":"2023-09-13T09:39:07.909477+0000","last_undegraded":"2023-09-13T09:39:07.909477+0000","last_fullsized":"2023-09-13T09:39:07.909477+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:08:01.975791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3],"acting":[5,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"84'3","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898467+0000","last_change":"2023-09-13T09:38:08.692201+0000","last_active":"2023-09-13T09:39:06.898467+0000","last_peered":"2023-09-13T09:39:06.898467+0000","last_clean":"2023-09-13T09:39:06.898467+0000","last_became_active":"2023-09-13T09:38:08.691334+0000","last_became_peered":"2023-09-13T09:38:08.691334+0000","last_unstale":"2023-09-13T09:39:06.898467+0000","last_undegraded":"2023-09-13T09:39:06.898467+0000","last_fullsized":"2023-09-13T09:39:06.898467+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:14:13.098275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904429+0000","last_change":"2023-09-13T09:38:09.701125+0000","last_active":"2023-09-13T09:39:06.904429+0000","last_peered":"2023-09-13T09:39:06.904429+0000","last_clean":"2023-09-13T09:39:06.904429+0000","last_became_active":"2023-09-13T09:38:09.700055+0000","last_became_peered":"2023-09-13T09:38:09.700055+0000","last_unstale":"2023-09-13T09:39:06.904429+0000","last_undegraded":"2023-09-13T09:39:06.904429+0000","last_fullsized":"2023-09-13T09:39:06.904429+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:26:17.787363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906298+0000","last_change":"2023-09-13T09:38:08.696797+0000","last_active":"2023-09-13T09:39:06.906298+0000","last_peered":"2023-09-13T09:39:06.906298+0000","last_clean":"2023-09-13T09:39:06.906298+0000","last_became_active":"2023-09-13T09:38:08.696494+0000","last_became_peered":"2023-09-13T09:38:08.696494+0000","last_unstale":"2023-09-13T09:39:06.906298+0000","last_undegraded":"2023-09-13T09:39:06.906298+0000","last_fullsized":"2023-09-13T09:39:06.906298+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:18:29.454184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903049+0000","last_change":"2023-09-13T09:38:09.694166+0000","last_active":"2023-09-13T09:39:06.903049+0000","last_peered":"2023-09-13T09:39:06.903049+0000","last_clean":"2023-09-13T09:39:06.903049+0000","last_became_active":"2023-09-13T09:38:09.693894+0000","last_became_peered":"2023-09-13T09:38:09.693894+0000","last_unstale":"2023-09-13T09:39:06.903049+0000","last_undegraded":"2023-09-13T09:39:06.903049+0000","last_fullsized":"2023-09-13T09:39:06.903049+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:27:35.845345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"84'4","reported_seq":177,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.795457+0000","last_change":"2023-09-13T09:38:08.693649+0000","last_active":"2023-09-13T09:39:34.795457+0000","last_peered":"2023-09-13T09:39:34.795457+0000","last_clean":"2023-09-13T09:39:34.795457+0000","last_became_active":"2023-09-13T09:38:08.693289+0000","last_became_peered":"2023-09-13T09:38:08.693289+0000","last_unstale":"2023-09-13T09:39:34.795457+0000","last_undegraded":"2023-09-13T09:39:34.795457+0000","last_fullsized":"2023-09-13T09:39:34.795457+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:39:27.819486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":158,"num_read_kb":158,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899503+0000","last_change":"2023-09-13T09:38:09.693872+0000","last_active":"2023-09-13T09:39:06.899503+0000","last_peered":"2023-09-13T09:39:06.899503+0000","last_clean":"2023-09-13T09:39:06.899503+0000","last_became_active":"2023-09-13T09:38:09.693445+0000","last_became_peered":"2023-09-13T09:38:09.693445+0000","last_unstale":"2023-09-13T09:39:06.899503+0000","last_undegraded":"2023-09-13T09:39:06.899503+0000","last_fullsized":"2023-09-13T09:39:06.899503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:29:35.717276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905571+0000","last_change":"2023-09-13T09:38:08.696375+0000","last_active":"2023-09-13T09:39:06.905571+0000","last_peered":"2023-09-13T09:39:06.905571+0000","last_clean":"2023-09-13T09:39:06.905571+0000","last_became_active":"2023-09-13T09:38:08.695799+0000","last_became_peered":"2023-09-13T09:38:08.695799+0000","last_unstale":"2023-09-13T09:39:06.905571+0000","last_undegraded":"2023-09-13T09:39:06.905571+0000","last_fullsized":"2023-09-13T09:39:06.905571+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T14:07:09.255704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901511+0000","last_change":"2023-09-13T09:38:09.706518+0000","last_active":"2023-09-13T09:39:06.901511+0000","last_peered":"2023-09-13T09:39:06.901511+0000","last_clean":"2023-09-13T09:39:06.901511+0000","last_became_active":"2023-09-13T09:38:09.706083+0000","last_became_peered":"2023-09-13T09:38:09.706083+0000","last_unstale":"2023-09-13T09:39:06.901511+0000","last_undegraded":"2023-09-13T09:39:06.901511+0000","last_fullsized":"2023-09-13T09:39:06.901511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:21:53.831430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.907003+0000","last_change":"2023-09-13T09:38:08.697878+0000","last_active":"2023-09-13T09:39:06.907003+0000","last_peered":"2023-09-13T09:39:06.907003+0000","last_clean":"2023-09-13T09:39:06.907003+0000","last_became_active":"2023-09-13T09:38:08.697476+0000","last_became_peered":"2023-09-13T09:38:08.697476+0000","last_unstale":"2023-09-13T09:39:06.907003+0000","last_undegraded":"2023-09-13T09:39:06.907003+0000","last_fullsized":"2023-09-13T09:39:06.907003+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:49:09.021111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899511+0000","last_change":"2023-09-13T09:38:09.697144+0000","last_active":"2023-09-13T09:39:06.899511+0000","last_peered":"2023-09-13T09:39:06.899511+0000","last_clean":"2023-09-13T09:39:06.899511+0000","last_became_active":"2023-09-13T09:38:09.696521+0000","last_became_peered":"2023-09-13T09:38:09.696521+0000","last_unstale":"2023-09-13T09:39:06.899511+0000","last_undegraded":"2023-09-13T09:39:06.899511+0000","last_fullsized":"2023-09-13T09:39:06.899511+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:36:17.096644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'31","reported_seq":211,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.796451+0000","last_change":"2023-09-13T09:38:08.694981+0000","last_active":"2023-09-13T09:39:34.796451+0000","last_peered":"2023-09-13T09:39:34.796451+0000","last_clean":"2023-09-13T09:39:34.796451+0000","last_became_active":"2023-09-13T09:38:08.694630+0000","last_became_peered":"2023-09-13T09:38:08.694630+0000","last_unstale":"2023-09-13T09:39:34.796451+0000","last_undegraded":"2023-09-13T09:39:34.796451+0000","last_fullsized":"2023-09-13T09:39:34.796451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:56:58.204622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59346,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":165,"num_read_kb":141,"num_write":33,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902735+0000","last_change":"2023-09-13T09:38:09.700927+0000","last_active":"2023-09-13T09:39:06.902735+0000","last_peered":"2023-09-13T09:39:06.902735+0000","last_clean":"2023-09-13T09:39:06.902735+0000","last_became_active":"2023-09-13T09:38:09.700608+0000","last_became_peered":"2023-09-13T09:38:09.700608+0000","last_unstale":"2023-09-13T09:39:06.902735+0000","last_undegraded":"2023-09-13T09:39:06.902735+0000","last_fullsized":"2023-09-13T09:39:06.902735+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:01:24.177293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"84'9","reported_seq":26,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899533+0000","last_change":"2023-09-13T09:38:08.699130+0000","last_active":"2023-09-13T09:39:06.899533+0000","last_peered":"2023-09-13T09:39:06.899533+0000","last_clean":"2023-09-13T09:39:06.899533+0000","last_became_active":"2023-09-13T09:38:08.698802+0000","last_became_peered":"2023-09-13T09:38:08.698802+0000","last_unstale":"2023-09-13T09:39:06.899533+0000","last_undegraded":"2023-09-13T09:39:06.899533+0000","last_fullsized":"2023-09-13T09:39:06.899533+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:36.539846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898513+0000","last_change":"2023-09-13T09:38:09.697387+0000","last_active":"2023-09-13T09:39:06.898513+0000","last_peered":"2023-09-13T09:39:06.898513+0000","last_clean":"2023-09-13T09:39:06.898513+0000","last_became_active":"2023-09-13T09:38:09.697081+0000","last_became_peered":"2023-09-13T09:38:09.697081+0000","last_unstale":"2023-09-13T09:39:06.898513+0000","last_undegraded":"2023-09-13T09:39:06.898513+0000","last_fullsized":"2023-09-13T09:39:06.898513+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:28:59.473258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"84'5","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905984+0000","last_change":"2023-09-13T09:38:08.696609+0000","last_active":"2023-09-13T09:39:06.905984+0000","last_peered":"2023-09-13T09:39:06.905984+0000","last_clean":"2023-09-13T09:39:06.905984+0000","last_became_active":"2023-09-13T09:38:08.696286+0000","last_became_peered":"2023-09-13T09:38:08.696286+0000","last_unstale":"2023-09-13T09:39:06.905984+0000","last_undegraded":"2023-09-13T09:39:06.905984+0000","last_fullsized":"2023-09-13T09:39:06.905984+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:06:51.121661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905704+0000","last_change":"2023-09-13T09:38:09.698374+0000","last_active":"2023-09-13T09:39:06.905704+0000","last_peered":"2023-09-13T09:39:06.905704+0000","last_clean":"2023-09-13T09:39:06.905704+0000","last_became_active":"2023-09-13T09:38:09.698050+0000","last_became_peered":"2023-09-13T09:38:09.698050+0000","last_unstale":"2023-09-13T09:39:06.905704+0000","last_undegraded":"2023-09-13T09:39:06.905704+0000","last_fullsized":"2023-09-13T09:39:06.905704+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:37:24.089861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'6","reported_seq":99,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:30.790063+0000","last_change":"2023-09-13T09:38:08.692717+0000","last_active":"2023-09-13T09:39:30.790063+0000","last_peered":"2023-09-13T09:39:30.790063+0000","last_clean":"2023-09-13T09:39:30.790063+0000","last_became_active":"2023-09-13T09:38:08.692340+0000","last_became_peered":"2023-09-13T09:38:08.692340+0000","last_unstale":"2023-09-13T09:39:30.790063+0000","last_undegraded":"2023-09-13T09:39:30.790063+0000","last_fullsized":"2023-09-13T09:39:30.790063+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:12:22.280879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":978,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":79,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905278+0000","last_change":"2023-09-13T09:38:09.701623+0000","last_active":"2023-09-13T09:39:06.905278+0000","last_peered":"2023-09-13T09:39:06.905278+0000","last_clean":"2023-09-13T09:39:06.905278+0000","last_became_active":"2023-09-13T09:38:09.701338+0000","last_became_peered":"2023-09-13T09:38:09.701338+0000","last_unstale":"2023-09-13T09:39:06.905278+0000","last_undegraded":"2023-09-13T09:39:06.905278+0000","last_fullsized":"2023-09-13T09:39:06.905278+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:49:58.937293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"84'17","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902190+0000","last_change":"2023-09-13T09:38:08.691968+0000","last_active":"2023-09-13T09:39:06.902190+0000","last_peered":"2023-09-13T09:39:06.902190+0000","last_clean":"2023-09-13T09:39:06.902190+0000","last_became_active":"2023-09-13T09:38:08.691668+0000","last_became_peered":"2023-09-13T09:38:08.691668+0000","last_unstale":"2023-09-13T09:39:06.902190+0000","last_undegraded":"2023-09-13T09:39:06.902190+0000","last_fullsized":"2023-09-13T09:39:06.902190+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:20:43.767948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905422+0000","last_change":"2023-09-13T09:38:09.698123+0000","last_active":"2023-09-13T09:39:06.905422+0000","last_peered":"2023-09-13T09:39:06.905422+0000","last_clean":"2023-09-13T09:39:06.905422+0000","last_became_active":"2023-09-13T09:38:09.697729+0000","last_became_peered":"2023-09-13T09:38:09.697729+0000","last_unstale":"2023-09-13T09:39:06.905422+0000","last_undegraded":"2023-09-13T09:39:06.905422+0000","last_fullsized":"2023-09-13T09:39:06.905422+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:07:25.151573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'2","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902535+0000","last_change":"2023-09-13T09:38:08.691091+0000","last_active":"2023-09-13T09:39:06.902535+0000","last_peered":"2023-09-13T09:39:06.902535+0000","last_clean":"2023-09-13T09:39:06.902535+0000","last_became_active":"2023-09-13T09:38:08.689128+0000","last_became_peered":"2023-09-13T09:38:08.689128+0000","last_unstale":"2023-09-13T09:39:06.902535+0000","last_undegraded":"2023-09-13T09:39:06.902535+0000","last_fullsized":"2023-09-13T09:39:06.902535+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:12:32.133388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904092+0000","last_change":"2023-09-13T09:38:09.706041+0000","last_active":"2023-09-13T09:39:06.904092+0000","last_peered":"2023-09-13T09:39:06.904092+0000","last_clean":"2023-09-13T09:39:06.904092+0000","last_became_active":"2023-09-13T09:38:09.705707+0000","last_became_peered":"2023-09-13T09:38:09.705707+0000","last_unstale":"2023-09-13T09:39:06.904092+0000","last_undegraded":"2023-09-13T09:39:06.904092+0000","last_fullsized":"2023-09-13T09:39:06.904092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:57.018000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"84'1","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903595+0000","last_change":"2023-09-13T09:38:08.695552+0000","last_active":"2023-09-13T09:39:06.903595+0000","last_peered":"2023-09-13T09:39:06.903595+0000","last_clean":"2023-09-13T09:39:06.903595+0000","last_became_active":"2023-09-13T09:38:08.695236+0000","last_became_peered":"2023-09-13T09:38:08.695236+0000","last_unstale":"2023-09-13T09:39:06.903595+0000","last_undegraded":"2023-09-13T09:39:06.903595+0000","last_fullsized":"2023-09-13T09:39:06.903595+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:23:41.958598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906623+0000","last_change":"2023-09-13T09:38:09.699864+0000","last_active":"2023-09-13T09:39:06.906623+0000","last_peered":"2023-09-13T09:39:06.906623+0000","last_clean":"2023-09-13T09:39:06.906623+0000","last_became_active":"2023-09-13T09:38:09.699522+0000","last_became_peered":"2023-09-13T09:38:09.699522+0000","last_unstale":"2023-09-13T09:39:06.906623+0000","last_undegraded":"2023-09-13T09:39:06.906623+0000","last_fullsized":"2023-09-13T09:39:06.906623+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T11:45:51.412200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"86'6","reported_seq":102,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.794496+0000","last_change":"2023-09-13T09:38:08.695651+0000","last_active":"2023-09-13T09:39:33.794496+0000","last_peered":"2023-09-13T09:39:33.794496+0000","last_clean":"2023-09-13T09:39:33.794496+0000","last_became_active":"2023-09-13T09:38:08.695074+0000","last_became_peered":"2023-09-13T09:38:08.695074+0000","last_unstale":"2023-09-13T09:39:33.794496+0000","last_undegraded":"2023-09-13T09:39:33.794496+0000","last_fullsized":"2023-09-13T09:39:33.794496+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:10:40.974436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":906,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906176+0000","last_change":"2023-09-13T09:38:09.698193+0000","last_active":"2023-09-13T09:39:06.906176+0000","last_peered":"2023-09-13T09:39:06.906176+0000","last_clean":"2023-09-13T09:39:06.906176+0000","last_became_active":"2023-09-13T09:38:09.697874+0000","last_became_peered":"2023-09-13T09:38:09.697874+0000","last_unstale":"2023-09-13T09:39:06.906176+0000","last_undegraded":"2023-09-13T09:39:06.906176+0000","last_fullsized":"2023-09-13T09:39:06.906176+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:16:48.908322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.909872+0000","last_change":"2023-09-13T09:39:07.909324+0000","last_active":"2023-09-13T09:39:07.909872+0000","last_peered":"2023-09-13T09:39:07.909872+0000","last_clean":"2023-09-13T09:39:07.909872+0000","last_became_active":"2023-09-13T09:39:07.908877+0000","last_became_peered":"2023-09-13T09:39:07.908877+0000","last_unstale":"2023-09-13T09:39:07.909872+0000","last_undegraded":"2023-09-13T09:39:07.909872+0000","last_fullsized":"2023-09-13T09:39:07.909872+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T21:15:28.983303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,8],"acting":[9,2,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:34.795111+0000","last_change":"2023-09-13T09:38:08.695499+0000","last_active":"2023-09-13T09:39:34.795111+0000","last_peered":"2023-09-13T09:39:34.795111+0000","last_clean":"2023-09-13T09:39:34.795111+0000","last_became_active":"2023-09-13T09:38:08.695167+0000","last_became_peered":"2023-09-13T09:38:08.695167+0000","last_unstale":"2023-09-13T09:39:34.795111+0000","last_undegraded":"2023-09-13T09:39:34.795111+0000","last_fullsized":"2023-09-13T09:39:34.795111+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:54:29.561408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":81,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903974+0000","last_change":"2023-09-13T09:38:09.702273+0000","last_active":"2023-09-13T09:39:06.903974+0000","last_peered":"2023-09-13T09:39:06.903974+0000","last_clean":"2023-09-13T09:39:06.903974+0000","last_became_active":"2023-09-13T09:38:09.701944+0000","last_became_peered":"2023-09-13T09:38:09.701944+0000","last_unstale":"2023-09-13T09:39:06.903974+0000","last_undegraded":"2023-09-13T09:39:06.903974+0000","last_fullsized":"2023-09-13T09:39:06.903974+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:56.548720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"84'6","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904162+0000","last_change":"2023-09-13T09:38:08.692966+0000","last_active":"2023-09-13T09:39:06.904162+0000","last_peered":"2023-09-13T09:39:06.904162+0000","last_clean":"2023-09-13T09:39:06.904162+0000","last_became_active":"2023-09-13T09:38:08.692613+0000","last_became_peered":"2023-09-13T09:38:08.692613+0000","last_unstale":"2023-09-13T09:39:06.904162+0000","last_undegraded":"2023-09-13T09:39:06.904162+0000","last_fullsized":"2023-09-13T09:39:06.904162+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:16:37.327846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":309,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905572+0000","last_change":"2023-09-13T09:37:08.710441+0000","last_active":"2023-09-13T09:39:06.905572+0000","last_peered":"2023-09-13T09:39:06.905572+0000","last_clean":"2023-09-13T09:39:06.905572+0000","last_became_active":"2023-09-13T09:37:08.709939+0000","last_became_peered":"2023-09-13T09:37:08.709939+0000","last_unstale":"2023-09-13T09:39:06.905572+0000","last_undegraded":"2023-09-13T09:39:06.905572+0000","last_fullsized":"2023-09-13T09:39:06.905572+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:34:16.664369+0000","last_clean_scrub_stamp":"2023-09-13T09:34:16.664369+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:49:00.964039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898360+0000","last_change":"2023-09-13T09:38:09.697244+0000","last_active":"2023-09-13T09:39:06.898360+0000","last_peered":"2023-09-13T09:39:06.898360+0000","last_clean":"2023-09-13T09:39:06.898360+0000","last_became_active":"2023-09-13T09:38:09.696925+0000","last_became_peered":"2023-09-13T09:38:09.696925+0000","last_unstale":"2023-09-13T09:39:06.898360+0000","last_undegraded":"2023-09-13T09:39:06.898360+0000","last_fullsized":"2023-09-13T09:39:06.898360+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:45:39.566528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"84'4","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905693+0000","last_change":"2023-09-13T09:38:08.702070+0000","last_active":"2023-09-13T09:39:06.905693+0000","last_peered":"2023-09-13T09:39:06.905693+0000","last_clean":"2023-09-13T09:39:06.905693+0000","last_became_active":"2023-09-13T09:38:08.701647+0000","last_became_peered":"2023-09-13T09:38:08.701647+0000","last_unstale":"2023-09-13T09:39:06.905693+0000","last_undegraded":"2023-09-13T09:39:06.905693+0000","last_fullsized":"2023-09-13T09:39:06.905693+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:30:22.405675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902844+0000","last_change":"2023-09-13T09:38:08.696935+0000","last_active":"2023-09-13T09:39:06.902844+0000","last_peered":"2023-09-13T09:39:06.902844+0000","last_clean":"2023-09-13T09:39:06.902844+0000","last_became_active":"2023-09-13T09:38:08.696534+0000","last_became_peered":"2023-09-13T09:38:08.696534+0000","last_unstale":"2023-09-13T09:39:06.902844+0000","last_undegraded":"2023-09-13T09:39:06.902844+0000","last_fullsized":"2023-09-13T09:39:06.902844+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:49:13.883043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898588+0000","last_change":"2023-09-13T09:38:09.695829+0000","last_active":"2023-09-13T09:39:06.898588+0000","last_peered":"2023-09-13T09:39:06.898588+0000","last_clean":"2023-09-13T09:39:06.898588+0000","last_became_active":"2023-09-13T09:38:09.695479+0000","last_became_peered":"2023-09-13T09:38:09.695479+0000","last_unstale":"2023-09-13T09:39:06.898588+0000","last_undegraded":"2023-09-13T09:39:06.898588+0000","last_fullsized":"2023-09-13T09:39:06.898588+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:24:00.042236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905259+0000","last_change":"2023-09-13T09:38:08.698530+0000","last_active":"2023-09-13T09:39:06.905259+0000","last_peered":"2023-09-13T09:39:06.905259+0000","last_clean":"2023-09-13T09:39:06.905259+0000","last_became_active":"2023-09-13T09:38:08.698206+0000","last_became_peered":"2023-09-13T09:38:08.698206+0000","last_unstale":"2023-09-13T09:39:06.905259+0000","last_undegraded":"2023-09-13T09:39:06.905259+0000","last_fullsized":"2023-09-13T09:39:06.905259+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:10:09.940216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905026+0000","last_change":"2023-09-13T09:38:09.700993+0000","last_active":"2023-09-13T09:39:06.905026+0000","last_peered":"2023-09-13T09:39:06.905026+0000","last_clean":"2023-09-13T09:39:06.905026+0000","last_became_active":"2023-09-13T09:38:09.700677+0000","last_became_peered":"2023-09-13T09:38:09.700677+0000","last_unstale":"2023-09-13T09:39:06.905026+0000","last_undegraded":"2023-09-13T09:39:06.905026+0000","last_fullsized":"2023-09-13T09:39:06.905026+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:20:32.209248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"84'7","reported_seq":23,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903706+0000","last_change":"2023-09-13T09:38:08.684326+0000","last_active":"2023-09-13T09:39:06.903706+0000","last_peered":"2023-09-13T09:39:06.903706+0000","last_clean":"2023-09-13T09:39:06.903706+0000","last_became_active":"2023-09-13T09:38:08.683972+0000","last_became_peered":"2023-09-13T09:38:08.683972+0000","last_unstale":"2023-09-13T09:39:06.903706+0000","last_undegraded":"2023-09-13T09:39:06.903706+0000","last_fullsized":"2023-09-13T09:39:06.903706+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:56:22.702277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901365+0000","last_change":"2023-09-13T09:38:09.706237+0000","last_active":"2023-09-13T09:39:06.901365+0000","last_peered":"2023-09-13T09:39:06.901365+0000","last_clean":"2023-09-13T09:39:06.901365+0000","last_became_active":"2023-09-13T09:38:09.705706+0000","last_became_peered":"2023-09-13T09:38:09.705706+0000","last_unstale":"2023-09-13T09:39:06.901365+0000","last_undegraded":"2023-09-13T09:39:06.901365+0000","last_fullsized":"2023-09-13T09:39:06.901365+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:58:18.195063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"84'2","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899139+0000","last_change":"2023-09-13T09:38:08.695641+0000","last_active":"2023-09-13T09:39:06.899139+0000","last_peered":"2023-09-13T09:39:06.899139+0000","last_clean":"2023-09-13T09:39:06.899139+0000","last_became_active":"2023-09-13T09:38:08.695090+0000","last_became_peered":"2023-09-13T09:38:08.695090+0000","last_unstale":"2023-09-13T09:39:06.899139+0000","last_undegraded":"2023-09-13T09:39:06.899139+0000","last_fullsized":"2023-09-13T09:39:06.899139+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:16:13.987022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902335+0000","last_change":"2023-09-13T09:38:09.702254+0000","last_active":"2023-09-13T09:39:06.902335+0000","last_peered":"2023-09-13T09:39:06.902335+0000","last_clean":"2023-09-13T09:39:06.902335+0000","last_became_active":"2023-09-13T09:38:09.701946+0000","last_became_peered":"2023-09-13T09:38:09.701946+0000","last_unstale":"2023-09-13T09:39:06.902335+0000","last_undegraded":"2023-09-13T09:39:06.902335+0000","last_fullsized":"2023-09-13T09:39:06.902335+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:43:41.651279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"84'7","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903489+0000","last_change":"2023-09-13T09:38:08.694692+0000","last_active":"2023-09-13T09:39:06.903489+0000","last_peered":"2023-09-13T09:39:06.903489+0000","last_clean":"2023-09-13T09:39:06.903489+0000","last_became_active":"2023-09-13T09:38:08.693799+0000","last_became_peered":"2023-09-13T09:38:08.693799+0000","last_unstale":"2023-09-13T09:39:06.903489+0000","last_undegraded":"2023-09-13T09:39:06.903489+0000","last_fullsized":"2023-09-13T09:39:06.903489+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:53:57.188153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903647+0000","last_change":"2023-09-13T09:38:09.707954+0000","last_active":"2023-09-13T09:39:06.903647+0000","last_peered":"2023-09-13T09:39:06.903647+0000","last_clean":"2023-09-13T09:39:06.903647+0000","last_became_active":"2023-09-13T09:38:09.707659+0000","last_became_peered":"2023-09-13T09:38:09.707659+0000","last_unstale":"2023-09-13T09:39:06.903647+0000","last_undegraded":"2023-09-13T09:39:06.903647+0000","last_fullsized":"2023-09-13T09:39:06.903647+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:04:34.587020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'3","reported_seq":17,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.914790+0000","last_change":"2023-09-13T09:39:07.914790+0000","last_active":"2023-09-13T09:39:07.914790+0000","last_peered":"2023-09-13T09:39:07.914790+0000","last_clean":"2023-09-13T09:39:07.914790+0000","last_became_active":"2023-09-13T09:39:07.909229+0000","last_became_peered":"2023-09-13T09:39:07.909229+0000","last_unstale":"2023-09-13T09:39:07.914790+0000","last_undegraded":"2023-09-13T09:39:07.914790+0000","last_fullsized":"2023-09-13T09:39:07.914790+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:06.947358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.904695+0000","last_change":"2023-09-13T09:38:09.700593+0000","last_active":"2023-09-13T09:39:06.904695+0000","last_peered":"2023-09-13T09:39:06.904695+0000","last_clean":"2023-09-13T09:39:06.904695+0000","last_became_active":"2023-09-13T09:38:09.700263+0000","last_became_peered":"2023-09-13T09:38:09.700263+0000","last_unstale":"2023-09-13T09:39:06.904695+0000","last_undegraded":"2023-09-13T09:39:06.904695+0000","last_fullsized":"2023-09-13T09:39:06.904695+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:17:38.094346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"84'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.902522+0000","last_change":"2023-09-13T09:38:08.692455+0000","last_active":"2023-09-13T09:39:06.902522+0000","last_peered":"2023-09-13T09:39:06.902522+0000","last_clean":"2023-09-13T09:39:06.902522+0000","last_became_active":"2023-09-13T09:38:08.692118+0000","last_became_peered":"2023-09-13T09:38:08.692118+0000","last_unstale":"2023-09-13T09:39:06.902522+0000","last_undegraded":"2023-09-13T09:39:06.902522+0000","last_fullsized":"2023-09-13T09:39:06.902522+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:07:33.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906384+0000","last_change":"2023-09-13T09:38:09.695783+0000","last_active":"2023-09-13T09:39:06.906384+0000","last_peered":"2023-09-13T09:39:06.906384+0000","last_clean":"2023-09-13T09:39:06.906384+0000","last_became_active":"2023-09-13T09:38:09.695473+0000","last_became_peered":"2023-09-13T09:38:09.695473+0000","last_unstale":"2023-09-13T09:39:06.906384+0000","last_undegraded":"2023-09-13T09:39:06.906384+0000","last_fullsized":"2023-09-13T09:39:06.906384+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:05:59.327234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"84'5","reported_seq":101,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:33.794442+0000","last_change":"2023-09-13T09:38:08.697468+0000","last_active":"2023-09-13T09:39:33.794442+0000","last_peered":"2023-09-13T09:39:33.794442+0000","last_clean":"2023-09-13T09:39:33.794442+0000","last_became_active":"2023-09-13T09:38:08.697141+0000","last_became_peered":"2023-09-13T09:38:08.697141+0000","last_unstale":"2023-09-13T09:39:33.794442+0000","last_undegraded":"2023-09-13T09:39:33.794442+0000","last_fullsized":"2023-09-13T09:39:33.794442+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:33:26.668764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":81,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906258+0000","last_change":"2023-09-13T09:38:09.703754+0000","last_active":"2023-09-13T09:39:06.906258+0000","last_peered":"2023-09-13T09:39:06.906258+0000","last_clean":"2023-09-13T09:39:06.906258+0000","last_became_active":"2023-09-13T09:38:09.703438+0000","last_became_peered":"2023-09-13T09:38:09.703438+0000","last_unstale":"2023-09-13T09:39:06.906258+0000","last_undegraded":"2023-09-13T09:39:06.906258+0000","last_fullsized":"2023-09-13T09:39:06.906258+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:19.298385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'3","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.906887+0000","last_change":"2023-09-13T09:38:08.698973+0000","last_active":"2023-09-13T09:39:06.906887+0000","last_peered":"2023-09-13T09:39:06.906887+0000","last_clean":"2023-09-13T09:39:06.906887+0000","last_became_active":"2023-09-13T09:38:08.698329+0000","last_became_peered":"2023-09-13T09:38:08.698329+0000","last_unstale":"2023-09-13T09:39:06.906887+0000","last_undegraded":"2023-09-13T09:39:06.906887+0000","last_fullsized":"2023-09-13T09:39:06.906887+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:10.684590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905485+0000","last_change":"2023-09-13T09:38:09.700216+0000","last_active":"2023-09-13T09:39:06.905485+0000","last_peered":"2023-09-13T09:39:06.905485+0000","last_clean":"2023-09-13T09:39:06.905485+0000","last_became_active":"2023-09-13T09:38:09.699876+0000","last_became_peered":"2023-09-13T09:38:09.699876+0000","last_unstale":"2023-09-13T09:39:06.905485+0000","last_undegraded":"2023-09-13T09:39:06.905485+0000","last_fullsized":"2023-09-13T09:39:06.905485+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:50:33.347155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'5","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898610+0000","last_change":"2023-09-13T09:38:08.696200+0000","last_active":"2023-09-13T09:39:06.898610+0000","last_peered":"2023-09-13T09:39:06.898610+0000","last_clean":"2023-09-13T09:39:06.898610+0000","last_became_active":"2023-09-13T09:38:08.695880+0000","last_became_peered":"2023-09-13T09:38:08.695880+0000","last_unstale":"2023-09-13T09:39:06.898610+0000","last_undegraded":"2023-09-13T09:39:06.898610+0000","last_fullsized":"2023-09-13T09:39:06.898610+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:07.674611+0000","last_clean_scrub_stamp":"2023-09-13T09:38:07.674611+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:29:38.222209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.905761+0000","last_change":"2023-09-13T09:38:09.703022+0000","last_active":"2023-09-13T09:39:06.905761+0000","last_peered":"2023-09-13T09:39:06.905761+0000","last_clean":"2023-09-13T09:39:06.905761+0000","last_became_active":"2023-09-13T09:38:09.702665+0000","last_became_peered":"2023-09-13T09:38:09.702665+0000","last_unstale":"2023-09-13T09:39:06.905761+0000","last_undegraded":"2023-09-13T09:39:06.905761+0000","last_fullsized":"2023-09-13T09:39:06.905761+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T09:38:59.284385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903711+0000","last_change":"2023-09-13T09:38:09.708137+0000","last_active":"2023-09-13T09:39:06.903711+0000","last_peered":"2023-09-13T09:39:06.903711+0000","last_clean":"2023-09-13T09:39:06.903711+0000","last_became_active":"2023-09-13T09:38:09.707829+0000","last_became_peered":"2023-09-13T09:38:09.707829+0000","last_unstale":"2023-09-13T09:39:06.903711+0000","last_undegraded":"2023-09-13T09:39:06.903711+0000","last_fullsized":"2023-09-13T09:39:06.903711+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T15:16:15.976098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899071+0000","last_change":"2023-09-13T09:38:09.703131+0000","last_active":"2023-09-13T09:39:06.899071+0000","last_peered":"2023-09-13T09:39:06.899071+0000","last_clean":"2023-09-13T09:39:06.899071+0000","last_became_active":"2023-09-13T09:38:09.702850+0000","last_became_peered":"2023-09-13T09:38:09.702850+0000","last_unstale":"2023-09-13T09:39:06.899071+0000","last_undegraded":"2023-09-13T09:39:06.899071+0000","last_fullsized":"2023-09-13T09:39:06.899071+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:33:08.422038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899035+0000","last_change":"2023-09-13T09:38:09.701691+0000","last_active":"2023-09-13T09:39:06.899035+0000","last_peered":"2023-09-13T09:39:06.899035+0000","last_clean":"2023-09-13T09:39:06.899035+0000","last_became_active":"2023-09-13T09:38:09.701395+0000","last_became_peered":"2023-09-13T09:38:09.701395+0000","last_unstale":"2023-09-13T09:39:06.899035+0000","last_undegraded":"2023-09-13T09:39:06.899035+0000","last_fullsized":"2023-09-13T09:39:06.899035+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:16:02.916712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.901222+0000","last_change":"2023-09-13T09:38:09.706885+0000","last_active":"2023-09-13T09:39:06.901222+0000","last_peered":"2023-09-13T09:39:06.901222+0000","last_clean":"2023-09-13T09:39:06.901222+0000","last_became_active":"2023-09-13T09:38:09.706569+0000","last_became_peered":"2023-09-13T09:38:09.706569+0000","last_unstale":"2023-09-13T09:39:06.901222+0000","last_undegraded":"2023-09-13T09:39:06.901222+0000","last_fullsized":"2023-09-13T09:39:06.901222+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T12:27:02.670010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898666+0000","last_change":"2023-09-13T09:38:09.698547+0000","last_active":"2023-09-13T09:39:06.898666+0000","last_peered":"2023-09-13T09:39:06.898666+0000","last_clean":"2023-09-13T09:39:06.898666+0000","last_became_active":"2023-09-13T09:38:09.698180+0000","last_became_peered":"2023-09-13T09:38:09.698180+0000","last_unstale":"2023-09-13T09:39:06.898666+0000","last_undegraded":"2023-09-13T09:39:06.898666+0000","last_fullsized":"2023-09-13T09:39:06.898666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:58:12.988597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:07.910066+0000","last_change":"2023-09-13T09:39:07.910066+0000","last_active":"2023-09-13T09:39:07.910066+0000","last_peered":"2023-09-13T09:39:07.910066+0000","last_clean":"2023-09-13T09:39:07.910066+0000","last_became_active":"2023-09-13T09:39:07.909109+0000","last_became_peered":"2023-09-13T09:39:07.909109+0000","last_unstale":"2023-09-13T09:39:07.910066+0000","last_undegraded":"2023-09-13T09:39:07.910066+0000","last_fullsized":"2023-09-13T09:39:07.910066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T13:51:07.559587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,9],"acting":[11,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.900063+0000","last_change":"2023-09-13T09:38:09.695277+0000","last_active":"2023-09-13T09:39:06.900063+0000","last_peered":"2023-09-13T09:39:06.900063+0000","last_clean":"2023-09-13T09:39:06.900063+0000","last_became_active":"2023-09-13T09:38:09.694959+0000","last_became_peered":"2023-09-13T09:38:09.694959+0000","last_unstale":"2023-09-13T09:39:06.900063+0000","last_undegraded":"2023-09-13T09:39:06.900063+0000","last_fullsized":"2023-09-13T09:39:06.900063+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:35:17.321069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903273+0000","last_change":"2023-09-13T09:38:09.702030+0000","last_active":"2023-09-13T09:39:06.903273+0000","last_peered":"2023-09-13T09:39:06.903273+0000","last_clean":"2023-09-13T09:39:06.903273+0000","last_became_active":"2023-09-13T09:38:09.701712+0000","last_became_peered":"2023-09-13T09:38:09.701712+0000","last_unstale":"2023-09-13T09:39:06.903273+0000","last_undegraded":"2023-09-13T09:39:06.903273+0000","last_fullsized":"2023-09-13T09:39:06.903273+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T10:14:38.909533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":86,"state":"active+clean","last_fresh":"2023-09-13T09:39:08.159049+0000","last_change":"2023-09-13T09:39:08.159049+0000","last_active":"2023-09-13T09:39:08.159049+0000","last_peered":"2023-09-13T09:39:08.159049+0000","last_clean":"2023-09-13T09:39:08.159049+0000","last_became_active":"2023-09-13T09:39:08.158719+0000","last_became_peered":"2023-09-13T09:39:08.158719+0000","last_unstale":"2023-09-13T09:39:08.159049+0000","last_undegraded":"2023-09-13T09:39:08.159049+0000","last_fullsized":"2023-09-13T09:39:08.159049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T16:24:52.336150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6],"acting":[5,9,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903267+0000","last_change":"2023-09-13T09:38:09.703544+0000","last_active":"2023-09-13T09:39:06.903267+0000","last_peered":"2023-09-13T09:39:06.903267+0000","last_clean":"2023-09-13T09:39:06.903267+0000","last_became_active":"2023-09-13T09:38:09.702015+0000","last_became_peered":"2023-09-13T09:38:09.702015+0000","last_unstale":"2023-09-13T09:39:06.903267+0000","last_undegraded":"2023-09-13T09:39:06.903267+0000","last_fullsized":"2023-09-13T09:39:06.903267+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T18:46:49.166965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.899447+0000","last_change":"2023-09-13T09:38:09.694224+0000","last_active":"2023-09-13T09:39:06.899447+0000","last_peered":"2023-09-13T09:39:06.899447+0000","last_clean":"2023-09-13T09:39:06.899447+0000","last_became_active":"2023-09-13T09:38:09.693562+0000","last_became_peered":"2023-09-13T09:38:09.693562+0000","last_unstale":"2023-09-13T09:39:06.899447+0000","last_undegraded":"2023-09-13T09:39:06.899447+0000","last_fullsized":"2023-09-13T09:39:06.899447+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T19:41:07.529921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.898674+0000","last_change":"2023-09-13T09:38:09.698919+0000","last_active":"2023-09-13T09:39:06.898674+0000","last_peered":"2023-09-13T09:39:06.898674+0000","last_clean":"2023-09-13T09:39:06.898674+0000","last_became_active":"2023-09-13T09:38:09.698637+0000","last_became_peered":"2023-09-13T09:38:09.698637+0000","last_unstale":"2023-09-13T09:39:06.898674+0000","last_undegraded":"2023-09-13T09:39:06.898674+0000","last_fullsized":"2023-09-13T09:39:06.898674+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T17:08:50.277687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-09-13T09:39:06.903854+0000","last_change":"2023-09-13T09:38:09.705194+0000","last_active":"2023-09-13T09:39:06.903854+0000","last_peered":"2023-09-13T09:39:06.903854+0000","last_clean":"2023-09-13T09:39:06.903854+0000","last_became_active":"2023-09-13T09:38:09.704888+0000","last_became_peered":"2023-09-13T09:38:09.704888+0000","last_unstale":"2023-09-13T09:39:06.903854+0000","last_undegraded":"2023-09-13T09:39:06.903854+0000","last_fullsized":"2023-09-13T09:39:06.903854+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-13T09:38:08.676069+0000","last_clean_scrub_stamp":"2023-09-13T09:38:08.676069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-09-14T20:49:07.995177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":66866,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":824,"num_read_kb":489,"num_write":234,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":196278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":206,"ondisk_log_size":206,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":79,"seq":339302416412,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":452728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.60299999999999998}]},{"osd":1,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"last":0.625},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"last":0.749}]},{"osd":2,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.376},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.55900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.85599999999999998}]},{"osd":5,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.41599999999999998}]},{"osd":6,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.753,"15min":0.753},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.58099999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.82099999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.66000000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.79800000000000004}]},{"osd":10,"last update":"Wed Sep 13 09:38:29 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.2989999999999999,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.78200000000000003}]}]},{"osd":10,"up_from":71,"seq":304942678050,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28624,"kb_used_data":1608,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716528,"statfs":{"total":95995035648,"available":95965724672,"internally_reserved":0,"allocated":1646592,"data_stored":1103168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.58699999999999997}]},{"osd":1,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.503,"15min":0.501},"min":{"1min":0.33400000000000002,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.621}]},{"osd":2,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66000000000000003,"15min":0.65600000000000003},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88500000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.63600000000000001,"15min":0.628},"min":{"1min":0.48799999999999999,"5min":0.374,"15min":0.374},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.79800000000000004}]},{"osd":3,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.69099999999999995,"15min":0.69899999999999995},"min":{"1min":0.47599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.84599999999999997,"5min":0.995,"15min":0.995},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.69399999999999995,"15min":0.70599999999999996},"min":{"1min":0.46600000000000003,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.86299999999999999,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.69499999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.63300000000000001,"15min":0.63400000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84899999999999998,"5min":0.95599999999999996,"15min":0.95599999999999996},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.63200000000000001,"15min":0.63300000000000001},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88700000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.81799999999999995}]},{"osd":5,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.69199999999999995,"15min":0.68899999999999995},"min":{"1min":0.48899999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.755,"15min":0.752},"min":{"1min":0.53400000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.86099999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.76000000000000001,"15min":0.77000000000000002},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.92400000000000004,"5min":1.161,"15min":1.161},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.81699999999999995,"15min":0.81599999999999995},"min":{"1min":0.60099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.96299999999999997,"5min":1.026,"15min":1.026},"last":0.89000000000000001}]},{"osd":7,"last update":"Wed Sep 13 09:38:05 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"last":0.875}]},{"osd":8,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.874,"15min":0.876},"min":{"1min":0.60099999999999998,"5min":0.432,"15min":0.432},"max":{"1min":1.1000000000000001,"5min":1.2829999999999999,"15min":1.2829999999999999},"last":1.0169999999999999},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.86899999999999999,"15min":0.879},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0920000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":1.004}]},{"osd":9,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88,"15min":0.88600000000000001},"min":{"1min":0.63300000000000001,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.0589999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.80700000000000005,"5min":0.871,"15min":0.88100000000000001},"min":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"max":{"1min":1.0169999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.94799999999999995}]},{"osd":11,"last update":"Wed Sep 13 09:39:31 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.88600000000000001,"15min":0.88200000000000001},"min":{"1min":0.70799999999999996,"5min":0.65800000000000003,"15min":0.65800000000000003},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.748,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.1120000000000001,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.97699999999999998}]}]},{"osd":9,"up_from":66,"seq":283467841573,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":452658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.46000000000000002,"15min":0.46800000000000003},"min":{"1min":0.28100000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.60999999999999999,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.316},{"interface":"front","average":{"1min":0.438,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.69499999999999995,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.38900000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.68500000000000005,"15min":0.70099999999999996},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.82999999999999996,"5min":1.0449999999999999,"15min":1.0449999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.70999999999999996,"15min":0.72399999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.78200000000000003,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.64800000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.66000000000000003,"15min":0.67500000000000004},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.77400000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.68999999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.873,"5min":1.0740000000000001,"15min":1.0740000000000001},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.57199999999999995,"15min":0.58799999999999997},"min":{"1min":0.32000000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.65300000000000002,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.45000000000000001,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.60499999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.443}]},{"osd":4,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.77400000000000002,"15min":0.79400000000000004},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.82499999999999996,"5min":1.2989999999999999,"15min":1.2989999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.74199999999999999,"15min":0.75600000000000001},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.88,"5min":1.256,"15min":1.256},"last":0.5}]},{"osd":5,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.72799999999999998,"15min":0.74399999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86699999999999999,"5min":1.117,"15min":1.117},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.623,"5min":0.70399999999999996,"15min":0.71799999999999997},"min":{"1min":0.496,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.83499999999999996,"5min":1.002,"15min":1.002},"last":0.63500000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.65100000000000002,"15min":0.66800000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.88200000000000001,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.72099999999999997,"15min":0.73899999999999999},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81399999999999995,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.42899999999999999}]},{"osd":7,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.80800000000000005,"15min":0.82599999999999996},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":0.83199999999999996,"5min":1.204,"15min":1.204},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.78700000000000003,"15min":0.80900000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85399999999999998,"5min":1.276,"15min":1.276},"last":0.71099999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.83399999999999996,"15min":0.85099999999999998},"min":{"1min":0.59999999999999998,"5min":0.501,"15min":0.501},"max":{"1min":0.86699999999999999,"5min":1.224,"15min":1.224},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71599999999999997,"5min":0.81200000000000006,"15min":0.82799999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.84999999999999998,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.60799999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.90600000000000003,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82899999999999996,"15min":0.83999999999999997},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.91900000000000004,"5min":1.3879999999999999,"15min":1.3879999999999999},"last":0.69399999999999995}]}]},{"osd":8,"up_from":58,"seq":249108103209,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":452705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.57399999999999995,"15min":0.58399999999999996},"min":{"1min":0.41599999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.73799999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.54700000000000004,"15min":0.55300000000000005},"min":{"1min":0.442,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.497}]},{"osd":1,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.61299999999999999,"15min":0.58799999999999997},"min":{"1min":0.38600000000000001,"5min":0.31,"15min":0.31},"max":{"1min":1.014,"5min":1.014,"15min":1.014},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.63700000000000001,"15min":0.61799999999999999},"min":{"1min":0.496,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.59599999999999997}]},{"osd":2,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.45800000000000002,"15min":0.44800000000000001},"min":{"1min":0.379,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.68600000000000005,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.436},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.47599999999999998,"15min":0.46999999999999997},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.73599999999999999}]},{"osd":3,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65100000000000002,"15min":0.60099999999999998},"min":{"1min":0.44800000000000001,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":5.9850000000000003,"15min":5.9850000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60199999999999998,"15min":0.60799999999999998},"min":{"1min":0.498,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.74299999999999999,"5min":0.64000000000000001,"15min":0.61199999999999999},"min":{"1min":0.56000000000000005,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.75,"5min":0.66300000000000003,"15min":0.63600000000000001},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.61799999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.59099999999999997,"15min":0.57899999999999996},"min":{"1min":0.45100000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.57699999999999996,"15min":0.56399999999999995},"min":{"1min":0.36599999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.78600000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.71499999999999997,"15min":0.66100000000000003},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.95199999999999996,"5min":6.0179999999999998,"15min":6.0179999999999998},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.76100000000000001,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.91600000000000004,"5min":6.0430000000000001,"15min":6.0430000000000001},"last":0.70099999999999996}]},{"osd":7,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.74299999999999999,"15min":0.72499999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.83199999999999996,"5min":0.72199999999999998,"15min":0.69099999999999995},"min":{"1min":0.51600000000000001,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.91100000000000003}]},{"osd":9,"last update":"Wed Sep 13 09:38:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.73899999999999999,"15min":0.72699999999999998},"min":{"1min":0.55500000000000005,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.68700000000000006,"15min":0.66900000000000004},"min":{"1min":0.51800000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.88}]},{"osd":10,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.73899999999999999,"15min":0.71999999999999997},"min":{"1min":0.56499999999999995,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.77800000000000002,"15min":0.76200000000000001},"min":{"1min":0.57099999999999995,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.84999999999999998}]},{"osd":11,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.80600000000000005}]}]},{"osd":7,"up_from":50,"seq":214748364846,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28548,"kb_used_data":1532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716604,"statfs":{"total":95995035648,"available":95965802496,"internally_reserved":0,"allocated":1568768,"data_stored":1046267,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.80500000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.502}]},{"osd":1,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.47999999999999998,"15min":0.48599999999999999},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.56999999999999995,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.5},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.40400000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54500000000000004}]},{"osd":2,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.64700000000000002,"15min":0.64100000000000001},"min":{"1min":0.52900000000000003,"5min":0.442,"15min":0.442},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.67000000000000004,"15min":0.66900000000000004},"min":{"1min":0.56499999999999995,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.85799999999999998,"5min":1.024,"15min":1.024},"last":0.66300000000000003}]},{"osd":3,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.69199999999999995,"15min":0.65200000000000002},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":5.093,"5min":5.093,"15min":5.093},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.68700000000000006,"15min":0.64700000000000002},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.0279999999999996,"5min":5.0279999999999996,"15min":5.0279999999999996},"last":0.64400000000000002}]},{"osd":4,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.372,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.59299999999999997,"15min":0.60299999999999998},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77000000000000002,"5min":0.999,"15min":0.999},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.73699999999999999,"15min":0.75700000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.88900000000000001,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.747},{"interface":"front","average":{"1min":0.751,"5min":0.72899999999999998,"15min":0.73199999999999998},"min":{"1min":0.54700000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":0.94999999999999996,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.69199999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.93300000000000005,"5min":0.79800000000000004,"15min":0.77900000000000003},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":4.5140000000000002,"5min":4.5140000000000002,"15min":4.5140000000000002},"last":0.76100000000000001},{"interface":"front","average":{"1min":1.115,"5min":0.83699999999999997,"15min":0.79300000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":8.1099999999999994,"5min":8.1099999999999994,"15min":8.1099999999999994},"last":0.67400000000000004}]},{"osd":8,"last update":"Wed Sep 13 09:39:24 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.66300000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.93500000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.81599999999999995,"15min":0.81799999999999995},"min":{"1min":0.74199999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.97899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.77300000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:53 2023","interfaces":[{"interface":"back","average":{"1min":1.04,"5min":0.81899999999999995,"15min":0.78200000000000003},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":5.258,"5min":5.258,"15min":5.258},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.79800000000000004,"15min":0.79700000000000004},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.81699999999999995}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.83299999999999996,"15min":0.83699999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.0409999999999999,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.81100000000000005,"15min":0.81299999999999994},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":1.002,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.94199999999999995}]},{"osd":11,"last update":"Wed Sep 13 09:39:12 2023","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.85199999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528371,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":958464,"data_stored":452699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.39600000000000002,"15min":0.38700000000000001},"min":{"1min":0.27700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.42099999999999999,"15min":0.40200000000000002},"min":{"1min":0.29999999999999999,"5min":0.255,"15min":0.255},"max":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":0.39100000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.60299999999999998,"15min":0.58399999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.625},{"interface":"front","average":{"1min":0.66700000000000004,"5min":0.63500000000000001,"15min":0.61299999999999999},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.82999999999999996}]},{"osd":2,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59599999999999997,"15min":0.58099999999999996},"min":{"1min":0.442,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.86599999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.47899999999999998,"15min":0.45900000000000002},"min":{"1min":0.32500000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.246,"5min":1.246,"15min":1.246},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51900000000000002,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66600000000000004,"15min":0.63900000000000001},"min":{"1min":0.50800000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.982,"5min":1.982,"15min":1.982},"last":0.71399999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.49299999999999999,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":2.0049999999999999,"5min":2.0049999999999999,"15min":2.0049999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.66900000000000004,"15min":0.65300000000000002},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.95299999999999996,"5min":1.101,"15min":1.101},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.69399999999999995,"15min":0.68300000000000005},"min":{"1min":0.52200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.014,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.754},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.73999999999999999,"15min":0.73599999999999999},"min":{"1min":0.52700000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90300000000000002,"5min":1.143,"15min":1.143},"last":0.80900000000000005}]},{"osd":8,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.72399999999999998,"15min":0.745},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.81499999999999995,"5min":1.214,"15min":1.214},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.52400000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":0.80500000000000005,"5min":1.121,"15min":1.121},"last":0.66600000000000004}]},{"osd":9,"last update":"Wed Sep 13 09:38:49 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.79300000000000004,"15min":0.81899999999999995},"min":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.92900000000000005,"5min":1.264,"15min":1.264},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.78800000000000003,"15min":0.81200000000000006},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97899999999999998,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.76900000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.82699999999999996,"15min":0.84499999999999997},"min":{"1min":0.60099999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.0880000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"last":0.85699999999999998},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.80300000000000005,"15min":0.81899999999999995},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.79500000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574920,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1015808,"data_stored":508632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56100000000000005,"15min":0.53900000000000003},"min":{"1min":0.40500000000000003,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":1.022,"5min":1.022,"15min":1.022},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.38200000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.83299999999999996,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Sep 13 09:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.623,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0009999999999999,"5min":1.075,"15min":1.075},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.61599999999999999,"15min":0.55700000000000005},"min":{"1min":0.56200000000000006,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.92300000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.76000000000000001}]},{"osd":3,"last update":"Wed Sep 13 09:38:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.59899999999999998,"15min":0.58299999999999996},"min":{"1min":0.43099999999999999,"5min":0.308,"15min":0.308},"max":{"1min":1.036,"5min":1.036,"15min":1.036},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.64900000000000002,"15min":0.59699999999999998},"min":{"1min":0.44600000000000001,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.96199999999999997,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.77900000000000003}]},{"osd":4,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.53600000000000003,"15min":0.48599999999999999},"min":{"1min":0.36899999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.54500000000000004,"15min":0.504},"min":{"1min":0.34799999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.91800000000000004,"5min":1.117,"15min":1.117},"last":0.83799999999999997}]},{"osd":5,"last update":"Wed Sep 13 09:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.626,"15min":0.57399999999999995},"min":{"1min":0.42699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.94699999999999995,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":0.69399999999999995,"15min":0.628},"min":{"1min":0.42399999999999999,"5min":0.38,"15min":0.38},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.94399999999999995}]},{"osd":6,"last update":"Wed Sep 13 09:38:47 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67900000000000005,"15min":0.64900000000000002},"min":{"1min":0.373,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.111,"5min":1.111,"15min":1.111},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.66300000000000003,"15min":0.64400000000000002},"min":{"1min":0.44500000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.81699999999999995}]},{"osd":7,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.68400000000000005,"15min":0.63100000000000001},"min":{"1min":0.47999999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":1.0229999999999999},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.68899999999999995,"15min":0.64300000000000002},"min":{"1min":0.46200000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.86699999999999999}]},{"osd":8,"last update":"Wed Sep 13 09:39:25 2023","interfaces":[{"interface":"back","average":{"1min":0.85999999999999999,"5min":0.78700000000000003,"15min":0.76600000000000001},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.83299999999999996,"15min":0.79700000000000004},"min":{"1min":0.505,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.141,"5min":1.1919999999999999,"15min":1.1919999999999999},"last":1.1339999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.81899999999999995,"15min":0.81699999999999995},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.121,"5min":1.121,"15min":1.121},"last":0.98399999999999999},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.872,"15min":0.86299999999999999},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.109}]},{"osd":10,"last update":"Wed Sep 13 09:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.95599999999999996,"5min":0.92400000000000004,"15min":0.91800000000000004},"min":{"1min":0.64400000000000002,"5min":0.502,"15min":0.502},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.873,"15min":0.86699999999999999},"min":{"1min":0.67500000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1679999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":1.006}]},{"osd":11,"last update":"Wed Sep 13 09:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.208,"5min":1.208,"15min":1.208},"last":1.05},{"interface":"front","average":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"min":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":1.038}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":453714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Sep 13 09:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54800000000000004,"15min":0.48199999999999998},"min":{"1min":0.39200000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73999999999999999,"5min":3.1680000000000001,"15min":3.1680000000000001},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56200000000000006,"15min":0.498},"min":{"1min":0.34799999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.82199999999999995,"5min":1.47,"15min":1.47},"last":0.52000000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.58899999999999997,"15min":0.52900000000000003},"min":{"1min":0.41499999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.478,"5min":1.478,"15min":1.478},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.60899999999999999,"15min":0.55200000000000005},"min":{"1min":0.42499999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.436}]},{"osd":4,"last update":"Wed Sep 13 09:39:01 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.59199999999999997,"15min":0.56999999999999995},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.875,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.57599999999999996,"15min":0.56999999999999995},"min":{"1min":0.40400000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78200000000000003,"5min":1.288,"15min":1.288},"last":0.505}]},{"osd":5,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.64100000000000001,"15min":0.61899999999999999},"min":{"1min":0.48599999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.4510000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64800000000000002,"15min":0.623},"min":{"1min":0.46000000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.85999999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.61699999999999999}]},{"osd":6,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.57899999999999996,"15min":0.56899999999999995},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.63600000000000001,"15min":0.63100000000000001},"min":{"1min":0.36899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0069999999999999,"5min":1.109,"15min":1.109},"last":0.46700000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76200000000000001,"5min":0.72599999999999998,"15min":0.71999999999999997},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.68500000000000005,"15min":0.69199999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.024,"5min":1.024,"15min":1.024},"last":0.69299999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.75700000000000001,"15min":0.78200000000000003},"min":{"1min":0.49199999999999999,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":2.0259999999999998,"5min":2.0259999999999998,"15min":2.0259999999999998},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.78700000000000003,"15min":0.81599999999999995},"min":{"1min":0.504,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":0.58299999999999996}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.745,"15min":0.77000000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.018,"5min":1.018,"15min":1.018},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.80000000000000004,"15min":0.82799999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.996,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.68000000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.80400000000000005,"15min":0.82199999999999995},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":0.97199999999999998,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.69399999999999995,"15min":0.70399999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.081,"5min":1.081,"15min":1.081},"last":0.54800000000000004}]},{"osd":11,"last update":"Wed Sep 13 09:38:33 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.72199999999999998}]}]},{"osd":2,"up_from":18,"seq":77309411396,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1040384,"data_stored":513244,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53000000000000003,"15min":0.48399999999999999},"min":{"1min":0.373,"5min":0.316,"15min":0.316},"max":{"1min":0.72999999999999998,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.56200000000000006,"15min":0.503},"min":{"1min":0.40100000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.48999999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.54800000000000004,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.80200000000000005,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.58299999999999996,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.878,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.81399999999999995}]},{"osd":3,"last update":"Wed Sep 13 09:38:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61199999999999999,"15min":0.59399999999999997},"min":{"1min":0.38400000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.82199999999999995,"5min":0.97499999999999998,"15min":0.97499999999999998},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56799999999999995,"15min":0.56399999999999995},"min":{"1min":0.42099999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.751,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.55800000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74099999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:19 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.496,"15min":0.45800000000000002},"min":{"1min":0.32900000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.752,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.48199999999999998,"15min":0.44600000000000001},"min":{"1min":0.35199999999999998,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.78200000000000003,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.77700000000000002,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.66100000000000003,"15min":0.64800000000000002},"min":{"1min":0.56000000000000005,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.81799999999999995,"5min":1,"15min":1},"last":0.72099999999999997}]},{"osd":7,"last update":"Wed Sep 13 09:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65600000000000003,"15min":0.66300000000000003},"min":{"1min":0.44500000000000001,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.98099999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.751}]},{"osd":8,"last update":"Wed Sep 13 09:39:27 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.67100000000000004,"15min":0.65900000000000003},"min":{"1min":0.441,"5min":0.38,"15min":0.38},"max":{"1min":0.91400000000000003,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.47399999999999998,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.42899999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.71199999999999997,"15min":0.72099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.70299999999999996,"15min":0.70199999999999996},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":2.6960000000000002,"5min":2.6960000000000002,"15min":2.6960000000000002},"last":0.46300000000000002}]},{"osd":10,"last update":"Wed Sep 13 09:39:05 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":0.84999999999999998,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.74299999999999999,"15min":0.73499999999999999},"min":{"1min":0.60499999999999998,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.77800000000000002}]},{"osd":11,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.755},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.874,"5min":0.874,"15min":0.874},"last":0.64900000000000002}]}]},{"osd":3,"up_from":25,"seq":107374182463,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":970752,"data_stored":451881,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.38500000000000001,"15min":0.34899999999999998},"min":{"1min":0.29599999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.55600000000000005,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.371},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.40600000000000003,"15min":0.38200000000000001},"min":{"1min":0.29399999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60499999999999998,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.39900000000000002}]},{"osd":1,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.53100000000000003},"min":{"1min":0.38200000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81699999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.55300000000000005,"15min":0.51900000000000002},"min":{"1min":0.40999999999999998,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69899999999999995,"5min":1.649,"15min":1.649},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.61699999999999999,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86299999999999999,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.66600000000000004,"15min":0.66400000000000003},"min":{"1min":0.432,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86899999999999999,"5min":2.238,"15min":2.238},"last":0.48499999999999999}]},{"osd":4,"last update":"Wed Sep 13 09:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59799999999999998,"15min":0.56399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83199999999999996,"5min":1.052,"15min":1.052},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.61699999999999999,"15min":0.60399999999999998},"min":{"1min":0.40200000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.746,"5min":1.292,"15min":1.292},"last":0.622}]},{"osd":5,"last update":"Wed Sep 13 09:39:26 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.61599999999999999,"15min":0.60399999999999998},"min":{"1min":0.40000000000000002,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.78600000000000003,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.47099999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.71499999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.98899999999999999,"5min":1.02,"15min":1.02},"last":0.5},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.35199999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.89500000000000002,"5min":1.071,"15min":1.071},"last":0.437}]},{"osd":7,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.68899999999999995,"15min":0.67400000000000004},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.84999999999999998,"5min":1.595,"15min":1.595},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.73199999999999998,"15min":0.72499999999999998},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.84199999999999997,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.69699999999999995}]},{"osd":8,"last update":"Wed Sep 13 09:37:26 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":0.89600000000000002}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.71399999999999997,"15min":0.72399999999999998},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.95299999999999996,"5min":1.109,"15min":1.109},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.72699999999999998,"15min":0.73999999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.89300000000000002,"5min":1.073,"15min":1.073},"last":0.60599999999999998}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.84699999999999998,"15min":0.871},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.97099999999999997,"5min":1.73,"15min":1.73},"last":0.751},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.83299999999999996,"15min":0.85899999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":0.92000000000000004,"5min":1.399,"15min":1.399},"last":0.74099999999999999}]},{"osd":11,"last update":"Wed Sep 13 09:39:10 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66500000000000004}]}]},{"osd":4,"up_from":32,"seq":137438953530,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":452626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.55000000000000004,"15min":0.52800000000000002},"min":{"1min":0.41899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.57399999999999995,"15min":0.53100000000000003},"min":{"1min":0.44700000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":3.335,"5min":3.335,"15min":3.335},"last":0.44700000000000001}]},{"osd":1,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.433,"15min":0.39500000000000002},"min":{"1min":0.28399999999999997,"5min":0.249,"15min":0.249},"max":{"1min":0.63600000000000001,"5min":0.745,"15min":0.745},"last":0.434},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.442,"15min":0.40699999999999997},"min":{"1min":0.34200000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.66800000000000004,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46300000000000002}]},{"osd":2,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.65300000000000002,"15min":0.61899999999999999},"min":{"1min":0.48999999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.93200000000000005,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.63400000000000001,"15min":0.59699999999999998},"min":{"1min":0.51200000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.81699999999999995,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.59599999999999997}]},{"osd":3,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.61899999999999999,"15min":0.57499999999999996},"min":{"1min":0.45200000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.80500000000000005,"5min":1.05,"15min":1.05},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.61899999999999999,"15min":0.59799999999999998},"min":{"1min":0.42499999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":3.5230000000000001,"15min":3.5230000000000001},"last":0.61699999999999999}]},{"osd":5,"last update":"Wed Sep 13 09:39:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.68400000000000005,"15min":0.65400000000000003},"min":{"1min":0.52500000000000002,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.69099999999999995,"15min":0.64700000000000002},"min":{"1min":0.60299999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.90900000000000003,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.76000000000000001}]},{"osd":6,"last update":"Wed Sep 13 09:38:43 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.67600000000000005,"15min":0.67600000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.98399999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"last":0.501},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.70499999999999996,"15min":0.70699999999999996},"min":{"1min":0.46000000000000002,"5min":0.443,"15min":0.443},"max":{"1min":0.87,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.53600000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:39:03 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67500000000000004},"min":{"1min":0.40600000000000003,"5min":0.377,"15min":0.377},"max":{"1min":0.93300000000000005,"5min":1.03,"15min":1.03},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.69999999999999996,"15min":0.67400000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.05,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84399999999999997}]},{"osd":8,"last update":"Wed Sep 13 09:39:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.78700000000000003,"15min":0.75700000000000001},"min":{"1min":0.69699999999999995,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.052,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.871,"5min":0.83299999999999996,"15min":0.81599999999999995},"min":{"1min":0.53900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.88100000000000001}]},{"osd":9,"last update":"Wed Sep 13 09:38:48 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.86599999999999999,"15min":0.87},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.8839999999999999,"5min":1.8839999999999999,"15min":1.8839999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.90800000000000003,"5min":0.86599999999999999,"15min":0.85899999999999999},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.4470000000000001,"5min":3.4470000000000001,"15min":3.4470000000000001},"last":0.71499999999999997}]},{"osd":10,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.90200000000000002,"15min":0.90800000000000003},"min":{"1min":0.58599999999999997,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.84499999999999997,"15min":0.83499999999999996},"min":{"1min":0.57299999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.115,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.86099999999999999}]},{"osd":11,"last update":"Wed Sep 13 09:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.95399999999999996,"15min":0.95399999999999996},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.91400000000000003},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.94899999999999995}]}]},{"osd":5,"up_from":37,"seq":158913790007,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28568,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716584,"statfs":{"total":95995035648,"available":95965782016,"internally_reserved":0,"allocated":1581056,"data_stored":1045237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.53300000000000003,"15min":0.505},"min":{"1min":0.41099999999999998,"5min":0.317,"15min":0.317},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.625,"5min":0.53500000000000003,"15min":0.498},"min":{"1min":0.45200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.48699999999999999}]},{"osd":1,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.57499999999999996,"15min":0.53300000000000003},"min":{"1min":0.42699999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.80500000000000005,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.748},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.57899999999999996,"15min":0.53300000000000003},"min":{"1min":0.51400000000000001,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.55200000000000005}]},{"osd":2,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.432,"15min":0.40000000000000002},"min":{"1min":0.35499999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61799999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.45800000000000002,"15min":0.41999999999999998},"min":{"1min":0.379,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.68999999999999995,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.55100000000000005,"15min":0.53100000000000003},"min":{"1min":0.40500000000000003,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.498,"5min":1.498,"15min":1.498},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.61399999999999999,"15min":0.58999999999999997},"min":{"1min":0.52900000000000003,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Sep 13 09:39:21 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.63100000000000001,"15min":0.58099999999999996},"min":{"1min":0.55800000000000005,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89100000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.504,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85399999999999998,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71399999999999997}]},{"osd":6,"last update":"Wed Sep 13 09:38:46 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.60799999999999998,"15min":0.60199999999999998},"min":{"1min":0.46400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68300000000000005,"15min":0.66800000000000004},"min":{"1min":0.48299999999999998,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"last":0.78100000000000003}]},{"osd":7,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73399999999999999,"15min":0.72899999999999998},"min":{"1min":0.55600000000000005,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.94399999999999995,"5min":1.044,"15min":1.044},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":0.88600000000000001,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.79200000000000004}]},{"osd":8,"last update":"Wed Sep 13 09:39:28 2023","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.65100000000000002,"15min":0.64100000000000001},"min":{"1min":0.48799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.90400000000000003,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59599999999999997,"15min":0.59399999999999997},"min":{"1min":0.46999999999999997,"5min":0.372,"15min":0.372},"max":{"1min":0.78800000000000003,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.61099999999999999}]},{"osd":9,"last update":"Wed Sep 13 09:38:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.73699999999999999,"15min":0.72399999999999998},"min":{"1min":0.57999999999999996,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"last":0.82799999999999996},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.77100000000000002,"15min":0.76100000000000001},"min":{"1min":0.53000000000000003,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.514,"5min":1.514,"15min":1.514},"last":0.80600000000000005}]},{"osd":10,"last update":"Wed Sep 13 09:39:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69699999999999995,"15min":0.69099999999999995},"min":{"1min":0.56799999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.86299999999999999,"5min":0.872,"15min":0.872},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.754,"15min":0.751},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":0.92500000000000004,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.86499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":57096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":61472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-13T09:39:37.027 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:37.028 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:36 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4294778585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:37.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 -- 172.21.15.6:0/2968189170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 msgr2=0x7ff7e01011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/2968189170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e01011d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00099c0 tx=0x7ff7d0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 -- 172.21.15.6:0/2968189170 shutdown_connections 2023-09-13T09:39:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/2968189170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e0102940 0x7ff7e01091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/2968189170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e01011d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/2968189170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e0101fa0 0x7ff7e0102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 -- 172.21.15.6:0/2968189170 >> 172.21.15.6:0/2968189170 conn(0x7ff7e00fc320 msgr2=0x7ff7e00fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 -- 172.21.15.6:0/2968189170 shutdown_connections 2023-09-13T09:39:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.185+0000 7ff7e60ff700 1 -- 172.21.15.6:0/2968189170 wait complete. 2023-09-13T09:39:37.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 Processor -- start 2023-09-13T09:39:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 -- start start 2023-09-13T09:39:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e0074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e0101fa0 0x7ff7e00730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e0102940 0x7ff7e00735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0073d80 con 0x7ff7e0100db0 2023-09-13T09:39:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e0073ef0 con 0x7ff7e0102940 2023-09-13T09:39:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7e60ff700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e01a0ae0 con 0x7ff7e0101fa0 2023-09-13T09:39:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.186+0000 7ff7df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e0074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e0074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33868/0 (socket says 172.21.15.6:33868) 2023-09-13T09:39:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 -- 172.21.15.6:0/1717081588 learned_addr learned my addr 172.21.15.6:0/1717081588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:37.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7dffff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e0102940 0x7ff7e00735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7deffd700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e0101fa0 0x7ff7e00730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 -- 172.21.15.6:0/1717081588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e0101fa0 msgr2=0x7ff7e00730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e0101fa0 0x7ff7e00730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 -- 172.21.15.6:0/1717081588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e0102940 msgr2=0x7ff7e00735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e0102940 0x7ff7e00735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 -- 172.21.15.6:0/1717081588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00095f0 con 0x7ff7e0100db0 2023-09-13T09:39:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7dffff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e0102940 0x7ff7e00735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7deffd700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e0101fa0 0x7ff7e00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7df7fe700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e0074a60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009fd0 tx=0x7ff7d000f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:37.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7dcff9700 1 -- 172.21.15.6:0/1717081588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d001d070 con 0x7ff7e0100db0 2023-09-13T09:39:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e01a0d60 con 0x7ff7e0100db0 2023-09-13T09:39:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7dcff9700 1 -- 172.21.15.6:0/1717081588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7d00054f0 con 0x7ff7e0100db0 2023-09-13T09:39:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7dcff9700 1 -- 172.21.15.6:0/1717081588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0004c40 con 0x7ff7e0100db0 2023-09-13T09:39:37.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.187+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e01a1190 con 0x7ff7e0100db0 2023-09-13T09:39:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.188+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e0107d30 con 0x7ff7e0100db0 2023-09-13T09:39:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.189+0000 7ff7dcff9700 1 -- 172.21.15.6:0/1717081588 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff7d000fc30 con 0x7ff7e0100db0 2023-09-13T09:39:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.190+0000 7ff7dcff9700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7cc0a0640 0x7ff7cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.190+0000 7ff7dcff9700 1 -- 172.21.15.6:0/1717081588 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7ff7d00ccb00 con 0x7ff7e0100db0 2023-09-13T09:39:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.190+0000 7ff7deffd700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7cc0a0640 0x7ff7cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.190+0000 7ff7deffd700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7cc0a0640 0x7ff7cc0a2b00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009be0 tx=0x7ff7c8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.194+0000 7ff7dcff9700 1 -- 172.21.15.6:0/1717081588 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff7d00cee60 con 0x7ff7e0100db0 2023-09-13T09:39:37.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:36 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4294778585' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.398+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7e002cfc0 con 0x7ff7e0100db0 2023-09-13T09:39:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.400+0000 7ff7dcff9700 1 -- 172.21.15.6:0/1717081588 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22443 (secure 0 0 0) 0x7ff7d0096650 con 0x7ff7e0100db0 2023-09-13T09:39:37.400 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:37.401 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:39:07.896691+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7cc0a0640 msgr2=0x7ff7cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7cc0a0640 0x7ff7cc0a2b00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009be0 tx=0x7ff7c8009260 comp rx=0 tx=0).stop 2023-09-13T09:39:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 msgr2=0x7ff7e0074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e0074a60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7ff7d0009fd0 tx=0x7ff7d000f740 comp rx=0 tx=0).stop 2023-09-13T09:39:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 shutdown_connections 2023-09-13T09:39:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7e0102940 0x7ff7e00735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7cc0a0640 0x7ff7cc0a2b00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7e0100db0 0x7ff7e0074a60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 --2- 172.21.15.6:0/1717081588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7e0101fa0 0x7ff7e00730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 >> 172.21.15.6:0/1717081588 conn(0x7ff7e00fc320 msgr2=0x7ff7e00fe5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 shutdown_connections 2023-09-13T09:39:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.402+0000 7ff7e60ff700 1 -- 172.21.15.6:0/1717081588 wait complete. 2023-09-13T09:39:37.415 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T09:39:37.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T09:39:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 -- 172.21.15.6:0/353926667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8101800 msgr2=0x7ffaf81080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 --2- 172.21.15.6:0/353926667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8101800 0x7ffaf81080b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000b0d0 tx=0x7ffaf000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 -- 172.21.15.6:0/353926667 shutdown_connections 2023-09-13T09:39:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 --2- 172.21.15.6:0/353926667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf8101800 0x7ffaf81080b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 --2- 172.21.15.6:0/353926667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf80ffc70 0x7ffaf8100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 --2- 172.21.15.6:0/353926667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaf8100e60 0x7ffaf81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 -- 172.21.15.6:0/353926667 >> 172.21.15.6:0/353926667 conn(0x7ffaf80fb1c0 msgr2=0x7ffaf80fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 -- 172.21.15.6:0/353926667 shutdown_connections 2023-09-13T09:39:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.544+0000 7ffafd961700 1 -- 172.21.15.6:0/353926667 wait complete. 2023-09-13T09:39:37.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 Processor -- start 2023-09-13T09:39:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 -- start start 2023-09-13T09:39:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80ffc70 0x7ffaf8196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaf8100e60 0x7ffaf81970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf8101800 0x7ffaf819e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf819e6e0 con 0x7ffaf80ffc70 2023-09-13T09:39:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf819e820 con 0x7ffaf8100e60 2023-09-13T09:39:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffafd961700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf819e9b0 con 0x7ffaf8101800 2023-09-13T09:39:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffaf6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80ffc70 0x7ffaf8196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffaf6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80ffc70 0x7ffaf8196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33882/0 (socket says 172.21.15.6:33882) 2023-09-13T09:39:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffaf6ffd700 1 -- 172.21.15.6:0/969591745 learned_addr learned my addr 172.21.15.6:0/969591745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffaf77fe700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf8101800 0x7ffaf819e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.545+0000 7ffaf67fc700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaf8100e60 0x7ffaf81970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffaf6ffd700 1 -- 172.21.15.6:0/969591745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf8101800 msgr2=0x7ffaf819e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffaf6ffd700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf8101800 0x7ffaf819e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffaf6ffd700 1 -- 172.21.15.6:0/969591745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaf8100e60 msgr2=0x7ffaf81970a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffaf6ffd700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaf8100e60 0x7ffaf81970a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffaf6ffd700 1 -- 172.21.15.6:0/969591745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf0009d00 con 0x7ffaf80ffc70 2023-09-13T09:39:37.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffaf6ffd700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80ffc70 0x7ffaf8196b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffae000d980 tx=0x7ffae000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffafc95f700 1 -- 172.21.15.6:0/969591745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0004020 con 0x7ffaf80ffc70 2023-09-13T09:39:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffafc95f700 1 -- 172.21.15.6:0/969591745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffae000f690 con 0x7ffaf80ffc70 2023-09-13T09:39:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf819ec90 con 0x7ffaf80ffc70 2023-09-13T09:39:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffafc95f700 1 -- 172.21.15.6:0/969591745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae0003a60 con 0x7ffaf80ffc70 2023-09-13T09:39:37.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.546+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf819f1a0 con 0x7ffaf80ffc70 2023-09-13T09:39:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.547+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf81071b0 con 0x7ffaf80ffc70 2023-09-13T09:39:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.548+0000 7ffafc95f700 1 -- 172.21.15.6:0/969591745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ffae000fb00 con 0x7ffaf80ffc70 2023-09-13T09:39:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.549+0000 7ffafc95f700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffae40a0640 0x7ffae40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.549+0000 7ffafc95f700 1 -- 172.21.15.6:0/969591745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7ffae00cb740 con 0x7ffaf80ffc70 2023-09-13T09:39:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.549+0000 7ffaf67fc700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffae40a0640 0x7ffae40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.549+0000 7ffaf67fc700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffae40a0640 0x7ffae40a2b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009c60 tx=0x7ffae8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:37.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.553+0000 7ffafc95f700 1 -- 172.21.15.6:0/969591745 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ffae0095260 con 0x7ffaf80ffc70 2023-09-13T09:39:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.754+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffaf802ce20 con 0x7ffaf80ffc70 2023-09-13T09:39:37.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.754+0000 7ffafc95f700 1 -- 172.21.15.6:0/969591745 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffae00b8020 con 0x7ffaf80ffc70 2023-09-13T09:39:37.755 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T09:39:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffae40a0640 msgr2=0x7ffae40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffae40a0640 0x7ffae40a2b00 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ffae8009c60 tx=0x7ffae8009260 comp rx=0 tx=0).stop 2023-09-13T09:39:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80ffc70 msgr2=0x7ffaf8196b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80ffc70 0x7ffaf8196b60 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7ffae000d980 tx=0x7ffae000dc90 comp rx=0 tx=0).stop 2023-09-13T09:39:37.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 shutdown_connections 2023-09-13T09:39:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaf8101800 0x7ffaf819e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffae40a0640 0x7ffae40a2b00 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffaf80ffc70 0x7ffaf8196b60 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 --2- 172.21.15.6:0/969591745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffaf8100e60 0x7ffaf81970a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.756+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 >> 172.21.15.6:0/969591745 conn(0x7ffaf80fb1c0 msgr2=0x7ffaf81042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:37.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.757+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 shutdown_connections 2023-09-13T09:39:37.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.757+0000 7ffafd961700 1 -- 172.21.15.6:0/969591745 wait complete. 2023-09-13T09:39:37.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T09:39:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.899+0000 7f63d2053700 1 -- 172.21.15.6:0/562297942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc0ffcc0 msgr2=0x7f63cc1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.899+0000 7f63d2053700 1 --2- 172.21.15.6:0/562297942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc0ffcc0 0x7f63cc1000e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0099c0 tx=0x7f63bc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 -- 172.21.15.6:0/562297942 shutdown_connections 2023-09-13T09:39:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 --2- 172.21.15.6:0/562297942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc101850 0x7f63cc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 --2- 172.21.15.6:0/562297942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc0ffcc0 0x7f63cc1000e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 --2- 172.21.15.6:0/562297942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc100eb0 0x7f63cc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 -- 172.21.15.6:0/562297942 >> 172.21.15.6:0/562297942 conn(0x7f63cc0fb250 msgr2=0x7f63cc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 -- 172.21.15.6:0/562297942 shutdown_connections 2023-09-13T09:39:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 -- 172.21.15.6:0/562297942 wait complete. 2023-09-13T09:39:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 Processor -- start 2023-09-13T09:39:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 -- start start 2023-09-13T09:39:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc0ffcc0 0x7f63cc068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.900+0000 7f63d2053700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc100eb0 0x7f63cc19dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63d2053700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc101850 0x7f63cc1a00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63d2053700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1a07d0 con 0x7f63cc101850 2023-09-13T09:39:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63d2053700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1a0940 con 0x7f63cc100eb0 2023-09-13T09:39:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63d2053700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1a0b00 con 0x7f63cc0ffcc0 2023-09-13T09:39:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc101850 0x7f63cc1a00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc101850 0x7f63cc1a00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33900/0 (socket says 172.21.15.6:33900) 2023-09-13T09:39:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 -- 172.21.15.6:0/3938627192 learned_addr learned my addr 172.21.15.6:0/3938627192 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cb7fe700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc0ffcc0 0x7f63cc068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63caffd700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc100eb0 0x7f63cc19dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 -- 172.21.15.6:0/3938627192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc0ffcc0 msgr2=0x7f63cc068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc0ffcc0 0x7f63cc068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 -- 172.21.15.6:0/3938627192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc100eb0 msgr2=0x7f63cc19dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc100eb0 0x7f63cc19dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 -- 172.21.15.6:0/3938627192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63bc0095f0 con 0x7f63cc101850 2023-09-13T09:39:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cb7fe700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc0ffcc0 0x7f63cc068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63cbfff700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc101850 0x7f63cc1a00f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007ee0 tx=0x7f63c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63c8ff9700 1 -- 172.21.15.6:0/3938627192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4017070 con 0x7f63cc101850 2023-09-13T09:39:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63c8ff9700 1 -- 172.21.15.6:0/3938627192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63c400f040 con 0x7f63cc101850 2023-09-13T09:39:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc1a0de0 con 0x7f63cc101850 2023-09-13T09:39:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63c8ff9700 1 -- 172.21.15.6:0/3938627192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4005740 con 0x7f63cc101850 2023-09-13T09:39:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.901+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc1a1210 con 0x7f63cc101850 2023-09-13T09:39:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.902+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63cc107280 con 0x7f63cc101850 2023-09-13T09:39:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.903+0000 7f63c8ff9700 1 -- 172.21.15.6:0/3938627192 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f63c40058a0 con 0x7f63cc101850 2023-09-13T09:39:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.904+0000 7f63c8ff9700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.904+0000 7f63c8ff9700 1 -- 172.21.15.6:0/3938627192 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f63c40cb490 con 0x7f63cc101850 2023-09-13T09:39:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.904+0000 7f63cb7fe700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.904+0000 7f63cb7fe700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00b580 tx=0x7f63bc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:37.908+0000 7f63c8ff9700 1 -- 172.21.15.6:0/3938627192 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f63c4094fb0 con 0x7f63cc101850 2023-09-13T09:39:38.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:37 smithi131 ceph-mon[102785]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2023-09-13T09:39:38.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:37 smithi131 ceph-mon[102785]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:37 smithi131 ceph-mon[102785]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:37 smithi131 ceph-mon[102785]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-09-13T09:39:38.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:37 smithi131 ceph-mon[102785]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:37 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1717081588' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:38.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:37 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/969591745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:38.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.106+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f63cc02cfc0 con 0x7f63cc101850 2023-09-13T09:39:38.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.106+0000 7f63c8ff9700 1 -- 172.21.15.6:0/3938627192 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f63c40985d0 con 0x7f63cc101850 2023-09-13T09:39:38.107 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T09:39:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 msgr2=0x7f63b40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00b580 tx=0x7f63bc005fb0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc101850 msgr2=0x7f63cc1a00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc101850 0x7f63cc1a00f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f63c4007ee0 tx=0x7f63c400d3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 shutdown_connections 2023-09-13T09:39:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc101850 0x7f63cc1a00f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc0ffcc0 0x7f63cc068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 --2- 172.21.15.6:0/3938627192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc100eb0 0x7f63cc19dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 >> 172.21.15.6:0/3938627192 conn(0x7f63cc0fb250 msgr2=0x7f63cc1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 shutdown_connections 2023-09-13T09:39:38.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.108+0000 7f63d2053700 1 -- 172.21.15.6:0/3938627192 wait complete. 2023-09-13T09:39:38.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:37 smithi006 ceph-mon[98665]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2023-09-13T09:39:38.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:37 smithi006 ceph-mon[98665]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:37 smithi006 ceph-mon[98665]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:37 smithi006 ceph-mon[98665]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-09-13T09:39:38.120 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:37 smithi006 ceph-mon[98665]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:37 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1717081588' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:38.121 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:37 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/969591745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:38.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T09:39:38.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 -- 172.21.15.6:0/975170618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c101fb0 msgr2=0x7f772c102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 --2- 172.21.15.6:0/975170618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c101fb0 0x7f772c102410 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f77280099c0 tx=0x7f7728009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 -- 172.21.15.6:0/975170618 shutdown_connections 2023-09-13T09:39:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 --2- 172.21.15.6:0/975170618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c102950 0x7f772c109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 --2- 172.21.15.6:0/975170618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c100dc0 0x7f772c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 --2- 172.21.15.6:0/975170618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c101fb0 0x7f772c102410 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 -- 172.21.15.6:0/975170618 >> 172.21.15.6:0/975170618 conn(0x7f772c0fc330 msgr2=0x7f772c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:38.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 -- 172.21.15.6:0/975170618 shutdown_connections 2023-09-13T09:39:38.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.251+0000 7f7733569700 1 -- 172.21.15.6:0/975170618 wait complete. 2023-09-13T09:39:38.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 Processor -- start 2023-09-13T09:39:38.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 -- start start 2023-09-13T09:39:38.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c100dc0 0x7f772c196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c101fb0 0x7f772c196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c102950 0x7f772c19dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c19e5b0 con 0x7f772c102950 2023-09-13T09:39:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c19e6f0 con 0x7f772c100dc0 2023-09-13T09:39:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7733569700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f772c19e880 con 0x7f772c101fb0 2023-09-13T09:39:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7731b06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c102950 0x7f772c19dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7731b06700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c102950 0x7f772c19dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33914/0 (socket says 172.21.15.6:33914) 2023-09-13T09:39:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7731b06700 1 -- 172.21.15.6:0/1069036742 learned_addr learned my addr 172.21.15.6:0/1069036742 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:38.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7730b04700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c101fb0 0x7f772c196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.252+0000 7f7731305700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c100dc0 0x7f772c196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7731b06700 1 -- 172.21.15.6:0/1069036742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c101fb0 msgr2=0x7f772c196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7731b06700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c101fb0 0x7f772c196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7731b06700 1 -- 172.21.15.6:0/1069036742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c100dc0 msgr2=0x7f772c196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7731b06700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c100dc0 0x7f772c196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7731b06700 1 -- 172.21.15.6:0/1069036742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77280095f0 con 0x7f772c102950 2023-09-13T09:39:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7731b06700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c102950 0x7f772c19dfe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f772400ef30 tx=0x7f772400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f77227fc700 1 -- 172.21.15.6:0/1069036742 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7724018070 con 0x7f772c102950 2023-09-13T09:39:38.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f77227fc700 1 -- 172.21.15.6:0/1069036742 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f772400f040 con 0x7f772c102950 2023-09-13T09:39:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f772c19eb00 con 0x7f772c102950 2023-09-13T09:39:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f77227fc700 1 -- 172.21.15.6:0/1069036742 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772400cd00 con 0x7f772c102950 2023-09-13T09:39:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.253+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f772c19efc0 con 0x7f772c102950 2023-09-13T09:39:38.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.254+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f772c10c5d0 con 0x7f772c102950 2023-09-13T09:39:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.255+0000 7f77227fc700 1 -- 172.21.15.6:0/1069036742 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7724003a00 con 0x7f772c102950 2023-09-13T09:39:38.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.256+0000 7f77227fc700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f77180a0640 0x7f77180a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:37 smithi053 ceph-mon[102373]: pgmap v301: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 767 B/s wr, 12 op/s 2023-09-13T09:39:38.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:37 smithi053 ceph-mon[102373]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:37 smithi053 ceph-mon[102373]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:37 smithi053 ceph-mon[102373]: mgrmap e18: x(active, since 7m), standbys: z, y 2023-09-13T09:39:38.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:37 smithi053 ceph-mon[102373]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-09-13T09:39:38.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:37 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1717081588' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:38.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:37 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/969591745' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T09:39:38.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.256+0000 7f7731305700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f77180a0640 0x7f77180a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.256+0000 7f77227fc700 1 -- 172.21.15.6:0/1069036742 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f77240cc160 con 0x7f772c102950 2023-09-13T09:39:38.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.256+0000 7f7731305700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f77180a0640 0x7f77180a2b00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f772c101e10 tx=0x7f771c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:38.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.259+0000 7f77227fc700 1 -- 172.21.15.6:0/1069036742 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7724095cb0 con 0x7f772c102950 2023-09-13T09:39:38.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.460+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f772c107cc0 con 0x7f772c102950 2023-09-13T09:39:38.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.461+0000 7f77227fc700 1 -- 172.21.15.6:0/1069036742 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f77240992d0 con 0x7f772c102950 2023-09-13T09:39:38.462 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T09:39:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f77180a0640 msgr2=0x7f77180a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f77180a0640 0x7f77180a2b00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f772c101e10 tx=0x7f771c009260 comp rx=0 tx=0).stop 2023-09-13T09:39:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c102950 msgr2=0x7f772c19dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c102950 0x7f772c19dfe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f772400ef30 tx=0x7f772400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 shutdown_connections 2023-09-13T09:39:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f77180a0640 0x7f77180a2b00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f772c102950 0x7f772c19dfe0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f772c100dc0 0x7f772c196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 --2- 172.21.15.6:0/1069036742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f772c101fb0 0x7f772c196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 >> 172.21.15.6:0/1069036742 conn(0x7f772c0fc330 msgr2=0x7f772c0fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 shutdown_connections 2023-09-13T09:39:38.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.463+0000 7f7733569700 1 -- 172.21.15.6:0/1069036742 wait complete. 2023-09-13T09:39:38.475 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:39:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 -- 172.21.15.6:0/1595033602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 msgr2=0x7f5438102400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 --2- 172.21.15.6:0/1595033602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438102400 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f54280099c0 tx=0x7f5428009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 -- 172.21.15.6:0/1595033602 shutdown_connections 2023-09-13T09:39:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 --2- 172.21.15.6:0/1595033602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5438102940 0x7f54381091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 --2- 172.21.15.6:0/1595033602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5438100db0 0x7f54381011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 --2- 172.21.15.6:0/1595033602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438102400 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 -- 172.21.15.6:0/1595033602 >> 172.21.15.6:0/1595033602 conn(0x7f54380fc320 msgr2=0x7f54380fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 -- 172.21.15.6:0/1595033602 shutdown_connections 2023-09-13T09:39:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.601+0000 7f543f6e6700 1 -- 172.21.15.6:0/1595033602 wait complete. 2023-09-13T09:39:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 Processor -- start 2023-09-13T09:39:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 -- start start 2023-09-13T09:39:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5438100db0 0x7f5438196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5438102940 0x7f543819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543819e5e0 con 0x7f5438101fa0 2023-09-13T09:39:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543819e720 con 0x7f5438102940 2023-09-13T09:39:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543f6e6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f543819e8b0 con 0x7f5438100db0 2023-09-13T09:39:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33926/0 (socket says 172.21.15.6:33926) 2023-09-13T09:39:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 -- 172.21.15.6:0/515189394 learned_addr learned my addr 172.21.15.6:0/515189394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543d482700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5438100db0 0x7f5438196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543dc83700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5438102940 0x7f543819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 -- 172.21.15.6:0/515189394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5438100db0 msgr2=0x7f5438196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5438100db0 0x7f5438196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 -- 172.21.15.6:0/515189394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5438102940 msgr2=0x7f543819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5438102940 0x7f543819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543cc81700 1 -- 172.21.15.6:0/515189394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54280095f0 con 0x7f5438101fa0 2023-09-13T09:39:38.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.602+0000 7f543dc83700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5438102940 0x7f543819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:38.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.603+0000 7f543cc81700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438196fa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5428009990 tx=0x7f5428005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:38.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.603+0000 7f542e7fc700 1 -- 172.21.15.6:0/515189394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f542801d070 con 0x7f5438101fa0 2023-09-13T09:39:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.603+0000 7f542e7fc700 1 -- 172.21.15.6:0/515189394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5428022470 con 0x7f5438101fa0 2023-09-13T09:39:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.603+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f543819eb30 con 0x7f5438101fa0 2023-09-13T09:39:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.603+0000 7f542e7fc700 1 -- 172.21.15.6:0/515189394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5428004230 con 0x7f5438101fa0 2023-09-13T09:39:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.603+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f543819f030 con 0x7f5438101fa0 2023-09-13T09:39:38.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.604+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5438107d30 con 0x7f5438101fa0 2023-09-13T09:39:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.606+0000 7f542e7fc700 1 -- 172.21.15.6:0/515189394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f54280225e0 con 0x7f5438101fa0 2023-09-13T09:39:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.606+0000 7f542e7fc700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f54240a06c0 0x7f54240a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.606+0000 7f543d482700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f54240a06c0 0x7f54240a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.606+0000 7f542e7fc700 1 -- 172.21.15.6:0/515189394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f54280cd130 con 0x7f5438101fa0 2023-09-13T09:39:38.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.607+0000 7f543d482700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f54240a06c0 0x7f54240a2b80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5434005950 tx=0x7f54340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:38.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.610+0000 7f542e7fc700 1 -- 172.21.15.6:0/515189394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f5428096d60 con 0x7f5438101fa0 2023-09-13T09:39:38.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.861+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f543810c810 con 0x7f5438101fa0 2023-09-13T09:39:38.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.861+0000 7f542e7fc700 1 -- 172.21.15.6:0/515189394 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f542809a380 con 0x7f5438101fa0 2023-09-13T09:39:38.862 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:38.862 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:38:16.673454+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:39:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.863+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f54240a06c0 msgr2=0x7f54240a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f54240a06c0 0x7f54240a2b80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5434005950 tx=0x7f54340058e0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 msgr2=0x7f5438196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:38.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438196fa0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f5428009990 tx=0x7f5428005e80 comp rx=0 tx=0).stop 2023-09-13T09:39:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 shutdown_connections 2023-09-13T09:39:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5438102940 0x7f543819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5438100db0 0x7f5438196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f54240a06c0 0x7f54240a2b80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 --2- 172.21.15.6:0/515189394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5438101fa0 0x7f5438196fa0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 >> 172.21.15.6:0/515189394 conn(0x7f54380fc320 msgr2=0x7f54380fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 shutdown_connections 2023-09-13T09:39:38.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:38.864+0000 7f543f6e6700 1 -- 172.21.15.6:0/515189394 wait complete. 2023-09-13T09:39:38.867 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2023-09-13T09:39:38.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T09:39:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 -- 172.21.15.6:0/478407147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c100e90 msgr2=0x7f1e1c1012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/478407147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c100e90 0x7f1e1c1012f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1e080099c0 tx=0x7f1e08009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 -- 172.21.15.6:0/478407147 shutdown_connections 2023-09-13T09:39:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/478407147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c101830 0x7f1e1c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/478407147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e1c0ffca0 0x7f1e1c1000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/478407147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c100e90 0x7f1e1c1012f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 -- 172.21.15.6:0/478407147 >> 172.21.15.6:0/478407147 conn(0x7f1e1c0fb250 msgr2=0x7f1e1c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 -- 172.21.15.6:0/478407147 shutdown_connections 2023-09-13T09:39:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.002+0000 7f1e22ef7700 1 -- 172.21.15.6:0/478407147 wait complete. 2023-09-13T09:39:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 Processor -- start 2023-09-13T09:39:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 -- start start 2023-09-13T09:39:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e1c0ffca0 0x7f1e1c194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c100e90 0x7f1e1c194d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c101830 0x7f1e1c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c19c3b0 con 0x7f1e1c101830 2023-09-13T09:39:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c19c4f0 con 0x7f1e1c100e90 2023-09-13T09:39:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e22ef7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c19c680 con 0x7f1e1c0ffca0 2023-09-13T09:39:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c101830 0x7f1e1c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c101830 0x7f1e1c19bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33942/0 (socket says 172.21.15.6:33942) 2023-09-13T09:39:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 -- 172.21.15.6:0/3540972319 learned_addr learned my addr 172.21.15.6:0/3540972319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e1bfff700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c100e90 0x7f1e1c194d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e20c93700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e1c0ffca0 0x7f1e1c194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 -- 172.21.15.6:0/3540972319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e1c0ffca0 msgr2=0x7f1e1c194830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e1c0ffca0 0x7f1e1c194830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 -- 172.21.15.6:0/3540972319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c100e90 msgr2=0x7f1e1c194d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c100e90 0x7f1e1c194d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.003+0000 7f1e21494700 1 -- 172.21.15.6:0/3540972319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e080095f0 con 0x7f1e1c101830 2023-09-13T09:39:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.004+0000 7f1e21494700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c101830 0x7f1e1c19bde0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400ef30 tx=0x7f1e1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.004+0000 7f1e19ffb700 1 -- 172.21.15.6:0/3540972319 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e14018070 con 0x7f1e1c101830 2023-09-13T09:39:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.004+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c19c900 con 0x7f1e1c101830 2023-09-13T09:39:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.004+0000 7f1e19ffb700 1 -- 172.21.15.6:0/3540972319 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1e1400f040 con 0x7f1e1c101830 2023-09-13T09:39:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.004+0000 7f1e19ffb700 1 -- 172.21.15.6:0/3540972319 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e1400cdb0 con 0x7f1e1c101830 2023-09-13T09:39:39.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.004+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c19ce10 con 0x7f1e1c101830 2023-09-13T09:39:39.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.005+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c106bd0 con 0x7f1e1c101830 2023-09-13T09:39:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.006+0000 7f1e19ffb700 1 -- 172.21.15.6:0/3540972319 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1e14003a00 con 0x7f1e1c101830 2023-09-13T09:39:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.006+0000 7f1e19ffb700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1e0c0a2850 0x7f1e0c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.006+0000 7f1e19ffb700 1 -- 172.21.15.6:0/3540972319 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f1e140cb810 con 0x7f1e1c101830 2023-09-13T09:39:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.007+0000 7f1e20c93700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1e0c0a2850 0x7f1e0c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.007+0000 7f1e20c93700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1e0c0a2850 0x7f1e0c0a4d10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1e10005950 tx=0x7f1e100058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.011+0000 7f1e19ffb700 1 -- 172.21.15.6:0/3540972319 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1e140953c0 con 0x7f1e1c101830 2023-09-13T09:39:39.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:38 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3938627192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:39.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:38 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1069036742' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:39.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.213+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e1c10a5f0 con 0x7f1e1c101830 2023-09-13T09:39:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.215+0000 7f1e19ffb700 1 -- 172.21.15.6:0/3540972319 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+22443 (secure 0 0 0) 0x7f1e140989e0 con 0x7f1e1c101830 2023-09-13T09:39:39.215 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:39:39.216 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":86,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:39:07.896691+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T09:39:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1e0c0a2850 msgr2=0x7f1e0c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1e0c0a2850 0x7f1e0c0a4d10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f1e10005950 tx=0x7f1e100058e0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c101830 msgr2=0x7f1e1c19bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c101830 0x7f1e1c19bde0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1e1400ef30 tx=0x7f1e1400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 shutdown_connections 2023-09-13T09:39:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1e0c0a2850 0x7f1e0c0a4d10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1e1c101830 0x7f1e1c19bde0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e1c0ffca0 0x7f1e1c194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 --2- 172.21.15.6:0/3540972319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1e1c100e90 0x7f1e1c194d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 >> 172.21.15.6:0/3540972319 conn(0x7f1e1c0fb250 msgr2=0x7f1e1c0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 shutdown_connections 2023-09-13T09:39:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.217+0000 7f1e22ef7700 1 -- 172.21.15.6:0/3540972319 wait complete. 2023-09-13T09:39:39.228 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:38 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3938627192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:39.229 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:38 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1069036742' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:39.230 DEBUG:tasks.fwd_scrub:Yielding 2023-09-13T09:39:39.231 INFO:teuthology.run_tasks:Running task workunit... 2023-09-13T09:39:39.244 INFO:tasks.workunit:Pulling workunits from ref 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:39:39.245 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-09-13T09:39:39.245 INFO:tasks.workunit:timeout=3h 2023-09-13T09:39:39.245 INFO:tasks.workunit:cleanup=True 2023-09-13T09:39:39.246 DEBUG:teuthology.orchestra.run.smithi006:> stat -- /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:39.247 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-09-13T09:39:39.247 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:39:39.247 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:39:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:38 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3938627192' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T09:39:39.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:38 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1069036742' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T09:39:39.266 INFO:teuthology.orchestra.run.smithi006.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:39.266 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2023-09-13T09:39:39.266 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 7ch/124d Inode: 1099511628283 Links: 2 2023-09-13T09:39:39.266 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-13T09:39:39.267 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:cephfs_t:s0 2023-09-13T09:39:39.267 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2023-09-13 09:38:16.024786641 +0000 2023-09-13T09:39:39.267 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2023-09-13 09:38:16.024786641 +0000 2023-09-13T09:39:39.267 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2023-09-13 09:39:32.180524841 +0000 2023-09-13T09:39:39.267 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: 2023-09-13 09:38:16.024786641 +0000 2023-09-13T09:39:39.268 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-09-13T09:39:39.269 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-09-13T09:39:39.367 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 2023-09-13T09:39:39.384 INFO:tasks.workunit.client.0.smithi006.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-09-13T09:39:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 -- 172.21.15.6:0/775552383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520108cb0 msgr2=0x7fe52010b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 --2- 172.21.15.6:0/775552383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520108cb0 0x7fe52010b140 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fe51800b0a0 tx=0x7fe51800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 -- 172.21.15.6:0/775552383 shutdown_connections 2023-09-13T09:39:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 --2- 172.21.15.6:0/775552383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520108cb0 0x7fe52010b140 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 --2- 172.21.15.6:0/775552383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe520074c70 0x7fe5200730c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 --2- 172.21.15.6:0/775552383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe520073690 0x7fe520073b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 -- 172.21.15.6:0/775552383 >> 172.21.15.6:0/775552383 conn(0x7fe5200fc330 msgr2=0x7fe5200fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 -- 172.21.15.6:0/775552383 shutdown_connections 2023-09-13T09:39:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.390+0000 7fe5261eb700 1 -- 172.21.15.6:0/775552383 wait complete. 2023-09-13T09:39:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 Processor -- start 2023-09-13T09:39:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 -- start start 2023-09-13T09:39:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520073690 0x7fe520198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe520074c70 0x7fe520199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe520108cb0 0x7fe5201a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201a0880 con 0x7fe520073690 2023-09-13T09:39:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201a09f0 con 0x7fe520108cb0 2023-09-13T09:39:39.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe5261eb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5201a0bb0 con 0x7fe520074c70 2023-09-13T09:39:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520073690 0x7fe520198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520073690 0x7fe520198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33954/0 (socket says 172.21.15.6:33954) 2023-09-13T09:39:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.391+0000 7fe51f7fe700 1 -- 172.21.15.6:0/3082482814 learned_addr learned my addr 172.21.15.6:0/3082482814 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51ffff700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe520108cb0 0x7fe5201a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51effd700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe520074c70 0x7fe520199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51f7fe700 1 -- 172.21.15.6:0/3082482814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe520074c70 msgr2=0x7fe520199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe520074c70 0x7fe520199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51f7fe700 1 -- 172.21.15.6:0/3082482814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe520108cb0 msgr2=0x7fe5201a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe520108cb0 0x7fe5201a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51f7fe700 1 -- 172.21.15.6:0/3082482814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe518009d00 con 0x7fe520073690 2023-09-13T09:39:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520073690 0x7fe520198d40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe51000e9a0 tx=0x7fe51000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51cff9700 1 -- 172.21.15.6:0/3082482814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510009790 con 0x7fe520073690 2023-09-13T09:39:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5201a0e90 con 0x7fe520073690 2023-09-13T09:39:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51cff9700 1 -- 172.21.15.6:0/3082482814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe51000cbd0 con 0x7fe520073690 2023-09-13T09:39:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe51cff9700 1 -- 172.21.15.6:0/3082482814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe510018680 con 0x7fe520073690 2023-09-13T09:39:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.392+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5201a12c0 con 0x7fe520073690 2023-09-13T09:39:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.394+0000 7fe51cff9700 1 -- 172.21.15.6:0/3082482814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe51000cd40 con 0x7fe520073690 2023-09-13T09:39:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.395+0000 7fe51cff9700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5080a0640 0x7fe5080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.395+0000 7fe51cff9700 1 -- 172.21.15.6:0/3082482814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fe510014070 con 0x7fe520073690 2023-09-13T09:39:39.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.395+0000 7fe51effd700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5080a0640 0x7fe5080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe51effd700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5080a0640 0x7fe5080a2b00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe514009bf0 tx=0x7fe514009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 Processor -- start 2023-09-13T09:39:39.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 -- start start 2023-09-13T09:39:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a0fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a0e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a0ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97967800 con 0x55fb97a0ea80 2023-09-13T09:39:39.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97965120 con 0x55fb97a100e0 2023-09-13T09:39:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97960a10 con 0x55fb97a0f780 2023-09-13T09:39:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a0ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a0ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33968/0 (socket says 172.21.15.6:33968) 2023-09-13T09:39:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe51effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe51ffff700 1 -- 172.21.15.6:0/2791051082 learned_addr learned my addr 172.21.15.6:0/2791051082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.396+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a0fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe51ffff700 1 -- 172.21.15.6:0/2791051082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 msgr2=0x55fb97a0fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe51ffff700 1 --2- 172.21.15.6:0/2791051082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a0fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe51ffff700 1 -- 172.21.15.6:0/2791051082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 msgr2=0x55fb97a0e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe51ffff700 1 --2- 172.21.15.6:0/2791051082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a0e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe51ffff700 1 -- 172.21.15.6:0/2791051082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb977e06b0 con 0x55fb97a0ea80 2023-09-13T09:39:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe51ffff700 1 --2- 172.21.15.6:0/2791051082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a0ef00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe518009c40 tx=0x7fe518009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef9b3bd3b284eb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe505ffb700 1 -- 172.21.15.6:0/2791051082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800e040 con 0x55fb97a0ea80 2023-09-13T09:39:39.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe505ffb700 1 -- 172.21.15.6:0/2791051082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe51800bab0 con 0x55fb97a0ea80 2023-09-13T09:39:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.397+0000 7fe505ffb700 1 -- 172.21.15.6:0/2791051082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51801c6a0 con 0x55fb97a0ea80 2023-09-13T09:39:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 -- 172.21.15.6:0/2791051082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 msgr2=0x55fb97a0ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/2791051082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a0ef00 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe518009c40 tx=0x7fe518009c70 comp rx=0 tx=0).stop 2023-09-13T09:39:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 -- 172.21.15.6:0/2791051082 shutdown_connections 2023-09-13T09:39:39.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/2791051082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a0ef00 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/2791051082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a0fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/2791051082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a0e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 -- 172.21.15.6:0/2791051082 >> 172.21.15.6:0/2791051082 conn(0x55fb9796cd00 msgr2=0x55fb97a08f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 -- 172.21.15.6:0/2791051082 shutdown_connections 2023-09-13T09:39:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 -- 172.21.15.6:0/2791051082 wait complete. 2023-09-13T09:39:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 -- start start 2023-09-13T09:39:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.398+0000 7fe5323d0b80 1 Processor -- start 2023-09-13T09:39:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a17f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a0f780 0x55fb97a18480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a100e0 0x55fb97a1f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb978fec30 con 0x55fb97a100e0 2023-09-13T09:39:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb978fe930 con 0x55fb97a0f780 2023-09-13T09:39:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb977e29a0 con 0x55fb97a0ea80 2023-09-13T09:39:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe5323d0b80 10 client.0 _ll_register_callbacks cb 0x55fb978fc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a100e0 0x55fb97a1f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a100e0 0x55fb97a1f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33974/0 (socket says 172.21.15.6:33974) 2023-09-13T09:39:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 -- 172.21.15.6:0/3743764661 learned_addr learned my addr 172.21.15.6:0/3743764661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a17f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51effd700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a0f780 0x55fb97a18480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 -- 172.21.15.6:0/3743764661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 msgr2=0x55fb97a17f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a17f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 -- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a0f780 msgr2=0x55fb97a18480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a0f780 0x55fb97a18480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 -- 172.21.15.6:0/3743764661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52010bd30 con 0x55fb97a100e0 2023-09-13T09:39:39.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51effd700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a0f780 0x55fb97a18480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:39.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe51ffff700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a100e0 0x55fb97a1f4c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe518003fa0 tx=0x7fe518003bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db608060cb9a308e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.399+0000 7fe4feffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:39.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe4feffd700 1 -- 172.21.15.6:0/3743764661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51800e040 con 0x55fb97a100e0 2023-09-13T09:39:39.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe4feffd700 1 -- 172.21.15.6:0/3743764661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fe518005270 con 0x55fb97a100e0 2023-09-13T09:39:39.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fb97a016f0 con 0x55fb97a100e0 2023-09-13T09:39:39.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe4feffd700 1 -- 172.21.15.6:0/3743764661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe518005430 con 0x55fb97a100e0 2023-09-13T09:39:39.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 10 client.15462 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:39.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fb97978820 con 0x55fb97a100e0 2023-09-13T09:39:39.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe4feffd700 1 -- 172.21.15.6:0/3743764661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fb97a016f0 con 0x55fb97a100e0 2023-09-13T09:39:39.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe4feffd700 1 -- 172.21.15.6:0/3743764661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe518019030 con 0x55fb97a100e0 2023-09-13T09:39:39.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 10 client.15462 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:39.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 10 client.15462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:39:39.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 20 client.15462 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:39.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a238e0 0x55fb97a25d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 4 client.15462 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:39.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fb979599f0 con 0x55fb97a238e0 2023-09-13T09:39:39.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.400+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a238e0 0x55fb97a25d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.401+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a238e0 0x55fb97a25d00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=974b0a822213f64f server_cookie=1dbe678d080775eb in_seq=0 out_seq=0 2023-09-13T09:39:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.401+0000 7fe4feffd700 10 client.15462 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe4feffd700 1 -- 172.21.15.6:0/3743764661 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fb979599f0 con 0x55fb97a238e0 2023-09-13T09:39:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe4feffd700 10 client.15462 handle_command_reply: tid=0 2023-09-13T09:39:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 client.15462 shutdown 2023-09-13T09:39:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a100e0 msgr2=0x55fb97a1f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a100e0 0x55fb97a1f4c0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe518003fa0 tx=0x7fe518003bc0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 shutdown_connections 2023-09-13T09:39:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a238e0 0x55fb97a25d00 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a100e0 0x55fb97a1f4c0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe4feffd700 0 client.15462 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a17f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3743764661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a0f780 0x55fb97a18480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 >> 172.21.15.6:0/3743764661 conn(0x55fb9796cd00 msgr2=0x55fb97a08f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 shutdown_connections 2023-09-13T09:39:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3743764661 wait complete. 2023-09-13T09:39:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.402+0000 7fe5323d0b80 20 client.15462 trim_cache size 0 max 16384 2023-09-13T09:39:39.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 Processor -- start 2023-09-13T09:39:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 -- start start 2023-09-13T09:39:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a0e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0f780 0x55fb97a1f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a02960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97a059a0 con 0x55fb97a0f780 2023-09-13T09:39:39.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97a0a7b0 con 0x55fb97a100e0 2023-09-13T09:39:39.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97a16530 con 0x55fb97a0ea80 2023-09-13T09:39:39.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe51effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0f780 0x55fb97a1f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe51effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0f780 0x55fb97a1f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33978/0 (socket says 172.21.15.6:33978) 2023-09-13T09:39:39.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe51effd700 1 -- 172.21.15.6:0/3501404185 learned_addr learned my addr 172.21.15.6:0/3501404185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.419+0000 7fe51ffff700 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a02960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a0e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe51effd700 1 -- 172.21.15.6:0/3501404185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 msgr2=0x55fb97a0e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe51effd700 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a0e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe51effd700 1 -- 172.21.15.6:0/3501404185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 msgr2=0x55fb97a02960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe51effd700 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a02960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe51effd700 1 -- 172.21.15.6:0/3501404185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb9778ce60 con 0x55fb97a0f780 2023-09-13T09:39:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe51effd700 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0f780 0x55fb97a1f3e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe514011f10 tx=0x7fe514014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c24e32d02eb171f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe5067fc700 1 -- 172.21.15.6:0/3501404185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5140119e0 con 0x55fb97a0f780 2023-09-13T09:39:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe5067fc700 1 -- 172.21.15.6:0/3501404185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe514016070 con 0x55fb97a0f780 2023-09-13T09:39:39.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.420+0000 7fe5067fc700 1 -- 172.21.15.6:0/3501404185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51401f710 con 0x55fb97a0f780 2023-09-13T09:39:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3501404185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0f780 msgr2=0x55fb97a1f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0f780 0x55fb97a1f3e0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fe514011f10 tx=0x7fe514014000 comp rx=0 tx=0).stop 2023-09-13T09:39:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3501404185 shutdown_connections 2023-09-13T09:39:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a02960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0ea80 0x55fb97a0e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/3501404185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0f780 0x55fb97a1f3e0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3501404185 >> 172.21.15.6:0/3501404185 conn(0x55fb9796cd00 msgr2=0x55fb97a17f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3501404185 shutdown_connections 2023-09-13T09:39:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 -- 172.21.15.6:0/3501404185 wait complete. 2023-09-13T09:39:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 -- start start 2023-09-13T09:39:39.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.421+0000 7fe5323d0b80 1 Processor -- start 2023-09-13T09:39:39.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a1c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a1cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a1dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97a1e180 con 0x55fb97a0ea80 2023-09-13T09:39:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97a1e2f0 con 0x55fb97a100e0 2023-09-13T09:39:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb97a1e4b0 con 0x55fb97a0f780 2023-09-13T09:39:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a1c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 10 client.0 _ll_register_callbacks cb 0x55fb978fc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a1c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:33984/0 (socket says 172.21.15.6:33984) 2023-09-13T09:39:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 -- 172.21.15.6:0/1234349832 learned_addr learned my addr 172.21.15.6:0/1234349832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51ffff700 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a1dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51effd700 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a1cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 -- 172.21.15.6:0/1234349832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 msgr2=0x55fb97a1cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a1cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 -- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 msgr2=0x55fb97a1dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a1dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 -- 172.21.15.6:0/1234349832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe514011b40 con 0x55fb97a0ea80 2023-09-13T09:39:39.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe51f7fe700 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a1c6f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe5100c9c60 tx=0x7fe5100cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13d76bb5786358f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe4feffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe4feffd700 1 -- 172.21.15.6:0/1234349832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5100a1650 con 0x55fb97a0ea80 2023-09-13T09:39:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe4feffd700 1 -- 172.21.15.6:0/1234349832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7fe510097980 con 0x55fb97a0ea80 2023-09-13T09:39:39.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.422+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe51800bab0 con 0x55fb97a0ea80 2023-09-13T09:39:39.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe4feffd700 1 -- 172.21.15.6:0/1234349832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5100b1be0 con 0x55fb97a0ea80 2023-09-13T09:39:39.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 10 client.15468 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:39.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55fb97775ce0 con 0x55fb97a0ea80 2023-09-13T09:39:39.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe4feffd700 1 -- 172.21.15.6:0/1234349832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe51800bab0 con 0x55fb97a0ea80 2023-09-13T09:39:39.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe4feffd700 1 -- 172.21.15.6:0/1234349832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe5100998d0 con 0x55fb97a0ea80 2023-09-13T09:39:39.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:39.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:39:39.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 20 client.15468 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:39.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a79c90 0x55fb97a7c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 4 client.15468 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:39:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fb9791a0d0 con 0x55fb97a79c90 2023-09-13T09:39:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.423+0000 7fe51effd700 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a79c90 0x55fb97a7c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.424+0000 7fe4feffd700 10 client.15468 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.424+0000 7fe51effd700 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a79c90 0x55fb97a7c0b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=123859c81a3ba027 server_cookie=5098d4fb812b9c78 in_seq=0 out_seq=0 2023-09-13T09:39:39.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.425+0000 7fe4feffd700 1 -- 172.21.15.6:0/1234349832 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fb9791a0d0 con 0x55fb97a79c90 2023-09-13T09:39:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.425+0000 7fe4feffd700 10 client.15468 handle_command_reply: tid=0 2023-09-13T09:39:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.425+0000 7fe5323d0b80 1 client.15468 shutdown 2023-09-13T09:39:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.425+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 msgr2=0x55fb97a1c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.425+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a1c6f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fe5100c9c60 tx=0x7fe5100cb040 comp rx=0 tx=0).stop 2023-09-13T09:39:39.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 shutdown_connections 2023-09-13T09:39:39.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fb97a100e0 0x55fb97a1dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fb97a79c90 0x55fb97a7c0b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fb97a0ea80 0x55fb97a1c6f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 --2- 172.21.15.6:0/1234349832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fb97a0f780 0x55fb97a1cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe4feffd700 0 client.15468 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 >> 172.21.15.6:0/1234349832 conn(0x55fb9796cd00 msgr2=0x55fb97a0d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 shutdown_connections 2023-09-13T09:39:39.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 1 -- 172.21.15.6:0/1234349832 wait complete. 2023-09-13T09:39:39.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5323d0b80 20 client.15468 trim_cache size 0 max 16384 2023-09-13T09:39:39.452 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:39.452 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:39:39.452 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "e2100a67-013a-4634-8204-e18f1ead511c", 2023-09-13T09:39:39.452 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:39:39.453 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:39.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5080a0640 msgr2=0x7fe5080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5080a0640 0x7fe5080a2b00 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe514009bf0 tx=0x7fe514009260 comp rx=0 tx=0).stop 2023-09-13T09:39:39.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520073690 msgr2=0x7fe520198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520073690 0x7fe520198d40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fe51000e9a0 tx=0x7fe51000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 shutdown_connections 2023-09-13T09:39:39.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe520108cb0 0x7fe5201a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5080a0640 0x7fe5080a2b00 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe520073690 0x7fe520198d40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 --2- 172.21.15.6:0/3082482814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe520074c70 0x7fe520199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 >> 172.21.15.6:0/3082482814 conn(0x7fe5200fc330 msgr2=0x7fe520104c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 shutdown_connections 2023-09-13T09:39:39.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.426+0000 7fe5261eb700 1 -- 172.21.15.6:0/3082482814 wait complete. 2023-09-13T09:39:39.457 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:39:39.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 -- 172.21.15.6:0/3652311995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c40ffa70 msgr2=0x7f76c40ffe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 --2- 172.21.15.6:0/3652311995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c40ffa70 0x7f76c40ffe90 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f76b40099c0 tx=0x7f76b4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 -- 172.21.15.6:0/3652311995 shutdown_connections 2023-09-13T09:39:39.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 --2- 172.21.15.6:0/3652311995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76c4101600 0x7f76c4107eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 --2- 172.21.15.6:0/3652311995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c40ffa70 0x7f76c40ffe90 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 --2- 172.21.15.6:0/3652311995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c4100c60 0x7f76c41010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 -- 172.21.15.6:0/3652311995 >> 172.21.15.6:0/3652311995 conn(0x7f76c40fafc0 msgr2=0x7f76c40fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 -- 172.21.15.6:0/3652311995 shutdown_connections 2023-09-13T09:39:39.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.631+0000 7f76c9201700 1 -- 172.21.15.6:0/3652311995 wait complete. 2023-09-13T09:39:39.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 Processor -- start 2023-09-13T09:39:39.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 -- start start 2023-09-13T09:39:39.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c40ffa70 0x7f76c4195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76c4100c60 0x7f76c4195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c4101600 0x7f76c419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419d2e0 con 0x7f76c4101600 2023-09-13T09:39:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419d420 con 0x7f76c4100c60 2023-09-13T09:39:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c9201700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c419d5b0 con 0x7f76c40ffa70 2023-09-13T09:39:39.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c4101600 0x7f76c419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c4101600 0x7f76c419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34002/0 (socket says 172.21.15.6:34002) 2023-09-13T09:39:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76ba59c700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76c4100c60 0x7f76c4195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c359e700 1 -- 172.21.15.6:0/917192510 learned_addr learned my addr 172.21.15.6:0/917192510 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.632+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c40ffa70 0x7f76c4195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c359e700 1 -- 172.21.15.6:0/917192510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c40ffa70 msgr2=0x7f76c4195760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c359e700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c40ffa70 0x7f76c4195760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c359e700 1 -- 172.21.15.6:0/917192510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76c4100c60 msgr2=0x7f76c4195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c359e700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76c4100c60 0x7f76c4195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c359e700 1 -- 172.21.15.6:0/917192510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b40095f0 con 0x7f76c4101600 2023-09-13T09:39:39.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76ba59c700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76c4100c60 0x7f76c4195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:39:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c359e700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c4101600 0x7f76c419cd10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00ef30 tx=0x7f76bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c0d99700 1 -- 172.21.15.6:0/917192510 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc018070 con 0x7f76c4101600 2023-09-13T09:39:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c419d830 con 0x7f76c4101600 2023-09-13T09:39:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c0d99700 1 -- 172.21.15.6:0/917192510 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76bc00f040 con 0x7f76c4101600 2023-09-13T09:39:39.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c0d99700 1 -- 172.21.15.6:0/917192510 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc00cd00 con 0x7f76c4101600 2023-09-13T09:39:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.633+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c419dd40 con 0x7f76c4101600 2023-09-13T09:39:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.635+0000 7f76c0d99700 1 -- 172.21.15.6:0/917192510 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f76bc003a00 con 0x7f76c4101600 2023-09-13T09:39:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.636+0000 7f76c0d99700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76b00a0640 0x7f76b00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.636+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76b00a0640 0x7f76b00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.636+0000 7f76c0d99700 1 -- 172.21.15.6:0/917192510 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f76bc0cb710 con 0x7f76c4101600 2023-09-13T09:39:39.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.636+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76b00a0640 0x7f76b00a2b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009990 tx=0x7f76b4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.636+0000 7f76d53e6b80 1 Processor -- start 2023-09-13T09:39:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76d53e6b80 1 -- start start 2023-09-13T09:39:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2e740 0x559adfc2eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 0x559adfc2f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc30010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfb87780 con 0x559adfc2fb60 2023-09-13T09:39:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfb850a0 con 0x559adfc2e740 2023-09-13T09:39:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfb80990 con 0x559adfc2f0a0 2023-09-13T09:39:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc30010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc30010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34010/0 (socket says 172.21.15.6:34010) 2023-09-13T09:39:39.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 -- 172.21.15.6:0/2908433405 learned_addr learned my addr 172.21.15.6:0/2908433405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2e740 0x559adfc2eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 -- 172.21.15.6:0/2908433405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 msgr2=0x559adfc2f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 0x559adfc2f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 -- 172.21.15.6:0/2908433405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2e740 msgr2=0x559adfc2eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2e740 0x559adfc2eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 -- 172.21.15.6:0/2908433405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559adfa00630 con 0x559adfc2fb60 2023-09-13T09:39:39.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2e740 0x559adfc2eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:39.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.637+0000 7f76c359e700 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc30010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0a0a30 tx=0x7f76bc098e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91f8129223387579 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76b959a700 1 -- 172.21.15.6:0/2908433405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc01b320 con 0x559adfc2fb60 2023-09-13T09:39:39.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76b959a700 1 -- 172.21.15.6:0/2908433405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76bc0b8030 con 0x559adfc2fb60 2023-09-13T09:39:39.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76b959a700 1 -- 172.21.15.6:0/2908433405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0b1210 con 0x559adfc2fb60 2023-09-13T09:39:39.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2908433405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 msgr2=0x559adfc30010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc30010 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0a0a30 tx=0x7f76bc098e80 comp rx=0 tx=0).stop 2023-09-13T09:39:39.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2908433405 shutdown_connections 2023-09-13T09:39:39.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc30010 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2e740 0x559adfc2eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2908433405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 0x559adfc2f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2908433405 >> 172.21.15.6:0/2908433405 conn(0x559adfb8cc80 msgr2=0x559adfc290e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2908433405 shutdown_connections 2023-09-13T09:39:39.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.638+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2908433405 wait complete. 2023-09-13T09:39:39.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 -- start start 2023-09-13T09:39:39.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 Processor -- start 2023-09-13T09:39:39.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc38080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2f0a0 0x559adfc385c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfb1ebb0 con 0x559adfc2f0a0 2023-09-13T09:39:39.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfb1e8b0 con 0x559adfc2fb60 2023-09-13T09:39:39.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfa02920 con 0x559adfc2e740 2023-09-13T09:39:39.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76d53e6b80 10 client.0 _ll_register_callbacks cb 0x559adfb1c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:39.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2f0a0 0x559adfc385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2f0a0 0x559adfc385c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34014/0 (socket says 172.21.15.6:34014) 2023-09-13T09:39:39.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 -- 172.21.15.6:0/3867632218 learned_addr learned my addr 172.21.15.6:0/3867632218 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76c359e700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc38080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 -- 172.21.15.6:0/3867632218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 msgr2=0x559adfc38080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc38080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 -- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 msgr2=0x559adfc3f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.639+0000 7f76ba59c700 1 -- 172.21.15.6:0/3867632218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c419dd40 con 0x559adfc2f0a0 2023-09-13T09:39:39.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76c359e700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:39:39.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76ba59c700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2f0a0 0x559adfc385c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0106f0 tx=0x7f76ac010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acc9bc7f2dcbcf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:39.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76aa7fc700 1 -- 172.21.15.6:0/3867632218 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac011970 con 0x559adfc2f0a0 2023-09-13T09:39:39.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76aa7fc700 1 -- 172.21.15.6:0/3867632218 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f76ac017070 con 0x559adfc2f0a0 2023-09-13T09:39:39.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559adfc21670 con 0x559adfc2f0a0 2023-09-13T09:39:39.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76aa7fc700 1 -- 172.21.15.6:0/3867632218 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76ac011ad0 con 0x559adfc2f0a0 2023-09-13T09:39:39.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 10 client.15480 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:39.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559adfb987a0 con 0x559adfc2f0a0 2023-09-13T09:39:39.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76aa7fc700 1 -- 172.21.15.6:0/3867632218 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559adfc21670 con 0x559adfc2f0a0 2023-09-13T09:39:39.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76aa7fc700 1 -- 172.21.15.6:0/3867632218 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76ac0051e0 con 0x559adfc2f0a0 2023-09-13T09:39:39.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 10 client.15480 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:39.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 10 client.15480 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:39:39.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 20 client.15480 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:39.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc43ef0 0x559adfc46310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 4 client.15480 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:39:39.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.640+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559adfb79970 con 0x559adfc43ef0 2023-09-13T09:39:39.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.641+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc43ef0 0x559adfc46310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.641+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc43ef0 0x559adfc46310 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14890bf090b9dbbc server_cookie=cec3a3efe17497f4 in_seq=0 out_seq=0 2023-09-13T09:39:39.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.641+0000 7f76aa7fc700 10 client.15480 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76aa7fc700 1 -- 172.21.15.6:0/3867632218 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559adfb79970 con 0x559adfc43ef0 2023-09-13T09:39:39.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76aa7fc700 10 client.15480 handle_command_reply: tid=0 2023-09-13T09:39:39.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 client.15480 shutdown 2023-09-13T09:39:39.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2f0a0 msgr2=0x559adfc385c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2f0a0 0x559adfc385c0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0106f0 tx=0x7f76ac010ab0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 shutdown_connections 2023-09-13T09:39:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc38080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc43ef0 0x559adfc46310 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/3867632218 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2f0a0 0x559adfc385c0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76aa7fc700 0 client.15480 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 >> 172.21.15.6:0/3867632218 conn(0x559adfb8cc80 msgr2=0x559adfc2d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 shutdown_connections 2023-09-13T09:39:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 1 -- 172.21.15.6:0/3867632218 wait complete. 2023-09-13T09:39:39.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.642+0000 7f76d53e6b80 20 client.15480 trim_cache size 0 max 16384 2023-09-13T09:39:39.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 Processor -- start 2023-09-13T09:39:39.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 -- start start 2023-09-13T09:39:39.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc23a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2f0a0 0x559adfc3f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc37730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfb79970 con 0x559adfc2fb60 2023-09-13T09:39:39.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfc39200 con 0x559adfc2f0a0 2023-09-13T09:39:39.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfc37530 con 0x559adfc2e740 2023-09-13T09:39:39.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76c359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc37730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76c359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc37730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34024/0 (socket says 172.21.15.6:34024) 2023-09-13T09:39:39.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76c359e700 1 -- 172.21.15.6:0/2102583364 learned_addr learned my addr 172.21.15.6:0/2102583364 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc23a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.659+0000 7f76ba59c700 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2f0a0 0x559adfc3f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76c359e700 1 -- 172.21.15.6:0/2102583364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 msgr2=0x559adfc23a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76c359e700 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc23a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76c359e700 1 -- 172.21.15.6:0/2102583364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2f0a0 msgr2=0x559adfc3f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76c359e700 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2f0a0 0x559adfc3f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76c359e700 1 -- 172.21.15.6:0/2102583364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559adf9acde0 con 0x559adfc2fb60 2023-09-13T09:39:39.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76ba59c700 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2f0a0 0x559adfc3f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:39:39.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76c359e700 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc37730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c6f0 tx=0x7f76bc099f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3318e8fb046c8144 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76b9d9b700 1 -- 172.21.15.6:0/2102583364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc01b320 con 0x559adfc2fb60 2023-09-13T09:39:39.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76b9d9b700 1 -- 172.21.15.6:0/2102583364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76bc09cdb0 con 0x559adfc2fb60 2023-09-13T09:39:39.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.660+0000 7f76b9d9b700 1 -- 172.21.15.6:0/2102583364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc097440 con 0x559adfc2fb60 2023-09-13T09:39:39.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2102583364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 msgr2=0x559adfc37730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc37730 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00c6f0 tx=0x7f76bc099f90 comp rx=0 tx=0).stop 2023-09-13T09:39:39.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2102583364 shutdown_connections 2023-09-13T09:39:39.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2fb60 0x559adfc37730 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2e740 0x559adfc23a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/2102583364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2f0a0 0x559adfc3f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2102583364 >> 172.21.15.6:0/2102583364 conn(0x559adfb8cc80 msgr2=0x559adfc29060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2102583364 shutdown_connections 2023-09-13T09:39:39.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- 172.21.15.6:0/2102583364 wait complete. 2023-09-13T09:39:39.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- start start 2023-09-13T09:39:39.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 Processor -- start 2023-09-13T09:39:39.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2e740 0x559adfc3d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 0x559adfc3d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfc3eae0 con 0x559adfc2e740 2023-09-13T09:39:39.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfc3ec50 con 0x559adfc2fb60 2023-09-13T09:39:39.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559adfc3ee10 con 0x559adfc2f0a0 2023-09-13T09:39:39.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76d53e6b80 10 client.0 _ll_register_callbacks cb 0x559adfb1c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:39:39.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.661+0000 7f76c2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2e740 0x559adfc3d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2e740 0x559adfc3d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34026/0 (socket says 172.21.15.6:34026) 2023-09-13T09:39:39.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76ba59c700 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 0x559adfc3d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 -- 172.21.15.6:0/1949699497 learned_addr learned my addr 172.21.15.6:0/1949699497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:39:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c359e700 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 -- 172.21.15.6:0/1949699497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 msgr2=0x559adfc3d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 0x559adfc3d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 -- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 msgr2=0x559adfc3e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:39:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 -- 172.21.15.6:0/1949699497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559adfa00630 con 0x559adfc2e740 2023-09-13T09:39:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76c2d9d700 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2e740 0x559adfc3d050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f76c4100ac0 tx=0x7f76b401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f66e6379b8f512e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:39:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76aa7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:39:39.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76aa7fc700 1 -- 172.21.15.6:0/1949699497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4005480 con 0x559adfc2e740 2023-09-13T09:39:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76aa7fc700 1 -- 172.21.15.6:0/1949699497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(86..86 src has 1..86) v4 ==== 8248+0+0 (secure 0 0 0) 0x7f76b40055e0 con 0x559adfc2e740 2023-09-13T09:39:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f76bc0b8030 con 0x559adfc2e740 2023-09-13T09:39:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76aa7fc700 1 -- 172.21.15.6:0/1949699497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76b40037d0 con 0x559adfc2e740 2023-09-13T09:39:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76d53e6b80 10 client.15486 fetch_fsmap learned FSMap version 26 2023-09-13T09:39:39.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x559adf995c60 con 0x559adfc2e740 2023-09-13T09:39:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.662+0000 7f76aa7fc700 1 -- 172.21.15.6:0/1949699497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76b4048080 con 0x559adfc2e740 2023-09-13T09:39:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76aa7fc700 1 -- 172.21.15.6:0/1949699497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 26) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76b400f860 con 0x559adfc2e740 2023-09-13T09:39:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76d53e6b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 26 2023-09-13T09:39:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76d53e6b80 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:39:39.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76d53e6b80 20 client.15486 populate_metadata read hostname 'smithi006' 2023-09-13T09:39:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc98a00 0x559adfc9ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:39:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76d53e6b80 4 client.15486 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:39:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559adfb3a050 con 0x559adfc98a00 2023-09-13T09:39:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76ba59c700 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc98a00 0x559adfc9ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:39:39.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76aa7fc700 10 client.15486 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.663+0000 7f76ba59c700 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc98a00 0x559adfc9ae20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=713a31d1825464b server_cookie=bd9aa3d1f08aa061 in_seq=0 out_seq=0 2023-09-13T09:39:39.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76aa7fc700 1 -- 172.21.15.6:0/1949699497 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559adfb3a050 con 0x559adfc98a00 2023-09-13T09:39:39.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76aa7fc700 10 client.15486 handle_command_reply: tid=0 2023-09-13T09:39:39.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 client.15486 shutdown 2023-09-13T09:39:39.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2e740 msgr2=0x559adfc3d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2e740 0x559adfc3d050 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f76c4100ac0 tx=0x7f76b401f000 comp rx=0 tx=0).stop 2023-09-13T09:39:39.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 shutdown_connections 2023-09-13T09:39:39.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559adfc2fb60 0x559adfc3e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559adfc98a00 0x559adfc9ae20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559adfc2e740 0x559adfc3d050 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 --2- 172.21.15.6:0/1949699497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559adfc2f0a0 0x559adfc3d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76aa7fc700 0 client.15486 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:39:39.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 >> 172.21.15.6:0/1949699497 conn(0x559adfb8cc80 msgr2=0x559adfc36090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 shutdown_connections 2023-09-13T09:39:39.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 1 -- 172.21.15.6:0/1949699497 wait complete. 2023-09-13T09:39:39.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76d53e6b80 20 client.15486 trim_cache size 0 max 16384 2023-09-13T09:39:39.687 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:39:39.687 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:39:39.688 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:39:39.688 INFO:teuthology.orchestra.run.smithi006.stdout: "e2100a67-013a-4634-8204-e18f1ead511c": { 2023-09-13T09:39:39.688 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:39:39.688 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "e2100a67-013a-4634-8204-e18f1ead511c", 2023-09-13T09:39:39.688 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:39:39.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:39:39.689 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:39:39.689 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:39:39.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76b00a0640 msgr2=0x7f76b00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76c9201700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76b00a0640 0x7f76b00a2b00 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f76b4009990 tx=0x7f76b4005fb0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.664+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c4101600 msgr2=0x7f76c419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:39:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c4101600 0x7f76c419cd10 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f76bc00ef30 tx=0x7f76bc00c3a0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 shutdown_connections 2023-09-13T09:39:39.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76b00a0640 0x7f76b00a2b00 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76c4101600 0x7f76c419cd10 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76c40ffa70 0x7f76c4195760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 --2- 172.21.15.6:0/917192510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76c4100c60 0x7f76c4195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:39:39.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 >> 172.21.15.6:0/917192510 conn(0x7f76c40fafc0 msgr2=0x7f76c40fd230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:39:39.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 shutdown_connections 2023-09-13T09:39:39.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:39:39.665+0000 7f76c9201700 1 -- 172.21.15.6:0/917192510 wait complete. 2023-09-13T09:39:39.693 INFO:tasks.cephfs.filesystem:scrub status for tag:e2100a67-013a-4634-8204-e18f1ead511c - {'path': '/', 'tag': 'e2100a67-013a-4634-8204-e18f1ead511c', 'options': 'recursive,force'} 2023-09-13T09:39:40.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:39 smithi006 ceph-mon[98665]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-09-13T09:39:40.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:39 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/515189394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:40.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:39 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3540972319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:39 smithi131 ceph-mon[102785]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-09-13T09:39:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:39 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/515189394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:40.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:39 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3540972319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:39 smithi053 ceph-mon[102373]: pgmap v302: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 938 B/s wr, 9 op/s 2023-09-13T09:39:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:39 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/515189394' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:39:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:39 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3540972319' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T09:39:41.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:40 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:39:41.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:39:41.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:39:41.029 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:39:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:40 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:39:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:39:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:39:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:39:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:40 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:39:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:39:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:39:41.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:39:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:41 smithi053 ceph-mon[102373]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2023-09-13T09:39:42.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:41 smithi006 ceph-mon[98665]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2023-09-13T09:39:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:41 smithi131 ceph-mon[102785]: pgmap v303: 97 pgs: 97 active+clean; 642 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1023 B/s wr, 9 op/s 2023-09-13T09:39:44.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:43 smithi006 ceph-mon[98665]: pgmap v304: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2023-09-13T09:39:44.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:43 smithi053 ceph-mon[102373]: pgmap v304: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2023-09-13T09:39:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:43 smithi131 ceph-mon[102785]: pgmap v304: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.1 KiB/s wr, 14 op/s 2023-09-13T09:39:45.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:39:45.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:39:45.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:39:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:45 smithi053 ceph-mon[102373]: pgmap v305: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-09-13T09:39:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:45 smithi006 ceph-mon[98665]: pgmap v305: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-09-13T09:39:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:45 smithi131 ceph-mon[102785]: pgmap v305: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.1 KiB/s wr, 11 op/s 2023-09-13T09:39:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:47 smithi053 ceph-mon[102373]: pgmap v306: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-09-13T09:39:48.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:47 smithi006 ceph-mon[98665]: pgmap v306: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-09-13T09:39:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:47 smithi131 ceph-mon[102785]: pgmap v306: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 2.2 KiB/s wr, 14 op/s 2023-09-13T09:39:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:49 smithi006 ceph-mon[98665]: pgmap v307: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-09-13T09:39:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:49 smithi053 ceph-mon[102373]: pgmap v307: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-09-13T09:39:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:49 smithi131 ceph-mon[102785]: pgmap v307: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2023-09-13T09:39:51.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:50 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:39:51.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:50 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:39:51.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:50 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:39:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:51 smithi006 ceph-mon[98665]: pgmap v308: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-09-13T09:39:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:51 smithi053 ceph-mon[102373]: pgmap v308: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-09-13T09:39:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:51 smithi131 ceph-mon[102785]: pgmap v308: 97 pgs: 97 active+clean; 648 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 10 op/s 2023-09-13T09:39:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:53 smithi006 ceph-mon[98665]: pgmap v309: 97 pgs: 97 active+clean; 659 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-09-13T09:39:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:53 smithi053 ceph-mon[102373]: pgmap v309: 97 pgs: 97 active+clean; 659 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-09-13T09:39:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:53 smithi131 ceph-mon[102785]: pgmap v309: 97 pgs: 97 active+clean; 659 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.2 KiB/s wr, 13 op/s 2023-09-13T09:39:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:55 smithi006 ceph-mon[98665]: pgmap v310: 97 pgs: 97 active+clean; 659 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-09-13T09:39:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:55 smithi053 ceph-mon[102373]: pgmap v310: 97 pgs: 97 active+clean; 659 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-09-13T09:39:56.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:55 smithi131 ceph-mon[102785]: pgmap v310: 97 pgs: 97 active+clean; 659 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 9 op/s 2023-09-13T09:39:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:57 smithi006 ceph-mon[98665]: pgmap v311: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-09-13T09:39:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:57 smithi053 ceph-mon[102373]: pgmap v311: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-09-13T09:39:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:57 smithi131 ceph-mon[102785]: pgmap v311: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 1.7 KiB/s wr, 12 op/s 2023-09-13T09:40:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:39:59 smithi006 ceph-mon[98665]: pgmap v312: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-13T09:40:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:39:59 smithi053 ceph-mon[102373]: pgmap v312: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-13T09:40:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:39:59 smithi131 ceph-mon[102785]: pgmap v312: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-13T09:40:01.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:00 smithi006 ceph-mon[98665]: overall HEALTH_OK 2023-09-13T09:40:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:00 smithi053 ceph-mon[102373]: overall HEALTH_OK 2023-09-13T09:40:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:00 smithi131 ceph-mon[102785]: overall HEALTH_OK 2023-09-13T09:40:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:01 smithi006 ceph-mon[98665]: pgmap v313: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-13T09:40:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:01 smithi053 ceph-mon[102373]: pgmap v313: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-13T09:40:02.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:01 smithi131 ceph-mon[102785]: pgmap v313: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 KiB/s wr, 9 op/s 2023-09-13T09:40:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:03 smithi006 ceph-mon[98665]: pgmap v314: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2023-09-13T09:40:04.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:03 smithi053 ceph-mon[102373]: pgmap v314: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2023-09-13T09:40:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:03 smithi131 ceph-mon[102785]: pgmap v314: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 1.8 KiB/s wr, 13 op/s 2023-09-13T09:40:06.196 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:05 smithi006 ceph-mon[98665]: pgmap v315: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-09-13T09:40:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:05 smithi053 ceph-mon[102373]: pgmap v315: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-09-13T09:40:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:05 smithi131 ceph-mon[102785]: pgmap v315: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 767 B/s wr, 9 op/s 2023-09-13T09:40:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:07 smithi006 ceph-mon[98665]: pgmap v316: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2023-09-13T09:40:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-09-13T09:40:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:07 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-09-13T09:40:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:07 smithi053 ceph-mon[102373]: pgmap v316: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2023-09-13T09:40:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-09-13T09:40:08.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:07 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-09-13T09:40:08.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:07 smithi131 ceph-mon[102785]: pgmap v316: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 682 B/s wr, 12 op/s 2023-09-13T09:40:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]: dispatch 2023-09-13T09:40:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:07 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]: dispatch 2023-09-13T09:40:09.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-09-13T09:40:09.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-09-13T09:40:09.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:08 smithi006 ceph-mon[98665]: osdmap e87: 12 total, 12 up, 12 in 2023-09-13T09:40:09.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-09-13T09:40:09.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-09-13T09:40:09.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:08 smithi053 ceph-mon[102373]: osdmap e87: 12 total, 12 up, 12 in 2023-09-13T09:40:09.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11]}]': finished 2023-09-13T09:40:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2023-09-13T09:40:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:08 smithi131 ceph-mon[102785]: osdmap e87: 12 total, 12 up, 12 in 2023-09-13T09:40:09.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:40:09.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 -- 172.21.15.6:0/2695613930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 msgr2=0x7f96c0107e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 --2- 172.21.15.6:0/2695613930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c0107e30 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f96b800b0d0 tx=0x7f96b800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 -- 172.21.15.6:0/2695613930 shutdown_connections 2023-09-13T09:40:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 --2- 172.21.15.6:0/2695613930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c0107e30 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 --2- 172.21.15.6:0/2695613930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c00ff9f0 0x7f96c00ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 --2- 172.21.15.6:0/2695613930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c0100be0 0x7f96c0101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 -- 172.21.15.6:0/2695613930 >> 172.21.15.6:0/2695613930 conn(0x7f96c00faf20 msgr2=0x7f96c00fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:09.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 -- 172.21.15.6:0/2695613930 shutdown_connections 2023-09-13T09:40:09.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.834+0000 7f96c659e700 1 -- 172.21.15.6:0/2695613930 wait complete. 2023-09-13T09:40:09.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 Processor -- start 2023-09-13T09:40:09.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 -- start start 2023-09-13T09:40:09.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c00ff9f0 0x7f96c01968f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c0100be0 0x7f96c0196e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c019e470 con 0x7f96c0101580 2023-09-13T09:40:09.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c019e5b0 con 0x7f96c00ff9f0 2023-09-13T09:40:09.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c659e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c019e740 con 0x7f96c0100be0 2023-09-13T09:40:09.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c019dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34046/0 (socket says 172.21.15.6:34046) 2023-09-13T09:40:09.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 -- 172.21.15.6:0/1197088593 learned_addr learned my addr 172.21.15.6:0/1197088593 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:09.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c559c700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c00ff9f0 0x7f96c01968f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c0100be0 0x7f96c0196e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 -- 172.21.15.6:0/1197088593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c0100be0 msgr2=0x7f96c0196e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c0100be0 0x7f96c0196e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 -- 172.21.15.6:0/1197088593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c00ff9f0 msgr2=0x7f96c01968f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c00ff9f0 0x7f96c01968f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c5d9d700 1 -- 172.21.15.6:0/1197088593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b8009d00 con 0x7f96c0101580 2023-09-13T09:40:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.835+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c0100be0 0x7f96c0196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.836+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c019dea0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f96b8007a00 tx=0x7f96b80094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.836+0000 7f96b67fc700 1 -- 172.21.15.6:0/1197088593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800e040 con 0x7f96c0101580 2023-09-13T09:40:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.836+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c019e9c0 con 0x7f96c0101580 2023-09-13T09:40:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.836+0000 7f96b67fc700 1 -- 172.21.15.6:0/1197088593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96b8003e10 con 0x7f96c0101580 2023-09-13T09:40:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.836+0000 7f96b67fc700 1 -- 172.21.15.6:0/1197088593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8012a90 con 0x7f96c0101580 2023-09-13T09:40:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.836+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c019ee40 con 0x7f96c0101580 2023-09-13T09:40:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.839+0000 7f96b67fc700 1 -- 172.21.15.6:0/1197088593 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f96b80056c0 con 0x7f96c0101580 2023-09-13T09:40:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.839+0000 7f96b67fc700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a0640 0x7f96ac0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.839+0000 7f96c559c700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a0640 0x7f96ac0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.839+0000 7f96b67fc700 1 -- 172.21.15.6:0/1197088593 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96b80cd290 con 0x7f96c0101580 2023-09-13T09:40:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.840+0000 7f96c559c700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a0640 0x7f96ac0a2b00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f96c0100a40 tx=0x7f96bc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 Processor -- start 2023-09-13T09:40:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 -- start start 2023-09-13T09:40:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339b740 0x56252339bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339c0a0 0x56252339c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x56252339cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625232f4780 con 0x56252339cb40 2023-09-13T09:40:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625232f20a0 con 0x56252339c0a0 2023-09-13T09:40:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625232ed990 con 0x56252339b740 2023-09-13T09:40:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96c559c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339b740 0x56252339bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96c4d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339c0a0 0x56252339c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.841+0000 7f96c5d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x56252339cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339c0a0 0x56252339c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:55808/0 (socket says 172.21.15.6:55808) 2023-09-13T09:40:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 -- 172.21.15.6:0/960913019 learned_addr learned my addr 172.21.15.6:0/960913019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c559c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339b740 0x56252339bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:37104/0 (socket says 172.21.15.6:37104) 2023-09-13T09:40:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 -- 172.21.15.6:0/960913019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339b740 msgr2=0x56252339bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339b740 0x56252339bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 -- 172.21.15.6:0/960913019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 msgr2=0x56252339cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x56252339cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 -- 172.21.15.6:0/960913019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56252316d630 con 0x56252339c0a0 2023-09-13T09:40:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x56252339cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.842+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339c0a0 0x56252339c600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f96b0008c70 tx=0x7f96b0008f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c732762867ff9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.845+0000 7f96ab7fe700 1 -- 172.21.15.6:0/960913019 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b000ecb0 con 0x56252339c0a0 2023-09-13T09:40:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.845+0000 7f96ab7fe700 1 -- 172.21.15.6:0/960913019 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96b000ee10 con 0x56252339c0a0 2023-09-13T09:40:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.845+0000 7f96ab7fe700 1 -- 172.21.15.6:0/960913019 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b0010430 con 0x56252339c0a0 2023-09-13T09:40:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 -- 172.21.15.6:0/960913019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339c0a0 msgr2=0x56252339c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339c0a0 0x56252339c600 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f96b0008c70 tx=0x7f96b0008f80 comp rx=0 tx=0).stop 2023-09-13T09:40:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 -- 172.21.15.6:0/960913019 shutdown_connections 2023-09-13T09:40:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x56252339cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339b740 0x56252339bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/960913019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339c0a0 0x56252339c600 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 -- 172.21.15.6:0/960913019 >> 172.21.15.6:0/960913019 conn(0x5625232f9c80 msgr2=0x5625233960e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 -- 172.21.15.6:0/960913019 shutdown_connections 2023-09-13T09:40:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 -- 172.21.15.6:0/960913019 wait complete. 2023-09-13T09:40:09.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 -- start start 2023-09-13T09:40:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.846+0000 7f96d39e5b80 1 Processor -- start 2023-09-13T09:40:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x5625233aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252328bbb0 con 0x56252339cb40 2023-09-13T09:40:09.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252328b8b0 con 0x56252339b740 2023-09-13T09:40:09.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252316f920 con 0x56252339c0a0 2023-09-13T09:40:09.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96d39e5b80 10 client.0 _ll_register_callbacks cb 0x562523289680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:09.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x5625233aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x5625233aa6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34060/0 (socket says 172.21.15.6:34060) 2023-09-13T09:40:09.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 -- 172.21.15.6:0/3890567017 learned_addr learned my addr 172.21.15.6:0/3890567017 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:09.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c4d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c559c700 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 -- 172.21.15.6:0/3890567017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 msgr2=0x5625233a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 -- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 msgr2=0x5625233a5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233a5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c5d9d700 1 -- 172.21.15.6:0/3890567017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96b00088d0 con 0x56252339cb40 2023-09-13T09:40:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.847+0000 7f96c559c700 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x5625233aa6e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009690 tx=0x7f96b800b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef6a5b02a1597ef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:09.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3890567017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b809e8f0 con 0x56252339cb40 2023-09-13T09:40:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3890567017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96b80a2aa0 con 0x56252339cb40 2023-09-13T09:40:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56252338e670 con 0x56252339cb40 2023-09-13T09:40:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3890567017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96b802bdd0 con 0x56252339cb40 2023-09-13T09:40:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 10 client.15498 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:09.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5625233057a0 con 0x56252339cb40 2023-09-13T09:40:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3890567017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56252338e670 con 0x56252339cb40 2023-09-13T09:40:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3890567017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f96b809a040 con 0x56252339cb40 2023-09-13T09:40:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 10 client.15498 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 10 client.15498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:09.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 20 client.15498 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5625233c1c60 0x5625233c4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 4 client.15498 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625232e6970 con 0x5625233c1c60 2023-09-13T09:40:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.848+0000 7f96c559c700 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5625233c1c60 0x5625233c4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.849+0000 7f96a8ff9700 10 client.15498 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.849+0000 7f96c559c700 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5625233c1c60 0x5625233c4080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3972f5a8eef13c14 server_cookie=2c9ef8bbbf3c89c4 in_seq=0 out_seq=0 2023-09-13T09:40:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3890567017 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5625232e6970 con 0x5625233c1c60 2023-09-13T09:40:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96a8ff9700 10 client.15498 handle_command_reply: tid=0 2023-09-13T09:40:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 client.15498 shutdown 2023-09-13T09:40:09.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 msgr2=0x5625233aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x5625233aa6e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009690 tx=0x7f96b800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 shutdown_connections 2023-09-13T09:40:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5625233c1c60 0x5625233c4080 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339cb40 0x5625233aa6e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233a5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3890567017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 >> 172.21.15.6:0/3890567017 conn(0x5625232f9c80 msgr2=0x5625233984a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96a8ff9700 0 client.15498 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 shutdown_connections 2023-09-13T09:40:09.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3890567017 wait complete. 2023-09-13T09:40:09.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.850+0000 7f96d39e5b80 20 client.15498 trim_cache size 0 max 16384 2023-09-13T09:40:09.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.867+0000 7f96d39e5b80 1 Processor -- start 2023-09-13T09:40:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96d39e5b80 1 -- start start 2023-09-13T09:40:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339b740 0x5625233d1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339cb40 0x5625233a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625233a4620 con 0x56252339b740 2023-09-13T09:40:09.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562523396ed0 con 0x56252339cb40 2023-09-13T09:40:09.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252338e650 con 0x56252339c0a0 2023-09-13T09:40:09.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339b740 0x5625233d1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339b740 0x5625233d1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34064/0 (socket says 172.21.15.6:34064) 2023-09-13T09:40:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 -- 172.21.15.6:0/2865581683 learned_addr learned my addr 172.21.15.6:0/2865581683 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339cb40 0x5625233a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 -- 172.21.15.6:0/2865581683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 msgr2=0x5625233aafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233aafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 -- 172.21.15.6:0/2865581683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339cb40 msgr2=0x5625233a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339cb40 0x5625233a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 -- 172.21.15.6:0/2865581683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562523119de0 con 0x56252339b740 2023-09-13T09:40:09.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339cb40 0x5625233a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:09.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.868+0000 7f96c559c700 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339b740 0x5625233d1880 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00bec0 tx=0x7f96bc013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad92ea1cda47429e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:09.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96abfff700 1 -- 172.21.15.6:0/2865581683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc026070 con 0x56252339b740 2023-09-13T09:40:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96abfff700 1 -- 172.21.15.6:0/2865581683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96bc015070 con 0x56252339b740 2023-09-13T09:40:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96abfff700 1 -- 172.21.15.6:0/2865581683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc004380 con 0x56252339b740 2023-09-13T09:40:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 -- 172.21.15.6:0/2865581683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339b740 msgr2=0x5625233d1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339b740 0x5625233d1880 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f96bc00bec0 tx=0x7f96bc013000 comp rx=0 tx=0).stop 2023-09-13T09:40:09.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 -- 172.21.15.6:0/2865581683 shutdown_connections 2023-09-13T09:40:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339cb40 0x5625233a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339b740 0x5625233d1880 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/2865581683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339c0a0 0x5625233aafd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 -- 172.21.15.6:0/2865581683 >> 172.21.15.6:0/2865581683 conn(0x5625232f9c80 msgr2=0x5625233960b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 -- 172.21.15.6:0/2865581683 shutdown_connections 2023-09-13T09:40:09.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.869+0000 7f96d39e5b80 1 -- 172.21.15.6:0/2865581683 wait complete. 2023-09-13T09:40:09.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 -- start start 2023-09-13T09:40:09.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 Processor -- start 2023-09-13T09:40:09.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233d1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339c0a0 0x5625234121c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339cb40 0x5625234147e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562523414ef0 con 0x56252339c0a0 2023-09-13T09:40:09.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562523415060 con 0x56252339b740 2023-09-13T09:40:09.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562523415220 con 0x56252339cb40 2023-09-13T09:40:09.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96d39e5b80 10 client.0 _ll_register_callbacks cb 0x562523289680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96c4d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339c0a0 0x5625234121c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96c4d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339c0a0 0x5625234121c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34072/0 (socket says 172.21.15.6:34072) 2023-09-13T09:40:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96c4d9b700 1 -- 172.21.15.6:0/3800434915 learned_addr learned my addr 172.21.15.6:0/3800434915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.870+0000 7f96c5d9d700 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339cb40 0x5625234147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96c559c700 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233d1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96c4d9b700 1 -- 172.21.15.6:0/3800434915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339cb40 msgr2=0x5625234147e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339cb40 0x5625234147e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96c4d9b700 1 -- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 msgr2=0x5625233d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:09.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233d1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96c4d9b700 1 -- 172.21.15.6:0/3800434915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96bc010d30 con 0x56252339c0a0 2023-09-13T09:40:09.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96c4d9b700 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339c0a0 0x5625234121c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f96b0005850 tx=0x7f96b0005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60ad99b8c7d9843e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:09.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96a8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:09.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3800434915 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b00046f0 con 0x56252339c0a0 2023-09-13T09:40:09.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3800434915 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96b0004850 con 0x56252339c0a0 2023-09-13T09:40:09.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96b000ee10 con 0x56252339c0a0 2023-09-13T09:40:09.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3800434915 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96b0004a10 con 0x56252339c0a0 2023-09-13T09:40:09.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96d39e5b80 10 client.15504 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:09.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562523102c60 con 0x56252339c0a0 2023-09-13T09:40:09.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.871+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3800434915 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96b000ee10 con 0x56252339c0a0 2023-09-13T09:40:09.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3800434915 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f96b0023b10 con 0x56252339c0a0 2023-09-13T09:40:09.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96d39e5b80 10 client.15504 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:09.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96d39e5b80 10 client.15504 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:09.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96d39e5b80 20 client.15504 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:09.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562523416c50 0x562523419070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:09.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96d39e5b80 4 client.15504 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:40:09.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5625232a7050 con 0x562523416c50 2023-09-13T09:40:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96c559c700 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562523416c50 0x562523419070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96a8ff9700 10 client.15504 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96c559c700 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562523416c50 0x562523419070 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ee728a518cc251 server_cookie=2563fdecf9d95dd in_seq=0 out_seq=0 2023-09-13T09:40:09.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96a8ff9700 1 -- 172.21.15.6:0/3800434915 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5625232a7050 con 0x562523416c50 2023-09-13T09:40:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.872+0000 7f96a8ff9700 10 client.15504 handle_command_reply: tid=0 2023-09-13T09:40:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 client.15504 shutdown 2023-09-13T09:40:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339c0a0 msgr2=0x5625234121c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339c0a0 0x5625234121c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f96b0005850 tx=0x7f96b0005270 comp rx=0 tx=0).stop 2023-09-13T09:40:09.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 shutdown_connections 2023-09-13T09:40:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56252339cb40 0x5625234147e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56252339b740 0x5625233d1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562523416c50 0x562523419070 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 --2- 172.21.15.6:0/3800434915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56252339c0a0 0x5625234121c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 >> 172.21.15.6:0/3800434915 conn(0x5625232f9c80 msgr2=0x5625233a00c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:09.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96a8ff9700 0 client.15504 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 shutdown_connections 2023-09-13T09:40:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 1 -- 172.21.15.6:0/3800434915 wait complete. 2023-09-13T09:40:09.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96d39e5b80 20 client.15504 trim_cache size 0 max 16384 2023-09-13T09:40:09.889 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:40:09.890 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:40:09.890 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:40:09.890 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:40:09.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a0640 msgr2=0x7f96ac0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.873+0000 7f96c659e700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a0640 0x7f96ac0a2b00 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f96c0100a40 tx=0x7f96bc00b410 comp rx=0 tx=0).stop 2023-09-13T09:40:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 msgr2=0x7f96c019dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c019dea0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f96b8007a00 tx=0x7f96b80094c0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 shutdown_connections 2023-09-13T09:40:09.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96ac0a0640 0x7f96ac0a2b00 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96c0101580 0x7f96c019dea0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96c00ff9f0 0x7f96c01968f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 --2- 172.21.15.6:0/1197088593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96c0100be0 0x7f96c0196e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 >> 172.21.15.6:0/1197088593 conn(0x7f96c00faf20 msgr2=0x7f96c0067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:09.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 shutdown_connections 2023-09-13T09:40:09.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:09.874+0000 7f96c659e700 1 -- 172.21.15.6:0/1197088593 wait complete. 2023-09-13T09:40:09.894 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:40:09.894 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:40:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:09 smithi006 ceph-mon[98665]: pgmap v318: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-13T09:40:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:09 smithi006 ceph-mon[98665]: osdmap e88: 12 total, 12 up, 12 in 2023-09-13T09:40:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/2880523904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc0ffc90 msgr2=0x7f8abc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/2880523904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc0ffc90 0x7f8abc1000b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f8aac0099c0 tx=0x7f8aac009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/2880523904 shutdown_connections 2023-09-13T09:40:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/2880523904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc101820 0x7f8abc1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/2880523904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc0ffc90 0x7f8abc1000b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/2880523904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8abc100e80 0x7f8abc1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/2880523904 >> 172.21.15.6:0/2880523904 conn(0x7f8abc0fb220 msgr2=0x7f8abc0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/2880523904 shutdown_connections 2023-09-13T09:40:10.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.025+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/2880523904 wait complete. 2023-09-13T09:40:10.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 Processor -- start 2023-09-13T09:40:10.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 -- start start 2023-09-13T09:40:10.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc0ffc90 0x7f8abc196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8abc100e80 0x7f8abc197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc101820 0x7f8abc19e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc19e640 con 0x7f8abc101820 2023-09-13T09:40:10.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc19e780 con 0x7f8abc0ffc90 2023-09-13T09:40:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ac0a6f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc19e910 con 0x7f8abc100e80 2023-09-13T09:40:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8abad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc101820 0x7f8abc19e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8abad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc101820 0x7f8abc19e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34088/0 (socket says 172.21.15.6:34088) 2023-09-13T09:40:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8abad9d700 1 -- 172.21.15.6:0/511820799 learned_addr learned my addr 172.21.15.6:0/511820799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8aba59c700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc0ffc90 0x7f8abc196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8ab9d9b700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8abc100e80 0x7f8abc197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8abad9d700 1 -- 172.21.15.6:0/511820799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8abc100e80 msgr2=0x7f8abc197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.026+0000 7f8abad9d700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8abc100e80 0x7f8abc197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8abad9d700 1 -- 172.21.15.6:0/511820799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc0ffc90 msgr2=0x7f8abc196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8abad9d700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc0ffc90 0x7f8abc196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8abad9d700 1 -- 172.21.15.6:0/511820799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac0095f0 con 0x7f8abc101820 2023-09-13T09:40:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8abad9d700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc101820 0x7f8abc19e070 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ef30 tx=0x7f8ab400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8aab7fe700 1 -- 172.21.15.6:0/511820799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4018070 con 0x7f8abc101820 2023-09-13T09:40:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8aab7fe700 1 -- 172.21.15.6:0/511820799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab400f040 con 0x7f8abc101820 2023-09-13T09:40:10.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc19eb90 con 0x7f8abc101820 2023-09-13T09:40:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8aab7fe700 1 -- 172.21.15.6:0/511820799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400cdb0 con 0x7f8abc101820 2023-09-13T09:40:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.027+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc19f050 con 0x7f8abc101820 2023-09-13T09:40:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.028+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc10b4f0 con 0x7f8abc101820 2023-09-13T09:40:10.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.029+0000 7f8aab7fe700 1 -- 172.21.15.6:0/511820799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8ab4003a00 con 0x7f8abc101820 2023-09-13T09:40:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.030+0000 7f8aab7fe700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8aa40a0640 0x7f8aa40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.030+0000 7f8aab7fe700 1 -- 172.21.15.6:0/511820799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8ab40cc190 con 0x7f8abc101820 2023-09-13T09:40:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.030+0000 7f8aba59c700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8aa40a0640 0x7f8aa40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.031+0000 7f8aba59c700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8aa40a0640 0x7f8aa40a2b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009990 tx=0x7f8aac005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.035+0000 7f8aab7fe700 1 -- 172.21.15.6:0/511820799 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8ab4095d00 con 0x7f8abc101820 2023-09-13T09:40:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:09 smithi053 ceph-mon[102373]: pgmap v318: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-13T09:40:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:09 smithi053 ceph-mon[102373]: osdmap e88: 12 total, 12 up, 12 in 2023-09-13T09:40:10.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:09 smithi131 ceph-mon[102785]: pgmap v318: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 204 B/s wr, 10 op/s 2023-09-13T09:40:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:09 smithi131 ceph-mon[102785]: osdmap e88: 12 total, 12 up, 12 in 2023-09-13T09:40:10.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.308+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8abc19f1e0 con 0x7f8abc101820 2023-09-13T09:40:10.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.309+0000 7f8aab7fe700 1 -- 172.21.15.6:0/511820799 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11337 (secure 0 0 0) 0x7f8ab4099320 con 0x7f8abc101820 2023-09-13T09:40:10.309 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:40:10.310 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:39:49.009431+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:40:10.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8aa40a0640 msgr2=0x7f8aa40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8aa40a0640 0x7f8aa40a2b00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009990 tx=0x7f8aac005fb0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc101820 msgr2=0x7f8abc19e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc101820 0x7f8abc19e070 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400ef30 tx=0x7f8ab400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 shutdown_connections 2023-09-13T09:40:10.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8aa40a0640 0x7f8aa40a2b00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8abc101820 0x7f8abc19e070 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8abc0ffc90 0x7f8abc196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 --2- 172.21.15.6:0/511820799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8abc100e80 0x7f8abc197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 >> 172.21.15.6:0/511820799 conn(0x7f8abc0fb220 msgr2=0x7f8abc067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 shutdown_connections 2023-09-13T09:40:10.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.311+0000 7f8ac0a6f700 1 -- 172.21.15.6:0/511820799 wait complete. 2023-09-13T09:40:10.314 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-09-13T09:40:10.324 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:40:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 -- 172.21.15.6:0/3753527263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 msgr2=0x7fac28108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 --2- 172.21.15.6:0/3753527263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 0x7fac28108100 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fac20009f90 tx=0x7fac2000b330 comp rx=0 tx=0).stop 2023-09-13T09:40:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 -- 172.21.15.6:0/3753527263 shutdown_connections 2023-09-13T09:40:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 --2- 172.21.15.6:0/3753527263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 0x7fac28108100 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 --2- 172.21.15.6:0/3753527263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac280ffcc0 0x7fac281000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 --2- 172.21.15.6:0/3753527263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 0x7fac28101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 -- 172.21.15.6:0/3753527263 >> 172.21.15.6:0/3753527263 conn(0x7fac280fb210 msgr2=0x7fac280fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 -- 172.21.15.6:0/3753527263 shutdown_connections 2023-09-13T09:40:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.455+0000 7fac301e2700 1 -- 172.21.15.6:0/3753527263 wait complete. 2023-09-13T09:40:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 Processor -- start 2023-09-13T09:40:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 -- start start 2023-09-13T09:40:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac280ffcc0 0x7fac2810a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 0x7fac28108a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 0x7fac28108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac28109760 con 0x7fac28100eb0 2023-09-13T09:40:10.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281098d0 con 0x7fac28101850 2023-09-13T09:40:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac301e2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac281a0bc0 con 0x7fac280ffcc0 2023-09-13T09:40:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac2d77d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 0x7fac28108a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac2d77d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 0x7fac28108a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34102/0 (socket says 172.21.15.6:34102) 2023-09-13T09:40:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac2d77d700 1 -- 172.21.15.6:0/4089957630 learned_addr learned my addr 172.21.15.6:0/4089957630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac2df7e700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac280ffcc0 0x7fac2810a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.456+0000 7fac2e77f700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 0x7fac28108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac2d77d700 1 -- 172.21.15.6:0/4089957630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac280ffcc0 msgr2=0x7fac2810a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac2d77d700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac280ffcc0 0x7fac2810a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac2d77d700 1 -- 172.21.15.6:0/4089957630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 msgr2=0x7fac28108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac2d77d700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 0x7fac28108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac2d77d700 1 -- 172.21.15.6:0/4089957630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac20009c40 con 0x7fac28100eb0 2023-09-13T09:40:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac2e77f700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 0x7fac28108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac2d77d700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 0x7fac28108a80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fac1800e9c0 tx=0x7fac1800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac1effd700 1 -- 172.21.15.6:0/4089957630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800cbd0 con 0x7fac28100eb0 2023-09-13T09:40:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac281a0ea0 con 0x7fac28100eb0 2023-09-13T09:40:10.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac281a1370 con 0x7fac28100eb0 2023-09-13T09:40:10.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac1effd700 1 -- 172.21.15.6:0/4089957630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac1800eeb0 con 0x7fac28100eb0 2023-09-13T09:40:10.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.457+0000 7fac1effd700 1 -- 172.21.15.6:0/4089957630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18005580 con 0x7fac28100eb0 2023-09-13T09:40:10.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.460+0000 7fac1effd700 1 -- 172.21.15.6:0/4089957630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fac18004750 con 0x7fac28100eb0 2023-09-13T09:40:10.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.461+0000 7fac1effd700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fac140a06c0 0x7fac140a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.461+0000 7fac1effd700 1 -- 172.21.15.6:0/4089957630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fac18014070 con 0x7fac28100eb0 2023-09-13T09:40:10.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.461+0000 7fac2df7e700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fac140a06c0 0x7fac140a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 Processor -- start 2023-09-13T09:40:10.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac2df7e700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fac140a06c0 0x7fac140a2b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fac28100d10 tx=0x7fac2400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 -- start start 2023-09-13T09:40:10.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cb700 0x561ab30cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab3023780 con 0x561ab30cb700 2023-09-13T09:40:10.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab30210a0 con 0x561ab30cc060 2023-09-13T09:40:10.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.462+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab301c990 con 0x561ab30caa00 2023-09-13T09:40:10.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:55864/0 (socket says 172.21.15.6:55864) 2023-09-13T09:40:10.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 -- 172.21.15.6:0/400752638 learned_addr learned my addr 172.21.15.6:0/400752638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2df7e700 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cb700 0x561ab30cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 -- 172.21.15.6:0/400752638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 msgr2=0x561ab30cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 -- 172.21.15.6:0/400752638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cb700 msgr2=0x561ab30cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cb700 0x561ab30cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 -- 172.21.15.6:0/400752638 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ab2e9c630 con 0x561ab30cc060 2023-09-13T09:40:10.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.463+0000 7fac2d77d700 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30ca4c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac180960c0 tx=0x7fac1800cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3177d3309db5938f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.464+0000 7fac13fff700 1 -- 172.21.15.6:0/400752638 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac18082ea0 con 0x561ab30cc060 2023-09-13T09:40:10.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.464+0000 7fac13fff700 1 -- 172.21.15.6:0/400752638 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac1809d480 con 0x561ab30cc060 2023-09-13T09:40:10.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.464+0000 7fac13fff700 1 -- 172.21.15.6:0/400752638 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac180998b0 con 0x561ab30cc060 2023-09-13T09:40:10.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/400752638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 msgr2=0x561ab30ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30ca4c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fac180960c0 tx=0x7fac1800cd30 comp rx=0 tx=0).stop 2023-09-13T09:40:10.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/400752638 shutdown_connections 2023-09-13T09:40:10.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cb700 0x561ab30cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/400752638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30ca4c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/400752638 >> 172.21.15.6:0/400752638 conn(0x561ab3028c80 msgr2=0x561ab30c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/400752638 shutdown_connections 2023-09-13T09:40:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/400752638 wait complete. 2023-09-13T09:40:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 -- start start 2023-09-13T09:40:10.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.465+0000 7fac3c3c7b80 1 Processor -- start 2023-09-13T09:40:10.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30d44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cc060 0x561ab30db510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab2fbabb0 con 0x561ab30cc060 2023-09-13T09:40:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab2fba8b0 con 0x561ab30cb700 2023-09-13T09:40:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab2e9e920 con 0x561ab30caa00 2023-09-13T09:40:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac3c3c7b80 10 client.0 _ll_register_callbacks cb 0x561ab2fb8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:10.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac2e77f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cc060 0x561ab30db510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac2df7e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac2df7e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30d3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:37166/0 (socket says 172.21.15.6:37166) 2023-09-13T09:40:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac2e77f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cc060 0x561ab30db510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34116/0 (socket says 172.21.15.6:34116) 2023-09-13T09:40:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac2df7e700 1 -- 172.21.15.6:0/1766132832 learned_addr learned my addr 172.21.15.6:0/1766132832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.466+0000 7fac2d77d700 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30d44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac2df7e700 1 -- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 msgr2=0x561ab30d44d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac2df7e700 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30d44d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac2df7e700 1 -- 172.21.15.6:0/1766132832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cc060 msgr2=0x561ab30db510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac2df7e700 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cc060 0x561ab30db510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac2df7e700 1 -- 172.21.15.6:0/1766132832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac281a1370 con 0x561ab30caa00 2023-09-13T09:40:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac2d77d700 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30d44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac2df7e700 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30d3f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac240116f0 tx=0x7fac240047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1201b7c815c608c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac117fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:40:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac117fa700 1 -- 172.21.15.6:0/1766132832 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2401f840 con 0x561ab30caa00 2023-09-13T09:40:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ab30bd670 con 0x561ab30caa00 2023-09-13T09:40:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac117fa700 1 -- 172.21.15.6:0/1766132832 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fac24017070 con 0x561ab30caa00 2023-09-13T09:40:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac117fa700 1 -- 172.21.15.6:0/1766132832 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac24011e90 con 0x561ab30caa00 2023-09-13T09:40:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac3c3c7b80 10 client.25102 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.467+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561ab30347a0 con 0x561ab30caa00 2023-09-13T09:40:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac117fa700 1 -- 172.21.15.6:0/1766132832 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561ab30bd670 con 0x561ab30caa00 2023-09-13T09:40:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac117fa700 1 -- 172.21.15.6:0/1766132832 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fac24028b30 con 0x561ab30caa00 2023-09-13T09:40:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac3c3c7b80 10 client.25102 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac3c3c7b80 10 client.25102 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:40:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac3c3c7b80 20 client.25102 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab30dfda0 0x561ab30e21c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac3c3c7b80 4 client.25102 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ab3015970 con 0x561ab30dfda0 2023-09-13T09:40:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.468+0000 7fac2d77d700 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab30dfda0 0x561ab30e21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.469+0000 7fac2d77d700 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab30dfda0 0x561ab30e21c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fcca15647b6071fc server_cookie=8ab146a2ce65ec47 in_seq=0 out_seq=0 2023-09-13T09:40:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.469+0000 7fac117fa700 10 client.25102 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.469+0000 7fac117fa700 1 -- 172.21.15.6:0/1766132832 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561ab3015970 con 0x561ab30dfda0 2023-09-13T09:40:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.469+0000 7fac117fa700 10 client.25102 handle_command_reply: tid=0 2023-09-13T09:40:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.469+0000 7fac3c3c7b80 1 client.25102 shutdown 2023-09-13T09:40:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.469+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 msgr2=0x561ab30d3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.469+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30d3f90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fac240116f0 tx=0x7fac240047c0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 shutdown_connections 2023-09-13T09:40:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab30dfda0 0x561ab30e21c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30cc060 0x561ab30db510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30caa00 0x561ab30d3f90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac117fa700 0 client.25102 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:10.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1766132832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30d44d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 >> 172.21.15.6:0/1766132832 conn(0x561ab3028c80 msgr2=0x561ab30bf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 shutdown_connections 2023-09-13T09:40:10.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1766132832 wait complete. 2023-09-13T09:40:10.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.470+0000 7fac3c3c7b80 20 client.25102 trim_cache size 0 max 16384 2023-09-13T09:40:10.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.496+0000 7fac3c3c7b80 1 Processor -- start 2023-09-13T09:40:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac3c3c7b80 1 -- start start 2023-09-13T09:40:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30db4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cc060 0x561ab30ce8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab30d3b00 con 0x561ab30caa00 2023-09-13T09:40:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab30c6fd0 con 0x561ab30cb700 2023-09-13T09:40:10.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab30d4fc0 con 0x561ab30cc060 2023-09-13T09:40:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30ca4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34120/0 (socket says 172.21.15.6:34120) 2023-09-13T09:40:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 -- 172.21.15.6:0/2033948696 learned_addr learned my addr 172.21.15.6:0/2033948696 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2d77d700 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30db4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2e77f700 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cc060 0x561ab30ce8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 -- 172.21.15.6:0/2033948696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cc060 msgr2=0x561ab30ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cc060 0x561ab30ce8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 -- 172.21.15.6:0/2033948696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 msgr2=0x561ab30db4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30db4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2df7e700 1 -- 172.21.15.6:0/2033948696 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ab2e48de0 con 0x561ab30caa00 2023-09-13T09:40:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.497+0000 7fac2e77f700 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cc060 0x561ab30ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.498+0000 7fac2df7e700 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30ca4c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fac2400ba60 tx=0x7fac2400b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d945e029901b6d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.498+0000 7fac1cff9700 1 -- 172.21.15.6:0/2033948696 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24032860 con 0x561ab30caa00 2023-09-13T09:40:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.498+0000 7fac1cff9700 1 -- 172.21.15.6:0/2033948696 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac2402d030 con 0x561ab30caa00 2023-09-13T09:40:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.498+0000 7fac1cff9700 1 -- 172.21.15.6:0/2033948696 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2401fdf0 con 0x561ab30caa00 2023-09-13T09:40:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/2033948696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 msgr2=0x561ab30ca4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30ca4c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fac2400ba60 tx=0x7fac2400b610 comp rx=0 tx=0).stop 2023-09-13T09:40:10.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/2033948696 shutdown_connections 2023-09-13T09:40:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cc060 0x561ab30ce8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30ca4c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/2033948696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cb700 0x561ab30db4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/2033948696 >> 172.21.15.6:0/2033948696 conn(0x561ab3028c80 msgr2=0x561ab30d2c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/2033948696 shutdown_connections 2023-09-13T09:40:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.499+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/2033948696 wait complete. 2023-09-13T09:40:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 -- start start 2023-09-13T09:40:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 Processor -- start 2023-09-13T09:40:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30d70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cb700 0x561ab30d7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30da630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab30dab70 con 0x561ab30caa00 2023-09-13T09:40:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab30dace0 con 0x561ab30cc060 2023-09-13T09:40:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab30daea0 con 0x561ab30cb700 2023-09-13T09:40:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac3c3c7b80 10 client.0 _ll_register_callbacks cb 0x561ab2fb8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:10.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac2df7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30d70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac2df7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30d70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34126/0 (socket says 172.21.15.6:34126) 2023-09-13T09:40:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.500+0000 7fac2df7e700 1 -- 172.21.15.6:0/1030814560 learned_addr learned my addr 172.21.15.6:0/1030814560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2d77d700 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cb700 0x561ab30d7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2e77f700 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30da630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2df7e700 1 -- 172.21.15.6:0/1030814560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cb700 msgr2=0x561ab30d7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2df7e700 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cb700 0x561ab30d7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2df7e700 1 -- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 msgr2=0x561ab30da630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2df7e700 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30da630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2df7e700 1 -- 172.21.15.6:0/1030814560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ab30347a0 con 0x561ab30caa00 2023-09-13T09:40:10.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac2df7e700 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30d70d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fac2403c040 tx=0x7fac24032780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5202a98e918a4969 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac117fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac117fa700 1 -- 172.21.15.6:0/1030814560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac24032a60 con 0x561ab30caa00 2023-09-13T09:40:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac1809d480 con 0x561ab30caa00 2023-09-13T09:40:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.501+0000 7fac117fa700 1 -- 172.21.15.6:0/1030814560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fac24017070 con 0x561ab30caa00 2023-09-13T09:40:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac117fa700 1 -- 172.21.15.6:0/1030814560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac24032bc0 con 0x561ab30caa00 2023-09-13T09:40:10.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 10 client.15528 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561ab2e31c60 con 0x561ab30caa00 2023-09-13T09:40:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac117fa700 1 -- 172.21.15.6:0/1030814560 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fac1809d480 con 0x561ab30caa00 2023-09-13T09:40:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac117fa700 1 -- 172.21.15.6:0/1030814560 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fac24003c10 con 0x561ab30caa00 2023-09-13T09:40:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 10 client.15528 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:10.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 10 client.15528 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:40:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 20 client.15528 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab3134670 0x561ab3136a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 4 client.15528 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561ab2fd6050 con 0x561ab3134670 2023-09-13T09:40:10.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.502+0000 7fac2d77d700 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab3134670 0x561ab3136a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac117fa700 10 client.15528 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:10.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac2d77d700 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab3134670 0x561ab3136a90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e281c18bdfb5800 server_cookie=8f309683c1132aee in_seq=0 out_seq=0 2023-09-13T09:40:10.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac117fa700 1 -- 172.21.15.6:0/1030814560 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561ab2fd6050 con 0x561ab3134670 2023-09-13T09:40:10.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac117fa700 10 client.15528 handle_command_reply: tid=0 2023-09-13T09:40:10.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 client.15528 shutdown 2023-09-13T09:40:10.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 msgr2=0x561ab30d70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30d70d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fac2403c040 tx=0x7fac24032780 comp rx=0 tx=0).stop 2023-09-13T09:40:10.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 shutdown_connections 2023-09-13T09:40:10.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x561ab3134670 0x561ab3136a90 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ab30cc060 0x561ab30da630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac117fa700 0 client.15528 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:10.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ab30caa00 0x561ab30d70d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 --2- 172.21.15.6:0/1030814560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ab30cb700 0x561ab30d7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 >> 172.21.15.6:0/1030814560 conn(0x561ab3028c80 msgr2=0x561ab30ce8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 shutdown_connections 2023-09-13T09:40:10.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.503+0000 7fac3c3c7b80 1 -- 172.21.15.6:0/1030814560 wait complete. 2023-09-13T09:40:10.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac3c3c7b80 20 client.15528 trim_cache size 0 max 16384 2023-09-13T09:40:10.518 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:10.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fac140a06c0 msgr2=0x7fac140a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fac140a06c0 0x7fac140a2b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fac28100d10 tx=0x7fac2400b410 comp rx=0 tx=0).stop 2023-09-13T09:40:10.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 msgr2=0x7fac28108a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 0x7fac28108a80 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fac1800e9c0 tx=0x7fac1800ecd0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 shutdown_connections 2023-09-13T09:40:10.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fac28101850 0x7fac28108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac280ffcc0 0x7fac2810a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fac140a06c0 0x7fac140a2b80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 --2- 172.21.15.6:0/4089957630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac28100eb0 0x7fac28108a80 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 >> 172.21.15.6:0/4089957630 conn(0x7fac280fb210 msgr2=0x7fac28104290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 shutdown_connections 2023-09-13T09:40:10.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.504+0000 7fac301e2700 1 -- 172.21.15.6:0/4089957630 wait complete. 2023-09-13T09:40:10.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:40:10.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 -- 172.21.15.6:0/477568508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2500ffcc0 msgr2=0x7fa2501000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 --2- 172.21.15.6:0/477568508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2500ffcc0 0x7fa2501000e0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0099c0 tx=0x7fa24c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 -- 172.21.15.6:0/477568508 shutdown_connections 2023-09-13T09:40:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 --2- 172.21.15.6:0/477568508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa250101850 0x7fa250108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 --2- 172.21.15.6:0/477568508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2500ffcc0 0x7fa2501000e0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 --2- 172.21.15.6:0/477568508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa250100eb0 0x7fa250101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 -- 172.21.15.6:0/477568508 >> 172.21.15.6:0/477568508 conn(0x7fa2500fb210 msgr2=0x7fa2500fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 -- 172.21.15.6:0/477568508 shutdown_connections 2023-09-13T09:40:10.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 -- 172.21.15.6:0/477568508 wait complete. 2023-09-13T09:40:10.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.692+0000 7fa258779700 1 Processor -- start 2023-09-13T09:40:10.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa258779700 1 -- start start 2023-09-13T09:40:10.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa258779700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2500ffcc0 0x7fa250194860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa258779700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa250100eb0 0x7fa250194da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa258779700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa250101850 0x7fa25019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa258779700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25019c3e0 con 0x7fa250101850 2023-09-13T09:40:10.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa258779700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25019c520 con 0x7fa2500ffcc0 2023-09-13T09:40:10.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa258779700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa25019c6b0 con 0x7fa250100eb0 2023-09-13T09:40:10.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa250101850 0x7fa25019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa250101850 0x7fa25019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34144/0 (socket says 172.21.15.6:34144) 2023-09-13T09:40:10.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 -- 172.21.15.6:0/3391981988 learned_addr learned my addr 172.21.15.6:0/3391981988 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256515700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2500ffcc0 0x7fa250194860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa255d14700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa250100eb0 0x7fa250194da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 -- 172.21.15.6:0/3391981988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa250100eb0 msgr2=0x7fa250194da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa250100eb0 0x7fa250194da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 -- 172.21.15.6:0/3391981988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2500ffcc0 msgr2=0x7fa250194860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2500ffcc0 0x7fa250194860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.693+0000 7fa256d16700 1 -- 172.21.15.6:0/3391981988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa24c0095f0 con 0x7fa250101850 2023-09-13T09:40:10.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.694+0000 7fa256d16700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa250101850 0x7fa25019be10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa248007ee0 tx=0x7fa24800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.694+0000 7fa2477fe700 1 -- 172.21.15.6:0/3391981988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248017070 con 0x7fa250101850 2023-09-13T09:40:10.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.694+0000 7fa2477fe700 1 -- 172.21.15.6:0/3391981988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa24800f040 con 0x7fa250101850 2023-09-13T09:40:10.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.694+0000 7fa2477fe700 1 -- 172.21.15.6:0/3391981988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248005580 con 0x7fa250101850 2023-09-13T09:40:10.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.694+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa25019c990 con 0x7fa250101850 2023-09-13T09:40:10.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.694+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa25019ce50 con 0x7fa250101850 2023-09-13T09:40:10.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.696+0000 7fa2477fe700 1 -- 172.21.15.6:0/3391981988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa24800db20 con 0x7fa250101850 2023-09-13T09:40:10.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.697+0000 7fa2477fe700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa23c0a2850 0x7fa23c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.697+0000 7fa256515700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa23c0a2850 0x7fa23c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.697+0000 7fa2477fe700 1 -- 172.21.15.6:0/3391981988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2480cb370 con 0x7fa250101850 2023-09-13T09:40:10.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.698+0000 7fa256515700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa23c0a2850 0x7fa23c0a4d10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009f50 tx=0x7fa24c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 Processor -- start 2023-09-13T09:40:10.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 -- start start 2023-09-13T09:40:10.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 0x55c85f2bab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2bb060 0x55c85f2b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2b9a00 0x55c85f2b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f212780 con 0x55c85f2bb060 2023-09-13T09:40:10.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f2100a0 con 0x55c85f2b9a00 2023-09-13T09:40:10.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa26495eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f20b990 con 0x55c85f2ba700 2023-09-13T09:40:10.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa255d14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2bb060 0x55c85f2b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa255d14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2bb060 0x55c85f2b94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34150/0 (socket says 172.21.15.6:34150) 2023-09-13T09:40:10.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa255d14700 1 -- 172.21.15.6:0/2121198063 learned_addr learned my addr 172.21.15.6:0/2121198063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.699+0000 7fa256d16700 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2b9a00 0x55c85f2b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa256515700 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 0x55c85f2bab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa255d14700 1 -- 172.21.15.6:0/2121198063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 msgr2=0x55c85f2bab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa255d14700 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 0x55c85f2bab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa255d14700 1 -- 172.21.15.6:0/2121198063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2b9a00 msgr2=0x55c85f2b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa255d14700 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2b9a00 0x55c85f2b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa255d14700 1 -- 172.21.15.6:0/2121198063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85f08b630 con 0x55c85f2bb060 2023-09-13T09:40:10.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa256d16700 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2b9a00 0x55c85f2b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:10.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa255d14700 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2bb060 0x55c85f2b94c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa24000bd70 tx=0x7fa2400106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bdf3db6cb1cda24 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa244ff9700 1 -- 172.21.15.6:0/2121198063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240010e10 con 0x55c85f2bb060 2023-09-13T09:40:10.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa244ff9700 1 -- 172.21.15.6:0/2121198063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa240015070 con 0x55c85f2bb060 2023-09-13T09:40:10.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.700+0000 7fa244ff9700 1 -- 172.21.15.6:0/2121198063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa240011730 con 0x55c85f2bb060 2023-09-13T09:40:10.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 -- 172.21.15.6:0/2121198063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2bb060 msgr2=0x55c85f2b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2bb060 0x55c85f2b94c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa24000bd70 tx=0x7fa2400106b0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 -- 172.21.15.6:0/2121198063 shutdown_connections 2023-09-13T09:40:10.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2b9a00 0x55c85f2b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 0x55c85f2bab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 --2- 172.21.15.6:0/2121198063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2bb060 0x55c85f2b94c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 -- 172.21.15.6:0/2121198063 >> 172.21.15.6:0/2121198063 conn(0x55c85f217c80 msgr2=0x55c85f2b3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.701+0000 7fa26495eb80 1 -- 172.21.15.6:0/2121198063 shutdown_connections 2023-09-13T09:40:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 -- 172.21.15.6:0/2121198063 wait complete. 2023-09-13T09:40:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 -- start start 2023-09-13T09:40:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 Processor -- start 2023-09-13T09:40:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2b9a00 0x55c85f2c2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2ba700 0x55c85f2c3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f1a9bb0 con 0x55c85f2ba700 2023-09-13T09:40:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f1a98b0 con 0x55c85f2bb060 2023-09-13T09:40:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.702+0000 7fa26495eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f08d920 con 0x55c85f2b9a00 2023-09-13T09:40:10.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa26495eb80 10 client.0 _ll_register_callbacks cb 0x55c85f1a7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2b9a00 0x55c85f2c2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2b9a00 0x55c85f2c2ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:37208/0 (socket says 172.21.15.6:37208) 2023-09-13T09:40:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 -- 172.21.15.6:0/1118703363 learned_addr learned my addr 172.21.15.6:0/1118703363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256d16700 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 -- 172.21.15.6:0/1118703363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 msgr2=0x55c85f2ca470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 -- 172.21.15.6:0/1118703363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2ba700 msgr2=0x55c85f2c3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2ba700 0x55c85f2c3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 -- 172.21.15.6:0/1118703363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24000b9a0 con 0x55c85f2b9a00 2023-09-13T09:40:10.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa256515700 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2b9a00 0x55c85f2c2ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0099c0 tx=0x7fa24c009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1288b3444f4033f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa239ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:40:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.703+0000 7fa239ffb700 1 -- 172.21.15.6:0/1118703363 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c003f30 con 0x55c85f2b9a00 2023-09-13T09:40:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa239ffb700 1 -- 172.21.15.6:0/1118703363 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa24c004090 con 0x55c85f2b9a00 2023-09-13T09:40:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c85f2ac670 con 0x55c85f2b9a00 2023-09-13T09:40:10.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa239ffb700 1 -- 172.21.15.6:0/1118703363 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa24c004500 con 0x55c85f2b9a00 2023-09-13T09:40:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 10 client.25117 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c85f2237a0 con 0x55c85f2b9a00 2023-09-13T09:40:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa239ffb700 1 -- 172.21.15.6:0/1118703363 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa24c03f020 con 0x55c85f2b9a00 2023-09-13T09:40:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa239ffb700 1 -- 172.21.15.6:0/1118703363 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa24c02f070 con 0x55c85f2b9a00 2023-09-13T09:40:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 10 client.25117 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:10.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 10 client.25117 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:40:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 20 client.25117 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f2d10f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 4 client.25117 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c85f204970 con 0x55c85f2cecd0 2023-09-13T09:40:10.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.704+0000 7fa255d14700 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f2d10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.705+0000 7fa239ffb700 10 client.25117 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.705+0000 7fa255d14700 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f2d10f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a0ee879d945b7e4b server_cookie=479fab28e8bec4eb in_seq=0 out_seq=0 2023-09-13T09:40:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa239ffb700 1 -- 172.21.15.6:0/1118703363 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c85f204970 con 0x55c85f2cecd0 2023-09-13T09:40:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa239ffb700 10 client.25117 handle_command_reply: tid=0 2023-09-13T09:40:10.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 client.25117 shutdown 2023-09-13T09:40:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2b9a00 msgr2=0x55c85f2c2ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2b9a00 0x55c85f2c2ef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa24c0099c0 tx=0x7fa24c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 shutdown_connections 2023-09-13T09:40:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f2d10f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa239ffb700 0 client.25117 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2b9a00 0x55c85f2c2ef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1118703363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2ba700 0x55c85f2c3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 >> 172.21.15.6:0/1118703363 conn(0x55c85f217c80 msgr2=0x55c85f2ae7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 shutdown_connections 2023-09-13T09:40:10.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 1 -- 172.21.15.6:0/1118703363 wait complete. 2023-09-13T09:40:10.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.706+0000 7fa26495eb80 20 client.25117 trim_cache size 0 max 16384 2023-09-13T09:40:10.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 Processor -- start 2023-09-13T09:40:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 -- start start 2023-09-13T09:40:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2b94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 0x55c85f2b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f2c0b60 con 0x55c85f2b9a00 2023-09-13T09:40:10.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f2be450 con 0x55c85f2bb060 2023-09-13T09:40:10.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa26495eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f2b5970 con 0x55c85f2ba700 2023-09-13T09:40:10.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2b94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2b94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34162/0 (socket says 172.21.15.6:34162) 2023-09-13T09:40:10.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 -- 172.21.15.6:0/4279096756 learned_addr learned my addr 172.21.15.6:0/4279096756 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256d16700 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 -- 172.21.15.6:0/4279096756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 msgr2=0x55c85f2b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 0x55c85f2b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 -- 172.21.15.6:0/4279096756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 msgr2=0x55c85f2ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256515700 1 -- 172.21.15.6:0/4279096756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c85f037de0 con 0x55c85f2b9a00 2023-09-13T09:40:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.723+0000 7fa256d16700 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.724+0000 7fa256515700 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2b94c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009350 tx=0x7fa24c003c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6721b5320f78a87c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.724+0000 7fa2457fa700 1 -- 172.21.15.6:0/4279096756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c00f9d0 con 0x55c85f2b9a00 2023-09-13T09:40:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.724+0000 7fa2457fa700 1 -- 172.21.15.6:0/4279096756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa24c03f070 con 0x55c85f2b9a00 2023-09-13T09:40:10.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.724+0000 7fa2457fa700 1 -- 172.21.15.6:0/4279096756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c004c20 con 0x55c85f2b9a00 2023-09-13T09:40:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- 172.21.15.6:0/4279096756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 msgr2=0x55c85f2b94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2b94c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009350 tx=0x7fa24c003c40 comp rx=0 tx=0).stop 2023-09-13T09:40:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- 172.21.15.6:0/4279096756 shutdown_connections 2023-09-13T09:40:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2bb060 0x55c85f2ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2b94c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 --2- 172.21.15.6:0/4279096756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2ba700 0x55c85f2b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- 172.21.15.6:0/4279096756 >> 172.21.15.6:0/4279096756 conn(0x55c85f217c80 msgr2=0x55c85f2c1be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- 172.21.15.6:0/4279096756 shutdown_connections 2023-09-13T09:40:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- 172.21.15.6:0/4279096756 wait complete. 2023-09-13T09:40:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- start start 2023-09-13T09:40:10.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 Processor -- start 2023-09-13T09:40:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2ba700 0x55c85f2c60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2bb060 0x55c85f2c9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f2c9650 con 0x55c85f2b9a00 2023-09-13T09:40:10.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f2c97c0 con 0x55c85f2ba700 2023-09-13T09:40:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c85f2c9980 con 0x55c85f2bb060 2023-09-13T09:40:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.725+0000 7fa26495eb80 10 client.0 _ll_register_callbacks cb 0x55c85f1a7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34168/0 (socket says 172.21.15.6:34168) 2023-09-13T09:40:10.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 -- 172.21.15.6:0/1523517113 learned_addr learned my addr 172.21.15.6:0/1523517113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa255d14700 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2ba700 0x55c85f2c60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256d16700 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2bb060 0x55c85f2c9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 -- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2bb060 msgr2=0x55c85f2c9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2bb060 0x55c85f2c9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 -- 172.21.15.6:0/1523517113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2ba700 msgr2=0x55c85f2c60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2ba700 0x55c85f2c60f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 -- 172.21.15.6:0/1523517113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c85f2237a0 con 0x55c85f2b9a00 2023-09-13T09:40:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa256515700 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2c5bb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005f50 tx=0x7fa24c00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a742b7f97d87662 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa239ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.726+0000 7fa239ffb700 1 -- 172.21.15.6:0/1523517113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24c004500 con 0x55c85f2b9a00 2023-09-13T09:40:10.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa240015070 con 0x55c85f2b9a00 2023-09-13T09:40:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa239ffb700 1 -- 172.21.15.6:0/1523517113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa24c040080 con 0x55c85f2b9a00 2023-09-13T09:40:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa239ffb700 1 -- 172.21.15.6:0/1523517113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa24c004660 con 0x55c85f2b9a00 2023-09-13T09:40:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 10 client.15543 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c85f020c60 con 0x55c85f2b9a00 2023-09-13T09:40:10.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa239ffb700 1 -- 172.21.15.6:0/1523517113 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa240015070 con 0x55c85f2b9a00 2023-09-13T09:40:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa239ffb700 1 -- 172.21.15.6:0/1523517113 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa24c0055a0 con 0x55c85f2b9a00 2023-09-13T09:40:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 10 client.15543 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 10 client.15543 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:40:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 20 client.15543 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f324ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 4 client.15543 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c85f1c5050 con 0x55c85f2cecd0 2023-09-13T09:40:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.727+0000 7fa255d14700 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f324ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa239ffb700 10 client.15543 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa255d14700 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f324ea0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d4df4910caf23cc2 server_cookie=ef3482cb041f772e in_seq=0 out_seq=0 2023-09-13T09:40:10.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa239ffb700 1 -- 172.21.15.6:0/1523517113 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c85f1c5050 con 0x55c85f2cecd0 2023-09-13T09:40:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa239ffb700 10 client.15543 handle_command_reply: tid=0 2023-09-13T09:40:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 client.15543 shutdown 2023-09-13T09:40:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 msgr2=0x55c85f2c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2c5bb0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fa24c005f50 tx=0x7fa24c00fc00 comp rx=0 tx=0).stop 2023-09-13T09:40:10.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 shutdown_connections 2023-09-13T09:40:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c85f2cecd0 0x55c85f324ea0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c85f2bb060 0x55c85f2c9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c85f2b9a00 0x55c85f2c5bb0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa239ffb700 0 client.15543 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 --2- 172.21.15.6:0/1523517113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c85f2ba700 0x55c85f2c60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.728+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 >> 172.21.15.6:0/1523517113 conn(0x55c85f217c80 msgr2=0x55c85f2b3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.729+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 shutdown_connections 2023-09-13T09:40:10.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa26495eb80 1 -- 172.21.15.6:0/1523517113 wait complete. 2023-09-13T09:40:10.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa26495eb80 20 client.15543 trim_cache size 0 max 16384 2023-09-13T09:40:10.747 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa23c0a2850 msgr2=0x7fa23c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa23c0a2850 0x7fa23c0a4d10 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fa24c009f50 tx=0x7fa24c00b540 comp rx=0 tx=0).stop 2023-09-13T09:40:10.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa250101850 msgr2=0x7fa25019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa250101850 0x7fa25019be10 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fa248007ee0 tx=0x7fa24800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 shutdown_connections 2023-09-13T09:40:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa23c0a2850 0x7fa23c0a4d10 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa250101850 0x7fa25019be10 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2500ffcc0 0x7fa250194860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 --2- 172.21.15.6:0/3391981988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa250100eb0 0x7fa250194da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 >> 172.21.15.6:0/3391981988 conn(0x7fa2500fb210 msgr2=0x7fa2500fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 shutdown_connections 2023-09-13T09:40:10.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.730+0000 7fa258779700 1 -- 172.21.15.6:0/3391981988 wait complete. 2023-09-13T09:40:10.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:40:10.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1190430800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 msgr2=0x7f6be01000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1190430800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 0x7f6be01000e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009920 tx=0x7f6bdc009c30 comp rx=0 tx=0).stop 2023-09-13T09:40:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1190430800 shutdown_connections 2023-09-13T09:40:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1190430800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6be0101850 0x7f6be0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1190430800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 0x7f6be01000e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1190430800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0100eb0 0x7f6be0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1190430800 >> 172.21.15.6:0/1190430800 conn(0x7f6be00fb250 msgr2=0x7f6be00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1190430800 shutdown_connections 2023-09-13T09:40:10.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.898+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1190430800 wait complete. 2023-09-13T09:40:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.899+0000 7f6be7bd5700 1 Processor -- start 2023-09-13T09:40:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.899+0000 7f6be7bd5700 1 -- start start 2023-09-13T09:40:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.899+0000 7f6be7bd5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 0x7f6be0068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.899+0000 7f6be7bd5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6be0100eb0 0x7f6be019dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be7bd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0101850 0x7f6be0199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be7bd5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be0199f40 con 0x7f6be0101850 2023-09-13T09:40:10.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be7bd5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be019a0b0 con 0x7f6be00ffcc0 2023-09-13T09:40:10.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be7bd5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be019a270 con 0x7f6be0100eb0 2023-09-13T09:40:10.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0101850 0x7f6be0199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0101850 0x7f6be0199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34186/0 (socket says 172.21.15.6:34186) 2023-09-13T09:40:10.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 -- 172.21.15.6:0/1923402130 learned_addr learned my addr 172.21.15.6:0/1923402130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be5170700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6be0100eb0 0x7f6be019dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be5971700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 0x7f6be0068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 -- 172.21.15.6:0/1923402130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6be0100eb0 msgr2=0x7f6be019dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6be0100eb0 0x7f6be019dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 -- 172.21.15.6:0/1923402130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 msgr2=0x7f6be0068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 0x7f6be0068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 -- 172.21.15.6:0/1923402130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bdc009520 con 0x7f6be0101850 2023-09-13T09:40:10.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be6172700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0101850 0x7f6be0199770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800ef30 tx=0x7f6bd800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6bd6ffd700 1 -- 172.21.15.6:0/1923402130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd8018070 con 0x7f6be0101850 2023-09-13T09:40:10.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.900+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be019a4f0 con 0x7f6be0101850 2023-09-13T09:40:10.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.901+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be019aa00 con 0x7f6be0101850 2023-09-13T09:40:10.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.901+0000 7f6bd6ffd700 1 -- 172.21.15.6:0/1923402130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bd800f040 con 0x7f6be0101850 2023-09-13T09:40:10.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.901+0000 7f6bd6ffd700 1 -- 172.21.15.6:0/1923402130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd800ccf0 con 0x7f6be0101850 2023-09-13T09:40:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.903+0000 7f6bd6ffd700 1 -- 172.21.15.6:0/1923402130 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6bd8004ad0 con 0x7f6be0101850 2023-09-13T09:40:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.904+0000 7f6bd6ffd700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6bcc0a06c0 0x7f6bcc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.904+0000 7f6be5971700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6bcc0a06c0 0x7f6bcc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.904+0000 7f6bd6ffd700 1 -- 172.21.15.6:0/1923402130 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6bd80cb610 con 0x7f6be0101850 2023-09-13T09:40:10.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.905+0000 7f6be5971700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6bcc0a06c0 0x7f6bcc0a2b80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0098f0 tx=0x7f6bdc019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.905+0000 7f6bf3dbab80 1 Processor -- start 2023-09-13T09:40:10.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.905+0000 7f6bf3dbab80 1 -- start start 2023-09-13T09:40:10.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727e9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727e8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b072741780 con 0x55b0727ea060 2023-09-13T09:40:10.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07273f0a0 con 0x55b0727e9700 2023-09-13T09:40:10.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b07273a990 con 0x55b0727e8a00 2023-09-13T09:40:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727e84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34192/0 (socket says 172.21.15.6:34192) 2023-09-13T09:40:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 -- 172.21.15.6:0/3657205588 learned_addr learned my addr 172.21.15.6:0/3657205588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5971700 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727e9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be6172700 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727e8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 -- 172.21.15.6:0/3657205588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 msgr2=0x55b0727e8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727e8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 -- 172.21.15.6:0/3657205588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 msgr2=0x55b0727e9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727e9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 -- 172.21.15.6:0/3657205588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0725ba630 con 0x55b0727ea060 2023-09-13T09:40:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5971700 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.906+0000 7f6be5170700 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727e84c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009d30 tx=0x7f6bd0011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bfeb1ad0c8c9a07 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bcbfff700 1 -- 172.21.15.6:0/3657205588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0004250 con 0x55b0727ea060 2023-09-13T09:40:10.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bcbfff700 1 -- 172.21.15.6:0/3657205588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bd0004cf0 con 0x55b0727ea060 2023-09-13T09:40:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bcbfff700 1 -- 172.21.15.6:0/3657205588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0005610 con 0x55b0727ea060 2023-09-13T09:40:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/3657205588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 msgr2=0x55b0727e84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727e84c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0009d30 tx=0x7f6bd0011720 comp rx=0 tx=0).stop 2023-09-13T09:40:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/3657205588 shutdown_connections 2023-09-13T09:40:10.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727e8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727e9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/3657205588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727e84c0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.907+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/3657205588 >> 172.21.15.6:0/3657205588 conn(0x55b072746c80 msgr2=0x55b0727e2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.908+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/3657205588 shutdown_connections 2023-09-13T09:40:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.908+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/3657205588 wait complete. 2023-09-13T09:40:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.908+0000 7f6bf3dbab80 1 -- start start 2023-09-13T09:40:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.908+0000 7f6bf3dbab80 1 Processor -- start 2023-09-13T09:40:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e9700 0x55b0727f2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727ea060 0x55b0727f9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0726d8bb0 con 0x55b0727e9700 2023-09-13T09:40:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0726d88b0 con 0x55b0727ea060 2023-09-13T09:40:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0725bc920 con 0x55b0727e8a00 2023-09-13T09:40:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bf3dbab80 10 client.0 _ll_register_callbacks cb 0x55b0726d6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e9700 0x55b0727f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e9700 0x55b0727f2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34200/0 (socket says 172.21.15.6:34200) 2023-09-13T09:40:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 -- 172.21.15.6:0/2931269428 learned_addr learned my addr 172.21.15.6:0/2931269428 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be6172700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727ea060 0x55b0727f9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5971700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 -- 172.21.15.6:0/2931269428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 msgr2=0x55b0727f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727f1ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 -- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727ea060 msgr2=0x55b0727f9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727ea060 0x55b0727f9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 -- 172.21.15.6:0/2931269428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bd0009960 con 0x55b0727e9700 2023-09-13T09:40:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be6172700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727ea060 0x55b0727f9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6be5170700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e9700 0x55b0727f2410 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0000c00 tx=0x7f6bd0004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=360cc38027bbbdbd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.909+0000 7f6bc97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bc97fa700 1 -- 172.21.15.6:0/2931269428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd0004aa0 con 0x55b0727e9700 2023-09-13T09:40:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bc97fa700 1 -- 172.21.15.6:0/2931269428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6bd0004050 con 0x55b0727e9700 2023-09-13T09:40:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0727db670 con 0x55b0727e9700 2023-09-13T09:40:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bc97fa700 1 -- 172.21.15.6:0/2931269428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bd0004210 con 0x55b0727e9700 2023-09-13T09:40:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 10 client.15555 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b0727527a0 con 0x55b0727e9700 2023-09-13T09:40:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bc97fa700 1 -- 172.21.15.6:0/2931269428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b0727db670 con 0x55b0727e9700 2023-09-13T09:40:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bc97fa700 1 -- 172.21.15.6:0/2931269428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f6bd0022400 con 0x55b0727e9700 2023-09-13T09:40:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 10 client.15555 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 10 client.15555 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:40:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 20 client.15555 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b0727fdd70 0x55b072800190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 4 client.15555 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.910+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b072733970 con 0x55b0727fdd70 2023-09-13T09:40:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.911+0000 7f6be5971700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b0727fdd70 0x55b072800190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.911+0000 7f6be5971700 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b0727fdd70 0x55b072800190 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4312b48bf5cd1fde server_cookie=c1254ae0ea1bdd00 in_seq=0 out_seq=0 2023-09-13T09:40:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.911+0000 7f6bc97fa700 10 client.15555 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:10.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bc97fa700 1 -- 172.21.15.6:0/2931269428 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b072733970 con 0x55b0727fdd70 2023-09-13T09:40:10.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bc97fa700 10 client.15555 handle_command_reply: tid=0 2023-09-13T09:40:10.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 client.15555 shutdown 2023-09-13T09:40:10.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e9700 msgr2=0x55b0727f2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e9700 0x55b0727f2410 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6bd0000c00 tx=0x7f6bd0004f10 comp rx=0 tx=0).stop 2023-09-13T09:40:10.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 shutdown_connections 2023-09-13T09:40:10.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b0727fdd70 0x55b072800190 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727ea060 0x55b0727f9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e8a00 0x55b0727f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/2931269428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e9700 0x55b0727f2410 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 >> 172.21.15.6:0/2931269428 conn(0x55b072746c80 msgr2=0x55b0727dd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bc97fa700 0 client.15555 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 shutdown_connections 2023-09-13T09:40:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/2931269428 wait complete. 2023-09-13T09:40:10.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.912+0000 7f6bf3dbab80 20 client.15555 trim_cache size 0 max 16384 2023-09-13T09:40:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.925+0000 7f6bf3dbab80 1 Processor -- start 2023-09-13T09:40:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.925+0000 7f6bf3dbab80 1 -- start start 2023-09-13T09:40:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e8a00 0x55b0727e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727f9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727ea060 0x55b0727ec840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0727e4fd0 con 0x55b0727e8a00 2023-09-13T09:40:10.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0727f2b50 con 0x55b0727e9700 2023-09-13T09:40:10.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0727efa90 con 0x55b0727ea060 2023-09-13T09:40:10.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e8a00 0x55b0727e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e8a00 0x55b0727e84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34204/0 (socket says 172.21.15.6:34204) 2023-09-13T09:40:10.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 -- 172.21.15.6:0/590130462 learned_addr learned my addr 172.21.15.6:0/590130462 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5170700 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727f9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be6172700 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727ea060 0x55b0727ec840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 -- 172.21.15.6:0/590130462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727ea060 msgr2=0x55b0727ec840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727ea060 0x55b0727ec840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 -- 172.21.15.6:0/590130462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 msgr2=0x55b0727f9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727f9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5971700 1 -- 172.21.15.6:0/590130462 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b072566de0 con 0x55b0727e8a00 2023-09-13T09:40:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.926+0000 7f6be5170700 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.927+0000 7f6be5971700 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e8a00 0x55b0727e84c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00c010 tx=0x7f6bdc01e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5976b8e41cefc1eb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.927+0000 7f6bd4d82700 1 -- 172.21.15.6:0/590130462 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0343b0 con 0x55b0727e8a00 2023-09-13T09:40:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.927+0000 7f6bd4d82700 1 -- 172.21.15.6:0/590130462 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bdc02b050 con 0x55b0727e8a00 2023-09-13T09:40:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.927+0000 7f6bd4d82700 1 -- 172.21.15.6:0/590130462 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0052a0 con 0x55b0727e8a00 2023-09-13T09:40:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/590130462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e8a00 msgr2=0x55b0727e84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e8a00 0x55b0727e84c0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc00c010 tx=0x7f6bdc01e000 comp rx=0 tx=0).stop 2023-09-13T09:40:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/590130462 shutdown_connections 2023-09-13T09:40:10.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727ea060 0x55b0727ec840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727e8a00 0x55b0727e84c0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/590130462 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e9700 0x55b0727f9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/590130462 >> 172.21.15.6:0/590130462 conn(0x55b072746c80 msgr2=0x55b0727ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/590130462 shutdown_connections 2023-09-13T09:40:10.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/590130462 wait complete. 2023-09-13T09:40:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 -- start start 2023-09-13T09:40:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.928+0000 7f6bf3dbab80 1 Processor -- start 2023-09-13T09:40:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e8a00 0x55b0727f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e9700 0x55b0727f5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6bf3dbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0727f8a80 con 0x55b0727ea060 2023-09-13T09:40:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0727f8bf0 con 0x55b0727e8a00 2023-09-13T09:40:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6bf3dbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0727f8db0 con 0x55b0727e9700 2023-09-13T09:40:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6bf3dbab80 10 client.0 _ll_register_callbacks cb 0x55b0726d6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:10.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34212/0 (socket says 172.21.15.6:34212) 2023-09-13T09:40:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 -- 172.21.15.6:0/259863756 learned_addr learned my addr 172.21.15.6:0/259863756 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be5971700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e8a00 0x55b0727f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be5170700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e9700 0x55b0727f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 -- 172.21.15.6:0/259863756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e9700 msgr2=0x55b0727f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e9700 0x55b0727f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 -- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e8a00 msgr2=0x55b0727f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e8a00 0x55b0727f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be6172700 1 -- 172.21.15.6:0/259863756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0727527a0 con 0x55b0727ea060 2023-09-13T09:40:10.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.929+0000 7f6be5170700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e9700 0x55b0727f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6be6172700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727f8540 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8098dd0 tx=0x7f6bd8099380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7397c34a13031ee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bc97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bc97fa700 1 -- 172.21.15.6:0/259863756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bd80a0b90 con 0x55b0727ea060 2023-09-13T09:40:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bc97fa700 1 -- 172.21.15.6:0/259863756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6bd8098e40 con 0x55b0727ea060 2023-09-13T09:40:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6bd0004cf0 con 0x55b0727ea060 2023-09-13T09:40:10.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bc97fa700 1 -- 172.21.15.6:0/259863756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6bd809cc70 con 0x55b0727ea060 2023-09-13T09:40:10.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bf3dbab80 10 client.15561 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:10.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f6be0108a50 con 0x55b0727ea060 2023-09-13T09:40:10.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bc97fa700 1 -- 172.21.15.6:0/259863756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6bd807b020 con 0x55b0727ea060 2023-09-13T09:40:10.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bc97fa700 1 -- 172.21.15.6:0/259863756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f6bd80cb0d0 con 0x55b0727ea060 2023-09-13T09:40:10.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bf3dbab80 10 client.15561 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:10.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bf3dbab80 10 client.15561 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:40:10.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bf3dbab80 20 client.15561 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:10.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.930+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b072852b10 0x55b072854f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:10.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.931+0000 7f6bf3dbab80 4 client.15561 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:10.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.931+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b0726f4050 con 0x55b072852b10 2023-09-13T09:40:10.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.931+0000 7f6be5971700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b072852b10 0x55b072854f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:10.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.931+0000 7f6bc97fa700 10 client.15561 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:10.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.931+0000 7f6be5971700 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b072852b10 0x55b072854f30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d327ffc4819a147 server_cookie=72ee4ed62b3c09fe in_seq=0 out_seq=0 2023-09-13T09:40:10.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bc97fa700 1 -- 172.21.15.6:0/259863756 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b0726f4050 con 0x55b072852b10 2023-09-13T09:40:10.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bc97fa700 10 client.15561 handle_command_reply: tid=0 2023-09-13T09:40:10.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 client.15561 shutdown 2023-09-13T09:40:10.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 msgr2=0x55b0727f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727f8540 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6bd8098dd0 tx=0x7f6bd8099380 comp rx=0 tx=0).stop 2023-09-13T09:40:10.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 shutdown_connections 2023-09-13T09:40:10.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b072852b10 0x55b072854f30 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0727ea060 0x55b0727f8540 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0727e8a00 0x55b0727f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 --2- 172.21.15.6:0/259863756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0727e9700 0x55b0727f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bc97fa700 0 client.15561 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:10.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 >> 172.21.15.6:0/259863756 conn(0x55b072746c80 msgr2=0x55b0727ec840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 shutdown_connections 2023-09-13T09:40:10.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 1 -- 172.21.15.6:0/259863756 wait complete. 2023-09-13T09:40:10.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.932+0000 7f6bf3dbab80 20 client.15561 trim_cache size 0 max 16384 2023-09-13T09:40:10.952 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:10.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6bcc0a06c0 msgr2=0x7f6bcc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6bcc0a06c0 0x7f6bcc0a2b80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc0098f0 tx=0x7f6bdc019040 comp rx=0 tx=0).stop 2023-09-13T09:40:10.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0101850 msgr2=0x7f6be0199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0101850 0x7f6be0199770 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6bd800ef30 tx=0x7f6bd800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 shutdown_connections 2023-09-13T09:40:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6bcc0a06c0 0x7f6bcc0a2b80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be0101850 0x7f6be0199770 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6be00ffcc0 0x7f6be0068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 --2- 172.21.15.6:0/1923402130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6be0100eb0 0x7f6be019dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 >> 172.21.15.6:0/1923402130 conn(0x7f6be00fb250 msgr2=0x7f6be00fd5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 shutdown_connections 2023-09-13T09:40:10.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:10.933+0000 7f6be7bd5700 1 -- 172.21.15.6:0/1923402130 wait complete. 2023-09-13T09:40:10.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:40:11.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:10 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/511820799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:40:11.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 -- 172.21.15.6:0/1465370501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598101840 msgr2=0x7f2598103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 --2- 172.21.15.6:0/1465370501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598101840 0x7f2598103c30 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2588009990 tx=0x7f2588009ca0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 -- 172.21.15.6:0/1465370501 shutdown_connections 2023-09-13T09:40:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 --2- 172.21.15.6:0/1465370501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598106aa0 0x7f2598108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 --2- 172.21.15.6:0/1465370501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598101840 0x7f2598103c30 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 --2- 172.21.15.6:0/1465370501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2598104170 0x7f2598106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 -- 172.21.15.6:0/1465370501 >> 172.21.15.6:0/1465370501 conn(0x7f25980fb250 msgr2=0x7f25980fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.092+0000 7f259d0b9700 1 -- 172.21.15.6:0/1465370501 shutdown_connections 2023-09-13T09:40:11.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.093+0000 7f259d0b9700 1 -- 172.21.15.6:0/1465370501 wait complete. 2023-09-13T09:40:11.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.093+0000 7f259d0b9700 1 Processor -- start 2023-09-13T09:40:11.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259d0b9700 1 -- start start 2023-09-13T09:40:11.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259d0b9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2598101840 0x7f25981011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259d0b9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598104170 0x7f25980ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259d0b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598106aa0 0x7f25980ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259d0b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25981004d0 con 0x7f2598106aa0 2023-09-13T09:40:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259d0b9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2598100640 con 0x7f2598104170 2023-09-13T09:40:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259d0b9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25981a0ab0 con 0x7f2598101840 2023-09-13T09:40:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598106aa0 0x7f25980ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598106aa0 0x7f25980ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34228/0 (socket says 172.21.15.6:34228) 2023-09-13T09:40:11.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259759e700 1 -- 172.21.15.6:0/497236344 learned_addr learned my addr 172.21.15.6:0/497236344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f2596d9d700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2598101840 0x7f25981011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259659c700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598104170 0x7f25980ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259759e700 1 -- 172.21.15.6:0/497236344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2598101840 msgr2=0x7f25981011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259759e700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2598101840 0x7f25981011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259759e700 1 -- 172.21.15.6:0/497236344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598104170 msgr2=0x7f25980ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.094+0000 7f259759e700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598104170 0x7f25980ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.095+0000 7f259759e700 1 -- 172.21.15.6:0/497236344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25880095f0 con 0x7f2598106aa0 2023-09-13T09:40:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.095+0000 7f259759e700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598106aa0 0x7f25980ffd30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2590007ee0 tx=0x7f259000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.095+0000 7f257ffff700 1 -- 172.21.15.6:0/497236344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590017070 con 0x7f2598106aa0 2023-09-13T09:40:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.095+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25981a0d90 con 0x7f2598106aa0 2023-09-13T09:40:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.095+0000 7f257ffff700 1 -- 172.21.15.6:0/497236344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f259000f040 con 0x7f2598106aa0 2023-09-13T09:40:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.095+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25981a1240 con 0x7f2598106aa0 2023-09-13T09:40:11.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.095+0000 7f257ffff700 1 -- 172.21.15.6:0/497236344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590005580 con 0x7f2598106aa0 2023-09-13T09:40:11.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.098+0000 7f257ffff700 1 -- 172.21.15.6:0/497236344 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f25900057a0 con 0x7f2598106aa0 2023-09-13T09:40:11.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.098+0000 7f257ffff700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25800a0640 0x7f25800a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.099+0000 7f257ffff700 1 -- 172.21.15.6:0/497236344 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f25900cb1d0 con 0x7f2598106aa0 2023-09-13T09:40:11.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.099+0000 7f2596d9d700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25800a0640 0x7f25800a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.099+0000 7f2596d9d700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25800a0640 0x7f25800a2b00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f258800b5c0 tx=0x7f2588005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 Processor -- start 2023-09-13T09:40:11.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 -- start start 2023-09-13T09:40:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffec700 0x563a3ffecb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffed060 0x563a3ffeb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffeba00 0x563a3ffebe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3ff44780 con 0x563a3ffed060 2023-09-13T09:40:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3ff420a0 con 0x563a3ffec700 2023-09-13T09:40:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f25a929eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3ff3d990 con 0x563a3ffeba00 2023-09-13T09:40:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f259659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffed060 0x563a3ffeb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f259659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffed060 0x563a3ffeb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34234/0 (socket says 172.21.15.6:34234) 2023-09-13T09:40:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f259659c700 1 -- 172.21.15.6:0/2494868663 learned_addr learned my addr 172.21.15.6:0/2494868663 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f2596d9d700 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffec700 0x563a3ffecb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.100+0000 7f259759e700 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffeba00 0x563a3ffebe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f259659c700 1 -- 172.21.15.6:0/2494868663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffeba00 msgr2=0x563a3ffebe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f259659c700 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffeba00 0x563a3ffebe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f259659c700 1 -- 172.21.15.6:0/2494868663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffec700 msgr2=0x563a3ffecb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f259659c700 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffec700 0x563a3ffecb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f259659c700 1 -- 172.21.15.6:0/2494868663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a3fdbd630 con 0x563a3ffed060 2023-09-13T09:40:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f259659c700 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffed060 0x563a3ffeb4c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f258c007d70 tx=0x7f258c0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde360de3e4fb261 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f257d7fa700 1 -- 172.21.15.6:0/2494868663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c010e10 con 0x563a3ffed060 2023-09-13T09:40:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f257d7fa700 1 -- 172.21.15.6:0/2494868663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f258c015070 con 0x563a3ffed060 2023-09-13T09:40:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.101+0000 7f257d7fa700 1 -- 172.21.15.6:0/2494868663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c003e60 con 0x563a3ffed060 2023-09-13T09:40:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 -- 172.21.15.6:0/2494868663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffed060 msgr2=0x563a3ffeb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffed060 0x563a3ffeb4c0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f258c007d70 tx=0x7f258c0106b0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 -- 172.21.15.6:0/2494868663 shutdown_connections 2023-09-13T09:40:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffeba00 0x563a3ffebe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffec700 0x563a3ffecb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2494868663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffed060 0x563a3ffeb4c0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 -- 172.21.15.6:0/2494868663 >> 172.21.15.6:0/2494868663 conn(0x563a3ff49c80 msgr2=0x563a3ffe5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 -- 172.21.15.6:0/2494868663 shutdown_connections 2023-09-13T09:40:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 -- 172.21.15.6:0/2494868663 wait complete. 2023-09-13T09:40:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.102+0000 7f25a929eb80 1 -- start start 2023-09-13T09:40:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 1 Processor -- start 2023-09-13T09:40:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3fff4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fff54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3fffc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3fedbbb0 con 0x563a3ffeba00 2023-09-13T09:40:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3fedb8b0 con 0x563a3ffed060 2023-09-13T09:40:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3fdbf920 con 0x563a3ffec700 2023-09-13T09:40:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f25a929eb80 10 client.0 _ll_register_callbacks cb 0x563a3fed9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f259659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fff54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f2596d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3fff4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f259659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fff54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:37292/0 (socket says 172.21.15.6:37292) 2023-09-13T09:40:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f2596d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3fff4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34242/0 (socket says 172.21.15.6:34242) 2023-09-13T09:40:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f259659c700 1 -- 172.21.15.6:0/1350226545 learned_addr learned my addr 172.21.15.6:0/1350226545 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.103+0000 7f259759e700 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3fffc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f259759e700 1 -- 172.21.15.6:0/1350226545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 msgr2=0x563a3fff54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f259759e700 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fff54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f259759e700 1 -- 172.21.15.6:0/1350226545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 msgr2=0x563a3fff4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f259759e700 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3fff4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f259759e700 1 -- 172.21.15.6:0/1350226545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f258c0079a0 con 0x563a3ffed060 2023-09-13T09:40:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f2596d9d700 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3fff4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f259759e700 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3fffc4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25900c8ff0 tx=0x7f2590022250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=231372179701a892 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f257aff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:40:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f257aff5700 1 -- 172.21.15.6:0/1350226545 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2590098dd0 con 0x563a3ffed060 2023-09-13T09:40:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a3ffde670 con 0x563a3ffed060 2023-09-13T09:40:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f257aff5700 1 -- 172.21.15.6:0/1350226545 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f259009c7a0 con 0x563a3ffed060 2023-09-13T09:40:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f257aff5700 1 -- 172.21.15.6:0/1350226545 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25900a09e0 con 0x563a3ffed060 2023-09-13T09:40:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f25a929eb80 10 client.25166 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563a3ff557a0 con 0x563a3ffed060 2023-09-13T09:40:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.104+0000 7f257aff5700 1 -- 172.21.15.6:0/1350226545 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563a3ffde670 con 0x563a3ffed060 2023-09-13T09:40:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f257aff5700 1 -- 172.21.15.6:0/1350226545 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f25900b6bc0 con 0x563a3ffed060 2023-09-13T09:40:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f25a929eb80 10 client.25166 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f25a929eb80 10 client.25166 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:40:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f25a929eb80 20 client.25166 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f25a929eb80 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40000cf0 0x563a40003110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f25a929eb80 4 client.25166 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a3ff36970 con 0x563a40000cf0 2023-09-13T09:40:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.105+0000 7f2596d9d700 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40000cf0 0x563a40003110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.106+0000 7f257aff5700 10 client.25166 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.106+0000 7f2596d9d700 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40000cf0 0x563a40003110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=695479442c7a8df1 server_cookie=84c6dc7d245206df in_seq=0 out_seq=0 2023-09-13T09:40:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.106+0000 7f257aff5700 1 -- 172.21.15.6:0/1350226545 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563a3ff36970 con 0x563a40000cf0 2023-09-13T09:40:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.106+0000 7f257aff5700 10 client.25166 handle_command_reply: tid=0 2023-09-13T09:40:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.106+0000 7f25a929eb80 1 client.25166 shutdown 2023-09-13T09:40:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 msgr2=0x563a3fffc4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3fffc4e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f25900c8ff0 tx=0x7f2590022250 comp rx=0 tx=0).stop 2023-09-13T09:40:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 shutdown_connections 2023-09-13T09:40:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40000cf0 0x563a40003110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3fffc4e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f257aff5700 0 client.25166 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3fff4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 --2- 172.21.15.6:0/1350226545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fff54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 >> 172.21.15.6:0/1350226545 conn(0x563a3ff49c80 msgr2=0x563a3ffe07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 shutdown_connections 2023-09-13T09:40:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 1 -- 172.21.15.6:0/1350226545 wait complete. 2023-09-13T09:40:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.107+0000 7f25a929eb80 20 client.25166 trim_cache size 0 max 16384 2023-09-13T09:40:11.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 Processor -- start 2023-09-13T09:40:11.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 -- start start 2023-09-13T09:40:11.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3ffeb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fffc400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3ffef880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3fff4ad0 con 0x563a3ffeba00 2023-09-13T09:40:11.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3ffe7730 con 0x563a3ffed060 2023-09-13T09:40:11.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f25a929eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3ffde400 con 0x563a3ffec700 2023-09-13T09:40:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f2596d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3ffeb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f2596d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3ffeb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34246/0 (socket says 172.21.15.6:34246) 2023-09-13T09:40:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f2596d9d700 1 -- 172.21.15.6:0/2227755724 learned_addr learned my addr 172.21.15.6:0/2227755724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f259659c700 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fffc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.125+0000 7f259759e700 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3ffef880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f2596d9d700 1 -- 172.21.15.6:0/2227755724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 msgr2=0x563a3fffc400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f2596d9d700 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fffc400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f2596d9d700 1 -- 172.21.15.6:0/2227755724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 msgr2=0x563a3ffef880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f2596d9d700 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3ffef880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f2596d9d700 1 -- 172.21.15.6:0/2227755724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a3fd69de0 con 0x563a3ffeba00 2023-09-13T09:40:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f259759e700 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3ffef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f2596d9d700 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3ffeb4c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dfbe69891d153a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f257dffb700 1 -- 172.21.15.6:0/2227755724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258802a040 con 0x563a3ffeba00 2023-09-13T09:40:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f257dffb700 1 -- 172.21.15.6:0/2227755724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f258802b040 con 0x563a3ffeba00 2023-09-13T09:40:11.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.126+0000 7f257dffb700 1 -- 172.21.15.6:0/2227755724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2588023820 con 0x563a3ffeba00 2023-09-13T09:40:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 -- 172.21.15.6:0/2227755724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 msgr2=0x563a3ffeb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3ffeb4c0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588005000 comp rx=0 tx=0).stop 2023-09-13T09:40:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 -- 172.21.15.6:0/2227755724 shutdown_connections 2023-09-13T09:40:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffed060 0x563a3ffef880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffeba00 0x563a3ffeb4c0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 --2- 172.21.15.6:0/2227755724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffec700 0x563a3fffc400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 -- 172.21.15.6:0/2227755724 >> 172.21.15.6:0/2227755724 conn(0x563a3ff49c80 msgr2=0x563a3fff3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 -- 172.21.15.6:0/2227755724 shutdown_connections 2023-09-13T09:40:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 -- 172.21.15.6:0/2227755724 wait complete. 2023-09-13T09:40:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 -- start start 2023-09-13T09:40:11.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 Processor -- start 2023-09-13T09:40:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffeba00 0x563a3fff8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffec700 0x563a3fff8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.127+0000 7f25a929eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffed060 0x563a3fffb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f25a929eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3fffbaa0 con 0x563a3ffec700 2023-09-13T09:40:11.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f25a929eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3fffbc10 con 0x563a3ffeba00 2023-09-13T09:40:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f25a929eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a3fffbdd0 con 0x563a3ffed060 2023-09-13T09:40:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f25a929eb80 10 client.0 _ll_register_callbacks cb 0x563a3fed9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffec700 0x563a3fff8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffec700 0x563a3fff8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34256/0 (socket says 172.21.15.6:34256) 2023-09-13T09:40:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 -- 172.21.15.6:0/228331677 learned_addr learned my addr 172.21.15.6:0/228331677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259759e700 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffed060 0x563a3fffb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f2596d9d700 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffeba00 0x563a3fff8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 -- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffed060 msgr2=0x563a3fffb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffed060 0x563a3fffb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 -- 172.21.15.6:0/228331677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffeba00 msgr2=0x563a3fff8000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffeba00 0x563a3fff8000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 -- 172.21.15.6:0/228331677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2598109b00 con 0x563a3ffec700 2023-09-13T09:40:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f259659c700 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffec700 0x563a3fff8540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f258c007d40 tx=0x7f258c010c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2f582b93cf7857 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.128+0000 7f257aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f257aff5700 1 -- 172.21.15.6:0/228331677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f258c004220 con 0x563a3ffec700 2023-09-13T09:40:11.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f257aff5700 1 -- 172.21.15.6:0/228331677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f258c004380 con 0x563a3ffec700 2023-09-13T09:40:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f258c015070 con 0x563a3ffec700 2023-09-13T09:40:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f257aff5700 1 -- 172.21.15.6:0/228331677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f258c004540 con 0x563a3ffec700 2023-09-13T09:40:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 10 client.15579 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x563a3fd52c60 con 0x563a3ffec700 2023-09-13T09:40:11.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f257aff5700 1 -- 172.21.15.6:0/228331677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f258c015070 con 0x563a3ffec700 2023-09-13T09:40:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f257aff5700 1 -- 172.21.15.6:0/228331677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f258c004b50 con 0x563a3ffec700 2023-09-13T09:40:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 10 client.15579 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 10 client.15579 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:40:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 20 client.15579 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:11.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40055880 0x563a40057ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 4 client.15579 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:11.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563a3fef7050 con 0x563a40055880 2023-09-13T09:40:11.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.129+0000 7f2596d9d700 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40055880 0x563a40057ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f2596d9d700 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40055880 0x563a40057ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2754946b26665392 server_cookie=b1f18c5c0aa86a4f in_seq=0 out_seq=0 2023-09-13T09:40:11.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f257aff5700 10 client.15579 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:11.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f257aff5700 1 -- 172.21.15.6:0/228331677 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563a3fef7050 con 0x563a40055880 2023-09-13T09:40:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f257aff5700 10 client.15579 handle_command_reply: tid=0 2023-09-13T09:40:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 client.15579 shutdown 2023-09-13T09:40:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffec700 msgr2=0x563a3fff8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffec700 0x563a3fff8540 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f258c007d40 tx=0x7f258c010c10 comp rx=0 tx=0).stop 2023-09-13T09:40:11.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 shutdown_connections 2023-09-13T09:40:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x563a40055880 0x563a40057ca0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a3ffed060 0x563a3fffb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a3ffeba00 0x563a3fff8000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f257aff5700 0 client.15579 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:11.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 --2- 172.21.15.6:0/228331677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a3ffec700 0x563a3fff8540 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 >> 172.21.15.6:0/228331677 conn(0x563a3ff49c80 msgr2=0x563a3ffef880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 shutdown_connections 2023-09-13T09:40:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.130+0000 7f25a929eb80 1 -- 172.21.15.6:0/228331677 wait complete. 2023-09-13T09:40:11.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f25a929eb80 20 client.15579 trim_cache size 0 max 16384 2023-09-13T09:40:11.148 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25800a0640 msgr2=0x7f25800a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25800a0640 0x7f25800a2b00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f258800b5c0 tx=0x7f2588005960 comp rx=0 tx=0).stop 2023-09-13T09:40:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598106aa0 msgr2=0x7f25980ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598106aa0 0x7f25980ffd30 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2590007ee0 tx=0x7f259000d3b0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 shutdown_connections 2023-09-13T09:40:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25800a0640 0x7f25800a2b00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2598106aa0 0x7f25980ffd30 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2598101840 0x7f25981011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 --2- 172.21.15.6:0/497236344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2598104170 0x7f25980ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 >> 172.21.15.6:0/497236344 conn(0x7f25980fb250 msgr2=0x7f25981024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 shutdown_connections 2023-09-13T09:40:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.131+0000 7f259d0b9700 1 -- 172.21.15.6:0/497236344 wait complete. 2023-09-13T09:40:11.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:40:11.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:10 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/511820799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:40:11.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:10 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/511820799' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:40:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.286+0000 7f82b3b7a700 1 -- 172.21.15.6:0/333248070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac100eb0 msgr2=0x7f82ac101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.286+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/333248070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac100eb0 0x7f82ac101310 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f829c009990 tx=0x7f829c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 -- 172.21.15.6:0/333248070 shutdown_connections 2023-09-13T09:40:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/333248070 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ac101850 0x7f82ac108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/333248070 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac0ffcc0 0x7f82ac1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/333248070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac100eb0 0x7f82ac101310 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 -- 172.21.15.6:0/333248070 >> 172.21.15.6:0/333248070 conn(0x7f82ac0fb210 msgr2=0x7f82ac0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 -- 172.21.15.6:0/333248070 shutdown_connections 2023-09-13T09:40:11.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 -- 172.21.15.6:0/333248070 wait complete. 2023-09-13T09:40:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.287+0000 7f82b3b7a700 1 Processor -- start 2023-09-13T09:40:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b3b7a700 1 -- start start 2023-09-13T09:40:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b3b7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ffcc0 0x7f82ac196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b3b7a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ac100eb0 0x7f82ac196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b3b7a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac101850 0x7f82ac19e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b3b7a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac19e5e0 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b3b7a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac19e720 con 0x7f82ac101850 2023-09-13T09:40:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b3b7a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ac19e8b0 con 0x7f82ac100eb0 2023-09-13T09:40:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ffcc0 0x7f82ac196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ffcc0 0x7f82ac196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34266/0 (socket says 172.21.15.6:34266) 2023-09-13T09:40:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 -- 172.21.15.6:0/4215512554 learned_addr learned my addr 172.21.15.6:0/4215512554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b2117700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac101850 0x7f82ac19e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1115700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ac100eb0 0x7f82ac196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 -- 172.21.15.6:0/4215512554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ac100eb0 msgr2=0x7f82ac196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ac100eb0 0x7f82ac196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 -- 172.21.15.6:0/4215512554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac101850 msgr2=0x7f82ac19e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac101850 0x7f82ac19e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 -- 172.21.15.6:0/4215512554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f829c0095f0 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b2117700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac101850 0x7f82ac19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1115700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ac100eb0 0x7f82ac196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.288+0000 7f82b1916700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ffcc0 0x7f82ac196a60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d980 tx=0x7f82a800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.289+0000 7f82a2ffd700 1 -- 172.21.15.6:0/4215512554 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800bb60 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.289+0000 7f82a2ffd700 1 -- 172.21.15.6:0/4215512554 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a8007620 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.289+0000 7f82a2ffd700 1 -- 172.21.15.6:0/4215512554 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a800f620 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.289+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ac19eb90 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.289+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac19f050 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.291+0000 7f82a2ffd700 1 -- 172.21.15.6:0/4215512554 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f82a8010460 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.292+0000 7f82a2ffd700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82980a0640 0x7f82980a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.292+0000 7f82a2ffd700 1 -- 172.21.15.6:0/4215512554 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82a80cbc10 con 0x7f82ac0ffcc0 2023-09-13T09:40:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.292+0000 7f82b1115700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82980a0640 0x7f82980a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.293+0000 7f82b1115700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82980a0640 0x7f82980a2b00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f829c006010 tx=0x7f829c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.293+0000 7f82bfd5fb80 1 Processor -- start 2023-09-13T09:40:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.293+0000 7f82bfd5fb80 1 -- start start 2023-09-13T09:40:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.293+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.293+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.293+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640bb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236400f780 con 0x5623640bc470 2023-09-13T09:40:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56236400d0a0 con 0x5623640bae10 2023-09-13T09:40:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562364008990 con 0x5623640bbb10 2023-09-13T09:40:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640ba8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34276/0 (socket says 172.21.15.6:34276) 2023-09-13T09:40:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 -- 172.21.15.6:0/3226102490 learned_addr learned my addr 172.21.15.6:0/3226102490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1916700 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b2117700 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640bb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 -- 172.21.15.6:0/3226102490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 msgr2=0x5623640bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 -- 172.21.15.6:0/3226102490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 msgr2=0x5623640bb270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640bb270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 -- 172.21.15.6:0/3226102490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562363e88630 con 0x5623640bc470 2023-09-13T09:40:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b2117700 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640bb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f82b1115700 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640ba8d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f829c00b930 tx=0x7f829c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3d1359ca90bfc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f8297fff700 1 -- 172.21.15.6:0/3226102490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c02b070 con 0x5623640bc470 2023-09-13T09:40:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.294+0000 7f8297fff700 1 -- 172.21.15.6:0/3226102490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c01e040 con 0x5623640bc470 2023-09-13T09:40:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f8297fff700 1 -- 172.21.15.6:0/3226102490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f829c024890 con 0x5623640bc470 2023-09-13T09:40:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/3226102490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 msgr2=0x5623640ba8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640ba8d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f829c00b930 tx=0x7f829c01f000 comp rx=0 tx=0).stop 2023-09-13T09:40:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/3226102490 shutdown_connections 2023-09-13T09:40:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640bb270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/3226102490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640ba8d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/3226102490 >> 172.21.15.6:0/3226102490 conn(0x562364014c80 msgr2=0x5623640b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/3226102490 shutdown_connections 2023-09-13T09:40:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.295+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/3226102490 wait complete. 2023-09-13T09:40:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 -- start start 2023-09-13T09:40:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 Processor -- start 2023-09-13T09:40:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bae10 0x5623640c4250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640c4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bc470 0x5623640cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562363fa6bb0 con 0x5623640bae10 2023-09-13T09:40:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562363fa68b0 con 0x5623640bc470 2023-09-13T09:40:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562363e8a920 con 0x5623640bbb10 2023-09-13T09:40:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.296+0000 7f82bfd5fb80 10 client.0 _ll_register_callbacks cb 0x562363fa4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bae10 0x5623640c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bae10 0x5623640c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34280/0 (socket says 172.21.15.6:34280) 2023-09-13T09:40:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 -- 172.21.15.6:0/265929333 learned_addr learned my addr 172.21.15.6:0/265929333 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b2117700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bc470 0x5623640cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1115700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 -- 172.21.15.6:0/265929333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 msgr2=0x5623640c4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640c4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 -- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bc470 msgr2=0x5623640cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bc470 0x5623640cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 -- 172.21.15.6:0/265929333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ac068e70 con 0x5623640bae10 2023-09-13T09:40:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b2117700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bc470 0x5623640cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82b1916700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bae10 0x5623640c4250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f82a80992f0 tx=0x7f82a8084130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39305e364831dd37 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82957fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82957fa700 1 -- 172.21.15.6:0/265929333 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8099ab0 con 0x5623640bae10 2023-09-13T09:40:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82957fa700 1 -- 172.21.15.6:0/265929333 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82a80993b0 con 0x5623640bae10 2023-09-13T09:40:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.297+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623640a9670 con 0x5623640bae10 2023-09-13T09:40:11.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82957fa700 1 -- 172.21.15.6:0/265929333 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a809d1e0 con 0x5623640bae10 2023-09-13T09:40:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 10 client.15591 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5623640207a0 con 0x5623640bae10 2023-09-13T09:40:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82957fa700 1 -- 172.21.15.6:0/265929333 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623640a9670 con 0x5623640bae10 2023-09-13T09:40:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82957fa700 1 -- 172.21.15.6:0/265929333 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f82a8099610 con 0x5623640bae10 2023-09-13T09:40:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 10 client.15591 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 10 client.15591 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 20 client.15591 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5623640cff70 0x5623640d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 4 client.15591 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562364001970 con 0x5623640cff70 2023-09-13T09:40:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.298+0000 7f82b1115700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5623640cff70 0x5623640d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.299+0000 7f82957fa700 10 client.15591 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.299+0000 7f82b1115700 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5623640cff70 0x5623640d2390 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51173171cf02fabb server_cookie=78330261d8f899de in_seq=0 out_seq=0 2023-09-13T09:40:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82957fa700 1 -- 172.21.15.6:0/265929333 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562364001970 con 0x5623640cff70 2023-09-13T09:40:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82957fa700 10 client.15591 handle_command_reply: tid=0 2023-09-13T09:40:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 client.15591 shutdown 2023-09-13T09:40:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bae10 msgr2=0x5623640c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bae10 0x5623640c4250 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f82a80992f0 tx=0x7f82a8084130 comp rx=0 tx=0).stop 2023-09-13T09:40:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 shutdown_connections 2023-09-13T09:40:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bc470 0x5623640cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5623640cff70 0x5623640d2390 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bae10 0x5623640c4250 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/265929333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640c4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 >> 172.21.15.6:0/265929333 conn(0x562364014c80 msgr2=0x5623640ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82957fa700 0 client.15591 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 shutdown_connections 2023-09-13T09:40:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/265929333 wait complete. 2023-09-13T09:40:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.300+0000 7f82bfd5fb80 20 client.15591 trim_cache size 0 max 16384 2023-09-13T09:40:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 Processor -- start 2023-09-13T09:40:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 -- start start 2023-09-13T09:40:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640becf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640cb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640bf230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623640b1810 con 0x5623640bc470 2023-09-13T09:40:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623640cd490 con 0x5623640bae10 2023-09-13T09:40:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.324+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623640cfd40 con 0x5623640bbb10 2023-09-13T09:40:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640bf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640bf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34292/0 (socket says 172.21.15.6:34292) 2023-09-13T09:40:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 -- 172.21.15.6:0/1212359049 learned_addr learned my addr 172.21.15.6:0/1212359049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b1916700 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640becf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b1115700 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640cb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 -- 172.21.15.6:0/1212359049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 msgr2=0x5623640cb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640cb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 -- 172.21.15.6:0/1212359049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 msgr2=0x5623640becf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640becf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 -- 172.21.15.6:0/1212359049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562363e34de0 con 0x5623640bc470 2023-09-13T09:40:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82b2117700 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640bf230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f82a4007750 tx=0x7f82a4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd1e4ddb2ca82d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82a0d82700 1 -- 172.21.15.6:0/1212359049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4017710 con 0x5623640bc470 2023-09-13T09:40:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82a0d82700 1 -- 172.21.15.6:0/1212359049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82a400f070 con 0x5623640bc470 2023-09-13T09:40:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.325+0000 7f82a0d82700 1 -- 172.21.15.6:0/1212359049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a4016d40 con 0x5623640bc470 2023-09-13T09:40:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/1212359049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 msgr2=0x5623640bf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640bf230 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f82a4007750 tx=0x7f82a4009040 comp rx=0 tx=0).stop 2023-09-13T09:40:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/1212359049 shutdown_connections 2023-09-13T09:40:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640bf230 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bae10 0x5623640becf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/1212359049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bbb10 0x5623640cb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/1212359049 >> 172.21.15.6:0/1212359049 conn(0x562364014c80 msgr2=0x5623640b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/1212359049 shutdown_connections 2023-09-13T09:40:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.326+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/1212359049 wait complete. 2023-09-13T09:40:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 -- start start 2023-09-13T09:40:11.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 Processor -- start 2023-09-13T09:40:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bae10 0x5623640c7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bbb10 0x5623640c7e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623640caf60 con 0x5623640bc470 2023-09-13T09:40:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623640cb0d0 con 0x5623640bbb10 2023-09-13T09:40:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623640cb290 con 0x5623640bae10 2023-09-13T09:40:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82bfd5fb80 10 client.0 _ll_register_callbacks cb 0x5623640b1ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82b2117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82b2117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34296/0 (socket says 172.21.15.6:34296) 2023-09-13T09:40:11.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82b2117700 1 -- 172.21.15.6:0/600556383 learned_addr learned my addr 172.21.15.6:0/600556383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.327+0000 7f82b1916700 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bae10 0x5623640c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82b1916700 1 -- 172.21.15.6:0/600556383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bbb10 msgr2=0x5623640c7e60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:40:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82b1916700 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bbb10 0x5623640c7e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82b1916700 1 -- 172.21.15.6:0/600556383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 msgr2=0x5623640caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:11.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82b1916700 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640caa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82b1916700 1 -- 172.21.15.6:0/600556383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82a4007400 con 0x5623640bae10 2023-09-13T09:40:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82b2117700 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82b1916700 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bae10 0x5623640c7920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82a8097700 tx=0x7f82a80841a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=137c7f43d71ceb4c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82957fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:40:11.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82957fa700 1 -- 172.21.15.6:0/600556383 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82a8014040 con 0x5623640bae10 2023-09-13T09:40:11.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82957fa700 1 -- 172.21.15.6:0/600556383 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82a8099ab0 con 0x5623640bae10 2023-09-13T09:40:11.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f829c01e040 con 0x5623640bae10 2023-09-13T09:40:11.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82957fa700 1 -- 172.21.15.6:0/600556383 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82a8010e40 con 0x5623640bae10 2023-09-13T09:40:11.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82bfd5fb80 10 client.25171 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:11.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.328+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562363e1dc60 con 0x5623640bae10 2023-09-13T09:40:11.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82957fa700 1 -- 172.21.15.6:0/600556383 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f829c01e040 con 0x5623640bae10 2023-09-13T09:40:11.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82957fa700 1 -- 172.21.15.6:0/600556383 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f82a80b71a0 con 0x5623640bae10 2023-09-13T09:40:11.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82bfd5fb80 10 client.25171 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:11.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82bfd5fb80 10 client.25171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:11.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82bfd5fb80 20 client.25171 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562364124980 0x562364126da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82bfd5fb80 4 client.25171 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562363fc2050 con 0x562364124980 2023-09-13T09:40:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.329+0000 7f82b1115700 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562364124980 0x562364126da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82957fa700 10 client.25171 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:11.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82b1115700 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562364124980 0x562364126da0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6db284a60fa3bbb server_cookie=6982ca36ed4a4d5f in_seq=0 out_seq=0 2023-09-13T09:40:11.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82957fa700 1 -- 172.21.15.6:0/600556383 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562363fc2050 con 0x562364124980 2023-09-13T09:40:11.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82957fa700 10 client.25171 handle_command_reply: tid=0 2023-09-13T09:40:11.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 client.25171 shutdown 2023-09-13T09:40:11.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bae10 msgr2=0x5623640c7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bae10 0x5623640c7920 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f82a8097700 tx=0x7f82a80841a0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 shutdown_connections 2023-09-13T09:40:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562364124980 0x562364126da0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623640bc470 0x5623640caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623640bae10 0x5623640c7920 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 --2- 172.21.15.6:0/600556383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623640bbb10 0x5623640c7e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 >> 172.21.15.6:0/600556383 conn(0x562364014c80 msgr2=0x5623640becf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82957fa700 0 client.25171 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:11.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 shutdown_connections 2023-09-13T09:40:11.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 1 -- 172.21.15.6:0/600556383 wait complete. 2023-09-13T09:40:11.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.330+0000 7f82bfd5fb80 20 client.25171 trim_cache size 0 max 16384 2023-09-13T09:40:11.346 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:11.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82980a0640 msgr2=0x7f82980a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82980a0640 0x7f82980a2b00 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f829c006010 tx=0x7f829c00b540 comp rx=0 tx=0).stop 2023-09-13T09:40:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ffcc0 msgr2=0x7f82ac196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ffcc0 0x7f82ac196a60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f82a800d980 tx=0x7f82a800dd40 comp rx=0 tx=0).stop 2023-09-13T09:40:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 shutdown_connections 2023-09-13T09:40:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ac101850 0x7f82ac19e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82980a0640 0x7f82980a2b00 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ac0ffcc0 0x7f82ac196a60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 --2- 172.21.15.6:0/4215512554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ac100eb0 0x7f82ac196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 >> 172.21.15.6:0/4215512554 conn(0x7f82ac0fb210 msgr2=0x7f82ac0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 shutdown_connections 2023-09-13T09:40:11.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:11.331+0000 7f82b3b7a700 1 -- 172.21.15.6:0/4215512554 wait complete. 2023-09-13T09:40:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:11 smithi006 ceph-mon[98665]: pgmap v320: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 7 op/s 2023-09-13T09:40:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:11 smithi053 ceph-mon[102373]: pgmap v320: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 7 op/s 2023-09-13T09:40:12.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:11 smithi131 ceph-mon[102785]: pgmap v320: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 0 B/s wr, 7 op/s 2023-09-13T09:40:12.351 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:40:12.351 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:40:12.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.509+0000 7faa55a36700 1 -- 172.21.15.6:0/470946931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa50100e80 msgr2=0x7faa501012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.509+0000 7faa55a36700 1 --2- 172.21.15.6:0/470946931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa50100e80 0x7faa501012e0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7faa440099c0 tx=0x7faa44009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.509+0000 7faa55a36700 1 -- 172.21.15.6:0/470946931 shutdown_connections 2023-09-13T09:40:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.509+0000 7faa55a36700 1 --2- 172.21.15.6:0/470946931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa50101820 0x7faa501080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.509+0000 7faa55a36700 1 --2- 172.21.15.6:0/470946931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa500ffc90 0x7faa501000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.509+0000 7faa55a36700 1 --2- 172.21.15.6:0/470946931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa50100e80 0x7faa501012e0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.509+0000 7faa55a36700 1 -- 172.21.15.6:0/470946931 >> 172.21.15.6:0/470946931 conn(0x7faa500fb220 msgr2=0x7faa500fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.510+0000 7faa55a36700 1 -- 172.21.15.6:0/470946931 shutdown_connections 2023-09-13T09:40:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.510+0000 7faa55a36700 1 -- 172.21.15.6:0/470946931 wait complete. 2023-09-13T09:40:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.510+0000 7faa55a36700 1 Processor -- start 2023-09-13T09:40:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa55a36700 1 -- start start 2023-09-13T09:40:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa55a36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa500ffc90 0x7faa50198cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa55a36700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa50100e80 0x7faa50199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa55a36700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa50101820 0x7faa501a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa55a36700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501a0830 con 0x7faa500ffc90 2023-09-13T09:40:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa55a36700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501a09a0 con 0x7faa50100e80 2023-09-13T09:40:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa55a36700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa501a0b60 con 0x7faa50101820 2023-09-13T09:40:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa500ffc90 0x7faa50198cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa500ffc90 0x7faa50198cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34306/0 (socket says 172.21.15.6:34306) 2023-09-13T09:40:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 -- 172.21.15.6:0/51123940 learned_addr learned my addr 172.21.15.6:0/51123940 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4f7fe700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa50101820 0x7faa501a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa50100e80 0x7faa50199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 -- 172.21.15.6:0/51123940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa50101820 msgr2=0x7faa501a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa50101820 0x7faa501a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 -- 172.21.15.6:0/51123940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa50100e80 msgr2=0x7faa50199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa50100e80 0x7faa50199200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.511+0000 7faa4effd700 1 -- 172.21.15.6:0/51123940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa440095f0 con 0x7faa500ffc90 2023-09-13T09:40:12.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.512+0000 7faa4effd700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa500ffc90 0x7faa50198cc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faa4000c990 tx=0x7faa4000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.512+0000 7faa54a34700 1 -- 172.21.15.6:0/51123940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40007940 con 0x7faa500ffc90 2023-09-13T09:40:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.512+0000 7faa54a34700 1 -- 172.21.15.6:0/51123940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa4000f450 con 0x7faa500ffc90 2023-09-13T09:40:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.512+0000 7faa54a34700 1 -- 172.21.15.6:0/51123940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40018660 con 0x7faa500ffc90 2023-09-13T09:40:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.512+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa501a0e40 con 0x7faa500ffc90 2023-09-13T09:40:12.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.512+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa501a1210 con 0x7faa500ffc90 2023-09-13T09:40:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.515+0000 7faa54a34700 1 -- 172.21.15.6:0/51123940 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7faa4000f8c0 con 0x7faa500ffc90 2023-09-13T09:40:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.516+0000 7faa54a34700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa380a06c0 0x7faa380a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.516+0000 7faa54a34700 1 -- 172.21.15.6:0/51123940 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa400cba30 con 0x7faa500ffc90 2023-09-13T09:40:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.516+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa380a06c0 0x7faa380a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa380a06c0 0x7faa380a2b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faa44006010 tx=0x7faa44005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 Processor -- start 2023-09-13T09:40:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 -- start start 2023-09-13T09:40:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897cf90 0x55a99897d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897d8f0 0x55a99897bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a99897c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9988cc800 con 0x55a99897d8f0 2023-09-13T09:40:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9988ca120 con 0x55a99897c290 2023-09-13T09:40:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.517+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9988c5a10 con 0x55a99897cf90 2023-09-13T09:40:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897cf90 0x55a99897d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897d8f0 0x55a99897bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897cf90 0x55a99897d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:37368/0 (socket says 172.21.15.6:37368) 2023-09-13T09:40:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 -- 172.21.15.6:0/2593047691 learned_addr learned my addr 172.21.15.6:0/2593047691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4f7fe700 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a99897c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 -- 172.21.15.6:0/2593047691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 msgr2=0x55a99897c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a99897c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 -- 172.21.15.6:0/2593047691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897d8f0 msgr2=0x55a99897bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897d8f0 0x55a99897bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 -- 172.21.15.6:0/2593047691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9987456b0 con 0x55a99897cf90 2023-09-13T09:40:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa4effd700 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897cf90 0x55a99897d3b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa400a0d10 tx=0x7faa40098b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27b3adf1ebf3c9fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.518+0000 7faa35ffb700 1 -- 172.21.15.6:0/2593047691 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4009d000 con 0x55a99897cf90 2023-09-13T09:40:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.519+0000 7faa35ffb700 1 -- 172.21.15.6:0/2593047691 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa400a1240 con 0x55a99897cf90 2023-09-13T09:40:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.519+0000 7faa35ffb700 1 -- 172.21.15.6:0/2593047691 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400958e0 con 0x55a99897cf90 2023-09-13T09:40:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.519+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2593047691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897cf90 msgr2=0x55a99897d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.519+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897cf90 0x55a99897d3b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7faa400a0d10 tx=0x7faa40098b30 comp rx=0 tx=0).stop 2023-09-13T09:40:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2593047691 shutdown_connections 2023-09-13T09:40:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a99897c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897cf90 0x55a99897d3b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2593047691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897d8f0 0x55a99897bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2593047691 >> 172.21.15.6:0/2593047691 conn(0x55a9988d1d00 msgr2=0x55a99896df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2593047691 shutdown_connections 2023-09-13T09:40:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2593047691 wait complete. 2023-09-13T09:40:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 -- start start 2023-09-13T09:40:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 Processor -- start 2023-09-13T09:40:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a9989857f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.520+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a998985d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a99898cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a998863c30 con 0x55a99897cf90 2023-09-13T09:40:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a998863930 con 0x55a99897d8f0 2023-09-13T09:40:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9987479a0 con 0x55a99897c290 2023-09-13T09:40:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa61c1bb80 10 client.0 _ll_register_callbacks cb 0x55a998861700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a998985d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a998985d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34324/0 (socket says 172.21.15.6:34324) 2023-09-13T09:40:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 -- 172.21.15.6:0/1484044626 learned_addr learned my addr 172.21.15.6:0/1484044626 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4effd700 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a9989857f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4f7fe700 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a99898cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 -- 172.21.15.6:0/1484044626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 msgr2=0x55a9989857f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a9989857f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 -- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 msgr2=0x55a99898cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a99898cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 -- 172.21.15.6:0/1484044626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa501a1210 con 0x55a99897cf90 2023-09-13T09:40:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a998985d30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faa44005210 tx=0x7faa44009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fc3589964d8ede server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.521+0000 7faa2effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa2effd700 1 -- 172.21.15.6:0/1484044626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44003f80 con 0x55a99897cf90 2023-09-13T09:40:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9989666f0 con 0x55a99897cf90 2023-09-13T09:40:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa2effd700 1 -- 172.21.15.6:0/1484044626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa440040e0 con 0x55a99897cf90 2023-09-13T09:40:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa2effd700 1 -- 172.21.15.6:0/1484044626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa44004500 con 0x55a99897cf90 2023-09-13T09:40:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa61c1bb80 10 client.15609 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9988dd820 con 0x55a99897cf90 2023-09-13T09:40:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa2effd700 1 -- 172.21.15.6:0/1484044626 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa4403f020 con 0x55a99897cf90 2023-09-13T09:40:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa2effd700 1 -- 172.21.15.6:0/1484044626 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7faa4402f070 con 0x55a99897cf90 2023-09-13T09:40:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa61c1bb80 10 client.15609 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa61c1bb80 10 client.15609 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.522+0000 7faa61c1bb80 20 client.15609 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.523+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a998991660 0x55a998993a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.523+0000 7faa61c1bb80 4 client.15609 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:12.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.523+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9988be9f0 con 0x55a998991660 2023-09-13T09:40:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.523+0000 7faa4effd700 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a998991660 0x55a998993a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.523+0000 7faa2effd700 10 client.15609 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.523+0000 7faa4effd700 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a998991660 0x55a998993a80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb6e587c452fe5c server_cookie=fe900bd94bb790a0 in_seq=0 out_seq=0 2023-09-13T09:40:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa2effd700 1 -- 172.21.15.6:0/1484044626 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a9988be9f0 con 0x55a998991660 2023-09-13T09:40:12.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa2effd700 10 client.15609 handle_command_reply: tid=0 2023-09-13T09:40:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 client.15609 shutdown 2023-09-13T09:40:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 msgr2=0x55a998985d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a998985d30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7faa44005210 tx=0x7faa44009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 shutdown_connections 2023-09-13T09:40:12.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a99898cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a9989857f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a998991660 0x55a998993a80 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/1484044626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a998985d30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa2effd700 0 client.15609 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 >> 172.21.15.6:0/1484044626 conn(0x55a9988d1d00 msgr2=0x55a998968870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 shutdown_connections 2023-09-13T09:40:12.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.524+0000 7faa61c1bb80 1 -- 172.21.15.6:0/1484044626 wait complete. 2023-09-13T09:40:12.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.525+0000 7faa61c1bb80 20 client.15609 trim_cache size 0 max 16384 2023-09-13T09:40:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 Processor -- start 2023-09-13T09:40:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 -- start start 2023-09-13T09:40:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a99897bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898cd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a998967960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a998984ac0 con 0x55a99897cf90 2023-09-13T09:40:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99896a960 con 0x55a99897d8f0 2023-09-13T09:40:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99896f7b0 con 0x55a99897c290 2023-09-13T09:40:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa4effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a99897bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34332/0 (socket says 172.21.15.6:34332) 2023-09-13T09:40:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa4effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a99897bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:37382/0 (socket says 172.21.15.6:37382) 2023-09-13T09:40:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.547+0000 7faa4e7fc700 1 -- 172.21.15.6:0/2993146510 learned_addr learned my addr 172.21.15.6:0/2993146510 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa4f7fe700 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a998967960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa4effd700 1 -- 172.21.15.6:0/2993146510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 msgr2=0x55a998967960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa4effd700 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a998967960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa4effd700 1 -- 172.21.15.6:0/2993146510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 msgr2=0x55a99898cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa4effd700 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa4effd700 1 -- 172.21.15.6:0/2993146510 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9986f1e60 con 0x55a99897c290 2023-09-13T09:40:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa4effd700 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a99897bd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa400c9850 tx=0x7faa40095640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3251d2c26a812aa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa367fc700 1 -- 172.21.15.6:0/2993146510 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40081070 con 0x55a99897c290 2023-09-13T09:40:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa367fc700 1 -- 172.21.15.6:0/2993146510 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa40097650 con 0x55a99897c290 2023-09-13T09:40:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.548+0000 7faa367fc700 1 -- 172.21.15.6:0/2993146510 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400958e0 con 0x55a99897c290 2023-09-13T09:40:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2993146510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 msgr2=0x55a99897bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a99897bd50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7faa400c9850 tx=0x7faa40095640 comp rx=0 tx=0).stop 2023-09-13T09:40:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2993146510 shutdown_connections 2023-09-13T09:40:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897d8f0 0x55a998967960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897c290 0x55a99897bd50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/2993146510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2993146510 >> 172.21.15.6:0/2993146510 conn(0x55a9988d1d00 msgr2=0x55a9989801b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2993146510 shutdown_connections 2023-09-13T09:40:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.549+0000 7faa61c1bb80 1 -- 172.21.15.6:0/2993146510 wait complete. 2023-09-13T09:40:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 -- start start 2023-09-13T09:40:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 Processor -- start 2023-09-13T09:40:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a998989ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897d8f0 0x55a9989e5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99898a580 con 0x55a99897cf90 2023-09-13T09:40:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a99898a6f0 con 0x55a99897c290 2023-09-13T09:40:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9989e59f0 con 0x55a99897d8f0 2023-09-13T09:40:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa61c1bb80 10 client.0 _ll_register_callbacks cb 0x55a998861700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa4effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a998989ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa4e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34336/0 (socket says 172.21.15.6:34336) 2023-09-13T09:40:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.550+0000 7faa4e7fc700 1 -- 172.21.15.6:0/3814472113 learned_addr learned my addr 172.21.15.6:0/3814472113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4f7fe700 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897d8f0 0x55a9989e5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4e7fc700 1 -- 172.21.15.6:0/3814472113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897d8f0 msgr2=0x55a9989e5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897d8f0 0x55a9989e5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4e7fc700 1 -- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 msgr2=0x55a998989ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a998989ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4e7fc700 1 -- 172.21.15.6:0/3814472113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a9987456b0 con 0x55a99897cf90 2023-09-13T09:40:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4effd700 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a998989ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa4e7fc700 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898a000 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faa440036f0 tx=0x7faa44009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=259e28b74e8e13c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa2effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa2effd700 1 -- 172.21.15.6:0/3814472113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4400fd70 con 0x55a99897cf90 2023-09-13T09:40:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa400a1240 con 0x55a99897cf90 2023-09-13T09:40:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa2effd700 1 -- 172.21.15.6:0/3814472113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa44040080 con 0x55a99897cf90 2023-09-13T09:40:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa2effd700 1 -- 172.21.15.6:0/3814472113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa44004500 con 0x55a99897cf90 2023-09-13T09:40:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa61c1bb80 10 client.15615 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.551+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a9986dace0 con 0x55a99897cf90 2023-09-13T09:40:12.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa2effd700 1 -- 172.21.15.6:0/3814472113 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa400a1240 con 0x55a99897cf90 2023-09-13T09:40:12.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa2effd700 1 -- 172.21.15.6:0/3814472113 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7faa440038c0 con 0x55a99897cf90 2023-09-13T09:40:12.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa61c1bb80 10 client.15615 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:12.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa61c1bb80 10 client.15615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:12.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa61c1bb80 20 client.15615 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:12.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a9989e7090 0x55a9989e94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa61c1bb80 4 client.15615 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:40:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a99887f0d0 con 0x55a9989e7090 2023-09-13T09:40:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.552+0000 7faa4effd700 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a9989e7090 0x55a9989e94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.553+0000 7faa2effd700 10 client.15615 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.553+0000 7faa4effd700 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a9989e7090 0x55a9989e94b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db00bba7ae40a7b2 server_cookie=2cd636a093e09d2f in_seq=0 out_seq=0 2023-09-13T09:40:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.554+0000 7faa2effd700 1 -- 172.21.15.6:0/3814472113 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a99887f0d0 con 0x55a9989e7090 2023-09-13T09:40:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.554+0000 7faa2effd700 10 client.15615 handle_command_reply: tid=0 2023-09-13T09:40:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.554+0000 7faa61c1bb80 1 client.15615 shutdown 2023-09-13T09:40:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 msgr2=0x55a99898a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898a000 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7faa440036f0 tx=0x7faa44009580 comp rx=0 tx=0).stop 2023-09-13T09:40:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 shutdown_connections 2023-09-13T09:40:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a99897d8f0 0x55a9989e5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a99897c290 0x55a998989ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a9989e7090 0x55a9989e94b0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 --2- 172.21.15.6:0/3814472113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a99897cf90 0x55a99898a000 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa2effd700 0 client.15615 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 >> 172.21.15.6:0/3814472113 conn(0x55a9988d1d00 msgr2=0x55a99897ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 shutdown_connections 2023-09-13T09:40:12.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 1 -- 172.21.15.6:0/3814472113 wait complete. 2023-09-13T09:40:12.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.555+0000 7faa61c1bb80 20 client.15615 trim_cache size 0 max 16384 2023-09-13T09:40:12.568 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:40:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:40:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "d97a0422-001e-4acd-8ba7-fc1a894d999b", 2023-09-13T09:40:12.568 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:40:12.569 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:40:12.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa380a06c0 msgr2=0x7faa380a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa380a06c0 0x7faa380a2b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7faa44006010 tx=0x7faa44005bc0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa500ffc90 msgr2=0x7faa50198cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa500ffc90 0x7faa50198cc0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7faa4000c990 tx=0x7faa4000cca0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 shutdown_connections 2023-09-13T09:40:12.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa50101820 0x7faa501a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa380a06c0 0x7faa380a2b80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa500ffc90 0x7faa50198cc0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 --2- 172.21.15.6:0/51123940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa50100e80 0x7faa50199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 >> 172.21.15.6:0/51123940 conn(0x7faa500fb220 msgr2=0x7faa500691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 shutdown_connections 2023-09-13T09:40:12.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.556+0000 7faa55a36700 1 -- 172.21.15.6:0/51123940 wait complete. 2023-09-13T09:40:12.573 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:40:12.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.708+0000 7f06f2b77700 1 -- 172.21.15.6:0/4089137632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec100eb0 msgr2=0x7f06ec101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.708+0000 7f06f2b77700 1 --2- 172.21.15.6:0/4089137632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec100eb0 0x7f06ec101310 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009990 tx=0x7f06d8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 -- 172.21.15.6:0/4089137632 shutdown_connections 2023-09-13T09:40:12.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 --2- 172.21.15.6:0/4089137632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06ec101850 0x7f06ec108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 --2- 172.21.15.6:0/4089137632 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec0ffcc0 0x7f06ec1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 --2- 172.21.15.6:0/4089137632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec100eb0 0x7f06ec101310 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 -- 172.21.15.6:0/4089137632 >> 172.21.15.6:0/4089137632 conn(0x7f06ec0fb250 msgr2=0x7f06ec0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 -- 172.21.15.6:0/4089137632 shutdown_connections 2023-09-13T09:40:12.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 -- 172.21.15.6:0/4089137632 wait complete. 2023-09-13T09:40:12.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 Processor -- start 2023-09-13T09:40:12.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.709+0000 7f06f2b77700 1 -- start start 2023-09-13T09:40:12.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f2b77700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06ec0ffcc0 0x7f06ec10a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f2b77700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec100eb0 0x7f06ec108a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f2b77700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec101850 0x7f06ec108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f2b77700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec109760 con 0x7f06ec101850 2023-09-13T09:40:12.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f2b77700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1098d0 con 0x7f06ec100eb0 2023-09-13T09:40:12.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f2b77700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06ec1a0ad0 con 0x7f06ec0ffcc0 2023-09-13T09:40:12.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec101850 0x7f06ec108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec101850 0x7f06ec108fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34350/0 (socket says 172.21.15.6:34350) 2023-09-13T09:40:12.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 -- 172.21.15.6:0/2588947463 learned_addr learned my addr 172.21.15.6:0/2588947463 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06ebfff700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec100eb0 0x7f06ec108a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f0913700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06ec0ffcc0 0x7f06ec10a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 -- 172.21.15.6:0/2588947463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06ec0ffcc0 msgr2=0x7f06ec10a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06ec0ffcc0 0x7f06ec10a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 -- 172.21.15.6:0/2588947463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec100eb0 msgr2=0x7f06ec108a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec100eb0 0x7f06ec108a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 -- 172.21.15.6:0/2588947463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d80095f0 con 0x7f06ec101850 2023-09-13T09:40:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f0913700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06ec0ffcc0 0x7f06ec10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.710+0000 7f06f1114700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec101850 0x7f06ec108fc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f06e400ada0 tx=0x7f06e400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.711+0000 7f06e9ffb700 1 -- 172.21.15.6:0/2588947463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e400f070 con 0x7f06ec101850 2023-09-13T09:40:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.711+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06ec1a0db0 con 0x7f06ec101850 2023-09-13T09:40:12.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.711+0000 7f06e9ffb700 1 -- 172.21.15.6:0/2588947463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06e4007b30 con 0x7f06ec101850 2023-09-13T09:40:12.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.711+0000 7f06e9ffb700 1 -- 172.21.15.6:0/2588947463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40052a0 con 0x7f06ec101850 2023-09-13T09:40:12.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.711+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec1a1260 con 0x7f06ec101850 2023-09-13T09:40:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.713+0000 7f06e9ffb700 1 -- 172.21.15.6:0/2588947463 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f06e400c980 con 0x7f06ec101850 2023-09-13T09:40:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.714+0000 7f06e9ffb700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06dc0a0640 0x7f06dc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.714+0000 7f06f0913700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06dc0a0640 0x7f06dc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.714+0000 7f06e9ffb700 1 -- 172.21.15.6:0/2588947463 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f06e40cb2a0 con 0x7f06ec101850 2023-09-13T09:40:12.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.715+0000 7f06f0913700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06dc0a0640 0x7f06dc0a2b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f06ec100d10 tx=0x7f06e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 Processor -- start 2023-09-13T09:40:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 -- start start 2023-09-13T09:40:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5e8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e9060 0x55e17b5e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5e7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b540780 con 0x55e17b5e9060 2023-09-13T09:40:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b53e0a0 con 0x55e17b5e7a00 2023-09-13T09:40:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b539990 con 0x55e17b5e8700 2023-09-13T09:40:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e9060 0x55e17b5e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e9060 0x55e17b5e74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34358/0 (socket says 172.21.15.6:34358) 2023-09-13T09:40:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06ebfff700 1 -- 172.21.15.6:0/499341813 learned_addr learned my addr 172.21.15.6:0/499341813 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06f1114700 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5e7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06f0913700 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5e8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.716+0000 7f06ebfff700 1 -- 172.21.15.6:0/499341813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 msgr2=0x55e17b5e8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06ebfff700 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5e8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06ebfff700 1 -- 172.21.15.6:0/499341813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 msgr2=0x55e17b5e7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06ebfff700 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5e7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06ebfff700 1 -- 172.21.15.6:0/499341813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e17b3b9630 con 0x55e17b5e9060 2023-09-13T09:40:12.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06ebfff700 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e9060 0x55e17b5e74c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f06d8015000 tx=0x7f06d8005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33440b84a390d9af server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06d6ffd700 1 -- 172.21.15.6:0/499341813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d801d070 con 0x55e17b5e9060 2023-09-13T09:40:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06d6ffd700 1 -- 172.21.15.6:0/499341813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06d801e040 con 0x55e17b5e9060 2023-09-13T09:40:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.717+0000 7f06d6ffd700 1 -- 172.21.15.6:0/499341813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8004a20 con 0x55e17b5e9060 2023-09-13T09:40:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 -- 172.21.15.6:0/499341813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e9060 msgr2=0x55e17b5e74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e9060 0x55e17b5e74c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f06d8015000 tx=0x7f06d8005c70 comp rx=0 tx=0).stop 2023-09-13T09:40:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 -- 172.21.15.6:0/499341813 shutdown_connections 2023-09-13T09:40:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5e7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5e8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/499341813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e9060 0x55e17b5e74c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 -- 172.21.15.6:0/499341813 >> 172.21.15.6:0/499341813 conn(0x55e17b545c80 msgr2=0x55e17b5e1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 -- 172.21.15.6:0/499341813 shutdown_connections 2023-09-13T09:40:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 -- 172.21.15.6:0/499341813 wait complete. 2023-09-13T09:40:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 -- start start 2023-09-13T09:40:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.718+0000 7f06fed5cb80 1 Processor -- start 2023-09-13T09:40:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e8700 0x55e17b5f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5f8400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b4d7bb0 con 0x55e17b5e8700 2023-09-13T09:40:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b4d78b0 con 0x55e17b5e7a00 2023-09-13T09:40:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b3bb920 con 0x55e17b5e9060 2023-09-13T09:40:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06fed5cb80 10 client.0 _ll_register_callbacks cb 0x55e17b4d5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e8700 0x55e17b5f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e8700 0x55e17b5f13c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34366/0 (socket says 172.21.15.6:34366) 2023-09-13T09:40:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06ebfff700 1 -- 172.21.15.6:0/1496515066 learned_addr learned my addr 172.21.15.6:0/1496515066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06f0913700 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.719+0000 7f06f1114700 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06f0913700 1 -- 172.21.15.6:0/1496515066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 msgr2=0x55e17b5f8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06f0913700 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5f8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06f0913700 1 -- 172.21.15.6:0/1496515066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e8700 msgr2=0x55e17b5f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06f0913700 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e8700 0x55e17b5f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06f0913700 1 -- 172.21.15.6:0/1496515066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06ec068ef0 con 0x55e17b5e7a00 2023-09-13T09:40:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06f0913700 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5f0e80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06e0011a50 tx=0x7f06e00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6275c8dabbfe106 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06cbfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:40:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06cbfff700 1 -- 172.21.15.6:0/1496515066 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e00206f0 con 0x55e17b5e7a00 2023-09-13T09:40:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e17b5da670 con 0x55e17b5e7a00 2023-09-13T09:40:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06cbfff700 1 -- 172.21.15.6:0/1496515066 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f06e0018070 con 0x55e17b5e7a00 2023-09-13T09:40:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06cbfff700 1 -- 172.21.15.6:0/1496515066 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06e0020850 con 0x55e17b5e7a00 2023-09-13T09:40:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06fed5cb80 10 client.25211 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.720+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e17b5517a0 con 0x55e17b5e7a00 2023-09-13T09:40:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06cbfff700 1 -- 172.21.15.6:0/1496515066 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e17b5da670 con 0x55e17b5e7a00 2023-09-13T09:40:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06cbfff700 1 -- 172.21.15.6:0/1496515066 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f06e0033b30 con 0x55e17b5e7a00 2023-09-13T09:40:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06fed5cb80 10 client.25211 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:12.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06fed5cb80 10 client.25211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06fed5cb80 20 client.25211 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b605570 0x55e17b607990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06fed5cb80 4 client.25211 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e17b532970 con 0x55e17b605570 2023-09-13T09:40:12.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.721+0000 7f06ebfff700 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b605570 0x55e17b607990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.722+0000 7f06ebfff700 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b605570 0x55e17b607990 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e953509a94581da1 server_cookie=2d9c50abac77c628 in_seq=0 out_seq=0 2023-09-13T09:40:12.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.722+0000 7f06cbfff700 10 client.25211 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.722+0000 7f06cbfff700 1 -- 172.21.15.6:0/1496515066 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e17b532970 con 0x55e17b605570 2023-09-13T09:40:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.722+0000 7f06cbfff700 10 client.25211 handle_command_reply: tid=0 2023-09-13T09:40:12.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.722+0000 7f06fed5cb80 1 client.25211 shutdown 2023-09-13T09:40:12.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 msgr2=0x55e17b5f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5f0e80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f06e0011a50 tx=0x7f06e00047c0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 shutdown_connections 2023-09-13T09:40:12.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5f8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e7a00 0x55e17b5f0e80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b605570 0x55e17b607990 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/1496515066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e8700 0x55e17b5f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06cbfff700 0 client.25211 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 >> 172.21.15.6:0/1496515066 conn(0x55e17b545c80 msgr2=0x55e17b5dc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 shutdown_connections 2023-09-13T09:40:12.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 1 -- 172.21.15.6:0/1496515066 wait complete. 2023-09-13T09:40:12.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.723+0000 7f06fed5cb80 20 client.25211 trim_cache size 0 max 16384 2023-09-13T09:40:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 Processor -- start 2023-09-13T09:40:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 -- start start 2023-09-13T09:40:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5e74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5f83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e9060 0x55e17b5f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b5f1eb0 con 0x55e17b5e7a00 2023-09-13T09:40:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b5e3730 con 0x55e17b5e9060 2023-09-13T09:40:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b5ec3d0 con 0x55e17b5e8700 2023-09-13T09:40:12.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f0913700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5e74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f0913700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5e74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34370/0 (socket says 172.21.15.6:34370) 2023-09-13T09:40:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f0913700 1 -- 172.21.15.6:0/3962272998 learned_addr learned my addr 172.21.15.6:0/3962272998 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06ebfff700 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5f83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f1114700 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e9060 0x55e17b5f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f0913700 1 -- 172.21.15.6:0/3962272998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 msgr2=0x55e17b5f83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f0913700 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5f83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f0913700 1 -- 172.21.15.6:0/3962272998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e9060 msgr2=0x55e17b5f0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.740+0000 7f06f0913700 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e9060 0x55e17b5f0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.741+0000 7f06f0913700 1 -- 172.21.15.6:0/3962272998 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e17b365de0 con 0x55e17b5e7a00 2023-09-13T09:40:12.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.741+0000 7f06f1114700 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e9060 0x55e17b5f0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.741+0000 7f06f0913700 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5e74c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009810 tx=0x7f06e0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d423772d7843fe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.741+0000 7f06d77fe700 1 -- 172.21.15.6:0/3962272998 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0029a40 con 0x55e17b5e7a00 2023-09-13T09:40:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.741+0000 7f06d77fe700 1 -- 172.21.15.6:0/3962272998 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06e0024070 con 0x55e17b5e7a00 2023-09-13T09:40:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.741+0000 7f06d77fe700 1 -- 172.21.15.6:0/3962272998 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e0033c90 con 0x55e17b5e7a00 2023-09-13T09:40:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 -- 172.21.15.6:0/3962272998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 msgr2=0x55e17b5e74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5e74c0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009810 tx=0x7f06e0009370 comp rx=0 tx=0).stop 2023-09-13T09:40:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 -- 172.21.15.6:0/3962272998 shutdown_connections 2023-09-13T09:40:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e9060 0x55e17b5f0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5e74c0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/3962272998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e8700 0x55e17b5f83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 -- 172.21.15.6:0/3962272998 >> 172.21.15.6:0/3962272998 conn(0x55e17b545c80 msgr2=0x55e17b5eb840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 -- 172.21.15.6:0/3962272998 shutdown_connections 2023-09-13T09:40:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 -- 172.21.15.6:0/3962272998 wait complete. 2023-09-13T09:40:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 -- start start 2023-09-13T09:40:12.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.742+0000 7f06fed5cb80 1 Processor -- start 2023-09-13T09:40:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5f2f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e8700 0x55e17b5f3460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06fed5cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5fc080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b5f8490 con 0x55e17b5e7a00 2023-09-13T09:40:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b5f8600 con 0x55e17b5e8700 2023-09-13T09:40:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06fed5cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e17b5f87c0 con 0x55e17b5e9060 2023-09-13T09:40:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06fed5cb80 10 client.0 _ll_register_callbacks cb 0x55e17b4d5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:12.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e8700 0x55e17b5f3460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06f0913700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5f2f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e8700 0x55e17b5f3460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56134/0 (socket says 172.21.15.6:56134) 2023-09-13T09:40:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 -- 172.21.15.6:0/4271845328 learned_addr learned my addr 172.21.15.6:0/4271845328 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06f1114700 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5fc080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 -- 172.21.15.6:0/4271845328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 msgr2=0x55e17b5fc080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5fc080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 -- 172.21.15.6:0/4271845328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 msgr2=0x55e17b5f2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5f2f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 -- 172.21.15.6:0/4271845328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e17b5517a0 con 0x55e17b5e8700 2023-09-13T09:40:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06f0913700 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:12.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06ebfff700 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e8700 0x55e17b5f3460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f06d80098e0 tx=0x7f06d800bb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec051a2a55e11405 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.743+0000 7f06cbfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:40:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06cbfff700 1 -- 172.21.15.6:0/4271845328 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8033070 con 0x55e17b5e8700 2023-09-13T09:40:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06d801e040 con 0x55e17b5e8700 2023-09-13T09:40:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06cbfff700 1 -- 172.21.15.6:0/4271845328 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f06d8005950 con 0x55e17b5e8700 2023-09-13T09:40:12.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06cbfff700 1 -- 172.21.15.6:0/4271845328 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06d801d040 con 0x55e17b5e8700 2023-09-13T09:40:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 10 client.25214 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55e17b34ec60 con 0x55e17b5e8700 2023-09-13T09:40:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06cbfff700 1 -- 172.21.15.6:0/4271845328 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06d801e040 con 0x55e17b5e8700 2023-09-13T09:40:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06cbfff700 1 -- 172.21.15.6:0/4271845328 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f06d80349d0 con 0x55e17b5e8700 2023-09-13T09:40:12.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 10 client.25214 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 10 client.25214 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 20 client.25214 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b5fda10 0x55e17b5ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 4 client.25214 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:40:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.744+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e17b4f3050 con 0x55e17b5fda10 2023-09-13T09:40:12.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06f0913700 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b5fda10 0x55e17b5ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06f0913700 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b5fda10 0x55e17b5ffe30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3410ba791c428aae server_cookie=6d7a77c950b4754a in_seq=0 out_seq=0 2023-09-13T09:40:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06cbfff700 10 client.25214 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06cbfff700 1 -- 172.21.15.6:0/4271845328 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e17b4f3050 con 0x55e17b5fda10 2023-09-13T09:40:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06cbfff700 10 client.25214 handle_command_reply: tid=0 2023-09-13T09:40:12.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06fed5cb80 1 client.25214 shutdown 2023-09-13T09:40:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e8700 msgr2=0x55e17b5f3460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.745+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e8700 0x55e17b5f3460 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f06d80098e0 tx=0x7f06d800bb30 comp rx=0 tx=0).stop 2023-09-13T09:40:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 shutdown_connections 2023-09-13T09:40:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e17b5e9060 0x55e17b5fc080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e17b5fda10 0x55e17b5ffe30 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e17b5e7a00 0x55e17b5f2f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06cbfff700 0 client.25214 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 --2- 172.21.15.6:0/4271845328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e17b5e8700 0x55e17b5f3460 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 >> 172.21.15.6:0/4271845328 conn(0x55e17b545c80 msgr2=0x55e17b5f0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 shutdown_connections 2023-09-13T09:40:12.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 1 -- 172.21.15.6:0/4271845328 wait complete. 2023-09-13T09:40:12.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06fed5cb80 20 client.25214 trim_cache size 0 max 16384 2023-09-13T09:40:12.761 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:40:12.761 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:40:12.761 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:40:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "d97a0422-001e-4acd-8ba7-fc1a894d999b": { 2023-09-13T09:40:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:40:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "d97a0422-001e-4acd-8ba7-fc1a894d999b", 2023-09-13T09:40:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:40:12.762 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:40:12.763 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:40:12.763 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:40:12.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06dc0a0640 msgr2=0x7f06dc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06f2b77700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06dc0a0640 0x7f06dc0a2b00 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f06ec100d10 tx=0x7f06e0009260 comp rx=0 tx=0).stop 2023-09-13T09:40:12.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.746+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec101850 msgr2=0x7f06ec108fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:12.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec101850 0x7f06ec108fc0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f06e400ada0 tx=0x7f06e400c330 comp rx=0 tx=0).stop 2023-09-13T09:40:12.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 shutdown_connections 2023-09-13T09:40:12.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06dc0a0640 0x7f06dc0a2b00 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06ec101850 0x7f06ec108fc0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06ec0ffcc0 0x7f06ec10a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 --2- 172.21.15.6:0/2588947463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06ec100eb0 0x7f06ec108a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:12.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 >> 172.21.15.6:0/2588947463 conn(0x7f06ec0fb250 msgr2=0x7f06ec0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:12.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 shutdown_connections 2023-09-13T09:40:12.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:12.747+0000 7f06f2b77700 1 -- 172.21.15.6:0/2588947463 wait complete. 2023-09-13T09:40:12.767 INFO:tasks.cephfs.filesystem:scrub status for tag:d97a0422-001e-4acd-8ba7-fc1a894d999b - {'path': '/', 'tag': 'd97a0422-001e-4acd-8ba7-fc1a894d999b', 'options': 'recursive,force'} 2023-09-13T09:40:13.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:12 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:40:13.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:12 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:13.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:12 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:40:13.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:12 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:13.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:12 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:40:13.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:12 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:13 smithi006 ceph-mon[98665]: pgmap v321: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:13 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:40:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:40:14.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:13 smithi053 ceph-mon[102373]: pgmap v321: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:13 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:40:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:40:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:14.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:13 smithi131 ceph-mon[102785]: pgmap v321: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:13 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:40:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:40:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:15 smithi006 ceph-mon[98665]: pgmap v322: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:15 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:40:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:15 smithi053 ceph-mon[102373]: pgmap v322: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:15 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:40:16.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:15 smithi131 ceph-mon[102785]: pgmap v322: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 7 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:15 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:40:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:17 smithi006 ceph-mon[98665]: pgmap v323: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:17 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:17 smithi053 ceph-mon[102373]: pgmap v323: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:18.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:17 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:17 smithi131 ceph-mon[102785]: pgmap v323: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:18.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:17 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:19 smithi006 ceph-mon[98665]: pgmap v324: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:19 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:40:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:40:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:40:20.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:19 smithi053 ceph-mon[102373]: pgmap v324: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:20.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:19 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:40:20.008 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:40:20.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:40:20.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:19 smithi131 ceph-mon[102785]: pgmap v324: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:19 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:40:20.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:40:20.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:40:20.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:40:21.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:40:21.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:40:21.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:40:22.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:21 smithi006 ceph-mon[98665]: pgmap v325: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:22.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:21 smithi053 ceph-mon[102373]: pgmap v325: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:22.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:21 smithi131 ceph-mon[102785]: pgmap v325: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:24.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:23 smithi006 ceph-mon[98665]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:24.010 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:23 smithi053 ceph-mon[102373]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:23 smithi131 ceph-mon[102785]: pgmap v326: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 12 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:26.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:25 smithi006 ceph-mon[98665]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:26.009 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:25 smithi053 ceph-mon[102373]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:26.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:25 smithi131 ceph-mon[102785]: pgmap v327: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 8 op/s; 0 B/s, 0 objects/s recovering 2023-09-13T09:40:28.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:27 smithi006 ceph-mon[98665]: pgmap v328: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2023-09-13T09:40:28.006 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:27 smithi053 ceph-mon[102373]: pgmap v328: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2023-09-13T09:40:28.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:27 smithi131 ceph-mon[102785]: pgmap v328: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 11 op/s 2023-09-13T09:40:30.018 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:29 smithi131 ceph-mon[102785]: pgmap v329: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:29 smithi006 ceph-mon[98665]: pgmap v329: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:29 smithi053 ceph-mon[102373]: pgmap v329: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:32.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:31 smithi131 ceph-mon[102785]: pgmap v330: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:31 smithi006 ceph-mon[98665]: pgmap v330: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:31 smithi053 ceph-mon[102373]: pgmap v330: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:34.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:33 smithi131 ceph-mon[102785]: pgmap v331: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:40:34.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:33 smithi053 ceph-mon[102373]: pgmap v331: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:40:34.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:33 smithi006 ceph-mon[98665]: pgmap v331: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 12 op/s 2023-09-13T09:40:36.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:35 smithi131 ceph-mon[102785]: pgmap v332: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:35 smithi006 ceph-mon[98665]: pgmap v332: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:35 smithi053 ceph-mon[102373]: pgmap v332: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:38.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:37 smithi131 ceph-mon[102785]: pgmap v333: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:40:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:37 smithi006 ceph-mon[98665]: pgmap v333: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:40:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:37 smithi053 ceph-mon[102373]: pgmap v333: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2023-09-13T09:40:38.590 INFO:tasks.workunit.client.0.smithi006.stderr:Updating files: 99% (11881/11967) Updating files: 100% (11967/11967) Updating files: 100% (11967/11967), done. 2023-09-13T09:40:39.146 INFO:tasks.workunit.client.0.smithi006.stderr:Note: switching to '4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5'. 2023-09-13T09:40:39.146 INFO:tasks.workunit.client.0.smithi006.stderr: 2023-09-13T09:40:39.147 INFO:tasks.workunit.client.0.smithi006.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-09-13T09:40:39.147 INFO:tasks.workunit.client.0.smithi006.stderr:changes and commit them, and you can discard any commits you make in this 2023-09-13T09:40:39.147 INFO:tasks.workunit.client.0.smithi006.stderr:state without impacting any branches by switching back to a branch. 2023-09-13T09:40:39.147 INFO:tasks.workunit.client.0.smithi006.stderr: 2023-09-13T09:40:39.147 INFO:tasks.workunit.client.0.smithi006.stderr:If you want to create a new branch to retain commits you create, you may 2023-09-13T09:40:39.147 INFO:tasks.workunit.client.0.smithi006.stderr:do so (now or later) by using -c with the switch command. Example: 2023-09-13T09:40:39.148 INFO:tasks.workunit.client.0.smithi006.stderr: 2023-09-13T09:40:39.148 INFO:tasks.workunit.client.0.smithi006.stderr: git switch -c 2023-09-13T09:40:39.148 INFO:tasks.workunit.client.0.smithi006.stderr: 2023-09-13T09:40:39.148 INFO:tasks.workunit.client.0.smithi006.stderr:Or undo this operation with: 2023-09-13T09:40:39.148 INFO:tasks.workunit.client.0.smithi006.stderr: 2023-09-13T09:40:39.149 INFO:tasks.workunit.client.0.smithi006.stderr: git switch - 2023-09-13T09:40:39.149 INFO:tasks.workunit.client.0.smithi006.stderr: 2023-09-13T09:40:39.149 INFO:tasks.workunit.client.0.smithi006.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-09-13T09:40:39.149 INFO:tasks.workunit.client.0.smithi006.stderr: 2023-09-13T09:40:39.149 INFO:tasks.workunit.client.0.smithi006.stderr:HEAD is now at 4a754ac981a Merge remote-tracking branch 'leonid/config_format' into wip-rishabh-2023sep12-b2 2023-09-13T09:40:39.150 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-09-13T09:40:39.185 INFO:tasks.workunit.client.0.smithi006.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-09-13T09:40:39.187 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-13T09:40:39.188 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-09-13T09:40:39.738 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-09-13T09:40:39.812 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-09-13T09:40:39.852 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-13T09:40:39.854 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-13T09:40:39.854 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-09-13T09:40:39.893 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-13T09:40:39.896 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T09:40:39.896 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-09-13T09:40:39.953 INFO:tasks.workunit:Running workunits matching suites/dbench.sh on client.0... 2023-09-13T09:40:39.955 INFO:tasks.workunit:Running workunit suites/dbench.sh... 2023-09-13T09:40:39.955 DEBUG:teuthology.orchestra.run.smithi006:workunit test suites/dbench.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/dbench.sh 2023-09-13T09:40:40.022 INFO:tasks.workunit.client.0.smithi006.stderr:+ dbench 1 2023-09-13T09:40:40.036 INFO:tasks.workunit.client.0.smithi006.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-09-13T09:40:40.037 INFO:tasks.workunit.client.0.smithi006.stdout: 2023-09-13T09:40:40.037 INFO:tasks.workunit.client.0.smithi006.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-09-13T09:40:40.044 INFO:tasks.workunit.client.0.smithi006.stdout:0 of 1 processes prepared for launch 0 sec 2023-09-13T09:40:40.144 INFO:tasks.workunit.client.0.smithi006.stdout:1 of 1 processes prepared for launch 0 sec 2023-09-13T09:40:40.145 INFO:tasks.workunit.client.0.smithi006.stdout:releasing clients 2023-09-13T09:40:40.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:39 smithi006 ceph-mon[98665]: pgmap v334: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:39 smithi053 ceph-mon[102373]: pgmap v334: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:39 smithi131 ceph-mon[102785]: pgmap v334: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:41.144 INFO:tasks.workunit.client.0.smithi006.stdout: 1 2761 31.95 MB/sec warmup 1 sec latency 7.492 ms 2023-09-13T09:40:42.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 4723 21.06 MB/sec warmup 2 sec latency 7.850 ms 2023-09-13T09:40:42.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:41 smithi006 ceph-mon[98665]: pgmap v335: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:41 smithi053 ceph-mon[102373]: pgmap v335: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:41 smithi131 ceph-mon[102785]: pgmap v335: 97 pgs: 97 active+clean; 663 KiB data, 330 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2023-09-13T09:40:42.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:40:42.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 -- 172.21.15.6:0/2772067001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc0ffcc0 msgr2=0x7fc9bc1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 --2- 172.21.15.6:0/2772067001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc0ffcc0 0x7fc9bc1000e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80099c0 tx=0x7fc9b8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 -- 172.21.15.6:0/2772067001 shutdown_connections 2023-09-13T09:40:42.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 --2- 172.21.15.6:0/2772067001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9bc101850 0x7fc9bc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 --2- 172.21.15.6:0/2772067001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc0ffcc0 0x7fc9bc1000e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 --2- 172.21.15.6:0/2772067001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9bc100eb0 0x7fc9bc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 -- 172.21.15.6:0/2772067001 >> 172.21.15.6:0/2772067001 conn(0x7fc9bc0fb250 msgr2=0x7fc9bc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 -- 172.21.15.6:0/2772067001 shutdown_connections 2023-09-13T09:40:42.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.914+0000 7fc9c330e700 1 -- 172.21.15.6:0/2772067001 wait complete. 2023-09-13T09:40:42.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 Processor -- start 2023-09-13T09:40:42.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 -- start start 2023-09-13T09:40:42.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9bc0ffcc0 0x7fc9bc195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc100eb0 0x7fc9bc195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9bc101850 0x7fc9bc19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc19d500 con 0x7fc9bc100eb0 2023-09-13T09:40:42.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc19d640 con 0x7fc9bc0ffcc0 2023-09-13T09:40:42.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c330e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc19d7d0 con 0x7fc9bc101850 2023-09-13T09:40:42.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc100eb0 0x7fc9bc195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c10aa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9bc0ffcc0 0x7fc9bc195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc100eb0 0x7fc9bc195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34416/0 (socket says 172.21.15.6:34416) 2023-09-13T09:40:42.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.915+0000 7fc9c08a9700 1 -- 172.21.15.6:0/220642491 learned_addr learned my addr 172.21.15.6:0/220642491 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:42.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9bc101850 0x7fc9bc19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c08a9700 1 -- 172.21.15.6:0/220642491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9bc101850 msgr2=0x7fc9bc19cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9bc101850 0x7fc9bc19cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c08a9700 1 -- 172.21.15.6:0/220642491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9bc0ffcc0 msgr2=0x7fc9bc195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9bc0ffcc0 0x7fc9bc195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c08a9700 1 -- 172.21.15.6:0/220642491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80095f0 con 0x7fc9bc100eb0 2023-09-13T09:40:42.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9bc101850 0x7fc9bc19cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:42.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9bc0ffcc0 0x7fc9bc195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:42.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc100eb0 0x7fc9bc195ec0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000d950 tx=0x7fc9b000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:42.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9ae7fc700 1 -- 172.21.15.6:0/220642491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0009940 con 0x7fc9bc100eb0 2023-09-13T09:40:42.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9ae7fc700 1 -- 172.21.15.6:0/220642491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9b0010460 con 0x7fc9bc100eb0 2023-09-13T09:40:42.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc19dab0 con 0x7fc9bc100eb0 2023-09-13T09:40:42.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9ae7fc700 1 -- 172.21.15.6:0/220642491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b000f620 con 0x7fc9bc100eb0 2023-09-13T09:40:42.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.916+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc19dfc0 con 0x7fc9bc100eb0 2023-09-13T09:40:42.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.918+0000 7fc9ae7fc700 1 -- 172.21.15.6:0/220642491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc9b00108d0 con 0x7fc9bc100eb0 2023-09-13T09:40:42.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.919+0000 7fc9ae7fc700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9a80a0640 0x7fc9a80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.919+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9a80a0640 0x7fc9a80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.919+0000 7fc9ae7fc700 1 -- 172.21.15.6:0/220642491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc9b00cba40 con 0x7fc9bc100eb0 2023-09-13T09:40:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.919+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9a80a0640 0x7fc9a80a2b00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009990 tx=0x7fc9b801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 Processor -- start 2023-09-13T09:40:42.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 -- start start 2023-09-13T09:40:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dca6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dca54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dbfe780 con 0x562a7dca6700 2023-09-13T09:40:42.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dbfc0a0 con 0x562a7dca5a00 2023-09-13T09:40:42.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dbf7990 con 0x562a7dca7060 2023-09-13T09:40:42.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9c10aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dca6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9c10aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dca6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34422/0 (socket says 172.21.15.6:34422) 2023-09-13T09:40:42.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9c10aa700 1 -- 172.21.15.6:0/4236772404 learned_addr learned my addr 172.21.15.6:0/4236772404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:42.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dca54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.920+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9c10aa700 1 -- 172.21.15.6:0/4236772404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 msgr2=0x562a7dca54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dca54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9c10aa700 1 -- 172.21.15.6:0/4236772404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 msgr2=0x562a7dca5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9c10aa700 1 -- 172.21.15.6:0/4236772404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a7da77630 con 0x562a7dca6700 2023-09-13T09:40:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dca6b20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc100d10 tx=0x7fc9b801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5f5a982aef05f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9a77fe700 1 -- 172.21.15.6:0/4236772404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b802a070 con 0x562a7dca6700 2023-09-13T09:40:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9a77fe700 1 -- 172.21.15.6:0/4236772404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9b801e040 con 0x562a7dca6700 2023-09-13T09:40:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.921+0000 7fc9a77fe700 1 -- 172.21.15.6:0/4236772404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800f820 con 0x562a7dca6700 2023-09-13T09:40:42.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/4236772404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 msgr2=0x562a7dca6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dca6b20 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc100d10 tx=0x7fc9b801f000 comp rx=0 tx=0).stop 2023-09-13T09:40:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/4236772404 shutdown_connections 2023-09-13T09:40:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dca6b20 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/4236772404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dca54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/4236772404 >> 172.21.15.6:0/4236772404 conn(0x562a7dc03c80 msgr2=0x562a7dc9ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/4236772404 shutdown_connections 2023-09-13T09:40:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/4236772404 wait complete. 2023-09-13T09:40:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 -- start start 2023-09-13T09:40:42.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.922+0000 7fc9cf4f3b80 1 Processor -- start 2023-09-13T09:40:42.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca7060 0x562a7dcb8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7db95bb0 con 0x562a7dca6700 2023-09-13T09:40:42.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7db958b0 con 0x562a7dca7060 2023-09-13T09:40:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7da79920 con 0x562a7dca5a00 2023-09-13T09:40:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 10 client.0 _ll_register_callbacks cb 0x562a7db93680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34430/0 (socket says 172.21.15.6:34430) 2023-09-13T09:40:42.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 -- 172.21.15.6:0/2795509030 learned_addr learned my addr 172.21.15.6:0/2795509030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca7060 0x562a7dcb8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 -- 172.21.15.6:0/2795509030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 msgr2=0x562a7dcb1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 -- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca7060 msgr2=0x562a7dcb8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca7060 0x562a7dcb8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 -- 172.21.15.6:0/2795509030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc108a50 con 0x562a7dca6700 2023-09-13T09:40:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb1650 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0098ee0 tx=0x7fc9b0099a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41396c03bce04d03 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/2795509030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0099440 con 0x562a7dca6700 2023-09-13T09:40:42.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/2795509030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc9b00995a0 con 0x562a7dca6700 2023-09-13T09:40:42.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a7dc98670 con 0x562a7dca6700 2023-09-13T09:40:42.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.923+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/2795509030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9b00986d0 con 0x562a7dca6700 2023-09-13T09:40:42.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 10 client.15645 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:42.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562a7dc0f7a0 con 0x562a7dca6700 2023-09-13T09:40:42.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/2795509030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9b00b5080 con 0x562a7dca6700 2023-09-13T09:40:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/2795509030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc9b0094fd0 con 0x562a7dca6700 2023-09-13T09:40:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 10 client.15645 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 10 client.15645 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 20 client.15645 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:42.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dcbcf80 0x562a7dcbf3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 4 client.15645 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a7dbf0970 con 0x562a7dcbcf80 2023-09-13T09:40:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dcbcf80 0x562a7dcbf3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9a4ff9700 10 client.15645 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:42.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.924+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dcbcf80 0x562a7dcbf3a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce676898146d6825 server_cookie=ad98eb276e8e3e1 in_seq=0 out_seq=0 2023-09-13T09:40:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/2795509030 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a7dbf0970 con 0x562a7dcbcf80 2023-09-13T09:40:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9a4ff9700 10 client.15645 handle_command_reply: tid=0 2023-09-13T09:40:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 client.15645 shutdown 2023-09-13T09:40:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 msgr2=0x562a7dcb1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb1650 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0098ee0 tx=0x7fc9b0099a20 comp rx=0 tx=0).stop 2023-09-13T09:40:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 shutdown_connections 2023-09-13T09:40:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca7060 0x562a7dcb8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dcbcf80 0x562a7dcbf3a0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/2795509030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb1650 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9a4ff9700 0 client.15645 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 >> 172.21.15.6:0/2795509030 conn(0x562a7dc03c80 msgr2=0x562a7dc9a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 shutdown_connections 2023-09-13T09:40:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.925+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/2795509030 wait complete. 2023-09-13T09:40:42.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.926+0000 7fc9cf4f3b80 20 client.15645 trim_cache size 0 max 16384 2023-09-13T09:40:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 Processor -- start 2023-09-13T09:40:42.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 -- start start 2023-09-13T09:40:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dcadb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dcb2010 con 0x562a7dca6700 2023-09-13T09:40:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dcae3b0 con 0x562a7dca5a00 2023-09-13T09:40:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dca1730 con 0x562a7dca7060 2023-09-13T09:40:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34438/0 (socket says 172.21.15.6:34438) 2023-09-13T09:40:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9c08a9700 1 -- 172.21.15.6:0/1575824149 learned_addr learned my addr 172.21.15.6:0/1575824149 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dcadb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.943+0000 7fc9c08a9700 1 -- 172.21.15.6:0/1575824149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 msgr2=0x562a7dcadb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dcadb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9c08a9700 1 -- 172.21.15.6:0/1575824149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 msgr2=0x562a7dca54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9c08a9700 1 -- 172.21.15.6:0/1575824149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a7da23de0 con 0x562a7dca6700 2023-09-13T09:40:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dcadb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb8650 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0097530 tx=0x7fc9b00990e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb422113980deb1e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9a7fff700 1 -- 172.21.15.6:0/1575824149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b0097580 con 0x562a7dca6700 2023-09-13T09:40:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9a7fff700 1 -- 172.21.15.6:0/1575824149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562a7dc98670 con 0x562a7dca6700 2023-09-13T09:40:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9a7fff700 1 -- 172.21.15.6:0/1575824149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b00a0fe0 con 0x562a7dca6700 2023-09-13T09:40:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1575824149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 msgr2=0x562a7dcb8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb8650 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0097530 tx=0x7fc9b00990e0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1575824149 shutdown_connections 2023-09-13T09:40:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.944+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca7060 0x562a7dcadb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca5a00 0x562a7dca54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1575824149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca6700 0x562a7dcb8650 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1575824149 >> 172.21.15.6:0/1575824149 conn(0x562a7dc03c80 msgr2=0x562a7dc9fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1575824149 shutdown_connections 2023-09-13T09:40:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1575824149 wait complete. 2023-09-13T09:40:42.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 -- start start 2023-09-13T09:40:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 Processor -- start 2023-09-13T09:40:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca6700 0x562a7dcb47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca7060 0x562a7dcb7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dcb7d50 con 0x562a7dca7060 2023-09-13T09:40:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dcb7ec0 con 0x562a7dca6700 2023-09-13T09:40:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a7dcb8080 con 0x562a7dca5a00 2023-09-13T09:40:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9cf4f3b80 10 client.0 _ll_register_callbacks cb 0x562a7db93680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9c18ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca7060 0x562a7dcb7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.945+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca6700 0x562a7dcb47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c08a9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca6700 0x562a7dcb47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56200/0 (socket says 172.21.15.6:56200) 2023-09-13T09:40:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c08a9700 1 -- 172.21.15.6:0/1395161967 learned_addr learned my addr 172.21.15.6:0/1395161967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c18ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca7060 0x562a7dcb7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34446/0 (socket says 172.21.15.6:34446) 2023-09-13T09:40:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c18ab700 1 -- 172.21.15.6:0/1395161967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 msgr2=0x562a7dcb42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c18ab700 1 -- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca6700 msgr2=0x562a7dcb47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca6700 0x562a7dcb47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c18ab700 1 -- 172.21.15.6:0/1395161967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562a7dc0f7a0 con 0x562a7dca7060 2023-09-13T09:40:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c08a9700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca6700 0x562a7dcb47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:42.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9c18ab700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca7060 0x562a7dcb7810 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x562a7dc9c9f0 tx=0x7fc9b4007ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=962aa6493b6e1353 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/1395161967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b400e040 con 0x562a7dca7060 2023-09-13T09:40:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/1395161967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc9b4004db0 con 0x562a7dca7060 2023-09-13T09:40:42.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9b801e040 con 0x562a7dca7060 2023-09-13T09:40:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/1395161967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9b4003a00 con 0x562a7dca7060 2023-09-13T09:40:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9cf4f3b80 10 client.15651 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.946+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562a7da0cc60 con 0x562a7dca7060 2023-09-13T09:40:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/1395161967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9b801e040 con 0x562a7dca7060 2023-09-13T09:40:42.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/1395161967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc9b4004020 con 0x562a7dca7060 2023-09-13T09:40:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9cf4f3b80 10 client.15651 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9cf4f3b80 10 client.15651 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9cf4f3b80 20 client.15651 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dd11da0 0x562a7dd141c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:42.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9cf4f3b80 4 client.15651 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:40:42.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562a7dbb1050 con 0x562a7dd11da0 2023-09-13T09:40:42.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dd11da0 0x562a7dd141c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:42.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9a4ff9700 10 client.15651 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:42.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.947+0000 7fc9c10aa700 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dd11da0 0x562a7dd141c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9cbf1929191feed3 server_cookie=e9873684b1ff517a in_seq=0 out_seq=0 2023-09-13T09:40:42.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9a4ff9700 1 -- 172.21.15.6:0/1395161967 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x562a7dbb1050 con 0x562a7dd11da0 2023-09-13T09:40:42.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9a4ff9700 10 client.15651 handle_command_reply: tid=0 2023-09-13T09:40:42.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 client.15651 shutdown 2023-09-13T09:40:42.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca7060 msgr2=0x562a7dcb7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca7060 0x562a7dcb7810 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x562a7dc9c9f0 tx=0x7fc9b4007ba0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 shutdown_connections 2023-09-13T09:40:42.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562a7dd11da0 0x562a7dd141c0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a7dca7060 0x562a7dcb7810 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9a4ff9700 0 client.15651 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:42.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a7dca5a00 0x562a7dcb42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 --2- 172.21.15.6:0/1395161967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a7dca6700 0x562a7dcb47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 >> 172.21.15.6:0/1395161967 conn(0x562a7dc03c80 msgr2=0x562a7dcadb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:42.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 shutdown_connections 2023-09-13T09:40:42.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 1 -- 172.21.15.6:0/1395161967 wait complete. 2023-09-13T09:40:42.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9cf4f3b80 20 client.15651 trim_cache size 0 max 16384 2023-09-13T09:40:42.970 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:40:42.971 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:40:42.971 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:40:42.971 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:40:42.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9a80a0640 msgr2=0x7fc9a80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9a80a0640 0x7fc9a80a2b00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009990 tx=0x7fc9b801a040 comp rx=0 tx=0).stop 2023-09-13T09:40:42.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc100eb0 msgr2=0x7fc9bc195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc100eb0 0x7fc9bc195ec0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fc9b000d950 tx=0x7fc9b000dc60 comp rx=0 tx=0).stop 2023-09-13T09:40:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 shutdown_connections 2023-09-13T09:40:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9bc101850 0x7fc9bc19cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9bc0ffcc0 0x7fc9bc195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9a80a0640 0x7fc9a80a2b00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 --2- 172.21.15.6:0/220642491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9bc100eb0 0x7fc9bc195ec0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.948+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 >> 172.21.15.6:0/220642491 conn(0x7fc9bc0fb250 msgr2=0x7fc9bc0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.949+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 shutdown_connections 2023-09-13T09:40:42.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:42.949+0000 7fc9c330e700 1 -- 172.21.15.6:0/220642491 wait complete. 2023-09-13T09:40:42.975 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:40:42.975 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:40:43.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 -- 172.21.15.6:0/200198388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 msgr2=0x7fae34108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 --2- 172.21.15.6:0/200198388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae34108ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00b0a0 tx=0x7fae2c00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 -- 172.21.15.6:0/200198388 shutdown_connections 2023-09-13T09:40:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 --2- 172.21.15.6:0/200198388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae34108ee0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 --2- 172.21.15.6:0/200198388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae34101810 0x7fae34103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 --2- 172.21.15.6:0/200198388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae34104140 0x7fae34106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 -- 172.21.15.6:0/200198388 >> 172.21.15.6:0/200198388 conn(0x7fae340fb220 msgr2=0x7fae340fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 -- 172.21.15.6:0/200198388 shutdown_connections 2023-09-13T09:40:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.101+0000 7fae39bfd700 1 -- 172.21.15.6:0/200198388 wait complete. 2023-09-13T09:40:43.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 Processor -- start 2023-09-13T09:40:43.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 -- start start 2023-09-13T09:40:43.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae34101810 0x7fae34101180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae34104140 0x7fae340ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae340ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341004a0 con 0x7fae34106a70 2023-09-13T09:40:43.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae34100610 con 0x7fae34104140 2023-09-13T09:40:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae39bfd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae341a0bb0 con 0x7fae34101810 2023-09-13T09:40:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae33fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae340ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae33fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae340ffd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34460/0 (socket says 172.21.15.6:34460) 2023-09-13T09:40:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae33fff700 1 -- 172.21.15.6:0/2005823487 learned_addr learned my addr 172.21.15.6:0/2005823487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae32ffd700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae34104140 0x7fae340ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.102+0000 7fae337fe700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae34101810 0x7fae34101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae33fff700 1 -- 172.21.15.6:0/2005823487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae34101810 msgr2=0x7fae34101180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae33fff700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae34101810 0x7fae34101180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae33fff700 1 -- 172.21.15.6:0/2005823487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae34104140 msgr2=0x7fae340ff7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae33fff700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae34104140 0x7fae340ff7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae33fff700 1 -- 172.21.15.6:0/2005823487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae24009520 con 0x7fae34106a70 2023-09-13T09:40:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae33fff700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae340ffd00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009fd0 tx=0x7fae2c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae30ff9700 1 -- 172.21.15.6:0/2005823487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c00e040 con 0x7fae34106a70 2023-09-13T09:40:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae30ff9700 1 -- 172.21.15.6:0/2005823487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fae2c0094a0 con 0x7fae34106a70 2023-09-13T09:40:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae2c009d00 con 0x7fae34106a70 2023-09-13T09:40:43.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae30ff9700 1 -- 172.21.15.6:0/2005823487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c01b6c0 con 0x7fae34106a70 2023-09-13T09:40:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.103+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae341a10c0 con 0x7fae34106a70 2023-09-13T09:40:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.104+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae340fcda0 con 0x7fae34106a70 2023-09-13T09:40:43.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.105+0000 7fae30ff9700 1 -- 172.21.15.6:0/2005823487 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fae2c01b820 con 0x7fae34106a70 2023-09-13T09:40:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.106+0000 7fae30ff9700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fae1c0a0790 0x7fae1c0a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.106+0000 7fae337fe700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fae1c0a0790 0x7fae1c0a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.106+0000 7fae30ff9700 1 -- 172.21.15.6:0/2005823487 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fae2c0cd2f0 con 0x7fae34106a70 2023-09-13T09:40:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.106+0000 7fae337fe700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fae1c0a0790 0x7fae1c0a2c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae24009df0 tx=0x7fae24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.110+0000 7fae30ff9700 1 -- 172.21.15.6:0/2005823487 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fae2c096ee0 con 0x7fae34106a70 2023-09-13T09:40:43.144 INFO:tasks.workunit.client.0.smithi006.stdout: 1 7427 19.63 MB/sec warmup 3 sec latency 11.069 ms 2023-09-13T09:40:43.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.370+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fae3410c810 con 0x7fae34106a70 2023-09-13T09:40:43.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.371+0000 7fae30ff9700 1 -- 172.21.15.6:0/2005823487 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11337 (secure 0 0 0) 0x7fae2c09a500 con 0x7fae34106a70 2023-09-13T09:40:43.372 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:40:43.372 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:39:49.009431+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:40:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fae1c0a0790 msgr2=0x7fae1c0a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fae1c0a0790 0x7fae1c0a2c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fae24009df0 tx=0x7fae24009260 comp rx=0 tx=0).stop 2023-09-13T09:40:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 msgr2=0x7fae340ffd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae340ffd00 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fae2c009fd0 tx=0x7fae2c00bce0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 shutdown_connections 2023-09-13T09:40:43.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fae1c0a0790 0x7fae1c0a2c50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae34106a70 0x7fae340ffd00 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae34101810 0x7fae34101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 --2- 172.21.15.6:0/2005823487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fae34104140 0x7fae340ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 >> 172.21.15.6:0/2005823487 conn(0x7fae340fb220 msgr2=0x7fae341024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 shutdown_connections 2023-09-13T09:40:43.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.373+0000 7fae39bfd700 1 -- 172.21.15.6:0/2005823487 wait complete. 2023-09-13T09:40:43.377 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2023-09-13T09:40:43.386 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:40:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.515+0000 7fc2942a5700 1 -- 172.21.15.6:0/1465601988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 msgr2=0x7fc28c1000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.515+0000 7fc2942a5700 1 --2- 172.21.15.6:0/1465601988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c1000c0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fc2880099c0 tx=0x7fc288009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.515+0000 7fc2942a5700 1 -- 172.21.15.6:0/1465601988 shutdown_connections 2023-09-13T09:40:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.515+0000 7fc2942a5700 1 --2- 172.21.15.6:0/1465601988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c101830 0x7fc28c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.515+0000 7fc2942a5700 1 --2- 172.21.15.6:0/1465601988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c1000c0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.515+0000 7fc2942a5700 1 --2- 172.21.15.6:0/1465601988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c100e90 0x7fc28c1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.515+0000 7fc2942a5700 1 -- 172.21.15.6:0/1465601988 >> 172.21.15.6:0/1465601988 conn(0x7fc28c0fb1f0 msgr2=0x7fc28c0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 -- 172.21.15.6:0/1465601988 shutdown_connections 2023-09-13T09:40:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 -- 172.21.15.6:0/1465601988 wait complete. 2023-09-13T09:40:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 Processor -- start 2023-09-13T09:40:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 -- start start 2023-09-13T09:40:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c069cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c100e90 0x7fc28c19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c101830 0x7fc28c19de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19e5c0 con 0x7fc28c0ffca0 2023-09-13T09:40:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19e730 con 0x7fc28c100e90 2023-09-13T09:40:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc2942a5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c19e8f0 con 0x7fc28c101830 2023-09-13T09:40:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc292041700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c069cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc292041700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c069cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34470/0 (socket says 172.21.15.6:34470) 2023-09-13T09:40:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc292041700 1 -- 172.21.15.6:0/135686544 learned_addr learned my addr 172.21.15.6:0/135686544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.516+0000 7fc291840700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c100e90 0x7fc28c19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc292842700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c101830 0x7fc28c19de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc292041700 1 -- 172.21.15.6:0/135686544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c101830 msgr2=0x7fc28c19de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc292041700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c101830 0x7fc28c19de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc292041700 1 -- 172.21.15.6:0/135686544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c100e90 msgr2=0x7fc28c19b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc292041700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c100e90 0x7fc28c19b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc292041700 1 -- 172.21.15.6:0/135686544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c009520 con 0x7fc28c0ffca0 2023-09-13T09:40:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc292041700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c069cd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc288009fd0 tx=0x7fc28800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc2837fe700 1 -- 172.21.15.6:0/135686544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28801d070 con 0x7fc28c0ffca0 2023-09-13T09:40:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc2837fe700 1 -- 172.21.15.6:0/135686544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc288005030 con 0x7fc28c0ffca0 2023-09-13T09:40:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2880095f0 con 0x7fc28c0ffca0 2023-09-13T09:40:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc2837fe700 1 -- 172.21.15.6:0/135686544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc288004aa0 con 0x7fc28c0ffca0 2023-09-13T09:40:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.517+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c19ee00 con 0x7fc28c0ffca0 2023-09-13T09:40:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.519+0000 7fc2837fe700 1 -- 172.21.15.6:0/135686544 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc288005410 con 0x7fc28c0ffca0 2023-09-13T09:40:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.520+0000 7fc2837fe700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2780a0640 0x7fc2780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.520+0000 7fc2837fe700 1 -- 172.21.15.6:0/135686544 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc2880cca40 con 0x7fc28c0ffca0 2023-09-13T09:40:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.520+0000 7fc291840700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2780a0640 0x7fc2780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc291840700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2780a0640 0x7fc2780a2b00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009df0 tx=0x7fc27c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 Processor -- start 2023-09-13T09:40:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 -- start start 2023-09-13T09:40:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a46816ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a4681694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468169e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4680c2780 con 0x55a46816a700 2023-09-13T09:40:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4680c00a0 con 0x55a468169a00 2023-09-13T09:40:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4680bb990 con 0x55a46816b060 2023-09-13T09:40:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc292842700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468169e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc292842700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468169e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56238/0 (socket says 172.21.15.6:56238) 2023-09-13T09:40:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.521+0000 7fc292842700 1 -- 172.21.15.6:0/1725303688 learned_addr learned my addr 172.21.15.6:0/1725303688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc291840700 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a4681694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc292041700 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a46816ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc292842700 1 -- 172.21.15.6:0/1725303688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 msgr2=0x55a4681694c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc292842700 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a4681694c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc292842700 1 -- 172.21.15.6:0/1725303688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 msgr2=0x55a46816ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc292842700 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a46816ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc292842700 1 -- 172.21.15.6:0/1725303688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a467f3b630 con 0x55a468169a00 2023-09-13T09:40:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc292842700 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468169e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2840098f0 tx=0x7fc284009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=825aaa0793394dec server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc280d82700 1 -- 172.21.15.6:0/1725303688 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284019070 con 0x55a468169a00 2023-09-13T09:40:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc280d82700 1 -- 172.21.15.6:0/1725303688 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc28400f040 con 0x55a468169a00 2023-09-13T09:40:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.522+0000 7fc280d82700 1 -- 172.21.15.6:0/1725303688 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284007a30 con 0x55a468169a00 2023-09-13T09:40:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 -- 172.21.15.6:0/1725303688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 msgr2=0x55a468169e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468169e80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2840098f0 tx=0x7fc284009c00 comp rx=0 tx=0).stop 2023-09-13T09:40:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 -- 172.21.15.6:0/1725303688 shutdown_connections 2023-09-13T09:40:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468169e80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a46816ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/1725303688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a4681694c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 -- 172.21.15.6:0/1725303688 >> 172.21.15.6:0/1725303688 conn(0x55a4680c7c80 msgr2=0x55a468163f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 -- 172.21.15.6:0/1725303688 shutdown_connections 2023-09-13T09:40:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 -- 172.21.15.6:0/1725303688 wait complete. 2023-09-13T09:40:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 -- start start 2023-09-13T09:40:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.523+0000 7fc2a048ab80 1 Processor -- start 2023-09-13T09:40:43.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468172ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816a700 0x55a468173410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816b060 0x55a46817a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a468059bb0 con 0x55a46816b060 2023-09-13T09:40:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4680598b0 con 0x55a468169a00 2023-09-13T09:40:43.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a467f3d920 con 0x55a46816a700 2023-09-13T09:40:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc2a048ab80 10 client.0 _ll_register_callbacks cb 0x55a468057680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816b060 0x55a46817a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292041700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468172ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292041700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468172ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56240/0 (socket says 172.21.15.6:56240) 2023-09-13T09:40:43.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292041700 1 -- 172.21.15.6:0/2630913925 learned_addr learned my addr 172.21.15.6:0/2630913925 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816b060 0x55a46817a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34488/0 (socket says 172.21.15.6:34488) 2023-09-13T09:40:43.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc291840700 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816a700 0x55a468173410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 -- 172.21.15.6:0/2630913925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816a700 msgr2=0x55a468173410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816a700 0x55a468173410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 -- 172.21.15.6:0/2630913925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 msgr2=0x55a468172ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468172ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 -- 172.21.15.6:0/2630913925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc284003c50 con 0x55a46816b060 2023-09-13T09:40:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc292842700 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816b060 0x55a46817a450 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc284009f50 tx=0x7fc284004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac4444863acf1ea0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.524+0000 7fc275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc275ffb700 1 -- 172.21.15.6:0/2630913925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284023070 con 0x55a46816b060 2023-09-13T09:40:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc275ffb700 1 -- 172.21.15.6:0/2630913925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc2840079c0 con 0x55a46816b060 2023-09-13T09:40:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a46815c670 con 0x55a46816b060 2023-09-13T09:40:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc275ffb700 1 -- 172.21.15.6:0/2630913925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc284019040 con 0x55a46816b060 2023-09-13T09:40:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 10 client.15669 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a4680d37a0 con 0x55a46816b060 2023-09-13T09:40:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc275ffb700 1 -- 172.21.15.6:0/2630913925 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc28402d020 con 0x55a46816b060 2023-09-13T09:40:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc275ffb700 1 -- 172.21.15.6:0/2630913925 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc284026030 con 0x55a46816b060 2023-09-13T09:40:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 10 client.15669 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 10 client.15669 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:40:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 20 client.15669 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a46817ebe0 0x55a468181000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 4 client.15669 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a4680b4970 con 0x55a46817ebe0 2023-09-13T09:40:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.525+0000 7fc292041700 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a46817ebe0 0x55a468181000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.526+0000 7fc292041700 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a46817ebe0 0x55a468181000 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2ff2093936af89f4 server_cookie=ec053620e4384cc6 in_seq=0 out_seq=0 2023-09-13T09:40:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.526+0000 7fc275ffb700 10 client.15669 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.526+0000 7fc275ffb700 1 -- 172.21.15.6:0/2630913925 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a4680b4970 con 0x55a46817ebe0 2023-09-13T09:40:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.526+0000 7fc275ffb700 10 client.15669 handle_command_reply: tid=0 2023-09-13T09:40:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 client.15669 shutdown 2023-09-13T09:40:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816b060 msgr2=0x55a46817a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816b060 0x55a46817a450 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc284009f50 tx=0x7fc284004780 comp rx=0 tx=0).stop 2023-09-13T09:40:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 shutdown_connections 2023-09-13T09:40:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a46817ebe0 0x55a468181000 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816b060 0x55a46817a450 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a468169a00 0x55a468172ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc275ffb700 0 client.15669 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/2630913925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816a700 0x55a468173410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 >> 172.21.15.6:0/2630913925 conn(0x55a4680c7c80 msgr2=0x55a468163ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 shutdown_connections 2023-09-13T09:40:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 1 -- 172.21.15.6:0/2630913925 wait complete. 2023-09-13T09:40:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.527+0000 7fc2a048ab80 20 client.15669 trim_cache size 0 max 16384 2023-09-13T09:40:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 Processor -- start 2023-09-13T09:40:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 -- start start 2023-09-13T09:40:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a468169a00 0x55a4681694c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816a700 0x55a468180fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a46817a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4681608e0 con 0x55a468169a00 2023-09-13T09:40:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a468165730 con 0x55a46816a700 2023-09-13T09:40:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a468170b80 con 0x55a46816b060 2023-09-13T09:40:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a468169a00 0x55a4681694c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc291840700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816a700 0x55a468180fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a468169a00 0x55a4681694c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34492/0 (socket says 172.21.15.6:34492) 2023-09-13T09:40:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 -- 172.21.15.6:0/4031555523 learned_addr learned my addr 172.21.15.6:0/4031555523 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292842700 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a46817a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 -- 172.21.15.6:0/4031555523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 msgr2=0x55a46817a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a46817a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 -- 172.21.15.6:0/4031555523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816a700 msgr2=0x55a468180fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816a700 0x55a468180fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292041700 1 -- 172.21.15.6:0/4031555523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a467ee7de0 con 0x55a468169a00 2023-09-13T09:40:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.542+0000 7fc292842700 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a46817a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc292041700 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a468169a00 0x55a4681694c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc288099f10 tx=0x7fc2880ca360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aace1c9ad83a5233 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc281583700 1 -- 172.21.15.6:0/4031555523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2880a21f0 con 0x55a468169a00 2023-09-13T09:40:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc281583700 1 -- 172.21.15.6:0/4031555523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2880a00b0 con 0x55a468169a00 2023-09-13T09:40:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc281583700 1 -- 172.21.15.6:0/4031555523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28809a6d0 con 0x55a468169a00 2023-09-13T09:40:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 -- 172.21.15.6:0/4031555523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a468169a00 msgr2=0x55a4681694c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a468169a00 0x55a4681694c0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fc288099f10 tx=0x7fc2880ca360 comp rx=0 tx=0).stop 2023-09-13T09:40:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 -- 172.21.15.6:0/4031555523 shutdown_connections 2023-09-13T09:40:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a46816b060 0x55a46817a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a468169a00 0x55a4681694c0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/4031555523 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816a700 0x55a468180fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 -- 172.21.15.6:0/4031555523 >> 172.21.15.6:0/4031555523 conn(0x55a4680c7c80 msgr2=0x55a468171be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 -- 172.21.15.6:0/4031555523 shutdown_connections 2023-09-13T09:40:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.543+0000 7fc2a048ab80 1 -- 172.21.15.6:0/4031555523 wait complete. 2023-09-13T09:40:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 -- start start 2023-09-13T09:40:43.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 Processor -- start 2023-09-13T09:40:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a468169a00 0x55a468175ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a4681760e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816b060 0x55a468179100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a468179640 con 0x55a46816a700 2023-09-13T09:40:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a4681797b0 con 0x55a46816b060 2023-09-13T09:40:43.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a468179970 con 0x55a468169a00 2023-09-13T09:40:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc2a048ab80 10 client.0 _ll_register_callbacks cb 0x55a468057680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc291840700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a4681760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc292842700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816b060 0x55a468179100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc291840700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a4681760e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34500/0 (socket says 172.21.15.6:34500) 2023-09-13T09:40:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc291840700 1 -- 172.21.15.6:0/3895311015 learned_addr learned my addr 172.21.15.6:0/3895311015 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc292842700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816b060 0x55a468179100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56258/0 (socket says 172.21.15.6:56258) 2023-09-13T09:40:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.544+0000 7fc292041700 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a468169a00 0x55a468175ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc292842700 1 -- 172.21.15.6:0/3895311015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a468169a00 msgr2=0x55a468175ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc292842700 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a468169a00 0x55a468175ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc292842700 1 -- 172.21.15.6:0/3895311015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 msgr2=0x55a4681760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc292842700 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a4681760e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc292842700 1 -- 172.21.15.6:0/3895311015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c19ee00 con 0x55a46816b060 2023-09-13T09:40:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc291840700 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a4681760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc292842700 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816b060 0x55a468179100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc284015cf0 tx=0x7fc284004e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a7386c62393b61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc275ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:40:43.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc275ffb700 1 -- 172.21.15.6:0/3895311015 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284019070 con 0x55a46816b060 2023-09-13T09:40:43.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc28400f040 con 0x55a46816b060 2023-09-13T09:40:43.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc275ffb700 1 -- 172.21.15.6:0/3895311015 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc28402e080 con 0x55a46816b060 2023-09-13T09:40:43.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc275ffb700 1 -- 172.21.15.6:0/3895311015 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc284023070 con 0x55a46816b060 2023-09-13T09:40:43.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc2a048ab80 10 client.25256 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.545+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a467ed0c60 con 0x55a46816b060 2023-09-13T09:40:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc275ffb700 1 -- 172.21.15.6:0/3895311015 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc28400f040 con 0x55a46816b060 2023-09-13T09:40:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc275ffb700 1 -- 172.21.15.6:0/3895311015 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fc284026070 con 0x55a46816b060 2023-09-13T09:40:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc2a048ab80 10 client.25256 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:43.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc2a048ab80 10 client.25256 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:40:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc2a048ab80 20 client.25256 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4681d3040 0x55a4681d5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc2a048ab80 4 client.25256 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a468075050 con 0x55a4681d3040 2023-09-13T09:40:43.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc292041700 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4681d3040 0x55a4681d5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc275ffb700 10 client.25256 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.546+0000 7fc292041700 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4681d3040 0x55a4681d5460 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=aa85fe10dbc0e005 server_cookie=e8a8db64291757b1 in_seq=0 out_seq=0 2023-09-13T09:40:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc275ffb700 1 -- 172.21.15.6:0/3895311015 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a468075050 con 0x55a4681d3040 2023-09-13T09:40:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc275ffb700 10 client.25256 handle_command_reply: tid=0 2023-09-13T09:40:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 client.25256 shutdown 2023-09-13T09:40:43.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816b060 msgr2=0x55a468179100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816b060 0x55a468179100 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc284015cf0 tx=0x7fc284004e90 comp rx=0 tx=0).stop 2023-09-13T09:40:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 shutdown_connections 2023-09-13T09:40:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a4681d3040 0x55a4681d5460 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a46816b060 0x55a468179100 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc275ffb700 0 client.25256 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:40:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a468169a00 0x55a468175ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 --2- 172.21.15.6:0/3895311015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a46816a700 0x55a4681760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 >> 172.21.15.6:0/3895311015 conn(0x55a4680c7c80 msgr2=0x55a468170dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 shutdown_connections 2023-09-13T09:40:43.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 1 -- 172.21.15.6:0/3895311015 wait complete. 2023-09-13T09:40:43.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2a048ab80 20 client.25256 trim_cache size 0 max 16384 2023-09-13T09:40:43.571 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2780a0640 msgr2=0x7fc2780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2780a0640 0x7fc2780a2b00 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009df0 tx=0x7fc27c009260 comp rx=0 tx=0).stop 2023-09-13T09:40:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 msgr2=0x7fc28c069cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c069cd0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc288009fd0 tx=0x7fc28800f690 comp rx=0 tx=0).stop 2023-09-13T09:40:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 shutdown_connections 2023-09-13T09:40:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c101830 0x7fc28c19de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2780a0640 0x7fc2780a2b00 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.547+0000 7fc2942a5700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc28c0ffca0 0x7fc28c069cd0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.548+0000 7fc2942a5700 1 --2- 172.21.15.6:0/135686544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc28c100e90 0x7fc28c19b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.548+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 >> 172.21.15.6:0/135686544 conn(0x7fc28c0fb1f0 msgr2=0x7fc28c0fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.548+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 shutdown_connections 2023-09-13T09:40:43.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.548+0000 7fc2942a5700 1 -- 172.21.15.6:0/135686544 wait complete. 2023-09-13T09:40:43.575 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:40:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.702+0000 7f26799c9700 1 -- 172.21.15.6:0/1117530888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674100eb0 msgr2=0x7f2674101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.702+0000 7f26799c9700 1 --2- 172.21.15.6:0/1117530888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674100eb0 0x7f2674101310 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f26640099c0 tx=0x7f2664009cd0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 -- 172.21.15.6:0/1117530888 shutdown_connections 2023-09-13T09:40:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 --2- 172.21.15.6:0/1117530888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2674101850 0x7f2674108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 --2- 172.21.15.6:0/1117530888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26740ffcc0 0x7f26741000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 --2- 172.21.15.6:0/1117530888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674100eb0 0x7f2674101310 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 -- 172.21.15.6:0/1117530888 >> 172.21.15.6:0/1117530888 conn(0x7f26740fb250 msgr2=0x7f26740fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 -- 172.21.15.6:0/1117530888 shutdown_connections 2023-09-13T09:40:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 -- 172.21.15.6:0/1117530888 wait complete. 2023-09-13T09:40:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.703+0000 7f26799c9700 1 Processor -- start 2023-09-13T09:40:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26799c9700 1 -- start start 2023-09-13T09:40:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26799c9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26740ffcc0 0x7f26741959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26799c9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2674100eb0 0x7f2674195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26799c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674101850 0x7f267419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26799c9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267419d550 con 0x7f2674101850 2023-09-13T09:40:43.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26799c9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267419d690 con 0x7f2674100eb0 2023-09-13T09:40:43.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26799c9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267419d820 con 0x7f26740ffcc0 2023-09-13T09:40:43.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674101850 0x7f267419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26727fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2674100eb0 0x7f2674195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674101850 0x7f267419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34516/0 (socket says 172.21.15.6:34516) 2023-09-13T09:40:43.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 -- 172.21.15.6:0/3008419163 learned_addr learned my addr 172.21.15.6:0/3008419163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f2672ffd700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26740ffcc0 0x7f26741959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 -- 172.21.15.6:0/3008419163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26740ffcc0 msgr2=0x7f26741959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26740ffcc0 0x7f26741959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 -- 172.21.15.6:0/3008419163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2674100eb0 msgr2=0x7f2674195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2674100eb0 0x7f2674195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26737fe700 1 -- 172.21.15.6:0/3008419163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26640095f0 con 0x7f2674101850 2023-09-13T09:40:43.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f2672ffd700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26740ffcc0 0x7f26741959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:43.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.704+0000 7f26727fc700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2674100eb0 0x7f2674195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.705+0000 7f26737fe700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674101850 0x7f267419cf80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f266c00ef30 tx=0x7f266c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.705+0000 7f26789c7700 1 -- 172.21.15.6:0/3008419163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c018070 con 0x7f2674101850 2023-09-13T09:40:43.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.705+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f267419daa0 con 0x7f2674101850 2023-09-13T09:40:43.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.705+0000 7f26789c7700 1 -- 172.21.15.6:0/3008419163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f266c00f040 con 0x7f2674101850 2023-09-13T09:40:43.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.705+0000 7f26789c7700 1 -- 172.21.15.6:0/3008419163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c00cdb0 con 0x7f2674101850 2023-09-13T09:40:43.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.705+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267419df60 con 0x7f2674101850 2023-09-13T09:40:43.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.707+0000 7f26789c7700 1 -- 172.21.15.6:0/3008419163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f266c003a00 con 0x7f2674101850 2023-09-13T09:40:43.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.707+0000 7f26789c7700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26600a0640 0x7f26600a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f26789c7700 1 -- 172.21.15.6:0/3008419163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f266c0cb860 con 0x7f2674101850 2023-09-13T09:40:43.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2672ffd700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26600a0640 0x7f26600a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2672ffd700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26600a0640 0x7f26600a2b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2674100d10 tx=0x7f265c008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 Processor -- start 2023-09-13T09:40:43.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 -- start start 2023-09-13T09:40:43.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4bf8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4bf74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4b50780 con 0x5625f4bf8700 2023-09-13T09:40:43.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4b4e0a0 con 0x5625f4bf9060 2023-09-13T09:40:43.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.708+0000 7f2685baeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4b49990 con 0x5625f4bf7a00 2023-09-13T09:40:43.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4bf8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4bf8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34520/0 (socket says 172.21.15.6:34520) 2023-09-13T09:40:43.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 -- 172.21.15.6:0/1126563487 learned_addr learned my addr 172.21.15.6:0/1126563487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f26727fc700 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4bf74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f26737fe700 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 -- 172.21.15.6:0/1126563487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 msgr2=0x5625f4bf7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 -- 172.21.15.6:0/1126563487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 msgr2=0x5625f4bf74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4bf74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 -- 172.21.15.6:0/1126563487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f49c9630 con 0x5625f4bf8700 2023-09-13T09:40:43.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f26737fe700 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2672ffd700 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4bf8b20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f265c00d7a0 tx=0x7f265c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd7710a5f228094 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2669ffb700 1 -- 172.21.15.6:0/1126563487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c014640 con 0x5625f4bf8700 2023-09-13T09:40:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2669ffb700 1 -- 172.21.15.6:0/1126563487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f265c014c60 con 0x5625f4bf8700 2023-09-13T09:40:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.709+0000 7f2669ffb700 1 -- 172.21.15.6:0/1126563487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c01fba0 con 0x5625f4bf8700 2023-09-13T09:40:43.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 -- 172.21.15.6:0/1126563487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 msgr2=0x5625f4bf8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4bf8b20 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f265c00d7a0 tx=0x7f265c010000 comp rx=0 tx=0).stop 2023-09-13T09:40:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 -- 172.21.15.6:0/1126563487 shutdown_connections 2023-09-13T09:40:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4bf8b20 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 --2- 172.21.15.6:0/1126563487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4bf74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 -- 172.21.15.6:0/1126563487 >> 172.21.15.6:0/1126563487 conn(0x5625f4b55c80 msgr2=0x5625f4bf1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 -- 172.21.15.6:0/1126563487 shutdown_connections 2023-09-13T09:40:43.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 -- 172.21.15.6:0/1126563487 wait complete. 2023-09-13T09:40:43.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.710+0000 7f2685baeb80 1 -- start start 2023-09-13T09:40:43.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 1 Processor -- start 2023-09-13T09:40:43.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf7a00 0x5625f4c00f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf9060 0x5625f4c084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4ae7bb0 con 0x5625f4bf9060 2023-09-13T09:40:43.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4ae78b0 con 0x5625f4bf7a00 2023-09-13T09:40:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f49cb920 con 0x5625f4bf8700 2023-09-13T09:40:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f26737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf9060 0x5625f4c084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2672ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf7a00 0x5625f4c00f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f26737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf9060 0x5625f4c084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34530/0 (socket says 172.21.15.6:34530) 2023-09-13T09:40:43.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f26737fe700 1 -- 172.21.15.6:0/2748068020 learned_addr learned my addr 172.21.15.6:0/2748068020 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f2685baeb80 10 client.0 _ll_register_callbacks cb 0x5625f4ae5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.711+0000 7f26727fc700 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f26737fe700 1 -- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 msgr2=0x5625f4c014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f26737fe700 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f26737fe700 1 -- 172.21.15.6:0/2748068020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf7a00 msgr2=0x5625f4c00f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f26737fe700 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf7a00 0x5625f4c00f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f26737fe700 1 -- 172.21.15.6:0/2748068020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f265c00e040 con 0x5625f4bf9060 2023-09-13T09:40:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2672ffd700 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf7a00 0x5625f4c00f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f26737fe700 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf9060 0x5625f4c084e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f266c099020 tx=0x7f266c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d584cd04ad69e2d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2652ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2652ffd700 1 -- 172.21.15.6:0/2748068020 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0b1420 con 0x5625f4bf9060 2023-09-13T09:40:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2652ffd700 1 -- 172.21.15.6:0/2748068020 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f266c099790 con 0x5625f4bf9060 2023-09-13T09:40:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625f4bea670 con 0x5625f4bf9060 2023-09-13T09:40:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2652ffd700 1 -- 172.21.15.6:0/2748068020 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f266c099090 con 0x5625f4bf9060 2023-09-13T09:40:43.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 10 client.15687 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:43.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5625f4b617a0 con 0x5625f4bf9060 2023-09-13T09:40:43.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2652ffd700 1 -- 172.21.15.6:0/2748068020 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5625f4bea670 con 0x5625f4bf9060 2023-09-13T09:40:43.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2652ffd700 1 -- 172.21.15.6:0/2748068020 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f266c0a0be0 con 0x5625f4bf9060 2023-09-13T09:40:43.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 10 client.15687 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:43.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 10 client.15687 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:40:43.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 20 client.15687 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:43.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c0cc00 0x5625f4c0eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 4 client.15687 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:43.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.712+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625f4b42970 con 0x5625f4c0cc00 2023-09-13T09:40:43.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.713+0000 7f2672ffd700 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c0cc00 0x5625f4c0eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.713+0000 7f2652ffd700 10 client.15687 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:43.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.713+0000 7f2672ffd700 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c0cc00 0x5625f4c0eff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1d32ed99804e9a79 server_cookie=73311aedecfb5133 in_seq=0 out_seq=0 2023-09-13T09:40:43.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2652ffd700 1 -- 172.21.15.6:0/2748068020 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5625f4b42970 con 0x5625f4c0cc00 2023-09-13T09:40:43.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2652ffd700 10 client.15687 handle_command_reply: tid=0 2023-09-13T09:40:43.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 client.15687 shutdown 2023-09-13T09:40:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf9060 msgr2=0x5625f4c084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf9060 0x5625f4c084e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f266c099020 tx=0x7f266c004ad0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 shutdown_connections 2023-09-13T09:40:43.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c0cc00 0x5625f4c0eff0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf9060 0x5625f4c084e0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf7a00 0x5625f4c00f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 --2- 172.21.15.6:0/2748068020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2652ffd700 0 client.15687 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 >> 172.21.15.6:0/2748068020 conn(0x5625f4b55c80 msgr2=0x5625f4bec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 shutdown_connections 2023-09-13T09:40:43.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 1 -- 172.21.15.6:0/2748068020 wait complete. 2023-09-13T09:40:43.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.714+0000 7f2685baeb80 20 client.15687 trim_cache size 0 max 16384 2023-09-13T09:40:43.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 Processor -- start 2023-09-13T09:40:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 -- start start 2023-09-13T09:40:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4c08470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c08dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4c0c9e0 con 0x5625f4bf8700 2023-09-13T09:40:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4bf3330 con 0x5625f4bf9060 2023-09-13T09:40:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2685baeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4c01be0 con 0x5625f4bf7a00 2023-09-13T09:40:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f26727fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4c08470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f26727fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4c08470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34536/0 (socket says 172.21.15.6:34536) 2023-09-13T09:40:43.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f26727fc700 1 -- 172.21.15.6:0/284187432 learned_addr learned my addr 172.21.15.6:0/284187432 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f26737fe700 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c08dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.727+0000 7f2672ffd700 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f26727fc700 1 -- 172.21.15.6:0/284187432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 msgr2=0x5625f4bf74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f26727fc700 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f26727fc700 1 -- 172.21.15.6:0/284187432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 msgr2=0x5625f4c08dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f26727fc700 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c08dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f26727fc700 1 -- 172.21.15.6:0/284187432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625f4975de0 con 0x5625f4bf8700 2023-09-13T09:40:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f26737fe700 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c08dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f26727fc700 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4c08470 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f26640058e0 tx=0x7f266400bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cb6f66a6d37563 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f266a7fc700 1 -- 172.21.15.6:0/284187432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266401d070 con 0x5625f4bf8700 2023-09-13T09:40:43.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f266a7fc700 1 -- 172.21.15.6:0/284187432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f266401e040 con 0x5625f4bf8700 2023-09-13T09:40:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.728+0000 7f266a7fc700 1 -- 172.21.15.6:0/284187432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266400f6c0 con 0x5625f4bf8700 2023-09-13T09:40:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 -- 172.21.15.6:0/284187432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 msgr2=0x5625f4c08470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4c08470 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f26640058e0 tx=0x7f266400bd40 comp rx=0 tx=0).stop 2023-09-13T09:40:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 -- 172.21.15.6:0/284187432 shutdown_connections 2023-09-13T09:40:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c08dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf7a00 0x5625f4bf74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 --2- 172.21.15.6:0/284187432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf8700 0x5625f4c08470 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 -- 172.21.15.6:0/284187432 >> 172.21.15.6:0/284187432 conn(0x5625f4b55c80 msgr2=0x5625f4bffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 -- 172.21.15.6:0/284187432 shutdown_connections 2023-09-13T09:40:43.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 -- 172.21.15.6:0/284187432 wait complete. 2023-09-13T09:40:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 -- start start 2023-09-13T09:40:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.729+0000 7f2685baeb80 1 Processor -- start 2023-09-13T09:40:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf7a00 0x5625f4c04440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c04980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2685baeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c079a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2685baeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4c07ee0 con 0x5625f4bf7a00 2023-09-13T09:40:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2685baeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4c08050 con 0x5625f4bf9060 2023-09-13T09:40:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2685baeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625f4c08210 con 0x5625f4bf8700 2023-09-13T09:40:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf7a00 0x5625f4c04440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf7a00 0x5625f4c04440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34540/0 (socket says 172.21.15.6:34540) 2023-09-13T09:40:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 -- 172.21.15.6:0/686531622 learned_addr learned my addr 172.21.15.6:0/686531622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f26737fe700 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c079a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2685baeb80 10 client.0 _ll_register_callbacks cb 0x5625f4ae5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f26727fc700 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c04980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 -- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 msgr2=0x5625f4c04980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c04980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 -- 172.21.15.6:0/686531622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 msgr2=0x5625f4c079a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c079a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 -- 172.21.15.6:0/686531622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625f4b617a0 con 0x5625f4bf7a00 2023-09-13T09:40:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2672ffd700 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf7a00 0x5625f4c04440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f265c009390 tx=0x7f265c00de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96f726641c18ab4d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2652ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.730+0000 7f2652ffd700 1 -- 172.21.15.6:0/686531622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f265c0096e0 con 0x5625f4bf7a00 2023-09-13T09:40:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2652ffd700 1 -- 172.21.15.6:0/686531622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f265c02fd50 con 0x5625f4bf7a00 2023-09-13T09:40:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f265c014c60 con 0x5625f4bf7a00 2023-09-13T09:40:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2652ffd700 1 -- 172.21.15.6:0/686531622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f265c014740 con 0x5625f4bf7a00 2023-09-13T09:40:43.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 10 client.15693 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f2674108a50 con 0x5625f4bf7a00 2023-09-13T09:40:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2652ffd700 1 -- 172.21.15.6:0/686531622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f265c014c60 con 0x5625f4bf7a00 2023-09-13T09:40:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2652ffd700 1 -- 172.21.15.6:0/686531622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f265c02f430 con 0x5625f4bf7a00 2023-09-13T09:40:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 10 client.15693 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:43.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 10 client.15693 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:40:43.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 20 client.15693 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:43.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c61c30 0x5625f4c64050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 4 client.15693 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:43.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5625f4b03050 con 0x5625f4c61c30 2023-09-13T09:40:43.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.731+0000 7f26727fc700 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c61c30 0x5625f4c64050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f26727fc700 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c61c30 0x5625f4c64050 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=262aae66df958793 server_cookie=ebaf0bcc33a690db in_seq=0 out_seq=0 2023-09-13T09:40:43.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2652ffd700 10 client.15693 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:43.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2652ffd700 1 -- 172.21.15.6:0/686531622 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5625f4b03050 con 0x5625f4c61c30 2023-09-13T09:40:43.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2652ffd700 10 client.15693 handle_command_reply: tid=0 2023-09-13T09:40:43.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 client.15693 shutdown 2023-09-13T09:40:43.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf7a00 msgr2=0x5625f4c04440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf7a00 0x5625f4c04440 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f265c009390 tx=0x7f265c00de80 comp rx=0 tx=0).stop 2023-09-13T09:40:43.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 shutdown_connections 2023-09-13T09:40:43.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5625f4c61c30 0x5625f4c64050 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625f4bf9060 0x5625f4c079a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2652ffd700 0 client.15693 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:40:43.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625f4bf7a00 0x5625f4c04440 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 --2- 172.21.15.6:0/686531622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625f4bf8700 0x5625f4c04980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 >> 172.21.15.6:0/686531622 conn(0x5625f4b55c80 msgr2=0x5625f4bfb920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 shutdown_connections 2023-09-13T09:40:43.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 1 -- 172.21.15.6:0/686531622 wait complete. 2023-09-13T09:40:43.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.732+0000 7f2685baeb80 20 client.15693 trim_cache size 0 max 16384 2023-09-13T09:40:43.758 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:43.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26600a0640 msgr2=0x7f26600a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26600a0640 0x7f26600a2b00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2674100d10 tx=0x7f265c008040 comp rx=0 tx=0).stop 2023-09-13T09:40:43.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674101850 msgr2=0x7f267419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674101850 0x7f267419cf80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f266c00ef30 tx=0x7f266c00c3a0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 shutdown_connections 2023-09-13T09:40:43.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26600a0640 0x7f26600a2b00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2674101850 0x7f267419cf80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26740ffcc0 0x7f26741959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 --2- 172.21.15.6:0/3008419163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2674100eb0 0x7f2674195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 >> 172.21.15.6:0/3008419163 conn(0x7f26740fb250 msgr2=0x7f26740fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 shutdown_connections 2023-09-13T09:40:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.733+0000 7f26799c9700 1 -- 172.21.15.6:0/3008419163 wait complete. 2023-09-13T09:40:43.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:40:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 -- 172.21.15.6:0/3545159896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 msgr2=0x7fef6c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 --2- 172.21.15.6:0/3545159896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 0x7fef6c108100 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fef6401e310 tx=0x7fef6401e620 comp rx=0 tx=0).stop 2023-09-13T09:40:43.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 -- 172.21.15.6:0/3545159896 shutdown_connections 2023-09-13T09:40:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 --2- 172.21.15.6:0/3545159896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 0x7fef6c108100 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 --2- 172.21.15.6:0/3545159896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c0ffcc0 0x7fef6c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 --2- 172.21.15.6:0/3545159896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c100eb0 0x7fef6c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 -- 172.21.15.6:0/3545159896 >> 172.21.15.6:0/3545159896 conn(0x7fef6c0fb250 msgr2=0x7fef6c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.903+0000 7fef72e52700 1 -- 172.21.15.6:0/3545159896 shutdown_connections 2023-09-13T09:40:43.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.904+0000 7fef72e52700 1 -- 172.21.15.6:0/3545159896 wait complete. 2023-09-13T09:40:43.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.904+0000 7fef72e52700 1 Processor -- start 2023-09-13T09:40:43.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.904+0000 7fef72e52700 1 -- start start 2023-09-13T09:40:43.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.904+0000 7fef72e52700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c0ffcc0 0x7fef6c071360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.904+0000 7fef72e52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c100eb0 0x7fef6c0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.904+0000 7fef72e52700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 0x7fef6c071de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef72e52700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c197f60 con 0x7fef6c100eb0 2023-09-13T09:40:43.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef72e52700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c1980d0 con 0x7fef6c101850 2023-09-13T09:40:43.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef72e52700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6c198290 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c100eb0 0x7fef6c0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c100eb0 0x7fef6c0718a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34556/0 (socket says 172.21.15.6:34556) 2023-09-13T09:40:43.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef6bfff700 1 -- 172.21.15.6:0/248916237 learned_addr learned my addr 172.21.15.6:0/248916237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef70bee700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c0ffcc0 0x7fef6c071360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef713ef700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 0x7fef6c071de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef70bee700 1 -- 172.21.15.6:0/248916237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 msgr2=0x7fef6c071de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef70bee700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 0x7fef6c071de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef70bee700 1 -- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c100eb0 msgr2=0x7fef6c0718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef70bee700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c100eb0 0x7fef6c0718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef70bee700 1 -- 172.21.15.6:0/248916237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6401ac50 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.905+0000 7fef6bfff700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c100eb0 0x7fef6c0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.906+0000 7fef70bee700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c0ffcc0 0x7fef6c071360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef60005fd0 tx=0x7fef6000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.906+0000 7fef69ffb700 1 -- 172.21.15.6:0/248916237 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60004220 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.906+0000 7fef69ffb700 1 -- 172.21.15.6:0/248916237 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef60004380 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.906+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef6c198570 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.906+0000 7fef69ffb700 1 -- 172.21.15.6:0/248916237 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60003b50 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.906+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef6c198a80 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.909+0000 7fef69ffb700 1 -- 172.21.15.6:0/248916237 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fef60003cf0 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.910+0000 7fef69ffb700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef540a0640 0x7fef540a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.910+0000 7fef69ffb700 1 -- 172.21.15.6:0/248916237 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef60014070 con 0x7fef6c0ffcc0 2023-09-13T09:40:43.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.910+0000 7fef6bfff700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef540a0640 0x7fef540a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.911+0000 7fef6bfff700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef540a0640 0x7fef540a2b00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fef5c011550 tx=0x7fef5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.911+0000 7fef7f037b80 1 Processor -- start 2023-09-13T09:40:43.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.911+0000 7fef7f037b80 1 -- start start 2023-09-13T09:40:43.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7af10 0x561ebde7b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7b870 0x561ebde79cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde7a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef7f037b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebddca780 con 0x561ebde7b870 2023-09-13T09:40:43.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef7f037b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebddc80a0 con 0x561ebde7af10 2023-09-13T09:40:43.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef7f037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebddc3990 con 0x561ebde7a210 2023-09-13T09:40:43.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7b870 0x561ebde79cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7b870 0x561ebde79cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34564/0 (socket says 172.21.15.6:34564) 2023-09-13T09:40:43.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef70bee700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7af10 0x561ebde7b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 -- 172.21.15.6:0/1962762089 learned_addr learned my addr 172.21.15.6:0/1962762089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef713ef700 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde7a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 -- 172.21.15.6:0/1962762089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 msgr2=0x561ebde7a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde7a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 -- 172.21.15.6:0/1962762089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7af10 msgr2=0x561ebde7b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7af10 0x561ebde7b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.912+0000 7fef6bfff700 1 -- 172.21.15.6:0/1962762089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ebdc43630 con 0x561ebde7b870 2023-09-13T09:40:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.913+0000 7fef6bfff700 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7b870 0x561ebde79cd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009880 tx=0x7fef5c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be39de69998d58f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.913+0000 7fef52ffd700 1 -- 172.21.15.6:0/1962762089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c026630 con 0x561ebde7b870 2023-09-13T09:40:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.913+0000 7fef52ffd700 1 -- 172.21.15.6:0/1962762089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef5c021070 con 0x561ebde7b870 2023-09-13T09:40:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.913+0000 7fef52ffd700 1 -- 172.21.15.6:0/1962762089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c01d670 con 0x561ebde7b870 2023-09-13T09:40:43.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 -- 172.21.15.6:0/1962762089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7b870 msgr2=0x561ebde79cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7b870 0x561ebde79cd0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009880 tx=0x7fef5c014000 comp rx=0 tx=0).stop 2023-09-13T09:40:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 -- 172.21.15.6:0/1962762089 shutdown_connections 2023-09-13T09:40:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde7a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7af10 0x561ebde7b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1962762089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7b870 0x561ebde79cd0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 -- 172.21.15.6:0/1962762089 >> 172.21.15.6:0/1962762089 conn(0x561ebddcfc80 msgr2=0x561ebde6bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 -- 172.21.15.6:0/1962762089 shutdown_connections 2023-09-13T09:40:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 -- 172.21.15.6:0/1962762089 wait complete. 2023-09-13T09:40:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.914+0000 7fef7f037b80 1 -- start start 2023-09-13T09:40:43.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 1 Processor -- start 2023-09-13T09:40:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde83730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde83c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebdd61bb0 con 0x561ebde7af10 2023-09-13T09:40:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebdd618b0 con 0x561ebde7b870 2023-09-13T09:40:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebdc45920 con 0x561ebde7a210 2023-09-13T09:40:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef7f037b80 10 client.0 _ll_register_callbacks cb 0x561ebdd5f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde83c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef70bee700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde83730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef713ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde83c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34570/0 (socket says 172.21.15.6:34570) 2023-09-13T09:40:43.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef6bfff700 1 -- 172.21.15.6:0/728819312 learned_addr learned my addr 172.21.15.6:0/728819312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef713ef700 1 -- 172.21.15.6:0/728819312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 msgr2=0x561ebde83730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef713ef700 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde83730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef713ef700 1 -- 172.21.15.6:0/728819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 msgr2=0x561ebde83c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef713ef700 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde83c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef713ef700 1 -- 172.21.15.6:0/728819312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef5c017070 con 0x561ebde7b870 2023-09-13T09:40:43.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.915+0000 7fef6bfff700 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde83c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef70bee700 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde83730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef713ef700 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8acb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef6c072f00 tx=0x7fef64004c80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a70818c97088be server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef4bfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:40:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef4bfff700 1 -- 172.21.15.6:0/728819312 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef64030040 con 0x561ebde7b870 2023-09-13T09:40:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ebde64670 con 0x561ebde7b870 2023-09-13T09:40:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef4bfff700 1 -- 172.21.15.6:0/728819312 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef640229c0 con 0x561ebde7b870 2023-09-13T09:40:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef4bfff700 1 -- 172.21.15.6:0/728819312 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef6401aad0 con 0x561ebde7b870 2023-09-13T09:40:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef7f037b80 10 client.25286 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561ebdddb7a0 con 0x561ebde7b870 2023-09-13T09:40:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef4bfff700 1 -- 172.21.15.6:0/728819312 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561ebde64670 con 0x561ebde7b870 2023-09-13T09:40:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.916+0000 7fef4bfff700 1 -- 172.21.15.6:0/728819312 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fef64018c90 con 0x561ebde7b870 2023-09-13T09:40:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef7f037b80 10 client.25286 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef7f037b80 10 client.25286 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:40:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef7f037b80 20 client.25286 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef7f037b80 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebde91870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef7f037b80 4 client.25286 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ebddbc970 con 0x561ebde8f450 2023-09-13T09:40:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef70bee700 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebde91870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef4bfff700 10 client.25286 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.917+0000 7fef70bee700 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebde91870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c3fe804ce33b9524 server_cookie=5c1d1ede0737eb41 in_seq=0 out_seq=0 2023-09-13T09:40:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef4bfff700 1 -- 172.21.15.6:0/728819312 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561ebddbc970 con 0x561ebde8f450 2023-09-13T09:40:43.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef4bfff700 10 client.25286 handle_command_reply: tid=0 2023-09-13T09:40:43.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 client.25286 shutdown 2023-09-13T09:40:43.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 msgr2=0x561ebde8acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8acb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fef6c072f00 tx=0x7fef64004c80 comp rx=0 tx=0).stop 2023-09-13T09:40:43.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 shutdown_connections 2023-09-13T09:40:43.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebde91870 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8acb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef4bfff700 0 client.25286 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:43.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde83730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 --2- 172.21.15.6:0/728819312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde83c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 >> 172.21.15.6:0/728819312 conn(0x561ebddcfc80 msgr2=0x561ebde667f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 shutdown_connections 2023-09-13T09:40:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 1 -- 172.21.15.6:0/728819312 wait complete. 2023-09-13T09:40:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.918+0000 7fef7f037b80 20 client.25286 trim_cache size 0 max 16384 2023-09-13T09:40:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 Processor -- start 2023-09-13T09:40:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 -- start start 2023-09-13T09:40:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde79cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde8ac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebde832a0 con 0x561ebde7af10 2023-09-13T09:40:43.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebde8c970 con 0x561ebde7b870 2023-09-13T09:40:43.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef7f037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebde6c860 con 0x561ebde7a210 2023-09-13T09:40:43.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde8ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde8ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34578/0 (socket says 172.21.15.6:34578) 2023-09-13T09:40:43.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef713ef700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef6bfff700 1 -- 172.21.15.6:0/775978952 learned_addr learned my addr 172.21.15.6:0/775978952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.932+0000 7fef70bee700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde79cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef6bfff700 1 -- 172.21.15.6:0/775978952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 msgr2=0x561ebde79cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef6bfff700 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde79cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef6bfff700 1 -- 172.21.15.6:0/775978952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 msgr2=0x561ebde8b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef6bfff700 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef6bfff700 1 -- 172.21.15.6:0/775978952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ebdbefde0 con 0x561ebde7af10 2023-09-13T09:40:43.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef713ef700 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef6bfff700 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde8ac70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e6a0 tx=0x7fef5c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d51d295f89c130 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef537fe700 1 -- 172.21.15.6:0/775978952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c005040 con 0x561ebde7af10 2023-09-13T09:40:43.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef537fe700 1 -- 172.21.15.6:0/775978952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef5c005660 con 0x561ebde7af10 2023-09-13T09:40:43.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.933+0000 7fef537fe700 1 -- 172.21.15.6:0/775978952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef5c004ea0 con 0x561ebde7af10 2023-09-13T09:40:43.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 -- 172.21.15.6:0/775978952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 msgr2=0x561ebde8ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde8ac70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fef5c00e6a0 tx=0x7fef5c009ed0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 -- 172.21.15.6:0/775978952 shutdown_connections 2023-09-13T09:40:43.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7a210 0x561ebde79cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 --2- 172.21.15.6:0/775978952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7af10 0x561ebde8ac70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 -- 172.21.15.6:0/775978952 >> 172.21.15.6:0/775978952 conn(0x561ebddcfc80 msgr2=0x561ebde823c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 -- 172.21.15.6:0/775978952 shutdown_connections 2023-09-13T09:40:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 -- 172.21.15.6:0/775978952 wait complete. 2023-09-13T09:40:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 -- start start 2023-09-13T09:40:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.934+0000 7fef7f037b80 1 Processor -- start 2023-09-13T09:40:43.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7a210 0x561ebde86bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7af10 0x561ebde87100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef7f037b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef7f037b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebde8a660 con 0x561ebde7a210 2023-09-13T09:40:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef7f037b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebde8a7d0 con 0x561ebde7b870 2023-09-13T09:40:43.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef7f037b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ebde8a990 con 0x561ebde7af10 2023-09-13T09:40:43.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7a210 0x561ebde86bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef7f037b80 10 client.0 _ll_register_callbacks cb 0x561ebdd5f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:43.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7a210 0x561ebde86bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34582/0 (socket says 172.21.15.6:34582) 2023-09-13T09:40:43.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 -- 172.21.15.6:0/1918282549 learned_addr learned my addr 172.21.15.6:0/1918282549 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:43.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef6bfff700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7af10 0x561ebde87100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef713ef700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 -- 172.21.15.6:0/1918282549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7af10 msgr2=0x561ebde87100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7af10 0x561ebde87100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 -- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 msgr2=0x561ebde8a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:43.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef70bee700 1 -- 172.21.15.6:0/1918282549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ebdddb7a0 con 0x561ebde7a210 2023-09-13T09:40:43.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef6bfff700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7af10 0x561ebde87100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.935+0000 7fef713ef700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:43.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef70bee700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7a210 0x561ebde86bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fef60004820 tx=0x7fef6000efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78aa678e94419eb5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:43.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef4bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef4bfff700 1 -- 172.21.15.6:0/1918282549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef600a1590 con 0x561ebde7a210 2023-09-13T09:40:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef4bfff700 1 -- 172.21.15.6:0/1918282549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef600ace40 con 0x561ebde7a210 2023-09-13T09:40:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef5c021070 con 0x561ebde7a210 2023-09-13T09:40:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef4bfff700 1 -- 172.21.15.6:0/1918282549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef60065240 con 0x561ebde7a210 2023-09-13T09:40:43.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 10 client.15711 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fef5c02a040 con 0x561ebde7a210 2023-09-13T09:40:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef4bfff700 1 -- 172.21.15.6:0/1918282549 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef6007c080 con 0x561ebde7a210 2023-09-13T09:40:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef4bfff700 1 -- 172.21.15.6:0/1918282549 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fef60099780 con 0x561ebde7a210 2023-09-13T09:40:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:43.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 10 client.15711 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:40:43.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 20 client.15711 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:43.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebdee6390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:43.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 4 client.15711 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:43.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.936+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561ebdd7d050 con 0x561ebde8f450 2023-09-13T09:40:43.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.937+0000 7fef6bfff700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebdee6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:43.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.937+0000 7fef6bfff700 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebdee6390 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1fe361ba92bd536b server_cookie=fd27b1067d135530 in_seq=0 out_seq=0 2023-09-13T09:40:43.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.937+0000 7fef4bfff700 10 client.15711 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:43.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef4bfff700 1 -- 172.21.15.6:0/1918282549 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561ebdd7d050 con 0x561ebde8f450 2023-09-13T09:40:43.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef4bfff700 10 client.15711 handle_command_reply: tid=0 2023-09-13T09:40:43.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 client.15711 shutdown 2023-09-13T09:40:43.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7a210 msgr2=0x561ebde86bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7a210 0x561ebde86bc0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fef60004820 tx=0x7fef6000efd0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 shutdown_connections 2023-09-13T09:40:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561ebde8f450 0x561ebdee6390 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561ebde7b870 0x561ebde8a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef4bfff700 0 client.15711 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:40:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561ebde7a210 0x561ebde86bc0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.939+0000 7fef7f037b80 1 --2- 172.21.15.6:0/1918282549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561ebde7af10 0x561ebde87100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 >> 172.21.15.6:0/1918282549 conn(0x561ebddcfc80 msgr2=0x561ebde7e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 shutdown_connections 2023-09-13T09:40:43.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef7f037b80 1 -- 172.21.15.6:0/1918282549 wait complete. 2023-09-13T09:40:43.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef7f037b80 20 client.15711 trim_cache size 0 max 16384 2023-09-13T09:40:43.959 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:43.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef540a0640 msgr2=0x7fef540a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef540a0640 0x7fef540a2b00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fef5c011550 tx=0x7fef5c009260 comp rx=0 tx=0).stop 2023-09-13T09:40:43.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c0ffcc0 msgr2=0x7fef6c071360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:43.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c0ffcc0 0x7fef6c071360 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fef60005fd0 tx=0x7fef6000eca0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 shutdown_connections 2023-09-13T09:40:43.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef6c101850 0x7fef6c071de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef6c0ffcc0 0x7fef6c071360 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef540a0640 0x7fef540a2b00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 --2- 172.21.15.6:0/248916237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef6c100eb0 0x7fef6c0718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:43.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 >> 172.21.15.6:0/248916237 conn(0x7fef6c0fb250 msgr2=0x7fef6c104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:43.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.940+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 shutdown_connections 2023-09-13T09:40:43.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:43.941+0000 7fef72e52700 1 -- 172.21.15.6:0/248916237 wait complete. 2023-09-13T09:40:43.963 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:40:44.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:43 smithi006 ceph-mon[98665]: pgmap v336: 97 pgs: 97 active+clean; 2.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 133 KiB/s wr, 35 op/s 2023-09-13T09:40:44.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:43 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2005823487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:40:44.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 -- 172.21.15.6:0/795146051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014101850 msgr2=0x7f4014108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 --2- 172.21.15.6:0/795146051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014101850 0x7f4014108100 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b0d0 tx=0x7f400c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 -- 172.21.15.6:0/795146051 shutdown_connections 2023-09-13T09:40:44.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 --2- 172.21.15.6:0/795146051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014101850 0x7f4014108100 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 --2- 172.21.15.6:0/795146051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40140ffcc0 0x7f40141000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 --2- 172.21.15.6:0/795146051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4014100eb0 0x7f4014101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 -- 172.21.15.6:0/795146051 >> 172.21.15.6:0/795146051 conn(0x7f40140fb250 msgr2=0x7f40140fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 -- 172.21.15.6:0/795146051 shutdown_connections 2023-09-13T09:40:44.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.093+0000 7f401ba41700 1 -- 172.21.15.6:0/795146051 wait complete. 2023-09-13T09:40:44.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 Processor -- start 2023-09-13T09:40:44.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 -- start start 2023-09-13T09:40:44.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40140ffcc0 0x7f401410c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014100eb0 0x7f401410a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4014101850 0x7f401410ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401410b5e0 con 0x7f4014100eb0 2023-09-13T09:40:44.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f401410b750 con 0x7f40140ffcc0 2023-09-13T09:40:44.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f401ba41700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40141a0bc0 con 0x7f4014101850 2023-09-13T09:40:44.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f4018fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014100eb0 0x7f401410a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f4018fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014100eb0 0x7f401410a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34598/0 (socket says 172.21.15.6:34598) 2023-09-13T09:40:44.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f4018fdc700 1 -- 172.21.15.6:0/2016395363 learned_addr learned my addr 172.21.15.6:0/2016395363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.094+0000 7f40197dd700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40140ffcc0 0x7f401410c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f4019fde700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4014101850 0x7f401410ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f4018fdc700 1 -- 172.21.15.6:0/2016395363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4014101850 msgr2=0x7f401410ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f4018fdc700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4014101850 0x7f401410ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f4018fdc700 1 -- 172.21.15.6:0/2016395363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40140ffcc0 msgr2=0x7f401410c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f4018fdc700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40140ffcc0 0x7f401410c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f4018fdc700 1 -- 172.21.15.6:0/2016395363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c009d00 con 0x7f4014100eb0 2023-09-13T09:40:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f40197dd700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40140ffcc0 0x7f401410c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f4018fdc700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014100eb0 0x7f401410a900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f400400d950 tx=0x7f400400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f400a7fc700 1 -- 172.21.15.6:0/2016395363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004009940 con 0x7f4014100eb0 2023-09-13T09:40:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40141a0ea0 con 0x7f4014100eb0 2023-09-13T09:40:44.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f400a7fc700 1 -- 172.21.15.6:0/2016395363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4004010460 con 0x7f4014100eb0 2023-09-13T09:40:44.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f400a7fc700 1 -- 172.21.15.6:0/2016395363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400f620 con 0x7f4014100eb0 2023-09-13T09:40:44.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.095+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40141a1370 con 0x7f4014100eb0 2023-09-13T09:40:44.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.097+0000 7f400a7fc700 1 -- 172.21.15.6:0/2016395363 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4004009aa0 con 0x7f4014100eb0 2023-09-13T09:40:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.098+0000 7f400a7fc700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40000a0640 0x7f40000a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.098+0000 7f40197dd700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40000a0640 0x7f40000a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.098+0000 7f400a7fc700 1 -- 172.21.15.6:0/2016395363 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f40040cb970 con 0x7f4014100eb0 2023-09-13T09:40:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f40197dd700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40000a0640 0x7f40000a2b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4014100d10 tx=0x7f4010009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 Processor -- start 2023-09-13T09:40:44.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 -- start start 2023-09-13T09:40:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612279a1060 0x56122799f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56122799fa00 0x56122799fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612278f8780 con 0x5612279a0700 2023-09-13T09:40:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612278f60a0 con 0x56122799fa00 2023-09-13T09:40:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4027c26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612278f1990 con 0x5612279a1060 2023-09-13T09:40:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f40197dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f40197dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34604/0 (socket says 172.21.15.6:34604) 2023-09-13T09:40:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f40197dd700 1 -- 172.21.15.6:0/3732227575 learned_addr learned my addr 172.21.15.6:0/3732227575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4019fde700 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56122799fa00 0x56122799fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f4018fdc700 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612279a1060 0x56122799f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f40197dd700 1 -- 172.21.15.6:0/3732227575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612279a1060 msgr2=0x56122799f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f40197dd700 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612279a1060 0x56122799f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.099+0000 7f40197dd700 1 -- 172.21.15.6:0/3732227575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56122799fa00 msgr2=0x56122799fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.100+0000 7f40197dd700 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56122799fa00 0x56122799fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.100+0000 7f40197dd700 1 -- 172.21.15.6:0/3732227575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561227771630 con 0x5612279a0700 2023-09-13T09:40:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.100+0000 7f4019fde700 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56122799fa00 0x56122799fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.100+0000 7f40197dd700 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a0b20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f40100043d0 tx=0x7f4010014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ab3e826e7fa1c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.100+0000 7f3fff7fe700 1 -- 172.21.15.6:0/3732227575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010003ce0 con 0x5612279a0700 2023-09-13T09:40:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.100+0000 7f3fff7fe700 1 -- 172.21.15.6:0/3732227575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4010003e40 con 0x5612279a0700 2023-09-13T09:40:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.100+0000 7f3fff7fe700 1 -- 172.21.15.6:0/3732227575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4010026900 con 0x5612279a0700 2023-09-13T09:40:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 -- 172.21.15.6:0/3732227575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 msgr2=0x5612279a0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a0b20 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f40100043d0 tx=0x7f4010014000 comp rx=0 tx=0).stop 2023-09-13T09:40:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 -- 172.21.15.6:0/3732227575 shutdown_connections 2023-09-13T09:40:44.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56122799fa00 0x56122799fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a0b20 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 --2- 172.21.15.6:0/3732227575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612279a1060 0x56122799f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 -- 172.21.15.6:0/3732227575 >> 172.21.15.6:0/3732227575 conn(0x5612278fdc80 msgr2=0x561227999f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 -- 172.21.15.6:0/3732227575 shutdown_connections 2023-09-13T09:40:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 -- 172.21.15.6:0/3732227575 wait complete. 2023-09-13T09:40:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 -- start start 2023-09-13T09:40:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.101+0000 7f4027c26b80 1 Processor -- start 2023-09-13T09:40:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a1060 0x5612279b0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122788fbb0 con 0x5612279a0700 2023-09-13T09:40:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56122788f8b0 con 0x5612279a1060 2023-09-13T09:40:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561227773920 con 0x56122799fa00 2023-09-13T09:40:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 10 client.0 _ll_register_callbacks cb 0x56122788d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34612/0 (socket says 172.21.15.6:34612) 2023-09-13T09:40:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 -- 172.21.15.6:0/624147333 learned_addr learned my addr 172.21.15.6:0/624147333 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4019fde700 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a1060 0x5612279b0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f40197dd700 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 -- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 msgr2=0x5612279a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 -- 172.21.15.6:0/624147333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a1060 msgr2=0x5612279b0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a1060 0x5612279b0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 -- 172.21.15.6:0/624147333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4010017070 con 0x5612279a0700 2023-09-13T09:40:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4018fdc700 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a94f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4004098e10 tx=0x7f400409cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170d9a7f9ffe40a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f3ffcff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f3ffcff9700 1 -- 172.21.15.6:0/624147333 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004099570 con 0x5612279a0700 2023-09-13T09:40:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f3ffcff9700 1 -- 172.21.15.6:0/624147333 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4004097570 con 0x5612279a0700 2023-09-13T09:40:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561227992670 con 0x5612279a0700 2023-09-13T09:40:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f3ffcff9700 1 -- 172.21.15.6:0/624147333 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4004098600 con 0x5612279a0700 2023-09-13T09:40:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.102+0000 7f4027c26b80 10 client.15723 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5612279097a0 con 0x5612279a0700 2023-09-13T09:40:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f3ffcff9700 1 -- 172.21.15.6:0/624147333 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561227992670 con 0x5612279a0700 2023-09-13T09:40:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f3ffcff9700 1 -- 172.21.15.6:0/624147333 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f40040b1200 con 0x5612279a0700 2023-09-13T09:40:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f4027c26b80 10 client.15723 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f4027c26b80 10 client.15723 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:40:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f4027c26b80 20 client.15723 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f4027c26b80 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x5612279b7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f4027c26b80 4 client.15723 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:44.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612278ea970 con 0x5612279b4d40 2023-09-13T09:40:44.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.103+0000 7f40197dd700 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x5612279b7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.104+0000 7f40197dd700 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x5612279b7160 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11566c66bc745e36 server_cookie=ff24fe422ed15e93 in_seq=0 out_seq=0 2023-09-13T09:40:44.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.104+0000 7f3ffcff9700 10 client.15723 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:44.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.104+0000 7f3ffcff9700 1 -- 172.21.15.6:0/624147333 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5612278ea970 con 0x5612279b4d40 2023-09-13T09:40:44.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.104+0000 7f3ffcff9700 10 client.15723 handle_command_reply: tid=0 2023-09-13T09:40:44.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.104+0000 7f4027c26b80 1 client.15723 shutdown 2023-09-13T09:40:44.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 msgr2=0x5612279a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a94f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f4004098e10 tx=0x7f400409cf40 comp rx=0 tx=0).stop 2023-09-13T09:40:44.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 shutdown_connections 2023-09-13T09:40:44.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x5612279b7160 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a1060 0x5612279b0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f3ffcff9700 0 client.15723 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:44.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 --2- 172.21.15.6:0/624147333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a0700 0x5612279a94f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 >> 172.21.15.6:0/624147333 conn(0x5612278fdc80 msgr2=0x5612279947f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 shutdown_connections 2023-09-13T09:40:44.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 1 -- 172.21.15.6:0/624147333 wait complete. 2023-09-13T09:40:44.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.105+0000 7f4027c26b80 20 client.15723 trim_cache size 0 max 16384 2023-09-13T09:40:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 Processor -- start 2023-09-13T09:40:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 -- start start 2023-09-13T09:40:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x56122799f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279a8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612279968e0 con 0x5612279a1060 2023-09-13T09:40:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612279a76a0 con 0x5612279a0700 2023-09-13T09:40:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4027c26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612279a6bc0 con 0x56122799fa00 2023-09-13T09:40:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.118+0000 7f4019fde700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279a8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f40197dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x56122799f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279a8f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34622/0 (socket says 172.21.15.6:34622) 2023-09-13T09:40:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4018fdc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 -- 172.21.15.6:0/590662740 learned_addr learned my addr 172.21.15.6:0/590662740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 -- 172.21.15.6:0/590662740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 msgr2=0x56122799f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 --2- 172.21.15.6:0/590662740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x56122799f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 -- 172.21.15.6:0/590662740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 msgr2=0x5612279b0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 --2- 172.21.15.6:0/590662740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 -- 172.21.15.6:0/590662740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56122771dde0 con 0x5612279a1060 2023-09-13T09:40:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f4019fde700 1 --2- 172.21.15.6:0/590662740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279a8f70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b0d0 tx=0x7f400c0074e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e65f10bbbd0e8723 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f3ffffff700 1 -- 172.21.15.6:0/590662740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00e040 con 0x5612279a1060 2023-09-13T09:40:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f3ffffff700 1 -- 172.21.15.6:0/590662740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f400c007850 con 0x5612279a1060 2023-09-13T09:40:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.119+0000 7f3ffffff700 1 -- 172.21.15.6:0/590662740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c005620 con 0x5612279a1060 2023-09-13T09:40:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 -- 172.21.15.6:0/590662740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 msgr2=0x5612279a8f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 --2- 172.21.15.6:0/590662740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279a8f70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f400c00b0d0 tx=0x7f400c0074e0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 -- 172.21.15.6:0/590662740 shutdown_connections 2023-09-13T09:40:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 --2- 172.21.15.6:0/590662740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279a8f70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 --2- 172.21.15.6:0/590662740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x56122799f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 --2- 172.21.15.6:0/590662740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 -- 172.21.15.6:0/590662740 >> 172.21.15.6:0/590662740 conn(0x5612278fdc80 msgr2=0x5612279a3920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 -- 172.21.15.6:0/590662740 shutdown_connections 2023-09-13T09:40:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 -- 172.21.15.6:0/590662740 wait complete. 2023-09-13T09:40:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 -- start start 2023-09-13T09:40:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.120+0000 7f4027c26b80 1 Processor -- start 2023-09-13T09:40:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4027c26b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4027c26b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612279ad130 con 0x5612279a1060 2023-09-13T09:40:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4027c26b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612279ad2a0 con 0x5612279a0700 2023-09-13T09:40:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4027c26b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612279ad460 con 0x56122799fa00 2023-09-13T09:40:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4027c26b80 10 client.0 _ll_register_callbacks cb 0x56122788d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34628/0 (socket says 172.21.15.6:34628) 2023-09-13T09:40:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 -- 172.21.15.6:0/308017781 learned_addr learned my addr 172.21.15.6:0/308017781 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4018fdc700 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f40197dd700 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 -- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 msgr2=0x5612279afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 -- 172.21.15.6:0/308017781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 msgr2=0x5612279b03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 -- 172.21.15.6:0/308017781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400c0093a0 con 0x5612279a1060 2023-09-13T09:40:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f4019fde700 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279ac9d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f400c007a30 tx=0x7f400c004e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18092a3fa370242 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f3ffcff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.121+0000 7f3ffcff9700 1 -- 172.21.15.6:0/308017781 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c00e040 con 0x5612279a1060 2023-09-13T09:40:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4010003e40 con 0x5612279a1060 2023-09-13T09:40:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f3ffcff9700 1 -- 172.21.15.6:0/308017781 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f400c005530 con 0x5612279a1060 2023-09-13T09:40:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f3ffcff9700 1 -- 172.21.15.6:0/308017781 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f400c0056f0 con 0x5612279a1060 2023-09-13T09:40:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 10 client.15729 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561227706c60 con 0x5612279a1060 2023-09-13T09:40:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f3ffcff9700 1 -- 172.21.15.6:0/308017781 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4010003e40 con 0x5612279a1060 2023-09-13T09:40:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f3ffcff9700 1 -- 172.21.15.6:0/308017781 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f400c00b100 con 0x5612279a1060 2023-09-13T09:40:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 10 client.15729 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 10 client.15729 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:40:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 20 client.15729 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x561227a0bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 4 client.15729 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5612278ab050 con 0x5612279b4d40 2023-09-13T09:40:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.122+0000 7f40197dd700 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x561227a0bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f3ffcff9700 10 client.15729 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f40197dd700 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x561227a0bf90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c2b8f6736f976e77 server_cookie=2775c92c2dfe567e in_seq=0 out_seq=0 2023-09-13T09:40:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f3ffcff9700 1 -- 172.21.15.6:0/308017781 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5612278ab050 con 0x5612279b4d40 2023-09-13T09:40:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f3ffcff9700 10 client.15729 handle_command_reply: tid=0 2023-09-13T09:40:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 client.15729 shutdown 2023-09-13T09:40:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 msgr2=0x5612279ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279ac9d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f400c007a30 tx=0x7f400c004e10 comp rx=0 tx=0).stop 2023-09-13T09:40:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 shutdown_connections 2023-09-13T09:40:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5612279b4d40 0x561227a0bf90 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612279a1060 0x5612279ac9d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56122799fa00 0x5612279afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 --2- 172.21.15.6:0/308017781 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612279a0700 0x5612279b03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f3ffcff9700 0 client.15729 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:40:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 >> 172.21.15.6:0/308017781 conn(0x5612278fdc80 msgr2=0x5612279a8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 shutdown_connections 2023-09-13T09:40:44.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 1 -- 172.21.15.6:0/308017781 wait complete. 2023-09-13T09:40:44.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.123+0000 7f4027c26b80 20 client.15729 trim_cache size 0 max 16384 2023-09-13T09:40:44.147 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:44.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40000a0640 msgr2=0x7f40000a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40000a0640 0x7f40000a2b00 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4014100d10 tx=0x7f4010009260 comp rx=0 tx=0).stop 2023-09-13T09:40:44.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014100eb0 msgr2=0x7f401410a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014100eb0 0x7f401410a900 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f400400d950 tx=0x7f400400dc60 comp rx=0 tx=0).stop 2023-09-13T09:40:44.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 shutdown_connections 2023-09-13T09:40:44.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4014101850 0x7f401410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f40140ffcc0 0x7f401410c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40000a0640 0x7f40000a2b00 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 --2- 172.21.15.6:0/2016395363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4014100eb0 0x7f401410a900 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 >> 172.21.15.6:0/2016395363 conn(0x7f40140fb250 msgr2=0x7f40140fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 shutdown_connections 2023-09-13T09:40:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.124+0000 7f401ba41700 1 -- 172.21.15.6:0/2016395363 wait complete. 2023-09-13T09:40:44.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:40:44.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 9544 16.59 MB/sec warmup 4 sec latency 17.383 ms 2023-09-13T09:40:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:43 smithi053 ceph-mon[102373]: pgmap v336: 97 pgs: 97 active+clean; 2.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 133 KiB/s wr, 35 op/s 2023-09-13T09:40:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:43 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2005823487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:40:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:43 smithi131 ceph-mon[102785]: pgmap v336: 97 pgs: 97 active+clean; 2.0 MiB data, 331 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 133 KiB/s wr, 35 op/s 2023-09-13T09:40:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:43 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2005823487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:40:44.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 -- 172.21.15.6:0/159824179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 msgr2=0x7f9980108f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 --2- 172.21.15.6:0/159824179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f9980108f30 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9978009f90 tx=0x7f997800b330 comp rx=0 tx=0).stop 2023-09-13T09:40:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 -- 172.21.15.6:0/159824179 shutdown_connections 2023-09-13T09:40:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 --2- 172.21.15.6:0/159824179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f9980108f30 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 --2- 172.21.15.6:0/159824179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99801018e0 0x7f9980103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 --2- 172.21.15.6:0/159824179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9980104210 0x7f9980106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 -- 172.21.15.6:0/159824179 >> 172.21.15.6:0/159824179 conn(0x7f99800fb250 msgr2=0x7f99800fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 -- 172.21.15.6:0/159824179 shutdown_connections 2023-09-13T09:40:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.317+0000 7f9987a84700 1 -- 172.21.15.6:0/159824179 wait complete. 2023-09-13T09:40:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 Processor -- start 2023-09-13T09:40:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 -- start start 2023-09-13T09:40:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99801018e0 0x7f9980196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980104210 0x7f99801970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f998019e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998019e700 con 0x7f9980106b40 2023-09-13T09:40:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998019e840 con 0x7f99801018e0 2023-09-13T09:40:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9987a84700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f998019e9d0 con 0x7f9980104210 2023-09-13T09:40:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9986021700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f998019e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99801018e0 0x7f9980196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99801018e0 0x7f9980196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56392/0 (socket says 172.21.15.6:56392) 2023-09-13T09:40:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9986021700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f998019e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34640/0 (socket says 172.21.15.6:34640) 2023-09-13T09:40:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 -- 172.21.15.6:0/1528575527 learned_addr learned my addr 172.21.15.6:0/1528575527 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f998501f700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980104210 0x7f99801970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 -- 172.21.15.6:0/1528575527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980104210 msgr2=0x7f99801970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980104210 0x7f99801970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 -- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 msgr2=0x7f998019e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f998019e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9985820700 1 -- 172.21.15.6:0/1528575527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9978009c40 con 0x7f99801018e0 2023-09-13T09:40:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.318+0000 7f9986021700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f998019e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.319+0000 7f9985820700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99801018e0 0x7f9980196b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f997000d980 tx=0x7f997000dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.319+0000 7f9976ffd700 1 -- 172.21.15.6:0/1528575527 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970004a30 con 0x7f99801018e0 2023-09-13T09:40:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.319+0000 7f9976ffd700 1 -- 172.21.15.6:0/1528575527 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f997000b640 con 0x7f99801018e0 2023-09-13T09:40:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.319+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f998019ecb0 con 0x7f99801018e0 2023-09-13T09:40:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.319+0000 7f9976ffd700 1 -- 172.21.15.6:0/1528575527 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9970009b50 con 0x7f99801018e0 2023-09-13T09:40:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.319+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f998019f170 con 0x7f99801018e0 2023-09-13T09:40:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.321+0000 7f9976ffd700 1 -- 172.21.15.6:0/1528575527 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9970009cb0 con 0x7f99801018e0 2023-09-13T09:40:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.322+0000 7f9976ffd700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f996c0a0640 0x7f996c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.322+0000 7f998501f700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f996c0a0640 0x7f996c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.322+0000 7f9976ffd700 1 -- 172.21.15.6:0/1528575527 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f99700cba60 con 0x7f99801018e0 2023-09-13T09:40:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.322+0000 7f998501f700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f996c0a0640 0x7f996c0a2b00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f997c005fd0 tx=0x7f997c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.322+0000 7f9993c69b80 1 Processor -- start 2023-09-13T09:40:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9993c69b80 1 -- start start 2023-09-13T09:40:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64ed9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64eda470 0x564c64ed88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ed9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9993c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64e2d780 con 0x564c64eda470 2023-09-13T09:40:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9993c69b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64e2b0a0 con 0x564c64ed9b10 2023-09-13T09:40:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9993c69b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64e26990 con 0x564c64ed8e10 2023-09-13T09:40:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64eda470 0x564c64ed88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64eda470 0x564c64ed88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34646/0 (socket says 172.21.15.6:34646) 2023-09-13T09:40:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 -- 172.21.15.6:0/1658849465 learned_addr learned my addr 172.21.15.6:0/1658849465 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9985820700 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64ed9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f9986021700 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ed9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 -- 172.21.15.6:0/1658849465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 msgr2=0x564c64ed9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ed9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 -- 172.21.15.6:0/1658849465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 msgr2=0x564c64ed9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64ed9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 -- 172.21.15.6:0/1658849465 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c64ca6630 con 0x564c64eda470 2023-09-13T09:40:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.323+0000 7f998501f700 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64eda470 0x564c64ed88d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f997c0041d0 tx=0x7f997c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbb4d10c4941a770 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f996bfff700 1 -- 172.21.15.6:0/1658849465 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c009e60 con 0x564c64eda470 2023-09-13T09:40:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f996bfff700 1 -- 172.21.15.6:0/1658849465 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f997c004830 con 0x564c64eda470 2023-09-13T09:40:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f996bfff700 1 -- 172.21.15.6:0/1658849465 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c005580 con 0x564c64eda470 2023-09-13T09:40:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f9993c69b80 1 -- 172.21.15.6:0/1658849465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64eda470 msgr2=0x564c64ed88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f9993c69b80 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64eda470 0x564c64ed88d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f997c0041d0 tx=0x7f997c014000 comp rx=0 tx=0).stop 2023-09-13T09:40:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f9993c69b80 1 -- 172.21.15.6:0/1658849465 shutdown_connections 2023-09-13T09:40:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f9993c69b80 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ed9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f9993c69b80 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64ed9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f9993c69b80 1 --2- 172.21.15.6:0/1658849465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64eda470 0x564c64ed88d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.324+0000 7f9993c69b80 1 -- 172.21.15.6:0/1658849465 >> 172.21.15.6:0/1658849465 conn(0x564c64e32c80 msgr2=0x564c64ecef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 -- 172.21.15.6:0/1658849465 shutdown_connections 2023-09-13T09:40:44.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 -- 172.21.15.6:0/1658849465 wait complete. 2023-09-13T09:40:44.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 -- start start 2023-09-13T09:40:44.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 Processor -- start 2023-09-13T09:40:44.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ee22e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64eda470 0x564c64ee9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64dc4bb0 con 0x564c64ed9b10 2023-09-13T09:40:44.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64dc48b0 con 0x564c64eda470 2023-09-13T09:40:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64ca8920 con 0x564c64ed8e10 2023-09-13T09:40:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f9993c69b80 10 client.0 _ll_register_callbacks cb 0x564c64dc2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.325+0000 7f998501f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34652/0 (socket says 172.21.15.6:34652) 2023-09-13T09:40:44.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 -- 172.21.15.6:0/327283360 learned_addr learned my addr 172.21.15.6:0/327283360 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f9985820700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ee22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f9986021700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64eda470 0x564c64ee9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 -- 172.21.15.6:0/327283360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 msgr2=0x564c64ee22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ee22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 -- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64eda470 msgr2=0x564c64ee9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64eda470 0x564c64ee9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 -- 172.21.15.6:0/327283360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c017070 con 0x564c64ed9b10 2023-09-13T09:40:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f9986021700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64eda470 0x564c64ee9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f998501f700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee2820 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f997c005560 tx=0x7f997c005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d5b27a201ccbf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f99697fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f99697fa700 1 -- 172.21.15.6:0/327283360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c02c070 con 0x564c64ed9b10 2023-09-13T09:40:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f99697fa700 1 -- 172.21.15.6:0/327283360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f997c009e60 con 0x564c64ed9b10 2023-09-13T09:40:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c64ec7670 con 0x564c64ed9b10 2023-09-13T09:40:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f99697fa700 1 -- 172.21.15.6:0/327283360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f997c0044e0 con 0x564c64ed9b10 2023-09-13T09:40:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f9993c69b80 10 client.15741 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.326+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564c64e3e7a0 con 0x564c64ed9b10 2023-09-13T09:40:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f99697fa700 1 -- 172.21.15.6:0/327283360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564c64ec7670 con 0x564c64ed9b10 2023-09-13T09:40:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f99697fa700 1 -- 172.21.15.6:0/327283360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f997c024030 con 0x564c64ed9b10 2023-09-13T09:40:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9993c69b80 10 client.15741 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9993c69b80 10 client.15741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9993c69b80 20 client.15741 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9993c69b80 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64eee040 0x564c64ef0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9993c69b80 4 client.15741 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c64e1f970 con 0x564c64eee040 2023-09-13T09:40:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9985820700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64eee040 0x564c64ef0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f99697fa700 10 client.15741 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.327+0000 7f9985820700 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64eee040 0x564c64ef0460 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13a03d03ab8ac34b server_cookie=795c7688e5642355 in_seq=0 out_seq=0 2023-09-13T09:40:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f99697fa700 1 -- 172.21.15.6:0/327283360 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564c64e1f970 con 0x564c64eee040 2023-09-13T09:40:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f99697fa700 10 client.15741 handle_command_reply: tid=0 2023-09-13T09:40:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 client.15741 shutdown 2023-09-13T09:40:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 msgr2=0x564c64ee2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee2820 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f997c005560 tx=0x7f997c005590 comp rx=0 tx=0).stop 2023-09-13T09:40:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 shutdown_connections 2023-09-13T09:40:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64eda470 0x564c64ee9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64ed8e10 0x564c64ee22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64eee040 0x564c64ef0460 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 --2- 172.21.15.6:0/327283360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee2820 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f99697fa700 0 client.15741 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 >> 172.21.15.6:0/327283360 conn(0x564c64e32c80 msgr2=0x564c64ec97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 shutdown_connections 2023-09-13T09:40:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.328+0000 7f9993c69b80 1 -- 172.21.15.6:0/327283360 wait complete. 2023-09-13T09:40:44.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.329+0000 7f9993c69b80 20 client.15741 trim_cache size 0 max 16384 2023-09-13T09:40:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 Processor -- start 2023-09-13T09:40:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 -- start start 2023-09-13T09:40:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed8e10 0x564c64ee1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64ecee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64ec7430 con 0x564c64ed9b10 2023-09-13T09:40:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64edff50 con 0x564c64ed8e10 2023-09-13T09:40:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9993c69b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64edd860 con 0x564c64eda470 2023-09-13T09:40:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34660/0 (socket says 172.21.15.6:34660) 2023-09-13T09:40:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 -- 172.21.15.6:0/2894363904 learned_addr learned my addr 172.21.15.6:0/2894363904 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9985820700 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed8e10 0x564c64ee1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9986021700 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64ecee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 -- 172.21.15.6:0/2894363904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 msgr2=0x564c64ecee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64ecee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 -- 172.21.15.6:0/2894363904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed8e10 msgr2=0x564c64ee1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed8e10 0x564c64ee1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 -- 172.21.15.6:0/2894363904 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c64c52de0 con 0x564c64ed9b10 2023-09-13T09:40:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f9986021700 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64ecee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.342+0000 7f998501f700 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee9820 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f997c005530 tx=0x7f997c009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7f2c93ae940756 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9974d82700 1 -- 172.21.15.6:0/2894363904 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c02c020 con 0x564c64ed9b10 2023-09-13T09:40:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9974d82700 1 -- 172.21.15.6:0/2894363904 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f997c009e60 con 0x564c64ed9b10 2023-09-13T09:40:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9974d82700 1 -- 172.21.15.6:0/2894363904 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997c01e680 con 0x564c64ed9b10 2023-09-13T09:40:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 -- 172.21.15.6:0/2894363904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 msgr2=0x564c64ee9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee9820 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f997c005530 tx=0x7f997c009420 comp rx=0 tx=0).stop 2023-09-13T09:40:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 -- 172.21.15.6:0/2894363904 shutdown_connections 2023-09-13T09:40:44.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64ecee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed8e10 0x564c64ee1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 --2- 172.21.15.6:0/2894363904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed9b10 0x564c64ee9820 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 -- 172.21.15.6:0/2894363904 >> 172.21.15.6:0/2894363904 conn(0x564c64e32c80 msgr2=0x564c64ee1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 -- 172.21.15.6:0/2894363904 shutdown_connections 2023-09-13T09:40:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.343+0000 7f9993c69b80 1 -- 172.21.15.6:0/2894363904 wait complete. 2023-09-13T09:40:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 -- start start 2023-09-13T09:40:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 Processor -- start 2023-09-13T09:40:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed8e10 0x564c64ee7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64f3de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64f40350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64f40a60 con 0x564c64ed8e10 2023-09-13T09:40:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64f40bd0 con 0x564c64ed9b10 2023-09-13T09:40:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c64f40d90 con 0x564c64eda470 2023-09-13T09:40:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9993c69b80 10 client.0 _ll_register_callbacks cb 0x564c64dc2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9985820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed8e10 0x564c64ee7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9985820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed8e10 0x564c64ee7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34664/0 (socket says 172.21.15.6:34664) 2023-09-13T09:40:44.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f998501f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64f3de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9985820700 1 -- 172.21.15.6:0/4123030484 learned_addr learned my addr 172.21.15.6:0/4123030484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:44.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.344+0000 7f9986021700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64f40350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9985820700 1 -- 172.21.15.6:0/4123030484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 msgr2=0x564c64f40350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9985820700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64f40350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9985820700 1 -- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 msgr2=0x564c64f3de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9985820700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64f3de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9985820700 1 -- 172.21.15.6:0/4123030484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c64e3e7a0 con 0x564c64ed8e10 2023-09-13T09:40:44.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f998501f700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64f3de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9986021700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64f40350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9985820700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed8e10 0x564c64ee7810 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f99700c94b0 tx=0x7f99700954e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e44a67ae10a77d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f99697fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f99697fa700 1 -- 172.21.15.6:0/4123030484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99700a1210 con 0x564c64ed8e10 2023-09-13T09:40:44.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f997c004830 con 0x564c64ed8e10 2023-09-13T09:40:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f99697fa700 1 -- 172.21.15.6:0/4123030484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9970097540 con 0x564c64ed8e10 2023-09-13T09:40:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f99697fa700 1 -- 172.21.15.6:0/4123030484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9970098690 con 0x564c64ed8e10 2023-09-13T09:40:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 10 client.15747 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x564c64c3bc60 con 0x564c64ed8e10 2023-09-13T09:40:44.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f99697fa700 1 -- 172.21.15.6:0/4123030484 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f997c004830 con 0x564c64ed8e10 2023-09-13T09:40:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f99697fa700 1 -- 172.21.15.6:0/4123030484 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f9970094f90 con 0x564c64ed8e10 2023-09-13T09:40:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 10 client.15747 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 10 client.15747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 20 client.15747 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:44.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64f427a0 0x564c64f44b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 4 client.15747 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:40:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.345+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564c64de0050 con 0x564c64f427a0 2023-09-13T09:40:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f998501f700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64f427a0 0x564c64f44b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f99697fa700 10 client.15747 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:44.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f998501f700 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64f427a0 0x564c64f44b90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3fc1d5c19e6ad4c7 server_cookie=68723539224140db in_seq=0 out_seq=0 2023-09-13T09:40:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f99697fa700 1 -- 172.21.15.6:0/4123030484 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564c64de0050 con 0x564c64f427a0 2023-09-13T09:40:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f99697fa700 10 client.15747 handle_command_reply: tid=0 2023-09-13T09:40:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 client.15747 shutdown 2023-09-13T09:40:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed8e10 msgr2=0x564c64ee7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed8e10 0x564c64ee7810 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f99700c94b0 tx=0x7f99700954e0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 shutdown_connections 2023-09-13T09:40:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c64eda470 0x564c64f40350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564c64f427a0 0x564c64f44b90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c64ed8e10 0x564c64ee7810 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 --2- 172.21.15.6:0/4123030484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c64ed9b10 0x564c64f3de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f99697fa700 0 client.15747 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.346+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 >> 172.21.15.6:0/4123030484 conn(0x564c64e32c80 msgr2=0x564c64ecee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 shutdown_connections 2023-09-13T09:40:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9993c69b80 1 -- 172.21.15.6:0/4123030484 wait complete. 2023-09-13T09:40:44.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9993c69b80 20 client.15747 trim_cache size 0 max 16384 2023-09-13T09:40:44.374 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:40:44.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f996c0a0640 msgr2=0x7f996c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f996c0a0640 0x7f996c0a2b00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f997c005fd0 tx=0x7f997c009310 comp rx=0 tx=0).stop 2023-09-13T09:40:44.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99801018e0 msgr2=0x7f9980196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:44.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99801018e0 0x7f9980196b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f997000d980 tx=0x7f997000dc90 comp rx=0 tx=0).stop 2023-09-13T09:40:44.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 shutdown_connections 2023-09-13T09:40:44.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f996c0a0640 0x7f996c0a2b00 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9980106b40 0x7f998019e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99801018e0 0x7f9980196b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 --2- 172.21.15.6:0/1528575527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9980104210 0x7f99801970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 >> 172.21.15.6:0/1528575527 conn(0x7f99800fb250 msgr2=0x7f9980102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 shutdown_connections 2023-09-13T09:40:44.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:44.347+0000 7f9987a84700 1 -- 172.21.15.6:0/1528575527 wait complete. 2023-09-13T09:40:45.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 11449 15.76 MB/sec warmup 5 sec latency 11.096 ms 2023-09-13T09:40:45.378 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:40:45.379 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:40:45.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 -- 172.21.15.6:0/801504216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4102930 msgr2=0x7f39e41091e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 --2- 172.21.15.6:0/801504216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4102930 0x7f39e41091e0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00b0d0 tx=0x7f39dc00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 -- 172.21.15.6:0/801504216 shutdown_connections 2023-09-13T09:40:45.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 --2- 172.21.15.6:0/801504216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4102930 0x7f39e41091e0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 --2- 172.21.15.6:0/801504216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e4100da0 0x7f39e41011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 --2- 172.21.15.6:0/801504216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39e4101f90 0x7f39e41023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 -- 172.21.15.6:0/801504216 >> 172.21.15.6:0/801504216 conn(0x7f39e40fc310 msgr2=0x7f39e40fe750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 -- 172.21.15.6:0/801504216 shutdown_connections 2023-09-13T09:40:45.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.526+0000 7f39e959d700 1 -- 172.21.15.6:0/801504216 wait complete. 2023-09-13T09:40:45.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 Processor -- start 2023-09-13T09:40:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 -- start start 2023-09-13T09:40:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e4100da0 0x7f39e4196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4101f90 0x7f39e4197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39e4102930 0x7f39e419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e419e6a0 con 0x7f39e4101f90 2023-09-13T09:40:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e419e7e0 con 0x7f39e4100da0 2023-09-13T09:40:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e959d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e419e970 con 0x7f39e4102930 2023-09-13T09:40:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4101f90 0x7f39e4197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e4100da0 0x7f39e4196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4101f90 0x7f39e4197060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34682/0 (socket says 172.21.15.6:34682) 2023-09-13T09:40:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e27fc700 1 -- 172.21.15.6:0/3373502706 learned_addr learned my addr 172.21.15.6:0/3373502706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.527+0000 7f39e37fe700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39e4102930 0x7f39e419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e27fc700 1 -- 172.21.15.6:0/3373502706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39e4102930 msgr2=0x7f39e419e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e27fc700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39e4102930 0x7f39e419e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e27fc700 1 -- 172.21.15.6:0/3373502706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e4100da0 msgr2=0x7f39e4196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e27fc700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e4100da0 0x7f39e4196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e27fc700 1 -- 172.21.15.6:0/3373502706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39dc009d00 con 0x7f39e4101f90 2023-09-13T09:40:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e4100da0 0x7f39e4196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e27fc700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4101f90 0x7f39e4197060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c9b0 tx=0x7f39d800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39cbfff700 1 -- 172.21.15.6:0/3373502706 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8007b00 con 0x7f39e4101f90 2023-09-13T09:40:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e419ec50 con 0x7f39e4101f90 2023-09-13T09:40:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39cbfff700 1 -- 172.21.15.6:0/3373502706 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39d800ce50 con 0x7f39e4101f90 2023-09-13T09:40:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39cbfff700 1 -- 172.21.15.6:0/3373502706 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8018660 con 0x7f39e4101f90 2023-09-13T09:40:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.528+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e419f1b0 con 0x7f39e4101f90 2023-09-13T09:40:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.530+0000 7f39cbfff700 1 -- 172.21.15.6:0/3373502706 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f39d800f450 con 0x7f39e4101f90 2023-09-13T09:40:45.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.531+0000 7f39cbfff700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39cc0a0640 0x7f39cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.531+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39cc0a0640 0x7f39cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.531+0000 7f39cbfff700 1 -- 172.21.15.6:0/3373502706 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39d80cbaf0 con 0x7f39e4101f90 2023-09-13T09:40:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.531+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39cc0a0640 0x7f39cc0a2b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39e4101df0 tx=0x7f39d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 Processor -- start 2023-09-13T09:40:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 -- start start 2023-09-13T09:40:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89043b90 0x557d89043fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d890444f0 0x557d89042950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d890432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d88f97800 con 0x557d89043b90 2023-09-13T09:40:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d88f95120 con 0x557d89042e90 2023-09-13T09:40:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39f5782b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d88f90a10 con 0x557d890444f0 2023-09-13T09:40:45.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89043b90 0x557d89043fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d890432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89043b90 0x557d89043fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34688/0 (socket says 172.21.15.6:34688) 2023-09-13T09:40:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e2ffd700 1 -- 172.21.15.6:0/3416573983 learned_addr learned my addr 172.21.15.6:0/3416573983 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e27fc700 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d890444f0 0x557d89042950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e37fe700 1 -- 172.21.15.6:0/3416573983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d890444f0 msgr2=0x557d89042950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e37fe700 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d890444f0 0x557d89042950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e37fe700 1 -- 172.21.15.6:0/3416573983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89043b90 msgr2=0x557d89043fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e37fe700 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89043b90 0x557d89043fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e37fe700 1 -- 172.21.15.6:0/3416573983 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d88e106b0 con 0x557d89042e90 2023-09-13T09:40:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.532+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89043b90 0x557d89043fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:45.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.533+0000 7f39e37fe700 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d890432f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39dc007a30 tx=0x7f39dc009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=579a1691ac189ca9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.533+0000 7f39c97fa700 1 -- 172.21.15.6:0/3416573983 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc00e040 con 0x557d89042e90 2023-09-13T09:40:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.533+0000 7f39c97fa700 1 -- 172.21.15.6:0/3416573983 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39dc009460 con 0x557d89042e90 2023-09-13T09:40:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.533+0000 7f39c97fa700 1 -- 172.21.15.6:0/3416573983 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0052d0 con 0x557d89042e90 2023-09-13T09:40:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- 172.21.15.6:0/3416573983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 msgr2=0x557d890432f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d890432f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f39dc007a30 tx=0x7f39dc009c30 comp rx=0 tx=0).stop 2023-09-13T09:40:45.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- 172.21.15.6:0/3416573983 shutdown_connections 2023-09-13T09:40:45.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d890432f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89043b90 0x557d89043fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3416573983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d890444f0 0x557d89042950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- 172.21.15.6:0/3416573983 >> 172.21.15.6:0/3416573983 conn(0x557d88f9cd00 msgr2=0x557d89038f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- 172.21.15.6:0/3416573983 shutdown_connections 2023-09-13T09:40:45.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- 172.21.15.6:0/3416573983 wait complete. 2023-09-13T09:40:45.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- start start 2023-09-13T09:40:45.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 Processor -- start 2023-09-13T09:40:45.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89042e90 0x557d8904c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89043b90 0x557d8904c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89053870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d88f2ec30 con 0x557d890444f0 2023-09-13T09:40:45.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d88f2e930 con 0x557d89043b90 2023-09-13T09:40:45.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d88e129a0 con 0x557d89042e90 2023-09-13T09:40:45.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39f5782b80 10 client.0 _ll_register_callbacks cb 0x557d88f2c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:45.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89053870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39e27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89043b90 0x557d8904c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39e27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89043b90 0x557d8904c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56452/0 (socket says 172.21.15.6:56452) 2023-09-13T09:40:45.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89053870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34698/0 (socket says 172.21.15.6:34698) 2023-09-13T09:40:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39e27fc700 1 -- 172.21.15.6:0/742370176 learned_addr learned my addr 172.21.15.6:0/742370176 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.534+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89042e90 0x557d8904c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39e27fc700 1 -- 172.21.15.6:0/742370176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89042e90 msgr2=0x557d8904c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39e27fc700 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89042e90 0x557d8904c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39e27fc700 1 -- 172.21.15.6:0/742370176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 msgr2=0x557d89053870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39e27fc700 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89053870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39e27fc700 1 -- 172.21.15.6:0/742370176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e4109b30 con 0x557d89043b90 2023-09-13T09:40:45.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39e37fe700 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89053870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:45.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39e27fc700 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89043b90 0x557d8904c830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39d80c9910 tx=0x7f39d8098c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c15150df7de715e4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:40:45.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39c6ff5700 1 -- 172.21.15.6:0/742370176 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8093ea0 con 0x557d89043b90 2023-09-13T09:40:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39c6ff5700 1 -- 172.21.15.6:0/742370176 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39d8099290 con 0x557d89043b90 2023-09-13T09:40:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d890316f0 con 0x557d89043b90 2023-09-13T09:40:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39c6ff5700 1 -- 172.21.15.6:0/742370176 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39d809d0c0 con 0x557d89043b90 2023-09-13T09:40:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39f5782b80 10 client.25340 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:45.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557d88fa8820 con 0x557d89043b90 2023-09-13T09:40:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.535+0000 7f39c6ff5700 1 -- 172.21.15.6:0/742370176 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557d890316f0 con 0x557d89043b90 2023-09-13T09:40:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39c6ff5700 1 -- 172.21.15.6:0/742370176 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f39d8098810 con 0x557d89043b90 2023-09-13T09:40:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39f5782b80 10 client.25340 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39f5782b80 10 client.25340 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:45.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39f5782b80 20 client.25340 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39f5782b80 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d89058080 0x557d8905a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39f5782b80 4 client.25340 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d88f899f0 con 0x557d89058080 2023-09-13T09:40:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d89058080 0x557d8905a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39c6ff5700 10 client.25340 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.536+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d89058080 0x557d8905a4a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aea5940936a025ef server_cookie=24154e73d54e7032 in_seq=0 out_seq=0 2023-09-13T09:40:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39c6ff5700 1 -- 172.21.15.6:0/742370176 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557d88f899f0 con 0x557d89058080 2023-09-13T09:40:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39c6ff5700 10 client.25340 handle_command_reply: tid=0 2023-09-13T09:40:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 client.25340 shutdown 2023-09-13T09:40:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89043b90 msgr2=0x557d8904c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89043b90 0x557d8904c830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f39d80c9910 tx=0x7f39d8098c70 comp rx=0 tx=0).stop 2023-09-13T09:40:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 shutdown_connections 2023-09-13T09:40:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d89058080 0x557d8905a4a0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89053870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89042e90 0x557d8904c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 --2- 172.21.15.6:0/742370176 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89043b90 0x557d8904c830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39c6ff5700 0 client.25340 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 >> 172.21.15.6:0/742370176 conn(0x557d88f9cd00 msgr2=0x557d89038f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 shutdown_connections 2023-09-13T09:40:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 1 -- 172.21.15.6:0/742370176 wait complete. 2023-09-13T09:40:45.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.537+0000 7f39f5782b80 20 client.25340 trim_cache size 0 max 16384 2023-09-13T09:40:45.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 Processor -- start 2023-09-13T09:40:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 -- start start 2023-09-13T09:40:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89042e90 0x557d89032960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89053830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d890444f0 0x557d89032ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8904cf70 con 0x557d89042e90 2023-09-13T09:40:45.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d89049fe0 con 0x557d890444f0 2023-09-13T09:40:45.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39f5782b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d890478d0 con 0x557d89043b90 2023-09-13T09:40:45.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89042e90 0x557d89032960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39e2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89042e90 0x557d89032960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34702/0 (socket says 172.21.15.6:34702) 2023-09-13T09:40:45.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39e2ffd700 1 -- 172.21.15.6:0/957754122 learned_addr learned my addr 172.21.15.6:0/957754122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39e37fe700 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d890444f0 0x557d89032ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.555+0000 7f39e27fc700 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89053830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39e2ffd700 1 -- 172.21.15.6:0/957754122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 msgr2=0x557d89053830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89053830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39e2ffd700 1 -- 172.21.15.6:0/957754122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d890444f0 msgr2=0x557d89032ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d890444f0 0x557d89032ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39e2ffd700 1 -- 172.21.15.6:0/957754122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d88dbce60 con 0x557d89042e90 2023-09-13T09:40:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89042e90 0x557d89032960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f39d4013010 tx=0x7f39d4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deae1b35f643f483 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39c9ffb700 1 -- 172.21.15.6:0/957754122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4024040 con 0x557d89042e90 2023-09-13T09:40:45.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39c9ffb700 1 -- 172.21.15.6:0/957754122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39d4003e30 con 0x557d89042e90 2023-09-13T09:40:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.556+0000 7f39c9ffb700 1 -- 172.21.15.6:0/957754122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d4028730 con 0x557d89042e90 2023-09-13T09:40:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 -- 172.21.15.6:0/957754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89042e90 msgr2=0x557d89032960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89042e90 0x557d89032960 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f39d4013010 tx=0x7f39d4014000 comp rx=0 tx=0).stop 2023-09-13T09:40:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 -- 172.21.15.6:0/957754122 shutdown_connections 2023-09-13T09:40:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d890444f0 0x557d89032ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d89042e90 0x557d89032960 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 --2- 172.21.15.6:0/957754122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89053830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 -- 172.21.15.6:0/957754122 >> 172.21.15.6:0/957754122 conn(0x557d88f9cd00 msgr2=0x557d8904c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 -- 172.21.15.6:0/957754122 shutdown_connections 2023-09-13T09:40:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 -- 172.21.15.6:0/957754122 wait complete. 2023-09-13T09:40:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 -- start start 2023-09-13T09:40:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 Processor -- start 2023-09-13T09:40:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d89050ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89050ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.557+0000 7f39f5782b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89052000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39f5782b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d89052540 con 0x557d890444f0 2023-09-13T09:40:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39f5782b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d890526b0 con 0x557d89042e90 2023-09-13T09:40:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39f5782b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d89052870 con 0x557d89043b90 2023-09-13T09:40:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39f5782b80 10 client.0 _ll_register_callbacks cb 0x557d88f2c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89052000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d89050ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89052000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34712/0 (socket says 172.21.15.6:34712) 2023-09-13T09:40:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 -- 172.21.15.6:0/3491320120 learned_addr learned my addr 172.21.15.6:0/3491320120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e27fc700 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89050ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 -- 172.21.15.6:0/3491320120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 msgr2=0x557d89050ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89050ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 -- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 msgr2=0x557d89050ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d89050ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 -- 172.21.15.6:0/3491320120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d4004210 con 0x557d890444f0 2023-09-13T09:40:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d89050ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39e37fe700 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89052000 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000f80 tx=0x7f39dc00bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfdbdb9997226f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:45.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39c6ff5700 1 -- 172.21.15.6:0/3491320120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc02a040 con 0x557d890444f0 2023-09-13T09:40:45.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39dc009460 con 0x557d890444f0 2023-09-13T09:40:45.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.558+0000 7f39c6ff5700 1 -- 172.21.15.6:0/3491320120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f39dc0052c0 con 0x557d890444f0 2023-09-13T09:40:45.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39c6ff5700 1 -- 172.21.15.6:0/3491320120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39dc00e040 con 0x557d890444f0 2023-09-13T09:40:45.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 10 client.15765 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:45.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x557d88da5ce0 con 0x557d890444f0 2023-09-13T09:40:45.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39c6ff5700 1 -- 172.21.15.6:0/3491320120 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f39dc009460 con 0x557d890444f0 2023-09-13T09:40:45.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39c6ff5700 1 -- 172.21.15.6:0/3491320120 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f39dc037080 con 0x557d890444f0 2023-09-13T09:40:45.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 10 client.15765 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:45.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 10 client.15765 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:45.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 20 client.15765 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:45.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d890ae050 0x557d890b0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 4 client.15765 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:40:45.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557d88f4a0d0 con 0x557d890ae050 2023-09-13T09:40:45.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.559+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d890ae050 0x557d890b0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.560+0000 7f39c6ff5700 10 client.15765 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.560+0000 7f39e2ffd700 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d890ae050 0x557d890b0440 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=835986cec7def577 server_cookie=c75108c194eae95f in_seq=0 out_seq=0 2023-09-13T09:40:45.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39c6ff5700 1 -- 172.21.15.6:0/3491320120 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557d88f4a0d0 con 0x557d890ae050 2023-09-13T09:40:45.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39c6ff5700 10 client.15765 handle_command_reply: tid=0 2023-09-13T09:40:45.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 client.15765 shutdown 2023-09-13T09:40:45.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 msgr2=0x557d89052000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89052000 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f39dc000f80 tx=0x7f39dc00bf70 comp rx=0 tx=0).stop 2023-09-13T09:40:45.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 shutdown_connections 2023-09-13T09:40:45.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557d890ae050 0x557d890b0440 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557d890444f0 0x557d89052000 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557d89042e90 0x557d89050ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 --2- 172.21.15.6:0/3491320120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557d89043b90 0x557d89050ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 >> 172.21.15.6:0/3491320120 conn(0x557d88f9cd00 msgr2=0x557d8903d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39c6ff5700 0 client.15765 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 shutdown_connections 2023-09-13T09:40:45.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 1 -- 172.21.15.6:0/3491320120 wait complete. 2023-09-13T09:40:45.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.561+0000 7f39f5782b80 20 client.15765 trim_cache size 0 max 16384 2023-09-13T09:40:45.581 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:40:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:40:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "163ac0b5-b51b-438a-9b47-b62e3df8fc84", 2023-09-13T09:40:45.582 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:40:45.582 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:40:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39cc0a0640 msgr2=0x7f39cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39cc0a0640 0x7f39cc0a2b00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39e4101df0 tx=0x7f39d4009260 comp rx=0 tx=0).stop 2023-09-13T09:40:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4101f90 msgr2=0x7f39e4197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4101f90 0x7f39e4197060 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f39d800c9b0 tx=0x7f39d800ccc0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 shutdown_connections 2023-09-13T09:40:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39e4102930 0x7f39e419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f39e4100da0 0x7f39e4196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39cc0a0640 0x7f39cc0a2b00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 --2- 172.21.15.6:0/3373502706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39e4101f90 0x7f39e4197060 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 >> 172.21.15.6:0/3373502706 conn(0x7f39e40fc310 msgr2=0x7f39e40fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 shutdown_connections 2023-09-13T09:40:45.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.562+0000 7f39e959d700 1 -- 172.21.15.6:0/3373502706 wait complete. 2023-09-13T09:40:45.586 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:40:45.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.715+0000 7fcb52787700 1 -- 172.21.15.6:0/340483123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 msgr2=0x7fcb4c1017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.715+0000 7fcb52787700 1 --2- 172.21.15.6:0/340483123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c1017e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c009990 tx=0x7fcb3c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 -- 172.21.15.6:0/340483123 shutdown_connections 2023-09-13T09:40:45.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 --2- 172.21.15.6:0/340483123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb4c100290 0x7fcb4c108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 --2- 172.21.15.6:0/340483123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c1017e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 --2- 172.21.15.6:0/340483123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c0ff8f0 0x7fcb4c0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 -- 172.21.15.6:0/340483123 >> 172.21.15.6:0/340483123 conn(0x7fcb4c0fb250 msgr2=0x7fcb4c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 -- 172.21.15.6:0/340483123 shutdown_connections 2023-09-13T09:40:45.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 -- 172.21.15.6:0/340483123 wait complete. 2023-09-13T09:40:45.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 Processor -- start 2023-09-13T09:40:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.716+0000 7fcb52787700 1 -- start start 2023-09-13T09:40:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb52787700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb4c0ff8f0 0x7fcb4c196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb52787700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c100290 0x7fcb4c197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb52787700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c19e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb52787700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c19e740 con 0x7fcb4c1013c0 2023-09-13T09:40:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb52787700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c19e880 con 0x7fcb4c0ff8f0 2023-09-13T09:40:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb52787700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb4c19ea10 con 0x7fcb4c100290 2023-09-13T09:40:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c19e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c19e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34724/0 (socket says 172.21.15.6:34724) 2023-09-13T09:40:45.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb4c0ff8f0 0x7fcb4c196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 -- 172.21.15.6:0/693109367 learned_addr learned my addr 172.21.15.6:0/693109367 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c100290 0x7fcb4c197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 -- 172.21.15.6:0/693109367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c100290 msgr2=0x7fcb4c197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c100290 0x7fcb4c197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 -- 172.21.15.6:0/693109367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb4c0ff8f0 msgr2=0x7fcb4c196bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb4c0ff8f0 0x7fcb4c196bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 -- 172.21.15.6:0/693109367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3c0095f0 con 0x7fcb4c1013c0 2023-09-13T09:40:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c100290 0x7fcb4c197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:40:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb50d24700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c19e170 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcb44007ee0 tx=0x7fcb4400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb497fa700 1 -- 172.21.15.6:0/693109367 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44017070 con 0x7fcb4c1013c0 2023-09-13T09:40:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.717+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb4c19ecf0 con 0x7fcb4c1013c0 2023-09-13T09:40:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.718+0000 7fcb497fa700 1 -- 172.21.15.6:0/693109367 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb4400f040 con 0x7fcb4c1013c0 2023-09-13T09:40:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.718+0000 7fcb497fa700 1 -- 172.21.15.6:0/693109367 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44005740 con 0x7fcb4c1013c0 2023-09-13T09:40:45.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.718+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c19f1b0 con 0x7fcb4c1013c0 2023-09-13T09:40:45.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.720+0000 7fcb497fa700 1 -- 172.21.15.6:0/693109367 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcb4400dc60 con 0x7fcb4c1013c0 2023-09-13T09:40:45.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb497fa700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb340a0640 0x7fcb340a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb340a0640 0x7fcb340a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb497fa700 1 -- 172.21.15.6:0/693109367 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb440cb3e0 con 0x7fcb4c1013c0 2023-09-13T09:40:45.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 Processor -- start 2023-09-13T09:40:45.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb340a0640 0x7fcb340a2b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b5c0 tx=0x7fcb3c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 -- start start 2023-09-13T09:40:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b764fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b7650060 0x55b5b764e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b75a7780 con 0x55b5b764f700 2023-09-13T09:40:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b75a50a0 con 0x55b5b764ea00 2023-09-13T09:40:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.721+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b75a0990 con 0x55b5b7650060 2023-09-13T09:40:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b764fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b764fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34730/0 (socket says 172.21.15.6:34730) 2023-09-13T09:40:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 -- 172.21.15.6:0/1169260286 learned_addr learned my addr 172.21.15.6:0/1169260286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb50d24700 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b7650060 0x55b5b764e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 -- 172.21.15.6:0/1169260286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b7650060 msgr2=0x55b5b764e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b7650060 0x55b5b764e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 -- 172.21.15.6:0/1169260286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 msgr2=0x55b5b764ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 -- 172.21.15.6:0/1169260286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5b7420630 con 0x55b5b764f700 2023-09-13T09:40:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b7650060 0x55b5b764e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b764fb20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c015000 tx=0x7fcb3c020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9058d62caf490df8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb327fc700 1 -- 172.21.15.6:0/1169260286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c02a070 con 0x55b5b764f700 2023-09-13T09:40:45.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb327fc700 1 -- 172.21.15.6:0/1169260286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb3c01e040 con 0x55b5b764f700 2023-09-13T09:40:45.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.722+0000 7fcb327fc700 1 -- 172.21.15.6:0/1169260286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c023b60 con 0x55b5b764f700 2023-09-13T09:40:45.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1169260286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 msgr2=0x55b5b764fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b764fb20 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c015000 tx=0x7fcb3c020000 comp rx=0 tx=0).stop 2023-09-13T09:40:45.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1169260286 shutdown_connections 2023-09-13T09:40:45.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b764fb20 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1169260286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b7650060 0x55b5b764e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1169260286 >> 172.21.15.6:0/1169260286 conn(0x55b5b75acc80 msgr2=0x55b5b7648f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1169260286 shutdown_connections 2023-09-13T09:40:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1169260286 wait complete. 2023-09-13T09:40:45.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.723+0000 7fcb5e96cb80 1 -- start start 2023-09-13T09:40:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 1 Processor -- start 2023-09-13T09:40:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b7657ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b7658410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b765f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b753ebb0 con 0x55b5b7650060 2023-09-13T09:40:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b753e8b0 con 0x55b5b764ea00 2023-09-13T09:40:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b7422920 con 0x55b5b764f700 2023-09-13T09:40:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb5e96cb80 10 client.0 _ll_register_callbacks cb 0x55b5b753c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b765f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b7657ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b765f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34740/0 (socket says 172.21.15.6:34740) 2023-09-13T09:40:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 -- 172.21.15.6:0/1286889821 learned_addr learned my addr 172.21.15.6:0/1286889821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b7658410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 -- 172.21.15.6:0/1286889821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 msgr2=0x55b5b7658410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b7658410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 -- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 msgr2=0x55b5b7657ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b7657ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb50d24700 1 -- 172.21.15.6:0/1286889821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb4c108b50 con 0x55b5b7650060 2023-09-13T09:40:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b7657ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:45.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.724+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b7658410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb50d24700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b765f450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcb440c8e90 tx=0x7fcb44004c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec13e1b06a5d0b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1286889821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44005aa0 con 0x55b5b7650060 2023-09-13T09:40:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1286889821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb44098de0 con 0x55b5b7650060 2023-09-13T09:40:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5b7641670 con 0x55b5b7650060 2023-09-13T09:40:45.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1286889821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb44098fa0 con 0x55b5b7650060 2023-09-13T09:40:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 10 client.15777 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b5b75b87a0 con 0x55b5b7650060 2023-09-13T09:40:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1286889821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b5b7641670 con 0x55b5b7650060 2023-09-13T09:40:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1286889821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fcb440b5050 con 0x55b5b7650060 2023-09-13T09:40:45.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 10 client.15777 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 10 client.15777 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 20 client.15777 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b7663cf0 0x55b5b7666110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 4 client.15777 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:40:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.725+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5b7599970 con 0x55b5b7663cf0 2023-09-13T09:40:45.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.726+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b7663cf0 0x55b5b7666110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.726+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b7663cf0 0x55b5b7666110 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90875f390cde1145 server_cookie=721617d6489764c6 in_seq=0 out_seq=0 2023-09-13T09:40:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.726+0000 7fcb2b7fe700 10 client.15777 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1286889821 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b5b7599970 con 0x55b5b7663cf0 2023-09-13T09:40:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb2b7fe700 10 client.15777 handle_command_reply: tid=0 2023-09-13T09:40:45.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 client.15777 shutdown 2023-09-13T09:40:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 msgr2=0x55b5b765f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b765f450 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fcb440c8e90 tx=0x7fcb44004c40 comp rx=0 tx=0).stop 2023-09-13T09:40:45.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 shutdown_connections 2023-09-13T09:40:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b7663cf0 0x55b5b7666110 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b765f450 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb2b7fe700 0 client.15777 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b7657ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1286889821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b7658410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 >> 172.21.15.6:0/1286889821 conn(0x55b5b75acc80 msgr2=0x55b5b76437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 shutdown_connections 2023-09-13T09:40:45.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1286889821 wait complete. 2023-09-13T09:40:45.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.727+0000 7fcb5e96cb80 20 client.15777 trim_cache size 0 max 16384 2023-09-13T09:40:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 Processor -- start 2023-09-13T09:40:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 -- start start 2023-09-13T09:40:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b765f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b7657ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b7663810 con 0x55b5b7650060 2023-09-13T09:40:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b76571a0 con 0x55b5b764ea00 2023-09-13T09:40:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b764a730 con 0x55b5b764f700 2023-09-13T09:40:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b7657ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb4bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b7657ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34748/0 (socket says 172.21.15.6:34748) 2023-09-13T09:40:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 -- 172.21.15.6:0/3252482301 learned_addr learned my addr 172.21.15.6:0/3252482301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b765f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 -- 172.21.15.6:0/3252482301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 msgr2=0x55b5b765f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b765f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 -- 172.21.15.6:0/3252482301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 msgr2=0x55b5b764e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb50d24700 1 -- 172.21.15.6:0/3252482301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5b73ccde0 con 0x55b5b7650060 2023-09-13T09:40:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.744+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b765f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:40:45.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb50d24700 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b7657ed0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcb44098880 tx=0x7fcb4400dbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cd551c67e9820a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb32ffd700 1 -- 172.21.15.6:0/3252482301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44005aa0 con 0x55b5b7650060 2023-09-13T09:40:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb32ffd700 1 -- 172.21.15.6:0/3252482301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb440947a0 con 0x55b5b7650060 2023-09-13T09:40:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb32ffd700 1 -- 172.21.15.6:0/3252482301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb44098de0 con 0x55b5b7650060 2023-09-13T09:40:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/3252482301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 msgr2=0x55b5b7657ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b7657ed0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fcb44098880 tx=0x7fcb4400dbd0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/3252482301 shutdown_connections 2023-09-13T09:40:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b7650060 0x55b5b7657ed0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b764ea00 0x55b5b764e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/3252482301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764f700 0x55b5b765f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/3252482301 >> 172.21.15.6:0/3252482301 conn(0x55b5b75acc80 msgr2=0x55b5b7652920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/3252482301 shutdown_connections 2023-09-13T09:40:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.745+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/3252482301 wait complete. 2023-09-13T09:40:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 -- start start 2023-09-13T09:40:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 Processor -- start 2023-09-13T09:40:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764ea00 0x55b5b765b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b765bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b7650060 0x55b5b765eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b765f090 con 0x55b5b764f700 2023-09-13T09:40:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b765f200 con 0x55b5b7650060 2023-09-13T09:40:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5b765f3c0 con 0x55b5b764ea00 2023-09-13T09:40:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb5e96cb80 10 client.0 _ll_register_callbacks cb 0x55b5b753c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:40:45.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb4b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b765bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb4b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b765bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34750/0 (socket says 172.21.15.6:34750) 2023-09-13T09:40:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb50d24700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b7650060 0x55b5b765eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb4b7fe700 1 -- 172.21.15.6:0/1087431545 learned_addr learned my addr 172.21.15.6:0/1087431545 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:40:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.746+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764ea00 0x55b5b765b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb4b7fe700 1 -- 172.21.15.6:0/1087431545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764ea00 msgr2=0x55b5b765b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764ea00 0x55b5b765b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb4b7fe700 1 -- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b7650060 msgr2=0x55b5b765eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:40:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b7650060 0x55b5b765eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb4b7fe700 1 -- 172.21.15.6:0/1087431545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5b75b87a0 con 0x55b5b764f700 2023-09-13T09:40:45.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb50d24700 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b7650060 0x55b5b765eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:40:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb4b7fe700 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b765bb30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcb400123f0 tx=0x7fcb40012700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b60f80428f3738b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:40:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb2b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:40:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1087431545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40017070 con 0x55b5b764f700 2023-09-13T09:40:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1087431545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb40004830 con 0x55b5b764f700 2023-09-13T09:40:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb3c01e040 con 0x55b5b764f700 2023-09-13T09:40:45.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1087431545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb400049f0 con 0x55b5b764f700 2023-09-13T09:40:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb5e96cb80 10 client.15783 fetch_fsmap learned FSMap version 27 2023-09-13T09:40:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b5b73b5c60 con 0x55b5b764f700 2023-09-13T09:40:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.747+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1087431545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb3c01e040 con 0x55b5b764f700 2023-09-13T09:40:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1087431545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 27) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fcb4001b850 con 0x55b5b764f700 2023-09-13T09:40:45.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb5e96cb80 10 client.15783 fetch_fsmap finished waiting for FSMap version 27 2023-09-13T09:40:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb5e96cb80 10 client.15783 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:40:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb5e96cb80 20 client.15783 populate_metadata read hostname 'smithi006' 2023-09-13T09:40:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b76b9080 0x55b5b76bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:40:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb5e96cb80 4 client.15783 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:40:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b5b755a050 con 0x55b5b76b9080 2023-09-13T09:40:45.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b76b9080 0x55b5b76bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:40:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb2b7fe700 10 client.15783 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb4bfff700 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b76b9080 0x55b5b76bb4a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=498512acd906fd5f server_cookie=56797a6128bea3fc in_seq=0 out_seq=0 2023-09-13T09:40:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb2b7fe700 1 -- 172.21.15.6:0/1087431545 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b5b755a050 con 0x55b5b76b9080 2023-09-13T09:40:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb2b7fe700 10 client.15783 handle_command_reply: tid=0 2023-09-13T09:40:45.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.748+0000 7fcb5e96cb80 1 client.15783 shutdown 2023-09-13T09:40:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 msgr2=0x55b5b765bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b765bb30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fcb400123f0 tx=0x7fcb40012700 comp rx=0 tx=0).stop 2023-09-13T09:40:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 shutdown_connections 2023-09-13T09:40:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b5b7650060 0x55b5b765eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b5b764ea00 0x55b5b765b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b5b76b9080 0x55b5b76bb4a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 --2- 172.21.15.6:0/1087431545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b5b764f700 0x55b5b765bb30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 >> 172.21.15.6:0/1087431545 conn(0x55b5b75acc80 msgr2=0x55b5b7657e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb2b7fe700 0 client.15783 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:40:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 shutdown_connections 2023-09-13T09:40:45.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 1 -- 172.21.15.6:0/1087431545 wait complete. 2023-09-13T09:40:45.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb5e96cb80 20 client.15783 trim_cache size 0 max 16384 2023-09-13T09:40:45.774 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:40:45.774 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:40:45.774 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:40:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "163ac0b5-b51b-438a-9b47-b62e3df8fc84": { 2023-09-13T09:40:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:40:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "163ac0b5-b51b-438a-9b47-b62e3df8fc84", 2023-09-13T09:40:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:40:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:40:45.776 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:40:45.776 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:40:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.749+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb340a0640 msgr2=0x7fcb340a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb340a0640 0x7fcb340a2b00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00b5c0 tx=0x7fcb3c005fb0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 msgr2=0x7fcb4c19e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:40:45.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c19e170 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fcb44007ee0 tx=0x7fcb4400d3b0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 shutdown_connections 2023-09-13T09:40:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb340a0640 0x7fcb340a2b00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb4c1013c0 0x7fcb4c19e170 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb4c0ff8f0 0x7fcb4c196bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 --2- 172.21.15.6:0/693109367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb4c100290 0x7fcb4c197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:40:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 >> 172.21.15.6:0/693109367 conn(0x7fcb4c0fb250 msgr2=0x7fcb4c068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:40:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 shutdown_connections 2023-09-13T09:40:45.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:40:45.750+0000 7fcb52787700 1 -- 172.21.15.6:0/693109367 wait complete. 2023-09-13T09:40:45.779 INFO:tasks.cephfs.filesystem:scrub status for tag:163ac0b5-b51b-438a-9b47-b62e3df8fc84 - {'path': '/', 'tag': '163ac0b5-b51b-438a-9b47-b62e3df8fc84', 'options': 'recursive,force'} 2023-09-13T09:40:46.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 14336 16.02 MB/sec warmup 6 sec latency 30.055 ms 2023-09-13T09:40:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:45 smithi053 ceph-mon[102373]: pgmap v337: 97 pgs: 97 active+clean; 2.7 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 197 KiB/s wr, 35 op/s 2023-09-13T09:40:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:45 smithi006 ceph-mon[98665]: pgmap v337: 97 pgs: 97 active+clean; 2.7 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 197 KiB/s wr, 35 op/s 2023-09-13T09:40:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:45 smithi131 ceph-mon[102785]: pgmap v337: 97 pgs: 97 active+clean; 2.7 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 197 KiB/s wr, 35 op/s 2023-09-13T09:40:47.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 16495 14.89 MB/sec warmup 7 sec latency 8.191 ms 2023-09-13T09:40:47.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:46 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:40:47.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:40:47.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:40:47.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:46 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:40:47.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:40:47.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:40:47.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:46 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:40:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:40:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:40:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:40:48.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 18329 14.57 MB/sec warmup 8 sec latency 21.742 ms 2023-09-13T09:40:48.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:47 smithi006 ceph-mon[98665]: pgmap v338: 97 pgs: 97 active+clean; 4.4 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 373 KiB/s wr, 46 op/s 2023-09-13T09:40:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:47 smithi053 ceph-mon[102373]: pgmap v338: 97 pgs: 97 active+clean; 4.4 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 373 KiB/s wr, 46 op/s 2023-09-13T09:40:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:47 smithi131 ceph-mon[102785]: pgmap v338: 97 pgs: 97 active+clean; 4.4 MiB data, 351 MiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 373 KiB/s wr, 46 op/s 2023-09-13T09:40:49.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 21290 14.89 MB/sec warmup 9 sec latency 8.988 ms 2023-09-13T09:40:50.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 22198 13.63 MB/sec warmup 10 sec latency 278.818 ms 2023-09-13T09:40:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:49 smithi006 ceph-mon[98665]: pgmap v339: 97 pgs: 97 active+clean; 7.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 680 KiB/s wr, 99 op/s 2023-09-13T09:40:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:49 smithi053 ceph-mon[102373]: pgmap v339: 97 pgs: 97 active+clean; 7.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 680 KiB/s wr, 99 op/s 2023-09-13T09:40:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:49 smithi131 ceph-mon[102785]: pgmap v339: 97 pgs: 97 active+clean; 7.4 MiB data, 360 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 680 KiB/s wr, 99 op/s 2023-09-13T09:40:51.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 25095 14.05 MB/sec warmup 11 sec latency 8.202 ms 2023-09-13T09:40:52.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 27270 13.49 MB/sec warmup 12 sec latency 7.737 ms 2023-09-13T09:40:52.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:51 smithi006 ceph-mon[98665]: pgmap v340: 97 pgs: 97 active+clean; 7.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 710 KiB/s wr, 102 op/s 2023-09-13T09:40:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:51 smithi053 ceph-mon[102373]: pgmap v340: 97 pgs: 97 active+clean; 7.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 710 KiB/s wr, 102 op/s 2023-09-13T09:40:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:51 smithi131 ceph-mon[102785]: pgmap v340: 97 pgs: 97 active+clean; 7.7 MiB data, 361 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 710 KiB/s wr, 102 op/s 2023-09-13T09:40:53.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 29197 13.41 MB/sec warmup 13 sec latency 7.469 ms 2023-09-13T09:40:54.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 32080 13.70 MB/sec warmup 14 sec latency 16.729 ms 2023-09-13T09:40:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:53 smithi053 ceph-mon[102373]: pgmap v341: 97 pgs: 97 active+clean; 12 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-09-13T09:40:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:53 smithi006 ceph-mon[98665]: pgmap v341: 97 pgs: 97 active+clean; 12 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-09-13T09:40:54.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:53 smithi131 ceph-mon[102785]: pgmap v341: 97 pgs: 97 active+clean; 12 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 522 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-09-13T09:40:55.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 33854 13.23 MB/sec warmup 15 sec latency 19.049 ms 2023-09-13T09:40:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:54 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:40:55.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:54 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:40:55.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:54 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:40:56.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 35886 13.26 MB/sec warmup 16 sec latency 110.850 ms 2023-09-13T09:40:56.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:40:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:55 smithi006 ceph-mon[98665]: pgmap v342: 97 pgs: 97 active+clean; 13 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.1 MiB/s wr, 132 op/s 2023-09-13T09:40:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:40:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:55 smithi053 ceph-mon[102373]: pgmap v342: 97 pgs: 97 active+clean; 13 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.1 MiB/s wr, 132 op/s 2023-09-13T09:40:56.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:40:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:55 smithi131 ceph-mon[102785]: pgmap v342: 97 pgs: 97 active+clean; 13 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 1.1 MiB/s wr, 132 op/s 2023-09-13T09:40:57.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 38269 13.13 MB/sec warmup 17 sec latency 8.003 ms 2023-09-13T09:40:58.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 40058 12.90 MB/sec warmup 18 sec latency 16.513 ms 2023-09-13T09:40:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:57 smithi006 ceph-mon[98665]: pgmap v343: 97 pgs: 97 active+clean; 16 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.4 MiB/s wr, 191 op/s 2023-09-13T09:40:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:57 smithi053 ceph-mon[102373]: pgmap v343: 97 pgs: 97 active+clean; 16 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.4 MiB/s wr, 191 op/s 2023-09-13T09:40:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:57 smithi131 ceph-mon[102785]: pgmap v343: 97 pgs: 97 active+clean; 16 MiB data, 396 MiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 1.4 MiB/s wr, 191 op/s 2023-09-13T09:40:59.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 42878 13.17 MB/sec warmup 19 sec latency 16.834 ms 2023-09-13T09:41:00.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 44987 12.87 MB/sec warmup 20 sec latency 19.272 ms 2023-09-13T09:41:00.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:40:59 smithi006 ceph-mon[98665]: pgmap v344: 97 pgs: 97 active+clean; 16 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.3 MiB/s wr, 181 op/s 2023-09-13T09:41:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:40:59 smithi053 ceph-mon[102373]: pgmap v344: 97 pgs: 97 active+clean; 16 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.3 MiB/s wr, 181 op/s 2023-09-13T09:41:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:40:59 smithi131 ceph-mon[102785]: pgmap v344: 97 pgs: 97 active+clean; 16 MiB data, 398 MiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.3 MiB/s wr, 181 op/s 2023-09-13T09:41:01.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 46631 12.84 MB/sec warmup 21 sec latency 106.425 ms 2023-09-13T09:41:02.145 INFO:tasks.workunit.client.0.smithi006.stdout: 1 49145 12.82 MB/sec warmup 22 sec latency 36.393 ms 2023-09-13T09:41:02.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:01 smithi006 ceph-mon[98665]: pgmap v345: 97 pgs: 97 active+clean; 17 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-09-13T09:41:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:01 smithi053 ceph-mon[102373]: pgmap v345: 97 pgs: 97 active+clean; 17 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-09-13T09:41:02.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:01 smithi131 ceph-mon[102785]: pgmap v345: 97 pgs: 97 active+clean; 17 MiB data, 407 MiB used, 1.0 TiB / 1.0 TiB avail; 491 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-09-13T09:41:03.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 50912 12.64 MB/sec warmup 23 sec latency 8.674 ms 2023-09-13T09:41:04.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 53538 12.81 MB/sec warmup 24 sec latency 18.162 ms 2023-09-13T09:41:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:03 smithi006 ceph-mon[98665]: pgmap v346: 97 pgs: 97 active+clean; 21 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.4 MiB/s wr, 191 op/s 2023-09-13T09:41:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:03 smithi053 ceph-mon[102373]: pgmap v346: 97 pgs: 97 active+clean; 21 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.4 MiB/s wr, 191 op/s 2023-09-13T09:41:04.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:03 smithi131 ceph-mon[102785]: pgmap v346: 97 pgs: 97 active+clean; 21 MiB data, 425 MiB used, 1.0 TiB / 1.0 TiB avail; 757 KiB/s rd, 1.4 MiB/s wr, 191 op/s 2023-09-13T09:41:05.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 55677 12.60 MB/sec warmup 25 sec latency 21.397 ms 2023-09-13T09:41:06.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 57021 12.56 MB/sec warmup 26 sec latency 269.375 ms 2023-09-13T09:41:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:05 smithi006 ceph-mon[98665]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2023-09-13T09:41:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:05 smithi053 ceph-mon[102373]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2023-09-13T09:41:06.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:05 smithi131 ceph-mon[102785]: pgmap v347: 97 pgs: 97 active+clean; 23 MiB data, 432 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 1.2 MiB/s wr, 164 op/s 2023-09-13T09:41:07.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 57021 12.10 MB/sec warmup 27 sec latency 1269.450 ms 2023-09-13T09:41:07.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:06 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:07.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:06 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:07.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:06 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:08.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 57021 11.66 MB/sec warmup 28 sec latency 2269.558 ms 2023-09-13T09:41:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:07 smithi006 ceph-mon[98665]: pgmap v348: 97 pgs: 97 active+clean; 23 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 1.2 MiB/s wr, 170 op/s 2023-09-13T09:41:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:07 smithi053 ceph-mon[102373]: pgmap v348: 97 pgs: 97 active+clean; 23 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 1.2 MiB/s wr, 170 op/s 2023-09-13T09:41:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:07 smithi131 ceph-mon[102785]: pgmap v348: 97 pgs: 97 active+clean; 23 MiB data, 440 MiB used, 1.0 TiB / 1.0 TiB avail; 586 KiB/s rd, 1.2 MiB/s wr, 170 op/s 2023-09-13T09:41:09.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 57084 11.26 MB/sec warmup 29 sec latency 3149.923 ms 2023-09-13T09:41:10.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 58774 11.08 MB/sec warmup 30 sec latency 16.620 ms 2023-09-13T09:41:10.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:09 smithi006 ceph-mon[98665]: pgmap v349: 97 pgs: 97 active+clean; 26 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:41:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:09 smithi053 ceph-mon[102373]: pgmap v349: 97 pgs: 97 active+clean; 26 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:41:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:09 smithi131 ceph-mon[102785]: pgmap v349: 97 pgs: 97 active+clean; 26 MiB data, 447 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:41:11.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 60306 11.11 MB/sec warmup 31 sec latency 497.562 ms 2023-09-13T09:41:12.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 60321 10.76 MB/sec warmup 32 sec latency 866.433 ms 2023-09-13T09:41:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:11 smithi006 ceph-mon[98665]: pgmap v350: 97 pgs: 97 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:41:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:11 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:11 smithi053 ceph-mon[102373]: pgmap v350: 97 pgs: 97 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:41:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:11 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:12.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:11 smithi131 ceph-mon[102785]: pgmap v350: 97 pgs: 97 active+clean; 26 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:41:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:11 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:13.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 60396 10.44 MB/sec warmup 33 sec latency 912.535 ms 2023-09-13T09:41:14.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 60441 10.14 MB/sec warmup 34 sec latency 1857.429 ms 2023-09-13T09:41:14.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:13 smithi006 ceph-mon[98665]: pgmap v351: 97 pgs: 97 active+clean; 27 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-09-13T09:41:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:13 smithi053 ceph-mon[102373]: pgmap v351: 97 pgs: 97 active+clean; 27 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-09-13T09:41:14.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:13 smithi131 ceph-mon[102785]: pgmap v351: 97 pgs: 97 active+clean; 27 MiB data, 472 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 1.1 MiB/s wr, 152 op/s 2023-09-13T09:41:15.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 60712 9.89 MB/sec warmup 35 sec latency 619.568 ms 2023-09-13T09:41:15.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:41:15.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.926+0000 7fe7f44b8700 1 -- 172.21.15.6:0/549587979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec100eb0 msgr2=0x7fe7ec101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.926+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/549587979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec100eb0 0x7fe7ec101310 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80099c0 tx=0x7fe7e8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.926+0000 7fe7f44b8700 1 -- 172.21.15.6:0/549587979 shutdown_connections 2023-09-13T09:41:15.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.926+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/549587979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ec101850 0x7fe7ec108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.926+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/549587979 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7ec0ffcc0 0x7fe7ec1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.926+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/549587979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec100eb0 0x7fe7ec101310 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 -- 172.21.15.6:0/549587979 >> 172.21.15.6:0/549587979 conn(0x7fe7ec0fb250 msgr2=0x7fe7ec0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:15.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 -- 172.21.15.6:0/549587979 shutdown_connections 2023-09-13T09:41:15.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 -- 172.21.15.6:0/549587979 wait complete. 2023-09-13T09:41:15.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 Processor -- start 2023-09-13T09:41:15.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 -- start start 2023-09-13T09:41:15.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7ec0ffcc0 0x7fe7ec196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ec100eb0 0x7fe7ec197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec101850 0x7fe7ec19e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec19e6c0 con 0x7fe7ec101850 2023-09-13T09:41:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec19e800 con 0x7fe7ec0ffcc0 2023-09-13T09:41:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.927+0000 7fe7f44b8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7ec19e990 con 0x7fe7ec100eb0 2023-09-13T09:41:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec101850 0x7fe7ec19e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec101850 0x7fe7ec19e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34768/0 (socket says 172.21.15.6:34768) 2023-09-13T09:41:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1315832656 learned_addr learned my addr 172.21.15.6:0/1315832656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7ec0ffcc0 0x7fe7ec196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ec100eb0 0x7fe7ec197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1315832656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ec100eb0 msgr2=0x7fe7ec197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ec100eb0 0x7fe7ec197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1315832656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7ec0ffcc0 msgr2=0x7fe7ec196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7ec0ffcc0 0x7fe7ec196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1315832656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7e80095f0 con 0x7fe7ec101850 2023-09-13T09:41:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ec100eb0 0x7fe7ec197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:15.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec101850 0x7fe7ec19e0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400ef30 tx=0x7fe7e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7df7fe700 1 -- 172.21.15.6:0/1315832656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4018070 con 0x7fe7ec101850 2023-09-13T09:41:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7ec19ec10 con 0x7fe7ec101850 2023-09-13T09:41:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7df7fe700 1 -- 172.21.15.6:0/1315832656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7e400f040 con 0x7fe7ec101850 2023-09-13T09:41:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7df7fe700 1 -- 172.21.15.6:0/1315832656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e400cdb0 con 0x7fe7ec101850 2023-09-13T09:41:15.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.928+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7ec19f120 con 0x7fe7ec101850 2023-09-13T09:41:15.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.931+0000 7fe7df7fe700 1 -- 172.21.15.6:0/1315832656 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe7e4003a00 con 0x7fe7ec101850 2023-09-13T09:41:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.931+0000 7fe7df7fe700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7d80a0640 0x7fe7d80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.932+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7d80a0640 0x7fe7d80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.932+0000 7fe7df7fe700 1 -- 172.21.15.6:0/1315832656 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe7e40cb790 con 0x7fe7ec101850 2023-09-13T09:41:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.932+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7d80a0640 0x7fe7d80a2b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec100d10 tx=0x7fe7e000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:15.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.932+0000 7fe80069db80 1 Processor -- start 2023-09-13T09:41:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.932+0000 7fe80069db80 1 -- start start 2023-09-13T09:41:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe80069db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496167700 0x558496167b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe80069db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x5584961664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe80069db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x558496166e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe80069db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584960bf780 con 0x558496167700 2023-09-13T09:41:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe80069db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584960bd0a0 con 0x558496166a00 2023-09-13T09:41:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe80069db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584960b8990 con 0x558496168060 2023-09-13T09:41:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496167700 0x558496167b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496167700 0x558496167b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34772/0 (socket says 172.21.15.6:34772) 2023-09-13T09:41:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 -- 172.21.15.6:0/1185919683 learned_addr learned my addr 172.21.15.6:0/1185919683 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:15.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x558496166e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 -- 172.21.15.6:0/1185919683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 msgr2=0x5584961664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x5584961664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x5584961664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 -- 172.21.15.6:0/1185919683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 msgr2=0x558496166e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x558496166e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 -- 172.21.15.6:0/1185919683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558495f38630 con 0x558496167700 2023-09-13T09:41:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x558496166e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x5584961664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496167700 0x558496167b20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0010f70 tx=0x7fe7e0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=485236fef9ed4aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:15.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7dcd82700 1 -- 172.21.15.6:0/1185919683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0011db0 con 0x558496167700 2023-09-13T09:41:15.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7dcd82700 1 -- 172.21.15.6:0/1185919683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7e0015070 con 0x558496167700 2023-09-13T09:41:15.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.933+0000 7fe7dcd82700 1 -- 172.21.15.6:0/1185919683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e001c610 con 0x558496167700 2023-09-13T09:41:15.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 -- 172.21.15.6:0/1185919683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496167700 msgr2=0x558496167b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496167700 0x558496167b20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0010f70 tx=0x7fe7e0013000 comp rx=0 tx=0).stop 2023-09-13T09:41:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 -- 172.21.15.6:0/1185919683 shutdown_connections 2023-09-13T09:41:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x558496166e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496167700 0x558496167b20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 --2- 172.21.15.6:0/1185919683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x5584961664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 -- 172.21.15.6:0/1185919683 >> 172.21.15.6:0/1185919683 conn(0x5584960c4c80 msgr2=0x558496160f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:15.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 -- 172.21.15.6:0/1185919683 shutdown_connections 2023-09-13T09:41:15.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.934+0000 7fe80069db80 1 -- 172.21.15.6:0/1185919683 wait complete. 2023-09-13T09:41:15.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 -- start start 2023-09-13T09:41:15.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 Processor -- start 2023-09-13T09:41:15.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x55849616ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 0x558496170450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x558496177490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558496056bb0 con 0x558496168060 2023-09-13T09:41:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584960568b0 con 0x558496166a00 2023-09-13T09:41:15.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558495f3a920 con 0x558496167700 2023-09-13T09:41:15.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe80069db80 10 client.0 _ll_register_callbacks cb 0x558496054680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:15.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe7f2a55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x558496177490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe7f2a55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x558496177490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34778/0 (socket says 172.21.15.6:34778) 2023-09-13T09:41:15.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1940961659 learned_addr learned my addr 172.21.15.6:0/1940961659 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:15.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.935+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x55849616ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1940961659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 msgr2=0x558496170450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:41:15.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 0x558496170450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 msgr2=0x55849616ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:15.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x55849616ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7f2a55700 1 -- 172.21.15.6:0/1940961659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e0010c50 con 0x558496168060 2023-09-13T09:41:15.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x558496177490 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400c7a0 tx=0x7fe7e4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb253ca826e9f29 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:15.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:15.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/1940961659 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4099660 con 0x558496168060 2023-09-13T09:41:15.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558496159670 con 0x558496168060 2023-09-13T09:41:15.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/1940961659 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe7e4098f60 con 0x558496168060 2023-09-13T09:41:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/1940961659 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7e409cd90 con 0x558496168060 2023-09-13T09:41:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe80069db80 10 client.15795 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.936+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5584960d07a0 con 0x558496168060 2023-09-13T09:41:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/1940961659 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558496159670 con 0x558496168060 2023-09-13T09:41:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/1940961659 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fe7e40a0ab0 con 0x558496168060 2023-09-13T09:41:15.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe80069db80 10 client.15795 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:15.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe80069db80 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:15.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe80069db80 20 client.15795 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:15.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe80069db80 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961824b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe80069db80 4 client.15795 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584960b1970 con 0x558496180090 2023-09-13T09:41:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961824b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe7d5ffb700 10 client.15795 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.937+0000 7fe7f2254700 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961824b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bd1da97cd871141 server_cookie=39ab4a93d2ae093c in_seq=0 out_seq=0 2023-09-13T09:41:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/1940961659 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5584960b1970 con 0x558496180090 2023-09-13T09:41:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe7d5ffb700 10 client.15795 handle_command_reply: tid=0 2023-09-13T09:41:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 client.15795 shutdown 2023-09-13T09:41:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 msgr2=0x558496177490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x558496177490 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400c7a0 tx=0x7fe7e4004ad0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 shutdown_connections 2023-09-13T09:41:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961824b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x558496177490 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x55849616ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe7d5ffb700 0 client.15795 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 --2- 172.21.15.6:0/1940961659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 0x558496170450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 >> 172.21.15.6:0/1940961659 conn(0x5584960c4c80 msgr2=0x55849615b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 shutdown_connections 2023-09-13T09:41:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.938+0000 7fe80069db80 1 -- 172.21.15.6:0/1940961659 wait complete. 2023-09-13T09:41:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.939+0000 7fe80069db80 20 client.15795 trim_cache size 0 max 16384 2023-09-13T09:41:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 Processor -- start 2023-09-13T09:41:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 -- start start 2023-09-13T09:41:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x5584961664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 0x558496177450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x55849617c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849615d8e0 con 0x558496168060 2023-09-13T09:41:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558496162730 con 0x558496166a00 2023-09-13T09:41:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe80069db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55849617d4d0 con 0x558496167700 2023-09-13T09:41:15.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x55849617c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x55849617c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34788/0 (socket says 172.21.15.6:34788) 2023-09-13T09:41:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 -- 172.21.15.6:0/393567787 learned_addr learned my addr 172.21.15.6:0/393567787 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2254700 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x5584961664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 -- 172.21.15.6:0/393567787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 msgr2=0x558496177450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:15.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 0x558496177450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 -- 172.21.15.6:0/393567787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 msgr2=0x5584961664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x5584961664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 -- 172.21.15.6:0/393567787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558495ee4de0 con 0x558496168060 2023-09-13T09:41:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2254700 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x5584961664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:15.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.956+0000 7fe7f2a55700 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x55849617c190 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40090a0 tx=0x7fe7e4095350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c91ac448d439aba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe7dd583700 1 -- 172.21.15.6:0/393567787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e4093c10 con 0x558496168060 2023-09-13T09:41:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe7dd583700 1 -- 172.21.15.6:0/393567787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7e40b6020 con 0x558496168060 2023-09-13T09:41:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe7dd583700 1 -- 172.21.15.6:0/393567787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e40b12f0 con 0x558496168060 2023-09-13T09:41:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 -- 172.21.15.6:0/393567787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 msgr2=0x55849617c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x55849617c190 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe7e40090a0 tx=0x7fe7e4095350 comp rx=0 tx=0).stop 2023-09-13T09:41:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 -- 172.21.15.6:0/393567787 shutdown_connections 2023-09-13T09:41:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496168060 0x55849617c190 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496166a00 0x5584961664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 --2- 172.21.15.6:0/393567787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496167700 0x558496177450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 -- 172.21.15.6:0/393567787 >> 172.21.15.6:0/393567787 conn(0x5584960c4c80 msgr2=0x558496160e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 -- 172.21.15.6:0/393567787 shutdown_connections 2023-09-13T09:41:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.957+0000 7fe80069db80 1 -- 172.21.15.6:0/393567787 wait complete. 2023-09-13T09:41:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 -- start start 2023-09-13T09:41:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 Processor -- start 2023-09-13T09:41:15.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496166a00 0x558496176f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496167700 0x558496177470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x558496173ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584961741d0 con 0x558496166a00 2023-09-13T09:41:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558496174340 con 0x558496167700 2023-09-13T09:41:15.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558496174500 con 0x558496168060 2023-09-13T09:41:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe80069db80 10 client.0 _ll_register_callbacks cb 0x558496054680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496166a00 0x558496176f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496166a00 0x558496176f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34790/0 (socket says 172.21.15.6:34790) 2023-09-13T09:41:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 -- 172.21.15.6:0/2651938821 learned_addr learned my addr 172.21.15.6:0/2651938821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:15.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496167700 0x558496177470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 -- 172.21.15.6:0/2651938821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 msgr2=0x558496173ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:15.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x558496173ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 -- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496167700 msgr2=0x558496177470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:15.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496167700 0x558496177470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 -- 172.21.15.6:0/2651938821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584960d07a0 con 0x558496166a00 2023-09-13T09:41:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496167700 0x558496177470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7f2254700 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496166a00 0x558496176f30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0010f40 tx=0x7fe7e0004710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625a2bb91271fb9b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.958+0000 7fe7d5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/2651938821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7e002c030 con 0x558496166a00 2023-09-13T09:41:15.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7e0015070 con 0x558496166a00 2023-09-13T09:41:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/2651938821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe7e0017070 con 0x558496166a00 2023-09-13T09:41:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/2651938821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7e001ed20 con 0x558496166a00 2023-09-13T09:41:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 10 client.15801 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x558495ecdc60 con 0x558496166a00 2023-09-13T09:41:15.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/2651938821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe7e0015070 con 0x558496166a00 2023-09-13T09:41:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/2651938821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fe7e0026580 con 0x558496166a00 2023-09-13T09:41:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 10 client.15801 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 20 client.15801 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961d76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:15.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 4 client.15801 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:41:15.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558496072050 con 0x558496180090 2023-09-13T09:41:15.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.959+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961d76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:15.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe7d5ffb700 10 client.15801 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:15.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe7f1a53700 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961d76a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9215c37bdd55573c server_cookie=14648d00d9389bdc in_seq=0 out_seq=0 2023-09-13T09:41:15.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe7d5ffb700 1 -- 172.21.15.6:0/2651938821 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558496072050 con 0x558496180090 2023-09-13T09:41:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe7d5ffb700 10 client.15801 handle_command_reply: tid=0 2023-09-13T09:41:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 client.15801 shutdown 2023-09-13T09:41:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496166a00 msgr2=0x558496176f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496166a00 0x558496176f30 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe7e0010f40 tx=0x7fe7e0004710 comp rx=0 tx=0).stop 2023-09-13T09:41:15.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 shutdown_connections 2023-09-13T09:41:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558496168060 0x558496173ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558496180090 0x5584961d76a0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558496166a00 0x558496176f30 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe7d5ffb700 0 client.15801 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:15.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 --2- 172.21.15.6:0/2651938821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558496167700 0x558496177470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 >> 172.21.15.6:0/2651938821 conn(0x5584960c4c80 msgr2=0x55849616a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 shutdown_connections 2023-09-13T09:41:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 1 -- 172.21.15.6:0/2651938821 wait complete. 2023-09-13T09:41:15.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.960+0000 7fe80069db80 20 client.15801 trim_cache size 0 max 16384 2023-09-13T09:41:15.981 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:41:15.982 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:41:15.982 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:41:15.982 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:41:15.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7d80a0640 msgr2=0x7fe7d80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7d80a0640 0x7fe7d80a2b00 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec100d10 tx=0x7fe7e000b410 comp rx=0 tx=0).stop 2023-09-13T09:41:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec101850 msgr2=0x7fe7ec19e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec101850 0x7fe7ec19e0f0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe7e400ef30 tx=0x7fe7e400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 shutdown_connections 2023-09-13T09:41:15.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7d80a0640 0x7fe7d80a2b00 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7ec101850 0x7fe7ec19e0f0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7ec0ffcc0 0x7fe7ec196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 --2- 172.21.15.6:0/1315832656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7ec100eb0 0x7fe7ec197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:15.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 >> 172.21.15.6:0/1315832656 conn(0x7fe7ec0fb250 msgr2=0x7fe7ec067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:15.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 shutdown_connections 2023-09-13T09:41:15.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:15.961+0000 7fe7f44b8700 1 -- 172.21.15.6:0/1315832656 wait complete. 2023-09-13T09:41:15.986 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:41:15.986 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:41:16.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.112+0000 7f122bfd4700 1 -- 172.21.15.6:0/659768764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240ffc90 msgr2=0x7f12241000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.112+0000 7f122bfd4700 1 --2- 172.21.15.6:0/659768764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240ffc90 0x7f12241000b0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f12200099c0 tx=0x7f1220009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.112+0000 7f122bfd4700 1 -- 172.21.15.6:0/659768764 shutdown_connections 2023-09-13T09:41:16.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.112+0000 7f122bfd4700 1 --2- 172.21.15.6:0/659768764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1224101820 0x7f12241080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.112+0000 7f122bfd4700 1 --2- 172.21.15.6:0/659768764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f12240ffc90 0x7f12241000b0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.112+0000 7f122bfd4700 1 --2- 172.21.15.6:0/659768764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1224100e80 0x7f12241012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.112+0000 7f122bfd4700 1 -- 172.21.15.6:0/659768764 >> 172.21.15.6:0/659768764 conn(0x7f12240fb220 msgr2=0x7f12240fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 -- 172.21.15.6:0/659768764 shutdown_connections 2023-09-13T09:41:16.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 -- 172.21.15.6:0/659768764 wait complete. 2023-09-13T09:41:16.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 Processor -- start 2023-09-13T09:41:16.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 -- start start 2023-09-13T09:41:16.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12240ffc90 0x7f1224196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1224100e80 0x7f1224196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1224101820 0x7f122419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122419e5f0 con 0x7f1224100e80 2023-09-13T09:41:16.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122419e730 con 0x7f1224101820 2023-09-13T09:41:16.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122bfd4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122419e8c0 con 0x7f12240ffc90 2023-09-13T09:41:16.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122956f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1224100e80 0x7f1224196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122956f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1224100e80 0x7f1224196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34806/0 (socket says 172.21.15.6:34806) 2023-09-13T09:41:16.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.113+0000 7f122956f700 1 -- 172.21.15.6:0/4166946389 learned_addr learned my addr 172.21.15.6:0/4166946389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f1229d70700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12240ffc90 0x7f1224196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122a571700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1224101820 0x7f122419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122956f700 1 -- 172.21.15.6:0/4166946389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12240ffc90 msgr2=0x7f1224196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122956f700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12240ffc90 0x7f1224196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122956f700 1 -- 172.21.15.6:0/4166946389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1224101820 msgr2=0x7f122419e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122956f700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1224101820 0x7f122419e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122956f700 1 -- 172.21.15.6:0/4166946389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12200095f0 con 0x7f1224100e80 2023-09-13T09:41:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122956f700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1224100e80 0x7f1224196fb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f121400d950 tx=0x7f121400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f121affd700 1 -- 172.21.15.6:0/4166946389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121400f890 con 0x7f1224100e80 2023-09-13T09:41:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f121affd700 1 -- 172.21.15.6:0/4166946389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1214010460 con 0x7f1224100e80 2023-09-13T09:41:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f121affd700 1 -- 172.21.15.6:0/4166946389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121400e610 con 0x7f1224100e80 2023-09-13T09:41:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f122419eba0 con 0x7f1224100e80 2023-09-13T09:41:16.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.114+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f122419f0b0 con 0x7f1224100e80 2023-09-13T09:41:16.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.115+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122410b4a0 con 0x7f1224100e80 2023-09-13T09:41:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.116+0000 7f121affd700 1 -- 172.21.15.6:0/4166946389 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f12140108d0 con 0x7f1224100e80 2023-09-13T09:41:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.117+0000 7f121affd700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12100a06c0 0x7f12100a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.117+0000 7f1229d70700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12100a06c0 0x7f12100a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.117+0000 7f121affd700 1 -- 172.21.15.6:0/4166946389 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f12140cb8e0 con 0x7f1224100e80 2023-09-13T09:41:16.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.117+0000 7f1229d70700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12100a06c0 0x7f12100a2b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1220009990 tx=0x7f12200051e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.121+0000 7f121affd700 1 -- 172.21.15.6:0/4166946389 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f12140953c0 con 0x7f1224100e80 2023-09-13T09:41:16.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 60995 9.62 MB/sec warmup 36 sec latency 640.602 ms 2023-09-13T09:41:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:15 smithi006 ceph-mon[98665]: pgmap v352: 97 pgs: 97 active+clean; 42 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2023-09-13T09:41:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:15 smithi053 ceph-mon[102373]: pgmap v352: 97 pgs: 97 active+clean; 42 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2023-09-13T09:41:16.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:15 smithi131 ceph-mon[102785]: pgmap v352: 97 pgs: 97 active+clean; 42 MiB data, 553 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 3.4 MiB/s wr, 162 op/s 2023-09-13T09:41:16.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.367+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f122410b6e0 con 0x7f1224100e80 2023-09-13T09:41:16.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.368+0000 7f121affd700 1 -- 172.21.15.6:0/4166946389 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) v1 ==== 94+0+11344 (secure 0 0 0) 0x7f1214020090 con 0x7f1224100e80 2023-09-13T09:41:16.368 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:41:16.369 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:41:09.822842+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:41:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12100a06c0 msgr2=0x7f12100a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12100a06c0 0x7f12100a2b80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f1220009990 tx=0x7f12200051e0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1224100e80 msgr2=0x7f1224196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1224100e80 0x7f1224196fb0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f121400d950 tx=0x7f121400dc60 comp rx=0 tx=0).stop 2023-09-13T09:41:16.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 shutdown_connections 2023-09-13T09:41:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1224101820 0x7f122419e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12240ffc90 0x7f1224196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12100a06c0 0x7f12100a2b80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 --2- 172.21.15.6:0/4166946389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1224100e80 0x7f1224196fb0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.370+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 >> 172.21.15.6:0/4166946389 conn(0x7f12240fb220 msgr2=0x7f1224067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.371+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 shutdown_connections 2023-09-13T09:41:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.371+0000 7f122bfd4700 1 -- 172.21.15.6:0/4166946389 wait complete. 2023-09-13T09:41:16.373 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 29 2023-09-13T09:41:16.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:41:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4055760538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81041d0 msgr2=0x7f7ef81065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4055760538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81041d0 0x7f7ef81065c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0009990 tx=0x7f7ee0009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4055760538 shutdown_connections 2023-09-13T09:41:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4055760538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef8106b00 0x7f7ef8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4055760538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef81018a0 0x7f7ef8103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4055760538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81041d0 0x7f7ef81065c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4055760538 >> 172.21.15.6:0/4055760538 conn(0x7f7ef80fb250 msgr2=0x7f7ef80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4055760538 shutdown_connections 2023-09-13T09:41:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.510+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4055760538 wait complete. 2023-09-13T09:41:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 Processor -- start 2023-09-13T09:41:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 -- start start 2023-09-13T09:41:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81018a0 0x7f7ef8101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef81041d0 0x7f7ef80ff850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef8106b00 0x7f7ef80ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef819a910 con 0x7f7ef81018a0 2023-09-13T09:41:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef81002d0 con 0x7f7ef8106b00 2023-09-13T09:41:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7efe1bd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef8100490 con 0x7f7ef81041d0 2023-09-13T09:41:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7ef77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81018a0 0x7f7ef8101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7ef77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81018a0 0x7f7ef8101210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34818/0 (socket says 172.21.15.6:34818) 2023-09-13T09:41:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4282356062 learned_addr learned my addr 172.21.15.6:0/4282356062 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef81041d0 0x7f7ef80ff850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.511+0000 7f7ef7fff700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef8106b00 0x7f7ef80ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4282356062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef81041d0 msgr2=0x7f7ef80ff850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef81041d0 0x7f7ef80ff850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4282356062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef8106b00 msgr2=0x7f7ef80ffd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef8106b00 0x7f7ef80ffd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4282356062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee00095f0 con 0x7f7ef81018a0 2023-09-13T09:41:16.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81018a0 0x7f7ef8101210 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800d950 tx=0x7f7ee800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef4ff9700 1 -- 172.21.15.6:0/4282356062 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800f890 con 0x7f7ef81018a0 2023-09-13T09:41:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef4ff9700 1 -- 172.21.15.6:0/4282356062 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ee8010460 con 0x7f7ef81018a0 2023-09-13T09:41:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef81a52c0 con 0x7f7ef81018a0 2023-09-13T09:41:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7ef4ff9700 1 -- 172.21.15.6:0/4282356062 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800e610 con 0x7f7ef81018a0 2023-09-13T09:41:16.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.512+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef81a56e0 con 0x7f7ef81018a0 2023-09-13T09:41:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.515+0000 7f7ef4ff9700 1 -- 172.21.15.6:0/4282356062 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7ee80108d0 con 0x7f7ef81018a0 2023-09-13T09:41:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.515+0000 7f7ef4ff9700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ee40a0640 0x7f7ee40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.515+0000 7f7f0a3a2b80 1 Processor -- start 2023-09-13T09:41:16.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.515+0000 7f7ef4ff9700 1 -- 172.21.15.6:0/4282356062 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ee80cb5e0 con 0x7f7ef81018a0 2023-09-13T09:41:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.515+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ee40a0640 0x7f7ee40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.515+0000 7f7f0a3a2b80 1 -- start start 2023-09-13T09:41:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6b700 0x556919c6bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6c060 0x556919c6a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6aa00 0x556919c6ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919bc3780 con 0x556919c6c060 2023-09-13T09:41:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919bc10a0 con 0x556919c6aa00 2023-09-13T09:41:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919bbc990 con 0x556919c6b700 2023-09-13T09:41:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6c060 0x556919c6a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6c060 0x556919c6a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34828/0 (socket says 172.21.15.6:34828) 2023-09-13T09:41:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1975589150 learned_addr learned my addr 172.21.15.6:0/1975589150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ee40a0640 0x7f7ee40a2b00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b2e0 tx=0x7f7ee000b950 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6b700 0x556919c6bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef7fff700 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6aa00 0x556919c6ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1975589150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6b700 msgr2=0x556919c6bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6b700 0x556919c6bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1975589150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6aa00 msgr2=0x556919c6ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6aa00 0x556919c6ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1975589150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556919a3c630 con 0x556919c6c060 2023-09-13T09:41:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6c060 0x556919c6a4c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0015000 tx=0x7f7ee0028000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c745fcb46a8ec692 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7eedffb700 1 -- 172.21.15.6:0/1975589150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0004600 con 0x556919c6c060 2023-09-13T09:41:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7eedffb700 1 -- 172.21.15.6:0/1975589150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ee001e040 con 0x556919c6c060 2023-09-13T09:41:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.516+0000 7f7eedffb700 1 -- 172.21.15.6:0/1975589150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee002fc20 con 0x556919c6c060 2023-09-13T09:41:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1975589150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6c060 msgr2=0x556919c6a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6c060 0x556919c6a4c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f7ee0015000 tx=0x7f7ee0028000 comp rx=0 tx=0).stop 2023-09-13T09:41:16.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1975589150 shutdown_connections 2023-09-13T09:41:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6aa00 0x556919c6ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6b700 0x556919c6bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1975589150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6c060 0x556919c6a4c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1975589150 >> 172.21.15.6:0/1975589150 conn(0x556919bc8c80 msgr2=0x556919c64f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1975589150 shutdown_connections 2023-09-13T09:41:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1975589150 wait complete. 2023-09-13T09:41:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.517+0000 7f7f0a3a2b80 1 -- start start 2023-09-13T09:41:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 1 Processor -- start 2023-09-13T09:41:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c73da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c742e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c7b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919b5abb0 con 0x556919c6aa00 2023-09-13T09:41:16.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919b5a8b0 con 0x556919c6b700 2023-09-13T09:41:16.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919a3e920 con 0x556919c6c060 2023-09-13T09:41:16.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7f0a3a2b80 10 client.0 _ll_register_callbacks cb 0x556919b58680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:16.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c73da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c73da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34832/0 (socket says 172.21.15.6:34832) 2023-09-13T09:41:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4126442599 learned_addr learned my addr 172.21.15.6:0/4126442599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef7fff700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c7b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4126442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 msgr2=0x556919c7b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c7b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 msgr2=0x556919c742e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c742e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef77fe700 1 -- 172.21.15.6:0/4126442599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef8109b00 con 0x556919c6aa00 2023-09-13T09:41:16.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.518+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c73da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80c9090 tx=0x7f7ee8098e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2828c7ae7a35772 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ed6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/4126442599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8017460 con 0x556919c6aa00 2023-09-13T09:41:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/4126442599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ee8098fe0 con 0x556919c6aa00 2023-09-13T09:41:16.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556919c5d670 con 0x556919c6aa00 2023-09-13T09:41:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/4126442599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ee80991a0 con 0x556919c6aa00 2023-09-13T09:41:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 10 client.15819 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556919bd47a0 con 0x556919c6aa00 2023-09-13T09:41:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/4126442599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556919c5d670 con 0x556919c6aa00 2023-09-13T09:41:16.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/4126442599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7ee80a0960 con 0x556919c6aa00 2023-09-13T09:41:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 10 client.15819 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 10 client.15819 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:41:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 20 client.15819 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919c7fb00 0x556919c81f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 4 client.15819 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556919bb5970 con 0x556919c7fb00 2023-09-13T09:41:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.519+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919c7fb00 0x556919c81f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.520+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919c7fb00 0x556919c81f20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ff4ccbe9188f4602 server_cookie=c2c3de8e878498f6 in_seq=0 out_seq=0 2023-09-13T09:41:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.520+0000 7f7ed6ffd700 10 client.15819 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:16.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/4126442599 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556919bb5970 con 0x556919c7fb00 2023-09-13T09:41:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7ed6ffd700 10 client.15819 handle_command_reply: tid=0 2023-09-13T09:41:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 client.15819 shutdown 2023-09-13T09:41:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 msgr2=0x556919c73da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c73da0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f7ee80c9090 tx=0x7f7ee8098e30 comp rx=0 tx=0).stop 2023-09-13T09:41:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 shutdown_connections 2023-09-13T09:41:16.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919c7fb00 0x556919c81f20 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c7b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c73da0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/4126442599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c742e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7ed6ffd700 0 client.15819 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:16.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 >> 172.21.15.6:0/4126442599 conn(0x556919bc8c80 msgr2=0x556919c5f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 shutdown_connections 2023-09-13T09:41:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/4126442599 wait complete. 2023-09-13T09:41:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.521+0000 7f7f0a3a2b80 20 client.15819 trim_cache size 0 max 16384 2023-09-13T09:41:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 Processor -- start 2023-09-13T09:41:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 -- start start 2023-09-13T09:41:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c6a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c7b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c6e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919c72640 con 0x556919c6aa00 2023-09-13T09:41:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919c71b60 con 0x556919c6b700 2023-09-13T09:41:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919c6f450 con 0x556919c6c060 2023-09-13T09:41:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7ef77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c6a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7ef77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c6a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34840/0 (socket says 172.21.15.6:34840) 2023-09-13T09:41:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7ef77fe700 1 -- 172.21.15.6:0/452732247 learned_addr learned my addr 172.21.15.6:0/452732247 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.534+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c7b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7ef7fff700 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c6e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7ef77fe700 1 -- 172.21.15.6:0/452732247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 msgr2=0x556919c6e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c6e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7ef77fe700 1 -- 172.21.15.6:0/452732247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 msgr2=0x556919c7b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c7b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7ef77fe700 1 -- 172.21.15.6:0/452732247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569199e8de0 con 0x556919c6aa00 2023-09-13T09:41:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c6a4c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8098d10 tx=0x7f7ee8097330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=730c12e0ef28564b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7eee7fc700 1 -- 172.21.15.6:0/452732247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80a0b60 con 0x556919c6aa00 2023-09-13T09:41:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7eee7fc700 1 -- 172.21.15.6:0/452732247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ee8094c90 con 0x556919c6aa00 2023-09-13T09:41:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7eee7fc700 1 -- 172.21.15.6:0/452732247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8098fe0 con 0x556919c6aa00 2023-09-13T09:41:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/452732247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 msgr2=0x556919c6a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.535+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c6a4c0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f7ee8098d10 tx=0x7f7ee8097330 comp rx=0 tx=0).stop 2023-09-13T09:41:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/452732247 shutdown_connections 2023-09-13T09:41:16.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6c060 0x556919c6e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6aa00 0x556919c6a4c0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/452732247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6b700 0x556919c7b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/452732247 >> 172.21.15.6:0/452732247 conn(0x556919bc8c80 msgr2=0x556919c64e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/452732247 shutdown_connections 2023-09-13T09:41:16.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/452732247 wait complete. 2023-09-13T09:41:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- start start 2023-09-13T09:41:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 Processor -- start 2023-09-13T09:41:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6aa00 0x556919c774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6b700 0x556919c779e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6c060 0x556919c7aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919c7af40 con 0x556919c6b700 2023-09-13T09:41:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919c7b0b0 con 0x556919c6c060 2023-09-13T09:41:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556919c7b270 con 0x556919c6aa00 2023-09-13T09:41:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7f0a3a2b80 10 client.0 _ll_register_callbacks cb 0x556919b58680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7ef6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6b700 0x556919c779e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.536+0000 7f7ef6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6b700 0x556919c779e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34848/0 (socket says 172.21.15.6:34848) 2023-09-13T09:41:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1303331542 learned_addr learned my addr 172.21.15.6:0/1303331542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef7fff700 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6c060 0x556919c7aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6aa00 0x556919c774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1303331542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6aa00 msgr2=0x556919c774a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6aa00 0x556919c774a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6c060 msgr2=0x556919c7aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6c060 0x556919c7aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef6ffd700 1 -- 172.21.15.6:0/1303331542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556919bd47a0 con 0x556919c6b700 2023-09-13T09:41:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ef6ffd700 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6b700 0x556919c779e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00098e0 tx=0x7f7ee00058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5d3e39c7cbba870 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ed6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/1303331542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee00403c0 con 0x556919c6b700 2023-09-13T09:41:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/1303331542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ee0040520 con 0x556919c6b700 2023-09-13T09:41:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ee001e040 con 0x556919c6b700 2023-09-13T09:41:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/1303331542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ee002fa60 con 0x556919c6b700 2023-09-13T09:41:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7f0a3a2b80 10 client.15825 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.537+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5569199d1c60 con 0x556919c6b700 2023-09-13T09:41:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/1303331542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ee001e040 con 0x556919c6b700 2023-09-13T09:41:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/1303331542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7ee0049070 con 0x556919c6b700 2023-09-13T09:41:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7f0a3a2b80 10 client.15825 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7f0a3a2b80 10 client.15825 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:41:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7f0a3a2b80 20 client.15825 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919cd47e0 0x556919cd6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7f0a3a2b80 4 client.15825 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556919b76050 con 0x556919cd47e0 2023-09-13T09:41:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.538+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919cd47e0 0x556919cd6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7ef77fe700 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919cd47e0 0x556919cd6bd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=560a4a10a2e1391f server_cookie=b02da6fb49a7b91b in_seq=0 out_seq=0 2023-09-13T09:41:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7ed6ffd700 10 client.15825 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7ed6ffd700 1 -- 172.21.15.6:0/1303331542 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556919b76050 con 0x556919cd47e0 2023-09-13T09:41:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7ed6ffd700 10 client.15825 handle_command_reply: tid=0 2023-09-13T09:41:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 client.15825 shutdown 2023-09-13T09:41:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6b700 msgr2=0x556919c779e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6b700 0x556919c779e0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7ee00098e0 tx=0x7f7ee00058e0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 shutdown_connections 2023-09-13T09:41:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556919cd47e0 0x556919cd6bd0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556919c6c060 0x556919c7aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556919c6aa00 0x556919c774a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7ed6ffd700 0 client.15825 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 --2- 172.21.15.6:0/1303331542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556919c6b700 0x556919c779e0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 >> 172.21.15.6:0/1303331542 conn(0x556919bc8c80 msgr2=0x556919c6e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 shutdown_connections 2023-09-13T09:41:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 1 -- 172.21.15.6:0/1303331542 wait complete. 2023-09-13T09:41:16.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.539+0000 7f7f0a3a2b80 20 client.15825 trim_cache size 0 max 16384 2023-09-13T09:41:16.563 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ee40a0640 msgr2=0x7f7ee40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ee40a0640 0x7f7ee40a2b00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b2e0 tx=0x7f7ee000b950 comp rx=0 tx=0).stop 2023-09-13T09:41:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81018a0 msgr2=0x7f7ef8101210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81018a0 0x7f7ef8101210 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800d950 tx=0x7f7ee800dc60 comp rx=0 tx=0).stop 2023-09-13T09:41:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 shutdown_connections 2023-09-13T09:41:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ef8106b00 0x7f7ef80ffd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7ee40a0640 0x7f7ee40a2b00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ef81018a0 0x7f7ef8101210 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 --2- 172.21.15.6:0/4282356062 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ef81041d0 0x7f7ef80ff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 >> 172.21.15.6:0/4282356062 conn(0x7f7ef80fb250 msgr2=0x7f7ef8102570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 shutdown_connections 2023-09-13T09:41:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.540+0000 7f7efe1bd700 1 -- 172.21.15.6:0/4282356062 wait complete. 2023-09-13T09:41:16.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:41:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/1456641528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840ffcc0 msgr2=0x7f8c841000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/1456641528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840ffcc0 0x7f8c841000e0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f8c740099c0 tx=0x7f8c74009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/1456641528 shutdown_connections 2023-09-13T09:41:16.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/1456641528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c84101850 0x7f8c84108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/1456641528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c840ffcc0 0x7f8c841000e0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/1456641528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c84100eb0 0x7f8c84101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/1456641528 >> 172.21.15.6:0/1456641528 conn(0x7f8c840fb250 msgr2=0x7f8c840fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/1456641528 shutdown_connections 2023-09-13T09:41:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.694+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/1456641528 wait complete. 2023-09-13T09:41:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 Processor -- start 2023-09-13T09:41:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 -- start start 2023-09-13T09:41:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c840ffcc0 0x7f8c841959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c84100eb0 0x7f8c84195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c84101850 0x7f8c8419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8419d550 con 0x7f8c84100eb0 2023-09-13T09:41:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8419d690 con 0x7f8c840ffcc0 2023-09-13T09:41:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c8b2f9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8419d820 con 0x7f8c84101850 2023-09-13T09:41:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c88894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c84100eb0 0x7f8c84195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c88894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c84100eb0 0x7f8c84195f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34860/0 (socket says 172.21.15.6:34860) 2023-09-13T09:41:16.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.695+0000 7f8c88894700 1 -- 172.21.15.6:0/3239760423 learned_addr learned my addr 172.21.15.6:0/3239760423 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c89095700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c840ffcc0 0x7f8c841959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c89896700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c84101850 0x7f8c8419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c88894700 1 -- 172.21.15.6:0/3239760423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c84101850 msgr2=0x7f8c8419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c88894700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c84101850 0x7f8c8419cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c88894700 1 -- 172.21.15.6:0/3239760423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c840ffcc0 msgr2=0x7f8c841959d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c88894700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c840ffcc0 0x7f8c841959d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c88894700 1 -- 172.21.15.6:0/3239760423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c740095f0 con 0x7f8c84100eb0 2023-09-13T09:41:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c89095700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c840ffcc0 0x7f8c841959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c88894700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c84100eb0 0x7f8c84195f10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000d980 tx=0x7f8c8000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/3239760423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8000bb60 con 0x7f8c84100eb0 2023-09-13T09:41:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/3239760423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c80007640 con 0x7f8c84100eb0 2023-09-13T09:41:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/3239760423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c80004e90 con 0x7f8c84100eb0 2023-09-13T09:41:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c8419db00 con 0x7f8c84100eb0 2023-09-13T09:41:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.696+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c8419e010 con 0x7f8c84100eb0 2023-09-13T09:41:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.698+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/3239760423 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8c8000bcc0 con 0x7f8c84100eb0 2023-09-13T09:41:16.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.699+0000 7f8c7a7fc700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c700a06c0 0x7f8c700a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.699+0000 7f8c7a7fc700 1 -- 172.21.15.6:0/3239760423 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8c800cba70 con 0x7f8c84100eb0 2023-09-13T09:41:16.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.699+0000 7f8c89095700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c700a06c0 0x7f8c700a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c89095700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c700a06c0 0x7f8c700a2b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b580 tx=0x7f8c74005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 Processor -- start 2023-09-13T09:41:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 -- start start 2023-09-13T09:41:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf80ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf81010 0x5568ecf81490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf819d0 0x5568ecf81e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eced9780 con 0x5568ecf806b0 2023-09-13T09:41:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eced70a0 con 0x5568ecf81010 2023-09-13T09:41:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c974deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568eced2990 con 0x5568ecf819d0 2023-09-13T09:41:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c89095700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf80ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c89095700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf80ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34866/0 (socket says 172.21.15.6:34866) 2023-09-13T09:41:16.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c89095700 1 -- 172.21.15.6:0/2300317080 learned_addr learned my addr 172.21.15.6:0/2300317080 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c88894700 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf81010 0x5568ecf81490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.700+0000 7f8c89896700 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf819d0 0x5568ecf81e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c89095700 1 -- 172.21.15.6:0/2300317080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf819d0 msgr2=0x5568ecf81e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c89095700 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf819d0 0x5568ecf81e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c89095700 1 -- 172.21.15.6:0/2300317080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf81010 msgr2=0x5568ecf81490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c89095700 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf81010 0x5568ecf81490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c89095700 1 -- 172.21.15.6:0/2300317080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568ecd52630 con 0x5568ecf806b0 2023-09-13T09:41:16.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c89896700 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf819d0 0x5568ecf81e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:16.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c89095700 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf80ad0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8c74000c00 tx=0x7f8c7401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7de217f315d6baf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c6f7fe700 1 -- 172.21.15.6:0/2300317080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7402b070 con 0x5568ecf806b0 2023-09-13T09:41:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c6f7fe700 1 -- 172.21.15.6:0/2300317080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c7401e040 con 0x5568ecf806b0 2023-09-13T09:41:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.701+0000 7f8c6f7fe700 1 -- 172.21.15.6:0/2300317080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74004b50 con 0x5568ecf806b0 2023-09-13T09:41:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 -- 172.21.15.6:0/2300317080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 msgr2=0x5568ecf80ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf80ad0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f8c74000c00 tx=0x7f8c7401f000 comp rx=0 tx=0).stop 2023-09-13T09:41:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 -- 172.21.15.6:0/2300317080 shutdown_connections 2023-09-13T09:41:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf819d0 0x5568ecf81e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf80ad0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2300317080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf81010 0x5568ecf81490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 -- 172.21.15.6:0/2300317080 >> 172.21.15.6:0/2300317080 conn(0x5568ecedec80 msgr2=0x5568ecf7af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 -- 172.21.15.6:0/2300317080 shutdown_connections 2023-09-13T09:41:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 -- 172.21.15.6:0/2300317080 wait complete. 2023-09-13T09:41:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 -- start start 2023-09-13T09:41:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.702+0000 7f8c974deb80 1 Processor -- start 2023-09-13T09:41:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf8e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf8e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf95860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c974deb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ece70bb0 con 0x5568ecf81010 2023-09-13T09:41:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c974deb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ece708b0 con 0x5568ecf819d0 2023-09-13T09:41:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c974deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ecd54920 con 0x5568ecf806b0 2023-09-13T09:41:16.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c974deb80 10 client.0 _ll_register_callbacks cb 0x5568ece6e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf8e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf8e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34874/0 (socket says 172.21.15.6:34874) 2023-09-13T09:41:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 -- 172.21.15.6:0/2827965725 learned_addr learned my addr 172.21.15.6:0/2827965725 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c89896700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf95860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c89095700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf8e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 -- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 msgr2=0x5568ecf8e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf8e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 -- 172.21.15.6:0/2827965725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 msgr2=0x5568ecf95860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf95860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 -- 172.21.15.6:0/2827965725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c84108a50 con 0x5568ecf81010 2023-09-13T09:41:16.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c89095700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf8e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c88894700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf8e820 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b540 tx=0x7f8c800992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9efb8356a916be1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.703+0000 7f8c6cff9700 1 -- 172.21.15.6:0/2827965725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800986a0 con 0x5568ecf81010 2023-09-13T09:41:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c6cff9700 1 -- 172.21.15.6:0/2827965725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8c80098800 con 0x5568ecf81010 2023-09-13T09:41:16.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568ecf73670 con 0x5568ecf81010 2023-09-13T09:41:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c6cff9700 1 -- 172.21.15.6:0/2827965725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c800b71f0 con 0x5568ecf81010 2023-09-13T09:41:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 10 client.15837 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5568eceea7a0 con 0x5568ecf81010 2023-09-13T09:41:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c6cff9700 1 -- 172.21.15.6:0/2827965725 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568ecf73670 con 0x5568ecf81010 2023-09-13T09:41:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c6cff9700 1 -- 172.21.15.6:0/2827965725 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8c800b1340 con 0x5568ecf81010 2023-09-13T09:41:16.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 10 client.15837 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 10 client.15837 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:41:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 20 client.15837 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecf9a0b0 0x5568ecf9c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 4 client.15837 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:16.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568ececb970 con 0x5568ecf9a0b0 2023-09-13T09:41:16.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.704+0000 7f8c89095700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecf9a0b0 0x5568ecf9c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.705+0000 7f8c6cff9700 10 client.15837 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:16.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.705+0000 7f8c89095700 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecf9a0b0 0x5568ecf9c4d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1eba4123b12ca194 server_cookie=e2f0a54f3e2af0c1 in_seq=0 out_seq=0 2023-09-13T09:41:16.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.705+0000 7f8c6cff9700 1 -- 172.21.15.6:0/2827965725 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5568ececb970 con 0x5568ecf9a0b0 2023-09-13T09:41:16.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.705+0000 7f8c6cff9700 10 client.15837 handle_command_reply: tid=0 2023-09-13T09:41:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 client.15837 shutdown 2023-09-13T09:41:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 msgr2=0x5568ecf8e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf8e820 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000b540 tx=0x7f8c800992e0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 shutdown_connections 2023-09-13T09:41:16.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecf9a0b0 0x5568ecf9c4d0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf95860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf8e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c6cff9700 0 client.15837 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 --2- 172.21.15.6:0/2827965725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf8e820 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 >> 172.21.15.6:0/2827965725 conn(0x5568ecedec80 msgr2=0x5568ecf757f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 shutdown_connections 2023-09-13T09:41:16.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 1 -- 172.21.15.6:0/2827965725 wait complete. 2023-09-13T09:41:16.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.706+0000 7f8c974deb80 20 client.15837 trim_cache size 0 max 16384 2023-09-13T09:41:16.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 Processor -- start 2023-09-13T09:41:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 -- start start 2023-09-13T09:41:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf88fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf81010 0x5568ecf95820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf89520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ecf99bd0 con 0x5568ecf806b0 2023-09-13T09:41:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ecf8cd40 con 0x5568ecf819d0 2023-09-13T09:41:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c974deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ecf7b9f0 con 0x5568ecf81010 2023-09-13T09:41:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf88fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf88fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34880/0 (socket says 172.21.15.6:34880) 2023-09-13T09:41:16.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 -- 172.21.15.6:0/3233892355 learned_addr learned my addr 172.21.15.6:0/3233892355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c88894700 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf81010 0x5568ecf95820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 -- 172.21.15.6:0/3233892355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf81010 msgr2=0x5568ecf95820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf81010 0x5568ecf95820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89896700 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf89520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 -- 172.21.15.6:0/3233892355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 msgr2=0x5568ecf89520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf89520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.719+0000 7f8c89095700 1 -- 172.21.15.6:0/3233892355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568eccfede0 con 0x5568ecf806b0 2023-09-13T09:41:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c89095700 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf88fe0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8c74000c00 tx=0x7f8c74022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6998a153a0d6126 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c6ffff700 1 -- 172.21.15.6:0/3233892355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7402b030 con 0x5568ecf806b0 2023-09-13T09:41:16.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c6ffff700 1 -- 172.21.15.6:0/3233892355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c7402c040 con 0x5568ecf806b0 2023-09-13T09:41:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c6ffff700 1 -- 172.21.15.6:0/3233892355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c74035040 con 0x5568ecf806b0 2023-09-13T09:41:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 -- 172.21.15.6:0/3233892355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 msgr2=0x5568ecf88fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf88fe0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f8c74000c00 tx=0x7f8c74022000 comp rx=0 tx=0).stop 2023-09-13T09:41:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 -- 172.21.15.6:0/3233892355 shutdown_connections 2023-09-13T09:41:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf89520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf806b0 0x5568ecf88fe0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 --2- 172.21.15.6:0/3233892355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf81010 0x5568ecf95820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 -- 172.21.15.6:0/3233892355 >> 172.21.15.6:0/3233892355 conn(0x5568ecedec80 msgr2=0x5568ecf8cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 -- 172.21.15.6:0/3233892355 shutdown_connections 2023-09-13T09:41:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.720+0000 7f8c974deb80 1 -- 172.21.15.6:0/3233892355 wait complete. 2023-09-13T09:41:16.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 -- start start 2023-09-13T09:41:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 Processor -- start 2023-09-13T09:41:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf91560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf91aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf94ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ecf95000 con 0x5568ecf81010 2023-09-13T09:41:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ecf95170 con 0x5568ecf819d0 2023-09-13T09:41:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568ecf95330 con 0x5568ecf806b0 2023-09-13T09:41:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c974deb80 10 client.0 _ll_register_callbacks cb 0x5568ecf7b570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c88894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf91aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c88894700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf91aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34888/0 (socket says 172.21.15.6:34888) 2023-09-13T09:41:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c88894700 1 -- 172.21.15.6:0/1239127726 learned_addr learned my addr 172.21.15.6:0/1239127726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c89095700 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf91560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.721+0000 7f8c89896700 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf94ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c88894700 1 -- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 msgr2=0x5568ecf91560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c88894700 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf91560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c88894700 1 -- 172.21.15.6:0/1239127726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 msgr2=0x5568ecf94ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c88894700 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf94ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c88894700 1 -- 172.21.15.6:0/1239127726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568ecd52630 con 0x5568ecf81010 2023-09-13T09:41:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c88894700 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf91aa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8c80099a60 tx=0x7f8c800048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fc13b5a4f4df4c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c6cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c6cff9700 1 -- 172.21.15.6:0/1239127726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c800b1420 con 0x5568ecf81010 2023-09-13T09:41:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c6cff9700 1 -- 172.21.15.6:0/1239127726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8c800b7030 con 0x5568ecf81010 2023-09-13T09:41:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c7401e040 con 0x5568ecf81010 2023-09-13T09:41:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c6cff9700 1 -- 172.21.15.6:0/1239127726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c800b71f0 con 0x5568ecf81010 2023-09-13T09:41:16.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 10 client.15843 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x5568ecce7c60 con 0x5568ecf81010 2023-09-13T09:41:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c6cff9700 1 -- 172.21.15.6:0/1239127726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c7401e040 con 0x5568ecf81010 2023-09-13T09:41:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c6cff9700 1 -- 172.21.15.6:0/1239127726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f8c80098110 con 0x5568ecf81010 2023-09-13T09:41:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 10 client.15843 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:16.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 10 client.15843 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:41:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 20 client.15843 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecfeeb90 0x5568ecff0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 4 client.15843 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.722+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5568ece8c050 con 0x5568ecfeeb90 2023-09-13T09:41:16.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.723+0000 7f8c89095700 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecfeeb90 0x5568ecff0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.723+0000 7f8c6cff9700 10 client.15843 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.723+0000 7f8c89095700 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecfeeb90 0x5568ecff0fb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=11a82a49a8402982 server_cookie=17f28d210a5508c1 in_seq=0 out_seq=0 2023-09-13T09:41:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.723+0000 7f8c6cff9700 1 -- 172.21.15.6:0/1239127726 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5568ece8c050 con 0x5568ecfeeb90 2023-09-13T09:41:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.723+0000 7f8c6cff9700 10 client.15843 handle_command_reply: tid=0 2023-09-13T09:41:16.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.723+0000 7f8c974deb80 1 client.15843 shutdown 2023-09-13T09:41:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 msgr2=0x5568ecf91aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf91aa0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8c80099a60 tx=0x7f8c800048a0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 shutdown_connections 2023-09-13T09:41:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5568ecfeeb90 0x5568ecff0fb0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568ecf819d0 0x5568ecf94ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c6cff9700 0 client.15843 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568ecf806b0 0x5568ecf91560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 --2- 172.21.15.6:0/1239127726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568ecf81010 0x5568ecf91aa0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 >> 172.21.15.6:0/1239127726 conn(0x5568ecedec80 msgr2=0x5568ecf88fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 shutdown_connections 2023-09-13T09:41:16.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 1 -- 172.21.15.6:0/1239127726 wait complete. 2023-09-13T09:41:16.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c974deb80 20 client.15843 trim_cache size 0 max 16384 2023-09-13T09:41:16.751 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:16.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c700a06c0 msgr2=0x7f8c700a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c700a06c0 0x7f8c700a2b80 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400b580 tx=0x7f8c74005fb0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c84100eb0 msgr2=0x7f8c84195f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c84100eb0 0x7f8c84195f10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f8c8000d980 tx=0x7f8c8000dd40 comp rx=0 tx=0).stop 2023-09-13T09:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 shutdown_connections 2023-09-13T09:41:16.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c84101850 0x7f8c8419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c840ffcc0 0x7f8c841959d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c700a06c0 0x7f8c700a2b80 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 --2- 172.21.15.6:0/3239760423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c84100eb0 0x7f8c84195f10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.724+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 >> 172.21.15.6:0/3239760423 conn(0x7f8c840fb250 msgr2=0x7f8c841043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.725+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 shutdown_connections 2023-09-13T09:41:16.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.725+0000 7f8c8b2f9700 1 -- 172.21.15.6:0/3239760423 wait complete. 2023-09-13T09:41:16.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:41:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 -- 172.21.15.6:0/108150884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60100eb0 msgr2=0x7fdc60101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/108150884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60100eb0 0x7fdc60101310 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fdc540099c0 tx=0x7fdc54009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 -- 172.21.15.6:0/108150884 shutdown_connections 2023-09-13T09:41:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/108150884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60101850 0x7fdc60108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/108150884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffcc0 0x7fdc601000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/108150884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60100eb0 0x7fdc60101310 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 -- 172.21.15.6:0/108150884 >> 172.21.15.6:0/108150884 conn(0x7fdc600fb250 msgr2=0x7fdc600fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 -- 172.21.15.6:0/108150884 shutdown_connections 2023-09-13T09:41:16.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.884+0000 7fdc65cf7700 1 -- 172.21.15.6:0/108150884 wait complete. 2023-09-13T09:41:16.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 Processor -- start 2023-09-13T09:41:16.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 -- start start 2023-09-13T09:41:16.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc600ffcc0 0x7fdc60196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60100eb0 0x7fdc60196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101850 0x7fdc6019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6019e590 con 0x7fdc60101850 2023-09-13T09:41:16.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6019e6d0 con 0x7fdc600ffcc0 2023-09-13T09:41:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc65cf7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6019e860 con 0x7fdc60100eb0 2023-09-13T09:41:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc5ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101850 0x7fdc6019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.885+0000 7fdc5ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101850 0x7fdc6019dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34902/0 (socket says 172.21.15.6:34902) 2023-09-13T09:41:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5ffff700 1 -- 172.21.15.6:0/4234887484 learned_addr learned my addr 172.21.15.6:0/4234887484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5effd700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60100eb0 0x7fdc60196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc600ffcc0 0x7fdc60196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5ffff700 1 -- 172.21.15.6:0/4234887484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60100eb0 msgr2=0x7fdc60196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60100eb0 0x7fdc60196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5ffff700 1 -- 172.21.15.6:0/4234887484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc600ffcc0 msgr2=0x7fdc60196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc600ffcc0 0x7fdc60196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5ffff700 1 -- 172.21.15.6:0/4234887484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc540095f0 con 0x7fdc60101850 2023-09-13T09:41:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101850 0x7fdc6019dfc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007d70 tx=0x7fdc5800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5cff9700 1 -- 172.21.15.6:0/4234887484 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800ac90 con 0x7fdc60101850 2023-09-13T09:41:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc6019eb40 con 0x7fdc60101850 2023-09-13T09:41:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5cff9700 1 -- 172.21.15.6:0/4234887484 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc5800adf0 con 0x7fdc60101850 2023-09-13T09:41:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc5cff9700 1 -- 172.21.15.6:0/4234887484 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580115e0 con 0x7fdc60101850 2023-09-13T09:41:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.886+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6019f000 con 0x7fdc60101850 2023-09-13T09:41:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.889+0000 7fdc5cff9700 1 -- 172.21.15.6:0/4234887484 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdc58012420 con 0x7fdc60101850 2023-09-13T09:41:16.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc5cff9700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc5cff9700 1 -- 172.21.15.6:0/4234887484 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc580cbe50 con 0x7fdc60101850 2023-09-13T09:41:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 Processor -- start 2023-09-13T09:41:16.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 -- start start 2023-09-13T09:41:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc60100d10 tx=0x7fdc5000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f325700 0x561b0f325b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f326060 0x561b0f3244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f324e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f27d780 con 0x561b0f326060 2023-09-13T09:41:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f27b0a0 con 0x561b0f324a00 2023-09-13T09:41:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.890+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f276990 con 0x561b0f325700 2023-09-13T09:41:16.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f326060 0x561b0f3244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f326060 0x561b0f3244c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34908/0 (socket says 172.21.15.6:34908) 2023-09-13T09:41:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 -- 172.21.15.6:0/2059748159 learned_addr learned my addr 172.21.15.6:0/2059748159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f324e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f325700 0x561b0f325b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 -- 172.21.15.6:0/2059748159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f325700 msgr2=0x561b0f325b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f325700 0x561b0f325b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 -- 172.21.15.6:0/2059748159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 msgr2=0x561b0f324e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f324e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 -- 172.21.15.6:0/2059748159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b0f0f6630 con 0x561b0f326060 2023-09-13T09:41:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc5effd700 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f326060 0x561b0f3244c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdc540099c0 tx=0x7fdc54005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d4d880be509403e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc45ffb700 1 -- 172.21.15.6:0/2059748159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5401d070 con 0x561b0f326060 2023-09-13T09:41:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc45ffb700 1 -- 172.21.15.6:0/2059748159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc5401e040 con 0x561b0f326060 2023-09-13T09:41:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.891+0000 7fdc45ffb700 1 -- 172.21.15.6:0/2059748159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54003b00 con 0x561b0f326060 2023-09-13T09:41:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 -- 172.21.15.6:0/2059748159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f326060 msgr2=0x561b0f3244c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f326060 0x561b0f3244c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fdc540099c0 tx=0x7fdc54005040 comp rx=0 tx=0).stop 2023-09-13T09:41:16.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 -- 172.21.15.6:0/2059748159 shutdown_connections 2023-09-13T09:41:16.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f324e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f325700 0x561b0f325b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/2059748159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f326060 0x561b0f3244c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 -- 172.21.15.6:0/2059748159 >> 172.21.15.6:0/2059748159 conn(0x561b0f282c80 msgr2=0x561b0f31ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 -- 172.21.15.6:0/2059748159 shutdown_connections 2023-09-13T09:41:16.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 -- 172.21.15.6:0/2059748159 wait complete. 2023-09-13T09:41:16.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.892+0000 7fdc71edcb80 1 -- start start 2023-09-13T09:41:16.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 1 Processor -- start 2023-09-13T09:41:16.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f324a00 0x561b0f32de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f32e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f326060 0x561b0f3353f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f214bb0 con 0x561b0f324a00 2023-09-13T09:41:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f2148b0 con 0x561b0f325700 2023-09-13T09:41:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f0f8920 con 0x561b0f326060 2023-09-13T09:41:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc71edcb80 10 client.0 _ll_register_callbacks cb 0x561b0f212680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f324a00 0x561b0f32de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f324a00 0x561b0f32de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34912/0 (socket says 172.21.15.6:34912) 2023-09-13T09:41:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3791958567 learned_addr learned my addr 172.21.15.6:0/3791958567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f326060 0x561b0f3353f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f32e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3791958567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f326060 msgr2=0x561b0f3353f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f326060 0x561b0f3353f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 msgr2=0x561b0f32e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f32e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3791958567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc60108a50 con 0x561b0f324a00 2023-09-13T09:41:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f32e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f326060 0x561b0f3353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f324a00 0x561b0f32de70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdc5001d9c0 tx=0x7fdc500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee245f61f3567ebd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.893+0000 7fdc3effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc3effd700 1 -- 172.21.15.6:0/3791958567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50010840 con 0x561b0f324a00 2023-09-13T09:41:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc3effd700 1 -- 172.21.15.6:0/3791958567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc500109a0 con 0x561b0f324a00 2023-09-13T09:41:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561b0f317670 con 0x561b0f324a00 2023-09-13T09:41:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc3effd700 1 -- 172.21.15.6:0/3791958567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc50010b60 con 0x561b0f324a00 2023-09-13T09:41:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 10 client.15855 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561b0f28e7a0 con 0x561b0f324a00 2023-09-13T09:41:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc3effd700 1 -- 172.21.15.6:0/3791958567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561b0f317670 con 0x561b0f324a00 2023-09-13T09:41:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc3effd700 1 -- 172.21.15.6:0/3791958567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fdc500313e0 con 0x561b0f324a00 2023-09-13T09:41:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 10 client.15855 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 10 client.15855 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:41:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 20 client.15855 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f339dd0 0x561b0f33c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 4 client.15855 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.894+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561b0f26f970 con 0x561b0f339dd0 2023-09-13T09:41:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.895+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f339dd0 0x561b0f33c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.895+0000 7fdc3effd700 10 client.15855 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.895+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f339dd0 0x561b0f33c1f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b529d071c3c35df9 server_cookie=d0762c89baf6a290 in_seq=0 out_seq=0 2023-09-13T09:41:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc3effd700 1 -- 172.21.15.6:0/3791958567 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561b0f26f970 con 0x561b0f339dd0 2023-09-13T09:41:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc3effd700 10 client.15855 handle_command_reply: tid=0 2023-09-13T09:41:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 client.15855 shutdown 2023-09-13T09:41:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f324a00 msgr2=0x561b0f32de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f324a00 0x561b0f32de70 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdc5001d9c0 tx=0x7fdc500047c0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 shutdown_connections 2023-09-13T09:41:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f339dd0 0x561b0f33c1f0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f326060 0x561b0f3353f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc3effd700 0 client.15855 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f324a00 0x561b0f32de70 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3791958567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f32e3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 >> 172.21.15.6:0/3791958567 conn(0x561b0f282c80 msgr2=0x561b0f3197f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 shutdown_connections 2023-09-13T09:41:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3791958567 wait complete. 2023-09-13T09:41:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.896+0000 7fdc71edcb80 20 client.15855 trim_cache size 0 max 16384 2023-09-13T09:41:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 Processor -- start 2023-09-13T09:41:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 -- start start 2023-09-13T09:41:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f282c80 0x561b0f3244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f3353b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f325700 0x561b0f3288e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f3363f0 con 0x561b0f325700 2023-09-13T09:41:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f320730 con 0x561b0f324a00 2023-09-13T09:41:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.909+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f32bb00 con 0x561b0f282c80 2023-09-13T09:41:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f325700 0x561b0f3288e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f325700 0x561b0f3288e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34924/0 (socket says 172.21.15.6:34924) 2023-09-13T09:41:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 -- 172.21.15.6:0/3749141812 learned_addr learned my addr 172.21.15.6:0/3749141812 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f3353b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f282c80 0x561b0f3244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 -- 172.21.15.6:0/3749141812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f282c80 msgr2=0x561b0f3244c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f282c80 0x561b0f3244c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 -- 172.21.15.6:0/3749141812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 msgr2=0x561b0f3353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f3353b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 -- 172.21.15.6:0/3749141812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b0f0a2de0 con 0x561b0f325700 2023-09-13T09:41:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f325700 0x561b0f3288e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007c50 tx=0x7fdc58084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab02bc55d562866 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc467fc700 1 -- 172.21.15.6:0/3749141812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58099c90 con 0x561b0f325700 2023-09-13T09:41:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc467fc700 1 -- 172.21.15.6:0/3749141812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc58099590 con 0x561b0f325700 2023-09-13T09:41:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.910+0000 7fdc467fc700 1 -- 172.21.15.6:0/3749141812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580997f0 con 0x561b0f325700 2023-09-13T09:41:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3749141812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f325700 msgr2=0x561b0f3288e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f325700 0x561b0f3288e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007c50 tx=0x7fdc58084040 comp rx=0 tx=0).stop 2023-09-13T09:41:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3749141812 shutdown_connections 2023-09-13T09:41:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f325700 0x561b0f3288e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f282c80 0x561b0f3244c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3749141812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f324a00 0x561b0f3353b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3749141812 >> 172.21.15.6:0/3749141812 conn(0x561b0f31f240 msgr2=0x561b0f335ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3749141812 shutdown_connections 2023-09-13T09:41:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3749141812 wait complete. 2023-09-13T09:41:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 -- start start 2023-09-13T09:41:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.911+0000 7fdc71edcb80 1 Processor -- start 2023-09-13T09:41:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f282c80 0x561b0f334e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f324a00 0x561b0f335340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc71edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f331920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f332080 con 0x561b0f282c80 2023-09-13T09:41:16.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f3321f0 con 0x561b0f325700 2023-09-13T09:41:16.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc71edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b0f3323b0 con 0x561b0f324a00 2023-09-13T09:41:16.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc71edcb80 10 client.0 _ll_register_callbacks cb 0x561b0f212680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f282c80 0x561b0f334e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f282c80 0x561b0f334e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34926/0 (socket says 172.21.15.6:34926) 2023-09-13T09:41:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3316390631 learned_addr learned my addr 172.21.15.6:0/3316390631 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f331920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f324a00 0x561b0f335340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3316390631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f324a00 msgr2=0x561b0f335340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f324a00 0x561b0f335340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 msgr2=0x561b0f331920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f331920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 -- 172.21.15.6:0/3316390631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6019f000 con 0x561b0f282c80 2023-09-13T09:41:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5ffff700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f331920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f324a00 0x561b0f335340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc5f7fe700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f282c80 0x561b0f334e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdc5001d990 tx=0x7fdc50031d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c83a617340c1621d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc3effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.912+0000 7fdc3effd700 1 -- 172.21.15.6:0/3316390631 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50010910 con 0x561b0f282c80 2023-09-13T09:41:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc3effd700 1 -- 172.21.15.6:0/3316390631 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc50010a70 con 0x561b0f282c80 2023-09-13T09:41:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc5401e040 con 0x561b0f282c80 2023-09-13T09:41:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc3effd700 1 -- 172.21.15.6:0/3316390631 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc50010c30 con 0x561b0f282c80 2023-09-13T09:41:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 10 client.15861 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561b0f08bc60 con 0x561b0f282c80 2023-09-13T09:41:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc3effd700 1 -- 172.21.15.6:0/3316390631 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc5401e040 con 0x561b0f282c80 2023-09-13T09:41:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc3effd700 1 -- 172.21.15.6:0/3316390631 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fdc5003c430 con 0x561b0f282c80 2023-09-13T09:41:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 10 client.15861 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 10 client.15861 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:41:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 20 client.15861 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:16.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f326060 0x561b0f3914e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 4 client.15861 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561b0f230050 con 0x561b0f326060 2023-09-13T09:41:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.913+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f326060 0x561b0f3914e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc3effd700 10 client.15861 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc5effd700 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f326060 0x561b0f3914e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=169e31657d0190b1 server_cookie=17cc6aa47baae51 in_seq=0 out_seq=0 2023-09-13T09:41:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc3effd700 1 -- 172.21.15.6:0/3316390631 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561b0f230050 con 0x561b0f326060 2023-09-13T09:41:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc3effd700 10 client.15861 handle_command_reply: tid=0 2023-09-13T09:41:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 client.15861 shutdown 2023-09-13T09:41:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f282c80 msgr2=0x561b0f334e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f282c80 0x561b0f334e00 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdc5001d990 tx=0x7fdc50031d60 comp rx=0 tx=0).stop 2023-09-13T09:41:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 shutdown_connections 2023-09-13T09:41:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561b0f326060 0x561b0f3914e0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561b0f325700 0x561b0f331920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561b0f282c80 0x561b0f334e00 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 --2- 172.21.15.6:0/3316390631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561b0f324a00 0x561b0f335340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc3effd700 0 client.15861 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 >> 172.21.15.6:0/3316390631 conn(0x561b0f31f240 msgr2=0x561b0f3288e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 shutdown_connections 2023-09-13T09:41:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 1 -- 172.21.15.6:0/3316390631 wait complete. 2023-09-13T09:41:16.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.914+0000 7fdc71edcb80 20 client.15861 trim_cache size 0 max 16384 2023-09-13T09:41:16.957 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:16.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 msgr2=0x7fdc480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdc60100d10 tx=0x7fdc5000a380 comp rx=0 tx=0).stop 2023-09-13T09:41:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101850 msgr2=0x7fdc6019dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101850 0x7fdc6019dfc0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fdc58007d70 tx=0x7fdc5800a340 comp rx=0 tx=0).stop 2023-09-13T09:41:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 shutdown_connections 2023-09-13T09:41:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101850 0x7fdc6019dfc0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc600ffcc0 0x7fdc60196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 --2- 172.21.15.6:0/4234887484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60100eb0 0x7fdc60196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 >> 172.21.15.6:0/4234887484 conn(0x7fdc600fb250 msgr2=0x7fdc60068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 shutdown_connections 2023-09-13T09:41:16.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:16.915+0000 7fdc65cf7700 1 -- 172.21.15.6:0/4234887484 wait complete. 2023-09-13T09:41:16.961 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:41:16.986 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:16 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4166946389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:41:17.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 -- 172.21.15.6:0/2283687492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 msgr2=0x7fa8341000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 --2- 172.21.15.6:0/2283687492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa8341000e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fa8240099c0 tx=0x7fa824009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 -- 172.21.15.6:0/2283687492 shutdown_connections 2023-09-13T09:41:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 --2- 172.21.15.6:0/2283687492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa834101850 0x7fa834108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 --2- 172.21.15.6:0/2283687492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa8341000e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 --2- 172.21.15.6:0/2283687492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa834100eb0 0x7fa834101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 -- 172.21.15.6:0/2283687492 >> 172.21.15.6:0/2283687492 conn(0x7fa8340fb250 msgr2=0x7fa8340fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 -- 172.21.15.6:0/2283687492 shutdown_connections 2023-09-13T09:41:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 -- 172.21.15.6:0/2283687492 wait complete. 2023-09-13T09:41:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.089+0000 7fa839744700 1 Processor -- start 2023-09-13T09:41:17.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa839744700 1 -- start start 2023-09-13T09:41:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa839744700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa834068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa839744700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa834100eb0 0x7fa83419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa839744700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa834101850 0x7fa83419de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa839744700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83419e5a0 con 0x7fa8340ffcc0 2023-09-13T09:41:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa839744700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83419e710 con 0x7fa834101850 2023-09-13T09:41:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa839744700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa83419e8d0 con 0x7fa834100eb0 2023-09-13T09:41:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa834068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa834068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34940/0 (socket says 172.21.15.6:34940) 2023-09-13T09:41:17.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 -- 172.21.15.6:0/3595353046 learned_addr learned my addr 172.21.15.6:0/3595353046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa8327fc700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa834100eb0 0x7fa83419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa8337fe700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa834101850 0x7fa83419de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 -- 172.21.15.6:0/3595353046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa834100eb0 msgr2=0x7fa83419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa834100eb0 0x7fa83419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 -- 172.21.15.6:0/3595353046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa834101850 msgr2=0x7fa83419de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa834101850 0x7fa83419de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.090+0000 7fa832ffd700 1 -- 172.21.15.6:0/3595353046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240095f0 con 0x7fa8340ffcc0 2023-09-13T09:41:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.091+0000 7fa832ffd700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa834068b20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa824009990 tx=0x7fa824004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.091+0000 7fa81bfff700 1 -- 172.21.15.6:0/3595353046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82401d070 con 0x7fa8340ffcc0 2023-09-13T09:41:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.091+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa83419eb50 con 0x7fa8340ffcc0 2023-09-13T09:41:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.091+0000 7fa81bfff700 1 -- 172.21.15.6:0/3595353046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa824004010 con 0x7fa8340ffcc0 2023-09-13T09:41:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.091+0000 7fa81bfff700 1 -- 172.21.15.6:0/3595353046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa824022cd0 con 0x7fa8340ffcc0 2023-09-13T09:41:17.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.091+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83419f000 con 0x7fa8340ffcc0 2023-09-13T09:41:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.093+0000 7fa81bfff700 1 -- 172.21.15.6:0/3595353046 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa824022470 con 0x7fa8340ffcc0 2023-09-13T09:41:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa81bfff700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa81c0a0640 0x7fa81c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa81bfff700 1 -- 172.21.15.6:0/3595353046 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa8240ccfa0 con 0x7fa8340ffcc0 2023-09-13T09:41:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa8327fc700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa81c0a0640 0x7fa81c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa8327fc700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa81c0a0640 0x7fa81c0a2b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa828005950 tx=0x7fa82800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa845929b80 1 Processor -- start 2023-09-13T09:41:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa845929b80 1 -- start start 2023-09-13T09:41:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa845929b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c8b10 0x561fbd3c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa845929b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3c78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa845929b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c7e10 0x561fbd3c8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.094+0000 7fa845929b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd31c780 con 0x561fbd3c7e10 2023-09-13T09:41:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa845929b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd31a0a0 con 0x561fbd3c9470 2023-09-13T09:41:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa845929b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd315990 con 0x561fbd3c8b10 2023-09-13T09:41:17.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c7e10 0x561fbd3c8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c7e10 0x561fbd3c8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34952/0 (socket says 172.21.15.6:34952) 2023-09-13T09:41:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 -- 172.21.15.6:0/1536949483 learned_addr learned my addr 172.21.15.6:0/1536949483 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c8b10 0x561fbd3c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8327fc700 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3c78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 -- 172.21.15.6:0/1536949483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c8b10 msgr2=0x561fbd3c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c8b10 0x561fbd3c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 -- 172.21.15.6:0/1536949483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 msgr2=0x561fbd3c78d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3c78d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 -- 172.21.15.6:0/1536949483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fbd195630 con 0x561fbd3c7e10 2023-09-13T09:41:17.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c8b10 0x561fbd3c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:17.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8337fe700 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c7e10 0x561fbd3c8270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098f0 tx=0x7fa82c009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84f984359ec9ebe8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8197fa700 1 -- 172.21.15.6:0/1536949483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c019070 con 0x561fbd3c7e10 2023-09-13T09:41:17.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8197fa700 1 -- 172.21.15.6:0/1536949483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa82c00f040 con 0x561fbd3c7e10 2023-09-13T09:41:17.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.095+0000 7fa8197fa700 1 -- 172.21.15.6:0/1536949483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c007bc0 con 0x561fbd3c7e10 2023-09-13T09:41:17.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 -- 172.21.15.6:0/1536949483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c7e10 msgr2=0x561fbd3c8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c7e10 0x561fbd3c8270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa82c0098f0 tx=0x7fa82c009c00 comp rx=0 tx=0).stop 2023-09-13T09:41:17.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 -- 172.21.15.6:0/1536949483 shutdown_connections 2023-09-13T09:41:17.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c7e10 0x561fbd3c8270 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c8b10 0x561fbd3c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 --2- 172.21.15.6:0/1536949483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3c78d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 -- 172.21.15.6:0/1536949483 >> 172.21.15.6:0/1536949483 conn(0x561fbd321c80 msgr2=0x561fbd3bdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 -- 172.21.15.6:0/1536949483 shutdown_connections 2023-09-13T09:41:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 -- 172.21.15.6:0/1536949483 wait complete. 2023-09-13T09:41:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 -- start start 2023-09-13T09:41:17.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.096+0000 7fa845929b80 1 Processor -- start 2023-09-13T09:41:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa845929b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 0x561fbd3d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa845929b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa845929b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3d8880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa845929b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd2b3bb0 con 0x561fbd3c8b10 2023-09-13T09:41:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa845929b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd2b38b0 con 0x561fbd3c9470 2023-09-13T09:41:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa845929b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd197920 con 0x561fbd3c7e10 2023-09-13T09:41:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa845929b80 10 client.0 _ll_register_callbacks cb 0x561fbd2b1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:17.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34956/0 (socket says 172.21.15.6:34956) 2023-09-13T09:41:17.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 -- 172.21.15.6:0/1596979492 learned_addr learned my addr 172.21.15.6:0/1596979492 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8337fe700 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3d8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 0x561fbd3d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 -- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 msgr2=0x561fbd3d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 0x561fbd3d1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 -- 172.21.15.6:0/1596979492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 msgr2=0x561fbd3d8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3d8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 -- 172.21.15.6:0/1596979492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa82c003c50 con 0x561fbd3c8b10 2023-09-13T09:41:17.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa8327fc700 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa828011530 tx=0x7fa8280047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b11f17b41c2c017 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.097+0000 7fa816ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:17.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa816ff5700 1 -- 172.21.15.6:0/1596979492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828004a30 con 0x561fbd3c8b10 2023-09-13T09:41:17.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa816ff5700 1 -- 172.21.15.6:0/1596979492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa828017070 con 0x561fbd3c8b10 2023-09-13T09:41:17.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561fbd3b6670 con 0x561fbd3c8b10 2023-09-13T09:41:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa816ff5700 1 -- 172.21.15.6:0/1596979492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa828011e30 con 0x561fbd3c8b10 2023-09-13T09:41:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 10 client.15873 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561fbd32d7a0 con 0x561fbd3c8b10 2023-09-13T09:41:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa816ff5700 1 -- 172.21.15.6:0/1596979492 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561fbd3b6670 con 0x561fbd3c8b10 2023-09-13T09:41:17.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa816ff5700 1 -- 172.21.15.6:0/1596979492 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa82801f760 con 0x561fbd3c8b10 2023-09-13T09:41:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 10 client.15873 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 10 client.15873 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:41:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 20 client.15873 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd3dd1e0 0x561fbd3df600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 4 client.15873 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561fbd30e970 con 0x561fbd3dd1e0 2023-09-13T09:41:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.098+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd3dd1e0 0x561fbd3df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.099+0000 7fa816ff5700 10 client.15873 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.099+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd3dd1e0 0x561fbd3df600 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b1d547428b206453 server_cookie=353f663f55a6c6c6 in_seq=0 out_seq=0 2023-09-13T09:41:17.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.099+0000 7fa816ff5700 1 -- 172.21.15.6:0/1596979492 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561fbd30e970 con 0x561fbd3dd1e0 2023-09-13T09:41:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.099+0000 7fa816ff5700 10 client.15873 handle_command_reply: tid=0 2023-09-13T09:41:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.099+0000 7fa845929b80 1 client.15873 shutdown 2023-09-13T09:41:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 msgr2=0x561fbd3d1840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa828011530 tx=0x7fa8280047c0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 shutdown_connections 2023-09-13T09:41:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd3dd1e0 0x561fbd3df600 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c9470 0x561fbd3d8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 0x561fbd3d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 --2- 172.21.15.6:0/1596979492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa816ff5700 0 client.15873 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:17.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 >> 172.21.15.6:0/1596979492 conn(0x561fbd321c80 msgr2=0x561fbd3bdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 shutdown_connections 2023-09-13T09:41:17.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 1 -- 172.21.15.6:0/1596979492 wait complete. 2023-09-13T09:41:17.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.100+0000 7fa845929b80 20 client.15873 trim_cache size 0 max 16384 2023-09-13T09:41:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 Processor -- start 2023-09-13T09:41:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 -- start start 2023-09-13T09:41:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 0x561fbd3d1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c9470 0x561fbd3d8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd3b6650 con 0x561fbd3c9470 2023-09-13T09:41:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd3bffd0 con 0x561fbd3c8b10 2023-09-13T09:41:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa845929b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd3bf760 con 0x561fbd3c7e10 2023-09-13T09:41:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c9470 0x561fbd3d8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c9470 0x561fbd3d8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34966/0 (socket says 172.21.15.6:34966) 2023-09-13T09:41:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 -- 172.21.15.6:0/3927870056 learned_addr learned my addr 172.21.15.6:0/3927870056 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8327fc700 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 -- 172.21.15.6:0/3927870056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 msgr2=0x561fbd3d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 0x561fbd3d1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 -- 172.21.15.6:0/3927870056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c8b10 msgr2=0x561fbd3d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 -- 172.21.15.6:0/3927870056 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561fbd141de0 con 0x561fbd3c9470 2023-09-13T09:41:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8327fc700 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.113+0000 7fa8337fe700 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c9470 0x561fbd3d8840 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa82c003c20 tx=0x7fa82c009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ffb8a6ad68d232a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa819ffb700 1 -- 172.21.15.6:0/3927870056 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c019070 con 0x561fbd3c9470 2023-09-13T09:41:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa819ffb700 1 -- 172.21.15.6:0/3927870056 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa82c01a040 con 0x561fbd3c9470 2023-09-13T09:41:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa819ffb700 1 -- 172.21.15.6:0/3927870056 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82c004e80 con 0x561fbd3c9470 2023-09-13T09:41:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 -- 172.21.15.6:0/3927870056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c9470 msgr2=0x561fbd3d8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c9470 0x561fbd3d8840 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa82c003c20 tx=0x7fa82c009540 comp rx=0 tx=0).stop 2023-09-13T09:41:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 -- 172.21.15.6:0/3927870056 shutdown_connections 2023-09-13T09:41:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c9470 0x561fbd3d8840 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c7e10 0x561fbd3d1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 --2- 172.21.15.6:0/3927870056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c8b10 0x561fbd3d1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 -- 172.21.15.6:0/3927870056 >> 172.21.15.6:0/3927870056 conn(0x561fbd321c80 msgr2=0x561fbd3bde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 -- 172.21.15.6:0/3927870056 shutdown_connections 2023-09-13T09:41:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.114+0000 7fa845929b80 1 -- 172.21.15.6:0/3927870056 wait complete. 2023-09-13T09:41:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 -- start start 2023-09-13T09:41:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 Processor -- start 2023-09-13T09:41:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c7e10 0x561fbd3d8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d5030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c9470 0x561fbd3d5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd3d5ab0 con 0x561fbd3c8b10 2023-09-13T09:41:17.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd3d5c20 con 0x561fbd3c7e10 2023-09-13T09:41:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561fbd430fc0 con 0x561fbd3c9470 2023-09-13T09:41:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa845929b80 10 client.0 _ll_register_callbacks cb 0x561fbd2b1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d5030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34970/0 (socket says 172.21.15.6:34970) 2023-09-13T09:41:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 -- 172.21.15.6:0/1916510329 learned_addr learned my addr 172.21.15.6:0/1916510329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c7e10 0x561fbd3d8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8337fe700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c9470 0x561fbd3d5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 -- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c9470 msgr2=0x561fbd3d5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c9470 0x561fbd3d5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 -- 172.21.15.6:0/1916510329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c7e10 msgr2=0x561fbd3d8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c7e10 0x561fbd3d8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 -- 172.21.15.6:0/1916510329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561fbd195630 con 0x561fbd3c8b10 2023-09-13T09:41:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8337fe700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c9470 0x561fbd3d5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa8327fc700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d5030 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa82801f8f0 tx=0x7fa82801f9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc33af5f79ec284 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.115+0000 7fa816ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:17.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa816ff5700 1 -- 172.21.15.6:0/1916510329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8280278a0 con 0x561fbd3c8b10 2023-09-13T09:41:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa816ff5700 1 -- 172.21.15.6:0/1916510329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa828017050 con 0x561fbd3c8b10 2023-09-13T09:41:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa82c00f040 con 0x561fbd3c8b10 2023-09-13T09:41:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa816ff5700 1 -- 172.21.15.6:0/1916510329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa828027a00 con 0x561fbd3c8b10 2023-09-13T09:41:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 10 client.15879 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:17.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x561fbd12ac60 con 0x561fbd3c8b10 2023-09-13T09:41:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa816ff5700 1 -- 172.21.15.6:0/1916510329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa82c00f040 con 0x561fbd3c8b10 2023-09-13T09:41:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa816ff5700 1 -- 172.21.15.6:0/1916510329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa828031b90 con 0x561fbd3c8b10 2023-09-13T09:41:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 10 client.15879 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 10 client.15879 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:41:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 20 client.15879 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:17.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd432910 0x561fbd434d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 4 client.15879 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561fbd2cf050 con 0x561fbd432910 2023-09-13T09:41:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.116+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd432910 0x561fbd434d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa832ffd700 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd432910 0x561fbd434d30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=15e8e59f82d356bb server_cookie=2bc877e7bd4ecfa0 in_seq=0 out_seq=0 2023-09-13T09:41:17.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa816ff5700 10 client.15879 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:17.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa816ff5700 1 -- 172.21.15.6:0/1916510329 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561fbd2cf050 con 0x561fbd432910 2023-09-13T09:41:17.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa816ff5700 10 client.15879 handle_command_reply: tid=0 2023-09-13T09:41:17.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 client.15879 shutdown 2023-09-13T09:41:17.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 msgr2=0x561fbd3d5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d5030 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fa82801f8f0 tx=0x7fa82801f9d0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 shutdown_connections 2023-09-13T09:41:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x561fbd432910 0x561fbd434d30 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561fbd3c9470 0x561fbd3d5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa816ff5700 0 client.15879 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:17.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561fbd3c7e10 0x561fbd3d8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 --2- 172.21.15.6:0/1916510329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561fbd3c8b10 0x561fbd3d5030 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 >> 172.21.15.6:0/1916510329 conn(0x561fbd321c80 msgr2=0x561fbd3cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 shutdown_connections 2023-09-13T09:41:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 1 -- 172.21.15.6:0/1916510329 wait complete. 2023-09-13T09:41:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.117+0000 7fa845929b80 20 client.15879 trim_cache size 0 max 16384 2023-09-13T09:41:17.147 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa81c0a0640 msgr2=0x7fa81c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa81c0a0640 0x7fa81c0a2b00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fa828005950 tx=0x7fa82800b410 comp rx=0 tx=0).stop 2023-09-13T09:41:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 msgr2=0x7fa834068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa834068b20 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa824009990 tx=0x7fa824004730 comp rx=0 tx=0).stop 2023-09-13T09:41:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 shutdown_connections 2023-09-13T09:41:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa834101850 0x7fa83419de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa81c0a0640 0x7fa81c0a2b00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8340ffcc0 0x7fa834068b20 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 --2- 172.21.15.6:0/3595353046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa834100eb0 0x7fa83419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 >> 172.21.15.6:0/3595353046 conn(0x7fa8340fb250 msgr2=0x7fa8341043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 shutdown_connections 2023-09-13T09:41:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.118+0000 7fa839744700 1 -- 172.21.15.6:0/3595353046 wait complete. 2023-09-13T09:41:17.151 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:41:17.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61012 9.36 MB/sec warmup 37 sec latency 1628.846 ms 2023-09-13T09:41:17.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:16 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4166946389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:41:17.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:16 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4166946389' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:41:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.316+0000 7f9171819700 1 -- 172.21.15.6:0/3965759941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c0ff0b0 msgr2=0x7f916c0ff4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.316+0000 7f9171819700 1 --2- 172.21.15.6:0/3965759941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c0ff0b0 0x7f916c0ff4d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f915c009990 tx=0x7f915c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 -- 172.21.15.6:0/3965759941 shutdown_connections 2023-09-13T09:41:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 --2- 172.21.15.6:0/3965759941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f916c102ac0 0x7f916c109370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 --2- 172.21.15.6:0/3965759941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c0ff0b0 0x7f916c0ff4d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 --2- 172.21.15.6:0/3965759941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c102120 0x7f916c102580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 -- 172.21.15.6:0/3965759941 >> 172.21.15.6:0/3965759941 conn(0x7f916c0fa9a0 msgr2=0x7f916c0fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 -- 172.21.15.6:0/3965759941 shutdown_connections 2023-09-13T09:41:17.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 -- 172.21.15.6:0/3965759941 wait complete. 2023-09-13T09:41:17.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.317+0000 7f9171819700 1 Processor -- start 2023-09-13T09:41:17.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f9171819700 1 -- start start 2023-09-13T09:41:17.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f9171819700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f916c0ff0b0 0x7f916c196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f9171819700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c102120 0x7f916c196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f9171819700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c102ac0 0x7f916c19e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f9171819700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c19e600 con 0x7f916c102120 2023-09-13T09:41:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f9171819700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c19e740 con 0x7f916c102ac0 2023-09-13T09:41:17.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f9171819700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f916c19e8d0 con 0x7f916c0ff0b0 2023-09-13T09:41:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c102120 0x7f916c196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c102120 0x7f916c196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34982/0 (socket says 172.21.15.6:34982) 2023-09-13T09:41:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 -- 172.21.15.6:0/3652107330 learned_addr learned my addr 172.21.15.6:0/3652107330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916affd700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f916c0ff0b0 0x7f916c196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916b7fe700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c102ac0 0x7f916c19e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 -- 172.21.15.6:0/3652107330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f916c0ff0b0 msgr2=0x7f916c196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f916c0ff0b0 0x7f916c196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 -- 172.21.15.6:0/3652107330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c102ac0 msgr2=0x7f916c19e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c102ac0 0x7f916c19e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.318+0000 7f916a7fc700 1 -- 172.21.15.6:0/3652107330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f915c0095f0 con 0x7f916c102120 2023-09-13T09:41:17.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.319+0000 7f916a7fc700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c102120 0x7f916c196fc0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f916000d950 tx=0x7f916000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.319+0000 7f9170817700 1 -- 172.21.15.6:0/3652107330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160009940 con 0x7f916c102120 2023-09-13T09:41:17.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.319+0000 7f9170817700 1 -- 172.21.15.6:0/3652107330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9160010460 con 0x7f916c102120 2023-09-13T09:41:17.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.319+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f916c19ebb0 con 0x7f916c102120 2023-09-13T09:41:17.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.319+0000 7f9170817700 1 -- 172.21.15.6:0/3652107330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916000f620 con 0x7f916c102120 2023-09-13T09:41:17.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.319+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c19f110 con 0x7f916c102120 2023-09-13T09:41:17.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.321+0000 7f9170817700 1 -- 172.21.15.6:0/3652107330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f91600108d0 con 0x7f916c102120 2023-09-13T09:41:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f9170817700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91540a06c0 0x7f91540a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f916affd700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91540a06c0 0x7f91540a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f9170817700 1 -- 172.21.15.6:0/3652107330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f91600cb9b0 con 0x7f916c102120 2023-09-13T09:41:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f916affd700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91540a06c0 0x7f91540a2b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b5c0 tx=0x7f915c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f917d9feb80 1 Processor -- start 2023-09-13T09:41:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f917d9feb80 1 -- start start 2023-09-13T09:41:17.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f46b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f454c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f45e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f917d9feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02e9e780 con 0x562e02f47060 2023-09-13T09:41:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.322+0000 7f917d9feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02e9c0a0 con 0x562e02f45a00 2023-09-13T09:41:17.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f917d9feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02e97990 con 0x562e02f46700 2023-09-13T09:41:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34990/0 (socket says 172.21.15.6:34990) 2023-09-13T09:41:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 -- 172.21.15.6:0/3740955317 learned_addr learned my addr 172.21.15.6:0/3740955317 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916affd700 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f46b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916b7fe700 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f45e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 -- 172.21.15.6:0/3740955317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 msgr2=0x562e02f46b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f46b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 -- 172.21.15.6:0/3740955317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 msgr2=0x562e02f45e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f45e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 -- 172.21.15.6:0/3740955317 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e02d17630 con 0x562e02f47060 2023-09-13T09:41:17.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916affd700 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f46b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f916a7fc700 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f454c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9160095650 tx=0x7f9160098da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cbede2d9ade32d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f9151ffb700 1 -- 172.21.15.6:0/3740955317 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916009cf80 con 0x562e02f47060 2023-09-13T09:41:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f9151ffb700 1 -- 172.21.15.6:0/3740955317 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91600a11c0 con 0x562e02f47060 2023-09-13T09:41:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.323+0000 7f9151ffb700 1 -- 172.21.15.6:0/3740955317 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9160098840 con 0x562e02f47060 2023-09-13T09:41:17.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 -- 172.21.15.6:0/3740955317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 msgr2=0x562e02f454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f454c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f9160095650 tx=0x7f9160098da0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 -- 172.21.15.6:0/3740955317 shutdown_connections 2023-09-13T09:41:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f45e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f46b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3740955317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f454c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 -- 172.21.15.6:0/3740955317 >> 172.21.15.6:0/3740955317 conn(0x562e02ea3c80 msgr2=0x562e02f3ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 -- 172.21.15.6:0/3740955317 shutdown_connections 2023-09-13T09:41:17.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 -- 172.21.15.6:0/3740955317 wait complete. 2023-09-13T09:41:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.324+0000 7f917d9feb80 1 -- start start 2023-09-13T09:41:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 1 Processor -- start 2023-09-13T09:41:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f4ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f4f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f564b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02e35bb0 con 0x562e02f47060 2023-09-13T09:41:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02e358b0 con 0x562e02f45a00 2023-09-13T09:41:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02d19920 con 0x562e02f46700 2023-09-13T09:41:17.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f917d9feb80 10 client.0 _ll_register_callbacks cb 0x562e02e33680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f564b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f564b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34998/0 (socket says 172.21.15.6:34998) 2023-09-13T09:41:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f916b7fe700 1 -- 172.21.15.6:0/3131325460 learned_addr learned my addr 172.21.15.6:0/3131325460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f916affd700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f4ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.325+0000 7f916a7fc700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f4f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f916b7fe700 1 -- 172.21.15.6:0/3131325460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 msgr2=0x562e02f4f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f916b7fe700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f4f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f916b7fe700 1 -- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 msgr2=0x562e02f4ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f916b7fe700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f4ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f916b7fe700 1 -- 172.21.15.6:0/3131325460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c19f110 con 0x562e02f47060 2023-09-13T09:41:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f916affd700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f4ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f916b7fe700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f564b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9164007af0 tx=0x7f9164007eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5124cb64c8b8d407 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f914affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:17.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f914affd700 1 -- 172.21.15.6:0/3131325460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164012b10 con 0x562e02f47060 2023-09-13T09:41:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e02f38670 con 0x562e02f47060 2023-09-13T09:41:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f914affd700 1 -- 172.21.15.6:0/3131325460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9164012c70 con 0x562e02f47060 2023-09-13T09:41:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f914affd700 1 -- 172.21.15.6:0/3131325460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9164012e30 con 0x562e02f47060 2023-09-13T09:41:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f917d9feb80 10 client.15891 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:17.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562e02eaf7a0 con 0x562e02f47060 2023-09-13T09:41:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f914affd700 1 -- 172.21.15.6:0/3131325460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562e02f38670 con 0x562e02f47060 2023-09-13T09:41:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f914affd700 1 -- 172.21.15.6:0/3131325460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9164014040 con 0x562e02f47060 2023-09-13T09:41:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f917d9feb80 10 client.15891 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:17.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f917d9feb80 10 client.15891 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.326+0000 7f917d9feb80 20 client.15891 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.327+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02f5adb0 0x562e02f5d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.327+0000 7f917d9feb80 4 client.15891 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.327+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e02e90970 con 0x562e02f5adb0 2023-09-13T09:41:17.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.327+0000 7f916affd700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02f5adb0 0x562e02f5d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.327+0000 7f916affd700 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02f5adb0 0x562e02f5d1d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de7136183b6ba13e server_cookie=aa0283e0ee38fd9e in_seq=0 out_seq=0 2023-09-13T09:41:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.327+0000 7f914affd700 10 client.15891 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f914affd700 1 -- 172.21.15.6:0/3131325460 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562e02e90970 con 0x562e02f5adb0 2023-09-13T09:41:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f914affd700 10 client.15891 handle_command_reply: tid=0 2023-09-13T09:41:17.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 client.15891 shutdown 2023-09-13T09:41:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 msgr2=0x562e02f564b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f564b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9164007af0 tx=0x7f9164007eb0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 shutdown_connections 2023-09-13T09:41:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02f5adb0 0x562e02f5d1d0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f564b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f4ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 --2- 172.21.15.6:0/3131325460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f4f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 >> 172.21.15.6:0/3131325460 conn(0x562e02ea3c80 msgr2=0x562e02f3a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f914affd700 0 client.15891 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:17.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 shutdown_connections 2023-09-13T09:41:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 1 -- 172.21.15.6:0/3131325460 wait complete. 2023-09-13T09:41:17.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.328+0000 7f917d9feb80 20 client.15891 trim_cache size 0 max 16384 2023-09-13T09:41:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 Processor -- start 2023-09-13T09:41:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 -- start start 2023-09-13T09:41:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f45a00 0x562e02f454c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f46700 0x562e02f563d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f47060 0x562e02f498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02f4cb80 con 0x562e02f45a00 2023-09-13T09:41:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02f4a470 con 0x562e02f46700 2023-09-13T09:41:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f917d9feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02f4fb90 con 0x562e02f47060 2023-09-13T09:41:17.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f45a00 0x562e02f454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f45a00 0x562e02f454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35002/0 (socket says 172.21.15.6:35002) 2023-09-13T09:41:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 -- 172.21.15.6:0/1742840560 learned_addr learned my addr 172.21.15.6:0/1742840560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916a7fc700 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f46700 0x562e02f563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 -- 172.21.15.6:0/1742840560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f47060 msgr2=0x562e02f498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f47060 0x562e02f498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 -- 172.21.15.6:0/1742840560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f46700 msgr2=0x562e02f563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f46700 0x562e02f563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 -- 172.21.15.6:0/1742840560 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e02cc3de0 con 0x562e02f45a00 2023-09-13T09:41:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916a7fc700 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f46700 0x562e02f563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.342+0000 7f916affd700 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f45a00 0x562e02f454c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f915c009990 tx=0x7f915c005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fed13648b74ac99 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f91527fc700 1 -- 172.21.15.6:0/1742840560 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c032430 con 0x562e02f45a00 2023-09-13T09:41:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f91527fc700 1 -- 172.21.15.6:0/1742840560 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f915c02b040 con 0x562e02f45a00 2023-09-13T09:41:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f91527fc700 1 -- 172.21.15.6:0/1742840560 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f915c023460 con 0x562e02f45a00 2023-09-13T09:41:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 -- 172.21.15.6:0/1742840560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f45a00 msgr2=0x562e02f454c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f45a00 0x562e02f454c0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f915c009990 tx=0x7f915c005000 comp rx=0 tx=0).stop 2023-09-13T09:41:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 -- 172.21.15.6:0/1742840560 shutdown_connections 2023-09-13T09:41:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f47060 0x562e02f498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f45a00 0x562e02f454c0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 --2- 172.21.15.6:0/1742840560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f46700 0x562e02f563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 -- 172.21.15.6:0/1742840560 >> 172.21.15.6:0/1742840560 conn(0x562e02ea3c80 msgr2=0x562e02f4cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 -- 172.21.15.6:0/1742840560 shutdown_connections 2023-09-13T09:41:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.343+0000 7f917d9feb80 1 -- 172.21.15.6:0/1742840560 wait complete. 2023-09-13T09:41:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 -- start start 2023-09-13T09:41:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 Processor -- start 2023-09-13T09:41:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f525e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f55600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02f55b40 con 0x562e02f47060 2023-09-13T09:41:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02f55cb0 con 0x562e02f45a00 2023-09-13T09:41:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e02f55e70 con 0x562e02f46700 2023-09-13T09:41:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f917d9feb80 10 client.0 _ll_register_callbacks cb 0x562e02e33680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f55600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f916b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f55600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35012/0 (socket says 172.21.15.6:35012) 2023-09-13T09:41:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f916b7fe700 1 -- 172.21.15.6:0/2828920846 learned_addr learned my addr 172.21.15.6:0/2828920846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f916a7fc700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.344+0000 7f916affd700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f916b7fe700 1 -- 172.21.15.6:0/2828920846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 msgr2=0x562e02f525e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f916b7fe700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f525e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f916b7fe700 1 -- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 msgr2=0x562e02f520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:17.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f916b7fe700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f916b7fe700 1 -- 172.21.15.6:0/2828920846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f916c109b60 con 0x562e02f47060 2023-09-13T09:41:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f916affd700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f916b7fe700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f55600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9164007840 tx=0x7f91640159a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e15a047c34a6cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f914affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f914affd700 1 -- 172.21.15.6:0/2828920846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9164012520 con 0x562e02f47060 2023-09-13T09:41:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f914affd700 1 -- 172.21.15.6:0/2828920846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9164015db0 con 0x562e02f47060 2023-09-13T09:41:17.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f91600a11c0 con 0x562e02f47060 2023-09-13T09:41:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f914affd700 1 -- 172.21.15.6:0/2828920846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9164004a50 con 0x562e02f47060 2023-09-13T09:41:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 10 client.15897 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x562e02cacc60 con 0x562e02f47060 2023-09-13T09:41:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f914affd700 1 -- 172.21.15.6:0/2828920846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91600a11c0 con 0x562e02f47060 2023-09-13T09:41:17.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f914affd700 1 -- 172.21.15.6:0/2828920846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f9164014070 con 0x562e02f47060 2023-09-13T09:41:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 10 client.15897 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 10 client.15897 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 20 client.15897 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02faf9f0 0x562e02fb1e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:17.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 4 client.15897 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.345+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562e02e51050 con 0x562e02faf9f0 2023-09-13T09:41:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.346+0000 7f916affd700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02faf9f0 0x562e02fb1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.346+0000 7f916affd700 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02faf9f0 0x562e02fb1e10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5eabc1a141bd04e4 server_cookie=35e881348f53f145 in_seq=0 out_seq=0 2023-09-13T09:41:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.346+0000 7f914affd700 10 client.15897 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:17.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.346+0000 7f914affd700 1 -- 172.21.15.6:0/2828920846 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562e02e51050 con 0x562e02faf9f0 2023-09-13T09:41:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.346+0000 7f914affd700 10 client.15897 handle_command_reply: tid=0 2023-09-13T09:41:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.346+0000 7f917d9feb80 1 client.15897 shutdown 2023-09-13T09:41:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 msgr2=0x562e02f55600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f55600 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9164007840 tx=0x7f91640159a0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 shutdown_connections 2023-09-13T09:41:17.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562e02faf9f0 0x562e02fb1e10 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e02f47060 0x562e02f55600 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f914affd700 0 client.15897 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e02f45a00 0x562e02f520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 --2- 172.21.15.6:0/2828920846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e02f46700 0x562e02f525e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 >> 172.21.15.6:0/2828920846 conn(0x562e02ea3c80 msgr2=0x562e02f498e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 shutdown_connections 2023-09-13T09:41:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 1 -- 172.21.15.6:0/2828920846 wait complete. 2023-09-13T09:41:17.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f917d9feb80 20 client.15897 trim_cache size 0 max 16384 2023-09-13T09:41:17.373 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91540a06c0 msgr2=0x7f91540a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91540a06c0 0x7f91540a2b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f915c00b5c0 tx=0x7f915c005fd0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c102120 msgr2=0x7f916c196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c102120 0x7f916c196fc0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f916000d950 tx=0x7f916000dc60 comp rx=0 tx=0).stop 2023-09-13T09:41:17.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 shutdown_connections 2023-09-13T09:41:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f916c102ac0 0x7f916c19e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f916c0ff0b0 0x7f916c196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91540a06c0 0x7f91540a2b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 --2- 172.21.15.6:0/3652107330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f916c102120 0x7f916c196fc0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:17.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 >> 172.21.15.6:0/3652107330 conn(0x7f916c0fa9a0 msgr2=0x7f916c0fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 shutdown_connections 2023-09-13T09:41:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:17.347+0000 7f9171819700 1 -- 172.21.15.6:0/3652107330 wait complete. 2023-09-13T09:41:18.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61051 9.11 MB/sec warmup 38 sec latency 972.048 ms 2023-09-13T09:41:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:17 smithi006 ceph-mon[98665]: pgmap v353: 97 pgs: 97 active+clean; 48 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 6.3 MiB/s wr, 233 op/s 2023-09-13T09:41:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:17 smithi053 ceph-mon[102373]: pgmap v353: 97 pgs: 97 active+clean; 48 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 6.3 MiB/s wr, 233 op/s 2023-09-13T09:41:18.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:17 smithi131 ceph-mon[102785]: pgmap v353: 97 pgs: 97 active+clean; 48 MiB data, 583 MiB used, 1.0 TiB / 1.0 TiB avail; 533 KiB/s rd, 6.3 MiB/s wr, 233 op/s 2023-09-13T09:41:18.377 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:41:18.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:41:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 -- 172.21.15.6:0/374096488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 msgr2=0x7f47fc1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 --2- 172.21.15.6:0/374096488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc1000e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f47f80099c0 tx=0x7f47f8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 -- 172.21.15.6:0/374096488 shutdown_connections 2023-09-13T09:41:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 --2- 172.21.15.6:0/374096488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc101850 0x7f47fc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 --2- 172.21.15.6:0/374096488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc1000e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 --2- 172.21.15.6:0/374096488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47fc100eb0 0x7f47fc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 -- 172.21.15.6:0/374096488 >> 172.21.15.6:0/374096488 conn(0x7f47fc0fb250 msgr2=0x7f47fc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 -- 172.21.15.6:0/374096488 shutdown_connections 2023-09-13T09:41:18.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.523+0000 7f4803283700 1 -- 172.21.15.6:0/374096488 wait complete. 2023-09-13T09:41:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 Processor -- start 2023-09-13T09:41:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 -- start start 2023-09-13T09:41:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc100eb0 0x7f47fc19b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47fc101850 0x7f47fc19dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc19e510 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc19e680 con 0x7f47fc101850 2023-09-13T09:41:18.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4803283700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47fc19e840 con 0x7f47fc100eb0 2023-09-13T09:41:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480101f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480101f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc068b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35022/0 (socket says 172.21.15.6:35022) 2023-09-13T09:41:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480101f700 1 -- 172.21.15.6:0/1795424615 learned_addr learned my addr 172.21.15.6:0/1795424615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480081e700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc100eb0 0x7f47fc19b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f4801820700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47fc101850 0x7f47fc19dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480101f700 1 -- 172.21.15.6:0/1795424615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc100eb0 msgr2=0x7f47fc19b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480101f700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc100eb0 0x7f47fc19b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480101f700 1 -- 172.21.15.6:0/1795424615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47fc101850 msgr2=0x7f47fc19dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.524+0000 7f480101f700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47fc101850 0x7f47fc19dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.525+0000 7f480101f700 1 -- 172.21.15.6:0/1795424615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f80095f0 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.525+0000 7f480101f700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc068b80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009f50 tx=0x7f47f8005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.525+0000 7f47f27fc700 1 -- 172.21.15.6:0/1795424615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f801d070 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.525+0000 7f47f27fc700 1 -- 172.21.15.6:0/1795424615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47f8003f90 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.525+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47fc19eac0 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.525+0000 7f47f27fc700 1 -- 172.21.15.6:0/1795424615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8022c10 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.525+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47fc19ef70 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.528+0000 7f47f27fc700 1 -- 172.21.15.6:0/1795424615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f47f8022470 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.528+0000 7f47f27fc700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47e80a0640 0x7f47e80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.528+0000 7f47f27fc700 1 -- 172.21.15.6:0/1795424615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f47f80ccff0 con 0x7f47fc0ffcc0 2023-09-13T09:41:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.528+0000 7f480081e700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47e80a0640 0x7f47e80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.529+0000 7f480081e700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47e80a0640 0x7f47e80a2b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005950 tx=0x7f47ec00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.529+0000 7f480f468b80 1 Processor -- start 2023-09-13T09:41:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.529+0000 7f480f468b80 1 -- start start 2023-09-13T09:41:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480f468b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59ed6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480f468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ed5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480f468b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed5e90 0x55ac59ed62f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480f468b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59e2a800 con 0x55ac59ed5e90 2023-09-13T09:41:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480f468b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59e28120 con 0x55ac59ed6b90 2023-09-13T09:41:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480f468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59e23a10 con 0x55ac59ed74f0 2023-09-13T09:41:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed5e90 0x55ac59ed62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed5e90 0x55ac59ed62f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35034/0 (socket says 172.21.15.6:35034) 2023-09-13T09:41:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 -- 172.21.15.6:0/1444350404 learned_addr learned my addr 172.21.15.6:0/1444350404 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480081e700 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ed5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f480101f700 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59ed6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 -- 172.21.15.6:0/1444350404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 msgr2=0x55ac59ed5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ed5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 -- 172.21.15.6:0/1444350404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 msgr2=0x55ac59ed6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59ed6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 -- 172.21.15.6:0/1444350404 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac59ca36b0 con 0x55ac59ed5e90 2023-09-13T09:41:18.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.530+0000 7f4801820700 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed5e90 0x55ac59ed62f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f47f40098f0 tx=0x7f47f4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683e66c210a0ad40 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f47e77fe700 1 -- 172.21.15.6:0/1444350404 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4019070 con 0x55ac59ed5e90 2023-09-13T09:41:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f47e77fe700 1 -- 172.21.15.6:0/1444350404 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47f400f040 con 0x55ac59ed5e90 2023-09-13T09:41:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f47e77fe700 1 -- 172.21.15.6:0/1444350404 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4007a60 con 0x55ac59ed5e90 2023-09-13T09:41:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 -- 172.21.15.6:0/1444350404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed5e90 msgr2=0x55ac59ed62f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed5e90 0x55ac59ed62f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f47f40098f0 tx=0x7f47f4009c00 comp rx=0 tx=0).stop 2023-09-13T09:41:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 -- 172.21.15.6:0/1444350404 shutdown_connections 2023-09-13T09:41:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed5e90 0x55ac59ed62f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59ed6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 --2- 172.21.15.6:0/1444350404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ed5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 -- 172.21.15.6:0/1444350404 >> 172.21.15.6:0/1444350404 conn(0x55ac59e2fd00 msgr2=0x55ac59ecbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 -- 172.21.15.6:0/1444350404 shutdown_connections 2023-09-13T09:41:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.531+0000 7f480f468b80 1 -- 172.21.15.6:0/1444350404 wait complete. 2023-09-13T09:41:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 -- start start 2023-09-13T09:41:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 Processor -- start 2023-09-13T09:41:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed5e90 0x55ac59edf390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59edf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59ee6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59dc1c30 con 0x55ac59ed74f0 2023-09-13T09:41:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59dc1930 con 0x55ac59ed6b90 2023-09-13T09:41:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59ca59a0 con 0x55ac59ed5e90 2023-09-13T09:41:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f480f468b80 10 client.0 _ll_register_callbacks cb 0x55ac59dbf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f4801820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59ee6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.532+0000 7f4801820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59ee6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35040/0 (socket says 172.21.15.6:35040) 2023-09-13T09:41:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f4801820700 1 -- 172.21.15.6:0/3337355427 learned_addr learned my addr 172.21.15.6:0/3337355427 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f480101f700 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed5e90 0x55ac59edf390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f480081e700 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59edf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f4801820700 1 -- 172.21.15.6:0/3337355427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed5e90 msgr2=0x55ac59edf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f4801820700 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed5e90 0x55ac59edf390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f4801820700 1 -- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 msgr2=0x55ac59edf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f4801820700 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59edf8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f4801820700 1 -- 172.21.15.6:0/3337355427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f4003c50 con 0x55ac59ed74f0 2023-09-13T09:41:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f4801820700 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59ee6910 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f47f4007540 tx=0x7f47f4007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b1da14a003e86a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f47e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3337355427 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4019050 con 0x55ac59ed74f0 2023-09-13T09:41:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac59ec46f0 con 0x55ac59ed74f0 2023-09-13T09:41:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3337355427 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f47f4015680 con 0x55ac59ed74f0 2023-09-13T09:41:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3337355427 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47f4004900 con 0x55ac59ed74f0 2023-09-13T09:41:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f480f468b80 10 client.15909 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.533+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ac59e3b820 con 0x55ac59ed74f0 2023-09-13T09:41:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3337355427 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ac59ec46f0 con 0x55ac59ed74f0 2023-09-13T09:41:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3337355427 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f47f401e810 con 0x55ac59ed74f0 2023-09-13T09:41:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f480f468b80 10 client.15909 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f480f468b80 10 client.15909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f480f468b80 20 client.15909 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:18.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f480f468b80 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59eeb170 0x55ac59eed590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f480f468b80 4 client.15909 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac59e1c9f0 con 0x55ac59eeb170 2023-09-13T09:41:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.534+0000 7f480101f700 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59eeb170 0x55ac59eed590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.535+0000 7f47e4ff9700 10 client.15909 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.535+0000 7f480101f700 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59eeb170 0x55ac59eed590 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=996194c9c55ac944 server_cookie=7edfb472a602cca1 in_seq=0 out_seq=0 2023-09-13T09:41:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.535+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3337355427 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ac59e1c9f0 con 0x55ac59eeb170 2023-09-13T09:41:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.535+0000 7f47e4ff9700 10 client.15909 handle_command_reply: tid=0 2023-09-13T09:41:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.535+0000 7f480f468b80 1 client.15909 shutdown 2023-09-13T09:41:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 msgr2=0x55ac59ee6910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59ee6910 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f47f4007540 tx=0x7f47f4007a90 comp rx=0 tx=0).stop 2023-09-13T09:41:18.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 shutdown_connections 2023-09-13T09:41:18.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59eeb170 0x55ac59eed590 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59ee6910 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed5e90 0x55ac59edf390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f47e4ff9700 0 client.15909 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 --2- 172.21.15.6:0/3337355427 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed6b90 0x55ac59edf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 >> 172.21.15.6:0/3337355427 conn(0x55ac59e2fd00 msgr2=0x55ac59ecbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 shutdown_connections 2023-09-13T09:41:18.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 1 -- 172.21.15.6:0/3337355427 wait complete. 2023-09-13T09:41:18.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.536+0000 7f480f468b80 20 client.15909 trim_cache size 0 max 16384 2023-09-13T09:41:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.553+0000 7f480f468b80 1 Processor -- start 2023-09-13T09:41:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.553+0000 7f480f468b80 1 -- start start 2023-09-13T09:41:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480f468b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ed9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480f468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed6b90 0x55ac59ee68d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480f468b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59eda2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480f468b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59ecd7b0 con 0x55ac59ed74f0 2023-09-13T09:41:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480f468b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59edcff0 con 0x55ac59ed5e90 2023-09-13T09:41:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480f468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59eda8e0 con 0x55ac59ed6b90 2023-09-13T09:41:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59eda2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59eda2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35048/0 (socket says 172.21.15.6:35048) 2023-09-13T09:41:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 -- 172.21.15.6:0/525834515 learned_addr learned my addr 172.21.15.6:0/525834515 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480101f700 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ed9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480081e700 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed6b90 0x55ac59ee68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 -- 172.21.15.6:0/525834515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed6b90 msgr2=0x55ac59ee68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed6b90 0x55ac59ee68d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 -- 172.21.15.6:0/525834515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 msgr2=0x55ac59ed9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ed9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 -- 172.21.15.6:0/525834515 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac59c4fe60 con 0x55ac59ed74f0 2023-09-13T09:41:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480101f700 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ed9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f480081e700 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed6b90 0x55ac59ee68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f4801820700 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59eda2b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f47f401eb70 tx=0x7f47f40097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=232187d15031dcbf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f47e7fff700 1 -- 172.21.15.6:0/525834515 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4019040 con 0x55ac59ed74f0 2023-09-13T09:41:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f47e7fff700 1 -- 172.21.15.6:0/525834515 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47f401a040 con 0x55ac59ed74f0 2023-09-13T09:41:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.554+0000 7f47e7fff700 1 -- 172.21.15.6:0/525834515 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f401d5e0 con 0x55ac59ed74f0 2023-09-13T09:41:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 -- 172.21.15.6:0/525834515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 msgr2=0x55ac59eda2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59eda2b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f47f401eb70 tx=0x7f47f40097e0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 -- 172.21.15.6:0/525834515 shutdown_connections 2023-09-13T09:41:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed74f0 0x55ac59eda2b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ed9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 --2- 172.21.15.6:0/525834515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed6b90 0x55ac59ee68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 -- 172.21.15.6:0/525834515 >> 172.21.15.6:0/525834515 conn(0x55ac59e2fd00 msgr2=0x55ac59ecbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 -- 172.21.15.6:0/525834515 shutdown_connections 2023-09-13T09:41:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 -- 172.21.15.6:0/525834515 wait complete. 2023-09-13T09:41:18.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 -- start start 2023-09-13T09:41:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.555+0000 7f480f468b80 1 Processor -- start 2023-09-13T09:41:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480f468b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ee6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480f468b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed6b90 0x55ac59ee30c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480f468b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ee3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480f468b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59ee3b40 con 0x55ac59ed6b90 2023-09-13T09:41:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480f468b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59ee3cb0 con 0x55ac59ed5e90 2023-09-13T09:41:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480f468b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac59f3ef90 con 0x55ac59ed74f0 2023-09-13T09:41:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480f468b80 10 client.0 _ll_register_callbacks cb 0x55ac59dbf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed6b90 0x55ac59ee30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed6b90 0x55ac59ee30c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35052/0 (socket says 172.21.15.6:35052) 2023-09-13T09:41:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 -- 172.21.15.6:0/3375395073 learned_addr learned my addr 172.21.15.6:0/3375395073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f4801820700 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ee3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480101f700 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ee6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 -- 172.21.15.6:0/3375395073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 msgr2=0x55ac59ee3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ee3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 -- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 msgr2=0x55ac59ee6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ee6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 -- 172.21.15.6:0/3375395073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac59e3b820 con 0x55ac59ed6b90 2023-09-13T09:41:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f480081e700 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed6b90 0x55ac59ee30c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f47ec011720 tx=0x7f47ec0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6851a1c1ee932e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.556+0000 7f47e4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:18.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3375395073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47ec024070 con 0x55ac59ed6b90 2023-09-13T09:41:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3375395073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f47ec017070 con 0x55ac59ed6b90 2023-09-13T09:41:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47f400f040 con 0x55ac59ed6b90 2023-09-13T09:41:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3375395073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47ec011e30 con 0x55ac59ed6b90 2023-09-13T09:41:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 10 client.15915 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ac59c38ce0 con 0x55ac59ed6b90 2023-09-13T09:41:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3375395073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47f400f040 con 0x55ac59ed6b90 2023-09-13T09:41:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3375395073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f47ec005520 con 0x55ac59ed6b90 2023-09-13T09:41:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 10 client.15915 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 20 client.15915 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59f40ad0 0x55ac59f42ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 4 client.15915 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:41:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ac59ddd0d0 con 0x55ac59f40ad0 2023-09-13T09:41:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.557+0000 7f480101f700 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59f40ad0 0x55ac59f42ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.558+0000 7f47e4ff9700 10 client.15915 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.558+0000 7f480101f700 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59f40ad0 0x55ac59f42ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=559ced580cd515b server_cookie=88bb4015d7edde82 in_seq=0 out_seq=0 2023-09-13T09:41:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.559+0000 7f47e4ff9700 1 -- 172.21.15.6:0/3375395073 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ac59ddd0d0 con 0x55ac59f40ad0 2023-09-13T09:41:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.559+0000 7f47e4ff9700 10 client.15915 handle_command_reply: tid=0 2023-09-13T09:41:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.559+0000 7f480f468b80 1 client.15915 shutdown 2023-09-13T09:41:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.559+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed6b90 msgr2=0x55ac59ee30c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.559+0000 7f480f468b80 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed6b90 0x55ac59ee30c0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f47ec011720 tx=0x7f47ec0047c0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 shutdown_connections 2023-09-13T09:41:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac59ed74f0 0x55ac59ee3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac59ed5e90 0x55ac59ee6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ac59f40ad0 0x55ac59f42ef0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 --2- 172.21.15.6:0/3375395073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac59ed6b90 0x55ac59ee30c0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f47e4ff9700 0 client.15915 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 >> 172.21.15.6:0/3375395073 conn(0x55ac59e2fd00 msgr2=0x55ac59ed9d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 shutdown_connections 2023-09-13T09:41:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 1 -- 172.21.15.6:0/3375395073 wait complete. 2023-09-13T09:41:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f480f468b80 20 client.15915 trim_cache size 0 max 16384 2023-09-13T09:41:18.579 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:41:18.579 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:41:18.579 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "46894211-4bdd-4746-8299-5ad836d8b0f8", 2023-09-13T09:41:18.580 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:41:18.580 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:41:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47e80a0640 msgr2=0x7f47e80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47e80a0640 0x7f47e80a2b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f47ec005950 tx=0x7f47ec00b410 comp rx=0 tx=0).stop 2023-09-13T09:41:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 msgr2=0x7f47fc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc068b80 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009f50 tx=0x7f47f8005720 comp rx=0 tx=0).stop 2023-09-13T09:41:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 shutdown_connections 2023-09-13T09:41:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47fc101850 0x7f47fc19dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47e80a0640 0x7f47e80a2b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47fc0ffcc0 0x7f47fc068b80 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 --2- 172.21.15.6:0/1795424615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47fc100eb0 0x7f47fc19b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 >> 172.21.15.6:0/1795424615 conn(0x7f47fc0fb250 msgr2=0x7f47fc0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.560+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 shutdown_connections 2023-09-13T09:41:18.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.561+0000 7f4803283700 1 -- 172.21.15.6:0/1795424615 wait complete. 2023-09-13T09:41:18.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:41:18.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 -- 172.21.15.6:0/721045929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84102910 msgr2=0x7f7c841091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/721045929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84102910 0x7f7c841091c0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c00b0d0 tx=0x7f7c7c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 -- 172.21.15.6:0/721045929 shutdown_connections 2023-09-13T09:41:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/721045929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84102910 0x7f7c841091c0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/721045929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c84100d80 0x7f7c841011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/721045929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c84101f70 0x7f7c841023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 -- 172.21.15.6:0/721045929 >> 172.21.15.6:0/721045929 conn(0x7f7c840fc310 msgr2=0x7f7c840fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 -- 172.21.15.6:0/721045929 shutdown_connections 2023-09-13T09:41:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 -- 172.21.15.6:0/721045929 wait complete. 2023-09-13T09:41:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 Processor -- start 2023-09-13T09:41:18.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.716+0000 7f7c8a91b700 1 -- start start 2023-09-13T09:41:18.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c8a91b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84100d80 0x7f7c84196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c8a91b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c84101f70 0x7f7c841970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c8a91b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c84102910 0x7f7c8419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c8a91b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8419e700 con 0x7f7c84100d80 2023-09-13T09:41:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c8a91b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8419e840 con 0x7f7c84101f70 2023-09-13T09:41:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c8a91b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c8419e9d0 con 0x7f7c84102910 2023-09-13T09:41:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84100d80 0x7f7c84196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84100d80 0x7f7c84196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35062/0 (socket says 172.21.15.6:35062) 2023-09-13T09:41:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 -- 172.21.15.6:0/3382472811 learned_addr learned my addr 172.21.15.6:0/3382472811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c84101f70 0x7f7c841970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c84102910 0x7f7c8419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 -- 172.21.15.6:0/3382472811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c84102910 msgr2=0x7f7c8419e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c84102910 0x7f7c8419e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 -- 172.21.15.6:0/3382472811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c84101f70 msgr2=0x7f7c841970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c84101f70 0x7f7c841970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 -- 172.21.15.6:0/3382472811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c009d00 con 0x7f7c84100d80 2023-09-13T09:41:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.717+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84100d80 0x7f7c84196b80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00d980 tx=0x7f7c6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.718+0000 7f7c817fa700 1 -- 172.21.15.6:0/3382472811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c004020 con 0x7f7c84100d80 2023-09-13T09:41:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.718+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8419ecb0 con 0x7f7c84100d80 2023-09-13T09:41:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.718+0000 7f7c817fa700 1 -- 172.21.15.6:0/3382472811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c6c00f690 con 0x7f7c84100d80 2023-09-13T09:41:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.718+0000 7f7c817fa700 1 -- 172.21.15.6:0/3382472811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c003a60 con 0x7f7c84100d80 2023-09-13T09:41:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.718+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c8419f1c0 con 0x7f7c84100d80 2023-09-13T09:41:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.720+0000 7f7c817fa700 1 -- 172.21.15.6:0/3382472811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7c6c00fb00 con 0x7f7c84100d80 2023-09-13T09:41:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.720+0000 7f7c817fa700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7c700a0640 0x7f7c700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.721+0000 7f7c817fa700 1 -- 172.21.15.6:0/3382472811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c6c0cb800 con 0x7f7c84100d80 2023-09-13T09:41:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.721+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7c700a0640 0x7f7c700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.721+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7c700a0640 0x7f7c700a2b00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c74005950 tx=0x7f7c7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.721+0000 7f7c96b00b80 1 Processor -- start 2023-09-13T09:41:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.721+0000 7f7c96b00b80 1 -- start start 2023-09-13T09:41:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0eb10 0x556134b0ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0f470 0x556134b0d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b0e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134a62780 con 0x556134b0de10 2023-09-13T09:41:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134a600a0 con 0x556134b0f470 2023-09-13T09:41:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134a5b990 con 0x556134b0eb10 2023-09-13T09:41:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b0e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b0e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35074/0 (socket says 172.21.15.6:35074) 2023-09-13T09:41:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 -- 172.21.15.6:0/3815947960 learned_addr learned my addr 172.21.15.6:0/3815947960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0f470 0x556134b0d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0eb10 0x556134b0ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 -- 172.21.15.6:0/3815947960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0eb10 msgr2=0x556134b0ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0eb10 0x556134b0ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 -- 172.21.15.6:0/3815947960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0f470 msgr2=0x556134b0d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0f470 0x556134b0d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 -- 172.21.15.6:0/3815947960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561348db630 con 0x556134b0de10 2023-09-13T09:41:18.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b0e270 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c005b90 tx=0x7f7c7c009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc04ede61f2f793 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c7a7fc700 1 -- 172.21.15.6:0/3815947960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c00e050 con 0x556134b0de10 2023-09-13T09:41:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c7a7fc700 1 -- 172.21.15.6:0/3815947960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c7c0077e0 con 0x556134b0de10 2023-09-13T09:41:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.722+0000 7f7c7a7fc700 1 -- 172.21.15.6:0/3815947960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7c005490 con 0x556134b0de10 2023-09-13T09:41:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3815947960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 msgr2=0x556134b0e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b0e270 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c005b90 tx=0x7f7c7c009b80 comp rx=0 tx=0).stop 2023-09-13T09:41:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3815947960 shutdown_connections 2023-09-13T09:41:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b0e270 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0eb10 0x556134b0ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3815947960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0f470 0x556134b0d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3815947960 >> 172.21.15.6:0/3815947960 conn(0x556134a67c80 msgr2=0x556134b03f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3815947960 shutdown_connections 2023-09-13T09:41:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3815947960 wait complete. 2023-09-13T09:41:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.723+0000 7f7c96b00b80 1 -- start start 2023-09-13T09:41:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 1 Processor -- start 2023-09-13T09:41:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b172d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0eb10 0x556134b17810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561349f9bb0 con 0x556134b0de10 2023-09-13T09:41:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561349f98b0 con 0x556134b0eb10 2023-09-13T09:41:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561348dd920 con 0x556134b0f470 2023-09-13T09:41:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c96b00b80 10 client.0 _ll_register_callbacks cb 0x5561349f7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b172d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b172d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35076/0 (socket says 172.21.15.6:35076) 2023-09-13T09:41:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 -- 172.21.15.6:0/1134867377 learned_addr learned my addr 172.21.15.6:0/1134867377 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c837fe700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0eb10 0x556134b17810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 -- 172.21.15.6:0/1134867377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 msgr2=0x556134b1e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 -- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0eb10 msgr2=0x556134b17810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0eb10 0x556134b17810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c83fff700 1 -- 172.21.15.6:0/1134867377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c84109b10 con 0x556134b0de10 2023-09-13T09:41:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.724+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c83fff700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b172d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00be80 tx=0x7f7c6c099640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7590357ac7106fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c637fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c637fe700 1 -- 172.21.15.6:0/1134867377 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0a0fb0 con 0x556134b0de10 2023-09-13T09:41:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c637fe700 1 -- 172.21.15.6:0/1134867377 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c6c0b8040 con 0x556134b0de10 2023-09-13T09:41:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556134afc670 con 0x556134b0de10 2023-09-13T09:41:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c637fe700 1 -- 172.21.15.6:0/1134867377 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c6c0232f0 con 0x556134b0de10 2023-09-13T09:41:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 10 client.15927 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556134a737a0 con 0x556134b0de10 2023-09-13T09:41:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c637fe700 1 -- 172.21.15.6:0/1134867377 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556134afc670 con 0x556134b0de10 2023-09-13T09:41:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c637fe700 1 -- 172.21.15.6:0/1134867377 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7c6c062070 con 0x556134b0de10 2023-09-13T09:41:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 10 client.15927 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 10 client.15927 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 20 client.15927 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b23050 0x556134b25470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 4 client.15927 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.725+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556134a54970 con 0x556134b23050 2023-09-13T09:41:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.726+0000 7f7c837fe700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b23050 0x556134b25470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.726+0000 7f7c637fe700 10 client.15927 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.726+0000 7f7c837fe700 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b23050 0x556134b25470 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50d9d47156aed6d7 server_cookie=8ef9c5992452c76d in_seq=0 out_seq=0 2023-09-13T09:41:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c637fe700 1 -- 172.21.15.6:0/1134867377 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556134a54970 con 0x556134b23050 2023-09-13T09:41:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c637fe700 10 client.15927 handle_command_reply: tid=0 2023-09-13T09:41:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 client.15927 shutdown 2023-09-13T09:41:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 msgr2=0x556134b172d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b172d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00be80 tx=0x7f7c6c099640 comp rx=0 tx=0).stop 2023-09-13T09:41:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 shutdown_connections 2023-09-13T09:41:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b23050 0x556134b25470 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0de10 0x556134b172d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/1134867377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0eb10 0x556134b17810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c637fe700 0 client.15927 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 >> 172.21.15.6:0/1134867377 conn(0x556134a67c80 msgr2=0x556134b03ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 shutdown_connections 2023-09-13T09:41:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 1 -- 172.21.15.6:0/1134867377 wait complete. 2023-09-13T09:41:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.727+0000 7f7c96b00b80 20 client.15927 trim_cache size 0 max 16384 2023-09-13T09:41:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 Processor -- start 2023-09-13T09:41:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 -- start start 2023-09-13T09:41:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b15f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b11d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134b20510 con 0x556134b0eb10 2023-09-13T09:41:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134b22b70 con 0x556134b0de10 2023-09-13T09:41:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134b05730 con 0x556134b0f470 2023-09-13T09:41:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35086/0 (socket says 172.21.15.6:35086) 2023-09-13T09:41:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 -- 172.21.15.6:0/3624554601 learned_addr learned my addr 172.21.15.6:0/3624554601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b15f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b11d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 -- 172.21.15.6:0/3624554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 msgr2=0x556134b11d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b11d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 -- 172.21.15.6:0/3624554601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 msgr2=0x556134b15f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b15f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c837fe700 1 -- 172.21.15.6:0/3624554601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556134887de0 con 0x556134b0eb10 2023-09-13T09:41:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.744+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b11d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1e810 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7c74005d90 tx=0x7f7c74013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1781501bf75fd5db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c7affd700 1 -- 172.21.15.6:0/3624554601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74024040 con 0x556134b0eb10 2023-09-13T09:41:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c7affd700 1 -- 172.21.15.6:0/3624554601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c74015070 con 0x556134b0eb10 2023-09-13T09:41:18.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c7affd700 1 -- 172.21.15.6:0/3624554601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c740054e0 con 0x556134b0eb10 2023-09-13T09:41:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3624554601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 msgr2=0x556134b1e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1e810 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7c74005d90 tx=0x7f7c74013000 comp rx=0 tx=0).stop 2023-09-13T09:41:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3624554601 shutdown_connections 2023-09-13T09:41:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b11d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b15f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3624554601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1e810 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3624554601 >> 172.21.15.6:0/3624554601 conn(0x556134a67c80 msgr2=0x556134b03ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3624554601 shutdown_connections 2023-09-13T09:41:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.745+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3624554601 wait complete. 2023-09-13T09:41:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 -- start start 2023-09-13T09:41:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 Processor -- start 2023-09-13T09:41:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b1a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134b1e220 con 0x556134b0eb10 2023-09-13T09:41:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134b1e390 con 0x556134b0de10 2023-09-13T09:41:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556134b1e550 con 0x556134b0f470 2023-09-13T09:41:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c96b00b80 10 client.0 _ll_register_callbacks cb 0x5561349f7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c83fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b1a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35092/0 (socket says 172.21.15.6:35092) 2023-09-13T09:41:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c837fe700 1 -- 172.21.15.6:0/3941231940 learned_addr learned my addr 172.21.15.6:0/3941231940 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.746+0000 7f7c88eb8700 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c83fff700 1 -- 172.21.15.6:0/3941231940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 msgr2=0x556134b1dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c83fff700 1 -- 172.21.15.6:0/3941231940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 msgr2=0x556134b1acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c83fff700 1 -- 172.21.15.6:0/3941231940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c74010e80 con 0x556134b0de10 2023-09-13T09:41:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c83fff700 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b1a780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c097290 tx=0x7f7c6c0988c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db379b8fd2b118fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c637fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:41:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c637fe700 1 -- 172.21.15.6:0/3941231940 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0a0fb0 con 0x556134b0de10 2023-09-13T09:41:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c637fe700 1 -- 172.21.15.6:0/3941231940 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7c6c0b8070 con 0x556134b0de10 2023-09-13T09:41:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c7c0077e0 con 0x556134b0de10 2023-09-13T09:41:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c637fe700 1 -- 172.21.15.6:0/3941231940 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c6c0986a0 con 0x556134b0de10 2023-09-13T09:41:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c96b00b80 10 client.25493 fetch_fsmap learned FSMap version 29 2023-09-13T09:41:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.747+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x556134870c60 con 0x556134b0de10 2023-09-13T09:41:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c637fe700 1 -- 172.21.15.6:0/3941231940 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7c7c0077e0 con 0x556134b0de10 2023-09-13T09:41:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c637fe700 1 -- 172.21.15.6:0/3941231940 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 29) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f7c6c062070 con 0x556134b0de10 2023-09-13T09:41:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c96b00b80 10 client.25493 fetch_fsmap finished waiting for FSMap version 29 2023-09-13T09:41:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c96b00b80 10 client.25493 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c96b00b80 20 client.25493 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b77c50 0x556134b7a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c96b00b80 4 client.25493 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:41:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556134a15050 con 0x556134b77c50 2023-09-13T09:41:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b77c50 0x556134b7a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c637fe700 10 client.25493 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c837fe700 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b77c50 0x556134b7a070 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f0f67031c2c5c17 server_cookie=5839f289a7de1afd in_seq=0 out_seq=0 2023-09-13T09:41:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.748+0000 7f7c637fe700 1 -- 172.21.15.6:0/3941231940 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556134a15050 con 0x556134b77c50 2023-09-13T09:41:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c637fe700 10 client.25493 handle_command_reply: tid=0 2023-09-13T09:41:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 client.25493 shutdown 2023-09-13T09:41:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 msgr2=0x556134b1a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b1a780 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c097290 tx=0x7f7c6c0988c0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 shutdown_connections 2023-09-13T09:41:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556134b0f470 0x556134b1dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556134b0de10 0x556134b1a780 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556134b77c50 0x556134b7a070 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 --2- 172.21.15.6:0/3941231940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556134b0eb10 0x556134b1acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c637fe700 0 client.25493 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 >> 172.21.15.6:0/3941231940 conn(0x556134a67c80 msgr2=0x556134b11d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 shutdown_connections 2023-09-13T09:41:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 1 -- 172.21.15.6:0/3941231940 wait complete. 2023-09-13T09:41:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c96b00b80 20 client.25493 trim_cache size 0 max 16384 2023-09-13T09:41:18.770 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:41:18.770 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:41:18.770 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:41:18.770 INFO:teuthology.orchestra.run.smithi006.stdout: "46894211-4bdd-4746-8299-5ad836d8b0f8": { 2023-09-13T09:41:18.770 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:41:18.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "46894211-4bdd-4746-8299-5ad836d8b0f8", 2023-09-13T09:41:18.771 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:41:18.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:41:18.771 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:41:18.771 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:41:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7c700a0640 msgr2=0x7f7c700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7c700a0640 0x7f7c700a2b00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7c74005950 tx=0x7f7c7400b410 comp rx=0 tx=0).stop 2023-09-13T09:41:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84100d80 msgr2=0x7f7c84196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84100d80 0x7f7c84196b80 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c00d980 tx=0x7f7c6c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:41:18.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 shutdown_connections 2023-09-13T09:41:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c84102910 0x7f7c8419e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7c700a0640 0x7f7c700a2b00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c84100d80 0x7f7c84196b80 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 --2- 172.21.15.6:0/3382472811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7c84101f70 0x7f7c841970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.749+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 >> 172.21.15.6:0/3382472811 conn(0x7f7c840fc310 msgr2=0x7f7c840fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.750+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 shutdown_connections 2023-09-13T09:41:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:18.750+0000 7f7c8a91b700 1 -- 172.21.15.6:0/3382472811 wait complete. 2023-09-13T09:41:18.775 INFO:tasks.cephfs.filesystem:scrub status for tag:46894211-4bdd-4746-8299-5ad836d8b0f8 - {'path': '/', 'tag': '46894211-4bdd-4746-8299-5ad836d8b0f8', 'options': 'recursive,force'} 2023-09-13T09:41:19.146 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61118 8.88 MB/sec warmup 39 sec latency 1423.675 ms 2023-09-13T09:41:20.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61118 8.66 MB/sec warmup 40 sec latency 1495.075 ms 2023-09-13T09:41:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: pgmap v354: 97 pgs: 97 active+clean; 42 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 6.2 MiB/s wr, 233 op/s 2023-09-13T09:41:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:41:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:19 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:41:20.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: pgmap v354: 97 pgs: 97 active+clean; 42 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 6.2 MiB/s wr, 233 op/s 2023-09-13T09:41:20.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:41:20.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:20.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:20.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:20.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:20.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:20.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:20.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:20.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:19 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:41:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: pgmap v354: 97 pgs: 97 active+clean; 42 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 6.2 MiB/s wr, 233 op/s 2023-09-13T09:41:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:41:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:20.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:19 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:41:21.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61118 8.45 MB/sec warmup 41 sec latency 2495.159 ms 2023-09-13T09:41:21.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:20 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:41:21.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:20 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:41:21.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:20 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:41:21.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:20 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:41:21.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:20 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:41:21.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:20 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:41:21.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:20 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:41:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:20 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:41:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:20 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:41:22.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61119 8.25 MB/sec warmup 42 sec latency 3492.298 ms 2023-09-13T09:41:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:21 smithi006 ceph-mon[98665]: pgmap v355: 97 pgs: 97 active+clean; 41 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 5.9 MiB/s wr, 198 op/s 2023-09-13T09:41:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:21 smithi053 ceph-mon[102373]: pgmap v355: 97 pgs: 97 active+clean; 41 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 5.9 MiB/s wr, 198 op/s 2023-09-13T09:41:22.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:21 smithi131 ceph-mon[102785]: pgmap v355: 97 pgs: 97 active+clean; 41 MiB data, 531 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 5.9 MiB/s wr, 198 op/s 2023-09-13T09:41:23.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61307 8.07 MB/sec warmup 43 sec latency 893.152 ms 2023-09-13T09:41:24.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61307 7.88 MB/sec warmup 44 sec latency 1893.250 ms 2023-09-13T09:41:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:23 smithi053 ceph-mon[102373]: pgmap v356: 97 pgs: 97 active+clean; 41 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2023-09-13T09:41:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:23 smithi006 ceph-mon[98665]: pgmap v356: 97 pgs: 97 active+clean; 41 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2023-09-13T09:41:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:23 smithi131 ceph-mon[102785]: pgmap v356: 97 pgs: 97 active+clean; 41 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 337 KiB/s rd, 5.9 MiB/s wr, 206 op/s 2023-09-13T09:41:25.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61307 7.71 MB/sec warmup 45 sec latency 2893.367 ms 2023-09-13T09:41:26.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61307 7.54 MB/sec warmup 46 sec latency 3893.487 ms 2023-09-13T09:41:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:25 smithi006 ceph-mon[98665]: pgmap v357: 97 pgs: 97 active+clean; 41 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 5.8 MiB/s wr, 199 op/s 2023-09-13T09:41:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:25 smithi053 ceph-mon[102373]: pgmap v357: 97 pgs: 97 active+clean; 41 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 5.8 MiB/s wr, 199 op/s 2023-09-13T09:41:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:25 smithi131 ceph-mon[102785]: pgmap v357: 97 pgs: 97 active+clean; 41 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 5.8 MiB/s wr, 199 op/s 2023-09-13T09:41:27.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 61308 7.38 MB/sec warmup 47 sec latency 4888.660 ms 2023-09-13T09:41:28.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 63872 7.57 MB/sec warmup 48 sec latency 16.303 ms 2023-09-13T09:41:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:27 smithi006 ceph-mon[98665]: pgmap v358: 97 pgs: 97 active+clean; 40 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 3.2 MiB/s wr, 132 op/s 2023-09-13T09:41:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:27 smithi053 ceph-mon[102373]: pgmap v358: 97 pgs: 97 active+clean; 40 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 3.2 MiB/s wr, 132 op/s 2023-09-13T09:41:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:27 smithi131 ceph-mon[102785]: pgmap v358: 97 pgs: 97 active+clean; 40 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 261 KiB/s rd, 3.2 MiB/s wr, 132 op/s 2023-09-13T09:41:29.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64592 7.46 MB/sec warmup 49 sec latency 157.757 ms 2023-09-13T09:41:30.147 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64592 7.31 MB/sec warmup 50 sec latency 1157.803 ms 2023-09-13T09:41:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:29 smithi006 ceph-mon[98665]: pgmap v359: 97 pgs: 97 active+clean; 40 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 75 KiB/s wr, 39 op/s 2023-09-13T09:41:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:29 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:41:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:29 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:41:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:29 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:41:30.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:29 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:41:30.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:29 smithi053 ceph-mon[102373]: pgmap v359: 97 pgs: 97 active+clean; 40 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 75 KiB/s wr, 39 op/s 2023-09-13T09:41:30.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:29 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:41:30.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:29 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:41:30.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:29 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:41:30.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:29 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:41:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:29 smithi131 ceph-mon[102785]: pgmap v359: 97 pgs: 97 active+clean; 40 MiB data, 543 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 75 KiB/s wr, 39 op/s 2023-09-13T09:41:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:29 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:41:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:29 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:41:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:29 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:41:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:29 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:41:31.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64592 7.16 MB/sec warmup 51 sec latency 2157.905 ms 2023-09-13T09:41:31.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:41:31.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:41:31.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:41:32.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64604 7.03 MB/sec warmup 52 sec latency 3147.135 ms 2023-09-13T09:41:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:31 smithi053 ceph-mon[102373]: pgmap v360: 97 pgs: 97 active+clean; 41 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 93 KiB/s wr, 31 op/s 2023-09-13T09:41:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:31 smithi006 ceph-mon[98665]: pgmap v360: 97 pgs: 97 active+clean; 41 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 93 KiB/s wr, 31 op/s 2023-09-13T09:41:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:31 smithi131 ceph-mon[102785]: pgmap v360: 97 pgs: 97 active+clean; 41 MiB data, 544 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 93 KiB/s wr, 31 op/s 2023-09-13T09:41:33.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64660 6.90 MB/sec warmup 53 sec latency 962.518 ms 2023-09-13T09:41:34.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64660 6.77 MB/sec warmup 54 sec latency 1962.560 ms 2023-09-13T09:41:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:33 smithi053 ceph-mon[102373]: pgmap v361: 97 pgs: 97 active+clean; 42 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 179 KiB/s wr, 60 op/s 2023-09-13T09:41:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:33 smithi006 ceph-mon[98665]: pgmap v361: 97 pgs: 97 active+clean; 42 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 179 KiB/s wr, 60 op/s 2023-09-13T09:41:34.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:33 smithi131 ceph-mon[102785]: pgmap v361: 97 pgs: 97 active+clean; 42 MiB data, 546 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 179 KiB/s wr, 60 op/s 2023-09-13T09:41:35.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64660 6.65 MB/sec warmup 55 sec latency 2962.598 ms 2023-09-13T09:41:36.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64660 6.53 MB/sec warmup 56 sec latency 3962.681 ms 2023-09-13T09:41:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:35 smithi006 ceph-mon[98665]: pgmap v362: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 187 KiB/s wr, 53 op/s 2023-09-13T09:41:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:35 smithi053 ceph-mon[102373]: pgmap v362: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 187 KiB/s wr, 53 op/s 2023-09-13T09:41:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:35 smithi131 ceph-mon[102785]: pgmap v362: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 187 KiB/s wr, 53 op/s 2023-09-13T09:41:37.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 64672 6.42 MB/sec warmup 57 sec latency 4953.573 ms 2023-09-13T09:41:38.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 67165 6.54 MB/sec warmup 58 sec latency 10.467 ms 2023-09-13T09:41:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:37 smithi053 ceph-mon[102373]: pgmap v363: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 171 KiB/s wr, 56 op/s 2023-09-13T09:41:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:37 smithi006 ceph-mon[98665]: pgmap v363: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 171 KiB/s wr, 56 op/s 2023-09-13T09:41:38.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:37 smithi131 ceph-mon[102785]: pgmap v363: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 171 KiB/s wr, 56 op/s 2023-09-13T09:41:39.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68143 6.52 MB/sec warmup 59 sec latency 35.028 ms 2023-09-13T09:41:40.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68143 6.41 MB/sec warmup 60 sec latency 1035.100 ms 2023-09-13T09:41:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:39 smithi006 ceph-mon[98665]: pgmap v364: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 161 KiB/s wr, 49 op/s 2023-09-13T09:41:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:39 smithi053 ceph-mon[102373]: pgmap v364: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 161 KiB/s wr, 49 op/s 2023-09-13T09:41:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:39 smithi131 ceph-mon[102785]: pgmap v364: 97 pgs: 97 active+clean; 42 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 189 KiB/s rd, 161 KiB/s wr, 49 op/s 2023-09-13T09:41:41.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68143 6.30 MB/sec warmup 61 sec latency 2035.223 ms 2023-09-13T09:41:42.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68158 6.20 MB/sec warmup 62 sec latency 3024.350 ms 2023-09-13T09:41:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:41 smithi006 ceph-mon[98665]: pgmap v365: 97 pgs: 97 active+clean; 42 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 179 KiB/s wr, 52 op/s 2023-09-13T09:41:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:41 smithi053 ceph-mon[102373]: pgmap v365: 97 pgs: 97 active+clean; 42 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 179 KiB/s wr, 52 op/s 2023-09-13T09:41:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:41 smithi131 ceph-mon[102785]: pgmap v365: 97 pgs: 97 active+clean; 42 MiB data, 548 MiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 179 KiB/s wr, 52 op/s 2023-09-13T09:41:43.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68211 6.11 MB/sec warmup 63 sec latency 961.009 ms 2023-09-13T09:41:44.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68211 6.01 MB/sec warmup 64 sec latency 1961.114 ms 2023-09-13T09:41:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:43 smithi053 ceph-mon[102373]: pgmap v366: 97 pgs: 97 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 279 KiB/s wr, 83 op/s 2023-09-13T09:41:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:43 smithi006 ceph-mon[98665]: pgmap v366: 97 pgs: 97 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 279 KiB/s wr, 83 op/s 2023-09-13T09:41:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:43 smithi131 ceph-mon[102785]: pgmap v366: 97 pgs: 97 active+clean; 43 MiB data, 551 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 279 KiB/s wr, 83 op/s 2023-09-13T09:41:45.148 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68211 5.92 MB/sec warmup 65 sec latency 2961.162 ms 2023-09-13T09:41:46.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68211 5.83 MB/sec warmup 66 sec latency 3961.257 ms 2023-09-13T09:41:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:45 smithi006 ceph-mon[98665]: pgmap v367: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 220 KiB/s wr, 57 op/s 2023-09-13T09:41:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:45 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:45 smithi053 ceph-mon[102373]: pgmap v367: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 220 KiB/s wr, 57 op/s 2023-09-13T09:41:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:45 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:45 smithi131 ceph-mon[102785]: pgmap v367: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 220 KiB/s wr, 57 op/s 2023-09-13T09:41:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:45 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:41:47.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 68223 5.74 MB/sec warmup 67 sec latency 4950.390 ms 2023-09-13T09:41:48.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 70313 5.83 MB/sec warmup 68 sec latency 14.326 ms 2023-09-13T09:41:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:47 smithi053 ceph-mon[102373]: pgmap v368: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 215 KiB/s wr, 61 op/s 2023-09-13T09:41:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:47 smithi006 ceph-mon[98665]: pgmap v368: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 215 KiB/s wr, 61 op/s 2023-09-13T09:41:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:47 smithi131 ceph-mon[102785]: pgmap v368: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 215 KiB/s wr, 61 op/s 2023-09-13T09:41:48.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:41:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 -- 172.21.15.6:0/3299408271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c100dc0 msgr2=0x7f5b3c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 --2- 172.21.15.6:0/3299408271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c1011e0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00b0d0 tx=0x7f5b2c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 -- 172.21.15.6:0/3299408271 shutdown_connections 2023-09-13T09:41:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 --2- 172.21.15.6:0/3299408271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b3c102950 0x7f5b3c109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 --2- 172.21.15.6:0/3299408271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c1011e0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 --2- 172.21.15.6:0/3299408271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c101fb0 0x7f5b3c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 -- 172.21.15.6:0/3299408271 >> 172.21.15.6:0/3299408271 conn(0x7f5b3c0fc330 msgr2=0x7f5b3c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 -- 172.21.15.6:0/3299408271 shutdown_connections 2023-09-13T09:41:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.908+0000 7f5b440d1700 1 -- 172.21.15.6:0/3299408271 wait complete. 2023-09-13T09:41:48.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 Processor -- start 2023-09-13T09:41:48.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 -- start start 2023-09-13T09:41:48.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c101fb0 0x7f5b3c197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b3c102950 0x7f5b3c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c19e760 con 0x7f5b3c101fb0 2023-09-13T09:41:48.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c19e8d0 con 0x7f5b3c100dc0 2023-09-13T09:41:48.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b440d1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b3c19ea90 con 0x7f5b3c102950 2023-09-13T09:41:48.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c101fb0 0x7f5b3c197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b41e6d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c101fb0 0x7f5b3c197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35104/0 (socket says 172.21.15.6:35104) 2023-09-13T09:41:48.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b41e6d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56858/0 (socket says 172.21.15.6:56858) 2023-09-13T09:41:48.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b4166c700 1 -- 172.21.15.6:0/2422964092 learned_addr learned my addr 172.21.15.6:0/2422964092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:48.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b4266e700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b3c102950 0x7f5b3c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b41e6d700 1 -- 172.21.15.6:0/2422964092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b3c102950 msgr2=0x7f5b3c19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b3c102950 0x7f5b3c19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b41e6d700 1 -- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c101fb0 msgr2=0x7f5b3c197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c101fb0 0x7f5b3c197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b41e6d700 1 -- 172.21.15.6:0/2422964092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c009d00 con 0x7f5b3c100dc0 2023-09-13T09:41:48.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.909+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c101fb0 0x7f5b3c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:48.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.910+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c196c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00b770 tx=0x7f5b2c008f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:48.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.910+0000 7f5b3affd700 1 -- 172.21.15.6:0/2422964092 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c00e040 con 0x7f5b3c100dc0 2023-09-13T09:41:48.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.910+0000 7f5b3affd700 1 -- 172.21.15.6:0/2422964092 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b2c005070 con 0x7f5b3c100dc0 2023-09-13T09:41:48.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.910+0000 7f5b3affd700 1 -- 172.21.15.6:0/2422964092 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c01d6d0 con 0x7f5b3c100dc0 2023-09-13T09:41:48.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.910+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b3c19ed10 con 0x7f5b3c100dc0 2023-09-13T09:41:48.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.910+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b3c19f130 con 0x7f5b3c100dc0 2023-09-13T09:41:48.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.912+0000 7f5b3affd700 1 -- 172.21.15.6:0/2422964092 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5b2c0051e0 con 0x7f5b3c100dc0 2023-09-13T09:41:48.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.912+0000 7f5b3affd700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b240a06c0 0x7f5b240a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.913+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b240a06c0 0x7f5b240a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.913+0000 7f5b3affd700 1 -- 172.21.15.6:0/2422964092 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5b2c0ccb40 con 0x7f5b3c100dc0 2023-09-13T09:41:48.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.913+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b240a06c0 0x7f5b240a2b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5b30011550 tx=0x7f5b30009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:48.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.913+0000 7f5b502b6b80 1 Processor -- start 2023-09-13T09:41:48.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.913+0000 7f5b502b6b80 1 -- start start 2023-09-13T09:41:48.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e10b10 0x55ec92e10f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e11470 0x55ec92e0f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e10270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92d64780 con 0x55ec92e11470 2023-09-13T09:41:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92d620a0 con 0x55ec92e0fe10 2023-09-13T09:41:48.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92d5d990 con 0x55ec92e10b10 2023-09-13T09:41:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e11470 0x55ec92e0f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e11470 0x55ec92e0f8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35112/0 (socket says 172.21.15.6:35112) 2023-09-13T09:41:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 -- 172.21.15.6:0/2072341113 learned_addr learned my addr 172.21.15.6:0/2072341113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:48.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e10b10 0x55ec92e10f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4266e700 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e10270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 -- 172.21.15.6:0/2072341113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e10b10 msgr2=0x55ec92e10f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e10b10 0x55ec92e10f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 -- 172.21.15.6:0/2072341113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 msgr2=0x55ec92e10270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e10270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 -- 172.21.15.6:0/2072341113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec92bdd630 con 0x55ec92e11470 2023-09-13T09:41:48.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e11470 0x55ec92e0f8d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009880 tx=0x7f5b30014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c406936b0759b77e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:48.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b23fff700 1 -- 172.21.15.6:0/2072341113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30026630 con 0x55ec92e11470 2023-09-13T09:41:48.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.914+0000 7f5b23fff700 1 -- 172.21.15.6:0/2072341113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b30021070 con 0x55ec92e11470 2023-09-13T09:41:48.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b23fff700 1 -- 172.21.15.6:0/2072341113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3001d670 con 0x55ec92e11470 2023-09-13T09:41:48.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2072341113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e11470 msgr2=0x55ec92e0f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e11470 0x55ec92e0f8d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009880 tx=0x7f5b30014000 comp rx=0 tx=0).stop 2023-09-13T09:41:48.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2072341113 shutdown_connections 2023-09-13T09:41:48.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e10270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e10b10 0x55ec92e10f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2072341113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e11470 0x55ec92e0f8d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2072341113 >> 172.21.15.6:0/2072341113 conn(0x55ec92d69c80 msgr2=0x55ec92e05f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:48.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2072341113 shutdown_connections 2023-09-13T09:41:48.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.915+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2072341113 wait complete. 2023-09-13T09:41:48.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 -- start start 2023-09-13T09:41:48.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 Processor -- start 2023-09-13T09:41:48.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e19330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e19870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e208b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92cfbbb0 con 0x55ec92e10b10 2023-09-13T09:41:48.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92cfb8b0 con 0x55ec92e0fe10 2023-09-13T09:41:48.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92bdf920 con 0x55ec92e11470 2023-09-13T09:41:48.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b502b6b80 10 client.0 _ll_register_callbacks cb 0x55ec92cf9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:48.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e19870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e19870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35118/0 (socket says 172.21.15.6:35118) 2023-09-13T09:41:48.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b4166c700 1 -- 172.21.15.6:0/208609809 learned_addr learned my addr 172.21.15.6:0/208609809 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:48.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e19330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.916+0000 7f5b4266e700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e208b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b4166c700 1 -- 172.21.15.6:0/208609809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 msgr2=0x55ec92e208b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b4166c700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e208b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b4166c700 1 -- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 msgr2=0x55ec92e19330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b4166c700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e19330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b4166c700 1 -- 172.21.15.6:0/208609809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b30017070 con 0x55ec92e10b10 2023-09-13T09:41:48.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e19330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:48.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b4166c700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e19870 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009810 tx=0x7f5b3000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e3c7f183288b470 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:48.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b217fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:48.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b217fa700 1 -- 172.21.15.6:0/208609809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3001c720 con 0x55ec92e10b10 2023-09-13T09:41:48.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b217fa700 1 -- 172.21.15.6:0/208609809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5b3001c880 con 0x55ec92e10b10 2023-09-13T09:41:48.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ec92dfe670 con 0x55ec92e10b10 2023-09-13T09:41:48.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b217fa700 1 -- 172.21.15.6:0/208609809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b30005040 con 0x55ec92e10b10 2023-09-13T09:41:48.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b502b6b80 10 client.15945 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ec92d757a0 con 0x55ec92e10b10 2023-09-13T09:41:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b217fa700 1 -- 172.21.15.6:0/208609809 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b3003e080 con 0x55ec92e10b10 2023-09-13T09:41:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b217fa700 1 -- 172.21.15.6:0/208609809 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5b30004c40 con 0x55ec92e10b10 2023-09-13T09:41:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b502b6b80 10 client.15945 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.917+0000 7f5b502b6b80 10 client.15945 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:48.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.918+0000 7f5b502b6b80 20 client.15945 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.918+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e250e0 0x55ec92e27500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.918+0000 7f5b502b6b80 4 client.15945 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.918+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ec92d56970 con 0x55ec92e250e0 2023-09-13T09:41:48.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.918+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e250e0 0x55ec92e27500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.918+0000 7f5b217fa700 10 client.15945 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.918+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e250e0 0x55ec92e27500 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82e3a599d38dbcac server_cookie=459c4c9b9a630573 in_seq=0 out_seq=0 2023-09-13T09:41:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b217fa700 1 -- 172.21.15.6:0/208609809 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ec92d56970 con 0x55ec92e250e0 2023-09-13T09:41:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b217fa700 10 client.15945 handle_command_reply: tid=0 2023-09-13T09:41:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 client.15945 shutdown 2023-09-13T09:41:48.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 msgr2=0x55ec92e19870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e19870 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5b30009810 tx=0x7f5b3000ee40 comp rx=0 tx=0).stop 2023-09-13T09:41:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 shutdown_connections 2023-09-13T09:41:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e208b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e19330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e250e0 0x55ec92e27500 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/208609809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e19870 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b217fa700 0 client.15945 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 >> 172.21.15.6:0/208609809 conn(0x55ec92d69c80 msgr2=0x55ec92e007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:48.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 shutdown_connections 2023-09-13T09:41:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 1 -- 172.21.15.6:0/208609809 wait complete. 2023-09-13T09:41:48.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.919+0000 7f5b502b6b80 20 client.15945 trim_cache size 0 max 16384 2023-09-13T09:41:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.936+0000 7f5b502b6b80 1 Processor -- start 2023-09-13T09:41:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.936+0000 7f5b502b6b80 1 -- start start 2023-09-13T09:41:48.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e274d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e20870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e05e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92e18ef0 con 0x55ec92e10b10 2023-09-13T09:41:48.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92e17ae0 con 0x55ec92e0fe10 2023-09-13T09:41:48.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92e17050 con 0x55ec92e11470 2023-09-13T09:41:48.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e20870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e20870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35126/0 (socket says 172.21.15.6:35126) 2023-09-13T09:41:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 -- 172.21.15.6:0/2929199547 learned_addr learned my addr 172.21.15.6:0/2929199547 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:48.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e274d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 -- 172.21.15.6:0/2929199547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 msgr2=0x55ec92e05e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4266e700 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e05e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e05e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 -- 172.21.15.6:0/2929199547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 msgr2=0x55ec92e274d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e274d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 -- 172.21.15.6:0/2929199547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ec92b89de0 con 0x55ec92e10b10 2023-09-13T09:41:48.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e274d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:48.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e20870 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000ec90 tx=0x7f5b3001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cedaf435d98d34 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:48.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b38ff9700 1 -- 172.21.15.6:0/2929199547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b30041070 con 0x55ec92e10b10 2023-09-13T09:41:48.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b38ff9700 1 -- 172.21.15.6:0/2929199547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ec92dfe670 con 0x55ec92e10b10 2023-09-13T09:41:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.937+0000 7f5b38ff9700 1 -- 172.21.15.6:0/2929199547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b3003a7b0 con 0x55ec92e10b10 2023-09-13T09:41:48.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2929199547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 msgr2=0x55ec92e20870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e20870 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f5b3000ec90 tx=0x7f5b3001c490 comp rx=0 tx=0).stop 2023-09-13T09:41:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2929199547 shutdown_connections 2023-09-13T09:41:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e05e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e0fe10 0x55ec92e274d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2929199547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e10b10 0x55ec92e20870 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2929199547 >> 172.21.15.6:0/2929199547 conn(0x55ec92d69c80 msgr2=0x55ec92e17ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2929199547 shutdown_connections 2023-09-13T09:41:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2929199547 wait complete. 2023-09-13T09:41:48.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 -- start start 2023-09-13T09:41:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.938+0000 7f5b502b6b80 1 Processor -- start 2023-09-13T09:41:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e0fe10 0x55ec92e1c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e10b10 0x55ec92e1c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b502b6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e1f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92e1fc10 con 0x55ec92e0fe10 2023-09-13T09:41:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92e1fd80 con 0x55ec92e10b10 2023-09-13T09:41:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b502b6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ec92e1ff40 con 0x55ec92e11470 2023-09-13T09:41:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b502b6b80 10 client.0 _ll_register_callbacks cb 0x55ec92cf9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e0fe10 0x55ec92e1c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e0fe10 0x55ec92e1c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35130/0 (socket says 172.21.15.6:35130) 2023-09-13T09:41:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 -- 172.21.15.6:0/2090080832 learned_addr learned my addr 172.21.15.6:0/2090080832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b4266e700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e1f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e10b10 0x55ec92e1c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 -- 172.21.15.6:0/2090080832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 msgr2=0x55ec92e1f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e1f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 -- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e10b10 msgr2=0x55ec92e1c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e10b10 0x55ec92e1c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 -- 172.21.15.6:0/2090080832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ec92d757a0 con 0x55ec92e0fe10 2023-09-13T09:41:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e10b10 0x55ec92e1c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:48.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b41e6d700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e0fe10 0x55ec92e1c170 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c000f80 tx=0x7f5b2c085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8737e3422f74cd52 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.939+0000 7f5b217fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b217fa700 1 -- 172.21.15.6:0/2090080832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c09aaa0 con 0x55ec92e0fe10 2023-09-13T09:41:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b217fa700 1 -- 172.21.15.6:0/2090080832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5b2c09a3a0 con 0x55ec92e0fe10 2023-09-13T09:41:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b30021070 con 0x55ec92e0fe10 2023-09-13T09:41:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b217fa700 1 -- 172.21.15.6:0/2090080832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b2c09e1d0 con 0x55ec92e0fe10 2023-09-13T09:41:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 10 client.15951 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55ec92b72c60 con 0x55ec92e0fe10 2023-09-13T09:41:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b217fa700 1 -- 172.21.15.6:0/2090080832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b30021070 con 0x55ec92e0fe10 2023-09-13T09:41:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b217fa700 1 -- 172.21.15.6:0/2090080832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5b2c0a00b0 con 0x55ec92e0fe10 2023-09-13T09:41:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 10 client.15951 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:48.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 20 client.15951 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e79690 0x55ec92e7bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 4 client.15951 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:41:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ec92d17050 con 0x55ec92e79690 2023-09-13T09:41:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.940+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e79690 0x55ec92e7bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b217fa700 10 client.15951 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b4166c700 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e79690 0x55ec92e7bab0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c03caefb9f189ce0 server_cookie=8e2660693a6ff6b4 in_seq=0 out_seq=0 2023-09-13T09:41:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b217fa700 1 -- 172.21.15.6:0/2090080832 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ec92d17050 con 0x55ec92e79690 2023-09-13T09:41:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b217fa700 10 client.15951 handle_command_reply: tid=0 2023-09-13T09:41:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 client.15951 shutdown 2023-09-13T09:41:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e0fe10 msgr2=0x55ec92e1c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e0fe10 0x55ec92e1c170 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c000f80 tx=0x7f5b2c085040 comp rx=0 tx=0).stop 2023-09-13T09:41:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 shutdown_connections 2023-09-13T09:41:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ec92e11470 0x55ec92e1f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ec92e79690 0x55ec92e7bab0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ec92e0fe10 0x55ec92e1c170 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 --2- 172.21.15.6:0/2090080832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ec92e10b10 0x55ec92e1c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b217fa700 0 client.15951 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:48.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 >> 172.21.15.6:0/2090080832 conn(0x55ec92d69c80 msgr2=0x55ec92e05e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:48.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 shutdown_connections 2023-09-13T09:41:48.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 1 -- 172.21.15.6:0/2090080832 wait complete. 2023-09-13T09:41:48.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.941+0000 7f5b502b6b80 20 client.15951 trim_cache size 0 max 16384 2023-09-13T09:41:48.988 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:41:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:41:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:41:48.988 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:41:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b240a06c0 msgr2=0x7f5b240a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b240a06c0 0x7f5b240a2b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f5b30011550 tx=0x7f5b30009260 comp rx=0 tx=0).stop 2023-09-13T09:41:48.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c100dc0 msgr2=0x7f5b3c196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c196c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c00b770 tx=0x7f5b2c008f10 comp rx=0 tx=0).stop 2023-09-13T09:41:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 shutdown_connections 2023-09-13T09:41:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b3c102950 0x7f5b3c19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5b3c100dc0 0x7f5b3c196c20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b240a06c0 0x7f5b240a2b80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 --2- 172.21.15.6:0/2422964092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b3c101fb0 0x7f5b3c197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 >> 172.21.15.6:0/2422964092 conn(0x7f5b3c0fc330 msgr2=0x7f5b3c0fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 shutdown_connections 2023-09-13T09:41:48.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:48.942+0000 7f5b440d1700 1 -- 172.21.15.6:0/2422964092 wait complete. 2023-09-13T09:41:48.993 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:41:48.993 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:41:49.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 -- 172.21.15.6:0/3344600783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680101f60 msgr2=0x7fa6801023c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 --2- 172.21.15.6:0/3344600783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680101f60 0x7fa6801023c0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fa6680099c0 tx=0x7fa668009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 -- 172.21.15.6:0/3344600783 shutdown_connections 2023-09-13T09:41:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 --2- 172.21.15.6:0/3344600783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa680102900 0x7fa6801091b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 --2- 172.21.15.6:0/3344600783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 0x7fa680101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 --2- 172.21.15.6:0/3344600783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680101f60 0x7fa6801023c0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 -- 172.21.15.6:0/3344600783 >> 172.21.15.6:0/3344600783 conn(0x7fa6800fc2e0 msgr2=0x7fa6800fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 -- 172.21.15.6:0/3344600783 shutdown_connections 2023-09-13T09:41:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.120+0000 7fa684d41700 1 -- 172.21.15.6:0/3344600783 wait complete. 2023-09-13T09:41:49.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 Processor -- start 2023-09-13T09:41:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 -- start start 2023-09-13T09:41:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 0x7fa680196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa680101f60 0x7fa680196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680102900 0x7fa68019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68019e5e0 con 0x7fa680102900 2023-09-13T09:41:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68019e720 con 0x7fa680101f60 2023-09-13T09:41:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa684d41700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68019e8b0 con 0x7fa680100d70 2023-09-13T09:41:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa67e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 0x7fa680196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa67ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680102900 0x7fa68019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa67e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 0x7fa680196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:38198/0 (socket says 172.21.15.6:38198) 2023-09-13T09:41:49.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.121+0000 7fa67e59c700 1 -- 172.21.15.6:0/1972239487 learned_addr learned my addr 172.21.15.6:0/1972239487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67dd9b700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa680101f60 0x7fa680196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67e59c700 1 -- 172.21.15.6:0/1972239487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa680101f60 msgr2=0x7fa680196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67e59c700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa680101f60 0x7fa680196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67e59c700 1 -- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680102900 msgr2=0x7fa68019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67e59c700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680102900 0x7fa68019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67e59c700 1 -- 172.21.15.6:0/1972239487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6680095f0 con 0x7fa680100d70 2023-09-13T09:41:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67ed9d700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680102900 0x7fa68019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:49.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa67e59c700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 0x7fa680196a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa67000d980 tx=0x7fa67000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa6777fe700 1 -- 172.21.15.6:0/1972239487 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67000f890 con 0x7fa680100d70 2023-09-13T09:41:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68019eb90 con 0x7fa680100d70 2023-09-13T09:41:49.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa6777fe700 1 -- 172.21.15.6:0/1972239487 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa670010460 con 0x7fa680100d70 2023-09-13T09:41:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa6777fe700 1 -- 172.21.15.6:0/1972239487 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6700195c0 con 0x7fa680100d70 2023-09-13T09:41:49.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.122+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68019f0f0 con 0x7fa680100d70 2023-09-13T09:41:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.123+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa680107cf0 con 0x7fa680100d70 2023-09-13T09:41:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.124+0000 7fa6777fe700 1 -- 172.21.15.6:0/1972239487 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa6700105d0 con 0x7fa680100d70 2023-09-13T09:41:49.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.125+0000 7fa6777fe700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa66c0a0640 0x7fa66c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.125+0000 7fa6777fe700 1 -- 172.21.15.6:0/1972239487 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa6700cbac0 con 0x7fa680100d70 2023-09-13T09:41:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.125+0000 7fa67dd9b700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa66c0a0640 0x7fa66c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.126+0000 7fa67dd9b700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa66c0a0640 0x7fa66c0a2b00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa668000c00 tx=0x7fa668009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.128+0000 7fa6777fe700 1 -- 172.21.15.6:0/1972239487 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa6700955a0 con 0x7fa680100d70 2023-09-13T09:41:49.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 71051 5.83 MB/sec warmup 69 sec latency 651.403 ms 2023-09-13T09:41:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.374+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa68002cfa0 con 0x7fa680100d70 2023-09-13T09:41:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.375+0000 7fa6777fe700 1 -- 172.21.15.6:0/1972239487 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11346 (secure 0 0 0) 0x7fa670098bc0 con 0x7fa680100d70 2023-09-13T09:41:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:41:49.375 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:41:44.012481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:41:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa66c0a0640 msgr2=0x7fa66c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa66c0a0640 0x7fa66c0a2b00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa668000c00 tx=0x7fa668009f10 comp rx=0 tx=0).stop 2023-09-13T09:41:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 msgr2=0x7fa680196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 0x7fa680196a60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa67000d980 tx=0x7fa67000dc90 comp rx=0 tx=0).stop 2023-09-13T09:41:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 shutdown_connections 2023-09-13T09:41:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa66c0a0640 0x7fa66c0a2b00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa680102900 0x7fa68019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa680100d70 0x7fa680196a60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 --2- 172.21.15.6:0/1972239487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa680101f60 0x7fa680196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 >> 172.21.15.6:0/1972239487 conn(0x7fa6800fc2e0 msgr2=0x7fa6800fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 shutdown_connections 2023-09-13T09:41:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.377+0000 7fa684d41700 1 -- 172.21.15.6:0/1972239487 wait complete. 2023-09-13T09:41:49.379 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 30 2023-09-13T09:41:49.390 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:41:49.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 -- 172.21.15.6:0/3350927257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641041d0 msgr2=0x7f08641065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 --2- 172.21.15.6:0/3350927257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641041d0 0x7f08641065c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f0854009990 tx=0x7f0854009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 -- 172.21.15.6:0/3350927257 shutdown_connections 2023-09-13T09:41:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 --2- 172.21.15.6:0/3350927257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0864106b00 0x7f0864108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 --2- 172.21.15.6:0/3350927257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08641018a0 0x7f0864103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 --2- 172.21.15.6:0/3350927257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641041d0 0x7f08641065c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 -- 172.21.15.6:0/3350927257 >> 172.21.15.6:0/3350927257 conn(0x7f08640fb250 msgr2=0x7f08640fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 -- 172.21.15.6:0/3350927257 shutdown_connections 2023-09-13T09:41:49.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 -- 172.21.15.6:0/3350927257 wait complete. 2023-09-13T09:41:49.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 Processor -- start 2023-09-13T09:41:49.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.517+0000 7f086a4e1700 1 -- start start 2023-09-13T09:41:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f086a4e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641018a0 0x7f0864198be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f086a4e1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08641041d0 0x7f0864199120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f086a4e1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0864106b00 0x7f08641a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f086a4e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641a0760 con 0x7f08641018a0 2023-09-13T09:41:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f086a4e1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641a08a0 con 0x7f08641041d0 2023-09-13T09:41:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f086a4e1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08641a0a30 con 0x7f0864106b00 2023-09-13T09:41:49.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641018a0 0x7f0864198be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641018a0 0x7f0864198be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35158/0 (socket says 172.21.15.6:35158) 2023-09-13T09:41:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 -- 172.21.15.6:0/2408511774 learned_addr learned my addr 172.21.15.6:0/2408511774 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0868a7e700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0864106b00 0x7f08641a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f08637fe700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08641041d0 0x7f0864199120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 -- 172.21.15.6:0/2408511774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0864106b00 msgr2=0x7f08641a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0864106b00 0x7f08641a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 -- 172.21.15.6:0/2408511774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08641041d0 msgr2=0x7f0864199120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08641041d0 0x7f0864199120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 -- 172.21.15.6:0/2408511774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08540095f0 con 0x7f08641018a0 2023-09-13T09:41:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0868a7e700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0864106b00 0x7f08641a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:49.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.518+0000 7f0863fff700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641018a0 0x7f0864198be0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f084c00d950 tx=0x7f084c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.519+0000 7f08617fa700 1 -- 172.21.15.6:0/2408511774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c009b40 con 0x7f08641018a0 2023-09-13T09:41:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.519+0000 7f08617fa700 1 -- 172.21.15.6:0/2408511774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f084c009ca0 con 0x7f08641018a0 2023-09-13T09:41:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.519+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08641a0d10 con 0x7f08641018a0 2023-09-13T09:41:49.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.519+0000 7f08617fa700 1 -- 172.21.15.6:0/2408511774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c00f620 con 0x7f08641018a0 2023-09-13T09:41:49.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.519+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08641a11d0 con 0x7f08641018a0 2023-09-13T09:41:49.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.521+0000 7f08617fa700 1 -- 172.21.15.6:0/2408511774 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f084c010460 con 0x7f08641018a0 2023-09-13T09:41:49.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.522+0000 7f08617fa700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f08500a0640 0x7f08500a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.522+0000 7f08617fa700 1 -- 172.21.15.6:0/2408511774 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f084c0cbfe0 con 0x7f08641018a0 2023-09-13T09:41:49.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.522+0000 7f08637fe700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f08500a0640 0x7f08500a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.522+0000 7f08637fe700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f08500a0640 0x7f08500a2b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08540095c0 tx=0x7f0854009530 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 Processor -- start 2023-09-13T09:41:49.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 -- start start 2023-09-13T09:41:49.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f225780 con 0x55f20f2cca00 2023-09-13T09:41:49.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f2230a0 con 0x55f20f2ce060 2023-09-13T09:41:49.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08766c6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f21e990 con 0x55f20f2cd700 2023-09-13T09:41:49.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35170/0 (socket says 172.21.15.6:35170) 2023-09-13T09:41:49.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 -- 172.21.15.6:0/1268896231 learned_addr learned my addr 172.21.15.6:0/1268896231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f08637fe700 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0863fff700 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 -- 172.21.15.6:0/1268896231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 msgr2=0x55f20f2cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 -- 172.21.15.6:0/1268896231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 msgr2=0x55f20f2cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 -- 172.21.15.6:0/1268896231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f20f09e630 con 0x55f20f2cca00 2023-09-13T09:41:49.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.523+0000 7f0868a7e700 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cce80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e260 tx=0x7f085c00e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92bff2baa4e63ea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f085a7fc700 1 -- 172.21.15.6:0/1268896231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c018070 con 0x55f20f2cca00 2023-09-13T09:41:49.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f085a7fc700 1 -- 172.21.15.6:0/1268896231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f085c007d00 con 0x55f20f2cca00 2023-09-13T09:41:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f085a7fc700 1 -- 172.21.15.6:0/1268896231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c014cb0 con 0x55f20f2cca00 2023-09-13T09:41:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 -- 172.21.15.6:0/1268896231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 msgr2=0x55f20f2cce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cce80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e260 tx=0x7f085c00e570 comp rx=0 tx=0).stop 2023-09-13T09:41:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 -- 172.21.15.6:0/1268896231 shutdown_connections 2023-09-13T09:41:49.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cce80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1268896231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 -- 172.21.15.6:0/1268896231 >> 172.21.15.6:0/1268896231 conn(0x55f20f22ac80 msgr2=0x55f20f2c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 -- 172.21.15.6:0/1268896231 shutdown_connections 2023-09-13T09:41:49.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.524+0000 7f08766c6b80 1 -- 172.21.15.6:0/1268896231 wait complete. 2023-09-13T09:41:49.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 -- start start 2023-09-13T09:41:49.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 Processor -- start 2023-09-13T09:41:49.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cca00 0x55f20f2d5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2d6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2ce060 0x55f20f2dd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f1bcbb0 con 0x55f20f2ce060 2023-09-13T09:41:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f1bc8b0 con 0x55f20f2cca00 2023-09-13T09:41:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f0a0920 con 0x55f20f2cd700 2023-09-13T09:41:49.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08766c6b80 10 client.0 _ll_register_callbacks cb 0x55f20f1ba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f0868a7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2ce060 0x55f20f2dd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f0868a7e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2ce060 0x55f20f2dd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35176/0 (socket says 172.21.15.6:35176) 2023-09-13T09:41:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f0868a7e700 1 -- 172.21.15.6:0/1457694072 learned_addr learned my addr 172.21.15.6:0/1457694072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f0863fff700 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cca00 0x55f20f2d5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.525+0000 7f08637fe700 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2d6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f0868a7e700 1 -- 172.21.15.6:0/1457694072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 msgr2=0x55f20f2d6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f0868a7e700 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2d6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f0868a7e700 1 -- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cca00 msgr2=0x55f20f2d5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f0868a7e700 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cca00 0x55f20f2d5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f0868a7e700 1 -- 172.21.15.6:0/1457694072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f085c00f040 con 0x55f20f2ce060 2023-09-13T09:41:49.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f0868a7e700 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2ce060 0x55f20f2dd450 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e8c0 tx=0x7f085c004e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16de109f3eb2c5b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08437fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08437fe700 1 -- 172.21.15.6:0/1457694072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f085c018040 con 0x55f20f2ce060 2023-09-13T09:41:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08437fe700 1 -- 172.21.15.6:0/1457694072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f085c014480 con 0x55f20f2ce060 2023-09-13T09:41:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f20f2bf670 con 0x55f20f2ce060 2023-09-13T09:41:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08437fe700 1 -- 172.21.15.6:0/1457694072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f085c014640 con 0x55f20f2ce060 2023-09-13T09:41:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08766c6b80 10 client.15969 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f20f2367a0 con 0x55f20f2ce060 2023-09-13T09:41:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08437fe700 1 -- 172.21.15.6:0/1457694072 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f20f2bf670 con 0x55f20f2ce060 2023-09-13T09:41:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.526+0000 7f08437fe700 1 -- 172.21.15.6:0/1457694072 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f085c0044f0 con 0x55f20f2ce060 2023-09-13T09:41:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f08766c6b80 10 client.15969 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:49.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f08766c6b80 10 client.15969 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:41:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f08766c6b80 20 client.15969 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f2e1bc0 0x55f20f2e3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f08766c6b80 4 client.15969 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f20f217970 con 0x55f20f2e1bc0 2023-09-13T09:41:49.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f0863fff700 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f2e1bc0 0x55f20f2e3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f0863fff700 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f2e1bc0 0x55f20f2e3fe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7db535f010fd7236 server_cookie=b8a9c4fb40e26dcf in_seq=0 out_seq=0 2023-09-13T09:41:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.527+0000 7f08437fe700 10 client.15969 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08437fe700 1 -- 172.21.15.6:0/1457694072 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f20f217970 con 0x55f20f2e1bc0 2023-09-13T09:41:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08437fe700 10 client.15969 handle_command_reply: tid=0 2023-09-13T09:41:49.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 client.15969 shutdown 2023-09-13T09:41:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2ce060 msgr2=0x55f20f2dd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2ce060 0x55f20f2dd450 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f085c00e8c0 tx=0x7f085c004e30 comp rx=0 tx=0).stop 2023-09-13T09:41:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 shutdown_connections 2023-09-13T09:41:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f2e1bc0 0x55f20f2e3fe0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2ce060 0x55f20f2dd450 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cca00 0x55f20f2d5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 --2- 172.21.15.6:0/1457694072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2d6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 >> 172.21.15.6:0/1457694072 conn(0x55f20f22ac80 msgr2=0x55f20f2c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08437fe700 0 client.15969 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 shutdown_connections 2023-09-13T09:41:49.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 1 -- 172.21.15.6:0/1457694072 wait complete. 2023-09-13T09:41:49.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.528+0000 7f08766c6b80 20 client.15969 trim_cache size 0 max 16384 2023-09-13T09:41:49.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 Processor -- start 2023-09-13T09:41:49.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 -- start start 2023-09-13T09:41:49.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2dd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2ddd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f2c8730 con 0x55f20f2cca00 2023-09-13T09:41:49.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f2d3b30 con 0x55f20f2ce060 2023-09-13T09:41:49.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.541+0000 7f08766c6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f2d1420 con 0x55f20f2cd700 2023-09-13T09:41:49.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35180/0 (socket says 172.21.15.6:35180) 2023-09-13T09:41:49.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 -- 172.21.15.6:0/385998682 learned_addr learned my addr 172.21.15.6:0/385998682 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f08637fe700 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2dd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0868a7e700 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2ddd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 -- 172.21.15.6:0/385998682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 msgr2=0x55f20f2dd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2dd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 -- 172.21.15.6:0/385998682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 msgr2=0x55f20f2ddd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2ddd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 -- 172.21.15.6:0/385998682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f20f04ade0 con 0x55f20f2cca00 2023-09-13T09:41:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f08637fe700 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0868a7e700 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2ddd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:49.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f0863fff700 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cc4c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f084c000c00 tx=0x7f084c084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9266c257e7299727 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f085affd700 1 -- 172.21.15.6:0/385998682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c09d590 con 0x55f20f2cca00 2023-09-13T09:41:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f085affd700 1 -- 172.21.15.6:0/385998682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f084c0a17d0 con 0x55f20f2cca00 2023-09-13T09:41:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.542+0000 7f085affd700 1 -- 172.21.15.6:0/385998682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c09d3b0 con 0x55f20f2cca00 2023-09-13T09:41:49.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 -- 172.21.15.6:0/385998682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 msgr2=0x55f20f2cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cc4c0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f084c000c00 tx=0x7f084c084040 comp rx=0 tx=0).stop 2023-09-13T09:41:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 -- 172.21.15.6:0/385998682 shutdown_connections 2023-09-13T09:41:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2ce060 0x55f20f2ddd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2cc4c0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 --2- 172.21.15.6:0/385998682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2cd700 0x55f20f2dd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 -- 172.21.15.6:0/385998682 >> 172.21.15.6:0/385998682 conn(0x55f20f22ac80 msgr2=0x55f20f2c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 -- 172.21.15.6:0/385998682 shutdown_connections 2023-09-13T09:41:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 -- 172.21.15.6:0/385998682 wait complete. 2023-09-13T09:41:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 -- start start 2023-09-13T09:41:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.543+0000 7f08766c6b80 1 Processor -- start 2023-09-13T09:41:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2d9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cd700 0x55f20f2d9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08766c6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2ce060 0x55f20f2dc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08766c6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f2dcbf0 con 0x55f20f2cca00 2023-09-13T09:41:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08766c6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f2dcd60 con 0x55f20f2cd700 2023-09-13T09:41:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08766c6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f20f2dcf20 con 0x55f20f2ce060 2023-09-13T09:41:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08766c6b80 10 client.0 _ll_register_callbacks cb 0x55f20f1ba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2d9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2d9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35186/0 (socket says 172.21.15.6:35186) 2023-09-13T09:41:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 -- 172.21.15.6:0/3844086412 learned_addr learned my addr 172.21.15.6:0/3844086412 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08637fe700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cd700 0x55f20f2d9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 -- 172.21.15.6:0/3844086412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2ce060 msgr2=0x55f20f2dc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0868a7e700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2ce060 0x55f20f2dc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2ce060 0x55f20f2dc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 -- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cd700 msgr2=0x55f20f2d9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cd700 0x55f20f2d9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 -- 172.21.15.6:0/3844086412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08641a11d0 con 0x55f20f2cca00 2023-09-13T09:41:49.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0868a7e700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2ce060 0x55f20f2dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:49.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f0863fff700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2d9150 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f084c0a12a0 tx=0x7f084c099350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fd1408b46a853f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08437fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:49.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.544+0000 7f08437fe700 1 -- 172.21.15.6:0/3844086412 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c014040 con 0x55f20f2cca00 2023-09-13T09:41:49.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08437fe700 1 -- 172.21.15.6:0/3844086412 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f084c09d150 con 0x55f20f2cca00 2023-09-13T09:41:49.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f085c007d00 con 0x55f20f2cca00 2023-09-13T09:41:49.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08437fe700 1 -- 172.21.15.6:0/3844086412 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f084c09d310 con 0x55f20f2cca00 2023-09-13T09:41:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 10 client.15975 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55f20f033c60 con 0x55f20f2cca00 2023-09-13T09:41:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08437fe700 1 -- 172.21.15.6:0/3844086412 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f085c007d00 con 0x55f20f2cca00 2023-09-13T09:41:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08437fe700 1 -- 172.21.15.6:0/3844086412 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f084c098c50 con 0x55f20f2cca00 2023-09-13T09:41:49.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 10 client.15975 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 10 client.15975 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:41:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 20 client.15975 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f336540 0x55f20f338960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 4 client.15975 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f20f1d8050 con 0x55f20f336540 2023-09-13T09:41:49.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.545+0000 7f08637fe700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f336540 0x55f20f338960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08437fe700 10 client.15975 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08637fe700 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f336540 0x55f20f338960 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=36f8bc48ac4083ca server_cookie=67076686919fbf7 in_seq=0 out_seq=0 2023-09-13T09:41:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08437fe700 1 -- 172.21.15.6:0/3844086412 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f20f1d8050 con 0x55f20f336540 2023-09-13T09:41:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08437fe700 10 client.15975 handle_command_reply: tid=0 2023-09-13T09:41:49.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 client.15975 shutdown 2023-09-13T09:41:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 msgr2=0x55f20f2d9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2d9150 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f084c0a12a0 tx=0x7f084c099350 comp rx=0 tx=0).stop 2023-09-13T09:41:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 shutdown_connections 2023-09-13T09:41:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f20f336540 0x55f20f338960 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f20f2ce060 0x55f20f2dc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f20f2cca00 0x55f20f2d9150 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 --2- 172.21.15.6:0/3844086412 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f20f2cd700 0x55f20f2d9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08437fe700 0 client.15975 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:41:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 >> 172.21.15.6:0/3844086412 conn(0x55f20f22ac80 msgr2=0x55f20f2d08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 shutdown_connections 2023-09-13T09:41:49.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 1 -- 172.21.15.6:0/3844086412 wait complete. 2023-09-13T09:41:49.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.546+0000 7f08766c6b80 20 client.15975 trim_cache size 0 max 16384 2023-09-13T09:41:49.575 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:49.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f08500a0640 msgr2=0x7f08500a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f08500a0640 0x7f08500a2b00 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f08540095c0 tx=0x7f0854009530 comp rx=0 tx=0).stop 2023-09-13T09:41:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641018a0 msgr2=0x7f0864198be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641018a0 0x7f0864198be0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f084c00d950 tx=0x7f084c00dd10 comp rx=0 tx=0).stop 2023-09-13T09:41:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 shutdown_connections 2023-09-13T09:41:49.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0864106b00 0x7f08641a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f08500a0640 0x7f08500a2b00 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08641018a0 0x7f0864198be0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 --2- 172.21.15.6:0/2408511774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f08641041d0 0x7f0864199120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 >> 172.21.15.6:0/2408511774 conn(0x7f08640fb250 msgr2=0x7f08640fff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 shutdown_connections 2023-09-13T09:41:49.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.547+0000 7f086a4e1700 1 -- 172.21.15.6:0/2408511774 wait complete. 2023-09-13T09:41:49.579 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:41:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 -- 172.21.15.6:0/3353524365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 msgr2=0x7f31cc101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 --2- 172.21.15.6:0/3353524365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc101310 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f31bc0099c0 tx=0x7f31bc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 -- 172.21.15.6:0/3353524365 shutdown_connections 2023-09-13T09:41:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 --2- 172.21.15.6:0/3353524365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31cc101850 0x7f31cc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 --2- 172.21.15.6:0/3353524365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31cc0ffcc0 0x7f31cc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 --2- 172.21.15.6:0/3353524365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc101310 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 -- 172.21.15.6:0/3353524365 >> 172.21.15.6:0/3353524365 conn(0x7f31cc0fb250 msgr2=0x7f31cc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 -- 172.21.15.6:0/3353524365 shutdown_connections 2023-09-13T09:41:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.707+0000 7f31d34ae700 1 -- 172.21.15.6:0/3353524365 wait complete. 2023-09-13T09:41:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 Processor -- start 2023-09-13T09:41:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 -- start start 2023-09-13T09:41:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31cc0ffcc0 0x7f31cc068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc19b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31cc101850 0x7f31cc19de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc19e5c0 con 0x7f31cc100eb0 2023-09-13T09:41:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc19e730 con 0x7f31cc101850 2023-09-13T09:41:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d34ae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31cc19e8f0 con 0x7f31cc0ffcc0 2023-09-13T09:41:49.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc19b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc19b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35202/0 (socket says 172.21.15.6:35202) 2023-09-13T09:41:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 -- 172.21.15.6:0/1559598619 learned_addr learned my addr 172.21.15.6:0/1559598619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d124a700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31cc0ffcc0 0x7f31cc068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31cc101850 0x7f31cc19de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 -- 172.21.15.6:0/1559598619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31cc0ffcc0 msgr2=0x7f31cc068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31cc0ffcc0 0x7f31cc068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 -- 172.21.15.6:0/1559598619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31cc101850 msgr2=0x7f31cc19de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31cc101850 0x7f31cc19de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 -- 172.21.15.6:0/1559598619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c4009c40 con 0x7f31cc100eb0 2023-09-13T09:41:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31cc101850 0x7f31cc19de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31d0a49700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc19b7e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009fd0 tx=0x7f31bc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.708+0000 7f31c27fc700 1 -- 172.21.15.6:0/1559598619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc01d070 con 0x7f31cc100eb0 2023-09-13T09:41:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.709+0000 7f31c27fc700 1 -- 172.21.15.6:0/1559598619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31bc0054f0 con 0x7f31cc100eb0 2023-09-13T09:41:49.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.709+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31bc0095f0 con 0x7f31cc100eb0 2023-09-13T09:41:49.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.709+0000 7f31c27fc700 1 -- 172.21.15.6:0/1559598619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc004bd0 con 0x7f31cc100eb0 2023-09-13T09:41:49.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.709+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31cc19ee60 con 0x7f31cc100eb0 2023-09-13T09:41:49.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.711+0000 7f31c27fc700 1 -- 172.21.15.6:0/1559598619 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f31bc00fb80 con 0x7f31cc100eb0 2023-09-13T09:41:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.711+0000 7f31c27fc700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31b80a06c0 0x7f31b80a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.712+0000 7f31d124a700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31b80a06c0 0x7f31b80a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.712+0000 7f31c27fc700 1 -- 172.21.15.6:0/1559598619 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31bc0cc9c0 con 0x7f31cc100eb0 2023-09-13T09:41:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.712+0000 7f31d124a700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31b80a06c0 0x7f31b80a2b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f31cc100d10 tx=0x7f31c8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 Processor -- start 2023-09-13T09:41:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 -- start start 2023-09-13T09:41:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c035db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c035c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c035ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c02b5780 con 0x55b1c035d700 2023-09-13T09:41:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c02b30a0 con 0x55b1c035e060 2023-09-13T09:41:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31df693b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c02ae990 con 0x55b1c035ca00 2023-09-13T09:41:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31d124a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c035db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31d124a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c035db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35208/0 (socket says 172.21.15.6:35208) 2023-09-13T09:41:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31d124a700 1 -- 172.21.15.6:0/573492076 learned_addr learned my addr 172.21.15.6:0/573492076 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31d0a49700 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c035c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c035ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31d124a700 1 -- 172.21.15.6:0/573492076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 msgr2=0x55b1c035ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.713+0000 7f31d124a700 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c035ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31d124a700 1 -- 172.21.15.6:0/573492076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 msgr2=0x55b1c035c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31d124a700 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c035c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31d124a700 1 -- 172.21.15.6:0/573492076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1c012e630 con 0x55b1c035d700 2023-09-13T09:41:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31d0a49700 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c035c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31d124a700 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c035db20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f31c8010e50 tx=0x7f31c8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1456440608274c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31b77fe700 1 -- 172.21.15.6:0/573492076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8004220 con 0x55b1c035d700 2023-09-13T09:41:49.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31b77fe700 1 -- 172.21.15.6:0/573492076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31c8015070 con 0x55b1c035d700 2023-09-13T09:41:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.714+0000 7f31b77fe700 1 -- 172.21.15.6:0/573492076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c801e680 con 0x55b1c035d700 2023-09-13T09:41:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 -- 172.21.15.6:0/573492076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 msgr2=0x55b1c035db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c035db20 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f31c8010e50 tx=0x7f31c8013000 comp rx=0 tx=0).stop 2023-09-13T09:41:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 -- 172.21.15.6:0/573492076 shutdown_connections 2023-09-13T09:41:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c035ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c035db20 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 --2- 172.21.15.6:0/573492076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c035c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 -- 172.21.15.6:0/573492076 >> 172.21.15.6:0/573492076 conn(0x55b1c02bac80 msgr2=0x55b1c0356f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 -- 172.21.15.6:0/573492076 shutdown_connections 2023-09-13T09:41:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 -- 172.21.15.6:0/573492076 wait complete. 2023-09-13T09:41:49.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 -- start start 2023-09-13T09:41:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.715+0000 7f31df693b80 1 Processor -- start 2023-09-13T09:41:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31df693b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c0365f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31df693b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035d700 0x55b1c03664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31df693b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035e060 0x55b1c036d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31df693b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c024cbb0 con 0x55b1c035e060 2023-09-13T09:41:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31df693b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c024c8b0 con 0x55b1c035d700 2023-09-13T09:41:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31df693b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c0130920 con 0x55b1c035ca00 2023-09-13T09:41:49.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31df693b80 10 client.0 _ll_register_callbacks cb 0x55b1c024a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035e060 0x55b1c036d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035e060 0x55b1c036d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35218/0 (socket says 172.21.15.6:35218) 2023-09-13T09:41:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 -- 172.21.15.6:0/2756948045 learned_addr learned my addr 172.21.15.6:0/2756948045 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d124a700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c0365f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d0a49700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035d700 0x55b1c03664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 -- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 msgr2=0x55b1c0365f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c0365f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 -- 172.21.15.6:0/2756948045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035d700 msgr2=0x55b1c03664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035d700 0x55b1c03664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 -- 172.21.15.6:0/2756948045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c8010b30 con 0x55b1c035e060 2023-09-13T09:41:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d124a700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c0365f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d0a49700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035d700 0x55b1c03664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035e060 0x55b1c036d4e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f31c4007b30 tx=0x7f31c4007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac5fd68edebdf3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:49.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.716+0000 7f31b4ff9700 1 -- 172.21.15.6:0/2756948045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4010ad0 con 0x55b1c035e060 2023-09-13T09:41:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1c034f670 con 0x55b1c035e060 2023-09-13T09:41:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31b4ff9700 1 -- 172.21.15.6:0/2756948045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31c4010c30 con 0x55b1c035e060 2023-09-13T09:41:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31b4ff9700 1 -- 172.21.15.6:0/2756948045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31c4010df0 con 0x55b1c035e060 2023-09-13T09:41:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 10 client.15987 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b1c02c67a0 con 0x55b1c035e060 2023-09-13T09:41:49.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31b4ff9700 1 -- 172.21.15.6:0/2756948045 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31c4025080 con 0x55b1c035e060 2023-09-13T09:41:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31b4ff9700 1 -- 172.21.15.6:0/2756948045 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f31c40205a0 con 0x55b1c035e060 2023-09-13T09:41:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 10 client.15987 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 10 client.15987 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:41:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 20 client.15987 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:49.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c0371e40 0x55b1c0374260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 4 client.15987 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.717+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1c02a7970 con 0x55b1c0371e40 2023-09-13T09:41:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.718+0000 7f31d124a700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c0371e40 0x55b1c0374260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.718+0000 7f31d124a700 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c0371e40 0x55b1c0374260 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=20d7da31730cca26 server_cookie=4876ea58cc4c5802 in_seq=0 out_seq=0 2023-09-13T09:41:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.718+0000 7f31b4ff9700 10 client.15987 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31b4ff9700 1 -- 172.21.15.6:0/2756948045 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1c02a7970 con 0x55b1c0371e40 2023-09-13T09:41:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31b4ff9700 10 client.15987 handle_command_reply: tid=0 2023-09-13T09:41:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 client.15987 shutdown 2023-09-13T09:41:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035e060 msgr2=0x55b1c036d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035e060 0x55b1c036d4e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f31c4007b30 tx=0x7f31c4007ef0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 shutdown_connections 2023-09-13T09:41:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c0371e40 0x55b1c0374260 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035e060 0x55b1c036d4e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31b4ff9700 0 client.15987 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035ca00 0x55b1c0365f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 --2- 172.21.15.6:0/2756948045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035d700 0x55b1c03664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 >> 172.21.15.6:0/2756948045 conn(0x55b1c02bac80 msgr2=0x55b1c03517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 shutdown_connections 2023-09-13T09:41:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 1 -- 172.21.15.6:0/2756948045 wait complete. 2023-09-13T09:41:49.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.719+0000 7f31df693b80 20 client.15987 trim_cache size 0 max 16384 2023-09-13T09:41:49.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 Processor -- start 2023-09-13T09:41:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 -- start start 2023-09-13T09:41:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035ca00 0x55b1c035c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035d700 0x55b1c036d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c0360920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c0365410 con 0x55b1c035ca00 2023-09-13T09:41:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c03538e0 con 0x55b1c035e060 2023-09-13T09:41:49.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31df693b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c0358730 con 0x55b1c035d700 2023-09-13T09:41:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31d124a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035ca00 0x55b1c035c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31d124a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035ca00 0x55b1c035c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35222/0 (socket says 172.21.15.6:35222) 2023-09-13T09:41:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31d124a700 1 -- 172.21.15.6:0/2708274832 learned_addr learned my addr 172.21.15.6:0/2708274832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.732+0000 7f31d0a49700 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035d700 0x55b1c036d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c0360920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31d124a700 1 -- 172.21.15.6:0/2708274832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035d700 msgr2=0x55b1c036d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31d124a700 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035d700 0x55b1c036d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31d124a700 1 -- 172.21.15.6:0/2708274832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 msgr2=0x55b1c0360920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31d124a700 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c0360920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31d124a700 1 -- 172.21.15.6:0/2708274832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1c00dade0 con 0x55b1c035ca00 2023-09-13T09:41:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31d124a700 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035ca00 0x55b1c035c4c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f31c8011ab0 tx=0x7f31c8011be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54ce05097022aed5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31b7fff700 1 -- 172.21.15.6:0/2708274832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8003980 con 0x55b1c035ca00 2023-09-13T09:41:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31b7fff700 1 -- 172.21.15.6:0/2708274832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31c802c030 con 0x55b1c035ca00 2023-09-13T09:41:49.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31b7fff700 1 -- 172.21.15.6:0/2708274832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c8005510 con 0x55b1c035ca00 2023-09-13T09:41:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31df693b80 1 -- 172.21.15.6:0/2708274832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035ca00 msgr2=0x55b1c035c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.733+0000 7f31df693b80 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035ca00 0x55b1c035c4c0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f31c8011ab0 tx=0x7f31c8011be0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- 172.21.15.6:0/2708274832 shutdown_connections 2023-09-13T09:41:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035e060 0x55b1c0360920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035ca00 0x55b1c035c4c0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 --2- 172.21.15.6:0/2708274832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035d700 0x55b1c036d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- 172.21.15.6:0/2708274832 >> 172.21.15.6:0/2708274832 conn(0x55b1c02bac80 msgr2=0x55b1c0364be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- 172.21.15.6:0/2708274832 shutdown_connections 2023-09-13T09:41:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- 172.21.15.6:0/2708274832 wait complete. 2023-09-13T09:41:49.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- start start 2023-09-13T09:41:49.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 Processor -- start 2023-09-13T09:41:49.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035ca00 0x55b1c036cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c0369aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035e060 0x55b1c0369fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c036a6c0 con 0x55b1c035d700 2023-09-13T09:41:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c036d5f0 con 0x55b1c035ca00 2023-09-13T09:41:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1c036d780 con 0x55b1c035e060 2023-09-13T09:41:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31df693b80 10 client.0 _ll_register_callbacks cb 0x55b1c024a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:49.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31d124a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035ca00 0x55b1c036cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31d0a49700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c0369aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31d124a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035ca00 0x55b1c036cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:56984/0 (socket says 172.21.15.6:56984) 2023-09-13T09:41:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31d124a700 1 -- 172.21.15.6:0/3204963772 learned_addr learned my addr 172.21.15.6:0/3204963772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.734+0000 7f31d0a49700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c0369aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35230/0 (socket says 172.21.15.6:35230) 2023-09-13T09:41:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d1a4b700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035e060 0x55b1c0369fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d0a49700 1 -- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035e060 msgr2=0x55b1c0369fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d0a49700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035e060 0x55b1c0369fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d0a49700 1 -- 172.21.15.6:0/3204963772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035ca00 msgr2=0x55b1c036cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d0a49700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035ca00 0x55b1c036cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d0a49700 1 -- 172.21.15.6:0/3204963772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1c012e630 con 0x55b1c035d700 2023-09-13T09:41:49.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d124a700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035ca00 0x55b1c036cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:49.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31d0a49700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c0369aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00bf40 tx=0x7f31bc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01fdd509779e2cd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31b4ff9700 1 -- 172.21.15.6:0/3204963772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31bc09a8f0 con 0x55b1c035d700 2023-09-13T09:41:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31b4ff9700 1 -- 172.21.15.6:0/3204963772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31bc09a1f0 con 0x55b1c035d700 2023-09-13T09:41:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31c8015070 con 0x55b1c035d700 2023-09-13T09:41:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31b4ff9700 1 -- 172.21.15.6:0/3204963772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31bc09e020 con 0x55b1c035d700 2023-09-13T09:41:49.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31df693b80 10 client.15993 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:49.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b1c00c3c60 con 0x55b1c035d700 2023-09-13T09:41:49.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.735+0000 7f31b4ff9700 1 -- 172.21.15.6:0/3204963772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31c8015070 con 0x55b1c035d700 2023-09-13T09:41:49.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31b4ff9700 1 -- 172.21.15.6:0/3204963772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f31bc099150 con 0x55b1c035d700 2023-09-13T09:41:49.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:49.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 10 client.15993 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:41:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 20 client.15993 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c03c71f0 0x55b1c03c9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 4 client.15993 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b1c0268050 con 0x55b1c03c71f0 2023-09-13T09:41:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31d124a700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c03c71f0 0x55b1c03c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31b4ff9700 10 client.15993 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31d124a700 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c03c71f0 0x55b1c03c9610 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d2de5f1ebf1bab9 server_cookie=3fb42056969ea2cb in_seq=0 out_seq=0 2023-09-13T09:41:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31b4ff9700 1 -- 172.21.15.6:0/3204963772 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b1c0268050 con 0x55b1c03c71f0 2023-09-13T09:41:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31b4ff9700 10 client.15993 handle_command_reply: tid=0 2023-09-13T09:41:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 1 client.15993 shutdown 2023-09-13T09:41:49.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 msgr2=0x55b1c0369aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.736+0000 7f31df693b80 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c0369aa0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00bf40 tx=0x7f31bc005ef0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 shutdown_connections 2023-09-13T09:41:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1c03c71f0 0x55b1c03c9610 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1c035e060 0x55b1c0369fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31b4ff9700 0 client.15993 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:41:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1c035ca00 0x55b1c036cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 --2- 172.21.15.6:0/3204963772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1c035d700 0x55b1c0369aa0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 >> 172.21.15.6:0/3204963772 conn(0x55b1c02bac80 msgr2=0x55b1c0360920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 shutdown_connections 2023-09-13T09:41:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 1 -- 172.21.15.6:0/3204963772 wait complete. 2023-09-13T09:41:49.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31df693b80 20 client.15993 trim_cache size 0 max 16384 2023-09-13T09:41:49.764 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:49.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31b80a06c0 msgr2=0x7f31b80a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31b80a06c0 0x7f31b80a2b80 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f31cc100d10 tx=0x7f31c8007400 comp rx=0 tx=0).stop 2023-09-13T09:41:49.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 msgr2=0x7f31cc19b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc19b7e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f31bc009fd0 tx=0x7f31bc00f690 comp rx=0 tx=0).stop 2023-09-13T09:41:49.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 shutdown_connections 2023-09-13T09:41:49.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31cc101850 0x7f31cc19de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31cc0ffcc0 0x7f31cc068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31b80a06c0 0x7f31b80a2b80 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 --2- 172.21.15.6:0/1559598619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31cc100eb0 0x7f31cc19b7e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 >> 172.21.15.6:0/1559598619 conn(0x7f31cc0fb250 msgr2=0x7f31cc1043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 shutdown_connections 2023-09-13T09:41:49.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.737+0000 7f31d34ae700 1 -- 172.21.15.6:0/1559598619 wait complete. 2023-09-13T09:41:49.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:41:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 -- 172.21.15.6:0/988635762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf80ffcc0 msgr2=0x7feaf81000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 --2- 172.21.15.6:0/988635762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf80ffcc0 0x7feaf81000e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7feaec0099c0 tx=0x7feaec009cd0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 -- 172.21.15.6:0/988635762 shutdown_connections 2023-09-13T09:41:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 --2- 172.21.15.6:0/988635762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf8101850 0x7feaf8108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 --2- 172.21.15.6:0/988635762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf80ffcc0 0x7feaf81000e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 --2- 172.21.15.6:0/988635762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feaf8100eb0 0x7feaf8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 -- 172.21.15.6:0/988635762 >> 172.21.15.6:0/988635762 conn(0x7feaf80fb250 msgr2=0x7feaf80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 -- 172.21.15.6:0/988635762 shutdown_connections 2023-09-13T09:41:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.897+0000 7feafece4700 1 -- 172.21.15.6:0/988635762 wait complete. 2023-09-13T09:41:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 Processor -- start 2023-09-13T09:41:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 -- start start 2023-09-13T09:41:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffcc0 0x7feaf8196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8100eb0 0x7feaf8196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feaf8101850 0x7feaf819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf819e610 con 0x7feaf8100eb0 2023-09-13T09:41:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf819e750 con 0x7feaf8101850 2023-09-13T09:41:49.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafece4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf819e8e0 con 0x7feaf80ffcc0 2023-09-13T09:41:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8100eb0 0x7feaf8196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8100eb0 0x7feaf8196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35244/0 (socket says 172.21.15.6:35244) 2023-09-13T09:41:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 -- 172.21.15.6:0/4082511763 learned_addr learned my addr 172.21.15.6:0/4082511763 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafca80700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffcc0 0x7feaf8196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafd281700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feaf8101850 0x7feaf819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 -- 172.21.15.6:0/4082511763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffcc0 msgr2=0x7feaf8196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffcc0 0x7feaf8196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 -- 172.21.15.6:0/4082511763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feaf8101850 msgr2=0x7feaf819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feaf8101850 0x7feaf819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feaf7fff700 1 -- 172.21.15.6:0/4082511763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0095f0 con 0x7feaf8100eb0 2023-09-13T09:41:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.898+0000 7feafd281700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feaf8101850 0x7feaf819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.899+0000 7feaf7fff700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8100eb0 0x7feaf8196fd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feae400d980 tx=0x7feae400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.899+0000 7feaf5ffb700 1 -- 172.21.15.6:0/4082511763 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4004220 con 0x7feaf8100eb0 2023-09-13T09:41:49.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.899+0000 7feaf5ffb700 1 -- 172.21.15.6:0/4082511763 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feae4007640 con 0x7feaf8100eb0 2023-09-13T09:41:49.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.899+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaf819ebc0 con 0x7feaf8100eb0 2023-09-13T09:41:49.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.899+0000 7feaf5ffb700 1 -- 172.21.15.6:0/4082511763 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4005610 con 0x7feaf8100eb0 2023-09-13T09:41:49.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.899+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf819f0d0 con 0x7feaf8100eb0 2023-09-13T09:41:49.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.902+0000 7feaf5ffb700 1 -- 172.21.15.6:0/4082511763 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7feae4004750 con 0x7feaf8100eb0 2023-09-13T09:41:49.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.903+0000 7feaf5ffb700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feae80a0640 0x7feae80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.903+0000 7feaf5ffb700 1 -- 172.21.15.6:0/4082511763 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feae40cbae0 con 0x7feaf8100eb0 2023-09-13T09:41:49.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.903+0000 7feafca80700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feae80a0640 0x7feae80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feafca80700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feae80a0640 0x7feae80a2b00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feaec009f50 tx=0x7feaec00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 Processor -- start 2023-09-13T09:41:49.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 -- start start 2023-09-13T09:41:49.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f8eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6f8d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6f8de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6ee6780 con 0x559ed6f8f060 2023-09-13T09:41:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6ee40a0 con 0x559ed6f8da00 2023-09-13T09:41:49.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6edf990 con 0x559ed6f8e700 2023-09-13T09:41:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6f8d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6f8d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35252/0 (socket says 172.21.15.6:35252) 2023-09-13T09:41:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 -- 172.21.15.6:0/2709722019 learned_addr learned my addr 172.21.15.6:0/2709722019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feafd281700 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6f8de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feafca80700 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f8eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 -- 172.21.15.6:0/2709722019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 msgr2=0x559ed6f8eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f8eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 -- 172.21.15.6:0/2709722019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 msgr2=0x559ed6f8de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6f8de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feaf7fff700 1 -- 172.21.15.6:0/2709722019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ed6d5f630 con 0x559ed6f8f060 2023-09-13T09:41:49.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feafca80700 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f8eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.904+0000 7feafd281700 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6f8de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.905+0000 7feaf7fff700 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6f8d4c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feae40a0dc0 tx=0x7feae4098cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb86b895c5693cf8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.905+0000 7feae2ffd700 1 -- 172.21.15.6:0/2709722019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae409d0b0 con 0x559ed6f8f060 2023-09-13T09:41:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.905+0000 7feae2ffd700 1 -- 172.21.15.6:0/2709722019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feae4093e90 con 0x559ed6f8f060 2023-09-13T09:41:49.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.905+0000 7feae2ffd700 1 -- 172.21.15.6:0/2709722019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4098770 con 0x559ed6f8f060 2023-09-13T09:41:49.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.905+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2709722019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 msgr2=0x559ed6f8d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.905+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6f8d4c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7feae40a0dc0 tx=0x7feae4098cb0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.905+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2709722019 shutdown_connections 2023-09-13T09:41:49.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6f8de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f8eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2709722019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6f8d4c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2709722019 >> 172.21.15.6:0/2709722019 conn(0x559ed6eebc80 msgr2=0x559ed6f87f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2709722019 shutdown_connections 2023-09-13T09:41:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2709722019 wait complete. 2023-09-13T09:41:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 -- start start 2023-09-13T09:41:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.906+0000 7feb0aec9b80 1 Processor -- start 2023-09-13T09:41:49.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8da00 0x559ed6f96fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f97500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 0x559ed6f9e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6e7dbb0 con 0x559ed6f8da00 2023-09-13T09:41:49.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6e7d8b0 con 0x559ed6f8f060 2023-09-13T09:41:49.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6d61920 con 0x559ed6f8e700 2023-09-13T09:41:49.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feb0aec9b80 10 client.0 _ll_register_callbacks cb 0x559ed6e7b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8da00 0x559ed6f96fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8da00 0x559ed6f96fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35256/0 (socket says 172.21.15.6:35256) 2023-09-13T09:41:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 -- 172.21.15.6:0/1329837422 learned_addr learned my addr 172.21.15.6:0/1329837422 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafd281700 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 0x559ed6f9e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feaf7fff700 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f97500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 -- 172.21.15.6:0/1329837422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 msgr2=0x559ed6f97500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f97500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 -- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 msgr2=0x559ed6f9e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 0x559ed6f9e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 -- 172.21.15.6:0/1329837422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf819f0d0 con 0x559ed6f8da00 2023-09-13T09:41:49.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7feafca80700 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8da00 0x559ed6f96fc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feaf8100d10 tx=0x7feaec01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c00681d4d679c97 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7fead7fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.907+0000 7fead7fff700 1 -- 172.21.15.6:0/1329837422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaec003eb0 con 0x559ed6f8da00 2023-09-13T09:41:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ed6f80670 con 0x559ed6f8da00 2023-09-13T09:41:49.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7fead7fff700 1 -- 172.21.15.6:0/1329837422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feaec004010 con 0x559ed6f8da00 2023-09-13T09:41:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7fead7fff700 1 -- 172.21.15.6:0/1329837422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaec0041d0 con 0x559ed6f8da00 2023-09-13T09:41:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 10 client.16005 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:49.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x559ed6ef77a0 con 0x559ed6f8da00 2023-09-13T09:41:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7fead7fff700 1 -- 172.21.15.6:0/1329837422 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feaec03f080 con 0x559ed6f8da00 2023-09-13T09:41:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7fead7fff700 1 -- 172.21.15.6:0/1329837422 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7feaec00f600 con 0x559ed6f8da00 2023-09-13T09:41:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 10 client.16005 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:49.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 10 client.16005 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:41:49.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 20 client.16005 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:49.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6fa2e90 0x559ed6fa52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 4 client.16005 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ed6ed8970 con 0x559ed6fa2e90 2023-09-13T09:41:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.908+0000 7feaf7fff700 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6fa2e90 0x559ed6fa52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.909+0000 7fead7fff700 10 client.16005 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.909+0000 7feaf7fff700 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6fa2e90 0x559ed6fa52b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=74614f606fc11304 server_cookie=8d402be82b06c57e in_seq=0 out_seq=0 2023-09-13T09:41:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.909+0000 7fead7fff700 1 -- 172.21.15.6:0/1329837422 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559ed6ed8970 con 0x559ed6fa2e90 2023-09-13T09:41:49.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.909+0000 7fead7fff700 10 client.16005 handle_command_reply: tid=0 2023-09-13T09:41:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 client.16005 shutdown 2023-09-13T09:41:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8da00 msgr2=0x559ed6f96fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8da00 0x559ed6f96fc0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7feaf8100d10 tx=0x7feaec01a050 comp rx=0 tx=0).stop 2023-09-13T09:41:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 shutdown_connections 2023-09-13T09:41:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6fa2e90 0x559ed6fa52b0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 0x559ed6f9e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8da00 0x559ed6f96fc0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7fead7fff700 0 client.16005 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1329837422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6f97500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 >> 172.21.15.6:0/1329837422 conn(0x559ed6eebc80 msgr2=0x559ed6f827f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 shutdown_connections 2023-09-13T09:41:49.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1329837422 wait complete. 2023-09-13T09:41:49.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.910+0000 7feb0aec9b80 20 client.16005 trim_cache size 0 max 16384 2023-09-13T09:41:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 Processor -- start 2023-09-13T09:41:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 -- start start 2023-09-13T09:41:49.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8da00 0x559ed6f8d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8e700 0x559ed6f88fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 0x559ed6f94e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6f924f0 con 0x559ed6f8e700 2023-09-13T09:41:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6fa2bb0 con 0x559ed6f8f060 2023-09-13T09:41:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6f9e8f0 con 0x559ed6f8da00 2023-09-13T09:41:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8e700 0x559ed6f88fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8e700 0x559ed6f88fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35266/0 (socket says 172.21.15.6:35266) 2023-09-13T09:41:49.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 -- 172.21.15.6:0/2541955867 learned_addr learned my addr 172.21.15.6:0/2541955867 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feafca80700 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8da00 0x559ed6f8d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 -- 172.21.15.6:0/2541955867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8da00 msgr2=0x559ed6f8d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8da00 0x559ed6f8d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 -- 172.21.15.6:0/2541955867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 msgr2=0x559ed6f94e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 0x559ed6f94e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.923+0000 7feaf7fff700 1 -- 172.21.15.6:0/2541955867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ed6d0bde0 con 0x559ed6f8e700 2023-09-13T09:41:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feaf7fff700 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8e700 0x559ed6f88fb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feae40c95e0 tx=0x7feae4084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78e7dfbb9a8562f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feae37fe700 1 -- 172.21.15.6:0/2541955867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4099050 con 0x559ed6f8e700 2023-09-13T09:41:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feae37fe700 1 -- 172.21.15.6:0/2541955867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feae409d0b0 con 0x559ed6f8e700 2023-09-13T09:41:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feae37fe700 1 -- 172.21.15.6:0/2541955867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4098770 con 0x559ed6f8e700 2023-09-13T09:41:49.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2541955867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8e700 msgr2=0x559ed6f88fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8e700 0x559ed6f88fb0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7feae40c95e0 tx=0x7feae4084040 comp rx=0 tx=0).stop 2023-09-13T09:41:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2541955867 shutdown_connections 2023-09-13T09:41:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8f060 0x559ed6f94e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8da00 0x559ed6f8d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/2541955867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8e700 0x559ed6f88fb0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2541955867 >> 172.21.15.6:0/2541955867 conn(0x559ed6eebc80 msgr2=0x559ed6f87e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2541955867 shutdown_connections 2023-09-13T09:41:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.924+0000 7feb0aec9b80 1 -- 172.21.15.6:0/2541955867 wait complete. 2023-09-13T09:41:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 -- start start 2023-09-13T09:41:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 Processor -- start 2023-09-13T09:41:49.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6ff4c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6ff71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6ff9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6ff9f30 con 0x559ed6f8f060 2023-09-13T09:41:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6ffa0a0 con 0x559ed6f8da00 2023-09-13T09:41:49.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ed6ffa260 con 0x559ed6f8e700 2023-09-13T09:41:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feb0aec9b80 10 client.0 _ll_register_callbacks cb 0x559ed6e7b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feafd281700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6ff9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feafd281700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6ff9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35274/0 (socket says 172.21.15.6:35274) 2023-09-13T09:41:49.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feafd281700 1 -- 172.21.15.6:0/1194022821 learned_addr learned my addr 172.21.15.6:0/1194022821 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feafca80700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6ff4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.925+0000 7feaf7fff700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6ff71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feafd281700 1 -- 172.21.15.6:0/1194022821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 msgr2=0x559ed6ff71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feafd281700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6ff71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feafd281700 1 -- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 msgr2=0x559ed6ff4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feafd281700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6ff4c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feafd281700 1 -- 172.21.15.6:0/1194022821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ed6d5f630 con 0x559ed6f8f060 2023-09-13T09:41:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feaf7fff700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6ff71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feafca80700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6ff4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feafd281700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6ff9820 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007b20 tx=0x7feaf0007e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5347aad9bf264d0a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7fead7fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7fead7fff700 1 -- 172.21.15.6:0/1194022821 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf00138d0 con 0x559ed6f8f060 2023-09-13T09:41:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7fead7fff700 1 -- 172.21.15.6:0/1194022821 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feaf0013a30 con 0x559ed6f8f060 2023-09-13T09:41:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feae4093e90 con 0x559ed6f8f060 2023-09-13T09:41:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7fead7fff700 1 -- 172.21.15.6:0/1194022821 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaf0013bf0 con 0x559ed6f8f060 2023-09-13T09:41:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 10 client.16011 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x559ed6cf4c60 con 0x559ed6f8f060 2023-09-13T09:41:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7fead7fff700 1 -- 172.21.15.6:0/1194022821 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feae4093e90 con 0x559ed6f8f060 2023-09-13T09:41:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7fead7fff700 1 -- 172.21.15.6:0/1194022821 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7feaf00163d0 con 0x559ed6f8f060 2023-09-13T09:41:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 10 client.16011 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 10 client.16011 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:41:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 20 client.16011 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6ffbdf0 0x559ed6ffe210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 4 client.16011 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.926+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559ed6e99050 con 0x559ed6ffbdf0 2023-09-13T09:41:49.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7feafca80700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6ffbdf0 0x559ed6ffe210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7fead7fff700 10 client.16011 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7feafca80700 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6ffbdf0 0x559ed6ffe210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=27ebe537c07c54ca server_cookie=38fac60bcbd62137 in_seq=0 out_seq=0 2023-09-13T09:41:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7fead7fff700 1 -- 172.21.15.6:0/1194022821 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559ed6e99050 con 0x559ed6ffbdf0 2023-09-13T09:41:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7fead7fff700 10 client.16011 handle_command_reply: tid=0 2023-09-13T09:41:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7feb0aec9b80 1 client.16011 shutdown 2023-09-13T09:41:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 msgr2=0x559ed6ff9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.927+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6ff9820 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7feaf0007b20 tx=0x7feaf0007e30 comp rx=0 tx=0).stop 2023-09-13T09:41:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 shutdown_connections 2023-09-13T09:41:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559ed6ffbdf0 0x559ed6ffe210 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ed6f8f060 0x559ed6ff9820 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7fead7fff700 0 client.16011 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:41:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ed6f8da00 0x559ed6ff4c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 --2- 172.21.15.6:0/1194022821 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ed6f8e700 0x559ed6ff71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 >> 172.21.15.6:0/1194022821 conn(0x559ed6eebc80 msgr2=0x559ed6f94e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 shutdown_connections 2023-09-13T09:41:49.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 1 -- 172.21.15.6:0/1194022821 wait complete. 2023-09-13T09:41:49.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feb0aec9b80 20 client.16011 trim_cache size 0 max 16384 2023-09-13T09:41:49.963 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feae80a0640 msgr2=0x7feae80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feae80a0640 0x7feae80a2b00 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7feaec009f50 tx=0x7feaec00b540 comp rx=0 tx=0).stop 2023-09-13T09:41:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8100eb0 msgr2=0x7feaf8196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8100eb0 0x7feaf8196fd0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7feae400d980 tx=0x7feae400dc90 comp rx=0 tx=0).stop 2023-09-13T09:41:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 shutdown_connections 2023-09-13T09:41:49.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feaf8101850 0x7feaf819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feaf80ffcc0 0x7feaf8196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feae80a0640 0x7feae80a2b00 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 --2- 172.21.15.6:0/4082511763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feaf8100eb0 0x7feaf8196fd0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 >> 172.21.15.6:0/4082511763 conn(0x7feaf80fb250 msgr2=0x7feaf8068050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:49.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 shutdown_connections 2023-09-13T09:41:49.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:49.928+0000 7feafece4700 1 -- 172.21.15.6:0/4082511763 wait complete. 2023-09-13T09:41:49.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:41:50.005 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:49 smithi006 ceph-mon[98665]: pgmap v369: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 209 KiB/s wr, 54 op/s 2023-09-13T09:41:50.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:49 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1972239487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:41:50.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 -- 172.21.15.6:0/22809007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 msgr2=0x7f89181065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 --2- 172.21.15.6:0/22809007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89181065c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8900009990 tx=0x7f8900009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 -- 172.21.15.6:0/22809007 shutdown_connections 2023-09-13T09:41:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 --2- 172.21.15.6:0/22809007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8918106b00 0x7f8918108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 --2- 172.21.15.6:0/22809007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89181018a0 0x7f8918103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 --2- 172.21.15.6:0/22809007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89181065c0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 -- 172.21.15.6:0/22809007 >> 172.21.15.6:0/22809007 conn(0x7f89180fb250 msgr2=0x7f89180fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 -- 172.21.15.6:0/22809007 shutdown_connections 2023-09-13T09:41:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.095+0000 7f891ddd3700 1 -- 172.21.15.6:0/22809007 wait complete. 2023-09-13T09:41:50.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 Processor -- start 2023-09-13T09:41:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 -- start start 2023-09-13T09:41:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89181018a0 0x7f8918101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89180ff850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8918106b00 0x7f89180ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8918100530 con 0x7f89181041d0 2023-09-13T09:41:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89181006a0 con 0x7f89181018a0 2023-09-13T09:41:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f891ddd3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89181a0a70 con 0x7f8918106b00 2023-09-13T09:41:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f8916ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89180ff850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f8916ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89180ff850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35286/0 (socket says 172.21.15.6:35286) 2023-09-13T09:41:50.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f8916ffd700 1 -- 172.21.15.6:0/3375786580 learned_addr learned my addr 172.21.15.6:0/3375786580 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f89177fe700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89181018a0 0x7f8918101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.096+0000 7f8917fff700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8918106b00 0x7f89180ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8916ffd700 1 -- 172.21.15.6:0/3375786580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8918106b00 msgr2=0x7f89180ffd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8916ffd700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8918106b00 0x7f89180ffd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8916ffd700 1 -- 172.21.15.6:0/3375786580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89181018a0 msgr2=0x7f8918101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8916ffd700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89181018a0 0x7f8918101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8916ffd700 1 -- 172.21.15.6:0/3375786580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89000095f0 con 0x7f89181041d0 2023-09-13T09:41:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8916ffd700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89180ff850 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f89000059d0 tx=0x7f8900004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8914ff9700 1 -- 172.21.15.6:0/3375786580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890001d070 con 0x7f89181041d0 2023-09-13T09:41:50.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89181a0cf0 con 0x7f89181041d0 2023-09-13T09:41:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8914ff9700 1 -- 172.21.15.6:0/3375786580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f890000fb90 con 0x7f89181041d0 2023-09-13T09:41:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f8914ff9700 1 -- 172.21.15.6:0/3375786580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89000173f0 con 0x7f89181041d0 2023-09-13T09:41:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.097+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89181a1120 con 0x7f89181041d0 2023-09-13T09:41:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.099+0000 7f8914ff9700 1 -- 172.21.15.6:0/3375786580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f890000fd00 con 0x7f89181041d0 2023-09-13T09:41:50.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.100+0000 7f8914ff9700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89040a0640 0x7f89040a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.100+0000 7f89177fe700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89040a0640 0x7f89040a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.100+0000 7f8914ff9700 1 -- 172.21.15.6:0/3375786580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f89000ccfd0 con 0x7f89181041d0 2023-09-13T09:41:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.100+0000 7f89177fe700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89040a0640 0x7f89040a2b00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8908009c60 tx=0x7f8908009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 Processor -- start 2023-09-13T09:41:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 -- start start 2023-09-13T09:41:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e68e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175dc1780 con 0x558175e6a060 2023-09-13T09:41:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175dbf0a0 con 0x558175e69700 2023-09-13T09:41:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175dba990 con 0x558175e68a00 2023-09-13T09:41:50.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35294/0 (socket says 172.21.15.6:35294) 2023-09-13T09:41:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 -- 172.21.15.6:0/151650695 learned_addr learned my addr 172.21.15.6:0/151650695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f89177fe700 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8917fff700 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e68e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 -- 172.21.15.6:0/151650695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 msgr2=0x558175e68e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e68e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 -- 172.21.15.6:0/151650695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 msgr2=0x558175e69b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e69b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 -- 172.21.15.6:0/151650695 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558175c3a630 con 0x558175e6a060 2023-09-13T09:41:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f8916ffd700 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e684c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f890009a730 tx=0x7f8900005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4179e9f0cff4fac7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.101+0000 7f890dffb700 1 -- 172.21.15.6:0/151650695 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890009a7a0 con 0x558175e6a060 2023-09-13T09:41:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f890dffb700 1 -- 172.21.15.6:0/151650695 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f890009e5d0 con 0x558175e6a060 2023-09-13T09:41:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f890dffb700 1 -- 172.21.15.6:0/151650695 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89000a2550 con 0x558175e6a060 2023-09-13T09:41:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 -- 172.21.15.6:0/151650695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 msgr2=0x558175e684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e684c0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f890009a730 tx=0x7f8900005ef0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 -- 172.21.15.6:0/151650695 shutdown_connections 2023-09-13T09:41:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e68e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/151650695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e684c0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 -- 172.21.15.6:0/151650695 >> 172.21.15.6:0/151650695 conn(0x558175dc6c80 msgr2=0x558175e62f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 -- 172.21.15.6:0/151650695 shutdown_connections 2023-09-13T09:41:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.102+0000 7f8929fb8b80 1 -- 172.21.15.6:0/151650695 wait complete. 2023-09-13T09:41:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 -- start start 2023-09-13T09:41:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 Processor -- start 2023-09-13T09:41:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e71b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e72090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e790d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175d58bb0 con 0x558175e6a060 2023-09-13T09:41:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175d588b0 con 0x558175e69700 2023-09-13T09:41:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175c3c920 con 0x558175e68a00 2023-09-13T09:41:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.103+0000 7f8929fb8b80 10 client.0 _ll_register_callbacks cb 0x558175d56680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:50.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e790d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35300/0 (socket says 172.21.15.6:35300) 2023-09-13T09:41:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 -- 172.21.15.6:0/3651844258 learned_addr learned my addr 172.21.15.6:0/3651844258 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8916ffd700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e72090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f89177fe700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e71b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 -- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 msgr2=0x558175e71b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e71b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 -- 172.21.15.6:0/3651844258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 msgr2=0x558175e72090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e72090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 -- 172.21.15.6:0/3651844258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89181a1120 con 0x558175e6a060 2023-09-13T09:41:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8916ffd700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e72090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f89177fe700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e71b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8917fff700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e790d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8910007b60 tx=0x7f8910007b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8662956ecaf912d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f88f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:50.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f88f6ffd700 1 -- 172.21.15.6:0/3651844258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f891000e040 con 0x558175e6a060 2023-09-13T09:41:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f88f6ffd700 1 -- 172.21.15.6:0/3651844258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8910015720 con 0x558175e6a060 2023-09-13T09:41:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.104+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558175e5b670 con 0x558175e6a060 2023-09-13T09:41:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f88f6ffd700 1 -- 172.21.15.6:0/3651844258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f89100158e0 con 0x558175e6a060 2023-09-13T09:41:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 10 client.16023 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558175dd27a0 con 0x558175e6a060 2023-09-13T09:41:50.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f88f6ffd700 1 -- 172.21.15.6:0/3651844258 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558175e5b670 con 0x558175e6a060 2023-09-13T09:41:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f88f6ffd700 1 -- 172.21.15.6:0/3651844258 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8910016be0 con 0x558175e6a060 2023-09-13T09:41:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 10 client.16023 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:41:50.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 20 client.16023 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175e7d9e0 0x558175e7fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 4 client.16023 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558175db3970 con 0x558175e7d9e0 2023-09-13T09:41:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.105+0000 7f89177fe700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175e7d9e0 0x558175e7fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.106+0000 7f88f6ffd700 10 client.16023 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:50.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.106+0000 7f89177fe700 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175e7d9e0 0x558175e7fe00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=54b1fad80ed067e9 server_cookie=9f9d6f68b3875e9f in_seq=0 out_seq=0 2023-09-13T09:41:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.106+0000 7f88f6ffd700 1 -- 172.21.15.6:0/3651844258 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558175db3970 con 0x558175e7d9e0 2023-09-13T09:41:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.106+0000 7f88f6ffd700 10 client.16023 handle_command_reply: tid=0 2023-09-13T09:41:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.106+0000 7f8929fb8b80 1 client.16023 shutdown 2023-09-13T09:41:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 msgr2=0x558175e790d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e790d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f8910007b60 tx=0x7f8910007b90 comp rx=0 tx=0).stop 2023-09-13T09:41:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 shutdown_connections 2023-09-13T09:41:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175e7d9e0 0x558175e7fe00 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e6a060 0x558175e790d0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e68a00 0x558175e71b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f88f6ffd700 0 client.16023 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/3651844258 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e72090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 >> 172.21.15.6:0/3651844258 conn(0x558175dc6c80 msgr2=0x558175e5d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 shutdown_connections 2023-09-13T09:41:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 1 -- 172.21.15.6:0/3651844258 wait complete. 2023-09-13T09:41:50.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.107+0000 7f8929fb8b80 20 client.16023 trim_cache size 0 max 16384 2023-09-13T09:41:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 Processor -- start 2023-09-13T09:41:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 -- start start 2023-09-13T09:41:50.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e78ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e6a060 0x558175e6c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175e716c0 con 0x558175e68a00 2023-09-13T09:41:50.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175e5f8e0 con 0x558175e69700 2023-09-13T09:41:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175e64730 con 0x558175e6a060 2023-09-13T09:41:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e684c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35304/0 (socket says 172.21.15.6:35304) 2023-09-13T09:41:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 -- 172.21.15.6:0/1274955765 learned_addr learned my addr 172.21.15.6:0/1274955765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8916ffd700 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e78ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 -- 172.21.15.6:0/1274955765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e6a060 msgr2=0x558175e6c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8917fff700 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e6a060 0x558175e6c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e6a060 0x558175e6c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 -- 172.21.15.6:0/1274955765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 msgr2=0x558175e78ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e78ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f89177fe700 1 -- 172.21.15.6:0/1274955765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558175be6de0 con 0x558175e68a00 2023-09-13T09:41:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.120+0000 7f8916ffd700 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f89177fe700 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e684c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x558175e80710 tx=0x7f8908017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46511648d1d8d92e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f890e7fc700 1 -- 172.21.15.6:0/1274955765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908023040 con 0x558175e68a00 2023-09-13T09:41:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f890e7fc700 1 -- 172.21.15.6:0/1274955765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8908029e10 con 0x558175e68a00 2023-09-13T09:41:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f890e7fc700 1 -- 172.21.15.6:0/1274955765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89080038e0 con 0x558175e68a00 2023-09-13T09:41:50.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 -- 172.21.15.6:0/1274955765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 msgr2=0x558175e684c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e684c0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x558175e80710 tx=0x7f8908017000 comp rx=0 tx=0).stop 2023-09-13T09:41:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 -- 172.21.15.6:0/1274955765 shutdown_connections 2023-09-13T09:41:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e6a060 0x558175e6c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e684c0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/1274955765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e69700 0x558175e78ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 -- 172.21.15.6:0/1274955765 >> 172.21.15.6:0/1274955765 conn(0x558175dc6c80 msgr2=0x558175e62e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 -- 172.21.15.6:0/1274955765 shutdown_connections 2023-09-13T09:41:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.121+0000 7f8929fb8b80 1 -- 172.21.15.6:0/1274955765 wait complete. 2023-09-13T09:41:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 -- start start 2023-09-13T09:41:50.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 Processor -- start 2023-09-13T09:41:50.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e74f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e69700 0x558175e75450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e6a060 0x558175e78470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175e789b0 con 0x558175e68a00 2023-09-13T09:41:50.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175e78b20 con 0x558175e6a060 2023-09-13T09:41:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558175e78ce0 con 0x558175e69700 2023-09-13T09:41:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8929fb8b80 10 client.0 _ll_register_callbacks cb 0x558175d56680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f89177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e74f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f89177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e74f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35310/0 (socket says 172.21.15.6:35310) 2023-09-13T09:41:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f89177fe700 1 -- 172.21.15.6:0/565132314 learned_addr learned my addr 172.21.15.6:0/565132314 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8917fff700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e6a060 0x558175e78470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f8916ffd700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e69700 0x558175e75450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f89177fe700 1 -- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e69700 msgr2=0x558175e75450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.122+0000 7f89177fe700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e69700 0x558175e75450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f89177fe700 1 -- 172.21.15.6:0/565132314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e6a060 msgr2=0x558175e78470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f89177fe700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e6a060 0x558175e78470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f89177fe700 1 -- 172.21.15.6:0/565132314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8908017070 con 0x558175e68a00 2023-09-13T09:41:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8917fff700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e6a060 0x558175e78470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f89177fe700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e74f10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8908029530 tx=0x7f8908029560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7795c0ba33188dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f88f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:50.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f88f6ffd700 1 -- 172.21.15.6:0/565132314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8908023040 con 0x558175e68a00 2023-09-13T09:41:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f88f6ffd700 1 -- 172.21.15.6:0/565132314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f890801eb00 con 0x558175e68a00 2023-09-13T09:41:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f890009e5d0 con 0x558175e68a00 2023-09-13T09:41:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f88f6ffd700 1 -- 172.21.15.6:0/565132314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8908005040 con 0x558175e68a00 2023-09-13T09:41:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 10 client.16029 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558175bcfc60 con 0x558175e68a00 2023-09-13T09:41:50.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f88f6ffd700 1 -- 172.21.15.6:0/565132314 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f890009e5d0 con 0x558175e68a00 2023-09-13T09:41:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f88f6ffd700 1 -- 172.21.15.6:0/565132314 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8908004c30 con 0x558175e68a00 2023-09-13T09:41:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 10 client.16029 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 10 client.16029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:41:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 20 client.16029 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:50.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175ed28c0 0x558175ed4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 4 client.16029 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.123+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558175d74050 con 0x558175ed28c0 2023-09-13T09:41:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.124+0000 7f8916ffd700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175ed28c0 0x558175ed4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.124+0000 7f88f6ffd700 10 client.16029 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:50.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.124+0000 7f8916ffd700 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175ed28c0 0x558175ed4ce0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e1be1e868a976012 server_cookie=e27af72364061390 in_seq=0 out_seq=0 2023-09-13T09:41:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.124+0000 7f88f6ffd700 1 -- 172.21.15.6:0/565132314 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558175d74050 con 0x558175ed28c0 2023-09-13T09:41:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.124+0000 7f88f6ffd700 10 client.16029 handle_command_reply: tid=0 2023-09-13T09:41:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.124+0000 7f8929fb8b80 1 client.16029 shutdown 2023-09-13T09:41:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 msgr2=0x558175e74f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e74f10 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8908029530 tx=0x7f8908029560 comp rx=0 tx=0).stop 2023-09-13T09:41:50.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 shutdown_connections 2023-09-13T09:41:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558175ed28c0 0x558175ed4ce0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558175e6a060 0x558175e78470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558175e68a00 0x558175e74f10 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 --2- 172.21.15.6:0/565132314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558175e69700 0x558175e75450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 >> 172.21.15.6:0/565132314 conn(0x558175dc6c80 msgr2=0x558175e6c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f88f6ffd700 0 client.16029 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:41:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 shutdown_connections 2023-09-13T09:41:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 1 -- 172.21.15.6:0/565132314 wait complete. 2023-09-13T09:41:50.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f8929fb8b80 20 client.16029 trim_cache size 0 max 16384 2023-09-13T09:41:50.150 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89040a0640 msgr2=0x7f89040a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89040a0640 0x7f89040a2b00 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8908009c60 tx=0x7f8908009260 comp rx=0 tx=0).stop 2023-09-13T09:41:50.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 msgr2=0x7f89180ff850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89180ff850 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f89000059d0 tx=0x7f8900004730 comp rx=0 tx=0).stop 2023-09-13T09:41:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 shutdown_connections 2023-09-13T09:41:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8918106b00 0x7f89180ffd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f89181018a0 0x7f8918101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f89040a0640 0x7f89040a2b00 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 --2- 172.21.15.6:0/3375786580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89181041d0 0x7f89180ff850 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 >> 172.21.15.6:0/3375786580 conn(0x7f89180fb250 msgr2=0x7f8918102510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 shutdown_connections 2023-09-13T09:41:50.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.125+0000 7f891ddd3700 1 -- 172.21.15.6:0/3375786580 wait complete. 2023-09-13T09:41:50.154 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:41:50.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 71051 5.74 MB/sec warmup 70 sec latency 1651.449 ms 2023-09-13T09:41:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:49 smithi053 ceph-mon[102373]: pgmap v369: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 209 KiB/s wr, 54 op/s 2023-09-13T09:41:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:49 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1972239487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:41:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:49 smithi131 ceph-mon[102785]: pgmap v369: 97 pgs: 97 active+clean; 44 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 213 KiB/s rd, 209 KiB/s wr, 54 op/s 2023-09-13T09:41:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:49 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1972239487' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:41:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.319+0000 7fee3f528700 1 -- 172.21.15.6:0/413678202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee380ff080 msgr2=0x7fee380ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.319+0000 7fee3f528700 1 --2- 172.21.15.6:0/413678202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee380ff080 0x7fee380ff4a0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fee34009990 tx=0x7fee34009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.319+0000 7fee3f528700 1 -- 172.21.15.6:0/413678202 shutdown_connections 2023-09-13T09:41:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.319+0000 7fee3f528700 1 --2- 172.21.15.6:0/413678202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee381029f0 0x7fee381092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.319+0000 7fee3f528700 1 --2- 172.21.15.6:0/413678202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee380ff080 0x7fee380ff4a0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.319+0000 7fee3f528700 1 --2- 172.21.15.6:0/413678202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee38102050 0x7fee381024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.319+0000 7fee3f528700 1 -- 172.21.15.6:0/413678202 >> 172.21.15.6:0/413678202 conn(0x7fee380fa9b0 msgr2=0x7fee380fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 -- 172.21.15.6:0/413678202 shutdown_connections 2023-09-13T09:41:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 -- 172.21.15.6:0/413678202 wait complete. 2023-09-13T09:41:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 Processor -- start 2023-09-13T09:41:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 -- start start 2023-09-13T09:41:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee380ff080 0x7fee38196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee38102050 0x7fee38196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee381029f0 0x7fee3819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3819e610 con 0x7fee381029f0 2023-09-13T09:41:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3819e750 con 0x7fee380ff080 2023-09-13T09:41:50.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3f528700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3819e8e0 con 0x7fee38102050 2023-09-13T09:41:50.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3dac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee381029f0 0x7fee3819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3dac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee381029f0 0x7fee3819e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35328/0 (socket says 172.21.15.6:35328) 2023-09-13T09:41:50.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3d2c4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee380ff080 0x7fee38196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.320+0000 7fee3dac5700 1 -- 172.21.15.6:0/3331217050 learned_addr learned my addr 172.21.15.6:0/3331217050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3cac3700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee38102050 0x7fee38196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3dac5700 1 -- 172.21.15.6:0/3331217050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee38102050 msgr2=0x7fee38196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3dac5700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee38102050 0x7fee38196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3dac5700 1 -- 172.21.15.6:0/3331217050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee380ff080 msgr2=0x7fee38196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3dac5700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee380ff080 0x7fee38196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3dac5700 1 -- 172.21.15.6:0/3331217050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee340095f0 con 0x7fee381029f0 2023-09-13T09:41:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3dac5700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee381029f0 0x7fee3819e040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fee3000ada0 tx=0x7fee3000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee2e7fc700 1 -- 172.21.15.6:0/3331217050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3000f070 con 0x7fee381029f0 2023-09-13T09:41:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee3819ebc0 con 0x7fee381029f0 2023-09-13T09:41:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee2e7fc700 1 -- 172.21.15.6:0/3331217050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee30007b30 con 0x7fee381029f0 2023-09-13T09:41:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee2e7fc700 1 -- 172.21.15.6:0/3331217050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30005280 con 0x7fee381029f0 2023-09-13T09:41:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.321+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3819f080 con 0x7fee381029f0 2023-09-13T09:41:50.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.323+0000 7fee2e7fc700 1 -- 172.21.15.6:0/3331217050 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fee3000c8d0 con 0x7fee381029f0 2023-09-13T09:41:50.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.324+0000 7fee2e7fc700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fee240a0640 0x7fee240a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.324+0000 7fee2e7fc700 1 -- 172.21.15.6:0/3331217050 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fee300cb1b0 con 0x7fee381029f0 2023-09-13T09:41:50.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.324+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fee240a0640 0x7fee240a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.324+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fee240a0640 0x7fee240a2b00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee34006010 tx=0x7fee34005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 Processor -- start 2023-09-13T09:41:50.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 -- start start 2023-09-13T09:41:50.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e1eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e1d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e1de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816d76780 con 0x563816e1da00 2023-09-13T09:41:50.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816d740a0 con 0x563816e1e700 2023-09-13T09:41:50.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee4b70db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816d6f990 con 0x563816e1f060 2023-09-13T09:41:50.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee3dac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e1de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee3dac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e1de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35336/0 (socket says 172.21.15.6:35336) 2023-09-13T09:41:50.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee3dac5700 1 -- 172.21.15.6:0/4017094808 learned_addr learned my addr 172.21.15.6:0/4017094808 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e1eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.325+0000 7fee3cac3700 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e1d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee3dac5700 1 -- 172.21.15.6:0/4017094808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 msgr2=0x563816e1d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee3dac5700 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e1d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee3dac5700 1 -- 172.21.15.6:0/4017094808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 msgr2=0x563816e1eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee3dac5700 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e1eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee3dac5700 1 -- 172.21.15.6:0/4017094808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563816bef630 con 0x563816e1da00 2023-09-13T09:41:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee3cac3700 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e1d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee3dac5700 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e1de80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fee300a0430 tx=0x7fee30098410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553966d782395ecf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee237fe700 1 -- 172.21.15.6:0/4017094808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300a0960 con 0x563816e1da00 2023-09-13T09:41:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee237fe700 1 -- 172.21.15.6:0/4017094808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee30096ac0 con 0x563816e1da00 2023-09-13T09:41:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee237fe700 1 -- 172.21.15.6:0/4017094808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30098be0 con 0x563816e1da00 2023-09-13T09:41:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.326+0000 7fee4b70db80 1 -- 172.21.15.6:0/4017094808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 msgr2=0x563816e1de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e1de80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fee300a0430 tx=0x7fee30098410 comp rx=0 tx=0).stop 2023-09-13T09:41:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 -- 172.21.15.6:0/4017094808 shutdown_connections 2023-09-13T09:41:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e1de80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e1eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 --2- 172.21.15.6:0/4017094808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e1d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 -- 172.21.15.6:0/4017094808 >> 172.21.15.6:0/4017094808 conn(0x563816d7bc80 msgr2=0x563816e17f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 -- 172.21.15.6:0/4017094808 shutdown_connections 2023-09-13T09:41:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 -- 172.21.15.6:0/4017094808 wait complete. 2023-09-13T09:41:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 -- start start 2023-09-13T09:41:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 Processor -- start 2023-09-13T09:41:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e26ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e27420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.327+0000 7fee4b70db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816d0dbb0 con 0x563816e1da00 2023-09-13T09:41:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee4b70db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816d0d8b0 con 0x563816e1e700 2023-09-13T09:41:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee4b70db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816bf1920 con 0x563816e1f060 2023-09-13T09:41:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e26ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee4b70db80 10 client.0 _ll_register_callbacks cb 0x563816d0b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e26ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35338/0 (socket says 172.21.15.6:35338) 2023-09-13T09:41:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 -- 172.21.15.6:0/3049467969 learned_addr learned my addr 172.21.15.6:0/3049467969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3cac3700 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e27420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3dac5700 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 -- 172.21.15.6:0/3049467969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 msgr2=0x563816e2e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 -- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 msgr2=0x563816e27420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e27420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 -- 172.21.15.6:0/3049467969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee3819f080 con 0x563816e1da00 2023-09-13T09:41:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e26ee0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fee38067db0 tx=0x7fee34009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e944a5198e78dda server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee20ff9700 1 -- 172.21.15.6:0/3049467969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3402a050 con 0x563816e1da00 2023-09-13T09:41:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee20ff9700 1 -- 172.21.15.6:0/3049467969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fee34023870 con 0x563816e1da00 2023-09-13T09:41:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.328+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563816e10670 con 0x563816e1da00 2023-09-13T09:41:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee20ff9700 1 -- 172.21.15.6:0/3049467969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee34023a70 con 0x563816e1da00 2023-09-13T09:41:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 10 client.16041 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x563816d877a0 con 0x563816e1da00 2023-09-13T09:41:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee20ff9700 1 -- 172.21.15.6:0/3049467969 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee3403e020 con 0x563816e1da00 2023-09-13T09:41:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee20ff9700 1 -- 172.21.15.6:0/3049467969 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fee3400fc60 con 0x563816e1da00 2023-09-13T09:41:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 10 client.16041 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 10 client.16041 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 20 client.16041 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e32cd0 0x563816e350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 4 client.16041 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563816d68970 con 0x563816e32cd0 2023-09-13T09:41:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.329+0000 7fee3cac3700 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e32cd0 0x563816e350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee20ff9700 10 client.16041 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee3cac3700 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e32cd0 0x563816e350f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa23b7517525b61 server_cookie=b0eaa04a33daf60d in_seq=0 out_seq=0 2023-09-13T09:41:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee20ff9700 1 -- 172.21.15.6:0/3049467969 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563816d68970 con 0x563816e32cd0 2023-09-13T09:41:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee20ff9700 10 client.16041 handle_command_reply: tid=0 2023-09-13T09:41:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee4b70db80 1 client.16041 shutdown 2023-09-13T09:41:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 msgr2=0x563816e26ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e26ee0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fee38067db0 tx=0x7fee34009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.330+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 shutdown_connections 2023-09-13T09:41:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e32cd0 0x563816e350f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e26ee0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3049467969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e27420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee20ff9700 0 client.16041 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 >> 172.21.15.6:0/3049467969 conn(0x563816d7bc80 msgr2=0x563816e127f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 shutdown_connections 2023-09-13T09:41:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 1 -- 172.21.15.6:0/3049467969 wait complete. 2023-09-13T09:41:50.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.331+0000 7fee4b70db80 20 client.16041 trim_cache size 0 max 16384 2023-09-13T09:41:50.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 Processor -- start 2023-09-13T09:41:50.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 -- start start 2023-09-13T09:41:50.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1da00 0x563816e1d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1e700 0x563816e2e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1f060 0x563816e1de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816e263d0 con 0x563816e1f060 2023-09-13T09:41:50.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816e26a80 con 0x563816e1da00 2023-09-13T09:41:50.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee4b70db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816e18ab0 con 0x563816e1e700 2023-09-13T09:41:50.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1f060 0x563816e1de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1f060 0x563816e1de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35350/0 (socket says 172.21.15.6:35350) 2023-09-13T09:41:50.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 -- 172.21.15.6:0/3069870671 learned_addr learned my addr 172.21.15.6:0/3069870671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3cac3700 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1e700 0x563816e2e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1da00 0x563816e1d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 -- 172.21.15.6:0/3069870671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1e700 msgr2=0x563816e2e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1e700 0x563816e2e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 -- 172.21.15.6:0/3069870671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1da00 msgr2=0x563816e1d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1da00 0x563816e1d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3dac5700 1 -- 172.21.15.6:0/3069870671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563816b9bde0 con 0x563816e1f060 2023-09-13T09:41:50.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.344+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1da00 0x563816e1d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:50.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee3dac5700 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1f060 0x563816e1de40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fee300953f0 tx=0x7fee3001afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8340d4f39db87b10 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee23fff700 1 -- 172.21.15.6:0/3069870671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee300a0960 con 0x563816e1f060 2023-09-13T09:41:50.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee23fff700 1 -- 172.21.15.6:0/3069870671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee30096d20 con 0x563816e1f060 2023-09-13T09:41:50.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee23fff700 1 -- 172.21.15.6:0/3069870671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee30098e40 con 0x563816e1f060 2023-09-13T09:41:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 -- 172.21.15.6:0/3069870671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1f060 msgr2=0x563816e1de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1f060 0x563816e1de40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fee300953f0 tx=0x7fee3001afb0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 -- 172.21.15.6:0/3069870671 shutdown_connections 2023-09-13T09:41:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1f060 0x563816e1de40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1da00 0x563816e1d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 --2- 172.21.15.6:0/3069870671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1e700 0x563816e2e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 -- 172.21.15.6:0/3069870671 >> 172.21.15.6:0/3069870671 conn(0x563816d7bc80 msgr2=0x563816e17e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 -- 172.21.15.6:0/3069870671 shutdown_connections 2023-09-13T09:41:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.345+0000 7fee4b70db80 1 -- 172.21.15.6:0/3069870671 wait complete. 2023-09-13T09:41:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 -- start start 2023-09-13T09:41:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 Processor -- start 2023-09-13T09:41:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e2a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e2a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816e2dd70 con 0x563816e1da00 2023-09-13T09:41:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816e2dee0 con 0x563816e1e700 2023-09-13T09:41:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563816e2e0a0 con 0x563816e1f060 2023-09-13T09:41:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee4b70db80 10 client.0 _ll_register_callbacks cb 0x563816d0b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e2a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e2a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35352/0 (socket says 172.21.15.6:35352) 2023-09-13T09:41:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 -- 172.21.15.6:0/2153948693 learned_addr learned my addr 172.21.15.6:0/2153948693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3cac3700 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e2a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3dac5700 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 -- 172.21.15.6:0/2153948693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 msgr2=0x563816e2d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 -- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 msgr2=0x563816e2a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e2a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.346+0000 7fee3d2c4700 1 -- 172.21.15.6:0/2153948693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563816bef630 con 0x563816e1da00 2023-09-13T09:41:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee3d2c4700 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e2a2d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fee3400b5c0 tx=0x7fee3400b5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=145c8750bbfde6f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee20ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee20ff9700 1 -- 172.21.15.6:0/2153948693 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee3402a070 con 0x563816e1da00 2023-09-13T09:41:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee20ff9700 1 -- 172.21.15.6:0/2153948693 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fee3403f080 con 0x563816e1da00 2023-09-13T09:41:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fee30096ac0 con 0x563816e1da00 2023-09-13T09:41:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee20ff9700 1 -- 172.21.15.6:0/2153948693 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee34038e80 con 0x563816e1da00 2023-09-13T09:41:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 10 client.16047 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x563816b84c60 con 0x563816e1da00 2023-09-13T09:41:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee20ff9700 1 -- 172.21.15.6:0/2153948693 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fee30096ac0 con 0x563816e1da00 2023-09-13T09:41:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee20ff9700 1 -- 172.21.15.6:0/2153948693 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fee3400f8d0 con 0x563816e1da00 2023-09-13T09:41:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 10 client.16047 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 20 client.16047 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e87830 0x563816e89c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 4 client.16047 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:41:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.347+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563816d29050 con 0x563816e87830 2023-09-13T09:41:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee3cac3700 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e87830 0x563816e89c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee20ff9700 10 client.16047 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee3cac3700 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e87830 0x563816e89c50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b161a7153ebd0fdb server_cookie=f80620aa54808155 in_seq=0 out_seq=0 2023-09-13T09:41:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee20ff9700 1 -- 172.21.15.6:0/2153948693 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563816d29050 con 0x563816e87830 2023-09-13T09:41:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee20ff9700 10 client.16047 handle_command_reply: tid=0 2023-09-13T09:41:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 client.16047 shutdown 2023-09-13T09:41:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 msgr2=0x563816e2a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e2a2d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fee3400b5c0 tx=0x7fee3400b5f0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 shutdown_connections 2023-09-13T09:41:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563816e1f060 0x563816e2d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563816e87830 0x563816e89c50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563816e1da00 0x563816e2a2d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee20ff9700 0 client.16047 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 --2- 172.21.15.6:0/2153948693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563816e1e700 0x563816e2a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.348+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 >> 172.21.15.6:0/2153948693 conn(0x563816d7bc80 msgr2=0x563816e21920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 shutdown_connections 2023-09-13T09:41:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee4b70db80 1 -- 172.21.15.6:0/2153948693 wait complete. 2023-09-13T09:41:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee4b70db80 20 client.16047 trim_cache size 0 max 16384 2023-09-13T09:41:50.373 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:41:50.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fee240a0640 msgr2=0x7fee240a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fee240a0640 0x7fee240a2b00 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fee34006010 tx=0x7fee34005960 comp rx=0 tx=0).stop 2023-09-13T09:41:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee381029f0 msgr2=0x7fee3819e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee381029f0 0x7fee3819e040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fee3000ada0 tx=0x7fee3000c330 comp rx=0 tx=0).stop 2023-09-13T09:41:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 shutdown_connections 2023-09-13T09:41:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fee240a0640 0x7fee240a2b00 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee381029f0 0x7fee3819e040 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fee380ff080 0x7fee38196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 --2- 172.21.15.6:0/3331217050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fee38102050 0x7fee38196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 >> 172.21.15.6:0/3331217050 conn(0x7fee380fa9b0 msgr2=0x7fee38105590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 shutdown_connections 2023-09-13T09:41:50.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:50.349+0000 7fee3f528700 1 -- 172.21.15.6:0/3331217050 wait complete. 2023-09-13T09:41:51.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 71051 5.66 MB/sec warmup 71 sec latency 2651.569 ms 2023-09-13T09:41:51.378 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:41:51.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:41:51.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 -- 172.21.15.6:0/4067905050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 msgr2=0x7fea5c103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4067905050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c103c90 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fea4c009990 tx=0x7fea4c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 -- 172.21.15.6:0/4067905050 shutdown_connections 2023-09-13T09:41:51.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4067905050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c106b00 0x7fea5c108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4067905050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c103c90 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4067905050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea5c1041d0 0x7fea5c1065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 -- 172.21.15.6:0/4067905050 >> 172.21.15.6:0/4067905050 conn(0x7fea5c0fb210 msgr2=0x7fea5c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.521+0000 7fea61f4a700 1 -- 172.21.15.6:0/4067905050 shutdown_connections 2023-09-13T09:41:51.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.522+0000 7fea61f4a700 1 -- 172.21.15.6:0/4067905050 wait complete. 2023-09-13T09:41:51.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.522+0000 7fea61f4a700 1 Processor -- start 2023-09-13T09:41:51.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.522+0000 7fea61f4a700 1 -- start start 2023-09-13T09:41:51.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.522+0000 7fea61f4a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.522+0000 7fea61f4a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c1041d0 0x7fea5c1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea61f4a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea5c106b00 0x7fea5c1a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea61f4a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1a07e0 con 0x7fea5c1018a0 2023-09-13T09:41:51.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea61f4a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1a0950 con 0x7fea5c1041d0 2023-09-13T09:41:51.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea61f4a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea5c1a0b10 con 0x7fea5c106b00 2023-09-13T09:41:51.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35366/0 (socket says 172.21.15.6:35366) 2023-09-13T09:41:51.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 -- 172.21.15.6:0/4025173765 learned_addr learned my addr 172.21.15.6:0/4025173765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5affd700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c1041d0 0x7fea5c1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5bfff700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea5c106b00 0x7fea5c1a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 -- 172.21.15.6:0/4025173765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea5c106b00 msgr2=0x7fea5c1a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea5c106b00 0x7fea5c1a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 -- 172.21.15.6:0/4025173765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c1041d0 msgr2=0x7fea5c1991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c1041d0 0x7fea5c1991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 -- 172.21.15.6:0/4025173765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0095f0 con 0x7fea5c1018a0 2023-09-13T09:41:51.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5bfff700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea5c106b00 0x7fea5c1a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:51.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c198c70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fea4c004730 tx=0x7fea4c004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea58ff9700 1 -- 172.21.15.6:0/4025173765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c01d070 con 0x7fea5c1018a0 2023-09-13T09:41:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea5c1a0d90 con 0x7fea5c1018a0 2023-09-13T09:41:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea58ff9700 1 -- 172.21.15.6:0/4025173765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea4c004c90 con 0x7fea5c1018a0 2023-09-13T09:41:51.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea58ff9700 1 -- 172.21.15.6:0/4025173765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c005570 con 0x7fea5c1018a0 2023-09-13T09:41:51.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.523+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c1a11b0 con 0x7fea5c1018a0 2023-09-13T09:41:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.526+0000 7fea58ff9700 1 -- 172.21.15.6:0/4025173765 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fea4c00fc70 con 0x7fea5c1018a0 2023-09-13T09:41:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.527+0000 7fea58ff9700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea440a0640 0x7fea440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.527+0000 7fea5affd700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea440a0640 0x7fea440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.527+0000 7fea58ff9700 1 -- 172.21.15.6:0/4025173765 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea4c0ccfa0 con 0x7fea5c1018a0 2023-09-13T09:41:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.527+0000 7fea5affd700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea440a0640 0x7fea440a2b00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea5c19a170 tx=0x7fea50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.527+0000 7fea6e12fb80 1 Processor -- start 2023-09-13T09:41:51.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea6e12fb80 1 -- start start 2023-09-13T09:41:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1520f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15204e800 con 0x55c1520f6780 2023-09-13T09:41:51.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c15204c120 con 0x55c1520f5a80 2023-09-13T09:41:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c152047a10 con 0x55c1520f70e0 2023-09-13T09:41:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35376/0 (socket says 172.21.15.6:35376) 2023-09-13T09:41:51.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 -- 172.21.15.6:0/156361205 learned_addr learned my addr 172.21.15.6:0/156361205 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5bfff700 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5affd700 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1520f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 -- 172.21.15.6:0/156361205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 msgr2=0x55c1520f5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1520f5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 -- 172.21.15.6:0/156361205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 msgr2=0x55c1520f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 -- 172.21.15.6:0/156361205 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c151ec76b0 con 0x55c1520f6780 2023-09-13T09:41:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5bfff700 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5affd700 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1520f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:41:51.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.528+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520f6ba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fea4c09a760 tx=0x7fea4c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5a568658664040 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea41ffb700 1 -- 172.21.15.6:0/156361205 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c09aed0 con 0x55c1520f6780 2023-09-13T09:41:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea41ffb700 1 -- 172.21.15.6:0/156361205 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea4c09a7d0 con 0x55c1520f6780 2023-09-13T09:41:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea41ffb700 1 -- 172.21.15.6:0/156361205 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c099f00 con 0x55c1520f6780 2023-09-13T09:41:51.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 -- 172.21.15.6:0/156361205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 msgr2=0x55c1520f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520f6ba0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fea4c09a760 tx=0x7fea4c005ef0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 -- 172.21.15.6:0/156361205 shutdown_connections 2023-09-13T09:41:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520f6ba0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/156361205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1520f5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 -- 172.21.15.6:0/156361205 >> 172.21.15.6:0/156361205 conn(0x55c152053d00 msgr2=0x55c1520eff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 -- 172.21.15.6:0/156361205 shutdown_connections 2023-09-13T09:41:51.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.529+0000 7fea6e12fb80 1 -- 172.21.15.6:0/156361205 wait complete. 2023-09-13T09:41:51.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.530+0000 7fea6e12fb80 1 -- start start 2023-09-13T09:41:51.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.530+0000 7fea6e12fb80 1 Processor -- start 2023-09-13T09:41:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.530+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520fec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.530+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520ff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.530+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1521061e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.530+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c151fe5c30 con 0x55c1520f6780 2023-09-13T09:41:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.530+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c151fe5930 con 0x55c1520f5a80 2023-09-13T09:41:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c151ec99a0 con 0x55c1520f70e0 2023-09-13T09:41:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea6e12fb80 10 client.0 _ll_register_callbacks cb 0x55c151fe3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520ff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520ff1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35382/0 (socket says 172.21.15.6:35382) 2023-09-13T09:41:51.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520fec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 -- 172.21.15.6:0/2371582449 learned_addr learned my addr 172.21.15.6:0/2371582449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5bfff700 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1521061e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 -- 172.21.15.6:0/2371582449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 msgr2=0x55c1521061e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1521061e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 -- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 msgr2=0x55c1520fec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520fec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 -- 172.21.15.6:0/2371582449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea5c1a11b0 con 0x55c1520f6780 2023-09-13T09:41:51.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:51.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea5affd700 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520ff1a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fea50009b20 tx=0x7fea500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c339433abbf7b726 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea3affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea3affd700 1 -- 172.21.15.6:0/2371582449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea50004230 con 0x55c1520f6780 2023-09-13T09:41:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea3affd700 1 -- 172.21.15.6:0/2371582449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea50004390 con 0x55c1520f6780 2023-09-13T09:41:51.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.531+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1520e86f0 con 0x55c1520f6780 2023-09-13T09:41:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea3affd700 1 -- 172.21.15.6:0/2371582449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea50004550 con 0x55c1520f6780 2023-09-13T09:41:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 10 client.16059 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c15205f820 con 0x55c1520f6780 2023-09-13T09:41:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea3affd700 1 -- 172.21.15.6:0/2371582449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c1520e86f0 con 0x55c1520f6780 2023-09-13T09:41:51.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea3affd700 1 -- 172.21.15.6:0/2371582449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fea5001ba50 con 0x55c1520f6780 2023-09-13T09:41:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 10 client.16059 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 20 client.16059 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c15210aa00 0x55c15210ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 4 client.16059 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:51.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1520409f0 con 0x55c15210aa00 2023-09-13T09:41:51.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.532+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c15210aa00 0x55c15210ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.533+0000 7fea3affd700 10 client.16059 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.533+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c15210aa00 0x55c15210ce20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d26cd03286559 server_cookie=746075617ff4924d in_seq=0 out_seq=0 2023-09-13T09:41:51.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.533+0000 7fea3affd700 1 -- 172.21.15.6:0/2371582449 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c1520409f0 con 0x55c15210aa00 2023-09-13T09:41:51.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea3affd700 10 client.16059 handle_command_reply: tid=0 2023-09-13T09:41:51.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 client.16059 shutdown 2023-09-13T09:41:51.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 msgr2=0x55c1520ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520ff1a0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fea50009b20 tx=0x7fea500047c0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 shutdown_connections 2023-09-13T09:41:51.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f70e0 0x55c1521061e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c1520fec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c15210aa00 0x55c15210ce20 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2371582449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c1520ff1a0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea3affd700 0 client.16059 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 >> 172.21.15.6:0/2371582449 conn(0x55c152053d00 msgr2=0x55c1520ea870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 shutdown_connections 2023-09-13T09:41:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2371582449 wait complete. 2023-09-13T09:41:51.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.534+0000 7fea6e12fb80 20 client.16059 trim_cache size 0 max 16384 2023-09-13T09:41:51.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 Processor -- start 2023-09-13T09:41:51.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 -- start start 2023-09-13T09:41:51.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c152053d00 0x55c1520f5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f5a80 0x55c1521061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f6780 0x55c1520fec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1520fe7d0 con 0x55c152053d00 2023-09-13T09:41:51.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c152107dc0 con 0x55c1520f6780 2023-09-13T09:41:51.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1520fd700 con 0x55c1520f5a80 2023-09-13T09:41:51.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c152053d00 0x55c1520f5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c152053d00 0x55c1520f5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35388/0 (socket says 172.21.15.6:35388) 2023-09-13T09:41:51.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea5b7fe700 1 -- 172.21.15.6:0/3067781050 learned_addr learned my addr 172.21.15.6:0/3067781050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea5affd700 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f5a80 0x55c1521061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.551+0000 7fea5bfff700 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f6780 0x55c1520fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea5b7fe700 1 -- 172.21.15.6:0/3067781050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f5a80 msgr2=0x55c1521061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f5a80 0x55c1521061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea5b7fe700 1 -- 172.21.15.6:0/3067781050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f6780 msgr2=0x55c1520fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f6780 0x55c1520fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea5b7fe700 1 -- 172.21.15.6:0/3067781050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1520f6130 con 0x55c152053d00 2023-09-13T09:41:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c152053d00 0x55c1520f5540 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0caaa0 tx=0x7fea4c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4b78b0c2964379 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea427fc700 1 -- 172.21.15.6:0/3067781050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c098be0 con 0x55c152053d00 2023-09-13T09:41:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea427fc700 1 -- 172.21.15.6:0/3067781050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea4c0a27b0 con 0x55c152053d00 2023-09-13T09:41:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea427fc700 1 -- 172.21.15.6:0/3067781050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c060df0 con 0x55c152053d00 2023-09-13T09:41:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea6e12fb80 1 -- 172.21.15.6:0/3067781050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c152053d00 msgr2=0x55c1520f5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.552+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c152053d00 0x55c1520f5540 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0caaa0 tx=0x7fea4c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- 172.21.15.6:0/3067781050 shutdown_connections 2023-09-13T09:41:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f6780 0x55c1520fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c152053d00 0x55c1520f5540 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/3067781050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1520f5a80 0x55c1521061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- 172.21.15.6:0/3067781050 >> 172.21.15.6:0/3067781050 conn(0x55c1520f02c0 msgr2=0x55c152106ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- 172.21.15.6:0/3067781050 shutdown_connections 2023-09-13T09:41:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- 172.21.15.6:0/3067781050 wait complete. 2023-09-13T09:41:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- start start 2023-09-13T09:41:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 Processor -- start 2023-09-13T09:41:51.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c152053d00 0x55c1521023e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c152102920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c152105940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c152105e80 con 0x55c1520f6780 2023-09-13T09:41:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c152105ff0 con 0x55c1520f5a80 2023-09-13T09:41:51.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1521061b0 con 0x55c152053d00 2023-09-13T09:41:51.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea6e12fb80 10 client.0 _ll_register_callbacks cb 0x55c151fe3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:51.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c152105940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c152105940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35398/0 (socket says 172.21.15.6:35398) 2023-09-13T09:41:51.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.553+0000 7fea5bfff700 1 -- 172.21.15.6:0/2572377665 learned_addr learned my addr 172.21.15.6:0/2572377665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5affd700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c152102920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c152053d00 0x55c1521023e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5bfff700 1 -- 172.21.15.6:0/2572377665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c152053d00 msgr2=0x55c1521023e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5bfff700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c152053d00 0x55c1521023e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5bfff700 1 -- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 msgr2=0x55c152102920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5bfff700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c152102920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5bfff700 1 -- 172.21.15.6:0/2572377665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c151ec76b0 con 0x55c1520f6780 2023-09-13T09:41:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5affd700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c152102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:41:51.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea5bfff700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c152105940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fea54007bf0 tx=0x7fea54007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c8c1a4eb1f6c93e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea3affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea3affd700 1 -- 172.21.15.6:0/2572377665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea54015ac0 con 0x55c1520f6780 2023-09-13T09:41:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea3affd700 1 -- 172.21.15.6:0/2572377665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea54015c20 con 0x55c1520f6780 2023-09-13T09:41:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea4c09a7d0 con 0x55c1520f6780 2023-09-13T09:41:51.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea3affd700 1 -- 172.21.15.6:0/2572377665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea54015de0 con 0x55c1520f6780 2023-09-13T09:41:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea6e12fb80 10 client.16065 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c151e73e60 con 0x55c1520f6780 2023-09-13T09:41:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.554+0000 7fea3affd700 1 -- 172.21.15.6:0/2572377665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea4c09a7d0 con 0x55c1520f6780 2023-09-13T09:41:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea3affd700 1 -- 172.21.15.6:0/2572377665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fea54021530 con 0x55c1520f6780 2023-09-13T09:41:51.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea6e12fb80 10 client.16065 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea6e12fb80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea6e12fb80 20 client.16065 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c1520f70e0 0x55c152161df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea6e12fb80 4 client.16065 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:41:51.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55c1520010d0 con 0x55c1520f70e0 2023-09-13T09:41:51.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c1520f70e0 0x55c152161df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea3affd700 10 client.16065 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.555+0000 7fea5b7fe700 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c1520f70e0 0x55c152161df0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=299a4ba6fb51013f server_cookie=b70e08d9189862af in_seq=0 out_seq=0 2023-09-13T09:41:51.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea3affd700 1 -- 172.21.15.6:0/2572377665 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c1520010d0 con 0x55c1520f70e0 2023-09-13T09:41:51.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea3affd700 10 client.16065 handle_command_reply: tid=0 2023-09-13T09:41:51.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 client.16065 shutdown 2023-09-13T09:41:51.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 msgr2=0x55c152105940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c152105940 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fea54007bf0 tx=0x7fea54007f00 comp rx=0 tx=0).stop 2023-09-13T09:41:51.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 shutdown_connections 2023-09-13T09:41:51.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c1520f70e0 0x55c152161df0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1520f6780 0x55c152105940 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c152053d00 0x55c1521023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea3affd700 0 client.16065 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 --2- 172.21.15.6:0/2572377665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1520f5a80 0x55c152102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 >> 172.21.15.6:0/2572377665 conn(0x55c1520f02c0 msgr2=0x55c1520fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.557+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 shutdown_connections 2023-09-13T09:41:51.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea6e12fb80 1 -- 172.21.15.6:0/2572377665 wait complete. 2023-09-13T09:41:51.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea6e12fb80 20 client.16065 trim_cache size 0 max 16384 2023-09-13T09:41:51.586 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:41:51.586 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:41:51.586 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "57cdc15c-0af9-4ea8-9b1d-d8662d5277b6", 2023-09-13T09:41:51.587 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:41:51.587 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:41:51.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea440a0640 msgr2=0x7fea440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea440a0640 0x7fea440a2b00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fea5c19a170 tx=0x7fea50009260 comp rx=0 tx=0).stop 2023-09-13T09:41:51.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 msgr2=0x7fea5c198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c198c70 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fea4c004730 tx=0x7fea4c004760 comp rx=0 tx=0).stop 2023-09-13T09:41:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 shutdown_connections 2023-09-13T09:41:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea5c106b00 0x7fea5c1a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea440a0640 0x7fea440a2b00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea5c1018a0 0x7fea5c198c70 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 --2- 172.21.15.6:0/4025173765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea5c1041d0 0x7fea5c1991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 >> 172.21.15.6:0/4025173765 conn(0x7fea5c0fb210 msgr2=0x7fea5c102510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 shutdown_connections 2023-09-13T09:41:51.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.558+0000 7fea61f4a700 1 -- 172.21.15.6:0/4025173765 wait complete. 2023-09-13T09:41:51.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:41:51.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 -- 172.21.15.6:0/975671757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0106aa0 msgr2=0x7f49a0108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 --2- 172.21.15.6:0/975671757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0106aa0 0x7f49a0108f10 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f499800b0a0 tx=0x7f499800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 -- 172.21.15.6:0/975671757 shutdown_connections 2023-09-13T09:41:51.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 --2- 172.21.15.6:0/975671757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0106aa0 0x7f49a0108f10 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 --2- 172.21.15.6:0/975671757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0101840 0x7f49a0103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 --2- 172.21.15.6:0/975671757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a0104170 0x7f49a0106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 -- 172.21.15.6:0/975671757 >> 172.21.15.6:0/975671757 conn(0x7f49a00fb250 msgr2=0x7f49a00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 -- 172.21.15.6:0/975671757 shutdown_connections 2023-09-13T09:41:51.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.724+0000 7f49a48bf700 1 -- 172.21.15.6:0/975671757 wait complete. 2023-09-13T09:41:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 Processor -- start 2023-09-13T09:41:51.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 -- start start 2023-09-13T09:41:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0101840 0x7f49a01011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0104170 0x7f49a00ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a0106aa0 0x7f49a00ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a01004d0 con 0x7f49a0101840 2023-09-13T09:41:51.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a0100640 con 0x7f49a0104170 2023-09-13T09:41:51.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f49a48bf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a01a0be0 con 0x7f49a0106aa0 2023-09-13T09:41:51.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0101840 0x7f49a01011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0104170 0x7f49a00ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0101840 0x7f49a01011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35408/0 (socket says 172.21.15.6:35408) 2023-09-13T09:41:51.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a0106aa0 0x7f49a00ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0104170 0x7f49a00ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57166/0 (socket says 172.21.15.6:57166) 2023-09-13T09:41:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 -- 172.21.15.6:0/1034464299 learned_addr learned my addr 172.21.15.6:0/1034464299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 -- 172.21.15.6:0/1034464299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a0106aa0 msgr2=0x7f49a00ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a0106aa0 0x7f49a00ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 -- 172.21.15.6:0/1034464299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0104170 msgr2=0x7f49a00ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0104170 0x7f49a00ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499e59c700 1 -- 172.21.15.6:0/1034464299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4990009520 con 0x7f49a0101840 2023-09-13T09:41:51.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499ed9d700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a0106aa0 0x7f49a00ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:51.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.725+0000 7f499dd9b700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0104170 0x7f49a00ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:51.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.726+0000 7f499e59c700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0101840 0x7f49a01011b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f499000eb30 tx=0x7f499000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.726+0000 7f498f7fe700 1 -- 172.21.15.6:0/1034464299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990009880 con 0x7f49a0101840 2023-09-13T09:41:51.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.726+0000 7f498f7fe700 1 -- 172.21.15.6:0/1034464299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49900044e0 con 0x7f49a0101840 2023-09-13T09:41:51.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.726+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4998009d00 con 0x7f49a0101840 2023-09-13T09:41:51.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.726+0000 7f498f7fe700 1 -- 172.21.15.6:0/1034464299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4990003d80 con 0x7f49a0101840 2023-09-13T09:41:51.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.726+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a01a11c0 con 0x7f49a0101840 2023-09-13T09:41:51.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.728+0000 7f498f7fe700 1 -- 172.21.15.6:0/1034464299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4990003f20 con 0x7f49a0101840 2023-09-13T09:41:51.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.729+0000 7f498f7fe700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49880a0640 0x7f49880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.729+0000 7f499dd9b700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49880a0640 0x7f49880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.729+0000 7f498f7fe700 1 -- 172.21.15.6:0/1034464299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4990014070 con 0x7f49a0101840 2023-09-13T09:41:51.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.729+0000 7f499dd9b700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49880a0640 0x7f49880a2b00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4994005950 tx=0x7f499400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.729+0000 7f49b0aa4b80 1 Processor -- start 2023-09-13T09:41:51.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f49b0aa4b80 1 -- start start 2023-09-13T09:41:51.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488103700 0x55b488103b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b4881024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488102a00 0x55b488102e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48805b780 con 0x55b488102a00 2023-09-13T09:41:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4880590a0 con 0x55b488103700 2023-09-13T09:41:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b488054990 con 0x55b488104060 2023-09-13T09:41:51.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488102a00 0x55b488102e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488103700 0x55b488103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488102a00 0x55b488102e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35420/0 (socket says 172.21.15.6:35420) 2023-09-13T09:41:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499ed9d700 1 -- 172.21.15.6:0/1056796242 learned_addr learned my addr 172.21.15.6:0/1056796242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499dd9b700 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b4881024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499ed9d700 1 -- 172.21.15.6:0/1056796242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 msgr2=0x55b4881024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499ed9d700 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b4881024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.730+0000 7f499ed9d700 1 -- 172.21.15.6:0/1056796242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488103700 msgr2=0x55b488103b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.731+0000 7f499ed9d700 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488103700 0x55b488103b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.731+0000 7f499ed9d700 1 -- 172.21.15.6:0/1056796242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b487ed4630 con 0x55b488102a00 2023-09-13T09:41:51.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.731+0000 7f499e59c700 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488103700 0x55b488103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.731+0000 7f499ed9d700 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488102a00 0x55b488102e80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f499800b0a0 tx=0x7f4998009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2372b0106f3fbc48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.731+0000 7f498cff9700 1 -- 172.21.15.6:0/1056796242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800e040 con 0x55b488102a00 2023-09-13T09:41:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.731+0000 7f498cff9700 1 -- 172.21.15.6:0/1056796242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49980076e0 con 0x55b488102a00 2023-09-13T09:41:51.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.731+0000 7f498cff9700 1 -- 172.21.15.6:0/1056796242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998005280 con 0x55b488102a00 2023-09-13T09:41:51.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/1056796242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488102a00 msgr2=0x55b488102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488102a00 0x55b488102e80 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f499800b0a0 tx=0x7f4998009340 comp rx=0 tx=0).stop 2023-09-13T09:41:51.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/1056796242 shutdown_connections 2023-09-13T09:41:51.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488102a00 0x55b488102e80 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488103700 0x55b488103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/1056796242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b4881024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/1056796242 >> 172.21.15.6:0/1056796242 conn(0x55b488060c80 msgr2=0x55b4880fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/1056796242 shutdown_connections 2023-09-13T09:41:51.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/1056796242 wait complete. 2023-09-13T09:41:51.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- start start 2023-09-13T09:41:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 Processor -- start 2023-09-13T09:41:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b48810bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b488113420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b487ff2bb0 con 0x55b488103700 2023-09-13T09:41:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.732+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b487ff28b0 con 0x55b488102a00 2023-09-13T09:41:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b487ed6920 con 0x55b488104060 2023-09-13T09:41:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f49b0aa4b80 10 client.0 _ll_register_callbacks cb 0x55b487ff0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:51.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35424/0 (socket says 172.21.15.6:35424) 2023-09-13T09:41:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 -- 172.21.15.6:0/328315236 learned_addr learned my addr 172.21.15.6:0/328315236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499e59c700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b48810bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499ed9d700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b488113420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 -- 172.21.15.6:0/328315236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 msgr2=0x55b488113420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b488113420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 -- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 msgr2=0x55b48810bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b48810bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 -- 172.21.15.6:0/328315236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a0109b00 con 0x55b488103700 2023-09-13T09:41:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499e59c700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b48810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f499dd9b700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810c3e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4994011a00 tx=0x7f49940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52af920cbe7e3a2c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.733+0000 7f4985ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f4985ffb700 1 -- 172.21.15.6:0/328315236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499401f840 con 0x55b488103700 2023-09-13T09:41:51.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f4985ffb700 1 -- 172.21.15.6:0/328315236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4994017070 con 0x55b488103700 2023-09-13T09:41:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b4880f5670 con 0x55b488103700 2023-09-13T09:41:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f4985ffb700 1 -- 172.21.15.6:0/328315236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f499401f9a0 con 0x55b488103700 2023-09-13T09:41:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 10 client.16077 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:51.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b48806c7a0 con 0x55b488103700 2023-09-13T09:41:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f4985ffb700 1 -- 172.21.15.6:0/328315236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b4880f5670 con 0x55b488103700 2023-09-13T09:41:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f4985ffb700 1 -- 172.21.15.6:0/328315236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4994028b90 con 0x55b488103700 2023-09-13T09:41:51.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 10 client.16077 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 20 client.16077 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488117d50 0x55b48811a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 4 client.16077 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:41:51.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.734+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b48804d970 con 0x55b488117d50 2023-09-13T09:41:51.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.735+0000 7f499e59c700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488117d50 0x55b48811a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.735+0000 7f4985ffb700 10 client.16077 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.735+0000 7f499e59c700 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488117d50 0x55b48811a170 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd18cbbef9710514 server_cookie=5926333ad1436219 in_seq=0 out_seq=0 2023-09-13T09:41:51.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f4985ffb700 1 -- 172.21.15.6:0/328315236 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b48804d970 con 0x55b488117d50 2023-09-13T09:41:51.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f4985ffb700 10 client.16077 handle_command_reply: tid=0 2023-09-13T09:41:51.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 client.16077 shutdown 2023-09-13T09:41:51.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 msgr2=0x55b48810c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810c3e0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f4994011a00 tx=0x7f49940047c0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 shutdown_connections 2023-09-13T09:41:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488104060 0x55b488113420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b48810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488117d50 0x55b48811a170 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/328315236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810c3e0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f4985ffb700 0 client.16077 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 >> 172.21.15.6:0/328315236 conn(0x55b488060c80 msgr2=0x55b4880fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 shutdown_connections 2023-09-13T09:41:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/328315236 wait complete. 2023-09-13T09:41:51.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.736+0000 7f49b0aa4b80 20 client.16077 trim_cache size 0 max 16384 2023-09-13T09:41:51.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 Processor -- start 2023-09-13T09:41:51.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 -- start start 2023-09-13T09:41:51.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488060c80 0x55b4881024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488102a00 0x55b4881133e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810bc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48810ba10 con 0x55b488103700 2023-09-13T09:41:51.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b4880fd990 con 0x55b488060c80 2023-09-13T09:41:51.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.754+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b488115090 con 0x55b488102a00 2023-09-13T09:41:51.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35434/0 (socket says 172.21.15.6:35434) 2023-09-13T09:41:51.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 -- 172.21.15.6:0/2616730077 learned_addr learned my addr 172.21.15.6:0/2616730077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499e59c700 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488060c80 0x55b4881024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499dd9b700 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488102a00 0x55b4881133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 -- 172.21.15.6:0/2616730077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488102a00 msgr2=0x55b4881133e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488102a00 0x55b4881133e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 -- 172.21.15.6:0/2616730077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488060c80 msgr2=0x55b4881024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488060c80 0x55b4881024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 -- 172.21.15.6:0/2616730077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b487e80de0 con 0x55b488103700 2023-09-13T09:41:51.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499e59c700 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488060c80 0x55b4881024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:41:51.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f499ed9d700 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810bc50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4998000f80 tx=0x7f49980099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38e9a8f00501fa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f498d7fa700 1 -- 172.21.15.6:0/2616730077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800e040 con 0x55b488103700 2023-09-13T09:41:51.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f498d7fa700 1 -- 172.21.15.6:0/2616730077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4998007850 con 0x55b488103700 2023-09-13T09:41:51.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.755+0000 7f498d7fa700 1 -- 172.21.15.6:0/2616730077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4998004430 con 0x55b488103700 2023-09-13T09:41:51.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2616730077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 msgr2=0x55b48810bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810bc50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f4998000f80 tx=0x7f49980099e0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2616730077 shutdown_connections 2023-09-13T09:41:51.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810bc50 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488060c80 0x55b4881024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2616730077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488102a00 0x55b4881133e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2616730077 >> 172.21.15.6:0/2616730077 conn(0x55b4880fd240 msgr2=0x55b488113d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2616730077 shutdown_connections 2023-09-13T09:41:51.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2616730077 wait complete. 2023-09-13T09:41:51.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.756+0000 7f49b0aa4b80 1 -- start start 2023-09-13T09:41:51.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 1 Processor -- start 2023-09-13T09:41:51.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488060c80 0x55b488112dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b488113310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b48810ff50 con 0x55b488103700 2023-09-13T09:41:51.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b488110090 con 0x55b488102a00 2023-09-13T09:41:51.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b488110250 con 0x55b488060c80 2023-09-13T09:41:51.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f49b0aa4b80 10 client.0 _ll_register_callbacks cb 0x55b487ff0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:41:51.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b488113310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35440/0 (socket says 172.21.15.6:35440) 2023-09-13T09:41:51.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488060c80 0x55b488112dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 -- 172.21.15.6:0/2948421798 learned_addr learned my addr 172.21.15.6:0/2948421798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:41:51.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b488113310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57194/0 (socket says 172.21.15.6:57194) 2023-09-13T09:41:51.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 -- 172.21.15.6:0/2948421798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488060c80 msgr2=0x55b488112dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488060c80 0x55b488112dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 -- 172.21.15.6:0/2948421798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 msgr2=0x55b488113310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:41:51.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b488113310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 -- 172.21.15.6:0/2948421798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4998009d00 con 0x55b488103700 2023-09-13T09:41:51.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f499ed9d700 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810f870 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f49980079c0 tx=0x7f499800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fddaef306eb82 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:41:51.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.757+0000 7f4985ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:41:51.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f4985ffb700 1 -- 172.21.15.6:0/2948421798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f499800e040 con 0x55b488103700 2023-09-13T09:41:51.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f49980076e0 con 0x55b488103700 2023-09-13T09:41:51.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f4985ffb700 1 -- 172.21.15.6:0/2948421798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4998005420 con 0x55b488103700 2023-09-13T09:41:51.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f4985ffb700 1 -- 172.21.15.6:0/2948421798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49980055e0 con 0x55b488103700 2023-09-13T09:41:51.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 10 client.16083 fetch_fsmap learned FSMap version 30 2023-09-13T09:41:51.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55b487ed4630 con 0x55b488103700 2023-09-13T09:41:51.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f4985ffb700 1 -- 172.21.15.6:0/2948421798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f49980076e0 con 0x55b488103700 2023-09-13T09:41:51.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f4985ffb700 1 -- 172.21.15.6:0/2948421798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4998042020 con 0x55b488103700 2023-09-13T09:41:51.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 10 client.16083 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:41:51.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:41:51.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 20 client.16083 populate_metadata read hostname 'smithi006' 2023-09-13T09:41:51.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488104060 0x55b48816edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:41:51.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 4 client.16083 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:41:51.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b48800e050 con 0x55b488104060 2023-09-13T09:41:51.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.758+0000 7f499e59c700 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488104060 0x55b48816edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:41:51.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f4985ffb700 10 client.16083 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f499e59c700 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488104060 0x55b48816edf0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=944a201ccbde417 server_cookie=3fc5fe2140475ee6 in_seq=0 out_seq=0 2023-09-13T09:41:51.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f4985ffb700 1 -- 172.21.15.6:0/2948421798 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b48800e050 con 0x55b488104060 2023-09-13T09:41:51.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f4985ffb700 10 client.16083 handle_command_reply: tid=0 2023-09-13T09:41:51.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 client.16083 shutdown 2023-09-13T09:41:51.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 msgr2=0x55b48810f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810f870 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f49980079c0 tx=0x7f499800bab0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 shutdown_connections 2023-09-13T09:41:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b488104060 0x55b48816edf0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b488103700 0x55b48810f870 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f4985ffb700 0 client.16083 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:41:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b488060c80 0x55b488112dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 --2- 172.21.15.6:0/2948421798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b488102a00 0x55b488113310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 >> 172.21.15.6:0/2948421798 conn(0x55b4880fd240 msgr2=0x55b48810bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 shutdown_connections 2023-09-13T09:41:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 1 -- 172.21.15.6:0/2948421798 wait complete. 2023-09-13T09:41:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.759+0000 7f49b0aa4b80 20 client.16083 trim_cache size 0 max 16384 2023-09-13T09:41:51.798 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:41:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:41:51.798 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:41:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "57cdc15c-0af9-4ea8-9b1d-d8662d5277b6": { 2023-09-13T09:41:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:41:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "57cdc15c-0af9-4ea8-9b1d-d8662d5277b6", 2023-09-13T09:41:51.799 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:41:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:41:51.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:41:51.801 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:41:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49880a0640 msgr2=0x7f49880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49880a0640 0x7f49880a2b00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4994005950 tx=0x7f499400b410 comp rx=0 tx=0).stop 2023-09-13T09:41:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0101840 msgr2=0x7f49a01011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:41:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0101840 0x7f49a01011b0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f499000eb30 tx=0x7f499000ee40 comp rx=0 tx=0).stop 2023-09-13T09:41:51.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 shutdown_connections 2023-09-13T09:41:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a0106aa0 0x7f49a00ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49880a0640 0x7f49880a2b00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49a0101840 0x7f49a01011b0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 --2- 172.21.15.6:0/1034464299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f49a0104170 0x7f49a00ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:41:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 >> 172.21.15.6:0/1034464299 conn(0x7f49a00fb250 msgr2=0x7f49a01024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:41:51.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 shutdown_connections 2023-09-13T09:41:51.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:41:51.760+0000 7f49a48bf700 1 -- 172.21.15.6:0/1034464299 wait complete. 2023-09-13T09:41:51.808 INFO:tasks.cephfs.filesystem:scrub status for tag:57cdc15c-0af9-4ea8-9b1d-d8662d5277b6 - {'path': '/', 'tag': '57cdc15c-0af9-4ea8-9b1d-d8662d5277b6', 'options': 'recursive,force'} 2023-09-13T09:41:52.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 71403 5.60 MB/sec warmup 72 sec latency 3090.118 ms 2023-09-13T09:41:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:51 smithi053 ceph-mon[102373]: pgmap v370: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 315 KiB/s wr, 60 op/s 2023-09-13T09:41:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:51 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:51 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:52.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:51 smithi006 ceph-mon[98665]: pgmap v370: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 315 KiB/s wr, 60 op/s 2023-09-13T09:41:52.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:51 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:52.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:51 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:51 smithi131 ceph-mon[102785]: pgmap v370: 97 pgs: 97 active+clean; 44 MiB data, 558 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 315 KiB/s wr, 60 op/s 2023-09-13T09:41:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:51 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:51 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 73494 5.63 MB/sec warmup 73 sec latency 12.692 ms 2023-09-13T09:41:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:41:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:53.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:41:53.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:52 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:41:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:53.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:53.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:53.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:41:53.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:52 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:41:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:53.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:41:53.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:53.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:52 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:41:54.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74658 5.69 MB/sec warmup 74 sec latency 485.567 ms 2023-09-13T09:41:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:53 smithi006 ceph-mon[98665]: pgmap v371: 97 pgs: 97 active+clean; 45 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 399 KiB/s wr, 80 op/s 2023-09-13T09:41:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:53 smithi053 ceph-mon[102373]: pgmap v371: 97 pgs: 97 active+clean; 45 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 399 KiB/s wr, 80 op/s 2023-09-13T09:41:54.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:53 smithi131 ceph-mon[102785]: pgmap v371: 97 pgs: 97 active+clean; 45 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 399 KiB/s wr, 80 op/s 2023-09-13T09:41:55.149 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74658 5.62 MB/sec warmup 75 sec latency 1485.665 ms 2023-09-13T09:41:56.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74658 5.54 MB/sec warmup 76 sec latency 2485.762 ms 2023-09-13T09:41:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:55 smithi006 ceph-mon[98665]: pgmap v372: 97 pgs: 97 active+clean; 45 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 325 KiB/s wr, 55 op/s 2023-09-13T09:41:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:55 smithi053 ceph-mon[102373]: pgmap v372: 97 pgs: 97 active+clean; 45 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 325 KiB/s wr, 55 op/s 2023-09-13T09:41:56.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:55 smithi131 ceph-mon[102785]: pgmap v372: 97 pgs: 97 active+clean; 45 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 245 KiB/s rd, 325 KiB/s wr, 55 op/s 2023-09-13T09:41:57.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74658 5.47 MB/sec warmup 77 sec latency 3485.910 ms 2023-09-13T09:41:58.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74680 5.40 MB/sec warmup 78 sec latency 4228.997 ms 2023-09-13T09:41:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:57 smithi006 ceph-mon[98665]: pgmap v373: 97 pgs: 97 active+clean; 46 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 414 KiB/s wr, 82 op/s 2023-09-13T09:41:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:57 smithi053 ceph-mon[102373]: pgmap v373: 97 pgs: 97 active+clean; 46 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 414 KiB/s wr, 82 op/s 2023-09-13T09:41:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:57 smithi131 ceph-mon[102785]: pgmap v373: 97 pgs: 97 active+clean; 46 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 414 KiB/s wr, 82 op/s 2023-09-13T09:41:59.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74680 5.33 MB/sec warmup 79 sec latency 1237.674 ms 2023-09-13T09:42:00.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74680 5.27 MB/sec warmup 80 sec latency 2237.779 ms 2023-09-13T09:42:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:41:59 smithi006 ceph-mon[98665]: pgmap v374: 97 pgs: 97 active+clean; 46 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 413 KiB/s wr, 81 op/s 2023-09-13T09:42:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:41:59 smithi053 ceph-mon[102373]: pgmap v374: 97 pgs: 97 active+clean; 46 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 413 KiB/s wr, 81 op/s 2023-09-13T09:42:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:41:59 smithi131 ceph-mon[102785]: pgmap v374: 97 pgs: 97 active+clean; 46 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 413 KiB/s wr, 81 op/s 2023-09-13T09:42:01.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74680 5.20 MB/sec warmup 81 sec latency 3237.901 ms 2023-09-13T09:42:02.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74680 5.14 MB/sec warmup 82 sec latency 4238.029 ms 2023-09-13T09:42:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:01 smithi006 ceph-mon[98665]: pgmap v375: 97 pgs: 97 active+clean; 47 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 458 KiB/s wr, 82 op/s 2023-09-13T09:42:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:01 smithi053 ceph-mon[102373]: pgmap v375: 97 pgs: 97 active+clean; 47 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 458 KiB/s wr, 82 op/s 2023-09-13T09:42:02.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:01 smithi131 ceph-mon[102785]: pgmap v375: 97 pgs: 97 active+clean; 47 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 458 KiB/s wr, 82 op/s 2023-09-13T09:42:03.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 74862 5.09 MB/sec warmup 83 sec latency 4975.665 ms 2023-09-13T09:42:04.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75210 5.03 MB/sec warmup 84 sec latency 574.201 ms 2023-09-13T09:42:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:03 smithi006 ceph-mon[98665]: pgmap v376: 97 pgs: 97 active+clean; 47 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 367 KiB/s wr, 85 op/s 2023-09-13T09:42:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:03 smithi053 ceph-mon[102373]: pgmap v376: 97 pgs: 97 active+clean; 47 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 367 KiB/s wr, 85 op/s 2023-09-13T09:42:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:03 smithi131 ceph-mon[102785]: pgmap v376: 97 pgs: 97 active+clean; 47 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 367 KiB/s wr, 85 op/s 2023-09-13T09:42:05.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75210 4.97 MB/sec warmup 85 sec latency 1574.258 ms 2023-09-13T09:42:05.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:05.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:05.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:05.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:05.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:05.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:05.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:05.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:05.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:05.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:05.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:06.150 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75210 4.91 MB/sec warmup 86 sec latency 2574.318 ms 2023-09-13T09:42:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:05 smithi053 ceph-mon[102373]: pgmap v377: 97 pgs: 97 active+clean; 47 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 299 KiB/s wr, 65 op/s 2023-09-13T09:42:06.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:05 smithi006 ceph-mon[98665]: pgmap v377: 97 pgs: 97 active+clean; 47 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 299 KiB/s wr, 65 op/s 2023-09-13T09:42:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:05 smithi131 ceph-mon[102785]: pgmap v377: 97 pgs: 97 active+clean; 47 MiB data, 573 MiB used, 1.0 TiB / 1.0 TiB avail; 205 KiB/s rd, 299 KiB/s wr, 65 op/s 2023-09-13T09:42:07.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75227 4.86 MB/sec warmup 87 sec latency 3561.194 ms 2023-09-13T09:42:08.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75266 4.80 MB/sec warmup 88 sec latency 969.652 ms 2023-09-13T09:42:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:07 smithi053 ceph-mon[102373]: pgmap v378: 97 pgs: 97 active+clean; 47 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 310 KiB/s wr, 67 op/s 2023-09-13T09:42:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:07 smithi006 ceph-mon[98665]: pgmap v378: 97 pgs: 97 active+clean; 47 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 310 KiB/s wr, 67 op/s 2023-09-13T09:42:08.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:07 smithi131 ceph-mon[102785]: pgmap v378: 97 pgs: 97 active+clean; 47 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 310 KiB/s wr, 67 op/s 2023-09-13T09:42:09.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75266 4.75 MB/sec warmup 89 sec latency 1969.754 ms 2023-09-13T09:42:10.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75266 4.70 MB/sec warmup 90 sec latency 2969.871 ms 2023-09-13T09:42:10.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:09 smithi006 ceph-mon[98665]: pgmap v379: 97 pgs: 97 active+clean; 47 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 316 KiB/s wr, 43 op/s 2023-09-13T09:42:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:09 smithi053 ceph-mon[102373]: pgmap v379: 97 pgs: 97 active+clean; 47 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 316 KiB/s wr, 43 op/s 2023-09-13T09:42:10.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:09 smithi131 ceph-mon[102785]: pgmap v379: 97 pgs: 97 active+clean; 47 MiB data, 576 MiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 316 KiB/s wr, 43 op/s 2023-09-13T09:42:11.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75266 4.65 MB/sec warmup 91 sec latency 3969.958 ms 2023-09-13T09:42:12.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 75276 4.60 MB/sec warmup 92 sec latency 4960.706 ms 2023-09-13T09:42:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:11 smithi006 ceph-mon[98665]: pgmap v380: 97 pgs: 97 active+clean; 47 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 316 KiB/s wr, 38 op/s 2023-09-13T09:42:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:11 smithi053 ceph-mon[102373]: pgmap v380: 97 pgs: 97 active+clean; 47 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 316 KiB/s wr, 38 op/s 2023-09-13T09:42:12.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:11 smithi131 ceph-mon[102785]: pgmap v380: 97 pgs: 97 active+clean; 47 MiB data, 575 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 316 KiB/s wr, 38 op/s 2023-09-13T09:42:13.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 77711 4.69 MB/sec warmup 93 sec latency 11.577 ms 2023-09-13T09:42:14.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 78753 4.70 MB/sec warmup 94 sec latency 13.882 ms 2023-09-13T09:42:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:13 smithi006 ceph-mon[98665]: pgmap v381: 97 pgs: 97 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 443 KiB/s wr, 46 op/s 2023-09-13T09:42:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:13 smithi053 ceph-mon[102373]: pgmap v381: 97 pgs: 97 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 443 KiB/s wr, 46 op/s 2023-09-13T09:42:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:13 smithi131 ceph-mon[102785]: pgmap v381: 97 pgs: 97 active+clean; 48 MiB data, 580 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 443 KiB/s wr, 46 op/s 2023-09-13T09:42:15.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 81076 4.78 MB/sec warmup 95 sec latency 11.917 ms 2023-09-13T09:42:16.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 82140 4.80 MB/sec warmup 96 sec latency 14.969 ms 2023-09-13T09:42:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:15 smithi006 ceph-mon[98665]: pgmap v382: 97 pgs: 97 active+clean; 49 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 516 KiB/s wr, 52 op/s 2023-09-13T09:42:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:15 smithi053 ceph-mon[102373]: pgmap v382: 97 pgs: 97 active+clean; 49 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 516 KiB/s wr, 52 op/s 2023-09-13T09:42:16.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:15 smithi131 ceph-mon[102785]: pgmap v382: 97 pgs: 97 active+clean; 49 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 516 KiB/s wr, 52 op/s 2023-09-13T09:42:17.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 82445 4.76 MB/sec warmup 97 sec latency 765.362 ms 2023-09-13T09:42:18.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 84802 4.84 MB/sec warmup 98 sec latency 11.978 ms 2023-09-13T09:42:18.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:17 smithi006 ceph-mon[98665]: pgmap v383: 97 pgs: 97 active+clean; 48 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 629 KiB/s wr, 76 op/s 2023-09-13T09:42:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:17 smithi053 ceph-mon[102373]: pgmap v383: 97 pgs: 97 active+clean; 48 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 629 KiB/s wr, 76 op/s 2023-09-13T09:42:18.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:17 smithi131 ceph-mon[102785]: pgmap v383: 97 pgs: 97 active+clean; 48 MiB data, 582 MiB used, 1.0 TiB / 1.0 TiB avail; 272 KiB/s rd, 629 KiB/s wr, 76 op/s 2023-09-13T09:42:19.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 85732 4.85 MB/sec warmup 99 sec latency 61.763 ms 2023-09-13T09:42:20.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 85843 4.80 MB/sec warmup 100 sec latency 896.452 ms 2023-09-13T09:42:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:19 smithi006 ceph-mon[98665]: pgmap v384: 97 pgs: 97 active+clean; 49 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 688 KiB/s wr, 98 op/s 2023-09-13T09:42:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:19 smithi053 ceph-mon[102373]: pgmap v384: 97 pgs: 97 active+clean; 49 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 688 KiB/s wr, 98 op/s 2023-09-13T09:42:20.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:19 smithi131 ceph-mon[102785]: pgmap v384: 97 pgs: 97 active+clean; 49 MiB data, 587 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 688 KiB/s wr, 98 op/s 2023-09-13T09:42:21.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 85843 4.75 MB/sec warmup 101 sec latency 1896.485 ms 2023-09-13T09:42:21.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:20 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:42:21.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:20 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:42:21.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:20 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:42:21.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:42:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 -- 172.21.15.6:0/1708410205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c101850 msgr2=0x7fd24c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 --2- 172.21.15.6:0/1708410205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c101850 0x7fd24c108100 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fd24400b0d0 tx=0x7fd24400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 -- 172.21.15.6:0/1708410205 shutdown_connections 2023-09-13T09:42:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 --2- 172.21.15.6:0/1708410205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c101850 0x7fd24c108100 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 --2- 172.21.15.6:0/1708410205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0ffcc0 0x7fd24c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 --2- 172.21.15.6:0/1708410205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24c100eb0 0x7fd24c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 -- 172.21.15.6:0/1708410205 >> 172.21.15.6:0/1708410205 conn(0x7fd24c0fb250 msgr2=0x7fd24c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 -- 172.21.15.6:0/1708410205 shutdown_connections 2023-09-13T09:42:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.938+0000 7fd252ed4700 1 -- 172.21.15.6:0/1708410205 wait complete. 2023-09-13T09:42:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 Processor -- start 2023-09-13T09:42:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 -- start start 2023-09-13T09:42:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0ffcc0 0x7fd24c196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c100eb0 0x7fd24c1970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24c101850 0x7fd24c19e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c19e6e0 con 0x7fd24c100eb0 2023-09-13T09:42:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c19e820 con 0x7fd24c101850 2023-09-13T09:42:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd252ed4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd24c19e9b0 con 0x7fd24c0ffcc0 2023-09-13T09:42:21.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c100eb0 0x7fd24c1970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c100eb0 0x7fd24c1970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35452/0 (socket says 172.21.15.6:35452) 2023-09-13T09:42:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 -- 172.21.15.6:0/2268232223 learned_addr learned my addr 172.21.15.6:0/2268232223 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd250c70700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0ffcc0 0x7fd24c196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd251471700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24c101850 0x7fd24c19e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 -- 172.21.15.6:0/2268232223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0ffcc0 msgr2=0x7fd24c196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0ffcc0 0x7fd24c196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 -- 172.21.15.6:0/2268232223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24c101850 msgr2=0x7fd24c19e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24c101850 0x7fd24c19e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 -- 172.21.15.6:0/2268232223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd244009d00 con 0x7fd24c100eb0 2023-09-13T09:42:21.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c100eb0 0x7fd24c1970a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd23800e9a0 tx=0x7fd23800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.939+0000 7fd249ffb700 1 -- 172.21.15.6:0/2268232223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238009790 con 0x7fd24c100eb0 2023-09-13T09:42:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.940+0000 7fd249ffb700 1 -- 172.21.15.6:0/2268232223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd238010430 con 0x7fd24c100eb0 2023-09-13T09:42:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.940+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd24c19ec90 con 0x7fd24c100eb0 2023-09-13T09:42:21.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.940+0000 7fd249ffb700 1 -- 172.21.15.6:0/2268232223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238018680 con 0x7fd24c100eb0 2023-09-13T09:42:21.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.940+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c19f1a0 con 0x7fd24c100eb0 2023-09-13T09:42:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.942+0000 7fd249ffb700 1 -- 172.21.15.6:0/2268232223 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd2380105a0 con 0x7fd24c100eb0 2023-09-13T09:42:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.943+0000 7fd249ffb700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd23c0a0640 0x7fd23c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.943+0000 7fd249ffb700 1 -- 172.21.15.6:0/2268232223 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd238014070 con 0x7fd24c100eb0 2023-09-13T09:42:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.943+0000 7fd250c70700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd23c0a0640 0x7fd23c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.943+0000 7fd250c70700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd23c0a0640 0x7fd23c0a2b00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd24c100d10 tx=0x7fd240009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.943+0000 7fd25f0b9b80 1 Processor -- start 2023-09-13T09:42:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd25f0b9b80 1 -- start start 2023-09-13T09:42:21.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c4a00 0x55c7e65c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e651d780 con 0x55c7e65c4a00 2023-09-13T09:42:21.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e651b0a0 con 0x55c7e65c6060 2023-09-13T09:42:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e6516990 con 0x55c7e65c5700 2023-09-13T09:42:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c4a00 0x55c7e65c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c4a00 0x55c7e65c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35462/0 (socket says 172.21.15.6:35462) 2023-09-13T09:42:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 -- 172.21.15.6:0/2950557731 learned_addr learned my addr 172.21.15.6:0/2950557731 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd250c70700 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 -- 172.21.15.6:0/2950557731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 msgr2=0x55c7e65c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 -- 172.21.15.6:0/2950557731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 msgr2=0x55c7e65c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 -- 172.21.15.6:0/2950557731 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e6396630 con 0x55c7e65c4a00 2023-09-13T09:42:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd24bfff700 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.944+0000 7fd251471700 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c4a00 0x55c7e65c4e80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd244009c60 tx=0x7fd244009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7192c4126ec3e197 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd236ffd700 1 -- 172.21.15.6:0/2950557731 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24400e040 con 0x55c7e65c4a00 2023-09-13T09:42:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd236ffd700 1 -- 172.21.15.6:0/2950557731 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd24400baa0 con 0x55c7e65c4a00 2023-09-13T09:42:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd236ffd700 1 -- 172.21.15.6:0/2950557731 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd244005070 con 0x55c7e65c4a00 2023-09-13T09:42:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/2950557731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c4a00 msgr2=0x55c7e65c4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c4a00 0x55c7e65c4e80 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd244009c60 tx=0x7fd244009c90 comp rx=0 tx=0).stop 2023-09-13T09:42:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/2950557731 shutdown_connections 2023-09-13T09:42:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c4a00 0x55c7e65c4e80 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/2950557731 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/2950557731 >> 172.21.15.6:0/2950557731 conn(0x55c7e6522c80 msgr2=0x55c7e65bef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/2950557731 shutdown_connections 2023-09-13T09:42:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.945+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/2950557731 wait complete. 2023-09-13T09:42:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 -- start start 2023-09-13T09:42:21.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 Processor -- start 2023-09-13T09:42:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c4a00 0x55c7e65d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65d2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e64b4bb0 con 0x55c7e65c6060 2023-09-13T09:42:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e64b48b0 con 0x55c7e65c4a00 2023-09-13T09:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e6398920 con 0x55c7e65c5700 2023-09-13T09:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd25f0b9b80 10 client.0 _ll_register_callbacks cb 0x55c7e64b2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd251471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd251471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35468/0 (socket says 172.21.15.6:35468) 2023-09-13T09:42:21.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd251471700 1 -- 172.21.15.6:0/3121730944 learned_addr learned my addr 172.21.15.6:0/3121730944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd24bfff700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.946+0000 7fd250c70700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c4a00 0x55c7e65d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd251471700 1 -- 172.21.15.6:0/3121730944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 msgr2=0x55c7e65d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd251471700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd251471700 1 -- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c4a00 msgr2=0x55c7e65d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd251471700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c4a00 0x55c7e65d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd251471700 1 -- 172.21.15.6:0/3121730944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c108a50 con 0x55c7e65c6060 2023-09-13T09:42:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd24bfff700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd251471700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d97d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd244007a30 tx=0x7fd244007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a661f026364a18c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:21.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd22bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd22bfff700 1 -- 172.21.15.6:0/3121730944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24400e040 con 0x55c7e65c6060 2023-09-13T09:42:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd22bfff700 1 -- 172.21.15.6:0/3121730944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd2440052d0 con 0x55c7e65c6060 2023-09-13T09:42:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7e65b7670 con 0x55c7e65c6060 2023-09-13T09:42:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd22bfff700 1 -- 172.21.15.6:0/3121730944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd244005490 con 0x55c7e65c6060 2023-09-13T09:42:21.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd25f0b9b80 10 client.16095 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c7e652e7a0 con 0x55c7e65c6060 2023-09-13T09:42:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd22bfff700 1 -- 172.21.15.6:0/3121730944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c7e65b7670 con 0x55c7e65c6060 2023-09-13T09:42:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd22bfff700 1 -- 172.21.15.6:0/3121730944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd24400b100 con 0x55c7e65c6060 2023-09-13T09:42:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd25f0b9b80 10 client.16095 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.947+0000 7fd25f0b9b80 10 client.16095 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.948+0000 7fd25f0b9b80 20 client.16095 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.948+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e65ddca0 0x55c7e65e00c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.948+0000 7fd25f0b9b80 4 client.16095 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.948+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7e650f970 con 0x55c7e65ddca0 2023-09-13T09:42:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.948+0000 7fd250c70700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e65ddca0 0x55c7e65e00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.948+0000 7fd22bfff700 10 client.16095 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.948+0000 7fd250c70700 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e65ddca0 0x55c7e65e00c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a70d6ec4a9934ad8 server_cookie=206d1b07345f0995 in_seq=0 out_seq=0 2023-09-13T09:42:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd22bfff700 1 -- 172.21.15.6:0/3121730944 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c7e650f970 con 0x55c7e65ddca0 2023-09-13T09:42:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd22bfff700 10 client.16095 handle_command_reply: tid=0 2023-09-13T09:42:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 client.16095 shutdown 2023-09-13T09:42:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 msgr2=0x55c7e65d97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d97d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd244007a30 tx=0x7fd244007800 comp rx=0 tx=0).stop 2023-09-13T09:42:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 shutdown_connections 2023-09-13T09:42:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e65ddca0 0x55c7e65e00c0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d97d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd22bfff700 0 client.16095 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c4a00 0x55c7e65d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3121730944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c5700 0x55c7e65d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 >> 172.21.15.6:0/3121730944 conn(0x55c7e6522c80 msgr2=0x55c7e65beee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 shutdown_connections 2023-09-13T09:42:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.949+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3121730944 wait complete. 2023-09-13T09:42:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.950+0000 7fd25f0b9b80 20 client.16095 trim_cache size 0 max 16384 2023-09-13T09:42:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.966+0000 7fd25f0b9b80 1 Processor -- start 2023-09-13T09:42:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.966+0000 7fd25f0b9b80 1 -- start start 2023-09-13T09:42:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c5700 0x55c7e65d9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65d2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e65cd2f0 con 0x55c7e65c5700 2023-09-13T09:42:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e65bf810 con 0x55c7e65c6060 2023-09-13T09:42:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e65d2ed0 con 0x55c7e65c4a00 2023-09-13T09:42:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c5700 0x55c7e65d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c5700 0x55c7e65d9790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35472/0 (socket says 172.21.15.6:35472) 2023-09-13T09:42:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 -- 172.21.15.6:0/3607904303 learned_addr learned my addr 172.21.15.6:0/3607904303 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd251471700 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65d2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd250c70700 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 -- 172.21.15.6:0/3607904303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 msgr2=0x55c7e65c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 -- 172.21.15.6:0/3607904303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 msgr2=0x55c7e65d2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65d2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 -- 172.21.15.6:0/3607904303 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e6342de0 con 0x55c7e65c5700 2023-09-13T09:42:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd24bfff700 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c5700 0x55c7e65d9790 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd238095a10 tx=0x7fd238095210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdce37a0041657d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd2377fe700 1 -- 172.21.15.6:0/3607904303 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23809d120 con 0x55c7e65c5700 2023-09-13T09:42:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd2377fe700 1 -- 172.21.15.6:0/3607904303 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd238099510 con 0x55c7e65c5700 2023-09-13T09:42:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.967+0000 7fd2377fe700 1 -- 172.21.15.6:0/3607904303 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238098c60 con 0x55c7e65c5700 2023-09-13T09:42:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3607904303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c5700 msgr2=0x55c7e65d9790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c5700 0x55c7e65d9790 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd238095a10 tx=0x7fd238095210 comp rx=0 tx=0).stop 2023-09-13T09:42:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3607904303 shutdown_connections 2023-09-13T09:42:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c6060 0x55c7e65d2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3607904303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c5700 0x55c7e65d9790 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3607904303 >> 172.21.15.6:0/3607904303 conn(0x55c7e6522c80 msgr2=0x55c7e65cbcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3607904303 shutdown_connections 2023-09-13T09:42:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3607904303 wait complete. 2023-09-13T09:42:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 -- start start 2023-09-13T09:42:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.968+0000 7fd25f0b9b80 1 Processor -- start 2023-09-13T09:42:21.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65d9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c5700 0x55c7e65d9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd25f0b9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e65d6760 con 0x55c7e65c6060 2023-09-13T09:42:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e65d68d0 con 0x55c7e65c5700 2023-09-13T09:42:21.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd25f0b9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e65d6a90 con 0x55c7e65c4a00 2023-09-13T09:42:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd25f0b9b80 10 client.0 _ll_register_callbacks cb 0x55c7e64b2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35482/0 (socket says 172.21.15.6:35482) 2023-09-13T09:42:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 -- 172.21.15.6:0/3878250551 learned_addr learned my addr 172.21.15.6:0/3878250551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:21.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd24bfff700 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c5700 0x55c7e65d9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd250c70700 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65d9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 -- 172.21.15.6:0/3878250551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 msgr2=0x55c7e65d9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65d9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 -- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c5700 msgr2=0x55c7e65d9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c5700 0x55c7e65d9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.969+0000 7fd251471700 1 -- 172.21.15.6:0/3878250551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd24c19f1a0 con 0x55c7e65c6060 2023-09-13T09:42:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd251471700 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d6050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd244002230 tx=0x7fd244006130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ac8146f804c4a09 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd22bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd22bfff700 1 -- 172.21.15.6:0/3878250551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24400e040 con 0x55c7e65c6060 2023-09-13T09:42:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd22bfff700 1 -- 172.21.15.6:0/3878250551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd244025450 con 0x55c7e65c6060 2023-09-13T09:42:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd24400baa0 con 0x55c7e65c6060 2023-09-13T09:42:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd22bfff700 1 -- 172.21.15.6:0/3878250551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd24400b0b0 con 0x55c7e65c6060 2023-09-13T09:42:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 10 client.16101 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c7e632bc60 con 0x55c7e65c6060 2023-09-13T09:42:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd22bfff700 1 -- 172.21.15.6:0/3878250551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd24400baa0 con 0x55c7e65c6060 2023-09-13T09:42:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd22bfff700 1 -- 172.21.15.6:0/3878250551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fd244038610 con 0x55c7e65c6060 2023-09-13T09:42:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 10 client.16101 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 10 client.16101 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 20 client.16101 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e6632de0 0x55c7e6635200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 4 client.16101 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:42:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.970+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c7e64d0050 con 0x55c7e6632de0 2023-09-13T09:42:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd250c70700 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e6632de0 0x55c7e6635200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd22bfff700 10 client.16101 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd250c70700 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e6632de0 0x55c7e6635200 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ee7d52c11449a server_cookie=b5dda5cefdeda293 in_seq=0 out_seq=0 2023-09-13T09:42:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd22bfff700 1 -- 172.21.15.6:0/3878250551 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c7e64d0050 con 0x55c7e6632de0 2023-09-13T09:42:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd22bfff700 10 client.16101 handle_command_reply: tid=0 2023-09-13T09:42:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 client.16101 shutdown 2023-09-13T09:42:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 msgr2=0x55c7e65d6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d6050 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd244002230 tx=0x7fd244006130 comp rx=0 tx=0).stop 2023-09-13T09:42:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 shutdown_connections 2023-09-13T09:42:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c7e6632de0 0x55c7e6635200 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7e65c6060 0x55c7e65d6050 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7e65c4a00 0x55c7e65d9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 --2- 172.21.15.6:0/3878250551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7e65c5700 0x55c7e65d9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd22bfff700 0 client.16101 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 >> 172.21.15.6:0/3878250551 conn(0x55c7e6522c80 msgr2=0x55c7e65d21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 shutdown_connections 2023-09-13T09:42:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.971+0000 7fd25f0b9b80 1 -- 172.21.15.6:0/3878250551 wait complete. 2023-09-13T09:42:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd25f0b9b80 20 client.16101 trim_cache size 0 max 16384 2023-09-13T09:42:21.994 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:42:21.994 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:42:21.994 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:42:21.994 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:42:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd23c0a0640 msgr2=0x7fd23c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd23c0a0640 0x7fd23c0a2b00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fd24c100d10 tx=0x7fd240009260 comp rx=0 tx=0).stop 2023-09-13T09:42:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c100eb0 msgr2=0x7fd24c1970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c100eb0 0x7fd24c1970a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fd23800e9a0 tx=0x7fd23800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 shutdown_connections 2023-09-13T09:42:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd24c101850 0x7fd24c19e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd24c0ffcc0 0x7fd24c196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd23c0a0640 0x7fd23c0a2b00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 --2- 172.21.15.6:0/2268232223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd24c100eb0 0x7fd24c1970a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 >> 172.21.15.6:0/2268232223 conn(0x7fd24c0fb250 msgr2=0x7fd24c068010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 shutdown_connections 2023-09-13T09:42:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:21.972+0000 7fd252ed4700 1 -- 172.21.15.6:0/2268232223 wait complete. 2023-09-13T09:42:21.998 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:42:21.999 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:42:22.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.123+0000 7f658e58d700 1 -- 172.21.15.6:0/3082812083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 msgr2=0x7f6588108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 --2- 172.21.15.6:0/3082812083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f6588108ee0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f658000b0a0 tx=0x7f658000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 -- 172.21.15.6:0/3082812083 shutdown_connections 2023-09-13T09:42:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 --2- 172.21.15.6:0/3082812083 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f6588108ee0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 --2- 172.21.15.6:0/3082812083 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6588101870 0x7f6588103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 --2- 172.21.15.6:0/3082812083 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65881041a0 0x7f6588106590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 -- 172.21.15.6:0/3082812083 >> 172.21.15.6:0/3082812083 conn(0x7f65880fb220 msgr2=0x7f65880fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 -- 172.21.15.6:0/3082812083 shutdown_connections 2023-09-13T09:42:22.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 -- 172.21.15.6:0/3082812083 wait complete. 2023-09-13T09:42:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.124+0000 7f658e58d700 1 Processor -- start 2023-09-13T09:42:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658e58d700 1 -- start start 2023-09-13T09:42:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658e58d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6588101870 0x7f6588196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658e58d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65881041a0 0x7f6588197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658e58d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f658819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658e58d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658819e6d0 con 0x7f6588106ad0 2023-09-13T09:42:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658e58d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658819e810 con 0x7f65881041a0 2023-09-13T09:42:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658e58d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f658819e9a0 con 0x7f6588101870 2023-09-13T09:42:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f658819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f658819e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35496/0 (socket says 172.21.15.6:35496) 2023-09-13T09:42:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 -- 172.21.15.6:0/2045949034 learned_addr learned my addr 172.21.15.6:0/2045949034 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f65877fe700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65881041a0 0x7f6588197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f6587fff700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6588101870 0x7f6588196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 -- 172.21.15.6:0/2045949034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6588101870 msgr2=0x7f6588196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6588101870 0x7f6588196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 -- 172.21.15.6:0/2045949034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65881041a0 msgr2=0x7f6588197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65881041a0 0x7f6588197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.125+0000 7f658cb2a700 1 -- 172.21.15.6:0/2045949034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6580009d00 con 0x7f6588106ad0 2023-09-13T09:42:22.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.126+0000 7f658cb2a700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f658819e100 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f658000b780 tx=0x7f658000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.126+0000 7f65857fa700 1 -- 172.21.15.6:0/2045949034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658000e040 con 0x7f6588106ad0 2023-09-13T09:42:22.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.126+0000 7f65857fa700 1 -- 172.21.15.6:0/2045949034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6580004c50 con 0x7f6588106ad0 2023-09-13T09:42:22.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.126+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f658819ec20 con 0x7f6588106ad0 2023-09-13T09:42:22.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.126+0000 7f65857fa700 1 -- 172.21.15.6:0/2045949034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6580005280 con 0x7f6588106ad0 2023-09-13T09:42:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.126+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f658819f0a0 con 0x7f6588106ad0 2023-09-13T09:42:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.127+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65880fcda0 con 0x7f6588106ad0 2023-09-13T09:42:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.128+0000 7f65857fa700 1 -- 172.21.15.6:0/2045949034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f658001d470 con 0x7f6588106ad0 2023-09-13T09:42:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.129+0000 7f65857fa700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65700a0640 0x7f65700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.129+0000 7f65857fa700 1 -- 172.21.15.6:0/2045949034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f65800cd170 con 0x7f6588106ad0 2023-09-13T09:42:22.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.129+0000 7f6587fff700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65700a0640 0x7f65700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.129+0000 7f6587fff700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65700a0640 0x7f65700a2b00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6578009c60 tx=0x7f6578009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.133+0000 7f65857fa700 1 -- 172.21.15.6:0/2045949034 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6580096c80 con 0x7f6588106ad0 2023-09-13T09:42:22.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 85858 4.71 MB/sec warmup 102 sec latency 2884.583 ms 2023-09-13T09:42:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:21 smithi006 ceph-mon[98665]: pgmap v385: 97 pgs: 97 active+clean; 50 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 743 KiB/s wr, 107 op/s 2023-09-13T09:42:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:42:22.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:42:22.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:21 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:21 smithi053 ceph-mon[102373]: pgmap v385: 97 pgs: 97 active+clean; 50 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 743 KiB/s wr, 107 op/s 2023-09-13T09:42:22.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:42:22.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:42:22.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:21 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:21 smithi131 ceph-mon[102785]: pgmap v385: 97 pgs: 97 active+clean; 50 MiB data, 588 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 743 KiB/s wr, 107 op/s 2023-09-13T09:42:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:42:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:42:22.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:21 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:42:22.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.385+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f658810c570 con 0x7f6588106ad0 2023-09-13T09:42:22.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.386+0000 7f65857fa700 1 -- 172.21.15.6:0/2045949034 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11346 (secure 0 0 0) 0x7f658009a2a0 con 0x7f6588106ad0 2023-09-13T09:42:22.387 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:42:22.388 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:41:44.012481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:42:22.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65700a0640 msgr2=0x7f65700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65700a0640 0x7f65700a2b00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f6578009c60 tx=0x7f6578009260 comp rx=0 tx=0).stop 2023-09-13T09:42:22.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 msgr2=0x7f658819e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f658819e100 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f658000b780 tx=0x7f658000bab0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 shutdown_connections 2023-09-13T09:42:22.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65700a0640 0x7f65700a2b00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6588106ad0 0x7f658819e100 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6588101870 0x7f6588196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 --2- 172.21.15.6:0/2045949034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f65881041a0 0x7f6588197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 >> 172.21.15.6:0/2045949034 conn(0x7f65880fb220 msgr2=0x7f65881024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 shutdown_connections 2023-09-13T09:42:22.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.388+0000 7f658e58d700 1 -- 172.21.15.6:0/2045949034 wait complete. 2023-09-13T09:42:22.392 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 30 2023-09-13T09:42:22.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:42:22.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 -- 172.21.15.6:0/947578919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c80ffcc0 msgr2=0x7ff5c81000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/947578919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c80ffcc0 0x7ff5c81000e0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40099c0 tx=0x7ff5c4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 -- 172.21.15.6:0/947578919 shutdown_connections 2023-09-13T09:42:22.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/947578919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c8101850 0x7ff5c8108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/947578919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c80ffcc0 0x7ff5c81000e0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/947578919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c8100eb0 0x7ff5c8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 -- 172.21.15.6:0/947578919 >> 172.21.15.6:0/947578919 conn(0x7ff5c80fb250 msgr2=0x7ff5c80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 -- 172.21.15.6:0/947578919 shutdown_connections 2023-09-13T09:42:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 -- 172.21.15.6:0/947578919 wait complete. 2023-09-13T09:42:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 Processor -- start 2023-09-13T09:42:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.529+0000 7ff5cfc16700 1 -- start start 2023-09-13T09:42:22.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cfc16700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80ffcc0 0x7ff5c8198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cfc16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c8100eb0 0x7ff5c8199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cfc16700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c8101850 0x7ff5c81a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cfc16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81a0790 con 0x7ff5c8100eb0 2023-09-13T09:42:22.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cfc16700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81a0900 con 0x7ff5c8101850 2023-09-13T09:42:22.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cfc16700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5c81a0ac0 con 0x7ff5c80ffcc0 2023-09-13T09:42:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c8100eb0 0x7ff5c8199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c8100eb0 0x7ff5c8199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35508/0 (socket says 172.21.15.6:35508) 2023-09-13T09:42:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd9b2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80ffcc0 0x7ff5c8198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3185155060 learned_addr learned my addr 172.21.15.6:0/3185155060 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c8101850 0x7ff5c81a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3185155060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80ffcc0 msgr2=0x7ff5c8198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80ffcc0 0x7ff5c8198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3185155060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c8101850 msgr2=0x7ff5c81a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c8101850 0x7ff5c81a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3185155060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c40095f0 con 0x7ff5c8100eb0 2023-09-13T09:42:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c8100eb0 0x7ff5c8199190 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800c9b0 tx=0x7ff5b800ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5beffd700 1 -- 172.21.15.6:0/3185155060 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8007b00 con 0x7ff5c8100eb0 2023-09-13T09:42:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.530+0000 7ff5beffd700 1 -- 172.21.15.6:0/3185155060 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5b800ce50 con 0x7ff5c8100eb0 2023-09-13T09:42:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.531+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5c81a0da0 con 0x7ff5c8100eb0 2023-09-13T09:42:22.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.531+0000 7ff5beffd700 1 -- 172.21.15.6:0/3185155060 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8018660 con 0x7ff5c8100eb0 2023-09-13T09:42:22.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.531+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c81a11d0 con 0x7ff5c8100eb0 2023-09-13T09:42:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.533+0000 7ff5beffd700 1 -- 172.21.15.6:0/3185155060 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff5b800f450 con 0x7ff5c8100eb0 2023-09-13T09:42:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.533+0000 7ff5beffd700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5b40a0640 0x7ff5b40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.534+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5b40a0640 0x7ff5b40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.534+0000 7ff5beffd700 1 -- 172.21.15.6:0/3185155060 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5b80cbb10 con 0x7ff5c8100eb0 2023-09-13T09:42:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.534+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5b40a0640 0x7ff5b40a2b00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009990 tx=0x7ff5c401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.534+0000 7ff5dbdfbb80 1 Processor -- start 2023-09-13T09:42:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.534+0000 7ff5dbdfbb80 1 -- start start 2023-09-13T09:42:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d183b780 con 0x5558d18e2a00 2023-09-13T09:42:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d18390a0 con 0x5558d18e4060 2023-09-13T09:42:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d1834990 con 0x5558d18e3700 2023-09-13T09:42:22.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35518/0 (socket says 172.21.15.6:35518) 2023-09-13T09:42:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/1763133488 learned_addr learned my addr 172.21.15.6:0/1763133488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/1763133488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 msgr2=0x5558d18e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/1763133488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 msgr2=0x5558d18e24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18e24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/1763133488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d16b4630 con 0x5558d18e2a00 2023-09-13T09:42:22.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e2e80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0011680 tx=0x7ff5c0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7580ab52cee0081 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5b3fff700 1 -- 172.21.15.6:0/1763133488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000e040 con 0x5558d18e2a00 2023-09-13T09:42:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5b3fff700 1 -- 172.21.15.6:0/1763133488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5c000f040 con 0x5558d18e2a00 2023-09-13T09:42:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.535+0000 7ff5b3fff700 1 -- 172.21.15.6:0/1763133488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0004860 con 0x5558d18e2a00 2023-09-13T09:42:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/1763133488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 msgr2=0x5558d18e2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e2e80 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0011680 tx=0x7ff5c0009920 comp rx=0 tx=0).stop 2023-09-13T09:42:22.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/1763133488 shutdown_connections 2023-09-13T09:42:22.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e2e80 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/1763133488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18e24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/1763133488 >> 172.21.15.6:0/1763133488 conn(0x5558d1840c80 msgr2=0x5558d18dcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/1763133488 shutdown_connections 2023-09-13T09:42:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.536+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/1763133488 wait complete. 2023-09-13T09:42:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 -- start start 2023-09-13T09:42:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 Processor -- start 2023-09-13T09:42:22.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e2a00 0x5558d18ebed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e3700 0x5558d18ec410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18f3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d17d2bb0 con 0x5558d18e3700 2023-09-13T09:42:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d17d28b0 con 0x5558d18e4060 2023-09-13T09:42:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d16b6920 con 0x5558d18e2a00 2023-09-13T09:42:22.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5dbdfbb80 10 client.0 _ll_register_callbacks cb 0x5558d17d0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5cd1b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e3700 0x5558d18ec410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5cd1b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e3700 0x5558d18ec410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35522/0 (socket says 172.21.15.6:35522) 2023-09-13T09:42:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3735463670 learned_addr learned my addr 172.21.15.6:0/3735463670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e2a00 0x5558d18ebed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.537+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3735463670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e2a00 msgr2=0x5558d18ebed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e2a00 0x5558d18ebed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 msgr2=0x5558d18f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5cd1b1700 1 -- 172.21.15.6:0/3735463670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c0011330 con 0x5558d18e3700 2023-09-13T09:42:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e3700 0x5558d18ec410 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80957b0 tx=0x7ff5b8098ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=634eb572fb9bfa5a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5b17fa700 1 -- 172.21.15.6:0/3735463670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5b8099710 con 0x5558d18e3700 2023-09-13T09:42:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5b17fa700 1 -- 172.21.15.6:0/3735463670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5b8007c60 con 0x5558d18e3700 2023-09-13T09:42:22.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5558d18d5670 con 0x5558d18e3700 2023-09-13T09:42:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5b17fa700 1 -- 172.21.15.6:0/3735463670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5b80992b0 con 0x5558d18e3700 2023-09-13T09:42:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 10 client.16119 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5558d184c7a0 con 0x5558d18e3700 2023-09-13T09:42:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5b17fa700 1 -- 172.21.15.6:0/3735463670 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5558d18d5670 con 0x5558d18e3700 2023-09-13T09:42:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5b17fa700 1 -- 172.21.15.6:0/3735463670 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ff5b80987a0 con 0x5558d18e3700 2023-09-13T09:42:22.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 10 client.16119 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 10 client.16119 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:42:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 20 client.16119 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d18f7be0 0x5558d18fa000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 4 client.16119 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:22.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.538+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558d182d970 con 0x5558d18f7be0 2023-09-13T09:42:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.539+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d18f7be0 0x5558d18fa000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.539+0000 7ff5b17fa700 10 client.16119 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.539+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d18f7be0 0x5558d18fa000 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4585573fd43204c3 server_cookie=4ecf81487724cfe5 in_seq=0 out_seq=0 2023-09-13T09:42:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5b17fa700 1 -- 172.21.15.6:0/3735463670 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5558d182d970 con 0x5558d18f7be0 2023-09-13T09:42:22.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5b17fa700 10 client.16119 handle_command_reply: tid=0 2023-09-13T09:42:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 client.16119 shutdown 2023-09-13T09:42:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e3700 msgr2=0x5558d18ec410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e3700 0x5558d18ec410 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff5b80957b0 tx=0x7ff5b8098ec0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 shutdown_connections 2023-09-13T09:42:22.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d18f7be0 0x5558d18fa000 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e4060 0x5558d18f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e2a00 0x5558d18ebed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/3735463670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e3700 0x5558d18ec410 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5b17fa700 0 client.16119 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.540+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 >> 172.21.15.6:0/3735463670 conn(0x5558d1840c80 msgr2=0x5558d18dcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.541+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 shutdown_connections 2023-09-13T09:42:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.541+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/3735463670 wait complete. 2023-09-13T09:42:22.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.541+0000 7ff5dbdfbb80 20 client.16119 trim_cache size 0 max 16384 2023-09-13T09:42:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.553+0000 7ff5dbdfbb80 1 Processor -- start 2023-09-13T09:42:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.553+0000 7ff5dbdfbb80 1 -- start start 2023-09-13T09:42:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e3700 0x5558d18f3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e4060 0x5558d18e68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d18dd810 con 0x5558d18e2a00 2023-09-13T09:42:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d18de730 con 0x5558d18e3700 2023-09-13T09:42:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d18ed050 con 0x5558d18e4060 2023-09-13T09:42:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35528/0 (socket says 172.21.15.6:35528) 2023-09-13T09:42:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 -- 172.21.15.6:0/2274149394 learned_addr learned my addr 172.21.15.6:0/2274149394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e3700 0x5558d18f3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e4060 0x5558d18e68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 -- 172.21.15.6:0/2274149394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e4060 msgr2=0x5558d18e68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e4060 0x5558d18e68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 -- 172.21.15.6:0/2274149394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e3700 msgr2=0x5558d18f3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e3700 0x5558d18f3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 -- 172.21.15.6:0/2274149394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5558d1660de0 con 0x5558d18e2a00 2023-09-13T09:42:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e3700 0x5558d18f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e24c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40099c0 tx=0x7ff5c401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8275d13c0049bcf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5bcd82700 1 -- 172.21.15.6:0/2274149394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c402c040 con 0x5558d18e2a00 2023-09-13T09:42:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5bcd82700 1 -- 172.21.15.6:0/2274149394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5c402d040 con 0x5558d18e2a00 2023-09-13T09:42:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.554+0000 7ff5bcd82700 1 -- 172.21.15.6:0/2274149394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c4005610 con 0x5558d18e2a00 2023-09-13T09:42:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2274149394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 msgr2=0x5558d18e24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e24c0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff5c40099c0 tx=0x7ff5c401f000 comp rx=0 tx=0).stop 2023-09-13T09:42:22.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2274149394 shutdown_connections 2023-09-13T09:42:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e4060 0x5558d18e68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e2a00 0x5558d18e24c0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2274149394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e3700 0x5558d18f3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2274149394 >> 172.21.15.6:0/2274149394 conn(0x5558d1840c80 msgr2=0x5558d18dce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2274149394 shutdown_connections 2023-09-13T09:42:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2274149394 wait complete. 2023-09-13T09:42:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 -- start start 2023-09-13T09:42:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.555+0000 7ff5dbdfbb80 1 Processor -- start 2023-09-13T09:42:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e2a00 0x5558d18f2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18f3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5dbdfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e4060 0x5558d18ef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d18f0020 con 0x5558d18e4060 2023-09-13T09:42:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d18f0190 con 0x5558d18e2a00 2023-09-13T09:42:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5dbdfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558d18f0350 con 0x5558d18e3700 2023-09-13T09:42:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5dbdfbb80 10 client.0 _ll_register_callbacks cb 0x5558d17d0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:22.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e4060 0x5558d18ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e4060 0x5558d18ef910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35538/0 (socket says 172.21.15.6:35538) 2023-09-13T09:42:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/2660581347 learned_addr learned my addr 172.21.15.6:0/2660581347 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5cd1b1700 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e2a00 0x5558d18f2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/2660581347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 msgr2=0x5558d18f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e2a00 msgr2=0x5558d18f2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e2a00 0x5558d18f2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 -- 172.21.15.6:0/2660581347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5c8108a50 con 0x5558d18e4060 2023-09-13T09:42:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5ce1b3700 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e4060 0x5558d18ef910 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0011650 tx=0x7ff5c0004110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8c1fbde8c0be17 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5b17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.556+0000 7ff5b17fa700 1 -- 172.21.15.6:0/2660581347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5c000e050 con 0x5558d18e4060 2023-09-13T09:42:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5b17fa700 1 -- 172.21.15.6:0/2660581347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5c0005210 con 0x5558d18e4060 2023-09-13T09:42:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5c000f040 con 0x5558d18e4060 2023-09-13T09:42:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5b17fa700 1 -- 172.21.15.6:0/2660581347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5c0005410 con 0x5558d18e4060 2023-09-13T09:42:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 10 client.16125 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5558d1649c60 con 0x5558d18e4060 2023-09-13T09:42:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5b17fa700 1 -- 172.21.15.6:0/2660581347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5c000f040 con 0x5558d18e4060 2023-09-13T09:42:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5b17fa700 1 -- 172.21.15.6:0/2660581347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7ff5c0028b00 con 0x5558d18e4060 2023-09-13T09:42:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 10 client.16125 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:22.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 10 client.16125 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:42:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 20 client.16125 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d194d0f0 0x5558d194f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 4 client.16125 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5558d17ee050 con 0x5558d194d0f0 2023-09-13T09:42:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.557+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d194d0f0 0x5558d194f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5b17fa700 10 client.16125 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5cd9b2700 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d194d0f0 0x5558d194f510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c9655af514db08e4 server_cookie=4e0b426e52411618 in_seq=0 out_seq=0 2023-09-13T09:42:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5b17fa700 1 -- 172.21.15.6:0/2660581347 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5558d17ee050 con 0x5558d194d0f0 2023-09-13T09:42:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5b17fa700 10 client.16125 handle_command_reply: tid=0 2023-09-13T09:42:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 client.16125 shutdown 2023-09-13T09:42:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e4060 msgr2=0x5558d18ef910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e4060 0x5558d18ef910 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff5c0011650 tx=0x7ff5c0004110 comp rx=0 tx=0).stop 2023-09-13T09:42:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 shutdown_connections 2023-09-13T09:42:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5558d194d0f0 0x5558d194f510 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5558d18e4060 0x5558d18ef910 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5558d18e2a00 0x5558d18f2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 --2- 172.21.15.6:0/2660581347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5558d18e3700 0x5558d18f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5b17fa700 0 client.16125 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 >> 172.21.15.6:0/2660581347 conn(0x5558d1840c80 msgr2=0x5558d18e68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 shutdown_connections 2023-09-13T09:42:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 1 -- 172.21.15.6:0/2660581347 wait complete. 2023-09-13T09:42:22.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.558+0000 7ff5dbdfbb80 20 client.16125 trim_cache size 0 max 16384 2023-09-13T09:42:22.584 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:22.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5b40a0640 msgr2=0x7ff5b40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5b40a0640 0x7ff5b40a2b00 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff5c4009990 tx=0x7ff5c401a040 comp rx=0 tx=0).stop 2023-09-13T09:42:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c8100eb0 msgr2=0x7ff5c8199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c8100eb0 0x7ff5c8199190 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff5b800c9b0 tx=0x7ff5b800ccc0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 shutdown_connections 2023-09-13T09:42:22.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff5c8101850 0x7ff5c81a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5c80ffcc0 0x7ff5c8198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5b40a0640 0x7ff5b40a2b00 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 --2- 172.21.15.6:0/3185155060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5c8100eb0 0x7ff5c8199190 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 >> 172.21.15.6:0/3185155060 conn(0x7ff5c80fb250 msgr2=0x7ff5c8068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 shutdown_connections 2023-09-13T09:42:22.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.559+0000 7ff5cfc16700 1 -- 172.21.15.6:0/3185155060 wait complete. 2023-09-13T09:42:22.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:42:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 -- 172.21.15.6:0/1922117758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 msgr2=0x7f0594101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 --2- 172.21.15.6:0/1922117758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 0x7f0594101310 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0588009920 tx=0x7f0588009c30 comp rx=0 tx=0).stop 2023-09-13T09:42:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 -- 172.21.15.6:0/1922117758 shutdown_connections 2023-09-13T09:42:22.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 --2- 172.21.15.6:0/1922117758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0594101850 0x7f0594108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 --2- 172.21.15.6:0/1922117758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 0x7f05941000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 --2- 172.21.15.6:0/1922117758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 0x7f0594101310 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 -- 172.21.15.6:0/1922117758 >> 172.21.15.6:0/1922117758 conn(0x7f05940fb250 msgr2=0x7f05940fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 -- 172.21.15.6:0/1922117758 shutdown_connections 2023-09-13T09:42:22.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.714+0000 7f059c542700 1 -- 172.21.15.6:0/1922117758 wait complete. 2023-09-13T09:42:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 Processor -- start 2023-09-13T09:42:22.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 -- start start 2023-09-13T09:42:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 0x7f0594196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 0x7f0594197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0594101850 0x7f059419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059419e6a0 con 0x7f05940ffcc0 2023-09-13T09:42:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059419e7e0 con 0x7f0594100eb0 2023-09-13T09:42:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059c542700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f059419e970 con 0x7f0594101850 2023-09-13T09:42:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059a2de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 0x7f0594196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059a2de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 0x7f0594196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35548/0 (socket says 172.21.15.6:35548) 2023-09-13T09:42:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059a2de700 1 -- 172.21.15.6:0/589122811 learned_addr learned my addr 172.21.15.6:0/589122811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f0599add700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 0x7f0594197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.715+0000 7f059aadf700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0594101850 0x7f059419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059a2de700 1 -- 172.21.15.6:0/589122811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0594101850 msgr2=0x7f059419e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059a2de700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0594101850 0x7f059419e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059a2de700 1 -- 172.21.15.6:0/589122811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 msgr2=0x7f0594197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059a2de700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 0x7f0594197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059a2de700 1 -- 172.21.15.6:0/589122811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05900095f0 con 0x7f05940ffcc0 2023-09-13T09:42:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059a2de700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 0x7f0594196b20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f059000ebf0 tx=0x7f059000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f05877fe700 1 -- 172.21.15.6:0/589122811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590009a10 con 0x7f05940ffcc0 2023-09-13T09:42:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c009c40 con 0x7f05940ffcc0 2023-09-13T09:42:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f05877fe700 1 -- 172.21.15.6:0/589122811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f059000cc80 con 0x7f05940ffcc0 2023-09-13T09:42:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f05877fe700 1 -- 172.21.15.6:0/589122811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590018710 con 0x7f05940ffcc0 2023-09-13T09:42:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.716+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0588009520 con 0x7f05940ffcc0 2023-09-13T09:42:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.719+0000 7f05877fe700 1 -- 172.21.15.6:0/589122811 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0590010430 con 0x7f05940ffcc0 2023-09-13T09:42:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.719+0000 7f05877fe700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05800a0640 0x7f05800a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.719+0000 7f05877fe700 1 -- 172.21.15.6:0/589122811 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0590014070 con 0x7f05940ffcc0 2023-09-13T09:42:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.720+0000 7f0599add700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05800a0640 0x7f05800a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.720+0000 7f0599add700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05800a0640 0x7f05800a2b00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f058800fa40 tx=0x7f0588019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.720+0000 7f05a8727b80 1 Processor -- start 2023-09-13T09:42:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.720+0000 7f05a8727b80 1 -- start start 2023-09-13T09:42:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.720+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667b9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.720+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 0x5604667b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f05a8727b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560466711780 con 0x5604667b9700 2023-09-13T09:42:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f05a8727b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046670f0a0 con 0x5604667b8a00 2023-09-13T09:42:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f05a8727b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046670a990 con 0x5604667ba060 2023-09-13T09:42:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667b9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667b9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35556/0 (socket says 172.21.15.6:35556) 2023-09-13T09:42:22.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 -- 172.21.15.6:0/1648446328 learned_addr learned my addr 172.21.15.6:0/1648446328 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f0599add700 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 -- 172.21.15.6:0/1648446328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 msgr2=0x5604667b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 -- 172.21.15.6:0/1648446328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 msgr2=0x5604667b8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 0x5604667b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 -- 172.21.15.6:0/1648446328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56046658a630 con 0x5604667b9700 2023-09-13T09:42:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f059a2de700 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667b9b20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f05900a13d0 tx=0x7f0590005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f0921c0a5153ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f0584ff9700 1 -- 172.21.15.6:0/1648446328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590099f90 con 0x5604667b9700 2023-09-13T09:42:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f0584ff9700 1 -- 172.21.15.6:0/1648446328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05900b1e90 con 0x5604667b9700 2023-09-13T09:42:22.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.721+0000 7f0584ff9700 1 -- 172.21.15.6:0/1648446328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0590097d50 con 0x5604667b9700 2023-09-13T09:42:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 -- 172.21.15.6:0/1648446328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 msgr2=0x5604667b9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667b9b20 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f05900a13d0 tx=0x7f0590005760 comp rx=0 tx=0).stop 2023-09-13T09:42:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 -- 172.21.15.6:0/1648446328 shutdown_connections 2023-09-13T09:42:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 0x5604667b8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667b9b20 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1648446328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 -- 172.21.15.6:0/1648446328 >> 172.21.15.6:0/1648446328 conn(0x560466716c80 msgr2=0x5604667b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 -- 172.21.15.6:0/1648446328 shutdown_connections 2023-09-13T09:42:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 -- 172.21.15.6:0/1648446328 wait complete. 2023-09-13T09:42:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.722+0000 7f05a8727b80 1 -- start start 2023-09-13T09:42:22.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 1 Processor -- start 2023-09-13T09:42:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 0x5604667c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667c2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667c94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604666a8bb0 con 0x5604667b9700 2023-09-13T09:42:22.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604666a88b0 con 0x5604667b8a00 2023-09-13T09:42:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56046658c920 con 0x5604667ba060 2023-09-13T09:42:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f05a8727b80 10 client.0 _ll_register_callbacks cb 0x5604666a6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667c2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667c2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35564/0 (socket says 172.21.15.6:35564) 2023-09-13T09:42:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 -- 172.21.15.6:0/453516152 learned_addr learned my addr 172.21.15.6:0/453516152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f059aadf700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667c94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f059a2de700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 0x5604667c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 -- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 msgr2=0x5604667c94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667c94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 -- 172.21.15.6:0/453516152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 msgr2=0x5604667c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 0x5604667c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 -- 172.21.15.6:0/453516152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0588009520 con 0x5604667b9700 2023-09-13T09:42:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f059aadf700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f0599add700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667c2480 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0588009920 tx=0x7f0588009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fbec7956d48ec95 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.723+0000 7f057dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:22.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f057dffb700 1 -- 172.21.15.6:0/453516152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588005450 con 0x5604667b9700 2023-09-13T09:42:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f057dffb700 1 -- 172.21.15.6:0/453516152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f05880055b0 con 0x5604667b9700 2023-09-13T09:42:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604667ab670 con 0x5604667b9700 2023-09-13T09:42:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f057dffb700 1 -- 172.21.15.6:0/453516152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0588003680 con 0x5604667b9700 2023-09-13T09:42:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 10 client.16137 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:22.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5604667227a0 con 0x5604667b9700 2023-09-13T09:42:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f057dffb700 1 -- 172.21.15.6:0/453516152 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f058803e080 con 0x5604667b9700 2023-09-13T09:42:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f057dffb700 1 -- 172.21.15.6:0/453516152 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f058803a850 con 0x5604667b9700 2023-09-13T09:42:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 10 client.16137 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 10 client.16137 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:42:22.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 20 client.16137 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x5604667d0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 4 client.16137 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560466703970 con 0x5604667cde10 2023-09-13T09:42:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.724+0000 7f059a2de700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x5604667d0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.725+0000 7f057dffb700 10 client.16137 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:22.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.725+0000 7f059a2de700 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x5604667d0230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=326d20f16b67d155 server_cookie=94750c61cf2e1e27 in_seq=0 out_seq=0 2023-09-13T09:42:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.725+0000 7f057dffb700 1 -- 172.21.15.6:0/453516152 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560466703970 con 0x5604667cde10 2023-09-13T09:42:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.725+0000 7f057dffb700 10 client.16137 handle_command_reply: tid=0 2023-09-13T09:42:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.725+0000 7f05a8727b80 1 client.16137 shutdown 2023-09-13T09:42:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 msgr2=0x5604667c2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667c2480 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f0588009920 tx=0x7f0588009260 comp rx=0 tx=0).stop 2023-09-13T09:42:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 shutdown_connections 2023-09-13T09:42:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x5604667d0230 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667ba060 0x5604667c94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f057dffb700 0 client.16137 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:22.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b8a00 0x5604667c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 --2- 172.21.15.6:0/453516152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667c2480 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 >> 172.21.15.6:0/453516152 conn(0x560466716c80 msgr2=0x5604667ad7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 shutdown_connections 2023-09-13T09:42:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 1 -- 172.21.15.6:0/453516152 wait complete. 2023-09-13T09:42:22.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.726+0000 7f05a8727b80 20 client.16137 trim_cache size 0 max 16384 2023-09-13T09:42:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.738+0000 7f05a8727b80 1 Processor -- start 2023-09-13T09:42:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05a8727b80 1 -- start start 2023-09-13T09:42:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x5604667b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667bfe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667ba060 0x5604667bc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05a8727b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604667c2bc0 con 0x5604667b9700 2023-09-13T09:42:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05a8727b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604667bfbe0 con 0x5604667ba060 2023-09-13T09:42:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05a8727b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604667bd4d0 con 0x5604667b8a00 2023-09-13T09:42:22.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667bfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667bfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35572/0 (socket says 172.21.15.6:35572) 2023-09-13T09:42:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 -- 172.21.15.6:0/76542455 learned_addr learned my addr 172.21.15.6:0/76542455 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f059a2de700 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x5604667b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f059aadf700 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667ba060 0x5604667bc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 -- 172.21.15.6:0/76542455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 msgr2=0x5604667b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x5604667b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 -- 172.21.15.6:0/76542455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667ba060 msgr2=0x5604667bc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667ba060 0x5604667bc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 -- 172.21.15.6:0/76542455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560466536de0 con 0x5604667b9700 2023-09-13T09:42:22.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f059a2de700 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x5604667b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f0599add700 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667bfe30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0588005e90 tx=0x7f0588005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90b165309a4ae2c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.739+0000 7f05857fa700 1 -- 172.21.15.6:0/76542455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058800f460 con 0x5604667b9700 2023-09-13T09:42:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05857fa700 1 -- 172.21.15.6:0/76542455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5604667ab670 con 0x5604667b9700 2023-09-13T09:42:22.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05857fa700 1 -- 172.21.15.6:0/76542455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0588003680 con 0x5604667b9700 2023-09-13T09:42:22.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 -- 172.21.15.6:0/76542455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 msgr2=0x5604667bfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667bfe30 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f0588005e90 tx=0x7f0588005b80 comp rx=0 tx=0).stop 2023-09-13T09:42:22.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 -- 172.21.15.6:0/76542455 shutdown_connections 2023-09-13T09:42:22.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667ba060 0x5604667bc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x5604667b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 --2- 172.21.15.6:0/76542455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667b9700 0x5604667bfe30 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 -- 172.21.15.6:0/76542455 >> 172.21.15.6:0/76542455 conn(0x560466716c80 msgr2=0x5604667c0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 -- 172.21.15.6:0/76542455 shutdown_connections 2023-09-13T09:42:22.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 -- 172.21.15.6:0/76542455 wait complete. 2023-09-13T09:42:22.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 -- start start 2023-09-13T09:42:22.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.740+0000 7f05a8727b80 1 Processor -- start 2023-09-13T09:42:22.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x56046681de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b9700 0x56046681e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f05a8727b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667ba060 0x560466824ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f05a8727b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560466825220 con 0x5604667ba060 2023-09-13T09:42:22.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f05a8727b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560466825360 con 0x5604667b9700 2023-09-13T09:42:22.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f05a8727b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560466825520 con 0x5604667b8a00 2023-09-13T09:42:22.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f05a8727b80 10 client.0 _ll_register_callbacks cb 0x5604666a6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:22.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667ba060 0x560466824ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667ba060 0x560466824ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35580/0 (socket says 172.21.15.6:35580) 2023-09-13T09:42:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 -- 172.21.15.6:0/1848260123 learned_addr learned my addr 172.21.15.6:0/1848260123 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059a2de700 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x56046681de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 -- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 msgr2=0x56046681de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x56046681de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f0599add700 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b9700 0x56046681e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 -- 172.21.15.6:0/1848260123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b9700 msgr2=0x56046681e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b9700 0x56046681e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 -- 172.21.15.6:0/1848260123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5604667227a0 con 0x5604667ba060 2023-09-13T09:42:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f059aadf700 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667ba060 0x560466824ce0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f058c007e40 tx=0x7f058c0145a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df12c569167b684 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.741+0000 7f057dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f057dffb700 1 -- 172.21.15.6:0/1848260123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f058c00e040 con 0x5604667ba060 2023-09-13T09:42:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f057dffb700 1 -- 172.21.15.6:0/1848260123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f058c014d30 con 0x5604667ba060 2023-09-13T09:42:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05900b1e90 con 0x5604667ba060 2023-09-13T09:42:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f057dffb700 1 -- 172.21.15.6:0/1848260123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f058c003a00 con 0x5604667ba060 2023-09-13T09:42:22.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 10 client.16143 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56046651fc60 con 0x5604667ba060 2023-09-13T09:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f057dffb700 1 -- 172.21.15.6:0/1848260123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f05900b1e90 con 0x5604667ba060 2023-09-13T09:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f057dffb700 1 -- 172.21.15.6:0/1848260123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f058c017440 con 0x5604667ba060 2023-09-13T09:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 10 client.16143 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:22.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 10 client.16143 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 20 client.16143 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x560466829020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 4 client.16143 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5604666c4050 con 0x5604667cde10 2023-09-13T09:42:22.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.742+0000 7f059a2de700 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x560466829020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f057dffb700 10 client.16143 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:22.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f059a2de700 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x560466829020 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ea09d0f02cc4f793 server_cookie=584705245c2a8b33 in_seq=0 out_seq=0 2023-09-13T09:42:22.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f057dffb700 1 -- 172.21.15.6:0/1848260123 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5604666c4050 con 0x5604667cde10 2023-09-13T09:42:22.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f057dffb700 10 client.16143 handle_command_reply: tid=0 2023-09-13T09:42:22.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 client.16143 shutdown 2023-09-13T09:42:22.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667ba060 msgr2=0x560466824ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667ba060 0x560466824ce0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f058c007e40 tx=0x7f058c0145a0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 shutdown_connections 2023-09-13T09:42:22.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5604667cde10 0x560466829020 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604667ba060 0x560466824ce0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604667b8a00 0x56046681de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 --2- 172.21.15.6:0/1848260123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604667b9700 0x56046681e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 >> 172.21.15.6:0/1848260123 conn(0x560466716c80 msgr2=0x5604667bc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f057dffb700 0 client.16143 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:22.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 shutdown_connections 2023-09-13T09:42:22.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 1 -- 172.21.15.6:0/1848260123 wait complete. 2023-09-13T09:42:22.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.743+0000 7f05a8727b80 20 client.16143 trim_cache size 0 max 16384 2023-09-13T09:42:22.769 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:22.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05800a0640 msgr2=0x7f05800a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05800a0640 0x7f05800a2b00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f058800fa40 tx=0x7f0588019040 comp rx=0 tx=0).stop 2023-09-13T09:42:22.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 msgr2=0x7f0594196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 0x7f0594196b20 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f059000ebf0 tx=0x7f059000ef00 comp rx=0 tx=0).stop 2023-09-13T09:42:22.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 shutdown_connections 2023-09-13T09:42:22.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0594101850 0x7f059419e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05800a0640 0x7f05800a2b00 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05940ffcc0 0x7f0594196b20 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 --2- 172.21.15.6:0/589122811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0594100eb0 0x7f0594197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 >> 172.21.15.6:0/589122811 conn(0x7f05940fb250 msgr2=0x7f05940fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 shutdown_connections 2023-09-13T09:42:22.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.744+0000 7f059c542700 1 -- 172.21.15.6:0/589122811 wait complete. 2023-09-13T09:42:22.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:42:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 -- 172.21.15.6:0/519168444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 msgr2=0x7fcac00ffd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/519168444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac00ffd50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009990 tx=0x7fcab0009ca0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 -- 172.21.15.6:0/519168444 shutdown_connections 2023-09-13T09:42:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/519168444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcac0100290 0x7fcac0108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/519168444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac01013c0 0x7fcac01017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/519168444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac00ffd50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 -- 172.21.15.6:0/519168444 >> 172.21.15.6:0/519168444 conn(0x7fcac00fb250 msgr2=0x7fcac00fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 -- 172.21.15.6:0/519168444 shutdown_connections 2023-09-13T09:42:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 -- 172.21.15.6:0/519168444 wait complete. 2023-09-13T09:42:22.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 Processor -- start 2023-09-13T09:42:22.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.900+0000 7fcac5ce0700 1 -- start start 2023-09-13T09:42:22.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac0195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcac0100290 0x7fcac0195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac01013c0 0x7fcac019d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac019d610 con 0x7fcac00ff8f0 2023-09-13T09:42:22.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac019d750 con 0x7fcac01013c0 2023-09-13T09:42:22.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcac019d8e0 con 0x7fcac0100290 2023-09-13T09:42:22.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac0195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac0195a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35590/0 (socket says 172.21.15.6:35590) 2023-09-13T09:42:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 -- 172.21.15.6:0/1243918902 learned_addr learned my addr 172.21.15.6:0/1243918902 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 -- 172.21.15.6:0/1243918902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcac0100290 msgr2=0x7fcac0195fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcac0100290 0x7fcac0195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 -- 172.21.15.6:0/1243918902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac01013c0 msgr2=0x7fcac019d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabffff700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac01013c0 0x7fcac019d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac01013c0 0x7fcac019d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 -- 172.21.15.6:0/1243918902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00095f0 con 0x7fcac00ff8f0 2023-09-13T09:42:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac0195a90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcab40098f0 tx=0x7fcab4009cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabcff9700 1 -- 172.21.15.6:0/1243918902 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab4012070 con 0x7fcac00ff8f0 2023-09-13T09:42:22.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcac0068dd0 con 0x7fcac00ff8f0 2023-09-13T09:42:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabcff9700 1 -- 172.21.15.6:0/1243918902 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcab40044e0 con 0x7fcac00ff8f0 2023-09-13T09:42:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcabcff9700 1 -- 172.21.15.6:0/1243918902 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab4007d10 con 0x7fcac00ff8f0 2023-09-13T09:42:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.901+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0069330 con 0x7fcac00ff8f0 2023-09-13T09:42:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.904+0000 7fcabcff9700 1 -- 172.21.15.6:0/1243918902 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcab4016030 con 0x7fcac00ff8f0 2023-09-13T09:42:22.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.904+0000 7fcabcff9700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcaa80a0640 0x7fcaa80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.904+0000 7fcabcff9700 1 -- 172.21.15.6:0/1243918902 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcab40ccec0 con 0x7fcac00ff8f0 2023-09-13T09:42:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.904+0000 7fcabeffd700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcaa80a0640 0x7fcaa80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabeffd700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcaa80a0640 0x7fcaa80a2b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcab00098e0 tx=0x7fcab0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 Processor -- start 2023-09-13T09:42:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 -- start start 2023-09-13T09:42:22.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d0af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d098d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d09e10 0x55c996d0a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996c5e780 con 0x55c996d09e10 2023-09-13T09:42:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996c5c0a0 con 0x55c996d0b470 2023-09-13T09:42:22.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996c57990 con 0x55c996d0ab10 2023-09-13T09:42:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d09e10 0x55c996d0a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d09e10 0x55c996d0a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35602/0 (socket says 172.21.15.6:35602) 2023-09-13T09:42:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 -- 172.21.15.6:0/2144117102 learned_addr learned my addr 172.21.15.6:0/2144117102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d0af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabeffd700 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d098d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 -- 172.21.15.6:0/2144117102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 msgr2=0x55c996d0af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d0af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 -- 172.21.15.6:0/2144117102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 msgr2=0x55c996d098d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d098d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.905+0000 7fcabffff700 1 -- 172.21.15.6:0/2144117102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c996ad7630 con 0x55c996d09e10 2023-09-13T09:42:22.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcabffff700 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d09e10 0x55c996d0a270 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcab80060b0 tx=0x7fcab8007500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e9cae5c269b83c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcaa5ffb700 1 -- 172.21.15.6:0/2144117102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8003c00 con 0x55c996d09e10 2023-09-13T09:42:22.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcaa5ffb700 1 -- 172.21.15.6:0/2144117102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcab8007e40 con 0x55c996d09e10 2023-09-13T09:42:22.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcaa5ffb700 1 -- 172.21.15.6:0/2144117102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8014780 con 0x55c996d09e10 2023-09-13T09:42:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2144117102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d09e10 msgr2=0x55c996d0a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d09e10 0x55c996d0a270 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcab80060b0 tx=0x7fcab8007500 comp rx=0 tx=0).stop 2023-09-13T09:42:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2144117102 shutdown_connections 2023-09-13T09:42:22.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d09e10 0x55c996d0a270 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d0af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2144117102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.906+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2144117102 >> 172.21.15.6:0/2144117102 conn(0x55c996c63c80 msgr2=0x55c996cfff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.907+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2144117102 shutdown_connections 2023-09-13T09:42:22.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.907+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2144117102 wait complete. 2023-09-13T09:42:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.907+0000 7fcad1ec5b80 1 -- start start 2023-09-13T09:42:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.907+0000 7fcad1ec5b80 1 Processor -- start 2023-09-13T09:42:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 0x55c996d132d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0ab10 0x55c996d13810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d1a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996bf5bb0 con 0x55c996d0b470 2023-09-13T09:42:22.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996bf58b0 con 0x55c996d0ab10 2023-09-13T09:42:22.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996ad9920 con 0x55c996d09e10 2023-09-13T09:42:22.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 10 client.0 _ll_register_callbacks cb 0x55c996bf3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:22.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d1a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabf7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 0x55c996d132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d1a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35608/0 (socket says 172.21.15.6:35608) 2023-09-13T09:42:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 -- 172.21.15.6:0/2266007093 learned_addr learned my addr 172.21.15.6:0/2266007093 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabeffd700 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0ab10 0x55c996d13810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 -- 172.21.15.6:0/2266007093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 msgr2=0x55c996d132d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 0x55c996d132d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 -- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0ab10 msgr2=0x55c996d13810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0ab10 0x55c996d13810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 -- 172.21.15.6:0/2266007093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab8009920 con 0x55c996d0b470 2023-09-13T09:42:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcabffff700 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d1a850 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcab80094f0 tx=0x7fcab8009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a2138b5edd7fbb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fca9effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fca9effd700 1 -- 172.21.15.6:0/2266007093 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8004770 con 0x55c996d0b470 2023-09-13T09:42:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fca9effd700 1 -- 172.21.15.6:0/2266007093 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcab8004460 con 0x55c996d0b470 2023-09-13T09:42:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.908+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c996cf8670 con 0x55c996d0b470 2023-09-13T09:42:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fca9effd700 1 -- 172.21.15.6:0/2266007093 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab8014500 con 0x55c996d0b470 2023-09-13T09:42:22.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 10 client.16155 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c996c6f7a0 con 0x55c996d0b470 2023-09-13T09:42:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fca9effd700 1 -- 172.21.15.6:0/2266007093 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c996cf8670 con 0x55c996d0b470 2023-09-13T09:42:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fca9effd700 1 -- 172.21.15.6:0/2266007093 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fcab801c040 con 0x55c996d0b470 2023-09-13T09:42:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 10 client.16155 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 10 client.16155 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:42:22.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 20 client.16155 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d1f1c0 0x55c996d215e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 4 client.16155 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c996c50970 con 0x55c996d1f1c0 2023-09-13T09:42:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.909+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d1f1c0 0x55c996d215e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.910+0000 7fca9effd700 10 client.16155 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.910+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d1f1c0 0x55c996d215e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3353046dd14449be server_cookie=a7fb7502bb92d3b8 in_seq=0 out_seq=0 2023-09-13T09:42:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.910+0000 7fca9effd700 1 -- 172.21.15.6:0/2266007093 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c996c50970 con 0x55c996d1f1c0 2023-09-13T09:42:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.910+0000 7fca9effd700 10 client.16155 handle_command_reply: tid=0 2023-09-13T09:42:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.910+0000 7fcad1ec5b80 1 client.16155 shutdown 2023-09-13T09:42:22.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 msgr2=0x55c996d1a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d1a850 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcab80094f0 tx=0x7fcab8009650 comp rx=0 tx=0).stop 2023-09-13T09:42:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 shutdown_connections 2023-09-13T09:42:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d1f1c0 0x55c996d215e0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d1a850 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 0x55c996d132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2266007093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0ab10 0x55c996d13810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fca9effd700 0 client.16155 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 >> 172.21.15.6:0/2266007093 conn(0x55c996c63c80 msgr2=0x55c996cffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 shutdown_connections 2023-09-13T09:42:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2266007093 wait complete. 2023-09-13T09:42:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.911+0000 7fcad1ec5b80 20 client.16155 trim_cache size 0 max 16384 2023-09-13T09:42:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 Processor -- start 2023-09-13T09:42:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 -- start start 2023-09-13T09:42:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 0x55c996d0dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0ab10 0x55c996d1a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d0e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996d01fd0 con 0x55c996d0ab10 2023-09-13T09:42:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996d01730 con 0x55c996d0b470 2023-09-13T09:42:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996d00dc0 con 0x55c996d09e10 2023-09-13T09:42:22.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0ab10 0x55c996d1a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0ab10 0x55c996d1a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35614/0 (socket says 172.21.15.6:35614) 2023-09-13T09:42:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 -- 172.21.15.6:0/2199068593 learned_addr learned my addr 172.21.15.6:0/2199068593 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabffff700 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d0e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 -- 172.21.15.6:0/2199068593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 msgr2=0x55c996d0dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 0x55c996d0dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 -- 172.21.15.6:0/2199068593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 msgr2=0x55c996d0e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d0e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 -- 172.21.15.6:0/2199068593 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c996a83de0 con 0x55c996d0ab10 2023-09-13T09:42:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.924+0000 7fcabeffd700 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0ab10 0x55c996d1a810 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcab000b900 tx=0x7fcab0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32a2a49bdd68a4d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcaa67fc700 1 -- 172.21.15.6:0/2199068593 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab001d070 con 0x55c996d0ab10 2023-09-13T09:42:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcaa67fc700 1 -- 172.21.15.6:0/2199068593 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcab002a070 con 0x55c996d0ab10 2023-09-13T09:42:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcaa67fc700 1 -- 172.21.15.6:0/2199068593 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab000f860 con 0x55c996d0ab10 2023-09-13T09:42:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2199068593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0ab10 msgr2=0x55c996d1a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0ab10 0x55c996d1a810 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fcab000b900 tx=0x7fcab0010000 comp rx=0 tx=0).stop 2023-09-13T09:42:22.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2199068593 shutdown_connections 2023-09-13T09:42:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d0b470 0x55c996d0e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d09e10 0x55c996d0dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/2199068593 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0ab10 0x55c996d1a810 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2199068593 >> 172.21.15.6:0/2199068593 conn(0x55c996c63c80 msgr2=0x55c996d11ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2199068593 shutdown_connections 2023-09-13T09:42:22.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.925+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/2199068593 wait complete. 2023-09-13T09:42:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 -- start start 2023-09-13T09:42:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 Processor -- start 2023-09-13T09:42:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d09e10 0x55c996d1a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d1a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d16cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996d173e0 con 0x55c996d0b470 2023-09-13T09:42:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996d17550 con 0x55c996d09e10 2023-09-13T09:42:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c996d17710 con 0x55c996d0ab10 2023-09-13T09:42:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcad1ec5b80 10 client.0 _ll_register_callbacks cb 0x55c996bf3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:22.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d16cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d16cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35622/0 (socket says 172.21.15.6:35622) 2023-09-13T09:42:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabffff700 1 -- 172.21.15.6:0/497212800 learned_addr learned my addr 172.21.15.6:0/497212800 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d09e10 0x55c996d1a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabeffd700 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d1a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabffff700 1 -- 172.21.15.6:0/497212800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 msgr2=0x55c996d1a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabffff700 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d1a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabffff700 1 -- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d09e10 msgr2=0x55c996d1a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.926+0000 7fcabffff700 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d09e10 0x55c996d1a1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcabffff700 1 -- 172.21.15.6:0/497212800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcac0108b50 con 0x55c996d0b470 2023-09-13T09:42:22.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcabffff700 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d16cd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009620 tx=0x7fcab80090a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37dad1b69e91bed8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fca9effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fca9effd700 1 -- 172.21.15.6:0/497212800 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcab8004930 con 0x55c996d0b470 2023-09-13T09:42:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fca9effd700 1 -- 172.21.15.6:0/497212800 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcab8005430 con 0x55c996d0b470 2023-09-13T09:42:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcab8007e40 con 0x55c996d0b470 2023-09-13T09:42:22.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fca9effd700 1 -- 172.21.15.6:0/497212800 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcab8004ce0 con 0x55c996d0b470 2023-09-13T09:42:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 10 client.16161 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55c996a6cc60 con 0x55c996d0b470 2023-09-13T09:42:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fca9effd700 1 -- 172.21.15.6:0/497212800 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcab8040080 con 0x55c996d0b470 2023-09-13T09:42:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fca9effd700 1 -- 172.21.15.6:0/497212800 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fcab801c070 con 0x55c996d0b470 2023-09-13T09:42:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 10 client.16161 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:22.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 10 client.16161 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:42:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 20 client.16161 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d74420 0x55c996d76840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 4 client.16161 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:22.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.927+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c996c11050 con 0x55c996d74420 2023-09-13T09:42:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d74420 0x55c996d76840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fca9effd700 10 client.16161 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d74420 0x55c996d76840 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5478e54b48494792 server_cookie=ed59b499035c44d3 in_seq=0 out_seq=0 2023-09-13T09:42:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fca9effd700 1 -- 172.21.15.6:0/497212800 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c996c11050 con 0x55c996d74420 2023-09-13T09:42:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fca9effd700 10 client.16161 handle_command_reply: tid=0 2023-09-13T09:42:22.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 client.16161 shutdown 2023-09-13T09:42:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 msgr2=0x55c996d16cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d16cd0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009620 tx=0x7fcab80090a0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 shutdown_connections 2023-09-13T09:42:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c996d74420 0x55c996d76840 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c996d0b470 0x55c996d16cd0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fca9effd700 0 client.16161 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c996d09e10 0x55c996d1a1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 --2- 172.21.15.6:0/497212800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c996d0ab10 0x55c996d1a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 >> 172.21.15.6:0/497212800 conn(0x55c996c63c80 msgr2=0x55c996d0dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.928+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 shutdown_connections 2023-09-13T09:42:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcad1ec5b80 1 -- 172.21.15.6:0/497212800 wait complete. 2023-09-13T09:42:22.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcad1ec5b80 20 client.16161 trim_cache size 0 max 16384 2023-09-13T09:42:22.954 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:22.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcaa80a0640 msgr2=0x7fcaa80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcaa80a0640 0x7fcaa80a2b00 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcab00098e0 tx=0x7fcab0005fb0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 msgr2=0x7fcac0195a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac0195a90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fcab40098f0 tx=0x7fcab4009cb0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 shutdown_connections 2023-09-13T09:42:22.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcac01013c0 0x7fcac019d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcaa80a0640 0x7fcaa80a2b00 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcac00ff8f0 0x7fcac0195a90 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 --2- 172.21.15.6:0/1243918902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcac0100290 0x7fcac0195fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 >> 172.21.15.6:0/1243918902 conn(0x7fcac00fb250 msgr2=0x7fcac00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:22.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 shutdown_connections 2023-09-13T09:42:22.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:22.929+0000 7fcac5ce0700 1 -- 172.21.15.6:0/1243918902 wait complete. 2023-09-13T09:42:22.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:42:23.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 -- 172.21.15.6:0/4221842753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06600ffcc0 msgr2=0x7f06601000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 --2- 172.21.15.6:0/4221842753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06600ffcc0 0x7f06601000e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f06540099c0 tx=0x7f0654009cd0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 -- 172.21.15.6:0/4221842753 shutdown_connections 2023-09-13T09:42:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 --2- 172.21.15.6:0/4221842753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0660101850 0x7f0660108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 --2- 172.21.15.6:0/4221842753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f06600ffcc0 0x7f06601000e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 --2- 172.21.15.6:0/4221842753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0660100eb0 0x7f0660101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 -- 172.21.15.6:0/4221842753 >> 172.21.15.6:0/4221842753 conn(0x7f06600fb250 msgr2=0x7f06600fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 -- 172.21.15.6:0/4221842753 shutdown_connections 2023-09-13T09:42:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 -- 172.21.15.6:0/4221842753 wait complete. 2023-09-13T09:42:23.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.086+0000 7f0664aa3700 1 Processor -- start 2023-09-13T09:42:23.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f0664aa3700 1 -- start start 2023-09-13T09:42:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f0664aa3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06600ffcc0 0x7f06601948c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f0664aa3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660100eb0 0x7f0660194e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f0664aa3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0660101850 0x7f066019be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f0664aa3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066019c440 con 0x7f0660100eb0 2023-09-13T09:42:23.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f0664aa3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066019c580 con 0x7f0660101850 2023-09-13T09:42:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f0664aa3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f066019c710 con 0x7f06600ffcc0 2023-09-13T09:42:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660100eb0 0x7f0660194e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660100eb0 0x7f0660194e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35634/0 (socket says 172.21.15.6:35634) 2023-09-13T09:42:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 -- 172.21.15.6:0/372219374 learned_addr learned my addr 172.21.15.6:0/372219374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065e59c700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06600ffcc0 0x7f06601948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065ed9d700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0660101850 0x7f066019be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 -- 172.21.15.6:0/372219374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06600ffcc0 msgr2=0x7f06601948c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06600ffcc0 0x7f06601948c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 -- 172.21.15.6:0/372219374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0660101850 msgr2=0x7f066019be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0660101850 0x7f066019be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 -- 172.21.15.6:0/372219374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06540095f0 con 0x7f0660100eb0 2023-09-13T09:42:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f065dd9b700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660100eb0 0x7f0660194e00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f065000d950 tx=0x7f065000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.087+0000 7f064f7fe700 1 -- 172.21.15.6:0/372219374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0650009940 con 0x7f0660100eb0 2023-09-13T09:42:23.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.088+0000 7f064f7fe700 1 -- 172.21.15.6:0/372219374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0650010460 con 0x7f0660100eb0 2023-09-13T09:42:23.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.088+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f066019c9f0 con 0x7f0660100eb0 2023-09-13T09:42:23.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.088+0000 7f064f7fe700 1 -- 172.21.15.6:0/372219374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f065000f620 con 0x7f0660100eb0 2023-09-13T09:42:23.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.088+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f066019cf00 con 0x7f0660100eb0 2023-09-13T09:42:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.090+0000 7f064f7fe700 1 -- 172.21.15.6:0/372219374 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f06500108d0 con 0x7f0660100eb0 2023-09-13T09:42:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.091+0000 7f064f7fe700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06480a2850 0x7f06480a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.091+0000 7f064f7fe700 1 -- 172.21.15.6:0/372219374 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f06500cbaa0 con 0x7f0660100eb0 2023-09-13T09:42:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.091+0000 7f065e59c700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06480a2850 0x7f06480a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.091+0000 7f065e59c700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06480a2850 0x7f06480a4d10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0654009f50 tx=0x7f065400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.091+0000 7f0670c88b80 1 Processor -- start 2023-09-13T09:42:23.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f0670c88b80 1 -- start start 2023-09-13T09:42:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f6700 0x5619521f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f7060 0x5619521f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x5619521f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f0670c88b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56195214e780 con 0x5619521f6700 2023-09-13T09:42:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f0670c88b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56195214c0a0 con 0x5619521f7060 2023-09-13T09:42:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f0670c88b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952147990 con 0x5619521f5a00 2023-09-13T09:42:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f6700 0x5619521f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f6700 0x5619521f6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35640/0 (socket says 172.21.15.6:35640) 2023-09-13T09:42:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 -- 172.21.15.6:0/2105490509 learned_addr learned my addr 172.21.15.6:0/2105490509 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065dd9b700 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f7060 0x5619521f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 -- 172.21.15.6:0/2105490509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 msgr2=0x5619521f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x5619521f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x5619521f5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 -- 172.21.15.6:0/2105490509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f7060 msgr2=0x5619521f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f7060 0x5619521f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 -- 172.21.15.6:0/2105490509 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561951fc7630 con 0x5619521f6700 2023-09-13T09:42:23.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.092+0000 7f065e59c700 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f6700 0x5619521f6b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f0654020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e696e1035cc55287 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f064cff9700 1 -- 172.21.15.6:0/2105490509 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06540038c0 con 0x5619521f6700 2023-09-13T09:42:23.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f064cff9700 1 -- 172.21.15.6:0/2105490509 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f065401e040 con 0x5619521f6700 2023-09-13T09:42:23.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f064cff9700 1 -- 172.21.15.6:0/2105490509 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654004970 con 0x5619521f6700 2023-09-13T09:42:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 -- 172.21.15.6:0/2105490509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f6700 msgr2=0x5619521f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f6700 0x5619521f6b20 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f0654000c00 tx=0x7f0654020000 comp rx=0 tx=0).stop 2023-09-13T09:42:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 -- 172.21.15.6:0/2105490509 shutdown_connections 2023-09-13T09:42:23.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x5619521f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f6700 0x5619521f6b20 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2105490509 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f7060 0x5619521f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 -- 172.21.15.6:0/2105490509 >> 172.21.15.6:0/2105490509 conn(0x561952153c80 msgr2=0x5619521eff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 -- 172.21.15.6:0/2105490509 shutdown_connections 2023-09-13T09:42:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.093+0000 7f0670c88b80 1 -- 172.21.15.6:0/2105490509 wait complete. 2023-09-13T09:42:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 -- start start 2023-09-13T09:42:23.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 Processor -- start 2023-09-13T09:42:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f5a00 0x5619521feea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x5619521ff3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f7060 0x561952206420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619520e5bb0 con 0x5619521f5a00 2023-09-13T09:42:23.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619520e58b0 con 0x5619521f6700 2023-09-13T09:42:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561951fc9920 con 0x5619521f7060 2023-09-13T09:42:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f0670c88b80 10 client.0 _ll_register_callbacks cb 0x5619520e3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f5a00 0x5619521feea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f5a00 0x5619521feea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35646/0 (socket says 172.21.15.6:35646) 2023-09-13T09:42:23.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 -- 172.21.15.6:0/2501203283 learned_addr learned my addr 172.21.15.6:0/2501203283 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065dd9b700 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x5619521ff3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f7060 0x561952206420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 -- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f7060 msgr2=0x561952206420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f7060 0x561952206420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 -- 172.21.15.6:0/2501203283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 msgr2=0x5619521ff3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x5619521ff3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.094+0000 7f065e59c700 1 -- 172.21.15.6:0/2501203283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660108a50 con 0x5619521f5a00 2023-09-13T09:42:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f065e59c700 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f5a00 0x5619521feea0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0654009d10 tx=0x7f0654003f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8316611a582bf9d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0645ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:23.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0645ffb700 1 -- 172.21.15.6:0/2501203283 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0654005350 con 0x5619521f5a00 2023-09-13T09:42:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0645ffb700 1 -- 172.21.15.6:0/2501203283 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0654004870 con 0x5619521f5a00 2023-09-13T09:42:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619521e8670 con 0x5619521f5a00 2023-09-13T09:42:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0645ffb700 1 -- 172.21.15.6:0/2501203283 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0654004a30 con 0x5619521f5a00 2023-09-13T09:42:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 10 client.16173 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:23.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x56195215f7a0 con 0x5619521f5a00 2023-09-13T09:42:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0645ffb700 1 -- 172.21.15.6:0/2501203283 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619521e8670 con 0x5619521f5a00 2023-09-13T09:42:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0645ffb700 1 -- 172.21.15.6:0/2501203283 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f065402fbd0 con 0x5619521f5a00 2023-09-13T09:42:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 10 client.16173 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 10 client.16173 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:42:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 20 client.16173 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:23.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195220a8b0 0x56195220ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 4 client.16173 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:23.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.095+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561952140970 con 0x56195220a8b0 2023-09-13T09:42:23.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.096+0000 7f065dd9b700 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195220a8b0 0x56195220ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.096+0000 7f0645ffb700 10 client.16173 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:23.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.096+0000 7f065dd9b700 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195220a8b0 0x56195220ccd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fea2f741ffa61668 server_cookie=615f6e537b0c4ac3 in_seq=0 out_seq=0 2023-09-13T09:42:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0645ffb700 1 -- 172.21.15.6:0/2501203283 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561952140970 con 0x56195220a8b0 2023-09-13T09:42:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0645ffb700 10 client.16173 handle_command_reply: tid=0 2023-09-13T09:42:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 client.16173 shutdown 2023-09-13T09:42:23.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f5a00 msgr2=0x5619521feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f5a00 0x5619521feea0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f0654009d10 tx=0x7f0654003f40 comp rx=0 tx=0).stop 2023-09-13T09:42:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 shutdown_connections 2023-09-13T09:42:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195220a8b0 0x56195220ccd0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f7060 0x561952206420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f5a00 0x5619521feea0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0645ffb700 0 client.16173 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2501203283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x5619521ff3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 >> 172.21.15.6:0/2501203283 conn(0x561952153c80 msgr2=0x5619521ea7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 shutdown_connections 2023-09-13T09:42:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 1 -- 172.21.15.6:0/2501203283 wait complete. 2023-09-13T09:42:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.097+0000 7f0670c88b80 20 client.16173 trim_cache size 0 max 16384 2023-09-13T09:42:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 Processor -- start 2023-09-13T09:42:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 -- start start 2023-09-13T09:42:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x5619521f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x56195220cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x5619522063e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619521ec8e0 con 0x5619521f7060 2023-09-13T09:42:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619521fd880 con 0x5619521f6700 2023-09-13T09:42:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f0670c88b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619522119f0 con 0x5619521f5a00 2023-09-13T09:42:23.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x5619522063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x5619522063e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35658/0 (socket says 172.21.15.6:35658) 2023-09-13T09:42:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 -- 172.21.15.6:0/2180295545 learned_addr learned my addr 172.21.15.6:0/2180295545 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065dd9b700 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x56195220cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 -- 172.21.15.6:0/2180295545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 msgr2=0x5619521f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x5619521f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 -- 172.21.15.6:0/2180295545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 msgr2=0x56195220cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x56195220cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065ed9d700 1 -- 172.21.15.6:0/2180295545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561951f73de0 con 0x5619521f7060 2023-09-13T09:42:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.110+0000 7f065dd9b700 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x56195220cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:23.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x5619522063e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0658008f80 tx=0x7f0658007660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6c60ec0cee1d35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f064d7fa700 1 -- 172.21.15.6:0/2180295545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580143f0 con 0x5619521f7060 2023-09-13T09:42:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f064d7fa700 1 -- 172.21.15.6:0/2180295545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f065800e030 con 0x5619521f7060 2023-09-13T09:42:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f064d7fa700 1 -- 172.21.15.6:0/2180295545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06580138c0 con 0x5619521f7060 2023-09-13T09:42:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 -- 172.21.15.6:0/2180295545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 msgr2=0x5619522063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x5619522063e0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0658008f80 tx=0x7f0658007660 comp rx=0 tx=0).stop 2023-09-13T09:42:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 -- 172.21.15.6:0/2180295545 shutdown_connections 2023-09-13T09:42:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x5619522063e0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x5619521f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2180295545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x56195220cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 -- 172.21.15.6:0/2180295545 >> 172.21.15.6:0/2180295545 conn(0x561952153c80 msgr2=0x5619521efee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 -- 172.21.15.6:0/2180295545 shutdown_connections 2023-09-13T09:42:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.111+0000 7f0670c88b80 1 -- 172.21.15.6:0/2180295545 wait complete. 2023-09-13T09:42:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 -- start start 2023-09-13T09:42:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 Processor -- start 2023-09-13T09:42:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x561952201ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x561952202410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x561952205430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952205970 con 0x5619521f7060 2023-09-13T09:42:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952205ae0 con 0x5619521f6700 2023-09-13T09:42:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561952205ca0 con 0x5619521f5a00 2023-09-13T09:42:23.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0670c88b80 10 client.0 _ll_register_callbacks cb 0x5619520e3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x561952205430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x561952205430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35664/0 (socket says 172.21.15.6:35664) 2023-09-13T09:42:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 -- 172.21.15.6:0/2682013642 learned_addr learned my addr 172.21.15.6:0/2682013642 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 -- 172.21.15.6:0/2682013642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 msgr2=0x561952201ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x561952201ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 -- 172.21.15.6:0/2682013642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 msgr2=0x561952202410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065dd9b700 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x561952202410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x561952202410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 -- 172.21.15.6:0/2682013642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0658008bb0 con 0x5619521f7060 2023-09-13T09:42:23.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f065ed9d700 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x561952205430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0658014690 tx=0x7f0658014770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb81b1d2119ba48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.112+0000 7f0645ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:23.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0645ffb700 1 -- 172.21.15.6:0/2682013642 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0658013800 con 0x5619521f7060 2023-09-13T09:42:23.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0645ffb700 1 -- 172.21.15.6:0/2682013642 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0658013960 con 0x5619521f7060 2023-09-13T09:42:23.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619521f13b0 con 0x5619521f7060 2023-09-13T09:42:23.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0645ffb700 1 -- 172.21.15.6:0/2682013642 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0658014c50 con 0x5619521f7060 2023-09-13T09:42:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 10 client.16179 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x561951f5cc60 con 0x5619521f7060 2023-09-13T09:42:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0645ffb700 1 -- 172.21.15.6:0/2682013642 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619521f13b0 con 0x5619521f7060 2023-09-13T09:42:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0645ffb700 1 -- 172.21.15.6:0/2682013642 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0658013070 con 0x5619521f7060 2023-09-13T09:42:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 10 client.16179 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 10 client.16179 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:42:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 20 client.16179 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195225f2f0 0x561952261710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 4 client.16179 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x7f065401e040 con 0x56195225f2f0 2023-09-13T09:42:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.113+0000 7f065e59c700 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195225f2f0 0x561952261710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0645ffb700 10 client.16179 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f065e59c700 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195225f2f0 0x561952261710 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f826b7ad8b571b7 server_cookie=d1139b8d7847c65a in_seq=0 out_seq=0 2023-09-13T09:42:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0645ffb700 1 -- 172.21.15.6:0/2682013642 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x7f065401e040 con 0x56195225f2f0 2023-09-13T09:42:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0645ffb700 10 client.16179 handle_command_reply: tid=0 2023-09-13T09:42:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 client.16179 shutdown 2023-09-13T09:42:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 msgr2=0x561952205430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x561952205430 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f0658014690 tx=0x7f0658014770 comp rx=0 tx=0).stop 2023-09-13T09:42:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 shutdown_connections 2023-09-13T09:42:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56195225f2f0 0x561952261710 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619521f7060 0x561952205430 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0645ffb700 0 client.16179 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619521f5a00 0x561952201ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 --2- 172.21.15.6:0/2682013642 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619521f6700 0x561952202410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 >> 172.21.15.6:0/2682013642 conn(0x561952153c80 msgr2=0x5619521fdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 shutdown_connections 2023-09-13T09:42:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 1 -- 172.21.15.6:0/2682013642 wait complete. 2023-09-13T09:42:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.114+0000 7f0670c88b80 20 client.16179 trim_cache size 0 max 16384 2023-09-13T09:42:23.143 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06480a2850 msgr2=0x7f06480a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06480a2850 0x7f06480a4d10 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f0654009f50 tx=0x7f065400b540 comp rx=0 tx=0).stop 2023-09-13T09:42:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660100eb0 msgr2=0x7f0660194e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660100eb0 0x7f0660194e00 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f065000d950 tx=0x7f065000dc60 comp rx=0 tx=0).stop 2023-09-13T09:42:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 shutdown_connections 2023-09-13T09:42:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0660101850 0x7f066019be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f06600ffcc0 0x7f06601948c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f06480a2850 0x7f06480a4d10 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 --2- 172.21.15.6:0/372219374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0660100eb0 0x7f0660194e00 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 >> 172.21.15.6:0/372219374 conn(0x7f06600fb250 msgr2=0x7f06601043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 shutdown_connections 2023-09-13T09:42:23.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.115+0000 7f0664aa3700 1 -- 172.21.15.6:0/372219374 wait complete. 2023-09-13T09:42:23.147 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:22 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2045949034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:42:23.148 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:42:23.151 INFO:tasks.workunit.client.0.smithi006.stdout: 1 85967 4.66 MB/sec warmup 103 sec latency 921.629 ms 2023-09-13T09:42:23.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:22 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2045949034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:42:23.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:22 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2045949034' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:42:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 -- 172.21.15.6:0/816583419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9610100290 msgr2=0x7f9610108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 --2- 172.21.15.6:0/816583419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9610100290 0x7f9610108120 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f960800b0a0 tx=0x7f960800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 -- 172.21.15.6:0/816583419 shutdown_connections 2023-09-13T09:42:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 --2- 172.21.15.6:0/816583419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9610100290 0x7f9610108120 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 --2- 172.21.15.6:0/816583419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96101013c0 0x7f96101017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 --2- 172.21.15.6:0/816583419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96100ff8f0 0x7f96100ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 -- 172.21.15.6:0/816583419 >> 172.21.15.6:0/816583419 conn(0x7f96100fb250 msgr2=0x7f96100fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 -- 172.21.15.6:0/816583419 shutdown_connections 2023-09-13T09:42:23.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.275+0000 7f9615c66700 1 -- 172.21.15.6:0/816583419 wait complete. 2023-09-13T09:42:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 Processor -- start 2023-09-13T09:42:23.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 -- start start 2023-09-13T09:42:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96100ff8f0 0x7f9610195b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9610100290 0x7f9610196070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96101013c0 0x7f961019d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961019d6b0 con 0x7f96101013c0 2023-09-13T09:42:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961019d7f0 con 0x7f96100ff8f0 2023-09-13T09:42:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f9615c66700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f961019d980 con 0x7f9610100290 2023-09-13T09:42:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f960ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96101013c0 0x7f961019d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f960ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96101013c0 0x7f961019d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35678/0 (socket says 172.21.15.6:35678) 2023-09-13T09:42:23.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f960ffff700 1 -- 172.21.15.6:0/4035089322 learned_addr learned my addr 172.21.15.6:0/4035089322 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.276+0000 7f960effd700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9610100290 0x7f9610196070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960f7fe700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96100ff8f0 0x7f9610195b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960ffff700 1 -- 172.21.15.6:0/4035089322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9610100290 msgr2=0x7f9610196070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960ffff700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9610100290 0x7f9610196070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960ffff700 1 -- 172.21.15.6:0/4035089322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96100ff8f0 msgr2=0x7f9610195b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960ffff700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96100ff8f0 0x7f9610195b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960ffff700 1 -- 172.21.15.6:0/4035089322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608009d00 con 0x7f96101013c0 2023-09-13T09:42:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960effd700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9610100290 0x7f9610196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960f7fe700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96100ff8f0 0x7f9610195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960ffff700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96101013c0 0x7f961019d0e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9608009fd0 tx=0x7f960800bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960cff9700 1 -- 172.21.15.6:0/4035089322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960800e040 con 0x7f96101013c0 2023-09-13T09:42:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960cff9700 1 -- 172.21.15.6:0/4035089322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9608003e10 con 0x7f96101013c0 2023-09-13T09:42:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f961019dc00 con 0x7f96101013c0 2023-09-13T09:42:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f960cff9700 1 -- 172.21.15.6:0/4035089322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960801b7e0 con 0x7f96101013c0 2023-09-13T09:42:23.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.277+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f961019e080 con 0x7f96101013c0 2023-09-13T09:42:23.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.280+0000 7f960cff9700 1 -- 172.21.15.6:0/4035089322 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f960801da30 con 0x7f96101013c0 2023-09-13T09:42:23.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.280+0000 7f960cff9700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f95f80a06c0 0x7f95f80a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.280+0000 7f960cff9700 1 -- 172.21.15.6:0/4035089322 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96080ccde0 con 0x7f96101013c0 2023-09-13T09:42:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.280+0000 7f960f7fe700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f95f80a06c0 0x7f95f80a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 Processor -- start 2023-09-13T09:42:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 -- start start 2023-09-13T09:42:23.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f95f80a06c0 0x7f95f80a2b80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9600005fd0 tx=0x7f9600005e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a5070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c676fb780 con 0x558c677a5910 2023-09-13T09:42:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c676f90a0 con 0x558c677a4c10 2023-09-13T09:42:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c676f4990 con 0x558c677a6270 2023-09-13T09:42:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677a5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35682/0 (socket says 172.21.15.6:35682) 2023-09-13T09:42:23.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 -- 172.21.15.6:0/1284436718 learned_addr learned my addr 172.21.15.6:0/1284436718 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960ffff700 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 -- 172.21.15.6:0/1284436718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 msgr2=0x558c677a46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960effd700 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677a46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 -- 172.21.15.6:0/1284436718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 msgr2=0x558c677a5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960f7fe700 1 -- 172.21.15.6:0/1284436718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c67574630 con 0x558c677a5910 2023-09-13T09:42:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960ffff700 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.281+0000 7f960effd700 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:23.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f960f7fe700 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677a5d30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9600008930 tx=0x7f9600008f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad1ad52444d5c728 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f95f5ffb700 1 -- 172.21.15.6:0/1284436718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000fa10 con 0x558c677a5910 2023-09-13T09:42:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f95f5ffb700 1 -- 172.21.15.6:0/1284436718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f960000fb70 con 0x558c677a5910 2023-09-13T09:42:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f95f5ffb700 1 -- 172.21.15.6:0/1284436718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960001b610 con 0x558c677a5910 2023-09-13T09:42:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1284436718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 msgr2=0x558c677a5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677a5d30 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f9600008930 tx=0x7f9600008f90 comp rx=0 tx=0).stop 2023-09-13T09:42:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1284436718 shutdown_connections 2023-09-13T09:42:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677a5d30 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1284436718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677a46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.282+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1284436718 >> 172.21.15.6:0/1284436718 conn(0x558c67700c80 msgr2=0x558c6779cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1284436718 shutdown_connections 2023-09-13T09:42:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1284436718 wait complete. 2023-09-13T09:42:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 -- start start 2023-09-13T09:42:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 Processor -- start 2023-09-13T09:42:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a4c10 0x558c677ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677ae600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a6270 0x558c677b5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c67692bb0 con 0x558c677a5910 2023-09-13T09:42:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c676928b0 con 0x558c677a6270 2023-09-13T09:42:23.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c67576920 con 0x558c677a4c10 2023-09-13T09:42:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.283+0000 7f9621e4bb80 10 client.0 _ll_register_callbacks cb 0x558c67690680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677ae600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677ae600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35690/0 (socket says 172.21.15.6:35690) 2023-09-13T09:42:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 -- 172.21.15.6:0/1882709799 learned_addr learned my addr 172.21.15.6:0/1882709799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960f7fe700 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a4c10 0x558c677ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960ffff700 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a6270 0x558c677b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 -- 172.21.15.6:0/1882709799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a4c10 msgr2=0x558c677ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a4c10 0x558c677ae0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 -- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a6270 msgr2=0x558c677b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a6270 0x558c677b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 -- 172.21.15.6:0/1882709799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960000d960 con 0x558c677a5910 2023-09-13T09:42:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f960effd700 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677ae600 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96040127f0 tx=0x7f9604012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e694b360becb00b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f95eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f95eeffd700 1 -- 172.21.15.6:0/1882709799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604010800 con 0x558c677a5910 2023-09-13T09:42:23.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f95eeffd700 1 -- 172.21.15.6:0/1882709799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9604010960 con 0x558c677a5910 2023-09-13T09:42:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c67795670 con 0x558c677a5910 2023-09-13T09:42:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f95eeffd700 1 -- 172.21.15.6:0/1882709799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9604010b20 con 0x558c677a5910 2023-09-13T09:42:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f9621e4bb80 10 client.16191 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.284+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558c6770c7a0 con 0x558c677a5910 2023-09-13T09:42:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f95eeffd700 1 -- 172.21.15.6:0/1882709799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558c67795670 con 0x558c677a5910 2023-09-13T09:42:23.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f95eeffd700 1 -- 172.21.15.6:0/1882709799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f96040243e0 con 0x558c677a5910 2023-09-13T09:42:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f9621e4bb80 10 client.16191 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f9621e4bb80 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f9621e4bb80 20 client.16191 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c677b9f10 0x558c677bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f9621e4bb80 4 client.16191 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c676ed970 con 0x558c677b9f10 2023-09-13T09:42:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.285+0000 7f960f7fe700 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c677b9f10 0x558c677bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f95eeffd700 10 client.16191 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f960f7fe700 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c677b9f10 0x558c677bc330 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b51bafe3852b3ee server_cookie=478b88b115496626 in_seq=0 out_seq=0 2023-09-13T09:42:23.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f95eeffd700 1 -- 172.21.15.6:0/1882709799 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c676ed970 con 0x558c677b9f10 2023-09-13T09:42:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f95eeffd700 10 client.16191 handle_command_reply: tid=0 2023-09-13T09:42:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f9621e4bb80 1 client.16191 shutdown 2023-09-13T09:42:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 msgr2=0x558c677ae600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677ae600 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96040127f0 tx=0x7f9604012b00 comp rx=0 tx=0).stop 2023-09-13T09:42:23.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 shutdown_connections 2023-09-13T09:42:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.286+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a6270 0x558c677b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a4c10 0x558c677ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c677b9f10 0x558c677bc330 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/1882709799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c677ae600 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f95eeffd700 0 client.16191 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:23.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 >> 172.21.15.6:0/1882709799 conn(0x558c67700c80 msgr2=0x558c677977f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 shutdown_connections 2023-09-13T09:42:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f9621e4bb80 1 -- 172.21.15.6:0/1882709799 wait complete. 2023-09-13T09:42:23.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.287+0000 7f9621e4bb80 20 client.16191 trim_cache size 0 max 16384 2023-09-13T09:42:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.299+0000 7f9621e4bb80 1 Processor -- start 2023-09-13T09:42:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f9621e4bb80 1 -- start start 2023-09-13T09:42:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c6779dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c6779ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c677aed40 con 0x558c677a5910 2023-09-13T09:42:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c677b7220 con 0x558c677a4c10 2023-09-13T09:42:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c677a44d0 con 0x558c677a6270 2023-09-13T09:42:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c6779ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c6779ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35696/0 (socket says 172.21.15.6:35696) 2023-09-13T09:42:23.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 -- 172.21.15.6:0/13583443 learned_addr learned my addr 172.21.15.6:0/13583443 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960f7fe700 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c6779dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 -- 172.21.15.6:0/13583443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 msgr2=0x558c677ae0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 -- 172.21.15.6:0/13583443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 msgr2=0x558c6779dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c6779dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 -- 172.21.15.6:0/13583443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c67520de0 con 0x558c677a5910 2023-09-13T09:42:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960f7fe700 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c6779dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f960effd700 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c6779ce60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9604000c00 tx=0x7f9604009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a692992d2c569c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f95f67fc700 1 -- 172.21.15.6:0/13583443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604010270 con 0x558c677a5910 2023-09-13T09:42:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f95f67fc700 1 -- 172.21.15.6:0/13583443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9604024e70 con 0x558c677a5910 2023-09-13T09:42:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.300+0000 7f95f67fc700 1 -- 172.21.15.6:0/13583443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604010a60 con 0x558c677a5910 2023-09-13T09:42:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 -- 172.21.15.6:0/13583443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 msgr2=0x558c6779ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c6779ce60 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f9604000c00 tx=0x7f9604009880 comp rx=0 tx=0).stop 2023-09-13T09:42:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 -- 172.21.15.6:0/13583443 shutdown_connections 2023-09-13T09:42:23.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a6270 0x558c677ae0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c6779dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/13583443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a5910 0x558c6779ce60 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 -- 172.21.15.6:0/13583443 >> 172.21.15.6:0/13583443 conn(0x558c67700c80 msgr2=0x558c677ace50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 -- 172.21.15.6:0/13583443 shutdown_connections 2023-09-13T09:42:23.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 -- 172.21.15.6:0/13583443 wait complete. 2023-09-13T09:42:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.301+0000 7f9621e4bb80 1 -- start start 2023-09-13T09:42:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 1 Processor -- start 2023-09-13T09:42:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a5910 0x558c677a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a6270 0x558c677a3130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c677a3670 con 0x558c677a6270 2023-09-13T09:42:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c677a37e0 con 0x558c677a4c10 2023-09-13T09:42:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c677a39a0 con 0x558c677a5910 2023-09-13T09:42:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f9621e4bb80 10 client.0 _ll_register_callbacks cb 0x558c67690680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a6270 0x558c677a3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a6270 0x558c677a3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35706/0 (socket says 172.21.15.6:35706) 2023-09-13T09:42:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 -- 172.21.15.6:0/51722078 learned_addr learned my addr 172.21.15.6:0/51722078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960effd700 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a5910 0x558c677a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960f7fe700 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 -- 172.21.15.6:0/51722078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a5910 msgr2=0x558c677a22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a5910 0x558c677a22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 -- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 msgr2=0x558c677a1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.302+0000 7f960ffff700 1 -- 172.21.15.6:0/51722078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558c6770c7a0 con 0x558c677a6270 2023-09-13T09:42:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f960ffff700 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a6270 0x558c677a3130 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f960809a5a0 tx=0x7f96080099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db9391977c2c0e03 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:23.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f95eeffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:23.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f95eeffd700 1 -- 172.21.15.6:0/51722078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960809ad10 con 0x558c677a6270 2023-09-13T09:42:23.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f95eeffd700 1 -- 172.21.15.6:0/51722078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f960809a610 con 0x558c677a6270 2023-09-13T09:42:23.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f960000fb70 con 0x558c677a6270 2023-09-13T09:42:23.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f95eeffd700 1 -- 172.21.15.6:0/51722078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f960809e440 con 0x558c677a6270 2023-09-13T09:42:23.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 10 client.16197 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:23.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x558c67509c60 con 0x558c677a6270 2023-09-13T09:42:23.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f95eeffd700 1 -- 172.21.15.6:0/51722078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f960000fb70 con 0x558c677a6270 2023-09-13T09:42:23.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f95eeffd700 1 -- 172.21.15.6:0/51722078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9608099b90 con 0x558c677a6270 2023-09-13T09:42:23.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 10 client.16197 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:23.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:23.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 20 client.16197 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:23.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c678109d0 0x558c67812df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:23.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 4 client.16197 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:23.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558c676ae050 con 0x558c678109d0 2023-09-13T09:42:23.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.303+0000 7f960f7fe700 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c678109d0 0x558c67812df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:23.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f95eeffd700 10 client.16197 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:23.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f960f7fe700 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c678109d0 0x558c67812df0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35b7098930cad8a5 server_cookie=aff44a7c5ebdff2a in_seq=0 out_seq=0 2023-09-13T09:42:23.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f95eeffd700 1 -- 172.21.15.6:0/51722078 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558c676ae050 con 0x558c678109d0 2023-09-13T09:42:23.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f95eeffd700 10 client.16197 handle_command_reply: tid=0 2023-09-13T09:42:23.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 client.16197 shutdown 2023-09-13T09:42:23.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a6270 msgr2=0x558c677a3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a6270 0x558c677a3130 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f960809a5a0 tx=0x7f96080099e0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 shutdown_connections 2023-09-13T09:42:23.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c678109d0 0x558c67812df0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c677a6270 0x558c677a3130 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c677a4c10 0x558c677a1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 --2- 172.21.15.6:0/51722078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c677a5910 0x558c677a22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 >> 172.21.15.6:0/51722078 conn(0x558c67700c80 msgr2=0x558c677ace50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f95eeffd700 0 client.16197 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 shutdown_connections 2023-09-13T09:42:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 1 -- 172.21.15.6:0/51722078 wait complete. 2023-09-13T09:42:23.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.304+0000 7f9621e4bb80 20 client.16197 trim_cache size 0 max 16384 2023-09-13T09:42:23.332 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:23.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f95f80a06c0 msgr2=0x7f95f80a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f95f80a06c0 0x7f95f80a2b80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f9600005fd0 tx=0x7f9600005e40 comp rx=0 tx=0).stop 2023-09-13T09:42:23.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96101013c0 msgr2=0x7f961019d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:23.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96101013c0 0x7f961019d0e0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f9608009fd0 tx=0x7f960800bd90 comp rx=0 tx=0).stop 2023-09-13T09:42:23.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 shutdown_connections 2023-09-13T09:42:23.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f95f80a06c0 0x7f95f80a2b80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96101013c0 0x7f961019d0e0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96100ff8f0 0x7f9610195b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 --2- 172.21.15.6:0/4035089322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9610100290 0x7f9610196070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 >> 172.21.15.6:0/4035089322 conn(0x7f96100fb250 msgr2=0x7f96100fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 shutdown_connections 2023-09-13T09:42:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:23.305+0000 7f9615c66700 1 -- 172.21.15.6:0/4035089322 wait complete. 2023-09-13T09:42:24.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 85967 4.62 MB/sec warmup 104 sec latency 1921.735 ms 2023-09-13T09:42:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:23 smithi006 ceph-mon[98665]: pgmap v386: 97 pgs: 97 active+clean; 51 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 945 KiB/s wr, 131 op/s 2023-09-13T09:42:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:23 smithi053 ceph-mon[102373]: pgmap v386: 97 pgs: 97 active+clean; 51 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 945 KiB/s wr, 131 op/s 2023-09-13T09:42:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:23 smithi131 ceph-mon[102785]: pgmap v386: 97 pgs: 97 active+clean; 51 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 945 KiB/s wr, 131 op/s 2023-09-13T09:42:24.338 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:42:24.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:42:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 -- 172.21.15.6:0/3055655851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4100eb0 msgr2=0x7f5ad4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 --2- 172.21.15.6:0/3055655851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4100eb0 0x7f5ad4101310 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f5ac80099c0 tx=0x7f5ac8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 -- 172.21.15.6:0/3055655851 shutdown_connections 2023-09-13T09:42:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 --2- 172.21.15.6:0/3055655851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad4101850 0x7f5ad4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 --2- 172.21.15.6:0/3055655851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ad40ffcc0 0x7f5ad41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 --2- 172.21.15.6:0/3055655851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4100eb0 0x7f5ad4101310 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 -- 172.21.15.6:0/3055655851 >> 172.21.15.6:0/3055655851 conn(0x7f5ad40fb250 msgr2=0x7f5ad40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 -- 172.21.15.6:0/3055655851 shutdown_connections 2023-09-13T09:42:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 -- 172.21.15.6:0/3055655851 wait complete. 2023-09-13T09:42:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 Processor -- start 2023-09-13T09:42:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.483+0000 7f5ada98a700 1 -- start start 2023-09-13T09:42:24.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ada98a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40ffcc0 0x7f5ad4194830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ada98a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ad4100eb0 0x7f5ad4194d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ada98a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4101850 0x7f5ad419bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ada98a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad419c3b0 con 0x7f5ad4101850 2023-09-13T09:42:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ada98a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad419c4f0 con 0x7f5ad40ffcc0 2023-09-13T09:42:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ada98a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad419c680 con 0x7f5ad4100eb0 2023-09-13T09:42:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4101850 0x7f5ad419bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4101850 0x7f5ad419bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35720/0 (socket says 172.21.15.6:35720) 2023-09-13T09:42:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 -- 172.21.15.6:0/1170759727 learned_addr learned my addr 172.21.15.6:0/1170759727 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40ffcc0 0x7f5ad4194830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 -- 172.21.15.6:0/1170759727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ad4100eb0 msgr2=0x7f5ad4194d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ad4100eb0 0x7f5ad4194d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ad4100eb0 0x7f5ad4194d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 -- 172.21.15.6:0/1170759727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40ffcc0 msgr2=0x7f5ad4194830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40ffcc0 0x7f5ad4194830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 -- 172.21.15.6:0/1170759727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac80095f0 con 0x7f5ad4101850 2023-09-13T09:42:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ad4100eb0 0x7f5ad4194d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:24.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.484+0000 7f5ad8f27700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4101850 0x7f5ad419bde0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5acc007ee0 tx=0x7f5acc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.485+0000 7f5ad17fa700 1 -- 172.21.15.6:0/1170759727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc017070 con 0x7f5ad4101850 2023-09-13T09:42:24.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.485+0000 7f5ad17fa700 1 -- 172.21.15.6:0/1170759727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5acc00f040 con 0x7f5ad4101850 2023-09-13T09:42:24.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.485+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad419c960 con 0x7f5ad4101850 2023-09-13T09:42:24.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.485+0000 7f5ad17fa700 1 -- 172.21.15.6:0/1170759727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5acc005740 con 0x7f5ad4101850 2023-09-13T09:42:24.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.485+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad419ce20 con 0x7f5ad4101850 2023-09-13T09:42:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 Processor -- start 2023-09-13T09:42:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ad17fa700 1 -- 172.21.15.6:0/1170759727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5acc0058a0 con 0x7f5ad4101850 2023-09-13T09:42:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 -- start start 2023-09-13T09:42:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c1b90 0x5614d38c1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c0e90 0x5614d38c12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d3815800 con 0x5614d38c0e90 2023-09-13T09:42:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d3813120 con 0x5614d38c1b90 2023-09-13T09:42:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d380ea10 con 0x5614d38c24f0 2023-09-13T09:42:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c0e90 0x5614d38c12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ad37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c0e90 0x5614d38c12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35726/0 (socket says 172.21.15.6:35726) 2023-09-13T09:42:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ad37fe700 1 -- 172.21.15.6:0/2999738808 learned_addr learned my addr 172.21.15.6:0/2999738808 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c1b90 0x5614d38c1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.489+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad17fa700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5abc0a0650 0x7f5abc0a2b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad37fe700 1 -- 172.21.15.6:0/2999738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 msgr2=0x5614d38c0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad37fe700 1 -- 172.21.15.6:0/2999738808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c1b90 msgr2=0x5614d38c1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c1b90 0x5614d38c1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad37fe700 1 -- 172.21.15.6:0/2999738808 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614d368e6b0 con 0x5614d38c0e90 2023-09-13T09:42:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad8f27700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5abc0a0650 0x7f5abc0a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c0e90 0x5614d38c12f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8006010 tx=0x7f5ac8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f47ee6ad9ef2f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5ad17fa700 1 -- 172.21.15.6:0/1170759727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5acc0cb4f0 con 0x7f5ad4101850 2023-09-13T09:42:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5aba7fc700 1 -- 172.21.15.6:0/2999738808 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac800ba90 con 0x5614d38c0e90 2023-09-13T09:42:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5aba7fc700 1 -- 172.21.15.6:0/2999738808 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac8004c80 con 0x5614d38c0e90 2023-09-13T09:42:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.490+0000 7f5aba7fc700 1 -- 172.21.15.6:0/2999738808 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8005300 con 0x5614d38c0e90 2023-09-13T09:42:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/2999738808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c0e90 msgr2=0x5614d38c12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ad8f27700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5abc0a0650 0x7f5abc0a2b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5acc098990 tx=0x7f5acc064510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c0e90 0x5614d38c12f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8006010 tx=0x7f5ac8000bc0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/2999738808 shutdown_connections 2023-09-13T09:42:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c0e90 0x5614d38c12f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c1b90 0x5614d38c1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/2999738808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/2999738808 >> 172.21.15.6:0/2999738808 conn(0x5614d381ad00 msgr2=0x5614d38b6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/2999738808 shutdown_connections 2023-09-13T09:42:24.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/2999738808 wait complete. 2023-09-13T09:42:24.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 -- start start 2023-09-13T09:42:24.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.491+0000 7f5ae6b6fb80 1 Processor -- start 2023-09-13T09:42:24.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38d1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d37acc30 con 0x5614d38c1b90 2023-09-13T09:42:24.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d37ac930 con 0x5614d38c24f0 2023-09-13T09:42:24.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d36909a0 con 0x5614d38c0e90 2023-09-13T09:42:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ae6b6fb80 10 client.0 _ll_register_callbacks cb 0x5614d37aa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35732/0 (socket says 172.21.15.6:35732) 2023-09-13T09:42:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3215563910 learned_addr learned my addr 172.21.15.6:0/3215563910 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3215563910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 msgr2=0x5614d38ca3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38ca3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3215563910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 msgr2=0x5614d38d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38d1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3215563910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad4108a50 con 0x5614d38c1b90 2023-09-13T09:42:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.492+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ca8e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4012480 tx=0x7f5ac4012840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e8ade7de40617f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ab37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ab37fe700 1 -- 172.21.15.6:0/3215563910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40107e0 con 0x5614d38c1b90 2023-09-13T09:42:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5614d38af6f0 con 0x5614d38c1b90 2023-09-13T09:42:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ab37fe700 1 -- 172.21.15.6:0/3215563910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ac4010940 con 0x5614d38c1b90 2023-09-13T09:42:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ab37fe700 1 -- 172.21.15.6:0/3215563910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ac4010b00 con 0x5614d38c1b90 2023-09-13T09:42:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 10 client.16209 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5614d3826820 con 0x5614d38c1b90 2023-09-13T09:42:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ab37fe700 1 -- 172.21.15.6:0/3215563910 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5614d38af6f0 con 0x5614d38c1b90 2023-09-13T09:42:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ab37fe700 1 -- 172.21.15.6:0/3215563910 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5ac401b440 con 0x5614d38c1b90 2023-09-13T09:42:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 10 client.16209 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 20 client.16209 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d38d62a0 0x5614d38d86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 4 client.16209 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.493+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5614d38079f0 con 0x5614d38d62a0 2023-09-13T09:42:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.494+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d38d62a0 0x5614d38d86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.494+0000 7f5ab37fe700 10 client.16209 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.494+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d38d62a0 0x5614d38d86c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fca693e2462da7 server_cookie=bef0b1a55c7ddb63 in_seq=0 out_seq=0 2023-09-13T09:42:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ab37fe700 1 -- 172.21.15.6:0/3215563910 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5614d38079f0 con 0x5614d38d62a0 2023-09-13T09:42:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ab37fe700 10 client.16209 handle_command_reply: tid=0 2023-09-13T09:42:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 client.16209 shutdown 2023-09-13T09:42:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 msgr2=0x5614d38ca8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ca8e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4012480 tx=0x7f5ac4012840 comp rx=0 tx=0).stop 2023-09-13T09:42:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 shutdown_connections 2023-09-13T09:42:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38d1920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38ca3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d38d62a0 0x5614d38d86c0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3215563910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ca8e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ab37fe700 0 client.16209 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 >> 172.21.15.6:0/3215563910 conn(0x5614d381ad00 msgr2=0x5614d38b6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 shutdown_connections 2023-09-13T09:42:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3215563910 wait complete. 2023-09-13T09:42:24.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.495+0000 7f5ae6b6fb80 20 client.16209 trim_cache size 0 max 16384 2023-09-13T09:42:24.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.512+0000 7f5ae6b6fb80 1 Processor -- start 2023-09-13T09:42:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.512+0000 7f5ae6b6fb80 1 -- start start 2023-09-13T09:42:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c0e90 0x5614d38c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d38b7890 con 0x5614d38c1b90 2023-09-13T09:42:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d38b7e30 con 0x5614d38c0e90 2023-09-13T09:42:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d38d3590 con 0x5614d38c24f0 2023-09-13T09:42:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35740/0 (socket says 172.21.15.6:35740) 2023-09-13T09:42:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3695043892 learned_addr learned my addr 172.21.15.6:0/3695043892 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c0e90 0x5614d38c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3695043892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 msgr2=0x5614d38c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3695043892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c0e90 msgr2=0x5614d38c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c0e90 0x5614d38c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 -- 172.21.15.6:0/3695043892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5614d38cb510 con 0x5614d38c1b90 2023-09-13T09:42:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c0e90 0x5614d38c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38d18e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5ac401b870 tx=0x7f5ac4012cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eabf9184e2dae260 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.513+0000 7f5abaffd700 1 -- 172.21.15.6:0/3695043892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac401b9e0 con 0x5614d38c1b90 2023-09-13T09:42:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5abaffd700 1 -- 172.21.15.6:0/3695043892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac4005040 con 0x5614d38c1b90 2023-09-13T09:42:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5abaffd700 1 -- 172.21.15.6:0/3695043892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4004950 con 0x5614d38c1b90 2023-09-13T09:42:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3695043892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 msgr2=0x5614d38d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38d18e0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5ac401b870 tx=0x7f5ac4012cc0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3695043892 shutdown_connections 2023-09-13T09:42:24.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c24f0 0x5614d38c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c0e90 0x5614d38c4e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/3695043892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38d18e0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3695043892 >> 172.21.15.6:0/3695043892 conn(0x5614d381ad00 msgr2=0x5614d38c9010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3695043892 shutdown_connections 2023-09-13T09:42:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/3695043892 wait complete. 2023-09-13T09:42:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.514+0000 7f5ae6b6fb80 1 -- start start 2023-09-13T09:42:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 1 Processor -- start 2023-09-13T09:42:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38d16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38ce680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d38cec60 con 0x5614d38c1b90 2023-09-13T09:42:24.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d392a0c0 con 0x5614d38c24f0 2023-09-13T09:42:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614d392a200 con 0x5614d38c0e90 2023-09-13T09:42:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ae6b6fb80 10 client.0 _ll_register_callbacks cb 0x5614d37aa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35746/0 (socket says 172.21.15.6:35746) 2023-09-13T09:42:24.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 -- 172.21.15.6:0/12493266 learned_addr learned my addr 172.21.15.6:0/12493266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38ce680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38d16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 -- 172.21.15.6:0/12493266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 msgr2=0x5614d38d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38d16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 -- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 msgr2=0x5614d38ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38ce680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad3fff700 1 -- 172.21.15.6:0/12493266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5614d3826820 con 0x5614d38c1b90 2023-09-13T09:42:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.515+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:42:24.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ad3fff700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ce140 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400ba20 tx=0x7f5ac401cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f1f42433e1b3d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ab37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ab37fe700 1 -- 172.21.15.6:0/12493266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac40055c0 con 0x5614d38c1b90 2023-09-13T09:42:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ab37fe700 1 -- 172.21.15.6:0/12493266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ac4000e40 con 0x5614d38c1b90 2023-09-13T09:42:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ac8004c80 con 0x5614d38c1b90 2023-09-13T09:42:24.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ab37fe700 1 -- 172.21.15.6:0/12493266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ac401b990 con 0x5614d38c1b90 2023-09-13T09:42:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 10 client.16215 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5614d363ae60 con 0x5614d38c1b90 2023-09-13T09:42:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ab37fe700 1 -- 172.21.15.6:0/12493266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac8004c80 con 0x5614d38c1b90 2023-09-13T09:42:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ab37fe700 1 -- 172.21.15.6:0/12493266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f5ac40105e0 con 0x5614d38c1b90 2023-09-13T09:42:24.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 10 client.16215 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 20 client.16215 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d392b920 0x5614d392dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 4 client.16215 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:42:24.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.516+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5614d37c80d0 con 0x5614d392b920 2023-09-13T09:42:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.517+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d392b920 0x5614d392dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.517+0000 7f5ab37fe700 10 client.16215 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.517+0000 7f5ad37fe700 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d392b920 0x5614d392dd40 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=496f5019302dd4b server_cookie=17ecfed330e83dd5 in_seq=0 out_seq=0 2023-09-13T09:42:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.518+0000 7f5ab37fe700 1 -- 172.21.15.6:0/12493266 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5614d37c80d0 con 0x5614d392b920 2023-09-13T09:42:24.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.518+0000 7f5ab37fe700 10 client.16215 handle_command_reply: tid=0 2023-09-13T09:42:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.518+0000 7f5ae6b6fb80 1 client.16215 shutdown 2023-09-13T09:42:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 msgr2=0x5614d38ce140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ce140 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5ac400ba20 tx=0x7f5ac401cfb0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 shutdown_connections 2023-09-13T09:42:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5614d38c24f0 0x5614d38ce680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5614d38c0e90 0x5614d38d16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5614d392b920 0x5614d392dd40 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 --2- 172.21.15.6:0/12493266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5614d38c1b90 0x5614d38ce140 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ab37fe700 0 client.16215 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 >> 172.21.15.6:0/12493266 conn(0x5614d381ad00 msgr2=0x5614d38c4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 shutdown_connections 2023-09-13T09:42:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 1 -- 172.21.15.6:0/12493266 wait complete. 2023-09-13T09:42:24.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ae6b6fb80 20 client.16215 trim_cache size 0 max 16384 2023-09-13T09:42:24.540 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:42:24.541 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:42:24.541 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "747309bc-c1f2-470f-9037-43ef04f571f9", 2023-09-13T09:42:24.541 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:42:24.541 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:42:24.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5abc0a0650 msgr2=0x7f5abc0a2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5abc0a0650 0x7f5abc0a2b10 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f5acc098990 tx=0x7f5acc064510 comp rx=0 tx=0).stop 2023-09-13T09:42:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4101850 msgr2=0x7f5ad419bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4101850 0x7f5ad419bde0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f5acc007ee0 tx=0x7f5acc00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 shutdown_connections 2023-09-13T09:42:24.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5abc0a0650 0x7f5abc0a2b10 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ad4101850 0x7f5ad419bde0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ad40ffcc0 0x7f5ad4194830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 --2- 172.21.15.6:0/1170759727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ad4100eb0 0x7f5ad4194d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.519+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 >> 172.21.15.6:0/1170759727 conn(0x7f5ad40fb250 msgr2=0x7f5ad40fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.520+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 shutdown_connections 2023-09-13T09:42:24.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.520+0000 7f5ada98a700 1 -- 172.21.15.6:0/1170759727 wait complete. 2023-09-13T09:42:24.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:42:24.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 -- 172.21.15.6:0/2537222886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330100eb0 msgr2=0x7f2330101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 --2- 172.21.15.6:0/2537222886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330100eb0 0x7f2330101310 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f23180099c0 tx=0x7f2318009cd0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 -- 172.21.15.6:0/2537222886 shutdown_connections 2023-09-13T09:42:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 --2- 172.21.15.6:0/2537222886 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2330101850 0x7f2330108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 --2- 172.21.15.6:0/2537222886 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f23300ffcc0 0x7f23301000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 --2- 172.21.15.6:0/2537222886 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330100eb0 0x7f2330101310 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 -- 172.21.15.6:0/2537222886 >> 172.21.15.6:0/2537222886 conn(0x7f23300fb250 msgr2=0x7f23300fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 -- 172.21.15.6:0/2537222886 shutdown_connections 2023-09-13T09:42:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.675+0000 7f23366c2700 1 -- 172.21.15.6:0/2537222886 wait complete. 2023-09-13T09:42:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 Processor -- start 2023-09-13T09:42:24.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 -- start start 2023-09-13T09:42:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23300ffcc0 0x7f2330198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2330100eb0 0x7f23301991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330101850 0x7f23301a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23301a07e0 con 0x7f2330101850 2023-09-13T09:42:24.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23301a0950 con 0x7f2330100eb0 2023-09-13T09:42:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f23366c2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23301a0b10 con 0x7f23300ffcc0 2023-09-13T09:42:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330101850 0x7f23301a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f232ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23300ffcc0 0x7f2330198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330101850 0x7f23301a0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35762/0 (socket says 172.21.15.6:35762) 2023-09-13T09:42:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f2334c5f700 1 -- 172.21.15.6:0/1463816352 learned_addr learned my addr 172.21.15.6:0/1463816352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.676+0000 7f232f7fe700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2330100eb0 0x7f23301991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f2334c5f700 1 -- 172.21.15.6:0/1463816352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23300ffcc0 msgr2=0x7f2330198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f2334c5f700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23300ffcc0 0x7f2330198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f2334c5f700 1 -- 172.21.15.6:0/1463816352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2330100eb0 msgr2=0x7f23301991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f2334c5f700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2330100eb0 0x7f23301991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f2334c5f700 1 -- 172.21.15.6:0/1463816352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23180095f0 con 0x7f2330101850 2023-09-13T09:42:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f232ffff700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23300ffcc0 0x7f2330198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f232f7fe700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2330100eb0 0x7f23301991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f2334c5f700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330101850 0x7f23301a0210 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f232800ef30 tx=0x7f232800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f232d7fa700 1 -- 172.21.15.6:0/1463816352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328018070 con 0x7f2330101850 2023-09-13T09:42:24.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23301a0d90 con 0x7f2330101850 2023-09-13T09:42:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23301a1260 con 0x7f2330101850 2023-09-13T09:42:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f232d7fa700 1 -- 172.21.15.6:0/1463816352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f232800f040 con 0x7f2330101850 2023-09-13T09:42:24.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.677+0000 7f232d7fa700 1 -- 172.21.15.6:0/1463816352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232800ccb0 con 0x7f2330101850 2023-09-13T09:42:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.680+0000 7f232d7fa700 1 -- 172.21.15.6:0/1463816352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2328004ad0 con 0x7f2330101850 2023-09-13T09:42:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.680+0000 7f232d7fa700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f231c0a0640 0x7f231c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.680+0000 7f232d7fa700 1 -- 172.21.15.6:0/1463816352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f23280cb570 con 0x7f2330101850 2023-09-13T09:42:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.680+0000 7f232ffff700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f231c0a0640 0x7f231c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f232ffff700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f231c0a0640 0x7f231c0a2b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2330199b40 tx=0x7f2320009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 Processor -- start 2023-09-13T09:42:24.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 -- start start 2023-09-13T09:42:24.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235660b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235661060 0x55723565f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55723565fa00 0x55723565fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572355b8780 con 0x55723565fa00 2023-09-13T09:42:24.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572355b60a0 con 0x557235660700 2023-09-13T09:42:24.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f23428a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572355b1990 con 0x557235661060 2023-09-13T09:42:24.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55723565fa00 0x55723565fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55723565fa00 0x55723565fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35770/0 (socket says 172.21.15.6:35770) 2023-09-13T09:42:24.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f2334c5f700 1 -- 172.21.15.6:0/2997111574 learned_addr learned my addr 172.21.15.6:0/2997111574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f232f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235661060 0x55723565f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.681+0000 7f232ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235660b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f232f7fe700 1 -- 172.21.15.6:0/2997111574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 msgr2=0x557235660b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f232f7fe700 1 --2- 172.21.15.6:0/2997111574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235660b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f232f7fe700 1 -- 172.21.15.6:0/2997111574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55723565fa00 msgr2=0x55723565fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f232f7fe700 1 --2- 172.21.15.6:0/2997111574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55723565fa00 0x55723565fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f232f7fe700 1 -- 172.21.15.6:0/2997111574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557235431630 con 0x557235661060 2023-09-13T09:42:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f232f7fe700 1 --2- 172.21.15.6:0/2997111574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235661060 0x55723565f4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2318009fd0 tx=0x7f2318005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb9836321dbe4fb7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f23267fc700 1 -- 172.21.15.6:0/2997111574 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231800bd40 con 0x557235661060 2023-09-13T09:42:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f23267fc700 1 -- 172.21.15.6:0/2997111574 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f231801e040 con 0x557235661060 2023-09-13T09:42:24.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.682+0000 7f23267fc700 1 -- 172.21.15.6:0/2997111574 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231800f460 con 0x557235661060 2023-09-13T09:42:24.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 -- 172.21.15.6:0/2997111574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235661060 msgr2=0x55723565f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2997111574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235661060 0x55723565f4c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2318009fd0 tx=0x7f2318005fb0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 -- 172.21.15.6:0/2997111574 shutdown_connections 2023-09-13T09:42:24.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2997111574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55723565fa00 0x55723565fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2997111574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235660b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2997111574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235661060 0x55723565f4c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 -- 172.21.15.6:0/2997111574 >> 172.21.15.6:0/2997111574 conn(0x5572355bdc80 msgr2=0x557235659f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 -- 172.21.15.6:0/2997111574 shutdown_connections 2023-09-13T09:42:24.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 -- 172.21.15.6:0/2997111574 wait complete. 2023-09-13T09:42:24.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 -- start start 2023-09-13T09:42:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.683+0000 7f23428a7b80 1 Processor -- start 2023-09-13T09:42:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x557235668ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235660700 0x557235669400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235661060 0x557235670440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55723554fbb0 con 0x557235661060 2023-09-13T09:42:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55723554f8b0 con 0x55723565fa00 2023-09-13T09:42:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557235433920 con 0x557235660700 2023-09-13T09:42:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 10 client.0 _ll_register_callbacks cb 0x55723554d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235661060 0x557235670440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f232f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235660700 0x557235669400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f232ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x557235668ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f232f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235660700 0x557235669400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:38828/0 (socket says 172.21.15.6:38828) 2023-09-13T09:42:24.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f232ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x557235668ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57528/0 (socket says 172.21.15.6:57528) 2023-09-13T09:42:24.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235661060 0x557235670440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35776/0 (socket says 172.21.15.6:35776) 2023-09-13T09:42:24.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f232f7fe700 1 -- 172.21.15.6:0/2132668678 learned_addr learned my addr 172.21.15.6:0/2132668678 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 -- 172.21.15.6:0/2132668678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235660700 msgr2=0x557235669400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235660700 0x557235669400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 -- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 msgr2=0x557235668ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x557235668ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 -- 172.21.15.6:0/2132668678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2330108a50 con 0x557235661060 2023-09-13T09:42:24.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f232ffff700 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x557235668ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f232f7fe700 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235660700 0x557235669400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f2334c5f700 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235661060 0x557235670440 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2328098d30 tx=0x7f23280992e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d440e763112df5d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f230f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f230f7fe700 1 -- 172.21.15.6:0/2132668678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2328098da0 con 0x557235661060 2023-09-13T09:42:24.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f230f7fe700 1 -- 172.21.15.6:0/2132668678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f232809cbd0 con 0x557235661060 2023-09-13T09:42:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.684+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557235652670 con 0x557235661060 2023-09-13T09:42:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f230f7fe700 1 -- 172.21.15.6:0/2132668678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23280a0d80 con 0x557235661060 2023-09-13T09:42:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 10 client.16227 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5572355c97a0 con 0x557235661060 2023-09-13T09:42:24.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f230f7fe700 1 -- 172.21.15.6:0/2132668678 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557235652670 con 0x557235661060 2023-09-13T09:42:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f230f7fe700 1 -- 172.21.15.6:0/2132668678 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f23280a0a10 con 0x557235661060 2023-09-13T09:42:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 10 client.16227 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 20 client.16227 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:24.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235674ba0 0x557235676fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 4 client.16227 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:24.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5572355aa970 con 0x557235674ba0 2023-09-13T09:42:24.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.685+0000 7f232ffff700 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235674ba0 0x557235676fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f230f7fe700 10 client.16227 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f232ffff700 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235674ba0 0x557235676fc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a85073465240de12 server_cookie=3eba85f49477db77 in_seq=0 out_seq=0 2023-09-13T09:42:24.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f230f7fe700 1 -- 172.21.15.6:0/2132668678 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5572355aa970 con 0x557235674ba0 2023-09-13T09:42:24.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f230f7fe700 10 client.16227 handle_command_reply: tid=0 2023-09-13T09:42:24.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f23428a7b80 1 client.16227 shutdown 2023-09-13T09:42:24.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235661060 msgr2=0x557235670440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235661060 0x557235670440 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2328098d30 tx=0x7f23280992e0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 shutdown_connections 2023-09-13T09:42:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.686+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235674ba0 0x557235676fc0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235661060 0x557235670440 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f230f7fe700 0 client.16227 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x557235668ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2132668678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557235660700 0x557235669400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 >> 172.21.15.6:0/2132668678 conn(0x5572355bdc80 msgr2=0x5572356547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 shutdown_connections 2023-09-13T09:42:24.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f23428a7b80 1 -- 172.21.15.6:0/2132668678 wait complete. 2023-09-13T09:42:24.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.687+0000 7f23428a7b80 20 client.16227 trim_cache size 0 max 16384 2023-09-13T09:42:24.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.705+0000 7f23428a7b80 1 Processor -- start 2023-09-13T09:42:24.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.705+0000 7f23428a7b80 1 -- start start 2023-09-13T09:42:24.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5572355bdc80 0x55723565f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55723565fa00 0x557235670400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235668c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f23428a7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572355aa970 con 0x5572355bdc80 2023-09-13T09:42:24.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f23428a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55723566a0b0 con 0x557235660700 2023-09-13T09:42:24.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f23428a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557235652650 con 0x55723565fa00 2023-09-13T09:42:24.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f232ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5572355bdc80 0x55723565f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f232ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5572355bdc80 0x55723565f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35780/0 (socket says 172.21.15.6:35780) 2023-09-13T09:42:24.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235668c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f232ffff700 1 -- 172.21.15.6:0/2713961981 learned_addr learned my addr 172.21.15.6:0/2713961981 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f232f7fe700 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55723565fa00 0x557235670400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f2334c5f700 1 -- 172.21.15.6:0/2713961981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55723565fa00 msgr2=0x557235670400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f2334c5f700 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55723565fa00 0x557235670400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f2334c5f700 1 -- 172.21.15.6:0/2713961981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5572355bdc80 msgr2=0x55723565f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f2334c5f700 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5572355bdc80 0x55723565f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f2334c5f700 1 -- 172.21.15.6:0/2713961981 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5572353ddde0 con 0x557235660700 2023-09-13T09:42:24.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.706+0000 7f2334c5f700 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235668c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23280090a0 tx=0x7f2328095040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ace9b36192bd32 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f2326ffd700 1 -- 172.21.15.6:0/2713961981 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f232809cbd0 con 0x557235660700 2023-09-13T09:42:24.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f2326ffd700 1 -- 172.21.15.6:0/2713961981 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2328094e50 con 0x557235660700 2023-09-13T09:42:24.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f2326ffd700 1 -- 172.21.15.6:0/2713961981 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23280a08f0 con 0x557235660700 2023-09-13T09:42:24.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 -- 172.21.15.6:0/2713961981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 msgr2=0x557235668c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235668c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23280090a0 tx=0x7f2328095040 comp rx=0 tx=0).stop 2023-09-13T09:42:24.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 -- 172.21.15.6:0/2713961981 shutdown_connections 2023-09-13T09:42:24.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557235660700 0x557235668c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5572355bdc80 0x55723565f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 --2- 172.21.15.6:0/2713961981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55723565fa00 0x557235670400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 -- 172.21.15.6:0/2713961981 >> 172.21.15.6:0/2713961981 conn(0x55723565a240 msgr2=0x5572356638e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.707+0000 7f23428a7b80 1 -- 172.21.15.6:0/2713961981 shutdown_connections 2023-09-13T09:42:24.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 -- 172.21.15.6:0/2713961981 wait complete. 2023-09-13T09:42:24.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 -- start start 2023-09-13T09:42:24.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 Processor -- start 2023-09-13T09:42:24.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572355bdc80 0x55723566c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x55723566cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235660700 0x55723566fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572356700a0 con 0x557235660700 2023-09-13T09:42:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557235670210 con 0x55723565fa00 2023-09-13T09:42:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5572356703d0 con 0x5572355bdc80 2023-09-13T09:42:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f23428a7b80 10 client.0 _ll_register_callbacks cb 0x55723554d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235660700 0x55723566fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f232f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x55723566cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f2334c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235660700 0x55723566fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35790/0 (socket says 172.21.15.6:35790) 2023-09-13T09:42:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f232ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572355bdc80 0x55723566c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.708+0000 7f2334c5f700 1 -- 172.21.15.6:0/945954869 learned_addr learned my addr 172.21.15.6:0/945954869 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f232f7fe700 1 -- 172.21.15.6:0/945954869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572355bdc80 msgr2=0x55723566c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f232f7fe700 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572355bdc80 0x55723566c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f232f7fe700 1 -- 172.21.15.6:0/945954869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235660700 msgr2=0x55723566fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f232f7fe700 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235660700 0x55723566fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f232f7fe700 1 -- 172.21.15.6:0/945954869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5572355c97a0 con 0x55723565fa00 2023-09-13T09:42:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f2334c5f700 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235660700 0x55723566fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:24.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f232ffff700 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572355bdc80 0x55723566c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f232f7fe700 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x55723566cb40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23180058e0 tx=0x7f2318009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a71555e8b7238748 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f230f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:42:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f230f7fe700 1 -- 172.21.15.6:0/945954869 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2318003be0 con 0x55723565fa00 2023-09-13T09:42:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f230f7fe700 1 -- 172.21.15.6:0/945954869 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2318003d40 con 0x55723565fa00 2023-09-13T09:42:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f231801e040 con 0x55723565fa00 2023-09-13T09:42:24.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f230f7fe700 1 -- 172.21.15.6:0/945954869 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f231800f460 con 0x55723565fa00 2023-09-13T09:42:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f23428a7b80 10 client.25718 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.709+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5572353c6c60 con 0x55723565fa00 2023-09-13T09:42:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f230f7fe700 1 -- 172.21.15.6:0/945954869 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2318040080 con 0x55723565fa00 2023-09-13T09:42:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f230f7fe700 1 -- 172.21.15.6:0/945954869 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f2318021070 con 0x55723565fa00 2023-09-13T09:42:24.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f23428a7b80 10 client.25718 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f23428a7b80 10 client.25718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f23428a7b80 20 client.25718 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f23428a7b80 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235661060 0x5572356d4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f23428a7b80 4 client.25718 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:42:24.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55723556b050 con 0x557235661060 2023-09-13T09:42:24.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f232ffff700 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235661060 0x5572356d4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:24.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f230f7fe700 10 client.25718 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.710+0000 7f232ffff700 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235661060 0x5572356d4150 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fcc96b442423f89 server_cookie=4dfc556a2aa7453b in_seq=0 out_seq=0 2023-09-13T09:42:24.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f230f7fe700 1 -- 172.21.15.6:0/945954869 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55723556b050 con 0x557235661060 2023-09-13T09:42:24.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f230f7fe700 10 client.25718 handle_command_reply: tid=0 2023-09-13T09:42:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 client.25718 shutdown 2023-09-13T09:42:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 msgr2=0x55723566cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x55723566cb40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f23180058e0 tx=0x7f2318009310 comp rx=0 tx=0).stop 2023-09-13T09:42:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 shutdown_connections 2023-09-13T09:42:24.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557235661060 0x5572356d4150 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557235660700 0x55723566fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5572355bdc80 0x55723566c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 --2- 172.21.15.6:0/945954869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55723565fa00 0x55723566cb40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f230f7fe700 0 client.25718 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:24.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 >> 172.21.15.6:0/945954869 conn(0x55723565a240 msgr2=0x557235668c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 shutdown_connections 2023-09-13T09:42:24.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 1 -- 172.21.15.6:0/945954869 wait complete. 2023-09-13T09:42:24.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.711+0000 7f23428a7b80 20 client.25718 trim_cache size 0 max 16384 2023-09-13T09:42:24.771 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:42:24.772 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:42:24.772 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:42:24.772 INFO:teuthology.orchestra.run.smithi006.stdout: "747309bc-c1f2-470f-9037-43ef04f571f9": { 2023-09-13T09:42:24.772 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:42:24.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "747309bc-c1f2-470f-9037-43ef04f571f9", 2023-09-13T09:42:24.773 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:42:24.773 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:42:24.773 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:42:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:42:24.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f231c0a0640 msgr2=0x7f231c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f231c0a0640 0x7f231c0a2b00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f2330199b40 tx=0x7f2320009260 comp rx=0 tx=0).stop 2023-09-13T09:42:24.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330101850 msgr2=0x7f23301a0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:24.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330101850 0x7f23301a0210 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f232800ef30 tx=0x7f232800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 shutdown_connections 2023-09-13T09:42:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f231c0a0640 0x7f231c0a2b00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2330101850 0x7f23301a0210 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23300ffcc0 0x7f2330198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 --2- 172.21.15.6:0/1463816352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2330100eb0 0x7f23301991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 >> 172.21.15.6:0/1463816352 conn(0x7f23300fb250 msgr2=0x7f23301067b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 shutdown_connections 2023-09-13T09:42:24.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:24.712+0000 7f23366c2700 1 -- 172.21.15.6:0/1463816352 wait complete. 2023-09-13T09:42:24.777 INFO:tasks.cephfs.filesystem:scrub status for tag:747309bc-c1f2-470f-9037-43ef04f571f9 - {'path': '/', 'tag': '747309bc-c1f2-470f-9037-43ef04f571f9', 'options': 'recursive,force'} 2023-09-13T09:42:25.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:25.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:25.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:25.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:25.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.008 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:24 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 87531 4.64 MB/sec warmup 105 sec latency 2335.723 ms 2023-09-13T09:42:25.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:25.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:25.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:25.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:25.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:24 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:24 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89098 4.71 MB/sec warmup 106 sec latency 12.735 ms 2023-09-13T09:42:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: pgmap v387: 97 pgs: 97 active+clean; 53 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.1 MiB/s wr, 143 op/s 2023-09-13T09:42:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:42:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:25 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: pgmap v387: 97 pgs: 97 active+clean; 53 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.1 MiB/s wr, 143 op/s 2023-09-13T09:42:26.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:42:26.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:26.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:26.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:26.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:26.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:25 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: pgmap v387: 97 pgs: 97 active+clean; 53 MiB data, 607 MiB used, 1.0 TiB / 1.0 TiB avail; 585 KiB/s rd, 1.1 MiB/s wr, 143 op/s 2023-09-13T09:42:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:42:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:25 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:27.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89411 4.67 MB/sec warmup 107 sec latency 598.458 ms 2023-09-13T09:42:28.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89448 4.62 MB/sec warmup 108 sec latency 975.781 ms 2023-09-13T09:42:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:27 smithi006 ceph-mon[98665]: pgmap v388: 97 pgs: 97 active+clean; 53 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2023-09-13T09:42:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:27 smithi053 ceph-mon[102373]: pgmap v388: 97 pgs: 97 active+clean; 53 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2023-09-13T09:42:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:27 smithi131 ceph-mon[102785]: pgmap v388: 97 pgs: 97 active+clean; 53 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 597 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2023-09-13T09:42:29.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89448 4.58 MB/sec warmup 109 sec latency 1975.893 ms 2023-09-13T09:42:30.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89448 4.54 MB/sec warmup 110 sec latency 2975.979 ms 2023-09-13T09:42:30.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:29 smithi006 ceph-mon[98665]: pgmap v389: 97 pgs: 97 active+clean; 54 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.0 MiB/s wr, 138 op/s 2023-09-13T09:42:30.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:29 smithi053 ceph-mon[102373]: pgmap v389: 97 pgs: 97 active+clean; 54 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.0 MiB/s wr, 138 op/s 2023-09-13T09:42:30.275 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:29 smithi131 ceph-mon[102785]: pgmap v389: 97 pgs: 97 active+clean; 54 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.0 MiB/s wr, 138 op/s 2023-09-13T09:42:31.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89448 4.50 MB/sec warmup 111 sec latency 3976.044 ms 2023-09-13T09:42:32.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89465 4.46 MB/sec warmup 112 sec latency 4963.595 ms 2023-09-13T09:42:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:31 smithi053 ceph-mon[102373]: pgmap v390: 97 pgs: 97 active+clean; 52 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 960 KiB/s wr, 112 op/s 2023-09-13T09:42:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:31 smithi006 ceph-mon[98665]: pgmap v390: 97 pgs: 97 active+clean; 52 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 960 KiB/s wr, 112 op/s 2023-09-13T09:42:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:31 smithi131 ceph-mon[102785]: pgmap v390: 97 pgs: 97 active+clean; 52 MiB data, 629 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 960 KiB/s wr, 112 op/s 2023-09-13T09:42:33.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89516 4.42 MB/sec warmup 113 sec latency 962.879 ms 2023-09-13T09:42:34.152 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89516 4.38 MB/sec warmup 114 sec latency 1963.004 ms 2023-09-13T09:42:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:33 smithi006 ceph-mon[98665]: pgmap v391: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 813 KiB/s wr, 107 op/s 2023-09-13T09:42:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:33 smithi053 ceph-mon[102373]: pgmap v391: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 813 KiB/s wr, 107 op/s 2023-09-13T09:42:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:33 smithi131 ceph-mon[102785]: pgmap v391: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 378 KiB/s rd, 813 KiB/s wr, 107 op/s 2023-09-13T09:42:35.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89516 4.34 MB/sec warmup 115 sec latency 2963.057 ms 2023-09-13T09:42:36.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89516 4.31 MB/sec warmup 116 sec latency 3963.098 ms 2023-09-13T09:42:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:35 smithi053 ceph-mon[102373]: pgmap v392: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 611 KiB/s wr, 87 op/s 2023-09-13T09:42:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:35 smithi006 ceph-mon[98665]: pgmap v392: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 611 KiB/s wr, 87 op/s 2023-09-13T09:42:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:35 smithi131 ceph-mon[102785]: pgmap v392: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 611 KiB/s wr, 87 op/s 2023-09-13T09:42:37.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 89535 4.27 MB/sec warmup 117 sec latency 4948.228 ms 2023-09-13T09:42:38.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 92063 4.35 MB/sec warmup 118 sec latency 10.365 ms 2023-09-13T09:42:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:37 smithi053 ceph-mon[102373]: pgmap v393: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 299 KiB/s wr, 70 op/s 2023-09-13T09:42:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:37 smithi006 ceph-mon[98665]: pgmap v393: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 299 KiB/s wr, 70 op/s 2023-09-13T09:42:38.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:37 smithi131 ceph-mon[102785]: pgmap v393: 97 pgs: 97 active+clean; 52 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 212 KiB/s rd, 299 KiB/s wr, 70 op/s 2023-09-13T09:42:39.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 93054 4.36 MB/sec warmup 119 sec latency 12.733 ms 2023-09-13T09:42:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:39 smithi006 ceph-mon[98665]: pgmap v394: 97 pgs: 97 active+clean; 53 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 236 KiB/s wr, 57 op/s 2023-09-13T09:42:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:42:40.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:39 smithi053 ceph-mon[102373]: pgmap v394: 97 pgs: 97 active+clean; 53 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 236 KiB/s wr, 57 op/s 2023-09-13T09:42:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:42:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:39 smithi131 ceph-mon[102785]: pgmap v394: 97 pgs: 97 active+clean; 53 MiB data, 635 MiB used, 1.0 TiB / 1.0 TiB avail; 159 KiB/s rd, 236 KiB/s wr, 57 op/s 2023-09-13T09:42:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:42:41.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 93060 0.00 MB/sec execute 1 sec latency 1987.991 ms 2023-09-13T09:42:42.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 93070 0.05 MB/sec execute 2 sec latency 2983.044 ms 2023-09-13T09:42:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:41 smithi006 ceph-mon[98665]: pgmap v395: 97 pgs: 97 active+clean; 53 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 185 KiB/s wr, 43 op/s 2023-09-13T09:42:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:41 smithi053 ceph-mon[102373]: pgmap v395: 97 pgs: 97 active+clean; 53 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 185 KiB/s wr, 43 op/s 2023-09-13T09:42:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:41 smithi131 ceph-mon[102785]: pgmap v395: 97 pgs: 97 active+clean; 53 MiB data, 636 MiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 185 KiB/s wr, 43 op/s 2023-09-13T09:42:43.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 95528 4.61 MB/sec execute 3 sec latency 14.373 ms 2023-09-13T09:42:44.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 96527 4.74 MB/sec execute 4 sec latency 23.684 ms 2023-09-13T09:42:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:43 smithi006 ceph-mon[98665]: pgmap v396: 97 pgs: 97 active+clean; 54 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 232 KiB/s wr, 53 op/s 2023-09-13T09:42:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:43 smithi053 ceph-mon[102373]: pgmap v396: 97 pgs: 97 active+clean; 54 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 232 KiB/s wr, 53 op/s 2023-09-13T09:42:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:43 smithi131 ceph-mon[102785]: pgmap v396: 97 pgs: 97 active+clean; 54 MiB data, 639 MiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 232 KiB/s wr, 53 op/s 2023-09-13T09:42:45.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 96539 3.79 MB/sec execute 5 sec latency 986.025 ms 2023-09-13T09:42:46.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 96539 3.16 MB/sec execute 6 sec latency 1986.138 ms 2023-09-13T09:42:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:46 smithi053 ceph-mon[102373]: pgmap v397: 97 pgs: 97 active+clean; 55 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 279 KiB/s wr, 65 op/s 2023-09-13T09:42:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:45 smithi006 ceph-mon[98665]: pgmap v397: 97 pgs: 97 active+clean; 55 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 279 KiB/s wr, 65 op/s 2023-09-13T09:42:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:45 smithi131 ceph-mon[102785]: pgmap v397: 97 pgs: 97 active+clean; 55 MiB data, 649 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 279 KiB/s wr, 65 op/s 2023-09-13T09:42:47.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 96558 2.72 MB/sec execute 7 sec latency 2970.768 ms 2023-09-13T09:42:48.153 INFO:tasks.workunit.client.0.smithi006.stdout: 1 98718 3.82 MB/sec execute 8 sec latency 16.316 ms 2023-09-13T09:42:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:48 smithi053 ceph-mon[102373]: pgmap v398: 97 pgs: 97 active+clean; 55 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 447 KiB/s wr, 85 op/s 2023-09-13T09:42:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:48 smithi006 ceph-mon[98665]: pgmap v398: 97 pgs: 97 active+clean; 55 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 447 KiB/s wr, 85 op/s 2023-09-13T09:42:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:48 smithi131 ceph-mon[102785]: pgmap v398: 97 pgs: 97 active+clean; 55 MiB data, 661 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 447 KiB/s wr, 85 op/s 2023-09-13T09:42:49.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 99810 4.20 MB/sec execute 9 sec latency 33.044 ms 2023-09-13T09:42:50.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 100152 3.83 MB/sec execute 10 sec latency 723.261 ms 2023-09-13T09:42:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:50 smithi006 ceph-mon[98665]: pgmap v399: 97 pgs: 97 active+clean; 56 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 568 KiB/s wr, 99 op/s 2023-09-13T09:42:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:50 smithi053 ceph-mon[102373]: pgmap v399: 97 pgs: 97 active+clean; 56 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 568 KiB/s wr, 99 op/s 2023-09-13T09:42:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:50 smithi131 ceph-mon[102785]: pgmap v399: 97 pgs: 97 active+clean; 56 MiB data, 663 MiB used, 1.0 TiB / 1.0 TiB avail; 370 KiB/s rd, 568 KiB/s wr, 99 op/s 2023-09-13T09:42:51.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 100152 3.48 MB/sec execute 11 sec latency 1723.332 ms 2023-09-13T09:42:52.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 100164 3.20 MB/sec execute 12 sec latency 2713.478 ms 2023-09-13T09:42:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:52 smithi131 ceph-mon[102785]: pgmap v400: 97 pgs: 97 active+clean; 56 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 606 KiB/s wr, 101 op/s 2023-09-13T09:42:52.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:52 smithi053 ceph-mon[102373]: pgmap v400: 97 pgs: 97 active+clean; 56 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 606 KiB/s wr, 101 op/s 2023-09-13T09:42:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:52 smithi006 ceph-mon[98665]: pgmap v400: 97 pgs: 97 active+clean; 56 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 606 KiB/s wr, 101 op/s 2023-09-13T09:42:53.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 102554 3.94 MB/sec execute 13 sec latency 15.191 ms 2023-09-13T09:42:54.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 103593 4.08 MB/sec execute 14 sec latency 12.954 ms 2023-09-13T09:42:54.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:54 smithi131 ceph-mon[102785]: pgmap v401: 97 pgs: 97 active+clean; 56 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 901 KiB/s wr, 130 op/s 2023-09-13T09:42:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:54 smithi006 ceph-mon[98665]: pgmap v401: 97 pgs: 97 active+clean; 56 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 901 KiB/s wr, 130 op/s 2023-09-13T09:42:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:54 smithi053 ceph-mon[102373]: pgmap v401: 97 pgs: 97 active+clean; 56 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 558 KiB/s rd, 901 KiB/s wr, 130 op/s 2023-09-13T09:42:54.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:42:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 -- 172.21.15.6:0/1158962424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49280fff80 msgr2=0x7f49281003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 --2- 172.21.15.6:0/1158962424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49280fff80 0x7f49281003e0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f491c009990 tx=0x7f491c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 -- 172.21.15.6:0/1158962424 shutdown_connections 2023-09-13T09:42:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 --2- 172.21.15.6:0/1158962424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4928100920 0x7f49281081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 --2- 172.21.15.6:0/1158962424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4928101250 0x7f4928101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 --2- 172.21.15.6:0/1158962424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49280fff80 0x7f49281003e0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 -- 172.21.15.6:0/1158962424 >> 172.21.15.6:0/1158962424 conn(0x7f49280fa9b0 msgr2=0x7f49280fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:54.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 -- 172.21.15.6:0/1158962424 shutdown_connections 2023-09-13T09:42:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.912+0000 7f492e871700 1 -- 172.21.15.6:0/1158962424 wait complete. 2023-09-13T09:42:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 Processor -- start 2023-09-13T09:42:54.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 -- start start 2023-09-13T09:42:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49280fff80 0x7f49280ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4928100920 0x7f492819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4928101250 0x7f492819dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492819e540 con 0x7f4928101250 2023-09-13T09:42:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492819e6b0 con 0x7f4928100920 2023-09-13T09:42:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.913+0000 7f492e871700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f492819e870 con 0x7f49280fff80 2023-09-13T09:42:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f492ce0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4928101250 0x7f492819dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f4927fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49280fff80 0x7f49280ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49277fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4928100920 0x7f492819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f4927fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49280fff80 0x7f49280ff9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:38854/0 (socket says 172.21.15.6:38854) 2023-09-13T09:42:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f4927fff700 1 -- 172.21.15.6:0/568706888 learned_addr learned my addr 172.21.15.6:0/568706888 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49277fe700 1 -- 172.21.15.6:0/568706888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49280fff80 msgr2=0x7f49280ff9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49277fe700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49280fff80 0x7f49280ff9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49277fe700 1 -- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4928101250 msgr2=0x7f492819dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49277fe700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4928101250 0x7f492819dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49277fe700 1 -- 172.21.15.6:0/568706888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f491c0095f0 con 0x7f4928100920 2023-09-13T09:42:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f4927fff700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49280fff80 0x7f49280ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:54.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f492ce0e700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4928101250 0x7f492819dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49277fe700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4928100920 0x7f492819b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f491c000c00 tx=0x7f491c005f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49257fa700 1 -- 172.21.15.6:0/568706888 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c01d070 con 0x7f4928100920 2023-09-13T09:42:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f492819eaf0 con 0x7f4928100920 2023-09-13T09:42:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49257fa700 1 -- 172.21.15.6:0/568706888 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f491c022470 con 0x7f4928100920 2023-09-13T09:42:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f49257fa700 1 -- 172.21.15.6:0/568706888 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c017650 con 0x7f4928100920 2023-09-13T09:42:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.914+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492819ef70 con 0x7f4928100920 2023-09-13T09:42:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.916+0000 7f49257fa700 1 -- 172.21.15.6:0/568706888 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f491c022850 con 0x7f4928100920 2023-09-13T09:42:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.917+0000 7f49257fa700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49100a0640 0x7f49100a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.917+0000 7f49257fa700 1 -- 172.21.15.6:0/568706888 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f491c0ccff0 con 0x7f4928100920 2023-09-13T09:42:54.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.917+0000 7f4927fff700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49100a0640 0x7f49100a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f4927fff700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49100a0640 0x7f49100a2b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4918005950 tx=0x7f4918009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 Processor -- start 2023-09-13T09:42:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 -- start start 2023-09-13T09:42:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab7700 0x55aa47ab7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47ab64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47a0f780 con 0x55aa47ab8060 2023-09-13T09:42:54.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47a0d0a0 con 0x55aa47ab6a00 2023-09-13T09:42:54.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f493aa56b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47a08990 con 0x55aa47ab7700 2023-09-13T09:42:54.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f49277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47ab64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f49277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47ab64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35810/0 (socket says 172.21.15.6:35810) 2023-09-13T09:42:54.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f4927fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab7700 0x55aa47ab7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f49277fe700 1 -- 172.21.15.6:0/406236495 learned_addr learned my addr 172.21.15.6:0/406236495 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:54.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.918+0000 7f492ce0e700 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f49277fe700 1 -- 172.21.15.6:0/406236495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab7700 msgr2=0x55aa47ab7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f49277fe700 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab7700 0x55aa47ab7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f49277fe700 1 -- 172.21.15.6:0/406236495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 msgr2=0x55aa47ab6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f49277fe700 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f49277fe700 1 -- 172.21.15.6:0/406236495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa47888630 con 0x55aa47ab8060 2023-09-13T09:42:54.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f4927fff700 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab7700 0x55aa47ab7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:54.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f49277fe700 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47ab64c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b680 tx=0x7f491c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acfa38cc0b72d62 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:54.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f490e7fc700 1 -- 172.21.15.6:0/406236495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c09e770 con 0x55aa47ab8060 2023-09-13T09:42:54.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f490e7fc700 1 -- 172.21.15.6:0/406236495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f491c0a2920 con 0x55aa47ab8060 2023-09-13T09:42:54.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f490e7fc700 1 -- 172.21.15.6:0/406236495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c09a090 con 0x55aa47ab8060 2023-09-13T09:42:54.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f493aa56b80 1 -- 172.21.15.6:0/406236495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 msgr2=0x55aa47ab64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.919+0000 7f493aa56b80 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47ab64c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f491c00b680 tx=0x7f491c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 -- 172.21.15.6:0/406236495 shutdown_connections 2023-09-13T09:42:54.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab7700 0x55aa47ab7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 --2- 172.21.15.6:0/406236495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47ab64c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 -- 172.21.15.6:0/406236495 >> 172.21.15.6:0/406236495 conn(0x55aa47a14c80 msgr2=0x55aa47ab0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 -- 172.21.15.6:0/406236495 shutdown_connections 2023-09-13T09:42:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 -- 172.21.15.6:0/406236495 wait complete. 2023-09-13T09:42:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 -- start start 2023-09-13T09:42:54.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.920+0000 7f493aa56b80 1 Processor -- start 2023-09-13T09:42:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab6a00 0x55aa47abfb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47ac00d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47ac7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa479a6bb0 con 0x55aa47ab6a00 2023-09-13T09:42:54.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa479a68b0 con 0x55aa47ab7700 2023-09-13T09:42:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa4788a920 con 0x55aa47ab8060 2023-09-13T09:42:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 10 client.0 _ll_register_callbacks cb 0x55aa479a4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab6a00 0x55aa47abfb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab6a00 0x55aa47abfb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35814/0 (socket says 172.21.15.6:35814) 2023-09-13T09:42:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 -- 172.21.15.6:0/243484905 learned_addr learned my addr 172.21.15.6:0/243484905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:54.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f49277fe700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47ac00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f492ce0e700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47ac7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 -- 172.21.15.6:0/243484905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 msgr2=0x55aa47ac7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47ac7110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 -- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 msgr2=0x55aa47ac00d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47ac00d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 -- 172.21.15.6:0/243484905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492819ef70 con 0x55aa47ab6a00 2023-09-13T09:42:54.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f492ce0e700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47ac7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:54.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f4927fff700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab6a00 0x55aa47abfb90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f491800ee50 tx=0x7f49180047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da01b5c664868efd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:54.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f49077fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:54.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f49077fe700 1 -- 172.21.15.6:0/243484905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4918022070 con 0x55aa47ab6a00 2023-09-13T09:42:54.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f49077fe700 1 -- 172.21.15.6:0/243484905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f491801ddc0 con 0x55aa47ab6a00 2023-09-13T09:42:54.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.921+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa47aa9670 con 0x55aa47ab6a00 2023-09-13T09:42:54.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f49077fe700 1 -- 172.21.15.6:0/243484905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f491800ee80 con 0x55aa47ab6a00 2023-09-13T09:42:54.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 10 client.16245 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:54.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55aa47a207a0 con 0x55aa47ab6a00 2023-09-13T09:42:54.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f49077fe700 1 -- 172.21.15.6:0/243484905 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55aa47aa9670 con 0x55aa47ab6a00 2023-09-13T09:42:54.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f49077fe700 1 -- 172.21.15.6:0/243484905 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4918005020 con 0x55aa47ab6a00 2023-09-13T09:42:54.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 10 client.16245 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:54.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 10 client.16245 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:54.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 20 client.16245 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:54.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47acba60 0x55aa47acde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 4 client.16245 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:54.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa47a01970 con 0x55aa47acba60 2023-09-13T09:42:54.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.922+0000 7f49277fe700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47acba60 0x55aa47acde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f49077fe700 10 client.16245 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:54.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f49277fe700 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47acba60 0x55aa47acde80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edb344f0f21d069f server_cookie=2f6a20ad8366ee96 in_seq=0 out_seq=0 2023-09-13T09:42:54.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f49077fe700 1 -- 172.21.15.6:0/243484905 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aa47a01970 con 0x55aa47acba60 2023-09-13T09:42:54.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f49077fe700 10 client.16245 handle_command_reply: tid=0 2023-09-13T09:42:54.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f493aa56b80 1 client.16245 shutdown 2023-09-13T09:42:54.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab6a00 msgr2=0x55aa47abfb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f493aa56b80 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab6a00 0x55aa47abfb90 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f491800ee50 tx=0x7f49180047c0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 shutdown_connections 2023-09-13T09:42:54.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.923+0000 7f493aa56b80 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47ac7110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f493aa56b80 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47acba60 0x55aa47acde80 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f493aa56b80 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab6a00 0x55aa47abfb90 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f49077fe700 0 client.16245 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f493aa56b80 1 --2- 172.21.15.6:0/243484905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47ac00d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 >> 172.21.15.6:0/243484905 conn(0x55aa47a14c80 msgr2=0x55aa47aab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 shutdown_connections 2023-09-13T09:42:54.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f493aa56b80 1 -- 172.21.15.6:0/243484905 wait complete. 2023-09-13T09:42:54.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.924+0000 7f493aa56b80 20 client.16245 trim_cache size 0 max 16384 2023-09-13T09:42:54.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 Processor -- start 2023-09-13T09:42:54.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 -- start start 2023-09-13T09:42:54.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab7700 0x55aa47abdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47aba8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47ac74c0 con 0x55aa47ab7700 2023-09-13T09:42:54.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47abb430 con 0x55aa47ab6a00 2023-09-13T09:42:54.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f493aa56b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47acb760 con 0x55aa47ab8060 2023-09-13T09:42:54.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f49277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab7700 0x55aa47abdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f49277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab7700 0x55aa47abdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35824/0 (socket says 172.21.15.6:35824) 2023-09-13T09:42:54.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f49277fe700 1 -- 172.21.15.6:0/722728619 learned_addr learned my addr 172.21.15.6:0/722728619 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:54.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f492ce0e700 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47aba8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.941+0000 7f4927fff700 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f49277fe700 1 -- 172.21.15.6:0/722728619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 msgr2=0x55aa47aba8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f49277fe700 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47aba8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f49277fe700 1 -- 172.21.15.6:0/722728619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 msgr2=0x55aa47ab64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f49277fe700 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f49277fe700 1 -- 172.21.15.6:0/722728619 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa47834de0 con 0x55aa47ab7700 2023-09-13T09:42:54.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f49277fe700 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab7700 0x55aa47abdd90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f491c09a8d0 tx=0x7f491c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=249abb5942995b92 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:54.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f490effd700 1 -- 172.21.15.6:0/722728619 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0225e0 con 0x55aa47ab7700 2023-09-13T09:42:54.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f490effd700 1 -- 172.21.15.6:0/722728619 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f491c09e770 con 0x55aa47ab7700 2023-09-13T09:42:54.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.942+0000 7f490effd700 1 -- 172.21.15.6:0/722728619 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a26f0 con 0x55aa47ab7700 2023-09-13T09:42:54.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 -- 172.21.15.6:0/722728619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab7700 msgr2=0x55aa47abdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab7700 0x55aa47abdd90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f491c09a8d0 tx=0x7f491c009310 comp rx=0 tx=0).stop 2023-09-13T09:42:54.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 -- 172.21.15.6:0/722728619 shutdown_connections 2023-09-13T09:42:54.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab8060 0x55aa47aba8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab6a00 0x55aa47ab64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 --2- 172.21.15.6:0/722728619 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab7700 0x55aa47abdd90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 -- 172.21.15.6:0/722728619 >> 172.21.15.6:0/722728619 conn(0x55aa47a14c80 msgr2=0x55aa47ab1810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:54.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 -- 172.21.15.6:0/722728619 shutdown_connections 2023-09-13T09:42:54.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 -- 172.21.15.6:0/722728619 wait complete. 2023-09-13T09:42:54.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 -- start start 2023-09-13T09:42:54.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 Processor -- start 2023-09-13T09:42:54.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab6a00 0x55aa47b1d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47b1fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.943+0000 7f493aa56b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47b22310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f493aa56b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47b22a20 con 0x55aa47ab8060 2023-09-13T09:42:54.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f493aa56b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47b22b90 con 0x55aa47ab7700 2023-09-13T09:42:54.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f493aa56b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa47b22d50 con 0x55aa47ab6a00 2023-09-13T09:42:54.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f493aa56b80 10 client.0 _ll_register_callbacks cb 0x55aa479a4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:54.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47b22310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f4927fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab6a00 0x55aa47b1d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47b22310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35832/0 (socket says 172.21.15.6:35832) 2023-09-13T09:42:54.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 -- 172.21.15.6:0/3141796909 learned_addr learned my addr 172.21.15.6:0/3141796909 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:54.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f49277fe700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47b1fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 -- 172.21.15.6:0/3141796909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab6a00 msgr2=0x55aa47b1d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab6a00 0x55aa47b1d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 -- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 msgr2=0x55aa47b1fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:54.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47b1fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 -- 172.21.15.6:0/3141796909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa47888630 con 0x55aa47ab8060 2023-09-13T09:42:54.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f4927fff700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab6a00 0x55aa47b1d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:54.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f49277fe700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47b1fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:54.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f492ce0e700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47b22310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4920003e70 tx=0x7f492000e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c9d3d3afbcaac1f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:54.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f49077fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:54.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f49077fe700 1 -- 172.21.15.6:0/3141796909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492001b070 con 0x55aa47ab8060 2023-09-13T09:42:54.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f49077fe700 1 -- 172.21.15.6:0/3141796909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f492000ee40 con 0x55aa47ab8060 2023-09-13T09:42:54.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.944+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f491c0a2920 con 0x55aa47ab8060 2023-09-13T09:42:54.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f49077fe700 1 -- 172.21.15.6:0/3141796909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49200090d0 con 0x55aa47ab8060 2023-09-13T09:42:54.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 10 client.16251 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:54.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55aa4781dc60 con 0x55aa47ab8060 2023-09-13T09:42:54.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f49077fe700 1 -- 172.21.15.6:0/3141796909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f491c0a2920 con 0x55aa47ab8060 2023-09-13T09:42:54.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f49077fe700 1 -- 172.21.15.6:0/3141796909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f492002a450 con 0x55aa47ab8060 2023-09-13T09:42:54.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 10 client.16251 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:54.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 10 client.16251 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:54.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 20 client.16251 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:54.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47b248f0 0x55aa47b26d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:54.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 4 client.16251 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:42:54.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aa479c2050 con 0x55aa47b248f0 2023-09-13T09:42:54.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.945+0000 7f4927fff700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47b248f0 0x55aa47b26d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:54.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f49077fe700 10 client.16251 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:54.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f4927fff700 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47b248f0 0x55aa47b26d10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=584ed0f05bb4d833 server_cookie=ef7c142838321359 in_seq=0 out_seq=0 2023-09-13T09:42:54.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f49077fe700 1 -- 172.21.15.6:0/3141796909 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55aa479c2050 con 0x55aa47b248f0 2023-09-13T09:42:54.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f49077fe700 10 client.16251 handle_command_reply: tid=0 2023-09-13T09:42:54.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 client.16251 shutdown 2023-09-13T09:42:54.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 msgr2=0x55aa47b22310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47b22310 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f4920003e70 tx=0x7f492000e7d0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 shutdown_connections 2023-09-13T09:42:54.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aa47b248f0 0x55aa47b26d10 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aa47ab8060 0x55aa47b22310 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f49077fe700 0 client.16251 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aa47ab6a00 0x55aa47b1d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 --2- 172.21.15.6:0/3141796909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aa47ab7700 0x55aa47b1fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 >> 172.21.15.6:0/3141796909 conn(0x55aa47a14c80 msgr2=0x55aa47abdd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:54.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 shutdown_connections 2023-09-13T09:42:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 1 -- 172.21.15.6:0/3141796909 wait complete. 2023-09-13T09:42:54.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.946+0000 7f493aa56b80 20 client.16251 trim_cache size 0 max 16384 2023-09-13T09:42:54.968 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:42:54.968 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:42:54.969 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:42:54.969 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:42:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49100a0640 msgr2=0x7f49100a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49100a0640 0x7f49100a2b00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4918005950 tx=0x7f4918009260 comp rx=0 tx=0).stop 2023-09-13T09:42:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4928100920 msgr2=0x7f492819b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4928100920 0x7f492819b760 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f491c000c00 tx=0x7f491c005f10 comp rx=0 tx=0).stop 2023-09-13T09:42:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 shutdown_connections 2023-09-13T09:42:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49100a0640 0x7f49100a2b00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4928101250 0x7f492819dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49280fff80 0x7f49280ff9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 --2- 172.21.15.6:0/568706888 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4928100920 0x7f492819b760 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 >> 172.21.15.6:0/568706888 conn(0x7f49280fa9b0 msgr2=0x7f49280fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 shutdown_connections 2023-09-13T09:42:54.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:54.947+0000 7f492e871700 1 -- 172.21.15.6:0/568706888 wait complete. 2023-09-13T09:42:54.973 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:42:54.973 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:42:55.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 -- 172.21.15.6:0/3751368145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 msgr2=0x7f975c1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 --2- 172.21.15.6:0/3751368145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 0x7f975c1012e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9750009990 tx=0x7f9750009ca0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 -- 172.21.15.6:0/3751368145 shutdown_connections 2023-09-13T09:42:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 --2- 172.21.15.6:0/3751368145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c101820 0x7f975c1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 --2- 172.21.15.6:0/3751368145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c0ffc90 0x7f975c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 --2- 172.21.15.6:0/3751368145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 0x7f975c1012e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 -- 172.21.15.6:0/3751368145 >> 172.21.15.6:0/3751368145 conn(0x7f975c0fb220 msgr2=0x7f975c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 -- 172.21.15.6:0/3751368145 shutdown_connections 2023-09-13T09:42:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.102+0000 7f97618b3700 1 -- 172.21.15.6:0/3751368145 wait complete. 2023-09-13T09:42:55.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.103+0000 7f97618b3700 1 Processor -- start 2023-09-13T09:42:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.103+0000 7f97618b3700 1 -- start start 2023-09-13T09:42:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.103+0000 7f97618b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c0ffc90 0x7f975c068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.103+0000 7f97618b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 0x7f975c19b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.103+0000 7f97618b3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c101820 0x7f975c19ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.103+0000 7f97618b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c19e560 con 0x7f975c0ffc90 2023-09-13T09:42:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.103+0000 7f97618b3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c19e6d0 con 0x7f975c101820 2023-09-13T09:42:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f97618b3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975c19e890 con 0x7f975c100e80 2023-09-13T09:42:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c0ffc90 0x7f975c068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c0ffc90 0x7f975c068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35842/0 (socket says 172.21.15.6:35842) 2023-09-13T09:42:55.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 -- 172.21.15.6:0/1686255650 learned_addr learned my addr 172.21.15.6:0/1686255650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975a7fc700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 0x7f975c19b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975b7fe700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c101820 0x7f975c19ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 -- 172.21.15.6:0/1686255650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 msgr2=0x7f975c19b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 0x7f975c19b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 -- 172.21.15.6:0/1686255650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c101820 msgr2=0x7f975c19ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c101820 0x7f975c19ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 -- 172.21.15.6:0/1686255650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97500095f0 con 0x7f975c0ffc90 2023-09-13T09:42:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f975affd700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c0ffc90 0x7f975c068b20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f974c00e970 tx=0x7f974c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f97608b1700 1 -- 172.21.15.6:0/1686255650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c009790 con 0x7f975c0ffc90 2023-09-13T09:42:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975c19eb70 con 0x7f975c0ffc90 2023-09-13T09:42:55.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f97608b1700 1 -- 172.21.15.6:0/1686255650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f974c00c7e0 con 0x7f975c0ffc90 2023-09-13T09:42:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f97608b1700 1 -- 172.21.15.6:0/1686255650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c003c70 con 0x7f975c0ffc90 2023-09-13T09:42:55.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.104+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975c19f080 con 0x7f975c0ffc90 2023-09-13T09:42:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.105+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975c107220 con 0x7f975c0ffc90 2023-09-13T09:42:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.106+0000 7f97608b1700 1 -- 172.21.15.6:0/1686255650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f974c00cc50 con 0x7f975c0ffc90 2023-09-13T09:42:55.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.107+0000 7f97608b1700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f97440a0640 0x7f97440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.107+0000 7f975a7fc700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f97440a0640 0x7f97440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.107+0000 7f97608b1700 1 -- 172.21.15.6:0/1686255650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f974c014070 con 0x7f975c0ffc90 2023-09-13T09:42:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.108+0000 7f975a7fc700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f97440a0640 0x7f97440a2b00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f975000b2e0 tx=0x7f9750005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.112+0000 7f97608b1700 1 -- 172.21.15.6:0/1686255650 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f974c095880 con 0x7f975c0ffc90 2023-09-13T09:42:55.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 105882 4.64 MB/sec execute 15 sec latency 12.307 ms 2023-09-13T09:42:55.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.375+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f975c10b4a0 con 0x7f975c0ffc90 2023-09-13T09:42:55.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.376+0000 7f97608b1700 1 -- 172.21.15.6:0/1686255650 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+11346 (secure 0 0 0) 0x7f974c0ace60 con 0x7f975c0ffc90 2023-09-13T09:42:55.376 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:42:55.376 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:41:44.012481+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:42:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f97440a0640 msgr2=0x7f97440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f97440a0640 0x7f97440a2b00 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f975000b2e0 tx=0x7f9750005fb0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c0ffc90 msgr2=0x7f975c068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c0ffc90 0x7f975c068b20 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f974c00e970 tx=0x7f974c00ec80 comp rx=0 tx=0).stop 2023-09-13T09:42:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 shutdown_connections 2023-09-13T09:42:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f975c101820 0x7f975c19ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f97440a0640 0x7f97440a2b00 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f975c0ffc90 0x7f975c068b20 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 --2- 172.21.15.6:0/1686255650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f975c100e80 0x7f975c19b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 >> 172.21.15.6:0/1686255650 conn(0x7f975c0fb220 msgr2=0x7f975c104360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 shutdown_connections 2023-09-13T09:42:55.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.378+0000 7f97618b3700 1 -- 172.21.15.6:0/1686255650 wait complete. 2023-09-13T09:42:55.381 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 30 2023-09-13T09:42:55.391 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:42:55.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 -- 172.21.15.6:0/2290227705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 msgr2=0x7feb1c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 --2- 172.21.15.6:0/2290227705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c1011e0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7feb10009920 tx=0x7feb10009c30 comp rx=0 tx=0).stop 2023-09-13T09:42:55.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 -- 172.21.15.6:0/2290227705 shutdown_connections 2023-09-13T09:42:55.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 --2- 172.21.15.6:0/2290227705 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb1c102950 0x7feb1c109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 --2- 172.21.15.6:0/2290227705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c1011e0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 --2- 172.21.15.6:0/2290227705 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c101fb0 0x7feb1c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 -- 172.21.15.6:0/2290227705 >> 172.21.15.6:0/2290227705 conn(0x7feb1c0fc330 msgr2=0x7feb1c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 -- 172.21.15.6:0/2290227705 shutdown_connections 2023-09-13T09:42:55.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.520+0000 7feb22b1b700 1 -- 172.21.15.6:0/2290227705 wait complete. 2023-09-13T09:42:55.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 Processor -- start 2023-09-13T09:42:55.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 -- start start 2023-09-13T09:42:55.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb1c101fb0 0x7feb1c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c102950 0x7feb1c0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c073d80 con 0x7feb1c100dc0 2023-09-13T09:42:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c073ef0 con 0x7feb1c102950 2023-09-13T09:42:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb22b1b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb1c1a0b60 con 0x7feb1c101fb0 2023-09-13T09:42:55.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35856/0 (socket says 172.21.15.6:35856) 2023-09-13T09:42:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 -- 172.21.15.6:0/206579425 learned_addr learned my addr 172.21.15.6:0/206579425 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb210b8700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c102950 0x7feb1c0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb1bfff700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb1c101fb0 0x7feb1c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 -- 172.21.15.6:0/206579425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb1c101fb0 msgr2=0x7feb1c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb1c101fb0 0x7feb1c0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 -- 172.21.15.6:0/206579425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c102950 msgr2=0x7feb1c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c102950 0x7feb1c0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 -- 172.21.15.6:0/206579425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb10009520 con 0x7feb1c100dc0 2023-09-13T09:42:55.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.521+0000 7feb208b7700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c074a60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7feb10009230 tx=0x7feb1000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.522+0000 7feb19ffb700 1 -- 172.21.15.6:0/206579425 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1001c070 con 0x7feb1c100dc0 2023-09-13T09:42:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.522+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c1a0de0 con 0x7feb1c100dc0 2023-09-13T09:42:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.522+0000 7feb19ffb700 1 -- 172.21.15.6:0/206579425 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb1000f7d0 con 0x7feb1c100dc0 2023-09-13T09:42:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.522+0000 7feb19ffb700 1 -- 172.21.15.6:0/206579425 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100039b0 con 0x7feb1c100dc0 2023-09-13T09:42:55.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.522+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb1c1a11a0 con 0x7feb1c100dc0 2023-09-13T09:42:55.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.524+0000 7feb19ffb700 1 -- 172.21.15.6:0/206579425 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7feb10020070 con 0x7feb1c100dc0 2023-09-13T09:42:55.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.524+0000 7feb19ffb700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb0c0a0640 0x7feb0c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.525+0000 7feb1bfff700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb0c0a0640 0x7feb0c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.525+0000 7feb19ffb700 1 -- 172.21.15.6:0/206579425 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feb100cc6e0 con 0x7feb1c100dc0 2023-09-13T09:42:55.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.525+0000 7feb1bfff700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb0c0a0640 0x7feb0c0a2b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb08005fd0 tx=0x7feb08009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.525+0000 7feb2ed00b80 1 Processor -- start 2023-09-13T09:42:55.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.525+0000 7feb2ed00b80 1 -- start start 2023-09-13T09:42:55.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e40700 0x55a1d9e40b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e41060 0x55a1d9e3f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9d98780 con 0x55a1d9e41060 2023-09-13T09:42:55.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9d960a0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9d91990 con 0x55a1d9e40700 2023-09-13T09:42:55.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e41060 0x55a1d9e3f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e41060 0x55a1d9e3f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35866/0 (socket says 172.21.15.6:35866) 2023-09-13T09:42:55.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 -- 172.21.15.6:0/2691309989 learned_addr learned my addr 172.21.15.6:0/2691309989 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb210b8700 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb208b7700 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e40700 0x55a1d9e40b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 -- 172.21.15.6:0/2691309989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e40700 msgr2=0x55a1d9e40b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e40700 0x55a1d9e40b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 -- 172.21.15.6:0/2691309989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 msgr2=0x55a1d9e3fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 -- 172.21.15.6:0/2691309989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d9c11630 con 0x55a1d9e41060 2023-09-13T09:42:55.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb210b8700 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb208b7700 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e40700 0x55a1d9e40b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:55.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb1bfff700 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e41060 0x55a1d9e3f4c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feb080041d0 tx=0x7feb08014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9a1e2cdffe11aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.526+0000 7feb06ffd700 1 -- 172.21.15.6:0/2691309989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08009e60 con 0x55a1d9e41060 2023-09-13T09:42:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb06ffd700 1 -- 172.21.15.6:0/2691309989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb08004830 con 0x55a1d9e41060 2023-09-13T09:42:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb06ffd700 1 -- 172.21.15.6:0/2691309989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb08005580 con 0x55a1d9e41060 2023-09-13T09:42:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2691309989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e41060 msgr2=0x55a1d9e3f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e41060 0x55a1d9e3f4c0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7feb080041d0 tx=0x7feb08014000 comp rx=0 tx=0).stop 2023-09-13T09:42:55.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2691309989 shutdown_connections 2023-09-13T09:42:55.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e40700 0x55a1d9e40b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2691309989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e41060 0x55a1d9e3f4c0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2691309989 >> 172.21.15.6:0/2691309989 conn(0x55a1d9d9dc80 msgr2=0x55a1d9e39f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2691309989 shutdown_connections 2023-09-13T09:42:55.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.527+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2691309989 wait complete. 2023-09-13T09:42:55.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 -- start start 2023-09-13T09:42:55.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 Processor -- start 2023-09-13T09:42:55.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e48ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e40700 0x55a1d9e49430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e50470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9d2fbb0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9d2f8b0 con 0x55a1d9e40700 2023-09-13T09:42:55.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9c13920 con 0x55a1d9e41060 2023-09-13T09:42:55.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb2ed00b80 10 client.0 _ll_register_callbacks cb 0x55a1d9d2d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:55.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb208b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e48ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb208b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e48ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35870/0 (socket says 172.21.15.6:35870) 2023-09-13T09:42:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb208b7700 1 -- 172.21.15.6:0/3932953947 learned_addr learned my addr 172.21.15.6:0/3932953947 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb1bfff700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e40700 0x55a1d9e49430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.528+0000 7feb210b8700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e50470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb208b7700 1 -- 172.21.15.6:0/3932953947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 msgr2=0x55a1d9e50470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb208b7700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e50470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb208b7700 1 -- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e40700 msgr2=0x55a1d9e49430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb208b7700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e40700 0x55a1d9e49430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb208b7700 1 -- 172.21.15.6:0/3932953947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb08017070 con 0x55a1d9e3fa00 2023-09-13T09:42:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb210b8700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e50470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb1bfff700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e40700 0x55a1d9e49430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb208b7700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e48ef0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7feb100098f0 tx=0x7feb1000f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9da23385949ebc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feafbfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feafbfff700 1 -- 172.21.15.6:0/3932953947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10099eb0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feafbfff700 1 -- 172.21.15.6:0/3932953947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feb1009dce0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1d9e32670 con 0x55a1d9e3fa00 2023-09-13T09:42:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feafbfff700 1 -- 172.21.15.6:0/3932953947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb100a1e90 con 0x55a1d9e3fa00 2023-09-13T09:42:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 10 client.16269 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a1d9da97a0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feafbfff700 1 -- 172.21.15.6:0/3932953947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a1d9e32670 con 0x55a1d9e3fa00 2023-09-13T09:42:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feafbfff700 1 -- 172.21.15.6:0/3932953947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7feb100a1a00 con 0x55a1d9e3fa00 2023-09-13T09:42:55.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 10 client.16269 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 10 client.16269 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:42:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 20 client.16269 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9e547c0 0x55a1d9e56be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 4 client.16269 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:55.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.529+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1d9d8a970 con 0x55a1d9e547c0 2023-09-13T09:42:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.530+0000 7feb1bfff700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9e547c0 0x55a1d9e56be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.530+0000 7feafbfff700 10 client.16269 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.530+0000 7feb1bfff700 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9e547c0 0x55a1d9e56be0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=784481d9d241daa0 server_cookie=a192d6a8d84cf921 in_seq=0 out_seq=0 2023-09-13T09:42:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feafbfff700 1 -- 172.21.15.6:0/3932953947 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a1d9d8a970 con 0x55a1d9e547c0 2023-09-13T09:42:55.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feafbfff700 10 client.16269 handle_command_reply: tid=0 2023-09-13T09:42:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 client.16269 shutdown 2023-09-13T09:42:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e3fa00 msgr2=0x55a1d9e48ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e48ef0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7feb100098f0 tx=0x7feb1000f940 comp rx=0 tx=0).stop 2023-09-13T09:42:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 shutdown_connections 2023-09-13T09:42:55.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9e547c0 0x55a1d9e56be0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e50470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e48ef0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feafbfff700 0 client.16269 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3932953947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e40700 0x55a1d9e49430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 >> 172.21.15.6:0/3932953947 conn(0x55a1d9d9dc80 msgr2=0x55a1d9e347f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 shutdown_connections 2023-09-13T09:42:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3932953947 wait complete. 2023-09-13T09:42:55.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.531+0000 7feb2ed00b80 20 client.16269 trim_cache size 0 max 16384 2023-09-13T09:42:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 Processor -- start 2023-09-13T09:42:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 -- start start 2023-09-13T09:42:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e48ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9e57240 con 0x55a1d9e40700 2023-09-13T09:42:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9e46b60 con 0x55a1d9e3fa00 2023-09-13T09:42:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9e44450 con 0x55a1d9e41060 2023-09-13T09:42:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb208b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35880/0 (socket says 172.21.15.6:35880) 2023-09-13T09:42:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb1bfff700 1 -- 172.21.15.6:0/2221242570 learned_addr learned my addr 172.21.15.6:0/2221242570 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb210b8700 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e48ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb208b7700 1 -- 172.21.15.6:0/2221242570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 msgr2=0x55a1d9e48ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb208b7700 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e48ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb208b7700 1 -- 172.21.15.6:0/2221242570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 msgr2=0x55a1d9e50430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb208b7700 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb208b7700 1 -- 172.21.15.6:0/2221242570 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1d9bbdde0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.545+0000 7feb1bfff700 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.546+0000 7feb208b7700 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3f4c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb100a1960 tx=0x7feb10009c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77333c072c88f32f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.546+0000 7feb077fe700 1 -- 172.21.15.6:0/2221242570 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10095ca0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.546+0000 7feb077fe700 1 -- 172.21.15.6:0/2221242570 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb1009dce0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.546+0000 7feb077fe700 1 -- 172.21.15.6:0/2221242570 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb100a1b70 con 0x55a1d9e3fa00 2023-09-13T09:42:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2221242570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 msgr2=0x55a1d9e3f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3f4c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feb100a1960 tx=0x7feb10009c30 comp rx=0 tx=0).stop 2023-09-13T09:42:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2221242570 shutdown_connections 2023-09-13T09:42:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e48ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e3f4c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/2221242570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2221242570 >> 172.21.15.6:0/2221242570 conn(0x55a1d9d9dc80 msgr2=0x55a1d9e50d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2221242570 shutdown_connections 2023-09-13T09:42:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- 172.21.15.6:0/2221242570 wait complete. 2023-09-13T09:42:55.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- start start 2023-09-13T09:42:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 Processor -- start 2023-09-13T09:42:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e4fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e4c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9e4cea0 con 0x55a1d9e40700 2023-09-13T09:42:55.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9e4d010 con 0x55a1d9e3fa00 2023-09-13T09:42:55.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.547+0000 7feb2ed00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1d9e4d1d0 con 0x55a1d9e41060 2023-09-13T09:42:55.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb2ed00b80 10 client.0 _ll_register_callbacks cb 0x55a1d9d2d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:55.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e4fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e4fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57640/0 (socket says 172.21.15.6:57640) 2023-09-13T09:42:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 -- 172.21.15.6:0/3101167856 learned_addr learned my addr 172.21.15.6:0/3101167856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35886/0 (socket says 172.21.15.6:35886) 2023-09-13T09:42:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb210b8700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e4c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 -- 172.21.15.6:0/3101167856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 msgr2=0x55a1d9e4c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e4c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 -- 172.21.15.6:0/3101167856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 msgr2=0x55a1d9e50320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 -- 172.21.15.6:0/3101167856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1d9c11630 con 0x55a1d9e3fa00 2023-09-13T09:42:55.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb210b8700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e4c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb1bfff700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb208b7700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e4fde0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb100963b0 tx=0x7feb100962f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b7d0313eab78439 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feafbfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:42:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feafbfff700 1 -- 172.21.15.6:0/3101167856 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb10099eb0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feafbfff700 1 -- 172.21.15.6:0/3101167856 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feb100a1e90 con 0x55a1d9e3fa00 2023-09-13T09:42:55.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb08004830 con 0x55a1d9e3fa00 2023-09-13T09:42:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feafbfff700 1 -- 172.21.15.6:0/3101167856 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb10003b10 con 0x55a1d9e3fa00 2023-09-13T09:42:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb2ed00b80 10 client.25760 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.548+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55a1d9da97a0 con 0x55a1d9e3fa00 2023-09-13T09:42:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feafbfff700 1 -- 172.21.15.6:0/3101167856 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb08004830 con 0x55a1d9e3fa00 2023-09-13T09:42:55.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feafbfff700 1 -- 172.21.15.6:0/3101167856 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7feb10005040 con 0x55a1d9e3fa00 2023-09-13T09:42:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb2ed00b80 10 client.25760 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb2ed00b80 10 client.25760 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:42:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb2ed00b80 20 client.25760 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9ea9520 0x55a1d9eab910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb2ed00b80 4 client.25760 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a1d9d4b050 con 0x55a1d9ea9520 2023-09-13T09:42:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb1bfff700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9ea9520 0x55a1d9eab910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feafbfff700 10 client.25760 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.549+0000 7feb1bfff700 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9ea9520 0x55a1d9eab910 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=150ee82eb71f81d7 server_cookie=fd195951220c5bd0 in_seq=0 out_seq=0 2023-09-13T09:42:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feafbfff700 1 -- 172.21.15.6:0/3101167856 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a1d9d4b050 con 0x55a1d9ea9520 2023-09-13T09:42:55.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feafbfff700 10 client.25760 handle_command_reply: tid=0 2023-09-13T09:42:55.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 client.25760 shutdown 2023-09-13T09:42:55.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 msgr2=0x55a1d9e4fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e4fde0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feb100963b0 tx=0x7feb100962f0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 shutdown_connections 2023-09-13T09:42:55.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a1d9ea9520 0x55a1d9eab910 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1d9e41060 0x55a1d9e4c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feafbfff700 0 client.25760 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:42:55.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1d9e3fa00 0x55a1d9e4fde0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 --2- 172.21.15.6:0/3101167856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1d9e40700 0x55a1d9e50320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 >> 172.21.15.6:0/3101167856 conn(0x55a1d9d9dc80 msgr2=0x55a1d9e48ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.550+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 shutdown_connections 2023-09-13T09:42:55.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb2ed00b80 1 -- 172.21.15.6:0/3101167856 wait complete. 2023-09-13T09:42:55.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb2ed00b80 20 client.25760 trim_cache size 0 max 16384 2023-09-13T09:42:55.576 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb0c0a0640 msgr2=0x7feb0c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb0c0a0640 0x7feb0c0a2b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb08005fd0 tx=0x7feb08009310 comp rx=0 tx=0).stop 2023-09-13T09:42:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 msgr2=0x7feb1c074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c074a60 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7feb10009230 tx=0x7feb1000b790 comp rx=0 tx=0).stop 2023-09-13T09:42:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 shutdown_connections 2023-09-13T09:42:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb1c102950 0x7feb1c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb0c0a0640 0x7feb0c0a2b00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb1c100dc0 0x7feb1c074a60 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 --2- 172.21.15.6:0/206579425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb1c101fb0 0x7feb1c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 >> 172.21.15.6:0/206579425 conn(0x7feb1c0fc330 msgr2=0x7feb1c0fe670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 shutdown_connections 2023-09-13T09:42:55.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.551+0000 7feb22b1b700 1 -- 172.21.15.6:0/206579425 wait complete. 2023-09-13T09:42:55.580 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:42:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 -- 172.21.15.6:0/2497237457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918101840 msgr2=0x7fa918103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 --2- 172.21.15.6:0/2497237457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918101840 0x7fa918103c30 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fa90c009990 tx=0x7fa90c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 -- 172.21.15.6:0/2497237457 shutdown_connections 2023-09-13T09:42:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 --2- 172.21.15.6:0/2497237457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa918106aa0 0x7fa918108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 --2- 172.21.15.6:0/2497237457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918101840 0x7fa918103c30 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 --2- 172.21.15.6:0/2497237457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa918104170 0x7fa918106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 -- 172.21.15.6:0/2497237457 >> 172.21.15.6:0/2497237457 conn(0x7fa9180fb250 msgr2=0x7fa9180fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 -- 172.21.15.6:0/2497237457 shutdown_connections 2023-09-13T09:42:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.709+0000 7fa91f275700 1 -- 172.21.15.6:0/2497237457 wait complete. 2023-09-13T09:42:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 Processor -- start 2023-09-13T09:42:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 -- start start 2023-09-13T09:42:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa918101840 0x7fa918196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918104170 0x7fa918196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa918106aa0 0x7fa91819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91819e5b0 con 0x7fa918104170 2023-09-13T09:42:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91819e6f0 con 0x7fa918101840 2023-09-13T09:42:55.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91f275700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91819e880 con 0x7fa918106aa0 2023-09-13T09:42:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91c810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918104170 0x7fa918196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91d011700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa918101840 0x7fa918196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91c810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918104170 0x7fa918196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35900/0 (socket says 172.21.15.6:35900) 2023-09-13T09:42:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91c810700 1 -- 172.21.15.6:0/4257025325 learned_addr learned my addr 172.21.15.6:0/4257025325 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.710+0000 7fa91d812700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa918106aa0 0x7fa91819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91c810700 1 -- 172.21.15.6:0/4257025325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa918106aa0 msgr2=0x7fa91819dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91c810700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa918106aa0 0x7fa91819dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91c810700 1 -- 172.21.15.6:0/4257025325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa918101840 msgr2=0x7fa918196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91c810700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa918101840 0x7fa918196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91c810700 1 -- 172.21.15.6:0/4257025325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa90c0095f0 con 0x7fa918104170 2023-09-13T09:42:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91d011700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa918101840 0x7fa918196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91c810700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918104170 0x7fa918196f70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa91400e9a0 tx=0x7fa91400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa90a7fc700 1 -- 172.21.15.6:0/4257025325 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914009790 con 0x7fa918104170 2023-09-13T09:42:55.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91819eb60 con 0x7fa918104170 2023-09-13T09:42:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa90a7fc700 1 -- 172.21.15.6:0/4257025325 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa914010430 con 0x7fa918104170 2023-09-13T09:42:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa90a7fc700 1 -- 172.21.15.6:0/4257025325 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914018680 con 0x7fa918104170 2023-09-13T09:42:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.711+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91819f070 con 0x7fa918104170 2023-09-13T09:42:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.713+0000 7fa90a7fc700 1 -- 172.21.15.6:0/4257025325 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa9140105a0 con 0x7fa918104170 2023-09-13T09:42:55.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.714+0000 7fa90a7fc700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9040a0640 0x7fa9040a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.714+0000 7fa90a7fc700 1 -- 172.21.15.6:0/4257025325 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa914014070 con 0x7fa918104170 2023-09-13T09:42:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.714+0000 7fa91d011700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9040a0640 0x7fa9040a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.714+0000 7fa91d011700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9040a0640 0x7fa9040a2b00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b2e0 tx=0x7fa90c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 Processor -- start 2023-09-13T09:42:55.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 -- start start 2023-09-13T09:42:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a8e10 0x55854c1a9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c0fd780 con 0x55854c1aa470 2023-09-13T09:42:55.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c0fb0a0 con 0x55854c1a8e10 2023-09-13T09:42:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c0f6990 con 0x55854c1a9b10 2023-09-13T09:42:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91c810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91d812700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a8e10 0x55854c1a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91c810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35908/0 (socket says 172.21.15.6:35908) 2023-09-13T09:42:55.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91d011700 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91c810700 1 -- 172.21.15.6:0/3171926736 learned_addr learned my addr 172.21.15.6:0/3171926736 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91d812700 1 -- 172.21.15.6:0/3171926736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 msgr2=0x55854c1a9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91d812700 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1a9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91d812700 1 -- 172.21.15.6:0/3171926736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 msgr2=0x55854c1a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91d812700 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.715+0000 7fa91d812700 1 -- 172.21.15.6:0/3171926736 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55854bf76630 con 0x55854c1a8e10 2023-09-13T09:42:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.716+0000 7fa91d812700 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a8e10 0x55854c1a9270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa910011580 tx=0x7fa910009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f8bccfb084f09bf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.716+0000 7fa9037fe700 1 -- 172.21.15.6:0/3171926736 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000e040 con 0x55854c1a8e10 2023-09-13T09:42:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.716+0000 7fa9037fe700 1 -- 172.21.15.6:0/3171926736 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa91000f040 con 0x55854c1a8e10 2023-09-13T09:42:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.716+0000 7fa9037fe700 1 -- 172.21.15.6:0/3171926736 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910004370 con 0x55854c1a8e10 2023-09-13T09:42:55.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 -- 172.21.15.6:0/3171926736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a8e10 msgr2=0x55854c1a9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a8e10 0x55854c1a9270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa910011580 tx=0x7fa910009920 comp rx=0 tx=0).stop 2023-09-13T09:42:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 -- 172.21.15.6:0/3171926736 shutdown_connections 2023-09-13T09:42:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a8e10 0x55854c1a9270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1a9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/3171926736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1a88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 -- 172.21.15.6:0/3171926736 >> 172.21.15.6:0/3171926736 conn(0x55854c102c80 msgr2=0x55854c19ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 -- 172.21.15.6:0/3171926736 shutdown_connections 2023-09-13T09:42:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 -- 172.21.15.6:0/3171926736 wait complete. 2023-09-13T09:42:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 -- start start 2023-09-13T09:42:55.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.717+0000 7fa92b45ab80 1 Processor -- start 2023-09-13T09:42:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1a8e10 0x55854c1b22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1b27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1aa470 0x55854c1b9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c094bb0 con 0x55854c1a8e10 2023-09-13T09:42:55.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c0948b0 con 0x55854c1aa470 2023-09-13T09:42:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854bf78920 con 0x55854c1a9b10 2023-09-13T09:42:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa92b45ab80 10 client.0 _ll_register_callbacks cb 0x55854c092680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1a8e10 0x55854c1b22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1a8e10 0x55854c1b22b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35912/0 (socket says 172.21.15.6:35912) 2023-09-13T09:42:55.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 -- 172.21.15.6:0/2147999618 learned_addr learned my addr 172.21.15.6:0/2147999618 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d812700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1aa470 0x55854c1b9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91c810700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1b27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 -- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 msgr2=0x55854c1b27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1b27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 -- 172.21.15.6:0/2147999618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1aa470 msgr2=0x55854c1b9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1aa470 0x55854c1b9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 -- 172.21.15.6:0/2147999618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa910011230 con 0x55854c1a8e10 2023-09-13T09:42:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d812700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1aa470 0x55854c1b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa91d011700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1a8e10 0x55854c1b22b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00fc70 tx=0x7fa90c01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a54960ca53dcc7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.718+0000 7fa900ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa900ff9700 1 -- 172.21.15.6:0/2147999618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c02b050 con 0x55854c1a8e10 2023-09-13T09:42:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa900ff9700 1 -- 172.21.15.6:0/2147999618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa90c026a70 con 0x55854c1a8e10 2023-09-13T09:42:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55854c197670 con 0x55854c1a8e10 2023-09-13T09:42:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa900ff9700 1 -- 172.21.15.6:0/2147999618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa90c026c30 con 0x55854c1a8e10 2023-09-13T09:42:55.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 10 client.16287 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55854c10e7a0 con 0x55854c1a8e10 2023-09-13T09:42:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa900ff9700 1 -- 172.21.15.6:0/2147999618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa90c03f020 con 0x55854c1a8e10 2023-09-13T09:42:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa900ff9700 1 -- 172.21.15.6:0/2147999618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa90c024ce0 con 0x55854c1a8e10 2023-09-13T09:42:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 10 client.16287 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:55.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 10 client.16287 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:42:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 20 client.16287 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c1be100 0x55854c1c0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 4 client.16287 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55854c0ef970 con 0x55854c1be100 2023-09-13T09:42:55.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.719+0000 7fa91c810700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c1be100 0x55854c1c0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa900ff9700 10 client.16287 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa91c810700 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c1be100 0x55854c1c0520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5f2b3bd4221e7125 server_cookie=7e25a7853b9d86bb in_seq=0 out_seq=0 2023-09-13T09:42:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa900ff9700 1 -- 172.21.15.6:0/2147999618 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55854c0ef970 con 0x55854c1be100 2023-09-13T09:42:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa900ff9700 10 client.16287 handle_command_reply: tid=0 2023-09-13T09:42:55.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 client.16287 shutdown 2023-09-13T09:42:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1a8e10 msgr2=0x55854c1b22b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1a8e10 0x55854c1b22b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00fc70 tx=0x7fa90c01a050 comp rx=0 tx=0).stop 2023-09-13T09:42:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 shutdown_connections 2023-09-13T09:42:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c1be100 0x55854c1c0520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1aa470 0x55854c1b9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1a8e10 0x55854c1b22b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2147999618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a9b10 0x55854c1b27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa900ff9700 0 client.16287 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.720+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 >> 172.21.15.6:0/2147999618 conn(0x55854c102c80 msgr2=0x55854c1997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.721+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 shutdown_connections 2023-09-13T09:42:55.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.721+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2147999618 wait complete. 2023-09-13T09:42:55.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.721+0000 7fa92b45ab80 20 client.16287 trim_cache size 0 max 16384 2023-09-13T09:42:55.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 Processor -- start 2023-09-13T09:42:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 -- start start 2023-09-13T09:42:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b97f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c1aa140 con 0x55854c1aa470 2023-09-13T09:42:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c1ad880 con 0x55854c1a9b10 2023-09-13T09:42:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c1a0730 con 0x55854c1a8e10 2023-09-13T09:42:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa91d812700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa91d812700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35924/0 (socket says 172.21.15.6:35924) 2023-09-13T09:42:55.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa91d812700 1 -- 172.21.15.6:0/4128510792 learned_addr learned my addr 172.21.15.6:0/4128510792 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa91c810700 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.734+0000 7fa91d011700 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa91d812700 1 -- 172.21.15.6:0/4128510792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 msgr2=0x55854c1accf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa91d812700 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1accf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa91d812700 1 -- 172.21.15.6:0/4128510792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 msgr2=0x55854c1b97f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa91d812700 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b97f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa91d812700 1 -- 172.21.15.6:0/4128510792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55854bf22de0 con 0x55854c1aa470 2023-09-13T09:42:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa91d011700 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa91d812700 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1ad230 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b010 tx=0x7fa910009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c46927b115b8661f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa903fff700 1 -- 172.21.15.6:0/4128510792 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91000e040 con 0x55854c1aa470 2023-09-13T09:42:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa903fff700 1 -- 172.21.15.6:0/4128510792 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa9100079c0 con 0x55854c1aa470 2023-09-13T09:42:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.735+0000 7fa903fff700 1 -- 172.21.15.6:0/4128510792 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa910027940 con 0x55854c1aa470 2023-09-13T09:42:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- 172.21.15.6:0/4128510792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 msgr2=0x55854c1ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1ad230 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa91000b010 tx=0x7fa910009dd0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- 172.21.15.6:0/4128510792 shutdown_connections 2023-09-13T09:42:55.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1ad230 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1accf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/4128510792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b97f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- 172.21.15.6:0/4128510792 >> 172.21.15.6:0/4128510792 conn(0x55854c102c80 msgr2=0x55854c1b01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- 172.21.15.6:0/4128510792 shutdown_connections 2023-09-13T09:42:55.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- 172.21.15.6:0/4128510792 wait complete. 2023-09-13T09:42:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- start start 2023-09-13T09:42:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 Processor -- start 2023-09-13T09:42:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c1b6380 con 0x55854c1aa470 2023-09-13T09:42:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c1b64f0 con 0x55854c1a9b10 2023-09-13T09:42:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854c1b66b0 con 0x55854c1a8e10 2023-09-13T09:42:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.736+0000 7fa92b45ab80 10 client.0 _ll_register_callbacks cb 0x55854c092680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:55.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91d812700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b9780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57684/0 (socket says 172.21.15.6:57684) 2023-09-13T09:42:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 -- 172.21.15.6:0/2474782746 learned_addr learned my addr 172.21.15.6:0/2474782746 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91d011700 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 -- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 msgr2=0x55854c1b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1b9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 -- 172.21.15.6:0/2474782746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 msgr2=0x55854c1b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1b5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 -- 172.21.15.6:0/2474782746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55854bf76630 con 0x55854c1a9b10 2023-09-13T09:42:55.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa91c810700 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b9780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9140959c0 tx=0x7fa9140cb040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=348e660e0f636341 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa900ff9700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:42:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa900ff9700 1 -- 172.21.15.6:0/2474782746 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91409d120 con 0x55854c1a9b10 2023-09-13T09:42:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa91000f040 con 0x55854c1a9b10 2023-09-13T09:42:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa900ff9700 1 -- 172.21.15.6:0/2474782746 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa91409d340 con 0x55854c1a9b10 2023-09-13T09:42:55.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa900ff9700 1 -- 172.21.15.6:0/2474782746 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9140a1580 con 0x55854c1a9b10 2023-09-13T09:42:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa92b45ab80 10 client.25778 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.737+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55854bf0bc60 con 0x55854c1a9b10 2023-09-13T09:42:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa900ff9700 1 -- 172.21.15.6:0/2474782746 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa91000f040 con 0x55854c1a9b10 2023-09-13T09:42:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa900ff9700 1 -- 172.21.15.6:0/2474782746 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa914098a00 con 0x55854c1a9b10 2023-09-13T09:42:55.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa92b45ab80 10 client.25778 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa92b45ab80 10 client.25778 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:42:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa92b45ab80 20 client.25778 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c213550 0x55854c215970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa92b45ab80 4 client.25778 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:55.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55854c0b0050 con 0x55854c213550 2023-09-13T09:42:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa91d011700 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c213550 0x55854c215970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa900ff9700 10 client.25778 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.738+0000 7fa91d011700 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c213550 0x55854c215970 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=380917cdd9d00853 server_cookie=9c03a417f6082283 in_seq=0 out_seq=0 2023-09-13T09:42:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa900ff9700 1 -- 172.21.15.6:0/2474782746 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55854c0b0050 con 0x55854c213550 2023-09-13T09:42:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa900ff9700 10 client.25778 handle_command_reply: tid=0 2023-09-13T09:42:55.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 client.25778 shutdown 2023-09-13T09:42:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 msgr2=0x55854c1b9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b9780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa9140959c0 tx=0x7fa9140cb040 comp rx=0 tx=0).stop 2023-09-13T09:42:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 shutdown_connections 2023-09-13T09:42:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55854c213550 0x55854c215970 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55854c1aa470 0x55854c1b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55854c1a8e10 0x55854c1b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 --2- 172.21.15.6:0/2474782746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55854c1a9b10 0x55854c1b9780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa900ff9700 0 client.25778 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:42:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 >> 172.21.15.6:0/2474782746 conn(0x55854c102c80 msgr2=0x55854c1accf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 shutdown_connections 2023-09-13T09:42:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 1 -- 172.21.15.6:0/2474782746 wait complete. 2023-09-13T09:42:55.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa92b45ab80 20 client.25778 trim_cache size 0 max 16384 2023-09-13T09:42:55.764 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9040a0640 msgr2=0x7fa9040a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa91f275700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9040a0640 0x7fa9040a2b00 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fa90c00b2e0 tx=0x7fa90c005fb0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918104170 msgr2=0x7fa918196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa91f275700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918104170 0x7fa918196f70 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fa91400e9a0 tx=0x7fa91400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 shutdown_connections 2023-09-13T09:42:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa91f275700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa918106aa0 0x7fa91819dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.739+0000 7fa91f275700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa918101840 0x7fa918196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.740+0000 7fa91f275700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa9040a0640 0x7fa9040a2b00 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.740+0000 7fa91f275700 1 --2- 172.21.15.6:0/4257025325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa918104170 0x7fa918196f70 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.740+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 >> 172.21.15.6:0/4257025325 conn(0x7fa9180fb250 msgr2=0x7fa9181024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.740+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 shutdown_connections 2023-09-13T09:42:55.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.740+0000 7fa91f275700 1 -- 172.21.15.6:0/4257025325 wait complete. 2023-09-13T09:42:55.768 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:42:55.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 -- 172.21.15.6:0/2214585600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8102950 msgr2=0x7f81f8109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 --2- 172.21.15.6:0/2214585600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8102950 0x7f81f8109200 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f81f000b0d0 tx=0x7f81f000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 -- 172.21.15.6:0/2214585600 shutdown_connections 2023-09-13T09:42:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 --2- 172.21.15.6:0/2214585600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8102950 0x7f81f8109200 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 --2- 172.21.15.6:0/2214585600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f8100dc0 0x7f81f81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 --2- 172.21.15.6:0/2214585600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81f8101fb0 0x7f81f8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 -- 172.21.15.6:0/2214585600 >> 172.21.15.6:0/2214585600 conn(0x7f81f80fc330 msgr2=0x7f81f80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 -- 172.21.15.6:0/2214585600 shutdown_connections 2023-09-13T09:42:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.896+0000 7f81ff639700 1 -- 172.21.15.6:0/2214585600 wait complete. 2023-09-13T09:42:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 Processor -- start 2023-09-13T09:42:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 -- start start 2023-09-13T09:42:55.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81f8100dc0 0x7f81f8074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8101fb0 0x7f81f80730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f8102950 0x7f81f80735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8073d80 con 0x7f81f8101fb0 2023-09-13T09:42:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f8073ef0 con 0x7f81f8100dc0 2023-09-13T09:42:55.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81ff639700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81f81a0bd0 con 0x7f81f8102950 2023-09-13T09:42:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81fcbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8101fb0 0x7f81f80730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81fcbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8101fb0 0x7f81f80730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35942/0 (socket says 172.21.15.6:35942) 2023-09-13T09:42:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81fd3d5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81f8100dc0 0x7f81f8074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81fcbd4700 1 -- 172.21.15.6:0/3279730919 learned_addr learned my addr 172.21.15.6:0/3279730919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.897+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f8102950 0x7f81f80735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81fcbd4700 1 -- 172.21.15.6:0/3279730919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f8102950 msgr2=0x7f81f80735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f8102950 0x7f81f80735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81fcbd4700 1 -- 172.21.15.6:0/3279730919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81f8100dc0 msgr2=0x7f81f8074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81f8100dc0 0x7f81f8074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81fcbd4700 1 -- 172.21.15.6:0/3279730919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81f0009d00 con 0x7f81f8101fb0 2023-09-13T09:42:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8101fb0 0x7f81f80730a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00e9a0 tx=0x7f81ec00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81ea7fc700 1 -- 172.21.15.6:0/3279730919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec009790 con 0x7f81f8101fb0 2023-09-13T09:42:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81ea7fc700 1 -- 172.21.15.6:0/3279730919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81ec00cbd0 con 0x7f81f8101fb0 2023-09-13T09:42:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81f81a0eb0 con 0x7f81f8101fb0 2023-09-13T09:42:55.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81ea7fc700 1 -- 172.21.15.6:0/3279730919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ec018680 con 0x7f81f8101fb0 2023-09-13T09:42:55.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.898+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f81a1330 con 0x7f81f8101fb0 2023-09-13T09:42:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.901+0000 7f81ea7fc700 1 -- 172.21.15.6:0/3279730919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f81ec00cd40 con 0x7f81f8101fb0 2023-09-13T09:42:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.901+0000 7f81ea7fc700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f81e40a0640 0x7f81e40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.901+0000 7f81ea7fc700 1 -- 172.21.15.6:0/3279730919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f81ec014070 con 0x7f81f8101fb0 2023-09-13T09:42:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.901+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f81e40a0640 0x7f81e40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f81e40a0640 0x7f81e40a2b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f81f8101e10 tx=0x7f81f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 Processor -- start 2023-09-13T09:42:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 -- start start 2023-09-13T09:42:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e733016b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e7330154c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733015e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e732f6e780 con 0x55e733016700 2023-09-13T09:42:55.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e732f6c0a0 con 0x55e733017060 2023-09-13T09:42:55.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f820b81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e732f67990 con 0x55e733015a00 2023-09-13T09:42:55.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f81fd3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e733016b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f81fd3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e733016b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35948/0 (socket says 172.21.15.6:35948) 2023-09-13T09:42:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f81fd3d5700 1 -- 172.21.15.6:0/883487691 learned_addr learned my addr 172.21.15.6:0/883487691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e7330154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.902+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733015e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81fd3d5700 1 -- 172.21.15.6:0/883487691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 msgr2=0x55e733015e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733015e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81fd3d5700 1 -- 172.21.15.6:0/883487691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 msgr2=0x55e7330154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e7330154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81fd3d5700 1 -- 172.21.15.6:0/883487691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e732de7630 con 0x55e733016700 2023-09-13T09:42:55.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733015e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e733016b20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f81f4011d50 tx=0x7f81f4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a662fb9cbf608899 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81e37fe700 1 -- 172.21.15.6:0/883487691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f400ed20 con 0x55e733016700 2023-09-13T09:42:55.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81e37fe700 1 -- 172.21.15.6:0/883487691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f4021070 con 0x55e733016700 2023-09-13T09:42:55.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.903+0000 7f81e37fe700 1 -- 172.21.15.6:0/883487691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f401d670 con 0x55e733016700 2023-09-13T09:42:55.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 -- 172.21.15.6:0/883487691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 msgr2=0x55e733016b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e733016b20 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f81f4011d50 tx=0x7f81f4014000 comp rx=0 tx=0).stop 2023-09-13T09:42:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 -- 172.21.15.6:0/883487691 shutdown_connections 2023-09-13T09:42:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733015e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e733016b20 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 --2- 172.21.15.6:0/883487691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e7330154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 -- 172.21.15.6:0/883487691 >> 172.21.15.6:0/883487691 conn(0x55e732f73c80 msgr2=0x55e73300ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 -- 172.21.15.6:0/883487691 shutdown_connections 2023-09-13T09:42:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 -- 172.21.15.6:0/883487691 wait complete. 2023-09-13T09:42:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 -- start start 2023-09-13T09:42:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.904+0000 7f820b81eb80 1 Processor -- start 2023-09-13T09:42:55.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733015a00 0x55e73301ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73301f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733017060 0x55e7330262e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f820b81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e732f05bb0 con 0x55e733015a00 2023-09-13T09:42:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f820b81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e732f058b0 con 0x55e733016700 2023-09-13T09:42:55.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f820b81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e732de9920 con 0x55e733017060 2023-09-13T09:42:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f820b81eb80 10 client.0 _ll_register_callbacks cb 0x55e732f03680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733015a00 0x55e73301ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733015a00 0x55e73301ed60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35954/0 (socket says 172.21.15.6:35954) 2023-09-13T09:42:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 -- 172.21.15.6:0/4036773244 learned_addr learned my addr 172.21.15.6:0/4036773244 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73301f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733017060 0x55e7330262e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 -- 172.21.15.6:0/4036773244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733017060 msgr2=0x55e7330262e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733017060 0x55e7330262e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 -- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 msgr2=0x55e73301f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73301f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 -- 172.21.15.6:0/4036773244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81f4017070 con 0x55e733015a00 2023-09-13T09:42:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73301f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733015a00 0x55e73301ed60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f81f4005d90 tx=0x7f81f400edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fccd27280e81db4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.905+0000 7f81e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f81e0ff9700 1 -- 172.21.15.6:0/4036773244 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f401cba0 con 0x55e733015a00 2023-09-13T09:42:55.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f81e0ff9700 1 -- 172.21.15.6:0/4036773244 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f81f401c620 con 0x55e733015a00 2023-09-13T09:42:55.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e733008670 con 0x55e733015a00 2023-09-13T09:42:55.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f81e0ff9700 1 -- 172.21.15.6:0/4036773244 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81f401c7e0 con 0x55e733015a00 2023-09-13T09:42:55.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 10 client.16305 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:55.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55e732f7f7a0 con 0x55e733015a00 2023-09-13T09:42:55.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f81e0ff9700 1 -- 172.21.15.6:0/4036773244 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f403d020 con 0x55e733015a00 2023-09-13T09:42:55.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f81e0ff9700 1 -- 172.21.15.6:0/4036773244 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f81f40049c0 con 0x55e733015a00 2023-09-13T09:42:55.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 10 client.16305 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:55.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 10 client.16305 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:42:55.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 20 client.16305 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:55.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73302abb0 0x55e73302cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 4 client.16305 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:55.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e732f60970 con 0x55e73302abb0 2023-09-13T09:42:55.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.906+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73302abb0 0x55e73302cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.907+0000 7f81e0ff9700 10 client.16305 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:55.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.907+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73302abb0 0x55e73302cfd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1806026c84fa9328 server_cookie=3709f6948210002e in_seq=0 out_seq=0 2023-09-13T09:42:55.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.907+0000 7f81e0ff9700 1 -- 172.21.15.6:0/4036773244 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e732f60970 con 0x55e73302abb0 2023-09-13T09:42:55.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.907+0000 7f81e0ff9700 10 client.16305 handle_command_reply: tid=0 2023-09-13T09:42:55.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.907+0000 7f820b81eb80 1 client.16305 shutdown 2023-09-13T09:42:55.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733015a00 msgr2=0x55e73301ed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733015a00 0x55e73301ed60 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f81f4005d90 tx=0x7f81f400edd0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 shutdown_connections 2023-09-13T09:42:55.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73302abb0 0x55e73302cfd0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733017060 0x55e7330262e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733015a00 0x55e73301ed60 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f81e0ff9700 0 client.16305 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:55.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 --2- 172.21.15.6:0/4036773244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73301f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 >> 172.21.15.6:0/4036773244 conn(0x55e732f73c80 msgr2=0x55e73300a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 shutdown_connections 2023-09-13T09:42:55.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 1 -- 172.21.15.6:0/4036773244 wait complete. 2023-09-13T09:42:55.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.908+0000 7f820b81eb80 20 client.16305 trim_cache size 0 max 16384 2023-09-13T09:42:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 Processor -- start 2023-09-13T09:42:55.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 -- start start 2023-09-13T09:42:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e7330154c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73302cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733017060 0x55e7330262a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e733011350 con 0x55e733017060 2023-09-13T09:42:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e733011980 con 0x55e733016700 2023-09-13T09:42:55.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f820b81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73301d4a0 con 0x55e733015a00 2023-09-13T09:42:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733017060 0x55e7330262a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733017060 0x55e7330262a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35966/0 (socket says 172.21.15.6:35966) 2023-09-13T09:42:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fcbd4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73302cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 -- 172.21.15.6:0/3518626602 learned_addr learned my addr 172.21.15.6:0/3518626602 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e7330154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 -- 172.21.15.6:0/3518626602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 msgr2=0x55e7330154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e7330154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 -- 172.21.15.6:0/3518626602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 msgr2=0x55e73302cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73302cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fdbd6700 1 -- 172.21.15.6:0/3518626602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e732d93de0 con 0x55e733017060 2023-09-13T09:42:55.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73302cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.923+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e7330154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.924+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733017060 0x55e7330262a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f81f0015000 tx=0x7f81f00095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4ae6a4f5ad4e48a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.924+0000 7f81e3fff700 1 -- 172.21.15.6:0/3518626602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f000e040 con 0x55e733017060 2023-09-13T09:42:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.924+0000 7f81e3fff700 1 -- 172.21.15.6:0/3518626602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f81f0009b80 con 0x55e733017060 2023-09-13T09:42:55.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.924+0000 7f81e3fff700 1 -- 172.21.15.6:0/3518626602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f00054c0 con 0x55e733017060 2023-09-13T09:42:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.924+0000 7f820b81eb80 1 -- 172.21.15.6:0/3518626602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733017060 msgr2=0x55e7330262a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.924+0000 7f820b81eb80 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733017060 0x55e7330262a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f81f0015000 tx=0x7f81f00095a0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.924+0000 7f820b81eb80 1 -- 172.21.15.6:0/3518626602 shutdown_connections 2023-09-13T09:42:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733017060 0x55e7330262a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e7330154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 --2- 172.21.15.6:0/3518626602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733016700 0x55e73302cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 -- 172.21.15.6:0/3518626602 >> 172.21.15.6:0/3518626602 conn(0x55e732f73c80 msgr2=0x55e73300fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 -- 172.21.15.6:0/3518626602 shutdown_connections 2023-09-13T09:42:55.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 -- 172.21.15.6:0/3518626602 wait complete. 2023-09-13T09:42:55.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 -- start start 2023-09-13T09:42:55.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 Processor -- start 2023-09-13T09:42:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733024260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e73307a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e73307cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73307d6d0 con 0x55e733016700 2023-09-13T09:42:55.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73307d840 con 0x55e733017060 2023-09-13T09:42:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73307da00 con 0x55e733015a00 2023-09-13T09:42:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f820b81eb80 10 client.0 _ll_register_callbacks cb 0x55e732f03680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f81fcbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e73307a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f81fcbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e73307a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35970/0 (socket says 172.21.15.6:35970) 2023-09-13T09:42:55.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f81fcbd4700 1 -- 172.21.15.6:0/2193459089 learned_addr learned my addr 172.21.15.6:0/2193459089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.925+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733024260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fdbd6700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e73307cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fd3d5700 1 -- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 msgr2=0x55e73307cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e73307cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fd3d5700 1 -- 172.21.15.6:0/2193459089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 msgr2=0x55e73307a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e73307a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fd3d5700 1 -- 172.21.15.6:0/2193459089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e732f7f7a0 con 0x55e733015a00 2023-09-13T09:42:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e73307a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81fd3d5700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733024260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81f4004e70 tx=0x7f81f401c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f478dc2c83a772a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:55.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81e0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:42:55.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81e0ff9700 1 -- 172.21.15.6:0/2193459089 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81f4009370 con 0x55e733015a00 2023-09-13T09:42:55.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81e0ff9700 1 -- 172.21.15.6:0/2193459089 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f81f403e080 con 0x55e733015a00 2023-09-13T09:42:55.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e732f21050 con 0x55e733015a00 2023-09-13T09:42:55.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f81e0ff9700 1 -- 172.21.15.6:0/2193459089 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81f401cdb0 con 0x55e733015a00 2023-09-13T09:42:55.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f820b81eb80 10 client.25753 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.926+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x7f81f81a1330 con 0x55e733015a00 2023-09-13T09:42:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f81e0ff9700 1 -- 172.21.15.6:0/2193459089 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e732f21050 con 0x55e733015a00 2023-09-13T09:42:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f81e0ff9700 1 -- 172.21.15.6:0/2193459089 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f81f40052d0 con 0x55e733015a00 2023-09-13T09:42:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f820b81eb80 10 client.25753 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f820b81eb80 10 client.25753 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:42:55.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f820b81eb80 20 client.25753 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f820b81eb80 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73307f110 0x55e733081530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f820b81eb80 4 client.25753 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e732db4f70 con 0x55e73307f110 2023-09-13T09:42:55.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.927+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73307f110 0x55e733081530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.928+0000 7f81e0ff9700 10 client.25753 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.928+0000 7f81fcbd4700 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73307f110 0x55e733081530 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f09c054f63e7fa7 server_cookie=57936a383ff8fe43 in_seq=0 out_seq=0 2023-09-13T09:42:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f81e0ff9700 1 -- 172.21.15.6:0/2193459089 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e732db4f70 con 0x55e73307f110 2023-09-13T09:42:55.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f81e0ff9700 10 client.25753 handle_command_reply: tid=0 2023-09-13T09:42:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 client.25753 shutdown 2023-09-13T09:42:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 msgr2=0x55e733024260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733024260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f81f4004e70 tx=0x7f81f401c8d0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 shutdown_connections 2023-09-13T09:42:55.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55e73307f110 0x55e733081530 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e733017060 0x55e73307cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e733015a00 0x55e733024260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 --2- 172.21.15.6:0/2193459089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e733016700 0x55e73307a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 >> 172.21.15.6:0/2193459089 conn(0x55e732f73c80 msgr2=0x55e73301dbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.929+0000 7f81e0ff9700 0 client.25753 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:42:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.930+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 shutdown_connections 2023-09-13T09:42:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.930+0000 7f820b81eb80 1 -- 172.21.15.6:0/2193459089 wait complete. 2023-09-13T09:42:55.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.930+0000 7f820b81eb80 20 client.25753 trim_cache size 0 max 16384 2023-09-13T09:42:55.953 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:55.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f81e40a0640 msgr2=0x7f81e40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f81e40a0640 0x7f81e40a2b00 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f81f8101e10 tx=0x7f81f4009260 comp rx=0 tx=0).stop 2023-09-13T09:42:55.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8101fb0 msgr2=0x7f81f80730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8101fb0 0x7f81f80730a0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f81ec00e9a0 tx=0x7f81ec00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 shutdown_connections 2023-09-13T09:42:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f8102950 0x7f81f80735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81f8100dc0 0x7f81f8074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f81e40a0640 0x7f81e40a2b00 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 --2- 172.21.15.6:0/3279730919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81f8101fb0 0x7f81f80730a0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 >> 172.21.15.6:0/3279730919 conn(0x7f81f80fc330 msgr2=0x7f81f8105400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 shutdown_connections 2023-09-13T09:42:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:55.931+0000 7f81ff639700 1 -- 172.21.15.6:0/3279730919 wait complete. 2023-09-13T09:42:55.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:42:56.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.086+0000 7f9de6855700 1 -- 172.21.15.6:0/4065737594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de00ffcc0 msgr2=0x7f9de01000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.086+0000 7f9de6855700 1 --2- 172.21.15.6:0/4065737594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de00ffcc0 0x7f9de01000e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009920 tx=0x7f9dd0009c30 comp rx=0 tx=0).stop 2023-09-13T09:42:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 -- 172.21.15.6:0/4065737594 shutdown_connections 2023-09-13T09:42:56.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 --2- 172.21.15.6:0/4065737594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9de0101850 0x7f9de0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 --2- 172.21.15.6:0/4065737594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de00ffcc0 0x7f9de01000e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 --2- 172.21.15.6:0/4065737594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 0x7f9de0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 -- 172.21.15.6:0/4065737594 >> 172.21.15.6:0/4065737594 conn(0x7f9de00fb250 msgr2=0x7f9de00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 -- 172.21.15.6:0/4065737594 shutdown_connections 2023-09-13T09:42:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 -- 172.21.15.6:0/4065737594 wait complete. 2023-09-13T09:42:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 Processor -- start 2023-09-13T09:42:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 -- start start 2023-09-13T09:42:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9de00ffcc0 0x7f9de00698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.087+0000 7f9de6855700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 0x7f9de019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9de6855700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de0101850 0x7f9de019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9de6855700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de019e640 con 0x7f9de0100eb0 2023-09-13T09:42:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9de6855700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de019e7b0 con 0x7f9de0101850 2023-09-13T09:42:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9de6855700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de019e970 con 0x7f9de00ffcc0 2023-09-13T09:42:56.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 0x7f9de019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9de00ffcc0 0x7f9de00698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 0x7f9de019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35984/0 (socket says 172.21.15.6:35984) 2023-09-13T09:42:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/3023685383 learned_addr learned my addr 172.21.15.6:0/3023685383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9de4df2700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de0101850 0x7f9de019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/3023685383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9de00ffcc0 msgr2=0x7f9de00698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9de00ffcc0 0x7f9de00698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/3023685383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de0101850 msgr2=0x7f9de019dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de0101850 0x7f9de019dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/3023685383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd40095f0 con 0x7f9de0100eb0 2023-09-13T09:42:56.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 0x7f9de019b860 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400ec10 tx=0x7f9dd400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3023685383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd400cc90 con 0x7f9de0100eb0 2023-09-13T09:42:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd0009520 con 0x7f9de0100eb0 2023-09-13T09:42:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3023685383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd40044e0 con 0x7f9de0100eb0 2023-09-13T09:42:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3023685383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4010430 con 0x7f9de0100eb0 2023-09-13T09:42:56.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.088+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0195a10 con 0x7f9de0100eb0 2023-09-13T09:42:56.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.092+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3023685383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9dd4003fb0 con 0x7f9de0100eb0 2023-09-13T09:42:56.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.092+0000 7f9ddd7fa700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9dc80a0640 0x7f9dc80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.092+0000 7f9ddd7fa700 1 -- 172.21.15.6:0/3023685383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9dd4014070 con 0x7f9de0100eb0 2023-09-13T09:42:56.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.092+0000 7f9ddffff700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9dc80a0640 0x7f9dc80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.092+0000 7f9df2a3ab80 1 Processor -- start 2023-09-13T09:42:56.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.092+0000 7f9df2a3ab80 1 -- start start 2023-09-13T09:42:56.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca33b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca324c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca32e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ec98b780 con 0x5639eca34060 2023-09-13T09:42:56.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ec9890a0 con 0x5639eca33700 2023-09-13T09:42:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ec984990 con 0x5639eca32a00 2023-09-13T09:42:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddffff700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9dc80a0640 0x7f9dc80a2b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00098f0 tx=0x7f9dd0019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca324c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35990/0 (socket says 172.21.15.6:35990) 2023-09-13T09:42:56.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/117314034 learned_addr learned my addr 172.21.15.6:0/117314034 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddffff700 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca33b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9de4df2700 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca32e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/117314034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 msgr2=0x5639eca32e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca32e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/117314034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 msgr2=0x5639eca33b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca33b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/117314034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639ec804630 con 0x5639eca34060 2023-09-13T09:42:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca324c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4095e00 tx=0x7f9dd4099440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c78e1abf6a5ff7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9dc67fc700 1 -- 172.21.15.6:0/117314034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd409a000 con 0x5639eca34060 2023-09-13T09:42:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9dc67fc700 1 -- 172.21.15.6:0/117314034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd4099900 con 0x5639eca34060 2023-09-13T09:42:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.093+0000 7f9dc67fc700 1 -- 172.21.15.6:0/117314034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd4097ca0 con 0x5639eca34060 2023-09-13T09:42:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/117314034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 msgr2=0x5639eca324c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca324c0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4095e00 tx=0x7f9dd4099440 comp rx=0 tx=0).stop 2023-09-13T09:42:56.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/117314034 shutdown_connections 2023-09-13T09:42:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca32e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca33b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/117314034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca324c0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/117314034 >> 172.21.15.6:0/117314034 conn(0x5639ec990c80 msgr2=0x5639eca2cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/117314034 shutdown_connections 2023-09-13T09:42:56.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.094+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/117314034 wait complete. 2023-09-13T09:42:56.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 -- start start 2023-09-13T09:42:56.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 Processor -- start 2023-09-13T09:42:56.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca434e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ec922bb0 con 0x5639eca33700 2023-09-13T09:42:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ec9228b0 con 0x5639eca32a00 2023-09-13T09:42:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639ec806920 con 0x5639eca34060 2023-09-13T09:42:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9df2a3ab80 10 client.0 _ll_register_callbacks cb 0x5639ec920680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:56.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35998/0 (socket says 172.21.15.6:35998) 2023-09-13T09:42:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57752/0 (socket says 172.21.15.6:57752) 2023-09-13T09:42:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/1509603190 learned_addr learned my addr 172.21.15.6:0/1509603190 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9de4df2700 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddffff700 1 -- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 msgr2=0x5639eca434e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddffff700 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca434e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddffff700 1 -- 172.21.15.6:0/1509603190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 msgr2=0x5639eca3c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddffff700 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.095+0000 7f9ddffff700 1 -- 172.21.15.6:0/1509603190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de0195a10 con 0x5639eca32a00 2023-09-13T09:42:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9ddffff700 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3bf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0000c00 tx=0x7f9dd0009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ae55af8c3da24a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9dbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:42:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/1509603190 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0005450 con 0x5639eca32a00 2023-09-13T09:42:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/1509603190 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9dd00055b0 con 0x5639eca32a00 2023-09-13T09:42:56.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639eca25670 con 0x5639eca32a00 2023-09-13T09:42:56.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/1509603190 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dd0003680 con 0x5639eca32a00 2023-09-13T09:42:56.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9df2a3ab80 10 client.25808 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:56.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5639ec99c7a0 con 0x5639eca32a00 2023-09-13T09:42:56.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/1509603190 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5639eca25670 con 0x5639eca32a00 2023-09-13T09:42:56.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/1509603190 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9dd00237d0 con 0x5639eca32a00 2023-09-13T09:42:56.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9df2a3ab80 10 client.25808 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:56.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9df2a3ab80 10 client.25808 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:42:56.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9df2a3ab80 20 client.25808 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:56.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.096+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca47d30 0x5639eca4a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.097+0000 7f9df2a3ab80 4 client.25808 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:56.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.097+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639ec97d970 con 0x5639eca47d30 2023-09-13T09:42:56.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.097+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca47d30 0x5639eca4a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.097+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca47d30 0x5639eca4a150 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=31c63079ce19279f server_cookie=69d986376890e75d in_seq=0 out_seq=0 2023-09-13T09:42:56.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.097+0000 7f9dbf7fe700 10 client.25808 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:56.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/1509603190 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5639ec97d970 con 0x5639eca47d30 2023-09-13T09:42:56.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9dbf7fe700 10 client.25808 handle_command_reply: tid=0 2023-09-13T09:42:56.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 client.25808 shutdown 2023-09-13T09:42:56.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 msgr2=0x5639eca3bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3bf60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0000c00 tx=0x7f9dd0009260 comp rx=0 tx=0).stop 2023-09-13T09:42:56.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 shutdown_connections 2023-09-13T09:42:56.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca47d30 0x5639eca4a150 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca434e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3bf60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/1509603190 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9dbf7fe700 0 client.25808 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:56.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 >> 172.21.15.6:0/1509603190 conn(0x5639ec990c80 msgr2=0x5639eca277f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 shutdown_connections 2023-09-13T09:42:56.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/1509603190 wait complete. 2023-09-13T09:42:56.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.098+0000 7f9df2a3ab80 20 client.25808 trim_cache size 0 max 16384 2023-09-13T09:42:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 Processor -- start 2023-09-13T09:42:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 -- start start 2023-09-13T09:42:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca324c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca434a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca3abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639eca2e730 con 0x5639eca34060 2023-09-13T09:42:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639eca3d0e0 con 0x5639eca33700 2023-09-13T09:42:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639eca374b0 con 0x5639eca32a00 2023-09-13T09:42:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9de4df2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca3abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9de4df2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca3abb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36008/0 (socket says 172.21.15.6:36008) 2023-09-13T09:42:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca434a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.111+0000 7f9de4df2700 1 -- 172.21.15.6:0/3859512657 learned_addr learned my addr 172.21.15.6:0/3859512657 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9ddffff700 1 -- 172.21.15.6:0/3859512657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 msgr2=0x5639eca434a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9ddffff700 1 --2- 172.21.15.6:0/3859512657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca434a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9ddffff700 1 -- 172.21.15.6:0/3859512657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 msgr2=0x5639eca3abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9ddffff700 1 --2- 172.21.15.6:0/3859512657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca3abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9ddffff700 1 -- 172.21.15.6:0/3859512657 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639ec7b0de0 con 0x5639eca32a00 2023-09-13T09:42:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9ddffff700 1 --2- 172.21.15.6:0/3859512657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca324c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009920 tx=0x7f9dd000bc20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e501e3f82a81a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9dc6ffd700 1 -- 172.21.15.6:0/3859512657 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd0005450 con 0x5639eca32a00 2023-09-13T09:42:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9dc6ffd700 1 -- 172.21.15.6:0/3859512657 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd002b040 con 0x5639eca32a00 2023-09-13T09:42:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.112+0000 7f9dc6ffd700 1 -- 172.21.15.6:0/3859512657 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00039b0 con 0x5639eca32a00 2023-09-13T09:42:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/3859512657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 msgr2=0x5639eca324c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/3859512657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca324c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009920 tx=0x7f9dd000bc20 comp rx=0 tx=0).stop 2023-09-13T09:42:56.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/3859512657 shutdown_connections 2023-09-13T09:42:56.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/3859512657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca34060 0x5639eca3abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/3859512657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca32a00 0x5639eca324c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/3859512657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca33700 0x5639eca434a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/3859512657 >> 172.21.15.6:0/3859512657 conn(0x5639ec990c80 msgr2=0x5639eca2d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/3859512657 shutdown_connections 2023-09-13T09:42:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/3859512657 wait complete. 2023-09-13T09:42:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 -- start start 2023-09-13T09:42:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 Processor -- start 2023-09-13T09:42:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca41fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.113+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639eca42500 con 0x5639eca33700 2023-09-13T09:42:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639eca42670 con 0x5639eca32a00 2023-09-13T09:42:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9df2a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639eca42830 con 0x5639eca34060 2023-09-13T09:42:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9df2a3ab80 10 client.0 _ll_register_callbacks cb 0x5639ec920680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36012/0 (socket says 172.21.15.6:36012) 2023-09-13T09:42:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57766/0 (socket says 172.21.15.6:57766) 2023-09-13T09:42:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/2951101944 learned_addr learned my addr 172.21.15.6:0/2951101944 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9de4df2700 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca41fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 msgr2=0x5639eca41fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca41fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/2951101944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 msgr2=0x5639eca3ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 -- 172.21.15.6:0/2951101944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639ec99c7a0 con 0x5639eca33700 2023-09-13T09:42:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddffff700 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9ddf7fe700 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3efa0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400c5b0 tx=0x7f9dd4099260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bd67a9eccbf2d2b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9dbf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/2951101944 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dd409a000 con 0x5639eca33700 2023-09-13T09:42:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/2951101944 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9dd40b6040 con 0x5639eca33700 2023-09-13T09:42:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9dd4099900 con 0x5639eca33700 2023-09-13T09:42:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/2951101944 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dd4003680 con 0x5639eca33700 2023-09-13T09:42:56.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9df2a3ab80 10 client.16329 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.114+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x5639ec799c60 con 0x5639eca33700 2023-09-13T09:42:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/2951101944 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9dd4099900 con 0x5639eca33700 2023-09-13T09:42:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/2951101944 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f9dd4098df0 con 0x5639eca33700 2023-09-13T09:42:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9df2a3ab80 10 client.16329 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9df2a3ab80 10 client.16329 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:42:56.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9df2a3ab80 20 client.16329 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca9bf20 0x5639eca9e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9df2a3ab80 4 client.16329 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5639ec93e050 con 0x5639eca9bf20 2023-09-13T09:42:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9ddffff700 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca9bf20 0x5639eca9e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9dbf7fe700 10 client.16329 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.115+0000 7f9ddffff700 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca9bf20 0x5639eca9e340 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=399b9426c3c986aa server_cookie=6302c7c08b06ecf3 in_seq=0 out_seq=0 2023-09-13T09:42:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9dbf7fe700 1 -- 172.21.15.6:0/2951101944 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5639ec93e050 con 0x5639eca9bf20 2023-09-13T09:42:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9dbf7fe700 10 client.16329 handle_command_reply: tid=0 2023-09-13T09:42:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 client.16329 shutdown 2023-09-13T09:42:56.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 msgr2=0x5639eca3efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3efa0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400c5b0 tx=0x7f9dd4099260 comp rx=0 tx=0).stop 2023-09-13T09:42:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 shutdown_connections 2023-09-13T09:42:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5639eca9bf20 0x5639eca9e340 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639eca34060 0x5639eca41fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639eca32a00 0x5639eca3ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9dbf7fe700 0 client.16329 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:42:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 --2- 172.21.15.6:0/2951101944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639eca33700 0x5639eca3efa0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 >> 172.21.15.6:0/2951101944 conn(0x5639ec990c80 msgr2=0x5639eca3abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 shutdown_connections 2023-09-13T09:42:56.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 1 -- 172.21.15.6:0/2951101944 wait complete. 2023-09-13T09:42:56.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9df2a3ab80 20 client.16329 trim_cache size 0 max 16384 2023-09-13T09:42:56.142 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:56.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9dc80a0640 msgr2=0x7f9dc80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9de6855700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9dc80a0640 0x7f9dc80a2b00 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00098f0 tx=0x7f9dd0019040 comp rx=0 tx=0).stop 2023-09-13T09:42:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 msgr2=0x7f9de019b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.116+0000 7f9de6855700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 0x7f9de019b860 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f9dd400ec10 tx=0x7f9dd400ef20 comp rx=0 tx=0).stop 2023-09-13T09:42:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 shutdown_connections 2023-09-13T09:42:56.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9de0101850 0x7f9de019dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9de00ffcc0 0x7f9de00698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9dc80a0640 0x7f9dc80a2b00 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 --2- 172.21.15.6:0/3023685383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de0100eb0 0x7f9de019b860 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 >> 172.21.15.6:0/3023685383 conn(0x7f9de00fb250 msgr2=0x7f9de00fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 shutdown_connections 2023-09-13T09:42:56.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.117+0000 7f9de6855700 1 -- 172.21.15.6:0/3023685383 wait complete. 2023-09-13T09:42:56.146 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:42:56.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 106911 4.76 MB/sec execute 16 sec latency 19.372 ms 2023-09-13T09:42:56.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:56 smithi131 ceph-mon[102785]: pgmap v402: 97 pgs: 97 active+clean; 57 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2023-09-13T09:42:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:56 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1686255650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:42:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 -- 172.21.15.6:0/665537021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 msgr2=0x7efe24103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 --2- 172.21.15.6:0/665537021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 0x7efe24103c90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7efe14009990 tx=0x7efe14009ca0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 -- 172.21.15.6:0/665537021 shutdown_connections 2023-09-13T09:42:56.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 --2- 172.21.15.6:0/665537021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe24106b00 0x7efe24108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 --2- 172.21.15.6:0/665537021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 0x7efe24103c90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 --2- 172.21.15.6:0/665537021 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe241041d0 0x7efe241065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 -- 172.21.15.6:0/665537021 >> 172.21.15.6:0/665537021 conn(0x7efe240fb250 msgr2=0x7efe240fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 -- 172.21.15.6:0/665537021 shutdown_connections 2023-09-13T09:42:56.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.276+0000 7efe28f80700 1 -- 172.21.15.6:0/665537021 wait complete. 2023-09-13T09:42:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.277+0000 7efe28f80700 1 Processor -- start 2023-09-13T09:42:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.277+0000 7efe28f80700 1 -- start start 2023-09-13T09:42:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe28f80700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 0x7efe24196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe28f80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe241041d0 0x7efe24196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe28f80700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe24106b00 0x7efe2419dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe28f80700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2419e5b0 con 0x7efe241041d0 2023-09-13T09:42:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe28f80700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2419e6f0 con 0x7efe24106b00 2023-09-13T09:42:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe28f80700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2419e880 con 0x7efe241018a0 2023-09-13T09:42:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe241041d0 0x7efe24196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe241041d0 0x7efe24196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36024/0 (socket says 172.21.15.6:36024) 2023-09-13T09:42:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe2259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 0x7efe24196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 -- 172.21.15.6:0/1303421834 learned_addr learned my addr 172.21.15.6:0/1303421834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe22d9d700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe24106b00 0x7efe2419dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 -- 172.21.15.6:0/1303421834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 msgr2=0x7efe24196a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 0x7efe24196a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 -- 172.21.15.6:0/1303421834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe24106b00 msgr2=0x7efe2419dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe24106b00 0x7efe2419dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 -- 172.21.15.6:0/1303421834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe140095f0 con 0x7efe241041d0 2023-09-13T09:42:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe2259c700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 0x7efe24196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe21d9b700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe241041d0 0x7efe24196f70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efe1800d980 tx=0x7efe1800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.278+0000 7efe137fe700 1 -- 172.21.15.6:0/1303421834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18004220 con 0x7efe241041d0 2023-09-13T09:42:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.279+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2419eb60 con 0x7efe241041d0 2023-09-13T09:42:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.279+0000 7efe137fe700 1 -- 172.21.15.6:0/1303421834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe18007640 con 0x7efe241041d0 2023-09-13T09:42:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.279+0000 7efe137fe700 1 -- 172.21.15.6:0/1303421834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe18005690 con 0x7efe241041d0 2023-09-13T09:42:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.279+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2419f0c0 con 0x7efe241041d0 2023-09-13T09:42:56.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.281+0000 7efe137fe700 1 -- 172.21.15.6:0/1303421834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7efe18004750 con 0x7efe241041d0 2023-09-13T09:42:56.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.281+0000 7efe137fe700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe0c0a0640 0x7efe0c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.281+0000 7efe2259c700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe0c0a0640 0x7efe0c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.281+0000 7efe137fe700 1 -- 172.21.15.6:0/1303421834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe180cba10 con 0x7efe241041d0 2023-09-13T09:42:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.282+0000 7efe2259c700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe0c0a0640 0x7efe0c0a2b00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efe1400b2e0 tx=0x7efe14005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.282+0000 7efe35165b80 1 Processor -- start 2023-09-13T09:42:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.282+0000 7efe35165b80 1 -- start start 2023-09-13T09:42:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe35165b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39efb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe35165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39f0060 0x55dea39ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe35165b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39eee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe35165b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea3947780 con 0x55dea39eea00 2023-09-13T09:42:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe35165b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea39450a0 con 0x55dea39ef700 2023-09-13T09:42:56.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe35165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea3940990 con 0x55dea39f0060 2023-09-13T09:42:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39efb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57786/0 (socket says 172.21.15.6:57786) 2023-09-13T09:42:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39eee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 -- 172.21.15.6:0/2717108020 learned_addr learned my addr 172.21.15.6:0/2717108020 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe21d9b700 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39f0060 0x55dea39ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 -- 172.21.15.6:0/2717108020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39f0060 msgr2=0x55dea39ee4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39f0060 0x55dea39ee4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 -- 172.21.15.6:0/2717108020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 msgr2=0x55dea39eee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39eee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 -- 172.21.15.6:0/2717108020 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dea37c0630 con 0x55dea39ef700 2023-09-13T09:42:56.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe22d9d700 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.283+0000 7efe2259c700 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39efb20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe14005850 tx=0x7efe14020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc51a3c7f66c224b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe10ff9700 1 -- 172.21.15.6:0/2717108020 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1402b070 con 0x55dea39ef700 2023-09-13T09:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe10ff9700 1 -- 172.21.15.6:0/2717108020 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe1401e040 con 0x55dea39ef700 2023-09-13T09:42:56.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe10ff9700 1 -- 172.21.15.6:0/2717108020 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14004c50 con 0x55dea39ef700 2023-09-13T09:42:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 -- 172.21.15.6:0/2717108020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 msgr2=0x55dea39efb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39efb20 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efe14005850 tx=0x7efe14020000 comp rx=0 tx=0).stop 2023-09-13T09:42:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 -- 172.21.15.6:0/2717108020 shutdown_connections 2023-09-13T09:42:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39eee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39efb20 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 --2- 172.21.15.6:0/2717108020 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39f0060 0x55dea39ee4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 -- 172.21.15.6:0/2717108020 >> 172.21.15.6:0/2717108020 conn(0x55dea394cc80 msgr2=0x55dea39e8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 -- 172.21.15.6:0/2717108020 shutdown_connections 2023-09-13T09:42:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.284+0000 7efe35165b80 1 -- 172.21.15.6:0/2717108020 wait complete. 2023-09-13T09:42:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 -- start start 2023-09-13T09:42:56.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 Processor -- start 2023-09-13T09:42:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39f8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39f0060 0x55dea39ff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea38debb0 con 0x55dea39f0060 2023-09-13T09:42:56.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea38de8b0 con 0x55dea39ef700 2023-09-13T09:42:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea37c2920 con 0x55dea39eea00 2023-09-13T09:42:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe35165b80 10 client.0 _ll_register_callbacks cb 0x55dea38dc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39f0060 0x55dea39ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39f0060 0x55dea39ff460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36040/0 (socket says 172.21.15.6:36040) 2023-09-13T09:42:56.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 -- 172.21.15.6:0/3343049977 learned_addr learned my addr 172.21.15.6:0/3343049977 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe2259c700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe21d9b700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39f8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 -- 172.21.15.6:0/3343049977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 msgr2=0x55dea39f7ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f7ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 -- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 msgr2=0x55dea39f8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39f8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe22d9d700 1 -- 172.21.15.6:0/3343049977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe24109b00 con 0x55dea39f0060 2023-09-13T09:42:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.285+0000 7efe2259c700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe22d9d700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39f0060 0x55dea39ff460 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efe1c011f70 tx=0x7efe1c014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7e872e67c0bf2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe09ffb700 1 -- 172.21.15.6:0/3343049977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1c00e040 con 0x55dea39f0060 2023-09-13T09:42:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dea39e1670 con 0x55dea39f0060 2023-09-13T09:42:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe09ffb700 1 -- 172.21.15.6:0/3343049977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe1c01a070 con 0x55dea39f0060 2023-09-13T09:42:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe09ffb700 1 -- 172.21.15.6:0/3343049977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe1c014ba0 con 0x55dea39f0060 2023-09-13T09:42:56.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 10 client.16341 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55dea39587a0 con 0x55dea39f0060 2023-09-13T09:42:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe09ffb700 1 -- 172.21.15.6:0/3343049977 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dea39e1670 con 0x55dea39f0060 2023-09-13T09:42:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe09ffb700 1 -- 172.21.15.6:0/3343049977 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efe1c004400 con 0x55dea39f0060 2023-09-13T09:42:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 10 client.16341 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:56.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 20 client.16341 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a03d60 0x55dea3a06180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 4 client.16341 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.286+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dea3939970 con 0x55dea3a03d60 2023-09-13T09:42:56.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.287+0000 7efe2259c700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a03d60 0x55dea3a06180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.287+0000 7efe09ffb700 10 client.16341 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.287+0000 7efe2259c700 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a03d60 0x55dea3a06180 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1850326390f7d5da server_cookie=8f36e279fbc443b6 in_seq=0 out_seq=0 2023-09-13T09:42:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.288+0000 7efe09ffb700 1 -- 172.21.15.6:0/3343049977 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dea3939970 con 0x55dea3a03d60 2023-09-13T09:42:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.288+0000 7efe09ffb700 10 client.16341 handle_command_reply: tid=0 2023-09-13T09:42:56.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 client.16341 shutdown 2023-09-13T09:42:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39f0060 msgr2=0x55dea39ff460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39f0060 0x55dea39ff460 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7efe1c011f70 tx=0x7efe1c014600 comp rx=0 tx=0).stop 2023-09-13T09:42:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 shutdown_connections 2023-09-13T09:42:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a03d60 0x55dea3a06180 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39f0060 0x55dea39ff460 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f7ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe09ffb700 0 client.16341 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 --2- 172.21.15.6:0/3343049977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39ef700 0x55dea39f8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 >> 172.21.15.6:0/3343049977 conn(0x55dea394cc80 msgr2=0x55dea39e37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 shutdown_connections 2023-09-13T09:42:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 1 -- 172.21.15.6:0/3343049977 wait complete. 2023-09-13T09:42:56.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.289+0000 7efe35165b80 20 client.16341 trim_cache size 0 max 16384 2023-09-13T09:42:56.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 Processor -- start 2023-09-13T09:42:56.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 -- start start 2023-09-13T09:42:56.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39ef700 0x55dea39e9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea39f6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea39e9c00 con 0x55dea39eea00 2023-09-13T09:42:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea39f5be0 con 0x55dea39f0060 2023-09-13T09:42:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.302+0000 7efe35165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea39f34f0 con 0x55dea39ef700 2023-09-13T09:42:56.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39ee4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36044/0 (socket says 172.21.15.6:36044) 2023-09-13T09:42:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 -- 172.21.15.6:0/2019366587 learned_addr learned my addr 172.21.15.6:0/2019366587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe21d9b700 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39ef700 0x55dea39e9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe22d9d700 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea39f6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 -- 172.21.15.6:0/2019366587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39ef700 msgr2=0x55dea39e9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39ef700 0x55dea39e9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 -- 172.21.15.6:0/2019366587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 msgr2=0x55dea39f6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea39f6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 -- 172.21.15.6:0/2019366587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dea376cde0 con 0x55dea39eea00 2023-09-13T09:42:56.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe2259c700 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39ee4c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efe140098e0 tx=0x7efe14028040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3b5e6f74802035 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe117fa700 1 -- 172.21.15.6:0/2019366587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14036040 con 0x55dea39eea00 2023-09-13T09:42:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe117fa700 1 -- 172.21.15.6:0/2019366587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe140048a0 con 0x55dea39eea00 2023-09-13T09:42:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.303+0000 7efe117fa700 1 -- 172.21.15.6:0/2019366587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1402b040 con 0x55dea39eea00 2023-09-13T09:42:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- 172.21.15.6:0/2019366587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 msgr2=0x55dea39ee4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39ee4c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7efe140098e0 tx=0x7efe14028040 comp rx=0 tx=0).stop 2023-09-13T09:42:56.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- 172.21.15.6:0/2019366587 shutdown_connections 2023-09-13T09:42:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea39f6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39eea00 0x55dea39ee4c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 --2- 172.21.15.6:0/2019366587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39ef700 0x55dea39e9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- 172.21.15.6:0/2019366587 >> 172.21.15.6:0/2019366587 conn(0x55dea394cc80 msgr2=0x55dea39e8e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- 172.21.15.6:0/2019366587 shutdown_connections 2023-09-13T09:42:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- 172.21.15.6:0/2019366587 wait complete. 2023-09-13T09:42:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- start start 2023-09-13T09:42:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 Processor -- start 2023-09-13T09:42:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39ef700 0x55dea39f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea3a5a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea3a5a680 con 0x55dea39ef700 2023-09-13T09:42:56.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea3a5a7c0 con 0x55dea39f0060 2023-09-13T09:42:56.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dea3a5a980 con 0x55dea39eea00 2023-09-13T09:42:56.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe35165b80 10 client.0 _ll_register_callbacks cb 0x55dea38dc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.304+0000 7efe21d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39ef700 0x55dea39f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39ef700 0x55dea39f4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36052/0 (socket says 172.21.15.6:36052) 2023-09-13T09:42:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe2259c700 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 -- 172.21.15.6:0/2290050079 learned_addr learned my addr 172.21.15.6:0/2290050079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:56.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe22d9d700 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea3a5a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 -- 172.21.15.6:0/2290050079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 msgr2=0x55dea39f49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 -- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 msgr2=0x55dea3a5a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea3a5a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 -- 172.21.15.6:0/2290050079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dea37c0630 con 0x55dea39ef700 2023-09-13T09:42:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe21d9b700 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39ef700 0x55dea39f4ee0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c00 tx=0x7efe18005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2418d7c525c3ec server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe09ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe09ffb700 1 -- 172.21.15.6:0/2290050079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe180a1220 con 0x55dea39ef700 2023-09-13T09:42:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe09ffb700 1 -- 172.21.15.6:0/2290050079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe18004380 con 0x55dea39ef700 2023-09-13T09:42:56.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe1401e040 con 0x55dea39ef700 2023-09-13T09:42:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe09ffb700 1 -- 172.21.15.6:0/2290050079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe180986a0 con 0x55dea39ef700 2023-09-13T09:42:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe35165b80 10 client.16347 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55dea3755c60 con 0x55dea39ef700 2023-09-13T09:42:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.305+0000 7efe09ffb700 1 -- 172.21.15.6:0/2290050079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe1401e040 con 0x55dea39ef700 2023-09-13T09:42:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe09ffb700 1 -- 172.21.15.6:0/2290050079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7efe18094fa0 con 0x55dea39ef700 2023-09-13T09:42:56.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 10 client.16347 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:56.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 10 client.16347 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:56.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 20 client.16347 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:56.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a5c460 0x55dea3a5e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:56.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 4 client.16347 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:42:56.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dea38fa050 con 0x55dea3a5c460 2023-09-13T09:42:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe2259c700 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a5c460 0x55dea3a5e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe09ffb700 10 client.16347 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe2259c700 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a5c460 0x55dea3a5e880 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b811e5385d8e318 server_cookie=299f7a1ba3960c71 in_seq=0 out_seq=0 2023-09-13T09:42:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe09ffb700 1 -- 172.21.15.6:0/2290050079 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dea38fa050 con 0x55dea3a5c460 2023-09-13T09:42:56.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe09ffb700 10 client.16347 handle_command_reply: tid=0 2023-09-13T09:42:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 1 client.16347 shutdown 2023-09-13T09:42:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39ef700 msgr2=0x55dea39f4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.306+0000 7efe35165b80 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39ef700 0x55dea39f4ee0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7efe18000c00 tx=0x7efe18005c80 comp rx=0 tx=0).stop 2023-09-13T09:42:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 shutdown_connections 2023-09-13T09:42:56.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dea39f0060 0x55dea3a5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dea39eea00 0x55dea39f49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55dea3a5c460 0x55dea3a5e880 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 --2- 172.21.15.6:0/2290050079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dea39ef700 0x55dea39f4ee0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe09ffb700 0 client.16347 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:56.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 >> 172.21.15.6:0/2290050079 conn(0x55dea394cc80 msgr2=0x55dea39f6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 shutdown_connections 2023-09-13T09:42:56.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 1 -- 172.21.15.6:0/2290050079 wait complete. 2023-09-13T09:42:56.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe35165b80 20 client.16347 trim_cache size 0 max 16384 2023-09-13T09:42:56.333 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:42:56.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe0c0a0640 msgr2=0x7efe0c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe0c0a0640 0x7efe0c0a2b00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7efe1400b2e0 tx=0x7efe14005fb0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe241041d0 msgr2=0x7efe24196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:56.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe241041d0 0x7efe24196f70 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7efe1800d980 tx=0x7efe1800dc90 comp rx=0 tx=0).stop 2023-09-13T09:42:56.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 shutdown_connections 2023-09-13T09:42:56.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe24106b00 0x7efe2419dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe241018a0 0x7efe24196a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe0c0a0640 0x7efe0c0a2b00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 --2- 172.21.15.6:0/1303421834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe241041d0 0x7efe24196f70 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:56.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 >> 172.21.15.6:0/1303421834 conn(0x7efe240fb250 msgr2=0x7efe24102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:56.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 shutdown_connections 2023-09-13T09:42:56.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:56.307+0000 7efe28f80700 1 -- 172.21.15.6:0/1303421834 wait complete. 2023-09-13T09:42:56.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:56 smithi006 ceph-mon[98665]: pgmap v402: 97 pgs: 97 active+clean; 57 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2023-09-13T09:42:56.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:56 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1686255650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:42:56.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:56 smithi053 ceph-mon[102373]: pgmap v402: 97 pgs: 97 active+clean; 57 MiB data, 643 MiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2023-09-13T09:42:56.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:56 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1686255650' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:42:57.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 107117 4.48 MB/sec execute 17 sec latency 789.466 ms 2023-09-13T09:42:57.338 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:42:57.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:42:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 -- 172.21.15.6:0/2789352121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 msgr2=0x7f1168107870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 --2- 172.21.15.6:0/2789352121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 0x7f1168107870 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f116000b0d0 tx=0x7f116000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 -- 172.21.15.6:0/2789352121 shutdown_connections 2023-09-13T09:42:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 --2- 172.21.15.6:0/2789352121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 0x7f1168107870 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 --2- 172.21.15.6:0/2789352121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 0x7f11680ff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 --2- 172.21.15.6:0/2789352121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168100620 0x7f1168100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 -- 172.21.15.6:0/2789352121 >> 172.21.15.6:0/2789352121 conn(0x7f11680fa9a0 msgr2=0x7f11680fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 -- 172.21.15.6:0/2789352121 shutdown_connections 2023-09-13T09:42:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.484+0000 7f116d76e700 1 -- 172.21.15.6:0/2789352121 wait complete. 2023-09-13T09:42:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 Processor -- start 2023-09-13T09:42:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 -- start start 2023-09-13T09:42:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 0x7f1168196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168100620 0x7f1168197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 0x7f116819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116819e6a0 con 0x7f1168100fc0 2023-09-13T09:42:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116819e7e0 con 0x7f11680ff430 2023-09-13T09:42:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f116d76e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116819e970 con 0x7f1168100620 2023-09-13T09:42:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f11677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 0x7f116819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 0x7f1168196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f11667fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168100620 0x7f1168197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 0x7f1168196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57820/0 (socket says 172.21.15.6:57820) 2023-09-13T09:42:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.485+0000 7f1166ffd700 1 -- 172.21.15.6:0/3896620158 learned_addr learned my addr 172.21.15.6:0/3896620158 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f11677fe700 1 -- 172.21.15.6:0/3896620158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168100620 msgr2=0x7f1168197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f11677fe700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168100620 0x7f1168197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f11677fe700 1 -- 172.21.15.6:0/3896620158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 msgr2=0x7f1168196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f11677fe700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 0x7f1168196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f11677fe700 1 -- 172.21.15.6:0/3896620158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1160009d00 con 0x7f1168100fc0 2023-09-13T09:42:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f1166ffd700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 0x7f1168196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f11677fe700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 0x7f116819e0d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f116000b820 tx=0x7f11600094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f114ffff700 1 -- 172.21.15.6:0/3896620158 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116000e040 con 0x7f1168100fc0 2023-09-13T09:42:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f114ffff700 1 -- 172.21.15.6:0/3896620158 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f116001dd50 con 0x7f1168100fc0 2023-09-13T09:42:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116819ebf0 con 0x7f1168100fc0 2023-09-13T09:42:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f114ffff700 1 -- 172.21.15.6:0/3896620158 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1160012d60 con 0x7f1168100fc0 2023-09-13T09:42:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.486+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116819f070 con 0x7f1168100fc0 2023-09-13T09:42:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.488+0000 7f114ffff700 1 -- 172.21.15.6:0/3896620158 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1160012470 con 0x7f1168100fc0 2023-09-13T09:42:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.489+0000 7f114ffff700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11500a0640 0x7f11500a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.489+0000 7f114ffff700 1 -- 172.21.15.6:0/3896620158 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f11600cd810 con 0x7f1168100fc0 2023-09-13T09:42:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.489+0000 7f1166ffd700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11500a0640 0x7f11500a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1166ffd700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11500a0640 0x7f11500a2b00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f115c007fd0 tx=0x7f115c007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 Processor -- start 2023-09-13T09:42:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 -- start start 2023-09-13T09:42:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88efcba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88efb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88efbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88e54800 con 0x55bf88efd0e0 2023-09-13T09:42:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88e52120 con 0x55bf88efc780 2023-09-13T09:42:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1179953b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88e4da10 con 0x55bf88efba80 2023-09-13T09:42:57.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f11667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88efb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f11667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88efb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36074/0 (socket says 172.21.15.6:36074) 2023-09-13T09:42:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f11667fc700 1 -- 172.21.15.6:0/137000700 learned_addr learned my addr 172.21.15.6:0/137000700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f1166ffd700 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88efcba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f11677fe700 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88efbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.490+0000 7f11667fc700 1 -- 172.21.15.6:0/137000700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 msgr2=0x55bf88efbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f11667fc700 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88efbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f11667fc700 1 -- 172.21.15.6:0/137000700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 msgr2=0x55bf88efcba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f11667fc700 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88efcba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f11667fc700 1 -- 172.21.15.6:0/137000700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf88ccd6b0 con 0x55bf88efd0e0 2023-09-13T09:42:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f11677fe700 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88efbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f11667fc700 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88efb540 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f115800bd70 tx=0x7f115800e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ef80e86e325b6a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f114d7fa700 1 -- 172.21.15.6:0/137000700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158013070 con 0x55bf88efd0e0 2023-09-13T09:42:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f114d7fa700 1 -- 172.21.15.6:0/137000700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f115800db10 con 0x55bf88efd0e0 2023-09-13T09:42:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.491+0000 7f114d7fa700 1 -- 172.21.15.6:0/137000700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115800c9b0 con 0x55bf88efd0e0 2023-09-13T09:42:57.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- 172.21.15.6:0/137000700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 msgr2=0x55bf88efb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88efb540 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f115800bd70 tx=0x7f115800e730 comp rx=0 tx=0).stop 2023-09-13T09:42:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- 172.21.15.6:0/137000700 shutdown_connections 2023-09-13T09:42:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88efbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88efcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 --2- 172.21.15.6:0/137000700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88efb540 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- 172.21.15.6:0/137000700 >> 172.21.15.6:0/137000700 conn(0x55bf88e59d00 msgr2=0x55bf88ef5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- 172.21.15.6:0/137000700 shutdown_connections 2023-09-13T09:42:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- 172.21.15.6:0/137000700 wait complete. 2023-09-13T09:42:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- start start 2023-09-13T09:42:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 Processor -- start 2023-09-13T09:42:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f04f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efc780 0x55bf88f05470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f0c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88debc30 con 0x55bf88efc780 2023-09-13T09:42:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88deb930 con 0x55bf88efd0e0 2023-09-13T09:42:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88ccf9a0 con 0x55bf88efba80 2023-09-13T09:42:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.492+0000 7f1179953b80 10 client.0 _ll_register_callbacks cb 0x55bf88de9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efc780 0x55bf88f05470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efc780 0x55bf88f05470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36080/0 (socket says 172.21.15.6:36080) 2023-09-13T09:42:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 -- 172.21.15.6:0/2437095448 learned_addr learned my addr 172.21.15.6:0/2437095448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11677fe700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f0c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f1166ffd700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f04f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 -- 172.21.15.6:0/2437095448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 msgr2=0x55bf88f04f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f04f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 -- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 msgr2=0x55bf88f0c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f0c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 -- 172.21.15.6:0/2437095448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115800ba20 con 0x55bf88efc780 2023-09-13T09:42:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11677fe700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f0c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:57.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f11667fc700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efc780 0x55bf88f05470 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1158010040 tx=0x7f115800d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2770e9e2ae532eba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f114aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f114aff5700 1 -- 172.21.15.6:0/2437095448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158024070 con 0x55bf88efc780 2023-09-13T09:42:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf88eee6f0 con 0x55bf88efc780 2023-09-13T09:42:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f114aff5700 1 -- 172.21.15.6:0/2437095448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1158005250 con 0x55bf88efc780 2023-09-13T09:42:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.493+0000 7f114aff5700 1 -- 172.21.15.6:0/2437095448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1158013040 con 0x55bf88efc780 2023-09-13T09:42:57.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 10 client.16359 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55bf88e65820 con 0x55bf88efc780 2023-09-13T09:42:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f114aff5700 1 -- 172.21.15.6:0/2437095448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f115802e020 con 0x55bf88efc780 2023-09-13T09:42:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f114aff5700 1 -- 172.21.15.6:0/2437095448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f1158027030 con 0x55bf88efc780 2023-09-13T09:42:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 10 client.16359 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:57.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 10 client.16359 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 20 client.16359 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f10da0 0x55bf88f131c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 4 client.16359 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf88e469f0 con 0x55bf88f10da0 2023-09-13T09:42:57.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.494+0000 7f1166ffd700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f10da0 0x55bf88f131c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.495+0000 7f114aff5700 10 client.16359 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.495+0000 7f1166ffd700 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f10da0 0x55bf88f131c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce77e8330a7e9c1 server_cookie=c80c7ded38100b32 in_seq=0 out_seq=0 2023-09-13T09:42:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.495+0000 7f114aff5700 1 -- 172.21.15.6:0/2437095448 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bf88e469f0 con 0x55bf88f10da0 2023-09-13T09:42:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.495+0000 7f114aff5700 10 client.16359 handle_command_reply: tid=0 2023-09-13T09:42:57.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.495+0000 7f1179953b80 1 client.16359 shutdown 2023-09-13T09:42:57.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.495+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efc780 msgr2=0x55bf88f05470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efc780 0x55bf88f05470 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1158010040 tx=0x7f115800d880 comp rx=0 tx=0).stop 2023-09-13T09:42:57.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 shutdown_connections 2023-09-13T09:42:57.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f0c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f04f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f10da0 0x55bf88f131c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 --2- 172.21.15.6:0/2437095448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efc780 0x55bf88f05470 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f114aff5700 0 client.16359 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 >> 172.21.15.6:0/2437095448 conn(0x55bf88e59d00 msgr2=0x55bf88ef0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 shutdown_connections 2023-09-13T09:42:57.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 1 -- 172.21.15.6:0/2437095448 wait complete. 2023-09-13T09:42:57.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.496+0000 7f1179953b80 20 client.16359 trim_cache size 0 max 16384 2023-09-13T09:42:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 Processor -- start 2023-09-13T09:42:57.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 -- start start 2023-09-13T09:42:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efba80 0x55bf88efb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efc780 0x55bf88f0c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f04f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88f04b00 con 0x55bf88efba80 2023-09-13T09:42:57.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88ef77b0 con 0x55bf88efd0e0 2023-09-13T09:42:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1179953b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88eee480 con 0x55bf88efc780 2023-09-13T09:42:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efba80 0x55bf88efb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efba80 0x55bf88efb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36086/0 (socket says 172.21.15.6:36086) 2023-09-13T09:42:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 -- 172.21.15.6:0/1347791533 learned_addr learned my addr 172.21.15.6:0/1347791533 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f11667fc700 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efc780 0x55bf88f0c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f11677fe700 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f04f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 -- 172.21.15.6:0/1347791533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efc780 msgr2=0x55bf88f0c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efc780 0x55bf88f0c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 -- 172.21.15.6:0/1347791533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 msgr2=0x55bf88f04f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f04f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f1166ffd700 1 -- 172.21.15.6:0/1347791533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf88f17db0 con 0x55bf88efba80 2023-09-13T09:42:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f11677fe700 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f04f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.513+0000 7f11667fc700 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efc780 0x55bf88f0c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1166ffd700 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efba80 0x55bf88efb540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f115c005d90 tx=0x7f115c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9286461f10b483cd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f114dffb700 1 -- 172.21.15.6:0/1347791533 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c024040 con 0x55bf88efba80 2023-09-13T09:42:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f114dffb700 1 -- 172.21.15.6:0/1347791533 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f115c015070 con 0x55bf88efba80 2023-09-13T09:42:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f114dffb700 1 -- 172.21.15.6:0/1347791533 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0038e0 con 0x55bf88efba80 2023-09-13T09:42:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 -- 172.21.15.6:0/1347791533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efba80 msgr2=0x55bf88efb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efba80 0x55bf88efb540 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f115c005d90 tx=0x7f115c013000 comp rx=0 tx=0).stop 2023-09-13T09:42:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 -- 172.21.15.6:0/1347791533 shutdown_connections 2023-09-13T09:42:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efd0e0 0x55bf88f04f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efba80 0x55bf88efb540 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 --2- 172.21.15.6:0/1347791533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efc780 0x55bf88f0c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 -- 172.21.15.6:0/1347791533 >> 172.21.15.6:0/1347791533 conn(0x55bf88e59d00 msgr2=0x55bf88f02d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 -- 172.21.15.6:0/1347791533 shutdown_connections 2023-09-13T09:42:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.514+0000 7f1179953b80 1 -- 172.21.15.6:0/1347791533 wait complete. 2023-09-13T09:42:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 -- start start 2023-09-13T09:42:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 Processor -- start 2023-09-13T09:42:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f0be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88f0c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88f089b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88f090c0 con 0x55bf88efd0e0 2023-09-13T09:42:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88f09230 con 0x55bf88efc780 2023-09-13T09:42:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf88f093f0 con 0x55bf88efba80 2023-09-13T09:42:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1179953b80 10 client.0 _ll_register_callbacks cb 0x55bf88de9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f11677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88f089b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f11667fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88f0c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f11677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88f089b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36096/0 (socket says 172.21.15.6:36096) 2023-09-13T09:42:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f11677fe700 1 -- 172.21.15.6:0/499384907 learned_addr learned my addr 172.21.15.6:0/499384907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.515+0000 7f1166ffd700 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f0be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f11677fe700 1 -- 172.21.15.6:0/499384907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 msgr2=0x55bf88f0be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f11677fe700 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f0be90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f11677fe700 1 -- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 msgr2=0x55bf88f0c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f11677fe700 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88f0c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f11677fe700 1 -- 172.21.15.6:0/499384907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c011950 con 0x55bf88efd0e0 2023-09-13T09:42:57.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f11667fc700 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88f0c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:57.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f11677fe700 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88f089b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f116000b0d0 tx=0x7f1160009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaac93e32592a4e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f114aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:57.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f114aff5700 1 -- 172.21.15.6:0/499384907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116009a9a0 con 0x55bf88efd0e0 2023-09-13T09:42:57.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f114aff5700 1 -- 172.21.15.6:0/499384907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f116009b740 con 0x55bf88efd0e0 2023-09-13T09:42:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f115800db10 con 0x55bf88efd0e0 2023-09-13T09:42:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f114aff5700 1 -- 172.21.15.6:0/499384907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f116009b040 con 0x55bf88efd0e0 2023-09-13T09:42:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f1179953b80 10 client.16365 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55bf88c79e60 con 0x55bf88efd0e0 2023-09-13T09:42:57.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f114aff5700 1 -- 172.21.15.6:0/499384907 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f115800db10 con 0x55bf88efd0e0 2023-09-13T09:42:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f114aff5700 1 -- 172.21.15.6:0/499384907 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f116009b3c0 con 0x55bf88efd0e0 2023-09-13T09:42:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f1179953b80 10 client.16365 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f1179953b80 10 client.16365 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.516+0000 7f1179953b80 20 client.16365 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.517+0000 7f1179953b80 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f661b0 0x55bf88f685d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.517+0000 7f1179953b80 4 client.16365 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:42:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.517+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bf88e070d0 con 0x55bf88f661b0 2023-09-13T09:42:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.517+0000 7f1166ffd700 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f661b0 0x55bf88f685d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.517+0000 7f114aff5700 10 client.16365 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.517+0000 7f1166ffd700 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f661b0 0x55bf88f685d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0a388875e3e806 server_cookie=d65bc891ee2e1c92 in_seq=0 out_seq=0 2023-09-13T09:42:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f114aff5700 1 -- 172.21.15.6:0/499384907 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bf88e070d0 con 0x55bf88f661b0 2023-09-13T09:42:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f114aff5700 10 client.16365 handle_command_reply: tid=0 2023-09-13T09:42:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 client.16365 shutdown 2023-09-13T09:42:57.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 msgr2=0x55bf88f089b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88f089b0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f116000b0d0 tx=0x7f1160009c70 comp rx=0 tx=0).stop 2023-09-13T09:42:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 shutdown_connections 2023-09-13T09:42:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf88f661b0 0x55bf88f685d0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf88efd0e0 0x55bf88f089b0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f114aff5700 0 client.16365 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf88efba80 0x55bf88f0be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 --2- 172.21.15.6:0/499384907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf88efc780 0x55bf88f0c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 >> 172.21.15.6:0/499384907 conn(0x55bf88e59d00 msgr2=0x55bf88f04ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 shutdown_connections 2023-09-13T09:42:57.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 1 -- 172.21.15.6:0/499384907 wait complete. 2023-09-13T09:42:57.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f1179953b80 20 client.16365 trim_cache size 0 max 16384 2023-09-13T09:42:57.544 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:42:57.544 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:42:57.545 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "36328566-148c-4918-9fe9-f25b4d841473", 2023-09-13T09:42:57.545 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:42:57.545 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:42:57.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11500a0640 msgr2=0x7f11500a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11500a0640 0x7f11500a2b00 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f115c007fd0 tx=0x7f115c007480 comp rx=0 tx=0).stop 2023-09-13T09:42:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 msgr2=0x7f116819e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 0x7f116819e0d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f116000b820 tx=0x7f11600094c0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 shutdown_connections 2023-09-13T09:42:57.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f11500a0640 0x7f11500a2b00 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1168100fc0 0x7f116819e0d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f11680ff430 0x7f1168196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.519+0000 7f116d76e700 1 --2- 172.21.15.6:0/3896620158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1168100620 0x7f1168197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.520+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 >> 172.21.15.6:0/3896620158 conn(0x7f11680fa9a0 msgr2=0x7f11680fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.520+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 shutdown_connections 2023-09-13T09:42:57.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.520+0000 7f116d76e700 1 -- 172.21.15.6:0/3896620158 wait complete. 2023-09-13T09:42:57.549 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:42:57.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 -- 172.21.15.6:0/99560610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81640fff00 msgr2=0x7f8164100380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 --2- 172.21.15.6:0/99560610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81640fff00 0x7f8164100380 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8154009990 tx=0x7f8154009ca0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 -- 172.21.15.6:0/99560610 shutdown_connections 2023-09-13T09:42:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 --2- 172.21.15.6:0/99560610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81641008c0 0x7f8164108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 --2- 172.21.15.6:0/99560610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8164101340 0x7f8164101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 --2- 172.21.15.6:0/99560610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81640fff00 0x7f8164100380 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 -- 172.21.15.6:0/99560610 >> 172.21.15.6:0/99560610 conn(0x7f81640fa9b0 msgr2=0x7f81640fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 -- 172.21.15.6:0/99560610 shutdown_connections 2023-09-13T09:42:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.681+0000 7f8169170700 1 -- 172.21.15.6:0/99560610 wait complete. 2023-09-13T09:42:57.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 Processor -- start 2023-09-13T09:42:57.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 -- start start 2023-09-13T09:42:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81640fff00 0x7f8164196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81641008c0 0x7f8164197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8164101340 0x7f816419e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816419e640 con 0x7f8164101340 2023-09-13T09:42:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816419e780 con 0x7f81641008c0 2023-09-13T09:42:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8169170700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f816419e910 con 0x7f81640fff00 2023-09-13T09:42:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f816359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8164101340 0x7f816419e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f816259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81641008c0 0x7f8164197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f8162d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81640fff00 0x7f8164196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f816359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8164101340 0x7f816419e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36110/0 (socket says 172.21.15.6:36110) 2023-09-13T09:42:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f816259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81641008c0 0x7f8164197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:57864/0 (socket says 172.21.15.6:57864) 2023-09-13T09:42:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.682+0000 7f816359e700 1 -- 172.21.15.6:0/2188194445 learned_addr learned my addr 172.21.15.6:0/2188194445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f816359e700 1 -- 172.21.15.6:0/2188194445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81640fff00 msgr2=0x7f8164196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f816359e700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81640fff00 0x7f8164196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f816359e700 1 -- 172.21.15.6:0/2188194445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81641008c0 msgr2=0x7f8164197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f816359e700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81641008c0 0x7f8164197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f816359e700 1 -- 172.21.15.6:0/2188194445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81540095f0 con 0x7f8164101340 2023-09-13T09:42:57.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f816259c700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81641008c0 0x7f8164197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:57.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f8162d9d700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81640fff00 0x7f8164196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:57.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f816359e700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8164101340 0x7f816419e070 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f815c00ef30 tx=0x7f815c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f814bfff700 1 -- 172.21.15.6:0/2188194445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c018070 con 0x7f8164101340 2023-09-13T09:42:57.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f814bfff700 1 -- 172.21.15.6:0/2188194445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f815c00f040 con 0x7f8164101340 2023-09-13T09:42:57.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f816419eb90 con 0x7f8164101340 2023-09-13T09:42:57.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f814bfff700 1 -- 172.21.15.6:0/2188194445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c00cd00 con 0x7f8164101340 2023-09-13T09:42:57.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.683+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816419f0a0 con 0x7f8164101340 2023-09-13T09:42:57.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.685+0000 7f814bfff700 1 -- 172.21.15.6:0/2188194445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f815c003a00 con 0x7f8164101340 2023-09-13T09:42:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.686+0000 7f814bfff700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f814c0a0640 0x7f814c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.686+0000 7f8162d9d700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f814c0a0640 0x7f814c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.686+0000 7f814bfff700 1 -- 172.21.15.6:0/2188194445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f815c0cb6e0 con 0x7f8164101340 2023-09-13T09:42:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8162d9d700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f814c0a0640 0x7f814c0a2b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8158007fd0 tx=0x7f81580073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 Processor -- start 2023-09-13T09:42:57.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 -- start start 2023-09-13T09:42:57.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778d9f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778d9fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778cf8780 con 0x556778d9fa00 2023-09-13T09:42:57.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778cf60a0 con 0x556778da0700 2023-09-13T09:42:57.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f8175355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778cf1990 con 0x556778da1060 2023-09-13T09:42:57.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.687+0000 7f816359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778d9fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778d9fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36118/0 (socket says 172.21.15.6:36118) 2023-09-13T09:42:57.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 -- 172.21.15.6:0/1548720046 learned_addr learned my addr 172.21.15.6:0/1548720046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f8162d9d700 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816259c700 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778d9f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 -- 172.21.15.6:0/1548720046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 msgr2=0x556778d9f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778d9f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 -- 172.21.15.6:0/1548720046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 msgr2=0x556778da0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 -- 172.21.15.6:0/1548720046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556778b71630 con 0x556778d9fa00 2023-09-13T09:42:57.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f816359e700 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778d9fe80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f815c095980 tx=0x7f815c098ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ef80c2dc224b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f81497fa700 1 -- 172.21.15.6:0/1548720046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c01b320 con 0x556778d9fa00 2023-09-13T09:42:57.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f81497fa700 1 -- 172.21.15.6:0/1548720046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f815c099610 con 0x556778d9fa00 2023-09-13T09:42:57.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.688+0000 7f81497fa700 1 -- 172.21.15.6:0/1548720046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c099170 con 0x556778d9fa00 2023-09-13T09:42:57.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 -- 172.21.15.6:0/1548720046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 msgr2=0x556778d9fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778d9fe80 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f815c095980 tx=0x7f815c098ad0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 -- 172.21.15.6:0/1548720046 shutdown_connections 2023-09-13T09:42:57.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778d9fe80 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 --2- 172.21.15.6:0/1548720046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778d9f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 -- 172.21.15.6:0/1548720046 >> 172.21.15.6:0/1548720046 conn(0x556778cfdc80 msgr2=0x556778d99f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 -- 172.21.15.6:0/1548720046 shutdown_connections 2023-09-13T09:42:57.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 -- 172.21.15.6:0/1548720046 wait complete. 2023-09-13T09:42:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 -- start start 2023-09-13T09:42:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.689+0000 7f8175355b80 1 Processor -- start 2023-09-13T09:42:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8175355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778da8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8175355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8175355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778db04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8175355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778c8fbb0 con 0x556778d9fa00 2023-09-13T09:42:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8175355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778c8f8b0 con 0x556778da0700 2023-09-13T09:42:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8175355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778b73920 con 0x556778da1060 2023-09-13T09:42:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8175355b80 10 client.0 _ll_register_callbacks cb 0x556778c8d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778da8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778da8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36120/0 (socket says 172.21.15.6:36120) 2023-09-13T09:42:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 -- 172.21.15.6:0/3799461580 learned_addr learned my addr 172.21.15.6:0/3799461580 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f816359e700 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778db04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f816259c700 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 -- 172.21.15.6:0/3799461580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 msgr2=0x556778db04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778db04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 -- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 msgr2=0x556778da9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 -- 172.21.15.6:0/3799461580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f816419f0a0 con 0x556778d9fa00 2023-09-13T09:42:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8162d9d700 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778da8f30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8158011010 tx=0x7f81580047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=203ce8dc7cc487f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.690+0000 7f8146ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8146ff5700 1 -- 172.21.15.6:0/3799461580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158011440 con 0x556778d9fa00 2023-09-13T09:42:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8146ff5700 1 -- 172.21.15.6:0/3799461580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8158017070 con 0x556778d9fa00 2023-09-13T09:42:57.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556778d92670 con 0x556778d9fa00 2023-09-13T09:42:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8146ff5700 1 -- 172.21.15.6:0/3799461580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81580115a0 con 0x556778d9fa00 2023-09-13T09:42:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 10 client.16377 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556778d097a0 con 0x556778d9fa00 2023-09-13T09:42:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8146ff5700 1 -- 172.21.15.6:0/3799461580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556778d92670 con 0x556778d9fa00 2023-09-13T09:42:57.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8146ff5700 1 -- 172.21.15.6:0/3799461580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8158020850 con 0x556778d9fa00 2023-09-13T09:42:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 10 client.16377 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 10 client.16377 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 20 client.16377 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778db4de0 0x556778db7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 4 client.16377 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:42:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556778cea970 con 0x556778db4de0 2023-09-13T09:42:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.691+0000 7f816259c700 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778db4de0 0x556778db7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.692+0000 7f8146ff5700 10 client.16377 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.692+0000 7f816259c700 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778db4de0 0x556778db7200 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7356cb47411e17b9 server_cookie=447beb1eb523df29 in_seq=0 out_seq=0 2023-09-13T09:42:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8146ff5700 1 -- 172.21.15.6:0/3799461580 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556778cea970 con 0x556778db4de0 2023-09-13T09:42:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8146ff5700 10 client.16377 handle_command_reply: tid=0 2023-09-13T09:42:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 client.16377 shutdown 2023-09-13T09:42:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 msgr2=0x556778da8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778da8f30 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f8158011010 tx=0x7f81580047c0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 shutdown_connections 2023-09-13T09:42:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778db04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778db4de0 0x556778db7200 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778d9fa00 0x556778da8f30 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 --2- 172.21.15.6:0/3799461580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da0700 0x556778da9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8146ff5700 0 client.16377 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 >> 172.21.15.6:0/3799461580 conn(0x556778cfdc80 msgr2=0x556778d947f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 shutdown_connections 2023-09-13T09:42:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 1 -- 172.21.15.6:0/3799461580 wait complete. 2023-09-13T09:42:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.693+0000 7f8175355b80 20 client.16377 trim_cache size 0 max 16384 2023-09-13T09:42:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 Processor -- start 2023-09-13T09:42:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 -- start start 2023-09-13T09:42:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778d9fa00 0x556778d9f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778db0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da1060 0x556778da3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778d9b970 con 0x556778da0700 2023-09-13T09:42:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778da6ba0 con 0x556778da1060 2023-09-13T09:42:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8175355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778da4490 con 0x556778d9fa00 2023-09-13T09:42:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f816259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778db0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f816359e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da1060 0x556778da3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f816259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778db0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36130/0 (socket says 172.21.15.6:36130) 2023-09-13T09:42:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f816259c700 1 -- 172.21.15.6:0/121835452 learned_addr learned my addr 172.21.15.6:0/121835452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.712+0000 7f8162d9d700 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778d9fa00 0x556778d9f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f816359e700 1 -- 172.21.15.6:0/121835452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778d9fa00 msgr2=0x556778d9f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f816359e700 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778d9fa00 0x556778d9f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f816359e700 1 -- 172.21.15.6:0/121835452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 msgr2=0x556778db0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f816359e700 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778db0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f816359e700 1 -- 172.21.15.6:0/121835452 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556778b1dde0 con 0x556778da1060 2023-09-13T09:42:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f816259c700 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778db0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:42:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f816359e700 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da1060 0x556778da3920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f815c09cf00 tx=0x7f815c098970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3c14180ba6465ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f8149ffb700 1 -- 172.21.15.6:0/121835452 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c09cd40 con 0x556778da1060 2023-09-13T09:42:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f8149ffb700 1 -- 172.21.15.6:0/121835452 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f815c0b1250 con 0x556778da1060 2023-09-13T09:42:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.713+0000 7f8149ffb700 1 -- 172.21.15.6:0/121835452 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c098660 con 0x556778da1060 2023-09-13T09:42:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 -- 172.21.15.6:0/121835452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da1060 msgr2=0x556778da3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da1060 0x556778da3920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f815c09cf00 tx=0x7f815c098970 comp rx=0 tx=0).stop 2023-09-13T09:42:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 -- 172.21.15.6:0/121835452 shutdown_connections 2023-09-13T09:42:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778da1060 0x556778da3920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778d9fa00 0x556778d9f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 --2- 172.21.15.6:0/121835452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778db0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 -- 172.21.15.6:0/121835452 >> 172.21.15.6:0/121835452 conn(0x556778cfdc80 msgr2=0x556778da6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 -- 172.21.15.6:0/121835452 shutdown_connections 2023-09-13T09:42:57.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 -- 172.21.15.6:0/121835452 wait complete. 2023-09-13T09:42:57.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 -- start start 2023-09-13T09:42:57.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 Processor -- start 2023-09-13T09:42:57.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778d9fa00 0x556778dabf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.714+0000 7f8175355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778dac440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778daf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778daf9a0 con 0x556778da0700 2023-09-13T09:42:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778dafb10 con 0x556778d9fa00 2023-09-13T09:42:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556778dafcd0 con 0x556778da1060 2023-09-13T09:42:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 10 client.0 _ll_register_callbacks cb 0x556778c8d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:42:57.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778dac440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778dac440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36136/0 (socket says 172.21.15.6:36136) 2023-09-13T09:42:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 -- 172.21.15.6:0/826272252 learned_addr learned my addr 172.21.15.6:0/826272252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:42:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8162d9d700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778d9fa00 0x556778dabf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816359e700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778daf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 -- 172.21.15.6:0/826272252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 msgr2=0x556778daf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778daf460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 -- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778d9fa00 msgr2=0x556778dabf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:42:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778d9fa00 0x556778dabf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 -- 172.21.15.6:0/826272252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8164108b10 con 0x556778da0700 2023-09-13T09:42:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816359e700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778daf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:42:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f816259c700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778dac440 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f815400b680 tx=0x7f8154005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a13c503078a16c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:42:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8146ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:42:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8146ff5700 1 -- 172.21.15.6:0/826272252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815401d070 con 0x556778da0700 2023-09-13T09:42:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8146ff5700 1 -- 172.21.15.6:0/826272252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8154027c70 con 0x556778da0700 2023-09-13T09:42:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f815c099610 con 0x556778da0700 2023-09-13T09:42:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8146ff5700 1 -- 172.21.15.6:0/826272252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8154027e30 con 0x556778da0700 2023-09-13T09:42:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 10 client.16383 fetch_fsmap learned FSMap version 30 2023-09-13T09:42:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.715+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x556778b71630 con 0x556778da0700 2023-09-13T09:42:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8146ff5700 1 -- 172.21.15.6:0/826272252 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f815c099610 con 0x556778da0700 2023-09-13T09:42:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8146ff5700 1 -- 172.21.15.6:0/826272252 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 30) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f8154004ad0 con 0x556778da0700 2023-09-13T09:42:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8175355b80 10 client.16383 fetch_fsmap finished waiting for FSMap version 30 2023-09-13T09:42:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8175355b80 10 client.16383 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:42:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8175355b80 20 client.16383 populate_metadata read hostname 'smithi006' 2023-09-13T09:42:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8175355b80 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778e098c0 0x556778e0bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:42:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8175355b80 4 client.16383 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:42:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556778cab050 con 0x556778e098c0 2023-09-13T09:42:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8162d9d700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778e098c0 0x556778e0bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:42:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8146ff5700 10 client.16383 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.716+0000 7f8162d9d700 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778e098c0 0x556778e0bce0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=361f2b8c184bf548 server_cookie=c6feda836f7fd11f in_seq=0 out_seq=0 2023-09-13T09:42:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8146ff5700 1 -- 172.21.15.6:0/826272252 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556778cab050 con 0x556778e098c0 2023-09-13T09:42:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8146ff5700 10 client.16383 handle_command_reply: tid=0 2023-09-13T09:42:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 client.16383 shutdown 2023-09-13T09:42:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 msgr2=0x556778dac440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778dac440 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f815400b680 tx=0x7f8154005fb0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 shutdown_connections 2023-09-13T09:42:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556778da1060 0x556778daf460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556778d9fa00 0x556778dabf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556778e098c0 0x556778e0bce0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 --2- 172.21.15.6:0/826272252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556778da0700 0x556778dac440 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8146ff5700 0 client.16383 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:42:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 >> 172.21.15.6:0/826272252 conn(0x556778cfdc80 msgr2=0x556778da7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 shutdown_connections 2023-09-13T09:42:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 1 -- 172.21.15.6:0/826272252 wait complete. 2023-09-13T09:42:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8175355b80 20 client.16383 trim_cache size 0 max 16384 2023-09-13T09:42:57.737 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:42:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:42:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:42:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "36328566-148c-4918-9fe9-f25b4d841473": { 2023-09-13T09:42:57.738 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:42:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "36328566-148c-4918-9fe9-f25b4d841473", 2023-09-13T09:42:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:42:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:42:57.739 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:42:57.739 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:42:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f814c0a0640 msgr2=0x7f814c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8169170700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f814c0a0640 0x7f814c0a2b00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f8158007fd0 tx=0x7f81580073d0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8164101340 msgr2=0x7f816419e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:42:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.717+0000 7f8169170700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8164101340 0x7f816419e070 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f815c00ef30 tx=0x7f815c00c3a0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 shutdown_connections 2023-09-13T09:42:57.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f814c0a0640 0x7f814c0a2b00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8164101340 0x7f816419e070 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81640fff00 0x7f8164196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 --2- 172.21.15.6:0/2188194445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f81641008c0 0x7f8164197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:42:57.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 >> 172.21.15.6:0/2188194445 conn(0x7f81640fa9b0 msgr2=0x7f81640fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:42:57.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 shutdown_connections 2023-09-13T09:42:57.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:42:57.718+0000 7f8169170700 1 -- 172.21.15.6:0/2188194445 wait complete. 2023-09-13T09:42:57.743 INFO:tasks.cephfs.filesystem:scrub status for tag:36328566-148c-4918-9fe9-f25b4d841473 - {'path': '/', 'tag': '36328566-148c-4918-9fe9-f25b4d841473', 'options': 'recursive,force'} 2023-09-13T09:42:58.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 107241 4.25 MB/sec execute 18 sec latency 790.977 ms 2023-09-13T09:42:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:58 smithi131 ceph-mon[102785]: pgmap v403: 97 pgs: 97 active+clean; 58 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-09-13T09:42:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:58 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:58 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:58 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:58 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:58 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:58 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:58 smithi006 ceph-mon[98665]: pgmap v403: 97 pgs: 97 active+clean; 58 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-09-13T09:42:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:58 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:58 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:58.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:58 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:58.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:58 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:58 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:58 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:58 smithi053 ceph-mon[102373]: pgmap v403: 97 pgs: 97 active+clean; 58 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 1.3 MiB/s wr, 145 op/s 2023-09-13T09:42:58.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:58 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:58.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:58 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:58.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:58 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:58.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:58 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:58 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:58.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:58 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 107241 4.03 MB/sec execute 19 sec latency 1535.389 ms 2023-09-13T09:42:59.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:42:59.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:59.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:59.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:59.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:42:59.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:42:59 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:42:59.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:59.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:59.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:59.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:42:59.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:42:59 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:42:59.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:59.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:59.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:59.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:42:59.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:42:59.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:42:59 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:00.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 107241 3.83 MB/sec execute 20 sec latency 2535.492 ms 2023-09-13T09:43:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:00 smithi006 ceph-mon[98665]: pgmap v404: 97 pgs: 97 active+clean; 59 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.2 MiB/s wr, 154 op/s 2023-09-13T09:43:00.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:00 smithi053 ceph-mon[102373]: pgmap v404: 97 pgs: 97 active+clean; 59 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.2 MiB/s wr, 154 op/s 2023-09-13T09:43:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:00 smithi131 ceph-mon[102785]: pgmap v404: 97 pgs: 97 active+clean; 59 MiB data, 687 MiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 1.2 MiB/s wr, 154 op/s 2023-09-13T09:43:01.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 107241 3.64 MB/sec execute 21 sec latency 3535.610 ms 2023-09-13T09:43:02.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 107256 3.48 MB/sec execute 22 sec latency 4524.017 ms 2023-09-13T09:43:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:02 smithi006 ceph-mon[98665]: pgmap v405: 97 pgs: 97 active+clean; 59 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:43:02.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:02 smithi053 ceph-mon[102373]: pgmap v405: 97 pgs: 97 active+clean; 59 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:43:02.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:02 smithi131 ceph-mon[102785]: pgmap v405: 97 pgs: 97 active+clean; 59 MiB data, 692 MiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 1.1 MiB/s wr, 145 op/s 2023-09-13T09:43:03.154 INFO:tasks.workunit.client.0.smithi006.stdout: 1 109639 3.89 MB/sec execute 23 sec latency 12.383 ms 2023-09-13T09:43:04.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110667 3.97 MB/sec execute 24 sec latency 13.092 ms 2023-09-13T09:43:04.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:04 smithi053 ceph-mon[102373]: pgmap v406: 97 pgs: 97 active+clean; 61 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2023-09-13T09:43:04.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:04 smithi006 ceph-mon[98665]: pgmap v406: 97 pgs: 97 active+clean; 61 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2023-09-13T09:43:04.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:04 smithi131 ceph-mon[102785]: pgmap v406: 97 pgs: 97 active+clean; 61 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 1.3 MiB/s wr, 151 op/s 2023-09-13T09:43:05.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110667 3.81 MB/sec execute 25 sec latency 1007.026 ms 2023-09-13T09:43:06.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110667 3.67 MB/sec execute 26 sec latency 2007.103 ms 2023-09-13T09:43:06.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:06 smithi053 ceph-mon[102373]: pgmap v407: 97 pgs: 97 active+clean; 62 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-09-13T09:43:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:06 smithi006 ceph-mon[98665]: pgmap v407: 97 pgs: 97 active+clean; 62 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-09-13T09:43:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:06 smithi131 ceph-mon[102785]: pgmap v407: 97 pgs: 97 active+clean; 62 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 519 KiB/s rd, 1.1 MiB/s wr, 129 op/s 2023-09-13T09:43:07.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110684 3.53 MB/sec execute 27 sec latency 2992.640 ms 2023-09-13T09:43:08.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110791 3.41 MB/sec execute 28 sec latency 916.355 ms 2023-09-13T09:43:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:08 smithi006 ceph-mon[98665]: pgmap v408: 97 pgs: 97 active+clean; 61 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 726 KiB/s wr, 117 op/s 2023-09-13T09:43:08.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:08 smithi053 ceph-mon[102373]: pgmap v408: 97 pgs: 97 active+clean; 61 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 726 KiB/s wr, 117 op/s 2023-09-13T09:43:08.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:08 smithi131 ceph-mon[102785]: pgmap v408: 97 pgs: 97 active+clean; 61 MiB data, 710 MiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 726 KiB/s wr, 117 op/s 2023-09-13T09:43:09.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110791 3.30 MB/sec execute 29 sec latency 1916.444 ms 2023-09-13T09:43:10.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110791 3.19 MB/sec execute 30 sec latency 2916.526 ms 2023-09-13T09:43:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:10 smithi006 ceph-mon[98665]: pgmap v409: 97 pgs: 97 active+clean; 61 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 625 KiB/s wr, 106 op/s 2023-09-13T09:43:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:10.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:10 smithi053 ceph-mon[102373]: pgmap v409: 97 pgs: 97 active+clean; 61 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 625 KiB/s wr, 106 op/s 2023-09-13T09:43:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:10.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:10 smithi131 ceph-mon[102785]: pgmap v409: 97 pgs: 97 active+clean; 61 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 365 KiB/s rd, 625 KiB/s wr, 106 op/s 2023-09-13T09:43:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:10.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:11.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110791 3.08 MB/sec execute 31 sec latency 3916.621 ms 2023-09-13T09:43:12.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 110806 2.99 MB/sec execute 32 sec latency 4903.785 ms 2023-09-13T09:43:12.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:12 smithi053 ceph-mon[102373]: pgmap v410: 97 pgs: 97 active+clean; 61 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 495 KiB/s wr, 75 op/s 2023-09-13T09:43:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:12 smithi006 ceph-mon[98665]: pgmap v410: 97 pgs: 97 active+clean; 61 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 495 KiB/s wr, 75 op/s 2023-09-13T09:43:12.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:12 smithi131 ceph-mon[102785]: pgmap v410: 97 pgs: 97 active+clean; 61 MiB data, 709 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 495 KiB/s wr, 75 op/s 2023-09-13T09:43:13.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 113008 3.27 MB/sec execute 33 sec latency 12.424 ms 2023-09-13T09:43:14.155 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114130 3.36 MB/sec execute 34 sec latency 12.878 ms 2023-09-13T09:43:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:14 smithi006 ceph-mon[98665]: pgmap v411: 97 pgs: 97 active+clean; 62 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 619 KiB/s wr, 79 op/s 2023-09-13T09:43:14.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:14 smithi053 ceph-mon[102373]: pgmap v411: 97 pgs: 97 active+clean; 62 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 619 KiB/s wr, 79 op/s 2023-09-13T09:43:14.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:14 smithi131 ceph-mon[102785]: pgmap v411: 97 pgs: 97 active+clean; 62 MiB data, 698 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 619 KiB/s wr, 79 op/s 2023-09-13T09:43:15.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114210 3.27 MB/sec execute 35 sec latency 945.250 ms 2023-09-13T09:43:16.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114210 3.18 MB/sec execute 36 sec latency 1945.357 ms 2023-09-13T09:43:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:16 smithi006 ceph-mon[98665]: pgmap v412: 97 pgs: 97 active+clean; 63 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 559 KiB/s wr, 72 op/s 2023-09-13T09:43:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:16 smithi053 ceph-mon[102373]: pgmap v412: 97 pgs: 97 active+clean; 63 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 559 KiB/s wr, 72 op/s 2023-09-13T09:43:16.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:16 smithi131 ceph-mon[102785]: pgmap v412: 97 pgs: 97 active+clean; 63 MiB data, 683 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 559 KiB/s wr, 72 op/s 2023-09-13T09:43:17.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114227 3.10 MB/sec execute 37 sec latency 2932.159 ms 2023-09-13T09:43:18.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114266 3.02 MB/sec execute 38 sec latency 971.376 ms 2023-09-13T09:43:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:18 smithi006 ceph-mon[98665]: pgmap v413: 97 pgs: 97 active+clean; 64 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 582 KiB/s wr, 84 op/s 2023-09-13T09:43:18.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:18 smithi053 ceph-mon[102373]: pgmap v413: 97 pgs: 97 active+clean; 64 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 582 KiB/s wr, 84 op/s 2023-09-13T09:43:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:18 smithi131 ceph-mon[102785]: pgmap v413: 97 pgs: 97 active+clean; 64 MiB data, 684 MiB used, 1.0 TiB / 1.0 TiB avail; 274 KiB/s rd, 582 KiB/s wr, 84 op/s 2023-09-13T09:43:19.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114266 2.94 MB/sec execute 39 sec latency 1971.483 ms 2023-09-13T09:43:19.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:19 smithi006 ceph-mon[98665]: pgmap v414: 97 pgs: 97 active+clean; 63 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 580 KiB/s wr, 84 op/s 2023-09-13T09:43:19.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:19 smithi053 ceph-mon[102373]: pgmap v414: 97 pgs: 97 active+clean; 63 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 580 KiB/s wr, 84 op/s 2023-09-13T09:43:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:19 smithi131 ceph-mon[102785]: pgmap v414: 97 pgs: 97 active+clean; 63 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 580 KiB/s wr, 84 op/s 2023-09-13T09:43:20.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114266 2.86 MB/sec execute 40 sec latency 2971.563 ms 2023-09-13T09:43:21.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114266 2.79 MB/sec execute 41 sec latency 3971.676 ms 2023-09-13T09:43:21.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:21 smithi006 ceph-mon[98665]: pgmap v415: 97 pgs: 97 active+clean; 63 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 694 KiB/s wr, 73 op/s 2023-09-13T09:43:21.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:21 smithi053 ceph-mon[102373]: pgmap v415: 97 pgs: 97 active+clean; 63 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 694 KiB/s wr, 73 op/s 2023-09-13T09:43:21.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:21 smithi131 ceph-mon[102785]: pgmap v415: 97 pgs: 97 active+clean; 63 MiB data, 689 MiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 694 KiB/s wr, 73 op/s 2023-09-13T09:43:22.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 114288 2.73 MB/sec execute 42 sec latency 4957.623 ms 2023-09-13T09:43:23.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:43:23.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:22 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 116443 2.93 MB/sec execute 43 sec latency 15.691 ms 2023-09-13T09:43:23.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:43:23.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:22 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:43:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:23.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:22 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:23 smithi131 ceph-mon[102785]: pgmap v416: 97 pgs: 97 active+clean; 63 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 835 KiB/s wr, 85 op/s 2023-09-13T09:43:24.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:43:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:43:24.020 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:24.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 117596 3.03 MB/sec execute 44 sec latency 13.523 ms 2023-09-13T09:43:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:23 smithi006 ceph-mon[98665]: pgmap v416: 97 pgs: 97 active+clean; 63 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 835 KiB/s wr, 85 op/s 2023-09-13T09:43:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:43:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:43:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:23 smithi053 ceph-mon[102373]: pgmap v416: 97 pgs: 97 active+clean; 63 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 835 KiB/s wr, 85 op/s 2023-09-13T09:43:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:43:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:43:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:43:25.156 INFO:tasks.workunit.client.0.smithi006.stdout: 1 117756 2.97 MB/sec execute 45 sec latency 878.228 ms 2023-09-13T09:43:26.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 117756 2.90 MB/sec execute 46 sec latency 1878.352 ms 2023-09-13T09:43:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:25 smithi006 ceph-mon[98665]: pgmap v417: 97 pgs: 97 active+clean; 63 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 842 KiB/s wr, 84 op/s 2023-09-13T09:43:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:25 smithi053 ceph-mon[102373]: pgmap v417: 97 pgs: 97 active+clean; 63 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 842 KiB/s wr, 84 op/s 2023-09-13T09:43:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:25 smithi131 ceph-mon[102785]: pgmap v417: 97 pgs: 97 active+clean; 63 MiB data, 693 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 842 KiB/s wr, 84 op/s 2023-09-13T09:43:27.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 117766 2.84 MB/sec execute 47 sec latency 2870.262 ms 2023-09-13T09:43:27.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:26 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:27.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:26 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:27.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:26 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:27.744 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:43:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/24706998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a4100eb0 msgr2=0x7ff3a4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/24706998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a4100eb0 0x7ff3a4101310 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7ff3a00099c0 tx=0x7ff3a0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/24706998 shutdown_connections 2023-09-13T09:43:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/24706998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a4101850 0x7ff3a4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/24706998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3a40ffcc0 0x7ff3a41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/24706998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a4100eb0 0x7ff3a4101310 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/24706998 >> 172.21.15.6:0/24706998 conn(0x7ff3a40fb250 msgr2=0x7ff3a40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/24706998 shutdown_connections 2023-09-13T09:43:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.888+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/24706998 wait complete. 2023-09-13T09:43:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 Processor -- start 2023-09-13T09:43:27.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 -- start start 2023-09-13T09:43:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40ffcc0 0x7ff3a410a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3a4100eb0 0x7ff3a4108c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a4101850 0x7ff3a4109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a41098f0 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a4109a60 con 0x7ff3a4100eb0 2023-09-13T09:43:27.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3ac3e4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3a41a0ad0 con 0x7ff3a4101850 2023-09-13T09:43:27.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40ffcc0 0x7ff3a410a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40ffcc0 0x7ff3a410a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36148/0 (socket says 172.21.15.6:36148) 2023-09-13T09:43:27.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 -- 172.21.15.6:0/1346777344 learned_addr learned my addr 172.21.15.6:0/1346777344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:27.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3a997f700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3a4100eb0 0x7ff3a4108c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa981700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a4101850 0x7ff3a4109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 -- 172.21.15.6:0/1346777344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a4101850 msgr2=0x7ff3a4109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a4101850 0x7ff3a4109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 -- 172.21.15.6:0/1346777344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3a4100eb0 msgr2=0x7ff3a4108c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3a4100eb0 0x7ff3a4108c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.889+0000 7ff3aa180700 1 -- 172.21.15.6:0/1346777344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00095f0 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.890+0000 7ff3a997f700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3a4100eb0 0x7ff3a4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.890+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40ffcc0 0x7ff3a410a5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff39400e970 tx=0x7ff39400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.890+0000 7ff39b7fe700 1 -- 172.21.15.6:0/1346777344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394009790 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.890+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3a41a0db0 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.890+0000 7ff39b7fe700 1 -- 172.21.15.6:0/1346777344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff39400eec0 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.890+0000 7ff39b7fe700 1 -- 172.21.15.6:0/1346777344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394003cf0 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.890+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3a41a1230 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.892+0000 7ff39b7fe700 1 -- 172.21.15.6:0/1346777344 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff39400ccd0 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.893+0000 7ff39b7fe700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3900a0640 0x7ff3900a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.893+0000 7ff3a997f700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3900a0640 0x7ff3900a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.893+0000 7ff39b7fe700 1 -- 172.21.15.6:0/1346777344 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff394014070 con 0x7ff3a40ffcc0 2023-09-13T09:43:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.893+0000 7ff3a997f700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3900a0640 0x7ff3900a2b00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b580 tx=0x7ff3a001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 Processor -- start 2023-09-13T09:43:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 -- start start 2023-09-13T09:43:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc906b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc907060 0x558ccc9054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc905a00 0x558ccc905e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc85e780 con 0x558ccc905a00 2023-09-13T09:43:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc85c0a0 con 0x558ccc907060 2023-09-13T09:43:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.894+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc857990 con 0x558ccc906700 2023-09-13T09:43:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc905a00 0x558ccc905e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3a997f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc907060 0x558ccc9054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc905a00 0x558ccc905e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36160/0 (socket says 172.21.15.6:36160) 2023-09-13T09:43:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 -- 172.21.15.6:0/1720659989 learned_addr learned my addr 172.21.15.6:0/1720659989 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc906b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 -- 172.21.15.6:0/1720659989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 msgr2=0x558ccc906b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc906b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 -- 172.21.15.6:0/1720659989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc907060 msgr2=0x558ccc9054c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc907060 0x558ccc9054c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 -- 172.21.15.6:0/1720659989 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ccc6d7630 con 0x558ccc905a00 2023-09-13T09:43:27.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff3aa981700 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc905a00 0x558ccc905e80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff39c003fc0 tx=0x7ff39c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb6963379a51dc0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff398d82700 1 -- 172.21.15.6:0/1720659989 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c019070 con 0x558ccc905a00 2023-09-13T09:43:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff398d82700 1 -- 172.21.15.6:0/1720659989 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff39c00f040 con 0x558ccc905a00 2023-09-13T09:43:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.895+0000 7ff398d82700 1 -- 172.21.15.6:0/1720659989 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c007a40 con 0x558ccc905a00 2023-09-13T09:43:27.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1720659989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc905a00 msgr2=0x558ccc905e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc905a00 0x558ccc905e80 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7ff39c003fc0 tx=0x7ff39c009ba0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1720659989 shutdown_connections 2023-09-13T09:43:27.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc905a00 0x558ccc905e80 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc906b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1720659989 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc907060 0x558ccc9054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1720659989 >> 172.21.15.6:0/1720659989 conn(0x558ccc863c80 msgr2=0x558ccc8fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1720659989 shutdown_connections 2023-09-13T09:43:27.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1720659989 wait complete. 2023-09-13T09:43:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.896+0000 7ff3b85c9b80 1 -- start start 2023-09-13T09:43:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 1 Processor -- start 2023-09-13T09:43:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc90ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc90f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc907060 0x558ccc916490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc7f5bb0 con 0x558ccc906700 2023-09-13T09:43:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc7f58b0 con 0x558ccc905a00 2023-09-13T09:43:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc6d9920 con 0x558ccc907060 2023-09-13T09:43:27.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3b85c9b80 10 client.0 _ll_register_callbacks cb 0x558ccc7f3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc90f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc90f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36164/0 (socket says 172.21.15.6:36164) 2023-09-13T09:43:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 -- 172.21.15.6:0/1713633592 learned_addr learned my addr 172.21.15.6:0/1713633592 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc90ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3aa981700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc907060 0x558ccc916490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 -- 172.21.15.6:0/1713633592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc907060 msgr2=0x558ccc916490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc907060 0x558ccc916490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 -- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 msgr2=0x558ccc90ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc90ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3a997f700 1 -- 172.21.15.6:0/1713633592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff39c003bf0 con 0x558ccc906700 2023-09-13T09:43:27.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.897+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc90ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:43:27.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3a997f700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc90f450 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0005850 tx=0x7ff3a0009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24877291df03782 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:27.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff38dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:27.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff38dffb700 1 -- 172.21.15.6:0/1713633592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a001d040 con 0x558ccc906700 2023-09-13T09:43:27.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff38dffb700 1 -- 172.21.15.6:0/1713633592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3a000bda0 con 0x558ccc906700 2023-09-13T09:43:27.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ccc8f8670 con 0x558ccc906700 2023-09-13T09:43:27.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff38dffb700 1 -- 172.21.15.6:0/1713633592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff3a0023c00 con 0x558ccc906700 2023-09-13T09:43:27.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 10 client.16395 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:27.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x558ccc86f7a0 con 0x558ccc906700 2023-09-13T09:43:27.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff38dffb700 1 -- 172.21.15.6:0/1713633592 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3a003e020 con 0x558ccc906700 2023-09-13T09:43:27.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff38dffb700 1 -- 172.21.15.6:0/1713633592 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff3a0038400 con 0x558ccc906700 2023-09-13T09:43:27.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 10 client.16395 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:27.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 10 client.16395 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:27.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 20 client.16395 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:27.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc91ad90 0x558ccc91d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 4 client.16395 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.898+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ccc850970 con 0x558ccc91ad90 2023-09-13T09:43:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.899+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc91ad90 0x558ccc91d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.899+0000 7ff38dffb700 10 client.16395 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.899+0000 7ff3aa180700 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc91ad90 0x558ccc91d1b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6403f40aef09235 server_cookie=a6cb24ab2a7ed2b5 in_seq=0 out_seq=0 2023-09-13T09:43:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff38dffb700 1 -- 172.21.15.6:0/1713633592 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558ccc850970 con 0x558ccc91ad90 2023-09-13T09:43:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff38dffb700 10 client.16395 handle_command_reply: tid=0 2023-09-13T09:43:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 client.16395 shutdown 2023-09-13T09:43:27.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 msgr2=0x558ccc90f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc90f450 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0005850 tx=0x7ff3a0009310 comp rx=0 tx=0).stop 2023-09-13T09:43:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 shutdown_connections 2023-09-13T09:43:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc907060 0x558ccc916490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc90ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc91ad90 0x558ccc91d1b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/1713633592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc90f450 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff38dffb700 0 client.16395 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:27.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 >> 172.21.15.6:0/1713633592 conn(0x558ccc863c80 msgr2=0x558ccc8ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:27.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 shutdown_connections 2023-09-13T09:43:27.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/1713633592 wait complete. 2023-09-13T09:43:27.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.900+0000 7ff3b85c9b80 20 client.16395 trim_cache size 0 max 16384 2023-09-13T09:43:27.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.920+0000 7ff3b85c9b80 1 Processor -- start 2023-09-13T09:43:27.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.920+0000 7ff3b85c9b80 1 -- start start 2023-09-13T09:43:27.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.920+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc863c80 0x558ccc9054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.920+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc916450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.920+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc90ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.920+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc901730 con 0x558ccc863c80 2023-09-13T09:43:27.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc90cb40 con 0x558ccc905a00 2023-09-13T09:43:27.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc90a450 con 0x558ccc906700 2023-09-13T09:43:27.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc863c80 0x558ccc9054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc863c80 0x558ccc9054c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36170/0 (socket says 172.21.15.6:36170) 2023-09-13T09:43:27.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 -- 172.21.15.6:0/2304920581 learned_addr learned my addr 172.21.15.6:0/2304920581 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3a997f700 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc916450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa981700 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc90ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 -- 172.21.15.6:0/2304920581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 msgr2=0x558ccc90ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc90ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 -- 172.21.15.6:0/2304920581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 msgr2=0x558ccc916450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc916450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 -- 172.21.15.6:0/2304920581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ccc683de0 con 0x558ccc863c80 2023-09-13T09:43:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3a997f700 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc916450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:43:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff3aa180700 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc863c80 0x558ccc9054c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff394096060 tx=0x7ff3940cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55b6564915179f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:27.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff399583700 1 -- 172.21.15.6:0/2304920581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39409d420 con 0x558ccc863c80 2023-09-13T09:43:27.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff399583700 1 -- 172.21.15.6:0/2304920581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3940a1660 con 0x558ccc863c80 2023-09-13T09:43:27.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.921+0000 7ff399583700 1 -- 172.21.15.6:0/2304920581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff394084310 con 0x558ccc863c80 2023-09-13T09:43:27.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/2304920581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc863c80 msgr2=0x558ccc9054c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc863c80 0x558ccc9054c0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7ff394096060 tx=0x7ff3940cb040 comp rx=0 tx=0).stop 2023-09-13T09:43:27.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/2304920581 shutdown_connections 2023-09-13T09:43:27.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc906700 0x558ccc90ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc863c80 0x558ccc9054c0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/2304920581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc916450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/2304920581 >> 172.21.15.6:0/2304920581 conn(0x558ccc900240 msgr2=0x558ccc909940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:27.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/2304920581 shutdown_connections 2023-09-13T09:43:27.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.922+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/2304920581 wait complete. 2023-09-13T09:43:27.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 -- start start 2023-09-13T09:43:27.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 Processor -- start 2023-09-13T09:43:27.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc863c80 0x558ccc9162f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc912dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc913300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc9139d0 con 0x558ccc906700 2023-09-13T09:43:27.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc96ebd0 con 0x558ccc905a00 2023-09-13T09:43:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ccc96ed60 con 0x558ccc863c80 2023-09-13T09:43:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3b85c9b80 10 client.0 _ll_register_callbacks cb 0x558ccc7f3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3aa981700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc913300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3aa981700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc913300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36180/0 (socket says 172.21.15.6:36180) 2023-09-13T09:43:27.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3aa981700 1 -- 172.21.15.6:0/3617253584 learned_addr learned my addr 172.21.15.6:0/3617253584 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3a997f700 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc912dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.923+0000 7ff3aa180700 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc863c80 0x558ccc9162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3aa981700 1 -- 172.21.15.6:0/3617253584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc863c80 msgr2=0x558ccc9162f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3aa981700 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc863c80 0x558ccc9162f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3aa981700 1 -- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 msgr2=0x558ccc912dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:27.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3aa981700 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc912dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3aa981700 1 -- 172.21.15.6:0/3617253584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ccc86f7a0 con 0x558ccc906700 2023-09-13T09:43:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3aa981700 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc913300 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff39c018000 tx=0x7ff39c005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=664bc179d5e8cacb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff38dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff38dffb700 1 -- 172.21.15.6:0/3617253584 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff39c019040 con 0x558ccc906700 2023-09-13T09:43:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff38dffb700 1 -- 172.21.15.6:0/3617253584 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff39c0094e0 con 0x558ccc906700 2023-09-13T09:43:27.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff39c00f040 con 0x558ccc906700 2023-09-13T09:43:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff38dffb700 1 -- 172.21.15.6:0/3617253584 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff39c007af0 con 0x558ccc906700 2023-09-13T09:43:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3b85c9b80 10 client.16401 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7ff3a41a1230 con 0x558ccc906700 2023-09-13T09:43:27.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.924+0000 7ff38dffb700 1 -- 172.21.15.6:0/3617253584 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff39c00f040 con 0x558ccc906700 2023-09-13T09:43:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff38dffb700 1 -- 172.21.15.6:0/3617253584 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7ff39c025020 con 0x558ccc906700 2023-09-13T09:43:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff3b85c9b80 10 client.16401 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:27.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff3b85c9b80 10 client.16401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff3b85c9b80 20 client.16401 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc907060 0x558ccc972800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff3b85c9b80 4 client.16401 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:43:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558ccc811050 con 0x558ccc907060 2023-09-13T09:43:27.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.925+0000 7ff3aa180700 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc907060 0x558ccc972800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.926+0000 7ff3aa180700 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc907060 0x558ccc972800 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e77c54b3896223c server_cookie=4bd6e3f4e2c61b9 in_seq=0 out_seq=0 2023-09-13T09:43:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.926+0000 7ff38dffb700 10 client.16401 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.926+0000 7ff38dffb700 1 -- 172.21.15.6:0/3617253584 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558ccc811050 con 0x558ccc907060 2023-09-13T09:43:27.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.926+0000 7ff38dffb700 10 client.16401 handle_command_reply: tid=0 2023-09-13T09:43:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.926+0000 7ff3b85c9b80 1 client.16401 shutdown 2023-09-13T09:43:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 msgr2=0x558ccc913300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc913300 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7ff39c018000 tx=0x7ff39c005b20 comp rx=0 tx=0).stop 2023-09-13T09:43:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 shutdown_connections 2023-09-13T09:43:27.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ccc907060 0x558ccc972800 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ccc906700 0x558ccc913300 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ccc863c80 0x558ccc9162f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 --2- 172.21.15.6:0/3617253584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ccc905a00 0x558ccc912dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 >> 172.21.15.6:0/3617253584 conn(0x558ccc900240 msgr2=0x558ccc90ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff38dffb700 0 client.16401 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.927+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 shutdown_connections 2023-09-13T09:43:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3b85c9b80 1 -- 172.21.15.6:0/3617253584 wait complete. 2023-09-13T09:43:27.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3b85c9b80 20 client.16401 trim_cache size 0 max 16384 2023-09-13T09:43:27.948 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:43:27.948 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:43:27.949 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:43:27.949 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:43:27.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3900a0640 msgr2=0x7ff3900a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3900a0640 0x7ff3900a2b00 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b580 tx=0x7ff3a001a040 comp rx=0 tx=0).stop 2023-09-13T09:43:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40ffcc0 msgr2=0x7ff3a410a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40ffcc0 0x7ff3a410a5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff39400e970 tx=0x7ff39400ec80 comp rx=0 tx=0).stop 2023-09-13T09:43:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 shutdown_connections 2023-09-13T09:43:27.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3a4101850 0x7ff3a4109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3900a0640 0x7ff3900a2b00 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3a40ffcc0 0x7ff3a410a5d0 secure :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7ff39400e970 tx=0x7ff39400ec80 comp rx=0 tx=0).stop 2023-09-13T09:43:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 --2- 172.21.15.6:0/1346777344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3a4100eb0 0x7ff3a4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:27.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.928+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 >> 172.21.15.6:0/1346777344 conn(0x7ff3a40fb250 msgr2=0x7ff3a40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:27.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.929+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 shutdown_connections 2023-09-13T09:43:27.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:27.929+0000 7ff3ac3e4700 1 -- 172.21.15.6:0/1346777344 wait complete. 2023-09-13T09:43:27.953 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:43:27.954 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:43:28.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.082+0000 7f19c5805700 1 -- 172.21.15.6:0/264036844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c00ffc90 msgr2=0x7f19c01000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.082+0000 7f19c5805700 1 --2- 172.21.15.6:0/264036844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c00ffc90 0x7f19c01000b0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f19b00099c0 tx=0x7f19b0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.082+0000 7f19c5805700 1 -- 172.21.15.6:0/264036844 shutdown_connections 2023-09-13T09:43:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.082+0000 7f19c5805700 1 --2- 172.21.15.6:0/264036844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19c0101820 0x7f19c01080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.082+0000 7f19c5805700 1 --2- 172.21.15.6:0/264036844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c00ffc90 0x7f19c01000b0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.082+0000 7f19c5805700 1 --2- 172.21.15.6:0/264036844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19c0100e80 0x7f19c01012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.082+0000 7f19c5805700 1 -- 172.21.15.6:0/264036844 >> 172.21.15.6:0/264036844 conn(0x7f19c00fb220 msgr2=0x7f19c00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.083+0000 7f19c5805700 1 -- 172.21.15.6:0/264036844 shutdown_connections 2023-09-13T09:43:28.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.083+0000 7f19c5805700 1 -- 172.21.15.6:0/264036844 wait complete. 2023-09-13T09:43:28.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.083+0000 7f19c5805700 1 Processor -- start 2023-09-13T09:43:28.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.083+0000 7f19c5805700 1 -- start start 2023-09-13T09:43:28.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.083+0000 7f19c5805700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19c00ffc90 0x7f19c0068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c5805700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19c0100e80 0x7f19c019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c5805700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c0101820 0x7f19c019de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c5805700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c019e5e0 con 0x7f19c0101820 2023-09-13T09:43:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c5805700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c019e750 con 0x7f19c0100e80 2023-09-13T09:43:28.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c5805700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c019e910 con 0x7f19c00ffc90 2023-09-13T09:43:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c0101820 0x7f19c019de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c0101820 0x7f19c019de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36194/0 (socket says 172.21.15.6:36194) 2023-09-13T09:43:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 -- 172.21.15.6:0/902245191 learned_addr learned my addr 172.21.15.6:0/902245191 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19be7fc700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19c0100e80 0x7f19c019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19beffd700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19c00ffc90 0x7f19c0068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 -- 172.21.15.6:0/902245191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19c00ffc90 msgr2=0x7f19c0068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19c00ffc90 0x7f19c0068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 -- 172.21.15.6:0/902245191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19c0100e80 msgr2=0x7f19c019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19c0100e80 0x7f19c019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 -- 172.21.15.6:0/902245191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b00095f0 con 0x7f19c0101820 2023-09-13T09:43:28.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19bf7fe700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c0101820 0x7f19c019de10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f19b8007ee0 tx=0x7f19b800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c4803700 1 -- 172.21.15.6:0/902245191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b800ddd0 con 0x7f19c0101820 2023-09-13T09:43:28.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c4803700 1 -- 172.21.15.6:0/902245191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19b800f040 con 0x7f19c0101820 2023-09-13T09:43:28.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c4803700 1 -- 172.21.15.6:0/902245191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19b80048e0 con 0x7f19c0101820 2023-09-13T09:43:28.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c019ebf0 con 0x7f19c0101820 2023-09-13T09:43:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.084+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c019f0b0 con 0x7f19c0101820 2023-09-13T09:43:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.085+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c010b4a0 con 0x7f19c0101820 2023-09-13T09:43:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.086+0000 7f19c4803700 1 -- 172.21.15.6:0/902245191 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f19b8003a00 con 0x7f19c0101820 2023-09-13T09:43:28.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.087+0000 7f19c4803700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19a80a06c0 0x7f19a80a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.087+0000 7f19beffd700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19a80a06c0 0x7f19a80a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.087+0000 7f19c4803700 1 -- 172.21.15.6:0/902245191 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19b80cbc70 con 0x7f19c0101820 2023-09-13T09:43:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.088+0000 7f19beffd700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19a80a06c0 0x7f19a80a2b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b580 tx=0x7f19b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.091+0000 7f19c4803700 1 -- 172.21.15.6:0/902245191 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f19b8095750 con 0x7f19c0101820 2023-09-13T09:43:28.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 117812 2.79 MB/sec execute 48 sec latency 965.485 ms 2023-09-13T09:43:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:27 smithi006 ceph-mon[98665]: pgmap v418: 97 pgs: 97 active+clean; 64 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 875 KiB/s wr, 97 op/s 2023-09-13T09:43:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:27 smithi053 ceph-mon[102373]: pgmap v418: 97 pgs: 97 active+clean; 64 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 875 KiB/s wr, 97 op/s 2023-09-13T09:43:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:27 smithi131 ceph-mon[102785]: pgmap v418: 97 pgs: 97 active+clean; 64 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 875 KiB/s wr, 97 op/s 2023-09-13T09:43:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.340+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19c010b6e0 con 0x7f19c0101820 2023-09-13T09:43:28.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.340+0000 7f19c4803700 1 -- 172.21.15.6:0/902245191 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+11344 (secure 0 0 0) 0x7f19b8023020 con 0x7f19c0101820 2023-09-13T09:43:28.341 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:43:28.341 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:24.824592+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:43:28.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.342+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19a80a06c0 msgr2=0x7f19a80a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.342+0000 7f19c5805700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19a80a06c0 0x7f19a80a2b80 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f19b000b580 tx=0x7f19b0005fb0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.342+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c0101820 msgr2=0x7f19c019de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.342+0000 7f19c5805700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c0101820 0x7f19c019de10 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f19b8007ee0 tx=0x7f19b800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 shutdown_connections 2023-09-13T09:43:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19a80a06c0 0x7f19a80a2b80 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c0101820 0x7f19c019de10 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19c00ffc90 0x7f19c0068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 --2- 172.21.15.6:0/902245191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19c0100e80 0x7f19c019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 >> 172.21.15.6:0/902245191 conn(0x7f19c00fb220 msgr2=0x7f19c00fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 shutdown_connections 2023-09-13T09:43:28.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.343+0000 7f19c5805700 1 -- 172.21.15.6:0/902245191 wait complete. 2023-09-13T09:43:28.346 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 31 2023-09-13T09:43:28.355 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:43:28.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 -- 172.21.15.6:0/4029543647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a08100eb0 msgr2=0x7f1a08101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 --2- 172.21.15.6:0/4029543647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a08100eb0 0x7f1a08101310 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f19f40099c0 tx=0x7f19f4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 -- 172.21.15.6:0/4029543647 shutdown_connections 2023-09-13T09:43:28.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 --2- 172.21.15.6:0/4029543647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a08101850 0x7f1a08108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 --2- 172.21.15.6:0/4029543647 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a080ffcc0 0x7f1a081000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 --2- 172.21.15.6:0/4029543647 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a08100eb0 0x7f1a08101310 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 -- 172.21.15.6:0/4029543647 >> 172.21.15.6:0/4029543647 conn(0x7f1a080fb250 msgr2=0x7f1a080fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 -- 172.21.15.6:0/4029543647 shutdown_connections 2023-09-13T09:43:28.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.483+0000 7f1a0f187700 1 -- 172.21.15.6:0/4029543647 wait complete. 2023-09-13T09:43:28.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 Processor -- start 2023-09-13T09:43:28.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 -- start start 2023-09-13T09:43:28.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a080ffcc0 0x7f1a08196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a08100eb0 0x7f1a08196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a08101850 0x7f1a0819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0819e610 con 0x7f1a080ffcc0 2023-09-13T09:43:28.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0819e750 con 0x7f1a08100eb0 2023-09-13T09:43:28.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0f187700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0819e8e0 con 0x7f1a08101850 2023-09-13T09:43:28.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a080ffcc0 0x7f1a08196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a080ffcc0 0x7f1a08196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36202/0 (socket says 172.21.15.6:36202) 2023-09-13T09:43:28.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 -- 172.21.15.6:0/967957546 learned_addr learned my addr 172.21.15.6:0/967957546 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0d724700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a08101850 0x7f1a0819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a07fff700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a08100eb0 0x7f1a08196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 -- 172.21.15.6:0/967957546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a08101850 msgr2=0x7f1a0819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a08101850 0x7f1a0819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 -- 172.21.15.6:0/967957546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a08100eb0 msgr2=0x7f1a08196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a08100eb0 0x7f1a08196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0cf23700 1 -- 172.21.15.6:0/967957546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f40095f0 con 0x7f1a080ffcc0 2023-09-13T09:43:28.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a0d724700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a08101850 0x7f1a0819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.484+0000 7f1a07fff700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a08100eb0 0x7f1a08196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.485+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a080ffcc0 0x7f1a08196a90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00d980 tx=0x7f19fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.485+0000 7f1a05ffb700 1 -- 172.21.15.6:0/967957546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc00de60 con 0x7f1a080ffcc0 2023-09-13T09:43:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.485+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a0819ebc0 con 0x7f1a080ffcc0 2023-09-13T09:43:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.485+0000 7f1a05ffb700 1 -- 172.21.15.6:0/967957546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19fc0044e0 con 0x7f1a080ffcc0 2023-09-13T09:43:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.485+0000 7f1a05ffb700 1 -- 172.21.15.6:0/967957546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc003be0 con 0x7f1a080ffcc0 2023-09-13T09:43:28.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.485+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a0819f120 con 0x7f1a080ffcc0 2023-09-13T09:43:28.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.487+0000 7f1a05ffb700 1 -- 172.21.15.6:0/967957546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f19fc009bb0 con 0x7f1a080ffcc0 2023-09-13T09:43:28.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.488+0000 7f1a05ffb700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19f80a0640 0x7f19f80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a05ffb700 1 -- 172.21.15.6:0/967957546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19fc0cb9d0 con 0x7f1a080ffcc0 2023-09-13T09:43:28.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a07fff700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19f80a0640 0x7f19f80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 Processor -- start 2023-09-13T09:43:28.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 -- start start 2023-09-13T09:43:28.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a07fff700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19f80a0640 0x7f19f80a2b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f19f4006010 tx=0x7f19f4009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4c700 0x56334ff4cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4d060 0x56334ff4b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4ba00 0x56334ff4be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334fea4780 con 0x56334ff4d060 2023-09-13T09:43:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334fea20a0 con 0x56334ff4c700 2023-09-13T09:43:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334fe9d990 con 0x56334ff4ba00 2023-09-13T09:43:28.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4d060 0x56334ff4b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4d060 0x56334ff4b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36212/0 (socket says 172.21.15.6:36212) 2023-09-13T09:43:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a07fff700 1 -- 172.21.15.6:0/2947738213 learned_addr learned my addr 172.21.15.6:0/2947738213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.489+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4c700 0x56334ff4cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a0d724700 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4ba00 0x56334ff4be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a07fff700 1 -- 172.21.15.6:0/2947738213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4ba00 msgr2=0x56334ff4be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4ba00 0x56334ff4be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a07fff700 1 -- 172.21.15.6:0/2947738213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4c700 msgr2=0x56334ff4cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4c700 0x56334ff4cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a07fff700 1 -- 172.21.15.6:0/2947738213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56334fd1d630 con 0x56334ff4d060 2023-09-13T09:43:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a0d724700 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4ba00 0x56334ff4be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4d060 0x56334ff4b4c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f19f40053a0 tx=0x7f19f401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0e171651e38e6f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f19f2ffd700 1 -- 172.21.15.6:0/2947738213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f401e070 con 0x56334ff4d060 2023-09-13T09:43:28.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f19f2ffd700 1 -- 172.21.15.6:0/2947738213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19f40056b0 con 0x56334ff4d060 2023-09-13T09:43:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.490+0000 7f19f2ffd700 1 -- 172.21.15.6:0/2947738213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4004760 con 0x56334ff4d060 2023-09-13T09:43:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2947738213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4d060 msgr2=0x56334ff4b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4d060 0x56334ff4b4c0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f19f40053a0 tx=0x7f19f401e000 comp rx=0 tx=0).stop 2023-09-13T09:43:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2947738213 shutdown_connections 2023-09-13T09:43:28.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4ba00 0x56334ff4be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4c700 0x56334ff4cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2947738213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4d060 0x56334ff4b4c0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2947738213 >> 172.21.15.6:0/2947738213 conn(0x56334fea9c80 msgr2=0x56334ff45f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2947738213 shutdown_connections 2023-09-13T09:43:28.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2947738213 wait complete. 2023-09-13T09:43:28.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 -- start start 2023-09-13T09:43:28.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.491+0000 7f1a1b36cb80 1 Processor -- start 2023-09-13T09:43:28.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff54e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff553b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334fe3bbb0 con 0x56334ff4ba00 2023-09-13T09:43:28.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334fe3b8b0 con 0x56334ff4d060 2023-09-13T09:43:28.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334fd1f920 con 0x56334ff4c700 2023-09-13T09:43:28.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a1b36cb80 10 client.0 _ll_register_callbacks cb 0x56334fe39680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:28.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff54e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff54e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36216/0 (socket says 172.21.15.6:36216) 2023-09-13T09:43:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2438755251 learned_addr learned my addr 172.21.15.6:0/2438755251 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0d724700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2438755251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 msgr2=0x56334ff553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 msgr2=0x56334ff5c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2438755251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a08108a50 con 0x56334ff4ba00 2023-09-13T09:43:28.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.492+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff54e70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000c00 tx=0x7f19fc099940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc599298e803a50 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f19e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f19e7fff700 1 -- 172.21.15.6:0/2438755251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc098800 con 0x56334ff4ba00 2023-09-13T09:43:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56334ff3e670 con 0x56334ff4ba00 2023-09-13T09:43:28.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f19e7fff700 1 -- 172.21.15.6:0/2438755251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19fc09cf40 con 0x56334ff4ba00 2023-09-13T09:43:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f19e7fff700 1 -- 172.21.15.6:0/2438755251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19fc0a1180 con 0x56334ff4ba00 2023-09-13T09:43:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 10 client.16419 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56334feb57a0 con 0x56334ff4ba00 2023-09-13T09:43:28.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f19e7fff700 1 -- 172.21.15.6:0/2438755251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56334ff3e670 con 0x56334ff4ba00 2023-09-13T09:43:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f19e7fff700 1 -- 172.21.15.6:0/2438755251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f19fc098070 con 0x56334ff4ba00 2023-09-13T09:43:28.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 10 client.16419 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 10 client.16419 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:43:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 20 client.16419 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ff60bb0 0x56334ff62fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 4 client.16419 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:28.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.493+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56334fe96970 con 0x56334ff60bb0 2023-09-13T09:43:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.494+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ff60bb0 0x56334ff62fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.494+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ff60bb0 0x56334ff62fd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b618d9d25aa87653 server_cookie=ef261c5da18e638 in_seq=0 out_seq=0 2023-09-13T09:43:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.494+0000 7f19e7fff700 10 client.16419 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:43:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f19e7fff700 1 -- 172.21.15.6:0/2438755251 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56334fe96970 con 0x56334ff60bb0 2023-09-13T09:43:28.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f19e7fff700 10 client.16419 handle_command_reply: tid=0 2023-09-13T09:43:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 client.16419 shutdown 2023-09-13T09:43:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 msgr2=0x56334ff54e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff54e70 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f19fc000c00 tx=0x7f19fc099940 comp rx=0 tx=0).stop 2023-09-13T09:43:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 shutdown_connections 2023-09-13T09:43:28.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ff60bb0 0x56334ff62fd0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff54e70 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2438755251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f19e7fff700 0 client.16419 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:43:28.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 >> 172.21.15.6:0/2438755251 conn(0x56334fea9c80 msgr2=0x56334ff407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 shutdown_connections 2023-09-13T09:43:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2438755251 wait complete. 2023-09-13T09:43:28.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.495+0000 7f1a1b36cb80 20 client.16419 trim_cache size 0 max 16384 2023-09-13T09:43:28.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.508+0000 7f1a1b36cb80 1 Processor -- start 2023-09-13T09:43:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.508+0000 7f1a1b36cb80 1 -- start start 2023-09-13T09:43:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4ba00 0x56334ff4b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4c700 0x56334ff46fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4d060 0x56334ff5c380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334ff606c0 con 0x56334ff4c700 2023-09-13T09:43:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334ff47730 con 0x56334ff4ba00 2023-09-13T09:43:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334ff50490 con 0x56334ff4d060 2023-09-13T09:43:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4c700 0x56334ff46fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4c700 0x56334ff46fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36226/0 (socket says 172.21.15.6:36226) 2023-09-13T09:43:28.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 -- 172.21.15.6:0/1879103136 learned_addr learned my addr 172.21.15.6:0/1879103136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4ba00 0x56334ff4b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a0d724700 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4d060 0x56334ff5c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 -- 172.21.15.6:0/1879103136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4d060 msgr2=0x56334ff5c380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4d060 0x56334ff5c380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 -- 172.21.15.6:0/1879103136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4ba00 msgr2=0x56334ff4b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4ba00 0x56334ff4b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 -- 172.21.15.6:0/1879103136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56334fcc9de0 con 0x56334ff4c700 2023-09-13T09:43:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4ba00 0x56334ff4b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f1a07fff700 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4c700 0x56334ff46fb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f19f4005b40 tx=0x7f19f4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d108a365d89234 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f19f37fe700 1 -- 172.21.15.6:0/1879103136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f401e040 con 0x56334ff4c700 2023-09-13T09:43:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f19f37fe700 1 -- 172.21.15.6:0/1879103136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19f4004200 con 0x56334ff4c700 2023-09-13T09:43:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.509+0000 7f19f37fe700 1 -- 172.21.15.6:0/1879103136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f4003c60 con 0x56334ff4c700 2023-09-13T09:43:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/1879103136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4c700 msgr2=0x56334ff46fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4c700 0x56334ff46fb0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f19f4005b40 tx=0x7f19f4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/1879103136 shutdown_connections 2023-09-13T09:43:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4d060 0x56334ff5c380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4ba00 0x56334ff4b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/1879103136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4c700 0x56334ff46fb0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/1879103136 >> 172.21.15.6:0/1879103136 conn(0x56334fea9c80 msgr2=0x56334ff45ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/1879103136 shutdown_connections 2023-09-13T09:43:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/1879103136 wait complete. 2023-09-13T09:43:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 -- start start 2023-09-13T09:43:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.510+0000 7f1a1b36cb80 1 Processor -- start 2023-09-13T09:43:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff57b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff58080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a1b36cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334ff5b5e0 con 0x56334ff4ba00 2023-09-13T09:43:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334ff5b750 con 0x56334ff4d060 2023-09-13T09:43:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a1b36cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56334ff5b910 con 0x56334ff4c700 2023-09-13T09:43:28.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a1b36cb80 10 client.0 _ll_register_callbacks cb 0x56334fe39680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff57b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff57b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36230/0 (socket says 172.21.15.6:36230) 2023-09-13T09:43:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2155572572 learned_addr learned my addr 172.21.15.6:0/2155572572 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0d724700 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2155572572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 msgr2=0x56334ff58080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff58080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 msgr2=0x56334ff5b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 -- 172.21.15.6:0/2155572572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56334fd1d630 con 0x56334ff4ba00 2023-09-13T09:43:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0d724700 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:28.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f1a0cf23700 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff57b40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0990a0 tx=0x7f19fc0976c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a3ea8c986b7f30 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f19e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.511+0000 7f19e7fff700 1 -- 172.21.15.6:0/2155572572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc098800 con 0x56334ff4ba00 2023-09-13T09:43:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f19e7fff700 1 -- 172.21.15.6:0/2155572572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19fc09cf40 con 0x56334ff4ba00 2023-09-13T09:43:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19f40056b0 con 0x56334ff4ba00 2023-09-13T09:43:28.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f19e7fff700 1 -- 172.21.15.6:0/2155572572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19fc0a1180 con 0x56334ff4ba00 2023-09-13T09:43:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 10 client.16425 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56334fcb2c60 con 0x56334ff4ba00 2023-09-13T09:43:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f19e7fff700 1 -- 172.21.15.6:0/2155572572 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19f40056b0 con 0x56334ff4ba00 2023-09-13T09:43:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f19e7fff700 1 -- 172.21.15.6:0/2155572572 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f19fc095820 con 0x56334ff4ba00 2023-09-13T09:43:28.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 10 client.16425 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 10 client.16425 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:43:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 20 client.16425 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ffb4fc0 0x56334ffb73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 4 client.16425 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:43:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56334fe57050 con 0x56334ffb4fc0 2023-09-13T09:43:28.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.512+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ffb4fc0 0x56334ffb73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f19e7fff700 10 client.16425 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:43:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a07fff700 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ffb4fc0 0x56334ffb73e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6cdd5c18be1ee07e server_cookie=a556fb494dbdb4e3 in_seq=0 out_seq=0 2023-09-13T09:43:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f19e7fff700 1 -- 172.21.15.6:0/2155572572 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56334fe57050 con 0x56334ffb4fc0 2023-09-13T09:43:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f19e7fff700 10 client.16425 handle_command_reply: tid=0 2023-09-13T09:43:28.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 client.16425 shutdown 2023-09-13T09:43:28.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 msgr2=0x56334ff57b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff57b40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f19fc0990a0 tx=0x7f19fc0976c0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 shutdown_connections 2023-09-13T09:43:28.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56334ffb4fc0 0x56334ffb73e0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56334ff4d060 0x56334ff5b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f19e7fff700 0 client.16425 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:43:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56334ff4ba00 0x56334ff57b40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 --2- 172.21.15.6:0/2155572572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56334ff4c700 0x56334ff58080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 >> 172.21.15.6:0/2155572572 conn(0x56334fea9c80 msgr2=0x56334ff4f920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 shutdown_connections 2023-09-13T09:43:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 1 -- 172.21.15.6:0/2155572572 wait complete. 2023-09-13T09:43:28.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.513+0000 7f1a1b36cb80 20 client.16425 trim_cache size 0 max 16384 2023-09-13T09:43:28.539 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:43:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19f80a0640 msgr2=0x7f19f80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19f80a0640 0x7f19f80a2b00 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f19f4006010 tx=0x7f19f4009f10 comp rx=0 tx=0).stop 2023-09-13T09:43:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a080ffcc0 msgr2=0x7f1a08196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a080ffcc0 0x7f1a08196a90 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00d980 tx=0x7f19fc00dd40 comp rx=0 tx=0).stop 2023-09-13T09:43:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 shutdown_connections 2023-09-13T09:43:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a08101850 0x7f1a0819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19f80a0640 0x7f19f80a2b00 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a080ffcc0 0x7f1a08196a90 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 --2- 172.21.15.6:0/967957546 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1a08100eb0 0x7f1a08196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 >> 172.21.15.6:0/967957546 conn(0x7f1a080fb250 msgr2=0x7f1a08068d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 shutdown_connections 2023-09-13T09:43:28.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.514+0000 7f1a0f187700 1 -- 172.21.15.6:0/967957546 wait complete. 2023-09-13T09:43:28.543 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:43:28.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 -- 172.21.15.6:0/2202380536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228100eb0 msgr2=0x7f9228101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 --2- 172.21.15.6:0/2202380536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228100eb0 0x7f9228101310 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f92140099c0 tx=0x7f9214009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 -- 172.21.15.6:0/2202380536 shutdown_connections 2023-09-13T09:43:28.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 --2- 172.21.15.6:0/2202380536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9228101850 0x7f9228108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 --2- 172.21.15.6:0/2202380536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92280ffcc0 0x7f92281000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 --2- 172.21.15.6:0/2202380536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228100eb0 0x7f9228101310 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 -- 172.21.15.6:0/2202380536 >> 172.21.15.6:0/2202380536 conn(0x7f92280fb250 msgr2=0x7f92280fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 -- 172.21.15.6:0/2202380536 shutdown_connections 2023-09-13T09:43:28.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.671+0000 7f922ee68700 1 -- 172.21.15.6:0/2202380536 wait complete. 2023-09-13T09:43:28.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 Processor -- start 2023-09-13T09:43:28.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 -- start start 2023-09-13T09:43:28.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92280ffcc0 0x7f9228195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9228100eb0 0x7f9228195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228101850 0x7f922819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922819d4f0 con 0x7f92280ffcc0 2023-09-13T09:43:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922819d630 con 0x7f9228101850 2023-09-13T09:43:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922ee68700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f922819d7c0 con 0x7f9228100eb0 2023-09-13T09:43:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922cc04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92280ffcc0 0x7f9228195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922cc04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92280ffcc0 0x7f9228195970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36244/0 (socket says 172.21.15.6:36244) 2023-09-13T09:43:28.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922cc04700 1 -- 172.21.15.6:0/357062422 learned_addr learned my addr 172.21.15.6:0/357062422 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f922d405700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228101850 0x7f922819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.672+0000 7f9227fff700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9228100eb0 0x7f9228195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922cc04700 1 -- 172.21.15.6:0/357062422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9228100eb0 msgr2=0x7f9228195eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922cc04700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9228100eb0 0x7f9228195eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922cc04700 1 -- 172.21.15.6:0/357062422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228101850 msgr2=0x7f922819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922cc04700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228101850 0x7f922819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922cc04700 1 -- 172.21.15.6:0/357062422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9220009c40 con 0x7f92280ffcc0 2023-09-13T09:43:28.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f9227fff700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9228100eb0 0x7f9228195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:28.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922cc04700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92280ffcc0 0x7f9228195970 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f921c00e970 tx=0x7f921c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f9225ffb700 1 -- 172.21.15.6:0/357062422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c009790 con 0x7f92280ffcc0 2023-09-13T09:43:28.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f9225ffb700 1 -- 172.21.15.6:0/357062422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f921c00eeb0 con 0x7f92280ffcc0 2023-09-13T09:43:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f9225ffb700 1 -- 172.21.15.6:0/357062422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c003d20 con 0x7f92280ffcc0 2023-09-13T09:43:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92140095f0 con 0x7f92280ffcc0 2023-09-13T09:43:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.673+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9228068400 con 0x7f92280ffcc0 2023-09-13T09:43:28.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.675+0000 7f9225ffb700 1 -- 172.21.15.6:0/357062422 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f921c003e80 con 0x7f92280ffcc0 2023-09-13T09:43:28.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.676+0000 7f9225ffb700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92180a0640 0x7f92180a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.676+0000 7f9225ffb700 1 -- 172.21.15.6:0/357062422 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f921c014070 con 0x7f92280ffcc0 2023-09-13T09:43:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.676+0000 7f9227fff700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92180a0640 0x7f92180a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.676+0000 7f9227fff700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92180a0640 0x7f92180a2b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f921400b580 tx=0x7f921401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 Processor -- start 2023-09-13T09:43:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 -- start start 2023-09-13T09:43:28.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b6060 0x556c621b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c6210d780 con 0x556c621b6060 2023-09-13T09:43:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c6210b0a0 con 0x556c621b4a00 2023-09-13T09:43:28.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f923b04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c62106990 con 0x556c621b5700 2023-09-13T09:43:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f9227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b6060 0x556c621b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f9227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b6060 0x556c621b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36254/0 (socket says 172.21.15.6:36254) 2023-09-13T09:43:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f9227fff700 1 -- 172.21.15.6:0/4066094241 learned_addr learned my addr 172.21.15.6:0/4066094241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f922cc04700 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.677+0000 7f922d405700 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9227fff700 1 -- 172.21.15.6:0/4066094241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 msgr2=0x556c621b5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9227fff700 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621b5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9227fff700 1 -- 172.21.15.6:0/4066094241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 msgr2=0x556c621b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9227fff700 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9227fff700 1 -- 172.21.15.6:0/4066094241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c61f86630 con 0x556c621b6060 2023-09-13T09:43:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f922cc04700 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:43:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9227fff700 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b6060 0x556c621b44c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9214015000 tx=0x7f921401e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614c191490d66979 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9212ffd700 1 -- 172.21.15.6:0/4066094241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921402a070 con 0x556c621b6060 2023-09-13T09:43:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9212ffd700 1 -- 172.21.15.6:0/4066094241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9214005510 con 0x556c621b6060 2023-09-13T09:43:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.678+0000 7f9212ffd700 1 -- 172.21.15.6:0/4066094241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921401d040 con 0x556c621b6060 2023-09-13T09:43:28.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 -- 172.21.15.6:0/4066094241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b6060 msgr2=0x556c621b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b6060 0x556c621b44c0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9214015000 tx=0x7f921401e000 comp rx=0 tx=0).stop 2023-09-13T09:43:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 -- 172.21.15.6:0/4066094241 shutdown_connections 2023-09-13T09:43:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621b5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 --2- 172.21.15.6:0/4066094241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b6060 0x556c621b44c0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 -- 172.21.15.6:0/4066094241 >> 172.21.15.6:0/4066094241 conn(0x556c62112c80 msgr2=0x556c621aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 -- 172.21.15.6:0/4066094241 shutdown_connections 2023-09-13T09:43:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 -- 172.21.15.6:0/4066094241 wait complete. 2023-09-13T09:43:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 -- start start 2023-09-13T09:43:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 Processor -- start 2023-09-13T09:43:28.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b4a00 0x556c621bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.679+0000 7f923b04db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f923b04db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c620a4bb0 con 0x556c621b4a00 2023-09-13T09:43:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f923b04db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c620a48b0 con 0x556c621b6060 2023-09-13T09:43:28.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f923b04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c61f88920 con 0x556c621b5700 2023-09-13T09:43:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f923b04db80 10 client.0 _ll_register_callbacks cb 0x556c620a2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b4a00 0x556c621bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b4a00 0x556c621bdf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36258/0 (socket says 172.21.15.6:36258) 2023-09-13T09:43:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 -- 172.21.15.6:0/1673658827 learned_addr learned my addr 172.21.15.6:0/1673658827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922d405700 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 -- 172.21.15.6:0/1673658827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 msgr2=0x556c621be440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 -- 172.21.15.6:0/1673658827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 msgr2=0x556c621c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 -- 172.21.15.6:0/1673658827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9228108a50 con 0x556c621b4a00 2023-09-13T09:43:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922d405700 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f922cc04700 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b4a00 0x556c621bdf00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f921c099590 tx=0x7f921c099db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2902a082b2e5da96 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f9207fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f9207fff700 1 -- 172.21.15.6:0/1673658827 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921c0a1670 con 0x556c621b4a00 2023-09-13T09:43:28.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f9207fff700 1 -- 172.21.15.6:0/1673658827 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f921c0979a0 con 0x556c621b4a00 2023-09-13T09:43:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c621a7670 con 0x556c621b4a00 2023-09-13T09:43:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f9207fff700 1 -- 172.21.15.6:0/1673658827 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f921c00ccd0 con 0x556c621b4a00 2023-09-13T09:43:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f923b04db80 10 client.16437 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.680+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556c6211e7a0 con 0x556c621b4a00 2023-09-13T09:43:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f9207fff700 1 -- 172.21.15.6:0/1673658827 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c621a7670 con 0x556c621b4a00 2023-09-13T09:43:28.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f9207fff700 1 -- 172.21.15.6:0/1673658827 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f921c098af0 con 0x556c621b4a00 2023-09-13T09:43:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f923b04db80 10 client.16437 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f923b04db80 10 client.16437 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:43:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f923b04db80 20 client.16437 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f923b04db80 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c621c9d60 0x556c621cc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f923b04db80 4 client.16437 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c620ff970 con 0x556c621c9d60 2023-09-13T09:43:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.681+0000 7f9227fff700 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c621c9d60 0x556c621cc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.682+0000 7f9227fff700 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c621c9d60 0x556c621cc180 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3352697e81cef202 server_cookie=c6e3b040810550a5 in_seq=0 out_seq=0 2023-09-13T09:43:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.682+0000 7f9207fff700 10 client.16437 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:43:28.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f9207fff700 1 -- 172.21.15.6:0/1673658827 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556c620ff970 con 0x556c621c9d60 2023-09-13T09:43:28.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f9207fff700 10 client.16437 handle_command_reply: tid=0 2023-09-13T09:43:28.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 client.16437 shutdown 2023-09-13T09:43:28.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b4a00 msgr2=0x556c621bdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b4a00 0x556c621bdf00 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f921c099590 tx=0x7f921c099db0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 shutdown_connections 2023-09-13T09:43:28.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c621c9d60 0x556c621cc180 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b4a00 0x556c621bdf00 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 --2- 172.21.15.6:0/1673658827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b5700 0x556c621be440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f9207fff700 0 client.16437 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:43:28.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 >> 172.21.15.6:0/1673658827 conn(0x556c62112c80 msgr2=0x556c621a97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 shutdown_connections 2023-09-13T09:43:28.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 1 -- 172.21.15.6:0/1673658827 wait complete. 2023-09-13T09:43:28.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.683+0000 7f923b04db80 20 client.16437 trim_cache size 0 max 16384 2023-09-13T09:43:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.696+0000 7f923b04db80 1 Processor -- start 2023-09-13T09:43:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.696+0000 7f923b04db80 1 -- start start 2023-09-13T09:43:28.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.696+0000 7f923b04db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.696+0000 7f923b04db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f923b04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b6060 0x556c621b8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f923b04db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c621c9bd0 con 0x556c621b5700 2023-09-13T09:43:28.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f923b04db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c621bc6d0 con 0x556c621b4a00 2023-09-13T09:43:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f923b04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c621bda70 con 0x556c621b6060 2023-09-13T09:43:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36268/0 (socket says 172.21.15.6:36268) 2023-09-13T09:43:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 -- 172.21.15.6:0/4049760199 learned_addr learned my addr 172.21.15.6:0/4049760199 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f922cc04700 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f922d405700 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b6060 0x556c621b8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 -- 172.21.15.6:0/4049760199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b6060 msgr2=0x556c621b8920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b6060 0x556c621b8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 -- 172.21.15.6:0/4049760199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 msgr2=0x556c621b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 -- 172.21.15.6:0/4049760199 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c61f32de0 con 0x556c621b5700 2023-09-13T09:43:28.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f922cc04700 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:43:28.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f9227fff700 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c5440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f9214027040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc72c53fb41f92fe server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f92137fe700 1 -- 172.21.15.6:0/4049760199 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921402a070 con 0x556c621b5700 2023-09-13T09:43:28.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f92137fe700 1 -- 172.21.15.6:0/4049760199 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f921402b040 con 0x556c621b5700 2023-09-13T09:43:28.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.697+0000 7f92137fe700 1 -- 172.21.15.6:0/4049760199 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921401d040 con 0x556c621b5700 2023-09-13T09:43:28.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 -- 172.21.15.6:0/4049760199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 msgr2=0x556c621c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c5440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9214000c00 tx=0x7f9214027040 comp rx=0 tx=0).stop 2023-09-13T09:43:28.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 -- 172.21.15.6:0/4049760199 shutdown_connections 2023-09-13T09:43:28.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b6060 0x556c621b8920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b4a00 0x556c621b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 --2- 172.21.15.6:0/4049760199 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c5440 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 -- 172.21.15.6:0/4049760199 >> 172.21.15.6:0/4049760199 conn(0x556c62112c80 msgr2=0x556c621bcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 -- 172.21.15.6:0/4049760199 shutdown_connections 2023-09-13T09:43:28.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 -- 172.21.15.6:0/4049760199 wait complete. 2023-09-13T09:43:28.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 -- start start 2023-09-13T09:43:28.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.698+0000 7f923b04db80 1 Processor -- start 2023-09-13T09:43:28.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f923b04db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b4a00 0x556c621c1330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f923b04db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f923b04db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f923b04db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c621c4dd0 con 0x556c621b5700 2023-09-13T09:43:28.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f923b04db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c621c4f40 con 0x556c621b6060 2023-09-13T09:43:28.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f923b04db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c621c5100 con 0x556c621b4a00 2023-09-13T09:43:28.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f923b04db80 10 client.0 _ll_register_callbacks cb 0x556c620a2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:28.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36274/0 (socket says 172.21.15.6:36274) 2023-09-13T09:43:28.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 -- 172.21.15.6:0/3312594586 learned_addr learned my addr 172.21.15.6:0/3312594586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f922cc04700 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b4a00 0x556c621c1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f922d405700 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 -- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b4a00 msgr2=0x556c621c1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b4a00 0x556c621c1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 -- 172.21.15.6:0/3312594586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 msgr2=0x556c621c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 -- 172.21.15.6:0/3312594586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c6211e7a0 con 0x556c621b5700 2023-09-13T09:43:28.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9227fff700 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c1870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f921400a010 tx=0x7f9214009970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90916e09355ac96f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.699+0000 7f9207fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:28.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f9207fff700 1 -- 172.21.15.6:0/3312594586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f921402a070 con 0x556c621b5700 2023-09-13T09:43:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f9207fff700 1 -- 172.21.15.6:0/3312594586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9214003b60 con 0x556c621b5700 2023-09-13T09:43:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9214005510 con 0x556c621b5700 2023-09-13T09:43:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f9207fff700 1 -- 172.21.15.6:0/3312594586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9214003d20 con 0x556c621b5700 2023-09-13T09:43:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 10 client.16443 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:28.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556c61f86630 con 0x556c621b5700 2023-09-13T09:43:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f9207fff700 1 -- 172.21.15.6:0/3312594586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9214005510 con 0x556c621b5700 2023-09-13T09:43:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f9207fff700 1 -- 172.21.15.6:0/3312594586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f921403d030 con 0x556c621b5700 2023-09-13T09:43:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 10 client.16443 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 10 client.16443 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:43:28.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 20 client.16443 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c6221e8e0 0x556c62220d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 4 client.16443 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:43:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.700+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556c620c0050 con 0x556c6221e8e0 2023-09-13T09:43:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.701+0000 7f922cc04700 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c6221e8e0 0x556c62220d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.701+0000 7f9207fff700 10 client.16443 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:43:28.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.701+0000 7f922cc04700 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c6221e8e0 0x556c62220d00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f4cd27093e4af27d server_cookie=b965c7322c5d3776 in_seq=0 out_seq=0 2023-09-13T09:43:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.701+0000 7f9207fff700 1 -- 172.21.15.6:0/3312594586 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556c620c0050 con 0x556c6221e8e0 2023-09-13T09:43:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.701+0000 7f9207fff700 10 client.16443 handle_command_reply: tid=0 2023-09-13T09:43:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 client.16443 shutdown 2023-09-13T09:43:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 msgr2=0x556c621c1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c1870 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f921400a010 tx=0x7f9214009970 comp rx=0 tx=0).stop 2023-09-13T09:43:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 shutdown_connections 2023-09-13T09:43:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x556c6221e8e0 0x556c62220d00 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c621b6060 0x556c621c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c621b4a00 0x556c621c1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f9207fff700 0 client.16443 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:43:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 --2- 172.21.15.6:0/3312594586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c621b5700 0x556c621c1870 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 >> 172.21.15.6:0/3312594586 conn(0x556c62112c80 msgr2=0x556c621b8920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 shutdown_connections 2023-09-13T09:43:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 1 -- 172.21.15.6:0/3312594586 wait complete. 2023-09-13T09:43:28.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.702+0000 7f923b04db80 20 client.16443 trim_cache size 0 max 16384 2023-09-13T09:43:28.725 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:43:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92180a0640 msgr2=0x7f92180a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92180a0640 0x7f92180a2b00 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f921400b580 tx=0x7f921401a040 comp rx=0 tx=0).stop 2023-09-13T09:43:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92280ffcc0 msgr2=0x7f9228195970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92280ffcc0 0x7f9228195970 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f921c00e970 tx=0x7f921c00ed30 comp rx=0 tx=0).stop 2023-09-13T09:43:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 shutdown_connections 2023-09-13T09:43:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9228101850 0x7f922819cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f92180a0640 0x7f92180a2b00 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92280ffcc0 0x7f9228195970 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 --2- 172.21.15.6:0/357062422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9228100eb0 0x7f9228195eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 >> 172.21.15.6:0/357062422 conn(0x7f92280fb250 msgr2=0x7f92281043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 shutdown_connections 2023-09-13T09:43:28.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.703+0000 7f922ee68700 1 -- 172.21.15.6:0/357062422 wait complete. 2023-09-13T09:43:28.729 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:43:28.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 -- 172.21.15.6:0/3264076467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8100e90 msgr2=0x7f26c81012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 --2- 172.21.15.6:0/3264076467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8100e90 0x7f26c81012f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f26b80099c0 tx=0x7f26b8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 -- 172.21.15.6:0/3264076467 shutdown_connections 2023-09-13T09:43:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 --2- 172.21.15.6:0/3264076467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c8101830 0x7f26c81080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 --2- 172.21.15.6:0/3264076467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26c80ffca0 0x7f26c81000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 --2- 172.21.15.6:0/3264076467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8100e90 0x7f26c81012f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 -- 172.21.15.6:0/3264076467 >> 172.21.15.6:0/3264076467 conn(0x7f26c80fb1f0 msgr2=0x7f26c80fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 -- 172.21.15.6:0/3264076467 shutdown_connections 2023-09-13T09:43:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 -- 172.21.15.6:0/3264076467 wait complete. 2023-09-13T09:43:28.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.857+0000 7f26cd667700 1 Processor -- start 2023-09-13T09:43:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26cd667700 1 -- start start 2023-09-13T09:43:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26cd667700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26c80ffca0 0x7f26c8103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26cd667700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c8100e90 0x7f26c81025a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26cd667700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8101830 0x7f26c8102ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26cd667700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c8103280 con 0x7f26c8101830 2023-09-13T09:43:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26cd667700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c81033f0 con 0x7f26c80ffca0 2023-09-13T09:43:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26cd667700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c81a0b20 con 0x7f26c8100e90 2023-09-13T09:43:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8101830 0x7f26c8102ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8101830 0x7f26c8102ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36290/0 (socket says 172.21.15.6:36290) 2023-09-13T09:43:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 -- 172.21.15.6:0/3160920193 learned_addr learned my addr 172.21.15.6:0/3160920193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c8100e90 0x7f26c81025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26c80ffca0 0x7f26c8103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 -- 172.21.15.6:0/3160920193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c8100e90 msgr2=0x7f26c81025a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c8100e90 0x7f26c81025a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 -- 172.21.15.6:0/3160920193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26c80ffca0 msgr2=0x7f26c8103f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26c80ffca0 0x7f26c8103f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c77fe700 1 -- 172.21.15.6:0/3160920193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b80095f0 con 0x7f26c8101830 2023-09-13T09:43:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.858+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c8100e90 0x7f26c81025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:28.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.859+0000 7f26c77fe700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8101830 0x7f26c8102ae0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007ee0 tx=0x7f26c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.859+0000 7f26bffff700 1 -- 172.21.15.6:0/3160920193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0017070 con 0x7f26c8101830 2023-09-13T09:43:28.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.859+0000 7f26bffff700 1 -- 172.21.15.6:0/3160920193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26c000f040 con 0x7f26c8101830 2023-09-13T09:43:28.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.859+0000 7f26bffff700 1 -- 172.21.15.6:0/3160920193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c0005740 con 0x7f26c8101830 2023-09-13T09:43:28.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.859+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c81a0e00 con 0x7f26c8101830 2023-09-13T09:43:28.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.859+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c81a1230 con 0x7f26c8101830 2023-09-13T09:43:28.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.861+0000 7f26bffff700 1 -- 172.21.15.6:0/3160920193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f26c00058a0 con 0x7f26c8101830 2023-09-13T09:43:28.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.862+0000 7f26bffff700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26b40a06c0 0x7f26b40a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.862+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26b40a06c0 0x7f26b40a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.862+0000 7f26bffff700 1 -- 172.21.15.6:0/3160920193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f26c00cb3b0 con 0x7f26c8101830 2023-09-13T09:43:28.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.862+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26b40a06c0 0x7f26b40a2b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f26c8100cf0 tx=0x7f26b000b5b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 Processor -- start 2023-09-13T09:43:28.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 -- start start 2023-09-13T09:43:28.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780126b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780125e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78007e780 con 0x55d780127060 2023-09-13T09:43:28.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78007c0a0 con 0x55d780125a00 2023-09-13T09:43:28.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26d984cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d780077990 con 0x55d780126700 2023-09-13T09:43:28.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26c67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26c67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801254c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36296/0 (socket says 172.21.15.6:36296) 2023-09-13T09:43:28.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26c67fc700 1 -- 172.21.15.6:0/3385444209 learned_addr learned my addr 172.21.15.6:0/3385444209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26c77fe700 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780125e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.863+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780126b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26c67fc700 1 -- 172.21.15.6:0/3385444209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 msgr2=0x55d780126b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780126b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26c67fc700 1 -- 172.21.15.6:0/3385444209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 msgr2=0x55d780125e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780125e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26c67fc700 1 -- 172.21.15.6:0/3385444209 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d77fef7630 con 0x55d780127060 2023-09-13T09:43:28.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801254c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009990 tx=0x7f26b8005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c6b7ace3716ac2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26bd7fa700 1 -- 172.21.15.6:0/3385444209 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8005230 con 0x55d780127060 2023-09-13T09:43:28.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26bd7fa700 1 -- 172.21.15.6:0/3385444209 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26b801e040 con 0x55d780127060 2023-09-13T09:43:28.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.864+0000 7f26bd7fa700 1 -- 172.21.15.6:0/3385444209 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8003b50 con 0x55d780127060 2023-09-13T09:43:28.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 -- 172.21.15.6:0/3385444209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 msgr2=0x55d7801254c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801254c0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f26b8009990 tx=0x7f26b8005e80 comp rx=0 tx=0).stop 2023-09-13T09:43:28.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 -- 172.21.15.6:0/3385444209 shutdown_connections 2023-09-13T09:43:28.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780125e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780126b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3385444209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801254c0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 -- 172.21.15.6:0/3385444209 >> 172.21.15.6:0/3385444209 conn(0x55d780083c80 msgr2=0x55d78011ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 -- 172.21.15.6:0/3385444209 shutdown_connections 2023-09-13T09:43:28.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 -- 172.21.15.6:0/3385444209 wait complete. 2023-09-13T09:43:28.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 -- start start 2023-09-13T09:43:28.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 Processor -- start 2023-09-13T09:43:28.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d78012ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.865+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780126700 0x55d78012f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780127060 0x55d780136410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26d984cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d780015bb0 con 0x55d780126700 2023-09-13T09:43:28.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26d984cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7800158b0 con 0x55d780125a00 2023-09-13T09:43:28.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26d984cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d77fef9920 con 0x55d780127060 2023-09-13T09:43:28.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26d984cb80 10 client.0 _ll_register_callbacks cb 0x55d780013680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:28.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780126700 0x55d78012f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780126700 0x55d78012f3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36302/0 (socket says 172.21.15.6:36302) 2023-09-13T09:43:28.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 -- 172.21.15.6:0/729674344 learned_addr learned my addr 172.21.15.6:0/729674344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d78012ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c77fe700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780127060 0x55d780136410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 -- 172.21.15.6:0/729674344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780127060 msgr2=0x55d780136410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780127060 0x55d780136410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 -- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 msgr2=0x55d78012ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d78012ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 -- 172.21.15.6:0/729674344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c8108a30 con 0x55d780126700 2023-09-13T09:43:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c77fe700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780127060 0x55d780136410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26c67fc700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780126700 0x55d78012f3d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f26b800b580 tx=0x7f26b8005170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddaccfd78252ceaa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26ae7fc700 1 -- 172.21.15.6:0/729674344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b8003b30 con 0x55d780126700 2023-09-13T09:43:28.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26ae7fc700 1 -- 172.21.15.6:0/729674344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f26b8003c90 con 0x55d780126700 2023-09-13T09:43:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d780118670 con 0x55d780126700 2023-09-13T09:43:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.866+0000 7f26ae7fc700 1 -- 172.21.15.6:0/729674344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26b80056e0 con 0x55d780126700 2023-09-13T09:43:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 10 client.16455 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d78008f7a0 con 0x55d780126700 2023-09-13T09:43:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26ae7fc700 1 -- 172.21.15.6:0/729674344 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d780118670 con 0x55d780126700 2023-09-13T09:43:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26ae7fc700 1 -- 172.21.15.6:0/729674344 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f26b8021070 con 0x55d780126700 2023-09-13T09:43:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 10 client.16455 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 10 client.16455 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:43:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 20 client.16455 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:28.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78013a930 0x55d78013cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 4 client.16455 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d780070970 con 0x55d78013a930 2023-09-13T09:43:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.867+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78013a930 0x55d78013cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.868+0000 7f26ae7fc700 10 client.16455 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:43:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.868+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78013a930 0x55d78013cd50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3caaece0009fda47 server_cookie=69521443f21a5bef in_seq=0 out_seq=0 2023-09-13T09:43:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.868+0000 7f26ae7fc700 1 -- 172.21.15.6:0/729674344 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d780070970 con 0x55d78013a930 2023-09-13T09:43:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.868+0000 7f26ae7fc700 10 client.16455 handle_command_reply: tid=0 2023-09-13T09:43:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 client.16455 shutdown 2023-09-13T09:43:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780126700 msgr2=0x55d78012f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780126700 0x55d78012f3d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f26b800b580 tx=0x7f26b8005170 comp rx=0 tx=0).stop 2023-09-13T09:43:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 shutdown_connections 2023-09-13T09:43:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78013a930 0x55d78013cd50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780127060 0x55d780136410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26ae7fc700 0 client.16455 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:43:28.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d78012ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 --2- 172.21.15.6:0/729674344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780126700 0x55d78012f3d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 >> 172.21.15.6:0/729674344 conn(0x55d780083c80 msgr2=0x55d78011a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 shutdown_connections 2023-09-13T09:43:28.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 1 -- 172.21.15.6:0/729674344 wait complete. 2023-09-13T09:43:28.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.869+0000 7f26d984cb80 20 client.16455 trim_cache size 0 max 16384 2023-09-13T09:43:28.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 Processor -- start 2023-09-13T09:43:28.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 -- start start 2023-09-13T09:43:28.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780125a00 0x55d7801254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d7801363d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780127060 0x55d78012ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d780121730 con 0x55d780125a00 2023-09-13T09:43:28.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d780120810 con 0x55d780127060 2023-09-13T09:43:28.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26d984cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d78012fb10 con 0x55d780126700 2023-09-13T09:43:28.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780125a00 0x55d7801254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26c6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780125a00 0x55d7801254c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36308/0 (socket says 172.21.15.6:36308) 2023-09-13T09:43:28.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26c6ffd700 1 -- 172.21.15.6:0/37673099 learned_addr learned my addr 172.21.15.6:0/37673099 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26c77fe700 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780127060 0x55d78012ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.882+0000 7f26c67fc700 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d7801363d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26c6ffd700 1 -- 172.21.15.6:0/37673099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 msgr2=0x55d7801363d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d7801363d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26c6ffd700 1 -- 172.21.15.6:0/37673099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780127060 msgr2=0x55d78012ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780127060 0x55d78012ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26c6ffd700 1 -- 172.21.15.6:0/37673099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d77fea3de0 con 0x55d780125a00 2023-09-13T09:43:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26c77fe700 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780127060 0x55d78012ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:28.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780125a00 0x55d7801254c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55d78013d620 tx=0x7f26b0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d85f55e6d4877835 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26bdffb700 1 -- 172.21.15.6:0/37673099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b0025040 con 0x55d780125a00 2023-09-13T09:43:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26bdffb700 1 -- 172.21.15.6:0/37673099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26b0028530 con 0x55d780125a00 2023-09-13T09:43:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.883+0000 7f26bdffb700 1 -- 172.21.15.6:0/37673099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b00117b0 con 0x55d780125a00 2023-09-13T09:43:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 -- 172.21.15.6:0/37673099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780125a00 msgr2=0x55d7801254c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780125a00 0x55d7801254c0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x55d78013d620 tx=0x7f26b0015000 comp rx=0 tx=0).stop 2023-09-13T09:43:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 -- 172.21.15.6:0/37673099 shutdown_connections 2023-09-13T09:43:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780127060 0x55d78012ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780125a00 0x55d7801254c0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 --2- 172.21.15.6:0/37673099 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d7801363d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 -- 172.21.15.6:0/37673099 >> 172.21.15.6:0/37673099 conn(0x55d780083c80 msgr2=0x55d78011fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 -- 172.21.15.6:0/37673099 shutdown_connections 2023-09-13T09:43:28.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 -- 172.21.15.6:0/37673099 wait complete. 2023-09-13T09:43:28.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 -- start start 2023-09-13T09:43:28.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 Processor -- start 2023-09-13T09:43:28.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780135c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.884+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780136150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26d984cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801326b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26d984cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d780132bf0 con 0x55d780127060 2023-09-13T09:43:28.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26d984cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d780132d60 con 0x55d780125a00 2023-09-13T09:43:28.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26d984cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d780132f20 con 0x55d780126700 2023-09-13T09:43:28.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26d984cb80 10 client.0 _ll_register_callbacks cb 0x55d780013680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:28.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780136150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780136150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:39370/0 (socket says 172.21.15.6:39370) 2023-09-13T09:43:28.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 -- 172.21.15.6:0/3332738214 learned_addr learned my addr 172.21.15.6:0/3332738214 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:28.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780135c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 -- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 msgr2=0x55d780135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780135c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 -- 172.21.15.6:0/3332738214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 msgr2=0x55d7801326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:28.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 -- 172.21.15.6:0/3332738214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26b000f9a0 con 0x55d780126700 2023-09-13T09:43:28.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26c67fc700 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780136150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26b80098e0 tx=0x7f26b8004c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de804163728c45fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:28.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.885+0000 7f26ae7fc700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:43:28.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.886+0000 7f26ae7fc700 1 -- 172.21.15.6:0/3332738214 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b800f970 con 0x55d780126700 2023-09-13T09:43:28.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.886+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26b801e040 con 0x55d780126700 2023-09-13T09:43:28.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.886+0000 7f26ae7fc700 1 -- 172.21.15.6:0/3332738214 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f26b8000e40 con 0x55d780126700 2023-09-13T09:43:28.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.886+0000 7f26ae7fc700 1 -- 172.21.15.6:0/3332738214 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26b8005290 con 0x55d780126700 2023-09-13T09:43:28.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.886+0000 7f26d984cb80 10 client.25888 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:28.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.886+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55d77fe8cc60 con 0x55d780126700 2023-09-13T09:43:28.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.886+0000 7f26ae7fc700 1 -- 172.21.15.6:0/3332738214 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f26b801e040 con 0x55d780126700 2023-09-13T09:43:28.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26ae7fc700 1 -- 172.21.15.6:0/3332738214 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f26b80099f0 con 0x55d780126700 2023-09-13T09:43:28.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26d984cb80 10 client.25888 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:28.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26d984cb80 10 client.25888 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:43:28.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26d984cb80 20 client.25888 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:28.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78018f810 0x55d780191c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:28.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26d984cb80 4 client.25888 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:43:28.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d780031050 con 0x55d78018f810 2023-09-13T09:43:28.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.887+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78018f810 0x55d780191c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:28.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26c6ffd700 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78018f810 0x55d780191c30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ff9bc54f9902d174 server_cookie=ea2cbe82966f9b90 in_seq=0 out_seq=0 2023-09-13T09:43:28.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26ae7fc700 10 client.25888 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:43:28.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26ae7fc700 1 -- 172.21.15.6:0/3332738214 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d780031050 con 0x55d78018f810 2023-09-13T09:43:28.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26ae7fc700 10 client.25888 handle_command_reply: tid=0 2023-09-13T09:43:28.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 client.25888 shutdown 2023-09-13T09:43:28.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 msgr2=0x55d780136150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780136150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f26b80098e0 tx=0x7f26b8004c00 comp rx=0 tx=0).stop 2023-09-13T09:43:28.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 shutdown_connections 2023-09-13T09:43:28.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55d78018f810 0x55d780191c30 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d780127060 0x55d7801326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d780125a00 0x55d780135c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26ae7fc700 0 client.25888 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:43:28.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 --2- 172.21.15.6:0/3332738214 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d780126700 0x55d780136150 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 >> 172.21.15.6:0/3332738214 conn(0x55d780083c80 msgr2=0x55d7801298e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 shutdown_connections 2023-09-13T09:43:28.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 1 -- 172.21.15.6:0/3332738214 wait complete. 2023-09-13T09:43:28.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.888+0000 7f26d984cb80 20 client.25888 trim_cache size 0 max 16384 2023-09-13T09:43:28.916 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:43:28.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26b40a06c0 msgr2=0x7f26b40a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26b40a06c0 0x7f26b40a2b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f26c8100cf0 tx=0x7f26b000b5b0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8101830 msgr2=0x7f26c8102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:28.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8101830 0x7f26c8102ae0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f26c0007ee0 tx=0x7f26c000d3b0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 shutdown_connections 2023-09-13T09:43:28.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f26b40a06c0 0x7f26b40a2b80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26c8101830 0x7f26c8102ae0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f26c80ffca0 0x7f26c8103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 --2- 172.21.15.6:0/3160920193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26c8100e90 0x7f26c81025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:28.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 >> 172.21.15.6:0/3160920193 conn(0x7f26c80fb1f0 msgr2=0x7f26c80fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:28.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 shutdown_connections 2023-09-13T09:43:28.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:28.889+0000 7f26cd667700 1 -- 172.21.15.6:0/3160920193 wait complete. 2023-09-13T09:43:28.920 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:43:29.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:28 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/902245191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:43:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 -- 172.21.15.6:0/493916745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 msgr2=0x7f73a01011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 --2- 172.21.15.6:0/493916745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a01011e0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f73900099c0 tx=0x7f7390009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 -- 172.21.15.6:0/493916745 shutdown_connections 2023-09-13T09:43:29.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 --2- 172.21.15.6:0/493916745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a0102950 0x7f73a0109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 --2- 172.21.15.6:0/493916745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a01011e0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 --2- 172.21.15.6:0/493916745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a0101fb0 0x7f73a0102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 -- 172.21.15.6:0/493916745 >> 172.21.15.6:0/493916745 conn(0x7f73a00fc330 msgr2=0x7f73a00fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 -- 172.21.15.6:0/493916745 shutdown_connections 2023-09-13T09:43:29.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 -- 172.21.15.6:0/493916745 wait complete. 2023-09-13T09:43:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 Processor -- start 2023-09-13T09:43:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.049+0000 7f73a748d700 1 -- start start 2023-09-13T09:43:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a0196b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a0101fb0 0x7f73a0197040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a0102950 0x7f73a019e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a019e680 con 0x7f73a0100dc0 2023-09-13T09:43:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a019e7c0 con 0x7f73a0101fb0 2023-09-13T09:43:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a019e950 con 0x7f73a0102950 2023-09-13T09:43:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a0196b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a0196b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36328/0 (socket says 172.21.15.6:36328) 2023-09-13T09:43:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 -- 172.21.15.6:0/3098387624 learned_addr learned my addr 172.21.15.6:0/3098387624 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 -- 172.21.15.6:0/3098387624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a0102950 msgr2=0x7f73a019e0b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T09:43:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a0102950 0x7f73a019e0b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 -- 172.21.15.6:0/3098387624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a0101fb0 msgr2=0x7f73a0197040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a0101fb0 0x7f73a0197040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 -- 172.21.15.6:0/3098387624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73900095f0 con 0x7f73a0100dc0 2023-09-13T09:43:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a5229700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a0196b00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f73900036f0 tx=0x7f7390009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73967fc700 1 -- 172.21.15.6:0/3098387624 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739001d070 con 0x7f73a0100dc0 2023-09-13T09:43:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a019ebd0 con 0x7f73a0100dc0 2023-09-13T09:43:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73967fc700 1 -- 172.21.15.6:0/3098387624 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7390004110 con 0x7f73a0100dc0 2023-09-13T09:43:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73967fc700 1 -- 172.21.15.6:0/3098387624 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7390021410 con 0x7f73a0100dc0 2023-09-13T09:43:29.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.050+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a019f000 con 0x7f73a0100dc0 2023-09-13T09:43:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.052+0000 7f73967fc700 1 -- 172.21.15.6:0/3098387624 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f739000f660 con 0x7f73a0100dc0 2023-09-13T09:43:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.053+0000 7f73967fc700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f738c0a0640 0x7f738c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.053+0000 7f73967fc700 1 -- 172.21.15.6:0/3098387624 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f73900ccc00 con 0x7f73a0100dc0 2023-09-13T09:43:29.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.053+0000 7f73a4a28700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f738c0a0640 0x7f738c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.054+0000 7f73a4a28700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f738c0a0640 0x7f738c0a2b00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f739c005950 tx=0x7f739c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.054+0000 7f73b3672b80 1 Processor -- start 2023-09-13T09:43:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.054+0000 7f73b3672b80 1 -- start start 2023-09-13T09:43:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.054+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af656b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.054+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af655e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73b3672b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af5ae780 con 0x5562af655a00 2023-09-13T09:43:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73b3672b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af5ac0a0 con 0x5562af657060 2023-09-13T09:43:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73b3672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af5a7990 con 0x5562af656700 2023-09-13T09:43:29.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af655e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af655e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36340/0 (socket says 172.21.15.6:36340) 2023-09-13T09:43:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 -- 172.21.15.6:0/206068151 learned_addr learned my addr 172.21.15.6:0/206068151 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5229700 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af656b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a4a28700 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 -- 172.21.15.6:0/206068151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 msgr2=0x5562af656b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af656b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 -- 172.21.15.6:0/206068151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 msgr2=0x5562af6554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 -- 172.21.15.6:0/206068151 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562af427630 con 0x5562af655a00 2023-09-13T09:43:29.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5229700 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af656b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:43:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f73a5a2a700 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af655e80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d00 tx=0x7f739800b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77948be1148654f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f738b7fe700 1 -- 172.21.15.6:0/206068151 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739800e070 con 0x5562af655a00 2023-09-13T09:43:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f738b7fe700 1 -- 172.21.15.6:0/206068151 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7398009830 con 0x5562af655a00 2023-09-13T09:43:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.055+0000 7f738b7fe700 1 -- 172.21.15.6:0/206068151 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7398011390 con 0x5562af655a00 2023-09-13T09:43:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 -- 172.21.15.6:0/206068151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 msgr2=0x5562af655e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af655e80 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7398009d00 tx=0x7f739800b330 comp rx=0 tx=0).stop 2023-09-13T09:43:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 -- 172.21.15.6:0/206068151 shutdown_connections 2023-09-13T09:43:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af655e80 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af656b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 --2- 172.21.15.6:0/206068151 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 -- 172.21.15.6:0/206068151 >> 172.21.15.6:0/206068151 conn(0x5562af5b3c80 msgr2=0x5562af64ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 -- 172.21.15.6:0/206068151 shutdown_connections 2023-09-13T09:43:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 -- 172.21.15.6:0/206068151 wait complete. 2023-09-13T09:43:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.056+0000 7f73b3672b80 1 -- start start 2023-09-13T09:43:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 1 Processor -- start 2023-09-13T09:43:29.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af655a00 0x5562af65ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af65f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af545bb0 con 0x5562af656700 2023-09-13T09:43:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af5458b0 con 0x5562af657060 2023-09-13T09:43:29.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af429920 con 0x5562af655a00 2023-09-13T09:43:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73b3672b80 10 client.0 _ll_register_callbacks cb 0x5562af543680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af65f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af65f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36344/0 (socket says 172.21.15.6:36344) 2023-09-13T09:43:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 -- 172.21.15.6:0/2355484253 learned_addr learned my addr 172.21.15.6:0/2355484253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a5229700 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af655a00 0x5562af65ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a5a2a700 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 -- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af655a00 msgr2=0x5562af65ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af655a00 0x5562af65ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 -- 172.21.15.6:0/2355484253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 msgr2=0x5562af6664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.057+0000 7f73a4a28700 1 -- 172.21.15.6:0/2355484253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73980099b0 con 0x5562af656700 2023-09-13T09:43:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73a4a28700 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af65f460 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f739c00de70 tx=0x7f739c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a678006a86e9563b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f7388ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f7388ff9700 1 -- 172.21.15.6:0/2355484253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c00dea0 con 0x5562af656700 2023-09-13T09:43:29.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f7388ff9700 1 -- 172.21.15.6:0/2355484253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f739c01e420 con 0x5562af656700 2023-09-13T09:43:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562af5a0970 con 0x5562af656700 2023-09-13T09:43:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f7388ff9700 1 -- 172.21.15.6:0/2355484253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f739c01e5e0 con 0x5562af656700 2023-09-13T09:43:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 10 client.16470 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5562af5bf7a0 con 0x5562af656700 2023-09-13T09:43:29.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f7388ff9700 1 -- 172.21.15.6:0/2355484253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5562af5a0970 con 0x5562af656700 2023-09-13T09:43:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f7388ff9700 1 -- 172.21.15.6:0/2355484253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f739c00f7c0 con 0x5562af656700 2023-09-13T09:43:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 10 client.16470 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 10 client.16470 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:43:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 20 client.16470 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:29.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af66ada0 0x5562af66d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 4 client.16470 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.058+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5562af561050 con 0x5562af66ada0 2023-09-13T09:43:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.059+0000 7f73a5229700 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af66ada0 0x5562af66d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.059+0000 7f7388ff9700 10 client.16470 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:43:29.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.059+0000 7f73a5229700 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af66ada0 0x5562af66d1c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efd30bb2d201c2e1 server_cookie=42c781c8e516688d in_seq=0 out_seq=0 2023-09-13T09:43:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f7388ff9700 1 -- 172.21.15.6:0/2355484253 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5562af561050 con 0x5562af66ada0 2023-09-13T09:43:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f7388ff9700 10 client.16470 handle_command_reply: tid=0 2023-09-13T09:43:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 client.16470 shutdown 2023-09-13T09:43:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 msgr2=0x5562af65f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af65f460 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f739c00de70 tx=0x7f739c004750 comp rx=0 tx=0).stop 2023-09-13T09:43:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 shutdown_connections 2023-09-13T09:43:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af66ada0 0x5562af66d1c0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af6664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f7388ff9700 0 client.16470 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:43:29.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af655a00 0x5562af65ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2355484253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af65f460 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 >> 172.21.15.6:0/2355484253 conn(0x5562af5b3c80 msgr2=0x5562af64fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 shutdown_connections 2023-09-13T09:43:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 1 -- 172.21.15.6:0/2355484253 wait complete. 2023-09-13T09:43:29.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.060+0000 7f73b3672b80 20 client.16470 trim_cache size 0 max 16384 2023-09-13T09:43:29.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 Processor -- start 2023-09-13T09:43:29.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 -- start start 2023-09-13T09:43:29.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af655a00 0x5562af6554c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af666460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af657060 0x5562af65db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af6513a0 con 0x5562af656700 2023-09-13T09:43:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af64c900 con 0x5562af655a00 2023-09-13T09:43:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73b3672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af65d910 con 0x5562af657060 2023-09-13T09:43:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73a4a28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af666460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.073+0000 7f73a4a28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af666460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36352/0 (socket says 172.21.15.6:36352) 2023-09-13T09:43:29.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a4a28700 1 -- 172.21.15.6:0/767379538 learned_addr learned my addr 172.21.15.6:0/767379538 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a5a2a700 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af657060 0x5562af65db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a5229700 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af655a00 0x5562af6554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a4a28700 1 -- 172.21.15.6:0/767379538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af657060 msgr2=0x5562af65db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a4a28700 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af657060 0x5562af65db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a4a28700 1 -- 172.21.15.6:0/767379538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af655a00 msgr2=0x5562af6554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a4a28700 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af655a00 0x5562af6554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a4a28700 1 -- 172.21.15.6:0/767379538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5562af3d3de0 con 0x5562af656700 2023-09-13T09:43:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a5229700 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af655a00 0x5562af6554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f73a4a28700 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af666460 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f739c000c00 tx=0x7f739c00d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b28999160539f22 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f738bfff700 1 -- 172.21.15.6:0/767379538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c00fd40 con 0x5562af656700 2023-09-13T09:43:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f738bfff700 1 -- 172.21.15.6:0/767379538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f739c00f880 con 0x5562af656700 2023-09-13T09:43:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.074+0000 7f738bfff700 1 -- 172.21.15.6:0/767379538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c026b10 con 0x5562af656700 2023-09-13T09:43:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- 172.21.15.6:0/767379538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 msgr2=0x5562af666460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af666460 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f739c000c00 tx=0x7f739c00d880 comp rx=0 tx=0).stop 2023-09-13T09:43:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- 172.21.15.6:0/767379538 shutdown_connections 2023-09-13T09:43:29.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af657060 0x5562af65db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af655a00 0x5562af6554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 --2- 172.21.15.6:0/767379538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af656700 0x5562af666460 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- 172.21.15.6:0/767379538 >> 172.21.15.6:0/767379538 conn(0x5562af5b3c80 msgr2=0x5562af666d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- 172.21.15.6:0/767379538 shutdown_connections 2023-09-13T09:43:29.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- 172.21.15.6:0/767379538 wait complete. 2023-09-13T09:43:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- start start 2023-09-13T09:43:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 Processor -- start 2023-09-13T09:43:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af665bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af666130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af662690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af662bd0 con 0x5562af655a00 2023-09-13T09:43:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af662d40 con 0x5562af657060 2023-09-13T09:43:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562af662eb0 con 0x5562af656700 2023-09-13T09:43:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.075+0000 7f73b3672b80 10 client.0 _ll_register_callbacks cb 0x5562af543680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:29.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af665bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af665bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36356/0 (socket says 172.21.15.6:36356) 2023-09-13T09:43:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 -- 172.21.15.6:0/2697063039 learned_addr learned my addr 172.21.15.6:0/2697063039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a4a28700 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af666130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5a2a700 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af662690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 -- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 msgr2=0x5562af666130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af666130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 -- 172.21.15.6:0/2697063039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 msgr2=0x5562af662690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af662690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 -- 172.21.15.6:0/2697063039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562af5bf7a0 con 0x5562af655a00 2023-09-13T09:43:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73a5229700 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af665bf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7390096930 tx=0x7f7390096040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdb2477b9020f436 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f7388ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f7388ff9700 1 -- 172.21.15.6:0/2697063039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739009e020 con 0x5562af655a00 2023-09-13T09:43:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f7388ff9700 1 -- 172.21.15.6:0/2697063039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f73900a2410 con 0x5562af655a00 2023-09-13T09:43:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5562af648670 con 0x5562af655a00 2023-09-13T09:43:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f7388ff9700 1 -- 172.21.15.6:0/2697063039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73900987d0 con 0x5562af655a00 2023-09-13T09:43:29.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73b3672b80 10 client.16476 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.076+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5562af3bcc60 con 0x5562af655a00 2023-09-13T09:43:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f7388ff9700 1 -- 172.21.15.6:0/2697063039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f73900b8030 con 0x5562af655a00 2023-09-13T09:43:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f7388ff9700 1 -- 172.21.15.6:0/2697063039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f73900a1f80 con 0x5562af655a00 2023-09-13T09:43:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73b3672b80 10 client.16476 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:29.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73b3672b80 10 client.16476 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:43:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73b3672b80 20 client.16476 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af6bfc30 0x5562af6c2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73b3672b80 4 client.16476 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:43:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5562af3f4f70 con 0x5562af6bfc30 2023-09-13T09:43:29.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73a4a28700 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af6bfc30 0x5562af6c2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f7388ff9700 10 client.16476 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:43:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.077+0000 7f73a4a28700 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af6bfc30 0x5562af6c2050 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2eef7da01e83e3b1 server_cookie=10880766e31c2b62 in_seq=0 out_seq=0 2023-09-13T09:43:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f7388ff9700 1 -- 172.21.15.6:0/2697063039 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5562af3f4f70 con 0x5562af6bfc30 2023-09-13T09:43:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f7388ff9700 10 client.16476 handle_command_reply: tid=0 2023-09-13T09:43:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 client.16476 shutdown 2023-09-13T09:43:29.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 msgr2=0x5562af665bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af665bf0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f7390096930 tx=0x7f7390096040 comp rx=0 tx=0).stop 2023-09-13T09:43:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 shutdown_connections 2023-09-13T09:43:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5562af6bfc30 0x5562af6c2050 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5562af657060 0x5562af662690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f7388ff9700 0 client.16476 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:43:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5562af655a00 0x5562af665bf0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 --2- 172.21.15.6:0/2697063039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5562af656700 0x5562af666130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 >> 172.21.15.6:0/2697063039 conn(0x5562af5b3c80 msgr2=0x5562af65db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 shutdown_connections 2023-09-13T09:43:29.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 1 -- 172.21.15.6:0/2697063039 wait complete. 2023-09-13T09:43:29.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73b3672b80 20 client.16476 trim_cache size 0 max 16384 2023-09-13T09:43:29.107 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:43:29.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f738c0a0640 msgr2=0x7f738c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f738c0a0640 0x7f738c0a2b00 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f739c005950 tx=0x7f739c0058e0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 msgr2=0x7f73a0196b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a0196b00 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f73900036f0 tx=0x7f7390009580 comp rx=0 tx=0).stop 2023-09-13T09:43:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 shutdown_connections 2023-09-13T09:43:29.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73a0102950 0x7f73a019e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f738c0a0640 0x7f738c0a2b00 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a0100dc0 0x7f73a0196b00 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 --2- 172.21.15.6:0/3098387624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f73a0101fb0 0x7f73a0197040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.078+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 >> 172.21.15.6:0/3098387624 conn(0x7f73a00fc330 msgr2=0x7f73a00fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.079+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 shutdown_connections 2023-09-13T09:43:29.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.079+0000 7f73a748d700 1 -- 172.21.15.6:0/3098387624 wait complete. 2023-09-13T09:43:29.111 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:43:29.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 117812 2.73 MB/sec execute 49 sec latency 1965.516 ms 2023-09-13T09:43:29.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.239+0000 7fc4ef639700 1 -- 172.21.15.6:0/4294434339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e8101850 msgr2=0x7fc4e8108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.239+0000 7fc4ef639700 1 --2- 172.21.15.6:0/4294434339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e8101850 0x7fc4e8108100 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fc4e000b0d0 tx=0x7fc4e000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.239+0000 7fc4ef639700 1 -- 172.21.15.6:0/4294434339 shutdown_connections 2023-09-13T09:43:29.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.239+0000 7fc4ef639700 1 --2- 172.21.15.6:0/4294434339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e8101850 0x7fc4e8108100 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.239+0000 7fc4ef639700 1 --2- 172.21.15.6:0/4294434339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4e80ffcc0 0x7fc4e81000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.239+0000 7fc4ef639700 1 --2- 172.21.15.6:0/4294434339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4e8100eb0 0x7fc4e8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.239+0000 7fc4ef639700 1 -- 172.21.15.6:0/4294434339 >> 172.21.15.6:0/4294434339 conn(0x7fc4e80fb250 msgr2=0x7fc4e80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 -- 172.21.15.6:0/4294434339 shutdown_connections 2023-09-13T09:43:29.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 -- 172.21.15.6:0/4294434339 wait complete. 2023-09-13T09:43:29.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 Processor -- start 2023-09-13T09:43:29.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 -- start start 2023-09-13T09:43:29.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e80ffcc0 0x7fc4e8068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4e8100eb0 0x7fc4e819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4e8101850 0x7fc4e819de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e819e630 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e819e7a0 con 0x7fc4e8101850 2023-09-13T09:43:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ef639700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e819e960 con 0x7fc4e8100eb0 2023-09-13T09:43:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.240+0000 7fc4ed3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e80ffcc0 0x7fc4e8068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e80ffcc0 0x7fc4e8068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36370/0 (socket says 172.21.15.6:36370) 2023-09-13T09:43:29.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2787961383 learned_addr learned my addr 172.21.15.6:0/2787961383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4edbd6700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4e8101850 0x7fc4e819de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4e8100eb0 0x7fc4e819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2787961383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4e8100eb0 msgr2=0x7fc4e819b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4e8100eb0 0x7fc4e819b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2787961383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4e8101850 msgr2=0x7fc4e819de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4e8101850 0x7fc4e819de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2787961383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4e0009d00 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e80ffcc0 0x7fc4e8068b40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4007b90 tx=0x7fc4e4007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4de7fc700 1 -- 172.21.15.6:0/2787961383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e400e470 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e8195640 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4de7fc700 1 -- 172.21.15.6:0/2787961383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4e4004020 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4de7fc700 1 -- 172.21.15.6:0/2787961383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e4003bd0 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.241+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e8195b50 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.243+0000 7fc4de7fc700 1 -- 172.21.15.6:0/2787961383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc4e4004190 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.244+0000 7fc4de7fc700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4d40a0640 0x7fc4d40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.244+0000 7fc4de7fc700 1 -- 172.21.15.6:0/2787961383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc4e40d4340 con 0x7fc4e80ffcc0 2023-09-13T09:43:29.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.244+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4d40a0640 0x7fc4d40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.244+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4d40a0640 0x7fc4d40a2b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005ea0 tx=0x7fc4d8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 Processor -- start 2023-09-13T09:43:29.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 -- start start 2023-09-13T09:43:29.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e31700 0x55e513e31b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e32060 0x55e513e304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e30a00 0x55e513e30e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513d89780 con 0x55e513e32060 2023-09-13T09:43:29.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513d870a0 con 0x55e513e30a00 2023-09-13T09:43:29.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513d82990 con 0x55e513e31700 2023-09-13T09:43:29.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4ecbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e32060 0x55e513e304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4ecbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e32060 0x55e513e304c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36380/0 (socket says 172.21.15.6:36380) 2023-09-13T09:43:29.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/1987195119 learned_addr learned my addr 172.21.15.6:0/1987195119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e31700 0x55e513e31b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.245+0000 7fc4edbd6700 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e30a00 0x55e513e30e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/1987195119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e31700 msgr2=0x55e513e31b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e31700 0x55e513e31b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/1987195119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e30a00 msgr2=0x55e513e30e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e30a00 0x55e513e30e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/1987195119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e513c02630 con 0x55e513e32060 2023-09-13T09:43:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e32060 0x55e513e304c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800a520 tx=0x7fc4d800af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4302adac3da6830d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4d37fe700 1 -- 172.21.15.6:0/1987195119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d8010cd0 con 0x55e513e32060 2023-09-13T09:43:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4d37fe700 1 -- 172.21.15.6:0/1987195119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4d8010e30 con 0x55e513e32060 2023-09-13T09:43:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.246+0000 7fc4d37fe700 1 -- 172.21.15.6:0/1987195119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d800f790 con 0x55e513e32060 2023-09-13T09:43:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1987195119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e32060 msgr2=0x55e513e304c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e32060 0x55e513e304c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800a520 tx=0x7fc4d800af90 comp rx=0 tx=0).stop 2023-09-13T09:43:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1987195119 shutdown_connections 2023-09-13T09:43:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e30a00 0x55e513e30e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e31700 0x55e513e31b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1987195119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e32060 0x55e513e304c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1987195119 >> 172.21.15.6:0/1987195119 conn(0x55e513d8ec80 msgr2=0x55e513e2af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1987195119 shutdown_connections 2023-09-13T09:43:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1987195119 wait complete. 2023-09-13T09:43:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 -- start start 2023-09-13T09:43:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.247+0000 7fc4fb81eb80 1 Processor -- start 2023-09-13T09:43:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e39f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e3a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e41480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513d20bb0 con 0x55e513e30a00 2023-09-13T09:43:29.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513d208b0 con 0x55e513e31700 2023-09-13T09:43:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513c04920 con 0x55e513e32060 2023-09-13T09:43:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 10 client.0 _ll_register_callbacks cb 0x55e513d1e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e39f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e39f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36384/0 (socket says 172.21.15.6:36384) 2023-09-13T09:43:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/1241069216 learned_addr learned my addr 172.21.15.6:0/1241069216 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e3a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4edbd6700 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e41480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/1241069216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 msgr2=0x55e513e41480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e41480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 msgr2=0x55e513e3a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e3a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/1241069216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d800e9a0 con 0x55e513e30a00 2023-09-13T09:43:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e39f00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4010330 tx=0x7fc4e40a2180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713b8dac34b7b41c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/1241069216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e40a58b0 con 0x55e513e30a00 2023-09-13T09:43:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/1241069216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc4e40a9af0 con 0x55e513e30a00 2023-09-13T09:43:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e513e23670 con 0x55e513e30a00 2023-09-13T09:43:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/1241069216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4e409fe20 con 0x55e513e30a00 2023-09-13T09:43:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 10 client.16488 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.248+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e513d9a7a0 con 0x55e513e30a00 2023-09-13T09:43:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/1241069216 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4e4084020 con 0x55e513e30a00 2023-09-13T09:43:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/1241069216 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc4e4067d20 con 0x55e513e30a00 2023-09-13T09:43:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4fb81eb80 10 client.16488 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4fb81eb80 10 client.16488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4fb81eb80 20 client.16488 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e45d60 0x55e513e48180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4fb81eb80 4 client.16488 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e513d7b970 con 0x55e513e45d60 2023-09-13T09:43:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.249+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e45d60 0x55e513e48180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.250+0000 7fc4d0ff9700 10 client.16488 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.250+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e45d60 0x55e513e48180 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33fa4b111ac41e87 server_cookie=2d9e7dbbca283e70 in_seq=0 out_seq=0 2023-09-13T09:43:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.250+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/1241069216 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e513d7b970 con 0x55e513e45d60 2023-09-13T09:43:29.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.250+0000 7fc4d0ff9700 10 client.16488 handle_command_reply: tid=0 2023-09-13T09:43:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.250+0000 7fc4fb81eb80 1 client.16488 shutdown 2023-09-13T09:43:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.250+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 msgr2=0x55e513e39f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.250+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e39f00 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4010330 tx=0x7fc4e40a2180 comp rx=0 tx=0).stop 2023-09-13T09:43:29.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 shutdown_connections 2023-09-13T09:43:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e41480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e45d60 0x55e513e48180 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e39f00 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4d0ff9700 0 client.16488 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:29.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/1241069216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e3a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 >> 172.21.15.6:0/1241069216 conn(0x55e513d8ec80 msgr2=0x55e513e257f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 shutdown_connections 2023-09-13T09:43:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/1241069216 wait complete. 2023-09-13T09:43:29.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.251+0000 7fc4fb81eb80 20 client.16488 trim_cache size 0 max 16384 2023-09-13T09:43:29.277 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:28 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/902245191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:43:29.277 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:28 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/902245191' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:43:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 Processor -- start 2023-09-13T09:43:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 -- start start 2023-09-13T09:43:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e41440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e39cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513e38640 con 0x55e513e30a00 2023-09-13T09:43:29.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513e39aa0 con 0x55e513e31700 2023-09-13T09:43:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513e2c780 con 0x55e513e32060 2023-09-13T09:43:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e304c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36392/0 (socket says 172.21.15.6:36392) 2023-09-13T09:43:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2718637141 learned_addr learned my addr 172.21.15.6:0/2718637141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4edbd6700 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e39cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2718637141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 msgr2=0x55e513e39cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e41440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e39cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2718637141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 msgr2=0x55e513e41440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e41440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ed3d5700 1 -- 172.21.15.6:0/2718637141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e513baede0 con 0x55e513e30a00 2023-09-13T09:43:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4edbd6700 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e39cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:29.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.264+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e41440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e304c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40a1780 tx=0x7fc4e40a1c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66518d0c4ec19aaa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4d3fff700 1 -- 172.21.15.6:0/2718637141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e409d870 con 0x55e513e30a00 2023-09-13T09:43:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4d3fff700 1 -- 172.21.15.6:0/2718637141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4e4084070 con 0x55e513e30a00 2023-09-13T09:43:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4d3fff700 1 -- 172.21.15.6:0/2718637141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4e409da80 con 0x55e513e30a00 2023-09-13T09:43:29.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/2718637141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 msgr2=0x55e513e304c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e304c0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fc4e40a1780 tx=0x7fc4e40a1c00 comp rx=0 tx=0).stop 2023-09-13T09:43:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/2718637141 shutdown_connections 2023-09-13T09:43:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e32060 0x55e513e39cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e30a00 0x55e513e304c0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/2718637141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e31700 0x55e513e41440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/2718637141 >> 172.21.15.6:0/2718637141 conn(0x55e513d8ec80 msgr2=0x55e513e348e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/2718637141 shutdown_connections 2023-09-13T09:43:29.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.265+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/2718637141 wait complete. 2023-09-13T09:43:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 -- start start 2023-09-13T09:43:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 Processor -- start 2023-09-13T09:43:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e30a00 0x55e513e3d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e31700 0x55e513e3dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e32060 0x55e513e40cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513e411f0 con 0x55e513e31700 2023-09-13T09:43:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513e41360 con 0x55e513e32060 2023-09-13T09:43:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e513e41520 con 0x55e513e30a00 2023-09-13T09:43:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4fb81eb80 10 client.0 _ll_register_callbacks cb 0x55e513d1e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e31700 0x55e513e3dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e31700 0x55e513e3dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36400/0 (socket says 172.21.15.6:36400) 2023-09-13T09:43:29.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/3269778253 learned_addr learned my addr 172.21.15.6:0/3269778253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:29.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4edbd6700 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e32060 0x55e513e40cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e30a00 0x55e513e3d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/3269778253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e30a00 msgr2=0x55e513e3d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e30a00 0x55e513e3d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e32060 msgr2=0x55e513e40cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:29.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e32060 0x55e513e40cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.266+0000 7fc4ecbd4700 1 -- 172.21.15.6:0/3269778253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e513d9a7a0 con 0x55e513e31700 2023-09-13T09:43:29.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4ecbd4700 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e31700 0x55e513e3dc90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800a520 tx=0x7fc4d800e7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4545830c982894c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:29.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:29.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/3269778253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4d80315b0 con 0x55e513e31700 2023-09-13T09:43:29.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/3269778253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc4d8031910 con 0x55e513e31700 2023-09-13T09:43:29.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4d8010e30 con 0x55e513e31700 2023-09-13T09:43:29.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/3269778253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4d8031ad0 con 0x55e513e31700 2023-09-13T09:43:29.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 10 client.16494 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:29.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e513b97c60 con 0x55e513e31700 2023-09-13T09:43:29.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/3269778253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4d8010e30 con 0x55e513e31700 2023-09-13T09:43:29.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/3269778253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fc4d801d450 con 0x55e513e31700 2023-09-13T09:43:29.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 10 client.16494 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:29.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:29.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 20 client.16494 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:29.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e9ae90 0x55e513e9d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:29.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 4 client.16494 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:43:29.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.267+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e513d3c050 con 0x55e513e9ae90 2023-09-13T09:43:29.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e9ae90 0x55e513e9d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:29.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4d0ff9700 10 client.16494 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:29.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4ed3d5700 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e9ae90 0x55e513e9d2b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d893cbd1bc08cf59 server_cookie=c66e5b4bd4a120c in_seq=0 out_seq=0 2023-09-13T09:43:29.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4d0ff9700 1 -- 172.21.15.6:0/3269778253 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e513d3c050 con 0x55e513e9ae90 2023-09-13T09:43:29.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4d0ff9700 10 client.16494 handle_command_reply: tid=0 2023-09-13T09:43:29.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 client.16494 shutdown 2023-09-13T09:43:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e31700 msgr2=0x55e513e3dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e31700 0x55e513e3dc90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fc4d800a520 tx=0x7fc4d800e7f0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 shutdown_connections 2023-09-13T09:43:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e513e32060 0x55e513e40cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e513e30a00 0x55e513e3d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e513e9ae90 0x55e513e9d2b0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 --2- 172.21.15.6:0/3269778253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e513e31700 0x55e513e3dc90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4d0ff9700 0 client.16494 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:29.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 >> 172.21.15.6:0/3269778253 conn(0x55e513d8ec80 msgr2=0x55e513e39cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.268+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 shutdown_connections 2023-09-13T09:43:29.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4fb81eb80 1 -- 172.21.15.6:0/3269778253 wait complete. 2023-09-13T09:43:29.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4fb81eb80 20 client.16494 trim_cache size 0 max 16384 2023-09-13T09:43:29.301 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:43:29.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4d40a0640 msgr2=0x7fc4d40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4d40a0640 0x7fc4d40a2b00 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8005ea0 tx=0x7fc4d8005e30 comp rx=0 tx=0).stop 2023-09-13T09:43:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e80ffcc0 msgr2=0x7fc4e8068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e80ffcc0 0x7fc4e8068b40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc4e4007b90 tx=0x7fc4e4007ea0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 shutdown_connections 2023-09-13T09:43:29.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc4e8101850 0x7fc4e819de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4d40a0640 0x7fc4d40a2b00 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e80ffcc0 0x7fc4e8068b40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 --2- 172.21.15.6:0/2787961383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4e8100eb0 0x7fc4e819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 >> 172.21.15.6:0/2787961383 conn(0x7fc4e80fb250 msgr2=0x7fc4e81042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:29.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 shutdown_connections 2023-09-13T09:43:29.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:29.269+0000 7fc4ef639700 1 -- 172.21.15.6:0/2787961383 wait complete. 2023-09-13T09:43:30.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 117812 2.67 MB/sec execute 50 sec latency 2965.550 ms 2023-09-13T09:43:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:29 smithi006 ceph-mon[98665]: pgmap v419: 97 pgs: 97 active+clean; 65 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 843 KiB/s wr, 94 op/s 2023-09-13T09:43:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:29 smithi053 ceph-mon[102373]: pgmap v419: 97 pgs: 97 active+clean; 65 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 843 KiB/s wr, 94 op/s 2023-09-13T09:43:30.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:29 smithi131 ceph-mon[102785]: pgmap v419: 97 pgs: 97 active+clean; 65 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 250 KiB/s rd, 843 KiB/s wr, 94 op/s 2023-09-13T09:43:30.306 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:43:30.307 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:43:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 -- 172.21.15.6:0/3520879845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d38102ab0 msgr2=0x7f4d38109360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/3520879845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d38102ab0 0x7f4d38109360 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000b0a0 tx=0x7f4d3000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 -- 172.21.15.6:0/3520879845 shutdown_connections 2023-09-13T09:43:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/3520879845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d38102ab0 0x7f4d38109360 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/3520879845 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d380ff0a0 0x7f4d380ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/3520879845 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d38102110 0x7f4d38102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 -- 172.21.15.6:0/3520879845 >> 172.21.15.6:0/3520879845 conn(0x7f4d380fa9b0 msgr2=0x7f4d380fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 -- 172.21.15.6:0/3520879845 shutdown_connections 2023-09-13T09:43:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.449+0000 7f4d3ff75700 1 -- 172.21.15.6:0/3520879845 wait complete. 2023-09-13T09:43:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 Processor -- start 2023-09-13T09:43:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 -- start start 2023-09-13T09:43:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d380ff0a0 0x7f4d38196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d38102110 0x7f4d381970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d38102ab0 0x7f4d3819e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3819e700 con 0x7f4d380ff0a0 2023-09-13T09:43:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3819e840 con 0x7f4d38102ab0 2023-09-13T09:43:30.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3ff75700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3819e9d0 con 0x7f4d38102110 2023-09-13T09:43:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3dd11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d380ff0a0 0x7f4d38196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3dd11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d380ff0a0 0x7f4d38196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36412/0 (socket says 172.21.15.6:36412) 2023-09-13T09:43:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1436242144 learned_addr learned my addr 172.21.15.6:0/1436242144 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3e512700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d38102ab0 0x7f4d3819e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.450+0000 7f4d3d510700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d38102110 0x7f4d381970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1436242144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d38102110 msgr2=0x7f4d381970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d38102110 0x7f4d381970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1436242144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d38102ab0 msgr2=0x7f4d3819e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d38102ab0 0x7f4d3819e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1436242144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30009d00 con 0x7f4d380ff0a0 2023-09-13T09:43:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d380ff0a0 0x7f4d38196b80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00d980 tx=0x7f4d2c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d2affd700 1 -- 172.21.15.6:0/1436242144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c004020 con 0x7f4d380ff0a0 2023-09-13T09:43:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d2affd700 1 -- 172.21.15.6:0/1436242144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d2c00f690 con 0x7f4d380ff0a0 2023-09-13T09:43:30.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d3819ecb0 con 0x7f4d380ff0a0 2023-09-13T09:43:30.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d2affd700 1 -- 172.21.15.6:0/1436242144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c003a60 con 0x7f4d380ff0a0 2023-09-13T09:43:30.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.451+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d3819f1c0 con 0x7f4d380ff0a0 2023-09-13T09:43:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.453+0000 7f4d2affd700 1 -- 172.21.15.6:0/1436242144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4d2c00fb00 con 0x7f4d380ff0a0 2023-09-13T09:43:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.454+0000 7f4d2affd700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d240a0640 0x7f4d240a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.454+0000 7f4d3d510700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d240a0640 0x7f4d240a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.454+0000 7f4d2affd700 1 -- 172.21.15.6:0/1436242144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d2c0cb7e0 con 0x7f4d380ff0a0 2023-09-13T09:43:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.454+0000 7f4d3d510700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d240a0640 0x7f4d240a2b00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4d34005950 tx=0x7f4d3400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.454+0000 7f4d4c15ab80 1 Processor -- start 2023-09-13T09:43:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d4c15ab80 1 -- start start 2023-09-13T09:43:30.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b39ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b38540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b38f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862a91800 con 0x562862b38a80 2023-09-13T09:43:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862a8f120 con 0x562862b3a0e0 2023-09-13T09:43:30.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862a8aa10 con 0x562862b39780 2023-09-13T09:43:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3e512700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b38f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3e512700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b38f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36424/0 (socket says 172.21.15.6:36424) 2023-09-13T09:43:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3e512700 1 -- 172.21.15.6:0/3984488987 learned_addr learned my addr 172.21.15.6:0/3984488987 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3d510700 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b38540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b39ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3e512700 1 -- 172.21.15.6:0/3984488987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 msgr2=0x562862b39ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3e512700 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b39ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3e512700 1 -- 172.21.15.6:0/3984488987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 msgr2=0x562862b38540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.455+0000 7f4d3e512700 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b38540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.456+0000 7f4d3e512700 1 -- 172.21.15.6:0/3984488987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56286290a6b0 con 0x562862b38a80 2023-09-13T09:43:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.456+0000 7f4d3e512700 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b38f00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4d300074e0 tx=0x7f4d30007510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9459a522c199e95 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.456+0000 7f4d23fff700 1 -- 172.21.15.6:0/3984488987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000e040 con 0x562862b38a80 2023-09-13T09:43:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.456+0000 7f4d23fff700 1 -- 172.21.15.6:0/3984488987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d300060c0 con 0x562862b38a80 2023-09-13T09:43:30.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.456+0000 7f4d23fff700 1 -- 172.21.15.6:0/3984488987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3001c940 con 0x562862b38a80 2023-09-13T09:43:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3984488987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 msgr2=0x562862b38f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b38f00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f4d300074e0 tx=0x7f4d30007510 comp rx=0 tx=0).stop 2023-09-13T09:43:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3984488987 shutdown_connections 2023-09-13T09:43:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b38f00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b39ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3984488987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b38540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3984488987 >> 172.21.15.6:0/3984488987 conn(0x562862a96d00 msgr2=0x562862b32f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3984488987 shutdown_connections 2023-09-13T09:43:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3984488987 wait complete. 2023-09-13T09:43:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 -- start start 2023-09-13T09:43:30.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.457+0000 7f4d4c15ab80 1 Processor -- start 2023-09-13T09:43:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b41f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b42470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862a28c30 con 0x562862b38a80 2023-09-13T09:43:30.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862a28930 con 0x562862b3a0e0 2023-09-13T09:43:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56286290c9a0 con 0x562862b39780 2023-09-13T09:43:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d4c15ab80 10 client.0 _ll_register_callbacks cb 0x562862a26700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b41f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b41f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36426/0 (socket says 172.21.15.6:36426) 2023-09-13T09:43:30.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1058791087 learned_addr learned my addr 172.21.15.6:0/1058791087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3d510700 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b42470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3e512700 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1058791087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 msgr2=0x562862b42470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b42470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 msgr2=0x562862b494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 -- 172.21.15.6:0/1058791087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d38109b50 con 0x562862b38a80 2023-09-13T09:43:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b41f30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0c9230 tx=0x7f4d2c0996f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4968baeacfed592e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.458+0000 7f4d217fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d217fa700 1 -- 172.21.15.6:0/1058791087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0a0f90 con 0x562862b38a80 2023-09-13T09:43:30.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d217fa700 1 -- 172.21.15.6:0/1058791087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d2c099180 con 0x562862b38a80 2023-09-13T09:43:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562862b2b6f0 con 0x562862b38a80 2023-09-13T09:43:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d217fa700 1 -- 172.21.15.6:0/1058791087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d2c099340 con 0x562862b38a80 2023-09-13T09:43:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 10 client.16506 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x562862aa2820 con 0x562862b38a80 2023-09-13T09:43:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d217fa700 1 -- 172.21.15.6:0/1058791087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562862b2b6f0 con 0x562862b38a80 2023-09-13T09:43:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d217fa700 1 -- 172.21.15.6:0/1058791087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4d2c062050 con 0x562862b38a80 2023-09-13T09:43:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 10 client.16506 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 20 client.16506 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:30.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862b4de10 0x562862b50230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 4 client.16506 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.459+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562862a839f0 con 0x562862b4de10 2023-09-13T09:43:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.460+0000 7f4d3d510700 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862b4de10 0x562862b50230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.460+0000 7f4d3d510700 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862b4de10 0x562862b50230 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfab1a6195f8ea30 server_cookie=43504a8e0b5d82b1 in_seq=0 out_seq=0 2023-09-13T09:43:30.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.460+0000 7f4d217fa700 10 client.16506 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d217fa700 1 -- 172.21.15.6:0/1058791087 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562862a839f0 con 0x562862b4de10 2023-09-13T09:43:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d217fa700 10 client.16506 handle_command_reply: tid=0 2023-09-13T09:43:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 client.16506 shutdown 2023-09-13T09:43:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 msgr2=0x562862b41f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b41f30 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c0c9230 tx=0x7f4d2c0996f0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 shutdown_connections 2023-09-13T09:43:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862b4de10 0x562862b50230 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b41f30 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d217fa700 0 client.16506 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/1058791087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b42470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 >> 172.21.15.6:0/1058791087 conn(0x562862a96d00 msgr2=0x562862b32f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 shutdown_connections 2023-09-13T09:43:30.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/1058791087 wait complete. 2023-09-13T09:43:30.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.461+0000 7f4d4c15ab80 20 client.16506 trim_cache size 0 max 16384 2023-09-13T09:43:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 Processor -- start 2023-09-13T09:43:30.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 -- start start 2023-09-13T09:43:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b38a80 0x562862b38540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b49470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b3a0e0 0x562862b423f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862b3fbc0 con 0x562862b3a0e0 2023-09-13T09:43:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862b3d4d0 con 0x562862b38a80 2023-09-13T09:43:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862b34370 con 0x562862b39780 2023-09-13T09:43:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d3e512700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b3a0e0 0x562862b423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d3e512700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b3a0e0 0x562862b423f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36438/0 (socket says 172.21.15.6:36438) 2023-09-13T09:43:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.478+0000 7f4d3e512700 1 -- 172.21.15.6:0/2401328913 learned_addr learned my addr 172.21.15.6:0/2401328913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3d510700 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b49470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b38a80 0x562862b38540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3e512700 1 -- 172.21.15.6:0/2401328913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 msgr2=0x562862b49470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3e512700 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b49470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3e512700 1 -- 172.21.15.6:0/2401328913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b38a80 msgr2=0x562862b38540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3e512700 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b38a80 0x562862b38540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3e512700 1 -- 172.21.15.6:0/2401328913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628628b6e60 con 0x562862b3a0e0 2023-09-13T09:43:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d3e512700 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b3a0e0 0x562862b423f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000b3f0 tx=0x7f4d3001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=526ee2e7122b26ed server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d28ff9700 1 -- 172.21.15.6:0/2401328913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3000e040 con 0x562862b3a0e0 2023-09-13T09:43:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d28ff9700 1 -- 172.21.15.6:0/2401328913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d30007870 con 0x562862b3a0e0 2023-09-13T09:43:30.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.479+0000 7f4d28ff9700 1 -- 172.21.15.6:0/2401328913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3001cc50 con 0x562862b3a0e0 2023-09-13T09:43:30.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/2401328913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b3a0e0 msgr2=0x562862b423f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b3a0e0 0x562862b423f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f4d3000b3f0 tx=0x7f4d3001c440 comp rx=0 tx=0).stop 2023-09-13T09:43:30.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/2401328913 shutdown_connections 2023-09-13T09:43:30.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b3a0e0 0x562862b423f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b38a80 0x562862b38540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/2401328913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b49470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/2401328913 >> 172.21.15.6:0/2401328913 conn(0x562862a96d00 msgr2=0x562862b41ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/2401328913 shutdown_connections 2023-09-13T09:43:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/2401328913 wait complete. 2023-09-13T09:43:30.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 -- start start 2023-09-13T09:43:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.480+0000 7f4d4c15ab80 1 Processor -- start 2023-09-13T09:43:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b46670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b46bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b47bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862b48100 con 0x562862b38a80 2023-09-13T09:43:30.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862b48270 con 0x562862b3a0e0 2023-09-13T09:43:30.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562862b48430 con 0x562862b39780 2023-09-13T09:43:30.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b46670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 10 client.0 _ll_register_callbacks cb 0x562862a26700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:30.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b46670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36440/0 (socket says 172.21.15.6:36440) 2023-09-13T09:43:30.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 -- 172.21.15.6:0/3204911626 learned_addr learned my addr 172.21.15.6:0/3204911626 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3d510700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b46bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 -- 172.21.15.6:0/3204911626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 msgr2=0x562862b46bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b46bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 -- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 msgr2=0x562862b47bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3e512700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b47bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b47bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 -- 172.21.15.6:0/3204911626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56286290a6b0 con 0x562862b38a80 2023-09-13T09:43:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3e512700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b47bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:43:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d3dd11700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b46670 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c098eb0 tx=0x7f4d2c0987c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989d450517c9ea88 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d217fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:43:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d217fa700 1 -- 172.21.15.6:0/3204911626 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d2c0a0f90 con 0x562862b38a80 2023-09-13T09:43:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d217fa700 1 -- 172.21.15.6:0/3204911626 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d2c077e40 con 0x562862b38a80 2023-09-13T09:43:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d300060c0 con 0x562862b38a80 2023-09-13T09:43:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.481+0000 7f4d217fa700 1 -- 172.21.15.6:0/3204911626 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d2c003bc0 con 0x562862b38a80 2023-09-13T09:43:30.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 10 client.16512 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x56286289fce0 con 0x562862b38a80 2023-09-13T09:43:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d217fa700 1 -- 172.21.15.6:0/3204911626 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d2c07c080 con 0x562862b38a80 2023-09-13T09:43:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d217fa700 1 -- 172.21.15.6:0/3204911626 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f4d2c062060 con 0x562862b38a80 2023-09-13T09:43:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 10 client.16512 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:30.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 20 client.16512 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862ba3e20 0x562862ba6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 4 client.16512 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:43:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562862a440d0 con 0x562862ba3e20 2023-09-13T09:43:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.482+0000 7f4d3d510700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862ba3e20 0x562862ba6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.483+0000 7f4d217fa700 10 client.16512 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.483+0000 7f4d3d510700 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862ba3e20 0x562862ba6210 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=695cda40f8880e1c server_cookie=c0f4c3a686e2180b in_seq=0 out_seq=0 2023-09-13T09:43:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.484+0000 7f4d217fa700 1 -- 172.21.15.6:0/3204911626 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562862a440d0 con 0x562862ba3e20 2023-09-13T09:43:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.484+0000 7f4d217fa700 10 client.16512 handle_command_reply: tid=0 2023-09-13T09:43:30.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.484+0000 7f4d4c15ab80 1 client.16512 shutdown 2023-09-13T09:43:30.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.484+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 msgr2=0x562862b46670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.484+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b46670 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c098eb0 tx=0x7f4d2c0987c0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 shutdown_connections 2023-09-13T09:43:30.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562862b3a0e0 0x562862b47bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562862ba3e20 0x562862ba6210 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562862b38a80 0x562862b46670 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 --2- 172.21.15.6:0/3204911626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562862b39780 0x562862b46bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 >> 172.21.15.6:0/3204911626 conn(0x562862a96d00 msgr2=0x562862b37530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d217fa700 0 client.16512 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 shutdown_connections 2023-09-13T09:43:30.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 1 -- 172.21.15.6:0/3204911626 wait complete. 2023-09-13T09:43:30.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d4c15ab80 20 client.16512 trim_cache size 0 max 16384 2023-09-13T09:43:30.507 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:43:30.508 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:43:30.508 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "72948d9e-16a1-4240-9d7c-5c8362c86704", 2023-09-13T09:43:30.508 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:43:30.508 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:43:30.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d240a0640 msgr2=0x7f4d240a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d240a0640 0x7f4d240a2b00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4d34005950 tx=0x7f4d3400b410 comp rx=0 tx=0).stop 2023-09-13T09:43:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d380ff0a0 msgr2=0x7f4d38196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d380ff0a0 0x7f4d38196b80 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f4d2c00d980 tx=0x7f4d2c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:43:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 shutdown_connections 2023-09-13T09:43:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d38102ab0 0x7f4d3819e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d240a0640 0x7f4d240a2b00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d380ff0a0 0x7f4d38196b80 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 --2- 172.21.15.6:0/1436242144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d38102110 0x7f4d381970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 >> 172.21.15.6:0/1436242144 conn(0x7f4d380fa9b0 msgr2=0x7f4d380fcbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 shutdown_connections 2023-09-13T09:43:30.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.485+0000 7f4d3ff75700 1 -- 172.21.15.6:0/1436242144 wait complete. 2023-09-13T09:43:30.512 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:43:30.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 -- 172.21.15.6:0/3665800746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa200100eb0 msgr2=0x7fa200101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 --2- 172.21.15.6:0/3665800746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa200100eb0 0x7fa200101310 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0099c0 tx=0x7fa1ec009cd0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 -- 172.21.15.6:0/3665800746 shutdown_connections 2023-09-13T09:43:30.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 --2- 172.21.15.6:0/3665800746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa200101850 0x7fa200108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 --2- 172.21.15.6:0/3665800746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2000ffcc0 0x7fa2001000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 --2- 172.21.15.6:0/3665800746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa200100eb0 0x7fa200101310 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 -- 172.21.15.6:0/3665800746 >> 172.21.15.6:0/3665800746 conn(0x7fa2000fb250 msgr2=0x7fa2000fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 -- 172.21.15.6:0/3665800746 shutdown_connections 2023-09-13T09:43:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.640+0000 7fa206bb9700 1 -- 172.21.15.6:0/3665800746 wait complete. 2023-09-13T09:43:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 Processor -- start 2023-09-13T09:43:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 -- start start 2023-09-13T09:43:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2000ffcc0 0x7fa200196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa200100eb0 0x7fa200196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200101850 0x7fa20019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019e5b0 con 0x7fa2000ffcc0 2023-09-13T09:43:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019e6f0 con 0x7fa200101850 2023-09-13T09:43:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa206bb9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa20019e880 con 0x7fa200100eb0 2023-09-13T09:43:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa204955700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2000ffcc0 0x7fa200196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa204955700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2000ffcc0 0x7fa200196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36454/0 (socket says 172.21.15.6:36454) 2023-09-13T09:43:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa204955700 1 -- 172.21.15.6:0/1900597394 learned_addr learned my addr 172.21.15.6:0/1900597394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa1fffff700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa200100eb0 0x7fa200196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.641+0000 7fa205156700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200101850 0x7fa20019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa204955700 1 -- 172.21.15.6:0/1900597394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa200100eb0 msgr2=0x7fa200196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa204955700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa200100eb0 0x7fa200196f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa204955700 1 -- 172.21.15.6:0/1900597394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200101850 msgr2=0x7fa20019dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa204955700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200101850 0x7fa20019dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa204955700 1 -- 172.21.15.6:0/1900597394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f4009520 con 0x7fa2000ffcc0 2023-09-13T09:43:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa204955700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2000ffcc0 0x7fa200196a30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400ea50 tx=0x7fa1f400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa1fdffb700 1 -- 172.21.15.6:0/1900597394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f400cbd0 con 0x7fa2000ffcc0 2023-09-13T09:43:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa1fdffb700 1 -- 172.21.15.6:0/1900597394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f400cd30 con 0x7fa2000ffcc0 2023-09-13T09:43:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1ec0095f0 con 0x7fa2000ffcc0 2023-09-13T09:43:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa1fdffb700 1 -- 172.21.15.6:0/1900597394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4018680 con 0x7fa2000ffcc0 2023-09-13T09:43:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.642+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa20019eee0 con 0x7fa2000ffcc0 2023-09-13T09:43:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.644+0000 7fa1fdffb700 1 -- 172.21.15.6:0/1900597394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa1f4010430 con 0x7fa2000ffcc0 2023-09-13T09:43:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.645+0000 7fa1fdffb700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa1f00a0640 0x7fa1f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.645+0000 7fa1fdffb700 1 -- 172.21.15.6:0/1900597394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa1f4014070 con 0x7fa2000ffcc0 2023-09-13T09:43:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.645+0000 7fa1fffff700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa1f00a0640 0x7fa1f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.645+0000 7fa1fffff700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa1f00a0640 0x7fa1f00a2b00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b580 tx=0x7fa1ec005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 Processor -- start 2023-09-13T09:43:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 -- start start 2023-09-13T09:43:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5848df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5848c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c5848d270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c583e1780 con 0x556c5848e470 2023-09-13T09:43:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c583df0a0 con 0x556c5848db10 2023-09-13T09:43:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c583da990 con 0x556c5848ce10 2023-09-13T09:43:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5848c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5848c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36464/0 (socket says 172.21.15.6:36464) 2023-09-13T09:43:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 -- 172.21.15.6:0/38508118 learned_addr learned my addr 172.21.15.6:0/38508118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa205156700 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c5848d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa204955700 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5848df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 -- 172.21.15.6:0/38508118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 msgr2=0x556c5848d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c5848d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 -- 172.21.15.6:0/38508118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 msgr2=0x556c5848df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5848df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 -- 172.21.15.6:0/38508118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c5825a630 con 0x556c5848e470 2023-09-13T09:43:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.646+0000 7fa1fffff700 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5848c8d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec015000 tx=0x7fa1ec01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9eaf1bad7a0117c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa1eaffd700 1 -- 172.21.15.6:0/38508118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec029070 con 0x556c5848e470 2023-09-13T09:43:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa1eaffd700 1 -- 172.21.15.6:0/38508118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1ec01e040 con 0x556c5848e470 2023-09-13T09:43:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa1eaffd700 1 -- 172.21.15.6:0/38508118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00f750 con 0x556c5848e470 2023-09-13T09:43:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 -- 172.21.15.6:0/38508118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 msgr2=0x556c5848c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5848c8d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec015000 tx=0x7fa1ec01f000 comp rx=0 tx=0).stop 2023-09-13T09:43:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 -- 172.21.15.6:0/38508118 shutdown_connections 2023-09-13T09:43:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c5848d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5848df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/38508118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5848c8d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 -- 172.21.15.6:0/38508118 >> 172.21.15.6:0/38508118 conn(0x556c583e6c80 msgr2=0x556c58482f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 -- 172.21.15.6:0/38508118 shutdown_connections 2023-09-13T09:43:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.647+0000 7fa212d9eb80 1 -- 172.21.15.6:0/38508118 wait complete. 2023-09-13T09:43:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 -- start start 2023-09-13T09:43:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 Processor -- start 2023-09-13T09:43:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848ce10 0x556c58496210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c58496750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848e470 0x556c5849d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c58378bb0 con 0x556c5848ce10 2023-09-13T09:43:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c583788b0 con 0x556c5848db10 2023-09-13T09:43:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5825c920 con 0x556c5848e470 2023-09-13T09:43:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa212d9eb80 10 client.0 _ll_register_callbacks cb 0x556c58376680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa204955700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848ce10 0x556c58496210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa204955700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848ce10 0x556c58496210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36468/0 (socket says 172.21.15.6:36468) 2023-09-13T09:43:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa204955700 1 -- 172.21.15.6:0/805053884 learned_addr learned my addr 172.21.15.6:0/805053884 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa1fffff700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c58496750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.648+0000 7fa205156700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848e470 0x556c5849d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1fffff700 1 -- 172.21.15.6:0/805053884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848e470 msgr2=0x556c5849d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1fffff700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848e470 0x556c5849d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1fffff700 1 -- 172.21.15.6:0/805053884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848ce10 msgr2=0x556c58496210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1fffff700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848ce10 0x556c58496210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1fffff700 1 -- 172.21.15.6:0/805053884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa200108a50 con 0x556c5848db10 2023-09-13T09:43:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa204955700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848ce10 0x556c58496210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:43:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1fffff700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c58496750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b8e0 tx=0x7fa1ec00fcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c115e05d82260a13 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1dffff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:43:30.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1dffff700 1 -- 172.21.15.6:0/805053884 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec029040 con 0x556c5848db10 2023-09-13T09:43:30.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1dffff700 1 -- 172.21.15.6:0/805053884 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa1ec005480 con 0x556c5848db10 2023-09-13T09:43:30.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556c5847b670 con 0x556c5848db10 2023-09-13T09:43:30.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa1dffff700 1 -- 172.21.15.6:0/805053884 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1ec0039e0 con 0x556c5848db10 2023-09-13T09:43:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa212d9eb80 10 client.25988 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.649+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556c583f27a0 con 0x556c5848db10 2023-09-13T09:43:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa1dffff700 1 -- 172.21.15.6:0/805053884 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556c5847b670 con 0x556c5848db10 2023-09-13T09:43:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa1dffff700 1 -- 172.21.15.6:0/805053884 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa1ec041940 con 0x556c5848db10 2023-09-13T09:43:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa212d9eb80 10 client.25988 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa212d9eb80 10 client.25988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa212d9eb80 20 client.25988 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584a1ac0 0x556c584a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa212d9eb80 4 client.25988 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:43:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556c583d3970 con 0x556c584a1ac0 2023-09-13T09:43:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa204955700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584a1ac0 0x556c584a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa1dffff700 10 client.25988 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.650+0000 7fa204955700 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584a1ac0 0x556c584a3ee0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a63100839d70282c server_cookie=dccb6fd8ed0dd2b2 in_seq=0 out_seq=0 2023-09-13T09:43:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa1dffff700 1 -- 172.21.15.6:0/805053884 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556c583d3970 con 0x556c584a1ac0 2023-09-13T09:43:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa1dffff700 10 client.25988 handle_command_reply: tid=0 2023-09-13T09:43:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 client.25988 shutdown 2023-09-13T09:43:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 msgr2=0x556c58496750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c58496750 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b8e0 tx=0x7fa1ec00fcd0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 shutdown_connections 2023-09-13T09:43:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848e470 0x556c5849d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584a1ac0 0x556c584a3ee0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848ce10 0x556c58496210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa1dffff700 0 client.25988 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/805053884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c58496750 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 >> 172.21.15.6:0/805053884 conn(0x556c583e6c80 msgr2=0x556c5847d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 shutdown_connections 2023-09-13T09:43:30.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.651+0000 7fa212d9eb80 1 -- 172.21.15.6:0/805053884 wait complete. 2023-09-13T09:43:30.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.652+0000 7fa212d9eb80 20 client.25988 trim_cache size 0 max 16384 2023-09-13T09:43:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.668+0000 7fa212d9eb80 1 Processor -- start 2023-09-13T09:43:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.668+0000 7fa212d9eb80 1 -- start start 2023-09-13T09:43:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.668+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c58482e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5849d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5847b400 con 0x556c5848e470 2023-09-13T09:43:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c58484730 con 0x556c5848db10 2023-09-13T09:43:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5847b5d0 con 0x556c5848ce10 2023-09-13T09:43:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36480/0 (socket says 172.21.15.6:36480) 2023-09-13T09:43:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 -- 172.21.15.6:0/1869493978 learned_addr learned my addr 172.21.15.6:0/1869493978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa204955700 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c58482e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa1fffff700 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5849d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 -- 172.21.15.6:0/1869493978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 msgr2=0x556c58482e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c58482e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 -- 172.21.15.6:0/1869493978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 msgr2=0x556c5849d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5849d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 -- 172.21.15.6:0/1869493978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c58206de0 con 0x556c5848e470 2023-09-13T09:43:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa205156700 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849e080 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80157f0 tx=0x7fa1f8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2c2c62e97ee090 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa1eb7fe700 1 -- 172.21.15.6:0/1869493978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f800e040 con 0x556c5848e470 2023-09-13T09:43:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa1eb7fe700 1 -- 172.21.15.6:0/1869493978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1f800f040 con 0x556c5848e470 2023-09-13T09:43:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.669+0000 7fa1eb7fe700 1 -- 172.21.15.6:0/1869493978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1f8004430 con 0x556c5848e470 2023-09-13T09:43:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 -- 172.21.15.6:0/1869493978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 msgr2=0x556c5849e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849e080 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa1f80157f0 tx=0x7fa1f8009920 comp rx=0 tx=0).stop 2023-09-13T09:43:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 -- 172.21.15.6:0/1869493978 shutdown_connections 2023-09-13T09:43:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849e080 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848ce10 0x556c58482e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/1869493978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848db10 0x556c5849d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 -- 172.21.15.6:0/1869493978 >> 172.21.15.6:0/1869493978 conn(0x556c583e6c80 msgr2=0x556c5848d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 -- 172.21.15.6:0/1869493978 shutdown_connections 2023-09-13T09:43:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 -- 172.21.15.6:0/1869493978 wait complete. 2023-09-13T09:43:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 -- start start 2023-09-13T09:43:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.670+0000 7fa212d9eb80 1 Processor -- start 2023-09-13T09:43:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848ce10 0x556c58499290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848db10 0x556c584997d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa212d9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5849cd30 con 0x556c5848e470 2023-09-13T09:43:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5849cea0 con 0x556c5848ce10 2023-09-13T09:43:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa212d9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c5849d060 con 0x556c5848db10 2023-09-13T09:43:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa212d9eb80 10 client.0 _ll_register_callbacks cb 0x556c58376680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:43:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa205156700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1fffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848db10 0x556c584997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa204955700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848ce10 0x556c58499290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa205156700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36486/0 (socket says 172.21.15.6:36486) 2023-09-13T09:43:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa205156700 1 -- 172.21.15.6:0/165686348 learned_addr learned my addr 172.21.15.6:0/165686348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:43:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1fffff700 1 -- 172.21.15.6:0/165686348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848ce10 msgr2=0x556c58499290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1fffff700 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848ce10 0x556c58499290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1fffff700 1 -- 172.21.15.6:0/165686348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 msgr2=0x556c5849c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:43:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1fffff700 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1fffff700 1 -- 172.21.15.6:0/165686348 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f80154a0 con 0x556c5848db10 2023-09-13T09:43:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa205156700 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:43:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1fffff700 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848db10 0x556c584997d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec041cd0 tx=0x7fa1ec00b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf3b2c4daec9dbf5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:43:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.671+0000 7fa1dffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:43:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa1dffff700 1 -- 172.21.15.6:0/165686348 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec029040 con 0x556c5848db10 2023-09-13T09:43:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa1dffff700 1 -- 172.21.15.6:0/165686348 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa1ec005940 con 0x556c5848db10 2023-09-13T09:43:30.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa1ec01e040 con 0x556c5848db10 2023-09-13T09:43:30.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa1dffff700 1 -- 172.21.15.6:0/165686348 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1ec00f860 con 0x556c5848db10 2023-09-13T09:43:30.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 10 client.25948 fetch_fsmap learned FSMap version 31 2023-09-13T09:43:30.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x556c581efc60 con 0x556c5848db10 2023-09-13T09:43:30.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa1dffff700 1 -- 172.21.15.6:0/165686348 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa1ec01e040 con 0x556c5848db10 2023-09-13T09:43:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa1dffff700 1 -- 172.21.15.6:0/165686348 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 31) v1 ==== 7902+0+0 (secure 0 0 0) 0x7fa1ec022850 con 0x556c5848db10 2023-09-13T09:43:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 10 client.25948 fetch_fsmap finished waiting for FSMap version 31 2023-09-13T09:43:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 10 client.25948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:43:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 20 client.25948 populate_metadata read hostname 'smithi006' 2023-09-13T09:43:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584f6290 0x556c584f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:43:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 4 client.25948 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:43:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556c58394050 con 0x556c584f6290 2023-09-13T09:43:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.672+0000 7fa204955700 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584f6290 0x556c584f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:43:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa1dffff700 10 client.25948 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa204955700 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584f6290 0x556c584f86b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=346f2eb50d0ad867 server_cookie=2366569599e42f53 in_seq=0 out_seq=0 2023-09-13T09:43:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa1dffff700 1 -- 172.21.15.6:0/165686348 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556c58394050 con 0x556c584f6290 2023-09-13T09:43:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa1dffff700 10 client.25948 handle_command_reply: tid=0 2023-09-13T09:43:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 client.25948 shutdown 2023-09-13T09:43:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848db10 msgr2=0x556c584997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848db10 0x556c584997d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec041cd0 tx=0x7fa1ec00b840 comp rx=0 tx=0).stop 2023-09-13T09:43:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 shutdown_connections 2023-09-13T09:43:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556c584f6290 0x556c584f86b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556c5848e470 0x556c5849c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa1dffff700 0 client.25948 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:43:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556c5848ce10 0x556c58499290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 --2- 172.21.15.6:0/165686348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556c5848db10 0x556c584997d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 >> 172.21.15.6:0/165686348 conn(0x556c583e6c80 msgr2=0x556c58482e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 shutdown_connections 2023-09-13T09:43:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 1 -- 172.21.15.6:0/165686348 wait complete. 2023-09-13T09:43:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.673+0000 7fa212d9eb80 20 client.25948 trim_cache size 0 max 16384 2023-09-13T09:43:30.698 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:43:30.698 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:43:30.698 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:43:30.699 INFO:teuthology.orchestra.run.smithi006.stdout: "72948d9e-16a1-4240-9d7c-5c8362c86704": { 2023-09-13T09:43:30.699 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:43:30.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "72948d9e-16a1-4240-9d7c-5c8362c86704", 2023-09-13T09:43:30.699 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:43:30.699 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:43:30.700 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:43:30.700 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:43:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa1f00a0640 msgr2=0x7fa1f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa1f00a0640 0x7fa1f00a2b00 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b580 tx=0x7fa1ec005fb0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2000ffcc0 msgr2=0x7fa200196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:43:30.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2000ffcc0 0x7fa200196a30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa1f400ea50 tx=0x7fa1f400ed60 comp rx=0 tx=0).stop 2023-09-13T09:43:30.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 shutdown_connections 2023-09-13T09:43:30.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa200101850 0x7fa20019dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa1f00a0640 0x7fa1f00a2b00 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2000ffcc0 0x7fa200196a30 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 --2- 172.21.15.6:0/1900597394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa200100eb0 0x7fa200196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:43:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 >> 172.21.15.6:0/1900597394 conn(0x7fa2000fb250 msgr2=0x7fa200067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:43:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 shutdown_connections 2023-09-13T09:43:30.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:43:30.674+0000 7fa206bb9700 1 -- 172.21.15.6:0/1900597394 wait complete. 2023-09-13T09:43:30.704 INFO:tasks.cephfs.filesystem:scrub status for tag:72948d9e-16a1-4240-9d7c-5c8362c86704 - {'path': '/', 'tag': '72948d9e-16a1-4240-9d7c-5c8362c86704', 'options': 'recursive,force'} 2023-09-13T09:43:31.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:30 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:31.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:30 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:31.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 119437 2.75 MB/sec execute 51 sec latency 3343.973 ms 2023-09-13T09:43:31.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:30 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:31.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:30 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:31.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:30 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:31.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:30 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 120974 2.93 MB/sec execute 52 sec latency 12.315 ms 2023-09-13T09:43:32.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: pgmap v420: 97 pgs: 97 active+clean; 65 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 940 KiB/s wr, 81 op/s 2023-09-13T09:43:32.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:43:32.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:32.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:32.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:32.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:32.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:32.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:32.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:43:32.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:31 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:32.263 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: pgmap v420: 97 pgs: 97 active+clean; 65 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 940 KiB/s wr, 81 op/s 2023-09-13T09:43:32.264 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:43:32.264 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.264 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:32.264 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:32.265 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:32.265 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:32.265 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.265 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.265 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.266 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:32.266 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:32.266 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.266 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:43:32.267 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.267 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.267 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.267 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:31 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: pgmap v420: 97 pgs: 97 active+clean; 65 MiB data, 720 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 940 KiB/s wr, 81 op/s 2023-09-13T09:43:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:43:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:32.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:32.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:32.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:32.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:32.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:32.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:43:32.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:43:32.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:31 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:33.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 122409 2.98 MB/sec execute 53 sec latency 12.856 ms 2023-09-13T09:43:34.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124418 3.17 MB/sec execute 54 sec latency 13.351 ms 2023-09-13T09:43:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:33 smithi053 ceph-mon[102373]: pgmap v421: 97 pgs: 97 active+clean; 66 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 1.0 MiB/s wr, 102 op/s 2023-09-13T09:43:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:33 smithi006 ceph-mon[98665]: pgmap v421: 97 pgs: 97 active+clean; 66 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 1.0 MiB/s wr, 102 op/s 2023-09-13T09:43:34.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:33 smithi131 ceph-mon[102785]: pgmap v421: 97 pgs: 97 active+clean; 66 MiB data, 703 MiB used, 1.0 TiB / 1.0 TiB avail; 280 KiB/s rd, 1.0 MiB/s wr, 102 op/s 2023-09-13T09:43:35.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124849 3.12 MB/sec execute 55 sec latency 295.883 ms 2023-09-13T09:43:36.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124849 3.07 MB/sec execute 56 sec latency 1295.965 ms 2023-09-13T09:43:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:35 smithi006 ceph-mon[98665]: pgmap v422: 97 pgs: 97 active+clean; 66 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 1000 KiB/s wr, 103 op/s 2023-09-13T09:43:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:35 smithi053 ceph-mon[102373]: pgmap v422: 97 pgs: 97 active+clean; 66 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 1000 KiB/s wr, 103 op/s 2023-09-13T09:43:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:35 smithi131 ceph-mon[102785]: pgmap v422: 97 pgs: 97 active+clean; 66 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 1000 KiB/s wr, 103 op/s 2023-09-13T09:43:37.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124864 3.02 MB/sec execute 57 sec latency 2284.001 ms 2023-09-13T09:43:38.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124905 2.96 MB/sec execute 58 sec latency 965.894 ms 2023-09-13T09:43:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:37 smithi053 ceph-mon[102373]: pgmap v423: 97 pgs: 97 active+clean; 66 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2023-09-13T09:43:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:37 smithi006 ceph-mon[98665]: pgmap v423: 97 pgs: 97 active+clean; 66 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2023-09-13T09:43:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:37 smithi131 ceph-mon[102785]: pgmap v423: 97 pgs: 97 active+clean; 66 MiB data, 734 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 1.1 MiB/s wr, 124 op/s 2023-09-13T09:43:39.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124905 2.91 MB/sec execute 59 sec latency 1966.017 ms 2023-09-13T09:43:40.157 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124905 2.87 MB/sec execute 60 sec latency 2966.135 ms 2023-09-13T09:43:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:39 smithi006 ceph-mon[98665]: pgmap v424: 97 pgs: 97 active+clean; 67 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-09-13T09:43:40.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:39 smithi053 ceph-mon[102373]: pgmap v424: 97 pgs: 97 active+clean; 67 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-09-13T09:43:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:39 smithi131 ceph-mon[102785]: pgmap v424: 97 pgs: 97 active+clean; 67 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.0 MiB/s wr, 121 op/s 2023-09-13T09:43:41.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124905 2.82 MB/sec execute 61 sec latency 3966.255 ms 2023-09-13T09:43:41.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:40 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:41.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:40 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:41.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:40 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:42.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 124927 2.77 MB/sec execute 62 sec latency 4948.685 ms 2023-09-13T09:43:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:41 smithi053 ceph-mon[102373]: pgmap v425: 97 pgs: 97 active+clean; 67 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1009 KiB/s wr, 107 op/s 2023-09-13T09:43:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:41 smithi006 ceph-mon[98665]: pgmap v425: 97 pgs: 97 active+clean; 67 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1009 KiB/s wr, 107 op/s 2023-09-13T09:43:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:41 smithi131 ceph-mon[102785]: pgmap v425: 97 pgs: 97 active+clean; 67 MiB data, 742 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 1009 KiB/s wr, 107 op/s 2023-09-13T09:43:43.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 127202 2.92 MB/sec execute 63 sec latency 12.853 ms 2023-09-13T09:43:44.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128393 2.98 MB/sec execute 64 sec latency 12.437 ms 2023-09-13T09:43:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:43 smithi006 ceph-mon[98665]: pgmap v426: 97 pgs: 97 active+clean; 66 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 864 KiB/s wr, 113 op/s 2023-09-13T09:43:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:43 smithi053 ceph-mon[102373]: pgmap v426: 97 pgs: 97 active+clean; 66 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 864 KiB/s wr, 113 op/s 2023-09-13T09:43:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:43 smithi131 ceph-mon[102785]: pgmap v426: 97 pgs: 97 active+clean; 66 MiB data, 755 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 864 KiB/s wr, 113 op/s 2023-09-13T09:43:45.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128393 2.94 MB/sec execute 65 sec latency 1007.493 ms 2023-09-13T09:43:45.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:45.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:45.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:45.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:45.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:45.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:46.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128393 2.89 MB/sec execute 66 sec latency 2007.562 ms 2023-09-13T09:43:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:43:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:45 smithi006 ceph-mon[98665]: pgmap v427: 97 pgs: 97 active+clean; 66 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 661 KiB/s wr, 98 op/s 2023-09-13T09:43:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:45 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:45 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:43:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:45 smithi053 ceph-mon[102373]: pgmap v427: 97 pgs: 97 active+clean; 66 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 661 KiB/s wr, 98 op/s 2023-09-13T09:43:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:45 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:45 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:43:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:45 smithi131 ceph-mon[102785]: pgmap v427: 97 pgs: 97 active+clean; 66 MiB data, 754 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 661 KiB/s wr, 98 op/s 2023-09-13T09:43:47.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128394 2.85 MB/sec execute 67 sec latency 3004.225 ms 2023-09-13T09:43:48.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128449 2.81 MB/sec execute 68 sec latency 959.941 ms 2023-09-13T09:43:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:47 smithi006 ceph-mon[98665]: pgmap v428: 97 pgs: 97 active+clean; 68 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 771 KiB/s wr, 110 op/s 2023-09-13T09:43:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:47 smithi053 ceph-mon[102373]: pgmap v428: 97 pgs: 97 active+clean; 68 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 771 KiB/s wr, 110 op/s 2023-09-13T09:43:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:47 smithi131 ceph-mon[102785]: pgmap v428: 97 pgs: 97 active+clean; 68 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 771 KiB/s wr, 110 op/s 2023-09-13T09:43:49.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128449 2.77 MB/sec execute 69 sec latency 1960.018 ms 2023-09-13T09:43:50.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128449 2.73 MB/sec execute 70 sec latency 2960.130 ms 2023-09-13T09:43:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:49 smithi006 ceph-mon[98665]: pgmap v429: 97 pgs: 97 active+clean; 68 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 522 KiB/s wr, 82 op/s 2023-09-13T09:43:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:49 smithi053 ceph-mon[102373]: pgmap v429: 97 pgs: 97 active+clean; 68 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 522 KiB/s wr, 82 op/s 2023-09-13T09:43:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:49 smithi131 ceph-mon[102785]: pgmap v429: 97 pgs: 97 active+clean; 68 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 522 KiB/s wr, 82 op/s 2023-09-13T09:43:51.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128449 2.69 MB/sec execute 71 sec latency 3960.250 ms 2023-09-13T09:43:52.158 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128471 2.66 MB/sec execute 72 sec latency 4943.271 ms 2023-09-13T09:43:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:51 smithi006 ceph-mon[98665]: pgmap v430: 97 pgs: 97 active+clean; 68 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 532 KiB/s wr, 71 op/s 2023-09-13T09:43:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:51 smithi053 ceph-mon[102373]: pgmap v430: 97 pgs: 97 active+clean; 68 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 532 KiB/s wr, 71 op/s 2023-09-13T09:43:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:51 smithi131 ceph-mon[102785]: pgmap v430: 97 pgs: 97 active+clean; 68 MiB data, 779 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 532 KiB/s wr, 71 op/s 2023-09-13T09:43:53.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128518 2.62 MB/sec execute 73 sec latency 967.917 ms 2023-09-13T09:43:54.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128518 2.58 MB/sec execute 74 sec latency 1968.031 ms 2023-09-13T09:43:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:53 smithi006 ceph-mon[98665]: pgmap v431: 97 pgs: 97 active+clean; 67 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 474 KiB/s wr, 76 op/s 2023-09-13T09:43:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:53 smithi053 ceph-mon[102373]: pgmap v431: 97 pgs: 97 active+clean; 67 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 474 KiB/s wr, 76 op/s 2023-09-13T09:43:54.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:53 smithi131 ceph-mon[102785]: pgmap v431: 97 pgs: 97 active+clean; 67 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 243 KiB/s rd, 474 KiB/s wr, 76 op/s 2023-09-13T09:43:55.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128518 2.55 MB/sec execute 75 sec latency 2968.081 ms 2023-09-13T09:43:56.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128518 2.52 MB/sec execute 76 sec latency 3968.173 ms 2023-09-13T09:43:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:55 smithi006 ceph-mon[98665]: pgmap v432: 97 pgs: 97 active+clean; 67 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 460 KiB/s wr, 69 op/s 2023-09-13T09:43:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:55 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:55 smithi053 ceph-mon[102373]: pgmap v432: 97 pgs: 97 active+clean; 67 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 460 KiB/s wr, 69 op/s 2023-09-13T09:43:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:55 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:55 smithi131 ceph-mon[102785]: pgmap v432: 97 pgs: 97 active+clean; 67 MiB data, 774 MiB used, 1.0 TiB / 1.0 TiB avail; 227 KiB/s rd, 460 KiB/s wr, 69 op/s 2023-09-13T09:43:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:55 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:43:57.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 128540 2.48 MB/sec execute 77 sec latency 4952.051 ms 2023-09-13T09:43:58.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 130935 2.62 MB/sec execute 78 sec latency 11.207 ms 2023-09-13T09:43:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:57 smithi006 ceph-mon[98665]: pgmap v433: 97 pgs: 97 active+clean; 68 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 490 KiB/s wr, 65 op/s 2023-09-13T09:43:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:57 smithi053 ceph-mon[102373]: pgmap v433: 97 pgs: 97 active+clean; 68 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 490 KiB/s wr, 65 op/s 2023-09-13T09:43:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:57 smithi131 ceph-mon[102785]: pgmap v433: 97 pgs: 97 active+clean; 68 MiB data, 775 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 490 KiB/s wr, 65 op/s 2023-09-13T09:43:59.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 131943 2.66 MB/sec execute 79 sec latency 56.470 ms 2023-09-13T09:44:00.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 131943 2.63 MB/sec execute 80 sec latency 1056.592 ms 2023-09-13T09:44:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:43:59 smithi006 ceph-mon[98665]: pgmap v434: 97 pgs: 97 active+clean; 68 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 342 KiB/s wr, 41 op/s 2023-09-13T09:44:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:43:59 smithi053 ceph-mon[102373]: pgmap v434: 97 pgs: 97 active+clean; 68 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 342 KiB/s wr, 41 op/s 2023-09-13T09:44:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:43:59 smithi131 ceph-mon[102785]: pgmap v434: 97 pgs: 97 active+clean; 68 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 342 KiB/s wr, 41 op/s 2023-09-13T09:44:00.705 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:44:00.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 -- 172.21.15.6:0/3367691417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6941013c0 msgr2=0x7fd6941017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 --2- 172.21.15.6:0/3367691417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6941013c0 0x7fd6941017e0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fd684009990 tx=0x7fd684009ca0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 -- 172.21.15.6:0/3367691417 shutdown_connections 2023-09-13T09:44:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 --2- 172.21.15.6:0/3367691417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd694100290 0x7fd694108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 --2- 172.21.15.6:0/3367691417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6941013c0 0x7fd6941017e0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 --2- 172.21.15.6:0/3367691417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6940ff8f0 0x7fd6940ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 -- 172.21.15.6:0/3367691417 >> 172.21.15.6:0/3367691417 conn(0x7fd6940fb250 msgr2=0x7fd6940fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 -- 172.21.15.6:0/3367691417 shutdown_connections 2023-09-13T09:44:00.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.846+0000 7fd69a170700 1 -- 172.21.15.6:0/3367691417 wait complete. 2023-09-13T09:44:00.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 Processor -- start 2023-09-13T09:44:00.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 -- start start 2023-09-13T09:44:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6940ff8f0 0x7fd6940698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd694100290 0x7fd69419b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6941013c0 0x7fd69419df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69419e6f0 con 0x7fd694100290 2023-09-13T09:44:00.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69419e860 con 0x7fd6941013c0 2023-09-13T09:44:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd69a170700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69419ea20 con 0x7fd6940ff8f0 2023-09-13T09:44:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd692ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd694100290 0x7fd69419b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd692ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd694100290 0x7fd69419b910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36496/0 (socket says 172.21.15.6:36496) 2023-09-13T09:44:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd692ffd700 1 -- 172.21.15.6:0/1325552524 learned_addr learned my addr 172.21.15.6:0/1325552524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.847+0000 7fd6937fe700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6940ff8f0 0x7fd6940698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd693fff700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6941013c0 0x7fd69419df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd692ffd700 1 -- 172.21.15.6:0/1325552524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6940ff8f0 msgr2=0x7fd6940698e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd692ffd700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6940ff8f0 0x7fd6940698e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd692ffd700 1 -- 172.21.15.6:0/1325552524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6941013c0 msgr2=0x7fd69419df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd692ffd700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6941013c0 0x7fd69419df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd692ffd700 1 -- 172.21.15.6:0/1325552524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840095f0 con 0x7fd694100290 2023-09-13T09:44:00.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd692ffd700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd694100290 0x7fd69419b910 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d950 tx=0x7fd68800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:00.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd690ff9700 1 -- 172.21.15.6:0/1325552524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688009940 con 0x7fd694100290 2023-09-13T09:44:00.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69419ed00 con 0x7fd694100290 2023-09-13T09:44:00.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd690ff9700 1 -- 172.21.15.6:0/1325552524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd688010460 con 0x7fd694100290 2023-09-13T09:44:00.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd690ff9700 1 -- 172.21.15.6:0/1325552524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68800f620 con 0x7fd694100290 2023-09-13T09:44:00.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.848+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69419f200 con 0x7fd694100290 2023-09-13T09:44:00.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.850+0000 7fd690ff9700 1 -- 172.21.15.6:0/1325552524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd6880108d0 con 0x7fd694100290 2023-09-13T09:44:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.851+0000 7fd690ff9700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd67c0a0640 0x7fd67c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.851+0000 7fd6937fe700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd67c0a0640 0x7fd67c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.851+0000 7fd690ff9700 1 -- 172.21.15.6:0/1325552524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6880cba40 con 0x7fd694100290 2023-09-13T09:44:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.852+0000 7fd6937fe700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd67c0a0640 0x7fd67c0a2b00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd68400b5c0 tx=0x7fd684005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:00.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.852+0000 7fd6a6355b80 1 Processor -- start 2023-09-13T09:44:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.852+0000 7fd6a6355b80 1 -- start start 2023-09-13T09:44:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.852+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc1ffab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.852+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffb060 0x559dc1ff94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.852+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ff9a00 0x559dc1ff9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.852+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1f52780 con 0x559dc1ff9a00 2023-09-13T09:44:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1f500a0 con 0x559dc1ffa700 2023-09-13T09:44:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1f4b990 con 0x559dc1ffb060 2023-09-13T09:44:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ff9a00 0x559dc1ff9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ff9a00 0x559dc1ff9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36506/0 (socket says 172.21.15.6:36506) 2023-09-13T09:44:00.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 -- 172.21.15.6:0/402057549 learned_addr learned my addr 172.21.15.6:0/402057549 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:00.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd6937fe700 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc1ffab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd692ffd700 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffb060 0x559dc1ff94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 -- 172.21.15.6:0/402057549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffb060 msgr2=0x559dc1ff94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffb060 0x559dc1ff94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 -- 172.21.15.6:0/402057549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 msgr2=0x559dc1ffab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc1ffab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 -- 172.21.15.6:0/402057549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dc1dcb630 con 0x559dc1ff9a00 2023-09-13T09:44:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd6937fe700 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc1ffab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd693fff700 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ff9a00 0x559dc1ff9e80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009dc0 tx=0x7fd68c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc6763015d8f3161 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:00.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd679ffb700 1 -- 172.21.15.6:0/402057549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c014610 con 0x559dc1ff9a00 2023-09-13T09:44:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd679ffb700 1 -- 172.21.15.6:0/402057549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd68c00f050 con 0x559dc1ff9a00 2023-09-13T09:44:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.853+0000 7fd679ffb700 1 -- 172.21.15.6:0/402057549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c013910 con 0x559dc1ff9a00 2023-09-13T09:44:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 -- 172.21.15.6:0/402057549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ff9a00 msgr2=0x559dc1ff9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ff9a00 0x559dc1ff9e80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009dc0 tx=0x7fd68c0077e0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 -- 172.21.15.6:0/402057549 shutdown_connections 2023-09-13T09:44:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ff9a00 0x559dc1ff9e80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc1ffab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/402057549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffb060 0x559dc1ff94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 -- 172.21.15.6:0/402057549 >> 172.21.15.6:0/402057549 conn(0x559dc1f57c80 msgr2=0x559dc1ff3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 -- 172.21.15.6:0/402057549 shutdown_connections 2023-09-13T09:44:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.854+0000 7fd6a6355b80 1 -- 172.21.15.6:0/402057549 wait complete. 2023-09-13T09:44:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 -- start start 2023-09-13T09:44:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 Processor -- start 2023-09-13T09:44:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc2002f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffa700 0x559dc2003440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffb060 0x559dc200a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1ee9bb0 con 0x559dc1ffa700 2023-09-13T09:44:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1ee98b0 con 0x559dc1ffb060 2023-09-13T09:44:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1dcd920 con 0x559dc1ff9a00 2023-09-13T09:44:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6a6355b80 10 client.0 _ll_register_callbacks cb 0x559dc1ee7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd692ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffa700 0x559dc2003440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd692ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffa700 0x559dc2003440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36510/0 (socket says 172.21.15.6:36510) 2023-09-13T09:44:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd692ffd700 1 -- 172.21.15.6:0/589733050 learned_addr learned my addr 172.21.15.6:0/589733050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd6937fe700 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc2002f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.855+0000 7fd693fff700 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffb060 0x559dc200a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.856+0000 7fd692ffd700 1 -- 172.21.15.6:0/589733050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 msgr2=0x559dc2002f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.856+0000 7fd692ffd700 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc2002f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.856+0000 7fd692ffd700 1 -- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffb060 msgr2=0x559dc200a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.856+0000 7fd692ffd700 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffb060 0x559dc200a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.856+0000 7fd692ffd700 1 -- 172.21.15.6:0/589733050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c009a20 con 0x559dc1ffa700 2023-09-13T09:44:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.856+0000 7fd692ffd700 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffa700 0x559dc2003440 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c94f0 tx=0x7fd6880999b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1996a8fd7e340fd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.856+0000 7fd672ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.857+0000 7fd672ffd700 1 -- 172.21.15.6:0/589733050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68809d010 con 0x559dc1ffa700 2023-09-13T09:44:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.857+0000 7fd672ffd700 1 -- 172.21.15.6:0/589733050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6880a1250 con 0x559dc1ffa700 2023-09-13T09:44:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.857+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559dc1fec670 con 0x559dc1ffa700 2023-09-13T09:44:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.857+0000 7fd672ffd700 1 -- 172.21.15.6:0/589733050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd688099440 con 0x559dc1ffa700 2023-09-13T09:44:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.857+0000 7fd6a6355b80 10 client.16542 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.857+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559dc1f637a0 con 0x559dc1ffa700 2023-09-13T09:44:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd672ffd700 1 -- 172.21.15.6:0/589733050 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6880b7030 con 0x559dc1ffa700 2023-09-13T09:44:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd672ffd700 1 -- 172.21.15.6:0/589733050 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd6880a0dc0 con 0x559dc1ffa700 2023-09-13T09:44:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6a6355b80 10 client.16542 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6a6355b80 10 client.16542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6a6355b80 20 client.16542 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc200ed90 0x559dc20111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6a6355b80 4 client.16542 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559dc1f44970 con 0x559dc200ed90 2023-09-13T09:44:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6937fe700 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc200ed90 0x559dc20111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd672ffd700 10 client.16542 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.858+0000 7fd6937fe700 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc200ed90 0x559dc20111b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=791e42ebfeffe0b3 server_cookie=7441909da7f62585 in_seq=0 out_seq=0 2023-09-13T09:44:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd672ffd700 1 -- 172.21.15.6:0/589733050 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559dc1f44970 con 0x559dc200ed90 2023-09-13T09:44:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd672ffd700 10 client.16542 handle_command_reply: tid=0 2023-09-13T09:44:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 client.16542 shutdown 2023-09-13T09:44:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffa700 msgr2=0x559dc2003440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffa700 0x559dc2003440 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fd6880c94f0 tx=0x7fd6880999b0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 shutdown_connections 2023-09-13T09:44:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffb060 0x559dc200a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc2002f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc200ed90 0x559dc20111b0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/589733050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffa700 0x559dc2003440 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd672ffd700 0 client.16542 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.859+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 >> 172.21.15.6:0/589733050 conn(0x559dc1f57c80 msgr2=0x559dc1ff3ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.860+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 shutdown_connections 2023-09-13T09:44:00.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.860+0000 7fd6a6355b80 1 -- 172.21.15.6:0/589733050 wait complete. 2023-09-13T09:44:00.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.860+0000 7fd6a6355b80 20 client.16542 trim_cache size 0 max 16384 2023-09-13T09:44:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 Processor -- start 2023-09-13T09:44:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 -- start start 2023-09-13T09:44:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc1ff94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc200a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc1ffd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1ff08e0 con 0x559dc1ffb060 2023-09-13T09:44:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc1fec490 con 0x559dc1ffa700 2023-09-13T09:44:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc2000b30 con 0x559dc1ff9a00 2023-09-13T09:44:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc1ffd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc1ffd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36520/0 (socket says 172.21.15.6:36520) 2023-09-13T09:44:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 -- 172.21.15.6:0/3695127245 learned_addr learned my addr 172.21.15.6:0/3695127245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd6937fe700 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc1ff94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd692ffd700 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc200a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 -- 172.21.15.6:0/3695127245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 msgr2=0x559dc1ff94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc1ff94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 -- 172.21.15.6:0/3695127245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 msgr2=0x559dc200a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc200a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd693fff700 1 -- 172.21.15.6:0/3695127245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dc1d77de0 con 0x559dc1ffb060 2023-09-13T09:44:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.877+0000 7fd692ffd700 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc200a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:00.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd693fff700 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc1ffd8e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009d10 tx=0x7fd68c0060b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0ea66b276690f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd67a7fc700 1 -- 172.21.15.6:0/3695127245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c022070 con 0x559dc1ffb060 2023-09-13T09:44:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd67a7fc700 1 -- 172.21.15.6:0/3695127245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd68c014410 con 0x559dc1ffb060 2023-09-13T09:44:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd67a7fc700 1 -- 172.21.15.6:0/3695127245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c005280 con 0x559dc1ffb060 2023-09-13T09:44:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3695127245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 msgr2=0x559dc1ffd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc1ffd8e0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009d10 tx=0x7fd68c0060b0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3695127245 shutdown_connections 2023-09-13T09:44:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc1ffd8e0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ff9a00 0x559dc1ff94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3695127245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ffa700 0x559dc200a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3695127245 >> 172.21.15.6:0/3695127245 conn(0x559dc1f57c80 msgr2=0x559dc1ff3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3695127245 shutdown_connections 2023-09-13T09:44:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.878+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3695127245 wait complete. 2023-09-13T09:44:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 -- start start 2023-09-13T09:44:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 Processor -- start 2023-09-13T09:44:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ff9a00 0x559dc200a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffa700 0x559dc2006f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc20075c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc2062bb0 con 0x559dc1ffb060 2023-09-13T09:44:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc2062cf0 con 0x559dc1ff9a00 2023-09-13T09:44:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dc2062e80 con 0x559dc1ffa700 2023-09-13T09:44:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6a6355b80 10 client.0 _ll_register_callbacks cb 0x559dc1ee7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd693fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc20075c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd693fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc20075c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36526/0 (socket says 172.21.15.6:36526) 2023-09-13T09:44:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd693fff700 1 -- 172.21.15.6:0/3146123480 learned_addr learned my addr 172.21.15.6:0/3146123480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd6937fe700 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ff9a00 0x559dc200a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.879+0000 7fd692ffd700 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffa700 0x559dc2006f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd693fff700 1 -- 172.21.15.6:0/3146123480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffa700 msgr2=0x559dc2006f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd693fff700 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffa700 0x559dc2006f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd693fff700 1 -- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ff9a00 msgr2=0x559dc200a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd693fff700 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ff9a00 0x559dc200a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd693fff700 1 -- 172.21.15.6:0/3146123480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559dc1dcb630 con 0x559dc1ffb060 2023-09-13T09:44:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd693fff700 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc20075c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009550 tx=0x7fd68c0147b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef56186d3d669e24 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd672ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd672ffd700 1 -- 172.21.15.6:0/3146123480 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd68c022070 con 0x559dc1ffb060 2023-09-13T09:44:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd672ffd700 1 -- 172.21.15.6:0/3146123480 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd68c005250 con 0x559dc1ffb060 2023-09-13T09:44:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd68c00f050 con 0x559dc1ffb060 2023-09-13T09:44:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd672ffd700 1 -- 172.21.15.6:0/3146123480 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd68c014a50 con 0x559dc1ffb060 2023-09-13T09:44:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 10 client.16548 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559dc1d60c60 con 0x559dc1ffb060 2023-09-13T09:44:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd672ffd700 1 -- 172.21.15.6:0/3146123480 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd68c00f050 con 0x559dc1ffb060 2023-09-13T09:44:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd672ffd700 1 -- 172.21.15.6:0/3146123480 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd68c02d070 con 0x559dc1ffb060 2023-09-13T09:44:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 10 client.16548 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 10 client.16548 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 20 client.16548 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc2064390 0x559dc20667b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 4 client.16548 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:44:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.880+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559dc1f05050 con 0x559dc2064390 2023-09-13T09:44:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd6937fe700 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc2064390 0x559dc20667b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd672ffd700 10 client.16548 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd6937fe700 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc2064390 0x559dc20667b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66bf7e653109e9d5 server_cookie=12f716d1ec1a63cf in_seq=0 out_seq=0 2023-09-13T09:44:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd672ffd700 1 -- 172.21.15.6:0/3146123480 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559dc1f05050 con 0x559dc2064390 2023-09-13T09:44:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd672ffd700 10 client.16548 handle_command_reply: tid=0 2023-09-13T09:44:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd6a6355b80 1 client.16548 shutdown 2023-09-13T09:44:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 msgr2=0x559dc20075c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc20075c0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fd68c009550 tx=0x7fd68c0147b0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 shutdown_connections 2023-09-13T09:44:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.881+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559dc2064390 0x559dc20667b0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559dc1ffb060 0x559dc20075c0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559dc1ff9a00 0x559dc200a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd672ffd700 0 client.16548 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd6a6355b80 1 --2- 172.21.15.6:0/3146123480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559dc1ffa700 0x559dc2006f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 >> 172.21.15.6:0/3146123480 conn(0x559dc1f57c80 msgr2=0x559dc1ffd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 shutdown_connections 2023-09-13T09:44:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd6a6355b80 1 -- 172.21.15.6:0/3146123480 wait complete. 2023-09-13T09:44:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd6a6355b80 20 client.16548 trim_cache size 0 max 16384 2023-09-13T09:44:00.905 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:44:00.905 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:44:00.905 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:44:00.905 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:44:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd67c0a0640 msgr2=0x7fd67c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd67c0a0640 0x7fd67c0a2b00 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd68400b5c0 tx=0x7fd684005fd0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd694100290 msgr2=0x7fd69419b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd694100290 0x7fd69419b910 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd68800d950 tx=0x7fd68800dc60 comp rx=0 tx=0).stop 2023-09-13T09:44:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 shutdown_connections 2023-09-13T09:44:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd6941013c0 0x7fd69419df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6940ff8f0 0x7fd6940698e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd67c0a0640 0x7fd67c0a2b00 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 --2- 172.21.15.6:0/1325552524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd694100290 0x7fd69419b910 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 >> 172.21.15.6:0/1325552524 conn(0x7fd6940fb250 msgr2=0x7fd6940fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 shutdown_connections 2023-09-13T09:44:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:00.882+0000 7fd69a170700 1 -- 172.21.15.6:0/1325552524 wait complete. 2023-09-13T09:44:00.909 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:44:00.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:44:01.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 -- 172.21.15.6:0/4214177302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 msgr2=0x7f5144101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 --2- 172.21.15.6:0/4214177302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f5144101310 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f51380099c0 tx=0x7f5138009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 -- 172.21.15.6:0/4214177302 shutdown_connections 2023-09-13T09:44:01.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 --2- 172.21.15.6:0/4214177302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5144101850 0x7f5144108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 --2- 172.21.15.6:0/4214177302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51440ffcc0 0x7f51441000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 --2- 172.21.15.6:0/4214177302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f5144101310 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 -- 172.21.15.6:0/4214177302 >> 172.21.15.6:0/4214177302 conn(0x7f51440fb250 msgr2=0x7f51440fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 -- 172.21.15.6:0/4214177302 shutdown_connections 2023-09-13T09:44:01.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.037+0000 7f514bee1700 1 -- 172.21.15.6:0/4214177302 wait complete. 2023-09-13T09:44:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 Processor -- start 2023-09-13T09:44:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 -- start start 2023-09-13T09:44:01.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51440ffcc0 0x7f5144069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f514419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5144101850 0x7f514419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419e590 con 0x7f5144100eb0 2023-09-13T09:44:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419e700 con 0x7f51440ffcc0 2023-09-13T09:44:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514bee1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514419e8c0 con 0x7f5144101850 2023-09-13T09:44:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f514419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f514419b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36538/0 (socket says 172.21.15.6:36538) 2023-09-13T09:44:01.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 -- 172.21.15.6:0/1188217817 learned_addr learned my addr 172.21.15.6:0/1188217817 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514a47e700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5144101850 0x7f514419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 -- 172.21.15.6:0/1188217817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5144101850 msgr2=0x7f514419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f5149c7d700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51440ffcc0 0x7f5144069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5144101850 0x7f514419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 -- 172.21.15.6:0/1188217817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51440ffcc0 msgr2=0x7f5144069880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51440ffcc0 0x7f5144069880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 -- 172.21.15.6:0/1188217817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51380095f0 con 0x7f5144100eb0 2023-09-13T09:44:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.038+0000 7f514947c700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f514419b7b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5138006010 tx=0x7f513800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.039+0000 7f5136ffd700 1 -- 172.21.15.6:0/1188217817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f513801c070 con 0x7f5144100eb0 2023-09-13T09:44:01.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.039+0000 7f5136ffd700 1 -- 172.21.15.6:0/1188217817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5138004830 con 0x7f5144100eb0 2023-09-13T09:44:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.039+0000 7f5136ffd700 1 -- 172.21.15.6:0/1188217817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51380054a0 con 0x7f5144100eb0 2023-09-13T09:44:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.039+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514419eb40 con 0x7f5144100eb0 2023-09-13T09:44:01.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.039+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514419ef00 con 0x7f5144100eb0 2023-09-13T09:44:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.040+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514410b520 con 0x7f5144100eb0 2023-09-13T09:44:01.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.041+0000 7f5136ffd700 1 -- 172.21.15.6:0/1188217817 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5138020070 con 0x7f5144100eb0 2023-09-13T09:44:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.041+0000 7f5136ffd700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51300a06c0 0x7f51300a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.042+0000 7f5149c7d700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51300a06c0 0x7f51300a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.042+0000 7f5136ffd700 1 -- 172.21.15.6:0/1188217817 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f51380cc990 con 0x7f5144100eb0 2023-09-13T09:44:01.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.042+0000 7f5149c7d700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51300a06c0 0x7f51300a2b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5144100d10 tx=0x7f5140009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.046+0000 7f5136ffd700 1 -- 172.21.15.6:0/1188217817 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f513805be10 con 0x7f5144100eb0 2023-09-13T09:44:01.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 131943 2.59 MB/sec execute 81 sec latency 2056.650 ms 2023-09-13T09:44:01.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.292+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5144106b50 con 0x7f5144100eb0 2023-09-13T09:44:01.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.293+0000 7f5136ffd700 1 -- 172.21.15.6:0/1188217817 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f5138096500 con 0x7f5144100eb0 2023-09-13T09:44:01.295 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:44:01.295 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:44:01.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51300a06c0 msgr2=0x7f51300a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51300a06c0 0x7f51300a2b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f5144100d10 tx=0x7f5140009260 comp rx=0 tx=0).stop 2023-09-13T09:44:01.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 msgr2=0x7f514419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f514419b7b0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5138006010 tx=0x7f513800f740 comp rx=0 tx=0).stop 2023-09-13T09:44:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 shutdown_connections 2023-09-13T09:44:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5144101850 0x7f514419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51440ffcc0 0x7f5144069880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51300a06c0 0x7f51300a2b80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 --2- 172.21.15.6:0/1188217817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5144100eb0 0x7f514419b7b0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 >> 172.21.15.6:0/1188217817 conn(0x7f51440fb250 msgr2=0x7f51440fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 shutdown_connections 2023-09-13T09:44:01.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.295+0000 7f514bee1700 1 -- 172.21.15.6:0/1188217817 wait complete. 2023-09-13T09:44:01.300 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:44:01.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:44:01.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 -- 172.21.15.6:0/3033902859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a0100eb0 msgr2=0x7f57a0101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 --2- 172.21.15.6:0/3033902859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a0100eb0 0x7f57a0101310 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f579c0099c0 tx=0x7f579c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 -- 172.21.15.6:0/3033902859 shutdown_connections 2023-09-13T09:44:01.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 --2- 172.21.15.6:0/3033902859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57a0101850 0x7f57a0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 --2- 172.21.15.6:0/3033902859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a00ffcc0 0x7f57a01000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 --2- 172.21.15.6:0/3033902859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a0100eb0 0x7f57a0101310 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 -- 172.21.15.6:0/3033902859 >> 172.21.15.6:0/3033902859 conn(0x7f57a00fb250 msgr2=0x7f57a00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 -- 172.21.15.6:0/3033902859 shutdown_connections 2023-09-13T09:44:01.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.435+0000 7f57a7c83700 1 -- 172.21.15.6:0/3033902859 wait complete. 2023-09-13T09:44:01.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 Processor -- start 2023-09-13T09:44:01.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 -- start start 2023-09-13T09:44:01.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a00ffcc0 0x7f57a0198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0100eb0 0x7f57a0199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57a0101850 0x7f57a01a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01a0830 con 0x7f57a00ffcc0 2023-09-13T09:44:01.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01a09a0 con 0x7f57a0100eb0 2023-09-13T09:44:01.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a7c83700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a01a0b60 con 0x7f57a0101850 2023-09-13T09:44:01.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a00ffcc0 0x7f57a0198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a00ffcc0 0x7f57a0198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36550/0 (socket says 172.21.15.6:36550) 2023-09-13T09:44:01.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 -- 172.21.15.6:0/2086213633 learned_addr learned my addr 172.21.15.6:0/2086213633 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a6220700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57a0101850 0x7f57a01a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a521e700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0100eb0 0x7f57a0199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 -- 172.21.15.6:0/2086213633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57a0101850 msgr2=0x7f57a01a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57a0101850 0x7f57a01a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 -- 172.21.15.6:0/2086213633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0100eb0 msgr2=0x7f57a0199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0100eb0 0x7f57a0199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 -- 172.21.15.6:0/2086213633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c0095f0 con 0x7f57a00ffcc0 2023-09-13T09:44:01.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a521e700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0100eb0 0x7f57a0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:01.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a6220700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57a0101850 0x7f57a01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:01.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.436+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a00ffcc0 0x7f57a0198cf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f579000e970 tx=0x7f579000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.437+0000 7f5796ffd700 1 -- 172.21.15.6:0/2086213633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790009790 con 0x7f57a00ffcc0 2023-09-13T09:44:01.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.437+0000 7f5796ffd700 1 -- 172.21.15.6:0/2086213633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f57900044e0 con 0x7f57a00ffcc0 2023-09-13T09:44:01.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.437+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a01a0e40 con 0x7f57a00ffcc0 2023-09-13T09:44:01.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.437+0000 7f5796ffd700 1 -- 172.21.15.6:0/2086213633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790003e30 con 0x7f57a00ffcc0 2023-09-13T09:44:01.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.437+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a01a1260 con 0x7f57a00ffcc0 2023-09-13T09:44:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.439+0000 7f5796ffd700 1 -- 172.21.15.6:0/2086213633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5790004000 con 0x7f57a00ffcc0 2023-09-13T09:44:01.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.439+0000 7f5796ffd700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f578c0a0640 0x7f578c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.440+0000 7f5796ffd700 1 -- 172.21.15.6:0/2086213633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5790014070 con 0x7f57a00ffcc0 2023-09-13T09:44:01.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.440+0000 7f57a521e700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f578c0a0640 0x7f578c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.440+0000 7f57a521e700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f578c0a0640 0x7f578c0a2b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f579c0098e0 tx=0x7f579c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.440+0000 7f57b3e68b80 1 Processor -- start 2023-09-13T09:44:01.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.440+0000 7f57b3e68b80 1 -- start start 2023-09-13T09:44:01.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabcdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabce060 0x55e0eabcc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabcce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eab25780 con 0x55e0eabce060 2023-09-13T09:44:01.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eab230a0 con 0x55e0eabcca00 2023-09-13T09:44:01.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eab1e990 con 0x55e0eabcd700 2023-09-13T09:44:01.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabce060 0x55e0eabcc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabce060 0x55e0eabcc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36560/0 (socket says 172.21.15.6:36560) 2023-09-13T09:44:01.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 -- 172.21.15.6:0/1845059059 learned_addr learned my addr 172.21.15.6:0/1845059059 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabcdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 -- 172.21.15.6:0/1845059059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 msgr2=0x55e0eabcdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a6220700 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabcce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabcdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 -- 172.21.15.6:0/1845059059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 msgr2=0x55e0eabcce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabcce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 -- 172.21.15.6:0/1845059059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ea99e630 con 0x55e0eabce060 2023-09-13T09:44:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f57a521e700 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabce060 0x55e0eabcc4c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f579c00bbd0 tx=0x7f579c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc0f9e125a6afd89 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.441+0000 7f578bfff700 1 -- 172.21.15.6:0/1845059059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c030070 con 0x55e0eabce060 2023-09-13T09:44:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f578bfff700 1 -- 172.21.15.6:0/1845059059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f579c028040 con 0x55e0eabce060 2023-09-13T09:44:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f578bfff700 1 -- 172.21.15.6:0/1845059059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c01c040 con 0x55e0eabce060 2023-09-13T09:44:01.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 -- 172.21.15.6:0/1845059059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabce060 msgr2=0x55e0eabcc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabce060 0x55e0eabcc4c0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f579c00bbd0 tx=0x7f579c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 -- 172.21.15.6:0/1845059059 shutdown_connections 2023-09-13T09:44:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabcce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabcdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/1845059059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabce060 0x55e0eabcc4c0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 -- 172.21.15.6:0/1845059059 >> 172.21.15.6:0/1845059059 conn(0x55e0eab2ac80 msgr2=0x55e0eabc6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 -- 172.21.15.6:0/1845059059 shutdown_connections 2023-09-13T09:44:01.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.442+0000 7f57b3e68b80 1 -- 172.21.15.6:0/1845059059 wait complete. 2023-09-13T09:44:01.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 -- start start 2023-09-13T09:44:01.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 Processor -- start 2023-09-13T09:44:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabd5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabce060 0x55e0eabdd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eaabcbb0 con 0x55e0eabcd700 2023-09-13T09:44:01.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eaabc8b0 con 0x55e0eabcca00 2023-09-13T09:44:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0ea9a0920 con 0x55e0eabce060 2023-09-13T09:44:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57b3e68b80 10 client.0 _ll_register_callbacks cb 0x55e0eaaba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57a521e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57a521e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36566/0 (socket says 172.21.15.6:36566) 2023-09-13T09:44:01.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57a521e700 1 -- 172.21.15.6:0/929648418 learned_addr learned my addr 172.21.15.6:0/929648418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabd5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.443+0000 7f57a6220700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabce060 0x55e0eabdd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57a521e700 1 -- 172.21.15.6:0/929648418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabce060 msgr2=0x55e0eabdd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57a521e700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabce060 0x55e0eabdd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57a521e700 1 -- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 msgr2=0x55e0eabd5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57a521e700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabd5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57a521e700 1 -- 172.21.15.6:0/929648418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a0108a50 con 0x55e0eabcd700 2023-09-13T09:44:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57a6220700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabce060 0x55e0eabdd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57a521e700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd6410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f579c00bf40 tx=0x7f579c0051b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4494dce300114f90 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57897fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57897fa700 1 -- 172.21.15.6:0/929648418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c01c050 con 0x55e0eabcd700 2023-09-13T09:44:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57897fa700 1 -- 172.21.15.6:0/929648418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f579c00fb20 con 0x55e0eabcd700 2023-09-13T09:44:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0eabbf670 con 0x55e0eabcd700 2023-09-13T09:44:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57897fa700 1 -- 172.21.15.6:0/929648418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f579c030040 con 0x55e0eabcd700 2023-09-13T09:44:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57b3e68b80 10 client.16566 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:01.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e0eab367a0 con 0x55e0eabcd700 2023-09-13T09:44:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57897fa700 1 -- 172.21.15.6:0/929648418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f579c046080 con 0x55e0eabcd700 2023-09-13T09:44:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.444+0000 7f57897fa700 1 -- 172.21.15.6:0/929648418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f579c02b070 con 0x55e0eabcd700 2023-09-13T09:44:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57b3e68b80 10 client.16566 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57b3e68b80 10 client.16566 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:44:01.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57b3e68b80 20 client.16566 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:01.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eabe1960 0x55e0eabe3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57b3e68b80 4 client.16566 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:01.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0eab17970 con 0x55e0eabe1960 2023-09-13T09:44:01.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eabe1960 0x55e0eabe3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57897fa700 10 client.16566 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:01.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.445+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eabe1960 0x55e0eabe3d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fc909eda031b4e38 server_cookie=588c3e5d5c7540f4 in_seq=0 out_seq=0 2023-09-13T09:44:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57897fa700 1 -- 172.21.15.6:0/929648418 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e0eab17970 con 0x55e0eabe1960 2023-09-13T09:44:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57897fa700 10 client.16566 handle_command_reply: tid=0 2023-09-13T09:44:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 client.16566 shutdown 2023-09-13T09:44:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 msgr2=0x55e0eabd6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd6410 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f579c00bf40 tx=0x7f579c0051b0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 shutdown_connections 2023-09-13T09:44:01.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eabe1960 0x55e0eabe3d80 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabce060 0x55e0eabdd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabcca00 0x55e0eabd5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/929648418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd6410 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 >> 172.21.15.6:0/929648418 conn(0x55e0eab2ac80 msgr2=0x55e0eabc17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57897fa700 0 client.16566 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 shutdown_connections 2023-09-13T09:44:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.446+0000 7f57b3e68b80 1 -- 172.21.15.6:0/929648418 wait complete. 2023-09-13T09:44:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.447+0000 7f57b3e68b80 20 client.16566 trim_cache size 0 max 16384 2023-09-13T09:44:01.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.459+0000 7f57b3e68b80 1 Processor -- start 2023-09-13T09:44:01.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57b3e68b80 1 -- start start 2023-09-13T09:44:01.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcca00 0x55e0eabcc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabdd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eabd5380 con 0x55e0eabcca00 2023-09-13T09:44:01.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eabd5a40 con 0x55e0eabce060 2023-09-13T09:44:01.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eabc7a60 con 0x55e0eabcd700 2023-09-13T09:44:01.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcca00 0x55e0eabcc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcca00 0x55e0eabcc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36572/0 (socket says 172.21.15.6:36572) 2023-09-13T09:44:01.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 -- 172.21.15.6:0/4031602042 learned_addr learned my addr 172.21.15.6:0/4031602042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a521e700 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabdd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 -- 172.21.15.6:0/4031602042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 msgr2=0x55e0eabdd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabdd410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 -- 172.21.15.6:0/4031602042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 msgr2=0x55e0eabddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a6220700 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 -- 172.21.15.6:0/4031602042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0ea94ade0 con 0x55e0eabcca00 2023-09-13T09:44:01.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a6220700 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:01.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.460+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcca00 0x55e0eabcc4c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f57900995e0 tx=0x7f5790003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad09aceff881dc6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f5794d82700 1 -- 172.21.15.6:0/4031602042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790082ea0 con 0x55e0eabcca00 2023-09-13T09:44:01.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f5794d82700 1 -- 172.21.15.6:0/4031602042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5790099650 con 0x55e0eabcca00 2023-09-13T09:44:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f5794d82700 1 -- 172.21.15.6:0/4031602042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5790004380 con 0x55e0eabcca00 2023-09-13T09:44:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4031602042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcca00 msgr2=0x55e0eabcc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcca00 0x55e0eabcc4c0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f57900995e0 tx=0x7f5790003890 comp rx=0 tx=0).stop 2023-09-13T09:44:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4031602042 shutdown_connections 2023-09-13T09:44:01.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcca00 0x55e0eabcc4c0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4031602042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcd700 0x55e0eabdd410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4031602042 >> 172.21.15.6:0/4031602042 conn(0x55e0eab2ac80 msgr2=0x55e0eabd4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4031602042 shutdown_connections 2023-09-13T09:44:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4031602042 wait complete. 2023-09-13T09:44:01.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.461+0000 7f57b3e68b80 1 -- start start 2023-09-13T09:44:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 1 Processor -- start 2023-09-13T09:44:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcca00 0x55e0eabd8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabdc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eabdca40 con 0x55e0eabcd700 2023-09-13T09:44:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eabdcbb0 con 0x55e0eabce060 2023-09-13T09:44:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0eabdcd70 con 0x55e0eabcca00 2023-09-13T09:44:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57b3e68b80 10 client.0 _ll_register_callbacks cb 0x55e0eaaba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36580/0 (socket says 172.21.15.6:36580) 2023-09-13T09:44:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 -- 172.21.15.6:0/4293812655 learned_addr learned my addr 172.21.15.6:0/4293812655 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcca00 0x55e0eabd8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a6220700 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabdc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 -- 172.21.15.6:0/4293812655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcca00 msgr2=0x55e0eabd8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcca00 0x55e0eabd8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 -- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 msgr2=0x55e0eabdc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabdc500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.462+0000 7f57a521e700 1 -- 172.21.15.6:0/4293812655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a01a1260 con 0x55e0eabcd700 2023-09-13T09:44:01.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57a521e700 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd94e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f579c006010 tx=0x7f579c0427d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdef4482f768562 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57897fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:01.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57897fa700 1 -- 172.21.15.6:0/4293812655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579c030050 con 0x55e0eabcd700 2023-09-13T09:44:01.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57897fa700 1 -- 172.21.15.6:0/4293812655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f579c00fd30 con 0x55e0eabcd700 2023-09-13T09:44:01.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f579c028040 con 0x55e0eabcd700 2023-09-13T09:44:01.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57897fa700 1 -- 172.21.15.6:0/4293812655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f579c01c040 con 0x55e0eabcd700 2023-09-13T09:44:01.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 10 client.16572 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:01.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e0ea933c60 con 0x55e0eabcd700 2023-09-13T09:44:01.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57897fa700 1 -- 172.21.15.6:0/4293812655 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f579c050020 con 0x55e0eabcd700 2023-09-13T09:44:01.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57897fa700 1 -- 172.21.15.6:0/4293812655 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f579c00f510 con 0x55e0eabcd700 2023-09-13T09:44:01.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 10 client.16572 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:01.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 10 client.16572 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:44:01.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 20 client.16572 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:01.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eac36080 0x55e0eac384a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 4 client.16572 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:01.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.463+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e0eaad8050 con 0x55e0eac36080 2023-09-13T09:44:01.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eac36080 0x55e0eac384a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57897fa700 10 client.16572 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57a5a1f700 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eac36080 0x55e0eac384a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=97b2d7425ddba7df server_cookie=31f5c7ce364ae217 in_seq=0 out_seq=0 2023-09-13T09:44:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57897fa700 1 -- 172.21.15.6:0/4293812655 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e0eaad8050 con 0x55e0eac36080 2023-09-13T09:44:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57897fa700 10 client.16572 handle_command_reply: tid=0 2023-09-13T09:44:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57b3e68b80 1 client.16572 shutdown 2023-09-13T09:44:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 msgr2=0x55e0eabd94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.464+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd94e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f579c006010 tx=0x7f579c0427d0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 shutdown_connections 2023-09-13T09:44:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55e0eac36080 0x55e0eac384a0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e0eabce060 0x55e0eabdc500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e0eabcca00 0x55e0eabd8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 --2- 172.21.15.6:0/4293812655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e0eabcd700 0x55e0eabd94e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57897fa700 0 client.16572 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 >> 172.21.15.6:0/4293812655 conn(0x55e0eab2ac80 msgr2=0x55e0eabd0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 shutdown_connections 2023-09-13T09:44:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 1 -- 172.21.15.6:0/4293812655 wait complete. 2023-09-13T09:44:01.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57b3e68b80 20 client.16572 trim_cache size 0 max 16384 2023-09-13T09:44:01.492 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:01.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f578c0a0640 msgr2=0x7f578c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f578c0a0640 0x7f578c0a2b00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f579c0098e0 tx=0x7f579c019040 comp rx=0 tx=0).stop 2023-09-13T09:44:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a00ffcc0 msgr2=0x7f57a0198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a00ffcc0 0x7f57a0198cf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f579000e970 tx=0x7f579000ed30 comp rx=0 tx=0).stop 2023-09-13T09:44:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 shutdown_connections 2023-09-13T09:44:01.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57a0101850 0x7f57a01a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f578c0a0640 0x7f578c0a2b00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57a00ffcc0 0x7f57a0198cf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 --2- 172.21.15.6:0/2086213633 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f57a0100eb0 0x7f57a0199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 >> 172.21.15.6:0/2086213633 conn(0x7f57a00fb250 msgr2=0x7f57a0067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 shutdown_connections 2023-09-13T09:44:01.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.465+0000 7f57a7c83700 1 -- 172.21.15.6:0/2086213633 wait complete. 2023-09-13T09:44:01.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:44:01.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 -- 172.21.15.6:0/780218661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff00ffcc0 msgr2=0x7faff01000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 --2- 172.21.15.6:0/780218661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff00ffcc0 0x7faff01000e0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fafe40099c0 tx=0x7fafe4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 -- 172.21.15.6:0/780218661 shutdown_connections 2023-09-13T09:44:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 --2- 172.21.15.6:0/780218661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faff0101850 0x7faff0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 --2- 172.21.15.6:0/780218661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff00ffcc0 0x7faff01000e0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 --2- 172.21.15.6:0/780218661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff0100eb0 0x7faff0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 -- 172.21.15.6:0/780218661 >> 172.21.15.6:0/780218661 conn(0x7faff00fb250 msgr2=0x7faff00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 -- 172.21.15.6:0/780218661 shutdown_connections 2023-09-13T09:44:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.622+0000 7faff6246700 1 -- 172.21.15.6:0/780218661 wait complete. 2023-09-13T09:44:01.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 Processor -- start 2023-09-13T09:44:01.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 -- start start 2023-09-13T09:44:01.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00ffcc0 0x7faff00698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faff0100eb0 0x7faff019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff0101850 0x7faff019dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff019e680 con 0x7faff0101850 2023-09-13T09:44:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff019e7f0 con 0x7faff0100eb0 2023-09-13T09:44:01.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7faff6246700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff019e9b0 con 0x7faff00ffcc0 2023-09-13T09:44:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7fafeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff0101850 0x7faff019dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7fafeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff0101850 0x7faff019dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36596/0 (socket says 172.21.15.6:36596) 2023-09-13T09:44:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7fafeffff700 1 -- 172.21.15.6:0/2563774380 learned_addr learned my addr 172.21.15.6:0/2563774380 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7fafef7fe700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00ffcc0 0x7faff00698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.623+0000 7fafeeffd700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faff0100eb0 0x7faff019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafeffff700 1 -- 172.21.15.6:0/2563774380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00ffcc0 msgr2=0x7faff00698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafeffff700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00ffcc0 0x7faff00698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafeffff700 1 -- 172.21.15.6:0/2563774380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faff0100eb0 msgr2=0x7faff019b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafeffff700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faff0100eb0 0x7faff019b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafeffff700 1 -- 172.21.15.6:0/2563774380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40095f0 con 0x7faff0101850 2023-09-13T09:44:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafeffff700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff0101850 0x7faff019dee0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafe8007ee0 tx=0x7fafe800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafecff9700 1 -- 172.21.15.6:0/2563774380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8017070 con 0x7faff0101850 2023-09-13T09:44:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafecff9700 1 -- 172.21.15.6:0/2563774380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe800f040 con 0x7faff0101850 2023-09-13T09:44:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff019ec90 con 0x7faff0101850 2023-09-13T09:44:01.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7fafecff9700 1 -- 172.21.15.6:0/2563774380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe8005580 con 0x7faff0101850 2023-09-13T09:44:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.624+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff019f150 con 0x7faff0101850 2023-09-13T09:44:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.626+0000 7fafecff9700 1 -- 172.21.15.6:0/2563774380 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fafe800db20 con 0x7faff0101850 2023-09-13T09:44:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.627+0000 7fafecff9700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fafd80a0640 0x7fafd80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.627+0000 7fafef7fe700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fafd80a0640 0x7fafd80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.627+0000 7fafecff9700 1 -- 172.21.15.6:0/2563774380 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fafe80cb360 con 0x7faff0101850 2023-09-13T09:44:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fafd80a0640 0x7fafd80a2b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b580 tx=0x7fafe4009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 Processor -- start 2023-09-13T09:44:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 -- start start 2023-09-13T09:44:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72276b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72277060 0x564c722754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72275a00 0x564c72275e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c721ce780 con 0x564c72276700 2023-09-13T09:44:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c721cc0a0 con 0x564c72275a00 2023-09-13T09:44:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fb00242bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c721c7990 con 0x564c72277060 2023-09-13T09:44:01.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72276b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72276b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36600/0 (socket says 172.21.15.6:36600) 2023-09-13T09:44:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 -- 172.21.15.6:0/2077726643 learned_addr learned my addr 172.21.15.6:0/2077726643 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafeffff700 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72275a00 0x564c72275e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafeeffd700 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72277060 0x564c722754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 -- 172.21.15.6:0/2077726643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72277060 msgr2=0x564c722754c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72277060 0x564c722754c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 -- 172.21.15.6:0/2077726643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72275a00 msgr2=0x564c72275e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72275a00 0x564c72275e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafef7fe700 1 -- 172.21.15.6:0/2077726643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c72047630 con 0x564c72276700 2023-09-13T09:44:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.628+0000 7fafeeffd700 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72277060 0x564c722754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fafef7fe700 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72276b20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7faff0100d10 tx=0x7fafe4020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d4caf25b5d1dbf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fafd5ffb700 1 -- 172.21.15.6:0/2077726643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40038c0 con 0x564c72276700 2023-09-13T09:44:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fafd5ffb700 1 -- 172.21.15.6:0/2077726643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe401e040 con 0x564c72276700 2023-09-13T09:44:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fafd5ffb700 1 -- 172.21.15.6:0/2077726643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe400fa90 con 0x564c72276700 2023-09-13T09:44:01.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fb00242bb80 1 -- 172.21.15.6:0/2077726643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 msgr2=0x564c72276b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fb00242bb80 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72276b20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7faff0100d10 tx=0x7fafe4020000 comp rx=0 tx=0).stop 2023-09-13T09:44:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fb00242bb80 1 -- 172.21.15.6:0/2077726643 shutdown_connections 2023-09-13T09:44:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fb00242bb80 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72275a00 0x564c72275e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fb00242bb80 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72276b20 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fb00242bb80 1 --2- 172.21.15.6:0/2077726643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72277060 0x564c722754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.629+0000 7fb00242bb80 1 -- 172.21.15.6:0/2077726643 >> 172.21.15.6:0/2077726643 conn(0x564c721d3c80 msgr2=0x564c7226ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.630+0000 7fb00242bb80 1 -- 172.21.15.6:0/2077726643 shutdown_connections 2023-09-13T09:44:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.630+0000 7fb00242bb80 1 -- 172.21.15.6:0/2077726643 wait complete. 2023-09-13T09:44:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.630+0000 7fb00242bb80 1 -- start start 2023-09-13T09:44:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.630+0000 7fb00242bb80 1 Processor -- start 2023-09-13T09:44:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c7227ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c7227f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c722864a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c72165bb0 con 0x564c72276700 2023-09-13T09:44:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c721658b0 con 0x564c72277060 2023-09-13T09:44:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c72049920 con 0x564c72275a00 2023-09-13T09:44:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 10 client.0 _ll_register_callbacks cb 0x564c72163680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c7227f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c7227f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36608/0 (socket says 172.21.15.6:36608) 2023-09-13T09:44:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 -- 172.21.15.6:0/393290052 learned_addr learned my addr 172.21.15.6:0/393290052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafef7fe700 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c7227ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeffff700 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c722864a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 -- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 msgr2=0x564c7227ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c7227ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 -- 172.21.15.6:0/393290052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 msgr2=0x564c722864a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c722864a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 -- 172.21.15.6:0/393290052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff0108a50 con 0x564c72276700 2023-09-13T09:44:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafeeffd700 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c7227f460 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fafe0010470 tx=0x7fafe0010780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569f96b5b4421210 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafceffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafceffd700 1 -- 172.21.15.6:0/393290052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00145f0 con 0x564c72276700 2023-09-13T09:44:01.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fafceffd700 1 -- 172.21.15.6:0/393290052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fafe0014750 con 0x564c72276700 2023-09-13T09:44:01.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.631+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564c72268670 con 0x564c72276700 2023-09-13T09:44:01.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fafceffd700 1 -- 172.21.15.6:0/393290052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafe0014910 con 0x564c72276700 2023-09-13T09:44:01.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 10 client.16584 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:01.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564c721df7a0 con 0x564c72276700 2023-09-13T09:44:01.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fafceffd700 1 -- 172.21.15.6:0/393290052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564c72268670 con 0x564c72276700 2023-09-13T09:44:01.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fafceffd700 1 -- 172.21.15.6:0/393290052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fafe001cb80 con 0x564c72276700 2023-09-13T09:44:01.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 10 client.16584 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:01.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 10 client.16584 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:44:01.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 20 client.16584 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:01.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c7228ad30 0x564c7228d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 4 client.16584 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564c721c0970 con 0x564c7228ad30 2023-09-13T09:44:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.632+0000 7fafef7fe700 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c7228ad30 0x564c7228d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.633+0000 7fafceffd700 10 client.16584 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.633+0000 7fafef7fe700 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c7228ad30 0x564c7228d150 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fe6b6a56027a95f7 server_cookie=ad2a5a753a8ac3a2 in_seq=0 out_seq=0 2023-09-13T09:44:01.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.633+0000 7fafceffd700 1 -- 172.21.15.6:0/393290052 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564c721c0970 con 0x564c7228ad30 2023-09-13T09:44:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.633+0000 7fafceffd700 10 client.16584 handle_command_reply: tid=0 2023-09-13T09:44:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.633+0000 7fb00242bb80 1 client.16584 shutdown 2023-09-13T09:44:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 msgr2=0x564c7227f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c7227f460 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fafe0010470 tx=0x7fafe0010780 comp rx=0 tx=0).stop 2023-09-13T09:44:01.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 shutdown_connections 2023-09-13T09:44:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c7228ad30 0x564c7228d150 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c722864a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c7227ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 --2- 172.21.15.6:0/393290052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c7227f460 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fafceffd700 0 client.16584 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 >> 172.21.15.6:0/393290052 conn(0x564c721d3c80 msgr2=0x564c7226a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 shutdown_connections 2023-09-13T09:44:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 1 -- 172.21.15.6:0/393290052 wait complete. 2023-09-13T09:44:01.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.634+0000 7fb00242bb80 20 client.16584 trim_cache size 0 max 16384 2023-09-13T09:44:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 Processor -- start 2023-09-13T09:44:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 -- start start 2023-09-13T09:44:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c722754c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72270fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c72286460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c72288180 con 0x564c72276700 2023-09-13T09:44:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c72270c40 con 0x564c72277060 2023-09-13T09:44:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fb00242bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c7227fba0 con 0x564c72275a00 2023-09-13T09:44:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fafeeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72270fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fafeeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72270fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36616/0 (socket says 172.21.15.6:36616) 2023-09-13T09:44:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fafeeffd700 1 -- 172.21.15.6:0/1887824662 learned_addr learned my addr 172.21.15.6:0/1887824662 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fafeffff700 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c72286460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.647+0000 7fafef7fe700 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c722754c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafeeffd700 1 -- 172.21.15.6:0/1887824662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 msgr2=0x564c722754c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafeeffd700 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c722754c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafeeffd700 1 -- 172.21.15.6:0/1887824662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 msgr2=0x564c72286460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafeeffd700 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c72286460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafeeffd700 1 -- 172.21.15.6:0/1887824662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564c71ff3de0 con 0x564c72276700 2023-09-13T09:44:01.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafef7fe700 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c722754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafeeffd700 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72270fb0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fafe0006ea0 tx=0x7fafe00046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0a3c1577b71c60 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafd67fc700 1 -- 172.21.15.6:0/1887824662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00136b0 con 0x564c72276700 2023-09-13T09:44:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafd67fc700 1 -- 172.21.15.6:0/1887824662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe00138e0 con 0x564c72276700 2023-09-13T09:44:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fafd67fc700 1 -- 172.21.15.6:0/1887824662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe001c6b0 con 0x564c72276700 2023-09-13T09:44:01.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.648+0000 7fb00242bb80 1 -- 172.21.15.6:0/1887824662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 msgr2=0x564c72270fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72270fb0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fafe0006ea0 tx=0x7fafe00046d0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- 172.21.15.6:0/1887824662 shutdown_connections 2023-09-13T09:44:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72277060 0x564c72286460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c722754c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1887824662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72276700 0x564c72270fb0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- 172.21.15.6:0/1887824662 >> 172.21.15.6:0/1887824662 conn(0x564c721d3c80 msgr2=0x564c7226fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- 172.21.15.6:0/1887824662 shutdown_connections 2023-09-13T09:44:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- 172.21.15.6:0/1887824662 wait complete. 2023-09-13T09:44:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- start start 2023-09-13T09:44:01.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 Processor -- start 2023-09-13T09:44:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c72282690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72276700 0x564c72282bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72277060 0x564c722854f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c72285a30 con 0x564c72277060 2023-09-13T09:44:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c72285ba0 con 0x564c72276700 2023-09-13T09:44:01.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.649+0000 7fb00242bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564c72285d10 con 0x564c72275a00 2023-09-13T09:44:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fb00242bb80 10 client.0 _ll_register_callbacks cb 0x564c72163680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72277060 0x564c722854f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72277060 0x564c722854f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36624/0 (socket says 172.21.15.6:36624) 2023-09-13T09:44:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeeffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72276700 0x564c72282bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 -- 172.21.15.6:0/1527770848 learned_addr learned my addr 172.21.15.6:0/1527770848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafef7fe700 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c72282690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 -- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 msgr2=0x564c72282690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c72282690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 -- 172.21.15.6:0/1527770848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72276700 msgr2=0x564c72282bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72276700 0x564c72282bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 -- 172.21.15.6:0/1527770848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564c721df7a0 con 0x564c72277060 2023-09-13T09:44:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafeffff700 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72277060 0x564c722854f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fafe80c8e60 tx=0x7fafe8005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb13cca2957411bd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafceffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafceffd700 1 -- 172.21.15.6:0/1527770848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe80a0b70 con 0x564c72277060 2023-09-13T09:44:01.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafceffd700 1 -- 172.21.15.6:0/1527770848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fafe80b0030 con 0x564c72277060 2023-09-13T09:44:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fafe401e040 con 0x564c72277060 2023-09-13T09:44:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fafceffd700 1 -- 172.21.15.6:0/1527770848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fafe8004c40 con 0x564c72277060 2023-09-13T09:44:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fb00242bb80 10 client.16590 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.650+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x564c71fdcc60 con 0x564c72277060 2023-09-13T09:44:01.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fafceffd700 1 -- 172.21.15.6:0/1527770848 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fafe8064020 con 0x564c72277060 2023-09-13T09:44:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fafceffd700 1 -- 172.21.15.6:0/1527770848 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fafe8097ff0 con 0x564c72277060 2023-09-13T09:44:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fb00242bb80 10 client.16590 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fb00242bb80 10 client.16590 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:44:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fb00242bb80 20 client.16590 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:01.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c722df7d0 0x564c722e1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fb00242bb80 4 client.16590 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564c72181050 con 0x564c722df7d0 2023-09-13T09:44:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.651+0000 7fafef7fe700 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c722df7d0 0x564c722e1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fafceffd700 10 client.16590 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:01.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fafef7fe700 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c722df7d0 0x564c722e1bc0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f457219e3767a016 server_cookie=8d073ccbf836532c in_seq=0 out_seq=0 2023-09-13T09:44:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fafceffd700 1 -- 172.21.15.6:0/1527770848 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564c72181050 con 0x564c722df7d0 2023-09-13T09:44:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fafceffd700 10 client.16590 handle_command_reply: tid=0 2023-09-13T09:44:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 client.16590 shutdown 2023-09-13T09:44:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72277060 msgr2=0x564c722854f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72277060 0x564c722854f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fafe80c8e60 tx=0x7fafe8005020 comp rx=0 tx=0).stop 2023-09-13T09:44:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 shutdown_connections 2023-09-13T09:44:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564c722df7d0 0x564c722e1bc0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564c72277060 0x564c722854f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564c72275a00 0x564c72282690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fafceffd700 0 client.16590 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:01.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 --2- 172.21.15.6:0/1527770848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564c72276700 0x564c72282bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 >> 172.21.15.6:0/1527770848 conn(0x564c721d3c80 msgr2=0x564c7227db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 shutdown_connections 2023-09-13T09:44:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 1 -- 172.21.15.6:0/1527770848 wait complete. 2023-09-13T09:44:01.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.652+0000 7fb00242bb80 20 client.16590 trim_cache size 0 max 16384 2023-09-13T09:44:01.678 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fafd80a0640 msgr2=0x7fafd80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fafd80a0640 0x7fafd80a2b00 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fafe400b580 tx=0x7fafe4009f10 comp rx=0 tx=0).stop 2023-09-13T09:44:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff0101850 msgr2=0x7faff019dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff0101850 0x7faff019dee0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fafe8007ee0 tx=0x7fafe800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 shutdown_connections 2023-09-13T09:44:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fafd80a0640 0x7fafd80a2b00 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faff0101850 0x7faff019dee0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00ffcc0 0x7faff00698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 --2- 172.21.15.6:0/2563774380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faff0100eb0 0x7faff019b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 >> 172.21.15.6:0/2563774380 conn(0x7faff00fb250 msgr2=0x7faff00fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 shutdown_connections 2023-09-13T09:44:01.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.653+0000 7faff6246700 1 -- 172.21.15.6:0/2563774380 wait complete. 2023-09-13T09:44:01.683 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:44:01.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 -- 172.21.15.6:0/2822433945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 msgr2=0x7fc3981091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/2822433945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc3981091c0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fc39000b0d0 tx=0x7fc39000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 -- 172.21.15.6:0/2822433945 shutdown_connections 2023-09-13T09:44:01.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/2822433945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc3981091c0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/2822433945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc398100d80 0x7fc3981011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/2822433945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc398101f70 0x7fc3981023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 -- 172.21.15.6:0/2822433945 >> 172.21.15.6:0/2822433945 conn(0x7fc3980fc310 msgr2=0x7fc3980fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 -- 172.21.15.6:0/2822433945 shutdown_connections 2023-09-13T09:44:01.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.812+0000 7fc39cd2e700 1 -- 172.21.15.6:0/2822433945 wait complete. 2023-09-13T09:44:01.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 Processor -- start 2023-09-13T09:44:01.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 -- start start 2023-09-13T09:44:01.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc398100d80 0x7fc398196d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc398101f70 0x7fc398197250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc39819e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39819e850 con 0x7fc398102910 2023-09-13T09:44:01.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39819e9c0 con 0x7fc398100d80 2023-09-13T09:44:01.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.813+0000 7fc39cd2e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc39819eb80 con 0x7fc398101f70 2023-09-13T09:44:01.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc39819e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc39819e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36638/0 (socket says 172.21.15.6:36638) 2023-09-13T09:44:01.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 -- 172.21.15.6:0/3881467563 learned_addr learned my addr 172.21.15.6:0/3881467563 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc39659c700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc398100d80 0x7fc398196d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc395d9b700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc398101f70 0x7fc398197250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 -- 172.21.15.6:0/3881467563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc398101f70 msgr2=0x7fc398197250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc398101f70 0x7fc398197250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 -- 172.21.15.6:0/3881467563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc398100d80 msgr2=0x7fc398196d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc398100d80 0x7fc398196d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 -- 172.21.15.6:0/3881467563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc390009d00 con 0x7fc398102910 2023-09-13T09:44:01.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc396d9d700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc39819e280 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc390007a00 tx=0x7fc3900094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc3877fe700 1 -- 172.21.15.6:0/3881467563 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39000e040 con 0x7fc398102910 2023-09-13T09:44:01.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc3877fe700 1 -- 172.21.15.6:0/3881467563 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc390003e10 con 0x7fc398102910 2023-09-13T09:44:01.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc3877fe700 1 -- 172.21.15.6:0/3881467563 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390012b10 con 0x7fc398102910 2023-09-13T09:44:01.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc39819ee00 con 0x7fc398102910 2023-09-13T09:44:01.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.814+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc39819f1d0 con 0x7fc398102910 2023-09-13T09:44:01.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.816+0000 7fc3877fe700 1 -- 172.21.15.6:0/3881467563 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc390012cf0 con 0x7fc398102910 2023-09-13T09:44:01.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.817+0000 7fc3877fe700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3800a06c0 0x7fc3800a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.817+0000 7fc3877fe700 1 -- 172.21.15.6:0/3881467563 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc3900cd350 con 0x7fc398102910 2023-09-13T09:44:01.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.817+0000 7fc39659c700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3800a06c0 0x7fc3800a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.817+0000 7fc39659c700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3800a06c0 0x7fc3800a2b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc3981981e0 tx=0x7fc388009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 Processor -- start 2023-09-13T09:44:01.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 -- start start 2023-09-13T09:44:01.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc31f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc31f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc314e780 con 0x55afc31f6700 2023-09-13T09:44:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc314c0a0 con 0x55afc31f5a00 2023-09-13T09:44:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc3147990 con 0x55afc31f7060 2023-09-13T09:44:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc39659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc31f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc39659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc31f6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36642/0 (socket says 172.21.15.6:36642) 2023-09-13T09:44:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.818+0000 7fc39659c700 1 -- 172.21.15.6:0/2769343171 learned_addr learned my addr 172.21.15.6:0/2769343171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc396d9d700 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31f5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc395d9b700 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc31f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc39659c700 1 -- 172.21.15.6:0/2769343171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 msgr2=0x55afc31f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc39659c700 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc31f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc39659c700 1 -- 172.21.15.6:0/2769343171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 msgr2=0x55afc31f5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc39659c700 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31f5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc39659c700 1 -- 172.21.15.6:0/2769343171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afc2fc7630 con 0x55afc31f6700 2023-09-13T09:44:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc39659c700 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc31f6b20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc38800e9d0 tx=0x7fc388011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcac20141e2e9226 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc384ff9700 1 -- 172.21.15.6:0/2769343171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388015480 con 0x55afc31f6700 2023-09-13T09:44:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc384ff9700 1 -- 172.21.15.6:0/2769343171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc388015aa0 con 0x55afc31f6700 2023-09-13T09:44:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.819+0000 7fc384ff9700 1 -- 172.21.15.6:0/2769343171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3880139e0 con 0x55afc31f6700 2023-09-13T09:44:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2769343171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 msgr2=0x55afc31f6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc31f6b20 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fc38800e9d0 tx=0x7fc388011000 comp rx=0 tx=0).stop 2023-09-13T09:44:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2769343171 shutdown_connections 2023-09-13T09:44:01.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc31f6b20 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2769343171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc31f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2769343171 >> 172.21.15.6:0/2769343171 conn(0x55afc3153c80 msgr2=0x55afc31eff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2769343171 shutdown_connections 2023-09-13T09:44:01.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2769343171 wait complete. 2023-09-13T09:44:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 -- start start 2023-09-13T09:44:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.820+0000 7fc3a8f13b80 1 Processor -- start 2023-09-13T09:44:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31fef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc31ff470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f7060 0x55afc32064b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc30e5bb0 con 0x55afc31f7060 2023-09-13T09:44:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc30e58b0 con 0x55afc31f5a00 2023-09-13T09:44:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc2fc9920 con 0x55afc31f6700 2023-09-13T09:44:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 10 client.0 _ll_register_callbacks cb 0x55afc30e3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:01.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f7060 0x55afc32064b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc39659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31fef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f7060 0x55afc32064b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36650/0 (socket says 172.21.15.6:36650) 2023-09-13T09:44:01.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 -- 172.21.15.6:0/2279821967 learned_addr learned my addr 172.21.15.6:0/2279821967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc395d9b700 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc31ff470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 -- 172.21.15.6:0/2279821967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 msgr2=0x55afc31ff470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc31ff470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 -- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 msgr2=0x55afc31fef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31fef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 -- 172.21.15.6:0/2279821967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc38800e6b0 con 0x55afc31f7060 2023-09-13T09:44:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc39659c700 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:01.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc396d9d700 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f7060 0x55afc32064b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc39009a880 tx=0x7fc39000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac6299a1c920cb32 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc37dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc37dffb700 1 -- 172.21.15.6:0/2279821967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc39009ab80 con 0x55afc31f7060 2023-09-13T09:44:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc37dffb700 1 -- 172.21.15.6:0/2279821967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc39009e9b0 con 0x55afc31f7060 2023-09-13T09:44:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.821+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55afc31e8670 con 0x55afc31f7060 2023-09-13T09:44:01.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc37dffb700 1 -- 172.21.15.6:0/2279821967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3900a2b60 con 0x55afc31f7060 2023-09-13T09:44:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 10 client.16602 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55afc315f7a0 con 0x55afc31f7060 2023-09-13T09:44:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc37dffb700 1 -- 172.21.15.6:0/2279821967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55afc31e8670 con 0x55afc31f7060 2023-09-13T09:44:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc37dffb700 1 -- 172.21.15.6:0/2279821967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc39009a070 con 0x55afc31f7060 2023-09-13T09:44:01.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 10 client.16602 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 10 client.16602 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:44:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 20 client.16602 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc320a9e0 0x55afc320ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 4 client.16602 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:01.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55afc3140970 con 0x55afc320a9e0 2023-09-13T09:44:01.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.822+0000 7fc39659c700 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc320a9e0 0x55afc320ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.823+0000 7fc37dffb700 10 client.16602 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:01.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.823+0000 7fc39659c700 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc320a9e0 0x55afc320ce00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=91b0b1b288041615 server_cookie=5b1c76bfe6fff78e in_seq=0 out_seq=0 2023-09-13T09:44:01.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.823+0000 7fc37dffb700 1 -- 172.21.15.6:0/2279821967 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55afc3140970 con 0x55afc320a9e0 2023-09-13T09:44:01.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc37dffb700 10 client.16602 handle_command_reply: tid=0 2023-09-13T09:44:01.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 client.16602 shutdown 2023-09-13T09:44:01.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f7060 msgr2=0x55afc32064b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f7060 0x55afc32064b0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fc39009a880 tx=0x7fc39000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 shutdown_connections 2023-09-13T09:44:01.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc320a9e0 0x55afc320ce00 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f7060 0x55afc32064b0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc31fef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2279821967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc31ff470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc37dffb700 0 client.16602 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 >> 172.21.15.6:0/2279821967 conn(0x55afc3153c80 msgr2=0x55afc31ea7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 shutdown_connections 2023-09-13T09:44:01.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2279821967 wait complete. 2023-09-13T09:44:01.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.824+0000 7fc3a8f13b80 20 client.16602 trim_cache size 0 max 16384 2023-09-13T09:44:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 Processor -- start 2023-09-13T09:44:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 -- start start 2023-09-13T09:44:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f5a00 0x55afc31f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc3206470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f7060 0x55afc31fdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc31ffbb0 con 0x55afc31f5a00 2023-09-13T09:44:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc31fcb80 con 0x55afc31f7060 2023-09-13T09:44:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc3200080 con 0x55afc31f6700 2023-09-13T09:44:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f5a00 0x55afc31f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f5a00 0x55afc31f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36654/0 (socket says 172.21.15.6:36654) 2023-09-13T09:44:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 -- 172.21.15.6:0/1185123019 learned_addr learned my addr 172.21.15.6:0/1185123019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc396d9d700 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f7060 0x55afc31fdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc395d9b700 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc3206470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 -- 172.21.15.6:0/1185123019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 msgr2=0x55afc3206470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc3206470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 -- 172.21.15.6:0/1185123019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f7060 msgr2=0x55afc31fdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f7060 0x55afc31fdbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 -- 172.21.15.6:0/1185123019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55afc2f73de0 con 0x55afc31f5a00 2023-09-13T09:44:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc39659c700 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f5a00 0x55afc31f54c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc38800ef40 tx=0x7fc388009200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2452172081c58b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3857fa700 1 -- 172.21.15.6:0/1185123019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388031530 con 0x55afc31f5a00 2023-09-13T09:44:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3857fa700 1 -- 172.21.15.6:0/1185123019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc388035070 con 0x55afc31f5a00 2023-09-13T09:44:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3857fa700 1 -- 172.21.15.6:0/1185123019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc388013670 con 0x55afc31f5a00 2023-09-13T09:44:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/1185123019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f5a00 msgr2=0x55afc31f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f5a00 0x55afc31f54c0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fc38800ef40 tx=0x7fc388009200 comp rx=0 tx=0).stop 2023-09-13T09:44:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/1185123019 shutdown_connections 2023-09-13T09:44:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f7060 0x55afc31fdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f5a00 0x55afc31f54c0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/1185123019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f6700 0x55afc3206470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.838+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/1185123019 >> 172.21.15.6:0/1185123019 conn(0x55afc3153c80 msgr2=0x55afc31efe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/1185123019 shutdown_connections 2023-09-13T09:44:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/1185123019 wait complete. 2023-09-13T09:44:01.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 -- start start 2023-09-13T09:44:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 Processor -- start 2023-09-13T09:44:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc3204610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc3204b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc32051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc32058b0 con 0x55afc31f6700 2023-09-13T09:44:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc3205a20 con 0x55afc31f5a00 2023-09-13T09:44:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55afc3205be0 con 0x55afc31f7060 2023-09-13T09:44:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc3a8f13b80 10 client.0 _ll_register_callbacks cb 0x55afc30e3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc395d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc3204b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc395d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc3204b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36662/0 (socket says 172.21.15.6:36662) 2023-09-13T09:44:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc39659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc3204610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc395d9b700 1 -- 172.21.15.6:0/2364454318 learned_addr learned my addr 172.21.15.6:0/2364454318 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.839+0000 7fc396d9d700 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc32051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc395d9b700 1 -- 172.21.15.6:0/2364454318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 msgr2=0x55afc32051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc395d9b700 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc32051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc395d9b700 1 -- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 msgr2=0x55afc3204610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc395d9b700 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc3204610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc395d9b700 1 -- 172.21.15.6:0/2364454318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55afc2fc7630 con 0x55afc31f6700 2023-09-13T09:44:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc39659c700 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc3204610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc395d9b700 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc3204b50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc38c015410 tx=0x7fc38c015720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69cea68354f2dfa4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc37dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc37dffb700 1 -- 172.21.15.6:0/2364454318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc38c015de0 con 0x55afc31f6700 2023-09-13T09:44:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc37dffb700 1 -- 172.21.15.6:0/2364454318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc38c016430 con 0x55afc31f6700 2023-09-13T09:44:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc388015aa0 con 0x55afc31f6700 2023-09-13T09:44:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc37dffb700 1 -- 172.21.15.6:0/2364454318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc38c0165f0 con 0x55afc31f6700 2023-09-13T09:44:01.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc3a8f13b80 10 client.16608 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55afc2f5cc60 con 0x55afc31f6700 2023-09-13T09:44:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc37dffb700 1 -- 172.21.15.6:0/2364454318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc388015aa0 con 0x55afc31f6700 2023-09-13T09:44:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.840+0000 7fc37dffb700 1 -- 172.21.15.6:0/2364454318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc38c029870 con 0x55afc31f6700 2023-09-13T09:44:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc3a8f13b80 10 client.16608 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc3a8f13b80 10 client.16608 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:44:01.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc3a8f13b80 20 client.16608 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc325f560 0x55afc3261980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc3a8f13b80 4 client.16608 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55afc3101050 con 0x55afc325f560 2023-09-13T09:44:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc39659c700 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc325f560 0x55afc3261980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:01.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc37dffb700 10 client.16608 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.841+0000 7fc39659c700 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc325f560 0x55afc3261980 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a22210144c20ddd server_cookie=c4711938289c4c2d in_seq=0 out_seq=0 2023-09-13T09:44:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc37dffb700 1 -- 172.21.15.6:0/2364454318 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55afc3101050 con 0x55afc325f560 2023-09-13T09:44:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc37dffb700 10 client.16608 handle_command_reply: tid=0 2023-09-13T09:44:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 client.16608 shutdown 2023-09-13T09:44:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 msgr2=0x55afc3204b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc3204b50 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fc38c015410 tx=0x7fc38c015720 comp rx=0 tx=0).stop 2023-09-13T09:44:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 shutdown_connections 2023-09-13T09:44:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55afc325f560 0x55afc3261980 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55afc31f7060 0x55afc32051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55afc31f5a00 0x55afc3204610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 --2- 172.21.15.6:0/2364454318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55afc31f6700 0x55afc3204b50 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc37dffb700 0 client.16608 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 >> 172.21.15.6:0/2364454318 conn(0x55afc3153c80 msgr2=0x55afc31fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 shutdown_connections 2023-09-13T09:44:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 1 -- 172.21.15.6:0/2364454318 wait complete. 2023-09-13T09:44:01.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc3a8f13b80 20 client.16608 trim_cache size 0 max 16384 2023-09-13T09:44:01.868 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:01.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3800a06c0 msgr2=0x7fc3800a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3800a06c0 0x7fc3800a2b80 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc3981981e0 tx=0x7fc388009190 comp rx=0 tx=0).stop 2023-09-13T09:44:01.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 msgr2=0x7fc39819e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.842+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc39819e280 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fc390007a00 tx=0x7fc3900094c0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 shutdown_connections 2023-09-13T09:44:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc3800a06c0 0x7fc3800a2b80 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc398102910 0x7fc39819e280 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc398100d80 0x7fc398196d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 --2- 172.21.15.6:0/3881467563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc398101f70 0x7fc398197250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 >> 172.21.15.6:0/3881467563 conn(0x7fc3980fc310 msgr2=0x7fc3981054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 shutdown_connections 2023-09-13T09:44:01.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.843+0000 7fc39cd2e700 1 -- 172.21.15.6:0/3881467563 wait complete. 2023-09-13T09:44:01.872 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:44:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 -- 172.21.15.6:0/3702253136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f84100eb0 msgr2=0x7f8f84101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 --2- 172.21.15.6:0/3702253136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f84100eb0 0x7f8f84101310 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f8f780099c0 tx=0x7f8f78009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 -- 172.21.15.6:0/3702253136 shutdown_connections 2023-09-13T09:44:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 --2- 172.21.15.6:0/3702253136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f84101850 0x7f8f84108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 --2- 172.21.15.6:0/3702253136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f840ffcc0 0x7f8f841000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 --2- 172.21.15.6:0/3702253136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f84100eb0 0x7f8f84101310 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 -- 172.21.15.6:0/3702253136 >> 172.21.15.6:0/3702253136 conn(0x7f8f840fb250 msgr2=0x7f8f840fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 -- 172.21.15.6:0/3702253136 shutdown_connections 2023-09-13T09:44:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.998+0000 7f8f8c033700 1 -- 172.21.15.6:0/3702253136 wait complete. 2023-09-13T09:44:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 Processor -- start 2023-09-13T09:44:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 -- start start 2023-09-13T09:44:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f840ffcc0 0x7f8f84196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f84100eb0 0x7f8f84196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f84101850 0x7f8f8419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8419e5e0 con 0x7f8f840ffcc0 2023-09-13T09:44:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8419e720 con 0x7f8f84100eb0 2023-09-13T09:44:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f8c033700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f8419e8b0 con 0x7f8f84101850 2023-09-13T09:44:02.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f840ffcc0 0x7f8f84196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f840ffcc0 0x7f8f84196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36674/0 (socket says 172.21.15.6:36674) 2023-09-13T09:44:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 -- 172.21.15.6:0/2025043200 learned_addr learned my addr 172.21.15.6:0/2025043200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 -- 172.21.15.6:0/2025043200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f84101850 msgr2=0x7f8f8419e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f84101850 0x7f8f8419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 -- 172.21.15.6:0/2025043200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f84100eb0 msgr2=0x7f8f84196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f895ce700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f84100eb0 0x7f8f84196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f84100eb0 0x7f8f84196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:01.999+0000 7f8f89dcf700 1 -- 172.21.15.6:0/2025043200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780095f0 con 0x7f8f840ffcc0 2023-09-13T09:44:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.000+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f840ffcc0 0x7f8f84196a60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e970 tx=0x7f8f8000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.000+0000 7f8f76ffd700 1 -- 172.21.15.6:0/2025043200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80009790 con 0x7f8f840ffcc0 2023-09-13T09:44:02.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.000+0000 7f8f76ffd700 1 -- 172.21.15.6:0/2025043200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f800044e0 con 0x7f8f840ffcc0 2023-09-13T09:44:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.000+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f8419eb90 con 0x7f8f840ffcc0 2023-09-13T09:44:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.000+0000 7f8f76ffd700 1 -- 172.21.15.6:0/2025043200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80003e30 con 0x7f8f840ffcc0 2023-09-13T09:44:02.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.000+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f8419f0a0 con 0x7f8f840ffcc0 2023-09-13T09:44:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 Processor -- start 2023-09-13T09:44:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 -- start start 2023-09-13T09:44:02.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382ab10 0x55ee4382af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 0x55ee438298d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee4382a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4377e780 con 0x55ee43829e10 2023-09-13T09:44:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4377c0a0 con 0x55ee4382ab10 2023-09-13T09:44:02.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f98218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43777990 con 0x55ee4382b470 2023-09-13T09:44:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f8a5d0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382ab10 0x55ee4382af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f895ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee4382a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f8a5d0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382ab10 0x55ee4382af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58436/0 (socket says 172.21.15.6:58436) 2023-09-13T09:44:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f8a5d0700 1 -- 172.21.15.6:0/3375477114 learned_addr learned my addr 172.21.15.6:0/3375477114 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f895ce700 1 -- 172.21.15.6:0/3375477114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 msgr2=0x55ee438298d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:44:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f895ce700 1 --2- 172.21.15.6:0/3375477114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 0x55ee438298d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f895ce700 1 -- 172.21.15.6:0/3375477114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382ab10 msgr2=0x55ee4382af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f895ce700 1 --2- 172.21.15.6:0/3375477114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382ab10 0x55ee4382af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f895ce700 1 -- 172.21.15.6:0/3375477114 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee435f7630 con 0x55ee43829e10 2023-09-13T09:44:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f895ce700 1 --2- 172.21.15.6:0/3375477114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee4382a270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8f78004800 tx=0x7f8f78005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df0f67bd5c903cc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f6ffff700 1 -- 172.21.15.6:0/3375477114 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7801c040 con 0x55ee43829e10 2023-09-13T09:44:02.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f6ffff700 1 -- 172.21.15.6:0/3375477114 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f7800f460 con 0x55ee43829e10 2023-09-13T09:44:02.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.004+0000 7f8f6ffff700 1 -- 172.21.15.6:0/3375477114 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f78022650 con 0x55ee43829e10 2023-09-13T09:44:02.013 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:01 smithi006 ceph-mon[98665]: pgmap v435: 97 pgs: 97 active+clean; 69 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 470 KiB/s wr, 49 op/s 2023-09-13T09:44:02.014 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:01 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1188217817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:44:02.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f76ffd700 1 -- 172.21.15.6:0/2025043200 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8f80003fd0 con 0x7f8f840ffcc0 2023-09-13T09:44:02.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 -- 172.21.15.6:0/3375477114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 msgr2=0x55ee4382a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 --2- 172.21.15.6:0/3375477114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee4382a270 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8f78004800 tx=0x7f8f78005f00 comp rx=0 tx=0).stop 2023-09-13T09:44:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 -- 172.21.15.6:0/3375477114 shutdown_connections 2023-09-13T09:44:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 --2- 172.21.15.6:0/3375477114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee4382a270 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 --2- 172.21.15.6:0/3375477114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382ab10 0x55ee4382af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 --2- 172.21.15.6:0/3375477114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 0x55ee438298d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 -- 172.21.15.6:0/3375477114 >> 172.21.15.6:0/3375477114 conn(0x55ee43783c80 msgr2=0x55ee4381ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 -- 172.21.15.6:0/3375477114 shutdown_connections 2023-09-13T09:44:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.005+0000 7f8f98218b80 1 -- 172.21.15.6:0/3375477114 wait complete. 2023-09-13T09:44:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f76ffd700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f700a0550 0x7f8f700a2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 -- start start 2023-09-13T09:44:02.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f8a5d0700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f700a0550 0x7f8f700a2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f76ffd700 1 -- 172.21.15.6:0/2025043200 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f80014070 con 0x7f8f840ffcc0 2023-09-13T09:44:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 Processor -- start 2023-09-13T09:44:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f8a5d0700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f700a0550 0x7f8f700a2a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009690 tx=0x7f8f7c009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee43833300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43833840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee4383a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43715bb0 con 0x55ee43829e10 2023-09-13T09:44:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee437158b0 con 0x55ee4382b470 2023-09-13T09:44:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee435f9920 con 0x55ee4382ab10 2023-09-13T09:44:02.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f98218b80 10 client.0 _ll_register_callbacks cb 0x55ee43713680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.006+0000 7f8f89dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee43833300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee43833300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36688/0 (socket says 172.21.15.6:36688) 2023-09-13T09:44:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 -- 172.21.15.6:0/4191568261 learned_addr learned my addr 172.21.15.6:0/4191568261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f895ce700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43833840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f8a5d0700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee4383a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 -- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 msgr2=0x55ee43833840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43833840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 -- 172.21.15.6:0/4191568261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 msgr2=0x55ee4383a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee4383a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 -- 172.21.15.6:0/4191568261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f84108a50 con 0x55ee43829e10 2023-09-13T09:44:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f895ce700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43833840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee43833300 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8f80099460 tx=0x7f8f80099350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e9c6ea685d7e2bd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/4191568261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f80099e60 con 0x55ee43829e10 2023-09-13T09:44:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/4191568261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f80099760 con 0x55ee43829e10 2023-09-13T09:44:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee43818670 con 0x55ee43829e10 2023-09-13T09:44:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/4191568261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f8009d590 con 0x55ee43829e10 2023-09-13T09:44:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f98218b80 10 client.16620 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.007+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ee4378f7a0 con 0x55ee43829e10 2023-09-13T09:44:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/4191568261 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f80063020 con 0x55ee43829e10 2023-09-13T09:44:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/4191568261 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f8009d200 con 0x55ee43829e10 2023-09-13T09:44:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f98218b80 10 client.16620 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f98218b80 10 client.16620 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:44:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f98218b80 20 client.16620 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f98218b80 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee4383f110 0x55ee43841530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f98218b80 4 client.16620 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee43770970 con 0x55ee4383f110 2023-09-13T09:44:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.008+0000 7f8f895ce700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee4383f110 0x55ee43841530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.009+0000 7f8f6d7fa700 10 client.16620 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.009+0000 7f8f895ce700 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee4383f110 0x55ee43841530 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6464cfb69b701d7a server_cookie=fc20f15dbd0f02d in_seq=0 out_seq=0 2023-09-13T09:44:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.009+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/4191568261 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee43770970 con 0x55ee4383f110 2023-09-13T09:44:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.009+0000 7f8f6d7fa700 10 client.16620 handle_command_reply: tid=0 2023-09-13T09:44:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.009+0000 7f8f98218b80 1 client.16620 shutdown 2023-09-13T09:44:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 msgr2=0x55ee43833300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee43833300 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f8f80099460 tx=0x7f8f80099350 comp rx=0 tx=0).stop 2023-09-13T09:44:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 shutdown_connections 2023-09-13T09:44:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee4383f110 0x55ee43841530 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee4383a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee43833300 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 --2- 172.21.15.6:0/4191568261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43833840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f6d7fa700 0 client.16620 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 >> 172.21.15.6:0/4191568261 conn(0x55ee43783c80 msgr2=0x55ee4381fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 shutdown_connections 2023-09-13T09:44:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 1 -- 172.21.15.6:0/4191568261 wait complete. 2023-09-13T09:44:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.010+0000 7f8f98218b80 20 client.16620 trim_cache size 0 max 16384 2023-09-13T09:44:02.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 Processor -- start 2023-09-13T09:44:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 -- start start 2023-09-13T09:44:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee43829e10 0x55ee43831fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee4382ab10 0x55ee4383a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 0x55ee4382dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43830f80 con 0x55ee4382ab10 2023-09-13T09:44:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43820d70 con 0x55ee43829e10 2023-09-13T09:44:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f98218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4382e890 con 0x55ee4382b470 2023-09-13T09:44:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee4382ab10 0x55ee4383a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee4382ab10 0x55ee4383a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36696/0 (socket says 172.21.15.6:36696) 2023-09-13T09:44:02.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 -- 172.21.15.6:0/2379690245 learned_addr learned my addr 172.21.15.6:0/2379690245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee43829e10 0x55ee43831fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f8a5d0700 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 0x55ee4382dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 -- 172.21.15.6:0/2379690245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 msgr2=0x55ee4382dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 0x55ee4382dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 -- 172.21.15.6:0/2379690245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee43829e10 msgr2=0x55ee43831fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee43829e10 0x55ee43831fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 -- 172.21.15.6:0/2379690245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee435a3de0 con 0x55ee4382ab10 2023-09-13T09:44:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.023+0000 7f8f895ce700 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee4382ab10 0x55ee4383a840 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8f78004800 tx=0x7f8f78009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f74043335eee80 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f74ff9700 1 -- 172.21.15.6:0/2379690245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7801c040 con 0x55ee4382ab10 2023-09-13T09:44:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f74ff9700 1 -- 172.21.15.6:0/2379690245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f7800f5d0 con 0x55ee4382ab10 2023-09-13T09:44:02.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f74ff9700 1 -- 172.21.15.6:0/2379690245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f7802c760 con 0x55ee4382ab10 2023-09-13T09:44:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 -- 172.21.15.6:0/2379690245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee4382ab10 msgr2=0x55ee4383a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee4382ab10 0x55ee4383a840 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8f78004800 tx=0x7f8f78009fd0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 -- 172.21.15.6:0/2379690245 shutdown_connections 2023-09-13T09:44:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382b470 0x55ee4382dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee43829e10 0x55ee43831fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 --2- 172.21.15.6:0/2379690245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee4382ab10 0x55ee4383a840 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 -- 172.21.15.6:0/2379690245 >> 172.21.15.6:0/2379690245 conn(0x55ee43783c80 msgr2=0x55ee4381fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 -- 172.21.15.6:0/2379690245 shutdown_connections 2023-09-13T09:44:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.024+0000 7f8f98218b80 1 -- 172.21.15.6:0/2379690245 wait complete. 2023-09-13T09:44:02.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 -- start start 2023-09-13T09:44:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 Processor -- start 2023-09-13T09:44:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee438389e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43838f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee438395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43839c80 con 0x55ee43829e10 2023-09-13T09:44:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43839df0 con 0x55ee4382b470 2023-09-13T09:44:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee43839fb0 con 0x55ee4382ab10 2023-09-13T09:44:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f98218b80 10 client.0 _ll_register_callbacks cb 0x55ee43713680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f89dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee438389e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f89dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee438389e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36700/0 (socket says 172.21.15.6:36700) 2023-09-13T09:44:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f89dcf700 1 -- 172.21.15.6:0/1857355449 learned_addr learned my addr 172.21.15.6:0/1857355449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f8a5d0700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee438395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f895ce700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43838f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f89dcf700 1 -- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 msgr2=0x55ee43838f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.025+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43838f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f89dcf700 1 -- 172.21.15.6:0/1857355449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 msgr2=0x55ee438395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee438395a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f89dcf700 1 -- 172.21.15.6:0/1857355449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee435f7630 con 0x55ee43829e10 2023-09-13T09:44:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f8a5d0700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee438395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f895ce700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43838f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:02.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f89dcf700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee438389e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8f80097ab0 tx=0x7f8f80003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98e9deda60a6a30e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f6d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:02.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/1857355449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f800a15a0 con 0x55ee43829e10 2023-09-13T09:44:02.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/1857355449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f80064080 con 0x55ee43829e10 2023-09-13T09:44:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f7800f460 con 0x55ee43829e10 2023-09-13T09:44:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/1857355449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f80099e60 con 0x55ee43829e10 2023-09-13T09:44:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 10 client.16626 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ee4358cc60 con 0x55ee43829e10 2023-09-13T09:44:02.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/1857355449 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f7800f460 con 0x55ee43829e10 2023-09-13T09:44:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/1857355449 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f800652b0 con 0x55ee43829e10 2023-09-13T09:44:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 10 client.16626 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 10 client.16626 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:44:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 20 client.16626 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee438935d0 0x55ee438959f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 4 client.16626 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.026+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ee43731050 con 0x55ee438935d0 2023-09-13T09:44:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f895ce700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee438935d0 0x55ee438959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f6d7fa700 10 client.16626 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f895ce700 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee438935d0 0x55ee438959f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9f52cc6aec8c46e6 server_cookie=429f901a68de4073 in_seq=0 out_seq=0 2023-09-13T09:44:02.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f6d7fa700 1 -- 172.21.15.6:0/1857355449 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ee43731050 con 0x55ee438935d0 2023-09-13T09:44:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f6d7fa700 10 client.16626 handle_command_reply: tid=0 2023-09-13T09:44:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f98218b80 1 client.16626 shutdown 2023-09-13T09:44:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 msgr2=0x55ee438389e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.027+0000 7f8f98218b80 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee438389e0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f8f80097ab0 tx=0x7f8f80003890 comp rx=0 tx=0).stop 2023-09-13T09:44:02.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 shutdown_connections 2023-09-13T09:44:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ee438935d0 0x55ee438959f0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee4382b470 0x55ee438395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee43829e10 0x55ee438389e0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f6d7fa700 0 client.16626 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:02.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 --2- 172.21.15.6:0/1857355449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee4382ab10 0x55ee43838f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 >> 172.21.15.6:0/1857355449 conn(0x55ee43783c80 msgr2=0x55ee43831fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 shutdown_connections 2023-09-13T09:44:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 1 -- 172.21.15.6:0/1857355449 wait complete. 2023-09-13T09:44:02.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f98218b80 20 client.16626 trim_cache size 0 max 16384 2023-09-13T09:44:02.055 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f700a0550 msgr2=0x7f8f700a2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f700a0550 0x7f8f700a2a10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009690 tx=0x7f8f7c009040 comp rx=0 tx=0).stop 2023-09-13T09:44:02.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f840ffcc0 msgr2=0x7f8f84196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f840ffcc0 0x7f8f84196a60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000e970 tx=0x7f8f8000ed30 comp rx=0 tx=0).stop 2023-09-13T09:44:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 shutdown_connections 2023-09-13T09:44:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f84101850 0x7f8f8419e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f700a0550 0x7f8f700a2a10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f840ffcc0 0x7f8f84196a60 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 --2- 172.21.15.6:0/2025043200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f84100eb0 0x7f8f84196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 >> 172.21.15.6:0/2025043200 conn(0x7f8f840fb250 msgr2=0x7f8f84068070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 shutdown_connections 2023-09-13T09:44:02.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.028+0000 7f8f8c033700 1 -- 172.21.15.6:0/2025043200 wait complete. 2023-09-13T09:44:02.059 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:44:02.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 131970 2.56 MB/sec execute 82 sec latency 3039.962 ms 2023-09-13T09:44:02.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.186+0000 7f238f1c0700 1 -- 172.21.15.6:0/1043110423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2388101850 msgr2=0x7f2388108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.186+0000 7f238f1c0700 1 --2- 172.21.15.6:0/1043110423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2388101850 0x7f2388108100 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f238000b0d0 tx=0x7f238000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- 172.21.15.6:0/1043110423 shutdown_connections 2023-09-13T09:44:02.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 --2- 172.21.15.6:0/1043110423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2388101850 0x7f2388108100 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 --2- 172.21.15.6:0/1043110423 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23880ffcc0 0x7f23881000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 --2- 172.21.15.6:0/1043110423 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2388100eb0 0x7f2388101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- 172.21.15.6:0/1043110423 >> 172.21.15.6:0/1043110423 conn(0x7f23880fb250 msgr2=0x7f23880fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- 172.21.15.6:0/1043110423 shutdown_connections 2023-09-13T09:44:02.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- 172.21.15.6:0/1043110423 wait complete. 2023-09-13T09:44:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 Processor -- start 2023-09-13T09:44:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- start start 2023-09-13T09:44:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23880ffcc0 0x7f2388068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2388100eb0 0x7f238819b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2388101850 0x7f238819dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238819e6b0 con 0x7f23880ffcc0 2023-09-13T09:44:02.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238819e820 con 0x7f2388100eb0 2023-09-13T09:44:02.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238f1c0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f238819e9e0 con 0x7f2388101850 2023-09-13T09:44:02.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.187+0000 7f238cf5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23880ffcc0 0x7f2388068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23880ffcc0 0x7f2388068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36714/0 (socket says 172.21.15.6:36714) 2023-09-13T09:44:02.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 -- 172.21.15.6:0/3650419799 learned_addr learned my addr 172.21.15.6:0/3650419799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f2387fff700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2388100eb0 0x7f238819b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238d75d700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2388101850 0x7f238819dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 -- 172.21.15.6:0/3650419799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2388101850 msgr2=0x7f238819dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2388101850 0x7f238819dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 -- 172.21.15.6:0/3650419799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2388100eb0 msgr2=0x7f238819b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2388100eb0 0x7f238819b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 -- 172.21.15.6:0/3650419799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380009d00 con 0x7f23880ffcc0 2023-09-13T09:44:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238cf5c700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23880ffcc0 0x7f2388068b40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f237c00d980 tx=0x7f237c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f2385ffb700 1 -- 172.21.15.6:0/3650419799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c004020 con 0x7f23880ffcc0 2023-09-13T09:44:02.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f2385ffb700 1 -- 172.21.15.6:0/3650419799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f237c00f690 con 0x7f23880ffcc0 2023-09-13T09:44:02.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f238819ecc0 con 0x7f23880ffcc0 2023-09-13T09:44:02.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f2385ffb700 1 -- 172.21.15.6:0/3650419799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c003a60 con 0x7f23880ffcc0 2023-09-13T09:44:02.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.188+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f238819f1d0 con 0x7f23880ffcc0 2023-09-13T09:44:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.191+0000 7f2385ffb700 1 -- 172.21.15.6:0/3650419799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f237c00fb00 con 0x7f23880ffcc0 2023-09-13T09:44:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.191+0000 7f2385ffb700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f23780a06c0 0x7f23780a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.192+0000 7f2385ffb700 1 -- 172.21.15.6:0/3650419799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f237c0cb720 con 0x7f23880ffcc0 2023-09-13T09:44:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.192+0000 7f2387fff700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f23780a06c0 0x7f23780a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.192+0000 7f2387fff700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f23780a06c0 0x7f23780a2b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f23880688b0 tx=0x7f2374009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.192+0000 7f239b3a5b80 1 Processor -- start 2023-09-13T09:44:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.192+0000 7f239b3a5b80 1 -- start start 2023-09-13T09:44:02.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6d9eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d9d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6d9de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6cf6780 con 0x5621b6d9da00 2023-09-13T09:44:02.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6cf40a0 con 0x5621b6d9f060 2023-09-13T09:44:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6cef990 con 0x5621b6d9e700 2023-09-13T09:44:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6d9de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6d9de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36726/0 (socket says 172.21.15.6:36726) 2023-09-13T09:44:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 -- 172.21.15.6:0/1511800454 learned_addr learned my addr 172.21.15.6:0/1511800454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238cf5c700 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6d9eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f2387fff700 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d9d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 -- 172.21.15.6:0/1511800454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 msgr2=0x5621b6d9eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6d9eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 -- 172.21.15.6:0/1511800454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 msgr2=0x5621b6d9d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d9d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 -- 172.21.15.6:0/1511800454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621b6b6f630 con 0x5621b6d9da00 2023-09-13T09:44:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f238d75d700 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6d9de80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2380005aa0 tx=0x7f2380009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0bfe43749432109 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.193+0000 7f2372ffd700 1 -- 172.21.15.6:0/1511800454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238000e040 con 0x5621b6d9da00 2023-09-13T09:44:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f2372ffd700 1 -- 172.21.15.6:0/1511800454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2380009460 con 0x5621b6d9da00 2023-09-13T09:44:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f2372ffd700 1 -- 172.21.15.6:0/1511800454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23800052d0 con 0x5621b6d9da00 2023-09-13T09:44:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 -- 172.21.15.6:0/1511800454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 msgr2=0x5621b6d9de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6d9de80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f2380005aa0 tx=0x7f2380009c90 comp rx=0 tx=0).stop 2023-09-13T09:44:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 -- 172.21.15.6:0/1511800454 shutdown_connections 2023-09-13T09:44:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6d9de80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6d9eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/1511800454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d9d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 -- 172.21.15.6:0/1511800454 >> 172.21.15.6:0/1511800454 conn(0x5621b6cfbc80 msgr2=0x5621b6d97f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 -- 172.21.15.6:0/1511800454 shutdown_connections 2023-09-13T09:44:02.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.194+0000 7f239b3a5b80 1 -- 172.21.15.6:0/1511800454 wait complete. 2023-09-13T09:44:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 -- start start 2023-09-13T09:44:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 Processor -- start 2023-09-13T09:44:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6da6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6da7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dae3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6c8dbb0 con 0x5621b6d9da00 2023-09-13T09:44:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6c8d8b0 con 0x5621b6d9f060 2023-09-13T09:44:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6b71920 con 0x5621b6d9e700 2023-09-13T09:44:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f239b3a5b80 10 client.0 _ll_register_callbacks cb 0x5621b6c8b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:02.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f238cf5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6da6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f238cf5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6da6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36728/0 (socket says 172.21.15.6:36728) 2023-09-13T09:44:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f238cf5c700 1 -- 172.21.15.6:0/3297683629 learned_addr learned my addr 172.21.15.6:0/3297683629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.195+0000 7f2387fff700 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6da7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f238d75d700 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dae3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f238cf5c700 1 -- 172.21.15.6:0/3297683629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 msgr2=0x5621b6da7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f238cf5c700 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6da7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f238cf5c700 1 -- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 msgr2=0x5621b6dae3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f238cf5c700 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dae3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f238cf5c700 1 -- 172.21.15.6:0/3297683629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2388108a50 con 0x5621b6d9da00 2023-09-13T09:44:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f238cf5c700 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6da6e40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f237c00be80 tx=0x7f237c0995c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a48c7ac3764ef0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f2367fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f2367fff700 1 -- 172.21.15.6:0/3297683629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c099320 con 0x5621b6d9da00 2023-09-13T09:44:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f2367fff700 1 -- 172.21.15.6:0/3297683629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f237c0a0f30 con 0x5621b6d9da00 2023-09-13T09:44:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621b6d90670 con 0x5621b6d9da00 2023-09-13T09:44:02.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f2367fff700 1 -- 172.21.15.6:0/3297683629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f237c0983b0 con 0x5621b6d9da00 2023-09-13T09:44:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f239b3a5b80 10 client.16638 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5621b6d077a0 con 0x5621b6d9da00 2023-09-13T09:44:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.196+0000 7f2367fff700 1 -- 172.21.15.6:0/3297683629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5621b6d90670 con 0x5621b6d9da00 2023-09-13T09:44:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f2367fff700 1 -- 172.21.15.6:0/3297683629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f237c0a0bc0 con 0x5621b6d9da00 2023-09-13T09:44:02.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f239b3a5b80 10 client.16638 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f239b3a5b80 10 client.16638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f239b3a5b80 20 client.16638 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6db4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f239b3a5b80 4 client.16638 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:02.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621b6ce8970 con 0x5621b6db29b0 2023-09-13T09:44:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f2387fff700 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6db4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f2387fff700 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6db4dd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d71684eeb28c2734 server_cookie=6595ce6805ee9282 in_seq=0 out_seq=0 2023-09-13T09:44:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.197+0000 7f2367fff700 10 client.16638 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:02.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f2367fff700 1 -- 172.21.15.6:0/3297683629 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5621b6ce8970 con 0x5621b6db29b0 2023-09-13T09:44:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f2367fff700 10 client.16638 handle_command_reply: tid=0 2023-09-13T09:44:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 client.16638 shutdown 2023-09-13T09:44:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 msgr2=0x5621b6da6e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6da6e40 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f237c00be80 tx=0x7f237c0995c0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 shutdown_connections 2023-09-13T09:44:02.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dae3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6db4dd0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6da6e40 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f2367fff700 0 client.16638 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3297683629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6da7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 >> 172.21.15.6:0/3297683629 conn(0x5621b6cfbc80 msgr2=0x5621b6d97ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 shutdown_connections 2023-09-13T09:44:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3297683629 wait complete. 2023-09-13T09:44:02.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.198+0000 7f239b3a5b80 20 client.16638 trim_cache size 0 max 16384 2023-09-13T09:44:02.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 Processor -- start 2023-09-13T09:44:02.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 -- start start 2023-09-13T09:44:02.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9da00 0x5621b6d9d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9e700 0x5621b6dae380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d97e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6db2740 con 0x5621b6d9e700 2023-09-13T09:44:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6da5580 con 0x5621b6d9f060 2023-09-13T09:44:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6d983a0 con 0x5621b6d9da00 2023-09-13T09:44:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f2387fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9e700 0x5621b6dae380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f2387fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9e700 0x5621b6dae380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36738/0 (socket says 172.21.15.6:36738) 2023-09-13T09:44:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.211+0000 7f2387fff700 1 -- 172.21.15.6:0/3647703200 learned_addr learned my addr 172.21.15.6:0/3647703200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f238d75d700 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d97e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f238cf5c700 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9da00 0x5621b6d9d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f2387fff700 1 -- 172.21.15.6:0/3647703200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9da00 msgr2=0x5621b6d9d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f2387fff700 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9da00 0x5621b6d9d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f2387fff700 1 -- 172.21.15.6:0/3647703200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 msgr2=0x5621b6d97e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f2387fff700 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d97e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f2387fff700 1 -- 172.21.15.6:0/3647703200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621b6b1bde0 con 0x5621b6d9e700 2023-09-13T09:44:02.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f2387fff700 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9e700 0x5621b6dae380 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2374011ca0 tx=0x7f2374014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a01864d8c37473 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f23737fe700 1 -- 172.21.15.6:0/3647703200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374023040 con 0x5621b6d9e700 2023-09-13T09:44:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f23737fe700 1 -- 172.21.15.6:0/3647703200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2374027d50 con 0x5621b6d9e700 2023-09-13T09:44:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.212+0000 7f23737fe700 1 -- 172.21.15.6:0/3647703200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374027730 con 0x5621b6d9e700 2023-09-13T09:44:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3647703200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9e700 msgr2=0x5621b6dae380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9e700 0x5621b6dae380 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f2374011ca0 tx=0x7f2374014000 comp rx=0 tx=0).stop 2023-09-13T09:44:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3647703200 shutdown_connections 2023-09-13T09:44:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6d97e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9da00 0x5621b6d9d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/3647703200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9e700 0x5621b6dae380 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3647703200 >> 172.21.15.6:0/3647703200 conn(0x5621b6cfbc80 msgr2=0x5621b6d98810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3647703200 shutdown_connections 2023-09-13T09:44:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- 172.21.15.6:0/3647703200 wait complete. 2023-09-13T09:44:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- start start 2023-09-13T09:44:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 Processor -- start 2023-09-13T09:44:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6daa5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6daaaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6dadbf0 con 0x5621b6d9da00 2023-09-13T09:44:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6dadd60 con 0x5621b6d9f060 2023-09-13T09:44:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621b6dadf20 con 0x5621b6d9e700 2023-09-13T09:44:02.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f239b3a5b80 10 client.0 _ll_register_callbacks cb 0x5621b6c8b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.213+0000 7f238cf5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6daa5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6daa5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36742/0 (socket says 172.21.15.6:36742) 2023-09-13T09:44:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 -- 172.21.15.6:0/2942745252 learned_addr learned my addr 172.21.15.6:0/2942745252 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238d75d700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f2387fff700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6daaaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 -- 172.21.15.6:0/2942745252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 msgr2=0x5621b6daaaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6daaaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 -- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 msgr2=0x5621b6dad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 -- 172.21.15.6:0/2942745252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2374017070 con 0x5621b6d9da00 2023-09-13T09:44:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f2387fff700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6daaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f238cf5c700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6daa5b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f237c0a0a00 tx=0x7f237c098660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d95d934bb94844 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f2367fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f2367fff700 1 -- 172.21.15.6:0/2942745252 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237c099630 con 0x5621b6d9da00 2023-09-13T09:44:02.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f2367fff700 1 -- 172.21.15.6:0/2942745252 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f237c005720 con 0x5621b6d9da00 2023-09-13T09:44:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2380009460 con 0x5621b6d9da00 2023-09-13T09:44:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f2367fff700 1 -- 172.21.15.6:0/2942745252 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f237c095200 con 0x5621b6d9da00 2023-09-13T09:44:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f239b3a5b80 10 client.16644 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5621b6b04c60 con 0x5621b6d9da00 2023-09-13T09:44:02.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.214+0000 7f2367fff700 1 -- 172.21.15.6:0/2942745252 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2380009460 con 0x5621b6d9da00 2023-09-13T09:44:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f2367fff700 1 -- 172.21.15.6:0/2942745252 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f237c094d00 con 0x5621b6d9da00 2023-09-13T09:44:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 10 client.16644 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 10 client.16644 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 20 client.16644 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:02.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6e09390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 4 client.16644 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5621b6ca9050 con 0x5621b6db29b0 2023-09-13T09:44:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f2387fff700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6e09390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f2367fff700 10 client.16644 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f2387fff700 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6e09390 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb055d552e533cc7 server_cookie=4d8f266f2c0d3f3d in_seq=0 out_seq=0 2023-09-13T09:44:02.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f2367fff700 1 -- 172.21.15.6:0/2942745252 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5621b6ca9050 con 0x5621b6db29b0 2023-09-13T09:44:02.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f2367fff700 10 client.16644 handle_command_reply: tid=0 2023-09-13T09:44:02.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 1 client.16644 shutdown 2023-09-13T09:44:02.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 msgr2=0x5621b6daa5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.215+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6daa5b0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f237c0a0a00 tx=0x7f237c098660 comp rx=0 tx=0).stop 2023-09-13T09:44:02.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 shutdown_connections 2023-09-13T09:44:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5621b6d9f060 0x5621b6dad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5621b6db29b0 0x5621b6e09390 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5621b6d9da00 0x5621b6daa5b0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f2367fff700 0 client.16644 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:02.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 --2- 172.21.15.6:0/2942745252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621b6d9e700 0x5621b6daaaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 >> 172.21.15.6:0/2942745252 conn(0x5621b6cfbc80 msgr2=0x5621b6da18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 shutdown_connections 2023-09-13T09:44:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 1 -- 172.21.15.6:0/2942745252 wait complete. 2023-09-13T09:44:02.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f239b3a5b80 20 client.16644 trim_cache size 0 max 16384 2023-09-13T09:44:02.244 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f23780a06c0 msgr2=0x7f23780a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f23780a06c0 0x7f23780a2b80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f23880688b0 tx=0x7f2374009260 comp rx=0 tx=0).stop 2023-09-13T09:44:02.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23880ffcc0 msgr2=0x7f2388068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23880ffcc0 0x7f2388068b40 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f237c00d980 tx=0x7f237c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:44:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 shutdown_connections 2023-09-13T09:44:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2388101850 0x7f238819dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f23780a06c0 0x7f23780a2b80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23880ffcc0 0x7f2388068b40 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 --2- 172.21.15.6:0/3650419799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2388100eb0 0x7f238819b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 >> 172.21.15.6:0/3650419799 conn(0x7f23880fb250 msgr2=0x7f23880fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 shutdown_connections 2023-09-13T09:44:02.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:02.216+0000 7f238f1c0700 1 -- 172.21.15.6:0/3650419799 wait complete. 2023-09-13T09:44:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:01 smithi053 ceph-mon[102373]: pgmap v435: 97 pgs: 97 active+clean; 69 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 470 KiB/s wr, 49 op/s 2023-09-13T09:44:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:01 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1188217817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:44:02.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:01 smithi131 ceph-mon[102785]: pgmap v435: 97 pgs: 97 active+clean; 69 MiB data, 782 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 470 KiB/s wr, 49 op/s 2023-09-13T09:44:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:01 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1188217817' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:44:03.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 131999 2.53 MB/sec execute 83 sec latency 976.958 ms 2023-09-13T09:44:03.249 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:44:03.249 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:44:03.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 -- 172.21.15.6:0/2538593932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 msgr2=0x7fbb101091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 --2- 172.21.15.6:0/2538593932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb101091b0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fbb0800b0d0 tx=0x7fbb0800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 -- 172.21.15.6:0/2538593932 shutdown_connections 2023-09-13T09:44:03.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 --2- 172.21.15.6:0/2538593932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb101091b0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 --2- 172.21.15.6:0/2538593932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb10100d70 0x7fbb10101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 --2- 172.21.15.6:0/2538593932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb10101f60 0x7fbb101023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 -- 172.21.15.6:0/2538593932 >> 172.21.15.6:0/2538593932 conn(0x7fbb100fc2e0 msgr2=0x7fbb100fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 -- 172.21.15.6:0/2538593932 shutdown_connections 2023-09-13T09:44:03.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.394+0000 7fbb14860700 1 -- 172.21.15.6:0/2538593932 wait complete. 2023-09-13T09:44:03.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 Processor -- start 2023-09-13T09:44:03.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 -- start start 2023-09-13T09:44:03.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb10100d70 0x7fbb10196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb10101f60 0x7fbb10197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb1019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1019e6a0 con 0x7fbb10102900 2023-09-13T09:44:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1019e7e0 con 0x7fbb10101f60 2023-09-13T09:44:03.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb14860700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1019e970 con 0x7fbb10100d70 2023-09-13T09:44:03.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb1019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb1019e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36760/0 (socket says 172.21.15.6:36760) 2023-09-13T09:44:03.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/2958339853 learned_addr learned my addr 172.21.15.6:0/2958339853 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb10101f60 0x7fbb10197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.395+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb10100d70 0x7fbb10196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/2958339853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb10100d70 msgr2=0x7fbb10196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb10100d70 0x7fbb10196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/2958339853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb10101f60 msgr2=0x7fbb10197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb10101f60 0x7fbb10197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/2958339853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009d00 con 0x7fbb10102900 2023-09-13T09:44:03.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb10100d70 0x7fbb10196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:03.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb1019e0d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbb08007a00 tx=0x7fbb080094c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb077fe700 1 -- 172.21.15.6:0/2958339853 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0800e040 con 0x7fbb10102900 2023-09-13T09:44:03.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb1019ebf0 con 0x7fbb10102900 2023-09-13T09:44:03.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb077fe700 1 -- 172.21.15.6:0/2958339853 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb08003e10 con 0x7fbb10102900 2023-09-13T09:44:03.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb077fe700 1 -- 172.21.15.6:0/2958339853 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb08012a90 con 0x7fbb10102900 2023-09-13T09:44:03.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.396+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb1019f070 con 0x7fbb10102900 2023-09-13T09:44:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.398+0000 7fbb077fe700 1 -- 172.21.15.6:0/2958339853 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbb080056c0 con 0x7fbb10102900 2023-09-13T09:44:03.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.399+0000 7fbb077fe700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbafc0a0640 0x7fbafc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.399+0000 7fbb077fe700 1 -- 172.21.15.6:0/2958339853 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbb080cd290 con 0x7fbb10102900 2023-09-13T09:44:03.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.399+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbafc0a0640 0x7fbafc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.399+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbafc0a0640 0x7fbafc0a2b00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbb00005950 tx=0x7fbb000058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.399+0000 7fbb20a45b80 1 Processor -- start 2023-09-13T09:44:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb20a45b80 1 -- start start 2023-09-13T09:44:03.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd68680fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd6867f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd686802f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd685d4800 con 0x55fd68680b90 2023-09-13T09:44:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd685d2120 con 0x55fd686814f0 2023-09-13T09:44:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd685cda10 con 0x55fd6867fe90 2023-09-13T09:44:03.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd68680fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd68680fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36764/0 (socket says 172.21.15.6:36764) 2023-09-13T09:44:03.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 -- 172.21.15.6:0/3526448812 learned_addr learned my addr 172.21.15.6:0/3526448812 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd6867f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd686802f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 -- 172.21.15.6:0/3526448812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 msgr2=0x55fd686802f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd686802f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 -- 172.21.15.6:0/3526448812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 msgr2=0x55fd6867f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd6867f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0e59c700 1 -- 172.21.15.6:0/3526448812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd6844d6b0 con 0x55fd68680b90 2023-09-13T09:44:03.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.400+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd686802f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.401+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd68680fb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000ff00 tx=0x7fbb00012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf8af0b977784e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.401+0000 7fbb04ff9700 1 -- 172.21.15.6:0/3526448812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb00011c60 con 0x55fd68680b90 2023-09-13T09:44:03.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.401+0000 7fbb04ff9700 1 -- 172.21.15.6:0/3526448812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb00011dc0 con 0x55fd68680b90 2023-09-13T09:44:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.401+0000 7fbb04ff9700 1 -- 172.21.15.6:0/3526448812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0001d720 con 0x55fd68680b90 2023-09-13T09:44:03.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.401+0000 7fbb20a45b80 1 -- 172.21.15.6:0/3526448812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 msgr2=0x55fd68680fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.401+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd68680fb0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fbb0000ff00 tx=0x7fbb00012000 comp rx=0 tx=0).stop 2023-09-13T09:44:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- 172.21.15.6:0/3526448812 shutdown_connections 2023-09-13T09:44:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd686802f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd68680fb0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/3526448812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd6867f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- 172.21.15.6:0/3526448812 >> 172.21.15.6:0/3526448812 conn(0x55fd685d9d00 msgr2=0x55fd68675f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- 172.21.15.6:0/3526448812 shutdown_connections 2023-09-13T09:44:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- 172.21.15.6:0/3526448812 wait complete. 2023-09-13T09:44:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- start start 2023-09-13T09:44:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 Processor -- start 2023-09-13T09:44:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd68689370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd68680b90 0x55fd686898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd686814f0 0x55fd686908f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd6856bc30 con 0x55fd686814f0 2023-09-13T09:44:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd6856b930 con 0x55fd68680b90 2023-09-13T09:44:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd6844f9a0 con 0x55fd6867fe90 2023-09-13T09:44:03.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.402+0000 7fbb20a45b80 10 client.0 _ll_register_callbacks cb 0x55fd68569700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd686814f0 0x55fd686908f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd686814f0 0x55fd686908f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36774/0 (socket says 172.21.15.6:36774) 2023-09-13T09:44:03.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/1135452331 learned_addr learned my addr 172.21.15.6:0/1135452331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd68689370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd68680b90 0x55fd686898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/1135452331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 msgr2=0x55fd68689370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd68689370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd68680b90 msgr2=0x55fd686898b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd68680b90 0x55fd686898b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 -- 172.21.15.6:0/1135452331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb0000fbb0 con 0x55fd686814f0 2023-09-13T09:44:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd686814f0 0x55fd686908f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbb0809a7c0 tx=0x7fbb0809a4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d5d3333ce4777d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbaf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:03.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/1135452331 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb0809aac0 con 0x55fd686814f0 2023-09-13T09:44:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/1135452331 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbb0809e8f0 con 0x55fd686814f0 2023-09-13T09:44:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fd6866e6f0 con 0x55fd686814f0 2023-09-13T09:44:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/1135452331 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb080a2aa0 con 0x55fd686814f0 2023-09-13T09:44:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb20a45b80 10 client.16656 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:03.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.403+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fd685e5820 con 0x55fd686814f0 2023-09-13T09:44:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/1135452331 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb08064020 con 0x55fd686814f0 2023-09-13T09:44:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/1135452331 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbb0809a0d0 con 0x55fd686814f0 2023-09-13T09:44:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb20a45b80 10 client.16656 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb20a45b80 10 client.16656 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:03.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb20a45b80 20 client.16656 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd68694f20 0x55fd68697310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb20a45b80 4 client.16656 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fd685c69f0 con 0x55fd68694f20 2023-09-13T09:44:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd68694f20 0x55fd68697310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbaf5ffb700 10 client.16656 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.404+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd68694f20 0x55fd68697310 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ad726297ab9fa55 server_cookie=c18d29fcaf4daf83 in_seq=0 out_seq=0 2023-09-13T09:44:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/1135452331 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fd685c69f0 con 0x55fd68694f20 2023-09-13T09:44:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbaf5ffb700 10 client.16656 handle_command_reply: tid=0 2023-09-13T09:44:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 client.16656 shutdown 2023-09-13T09:44:03.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd686814f0 msgr2=0x55fd686908f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd686814f0 0x55fd686908f0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fbb0809a7c0 tx=0x7fbb0809a4a0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 shutdown_connections 2023-09-13T09:44:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd68694f20 0x55fd68697310 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd686814f0 0x55fd686908f0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd68689370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1135452331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd68680b90 0x55fd686898b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 >> 172.21.15.6:0/1135452331 conn(0x55fd685d9d00 msgr2=0x55fd68670870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbaf5ffb700 0 client.16656 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.405+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 shutdown_connections 2023-09-13T09:44:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.406+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1135452331 wait complete. 2023-09-13T09:44:03.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.406+0000 7fbb20a45b80 20 client.16656 trim_cache size 0 max 16384 2023-09-13T09:44:03.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 Processor -- start 2023-09-13T09:44:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 -- start start 2023-09-13T09:44:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd68689370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd686908b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686898b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd68688850 con 0x55fd68680b90 2023-09-13T09:44:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd68678080 con 0x55fd686814f0 2023-09-13T09:44:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd68677080 con 0x55fd6867fe90 2023-09-13T09:44:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd686908b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd686908b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36780/0 (socket says 172.21.15.6:36780) 2023-09-13T09:44:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/1817422487 learned_addr learned my addr 172.21.15.6:0/1817422487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/1817422487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 msgr2=0x55fd68689370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/1817422487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd68689370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/1817422487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 msgr2=0x55fd686898b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/1817422487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686898b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/1817422487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fd686883a0 con 0x55fd68680b90 2023-09-13T09:44:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.423+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/1817422487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd686908b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80046d0 tx=0x7fbaf800baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48d95a40483e9fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb057fa700 1 -- 172.21.15.6:0/1817422487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8017070 con 0x55fd68680b90 2023-09-13T09:44:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb057fa700 1 -- 172.21.15.6:0/1817422487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaf8004cf0 con 0x55fd68680b90 2023-09-13T09:44:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb057fa700 1 -- 172.21.15.6:0/1817422487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8005280 con 0x55fd68680b90 2023-09-13T09:44:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1817422487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 msgr2=0x55fd686908b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1817422487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd686908b0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7fbaf80046d0 tx=0x7fbaf800baf0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1817422487 shutdown_connections 2023-09-13T09:44:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1817422487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686898b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1817422487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd68689370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/1817422487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd686908b0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1817422487 >> 172.21.15.6:0/1817422487 conn(0x55fd685d9d00 msgr2=0x55fd68687240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1817422487 shutdown_connections 2023-09-13T09:44:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.424+0000 7fbb20a45b80 1 -- 172.21.15.6:0/1817422487 wait complete. 2023-09-13T09:44:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 -- start start 2023-09-13T09:44:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 Processor -- start 2023-09-13T09:44:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd6868d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd6868d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686e8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd68690910 con 0x55fd68680b90 2023-09-13T09:44:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd68690a80 con 0x55fd686814f0 2023-09-13T09:44:03.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fd68690c40 con 0x55fd6867fe90 2023-09-13T09:44:03.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb20a45b80 10 client.0 _ll_register_callbacks cb 0x55fd68569700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:03.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd6868d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd6868d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36786/0 (socket says 172.21.15.6:36786) 2023-09-13T09:44:03.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/688272065 learned_addr learned my addr 172.21.15.6:0/688272065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd6868d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686e8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/688272065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 msgr2=0x55fd6868d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd6868d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 msgr2=0x55fd686e8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686e8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0dd9b700 1 -- 172.21.15.6:0/688272065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaf8004380 con 0x55fd68680b90 2023-09-13T09:44:03.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.425+0000 7fbb0ed9d700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686e8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:03.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb0dd9b700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd6868d8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8004980 tx=0x7fbaf8004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de13796ba8c6d181 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbaf5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:03.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/688272065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaf8017030 con 0x55fd68680b90 2023-09-13T09:44:03.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/688272065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbaf8018070 con 0x55fd68680b90 2023-09-13T09:44:03.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb00011dc0 con 0x55fd68680b90 2023-09-13T09:44:03.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/688272065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaf8021070 con 0x55fd68680b90 2023-09-13T09:44:03.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 10 client.16662 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:03.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fd683f9e60 con 0x55fd68680b90 2023-09-13T09:44:03.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/688272065 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb00011dc0 con 0x55fd68680b90 2023-09-13T09:44:03.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/688272065 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbaf801c770 con 0x55fd68680b90 2023-09-13T09:44:03.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 10 client.16662 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:03.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 10 client.16662 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:03.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 20 client.16662 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:03.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd686eaa00 0x55fd686ece20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 4 client.16662 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:44:03.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.426+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55fd685870d0 con 0x55fd686eaa00 2023-09-13T09:44:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.427+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd686eaa00 0x55fd686ece20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.427+0000 7fbb0e59c700 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd686eaa00 0x55fd686ece20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=383397caa5977ea1 server_cookie=1233b9f6bb1d7ab9 in_seq=0 out_seq=0 2023-09-13T09:44:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.427+0000 7fbaf5ffb700 10 client.16662 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.428+0000 7fbaf5ffb700 1 -- 172.21.15.6:0/688272065 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55fd685870d0 con 0x55fd686eaa00 2023-09-13T09:44:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.428+0000 7fbaf5ffb700 10 client.16662 handle_command_reply: tid=0 2023-09-13T09:44:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 client.16662 shutdown 2023-09-13T09:44:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 msgr2=0x55fd6868d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd6868d8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fbaf8004980 tx=0x7fbaf8004a60 comp rx=0 tx=0).stop 2023-09-13T09:44:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 shutdown_connections 2023-09-13T09:44:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fd686814f0 0x55fd686e8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fd6867fe90 0x55fd6868d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fd686eaa00 0x55fd686ece20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 --2- 172.21.15.6:0/688272065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fd68680b90 0x55fd6868d8f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbaf5ffb700 0 client.16662 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 >> 172.21.15.6:0/688272065 conn(0x55fd685d9d00 msgr2=0x55fd68683d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 shutdown_connections 2023-09-13T09:44:03.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 1 -- 172.21.15.6:0/688272065 wait complete. 2023-09-13T09:44:03.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb20a45b80 20 client.16662 trim_cache size 0 max 16384 2023-09-13T09:44:03.472 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:44:03.472 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:44:03.473 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "bad99e14-48b9-479a-9ed5-51d504556bac", 2023-09-13T09:44:03.473 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:44:03.473 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:44:03.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbafc0a0640 msgr2=0x7fbafc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb14860700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbafc0a0640 0x7fbafc0a2b00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbb00005950 tx=0x7fbb000058e0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 msgr2=0x7fbb1019e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.429+0000 7fbb14860700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb1019e0d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fbb08007a00 tx=0x7fbb080094c0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 shutdown_connections 2023-09-13T09:44:03.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbafc0a0640 0x7fbafc0a2b00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb10102900 0x7fbb1019e0d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb10100d70 0x7fbb10196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 --2- 172.21.15.6:0/2958339853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb10101f60 0x7fbb10197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 >> 172.21.15.6:0/2958339853 conn(0x7fbb100fc2e0 msgr2=0x7fbb10105400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 shutdown_connections 2023-09-13T09:44:03.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.430+0000 7fbb14860700 1 -- 172.21.15.6:0/2958339853 wait complete. 2023-09-13T09:44:03.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:44:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 -- 172.21.15.6:0/4282114169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818106aa0 msgr2=0x7f5818108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 --2- 172.21.15.6:0/4282114169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818106aa0 0x7f5818108f10 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f581000b0a0 tx=0x7f581000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 -- 172.21.15.6:0/4282114169 shutdown_connections 2023-09-13T09:44:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 --2- 172.21.15.6:0/4282114169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818106aa0 0x7f5818108f10 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 --2- 172.21.15.6:0/4282114169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5818101840 0x7f5818103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 --2- 172.21.15.6:0/4282114169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5818104170 0x7f5818106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 -- 172.21.15.6:0/4282114169 >> 172.21.15.6:0/4282114169 conn(0x7f58180fb250 msgr2=0x7f58180fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 -- 172.21.15.6:0/4282114169 shutdown_connections 2023-09-13T09:44:03.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.613+0000 7f581d22b700 1 -- 172.21.15.6:0/4282114169 wait complete. 2023-09-13T09:44:03.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.614+0000 7f581d22b700 1 Processor -- start 2023-09-13T09:44:03.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.614+0000 7f581d22b700 1 -- start start 2023-09-13T09:44:03.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581d22b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818101840 0x7f5818196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581d22b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5818104170 0x7f58181970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581d22b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5818106aa0 0x7f581819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581d22b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581819e6f0 con 0x7f5818101840 2023-09-13T09:44:03.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581d22b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581819e830 con 0x7f5818106aa0 2023-09-13T09:44:03.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581d22b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f581819e9c0 con 0x7f5818104170 2023-09-13T09:44:03.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818101840 0x7f5818196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818101840 0x7f5818196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36798/0 (socket says 172.21.15.6:36798) 2023-09-13T09:44:03.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 -- 172.21.15.6:0/19503729 learned_addr learned my addr 172.21.15.6:0/19503729 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581659c700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5818104170 0x7f58181970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581759e700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5818106aa0 0x7f581819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 -- 172.21.15.6:0/19503729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5818104170 msgr2=0x7f58181970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5818104170 0x7f58181970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 -- 172.21.15.6:0/19503729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5818106aa0 msgr2=0x7f581819e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5818106aa0 0x7f581819e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 -- 172.21.15.6:0/19503729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5810009d00 con 0x7f5818101840 2023-09-13T09:44:03.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581759e700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5818106aa0 0x7f581819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:03.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581659c700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5818104170 0x7f58181970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:03.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f5816d9d700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818101840 0x7f5818196b70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f580800e9a0 tx=0x7f580800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f57fffff700 1 -- 172.21.15.6:0/19503729 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808009790 con 0x7f5818101840 2023-09-13T09:44:03.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f57fffff700 1 -- 172.21.15.6:0/19503729 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5808010430 con 0x7f5818101840 2023-09-13T09:44:03.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f581819eca0 con 0x7f5818101840 2023-09-13T09:44:03.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.615+0000 7f57fffff700 1 -- 172.21.15.6:0/19503729 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808018680 con 0x7f5818101840 2023-09-13T09:44:03.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.616+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581819f1b0 con 0x7f5818101840 2023-09-13T09:44:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.618+0000 7f57fffff700 1 -- 172.21.15.6:0/19503729 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f58080105a0 con 0x7f5818101840 2023-09-13T09:44:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.618+0000 7f57fffff700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58000a0640 0x7f58000a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.618+0000 7f581659c700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58000a0640 0x7f58000a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.618+0000 7f57fffff700 1 -- 172.21.15.6:0/19503729 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5808014070 con 0x7f5818101840 2023-09-13T09:44:03.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.619+0000 7f581659c700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58000a0640 0x7f58000a2b00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f580c011490 tx=0x7f580c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.619+0000 7f5829410b80 1 Processor -- start 2023-09-13T09:44:03.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.619+0000 7f5829410b80 1 -- start start 2023-09-13T09:44:03.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.619+0000 7f5829410b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.619+0000 7f5829410b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.619+0000 7f5829410b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f5829410b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e806fc780 con 0x559e807a4700 2023-09-13T09:44:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f5829410b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e806fa0a0 con 0x559e807a3a00 2023-09-13T09:44:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f5816d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f5829410b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e806f5990 con 0x559e807a5060 2023-09-13T09:44:03.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f5816d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36806/0 (socket says 172.21.15.6:36806) 2023-09-13T09:44:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f5816d9d700 1 -- 172.21.15.6:0/664549257 learned_addr learned my addr 172.21.15.6:0/664549257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581659c700 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807a34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581759e700 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581659c700 1 -- 172.21.15.6:0/664549257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 msgr2=0x559e807a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581659c700 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581659c700 1 -- 172.21.15.6:0/664549257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 msgr2=0x559e807a4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581659c700 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807a4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581659c700 1 -- 172.21.15.6:0/664549257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e80575630 con 0x559e807a5060 2023-09-13T09:44:03.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f581659c700 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807a34c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f580c0042f0 tx=0x7f580c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=26f5bd6c02f7b07b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f57fd7fa700 1 -- 172.21.15.6:0/664549257 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c003d10 con 0x559e807a5060 2023-09-13T09:44:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f57fd7fa700 1 -- 172.21.15.6:0/664549257 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f580c003e70 con 0x559e807a5060 2023-09-13T09:44:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.620+0000 7f57fd7fa700 1 -- 172.21.15.6:0/664549257 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580c01e7b0 con 0x559e807a5060 2023-09-13T09:44:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 -- 172.21.15.6:0/664549257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 msgr2=0x559e807a34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807a34c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f580c0042f0 tx=0x7f580c014000 comp rx=0 tx=0).stop 2023-09-13T09:44:03.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 -- 172.21.15.6:0/664549257 shutdown_connections 2023-09-13T09:44:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807a4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 --2- 172.21.15.6:0/664549257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807a34c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 -- 172.21.15.6:0/664549257 >> 172.21.15.6:0/664549257 conn(0x559e80701c80 msgr2=0x559e8079df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 -- 172.21.15.6:0/664549257 shutdown_connections 2023-09-13T09:44:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.621+0000 7f5829410b80 1 -- 172.21.15.6:0/664549257 wait complete. 2023-09-13T09:44:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 -- start start 2023-09-13T09:44:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 Processor -- start 2023-09-13T09:44:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a3a00 0x559e807aced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807ad410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a5060 0x559e807b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e80693bb0 con 0x559e807a3a00 2023-09-13T09:44:03.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e806938b0 con 0x559e807a5060 2023-09-13T09:44:03.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e80577920 con 0x559e807a4700 2023-09-13T09:44:03.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f5829410b80 10 client.0 _ll_register_callbacks cb 0x559e80691680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:03.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f581759e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a5060 0x559e807b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f581759e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a5060 0x559e807b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58572/0 (socket says 172.21.15.6:58572) 2023-09-13T09:44:03.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f581759e700 1 -- 172.21.15.6:0/1871489986 learned_addr learned my addr 172.21.15.6:0/1871489986 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.622+0000 7f581659c700 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807ad410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f581759e700 1 -- 172.21.15.6:0/1871489986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 msgr2=0x559e807ad410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f581759e700 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807ad410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f581759e700 1 -- 172.21.15.6:0/1871489986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a3a00 msgr2=0x559e807aced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f581759e700 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a3a00 0x559e807aced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f581759e700 1 -- 172.21.15.6:0/1871489986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f580c017070 con 0x559e807a5060 2023-09-13T09:44:03.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f581759e700 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a5060 0x559e807b4450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f581000b0a0 tx=0x7f58100095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2a2d5279651f8c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f57faff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:44:03.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f57faff5700 1 -- 172.21.15.6:0/1871489986 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f581000e040 con 0x559e807a5060 2023-09-13T09:44:03.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f57faff5700 1 -- 172.21.15.6:0/1871489986 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5810003a00 con 0x559e807a5060 2023-09-13T09:44:03.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559e80796670 con 0x559e807a5060 2023-09-13T09:44:03.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f57faff5700 1 -- 172.21.15.6:0/1871489986 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5810003bc0 con 0x559e807a5060 2023-09-13T09:44:03.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f5829410b80 10 client.26111 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:03.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.623+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559e8070d7a0 con 0x559e807a5060 2023-09-13T09:44:03.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f57faff5700 1 -- 172.21.15.6:0/1871489986 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559e80796670 con 0x559e807a5060 2023-09-13T09:44:03.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f57faff5700 1 -- 172.21.15.6:0/1871489986 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f581000b0d0 con 0x559e807a5060 2023-09-13T09:44:03.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5829410b80 10 client.26111 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:03.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5829410b80 10 client.26111 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:03.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5829410b80 20 client.26111 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:03.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5829410b80 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e807b8c90 0x559e807bb0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5829410b80 4 client.26111 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:03.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559e806ee970 con 0x559e807b8c90 2023-09-13T09:44:03.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5816d9d700 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e807b8c90 0x559e807bb0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f57faff5700 10 client.26111 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.624+0000 7f5816d9d700 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e807b8c90 0x559e807bb0b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3f98962b7af2dc server_cookie=3c7856cb8f343c4c in_seq=0 out_seq=0 2023-09-13T09:44:03.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f57faff5700 1 -- 172.21.15.6:0/1871489986 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559e806ee970 con 0x559e807b8c90 2023-09-13T09:44:03.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f57faff5700 10 client.26111 handle_command_reply: tid=0 2023-09-13T09:44:03.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 client.26111 shutdown 2023-09-13T09:44:03.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a5060 msgr2=0x559e807b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a5060 0x559e807b4450 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f581000b0a0 tx=0x7f58100095c0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 shutdown_connections 2023-09-13T09:44:03.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a5060 0x559e807b4450 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e807b8c90 0x559e807bb0b0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a3a00 0x559e807aced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f57faff5700 0 client.26111 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 --2- 172.21.15.6:0/1871489986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807ad410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 >> 172.21.15.6:0/1871489986 conn(0x559e80701c80 msgr2=0x559e807987f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 shutdown_connections 2023-09-13T09:44:03.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.625+0000 7f5829410b80 1 -- 172.21.15.6:0/1871489986 wait complete. 2023-09-13T09:44:03.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.626+0000 7f5829410b80 20 client.26111 trim_cache size 0 max 16384 2023-09-13T09:44:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 Processor -- start 2023-09-13T09:44:03.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 -- start start 2023-09-13T09:44:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807b4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a5060 0x559e807a7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e807b8840 con 0x559e807a5060 2023-09-13T09:44:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8079fa10 con 0x559e807a3a00 2023-09-13T09:44:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5829410b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e8079a8e0 con 0x559e807a4700 2023-09-13T09:44:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f581759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a5060 0x559e807a7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f5816d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f581759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a5060 0x559e807a7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36824/0 (socket says 172.21.15.6:36824) 2023-09-13T09:44:03.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f581759e700 1 -- 172.21.15.6:0/1121476931 learned_addr learned my addr 172.21.15.6:0/1121476931 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.644+0000 7f581659c700 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f5816d9d700 1 -- 172.21.15.6:0/1121476931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 msgr2=0x559e807b4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f5816d9d700 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807b4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f5816d9d700 1 -- 172.21.15.6:0/1121476931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a5060 msgr2=0x559e807a7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f5816d9d700 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a5060 0x559e807a7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f5816d9d700 1 -- 172.21.15.6:0/1121476931 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559e80521de0 con 0x559e807a3a00 2023-09-13T09:44:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f5816d9d700 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a34c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5808095a30 tx=0x7f58080c9710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db9334af4c867af3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f57fdffb700 1 -- 172.21.15.6:0/1121476931 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f580809d170 con 0x559e807a3a00 2023-09-13T09:44:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f57fdffb700 1 -- 172.21.15.6:0/1121476931 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5808099530 con 0x559e807a3a00 2023-09-13T09:44:03.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.645+0000 7f57fdffb700 1 -- 172.21.15.6:0/1121476931 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5808099790 con 0x559e807a3a00 2023-09-13T09:44:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 -- 172.21.15.6:0/1121476931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 msgr2=0x559e807a34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a34c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5808095a30 tx=0x7f58080c9710 comp rx=0 tx=0).stop 2023-09-13T09:44:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 -- 172.21.15.6:0/1121476931 shutdown_connections 2023-09-13T09:44:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a5060 0x559e807a7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807a34c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 --2- 172.21.15.6:0/1121476931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a4700 0x559e807b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 -- 172.21.15.6:0/1121476931 >> 172.21.15.6:0/1121476931 conn(0x559e80701c80 msgr2=0x559e807b4d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 -- 172.21.15.6:0/1121476931 shutdown_connections 2023-09-13T09:44:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 -- 172.21.15.6:0/1121476931 wait complete. 2023-09-13T09:44:03.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 -- start start 2023-09-13T09:44:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 Processor -- start 2023-09-13T09:44:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.646+0000 7f5829410b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807b4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5829410b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807b0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5829410b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e807b0d60 con 0x559e807a4700 2023-09-13T09:44:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5829410b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e807b0ed0 con 0x559e807a3a00 2023-09-13T09:44:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5829410b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559e807b1090 con 0x559e807a5060 2023-09-13T09:44:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5829410b80 10 client.0 _ll_register_callbacks cb 0x559e80691680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f581659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58582/0 (socket says 172.21.15.6:58582) 2023-09-13T09:44:03.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 -- 172.21.15.6:0/582701238 learned_addr learned my addr 172.21.15.6:0/582701238 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:03.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f581759e700 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 -- 172.21.15.6:0/582701238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 msgr2=0x559e807b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 -- 172.21.15.6:0/582701238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 msgr2=0x559e807b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:03.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 -- 172.21.15.6:0/582701238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f581819f1b0 con 0x559e807a3a00 2023-09-13T09:44:03.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f5816d9d700 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807b3ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f58080843b0 tx=0x7f580809d200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab5d32ee3a3db7a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:03.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f57faff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:44:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.647+0000 7f57faff5700 1 -- 172.21.15.6:0/582701238 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58080a15a0 con 0x559e807a3a00 2023-09-13T09:44:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f57faff5700 1 -- 172.21.15.6:0/582701238 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5808010880 con 0x559e807a3a00 2023-09-13T09:44:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f580c003e70 con 0x559e807a3a00 2023-09-13T09:44:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f57faff5700 1 -- 172.21.15.6:0/582701238 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58080b7300 con 0x559e807a3a00 2023-09-13T09:44:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 10 client.26117 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:03.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559e8050ac60 con 0x559e807a3a00 2023-09-13T09:44:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f57faff5700 1 -- 172.21.15.6:0/582701238 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f580c003e70 con 0x559e807a3a00 2023-09-13T09:44:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f57faff5700 1 -- 172.21.15.6:0/582701238 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5808099820 con 0x559e807a3a00 2023-09-13T09:44:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 10 client.26117 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 10 client.26117 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:03.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 20 client.26117 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e8080dcd0 0x559e808100f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 4 client.26117 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:44:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559e806af050 con 0x559e8080dcd0 2023-09-13T09:44:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.648+0000 7f581659c700 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e8080dcd0 0x559e808100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:03.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f581659c700 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e8080dcd0 0x559e808100f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b6e789bd5ae6e5 server_cookie=768f56901ebc777b in_seq=0 out_seq=0 2023-09-13T09:44:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f57faff5700 10 client.26117 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f57faff5700 1 -- 172.21.15.6:0/582701238 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559e806af050 con 0x559e8080dcd0 2023-09-13T09:44:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f57faff5700 10 client.26117 handle_command_reply: tid=0 2023-09-13T09:44:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 client.26117 shutdown 2023-09-13T09:44:03.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 msgr2=0x559e807b3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807b3ce0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f58080843b0 tx=0x7f580809d200 comp rx=0 tx=0).stop 2023-09-13T09:44:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 shutdown_connections 2023-09-13T09:44:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559e807a5060 0x559e807b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559e807a3a00 0x559e807b3ce0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559e8080dcd0 0x559e808100f0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 --2- 172.21.15.6:0/582701238 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559e807a4700 0x559e807b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f57faff5700 0 client.26117 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 >> 172.21.15.6:0/582701238 conn(0x559e80701c80 msgr2=0x559e807a7980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 shutdown_connections 2023-09-13T09:44:03.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 1 -- 172.21.15.6:0/582701238 wait complete. 2023-09-13T09:44:03.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.649+0000 7f5829410b80 20 client.26117 trim_cache size 0 max 16384 2023-09-13T09:44:03.670 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:44:03.670 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:44:03.670 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:44:03.671 INFO:teuthology.orchestra.run.smithi006.stdout: "bad99e14-48b9-479a-9ed5-51d504556bac": { 2023-09-13T09:44:03.671 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:44:03.671 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "bad99e14-48b9-479a-9ed5-51d504556bac", 2023-09-13T09:44:03.671 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:44:03.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:44:03.672 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:44:03.672 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:44:03.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58000a0640 msgr2=0x7f58000a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58000a0640 0x7f58000a2b00 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f580c011490 tx=0x7f580c009260 comp rx=0 tx=0).stop 2023-09-13T09:44:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818101840 msgr2=0x7f5818196b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818101840 0x7f5818196b70 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f580800e9a0 tx=0x7f580800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 shutdown_connections 2023-09-13T09:44:03.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5818106aa0 0x7f581819e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f58000a0640 0x7f58000a2b00 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5818101840 0x7f5818196b70 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 --2- 172.21.15.6:0/19503729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5818104170 0x7f58181970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 >> 172.21.15.6:0/19503729 conn(0x7f58180fb250 msgr2=0x7f58181024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:03.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 shutdown_connections 2023-09-13T09:44:03.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:03.650+0000 7f581d22b700 1 -- 172.21.15.6:0/19503729 wait complete. 2023-09-13T09:44:03.676 INFO:tasks.cephfs.filesystem:scrub status for tag:bad99e14-48b9-479a-9ed5-51d504556bac - {'path': '/', 'tag': 'bad99e14-48b9-479a-9ed5-51d504556bac', 'options': 'recursive,force'} 2023-09-13T09:44:04.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:03 smithi006 ceph-mon[98665]: pgmap v436: 97 pgs: 97 active+clean; 69 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 436 KiB/s wr, 72 op/s 2023-09-13T09:44:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:03 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:04.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:03 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:04.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 133718 2.58 MB/sec execute 84 sec latency 1285.715 ms 2023-09-13T09:44:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:03 smithi053 ceph-mon[102373]: pgmap v436: 97 pgs: 97 active+clean; 69 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 436 KiB/s wr, 72 op/s 2023-09-13T09:44:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:03 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:03 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:03 smithi131 ceph-mon[102785]: pgmap v436: 97 pgs: 97 active+clean; 69 MiB data, 787 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 436 KiB/s wr, 72 op/s 2023-09-13T09:44:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:03 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:03 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135229 2.69 MB/sec execute 85 sec latency 13.470 ms 2023-09-13T09:44:05.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:44:05.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:05.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:05.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:05.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:05.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:05.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:05.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:05.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:04 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:44:05.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:05.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:05.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:05.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:05.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:05.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:05.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.263 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:05.263 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.263 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:04 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:44:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:05.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:05.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:05.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:05.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:05.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:05.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:05.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:04 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:06.159 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135487 2.66 MB/sec execute 86 sec latency 721.794 ms 2023-09-13T09:44:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:05 smithi006 ceph-mon[98665]: pgmap v437: 97 pgs: 97 active+clean; 68 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 442 KiB/s wr, 73 op/s 2023-09-13T09:44:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:05 smithi053 ceph-mon[102373]: pgmap v437: 97 pgs: 97 active+clean; 68 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 442 KiB/s wr, 73 op/s 2023-09-13T09:44:06.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:05 smithi131 ceph-mon[102785]: pgmap v437: 97 pgs: 97 active+clean; 68 MiB data, 786 MiB used, 1.0 TiB / 1.0 TiB avail; 317 KiB/s rd, 442 KiB/s wr, 73 op/s 2023-09-13T09:44:07.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135497 2.64 MB/sec execute 87 sec latency 1716.633 ms 2023-09-13T09:44:08.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135543 2.61 MB/sec execute 88 sec latency 961.696 ms 2023-09-13T09:44:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:07 smithi006 ceph-mon[98665]: pgmap v438: 97 pgs: 97 active+clean; 70 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 630 KiB/s wr, 96 op/s 2023-09-13T09:44:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:07 smithi053 ceph-mon[102373]: pgmap v438: 97 pgs: 97 active+clean; 70 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 630 KiB/s wr, 96 op/s 2023-09-13T09:44:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:07 smithi131 ceph-mon[102785]: pgmap v438: 97 pgs: 97 active+clean; 70 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 630 KiB/s wr, 96 op/s 2023-09-13T09:44:09.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135543 2.58 MB/sec execute 89 sec latency 1961.816 ms 2023-09-13T09:44:10.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135543 2.55 MB/sec execute 90 sec latency 2961.930 ms 2023-09-13T09:44:10.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:09 smithi006 ceph-mon[98665]: pgmap v439: 97 pgs: 97 active+clean; 72 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 735 KiB/s wr, 97 op/s 2023-09-13T09:44:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:09 smithi053 ceph-mon[102373]: pgmap v439: 97 pgs: 97 active+clean; 72 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 735 KiB/s wr, 97 op/s 2023-09-13T09:44:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:09 smithi131 ceph-mon[102785]: pgmap v439: 97 pgs: 97 active+clean; 72 MiB data, 777 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 735 KiB/s wr, 97 op/s 2023-09-13T09:44:11.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135543 2.52 MB/sec execute 91 sec latency 3962.057 ms 2023-09-13T09:44:12.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 135543 2.49 MB/sec execute 92 sec latency 4962.191 ms 2023-09-13T09:44:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:11 smithi053 ceph-mon[102373]: pgmap v440: 97 pgs: 97 active+clean; 72 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 901 KiB/s wr, 106 op/s 2023-09-13T09:44:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:11 smithi006 ceph-mon[98665]: pgmap v440: 97 pgs: 97 active+clean; 72 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 901 KiB/s wr, 106 op/s 2023-09-13T09:44:12.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:11 smithi131 ceph-mon[102785]: pgmap v440: 97 pgs: 97 active+clean; 72 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 381 KiB/s rd, 901 KiB/s wr, 106 op/s 2023-09-13T09:44:13.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 137719 2.59 MB/sec execute 93 sec latency 5043.955 ms 2023-09-13T09:44:14.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 138840 2.64 MB/sec execute 94 sec latency 42.351 ms 2023-09-13T09:44:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:13 smithi006 ceph-mon[98665]: pgmap v441: 97 pgs: 97 active+clean; 70 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 875 KiB/s wr, 108 op/s 2023-09-13T09:44:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:13 smithi053 ceph-mon[102373]: pgmap v441: 97 pgs: 97 active+clean; 70 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 875 KiB/s wr, 108 op/s 2023-09-13T09:44:14.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:13 smithi131 ceph-mon[102785]: pgmap v441: 97 pgs: 97 active+clean; 70 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 342 KiB/s rd, 875 KiB/s wr, 108 op/s 2023-09-13T09:44:15.160 INFO:tasks.workunit.client.0.smithi006.stdout: 1 140975 2.70 MB/sec execute 95 sec latency 13.579 ms 2023-09-13T09:44:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:14 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:14 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:14 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:14 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:15.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:14 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:15.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:14 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:15.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:14 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:15.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:14 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:15.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:14 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:14 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:14 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:14 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:16.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 142337 2.78 MB/sec execute 96 sec latency 18.383 ms 2023-09-13T09:44:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:15 smithi006 ceph-mon[98665]: pgmap v442: 97 pgs: 97 active+clean; 69 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 834 KiB/s wr, 89 op/s 2023-09-13T09:44:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:15 smithi053 ceph-mon[102373]: pgmap v442: 97 pgs: 97 active+clean; 69 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 834 KiB/s wr, 89 op/s 2023-09-13T09:44:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:15 smithi131 ceph-mon[102785]: pgmap v442: 97 pgs: 97 active+clean; 69 MiB data, 773 MiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 834 KiB/s wr, 89 op/s 2023-09-13T09:44:17.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 142621 2.76 MB/sec execute 97 sec latency 760.239 ms 2023-09-13T09:44:18.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 144900 2.86 MB/sec execute 98 sec latency 15.147 ms 2023-09-13T09:44:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:17 smithi006 ceph-mon[98665]: pgmap v443: 97 pgs: 97 active+clean; 71 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 966 KiB/s wr, 116 op/s 2023-09-13T09:44:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:17 smithi053 ceph-mon[102373]: pgmap v443: 97 pgs: 97 active+clean; 71 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 966 KiB/s wr, 116 op/s 2023-09-13T09:44:18.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:17 smithi131 ceph-mon[102785]: pgmap v443: 97 pgs: 97 active+clean; 71 MiB data, 781 MiB used, 1.0 TiB / 1.0 TiB avail; 302 KiB/s rd, 966 KiB/s wr, 116 op/s 2023-09-13T09:44:19.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 146025 2.89 MB/sec execute 99 sec latency 12.020 ms 2023-09-13T09:44:20.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 148042 2.94 MB/sec execute 100 sec latency 35.515 ms 2023-09-13T09:44:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:19 smithi006 ceph-mon[98665]: pgmap v444: 97 pgs: 97 active+clean; 71 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 844 KiB/s wr, 101 op/s 2023-09-13T09:44:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:19 smithi053 ceph-mon[102373]: pgmap v444: 97 pgs: 97 active+clean; 71 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 844 KiB/s wr, 101 op/s 2023-09-13T09:44:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:19 smithi131 ceph-mon[102785]: pgmap v444: 97 pgs: 97 active+clean; 71 MiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 844 KiB/s wr, 101 op/s 2023-09-13T09:44:21.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 149436 3.02 MB/sec execute 101 sec latency 19.334 ms 2023-09-13T09:44:22.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 151408 3.06 MB/sec execute 102 sec latency 48.345 ms 2023-09-13T09:44:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:21 smithi006 ceph-mon[98665]: pgmap v445: 97 pgs: 97 active+clean; 73 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 851 KiB/s wr, 118 op/s 2023-09-13T09:44:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:21 smithi053 ceph-mon[102373]: pgmap v445: 97 pgs: 97 active+clean; 73 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 851 KiB/s wr, 118 op/s 2023-09-13T09:44:22.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:21 smithi131 ceph-mon[102785]: pgmap v445: 97 pgs: 97 active+clean; 73 MiB data, 813 MiB used, 1.0 TiB / 1.0 TiB avail; 329 KiB/s rd, 851 KiB/s wr, 118 op/s 2023-09-13T09:44:23.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 152918 3.15 MB/sec execute 103 sec latency 12.699 ms 2023-09-13T09:44:24.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 154129 3.17 MB/sec execute 104 sec latency 17.762 ms 2023-09-13T09:44:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:23 smithi053 ceph-mon[102373]: pgmap v446: 97 pgs: 97 active+clean; 74 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 950 KiB/s wr, 158 op/s 2023-09-13T09:44:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:44:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:44:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:44:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:44:24.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:23 smithi006 ceph-mon[98665]: pgmap v446: 97 pgs: 97 active+clean; 74 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 950 KiB/s wr, 158 op/s 2023-09-13T09:44:24.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:44:24.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:44:24.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:44:24.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:44:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:23 smithi131 ceph-mon[102785]: pgmap v446: 97 pgs: 97 active+clean; 74 MiB data, 845 MiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 950 KiB/s wr, 158 op/s 2023-09-13T09:44:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:44:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:44:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:44:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:44:25.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156319 3.27 MB/sec execute 105 sec latency 15.678 ms 2023-09-13T09:44:26.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156759 3.24 MB/sec execute 106 sec latency 222.426 ms 2023-09-13T09:44:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:25 smithi006 ceph-mon[98665]: pgmap v447: 97 pgs: 97 active+clean; 76 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.0 MiB/s wr, 182 op/s 2023-09-13T09:44:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:25 smithi053 ceph-mon[102373]: pgmap v447: 97 pgs: 97 active+clean; 76 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.0 MiB/s wr, 182 op/s 2023-09-13T09:44:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:25 smithi131 ceph-mon[102785]: pgmap v447: 97 pgs: 97 active+clean; 76 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 1.0 MiB/s wr, 182 op/s 2023-09-13T09:44:27.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156803 3.22 MB/sec execute 107 sec latency 1202.790 ms 2023-09-13T09:44:28.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156883 3.19 MB/sec execute 108 sec latency 925.975 ms 2023-09-13T09:44:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:27 smithi006 ceph-mon[98665]: pgmap v448: 97 pgs: 97 active+clean; 78 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 1.1 MiB/s wr, 210 op/s 2023-09-13T09:44:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:27 smithi053 ceph-mon[102373]: pgmap v448: 97 pgs: 97 active+clean; 78 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 1.1 MiB/s wr, 210 op/s 2023-09-13T09:44:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:27 smithi131 ceph-mon[102785]: pgmap v448: 97 pgs: 97 active+clean; 78 MiB data, 885 MiB used, 1.0 TiB / 1.0 TiB avail; 766 KiB/s rd, 1.1 MiB/s wr, 210 op/s 2023-09-13T09:44:29.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156883 3.16 MB/sec execute 109 sec latency 1926.109 ms 2023-09-13T09:44:30.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156883 3.13 MB/sec execute 110 sec latency 2926.211 ms 2023-09-13T09:44:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:29 smithi006 ceph-mon[98665]: pgmap v449: 97 pgs: 97 active+clean; 78 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2023-09-13T09:44:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:29 smithi053 ceph-mon[102373]: pgmap v449: 97 pgs: 97 active+clean; 78 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2023-09-13T09:44:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:29 smithi131 ceph-mon[102785]: pgmap v449: 97 pgs: 97 active+clean; 78 MiB data, 886 MiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2023-09-13T09:44:31.161 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156883 3.10 MB/sec execute 111 sec latency 3926.335 ms 2023-09-13T09:44:32.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 156912 3.07 MB/sec execute 112 sec latency 4908.290 ms 2023-09-13T09:44:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:31 smithi053 ceph-mon[102373]: pgmap v450: 97 pgs: 97 active+clean; 79 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2023-09-13T09:44:32.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:31 smithi006 ceph-mon[98665]: pgmap v450: 97 pgs: 97 active+clean; 79 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2023-09-13T09:44:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:31 smithi131 ceph-mon[102785]: pgmap v450: 97 pgs: 97 active+clean; 79 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 737 KiB/s rd, 1.0 MiB/s wr, 184 op/s 2023-09-13T09:44:33.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 159279 3.16 MB/sec execute 113 sec latency 13.784 ms 2023-09-13T09:44:33.677 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:44:33.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.808+0000 7f029c1da700 1 -- 172.21.15.6:0/1751828776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294102900 msgr2=0x7f02941091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.808+0000 7f029c1da700 1 --2- 172.21.15.6:0/1751828776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294102900 0x7f02941091b0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f028c00b0d0 tx=0x7f028c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.808+0000 7f029c1da700 1 -- 172.21.15.6:0/1751828776 shutdown_connections 2023-09-13T09:44:33.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.808+0000 7f029c1da700 1 --2- 172.21.15.6:0/1751828776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294102900 0x7f02941091b0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.808+0000 7f029c1da700 1 --2- 172.21.15.6:0/1751828776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0294100d70 0x7f0294101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.808+0000 7f029c1da700 1 --2- 172.21.15.6:0/1751828776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 0x7f02941023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 -- 172.21.15.6:0/1751828776 >> 172.21.15.6:0/1751828776 conn(0x7f02940fc2e0 msgr2=0x7f02940fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:33.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 -- 172.21.15.6:0/1751828776 shutdown_connections 2023-09-13T09:44:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 -- 172.21.15.6:0/1751828776 wait complete. 2023-09-13T09:44:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 Processor -- start 2023-09-13T09:44:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 -- start start 2023-09-13T09:44:33.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294100d70 0x7f0294074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 0x7f02940730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0294102900 0x7f02940735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294073d80 con 0x7f0294100d70 2023-09-13T09:44:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0294073ef0 con 0x7f0294101f60 2023-09-13T09:44:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f029c1da700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02941a0c10 con 0x7f0294102900 2023-09-13T09:44:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.809+0000 7f0299775700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 0x7f02940730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 0x7f02940730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58600/0 (socket says 172.21.15.6:58600) 2023-09-13T09:44:33.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 -- 172.21.15.6:0/448394693 learned_addr learned my addr 172.21.15.6:0/448394693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299f76700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294100d70 0x7f0294074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f029a777700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0294102900 0x7f02940735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 -- 172.21.15.6:0/448394693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0294102900 msgr2=0x7f02940735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0294102900 0x7f02940735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 -- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294100d70 msgr2=0x7f0294074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294100d70 0x7f0294074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 -- 172.21.15.6:0/448394693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f028c009d00 con 0x7f0294101f60 2023-09-13T09:44:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f0299775700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 0x7f02940730a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f028400e9c0 tx=0x7f028400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f028affd700 1 -- 172.21.15.6:0/448394693 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840097b0 con 0x7f0294101f60 2023-09-13T09:44:33.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02941a0ef0 con 0x7f0294101f60 2023-09-13T09:44:33.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f028affd700 1 -- 172.21.15.6:0/448394693 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f028400ee60 con 0x7f0294101f60 2023-09-13T09:44:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f028affd700 1 -- 172.21.15.6:0/448394693 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02840054f0 con 0x7f0294101f60 2023-09-13T09:44:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.810+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02941a1320 con 0x7f0294101f60 2023-09-13T09:44:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.813+0000 7f028affd700 1 -- 172.21.15.6:0/448394693 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0284004750 con 0x7f0294101f60 2023-09-13T09:44:33.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.813+0000 7f028affd700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02800a0640 0x7f02800a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.813+0000 7f028affd700 1 -- 172.21.15.6:0/448394693 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0284014070 con 0x7f0294101f60 2023-09-13T09:44:33.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.813+0000 7f0299f76700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02800a0640 0x7f02800a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f0299f76700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02800a0640 0x7f02800a2b00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0294101dc0 tx=0x7f0290009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 Processor -- start 2023-09-13T09:44:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 -- start start 2023-09-13T09:44:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x561633216b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x5616332154c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633215a00 0x561633215e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163316e780 con 0x561633215a00 2023-09-13T09:44:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163316c0a0 con 0x561633216700 2023-09-13T09:44:33.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.814+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561633167990 con 0x561633217060 2023-09-13T09:44:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633215a00 0x561633215e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f0299f76700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x561633216b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633215a00 0x561633215e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36854/0 (socket says 172.21.15.6:36854) 2023-09-13T09:44:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 -- 172.21.15.6:0/1242650779 learned_addr learned my addr 172.21.15.6:0/1242650779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f0299775700 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x5616332154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 -- 172.21.15.6:0/1242650779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 msgr2=0x5616332154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x5616332154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 -- 172.21.15.6:0/1242650779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 msgr2=0x561633216b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x561633216b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 -- 172.21.15.6:0/1242650779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561632fe7630 con 0x561633215a00 2023-09-13T09:44:33.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f029a777700 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633215a00 0x561633215e80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f028c015000 tx=0x7f028c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4077c528ec83ffee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f027ffff700 1 -- 172.21.15.6:0/1242650779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00e040 con 0x561633215a00 2023-09-13T09:44:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f027ffff700 1 -- 172.21.15.6:0/1242650779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f028c00baa0 con 0x561633215a00 2023-09-13T09:44:33.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.815+0000 7f027ffff700 1 -- 172.21.15.6:0/1242650779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c005070 con 0x561633215a00 2023-09-13T09:44:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 -- 172.21.15.6:0/1242650779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633215a00 msgr2=0x561633215e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633215a00 0x561633215e80 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f028c015000 tx=0x7f028c005b00 comp rx=0 tx=0).stop 2023-09-13T09:44:33.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 -- 172.21.15.6:0/1242650779 shutdown_connections 2023-09-13T09:44:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633215a00 0x561633215e80 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x561633216b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/1242650779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x5616332154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 -- 172.21.15.6:0/1242650779 >> 172.21.15.6:0/1242650779 conn(0x561633173c80 msgr2=0x56163320ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 -- 172.21.15.6:0/1242650779 shutdown_connections 2023-09-13T09:44:33.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 -- 172.21.15.6:0/1242650779 wait complete. 2023-09-13T09:44:33.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 -- start start 2023-09-13T09:44:33.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.816+0000 7f02a83bfb80 1 Processor -- start 2023-09-13T09:44:33.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x56163321eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x56163321f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633217060 0x561633226450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561633105bb0 con 0x561633217060 2023-09-13T09:44:33.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5616331058b0 con 0x561633216700 2023-09-13T09:44:33.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561632fe9920 con 0x561633215a00 2023-09-13T09:44:33.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f02a83bfb80 10 client.0 _ll_register_callbacks cb 0x561633103680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633217060 0x561633226450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f0299f76700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x56163321eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f0299775700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x56163321f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633217060 0x561633226450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36860/0 (socket says 172.21.15.6:36860) 2023-09-13T09:44:33.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 -- 172.21.15.6:0/3572831950 learned_addr learned my addr 172.21.15.6:0/3572831950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f0299f76700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x56163321eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:39910/0 (socket says 172.21.15.6:39910) 2023-09-13T09:44:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 -- 172.21.15.6:0/3572831950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 msgr2=0x56163321eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x56163321eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 -- 172.21.15.6:0/3572831950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 msgr2=0x56163321f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x56163321f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.817+0000 7f029a777700 1 -- 172.21.15.6:0/3572831950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0294109b00 con 0x561633217060 2023-09-13T09:44:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f029a777700 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633217060 0x561633226450 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f028c007a30 tx=0x7f028c003a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e94e122263e2ce8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f027d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:33.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f027d7fa700 1 -- 172.21.15.6:0/3572831950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028c00e040 con 0x561633217060 2023-09-13T09:44:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f027d7fa700 1 -- 172.21.15.6:0/3572831950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f028c0050c0 con 0x561633217060 2023-09-13T09:44:33.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561633208670 con 0x561633217060 2023-09-13T09:44:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f027d7fa700 1 -- 172.21.15.6:0/3572831950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f028c005280 con 0x561633217060 2023-09-13T09:44:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 10 client.16689 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:33.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56163317f7a0 con 0x561633217060 2023-09-13T09:44:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f027d7fa700 1 -- 172.21.15.6:0/3572831950 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561633208670 con 0x561633217060 2023-09-13T09:44:33.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f027d7fa700 1 -- 172.21.15.6:0/3572831950 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f028c00b100 con 0x561633217060 2023-09-13T09:44:33.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 10 client.16689 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:33.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 10 client.16689 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:33.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 20 client.16689 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:33.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163322a8d0 0x56163322ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 4 client.16689 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561633160970 con 0x56163322a8d0 2023-09-13T09:44:33.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.818+0000 7f0299f76700 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163322a8d0 0x56163322ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.819+0000 7f0299f76700 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163322a8d0 0x56163322ccf0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52fa8dc832fbaf86 server_cookie=f9f9f21ca928a5ef in_seq=0 out_seq=0 2023-09-13T09:44:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.819+0000 7f027d7fa700 10 client.16689 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.820+0000 7f027d7fa700 1 -- 172.21.15.6:0/3572831950 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561633160970 con 0x56163322a8d0 2023-09-13T09:44:33.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.820+0000 7f027d7fa700 10 client.16689 handle_command_reply: tid=0 2023-09-13T09:44:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.820+0000 7f02a83bfb80 1 client.16689 shutdown 2023-09-13T09:44:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633217060 msgr2=0x561633226450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633217060 0x561633226450 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f028c007a30 tx=0x7f028c003a00 comp rx=0 tx=0).stop 2023-09-13T09:44:33.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 shutdown_connections 2023-09-13T09:44:33.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163322a8d0 0x56163322ccf0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633217060 0x561633226450 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x56163321eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3572831950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633216700 0x56163321f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f027d7fa700 0 client.16689 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:33.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 >> 172.21.15.6:0/3572831950 conn(0x561633173c80 msgr2=0x56163320fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:33.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 shutdown_connections 2023-09-13T09:44:33.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3572831950 wait complete. 2023-09-13T09:44:33.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.821+0000 7f02a83bfb80 20 client.16689 trim_cache size 0 max 16384 2023-09-13T09:44:33.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.838+0000 7f02a83bfb80 1 Processor -- start 2023-09-13T09:44:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.838+0000 7f02a83bfb80 1 -- start start 2023-09-13T09:44:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x5616332154c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633226410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633217060 0x56163320fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163321cb30 con 0x561633216700 2023-09-13T09:44:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163321d610 con 0x561633217060 2023-09-13T09:44:33.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56163321a420 con 0x561633215a00 2023-09-13T09:44:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633226410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633226410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36866/0 (socket says 172.21.15.6:36866) 2023-09-13T09:44:33.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 -- 172.21.15.6:0/3753640255 learned_addr learned my addr 172.21.15.6:0/3753640255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:33.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f029a777700 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633217060 0x56163320fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299f76700 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x5616332154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 -- 172.21.15.6:0/3753640255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 msgr2=0x5616332154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x5616332154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 -- 172.21.15.6:0/3753640255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633217060 msgr2=0x56163320fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633217060 0x56163320fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 -- 172.21.15.6:0/3753640255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561632f93de0 con 0x561633216700 2023-09-13T09:44:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299f76700 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x5616332154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0299775700 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633226410 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0284095ad0 tx=0x7f0284084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d814a04a83ffe32b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:33.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.839+0000 7f0288ff9700 1 -- 172.21.15.6:0/3753640255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028409d400 con 0x561633216700 2023-09-13T09:44:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f0288ff9700 1 -- 172.21.15.6:0/3753640255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02840a1640 con 0x561633216700 2023-09-13T09:44:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f0288ff9700 1 -- 172.21.15.6:0/3753640255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f028409d0b0 con 0x561633216700 2023-09-13T09:44:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3753640255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 msgr2=0x561633226410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633226410 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f0284095ad0 tx=0x7f0284084040 comp rx=0 tx=0).stop 2023-09-13T09:44:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3753640255 shutdown_connections 2023-09-13T09:44:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633217060 0x56163320fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633215a00 0x5616332154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/3753640255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633226410 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3753640255 >> 172.21.15.6:0/3753640255 conn(0x561633173c80 msgr2=0x56163321dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3753640255 shutdown_connections 2023-09-13T09:44:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 -- 172.21.15.6:0/3753640255 wait complete. 2023-09-13T09:44:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.840+0000 7f02a83bfb80 1 -- start start 2023-09-13T09:44:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 1 Processor -- start 2023-09-13T09:44:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633215a00 0x561633222530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633222a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x561633225a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561633225fd0 con 0x561633216700 2023-09-13T09:44:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561633226140 con 0x561633215a00 2023-09-13T09:44:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561633226300 con 0x561633217060 2023-09-13T09:44:33.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f02a83bfb80 10 client.0 _ll_register_callbacks cb 0x561633103680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f0299775700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633222a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f0299f76700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633215a00 0x561633222530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f0299775700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633222a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36872/0 (socket says 172.21.15.6:36872) 2023-09-13T09:44:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f0299f76700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633215a00 0x561633222530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58626/0 (socket says 172.21.15.6:58626) 2023-09-13T09:44:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f0299775700 1 -- 172.21.15.6:0/2087060204 learned_addr learned my addr 172.21.15.6:0/2087060204 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f029a777700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x561633225a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.841+0000 7f0299775700 1 -- 172.21.15.6:0/2087060204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 msgr2=0x561633225a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f0299775700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x561633225a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f0299775700 1 -- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633215a00 msgr2=0x561633222530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f0299775700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633215a00 0x561633222530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f0299775700 1 -- 172.21.15.6:0/2087060204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02941a1320 con 0x561633216700 2023-09-13T09:44:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f0299f76700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633215a00 0x561633222530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f029a777700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x561633225a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f0299775700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633222a70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0284084010 tx=0x7f0284099430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7dbdbe087707c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f027d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f027d7fa700 1 -- 172.21.15.6:0/2087060204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0284063070 con 0x561633216700 2023-09-13T09:44:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f027d7fa700 1 -- 172.21.15.6:0/2087060204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f02840b0030 con 0x561633216700 2023-09-13T09:44:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f028c00baa0 con 0x561633216700 2023-09-13T09:44:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f027d7fa700 1 -- 172.21.15.6:0/2087060204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f028409d400 con 0x561633216700 2023-09-13T09:44:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 10 client.16695 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561632f7cc60 con 0x561633216700 2023-09-13T09:44:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f027d7fa700 1 -- 172.21.15.6:0/2087060204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f028c00baa0 con 0x561633216700 2023-09-13T09:44:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f027d7fa700 1 -- 172.21.15.6:0/2087060204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0284099830 con 0x561633216700 2023-09-13T09:44:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 10 client.16695 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 10 client.16695 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 20 client.16695 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163327f6d0 0x561633281af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 4 client.16695 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:44:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.842+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561633121050 con 0x56163327f6d0 2023-09-13T09:44:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.843+0000 7f0299f76700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163327f6d0 0x561633281af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.843+0000 7f027d7fa700 10 client.16695 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.843+0000 7f0299f76700 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163327f6d0 0x561633281af0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9b9a6b8efff52f server_cookie=d71917bb0468fa2e in_seq=0 out_seq=0 2023-09-13T09:44:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f027d7fa700 1 -- 172.21.15.6:0/2087060204 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561633121050 con 0x56163327f6d0 2023-09-13T09:44:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f027d7fa700 10 client.16695 handle_command_reply: tid=0 2023-09-13T09:44:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 client.16695 shutdown 2023-09-13T09:44:33.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 msgr2=0x561633222a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633222a70 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f0284084010 tx=0x7f0284099430 comp rx=0 tx=0).stop 2023-09-13T09:44:33.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 shutdown_connections 2023-09-13T09:44:33.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561633217060 0x561633225a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561633215a00 0x561633222530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56163327f6d0 0x561633281af0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 --2- 172.21.15.6:0/2087060204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561633216700 0x561633222a70 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f027d7fa700 0 client.16695 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:33.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 >> 172.21.15.6:0/2087060204 conn(0x561633173c80 msgr2=0x56163320fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:33.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 shutdown_connections 2023-09-13T09:44:33.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.844+0000 7f02a83bfb80 1 -- 172.21.15.6:0/2087060204 wait complete. 2023-09-13T09:44:33.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f02a83bfb80 20 client.16695 trim_cache size 0 max 16384 2023-09-13T09:44:33.910 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:44:33.911 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:44:33.911 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:44:33.911 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:44:33.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02800a0640 msgr2=0x7f02800a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02800a0640 0x7f02800a2b00 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f0294101dc0 tx=0x7f0290009260 comp rx=0 tx=0).stop 2023-09-13T09:44:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 msgr2=0x7f02940730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 0x7f02940730a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f028400e9c0 tx=0x7f028400ecd0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 shutdown_connections 2023-09-13T09:44:33.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0294102900 0x7f02940735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02800a0640 0x7f02800a2b00 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0294100d70 0x7f0294074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 --2- 172.21.15.6:0/448394693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0294101f60 0x7f02940730a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:33.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 >> 172.21.15.6:0/448394693 conn(0x7f02940fc2e0 msgr2=0x7f02940fe490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:33.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 shutdown_connections 2023-09-13T09:44:33.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:33.845+0000 7f029c1da700 1 -- 172.21.15.6:0/448394693 wait complete. 2023-09-13T09:44:33.916 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:44:33.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:44:34.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:33 smithi006 ceph-mon[98665]: pgmap v451: 97 pgs: 97 active+clean; 79 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 883 KiB/s wr, 167 op/s 2023-09-13T09:44:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 -- 172.21.15.6:0/2874767599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 msgr2=0x7fe750103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2874767599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750103c60 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe74000b0a0 tx=0x7fe74000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 -- 172.21.15.6:0/2874767599 shutdown_connections 2023-09-13T09:44:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2874767599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe750106ad0 0x7fe750108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2874767599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750103c60 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2874767599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7501041a0 0x7fe750106590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 -- 172.21.15.6:0/2874767599 >> 172.21.15.6:0/2874767599 conn(0x7fe7500fb220 msgr2=0x7fe7500fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 -- 172.21.15.6:0/2874767599 shutdown_connections 2023-09-13T09:44:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.046+0000 7fe7584fd700 1 -- 172.21.15.6:0/2874767599 wait complete. 2023-09-13T09:44:34.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 Processor -- start 2023-09-13T09:44:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 -- start start 2023-09-13T09:44:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750196c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7501041a0 0x7fe750197160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe750106ad0 0x7fe75019e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e760 con 0x7fe750101870 2023-09-13T09:44:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019e8d0 con 0x7fe7501041a0 2023-09-13T09:44:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe7584fd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe75019ea90 con 0x7fe750106ad0 2023-09-13T09:44:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe756299700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750196c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe755a98700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7501041a0 0x7fe750197160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe756299700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750196c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36884/0 (socket says 172.21.15.6:36884) 2023-09-13T09:44:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe756a9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe750106ad0 0x7fe75019e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe755a98700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7501041a0 0x7fe750197160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58642/0 (socket says 172.21.15.6:58642) 2023-09-13T09:44:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.047+0000 7fe756299700 1 -- 172.21.15.6:0/2278061548 learned_addr learned my addr 172.21.15.6:0/2278061548 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe756299700 1 -- 172.21.15.6:0/2278061548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe750106ad0 msgr2=0x7fe75019e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe756299700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe750106ad0 0x7fe75019e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe756299700 1 -- 172.21.15.6:0/2278061548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7501041a0 msgr2=0x7fe750197160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe756299700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7501041a0 0x7fe750197160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe756299700 1 -- 172.21.15.6:0/2278061548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe740009d00 con 0x7fe750101870 2023-09-13T09:44:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe755a98700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7501041a0 0x7fe750197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe756299700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750196c20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe740007a60 tx=0x7fe74000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe74f7fe700 1 -- 172.21.15.6:0/2278061548 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe74000e040 con 0x7fe750101870 2023-09-13T09:44:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe74f7fe700 1 -- 172.21.15.6:0/2278061548 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe740004c50 con 0x7fe750101870 2023-09-13T09:44:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe75019ed10 con 0x7fe750101870 2023-09-13T09:44:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe74f7fe700 1 -- 172.21.15.6:0/2278061548 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7400052a0 con 0x7fe750101870 2023-09-13T09:44:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.048+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe75019f190 con 0x7fe750101870 2023-09-13T09:44:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.049+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7500fcda0 con 0x7fe750101870 2023-09-13T09:44:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.050+0000 7fe74f7fe700 1 -- 172.21.15.6:0/2278061548 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe74001d470 con 0x7fe750101870 2023-09-13T09:44:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.051+0000 7fe74f7fe700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7380a0640 0x7fe7380a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.051+0000 7fe755a98700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7380a0640 0x7fe7380a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.051+0000 7fe74f7fe700 1 -- 172.21.15.6:0/2278061548 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe7400cd160 con 0x7fe750101870 2023-09-13T09:44:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.051+0000 7fe755a98700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7380a0640 0x7fe7380a2b00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe744011490 tx=0x7fe744009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.055+0000 7fe74f7fe700 1 -- 172.21.15.6:0/2278061548 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe740096cd0 con 0x7fe750101870 2023-09-13T09:44:34.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 160259 3.18 MB/sec execute 114 sec latency 14.845 ms 2023-09-13T09:44:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:33 smithi053 ceph-mon[102373]: pgmap v451: 97 pgs: 97 active+clean; 79 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 883 KiB/s wr, 167 op/s 2023-09-13T09:44:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:33 smithi131 ceph-mon[102785]: pgmap v451: 97 pgs: 97 active+clean; 79 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 883 KiB/s wr, 167 op/s 2023-09-13T09:44:34.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.311+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe75002ce10 con 0x7fe750101870 2023-09-13T09:44:34.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.312+0000 7fe74f7fe700 1 -- 172.21.15.6:0/2278061548 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fe74009a2f0 con 0x7fe750101870 2023-09-13T09:44:34.312 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:44:34.313 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:44:34.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7380a0640 msgr2=0x7fe7380a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7380a0640 0x7fe7380a2b00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe744011490 tx=0x7fe744009260 comp rx=0 tx=0).stop 2023-09-13T09:44:34.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 msgr2=0x7fe750196c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750196c20 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe740007a60 tx=0x7fe74000bab0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 shutdown_connections 2023-09-13T09:44:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe750106ad0 0x7fe75019e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7380a0640 0x7fe7380a2b00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe750101870 0x7fe750196c20 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 --2- 172.21.15.6:0/2278061548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe7501041a0 0x7fe750197160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 >> 172.21.15.6:0/2278061548 conn(0x7fe7500fb220 msgr2=0x7fe7501024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 shutdown_connections 2023-09-13T09:44:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.314+0000 7fe7584fd700 1 -- 172.21.15.6:0/2278061548 wait complete. 2023-09-13T09:44:34.317 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:44:34.328 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:44:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.456+0000 7fa5e9066700 1 -- 172.21.15.6:0/2735714001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e41012c0 msgr2=0x7fa5e41016e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.456+0000 7fa5e9066700 1 --2- 172.21.15.6:0/2735714001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e41012c0 0x7fa5e41016e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fa5d4009990 tx=0x7fa5d4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.456+0000 7fa5e9066700 1 -- 172.21.15.6:0/2735714001 shutdown_connections 2023-09-13T09:44:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.456+0000 7fa5e9066700 1 --2- 172.21.15.6:0/2735714001 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5e4100920 0x7fa5e41081c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.456+0000 7fa5e9066700 1 --2- 172.21.15.6:0/2735714001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e41012c0 0x7fa5e41016e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.456+0000 7fa5e9066700 1 --2- 172.21.15.6:0/2735714001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e40fff60 0x7fa5e41003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.456+0000 7fa5e9066700 1 -- 172.21.15.6:0/2735714001 >> 172.21.15.6:0/2735714001 conn(0x7fa5e40fa9b0 msgr2=0x7fa5e40fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.457+0000 7fa5e9066700 1 -- 172.21.15.6:0/2735714001 shutdown_connections 2023-09-13T09:44:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.457+0000 7fa5e9066700 1 -- 172.21.15.6:0/2735714001 wait complete. 2023-09-13T09:44:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.457+0000 7fa5e9066700 1 Processor -- start 2023-09-13T09:44:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.457+0000 7fa5e9066700 1 -- start start 2023-09-13T09:44:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e9066700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e40fff60 0x7fa5e4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e9066700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e4100920 0x7fa5e4199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e9066700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5e41012c0 0x7fa5e41a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e9066700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41a0860 con 0x7fa5e4100920 2023-09-13T09:44:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e9066700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41a09d0 con 0x7fa5e41012c0 2023-09-13T09:44:34.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e9066700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5e41a0b90 con 0x7fa5e40fff60 2023-09-13T09:44:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e4100920 0x7fa5e4199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e4100920 0x7fa5e4199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36900/0 (socket says 172.21.15.6:36900) 2023-09-13T09:44:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 -- 172.21.15.6:0/4151497533 learned_addr learned my addr 172.21.15.6:0/4151497533 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e40fff60 0x7fa5e4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e359e700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5e41012c0 0x7fa5e41a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 -- 172.21.15.6:0/4151497533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e40fff60 msgr2=0x7fa5e4198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e40fff60 0x7fa5e4198d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 -- 172.21.15.6:0/4151497533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5e41012c0 msgr2=0x7fa5e41a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5e41012c0 0x7fa5e41a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 -- 172.21.15.6:0/4151497533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5d40095f0 con 0x7fa5e4100920 2023-09-13T09:44:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5e259c700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e4100920 0x7fa5e4199260 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800d980 tx=0x7fa5d800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.458+0000 7fa5cbfff700 1 -- 172.21.15.6:0/4151497533 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d800de60 con 0x7fa5e4100920 2023-09-13T09:44:34.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.459+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5e41a0e70 con 0x7fa5e4100920 2023-09-13T09:44:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.459+0000 7fa5cbfff700 1 -- 172.21.15.6:0/4151497533 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5d80044e0 con 0x7fa5e4100920 2023-09-13T09:44:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.459+0000 7fa5cbfff700 1 -- 172.21.15.6:0/4151497533 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8003be0 con 0x7fa5e4100920 2023-09-13T09:44:34.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.459+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e41a12f0 con 0x7fa5e4100920 2023-09-13T09:44:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.461+0000 7fa5cbfff700 1 -- 172.21.15.6:0/4151497533 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa5d8009bb0 con 0x7fa5e4100920 2023-09-13T09:44:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.461+0000 7fa5cbfff700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5cc0a0640 0x7fa5cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.461+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5cc0a0640 0x7fa5cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.461+0000 7fa5cbfff700 1 -- 172.21.15.6:0/4151497533 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5d80cb970 con 0x7fa5e4100920 2023-09-13T09:44:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5cc0a0640 0x7fa5cc0a2b00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400b5c0 tx=0x7fa5d4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 Processor -- start 2023-09-13T09:44:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 -- start start 2023-09-13T09:44:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e69700 0x55c636e69b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e68a00 0x55c636e68e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636dc1780 con 0x55c636e68a00 2023-09-13T09:44:34.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636dbf0a0 con 0x55c636e6a060 2023-09-13T09:44:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636dba990 con 0x55c636e69700 2023-09-13T09:44:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5e359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e68a00 0x55c636e68e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5e359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e68a00 0x55c636e68e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36910/0 (socket says 172.21.15.6:36910) 2023-09-13T09:44:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5e359e700 1 -- 172.21.15.6:0/1693400050 learned_addr learned my addr 172.21.15.6:0/1693400050 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5e259c700 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.462+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e69700 0x55c636e69b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5e359e700 1 -- 172.21.15.6:0/1693400050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e69700 msgr2=0x55c636e69b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e69700 0x55c636e69b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5e359e700 1 -- 172.21.15.6:0/1693400050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 msgr2=0x55c636e684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5e359e700 1 -- 172.21.15.6:0/1693400050 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c636c3a630 con 0x55c636e68a00 2023-09-13T09:44:34.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5e259c700 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e68a00 0x55c636e68e80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009dc0 tx=0x7fa5dc0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1be73edb676bee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5c97fa700 1 -- 172.21.15.6:0/1693400050 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc014610 con 0x55c636e68a00 2023-09-13T09:44:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5c97fa700 1 -- 172.21.15.6:0/1693400050 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5dc00f050 con 0x55c636e68a00 2023-09-13T09:44:34.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5c97fa700 1 -- 172.21.15.6:0/1693400050 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0139a0 con 0x55c636e68a00 2023-09-13T09:44:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.463+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1693400050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e68a00 msgr2=0x55c636e68e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e68a00 0x55c636e68e80 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009dc0 tx=0x7fa5dc0077e0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1693400050 shutdown_connections 2023-09-13T09:44:34.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e68a00 0x55c636e68e80 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e69700 0x55c636e69b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1693400050 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1693400050 >> 172.21.15.6:0/1693400050 conn(0x55c636dc6c80 msgr2=0x55c636e62f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1693400050 shutdown_connections 2023-09-13T09:44:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1693400050 wait complete. 2023-09-13T09:44:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- start start 2023-09-13T09:44:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 Processor -- start 2023-09-13T09:44:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e71f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e69700 0x55c636e72450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e6a060 0x55c636e79490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636d58bb0 con 0x55c636e6a060 2023-09-13T09:44:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636d588b0 con 0x55c636e69700 2023-09-13T09:44:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636c3c920 con 0x55c636e68a00 2023-09-13T09:44:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5f524bb80 10 client.0 _ll_register_callbacks cb 0x55c636d56680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:34.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5e359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e6a060 0x55c636e79490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5e359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e6a060 0x55c636e79490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36916/0 (socket says 172.21.15.6:36916) 2023-09-13T09:44:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5e2d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e71f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5e359e700 1 -- 172.21.15.6:0/1352334997 learned_addr learned my addr 172.21.15.6:0/1352334997 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.464+0000 7fa5e259c700 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e69700 0x55c636e72450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5e359e700 1 -- 172.21.15.6:0/1352334997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 msgr2=0x55c636e71f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e71f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5e359e700 1 -- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e69700 msgr2=0x55c636e72450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e69700 0x55c636e72450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5e359e700 1 -- 172.21.15.6:0/1352334997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5dc009a20 con 0x55c636e6a060 2023-09-13T09:44:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e6a060 0x55c636e79490 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009f50 tx=0x7fa5dc013910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=615a4e2bda1c872d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:34.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1352334997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5dc0098c0 con 0x55c636e6a060 2023-09-13T09:44:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c636e5b670 con 0x55c636e6a060 2023-09-13T09:44:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1352334997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5dc014410 con 0x55c636e6a060 2023-09-13T09:44:34.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1352334997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5dc006000 con 0x55c636e6a060 2023-09-13T09:44:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5f524bb80 10 client.16713 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c636dd27a0 con 0x55c636e6a060 2023-09-13T09:44:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.465+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1352334997 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c636e5b670 con 0x55c636e6a060 2023-09-13T09:44:34.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1352334997 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa5dc027770 con 0x55c636e6a060 2023-09-13T09:44:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5f524bb80 10 client.16713 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5f524bb80 10 client.16713 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:44:34.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5f524bb80 20 client.16713 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636e7dbb0 0x55c636e7ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5f524bb80 4 client.16713 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:34.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c636db3970 con 0x55c636e7dbb0 2023-09-13T09:44:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636e7dbb0 0x55c636e7ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5c6ff5700 10 client.16713 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.466+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636e7dbb0 0x55c636e7ffd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7e5d969a6b206206 server_cookie=ff9a1958bd87b70c in_seq=0 out_seq=0 2023-09-13T09:44:34.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1352334997 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c636db3970 con 0x55c636e7dbb0 2023-09-13T09:44:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5c6ff5700 10 client.16713 handle_command_reply: tid=0 2023-09-13T09:44:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 client.16713 shutdown 2023-09-13T09:44:34.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e6a060 msgr2=0x55c636e79490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e6a060 0x55c636e79490 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc009f50 tx=0x7fa5dc013910 comp rx=0 tx=0).stop 2023-09-13T09:44:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 shutdown_connections 2023-09-13T09:44:34.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636e7dbb0 0x55c636e7ffd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e6a060 0x55c636e79490 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5c6ff5700 0 client.16713 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:34.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e71f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1352334997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e69700 0x55c636e72450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 >> 172.21.15.6:0/1352334997 conn(0x55c636dc6c80 msgr2=0x55c636e62ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 shutdown_connections 2023-09-13T09:44:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1352334997 wait complete. 2023-09-13T09:44:34.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.467+0000 7fa5f524bb80 20 client.16713 trim_cache size 0 max 16384 2023-09-13T09:44:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.480+0000 7fa5f524bb80 1 Processor -- start 2023-09-13T09:44:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.480+0000 7fa5f524bb80 1 -- start start 2023-09-13T09:44:34.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.480+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e68a00 0x55c636e684c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.480+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e79450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e6a060 0x55c636e6c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636e64350 con 0x55c636e69700 2023-09-13T09:44:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636e64730 con 0x55c636e68a00 2023-09-13T09:44:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636e72b90 con 0x55c636e6a060 2023-09-13T09:44:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e79450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e79450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36922/0 (socket says 172.21.15.6:36922) 2023-09-13T09:44:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 -- 172.21.15.6:0/3885189717 learned_addr learned my addr 172.21.15.6:0/3885189717 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e359e700 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e6a060 0x55c636e6c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e68a00 0x55c636e684c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 -- 172.21.15.6:0/3885189717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e6a060 msgr2=0x55c636e6c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e6a060 0x55c636e6c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 -- 172.21.15.6:0/3885189717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e68a00 msgr2=0x55c636e684c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e68a00 0x55c636e684c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 -- 172.21.15.6:0/3885189717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c636e690b0 con 0x55c636e69700 2023-09-13T09:44:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e68a00 0x55c636e684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:34.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5e259c700 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e79450 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80990a0 tx=0x7fa5d80954d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a039a809d1e7ef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5c9ffb700 1 -- 172.21.15.6:0/3885189717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d8099110 con 0x55c636e69700 2023-09-13T09:44:34.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5c9ffb700 1 -- 172.21.15.6:0/3885189717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5d809cf40 con 0x55c636e69700 2023-09-13T09:44:34.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.481+0000 7fa5c9ffb700 1 -- 172.21.15.6:0/3885189717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80a0f50 con 0x55c636e69700 2023-09-13T09:44:34.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 -- 172.21.15.6:0/3885189717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 msgr2=0x55c636e79450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e79450 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7fa5d80990a0 tx=0x7fa5d80954d0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 -- 172.21.15.6:0/3885189717 shutdown_connections 2023-09-13T09:44:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e6a060 0x55c636e6c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e68a00 0x55c636e684c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/3885189717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e79450 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 -- 172.21.15.6:0/3885189717 >> 172.21.15.6:0/3885189717 conn(0x55c636dc6c80 msgr2=0x55c636e62e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 -- 172.21.15.6:0/3885189717 shutdown_connections 2023-09-13T09:44:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 -- 172.21.15.6:0/3885189717 wait complete. 2023-09-13T09:44:34.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 -- start start 2023-09-13T09:44:34.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.482+0000 7fa5f524bb80 1 Processor -- start 2023-09-13T09:44:34.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e755e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e75b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e78580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636e78ac0 con 0x55c636e69700 2023-09-13T09:44:34.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636e78c30 con 0x55c636e6a060 2023-09-13T09:44:34.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c636e78df0 con 0x55c636e68a00 2023-09-13T09:44:34.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 10 client.0 _ll_register_callbacks cb 0x55c636d56680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:34.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e75b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e75b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36928/0 (socket says 172.21.15.6:36928) 2023-09-13T09:44:34.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 -- 172.21.15.6:0/1745753482 learned_addr learned my addr 172.21.15.6:0/1745753482 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e755e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e78580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 -- 172.21.15.6:0/1745753482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 msgr2=0x55c636e755e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e755e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 -- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 msgr2=0x55c636e78580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e78580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 -- 172.21.15.6:0/1745753482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5e41a12f0 con 0x55c636e69700 2023-09-13T09:44:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e359e700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e78580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5e259c700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e75b20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800d950 tx=0x7fa5d8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf04c6ef49317492 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5c6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:34.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1745753482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5d80a0ef0 con 0x55c636e69700 2023-09-13T09:44:34.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1745753482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5d8099110 con 0x55c636e69700 2023-09-13T09:44:34.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.483+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5dc00f050 con 0x55c636e69700 2023-09-13T09:44:34.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1745753482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5d80a1180 con 0x55c636e69700 2023-09-13T09:44:34.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 10 client.16719 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:34.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c636be6de0 con 0x55c636e69700 2023-09-13T09:44:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1745753482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5dc00f050 con 0x55c636e69700 2023-09-13T09:44:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1745753482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa5d8098200 con 0x55c636e69700 2023-09-13T09:44:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 10 client.16719 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:34.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 10 client.16719 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:44:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 20 client.16719 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636ed23c0 0x55c636ed47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 4 client.16719 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c636d74050 con 0x55c636ed23c0 2023-09-13T09:44:34.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.484+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636ed23c0 0x55c636ed47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5e2d9d700 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636ed23c0 0x55c636ed47e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bab899f4f027ac8a server_cookie=65ad99b539d7ff9 in_seq=0 out_seq=0 2023-09-13T09:44:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5c6ff5700 10 client.16719 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5c6ff5700 1 -- 172.21.15.6:0/1745753482 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c636d74050 con 0x55c636ed23c0 2023-09-13T09:44:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5c6ff5700 10 client.16719 handle_command_reply: tid=0 2023-09-13T09:44:34.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 client.16719 shutdown 2023-09-13T09:44:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 msgr2=0x55c636e75b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e75b20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800d950 tx=0x7fa5d8004750 comp rx=0 tx=0).stop 2023-09-13T09:44:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 shutdown_connections 2023-09-13T09:44:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c636ed23c0 0x55c636ed47e0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c636e6a060 0x55c636e78580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5c6ff5700 0 client.16719 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:44:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c636e68a00 0x55c636e755e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 --2- 172.21.15.6:0/1745753482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c636e69700 0x55c636e75b20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 >> 172.21.15.6:0/1745753482 conn(0x55c636dc6c80 msgr2=0x55c636e6c940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 shutdown_connections 2023-09-13T09:44:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 1 -- 172.21.15.6:0/1745753482 wait complete. 2023-09-13T09:44:34.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5f524bb80 20 client.16719 trim_cache size 0 max 16384 2023-09-13T09:44:34.533 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5cc0a0640 msgr2=0x7fa5cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5e9066700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5cc0a0640 0x7fa5cc0a2b00 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa5d400b5c0 tx=0x7fa5d4005fb0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e4100920 msgr2=0x7fa5e4199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.485+0000 7fa5e9066700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e4100920 0x7fa5e4199260 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fa5d800d980 tx=0x7fa5d800dd40 comp rx=0 tx=0).stop 2023-09-13T09:44:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 shutdown_connections 2023-09-13T09:44:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5e41012c0 0x7fa5e41a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5e40fff60 0x7fa5e4198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5cc0a0640 0x7fa5cc0a2b00 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 --2- 172.21.15.6:0/4151497533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5e4100920 0x7fa5e4199260 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 >> 172.21.15.6:0/4151497533 conn(0x7fa5e40fa9b0 msgr2=0x7fa5e40feed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 shutdown_connections 2023-09-13T09:44:34.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.486+0000 7fa5e9066700 1 -- 172.21.15.6:0/4151497533 wait complete. 2023-09-13T09:44:34.538 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:44:34.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 -- 172.21.15.6:0/3878608015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 msgr2=0x7f30d0106600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 --2- 172.21.15.6:0/3878608015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d0106600 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009990 tx=0x7f30c4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 -- 172.21.15.6:0/3878608015 shutdown_connections 2023-09-13T09:44:34.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 --2- 172.21.15.6:0/3878608015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30d0106b40 0x7f30d0108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 --2- 172.21.15.6:0/3878608015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d01018e0 0x7f30d0103cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 --2- 172.21.15.6:0/3878608015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d0106600 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 -- 172.21.15.6:0/3878608015 >> 172.21.15.6:0/3878608015 conn(0x7f30d00fb250 msgr2=0x7f30d00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 -- 172.21.15.6:0/3878608015 shutdown_connections 2023-09-13T09:44:34.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.667+0000 7f30d8609700 1 -- 172.21.15.6:0/3878608015 wait complete. 2023-09-13T09:44:34.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 Processor -- start 2023-09-13T09:44:34.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 -- start start 2023-09-13T09:44:34.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30d01018e0 0x7f30d0101250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d00ff890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d0106b40 0x7f30d00ffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d0100570 con 0x7f30d0104210 2023-09-13T09:44:34.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d01006e0 con 0x7f30d0106b40 2023-09-13T09:44:34.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d8609700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30d01a0a80 con 0x7f30d01018e0 2023-09-13T09:44:34.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d00ff890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d00ff890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36942/0 (socket says 172.21.15.6:36942) 2023-09-13T09:44:34.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 -- 172.21.15.6:0/566589422 learned_addr learned my addr 172.21.15.6:0/566589422 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d63a5700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30d01018e0 0x7f30d0101250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d6ba6700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d0106b40 0x7f30d00ffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 -- 172.21.15.6:0/566589422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30d01018e0 msgr2=0x7f30d0101250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30d01018e0 0x7f30d0101250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 -- 172.21.15.6:0/566589422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d0106b40 msgr2=0x7f30d00ffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d0106b40 0x7f30d00ffdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.668+0000 7f30d5ba4700 1 -- 172.21.15.6:0/566589422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40095f0 con 0x7f30d0104210 2023-09-13T09:44:34.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.669+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d00ff890 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f30c40059d0 tx=0x7f30c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.669+0000 7f30c37fe700 1 -- 172.21.15.6:0/566589422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c401d070 con 0x7f30d0104210 2023-09-13T09:44:34.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.669+0000 7f30c37fe700 1 -- 172.21.15.6:0/566589422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c400fb90 con 0x7f30d0104210 2023-09-13T09:44:34.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.669+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30d01a0d00 con 0x7f30d0104210 2023-09-13T09:44:34.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.669+0000 7f30c37fe700 1 -- 172.21.15.6:0/566589422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c40173f0 con 0x7f30d0104210 2023-09-13T09:44:34.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.669+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d01a1120 con 0x7f30d0104210 2023-09-13T09:44:34.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.671+0000 7f30c37fe700 1 -- 172.21.15.6:0/566589422 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f30c400fd00 con 0x7f30d0104210 2023-09-13T09:44:34.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.671+0000 7f30c37fe700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30bc0a0640 0x7f30bc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.672+0000 7f30c37fe700 1 -- 172.21.15.6:0/566589422 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f30c40ccfc0 con 0x7f30d0104210 2023-09-13T09:44:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.672+0000 7f30d63a5700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30bc0a0640 0x7f30bc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.672+0000 7f30d63a5700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30bc0a0640 0x7f30bc0a2b00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009c60 tx=0x7f30cc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.672+0000 7f30e47eeb80 1 Processor -- start 2023-09-13T09:44:34.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30e47eeb80 1 -- start start 2023-09-13T09:44:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf5cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf5b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1beb4780 con 0x55ac1bf5d060 2023-09-13T09:44:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1beb20a0 con 0x55ac1bf5ba00 2023-09-13T09:44:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bead990 con 0x55ac1bf5c700 2023-09-13T09:44:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf5b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf5b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36950/0 (socket says 172.21.15.6:36950) 2023-09-13T09:44:34.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3428315691 learned_addr learned my addr 172.21.15.6:0/3428315691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d63a5700 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf5cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d6ba6700 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3428315691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 msgr2=0x55ac1bf5cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf5cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3428315691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 msgr2=0x55ac1bf5be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3428315691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1bd2d630 con 0x55ac1bf5d060 2023-09-13T09:44:34.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.673+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf5b4c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f30c40a22a0 tx=0x7f30c4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180e85a4e2966b06 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30c0ff9700 1 -- 172.21.15.6:0/3428315691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c409aef0 con 0x55ac1bf5d060 2023-09-13T09:44:34.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30c0ff9700 1 -- 172.21.15.6:0/3428315691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c409a7f0 con 0x55ac1bf5d060 2023-09-13T09:44:34.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30c0ff9700 1 -- 172.21.15.6:0/3428315691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c40a2340 con 0x55ac1bf5d060 2023-09-13T09:44:34.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3428315691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 msgr2=0x55ac1bf5b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf5b4c0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f30c40a22a0 tx=0x7f30c4005ef0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3428315691 shutdown_connections 2023-09-13T09:44:34.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf5cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3428315691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf5b4c0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3428315691 >> 172.21.15.6:0/3428315691 conn(0x55ac1beb9c80 msgr2=0x55ac1bf55f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3428315691 shutdown_connections 2023-09-13T09:44:34.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.674+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3428315691 wait complete. 2023-09-13T09:44:34.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 -- start start 2023-09-13T09:44:34.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 Processor -- start 2023-09-13T09:44:34.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf64b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf650c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1be4bbb0 con 0x55ac1bf5d060 2023-09-13T09:44:34.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1be4b8b0 con 0x55ac1bf5ba00 2023-09-13T09:44:34.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bd2f920 con 0x55ac1bf5c700 2023-09-13T09:44:34.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30e47eeb80 10 client.0 _ll_register_callbacks cb 0x55ac1be49680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30d6ba6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30d6ba6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36958/0 (socket says 172.21.15.6:36958) 2023-09-13T09:44:34.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30d6ba6700 1 -- 172.21.15.6:0/2185122622 learned_addr learned my addr 172.21.15.6:0/2185122622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.675+0000 7f30d63a5700 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf64b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30d6ba6700 1 -- 172.21.15.6:0/2185122622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 msgr2=0x55ac1bf650c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30d6ba6700 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf650c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30d6ba6700 1 -- 172.21.15.6:0/2185122622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 msgr2=0x55ac1bf64b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30d6ba6700 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf64b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30d6ba6700 1 -- 172.21.15.6:0/2185122622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30d01a1120 con 0x55ac1bf5d060 2023-09-13T09:44:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30d63a5700 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf64b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30d6ba6700 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c100 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f30c8012e20 tx=0x7f30c8014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72efa499da83ec4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30b9ffb700 1 -- 172.21.15.6:0/2185122622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c800e040 con 0x55ac1bf5d060 2023-09-13T09:44:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30b9ffb700 1 -- 172.21.15.6:0/2185122622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f30c8014b90 con 0x55ac1bf5d060 2023-09-13T09:44:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac1bf4e670 con 0x55ac1bf5d060 2023-09-13T09:44:34.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30b9ffb700 1 -- 172.21.15.6:0/2185122622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30c8014d50 con 0x55ac1bf5d060 2023-09-13T09:44:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30e47eeb80 10 client.16731 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ac1bec57a0 con 0x55ac1bf5d060 2023-09-13T09:44:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30b9ffb700 1 -- 172.21.15.6:0/2185122622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ac1bf4e670 con 0x55ac1bf5d060 2023-09-13T09:44:34.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30b9ffb700 1 -- 172.21.15.6:0/2185122622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30c801c020 con 0x55ac1bf5d060 2023-09-13T09:44:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30e47eeb80 10 client.16731 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30e47eeb80 10 client.16731 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:44:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.676+0000 7f30e47eeb80 20 client.16731 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.677+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bf70980 0x55ac1bf72da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.677+0000 7f30e47eeb80 4 client.16731 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.677+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac1bea6970 con 0x55ac1bf70980 2023-09-13T09:44:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.677+0000 7f30d63a5700 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bf70980 0x55ac1bf72da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.677+0000 7f30b9ffb700 10 client.16731 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.677+0000 7f30d63a5700 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bf70980 0x55ac1bf72da0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=14673c4fb9b4b5b5 server_cookie=1ae242490d52e154 in_seq=0 out_seq=0 2023-09-13T09:44:34.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30b9ffb700 1 -- 172.21.15.6:0/2185122622 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ac1bea6970 con 0x55ac1bf70980 2023-09-13T09:44:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30b9ffb700 10 client.16731 handle_command_reply: tid=0 2023-09-13T09:44:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 client.16731 shutdown 2023-09-13T09:44:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 msgr2=0x55ac1bf6c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c100 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f30c8012e20 tx=0x7f30c8014600 comp rx=0 tx=0).stop 2023-09-13T09:44:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 shutdown_connections 2023-09-13T09:44:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bf70980 0x55ac1bf72da0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c100 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf64b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30b9ffb700 0 client.16731 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/2185122622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5c700 0x55ac1bf650c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 >> 172.21.15.6:0/2185122622 conn(0x55ac1beb9c80 msgr2=0x55ac1bf507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 shutdown_connections 2023-09-13T09:44:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 1 -- 172.21.15.6:0/2185122622 wait complete. 2023-09-13T09:44:34.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.678+0000 7f30e47eeb80 20 client.16731 trim_cache size 0 max 16384 2023-09-13T09:44:34.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 Processor -- start 2023-09-13T09:44:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 -- start start 2023-09-13T09:44:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf6c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bf4e650 con 0x55ac1bf5c700 2023-09-13T09:44:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bf646f0 con 0x55ac1bf5d060 2023-09-13T09:44:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bf56cf0 con 0x55ac1bf5ba00 2023-09-13T09:44:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf6c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf6c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36964/0 (socket says 172.21.15.6:36964) 2023-09-13T09:44:34.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3264834987 learned_addr learned my addr 172.21.15.6:0/3264834987 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.691+0000 7f30d63a5700 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30d6ba6700 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3264834987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5ba00 msgr2=0x55ac1bf5b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3264834987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5d060 msgr2=0x55ac1bf6c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30d5ba4700 1 -- 172.21.15.6:0/3264834987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac1bcd9de0 con 0x55ac1bf5c700 2023-09-13T09:44:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf6c020 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f30c4097260 tx=0x7f30c409a460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc6530bc3d4ecad server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30c17fa700 1 -- 172.21.15.6:0/3264834987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c409e620 con 0x55ac1bf5c700 2023-09-13T09:44:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30c17fa700 1 -- 172.21.15.6:0/3264834987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c40a27d0 con 0x55ac1bf5c700 2023-09-13T09:44:34.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30c17fa700 1 -- 172.21.15.6:0/3264834987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c4096040 con 0x55ac1bf5c700 2023-09-13T09:44:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3264834987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 msgr2=0x55ac1bf6c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf6c020 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f30c4097260 tx=0x7f30c409a460 comp rx=0 tx=0).stop 2023-09-13T09:44:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3264834987 shutdown_connections 2023-09-13T09:44:34.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.692+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf5b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/3264834987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf6c020 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3264834987 >> 172.21.15.6:0/3264834987 conn(0x55ac1beb9c80 msgr2=0x55ac1bf55e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3264834987 shutdown_connections 2023-09-13T09:44:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 -- 172.21.15.6:0/3264834987 wait complete. 2023-09-13T09:44:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 -- start start 2023-09-13T09:44:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 Processor -- start 2023-09-13T09:44:34.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf679f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf67f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bf6b440 con 0x55ac1bf5c700 2023-09-13T09:44:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bf6b5b0 con 0x55ac1bf5ba00 2023-09-13T09:44:34.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac1bf6b770 con 0x55ac1bf5d060 2023-09-13T09:44:34.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30e47eeb80 10 client.0 _ll_register_callbacks cb 0x55ac1be49680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:34.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf67f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30d5ba4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf67f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36970/0 (socket says 172.21.15.6:36970) 2023-09-13T09:44:34.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30d5ba4700 1 -- 172.21.15.6:0/4148234650 learned_addr learned my addr 172.21.15.6:0/4148234650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30d6ba6700 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.693+0000 7f30d63a5700 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30d5ba4700 1 -- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5d060 msgr2=0x55ac1bf6af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30d5ba4700 1 -- 172.21.15.6:0/4148234650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 msgr2=0x55ac1bf679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30d5ba4700 1 -- 172.21.15.6:0/4148234650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac1bd2d630 con 0x55ac1bf5c700 2023-09-13T09:44:34.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30d5ba4700 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf67f30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f30c40a22a0 tx=0x7f30c40047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91c3f54f69598a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:34.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30b9ffb700 1 -- 172.21.15.6:0/4148234650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c409e370 con 0x55ac1bf5c700 2023-09-13T09:44:34.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30b9ffb700 1 -- 172.21.15.6:0/4148234650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f30c407d070 con 0x55ac1bf5c700 2023-09-13T09:44:34.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f30c409a7f0 con 0x55ac1bf5c700 2023-09-13T09:44:34.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30b9ffb700 1 -- 172.21.15.6:0/4148234650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30c409e620 con 0x55ac1bf5c700 2023-09-13T09:44:34.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 10 client.16737 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:34.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ac1bcc2c60 con 0x55ac1bf5c700 2023-09-13T09:44:34.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30b9ffb700 1 -- 172.21.15.6:0/4148234650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f30c409a7f0 con 0x55ac1bf5c700 2023-09-13T09:44:34.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30b9ffb700 1 -- 172.21.15.6:0/4148234650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f30c40966e0 con 0x55ac1bf5c700 2023-09-13T09:44:34.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 10 client.16737 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:34.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 10 client.16737 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:44:34.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 20 client.16737 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:34.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bfc4f70 0x55ac1bfc7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 4 client.16737 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:34.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.694+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ac1be67050 con 0x55ac1bfc4f70 2023-09-13T09:44:34.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30d63a5700 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bfc4f70 0x55ac1bfc7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30b9ffb700 10 client.16737 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:34.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30d63a5700 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bfc4f70 0x55ac1bfc7390 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=965e58c73eb625f4 server_cookie=552e57ca56535e02 in_seq=0 out_seq=0 2023-09-13T09:44:34.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30b9ffb700 1 -- 172.21.15.6:0/4148234650 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ac1be67050 con 0x55ac1bfc4f70 2023-09-13T09:44:34.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30b9ffb700 10 client.16737 handle_command_reply: tid=0 2023-09-13T09:44:34.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 client.16737 shutdown 2023-09-13T09:44:34.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 msgr2=0x55ac1bf67f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf67f30 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f30c40a22a0 tx=0x7f30c40047a0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 shutdown_connections 2023-09-13T09:44:34.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ac1bfc4f70 0x55ac1bfc7390 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac1bf5d060 0x55ac1bf6af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30b9ffb700 0 client.16737 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:44:34.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac1bf5ba00 0x55ac1bf679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.695+0000 7f30e47eeb80 1 --2- 172.21.15.6:0/4148234650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac1bf5c700 0x55ac1bf67f30 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 >> 172.21.15.6:0/4148234650 conn(0x55ac1beb9c80 msgr2=0x55ac1bf5f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 shutdown_connections 2023-09-13T09:44:34.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30e47eeb80 1 -- 172.21.15.6:0/4148234650 wait complete. 2023-09-13T09:44:34.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30e47eeb80 20 client.16737 trim_cache size 0 max 16384 2023-09-13T09:44:34.735 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:34.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30bc0a0640 msgr2=0x7f30bc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30bc0a0640 0x7f30bc0a2b00 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009c60 tx=0x7f30cc009260 comp rx=0 tx=0).stop 2023-09-13T09:44:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 msgr2=0x7f30d00ff890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d00ff890 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f30c40059d0 tx=0x7f30c4004730 comp rx=0 tx=0).stop 2023-09-13T09:44:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 shutdown_connections 2023-09-13T09:44:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f30d0106b40 0x7f30d00ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30d01018e0 0x7f30d0101250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30bc0a0640 0x7f30bc0a2b00 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 --2- 172.21.15.6:0/566589422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30d0104210 0x7f30d00ff890 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 >> 172.21.15.6:0/566589422 conn(0x7f30d00fb250 msgr2=0x7f30d0102550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 shutdown_connections 2023-09-13T09:44:34.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.696+0000 7f30d8609700 1 -- 172.21.15.6:0/566589422 wait complete. 2023-09-13T09:44:34.740 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:44:34.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.868+0000 7faa95b93700 1 -- 172.21.15.6:0/2818558943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 msgr2=0x7faa90103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.868+0000 7faa95b93700 1 --2- 172.21.15.6:0/2818558943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90103c90 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7faa80009990 tx=0x7faa80009ca0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 -- 172.21.15.6:0/2818558943 shutdown_connections 2023-09-13T09:44:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 --2- 172.21.15.6:0/2818558943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa90106b00 0x7faa90108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 --2- 172.21.15.6:0/2818558943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90103c90 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 --2- 172.21.15.6:0/2818558943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa901041d0 0x7faa901065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 -- 172.21.15.6:0/2818558943 >> 172.21.15.6:0/2818558943 conn(0x7faa900fb250 msgr2=0x7faa900fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 -- 172.21.15.6:0/2818558943 shutdown_connections 2023-09-13T09:44:34.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 -- 172.21.15.6:0/2818558943 wait complete. 2023-09-13T09:44:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 Processor -- start 2023-09-13T09:44:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.869+0000 7faa95b93700 1 -- start start 2023-09-13T09:44:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa901041d0 0x7faa90196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa90106b00 0x7faa9019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9019e630 con 0x7faa901018a0 2023-09-13T09:44:34.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9019e770 con 0x7faa901041d0 2023-09-13T09:44:34.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9019e900 con 0x7faa90106b00 2023-09-13T09:44:34.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36982/0 (socket says 172.21.15.6:36982) 2023-09-13T09:44:34.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 -- 172.21.15.6:0/4213298575 learned_addr learned my addr 172.21.15.6:0/4213298575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8effd700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa901041d0 0x7faa90196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8ffff700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa90106b00 0x7faa9019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 -- 172.21.15.6:0/4213298575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa90106b00 msgr2=0x7faa9019e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa90106b00 0x7faa9019e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 -- 172.21.15.6:0/4213298575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa901041d0 msgr2=0x7faa90196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa901041d0 0x7faa90196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 -- 172.21.15.6:0/4213298575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa800095f0 con 0x7faa901018a0 2023-09-13T09:44:34.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8effd700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa901041d0 0x7faa90196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:34.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8ffff700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa90106b00 0x7faa9019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:34.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90196ab0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7faa80005910 tx=0x7faa8001caf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8cff9700 1 -- 172.21.15.6:0/4213298575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa80021070 con 0x7faa901018a0 2023-09-13T09:44:34.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8cff9700 1 -- 172.21.15.6:0/4213298575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa8001cdd0 con 0x7faa901018a0 2023-09-13T09:44:34.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa900ff690 con 0x7faa901018a0 2023-09-13T09:44:34.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa8cff9700 1 -- 172.21.15.6:0/4213298575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800277a0 con 0x7faa901018a0 2023-09-13T09:44:34.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.870+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa900ffb40 con 0x7faa901018a0 2023-09-13T09:44:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.873+0000 7faa8cff9700 1 -- 172.21.15.6:0/4213298575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7faa80025070 con 0x7faa901018a0 2023-09-13T09:44:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.874+0000 7faa8cff9700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa7c0a0640 0x7faa7c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.874+0000 7faa8cff9700 1 -- 172.21.15.6:0/4213298575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa800d1260 con 0x7faa901018a0 2023-09-13T09:44:34.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.874+0000 7faa8effd700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa7c0a0640 0x7faa7c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.874+0000 7faaa1d78b80 1 Processor -- start 2023-09-13T09:44:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faaa1d78b80 1 -- start start 2023-09-13T09:44:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa7c0a0640 0x7faa7c0a2b00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa78005fd0 tx=0x7faa78005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b12b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b11e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271a6a780 con 0x559271b13060 2023-09-13T09:44:34.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271a680a0 con 0x559271b11a00 2023-09-13T09:44:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271a63990 con 0x559271b12700 2023-09-13T09:44:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b114c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36992/0 (socket says 172.21.15.6:36992) 2023-09-13T09:44:34.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 -- 172.21.15.6:0/2391463410 learned_addr learned my addr 172.21.15.6:0/2391463410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b12b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8ffff700 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b11e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 -- 172.21.15.6:0/2391463410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 msgr2=0x559271b12b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b12b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 -- 172.21.15.6:0/2391463410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 msgr2=0x559271b11e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b11e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 -- 172.21.15.6:0/2391463410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592718e3630 con 0x559271b13060 2023-09-13T09:44:34.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.875+0000 7faa8effd700 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b114c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7faa7800edd0 tx=0x7faa78009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18c3bb8951b7024 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faa85ffb700 1 -- 172.21.15.6:0/2391463410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa78022070 con 0x559271b13060 2023-09-13T09:44:34.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faa85ffb700 1 -- 172.21.15.6:0/2391463410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa7800ee00 con 0x559271b13060 2023-09-13T09:44:34.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faa85ffb700 1 -- 172.21.15.6:0/2391463410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa78005440 con 0x559271b13060 2023-09-13T09:44:34.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2391463410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 msgr2=0x559271b114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b114c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7faa7800edd0 tx=0x7faa78009f90 comp rx=0 tx=0).stop 2023-09-13T09:44:34.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2391463410 shutdown_connections 2023-09-13T09:44:34.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b11e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b12b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2391463410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b114c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2391463410 >> 172.21.15.6:0/2391463410 conn(0x559271a6fc80 msgr2=0x559271b0bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2391463410 shutdown_connections 2023-09-13T09:44:34.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.876+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2391463410 wait complete. 2023-09-13T09:44:34.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.877+0000 7faaa1d78b80 1 -- start start 2023-09-13T09:44:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.877+0000 7faaa1d78b80 1 Processor -- start 2023-09-13T09:44:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.877+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b11a00 0x559271b1aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.877+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b12700 0x559271b1b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b22440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271a01bb0 con 0x559271b12700 2023-09-13T09:44:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271a018b0 con 0x559271b13060 2023-09-13T09:44:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592718e5920 con 0x559271b11a00 2023-09-13T09:44:34.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 10 client.0 _ll_register_callbacks cb 0x5592719ff680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:34.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b12700 0x559271b1b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b12700 0x559271b1b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36998/0 (socket says 172.21.15.6:36998) 2023-09-13T09:44:34.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 -- 172.21.15.6:0/3411525003 learned_addr learned my addr 172.21.15.6:0/3411525003 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b11a00 0x559271b1aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8ffff700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b22440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 -- 172.21.15.6:0/3411525003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b11a00 msgr2=0x559271b1aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b11a00 0x559271b1aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 -- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 msgr2=0x559271b22440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b22440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 -- 172.21.15.6:0/3411525003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7800eab0 con 0x559271b12700 2023-09-13T09:44:34.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8ffff700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b22440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:34.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa8effd700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b12700 0x559271b1b400 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faa78011a30 tx=0x7faa78005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f616a5e63974b6b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa6effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:34.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa6effd700 1 -- 172.21.15.6:0/3411525003 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa78022070 con 0x559271b12700 2023-09-13T09:44:34.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa6effd700 1 -- 172.21.15.6:0/3411525003 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa78004020 con 0x559271b12700 2023-09-13T09:44:34.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559271b04670 con 0x559271b12700 2023-09-13T09:44:34.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faa6effd700 1 -- 172.21.15.6:0/3411525003 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa78011d60 con 0x559271b12700 2023-09-13T09:44:34.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 10 client.16749 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:34.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.878+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559271a7b7a0 con 0x559271b12700 2023-09-13T09:44:34.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faa6effd700 1 -- 172.21.15.6:0/3411525003 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559271b04670 con 0x559271b12700 2023-09-13T09:44:34.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faa6effd700 1 -- 172.21.15.6:0/3411525003 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faa780037c0 con 0x559271b12700 2023-09-13T09:44:34.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faaa1d78b80 10 client.16749 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:34.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faaa1d78b80 10 client.16749 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:44:34.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faaa1d78b80 20 client.16749 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:34.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b26b90 0x559271b28fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faaa1d78b80 4 client.16749 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:34.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559271a5c970 con 0x559271b26b90 2023-09-13T09:44:34.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b26b90 0x559271b28fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faa6effd700 10 client.16749 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:34.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.879+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b26b90 0x559271b28fb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d0c2e3e812fa89a server_cookie=7fdd16971879d9b2 in_seq=0 out_seq=0 2023-09-13T09:44:34.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.880+0000 7faa6effd700 1 -- 172.21.15.6:0/3411525003 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559271a5c970 con 0x559271b26b90 2023-09-13T09:44:34.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.880+0000 7faa6effd700 10 client.16749 handle_command_reply: tid=0 2023-09-13T09:44:34.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.880+0000 7faaa1d78b80 1 client.16749 shutdown 2023-09-13T09:44:34.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b12700 msgr2=0x559271b1b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b12700 0x559271b1b400 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faa78011a30 tx=0x7faa78005730 comp rx=0 tx=0).stop 2023-09-13T09:44:34.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 shutdown_connections 2023-09-13T09:44:34.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b26b90 0x559271b28fb0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b22440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faa6effd700 0 client.16749 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:34.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b11a00 0x559271b1aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/3411525003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b12700 0x559271b1b400 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 >> 172.21.15.6:0/3411525003 conn(0x559271a6fc80 msgr2=0x559271b067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 shutdown_connections 2023-09-13T09:44:34.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 1 -- 172.21.15.6:0/3411525003 wait complete. 2023-09-13T09:44:34.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.881+0000 7faaa1d78b80 20 client.16749 trim_cache size 0 max 16384 2023-09-13T09:44:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 Processor -- start 2023-09-13T09:44:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 -- start start 2023-09-13T09:44:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b11a00 0x559271b114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b22400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b1a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271b0d7d0 con 0x559271b11a00 2023-09-13T09:44:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271b196b0 con 0x559271b13060 2023-09-13T09:44:34.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271b18ba0 con 0x559271b12700 2023-09-13T09:44:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b11a00 0x559271b114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b11a00 0x559271b114c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37004/0 (socket says 172.21.15.6:37004) 2023-09-13T09:44:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faa8f7fe700 1 -- 172.21.15.6:0/2101401961 learned_addr learned my addr 172.21.15.6:0/2101401961 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faa8effd700 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b22400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.894+0000 7faa8ffff700 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b1a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa8f7fe700 1 -- 172.21.15.6:0/2101401961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 msgr2=0x559271b22400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b22400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa8f7fe700 1 -- 172.21.15.6:0/2101401961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 msgr2=0x559271b1a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b1a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa8f7fe700 1 -- 172.21.15.6:0/2101401961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55927188fde0 con 0x559271b11a00 2023-09-13T09:44:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa8ffff700 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b1a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:34.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b11a00 0x559271b114c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7faa800cecb0 tx=0x7faa80009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd3b242e969fa3f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa867fc700 1 -- 172.21.15.6:0/2101401961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa800cedc0 con 0x559271b11a00 2023-09-13T09:44:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa867fc700 1 -- 172.21.15.6:0/2101401961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa8009cef0 con 0x559271b11a00 2023-09-13T09:44:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faa867fc700 1 -- 172.21.15.6:0/2101401961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8009e040 con 0x559271b11a00 2023-09-13T09:44:34.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2101401961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b11a00 msgr2=0x559271b114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b11a00 0x559271b114c0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7faa800cecb0 tx=0x7faa80009ca0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2101401961 shutdown_connections 2023-09-13T09:44:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b13060 0x559271b1a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b11a00 0x559271b114c0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2101401961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b22400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2101401961 >> 172.21.15.6:0/2101401961 conn(0x559271a6fc80 msgr2=0x559271b19bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2101401961 shutdown_connections 2023-09-13T09:44:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.895+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2101401961 wait complete. 2023-09-13T09:44:34.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 -- start start 2023-09-13T09:44:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 Processor -- start 2023-09-13T09:44:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b1dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b1e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b211c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271b21700 con 0x559271b13060 2023-09-13T09:44:34.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271b21870 con 0x559271b11a00 2023-09-13T09:44:34.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559271b21a30 con 0x559271b12700 2023-09-13T09:44:34.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faaa1d78b80 10 client.0 _ll_register_callbacks cb 0x5592719ff680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:34.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faa8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b211c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faa8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b1e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b1dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faa8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b1e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40066/0 (socket says 172.21.15.6:40066) 2023-09-13T09:44:34.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faa8f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b1dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58766/0 (socket says 172.21.15.6:58766) 2023-09-13T09:44:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faa8effd700 1 -- 172.21.15.6:0/2773408577 learned_addr learned my addr 172.21.15.6:0/2773408577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.896+0000 7faa8ffff700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b211c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37014/0 (socket says 172.21.15.6:37014) 2023-09-13T09:44:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8effd700 1 -- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 msgr2=0x559271b1dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8effd700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b1dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8effd700 1 -- 172.21.15.6:0/2773408577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 msgr2=0x559271b211c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:34.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8effd700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b211c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8effd700 1 -- 172.21.15.6:0/2773408577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa900ffb40 con 0x559271b12700 2023-09-13T09:44:34.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b1dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:34.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8ffff700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa8effd700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b1e1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa780095a0 tx=0x7faa78009a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e9282180eedeea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa6effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:44:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa6effd700 1 -- 172.21.15.6:0/2773408577 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa78022040 con 0x559271b12700 2023-09-13T09:44:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa6effd700 1 -- 172.21.15.6:0/2773408577 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa78003890 con 0x559271b12700 2023-09-13T09:44:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa7800ee00 con 0x559271b12700 2023-09-13T09:44:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa6effd700 1 -- 172.21.15.6:0/2773408577 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa78004920 con 0x559271b12700 2023-09-13T09:44:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faaa1d78b80 10 client.26140 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559271878c60 con 0x559271b12700 2023-09-13T09:44:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.897+0000 7faa6effd700 1 -- 172.21.15.6:0/2773408577 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa7800ee00 con 0x559271b12700 2023-09-13T09:44:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faa6effd700 1 -- 172.21.15.6:0/2773408577 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faa78004230 con 0x559271b12700 2023-09-13T09:44:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faaa1d78b80 10 client.26140 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faaa1d78b80 10 client.26140 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:44:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faaa1d78b80 20 client.26140 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:34.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b7af00 0x559271b7d320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:34.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faaa1d78b80 4 client.26140 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:34.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559271a1d050 con 0x559271b7af00 2023-09-13T09:44:34.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b7af00 0x559271b7d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:34.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faa6effd700 10 client.26140 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.898+0000 7faa8f7fe700 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b7af00 0x559271b7d320 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b2d10b5ea945423 server_cookie=364aec3d088c3b9f in_seq=0 out_seq=0 2023-09-13T09:44:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa6effd700 1 -- 172.21.15.6:0/2773408577 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559271a1d050 con 0x559271b7af00 2023-09-13T09:44:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa6effd700 10 client.26140 handle_command_reply: tid=0 2023-09-13T09:44:34.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 client.26140 shutdown 2023-09-13T09:44:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 msgr2=0x559271b1e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b1e1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa780095a0 tx=0x7faa78009a80 comp rx=0 tx=0).stop 2023-09-13T09:44:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 shutdown_connections 2023-09-13T09:44:34.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559271b7af00 0x559271b7d320 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559271b13060 0x559271b211c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559271b11a00 0x559271b1dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa6effd700 0 client.26140 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:44:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 --2- 172.21.15.6:0/2773408577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559271b12700 0x559271b1e1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 >> 172.21.15.6:0/2773408577 conn(0x559271a6fc80 msgr2=0x559271b0be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 shutdown_connections 2023-09-13T09:44:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 1 -- 172.21.15.6:0/2773408577 wait complete. 2023-09-13T09:44:34.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faaa1d78b80 20 client.26140 trim_cache size 0 max 16384 2023-09-13T09:44:34.938 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:34.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa7c0a0640 msgr2=0x7faa7c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa7c0a0640 0x7faa7c0a2b00 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa78005fd0 tx=0x7faa78005ee0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 msgr2=0x7faa90196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90196ab0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7faa80005910 tx=0x7faa8001caf0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 shutdown_connections 2023-09-13T09:44:34.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa90106b00 0x7faa9019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa7c0a0640 0x7faa7c0a2b00 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa901018a0 0x7faa90196ab0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 --2- 172.21.15.6:0/4213298575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa901041d0 0x7faa90196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.899+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 >> 172.21.15.6:0/4213298575 conn(0x7faa900fb250 msgr2=0x7faa90102510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.900+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 shutdown_connections 2023-09-13T09:44:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:34.900+0000 7faa95b93700 1 -- 172.21.15.6:0/4213298575 wait complete. 2023-09-13T09:44:34.942 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:44:34.968 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:34 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2278061548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:44:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.071+0000 7fcb6a917700 1 -- 172.21.15.6:0/1375717514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 msgr2=0x7fcb641033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.071+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1375717514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb641033e0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fcb540099c0 tx=0x7fcb54009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.071+0000 7fcb6a917700 1 -- 172.21.15.6:0/1375717514 shutdown_connections 2023-09-13T09:44:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.071+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1375717514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb64104b50 0x7fcb6410b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.071+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1375717514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb641033e0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.071+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1375717514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb641041b0 0x7fcb64104610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.071+0000 7fcb6a917700 1 -- 172.21.15.6:0/1375717514 >> 172.21.15.6:0/1375717514 conn(0x7fcb640fe530 msgr2=0x7fcb64100970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 -- 172.21.15.6:0/1375717514 shutdown_connections 2023-09-13T09:44:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 -- 172.21.15.6:0/1375717514 wait complete. 2023-09-13T09:44:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 Processor -- start 2023-09-13T09:44:35.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 -- start start 2023-09-13T09:44:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb64198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb641041b0 0x7fcb64199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb64104b50 0x7fcb641a02a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641a0870 con 0x7fcb64102fc0 2023-09-13T09:44:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641a09e0 con 0x7fcb641041b0 2023-09-13T09:44:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.072+0000 7fcb6a917700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb641a0ba0 con 0x7fcb64104b50 2023-09-13T09:44:35.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb64198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb64198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37024/0 (socket says 172.21.15.6:37024) 2023-09-13T09:44:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 -- 172.21.15.6:0/1368577430 learned_addr learned my addr 172.21.15.6:0/1368577430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb637fe700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb641041b0 0x7fcb64199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb68eb4700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb64104b50 0x7fcb641a02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 -- 172.21.15.6:0/1368577430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb64104b50 msgr2=0x7fcb641a02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb64104b50 0x7fcb641a02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 -- 172.21.15.6:0/1368577430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb641041b0 msgr2=0x7fcb64199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb641041b0 0x7fcb64199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 -- 172.21.15.6:0/1368577430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb540095f0 con 0x7fcb64102fc0 2023-09-13T09:44:35.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb63fff700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb64198d30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009990 tx=0x7fcb54004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb617fa700 1 -- 172.21.15.6:0/1368577430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5401d070 con 0x7fcb64102fc0 2023-09-13T09:44:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb617fa700 1 -- 172.21.15.6:0/1368577430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb54004010 con 0x7fcb64102fc0 2023-09-13T09:44:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb641a0e20 con 0x7fcb64102fc0 2023-09-13T09:44:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb617fa700 1 -- 172.21.15.6:0/1368577430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb54022cd0 con 0x7fcb64102fc0 2023-09-13T09:44:35.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.073+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb641a1210 con 0x7fcb64102fc0 2023-09-13T09:44:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.075+0000 7fcb617fa700 1 -- 172.21.15.6:0/1368577430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcb54022470 con 0x7fcb64102fc0 2023-09-13T09:44:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.076+0000 7fcb617fa700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb4c0a0640 0x7fcb4c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.076+0000 7fcb617fa700 1 -- 172.21.15.6:0/1368577430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb540ccf10 con 0x7fcb64102fc0 2023-09-13T09:44:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.076+0000 7fcb637fe700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb4c0a0640 0x7fcb4c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.076+0000 7fcb637fe700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb4c0a0640 0x7fcb4c0a2b00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb58007be0 tx=0x7fcb580073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 Processor -- start 2023-09-13T09:44:35.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 -- start start 2023-09-13T09:44:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba3db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba3c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba3ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b995780 con 0x555d2ba3e060 2023-09-13T09:44:35.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b9930a0 con 0x555d2ba3ca00 2023-09-13T09:44:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b98e990 con 0x555d2ba3d700 2023-09-13T09:44:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba3c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba3c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37034/0 (socket says 172.21.15.6:37034) 2023-09-13T09:44:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb637fe700 1 -- 172.21.15.6:0/623862449 learned_addr learned my addr 172.21.15.6:0/623862449 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.077+0000 7fcb63fff700 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba3db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb68eb4700 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba3ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb637fe700 1 -- 172.21.15.6:0/623862449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 msgr2=0x555d2ba3db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb637fe700 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba3db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb637fe700 1 -- 172.21.15.6:0/623862449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 msgr2=0x555d2ba3ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb637fe700 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba3ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb637fe700 1 -- 172.21.15.6:0/623862449 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d2b80e630 con 0x555d2ba3e060 2023-09-13T09:44:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb63fff700 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba3db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb637fe700 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba3c4c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fcb58010e80 tx=0x7fcb58013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45231da574538fdb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb4a7fc700 1 -- 172.21.15.6:0/623862449 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58010eb0 con 0x555d2ba3e060 2023-09-13T09:44:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb4a7fc700 1 -- 172.21.15.6:0/623862449 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb58003b40 con 0x555d2ba3e060 2023-09-13T09:44:35.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.078+0000 7fcb4a7fc700 1 -- 172.21.15.6:0/623862449 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58011ba0 con 0x555d2ba3e060 2023-09-13T09:44:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 -- 172.21.15.6:0/623862449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 msgr2=0x555d2ba3c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba3c4c0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fcb58010e80 tx=0x7fcb58013000 comp rx=0 tx=0).stop 2023-09-13T09:44:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 -- 172.21.15.6:0/623862449 shutdown_connections 2023-09-13T09:44:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba3ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba3db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/623862449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba3c4c0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 -- 172.21.15.6:0/623862449 >> 172.21.15.6:0/623862449 conn(0x555d2b99ac80 msgr2=0x555d2ba36f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 -- 172.21.15.6:0/623862449 shutdown_connections 2023-09-13T09:44:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 -- 172.21.15.6:0/623862449 wait complete. 2023-09-13T09:44:35.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 -- start start 2023-09-13T09:44:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.079+0000 7fcb76afcb80 1 Processor -- start 2023-09-13T09:44:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba45f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba4d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b92cbb0 con 0x555d2ba3e060 2023-09-13T09:44:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b92c8b0 con 0x555d2ba3ca00 2023-09-13T09:44:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2b810920 con 0x555d2ba3d700 2023-09-13T09:44:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 10 client.0 _ll_register_callbacks cb 0x555d2b92a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba4d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba4d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37042/0 (socket says 172.21.15.6:37042) 2023-09-13T09:44:35.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 -- 172.21.15.6:0/533425386 learned_addr learned my addr 172.21.15.6:0/533425386 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb63fff700 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba45f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb637fe700 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 -- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 msgr2=0x555d2ba464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 -- 172.21.15.6:0/533425386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 msgr2=0x555d2ba45f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba45f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 -- 172.21.15.6:0/533425386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb58010b60 con 0x555d2ba3e060 2023-09-13T09:44:35.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb68eb4700 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba4d4e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c004070 tx=0x7fcb5c004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6d525288bb5857 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb437fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:35.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb437fe700 1 -- 172.21.15.6:0/533425386 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c007910 con 0x555d2ba3e060 2023-09-13T09:44:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d2ba2f670 con 0x555d2ba3e060 2023-09-13T09:44:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.080+0000 7fcb437fe700 1 -- 172.21.15.6:0/533425386 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb5c007a70 con 0x555d2ba3e060 2023-09-13T09:44:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb437fe700 1 -- 172.21.15.6:0/533425386 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5c007c30 con 0x555d2ba3e060 2023-09-13T09:44:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 10 client.16767 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:35.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x555d2b9a67a0 con 0x555d2ba3e060 2023-09-13T09:44:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb437fe700 1 -- 172.21.15.6:0/533425386 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555d2ba2f670 con 0x555d2ba3e060 2023-09-13T09:44:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb437fe700 1 -- 172.21.15.6:0/533425386 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcb5c014040 con 0x555d2ba3e060 2023-09-13T09:44:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 10 client.16767 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 10 client.16767 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:44:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 20 client.16767 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2ba54210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 4 client.16767 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d2b987970 con 0x555d2ba51df0 2023-09-13T09:44:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.081+0000 7fcb63fff700 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2ba54210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb437fe700 10 client.16767 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb63fff700 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2ba54210 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=812f2905f9a1fc24 server_cookie=a46f3de374d6041f in_seq=0 out_seq=0 2023-09-13T09:44:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb437fe700 1 -- 172.21.15.6:0/533425386 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555d2b987970 con 0x555d2ba51df0 2023-09-13T09:44:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb437fe700 10 client.16767 handle_command_reply: tid=0 2023-09-13T09:44:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 client.16767 shutdown 2023-09-13T09:44:35.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 msgr2=0x555d2ba4d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba4d4e0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c004070 tx=0x7fcb5c004380 comp rx=0 tx=0).stop 2023-09-13T09:44:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 shutdown_connections 2023-09-13T09:44:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2ba54210 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3e060 0x555d2ba4d4e0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb437fe700 0 client.16767 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3ca00 0x555d2ba45f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/533425386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3d700 0x555d2ba464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.082+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 >> 172.21.15.6:0/533425386 conn(0x555d2b99ac80 msgr2=0x555d2ba317f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.083+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 shutdown_connections 2023-09-13T09:44:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.083+0000 7fcb76afcb80 1 -- 172.21.15.6:0/533425386 wait complete. 2023-09-13T09:44:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.083+0000 7fcb76afcb80 20 client.16767 trim_cache size 0 max 16384 2023-09-13T09:44:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 Processor -- start 2023-09-13T09:44:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 -- start start 2023-09-13T09:44:35.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3ca00 0x555d2ba3c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3d700 0x555d2ba4d400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3e060 0x555d2ba40920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2ba45ad0 con 0x555d2ba3ca00 2023-09-13T09:44:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2ba37cf0 con 0x555d2ba3d700 2023-09-13T09:44:35.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2ba4f1a0 con 0x555d2ba3e060 2023-09-13T09:44:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3ca00 0x555d2ba3c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3ca00 0x555d2ba3c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37046/0 (socket says 172.21.15.6:37046) 2023-09-13T09:44:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 -- 172.21.15.6:0/4080078590 learned_addr learned my addr 172.21.15.6:0/4080078590 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 -- 172.21.15.6:0/4080078590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3e060 msgr2=0x555d2ba40920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 --2- 172.21.15.6:0/4080078590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3e060 0x555d2ba40920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 -- 172.21.15.6:0/4080078590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3d700 msgr2=0x555d2ba4d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 --2- 172.21.15.6:0/4080078590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3d700 0x555d2ba4d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 -- 172.21.15.6:0/4080078590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d2b7bade0 con 0x555d2ba3ca00 2023-09-13T09:44:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.096+0000 7fcb63fff700 1 --2- 172.21.15.6:0/4080078590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3ca00 0x555d2ba3c4c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcb540caa10 tx=0x7fcb54083f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fbdfee72698689 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb4affd700 1 -- 172.21.15.6:0/4080078590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5409e570 con 0x555d2ba3ca00 2023-09-13T09:44:35.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb4affd700 1 -- 172.21.15.6:0/4080078590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb540a2720 con 0x555d2ba3ca00 2023-09-13T09:44:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb4affd700 1 -- 172.21.15.6:0/4080078590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5409a9a0 con 0x555d2ba3ca00 2023-09-13T09:44:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 -- 172.21.15.6:0/4080078590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3ca00 msgr2=0x555d2ba3c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/4080078590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3ca00 0x555d2ba3c4c0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fcb540caa10 tx=0x7fcb54083f90 comp rx=0 tx=0).stop 2023-09-13T09:44:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 -- 172.21.15.6:0/4080078590 shutdown_connections 2023-09-13T09:44:35.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/4080078590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3e060 0x555d2ba40920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/4080078590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3ca00 0x555d2ba3c4c0 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/4080078590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3d700 0x555d2ba4d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 -- 172.21.15.6:0/4080078590 >> 172.21.15.6:0/4080078590 conn(0x555d2b99ac80 msgr2=0x555d2ba44bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 -- 172.21.15.6:0/4080078590 shutdown_connections 2023-09-13T09:44:35.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.097+0000 7fcb76afcb80 1 -- 172.21.15.6:0/4080078590 wait complete. 2023-09-13T09:44:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 -- start start 2023-09-13T09:44:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 Processor -- start 2023-09-13T09:44:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3ca00 0x555d2ba49540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3d700 0x555d2ba49a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3e060 0x555d2ba4caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2ba4cfe0 con 0x555d2ba3d700 2023-09-13T09:44:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2ba4d150 con 0x555d2ba3e060 2023-09-13T09:44:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d2ba4d310 con 0x555d2ba3ca00 2023-09-13T09:44:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb76afcb80 10 client.0 _ll_register_callbacks cb 0x555d2b92a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3d700 0x555d2ba49a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3d700 0x555d2ba49a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37052/0 (socket says 172.21.15.6:37052) 2023-09-13T09:44:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 -- 172.21.15.6:0/2719462342 learned_addr learned my addr 172.21.15.6:0/2719462342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb68eb4700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3e060 0x555d2ba4caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb63fff700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3ca00 0x555d2ba49540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 -- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3ca00 msgr2=0x555d2ba49540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3ca00 0x555d2ba49540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 -- 172.21.15.6:0/2719462342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3e060 msgr2=0x555d2ba4caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3e060 0x555d2ba4caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb637fe700 1 -- 172.21.15.6:0/2719462342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb641a0e20 con 0x555d2ba3d700 2023-09-13T09:44:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.098+0000 7fcb63fff700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3ca00 0x555d2ba49540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:35.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb637fe700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3d700 0x555d2ba49a80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcb58010e50 tx=0x7fcb58003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6497f571d687b6bc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb437fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb437fe700 1 -- 172.21.15.6:0/2719462342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb58005050 con 0x555d2ba3d700 2023-09-13T09:44:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb58003b40 con 0x555d2ba3d700 2023-09-13T09:44:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb437fe700 1 -- 172.21.15.6:0/2719462342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb58017070 con 0x555d2ba3d700 2023-09-13T09:44:35.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb437fe700 1 -- 172.21.15.6:0/2719462342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb580051b0 con 0x555d2ba3d700 2023-09-13T09:44:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 10 client.16773 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x555d2b7a3c60 con 0x555d2ba3d700 2023-09-13T09:44:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb437fe700 1 -- 172.21.15.6:0/2719462342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb58003b40 con 0x555d2ba3d700 2023-09-13T09:44:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb437fe700 1 -- 172.21.15.6:0/2719462342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcb58004c70 con 0x555d2ba3d700 2023-09-13T09:44:35.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 10 client.16773 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 10 client.16773 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:44:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 20 client.16773 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2baa8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 4 client.16773 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.099+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555d2b948050 con 0x555d2ba51df0 2023-09-13T09:44:35.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb63fff700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2baa8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb63fff700 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2baa8fe0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=25ae912938be9acd server_cookie=6c9ee6bdb60362f0 in_seq=0 out_seq=0 2023-09-13T09:44:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb437fe700 10 client.16773 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb437fe700 1 -- 172.21.15.6:0/2719462342 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555d2b948050 con 0x555d2ba51df0 2023-09-13T09:44:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb437fe700 10 client.16773 handle_command_reply: tid=0 2023-09-13T09:44:35.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 client.16773 shutdown 2023-09-13T09:44:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3d700 msgr2=0x555d2ba49a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3d700 0x555d2ba49a80 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fcb58010e50 tx=0x7fcb58003ee0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 shutdown_connections 2023-09-13T09:44:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555d2ba51df0 0x555d2baa8fe0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555d2ba3e060 0x555d2ba4caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555d2ba3ca00 0x555d2ba49540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 --2- 172.21.15.6:0/2719462342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555d2ba3d700 0x555d2ba49a80 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb437fe700 0 client.16773 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:44:35.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 >> 172.21.15.6:0/2719462342 conn(0x555d2b99ac80 msgr2=0x555d2ba40920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.100+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 shutdown_connections 2023-09-13T09:44:35.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb76afcb80 1 -- 172.21.15.6:0/2719462342 wait complete. 2023-09-13T09:44:35.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb76afcb80 20 client.16773 trim_cache size 0 max 16384 2023-09-13T09:44:35.125 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb4c0a0640 msgr2=0x7fcb4c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb4c0a0640 0x7fcb4c0a2b00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fcb58007be0 tx=0x7fcb580073d0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 msgr2=0x7fcb64198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb64198d30 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009990 tx=0x7fcb54004730 comp rx=0 tx=0).stop 2023-09-13T09:44:35.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 shutdown_connections 2023-09-13T09:44:35.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb64104b50 0x7fcb641a02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb4c0a0640 0x7fcb4c0a2b00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb64102fc0 0x7fcb64198d30 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 --2- 172.21.15.6:0/1368577430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb641041b0 0x7fcb64199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 >> 172.21.15.6:0/1368577430 conn(0x7fcb640fe530 msgr2=0x7fcb641076f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 shutdown_connections 2023-09-13T09:44:35.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.101+0000 7fcb6a917700 1 -- 172.21.15.6:0/1368577430 wait complete. 2023-09-13T09:44:35.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:44:35.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 160430 3.16 MB/sec execute 115 sec latency 895.085 ms 2023-09-13T09:44:35.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:34 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2278061548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:44:35.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:34 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2278061548' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:44:35.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.289+0000 7fcf7be5d700 1 -- 172.21.15.6:0/3022967316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74101fc0 msgr2=0x7fcf74102420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.289+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/3022967316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74101fc0 0x7fcf74102420 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fcf640099c0 tx=0x7fcf64009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.289+0000 7fcf7be5d700 1 -- 172.21.15.6:0/3022967316 shutdown_connections 2023-09-13T09:44:35.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.289+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/3022967316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf74102960 0x7fcf74109210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.289+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/3022967316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf74100dd0 0x7fcf741011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.289+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/3022967316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74101fc0 0x7fcf74102420 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.289+0000 7fcf7be5d700 1 -- 172.21.15.6:0/3022967316 >> 172.21.15.6:0/3022967316 conn(0x7fcf740fc320 msgr2=0x7fcf740fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 -- 172.21.15.6:0/3022967316 shutdown_connections 2023-09-13T09:44:35.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 -- 172.21.15.6:0/3022967316 wait complete. 2023-09-13T09:44:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 Processor -- start 2023-09-13T09:44:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 -- start start 2023-09-13T09:44:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf74100dd0 0x7fcf741969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf74101fc0 0x7fcf74196ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74102960 0x7fcf7419df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7419e530 con 0x7fcf74102960 2023-09-13T09:44:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7419e670 con 0x7fcf74100dd0 2023-09-13T09:44:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7be5d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7419e800 con 0x7fcf74101fc0 2023-09-13T09:44:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7a3fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74102960 0x7fcf7419df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7a3fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74102960 0x7fcf7419df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37070/0 (socket says 172.21.15.6:37070) 2023-09-13T09:44:35.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/981732876 learned_addr learned my addr 172.21.15.6:0/981732876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.290+0000 7fcf793f8700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf74101fc0 0x7fcf74196ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf74100dd0 0x7fcf741969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/981732876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf74101fc0 msgr2=0x7fcf74196ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf74101fc0 0x7fcf74196ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/981732876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf74100dd0 msgr2=0x7fcf741969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf74100dd0 0x7fcf741969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/981732876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf640095f0 con 0x7fcf74102960 2023-09-13T09:44:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74102960 0x7fcf7419df60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c007ee0 tx=0x7fcf6c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf6affd700 1 -- 172.21.15.6:0/981732876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c017070 con 0x7fcf74102960 2023-09-13T09:44:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf6affd700 1 -- 172.21.15.6:0/981732876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf6c00f040 con 0x7fcf74102960 2023-09-13T09:44:35.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7419eae0 con 0x7fcf74102960 2023-09-13T09:44:35.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf6affd700 1 -- 172.21.15.6:0/981732876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c005580 con 0x7fcf74102960 2023-09-13T09:44:35.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.291+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7419efa0 con 0x7fcf74102960 2023-09-13T09:44:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.293+0000 7fcf6affd700 1 -- 172.21.15.6:0/981732876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcf6c00db20 con 0x7fcf74102960 2023-09-13T09:44:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.294+0000 7fcf6affd700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcf600a0640 0x7fcf600a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.294+0000 7fcf6affd700 1 -- 172.21.15.6:0/981732876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf6c0cb370 con 0x7fcf74102960 2023-09-13T09:44:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.294+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcf600a0640 0x7fcf600a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.294+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcf600a0640 0x7fcf600a2b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf74101e20 tx=0x7fcf7000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 Processor -- start 2023-09-13T09:44:35.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 -- start start 2023-09-13T09:44:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a3af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a398d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a3a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68098e780 con 0x55b680a3b470 2023-09-13T09:44:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b68098c0a0 con 0x55b680a3ab10 2023-09-13T09:44:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf88042b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680987990 con 0x55b680a39e10 2023-09-13T09:44:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf793f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf793f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a398d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37076/0 (socket says 172.21.15.6:37076) 2023-09-13T09:44:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf793f8700 1 -- 172.21.15.6:0/1046848866 learned_addr learned my addr 172.21.15.6:0/1046848866 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a3af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a3a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf793f8700 1 -- 172.21.15.6:0/1046848866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 msgr2=0x55b680a3a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.295+0000 7fcf793f8700 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a3a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.296+0000 7fcf793f8700 1 -- 172.21.15.6:0/1046848866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 msgr2=0x55b680a3af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.296+0000 7fcf793f8700 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a3af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.296+0000 7fcf793f8700 1 -- 172.21.15.6:0/1046848866 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b680807630 con 0x55b680a3b470 2023-09-13T09:44:35.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.296+0000 7fcf793f8700 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a398d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fcf640036f0 tx=0x7fcf64005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68caa699fdd6aa40 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.296+0000 7fcf5ffff700 1 -- 172.21.15.6:0/1046848866 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6401d070 con 0x55b680a3b470 2023-09-13T09:44:35.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.296+0000 7fcf5ffff700 1 -- 172.21.15.6:0/1046848866 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf6401e040 con 0x55b680a3b470 2023-09-13T09:44:35.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.296+0000 7fcf5ffff700 1 -- 172.21.15.6:0/1046848866 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf64003b20 con 0x55b680a3b470 2023-09-13T09:44:35.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 -- 172.21.15.6:0/1046848866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 msgr2=0x55b680a398d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a398d0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fcf640036f0 tx=0x7fcf64005040 comp rx=0 tx=0).stop 2023-09-13T09:44:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 -- 172.21.15.6:0/1046848866 shutdown_connections 2023-09-13T09:44:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a3a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a3af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1046848866 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a398d0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 -- 172.21.15.6:0/1046848866 >> 172.21.15.6:0/1046848866 conn(0x55b680993c80 msgr2=0x55b680a2ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 -- 172.21.15.6:0/1046848866 shutdown_connections 2023-09-13T09:44:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 -- 172.21.15.6:0/1046848866 wait complete. 2023-09-13T09:44:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 -- start start 2023-09-13T09:44:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.297+0000 7fcf88042b80 1 Processor -- start 2023-09-13T09:44:35.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a432b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3ab10 0x55b680a437f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3b470 0x55b680a4a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680925bb0 con 0x55b680a39e10 2023-09-13T09:44:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6809258b0 con 0x55b680a3b470 2023-09-13T09:44:35.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680809920 con 0x55b680a3ab10 2023-09-13T09:44:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 10 client.0 _ll_register_callbacks cb 0x55b680923680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a432b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a432b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37080/0 (socket says 172.21.15.6:37080) 2023-09-13T09:44:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2421034300 learned_addr learned my addr 172.21.15.6:0/2421034300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3b470 0x55b680a4a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3ab10 0x55b680a437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2421034300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3ab10 msgr2=0x55b680a437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3ab10 0x55b680a437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3b470 msgr2=0x55b680a4a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3b470 0x55b680a4a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2421034300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74109b60 con 0x55b680a39e10 2023-09-13T09:44:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3ab10 0x55b680a437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a432b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fcf7001dda0 tx=0x7fcf700047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea86edc5d6b0cff0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2421034300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf700108c0 con 0x55b680a39e10 2023-09-13T09:44:35.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2421034300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf70010a20 con 0x55b680a39e10 2023-09-13T09:44:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.298+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b680a28670 con 0x55b680a39e10 2023-09-13T09:44:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2421034300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf70010be0 con 0x55b680a39e10 2023-09-13T09:44:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 10 client.16785 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55b68099f7a0 con 0x55b680a39e10 2023-09-13T09:44:35.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2421034300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b680a28670 con 0x55b680a39e10 2023-09-13T09:44:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2421034300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcf70027420 con 0x55b680a39e10 2023-09-13T09:44:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 10 client.16785 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 10 client.16785 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 20 client.16785 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:35.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680a4f090 0x55b680a514b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 4 client.16785 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b680980970 con 0x55b680a4f090 2023-09-13T09:44:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.299+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680a4f090 0x55b680a514b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.300+0000 7fcf5d7fa700 10 client.16785 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:35.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.300+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680a4f090 0x55b680a514b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4c63cd3f2717c06 server_cookie=8d019be3153e94cc in_seq=0 out_seq=0 2023-09-13T09:44:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.300+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2421034300 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b680980970 con 0x55b680a4f090 2023-09-13T09:44:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.300+0000 7fcf5d7fa700 10 client.16785 handle_command_reply: tid=0 2023-09-13T09:44:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.300+0000 7fcf88042b80 1 client.16785 shutdown 2023-09-13T09:44:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 msgr2=0x55b680a432b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a432b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fcf7001dda0 tx=0x7fcf700047c0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 shutdown_connections 2023-09-13T09:44:35.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3b470 0x55b680a4a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680a4f090 0x55b680a514b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a432b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2421034300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3ab10 0x55b680a437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf5d7fa700 0 client.16785 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:35.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 >> 172.21.15.6:0/2421034300 conn(0x55b680993c80 msgr2=0x55b680a2a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 shutdown_connections 2023-09-13T09:44:35.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 1 -- 172.21.15.6:0/2421034300 wait complete. 2023-09-13T09:44:35.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.301+0000 7fcf88042b80 20 client.16785 trim_cache size 0 max 16384 2023-09-13T09:44:35.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 Processor -- start 2023-09-13T09:44:35.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 -- start start 2023-09-13T09:44:35.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a41710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a4a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680a3e910 con 0x55b680a3b470 2023-09-13T09:44:35.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680a4ed90 con 0x55b680a3ab10 2023-09-13T09:44:35.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf88042b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680a51480 con 0x55b680a39e10 2023-09-13T09:44:35.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a4a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a4a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37092/0 (socket says 172.21.15.6:37092) 2023-09-13T09:44:35.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/1542434912 learned_addr learned my addr 172.21.15.6:0/1542434912 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf793f8700 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a41710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/1542434912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 msgr2=0x55b680a411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/1542434912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 msgr2=0x55b680a41710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a41710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf7a3fa700 1 -- 172.21.15.6:0/1542434912 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6807b3de0 con 0x55b680a3b470 2023-09-13T09:44:35.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:35.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.314+0000 7fcf793f8700 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a41710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:44:35.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a4a7f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c098aa0 tx=0x7fcf6c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c788763881fbe2d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf68ff9700 1 -- 172.21.15.6:0/1542434912 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0a0b80 con 0x55b680a3b470 2023-09-13T09:44:35.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf68ff9700 1 -- 172.21.15.6:0/1542434912 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf6c096c50 con 0x55b680a3b470 2023-09-13T09:44:35.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf68ff9700 1 -- 172.21.15.6:0/1542434912 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c022250 con 0x55b680a3b470 2023-09-13T09:44:35.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 -- 172.21.15.6:0/1542434912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 msgr2=0x55b680a4a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a4a7f0 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c098aa0 tx=0x7fcf6c00b040 comp rx=0 tx=0).stop 2023-09-13T09:44:35.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 -- 172.21.15.6:0/1542434912 shutdown_connections 2023-09-13T09:44:35.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a3b470 0x55b680a4a7f0 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a39e10 0x55b680a411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 --2- 172.21.15.6:0/1542434912 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a41710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 -- 172.21.15.6:0/1542434912 >> 172.21.15.6:0/1542434912 conn(0x55b680993c80 msgr2=0x55b680a2fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 -- 172.21.15.6:0/1542434912 shutdown_connections 2023-09-13T09:44:35.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.315+0000 7fcf88042b80 1 -- 172.21.15.6:0/1542434912 wait complete. 2023-09-13T09:44:35.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 -- start start 2023-09-13T09:44:35.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 Processor -- start 2023-09-13T09:44:35.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a46a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a46f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3b470 0x55b680a49b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680a4a070 con 0x55b680a39e10 2023-09-13T09:44:35.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680a4a1e0 con 0x55b680a3ab10 2023-09-13T09:44:35.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b680a4a3a0 con 0x55b680a3b470 2023-09-13T09:44:35.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf88042b80 10 client.0 _ll_register_callbacks cb 0x55b680923680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf79bf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a46a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf79bf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a46a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37094/0 (socket says 172.21.15.6:37094) 2023-09-13T09:44:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2349095284 learned_addr learned my addr 172.21.15.6:0/2349095284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf7a3fa700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3b470 0x55b680a49b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.316+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a46f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2349095284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3b470 msgr2=0x55b680a49b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3b470 0x55b680a49b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 msgr2=0x55b680a46f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a46f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf79bf9700 1 -- 172.21.15.6:0/2349095284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf7419efa0 con 0x55b680a39e10 2023-09-13T09:44:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a46f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:44:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf79bf9700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a46a20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcf70005ec0 tx=0x7fcf70027aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b060aa06f2f57d22 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf5d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2349095284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf70010ad0 con 0x55b680a39e10 2023-09-13T09:44:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2349095284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcf70010c30 con 0x55b680a39e10 2023-09-13T09:44:35.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf6401e040 con 0x55b680a39e10 2023-09-13T09:44:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2349095284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf700275c0 con 0x55b680a39e10 2023-09-13T09:44:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf88042b80 10 client.16791 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55b68079cc60 con 0x55b680a39e10 2023-09-13T09:44:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2349095284 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcf6401e040 con 0x55b680a39e10 2023-09-13T09:44:35.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2349095284 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcf7001b420 con 0x55b680a39e10 2023-09-13T09:44:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.317+0000 7fcf88042b80 10 client.16791 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 10 client.16791 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 20 client.16791 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680aa3d10 0x55b680aa6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:35.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 4 client.16791 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:44:35.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b680941050 con 0x55b680aa3d10 2023-09-13T09:44:35.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680aa3d10 0x55b680aa6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:35.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf793f8700 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680aa3d10 0x55b680aa6130 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd0605255865e25 server_cookie=e76d0fff34b9dc3b in_seq=0 out_seq=0 2023-09-13T09:44:35.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf5d7fa700 10 client.16791 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:35.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf5d7fa700 1 -- 172.21.15.6:0/2349095284 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b680941050 con 0x55b680aa3d10 2023-09-13T09:44:35.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf5d7fa700 10 client.16791 handle_command_reply: tid=0 2023-09-13T09:44:35.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 1 client.16791 shutdown 2023-09-13T09:44:35.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 msgr2=0x55b680a46a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.318+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a46a20 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fcf70005ec0 tx=0x7fcf70027aa0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 shutdown_connections 2023-09-13T09:44:35.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b680a3b470 0x55b680a49b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b680aa3d10 0x55b680aa6130 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b680a39e10 0x55b680a46a20 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 --2- 172.21.15.6:0/2349095284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b680a3ab10 0x55b680a46f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf5d7fa700 0 client.16791 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:35.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 >> 172.21.15.6:0/2349095284 conn(0x55b680993c80 msgr2=0x55b680a411d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 shutdown_connections 2023-09-13T09:44:35.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 1 -- 172.21.15.6:0/2349095284 wait complete. 2023-09-13T09:44:35.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf88042b80 20 client.16791 trim_cache size 0 max 16384 2023-09-13T09:44:35.345 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:44:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcf600a0640 msgr2=0x7fcf600a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcf600a0640 0x7fcf600a2b00 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf74101e20 tx=0x7fcf7000a3b0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74102960 msgr2=0x7fcf7419df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74102960 0x7fcf7419df60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c007ee0 tx=0x7fcf6c00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 shutdown_connections 2023-09-13T09:44:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcf600a0640 0x7fcf600a2b00 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcf74102960 0x7fcf7419df60 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcf74100dd0 0x7fcf741969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 --2- 172.21.15.6:0/981732876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf74101fc0 0x7fcf74196ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 >> 172.21.15.6:0/981732876 conn(0x7fcf740fc320 msgr2=0x7fcf740fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 shutdown_connections 2023-09-13T09:44:35.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:35.319+0000 7fcf7be5d700 1 -- 172.21.15.6:0/981732876 wait complete. 2023-09-13T09:44:36.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 160430 3.13 MB/sec execute 116 sec latency 1895.187 ms 2023-09-13T09:44:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:35 smithi053 ceph-mon[102373]: pgmap v452: 97 pgs: 97 active+clean; 80 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 765 KiB/s wr, 135 op/s 2023-09-13T09:44:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:35 smithi006 ceph-mon[98665]: pgmap v452: 97 pgs: 97 active+clean; 80 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 765 KiB/s wr, 135 op/s 2023-09-13T09:44:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:35 smithi131 ceph-mon[102785]: pgmap v452: 97 pgs: 97 active+clean; 80 MiB data, 916 MiB used, 1.0 TiB / 1.0 TiB avail; 529 KiB/s rd, 765 KiB/s wr, 135 op/s 2023-09-13T09:44:36.350 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:44:36.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:44:36.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 -- 172.21.15.6:0/3058936419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d80ffcc0 msgr2=0x7f17d81000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/3058936419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d80ffcc0 0x7f17d81000e0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f17d40099c0 tx=0x7f17d4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 -- 172.21.15.6:0/3058936419 shutdown_connections 2023-09-13T09:44:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/3058936419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17d8101850 0x7f17d8108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/3058936419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d80ffcc0 0x7f17d81000e0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/3058936419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17d8100eb0 0x7f17d8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 -- 172.21.15.6:0/3058936419 >> 172.21.15.6:0/3058936419 conn(0x7f17d80fb250 msgr2=0x7f17d80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 -- 172.21.15.6:0/3058936419 shutdown_connections 2023-09-13T09:44:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.494+0000 7f17dfa4f700 1 -- 172.21.15.6:0/3058936419 wait complete. 2023-09-13T09:44:36.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 Processor -- start 2023-09-13T09:44:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 -- start start 2023-09-13T09:44:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17d80ffcc0 0x7f17d8195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17d8100eb0 0x7f17d8195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8101850 0x7f17d819cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d819d4d0 con 0x7f17d8101850 2023-09-13T09:44:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d819d610 con 0x7f17d80ffcc0 2023-09-13T09:44:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.495+0000 7f17dfa4f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d819d7a0 con 0x7f17d8100eb0 2023-09-13T09:44:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8101850 0x7f17d819cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17dd7eb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17d80ffcc0 0x7f17d8195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17dd7eb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17d80ffcc0 0x7f17d8195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58864/0 (socket says 172.21.15.6:58864) 2023-09-13T09:44:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17dd7eb700 1 -- 172.21.15.6:0/4072837909 learned_addr learned my addr 172.21.15.6:0/4072837909 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8101850 0x7f17d819cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37112/0 (socket says 172.21.15.6:37112) 2023-09-13T09:44:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17dcfea700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17d8100eb0 0x7f17d8195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 -- 172.21.15.6:0/4072837909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17d8100eb0 msgr2=0x7f17d8195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17d8100eb0 0x7f17d8195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 -- 172.21.15.6:0/4072837909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17d80ffcc0 msgr2=0x7f17d8195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17d80ffcc0 0x7f17d8195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 -- 172.21.15.6:0/4072837909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40095f0 con 0x7f17d8101850 2023-09-13T09:44:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ddfec700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8101850 0x7f17d819cf00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f17d000cc50 tx=0x7f17d000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ca7fc700 1 -- 172.21.15.6:0/4072837909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d000ab40 con 0x7f17d8101850 2023-09-13T09:44:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ca7fc700 1 -- 172.21.15.6:0/4072837909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17d000aca0 con 0x7f17d8101850 2023-09-13T09:44:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d819da80 con 0x7f17d8101850 2023-09-13T09:44:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17ca7fc700 1 -- 172.21.15.6:0/4072837909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d00115c0 con 0x7f17d8101850 2023-09-13T09:44:36.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.496+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d819df40 con 0x7f17d8101850 2023-09-13T09:44:36.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.498+0000 7f17ca7fc700 1 -- 172.21.15.6:0/4072837909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f17d0012420 con 0x7f17d8101850 2023-09-13T09:44:36.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.499+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17c40a0640 0x7f17c40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.499+0000 7f17ca7fc700 1 -- 172.21.15.6:0/4072837909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17d00cbe10 con 0x7f17d8101850 2023-09-13T09:44:36.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.499+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17c40a0640 0x7f17c40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.499+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17c40a0640 0x7f17c40a2b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005950 tx=0x7f17d40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 Processor -- start 2023-09-13T09:44:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 -- start start 2023-09-13T09:44:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf02840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02d80 0x55a3acf03690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3ace59800 con 0x55a3acf02d80 2023-09-13T09:44:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3ace57120 con 0x55a3acf02420 2023-09-13T09:44:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3ace52a10 con 0x55a3acf03c70 2023-09-13T09:44:36.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17dcfea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02d80 0x55a3acf03690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17dcfea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02d80 0x55a3acf03690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37118/0 (socket says 172.21.15.6:37118) 2023-09-13T09:44:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17dcfea700 1 -- 172.21.15.6:0/2516101797 learned_addr learned my addr 172.21.15.6:0/2516101797 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf02840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.500+0000 7f17ddfec700 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17dcfea700 1 -- 172.21.15.6:0/2516101797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 msgr2=0x55a3acf040f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17dcfea700 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf040f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17dcfea700 1 -- 172.21.15.6:0/2516101797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 msgr2=0x55a3acf02840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17dcfea700 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf02840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17dcfea700 1 -- 172.21.15.6:0/2516101797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3accd26b0 con 0x55a3acf02d80 2023-09-13T09:44:36.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17dcfea700 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02d80 0x55a3acf03690 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00bd70 tx=0x7f17cc00f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93702aa1043f1851 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17c37fe700 1 -- 172.21.15.6:0/2516101797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00fda0 con 0x55a3acf02d80 2023-09-13T09:44:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17c37fe700 1 -- 172.21.15.6:0/2516101797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17cc01a920 con 0x55a3acf02d80 2023-09-13T09:44:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.501+0000 7f17c37fe700 1 -- 172.21.15.6:0/2516101797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0117c0 con 0x55a3acf02d80 2023-09-13T09:44:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 -- 172.21.15.6:0/2516101797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02d80 msgr2=0x55a3acf03690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02d80 0x55a3acf03690 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00bd70 tx=0x7f17cc00f640 comp rx=0 tx=0).stop 2023-09-13T09:44:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 -- 172.21.15.6:0/2516101797 shutdown_connections 2023-09-13T09:44:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf02840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/2516101797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02d80 0x55a3acf03690 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 -- 172.21.15.6:0/2516101797 >> 172.21.15.6:0/2516101797 conn(0x55a3ace5ed00 msgr2=0x55a3acefd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 -- 172.21.15.6:0/2516101797 shutdown_connections 2023-09-13T09:44:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 -- 172.21.15.6:0/2516101797 wait complete. 2023-09-13T09:44:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 -- start start 2023-09-13T09:44:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.502+0000 7f17ebc34b80 1 Processor -- start 2023-09-13T09:44:36.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf0c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02d80 0x55a3acf0c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf13720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acdf0c30 con 0x55a3acf03c70 2023-09-13T09:44:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acdf0930 con 0x55a3acf02420 2023-09-13T09:44:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3accd49a0 con 0x55a3acf02d80 2023-09-13T09:44:36.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ebc34b80 10 client.0 _ll_register_callbacks cb 0x55a3acdee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf13720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf13720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37126/0 (socket says 172.21.15.6:37126) 2023-09-13T09:44:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 -- 172.21.15.6:0/3717017434 learned_addr learned my addr 172.21.15.6:0/3717017434 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf0c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17dcfea700 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02d80 0x55a3acf0c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 -- 172.21.15.6:0/3717017434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02d80 msgr2=0x55a3acf0c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02d80 0x55a3acf0c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 -- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 msgr2=0x55a3acf0c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf0c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 -- 172.21.15.6:0/3717017434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc00b9a0 con 0x55a3acf03c70 2023-09-13T09:44:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17ddfec700 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf13720 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f17d00c9910 tx=0x7f17d0099d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f2fff6113901eec server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.503+0000 7f17c0ff9700 1 -- 172.21.15.6:0/3717017434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d00a1620 con 0x55a3acf03c70 2023-09-13T09:44:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17c0ff9700 1 -- 172.21.15.6:0/3717017434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17d000ae10 con 0x55a3acf03c70 2023-09-13T09:44:36.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3acef36f0 con 0x55a3acf03c70 2023-09-13T09:44:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17c0ff9700 1 -- 172.21.15.6:0/3717017434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17d0097950 con 0x55a3acf03c70 2023-09-13T09:44:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 10 client.16803 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a3ace6a820 con 0x55a3acf03c70 2023-09-13T09:44:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17c0ff9700 1 -- 172.21.15.6:0/3717017434 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17d0063020 con 0x55a3acf03c70 2023-09-13T09:44:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17c0ff9700 1 -- 172.21.15.6:0/3717017434 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f17d0099810 con 0x55a3acf03c70 2023-09-13T09:44:36.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 10 client.16803 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 10 client.16803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 20 client.16803 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf17fa0 0x55a3acf1a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 4 client.16803 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:36.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3ace4b9f0 con 0x55a3acf17fa0 2023-09-13T09:44:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.504+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf17fa0 0x55a3acf1a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.505+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf17fa0 0x55a3acf1a3c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce34eea8b171e28 server_cookie=844afc409cc43f63 in_seq=0 out_seq=0 2023-09-13T09:44:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.505+0000 7f17c0ff9700 10 client.16803 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17c0ff9700 1 -- 172.21.15.6:0/3717017434 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a3ace4b9f0 con 0x55a3acf17fa0 2023-09-13T09:44:36.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17c0ff9700 10 client.16803 handle_command_reply: tid=0 2023-09-13T09:44:36.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 client.16803 shutdown 2023-09-13T09:44:36.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 msgr2=0x55a3acf13720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf13720 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f17d00c9910 tx=0x7f17d0099d30 comp rx=0 tx=0).stop 2023-09-13T09:44:36.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 shutdown_connections 2023-09-13T09:44:36.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf17fa0 0x55a3acf1a3c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf13720 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02420 0x55a3acf0c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17c0ff9700 0 client.16803 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3717017434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02d80 0x55a3acf0c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 >> 172.21.15.6:0/3717017434 conn(0x55a3ace5ed00 msgr2=0x55a3aceff320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 shutdown_connections 2023-09-13T09:44:36.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3717017434 wait complete. 2023-09-13T09:44:36.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.506+0000 7f17ebc34b80 20 client.16803 trim_cache size 0 max 16384 2023-09-13T09:44:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 Processor -- start 2023-09-13T09:44:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 -- start start 2023-09-13T09:44:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02420 0x55a3aceff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 0x55a3acf136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf0c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acf09e00 con 0x55a3acf02420 2023-09-13T09:44:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acf076f0 con 0x55a3acf02d80 2023-09-13T09:44:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.523+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acef3480 con 0x55a3acf03c70 2023-09-13T09:44:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02420 0x55a3aceff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02420 0x55a3aceff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37130/0 (socket says 172.21.15.6:37130) 2023-09-13T09:44:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 -- 172.21.15.6:0/3291852770 learned_addr learned my addr 172.21.15.6:0/3291852770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17ddfec700 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf0c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 -- 172.21.15.6:0/3291852770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 msgr2=0x55a3acf0c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf0c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 -- 172.21.15.6:0/3291852770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 msgr2=0x55a3acf136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 0x55a3acf136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 -- 172.21.15.6:0/3291852770 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3acc7ee60 con 0x55a3acf02420 2023-09-13T09:44:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02420 0x55a3aceff4c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f17d40095c0 tx=0x7f17d4023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731e2f86b90d905a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17c3fff700 1 -- 172.21.15.6:0/3291852770 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4036e90 con 0x55a3acf02420 2023-09-13T09:44:36.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17c3fff700 1 -- 172.21.15.6:0/3291852770 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17d401e040 con 0x55a3acf02420 2023-09-13T09:44:36.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.524+0000 7f17c3fff700 1 -- 172.21.15.6:0/3291852770 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4003f20 con 0x55a3acf02420 2023-09-13T09:44:36.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3291852770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02420 msgr2=0x55a3aceff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02420 0x55a3aceff4c0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f17d40095c0 tx=0x7f17d4023000 comp rx=0 tx=0).stop 2023-09-13T09:44:36.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3291852770 shutdown_connections 2023-09-13T09:44:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf03c70 0x55a3acf0c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf02420 0x55a3aceff4c0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/3291852770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 0x55a3acf136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3291852770 >> 172.21.15.6:0/3291852770 conn(0x55a3ace5ed00 msgr2=0x55a3acf0bf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3291852770 shutdown_connections 2023-09-13T09:44:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- 172.21.15.6:0/3291852770 wait complete. 2023-09-13T09:44:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- start start 2023-09-13T09:44:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 Processor -- start 2023-09-13T09:44:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02420 0x55a3acf10b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 0x55a3acf11090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf120a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acf125e0 con 0x55a3acf03c70 2023-09-13T09:44:36.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acf12750 con 0x55a3acf02d80 2023-09-13T09:44:36.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3acf12910 con 0x55a3acf02420 2023-09-13T09:44:36.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.525+0000 7f17ebc34b80 10 client.0 _ll_register_callbacks cb 0x55a3acdee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:36.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf120a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37140/0 (socket says 172.21.15.6:37140) 2023-09-13T09:44:36.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 -- 172.21.15.6:0/823027333 learned_addr learned my addr 172.21.15.6:0/823027333 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17dcfea700 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 0x55a3acf11090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02420 0x55a3acf10b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 -- 172.21.15.6:0/823027333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02420 msgr2=0x55a3acf10b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02420 0x55a3acf10b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 -- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 msgr2=0x55a3acf11090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 0x55a3acf11090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 -- 172.21.15.6:0/823027333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d8108a50 con 0x55a3acf03c70 2023-09-13T09:44:36.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ddfec700 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf120a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f17d00cc0f0 tx=0x7f17d0099030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=339f71d18358a58 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:36.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17c0ff9700 1 -- 172.21.15.6:0/823027333 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d000ae10 con 0x55a3acf03c70 2023-09-13T09:44:36.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17c0ff9700 1 -- 172.21.15.6:0/823027333 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17d0064080 con 0x55a3acf03c70 2023-09-13T09:44:36.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17cc01a920 con 0x55a3acf03c70 2023-09-13T09:44:36.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17c0ff9700 1 -- 172.21.15.6:0/823027333 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17d00a1620 con 0x55a3acf03c70 2023-09-13T09:44:36.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ebc34b80 10 client.16809 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:36.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.526+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a3acc67ce0 con 0x55a3acf03c70 2023-09-13T09:44:36.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17c0ff9700 1 -- 172.21.15.6:0/823027333 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17cc01a920 con 0x55a3acf03c70 2023-09-13T09:44:36.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17c0ff9700 1 -- 172.21.15.6:0/823027333 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f17d00126d0 con 0x55a3acf03c70 2023-09-13T09:44:36.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17ebc34b80 10 client.16809 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:36.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17ebc34b80 10 client.16809 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:36.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17ebc34b80 20 client.16809 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:36.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf6e220 0x55a3acf70610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17ebc34b80 4 client.16809 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:44:36.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a3ace0c0d0 con 0x55a3acf6e220 2023-09-13T09:44:36.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf6e220 0x55a3acf70610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17c0ff9700 10 client.16809 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.527+0000 7f17dd7eb700 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf6e220 0x55a3acf70610 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a47dfefa85e899d4 server_cookie=c2bfd3bd74d043e2 in_seq=0 out_seq=0 2023-09-13T09:44:36.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17c0ff9700 1 -- 172.21.15.6:0/823027333 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a3ace0c0d0 con 0x55a3acf6e220 2023-09-13T09:44:36.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17c0ff9700 10 client.16809 handle_command_reply: tid=0 2023-09-13T09:44:36.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 client.16809 shutdown 2023-09-13T09:44:36.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 msgr2=0x55a3acf120a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf120a0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f17d00cc0f0 tx=0x7f17d0099030 comp rx=0 tx=0).stop 2023-09-13T09:44:36.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 shutdown_connections 2023-09-13T09:44:36.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a3acf6e220 0x55a3acf70610 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a3acf03c70 0x55a3acf120a0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a3acf02420 0x55a3acf10b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17c0ff9700 0 client.16809 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 --2- 172.21.15.6:0/823027333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a3acf02d80 0x55a3acf11090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 >> 172.21.15.6:0/823027333 conn(0x55a3ace5ed00 msgr2=0x55a3acefe4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 shutdown_connections 2023-09-13T09:44:36.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 1 -- 172.21.15.6:0/823027333 wait complete. 2023-09-13T09:44:36.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.529+0000 7f17ebc34b80 20 client.16809 trim_cache size 0 max 16384 2023-09-13T09:44:36.550 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:44:36.551 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:44:36.551 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "30e1e358-6a8b-4242-a655-c82a6ea4eb07", 2023-09-13T09:44:36.551 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:44:36.551 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:44:36.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17c40a0640 msgr2=0x7f17c40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17c40a0640 0x7f17c40a2b00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005950 tx=0x7f17d40058e0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8101850 msgr2=0x7f17d819cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8101850 0x7f17d819cf00 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f17d000cc50 tx=0x7f17d000cf60 comp rx=0 tx=0).stop 2023-09-13T09:44:36.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 shutdown_connections 2023-09-13T09:44:36.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17c40a0640 0x7f17c40a2b00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17d8101850 0x7f17d819cf00 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17d80ffcc0 0x7f17d8195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 --2- 172.21.15.6:0/4072837909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17d8100eb0 0x7f17d8195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 >> 172.21.15.6:0/4072837909 conn(0x7f17d80fb250 msgr2=0x7f17d8104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 shutdown_connections 2023-09-13T09:44:36.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.530+0000 7f17dfa4f700 1 -- 172.21.15.6:0/4072837909 wait complete. 2023-09-13T09:44:36.555 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:44:36.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.692+0000 7f38b2f25700 1 -- 172.21.15.6:0/311020911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 msgr2=0x7f38ac1017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.692+0000 7f38b2f25700 1 --2- 172.21.15.6:0/311020911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 0x7f38ac1017e0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f38a0009990 tx=0x7f38a0009ca0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.692+0000 7f38b2f25700 1 -- 172.21.15.6:0/311020911 shutdown_connections 2023-09-13T09:44:36.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.692+0000 7f38b2f25700 1 --2- 172.21.15.6:0/311020911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac100290 0x7f38ac108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 --2- 172.21.15.6:0/311020911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 0x7f38ac1017e0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 --2- 172.21.15.6:0/311020911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac0ff8f0 0x7f38ac0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 -- 172.21.15.6:0/311020911 >> 172.21.15.6:0/311020911 conn(0x7f38ac0fb250 msgr2=0x7f38ac0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 -- 172.21.15.6:0/311020911 shutdown_connections 2023-09-13T09:44:36.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 -- 172.21.15.6:0/311020911 wait complete. 2023-09-13T09:44:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 Processor -- start 2023-09-13T09:44:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 -- start start 2023-09-13T09:44:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0ff8f0 0x7f38ac0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac100290 0x7f38ac19b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.693+0000 7f38b2f25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 0x7f38ac19df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b2f25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac19e6f0 con 0x7f38ac1013c0 2023-09-13T09:44:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b2f25700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac19e860 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b2f25700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38ac19ea20 con 0x7f38ac100290 2023-09-13T09:44:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0ff8f0 0x7f38ac0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b14c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 0x7f38ac19df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0ff8f0 0x7f38ac0698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58906/0 (socket says 172.21.15.6:58906) 2023-09-13T09:44:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 -- 172.21.15.6:0/283287082 learned_addr learned my addr 172.21.15.6:0/283287082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38abfff700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac100290 0x7f38ac19b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 -- 172.21.15.6:0/283287082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac100290 msgr2=0x7f38ac19b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac100290 0x7f38ac19b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 -- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 msgr2=0x7f38ac19df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 0x7f38ac19df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 -- 172.21.15.6:0/283287082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38a00095f0 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0ff8f0 0x7f38ac0698e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38a0004710 tx=0x7f38a0009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38a9ffb700 1 -- 172.21.15.6:0/283287082 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a001d070 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ac19eca0 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38a9ffb700 1 -- 172.21.15.6:0/283287082 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38a0021410 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.694+0000 7f38a9ffb700 1 -- 172.21.15.6:0/283287082 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0017650 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.695+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac19f0d0 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.698+0000 7f38a9ffb700 1 -- 172.21.15.6:0/283287082 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f38a0021580 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.698+0000 7f38a9ffb700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f389c0a0640 0x7f389c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.698+0000 7f38a9ffb700 1 -- 172.21.15.6:0/283287082 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f38a00ccfb0 con 0x7f38ac0ff8f0 2023-09-13T09:44:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.698+0000 7f38abfff700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f389c0a0640 0x7f389c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 Processor -- start 2023-09-13T09:44:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 -- start start 2023-09-13T09:44:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f389c0a0640 0x7f389c0a2b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3898009c60 tx=0x7f3898009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c3470 0x55ee209c18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee20916780 con 0x55ee209c3470 2023-09-13T09:44:36.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee209140a0 con 0x55ee209c2b10 2023-09-13T09:44:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee2090f990 con 0x55ee209c1e10 2023-09-13T09:44:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c3470 0x55ee209c18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c3470 0x55ee209c18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37160/0 (socket says 172.21.15.6:37160) 2023-09-13T09:44:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 -- 172.21.15.6:0/1866639107 learned_addr learned my addr 172.21.15.6:0/1866639107 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38b14c2700 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 -- 172.21.15.6:0/1866639107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 msgr2=0x55ee209c2270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209c2270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 -- 172.21.15.6:0/1866639107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 msgr2=0x55ee209c2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38abfff700 1 -- 172.21.15.6:0/1866639107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee2078f630 con 0x55ee209c3470 2023-09-13T09:44:36.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.699+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:36.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38abfff700 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c3470 0x55ee209c18d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f389800e4e0 tx=0x7f3898014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ceb539047ca7f2e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f3896ffd700 1 -- 172.21.15.6:0/1866639107 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800ee00 con 0x55ee209c3470 2023-09-13T09:44:36.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f3896ffd700 1 -- 172.21.15.6:0/1866639107 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3898021070 con 0x55ee209c3470 2023-09-13T09:44:36.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f3896ffd700 1 -- 172.21.15.6:0/1866639107 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389801d7d0 con 0x55ee209c3470 2023-09-13T09:44:36.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1866639107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c3470 msgr2=0x55ee209c18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c3470 0x55ee209c18d0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f389800e4e0 tx=0x7f3898014000 comp rx=0 tx=0).stop 2023-09-13T09:44:36.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1866639107 shutdown_connections 2023-09-13T09:44:36.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209c2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1866639107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c3470 0x55ee209c18d0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1866639107 >> 172.21.15.6:0/1866639107 conn(0x55ee2091bc80 msgr2=0x55ee209b7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1866639107 shutdown_connections 2023-09-13T09:44:36.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.700+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1866639107 wait complete. 2023-09-13T09:44:36.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 -- start start 2023-09-13T09:44:36.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 Processor -- start 2023-09-13T09:44:36.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c1e10 0x55ee209cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c3470 0x55ee209d2860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee208adbb0 con 0x55ee209c1e10 2023-09-13T09:44:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee208ad8b0 con 0x55ee209c3470 2023-09-13T09:44:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee20791920 con 0x55ee209c2b10 2023-09-13T09:44:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38bf10ab80 10 client.0 _ll_register_callbacks cb 0x55ee208ab680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c1e10 0x55ee209cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38b14c2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c3470 0x55ee209d2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38abfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c1e10 0x55ee209cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37164/0 (socket says 172.21.15.6:37164) 2023-09-13T09:44:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38b14c2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c3470 0x55ee209d2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:58924/0 (socket says 172.21.15.6:58924) 2023-09-13T09:44:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38b0cc1700 1 -- 172.21.15.6:0/1191693569 learned_addr learned my addr 172.21.15.6:0/1191693569 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.701+0000 7f38abfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209cb820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40220/0 (socket says 172.21.15.6:40220) 2023-09-13T09:44:36.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38abfff700 1 -- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c3470 msgr2=0x55ee209d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38abfff700 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c3470 0x55ee209d2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38abfff700 1 -- 172.21.15.6:0/1191693569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c1e10 msgr2=0x55ee209cb2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38abfff700 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c1e10 0x55ee209cb2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38abfff700 1 -- 172.21.15.6:0/1191693569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3898017070 con 0x55ee209c2b10 2023-09-13T09:44:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38b14c2700 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c3470 0x55ee209d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:36.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c1e10 0x55ee209cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:44:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38abfff700 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209cb820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f389800e4b0 tx=0x7f389800edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccb7f95551cb07e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f388bfff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:44:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f388bfff700 1 -- 172.21.15.6:0/1191693569 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898005250 con 0x55ee209c2b10 2023-09-13T09:44:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee209b0670 con 0x55ee209c2b10 2023-09-13T09:44:36.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f388bfff700 1 -- 172.21.15.6:0/1191693569 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f38980053b0 con 0x55ee209c2b10 2023-09-13T09:44:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f388bfff700 1 -- 172.21.15.6:0/1191693569 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3898005570 con 0x55ee209c2b10 2023-09-13T09:44:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38bf10ab80 10 client.26194 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.702+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ee209277a0 con 0x55ee209c2b10 2023-09-13T09:44:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f388bfff700 1 -- 172.21.15.6:0/1191693569 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f389803d080 con 0x55ee209c2b10 2023-09-13T09:44:36.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f388bfff700 1 -- 172.21.15.6:0/1191693569 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f389801c6b0 con 0x55ee209c2b10 2023-09-13T09:44:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38bf10ab80 10 client.26194 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38bf10ab80 10 client.26194 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38bf10ab80 20 client.26194 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209d6f50 0x55ee209d9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38bf10ab80 4 client.26194 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:44:36.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee20908970 con 0x55ee209d6f50 2023-09-13T09:44:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209d6f50 0x55ee209d9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f388bfff700 10 client.26194 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.703+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209d6f50 0x55ee209d9370 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e94001372d23404a server_cookie=29b62b8046ebc115 in_seq=0 out_seq=0 2023-09-13T09:44:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f388bfff700 1 -- 172.21.15.6:0/1191693569 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee20908970 con 0x55ee209d6f50 2023-09-13T09:44:36.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f388bfff700 10 client.26194 handle_command_reply: tid=0 2023-09-13T09:44:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 client.26194 shutdown 2023-09-13T09:44:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 msgr2=0x55ee209cb820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209cb820 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f389800e4b0 tx=0x7f389800edb0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 shutdown_connections 2023-09-13T09:44:36.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c3470 0x55ee209d2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209d6f50 0x55ee209d9370 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee209c1e10 0x55ee209cb2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1191693569 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209cb820 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f388bfff700 0 client.26194 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 >> 172.21.15.6:0/1191693569 conn(0x55ee2091bc80 msgr2=0x55ee209b27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 shutdown_connections 2023-09-13T09:44:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.704+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1191693569 wait complete. 2023-09-13T09:44:36.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.705+0000 7f38bf10ab80 20 client.26194 trim_cache size 0 max 16384 2023-09-13T09:44:36.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 Processor -- start 2023-09-13T09:44:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 -- start start 2023-09-13T09:44:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209d2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee209cc1b0 con 0x55ee2091bc80 2023-09-13T09:44:36.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee209b0400 con 0x55ee209c2b10 2023-09-13T09:44:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.721+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee209cbf60 con 0x55ee209c1e10 2023-09-13T09:44:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37172/0 (socket says 172.21.15.6:37172) 2023-09-13T09:44:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 -- 172.21.15.6:0/3496881051 learned_addr learned my addr 172.21.15.6:0/3496881051 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38abfff700 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209d2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b14c2700 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 -- 172.21.15.6:0/3496881051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 msgr2=0x55ee209d2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209d2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 -- 172.21.15.6:0/3496881051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 msgr2=0x55ee209c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 -- 172.21.15.6:0/3496881051 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee2073bde0 con 0x55ee2091bc80 2023-09-13T09:44:36.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209c5d50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f38a00cadd0 tx=0x7f38a00cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a033a12eba7414c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38977fe700 1 -- 172.21.15.6:0/3496881051 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a009a7e0 con 0x55ee2091bc80 2023-09-13T09:44:36.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38977fe700 1 -- 172.21.15.6:0/3496881051 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38a009e610 con 0x55ee2091bc80 2023-09-13T09:44:36.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.722+0000 7f38977fe700 1 -- 172.21.15.6:0/3496881051 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0099f30 con 0x55ee2091bc80 2023-09-13T09:44:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 -- 172.21.15.6:0/3496881051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 msgr2=0x55ee209c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209c5d50 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f38a00cadd0 tx=0x7f38a00cc040 comp rx=0 tx=0).stop 2023-09-13T09:44:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 -- 172.21.15.6:0/3496881051 shutdown_connections 2023-09-13T09:44:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c2b10 0x55ee209c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209c5d50 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/3496881051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c1e10 0x55ee209d2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 -- 172.21.15.6:0/3496881051 >> 172.21.15.6:0/3496881051 conn(0x55ee209ca380 msgr2=0x55ee209d3150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 -- 172.21.15.6:0/3496881051 shutdown_connections 2023-09-13T09:44:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 -- 172.21.15.6:0/3496881051 wait complete. 2023-09-13T09:44:36.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 -- start start 2023-09-13T09:44:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.723+0000 7f38bf10ab80 1 Processor -- start 2023-09-13T09:44:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209d2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c1e10 0x55ee209d25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38bf10ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209ceb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee209cf0e0 con 0x55ee2091bc80 2023-09-13T09:44:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee209cf250 con 0x55ee209c1e10 2023-09-13T09:44:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38bf10ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee209cf410 con 0x55ee209c2b10 2023-09-13T09:44:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38bf10ab80 10 client.0 _ll_register_callbacks cb 0x55ee208ab680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:44:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209d2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209d2070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37178/0 (socket says 172.21.15.6:37178) 2023-09-13T09:44:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 -- 172.21.15.6:0/1947559098 learned_addr learned my addr 172.21.15.6:0/1947559098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:44:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38abfff700 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c1e10 0x55ee209d25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b14c2700 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209ceb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 -- 172.21.15.6:0/1947559098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 msgr2=0x55ee209ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209ceb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 -- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c1e10 msgr2=0x55ee209d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:44:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c1e10 0x55ee209d25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.724+0000 7f38b0cc1700 1 -- 172.21.15.6:0/1947559098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38ac19eca0 con 0x55ee2091bc80 2023-09-13T09:44:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38b0cc1700 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209d2070 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f38a009ae40 tx=0x7f38a0098b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2637a00784aa67 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:44:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f388bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:44:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f388bfff700 1 -- 172.21.15.6:0/1947559098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38a0099ed0 con 0x55ee2091bc80 2023-09-13T09:44:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f388bfff700 1 -- 172.21.15.6:0/1947559098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f38a00a27c0 con 0x55ee2091bc80 2023-09-13T09:44:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3898021070 con 0x55ee2091bc80 2023-09-13T09:44:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f388bfff700 1 -- 172.21.15.6:0/1947559098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f38a009a7e0 con 0x55ee2091bc80 2023-09-13T09:44:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 10 client.16827 fetch_fsmap learned FSMap version 34 2023-09-13T09:44:36.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ee20724c60 con 0x55ee2091bc80 2023-09-13T09:44:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f388bfff700 1 -- 172.21.15.6:0/1947559098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3898021070 con 0x55ee2091bc80 2023-09-13T09:44:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f388bfff700 1 -- 172.21.15.6:0/1947559098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f38a00662b0 con 0x55ee2091bc80 2023-09-13T09:44:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 10 client.16827 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:44:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 10 client.16827 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:44:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 20 client.16827 populate_metadata read hostname 'smithi006' 2023-09-13T09:44:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209c3470 0x55ee20a2e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:44:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 4 client.16827 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:44:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee208c9050 con 0x55ee209c3470 2023-09-13T09:44:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.725+0000 7f38abfff700 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209c3470 0x55ee20a2e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:44:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f388bfff700 10 client.16827 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38abfff700 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209c3470 0x55ee20a2e010 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdc1f7009b7abfb8 server_cookie=d58549216cf6b3b1 in_seq=0 out_seq=0 2023-09-13T09:44:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f388bfff700 1 -- 172.21.15.6:0/1947559098 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ee208c9050 con 0x55ee209c3470 2023-09-13T09:44:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f388bfff700 10 client.16827 handle_command_reply: tid=0 2023-09-13T09:44:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 client.16827 shutdown 2023-09-13T09:44:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 msgr2=0x55ee209d2070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209d2070 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f38a009ae40 tx=0x7f38a0098b80 comp rx=0 tx=0).stop 2023-09-13T09:44:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 shutdown_connections 2023-09-13T09:44:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee209c2b10 0x55ee209ceb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee209c3470 0x55ee20a2e010 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee2091bc80 0x55ee209d2070 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 --2- 172.21.15.6:0/1947559098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee209c1e10 0x55ee209d25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f388bfff700 0 client.16827 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:44:36.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 >> 172.21.15.6:0/1947559098 conn(0x55ee209ca380 msgr2=0x55ee209c5d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 shutdown_connections 2023-09-13T09:44:36.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.726+0000 7f38bf10ab80 1 -- 172.21.15.6:0/1947559098 wait complete. 2023-09-13T09:44:36.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38bf10ab80 20 client.16827 trim_cache size 0 max 16384 2023-09-13T09:44:36.747 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:44:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:44:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:44:36.747 INFO:teuthology.orchestra.run.smithi006.stdout: "30e1e358-6a8b-4242-a655-c82a6ea4eb07": { 2023-09-13T09:44:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:44:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "30e1e358-6a8b-4242-a655-c82a6ea4eb07", 2023-09-13T09:44:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:44:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:44:36.748 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:44:36.748 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:44:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f389c0a0640 msgr2=0x7f389c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f389c0a0640 0x7f389c0a2b00 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3898009c60 tx=0x7f3898009260 comp rx=0 tx=0).stop 2023-09-13T09:44:36.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0ff8f0 msgr2=0x7f38ac0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:44:36.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0ff8f0 0x7f38ac0698e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f38a0004710 tx=0x7f38a0009580 comp rx=0 tx=0).stop 2023-09-13T09:44:36.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 shutdown_connections 2023-09-13T09:44:36.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f389c0a0640 0x7f389c0a2b00 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38ac1013c0 0x7f38ac19df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38ac0ff8f0 0x7f38ac0698e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 --2- 172.21.15.6:0/283287082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38ac100290 0x7f38ac19b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:44:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 >> 172.21.15.6:0/283287082 conn(0x7f38ac0fb250 msgr2=0x7f38ac0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:44:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 shutdown_connections 2023-09-13T09:44:36.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:44:36.727+0000 7f38b2f25700 1 -- 172.21.15.6:0/283287082 wait complete. 2023-09-13T09:44:36.752 INFO:tasks.cephfs.filesystem:scrub status for tag:30e1e358-6a8b-4242-a655-c82a6ea4eb07 - {'path': '/', 'tag': '30e1e358-6a8b-4242-a655-c82a6ea4eb07', 'options': 'recursive,force'} 2023-09-13T09:44:37.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:36 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:37.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:36 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:37.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:36 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:37.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:36 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:37.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 161978 3.16 MB/sec execute 117 sec latency 2332.783 ms 2023-09-13T09:44:37.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:36 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:37.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:36 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:37.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:36 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:37.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:36 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:37.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:36 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:36 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:36 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:37.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:36 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 163524 3.24 MB/sec execute 118 sec latency 13.442 ms 2023-09-13T09:44:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: pgmap v453: 97 pgs: 97 active+clean; 80 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 711 KiB/s wr, 113 op/s 2023-09-13T09:44:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:44:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:38.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:44:38.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:37 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: pgmap v453: 97 pgs: 97 active+clean; 80 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 711 KiB/s wr, 113 op/s 2023-09-13T09:44:38.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:44:38.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:38.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:38.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:38.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:38.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:44:38.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:37 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: pgmap v453: 97 pgs: 97 active+clean; 80 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 446 KiB/s rd, 711 KiB/s wr, 113 op/s 2023-09-13T09:44:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:44:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:38.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:44:38.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:38.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:37 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:44:39.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 163850 3.21 MB/sec execute 119 sec latency 570.018 ms 2023-09-13T09:44:40.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 163850 3.18 MB/sec execute 120 sec latency 1570.104 ms 2023-09-13T09:44:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:39 smithi006 ceph-mon[98665]: pgmap v454: 97 pgs: 97 active+clean; 80 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 723 KiB/s wr, 104 op/s 2023-09-13T09:44:40.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:39 smithi053 ceph-mon[102373]: pgmap v454: 97 pgs: 97 active+clean; 80 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 723 KiB/s wr, 104 op/s 2023-09-13T09:44:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:39 smithi131 ceph-mon[102785]: pgmap v454: 97 pgs: 97 active+clean; 80 MiB data, 921 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 723 KiB/s wr, 104 op/s 2023-09-13T09:44:41.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 163850 3.16 MB/sec execute 121 sec latency 2570.212 ms 2023-09-13T09:44:42.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 163865 3.13 MB/sec execute 122 sec latency 3558.012 ms 2023-09-13T09:44:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:41 smithi053 ceph-mon[102373]: pgmap v455: 97 pgs: 97 active+clean; 81 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 801 KiB/s wr, 106 op/s 2023-09-13T09:44:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:41 smithi006 ceph-mon[98665]: pgmap v455: 97 pgs: 97 active+clean; 81 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 801 KiB/s wr, 106 op/s 2023-09-13T09:44:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:41 smithi131 ceph-mon[102785]: pgmap v455: 97 pgs: 97 active+clean; 81 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 801 KiB/s wr, 106 op/s 2023-09-13T09:44:43.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 166081 3.20 MB/sec execute 123 sec latency 45.155 ms 2023-09-13T09:44:44.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167255 3.24 MB/sec execute 124 sec latency 15.669 ms 2023-09-13T09:44:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:43 smithi006 ceph-mon[98665]: pgmap v456: 97 pgs: 97 active+clean; 81 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 841 KiB/s wr, 107 op/s 2023-09-13T09:44:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:43 smithi053 ceph-mon[102373]: pgmap v456: 97 pgs: 97 active+clean; 81 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 841 KiB/s wr, 107 op/s 2023-09-13T09:44:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:43 smithi131 ceph-mon[102785]: pgmap v456: 97 pgs: 97 active+clean; 81 MiB data, 929 MiB used, 1.0 TiB / 1.0 TiB avail; 304 KiB/s rd, 841 KiB/s wr, 107 op/s 2023-09-13T09:44:45.162 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167399 3.21 MB/sec execute 125 sec latency 881.010 ms 2023-09-13T09:44:46.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167399 3.18 MB/sec execute 126 sec latency 1881.141 ms 2023-09-13T09:44:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:45 smithi006 ceph-mon[98665]: pgmap v457: 97 pgs: 97 active+clean; 82 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 928 KiB/s wr, 123 op/s 2023-09-13T09:44:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:45 smithi053 ceph-mon[102373]: pgmap v457: 97 pgs: 97 active+clean; 82 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 928 KiB/s wr, 123 op/s 2023-09-13T09:44:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:45 smithi131 ceph-mon[102785]: pgmap v457: 97 pgs: 97 active+clean; 82 MiB data, 966 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 928 KiB/s wr, 123 op/s 2023-09-13T09:44:47.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167411 3.16 MB/sec execute 127 sec latency 2870.666 ms 2023-09-13T09:44:48.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167455 3.14 MB/sec execute 128 sec latency 969.401 ms 2023-09-13T09:44:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:47 smithi006 ceph-mon[98665]: pgmap v458: 97 pgs: 97 active+clean; 82 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 760 KiB/s wr, 112 op/s 2023-09-13T09:44:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:47 smithi053 ceph-mon[102373]: pgmap v458: 97 pgs: 97 active+clean; 82 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 760 KiB/s wr, 112 op/s 2023-09-13T09:44:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:47 smithi131 ceph-mon[102785]: pgmap v458: 97 pgs: 97 active+clean; 82 MiB data, 972 MiB used, 1.0 TiB / 1.0 TiB avail; 368 KiB/s rd, 760 KiB/s wr, 112 op/s 2023-09-13T09:44:49.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167455 3.11 MB/sec execute 129 sec latency 1969.438 ms 2023-09-13T09:44:50.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167455 3.09 MB/sec execute 130 sec latency 2969.549 ms 2023-09-13T09:44:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:49 smithi053 ceph-mon[102373]: pgmap v459: 97 pgs: 97 active+clean; 84 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 781 KiB/s wr, 115 op/s 2023-09-13T09:44:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:49 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:49 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:49 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:49 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:50.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:49 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:44:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:49 smithi006 ceph-mon[98665]: pgmap v459: 97 pgs: 97 active+clean; 84 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 781 KiB/s wr, 115 op/s 2023-09-13T09:44:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:49 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:49 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:49 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:49 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:49 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:44:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:49 smithi131 ceph-mon[102785]: pgmap v459: 97 pgs: 97 active+clean; 84 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 371 KiB/s rd, 781 KiB/s wr, 115 op/s 2023-09-13T09:44:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:49 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:49 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:49 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:49 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:49 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:44:51.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167455 3.06 MB/sec execute 131 sec latency 3969.644 ms 2023-09-13T09:44:52.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167470 3.04 MB/sec execute 132 sec latency 4958.251 ms 2023-09-13T09:44:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:51 smithi006 ceph-mon[98665]: pgmap v460: 97 pgs: 97 active+clean; 84 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 766 KiB/s wr, 94 op/s 2023-09-13T09:44:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:51 smithi053 ceph-mon[102373]: pgmap v460: 97 pgs: 97 active+clean; 84 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 766 KiB/s wr, 94 op/s 2023-09-13T09:44:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:51 smithi131 ceph-mon[102785]: pgmap v460: 97 pgs: 97 active+clean; 84 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 321 KiB/s rd, 766 KiB/s wr, 94 op/s 2023-09-13T09:44:53.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167523 3.02 MB/sec execute 133 sec latency 962.695 ms 2023-09-13T09:44:54.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167523 3.00 MB/sec execute 134 sec latency 1962.787 ms 2023-09-13T09:44:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:53 smithi006 ceph-mon[98665]: pgmap v461: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 913 KiB/s wr, 93 op/s 2023-09-13T09:44:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:53 smithi053 ceph-mon[102373]: pgmap v461: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 913 KiB/s wr, 93 op/s 2023-09-13T09:44:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:53 smithi131 ceph-mon[102785]: pgmap v461: 97 pgs: 97 active+clean; 83 MiB data, 998 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 913 KiB/s wr, 93 op/s 2023-09-13T09:44:55.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167523 2.97 MB/sec execute 135 sec latency 2962.854 ms 2023-09-13T09:44:56.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167523 2.95 MB/sec execute 136 sec latency 3962.982 ms 2023-09-13T09:44:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:55 smithi006 ceph-mon[98665]: pgmap v462: 97 pgs: 97 active+clean; 83 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 1021 KiB/s wr, 94 op/s 2023-09-13T09:44:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:55 smithi053 ceph-mon[102373]: pgmap v462: 97 pgs: 97 active+clean; 83 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 1021 KiB/s wr, 94 op/s 2023-09-13T09:44:56.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:55 smithi131 ceph-mon[102785]: pgmap v462: 97 pgs: 97 active+clean; 83 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 259 KiB/s rd, 1021 KiB/s wr, 94 op/s 2023-09-13T09:44:57.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 167545 2.93 MB/sec execute 137 sec latency 4945.280 ms 2023-09-13T09:44:58.163 INFO:tasks.workunit.client.0.smithi006.stdout: 1 169905 3.00 MB/sec execute 138 sec latency 14.487 ms 2023-09-13T09:44:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:57 smithi006 ceph-mon[98665]: pgmap v463: 97 pgs: 97 active+clean; 82 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2023-09-13T09:44:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:57 smithi053 ceph-mon[102373]: pgmap v463: 97 pgs: 97 active+clean; 82 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2023-09-13T09:44:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:57 smithi131 ceph-mon[102785]: pgmap v463: 97 pgs: 97 active+clean; 82 MiB data, 996 MiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 1.2 MiB/s wr, 86 op/s 2023-09-13T09:44:59.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170939 3.02 MB/sec execute 139 sec latency 13.672 ms 2023-09-13T09:45:00.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170939 3.00 MB/sec execute 140 sec latency 1006.629 ms 2023-09-13T09:45:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:44:59 smithi006 ceph-mon[98665]: pgmap v464: 97 pgs: 97 active+clean; 82 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.2 MiB/s wr, 88 op/s 2023-09-13T09:45:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:44:59 smithi053 ceph-mon[102373]: pgmap v464: 97 pgs: 97 active+clean; 82 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.2 MiB/s wr, 88 op/s 2023-09-13T09:45:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:44:59 smithi131 ceph-mon[102785]: pgmap v464: 97 pgs: 97 active+clean; 82 MiB data, 995 MiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 1.2 MiB/s wr, 88 op/s 2023-09-13T09:45:01.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170939 2.98 MB/sec execute 141 sec latency 2006.761 ms 2023-09-13T09:45:02.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170966 2.96 MB/sec execute 142 sec latency 2987.551 ms 2023-09-13T09:45:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:01 smithi006 ceph-mon[98665]: pgmap v465: 97 pgs: 97 active+clean; 82 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 1.3 MiB/s wr, 82 op/s 2023-09-13T09:45:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:01 smithi053 ceph-mon[102373]: pgmap v465: 97 pgs: 97 active+clean; 82 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 1.3 MiB/s wr, 82 op/s 2023-09-13T09:45:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:01 smithi131 ceph-mon[102785]: pgmap v465: 97 pgs: 97 active+clean; 82 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 1.3 MiB/s wr, 82 op/s 2023-09-13T09:45:03.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170995 2.94 MB/sec execute 143 sec latency 973.836 ms 2023-09-13T09:45:04.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170995 2.92 MB/sec execute 144 sec latency 1973.936 ms 2023-09-13T09:45:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:03 smithi006 ceph-mon[98665]: pgmap v466: 97 pgs: 97 active+clean; 83 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 1.4 MiB/s wr, 88 op/s 2023-09-13T09:45:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:03 smithi053 ceph-mon[102373]: pgmap v466: 97 pgs: 97 active+clean; 83 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 1.4 MiB/s wr, 88 op/s 2023-09-13T09:45:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:03 smithi131 ceph-mon[102785]: pgmap v466: 97 pgs: 97 active+clean; 83 MiB data, 997 MiB used, 1.0 TiB / 1.0 TiB avail; 219 KiB/s rd, 1.4 MiB/s wr, 88 op/s 2023-09-13T09:45:05.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170995 2.90 MB/sec execute 145 sec latency 2974.027 ms 2023-09-13T09:45:06.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 170995 2.88 MB/sec execute 146 sec latency 3974.115 ms 2023-09-13T09:45:06.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:05 smithi006 ceph-mon[98665]: pgmap v467: 97 pgs: 97 active+clean; 82 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2023-09-13T09:45:06.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:05 smithi053 ceph-mon[102373]: pgmap v467: 97 pgs: 97 active+clean; 82 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2023-09-13T09:45:06.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:05 smithi131 ceph-mon[102785]: pgmap v467: 97 pgs: 97 active+clean; 82 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 316 KiB/s rd, 1.1 MiB/s wr, 95 op/s 2023-09-13T09:45:06.753 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:45:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 -- 172.21.15.6:0/1410306753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40101fb0 msgr2=0x7f1d40102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 --2- 172.21.15.6:0/1410306753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40101fb0 0x7f1d40102410 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c0099c0 tx=0x7f1d3c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 -- 172.21.15.6:0/1410306753 shutdown_connections 2023-09-13T09:45:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 --2- 172.21.15.6:0/1410306753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d40102950 0x7f1d40109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 --2- 172.21.15.6:0/1410306753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d40100dc0 0x7f1d401011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 --2- 172.21.15.6:0/1410306753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40101fb0 0x7f1d40102410 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 -- 172.21.15.6:0/1410306753 >> 172.21.15.6:0/1410306753 conn(0x7f1d400fc350 msgr2=0x7f1d400fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 -- 172.21.15.6:0/1410306753 shutdown_connections 2023-09-13T09:45:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.895+0000 7f1d4727f700 1 -- 172.21.15.6:0/1410306753 wait complete. 2023-09-13T09:45:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 Processor -- start 2023-09-13T09:45:06.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 -- start start 2023-09-13T09:45:06.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d40100dc0 0x7f1d40074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d40101fb0 0x7f1d400730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40102950 0x7f1d400735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40073d80 con 0x7f1d40102950 2023-09-13T09:45:06.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d40073ef0 con 0x7f1d40101fb0 2023-09-13T09:45:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4727f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d401a0990 con 0x7f1d40100dc0 2023-09-13T09:45:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4581c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40102950 0x7f1d400735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4581c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40102950 0x7f1d400735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37196/0 (socket says 172.21.15.6:37196) 2023-09-13T09:45:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4581c700 1 -- 172.21.15.6:0/2111374787 learned_addr learned my addr 172.21.15.6:0/2111374787 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:06.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4481a700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d40101fb0 0x7f1d400730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.896+0000 7f1d4501b700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d40100dc0 0x7f1d40074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4581c700 1 -- 172.21.15.6:0/2111374787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d40100dc0 msgr2=0x7f1d40074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4581c700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d40100dc0 0x7f1d40074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4581c700 1 -- 172.21.15.6:0/2111374787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d40101fb0 msgr2=0x7f1d400730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4581c700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d40101fb0 0x7f1d400730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4581c700 1 -- 172.21.15.6:0/2111374787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0095f0 con 0x7f1d40102950 2023-09-13T09:45:06.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4581c700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40102950 0x7f1d400735e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007d70 tx=0x7f1d3800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:06.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d367fc700 1 -- 172.21.15.6:0/2111374787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3800ac90 con 0x7f1d40102950 2023-09-13T09:45:06.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d367fc700 1 -- 172.21.15.6:0/2111374787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d3800adf0 con 0x7f1d40102950 2023-09-13T09:45:06.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d401a0c70 con 0x7f1d40102950 2023-09-13T09:45:06.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d367fc700 1 -- 172.21.15.6:0/2111374787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380115e0 con 0x7f1d40102950 2023-09-13T09:45:06.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.897+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d401a1130 con 0x7f1d40102950 2023-09-13T09:45:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.900+0000 7f1d367fc700 1 -- 172.21.15.6:0/2111374787 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1d38012420 con 0x7f1d40102950 2023-09-13T09:45:06.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.900+0000 7f1d367fc700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1d2c0a0640 0x7f1d2c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d367fc700 1 -- 172.21.15.6:0/2111374787 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1d380cbe50 con 0x7f1d40102950 2023-09-13T09:45:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d4501b700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1d2c0a0640 0x7f1d2c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d4501b700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1d2c0a0640 0x7f1d2c0a2b00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1d40101e10 tx=0x7f1d3000a3b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:06.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 Processor -- start 2023-09-13T09:45:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 -- start start 2023-09-13T09:45:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562768410700 0x562768410b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276840f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56276840fa00 0x56276840fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562768368780 con 0x562768411060 2023-09-13T09:45:06.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627683660a0 con 0x56276840fa00 2023-09-13T09:45:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.901+0000 7f1d53464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562768361990 con 0x562768410700 2023-09-13T09:45:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276840f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276840f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37202/0 (socket says 172.21.15.6:37202) 2023-09-13T09:45:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 -- 172.21.15.6:0/3300767110 learned_addr learned my addr 172.21.15.6:0/3300767110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:06.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4501b700 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562768410700 0x562768410b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4581c700 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56276840fa00 0x56276840fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 -- 172.21.15.6:0/3300767110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562768410700 msgr2=0x562768410b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562768410700 0x562768410b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 -- 172.21.15.6:0/3300767110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56276840fa00 msgr2=0x56276840fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56276840fa00 0x56276840fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 -- 172.21.15.6:0/3300767110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627681e1630 con 0x562768411060 2023-09-13T09:45:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4581c700 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56276840fa00 0x56276840fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4501b700 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562768410700 0x562768410b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d4481a700 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276840f4c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c000c00 tx=0x7f1d3c0050f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff8d2e4f1d8773b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:06.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d2b7fe700 1 -- 172.21.15.6:0/3300767110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c01d070 con 0x562768411060 2023-09-13T09:45:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d2b7fe700 1 -- 172.21.15.6:0/3300767110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d3c01e040 con 0x562768411060 2023-09-13T09:45:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.902+0000 7f1d2b7fe700 1 -- 172.21.15.6:0/3300767110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c003b50 con 0x562768411060 2023-09-13T09:45:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 -- 172.21.15.6:0/3300767110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 msgr2=0x56276840f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276840f4c0 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c000c00 tx=0x7f1d3c0050f0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 -- 172.21.15.6:0/3300767110 shutdown_connections 2023-09-13T09:45:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56276840fa00 0x56276840fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562768410700 0x562768410b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3300767110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276840f4c0 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 -- 172.21.15.6:0/3300767110 >> 172.21.15.6:0/3300767110 conn(0x56276836dc80 msgr2=0x562768409f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:06.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 -- 172.21.15.6:0/3300767110 shutdown_connections 2023-09-13T09:45:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 -- 172.21.15.6:0/3300767110 wait complete. 2023-09-13T09:45:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 -- start start 2023-09-13T09:45:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.903+0000 7f1d53464b80 1 Processor -- start 2023-09-13T09:45:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x562768418e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768410700 0x5627684193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768411060 0x5627684203f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d53464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627682ffbb0 con 0x562768410700 2023-09-13T09:45:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d53464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627682ff8b0 con 0x562768411060 2023-09-13T09:45:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d53464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627681e3920 con 0x56276840fa00 2023-09-13T09:45:06.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d53464b80 10 client.0 _ll_register_callbacks cb 0x5627682fd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768410700 0x5627684193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768410700 0x5627684193b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37208/0 (socket says 172.21.15.6:37208) 2023-09-13T09:45:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 -- 172.21.15.6:0/758236590 learned_addr learned my addr 172.21.15.6:0/758236590 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4581c700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768411060 0x5627684203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4501b700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x562768418e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 -- 172.21.15.6:0/758236590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 msgr2=0x562768418e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x562768418e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 -- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768411060 msgr2=0x5627684203f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768411060 0x5627684203f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4481a700 1 -- 172.21.15.6:0/758236590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d40109b50 con 0x562768410700 2023-09-13T09:45:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.904+0000 7f1d4581c700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768411060 0x5627684203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d4481a700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768410700 0x5627684193b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009350 tx=0x7f1d3c00ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdc7b61cae04697 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:06.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d28ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d28ff9700 1 -- 172.21.15.6:0/758236590 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c01d030 con 0x562768410700 2023-09-13T09:45:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d28ff9700 1 -- 172.21.15.6:0/758236590 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1d3c003d40 con 0x562768410700 2023-09-13T09:45:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562768402670 con 0x562768410700 2023-09-13T09:45:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d28ff9700 1 -- 172.21.15.6:0/758236590 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d3c003f00 con 0x562768410700 2023-09-13T09:45:06.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 10 client.16839 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5627683797a0 con 0x562768410700 2023-09-13T09:45:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d28ff9700 1 -- 172.21.15.6:0/758236590 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562768402670 con 0x562768410700 2023-09-13T09:45:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d28ff9700 1 -- 172.21.15.6:0/758236590 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1d3c004c90 con 0x562768410700 2023-09-13T09:45:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 10 client.16839 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 10 client.16839 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 20 client.16839 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562768424830 0x562768426c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 4 client.16839 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.905+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56276835a970 con 0x562768424830 2023-09-13T09:45:06.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.906+0000 7f1d4501b700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562768424830 0x562768426c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.906+0000 7f1d4501b700 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562768424830 0x562768426c50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2555b394a5ab9005 server_cookie=a6fcbb5f18f27ef0 in_seq=0 out_seq=0 2023-09-13T09:45:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.906+0000 7f1d28ff9700 10 client.16839 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d28ff9700 1 -- 172.21.15.6:0/758236590 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56276835a970 con 0x562768424830 2023-09-13T09:45:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d28ff9700 10 client.16839 handle_command_reply: tid=0 2023-09-13T09:45:06.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 client.16839 shutdown 2023-09-13T09:45:06.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768410700 msgr2=0x5627684193b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768410700 0x5627684193b0 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009350 tx=0x7f1d3c00ba70 comp rx=0 tx=0).stop 2023-09-13T09:45:06.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 shutdown_connections 2023-09-13T09:45:06.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768411060 0x5627684203f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x562768418e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562768424830 0x562768426c50 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 --2- 172.21.15.6:0/758236590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768410700 0x5627684193b0 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 >> 172.21.15.6:0/758236590 conn(0x56276836dc80 msgr2=0x5627684047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d28ff9700 0 client.16839 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:06.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 shutdown_connections 2023-09-13T09:45:06.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 1 -- 172.21.15.6:0/758236590 wait complete. 2023-09-13T09:45:06.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.907+0000 7f1d53464b80 20 client.16839 trim_cache size 0 max 16384 2023-09-13T09:45:06.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 Processor -- start 2023-09-13T09:45:06.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 -- start start 2023-09-13T09:45:06.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276840f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x5627684203b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x562768409e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562768418a40 con 0x562768411060 2023-09-13T09:45:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562768419fc0 con 0x562768410700 2023-09-13T09:45:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d53464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627684143e0 con 0x56276840fa00 2023-09-13T09:45:06.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d4581c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x562768409e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d4581c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x562768409e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37218/0 (socket says 172.21.15.6:37218) 2023-09-13T09:45:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d4581c700 1 -- 172.21.15.6:0/3922070469 learned_addr learned my addr 172.21.15.6:0/3922070469 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d4481a700 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x5627684203b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.924+0000 7f1d4501b700 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276840f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d4581c700 1 -- 172.21.15.6:0/3922070469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 msgr2=0x56276840f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d4581c700 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276840f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d4581c700 1 -- 172.21.15.6:0/3922070469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 msgr2=0x5627684203b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d4581c700 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x5627684203b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d4581c700 1 -- 172.21.15.6:0/3922070469 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56276818dde0 con 0x562768411060 2023-09-13T09:45:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d4481a700 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x5627684203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d4581c700 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x562768409e60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1d38099290 tx=0x7f1d38099490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0ac8f5ebf54ba8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d2bfff700 1 -- 172.21.15.6:0/3922070469 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38099590 con 0x562768411060 2023-09-13T09:45:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d2bfff700 1 -- 172.21.15.6:0/3922070469 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d3809d3c0 con 0x562768411060 2023-09-13T09:45:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d2bfff700 1 -- 172.21.15.6:0/3922070469 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d38099a50 con 0x562768411060 2023-09-13T09:45:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 -- 172.21.15.6:0/3922070469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 msgr2=0x562768409e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x562768409e60 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f1d38099290 tx=0x7f1d38099490 comp rx=0 tx=0).stop 2023-09-13T09:45:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 -- 172.21.15.6:0/3922070469 shutdown_connections 2023-09-13T09:45:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x562768409e60 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276840f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 --2- 172.21.15.6:0/3922070469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x5627684203b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 -- 172.21.15.6:0/3922070469 >> 172.21.15.6:0/3922070469 conn(0x56276836dc80 msgr2=0x562768417b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.925+0000 7f1d53464b80 1 -- 172.21.15.6:0/3922070469 shutdown_connections 2023-09-13T09:45:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 -- 172.21.15.6:0/3922070469 wait complete. 2023-09-13T09:45:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 -- start start 2023-09-13T09:45:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 Processor -- start 2023-09-13T09:45:06.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276841c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x56276841c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276841f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56276841fc70 con 0x562768411060 2023-09-13T09:45:06.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56276841fde0 con 0x562768410700 2023-09-13T09:45:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56276841ffa0 con 0x56276840fa00 2023-09-13T09:45:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d53464b80 10 client.0 _ll_register_callbacks cb 0x5627682fd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d4581c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276841f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d4581c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276841f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37224/0 (socket says 172.21.15.6:37224) 2023-09-13T09:45:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d4581c700 1 -- 172.21.15.6:0/2535544871 learned_addr learned my addr 172.21.15.6:0/2535544871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.926+0000 7f1d4501b700 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276841c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d4481a700 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x56276841c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d4581c700 1 -- 172.21.15.6:0/2535544871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 msgr2=0x56276841c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d4581c700 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276841c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d4581c700 1 -- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 msgr2=0x56276841c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d4581c700 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x56276841c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d4581c700 1 -- 172.21.15.6:0/2535544871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d401a1130 con 0x562768411060 2023-09-13T09:45:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d4581c700 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276841f730 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800a690 tx=0x7f1d38095210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9684c2b373a060 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d28ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d28ff9700 1 -- 172.21.15.6:0/2535544871 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d380b7070 con 0x562768411060 2023-09-13T09:45:06.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d28ff9700 1 -- 172.21.15.6:0/2535544871 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1d3809d170 con 0x562768411060 2023-09-13T09:45:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d3c01e040 con 0x562768411060 2023-09-13T09:45:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d28ff9700 1 -- 172.21.15.6:0/2535544871 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d38099590 con 0x562768411060 2023-09-13T09:45:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d53464b80 10 client.16845 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562768176c60 con 0x562768411060 2023-09-13T09:45:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d28ff9700 1 -- 172.21.15.6:0/2535544871 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1d3807c080 con 0x562768411060 2023-09-13T09:45:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.927+0000 7f1d28ff9700 1 -- 172.21.15.6:0/2535544871 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1d380a1170 con 0x562768411060 2023-09-13T09:45:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 10 client.16845 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 10 client.16845 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 20 client.16845 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627684791b0 0x56276847b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 4 client.16845 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:45:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56276831b050 con 0x5627684791b0 2023-09-13T09:45:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d4501b700 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627684791b0 0x56276847b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d28ff9700 10 client.16845 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d4501b700 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627684791b0 0x56276847b5d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aab75c4d2d3e4e5 server_cookie=ac138643bb5c17b5 in_seq=0 out_seq=0 2023-09-13T09:45:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d28ff9700 1 -- 172.21.15.6:0/2535544871 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56276831b050 con 0x5627684791b0 2023-09-13T09:45:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d28ff9700 10 client.16845 handle_command_reply: tid=0 2023-09-13T09:45:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 1 client.16845 shutdown 2023-09-13T09:45:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 msgr2=0x56276841f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.928+0000 7f1d53464b80 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276841f730 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f1d3800a690 tx=0x7f1d38095210 comp rx=0 tx=0).stop 2023-09-13T09:45:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 shutdown_connections 2023-09-13T09:45:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627684791b0 0x56276847b5d0 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562768411060 0x56276841f730 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56276840fa00 0x56276841c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d28ff9700 0 client.16845 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 --2- 172.21.15.6:0/2535544871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562768410700 0x56276841c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 >> 172.21.15.6:0/2535544871 conn(0x56276836dc80 msgr2=0x562768413880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 shutdown_connections 2023-09-13T09:45:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 1 -- 172.21.15.6:0/2535544871 wait complete. 2023-09-13T09:45:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d53464b80 20 client.16845 trim_cache size 0 max 16384 2023-09-13T09:45:06.952 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:45:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:45:06.952 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:45:06.952 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:45:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1d2c0a0640 msgr2=0x7f1d2c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1d2c0a0640 0x7f1d2c0a2b00 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1d40101e10 tx=0x7f1d3000a3b0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40102950 msgr2=0x7f1d400735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40102950 0x7f1d400735e0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f1d38007d70 tx=0x7f1d3800a340 comp rx=0 tx=0).stop 2023-09-13T09:45:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 shutdown_connections 2023-09-13T09:45:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1d2c0a0640 0x7f1d2c0a2b00 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d40102950 0x7f1d400735e0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d40100dc0 0x7f1d40074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 --2- 172.21.15.6:0/2111374787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1d40101fb0 0x7f1d400730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 >> 172.21.15.6:0/2111374787 conn(0x7f1d400fc350 msgr2=0x7f1d400fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 shutdown_connections 2023-09-13T09:45:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:06.929+0000 7f1d4727f700 1 -- 172.21.15.6:0/2111374787 wait complete. 2023-09-13T09:45:06.956 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:45:06.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:45:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.081+0000 7f76e6d57700 1 -- 172.21.15.6:0/1045259388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0100610 msgr2=0x7f76e0100a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.081+0000 7f76e6d57700 1 --2- 172.21.15.6:0/1045259388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0100610 0x7f76e0100a70 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0099c0 tx=0x7f76cc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.081+0000 7f76e6d57700 1 -- 172.21.15.6:0/1045259388 shutdown_connections 2023-09-13T09:45:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 --2- 172.21.15.6:0/1045259388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e0100fb0 0x7f76e0107860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 --2- 172.21.15.6:0/1045259388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76e00ff420 0x7f76e00ff840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 --2- 172.21.15.6:0/1045259388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e0100610 0x7f76e0100a70 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 -- 172.21.15.6:0/1045259388 >> 172.21.15.6:0/1045259388 conn(0x7f76e00fa990 msgr2=0x7f76e00fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 -- 172.21.15.6:0/1045259388 shutdown_connections 2023-09-13T09:45:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 -- 172.21.15.6:0/1045259388 wait complete. 2023-09-13T09:45:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 Processor -- start 2023-09-13T09:45:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 -- start start 2023-09-13T09:45:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e00ff420 0x7f76e0195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76e0100610 0x7f76e0195e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e0100fb0 0x7f76e019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e019d4b0 con 0x7f76e00ff420 2023-09-13T09:45:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e019d5f0 con 0x7f76e0100fb0 2023-09-13T09:45:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.082+0000 7f76e6d57700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e019d780 con 0x7f76e0100610 2023-09-13T09:45:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e00ff420 0x7f76e0195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e00ff420 0x7f76e0195930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37234/0 (socket says 172.21.15.6:37234) 2023-09-13T09:45:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 -- 172.21.15.6:0/3965705126 learned_addr learned my addr 172.21.15.6:0/3965705126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e52f4700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e0100fb0 0x7f76e019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76dffff700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76e0100610 0x7f76e0195e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 -- 172.21.15.6:0/3965705126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76e0100610 msgr2=0x7f76e0195e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76e0100610 0x7f76e0195e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 -- 172.21.15.6:0/3965705126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e0100fb0 msgr2=0x7f76e019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e0100fb0 0x7f76e019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 -- 172.21.15.6:0/3965705126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc0095f0 con 0x7f76e00ff420 2023-09-13T09:45:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e4af3700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e00ff420 0x7f76e0195930 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f76d40098f0 tx=0x7f76d4009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76ddffb700 1 -- 172.21.15.6:0/3965705126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4012070 con 0x7f76e00ff420 2023-09-13T09:45:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76ddffb700 1 -- 172.21.15.6:0/3965705126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76d40044e0 con 0x7f76e00ff420 2023-09-13T09:45:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e00fc2c0 con 0x7f76e00ff420 2023-09-13T09:45:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76ddffb700 1 -- 172.21.15.6:0/3965705126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d4003df0 con 0x7f76e00ff420 2023-09-13T09:45:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.083+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e00fc7d0 con 0x7f76e00ff420 2023-09-13T09:45:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.084+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e010ac40 con 0x7f76e00ff420 2023-09-13T09:45:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.085+0000 7f76ddffb700 1 -- 172.21.15.6:0/3965705126 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f76d4016030 con 0x7f76e00ff420 2023-09-13T09:45:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.086+0000 7f76ddffb700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76d00a0640 0x7f76d00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.086+0000 7f76dffff700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76d00a0640 0x7f76d00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.086+0000 7f76ddffb700 1 -- 172.21.15.6:0/3965705126 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f76d40cccf0 con 0x7f76e00ff420 2023-09-13T09:45:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.087+0000 7f76dffff700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76d00a0640 0x7f76d00a2b00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00b580 tx=0x7f76cc005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.091+0000 7f76ddffb700 1 -- 172.21.15.6:0/3965705126 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f76d40d1070 con 0x7f76e00ff420 2023-09-13T09:45:07.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 171017 2.86 MB/sec execute 147 sec latency 4954.209 ms 2023-09-13T09:45:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.353+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76e0106b70 con 0x7f76e00ff420 2023-09-13T09:45:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.354+0000 7f76ddffb700 1 -- 172.21.15.6:0/3965705126 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f76d40967d0 con 0x7f76e00ff420 2023-09-13T09:45:07.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:45:07.355 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:45:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76d00a0640 msgr2=0x7f76d00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76d00a0640 0x7f76d00a2b00 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00b580 tx=0x7f76cc005bc0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e00ff420 msgr2=0x7f76e0195930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e00ff420 0x7f76e0195930 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f76d40098f0 tx=0x7f76d4009c00 comp rx=0 tx=0).stop 2023-09-13T09:45:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 shutdown_connections 2023-09-13T09:45:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f76e0100fb0 0x7f76e019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76d00a0640 0x7f76d00a2b00 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76e00ff420 0x7f76e0195930 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 --2- 172.21.15.6:0/3965705126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76e0100610 0x7f76e0195e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 >> 172.21.15.6:0/3965705126 conn(0x7f76e00fa990 msgr2=0x7f76e01040d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 shutdown_connections 2023-09-13T09:45:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.356+0000 7f76e6d57700 1 -- 172.21.15.6:0/3965705126 wait complete. 2023-09-13T09:45:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:45:07.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:45:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- 172.21.15.6:0/3936601186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd068100eb0 msgr2=0x7fd068101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 --2- 172.21.15.6:0/3936601186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd068100eb0 0x7fd068101310 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7fd0540099c0 tx=0x7fd054009cd0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- 172.21.15.6:0/3936601186 shutdown_connections 2023-09-13T09:45:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 --2- 172.21.15.6:0/3936601186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068101850 0x7fd068108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 --2- 172.21.15.6:0/3936601186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0680ffcc0 0x7fd0681000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 --2- 172.21.15.6:0/3936601186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd068100eb0 0x7fd068101310 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- 172.21.15.6:0/3936601186 >> 172.21.15.6:0/3936601186 conn(0x7fd0680fb250 msgr2=0x7fd0680fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- 172.21.15.6:0/3936601186 shutdown_connections 2023-09-13T09:45:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- 172.21.15.6:0/3936601186 wait complete. 2023-09-13T09:45:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 Processor -- start 2023-09-13T09:45:07.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- start start 2023-09-13T09:45:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0680ffcc0 0x7fd068195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd068100eb0 0x7fd068195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068101850 0x7fd06819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06819d500 con 0x7fd0680ffcc0 2023-09-13T09:45:07.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06819d640 con 0x7fd068101850 2023-09-13T09:45:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.499+0000 7fd06ec99700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06819d7d0 con 0x7fd068100eb0 2023-09-13T09:45:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06ca35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0680ffcc0 0x7fd068195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06d236700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068101850 0x7fd06819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06ca35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0680ffcc0 0x7fd068195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37248/0 (socket says 172.21.15.6:37248) 2023-09-13T09:45:07.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06ca35700 1 -- 172.21.15.6:0/2601982827 learned_addr learned my addr 172.21.15.6:0/2601982827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd067fff700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd068100eb0 0x7fd068195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06d236700 1 -- 172.21.15.6:0/2601982827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd068100eb0 msgr2=0x7fd068195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06d236700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd068100eb0 0x7fd068195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06d236700 1 -- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0680ffcc0 msgr2=0x7fd068195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06d236700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0680ffcc0 0x7fd068195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06d236700 1 -- 172.21.15.6:0/2601982827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540095f0 con 0x7fd068101850 2023-09-13T09:45:07.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06ca35700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0680ffcc0 0x7fd068195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:07.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06d236700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068101850 0x7fd06819cf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd06000efc0 tx=0x7fd06000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd065ffb700 1 -- 172.21.15.6:0/2601982827 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060018070 con 0x7fd068101850 2023-09-13T09:45:07.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd068067fb0 con 0x7fd068101850 2023-09-13T09:45:07.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd065ffb700 1 -- 172.21.15.6:0/2601982827 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd06000f040 con 0x7fd068101850 2023-09-13T09:45:07.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.500+0000 7fd065ffb700 1 -- 172.21.15.6:0/2601982827 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06000cd40 con 0x7fd068101850 2023-09-13T09:45:07.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.501+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd068068470 con 0x7fd068101850 2023-09-13T09:45:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.503+0000 7fd065ffb700 1 -- 172.21.15.6:0/2601982827 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd060003a00 con 0x7fd068101850 2023-09-13T09:45:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.504+0000 7fd065ffb700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0580a0640 0x7fd0580a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.504+0000 7fd065ffb700 1 -- 172.21.15.6:0/2601982827 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd0600cb7b0 con 0x7fd068101850 2023-09-13T09:45:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.504+0000 7fd06ca35700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0580a0640 0x7fd0580a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.504+0000 7fd06ca35700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0580a0640 0x7fd0580a2b00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd05c005950 tx=0x7fd05c010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 Processor -- start 2023-09-13T09:45:07.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 -- start start 2023-09-13T09:45:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d6116b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61154c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d6115e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d606e780 con 0x5607d6115a00 2023-09-13T09:45:07.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d606c0a0 con 0x5607d6116700 2023-09-13T09:45:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d6067990 con 0x5607d6117060 2023-09-13T09:45:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd06d236700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d6115e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd067fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd06d236700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d6115e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37260/0 (socket says 172.21.15.6:37260) 2023-09-13T09:45:07.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd06d236700 1 -- 172.21.15.6:0/920746582 learned_addr learned my addr 172.21.15.6:0/920746582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.505+0000 7fd06ca35700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d6116b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd06d236700 1 -- 172.21.15.6:0/920746582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 msgr2=0x5607d61154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd06d236700 1 --2- 172.21.15.6:0/920746582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd06d236700 1 -- 172.21.15.6:0/920746582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 msgr2=0x5607d6116b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd06d236700 1 --2- 172.21.15.6:0/920746582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d6116b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd06d236700 1 -- 172.21.15.6:0/920746582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607d5ee7630 con 0x5607d6115a00 2023-09-13T09:45:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd06d236700 1 --2- 172.21.15.6:0/920746582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d6115e80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd0600090a0 tx=0x7fd060098e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc9919595c5a2af server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd052ffd700 1 -- 172.21.15.6:0/920746582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060004ad0 con 0x5607d6115a00 2023-09-13T09:45:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd052ffd700 1 -- 172.21.15.6:0/920746582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0600996e0 con 0x5607d6115a00 2023-09-13T09:45:07.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.506+0000 7fd052ffd700 1 -- 172.21.15.6:0/920746582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd06001b320 con 0x5607d6115a00 2023-09-13T09:45:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/920746582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 msgr2=0x5607d6115e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/920746582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d6115e80 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fd0600090a0 tx=0x7fd060098e30 comp rx=0 tx=0).stop 2023-09-13T09:45:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/920746582 shutdown_connections 2023-09-13T09:45:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/920746582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d6115e80 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/920746582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d6116b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/920746582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/920746582 >> 172.21.15.6:0/920746582 conn(0x5607d6073c80 msgr2=0x5607d610ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/920746582 shutdown_connections 2023-09-13T09:45:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/920746582 wait complete. 2023-09-13T09:45:07.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 -- start start 2023-09-13T09:45:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 Processor -- start 2023-09-13T09:45:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.507+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d611ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d611f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61264e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d6005bb0 con 0x5607d6115a00 2023-09-13T09:45:07.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d60058b0 con 0x5607d6116700 2023-09-13T09:45:07.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d5ee9920 con 0x5607d6117060 2023-09-13T09:45:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd07ae7eb80 10 client.0 _ll_register_callbacks cb 0x5607d6003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:07.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d611ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d611ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37262/0 (socket says 172.21.15.6:37262) 2023-09-13T09:45:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 -- 172.21.15.6:0/2164861600 learned_addr learned my addr 172.21.15.6:0/2164861600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06d236700 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd067fff700 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d611f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 -- 172.21.15.6:0/2164861600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 msgr2=0x5607d61264e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61264e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 -- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 msgr2=0x5607d611f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d611f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 -- 172.21.15.6:0/2164861600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd068068470 con 0x5607d6115a00 2023-09-13T09:45:07.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd06ca35700 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d611ef60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd05c01a710 tx=0x7fd05c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2c24bf7190fb61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd047fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd047fff700 1 -- 172.21.15.6:0/2164861600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05c021040 con 0x5607d6115a00 2023-09-13T09:45:07.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd047fff700 1 -- 172.21.15.6:0/2164861600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd05c01ae30 con 0x5607d6115a00 2023-09-13T09:45:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.508+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607d6108670 con 0x5607d6115a00 2023-09-13T09:45:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd047fff700 1 -- 172.21.15.6:0/2164861600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd05c013040 con 0x5607d6115a00 2023-09-13T09:45:07.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 10 client.16863 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5607d607f7a0 con 0x5607d6115a00 2023-09-13T09:45:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd047fff700 1 -- 172.21.15.6:0/2164861600 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5607d6108670 con 0x5607d6115a00 2023-09-13T09:45:07.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd047fff700 1 -- 172.21.15.6:0/2164861600 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd05c019620 con 0x5607d6115a00 2023-09-13T09:45:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 10 client.16863 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 10 client.16863 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:45:07.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 20 client.16863 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d612adf0 0x5607d612d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 4 client.16863 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607d6060970 con 0x5607d612adf0 2023-09-13T09:45:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.509+0000 7fd067fff700 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d612adf0 0x5607d612d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.510+0000 7fd067fff700 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d612adf0 0x5607d612d210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ed8afa8a4864cfaf server_cookie=d02cb0758b3a887d in_seq=0 out_seq=0 2023-09-13T09:45:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.510+0000 7fd047fff700 10 client.16863 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.510+0000 7fd047fff700 1 -- 172.21.15.6:0/2164861600 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5607d6060970 con 0x5607d612adf0 2023-09-13T09:45:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.510+0000 7fd047fff700 10 client.16863 handle_command_reply: tid=0 2023-09-13T09:45:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.510+0000 7fd07ae7eb80 1 client.16863 shutdown 2023-09-13T09:45:07.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.510+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 msgr2=0x5607d611ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.510+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d611ef60 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fd05c01a710 tx=0x7fd05c0047c0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 shutdown_connections 2023-09-13T09:45:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d612adf0 0x5607d612d210 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6117060 0x5607d61264e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6115a00 0x5607d611ef60 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/2164861600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6116700 0x5607d611f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd047fff700 0 client.16863 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 >> 172.21.15.6:0/2164861600 conn(0x5607d6073c80 msgr2=0x5607d610a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 shutdown_connections 2023-09-13T09:45:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/2164861600 wait complete. 2023-09-13T09:45:07.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.511+0000 7fd07ae7eb80 20 client.16863 trim_cache size 0 max 16384 2023-09-13T09:45:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 Processor -- start 2023-09-13T09:45:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 -- start start 2023-09-13T09:45:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6115a00 0x5607d61154c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6116700 0x5607d61264a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6117060 0x5607d611ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d6111a40 con 0x5607d6116700 2023-09-13T09:45:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d6110c20 con 0x5607d6117060 2023-09-13T09:45:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d611cc30 con 0x5607d6115a00 2023-09-13T09:45:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd067fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6116700 0x5607d61264a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd067fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6116700 0x5607d61264a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37272/0 (socket says 172.21.15.6:37272) 2023-09-13T09:45:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd067fff700 1 -- 172.21.15.6:0/3143908766 learned_addr learned my addr 172.21.15.6:0/3143908766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd06ca35700 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6115a00 0x5607d61154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.524+0000 7fd06d236700 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6117060 0x5607d611ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd067fff700 1 -- 172.21.15.6:0/3143908766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6115a00 msgr2=0x5607d61154c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd067fff700 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6115a00 0x5607d61154c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd067fff700 1 -- 172.21.15.6:0/3143908766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6117060 msgr2=0x5607d611ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd067fff700 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6117060 0x5607d611ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd067fff700 1 -- 172.21.15.6:0/3143908766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607d5e93de0 con 0x5607d6116700 2023-09-13T09:45:07.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd067fff700 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6116700 0x5607d61264a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd054000c00 tx=0x7fd054005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33521271d52a62e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd0537fe700 1 -- 172.21.15.6:0/3143908766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400bcf0 con 0x5607d6116700 2023-09-13T09:45:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd0537fe700 1 -- 172.21.15.6:0/3143908766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd054022040 con 0x5607d6116700 2023-09-13T09:45:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.525+0000 7fd0537fe700 1 -- 172.21.15.6:0/3143908766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054005330 con 0x5607d6116700 2023-09-13T09:45:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/3143908766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6116700 msgr2=0x5607d61264a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6116700 0x5607d61264a0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7fd054000c00 tx=0x7fd054005fb0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/3143908766 shutdown_connections 2023-09-13T09:45:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6117060 0x5607d611ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6115a00 0x5607d61154c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/3143908766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6116700 0x5607d61264a0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/3143908766 >> 172.21.15.6:0/3143908766 conn(0x5607d6073c80 msgr2=0x5607d61199c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/3143908766 shutdown_connections 2023-09-13T09:45:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/3143908766 wait complete. 2023-09-13T09:45:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 -- start start 2023-09-13T09:45:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 Processor -- start 2023-09-13T09:45:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6115a00 0x5607d6122500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6116700 0x5607d6122a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6117060 0x5607d6125a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.526+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d6125fa0 con 0x5607d6117060 2023-09-13T09:45:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d6126110 con 0x5607d6115a00 2023-09-13T09:45:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd07ae7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607d61262d0 con 0x5607d6116700 2023-09-13T09:45:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd07ae7eb80 10 client.0 _ll_register_callbacks cb 0x5607d6003680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6117060 0x5607d6125a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06ca35700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6115a00 0x5607d6122500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd067fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6116700 0x5607d6122a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6117060 0x5607d6125a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37280/0 (socket says 172.21.15.6:37280) 2023-09-13T09:45:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd067fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6116700 0x5607d6122a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40332/0 (socket says 172.21.15.6:40332) 2023-09-13T09:45:07.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 -- 172.21.15.6:0/86708413 learned_addr learned my addr 172.21.15.6:0/86708413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06ca35700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6115a00 0x5607d6122500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59032/0 (socket says 172.21.15.6:59032) 2023-09-13T09:45:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 -- 172.21.15.6:0/86708413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6116700 msgr2=0x5607d6122a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6116700 0x5607d6122a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 -- 172.21.15.6:0/86708413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6115a00 msgr2=0x5607d6122500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6115a00 0x5607d6122500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 -- 172.21.15.6:0/86708413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd068108a50 con 0x5607d6117060 2023-09-13T09:45:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd06d236700 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6117060 0x5607d6125a60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c6f0 tx=0x7fd0600060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54b0c2f6ef12f18 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd047fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd047fff700 1 -- 172.21.15.6:0/86708413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd060004ad0 con 0x5607d6117060 2023-09-13T09:45:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd047fff700 1 -- 172.21.15.6:0/86708413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd06009ce10 con 0x5607d6117060 2023-09-13T09:45:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0600996e0 con 0x5607d6117060 2023-09-13T09:45:07.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd047fff700 1 -- 172.21.15.6:0/86708413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0600a0fc0 con 0x5607d6117060 2023-09-13T09:45:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd07ae7eb80 10 client.16869 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.527+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5607d5e7cc60 con 0x5607d6117060 2023-09-13T09:45:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd047fff700 1 -- 172.21.15.6:0/86708413 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0600996e0 con 0x5607d6117060 2023-09-13T09:45:07.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd047fff700 1 -- 172.21.15.6:0/86708413 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd0600984d0 con 0x5607d6117060 2023-09-13T09:45:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd07ae7eb80 10 client.16869 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd07ae7eb80 10 client.16869 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:45:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd07ae7eb80 20 client.16869 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d617f970 0x5607d6181d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd07ae7eb80 4 client.16869 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:07.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5607d6021050 con 0x5607d617f970 2023-09-13T09:45:07.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd06ca35700 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d617f970 0x5607d6181d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd047fff700 10 client.16869 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:07.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.528+0000 7fd06ca35700 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d617f970 0x5607d6181d90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=af3840c46f69c5a server_cookie=b151a32f881d3d4e in_seq=0 out_seq=0 2023-09-13T09:45:07.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd047fff700 1 -- 172.21.15.6:0/86708413 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5607d6021050 con 0x5607d617f970 2023-09-13T09:45:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd047fff700 10 client.16869 handle_command_reply: tid=0 2023-09-13T09:45:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 client.16869 shutdown 2023-09-13T09:45:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6117060 msgr2=0x5607d6125a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6117060 0x5607d6125a60 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fd06000c6f0 tx=0x7fd0600060e0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 shutdown_connections 2023-09-13T09:45:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5607d617f970 0x5607d6181d90 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5607d6117060 0x5607d6125a60 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd047fff700 0 client.16869 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:07.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5607d6115a00 0x5607d6122500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 --2- 172.21.15.6:0/86708413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5607d6116700 0x5607d6122a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 >> 172.21.15.6:0/86708413 conn(0x5607d6073c80 msgr2=0x5607d611ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 shutdown_connections 2023-09-13T09:45:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 1 -- 172.21.15.6:0/86708413 wait complete. 2023-09-13T09:45:07.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.529+0000 7fd07ae7eb80 20 client.16869 trim_cache size 0 max 16384 2023-09-13T09:45:07.562 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:07.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0580a0640 msgr2=0x7fd0580a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0580a0640 0x7fd0580a2b00 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd05c005950 tx=0x7fd05c010040 comp rx=0 tx=0).stop 2023-09-13T09:45:07.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068101850 msgr2=0x7fd06819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068101850 0x7fd06819cf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd06000efc0 tx=0x7fd06000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 shutdown_connections 2023-09-13T09:45:07.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd068101850 0x7fd06819cf30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0580a0640 0x7fd0580a2b00 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0680ffcc0 0x7fd068195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 --2- 172.21.15.6:0/2601982827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd068100eb0 0x7fd068195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 >> 172.21.15.6:0/2601982827 conn(0x7fd0680fb250 msgr2=0x7fd0680fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 shutdown_connections 2023-09-13T09:45:07.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.530+0000 7fd06ec99700 1 -- 172.21.15.6:0/2601982827 wait complete. 2023-09-13T09:45:07.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:45:07.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 -- 172.21.15.6:0/1789893366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88901018b0 msgr2=0x7f8890108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 --2- 172.21.15.6:0/1789893366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88901018b0 0x7f8890108140 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f888800b0a0 tx=0x7f888800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 -- 172.21.15.6:0/1789893366 shutdown_connections 2023-09-13T09:45:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 --2- 172.21.15.6:0/1789893366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88901018b0 0x7f8890108140 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 --2- 172.21.15.6:0/1789893366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88901001e0 0x7f8890100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 --2- 172.21.15.6:0/1789893366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8890100ef0 0x7f8890101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 -- 172.21.15.6:0/1789893366 >> 172.21.15.6:0/1789893366 conn(0x7f88900fa9b0 msgr2=0x7f88900fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.700+0000 7f88987eb700 1 -- 172.21.15.6:0/1789893366 shutdown_connections 2023-09-13T09:45:07.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 -- 172.21.15.6:0/1789893366 wait complete. 2023-09-13T09:45:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 Processor -- start 2023-09-13T09:45:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 -- start start 2023-09-13T09:45:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88901001e0 0x7f88900ff8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8890100ef0 0x7f889019b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88901018b0 0x7f889019df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889019e6a0 con 0x7f8890100ef0 2023-09-13T09:45:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889019e810 con 0x7f88901001e0 2023-09-13T09:45:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f88987eb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889019e9d0 con 0x7f88901018b0 2023-09-13T09:45:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f8895d86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8890100ef0 0x7f889019b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f8895d86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8890100ef0 0x7f889019b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37292/0 (socket says 172.21.15.6:37292) 2023-09-13T09:45:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f8895d86700 1 -- 172.21.15.6:0/4198608236 learned_addr learned my addr 172.21.15.6:0/4198608236 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f8896587700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88901001e0 0x7f88900ff8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.701+0000 7f8896d88700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88901018b0 0x7f889019df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f8895d86700 1 -- 172.21.15.6:0/4198608236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88901018b0 msgr2=0x7f889019df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f8895d86700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88901018b0 0x7f889019df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f8895d86700 1 -- 172.21.15.6:0/4198608236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88901001e0 msgr2=0x7f88900ff8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f8895d86700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88901001e0 0x7f88900ff8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f8895d86700 1 -- 172.21.15.6:0/4198608236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8888009d00 con 0x7f8890100ef0 2023-09-13T09:45:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f8895d86700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8890100ef0 0x7f889019b8c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f888000e970 tx=0x7f888000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f88877fe700 1 -- 172.21.15.6:0/4198608236 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880009790 con 0x7f8890100ef0 2023-09-13T09:45:07.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88901957b0 con 0x7f8890100ef0 2023-09-13T09:45:07.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f88877fe700 1 -- 172.21.15.6:0/4198608236 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f888000c7e0 con 0x7f8890100ef0 2023-09-13T09:45:07.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f88877fe700 1 -- 172.21.15.6:0/4198608236 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8880003c70 con 0x7f8890100ef0 2023-09-13T09:45:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.702+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8890195cc0 con 0x7f8890100ef0 2023-09-13T09:45:07.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.704+0000 7f88877fe700 1 -- 172.21.15.6:0/4198608236 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f888000cc50 con 0x7f8890100ef0 2023-09-13T09:45:07.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.705+0000 7f88877fe700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f887c0a0640 0x7f887c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.705+0000 7f8896587700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f887c0a0640 0x7f887c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.705+0000 7f88877fe700 1 -- 172.21.15.6:0/4198608236 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8880014070 con 0x7f8890100ef0 2023-09-13T09:45:07.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.705+0000 7f8896587700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f887c0a0640 0x7f887c0a2b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8890067b20 tx=0x7f888c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 Processor -- start 2023-09-13T09:45:07.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 -- start start 2023-09-13T09:45:07.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fd700 0x5574d33fdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fe060 0x5574d33fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d3355780 con 0x5574d33fd700 2023-09-13T09:45:07.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d33530a0 con 0x5574d33fca00 2023-09-13T09:45:07.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d334e990 con 0x5574d33fe060 2023-09-13T09:45:07.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896587700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fd700 0x5574d33fdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896587700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fd700 0x5574d33fdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37298/0 (socket says 172.21.15.6:37298) 2023-09-13T09:45:07.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896587700 1 -- 172.21.15.6:0/177954069 learned_addr learned my addr 172.21.15.6:0/177954069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896d88700 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8895d86700 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fe060 0x5574d33fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896d88700 1 -- 172.21.15.6:0/177954069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fe060 msgr2=0x5574d33fc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896d88700 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fe060 0x5574d33fc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896d88700 1 -- 172.21.15.6:0/177954069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fd700 msgr2=0x5574d33fdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896d88700 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fd700 0x5574d33fdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.706+0000 7f8896d88700 1 -- 172.21.15.6:0/177954069 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574d31ce630 con 0x5574d33fca00 2023-09-13T09:45:07.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.707+0000 7f8896d88700 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fce80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fd0 tx=0x7f8888009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719fb235905ca0c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.707+0000 7f8884ff9700 1 -- 172.21.15.6:0/177954069 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800e040 con 0x5574d33fca00 2023-09-13T09:45:07.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.707+0000 7f8884ff9700 1 -- 172.21.15.6:0/177954069 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8888006000 con 0x5574d33fca00 2023-09-13T09:45:07.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.707+0000 7f8884ff9700 1 -- 172.21.15.6:0/177954069 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888801c440 con 0x5574d33fca00 2023-09-13T09:45:07.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- 172.21.15.6:0/177954069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 msgr2=0x5574d33fce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fce80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fd0 tx=0x7f8888009c60 comp rx=0 tx=0).stop 2023-09-13T09:45:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- 172.21.15.6:0/177954069 shutdown_connections 2023-09-13T09:45:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fce80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fd700 0x5574d33fdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/177954069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fe060 0x5574d33fc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- 172.21.15.6:0/177954069 >> 172.21.15.6:0/177954069 conn(0x5574d335ac80 msgr2=0x5574d33f6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- 172.21.15.6:0/177954069 shutdown_connections 2023-09-13T09:45:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- 172.21.15.6:0/177954069 wait complete. 2023-09-13T09:45:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- start start 2023-09-13T09:45:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 Processor -- start 2023-09-13T09:45:07.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fca00 0x5574d3405ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fd700 0x5574d34063e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d340d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d32ecbb0 con 0x5574d33fe060 2023-09-13T09:45:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d32ec8b0 con 0x5574d33fd700 2023-09-13T09:45:07.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.708+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d31d0920 con 0x5574d33fca00 2023-09-13T09:45:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f88a49d0b80 10 client.0 _ll_register_callbacks cb 0x5574d32ea680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896587700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fca00 0x5574d3405ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896d88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d340d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896587700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fca00 0x5574d3405ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40358/0 (socket says 172.21.15.6:40358) 2023-09-13T09:45:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896587700 1 -- 172.21.15.6:0/234140662 learned_addr learned my addr 172.21.15.6:0/234140662 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8895d86700 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fd700 0x5574d34063e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896d88700 1 -- 172.21.15.6:0/234140662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fca00 msgr2=0x5574d3405ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896d88700 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fca00 0x5574d3405ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896d88700 1 -- 172.21.15.6:0/234140662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fd700 msgr2=0x5574d34063e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896d88700 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fd700 0x5574d34063e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896d88700 1 -- 172.21.15.6:0/234140662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8890108a70 con 0x5574d33fe060 2023-09-13T09:45:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8896d88700 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d340d420 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fd0 tx=0x7f8888003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b7f06ae533f397 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8879ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8879ffb700 1 -- 172.21.15.6:0/234140662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800e040 con 0x5574d33fe060 2023-09-13T09:45:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8879ffb700 1 -- 172.21.15.6:0/234140662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8888025460 con 0x5574d33fe060 2023-09-13T09:45:07.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5574d33ef670 con 0x5574d33fe060 2023-09-13T09:45:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f8879ffb700 1 -- 172.21.15.6:0/234140662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8888025620 con 0x5574d33fe060 2023-09-13T09:45:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f88a49d0b80 10 client.16881 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.709+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5574d33667a0 con 0x5574d33fe060 2023-09-13T09:45:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f8879ffb700 1 -- 172.21.15.6:0/234140662 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8888036020 con 0x5574d33fe060 2023-09-13T09:45:07.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f8879ffb700 1 -- 172.21.15.6:0/234140662 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8888019070 con 0x5574d33fe060 2023-09-13T09:45:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f88a49d0b80 10 client.16881 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f88a49d0b80 10 client.16881 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:45:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f88a49d0b80 20 client.16881 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d3411950 0x5574d3413d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f88a49d0b80 4 client.16881 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5574d3347970 con 0x5574d3411950 2023-09-13T09:45:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f8896587700 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d3411950 0x5574d3413d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f8879ffb700 10 client.16881 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.710+0000 7f8896587700 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d3411950 0x5574d3413d70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c2c29d8ee2e4cef4 server_cookie=cad24f743f76b410 in_seq=0 out_seq=0 2023-09-13T09:45:07.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f8879ffb700 1 -- 172.21.15.6:0/234140662 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5574d3347970 con 0x5574d3411950 2023-09-13T09:45:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f8879ffb700 10 client.16881 handle_command_reply: tid=0 2023-09-13T09:45:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 client.16881 shutdown 2023-09-13T09:45:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 msgr2=0x5574d340d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d340d420 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f8888009fd0 tx=0x7f8888003f00 comp rx=0 tx=0).stop 2023-09-13T09:45:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 shutdown_connections 2023-09-13T09:45:07.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d3411950 0x5574d3413d70 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d340d420 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fca00 0x5574d3405ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/234140662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fd700 0x5574d34063e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 >> 172.21.15.6:0/234140662 conn(0x5574d335ac80 msgr2=0x5574d33f6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f8879ffb700 0 client.16881 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 shutdown_connections 2023-09-13T09:45:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 1 -- 172.21.15.6:0/234140662 wait complete. 2023-09-13T09:45:07.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.711+0000 7f88a49d0b80 20 client.16881 trim_cache size 0 max 16384 2023-09-13T09:45:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 Processor -- start 2023-09-13T09:45:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 -- start start 2023-09-13T09:45:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d340d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d3400940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d33f7de0 con 0x5574d33fe060 2023-09-13T09:45:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d33f8370 con 0x5574d33fca00 2023-09-13T09:45:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d33f8730 con 0x5574d33fd700 2023-09-13T09:45:07.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f8896d88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d3400940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f8896587700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f8896d88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d3400940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37316/0 (socket says 172.21.15.6:37316) 2023-09-13T09:45:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f8896d88700 1 -- 172.21.15.6:0/3947628418 learned_addr learned my addr 172.21.15.6:0/3947628418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.725+0000 7f8895d86700 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d340d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f8896d88700 1 -- 172.21.15.6:0/3947628418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 msgr2=0x5574d340d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f8896d88700 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d340d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f8896d88700 1 -- 172.21.15.6:0/3947628418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 msgr2=0x5574d33fc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f8896d88700 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f8896d88700 1 -- 172.21.15.6:0/3947628418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5574d317ade0 con 0x5574d33fe060 2023-09-13T09:45:07.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f8896d88700 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d3400940 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8888002230 tx=0x7f8888000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fffedce86abaad6e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f88857fa700 1 -- 172.21.15.6:0/3947628418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800e070 con 0x5574d33fe060 2023-09-13T09:45:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f88857fa700 1 -- 172.21.15.6:0/3947628418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8888036070 con 0x5574d33fe060 2023-09-13T09:45:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.726+0000 7f88857fa700 1 -- 172.21.15.6:0/3947628418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8888025b60 con 0x5574d33fe060 2023-09-13T09:45:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- 172.21.15.6:0/3947628418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 msgr2=0x5574d3400940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d3400940 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f8888002230 tx=0x7f8888000f40 comp rx=0 tx=0).stop 2023-09-13T09:45:07.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- 172.21.15.6:0/3947628418 shutdown_connections 2023-09-13T09:45:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fe060 0x5574d3400940 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fca00 0x5574d33fc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/3947628418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d340d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- 172.21.15.6:0/3947628418 >> 172.21.15.6:0/3947628418 conn(0x5574d335ac80 msgr2=0x5574d3404b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- 172.21.15.6:0/3947628418 shutdown_connections 2023-09-13T09:45:07.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- 172.21.15.6:0/3947628418 wait complete. 2023-09-13T09:45:07.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- start start 2023-09-13T09:45:07.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 Processor -- start 2023-09-13T09:45:07.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fca00 0x5574d3408cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d3409230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fe060 0x5574d340c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d340c790 con 0x5574d33fca00 2023-09-13T09:45:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d340c900 con 0x5574d33fe060 2023-09-13T09:45:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5574d340cac0 con 0x5574d33fd700 2023-09-13T09:45:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f88a49d0b80 10 client.0 _ll_register_callbacks cb 0x5574d32ea680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:07.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f8896587700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fca00 0x5574d3408cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f8896587700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fca00 0x5574d3408cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37318/0 (socket says 172.21.15.6:37318) 2023-09-13T09:45:07.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f8895d86700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d3409230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f8896587700 1 -- 172.21.15.6:0/858826069 learned_addr learned my addr 172.21.15.6:0/858826069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.727+0000 7f8896d88700 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fe060 0x5574d340c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8896587700 1 -- 172.21.15.6:0/858826069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 msgr2=0x5574d3409230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8896587700 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d3409230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8896587700 1 -- 172.21.15.6:0/858826069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fe060 msgr2=0x5574d340c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8896587700 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fe060 0x5574d340c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8896587700 1 -- 172.21.15.6:0/858826069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5574d33667a0 con 0x5574d33fca00 2023-09-13T09:45:07.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8896587700 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fca00 0x5574d3408cf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x5574d3414650 tx=0x7f888c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fb058606647503 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8879ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8879ffb700 1 -- 172.21.15.6:0/858826069 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888c022070 con 0x5574d33fca00 2023-09-13T09:45:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8879ffb700 1 -- 172.21.15.6:0/858826069 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f888c02b4b0 con 0x5574d33fca00 2023-09-13T09:45:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8888006000 con 0x5574d33fca00 2023-09-13T09:45:07.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8879ffb700 1 -- 172.21.15.6:0/858826069 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f888c004020 con 0x5574d33fca00 2023-09-13T09:45:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f88a49d0b80 10 client.16887 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5574d3163c60 con 0x5574d33fca00 2023-09-13T09:45:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8879ffb700 1 -- 172.21.15.6:0/858826069 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8888006000 con 0x5574d33fca00 2023-09-13T09:45:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.728+0000 7f8879ffb700 1 -- 172.21.15.6:0/858826069 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f888c003d10 con 0x5574d33fca00 2023-09-13T09:45:07.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 10 client.16887 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:07.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 10 client.16887 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:45:07.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 20 client.16887 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:07.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d34663f0 0x5574d3468810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 4 client.16887 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:07.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5574d3308050 con 0x5574d34663f0 2023-09-13T09:45:07.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f8895d86700 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d34663f0 0x5574d3468810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f8895d86700 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d34663f0 0x5574d3468810 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c81f7b1475186f31 server_cookie=c26a6fb6a9f2062a in_seq=0 out_seq=0 2023-09-13T09:45:07.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f8879ffb700 10 client.16887 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:07.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f8879ffb700 1 -- 172.21.15.6:0/858826069 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5574d3308050 con 0x5574d34663f0 2023-09-13T09:45:07.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f8879ffb700 10 client.16887 handle_command_reply: tid=0 2023-09-13T09:45:07.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 1 client.16887 shutdown 2023-09-13T09:45:07.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fca00 msgr2=0x5574d3408cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fca00 0x5574d3408cf0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x5574d3414650 tx=0x7f888c0047c0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 shutdown_connections 2023-09-13T09:45:07.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.729+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5574d34663f0 0x5574d3468810 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5574d33fe060 0x5574d340c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f8879ffb700 0 client.16887 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:07.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5574d33fca00 0x5574d3408cf0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88a49d0b80 1 --2- 172.21.15.6:0/858826069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5574d33fd700 0x5574d3409230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 >> 172.21.15.6:0/858826069 conn(0x5574d335ac80 msgr2=0x5574d3405e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 shutdown_connections 2023-09-13T09:45:07.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88a49d0b80 1 -- 172.21.15.6:0/858826069 wait complete. 2023-09-13T09:45:07.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88a49d0b80 20 client.16887 trim_cache size 0 max 16384 2023-09-13T09:45:07.760 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:07.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f887c0a0640 msgr2=0x7f887c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f887c0a0640 0x7f887c0a2b00 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8890067b20 tx=0x7f888c009260 comp rx=0 tx=0).stop 2023-09-13T09:45:07.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8890100ef0 msgr2=0x7f889019b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8890100ef0 0x7f889019b8c0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f888000e970 tx=0x7f888000ec80 comp rx=0 tx=0).stop 2023-09-13T09:45:07.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 shutdown_connections 2023-09-13T09:45:07.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88901018b0 0x7f889019df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f88901001e0 0x7f88900ff8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f887c0a0640 0x7f887c0a2b00 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 --2- 172.21.15.6:0/4198608236 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8890100ef0 0x7f889019b8c0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 >> 172.21.15.6:0/4198608236 conn(0x7f88900fa9b0 msgr2=0x7f88900fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 shutdown_connections 2023-09-13T09:45:07.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.730+0000 7f88987eb700 1 -- 172.21.15.6:0/4198608236 wait complete. 2023-09-13T09:45:07.764 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:45:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 -- 172.21.15.6:0/3591234435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c88101850 msgr2=0x7f6c88108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/3591234435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c88101850 0x7f6c88108100 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b0d0 tx=0x7f6c8000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 -- 172.21.15.6:0/3591234435 shutdown_connections 2023-09-13T09:45:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/3591234435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c88101850 0x7f6c88108100 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/3591234435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c880ffcc0 0x7f6c881000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/3591234435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c88100eb0 0x7f6c88101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 -- 172.21.15.6:0/3591234435 >> 172.21.15.6:0/3591234435 conn(0x7f6c880fb250 msgr2=0x7f6c880fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 -- 172.21.15.6:0/3591234435 shutdown_connections 2023-09-13T09:45:07.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.894+0000 7f6c8dc62700 1 -- 172.21.15.6:0/3591234435 wait complete. 2023-09-13T09:45:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 Processor -- start 2023-09-13T09:45:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 -- start start 2023-09-13T09:45:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c880ffcc0 0x7f6c88194940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c88100eb0 0x7f6c88194e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88101850 0x7f6c8819bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819c4c0 con 0x7f6c880ffcc0 2023-09-13T09:45:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819c600 con 0x7f6c88101850 2023-09-13T09:45:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c8dc62700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c8819c790 con 0x7f6c88100eb0 2023-09-13T09:45:07.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c880ffcc0 0x7f6c88194940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c880ffcc0 0x7f6c88194940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37332/0 (socket says 172.21.15.6:37332) 2023-09-13T09:45:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c877fe700 1 -- 172.21.15.6:0/2772896458 learned_addr learned my addr 172.21.15.6:0/2772896458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c87fff700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88101850 0x7f6c8819bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c88100eb0 0x7f6c88194e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c877fe700 1 -- 172.21.15.6:0/2772896458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c88100eb0 msgr2=0x7f6c88194e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c877fe700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c88100eb0 0x7f6c88194e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.895+0000 7f6c877fe700 1 -- 172.21.15.6:0/2772896458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88101850 msgr2=0x7f6c8819bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c877fe700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88101850 0x7f6c8819bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c877fe700 1 -- 172.21.15.6:0/2772896458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7800b730 con 0x7f6c880ffcc0 2023-09-13T09:45:07.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c877fe700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c880ffcc0 0x7f6c88194940 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6c78010be0 tx=0x7f6c78010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c84ff9700 1 -- 172.21.15.6:0/2772896458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800ea00 con 0x7f6c880ffcc0 2023-09-13T09:45:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c80009d00 con 0x7f6c880ffcc0 2023-09-13T09:45:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c84ff9700 1 -- 172.21.15.6:0/2772896458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c78011040 con 0x7f6c880ffcc0 2023-09-13T09:45:07.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c84ff9700 1 -- 172.21.15.6:0/2772896458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780153e0 con 0x7f6c880ffcc0 2023-09-13T09:45:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.896+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8819cdf0 con 0x7f6c880ffcc0 2023-09-13T09:45:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.898+0000 7f6c84ff9700 1 -- 172.21.15.6:0/2772896458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6c7800ecd0 con 0x7f6c880ffcc0 2023-09-13T09:45:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.899+0000 7f6c84ff9700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c700a0640 0x7f6c700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.899+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c700a0640 0x7f6c700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.899+0000 7f6c84ff9700 1 -- 172.21.15.6:0/2772896458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c780cdf70 con 0x7f6c880ffcc0 2023-09-13T09:45:07.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.899+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c700a0640 0x7f6c700a2b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009c60 tx=0x7f6c7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 Processor -- start 2023-09-13T09:45:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 -- start start 2023-09-13T09:45:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf754bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754c470 0x55abf754a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf754b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf749f780 con 0x55abf754ae10 2023-09-13T09:45:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf749d0a0 con 0x55abf754c470 2023-09-13T09:45:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf7498990 con 0x55abf754bb10 2023-09-13T09:45:07.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c86ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754c470 0x55abf754a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf754b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf754bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c86ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754c470 0x55abf754a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59098/0 (socket says 172.21.15.6:59098) 2023-09-13T09:45:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.900+0000 7f6c86ffd700 1 -- 172.21.15.6:0/211732194 learned_addr learned my addr 172.21.15.6:0/211732194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c877fe700 1 -- 172.21.15.6:0/211732194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754c470 msgr2=0x55abf754a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c877fe700 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754c470 0x55abf754a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c877fe700 1 -- 172.21.15.6:0/211732194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 msgr2=0x55abf754b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c877fe700 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf754b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c877fe700 1 -- 172.21.15.6:0/211732194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abf7318630 con 0x55abf754bb10 2023-09-13T09:45:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754c470 0x55abf754a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:07.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c87fff700 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf754b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c877fe700 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf754bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c780cba70 tx=0x7f6c7809b070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ebaefdcaac7de78 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c6dffb700 1 -- 172.21.15.6:0/211732194 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7809b710 con 0x55abf754bb10 2023-09-13T09:45:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c6dffb700 1 -- 172.21.15.6:0/211732194 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c7809f540 con 0x55abf754bb10 2023-09-13T09:45:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.901+0000 7f6c6dffb700 1 -- 172.21.15.6:0/211732194 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7809b970 con 0x55abf754bb10 2023-09-13T09:45:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 -- 172.21.15.6:0/211732194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 msgr2=0x55abf754bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf754bf30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6c780cba70 tx=0x7f6c7809b070 comp rx=0 tx=0).stop 2023-09-13T09:45:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 -- 172.21.15.6:0/211732194 shutdown_connections 2023-09-13T09:45:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf754b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf754bf30 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/211732194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754c470 0x55abf754a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 -- 172.21.15.6:0/211732194 >> 172.21.15.6:0/211732194 conn(0x55abf74a4c80 msgr2=0x55abf7540f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 -- 172.21.15.6:0/211732194 shutdown_connections 2023-09-13T09:45:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 -- 172.21.15.6:0/211732194 wait complete. 2023-09-13T09:45:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.902+0000 7f6c99e47b80 1 -- start start 2023-09-13T09:45:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 1 Processor -- start 2023-09-13T09:45:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf7554340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf7554880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf755b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf7436bb0 con 0x55abf754c470 2023-09-13T09:45:07.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf74368b0 con 0x55abf754ae10 2023-09-13T09:45:07.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf731a920 con 0x55abf754bb10 2023-09-13T09:45:07.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c99e47b80 10 client.0 _ll_register_callbacks cb 0x55abf7434680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf7554340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf755b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf7554340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59102/0 (socket says 172.21.15.6:59102) 2023-09-13T09:45:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf755b8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37350/0 (socket says 172.21.15.6:37350) 2023-09-13T09:45:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c877fe700 1 -- 172.21.15.6:0/237035091 learned_addr learned my addr 172.21.15.6:0/237035091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf7554880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 -- 172.21.15.6:0/237035091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 msgr2=0x55abf7554880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf7554880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 -- 172.21.15.6:0/237035091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 msgr2=0x55abf7554340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf7554340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 -- 172.21.15.6:0/237035091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c8819cdf0 con 0x55abf754c470 2023-09-13T09:45:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c87fff700 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf755b8c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b770 tx=0x7f6c80008f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cdf13b1bfb4f35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.903+0000 7f6c66ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:07.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c66ffd700 1 -- 172.21.15.6:0/237035091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8000e040 con 0x55abf754c470 2023-09-13T09:45:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c66ffd700 1 -- 172.21.15.6:0/237035091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c8000baa0 con 0x55abf754c470 2023-09-13T09:45:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abf7539670 con 0x55abf754c470 2023-09-13T09:45:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c66ffd700 1 -- 172.21.15.6:0/237035091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c8000bca0 con 0x55abf754c470 2023-09-13T09:45:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 10 client.16899 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:07.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55abf74b07a0 con 0x55abf754c470 2023-09-13T09:45:07.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c66ffd700 1 -- 172.21.15.6:0/237035091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55abf7539670 con 0x55abf754c470 2023-09-13T09:45:07.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c66ffd700 1 -- 172.21.15.6:0/237035091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c8000b100 con 0x55abf754c470 2023-09-13T09:45:07.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 10 client.16899 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:07.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 10 client.16899 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:45:07.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 20 client.16899 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75601e0 0x55abf7562600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 4 client.16899 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.904+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abf7491970 con 0x55abf75601e0 2023-09-13T09:45:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.905+0000 7f6c877fe700 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75601e0 0x55abf7562600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.905+0000 7f6c66ffd700 10 client.16899 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:07.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.905+0000 7f6c877fe700 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75601e0 0x55abf7562600 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9c57e8462d4ab7a server_cookie=6db72d7e733c9ada in_seq=0 out_seq=0 2023-09-13T09:45:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c66ffd700 1 -- 172.21.15.6:0/237035091 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55abf7491970 con 0x55abf75601e0 2023-09-13T09:45:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c66ffd700 10 client.16899 handle_command_reply: tid=0 2023-09-13T09:45:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 client.16899 shutdown 2023-09-13T09:45:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 msgr2=0x55abf755b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf755b8c0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f6c8000b770 tx=0x7f6c80008f80 comp rx=0 tx=0).stop 2023-09-13T09:45:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 shutdown_connections 2023-09-13T09:45:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75601e0 0x55abf7562600 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf755b8c0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c66ffd700 0 client.16899 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:07.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf7554340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/237035091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf7554880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 >> 172.21.15.6:0/237035091 conn(0x55abf74a4c80 msgr2=0x55abf753b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 shutdown_connections 2023-09-13T09:45:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 1 -- 172.21.15.6:0/237035091 wait complete. 2023-09-13T09:45:07.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.906+0000 7f6c99e47b80 20 client.16899 trim_cache size 0 max 16384 2023-09-13T09:45:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 Processor -- start 2023-09-13T09:45:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 -- start start 2023-09-13T09:45:07.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf75625d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf755b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf7552f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf75429f0 con 0x55abf754c470 2023-09-13T09:45:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf7551ff0 con 0x55abf754ae10 2023-09-13T09:45:07.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf754f8e0 con 0x55abf754bb10 2023-09-13T09:45:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf7552f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf75625d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c86ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf755b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf75625d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59114/0 (socket says 172.21.15.6:59114) 2023-09-13T09:45:07.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf7552f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37356/0 (socket says 172.21.15.6:37356) 2023-09-13T09:45:07.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.920+0000 7f6c877fe700 1 -- 172.21.15.6:0/307242230 learned_addr learned my addr 172.21.15.6:0/307242230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c86ffd700 1 -- 172.21.15.6:0/307242230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 msgr2=0x55abf75625d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf75625d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c86ffd700 1 -- 172.21.15.6:0/307242230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 msgr2=0x55abf7552f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf7552f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c86ffd700 1 -- 172.21.15.6:0/307242230 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abf72c4de0 con 0x55abf754bb10 2023-09-13T09:45:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c877fe700 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf75625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf755b880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009fd0 tx=0x7f6c7c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d765ca9b5a2376d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c6e7fc700 1 -- 172.21.15.6:0/307242230 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c022070 con 0x55abf754bb10 2023-09-13T09:45:07.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c6e7fc700 1 -- 172.21.15.6:0/307242230 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c7c023040 con 0x55abf754bb10 2023-09-13T09:45:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.921+0000 7f6c6e7fc700 1 -- 172.21.15.6:0/307242230 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7c027660 con 0x55abf754bb10 2023-09-13T09:45:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 -- 172.21.15.6:0/307242230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 msgr2=0x55abf755b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf755b880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009fd0 tx=0x7f6c7c014000 comp rx=0 tx=0).stop 2023-09-13T09:45:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 -- 172.21.15.6:0/307242230 shutdown_connections 2023-09-13T09:45:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754c470 0x55abf7552f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754ae10 0x55abf75625d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/307242230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754bb10 0x55abf755b880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 -- 172.21.15.6:0/307242230 >> 172.21.15.6:0/307242230 conn(0x55abf74a4c80 msgr2=0x55abf7540e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 -- 172.21.15.6:0/307242230 shutdown_connections 2023-09-13T09:45:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 -- 172.21.15.6:0/307242230 wait complete. 2023-09-13T09:45:07.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 -- start start 2023-09-13T09:45:07.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.922+0000 7f6c99e47b80 1 Processor -- start 2023-09-13T09:45:07.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf7557550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754bb10 0x55abf7557a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754c470 0x55abf755aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf755aff0 con 0x55abf754ae10 2023-09-13T09:45:07.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf755b160 con 0x55abf754bb10 2023-09-13T09:45:07.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abf755b320 con 0x55abf754c470 2023-09-13T09:45:07.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 10 client.0 _ll_register_callbacks cb 0x55abf7434680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:07.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf7557550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf7557550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37360/0 (socket says 172.21.15.6:37360) 2023-09-13T09:45:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 -- 172.21.15.6:0/935154365 learned_addr learned my addr 172.21.15.6:0/935154365 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754bb10 0x55abf7557a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c87fff700 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754c470 0x55abf755aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 -- 172.21.15.6:0/935154365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754c470 msgr2=0x55abf755aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754c470 0x55abf755aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 -- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754bb10 msgr2=0x55abf7557a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754bb10 0x55abf7557a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 -- 172.21.15.6:0/935154365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abf7318630 con 0x55abf754ae10 2023-09-13T09:45:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c877fe700 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf7557550 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800e3a0 tx=0x7f6c7809bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e88f6af79d3552ba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:07.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c66ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c66ffd700 1 -- 172.21.15.6:0/935154365 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c780b9040 con 0x55abf754ae10 2023-09-13T09:45:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c66ffd700 1 -- 172.21.15.6:0/935154365 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c78099ab0 con 0x55abf754ae10 2023-09-13T09:45:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.923+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c7809f540 con 0x55abf754ae10 2023-09-13T09:45:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c66ffd700 1 -- 172.21.15.6:0/935154365 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c7809b790 con 0x55abf754ae10 2023-09-13T09:45:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 10 client.16905 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:07.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f6c7c0041a0 con 0x55abf754ae10 2023-09-13T09:45:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c66ffd700 1 -- 172.21.15.6:0/935154365 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c7809f540 con 0x55abf754ae10 2023-09-13T09:45:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c66ffd700 1 -- 172.21.15.6:0/935154365 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c7809ad20 con 0x55abf754ae10 2023-09-13T09:45:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 10 client.16905 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 10 client.16905 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:45:07.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 20 client.16905 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75b4cd0 0x55abf75b70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 4 client.16905 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55abf7452050 con 0x55abf75b4cd0 2023-09-13T09:45:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.924+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75b4cd0 0x55abf75b70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c66ffd700 10 client.16905 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:07.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c86ffd700 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75b4cd0 0x55abf75b70f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b54e9b6fa25ea3d server_cookie=ccf6107f29952470 in_seq=0 out_seq=0 2023-09-13T09:45:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c66ffd700 1 -- 172.21.15.6:0/935154365 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55abf7452050 con 0x55abf75b4cd0 2023-09-13T09:45:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c66ffd700 10 client.16905 handle_command_reply: tid=0 2023-09-13T09:45:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 client.16905 shutdown 2023-09-13T09:45:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 msgr2=0x55abf7557550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf7557550 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f6c7800e3a0 tx=0x7f6c7809bf50 comp rx=0 tx=0).stop 2023-09-13T09:45:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 shutdown_connections 2023-09-13T09:45:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abf75b4cd0 0x55abf75b70f0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abf754c470 0x55abf755aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abf754ae10 0x55abf7557550 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 --2- 172.21.15.6:0/935154365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abf754bb10 0x55abf7557a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c66ffd700 0 client.16905 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 >> 172.21.15.6:0/935154365 conn(0x55abf74a4c80 msgr2=0x55abf7552f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 shutdown_connections 2023-09-13T09:45:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 1 -- 172.21.15.6:0/935154365 wait complete. 2023-09-13T09:45:07.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.925+0000 7f6c99e47b80 20 client.16905 trim_cache size 0 max 16384 2023-09-13T09:45:07.953 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:07.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c700a0640 msgr2=0x7f6c700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c700a0640 0x7f6c700a2b00 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f6c7c009c60 tx=0x7f6c7c009260 comp rx=0 tx=0).stop 2023-09-13T09:45:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c880ffcc0 msgr2=0x7f6c88194940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c880ffcc0 0x7f6c88194940 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f6c78010be0 tx=0x7f6c78010ef0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 shutdown_connections 2023-09-13T09:45:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c88101850 0x7f6c8819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c700a0640 0x7f6c700a2b00 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c880ffcc0 0x7f6c88194940 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 --2- 172.21.15.6:0/2772896458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c88100eb0 0x7f6c88194e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 >> 172.21.15.6:0/2772896458 conn(0x7f6c880fb250 msgr2=0x7f6c880fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 shutdown_connections 2023-09-13T09:45:07.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:07.926+0000 7f6c8dc62700 1 -- 172.21.15.6:0/2772896458 wait complete. 2023-09-13T09:45:07.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:45:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:07 smithi006 ceph-mon[98665]: pgmap v468: 97 pgs: 97 active+clean; 82 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 949 KiB/s wr, 85 op/s 2023-09-13T09:45:08.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:07 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3965705126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:45:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 -- 172.21.15.6:0/879669278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c740ffc90 msgr2=0x7f1c741000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 --2- 172.21.15.6:0/879669278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c740ffc90 0x7f1c741000b0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f1c700099c0 tx=0x7f1c70009cd0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 -- 172.21.15.6:0/879669278 shutdown_connections 2023-09-13T09:45:08.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 --2- 172.21.15.6:0/879669278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c74101820 0x7f1c741080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 --2- 172.21.15.6:0/879669278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c740ffc90 0x7f1c741000b0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 --2- 172.21.15.6:0/879669278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c74100e80 0x7f1c741012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 -- 172.21.15.6:0/879669278 >> 172.21.15.6:0/879669278 conn(0x7f1c740fb220 msgr2=0x7f1c740fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.096+0000 7f1c7c786700 1 -- 172.21.15.6:0/879669278 shutdown_connections 2023-09-13T09:45:08.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 -- 172.21.15.6:0/879669278 wait complete. 2023-09-13T09:45:08.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 Processor -- start 2023-09-13T09:45:08.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 -- start start 2023-09-13T09:45:08.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c740ffc90 0x7f1c74196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74100e80 0x7f1c74196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c74101820 0x7f1c7419e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7419e5f0 con 0x7f1c74100e80 2023-09-13T09:45:08.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7419e730 con 0x7f1c740ffc90 2023-09-13T09:45:08.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7c786700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c7419e8c0 con 0x7f1c74101820 2023-09-13T09:45:08.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c79d21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74100e80 0x7f1c74196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7a522700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c740ffc90 0x7f1c74196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c79d21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74100e80 0x7f1c74196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37376/0 (socket says 172.21.15.6:37376) 2023-09-13T09:45:08.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c79d21700 1 -- 172.21.15.6:0/3687340260 learned_addr learned my addr 172.21.15.6:0/3687340260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.097+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c74101820 0x7f1c7419e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c79d21700 1 -- 172.21.15.6:0/3687340260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c74101820 msgr2=0x7f1c7419e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c79d21700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c74101820 0x7f1c7419e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c79d21700 1 -- 172.21.15.6:0/3687340260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c740ffc90 msgr2=0x7f1c74196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c79d21700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c740ffc90 0x7f1c74196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c79d21700 1 -- 172.21.15.6:0/3687340260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c700095f0 con 0x7f1c74100e80 2023-09-13T09:45:08.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c7a522700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c740ffc90 0x7f1c74196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c79d21700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74100e80 0x7f1c74196fb0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e9a0 tx=0x7f1c6400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c6b7fe700 1 -- 172.21.15.6:0/3687340260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64009790 con 0x7f1c74100e80 2023-09-13T09:45:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c6b7fe700 1 -- 172.21.15.6:0/3687340260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c64010430 con 0x7f1c74100e80 2023-09-13T09:45:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c6b7fe700 1 -- 172.21.15.6:0/3687340260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64018680 con 0x7f1c74100e80 2023-09-13T09:45:08.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c7419eba0 con 0x7f1c74100e80 2023-09-13T09:45:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.098+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7419f0b0 con 0x7f1c74100e80 2023-09-13T09:45:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.100+0000 7f1c6b7fe700 1 -- 172.21.15.6:0/3687340260 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1c640105a0 con 0x7f1c74100e80 2023-09-13T09:45:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.101+0000 7f1c6b7fe700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1c600a06c0 0x7f1c600a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.101+0000 7f1c6b7fe700 1 -- 172.21.15.6:0/3687340260 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1c64014070 con 0x7f1c74100e80 2023-09-13T09:45:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.101+0000 7f1c7a522700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1c600a06c0 0x7f1c600a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.101+0000 7f1c7a522700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1c600a06c0 0x7f1c600a2b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009990 tx=0x7f1c7001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 Processor -- start 2023-09-13T09:45:08.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 -- start start 2023-09-13T09:45:08.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f59bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f59ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f4f3780 con 0x55837f59c060 2023-09-13T09:45:08.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f4f10a0 con 0x55837f59aa00 2023-09-13T09:45:08.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f4ec990 con 0x55837f59b700 2023-09-13T09:45:08.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c79d21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c79d21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37384/0 (socket says 172.21.15.6:37384) 2023-09-13T09:45:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c79d21700 1 -- 172.21.15.6:0/1667762112 learned_addr learned my addr 172.21.15.6:0/1667762112 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f59ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.102+0000 7f1c7a522700 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f59bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c79d21700 1 -- 172.21.15.6:0/1667762112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 msgr2=0x55837f59bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c79d21700 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f59bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c79d21700 1 -- 172.21.15.6:0/1667762112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 msgr2=0x55837f59ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c79d21700 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f59ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c79d21700 1 -- 172.21.15.6:0/1667762112 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55837f36c630 con 0x55837f59c060 2023-09-13T09:45:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c79d21700 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59a4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1c640959d0 tx=0x7f1c640993d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f43034c5448695 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c68ff9700 1 -- 172.21.15.6:0/1667762112 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6409d300 con 0x55837f59c060 2023-09-13T09:45:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c68ff9700 1 -- 172.21.15.6:0/1667762112 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c640a1540 con 0x55837f59c060 2023-09-13T09:45:08.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.103+0000 7f1c68ff9700 1 -- 172.21.15.6:0/1667762112 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c64099730 con 0x55837f59c060 2023-09-13T09:45:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 -- 172.21.15.6:0/1667762112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 msgr2=0x55837f59a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59a4c0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f1c640959d0 tx=0x7f1c640993d0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 -- 172.21.15.6:0/1667762112 shutdown_connections 2023-09-13T09:45:08.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f59ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f59bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/1667762112 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59a4c0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 -- 172.21.15.6:0/1667762112 >> 172.21.15.6:0/1667762112 conn(0x55837f4f8c80 msgr2=0x55837f594f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 -- 172.21.15.6:0/1667762112 shutdown_connections 2023-09-13T09:45:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 -- 172.21.15.6:0/1667762112 wait complete. 2023-09-13T09:45:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 -- start start 2023-09-13T09:45:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.104+0000 7f1c8896bb80 1 Processor -- start 2023-09-13T09:45:08.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a4420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5ab460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f48abb0 con 0x55837f59c060 2023-09-13T09:45:08.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f48a8b0 con 0x55837f59aa00 2023-09-13T09:45:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f36e920 con 0x55837f59b700 2023-09-13T09:45:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 10 client.0 _ll_register_callbacks cb 0x55837f488680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5ab460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7a522700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7a522700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a3ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59144/0 (socket says 172.21.15.6:59144) 2023-09-13T09:45:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5ab460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37392/0 (socket says 172.21.15.6:37392) 2023-09-13T09:45:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7a522700 1 -- 172.21.15.6:0/3159417562 learned_addr learned my addr 172.21.15.6:0/3159417562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c79d21700 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 -- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 msgr2=0x55837f5a4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 -- 172.21.15.6:0/3159417562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 msgr2=0x55837f5a3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 -- 172.21.15.6:0/3159417562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c7419f0b0 con 0x55837f59c060 2023-09-13T09:45:08.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7a522700 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5ab460 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c011e90 tx=0x7f1c6c014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e857a45a0299862 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c5dffb700 1 -- 172.21.15.6:0/3159417562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c00e040 con 0x55837f59c060 2023-09-13T09:45:08.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c5dffb700 1 -- 172.21.15.6:0/3159417562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1c6c004bb0 con 0x55837f59c060 2023-09-13T09:45:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.105+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55837f58d670 con 0x55837f59c060 2023-09-13T09:45:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c5dffb700 1 -- 172.21.15.6:0/3159417562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c6c004d70 con 0x55837f59c060 2023-09-13T09:45:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 10 client.16917 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55837f5047a0 con 0x55837f59c060 2023-09-13T09:45:08.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c5dffb700 1 -- 172.21.15.6:0/3159417562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55837f58d670 con 0x55837f59c060 2023-09-13T09:45:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c5dffb700 1 -- 172.21.15.6:0/3159417562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1c6c01c030 con 0x55837f59c060 2023-09-13T09:45:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 10 client.16917 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 10 client.16917 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:45:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 20 client.16917 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:08.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f5afdc0 0x55837f5b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 4 client.16917 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55837f4e5970 con 0x55837f5afdc0 2023-09-13T09:45:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.106+0000 7f1c7a522700 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f5afdc0 0x55837f5b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c5dffb700 10 client.16917 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:08.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c7a522700 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f5afdc0 0x55837f5b21e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9ddf2fd8d8024d35 server_cookie=a443089f48cc90a4 in_seq=0 out_seq=0 2023-09-13T09:45:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c5dffb700 1 -- 172.21.15.6:0/3159417562 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55837f4e5970 con 0x55837f5afdc0 2023-09-13T09:45:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c5dffb700 10 client.16917 handle_command_reply: tid=0 2023-09-13T09:45:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 client.16917 shutdown 2023-09-13T09:45:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 msgr2=0x55837f5ab460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5ab460 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c011e90 tx=0x7f1c6c014600 comp rx=0 tx=0).stop 2023-09-13T09:45:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 shutdown_connections 2023-09-13T09:45:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f5afdc0 0x55837f5b21e0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5ab460 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3159417562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.107+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 >> 172.21.15.6:0/3159417562 conn(0x55837f4f8c80 msgr2=0x55837f58f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.108+0000 7f1c5dffb700 0 client.16917 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.108+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 shutdown_connections 2023-09-13T09:45:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.108+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3159417562 wait complete. 2023-09-13T09:45:08.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.108+0000 7f1c8896bb80 20 client.16917 trim_cache size 0 max 16384 2023-09-13T09:45:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 Processor -- start 2023-09-13T09:45:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 -- start start 2023-09-13T09:45:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59aa00 0x55837f59a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59b700 0x55837f5ab380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f595cf0 con 0x55837f59c060 2023-09-13T09:45:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f5ab8c0 con 0x55837f59b700 2023-09-13T09:45:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f58d400 con 0x55837f59aa00 2023-09-13T09:45:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.121+0000 7f1c7ad23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c79d21700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59b700 0x55837f5ab380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7a522700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59aa00 0x55837f59a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37400/0 (socket says 172.21.15.6:37400) 2023-09-13T09:45:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7a522700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59aa00 0x55837f59a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40450/0 (socket says 172.21.15.6:40450) 2023-09-13T09:45:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 -- 172.21.15.6:0/3455000994 learned_addr learned my addr 172.21.15.6:0/3455000994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c79d21700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59b700 0x55837f5ab380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59154/0 (socket says 172.21.15.6:59154) 2023-09-13T09:45:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 -- 172.21.15.6:0/3455000994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59aa00 msgr2=0x55837f59a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59aa00 0x55837f59a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 -- 172.21.15.6:0/3455000994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59b700 msgr2=0x55837f5ab380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59b700 0x55837f5ab380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 -- 172.21.15.6:0/3455000994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55837f59b0b0 con 0x55837f59c060 2023-09-13T09:45:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7a522700 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59aa00 0x55837f59a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c79d21700 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59b700 0x55837f5ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59e9c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b010 tx=0x7f1c6c0093e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd8d05aa94dec45 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c697fa700 1 -- 172.21.15.6:0/3455000994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c00e070 con 0x55837f59c060 2023-09-13T09:45:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c697fa700 1 -- 172.21.15.6:0/3455000994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c6c023030 con 0x55837f59c060 2023-09-13T09:45:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.122+0000 7f1c697fa700 1 -- 172.21.15.6:0/3455000994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c004830 con 0x55837f59c060 2023-09-13T09:45:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3455000994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 msgr2=0x55837f59e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59e9c0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c00b010 tx=0x7f1c6c0093e0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3455000994 shutdown_connections 2023-09-13T09:45:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f59e9c0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59aa00 0x55837f59a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/3455000994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59b700 0x55837f5ab380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3455000994 >> 172.21.15.6:0/3455000994 conn(0x55837f4f8c80 msgr2=0x55837f5b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3455000994 shutdown_connections 2023-09-13T09:45:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 -- 172.21.15.6:0/3455000994 wait complete. 2023-09-13T09:45:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 -- start start 2023-09-13T09:45:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.123+0000 7f1c8896bb80 1 Processor -- start 2023-09-13T09:45:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5a9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f5a9ff0 con 0x55837f59c060 2023-09-13T09:45:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f5aa160 con 0x55837f59aa00 2023-09-13T09:45:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55837f5aa320 con 0x55837f59b700 2023-09-13T09:45:08.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 10 client.0 _ll_register_callbacks cb 0x55837f488680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5a9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7a522700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5a9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37406/0 (socket says 172.21.15.6:37406) 2023-09-13T09:45:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c79d21700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7a522700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59158/0 (socket says 172.21.15.6:59158) 2023-09-13T09:45:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 -- 172.21.15.6:0/4174432307 learned_addr learned my addr 172.21.15.6:0/4174432307 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 -- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 msgr2=0x55837f5a10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 -- 172.21.15.6:0/4174432307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 msgr2=0x55837f5a0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 -- 172.21.15.6:0/4174432307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55837f36c630 con 0x55837f59c060 2023-09-13T09:45:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7a522700 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c79d21700 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c7ad23700 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5a9ab0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c004360 tx=0x7f1c6c003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3efd21d9bdb90f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c5dffb700 1 -- 172.21.15.6:0/4174432307 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c6c00e040 con 0x55837f59c060 2023-09-13T09:45:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c5dffb700 1 -- 172.21.15.6:0/4174432307 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1c6c02c070 con 0x55837f59c060 2023-09-13T09:45:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.124+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c640a1540 con 0x55837f59c060 2023-09-13T09:45:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c5dffb700 1 -- 172.21.15.6:0/4174432307 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c6c0045d0 con 0x55837f59c060 2023-09-13T09:45:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 10 client.16923 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:08.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55837f5047a0 con 0x55837f59c060 2023-09-13T09:45:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c5dffb700 1 -- 172.21.15.6:0/4174432307 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c6c040020 con 0x55837f59c060 2023-09-13T09:45:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c5dffb700 1 -- 172.21.15.6:0/4174432307 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1c6c014320 con 0x55837f59c060 2023-09-13T09:45:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 10 client.16923 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 10 client.16923 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:45:08.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 20 client.16923 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f603c30 0x55837f606050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 4 client.16923 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55837f4a6050 con 0x55837f603c30 2023-09-13T09:45:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.125+0000 7f1c7a522700 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f603c30 0x55837f606050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.126+0000 7f1c5dffb700 10 client.16923 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.126+0000 7f1c7a522700 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f603c30 0x55837f606050 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=37be665c8b6ba8b7 server_cookie=4f42d24a9aee40ef in_seq=0 out_seq=0 2023-09-13T09:45:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c5dffb700 1 -- 172.21.15.6:0/4174432307 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55837f4a6050 con 0x55837f603c30 2023-09-13T09:45:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c5dffb700 10 client.16923 handle_command_reply: tid=0 2023-09-13T09:45:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 client.16923 shutdown 2023-09-13T09:45:08.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 msgr2=0x55837f5a9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5a9ab0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f1c6c004360 tx=0x7f1c6c003c30 comp rx=0 tx=0).stop 2023-09-13T09:45:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 shutdown_connections 2023-09-13T09:45:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55837f603c30 0x55837f606050 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55837f59c060 0x55837f5a9ab0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c5dffb700 0 client.16923 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:08.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55837f59aa00 0x55837f5a0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 --2- 172.21.15.6:0/4174432307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55837f59b700 0x55837f5a10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 >> 172.21.15.6:0/4174432307 conn(0x55837f4f8c80 msgr2=0x55837f59e9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 shutdown_connections 2023-09-13T09:45:08.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 1 -- 172.21.15.6:0/4174432307 wait complete. 2023-09-13T09:45:08.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.127+0000 7f1c8896bb80 20 client.16923 trim_cache size 0 max 16384 2023-09-13T09:45:08.159 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1c600a06c0 msgr2=0x7f1c600a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1c600a06c0 0x7f1c600a2b80 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f1c70009990 tx=0x7f1c7001a040 comp rx=0 tx=0).stop 2023-09-13T09:45:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74100e80 msgr2=0x7f1c74196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74100e80 0x7f1c74196fb0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f1c6400e9a0 tx=0x7f1c6400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 shutdown_connections 2023-09-13T09:45:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c74101820 0x7f1c7419e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c740ffc90 0x7f1c74196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1c600a06c0 0x7f1c600a2b80 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 --2- 172.21.15.6:0/3687340260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c74100e80 0x7f1c74196fb0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 >> 172.21.15.6:0/3687340260 conn(0x7f1c740fb220 msgr2=0x7f1c74069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 shutdown_connections 2023-09-13T09:45:08.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.128+0000 7f1c7c786700 1 -- 172.21.15.6:0/3687340260 wait complete. 2023-09-13T09:45:08.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:45:08.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 173173 2.92 MB/sec execute 148 sec latency 48.573 ms 2023-09-13T09:45:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:07 smithi053 ceph-mon[102373]: pgmap v468: 97 pgs: 97 active+clean; 82 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 949 KiB/s wr, 85 op/s 2023-09-13T09:45:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:07 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3965705126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:45:08.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:07 smithi131 ceph-mon[102785]: pgmap v468: 97 pgs: 97 active+clean; 82 MiB data, 993 MiB used, 1.0 TiB / 1.0 TiB avail; 293 KiB/s rd, 949 KiB/s wr, 85 op/s 2023-09-13T09:45:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:07 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3965705126' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:45:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- 172.21.15.6:0/3705933995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c100dc0 msgr2=0x7f8f4c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 --2- 172.21.15.6:0/3705933995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c100dc0 0x7f8f4c1011e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f8f480099c0 tx=0x7f8f48009cd0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- 172.21.15.6:0/3705933995 shutdown_connections 2023-09-13T09:45:08.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 --2- 172.21.15.6:0/3705933995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 0x7f8f4c109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 --2- 172.21.15.6:0/3705933995 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c100dc0 0x7f8f4c1011e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 --2- 172.21.15.6:0/3705933995 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f4c101fb0 0x7f8f4c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- 172.21.15.6:0/3705933995 >> 172.21.15.6:0/3705933995 conn(0x7f8f4c0fc330 msgr2=0x7f8f4c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- 172.21.15.6:0/3705933995 shutdown_connections 2023-09-13T09:45:08.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- 172.21.15.6:0/3705933995 wait complete. 2023-09-13T09:45:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 Processor -- start 2023-09-13T09:45:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- start start 2023-09-13T09:45:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f4c100dc0 0x7f8f4c196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c101fb0 0x7f8f4c196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 0x7f8f4c19e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c19e610 con 0x7f8f4c102950 2023-09-13T09:45:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.294+0000 7f8f539d2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c19e750 con 0x7f8f4c101fb0 2023-09-13T09:45:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f539d2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4c19e8e0 con 0x7f8f4c100dc0 2023-09-13T09:45:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 0x7f8f4c19e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f5176e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f4c100dc0 0x7f8f4c196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 0x7f8f4c19e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37420/0 (socket says 172.21.15.6:37420) 2023-09-13T09:45:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f50f6d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c101fb0 0x7f8f4c196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 -- 172.21.15.6:0/2798343784 learned_addr learned my addr 172.21.15.6:0/2798343784 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 -- 172.21.15.6:0/2798343784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f4c100dc0 msgr2=0x7f8f4c196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f4c100dc0 0x7f8f4c196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 -- 172.21.15.6:0/2798343784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c101fb0 msgr2=0x7f8f4c196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c101fb0 0x7f8f4c196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 -- 172.21.15.6:0/2798343784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480095f0 con 0x7f8f4c102950 2023-09-13T09:45:08.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c101fb0 0x7f8f4c196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 0x7f8f4c19e040 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ef30 tx=0x7f8f4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f427fc700 1 -- 172.21.15.6:0/2798343784 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44018070 con 0x7f8f4c102950 2023-09-13T09:45:08.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f4c19eb60 con 0x7f8f4c102950 2023-09-13T09:45:08.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f427fc700 1 -- 172.21.15.6:0/2798343784 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4400f040 con 0x7f8f4c102950 2023-09-13T09:45:08.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f427fc700 1 -- 172.21.15.6:0/2798343784 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400cd00 con 0x7f8f4c102950 2023-09-13T09:45:08.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.295+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c19f020 con 0x7f8f4c102950 2023-09-13T09:45:08.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.298+0000 7f8f427fc700 1 -- 172.21.15.6:0/2798343784 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8f44003a00 con 0x7f8f4c102950 2023-09-13T09:45:08.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.298+0000 7f8f427fc700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f380a0640 0x7f8f380a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.298+0000 7f8f427fc700 1 -- 172.21.15.6:0/2798343784 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f440cb740 con 0x7f8f4c102950 2023-09-13T09:45:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.298+0000 7f8f5176e700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f380a0640 0x7f8f380a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5176e700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f380a0640 0x7f8f380a2b00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009990 tx=0x7f8f48005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 Processor -- start 2023-09-13T09:45:08.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 -- start start 2023-09-13T09:45:08.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9a4bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4c060 0x5627d9a4a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d99a3780 con 0x5627d9a4c060 2023-09-13T09:45:08.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d99a10a0 con 0x5627d9a4aa00 2023-09-13T09:45:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d999c990 con 0x5627d9a4b700 2023-09-13T09:45:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f50f6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4c060 0x5627d9a4a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5176e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9a4bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f51f6f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5176e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9a4bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40478/0 (socket says 172.21.15.6:40478) 2023-09-13T09:45:08.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f5176e700 1 -- 172.21.15.6:0/1109236013 learned_addr learned my addr 172.21.15.6:0/1109236013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.299+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4c060 0x5627d9a4a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37426/0 (socket says 172.21.15.6:37426) 2023-09-13T09:45:08.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f51f6f700 1 -- 172.21.15.6:0/1109236013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 msgr2=0x5627d9a4bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9a4bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f51f6f700 1 -- 172.21.15.6:0/1109236013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4c060 msgr2=0x5627d9a4a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4c060 0x5627d9a4a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f51f6f700 1 -- 172.21.15.6:0/1109236013 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d981c630 con 0x5627d9a4aa00 2023-09-13T09:45:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4ae80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ef00 tx=0x7f8f44098e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60e6ecc42dea684c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f377fe700 1 -- 172.21.15.6:0/1109236013 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f440b8030 con 0x5627d9a4aa00 2023-09-13T09:45:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f377fe700 1 -- 172.21.15.6:0/1109236013 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4401b320 con 0x5627d9a4aa00 2023-09-13T09:45:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.300+0000 7f8f377fe700 1 -- 172.21.15.6:0/1109236013 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f440991d0 con 0x5627d9a4aa00 2023-09-13T09:45:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1109236013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 msgr2=0x5627d9a4ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4ae80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ef00 tx=0x7f8f44098e70 comp rx=0 tx=0).stop 2023-09-13T09:45:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1109236013 shutdown_connections 2023-09-13T09:45:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4ae80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9a4bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1109236013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4c060 0x5627d9a4a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1109236013 >> 172.21.15.6:0/1109236013 conn(0x5627d99a8c80 msgr2=0x5627d9a44f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1109236013 shutdown_connections 2023-09-13T09:45:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1109236013 wait complete. 2023-09-13T09:45:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 -- start start 2023-09-13T09:45:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.301+0000 7f8f5fbb7b80 1 Processor -- start 2023-09-13T09:45:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a53ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a54420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a5b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d993abb0 con 0x5627d9a4b700 2023-09-13T09:45:08.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d993a8b0 con 0x5627d9a4aa00 2023-09-13T09:45:08.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d981e920 con 0x5627d9a4c060 2023-09-13T09:45:08.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5fbb7b80 10 client.0 _ll_register_callbacks cb 0x5627d9938680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:08.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a54420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5176e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a53ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a54420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37432/0 (socket says 172.21.15.6:37432) 2023-09-13T09:45:08.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 -- 172.21.15.6:0/1035062267 learned_addr learned my addr 172.21.15.6:0/1035062267 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a5b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 -- 172.21.15.6:0/1035062267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 msgr2=0x5627d9a5b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a5b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 -- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 msgr2=0x5627d9a53ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a53ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 -- 172.21.15.6:0/1035062267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f4c19f020 con 0x5627d9a4b700 2023-09-13T09:45:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f5176e700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a53ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a5b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a54420 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c012d20 tx=0x7f8f3c00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431948c95591c11 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1035062267 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3c017070 con 0x5627d9a4b700 2023-09-13T09:45:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627d9a3d670 con 0x5627d9a4b700 2023-09-13T09:45:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.302+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1035062267 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f3c00fc30 con 0x5627d9a4b700 2023-09-13T09:45:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1035062267 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f3c0122e0 con 0x5627d9a4b700 2023-09-13T09:45:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 10 client.16935 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5627d99b47a0 con 0x5627d9a4b700 2023-09-13T09:45:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1035062267 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5627d9a3d670 con 0x5627d9a4b700 2023-09-13T09:45:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1035062267 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f3c010430 con 0x5627d9a4b700 2023-09-13T09:45:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 10 client.16935 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 10 client.16935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 20 client.16935 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9a5fdb0 0x5627d9a621d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 4 client.16935 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627d9995970 con 0x5627d9a5fdb0 2023-09-13T09:45:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.303+0000 7f8f5176e700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9a5fdb0 0x5627d9a621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.304+0000 7f8f34ff9700 10 client.16935 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.304+0000 7f8f5176e700 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9a5fdb0 0x5627d9a621d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6805e82a17844d16 server_cookie=6444024ec8d88548 in_seq=0 out_seq=0 2023-09-13T09:45:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.304+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1035062267 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5627d9995970 con 0x5627d9a5fdb0 2023-09-13T09:45:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.304+0000 7f8f34ff9700 10 client.16935 handle_command_reply: tid=0 2023-09-13T09:45:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 client.16935 shutdown 2023-09-13T09:45:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 msgr2=0x5627d9a54420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a54420 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8f3c012d20 tx=0x7f8f3c00f6a0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 shutdown_connections 2023-09-13T09:45:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a5b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a53ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9a5fdb0 0x5627d9a621d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1035062267 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a54420 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f34ff9700 0 client.16935 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 >> 172.21.15.6:0/1035062267 conn(0x5627d99a8c80 msgr2=0x5627d9a3f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 shutdown_connections 2023-09-13T09:45:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1035062267 wait complete. 2023-09-13T09:45:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.305+0000 7f8f5fbb7b80 20 client.16935 trim_cache size 0 max 16384 2023-09-13T09:45:08.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 Processor -- start 2023-09-13T09:45:08.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 -- start start 2023-09-13T09:45:08.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a53ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a54420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d9a53a80 con 0x5627d9a4b700 2023-09-13T09:45:08.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d9a45810 con 0x5627d9a4aa00 2023-09-13T09:45:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d9a54b90 con 0x5627d9a4c060 2023-09-13T09:45:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f50f6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a53ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.318+0000 7f8f5176e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f50f6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a53ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37440/0 (socket says 172.21.15.6:37440) 2023-09-13T09:45:08.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f50f6d700 1 -- 172.21.15.6:0/889867141 learned_addr learned my addr 172.21.15.6:0/889867141 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a54420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f5176e700 1 -- 172.21.15.6:0/889867141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 msgr2=0x5627d9a54420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f5176e700 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a54420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f5176e700 1 -- 172.21.15.6:0/889867141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 msgr2=0x5627d9a53ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f5176e700 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a53ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f5176e700 1 -- 172.21.15.6:0/889867141 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627d97c8de0 con 0x5627d9a4aa00 2023-09-13T09:45:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a53ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f5176e700 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4a4c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f480095c0 tx=0x7f8f48021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322524a0007b2cfc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f37fff700 1 -- 172.21.15.6:0/889867141 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48029040 con 0x5627d9a4aa00 2023-09-13T09:45:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f37fff700 1 -- 172.21.15.6:0/889867141 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4802a040 con 0x5627d9a4aa00 2023-09-13T09:45:08.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.319+0000 7f8f37fff700 1 -- 172.21.15.6:0/889867141 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4800f460 con 0x5627d9a4aa00 2023-09-13T09:45:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/889867141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 msgr2=0x5627d9a4a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4a4c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f8f480095c0 tx=0x7f8f48021000 comp rx=0 tx=0).stop 2023-09-13T09:45:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/889867141 shutdown_connections 2023-09-13T09:45:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4c060 0x5627d9a54420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4aa00 0x5627d9a4a4c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/889867141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4b700 0x5627d9a53ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/889867141 >> 172.21.15.6:0/889867141 conn(0x5627d99a8c80 msgr2=0x5627d9a52b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/889867141 shutdown_connections 2023-09-13T09:45:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/889867141 wait complete. 2023-09-13T09:45:08.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 -- start start 2023-09-13T09:45:08.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.320+0000 7f8f5fbb7b80 1 Processor -- start 2023-09-13T09:45:08.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4aa00 0x5627d9aafe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9ab0360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4c060 0x5627d9ab6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d9ab73a0 con 0x5627d9a4aa00 2023-09-13T09:45:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d9ab74e0 con 0x5627d9a4c060 2023-09-13T09:45:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627d9ab76a0 con 0x5627d9a4b700 2023-09-13T09:45:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 10 client.0 _ll_register_callbacks cb 0x5627d9938680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4aa00 0x5627d9aafe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4aa00 0x5627d9aafe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37444/0 (socket says 172.21.15.6:37444) 2023-09-13T09:45:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 -- 172.21.15.6:0/1719951227 learned_addr learned my addr 172.21.15.6:0/1719951227 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4c060 0x5627d9ab6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9ab0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 -- 172.21.15.6:0/1719951227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 msgr2=0x5627d9ab0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9ab0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 -- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4c060 msgr2=0x5627d9ab6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4c060 0x5627d9ab6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 -- 172.21.15.6:0/1719951227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5627d99b47a0 con 0x5627d9a4aa00 2023-09-13T09:45:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f51f6f700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4c060 0x5627d9ab6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:08.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5176e700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4aa00 0x5627d9aafe20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005040 tx=0x7f8f48009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f6873a0e782501 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f34ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1719951227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f48029040 con 0x5627d9a4aa00 2023-09-13T09:45:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1719951227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8f48003e00 con 0x5627d9a4aa00 2023-09-13T09:45:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.321+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8f4401b320 con 0x5627d9a4aa00 2023-09-13T09:45:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1719951227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f480335a0 con 0x5627d9a4aa00 2023-09-13T09:45:08.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 10 client.16941 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f8f4c109b50 con 0x5627d9a4aa00 2023-09-13T09:45:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1719951227 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8f4804f080 con 0x5627d9a4aa00 2023-09-13T09:45:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1719951227 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8f4800f460 con 0x5627d9a4aa00 2023-09-13T09:45:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 10 client.16941 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:08.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 10 client.16941 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 20 client.16941 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9ab8c30 0x5627d9abb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 4 client.16941 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5627d9956050 con 0x5627d9ab8c30 2023-09-13T09:45:08.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.322+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9ab8c30 0x5627d9abb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f34ff9700 10 client.16941 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f50f6d700 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9ab8c30 0x5627d9abb050 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=644442bf69e4b74d server_cookie=42de450491928bfd in_seq=0 out_seq=0 2023-09-13T09:45:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f34ff9700 1 -- 172.21.15.6:0/1719951227 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5627d9956050 con 0x5627d9ab8c30 2023-09-13T09:45:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f34ff9700 10 client.16941 handle_command_reply: tid=0 2023-09-13T09:45:08.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 client.16941 shutdown 2023-09-13T09:45:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4aa00 msgr2=0x5627d9aafe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4aa00 0x5627d9aafe20 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f8f48005040 tx=0x7f8f48009fd0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 shutdown_connections 2023-09-13T09:45:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5627d9a4c060 0x5627d9ab6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5627d9ab8c30 0x5627d9abb050 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5627d9a4aa00 0x5627d9aafe20 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 --2- 172.21.15.6:0/1719951227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5627d9a4b700 0x5627d9ab0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f34ff9700 0 client.16941 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:08.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 >> 172.21.15.6:0/1719951227 conn(0x5627d99a8c80 msgr2=0x5627d9a4e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 shutdown_connections 2023-09-13T09:45:08.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 1 -- 172.21.15.6:0/1719951227 wait complete. 2023-09-13T09:45:08.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.323+0000 7f8f5fbb7b80 20 client.16941 trim_cache size 0 max 16384 2023-09-13T09:45:08.354 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f380a0640 msgr2=0x7f8f380a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f380a0640 0x7f8f380a2b00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8f48009990 tx=0x7f8f48005fb0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 msgr2=0x7f8f4c19e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:08.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 0x7f8f4c19e040 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ef30 tx=0x7f8f4400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 shutdown_connections 2023-09-13T09:45:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8f380a0640 0x7f8f380a2b00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f4c102950 0x7f8f4c19e040 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f4c100dc0 0x7f8f4c196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 --2- 172.21.15.6:0/2798343784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8f4c101fb0 0x7f8f4c196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 >> 172.21.15.6:0/2798343784 conn(0x7f8f4c0fc330 msgr2=0x7f8f4c0fe570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 shutdown_connections 2023-09-13T09:45:08.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:08.324+0000 7f8f539d2700 1 -- 172.21.15.6:0/2798343784 wait complete. 2023-09-13T09:45:09.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 174291 2.95 MB/sec execute 149 sec latency 13.973 ms 2023-09-13T09:45:09.359 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:45:09.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:45:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 -- 172.21.15.6:0/3270154846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 msgr2=0x7f9b540ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 --2- 172.21.15.6:0/3270154846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b540ff860 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400aad0 tx=0x7f9b4400ade0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 -- 172.21.15.6:0/3270154846 shutdown_connections 2023-09-13T09:45:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 --2- 172.21.15.6:0/3270154846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b54100fd0 0x7f9b54107880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 --2- 172.21.15.6:0/3270154846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b540ff860 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 --2- 172.21.15.6:0/3270154846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b54100630 0x7f9b54100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 -- 172.21.15.6:0/3270154846 >> 172.21.15.6:0/3270154846 conn(0x7f9b540fa9b0 msgr2=0x7f9b540fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 -- 172.21.15.6:0/3270154846 shutdown_connections 2023-09-13T09:45:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.490+0000 7f9b5a287700 1 -- 172.21.15.6:0/3270154846 wait complete. 2023-09-13T09:45:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 Processor -- start 2023-09-13T09:45:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 -- start start 2023-09-13T09:45:09.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b54194880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b54100630 0x7f9b54194dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b54100fd0 0x7f9b5419be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5419c400 con 0x7f9b540ff440 2023-09-13T09:45:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5419c540 con 0x7f9b54100630 2023-09-13T09:45:09.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b5a287700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b5419c6d0 con 0x7f9b54100fd0 2023-09-13T09:45:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b54194880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b54194880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37458/0 (socket says 172.21.15.6:37458) 2023-09-13T09:45:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 -- 172.21.15.6:0/1659281804 learned_addr learned my addr 172.21.15.6:0/1659281804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b58824700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b54100fd0 0x7f9b5419be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b537fe700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b54100630 0x7f9b54194dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 -- 172.21.15.6:0/1659281804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b54100fd0 msgr2=0x7f9b5419be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b54100fd0 0x7f9b5419be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 -- 172.21.15.6:0/1659281804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b54100630 msgr2=0x7f9b54194dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b54100630 0x7f9b54194dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b53fff700 1 -- 172.21.15.6:0/1659281804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b4400a700 con 0x7f9b540ff440 2023-09-13T09:45:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.491+0000 7f9b537fe700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b54100630 0x7f9b54194dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.492+0000 7f9b53fff700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b54194880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400a9f0 tx=0x7f9b4400ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.492+0000 7f9b517fa700 1 -- 172.21.15.6:0/1659281804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4401d480 con 0x7f9b540ff440 2023-09-13T09:45:09.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.492+0000 7f9b517fa700 1 -- 172.21.15.6:0/1659281804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b4401daa0 con 0x7f9b540ff440 2023-09-13T09:45:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.492+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b5419c950 con 0x7f9b540ff440 2023-09-13T09:45:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.492+0000 7f9b517fa700 1 -- 172.21.15.6:0/1659281804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4400ea50 con 0x7f9b540ff440 2023-09-13T09:45:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.492+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5419cd70 con 0x7f9b540ff440 2023-09-13T09:45:09.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.494+0000 7f9b517fa700 1 -- 172.21.15.6:0/1659281804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9b4401dc10 con 0x7f9b540ff440 2023-09-13T09:45:09.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.494+0000 7f9b517fa700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b3c0a0640 0x7f9b3c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.495+0000 7f9b517fa700 1 -- 172.21.15.6:0/1659281804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9b44012070 con 0x7f9b540ff440 2023-09-13T09:45:09.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.495+0000 7f9b537fe700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b3c0a0640 0x7f9b3c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.495+0000 7f9b537fe700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b3c0a0640 0x7f9b3c0a2b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005950 tx=0x7f9b480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.495+0000 7f9b6646cb80 1 Processor -- start 2023-09-13T09:45:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.495+0000 7f9b6646cb80 1 -- start start 2023-09-13T09:45:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9a7950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c8fc800 con 0x55601c9a8b90 2023-09-13T09:45:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c8fa120 con 0x55601c9a7e90 2023-09-13T09:45:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c8f5a10 con 0x55601c9a94f0 2023-09-13T09:45:09.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37466/0 (socket says 172.21.15.6:37466) 2023-09-13T09:45:09.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 -- 172.21.15.6:0/843415922 learned_addr learned my addr 172.21.15.6:0/843415922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b537fe700 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9a7950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b58824700 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 -- 172.21.15.6:0/843415922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 msgr2=0x55601c9a7950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9a7950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 -- 172.21.15.6:0/843415922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 msgr2=0x55601c9a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 -- 172.21.15.6:0/843415922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601c7756b0 con 0x55601c9a8b90 2023-09-13T09:45:09.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b537fe700 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b58824700 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:45:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b53fff700 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9a8fb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9b440a50f0 tx=0x7f9b4400a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f82c9be290adc7ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b3a7fc700 1 -- 172.21.15.6:0/843415922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b4409d640 con 0x55601c9a8b90 2023-09-13T09:45:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b3a7fc700 1 -- 172.21.15.6:0/843415922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b44086e90 con 0x55601c9a8b90 2023-09-13T09:45:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.496+0000 7f9b3a7fc700 1 -- 172.21.15.6:0/843415922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b440880e0 con 0x55601c9a8b90 2023-09-13T09:45:09.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 -- 172.21.15.6:0/843415922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 msgr2=0x55601c9a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9a8fb0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f9b440a50f0 tx=0x7f9b4400a420 comp rx=0 tx=0).stop 2023-09-13T09:45:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 -- 172.21.15.6:0/843415922 shutdown_connections 2023-09-13T09:45:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9a8fb0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/843415922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9a7950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 -- 172.21.15.6:0/843415922 >> 172.21.15.6:0/843415922 conn(0x55601c901d00 msgr2=0x55601c99df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 -- 172.21.15.6:0/843415922 shutdown_connections 2023-09-13T09:45:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 -- 172.21.15.6:0/843415922 wait complete. 2023-09-13T09:45:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.497+0000 7f9b6646cb80 1 -- start start 2023-09-13T09:45:09.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 1 Processor -- start 2023-09-13T09:45:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9b11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9b8770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c893c30 con 0x55601c9a8b90 2023-09-13T09:45:09.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c893930 con 0x55601c9a7e90 2023-09-13T09:45:09.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c7779a0 con 0x55601c9a94f0 2023-09-13T09:45:09.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b6646cb80 10 client.0 _ll_register_callbacks cb 0x55601c891700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:09.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9b1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37474/0 (socket says 172.21.15.6:37474) 2023-09-13T09:45:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 -- 172.21.15.6:0/1474855516 learned_addr learned my addr 172.21.15.6:0/1474855516 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b53fff700 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 -- 172.21.15.6:0/1474855516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 msgr2=0x55601c9b8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b58824700 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9b8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 -- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 msgr2=0x55601c9b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.498+0000 7f9b537fe700 1 -- 172.21.15.6:0/1474855516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b5419cd70 con 0x55601c9a8b90 2023-09-13T09:45:09.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b537fe700 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9b1730 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9b48004130 tx=0x7f9b48004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a98cca320e497c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b337fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:09.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b337fe700 1 -- 172.21.15.6:0/1474855516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48017040 con 0x55601c9a8b90 2023-09-13T09:45:09.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55601c9966f0 con 0x55601c9a8b90 2023-09-13T09:45:09.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b337fe700 1 -- 172.21.15.6:0/1474855516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9b48003d20 con 0x55601c9a8b90 2023-09-13T09:45:09.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b337fe700 1 -- 172.21.15.6:0/1474855516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b48020440 con 0x55601c9a8b90 2023-09-13T09:45:09.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 10 client.16953 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:09.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55601c90d820 con 0x55601c9a8b90 2023-09-13T09:45:09.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b337fe700 1 -- 172.21.15.6:0/1474855516 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55601c9966f0 con 0x55601c9a8b90 2023-09-13T09:45:09.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b337fe700 1 -- 172.21.15.6:0/1474855516 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9b4801d050 con 0x55601c9a8b90 2023-09-13T09:45:09.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 10 client.16953 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:09.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 10 client.16953 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:09.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 20 client.16953 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9bcf90 0x55601c9bf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 4 client.16953 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:09.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55601c8ee9f0 con 0x55601c9bcf90 2023-09-13T09:45:09.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.499+0000 7f9b53fff700 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9bcf90 0x55601c9bf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.500+0000 7f9b337fe700 10 client.16953 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.500+0000 7f9b53fff700 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9bcf90 0x55601c9bf3b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d64699d61148d04 server_cookie=fef50852961ab8a7 in_seq=0 out_seq=0 2023-09-13T09:45:09.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.500+0000 7f9b337fe700 1 -- 172.21.15.6:0/1474855516 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55601c8ee9f0 con 0x55601c9bcf90 2023-09-13T09:45:09.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.500+0000 7f9b337fe700 10 client.16953 handle_command_reply: tid=0 2023-09-13T09:45:09.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 client.16953 shutdown 2023-09-13T09:45:09.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 msgr2=0x55601c9b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9b1730 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f9b48004130 tx=0x7f9b48004750 comp rx=0 tx=0).stop 2023-09-13T09:45:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 shutdown_connections 2023-09-13T09:45:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a94f0 0x55601c9b8770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a7e90 0x55601c9b11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9bcf90 0x55601c9bf3b0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/1474855516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a8b90 0x55601c9b1730 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b337fe700 0 client.16953 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 >> 172.21.15.6:0/1474855516 conn(0x55601c901d00 msgr2=0x55601c998870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 shutdown_connections 2023-09-13T09:45:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 1 -- 172.21.15.6:0/1474855516 wait complete. 2023-09-13T09:45:09.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.501+0000 7f9b6646cb80 20 client.16953 trim_cache size 0 max 16384 2023-09-13T09:45:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.518+0000 7f9b6646cb80 1 Processor -- start 2023-09-13T09:45:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.518+0000 7f9b6646cb80 1 -- start start 2023-09-13T09:45:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.518+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c901d00 0x55601c998970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.518+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a8b90 0x55601c9acdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c9b0d60 con 0x55601c9a7e90 2023-09-13T09:45:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c9a0050 con 0x55601c901d00 2023-09-13T09:45:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c9ba3d0 con 0x55601c9a8b90 2023-09-13T09:45:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c901d00 0x55601c998970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37484/0 (socket says 172.21.15.6:37484) 2023-09-13T09:45:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c901d00 0x55601c998970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59236/0 (socket says 172.21.15.6:59236) 2023-09-13T09:45:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 -- 172.21.15.6:0/2247649671 learned_addr learned my addr 172.21.15.6:0/2247649671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b58824700 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a8b90 0x55601c9acdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 -- 172.21.15.6:0/2247649671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a8b90 msgr2=0x55601c9acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a8b90 0x55601c9acdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 -- 172.21.15.6:0/2247649671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c901d00 msgr2=0x55601c998970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c901d00 0x55601c998970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 -- 172.21.15.6:0/2247649671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55601c721e60 con 0x55601c9a7e90 2023-09-13T09:45:09.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b53fff700 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c901d00 0x55601c998970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b537fe700 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b8730 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b4800b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34613b2865618c3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b3affd700 1 -- 172.21.15.6:0/2247649671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48011440 con 0x55601c9a7e90 2023-09-13T09:45:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b3affd700 1 -- 172.21.15.6:0/2247649671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b48003d20 con 0x55601c9a7e90 2023-09-13T09:45:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.519+0000 7f9b3affd700 1 -- 172.21.15.6:0/2247649671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48020e40 con 0x55601c9a7e90 2023-09-13T09:45:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 -- 172.21.15.6:0/2247649671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 msgr2=0x55601c9b8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b8730 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f9b48000c00 tx=0x7f9b4800b9b0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 -- 172.21.15.6:0/2247649671 shutdown_connections 2023-09-13T09:45:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c9a8b90 0x55601c9acdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c901d00 0x55601c998970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/2247649671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b8730 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 -- 172.21.15.6:0/2247649671 >> 172.21.15.6:0/2247649671 conn(0x55601c99e2c0 msgr2=0x55601c9a2530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 -- 172.21.15.6:0/2247649671 shutdown_connections 2023-09-13T09:45:09.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 -- 172.21.15.6:0/2247649671 wait complete. 2023-09-13T09:45:09.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 -- start start 2023-09-13T09:45:09.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.520+0000 7f9b6646cb80 1 Processor -- start 2023-09-13T09:45:09.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c901d00 0x55601c9b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a8b90 0x55601c9b7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c9b81d0 con 0x55601c9a7e90 2023-09-13T09:45:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c9b8340 con 0x55601c9a8b90 2023-09-13T09:45:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55601c9b8500 con 0x55601c901d00 2023-09-13T09:45:09.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 10 client.0 _ll_register_callbacks cb 0x55601c891700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:09.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c901d00 0x55601c9b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37488/0 (socket says 172.21.15.6:37488) 2023-09-13T09:45:09.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c901d00 0x55601c9b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40540/0 (socket says 172.21.15.6:40540) 2023-09-13T09:45:09.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 -- 172.21.15.6:0/700734194 learned_addr learned my addr 172.21.15.6:0/700734194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b58824700 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a8b90 0x55601c9b7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 -- 172.21.15.6:0/700734194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c901d00 msgr2=0x55601c9b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c901d00 0x55601c9b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 -- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a8b90 msgr2=0x55601c9b7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a8b90 0x55601c9b7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 -- 172.21.15.6:0/700734194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55601c7756b0 con 0x55601c9a7e90 2023-09-13T09:45:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b53fff700 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c901d00 0x55601c9b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b537fe700 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b2df0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005d10 tx=0x7f9b4800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70c8a26fc520004f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b337fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b337fe700 1 -- 172.21.15.6:0/700734194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b48020b40 con 0x55601c9a7e90 2023-09-13T09:45:09.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b337fe700 1 -- 172.21.15.6:0/700734194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9b48020ca0 con 0x55601c9a7e90 2023-09-13T09:45:09.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.521+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b44086e90 con 0x55601c9a7e90 2023-09-13T09:45:09.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b337fe700 1 -- 172.21.15.6:0/700734194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b48020e60 con 0x55601c9a7e90 2023-09-13T09:45:09.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 10 client.16959 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:09.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55601c90d820 con 0x55601c9a7e90 2023-09-13T09:45:09.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b337fe700 1 -- 172.21.15.6:0/700734194 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b44086e90 con 0x55601c9a7e90 2023-09-13T09:45:09.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b337fe700 1 -- 172.21.15.6:0/700734194 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f9b4801d070 con 0x55601c9a7e90 2023-09-13T09:45:09.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 10 client.16959 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:09.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 10 client.16959 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:09.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 20 client.16959 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:09.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9a94f0 0x55601ca1a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 4 client.16959 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:45:09.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55601c8af0d0 con 0x55601c9a94f0 2023-09-13T09:45:09.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.522+0000 7f9b53fff700 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9a94f0 0x55601ca1a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.523+0000 7f9b337fe700 10 client.16959 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.523+0000 7f9b53fff700 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9a94f0 0x55601ca1a270 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e569b1d2e68fdbcd server_cookie=e738a9dcd550ae8c in_seq=0 out_seq=0 2023-09-13T09:45:09.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b337fe700 1 -- 172.21.15.6:0/700734194 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55601c8af0d0 con 0x55601c9a94f0 2023-09-13T09:45:09.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b337fe700 10 client.16959 handle_command_reply: tid=0 2023-09-13T09:45:09.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 client.16959 shutdown 2023-09-13T09:45:09.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 msgr2=0x55601c9b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b2df0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005d10 tx=0x7f9b4800ba50 comp rx=0 tx=0).stop 2023-09-13T09:45:09.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 shutdown_connections 2023-09-13T09:45:09.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55601c9a8b90 0x55601c9b7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55601c901d00 0x55601c9b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55601c9a94f0 0x55601ca1a270 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 --2- 172.21.15.6:0/700734194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55601c9a7e90 0x55601c9b2df0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b337fe700 0 client.16959 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 >> 172.21.15.6:0/700734194 conn(0x55601c99e2c0 msgr2=0x55601c9981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 shutdown_connections 2023-09-13T09:45:09.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 1 -- 172.21.15.6:0/700734194 wait complete. 2023-09-13T09:45:09.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.524+0000 7f9b6646cb80 20 client.16959 trim_cache size 0 max 16384 2023-09-13T09:45:09.554 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:45:09.554 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:45:09.554 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "2389e0cc-c3a8-43dc-8f05-1efc513ed4c0", 2023-09-13T09:45:09.554 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:45:09.555 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:45:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b3c0a0640 msgr2=0x7f9b3c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b3c0a0640 0x7f9b3c0a2b00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005950 tx=0x7f9b480058e0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 msgr2=0x7f9b54194880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b54194880 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f9b4400a9f0 tx=0x7f9b4400ce20 comp rx=0 tx=0).stop 2023-09-13T09:45:09.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 shutdown_connections 2023-09-13T09:45:09.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b54100fd0 0x7f9b5419be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b3c0a0640 0x7f9b3c0a2b00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b540ff440 0x7f9b54194880 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 --2- 172.21.15.6:0/1659281804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b54100630 0x7f9b54194dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 >> 172.21.15.6:0/1659281804 conn(0x7f9b540fa9b0 msgr2=0x7f9b54103b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 shutdown_connections 2023-09-13T09:45:09.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.525+0000 7f9b5a287700 1 -- 172.21.15.6:0/1659281804 wait complete. 2023-09-13T09:45:09.559 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:45:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 -- 172.21.15.6:0/2711900369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c101850 msgr2=0x7fda5c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 --2- 172.21.15.6:0/2711900369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c101850 0x7fda5c108100 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7fda5400b0d0 tx=0x7fda5400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 -- 172.21.15.6:0/2711900369 shutdown_connections 2023-09-13T09:45:09.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 --2- 172.21.15.6:0/2711900369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c101850 0x7fda5c108100 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 --2- 172.21.15.6:0/2711900369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda5c0ffcc0 0x7fda5c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 --2- 172.21.15.6:0/2711900369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5c100eb0 0x7fda5c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 -- 172.21.15.6:0/2711900369 >> 172.21.15.6:0/2711900369 conn(0x7fda5c0fb250 msgr2=0x7fda5c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 -- 172.21.15.6:0/2711900369 shutdown_connections 2023-09-13T09:45:09.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.687+0000 7fda62c33700 1 -- 172.21.15.6:0/2711900369 wait complete. 2023-09-13T09:45:09.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 Processor -- start 2023-09-13T09:45:09.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 -- start start 2023-09-13T09:45:09.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5c0ffcc0 0x7fda5c196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c100eb0 0x7fda5c197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda5c101850 0x7fda5c19e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c19e760 con 0x7fda5c100eb0 2023-09-13T09:45:09.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c19e8a0 con 0x7fda5c0ffcc0 2023-09-13T09:45:09.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda62c33700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5c19ea30 con 0x7fda5c101850 2023-09-13T09:45:09.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c100eb0 0x7fda5c197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda609cf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5c0ffcc0 0x7fda5c196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c100eb0 0x7fda5c197120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37502/0 (socket says 172.21.15.6:37502) 2023-09-13T09:45:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda5bfff700 1 -- 172.21.15.6:0/73512497 learned_addr learned my addr 172.21.15.6:0/73512497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.688+0000 7fda611d0700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda5c101850 0x7fda5c19e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda5bfff700 1 -- 172.21.15.6:0/73512497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda5c101850 msgr2=0x7fda5c19e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda5bfff700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda5c101850 0x7fda5c19e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda5bfff700 1 -- 172.21.15.6:0/73512497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5c0ffcc0 msgr2=0x7fda5c196be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda5bfff700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5c0ffcc0 0x7fda5c196be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda5bfff700 1 -- 172.21.15.6:0/73512497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda54009d00 con 0x7fda5c100eb0 2023-09-13T09:45:09.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda609cf700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5c0ffcc0 0x7fda5c196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:09.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda5bfff700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c100eb0 0x7fda5c197120 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fda4800e9a0 tx=0x7fda4800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda59ffb700 1 -- 172.21.15.6:0/73512497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48009790 con 0x7fda5c100eb0 2023-09-13T09:45:09.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5c19ed10 con 0x7fda5c100eb0 2023-09-13T09:45:09.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda59ffb700 1 -- 172.21.15.6:0/73512497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda48010430 con 0x7fda5c100eb0 2023-09-13T09:45:09.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda59ffb700 1 -- 172.21.15.6:0/73512497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48018680 con 0x7fda5c100eb0 2023-09-13T09:45:09.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.689+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c19f210 con 0x7fda5c100eb0 2023-09-13T09:45:09.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.691+0000 7fda59ffb700 1 -- 172.21.15.6:0/73512497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fda480105a0 con 0x7fda5c100eb0 2023-09-13T09:45:09.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.692+0000 7fda59ffb700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fda4c0a0640 0x7fda4c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.692+0000 7fda59ffb700 1 -- 172.21.15.6:0/73512497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fda48014070 con 0x7fda5c100eb0 2023-09-13T09:45:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.692+0000 7fda609cf700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fda4c0a0640 0x7fda4c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda609cf700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fda4c0a0640 0x7fda4c0a2b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fda5c100d10 tx=0x7fda50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 Processor -- start 2023-09-13T09:45:09.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 -- start start 2023-09-13T09:45:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e6700 0x5624b40e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e7060 0x5624b40e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40e5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b403e780 con 0x5624b40e7060 2023-09-13T09:45:09.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b403c0a0 con 0x5624b40e5a00 2023-09-13T09:45:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b4037990 con 0x5624b40e6700 2023-09-13T09:45:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e7060 0x5624b40e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda611d0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40e5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda609cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e6700 0x5624b40e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e7060 0x5624b40e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37510/0 (socket says 172.21.15.6:37510) 2023-09-13T09:45:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.693+0000 7fda5bfff700 1 -- 172.21.15.6:0/637327124 learned_addr learned my addr 172.21.15.6:0/637327124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda611d0700 1 -- 172.21.15.6:0/637327124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e6700 msgr2=0x5624b40e6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda611d0700 1 --2- 172.21.15.6:0/637327124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e6700 0x5624b40e6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda611d0700 1 -- 172.21.15.6:0/637327124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e7060 msgr2=0x5624b40e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda611d0700 1 --2- 172.21.15.6:0/637327124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e7060 0x5624b40e54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda611d0700 1 -- 172.21.15.6:0/637327124 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624b3eb7630 con 0x5624b40e5a00 2023-09-13T09:45:09.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda611d0700 1 --2- 172.21.15.6:0/637327124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40e5e80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fda5400b770 tx=0x7fda54009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb50f210714e556 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda46ffd700 1 -- 172.21.15.6:0/637327124 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5400e040 con 0x5624b40e5a00 2023-09-13T09:45:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda46ffd700 1 -- 172.21.15.6:0/637327124 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda5400baa0 con 0x5624b40e5a00 2023-09-13T09:45:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.694+0000 7fda46ffd700 1 -- 172.21.15.6:0/637327124 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda54005070 con 0x5624b40e5a00 2023-09-13T09:45:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 -- 172.21.15.6:0/637327124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 msgr2=0x5624b40e5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/637327124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40e5e80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fda5400b770 tx=0x7fda54009c60 comp rx=0 tx=0).stop 2023-09-13T09:45:09.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 -- 172.21.15.6:0/637327124 shutdown_connections 2023-09-13T09:45:09.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/637327124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40e5e80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/637327124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e6700 0x5624b40e6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/637327124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e7060 0x5624b40e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 -- 172.21.15.6:0/637327124 >> 172.21.15.6:0/637327124 conn(0x5624b4043c80 msgr2=0x5624b40dff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 -- 172.21.15.6:0/637327124 shutdown_connections 2023-09-13T09:45:09.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 -- 172.21.15.6:0/637327124 wait complete. 2023-09-13T09:45:09.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 -- start start 2023-09-13T09:45:09.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.695+0000 7fda6ee18b80 1 Processor -- start 2023-09-13T09:45:09.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e5a00 0x5624b40eee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40ef3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e7060 0x5624b40f63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b3fd5bb0 con 0x5624b40e6700 2023-09-13T09:45:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b3fd58b0 con 0x5624b40e7060 2023-09-13T09:45:09.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b3eb9920 con 0x5624b40e5a00 2023-09-13T09:45:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda6ee18b80 10 client.0 _ll_register_callbacks cb 0x5624b3fd3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e5a00 0x5624b40eee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40ef3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e5a00 0x5624b40eee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40568/0 (socket says 172.21.15.6:40568) 2023-09-13T09:45:09.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40ef3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37516/0 (socket says 172.21.15.6:37516) 2023-09-13T09:45:09.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 -- 172.21.15.6:0/2352841684 learned_addr learned my addr 172.21.15.6:0/2352841684 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda611d0700 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e7060 0x5624b40f63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 -- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e7060 msgr2=0x5624b40f63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e7060 0x5624b40f63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 -- 172.21.15.6:0/2352841684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 msgr2=0x5624b40ef3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40ef3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 -- 172.21.15.6:0/2352841684 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c108a50 con 0x5624b40e5a00 2023-09-13T09:45:09.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda611d0700 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e7060 0x5624b40f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:09.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda609cf700 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e5a00 0x5624b40eee70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda500039d0 tx=0x7fda500047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=510dc1d4782b1eaa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.696+0000 7fda3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:45:09.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda3bfff700 1 -- 172.21.15.6:0/2352841684 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda5001fac0 con 0x5624b40e5a00 2023-09-13T09:45:09.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624b40d8670 con 0x5624b40e5a00 2023-09-13T09:45:09.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda3bfff700 1 -- 172.21.15.6:0/2352841684 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fda50003e40 con 0x5624b40e5a00 2023-09-13T09:45:09.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda3bfff700 1 -- 172.21.15.6:0/2352841684 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda5001fc20 con 0x5624b40e5a00 2023-09-13T09:45:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 10 client.26338 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5624b404f7a0 con 0x5624b40e5a00 2023-09-13T09:45:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda3bfff700 1 -- 172.21.15.6:0/2352841684 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5624b40d8670 con 0x5624b40e5a00 2023-09-13T09:45:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda3bfff700 1 -- 172.21.15.6:0/2352841684 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fda50032400 con 0x5624b40e5a00 2023-09-13T09:45:09.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 10 client.26338 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:09.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:09.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 20 client.26338 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:09.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40fac40 0x5624b40fd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 4 client.26338 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.697+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624b4030970 con 0x5624b40fac40 2023-09-13T09:45:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.698+0000 7fda5bfff700 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40fac40 0x5624b40fd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.698+0000 7fda5bfff700 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40fac40 0x5624b40fd060 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a424e87e55ca4ad server_cookie=3070233a6271d365 in_seq=0 out_seq=0 2023-09-13T09:45:09.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.698+0000 7fda3bfff700 10 client.26338 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda3bfff700 1 -- 172.21.15.6:0/2352841684 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5624b4030970 con 0x5624b40fac40 2023-09-13T09:45:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda3bfff700 10 client.26338 handle_command_reply: tid=0 2023-09-13T09:45:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 client.26338 shutdown 2023-09-13T09:45:09.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e5a00 msgr2=0x5624b40eee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e5a00 0x5624b40eee70 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fda500039d0 tx=0x7fda500047c0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 shutdown_connections 2023-09-13T09:45:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e7060 0x5624b40f63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b40e5a00 0x5624b40eee70 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40fac40 0x5624b40fd060 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/2352841684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40ef3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda3bfff700 0 client.26338 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 >> 172.21.15.6:0/2352841684 conn(0x5624b4043c80 msgr2=0x5624b40dfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 shutdown_connections 2023-09-13T09:45:09.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 1 -- 172.21.15.6:0/2352841684 wait complete. 2023-09-13T09:45:09.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.699+0000 7fda6ee18b80 20 client.26338 trim_cache size 0 max 16384 2023-09-13T09:45:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 Processor -- start 2023-09-13T09:45:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 -- start start 2023-09-13T09:45:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e5a00 0x5624b40f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e6700 0x5624b40eec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b40e0a60 con 0x5624b40e5a00 2023-09-13T09:45:09.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b40fa7b0 con 0x5624b40e6700 2023-09-13T09:45:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b40e1730 con 0x5624b4043c80 2023-09-13T09:45:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e5a00 0x5624b40f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda5bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e5a00 0x5624b40f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37524/0 (socket says 172.21.15.6:37524) 2023-09-13T09:45:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda5bfff700 1 -- 172.21.15.6:0/3008766354 learned_addr learned my addr 172.21.15.6:0/3008766354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda609cf700 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda611d0700 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e6700 0x5624b40eec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda5bfff700 1 -- 172.21.15.6:0/3008766354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 msgr2=0x5624b40e54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.719+0000 7fda5bfff700 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40e54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.720+0000 7fda5bfff700 1 -- 172.21.15.6:0/3008766354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e6700 msgr2=0x5624b40eec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.720+0000 7fda5bfff700 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e6700 0x5624b40eec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.720+0000 7fda5bfff700 1 -- 172.21.15.6:0/3008766354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624b3e63de0 con 0x5624b40e5a00 2023-09-13T09:45:09.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.720+0000 7fda5bfff700 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e5a00 0x5624b40f63b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fda480c9b00 tx=0x7fda4801a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32481ac96ea903 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.720+0000 7fda477fe700 1 -- 172.21.15.6:0/3008766354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48099480 con 0x5624b40e5a00 2023-09-13T09:45:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.720+0000 7fda477fe700 1 -- 172.21.15.6:0/3008766354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda4809d2b0 con 0x5624b40e5a00 2023-09-13T09:45:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.720+0000 7fda477fe700 1 -- 172.21.15.6:0/3008766354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48097900 con 0x5624b40e5a00 2023-09-13T09:45:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- 172.21.15.6:0/3008766354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e5a00 msgr2=0x5624b40f63b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e5a00 0x5624b40f63b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fda480c9b00 tx=0x7fda4801a040 comp rx=0 tx=0).stop 2023-09-13T09:45:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- 172.21.15.6:0/3008766354 shutdown_connections 2023-09-13T09:45:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e6700 0x5624b40eec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40e54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/3008766354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e5a00 0x5624b40f63b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- 172.21.15.6:0/3008766354 >> 172.21.15.6:0/3008766354 conn(0x5624b40edf10 msgr2=0x5624b40f6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- 172.21.15.6:0/3008766354 shutdown_connections 2023-09-13T09:45:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- 172.21.15.6:0/3008766354 wait complete. 2023-09-13T09:45:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- start start 2023-09-13T09:45:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 Processor -- start 2023-09-13T09:45:09.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40f6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40f3420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b414ea60 con 0x5624b40e6700 2023-09-13T09:45:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.721+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b414eba0 con 0x5624b40e5a00 2023-09-13T09:45:09.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda6ee18b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624b414ece0 con 0x5624b4043c80 2023-09-13T09:45:09.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda6ee18b80 10 client.0 _ll_register_callbacks cb 0x5624b3fd3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:09.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda611d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40f3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda611d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40f3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37532/0 (socket says 172.21.15.6:37532) 2023-09-13T09:45:09.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda611d0700 1 -- 172.21.15.6:0/598939256 learned_addr learned my addr 172.21.15.6:0/598939256 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda609cf700 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40f6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda5bfff700 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda609cf700 1 -- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 msgr2=0x5624b40f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda609cf700 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40f2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda609cf700 1 -- 172.21.15.6:0/598939256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 msgr2=0x5624b40f3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda609cf700 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40f3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda609cf700 1 -- 172.21.15.6:0/598939256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda5c19f210 con 0x5624b4043c80 2023-09-13T09:45:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda609cf700 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40f6350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda50000c00 tx=0x7fda50032690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2147068d76e2b130 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda3bfff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:45:09.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda3bfff700 1 -- 172.21.15.6:0/598939256 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda50004a30 con 0x5624b4043c80 2023-09-13T09:45:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda5400baa0 con 0x5624b4043c80 2023-09-13T09:45:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.722+0000 7fda3bfff700 1 -- 172.21.15.6:0/598939256 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fda50037070 con 0x5624b4043c80 2023-09-13T09:45:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda3bfff700 1 -- 172.21.15.6:0/598939256 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda50004b90 con 0x5624b4043c80 2023-09-13T09:45:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 10 client.26344 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:09.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5624b3e4cc60 con 0x5624b4043c80 2023-09-13T09:45:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda3bfff700 1 -- 172.21.15.6:0/598939256 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda5400baa0 con 0x5624b4043c80 2023-09-13T09:45:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda3bfff700 1 -- 172.21.15.6:0/598939256 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fda50005040 con 0x5624b4043c80 2023-09-13T09:45:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 10 client.26344 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:09.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:09.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 20 client.26344 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:09.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40e7060 0x5624b4152770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:09.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 4 client.26344 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:45:09.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5624b3ff1050 con 0x5624b40e7060 2023-09-13T09:45:09.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.723+0000 7fda5bfff700 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40e7060 0x5624b4152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:09.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda3bfff700 10 client.26344 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda5bfff700 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40e7060 0x5624b4152770 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d5c558e3c790676 server_cookie=e8534fc6c9eb6352 in_seq=0 out_seq=0 2023-09-13T09:45:09.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda3bfff700 1 -- 172.21.15.6:0/598939256 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5624b3ff1050 con 0x5624b40e7060 2023-09-13T09:45:09.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda3bfff700 10 client.26344 handle_command_reply: tid=0 2023-09-13T09:45:09.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 client.26344 shutdown 2023-09-13T09:45:09.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 msgr2=0x5624b40f6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40f6350 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fda50000c00 tx=0x7fda50032690 comp rx=0 tx=0).stop 2023-09-13T09:45:09.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 shutdown_connections 2023-09-13T09:45:09.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5624b40e7060 0x5624b4152770 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5624b40e6700 0x5624b40f3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda3bfff700 0 client.26344 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:09.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5624b4043c80 0x5624b40f6350 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 --2- 172.21.15.6:0/598939256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5624b40e5a00 0x5624b40f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 >> 172.21.15.6:0/598939256 conn(0x5624b40edf10 msgr2=0x5624b40eec20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 shutdown_connections 2023-09-13T09:45:09.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 1 -- 172.21.15.6:0/598939256 wait complete. 2023-09-13T09:45:09.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.724+0000 7fda6ee18b80 20 client.26344 trim_cache size 0 max 16384 2023-09-13T09:45:09.754 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:45:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:45:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:45:09.754 INFO:teuthology.orchestra.run.smithi006.stdout: "2389e0cc-c3a8-43dc-8f05-1efc513ed4c0": { 2023-09-13T09:45:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:45:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "2389e0cc-c3a8-43dc-8f05-1efc513ed4c0", 2023-09-13T09:45:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:45:09.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:45:09.756 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:45:09.756 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:45:09.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fda4c0a0640 msgr2=0x7fda4c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fda4c0a0640 0x7fda4c0a2b00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fda5c100d10 tx=0x7fda50009260 comp rx=0 tx=0).stop 2023-09-13T09:45:09.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c100eb0 msgr2=0x7fda5c197120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:09.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c100eb0 0x7fda5c197120 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fda4800e9a0 tx=0x7fda4800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 shutdown_connections 2023-09-13T09:45:09.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda5c101850 0x7fda5c19e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda5c0ffcc0 0x7fda5c196be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fda4c0a0640 0x7fda4c0a2b00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 --2- 172.21.15.6:0/73512497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda5c100eb0 0x7fda5c197120 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:09.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 >> 172.21.15.6:0/73512497 conn(0x7fda5c0fb250 msgr2=0x7fda5c067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:09.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 shutdown_connections 2023-09-13T09:45:09.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:09.725+0000 7fda62c33700 1 -- 172.21.15.6:0/73512497 wait complete. 2023-09-13T09:45:09.760 INFO:tasks.cephfs.filesystem:scrub status for tag:2389e0cc-c3a8-43dc-8f05-1efc513ed4c0 - {'path': '/', 'tag': '2389e0cc-c3a8-43dc-8f05-1efc513ed4c0', 'options': 'recursive,force'} 2023-09-13T09:45:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: pgmap v469: 97 pgs: 97 active+clean; 83 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 718 KiB/s wr, 79 op/s 2023-09-13T09:45:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:10.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.007 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:09 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.164 INFO:tasks.workunit.client.0.smithi006.stdout: 1 175737 2.97 MB/sec execute 150 sec latency 222.843 ms 2023-09-13T09:45:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: pgmap v469: 97 pgs: 97 active+clean; 83 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 718 KiB/s wr, 79 op/s 2023-09-13T09:45:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:10.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:09 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: pgmap v469: 97 pgs: 97 active+clean; 83 MiB data, 994 MiB used, 1.0 TiB / 1.0 TiB avail; 298 KiB/s rd, 718 KiB/s wr, 79 op/s 2023-09-13T09:45:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:10.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:10.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:09 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 177675 3.03 MB/sec execute 151 sec latency 16.760 ms 2023-09-13T09:45:11.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:45:11.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:11.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:11.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:11.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:11.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:10 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:45:11.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:11.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:11.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:11.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:11.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:10 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:45:11.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:11.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:11.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:11.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:11.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:11.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:10 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:12.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 178077 3.02 MB/sec execute 152 sec latency 502.055 ms 2023-09-13T09:45:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:11 smithi006 ceph-mon[98665]: pgmap v470: 97 pgs: 97 active+clean; 83 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 825 KiB/s wr, 79 op/s 2023-09-13T09:45:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:11 smithi053 ceph-mon[102373]: pgmap v470: 97 pgs: 97 active+clean; 83 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 825 KiB/s wr, 79 op/s 2023-09-13T09:45:12.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:11 smithi131 ceph-mon[102785]: pgmap v470: 97 pgs: 97 active+clean; 83 MiB data, 1001 MiB used, 1.0 TiB / 1.0 TiB avail; 300 KiB/s rd, 825 KiB/s wr, 79 op/s 2023-09-13T09:45:13.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 180242 3.07 MB/sec execute 153 sec latency 16.493 ms 2023-09-13T09:45:14.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 181382 3.10 MB/sec execute 154 sec latency 16.192 ms 2023-09-13T09:45:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:13 smithi006 ceph-mon[98665]: pgmap v471: 97 pgs: 97 active+clean; 83 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 690 KiB/s wr, 86 op/s 2023-09-13T09:45:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:13 smithi053 ceph-mon[102373]: pgmap v471: 97 pgs: 97 active+clean; 83 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 690 KiB/s wr, 86 op/s 2023-09-13T09:45:14.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:13 smithi131 ceph-mon[102785]: pgmap v471: 97 pgs: 97 active+clean; 83 MiB data, 1003 MiB used, 1.0 TiB / 1.0 TiB avail; 328 KiB/s rd, 690 KiB/s wr, 86 op/s 2023-09-13T09:45:15.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 183380 3.13 MB/sec execute 155 sec latency 39.685 ms 2023-09-13T09:45:16.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 184751 3.18 MB/sec execute 156 sec latency 178.556 ms 2023-09-13T09:45:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:15 smithi006 ceph-mon[98665]: pgmap v472: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 894 KiB/s wr, 144 op/s 2023-09-13T09:45:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:15 smithi053 ceph-mon[102373]: pgmap v472: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 894 KiB/s wr, 144 op/s 2023-09-13T09:45:16.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:15 smithi131 ceph-mon[102785]: pgmap v472: 97 pgs: 97 active+clean; 86 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 894 KiB/s wr, 144 op/s 2023-09-13T09:45:17.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 185166 3.17 MB/sec execute 157 sec latency 498.214 ms 2023-09-13T09:45:18.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 185178 3.15 MB/sec execute 158 sec latency 980.856 ms 2023-09-13T09:45:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:17 smithi006 ceph-mon[98665]: pgmap v473: 97 pgs: 97 active+clean; 87 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1007 KiB/s wr, 136 op/s 2023-09-13T09:45:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:17 smithi053 ceph-mon[102373]: pgmap v473: 97 pgs: 97 active+clean; 87 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1007 KiB/s wr, 136 op/s 2023-09-13T09:45:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:17 smithi131 ceph-mon[102785]: pgmap v473: 97 pgs: 97 active+clean; 87 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 468 KiB/s rd, 1007 KiB/s wr, 136 op/s 2023-09-13T09:45:19.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 185178 3.13 MB/sec execute 159 sec latency 1980.956 ms 2023-09-13T09:45:20.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 185178 3.11 MB/sec execute 160 sec latency 2981.012 ms 2023-09-13T09:45:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:19 smithi006 ceph-mon[98665]: pgmap v474: 97 pgs: 97 active+clean; 87 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2023-09-13T09:45:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:19 smithi053 ceph-mon[102373]: pgmap v474: 97 pgs: 97 active+clean; 87 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2023-09-13T09:45:20.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:19 smithi131 ceph-mon[102785]: pgmap v474: 97 pgs: 97 active+clean; 87 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 520 KiB/s rd, 1.1 MiB/s wr, 148 op/s 2023-09-13T09:45:21.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 185178 3.09 MB/sec execute 161 sec latency 3981.072 ms 2023-09-13T09:45:22.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 185207 3.07 MB/sec execute 162 sec latency 4959.815 ms 2023-09-13T09:45:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:21 smithi006 ceph-mon[98665]: pgmap v475: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2023-09-13T09:45:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:21 smithi053 ceph-mon[102373]: pgmap v475: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2023-09-13T09:45:22.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:21 smithi131 ceph-mon[102785]: pgmap v475: 97 pgs: 97 active+clean; 88 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 675 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2023-09-13T09:45:23.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 187629 3.13 MB/sec execute 163 sec latency 12.680 ms 2023-09-13T09:45:24.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188672 3.15 MB/sec execute 164 sec latency 13.427 ms 2023-09-13T09:45:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:23 smithi006 ceph-mon[98665]: pgmap v476: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 1.2 MiB/s wr, 177 op/s 2023-09-13T09:45:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:23 smithi053 ceph-mon[102373]: pgmap v476: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 1.2 MiB/s wr, 177 op/s 2023-09-13T09:45:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:23 smithi131 ceph-mon[102785]: pgmap v476: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 638 KiB/s rd, 1.2 MiB/s wr, 177 op/s 2023-09-13T09:45:25.165 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188672 3.13 MB/sec execute 165 sec latency 1001.894 ms 2023-09-13T09:45:25.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:25.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:25.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:25.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:25.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:25.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:45:25.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:45:25.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:45:25.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:45:25.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:25.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:25.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:25.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:25.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:25.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:45:25.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:45:25.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:45:25.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:45:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:45:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:45:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:45:25.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:45:26.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188672 3.11 MB/sec execute 166 sec latency 2001.998 ms 2023-09-13T09:45:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:25 smithi006 ceph-mon[98665]: pgmap v477: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 1.2 MiB/s wr, 185 op/s 2023-09-13T09:45:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:25 smithi053 ceph-mon[102373]: pgmap v477: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 1.2 MiB/s wr, 185 op/s 2023-09-13T09:45:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:25 smithi131 ceph-mon[102785]: pgmap v477: 97 pgs: 97 active+clean; 90 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 603 KiB/s rd, 1.2 MiB/s wr, 185 op/s 2023-09-13T09:45:27.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188687 3.09 MB/sec execute 167 sec latency 2990.139 ms 2023-09-13T09:45:28.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188728 3.07 MB/sec execute 168 sec latency 968.041 ms 2023-09-13T09:45:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:27 smithi006 ceph-mon[98665]: pgmap v478: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 818 KiB/s wr, 115 op/s 2023-09-13T09:45:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:27 smithi053 ceph-mon[102373]: pgmap v478: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 818 KiB/s wr, 115 op/s 2023-09-13T09:45:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:27 smithi131 ceph-mon[102785]: pgmap v478: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 410 KiB/s rd, 818 KiB/s wr, 115 op/s 2023-09-13T09:45:29.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188728 3.05 MB/sec execute 169 sec latency 1968.079 ms 2023-09-13T09:45:30.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188728 3.04 MB/sec execute 170 sec latency 2968.131 ms 2023-09-13T09:45:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:30 smithi006 ceph-mon[98665]: pgmap v479: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 656 KiB/s wr, 105 op/s 2023-09-13T09:45:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:30 smithi053 ceph-mon[102373]: pgmap v479: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 656 KiB/s wr, 105 op/s 2023-09-13T09:45:30.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:30 smithi131 ceph-mon[102785]: pgmap v479: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 334 KiB/s rd, 656 KiB/s wr, 105 op/s 2023-09-13T09:45:31.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188728 3.02 MB/sec execute 171 sec latency 3968.273 ms 2023-09-13T09:45:32.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188760 3.00 MB/sec execute 172 sec latency 4945.472 ms 2023-09-13T09:45:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:32 smithi006 ceph-mon[98665]: pgmap v480: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 662 KiB/s wr, 97 op/s 2023-09-13T09:45:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:32 smithi053 ceph-mon[102373]: pgmap v480: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 662 KiB/s wr, 97 op/s 2023-09-13T09:45:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:32 smithi131 ceph-mon[102785]: pgmap v480: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 662 KiB/s wr, 97 op/s 2023-09-13T09:45:33.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188796 2.98 MB/sec execute 173 sec latency 972.299 ms 2023-09-13T09:45:34.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188796 2.97 MB/sec execute 174 sec latency 1972.427 ms 2023-09-13T09:45:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:34 smithi131 ceph-mon[102785]: pgmap v481: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 474 KiB/s wr, 64 op/s 2023-09-13T09:45:34.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:34 smithi053 ceph-mon[102373]: pgmap v481: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 474 KiB/s wr, 64 op/s 2023-09-13T09:45:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:34 smithi006 ceph-mon[98665]: pgmap v481: 97 pgs: 97 active+clean; 89 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 474 KiB/s wr, 64 op/s 2023-09-13T09:45:35.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188796 2.95 MB/sec execute 175 sec latency 2972.552 ms 2023-09-13T09:45:36.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188796 2.93 MB/sec execute 176 sec latency 3972.656 ms 2023-09-13T09:45:36.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:36 smithi131 ceph-mon[102785]: pgmap v482: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 417 KiB/s wr, 64 op/s 2023-09-13T09:45:36.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:36 smithi006 ceph-mon[98665]: pgmap v482: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 417 KiB/s wr, 64 op/s 2023-09-13T09:45:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:36 smithi053 ceph-mon[102373]: pgmap v482: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 173 KiB/s rd, 417 KiB/s wr, 64 op/s 2023-09-13T09:45:37.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 188828 2.92 MB/sec execute 177 sec latency 4950.154 ms 2023-09-13T09:45:38.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 191200 2.97 MB/sec execute 178 sec latency 39.950 ms 2023-09-13T09:45:38.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:38 smithi131 ceph-mon[102785]: pgmap v483: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 419 KiB/s wr, 41 op/s 2023-09-13T09:45:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:38 smithi006 ceph-mon[98665]: pgmap v483: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 419 KiB/s wr, 41 op/s 2023-09-13T09:45:38.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:38 smithi053 ceph-mon[102373]: pgmap v483: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 419 KiB/s wr, 41 op/s 2023-09-13T09:45:39.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 192213 2.99 MB/sec execute 179 sec latency 13.301 ms 2023-09-13T09:45:39.761 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:45:39.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 -- 172.21.15.6:0/111344626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c101860 msgr2=0x7fa63c103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 --2- 172.21.15.6:0/111344626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c101860 0x7fa63c103c50 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009990 tx=0x7fa62c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 -- 172.21.15.6:0/111344626 shutdown_connections 2023-09-13T09:45:39.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 --2- 172.21.15.6:0/111344626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c106ba0 0x7fa63c109030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 --2- 172.21.15.6:0/111344626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c101860 0x7fa63c103c50 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 --2- 172.21.15.6:0/111344626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa63c104190 0x7fa63c106580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 -- 172.21.15.6:0/111344626 >> 172.21.15.6:0/111344626 conn(0x7fa63c0fb250 msgr2=0x7fa63c0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:39.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 -- 172.21.15.6:0/111344626 shutdown_connections 2023-09-13T09:45:39.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.896+0000 7fa644039700 1 -- 172.21.15.6:0/111344626 wait complete. 2023-09-13T09:45:39.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 Processor -- start 2023-09-13T09:45:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 -- start start 2023-09-13T09:45:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c101860 0x7fa63c196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa63c104190 0x7fa63c1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c106ba0 0x7fa63c19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c19e700 con 0x7fa63c106ba0 2023-09-13T09:45:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c19e840 con 0x7fa63c104190 2023-09-13T09:45:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.897+0000 7fa644039700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63c19e9d0 con 0x7fa63c101860 2023-09-13T09:45:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa6425d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c106ba0 0x7fa63c19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c101860 0x7fa63c196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c101860 0x7fa63c196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40596/0 (socket says 172.21.15.6:40596) 2023-09-13T09:45:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa6415d4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa63c104190 0x7fa63c1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 -- 172.21.15.6:0/1865598726 learned_addr learned my addr 172.21.15.6:0/1865598726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa6425d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c106ba0 0x7fa63c19e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37546/0 (socket says 172.21.15.6:37546) 2023-09-13T09:45:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 -- 172.21.15.6:0/1865598726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa63c104190 msgr2=0x7fa63c1970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa63c104190 0x7fa63c1970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 -- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c106ba0 msgr2=0x7fa63c19e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c106ba0 0x7fa63c19e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 -- 172.21.15.6:0/1865598726 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa62c0095f0 con 0x7fa63c101860 2023-09-13T09:45:39.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa6425d6700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c106ba0 0x7fa63c19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:39.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa641dd5700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c101860 0x7fa63c196b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0059d0 tx=0x7fa62c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:39.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa632ffd700 1 -- 172.21.15.6:0/1865598726 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c01d070 con 0x7fa63c101860 2023-09-13T09:45:39.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa63c19ec50 con 0x7fa63c101860 2023-09-13T09:45:39.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa63c19f0d0 con 0x7fa63c101860 2023-09-13T09:45:39.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa632ffd700 1 -- 172.21.15.6:0/1865598726 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa62c00fb90 con 0x7fa63c101860 2023-09-13T09:45:39.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.898+0000 7fa632ffd700 1 -- 172.21.15.6:0/1865598726 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0173f0 con 0x7fa63c101860 2023-09-13T09:45:39.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.901+0000 7fa632ffd700 1 -- 172.21.15.6:0/1865598726 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa62c00fd00 con 0x7fa63c101860 2023-09-13T09:45:39.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.901+0000 7fa632ffd700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6280a0640 0x7fa6280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.901+0000 7fa6415d4700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6280a0640 0x7fa6280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.901+0000 7fa632ffd700 1 -- 172.21.15.6:0/1865598726 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa62c0cd050 con 0x7fa63c101860 2023-09-13T09:45:39.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa6415d4700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6280a0640 0x7fa6280a2b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa638009c60 tx=0x7fa638009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:39.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 Processor -- start 2023-09-13T09:45:39.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 -- start start 2023-09-13T09:45:39.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad1fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad20060 0x56003ad1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1ea00 0x56003ad1ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ac77780 con 0x56003ad1f700 2023-09-13T09:45:39.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ac750a0 con 0x56003ad1ea00 2023-09-13T09:45:39.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.902+0000 7fa65021eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ac70990 con 0x56003ad20060 2023-09-13T09:45:39.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad1fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6415d4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad20060 0x56003ad1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1ea00 0x56003ad1ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6415d4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad20060 0x56003ad1e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40606/0 (socket says 172.21.15.6:40606) 2023-09-13T09:45:39.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1ea00 0x56003ad1ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59310/0 (socket says 172.21.15.6:59310) 2023-09-13T09:45:39.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad1fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37550/0 (socket says 172.21.15.6:37550) 2023-09-13T09:45:39.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6415d4700 1 -- 172.21.15.6:0/167459327 learned_addr learned my addr 172.21.15.6:0/167459327 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:39.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 -- 172.21.15.6:0/167459327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad20060 msgr2=0x56003ad1e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 --2- 172.21.15.6:0/167459327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad20060 0x56003ad1e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 -- 172.21.15.6:0/167459327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 msgr2=0x56003ad1fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 --2- 172.21.15.6:0/167459327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad1fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 -- 172.21.15.6:0/167459327 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56003aaf0630 con 0x56003ad1ea00 2023-09-13T09:45:39.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa6425d6700 1 --2- 172.21.15.6:0/167459327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1ea00 0x56003ad1ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa634003db0 tx=0x7fa634009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58bc0738de0da318 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:39.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa627fff700 1 -- 172.21.15.6:0/167459327 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634004bb0 con 0x56003ad1ea00 2023-09-13T09:45:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa627fff700 1 -- 172.21.15.6:0/167459327 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa63400f040 con 0x56003ad1ea00 2023-09-13T09:45:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.903+0000 7fa627fff700 1 -- 172.21.15.6:0/167459327 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa634007c20 con 0x56003ad1ea00 2023-09-13T09:45:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 -- 172.21.15.6:0/167459327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1ea00 msgr2=0x56003ad1ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 --2- 172.21.15.6:0/167459327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1ea00 0x56003ad1ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa634003db0 tx=0x7fa634009920 comp rx=0 tx=0).stop 2023-09-13T09:45:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 -- 172.21.15.6:0/167459327 shutdown_connections 2023-09-13T09:45:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 --2- 172.21.15.6:0/167459327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1ea00 0x56003ad1ee80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 --2- 172.21.15.6:0/167459327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad1fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 --2- 172.21.15.6:0/167459327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad20060 0x56003ad1e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 -- 172.21.15.6:0/167459327 >> 172.21.15.6:0/167459327 conn(0x56003ac7cc80 msgr2=0x56003ad18f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 -- 172.21.15.6:0/167459327 shutdown_connections 2023-09-13T09:45:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 -- 172.21.15.6:0/167459327 wait complete. 2023-09-13T09:45:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.904+0000 7fa65021eb80 1 -- start start 2023-09-13T09:45:39.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 1 Processor -- start 2023-09-13T09:45:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1ea00 0x56003ad27ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1f700 0x56003ad28410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ac0ebb0 con 0x56003ad1ea00 2023-09-13T09:45:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ac0e8b0 con 0x56003ad20060 2023-09-13T09:45:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003aaf2920 con 0x56003ad1f700 2023-09-13T09:45:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa65021eb80 10 client.0 _ll_register_callbacks cb 0x56003ac0c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1ea00 0x56003ad27ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1ea00 0x56003ad27ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37556/0 (socket says 172.21.15.6:37556) 2023-09-13T09:45:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa641dd5700 1 -- 172.21.15.6:0/2097647225 learned_addr learned my addr 172.21.15.6:0/2097647225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:39.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa6415d4700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1f700 0x56003ad28410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.905+0000 7fa6425d6700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa641dd5700 1 -- 172.21.15.6:0/2097647225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1f700 msgr2=0x56003ad28410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa641dd5700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1f700 0x56003ad28410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa641dd5700 1 -- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 msgr2=0x56003ad2f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa641dd5700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa641dd5700 1 -- 172.21.15.6:0/2097647225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa634003a60 con 0x56003ad1ea00 2023-09-13T09:45:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa6425d6700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa641dd5700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1ea00 0x56003ad27ed0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa62c09a5c0 tx=0x7fa62c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c9643a1a81613c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa6257fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:39.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa6257fa700 1 -- 172.21.15.6:0/2097647225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0a28a0 con 0x56003ad1ea00 2023-09-13T09:45:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56003ad11670 con 0x56003ad1ea00 2023-09-13T09:45:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa6257fa700 1 -- 172.21.15.6:0/2097647225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa62c099db0 con 0x56003ad1ea00 2023-09-13T09:45:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa6257fa700 1 -- 172.21.15.6:0/2097647225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa62c099f70 con 0x56003ad1ea00 2023-09-13T09:45:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa65021eb80 10 client.16989 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:39.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56003ac887a0 con 0x56003ad1ea00 2023-09-13T09:45:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa6257fa700 1 -- 172.21.15.6:0/2097647225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa62c0b8020 con 0x56003ad1ea00 2023-09-13T09:45:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa6257fa700 1 -- 172.21.15.6:0/2097647225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa62c0998b0 con 0x56003ad1ea00 2023-09-13T09:45:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa65021eb80 10 client.16989 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa65021eb80 10 client.16989 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:39.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa65021eb80 20 client.16989 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.906+0000 7fa65021eb80 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad33970 0x56003ad35d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.907+0000 7fa65021eb80 4 client.16989 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.907+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56003ac69970 con 0x56003ad33970 2023-09-13T09:45:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.907+0000 7fa6415d4700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad33970 0x56003ad35d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.907+0000 7fa6257fa700 10 client.16989 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.907+0000 7fa6415d4700 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad33970 0x56003ad35d60 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252216d4ad8a0050 server_cookie=e29b90951bf7c4a6 in_seq=0 out_seq=0 2023-09-13T09:45:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa6257fa700 1 -- 172.21.15.6:0/2097647225 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56003ac69970 con 0x56003ad33970 2023-09-13T09:45:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa6257fa700 10 client.16989 handle_command_reply: tid=0 2023-09-13T09:45:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 client.16989 shutdown 2023-09-13T09:45:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1ea00 msgr2=0x56003ad27ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1ea00 0x56003ad27ed0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa62c09a5c0 tx=0x7fa62c005ef0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 shutdown_connections 2023-09-13T09:45:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad33970 0x56003ad35d60 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1ea00 0x56003ad27ed0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 --2- 172.21.15.6:0/2097647225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1f700 0x56003ad28410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa6257fa700 0 client.16989 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 >> 172.21.15.6:0/2097647225 conn(0x56003ac7cc80 msgr2=0x56003ad18ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 shutdown_connections 2023-09-13T09:45:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 1 -- 172.21.15.6:0/2097647225 wait complete. 2023-09-13T09:45:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.908+0000 7fa65021eb80 20 client.16989 trim_cache size 0 max 16384 2023-09-13T09:45:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 Processor -- start 2023-09-13T09:45:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 -- start start 2023-09-13T09:45:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1f700 0x56003ad2f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad20060 0x56003ad18e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ad337c0 con 0x56003ad20060 2023-09-13T09:45:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ad1a760 con 0x56003ad1f700 2023-09-13T09:45:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa65021eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ad234a0 con 0x56003ad1ea00 2023-09-13T09:45:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1f700 0x56003ad2f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6425d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad20060 0x56003ad18e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1f700 0x56003ad2f410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59322/0 (socket says 172.21.15.6:59322) 2023-09-13T09:45:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 -- 172.21.15.6:0/3788183544 learned_addr learned my addr 172.21.15.6:0/3788183544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6425d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad20060 0x56003ad18e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37568/0 (socket says 172.21.15.6:37568) 2023-09-13T09:45:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa641dd5700 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 -- 172.21.15.6:0/3788183544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 msgr2=0x56003ad1e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad1e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 -- 172.21.15.6:0/3788183544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad20060 msgr2=0x56003ad18e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad20060 0x56003ad18e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.927+0000 7fa6415d4700 1 -- 172.21.15.6:0/3788183544 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56003aa9cde0 con 0x56003ad1f700 2023-09-13T09:45:39.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa6415d4700 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1f700 0x56003ad2f410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa638004220 tx=0x7fa638014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b53617d68fd86e92 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:39.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa630ff9700 1 -- 172.21.15.6:0/3788183544 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa638022070 con 0x56003ad1f700 2023-09-13T09:45:39.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa630ff9700 1 -- 172.21.15.6:0/3788183544 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa638023040 con 0x56003ad1f700 2023-09-13T09:45:39.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa630ff9700 1 -- 172.21.15.6:0/3788183544 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa63801d410 con 0x56003ad1f700 2023-09-13T09:45:39.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 -- 172.21.15.6:0/3788183544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1f700 msgr2=0x56003ad2f410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1f700 0x56003ad2f410 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa638004220 tx=0x7fa638014000 comp rx=0 tx=0).stop 2023-09-13T09:45:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 -- 172.21.15.6:0/3788183544 shutdown_connections 2023-09-13T09:45:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad20060 0x56003ad18e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad1e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 --2- 172.21.15.6:0/3788183544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad1f700 0x56003ad2f410 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 -- 172.21.15.6:0/3788183544 >> 172.21.15.6:0/3788183544 conn(0x56003ac7cc80 msgr2=0x56003ad26be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.928+0000 7fa65021eb80 1 -- 172.21.15.6:0/3788183544 shutdown_connections 2023-09-13T09:45:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 -- 172.21.15.6:0/3788183544 wait complete. 2023-09-13T09:45:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 -- start start 2023-09-13T09:45:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 Processor -- start 2023-09-13T09:45:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad2eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad2f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2b950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ad2c060 con 0x56003ad1f700 2023-09-13T09:45:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ad2c1d0 con 0x56003ad20060 2023-09-13T09:45:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56003ad2c390 con 0x56003ad1ea00 2023-09-13T09:45:39.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa65021eb80 10 client.0 _ll_register_callbacks cb 0x56003ac0c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:39.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa6415d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad2f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad2eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa6425d6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa6415d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad2f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37572/0 (socket says 172.21.15.6:37572) 2023-09-13T09:45:39.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa641dd5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad2eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40624/0 (socket says 172.21.15.6:40624) 2023-09-13T09:45:39.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.929+0000 7fa6415d4700 1 -- 172.21.15.6:0/591892761 learned_addr learned my addr 172.21.15.6:0/591892761 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:39.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa641dd5700 1 -- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 msgr2=0x56003ad2b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa641dd5700 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa641dd5700 1 -- 172.21.15.6:0/591892761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 msgr2=0x56003ad2f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:39.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa641dd5700 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad2f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa641dd5700 1 -- 172.21.15.6:0/591892761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa638017070 con 0x56003ad1ea00 2023-09-13T09:45:39.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa6425d6700 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:39.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa641dd5700 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad2eeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa62c024010 tx=0x7fa62c009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffc9221b5c9bc6f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:39.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa6257fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:45:39.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa6257fa700 1 -- 172.21.15.6:0/591892761 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62c0a2610 con 0x56003ad1ea00 2023-09-13T09:45:39.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa63400f040 con 0x56003ad1ea00 2023-09-13T09:45:39.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa6257fa700 1 -- 172.21.15.6:0/591892761 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa62c0a28a0 con 0x56003ad1ea00 2023-09-13T09:45:39.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa6257fa700 1 -- 172.21.15.6:0/591892761 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa62c099a30 con 0x56003ad1ea00 2023-09-13T09:45:39.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa65021eb80 10 client.26362 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:39.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56003aa85c60 con 0x56003ad1ea00 2023-09-13T09:45:39.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.930+0000 7fa6257fa700 1 -- 172.21.15.6:0/591892761 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa63400f040 con 0x56003ad1ea00 2023-09-13T09:45:39.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa6257fa700 1 -- 172.21.15.6:0/591892761 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa62c066070 con 0x56003ad1ea00 2023-09-13T09:45:39.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa65021eb80 10 client.26362 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:39.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa65021eb80 10 client.26362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:39.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa65021eb80 20 client.26362 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:39.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa65021eb80 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad90fe0 0x56003ad93400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:39.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa65021eb80 4 client.26362 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:45:39.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56003ac2a050 con 0x56003ad90fe0 2023-09-13T09:45:39.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa6415d4700 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad90fe0 0x56003ad93400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:39.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa6257fa700 10 client.26362 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:39.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa6415d4700 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad90fe0 0x56003ad93400 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff5f3d288dd780f0 server_cookie=b7ab09309d27431b in_seq=0 out_seq=0 2023-09-13T09:45:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa6257fa700 1 -- 172.21.15.6:0/591892761 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56003ac2a050 con 0x56003ad90fe0 2023-09-13T09:45:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.931+0000 7fa6257fa700 10 client.26362 handle_command_reply: tid=0 2023-09-13T09:45:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 client.26362 shutdown 2023-09-13T09:45:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 msgr2=0x56003ad2eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad2eeb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa62c024010 tx=0x7fa62c009510 comp rx=0 tx=0).stop 2023-09-13T09:45:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 shutdown_connections 2023-09-13T09:45:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56003ad20060 0x56003ad2b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56003ad1ea00 0x56003ad2eeb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56003ad90fe0 0x56003ad93400 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 --2- 172.21.15.6:0/591892761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56003ad1f700 0x56003ad2f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa6257fa700 0 client.26362 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 >> 172.21.15.6:0/591892761 conn(0x56003ac7cc80 msgr2=0x56003ad228e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 shutdown_connections 2023-09-13T09:45:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 1 -- 172.21.15.6:0/591892761 wait complete. 2023-09-13T09:45:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa65021eb80 20 client.26362 trim_cache size 0 max 16384 2023-09-13T09:45:39.953 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:45:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:45:39.953 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:45:39.953 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:45:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6280a0640 msgr2=0x7fa6280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa644039700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6280a0640 0x7fa6280a2b00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa638009c60 tx=0x7fa638009260 comp rx=0 tx=0).stop 2023-09-13T09:45:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c101860 msgr2=0x7fa63c196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa644039700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c101860 0x7fa63c196b80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa62c0059d0 tx=0x7fa62c004730 comp rx=0 tx=0).stop 2023-09-13T09:45:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.932+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 shutdown_connections 2023-09-13T09:45:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.933+0000 7fa644039700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6280a0640 0x7fa6280a2b00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.933+0000 7fa644039700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa63c106ba0 0x7fa63c19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.933+0000 7fa644039700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa63c101860 0x7fa63c196b80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.933+0000 7fa644039700 1 --2- 172.21.15.6:0/1865598726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa63c104190 0x7fa63c1970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.933+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 >> 172.21.15.6:0/1865598726 conn(0x7fa63c0fb250 msgr2=0x7fa63c1024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.933+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 shutdown_connections 2023-09-13T09:45:39.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:39.933+0000 7fa644039700 1 -- 172.21.15.6:0/1865598726 wait complete. 2023-09-13T09:45:39.957 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:45:39.958 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:45:40.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 -- 172.21.15.6:0/2354671744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc0ffc90 msgr2=0x7ff3bc1000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 --2- 172.21.15.6:0/2354671744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc1000b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac0099c0 tx=0x7ff3ac009cd0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 -- 172.21.15.6:0/2354671744 shutdown_connections 2023-09-13T09:45:40.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 --2- 172.21.15.6:0/2354671744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc101820 0x7ff3bc1080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 --2- 172.21.15.6:0/2354671744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc1000b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 --2- 172.21.15.6:0/2354671744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3bc100e80 0x7ff3bc1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 -- 172.21.15.6:0/2354671744 >> 172.21.15.6:0/2354671744 conn(0x7ff3bc0fb220 msgr2=0x7ff3bc0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 -- 172.21.15.6:0/2354671744 shutdown_connections 2023-09-13T09:45:40.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.090+0000 7ff3c100a700 1 -- 172.21.15.6:0/2354671744 wait complete. 2023-09-13T09:45:40.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 Processor -- start 2023-09-13T09:45:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 -- start start 2023-09-13T09:45:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3bc100e80 0x7ff3bc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc101820 0x7ff3bc19de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc19e5d0 con 0x7ff3bc101820 2023-09-13T09:45:40.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc19e740 con 0x7ff3bc100e80 2023-09-13T09:45:40.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3c100a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3bc19e900 con 0x7ff3bc0ffc90 2023-09-13T09:45:40.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3bad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3ba59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3bc100e80 0x7ff3bc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3bad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc068b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40638/0 (socket says 172.21.15.6:40638) 2023-09-13T09:45:40.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3bad9d700 1 -- 172.21.15.6:0/1072503903 learned_addr learned my addr 172.21.15.6:0/1072503903 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.091+0000 7ff3bb59e700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc101820 0x7ff3bc19de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3ba59c700 1 -- 172.21.15.6:0/1072503903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc0ffc90 msgr2=0x7ff3bc068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3ba59c700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3ba59c700 1 -- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc101820 msgr2=0x7ff3bc19de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3ba59c700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc101820 0x7ff3bc19de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3ba59c700 1 -- 172.21.15.6:0/1072503903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3ac0095f0 con 0x7ff3bc100e80 2023-09-13T09:45:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3bad9d700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3ba59c700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3bc100e80 0x7ff3bc19b7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000e9f0 tx=0x7ff3b000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3a3fff700 1 -- 172.21.15.6:0/1072503903 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b000c9c0 con 0x7ff3bc100e80 2023-09-13T09:45:40.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3bc19ebe0 con 0x7ff3bc100e80 2023-09-13T09:45:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3a3fff700 1 -- 172.21.15.6:0/1072503903 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3b0010430 con 0x7ff3bc100e80 2023-09-13T09:45:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3a3fff700 1 -- 172.21.15.6:0/1072503903 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3b0018680 con 0x7ff3bc100e80 2023-09-13T09:45:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.092+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3bc19f0f0 con 0x7ff3bc100e80 2023-09-13T09:45:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.093+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3bc106c10 con 0x7ff3bc100e80 2023-09-13T09:45:40.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.094+0000 7ff3a3fff700 1 -- 172.21.15.6:0/1072503903 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff3b0010860 con 0x7ff3bc100e80 2023-09-13T09:45:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.095+0000 7ff3a3fff700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3a40a06c0 0x7ff3a40a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.095+0000 7ff3a3fff700 1 -- 172.21.15.6:0/1072503903 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3b0014070 con 0x7ff3bc100e80 2023-09-13T09:45:40.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.095+0000 7ff3bad9d700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3a40a06c0 0x7ff3a40a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.095+0000 7ff3bad9d700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3a40a06c0 0x7ff3a40a2b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac004800 tx=0x7ff3ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.098+0000 7ff3a3fff700 1 -- 172.21.15.6:0/1072503903 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff3b00959f0 con 0x7ff3bc100e80 2023-09-13T09:45:40.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 194260 3.03 MB/sec execute 180 sec latency 15.084 ms 2023-09-13T09:45:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:40 smithi006 ceph-mon[98665]: pgmap v484: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 401 KiB/s wr, 38 op/s 2023-09-13T09:45:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:40 smithi131 ceph-mon[102785]: pgmap v484: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 401 KiB/s wr, 38 op/s 2023-09-13T09:45:40.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.354+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3bc02cfa0 con 0x7ff3bc100e80 2023-09-13T09:45:40.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.355+0000 7ff3a3fff700 1 -- 172.21.15.6:0/1072503903 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7ff3b0099010 con 0x7ff3bc100e80 2023-09-13T09:45:40.355 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:45:40.356 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:45:40.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3a40a06c0 msgr2=0x7ff3a40a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3a40a06c0 0x7ff3a40a2b80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7ff3ac004800 tx=0x7ff3ac01a040 comp rx=0 tx=0).stop 2023-09-13T09:45:40.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3bc100e80 msgr2=0x7ff3bc19b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3bc100e80 0x7ff3bc19b7a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff3b000e9f0 tx=0x7ff3b000ed00 comp rx=0 tx=0).stop 2023-09-13T09:45:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 shutdown_connections 2023-09-13T09:45:40.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3a40a06c0 0x7ff3a40a2b80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3bc101820 0x7ff3bc19de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3bc0ffc90 0x7ff3bc068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 --2- 172.21.15.6:0/1072503903 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3bc100e80 0x7ff3bc19b7a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.357+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 >> 172.21.15.6:0/1072503903 conn(0x7ff3bc0fb220 msgr2=0x7ff3bc0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.358+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 shutdown_connections 2023-09-13T09:45:40.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.358+0000 7ff3c100a700 1 -- 172.21.15.6:0/1072503903 wait complete. 2023-09-13T09:45:40.363 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:45:40.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:45:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 -- 172.21.15.6:0/3143818576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0101850 msgr2=0x7f50c0108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 --2- 172.21.15.6:0/3143818576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0101850 0x7f50c0108100 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f50b800b0d0 tx=0x7f50b800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 -- 172.21.15.6:0/3143818576 shutdown_connections 2023-09-13T09:45:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 --2- 172.21.15.6:0/3143818576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c0101850 0x7f50c0108100 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 --2- 172.21.15.6:0/3143818576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c00ffcc0 0x7f50c01000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 --2- 172.21.15.6:0/3143818576 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c0100eb0 0x7f50c0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 -- 172.21.15.6:0/3143818576 >> 172.21.15.6:0/3143818576 conn(0x7f50c00fb250 msgr2=0x7f50c00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 -- 172.21.15.6:0/3143818576 shutdown_connections 2023-09-13T09:45:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 -- 172.21.15.6:0/3143818576 wait complete. 2023-09-13T09:45:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.503+0000 7f50c6214700 1 Processor -- start 2023-09-13T09:45:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50c6214700 1 -- start start 2023-09-13T09:45:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50c6214700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c00ffcc0 0x7f50c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50c6214700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c0100eb0 0x7f50c019b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50c6214700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c0101850 0x7f50c019dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50c6214700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019e680 con 0x7f50c00ffcc0 2023-09-13T09:45:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50c6214700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019e7f0 con 0x7f50c0101850 2023-09-13T09:45:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50c6214700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c019e9b0 con 0x7f50c0100eb0 2023-09-13T09:45:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c00ffcc0 0x7f50c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c00ffcc0 0x7f50c0068b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37598/0 (socket says 172.21.15.6:37598) 2023-09-13T09:45:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 -- 172.21.15.6:0/2580928399 learned_addr learned my addr 172.21.15.6:0/2580928399 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bffff700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c0101850 0x7f50c019dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50beffd700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c0100eb0 0x7f50c019b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 -- 172.21.15.6:0/2580928399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c0100eb0 msgr2=0x7f50c019b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c0100eb0 0x7f50c019b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 -- 172.21.15.6:0/2580928399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c0101850 msgr2=0x7f50c019dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c0101850 0x7f50c019dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 -- 172.21.15.6:0/2580928399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b8009d00 con 0x7f50c00ffcc0 2023-09-13T09:45:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.504+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c00ffcc0 0x7f50c0068b80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f50a800e970 tx=0x7f50a800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.505+0000 7f50bcff9700 1 -- 172.21.15.6:0/2580928399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8009790 con 0x7f50c00ffcc0 2023-09-13T09:45:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.505+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c019ec90 con 0x7f50c00ffcc0 2023-09-13T09:45:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.505+0000 7f50bcff9700 1 -- 172.21.15.6:0/2580928399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50a800c7e0 con 0x7f50c00ffcc0 2023-09-13T09:45:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.505+0000 7f50bcff9700 1 -- 172.21.15.6:0/2580928399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a8003c70 con 0x7f50c00ffcc0 2023-09-13T09:45:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.505+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c019f1a0 con 0x7f50c00ffcc0 2023-09-13T09:45:40.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:40 smithi053 ceph-mon[102373]: pgmap v484: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 401 KiB/s wr, 38 op/s 2023-09-13T09:45:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.507+0000 7f50bcff9700 1 -- 172.21.15.6:0/2580928399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f50a800cc50 con 0x7f50c00ffcc0 2023-09-13T09:45:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.507+0000 7f50bcff9700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50ac0a0640 0x7f50ac0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.507+0000 7f50bcff9700 1 -- 172.21.15.6:0/2580928399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50a8014070 con 0x7f50c00ffcc0 2023-09-13T09:45:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.507+0000 7f50beffd700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50ac0a0640 0x7f50ac0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.508+0000 7f50beffd700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50ac0a0640 0x7f50ac0a2b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009c60 tx=0x7f50b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.508+0000 7f50d23f9b80 1 Processor -- start 2023-09-13T09:45:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.508+0000 7f50d23f9b80 1 -- start start 2023-09-13T09:45:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a33fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a340060 0x56100a33e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a33ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a297780 con 0x56100a33f700 2023-09-13T09:45:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a2950a0 con 0x56100a33ea00 2023-09-13T09:45:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a290990 con 0x56100a340060 2023-09-13T09:45:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a33fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a33fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37606/0 (socket says 172.21.15.6:37606) 2023-09-13T09:45:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 -- 172.21.15.6:0/4101572914 learned_addr learned my addr 172.21.15.6:0/4101572914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bffff700 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a33ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50beffd700 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a340060 0x56100a33e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 -- 172.21.15.6:0/4101572914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a340060 msgr2=0x56100a33e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a340060 0x56100a33e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 -- 172.21.15.6:0/4101572914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 msgr2=0x56100a33ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a33ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 -- 172.21.15.6:0/4101572914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56100a110630 con 0x56100a33f700 2023-09-13T09:45:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50beffd700 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a340060 0x56100a33e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:45:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bffff700 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a33ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a33fb20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f50a8095a50 tx=0x7f50a8098f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531f6436975c371d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50b5ffb700 1 -- 172.21.15.6:0/4101572914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a809d170 con 0x56100a33f700 2023-09-13T09:45:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50b5ffb700 1 -- 172.21.15.6:0/4101572914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50a8099550 con 0x56100a33f700 2023-09-13T09:45:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.509+0000 7f50b5ffb700 1 -- 172.21.15.6:0/4101572914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a80997b0 con 0x56100a33f700 2023-09-13T09:45:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 -- 172.21.15.6:0/4101572914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 msgr2=0x56100a33fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a33fb20 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f50a8095a50 tx=0x7f50a8098f30 comp rx=0 tx=0).stop 2023-09-13T09:45:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 -- 172.21.15.6:0/4101572914 shutdown_connections 2023-09-13T09:45:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a33ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a33fb20 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/4101572914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a340060 0x56100a33e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 -- 172.21.15.6:0/4101572914 >> 172.21.15.6:0/4101572914 conn(0x56100a29cc80 msgr2=0x56100a338f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 -- 172.21.15.6:0/4101572914 shutdown_connections 2023-09-13T09:45:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.510+0000 7f50d23f9b80 1 -- 172.21.15.6:0/4101572914 wait complete. 2023-09-13T09:45:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 -- start start 2023-09-13T09:45:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 Processor -- start 2023-09-13T09:45:40.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a347f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33f700 0x56100a348490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a340060 0x56100a34f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a22ebb0 con 0x56100a340060 2023-09-13T09:45:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a22e8b0 con 0x56100a33ea00 2023-09-13T09:45:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a112920 con 0x56100a33f700 2023-09-13T09:45:40.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50d23f9b80 10 client.0 _ll_register_callbacks cb 0x56100a22c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a340060 0x56100a34f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a340060 0x56100a34f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37616/0 (socket says 172.21.15.6:37616) 2023-09-13T09:45:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a347f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50bffff700 1 -- 172.21.15.6:0/310416045 learned_addr learned my addr 172.21.15.6:0/310416045 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.511+0000 7f50beffd700 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33f700 0x56100a348490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50bffff700 1 -- 172.21.15.6:0/310416045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33f700 msgr2=0x56100a348490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50bffff700 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33f700 0x56100a348490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50bffff700 1 -- 172.21.15.6:0/310416045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 msgr2=0x56100a347f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50bffff700 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a347f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50bffff700 1 -- 172.21.15.6:0/310416045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c019f1a0 con 0x56100a340060 2023-09-13T09:45:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50beffd700 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33f700 0x56100a348490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:45:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50bffff700 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a340060 0x56100a34f4d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f50b8008f80 tx=0x7f50b8008fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdda030370927971 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f509effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f509effd700 1 -- 172.21.15.6:0/310416045 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800e040 con 0x56100a340060 2023-09-13T09:45:40.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f509effd700 1 -- 172.21.15.6:0/310416045 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50b800bca0 con 0x56100a340060 2023-09-13T09:45:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56100a331670 con 0x56100a340060 2023-09-13T09:45:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f509effd700 1 -- 172.21.15.6:0/310416045 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b800be60 con 0x56100a340060 2023-09-13T09:45:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 10 client.17013 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56100a2a87a0 con 0x56100a340060 2023-09-13T09:45:40.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f509effd700 1 -- 172.21.15.6:0/310416045 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56100a331670 con 0x56100a340060 2023-09-13T09:45:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f509effd700 1 -- 172.21.15.6:0/310416045 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f50b800b100 con 0x56100a340060 2023-09-13T09:45:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 10 client.17013 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 10 client.17013 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:45:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 20 client.17013 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a353ce0 0x56100a356100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.512+0000 7f50d23f9b80 4 client.17013 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.513+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56100a289970 con 0x56100a353ce0 2023-09-13T09:45:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.513+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a353ce0 0x56100a356100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.513+0000 7f509effd700 10 client.17013 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.513+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a353ce0 0x56100a356100 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6da3c0887cdd39aa server_cookie=e7a61d3176f8848f in_seq=0 out_seq=0 2023-09-13T09:45:40.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f509effd700 1 -- 172.21.15.6:0/310416045 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56100a289970 con 0x56100a353ce0 2023-09-13T09:45:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f509effd700 10 client.17013 handle_command_reply: tid=0 2023-09-13T09:45:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 client.17013 shutdown 2023-09-13T09:45:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a340060 msgr2=0x56100a34f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a340060 0x56100a34f4d0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f50b8008f80 tx=0x7f50b8008fb0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 shutdown_connections 2023-09-13T09:45:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a353ce0 0x56100a356100 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a340060 0x56100a34f4d0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a33ea00 0x56100a347f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/310416045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33f700 0x56100a348490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f509effd700 0 client.17013 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 >> 172.21.15.6:0/310416045 conn(0x56100a29cc80 msgr2=0x56100a3337f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 shutdown_connections 2023-09-13T09:45:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 1 -- 172.21.15.6:0/310416045 wait complete. 2023-09-13T09:45:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.514+0000 7f50d23f9b80 20 client.17013 trim_cache size 0 max 16384 2023-09-13T09:45:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.527+0000 7f50d23f9b80 1 Processor -- start 2023-09-13T09:45:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.527+0000 7f50d23f9b80 1 -- start start 2023-09-13T09:45:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a33e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a3429c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a347af0 con 0x56100a33f700 2023-09-13T09:45:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a33afd0 con 0x56100a340060 2023-09-13T09:45:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a34f960 con 0x56100a33ea00 2023-09-13T09:45:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a3429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a3429c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59378/0 (socket says 172.21.15.6:59378) 2023-09-13T09:45:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 -- 172.21.15.6:0/905327489 learned_addr learned my addr 172.21.15.6:0/905327489 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a33e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 -- 172.21.15.6:0/905327489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 msgr2=0x56100a33e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a33e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 -- 172.21.15.6:0/905327489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 msgr2=0x56100a34f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 -- 172.21.15.6:0/905327489 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56100a0bcde0 con 0x56100a340060 2023-09-13T09:45:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50bffff700 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a3429c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007a30 tx=0x7f50b800b7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8401f5d2295dd7a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.528+0000 7f50b67fc700 1 -- 172.21.15.6:0/905327489 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b800e040 con 0x56100a340060 2023-09-13T09:45:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50b67fc700 1 -- 172.21.15.6:0/905327489 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50b802b030 con 0x56100a340060 2023-09-13T09:45:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50b67fc700 1 -- 172.21.15.6:0/905327489 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b8003c60 con 0x56100a340060 2023-09-13T09:45:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 -- 172.21.15.6:0/905327489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 msgr2=0x56100a3429c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a3429c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007a30 tx=0x7f50b800b7b0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 -- 172.21.15.6:0/905327489 shutdown_connections 2023-09-13T09:45:40.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a3429c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a33e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/905327489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 -- 172.21.15.6:0/905327489 >> 172.21.15.6:0/905327489 conn(0x56100a29cc80 msgr2=0x56100a346bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 -- 172.21.15.6:0/905327489 shutdown_connections 2023-09-13T09:45:40.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 -- 172.21.15.6:0/905327489 wait complete. 2023-09-13T09:45:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.529+0000 7f50d23f9b80 1 -- start start 2023-09-13T09:45:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 1 Processor -- start 2023-09-13T09:45:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a34b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a34e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a34ee30 con 0x56100a33f700 2023-09-13T09:45:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a34efa0 con 0x56100a340060 2023-09-13T09:45:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56100a34f160 con 0x56100a33ea00 2023-09-13T09:45:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50d23f9b80 10 client.0 _ll_register_callbacks cb 0x56100a22c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a34b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37628/0 (socket says 172.21.15.6:37628) 2023-09-13T09:45:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50bf7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a34b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40680/0 (socket says 172.21.15.6:40680) 2023-09-13T09:45:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50beffd700 1 -- 172.21.15.6:0/3091068410 learned_addr learned my addr 172.21.15.6:0/3091068410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50bffff700 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a34e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.530+0000 7f50beffd700 1 -- 172.21.15.6:0/3091068410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 msgr2=0x56100a34b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50beffd700 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a34b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50beffd700 1 -- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 msgr2=0x56100a34e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50beffd700 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a34e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50beffd700 1 -- 172.21.15.6:0/3091068410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56100a2a87a0 con 0x56100a33f700 2023-09-13T09:45:40.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a34b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50beffd700 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34b8d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f50b0003900 tx=0x7f50b00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ef4084a52c8e670 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f509effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f509effd700 1 -- 172.21.15.6:0/3091068410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0023070 con 0x56100a33f700 2023-09-13T09:45:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f509effd700 1 -- 172.21.15.6:0/3091068410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50b001d620 con 0x56100a33f700 2023-09-13T09:45:40.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50a8099550 con 0x56100a33f700 2023-09-13T09:45:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f509effd700 1 -- 172.21.15.6:0/3091068410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b001d7e0 con 0x56100a33f700 2023-09-13T09:45:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50d23f9b80 10 client.17019 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56100a0a5c60 con 0x56100a33f700 2023-09-13T09:45:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f509effd700 1 -- 172.21.15.6:0/3091068410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50a8099550 con 0x56100a33f700 2023-09-13T09:45:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f509effd700 1 -- 172.21.15.6:0/3091068410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f50b0032a30 con 0x56100a33f700 2023-09-13T09:45:40.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50d23f9b80 10 client.17019 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50d23f9b80 10 client.17019 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:45:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.531+0000 7f50d23f9b80 20 client.17019 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.532+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a3a8da0 0x56100a3ab1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.532+0000 7f50d23f9b80 4 client.17019 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:40.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.532+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56100a24a050 con 0x56100a3a8da0 2023-09-13T09:45:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.532+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a3a8da0 0x56100a3ab1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.532+0000 7f509effd700 10 client.17019 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.532+0000 7f50bf7fe700 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a3a8da0 0x56100a3ab1c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=830321c8f933f108 server_cookie=e8c9b5d0025bbf0b in_seq=0 out_seq=0 2023-09-13T09:45:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f509effd700 1 -- 172.21.15.6:0/3091068410 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56100a24a050 con 0x56100a3a8da0 2023-09-13T09:45:40.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f509effd700 10 client.17019 handle_command_reply: tid=0 2023-09-13T09:45:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 client.17019 shutdown 2023-09-13T09:45:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 msgr2=0x56100a34b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34b8d0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f50b0003900 tx=0x7f50b00047c0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 shutdown_connections 2023-09-13T09:45:40.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56100a3a8da0 0x56100a3ab1c0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56100a340060 0x56100a34e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f509effd700 0 client.17019 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:45:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56100a33ea00 0x56100a34b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 --2- 172.21.15.6:0/3091068410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56100a33f700 0x56100a34b8d0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 >> 172.21.15.6:0/3091068410 conn(0x56100a29cc80 msgr2=0x56100a3429c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.533+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 shutdown_connections 2023-09-13T09:45:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50d23f9b80 1 -- 172.21.15.6:0/3091068410 wait complete. 2023-09-13T09:45:40.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50d23f9b80 20 client.17019 trim_cache size 0 max 16384 2023-09-13T09:45:40.558 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50ac0a0640 msgr2=0x7f50ac0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50ac0a0640 0x7f50ac0a2b00 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f50b0009c60 tx=0x7f50b0009260 comp rx=0 tx=0).stop 2023-09-13T09:45:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c00ffcc0 msgr2=0x7f50c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c00ffcc0 0x7f50c0068b80 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f50a800e970 tx=0x7f50a800ec80 comp rx=0 tx=0).stop 2023-09-13T09:45:40.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 shutdown_connections 2023-09-13T09:45:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50c0101850 0x7f50c019dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50ac0a0640 0x7f50ac0a2b00 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50c00ffcc0 0x7f50c0068b80 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 --2- 172.21.15.6:0/2580928399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50c0100eb0 0x7f50c019b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 >> 172.21.15.6:0/2580928399 conn(0x7f50c00fb250 msgr2=0x7f50c00fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 shutdown_connections 2023-09-13T09:45:40.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.534+0000 7f50c6214700 1 -- 172.21.15.6:0/2580928399 wait complete. 2023-09-13T09:45:40.562 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:45:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 -- 172.21.15.6:0/1941123608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e0106b00 msgr2=0x7fe4e0108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 --2- 172.21.15.6:0/1941123608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e0106b00 0x7fe4e0108f10 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fe4d800b0a0 tx=0x7fe4d800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 -- 172.21.15.6:0/1941123608 shutdown_connections 2023-09-13T09:45:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 --2- 172.21.15.6:0/1941123608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e0106b00 0x7fe4e0108f10 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 --2- 172.21.15.6:0/1941123608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01018a0 0x7fe4e0103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 --2- 172.21.15.6:0/1941123608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e01041d0 0x7fe4e01065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 -- 172.21.15.6:0/1941123608 >> 172.21.15.6:0/1941123608 conn(0x7fe4e00fb250 msgr2=0x7fe4e00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 -- 172.21.15.6:0/1941123608 shutdown_connections 2023-09-13T09:45:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.695+0000 7fe4e5916700 1 -- 172.21.15.6:0/1941123608 wait complete. 2023-09-13T09:45:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 Processor -- start 2023-09-13T09:45:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 -- start start 2023-09-13T09:45:40.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01018a0 0x7fe4e0196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e01041d0 0x7fe4e01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e0106b00 0x7fe4e019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e019e720 con 0x7fe4e01041d0 2023-09-13T09:45:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e019e860 con 0x7fe4e01018a0 2023-09-13T09:45:40.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4e5916700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e019e9f0 con 0x7fe4e0106b00 2023-09-13T09:45:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e01041d0 0x7fe4e01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e01041d0 0x7fe4e01970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37642/0 (socket says 172.21.15.6:37642) 2023-09-13T09:45:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 -- 172.21.15.6:0/4244306897 learned_addr learned my addr 172.21.15.6:0/4244306897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4deffd700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01018a0 0x7fe4e0196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4df7fe700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e0106b00 0x7fe4e019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 -- 172.21.15.6:0/4244306897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e0106b00 msgr2=0x7fe4e019e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e0106b00 0x7fe4e019e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 -- 172.21.15.6:0/4244306897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01018a0 msgr2=0x7fe4e0196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01018a0 0x7fe4e0196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.696+0000 7fe4de7fc700 1 -- 172.21.15.6:0/4244306897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d0009520 con 0x7fe4e01041d0 2023-09-13T09:45:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.697+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e01041d0 0x7fe4e01970e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9a0 tx=0x7fe4c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.697+0000 7fe4e4914700 1 -- 172.21.15.6:0/4244306897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8009790 con 0x7fe4e01041d0 2023-09-13T09:45:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.697+0000 7fe4e4914700 1 -- 172.21.15.6:0/4244306897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4c800cbd0 con 0x7fe4e01041d0 2023-09-13T09:45:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.697+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4d8009d00 con 0x7fe4e01041d0 2023-09-13T09:45:40.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.697+0000 7fe4e4914700 1 -- 172.21.15.6:0/4244306897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8018680 con 0x7fe4e01041d0 2023-09-13T09:45:40.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.697+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e019f050 con 0x7fe4e01041d0 2023-09-13T09:45:40.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.699+0000 7fe4e4914700 1 -- 172.21.15.6:0/4244306897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe4c800cd40 con 0x7fe4e01041d0 2023-09-13T09:45:40.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.699+0000 7fe4e4914700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4cc0a0640 0x7fe4cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.700+0000 7fe4e4914700 1 -- 172.21.15.6:0/4244306897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe4c8014070 con 0x7fe4e01041d0 2023-09-13T09:45:40.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.700+0000 7fe4deffd700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4cc0a0640 0x7fe4cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.700+0000 7fe4deffd700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4cc0a0640 0x7fe4cc0a2b00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009df0 tx=0x7fe4d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.700+0000 7fe4f1afbb80 1 Processor -- start 2023-09-13T09:45:40.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.700+0000 7fe4f1afbb80 1 -- start start 2023-09-13T09:45:40.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d21b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d22060 0x562f02d204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d20a00 0x562f02d20e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02c79780 con 0x562f02d21700 2023-09-13T09:45:40.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02c770a0 con 0x562f02d22060 2023-09-13T09:45:40.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02c72990 con 0x562f02d20a00 2023-09-13T09:45:40.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d21b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d21b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37648/0 (socket says 172.21.15.6:37648) 2023-09-13T09:45:40.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 -- 172.21.15.6:0/203542760 learned_addr learned my addr 172.21.15.6:0/203542760 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4df7fe700 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d20a00 0x562f02d20e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d22060 0x562f02d204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 -- 172.21.15.6:0/203542760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d20a00 msgr2=0x562f02d20e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d20a00 0x562f02d20e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 -- 172.21.15.6:0/203542760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d22060 msgr2=0x562f02d204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d22060 0x562f02d204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 -- 172.21.15.6:0/203542760 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f02af2630 con 0x562f02d21700 2023-09-13T09:45:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4deffd700 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d21b20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00094f0 tx=0x7fe4d0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90726de04f89756 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.701+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/203542760 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0026630 con 0x562f02d21700 2023-09-13T09:45:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/203542760 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4d0021070 con 0x562f02d21700 2023-09-13T09:45:40.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4d5ffb700 1 -- 172.21.15.6:0/203542760 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d001d720 con 0x562f02d21700 2023-09-13T09:45:40.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/203542760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 msgr2=0x562f02d21b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d21b20 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fe4d00094f0 tx=0x7fe4d0014000 comp rx=0 tx=0).stop 2023-09-13T09:45:40.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/203542760 shutdown_connections 2023-09-13T09:45:40.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d20a00 0x562f02d20e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d21b20 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/203542760 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d22060 0x562f02d204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/203542760 >> 172.21.15.6:0/203542760 conn(0x562f02c7ec80 msgr2=0x562f02d1af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/203542760 shutdown_connections 2023-09-13T09:45:40.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.702+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/203542760 wait complete. 2023-09-13T09:45:40.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 -- start start 2023-09-13T09:45:40.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 Processor -- start 2023-09-13T09:45:40.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d29f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d2a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d314e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02c10bb0 con 0x562f02d21700 2023-09-13T09:45:40.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02c108b0 con 0x562f02d20a00 2023-09-13T09:45:40.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02af4920 con 0x562f02d22060 2023-09-13T09:45:40.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4f1afbb80 10 client.0 _ll_register_callbacks cb 0x562f02c0e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:40.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d2a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d2a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37656/0 (socket says 172.21.15.6:37656) 2023-09-13T09:45:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4deffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d29f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4de7fc700 1 -- 172.21.15.6:0/368920106 learned_addr learned my addr 172.21.15.6:0/368920106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.703+0000 7fe4df7fe700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d314e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4de7fc700 1 -- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 msgr2=0x562f02d314e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d314e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4de7fc700 1 -- 172.21.15.6:0/368920106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 msgr2=0x562f02d29f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d29f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4de7fc700 1 -- 172.21.15.6:0/368920106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4d0017070 con 0x562f02d21700 2023-09-13T09:45:40.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4df7fe700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d314e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:40.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4deffd700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d29f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:40.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d2a4a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80c9c00 tx=0x7fe4c8099ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0358f96582c55a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4beffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:40.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4beffd700 1 -- 172.21.15.6:0/368920106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c809d3b0 con 0x562f02d21700 2023-09-13T09:45:40.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4beffd700 1 -- 172.21.15.6:0/368920106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe4c8095040 con 0x562f02d21700 2023-09-13T09:45:40.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f02d13670 con 0x562f02d21700 2023-09-13T09:45:40.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4beffd700 1 -- 172.21.15.6:0/368920106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4c80a15f0 con 0x562f02d21700 2023-09-13T09:45:40.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4f1afbb80 10 client.17031 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:40.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562f02c8a7a0 con 0x562f02d21700 2023-09-13T09:45:40.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.704+0000 7fe4beffd700 1 -- 172.21.15.6:0/368920106 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562f02d13670 con 0x562f02d21700 2023-09-13T09:45:40.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4beffd700 1 -- 172.21.15.6:0/368920106 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe4c8065130 con 0x562f02d21700 2023-09-13T09:45:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4f1afbb80 10 client.17031 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4f1afbb80 10 client.17031 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:45:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4f1afbb80 20 client.17031 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d35cd0 0x562f02d380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4f1afbb80 4 client.17031 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f02c6b970 con 0x562f02d35cd0 2023-09-13T09:45:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4deffd700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d35cd0 0x562f02d380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4beffd700 10 client.17031 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.705+0000 7fe4deffd700 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d35cd0 0x562f02d380f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=630f27dd63c94abc server_cookie=9139fe6d27f7b304 in_seq=0 out_seq=0 2023-09-13T09:45:40.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4beffd700 1 -- 172.21.15.6:0/368920106 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f02c6b970 con 0x562f02d35cd0 2023-09-13T09:45:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4beffd700 10 client.17031 handle_command_reply: tid=0 2023-09-13T09:45:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 client.17031 shutdown 2023-09-13T09:45:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 msgr2=0x562f02d2a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d2a4a0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80c9c00 tx=0x7fe4c8099ac0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 shutdown_connections 2023-09-13T09:45:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d35cd0 0x562f02d380f0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d314e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d29f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/368920106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d2a4a0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4beffd700 0 client.17031 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 >> 172.21.15.6:0/368920106 conn(0x562f02c7ec80 msgr2=0x562f02d157f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 shutdown_connections 2023-09-13T09:45:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/368920106 wait complete. 2023-09-13T09:45:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.706+0000 7fe4f1afbb80 20 client.17031 trim_cache size 0 max 16384 2023-09-13T09:45:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 Processor -- start 2023-09-13T09:45:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 -- start start 2023-09-13T09:45:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d314a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d24940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02d357f0 con 0x562f02d21700 2023-09-13T09:45:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02d1b9e0 con 0x562f02d20a00 2023-09-13T09:45:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02d178e0 con 0x562f02d22060 2023-09-13T09:45:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d314a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d314a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37662/0 (socket says 172.21.15.6:37662) 2023-09-13T09:45:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 -- 172.21.15.6:0/2248727135 learned_addr learned my addr 172.21.15.6:0/2248727135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4deffd700 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4df7fe700 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d24940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 -- 172.21.15.6:0/2248727135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 msgr2=0x562f02d24940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d24940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 -- 172.21.15.6:0/2248727135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 msgr2=0x562f02d204c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d204c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 -- 172.21.15.6:0/2248727135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f02a9ede0 con 0x562f02d21700 2023-09-13T09:45:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.720+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d314a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80994c0 tx=0x7fe4c8098dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd0da7294280b65 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4d67fc700 1 -- 172.21.15.6:0/2248727135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c809d3b0 con 0x562f02d21700 2023-09-13T09:45:40.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4d67fc700 1 -- 172.21.15.6:0/2248727135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4c80a15f0 con 0x562f02d21700 2023-09-13T09:45:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4d67fc700 1 -- 172.21.15.6:0/2248727135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c80b75a0 con 0x562f02d21700 2023-09-13T09:45:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/2248727135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 msgr2=0x562f02d314a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d314a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fe4c80994c0 tx=0x7fe4c8098dd0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/2248727135 shutdown_connections 2023-09-13T09:45:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d24940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d20a00 0x562f02d204c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/2248727135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d21700 0x562f02d314a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/2248727135 >> 172.21.15.6:0/2248727135 conn(0x562f02c7ec80 msgr2=0x562f02d28be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/2248727135 shutdown_connections 2023-09-13T09:45:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.721+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/2248727135 wait complete. 2023-09-13T09:45:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 -- start start 2023-09-13T09:45:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 Processor -- start 2023-09-13T09:45:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d20a00 0x562f02d2d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d21700 0x562f02d2d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d30670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02d30bb0 con 0x562f02d20a00 2023-09-13T09:45:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02d30d20 con 0x562f02d21700 2023-09-13T09:45:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f02d30ee0 con 0x562f02d22060 2023-09-13T09:45:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d20a00 0x562f02d2d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4f1afbb80 10 client.0 _ll_register_callbacks cb 0x562f02c0e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4de7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d21700 0x562f02d2d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d20a00 0x562f02d2d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37668/0 (socket says 172.21.15.6:37668) 2023-09-13T09:45:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4deffd700 1 -- 172.21.15.6:0/1700623384 learned_addr learned my addr 172.21.15.6:0/1700623384 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.722+0000 7fe4df7fe700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d30670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4deffd700 1 -- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 msgr2=0x562f02d30670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4deffd700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d30670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4deffd700 1 -- 172.21.15.6:0/1700623384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d21700 msgr2=0x562f02d2d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4deffd700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d21700 0x562f02d2d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4deffd700 1 -- 172.21.15.6:0/1700623384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f02c8a7a0 con 0x562f02d20a00 2023-09-13T09:45:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4df7fe700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d30670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d21700 0x562f02d2d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4deffd700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d20a00 0x562f02d2d110 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000ecb0 tx=0x7fe4d0011ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ba5a1f0dfd9b94 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4beffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4beffd700 1 -- 172.21.15.6:0/1700623384 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0033a90 con 0x562f02d20a00 2023-09-13T09:45:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4beffd700 1 -- 172.21.15.6:0/1700623384 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe4d0033bf0 con 0x562f02d20a00 2023-09-13T09:45:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe4d0021070 con 0x562f02d20a00 2023-09-13T09:45:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4beffd700 1 -- 172.21.15.6:0/1700623384 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe4d0033db0 con 0x562f02d20a00 2023-09-13T09:45:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4f1afbb80 10 client.17037 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562f02a87c60 con 0x562f02d20a00 2023-09-13T09:45:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4beffd700 1 -- 172.21.15.6:0/1700623384 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4d0042080 con 0x562f02d20a00 2023-09-13T09:45:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.723+0000 7fe4beffd700 1 -- 172.21.15.6:0/1700623384 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe4d001c590 con 0x562f02d20a00 2023-09-13T09:45:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 10 client.17037 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 10 client.17037 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:45:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 20 client.17037 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d8a960 0x562f02d8cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 4 client.17037 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562f02c2c050 con 0x562f02d8a960 2023-09-13T09:45:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d8a960 0x562f02d8cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4beffd700 10 client.17037 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4de7fc700 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d8a960 0x562f02d8cd80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d2b0f74c75b70a38 server_cookie=d143a7311c1fce4e in_seq=0 out_seq=0 2023-09-13T09:45:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4beffd700 1 -- 172.21.15.6:0/1700623384 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562f02c2c050 con 0x562f02d8a960 2023-09-13T09:45:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4beffd700 10 client.17037 handle_command_reply: tid=0 2023-09-13T09:45:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 client.17037 shutdown 2023-09-13T09:45:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d20a00 msgr2=0x562f02d2d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d20a00 0x562f02d2d110 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000ecb0 tx=0x7fe4d0011ae0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 shutdown_connections 2023-09-13T09:45:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562f02d8a960 0x562f02d8cd80 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f02d22060 0x562f02d30670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4beffd700 0 client.17037 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:45:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f02d20a00 0x562f02d2d110 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 --2- 172.21.15.6:0/1700623384 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f02d21700 0x562f02d2d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.724+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 >> 172.21.15.6:0/1700623384 conn(0x562f02c7ec80 msgr2=0x562f02d24940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 shutdown_connections 2023-09-13T09:45:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4f1afbb80 1 -- 172.21.15.6:0/1700623384 wait complete. 2023-09-13T09:45:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4f1afbb80 20 client.17037 trim_cache size 0 max 16384 2023-09-13T09:45:40.751 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4cc0a0640 msgr2=0x7fe4cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4cc0a0640 0x7fe4cc0a2b00 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe4d0009df0 tx=0x7fe4d0009260 comp rx=0 tx=0).stop 2023-09-13T09:45:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e01041d0 msgr2=0x7fe4e01970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e01041d0 0x7fe4e01970e0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fe4c800e9a0 tx=0x7fe4c800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 shutdown_connections 2023-09-13T09:45:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e0106b00 0x7fe4e019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe4e01018a0 0x7fe4e0196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4cc0a0640 0x7fe4cc0a2b00 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 --2- 172.21.15.6:0/4244306897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4e01041d0 0x7fe4e01970e0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 >> 172.21.15.6:0/4244306897 conn(0x7fe4e00fb250 msgr2=0x7fe4e0102510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 shutdown_connections 2023-09-13T09:45:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.725+0000 7fe4e5916700 1 -- 172.21.15.6:0/4244306897 wait complete. 2023-09-13T09:45:40.755 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:45:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 -- 172.21.15.6:0/3006598982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 msgr2=0x7f37a4102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3006598982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4102410 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3798009920 tx=0x7f3798009c30 comp rx=0 tx=0).stop 2023-09-13T09:45:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 -- 172.21.15.6:0/3006598982 shutdown_connections 2023-09-13T09:45:40.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3006598982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a4102950 0x7f37a4109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3006598982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a4100dc0 0x7f37a41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3006598982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4102410 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 -- 172.21.15.6:0/3006598982 >> 172.21.15.6:0/3006598982 conn(0x7f37a40fc330 msgr2=0x7f37a40fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 -- 172.21.15.6:0/3006598982 shutdown_connections 2023-09-13T09:45:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.889+0000 7f37aa67d700 1 -- 172.21.15.6:0/3006598982 wait complete. 2023-09-13T09:45:40.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 Processor -- start 2023-09-13T09:45:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 -- start start 2023-09-13T09:45:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a4100dc0 0x7f37a4196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a4102950 0x7f37a419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a419e6c0 con 0x7f37a4102950 2023-09-13T09:45:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a419e800 con 0x7f37a4101fb0 2023-09-13T09:45:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37aa67d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a419e990 con 0x7f37a4100dc0 2023-09-13T09:45:40.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37a8c1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a4102950 0x7f37a419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a4100dc0 0x7f37a4196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59440/0 (socket says 172.21.15.6:59440) 2023-09-13T09:45:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.890+0000 7f37a37fe700 1 -- 172.21.15.6:0/3249970493 learned_addr learned my addr 172.21.15.6:0/3249970493 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a37fe700 1 -- 172.21.15.6:0/3249970493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a4100dc0 msgr2=0x7f37a4196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a37fe700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a4100dc0 0x7f37a4196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a37fe700 1 -- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a4102950 msgr2=0x7f37a419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a37fe700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a4102950 0x7f37a419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a37fe700 1 -- 172.21.15.6:0/3249970493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37940095f0 con 0x7f37a4101fb0 2023-09-13T09:45:40.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a8c1a700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a4102950 0x7f37a419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a37fe700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4197080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3798009230 tx=0x7f379800b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a17fa700 1 -- 172.21.15.6:0/3249970493 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379801c070 con 0x7f37a4101fb0 2023-09-13T09:45:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3798009520 con 0x7f37a4101fb0 2023-09-13T09:45:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a17fa700 1 -- 172.21.15.6:0/3249970493 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f379800f7d0 con 0x7f37a4101fb0 2023-09-13T09:45:40.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37a17fa700 1 -- 172.21.15.6:0/3249970493 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798003ae0 con 0x7f37a4101fb0 2023-09-13T09:45:40.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.891+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a419ef00 con 0x7f37a4101fb0 2023-09-13T09:45:40.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.893+0000 7f37a17fa700 1 -- 172.21.15.6:0/3249970493 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3798020030 con 0x7f37a4101fb0 2023-09-13T09:45:40.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.894+0000 7f37a17fa700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f378c0a06c0 0x7f378c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.894+0000 7f37a3fff700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f378c0a06c0 0x7f378c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.894+0000 7f37a17fa700 1 -- 172.21.15.6:0/3249970493 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f37980ccb80 con 0x7f37a4101fb0 2023-09-13T09:45:40.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37a3fff700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f378c0a06c0 0x7f378c0a2b80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f37a4101e10 tx=0x7f3794009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 Processor -- start 2023-09-13T09:45:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 -- start start 2023-09-13T09:45:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b92eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92f060 0x562c4b92d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92da00 0x562c4b92de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b886780 con 0x562c4b92da00 2023-09-13T09:45:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b8840a0 con 0x562c4b92f060 2023-09-13T09:45:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37b6862b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b87f990 con 0x562c4b92e700 2023-09-13T09:45:40.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37a8c1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92da00 0x562c4b92de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b92eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37a8c1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92da00 0x562c4b92de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37692/0 (socket says 172.21.15.6:37692) 2023-09-13T09:45:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37a8c1a700 1 -- 172.21.15.6:0/1617044063 learned_addr learned my addr 172.21.15.6:0/1617044063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.895+0000 7f37a37fe700 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92f060 0x562c4b92d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f37a3fff700 1 -- 172.21.15.6:0/1617044063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92f060 msgr2=0x562c4b92d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f37a3fff700 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92f060 0x562c4b92d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f37a3fff700 1 -- 172.21.15.6:0/1617044063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92da00 msgr2=0x562c4b92de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f37a3fff700 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92da00 0x562c4b92de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f37a3fff700 1 -- 172.21.15.6:0/1617044063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c4b6ff630 con 0x562c4b92e700 2023-09-13T09:45:40.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f37a3fff700 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b92eb20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f379400e5c0 tx=0x7f3794014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=413c74e0cb49f3e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f378a7fc700 1 -- 172.21.15.6:0/1617044063 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3794026630 con 0x562c4b92e700 2023-09-13T09:45:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f378a7fc700 1 -- 172.21.15.6:0/1617044063 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3794021070 con 0x562c4b92e700 2023-09-13T09:45:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.896+0000 7f378a7fc700 1 -- 172.21.15.6:0/1617044063 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379401d670 con 0x562c4b92e700 2023-09-13T09:45:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 -- 172.21.15.6:0/1617044063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 msgr2=0x562c4b92eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b92eb20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f379400e5c0 tx=0x7f3794014000 comp rx=0 tx=0).stop 2023-09-13T09:45:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 -- 172.21.15.6:0/1617044063 shutdown_connections 2023-09-13T09:45:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92da00 0x562c4b92de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b92eb20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1617044063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92f060 0x562c4b92d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 -- 172.21.15.6:0/1617044063 >> 172.21.15.6:0/1617044063 conn(0x562c4b88bc80 msgr2=0x562c4b927f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 -- 172.21.15.6:0/1617044063 shutdown_connections 2023-09-13T09:45:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 -- 172.21.15.6:0/1617044063 wait complete. 2023-09-13T09:45:40.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.897+0000 7f37b6862b80 1 -- start start 2023-09-13T09:45:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 1 Processor -- start 2023-09-13T09:45:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b936f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b937440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b81dbb0 con 0x562c4b92e700 2023-09-13T09:45:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b81d8b0 con 0x562c4b92da00 2023-09-13T09:45:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b701920 con 0x562c4b92f060 2023-09-13T09:45:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37b6862b80 10 client.0 _ll_register_callbacks cb 0x562c4b81b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b937440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b937440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37698/0 (socket says 172.21.15.6:37698) 2023-09-13T09:45:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 -- 172.21.15.6:0/2013144285 learned_addr learned my addr 172.21.15.6:0/2013144285 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a3fff700 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b936f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a8c1a700 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 -- 172.21.15.6:0/2013144285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 msgr2=0x562c4b93e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 -- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 msgr2=0x562c4b936f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b936f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 -- 172.21.15.6:0/2013144285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3794017070 con 0x562c4b92e700 2023-09-13T09:45:40.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37a37fe700 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b937440 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f379800f9a0 tx=0x7f379800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f83a97cdbcb4d4b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.898+0000 7f37837fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37837fe700 1 -- 172.21.15.6:0/2013144285 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379809a350 con 0x562c4b92e700 2023-09-13T09:45:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37837fe700 1 -- 172.21.15.6:0/2013144285 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f379809e180 con 0x562c4b92e700 2023-09-13T09:45:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c4b920670 con 0x562c4b92e700 2023-09-13T09:45:40.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37837fe700 1 -- 172.21.15.6:0/2013144285 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37980a2330 con 0x562c4b92e700 2023-09-13T09:45:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 10 client.17049 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562c4b8977a0 con 0x562c4b92e700 2023-09-13T09:45:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37837fe700 1 -- 172.21.15.6:0/2013144285 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562c4b920670 con 0x562c4b92e700 2023-09-13T09:45:40.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37837fe700 1 -- 172.21.15.6:0/2013144285 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f37980b8130 con 0x562c4b92e700 2023-09-13T09:45:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 10 client.17049 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 10 client.17049 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:45:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 20 client.17049 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b9426d0 0x562c4b944af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 4 client.17049 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:40.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c4b878970 con 0x562c4b9426d0 2023-09-13T09:45:40.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.899+0000 7f37a3fff700 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b9426d0 0x562c4b944af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.900+0000 7f37a3fff700 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b9426d0 0x562c4b944af0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45be9dbcb3d3212 server_cookie=b8e758d4555735c8 in_seq=0 out_seq=0 2023-09-13T09:45:40.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.900+0000 7f37837fe700 10 client.17049 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:40.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.900+0000 7f37837fe700 1 -- 172.21.15.6:0/2013144285 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562c4b878970 con 0x562c4b9426d0 2023-09-13T09:45:40.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.900+0000 7f37837fe700 10 client.17049 handle_command_reply: tid=0 2023-09-13T09:45:40.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 client.17049 shutdown 2023-09-13T09:45:40.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 msgr2=0x562c4b937440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b937440 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f379800f9a0 tx=0x7f379800bc40 comp rx=0 tx=0).stop 2023-09-13T09:45:40.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 shutdown_connections 2023-09-13T09:45:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b9426d0 0x562c4b944af0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37837fe700 0 client.17049 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b936f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2013144285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b937440 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 >> 172.21.15.6:0/2013144285 conn(0x562c4b88bc80 msgr2=0x562c4b9227f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 shutdown_connections 2023-09-13T09:45:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 1 -- 172.21.15.6:0/2013144285 wait complete. 2023-09-13T09:45:40.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.901+0000 7f37b6862b80 20 client.17049 trim_cache size 0 max 16384 2023-09-13T09:45:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 Processor -- start 2023-09-13T09:45:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 -- start start 2023-09-13T09:45:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b92d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b93e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92f060 0x562c4b93ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b878970 con 0x562c4b92f060 2023-09-13T09:45:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b9363b0 con 0x562c4b92da00 2023-09-13T09:45:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37b6862b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b920680 con 0x562c4b92e700 2023-09-13T09:45:40.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92f060 0x562c4b93ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92f060 0x562c4b93ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37708/0 (socket says 172.21.15.6:37708) 2023-09-13T09:45:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 -- 172.21.15.6:0/1628726684 learned_addr learned my addr 172.21.15.6:0/1628726684 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a3fff700 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b92d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a37fe700 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b93e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 -- 172.21.15.6:0/1628726684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 msgr2=0x562c4b93e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b93e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 -- 172.21.15.6:0/1628726684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 msgr2=0x562c4b92d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b92d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 -- 172.21.15.6:0/1628726684 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c4b6abde0 con 0x562c4b92f060 2023-09-13T09:45:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a37fe700 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b93e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:40.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.915+0000 7f37a8c1a700 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92f060 0x562c4b93ed70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f379c003e60 tx=0x7f379c003e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0cfb622a641b426 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f378affd700 1 -- 172.21.15.6:0/1628726684 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c007500 con 0x562c4b92f060 2023-09-13T09:45:40.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f378affd700 1 -- 172.21.15.6:0/1628726684 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f379c00f040 con 0x562c4b92f060 2023-09-13T09:45:40.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f378affd700 1 -- 172.21.15.6:0/1628726684 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c017920 con 0x562c4b92f060 2023-09-13T09:45:40.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 -- 172.21.15.6:0/1628726684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92f060 msgr2=0x562c4b93ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92f060 0x562c4b93ed70 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f379c003e60 tx=0x7f379c003e90 comp rx=0 tx=0).stop 2023-09-13T09:45:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 -- 172.21.15.6:0/1628726684 shutdown_connections 2023-09-13T09:45:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92f060 0x562c4b93ed70 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b92d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 --2- 172.21.15.6:0/1628726684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92e700 0x562c4b93e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 -- 172.21.15.6:0/1628726684 >> 172.21.15.6:0/1628726684 conn(0x562c4b88bc80 msgr2=0x562c4b935be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 -- 172.21.15.6:0/1628726684 shutdown_connections 2023-09-13T09:45:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.916+0000 7f37b6862b80 1 -- 172.21.15.6:0/1628726684 wait complete. 2023-09-13T09:45:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 -- start start 2023-09-13T09:45:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 Processor -- start 2023-09-13T09:45:40.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b93dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b93aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b93e810 con 0x562c4b92e700 2023-09-13T09:45:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b93b510 con 0x562c4b92da00 2023-09-13T09:45:40.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c4b93b6d0 con 0x562c4b92f060 2023-09-13T09:45:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37b6862b80 10 client.0 _ll_register_callbacks cb 0x562c4b81b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b93aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37a37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b93aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37712/0 (socket says 172.21.15.6:37712) 2023-09-13T09:45:40.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37a37fe700 1 -- 172.21.15.6:0/2835231240 learned_addr learned my addr 172.21.15.6:0/2835231240 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37a3fff700 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b93dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.917+0000 7f37a8c1a700 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37a37fe700 1 -- 172.21.15.6:0/2835231240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 msgr2=0x562c4b93afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37a37fe700 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37a37fe700 1 -- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 msgr2=0x562c4b93dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:40.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37a37fe700 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b93dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37a37fe700 1 -- 172.21.15.6:0/2835231240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c003b40 con 0x562c4b92e700 2023-09-13T09:45:40.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37a37fe700 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b93aa90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3798005e90 tx=0x7f37980967c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b95a05d2a51a87b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:40.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37837fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:40.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37837fe700 1 -- 172.21.15.6:0/2835231240 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798021580 con 0x562c4b92e700 2023-09-13T09:45:40.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37837fe700 1 -- 172.21.15.6:0/2835231240 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f37980a0250 con 0x562c4b92e700 2023-09-13T09:45:40.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3794021070 con 0x562c4b92e700 2023-09-13T09:45:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37837fe700 1 -- 172.21.15.6:0/2835231240 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37980b8280 con 0x562c4b92e700 2023-09-13T09:45:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 10 client.17055 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:40.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562c4b694c60 con 0x562c4b92e700 2023-09-13T09:45:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37837fe700 1 -- 172.21.15.6:0/2835231240 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3794021070 con 0x562c4b92e700 2023-09-13T09:45:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37837fe700 1 -- 172.21.15.6:0/2835231240 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f37980adbe0 con 0x562c4b92e700 2023-09-13T09:45:40.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 10 client.17055 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 10 client.17055 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:45:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 20 client.17055 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b997810 0x562c4b999c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:40.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 4 client.17055 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.918+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562c4b839050 con 0x562c4b997810 2023-09-13T09:45:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37a3fff700 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b997810 0x562c4b999c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37837fe700 10 client.17055 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37a3fff700 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b997810 0x562c4b999c30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eac7a1c6858119d7 server_cookie=aa461c9418e6baa1 in_seq=0 out_seq=0 2023-09-13T09:45:40.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37837fe700 1 -- 172.21.15.6:0/2835231240 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562c4b839050 con 0x562c4b997810 2023-09-13T09:45:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37837fe700 10 client.17055 handle_command_reply: tid=0 2023-09-13T09:45:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 client.17055 shutdown 2023-09-13T09:45:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 msgr2=0x562c4b93aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b93aa90 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3798005e90 tx=0x7f37980967c0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 shutdown_connections 2023-09-13T09:45:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562c4b997810 0x562c4b999c30 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c4b92f060 0x562c4b93afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c4b92da00 0x562c4b93dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 --2- 172.21.15.6:0/2835231240 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c4b92e700 0x562c4b93aa90 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 >> 172.21.15.6:0/2835231240 conn(0x562c4b88bc80 msgr2=0x562c4b931880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37837fe700 0 client.17055 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:45:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 shutdown_connections 2023-09-13T09:45:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.919+0000 7f37b6862b80 1 -- 172.21.15.6:0/2835231240 wait complete. 2023-09-13T09:45:40.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37b6862b80 20 client.17055 trim_cache size 0 max 16384 2023-09-13T09:45:40.953 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f378c0a06c0 msgr2=0x7f378c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f378c0a06c0 0x7f378c0a2b80 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f37a4101e10 tx=0x7f3794009310 comp rx=0 tx=0).stop 2023-09-13T09:45:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 msgr2=0x7f37a4197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4197080 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3798009230 tx=0x7f379800b790 comp rx=0 tx=0).stop 2023-09-13T09:45:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 shutdown_connections 2023-09-13T09:45:40.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f378c0a06c0 0x7f378c0a2b80 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a4102950 0x7f37a419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a4100dc0 0x7f37a4196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 --2- 172.21.15.6:0/3249970493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a4101fb0 0x7f37a4197080 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:40.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 >> 172.21.15.6:0/3249970493 conn(0x7f37a40fc330 msgr2=0x7f37a4105590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 shutdown_connections 2023-09-13T09:45:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:40.920+0000 7f37aa67d700 1 -- 172.21.15.6:0/3249970493 wait complete. 2023-09-13T09:45:40.957 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:45:41.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 -- 172.21.15.6:0/919682360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d00ffcc0 msgr2=0x7f16d01000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 --2- 172.21.15.6:0/919682360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d00ffcc0 0x7f16d01000e0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f16c00099c0 tx=0x7f16c0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 -- 172.21.15.6:0/919682360 shutdown_connections 2023-09-13T09:45:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 --2- 172.21.15.6:0/919682360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d0101850 0x7f16d0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 --2- 172.21.15.6:0/919682360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d00ffcc0 0x7f16d01000e0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 --2- 172.21.15.6:0/919682360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d0100eb0 0x7f16d0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 -- 172.21.15.6:0/919682360 >> 172.21.15.6:0/919682360 conn(0x7f16d00fb250 msgr2=0x7f16d00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 -- 172.21.15.6:0/919682360 shutdown_connections 2023-09-13T09:45:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.096+0000 7f16d491b700 1 -- 172.21.15.6:0/919682360 wait complete. 2023-09-13T09:45:41.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 Processor -- start 2023-09-13T09:45:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 -- start start 2023-09-13T09:45:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d00ffcc0 0x7f16d0196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d0100eb0 0x7f16d0196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d0101850 0x7f16d019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d019e610 con 0x7f16d0100eb0 2023-09-13T09:45:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d019e750 con 0x7f16d0101850 2023-09-13T09:45:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.097+0000 7f16d491b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16d019e8e0 con 0x7f16d00ffcc0 2023-09-13T09:45:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16ce59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d00ffcc0 0x7f16d0196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d0100eb0 0x7f16d0196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16ced9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d0101850 0x7f16d019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16ce59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d00ffcc0 0x7f16d0196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40778/0 (socket says 172.21.15.6:40778) 2023-09-13T09:45:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16ce59c700 1 -- 172.21.15.6:0/3459185358 learned_addr learned my addr 172.21.15.6:0/3459185358 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c5d9b700 1 -- 172.21.15.6:0/3459185358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d00ffcc0 msgr2=0x7f16d0196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d00ffcc0 0x7f16d0196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c5d9b700 1 -- 172.21.15.6:0/3459185358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d0101850 msgr2=0x7f16d019e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d0101850 0x7f16d019e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c5d9b700 1 -- 172.21.15.6:0/3459185358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c00095f0 con 0x7f16d0100eb0 2023-09-13T09:45:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16ce59c700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d00ffcc0 0x7f16d0196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d0100eb0 0x7f16d0196fd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f16b800e9f0 tx=0x7f16b800ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c7fff700 1 -- 172.21.15.6:0/3459185358 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b800c9c0 con 0x7f16d0100eb0 2023-09-13T09:45:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c7fff700 1 -- 172.21.15.6:0/3459185358 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16b8010430 con 0x7f16d0100eb0 2023-09-13T09:45:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16d019ebc0 con 0x7f16d0100eb0 2023-09-13T09:45:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16c7fff700 1 -- 172.21.15.6:0/3459185358 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b8018680 con 0x7f16d0100eb0 2023-09-13T09:45:41.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.098+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d019f0d0 con 0x7f16d0100eb0 2023-09-13T09:45:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.101+0000 7f16c7fff700 1 -- 172.21.15.6:0/3459185358 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f16b8010860 con 0x7f16d0100eb0 2023-09-13T09:45:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.102+0000 7f16c7fff700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16bc0a0640 0x7f16bc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.102+0000 7f16c7fff700 1 -- 172.21.15.6:0/3459185358 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f16b8014070 con 0x7f16d0100eb0 2023-09-13T09:45:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.102+0000 7f16ce59c700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16bc0a0640 0x7f16bc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16ce59c700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16bc0a0640 0x7f16bc0a2b00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f16c0004800 tx=0x7f16c001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 Processor -- start 2023-09-13T09:45:41.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 -- start start 2023-09-13T09:45:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d25700 0x562520d25b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d24a00 0x562520d24e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520c7d780 con 0x562520d26060 2023-09-13T09:45:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520c7b0a0 con 0x562520d24a00 2023-09-13T09:45:41.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520c76990 con 0x562520d25700 2023-09-13T09:45:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16ced9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d24a00 0x562520d24e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d244c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37734/0 (socket says 172.21.15.6:37734) 2023-09-13T09:45:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 -- 172.21.15.6:0/4114187022 learned_addr learned my addr 172.21.15.6:0/4114187022 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16ce59c700 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d25700 0x562520d25b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 -- 172.21.15.6:0/4114187022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d25700 msgr2=0x562520d25b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d25700 0x562520d25b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 -- 172.21.15.6:0/4114187022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d24a00 msgr2=0x562520d24e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d24a00 0x562520d24e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.103+0000 7f16c5d9b700 1 -- 172.21.15.6:0/4114187022 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562520af6630 con 0x562520d26060 2023-09-13T09:45:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.104+0000 7f16ce59c700 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d25700 0x562520d25b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:45:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.104+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d244c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f16b8099430 tx=0x7f16b80990b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93269412c6eee8fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.104+0000 7f16c4d99700 1 -- 172.21.15.6:0/4114187022 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80994a0 con 0x562520d26060 2023-09-13T09:45:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.104+0000 7f16c4d99700 1 -- 172.21.15.6:0/4114187022 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16b809d2d0 con 0x562520d26060 2023-09-13T09:45:41.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.104+0000 7f16c4d99700 1 -- 172.21.15.6:0/4114187022 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80840b0 con 0x562520d26060 2023-09-13T09:45:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4114187022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 msgr2=0x562520d244c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d244c0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f16b8099430 tx=0x7f16b80990b0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4114187022 shutdown_connections 2023-09-13T09:45:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d24a00 0x562520d24e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d25700 0x562520d25b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4114187022 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d244c0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4114187022 >> 172.21.15.6:0/4114187022 conn(0x562520c82c80 msgr2=0x562520d1ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4114187022 shutdown_connections 2023-09-13T09:45:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4114187022 wait complete. 2023-09-13T09:45:41.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 -- start start 2023-09-13T09:45:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 Processor -- start 2023-09-13T09:45:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d2df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d25700 0x562520d2e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d26060 0x562520d354b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.105+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520c14bb0 con 0x562520d25700 2023-09-13T09:45:41.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520c148b0 con 0x562520d26060 2023-09-13T09:45:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520af8920 con 0x562520d24a00 2023-09-13T09:45:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16e0b00b80 10 client.0 _ll_register_callbacks cb 0x562520c12680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16ce59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d2df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16ced9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d26060 0x562520d354b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16c5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d25700 0x562520d2e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16ce59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d2df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40792/0 (socket says 172.21.15.6:40792) 2023-09-13T09:45:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16ce59c700 1 -- 172.21.15.6:0/2971395122 learned_addr learned my addr 172.21.15.6:0/2971395122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16c5d9b700 1 -- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 msgr2=0x562520d2df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d2df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16c5d9b700 1 -- 172.21.15.6:0/2971395122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d26060 msgr2=0x562520d354b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d26060 0x562520d354b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16c5d9b700 1 -- 172.21.15.6:0/2971395122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16d019f0d0 con 0x562520d25700 2023-09-13T09:45:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16ced9d700 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d26060 0x562520d354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16ce59c700 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d2df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d25700 0x562520d2e470 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f16b8097a90 tx=0x7f16b8099ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=defe2c448623902c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2971395122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b80994a0 con 0x562520d25700 2023-09-13T09:45:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2971395122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f16b8098990 con 0x562520d25700 2023-09-13T09:45:41.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.106+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562520d17670 con 0x562520d25700 2023-09-13T09:45:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2971395122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16b8098b50 con 0x562520d25700 2023-09-13T09:45:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 10 client.17067 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562520c8e7a0 con 0x562520d25700 2023-09-13T09:45:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2971395122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562520d17670 con 0x562520d25700 2023-09-13T09:45:41.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2971395122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f16b8095290 con 0x562520d25700 2023-09-13T09:45:41.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 10 client.17067 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:41.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 10 client.17067 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:45:41.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 20 client.17067 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:41.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d39990 0x562520d3bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 4 client.17067 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562520c6f970 con 0x562520d39990 2023-09-13T09:45:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.107+0000 7f16ce59c700 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d39990 0x562520d3bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.108+0000 7f16b5ffb700 10 client.17067 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.108+0000 7f16ce59c700 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d39990 0x562520d3bdb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2b1c2631ddaf4ff9 server_cookie=9583031e4279e739 in_seq=0 out_seq=0 2023-09-13T09:45:41.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.108+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2971395122 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562520c6f970 con 0x562520d39990 2023-09-13T09:45:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.108+0000 7f16b5ffb700 10 client.17067 handle_command_reply: tid=0 2023-09-13T09:45:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.108+0000 7f16e0b00b80 1 client.17067 shutdown 2023-09-13T09:45:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d25700 msgr2=0x562520d2e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d25700 0x562520d2e470 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f16b8097a90 tx=0x7f16b8099ce0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 shutdown_connections 2023-09-13T09:45:41.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d39990 0x562520d3bdb0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d26060 0x562520d354b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16b5ffb700 0 client.17067 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d2df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2971395122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d25700 0x562520d2e470 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 >> 172.21.15.6:0/2971395122 conn(0x562520c82c80 msgr2=0x562520d197f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 shutdown_connections 2023-09-13T09:45:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2971395122 wait complete. 2023-09-13T09:45:41.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.109+0000 7f16e0b00b80 20 client.17067 trim_cache size 0 max 16384 2023-09-13T09:45:41.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.122+0000 7f16e0b00b80 1 Processor -- start 2023-09-13T09:45:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16e0b00b80 1 -- start start 2023-09-13T09:45:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d24a00 0x562520d244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d26060 0x562520d2be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520d2db00 con 0x562520d24a00 2023-09-13T09:45:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520d1b950 con 0x562520d25700 2023-09-13T09:45:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520d2ec30 con 0x562520d26060 2023-09-13T09:45:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d24a00 0x562520d244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16c5d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d24a00 0x562520d244c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37746/0 (socket says 172.21.15.6:37746) 2023-09-13T09:45:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 -- 172.21.15.6:0/4233778710 learned_addr learned my addr 172.21.15.6:0/4233778710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ced9d700 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d26060 0x562520d2be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 -- 172.21.15.6:0/4233778710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d26060 msgr2=0x562520d2be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d26060 0x562520d2be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 -- 172.21.15.6:0/4233778710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 msgr2=0x562520d35470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 -- 172.21.15.6:0/4233778710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562520aa2de0 con 0x562520d24a00 2023-09-13T09:45:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.123+0000 7f16ce59c700 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d24a00 0x562520d244c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f16c0000c00 tx=0x7f16c001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee28bef731835ed3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16c559a700 1 -- 172.21.15.6:0/4233778710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c000fee0 con 0x562520d24a00 2023-09-13T09:45:41.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16c559a700 1 -- 172.21.15.6:0/4233778710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16c002b040 con 0x562520d24a00 2023-09-13T09:45:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16c559a700 1 -- 172.21.15.6:0/4233778710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c0004a90 con 0x562520d24a00 2023-09-13T09:45:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4233778710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d24a00 msgr2=0x562520d244c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d24a00 0x562520d244c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f16c0000c00 tx=0x7f16c001f000 comp rx=0 tx=0).stop 2023-09-13T09:45:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4233778710 shutdown_connections 2023-09-13T09:45:41.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d26060 0x562520d2be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d24a00 0x562520d244c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/4233778710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4233778710 >> 172.21.15.6:0/4233778710 conn(0x562520c82c80 msgr2=0x562520d2cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4233778710 shutdown_connections 2023-09-13T09:45:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.124+0000 7f16e0b00b80 1 -- 172.21.15.6:0/4233778710 wait complete. 2023-09-13T09:45:41.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 -- start start 2023-09-13T09:45:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 Processor -- start 2023-09-13T09:45:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d34cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d317c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520d31d50 con 0x562520d26060 2023-09-13T09:45:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520d31ec0 con 0x562520d25700 2023-09-13T09:45:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562520d32080 con 0x562520d24a00 2023-09-13T09:45:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16e0b00b80 10 client.0 _ll_register_callbacks cb 0x562520c12680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16c5d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d317c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ce59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d34cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16c5d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59510/0 (socket says 172.21.15.6:59510) 2023-09-13T09:45:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16c5d9b700 1 -- 172.21.15.6:0/2110514486 learned_addr learned my addr 172.21.15.6:0/2110514486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ced9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d317c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37756/0 (socket says 172.21.15.6:37756) 2023-09-13T09:45:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ced9d700 1 -- 172.21.15.6:0/2110514486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 msgr2=0x562520d34cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ced9d700 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d34cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ced9d700 1 -- 172.21.15.6:0/2110514486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 msgr2=0x562520d35230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ced9d700 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16ced9d700 1 -- 172.21.15.6:0/2110514486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562520c8e7a0 con 0x562520d26060 2023-09-13T09:45:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.125+0000 7f16c5d9b700 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16ced9d700 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d317c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x562520d1bb90 tx=0x7f16c80077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24e37f9f1438e4b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16b5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2110514486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16c801c070 con 0x562520d26060 2023-09-13T09:45:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2110514486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f16c8004bb0 con 0x562520d26060 2023-09-13T09:45:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f16b809d2d0 con 0x562520d26060 2023-09-13T09:45:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2110514486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16c800e040 con 0x562520d26060 2023-09-13T09:45:41.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 10 client.17073 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f16d0108a50 con 0x562520d26060 2023-09-13T09:45:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2110514486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f16b809d2d0 con 0x562520d26060 2023-09-13T09:45:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2110514486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f16c8004680 con 0x562520d26060 2023-09-13T09:45:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 10 client.17073 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:41.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 10 client.17073 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:45:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 20 client.17073 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d8ed50 0x562520d91170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 4 client.17073 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562520c30050 con 0x562520d8ed50 2023-09-13T09:45:41.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.126+0000 7f16ce59c700 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d8ed50 0x562520d91170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16b5ffb700 10 client.17073 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16ce59c700 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d8ed50 0x562520d91170 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5d1a71b571d62510 server_cookie=306f4d5ef4c4af71 in_seq=0 out_seq=0 2023-09-13T09:45:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16b5ffb700 1 -- 172.21.15.6:0/2110514486 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562520c30050 con 0x562520d8ed50 2023-09-13T09:45:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16b5ffb700 10 client.17073 handle_command_reply: tid=0 2023-09-13T09:45:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 client.17073 shutdown 2023-09-13T09:45:41.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 msgr2=0x562520d317c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d317c0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x562520d1bb90 tx=0x7f16c80077e0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 shutdown_connections 2023-09-13T09:45:41.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562520d8ed50 0x562520d91170 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562520d26060 0x562520d317c0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562520d24a00 0x562520d34cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16b5ffb700 0 client.17073 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:45:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 --2- 172.21.15.6:0/2110514486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562520d25700 0x562520d35230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 >> 172.21.15.6:0/2110514486 conn(0x562520c82c80 msgr2=0x562520d28980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 shutdown_connections 2023-09-13T09:45:41.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 1 -- 172.21.15.6:0/2110514486 wait complete. 2023-09-13T09:45:41.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.127+0000 7f16e0b00b80 20 client.17073 trim_cache size 0 max 16384 2023-09-13T09:45:41.152 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16bc0a0640 msgr2=0x7f16bc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16bc0a0640 0x7f16bc0a2b00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f16c0004800 tx=0x7f16c001a040 comp rx=0 tx=0).stop 2023-09-13T09:45:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d0100eb0 msgr2=0x7f16d0196fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d0100eb0 0x7f16d0196fd0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f16b800e9f0 tx=0x7f16b800ed00 comp rx=0 tx=0).stop 2023-09-13T09:45:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 shutdown_connections 2023-09-13T09:45:41.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16d0101850 0x7f16d019e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16d00ffcc0 0x7f16d0196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f16bc0a0640 0x7f16bc0a2b00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 --2- 172.21.15.6:0/3459185358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f16d0100eb0 0x7f16d0196fd0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 >> 172.21.15.6:0/3459185358 conn(0x7f16d00fb250 msgr2=0x7f16d0068e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 shutdown_connections 2023-09-13T09:45:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.128+0000 7f16d491b700 1 -- 172.21.15.6:0/3459185358 wait complete. 2023-09-13T09:45:41.156 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:45:41.166 INFO:tasks.workunit.client.0.smithi006.stdout: 1 195491 3.06 MB/sec execute 181 sec latency 27.075 ms 2023-09-13T09:45:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.288+0000 7ff0114a5700 1 -- 172.21.15.6:0/4158679737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c102900 msgr2=0x7ff00c1091b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.288+0000 7ff0114a5700 1 --2- 172.21.15.6:0/4158679737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c102900 0x7ff00c1091b0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff00400b0d0 tx=0x7ff00400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.288+0000 7ff0114a5700 1 -- 172.21.15.6:0/4158679737 shutdown_connections 2023-09-13T09:45:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.288+0000 7ff0114a5700 1 --2- 172.21.15.6:0/4158679737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c102900 0x7ff00c1091b0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.288+0000 7ff0114a5700 1 --2- 172.21.15.6:0/4158679737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00c100d70 0x7ff00c101190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.288+0000 7ff0114a5700 1 --2- 172.21.15.6:0/4158679737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c101f60 0x7ff00c1023c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.289+0000 7ff0114a5700 1 -- 172.21.15.6:0/4158679737 >> 172.21.15.6:0/4158679737 conn(0x7ff00c0fc2e0 msgr2=0x7ff00c0fe720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.289+0000 7ff0114a5700 1 -- 172.21.15.6:0/4158679737 shutdown_connections 2023-09-13T09:45:41.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.289+0000 7ff0114a5700 1 -- 172.21.15.6:0/4158679737 wait complete. 2023-09-13T09:45:41.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.289+0000 7ff0114a5700 1 Processor -- start 2023-09-13T09:45:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.289+0000 7ff0114a5700 1 -- start start 2023-09-13T09:45:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c100d70 0x7ff00c196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c101f60 0x7ff00c197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00c102900 0x7ff00c19e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c19e6a0 con 0x7ff00c100d70 2023-09-13T09:45:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c19e7e0 con 0x7ff00c101f60 2023-09-13T09:45:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00c19e970 con 0x7ff00c102900 2023-09-13T09:45:41.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c100d70 0x7ff00c196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c100d70 0x7ff00c196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37766/0 (socket says 172.21.15.6:37766) 2023-09-13T09:45:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 -- 172.21.15.6:0/628361865 learned_addr learned my addr 172.21.15.6:0/628361865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c101f60 0x7ff00c197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00c102900 0x7ff00c19e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 -- 172.21.15.6:0/628361865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00c102900 msgr2=0x7ff00c19e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00c102900 0x7ff00c19e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 -- 172.21.15.6:0/628361865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c101f60 msgr2=0x7ff00c197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c101f60 0x7ff00c197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 -- 172.21.15.6:0/628361865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004009d00 con 0x7ff00c100d70 2023-09-13T09:45:41.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff00affd700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c100d70 0x7ff00c196b20 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7feffc00e970 tx=0x7feffc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7feff3fff700 1 -- 172.21.15.6:0/628361865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc009790 con 0x7ff00c100d70 2023-09-13T09:45:41.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff00c19ec50 con 0x7ff00c100d70 2023-09-13T09:45:41.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7feff3fff700 1 -- 172.21.15.6:0/628361865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feffc00c7e0 con 0x7ff00c100d70 2023-09-13T09:45:41.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7feff3fff700 1 -- 172.21.15.6:0/628361865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feffc003c70 con 0x7ff00c100d70 2023-09-13T09:45:41.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.290+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c19f1b0 con 0x7ff00c100d70 2023-09-13T09:45:41.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.293+0000 7feff3fff700 1 -- 172.21.15.6:0/628361865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7feffc00cc50 con 0x7ff00c100d70 2023-09-13T09:45:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.294+0000 7feff3fff700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feff40a0640 0x7feff40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.294+0000 7feff3fff700 1 -- 172.21.15.6:0/628361865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feffc014070 con 0x7ff00c100d70 2023-09-13T09:45:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.294+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feff40a0640 0x7feff40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feff40a0640 0x7feff40a2b00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff000009c60 tx=0x7ff000009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 Processor -- start 2023-09-13T09:45:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 -- start start 2023-09-13T09:45:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea58f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea58270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1e9ac780 con 0x560a1ea59470 2023-09-13T09:45:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1e9aa0a0 con 0x560a1ea57e10 2023-09-13T09:45:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1e9a5990 con 0x560a1ea58b10 2023-09-13T09:45:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea58f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37776/0 (socket says 172.21.15.6:37776) 2023-09-13T09:45:41.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 -- 172.21.15.6:0/800806688 learned_addr learned my addr 172.21.15.6:0/800806688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea58270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 -- 172.21.15.6:0/800806688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 msgr2=0x560a1ea58f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea58f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 -- 172.21.15.6:0/800806688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 msgr2=0x560a1ea58270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea58270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00a7fc700 1 -- 172.21.15.6:0/800806688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a1e825630 con 0x560a1ea59470 2023-09-13T09:45:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.295+0000 7ff00affd700 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea58f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.296+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea578d0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff00000e4e0 tx=0x7ff000014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fd5dbaa434e322 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.296+0000 7feff17fa700 1 -- 172.21.15.6:0/800806688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00000ee00 con 0x560a1ea59470 2023-09-13T09:45:41.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.296+0000 7feff17fa700 1 -- 172.21.15.6:0/800806688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff000021070 con 0x560a1ea59470 2023-09-13T09:45:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.296+0000 7feff17fa700 1 -- 172.21.15.6:0/800806688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00001d7f0 con 0x560a1ea59470 2023-09-13T09:45:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.296+0000 7ff01d68ab80 1 -- 172.21.15.6:0/800806688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 msgr2=0x560a1ea578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.296+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea578d0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff00000e4e0 tx=0x7ff000014000 comp rx=0 tx=0).stop 2023-09-13T09:45:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- 172.21.15.6:0/800806688 shutdown_connections 2023-09-13T09:45:41.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea58270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea58f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/800806688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea578d0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- 172.21.15.6:0/800806688 >> 172.21.15.6:0/800806688 conn(0x560a1e9b1c80 msgr2=0x560a1ea4df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- 172.21.15.6:0/800806688 shutdown_connections 2023-09-13T09:45:41.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- 172.21.15.6:0/800806688 wait complete. 2023-09-13T09:45:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- start start 2023-09-13T09:45:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 Processor -- start 2023-09-13T09:45:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea68880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1e943bb0 con 0x560a1ea59470 2023-09-13T09:45:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1e9438b0 con 0x560a1ea58b10 2023-09-13T09:45:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.297+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1e827920 con 0x560a1ea57e10 2023-09-13T09:45:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff01d68ab80 10 client.0 _ll_register_callbacks cb 0x560a1e941680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:41.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea68880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59538/0 (socket says 172.21.15.6:59538) 2023-09-13T09:45:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea68880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37784/0 (socket says 172.21.15.6:37784) 2023-09-13T09:45:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 -- 172.21.15.6:0/2031786319 learned_addr learned my addr 172.21.15.6:0/2031786319 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00affd700 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 -- 172.21.15.6:0/2031786319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea57e10 msgr2=0x560a1ea61300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 -- 172.21.15.6:0/2031786319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 msgr2=0x560a1ea68880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea68880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 -- 172.21.15.6:0/2031786319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff000017070 con 0x560a1ea58b10 2023-09-13T09:45:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea68880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff00000ed50 tx=0x7ff00000ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64a3dc42f115a3d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7fefeeff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:45:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7fefeeff5700 1 -- 172.21.15.6:0/2031786319 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0000052d0 con 0x560a1ea58b10 2023-09-13T09:45:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a1ea46670 con 0x560a1ea58b10 2023-09-13T09:45:41.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7fefeeff5700 1 -- 172.21.15.6:0/2031786319 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff000005430 con 0x560a1ea58b10 2023-09-13T09:45:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.298+0000 7fefeeff5700 1 -- 172.21.15.6:0/2031786319 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0000055f0 con 0x560a1ea58b10 2023-09-13T09:45:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 10 client.26498 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560a1e9bd7a0 con 0x560a1ea58b10 2023-09-13T09:45:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7fefeeff5700 1 -- 172.21.15.6:0/2031786319 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff00003d080 con 0x560a1ea58b10 2023-09-13T09:45:41.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7fefeeff5700 1 -- 172.21.15.6:0/2031786319 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff00001c7e0 con 0x560a1ea58b10 2023-09-13T09:45:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 10 client.26498 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 10 client.26498 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 20 client.26498 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1ea6f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 4 client.26498 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a1e99e970 con 0x560a1ea6d120 2023-09-13T09:45:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.299+0000 7ff00affd700 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1ea6f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.300+0000 7fefeeff5700 10 client.26498 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.300+0000 7ff00affd700 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1ea6f540 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a42a833f35900af server_cookie=9f55e7d30478ac9f in_seq=0 out_seq=0 2023-09-13T09:45:41.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7fefeeff5700 1 -- 172.21.15.6:0/2031786319 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560a1e99e970 con 0x560a1ea6d120 2023-09-13T09:45:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7fefeeff5700 10 client.26498 handle_command_reply: tid=0 2023-09-13T09:45:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 client.26498 shutdown 2023-09-13T09:45:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea58b10 msgr2=0x560a1ea61840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff00000ed50 tx=0x7ff00000ed80 comp rx=0 tx=0).stop 2023-09-13T09:45:41.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 shutdown_connections 2023-09-13T09:45:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1ea6f540 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea68880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7fefeeff5700 0 client.26498 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/2031786319 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 >> 172.21.15.6:0/2031786319 conn(0x560a1e9b1c80 msgr2=0x560a1ea487f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 shutdown_connections 2023-09-13T09:45:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 1 -- 172.21.15.6:0/2031786319 wait complete. 2023-09-13T09:45:41.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.301+0000 7ff01d68ab80 20 client.26498 trim_cache size 0 max 16384 2023-09-13T09:45:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.314+0000 7ff01d68ab80 1 Processor -- start 2023-09-13T09:45:41.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.314+0000 7ff01d68ab80 1 -- start start 2023-09-13T09:45:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea59470 0x560a1ea687a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1ea4ffd0 con 0x560a1ea58b10 2023-09-13T09:45:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1ea68ce0 con 0x560a1ea57e10 2023-09-13T09:45:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1ea62480 con 0x560a1ea59470 2023-09-13T09:45:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37790/0 (socket says 172.21.15.6:37790) 2023-09-13T09:45:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 -- 172.21.15.6:0/3708122432 learned_addr learned my addr 172.21.15.6:0/3708122432 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea59470 0x560a1ea687a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 -- 172.21.15.6:0/3708122432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea59470 msgr2=0x560a1ea687a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea59470 0x560a1ea687a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 -- 172.21.15.6:0/3708122432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 msgr2=0x560a1ea61300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 -- 172.21.15.6:0/3708122432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a1e7d1de0 con 0x560a1ea58b10 2023-09-13T09:45:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00affd700 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:41.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff00000eea0 tx=0x7ff00000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4341812b7609e4a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7feff1ffb700 1 -- 172.21.15.6:0/3708122432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00001d410 con 0x560a1ea58b10 2023-09-13T09:45:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.315+0000 7feff1ffb700 1 -- 172.21.15.6:0/3708122432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560a1ea46670 con 0x560a1ea58b10 2023-09-13T09:45:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7feff1ffb700 1 -- 172.21.15.6:0/3708122432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00001d930 con 0x560a1ea58b10 2023-09-13T09:45:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3708122432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea58b10 msgr2=0x560a1ea61840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff00000eea0 tx=0x7ff00000ef50 comp rx=0 tx=0).stop 2023-09-13T09:45:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3708122432 shutdown_connections 2023-09-13T09:45:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea59470 0x560a1ea687a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea61300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3708122432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea58b10 0x560a1ea61840 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3708122432 >> 172.21.15.6:0/3708122432 conn(0x560a1e9b1c80 msgr2=0x560a1ea4de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3708122432 shutdown_connections 2023-09-13T09:45:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3708122432 wait complete. 2023-09-13T09:45:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 -- start start 2023-09-13T09:45:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.316+0000 7ff01d68ab80 1 Processor -- start 2023-09-13T09:45:41.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea64560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea64aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff01d68ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea67ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1ea68000 con 0x560a1ea59470 2023-09-13T09:45:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1ea68170 con 0x560a1ea57e10 2023-09-13T09:45:41.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff01d68ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a1ea68330 con 0x560a1ea58b10 2023-09-13T09:45:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff01d68ab80 10 client.0 _ll_register_callbacks cb 0x560a1e941680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea67ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea67ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37798/0 (socket says 172.21.15.6:37798) 2023-09-13T09:45:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3609389443 learned_addr learned my addr 172.21.15.6:0/3609389443 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00affd700 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea64560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00a7fc700 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea64aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3609389443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 msgr2=0x560a1ea64aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea64aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 msgr2=0x560a1ea64560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea64560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 -- 172.21.15.6:0/3609389443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff00c19ec50 con 0x560a1ea59470 2023-09-13T09:45:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7ff00b7fe700 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea67ac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff004006130 tx=0x7ff0040078e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45d051d3c84593a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7fefeeff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.317+0000 7fefeeff5700 1 -- 172.21.15.6:0/3609389443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00400e040 con 0x560a1ea59470 2023-09-13T09:45:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7fefeeff5700 1 -- 172.21.15.6:0/3609389443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff004003a00 con 0x560a1ea59470 2023-09-13T09:45:41.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff000021070 con 0x560a1ea59470 2023-09-13T09:45:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7fefeeff5700 1 -- 172.21.15.6:0/3609389443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff004003bc0 con 0x560a1ea59470 2023-09-13T09:45:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 10 client.17091 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560a1e9bd7a0 con 0x560a1ea59470 2023-09-13T09:45:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7fefeeff5700 1 -- 172.21.15.6:0/3609389443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff004035080 con 0x560a1ea59470 2023-09-13T09:45:41.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7fefeeff5700 1 -- 172.21.15.6:0/3609389443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff00400b100 con 0x560a1ea59470 2023-09-13T09:45:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 10 client.17091 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 10 client.17091 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 20 client.17091 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1eac3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 4 client.17091 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:45:41.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560a1e95f050 con 0x560a1ea6d120 2023-09-13T09:45:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.318+0000 7ff00affd700 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1eac3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.319+0000 7fefeeff5700 10 client.17091 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.319+0000 7ff00affd700 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1eac3f90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c98780e49c6b6 server_cookie=1aac0b1b3f6aa576 in_seq=0 out_seq=0 2023-09-13T09:45:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7fefeeff5700 1 -- 172.21.15.6:0/3609389443 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560a1e95f050 con 0x560a1ea6d120 2023-09-13T09:45:41.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7fefeeff5700 10 client.17091 handle_command_reply: tid=0 2023-09-13T09:45:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 client.17091 shutdown 2023-09-13T09:45:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 msgr2=0x560a1ea67ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea67ac0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7ff004006130 tx=0x7ff0040078e0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 shutdown_connections 2023-09-13T09:45:41.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560a1ea6d120 0x560a1eac3f90 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560a1ea59470 0x560a1ea67ac0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560a1ea57e10 0x560a1ea64560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 --2- 172.21.15.6:0/3609389443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560a1ea58b10 0x560a1ea64aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 >> 172.21.15.6:0/3609389443 conn(0x560a1e9b1c80 msgr2=0x560a1ea612a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7fefeeff5700 0 client.17091 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 shutdown_connections 2023-09-13T09:45:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 1 -- 172.21.15.6:0/3609389443 wait complete. 2023-09-13T09:45:41.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.320+0000 7ff01d68ab80 20 client.17091 trim_cache size 0 max 16384 2023-09-13T09:45:41.345 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:45:41.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feff40a0640 msgr2=0x7feff40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feff40a0640 0x7feff40a2b00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7ff000009c60 tx=0x7ff000009260 comp rx=0 tx=0).stop 2023-09-13T09:45:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c100d70 msgr2=0x7ff00c196b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c100d70 0x7ff00c196b20 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7feffc00e970 tx=0x7feffc00ec80 comp rx=0 tx=0).stop 2023-09-13T09:45:41.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 shutdown_connections 2023-09-13T09:45:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff00c102900 0x7ff00c19e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feff40a0640 0x7feff40a2b00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00c100d70 0x7ff00c196b20 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 --2- 172.21.15.6:0/628361865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff00c101f60 0x7ff00c197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 >> 172.21.15.6:0/628361865 conn(0x7ff00c0fc2e0 msgr2=0x7ff00c105400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:41.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 shutdown_connections 2023-09-13T09:45:41.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:41.321+0000 7ff0114a5700 1 -- 172.21.15.6:0/628361865 wait complete. 2023-09-13T09:45:41.348 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:41 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1072503903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:45:41.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:41 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1072503903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:45:41.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:41 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1072503903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:45:42.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 197236 3.08 MB/sec execute 182 sec latency 46.042 ms 2023-09-13T09:45:42.349 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:45:42.350 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:45:42.375 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:42 smithi006 ceph-mon[98665]: pgmap v485: 97 pgs: 97 active+clean; 92 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 508 KiB/s wr, 60 op/s 2023-09-13T09:45:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.484+0000 7f7d2e963700 1 -- 172.21.15.6:0/2953156551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 msgr2=0x7f7d28109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.484+0000 7f7d2e963700 1 --2- 172.21.15.6:0/2953156551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d28109200 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000b0d0 tx=0x7f7d2000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 -- 172.21.15.6:0/2953156551 shutdown_connections 2023-09-13T09:45:42.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 --2- 172.21.15.6:0/2953156551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d28109200 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 --2- 172.21.15.6:0/2953156551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d28100dc0 0x7f7d281011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 --2- 172.21.15.6:0/2953156551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d28101fb0 0x7f7d28102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 -- 172.21.15.6:0/2953156551 >> 172.21.15.6:0/2953156551 conn(0x7f7d280fc330 msgr2=0x7f7d280fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 -- 172.21.15.6:0/2953156551 shutdown_connections 2023-09-13T09:45:42.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 -- 172.21.15.6:0/2953156551 wait complete. 2023-09-13T09:45:42.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 Processor -- start 2023-09-13T09:45:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.485+0000 7f7d2e963700 1 -- start start 2023-09-13T09:45:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2e963700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d28100dc0 0x7f7d28196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2e963700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d28101fb0 0x7f7d28197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2e963700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d2819e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2e963700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2819e6d0 con 0x7f7d28102950 2023-09-13T09:45:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2e963700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2819e810 con 0x7f7d28100dc0 2023-09-13T09:45:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2e963700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2819e9a0 con 0x7f7d28101fb0 2023-09-13T09:45:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d2819e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d27fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d28100dc0 0x7f7d28196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d277fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d28101fb0 0x7f7d28197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d2819e100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37812/0 (socket says 172.21.15.6:37812) 2023-09-13T09:45:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 -- 172.21.15.6:0/1882587774 learned_addr learned my addr 172.21.15.6:0/1882587774 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 -- 172.21.15.6:0/1882587774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d28101fb0 msgr2=0x7f7d28197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d28101fb0 0x7f7d28197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 -- 172.21.15.6:0/1882587774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d28100dc0 msgr2=0x7f7d28196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d28100dc0 0x7f7d28196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 -- 172.21.15.6:0/1882587774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d20009d00 con 0x7f7d28102950 2023-09-13T09:45:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d277fe700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d28101fb0 0x7f7d28197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:42.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d2819e100 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7d20008ec0 tx=0x7f7d20008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.486+0000 7f7d257fa700 1 -- 172.21.15.6:0/1882587774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2000e040 con 0x7f7d28102950 2023-09-13T09:45:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.487+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2819ec20 con 0x7f7d28102950 2023-09-13T09:45:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.487+0000 7f7d257fa700 1 -- 172.21.15.6:0/1882587774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d20005070 con 0x7f7d28102950 2023-09-13T09:45:42.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.487+0000 7f7d257fa700 1 -- 172.21.15.6:0/1882587774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d2001b6c0 con 0x7f7d28102950 2023-09-13T09:45:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.487+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2819f0a0 con 0x7f7d28102950 2023-09-13T09:45:42.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.489+0000 7f7d257fa700 1 -- 172.21.15.6:0/1882587774 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7d200051e0 con 0x7f7d28102950 2023-09-13T09:45:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.489+0000 7f7d257fa700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7d100a0640 0x7f7d100a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.489+0000 7f7d27fff700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7d100a0640 0x7f7d100a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d257fa700 1 -- 172.21.15.6:0/1882587774 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7d200ccc90 con 0x7f7d28102950 2023-09-13T09:45:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d27fff700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7d100a0640 0x7f7d100a2b00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7d28101e10 tx=0x7f7d18009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 Processor -- start 2023-09-13T09:45:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 -- start start 2023-09-13T09:45:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8018ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad80190e0 0x558ad8017540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad8017a80 0x558ad8017f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad7f70800 con 0x558ad8017a80 2023-09-13T09:45:42.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad7f6e120 con 0x558ad8018780 2023-09-13T09:45:42.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.490+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad7f69a10 con 0x558ad80190e0 2023-09-13T09:45:42.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d2cf00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad8017a80 0x558ad8017f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8018ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d277fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad80190e0 0x558ad8017540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8018ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59572/0 (socket says 172.21.15.6:59572) 2023-09-13T09:45:42.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 -- 172.21.15.6:0/3375170737 learned_addr learned my addr 172.21.15.6:0/3375170737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 -- 172.21.15.6:0/3375170737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad80190e0 msgr2=0x558ad8017540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad80190e0 0x558ad8017540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 -- 172.21.15.6:0/3375170737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad8017a80 msgr2=0x558ad8017f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad8017a80 0x558ad8017f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 -- 172.21.15.6:0/3375170737 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ad7de96b0 con 0x558ad8018780 2023-09-13T09:45:42.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad8017a80 0x558ad8017f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:42.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8018ba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d18011d50 tx=0x7f7d18014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1b44157db8e5308 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d0e7fc700 1 -- 172.21.15.6:0/3375170737 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800ed20 con 0x558ad8018780 2023-09-13T09:45:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d0e7fc700 1 -- 172.21.15.6:0/3375170737 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d18021070 con 0x558ad8018780 2023-09-13T09:45:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.491+0000 7f7d0e7fc700 1 -- 172.21.15.6:0/3375170737 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1801d410 con 0x558ad8018780 2023-09-13T09:45:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3375170737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 msgr2=0x558ad8018ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8018ba0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7d18011d50 tx=0x7f7d18014000 comp rx=0 tx=0).stop 2023-09-13T09:45:42.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3375170737 shutdown_connections 2023-09-13T09:45:42.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad8017a80 0x558ad8017f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8018ba0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3375170737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad80190e0 0x558ad8017540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3375170737 >> 172.21.15.6:0/3375170737 conn(0x558ad7f75d00 msgr2=0x558ad8011f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3375170737 shutdown_connections 2023-09-13T09:45:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3375170737 wait complete. 2023-09-13T09:45:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.492+0000 7f7d3ab48b80 1 -- start start 2023-09-13T09:45:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 1 Processor -- start 2023-09-13T09:45:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8017a80 0x558ad8020fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8018780 0x558ad80214e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad80190e0 0x558ad8028520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad7f07c30 con 0x558ad80190e0 2023-09-13T09:45:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad7f07930 con 0x558ad8017a80 2023-09-13T09:45:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad7deb9a0 con 0x558ad8018780 2023-09-13T09:45:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d3ab48b80 10 client.0 _ll_register_callbacks cb 0x558ad7f05700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:42.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad80190e0 0x558ad8028520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad80190e0 0x558ad8028520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37826/0 (socket says 172.21.15.6:37826) 2023-09-13T09:45:42.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 -- 172.21.15.6:0/3752906889 learned_addr learned my addr 172.21.15.6:0/3752906889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d277fe700 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8018780 0x558ad80214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8017a80 0x558ad8020fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 -- 172.21.15.6:0/3752906889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8018780 msgr2=0x558ad80214e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8018780 0x558ad80214e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 -- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8017a80 msgr2=0x558ad8020fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8017a80 0x558ad8020fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.493+0000 7f7d2cf00700 1 -- 172.21.15.6:0/3752906889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d18017070 con 0x558ad80190e0 2023-09-13T09:45:42.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad80190e0 0x558ad8028520 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7d200caab0 tx=0x7f7d2000b3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca82e0e78307364 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d077fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d077fe700 1 -- 172.21.15.6:0/3752906889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200b1070 con 0x558ad80190e0 2023-09-13T09:45:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d077fe700 1 -- 172.21.15.6:0/3752906889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7d2009abc0 con 0x558ad80190e0 2023-09-13T09:45:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ad800a6f0 con 0x558ad80190e0 2023-09-13T09:45:42.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d077fe700 1 -- 172.21.15.6:0/3752906889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d2009a4c0 con 0x558ad80190e0 2023-09-13T09:45:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 10 client.17103 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558ad7f81820 con 0x558ad80190e0 2023-09-13T09:45:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d077fe700 1 -- 172.21.15.6:0/3752906889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d20064080 con 0x558ad80190e0 2023-09-13T09:45:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d077fe700 1 -- 172.21.15.6:0/3752906889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7d2009a720 con 0x558ad80190e0 2023-09-13T09:45:42.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 10 client.17103 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 10 client.17103 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 20 client.17103 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad802ca80 0x558ad802eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 4 client.17103 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:42.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.494+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ad7f629f0 con 0x558ad802ca80 2023-09-13T09:45:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.495+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad802ca80 0x558ad802eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.495+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad802ca80 0x558ad802eea0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb27805f50587a3 server_cookie=b8778907fdaf7eb8 in_seq=0 out_seq=0 2023-09-13T09:45:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.495+0000 7f7d077fe700 10 client.17103 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.495+0000 7f7d077fe700 1 -- 172.21.15.6:0/3752906889 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558ad7f629f0 con 0x558ad802ca80 2023-09-13T09:45:42.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.495+0000 7f7d077fe700 10 client.17103 handle_command_reply: tid=0 2023-09-13T09:45:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 client.17103 shutdown 2023-09-13T09:45:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad80190e0 msgr2=0x558ad8028520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad80190e0 0x558ad8028520 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f7d200caab0 tx=0x7f7d2000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 shutdown_connections 2023-09-13T09:45:42.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad802ca80 0x558ad802eea0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad80190e0 0x558ad8028520 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8017a80 0x558ad8020fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3752906889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8018780 0x558ad80214e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d077fe700 0 client.17103 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 >> 172.21.15.6:0/3752906889 conn(0x558ad7f75d00 msgr2=0x558ad800c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 shutdown_connections 2023-09-13T09:45:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3752906889 wait complete. 2023-09-13T09:45:42.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.496+0000 7f7d3ab48b80 20 client.17103 trim_cache size 0 max 16384 2023-09-13T09:45:42.518 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:42 smithi053 ceph-mon[102373]: pgmap v485: 97 pgs: 97 active+clean; 92 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 508 KiB/s wr, 60 op/s 2023-09-13T09:45:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.513+0000 7f7d3ab48b80 1 Processor -- start 2023-09-13T09:45:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.513+0000 7f7d3ab48b80 1 -- start start 2023-09-13T09:45:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad800c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80284e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8016c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad8020450 con 0x558ad7f75d00 2023-09-13T09:45:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad802c870 con 0x558ad8018780 2023-09-13T09:45:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad8020b40 con 0x558ad8017a80 2023-09-13T09:45:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad800c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad800c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37830/0 (socket says 172.21.15.6:37830) 2023-09-13T09:45:42.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 -- 172.21.15.6:0/3558785828 learned_addr learned my addr 172.21.15.6:0/3558785828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8016c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d277fe700 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 -- 172.21.15.6:0/3558785828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 msgr2=0x558ad80284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80284e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 -- 172.21.15.6:0/3558785828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 msgr2=0x558ad8016c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8016c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 -- 172.21.15.6:0/3558785828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ad7d95e60 con 0x558ad7f75d00 2023-09-13T09:45:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d27fff700 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad800c970 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7d18011d20 tx=0x7f7d1801ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23883d777cd692ca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.514+0000 7f7d0effd700 1 -- 172.21.15.6:0/3558785828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1801cca0 con 0x558ad7f75d00 2023-09-13T09:45:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d0effd700 1 -- 172.21.15.6:0/3558785828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d1800eb20 con 0x558ad7f75d00 2023-09-13T09:45:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d0effd700 1 -- 172.21.15.6:0/3558785828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1801c890 con 0x558ad7f75d00 2023-09-13T09:45:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3558785828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 msgr2=0x558ad800c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad800c970 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f7d18011d20 tx=0x7f7d1801ca60 comp rx=0 tx=0).stop 2023-09-13T09:45:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3558785828 shutdown_connections 2023-09-13T09:45:42.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad8016c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad800c970 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/3558785828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80284e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3558785828 >> 172.21.15.6:0/3558785828 conn(0x558ad80122c0 msgr2=0x558ad8016530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3558785828 shutdown_connections 2023-09-13T09:45:42.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.515+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/3558785828 wait complete. 2023-09-13T09:45:42.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 -- start start 2023-09-13T09:45:42.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 Processor -- start 2023-09-13T09:45:42.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad8025ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad80273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad8027930 con 0x558ad7f75d00 2023-09-13T09:45:42.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad8027aa0 con 0x558ad8018780 2023-09-13T09:45:42.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ad8027c60 con 0x558ad8017a80 2023-09-13T09:45:42.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d3ab48b80 10 client.0 _ll_register_callbacks cb 0x558ad7f05700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:42.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad8025ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad8025ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37836/0 (socket says 172.21.15.6:37836) 2023-09-13T09:45:42.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 -- 172.21.15.6:0/357849842 learned_addr learned my addr 172.21.15.6:0/357849842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d277fe700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad80273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 -- 172.21.15.6:0/357849842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 msgr2=0x558ad80263e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80263e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 -- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 msgr2=0x558ad80273f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad80273f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d27fff700 1 -- 172.21.15.6:0/357849842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d1802a040 con 0x558ad7f75d00 2023-09-13T09:45:42.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.516+0000 7f7d2cf00700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad80273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:42.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d27fff700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad8025ea0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7d1801cad0 tx=0x7f7d1801cb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6357b37498e63e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d077fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:45:42.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d077fe700 1 -- 172.21.15.6:0/357849842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d1800ec90 con 0x558ad7f75d00 2023-09-13T09:45:42.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d077fe700 1 -- 172.21.15.6:0/357849842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7d1800edf0 con 0x558ad7f75d00 2023-09-13T09:45:42.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7d18021070 con 0x558ad7f75d00 2023-09-13T09:45:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d077fe700 1 -- 172.21.15.6:0/357849842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7d1801c630 con 0x558ad7f75d00 2023-09-13T09:45:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 10 client.17109 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558ad7d7ece0 con 0x558ad7f75d00 2023-09-13T09:45:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d077fe700 1 -- 172.21.15.6:0/357849842 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7d1804a020 con 0x558ad7f75d00 2023-09-13T09:45:42.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d077fe700 1 -- 172.21.15.6:0/357849842 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7d18038020 con 0x558ad7f75d00 2023-09-13T09:45:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 10 client.17109 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 10 client.17109 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 20 client.17109 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad80190e0 0x558ad8085120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 4 client.17109 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:45:42.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.517+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558ad7f230d0 con 0x558ad80190e0 2023-09-13T09:45:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.518+0000 7f7d277fe700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad80190e0 0x558ad8085120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.518+0000 7f7d077fe700 10 client.17109 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.518+0000 7f7d277fe700 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad80190e0 0x558ad8085120 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59ee335c63249115 server_cookie=b05d95efdec9e979 in_seq=0 out_seq=0 2023-09-13T09:45:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d077fe700 1 -- 172.21.15.6:0/357849842 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558ad7f230d0 con 0x558ad80190e0 2023-09-13T09:45:42.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d077fe700 10 client.17109 handle_command_reply: tid=0 2023-09-13T09:45:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 client.17109 shutdown 2023-09-13T09:45:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 msgr2=0x558ad8025ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad8025ea0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f7d1801cad0 tx=0x7f7d1801cb00 comp rx=0 tx=0).stop 2023-09-13T09:45:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 shutdown_connections 2023-09-13T09:45:42.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558ad8018780 0x558ad80273f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558ad80190e0 0x558ad8085120 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558ad7f75d00 0x558ad8025ea0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d077fe700 0 client.17109 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 --2- 172.21.15.6:0/357849842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558ad8017a80 0x558ad80263e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 >> 172.21.15.6:0/357849842 conn(0x558ad80122c0 msgr2=0x558ad8016dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 shutdown_connections 2023-09-13T09:45:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 1 -- 172.21.15.6:0/357849842 wait complete. 2023-09-13T09:45:42.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d3ab48b80 20 client.17109 trim_cache size 0 max 16384 2023-09-13T09:45:42.539 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:45:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:45:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "d1085f38-dd95-4781-88b9-2b3ed1ee79a5", 2023-09-13T09:45:42.540 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:45:42.540 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:45:42.541 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:42 smithi131 ceph-mon[102785]: pgmap v485: 97 pgs: 97 active+clean; 92 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 508 KiB/s wr, 60 op/s 2023-09-13T09:45:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7d100a0640 msgr2=0x7f7d100a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d2e963700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7d100a0640 0x7f7d100a2b00 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f7d28101e10 tx=0x7f7d18009260 comp rx=0 tx=0).stop 2023-09-13T09:45:42.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 msgr2=0x7f7d2819e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.520+0000 7f7d2e963700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d2819e100 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f7d20008ec0 tx=0x7f7d20008ef0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 shutdown_connections 2023-09-13T09:45:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7d100a0640 0x7f7d100a2b00 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d28102950 0x7f7d2819e100 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7d28100dc0 0x7f7d28196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 --2- 172.21.15.6:0/1882587774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7d28101fb0 0x7f7d28197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 >> 172.21.15.6:0/1882587774 conn(0x7f7d280fc330 msgr2=0x7f7d28105420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 shutdown_connections 2023-09-13T09:45:42.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.521+0000 7f7d2e963700 1 -- 172.21.15.6:0/1882587774 wait complete. 2023-09-13T09:45:42.545 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:45:42.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 -- 172.21.15.6:0/1510188934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac102950 msgr2=0x7f4fac109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 --2- 172.21.15.6:0/1510188934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac102950 0x7f4fac109200 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f4fa400b0d0 tx=0x7f4fa400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 -- 172.21.15.6:0/1510188934 shutdown_connections 2023-09-13T09:45:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 --2- 172.21.15.6:0/1510188934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac102950 0x7f4fac109200 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 --2- 172.21.15.6:0/1510188934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fac100dc0 0x7f4fac1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 --2- 172.21.15.6:0/1510188934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fac101fb0 0x7f4fac102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 -- 172.21.15.6:0/1510188934 >> 172.21.15.6:0/1510188934 conn(0x7f4fac0fc350 msgr2=0x7f4fac0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 -- 172.21.15.6:0/1510188934 shutdown_connections 2023-09-13T09:45:42.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.716+0000 7f4fb3939700 1 -- 172.21.15.6:0/1510188934 wait complete. 2023-09-13T09:45:42.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 Processor -- start 2023-09-13T09:45:42.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 -- start start 2023-09-13T09:45:42.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac100dc0 0x7f4fac196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fac101fb0 0x7f4fac197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fac102950 0x7f4fac19e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac19e6b0 con 0x7f4fac100dc0 2023-09-13T09:45:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac19e7f0 con 0x7f4fac102950 2023-09-13T09:45:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb3939700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fac19e980 con 0x7f4fac101fb0 2023-09-13T09:45:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac100dc0 0x7f4fac196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac100dc0 0x7f4fac196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37850/0 (socket says 172.21.15.6:37850) 2023-09-13T09:45:42.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 -- 172.21.15.6:0/3830311550 learned_addr learned my addr 172.21.15.6:0/3830311550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb1ed6700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fac102950 0x7f4fac19e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fac101fb0 0x7f4fac197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 -- 172.21.15.6:0/3830311550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fac101fb0 msgr2=0x7f4fac197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fac101fb0 0x7f4fac197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 -- 172.21.15.6:0/3830311550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fac102950 msgr2=0x7f4fac19e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fac102950 0x7f4fac19e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb16d5700 1 -- 172.21.15.6:0/3830311550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa4009d00 con 0x7f4fac100dc0 2023-09-13T09:45:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.717+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fac101fb0 0x7f4fac197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:45:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.718+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac100dc0 0x7f4fac196b30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00e970 tx=0x7f4f9c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.718+0000 7f4fa27fc700 1 -- 172.21.15.6:0/3830311550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c009790 con 0x7f4fac100dc0 2023-09-13T09:45:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.718+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac19ec60 con 0x7f4fac100dc0 2023-09-13T09:45:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.718+0000 7f4fa27fc700 1 -- 172.21.15.6:0/3830311550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f9c00eec0 con 0x7f4fac100dc0 2023-09-13T09:45:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.718+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fac19f1c0 con 0x7f4fac100dc0 2023-09-13T09:45:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.718+0000 7f4fa27fc700 1 -- 172.21.15.6:0/3830311550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c003cf0 con 0x7f4fac100dc0 2023-09-13T09:45:42.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.720+0000 7f4fa27fc700 1 -- 172.21.15.6:0/3830311550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4f9c00ccd0 con 0x7f4fac100dc0 2023-09-13T09:45:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.721+0000 7f4fa27fc700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f980a4a50 0x7f4f980a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.721+0000 7f4fa27fc700 1 -- 172.21.15.6:0/3830311550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f9c014070 con 0x7f4fac100dc0 2023-09-13T09:45:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.721+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f980a4a50 0x7f4f980a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.722+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f980a4a50 0x7f4f980a6f10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009be0 tx=0x7f4fa8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.722+0000 7f4fbfb1eb80 1 Processor -- start 2023-09-13T09:45:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.722+0000 7f4fbfb1eb80 1 -- start start 2023-09-13T09:45:42.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d9922b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99214c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d9921e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d987a780 con 0x5590d9921a00 2023-09-13T09:45:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d98780a0 con 0x5590d9922700 2023-09-13T09:45:42.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d9873990 con 0x5590d9923060 2023-09-13T09:45:42.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb1ed6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d9921e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d9922b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99214c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40912/0 (socket says 172.21.15.6:40912) 2023-09-13T09:45:42.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb1ed6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d9921e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37862/0 (socket says 172.21.15.6:37862) 2023-09-13T09:45:42.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d9922b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59614/0 (socket says 172.21.15.6:59614) 2023-09-13T09:45:42.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 -- 172.21.15.6:0/2823495398 learned_addr learned my addr 172.21.15.6:0/2823495398 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 -- 172.21.15.6:0/2823495398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 msgr2=0x5590d9922b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d9922b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 -- 172.21.15.6:0/2823495398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 msgr2=0x5590d9921e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d9921e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 -- 172.21.15.6:0/2823495398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590d96f3630 con 0x5590d9923060 2023-09-13T09:45:42.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb1ed6700 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d9921e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:42.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.723+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99214c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8010d00 tx=0x7f4fa8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94ae820e470167bf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4f977fe700 1 -- 172.21.15.6:0/2823495398 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa8012ab0 con 0x5590d9923060 2023-09-13T09:45:42.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4f977fe700 1 -- 172.21.15.6:0/2823495398 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa8012c10 con 0x5590d9923060 2023-09-13T09:45:42.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4f977fe700 1 -- 172.21.15.6:0/2823495398 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa801e610 con 0x5590d9923060 2023-09-13T09:45:42.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/2823495398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 msgr2=0x5590d99214c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99214c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8010d00 tx=0x7f4fa8013000 comp rx=0 tx=0).stop 2023-09-13T09:45:42.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/2823495398 shutdown_connections 2023-09-13T09:45:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d9921e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d9922b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/2823495398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99214c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/2823495398 >> 172.21.15.6:0/2823495398 conn(0x5590d987fc80 msgr2=0x5590d991bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/2823495398 shutdown_connections 2023-09-13T09:45:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.724+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/2823495398 wait complete. 2023-09-13T09:45:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 -- start start 2023-09-13T09:45:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 Processor -- start 2023-09-13T09:45:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9921a00 0x5590d992af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9922700 0x5590d992b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d9811bb0 con 0x5590d9922700 2023-09-13T09:45:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d98118b0 con 0x5590d9921a00 2023-09-13T09:45:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d96f5920 con 0x5590d9923060 2023-09-13T09:45:42.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fbfb1eb80 10 client.0 _ll_register_callbacks cb 0x5590d980f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9921a00 0x5590d992af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fb0ed4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9922700 0x5590d992b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.725+0000 7f4fb1ed6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9921a00 0x5590d992af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59620/0 (socket says 172.21.15.6:59620) 2023-09-13T09:45:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 -- 172.21.15.6:0/945175237 learned_addr learned my addr 172.21.15.6:0/945175237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb1ed6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99324a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40922/0 (socket says 172.21.15.6:40922) 2023-09-13T09:45:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb0ed4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9922700 0x5590d992b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37866/0 (socket says 172.21.15.6:37866) 2023-09-13T09:45:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 -- 172.21.15.6:0/945175237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 msgr2=0x5590d99324a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99324a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 -- 172.21.15.6:0/945175237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9922700 msgr2=0x5590d992b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9922700 0x5590d992b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 -- 172.21.15.6:0/945175237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa80109b0 con 0x5590d9921a00 2023-09-13T09:45:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb1ed6700 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99324a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9921a00 0x5590d992af20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c096060 tx=0x7f4f9c099d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67976fcdeffe6e0d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4f94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:45:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4f94ff9700 1 -- 172.21.15.6:0/945175237 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c09d420 con 0x5590d9921a00 2023-09-13T09:45:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590d9914670 con 0x5590d9921a00 2023-09-13T09:45:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4f94ff9700 1 -- 172.21.15.6:0/945175237 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f9c082e40 con 0x5590d9921a00 2023-09-13T09:45:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4f94ff9700 1 -- 172.21.15.6:0/945175237 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f9c0a1660 con 0x5590d9921a00 2023-09-13T09:45:42.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fbfb1eb80 10 client.26534 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.726+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5590d988b7a0 con 0x5590d9921a00 2023-09-13T09:45:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4f94ff9700 1 -- 172.21.15.6:0/945175237 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5590d9914670 con 0x5590d9921a00 2023-09-13T09:45:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4f94ff9700 1 -- 172.21.15.6:0/945175237 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f9c098ae0 con 0x5590d9921a00 2023-09-13T09:45:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4fbfb1eb80 10 client.26534 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:42.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4fbfb1eb80 10 client.26534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4fbfb1eb80 20 client.26534 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d9936ca0 0x5590d99390c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4fbfb1eb80 4 client.26534 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:45:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590d986c970 con 0x5590d9936ca0 2023-09-13T09:45:42.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.727+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d9936ca0 0x5590d99390c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4f94ff9700 10 client.26534 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d9936ca0 0x5590d99390c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af0628e83eb94bc8 server_cookie=d6c3503a86868d31 in_seq=0 out_seq=0 2023-09-13T09:45:42.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4f94ff9700 1 -- 172.21.15.6:0/945175237 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5590d986c970 con 0x5590d9936ca0 2023-09-13T09:45:42.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4f94ff9700 10 client.26534 handle_command_reply: tid=0 2023-09-13T09:45:42.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 client.26534 shutdown 2023-09-13T09:45:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9921a00 msgr2=0x5590d992af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9921a00 0x5590d992af20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c096060 tx=0x7f4f9c099d70 comp rx=0 tx=0).stop 2023-09-13T09:45:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 shutdown_connections 2023-09-13T09:45:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9923060 0x5590d99324a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9921a00 0x5590d992af20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d9936ca0 0x5590d99390c0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/945175237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9922700 0x5590d992b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4f94ff9700 0 client.26534 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.728+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 >> 172.21.15.6:0/945175237 conn(0x5590d987fc80 msgr2=0x5590d99167f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.729+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 shutdown_connections 2023-09-13T09:45:42.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.729+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/945175237 wait complete. 2023-09-13T09:45:42.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.729+0000 7f4fbfb1eb80 20 client.26534 trim_cache size 0 max 16384 2023-09-13T09:45:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 Processor -- start 2023-09-13T09:45:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 -- start start 2023-09-13T09:45:42.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d99214c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9922700 0x5590d9932460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9923060 0x5590d99258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d992a3d0 con 0x5590d9921a00 2023-09-13T09:45:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d9914650 con 0x5590d9923060 2023-09-13T09:45:42.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d992aa90 con 0x5590d9922700 2023-09-13T09:45:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.746+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d99214c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb1ed6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9923060 0x5590d99258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d99214c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37872/0 (socket says 172.21.15.6:37872) 2023-09-13T09:45:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb0ed4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9922700 0x5590d9932460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb16d5700 1 -- 172.21.15.6:0/919425780 learned_addr learned my addr 172.21.15.6:0/919425780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb0ed4700 1 -- 172.21.15.6:0/919425780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9923060 msgr2=0x5590d99258e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9923060 0x5590d99258e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb0ed4700 1 -- 172.21.15.6:0/919425780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 msgr2=0x5590d99214c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d99214c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb0ed4700 1 -- 172.21.15.6:0/919425780 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590d969fde0 con 0x5590d9922700 2023-09-13T09:45:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d99214c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:45:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9922700 0x5590d9932460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8011010 tx=0x7f4fa801fd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c45fecddd9f5fca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4f97fff700 1 -- 172.21.15.6:0/919425780 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa802f070 con 0x5590d9922700 2023-09-13T09:45:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4f97fff700 1 -- 172.21.15.6:0/919425780 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa8030040 con 0x5590d9922700 2023-09-13T09:45:42.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.747+0000 7f4f97fff700 1 -- 172.21.15.6:0/919425780 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fa801f450 con 0x5590d9922700 2023-09-13T09:45:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/919425780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9922700 msgr2=0x5590d9932460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9922700 0x5590d9932460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8011010 tx=0x7f4fa801fd00 comp rx=0 tx=0).stop 2023-09-13T09:45:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/919425780 shutdown_connections 2023-09-13T09:45:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9923060 0x5590d99258e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9921a00 0x5590d99214c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/919425780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9922700 0x5590d9932460 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/919425780 >> 172.21.15.6:0/919425780 conn(0x5590d987fc80 msgr2=0x5590d991be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/919425780 shutdown_connections 2023-09-13T09:45:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/919425780 wait complete. 2023-09-13T09:45:42.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.748+0000 7f4fbfb1eb80 1 -- start start 2023-09-13T09:45:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 1 Processor -- start 2023-09-13T09:45:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9921a00 0x5590d992e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d992ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9923060 0x5590d9931a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d9931f60 con 0x5590d9923060 2023-09-13T09:45:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d99320d0 con 0x5590d9922700 2023-09-13T09:45:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590d9932290 con 0x5590d9921a00 2023-09-13T09:45:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fbfb1eb80 10 client.0 _ll_register_callbacks cb 0x5590d980f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:45:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9921a00 0x5590d992e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9921a00 0x5590d992e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:40932/0 (socket says 172.21.15.6:40932) 2023-09-13T09:45:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb1ed6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9923060 0x5590d9931a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 -- 172.21.15.6:0/767483919 learned_addr learned my addr 172.21.15.6:0/767483919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:45:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d992ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 -- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 msgr2=0x5590d992ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d992ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 -- 172.21.15.6:0/767483919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9923060 msgr2=0x5590d9931a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:45:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9923060 0x5590d9931a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.749+0000 7f4fb16d5700 1 -- 172.21.15.6:0/767483919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590d988b7a0 con 0x5590d9921a00 2023-09-13T09:45:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fb16d5700 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9921a00 0x5590d992e4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000c00 tx=0x7f4f9c005ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de7199e96e9c6ea8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:45:42.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4f94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:45:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4f94ff9700 1 -- 172.21.15.6:0/767483919 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9c09d420 con 0x5590d9921a00 2023-09-13T09:45:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4fa8012c10 con 0x5590d9921a00 2023-09-13T09:45:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4f94ff9700 1 -- 172.21.15.6:0/767483919 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f9c082e40 con 0x5590d9921a00 2023-09-13T09:45:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4f94ff9700 1 -- 172.21.15.6:0/767483919 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f9c0a1660 con 0x5590d9921a00 2023-09-13T09:45:42.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 10 client.26485 fetch_fsmap learned FSMap version 34 2023-09-13T09:45:42.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5590d96f3630 con 0x5590d9921a00 2023-09-13T09:45:42.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4f94ff9700 1 -- 172.21.15.6:0/767483919 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4fa8012c10 con 0x5590d9921a00 2023-09-13T09:45:42.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4f94ff9700 1 -- 172.21.15.6:0/767483919 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4f9c0953e0 con 0x5590d9921a00 2023-09-13T09:45:42.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 10 client.26485 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:45:42.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 10 client.26485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:45:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 20 client.26485 populate_metadata read hostname 'smithi006' 2023-09-13T09:45:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d998b9c0 0x5590d998dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:45:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 4 client.26485 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:45:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.750+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5590d982d050 con 0x5590d998b9c0 2023-09-13T09:45:42.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d998b9c0 0x5590d998dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:45:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4f94ff9700 10 client.26485 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fb0ed4700 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d998b9c0 0x5590d998dde0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c331e24cf33c29f8 server_cookie=5524d940f7d46db9 in_seq=0 out_seq=0 2023-09-13T09:45:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4f94ff9700 1 -- 172.21.15.6:0/767483919 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5590d982d050 con 0x5590d998b9c0 2023-09-13T09:45:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4f94ff9700 10 client.26485 handle_command_reply: tid=0 2023-09-13T09:45:42.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 client.26485 shutdown 2023-09-13T09:45:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9921a00 msgr2=0x5590d992e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9921a00 0x5590d992e4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c000c00 tx=0x7f4f9c005ce0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 shutdown_connections 2023-09-13T09:45:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590d998b9c0 0x5590d998dde0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590d9923060 0x5590d9931a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4f94ff9700 0 client.26485 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:45:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590d9921a00 0x5590d992e4c0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 --2- 172.21.15.6:0/767483919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590d9922700 0x5590d992ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.751+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 >> 172.21.15.6:0/767483919 conn(0x5590d987fc80 msgr2=0x5590d99258e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 shutdown_connections 2023-09-13T09:45:42.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fbfb1eb80 1 -- 172.21.15.6:0/767483919 wait complete. 2023-09-13T09:45:42.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fbfb1eb80 20 client.26485 trim_cache size 0 max 16384 2023-09-13T09:45:42.772 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:45:42.772 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:45:42.773 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:45:42.773 INFO:teuthology.orchestra.run.smithi006.stdout: "d1085f38-dd95-4781-88b9-2b3ed1ee79a5": { 2023-09-13T09:45:42.773 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:45:42.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "d1085f38-dd95-4781-88b9-2b3ed1ee79a5", 2023-09-13T09:45:42.773 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:45:42.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:45:42.774 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:45:42.774 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:45:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f980a4a50 msgr2=0x7f4f980a6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f980a4a50 0x7f4f980a6f10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4fa8009be0 tx=0x7f4fa8009260 comp rx=0 tx=0).stop 2023-09-13T09:45:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac100dc0 msgr2=0x7f4fac196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:45:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac100dc0 0x7f4fac196b30 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f4f9c00e970 tx=0x7f4f9c00ec80 comp rx=0 tx=0).stop 2023-09-13T09:45:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 shutdown_connections 2023-09-13T09:45:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4fac102950 0x7f4fac19e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f980a4a50 0x7f4f980a6f10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4fac100dc0 0x7f4fac196b30 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 --2- 172.21.15.6:0/3830311550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fac101fb0 0x7f4fac197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:45:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 >> 172.21.15.6:0/3830311550 conn(0x7f4fac0fc350 msgr2=0x7f4fac0fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:45:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 shutdown_connections 2023-09-13T09:45:42.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:45:42.752+0000 7f4fb3939700 1 -- 172.21.15.6:0/3830311550 wait complete. 2023-09-13T09:45:42.778 INFO:tasks.cephfs.filesystem:scrub status for tag:d1085f38-dd95-4781-88b9-2b3ed1ee79a5 - {'path': '/', 'tag': 'd1085f38-dd95-4781-88b9-2b3ed1ee79a5', 'options': 'recursive,force'} 2023-09-13T09:45:43.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 198901 3.13 MB/sec execute 183 sec latency 31.581 ms 2023-09-13T09:45:43.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:43.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:43.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:43.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:43.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:43 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:43.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:43.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:43.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:43.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:43 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:43.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:43.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:43.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:43.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:43.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:43 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 200158 3.14 MB/sec execute 184 sec latency 44.387 ms 2023-09-13T09:45:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: pgmap v486: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 508 KiB/s wr, 65 op/s 2023-09-13T09:45:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:45:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:45:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:44 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: pgmap v486: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 508 KiB/s wr, 65 op/s 2023-09-13T09:45:44.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:45:44.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:45:44.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:44 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: pgmap v486: 97 pgs: 97 active+clean; 91 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 186 KiB/s rd, 508 KiB/s wr, 65 op/s 2023-09-13T09:45:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:45:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:45:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:44 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:45:45.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 202395 3.20 MB/sec execute 185 sec latency 12.447 ms 2023-09-13T09:45:46.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 203340 3.20 MB/sec execute 186 sec latency 15.026 ms 2023-09-13T09:45:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:46 smithi006 ceph-mon[98665]: pgmap v487: 97 pgs: 97 active+clean; 94 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 879 KiB/s wr, 139 op/s 2023-09-13T09:45:46.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:46 smithi053 ceph-mon[102373]: pgmap v487: 97 pgs: 97 active+clean; 94 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 879 KiB/s wr, 139 op/s 2023-09-13T09:45:46.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:46 smithi131 ceph-mon[102785]: pgmap v487: 97 pgs: 97 active+clean; 94 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 492 KiB/s rd, 879 KiB/s wr, 139 op/s 2023-09-13T09:45:47.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 205736 3.26 MB/sec execute 187 sec latency 12.165 ms 2023-09-13T09:45:48.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 206613 3.26 MB/sec execute 188 sec latency 39.980 ms 2023-09-13T09:45:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:48 smithi006 ceph-mon[98665]: pgmap v488: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.1 MiB/s wr, 158 op/s 2023-09-13T09:45:48.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:48 smithi053 ceph-mon[102373]: pgmap v488: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.1 MiB/s wr, 158 op/s 2023-09-13T09:45:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:48 smithi131 ceph-mon[102785]: pgmap v488: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 605 KiB/s rd, 1.1 MiB/s wr, 158 op/s 2023-09-13T09:45:49.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 208914 3.31 MB/sec execute 189 sec latency 32.868 ms 2023-09-13T09:45:50.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 209945 3.32 MB/sec execute 190 sec latency 16.064 ms 2023-09-13T09:45:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:50 smithi006 ceph-mon[98665]: pgmap v489: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2023-09-13T09:45:50.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:50 smithi053 ceph-mon[102373]: pgmap v489: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2023-09-13T09:45:50.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:50 smithi131 ceph-mon[102785]: pgmap v489: 97 pgs: 97 active+clean; 95 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 629 KiB/s rd, 1.2 MiB/s wr, 163 op/s 2023-09-13T09:45:51.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 212257 3.37 MB/sec execute 191 sec latency 14.623 ms 2023-09-13T09:45:52.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 213377 3.38 MB/sec execute 192 sec latency 20.286 ms 2023-09-13T09:45:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:52 smithi006 ceph-mon[98665]: pgmap v490: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1.6 MiB/s wr, 225 op/s 2023-09-13T09:45:52.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:52 smithi053 ceph-mon[102373]: pgmap v490: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1.6 MiB/s wr, 225 op/s 2023-09-13T09:45:52.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:52 smithi131 ceph-mon[102785]: pgmap v490: 97 pgs: 97 active+clean; 98 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 936 KiB/s rd, 1.6 MiB/s wr, 225 op/s 2023-09-13T09:45:53.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 215476 3.41 MB/sec execute 193 sec latency 12.850 ms 2023-09-13T09:45:54.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 216811 3.45 MB/sec execute 194 sec latency 47.109 ms 2023-09-13T09:45:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:54 smithi006 ceph-mon[98665]: pgmap v491: 97 pgs: 97 active+clean; 99 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 249 op/s 2023-09-13T09:45:54.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:54 smithi053 ceph-mon[102373]: pgmap v491: 97 pgs: 97 active+clean; 99 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 249 op/s 2023-09-13T09:45:54.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:54 smithi131 ceph-mon[102785]: pgmap v491: 97 pgs: 97 active+clean; 99 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 249 op/s 2023-09-13T09:45:55.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 218824 3.47 MB/sec execute 195 sec latency 12.721 ms 2023-09-13T09:45:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:55.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:45:55.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:55.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:45:55.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:45:56.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 220352 3.51 MB/sec execute 196 sec latency 12.325 ms 2023-09-13T09:45:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:56 smithi006 ceph-mon[98665]: pgmap v492: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 277 op/s 2023-09-13T09:45:56.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:56 smithi053 ceph-mon[102373]: pgmap v492: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 277 op/s 2023-09-13T09:45:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:56 smithi131 ceph-mon[102785]: pgmap v492: 97 pgs: 97 active+clean; 100 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 2.0 MiB/s wr, 277 op/s 2023-09-13T09:45:57.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 222166 3.52 MB/sec execute 197 sec latency 13.104 ms 2023-09-13T09:45:58.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 223822 3.57 MB/sec execute 198 sec latency 11.916 ms 2023-09-13T09:45:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:45:58 smithi006 ceph-mon[98665]: pgmap v493: 97 pgs: 97 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 259 op/s 2023-09-13T09:45:58.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:45:58 smithi053 ceph-mon[102373]: pgmap v493: 97 pgs: 97 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 259 op/s 2023-09-13T09:45:58.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:45:58 smithi131 ceph-mon[102785]: pgmap v493: 97 pgs: 97 active+clean; 102 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.9 MiB/s wr, 259 op/s 2023-09-13T09:45:59.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 225162 3.58 MB/sec execute 199 sec latency 39.891 ms 2023-09-13T09:46:00.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 227296 3.63 MB/sec execute 200 sec latency 44.685 ms 2023-09-13T09:46:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:00 smithi006 ceph-mon[98665]: pgmap v494: 97 pgs: 97 active+clean; 103 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 245 op/s 2023-09-13T09:46:00.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:00 smithi053 ceph-mon[102373]: pgmap v494: 97 pgs: 97 active+clean; 103 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 245 op/s 2023-09-13T09:46:00.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:00 smithi131 ceph-mon[102785]: pgmap v494: 97 pgs: 97 active+clean; 103 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.8 MiB/s wr, 245 op/s 2023-09-13T09:46:01.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 228482 3.64 MB/sec execute 201 sec latency 12.352 ms 2023-09-13T09:46:02.167 INFO:tasks.workunit.client.0.smithi006.stdout: 1 230689 3.68 MB/sec execute 202 sec latency 79.321 ms 2023-09-13T09:46:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:02 smithi006 ceph-mon[98665]: pgmap v495: 97 pgs: 97 active+clean; 103 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 259 op/s 2023-09-13T09:46:02.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:02 smithi053 ceph-mon[102373]: pgmap v495: 97 pgs: 97 active+clean; 103 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 259 op/s 2023-09-13T09:46:02.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:02 smithi131 ceph-mon[102785]: pgmap v495: 97 pgs: 97 active+clean; 103 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.7 MiB/s wr, 259 op/s 2023-09-13T09:46:03.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 231583 3.68 MB/sec execute 203 sec latency 14.192 ms 2023-09-13T09:46:04.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 233877 3.72 MB/sec execute 204 sec latency 17.906 ms 2023-09-13T09:46:04.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:04 smithi006 ceph-mon[98665]: pgmap v496: 97 pgs: 97 active+clean; 105 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 249 op/s 2023-09-13T09:46:04.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:04 smithi053 ceph-mon[102373]: pgmap v496: 97 pgs: 97 active+clean; 105 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 249 op/s 2023-09-13T09:46:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:04 smithi131 ceph-mon[102785]: pgmap v496: 97 pgs: 97 active+clean; 105 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.5 MiB/s wr, 249 op/s 2023-09-13T09:46:05.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 234870 3.73 MB/sec execute 205 sec latency 13.971 ms 2023-09-13T09:46:06.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 237079 3.77 MB/sec execute 206 sec latency 11.805 ms 2023-09-13T09:46:06.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:06 smithi053 ceph-mon[102373]: pgmap v497: 97 pgs: 97 active+clean; 107 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 234 op/s 2023-09-13T09:46:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:06 smithi006 ceph-mon[98665]: pgmap v497: 97 pgs: 97 active+clean; 107 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 234 op/s 2023-09-13T09:46:06.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:06 smithi131 ceph-mon[102785]: pgmap v497: 97 pgs: 97 active+clean; 107 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 234 op/s 2023-09-13T09:46:07.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 238198 3.79 MB/sec execute 207 sec latency 28.863 ms 2023-09-13T09:46:08.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 240187 3.80 MB/sec execute 208 sec latency 42.516 ms 2023-09-13T09:46:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:08 smithi006 ceph-mon[98665]: pgmap v498: 97 pgs: 97 active+clean; 109 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 249 op/s 2023-09-13T09:46:08.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:08 smithi053 ceph-mon[102373]: pgmap v498: 97 pgs: 97 active+clean; 109 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 249 op/s 2023-09-13T09:46:08.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:08 smithi131 ceph-mon[102785]: pgmap v498: 97 pgs: 97 active+clean; 109 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.2 MiB/s wr, 249 op/s 2023-09-13T09:46:09.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 241636 3.84 MB/sec execute 209 sec latency 22.019 ms 2023-09-13T09:46:10.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 243629 3.86 MB/sec execute 210 sec latency 13.209 ms 2023-09-13T09:46:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:10 smithi006 ceph-mon[98665]: pgmap v499: 97 pgs: 97 active+clean; 110 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 203 op/s 2023-09-13T09:46:10.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:10 smithi053 ceph-mon[102373]: pgmap v499: 97 pgs: 97 active+clean; 110 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 203 op/s 2023-09-13T09:46:10.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:10 smithi131 ceph-mon[102785]: pgmap v499: 97 pgs: 97 active+clean; 110 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 1.1 MiB/s wr, 203 op/s 2023-09-13T09:46:11.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 245166 3.89 MB/sec execute 211 sec latency 15.733 ms 2023-09-13T09:46:12.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 246927 3.90 MB/sec execute 212 sec latency 12.764 ms 2023-09-13T09:46:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:12 smithi006 ceph-mon[98665]: pgmap v500: 97 pgs: 97 active+clean; 111 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 1.1 MiB/s wr, 214 op/s 2023-09-13T09:46:12.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:12 smithi053 ceph-mon[102373]: pgmap v500: 97 pgs: 97 active+clean; 111 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 1.1 MiB/s wr, 214 op/s 2023-09-13T09:46:12.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:12 smithi131 ceph-mon[102785]: pgmap v500: 97 pgs: 97 active+clean; 111 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 928 KiB/s rd, 1.1 MiB/s wr, 214 op/s 2023-09-13T09:46:12.778 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:46:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 -- 172.21.15.6:0/2656554679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1041d0 msgr2=0x7f2a1c1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 --2- 172.21.15.6:0/2656554679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1041d0 0x7f2a1c1065c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f2a10009990 tx=0x7f2a10009ca0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 -- 172.21.15.6:0/2656554679 shutdown_connections 2023-09-13T09:46:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 --2- 172.21.15.6:0/2656554679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a1c106b00 0x7f2a1c108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 --2- 172.21.15.6:0/2656554679 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c1018a0 0x7f2a1c103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 --2- 172.21.15.6:0/2656554679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1041d0 0x7f2a1c1065c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 -- 172.21.15.6:0/2656554679 >> 172.21.15.6:0/2656554679 conn(0x7f2a1c0fb250 msgr2=0x7f2a1c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 -- 172.21.15.6:0/2656554679 shutdown_connections 2023-09-13T09:46:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 -- 172.21.15.6:0/2656554679 wait complete. 2023-09-13T09:46:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.925+0000 7f2a212b0700 1 Processor -- start 2023-09-13T09:46:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a212b0700 1 -- start start 2023-09-13T09:46:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a212b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1018a0 0x7f2a1c198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a212b0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c1041d0 0x7f2a1c1991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a212b0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a1c106b00 0x7f2a1c1a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a212b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c1a07a0 con 0x7f2a1c1018a0 2023-09-13T09:46:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a212b0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c1a0910 con 0x7f2a1c1041d0 2023-09-13T09:46:12.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a212b0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c1a0ad0 con 0x7f2a1c106b00 2023-09-13T09:46:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1018a0 0x7f2a1c198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1018a0 0x7f2a1c198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37892/0 (socket says 172.21.15.6:37892) 2023-09-13T09:46:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 -- 172.21.15.6:0/3432677130 learned_addr learned my addr 172.21.15.6:0/3432677130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c1041d0 0x7f2a1c1991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a1c106b00 0x7f2a1c1a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 -- 172.21.15.6:0/3432677130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a1c106b00 msgr2=0x7f2a1c1a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a1c106b00 0x7f2a1c1a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 -- 172.21.15.6:0/3432677130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c1041d0 msgr2=0x7f2a1c1991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c1041d0 0x7f2a1c1991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 -- 172.21.15.6:0/3432677130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a100095f0 con 0x7f2a1c1018a0 2023-09-13T09:46:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1018a0 0x7f2a1c198c60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00e9a0 tx=0x7f2a0c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.926+0000 7f2a03fff700 1 -- 172.21.15.6:0/3432677130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c009790 con 0x7f2a1c1018a0 2023-09-13T09:46:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.927+0000 7f2a03fff700 1 -- 172.21.15.6:0/3432677130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a0c010430 con 0x7f2a1c1018a0 2023-09-13T09:46:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.927+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c1a0db0 con 0x7f2a1c1018a0 2023-09-13T09:46:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.927+0000 7f2a03fff700 1 -- 172.21.15.6:0/3432677130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c018680 con 0x7f2a1c1018a0 2023-09-13T09:46:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.927+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c1a1200 con 0x7f2a1c1018a0 2023-09-13T09:46:12.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.929+0000 7f2a03fff700 1 -- 172.21.15.6:0/3432677130 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2a0c0105a0 con 0x7f2a1c1018a0 2023-09-13T09:46:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.930+0000 7f2a03fff700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2a040a0640 0x7f2a040a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.930+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2a040a0640 0x7f2a040a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.930+0000 7f2a03fff700 1 -- 172.21.15.6:0/3432677130 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2a0c014070 con 0x7f2a1c1018a0 2023-09-13T09:46:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2a040a0640 0x7f2a040a2b00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b2e0 tx=0x7f2a10005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 Processor -- start 2023-09-13T09:46:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 -- start start 2023-09-13T09:46:12.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a6060 0x55aaf93a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf92fd780 con 0x55aaf93a4a00 2023-09-13T09:46:12.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf92fb0a0 con 0x55aaf93a5700 2023-09-13T09:46:12.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf92f6990 con 0x55aaf93a6060 2023-09-13T09:46:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a1affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93a4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37904/0 (socket says 172.21.15.6:37904) 2023-09-13T09:46:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/4087352846 learned_addr learned my addr 172.21.15.6:0/4087352846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:12.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.931+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a6060 0x55aaf93a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/4087352846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a6060 msgr2=0x55aaf93a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a6060 0x55aaf93a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/4087352846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 msgr2=0x55aaf93a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/4087352846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaf9176630 con 0x55aaf93a4a00 2023-09-13T09:46:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93a4e80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098f0 tx=0x7f2a14009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2f7f0bcdbdfb686 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a017fa700 1 -- 172.21.15.6:0/4087352846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14019070 con 0x55aaf93a4a00 2023-09-13T09:46:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a017fa700 1 -- 172.21.15.6:0/4087352846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a1400f040 con 0x55aaf93a4a00 2023-09-13T09:46:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.932+0000 7f2a017fa700 1 -- 172.21.15.6:0/4087352846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14007a60 con 0x55aaf93a4a00 2023-09-13T09:46:12.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 -- 172.21.15.6:0/4087352846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 msgr2=0x55aaf93a4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93a4e80 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098f0 tx=0x7f2a14009c00 comp rx=0 tx=0).stop 2023-09-13T09:46:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 -- 172.21.15.6:0/4087352846 shutdown_connections 2023-09-13T09:46:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93a4e80 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/4087352846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a6060 0x55aaf93a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 -- 172.21.15.6:0/4087352846 >> 172.21.15.6:0/4087352846 conn(0x55aaf9302c80 msgr2=0x55aaf939ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 -- 172.21.15.6:0/4087352846 shutdown_connections 2023-09-13T09:46:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 -- 172.21.15.6:0/4087352846 wait complete. 2023-09-13T09:46:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 -- start start 2023-09-13T09:46:12.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.933+0000 7f2a2d495b80 1 Processor -- start 2023-09-13T09:46:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93b6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a5700 0x55aaf93b6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a6060 0x55aaf93bdc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf9294bb0 con 0x55aaf93a4a00 2023-09-13T09:46:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf92948b0 con 0x55aaf93a6060 2023-09-13T09:46:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf9178920 con 0x55aaf93a5700 2023-09-13T09:46:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 10 client.0 _ll_register_callbacks cb 0x55aaf9292680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:12.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37906/0 (socket says 172.21.15.6:37906) 2023-09-13T09:46:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 -- 172.21.15.6:0/3993890225 learned_addr learned my addr 172.21.15.6:0/3993890225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a5700 0x55aaf93b6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a6060 0x55aaf93bdc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 -- 172.21.15.6:0/3993890225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a5700 msgr2=0x55aaf93b6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a5700 0x55aaf93b6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 -- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a6060 msgr2=0x55aaf93bdc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a6060 0x55aaf93bdc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 -- 172.21.15.6:0/3993890225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a14003c50 con 0x55aaf93a4a00 2023-09-13T09:46:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93b6710 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c099210 tx=0x7f2a0c099c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08e595600e02add server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f29feff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:12.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f29feff5700 1 -- 172.21.15.6:0/3993890225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c09d170 con 0x55aaf93a4a00 2023-09-13T09:46:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f29feff5700 1 -- 172.21.15.6:0/3993890225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2a0c09d340 con 0x55aaf93a4a00 2023-09-13T09:46:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.934+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aaf9397670 con 0x55aaf93a4a00 2023-09-13T09:46:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f29feff5700 1 -- 172.21.15.6:0/3993890225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a0c0a1580 con 0x55aaf93a4a00 2023-09-13T09:46:12.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 10 client.17139 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55aaf930e7a0 con 0x55aaf93a4a00 2023-09-13T09:46:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f29feff5700 1 -- 172.21.15.6:0/3993890225 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a0c063080 con 0x55aaf93a4a00 2023-09-13T09:46:12.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f29feff5700 1 -- 172.21.15.6:0/3993890225 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2a0c065120 con 0x55aaf93a4a00 2023-09-13T09:46:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 10 client.17139 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 10 client.17139 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 20 client.17139 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:12.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf93c2490 0x55aaf93c48b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 4 client.17139 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aaf92ef970 con 0x55aaf93c2490 2023-09-13T09:46:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.935+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf93c2490 0x55aaf93c48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.936+0000 7f29feff5700 10 client.17139 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.936+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf93c2490 0x55aaf93c48b0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a86a8d43352fecb server_cookie=9d6ffe61518dd9b8 in_seq=0 out_seq=0 2023-09-13T09:46:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.936+0000 7f29feff5700 1 -- 172.21.15.6:0/3993890225 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aaf92ef970 con 0x55aaf93c2490 2023-09-13T09:46:12.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.936+0000 7f29feff5700 10 client.17139 handle_command_reply: tid=0 2023-09-13T09:46:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.936+0000 7f2a2d495b80 1 client.17139 shutdown 2023-09-13T09:46:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.936+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 msgr2=0x55aaf93b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.936+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93b6710 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c099210 tx=0x7f2a0c099c90 comp rx=0 tx=0).stop 2023-09-13T09:46:12.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 shutdown_connections 2023-09-13T09:46:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a6060 0x55aaf93bdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf93c2490 0x55aaf93c48b0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a4a00 0x55aaf93b6710 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3993890225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a5700 0x55aaf93b6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 >> 172.21.15.6:0/3993890225 conn(0x55aaf9302c80 msgr2=0x55aaf939eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f29feff5700 0 client.17139 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:12.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 shutdown_connections 2023-09-13T09:46:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3993890225 wait complete. 2023-09-13T09:46:12.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.937+0000 7f2a2d495b80 20 client.17139 trim_cache size 0 max 16384 2023-09-13T09:46:12.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 Processor -- start 2023-09-13T09:46:12.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 -- start start 2023-09-13T09:46:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93a88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf939b8e0 con 0x55aaf93a6060 2023-09-13T09:46:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf9397490 con 0x55aaf93a5700 2023-09-13T09:46:12.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf93a9420 con 0x55aaf93a4a00 2023-09-13T09:46:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93a88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93a88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37918/0 (socket says 172.21.15.6:37918) 2023-09-13T09:46:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/1587176867 learned_addr learned my addr 172.21.15.6:0/1587176867 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.954+0000 7f2a1affd700 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/1587176867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 msgr2=0x55aaf93a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/1587176867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 msgr2=0x55aaf93bdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/1587176867 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aaf9122de0 con 0x55aaf93a6060 2023-09-13T09:46:12.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a1a7fc700 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:12.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93a88e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098f0 tx=0x7f2a14009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8d071c096a756a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:12.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a01ffb700 1 -- 172.21.15.6:0/1587176867 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14019040 con 0x55aaf93a6060 2023-09-13T09:46:12.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a01ffb700 1 -- 172.21.15.6:0/1587176867 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a14004c90 con 0x55aaf93a6060 2023-09-13T09:46:12.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.955+0000 7f2a01ffb700 1 -- 172.21.15.6:0/1587176867 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14015480 con 0x55aaf93a6060 2023-09-13T09:46:12.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- 172.21.15.6:0/1587176867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 msgr2=0x55aaf93a88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93a88e0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098f0 tx=0x7f2a14009510 comp rx=0 tx=0).stop 2023-09-13T09:46:12.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- 172.21.15.6:0/1587176867 shutdown_connections 2023-09-13T09:46:12.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93a88e0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/1587176867 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- 172.21.15.6:0/1587176867 >> 172.21.15.6:0/1587176867 conn(0x55aaf9302c80 msgr2=0x55aaf93abd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- 172.21.15.6:0/1587176867 shutdown_connections 2023-09-13T09:46:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- 172.21.15.6:0/1587176867 wait complete. 2023-09-13T09:46:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- start start 2023-09-13T09:46:12.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 Processor -- start 2023-09-13T09:46:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf93ba8c0 con 0x55aaf93a6060 2023-09-13T09:46:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf93baa30 con 0x55aaf93a5700 2023-09-13T09:46:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aaf93babf0 con 0x55aaf93a4a00 2023-09-13T09:46:12.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a2d495b80 10 client.0 _ll_register_callbacks cb 0x55aaf9292680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a1affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93ba1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37924/0 (socket says 172.21.15.6:37924) 2023-09-13T09:46:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a1a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.956+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/3513194275 learned_addr learned my addr 172.21.15.6:0/3513194275 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/3513194275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 msgr2=0x55aaf93bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/3513194275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 msgr2=0x55aaf93bdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:12.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a1b7fe700 1 -- 172.21.15.6:0/3513194275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c109b00 con 0x55aaf93a6060 2023-09-13T09:46:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a1b7fe700 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93ba1b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098c0 tx=0x7f2a14007460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=104938cc2d3b2153 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f29feff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:12.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f29feff5700 1 -- 172.21.15.6:0/3513194275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14019030 con 0x55aaf93a6060 2023-09-13T09:46:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2a1400f040 con 0x55aaf93a6060 2023-09-13T09:46:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f29feff5700 1 -- 172.21.15.6:0/3513194275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2a14025020 con 0x55aaf93a6060 2023-09-13T09:46:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f29feff5700 1 -- 172.21.15.6:0/3513194275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a140076d0 con 0x55aaf93a6060 2023-09-13T09:46:12.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a2d495b80 10 client.17145 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55aaf9176630 con 0x55aaf93a6060 2023-09-13T09:46:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f29feff5700 1 -- 172.21.15.6:0/3513194275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2a1400f040 con 0x55aaf93a6060 2023-09-13T09:46:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f29feff5700 1 -- 172.21.15.6:0/3513194275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2a14015af0 con 0x55aaf93a6060 2023-09-13T09:46:12.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.957+0000 7f2a2d495b80 10 client.17145 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f2a2d495b80 10 client.17145 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f2a2d495b80 20 client.17145 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf9417680 0x55aaf9419aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f2a2d495b80 4 client.17145 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:46:12.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aaf92b0050 con 0x55aaf9417680 2023-09-13T09:46:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf9417680 0x55aaf9419aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f29feff5700 10 client.17145 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.958+0000 7f2a1affd700 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf9417680 0x55aaf9419aa0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc3d923ceba44ae9 server_cookie=a403691ba7c829e0 in_seq=0 out_seq=0 2023-09-13T09:46:12.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.959+0000 7f29feff5700 1 -- 172.21.15.6:0/3513194275 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55aaf92b0050 con 0x55aaf9417680 2023-09-13T09:46:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.959+0000 7f29feff5700 10 client.17145 handle_command_reply: tid=0 2023-09-13T09:46:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.959+0000 7f2a2d495b80 1 client.17145 shutdown 2023-09-13T09:46:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 msgr2=0x55aaf93ba1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93ba1b0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2a140098c0 tx=0x7f2a14007460 comp rx=0 tx=0).stop 2023-09-13T09:46:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 shutdown_connections 2023-09-13T09:46:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aaf9417680 0x55aaf9419aa0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aaf93a6060 0x55aaf93ba1b0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f29feff5700 0 client.17145 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aaf93a4a00 0x55aaf93bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 --2- 172.21.15.6:0/3513194275 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aaf93a5700 0x55aaf93bdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 >> 172.21.15.6:0/3513194275 conn(0x55aaf9302c80 msgr2=0x55aaf93a88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 shutdown_connections 2023-09-13T09:46:12.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 1 -- 172.21.15.6:0/3513194275 wait complete. 2023-09-13T09:46:12.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a2d495b80 20 client.17145 trim_cache size 0 max 16384 2023-09-13T09:46:12.991 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:46:12.992 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:46:12.992 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:46:12.992 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:46:12.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2a040a0640 msgr2=0x7f2a040a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a212b0700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2a040a0640 0x7f2a040a2b00 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000b2e0 tx=0x7f2a10005fb0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1018a0 msgr2=0x7f2a1c198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:12.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.960+0000 7f2a212b0700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1018a0 0x7f2a1c198c60 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00e9a0 tx=0x7f2a0c00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 shutdown_connections 2023-09-13T09:46:12.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a1c106b00 0x7f2a1c1a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2a040a0640 0x7f2a040a2b00 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a1c1018a0 0x7f2a1c198c60 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 --2- 172.21.15.6:0/3432677130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2a1c1041d0 0x7f2a1c1991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:12.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 >> 172.21.15.6:0/3432677130 conn(0x7f2a1c0fb250 msgr2=0x7f2a1c0fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:12.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 shutdown_connections 2023-09-13T09:46:12.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:12.961+0000 7f2a212b0700 1 -- 172.21.15.6:0/3432677130 wait complete. 2023-09-13T09:46:12.997 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:46:12.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:46:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 -- 172.21.15.6:0/119366929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040ffc90 msgr2=0x7fd7041000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 --2- 172.21.15.6:0/119366929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040ffc90 0x7fd7041000b0 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fd7000099c0 tx=0x7fd700009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 -- 172.21.15.6:0/119366929 shutdown_connections 2023-09-13T09:46:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 --2- 172.21.15.6:0/119366929 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd704101820 0x7fd7041080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 --2- 172.21.15.6:0/119366929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7040ffc90 0x7fd7041000b0 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 --2- 172.21.15.6:0/119366929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704100e80 0x7fd7041012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 -- 172.21.15.6:0/119366929 >> 172.21.15.6:0/119366929 conn(0x7fd7040fb220 msgr2=0x7fd7040fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 -- 172.21.15.6:0/119366929 shutdown_connections 2023-09-13T09:46:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.128+0000 7fd70c72f700 1 -- 172.21.15.6:0/119366929 wait complete. 2023-09-13T09:46:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 Processor -- start 2023-09-13T09:46:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 -- start start 2023-09-13T09:46:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040ffc90 0x7fd704103f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704100e80 0x7fd704102570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd704101820 0x7fd704102ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd704103250 con 0x7fd704101820 2023-09-13T09:46:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041033c0 con 0x7fd7040ffc90 2023-09-13T09:46:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70c72f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7041a0ad0 con 0x7fd704100e80 2023-09-13T09:46:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd704101820 0x7fd704102ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd704101820 0x7fd704102ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37938/0 (socket says 172.21.15.6:37938) 2023-09-13T09:46:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 -- 172.21.15.6:0/2342628355 learned_addr learned my addr 172.21.15.6:0/2342628355 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70a4cb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040ffc90 0x7fd704103f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd709cca700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704100e80 0x7fd704102570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 -- 172.21.15.6:0/2342628355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704100e80 msgr2=0x7fd704102570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704100e80 0x7fd704102570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 -- 172.21.15.6:0/2342628355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040ffc90 msgr2=0x7fd704103f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040ffc90 0x7fd704103f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 -- 172.21.15.6:0/2342628355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000095f0 con 0x7fd704101820 2023-09-13T09:46:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.129+0000 7fd70accc700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd704101820 0x7fd704102ab0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007ee0 tx=0x7fd6fc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.130+0000 7fd6fb7fe700 1 -- 172.21.15.6:0/2342628355 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc00dd20 con 0x7fd704101820 2023-09-13T09:46:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.130+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7041a0db0 con 0x7fd704101820 2023-09-13T09:46:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.130+0000 7fd6fb7fe700 1 -- 172.21.15.6:0/2342628355 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6fc00f040 con 0x7fd704101820 2023-09-13T09:46:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.130+0000 7fd6fb7fe700 1 -- 172.21.15.6:0/2342628355 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0048a0 con 0x7fd704101820 2023-09-13T09:46:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.130+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7041a1210 con 0x7fd704101820 2023-09-13T09:46:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.131+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd704107d70 con 0x7fd704101820 2023-09-13T09:46:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.132+0000 7fd6fb7fe700 1 -- 172.21.15.6:0/2342628355 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd6fc003a00 con 0x7fd704101820 2023-09-13T09:46:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.132+0000 7fd6fb7fe700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f00a0640 0x7fd6f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.132+0000 7fd70a4cb700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f00a0640 0x7fd6f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.133+0000 7fd6fb7fe700 1 -- 172.21.15.6:0/2342628355 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6fc0cb400 con 0x7fd704101820 2023-09-13T09:46:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.133+0000 7fd70a4cb700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f00a0640 0x7fd6f00a2b00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd700009990 tx=0x7fd7000051e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.137+0000 7fd6fb7fe700 1 -- 172.21.15.6:0/2342628355 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd6fc04ee10 con 0x7fd704101820 2023-09-13T09:46:13.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 248617 3.95 MB/sec execute 213 sec latency 19.857 ms 2023-09-13T09:46:13.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.397+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd70410b4a0 con 0x7fd704101820 2023-09-13T09:46:13.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.398+0000 7fd6fb7fe700 1 -- 172.21.15.6:0/2342628355 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fd6fc094ee0 con 0x7fd704101820 2023-09-13T09:46:13.398 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:46:13.399 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:46:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f00a0640 msgr2=0x7fd6f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f00a0640 0x7fd6f00a2b00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd700009990 tx=0x7fd7000051e0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd704101820 msgr2=0x7fd704102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd704101820 0x7fd704102ab0 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc007ee0 tx=0x7fd6fc00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 shutdown_connections 2023-09-13T09:46:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f00a0640 0x7fd6f00a2b00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd704101820 0x7fd704102ab0 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd7040ffc90 0x7fd704103f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 --2- 172.21.15.6:0/2342628355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd704100e80 0x7fd704102570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 >> 172.21.15.6:0/2342628355 conn(0x7fd7040fb220 msgr2=0x7fd7040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 shutdown_connections 2023-09-13T09:46:13.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.400+0000 7fd70c72f700 1 -- 172.21.15.6:0/2342628355 wait complete. 2023-09-13T09:46:13.403 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:46:13.413 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:46:13.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 -- 172.21.15.6:0/3990050637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 msgr2=0x7f3114101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 --2- 172.21.15.6:0/3990050637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f3114101310 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f31080099c0 tx=0x7f3108009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 -- 172.21.15.6:0/3990050637 shutdown_connections 2023-09-13T09:46:13.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 --2- 172.21.15.6:0/3990050637 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3114101850 0x7f3114108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 --2- 172.21.15.6:0/3990050637 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31140ffcc0 0x7f31141000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 --2- 172.21.15.6:0/3990050637 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f3114101310 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 -- 172.21.15.6:0/3990050637 >> 172.21.15.6:0/3990050637 conn(0x7f31140fb250 msgr2=0x7f31140fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 -- 172.21.15.6:0/3990050637 shutdown_connections 2023-09-13T09:46:13.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.545+0000 7f311aa5a700 1 -- 172.21.15.6:0/3990050637 wait complete. 2023-09-13T09:46:13.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 Processor -- start 2023-09-13T09:46:13.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 -- start start 2023-09-13T09:46:13.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31140ffcc0 0x7f3114068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f311419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3114101850 0x7f311419dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311419e580 con 0x7f3114100eb0 2023-09-13T09:46:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311419e6f0 con 0x7f31140ffcc0 2023-09-13T09:46:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f311aa5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311419e8b0 con 0x7f3114101850 2023-09-13T09:46:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f31137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f311419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f31137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f311419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37950/0 (socket says 172.21.15.6:37950) 2023-09-13T09:46:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f31137fe700 1 -- 172.21.15.6:0/1885633678 learned_addr learned my addr 172.21.15.6:0/1885633678 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f3118ff7700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3114101850 0x7f311419dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.546+0000 7f3113fff700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31140ffcc0 0x7f3114068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31137fe700 1 -- 172.21.15.6:0/1885633678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3114101850 msgr2=0x7f311419dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31137fe700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3114101850 0x7f311419dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31137fe700 1 -- 172.21.15.6:0/1885633678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31140ffcc0 msgr2=0x7f3114068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31137fe700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31140ffcc0 0x7f3114068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31137fe700 1 -- 172.21.15.6:0/1885633678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31080095f0 con 0x7f3114100eb0 2023-09-13T09:46:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31137fe700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f311419b7a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3108009fd0 tx=0x7f3108009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31117fa700 1 -- 172.21.15.6:0/1885633678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310801d070 con 0x7f3114100eb0 2023-09-13T09:46:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311419eb30 con 0x7f3114100eb0 2023-09-13T09:46:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31117fa700 1 -- 172.21.15.6:0/1885633678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3108005030 con 0x7f3114100eb0 2023-09-13T09:46:13.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f31117fa700 1 -- 172.21.15.6:0/1885633678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108004a90 con 0x7f3114100eb0 2023-09-13T09:46:13.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.547+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311419efb0 con 0x7f3114100eb0 2023-09-13T09:46:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.549+0000 7f31117fa700 1 -- 172.21.15.6:0/1885633678 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f31080051a0 con 0x7f3114100eb0 2023-09-13T09:46:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.550+0000 7f31117fa700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30fc0a0640 0x7f30fc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.550+0000 7f3113fff700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30fc0a0640 0x7f30fc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.550+0000 7f31117fa700 1 -- 172.21.15.6:0/1885633678 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31080cc990 con 0x7f3114100eb0 2023-09-13T09:46:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3113fff700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30fc0a0640 0x7f30fc0a2b00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3114100d10 tx=0x7f3104009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 Processor -- start 2023-09-13T09:46:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 -- start start 2023-09-13T09:46:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347edbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edc060 0x556347eda4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edaa00 0x556347edae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347e33780 con 0x556347edc060 2023-09-13T09:46:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347e310a0 con 0x556347edb700 2023-09-13T09:46:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.551+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347e2c990 con 0x556347edaa00 2023-09-13T09:46:13.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f3113fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347edbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f31137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edc060 0x556347eda4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f3113fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347edbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59712/0 (socket says 172.21.15.6:59712) 2023-09-13T09:46:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f3113fff700 1 -- 172.21.15.6:0/3253314147 learned_addr learned my addr 172.21.15.6:0/3253314147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f3118ff7700 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edaa00 0x556347edae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f31137fe700 1 -- 172.21.15.6:0/3253314147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edaa00 msgr2=0x556347edae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f31137fe700 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edaa00 0x556347edae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f31137fe700 1 -- 172.21.15.6:0/3253314147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 msgr2=0x556347edbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f31137fe700 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347edbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f31137fe700 1 -- 172.21.15.6:0/3253314147 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556347cac630 con 0x556347edc060 2023-09-13T09:46:13.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f3113fff700 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347edbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f31137fe700 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edc060 0x556347eda4c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f31080ca490 tx=0x7f310809a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9132ce96f86c2f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f30fa7fc700 1 -- 172.21.15.6:0/3253314147 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080a21a0 con 0x556347edc060 2023-09-13T09:46:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f30fa7fc700 1 -- 172.21.15.6:0/3253314147 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31080a0070 con 0x556347edc060 2023-09-13T09:46:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.552+0000 7f30fa7fc700 1 -- 172.21.15.6:0/3253314147 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31080996b0 con 0x556347edc060 2023-09-13T09:46:13.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 -- 172.21.15.6:0/3253314147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edc060 msgr2=0x556347eda4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edc060 0x556347eda4c0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f31080ca490 tx=0x7f310809a940 comp rx=0 tx=0).stop 2023-09-13T09:46:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 -- 172.21.15.6:0/3253314147 shutdown_connections 2023-09-13T09:46:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edaa00 0x556347edae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347edbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/3253314147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edc060 0x556347eda4c0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 -- 172.21.15.6:0/3253314147 >> 172.21.15.6:0/3253314147 conn(0x556347e38c80 msgr2=0x556347ed4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 -- 172.21.15.6:0/3253314147 shutdown_connections 2023-09-13T09:46:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 -- 172.21.15.6:0/3253314147 wait complete. 2023-09-13T09:46:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.553+0000 7f3126c3fb80 1 -- start start 2023-09-13T09:46:13.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 1 Processor -- start 2023-09-13T09:46:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347ee3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347ee40e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347eeb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347dcabb0 con 0x556347edaa00 2023-09-13T09:46:13.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347dca8b0 con 0x556347edb700 2023-09-13T09:46:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347cae920 con 0x556347edc060 2023-09-13T09:46:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3126c3fb80 10 client.0 _ll_register_callbacks cb 0x556347dc8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3113fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347ee3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3113fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347ee3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37962/0 (socket says 172.21.15.6:37962) 2023-09-13T09:46:13.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f31137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347ee40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3113fff700 1 -- 172.21.15.6:0/4249394956 learned_addr learned my addr 172.21.15.6:0/4249394956 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3118ff7700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347eeb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f31137fe700 1 -- 172.21.15.6:0/4249394956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 msgr2=0x556347eeb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f31137fe700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347eeb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f31137fe700 1 -- 172.21.15.6:0/4249394956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 msgr2=0x556347ee3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f31137fe700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347ee3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f31137fe700 1 -- 172.21.15.6:0/4249394956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311419efb0 con 0x556347edb700 2023-09-13T09:46:13.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3118ff7700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347eeb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.554+0000 7f3113fff700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347ee3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f31137fe700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347ee40e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f31080ca490 tx=0x7f3108099a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52b309098561d4ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f30f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:13.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f30f37fe700 1 -- 172.21.15.6:0/4249394956 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108098300 con 0x556347edb700 2023-09-13T09:46:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556347ecd670 con 0x556347edb700 2023-09-13T09:46:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f30f37fe700 1 -- 172.21.15.6:0/4249394956 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3108098560 con 0x556347edb700 2023-09-13T09:46:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f30f37fe700 1 -- 172.21.15.6:0/4249394956 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31080a21a0 con 0x556347edb700 2023-09-13T09:46:13.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 10 client.26576 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x556347e447a0 con 0x556347edb700 2023-09-13T09:46:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f30f37fe700 1 -- 172.21.15.6:0/4249394956 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3108066020 con 0x556347edb700 2023-09-13T09:46:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f30f37fe700 1 -- 172.21.15.6:0/4249394956 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f31080960d0 con 0x556347edb700 2023-09-13T09:46:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 10 client.26576 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:13.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 10 client.26576 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:46:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 20 client.26576 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347eef450 0x556347ef1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 4 client.26576 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.555+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556347e25970 con 0x556347eef450 2023-09-13T09:46:13.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.556+0000 7f3113fff700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347eef450 0x556347ef1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.556+0000 7f30f37fe700 10 client.26576 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.556+0000 7f3113fff700 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347eef450 0x556347ef1870 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=91334f7f3a855831 server_cookie=54aa67142c026539 in_seq=0 out_seq=0 2023-09-13T09:46:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f30f37fe700 1 -- 172.21.15.6:0/4249394956 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556347e25970 con 0x556347eef450 2023-09-13T09:46:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f30f37fe700 10 client.26576 handle_command_reply: tid=0 2023-09-13T09:46:13.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 client.26576 shutdown 2023-09-13T09:46:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 msgr2=0x556347ee40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347ee40e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f31080ca490 tx=0x7f3108099a60 comp rx=0 tx=0).stop 2023-09-13T09:46:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 shutdown_connections 2023-09-13T09:46:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347eef450 0x556347ef1870 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347eeb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f30f37fe700 0 client.26576 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347ee3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/4249394956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347ee40e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 >> 172.21.15.6:0/4249394956 conn(0x556347e38c80 msgr2=0x556347ecf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 shutdown_connections 2023-09-13T09:46:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 1 -- 172.21.15.6:0/4249394956 wait complete. 2023-09-13T09:46:13.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.557+0000 7f3126c3fb80 20 client.26576 trim_cache size 0 max 16384 2023-09-13T09:46:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.570+0000 7f3126c3fb80 1 Processor -- start 2023-09-13T09:46:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3126c3fb80 1 -- start start 2023-09-13T09:46:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347eda4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edb700 0x556347eeba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edc060 0x556347ee1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347edf4c0 con 0x556347edaa00 2023-09-13T09:46:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347ecd400 con 0x556347edc060 2023-09-13T09:46:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347ef1ed0 con 0x556347edb700 2023-09-13T09:46:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347eda4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347eda4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37970/0 (socket says 172.21.15.6:37970) 2023-09-13T09:46:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3118ff7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edc060 0x556347ee1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 -- 172.21.15.6:0/1803688180 learned_addr learned my addr 172.21.15.6:0/1803688180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f31137fe700 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edb700 0x556347eeba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 -- 172.21.15.6:0/1803688180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edb700 msgr2=0x556347eeba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edb700 0x556347eeba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 -- 172.21.15.6:0/1803688180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edc060 msgr2=0x556347ee1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edc060 0x556347ee1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 -- 172.21.15.6:0/1803688180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556347c58de0 con 0x556347edaa00 2023-09-13T09:46:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3118ff7700 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edc060 0x556347ee1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f3113fff700 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347eda4c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f31040117d0 tx=0x7f3104014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a53eeba6f8620e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.571+0000 7f30faffd700 1 -- 172.21.15.6:0/1803688180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104022030 con 0x556347edaa00 2023-09-13T09:46:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f30faffd700 1 -- 172.21.15.6:0/1803688180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3104023040 con 0x556347edaa00 2023-09-13T09:46:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f30faffd700 1 -- 172.21.15.6:0/1803688180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310402a660 con 0x556347edaa00 2023-09-13T09:46:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 -- 172.21.15.6:0/1803688180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 msgr2=0x556347eda4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347eda4c0 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f31040117d0 tx=0x7f3104014000 comp rx=0 tx=0).stop 2023-09-13T09:46:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 -- 172.21.15.6:0/1803688180 shutdown_connections 2023-09-13T09:46:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edc060 0x556347ee1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347eda4c0 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/1803688180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edb700 0x556347eeba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 -- 172.21.15.6:0/1803688180 >> 172.21.15.6:0/1803688180 conn(0x556347e38c80 msgr2=0x556347ee2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 -- 172.21.15.6:0/1803688180 shutdown_connections 2023-09-13T09:46:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.572+0000 7f3126c3fb80 1 -- 172.21.15.6:0/1803688180 wait complete. 2023-09-13T09:46:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 -- start start 2023-09-13T09:46:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 Processor -- start 2023-09-13T09:46:13.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347f41430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347f43980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347f46010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347f46750 con 0x556347edaa00 2023-09-13T09:46:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347f468c0 con 0x556347edb700 2023-09-13T09:46:13.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556347f46a80 con 0x556347edc060 2023-09-13T09:46:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3126c3fb80 10 client.0 _ll_register_callbacks cb 0x556347dc8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3113fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347f41430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f31137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347f43980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3113fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347f41430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37976/0 (socket says 172.21.15.6:37976) 2023-09-13T09:46:13.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3113fff700 1 -- 172.21.15.6:0/2312012134 learned_addr learned my addr 172.21.15.6:0/2312012134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f3118ff7700 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347f46010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f31137fe700 1 -- 172.21.15.6:0/2312012134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 msgr2=0x556347f46010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f31137fe700 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347f46010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f31137fe700 1 -- 172.21.15.6:0/2312012134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 msgr2=0x556347f41430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f31137fe700 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347f41430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.573+0000 7f31137fe700 1 -- 172.21.15.6:0/2312012134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f310c009100 con 0x556347edb700 2023-09-13T09:46:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3113fff700 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347f41430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f31137fe700 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347f43980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31080a1c70 tx=0x7f31080ccb50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81e055a2d6ad393c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f30f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:13.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f30f37fe700 1 -- 172.21.15.6:0/2312012134 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3108099500 con 0x556347edb700 2023-09-13T09:46:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f30f37fe700 1 -- 172.21.15.6:0/2312012134 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31080a21a0 con 0x556347edb700 2023-09-13T09:46:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31080a0070 con 0x556347edb700 2023-09-13T09:46:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f30f37fe700 1 -- 172.21.15.6:0/2312012134 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f310809a8c0 con 0x556347edb700 2023-09-13T09:46:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 10 client.26582 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:13.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f310401d700 con 0x556347edb700 2023-09-13T09:46:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f30f37fe700 1 -- 172.21.15.6:0/2312012134 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31080a0070 con 0x556347edb700 2023-09-13T09:46:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f30f37fe700 1 -- 172.21.15.6:0/2312012134 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3108004c80 con 0x556347edb700 2023-09-13T09:46:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 10 client.26582 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 10 client.26582 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:46:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 20 client.26582 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:13.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347f47fd0 0x556347f4a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 4 client.26582 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.574+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556347de6050 con 0x556347f47fd0 2023-09-13T09:46:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3113fff700 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347f47fd0 0x556347f4a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3113fff700 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347f47fd0 0x556347f4a3c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ee63ebe30a9b1f48 server_cookie=f26774e382bbff0b in_seq=0 out_seq=0 2023-09-13T09:46:13.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f30f37fe700 10 client.26582 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f30f37fe700 1 -- 172.21.15.6:0/2312012134 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556347de6050 con 0x556347f47fd0 2023-09-13T09:46:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f30f37fe700 10 client.26582 handle_command_reply: tid=0 2023-09-13T09:46:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 client.26582 shutdown 2023-09-13T09:46:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 msgr2=0x556347f43980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347f43980 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f31080a1c70 tx=0x7f31080ccb50 comp rx=0 tx=0).stop 2023-09-13T09:46:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 shutdown_connections 2023-09-13T09:46:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556347f47fd0 0x556347f4a3c0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556347edc060 0x556347f46010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f30f37fe700 0 client.26582 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:13.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556347edaa00 0x556347f41430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 --2- 172.21.15.6:0/2312012134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556347edb700 0x556347f43980 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 >> 172.21.15.6:0/2312012134 conn(0x556347e38c80 msgr2=0x556347ede980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.575+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 shutdown_connections 2023-09-13T09:46:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f3126c3fb80 1 -- 172.21.15.6:0/2312012134 wait complete. 2023-09-13T09:46:13.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f3126c3fb80 20 client.26582 trim_cache size 0 max 16384 2023-09-13T09:46:13.606 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:13.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30fc0a0640 msgr2=0x7f30fc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30fc0a0640 0x7f30fc0a2b00 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f3114100d10 tx=0x7f3104009260 comp rx=0 tx=0).stop 2023-09-13T09:46:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 msgr2=0x7f311419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f311419b7a0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f3108009fd0 tx=0x7f3108009580 comp rx=0 tx=0).stop 2023-09-13T09:46:13.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 shutdown_connections 2023-09-13T09:46:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3114101850 0x7f311419dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f31140ffcc0 0x7f3114068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30fc0a0640 0x7f30fc0a2b00 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 --2- 172.21.15.6:0/1885633678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3114100eb0 0x7f311419b7a0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 >> 172.21.15.6:0/1885633678 conn(0x7f31140fb250 msgr2=0x7f31140fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 shutdown_connections 2023-09-13T09:46:13.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.576+0000 7f311aa5a700 1 -- 172.21.15.6:0/1885633678 wait complete. 2023-09-13T09:46:13.610 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:46:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 -- 172.21.15.6:0/2648208268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60600ffca0 msgr2=0x7f60601000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 --2- 172.21.15.6:0/2648208268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60600ffca0 0x7f60601000c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f60500099c0 tx=0x7f6050009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 -- 172.21.15.6:0/2648208268 shutdown_connections 2023-09-13T09:46:13.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 --2- 172.21.15.6:0/2648208268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6060101830 0x7f60601080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 --2- 172.21.15.6:0/2648208268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60600ffca0 0x7f60601000c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 --2- 172.21.15.6:0/2648208268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060100e90 0x7f60601012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 -- 172.21.15.6:0/2648208268 >> 172.21.15.6:0/2648208268 conn(0x7f60600fb210 msgr2=0x7f60600fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 -- 172.21.15.6:0/2648208268 shutdown_connections 2023-09-13T09:46:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.741+0000 7f60658e3700 1 -- 172.21.15.6:0/2648208268 wait complete. 2023-09-13T09:46:13.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 Processor -- start 2023-09-13T09:46:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 -- start start 2023-09-13T09:46:13.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60600ffca0 0x7f6060196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6060100e90 0x7f6060196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060101830 0x7f606019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606019e5e0 con 0x7f6060100e90 2023-09-13T09:46:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606019e720 con 0x7f6060101830 2023-09-13T09:46:13.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f60658e3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f606019e8b0 con 0x7f60600ffca0 2023-09-13T09:46:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f605effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60600ffca0 0x7f6060196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060101830 0x7f606019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f605effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60600ffca0 0x7f6060196a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41044/0 (socket says 172.21.15.6:41044) 2023-09-13T09:46:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f605effd700 1 -- 172.21.15.6:0/628039430 learned_addr learned my addr 172.21.15.6:0/628039430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.742+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060101830 0x7f606019e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59748/0 (socket says 172.21.15.6:59748) 2023-09-13T09:46:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605e7fc700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6060100e90 0x7f6060196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605effd700 1 -- 172.21.15.6:0/628039430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060101830 msgr2=0x7f606019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605effd700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060101830 0x7f606019e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605effd700 1 -- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6060100e90 msgr2=0x7f6060196fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605effd700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6060100e90 0x7f6060196fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605effd700 1 -- 172.21.15.6:0/628039430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60500095f0 con 0x7f60600ffca0 2023-09-13T09:46:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605f7fe700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060101830 0x7f606019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f605effd700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60600ffca0 0x7f6060196a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6050009fd0 tx=0x7f6050009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f60648e1700 1 -- 172.21.15.6:0/628039430 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605001d070 con 0x7f60600ffca0 2023-09-13T09:46:13.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f606019eb30 con 0x7f60600ffca0 2023-09-13T09:46:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f606019efb0 con 0x7f60600ffca0 2023-09-13T09:46:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f60648e1700 1 -- 172.21.15.6:0/628039430 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6050005030 con 0x7f60600ffca0 2023-09-13T09:46:13.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.743+0000 7f60648e1700 1 -- 172.21.15.6:0/628039430 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050004a90 con 0x7f60600ffca0 2023-09-13T09:46:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.746+0000 7f60648e1700 1 -- 172.21.15.6:0/628039430 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f60500051a0 con 0x7f60600ffca0 2023-09-13T09:46:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f60648e1700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60480a0640 0x7f60480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f605e7fc700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60480a0640 0x7f60480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f60648e1700 1 -- 172.21.15.6:0/628039430 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f60500cc830 con 0x7f60600ffca0 2023-09-13T09:46:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 Processor -- start 2023-09-13T09:46:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 -- start start 2023-09-13T09:46:13.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f605e7fc700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60480a0640 0x7f60480a2b00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c60 tx=0x7f6054009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27ccf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27cc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c2720780 con 0x5593c27cbe10 2023-09-13T09:46:13.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c271e0a0 con 0x5593c27cd470 2023-09-13T09:46:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.747+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c2719990 con 0x5593c27ccb10 2023-09-13T09:46:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27ccf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38002/0 (socket says 172.21.15.6:38002) 2023-09-13T09:46:13.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 -- 172.21.15.6:0/1325891018 learned_addr learned my addr 172.21.15.6:0/1325891018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 -- 172.21.15.6:0/1325891018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 msgr2=0x5593c27ccf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27ccf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 -- 172.21.15.6:0/1325891018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 msgr2=0x5593c27cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 -- 172.21.15.6:0/1325891018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c2599630 con 0x5593c27cbe10 2023-09-13T09:46:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605e7fc700 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f605f7fe700 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27cc270 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6058003eb0 tx=0x7f6058009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=942cec1151cb9518 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f6045ffb700 1 -- 172.21.15.6:0/1325891018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580092d0 con 0x5593c27cbe10 2023-09-13T09:46:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f6045ffb700 1 -- 172.21.15.6:0/1325891018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f605800f040 con 0x5593c27cbe10 2023-09-13T09:46:13.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.748+0000 7f6045ffb700 1 -- 172.21.15.6:0/1325891018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605800e7e0 con 0x5593c27cbe10 2023-09-13T09:46:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1325891018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 msgr2=0x5593c27cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27cc270 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6058003eb0 tx=0x7f6058009920 comp rx=0 tx=0).stop 2023-09-13T09:46:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1325891018 shutdown_connections 2023-09-13T09:46:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27cc270 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27ccf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1325891018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1325891018 >> 172.21.15.6:0/1325891018 conn(0x5593c2725c80 msgr2=0x5593c27c1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1325891018 shutdown_connections 2023-09-13T09:46:13.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1325891018 wait complete. 2023-09-13T09:46:13.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.749+0000 7f6071ac8b80 1 -- start start 2023-09-13T09:46:13.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 1 Processor -- start 2023-09-13T09:46:13.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cbe10 0x5593c27d52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27d5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c26b7bb0 con 0x5593c27ccb10 2023-09-13T09:46:13.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c26b78b0 con 0x5593c27cd470 2023-09-13T09:46:13.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c259b920 con 0x5593c27cbe10 2023-09-13T09:46:13.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f6071ac8b80 10 client.0 _ll_register_callbacks cb 0x5593c26b5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:13.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cbe10 0x5593c27d52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27d5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cbe10 0x5593c27d52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41058/0 (socket says 172.21.15.6:41058) 2023-09-13T09:46:13.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605effd700 1 -- 172.21.15.6:0/3402848117 learned_addr learned my addr 172.21.15.6:0/3402848117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27d5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38006/0 (socket says 172.21.15.6:38006) 2023-09-13T09:46:13.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605f7fe700 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605effd700 1 -- 172.21.15.6:0/3402848117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 msgr2=0x5593c27dc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605effd700 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.750+0000 7f605effd700 1 -- 172.21.15.6:0/3402848117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 msgr2=0x5593c27d5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.751+0000 7f605effd700 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27d5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.751+0000 7f605effd700 1 -- 172.21.15.6:0/3402848117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6058003b90 con 0x5593c27cbe10 2023-09-13T09:46:13.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.751+0000 7f605effd700 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cbe10 0x5593c27d52c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60500ca650 tx=0x7f6050005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aebcb69d14015d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.751+0000 7f603effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:46:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f603effd700 1 -- 172.21.15.6:0/3402848117 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6050099750 con 0x5593c27cbe10 2023-09-13T09:46:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593c27ba670 con 0x5593c27cbe10 2023-09-13T09:46:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f603effd700 1 -- 172.21.15.6:0/3402848117 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f605009de90 con 0x5593c27cbe10 2023-09-13T09:46:13.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f603effd700 1 -- 172.21.15.6:0/3402848117 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60500a2040 con 0x5593c27cbe10 2023-09-13T09:46:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 10 client.26539 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5593c27317a0 con 0x5593c27cbe10 2023-09-13T09:46:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f603effd700 1 -- 172.21.15.6:0/3402848117 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f60500b6080 con 0x5593c27cbe10 2023-09-13T09:46:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f603effd700 1 -- 172.21.15.6:0/3402848117 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f60500a1bb0 con 0x5593c27cbe10 2023-09-13T09:46:13.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 10 client.26539 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 10 client.26539 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:46:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 20 client.26539 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c27e0d20 0x5593c27e3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 4 client.26539 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:13.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.752+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593c2712970 con 0x5593c27e0d20 2023-09-13T09:46:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.753+0000 7f605e7fc700 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c27e0d20 0x5593c27e3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.753+0000 7f603effd700 10 client.26539 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.753+0000 7f605e7fc700 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c27e0d20 0x5593c27e3110 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=1f1fa0492e2a5353 server_cookie=7c6a0b7aba890a6b in_seq=0 out_seq=0 2023-09-13T09:46:13.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f603effd700 1 -- 172.21.15.6:0/3402848117 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5593c2712970 con 0x5593c27e0d20 2023-09-13T09:46:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f603effd700 10 client.26539 handle_command_reply: tid=0 2023-09-13T09:46:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 client.26539 shutdown 2023-09-13T09:46:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cbe10 msgr2=0x5593c27d52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cbe10 0x5593c27d52c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f60500ca650 tx=0x7f6050005760 comp rx=0 tx=0).stop 2023-09-13T09:46:13.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 shutdown_connections 2023-09-13T09:46:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c27e0d20 0x5593c27e3110 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f603effd700 0 client.26539 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cbe10 0x5593c27d52c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/3402848117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 >> 172.21.15.6:0/3402848117 conn(0x5593c2725c80 msgr2=0x5593c27c1ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 shutdown_connections 2023-09-13T09:46:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 1 -- 172.21.15.6:0/3402848117 wait complete. 2023-09-13T09:46:13.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.754+0000 7f6071ac8b80 20 client.26539 trim_cache size 0 max 16384 2023-09-13T09:46:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 Processor -- start 2023-09-13T09:46:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 -- start start 2023-09-13T09:46:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27d4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27c1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c27c2420 con 0x5593c27cbe10 2023-09-13T09:46:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c27d2ef0 con 0x5593c27cd470 2023-09-13T09:46:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c27c2d70 con 0x5593c27ccb10 2023-09-13T09:46:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f605effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27d4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f605e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27c1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f605f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59772/0 (socket says 172.21.15.6:59772) 2023-09-13T09:46:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f605effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27d4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38012/0 (socket says 172.21.15.6:38012) 2023-09-13T09:46:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.769+0000 7f605f7fe700 1 -- 172.21.15.6:0/1726847088 learned_addr learned my addr 172.21.15.6:0/1726847088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f605e7fc700 1 -- 172.21.15.6:0/1726847088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 msgr2=0x5593c27dd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f605e7fc700 1 --2- 172.21.15.6:0/1726847088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f605e7fc700 1 -- 172.21.15.6:0/1726847088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 msgr2=0x5593c27d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f605e7fc700 1 --2- 172.21.15.6:0/1726847088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27d4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f605e7fc700 1 -- 172.21.15.6:0/1726847088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c2545de0 con 0x5593c27ccb10 2023-09-13T09:46:13.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f605e7fc700 1 --2- 172.21.15.6:0/1726847088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27c1ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5593c26b79c0 tx=0x7f6054014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fc0d38b59fef1a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f60467fc700 1 -- 172.21.15.6:0/1726847088 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6054022030 con 0x5593c27ccb10 2023-09-13T09:46:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f60467fc700 1 -- 172.21.15.6:0/1726847088 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6054023040 con 0x5593c27ccb10 2023-09-13T09:46:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.770+0000 7f60467fc700 1 -- 172.21.15.6:0/1726847088 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605401dd30 con 0x5593c27ccb10 2023-09-13T09:46:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1726847088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 msgr2=0x5593c27c1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1726847088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27c1ee0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x5593c26b79c0 tx=0x7f6054014000 comp rx=0 tx=0).stop 2023-09-13T09:46:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1726847088 shutdown_connections 2023-09-13T09:46:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1726847088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cd470 0x5593c27dd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1726847088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27cbe10 0x5593c27d4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/1726847088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27ccb10 0x5593c27c1ee0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1726847088 >> 172.21.15.6:0/1726847088 conn(0x5593c2725c80 msgr2=0x5593c27cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1726847088 shutdown_connections 2023-09-13T09:46:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.771+0000 7f6071ac8b80 1 -- 172.21.15.6:0/1726847088 wait complete. 2023-09-13T09:46:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 -- start start 2023-09-13T09:46:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 Processor -- start 2023-09-13T09:46:13.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cbe10 0x5593c27caca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cd470 0x5593c27dc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c27c92b0 con 0x5593c27ccb10 2023-09-13T09:46:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c27c93f0 con 0x5593c27cbe10 2023-09-13T09:46:13.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c27c95b0 con 0x5593c27cd470 2023-09-13T09:46:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.772+0000 7f6071ac8b80 10 client.0 _ll_register_callbacks cb 0x5593c26b5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cbe10 0x5593c27caca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cbe10 0x5593c27caca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59774/0 (socket says 172.21.15.6:59774) 2023-09-13T09:46:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 -- 172.21.15.6:0/44147200 learned_addr learned my addr 172.21.15.6:0/44147200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605e7fc700 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605f7fe700 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cd470 0x5593c27dc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 -- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cd470 msgr2=0x5593c27dc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cd470 0x5593c27dc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 -- 172.21.15.6:0/44147200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 msgr2=0x5593c27cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27cb1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 -- 172.21.15.6:0/44147200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f605402ba60 con 0x5593c27cbe10 2023-09-13T09:46:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f605effd700 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cbe10 0x5593c27caca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60500a1f10 tx=0x7f605009a630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fd5e751a9343603 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f603effd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f603effd700 1 -- 172.21.15.6:0/44147200 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605009edd0 con 0x5593c27cbe10 2023-09-13T09:46:13.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f603effd700 1 -- 172.21.15.6:0/44147200 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f605009de90 con 0x5593c27cbe10 2023-09-13T09:46:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.773+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f605800f040 con 0x5593c27cbe10 2023-09-13T09:46:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f603effd700 1 -- 172.21.15.6:0/44147200 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60500a2040 con 0x5593c27cbe10 2023-09-13T09:46:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 10 client.26600 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5593c252ec60 con 0x5593c27cbe10 2023-09-13T09:46:13.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f603effd700 1 -- 172.21.15.6:0/44147200 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f605800f040 con 0x5593c27cbe10 2023-09-13T09:46:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f603effd700 1 -- 172.21.15.6:0/44147200 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6050095f50 con 0x5593c27cbe10 2023-09-13T09:46:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 10 client.26600 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 10 client.26600 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:46:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 20 client.26600 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:13.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c2839ae0 0x5593c283bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 4 client.26600 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5593c26d3050 con 0x5593c2839ae0 2023-09-13T09:46:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.774+0000 7f605e7fc700 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c2839ae0 0x5593c283bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f603effd700 10 client.26600 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:13.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f605e7fc700 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c2839ae0 0x5593c283bed0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=76f3ce80a527768d server_cookie=da549f976a2418bc in_seq=0 out_seq=0 2023-09-13T09:46:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f603effd700 1 -- 172.21.15.6:0/44147200 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5593c26d3050 con 0x5593c2839ae0 2023-09-13T09:46:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f603effd700 10 client.26600 handle_command_reply: tid=0 2023-09-13T09:46:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 client.26600 shutdown 2023-09-13T09:46:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cbe10 msgr2=0x5593c27caca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cbe10 0x5593c27caca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f60500a1f10 tx=0x7f605009a630 comp rx=0 tx=0).stop 2023-09-13T09:46:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 shutdown_connections 2023-09-13T09:46:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5593c2839ae0 0x5593c283bed0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c27cd470 0x5593c27dc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c27cbe10 0x5593c27caca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 --2- 172.21.15.6:0/44147200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c27ccb10 0x5593c27cb1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f603effd700 0 client.26600 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 >> 172.21.15.6:0/44147200 conn(0x5593c2725c80 msgr2=0x5593c27cfcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 shutdown_connections 2023-09-13T09:46:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 1 -- 172.21.15.6:0/44147200 wait complete. 2023-09-13T09:46:13.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.775+0000 7f6071ac8b80 20 client.26600 trim_cache size 0 max 16384 2023-09-13T09:46:13.797 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60480a0640 msgr2=0x7f60480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60480a0640 0x7f60480a2b00 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f6054009c60 tx=0x7f6054009260 comp rx=0 tx=0).stop 2023-09-13T09:46:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60600ffca0 msgr2=0x7f6060196a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60600ffca0 0x7f6060196a60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6050009fd0 tx=0x7f6050009580 comp rx=0 tx=0).stop 2023-09-13T09:46:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 shutdown_connections 2023-09-13T09:46:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6060101830 0x7f606019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60600ffca0 0x7f6060196a60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f60480a0640 0x7f60480a2b00 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 --2- 172.21.15.6:0/628039430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6060100e90 0x7f6060196fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 >> 172.21.15.6:0/628039430 conn(0x7f60600fb210 msgr2=0x7f6060069240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 shutdown_connections 2023-09-13T09:46:13.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.776+0000 7f60658e3700 1 -- 172.21.15.6:0/628039430 wait complete. 2023-09-13T09:46:13.801 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:46:13.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 -- 172.21.15.6:0/2880691943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc74100920 msgr2=0x7fcc741081e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 --2- 172.21.15.6:0/2880691943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc74100920 0x7fcc741081e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c009f90 tx=0x7fcc6c00b330 comp rx=0 tx=0).stop 2023-09-13T09:46:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 -- 172.21.15.6:0/2880691943 shutdown_connections 2023-09-13T09:46:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 --2- 172.21.15.6:0/2880691943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc74100920 0x7fcc741081e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 --2- 172.21.15.6:0/2880691943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc74101250 0x7fcc74101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 --2- 172.21.15.6:0/2880691943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fff80 0x7fcc741003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 -- 172.21.15.6:0/2880691943 >> 172.21.15.6:0/2880691943 conn(0x7fcc740fa9b0 msgr2=0x7fcc740fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 -- 172.21.15.6:0/2880691943 shutdown_connections 2023-09-13T09:46:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.948+0000 7fcc79861700 1 -- 172.21.15.6:0/2880691943 wait complete. 2023-09-13T09:46:13.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 Processor -- start 2023-09-13T09:46:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 -- start start 2023-09-13T09:46:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc740fff80 0x7fcc74196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc74100920 0x7fcc741970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc74101250 0x7fcc7419e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419e6a0 con 0x7fcc74101250 2023-09-13T09:46:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419e7e0 con 0x7fcc740fff80 2023-09-13T09:46:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc79861700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc7419e970 con 0x7fcc74100920 2023-09-13T09:46:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc74101250 0x7fcc7419e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc72ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc740fff80 0x7fcc74196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc72ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc740fff80 0x7fcc74196b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59788/0 (socket says 172.21.15.6:59788) 2023-09-13T09:46:13.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc74101250 0x7fcc7419e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38036/0 (socket says 172.21.15.6:38036) 2023-09-13T09:46:13.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc72ffd700 1 -- 172.21.15.6:0/700212703 learned_addr learned my addr 172.21.15.6:0/700212703 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc727fc700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc74100920 0x7fcc741970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc737fe700 1 -- 172.21.15.6:0/700212703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc74100920 msgr2=0x7fcc741970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc737fe700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc74100920 0x7fcc741970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc737fe700 1 -- 172.21.15.6:0/700212703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc740fff80 msgr2=0x7fcc74196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc737fe700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc740fff80 0x7fcc74196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc737fe700 1 -- 172.21.15.6:0/700212703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc680095f0 con 0x7fcc74101250 2023-09-13T09:46:13.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.949+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc740fff80 0x7fcc74196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.950+0000 7fcc737fe700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc74101250 0x7fcc7419e0d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b6c0 tx=0x7fcc6c004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.950+0000 7fcc7885f700 1 -- 172.21.15.6:0/700212703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c00e040 con 0x7fcc74101250 2023-09-13T09:46:13.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.950+0000 7fcc7885f700 1 -- 172.21.15.6:0/700212703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc6c00bbf0 con 0x7fcc74101250 2023-09-13T09:46:13.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.950+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc6c009c40 con 0x7fcc74101250 2023-09-13T09:46:13.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.950+0000 7fcc7885f700 1 -- 172.21.15.6:0/700212703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc6c0052a0 con 0x7fcc74101250 2023-09-13T09:46:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.950+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7419eee0 con 0x7fcc74101250 2023-09-13T09:46:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.953+0000 7fcc7885f700 1 -- 172.21.15.6:0/700212703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcc6c01d470 con 0x7fcc74101250 2023-09-13T09:46:13.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.953+0000 7fcc7885f700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc5c0a0640 0x7fcc5c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc7885f700 1 -- 172.21.15.6:0/700212703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc6c0ccf50 con 0x7fcc74101250 2023-09-13T09:46:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc5c0a0640 0x7fcc5c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc5c0a0640 0x7fcc5c0a2b00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc64005950 tx=0x7fcc64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc85a46b80 1 Processor -- start 2023-09-13T09:46:13.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc85a46b80 1 -- start start 2023-09-13T09:46:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x55923433cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923433b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x55923433c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.954+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559234290780 con 0x55923433cb10 2023-09-13T09:46:13.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923428e0a0 con 0x55923433be10 2023-09-13T09:46:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559234289990 con 0x55923433d470 2023-09-13T09:46:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x55923433cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x55923433cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38040/0 (socket says 172.21.15.6:38040) 2023-09-13T09:46:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923433b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc72ffd700 1 -- 172.21.15.6:0/1781372441 learned_addr learned my addr 172.21.15.6:0/1781372441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc737fe700 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x55923433c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc727fc700 1 -- 172.21.15.6:0/1781372441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 msgr2=0x55923433c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc727fc700 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x55923433c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc727fc700 1 -- 172.21.15.6:0/1781372441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 msgr2=0x55923433cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc727fc700 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x55923433cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc727fc700 1 -- 172.21.15.6:0/1781372441 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559234109630 con 0x55923433d470 2023-09-13T09:46:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x55923433cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc727fc700 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923433b8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009f20 tx=0x7fcc68011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef56d0fe9c1079f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc59ffb700 1 -- 172.21.15.6:0/1781372441 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68004310 con 0x55923433d470 2023-09-13T09:46:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc59ffb700 1 -- 172.21.15.6:0/1781372441 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc68004470 con 0x55923433d470 2023-09-13T09:46:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.955+0000 7fcc59ffb700 1 -- 172.21.15.6:0/1781372441 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68019910 con 0x55923433d470 2023-09-13T09:46:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1781372441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 msgr2=0x55923433b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923433b8d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcc68009f20 tx=0x7fcc68011720 comp rx=0 tx=0).stop 2023-09-13T09:46:13.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1781372441 shutdown_connections 2023-09-13T09:46:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x55923433c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x55923433cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1781372441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923433b8d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1781372441 >> 172.21.15.6:0/1781372441 conn(0x559234295c80 msgr2=0x559234331f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1781372441 shutdown_connections 2023-09-13T09:46:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.956+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1781372441 wait complete. 2023-09-13T09:46:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 -- start start 2023-09-13T09:46:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 Processor -- start 2023-09-13T09:46:13.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x559234345340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234345880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923434c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559234227bb0 con 0x55923433cb10 2023-09-13T09:46:13.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592342278b0 con 0x55923433be10 2023-09-13T09:46:13.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923410b920 con 0x55923433d470 2023-09-13T09:46:13.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc85a46b80 10 client.0 _ll_register_callbacks cb 0x559234225680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:13.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234345880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234345880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38048/0 (socket says 172.21.15.6:38048) 2023-09-13T09:46:13.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc727fc700 1 -- 172.21.15.6:0/1974609657 learned_addr learned my addr 172.21.15.6:0/1974609657 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc737fe700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923434c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x559234345340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc727fc700 1 -- 172.21.15.6:0/1974609657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 msgr2=0x55923434c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc727fc700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923434c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc727fc700 1 -- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 msgr2=0x559234345340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.957+0000 7fcc727fc700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x559234345340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc727fc700 1 -- 172.21.15.6:0/1974609657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc68009b80 con 0x55923433cb10 2023-09-13T09:46:13.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x559234345340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:13.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc727fc700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234345880 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcc68005b40 tx=0x7fcc680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e46becf5418ad5f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:13.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc52ffd700 1 -- 172.21.15.6:0/1974609657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68003ad0 con 0x55923433cb10 2023-09-13T09:46:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc52ffd700 1 -- 172.21.15.6:0/1974609657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc68003c30 con 0x55923433cb10 2023-09-13T09:46:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55923432a670 con 0x55923433cb10 2023-09-13T09:46:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc52ffd700 1 -- 172.21.15.6:0/1974609657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc68019690 con 0x55923433cb10 2023-09-13T09:46:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc85a46b80 10 client.17199 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:13.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5592342a17a0 con 0x55923433cb10 2023-09-13T09:46:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc52ffd700 1 -- 172.21.15.6:0/1974609657 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55923432a670 con 0x55923433cb10 2023-09-13T09:46:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc52ffd700 1 -- 172.21.15.6:0/1974609657 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc6801a930 con 0x55923433cb10 2023-09-13T09:46:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc85a46b80 10 client.17199 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.958+0000 7fcc85a46b80 10 client.17199 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:46:13.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.959+0000 7fcc85a46b80 20 client.17199 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.959+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559234351050 0x559234353470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.959+0000 7fcc85a46b80 4 client.17199 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.959+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559234282970 con 0x559234351050 2023-09-13T09:46:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.959+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559234351050 0x559234353470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.959+0000 7fcc52ffd700 10 client.17199 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:13.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.959+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559234351050 0x559234353470 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6b2bb61d58d57334 server_cookie=e1f5486fd4fbb8a4 in_seq=0 out_seq=0 2023-09-13T09:46:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc52ffd700 1 -- 172.21.15.6:0/1974609657 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559234282970 con 0x559234351050 2023-09-13T09:46:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc52ffd700 10 client.17199 handle_command_reply: tid=0 2023-09-13T09:46:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 client.17199 shutdown 2023-09-13T09:46:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 msgr2=0x559234345880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234345880 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fcc68005b40 tx=0x7fcc680045e0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 shutdown_connections 2023-09-13T09:46:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559234351050 0x559234353470 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433d470 0x55923434c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc52ffd700 0 client.17199 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433be10 0x559234345340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/1974609657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234345880 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 >> 172.21.15.6:0/1974609657 conn(0x559234295c80 msgr2=0x55923432c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 shutdown_connections 2023-09-13T09:46:13.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 1 -- 172.21.15.6:0/1974609657 wait complete. 2023-09-13T09:46:13.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.960+0000 7fcc85a46b80 20 client.17199 trim_cache size 0 max 16384 2023-09-13T09:46:13.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 Processor -- start 2023-09-13T09:46:13.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 -- start start 2023-09-13T09:46:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433be10 0x559234332fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433cb10 0x55923434c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x559234343ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559234333730 con 0x55923433be10 2023-09-13T09:46:13.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923432a400 con 0x55923433d470 2023-09-13T09:46:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559234345fc0 con 0x55923433cb10 2023-09-13T09:46:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433be10 0x559234332fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433cb10 0x55923434c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x559234343ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:13.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433cb10 0x55923434c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41110/0 (socket says 172.21.15.6:41110) 2023-09-13T09:46:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 -- 172.21.15.6:0/3908620136 learned_addr learned my addr 172.21.15.6:0/3908620136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc72ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433be10 0x559234332fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38054/0 (socket says 172.21.15.6:38054) 2023-09-13T09:46:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 -- 172.21.15.6:0/3908620136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 msgr2=0x559234343ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x559234343ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 -- 172.21.15.6:0/3908620136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433be10 msgr2=0x559234332fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:13.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433be10 0x559234332fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc727fc700 1 -- 172.21.15.6:0/3908620136 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592340b5de0 con 0x55923433cb10 2023-09-13T09:46:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.974+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433be10 0x559234332fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.975+0000 7fcc727fc700 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433cb10 0x55923434c880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc6801ad10 tx=0x7fcc68011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9d0257ef95e439f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.975+0000 7fcc5a7fc700 1 -- 172.21.15.6:0/3908620136 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68009e50 con 0x55923433cb10 2023-09-13T09:46:13.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.975+0000 7fcc5a7fc700 1 -- 172.21.15.6:0/3908620136 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc68023400 con 0x55923433cb10 2023-09-13T09:46:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.975+0000 7fcc5a7fc700 1 -- 172.21.15.6:0/3908620136 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68023a90 con 0x55923433cb10 2023-09-13T09:46:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.975+0000 7fcc85a46b80 1 -- 172.21.15.6:0/3908620136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433cb10 msgr2=0x55923434c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.975+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433cb10 0x55923434c880 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc6801ad10 tx=0x7fcc68011720 comp rx=0 tx=0).stop 2023-09-13T09:46:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- 172.21.15.6:0/3908620136 shutdown_connections 2023-09-13T09:46:13.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x559234343ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433be10 0x559234332fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/3908620136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433cb10 0x55923434c880 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- 172.21.15.6:0/3908620136 >> 172.21.15.6:0/3908620136 conn(0x559234295c80 msgr2=0x559234331e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- 172.21.15.6:0/3908620136 shutdown_connections 2023-09-13T09:46:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- 172.21.15.6:0/3908620136 wait complete. 2023-09-13T09:46:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- start start 2023-09-13T09:46:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 Processor -- start 2023-09-13T09:46:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433be10 0x559234348a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234348f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x55923434b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923434bdb0 con 0x55923433cb10 2023-09-13T09:46:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923434bf20 con 0x55923433d470 2023-09-13T09:46:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923434c090 con 0x55923433be10 2023-09-13T09:46:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc85a46b80 10 client.0 _ll_register_callbacks cb 0x559234225680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:14.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.976+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234348f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234348f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38062/0 (socket says 172.21.15.6:38062) 2023-09-13T09:46:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc737fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x55923434b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc72ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433be10 0x559234348a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 -- 172.21.15.6:0/333787713 learned_addr learned my addr 172.21.15.6:0/333787713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 -- 172.21.15.6:0/333787713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433be10 msgr2=0x559234348a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433be10 0x559234348a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 -- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 msgr2=0x55923434b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x55923434b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 -- 172.21.15.6:0/333787713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc6400ea60 con 0x55923433cb10 2023-09-13T09:46:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc737fe700 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x55923434b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc727fc700 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234348f50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fcc68003e40 tx=0x7fcc6801a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b58e95e8720872c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc52ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc52ffd700 1 -- 172.21.15.6:0/333787713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc68005a00 con 0x55923433cb10 2023-09-13T09:46:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc52ffd700 1 -- 172.21.15.6:0/333787713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc68000e40 con 0x55923433cb10 2023-09-13T09:46:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc68004470 con 0x55923433cb10 2023-09-13T09:46:14.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc52ffd700 1 -- 172.21.15.6:0/333787713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc68009e50 con 0x55923433cb10 2023-09-13T09:46:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc85a46b80 10 client.17205 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.977+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5592342a17a0 con 0x55923433cb10 2023-09-13T09:46:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc52ffd700 1 -- 172.21.15.6:0/333787713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc68004470 con 0x55923433cb10 2023-09-13T09:46:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc52ffd700 1 -- 172.21.15.6:0/333787713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc680239a0 con 0x55923433cb10 2023-09-13T09:46:14.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc85a46b80 10 client.17205 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc85a46b80 10 client.17205 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:46:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc85a46b80 20 client.17205 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5592343a5710 0x5592343a7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc85a46b80 4 client.17205 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559234243050 con 0x5592343a5710 2023-09-13T09:46:14.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5592343a5710 0x5592343a7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc72ffd700 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5592343a5710 0x5592343a7b30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c0d8548471e67f3 server_cookie=2bf83b533c1d4f64 in_seq=0 out_seq=0 2023-09-13T09:46:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.978+0000 7fcc52ffd700 10 client.17205 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc52ffd700 1 -- 172.21.15.6:0/333787713 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559234243050 con 0x5592343a5710 2023-09-13T09:46:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc52ffd700 10 client.17205 handle_command_reply: tid=0 2023-09-13T09:46:14.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 client.17205 shutdown 2023-09-13T09:46:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 msgr2=0x559234348f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234348f50 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fcc68003e40 tx=0x7fcc6801a6f0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 shutdown_connections 2023-09-13T09:46:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5592343a5710 0x5592343a7b30 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55923433d470 0x55923434b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55923433be10 0x559234348a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc52ffd700 0 client.17205 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:14.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 --2- 172.21.15.6:0/333787713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55923433cb10 0x559234348f50 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 >> 172.21.15.6:0/333787713 conn(0x559234295c80 msgr2=0x559234343ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 shutdown_connections 2023-09-13T09:46:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 1 -- 172.21.15.6:0/333787713 wait complete. 2023-09-13T09:46:14.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc85a46b80 20 client.17205 trim_cache size 0 max 16384 2023-09-13T09:46:14.010 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:14.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc5c0a0640 msgr2=0x7fcc5c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc79861700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc5c0a0640 0x7fcc5c0a2b00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc64005950 tx=0x7fcc64009260 comp rx=0 tx=0).stop 2023-09-13T09:46:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc74101250 msgr2=0x7fcc7419e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.979+0000 7fcc79861700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc74101250 0x7fcc7419e0d0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7fcc6c00b6c0 tx=0x7fcc6c004cc0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 shutdown_connections 2023-09-13T09:46:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc5c0a0640 0x7fcc5c0a2b00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc74101250 0x7fcc7419e0d0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc740fff80 0x7fcc74196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 --2- 172.21.15.6:0/700212703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc74100920 0x7fcc741970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 >> 172.21.15.6:0/700212703 conn(0x7fcc740fa9b0 msgr2=0x7fcc740feeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 shutdown_connections 2023-09-13T09:46:14.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:13.980+0000 7fcc79861700 1 -- 172.21.15.6:0/700212703 wait complete. 2023-09-13T09:46:14.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:46:14.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 249513 3.94 MB/sec execute 214 sec latency 54.097 ms 2023-09-13T09:46:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 -- 172.21.15.6:0/2384360537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 msgr2=0x7f8688108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 --2- 172.21.15.6:0/2384360537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 0x7f8688108100 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f868000b0d0 tx=0x7f868000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 -- 172.21.15.6:0/2384360537 shutdown_connections 2023-09-13T09:46:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 --2- 172.21.15.6:0/2384360537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 0x7f8688108100 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 --2- 172.21.15.6:0/2384360537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86880ffcc0 0x7f86881000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 --2- 172.21.15.6:0/2384360537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8688100eb0 0x7f8688101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 -- 172.21.15.6:0/2384360537 >> 172.21.15.6:0/2384360537 conn(0x7f86880fb250 msgr2=0x7f86880fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 -- 172.21.15.6:0/2384360537 shutdown_connections 2023-09-13T09:46:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.171+0000 7f868c914700 1 -- 172.21.15.6:0/2384360537 wait complete. 2023-09-13T09:46:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 Processor -- start 2023-09-13T09:46:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 -- start start 2023-09-13T09:46:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86880ffcc0 0x7f8688195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688100eb0 0x7f8688195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 0x7f868819d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819d5e0 con 0x7f8688101850 2023-09-13T09:46:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819d720 con 0x7f8688100eb0 2023-09-13T09:46:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868c914700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819d8b0 con 0x7f86880ffcc0 2023-09-13T09:46:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f8685d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688100eb0 0x7f8688195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f8686d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 0x7f868819d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f8685d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688100eb0 0x7f8688195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59832/0 (socket says 172.21.15.6:59832) 2023-09-13T09:46:14.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f8685d9b700 1 -- 172.21.15.6:0/596564091 learned_addr learned my addr 172.21.15.6:0/596564091 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f868659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86880ffcc0 0x7f8688195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f8685d9b700 1 -- 172.21.15.6:0/596564091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86880ffcc0 msgr2=0x7f8688195a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.172+0000 7f8685d9b700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86880ffcc0 0x7f8688195a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f8685d9b700 1 -- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 msgr2=0x7f868819d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f8685d9b700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 0x7f868819d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f8685d9b700 1 -- 172.21.15.6:0/596564091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8680009d00 con 0x7f8688100eb0 2023-09-13T09:46:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f8686d9d700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 0x7f868819d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f8685d9b700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688100eb0 0x7f8688195fa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e9a0 tx=0x7f867c00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f86777fe700 1 -- 172.21.15.6:0/596564091 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c009790 con 0x7f8688100eb0 2023-09-13T09:46:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f86777fe700 1 -- 172.21.15.6:0/596564091 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f867c00dce0 con 0x7f8688100eb0 2023-09-13T09:46:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f86777fe700 1 -- 172.21.15.6:0/596564091 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0153b0 con 0x7f8688100eb0 2023-09-13T09:46:14.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8688068010 con 0x7f8688100eb0 2023-09-13T09:46:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.173+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86880684d0 con 0x7f8688100eb0 2023-09-13T09:46:14.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.175+0000 7f86777fe700 1 -- 172.21.15.6:0/596564091 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f867c016510 con 0x7f8688100eb0 2023-09-13T09:46:14.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.176+0000 7f86777fe700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86700a0640 0x7f86700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.176+0000 7f868659c700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86700a0640 0x7f86700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.177+0000 7f86777fe700 1 -- 172.21.15.6:0/596564091 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f867c0cb3a0 con 0x7f8688100eb0 2023-09-13T09:46:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.177+0000 7f868659c700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86700a0640 0x7f86700a2b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8688100d10 tx=0x7f8678009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.177+0000 7f8698af9b80 1 Processor -- start 2023-09-13T09:46:14.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8698af9b80 1 -- start start 2023-09-13T09:46:14.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c55b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c54e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8698af9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640bad780 con 0x562640c54a00 2023-09-13T09:46:14.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8698af9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640bab0a0 con 0x562640c56060 2023-09-13T09:46:14.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8698af9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640ba6990 con 0x562640c55700 2023-09-13T09:46:14.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c54e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c54e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38086/0 (socket says 172.21.15.6:38086) 2023-09-13T09:46:14.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f868659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c55b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 -- 172.21.15.6:0/3823016857 learned_addr learned my addr 172.21.15.6:0/3823016857 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8685d9b700 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 -- 172.21.15.6:0/3823016857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 msgr2=0x562640c55b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c55b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 -- 172.21.15.6:0/3823016857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 msgr2=0x562640c544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 -- 172.21.15.6:0/3823016857 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562640a26630 con 0x562640c54a00 2023-09-13T09:46:14.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8685d9b700 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f868659c700 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c55b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.178+0000 7f8686d9d700 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c54e80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8680015000 tx=0x7f86800060c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6495c86fb8deae26 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8674ff9700 1 -- 172.21.15.6:0/3823016857 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680021070 con 0x562640c54a00 2023-09-13T09:46:14.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8674ff9700 1 -- 172.21.15.6:0/3823016857 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86800092e0 con 0x562640c54a00 2023-09-13T09:46:14.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8674ff9700 1 -- 172.21.15.6:0/3823016857 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000e040 con 0x562640c54a00 2023-09-13T09:46:14.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 -- 172.21.15.6:0/3823016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 msgr2=0x562640c54e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c54e80 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f8680015000 tx=0x7f86800060c0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 -- 172.21.15.6:0/3823016857 shutdown_connections 2023-09-13T09:46:14.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c54e80 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c55b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3823016857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 -- 172.21.15.6:0/3823016857 >> 172.21.15.6:0/3823016857 conn(0x562640bb2c80 msgr2=0x562640c4ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 -- 172.21.15.6:0/3823016857 shutdown_connections 2023-09-13T09:46:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.179+0000 7f8698af9b80 1 -- 172.21.15.6:0/3823016857 wait complete. 2023-09-13T09:46:14.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 -- start start 2023-09-13T09:46:14.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 Processor -- start 2023-09-13T09:46:14.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c5df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c5e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c65480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640b44bb0 con 0x562640c56060 2023-09-13T09:46:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640b448b0 con 0x562640c55700 2023-09-13T09:46:14.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640a28920 con 0x562640c54a00 2023-09-13T09:46:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8698af9b80 10 client.0 _ll_register_callbacks cb 0x562640b42680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f868659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c5df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f868659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c5df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41142/0 (socket says 172.21.15.6:41142) 2023-09-13T09:46:14.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8685d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c5e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f868659c700 1 -- 172.21.15.6:0/4082029514 learned_addr learned my addr 172.21.15.6:0/4082029514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.180+0000 7f8686d9d700 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c65480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f868659c700 1 -- 172.21.15.6:0/4082029514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 msgr2=0x562640c5e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f868659c700 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c5e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f868659c700 1 -- 172.21.15.6:0/4082029514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 msgr2=0x562640c65480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f868659c700 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c65480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f868659c700 1 -- 172.21.15.6:0/4082029514 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8688108a50 con 0x562640c54a00 2023-09-13T09:46:14.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f868659c700 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c5df00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f867801d8f0 tx=0x7f86780047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d6dc1b16c03aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f866dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:46:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f866dffb700 1 -- 172.21.15.6:0/4082029514 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678022070 con 0x562640c54a00 2023-09-13T09:46:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f866dffb700 1 -- 172.21.15.6:0/4082029514 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f867801c690 con 0x562640c54a00 2023-09-13T09:46:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562640c47670 con 0x562640c54a00 2023-09-13T09:46:14.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f866dffb700 1 -- 172.21.15.6:0/4082029514 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f867801c850 con 0x562640c54a00 2023-09-13T09:46:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f8698af9b80 10 client.26575 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.181+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562640bbe7a0 con 0x562640c54a00 2023-09-13T09:46:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f866dffb700 1 -- 172.21.15.6:0/4082029514 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8678035080 con 0x562640c54a00 2023-09-13T09:46:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f866dffb700 1 -- 172.21.15.6:0/4082029514 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8678031a90 con 0x562640c54a00 2023-09-13T09:46:14.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8698af9b80 10 client.26575 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8698af9b80 10 client.26575 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:46:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8698af9b80 20 client.26575 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8698af9b80 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640c69d90 0x562640c6c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8698af9b80 4 client.26575 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:14.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562640b9f970 con 0x562640c69d90 2023-09-13T09:46:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8685d9b700 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640c69d90 0x562640c6c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f866dffb700 10 client.26575 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.182+0000 7f8685d9b700 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640c69d90 0x562640c6c1b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cea9ad9710e3d71f server_cookie=a8e10f03fbc01da in_seq=0 out_seq=0 2023-09-13T09:46:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f866dffb700 1 -- 172.21.15.6:0/4082029514 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x7f867c0b6730 con 0x562640c69d90 2023-09-13T09:46:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f866dffb700 10 client.26575 handle_command_reply: tid=0 2023-09-13T09:46:14.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 client.26575 shutdown 2023-09-13T09:46:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 msgr2=0x562640c5df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c5df00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f867801d8f0 tx=0x7f86780047c0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 shutdown_connections 2023-09-13T09:46:14.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640c69d90 0x562640c6c1b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c65480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f866dffb700 0 client.26575 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c5df00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 --2- 172.21.15.6:0/4082029514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c5e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 >> 172.21.15.6:0/4082029514 conn(0x562640bb2c80 msgr2=0x562640c4eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 shutdown_connections 2023-09-13T09:46:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 1 -- 172.21.15.6:0/4082029514 wait complete. 2023-09-13T09:46:14.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.183+0000 7f8698af9b80 20 client.26575 trim_cache size 0 max 16384 2023-09-13T09:46:14.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.199+0000 7f8698af9b80 1 Processor -- start 2023-09-13T09:46:14.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.199+0000 7f8698af9b80 1 -- start start 2023-09-13T09:46:14.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.199+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c544c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.199+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c65410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f8698af9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640c50730 con 0x562640c54a00 2023-09-13T09:46:14.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f8698af9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640c5f080 con 0x562640c56060 2023-09-13T09:46:14.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f8698af9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640c5bb80 con 0x562640c55700 2023-09-13T09:46:14.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38096/0 (socket says 172.21.15.6:38096) 2023-09-13T09:46:14.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 -- 172.21.15.6:0/1769411327 learned_addr learned my addr 172.21.15.6:0/1769411327 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f8685d9b700 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c65410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f8686d9d700 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 -- 172.21.15.6:0/1769411327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 msgr2=0x562640c65410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c65410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 -- 172.21.15.6:0/1769411327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 msgr2=0x562640c588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 -- 172.21.15.6:0/1769411327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626409d2de0 con 0x562640c54a00 2023-09-13T09:46:14.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.200+0000 7f868659c700 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c544c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8678013010 tx=0x7f8678005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43fc2034ab5d7902 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.201+0000 7f86757fa700 1 -- 172.21.15.6:0/1769411327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678022070 con 0x562640c54a00 2023-09-13T09:46:14.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.201+0000 7f86757fa700 1 -- 172.21.15.6:0/1769411327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562640c47670 con 0x562640c54a00 2023-09-13T09:46:14.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.201+0000 7f86757fa700 1 -- 172.21.15.6:0/1769411327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678031b90 con 0x562640c54a00 2023-09-13T09:46:14.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 -- 172.21.15.6:0/1769411327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 msgr2=0x562640c544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c544c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8678013010 tx=0x7f8678005880 comp rx=0 tx=0).stop 2023-09-13T09:46:14.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 -- 172.21.15.6:0/1769411327 shutdown_connections 2023-09-13T09:46:14.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c56060 0x562640c588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c54a00 0x562640c544c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 --2- 172.21.15.6:0/1769411327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c55700 0x562640c65410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 -- 172.21.15.6:0/1769411327 >> 172.21.15.6:0/1769411327 conn(0x562640bb2c80 msgr2=0x562640c5cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 -- 172.21.15.6:0/1769411327 shutdown_connections 2023-09-13T09:46:14.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.202+0000 7f8698af9b80 1 -- 172.21.15.6:0/1769411327 wait complete. 2023-09-13T09:46:14.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 -- start start 2023-09-13T09:46:14.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 Processor -- start 2023-09-13T09:46:14.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c64f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c61a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c61f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640c62620 con 0x562640c56060 2023-09-13T09:46:14.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640c655e0 con 0x562640c55700 2023-09-13T09:46:14.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562640c65770 con 0x562640c54a00 2023-09-13T09:46:14.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8698af9b80 10 client.0 _ll_register_callbacks cb 0x562640b42680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:14.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8686d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c61f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8685d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c61a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f868659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c64f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8686d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c61f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38106/0 (socket says 172.21.15.6:38106) 2023-09-13T09:46:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8685d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c61a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59860/0 (socket says 172.21.15.6:59860) 2023-09-13T09:46:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f868659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c64f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41156/0 (socket says 172.21.15.6:41156) 2023-09-13T09:46:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.203+0000 7f8686d9d700 1 -- 172.21.15.6:0/3316013340 learned_addr learned my addr 172.21.15.6:0/3316013340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8686d9d700 1 -- 172.21.15.6:0/3316013340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 msgr2=0x562640c64f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8686d9d700 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c64f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8686d9d700 1 -- 172.21.15.6:0/3316013340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 msgr2=0x562640c61a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8686d9d700 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c61a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8686d9d700 1 -- 172.21.15.6:0/3316013340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562640bbe7a0 con 0x562640c56060 2023-09-13T09:46:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8685d9b700 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c61a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8686d9d700 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c61f40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8680006200 tx=0x7f868000bcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e78a1ffa1c4debe7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f866dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f866dffb700 1 -- 172.21.15.6:0/3316013340 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680021070 con 0x562640c56060 2023-09-13T09:46:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f866dffb700 1 -- 172.21.15.6:0/3316013340 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f86800054e0 con 0x562640c56060 2023-09-13T09:46:14.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.204+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86800092e0 con 0x562640c56060 2023-09-13T09:46:14.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f866dffb700 1 -- 172.21.15.6:0/3316013340 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f868000e040 con 0x562640c56060 2023-09-13T09:46:14.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 10 client.17223 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:14.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5626409bbc60 con 0x562640c56060 2023-09-13T09:46:14.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f866dffb700 1 -- 172.21.15.6:0/3316013340 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8680046020 con 0x562640c56060 2023-09-13T09:46:14.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f866dffb700 1 -- 172.21.15.6:0/3316013340 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f868000b450 con 0x562640c56060 2023-09-13T09:46:14.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 10 client.17223 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:14.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 10 client.17223 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:46:14.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 20 client.17223 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:14.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640cd0060 0x562640cd2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 4 client.17223 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:14.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562640b60050 con 0x562640cd0060 2023-09-13T09:46:14.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.205+0000 7f868659c700 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640cd0060 0x562640cd2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f866dffb700 10 client.17223 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:14.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f868659c700 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640cd0060 0x562640cd2450 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9b4c0da4cef9cb89 server_cookie=79b323ea592b265d in_seq=0 out_seq=0 2023-09-13T09:46:14.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f866dffb700 1 -- 172.21.15.6:0/3316013340 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562640b60050 con 0x562640cd0060 2023-09-13T09:46:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f866dffb700 10 client.17223 handle_command_reply: tid=0 2023-09-13T09:46:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 client.17223 shutdown 2023-09-13T09:46:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 msgr2=0x562640c61f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c61f40 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8680006200 tx=0x7f868000bcd0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 shutdown_connections 2023-09-13T09:46:14.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562640cd0060 0x562640cd2450 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562640c56060 0x562640c61f40 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562640c54a00 0x562640c64f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f866dffb700 0 client.17223 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:14.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 --2- 172.21.15.6:0/3316013340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562640c55700 0x562640c61a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 >> 172.21.15.6:0/3316013340 conn(0x562640bb2c80 msgr2=0x562640c588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 shutdown_connections 2023-09-13T09:46:14.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 1 -- 172.21.15.6:0/3316013340 wait complete. 2023-09-13T09:46:14.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.206+0000 7f8698af9b80 20 client.17223 trim_cache size 0 max 16384 2023-09-13T09:46:14.247 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86700a0640 msgr2=0x7f86700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86700a0640 0x7f86700a2b00 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8688100d10 tx=0x7f8678009260 comp rx=0 tx=0).stop 2023-09-13T09:46:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688100eb0 msgr2=0x7f8688195fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688100eb0 0x7f8688195fa0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f867c00e9a0 tx=0x7f867c00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 shutdown_connections 2023-09-13T09:46:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86700a0640 0x7f86700a2b00 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8688101850 0x7f868819d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86880ffcc0 0x7f8688195a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 --2- 172.21.15.6:0/596564091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688100eb0 0x7f8688195fa0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 >> 172.21.15.6:0/596564091 conn(0x7f86880fb250 msgr2=0x7f86880fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 shutdown_connections 2023-09-13T09:46:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.207+0000 7f868c914700 1 -- 172.21.15.6:0/596564091 wait complete. 2023-09-13T09:46:14.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:46:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3010905522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 msgr2=0x7f8ac4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3010905522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4101310 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009990 tx=0x7f8ab4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3010905522 shutdown_connections 2023-09-13T09:46:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3010905522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac4101850 0x7f8ac4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3010905522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ac40ffcc0 0x7f8ac41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3010905522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4101310 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3010905522 >> 172.21.15.6:0/3010905522 conn(0x7f8ac40fb250 msgr2=0x7f8ac40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3010905522 shutdown_connections 2023-09-13T09:46:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.388+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3010905522 wait complete. 2023-09-13T09:46:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 Processor -- start 2023-09-13T09:46:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 -- start start 2023-09-13T09:46:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ac40ffcc0 0x7f8ac410a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4108a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac4101850 0x7f8ac4108fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac4109760 con 0x7f8ac4100eb0 2023-09-13T09:46:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac41098d0 con 0x7f8ac4101850 2023-09-13T09:46:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.389+0000 7f8acbdd3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac41a0b20 con 0x7f8ac40ffcc0 2023-09-13T09:46:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4108a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4108a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38118/0 (socket says 172.21.15.6:38118) 2023-09-13T09:46:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 -- 172.21.15.6:0/3732232442 learned_addr learned my addr 172.21.15.6:0/3732232442 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ac40ffcc0 0x7f8ac410a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8aca370700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac4101850 0x7f8ac4108fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 -- 172.21.15.6:0/3732232442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ac40ffcc0 msgr2=0x7f8ac410a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ac40ffcc0 0x7f8ac410a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 -- 172.21.15.6:0/3732232442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac4101850 msgr2=0x7f8ac4108fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac4101850 0x7f8ac4108fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 -- 172.21.15.6:0/3732232442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab40095f0 con 0x7f8ac4100eb0 2023-09-13T09:46:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8ac936e700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4108a80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40059d0 tx=0x7f8ab4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8abaffd700 1 -- 172.21.15.6:0/3732232442 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab401d070 con 0x7f8ac4100eb0 2023-09-13T09:46:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8abaffd700 1 -- 172.21.15.6:0/3732232442 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab400fb90 con 0x7f8ac4100eb0 2023-09-13T09:46:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac41a0da0 con 0x7f8ac4100eb0 2023-09-13T09:46:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8abaffd700 1 -- 172.21.15.6:0/3732232442 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40173f0 con 0x7f8ac4100eb0 2023-09-13T09:46:14.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.390+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac41a11c0 con 0x7f8ac4100eb0 2023-09-13T09:46:14.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.392+0000 7f8abaffd700 1 -- 172.21.15.6:0/3732232442 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8ab400fd00 con 0x7f8ac4100eb0 2023-09-13T09:46:14.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.393+0000 7f8abaffd700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8ab00a0640 0x7f8ab00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.393+0000 7f8abaffd700 1 -- 172.21.15.6:0/3732232442 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8ab40ccfe0 con 0x7f8ac4100eb0 2023-09-13T09:46:14.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.393+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8ab00a0640 0x7f8ab00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.394+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8ab00a0640 0x7f8ab00a2b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4100d10 tx=0x7f8ac0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.394+0000 7f8ad7fb8b80 1 Processor -- start 2023-09-13T09:46:14.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ad7fb8b80 1 -- start start 2023-09-13T09:46:14.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aefb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88af0060 0x557e88aee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88aeee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88a47780 con 0x557e88af0060 2023-09-13T09:46:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88a450a0 con 0x557e88aef700 2023-09-13T09:46:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88a40990 con 0x557e88aeea00 2023-09-13T09:46:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac9b6f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aefb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88af0060 0x557e88aee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88af0060 0x557e88aee4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38126/0 (socket says 172.21.15.6:38126) 2023-09-13T09:46:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac9b6f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aefb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59880/0 (socket says 172.21.15.6:59880) 2023-09-13T09:46:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 -- 172.21.15.6:0/2195926535 learned_addr learned my addr 172.21.15.6:0/2195926535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8aca370700 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88aeee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 -- 172.21.15.6:0/2195926535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 msgr2=0x557e88aeee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88aeee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 -- 172.21.15.6:0/2195926535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 msgr2=0x557e88aefb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aefb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 -- 172.21.15.6:0/2195926535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e888c0630 con 0x557e88af0060 2023-09-13T09:46:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aefb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.395+0000 7f8ac936e700 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88af0060 0x557e88aee4c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4097260 tx=0x7f8ab4005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f6f7aca223eaf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8aaffff700 1 -- 172.21.15.6:0/2195926535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab409aef0 con 0x557e88af0060 2023-09-13T09:46:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8aaffff700 1 -- 172.21.15.6:0/2195926535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab409a7f0 con 0x557e88af0060 2023-09-13T09:46:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8aaffff700 1 -- 172.21.15.6:0/2195926535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40a2340 con 0x557e88af0060 2023-09-13T09:46:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2195926535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88af0060 msgr2=0x557e88aee4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88af0060 0x557e88aee4c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4097260 tx=0x7f8ab4005ef0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2195926535 shutdown_connections 2023-09-13T09:46:14.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88aeee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aefb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2195926535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88af0060 0x557e88aee4c0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2195926535 >> 172.21.15.6:0/2195926535 conn(0x557e88a4cc80 msgr2=0x557e88ae8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.396+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2195926535 shutdown_connections 2023-09-13T09:46:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2195926535 wait complete. 2023-09-13T09:46:14.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 -- start start 2023-09-13T09:46:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 Processor -- start 2023-09-13T09:46:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88af7c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88af8160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88aff1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e889debb0 con 0x557e88aeea00 2023-09-13T09:46:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e889de8b0 con 0x557e88aef700 2023-09-13T09:46:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e888c2920 con 0x557e88af0060 2023-09-13T09:46:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ad7fb8b80 10 client.0 _ll_register_callbacks cb 0x557e889dc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.397+0000 7f8ac9b6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88af7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac9b6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88af7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38130/0 (socket says 172.21.15.6:38130) 2023-09-13T09:46:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac9b6f700 1 -- 172.21.15.6:0/1419955008 learned_addr learned my addr 172.21.15.6:0/1419955008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac936e700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88af8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8aca370700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88aff1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac936e700 1 -- 172.21.15.6:0/1419955008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 msgr2=0x557e88aff1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac936e700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88aff1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac936e700 1 -- 172.21.15.6:0/1419955008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 msgr2=0x557e88af7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac936e700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88af7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac936e700 1 -- 172.21.15.6:0/1419955008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac41a11c0 con 0x557e88aef700 2023-09-13T09:46:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88af7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ac936e700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88af8160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ab409a4f0 tx=0x7f8ab409a5c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f752ab5dcb9a7300 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8aad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8aad7fa700 1 -- 172.21.15.6:0/1419955008 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4096050 con 0x557e88aef700 2023-09-13T09:46:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e88ae1670 con 0x557e88aef700 2023-09-13T09:46:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8aad7fa700 1 -- 172.21.15.6:0/1419955008 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8ab40961b0 con 0x557e88aef700 2023-09-13T09:46:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8aad7fa700 1 -- 172.21.15.6:0/1419955008 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab409e170 con 0x557e88aef700 2023-09-13T09:46:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ad7fb8b80 10 client.26648 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.398+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557e88a587a0 con 0x557e88aef700 2023-09-13T09:46:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8aad7fa700 1 -- 172.21.15.6:0/1419955008 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557e88ae1670 con 0x557e88aef700 2023-09-13T09:46:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8aad7fa700 1 -- 172.21.15.6:0/1419955008 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8ab4099750 con 0x557e88aef700 2023-09-13T09:46:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8ad7fb8b80 10 client.26648 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8ad7fb8b80 10 client.26648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8ad7fb8b80 20 client.26648 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b03540 0x557e88b05930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8ad7fb8b80 4 client.26648 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e88a39970 con 0x557e88b03540 2023-09-13T09:46:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.399+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b03540 0x557e88b05930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8aad7fa700 10 client.26648 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b03540 0x557e88b05930 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688e774ba03bd1d1 server_cookie=82f7aee29a18c6db in_seq=0 out_seq=0 2023-09-13T09:46:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8aad7fa700 1 -- 172.21.15.6:0/1419955008 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e88a39970 con 0x557e88b03540 2023-09-13T09:46:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8aad7fa700 10 client.26648 handle_command_reply: tid=0 2023-09-13T09:46:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 client.26648 shutdown 2023-09-13T09:46:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 msgr2=0x557e88af8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88af8160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8ab409a4f0 tx=0x7f8ab409a5c0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 shutdown_connections 2023-09-13T09:46:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88aff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b03540 0x557e88b05930 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88af7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8aad7fa700 0 client.26648 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:14.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/1419955008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88af8160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.400+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 >> 172.21.15.6:0/1419955008 conn(0x557e88a4cc80 msgr2=0x557e88ae37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.401+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 shutdown_connections 2023-09-13T09:46:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.401+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/1419955008 wait complete. 2023-09-13T09:46:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.401+0000 7f8ad7fb8b80 20 client.26648 trim_cache size 0 max 16384 2023-09-13T09:46:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 Processor -- start 2023-09-13T09:46:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 -- start start 2023-09-13T09:46:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88aee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aff160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88af68e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88ae5910 con 0x557e88aeea00 2023-09-13T09:46:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88aea730 con 0x557e88aef700 2023-09-13T09:46:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88af88a0 con 0x557e88af0060 2023-09-13T09:46:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac9b6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88aee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8aca370700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88af68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac936e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aff160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac9b6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88aee4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38138/0 (socket says 172.21.15.6:38138) 2023-09-13T09:46:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac9b6f700 1 -- 172.21.15.6:0/2266615345 learned_addr learned my addr 172.21.15.6:0/2266615345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac936e700 1 -- 172.21.15.6:0/2266615345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 msgr2=0x557e88af68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac936e700 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88af68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac936e700 1 -- 172.21.15.6:0/2266615345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 msgr2=0x557e88aee4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac936e700 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88aee4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac936e700 1 -- 172.21.15.6:0/2266615345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e8886cde0 con 0x557e88aef700 2023-09-13T09:46:14.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.414+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88aee4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ac936e700 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aff160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ab409a780 tx=0x7f8ab4005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb04f4cd98b8012b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ab8ff9700 1 -- 172.21.15.6:0/2266615345 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4099ce0 con 0x557e88aef700 2023-09-13T09:46:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ab8ff9700 1 -- 172.21.15.6:0/2266615345 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab409e620 con 0x557e88aef700 2023-09-13T09:46:14.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ab8ff9700 1 -- 172.21.15.6:0/2266615345 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab40998d0 con 0x557e88aef700 2023-09-13T09:46:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2266615345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 msgr2=0x557e88aff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aff160 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f8ab409a780 tx=0x7f8ab4005ef0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2266615345 shutdown_connections 2023-09-13T09:46:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88af0060 0x557e88af68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aeea00 0x557e88aee4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/2266615345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88aef700 0x557e88aff160 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.415+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2266615345 >> 172.21.15.6:0/2266615345 conn(0x557e88a4cc80 msgr2=0x557e88affa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2266615345 shutdown_connections 2023-09-13T09:46:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/2266615345 wait complete. 2023-09-13T09:46:14.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 -- start start 2023-09-13T09:46:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 Processor -- start 2023-09-13T09:46:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88afa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aef700 0x557e88afaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88af0060 0x557e88afdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88afe470 con 0x557e88aef700 2023-09-13T09:46:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88afe5e0 con 0x557e88af0060 2023-09-13T09:46:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.416+0000 7f8ad7fb8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e88afe7a0 con 0x557e88aeea00 2023-09-13T09:46:14.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ad7fb8b80 10 client.0 _ll_register_callbacks cb 0x557e889dc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac936e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aef700 0x557e88afaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac936e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aef700 0x557e88afaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38146/0 (socket says 172.21.15.6:38146) 2023-09-13T09:46:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac936e700 1 -- 172.21.15.6:0/3258375799 learned_addr learned my addr 172.21.15.6:0/3258375799 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88afa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8aca370700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88af0060 0x557e88afdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac9b6f700 1 -- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88af0060 msgr2=0x557e88afdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88af0060 0x557e88afdf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac9b6f700 1 -- 172.21.15.6:0/3258375799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aef700 msgr2=0x557e88afaf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aef700 0x557e88afaf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac9b6f700 1 -- 172.21.15.6:0/3258375799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac0011af0 con 0x557e88aeea00 2023-09-13T09:46:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac936e700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aef700 0x557e88afaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8aca370700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88af0060 0x557e88afdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8ac9b6f700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88afa9d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x557e88a39ab0 tx=0x7f8ac00047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283962157dc80746 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:14.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.417+0000 7f8aad7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:46:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8aad7fa700 1 -- 172.21.15.6:0/3258375799 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ac0022040 con 0x557e88aeea00 2023-09-13T09:46:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ab409a7f0 con 0x557e88aeea00 2023-09-13T09:46:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8aad7fa700 1 -- 172.21.15.6:0/3258375799 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8ac0004220 con 0x557e88aeea00 2023-09-13T09:46:14.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8aad7fa700 1 -- 172.21.15.6:0/3258375799 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ac00043e0 con 0x557e88aeea00 2023-09-13T09:46:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8ad7fb8b80 10 client.26596 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557e88a587a0 con 0x557e88aeea00 2023-09-13T09:46:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8aad7fa700 1 -- 172.21.15.6:0/3258375799 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ab409a7f0 con 0x557e88aeea00 2023-09-13T09:46:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8aad7fa700 1 -- 172.21.15.6:0/3258375799 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8ac00039b0 con 0x557e88aeea00 2023-09-13T09:46:14.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8ad7fb8b80 10 client.26596 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8ad7fb8b80 10 client.26596 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8ad7fb8b80 20 client.26596 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.418+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b57de0 0x557e88b5a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:14.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8ad7fb8b80 4 client.26596 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557e889fa050 con 0x557e88b57de0 2023-09-13T09:46:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8ac936e700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b57de0 0x557e88b5a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8ac936e700 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b57de0 0x557e88b5a1d0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a46e70f80bd6e3d server_cookie=56d57b1757b3faf6 in_seq=0 out_seq=0 2023-09-13T09:46:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8aad7fa700 10 client.26596 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:14.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8aad7fa700 1 -- 172.21.15.6:0/3258375799 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557e889fa050 con 0x557e88b57de0 2023-09-13T09:46:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8aad7fa700 10 client.26596 handle_command_reply: tid=0 2023-09-13T09:46:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8ad7fb8b80 1 client.26596 shutdown 2023-09-13T09:46:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 msgr2=0x557e88afa9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.419+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88afa9d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x557e88a39ab0 tx=0x7f8ac00047c0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 shutdown_connections 2023-09-13T09:46:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e88af0060 0x557e88afdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e88aeea00 0x557e88afa9d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e88b57de0 0x557e88b5a1d0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 --2- 172.21.15.6:0/3258375799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e88aef700 0x557e88afaf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8aad7fa700 0 client.26596 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 >> 172.21.15.6:0/3258375799 conn(0x557e88a4cc80 msgr2=0x557e88af28e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 shutdown_connections 2023-09-13T09:46:14.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 1 -- 172.21.15.6:0/3258375799 wait complete. 2023-09-13T09:46:14.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8ad7fb8b80 20 client.26596 trim_cache size 0 max 16384 2023-09-13T09:46:14.453 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8ab00a0640 msgr2=0x7f8ab00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8ab00a0640 0x7f8ab00a2b00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8ac4100d10 tx=0x7f8ac0009260 comp rx=0 tx=0).stop 2023-09-13T09:46:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 msgr2=0x7f8ac4108a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4108a80 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40059d0 tx=0x7f8ab4004730 comp rx=0 tx=0).stop 2023-09-13T09:46:14.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 shutdown_connections 2023-09-13T09:46:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ac4101850 0x7f8ac4108fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ac40ffcc0 0x7f8ac410a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8ab00a0640 0x7f8ab00a2b00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 --2- 172.21.15.6:0/3732232442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ac4100eb0 0x7f8ac4108a80 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 >> 172.21.15.6:0/3732232442 conn(0x7f8ac40fb250 msgr2=0x7f8ac41043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 shutdown_connections 2023-09-13T09:46:14.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:14.420+0000 7f8acbdd3700 1 -- 172.21.15.6:0/3732232442 wait complete. 2023-09-13T09:46:14.457 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:14 smithi006 ceph-mon[98665]: pgmap v501: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2023-09-13T09:46:14.458 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:14 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2342628355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:46:14.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:14 smithi053 ceph-mon[102373]: pgmap v501: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2023-09-13T09:46:14.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:14 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2342628355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:46:14.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:14 smithi131 ceph-mon[102785]: pgmap v501: 97 pgs: 97 active+clean; 112 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 949 KiB/s rd, 1.2 MiB/s wr, 221 op/s 2023-09-13T09:46:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:14 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2342628355' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:46:15.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 251948 3.99 MB/sec execute 215 sec latency 16.495 ms 2023-09-13T09:46:15.460 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:46:15.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:46:15.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 -- 172.21.15.6:0/2826907426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 msgr2=0x7f1264101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 --2- 172.21.15.6:0/2826907426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f1264101310 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f12540099c0 tx=0x7f1254009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 -- 172.21.15.6:0/2826907426 shutdown_connections 2023-09-13T09:46:15.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 --2- 172.21.15.6:0/2826907426 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1264101850 0x7f1264108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 --2- 172.21.15.6:0/2826907426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12640ffcc0 0x7f12641000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 --2- 172.21.15.6:0/2826907426 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f1264101310 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 -- 172.21.15.6:0/2826907426 >> 172.21.15.6:0/2826907426 conn(0x7f12640fb250 msgr2=0x7f12640fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 -- 172.21.15.6:0/2826907426 shutdown_connections 2023-09-13T09:46:15.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 -- 172.21.15.6:0/2826907426 wait complete. 2023-09-13T09:46:15.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 Processor -- start 2023-09-13T09:46:15.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.594+0000 7f126c037700 1 -- start start 2023-09-13T09:46:15.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12640ffcc0 0x7f12640698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f126419b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1264101850 0x7f126419ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126419e5c0 con 0x7f1264100eb0 2023-09-13T09:46:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126419e730 con 0x7f12640ffcc0 2023-09-13T09:46:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f126419e8f0 con 0x7f1264101850 2023-09-13T09:46:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f126419b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f1269dd3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12640ffcc0 0x7f12640698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f126419b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38158/0 (socket says 172.21.15.6:38158) 2023-09-13T09:46:15.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 -- 172.21.15.6:0/2371213262 learned_addr learned my addr 172.21.15.6:0/2371213262 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126a5d4700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1264101850 0x7f126419ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 -- 172.21.15.6:0/2371213262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1264101850 msgr2=0x7f126419ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1264101850 0x7f126419ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 -- 172.21.15.6:0/2371213262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12640ffcc0 msgr2=0x7f12640698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12640ffcc0 0x7f12640698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 -- 172.21.15.6:0/2371213262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12540095f0 con 0x7f1264100eb0 2023-09-13T09:46:15.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f1269dd3700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12640ffcc0 0x7f12640698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f12695d2700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f126419b7a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1254009990 tx=0x7f125400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f125affd700 1 -- 172.21.15.6:0/2371213262 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125401d070 con 0x7f1264100eb0 2023-09-13T09:46:15.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f125affd700 1 -- 172.21.15.6:0/2371213262 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1254005030 con 0x7f1264100eb0 2023-09-13T09:46:15.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f126419eb70 con 0x7f1264100eb0 2023-09-13T09:46:15.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f125affd700 1 -- 172.21.15.6:0/2371213262 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1254004a70 con 0x7f1264100eb0 2023-09-13T09:46:15.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.595+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126419ef90 con 0x7f1264100eb0 2023-09-13T09:46:15.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.599+0000 7f127821cb80 1 Processor -- start 2023-09-13T09:46:15.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.599+0000 7f127821cb80 1 -- start start 2023-09-13T09:46:15.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f127821cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb3ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f127821cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb404f0 0x56186bb3e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f127821cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3ee90 0x56186bb3f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f127821cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186ba93800 con 0x56186bb3fb90 2023-09-13T09:46:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f127821cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186ba91120 con 0x56186bb404f0 2023-09-13T09:46:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f127821cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186ba8ca10 con 0x56186bb3ee90 2023-09-13T09:46:15.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f126a5d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb3ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f1269dd3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb404f0 0x56186bb3e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f126a5d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb3ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38162/0 (socket says 172.21.15.6:38162) 2023-09-13T09:46:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f126a5d4700 1 -- 172.21.15.6:0/3336355537 learned_addr learned my addr 172.21.15.6:0/3336355537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f125affd700 1 -- 172.21.15.6:0/2371213262 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1254005410 con 0x7f1264100eb0 2023-09-13T09:46:15.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f12695d2700 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3ee90 0x56186bb3f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f1269dd3700 1 -- 172.21.15.6:0/3336355537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3ee90 msgr2=0x56186bb3f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f1269dd3700 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3ee90 0x56186bb3f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f1269dd3700 1 -- 172.21.15.6:0/3336355537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 msgr2=0x56186bb3ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f1269dd3700 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb3ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f1269dd3700 1 -- 172.21.15.6:0/3336355537 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56186b90c6b0 con 0x56186bb404f0 2023-09-13T09:46:15.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f126a5d4700 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb3ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f12695d2700 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3ee90 0x56186bb3f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:46:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f1269dd3700 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb404f0 0x56186bb3e950 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12600114c0 tx=0x7f12600117d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d73edbdd62b52c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.600+0000 7f125affd700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12500a06c0 0x7f12500a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f124ffff700 1 -- 172.21.15.6:0/3336355537 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260004310 con 0x56186bb404f0 2023-09-13T09:46:15.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f124ffff700 1 -- 172.21.15.6:0/3336355537 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1260004470 con 0x56186bb404f0 2023-09-13T09:46:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f124ffff700 1 -- 172.21.15.6:0/3336355537 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260003680 con 0x56186bb404f0 2023-09-13T09:46:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f126a5d4700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12500a06c0 0x7f12500a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f125affd700 1 -- 172.21.15.6:0/2371213262 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f12540cca00 con 0x7f1264100eb0 2023-09-13T09:46:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 -- 172.21.15.6:0/3336355537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb404f0 msgr2=0x56186bb3e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb404f0 0x56186bb3e950 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f12600114c0 tx=0x7f12600117d0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f126a5d4700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12500a06c0 0x7f12500a2b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f125c007610 tx=0x7f125c00b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 -- 172.21.15.6:0/3336355537 shutdown_connections 2023-09-13T09:46:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3ee90 0x56186bb3f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb3ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 --2- 172.21.15.6:0/3336355537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb404f0 0x56186bb3e950 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 -- 172.21.15.6:0/3336355537 >> 172.21.15.6:0/3336355537 conn(0x56186ba98d00 msgr2=0x56186bb34f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.601+0000 7f127821cb80 1 -- 172.21.15.6:0/3336355537 shutdown_connections 2023-09-13T09:46:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 -- 172.21.15.6:0/3336355537 wait complete. 2023-09-13T09:46:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 -- start start 2023-09-13T09:46:15.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 Processor -- start 2023-09-13T09:46:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb48390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb488d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb404f0 0x56186bb4f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186ba2ac30 con 0x56186bb3fb90 2023-09-13T09:46:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186ba2a930 con 0x56186bb3ee90 2023-09-13T09:46:15.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186b90e9a0 con 0x56186bb404f0 2023-09-13T09:46:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f127821cb80 10 client.0 _ll_register_callbacks cb 0x56186ba28700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f1269dd3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb48390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f126a5d4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb404f0 0x56186bb4f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f12695d2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb488d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.602+0000 7f1269dd3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb48390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59926/0 (socket says 172.21.15.6:59926) 2023-09-13T09:46:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f1269dd3700 1 -- 172.21.15.6:0/2058226000 learned_addr learned my addr 172.21.15.6:0/2058226000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f126a5d4700 1 -- 172.21.15.6:0/2058226000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 msgr2=0x56186bb48390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f126a5d4700 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb48390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f126a5d4700 1 -- 172.21.15.6:0/2058226000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 msgr2=0x56186bb488d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f126a5d4700 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb488d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f126a5d4700 1 -- 172.21.15.6:0/2058226000 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1260009c90 con 0x56186bb404f0 2023-09-13T09:46:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f12695d2700 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f126a5d4700 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb404f0 0x56186bb4f910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f125c016db0 tx=0x7f125c004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=705ed8ff847733dd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f124d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:46:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f124d7fa700 1 -- 172.21.15.6:0/2058226000 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125c026070 con 0x56186bb404f0 2023-09-13T09:46:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f124d7fa700 1 -- 172.21.15.6:0/2058226000 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f125c004bb0 con 0x56186bb404f0 2023-09-13T09:46:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56186bb2d6f0 con 0x56186bb404f0 2023-09-13T09:46:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f124d7fa700 1 -- 172.21.15.6:0/2058226000 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f125c00e040 con 0x56186bb404f0 2023-09-13T09:46:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f127821cb80 10 client.26605 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.603+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56186baa4820 con 0x56186bb404f0 2023-09-13T09:46:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f124d7fa700 1 -- 172.21.15.6:0/2058226000 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f125c030020 con 0x56186bb404f0 2023-09-13T09:46:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f124d7fa700 1 -- 172.21.15.6:0/2058226000 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f125c029030 con 0x56186bb404f0 2023-09-13T09:46:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f127821cb80 10 client.26605 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f127821cb80 10 client.26605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f127821cb80 20 client.26605 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f127821cb80 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb54230 0x56186bb56650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f127821cb80 4 client.26605 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56186ba859f0 con 0x56186bb54230 2023-09-13T09:46:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f1269dd3700 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb54230 0x56186bb56650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f124d7fa700 10 client.26605 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.604+0000 7f1269dd3700 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb54230 0x56186bb56650 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac8acf2ce82624f server_cookie=da81b16287461e98 in_seq=0 out_seq=0 2023-09-13T09:46:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f124d7fa700 1 -- 172.21.15.6:0/2058226000 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56186ba859f0 con 0x56186bb54230 2023-09-13T09:46:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f124d7fa700 10 client.26605 handle_command_reply: tid=0 2023-09-13T09:46:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 client.26605 shutdown 2023-09-13T09:46:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb404f0 msgr2=0x56186bb4f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb404f0 0x56186bb4f910 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f125c016db0 tx=0x7f125c004ad0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 shutdown_connections 2023-09-13T09:46:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb404f0 0x56186bb4f910 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb48390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb54230 0x56186bb56650 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 --2- 172.21.15.6:0/2058226000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb488d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f124d7fa700 0 client.26605 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 >> 172.21.15.6:0/2058226000 conn(0x56186ba98d00 msgr2=0x56186bb34f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 shutdown_connections 2023-09-13T09:46:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 1 -- 172.21.15.6:0/2058226000 wait complete. 2023-09-13T09:46:15.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.606+0000 7f127821cb80 20 client.26605 trim_cache size 0 max 16384 2023-09-13T09:46:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 Processor -- start 2023-09-13T09:46:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 -- start start 2023-09-13T09:46:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186ba98d00 0x56186bb2f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3fb90 0x56186bb39c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186bb36a70 con 0x56186ba98d00 2023-09-13T09:46:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186bb2d510 con 0x56186bb3ee90 2023-09-13T09:46:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f127821cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186bb46030 con 0x56186bb3fb90 2023-09-13T09:46:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f1269dd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186ba98d00 0x56186bb2f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f126a5d4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3fb90 0x56186bb39c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f1269dd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186ba98d00 0x56186bb2f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38178/0 (socket says 172.21.15.6:38178) 2023-09-13T09:46:15.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f12695d2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.624+0000 7f1269dd3700 1 -- 172.21.15.6:0/792386718 learned_addr learned my addr 172.21.15.6:0/792386718 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1269dd3700 1 -- 172.21.15.6:0/792386718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3fb90 msgr2=0x56186bb39c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1269dd3700 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3fb90 0x56186bb39c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1269dd3700 1 -- 172.21.15.6:0/792386718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 msgr2=0x56186bb4f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1269dd3700 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1269dd3700 1 -- 172.21.15.6:0/792386718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56186b8b8e60 con 0x56186ba98d00 2023-09-13T09:46:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f126a5d4700 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3fb90 0x56186bb39c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f12695d2700 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1269dd3700 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186ba98d00 0x56186bb2f970 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f12600097c0 tx=0x7f1260009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41c857ea8911801 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1258ff9700 1 -- 172.21.15.6:0/792386718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260029070 con 0x56186ba98d00 2023-09-13T09:46:15.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1258ff9700 1 -- 172.21.15.6:0/792386718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1260005ce0 con 0x56186ba98d00 2023-09-13T09:46:15.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.625+0000 7f1258ff9700 1 -- 172.21.15.6:0/792386718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1260024420 con 0x56186ba98d00 2023-09-13T09:46:15.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 -- 172.21.15.6:0/792386718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186ba98d00 msgr2=0x56186bb2f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186ba98d00 0x56186bb2f970 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f12600097c0 tx=0x7f1260009fb0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 -- 172.21.15.6:0/792386718 shutdown_connections 2023-09-13T09:46:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186bb3fb90 0x56186bb39c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186ba98d00 0x56186bb2f970 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 --2- 172.21.15.6:0/792386718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 -- 172.21.15.6:0/792386718 >> 172.21.15.6:0/792386718 conn(0x56186bb352c0 msgr2=0x56186bb39530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 -- 172.21.15.6:0/792386718 shutdown_connections 2023-09-13T09:46:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 -- 172.21.15.6:0/792386718 wait complete. 2023-09-13T09:46:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 -- start start 2023-09-13T09:46:15.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 Processor -- start 2023-09-13T09:46:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.626+0000 7f127821cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186ba98d00 0x56186bb4d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f127821cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f127821cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb4ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f127821cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186bb4efd0 con 0x56186bb3fb90 2023-09-13T09:46:15.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f127821cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186bb4f140 con 0x56186bb3ee90 2023-09-13T09:46:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f127821cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56186bb4f300 con 0x56186ba98d00 2023-09-13T09:46:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f127821cb80 10 client.0 _ll_register_callbacks cb 0x56186ba28700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59942/0 (socket says 172.21.15.6:59942) 2023-09-13T09:46:15.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 -- 172.21.15.6:0/3868480730 learned_addr learned my addr 172.21.15.6:0/3868480730 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f126a5d4700 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb4ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 -- 172.21.15.6:0/3868480730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186ba98d00 msgr2=0x56186bb4d540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:46:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186ba98d00 0x56186bb4d540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 -- 172.21.15.6:0/3868480730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 msgr2=0x56186bb4ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb4ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 -- 172.21.15.6:0/3868480730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f126419ef90 con 0x56186bb3ee90 2023-09-13T09:46:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f12695d2700 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4da80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f12540966d0 tx=0x7f125409a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70b669c7ecdda7ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f124d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f124d7fa700 1 -- 172.21.15.6:0/3868480730 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f125409a8d0 con 0x56186bb3ee90 2023-09-13T09:46:15.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f124d7fa700 1 -- 172.21.15.6:0/3868480730 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f125409a1d0 con 0x56186bb3ee90 2023-09-13T09:46:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.627+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1260004470 con 0x56186bb3ee90 2023-09-13T09:46:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f124d7fa700 1 -- 172.21.15.6:0/3868480730 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f125409e000 con 0x56186bb3ee90 2023-09-13T09:46:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 10 client.26672 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56186baa4820 con 0x56186bb3ee90 2023-09-13T09:46:15.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f124d7fa700 1 -- 172.21.15.6:0/3868480730 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f12540b6080 con 0x56186bb3ee90 2023-09-13T09:46:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f124d7fa700 1 -- 172.21.15.6:0/3868480730 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f12540a1e40 con 0x56186bb3ee90 2023-09-13T09:46:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 10 client.26672 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 10 client.26672 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 20 client.26672 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb404f0 0x56186bb3ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 4 client.26672 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:46:15.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56186ba460d0 con 0x56186bb404f0 2023-09-13T09:46:15.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f1269dd3700 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb404f0 0x56186bb3ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f124d7fa700 10 client.26672 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.628+0000 7f1269dd3700 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb404f0 0x56186bb3ca80 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be4231ba5e979fc2 server_cookie=d2e6583155ba3ba1 in_seq=0 out_seq=0 2023-09-13T09:46:15.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f124d7fa700 1 -- 172.21.15.6:0/3868480730 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56186ba460d0 con 0x56186bb404f0 2023-09-13T09:46:15.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f124d7fa700 10 client.26672 handle_command_reply: tid=0 2023-09-13T09:46:15.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 client.26672 shutdown 2023-09-13T09:46:15.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 msgr2=0x56186bb4da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4da80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f12540966d0 tx=0x7f125409a710 comp rx=0 tx=0).stop 2023-09-13T09:46:15.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 shutdown_connections 2023-09-13T09:46:15.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56186bb404f0 0x56186bb3ca80 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56186bb3fb90 0x56186bb4ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56186ba98d00 0x56186bb4d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 --2- 172.21.15.6:0/3868480730 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56186bb3ee90 0x56186bb4da80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f124d7fa700 0 client.26672 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 >> 172.21.15.6:0/3868480730 conn(0x56186bb352c0 msgr2=0x56186bb39dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 shutdown_connections 2023-09-13T09:46:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 1 -- 172.21.15.6:0/3868480730 wait complete. 2023-09-13T09:46:15.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f127821cb80 20 client.26672 trim_cache size 0 max 16384 2023-09-13T09:46:15.649 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:46:15.649 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:46:15.649 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "3a522531-e951-47a8-9b5c-723ceb18a9ae", 2023-09-13T09:46:15.649 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:46:15.649 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:46:15.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12500a06c0 msgr2=0x7f12500a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f126c037700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12500a06c0 0x7f12500a2b80 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f125c007610 tx=0x7f125c00b040 comp rx=0 tx=0).stop 2023-09-13T09:46:15.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 msgr2=0x7f126419b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.631+0000 7f126c037700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f126419b7a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f1254009990 tx=0x7f125400f690 comp rx=0 tx=0).stop 2023-09-13T09:46:15.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 shutdown_connections 2023-09-13T09:46:15.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1264101850 0x7f126419ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f12640ffcc0 0x7f12640698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f12500a06c0 0x7f12500a2b80 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 --2- 172.21.15.6:0/2371213262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1264100eb0 0x7f126419b7a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 >> 172.21.15.6:0/2371213262 conn(0x7f12640fb250 msgr2=0x7f12640fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 shutdown_connections 2023-09-13T09:46:15.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.632+0000 7f126c037700 1 -- 172.21.15.6:0/2371213262 wait complete. 2023-09-13T09:46:15.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:46:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 -- 172.21.15.6:0/2720742969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f44100eb0 msgr2=0x7f0f44101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 --2- 172.21.15.6:0/2720742969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f44100eb0 0x7f0f44101310 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f0f380099c0 tx=0x7f0f38009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 -- 172.21.15.6:0/2720742969 shutdown_connections 2023-09-13T09:46:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 --2- 172.21.15.6:0/2720742969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f44101850 0x7f0f44108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 --2- 172.21.15.6:0/2720742969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f440ffcc0 0x7f0f441000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 --2- 172.21.15.6:0/2720742969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f44100eb0 0x7f0f44101310 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 -- 172.21.15.6:0/2720742969 >> 172.21.15.6:0/2720742969 conn(0x7f0f440fb250 msgr2=0x7f0f440fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.786+0000 7f0f49f82700 1 -- 172.21.15.6:0/2720742969 shutdown_connections 2023-09-13T09:46:15.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.787+0000 7f0f49f82700 1 -- 172.21.15.6:0/2720742969 wait complete. 2023-09-13T09:46:15.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.787+0000 7f0f49f82700 1 Processor -- start 2023-09-13T09:46:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f49f82700 1 -- start start 2023-09-13T09:46:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f49f82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440ffcc0 0x7f0f44195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f49f82700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f44100eb0 0x7f0f44195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f49f82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f44101850 0x7f0f4419cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f49f82700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4419d4e0 con 0x7f0f440ffcc0 2023-09-13T09:46:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f49f82700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4419d620 con 0x7f0f44101850 2023-09-13T09:46:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f49f82700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f4419d7b0 con 0x7f0f44100eb0 2023-09-13T09:46:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440ffcc0 0x7f0f44195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440ffcc0 0x7f0f44195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38198/0 (socket says 172.21.15.6:38198) 2023-09-13T09:46:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 -- 172.21.15.6:0/3378727301 learned_addr learned my addr 172.21.15.6:0/3378727301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f43fff700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f44101850 0x7f0f4419cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f44100eb0 0x7f0f44195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 -- 172.21.15.6:0/3378727301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f44100eb0 msgr2=0x7f0f44195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f44100eb0 0x7f0f44195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 -- 172.21.15.6:0/3378727301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f44101850 msgr2=0x7f0f4419cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f44101850 0x7f0f4419cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 -- 172.21.15.6:0/3378727301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f380095f0 con 0x7f0f440ffcc0 2023-09-13T09:46:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f43fff700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f44101850 0x7f0f4419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.788+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440ffcc0 0x7f0f44195960 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400e970 tx=0x7f0f3400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.789+0000 7f0f40ff9700 1 -- 172.21.15.6:0/3378727301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34009790 con 0x7f0f440ffcc0 2023-09-13T09:46:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.789+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f4419da90 con 0x7f0f440ffcc0 2023-09-13T09:46:15.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.789+0000 7f0f40ff9700 1 -- 172.21.15.6:0/3378727301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f3400c7e0 con 0x7f0f440ffcc0 2023-09-13T09:46:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.789+0000 7f0f40ff9700 1 -- 172.21.15.6:0/3378727301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f34003c70 con 0x7f0f440ffcc0 2023-09-13T09:46:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.789+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4419dfa0 con 0x7f0f440ffcc0 2023-09-13T09:46:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.791+0000 7f0f40ff9700 1 -- 172.21.15.6:0/3378727301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0f3400cc50 con 0x7f0f440ffcc0 2023-09-13T09:46:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f40ff9700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f2c0a0640 0x7f0f2c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f2c0a0640 0x7f0f2c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f40ff9700 1 -- 172.21.15.6:0/3378727301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f34014070 con 0x7f0f440ffcc0 2023-09-13T09:46:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f2c0a0640 0x7f0f2c0a2b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800b580 tx=0x7f0f38005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f56167b80 1 Processor -- start 2023-09-13T09:46:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f56167b80 1 -- start start 2023-09-13T09:46:15.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b7700 0x5599c06b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.792+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c06b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b6a00 0x5599c06b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f56167b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c060f780 con 0x5599c06b6a00 2023-09-13T09:46:15.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f56167b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c060d0a0 con 0x5599c06b8060 2023-09-13T09:46:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f56167b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c0608990 con 0x5599c06b7700 2023-09-13T09:46:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b6a00 0x5599c06b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c06b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c06b64c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59964/0 (socket says 172.21.15.6:59964) 2023-09-13T09:46:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b6a00 0x5599c06b6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38210/0 (socket says 172.21.15.6:38210) 2023-09-13T09:46:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3932787113 learned_addr learned my addr 172.21.15.6:0/3932787113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b7700 0x5599c06b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3932787113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b7700 msgr2=0x5599c06b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b7700 0x5599c06b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3932787113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b6a00 msgr2=0x5599c06b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b6a00 0x5599c06b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3932787113 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599c0488630 con 0x5599c06b8060 2023-09-13T09:46:15.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f43fff700 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b6a00 0x5599c06b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b7700 0x5599c06b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.793+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c06b64c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f38015000 tx=0x7f0f3801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=603d437bab3f5f29 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f29ffb700 1 -- 172.21.15.6:0/3932787113 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3802b070 con 0x5599c06b8060 2023-09-13T09:46:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f29ffb700 1 -- 172.21.15.6:0/3932787113 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f3801e040 con 0x5599c06b8060 2023-09-13T09:46:15.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f29ffb700 1 -- 172.21.15.6:0/3932787113 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f380248d0 con 0x5599c06b8060 2023-09-13T09:46:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 -- 172.21.15.6:0/3932787113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 msgr2=0x5599c06b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c06b64c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f38015000 tx=0x7f0f3801f000 comp rx=0 tx=0).stop 2023-09-13T09:46:15.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 -- 172.21.15.6:0/3932787113 shutdown_connections 2023-09-13T09:46:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b6a00 0x5599c06b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b7700 0x5599c06b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3932787113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c06b64c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 -- 172.21.15.6:0/3932787113 >> 172.21.15.6:0/3932787113 conn(0x5599c0614c80 msgr2=0x5599c06b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 -- 172.21.15.6:0/3932787113 shutdown_connections 2023-09-13T09:46:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.794+0000 7f0f56167b80 1 -- 172.21.15.6:0/3932787113 wait complete. 2023-09-13T09:46:15.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 -- start start 2023-09-13T09:46:15.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 Processor -- start 2023-09-13T09:46:15.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06bfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06c03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06c7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c05a6bb0 con 0x5599c06b7700 2023-09-13T09:46:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c05a68b0 con 0x5599c06b6a00 2023-09-13T09:46:15.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c048a920 con 0x5599c06b8060 2023-09-13T09:46:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f56167b80 10 client.0 _ll_register_callbacks cb 0x5599c05a4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.795+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06c03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06bfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06bfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:59968/0 (socket says 172.21.15.6:59968) 2023-09-13T09:46:15.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06c03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38214/0 (socket says 172.21.15.6:38214) 2023-09-13T09:46:15.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f437fe700 1 -- 172.21.15.6:0/3852198947 learned_addr learned my addr 172.21.15.6:0/3852198947 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f43fff700 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06c7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3852198947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 msgr2=0x5599c06c7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06c7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 msgr2=0x5599c06bfe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06bfe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3852198947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f44108a50 con 0x5599c06b7700 2023-09-13T09:46:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06c03c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800b8e0 tx=0x7f0f38024990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c94913cc97445 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:15.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3852198947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3802b040 con 0x5599c06b7700 2023-09-13T09:46:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3852198947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f38005480 con 0x5599c06b7700 2023-09-13T09:46:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599c06a9670 con 0x5599c06b7700 2023-09-13T09:46:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3852198947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f380039e0 con 0x5599c06b7700 2023-09-13T09:46:15.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f56167b80 10 client.17271 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5599c06207a0 con 0x5599c06b7700 2023-09-13T09:46:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.796+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3852198947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5599c06a9670 con 0x5599c06b7700 2023-09-13T09:46:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3852198947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f3800fcc0 con 0x5599c06b7700 2023-09-13T09:46:15.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f56167b80 10 client.17271 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f56167b80 10 client.17271 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f56167b80 20 client.17271 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c06cb780 0x5599c06cdba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f56167b80 4 client.17271 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:15.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599c0601970 con 0x5599c06cb780 2023-09-13T09:46:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c06cb780 0x5599c06cdba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f22ffd700 10 client.17271 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.797+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c06cb780 0x5599c06cdba0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a9604e4f3dffcb6 server_cookie=81451d753c0fb2f6 in_seq=0 out_seq=0 2023-09-13T09:46:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3852198947 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5599c0601970 con 0x5599c06cb780 2023-09-13T09:46:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f22ffd700 10 client.17271 handle_command_reply: tid=0 2023-09-13T09:46:15.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 client.17271 shutdown 2023-09-13T09:46:15.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 msgr2=0x5599c06c03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06c03c0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800b8e0 tx=0x7f0f38024990 comp rx=0 tx=0).stop 2023-09-13T09:46:15.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 shutdown_connections 2023-09-13T09:46:15.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06c7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06bfe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c06cb780 0x5599c06cdba0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3852198947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06c03c0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 >> 172.21.15.6:0/3852198947 conn(0x5599c0614c80 msgr2=0x5599c06ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f22ffd700 0 client.17271 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 shutdown_connections 2023-09-13T09:46:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 1 -- 172.21.15.6:0/3852198947 wait complete. 2023-09-13T09:46:15.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.798+0000 7f0f56167b80 20 client.17271 trim_cache size 0 max 16384 2023-09-13T09:46:15.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.815+0000 7f0f56167b80 1 Processor -- start 2023-09-13T09:46:15.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f56167b80 1 -- start start 2023-09-13T09:46:15.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06ba920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06bae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f56167b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c06bf9f0 con 0x5599c06b7700 2023-09-13T09:46:15.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f56167b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c06c77b0 con 0x5599c06b6a00 2023-09-13T09:46:15.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f56167b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c06bdbc0 con 0x5599c06b8060 2023-09-13T09:46:15.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06ba920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06ba920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38222/0 (socket says 172.21.15.6:38222) 2023-09-13T09:46:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f42ffd700 1 -- 172.21.15.6:0/2615775695 learned_addr learned my addr 172.21.15.6:0/2615775695 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f43fff700 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06bae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f437fe700 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f43fff700 1 -- 172.21.15.6:0/2615775695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 msgr2=0x5599c06b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f43fff700 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f43fff700 1 -- 172.21.15.6:0/2615775695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 msgr2=0x5599c06ba920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f43fff700 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06ba920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.816+0000 7f0f43fff700 1 -- 172.21.15.6:0/2615775695 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599c0434de0 con 0x5599c06b8060 2023-09-13T09:46:15.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.817+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06ba920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.817+0000 7f0f437fe700 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.817+0000 7f0f43fff700 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06bae60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009550 tx=0x7f0f3c009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f121a0cbe904a872 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.817+0000 7f0f2a7fc700 1 -- 172.21.15.6:0/2615775695 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c004db0 con 0x5599c06b8060 2023-09-13T09:46:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.817+0000 7f0f2a7fc700 1 -- 172.21.15.6:0/2615775695 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f3c00f040 con 0x5599c06b8060 2023-09-13T09:46:15.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.817+0000 7f0f2a7fc700 1 -- 172.21.15.6:0/2615775695 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c01fb10 con 0x5599c06b8060 2023-09-13T09:46:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 -- 172.21.15.6:0/2615775695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 msgr2=0x5599c06bae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06bae60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c009550 tx=0x7f0f3c009920 comp rx=0 tx=0).stop 2023-09-13T09:46:15.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 -- 172.21.15.6:0/2615775695 shutdown_connections 2023-09-13T09:46:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b8060 0x5599c06bae60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b6a00 0x5599c06b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 --2- 172.21.15.6:0/2615775695 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c06ba920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 -- 172.21.15.6:0/2615775695 >> 172.21.15.6:0/2615775695 conn(0x5599c0614c80 msgr2=0x5599c06b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 -- 172.21.15.6:0/2615775695 shutdown_connections 2023-09-13T09:46:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 -- 172.21.15.6:0/2615775695 wait complete. 2023-09-13T09:46:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 -- start start 2023-09-13T09:46:15.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 Processor -- start 2023-09-13T09:46:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b6a00 0x5599c071b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.818+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c071bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f56167b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c0722a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f56167b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c0722fa0 con 0x5599c06b7700 2023-09-13T09:46:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f56167b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c07230e0 con 0x5599c06b8060 2023-09-13T09:46:15.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f56167b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c0723270 con 0x5599c06b6a00 2023-09-13T09:46:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f56167b80 10 client.0 _ll_register_callbacks cb 0x5599c05a4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c071bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c071bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38228/0 (socket says 172.21.15.6:38228) 2023-09-13T09:46:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f43fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c0722a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3170399119 learned_addr learned my addr 172.21.15.6:0/3170399119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:15.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b6a00 0x5599c071b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3170399119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b6a00 msgr2=0x5599c071b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b6a00 0x5599c071b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3170399119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 msgr2=0x5599c0722a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:15.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c0722a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 -- 172.21.15.6:0/3170399119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f4419da90 con 0x5599c06b7700 2023-09-13T09:46:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b6a00 0x5599c071b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f42ffd700 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c071bcf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005350 tx=0x7f0f38005690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb1af13ebf59192 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:15.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f22ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3170399119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3802b030 con 0x5599c06b7700 2023-09-13T09:46:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3170399119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f38039d70 con 0x5599c06b7700 2023-09-13T09:46:15.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.819+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f3801e040 con 0x5599c06b7700 2023-09-13T09:46:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3170399119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f380240f0 con 0x5599c06b7700 2023-09-13T09:46:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 10 client.17277 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5599c06207a0 con 0x5599c06b7700 2023-09-13T09:46:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3170399119 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f3801e040 con 0x5599c06b7700 2023-09-13T09:46:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3170399119 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0f38003ae0 con 0x5599c06b7700 2023-09-13T09:46:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 10 client.17277 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 10 client.17277 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:15.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 20 client.17277 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c0724840 0x5599c0726c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 4 client.17277 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:46:15.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5599c05c2050 con 0x5599c0724840 2023-09-13T09:46:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c0724840 0x5599c0726c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f437fe700 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c0724840 0x5599c0726c60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1937cc82d802355 server_cookie=6633c69c899b2fd1 in_seq=0 out_seq=0 2023-09-13T09:46:15.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.820+0000 7f0f22ffd700 10 client.17277 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f22ffd700 1 -- 172.21.15.6:0/3170399119 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5599c05c2050 con 0x5599c0724840 2023-09-13T09:46:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f22ffd700 10 client.17277 handle_command_reply: tid=0 2023-09-13T09:46:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 client.17277 shutdown 2023-09-13T09:46:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 msgr2=0x5599c071bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c071bcf0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0f38005350 tx=0x7f0f38005690 comp rx=0 tx=0).stop 2023-09-13T09:46:15.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 shutdown_connections 2023-09-13T09:46:15.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5599c06b8060 0x5599c0722a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5599c06b6a00 0x5599c071b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5599c0724840 0x5599c0726c60 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 --2- 172.21.15.6:0/3170399119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5599c06b7700 0x5599c071bcf0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f22ffd700 0 client.17277 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:15.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 >> 172.21.15.6:0/3170399119 conn(0x5599c0614c80 msgr2=0x5599c06bfe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 shutdown_connections 2023-09-13T09:46:15.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 1 -- 172.21.15.6:0/3170399119 wait complete. 2023-09-13T09:46:15.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.823+0000 7f0f56167b80 20 client.17277 trim_cache size 0 max 16384 2023-09-13T09:46:15.859 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:46:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:46:15.859 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:46:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "3a522531-e951-47a8-9b5c-723ceb18a9ae": { 2023-09-13T09:46:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:46:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "3a522531-e951-47a8-9b5c-723ceb18a9ae", 2023-09-13T09:46:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:46:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:46:15.860 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:46:15.861 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:46:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f2c0a0640 msgr2=0x7f0f2c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f2c0a0640 0x7f0f2c0a2b00 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0f3800b580 tx=0x7f0f38005fb0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440ffcc0 msgr2=0x7f0f44195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440ffcc0 0x7f0f44195960 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400e970 tx=0x7f0f3400ec80 comp rx=0 tx=0).stop 2023-09-13T09:46:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 shutdown_connections 2023-09-13T09:46:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f44101850 0x7f0f4419cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f2c0a0640 0x7f0f2c0a2b00 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f440ffcc0 0x7f0f44195960 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 --2- 172.21.15.6:0/3378727301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f44100eb0 0x7f0f44195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:15.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 >> 172.21.15.6:0/3378727301 conn(0x7f0f440fb250 msgr2=0x7f0f440fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:15.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 shutdown_connections 2023-09-13T09:46:15.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:15.824+0000 7f0f49f82700 1 -- 172.21.15.6:0/3378727301 wait complete. 2023-09-13T09:46:15.865 INFO:tasks.cephfs.filesystem:scrub status for tag:3a522531-e951-47a8-9b5c-723ceb18a9ae - {'path': '/', 'tag': '3a522531-e951-47a8-9b5c-723ceb18a9ae', 'options': 'recursive,force'} 2023-09-13T09:46:16.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 252792 3.99 MB/sec execute 216 sec latency 35.312 ms 2023-09-13T09:46:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:16 smithi006 ceph-mon[98665]: pgmap v502: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.3 MiB/s wr, 238 op/s 2023-09-13T09:46:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:16 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:16 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:16 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:16 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:16.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:16 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:16 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:16 smithi053 ceph-mon[102373]: pgmap v502: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.3 MiB/s wr, 238 op/s 2023-09-13T09:46:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:16 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:16 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:16 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:16 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:16 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:16 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:16 smithi131 ceph-mon[102785]: pgmap v502: 97 pgs: 97 active+clean; 115 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 942 KiB/s rd, 1.3 MiB/s wr, 238 op/s 2023-09-13T09:46:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:16 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:16 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:16 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:16 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:16.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:16 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:16.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:16 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 255234 4.03 MB/sec execute 217 sec latency 13.259 ms 2023-09-13T09:46:17.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:46:17.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:17.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:17.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:17.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:17.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:17.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:17 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:46:17.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:17.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:17.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:17.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:17.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:17.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:17 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:46:17.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:17.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:17.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:17.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:17.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:17.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:17.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:17 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:18.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 256131 4.03 MB/sec execute 218 sec latency 12.918 ms 2023-09-13T09:46:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:18 smithi006 ceph-mon[98665]: pgmap v503: 97 pgs: 97 active+clean; 115 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.6 MiB/s wr, 233 op/s 2023-09-13T09:46:18.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:18 smithi053 ceph-mon[102373]: pgmap v503: 97 pgs: 97 active+clean; 115 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.6 MiB/s wr, 233 op/s 2023-09-13T09:46:18.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:18 smithi131 ceph-mon[102785]: pgmap v503: 97 pgs: 97 active+clean; 115 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 1.6 MiB/s wr, 233 op/s 2023-09-13T09:46:19.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 258181 4.06 MB/sec execute 219 sec latency 60.563 ms 2023-09-13T09:46:19.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:19 smithi053 ceph-mon[102373]: pgmap v504: 97 pgs: 97 active+clean; 117 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 1.6 MiB/s wr, 226 op/s 2023-09-13T09:46:19.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:19 smithi006 ceph-mon[98665]: pgmap v504: 97 pgs: 97 active+clean; 117 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 1.6 MiB/s wr, 226 op/s 2023-09-13T09:46:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:19 smithi131 ceph-mon[102785]: pgmap v504: 97 pgs: 97 active+clean; 117 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 1.6 MiB/s wr, 226 op/s 2023-09-13T09:46:20.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 259409 4.08 MB/sec execute 220 sec latency 14.305 ms 2023-09-13T09:46:21.168 INFO:tasks.workunit.client.0.smithi006.stdout: 1 260830 4.09 MB/sec execute 221 sec latency 112.273 ms 2023-09-13T09:46:21.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:21 smithi006 ceph-mon[98665]: pgmap v505: 97 pgs: 97 active+clean; 118 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2023-09-13T09:46:21.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:21 smithi053 ceph-mon[102373]: pgmap v505: 97 pgs: 97 active+clean; 118 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2023-09-13T09:46:21.768 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:21 smithi131 ceph-mon[102785]: pgmap v505: 97 pgs: 97 active+clean; 118 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 850 KiB/s rd, 1.7 MiB/s wr, 235 op/s 2023-09-13T09:46:22.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 262774 4.13 MB/sec execute 222 sec latency 17.837 ms 2023-09-13T09:46:23.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 263938 4.14 MB/sec execute 223 sec latency 12.496 ms 2023-09-13T09:46:24.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 266135 4.17 MB/sec execute 224 sec latency 45.305 ms 2023-09-13T09:46:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:23 smithi006 ceph-mon[98665]: pgmap v506: 97 pgs: 97 active+clean; 118 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-13T09:46:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:23 smithi053 ceph-mon[102373]: pgmap v506: 97 pgs: 97 active+clean; 118 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-13T09:46:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:23 smithi131 ceph-mon[102785]: pgmap v506: 97 pgs: 97 active+clean; 118 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 1.9 MiB/s wr, 247 op/s 2023-09-13T09:46:25.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 266841 4.16 MB/sec execute 225 sec latency 57.239 ms 2023-09-13T09:46:26.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 268990 4.20 MB/sec execute 226 sec latency 14.553 ms 2023-09-13T09:46:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:25 smithi053 ceph-mon[102373]: pgmap v507: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2023-09-13T09:46:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:46:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:46:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:46:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:46:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:25 smithi006 ceph-mon[98665]: pgmap v507: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2023-09-13T09:46:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:46:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:46:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:46:26.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:46:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:25 smithi131 ceph-mon[102785]: pgmap v507: 97 pgs: 97 active+clean; 120 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1015 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2023-09-13T09:46:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:46:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:46:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:46:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:46:27.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 270129 4.21 MB/sec execute 227 sec latency 13.294 ms 2023-09-13T09:46:28.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 272178 4.23 MB/sec execute 228 sec latency 15.017 ms 2023-09-13T09:46:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:27 smithi006 ceph-mon[98665]: pgmap v508: 97 pgs: 97 active+clean; 124 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2023-09-13T09:46:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:27 smithi053 ceph-mon[102373]: pgmap v508: 97 pgs: 97 active+clean; 124 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2023-09-13T09:46:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:27 smithi131 ceph-mon[102785]: pgmap v508: 97 pgs: 97 active+clean; 124 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1022 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2023-09-13T09:46:29.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 273549 4.26 MB/sec execute 229 sec latency 22.540 ms 2023-09-13T09:46:30.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 275042 4.26 MB/sec execute 230 sec latency 37.329 ms 2023-09-13T09:46:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:29 smithi006 ceph-mon[98665]: pgmap v509: 97 pgs: 97 active+clean; 125 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 279 op/s 2023-09-13T09:46:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:29 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:46:30.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:29 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:46:30.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:29 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:46:30.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:29 smithi053 ceph-mon[102373]: pgmap v509: 97 pgs: 97 active+clean; 125 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 279 op/s 2023-09-13T09:46:30.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:29 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:46:30.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:29 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:46:30.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:29 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:46:30.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:29 smithi131 ceph-mon[102785]: pgmap v509: 97 pgs: 97 active+clean; 125 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.4 MiB/s wr, 279 op/s 2023-09-13T09:46:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:29 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:46:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:29 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:46:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:29 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:46:31.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 276942 4.30 MB/sec execute 231 sec latency 16.665 ms 2023-09-13T09:46:31.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:46:31.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:46:31.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:46:31.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:46:31.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:46:31.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:46:32.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 277880 4.29 MB/sec execute 232 sec latency 71.268 ms 2023-09-13T09:46:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:31 smithi053 ceph-mon[102373]: pgmap v510: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:46:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:31 smithi006 ceph-mon[98665]: pgmap v510: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:46:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:31 smithi131 ceph-mon[102785]: pgmap v510: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 989 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:46:33.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 280312 4.34 MB/sec execute 233 sec latency 12.365 ms 2023-09-13T09:46:34.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 281166 4.33 MB/sec execute 234 sec latency 19.573 ms 2023-09-13T09:46:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:33 smithi006 ceph-mon[98665]: pgmap v511: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:46:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:33 smithi053 ceph-mon[102373]: pgmap v511: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:46:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:33 smithi131 ceph-mon[102785]: pgmap v511: 97 pgs: 97 active+clean; 124 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:46:35.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 283258 4.36 MB/sec execute 235 sec latency 39.777 ms 2023-09-13T09:46:36.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 284342 4.37 MB/sec execute 236 sec latency 20.724 ms 2023-09-13T09:46:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:35 smithi006 ceph-mon[98665]: pgmap v512: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 295 op/s 2023-09-13T09:46:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:35 smithi053 ceph-mon[102373]: pgmap v512: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 295 op/s 2023-09-13T09:46:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:35 smithi131 ceph-mon[102785]: pgmap v512: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.6 MiB/s wr, 295 op/s 2023-09-13T09:46:37.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 286339 4.39 MB/sec execute 237 sec latency 12.619 ms 2023-09-13T09:46:38.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 287692 4.42 MB/sec execute 238 sec latency 32.941 ms 2023-09-13T09:46:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:37 smithi006 ceph-mon[98665]: pgmap v513: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 2.5 MiB/s wr, 262 op/s 2023-09-13T09:46:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:37 smithi053 ceph-mon[102373]: pgmap v513: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 2.5 MiB/s wr, 262 op/s 2023-09-13T09:46:38.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:37 smithi131 ceph-mon[102785]: pgmap v513: 97 pgs: 97 active+clean; 126 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 958 KiB/s rd, 2.5 MiB/s wr, 262 op/s 2023-09-13T09:46:39.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 289107 4.42 MB/sec execute 239 sec latency 13.357 ms 2023-09-13T09:46:40.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 291087 4.46 MB/sec execute 240 sec latency 45.515 ms 2023-09-13T09:46:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:39 smithi006 ceph-mon[98665]: pgmap v514: 97 pgs: 97 active+clean; 127 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2023-09-13T09:46:40.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:39 smithi053 ceph-mon[102373]: pgmap v514: 97 pgs: 97 active+clean; 127 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2023-09-13T09:46:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:39 smithi131 ceph-mon[102785]: pgmap v514: 97 pgs: 97 active+clean; 127 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 841 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2023-09-13T09:46:41.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 291948 4.45 MB/sec execute 241 sec latency 22.364 ms 2023-09-13T09:46:42.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 294402 4.49 MB/sec execute 242 sec latency 12.320 ms 2023-09-13T09:46:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:41 smithi006 ceph-mon[98665]: pgmap v515: 97 pgs: 97 active+clean; 128 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-09-13T09:46:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:41 smithi053 ceph-mon[102373]: pgmap v515: 97 pgs: 97 active+clean; 128 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-09-13T09:46:42.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:41 smithi131 ceph-mon[102785]: pgmap v515: 97 pgs: 97 active+clean; 128 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 799 KiB/s rd, 2.1 MiB/s wr, 233 op/s 2023-09-13T09:46:43.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 295204 4.49 MB/sec execute 243 sec latency 18.046 ms 2023-09-13T09:46:44.169 INFO:tasks.workunit.client.0.smithi006.stdout: 1 297441 4.52 MB/sec execute 244 sec latency 11.115 ms 2023-09-13T09:46:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:43 smithi006 ceph-mon[98665]: pgmap v516: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 2.4 MiB/s wr, 262 op/s 2023-09-13T09:46:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:43 smithi053 ceph-mon[102373]: pgmap v516: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 2.4 MiB/s wr, 262 op/s 2023-09-13T09:46:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:43 smithi131 ceph-mon[102785]: pgmap v516: 97 pgs: 97 active+clean; 129 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 2.4 MiB/s wr, 262 op/s 2023-09-13T09:46:45.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 298460 4.52 MB/sec execute 245 sec latency 68.469 ms 2023-09-13T09:46:45.866 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:46:46.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 -- 172.21.15.6:0/2712442169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 msgr2=0x7f4d80106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 --2- 172.21.15.6:0/2712442169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80106560 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f4d70009990 tx=0x7f4d70009ca0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 -- 172.21.15.6:0/2712442169 shutdown_connections 2023-09-13T09:46:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 --2- 172.21.15.6:0/2712442169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d80106aa0 0x7f4d80108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 --2- 172.21.15.6:0/2712442169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d80101840 0x7f4d80103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 --2- 172.21.15.6:0/2712442169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80106560 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 -- 172.21.15.6:0/2712442169 >> 172.21.15.6:0/2712442169 conn(0x7f4d800fb250 msgr2=0x7f4d800fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 -- 172.21.15.6:0/2712442169 shutdown_connections 2023-09-13T09:46:46.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.004+0000 7f4d85efd700 1 -- 172.21.15.6:0/2712442169 wait complete. 2023-09-13T09:46:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 Processor -- start 2023-09-13T09:46:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 -- start start 2023-09-13T09:46:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d80101840 0x7f4d80196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d80106aa0 0x7f4d8019e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8019e5f0 con 0x7f4d80104170 2023-09-13T09:46:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8019e730 con 0x7f4d80101840 2023-09-13T09:46:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.005+0000 7f4d85efd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8019e8c0 con 0x7f4d80106aa0 2023-09-13T09:46:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d80101840 0x7f4d80196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80196fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38242/0 (socket says 172.21.15.6:38242) 2023-09-13T09:46:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 -- 172.21.15.6:0/3717253873 learned_addr learned my addr 172.21.15.6:0/3717253873 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7ffff700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d80106aa0 0x7f4d8019e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 -- 172.21.15.6:0/3717253873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d80106aa0 msgr2=0x7f4d8019e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d80106aa0 0x7f4d8019e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 -- 172.21.15.6:0/3717253873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d80101840 msgr2=0x7f4d80196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d80101840 0x7f4d80196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 -- 172.21.15.6:0/3717253873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d700095f0 con 0x7f4d80104170 2023-09-13T09:46:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d80101840 0x7f4d80196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7effd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80196fb0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4d700059d0 tx=0x7f4d700047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7cff9700 1 -- 172.21.15.6:0/3717253873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7001d070 con 0x7f4d80104170 2023-09-13T09:46:46.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8019eb40 con 0x7f4d80104170 2023-09-13T09:46:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7cff9700 1 -- 172.21.15.6:0/3717253873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d7000fb90 con 0x7f4d80104170 2023-09-13T09:46:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d7cff9700 1 -- 172.21.15.6:0/3717253873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70017650 con 0x7f4d80104170 2023-09-13T09:46:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.006+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8019efc0 con 0x7f4d80104170 2023-09-13T09:46:46.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.009+0000 7f4d7cff9700 1 -- 172.21.15.6:0/3717253873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4d7000fd00 con 0x7f4d80104170 2023-09-13T09:46:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.009+0000 7f4d7cff9700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d680a0640 0x7f4d680a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.010+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d680a0640 0x7f4d680a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.010+0000 7f4d7cff9700 1 -- 172.21.15.6:0/3717253873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d700cd300 con 0x7f4d80104170 2023-09-13T09:46:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.010+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d680a0640 0x7f4d680a2b00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d74011490 tx=0x7f4d74009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.010+0000 7f4d920e2b80 1 Processor -- start 2023-09-13T09:46:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.010+0000 7f4d920e2b80 1 -- start start 2023-09-13T09:46:46.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8873d780 con 0x559a887e9b10 2023-09-13T09:46:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a8873b0a0 con 0x559a887e8e10 2023-09-13T09:46:46.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a88736990 con 0x559a887ea470 2023-09-13T09:46:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887e9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38248/0 (socket says 172.21.15.6:38248) 2023-09-13T09:46:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2250524894 learned_addr learned my addr 172.21.15.6:0/2250524894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7ffff700 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7effd700 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2250524894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 msgr2=0x559a887e88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887e88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2250524894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 msgr2=0x559a887e9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2250524894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a885b6630 con 0x559a887e9b10 2023-09-13T09:46:46.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7effd700 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887e88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:46:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887e9f30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4d740043c0 tx=0x7f4d74014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e27c231cfdddb7d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d65ffb700 1 -- 172.21.15.6:0/2250524894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d74003d10 con 0x559a887e9b10 2023-09-13T09:46:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d65ffb700 1 -- 172.21.15.6:0/2250524894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d74003e70 con 0x559a887e9b10 2023-09-13T09:46:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.011+0000 7f4d65ffb700 1 -- 172.21.15.6:0/2250524894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7401e7d0 con 0x559a887e9b10 2023-09-13T09:46:46.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2250524894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 msgr2=0x559a887e9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887e9f30 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f4d740043c0 tx=0x7f4d74014000 comp rx=0 tx=0).stop 2023-09-13T09:46:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2250524894 shutdown_connections 2023-09-13T09:46:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887e9f30 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2250524894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887e88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2250524894 >> 172.21.15.6:0/2250524894 conn(0x559a88742c80 msgr2=0x559a887def10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2250524894 shutdown_connections 2023-09-13T09:46:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.012+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2250524894 wait complete. 2023-09-13T09:46:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 -- start start 2023-09-13T09:46:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 Processor -- start 2023-09-13T09:46:46.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887f2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f2940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887f9980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a886d4bb0 con 0x559a887e9b10 2023-09-13T09:46:46.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a886d48b0 con 0x559a887e8e10 2023-09-13T09:46:46.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a885b8920 con 0x559a887ea470 2023-09-13T09:46:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d920e2b80 10 client.0 _ll_register_callbacks cb 0x559a886d2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887f2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60010/0 (socket says 172.21.15.6:60010) 2023-09-13T09:46:46.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.013+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2525489306 learned_addr learned my addr 172.21.15.6:0/2525489306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2525489306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 msgr2=0x559a887f9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887f9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2525489306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 msgr2=0x559a887f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/2525489306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d74017070 con 0x559a887e8e10 2023-09-13T09:46:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d7effd700 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887f2400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4d74004390 tx=0x7f4d74026630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af2ebab00d0cc7c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d5effd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d5effd700 1 -- 172.21.15.6:0/2525489306 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7402b070 con 0x559a887e8e10 2023-09-13T09:46:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a887d7670 con 0x559a887e8e10 2023-09-13T09:46:46.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d5effd700 1 -- 172.21.15.6:0/2525489306 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d74026a60 con 0x559a887e8e10 2023-09-13T09:46:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d5effd700 1 -- 172.21.15.6:0/2525489306 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d74026c20 con 0x559a887e8e10 2023-09-13T09:46:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d920e2b80 10 client.26702 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559a8874e7a0 con 0x559a887e8e10 2023-09-13T09:46:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.014+0000 7f4d5effd700 1 -- 172.21.15.6:0/2525489306 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559a887d7670 con 0x559a887e8e10 2023-09-13T09:46:46.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d5effd700 1 -- 172.21.15.6:0/2525489306 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d74024020 con 0x559a887e8e10 2023-09-13T09:46:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d920e2b80 10 client.26702 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d920e2b80 10 client.26702 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d920e2b80 20 client.26702 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a888003a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d920e2b80 4 client.26702 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a8872f970 con 0x559a887fdf80 2023-09-13T09:46:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d7effd700 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a888003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d7effd700 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a888003a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2931e4f670c35d8 server_cookie=6028b997a2bfd72c in_seq=0 out_seq=0 2023-09-13T09:46:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.015+0000 7f4d5effd700 10 client.26702 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:46.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d5effd700 1 -- 172.21.15.6:0/2525489306 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a8872f970 con 0x559a887fdf80 2023-09-13T09:46:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d5effd700 10 client.26702 handle_command_reply: tid=0 2023-09-13T09:46:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 client.26702 shutdown 2023-09-13T09:46:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 msgr2=0x559a887f2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887f2400 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f4d74004390 tx=0x7f4d74026630 comp rx=0 tx=0).stop 2023-09-13T09:46:46.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 shutdown_connections 2023-09-13T09:46:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887f9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887f2400 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a888003a0 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d5effd700 0 client.26702 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/2525489306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 >> 172.21.15.6:0/2525489306 conn(0x559a88742c80 msgr2=0x559a887d97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 shutdown_connections 2023-09-13T09:46:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 1 -- 172.21.15.6:0/2525489306 wait complete. 2023-09-13T09:46:46.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.016+0000 7f4d920e2b80 20 client.26702 trim_cache size 0 max 16384 2023-09-13T09:46:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 Processor -- start 2023-09-13T09:46:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 -- start start 2023-09-13T09:46:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887f1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a887f1fb0 con 0x559a887e9b10 2023-09-13T09:46:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a887e1000 con 0x559a887e8e10 2023-09-13T09:46:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.034+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a887e0150 con 0x559a887ea470 2023-09-13T09:46:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887f1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38264/0 (socket says 172.21.15.6:38264) 2023-09-13T09:46:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7effd700 1 -- 172.21.15.6:0/390340276 learned_addr learned my addr 172.21.15.6:0/390340276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/390340276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 msgr2=0x559a887f1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887f1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/390340276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 msgr2=0x559a887f9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/390340276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a88562de0 con 0x559a887e8e10 2023-09-13T09:46:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7effd700 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e88d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4d74011be0 tx=0x7f4d74026f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e12bf14c9335b92 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d667fc700 1 -- 172.21.15.6:0/390340276 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7402b070 con 0x559a887e8e10 2023-09-13T09:46:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d667fc700 1 -- 172.21.15.6:0/390340276 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d74026a60 con 0x559a887e8e10 2023-09-13T09:46:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.035+0000 7f4d667fc700 1 -- 172.21.15.6:0/390340276 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7401eb80 con 0x559a887e8e10 2023-09-13T09:46:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 -- 172.21.15.6:0/390340276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 msgr2=0x559a887e88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e88d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f4d74011be0 tx=0x7f4d74026f30 comp rx=0 tx=0).stop 2023-09-13T09:46:46.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 -- 172.21.15.6:0/390340276 shutdown_connections 2023-09-13T09:46:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887ea470 0x559a887f1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e8e10 0x559a887e88d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/390340276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887e9b10 0x559a887f9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 -- 172.21.15.6:0/390340276 >> 172.21.15.6:0/390340276 conn(0x559a88742c80 msgr2=0x559a887fa270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 -- 172.21.15.6:0/390340276 shutdown_connections 2023-09-13T09:46:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.036+0000 7f4d920e2b80 1 -- 172.21.15.6:0/390340276 wait complete. 2023-09-13T09:46:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 -- start start 2023-09-13T09:46:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 Processor -- start 2023-09-13T09:46:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887e8e10 0x559a887f5870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e9b10 0x559a887f5db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887ea470 0x559a887f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a887f9310 con 0x559a887ea470 2023-09-13T09:46:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a887f9480 con 0x559a887e9b10 2023-09-13T09:46:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a887f9640 con 0x559a887e8e10 2023-09-13T09:46:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d920e2b80 10 client.0 _ll_register_callbacks cb 0x559a886d2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:46.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887e8e10 0x559a887f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d7ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887ea470 0x559a887f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d7f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887e8e10 0x559a887f5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41322/0 (socket says 172.21.15.6:41322) 2023-09-13T09:46:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d7ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887ea470 0x559a887f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38270/0 (socket says 172.21.15.6:38270) 2023-09-13T09:46:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.037+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/980594671 learned_addr learned my addr 172.21.15.6:0/980594671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7effd700 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e9b10 0x559a887f5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e9b10 msgr2=0x559a887f5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e9b10 0x559a887f5db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/980594671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887ea470 msgr2=0x559a887f8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887ea470 0x559a887f8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7f7fe700 1 -- 172.21.15.6:0/980594671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8019efc0 con 0x559a887e8e10 2023-09-13T09:46:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7ffff700 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887ea470 0x559a887f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d7f7fe700 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887e8e10 0x559a887f5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d740043c0 tx=0x7f4d74005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10744ddfc5787548 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d5effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:46:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d5effd700 1 -- 172.21.15.6:0/980594671 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7402b040 con 0x559a887e8e10 2023-09-13T09:46:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d5effd700 1 -- 172.21.15.6:0/980594671 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4d74026bd0 con 0x559a887e8e10 2023-09-13T09:46:46.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d74003e70 con 0x559a887e8e10 2023-09-13T09:46:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.038+0000 7f4d5effd700 1 -- 172.21.15.6:0/980594671 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d74005020 con 0x559a887e8e10 2023-09-13T09:46:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 10 client.26638 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559a8874e7a0 con 0x559a887e8e10 2023-09-13T09:46:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d5effd700 1 -- 172.21.15.6:0/980594671 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4d74003e70 con 0x559a887e8e10 2023-09-13T09:46:46.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d5effd700 1 -- 172.21.15.6:0/980594671 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4d74041030 con 0x559a887e8e10 2023-09-13T09:46:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 10 client.26638 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 10 client.26638 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 20 client.26638 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a88854aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 4 client.26638 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:46:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559a886f0050 con 0x559a887fdf80 2023-09-13T09:46:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.039+0000 7f4d7effd700 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a88854aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d7effd700 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a88854aa0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc846d54c23deeba server_cookie=54f752ce9edef8f1 in_seq=0 out_seq=0 2023-09-13T09:46:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d5effd700 10 client.26638 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d5effd700 1 -- 172.21.15.6:0/980594671 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559a886f0050 con 0x559a887fdf80 2023-09-13T09:46:46.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d5effd700 10 client.26638 handle_command_reply: tid=0 2023-09-13T09:46:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 client.26638 shutdown 2023-09-13T09:46:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887e8e10 msgr2=0x559a887f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887e8e10 0x559a887f5870 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4d740043c0 tx=0x7f4d74005a00 comp rx=0 tx=0).stop 2023-09-13T09:46:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 shutdown_connections 2023-09-13T09:46:46.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a887fdf80 0x559a88854aa0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a887ea470 0x559a887f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a887e8e10 0x559a887f5870 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 --2- 172.21.15.6:0/980594671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a887e9b10 0x559a887f5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.040+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 >> 172.21.15.6:0/980594671 conn(0x559a88742c80 msgr2=0x559a887f1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d5effd700 0 client.26638 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 shutdown_connections 2023-09-13T09:46:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d920e2b80 1 -- 172.21.15.6:0/980594671 wait complete. 2023-09-13T09:46:46.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d920e2b80 20 client.26638 trim_cache size 0 max 16384 2023-09-13T09:46:46.059 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:46:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:46:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:46:46.060 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:46:46.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d680a0640 msgr2=0x7f4d680a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d85efd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d680a0640 0x7f4d680a2b00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4d74011490 tx=0x7f4d74009260 comp rx=0 tx=0).stop 2023-09-13T09:46:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 msgr2=0x7f4d80196fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.041+0000 7f4d85efd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80196fb0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f4d700059d0 tx=0x7f4d700047a0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 shutdown_connections 2023-09-13T09:46:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d80106aa0 0x7f4d8019e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4d80101840 0x7f4d80196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4d680a0640 0x7f4d680a2b00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 --2- 172.21.15.6:0/3717253873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d80104170 0x7f4d80196fb0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 >> 172.21.15.6:0/3717253873 conn(0x7f4d800fb250 msgr2=0x7f4d80102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 shutdown_connections 2023-09-13T09:46:46.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.042+0000 7f4d85efd700 1 -- 172.21.15.6:0/3717253873 wait complete. 2023-09-13T09:46:46.064 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:46:46.064 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:46:46.090 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:45 smithi006 ceph-mon[98665]: pgmap v517: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.6 MiB/s wr, 273 op/s 2023-09-13T09:46:46.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 300358 4.54 MB/sec execute 246 sec latency 19.972 ms 2023-09-13T09:46:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 -- 172.21.15.6:0/3336662235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8101fb0 msgr2=0x7f36a8102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3336662235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8101fb0 0x7f36a8102410 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f36940099c0 tx=0x7f3694009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 -- 172.21.15.6:0/3336662235 shutdown_connections 2023-09-13T09:46:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3336662235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a8102950 0x7f36a8109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3336662235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a8100dc0 0x7f36a81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3336662235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8101fb0 0x7f36a8102410 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 -- 172.21.15.6:0/3336662235 >> 172.21.15.6:0/3336662235 conn(0x7f36a80fc330 msgr2=0x7f36a80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 -- 172.21.15.6:0/3336662235 shutdown_connections 2023-09-13T09:46:46.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 -- 172.21.15.6:0/3336662235 wait complete. 2023-09-13T09:46:46.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 Processor -- start 2023-09-13T09:46:46.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.200+0000 7f36aee9b700 1 -- start start 2023-09-13T09:46:46.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36aee9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8100dc0 0x7f36a8196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36aee9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a8101fb0 0x7f36a8197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36aee9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a8102950 0x7f36a819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36aee9b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819e640 con 0x7f36a8100dc0 2023-09-13T09:46:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36aee9b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819e780 con 0x7f36a8101fb0 2023-09-13T09:46:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36aee9b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a819e910 con 0x7f36a8102950 2023-09-13T09:46:46.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8100dc0 0x7f36a8196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8100dc0 0x7f36a8196ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38282/0 (socket says 172.21.15.6:38282) 2023-09-13T09:46:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 -- 172.21.15.6:0/3338693192 learned_addr learned my addr 172.21.15.6:0/3338693192 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36a7fff700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a8101fb0 0x7f36a8197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36ad438700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a8102950 0x7f36a819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 -- 172.21.15.6:0/3338693192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a8102950 msgr2=0x7f36a819e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a8102950 0x7f36a819e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 -- 172.21.15.6:0/3338693192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a8101fb0 msgr2=0x7f36a8197000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a8101fb0 0x7f36a8197000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 -- 172.21.15.6:0/3338693192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369c009520 con 0x7f36a8100dc0 2023-09-13T09:46:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36acc37700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8100dc0 0x7f36a8196ac0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f369c00ea50 tx=0x7f369c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36a5ffb700 1 -- 172.21.15.6:0/3338693192 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c00cbd0 con 0x7f36a8100dc0 2023-09-13T09:46:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36a5ffb700 1 -- 172.21.15.6:0/3338693192 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f369c00cd30 con 0x7f36a8100dc0 2023-09-13T09:46:46.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36940095f0 con 0x7f36a8100dc0 2023-09-13T09:46:46.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.201+0000 7f36a5ffb700 1 -- 172.21.15.6:0/3338693192 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369c0186c0 con 0x7f36a8100dc0 2023-09-13T09:46:46.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.202+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a819efc0 con 0x7f36a8100dc0 2023-09-13T09:46:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.203+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a8108350 con 0x7f36a8100dc0 2023-09-13T09:46:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.203+0000 7f36a5ffb700 1 -- 172.21.15.6:0/3338693192 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f369c018820 con 0x7f36a8100dc0 2023-09-13T09:46:46.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.204+0000 7f36a5ffb700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36980a06c0 0x7f36980a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.204+0000 7f36a5ffb700 1 -- 172.21.15.6:0/3338693192 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f369c014070 con 0x7f36a8100dc0 2023-09-13T09:46:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.204+0000 7f36a7fff700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36980a06c0 0x7f36980a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.205+0000 7f36a7fff700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36980a06c0 0x7f36980a2b80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f369400b580 tx=0x7f3694005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.209+0000 7f36a5ffb700 1 -- 172.21.15.6:0/3338693192 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f369c095b90 con 0x7f36a8100dc0 2023-09-13T09:46:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:45 smithi053 ceph-mon[102373]: pgmap v517: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.6 MiB/s wr, 273 op/s 2023-09-13T09:46:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:45 smithi131 ceph-mon[102785]: pgmap v517: 97 pgs: 97 active+clean; 131 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.6 MiB/s wr, 273 op/s 2023-09-13T09:46:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.473+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36a810c5d0 con 0x7f36a8100dc0 2023-09-13T09:46:46.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.474+0000 7f36a5ffb700 1 -- 172.21.15.6:0/3338693192 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f369c0b0c60 con 0x7f36a8100dc0 2023-09-13T09:46:46.475 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:46:46.475 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:46:46.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36980a06c0 msgr2=0x7f36980a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36980a06c0 0x7f36980a2b80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f369400b580 tx=0x7f3694005fb0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8100dc0 msgr2=0x7f36a8196ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8100dc0 0x7f36a8196ac0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f369c00ea50 tx=0x7f369c00ed60 comp rx=0 tx=0).stop 2023-09-13T09:46:46.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 shutdown_connections 2023-09-13T09:46:46.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a8102950 0x7f36a819e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f36980a06c0 0x7f36980a2b80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f36a8100dc0 0x7f36a8196ac0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 --2- 172.21.15.6:0/3338693192 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f36a8101fb0 0x7f36a8197000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 >> 172.21.15.6:0/3338693192 conn(0x7f36a80fc330 msgr2=0x7f36a8105490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 shutdown_connections 2023-09-13T09:46:46.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.476+0000 7f36aee9b700 1 -- 172.21.15.6:0/3338693192 wait complete. 2023-09-13T09:46:46.480 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:46:46.490 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:46:46.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 -- 172.21.15.6:0/688561966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 msgr2=0x7f7aa0108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 --2- 172.21.15.6:0/688561966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0108120 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f7a9800b0a0 tx=0x7f7a9800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 -- 172.21.15.6:0/688561966 shutdown_connections 2023-09-13T09:46:46.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 --2- 172.21.15.6:0/688561966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0108120 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 --2- 172.21.15.6:0/688561966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa01013c0 0x7f7aa01017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 --2- 172.21.15.6:0/688561966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aa00ff8f0 0x7f7aa00ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 -- 172.21.15.6:0/688561966 >> 172.21.15.6:0/688561966 conn(0x7f7aa00fb250 msgr2=0x7f7aa00fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 -- 172.21.15.6:0/688561966 shutdown_connections 2023-09-13T09:46:46.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.667+0000 7f7aa638b700 1 -- 172.21.15.6:0/688561966 wait complete. 2023-09-13T09:46:46.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.668+0000 7f7aa638b700 1 Processor -- start 2023-09-13T09:46:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.668+0000 7f7aa638b700 1 -- start start 2023-09-13T09:46:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7aa638b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa00ff8f0 0x7f7aa0195be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7aa638b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0196120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7aa638b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aa01013c0 0x7f7aa019d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7aa638b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa019d760 con 0x7f7aa0100290 2023-09-13T09:46:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7aa638b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa019d8a0 con 0x7f7aa01013c0 2023-09-13T09:46:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7aa638b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa019da30 con 0x7f7aa00ff8f0 2023-09-13T09:46:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0196120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0196120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38298/0 (socket says 172.21.15.6:38298) 2023-09-13T09:46:46.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/3563673683 learned_addr learned my addr 172.21.15.6:0/3563673683 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa00ff8f0 0x7f7aa0195be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7aa4928700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aa01013c0 0x7f7aa019d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/3563673683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa00ff8f0 msgr2=0x7f7aa0195be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa00ff8f0 0x7f7aa0195be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/3563673683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aa01013c0 msgr2=0x7f7aa019d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aa01013c0 0x7f7aa019d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/3563673683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a98009d00 con 0x7f7aa0100290 2023-09-13T09:46:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0196120 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e9a0 tx=0x7f7a9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.669+0000 7f7a9d7fa700 1 -- 172.21.15.6:0/3563673683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94009790 con 0x7f7aa0100290 2023-09-13T09:46:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.670+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa019dd10 con 0x7f7aa0100290 2023-09-13T09:46:46.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.670+0000 7f7a9d7fa700 1 -- 172.21.15.6:0/3563673683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a94010430 con 0x7f7aa0100290 2023-09-13T09:46:46.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.670+0000 7f7a9d7fa700 1 -- 172.21.15.6:0/3563673683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a94018680 con 0x7f7aa0100290 2023-09-13T09:46:46.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.670+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa019e1d0 con 0x7f7aa0100290 2023-09-13T09:46:46.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.672+0000 7f7a9d7fa700 1 -- 172.21.15.6:0/3563673683 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7a940105a0 con 0x7f7aa0100290 2023-09-13T09:46:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.672+0000 7f7a9d7fa700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7a880a0640 0x7f7a880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.673+0000 7f7a9d7fa700 1 -- 172.21.15.6:0/3563673683 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a94014070 con 0x7f7aa0100290 2023-09-13T09:46:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.673+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7a880a0640 0x7f7a880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.673+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7a880a0640 0x7f7a880a2b00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0100d30 tx=0x7f7a90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.673+0000 7f7ab2570b80 1 Processor -- start 2023-09-13T09:46:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.673+0000 7f7ab2570b80 1 -- start start 2023-09-13T09:46:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f002b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0014c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f001e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69ef5a780 con 0x55b69f002700 2023-09-13T09:46:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69ef580a0 con 0x55b69f001a00 2023-09-13T09:46:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69ef53990 con 0x55b69f003060 2023-09-13T09:46:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f002b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f002b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38304/0 (socket says 172.21.15.6:38304) 2023-09-13T09:46:46.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 -- 172.21.15.6:0/308143380 learned_addr learned my addr 172.21.15.6:0/308143380 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 -- 172.21.15.6:0/308143380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 msgr2=0x55b69f0014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 -- 172.21.15.6:0/308143380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 msgr2=0x55b69f001e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:46:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f001e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 -- 172.21.15.6:0/308143380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b69edd3630 con 0x55b69f002700 2023-09-13T09:46:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.674+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f002b20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7a90011d50 tx=0x7f7a90014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c107257e77978c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7a867fc700 1 -- 172.21.15.6:0/308143380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9000ed20 con 0x55b69f002700 2023-09-13T09:46:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7a867fc700 1 -- 172.21.15.6:0/308143380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a90021070 con 0x55b69f002700 2023-09-13T09:46:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7a867fc700 1 -- 172.21.15.6:0/308143380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9001d670 con 0x55b69f002700 2023-09-13T09:46:46.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 -- 172.21.15.6:0/308143380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 msgr2=0x55b69f002b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f002b20 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f7a90011d50 tx=0x7f7a90014000 comp rx=0 tx=0).stop 2023-09-13T09:46:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 -- 172.21.15.6:0/308143380 shutdown_connections 2023-09-13T09:46:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f001e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f002b20 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/308143380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 -- 172.21.15.6:0/308143380 >> 172.21.15.6:0/308143380 conn(0x55b69ef5fc80 msgr2=0x55b69effbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.675+0000 7f7ab2570b80 1 -- 172.21.15.6:0/308143380 shutdown_connections 2023-09-13T09:46:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 -- 172.21.15.6:0/308143380 wait complete. 2023-09-13T09:46:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 -- start start 2023-09-13T09:46:46.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 Processor -- start 2023-09-13T09:46:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f00af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f00b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0124b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69eef1bb0 con 0x55b69f002700 2023-09-13T09:46:46.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69eef18b0 con 0x55b69f001a00 2023-09-13T09:46:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69edd5920 con 0x55b69f003060 2023-09-13T09:46:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7ab2570b80 10 client.0 _ll_register_callbacks cb 0x55b69eeef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.676+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f00b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f00af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f00b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38310/0 (socket says 172.21.15.6:38310) 2023-09-13T09:46:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7aa4928700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0124b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/748810470 learned_addr learned my addr 172.21.15.6:0/748810470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/748810470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 msgr2=0x55b69f0124b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0124b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/748810470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 msgr2=0x55b69f00af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f00af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 -- 172.21.15.6:0/748810470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a90017070 con 0x55b69f002700 2023-09-13T09:46:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f00b470 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e970 tx=0x7f7a94098f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7062cd810bf4df5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a7f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/748810470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9409d170 con 0x55b69f002700 2023-09-13T09:46:46.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/748810470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a9409d340 con 0x55b69f002700 2023-09-13T09:46:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b69eff4670 con 0x55b69f002700 2023-09-13T09:46:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/748810470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a940a1580 con 0x55b69f002700 2023-09-13T09:46:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7ab2570b80 10 client.17313 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55b69ef6b7a0 con 0x55b69f002700 2023-09-13T09:46:46.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.677+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/748810470 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a94063080 con 0x55b69f002700 2023-09-13T09:46:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/748810470 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7a94065120 con 0x55b69f002700 2023-09-13T09:46:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7ab2570b80 10 client.17313 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7ab2570b80 10 client.17313 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:46:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7ab2570b80 20 client.17313 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:46.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f016d40 0x55b69f019160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7ab2570b80 4 client.17313 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:46.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b69ef4c970 con 0x55b69f016d40 2023-09-13T09:46:46.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f016d40 0x55b69f019160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7a7f7fe700 10 client.17313 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:46.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.678+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f016d40 0x55b69f019160 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f21b5640790dba9f server_cookie=65f7146ce8e15f58 in_seq=0 out_seq=0 2023-09-13T09:46:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/748810470 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b69ef4c970 con 0x55b69f016d40 2023-09-13T09:46:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7a7f7fe700 10 client.17313 handle_command_reply: tid=0 2023-09-13T09:46:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 client.17313 shutdown 2023-09-13T09:46:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 msgr2=0x55b69f00b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f00b470 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e970 tx=0x7f7a94098f60 comp rx=0 tx=0).stop 2023-09-13T09:46:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 shutdown_connections 2023-09-13T09:46:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f016d40 0x55b69f019160 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f0124b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f00af30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/748810470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f002700 0x55b69f00b470 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7a7f7fe700 0 client.17313 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 >> 172.21.15.6:0/748810470 conn(0x55b69ef5fc80 msgr2=0x55b69effbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 shutdown_connections 2023-09-13T09:46:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.680+0000 7f7ab2570b80 1 -- 172.21.15.6:0/748810470 wait complete. 2023-09-13T09:46:46.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.681+0000 7f7ab2570b80 20 client.17313 trim_cache size 0 max 16384 2023-09-13T09:46:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 Processor -- start 2023-09-13T09:46:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 -- start start 2023-09-13T09:46:46.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f0014c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f002700 0x55b69f012470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f003060 0x55b69f00af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69effdfd0 con 0x55b69f003060 2023-09-13T09:46:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69effd100 con 0x55b69f001a00 2023-09-13T09:46:46.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69effc810 con 0x55b69f002700 2023-09-13T09:46:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7aa4928700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f003060 0x55b69f00af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f0014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7aa4928700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f003060 0x55b69f00af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38320/0 (socket says 172.21.15.6:38320) 2023-09-13T09:46:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f0014c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60072/0 (socket says 172.21.15.6:60072) 2023-09-13T09:46:46.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7aa4928700 1 -- 172.21.15.6:0/1485541018 learned_addr learned my addr 172.21.15.6:0/1485541018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.694+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f002700 0x55b69f012470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a9ffff700 1 -- 172.21.15.6:0/1485541018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f002700 msgr2=0x55b69f012470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f002700 0x55b69f012470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a9ffff700 1 -- 172.21.15.6:0/1485541018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f003060 msgr2=0x55b69f00af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f003060 0x55b69f00af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a9ffff700 1 -- 172.21.15.6:0/1485541018 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b69ed7fde0 con 0x55b69f001a00 2023-09-13T09:46:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7aa4928700 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f003060 0x55b69f00af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f002700 0x55b69f012470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f0014c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a900117d0 tx=0x7f7a90011b10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4221a538d546f643 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a86ffd700 1 -- 172.21.15.6:0/1485541018 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9000ede0 con 0x55b69f001a00 2023-09-13T09:46:46.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a86ffd700 1 -- 172.21.15.6:0/1485541018 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a9001cdd0 con 0x55b69f001a00 2023-09-13T09:46:46.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.695+0000 7f7a86ffd700 1 -- 172.21.15.6:0/1485541018 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90005040 con 0x55b69f001a00 2023-09-13T09:46:46.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 -- 172.21.15.6:0/1485541018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 msgr2=0x55b69f0014c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f0014c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7a900117d0 tx=0x7f7a90011b10 comp rx=0 tx=0).stop 2023-09-13T09:46:46.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 -- 172.21.15.6:0/1485541018 shutdown_connections 2023-09-13T09:46:46.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f003060 0x55b69f00af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f001a00 0x55b69f0014c0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/1485541018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f002700 0x55b69f012470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 -- 172.21.15.6:0/1485541018 >> 172.21.15.6:0/1485541018 conn(0x55b69ef5fc80 msgr2=0x55b69effbe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 -- 172.21.15.6:0/1485541018 shutdown_connections 2023-09-13T09:46:46.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 -- 172.21.15.6:0/1485541018 wait complete. 2023-09-13T09:46:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.696+0000 7f7ab2570b80 1 -- start start 2023-09-13T09:46:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 1 Processor -- start 2023-09-13T09:46:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f001a00 0x55b69f06a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f002700 0x55b69f06a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f012470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69f066fc0 con 0x55b69f001a00 2023-09-13T09:46:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69f067130 con 0x55b69f002700 2023-09-13T09:46:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b69f0672f0 con 0x55b69f003060 2023-09-13T09:46:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7ab2570b80 10 client.0 _ll_register_callbacks cb 0x55b69eeef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:46.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f001a00 0x55b69f06a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f001a00 0x55b69f06a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38322/0 (socket says 172.21.15.6:38322) 2023-09-13T09:46:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 -- 172.21.15.6:0/2160788872 learned_addr learned my addr 172.21.15.6:0/2160788872 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f002700 0x55b69f06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7aa4928700 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f012470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 -- 172.21.15.6:0/2160788872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 msgr2=0x55b69f012470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f012470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 -- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f002700 msgr2=0x55b69f06a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f002700 0x55b69f06a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.697+0000 7f7a9ffff700 1 -- 172.21.15.6:0/2160788872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b69ef6b7a0 con 0x55b69f001a00 2023-09-13T09:46:46.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a9ffff700 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f001a00 0x55b69f06a3d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7a90005d90 tx=0x7f7a90011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d6cd6e113a68aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a7f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/2160788872 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a90004470 con 0x55b69f001a00 2023-09-13T09:46:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/2160788872 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a90032110 con 0x55b69f001a00 2023-09-13T09:46:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7a90021070 con 0x55b69f001a00 2023-09-13T09:46:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/2160788872 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7a900322d0 con 0x55b69f001a00 2023-09-13T09:46:46.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 10 client.17319 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f7aa0108b50 con 0x55b69f001a00 2023-09-13T09:46:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/2160788872 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a90021070 con 0x55b69f001a00 2023-09-13T09:46:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/2160788872 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7a90005390 con 0x55b69f001a00 2023-09-13T09:46:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 10 client.17319 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:46.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 10 client.17319 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:46:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 20 client.17319 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f0744d0 0x55b69f0768f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 4 client.17319 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b69ef0d050 con 0x55b69f0744d0 2023-09-13T09:46:46.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.698+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f0744d0 0x55b69f0768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.699+0000 7f7a7f7fe700 10 client.17319 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.699+0000 7f7a9f7fe700 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f0744d0 0x55b69f0768f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2fe85f8bc210f6e9 server_cookie=68eb5cc4c483122a in_seq=0 out_seq=0 2023-09-13T09:46:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.699+0000 7f7a7f7fe700 1 -- 172.21.15.6:0/2160788872 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b69ef0d050 con 0x55b69f0744d0 2023-09-13T09:46:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.699+0000 7f7a7f7fe700 10 client.17319 handle_command_reply: tid=0 2023-09-13T09:46:46.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.699+0000 7f7ab2570b80 1 client.17319 shutdown 2023-09-13T09:46:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f001a00 msgr2=0x55b69f06a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f001a00 0x55b69f06a3d0 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7a90005d90 tx=0x7f7a90011890 comp rx=0 tx=0).stop 2023-09-13T09:46:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 shutdown_connections 2023-09-13T09:46:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55b69f0744d0 0x55b69f0768f0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b69f003060 0x55b69f012470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b69f001a00 0x55b69f06a3d0 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 --2- 172.21.15.6:0/2160788872 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b69f002700 0x55b69f06a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7a7f7fe700 0 client.17319 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:46:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 >> 172.21.15.6:0/2160788872 conn(0x55b69ef5fc80 msgr2=0x55b69f0058e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 shutdown_connections 2023-09-13T09:46:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 1 -- 172.21.15.6:0/2160788872 wait complete. 2023-09-13T09:46:46.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7ab2570b80 20 client.17319 trim_cache size 0 max 16384 2023-09-13T09:46:46.722 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7a880a0640 msgr2=0x7f7a880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7aa638b700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7a880a0640 0x7f7a880a2b00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0100d30 tx=0x7f7a90009260 comp rx=0 tx=0).stop 2023-09-13T09:46:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 msgr2=0x7f7aa0196120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.700+0000 7f7aa638b700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0196120 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f7a9400e9a0 tx=0x7f7a9400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 shutdown_connections 2023-09-13T09:46:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7aa01013c0 0x7f7aa019d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7aa00ff8f0 0x7f7aa0195be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7a880a0640 0x7f7a880a2b00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 --2- 172.21.15.6:0/3563673683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7aa0100290 0x7f7aa0196120 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 >> 172.21.15.6:0/3563673683 conn(0x7f7aa00fb250 msgr2=0x7f7aa0104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 shutdown_connections 2023-09-13T09:46:46.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.701+0000 7f7aa638b700 1 -- 172.21.15.6:0/3563673683 wait complete. 2023-09-13T09:46:46.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:46:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.858+0000 7f01bdf9d700 1 -- 172.21.15.6:0/1467721208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8100be0 msgr2=0x7f01b8101040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.858+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/1467721208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8100be0 0x7f01b8101040 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009990 tx=0x7f01a4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- 172.21.15.6:0/1467721208 shutdown_connections 2023-09-13T09:46:46.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/1467721208 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01b8101580 0x7f01b8067fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/1467721208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b80ff9f0 0x7f01b80ffe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/1467721208 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8100be0 0x7f01b8101040 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- 172.21.15.6:0/1467721208 >> 172.21.15.6:0/1467721208 conn(0x7f01b80faf20 msgr2=0x7f01b80fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- 172.21.15.6:0/1467721208 shutdown_connections 2023-09-13T09:46:46.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- 172.21.15.6:0/1467721208 wait complete. 2023-09-13T09:46:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 Processor -- start 2023-09-13T09:46:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- start start 2023-09-13T09:46:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b80ff9f0 0x7f01b81967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01b8100be0 0x7f01b8196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8101580 0x7f01b819dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b819e370 con 0x7f01b8101580 2023-09-13T09:46:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b819e4b0 con 0x7f01b8100be0 2023-09-13T09:46:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.859+0000 7f01bdf9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b819e640 con 0x7f01b80ff9f0 2023-09-13T09:46:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8101580 0x7f01b819dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8101580 0x7f01b819dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38340/0 (socket says 172.21.15.6:38340) 2023-09-13T09:46:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 -- 172.21.15.6:0/3714484110 learned_addr learned my addr 172.21.15.6:0/3714484110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01b7fff700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01b8100be0 0x7f01b8196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b80ff9f0 0x7f01b81967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 -- 172.21.15.6:0/3714484110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b80ff9f0 msgr2=0x7f01b81967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b80ff9f0 0x7f01b81967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 -- 172.21.15.6:0/3714484110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01b8100be0 msgr2=0x7f01b8196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01b8100be0 0x7f01b8196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 -- 172.21.15.6:0/3714484110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a40095f0 con 0x7f01b8101580 2023-09-13T09:46:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bd79c700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8101580 0x7f01b819dda0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f01b000ef30 tx=0x7f01b000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01b5ffb700 1 -- 172.21.15.6:0/3714484110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0018070 con 0x7f01b8101580 2023-09-13T09:46:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01b5ffb700 1 -- 172.21.15.6:0/3714484110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b000f040 con 0x7f01b8101580 2023-09-13T09:46:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b819e8c0 con 0x7f01b8101580 2023-09-13T09:46:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.860+0000 7f01b5ffb700 1 -- 172.21.15.6:0/3714484110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b000cd00 con 0x7f01b8101580 2023-09-13T09:46:46.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.861+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b819ed80 con 0x7f01b8101580 2023-09-13T09:46:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.863+0000 7f01b5ffb700 1 -- 172.21.15.6:0/3714484110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f01b0003a00 con 0x7f01b8101580 2023-09-13T09:46:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.863+0000 7f01b5ffb700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01a80a0640 0x7f01a80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.864+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01a80a0640 0x7f01a80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.864+0000 7f01b5ffb700 1 -- 172.21.15.6:0/3714484110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01b00cb750 con 0x7f01b8101580 2023-09-13T09:46:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.864+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01a80a0640 0x7f01a80a2b00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f01b8100a40 tx=0x7f01ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.864+0000 7f01cb3e4b80 1 Processor -- start 2023-09-13T09:46:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01cb3e4b80 1 -- start start 2023-09-13T09:46:46.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556b45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b4b60 0x55f7556b5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f75560c780 con 0x55f7556b4b60 2023-09-13T09:46:46.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f75560a0a0 con 0x55f7556b40a0 2023-09-13T09:46:46.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f755605990 con 0x55f7556b3740 2023-09-13T09:46:46.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b4b60 0x55f7556b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b4b60 0x55f7556b5010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38348/0 (socket says 172.21.15.6:38348) 2023-09-13T09:46:46.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bcf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 -- 172.21.15.6:0/175094459 learned_addr learned my addr 172.21.15.6:0/175094459 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01b7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556b45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 -- 172.21.15.6:0/175094459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 msgr2=0x55f7556b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 --2- 172.21.15.6:0/175094459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 -- 172.21.15.6:0/175094459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 msgr2=0x55f7556b45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 --2- 172.21.15.6:0/175094459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556b45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 -- 172.21.15.6:0/175094459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f755485630 con 0x55f7556b4b60 2023-09-13T09:46:46.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01bd79c700 1 --2- 172.21.15.6:0/175094459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b4b60 0x55f7556b5010 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f01b00a0a30 tx=0x7f01b0098e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9128d855e0ff0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01a2ffd700 1 -- 172.21.15.6:0/175094459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b001b320 con 0x55f7556b4b60 2023-09-13T09:46:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01a2ffd700 1 -- 172.21.15.6:0/175094459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b00b8030 con 0x55f7556b4b60 2023-09-13T09:46:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.865+0000 7f01a2ffd700 1 -- 172.21.15.6:0/175094459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b00a0ff0 con 0x55f7556b4b60 2023-09-13T09:46:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/175094459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b4b60 msgr2=0x55f7556b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/175094459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b4b60 0x55f7556b5010 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f01b00a0a30 tx=0x7f01b0098e80 comp rx=0 tx=0).stop 2023-09-13T09:46:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/175094459 shutdown_connections 2023-09-13T09:46:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/175094459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b4b60 0x55f7556b5010 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/175094459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/175094459 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556b45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/175094459 >> 172.21.15.6:0/175094459 conn(0x55f755611c80 msgr2=0x55f7556ae0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/175094459 shutdown_connections 2023-09-13T09:46:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.866+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/175094459 wait complete. 2023-09-13T09:46:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 -- start start 2023-09-13T09:46:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 Processor -- start 2023-09-13T09:46:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556bd650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7555a3bb0 con 0x55f7556b40a0 2023-09-13T09:46:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7555a38b0 con 0x55f7556b4b60 2023-09-13T09:46:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f755487920 con 0x55f7556b3740 2023-09-13T09:46:46.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01cb3e4b80 10 client.0 _ll_register_callbacks cb 0x55f7555a1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:46.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01bcf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01bcf9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41404/0 (socket says 172.21.15.6:41404) 2023-09-13T09:46:46.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01bcf9b700 1 -- 172.21.15.6:0/3315225435 learned_addr learned my addr 172.21.15.6:0/3315225435 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01b7fff700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556bd650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.867+0000 7f01bd79c700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01bcf9b700 1 -- 172.21.15.6:0/3315225435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 msgr2=0x55f7556c4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01bcf9b700 1 -- 172.21.15.6:0/3315225435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 msgr2=0x55f7556bd650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556bd650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01bcf9b700 1 -- 172.21.15.6:0/3315225435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b819ed80 con 0x55f7556b3740 2023-09-13T09:46:46.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01b7fff700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556bd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556bd110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f01ac01d8d0 tx=0x7f01ac0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6dc2c1a86366ed0a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f0197fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:46:46.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f0197fff700 1 -- 172.21.15.6:0/3315225435 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac022070 con 0x55f7556b3740 2023-09-13T09:46:46.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7556a6670 con 0x55f7556b3740 2023-09-13T09:46:46.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f0197fff700 1 -- 172.21.15.6:0/3315225435 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01ac004020 con 0x55f7556b3740 2023-09-13T09:46:46.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f0197fff700 1 -- 172.21.15.6:0/3315225435 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01ac0041e0 con 0x55f7556b3740 2023-09-13T09:46:46.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01cb3e4b80 10 client.26674 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:46.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f75561d7a0 con 0x55f7556b3740 2023-09-13T09:46:46.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.868+0000 7f0197fff700 1 -- 172.21.15.6:0/3315225435 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f7556a6670 con 0x55f7556b3740 2023-09-13T09:46:46.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f0197fff700 1 -- 172.21.15.6:0/3315225435 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f01ac01c6a0 con 0x55f7556b3740 2023-09-13T09:46:46.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01cb3e4b80 10 client.26674 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:46.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01cb3e4b80 10 client.26674 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:46:46.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01cb3e4b80 20 client.26674 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:46.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f7556c8f90 0x55f7556cb3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01cb3e4b80 4 client.26674 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:46.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7555fe970 con 0x55f7556c8f90 2023-09-13T09:46:46.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01b7fff700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f7556c8f90 0x55f7556cb3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f01b7fff700 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f7556c8f90 0x55f7556cb3b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ce3af82fca0fb1e8 server_cookie=1ad0b52e8d0b8819 in_seq=0 out_seq=0 2023-09-13T09:46:46.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.869+0000 7f0197fff700 10 client.26674 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:46.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f0197fff700 1 -- 172.21.15.6:0/3315225435 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f7555fe970 con 0x55f7556c8f90 2023-09-13T09:46:46.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f0197fff700 10 client.26674 handle_command_reply: tid=0 2023-09-13T09:46:46.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 client.26674 shutdown 2023-09-13T09:46:46.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 msgr2=0x55f7556bd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556bd110 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f01ac01d8d0 tx=0x7f01ac0047c0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 shutdown_connections 2023-09-13T09:46:46.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f7556c8f90 0x55f7556cb3b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556bd110 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/3315225435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556bd650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f0197fff700 0 client.26674 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:46.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 >> 172.21.15.6:0/3315225435 conn(0x55f755611c80 msgr2=0x55f7556b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 shutdown_connections 2023-09-13T09:46:46.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/3315225435 wait complete. 2023-09-13T09:46:46.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.870+0000 7f01cb3e4b80 20 client.26674 trim_cache size 0 max 16384 2023-09-13T09:46:46.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.883+0000 7f01cb3e4b80 1 Processor -- start 2023-09-13T09:46:46.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.883+0000 7f01cb3e4b80 1 -- start start 2023-09-13T09:46:46.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b3740 0x55f7556a8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b4b60 0x55f7556bbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7556a6650 con 0x55f7556b3740 2023-09-13T09:46:46.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7556bcc80 con 0x55f7556b40a0 2023-09-13T09:46:46.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7556afff0 con 0x55f7556b4b60 2023-09-13T09:46:46.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b3740 0x55f7556a8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b3740 0x55f7556a8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38358/0 (socket says 172.21.15.6:38358) 2023-09-13T09:46:46.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 -- 172.21.15.6:0/2018469053 learned_addr learned my addr 172.21.15.6:0/2018469053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01b7fff700 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bd79c700 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b4b60 0x55f7556bbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 -- 172.21.15.6:0/2018469053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b4b60 msgr2=0x55f7556bbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b4b60 0x55f7556bbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 -- 172.21.15.6:0/2018469053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 msgr2=0x55f7556c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 -- 172.21.15.6:0/2018469053 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f755431de0 con 0x55f7556b3740 2023-09-13T09:46:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bd79c700 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b4b60 0x55f7556bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01b7fff700 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b3740 0x55f7556a8a00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f01ac011b60 tx=0x7f01ac004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1d66aaaa0cb431 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01a37fe700 1 -- 172.21.15.6:0/2018469053 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac022040 con 0x55f7556b3740 2023-09-13T09:46:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.884+0000 7f01a37fe700 1 -- 172.21.15.6:0/2018469053 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01ac0044e0 con 0x55f7556b3740 2023-09-13T09:46:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01a37fe700 1 -- 172.21.15.6:0/2018469053 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac003bb0 con 0x55f7556b3740 2023-09-13T09:46:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/2018469053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b3740 msgr2=0x55f7556a8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b3740 0x55f7556a8a00 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f01ac011b60 tx=0x7f01ac004750 comp rx=0 tx=0).stop 2023-09-13T09:46:46.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/2018469053 shutdown_connections 2023-09-13T09:46:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b4b60 0x55f7556bbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b3740 0x55f7556a8a00 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/2018469053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b40a0 0x55f7556c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/2018469053 >> 172.21.15.6:0/2018469053 conn(0x55f755611c80 msgr2=0x55f7556ae060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/2018469053 shutdown_connections 2023-09-13T09:46:46.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.885+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/2018469053 wait complete. 2023-09-13T09:46:46.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 -- start start 2023-09-13T09:46:46.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 Processor -- start 2023-09-13T09:46:46.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556c28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556c2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7556c4200 con 0x55f7556b40a0 2023-09-13T09:46:46.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7556c4370 con 0x55f7556b4b60 2023-09-13T09:46:46.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7556c4530 con 0x55f7556b3740 2023-09-13T09:46:46.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01cb3e4b80 10 client.0 _ll_register_callbacks cb 0x55f7555a1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:46.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556c2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01b7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556c2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38366/0 (socket says 172.21.15.6:38366) 2023-09-13T09:46:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01b7fff700 1 -- 172.21.15.6:0/4007102773 learned_addr learned my addr 172.21.15.6:0/4007102773 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01bd79c700 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556c28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01b7fff700 1 -- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 msgr2=0x55f7556c28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.886+0000 7f01b7fff700 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556c28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01b7fff700 1 -- 172.21.15.6:0/4007102773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 msgr2=0x55f7556c3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01b7fff700 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01b7fff700 1 -- 172.21.15.6:0/4007102773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b80689e0 con 0x55f7556b40a0 2023-09-13T09:46:46.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01b7fff700 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556c2de0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009990 tx=0x7f01a400bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41671fba2d0ca373 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f0197fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f0197fff700 1 -- 172.21.15.6:0/4007102773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a401d040 con 0x55f7556b40a0 2023-09-13T09:46:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f0197fff700 1 -- 172.21.15.6:0/4007102773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f01a40290d0 con 0x55f7556b40a0 2023-09-13T09:46:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f01b00b8030 con 0x55f7556b40a0 2023-09-13T09:46:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f0197fff700 1 -- 172.21.15.6:0/4007102773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f01a4029290 con 0x55f7556b40a0 2023-09-13T09:46:46.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 10 client.17337 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:46.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f75561d7a0 con 0x55f7556b40a0 2023-09-13T09:46:46.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f0197fff700 1 -- 172.21.15.6:0/4007102773 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f01b00b8030 con 0x55f7556b40a0 2023-09-13T09:46:46.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f0197fff700 1 -- 172.21.15.6:0/4007102773 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f01a40046c0 con 0x55f7556b40a0 2023-09-13T09:46:46.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 10 client.17337 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:46.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 10 client.17337 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:46:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 20 client.17337 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f75571e160 0x55f755720580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.887+0000 7f01cb3e4b80 4 client.17337 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f7555bf050 con 0x55f75571e160 2023-09-13T09:46:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f75571e160 0x55f755720580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:46.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01bcf9b700 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f75571e160 0x55f755720580 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=624796908abf2453 server_cookie=ed812b4c40822db9 in_seq=0 out_seq=0 2023-09-13T09:46:46.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f0197fff700 10 client.17337 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:46.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f0197fff700 1 -- 172.21.15.6:0/4007102773 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f7555bf050 con 0x55f75571e160 2023-09-13T09:46:46.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f0197fff700 10 client.17337 handle_command_reply: tid=0 2023-09-13T09:46:46.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 client.17337 shutdown 2023-09-13T09:46:46.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 msgr2=0x55f7556c2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556c2de0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f01a4009990 tx=0x7f01a400bfb0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 shutdown_connections 2023-09-13T09:46:46.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f75571e160 0x55f755720580 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7556b4b60 0x55f7556c3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f0197fff700 0 client.17337 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:46:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7556b3740 0x55f7556c28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 --2- 172.21.15.6:0/4007102773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7556b40a0 0x55f7556c2de0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.888+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 >> 172.21.15.6:0/4007102773 conn(0x55f755611c80 msgr2=0x55f7556bbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 shutdown_connections 2023-09-13T09:46:46.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01cb3e4b80 1 -- 172.21.15.6:0/4007102773 wait complete. 2023-09-13T09:46:46.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01cb3e4b80 20 client.17337 trim_cache size 0 max 16384 2023-09-13T09:46:46.913 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01a80a0640 msgr2=0x7f01a80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01a80a0640 0x7f01a80a2b00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f01b8100a40 tx=0x7f01ac009260 comp rx=0 tx=0).stop 2023-09-13T09:46:46.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8101580 msgr2=0x7f01b819dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:46.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8101580 0x7f01b819dda0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f01b000ef30 tx=0x7f01b000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 shutdown_connections 2023-09-13T09:46:46.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01a80a0640 0x7f01a80a2b00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01b8101580 0x7f01b819dda0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01b80ff9f0 0x7f01b81967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 --2- 172.21.15.6:0/3714484110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01b8100be0 0x7f01b8196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:46.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 >> 172.21.15.6:0/3714484110 conn(0x7f01b80faf20 msgr2=0x7f01b80fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:46.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 shutdown_connections 2023-09-13T09:46:46.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:46.889+0000 7f01bdf9d700 1 -- 172.21.15.6:0/3714484110 wait complete. 2023-09-13T09:46:46.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:46:47.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:46 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3338693192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:46:47.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.048+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/869033049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44100eb0 msgr2=0x7f6e44101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.048+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/869033049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44100eb0 0x7f6e44101310 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f6e340099c0 tx=0x7f6e34009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/869033049 shutdown_connections 2023-09-13T09:46:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/869033049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e44101850 0x7f6e44108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/869033049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 0x7f6e441000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/869033049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44100eb0 0x7f6e44101310 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/869033049 >> 172.21.15.6:0/869033049 conn(0x7f6e440fb250 msgr2=0x7f6e440fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/869033049 shutdown_connections 2023-09-13T09:46:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/869033049 wait complete. 2023-09-13T09:46:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 Processor -- start 2023-09-13T09:46:47.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.049+0000 7f6e4bdc7700 1 -- start start 2023-09-13T09:46:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4bdc7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 0x7f6e44068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4bdc7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e44100eb0 0x7f6e4419b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4bdc7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44101850 0x7f6e4419ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4bdc7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4419e560 con 0x7f6e44101850 2023-09-13T09:46:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4bdc7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4419e6d0 con 0x7f6e44100eb0 2023-09-13T09:46:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4bdc7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4419e890 con 0x7f6e440ffcc0 2023-09-13T09:46:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 0x7f6e44068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 0x7f6e44068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41432/0 (socket says 172.21.15.6:41432) 2023-09-13T09:46:47.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 -- 172.21.15.6:0/2549770039 learned_addr learned my addr 172.21.15.6:0/2549770039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49362700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e44100eb0 0x7f6e4419b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4a364700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44101850 0x7f6e4419ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 -- 172.21.15.6:0/2549770039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e44100eb0 msgr2=0x7f6e4419b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e44100eb0 0x7f6e4419b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 -- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44101850 msgr2=0x7f6e4419ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44101850 0x7f6e4419ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 -- 172.21.15.6:0/2549770039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340095f0 con 0x7f6e440ffcc0 2023-09-13T09:46:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e4a364700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44101850 0x7f6e4419ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e49b63700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 0x7f6e44068b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000e970 tx=0x7f6e4000ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.050+0000 7f6e3affd700 1 -- 172.21.15.6:0/2549770039 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40009790 con 0x7f6e440ffcc0 2023-09-13T09:46:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.051+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4419eb70 con 0x7f6e440ffcc0 2023-09-13T09:46:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.051+0000 7f6e3affd700 1 -- 172.21.15.6:0/2549770039 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e4000c7e0 con 0x7f6e440ffcc0 2023-09-13T09:46:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.051+0000 7f6e3affd700 1 -- 172.21.15.6:0/2549770039 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40003c70 con 0x7f6e440ffcc0 2023-09-13T09:46:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.051+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4419f0d0 con 0x7f6e440ffcc0 2023-09-13T09:46:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.053+0000 7f6e3affd700 1 -- 172.21.15.6:0/2549770039 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6e4000cc50 con 0x7f6e440ffcc0 2023-09-13T09:46:47.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.053+0000 7f6e3affd700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6e300a0640 0x7f6e300a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.053+0000 7f6e3affd700 1 -- 172.21.15.6:0/2549770039 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e40014070 con 0x7f6e440ffcc0 2023-09-13T09:46:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.054+0000 7f6e49362700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6e300a0640 0x7f6e300a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.054+0000 7f6e49362700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6e300a0640 0x7f6e300a2b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400b580 tx=0x7f6e34005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.054+0000 7f6e57facb80 1 Processor -- start 2023-09-13T09:46:47.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.054+0000 7f6e57facb80 1 -- start start 2023-09-13T09:46:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c2700 0x5640774c2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c1a00 0x5640774c1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e57facb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56407741a780 con 0x5640774c2700 2023-09-13T09:46:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e57facb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640774180a0 con 0x5640774c1a00 2023-09-13T09:46:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e57facb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564077413990 con 0x5640774c3060 2023-09-13T09:46:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c2700 0x5640774c2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c2700 0x5640774c2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38386/0 (socket says 172.21.15.6:38386) 2023-09-13T09:46:47.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 -- 172.21.15.6:0/882669913 learned_addr learned my addr 172.21.15.6:0/882669913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49362700 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e4a364700 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c1a00 0x5640774c1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 -- 172.21.15.6:0/882669913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 msgr2=0x5640774c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 -- 172.21.15.6:0/882669913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c1a00 msgr2=0x5640774c1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c1a00 0x5640774c1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 -- 172.21.15.6:0/882669913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564077293630 con 0x5640774c2700 2023-09-13T09:46:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e49b63700 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c2700 0x5640774c2b20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6e40095fb0 tx=0x7f6e40003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22ab80d5c8812513 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e2ffff700 1 -- 172.21.15.6:0/882669913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4009d170 con 0x5640774c2700 2023-09-13T09:46:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e2ffff700 1 -- 172.21.15.6:0/882669913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e40099540 con 0x5640774c2700 2023-09-13T09:46:47.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.055+0000 7f6e2ffff700 1 -- 172.21.15.6:0/882669913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e40084250 con 0x5640774c2700 2023-09-13T09:46:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 -- 172.21.15.6:0/882669913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c2700 msgr2=0x5640774c2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c2700 0x5640774c2b20 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f6e40095fb0 tx=0x7f6e40003710 comp rx=0 tx=0).stop 2023-09-13T09:46:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 -- 172.21.15.6:0/882669913 shutdown_connections 2023-09-13T09:46:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c1a00 0x5640774c1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c2700 0x5640774c2b20 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 --2- 172.21.15.6:0/882669913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 -- 172.21.15.6:0/882669913 >> 172.21.15.6:0/882669913 conn(0x56407741fc80 msgr2=0x5640774bbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 -- 172.21.15.6:0/882669913 shutdown_connections 2023-09-13T09:46:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.056+0000 7f6e57facb80 1 -- 172.21.15.6:0/882669913 wait complete. 2023-09-13T09:46:47.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 -- start start 2023-09-13T09:46:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 Processor -- start 2023-09-13T09:46:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774caf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c2700 0x5640774cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c3060 0x5640774d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640773b1bb0 con 0x5640774c1a00 2023-09-13T09:46:47.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640773b18b0 con 0x5640774c3060 2023-09-13T09:46:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564077295920 con 0x5640774c2700 2023-09-13T09:46:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e57facb80 10 client.0 _ll_register_callbacks cb 0x5640773af680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774caf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38392/0 (socket says 172.21.15.6:38392) 2023-09-13T09:46:47.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e49b63700 1 -- 172.21.15.6:0/3158078756 learned_addr learned my addr 172.21.15.6:0/3158078756 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e4a364700 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c3060 0x5640774d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.057+0000 7f6e49362700 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c2700 0x5640774cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e49b63700 1 -- 172.21.15.6:0/3158078756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c2700 msgr2=0x5640774cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e49b63700 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c2700 0x5640774cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e49b63700 1 -- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c3060 msgr2=0x5640774d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e49b63700 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c3060 0x5640774d24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e49b63700 1 -- 172.21.15.6:0/3158078756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4419f0d0 con 0x5640774c1a00 2023-09-13T09:46:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e49b63700 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774caf70 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6e40097890 tx=0x7f6e4009d170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e451b0084cb4b6a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e2d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:47.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/3158078756 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e4009d370 con 0x5640774c1a00 2023-09-13T09:46:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/3158078756 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e400a15b0 con 0x5640774c1a00 2023-09-13T09:46:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640774b4670 con 0x5640774c1a00 2023-09-13T09:46:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/3158078756 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e40065230 con 0x5640774c1a00 2023-09-13T09:46:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e57facb80 10 client.17349 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56407742b7a0 con 0x5640774c1a00 2023-09-13T09:46:47.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/3158078756 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5640774b4670 con 0x5640774c1a00 2023-09-13T09:46:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.058+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/3158078756 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e40004220 con 0x5640774c1a00 2023-09-13T09:46:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e57facb80 10 client.17349 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e57facb80 10 client.17349 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:46:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e57facb80 20 client.17349 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:47.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e57facb80 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5640774d68a0 0x5640774d8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e57facb80 4 client.17349 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56407740c970 con 0x5640774d68a0 2023-09-13T09:46:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e49362700 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5640774d68a0 0x5640774d8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e2d7fa700 10 client.17349 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:47.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.059+0000 7f6e49362700 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5640774d68a0 0x5640774d8cc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4951c17f87a77f29 server_cookie=178bfef771f0b3d9 in_seq=0 out_seq=0 2023-09-13T09:46:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/3158078756 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56407740c970 con 0x5640774d68a0 2023-09-13T09:46:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e2d7fa700 10 client.17349 handle_command_reply: tid=0 2023-09-13T09:46:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 client.17349 shutdown 2023-09-13T09:46:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 msgr2=0x5640774caf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774caf70 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f6e40097890 tx=0x7f6e4009d170 comp rx=0 tx=0).stop 2023-09-13T09:46:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 shutdown_connections 2023-09-13T09:46:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5640774d68a0 0x5640774d8cc0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c3060 0x5640774d24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e2d7fa700 0 client.17349 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:47.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774caf70 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 --2- 172.21.15.6:0/3158078756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c2700 0x5640774cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 >> 172.21.15.6:0/3158078756 conn(0x56407741fc80 msgr2=0x5640774b67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 shutdown_connections 2023-09-13T09:46:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 1 -- 172.21.15.6:0/3158078756 wait complete. 2023-09-13T09:46:47.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.060+0000 7f6e57facb80 20 client.17349 trim_cache size 0 max 16384 2023-09-13T09:46:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 Processor -- start 2023-09-13T09:46:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 -- start start 2023-09-13T09:46:47.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774d24b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640774bda10 con 0x5640774c1a00 2023-09-13T09:46:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640774b88e0 con 0x5640774c2700 2023-09-13T09:46:47.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e57facb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640774bd350 con 0x5640774c3060 2023-09-13T09:46:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49362700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774d24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49b63700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38400/0 (socket says 172.21.15.6:38400) 2023-09-13T09:46:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49b63700 1 -- 172.21.15.6:0/1359381169 learned_addr learned my addr 172.21.15.6:0/1359381169 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e4a364700 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49362700 1 -- 172.21.15.6:0/1359381169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 msgr2=0x5640774c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49362700 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49362700 1 -- 172.21.15.6:0/1359381169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 msgr2=0x5640774c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49362700 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774c14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49362700 1 -- 172.21.15.6:0/1359381169 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56407723fde0 con 0x5640774c2700 2023-09-13T09:46:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e49b63700 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.075+0000 7f6e4a364700 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.076+0000 7f6e49362700 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774d24b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009fd0 tx=0x7f6e34021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29be43a5ed9e2e1a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.076+0000 7f6e38ff9700 1 -- 172.21.15.6:0/1359381169 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34029040 con 0x5640774c2700 2023-09-13T09:46:47.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.076+0000 7f6e38ff9700 1 -- 172.21.15.6:0/1359381169 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e3402a040 con 0x5640774c2700 2023-09-13T09:46:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.076+0000 7f6e38ff9700 1 -- 172.21.15.6:0/1359381169 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e34003ac0 con 0x5640774c2700 2023-09-13T09:46:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.076+0000 7f6e57facb80 1 -- 172.21.15.6:0/1359381169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 msgr2=0x5640774d24b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774d24b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f6e34009fd0 tx=0x7f6e34021000 comp rx=0 tx=0).stop 2023-09-13T09:46:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- 172.21.15.6:0/1359381169 shutdown_connections 2023-09-13T09:46:47.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c3060 0x5640774c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c1a00 0x5640774c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 --2- 172.21.15.6:0/1359381169 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774d24b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- 172.21.15.6:0/1359381169 >> 172.21.15.6:0/1359381169 conn(0x56407741fc80 msgr2=0x5640774c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- 172.21.15.6:0/1359381169 shutdown_connections 2023-09-13T09:46:47.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- 172.21.15.6:0/1359381169 wait complete. 2023-09-13T09:46:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- start start 2023-09-13T09:46:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 Processor -- start 2023-09-13T09:46:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c1a00 0x5640774ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774cea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c3060 0x5640774d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640774d1f80 con 0x5640774c3060 2023-09-13T09:46:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640774d20f0 con 0x5640774c2700 2023-09-13T09:46:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640774d22b0 con 0x5640774c1a00 2023-09-13T09:46:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.077+0000 7f6e57facb80 10 client.0 _ll_register_callbacks cb 0x5640773af680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c3060 0x5640774d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c3060 0x5640774d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38410/0 (socket says 172.21.15.6:38410) 2023-09-13T09:46:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 -- 172.21.15.6:0/155222364 learned_addr learned my addr 172.21.15.6:0/155222364 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e49362700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774cea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e49b63700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c1a00 0x5640774ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 -- 172.21.15.6:0/155222364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c1a00 msgr2=0x5640774ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c1a00 0x5640774ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 -- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 msgr2=0x5640774cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774cea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 -- 172.21.15.6:0/155222364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56407742b7a0 con 0x5640774c3060 2023-09-13T09:46:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e49b63700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c1a00 0x5640774ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:47.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e4a364700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c3060 0x5640774d1a40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00ef20 tx=0x7f6e3c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0920c3bc6a91c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e2d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/155222364 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c01c070 con 0x5640774c3060 2023-09-13T09:46:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/155222364 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6e3c004bb0 con 0x5640774c3060 2023-09-13T09:46:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6e40099540 con 0x5640774c3060 2023-09-13T09:46:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/155222364 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6e3c004d70 con 0x5640774c3060 2023-09-13T09:46:47.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e57facb80 10 client.17355 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.078+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f6e3c00e600 con 0x5640774c3060 2023-09-13T09:46:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/155222364 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6e40099540 con 0x5640774c3060 2023-09-13T09:46:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/155222364 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6e3c016400 con 0x5640774c3060 2023-09-13T09:46:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e57facb80 10 client.17355 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:47.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e57facb80 10 client.17355 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:46:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e57facb80 20 client.17355 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e57facb80 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56407752b9f0 0x56407752de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e57facb80 4 client.17355 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5640773cd050 con 0x56407752b9f0 2023-09-13T09:46:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e49b63700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56407752b9f0 0x56407752de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e49b63700 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56407752b9f0 0x56407752de10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7c0c221f90fa04bd server_cookie=1a0c8963f1ee3f47 in_seq=0 out_seq=0 2023-09-13T09:46:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.079+0000 7f6e2d7fa700 10 client.17355 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e2d7fa700 1 -- 172.21.15.6:0/155222364 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5640773cd050 con 0x56407752b9f0 2023-09-13T09:46:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e2d7fa700 10 client.17355 handle_command_reply: tid=0 2023-09-13T09:46:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 client.17355 shutdown 2023-09-13T09:46:47.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c3060 msgr2=0x5640774d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c3060 0x5640774d1a40 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c00ef20 tx=0x7f6e3c0077e0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 shutdown_connections 2023-09-13T09:46:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56407752b9f0 0x56407752de10 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5640774c3060 0x5640774d1a40 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5640774c1a00 0x5640774ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e2d7fa700 0 client.17355 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:46:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 --2- 172.21.15.6:0/155222364 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5640774c2700 0x5640774cea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.080+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 >> 172.21.15.6:0/155222364 conn(0x56407741fc80 msgr2=0x5640774c8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 shutdown_connections 2023-09-13T09:46:47.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e57facb80 1 -- 172.21.15.6:0/155222364 wait complete. 2023-09-13T09:46:47.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e57facb80 20 client.17355 trim_cache size 0 max 16384 2023-09-13T09:46:47.104 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:47.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6e300a0640 msgr2=0x7f6e300a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6e300a0640 0x7f6e300a2b00 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f6e3400b580 tx=0x7f6e34005fb0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 msgr2=0x7f6e44068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 0x7f6e44068b20 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e4000e970 tx=0x7f6e4000ec80 comp rx=0 tx=0).stop 2023-09-13T09:46:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 shutdown_connections 2023-09-13T09:46:47.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6e300a0640 0x7f6e300a2b00 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6e44101850 0x7f6e4419ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e440ffcc0 0x7f6e44068b20 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 --2- 172.21.15.6:0/2549770039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6e44100eb0 0x7f6e4419b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 >> 172.21.15.6:0/2549770039 conn(0x7f6e440fb250 msgr2=0x7f6e440fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 shutdown_connections 2023-09-13T09:46:47.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.081+0000 7f6e4bdc7700 1 -- 172.21.15.6:0/2549770039 wait complete. 2023-09-13T09:46:47.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:46:47.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 301806 4.56 MB/sec execute 247 sec latency 20.933 ms 2023-09-13T09:46:47.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 -- 172.21.15.6:0/4170122892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f381029f0 msgr2=0x7f2f381092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/4170122892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f381029f0 0x7f2f381092a0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000b0a0 tx=0x7f2f3000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 -- 172.21.15.6:0/4170122892 shutdown_connections 2023-09-13T09:46:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/4170122892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f381029f0 0x7f2f381092a0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/4170122892 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f380ff080 0x7f2f380ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/4170122892 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f38102050 0x7f2f381024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 -- 172.21.15.6:0/4170122892 >> 172.21.15.6:0/4170122892 conn(0x7f2f380fa9b0 msgr2=0x7f2f380fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 -- 172.21.15.6:0/4170122892 shutdown_connections 2023-09-13T09:46:47.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.243+0000 7f2f3e00d700 1 -- 172.21.15.6:0/4170122892 wait complete. 2023-09-13T09:46:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 Processor -- start 2023-09-13T09:46:47.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 -- start start 2023-09-13T09:46:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f380ff080 0x7f2f38196be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f38102050 0x7f2f38197120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f381029f0 0x7f2f3819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3819e760 con 0x7f2f380ff080 2023-09-13T09:46:47.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3819e8a0 con 0x7f2f381029f0 2023-09-13T09:46:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f3e00d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3819ea30 con 0x7f2f38102050 2023-09-13T09:46:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f380ff080 0x7f2f38196be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f380ff080 0x7f2f38196be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38420/0 (socket says 172.21.15.6:38420) 2023-09-13T09:46:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f377fe700 1 -- 172.21.15.6:0/3670085541 learned_addr learned my addr 172.21.15.6:0/3670085541 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f2ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f38102050 0x7f2f38197120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.244+0000 7f2f37fff700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f381029f0 0x7f2f3819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f377fe700 1 -- 172.21.15.6:0/3670085541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f38102050 msgr2=0x7f2f38197120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f377fe700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f38102050 0x7f2f38197120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f377fe700 1 -- 172.21.15.6:0/3670085541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f381029f0 msgr2=0x7f2f3819e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f377fe700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f381029f0 0x7f2f3819e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f377fe700 1 -- 172.21.15.6:0/3670085541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30009d00 con 0x7f2f380ff080 2023-09-13T09:46:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f377fe700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f380ff080 0x7f2f38196be0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800e970 tx=0x7f2f2800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f357fa700 1 -- 172.21.15.6:0/3670085541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28009790 con 0x7f2f380ff080 2023-09-13T09:46:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f357fa700 1 -- 172.21.15.6:0/3670085541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f2800c7e0 con 0x7f2f380ff080 2023-09-13T09:46:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3819ed10 con 0x7f2f380ff080 2023-09-13T09:46:47.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f357fa700 1 -- 172.21.15.6:0/3670085541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28003c70 con 0x7f2f380ff080 2023-09-13T09:46:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.245+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f3819f1d0 con 0x7f2f380ff080 2023-09-13T09:46:47.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.247+0000 7f2f357fa700 1 -- 172.21.15.6:0/3670085541 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2f2800cc50 con 0x7f2f380ff080 2023-09-13T09:46:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.248+0000 7f2f357fa700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2f240a0640 0x7f2f240a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.248+0000 7f2f357fa700 1 -- 172.21.15.6:0/3670085541 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2f28014070 con 0x7f2f380ff080 2023-09-13T09:46:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.248+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2f240a0640 0x7f2f240a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.248+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2f240a0640 0x7f2f240a2b00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009c60 tx=0x7f2f20009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 Processor -- start 2023-09-13T09:46:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 -- start start 2023-09-13T09:46:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba5700 0x56180bba5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bba44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba4a00 0x56180bba4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bafd780 con 0x56180bba4a00 2023-09-13T09:46:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bafb0a0 con 0x56180bba5700 2023-09-13T09:46:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180baf6990 con 0x56180bba6060 2023-09-13T09:46:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba4a00 0x56180bba4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba4a00 0x56180bba4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38432/0 (socket says 172.21.15.6:38432) 2023-09-13T09:46:47.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f37fff700 1 -- 172.21.15.6:0/1680688162 learned_addr learned my addr 172.21.15.6:0/1680688162 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bba44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.249+0000 7f2f377fe700 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba5700 0x56180bba5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f37fff700 1 -- 172.21.15.6:0/1680688162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 msgr2=0x56180bba44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f37fff700 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bba44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f37fff700 1 -- 172.21.15.6:0/1680688162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba5700 msgr2=0x56180bba5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f37fff700 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba5700 0x56180bba5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f37fff700 1 -- 172.21.15.6:0/1680688162 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180b976630 con 0x56180bba4a00 2023-09-13T09:46:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f377fe700 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba5700 0x56180bba5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f37fff700 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba4a00 0x56180bba4e80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000b0a0 tx=0x7f2f30009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51dc2f8e55fd0542 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f2dffb700 1 -- 172.21.15.6:0/1680688162 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3000e040 con 0x56180bba4a00 2023-09-13T09:46:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f2dffb700 1 -- 172.21.15.6:0/1680688162 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f300076e0 con 0x56180bba4a00 2023-09-13T09:46:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.250+0000 7f2f2dffb700 1 -- 172.21.15.6:0/1680688162 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3001c6a0 con 0x56180bba4a00 2023-09-13T09:46:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1680688162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba4a00 msgr2=0x56180bba4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba4a00 0x56180bba4e80 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000b0a0 tx=0x7f2f30009c20 comp rx=0 tx=0).stop 2023-09-13T09:46:47.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1680688162 shutdown_connections 2023-09-13T09:46:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba4a00 0x56180bba4e80 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba5700 0x56180bba5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1680688162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bba44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1680688162 >> 172.21.15.6:0/1680688162 conn(0x56180bb02c80 msgr2=0x56180bb9ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1680688162 shutdown_connections 2023-09-13T09:46:47.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1680688162 wait complete. 2023-09-13T09:46:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 -- start start 2023-09-13T09:46:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 Processor -- start 2023-09-13T09:46:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bbadf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.251+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba5700 0x56180bbae440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bbb5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180ba94bb0 con 0x56180bba5700 2023-09-13T09:46:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180ba948b0 con 0x56180bba4a00 2023-09-13T09:46:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180b978920 con 0x56180bba6060 2023-09-13T09:46:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f4a1f2b80 10 client.0 _ll_register_callbacks cb 0x56180ba92680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:47.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba5700 0x56180bbae440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bbadf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bbadf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60190/0 (socket says 172.21.15.6:60190) 2023-09-13T09:46:47.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba5700 0x56180bbae440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38436/0 (socket says 172.21.15.6:38436) 2023-09-13T09:46:47.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 -- 172.21.15.6:0/3963674257 learned_addr learned my addr 172.21.15.6:0/3963674257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f37fff700 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bbb5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 -- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 msgr2=0x56180bbb5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bbb5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 -- 172.21.15.6:0/3963674257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba5700 msgr2=0x56180bbae440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba5700 0x56180bbae440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 -- 172.21.15.6:0/3963674257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f38109ba0 con 0x56180bba4a00 2023-09-13T09:46:47.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba5700 0x56180bbae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:47.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f377fe700 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bbadf00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005950 tx=0x7f2f28098f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=658e41e026d65b2a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:47.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f16ffd700 1 -- 172.21.15.6:0/3963674257 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f2809d170 con 0x56180bba4a00 2023-09-13T09:46:47.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f16ffd700 1 -- 172.21.15.6:0/3963674257 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2f28099540 con 0x56180bba4a00 2023-09-13T09:46:47.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.252+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56180bb97670 con 0x56180bba4a00 2023-09-13T09:46:47.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f16ffd700 1 -- 172.21.15.6:0/3963674257 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f2809d370 con 0x56180bba4a00 2023-09-13T09:46:47.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 10 client.26777 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:47.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56180bb0e7a0 con 0x56180bba4a00 2023-09-13T09:46:47.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f16ffd700 1 -- 172.21.15.6:0/3963674257 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f28063020 con 0x56180bba4a00 2023-09-13T09:46:47.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f16ffd700 1 -- 172.21.15.6:0/3963674257 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f28098a30 con 0x56180bba4a00 2023-09-13T09:46:47.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 10 client.26777 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 10 client.26777 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 20 client.26777 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bbbc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 4 client.26777 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:47.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56180baef970 con 0x56180bbb9d80 2023-09-13T09:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.253+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bbbc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.254+0000 7f2f16ffd700 10 client.26777 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.254+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bbbc1a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=746ef5ff6ff69a08 server_cookie=6f5cad489d77eaee in_seq=0 out_seq=0 2023-09-13T09:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.254+0000 7f2f16ffd700 1 -- 172.21.15.6:0/3963674257 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56180baef970 con 0x56180bbb9d80 2023-09-13T09:46:47.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.254+0000 7f2f16ffd700 10 client.26777 handle_command_reply: tid=0 2023-09-13T09:46:47.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.254+0000 7f2f4a1f2b80 1 client.26777 shutdown 2023-09-13T09:46:47.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.254+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 msgr2=0x56180bbadf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.254+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bbadf00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2f28005950 tx=0x7f2f28098f20 comp rx=0 tx=0).stop 2023-09-13T09:46:47.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 shutdown_connections 2023-09-13T09:46:47.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bbbc1a0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba6060 0x56180bbb5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f16ffd700 0 client.26777 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:47.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bbadf00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/3963674257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba5700 0x56180bbae440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 >> 172.21.15.6:0/3963674257 conn(0x56180bb02c80 msgr2=0x56180bb997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 shutdown_connections 2023-09-13T09:46:47.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/3963674257 wait complete. 2023-09-13T09:46:47.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.255+0000 7f2f4a1f2b80 20 client.26777 trim_cache size 0 max 16384 2023-09-13T09:46:47.277 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:46 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3338693192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:46:47.277 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:46 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3338693192' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:46:47.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 Processor -- start 2023-09-13T09:46:47.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 -- start start 2023-09-13T09:46:47.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bba44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bbadcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bbae1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bbadaa0 con 0x56180bba6060 2023-09-13T09:46:47.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bb9f990 con 0x56180bba4a00 2023-09-13T09:46:47.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bbaef60 con 0x56180bba5700 2023-09-13T09:46:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bba44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bbae1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bba44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60198/0 (socket says 172.21.15.6:60198) 2023-09-13T09:46:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f377fe700 1 -- 172.21.15.6:0/2178026563 learned_addr learned my addr 172.21.15.6:0/2178026563 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.270+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bbadcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f377fe700 1 -- 172.21.15.6:0/2178026563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 msgr2=0x56180bbadcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f377fe700 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bbadcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f377fe700 1 -- 172.21.15.6:0/2178026563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 msgr2=0x56180bbae1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f377fe700 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bbae1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f377fe700 1 -- 172.21.15.6:0/2178026563 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56180b922de0 con 0x56180bba4a00 2023-09-13T09:46:47.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bbadcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f377fe700 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bba44c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f28095a40 tx=0x7f2f28097af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6257be0cd39f023b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f2e7fc700 1 -- 172.21.15.6:0/2178026563 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28003dd0 con 0x56180bba4a00 2023-09-13T09:46:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f2e7fc700 1 -- 172.21.15.6:0/2178026563 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f28063030 con 0x56180bba4a00 2023-09-13T09:46:47.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.271+0000 7f2f2e7fc700 1 -- 172.21.15.6:0/2178026563 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28098b50 con 0x56180bba4a00 2023-09-13T09:46:47.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/2178026563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 msgr2=0x56180bba44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bba44c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2f28095a40 tx=0x7f2f28097af0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/2178026563 shutdown_connections 2023-09-13T09:46:47.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bbae1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bba44c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/2178026563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bbadcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/2178026563 >> 172.21.15.6:0/2178026563 conn(0x56180bb02c80 msgr2=0x56180bba88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/2178026563 shutdown_connections 2023-09-13T09:46:47.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/2178026563 wait complete. 2023-09-13T09:46:47.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 -- start start 2023-09-13T09:46:47.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 Processor -- start 2023-09-13T09:46:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bc09df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bc0a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bc10ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.272+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bc113e0 con 0x56180bba6060 2023-09-13T09:46:47.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bc11520 con 0x56180bba4a00 2023-09-13T09:46:47.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f4a1f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56180bc116b0 con 0x56180bba5700 2023-09-13T09:46:47.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f4a1f2b80 10 client.0 _ll_register_callbacks cb 0x56180ba92680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:47.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bc09df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f37fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bc10ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bc09df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60204/0 (socket says 172.21.15.6:60204) 2023-09-13T09:46:47.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 -- 172.21.15.6:0/1119033583 learned_addr learned my addr 172.21.15.6:0/1119033583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bc0a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 -- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 msgr2=0x56180bc0a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bc0a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 -- 172.21.15.6:0/1119033583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 msgr2=0x56180bc10ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bc10ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 -- 172.21.15.6:0/1119033583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56180bb0e7a0 con 0x56180bba4a00 2023-09-13T09:46:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f377fe700 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bc09df0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f28095fb0 tx=0x7f2f2809d1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49e3fcec86557441 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f16ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f16ffd700 1 -- 172.21.15.6:0/1119033583 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f28099540 con 0x56180bba4a00 2023-09-13T09:46:47.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f16ffd700 1 -- 172.21.15.6:0/1119033583 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2f28064080 con 0x56180bba4a00 2023-09-13T09:46:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.273+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2f300076e0 con 0x56180bba4a00 2023-09-13T09:46:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f16ffd700 1 -- 172.21.15.6:0/1119033583 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2f2809d370 con 0x56180bba4a00 2023-09-13T09:46:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 10 client.26783 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56180b90bc60 con 0x56180bba4a00 2023-09-13T09:46:47.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f16ffd700 1 -- 172.21.15.6:0/1119033583 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2f280a5020 con 0x56180bba4a00 2023-09-13T09:46:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f16ffd700 1 -- 172.21.15.6:0/1119033583 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2f28004220 con 0x56180bba4a00 2023-09-13T09:46:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 10 client.26783 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 10 client.26783 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:46:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 20 client.26783 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:47.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bc14ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 4 client.26783 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56180bab0050 con 0x56180bbb9d80 2023-09-13T09:46:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bc14ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f16ffd700 10 client.26783 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.274+0000 7f2f2ffff700 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bc14ab0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=49b86794ac5040a4 server_cookie=febf97652dde8b49 in_seq=0 out_seq=0 2023-09-13T09:46:47.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f16ffd700 1 -- 172.21.15.6:0/1119033583 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56180bab0050 con 0x56180bbb9d80 2023-09-13T09:46:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f16ffd700 10 client.26783 handle_command_reply: tid=0 2023-09-13T09:46:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 client.26783 shutdown 2023-09-13T09:46:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 msgr2=0x56180bc09df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bc09df0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f28095fb0 tx=0x7f2f2809d1f0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 shutdown_connections 2023-09-13T09:46:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56180bbb9d80 0x56180bc14ab0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56180bba6060 0x56180bc10ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56180bba4a00 0x56180bc09df0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 --2- 172.21.15.6:0/1119033583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56180bba5700 0x56180bc0a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f16ffd700 0 client.26783 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:46:47.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 >> 172.21.15.6:0/1119033583 conn(0x56180bb02c80 msgr2=0x56180bbadcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 shutdown_connections 2023-09-13T09:46:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 1 -- 172.21.15.6:0/1119033583 wait complete. 2023-09-13T09:46:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.275+0000 7f2f4a1f2b80 20 client.26783 trim_cache size 0 max 16384 2023-09-13T09:46:47.299 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2f240a0640 msgr2=0x7f2f240a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2f240a0640 0x7f2f240a2b00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f2f20009c60 tx=0x7f2f20009260 comp rx=0 tx=0).stop 2023-09-13T09:46:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f380ff080 msgr2=0x7f2f38196be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f380ff080 0x7f2f38196be0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800e970 tx=0x7f2f2800ec80 comp rx=0 tx=0).stop 2023-09-13T09:46:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 shutdown_connections 2023-09-13T09:46:47.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2f381029f0 0x7f2f3819e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2f240a0640 0x7f2f240a2b00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f380ff080 0x7f2f38196be0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 --2- 172.21.15.6:0/3670085541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f38102050 0x7f2f38197120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 >> 172.21.15.6:0/3670085541 conn(0x7f2f380fa9b0 msgr2=0x7f2f380fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 shutdown_connections 2023-09-13T09:46:47.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.276+0000 7f2f3e00d700 1 -- 172.21.15.6:0/3670085541 wait complete. 2023-09-13T09:46:47.303 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:46:47.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 -- 172.21.15.6:0/133476120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b41013c0 msgr2=0x7f25b41017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 --2- 172.21.15.6:0/133476120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b41013c0 0x7f25b41017e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f25a8009990 tx=0x7f25a8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 -- 172.21.15.6:0/133476120 shutdown_connections 2023-09-13T09:46:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 --2- 172.21.15.6:0/133476120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25b4100290 0x7f25b4108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 --2- 172.21.15.6:0/133476120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b41013c0 0x7f25b41017e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 --2- 172.21.15.6:0/133476120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b40ff8f0 0x7f25b40ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 -- 172.21.15.6:0/133476120 >> 172.21.15.6:0/133476120 conn(0x7f25b40fb250 msgr2=0x7f25b40fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 -- 172.21.15.6:0/133476120 shutdown_connections 2023-09-13T09:46:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.436+0000 7f25bab0f700 1 -- 172.21.15.6:0/133476120 wait complete. 2023-09-13T09:46:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 Processor -- start 2023-09-13T09:46:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 -- start start 2023-09-13T09:46:47.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40ff8f0 0x7f25b40698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25b4100290 0x7f25b419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b41013c0 0x7f25b419df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b419e6c0 con 0x7f25b40ff8f0 2023-09-13T09:46:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b419e830 con 0x7f25b41013c0 2023-09-13T09:46:47.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25bab0f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b419e9f0 con 0x7f25b4100290 2023-09-13T09:46:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25b88ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40ff8f0 0x7f25b40698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25b88ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40ff8f0 0x7f25b40698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38462/0 (socket says 172.21.15.6:38462) 2023-09-13T09:46:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25b88ab700 1 -- 172.21.15.6:0/1937755243 learned_addr learned my addr 172.21.15.6:0/1937755243 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25b3fff700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25b4100290 0x7f25b419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.437+0000 7f25b90ac700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b41013c0 0x7f25b419df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b88ab700 1 -- 172.21.15.6:0/1937755243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25b4100290 msgr2=0x7f25b419b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b88ab700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25b4100290 0x7f25b419b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b88ab700 1 -- 172.21.15.6:0/1937755243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b41013c0 msgr2=0x7f25b419df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b88ab700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b41013c0 0x7f25b419df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b88ab700 1 -- 172.21.15.6:0/1937755243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a0009520 con 0x7f25b40ff8f0 2023-09-13T09:46:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b88ab700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40ff8f0 0x7f25b40698e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f25a800b680 tx=0x7f25a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b1ffb700 1 -- 172.21.15.6:0/1937755243 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a801d070 con 0x7f25b40ff8f0 2023-09-13T09:46:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b1ffb700 1 -- 172.21.15.6:0/1937755243 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25a80054f0 con 0x7f25b40ff8f0 2023-09-13T09:46:47.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a80095f0 con 0x7f25b40ff8f0 2023-09-13T09:46:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25b1ffb700 1 -- 172.21.15.6:0/1937755243 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a8004be0 con 0x7f25b40ff8f0 2023-09-13T09:46:47.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.438+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b419eea0 con 0x7f25b40ff8f0 2023-09-13T09:46:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.441+0000 7f25b1ffb700 1 -- 172.21.15.6:0/1937755243 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f25a800fbc0 con 0x7f25b40ff8f0 2023-09-13T09:46:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.442+0000 7f25b1ffb700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25a40a0640 0x7f25a40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.442+0000 7f25b1ffb700 1 -- 172.21.15.6:0/1937755243 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f25a80cce30 con 0x7f25b40ff8f0 2023-09-13T09:46:47.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.442+0000 7f25b3fff700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25a40a0640 0x7f25a40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.442+0000 7f25b3fff700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25a40a0640 0x7f25a40a2b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009df0 tx=0x7f25a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.442+0000 7f25c6cf4b80 1 Processor -- start 2023-09-13T09:46:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.442+0000 7f25c6cf4b80 1 -- start start 2023-09-13T09:46:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab35700 0x56409ab35b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab34e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409aa8d780 con 0x56409ab36060 2023-09-13T09:46:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409aa8b0a0 con 0x56409ab34a00 2023-09-13T09:46:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409aa86990 con 0x56409ab35700 2023-09-13T09:46:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab344c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38472/0 (socket says 172.21.15.6:38472) 2023-09-13T09:46:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 -- 172.21.15.6:0/3013980286 learned_addr learned my addr 172.21.15.6:0/3013980286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b90ac700 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab34e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b88ab700 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab35700 0x56409ab35b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 -- 172.21.15.6:0/3013980286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab35700 msgr2=0x56409ab35b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab35700 0x56409ab35b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 -- 172.21.15.6:0/3013980286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 msgr2=0x56409ab34e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab34e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 -- 172.21.15.6:0/3013980286 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56409a906630 con 0x56409ab36060 2023-09-13T09:46:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b90ac700 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab34e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:47.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f25b3fff700 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab344c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f25a00094f0 tx=0x7f25a0014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f734e99a88d965de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.443+0000 7f259effd700 1 -- 172.21.15.6:0/3013980286 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0026630 con 0x56409ab36060 2023-09-13T09:46:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f259effd700 1 -- 172.21.15.6:0/3013980286 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25a0021070 con 0x56409ab36060 2023-09-13T09:46:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f259effd700 1 -- 172.21.15.6:0/3013980286 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a001d690 con 0x56409ab36060 2023-09-13T09:46:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3013980286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 msgr2=0x56409ab344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab344c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f25a00094f0 tx=0x7f25a0014000 comp rx=0 tx=0).stop 2023-09-13T09:46:47.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3013980286 shutdown_connections 2023-09-13T09:46:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab34e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab35700 0x56409ab35b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3013980286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab344c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3013980286 >> 172.21.15.6:0/3013980286 conn(0x56409aa92c80 msgr2=0x56409ab2ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3013980286 shutdown_connections 2023-09-13T09:46:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.444+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3013980286 wait complete. 2023-09-13T09:46:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 -- start start 2023-09-13T09:46:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 Processor -- start 2023-09-13T09:46:47.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab34a00 0x56409ab3def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab3e430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab49880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409aa24bb0 con 0x56409ab34a00 2023-09-13T09:46:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409aa248b0 con 0x56409ab35700 2023-09-13T09:46:47.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409a908920 con 0x56409ab36060 2023-09-13T09:46:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25c6cf4b80 10 client.0 _ll_register_callbacks cb 0x56409aa22680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab3e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25b90ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab49880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab3e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60234/0 (socket says 172.21.15.6:60234) 2023-09-13T09:46:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.445+0000 7f25b3fff700 1 -- 172.21.15.6:0/2201695871 learned_addr learned my addr 172.21.15.6:0/2201695871 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25b90ac700 1 -- 172.21.15.6:0/2201695871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 msgr2=0x56409ab3e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25b90ac700 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab3e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25b90ac700 1 -- 172.21.15.6:0/2201695871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab34a00 msgr2=0x56409ab3def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25b90ac700 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab34a00 0x56409ab3def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25b90ac700 1 -- 172.21.15.6:0/2201695871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a0017070 con 0x56409ab36060 2023-09-13T09:46:47.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25b90ac700 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab49880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25ac004070 tx=0x7f25ac0040a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10a30ec2bfb06016 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f2593fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:46:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f2593fff700 1 -- 172.21.15.6:0/2201695871 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac007710 con 0x56409ab36060 2023-09-13T09:46:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f2593fff700 1 -- 172.21.15.6:0/2201695871 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f25ac007870 con 0x56409ab36060 2023-09-13T09:46:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56409ab27670 con 0x56409ab36060 2023-09-13T09:46:47.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f2593fff700 1 -- 172.21.15.6:0/2201695871 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25ac007a30 con 0x56409ab36060 2023-09-13T09:46:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25c6cf4b80 10 client.26728 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56409aa9e7a0 con 0x56409ab36060 2023-09-13T09:46:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.446+0000 7f2593fff700 1 -- 172.21.15.6:0/2201695871 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56409ab27670 con 0x56409ab36060 2023-09-13T09:46:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f2593fff700 1 -- 172.21.15.6:0/2201695871 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f25ac016cf0 con 0x56409ab36060 2023-09-13T09:46:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25c6cf4b80 10 client.26728 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:47.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25c6cf4b80 10 client.26728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25c6cf4b80 20 client.26728 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409ab505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25c6cf4b80 4 client.26728 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56409aa7f970 con 0x56409ab4e1d0 2023-09-13T09:46:47.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25b88ab700 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409ab505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f2593fff700 10 client.26728 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:47.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.447+0000 7f25b88ab700 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409ab505f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f5f443bd174cf2d server_cookie=5488332ba18f6a61 in_seq=0 out_seq=0 2023-09-13T09:46:47.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f2593fff700 1 -- 172.21.15.6:0/2201695871 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56409aa7f970 con 0x56409ab4e1d0 2023-09-13T09:46:47.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f2593fff700 10 client.26728 handle_command_reply: tid=0 2023-09-13T09:46:47.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 client.26728 shutdown 2023-09-13T09:46:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 msgr2=0x56409ab49880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab49880 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f25ac004070 tx=0x7f25ac0040a0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 shutdown_connections 2023-09-13T09:46:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab49880 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409ab505f0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab34a00 0x56409ab3def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f2593fff700 0 client.26728 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/2201695871 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab3e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 >> 172.21.15.6:0/2201695871 conn(0x56409aa92c80 msgr2=0x56409ab297f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 shutdown_connections 2023-09-13T09:46:47.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/2201695871 wait complete. 2023-09-13T09:46:47.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.449+0000 7f25c6cf4b80 20 client.26728 trim_cache size 0 max 16384 2023-09-13T09:46:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.463+0000 7f25c6cf4b80 1 Processor -- start 2023-09-13T09:46:47.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.463+0000 7f25c6cf4b80 1 -- start start 2023-09-13T09:46:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.463+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.463+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab35700 0x56409ab49880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.463+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab5ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409ab4b600 con 0x56409ab35700 2023-09-13T09:46:47.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409ab5e340 con 0x56409ab34a00 2023-09-13T09:46:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409ab3bb60 con 0x56409ab36060 2023-09-13T09:46:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab35700 0x56409ab49880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab35700 0x56409ab49880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38486/0 (socket says 172.21.15.6:38486) 2023-09-13T09:46:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b88ab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 -- 172.21.15.6:0/3014969994 learned_addr learned my addr 172.21.15.6:0/3014969994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b90ac700 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab5ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 -- 172.21.15.6:0/3014969994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 msgr2=0x56409ab5ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab5ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 -- 172.21.15.6:0/3014969994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 msgr2=0x56409ab344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab344c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 -- 172.21.15.6:0/3014969994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56409a8b2de0 con 0x56409ab35700 2023-09-13T09:46:47.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b88ab700 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:47.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b90ac700 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab5ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:47.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f25b3fff700 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab35700 0x56409ab49880 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f25a00058e0 tx=0x7f25a000e440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=148abb926e168692 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f259f7fe700 1 -- 172.21.15.6:0/3014969994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a000ee70 con 0x56409ab35700 2023-09-13T09:46:47.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f259f7fe700 1 -- 172.21.15.6:0/3014969994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25a00092f0 con 0x56409ab35700 2023-09-13T09:46:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.464+0000 7f259f7fe700 1 -- 172.21.15.6:0/3014969994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00056e0 con 0x56409ab35700 2023-09-13T09:46:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3014969994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab35700 msgr2=0x56409ab49880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab35700 0x56409ab49880 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f25a00058e0 tx=0x7f25a000e440 comp rx=0 tx=0).stop 2023-09-13T09:46:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3014969994 shutdown_connections 2023-09-13T09:46:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab36060 0x56409ab5ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab34a00 0x56409ab344c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3014969994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab35700 0x56409ab49880 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3014969994 >> 172.21.15.6:0/3014969994 conn(0x56409aa92c80 msgr2=0x56409ab34de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3014969994 shutdown_connections 2023-09-13T09:46:47.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3014969994 wait complete. 2023-09-13T09:46:47.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 -- start start 2023-09-13T09:46:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.465+0000 7f25c6cf4b80 1 Processor -- start 2023-09-13T09:46:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab34a00 0x56409ab5af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab5b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25c6cf4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab5c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409ab5ca00 con 0x56409ab36060 2023-09-13T09:46:47.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409ab5cb70 con 0x56409ab35700 2023-09-13T09:46:47.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25c6cf4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56409ab5cd30 con 0x56409ab34a00 2023-09-13T09:46:47.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25c6cf4b80 10 client.0 _ll_register_callbacks cb 0x56409aa22680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:47.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab5c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab5b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab5c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38494/0 (socket says 172.21.15.6:38494) 2023-09-13T09:46:47.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 -- 172.21.15.6:0/3419772909 learned_addr learned my addr 172.21.15.6:0/3419772909 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:47.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b88ab700 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab34a00 0x56409ab5af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 -- 172.21.15.6:0/3419772909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab34a00 msgr2=0x56409ab5af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab34a00 0x56409ab5af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 -- 172.21.15.6:0/3419772909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 msgr2=0x56409ab5b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:47.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab5b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 -- 172.21.15.6:0/3419772909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b419eea0 con 0x56409ab36060 2023-09-13T09:46:47.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f25b90ac700 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab5c4c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x56409ab2fa00 tx=0x7f25ac003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182f930a55ff3aff server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:47.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.466+0000 7f2593fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f2593fff700 1 -- 172.21.15.6:0/3419772909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac01ec30 con 0x56409ab36060 2023-09-13T09:46:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25a0021070 con 0x56409ab36060 2023-09-13T09:46:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f2593fff700 1 -- 172.21.15.6:0/3419772909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f25ac01ed90 con 0x56409ab36060 2023-09-13T09:46:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f2593fff700 1 -- 172.21.15.6:0/3419772909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25ac007710 con 0x56409ab36060 2023-09-13T09:46:47.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 10 client.17388 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:47.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f25a002a040 con 0x56409ab36060 2023-09-13T09:46:47.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f2593fff700 1 -- 172.21.15.6:0/3419772909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25a0021070 con 0x56409ab36060 2023-09-13T09:46:47.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f2593fff700 1 -- 172.21.15.6:0/3419772909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f25ac01f930 con 0x56409ab36060 2023-09-13T09:46:47.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 10 client.17388 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:47.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 10 client.17388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 20 client.17388 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409aba4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 4 client.17388 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:46:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56409aa40050 con 0x56409ab4e1d0 2023-09-13T09:46:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.467+0000 7f25b88ab700 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409aba4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.468+0000 7f2593fff700 10 client.17388 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.468+0000 7f25b88ab700 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409aba4a60 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aecf71cc2f350978 server_cookie=8f3be6cf0e6f034d in_seq=0 out_seq=0 2023-09-13T09:46:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f2593fff700 1 -- 172.21.15.6:0/3419772909 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56409aa40050 con 0x56409ab4e1d0 2023-09-13T09:46:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f2593fff700 10 client.17388 handle_command_reply: tid=0 2023-09-13T09:46:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 client.17388 shutdown 2023-09-13T09:46:47.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 msgr2=0x56409ab5c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab5c4c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x56409ab2fa00 tx=0x7f25ac003f90 comp rx=0 tx=0).stop 2023-09-13T09:46:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 shutdown_connections 2023-09-13T09:46:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56409ab4e1d0 0x56409aba4a60 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56409ab36060 0x56409ab5c4c0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56409ab34a00 0x56409ab5af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 --2- 172.21.15.6:0/3419772909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56409ab35700 0x56409ab5b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f2593fff700 0 client.17388 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 >> 172.21.15.6:0/3419772909 conn(0x56409aa92c80 msgr2=0x56409ab2ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 shutdown_connections 2023-09-13T09:46:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 1 -- 172.21.15.6:0/3419772909 wait complete. 2023-09-13T09:46:47.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25c6cf4b80 20 client.17388 trim_cache size 0 max 16384 2023-09-13T09:46:47.491 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:46:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25a40a0640 msgr2=0x7f25a40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.469+0000 7f25bab0f700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25a40a0640 0x7f25a40a2b00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f25a0009df0 tx=0x7f25a0009260 comp rx=0 tx=0).stop 2023-09-13T09:46:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40ff8f0 msgr2=0x7f25b40698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40ff8f0 0x7f25b40698e0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f25a800b680 tx=0x7f25a8004730 comp rx=0 tx=0).stop 2023-09-13T09:46:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 shutdown_connections 2023-09-13T09:46:47.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25b41013c0 0x7f25b419df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25a40a0640 0x7f25a40a2b00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25b40ff8f0 0x7f25b40698e0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 --2- 172.21.15.6:0/1937755243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25b4100290 0x7f25b419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:47.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 >> 172.21.15.6:0/1937755243 conn(0x7f25b40fb250 msgr2=0x7f25b40fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 shutdown_connections 2023-09-13T09:46:47.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:47.470+0000 7f25bab0f700 1 -- 172.21.15.6:0/1937755243 wait complete. 2023-09-13T09:46:48.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 302761 4.56 MB/sec execute 248 sec latency 44.819 ms 2023-09-13T09:46:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:47 smithi053 ceph-mon[102373]: pgmap v518: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 2.5 MiB/s wr, 275 op/s 2023-09-13T09:46:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:47 smithi006 ceph-mon[98665]: pgmap v518: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 2.5 MiB/s wr, 275 op/s 2023-09-13T09:46:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:47 smithi131 ceph-mon[102785]: pgmap v518: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1020 KiB/s rd, 2.5 MiB/s wr, 275 op/s 2023-09-13T09:46:48.495 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:46:48.496 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:46:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.631+0000 7f0a67da5700 1 -- 172.21.15.6:0/2057119677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60100eb0 msgr2=0x7f0a60101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.631+0000 7f0a67da5700 1 --2- 172.21.15.6:0/2057119677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60100eb0 0x7f0a60101310 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0a500099c0 tx=0x7f0a50009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 -- 172.21.15.6:0/2057119677 shutdown_connections 2023-09-13T09:46:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 --2- 172.21.15.6:0/2057119677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a60101850 0x7f0a60108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 --2- 172.21.15.6:0/2057119677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a600ffcc0 0x7f0a601000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 --2- 172.21.15.6:0/2057119677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60100eb0 0x7f0a60101310 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 -- 172.21.15.6:0/2057119677 >> 172.21.15.6:0/2057119677 conn(0x7f0a600fb250 msgr2=0x7f0a600fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 -- 172.21.15.6:0/2057119677 shutdown_connections 2023-09-13T09:46:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 -- 172.21.15.6:0/2057119677 wait complete. 2023-09-13T09:46:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 Processor -- start 2023-09-13T09:46:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.632+0000 7f0a67da5700 1 -- start start 2023-09-13T09:46:48.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a600ffcc0 0x7f0a60198ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a60100eb0 0x7f0a601991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60101850 0x7f0a601a0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601a0810 con 0x7f0a60101850 2023-09-13T09:46:48.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601a0980 con 0x7f0a60100eb0 2023-09-13T09:46:48.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a601a0b40 con 0x7f0a600ffcc0 2023-09-13T09:46:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60101850 0x7f0a601a0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a600ffcc0 0x7f0a60198ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60101850 0x7f0a601a0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38508/0 (socket says 172.21.15.6:38508) 2023-09-13T09:46:48.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 -- 172.21.15.6:0/3816667854 learned_addr learned my addr 172.21.15.6:0/3816667854 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a65340700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a60100eb0 0x7f0a601991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 -- 172.21.15.6:0/3816667854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a600ffcc0 msgr2=0x7f0a60198ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a600ffcc0 0x7f0a60198ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 -- 172.21.15.6:0/3816667854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a60100eb0 msgr2=0x7f0a601991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a60100eb0 0x7f0a601991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 -- 172.21.15.6:0/3816667854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a500095f0 con 0x7f0a60101850 2023-09-13T09:46:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a65b41700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a600ffcc0 0x7f0a60198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a66342700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60101850 0x7f0a601a0240 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0a58007ee0 tx=0x7f0a5800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a56ffd700 1 -- 172.21.15.6:0/3816667854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58017070 con 0x7f0a60101850 2023-09-13T09:46:48.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a56ffd700 1 -- 172.21.15.6:0/3816667854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a5800f040 con 0x7f0a60101850 2023-09-13T09:46:48.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a56ffd700 1 -- 172.21.15.6:0/3816667854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58005580 con 0x7f0a60101850 2023-09-13T09:46:48.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a601a0e20 con 0x7f0a60101850 2023-09-13T09:46:48.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.633+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a601a1250 con 0x7f0a60101850 2023-09-13T09:46:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.636+0000 7f0a56ffd700 1 -- 172.21.15.6:0/3816667854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0a5800db20 con 0x7f0a60101850 2023-09-13T09:46:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.636+0000 7f0a56ffd700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0a4c0a0640 0x7f0a4c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a65b41700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0a4c0a0640 0x7f0a4c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a56ffd700 1 -- 172.21.15.6:0/3816667854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0a580cb3c0 con 0x7f0a60101850 2023-09-13T09:46:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 Processor -- start 2023-09-13T09:46:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 -- start start 2023-09-13T09:46:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a65b41700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0a4c0a0640 0x7f0a4c0a2b00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0a60199b70 tx=0x7f0a5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e8463dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8463c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e8463cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e84595800 con 0x556e8463d780 2023-09-13T09:46:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e84593120 con 0x556e8463e0e0 2023-09-13T09:46:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8458ea10 con 0x556e8463ca80 2023-09-13T09:46:48.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e8463dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e8463dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38512/0 (socket says 172.21.15.6:38512) 2023-09-13T09:46:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a65340700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8463c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a65b41700 1 -- 172.21.15.6:0/514517932 learned_addr learned my addr 172.21.15.6:0/514517932 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.637+0000 7f0a66342700 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e8463cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a66342700 1 -- 172.21.15.6:0/514517932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 msgr2=0x556e8463c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a66342700 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8463c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a66342700 1 -- 172.21.15.6:0/514517932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 msgr2=0x556e8463dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a66342700 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e8463dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a66342700 1 -- 172.21.15.6:0/514517932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e8440e6b0 con 0x556e8463ca80 2023-09-13T09:46:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a65340700 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8463c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a65b41700 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e8463dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a66342700 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e8463cf00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0a58020000 tx=0x7f0a58021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b88b8057bb02ebed server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a4bfff700 1 -- 172.21.15.6:0/514517932 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a580a0b70 con 0x556e8463ca80 2023-09-13T09:46:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a4bfff700 1 -- 172.21.15.6:0/514517932 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a58096c40 con 0x556e8463ca80 2023-09-13T09:46:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.638+0000 7f0a4bfff700 1 -- 172.21.15.6:0/514517932 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a58022450 con 0x556e8463ca80 2023-09-13T09:46:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/514517932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 msgr2=0x556e8463cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e8463cf00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0a58020000 tx=0x7f0a58021000 comp rx=0 tx=0).stop 2023-09-13T09:46:48.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/514517932 shutdown_connections 2023-09-13T09:46:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e8463cf00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e8463dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/514517932 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8463c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/514517932 >> 172.21.15.6:0/514517932 conn(0x556e8459ad00 msgr2=0x556e84636f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/514517932 shutdown_connections 2023-09-13T09:46:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/514517932 wait complete. 2023-09-13T09:46:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 -- start start 2023-09-13T09:46:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.639+0000 7f0a73f8ab80 1 Processor -- start 2023-09-13T09:46:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e84646040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e84646580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8464d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8452cc30 con 0x556e8463d780 2023-09-13T09:46:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8452c930 con 0x556e8463e0e0 2023-09-13T09:46:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e844109a0 con 0x556e8463ca80 2023-09-13T09:46:48.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a73f8ab80 10 client.0 _ll_register_callbacks cb 0x556e8452a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e84646580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e84646040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e84646580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38520/0 (socket says 172.21.15.6:38520) 2023-09-13T09:46:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 -- 172.21.15.6:0/2063974477 learned_addr learned my addr 172.21.15.6:0/2063974477 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a66342700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8464d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 -- 172.21.15.6:0/2063974477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 msgr2=0x556e84646040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e84646040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 -- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 msgr2=0x556e8464d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8464d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65340700 1 -- 172.21.15.6:0/2063974477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a601a1250 con 0x556e8463d780 2023-09-13T09:46:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a65b41700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e84646040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.640+0000 7f0a66342700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8464d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a65340700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e84646580 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0a500058e0 tx=0x7f0a50005ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326bfe80567409aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a497fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:48.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a497fa700 1 -- 172.21.15.6:0/2063974477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a50003da0 con 0x556e8463d780 2023-09-13T09:46:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e8462f6f0 con 0x556e8463d780 2023-09-13T09:46:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a497fa700 1 -- 172.21.15.6:0/2063974477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0a50005040 con 0x556e8463d780 2023-09-13T09:46:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a497fa700 1 -- 172.21.15.6:0/2063974477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a50005200 con 0x556e8463d780 2023-09-13T09:46:48.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 10 client.17400 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x556e845a6820 con 0x556e8463d780 2023-09-13T09:46:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a497fa700 1 -- 172.21.15.6:0/2063974477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a50033080 con 0x556e8463d780 2023-09-13T09:46:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a497fa700 1 -- 172.21.15.6:0/2063974477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0a50024b30 con 0x556e8463d780 2023-09-13T09:46:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 10 client.17400 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:48.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 10 client.17400 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 20 client.17400 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e84651ee0 0x556e84654300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 4 client.17400 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.641+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e845879f0 con 0x556e84651ee0 2023-09-13T09:46:48.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.642+0000 7f0a65b41700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e84651ee0 0x556e84654300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.642+0000 7f0a497fa700 10 client.17400 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.642+0000 7f0a65b41700 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e84651ee0 0x556e84654300 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef4e813ad8d653a9 server_cookie=45900c9a5217c077 in_seq=0 out_seq=0 2023-09-13T09:46:48.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a497fa700 1 -- 172.21.15.6:0/2063974477 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556e845879f0 con 0x556e84651ee0 2023-09-13T09:46:48.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a497fa700 10 client.17400 handle_command_reply: tid=0 2023-09-13T09:46:48.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 client.17400 shutdown 2023-09-13T09:46:48.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 msgr2=0x556e84646580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e84646580 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f0a500058e0 tx=0x7f0a50005ad0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 shutdown_connections 2023-09-13T09:46:48.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463e0e0 0x556e8464d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463ca80 0x556e84646040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e84651ee0 0x556e84654300 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2063974477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463d780 0x556e84646580 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 >> 172.21.15.6:0/2063974477 conn(0x556e8459ad00 msgr2=0x556e84636f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a497fa700 0 client.17400 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 shutdown_connections 2023-09-13T09:46:48.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2063974477 wait complete. 2023-09-13T09:46:48.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.643+0000 7f0a73f8ab80 20 client.17400 trim_cache size 0 max 16384 2023-09-13T09:46:48.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 Processor -- start 2023-09-13T09:46:48.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 -- start start 2023-09-13T09:46:48.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463ca80 0x556e8463c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463d780 0x556e8464d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463e0e0 0x556e84630960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e846471c0 con 0x556e8463e0e0 2023-09-13T09:46:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e84646cc0 con 0x556e8463ca80 2023-09-13T09:46:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e84643ca0 con 0x556e8463d780 2023-09-13T09:46:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a66342700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463e0e0 0x556e84630960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463ca80 0x556e8463c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a66342700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463e0e0 0x556e84630960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38530/0 (socket says 172.21.15.6:38530) 2023-09-13T09:46:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463ca80 0x556e8463c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60282/0 (socket says 172.21.15.6:60282) 2023-09-13T09:46:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a66342700 1 -- 172.21.15.6:0/4070474294 learned_addr learned my addr 172.21.15.6:0/4070474294 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.661+0000 7f0a65340700 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463d780 0x556e8464d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a65b41700 1 -- 172.21.15.6:0/4070474294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463d780 msgr2=0x556e8464d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a65b41700 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463d780 0x556e8464d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a65b41700 1 -- 172.21.15.6:0/4070474294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463e0e0 msgr2=0x556e84630960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a65b41700 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463e0e0 0x556e84630960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a65b41700 1 -- 172.21.15.6:0/4070474294 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e843bae60 con 0x556e8463ca80 2023-09-13T09:46:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a66342700 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463e0e0 0x556e84630960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a65b41700 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463ca80 0x556e8463c540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x556e846548e0 tx=0x7f0a5c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=194ee45f2fab3db8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a54ff9700 1 -- 172.21.15.6:0/4070474294 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c024040 con 0x556e8463ca80 2023-09-13T09:46:48.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a54ff9700 1 -- 172.21.15.6:0/4070474294 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0a5c0295b0 con 0x556e8463ca80 2023-09-13T09:46:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.662+0000 7f0a54ff9700 1 -- 172.21.15.6:0/4070474294 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c004ea0 con 0x556e8463ca80 2023-09-13T09:46:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/4070474294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463ca80 msgr2=0x556e8463c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463ca80 0x556e8463c540 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x556e846548e0 tx=0x7f0a5c014000 comp rx=0 tx=0).stop 2023-09-13T09:46:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/4070474294 shutdown_connections 2023-09-13T09:46:48.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463e0e0 0x556e84630960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463ca80 0x556e8463c540 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/4070474294 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463d780 0x556e8464d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/4070474294 >> 172.21.15.6:0/4070474294 conn(0x556e8459ad00 msgr2=0x556e84640a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/4070474294 shutdown_connections 2023-09-13T09:46:48.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/4070474294 wait complete. 2023-09-13T09:46:48.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 -- start start 2023-09-13T09:46:48.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.663+0000 7f0a73f8ab80 1 Processor -- start 2023-09-13T09:46:48.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463ca80 0x556e8464a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463d780 0x556e8464a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a73f8ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463e0e0 0x556e846a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8464d7c0 con 0x556e8463ca80 2023-09-13T09:46:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e8464d930 con 0x556e8463d780 2023-09-13T09:46:48.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a73f8ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e846a6240 con 0x556e8463e0e0 2023-09-13T09:46:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a73f8ab80 10 client.0 _ll_register_callbacks cb 0x556e8452a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463ca80 0x556e8464a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463ca80 0x556e8464a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38532/0 (socket says 172.21.15.6:38532) 2023-09-13T09:46:48.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 -- 172.21.15.6:0/2394944956 learned_addr learned my addr 172.21.15.6:0/2394944956 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65340700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463d780 0x556e8464a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a66342700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463e0e0 0x556e846a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 -- 172.21.15.6:0/2394944956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463e0e0 msgr2=0x556e846a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463e0e0 0x556e846a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 -- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463d780 msgr2=0x556e8464a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463d780 0x556e8464a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65b41700 1 -- 172.21.15.6:0/2394944956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556e8440e6b0 con 0x556e8463ca80 2023-09-13T09:46:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a65340700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463d780 0x556e8464a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.664+0000 7f0a66342700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463e0e0 0x556e846a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a65b41700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463ca80 0x556e8464a260 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c004800 tx=0x7f0a5c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e6c7e8d9025a6b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a497fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a497fa700 1 -- 172.21.15.6:0/2394944956 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c024040 con 0x556e8463ca80 2023-09-13T09:46:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a497fa700 1 -- 172.21.15.6:0/2394944956 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0a5c029900 con 0x556e8463ca80 2023-09-13T09:46:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e845480d0 con 0x556e8463ca80 2023-09-13T09:46:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a497fa700 1 -- 172.21.15.6:0/2394944956 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a5c0295b0 con 0x556e8463ca80 2023-09-13T09:46:48.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 10 client.17406 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f0a5c003900 con 0x556e8463ca80 2023-09-13T09:46:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a497fa700 1 -- 172.21.15.6:0/2394944956 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556e845480d0 con 0x556e8463ca80 2023-09-13T09:46:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a497fa700 1 -- 172.21.15.6:0/2394944956 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0a5c02f020 con 0x556e8463ca80 2023-09-13T09:46:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 10 client.17406 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:48.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 10 client.17406 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 20 client.17406 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e846a7d50 0x556e846aa170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 4 client.17406 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:46:48.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.665+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556e843dbff0 con 0x556e846a7d50 2023-09-13T09:46:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.666+0000 7f0a65340700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e846a7d50 0x556e846aa170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.666+0000 7f0a497fa700 10 client.17406 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.666+0000 7f0a65340700 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e846a7d50 0x556e846aa170 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be2a3d0115703730 server_cookie=f7a75b8b3a3ca8fe in_seq=0 out_seq=0 2023-09-13T09:46:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a497fa700 1 -- 172.21.15.6:0/2394944956 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556e843dbff0 con 0x556e846a7d50 2023-09-13T09:46:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a497fa700 10 client.17406 handle_command_reply: tid=0 2023-09-13T09:46:48.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 client.17406 shutdown 2023-09-13T09:46:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463ca80 msgr2=0x556e8464a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463ca80 0x556e8464a260 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c004800 tx=0x7f0a5c003f90 comp rx=0 tx=0).stop 2023-09-13T09:46:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 shutdown_connections 2023-09-13T09:46:48.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e8463e0e0 0x556e846a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556e846a7d50 0x556e846aa170 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e8463ca80 0x556e8464a260 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 --2- 172.21.15.6:0/2394944956 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e8463d780 0x556e8464a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 >> 172.21.15.6:0/2394944956 conn(0x556e8459ad00 msgr2=0x556e8463b530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.667+0000 7f0a497fa700 0 client.17406 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 shutdown_connections 2023-09-13T09:46:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a73f8ab80 1 -- 172.21.15.6:0/2394944956 wait complete. 2023-09-13T09:46:48.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a73f8ab80 20 client.17406 trim_cache size 0 max 16384 2023-09-13T09:46:48.697 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:46:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:46:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "1d31e102-6ca8-4f10-99fc-f5f4cff2a5ac", 2023-09-13T09:46:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:46:48.697 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:46:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0a4c0a0640 msgr2=0x7f0a4c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0a4c0a0640 0x7f0a4c0a2b00 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0a60199b70 tx=0x7f0a5c009260 comp rx=0 tx=0).stop 2023-09-13T09:46:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60101850 msgr2=0x7f0a601a0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60101850 0x7f0a601a0240 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f0a58007ee0 tx=0x7f0a5800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 shutdown_connections 2023-09-13T09:46:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0a4c0a0640 0x7f0a4c0a2b00 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0a60101850 0x7f0a601a0240 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a600ffcc0 0x7f0a60198ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 --2- 172.21.15.6:0/3816667854 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0a60100eb0 0x7f0a601991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 >> 172.21.15.6:0/3816667854 conn(0x7f0a600fb250 msgr2=0x7f0a600fbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 shutdown_connections 2023-09-13T09:46:48.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.668+0000 7f0a67da5700 1 -- 172.21.15.6:0/3816667854 wait complete. 2023-09-13T09:46:48.702 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:46:48.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 -- 172.21.15.6:0/1879429379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c00ffff0 msgr2=0x7f42c0100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 --2- 172.21.15.6:0/1879429379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c00ffff0 0x7f42c0100470 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099c0 tx=0x7f42b4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 -- 172.21.15.6:0/1879429379 shutdown_connections 2023-09-13T09:46:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 --2- 172.21.15.6:0/1879429379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42c01009b0 0x7f42c0100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 --2- 172.21.15.6:0/1879429379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 0x7f42c00ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 --2- 172.21.15.6:0/1879429379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c00ffff0 0x7f42c0100470 secure :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099c0 tx=0x7f42b4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 -- 172.21.15.6:0/1879429379 >> 172.21.15.6:0/1879429379 conn(0x7f42c00fb250 msgr2=0x7f42c00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 -- 172.21.15.6:0/1879429379 shutdown_connections 2023-09-13T09:46:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 -- 172.21.15.6:0/1879429379 wait complete. 2023-09-13T09:46:48.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.843+0000 7f42c604e700 1 Processor -- start 2023-09-13T09:46:48.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42c604e700 1 -- start start 2023-09-13T09:46:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42c604e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 0x7f42c0198f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42c604e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42c01009b0 0x7f42c0199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42c604e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c019e4a0 0x7f42c01a0890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42c604e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c01a0e60 con 0x7f42c019e4a0 2023-09-13T09:46:48.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42c604e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c01a0fa0 con 0x7f42c01009b0 2023-09-13T09:46:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42c604e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c01a1130 con 0x7f42c00ff690 2023-09-13T09:46:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 0x7f42c0198f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c019e4a0 0x7f42c01a0890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42beffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42c01009b0 0x7f42c0199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 0x7f42c0198f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41600/0 (socket says 172.21.15.6:41600) 2023-09-13T09:46:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 -- 172.21.15.6:0/1993883340 learned_addr learned my addr 172.21.15.6:0/1993883340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c019e4a0 0x7f42c01a0890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38550/0 (socket says 172.21.15.6:38550) 2023-09-13T09:46:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 -- 172.21.15.6:0/1993883340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42c01009b0 msgr2=0x7f42c0199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42c01009b0 0x7f42c0199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 -- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c019e4a0 msgr2=0x7f42c01a0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c019e4a0 0x7f42c01a0890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.844+0000 7f42bf7fe700 1 -- 172.21.15.6:0/1993883340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42b8009c40 con 0x7f42c00ff690 2023-09-13T09:46:48.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42beffd700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42c01009b0 0x7f42c0199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42bffff700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c019e4a0 0x7f42c01a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:46:48.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 0x7f42c0198f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42b000e9a0 tx=0x7f42b000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42bcff9700 1 -- 172.21.15.6:0/1993883340 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0009790 con 0x7f42c00ff690 2023-09-13T09:46:48.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42b40095f0 con 0x7f42c00ff690 2023-09-13T09:46:48.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42bcff9700 1 -- 172.21.15.6:0/1993883340 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42b000ce80 con 0x7f42c00ff690 2023-09-13T09:46:48.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42bcff9700 1 -- 172.21.15.6:0/1993883340 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b0018680 con 0x7f42c00ff690 2023-09-13T09:46:48.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.845+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c01a1790 con 0x7f42c00ff690 2023-09-13T09:46:48.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.847+0000 7f42bcff9700 1 -- 172.21.15.6:0/1993883340 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f42b0010430 con 0x7f42c00ff690 2023-09-13T09:46:48.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.848+0000 7f42bcff9700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42a80a0640 0x7f42a80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.848+0000 7f42beffd700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42a80a0640 0x7f42a80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.848+0000 7f42bcff9700 1 -- 172.21.15.6:0/1993883340 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f42b0014070 con 0x7f42c00ff690 2023-09-13T09:46:48.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42beffd700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42a80a0640 0x7f42a80a2b00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f42b40058e0 tx=0x7f42b401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42d2233b80 1 Processor -- start 2023-09-13T09:46:48.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42d2233b80 1 -- start start 2023-09-13T09:46:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71b700 0x559ffc71bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71c060 0x559ffc71a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71aa00 0x559ffc71ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42d2233b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc673780 con 0x559ffc71c060 2023-09-13T09:46:48.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.849+0000 7f42d2233b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc6710a0 con 0x559ffc71b700 2023-09-13T09:46:48.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42d2233b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc66c990 con 0x559ffc71aa00 2023-09-13T09:46:48.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71c060 0x559ffc71a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71c060 0x559ffc71a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38556/0 (socket says 172.21.15.6:38556) 2023-09-13T09:46:48.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 -- 172.21.15.6:0/2069606261 learned_addr learned my addr 172.21.15.6:0/2069606261 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42bffff700 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71aa00 0x559ffc71ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 -- 172.21.15.6:0/2069606261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71aa00 msgr2=0x559ffc71ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71b700 0x559ffc71bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71aa00 0x559ffc71ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 -- 172.21.15.6:0/2069606261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71b700 msgr2=0x559ffc71bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71b700 0x559ffc71bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 -- 172.21.15.6:0/2069606261 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ffc4ec630 con 0x559ffc71c060 2023-09-13T09:46:48.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42bffff700 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71aa00 0x559ffc71ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:46:48.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71b700 0x559ffc71bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:46:48.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42beffd700 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71c060 0x559ffc71a4c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f42b4015000 tx=0x7f42b4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42014bdbbe328a40 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42a5ffb700 1 -- 172.21.15.6:0/2069606261 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b402a070 con 0x559ffc71c060 2023-09-13T09:46:48.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42a5ffb700 1 -- 172.21.15.6:0/2069606261 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42b401e040 con 0x559ffc71c060 2023-09-13T09:46:48.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.850+0000 7f42a5ffb700 1 -- 172.21.15.6:0/2069606261 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b400f730 con 0x559ffc71c060 2023-09-13T09:46:48.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 -- 172.21.15.6:0/2069606261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71c060 msgr2=0x559ffc71a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71c060 0x559ffc71a4c0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f42b4015000 tx=0x7f42b4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 -- 172.21.15.6:0/2069606261 shutdown_connections 2023-09-13T09:46:48.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71aa00 0x559ffc71ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71b700 0x559ffc71bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2069606261 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71c060 0x559ffc71a4c0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 -- 172.21.15.6:0/2069606261 >> 172.21.15.6:0/2069606261 conn(0x559ffc678c80 msgr2=0x559ffc714f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 -- 172.21.15.6:0/2069606261 shutdown_connections 2023-09-13T09:46:48.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 -- 172.21.15.6:0/2069606261 wait complete. 2023-09-13T09:46:48.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.851+0000 7f42d2233b80 1 -- start start 2023-09-13T09:46:48.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 1 Processor -- start 2023-09-13T09:46:48.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc723ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71c060 0x559ffc72b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc60abb0 con 0x559ffc71b700 2023-09-13T09:46:48.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc60a8b0 con 0x559ffc71aa00 2023-09-13T09:46:48.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc4ee920 con 0x559ffc71c060 2023-09-13T09:46:48.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42d2233b80 10 client.0 _ll_register_callbacks cb 0x559ffc608680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:48.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc723ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc723ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60316/0 (socket says 172.21.15.6:60316) 2023-09-13T09:46:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 -- 172.21.15.6:0/747548696 learned_addr learned my addr 172.21.15.6:0/747548696 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42beffd700 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bffff700 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71c060 0x559ffc72b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 -- 172.21.15.6:0/747548696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71c060 msgr2=0x559ffc72b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71c060 0x559ffc72b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 -- 172.21.15.6:0/747548696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 msgr2=0x559ffc724410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.852+0000 7f42bf7fe700 1 -- 172.21.15.6:0/747548696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c010bd30 con 0x559ffc71aa00 2023-09-13T09:46:48.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc723ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f42b0010ac0 tx=0x7f42b0099b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6c1a0ea895a48e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f429effd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:46:48.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f429effd700 1 -- 172.21.15.6:0/747548696 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b009d450 con 0x559ffc71aa00 2023-09-13T09:46:48.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f429effd700 1 -- 172.21.15.6:0/747548696 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f42b00a1690 con 0x559ffc71aa00 2023-09-13T09:46:48.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559ffc70d670 con 0x559ffc71aa00 2023-09-13T09:46:48.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f429effd700 1 -- 172.21.15.6:0/747548696 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42b0010710 con 0x559ffc71aa00 2023-09-13T09:46:48.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 10 client.26828 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:48.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559ffc6847a0 con 0x559ffc71aa00 2023-09-13T09:46:48.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f429effd700 1 -- 172.21.15.6:0/747548696 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559ffc70d670 con 0x559ffc71aa00 2023-09-13T09:46:48.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f429effd700 1 -- 172.21.15.6:0/747548696 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f42b0084070 con 0x559ffc71aa00 2023-09-13T09:46:48.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 10 client.26828 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:48.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 10 client.26828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:48.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 20 client.26828 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:48.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc72fbf0 0x559ffc732010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 4 client.26828 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:46:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.853+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559ffc665970 con 0x559ffc72fbf0 2023-09-13T09:46:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.854+0000 7f42beffd700 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc72fbf0 0x559ffc732010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.854+0000 7f429effd700 10 client.26828 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.854+0000 7f42beffd700 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc72fbf0 0x559ffc732010 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7be689b3491c6fb9 server_cookie=2e29ee474d0e29d2 in_seq=0 out_seq=0 2023-09-13T09:46:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f429effd700 1 -- 172.21.15.6:0/747548696 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559ffc665970 con 0x559ffc72fbf0 2023-09-13T09:46:48.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f429effd700 10 client.26828 handle_command_reply: tid=0 2023-09-13T09:46:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 client.26828 shutdown 2023-09-13T09:46:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 msgr2=0x559ffc723ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc723ed0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f42b0010ac0 tx=0x7f42b0099b60 comp rx=0 tx=0).stop 2023-09-13T09:46:48.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 shutdown_connections 2023-09-13T09:46:48.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71c060 0x559ffc72b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc723ed0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc72fbf0 0x559ffc732010 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 --2- 172.21.15.6:0/747548696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f429effd700 0 client.26828 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 >> 172.21.15.6:0/747548696 conn(0x559ffc678c80 msgr2=0x559ffc70f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 shutdown_connections 2023-09-13T09:46:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 1 -- 172.21.15.6:0/747548696 wait complete. 2023-09-13T09:46:48.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.855+0000 7f42d2233b80 20 client.26828 trim_cache size 0 max 16384 2023-09-13T09:46:48.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.874+0000 7f42d2233b80 1 Processor -- start 2023-09-13T09:46:48.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42d2233b80 1 -- start start 2023-09-13T09:46:48.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc678c80 0x559ffc71a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc72b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42d2233b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc715a30 con 0x559ffc71b700 2023-09-13T09:46:48.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42d2233b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc723380 con 0x559ffc71aa00 2023-09-13T09:46:48.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42d2233b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc723a40 con 0x559ffc678c80 2023-09-13T09:46:48.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38572/0 (socket says 172.21.15.6:38572) 2023-09-13T09:46:48.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 -- 172.21.15.6:0/3263166555 learned_addr learned my addr 172.21.15.6:0/3263166555 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42beffd700 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc72b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc678c80 0x559ffc71a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 -- 172.21.15.6:0/3263166555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc678c80 msgr2=0x559ffc71a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc678c80 0x559ffc71a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 -- 172.21.15.6:0/3263166555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 msgr2=0x559ffc72b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc72b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 -- 172.21.15.6:0/3263166555 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ffc722e50 con 0x559ffc71b700 2023-09-13T09:46:48.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.875+0000 7f42bffff700 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724390 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f42b8003d80 tx=0x7f42b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66edaf82e186350b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42a67fc700 1 -- 172.21.15.6:0/3263166555 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8008e10 con 0x559ffc71b700 2023-09-13T09:46:48.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42a67fc700 1 -- 172.21.15.6:0/3263166555 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42b800f040 con 0x559ffc71b700 2023-09-13T09:46:48.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42a67fc700 1 -- 172.21.15.6:0/3263166555 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8020920 con 0x559ffc71b700 2023-09-13T09:46:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 -- 172.21.15.6:0/3263166555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 msgr2=0x559ffc724390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724390 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f42b8003d80 tx=0x7f42b800b040 comp rx=0 tx=0).stop 2023-09-13T09:46:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 -- 172.21.15.6:0/3263166555 shutdown_connections 2023-09-13T09:46:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71b700 0x559ffc724390 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc678c80 0x559ffc71a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 --2- 172.21.15.6:0/3263166555 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc71aa00 0x559ffc72b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 -- 172.21.15.6:0/3263166555 >> 172.21.15.6:0/3263166555 conn(0x559ffc715240 msgr2=0x559ffc723c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 -- 172.21.15.6:0/3263166555 shutdown_connections 2023-09-13T09:46:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.876+0000 7f42d2233b80 1 -- 172.21.15.6:0/3263166555 wait complete. 2023-09-13T09:46:48.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 -- start start 2023-09-13T09:46:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 Processor -- start 2023-09-13T09:46:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc678c80 0x559ffc728540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71aa00 0x559ffc728a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71b700 0x559ffc729a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc729fd0 con 0x559ffc71aa00 2023-09-13T09:46:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc72a140 con 0x559ffc678c80 2023-09-13T09:46:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ffc72a300 con 0x559ffc71b700 2023-09-13T09:46:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42d2233b80 10 client.0 _ll_register_callbacks cb 0x559ffc608680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:46:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.877+0000 7f42beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71aa00 0x559ffc728a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71aa00 0x559ffc728a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38574/0 (socket says 172.21.15.6:38574) 2023-09-13T09:46:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 -- 172.21.15.6:0/2409453122 learned_addr learned my addr 172.21.15.6:0/2409453122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:46:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc678c80 0x559ffc728540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42bffff700 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71b700 0x559ffc729a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 -- 172.21.15.6:0/2409453122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71b700 msgr2=0x559ffc729a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71b700 0x559ffc729a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 -- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc678c80 msgr2=0x559ffc728540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:46:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc678c80 0x559ffc728540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 -- 172.21.15.6:0/2409453122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42b8003a00 con 0x559ffc71aa00 2023-09-13T09:46:48.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42beffd700 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71aa00 0x559ffc728a80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099c0 tx=0x7f42b4004ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f08abe8a879fbc68 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:46:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f429effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:46:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f429effd700 1 -- 172.21.15.6:0/2409453122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b402a040 con 0x559ffc71aa00 2023-09-13T09:46:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f429effd700 1 -- 172.21.15.6:0/2409453122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f42b403b0b0 con 0x559ffc71aa00 2023-09-13T09:46:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f42b401e040 con 0x559ffc71aa00 2023-09-13T09:46:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f429effd700 1 -- 172.21.15.6:0/2409453122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42b403be70 con 0x559ffc71aa00 2023-09-13T09:46:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42d2233b80 10 client.17424 fetch_fsmap learned FSMap version 34 2023-09-13T09:46:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.878+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559ffc498de0 con 0x559ffc71aa00 2023-09-13T09:46:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f429effd700 1 -- 172.21.15.6:0/2409453122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f42b404c020 con 0x559ffc71aa00 2023-09-13T09:46:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f429effd700 1 -- 172.21.15.6:0/2409453122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f42b400f580 con 0x559ffc71aa00 2023-09-13T09:46:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42d2233b80 10 client.17424 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:46:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42d2233b80 10 client.17424 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:46:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42d2233b80 20 client.17424 populate_metadata read hostname 'smithi006' 2023-09-13T09:46:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc71c060 0x559ffc787a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:46:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42d2233b80 4 client.17424 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:46:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559ffc626050 con 0x559ffc71c060 2023-09-13T09:46:48.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc71c060 0x559ffc787a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:46:48.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f429effd700 10 client.17424 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.879+0000 7f42bf7fe700 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc71c060 0x559ffc787a30 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f731b115e23b03 server_cookie=21198922a28ef0b9 in_seq=0 out_seq=0 2023-09-13T09:46:48.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f429effd700 1 -- 172.21.15.6:0/2409453122 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559ffc626050 con 0x559ffc71c060 2023-09-13T09:46:48.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f429effd700 10 client.17424 handle_command_reply: tid=0 2023-09-13T09:46:48.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 client.17424 shutdown 2023-09-13T09:46:48.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71aa00 msgr2=0x559ffc728a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71aa00 0x559ffc728a80 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f42b40099c0 tx=0x7f42b4004ca0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 shutdown_connections 2023-09-13T09:46:48.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559ffc71b700 0x559ffc729a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559ffc678c80 0x559ffc728540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559ffc71c060 0x559ffc787a30 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 --2- 172.21.15.6:0/2409453122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559ffc71aa00 0x559ffc728a80 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f429effd700 0 client.17424 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:46:48.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 >> 172.21.15.6:0/2409453122 conn(0x559ffc715240 msgr2=0x559ffc7194b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 shutdown_connections 2023-09-13T09:46:48.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 1 -- 172.21.15.6:0/2409453122 wait complete. 2023-09-13T09:46:48.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42d2233b80 20 client.17424 trim_cache size 0 max 16384 2023-09-13T09:46:48.915 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:46:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:46:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:46:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "1d31e102-6ca8-4f10-99fc-f5f4cff2a5ac": { 2023-09-13T09:46:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:46:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "1d31e102-6ca8-4f10-99fc-f5f4cff2a5ac", 2023-09-13T09:46:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:46:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:46:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:46:48.917 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:46:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42a80a0640 msgr2=0x7f42a80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42a80a0640 0x7f42a80a2b00 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f42b40058e0 tx=0x7f42b401a040 comp rx=0 tx=0).stop 2023-09-13T09:46:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 msgr2=0x7f42c0198f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:46:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 0x7f42c0198f00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42b000e9a0 tx=0x7f42b000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 shutdown_connections 2023-09-13T09:46:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f42a80a0640 0x7f42a80a2b00 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42c019e4a0 0x7f42c01a0890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42c00ff690 0x7f42c0198f00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.880+0000 7f42c604e700 1 --2- 172.21.15.6:0/1993883340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42c01009b0 0x7f42c0199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:46:48.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.881+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 >> 172.21.15.6:0/1993883340 conn(0x7f42c00fb250 msgr2=0x7f42c00fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:46:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.881+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 shutdown_connections 2023-09-13T09:46:48.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:46:48.881+0000 7f42c604e700 1 -- 172.21.15.6:0/1993883340 wait complete. 2023-09-13T09:46:48.921 INFO:tasks.cephfs.filesystem:scrub status for tag:1d31e102-6ca8-4f10-99fc-f5f4cff2a5ac - {'path': '/', 'tag': '1d31e102-6ca8-4f10-99fc-f5f4cff2a5ac', 'options': 'recursive,force'} 2023-09-13T09:46:49.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 305154 4.60 MB/sec execute 249 sec latency 30.626 ms 2023-09-13T09:46:50.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 305999 4.59 MB/sec execute 250 sec latency 61.263 ms 2023-09-13T09:46:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: pgmap v519: 97 pgs: 97 active+clean; 135 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2023-09-13T09:46:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:46:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:46:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: pgmap v519: 97 pgs: 97 active+clean; 135 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2023-09-13T09:46:50.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:46:50.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:50.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:50.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:50.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:50.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:50.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:50.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:46:50.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: pgmap v519: 97 pgs: 97 active+clean; 135 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 912 KiB/s rd, 2.1 MiB/s wr, 247 op/s 2023-09-13T09:46:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:46:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:50.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:46:50.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:50.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:46:51.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 308403 4.63 MB/sec execute 251 sec latency 20.548 ms 2023-09-13T09:46:52.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 309335 4.63 MB/sec execute 252 sec latency 13.297 ms 2023-09-13T09:46:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:51 smithi006 ceph-mon[98665]: pgmap v520: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:46:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:51 smithi053 ceph-mon[102373]: pgmap v520: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:46:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:51 smithi131 ceph-mon[102785]: pgmap v520: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:46:53.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 311528 4.66 MB/sec execute 253 sec latency 11.898 ms 2023-09-13T09:46:54.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 312586 4.67 MB/sec execute 254 sec latency 38.131 ms 2023-09-13T09:46:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:53 smithi006 ceph-mon[98665]: pgmap v521: 97 pgs: 97 active+clean; 135 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 292 op/s 2023-09-13T09:46:54.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:53 smithi053 ceph-mon[102373]: pgmap v521: 97 pgs: 97 active+clean; 135 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 292 op/s 2023-09-13T09:46:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:53 smithi131 ceph-mon[102785]: pgmap v521: 97 pgs: 97 active+clean; 135 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 292 op/s 2023-09-13T09:46:55.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 314296 4.67 MB/sec execute 255 sec latency 28.635 ms 2023-09-13T09:46:56.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 315980 4.70 MB/sec execute 256 sec latency 16.127 ms 2023-09-13T09:46:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:55 smithi006 ceph-mon[98665]: pgmap v522: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2023-09-13T09:46:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:55 smithi053 ceph-mon[102373]: pgmap v522: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2023-09-13T09:46:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:55 smithi131 ceph-mon[102785]: pgmap v522: 97 pgs: 97 active+clean; 136 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 278 op/s 2023-09-13T09:46:57.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 317160 4.71 MB/sec execute 257 sec latency 12.626 ms 2023-09-13T09:46:58.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 319388 4.74 MB/sec execute 258 sec latency 13.792 ms 2023-09-13T09:46:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:57 smithi006 ceph-mon[98665]: pgmap v523: 97 pgs: 97 active+clean; 140 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 297 op/s 2023-09-13T09:46:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:57 smithi053 ceph-mon[102373]: pgmap v523: 97 pgs: 97 active+clean; 140 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 297 op/s 2023-09-13T09:46:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:57 smithi131 ceph-mon[102785]: pgmap v523: 97 pgs: 97 active+clean; 140 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 297 op/s 2023-09-13T09:46:59.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 320225 4.73 MB/sec execute 259 sec latency 13.128 ms 2023-09-13T09:47:00.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 322166 4.75 MB/sec execute 260 sec latency 92.971 ms 2023-09-13T09:47:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:59 smithi006 ceph-mon[98665]: pgmap v524: 97 pgs: 97 active+clean; 140 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.2 MiB/s wr, 231 op/s 2023-09-13T09:47:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:46:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:59 smithi053 ceph-mon[102373]: pgmap v524: 97 pgs: 97 active+clean; 140 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.2 MiB/s wr, 231 op/s 2023-09-13T09:47:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:46:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:59 smithi131 ceph-mon[102785]: pgmap v524: 97 pgs: 97 active+clean; 140 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.2 MiB/s wr, 231 op/s 2023-09-13T09:47:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:46:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:01.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 323263 4.76 MB/sec execute 261 sec latency 17.518 ms 2023-09-13T09:47:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:01.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:01.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:01.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:01.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:01.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:02.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 325561 4.78 MB/sec execute 262 sec latency 12.972 ms 2023-09-13T09:47:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:01 smithi053 ceph-mon[102373]: pgmap v525: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:47:02.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:01 smithi006 ceph-mon[98665]: pgmap v525: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:47:02.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:01 smithi131 ceph-mon[102785]: pgmap v525: 97 pgs: 97 active+clean; 141 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:47:03.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 326790 4.80 MB/sec execute 263 sec latency 12.636 ms 2023-09-13T09:47:04.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 328776 4.81 MB/sec execute 264 sec latency 18.555 ms 2023-09-13T09:47:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:03 smithi006 ceph-mon[98665]: pgmap v526: 97 pgs: 97 active+clean; 143 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 283 op/s 2023-09-13T09:47:04.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:03 smithi053 ceph-mon[102373]: pgmap v526: 97 pgs: 97 active+clean; 143 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 283 op/s 2023-09-13T09:47:04.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:03 smithi131 ceph-mon[102785]: pgmap v526: 97 pgs: 97 active+clean; 143 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.5 MiB/s wr, 283 op/s 2023-09-13T09:47:05.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 330197 4.83 MB/sec execute 265 sec latency 49.772 ms 2023-09-13T09:47:06.170 INFO:tasks.workunit.client.0.smithi006.stdout: 1 331544 4.83 MB/sec execute 266 sec latency 21.266 ms 2023-09-13T09:47:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:05 smithi006 ceph-mon[98665]: pgmap v527: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 261 op/s 2023-09-13T09:47:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:05 smithi053 ceph-mon[102373]: pgmap v527: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 261 op/s 2023-09-13T09:47:06.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:05 smithi131 ceph-mon[102785]: pgmap v527: 97 pgs: 97 active+clean; 145 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 261 op/s 2023-09-13T09:47:07.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 333683 4.87 MB/sec execute 267 sec latency 13.854 ms 2023-09-13T09:47:08.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 334828 4.87 MB/sec execute 268 sec latency 12.754 ms 2023-09-13T09:47:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:07 smithi006 ceph-mon[98665]: pgmap v528: 97 pgs: 97 active+clean; 146 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 264 op/s 2023-09-13T09:47:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:07 smithi053 ceph-mon[102373]: pgmap v528: 97 pgs: 97 active+clean; 146 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 264 op/s 2023-09-13T09:47:08.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:07 smithi131 ceph-mon[102785]: pgmap v528: 97 pgs: 97 active+clean; 146 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 264 op/s 2023-09-13T09:47:09.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 337094 4.90 MB/sec execute 269 sec latency 11.908 ms 2023-09-13T09:47:10.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 337777 4.89 MB/sec execute 270 sec latency 96.627 ms 2023-09-13T09:47:10.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:09 smithi006 ceph-mon[98665]: pgmap v529: 97 pgs: 97 active+clean; 147 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 1.9 MiB/s wr, 230 op/s 2023-09-13T09:47:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:09 smithi053 ceph-mon[102373]: pgmap v529: 97 pgs: 97 active+clean; 147 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 1.9 MiB/s wr, 230 op/s 2023-09-13T09:47:10.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:09 smithi131 ceph-mon[102785]: pgmap v529: 97 pgs: 97 active+clean; 147 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 835 KiB/s rd, 1.9 MiB/s wr, 230 op/s 2023-09-13T09:47:11.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 339908 4.91 MB/sec execute 271 sec latency 52.943 ms 2023-09-13T09:47:12.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 341054 4.92 MB/sec execute 272 sec latency 14.129 ms 2023-09-13T09:47:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:11 smithi053 ceph-mon[102373]: pgmap v530: 97 pgs: 97 active+clean; 148 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2023-09-13T09:47:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:11 smithi006 ceph-mon[98665]: pgmap v530: 97 pgs: 97 active+clean; 148 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2023-09-13T09:47:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:11 smithi131 ceph-mon[102785]: pgmap v530: 97 pgs: 97 active+clean; 148 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 1007 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2023-09-13T09:47:13.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 343115 4.93 MB/sec execute 273 sec latency 12.611 ms 2023-09-13T09:47:14.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 344479 4.95 MB/sec execute 274 sec latency 12.855 ms 2023-09-13T09:47:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:13 smithi006 ceph-mon[98665]: pgmap v531: 97 pgs: 97 active+clean; 150 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.4 MiB/s wr, 267 op/s 2023-09-13T09:47:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:13 smithi053 ceph-mon[102373]: pgmap v531: 97 pgs: 97 active+clean; 150 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.4 MiB/s wr, 267 op/s 2023-09-13T09:47:14.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:13 smithi131 ceph-mon[102785]: pgmap v531: 97 pgs: 97 active+clean; 150 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1004 KiB/s rd, 2.4 MiB/s wr, 267 op/s 2023-09-13T09:47:15.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 346456 4.96 MB/sec execute 275 sec latency 18.193 ms 2023-09-13T09:47:16.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 347897 4.99 MB/sec execute 276 sec latency 38.066 ms 2023-09-13T09:47:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:15 smithi006 ceph-mon[98665]: pgmap v532: 97 pgs: 97 active+clean; 152 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2023-09-13T09:47:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:15 smithi053 ceph-mon[102373]: pgmap v532: 97 pgs: 97 active+clean; 152 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2023-09-13T09:47:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:15 smithi131 ceph-mon[102785]: pgmap v532: 97 pgs: 97 active+clean; 152 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 281 op/s 2023-09-13T09:47:17.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 349020 4.99 MB/sec execute 277 sec latency 61.435 ms 2023-09-13T09:47:18.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 351262 5.01 MB/sec execute 278 sec latency 12.763 ms 2023-09-13T09:47:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:17 smithi006 ceph-mon[98665]: pgmap v533: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.5 MiB/s wr, 250 op/s 2023-09-13T09:47:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:17 smithi053 ceph-mon[102373]: pgmap v533: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.5 MiB/s wr, 250 op/s 2023-09-13T09:47:18.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:17 smithi131 ceph-mon[102785]: pgmap v533: 97 pgs: 97 active+clean; 153 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.5 MiB/s wr, 250 op/s 2023-09-13T09:47:18.922 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:47:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 -- 172.21.15.6:0/3088307833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c0ff080 msgr2=0x7f022c0ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 --2- 172.21.15.6:0/3088307833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c0ff080 0x7f022c0ff4a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f021c009990 tx=0x7f021c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 -- 172.21.15.6:0/3088307833 shutdown_connections 2023-09-13T09:47:19.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 --2- 172.21.15.6:0/3088307833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f022c1029f0 0x7f022c1092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 --2- 172.21.15.6:0/3088307833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c0ff080 0x7f022c0ff4a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 --2- 172.21.15.6:0/3088307833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f022c102050 0x7f022c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 -- 172.21.15.6:0/3088307833 >> 172.21.15.6:0/3088307833 conn(0x7f022c0fa9b0 msgr2=0x7f022c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 -- 172.21.15.6:0/3088307833 shutdown_connections 2023-09-13T09:47:19.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.061+0000 7f0231ea7700 1 -- 172.21.15.6:0/3088307833 wait complete. 2023-09-13T09:47:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 Processor -- start 2023-09-13T09:47:19.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 -- start start 2023-09-13T09:47:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f022c0ff080 0x7f022c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f022c102050 0x7f022c199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c1029f0 0x7f022c1a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1a0840 con 0x7f022c1029f0 2023-09-13T09:47:19.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1a09b0 con 0x7f022c0ff080 2023-09-13T09:47:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f0231ea7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022c1a0b70 con 0x7f022c102050 2023-09-13T09:47:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f022bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c1029f0 0x7f022c1a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f022affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f022c102050 0x7f022c199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f022b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f022c0ff080 0x7f022c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f022affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f022c102050 0x7f022c199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41652/0 (socket says 172.21.15.6:41652) 2023-09-13T09:47:19.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f022bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c1029f0 0x7f022c1a0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38600/0 (socket says 172.21.15.6:38600) 2023-09-13T09:47:19.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.062+0000 7f022affd700 1 -- 172.21.15.6:0/1937400950 learned_addr learned my addr 172.21.15.6:0/1937400950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f022b7fe700 1 -- 172.21.15.6:0/1937400950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f022c102050 msgr2=0x7f022c199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f022b7fe700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f022c102050 0x7f022c199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f022b7fe700 1 -- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c1029f0 msgr2=0x7f022c1a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f022b7fe700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c1029f0 0x7f022c1a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f022b7fe700 1 -- 172.21.15.6:0/1937400950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0095f0 con 0x7f022c0ff080 2023-09-13T09:47:19.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f022b7fe700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f022c0ff080 0x7f022c198d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f021c00b680 tx=0x7f021c009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f0228ff9700 1 -- 172.21.15.6:0/1937400950 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c01d070 con 0x7f022c0ff080 2023-09-13T09:47:19.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022c1a0df0 con 0x7f022c0ff080 2023-09-13T09:47:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f0228ff9700 1 -- 172.21.15.6:0/1937400950 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f021c021410 con 0x7f022c0ff080 2023-09-13T09:47:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f0228ff9700 1 -- 172.21.15.6:0/1937400950 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c017650 con 0x7f022c0ff080 2023-09-13T09:47:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.063+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022c1a11c0 con 0x7f022c0ff080 2023-09-13T09:47:19.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.066+0000 7f0228ff9700 1 -- 172.21.15.6:0/1937400950 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f021c021810 con 0x7f022c0ff080 2023-09-13T09:47:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.066+0000 7f0228ff9700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02140a0640 0x7f02140a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f022affd700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02140a0640 0x7f02140a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f0228ff9700 1 -- 172.21.15.6:0/1937400950 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f021c0ccf80 con 0x7f022c0ff080 2023-09-13T09:47:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 Processor -- start 2023-09-13T09:47:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f022affd700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02140a0640 0x7f02140a2b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0220009d20 tx=0x7f0220009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 -- start start 2023-09-13T09:47:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52abb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52aae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c5203780 con 0x5582c52ac060 2023-09-13T09:47:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c52010a0 con 0x5582c52aaa00 2023-09-13T09:47:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f023e08cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c51fc990 con 0x5582c52ab700 2023-09-13T09:47:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f022affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f022affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52aa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38606/0 (socket says 172.21.15.6:38606) 2023-09-13T09:47:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f022affd700 1 -- 172.21.15.6:0/3141064984 learned_addr learned my addr 172.21.15.6:0/3141064984 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.067+0000 7f022b7fe700 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f022bfff700 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f022affd700 1 -- 172.21.15.6:0/3141064984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 msgr2=0x5582c52abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f022affd700 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f022affd700 1 -- 172.21.15.6:0/3141064984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 msgr2=0x5582c52aae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f022affd700 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52aae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f022affd700 1 -- 172.21.15.6:0/3141064984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c507c630 con 0x5582c52ac060 2023-09-13T09:47:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f022affd700 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52aa4c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f022000e540 tx=0x7f0220014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78995a9dd5b4cf9f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f0211ffb700 1 -- 172.21.15.6:0/3141064984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0220026430 con 0x5582c52ac060 2023-09-13T09:47:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f0211ffb700 1 -- 172.21.15.6:0/3141064984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0220021070 con 0x5582c52ac060 2023-09-13T09:47:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.068+0000 7f0211ffb700 1 -- 172.21.15.6:0/3141064984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022001d700 con 0x5582c52ac060 2023-09-13T09:47:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 -- 172.21.15.6:0/3141064984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 msgr2=0x5582c52aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52aa4c0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f022000e540 tx=0x7f0220014000 comp rx=0 tx=0).stop 2023-09-13T09:47:19.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 -- 172.21.15.6:0/3141064984 shutdown_connections 2023-09-13T09:47:19.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52aae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52abb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 --2- 172.21.15.6:0/3141064984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52aa4c0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 -- 172.21.15.6:0/3141064984 >> 172.21.15.6:0/3141064984 conn(0x5582c5208c80 msgr2=0x5582c52a4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 -- 172.21.15.6:0/3141064984 shutdown_connections 2023-09-13T09:47:19.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 -- 172.21.15.6:0/3141064984 wait complete. 2023-09-13T09:47:19.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 -- start start 2023-09-13T09:47:19.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.069+0000 7f023e08cb80 1 Processor -- start 2023-09-13T09:47:19.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52aaa00 0x5582c52b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52b4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ac060 0x5582c52bb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c519abb0 con 0x5582c52aaa00 2023-09-13T09:47:19.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c519a8b0 con 0x5582c52ac060 2023-09-13T09:47:19.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c507e920 con 0x5582c52ab700 2023-09-13T09:47:19.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 10 client.0 _ll_register_callbacks cb 0x5582c5198680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:19.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52aaa00 0x5582c52b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52aaa00 0x5582c52b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38610/0 (socket says 172.21.15.6:38610) 2023-09-13T09:47:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 -- 172.21.15.6:0/1145690514 learned_addr learned my addr 172.21.15.6:0/1145690514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022affd700 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022bfff700 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ac060 0x5582c52bb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 -- 172.21.15.6:0/1145690514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 msgr2=0x5582c52b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 -- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ac060 msgr2=0x5582c52bb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ac060 0x5582c52bb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 -- 172.21.15.6:0/1145690514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0220017070 con 0x5582c52aaa00 2023-09-13T09:47:19.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f022b7fe700 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52aaa00 0x5582c52b3f00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f021c0caa30 tx=0x7f021c09acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b2decf6fbbff18 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f020affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f020affd700 1 -- 172.21.15.6:0/1145690514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c09aeb0 con 0x5582c52aaa00 2023-09-13T09:47:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582c529d670 con 0x5582c52aaa00 2023-09-13T09:47:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.070+0000 7f020affd700 1 -- 172.21.15.6:0/1145690514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f021c09a7b0 con 0x5582c52aaa00 2023-09-13T09:47:19.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f020affd700 1 -- 172.21.15.6:0/1145690514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f021c09e5e0 con 0x5582c52aaa00 2023-09-13T09:47:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 10 client.17436 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5582c52147a0 con 0x5582c52aaa00 2023-09-13T09:47:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f020affd700 1 -- 172.21.15.6:0/1145690514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5582c529d670 con 0x5582c52aaa00 2023-09-13T09:47:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f020affd700 1 -- 172.21.15.6:0/1145690514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f021c0b2d20 con 0x5582c52aaa00 2023-09-13T09:47:19.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 10 client.17436 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 10 client.17436 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 20 client.17436 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c52bf950 0x5582c52c1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 4 client.17436 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:19.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582c51f5970 con 0x5582c52bf950 2023-09-13T09:47:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.071+0000 7f022affd700 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c52bf950 0x5582c52c1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.072+0000 7f020affd700 10 client.17436 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.072+0000 7f022affd700 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c52bf950 0x5582c52c1d70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57267b866256e85f server_cookie=682c3f23c11b1ddc in_seq=0 out_seq=0 2023-09-13T09:47:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.072+0000 7f020affd700 1 -- 172.21.15.6:0/1145690514 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5582c51f5970 con 0x5582c52bf950 2023-09-13T09:47:19.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.072+0000 7f020affd700 10 client.17436 handle_command_reply: tid=0 2023-09-13T09:47:19.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.072+0000 7f023e08cb80 1 client.17436 shutdown 2023-09-13T09:47:19.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.072+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52aaa00 msgr2=0x5582c52b3f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.072+0000 7f023e08cb80 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52aaa00 0x5582c52b3f00 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f021c0caa30 tx=0x7f021c09acf0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 shutdown_connections 2023-09-13T09:47:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ac060 0x5582c52bb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c52bf950 0x5582c52c1d70 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52aaa00 0x5582c52b3f00 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f020affd700 0 client.17436 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 --2- 172.21.15.6:0/1145690514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ab700 0x5582c52b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 >> 172.21.15.6:0/1145690514 conn(0x5582c5208c80 msgr2=0x5582c529f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 shutdown_connections 2023-09-13T09:47:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 1 -- 172.21.15.6:0/1145690514 wait complete. 2023-09-13T09:47:19.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.073+0000 7f023e08cb80 20 client.17436 trim_cache size 0 max 16384 2023-09-13T09:47:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 Processor -- start 2023-09-13T09:47:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 -- start start 2023-09-13T09:47:19.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52aaa00 0x5582c52aa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ab700 0x5582c52bb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c52b33b0 con 0x5582c52ac060 2023-09-13T09:47:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c52b3a70 con 0x5582c52ab700 2023-09-13T09:47:19.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f023e08cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c52b25e0 con 0x5582c52aaa00 2023-09-13T09:47:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ab700 0x5582c52bb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52aaa00 0x5582c52aa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38622/0 (socket says 172.21.15.6:38622) 2023-09-13T09:47:19.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022bfff700 1 -- 172.21.15.6:0/597436496 learned_addr learned my addr 172.21.15.6:0/597436496 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ab700 0x5582c52bb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60376/0 (socket says 172.21.15.6:60376) 2023-09-13T09:47:19.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022b7fe700 1 -- 172.21.15.6:0/597436496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ab700 msgr2=0x5582c52bb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.091+0000 7f022b7fe700 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ab700 0x5582c52bb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f022b7fe700 1 -- 172.21.15.6:0/597436496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 msgr2=0x5582c52b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f022b7fe700 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52b3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f022b7fe700 1 -- 172.21.15.6:0/597436496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582c5028de0 con 0x5582c52aaa00 2023-09-13T09:47:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f022affd700 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ab700 0x5582c52bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f022b7fe700 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52aaa00 0x5582c52aa4c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f021c009350 tx=0x7f021c0a2300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=929c744270ba04a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f02127fc700 1 -- 172.21.15.6:0/597436496 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c0a25b0 con 0x5582c52aaa00 2023-09-13T09:47:19.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f02127fc700 1 -- 172.21.15.6:0/597436496 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f021c0b7030 con 0x5582c52aaa00 2023-09-13T09:47:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.092+0000 7f02127fc700 1 -- 172.21.15.6:0/597436496 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021c0a2790 con 0x5582c52aaa00 2023-09-13T09:47:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- 172.21.15.6:0/597436496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52aaa00 msgr2=0x5582c52aa4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52aaa00 0x5582c52aa4c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f021c009350 tx=0x7f021c0a2300 comp rx=0 tx=0).stop 2023-09-13T09:47:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- 172.21.15.6:0/597436496 shutdown_connections 2023-09-13T09:47:19.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ac060 0x5582c52b3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52aaa00 0x5582c52aa4c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 --2- 172.21.15.6:0/597436496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52ab700 0x5582c52bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- 172.21.15.6:0/597436496 >> 172.21.15.6:0/597436496 conn(0x5582c5208c80 msgr2=0x5582c52ae8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- 172.21.15.6:0/597436496 shutdown_connections 2023-09-13T09:47:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- 172.21.15.6:0/597436496 wait complete. 2023-09-13T09:47:19.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- start start 2023-09-13T09:47:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 Processor -- start 2023-09-13T09:47:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52bb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ab700 0x5582c52b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ac060 0x5582c52b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c52b85b0 con 0x5582c52ab700 2023-09-13T09:47:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.093+0000 7f023e08cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c52b8720 con 0x5582c52aaa00 2023-09-13T09:47:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f023e08cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582c5313770 con 0x5582c52ac060 2023-09-13T09:47:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f023e08cb80 10 client.0 _ll_register_callbacks cb 0x5582c5198680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:19.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ab700 0x5582c52b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52bb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ab700 0x5582c52b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38626/0 (socket says 172.21.15.6:38626) 2023-09-13T09:47:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 -- 172.21.15.6:0/2782164625 learned_addr learned my addr 172.21.15.6:0/2782164625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022bfff700 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ac060 0x5582c52b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 -- 172.21.15.6:0/2782164625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ac060 msgr2=0x5582c52b8070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ac060 0x5582c52b8070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 -- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 msgr2=0x5582c52bb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52bb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 -- 172.21.15.6:0/2782164625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022002a040 con 0x5582c52ab700 2023-09-13T09:47:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022b7fe700 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f022affd700 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ab700 0x5582c52b7b30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0220026000 tx=0x7f0220009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f885526e8fbc307f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f020affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f020affd700 1 -- 172.21.15.6:0/2782164625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f022000eb60 con 0x5582c52ab700 2023-09-13T09:47:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f020affd700 1 -- 172.21.15.6:0/2782164625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f022000ed80 con 0x5582c52ab700 2023-09-13T09:47:19.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0220021070 con 0x5582c52ab700 2023-09-13T09:47:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f020affd700 1 -- 172.21.15.6:0/2782164625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f022001cd60 con 0x5582c52ab700 2023-09-13T09:47:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f023e08cb80 10 client.17442 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.094+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5582c52147a0 con 0x5582c52ab700 2023-09-13T09:47:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f020affd700 1 -- 172.21.15.6:0/2782164625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0220042080 con 0x5582c52ab700 2023-09-13T09:47:19.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f020affd700 1 -- 172.21.15.6:0/2782164625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f022001c480 con 0x5582c52ab700 2023-09-13T09:47:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f023e08cb80 10 client.17442 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f023e08cb80 10 client.17442 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f023e08cb80 20 client.17442 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f023e08cb80 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c53150d0 0x5582c53174f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f023e08cb80 4 client.17442 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:47:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5582c51b6050 con 0x5582c53150d0 2023-09-13T09:47:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f022b7fe700 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c53150d0 0x5582c53174f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f020affd700 10 client.17442 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f022b7fe700 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c53150d0 0x5582c53174f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6fc86063d972c55 server_cookie=7acfba7dcc7c28a4 in_seq=0 out_seq=0 2023-09-13T09:47:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.095+0000 7f020affd700 1 -- 172.21.15.6:0/2782164625 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5582c51b6050 con 0x5582c53150d0 2023-09-13T09:47:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f020affd700 10 client.17442 handle_command_reply: tid=0 2023-09-13T09:47:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 client.17442 shutdown 2023-09-13T09:47:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ab700 msgr2=0x5582c52b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ab700 0x5582c52b7b30 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f0220026000 tx=0x7f0220009820 comp rx=0 tx=0).stop 2023-09-13T09:47:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 shutdown_connections 2023-09-13T09:47:19.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5582c52ac060 0x5582c52b8070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5582c52aaa00 0x5582c52bb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5582c53150d0 0x5582c53174f0 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 --2- 172.21.15.6:0/2782164625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5582c52ab700 0x5582c52b7b30 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f020affd700 0 client.17442 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 >> 172.21.15.6:0/2782164625 conn(0x5582c5208c80 msgr2=0x5582c52b3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 shutdown_connections 2023-09-13T09:47:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 1 -- 172.21.15.6:0/2782164625 wait complete. 2023-09-13T09:47:19.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f023e08cb80 20 client.17442 trim_cache size 0 max 16384 2023-09-13T09:47:19.120 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:47:19.120 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:47:19.120 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:47:19.120 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:47:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02140a0640 msgr2=0x7f02140a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02140a0640 0x7f02140a2b00 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f0220009d20 tx=0x7f0220009260 comp rx=0 tx=0).stop 2023-09-13T09:47:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f022c0ff080 msgr2=0x7f022c198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f022c0ff080 0x7f022c198d00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f021c00b680 tx=0x7f021c009580 comp rx=0 tx=0).stop 2023-09-13T09:47:19.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 shutdown_connections 2023-09-13T09:47:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02140a0640 0x7f02140a2b00 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f022c1029f0 0x7f022c1a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f022c0ff080 0x7f022c198d00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 --2- 172.21.15.6:0/1937400950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f022c102050 0x7f022c199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.096+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 >> 172.21.15.6:0/1937400950 conn(0x7f022c0fa9b0 msgr2=0x7f022c107980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.097+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 shutdown_connections 2023-09-13T09:47:19.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.097+0000 7f0231ea7700 1 -- 172.21.15.6:0/1937400950 wait complete. 2023-09-13T09:47:19.124 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:47:19.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:47:19.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 352070 5.00 MB/sec execute 279 sec latency 13.616 ms 2023-09-13T09:47:19.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 -- 172.21.15.6:0/2322511086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948100db0 msgr2=0x7f09481011d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 --2- 172.21.15.6:0/2322511086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948100db0 0x7f09481011d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f09440099c0 tx=0x7f0944009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 -- 172.21.15.6:0/2322511086 shutdown_connections 2023-09-13T09:47:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 --2- 172.21.15.6:0/2322511086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948102940 0x7f09481091f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 --2- 172.21.15.6:0/2322511086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948100db0 0x7f09481011d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 --2- 172.21.15.6:0/2322511086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0948101fa0 0x7f0948102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 -- 172.21.15.6:0/2322511086 >> 172.21.15.6:0/2322511086 conn(0x7f09480fc320 msgr2=0x7f09480fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 -- 172.21.15.6:0/2322511086 shutdown_connections 2023-09-13T09:47:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.258+0000 7f094fd85700 1 -- 172.21.15.6:0/2322511086 wait complete. 2023-09-13T09:47:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 Processor -- start 2023-09-13T09:47:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 -- start start 2023-09-13T09:47:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948100db0 0x7f0948074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0948101fa0 0x7f09480730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948102940 0x7f09480735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948073d80 con 0x7f0948100db0 2023-09-13T09:47:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0948073ef0 con 0x7f0948102940 2023-09-13T09:47:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094fd85700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09481a0ad0 con 0x7f0948101fa0 2023-09-13T09:47:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094db21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948100db0 0x7f0948074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094db21700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948100db0 0x7f0948074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38638/0 (socket says 172.21.15.6:38638) 2023-09-13T09:47:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094db21700 1 -- 172.21.15.6:0/1478790834 learned_addr learned my addr 172.21.15.6:0/1478790834 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094d320700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0948101fa0 0x7f09480730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.259+0000 7f094e322700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948102940 0x7f09480735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094db21700 1 -- 172.21.15.6:0/1478790834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0948101fa0 msgr2=0x7f09480730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094db21700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0948101fa0 0x7f09480730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094db21700 1 -- 172.21.15.6:0/1478790834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948102940 msgr2=0x7f09480735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094db21700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948102940 0x7f09480735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094db21700 1 -- 172.21.15.6:0/1478790834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09440095f0 con 0x7f0948100db0 2023-09-13T09:47:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094db21700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948100db0 0x7f0948074a60 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f09440058e0 tx=0x7f094400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f093effd700 1 -- 172.21.15.6:0/1478790834 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094401d070 con 0x7f0948100db0 2023-09-13T09:47:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09481a0d50 con 0x7f0948100db0 2023-09-13T09:47:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09481a11d0 con 0x7f0948100db0 2023-09-13T09:47:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f093effd700 1 -- 172.21.15.6:0/1478790834 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0944005050 con 0x7f0948100db0 2023-09-13T09:47:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.260+0000 7f093effd700 1 -- 172.21.15.6:0/1478790834 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0944004b30 con 0x7f0948100db0 2023-09-13T09:47:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.261+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f092c005320 con 0x7f0948100db0 2023-09-13T09:47:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.262+0000 7f093effd700 1 -- 172.21.15.6:0/1478790834 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0944004c90 con 0x7f0948100db0 2023-09-13T09:47:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.263+0000 7f093effd700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09340a0640 0x7f09340a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.263+0000 7f093effd700 1 -- 172.21.15.6:0/1478790834 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f09440cc9f0 con 0x7f0948100db0 2023-09-13T09:47:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.263+0000 7f094d320700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09340a0640 0x7f09340a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.263+0000 7f094d320700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09340a0640 0x7f09340a2b00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0938009c60 tx=0x7f0938009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.267+0000 7f093effd700 1 -- 172.21.15.6:0/1478790834 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0944096560 con 0x7f0948100db0 2023-09-13T09:47:19.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.535+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f092c0058a0 con 0x7f0948100db0 2023-09-13T09:47:19.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.536+0000 7f093effd700 1 -- 172.21.15.6:0/1478790834 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f0944099b80 con 0x7f0948100db0 2023-09-13T09:47:19.536 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:47:19.536 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:47:19.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.537+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09340a0640 msgr2=0x7f09340a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.537+0000 7f094fd85700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09340a0640 0x7f09340a2b00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f0938009c60 tx=0x7f0938009260 comp rx=0 tx=0).stop 2023-09-13T09:47:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.537+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948100db0 msgr2=0x7f0948074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.537+0000 7f094fd85700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948100db0 0x7f0948074a60 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f09440058e0 tx=0x7f094400f690 comp rx=0 tx=0).stop 2023-09-13T09:47:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 shutdown_connections 2023-09-13T09:47:19.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0948102940 0x7f09480735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f09340a0640 0x7f09340a2b00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0948100db0 0x7f0948074a60 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 --2- 172.21.15.6:0/1478790834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0948101fa0 0x7f09480730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 >> 172.21.15.6:0/1478790834 conn(0x7f09480fc320 msgr2=0x7f09480fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 shutdown_connections 2023-09-13T09:47:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.538+0000 7f094fd85700 1 -- 172.21.15.6:0/1478790834 wait complete. 2023-09-13T09:47:19.541 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:47:19.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:47:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 -- 172.21.15.6:0/1111053424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524100eb0 msgr2=0x7fa524101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1111053424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524100eb0 0x7fa524101310 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0099c0 tx=0x7fa50c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 -- 172.21.15.6:0/1111053424 shutdown_connections 2023-09-13T09:47:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1111053424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa524101850 0x7fa524108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1111053424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5240ffcc0 0x7fa5241000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1111053424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524100eb0 0x7fa524101310 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 -- 172.21.15.6:0/1111053424 >> 172.21.15.6:0/1111053424 conn(0x7fa5240fb250 msgr2=0x7fa5240fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 -- 172.21.15.6:0/1111053424 shutdown_connections 2023-09-13T09:47:19.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.694+0000 7fa5290f1700 1 -- 172.21.15.6:0/1111053424 wait complete. 2023-09-13T09:47:19.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 Processor -- start 2023-09-13T09:47:19.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 -- start start 2023-09-13T09:47:19.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5240ffcc0 0x7fa524196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa524100eb0 0x7fa524196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524101850 0x7fa52419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52419e620 con 0x7fa524101850 2023-09-13T09:47:19.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52419e760 con 0x7fa524100eb0 2023-09-13T09:47:19.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa5290f1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa52419e8f0 con 0x7fa5240ffcc0 2023-09-13T09:47:19.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524101850 0x7fa52419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa524100eb0 0x7fa524196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5240ffcc0 0x7fa524196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524101850 0x7fa52419e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38656/0 (socket says 172.21.15.6:38656) 2023-09-13T09:47:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa524100eb0 0x7fa524196fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60410/0 (socket says 172.21.15.6:60410) 2023-09-13T09:47:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 -- 172.21.15.6:0/1421225180 learned_addr learned my addr 172.21.15.6:0/1421225180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 -- 172.21.15.6:0/1421225180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5240ffcc0 msgr2=0x7fa524196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5240ffcc0 0x7fa524196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 -- 172.21.15.6:0/1421225180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa524100eb0 msgr2=0x7fa524196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa524100eb0 0x7fa524196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52359e700 1 -- 172.21.15.6:0/1421225180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50c0095f0 con 0x7fa524101850 2023-09-13T09:47:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.695+0000 7fa52259c700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa524100eb0 0x7fa524196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.696+0000 7fa52359e700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524101850 0x7fa52419e050 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa51c007ee0 tx=0x7fa51c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.696+0000 7fa51bfff700 1 -- 172.21.15.6:0/1421225180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c017070 con 0x7fa524101850 2023-09-13T09:47:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.696+0000 7fa51bfff700 1 -- 172.21.15.6:0/1421225180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa51c00f040 con 0x7fa524101850 2023-09-13T09:47:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.696+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa52419ebd0 con 0x7fa524101850 2023-09-13T09:47:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.696+0000 7fa51bfff700 1 -- 172.21.15.6:0/1421225180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c005580 con 0x7fa524101850 2023-09-13T09:47:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.696+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa52419f090 con 0x7fa524101850 2023-09-13T09:47:19.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.698+0000 7fa51bfff700 1 -- 172.21.15.6:0/1421225180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa51c00db20 con 0x7fa524101850 2023-09-13T09:47:19.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.699+0000 7fa51bfff700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5100a0640 0x7fa5100a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.699+0000 7fa51bfff700 1 -- 172.21.15.6:0/1421225180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa51c0cb360 con 0x7fa524101850 2023-09-13T09:47:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.699+0000 7fa522d9d700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5100a0640 0x7fa5100a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa522d9d700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5100a0640 0x7fa5100a2b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa524100d10 tx=0x7fa514009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 Processor -- start 2023-09-13T09:47:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 -- start start 2023-09-13T09:47:19.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc030f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f9060 0x55dc030f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc03050780 con 0x55dc030f9060 2023-09-13T09:47:19.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0304e0a0 con 0x55dc030f8700 2023-09-13T09:47:19.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc03049990 con 0x55dc030f7a00 2023-09-13T09:47:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa52259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f9060 0x55dc030f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc030f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc030f8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60416/0 (socket says 172.21.15.6:60416) 2023-09-13T09:47:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa52259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f9060 0x55dc030f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38662/0 (socket says 172.21.15.6:38662) 2023-09-13T09:47:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa522d9d700 1 -- 172.21.15.6:0/1700584922 learned_addr learned my addr 172.21.15.6:0/1700584922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.700+0000 7fa52359e700 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa522d9d700 1 -- 172.21.15.6:0/1700584922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 msgr2=0x55dc030f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa522d9d700 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa522d9d700 1 -- 172.21.15.6:0/1700584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f9060 msgr2=0x55dc030f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa522d9d700 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f9060 0x55dc030f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa522d9d700 1 -- 172.21.15.6:0/1700584922 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc02ec9630 con 0x55dc030f8700 2023-09-13T09:47:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa52259c700 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f9060 0x55dc030f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa52359e700 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa522d9d700 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc030f8b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa514011d50 tx=0x7fa514014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bb1de31e61f24b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa5197fa700 1 -- 172.21.15.6:0/1700584922 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400ed20 con 0x55dc030f8700 2023-09-13T09:47:19.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa5197fa700 1 -- 172.21.15.6:0/1700584922 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa514021070 con 0x55dc030f8700 2023-09-13T09:47:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.701+0000 7fa5197fa700 1 -- 172.21.15.6:0/1700584922 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51401d410 con 0x55dc030f8700 2023-09-13T09:47:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1700584922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 msgr2=0x55dc030f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc030f8b20 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa514011d50 tx=0x7fa514014000 comp rx=0 tx=0).stop 2023-09-13T09:47:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1700584922 shutdown_connections 2023-09-13T09:47:19.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc030f8b20 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1700584922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f9060 0x55dc030f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1700584922 >> 172.21.15.6:0/1700584922 conn(0x55dc03055c80 msgr2=0x55dc030f1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1700584922 shutdown_connections 2023-09-13T09:47:19.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1700584922 wait complete. 2023-09-13T09:47:19.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 -- start start 2023-09-13T09:47:19.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.702+0000 7fa5352d6b80 1 Processor -- start 2023-09-13T09:47:19.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03100ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03101430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc03108470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc02fe7bb0 con 0x55dc030f7a00 2023-09-13T09:47:19.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc02fe78b0 con 0x55dc030f8700 2023-09-13T09:47:19.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc02ecb920 con 0x55dc030f9060 2023-09-13T09:47:19.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa5352d6b80 10 client.0 _ll_register_callbacks cb 0x55dc02fe5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:19.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03100ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03100ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38666/0 (socket says 172.21.15.6:38666) 2023-09-13T09:47:19.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa522d9d700 1 -- 172.21.15.6:0/2902908755 learned_addr learned my addr 172.21.15.6:0/2902908755 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52259c700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03101430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52359e700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc03108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52259c700 1 -- 172.21.15.6:0/2902908755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 msgr2=0x55dc03108470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52259c700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc03108470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52259c700 1 -- 172.21.15.6:0/2902908755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 msgr2=0x55dc03100ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52259c700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03100ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52259c700 1 -- 172.21.15.6:0/2902908755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa514017070 con 0x55dc030f8700 2023-09-13T09:47:19.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa522d9d700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa52259c700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03101430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009fd0 tx=0x7fa50c003b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42049be8711e1360 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa50a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:47:19.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.703+0000 7fa50a7fc700 1 -- 172.21.15.6:0/2902908755 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c005240 con 0x55dc030f8700 2023-09-13T09:47:19.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc030ea670 con 0x55dc030f8700 2023-09-13T09:47:19.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa50a7fc700 1 -- 172.21.15.6:0/2902908755 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa50c0053a0 con 0x55dc030f8700 2023-09-13T09:47:19.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa50a7fc700 1 -- 172.21.15.6:0/2902908755 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa50c005560 con 0x55dc030f8700 2023-09-13T09:47:19.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 10 client.26870 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:19.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55dc030617a0 con 0x55dc030f8700 2023-09-13T09:47:19.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa50a7fc700 1 -- 172.21.15.6:0/2902908755 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa50c033080 con 0x55dc030f8700 2023-09-13T09:47:19.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa50a7fc700 1 -- 172.21.15.6:0/2902908755 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa50c02f430 con 0x55dc030f8700 2023-09-13T09:47:19.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 10 client.26870 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:19.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 10 client.26870 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:47:19.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 20 client.26870 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:19.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc0310ccc0 0x55dc0310f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 4 client.26870 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:19.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc03042970 con 0x55dc0310ccc0 2023-09-13T09:47:19.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.704+0000 7fa522d9d700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc0310ccc0 0x55dc0310f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.705+0000 7fa50a7fc700 10 client.26870 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:19.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.705+0000 7fa522d9d700 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc0310ccc0 0x55dc0310f0e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4ff8d6f073ec8ba6 server_cookie=935f6c6cee138138 in_seq=0 out_seq=0 2023-09-13T09:47:19.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.705+0000 7fa50a7fc700 1 -- 172.21.15.6:0/2902908755 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dc03042970 con 0x55dc0310ccc0 2023-09-13T09:47:19.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.705+0000 7fa50a7fc700 10 client.26870 handle_command_reply: tid=0 2023-09-13T09:47:19.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.705+0000 7fa5352d6b80 1 client.26870 shutdown 2023-09-13T09:47:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 msgr2=0x55dc03101430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03101430 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa50c009fd0 tx=0x7fa50c003b40 comp rx=0 tx=0).stop 2023-09-13T09:47:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 shutdown_connections 2023-09-13T09:47:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc0310ccc0 0x55dc0310f0e0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc03108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa50a7fc700 0 client.26870 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:19.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/2902908755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03101430 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 >> 172.21.15.6:0/2902908755 conn(0x55dc03055c80 msgr2=0x55dc030ec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 shutdown_connections 2023-09-13T09:47:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 1 -- 172.21.15.6:0/2902908755 wait complete. 2023-09-13T09:47:19.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.706+0000 7fa5352d6b80 20 client.26870 trim_cache size 0 max 16384 2023-09-13T09:47:19.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 Processor -- start 2023-09-13T09:47:19.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 -- start start 2023-09-13T09:47:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f8700 0x55dc03108430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f9060 0x55dc03100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc030f3a10 con 0x55dc030f8700 2023-09-13T09:47:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc030ee8e0 con 0x55dc030f9060 2023-09-13T09:47:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc03101b70 con 0x55dc030f7a00 2023-09-13T09:47:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.722+0000 7fa52259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f8700 0x55dc03108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52359e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f9060 0x55dc03100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f8700 0x55dc03108430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38674/0 (socket says 172.21.15.6:38674) 2023-09-13T09:47:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 -- 172.21.15.6:0/1708140933 learned_addr learned my addr 172.21.15.6:0/1708140933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 -- 172.21.15.6:0/1708140933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 msgr2=0x55dc030f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 -- 172.21.15.6:0/1708140933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f9060 msgr2=0x55dc03100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f9060 0x55dc03100ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 -- 172.21.15.6:0/1708140933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc02e75de0 con 0x55dc030f8700 2023-09-13T09:47:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa522d9d700 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52359e700 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f9060 0x55dc03100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa52259c700 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f8700 0x55dc03108430 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00bf40 tx=0x7fa50c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b312650a2d1faf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa519ffb700 1 -- 172.21.15.6:0/1708140933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c037030 con 0x55dc030f8700 2023-09-13T09:47:19.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa519ffb700 1 -- 172.21.15.6:0/1708140933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dc030ea670 con 0x55dc030f8700 2023-09-13T09:47:19.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.723+0000 7fa519ffb700 1 -- 172.21.15.6:0/1708140933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50c0246e0 con 0x55dc030f8700 2023-09-13T09:47:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1708140933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f8700 msgr2=0x55dc03108430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f8700 0x55dc03108430 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fa50c00bf40 tx=0x7fa50c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1708140933 shutdown_connections 2023-09-13T09:47:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f9060 0x55dc03100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f7a00 0x55dc030f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/1708140933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f8700 0x55dc03108430 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1708140933 >> 172.21.15.6:0/1708140933 conn(0x55dc03055c80 msgr2=0x55dc030f1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1708140933 shutdown_connections 2023-09-13T09:47:19.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 -- 172.21.15.6:0/1708140933 wait complete. 2023-09-13T09:47:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.724+0000 7fa5352d6b80 1 -- start start 2023-09-13T09:47:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 1 Processor -- start 2023-09-13T09:47:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03104660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03104ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc031077b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc03107cf0 con 0x55dc030f7a00 2023-09-13T09:47:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc03107e60 con 0x55dc030f8700 2023-09-13T09:47:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc03108020 con 0x55dc030f9060 2023-09-13T09:47:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa5352d6b80 10 client.0 _ll_register_callbacks cb 0x55dc02fe5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03104660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03104660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38680/0 (socket says 172.21.15.6:38680) 2023-09-13T09:47:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 -- 172.21.15.6:0/3650528580 learned_addr learned my addr 172.21.15.6:0/3650528580 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa52259c700 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03104ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa52359e700 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc031077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 -- 172.21.15.6:0/3650528580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 msgr2=0x55dc031077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc031077b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 -- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 msgr2=0x55dc03104ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03104ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 -- 172.21.15.6:0/3650528580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa51402a040 con 0x55dc030f7a00 2023-09-13T09:47:19.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa522d9d700 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03104660 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa514005950 tx=0x7fa514005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd61fc58e27852c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.725+0000 7fa50a7fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa50a7fc700 1 -- 172.21.15.6:0/3650528580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51400edc0 con 0x55dc030f7a00 2023-09-13T09:47:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa50a7fc700 1 -- 172.21.15.6:0/3650528580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa514032a20 con 0x55dc030f7a00 2023-09-13T09:47:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa514021070 con 0x55dc030f7a00 2023-09-13T09:47:19.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa50a7fc700 1 -- 172.21.15.6:0/3650528580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa514032c20 con 0x55dc030f7a00 2023-09-13T09:47:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 10 client.17466 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fa51c021070 con 0x55dc030f7a00 2023-09-13T09:47:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa50a7fc700 1 -- 172.21.15.6:0/3650528580 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa514021070 con 0x55dc030f7a00 2023-09-13T09:47:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa50a7fc700 1 -- 172.21.15.6:0/3650528580 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa51403a020 con 0x55dc030f7a00 2023-09-13T09:47:19.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 10 client.17466 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 10 client.17466 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:47:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 20 client.17466 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc03161b90 0x55dc03163fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 4 client.17466 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:19.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dc03003050 con 0x55dc03161b90 2023-09-13T09:47:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.726+0000 7fa52259c700 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc03161b90 0x55dc03163fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa50a7fc700 10 client.17466 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa52259c700 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc03161b90 0x55dc03163fb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ea731cb82cfc37cf server_cookie=ac850c1b73aa509a in_seq=0 out_seq=0 2023-09-13T09:47:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa50a7fc700 1 -- 172.21.15.6:0/3650528580 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dc03003050 con 0x55dc03161b90 2023-09-13T09:47:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa50a7fc700 10 client.17466 handle_command_reply: tid=0 2023-09-13T09:47:19.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 client.17466 shutdown 2023-09-13T09:47:19.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 msgr2=0x55dc03104660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03104660 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fa514005950 tx=0x7fa514005cb0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 shutdown_connections 2023-09-13T09:47:19.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55dc03161b90 0x55dc03163fb0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dc030f9060 0x55dc031077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dc030f7a00 0x55dc03104660 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 --2- 172.21.15.6:0/3650528580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dc030f8700 0x55dc03104ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa50a7fc700 0 client.17466 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 >> 172.21.15.6:0/3650528580 conn(0x55dc03055c80 msgr2=0x55dc030fb980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 shutdown_connections 2023-09-13T09:47:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 1 -- 172.21.15.6:0/3650528580 wait complete. 2023-09-13T09:47:19.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.727+0000 7fa5352d6b80 20 client.17466 trim_cache size 0 max 16384 2023-09-13T09:47:19.753 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5100a0640 msgr2=0x7fa5100a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5100a0640 0x7fa5100a2b00 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa524100d10 tx=0x7fa514009260 comp rx=0 tx=0).stop 2023-09-13T09:47:19.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524101850 msgr2=0x7fa52419e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524101850 0x7fa52419e050 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fa51c007ee0 tx=0x7fa51c00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 shutdown_connections 2023-09-13T09:47:19.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5100a0640 0x7fa5100a2b00 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa524101850 0x7fa52419e050 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5240ffcc0 0x7fa524196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 --2- 172.21.15.6:0/1421225180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa524100eb0 0x7fa524196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 >> 172.21.15.6:0/1421225180 conn(0x7fa5240fb250 msgr2=0x7fa5240fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 shutdown_connections 2023-09-13T09:47:19.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.728+0000 7fa5290f1700 1 -- 172.21.15.6:0/1421225180 wait complete. 2023-09-13T09:47:19.758 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:47:19.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 -- 172.21.15.6:0/2990860221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 msgr2=0x7f2db41080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2990860221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 0x7f2db41080e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f2dac00b0d0 tx=0x7f2dac00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 -- 172.21.15.6:0/2990860221 shutdown_connections 2023-09-13T09:47:19.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2990860221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 0x7f2db41080e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2990860221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 0x7f2db41000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2990860221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2db4100e90 0x7f2db41012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 -- 172.21.15.6:0/2990860221 >> 172.21.15.6:0/2990860221 conn(0x7f2db40fb1f0 msgr2=0x7f2db40fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 -- 172.21.15.6:0/2990860221 shutdown_connections 2023-09-13T09:47:19.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.899+0000 7f2dbb095700 1 -- 172.21.15.6:0/2990860221 wait complete. 2023-09-13T09:47:19.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 Processor -- start 2023-09-13T09:47:19.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 -- start start 2023-09-13T09:47:19.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 0x7f2db4196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2db4100e90 0x7f2db4197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 0x7f2db419e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db419e6b0 con 0x7f2db4101830 2023-09-13T09:47:19.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db419e7f0 con 0x7f2db40ffca0 2023-09-13T09:47:19.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2dbb095700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db419e980 con 0x7f2db4100e90 2023-09-13T09:47:19.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2db9632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 0x7f2db419e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2db8e31700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 0x7f2db4196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2db8e31700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 0x7f2db4196b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60450/0 (socket says 172.21.15.6:60450) 2023-09-13T09:47:19.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2db9632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 0x7f2db419e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38696/0 (socket says 172.21.15.6:38696) 2023-09-13T09:47:19.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2db8e31700 1 -- 172.21.15.6:0/2996558645 learned_addr learned my addr 172.21.15.6:0/2996558645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.900+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2db4100e90 0x7f2db4197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db8e31700 1 -- 172.21.15.6:0/2996558645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2db4100e90 msgr2=0x7f2db4197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db8e31700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2db4100e90 0x7f2db4197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db8e31700 1 -- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 msgr2=0x7f2db419e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db8e31700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 0x7f2db419e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db8e31700 1 -- 172.21.15.6:0/2996558645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac009d00 con 0x7f2db40ffca0 2023-09-13T09:47:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2db4100e90 0x7f2db4197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db8e31700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 0x7f2db4196b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2da800e970 tx=0x7f2da800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db1ffb700 1 -- 172.21.15.6:0/2996558645 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8009790 con 0x7f2db40ffca0 2023-09-13T09:47:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db419ec60 con 0x7f2db40ffca0 2023-09-13T09:47:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db1ffb700 1 -- 172.21.15.6:0/2996558645 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2da800c7e0 con 0x7f2db40ffca0 2023-09-13T09:47:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2db1ffb700 1 -- 172.21.15.6:0/2996558645 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da8003c70 con 0x7f2db40ffca0 2023-09-13T09:47:19.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.901+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db419f170 con 0x7f2db40ffca0 2023-09-13T09:47:19.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.903+0000 7f2db1ffb700 1 -- 172.21.15.6:0/2996558645 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2da800cc50 con 0x7f2db40ffca0 2023-09-13T09:47:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.904+0000 7f2db1ffb700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2da40a0640 0x7f2da40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.904+0000 7f2db1ffb700 1 -- 172.21.15.6:0/2996558645 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2da8014070 con 0x7f2db40ffca0 2023-09-13T09:47:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.904+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2da40a0640 0x7f2da40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.905+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2da40a0640 0x7f2da40a2b00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2da0011490 tx=0x7f2da0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 Processor -- start 2023-09-13T09:47:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 -- start start 2023-09-13T09:47:19.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975711b10 0x558975711f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975712470 0x5589757108d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975711270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558975665780 con 0x558975710e10 2023-09-13T09:47:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589756630a0 con 0x558975712470 2023-09-13T09:47:19.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55897565e990 con 0x558975711b10 2023-09-13T09:47:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975712470 0x5589757108d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975711270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db8e31700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975711b10 0x558975711f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975711270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38706/0 (socket says 172.21.15.6:38706) 2023-09-13T09:47:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 -- 172.21.15.6:0/2694057580 learned_addr learned my addr 172.21.15.6:0/2694057580 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 -- 172.21.15.6:0/2694057580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975711b10 msgr2=0x558975711f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975711b10 0x558975711f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 -- 172.21.15.6:0/2694057580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975712470 msgr2=0x5589757108d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975712470 0x5589757108d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db9632700 1 -- 172.21.15.6:0/2694057580 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589754de630 con 0x558975710e10 2023-09-13T09:47:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db8e31700 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975711b10 0x558975711f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.906+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975712470 0x5589757108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.907+0000 7f2db9632700 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975711270 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c60 tx=0x7f2dac009c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6cb3d8637474e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.907+0000 7f2d9effd700 1 -- 172.21.15.6:0/2694057580 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac00e040 con 0x558975710e10 2023-09-13T09:47:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.907+0000 7f2d9effd700 1 -- 172.21.15.6:0/2694057580 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2dac00baa0 con 0x558975710e10 2023-09-13T09:47:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.907+0000 7f2d9effd700 1 -- 172.21.15.6:0/2694057580 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac005070 con 0x558975710e10 2023-09-13T09:47:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.907+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2694057580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 msgr2=0x558975711270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.907+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975711270 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009c60 tx=0x7f2dac009c90 comp rx=0 tx=0).stop 2023-09-13T09:47:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2694057580 shutdown_connections 2023-09-13T09:47:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975711270 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975711b10 0x558975711f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2694057580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975712470 0x5589757108d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2694057580 >> 172.21.15.6:0/2694057580 conn(0x55897566ac80 msgr2=0x558975706f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2694057580 shutdown_connections 2023-09-13T09:47:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2694057580 wait complete. 2023-09-13T09:47:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- start start 2023-09-13T09:47:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 Processor -- start 2023-09-13T09:47:19.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975710e10 0x55897571a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x55897571a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975712470 0x558975721810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589755fcbb0 con 0x558975712470 2023-09-13T09:47:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589755fc8b0 con 0x558975711b10 2023-09-13T09:47:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.908+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589754e0920 con 0x558975710e10 2023-09-13T09:47:19.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2dc727ab80 10 client.0 _ll_register_callbacks cb 0x5589755fa680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975710e10 0x55897571a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x55897571a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975710e10 0x55897571a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41762/0 (socket says 172.21.15.6:41762) 2023-09-13T09:47:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 -- 172.21.15.6:0/1562535656 learned_addr learned my addr 172.21.15.6:0/1562535656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db3fff700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x55897571a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60466/0 (socket says 172.21.15.6:60466) 2023-09-13T09:47:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db9632700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975712470 0x558975721810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 -- 172.21.15.6:0/1562535656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 msgr2=0x55897571a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x55897571a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 -- 172.21.15.6:0/1562535656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975712470 msgr2=0x558975721810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975712470 0x558975721810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 -- 172.21.15.6:0/1562535656 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db4108a30 con 0x558975710e10 2023-09-13T09:47:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db3fff700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x55897571a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2db8e31700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975710e10 0x55897571a290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2da8095fb0 tx=0x7f2da8003dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2aa5c98d2a55da server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2d93fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:47:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2d93fff700 1 -- 172.21.15.6:0/1562535656 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da809d170 con 0x558975710e10 2023-09-13T09:47:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2d93fff700 1 -- 172.21.15.6:0/1562535656 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2da809d370 con 0x558975710e10 2023-09-13T09:47:19.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589756ff670 con 0x558975710e10 2023-09-13T09:47:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.909+0000 7f2d93fff700 1 -- 172.21.15.6:0/1562535656 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2da80a15b0 con 0x558975710e10 2023-09-13T09:47:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 10 client.26824 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5589756767a0 con 0x558975710e10 2023-09-13T09:47:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2d93fff700 1 -- 172.21.15.6:0/1562535656 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5589756ff670 con 0x558975710e10 2023-09-13T09:47:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2d93fff700 1 -- 172.21.15.6:0/1562535656 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2da8065130 con 0x558975710e10 2023-09-13T09:47:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 10 client.26824 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 10 client.26824 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:47:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 20 client.26824 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x558975726060 0x558975728480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 4 client.26824 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558975657970 con 0x558975726060 2023-09-13T09:47:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2db3fff700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x558975726060 0x558975728480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2d93fff700 10 client.26824 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.910+0000 7f2db3fff700 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x558975726060 0x558975728480 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c6912b102f02fecb server_cookie=1650a9f73a4b2096 in_seq=0 out_seq=0 2023-09-13T09:47:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2d93fff700 1 -- 172.21.15.6:0/1562535656 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558975657970 con 0x558975726060 2023-09-13T09:47:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2d93fff700 10 client.26824 handle_command_reply: tid=0 2023-09-13T09:47:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 client.26824 shutdown 2023-09-13T09:47:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975710e10 msgr2=0x55897571a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975710e10 0x55897571a290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2da8095fb0 tx=0x7f2da8003dd0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 shutdown_connections 2023-09-13T09:47:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x558975726060 0x558975728480 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975712470 0x558975721810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975710e10 0x55897571a290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2d93fff700 0 client.26824 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/1562535656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x55897571a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.911+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 >> 172.21.15.6:0/1562535656 conn(0x55897566ac80 msgr2=0x558975706ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.912+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 shutdown_connections 2023-09-13T09:47:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.912+0000 7f2dc727ab80 1 -- 172.21.15.6:0/1562535656 wait complete. 2023-09-13T09:47:19.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.912+0000 7f2dc727ab80 20 client.26824 trim_cache size 0 max 16384 2023-09-13T09:47:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 Processor -- start 2023-09-13T09:47:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 -- start start 2023-09-13T09:47:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975707920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x5589757217d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x558975706ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589757074b0 con 0x558975710e10 2023-09-13T09:47:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558975715820 con 0x558975711b10 2023-09-13T09:47:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558975725d60 con 0x558975712470 2023-09-13T09:47:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2db8e31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975707920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2db3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x5589757217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2db9632700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x558975706ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2db3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x5589757217d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60474/0 (socket says 172.21.15.6:60474) 2023-09-13T09:47:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2db8e31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975707920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38716/0 (socket says 172.21.15.6:38716) 2023-09-13T09:47:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.925+0000 7f2db3fff700 1 -- 172.21.15.6:0/2656554066 learned_addr learned my addr 172.21.15.6:0/2656554066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2db3fff700 1 -- 172.21.15.6:0/2656554066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 msgr2=0x558975706ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2656554066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x558975706ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2db3fff700 1 -- 172.21.15.6:0/2656554066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 msgr2=0x558975707920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2656554066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975707920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2db3fff700 1 -- 172.21.15.6:0/2656554066 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55897548ade0 con 0x558975711b10 2023-09-13T09:47:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2db3fff700 1 --2- 172.21.15.6:0/2656554066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x5589757217d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x558975728d60 tx=0x7f2da0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a11ee04f5fd21e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2d9f7fe700 1 -- 172.21.15.6:0/2656554066 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0024040 con 0x558975711b10 2023-09-13T09:47:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2d9f7fe700 1 -- 172.21.15.6:0/2656554066 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2da0003c00 con 0x558975711b10 2023-09-13T09:47:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.926+0000 7f2d9f7fe700 1 -- 172.21.15.6:0/2656554066 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da001ed10 con 0x558975711b10 2023-09-13T09:47:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2656554066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 msgr2=0x5589757217d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2656554066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x5589757217d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x558975728d60 tx=0x7f2da0014000 comp rx=0 tx=0).stop 2023-09-13T09:47:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2656554066 shutdown_connections 2023-09-13T09:47:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2656554066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x558975706ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2656554066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975710e10 0x558975707920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/2656554066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975711b10 0x5589757217d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2656554066 >> 172.21.15.6:0/2656554066 conn(0x55897566ac80 msgr2=0x5589757111f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2656554066 shutdown_connections 2023-09-13T09:47:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 -- 172.21.15.6:0/2656554066 wait complete. 2023-09-13T09:47:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.927+0000 7f2dc727ab80 1 -- start start 2023-09-13T09:47:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 1 Processor -- start 2023-09-13T09:47:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975710e10 0x55897570de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975711b10 0x55897570e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x5589757217a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55897570f360 con 0x558975711b10 2023-09-13T09:47:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55897570f4d0 con 0x558975710e10 2023-09-13T09:47:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55897570f690 con 0x558975712470 2023-09-13T09:47:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2dc727ab80 10 client.0 _ll_register_callbacks cb 0x5589755fa680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975711b10 0x55897570e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975711b10 0x55897570e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38724/0 (socket says 172.21.15.6:38724) 2023-09-13T09:47:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 -- 172.21.15.6:0/3557944524 learned_addr learned my addr 172.21.15.6:0/3557944524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db8e31700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975710e10 0x55897570de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db9632700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x5589757217a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 -- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 msgr2=0x5589757217a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x5589757217a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 -- 172.21.15.6:0/3557944524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975710e10 msgr2=0x55897570de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975710e10 0x55897570de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db3fff700 1 -- 172.21.15.6:0/3557944524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2da0029900 con 0x558975711b10 2023-09-13T09:47:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.928+0000 7f2db8e31700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975710e10 0x55897570de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2db3fff700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975711b10 0x55897570e350 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2da002afd0 tx=0x7f2da00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc68797deca51b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2d93fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2d93fff700 1 -- 172.21.15.6:0/3557944524 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da0022070 con 0x558975711b10 2023-09-13T09:47:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2dac00baa0 con 0x558975711b10 2023-09-13T09:47:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2d93fff700 1 -- 172.21.15.6:0/3557944524 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2da001e3f0 con 0x558975711b10 2023-09-13T09:47:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2d93fff700 1 -- 172.21.15.6:0/3557944524 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2da0024040 con 0x558975711b10 2023-09-13T09:47:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2dc727ab80 10 client.17484 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558975473c60 con 0x558975711b10 2023-09-13T09:47:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.929+0000 7f2d93fff700 1 -- 172.21.15.6:0/3557944524 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2dac00baa0 con 0x558975711b10 2023-09-13T09:47:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2d93fff700 1 -- 172.21.15.6:0/3557944524 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2da0033820 con 0x558975711b10 2023-09-13T09:47:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2dc727ab80 10 client.17484 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2dc727ab80 10 client.17484 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:47:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2dc727ab80 20 client.17484 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5589757765a0 0x5589757789c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2dc727ab80 4 client.17484 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558975618050 con 0x5589757765a0 2023-09-13T09:47:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2db8e31700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5589757765a0 0x5589757789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2d93fff700 10 client.17484 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2db8e31700 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5589757765a0 0x5589757789c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2ed5857ccd09472 server_cookie=adb73821f8b25f35 in_seq=0 out_seq=0 2023-09-13T09:47:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2d93fff700 1 -- 172.21.15.6:0/3557944524 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558975618050 con 0x5589757765a0 2023-09-13T09:47:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2d93fff700 10 client.17484 handle_command_reply: tid=0 2023-09-13T09:47:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.930+0000 7f2dc727ab80 1 client.17484 shutdown 2023-09-13T09:47:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975711b10 msgr2=0x55897570e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975711b10 0x55897570e350 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f2da002afd0 tx=0x7f2da00057f0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 shutdown_connections 2023-09-13T09:47:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5589757765a0 0x5589757789c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558975712470 0x5589757217a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558975710e10 0x55897570de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 --2- 172.21.15.6:0/3557944524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558975711b10 0x55897570e350 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 >> 172.21.15.6:0/3557944524 conn(0x55897566ac80 msgr2=0x558975718180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2d93fff700 0 client.17484 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 shutdown_connections 2023-09-13T09:47:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 1 -- 172.21.15.6:0/3557944524 wait complete. 2023-09-13T09:47:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.931+0000 7f2dc727ab80 20 client.17484 trim_cache size 0 max 16384 2023-09-13T09:47:19.961 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2da40a0640 msgr2=0x7f2da40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2da40a0640 0x7f2da40a2b00 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f2da0011490 tx=0x7f2da0009260 comp rx=0 tx=0).stop 2023-09-13T09:47:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 msgr2=0x7f2db4196b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 0x7f2db4196b30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f2da800e970 tx=0x7f2da800ec80 comp rx=0 tx=0).stop 2023-09-13T09:47:19.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 shutdown_connections 2023-09-13T09:47:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2da40a0640 0x7f2da40a2b00 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2db4101830 0x7f2db419e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2db40ffca0 0x7f2db4196b30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 --2- 172.21.15.6:0/2996558645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2db4100e90 0x7f2db4197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 >> 172.21.15.6:0/2996558645 conn(0x7f2db40fb1f0 msgr2=0x7f2db40691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 shutdown_connections 2023-09-13T09:47:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:19.932+0000 7f2dbb095700 1 -- 172.21.15.6:0/2996558645 wait complete. 2023-09-13T09:47:19.965 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:47:20.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.106+0000 7f6a904a3700 1 -- 172.21.15.6:0/3333027391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88102950 msgr2=0x7f6a88109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.106+0000 7f6a904a3700 1 --2- 172.21.15.6:0/3333027391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88102950 0x7f6a88109200 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a80009fc0 tx=0x7f6a8000b330 comp rx=0 tx=0).stop 2023-09-13T09:47:20.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.106+0000 7f6a904a3700 1 -- 172.21.15.6:0/3333027391 shutdown_connections 2023-09-13T09:47:20.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.106+0000 7f6a904a3700 1 --2- 172.21.15.6:0/3333027391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88102950 0x7f6a88109200 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.106+0000 7f6a904a3700 1 --2- 172.21.15.6:0/3333027391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a88100dc0 0x7f6a881011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.106+0000 7f6a904a3700 1 --2- 172.21.15.6:0/3333027391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88101fb0 0x7f6a88102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.106+0000 7f6a904a3700 1 -- 172.21.15.6:0/3333027391 >> 172.21.15.6:0/3333027391 conn(0x7f6a880fc330 msgr2=0x7f6a880fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 -- 172.21.15.6:0/3333027391 shutdown_connections 2023-09-13T09:47:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 -- 172.21.15.6:0/3333027391 wait complete. 2023-09-13T09:47:20.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 Processor -- start 2023-09-13T09:47:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 -- start start 2023-09-13T09:47:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88100dc0 0x7f6a8819d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88101fb0 0x7f6a8819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a88102950 0x7f6a881a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881a4cd0 con 0x7f6a88102950 2023-09-13T09:47:20.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881a4e10 con 0x7f6a88100dc0 2023-09-13T09:47:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.107+0000 7f6a904a3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a881a4fa0 con 0x7f6a88101fb0 2023-09-13T09:47:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88100dc0 0x7f6a8819d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88100dc0 0x7f6a8819d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60492/0 (socket says 172.21.15.6:60492) 2023-09-13T09:47:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 -- 172.21.15.6:0/2946752881 learned_addr learned my addr 172.21.15.6:0/2946752881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a88102950 0x7f6a881a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88101fb0 0x7f6a8819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 -- 172.21.15.6:0/2946752881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88101fb0 msgr2=0x7f6a8819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88101fb0 0x7f6a8819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 -- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a88102950 msgr2=0x7f6a881a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a88102950 0x7f6a881a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 -- 172.21.15.6:0/2946752881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a80009c40 con 0x7f6a88100dc0 2023-09-13T09:47:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88100dc0 0x7f6a8819d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e9f0 tx=0x7f6a8400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a7f7fe700 1 -- 172.21.15.6:0/2946752881 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84004220 con 0x7f6a88100dc0 2023-09-13T09:47:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a7f7fe700 1 -- 172.21.15.6:0/2946752881 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a84004380 con 0x7f6a88100dc0 2023-09-13T09:47:20.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a881a5280 con 0x7f6a88100dc0 2023-09-13T09:47:20.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a7f7fe700 1 -- 172.21.15.6:0/2946752881 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84003be0 con 0x7f6a88100dc0 2023-09-13T09:47:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.108+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a881a57e0 con 0x7f6a88100dc0 2023-09-13T09:47:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.111+0000 7f6a7f7fe700 1 -- 172.21.15.6:0/2946752881 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6a84003d40 con 0x7f6a88100dc0 2023-09-13T09:47:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.112+0000 7f6a7f7fe700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6a740a06c0 0x7f6a740a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6a740a06c0 0x7f6a740a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a7f7fe700 1 -- 172.21.15.6:0/2946752881 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6a84014070 con 0x7f6a88100dc0 2023-09-13T09:47:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 Processor -- start 2023-09-13T09:47:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 -- start start 2023-09-13T09:47:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc9700 0x557b12dc9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dc84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6a740a06c0 0x7f6a740a2b80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009c60 tx=0x7f6a78009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc8a00 0x557b12dc8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12d21780 con 0x557b12dca060 2023-09-13T09:47:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12d1f0a0 con 0x557b12dc9700 2023-09-13T09:47:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12d1a990 con 0x557b12dc8a00 2023-09-13T09:47:20.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.113+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc9700 0x557b12dc9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8da3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dc84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc9700 0x557b12dc9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60500/0 (socket says 172.21.15.6:60500) 2023-09-13T09:47:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 -- 172.21.15.6:0/851117147 learned_addr learned my addr 172.21.15.6:0/851117147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc8a00 0x557b12dc8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 -- 172.21.15.6:0/851117147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc8a00 msgr2=0x557b12dc8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc8a00 0x557b12dc8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 -- 172.21.15.6:0/851117147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 msgr2=0x557b12dc84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dc84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 -- 172.21.15.6:0/851117147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b12b9a630 con 0x557b12dc9700 2023-09-13T09:47:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc9700 0x557b12dc9b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a840a0ea0 tx=0x7f6a84009530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfd8ba22fbe91cce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a7cd82700 1 -- 172.21.15.6:0/851117147 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84099a60 con 0x557b12dc9700 2023-09-13T09:47:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a7cd82700 1 -- 172.21.15.6:0/851117147 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a84099360 con 0x557b12dc9700 2023-09-13T09:47:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.114+0000 7f6a7cd82700 1 -- 172.21.15.6:0/851117147 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840995c0 con 0x557b12dc9700 2023-09-13T09:47:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 -- 172.21.15.6:0/851117147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc9700 msgr2=0x557b12dc9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc9700 0x557b12dc9b20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6a840a0ea0 tx=0x7f6a84009530 comp rx=0 tx=0).stop 2023-09-13T09:47:20.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 -- 172.21.15.6:0/851117147 shutdown_connections 2023-09-13T09:47:20.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc8a00 0x557b12dc8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc9700 0x557b12dc9b20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/851117147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dc84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 -- 172.21.15.6:0/851117147 >> 172.21.15.6:0/851117147 conn(0x557b12d26c80 msgr2=0x557b12dc2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 -- 172.21.15.6:0/851117147 shutdown_connections 2023-09-13T09:47:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.115+0000 7f6a9c688b80 1 -- 172.21.15.6:0/851117147 wait complete. 2023-09-13T09:47:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 -- start start 2023-09-13T09:47:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 Processor -- start 2023-09-13T09:47:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dd1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc9700 0x557b12dd2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dca060 0x557b12dd94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12cb8bb0 con 0x557b12dc9700 2023-09-13T09:47:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12cb88b0 con 0x557b12dc8a00 2023-09-13T09:47:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12b9c920 con 0x557b12dca060 2023-09-13T09:47:20.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a9c688b80 10 client.0 _ll_register_callbacks cb 0x557b12cb6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dd1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dd1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60506/0 (socket says 172.21.15.6:60506) 2023-09-13T09:47:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a8e23f700 1 -- 172.21.15.6:0/3759326092 learned_addr learned my addr 172.21.15.6:0/3759326092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc9700 0x557b12dd2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.116+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dca060 0x557b12dd94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a8e23f700 1 -- 172.21.15.6:0/3759326092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dca060 msgr2=0x557b12dd94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dca060 0x557b12dd94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a8e23f700 1 -- 172.21.15.6:0/3759326092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc9700 msgr2=0x557b12dd2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc9700 0x557b12dd2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a8e23f700 1 -- 172.21.15.6:0/3759326092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a881a57e0 con 0x557b12dc8a00 2023-09-13T09:47:20.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dca060 0x557b12dd94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:47:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dd1f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e9c0 tx=0x7f6a840045b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da75a2b3d846949b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:47:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a71ffb700 1 -- 172.21.15.6:0/3759326092 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a840a13d0 con 0x557b12dc8a00 2023-09-13T09:47:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b12dbb670 con 0x557b12dc8a00 2023-09-13T09:47:20.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a71ffb700 1 -- 172.21.15.6:0/3759326092 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6a840b72c0 con 0x557b12dc8a00 2023-09-13T09:47:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a71ffb700 1 -- 172.21.15.6:0/3759326092 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a840995c0 con 0x557b12dc8a00 2023-09-13T09:47:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a9c688b80 10 client.26906 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557b12d327a0 con 0x557b12dc8a00 2023-09-13T09:47:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.117+0000 7f6a71ffb700 1 -- 172.21.15.6:0/3759326092 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a840a5020 con 0x557b12dc8a00 2023-09-13T09:47:20.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a71ffb700 1 -- 172.21.15.6:0/3759326092 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6a84082bb0 con 0x557b12dc8a00 2023-09-13T09:47:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a9c688b80 10 client.26906 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a9c688b80 10 client.26906 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:47:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a9c688b80 20 client.26906 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12ddd8f0 0x557b12ddfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a9c688b80 4 client.26906 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b12d13970 con 0x557b12ddd8f0 2023-09-13T09:47:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12ddd8f0 0x557b12ddfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a71ffb700 10 client.26906 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.118+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12ddd8f0 0x557b12ddfd10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dae19d4238b3edbb server_cookie=3b764453b5277c93 in_seq=0 out_seq=0 2023-09-13T09:47:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a71ffb700 1 -- 172.21.15.6:0/3759326092 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557b12d13970 con 0x557b12ddd8f0 2023-09-13T09:47:20.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a71ffb700 10 client.26906 handle_command_reply: tid=0 2023-09-13T09:47:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 client.26906 shutdown 2023-09-13T09:47:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 msgr2=0x557b12dd1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dd1f40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e9c0 tx=0x7f6a840045b0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 shutdown_connections 2023-09-13T09:47:20.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12ddd8f0 0x557b12ddfd10 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dca060 0x557b12dd94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a71ffb700 0 client.26906 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dd1f40 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/3759326092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc9700 0x557b12dd2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 >> 172.21.15.6:0/3759326092 conn(0x557b12d26c80 msgr2=0x557b12dbd7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 shutdown_connections 2023-09-13T09:47:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 1 -- 172.21.15.6:0/3759326092 wait complete. 2023-09-13T09:47:20.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.119+0000 7f6a9c688b80 20 client.26906 trim_cache size 0 max 16384 2023-09-13T09:47:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 Processor -- start 2023-09-13T09:47:20.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 -- start start 2023-09-13T09:47:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dc84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dc3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dd9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12dc4970 con 0x557b12dca060 2023-09-13T09:47:20.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12dcd480 con 0x557b12dc8a00 2023-09-13T09:47:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12de4a30 con 0x557b12dc9700 2023-09-13T09:47:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a8ea40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dd9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dc84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a8da3e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dc3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a8ea40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dd9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38762/0 (socket says 172.21.15.6:38762) 2023-09-13T09:47:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.133+0000 7f6a8ea40700 1 -- 172.21.15.6:0/1487385553 learned_addr learned my addr 172.21.15.6:0/1487385553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a8ea40700 1 -- 172.21.15.6:0/1487385553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 msgr2=0x557b12dc3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dc3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a8ea40700 1 -- 172.21.15.6:0/1487385553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 msgr2=0x557b12dc84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dc84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a8ea40700 1 -- 172.21.15.6:0/1487385553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b12b46de0 con 0x557b12dca060 2023-09-13T09:47:20.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dc84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dd9450 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6a800094a0 tx=0x7f6a800094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65af856eb605cdfd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a7d583700 1 -- 172.21.15.6:0/1487385553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000e040 con 0x557b12dca060 2023-09-13T09:47:20.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a7d583700 1 -- 172.21.15.6:0/1487385553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a80003a00 con 0x557b12dca060 2023-09-13T09:47:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.134+0000 7f6a7d583700 1 -- 172.21.15.6:0/1487385553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80005040 con 0x557b12dca060 2023-09-13T09:47:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 -- 172.21.15.6:0/1487385553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 msgr2=0x557b12dd9450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dd9450 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f6a800094a0 tx=0x7f6a800094d0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 -- 172.21.15.6:0/1487385553 shutdown_connections 2023-09-13T09:47:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dca060 0x557b12dd9450 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dc8a00 0x557b12dc84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/1487385553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dc3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 -- 172.21.15.6:0/1487385553 >> 172.21.15.6:0/1487385553 conn(0x557b12d26c80 msgr2=0x557b12dc2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 -- 172.21.15.6:0/1487385553 shutdown_connections 2023-09-13T09:47:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 -- 172.21.15.6:0/1487385553 wait complete. 2023-09-13T09:47:20.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 -- start start 2023-09-13T09:47:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.135+0000 7f6a9c688b80 1 Processor -- start 2023-09-13T09:47:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc8a00 0x557b12dd5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dd5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dca060 0x557b12dd88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12dd8de0 con 0x557b12dc8a00 2023-09-13T09:47:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12dd8f50 con 0x557b12dca060 2023-09-13T09:47:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b12dd9110 con 0x557b12dc9700 2023-09-13T09:47:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 10 client.0 _ll_register_callbacks cb 0x557b12cb6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc8a00 0x557b12dd5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc8a00 0x557b12dd5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38764/0 (socket says 172.21.15.6:38764) 2023-09-13T09:47:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 -- 172.21.15.6:0/664025458 learned_addr learned my addr 172.21.15.6:0/664025458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dca060 0x557b12dd88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dd5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 -- 172.21.15.6:0/664025458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 msgr2=0x557b12dd5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dd5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 -- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dca060 msgr2=0x557b12dd88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dca060 0x557b12dd88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 -- 172.21.15.6:0/664025458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b12d327a0 con 0x557b12dc8a00 2023-09-13T09:47:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8ea40700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dca060 0x557b12dd88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a8e23f700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc8a00 0x557b12dd5340 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6a840c99e0 tx=0x7f6a8401f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5aaa2b55499b718 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a71ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a71ffb700 1 -- 172.21.15.6:0/664025458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a84099a60 con 0x557b12dc8a00 2023-09-13T09:47:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a71ffb700 1 -- 172.21.15.6:0/664025458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6a840a6080 con 0x557b12dc8a00 2023-09-13T09:47:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.136+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a84099360 con 0x557b12dc8a00 2023-09-13T09:47:20.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a71ffb700 1 -- 172.21.15.6:0/664025458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a84095500 con 0x557b12dc8a00 2023-09-13T09:47:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 10 client.17502 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f6a88109b50 con 0x557b12dc8a00 2023-09-13T09:47:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a71ffb700 1 -- 172.21.15.6:0/664025458 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6a84099360 con 0x557b12dc8a00 2023-09-13T09:47:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a71ffb700 1 -- 172.21.15.6:0/664025458 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6a840a0f40 con 0x557b12dc8a00 2023-09-13T09:47:20.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 10 client.17502 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 10 client.17502 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:47:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 20 client.17502 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12e322d0 0x557b12e346f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 4 client.17502 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:20.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557b12cd4050 con 0x557b12e322d0 2023-09-13T09:47:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12e322d0 0x557b12e346f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a71ffb700 10 client.17502 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.137+0000 7f6a8da3e700 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12e322d0 0x557b12e346f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2edd8596e7a21b1 server_cookie=9c25ede18bb39365 in_seq=0 out_seq=0 2023-09-13T09:47:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a71ffb700 1 -- 172.21.15.6:0/664025458 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557b12cd4050 con 0x557b12e322d0 2023-09-13T09:47:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a71ffb700 10 client.17502 handle_command_reply: tid=0 2023-09-13T09:47:20.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 client.17502 shutdown 2023-09-13T09:47:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc8a00 msgr2=0x557b12dd5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc8a00 0x557b12dd5340 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f6a840c99e0 tx=0x7f6a8401f650 comp rx=0 tx=0).stop 2023-09-13T09:47:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 shutdown_connections 2023-09-13T09:47:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x557b12e322d0 0x557b12e346f0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557b12dca060 0x557b12dd88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a71ffb700 0 client.17502 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557b12dc8a00 0x557b12dd5340 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 --2- 172.21.15.6:0/664025458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557b12dc9700 0x557b12dd5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 >> 172.21.15.6:0/664025458 conn(0x557b12d26c80 msgr2=0x557b12dcfde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 shutdown_connections 2023-09-13T09:47:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 1 -- 172.21.15.6:0/664025458 wait complete. 2023-09-13T09:47:20.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a9c688b80 20 client.17502 trim_cache size 0 max 16384 2023-09-13T09:47:20.160 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6a740a06c0 msgr2=0x7f6a740a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6a740a06c0 0x7f6a740a2b80 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009c60 tx=0x7f6a78009260 comp rx=0 tx=0).stop 2023-09-13T09:47:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88100dc0 msgr2=0x7f6a8819d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88100dc0 0x7f6a8819d150 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6a8400e9f0 tx=0x7f6a8400ed00 comp rx=0 tx=0).stop 2023-09-13T09:47:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 shutdown_connections 2023-09-13T09:47:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6a740a06c0 0x7f6a740a2b80 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a88102950 0x7f6a881a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6a88100dc0 0x7f6a8819d150 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 --2- 172.21.15.6:0/2946752881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88101fb0 0x7f6a8819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.138+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 >> 172.21.15.6:0/2946752881 conn(0x7f6a880fc330 msgr2=0x7f6a880fe020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.139+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 shutdown_connections 2023-09-13T09:47:20.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.139+0000 7f6a904a3700 1 -- 172.21.15.6:0/2946752881 wait complete. 2023-09-13T09:47:20.164 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:19 smithi006 ceph-mon[98665]: pgmap v534: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 2.3 MiB/s wr, 249 op/s 2023-09-13T09:47:20.164 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:19 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1478790834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:47:20.165 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:47:20.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 353936 5.02 MB/sec execute 280 sec latency 14.241 ms 2023-09-13T09:47:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:19 smithi053 ceph-mon[102373]: pgmap v534: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 2.3 MiB/s wr, 249 op/s 2023-09-13T09:47:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:19 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1478790834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:47:20.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:19 smithi131 ceph-mon[102785]: pgmap v534: 97 pgs: 97 active+clean; 154 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 919 KiB/s rd, 2.3 MiB/s wr, 249 op/s 2023-09-13T09:47:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:19 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1478790834' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:47:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/1895824919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 msgr2=0x7fe1b40ffe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/1895824919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 0x7fe1b40ffe10 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009920 tx=0x7fe1a8009c30 comp rx=0 tx=0).stop 2023-09-13T09:47:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/1895824919 shutdown_connections 2023-09-13T09:47:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/1895824919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4101580 0x7fe1b4107e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/1895824919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 0x7fe1b40ffe10 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/1895824919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b4100be0 0x7fe1b4101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/1895824919 >> 172.21.15.6:0/1895824919 conn(0x7fe1b40faf20 msgr2=0x7fe1b40fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/1895824919 shutdown_connections 2023-09-13T09:47:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/1895824919 wait complete. 2023-09-13T09:47:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.301+0000 7fe1b9f9d700 1 Processor -- start 2023-09-13T09:47:20.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b9f9d700 1 -- start start 2023-09-13T09:47:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b9f9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 0x7fe1b4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b9f9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4100be0 0x7fe1b419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b9f9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b4101580 0x7fe1b419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b9f9d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b419e410 con 0x7fe1b4100be0 2023-09-13T09:47:20.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b9f9d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b419e580 con 0x7fe1b40ff9f0 2023-09-13T09:47:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b9f9d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b419e740 con 0x7fe1b4101580 2023-09-13T09:47:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4100be0 0x7fe1b419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4100be0 0x7fe1b419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38778/0 (socket says 172.21.15.6:38778) 2023-09-13T09:47:20.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 -- 172.21.15.6:0/4275129809 learned_addr learned my addr 172.21.15.6:0/4275129809 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b979c700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b4101580 0x7fe1b419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 0x7fe1b4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 -- 172.21.15.6:0/4275129809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b4101580 msgr2=0x7fe1b419dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b4101580 0x7fe1b419dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 -- 172.21.15.6:0/4275129809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 msgr2=0x7fe1b4068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 0x7fe1b4068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 -- 172.21.15.6:0/4275129809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1ac009d00 con 0x7fe1b4100be0 2023-09-13T09:47:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.302+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4100be0 0x7fe1b419b5e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000e9a0 tx=0x7fe1a000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.303+0000 7fe1b1ffb700 1 -- 172.21.15.6:0/4275129809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0009790 con 0x7fe1b4100be0 2023-09-13T09:47:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.303+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1a8009520 con 0x7fe1b4100be0 2023-09-13T09:47:20.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.303+0000 7fe1b1ffb700 1 -- 172.21.15.6:0/4275129809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1a0010430 con 0x7fe1b4100be0 2023-09-13T09:47:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.303+0000 7fe1b1ffb700 1 -- 172.21.15.6:0/4275129809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a0018680 con 0x7fe1b4100be0 2023-09-13T09:47:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.303+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b419eda0 con 0x7fe1b4100be0 2023-09-13T09:47:20.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.305+0000 7fe1b1ffb700 1 -- 172.21.15.6:0/4275129809 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe1a00105a0 con 0x7fe1b4100be0 2023-09-13T09:47:20.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.306+0000 7fe1b1ffb700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1a40a0640 0x7fe1a40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.306+0000 7fe1b1ffb700 1 -- 172.21.15.6:0/4275129809 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe1a0014070 con 0x7fe1b4100be0 2023-09-13T09:47:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.306+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1a40a0640 0x7fe1a40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.306+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1a40a0640 0x7fe1a40a2b00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80098f0 tx=0x7fe1a8019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.306+0000 7fe1c73e4b80 1 Processor -- start 2023-09-13T09:47:20.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.306+0000 7fe1c73e4b80 1 -- start start 2023-09-13T09:47:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd666740 0x55babd666b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd6670a0 0x55babd6675d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd667b60 0x55babd668010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd5bf780 con 0x55babd667b60 2023-09-13T09:47:20.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd5bd0a0 con 0x55babd6670a0 2023-09-13T09:47:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd5b8990 con 0x55babd666740 2023-09-13T09:47:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd667b60 0x55babd668010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd666740 0x55babd666b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd667b60 0x55babd668010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38788/0 (socket says 172.21.15.6:38788) 2023-09-13T09:47:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 -- 172.21.15.6:0/3006631201 learned_addr learned my addr 172.21.15.6:0/3006631201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd6670a0 0x55babd6675d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 -- 172.21.15.6:0/3006631201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd666740 msgr2=0x55babd666b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd666740 0x55babd666b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 -- 172.21.15.6:0/3006631201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd6670a0 msgr2=0x55babd6675d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd6670a0 0x55babd6675d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 -- 172.21.15.6:0/3006631201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55babd438630 con 0x55babd667b60 2023-09-13T09:47:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd667b60 0x55babd668010 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009530 tx=0x7fe1ac0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e5d7b53fd2f06c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe19effd700 1 -- 172.21.15.6:0/3006631201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00e070 con 0x55babd667b60 2023-09-13T09:47:20.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe19effd700 1 -- 172.21.15.6:0/3006631201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1ac00f040 con 0x55babd667b60 2023-09-13T09:47:20.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.307+0000 7fe19effd700 1 -- 172.21.15.6:0/3006631201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0176c0 con 0x55babd667b60 2023-09-13T09:47:20.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3006631201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd667b60 msgr2=0x55babd668010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd667b60 0x55babd668010 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009530 tx=0x7fe1ac0099e0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3006631201 shutdown_connections 2023-09-13T09:47:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd667b60 0x55babd668010 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd666740 0x55babd666b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3006631201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd6670a0 0x55babd6675d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3006631201 >> 172.21.15.6:0/3006631201 conn(0x55babd5c4c80 msgr2=0x55babd6610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3006631201 shutdown_connections 2023-09-13T09:47:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.308+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3006631201 wait complete. 2023-09-13T09:47:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 -- start start 2023-09-13T09:47:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 Processor -- start 2023-09-13T09:47:20.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd6788e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd678e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd556bb0 con 0x55babd666740 2023-09-13T09:47:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd5568b0 con 0x55babd667b60 2023-09-13T09:47:20.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd43a920 con 0x55babd6670a0 2023-09-13T09:47:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1c73e4b80 10 client.0 _ll_register_callbacks cb 0x55babd554680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd6788e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd6788e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38790/0 (socket says 172.21.15.6:38790) 2023-09-13T09:47:20.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.309+0000 7fe1b8f9b700 1 -- 172.21.15.6:0/3479422115 learned_addr learned my addr 172.21.15.6:0/3479422115 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd678e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b979c700 1 -- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 msgr2=0x55babd678e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd678e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b979c700 1 -- 172.21.15.6:0/3479422115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 msgr2=0x55babd6788e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd6788e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b979c700 1 -- 172.21.15.6:0/3479422115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1ac0091e0 con 0x55babd667b60 2023-09-13T09:47:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd6788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67fe60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009500 tx=0x7fe1ac018b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c09f128b147bd340 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe193fff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:47:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe193fff700 1 -- 172.21.15.6:0/3479422115 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00e040 con 0x55babd667b60 2023-09-13T09:47:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe193fff700 1 -- 172.21.15.6:0/3479422115 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe1ac004cd0 con 0x55babd667b60 2023-09-13T09:47:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.310+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55babd659670 con 0x55babd667b60 2023-09-13T09:47:20.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe193fff700 1 -- 172.21.15.6:0/3479422115 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1ac004e90 con 0x55babd667b60 2023-09-13T09:47:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 10 client.26924 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55babd5d07a0 con 0x55babd667b60 2023-09-13T09:47:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe193fff700 1 -- 172.21.15.6:0/3479422115 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55babd659670 con 0x55babd667b60 2023-09-13T09:47:20.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe193fff700 1 -- 172.21.15.6:0/3479422115 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe1ac0075c0 con 0x55babd667b60 2023-09-13T09:47:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 10 client.26924 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 10 client.26924 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:47:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 20 client.26924 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:20.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd684670 0x55babd686a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 4 client.26924 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55babd5b1970 con 0x55babd684670 2023-09-13T09:47:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.311+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd684670 0x55babd686a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.312+0000 7fe193fff700 10 client.26924 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.312+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd684670 0x55babd686a90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d60e09108eb57c53 server_cookie=881d7d2bef9609e2 in_seq=0 out_seq=0 2023-09-13T09:47:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe193fff700 1 -- 172.21.15.6:0/3479422115 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55babd5b1970 con 0x55babd684670 2023-09-13T09:47:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe193fff700 10 client.26924 handle_command_reply: tid=0 2023-09-13T09:47:20.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 client.26924 shutdown 2023-09-13T09:47:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 msgr2=0x55babd67fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67fe60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac009500 tx=0x7fe1ac018b60 comp rx=0 tx=0).stop 2023-09-13T09:47:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 shutdown_connections 2023-09-13T09:47:20.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd684670 0x55babd686a90 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67fe60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd6788e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3479422115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd678e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe193fff700 0 client.26924 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 >> 172.21.15.6:0/3479422115 conn(0x55babd5c4c80 msgr2=0x55babd6654b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 shutdown_connections 2023-09-13T09:47:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3479422115 wait complete. 2023-09-13T09:47:20.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.313+0000 7fe1c73e4b80 20 client.26924 trim_cache size 0 max 16384 2023-09-13T09:47:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 Processor -- start 2023-09-13T09:47:20.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 -- start start 2023-09-13T09:47:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd666740 0x55babd666b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd6670a0 0x55babd67fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd667b60 0x55babd677f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd659650 con 0x55babd6670a0 2023-09-13T09:47:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd65d8e0 con 0x55babd666740 2023-09-13T09:47:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd662fc0 con 0x55babd667b60 2023-09-13T09:47:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd6670a0 0x55babd67fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd666740 0x55babd666b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd6670a0 0x55babd67fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38800/0 (socket says 172.21.15.6:38800) 2023-09-13T09:47:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd666740 0x55babd666b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60554/0 (socket says 172.21.15.6:60554) 2023-09-13T09:47:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b3fff700 1 -- 172.21.15.6:0/3749266609 learned_addr learned my addr 172.21.15.6:0/3749266609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd667b60 0x55babd677f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b979c700 1 -- 172.21.15.6:0/3749266609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd666740 msgr2=0x55babd666b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd666740 0x55babd666b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b979c700 1 -- 172.21.15.6:0/3749266609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd6670a0 msgr2=0x55babd67fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd6670a0 0x55babd67fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b979c700 1 -- 172.21.15.6:0/3749266609 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55babd3e4de0 con 0x55babd667b60 2023-09-13T09:47:20.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd6670a0 0x55babd67fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.327+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd666740 0x55babd666b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.328+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd667b60 0x55babd677f90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac020940 tx=0x7fe1ac0099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=330f06f8f2ea26a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.328+0000 7fe19f7fe700 1 -- 172.21.15.6:0/3749266609 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac00e040 con 0x55babd667b60 2023-09-13T09:47:20.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.328+0000 7fe19f7fe700 1 -- 172.21.15.6:0/3749266609 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1ac004e30 con 0x55babd667b60 2023-09-13T09:47:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.328+0000 7fe19f7fe700 1 -- 172.21.15.6:0/3749266609 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac020650 con 0x55babd667b60 2023-09-13T09:47:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3749266609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd667b60 msgr2=0x55babd677f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd667b60 0x55babd677f90 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac020940 tx=0x7fe1ac0099e0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3749266609 shutdown_connections 2023-09-13T09:47:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd667b60 0x55babd677f90 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd666740 0x55babd666b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3749266609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd6670a0 0x55babd67fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3749266609 >> 172.21.15.6:0/3749266609 conn(0x55babd5c4c80 msgr2=0x55babd68b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3749266609 shutdown_connections 2023-09-13T09:47:20.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3749266609 wait complete. 2023-09-13T09:47:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- start start 2023-09-13T09:47:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 Processor -- start 2023-09-13T09:47:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd67d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd67d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd67eca0 con 0x55babd666740 2023-09-13T09:47:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.329+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd67ee10 con 0x55babd667b60 2023-09-13T09:47:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1c73e4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55babd67efd0 con 0x55babd6670a0 2023-09-13T09:47:20.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1c73e4b80 10 client.0 _ll_register_callbacks cb 0x55babd554680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd67d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd67d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38804/0 (socket says 172.21.15.6:38804) 2023-09-13T09:47:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 -- 172.21.15.6:0/3767641592 learned_addr learned my addr 172.21.15.6:0/3767641592 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd67d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b979c700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 -- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 msgr2=0x55babd67d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd67d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 -- 172.21.15.6:0/3767641592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 msgr2=0x55babd67e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 -- 172.21.15.6:0/3767641592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b4108780 con 0x55babd666740 2023-09-13T09:47:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd67d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1b8f9b700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd67d2d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009230 tx=0x7fe1a8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d63fb4108b5769 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe193fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:20.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe193fff700 1 -- 172.21.15.6:0/3767641592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1a802a040 con 0x55babd666740 2023-09-13T09:47:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe193fff700 1 -- 172.21.15.6:0/3767641592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe1a8035ce0 con 0x55babd666740 2023-09-13T09:47:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1ac00f040 con 0x55babd666740 2023-09-13T09:47:20.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe193fff700 1 -- 172.21.15.6:0/3767641592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1a8035ea0 con 0x55babd666740 2023-09-13T09:47:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.330+0000 7fe1c73e4b80 10 client.17520 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fe1b419eda0 con 0x55babd666740 2023-09-13T09:47:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe193fff700 1 -- 172.21.15.6:0/3767641592 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe1ac00f040 con 0x55babd666740 2023-09-13T09:47:20.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe193fff700 1 -- 172.21.15.6:0/3767641592 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe1a803b020 con 0x55babd666740 2023-09-13T09:47:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1c73e4b80 10 client.17520 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1c73e4b80 10 client.17520 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:47:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1c73e4b80 20 client.17520 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd6d89c0 0x55babd6dade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1c73e4b80 4 client.17520 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55babd572050 con 0x55babd6d89c0 2023-09-13T09:47:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd6d89c0 0x55babd6dade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe193fff700 10 client.17520 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:20.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.331+0000 7fe1b3fff700 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd6d89c0 0x55babd6dade0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=21c30cb311e1eaac server_cookie=24e8f71e61cc71d4 in_seq=0 out_seq=0 2023-09-13T09:47:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe193fff700 1 -- 172.21.15.6:0/3767641592 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55babd572050 con 0x55babd6d89c0 2023-09-13T09:47:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe193fff700 10 client.17520 handle_command_reply: tid=0 2023-09-13T09:47:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 client.17520 shutdown 2023-09-13T09:47:20.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 msgr2=0x55babd67d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd67d2d0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fe1a8009230 tx=0x7fe1a8009260 comp rx=0 tx=0).stop 2023-09-13T09:47:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 shutdown_connections 2023-09-13T09:47:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55babd6d89c0 0x55babd6dade0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55babd667b60 0x55babd67e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55babd666740 0x55babd67d2d0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 --2- 172.21.15.6:0/3767641592 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55babd6670a0 0x55babd67d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe193fff700 0 client.17520 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:20.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 >> 172.21.15.6:0/3767641592 conn(0x55babd5c4c80 msgr2=0x55babd677640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.373 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:20.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 shutdown_connections 2023-09-13T09:47:20.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 1 -- 172.21.15.6:0/3767641592 wait complete. 2023-09-13T09:47:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.332+0000 7fe1c73e4b80 20 client.17520 trim_cache size 0 max 16384 2023-09-13T09:47:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1a40a0640 msgr2=0x7fe1a40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1a40a0640 0x7fe1a40a2b00 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe1a80098f0 tx=0x7fe1a8019040 comp rx=0 tx=0).stop 2023-09-13T09:47:20.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4100be0 msgr2=0x7fe1b419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4100be0 0x7fe1b419b5e0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe1a000e9a0 tx=0x7fe1a000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 shutdown_connections 2023-09-13T09:47:20.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b4101580 0x7fe1b419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1b40ff9f0 0x7fe1b4068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1a40a0640 0x7fe1a40a2b00 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 --2- 172.21.15.6:0/4275129809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1b4100be0 0x7fe1b419b5e0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 >> 172.21.15.6:0/4275129809 conn(0x7fe1b40faf20 msgr2=0x7fe1b40fd290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 shutdown_connections 2023-09-13T09:47:20.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.333+0000 7fe1b9f9d700 1 -- 172.21.15.6:0/4275129809 wait complete. 2023-09-13T09:47:20.378 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:47:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 -- 172.21.15.6:0/2674237443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 msgr2=0x7f13dc101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 --2- 172.21.15.6:0/2674237443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc101310 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f13d00099c0 tx=0x7f13d0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 -- 172.21.15.6:0/2674237443 shutdown_connections 2023-09-13T09:47:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 --2- 172.21.15.6:0/2674237443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13dc101850 0x7f13dc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 --2- 172.21.15.6:0/2674237443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc0ffcc0 0x7f13dc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 --2- 172.21.15.6:0/2674237443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc101310 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 -- 172.21.15.6:0/2674237443 >> 172.21.15.6:0/2674237443 conn(0x7f13dc0fb250 msgr2=0x7f13dc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 -- 172.21.15.6:0/2674237443 shutdown_connections 2023-09-13T09:47:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.552+0000 7f13e25bd700 1 -- 172.21.15.6:0/2674237443 wait complete. 2023-09-13T09:47:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 Processor -- start 2023-09-13T09:47:20.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 -- start start 2023-09-13T09:47:20.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13dc0ffcc0 0x7f13dc195970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc195eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc101850 0x7f13dc19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc19d4f0 con 0x7f13dc100eb0 2023-09-13T09:47:20.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc19d630 con 0x7f13dc0ffcc0 2023-09-13T09:47:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13e25bd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc19d7c0 con 0x7f13dc101850 2023-09-13T09:47:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc195eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.553+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc195eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38820/0 (socket says 172.21.15.6:38820) 2023-09-13T09:47:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13db7fe700 1 -- 172.21.15.6:0/3027859551 learned_addr learned my addr 172.21.15.6:0/3027859551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13dbfff700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13dc0ffcc0 0x7f13dc195970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13e0b5a700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc101850 0x7f13dc19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13db7fe700 1 -- 172.21.15.6:0/3027859551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc101850 msgr2=0x7f13dc19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc101850 0x7f13dc19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13db7fe700 1 -- 172.21.15.6:0/3027859551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13dc0ffcc0 msgr2=0x7f13dc195970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13dc0ffcc0 0x7f13dc195970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13db7fe700 1 -- 172.21.15.6:0/3027859551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009c40 con 0x7f13dc100eb0 2023-09-13T09:47:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13dbfff700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13dc0ffcc0 0x7f13dc195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc195eb0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009fd0 tx=0x7f13d000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13d97fa700 1 -- 172.21.15.6:0/3027859551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d001d070 con 0x7f13dc100eb0 2023-09-13T09:47:20.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13d00095f0 con 0x7f13dc100eb0 2023-09-13T09:47:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13d97fa700 1 -- 172.21.15.6:0/3027859551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13d00054f0 con 0x7f13dc100eb0 2023-09-13T09:47:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13d97fa700 1 -- 172.21.15.6:0/3027859551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0004ab0 con 0x7f13dc100eb0 2023-09-13T09:47:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.554+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc19dcd0 con 0x7f13dc100eb0 2023-09-13T09:47:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.556+0000 7f13d97fa700 1 -- 172.21.15.6:0/3027859551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f13d000fb80 con 0x7f13dc100eb0 2023-09-13T09:47:20.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.557+0000 7f13d97fa700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f13c40a0640 0x7f13c40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.557+0000 7f13d97fa700 1 -- 172.21.15.6:0/3027859551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13d00ccc40 con 0x7f13dc100eb0 2023-09-13T09:47:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.557+0000 7f13dbfff700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f13c40a0640 0x7f13c40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13dbfff700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f13c40a0640 0x7f13c40a2b00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f13dc100d10 tx=0x7f13cc007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 Processor -- start 2023-09-13T09:47:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 -- start start 2023-09-13T09:47:20.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cacce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cad220 0x55bf08cad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cae060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08c03780 con 0x55bf08cac8c0 2023-09-13T09:47:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08c010a0 con 0x55bf08cadbe0 2023-09-13T09:47:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08bfc990 con 0x55bf08cad220 2023-09-13T09:47:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cacce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cad220 0x55bf08cad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13e0b5a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cacce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38826/0 (socket says 172.21.15.6:38826) 2023-09-13T09:47:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.558+0000 7f13dbfff700 1 -- 172.21.15.6:0/84106862 learned_addr learned my addr 172.21.15.6:0/84106862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13db7fe700 1 -- 172.21.15.6:0/84106862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 msgr2=0x55bf08cae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13db7fe700 1 --2- 172.21.15.6:0/84106862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cae060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13db7fe700 1 -- 172.21.15.6:0/84106862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 msgr2=0x55bf08cacce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13db7fe700 1 --2- 172.21.15.6:0/84106862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cacce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13db7fe700 1 -- 172.21.15.6:0/84106862 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf08a7c630 con 0x55bf08cad220 2023-09-13T09:47:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13db7fe700 1 --2- 172.21.15.6:0/84106862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cad220 0x55bf08cad6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13d00ca6c0 tx=0x7f13d0005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=733d7b28c5cd534e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13c27fc700 1 -- 172.21.15.6:0/84106862 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0005660 con 0x55bf08cad220 2023-09-13T09:47:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13c27fc700 1 -- 172.21.15.6:0/84106862 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13d009ac90 con 0x55bf08cad220 2023-09-13T09:47:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.559+0000 7f13c27fc700 1 -- 172.21.15.6:0/84106862 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00989c0 con 0x55bf08cad220 2023-09-13T09:47:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/84106862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cad220 msgr2=0x55bf08cad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/84106862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cad220 0x55bf08cad6a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f13d00ca6c0 tx=0x7f13d0005ef0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/84106862 shutdown_connections 2023-09-13T09:47:20.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/84106862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/84106862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cacce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/84106862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cad220 0x55bf08cad6a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/84106862 >> 172.21.15.6:0/84106862 conn(0x55bf08c08c80 msgr2=0x55bf08ca4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/84106862 shutdown_connections 2023-09-13T09:47:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/84106862 wait complete. 2023-09-13T09:47:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.560+0000 7f13ee7a2b80 1 -- start start 2023-09-13T09:47:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 1 Processor -- start 2023-09-13T09:47:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cb5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cad220 0x55bf08cb63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08b9abb0 con 0x55bf08cac8c0 2023-09-13T09:47:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08b9a8b0 con 0x55bf08cad220 2023-09-13T09:47:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08a7e920 con 0x55bf08cadbe0 2023-09-13T09:47:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13ee7a2b80 10 client.0 _ll_register_callbacks cb 0x55bf08b98680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cb5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cb5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38832/0 (socket says 172.21.15.6:38832) 2023-09-13T09:47:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 -- 172.21.15.6:0/105468408 learned_addr learned my addr 172.21.15.6:0/105468408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13e0b5a700 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 -- 172.21.15.6:0/105468408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cadbe0 msgr2=0x55bf08cbd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 -- 172.21.15.6:0/105468408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cad220 msgr2=0x55bf08cb63f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:47:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cad220 0x55bf08cb63f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.561+0000 7f13dbfff700 1 -- 172.21.15.6:0/105468408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc19dcd0 con 0x55bf08cac8c0 2023-09-13T09:47:20.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13dbfff700 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cb5eb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f13cc022d80 tx=0x7f13cc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d977c896a848b035 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:20.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13bb7fe700 1 -- 172.21.15.6:0/105468408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc011e40 con 0x55bf08cac8c0 2023-09-13T09:47:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13bb7fe700 1 -- 172.21.15.6:0/105468408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13cc017070 con 0x55bf08cac8c0 2023-09-13T09:47:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bf08c9d670 con 0x55bf08cac8c0 2023-09-13T09:47:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13bb7fe700 1 -- 172.21.15.6:0/105468408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13cc004030 con 0x55bf08cac8c0 2023-09-13T09:47:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13ee7a2b80 10 client.17532 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55bf08c147a0 con 0x55bf08cac8c0 2023-09-13T09:47:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.562+0000 7f13bb7fe700 1 -- 172.21.15.6:0/105468408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bf08c9d670 con 0x55bf08cac8c0 2023-09-13T09:47:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13bb7fe700 1 -- 172.21.15.6:0/105468408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13cc021850 con 0x55bf08cac8c0 2023-09-13T09:47:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13ee7a2b80 10 client.17532 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13ee7a2b80 10 client.17532 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:20.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13ee7a2b80 20 client.17532 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:20.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08cabec0 0x55bf08cc2370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13ee7a2b80 4 client.17532 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:20.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bf08bf5970 con 0x55bf08cabec0 2023-09-13T09:47:20.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13db7fe700 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08cabec0 0x55bf08cc2370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13bb7fe700 10 client.17532 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:20.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.563+0000 7f13db7fe700 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08cabec0 0x55bf08cc2370 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f10a9bbd9ac6c6a9 server_cookie=ca0af39b01d61b8a in_seq=0 out_seq=0 2023-09-13T09:47:20.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13bb7fe700 1 -- 172.21.15.6:0/105468408 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bf08bf5970 con 0x55bf08cabec0 2023-09-13T09:47:20.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13bb7fe700 10 client.17532 handle_command_reply: tid=0 2023-09-13T09:47:20.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 client.17532 shutdown 2023-09-13T09:47:20.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 msgr2=0x55bf08cb5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cb5eb0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f13cc022d80 tx=0x7f13cc0047c0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 shutdown_connections 2023-09-13T09:47:20.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08cabec0 0x55bf08cc2370 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cac8c0 0x55bf08cb5eb0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/105468408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cad220 0x55bf08cb63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13bb7fe700 0 client.17532 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 >> 172.21.15.6:0/105468408 conn(0x55bf08c08c80 msgr2=0x55bf08c9f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 shutdown_connections 2023-09-13T09:47:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.564+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/105468408 wait complete. 2023-09-13T09:47:20.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.565+0000 7f13ee7a2b80 20 client.17532 trim_cache size 0 max 16384 2023-09-13T09:47:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 Processor -- start 2023-09-13T09:47:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 -- start start 2023-09-13T09:47:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cb0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cb1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08cb5a20 con 0x55bf08cad220 2023-09-13T09:47:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08ca6fd0 con 0x55bf08cadbe0 2023-09-13T09:47:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08cb6ee0 con 0x55bf08cac8c0 2023-09-13T09:47:20.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cb1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cb0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cb1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38838/0 (socket says 172.21.15.6:38838) 2023-09-13T09:47:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13db7fe700 1 -- 172.21.15.6:0/3651974917 learned_addr learned my addr 172.21.15.6:0/3651974917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.579+0000 7f13e0b5a700 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13db7fe700 1 -- 172.21.15.6:0/3651974917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 msgr2=0x55bf08cb0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cb0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13db7fe700 1 -- 172.21.15.6:0/3651974917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 msgr2=0x55bf08cbd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13db7fe700 1 -- 172.21.15.6:0/3651974917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bf08a28de0 con 0x55bf08cad220 2023-09-13T09:47:20.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13e0b5a700 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cb1160 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f13d009a240 tx=0x7f13d0005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4846f8e6b5e336dd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13c2ffd700 1 -- 172.21.15.6:0/3651974917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d009e3c0 con 0x55bf08cad220 2023-09-13T09:47:20.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13c2ffd700 1 -- 172.21.15.6:0/3651974917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13d0098930 con 0x55bf08cad220 2023-09-13T09:47:20.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.580+0000 7f13c2ffd700 1 -- 172.21.15.6:0/3651974917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0099cc0 con 0x55bf08cad220 2023-09-13T09:47:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3651974917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 msgr2=0x55bf08cb1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cb1160 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f13d009a240 tx=0x7f13d0005ef0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3651974917 shutdown_connections 2023-09-13T09:47:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbd3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cb0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3651974917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cb1160 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3651974917 >> 172.21.15.6:0/3651974917 conn(0x55bf08c08c80 msgr2=0x55bf08cb4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3651974917 shutdown_connections 2023-09-13T09:47:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3651974917 wait complete. 2023-09-13T09:47:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.581+0000 7f13ee7a2b80 1 -- start start 2023-09-13T09:47:20.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 1 Processor -- start 2023-09-13T09:47:20.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cbae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cbb390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08cbc8e0 con 0x55bf08cad220 2023-09-13T09:47:20.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08cbca50 con 0x55bf08cadbe0 2023-09-13T09:47:20.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bf08cbcc10 con 0x55bf08cac8c0 2023-09-13T09:47:20.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13ee7a2b80 10 client.0 _ll_register_callbacks cb 0x55bf08b98680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:20.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cbb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cbae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cbb390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38846/0 (socket says 172.21.15.6:38846) 2023-09-13T09:47:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 -- 172.21.15.6:0/3309591769 learned_addr learned my addr 172.21.15.6:0/3309591769 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13dbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cbae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:41898/0 (socket says 172.21.15.6:41898) 2023-09-13T09:47:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13e0b5a700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 -- 172.21.15.6:0/3309591769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 msgr2=0x55bf08cbae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cbae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 -- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 msgr2=0x55bf08cbc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13db7fe700 1 -- 172.21.15.6:0/3309591769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d40091e0 con 0x55bf08cad220 2023-09-13T09:47:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13dbfff700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cbae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.582+0000 7f13e0b5a700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13db7fe700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cbb390 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f13d00a2040 tx=0x7f13d00a2570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e936a701e1460def server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13bb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13bb7fe700 1 -- 172.21.15.6:0/3309591769 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0099c80 con 0x55bf08cad220 2023-09-13T09:47:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13bb7fe700 1 -- 172.21.15.6:0/3309591769 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f13d009e3c0 con 0x55bf08cad220 2023-09-13T09:47:20.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f13d009ac90 con 0x55bf08cad220 2023-09-13T09:47:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13bb7fe700 1 -- 172.21.15.6:0/3309591769 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f13d009e040 con 0x55bf08cad220 2023-09-13T09:47:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 10 client.17538 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55bf08a7c630 con 0x55bf08cad220 2023-09-13T09:47:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13bb7fe700 1 -- 172.21.15.6:0/3309591769 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f13d009ac90 con 0x55bf08cad220 2023-09-13T09:47:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13bb7fe700 1 -- 172.21.15.6:0/3309591769 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f13d00cabb0 con 0x55bf08cad220 2023-09-13T09:47:20.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 10 client.17538 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 10 client.17538 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 20 client.17538 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08d14150 0x55bf08d16570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 4 client.17538 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:20.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bf08bb6050 con 0x55bf08d14150 2023-09-13T09:47:20.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.583+0000 7f13dbfff700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08d14150 0x55bf08d16570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:20.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13bb7fe700 10 client.17538 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:20.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13dbfff700 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08d14150 0x55bf08d16570 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cffbc949f6cc7338 server_cookie=df0225cf8ffbd35e in_seq=0 out_seq=0 2023-09-13T09:47:20.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13bb7fe700 1 -- 172.21.15.6:0/3309591769 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bf08bb6050 con 0x55bf08d14150 2023-09-13T09:47:20.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13bb7fe700 10 client.17538 handle_command_reply: tid=0 2023-09-13T09:47:20.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 client.17538 shutdown 2023-09-13T09:47:20.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 msgr2=0x55bf08cbb390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cbb390 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f13d00a2040 tx=0x7f13d00a2570 comp rx=0 tx=0).stop 2023-09-13T09:47:20.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 shutdown_connections 2023-09-13T09:47:20.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bf08cadbe0 0x55bf08cbc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bf08cac8c0 0x55bf08cbae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bf08d14150 0x55bf08d16570 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 --2- 172.21.15.6:0/3309591769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bf08cad220 0x55bf08cbb390 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13bb7fe700 0 client.17538 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:20.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 >> 172.21.15.6:0/3309591769 conn(0x55bf08c08c80 msgr2=0x55bf08cb0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 shutdown_connections 2023-09-13T09:47:20.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 1 -- 172.21.15.6:0/3309591769 wait complete. 2023-09-13T09:47:20.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.584+0000 7f13ee7a2b80 20 client.17538 trim_cache size 0 max 16384 2023-09-13T09:47:20.613 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f13c40a0640 msgr2=0x7f13c40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f13c40a0640 0x7f13c40a2b00 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f13dc100d10 tx=0x7f13cc007400 comp rx=0 tx=0).stop 2023-09-13T09:47:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 msgr2=0x7f13dc195eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc195eb0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f13d0009fd0 tx=0x7f13d000f690 comp rx=0 tx=0).stop 2023-09-13T09:47:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 shutdown_connections 2023-09-13T09:47:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f13dc101850 0x7f13dc19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f13dc0ffcc0 0x7f13dc195970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f13c40a0640 0x7f13c40a2b00 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 --2- 172.21.15.6:0/3027859551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13dc100eb0 0x7f13dc195eb0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 >> 172.21.15.6:0/3027859551 conn(0x7f13dc0fb250 msgr2=0x7f13dc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 shutdown_connections 2023-09-13T09:47:20.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:20.585+0000 7f13e25bd700 1 -- 172.21.15.6:0/3027859551 wait complete. 2023-09-13T09:47:21.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 355096 5.03 MB/sec execute 281 sec latency 70.984 ms 2023-09-13T09:47:21.618 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:47:21.618 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:47:21.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 -- 172.21.15.6:0/2357744986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc102950 msgr2=0x7f52cc109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 --2- 172.21.15.6:0/2357744986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc102950 0x7f52cc109200 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f52c400b0d0 tx=0x7f52c400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 -- 172.21.15.6:0/2357744986 shutdown_connections 2023-09-13T09:47:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 --2- 172.21.15.6:0/2357744986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc102950 0x7f52cc109200 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 --2- 172.21.15.6:0/2357744986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52cc100dc0 0x7f52cc1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 --2- 172.21.15.6:0/2357744986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52cc101fb0 0x7f52cc102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 -- 172.21.15.6:0/2357744986 >> 172.21.15.6:0/2357744986 conn(0x7f52cc0fc350 msgr2=0x7f52cc0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 -- 172.21.15.6:0/2357744986 shutdown_connections 2023-09-13T09:47:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.759+0000 7f52d3b25700 1 -- 172.21.15.6:0/2357744986 wait complete. 2023-09-13T09:47:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 Processor -- start 2023-09-13T09:47:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 -- start start 2023-09-13T09:47:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc100dc0 0x7f52cc074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52cc101fb0 0x7f52cc0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52cc102950 0x7f52cc0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc073d80 con 0x7f52cc100dc0 2023-09-13T09:47:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc073ef0 con 0x7f52cc101fb0 2023-09-13T09:47:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d3b25700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52cc1a0b90 con 0x7f52cc102950 2023-09-13T09:47:21.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d18c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc100dc0 0x7f52cc074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d10c0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52cc101fb0 0x7f52cc0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d18c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc100dc0 0x7f52cc074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38858/0 (socket says 172.21.15.6:38858) 2023-09-13T09:47:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d18c1700 1 -- 172.21.15.6:0/3293033330 learned_addr learned my addr 172.21.15.6:0/3293033330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.760+0000 7f52d20c2700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52cc102950 0x7f52cc0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d18c1700 1 -- 172.21.15.6:0/3293033330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52cc102950 msgr2=0x7f52cc0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d18c1700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52cc102950 0x7f52cc0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d18c1700 1 -- 172.21.15.6:0/3293033330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52cc101fb0 msgr2=0x7f52cc0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d18c1700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52cc101fb0 0x7f52cc0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d18c1700 1 -- 172.21.15.6:0/3293033330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c4009d00 con 0x7f52cc100dc0 2023-09-13T09:47:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d10c0700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52cc101fb0 0x7f52cc0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d18c1700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc100dc0 0x7f52cc074a60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f52c800e970 tx=0x7f52c800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52c2ffd700 1 -- 172.21.15.6:0/3293033330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8009790 con 0x7f52cc100dc0 2023-09-13T09:47:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52cc1a0e70 con 0x7f52cc100dc0 2023-09-13T09:47:21.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52c2ffd700 1 -- 172.21.15.6:0/3293033330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52c800c7e0 con 0x7f52cc100dc0 2023-09-13T09:47:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52c2ffd700 1 -- 172.21.15.6:0/3293033330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c8003c70 con 0x7f52cc100dc0 2023-09-13T09:47:21.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.761+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc1a12f0 con 0x7f52cc100dc0 2023-09-13T09:47:21.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.764+0000 7f52c2ffd700 1 -- 172.21.15.6:0/3293033330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f52c800cc50 con 0x7f52cc100dc0 2023-09-13T09:47:21.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.765+0000 7f52c2ffd700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52b80a06c0 0x7f52b80a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.765+0000 7f52d10c0700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52b80a06c0 0x7f52b80a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.765+0000 7f52c2ffd700 1 -- 172.21.15.6:0/3293033330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52c8014070 con 0x7f52cc100dc0 2023-09-13T09:47:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52d10c0700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52b80a06c0 0x7f52b80a2b80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52bc011490 tx=0x7f52bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 Processor -- start 2023-09-13T09:47:21.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 -- start start 2023-09-13T09:47:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f66780 0x55aab1f66ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f670e0 0x55aab1f65540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f65f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1ebe800 con 0x55aab1f65a80 2023-09-13T09:47:21.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1ebc120 con 0x55aab1f66780 2023-09-13T09:47:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1eb7a10 con 0x55aab1f670e0 2023-09-13T09:47:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.766+0000 7f52d20c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f65f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f65f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38870/0 (socket says 172.21.15.6:38870) 2023-09-13T09:47:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d10c0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f670e0 0x55aab1f65540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 -- 172.21.15.6:0/2717856826 learned_addr learned my addr 172.21.15.6:0/2717856826 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d18c1700 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f66780 0x55aab1f66ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 -- 172.21.15.6:0/2717856826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f670e0 msgr2=0x55aab1f65540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f670e0 0x55aab1f65540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 -- 172.21.15.6:0/2717856826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f66780 msgr2=0x55aab1f66ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f66780 0x55aab1f66ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 -- 172.21.15.6:0/2717856826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab1d376b0 con 0x55aab1f65a80 2023-09-13T09:47:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d10c0700 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f670e0 0x55aab1f65540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52d20c2700 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f65f00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f52c4015000 tx=0x7f52c4009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc2362f11df0beb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52b7fff700 1 -- 172.21.15.6:0/2717856826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c400e040 con 0x55aab1f65a80 2023-09-13T09:47:21.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52b7fff700 1 -- 172.21.15.6:0/2717856826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52c400baa0 con 0x55aab1f65a80 2023-09-13T09:47:21.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.767+0000 7f52b7fff700 1 -- 172.21.15.6:0/2717856826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c4005070 con 0x55aab1f65a80 2023-09-13T09:47:21.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2717856826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 msgr2=0x55aab1f65f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f65f00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f52c4015000 tx=0x7f52c4009c60 comp rx=0 tx=0).stop 2023-09-13T09:47:21.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2717856826 shutdown_connections 2023-09-13T09:47:21.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f65f00 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f66780 0x55aab1f66ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2717856826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f670e0 0x55aab1f65540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2717856826 >> 172.21.15.6:0/2717856826 conn(0x55aab1ec3d00 msgr2=0x55aab1f5ff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2717856826 shutdown_connections 2023-09-13T09:47:21.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2717856826 wait complete. 2023-09-13T09:47:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 -- start start 2023-09-13T09:47:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.768+0000 7f52dfd0ab80 1 Processor -- start 2023-09-13T09:47:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f6eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f6f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f670e0 0x55aab1f76470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1e55c30 con 0x55aab1f65a80 2023-09-13T09:47:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1e55930 con 0x55aab1f670e0 2023-09-13T09:47:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1d399a0 con 0x55aab1f66780 2023-09-13T09:47:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52dfd0ab80 10 client.0 _ll_register_callbacks cb 0x55aab1e53700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:21.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f6eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f6eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38872/0 (socket says 172.21.15.6:38872) 2023-09-13T09:47:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 -- 172.21.15.6:0/2530787399 learned_addr learned my addr 172.21.15.6:0/2530787399 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d20c2700 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f670e0 0x55aab1f76470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d10c0700 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f6f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 -- 172.21.15.6:0/2530787399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 msgr2=0x55aab1f6f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f6f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 -- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f670e0 msgr2=0x55aab1f76470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f670e0 0x55aab1f76470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 -- 172.21.15.6:0/2530787399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52cc109b50 con 0x55aab1f65a80 2023-09-13T09:47:21.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52d18c1700 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f6eef0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f52c80c9800 tx=0x7f52c8003dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f05c87a4d5d1c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.769+0000 7f52b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52b57fa700 1 -- 172.21.15.6:0/2530787399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c809d320 con 0x55aab1f65a80 2023-09-13T09:47:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52b57fa700 1 -- 172.21.15.6:0/2530787399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52c80a1560 con 0x55aab1f65a80 2023-09-13T09:47:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aab1f586f0 con 0x55aab1f65a80 2023-09-13T09:47:21.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52b57fa700 1 -- 172.21.15.6:0/2530787399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52c8099750 con 0x55aab1f65a80 2023-09-13T09:47:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 10 client.17550 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55aab1ecf820 con 0x55aab1f65a80 2023-09-13T09:47:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52b57fa700 1 -- 172.21.15.6:0/2530787399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55aab1f586f0 con 0x55aab1f65a80 2023-09-13T09:47:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52b57fa700 1 -- 172.21.15.6:0/2530787399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f52c80b73b0 con 0x55aab1f65a80 2023-09-13T09:47:21.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 10 client.17550 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 20 client.17550 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1f7aca0 0x55aab1f7d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 4 client.17550 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:21.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aab1eb09f0 con 0x55aab1f7aca0 2023-09-13T09:47:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.770+0000 7f52d10c0700 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1f7aca0 0x55aab1f7d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.771+0000 7f52b57fa700 10 client.17550 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.771+0000 7f52d10c0700 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1f7aca0 0x55aab1f7d0c0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be3d0df13bcb6ca3 server_cookie=50b73bcb9891c4b7 in_seq=0 out_seq=0 2023-09-13T09:47:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52b57fa700 1 -- 172.21.15.6:0/2530787399 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55aab1eb09f0 con 0x55aab1f7aca0 2023-09-13T09:47:21.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52b57fa700 10 client.17550 handle_command_reply: tid=0 2023-09-13T09:47:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 client.17550 shutdown 2023-09-13T09:47:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 msgr2=0x55aab1f6eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f6eef0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f52c80c9800 tx=0x7f52c8003dd0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 shutdown_connections 2023-09-13T09:47:21.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f670e0 0x55aab1f76470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1f7aca0 0x55aab1f7d0c0 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f65a80 0x55aab1f6eef0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2530787399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f6f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52b57fa700 0 client.17550 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:21.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 >> 172.21.15.6:0/2530787399 conn(0x55aab1ec3d00 msgr2=0x55aab1f5ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 shutdown_connections 2023-09-13T09:47:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2530787399 wait complete. 2023-09-13T09:47:21.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.772+0000 7f52dfd0ab80 20 client.17550 trim_cache size 0 max 16384 2023-09-13T09:47:21.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.790+0000 7f52dfd0ab80 1 Processor -- start 2023-09-13T09:47:21.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.790+0000 7f52dfd0ab80 1 -- start start 2023-09-13T09:47:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f65540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f76430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1f6eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1f6eaa0 con 0x55aab1f670e0 2023-09-13T09:47:21.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1f617e0 con 0x55aab1f65a80 2023-09-13T09:47:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1f60e90 con 0x55aab1f66780 2023-09-13T09:47:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d20c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1f6eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d20c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1f6eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38882/0 (socket says 172.21.15.6:38882) 2023-09-13T09:47:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d20c2700 1 -- 172.21.15.6:0/3735092241 learned_addr learned my addr 172.21.15.6:0/3735092241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d18c1700 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f65540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d10c0700 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f76430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d18c1700 1 -- 172.21.15.6:0/3735092241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 msgr2=0x55aab1f76430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d18c1700 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f76430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d18c1700 1 -- 172.21.15.6:0/3735092241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 msgr2=0x55aab1f6eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d18c1700 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1f6eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d18c1700 1 -- 172.21.15.6:0/3735092241 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aab1ce3e60 con 0x55aab1f65a80 2023-09-13T09:47:21.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d20c2700 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1f6eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:21.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.791+0000 7f52d18c1700 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f65540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52c8097840 tx=0x7f52c8097aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68c705c4217d6f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.793+0000 7f52c0d82700 1 -- 172.21.15.6:0/3735092241 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80a1560 con 0x55aab1f65a80 2023-09-13T09:47:21.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.793+0000 7f52c0d82700 1 -- 172.21.15.6:0/3735092241 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52c809d320 con 0x55aab1f65a80 2023-09-13T09:47:21.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.793+0000 7f52c0d82700 1 -- 172.21.15.6:0/3735092241 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c80b7510 con 0x55aab1f65a80 2023-09-13T09:47:21.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/3735092241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 msgr2=0x55aab1f65540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f65540 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f52c8097840 tx=0x7f52c8097aa0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/3735092241 shutdown_connections 2023-09-13T09:47:21.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1f6eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f65540 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/3735092241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f76430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/3735092241 >> 172.21.15.6:0/3735092241 conn(0x55aab1ec3d00 msgr2=0x55aab1f69900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/3735092241 shutdown_connections 2023-09-13T09:47:21.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/3735092241 wait complete. 2023-09-13T09:47:21.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 -- start start 2023-09-13T09:47:21.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.794+0000 7f52dfd0ab80 1 Processor -- start 2023-09-13T09:47:21.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f72ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f73530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52dfd0ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1fceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1f76550 con 0x55aab1f670e0 2023-09-13T09:47:21.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1f766c0 con 0x55aab1f65a80 2023-09-13T09:47:21.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52dfd0ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aab1f76880 con 0x55aab1f66780 2023-09-13T09:47:21.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52dfd0ab80 10 client.0 _ll_register_callbacks cb 0x55aab1e53700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:21.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1fceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d18c1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f72ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1fceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38888/0 (socket says 172.21.15.6:38888) 2023-09-13T09:47:21.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 -- 172.21.15.6:0/2408853525 learned_addr learned my addr 172.21.15.6:0/2408853525 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d10c0700 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f73530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 -- 172.21.15.6:0/2408853525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 msgr2=0x55aab1f73530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f73530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 -- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 msgr2=0x55aab1f72ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f72ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 -- 172.21.15.6:0/2408853525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aab1d376b0 con 0x55aab1f670e0 2023-09-13T09:47:21.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d18c1700 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f72ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:21.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52d20c2700 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1fceac0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009fd0 tx=0x7f52c40076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca1e888c0cf9ad server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.795+0000 7f52b57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:21.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52b57fa700 1 -- 172.21.15.6:0/2408853525 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52c402b070 con 0x55aab1f670e0 2023-09-13T09:47:21.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52b57fa700 1 -- 172.21.15.6:0/2408853525 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f52c40077c0 con 0x55aab1f670e0 2023-09-13T09:47:21.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f52c400baa0 con 0x55aab1f670e0 2023-09-13T09:47:21.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52b57fa700 1 -- 172.21.15.6:0/2408853525 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52c400e040 con 0x55aab1f670e0 2023-09-13T09:47:21.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 10 client.17556 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:21.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55aab1ecf820 con 0x55aab1f670e0 2023-09-13T09:47:21.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52b57fa700 1 -- 172.21.15.6:0/2408853525 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f52c400baa0 con 0x55aab1f670e0 2023-09-13T09:47:21.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52b57fa700 1 -- 172.21.15.6:0/2408853525 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f52c400b100 con 0x55aab1f670e0 2023-09-13T09:47:21.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 10 client.17556 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:21.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 10 client.17556 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:21.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 20 client.17556 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1fd03b0 0x55aab1fd27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 4 client.17556 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:47:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55aab1e710d0 con 0x55aab1fd03b0 2023-09-13T09:47:21.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.796+0000 7f52d18c1700 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1fd03b0 0x55aab1fd27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.797+0000 7f52d18c1700 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1fd03b0 0x55aab1fd27d0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77009f9b37dc77c3 server_cookie=946382fdd0ce3b2d in_seq=0 out_seq=0 2023-09-13T09:47:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.797+0000 7f52b57fa700 10 client.17556 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52b57fa700 1 -- 172.21.15.6:0/2408853525 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55aab1e710d0 con 0x55aab1fd03b0 2023-09-13T09:47:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52b57fa700 10 client.17556 handle_command_reply: tid=0 2023-09-13T09:47:21.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 client.17556 shutdown 2023-09-13T09:47:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 msgr2=0x55aab1fceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1fceac0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f52c4009fd0 tx=0x7f52c40076d0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 shutdown_connections 2023-09-13T09:47:21.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55aab1fd03b0 0x55aab1fd27d0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55aab1f670e0 0x55aab1fceac0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52b57fa700 0 client.17556 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55aab1f65a80 0x55aab1f72ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 --2- 172.21.15.6:0/2408853525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55aab1f66780 0x55aab1f73530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 >> 172.21.15.6:0/2408853525 conn(0x55aab1ec3d00 msgr2=0x55aab1f6eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 shutdown_connections 2023-09-13T09:47:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 1 -- 172.21.15.6:0/2408853525 wait complete. 2023-09-13T09:47:21.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.798+0000 7f52dfd0ab80 20 client.17556 trim_cache size 0 max 16384 2023-09-13T09:47:21.818 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "dbf34e36-6101-40dc-af8a-0b73640993f1", 2023-09-13T09:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:47:21.819 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:47:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52b80a06c0 msgr2=0x7f52b80a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52b80a06c0 0x7f52b80a2b80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f52bc011490 tx=0x7f52bc009260 comp rx=0 tx=0).stop 2023-09-13T09:47:21.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc100dc0 msgr2=0x7f52cc074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc100dc0 0x7f52cc074a60 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f52c800e970 tx=0x7f52c800ec80 comp rx=0 tx=0).stop 2023-09-13T09:47:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 shutdown_connections 2023-09-13T09:47:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52cc102950 0x7f52cc0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52b80a06c0 0x7f52b80a2b80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f52cc100dc0 0x7f52cc074a60 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 --2- 172.21.15.6:0/3293033330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f52cc101fb0 0x7f52cc0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 >> 172.21.15.6:0/3293033330 conn(0x7f52cc0fc350 msgr2=0x7f52cc0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 shutdown_connections 2023-09-13T09:47:21.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.799+0000 7f52d3b25700 1 -- 172.21.15.6:0/3293033330 wait complete. 2023-09-13T09:47:21.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:47:21.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 -- 172.21.15.6:0/3641734998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b00ffcc0 msgr2=0x7f19b01000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 --2- 172.21.15.6:0/3641734998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b00ffcc0 0x7f19b01000e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f19ac009920 tx=0x7f19ac009c30 comp rx=0 tx=0).stop 2023-09-13T09:47:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 -- 172.21.15.6:0/3641734998 shutdown_connections 2023-09-13T09:47:21.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 --2- 172.21.15.6:0/3641734998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b0101850 0x7f19b0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 --2- 172.21.15.6:0/3641734998 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b00ffcc0 0x7f19b01000e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 --2- 172.21.15.6:0/3641734998 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 0x7f19b0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 -- 172.21.15.6:0/3641734998 >> 172.21.15.6:0/3641734998 conn(0x7f19b00fb250 msgr2=0x7f19b00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 -- 172.21.15.6:0/3641734998 shutdown_connections 2023-09-13T09:47:21.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.967+0000 7f19b734a700 1 -- 172.21.15.6:0/3641734998 wait complete. 2023-09-13T09:47:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 Processor -- start 2023-09-13T09:47:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 -- start start 2023-09-13T09:47:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b00ffcc0 0x7f19b0069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 0x7f19b019b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b0101850 0x7f19b019dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b019e640 con 0x7f19b0100eb0 2023-09-13T09:47:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b019e7b0 con 0x7f19b0101850 2023-09-13T09:47:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b734a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19b019e970 con 0x7f19b00ffcc0 2023-09-13T09:47:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b48e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 0x7f19b019b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b50e6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b00ffcc0 0x7f19b0069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b48e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 0x7f19b019b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38900/0 (socket says 172.21.15.6:38900) 2023-09-13T09:47:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b58e7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b0101850 0x7f19b019dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.968+0000 7f19b48e5700 1 -- 172.21.15.6:0/2627406374 learned_addr learned my addr 172.21.15.6:0/2627406374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b50e6700 1 -- 172.21.15.6:0/2627406374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b0101850 msgr2=0x7f19b019dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b50e6700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b0101850 0x7f19b019dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b50e6700 1 -- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 msgr2=0x7f19b019b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b50e6700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 0x7f19b019b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b50e6700 1 -- 172.21.15.6:0/2627406374 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a00095f0 con 0x7f19b00ffcc0 2023-09-13T09:47:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b48e5700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 0x7f19b019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b50e6700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b00ffcc0 0x7f19b0069880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19ac000c00 tx=0x7f19ac00b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19a67fc700 1 -- 172.21.15.6:0/2627406374 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac01c070 con 0x7f19b00ffcc0 2023-09-13T09:47:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19a67fc700 1 -- 172.21.15.6:0/2627406374 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19ac00f7d0 con 0x7f19b00ffcc0 2023-09-13T09:47:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ac009520 con 0x7f19b00ffcc0 2023-09-13T09:47:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.969+0000 7f19a67fc700 1 -- 172.21.15.6:0/2627406374 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac003920 con 0x7f19b00ffcc0 2023-09-13T09:47:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.970+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b019ee30 con 0x7f19b00ffcc0 2023-09-13T09:47:21.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.972+0000 7f19a67fc700 1 -- 172.21.15.6:0/2627406374 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f19ac020030 con 0x7f19b00ffcc0 2023-09-13T09:47:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.973+0000 7f19a67fc700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f199c0a0640 0x7f199c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.973+0000 7f19b48e5700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f199c0a0640 0x7f199c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.973+0000 7f19a67fc700 1 -- 172.21.15.6:0/2627406374 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19ac0ccb70 con 0x7f19b00ffcc0 2023-09-13T09:47:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.973+0000 7f19b48e5700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f199c0a0640 0x7f199c0a2b00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f19a0005d10 tx=0x7f19a0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 Processor -- start 2023-09-13T09:47:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 -- start start 2023-09-13T09:47:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694bb10 0x560da694bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694c470 0x560da694a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694ae10 0x560da694b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da689f780 con 0x560da694bb10 2023-09-13T09:47:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da689d0a0 con 0x560da694c470 2023-09-13T09:47:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19c352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da6898990 con 0x560da694ae10 2023-09-13T09:47:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694bb10 0x560da694bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b48e5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694c470 0x560da694a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694bb10 0x560da694bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38906/0 (socket says 172.21.15.6:38906) 2023-09-13T09:47:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 -- 172.21.15.6:0/4292137048 learned_addr learned my addr 172.21.15.6:0/4292137048 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b58e7700 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694ae10 0x560da694b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 -- 172.21.15.6:0/4292137048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694ae10 msgr2=0x560da694b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694ae10 0x560da694b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 -- 172.21.15.6:0/4292137048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694c470 msgr2=0x560da694a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694c470 0x560da694a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 -- 172.21.15.6:0/4292137048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560da6718630 con 0x560da694bb10 2023-09-13T09:47:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b48e5700 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694c470 0x560da694a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.974+0000 7f19b50e6700 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694bb10 0x560da694bf30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f19ac096df0 tx=0x7f19ac00ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59bf225d3fd72a2f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f199b7fe700 1 -- 172.21.15.6:0/4292137048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac09aa80 con 0x560da694bb10 2023-09-13T09:47:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f199b7fe700 1 -- 172.21.15.6:0/4292137048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19ac09a380 con 0x560da694bb10 2023-09-13T09:47:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f199b7fe700 1 -- 172.21.15.6:0/4292137048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19ac00bbe0 con 0x560da694bb10 2023-09-13T09:47:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 -- 172.21.15.6:0/4292137048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694bb10 msgr2=0x560da694bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694bb10 0x560da694bf30 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f19ac096df0 tx=0x7f19ac00ba30 comp rx=0 tx=0).stop 2023-09-13T09:47:21.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 -- 172.21.15.6:0/4292137048 shutdown_connections 2023-09-13T09:47:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694ae10 0x560da694b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694bb10 0x560da694bf30 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 --2- 172.21.15.6:0/4292137048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694c470 0x560da694a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 -- 172.21.15.6:0/4292137048 >> 172.21.15.6:0/4292137048 conn(0x560da68a4c80 msgr2=0x560da6940f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:21.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 -- 172.21.15.6:0/4292137048 shutdown_connections 2023-09-13T09:47:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.975+0000 7f19c352fb80 1 -- 172.21.15.6:0/4292137048 wait complete. 2023-09-13T09:47:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 -- start start 2023-09-13T09:47:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 Processor -- start 2023-09-13T09:47:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6953fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6954510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da6836bb0 con 0x560da694c470 2023-09-13T09:47:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da68368b0 con 0x560da694ae10 2023-09-13T09:47:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da671a920 con 0x560da694bb10 2023-09-13T09:47:21.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.976+0000 7f19c352fb80 10 client.0 _ll_register_callbacks cb 0x560da6834680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38912/0 (socket says 172.21.15.6:38912) 2023-09-13T09:47:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 -- 172.21.15.6:0/1557352928 learned_addr learned my addr 172.21.15.6:0/1557352928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b50e6700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6953fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b48e5700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6954510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 -- 172.21.15.6:0/1557352928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 msgr2=0x560da6954510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6954510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 -- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 msgr2=0x560da6953fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6953fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:21.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 -- 172.21.15.6:0/1557352928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19b019ee30 con 0x560da694c470 2023-09-13T09:47:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b48e5700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6954510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:47:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b50e6700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6953fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19b58e7700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695b550 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f19a8007ed0 tx=0x7f19a8007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d28f7b9e49c2954 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f1998ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f1998ff9700 1 -- 172.21.15.6:0/1557352928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800e070 con 0x560da694c470 2023-09-13T09:47:21.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f1998ff9700 1 -- 172.21.15.6:0/1557352928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19a80093f0 con 0x560da694c470 2023-09-13T09:47:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.977+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560da6939670 con 0x560da694c470 2023-09-13T09:47:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f1998ff9700 1 -- 172.21.15.6:0/1557352928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19a8013b30 con 0x560da694c470 2023-09-13T09:47:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 10 client.17568 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560da68b07a0 con 0x560da694c470 2023-09-13T09:47:22.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f1998ff9700 1 -- 172.21.15.6:0/1557352928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560da6939670 con 0x560da694c470 2023-09-13T09:47:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f1998ff9700 1 -- 172.21.15.6:0/1557352928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f19a801e3b0 con 0x560da694c470 2023-09-13T09:47:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 10 client.17568 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 20 client.17568 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:22.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da695fdd0 0x560da69621f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 4 client.17568 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560da6891970 con 0x560da695fdd0 2023-09-13T09:47:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.978+0000 7f19b50e6700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da695fdd0 0x560da69621f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.979+0000 7f1998ff9700 10 client.17568 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:22.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.979+0000 7f19b50e6700 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da695fdd0 0x560da69621f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=747bcb7904e97bb4 server_cookie=ca911f27d0e79830 in_seq=0 out_seq=0 2023-09-13T09:47:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f1998ff9700 1 -- 172.21.15.6:0/1557352928 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560da6891970 con 0x560da695fdd0 2023-09-13T09:47:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f1998ff9700 10 client.17568 handle_command_reply: tid=0 2023-09-13T09:47:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 client.17568 shutdown 2023-09-13T09:47:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 msgr2=0x560da695b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:22.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695b550 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f19a8007ed0 tx=0x7f19a8007f00 comp rx=0 tx=0).stop 2023-09-13T09:47:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 shutdown_connections 2023-09-13T09:47:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da695fdd0 0x560da69621f0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695b550 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f1998ff9700 0 client.17568 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:22.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6953fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1557352928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6954510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 >> 172.21.15.6:0/1557352928 conn(0x560da68a4c80 msgr2=0x560da693b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 shutdown_connections 2023-09-13T09:47:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 1 -- 172.21.15.6:0/1557352928 wait complete. 2023-09-13T09:47:22.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.980+0000 7f19c352fb80 20 client.17568 trim_cache size 0 max 16384 2023-09-13T09:47:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.999+0000 7f19c352fb80 1 Processor -- start 2023-09-13T09:47:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:21.999+0000 7f19c352fb80 1 -- start start 2023-09-13T09:47:22.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6940e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da695b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695be40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19c352fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da693d8e0 con 0x560da694c470 2023-09-13T09:47:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19c352fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da6942730 con 0x560da694ae10 2023-09-13T09:47:22.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19c352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da695d240 con 0x560da694bb10 2023-09-13T09:47:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38922/0 (socket says 172.21.15.6:38922) 2023-09-13T09:47:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 -- 172.21.15.6:0/2908431335 learned_addr learned my addr 172.21.15.6:0/2908431335 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b48e5700 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da695b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b50e6700 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6940e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 -- 172.21.15.6:0/2908431335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 msgr2=0x560da695b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da695b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 -- 172.21.15.6:0/2908431335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 msgr2=0x560da6940e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6940e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 -- 172.21.15.6:0/2908431335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560da66c4de0 con 0x560da694c470 2023-09-13T09:47:22.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f19b58e7700 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695be40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009990 tx=0x7f19a80099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33fb8d8cc026ca61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:22.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f199bfff700 1 -- 172.21.15.6:0/2908431335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800e040 con 0x560da694c470 2023-09-13T09:47:22.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.000+0000 7f199bfff700 1 -- 172.21.15.6:0/2908431335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19a8023070 con 0x560da694c470 2023-09-13T09:47:22.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f199bfff700 1 -- 172.21.15.6:0/2908431335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a801f440 con 0x560da694c470 2023-09-13T09:47:22.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 -- 172.21.15.6:0/2908431335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 msgr2=0x560da695be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:22.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695be40 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f19a8009990 tx=0x7f19a80099c0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 -- 172.21.15.6:0/2908431335 shutdown_connections 2023-09-13T09:47:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695be40 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da6940e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 --2- 172.21.15.6:0/2908431335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da695b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 -- 172.21.15.6:0/2908431335 >> 172.21.15.6:0/2908431335 conn(0x560da68a4c80 msgr2=0x560da694b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 -- 172.21.15.6:0/2908431335 shutdown_connections 2023-09-13T09:47:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.001+0000 7f19c352fb80 1 -- 172.21.15.6:0/2908431335 wait complete. 2023-09-13T09:47:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 -- start start 2023-09-13T09:47:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 Processor -- start 2023-09-13T09:47:22.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da69576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6957be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da695ad50 con 0x560da694c470 2023-09-13T09:47:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da695aec0 con 0x560da694ae10 2023-09-13T09:47:22.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560da695b080 con 0x560da694bb10 2023-09-13T09:47:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19c352fb80 10 client.0 _ll_register_callbacks cb 0x560da6834680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19b58e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19b48e5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6957be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19b58e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38928/0 (socket says 172.21.15.6:38928) 2023-09-13T09:47:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19b58e7700 1 -- 172.21.15.6:0/1879306889 learned_addr learned my addr 172.21.15.6:0/1879306889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:22.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.002+0000 7f19b50e6700 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da69576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19b58e7700 1 -- 172.21.15.6:0/1879306889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 msgr2=0x560da6957be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19b58e7700 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6957be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19b58e7700 1 -- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 msgr2=0x560da69576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19b58e7700 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da69576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19b58e7700 1 -- 172.21.15.6:0/1879306889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560da68b07a0 con 0x560da694c470 2023-09-13T09:47:22.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19b48e5700 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6957be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:22.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19b58e7700 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695a810 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f19a800b010 tx=0x7f19a8007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7c752861edb366f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:22.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f1998ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:22.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f1998ff9700 1 -- 172.21.15.6:0/1879306889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19a800e050 con 0x560da694c470 2023-09-13T09:47:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f1998ff9700 1 -- 172.21.15.6:0/1879306889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19a8013930 con 0x560da694c470 2023-09-13T09:47:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19ac09a380 con 0x560da694c470 2023-09-13T09:47:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f1998ff9700 1 -- 172.21.15.6:0/1879306889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19a801ee20 con 0x560da694c470 2023-09-13T09:47:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19c352fb80 10 client.17574 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560da66adc60 con 0x560da694c470 2023-09-13T09:47:22.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f1998ff9700 1 -- 172.21.15.6:0/1879306889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f19a8044020 con 0x560da694c470 2023-09-13T09:47:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f1998ff9700 1 -- 172.21.15.6:0/1879306889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f19a801fc90 con 0x560da694c470 2023-09-13T09:47:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19c352fb80 10 client.17574 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.003+0000 7f19c352fb80 10 client.17574 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 20 client.17574 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:22.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da69b47f0 0x560da69b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 4 client.17574 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:47:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560da6852050 con 0x560da69b47f0 2023-09-13T09:47:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19b50e6700 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da69b47f0 0x560da69b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f1998ff9700 10 client.17574 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:22.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19b50e6700 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da69b47f0 0x560da69b6be0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f71b19564bd0661c server_cookie=7d4571f6bf6974a in_seq=0 out_seq=0 2023-09-13T09:47:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f1998ff9700 1 -- 172.21.15.6:0/1879306889 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560da6852050 con 0x560da69b47f0 2023-09-13T09:47:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f1998ff9700 10 client.17574 handle_command_reply: tid=0 2023-09-13T09:47:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 client.17574 shutdown 2023-09-13T09:47:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 msgr2=0x560da695a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:22.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695a810 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f19a800b010 tx=0x7f19a8007ef0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 shutdown_connections 2023-09-13T09:47:22.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560da69b47f0 0x560da69b6be0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560da694c470 0x560da695a810 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560da694ae10 0x560da69576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 --2- 172.21.15.6:0/1879306889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560da694bb10 0x560da6957be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f1998ff9700 0 client.17574 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:22.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.004+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 >> 172.21.15.6:0/1879306889 conn(0x560da68a4c80 msgr2=0x560da6940e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:22.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 shutdown_connections 2023-09-13T09:47:22.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19c352fb80 1 -- 172.21.15.6:0/1879306889 wait complete. 2023-09-13T09:47:22.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19c352fb80 20 client.17574 trim_cache size 0 max 16384 2023-09-13T09:47:22.029 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:47:22.029 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:47:22.029 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:47:22.030 INFO:teuthology.orchestra.run.smithi006.stdout: "dbf34e36-6101-40dc-af8a-0b73640993f1": { 2023-09-13T09:47:22.030 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:47:22.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "dbf34e36-6101-40dc-af8a-0b73640993f1", 2023-09-13T09:47:22.030 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:47:22.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:47:22.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:47:22.031 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:47:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f199c0a0640 msgr2=0x7f199c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f199c0a0640 0x7f199c0a2b00 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f19a0005d10 tx=0x7f19a0009310 comp rx=0 tx=0).stop 2023-09-13T09:47:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b00ffcc0 msgr2=0x7f19b0069880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:22.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b00ffcc0 0x7f19b0069880 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f19ac000c00 tx=0x7f19ac00b790 comp rx=0 tx=0).stop 2023-09-13T09:47:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 shutdown_connections 2023-09-13T09:47:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f19b0101850 0x7f19b019dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19b00ffcc0 0x7f19b0069880 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f199c0a0640 0x7f199c0a2b00 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 --2- 172.21.15.6:0/2627406374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19b0100eb0 0x7f19b019b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 >> 172.21.15.6:0/2627406374 conn(0x7f19b00fb250 msgr2=0x7f19b00fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 shutdown_connections 2023-09-13T09:47:22.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:22.005+0000 7f19b734a700 1 -- 172.21.15.6:0/2627406374 wait complete. 2023-09-13T09:47:22.034 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:21 smithi006 ceph-mon[98665]: pgmap v535: 97 pgs: 97 active+clean; 155 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2023-09-13T09:47:22.035 INFO:tasks.cephfs.filesystem:scrub status for tag:dbf34e36-6101-40dc-af8a-0b73640993f1 - {'path': '/', 'tag': 'dbf34e36-6101-40dc-af8a-0b73640993f1', 'options': 'recursive,force'} 2023-09-13T09:47:22.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 356388 5.03 MB/sec execute 282 sec latency 19.134 ms 2023-09-13T09:47:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:21 smithi053 ceph-mon[102373]: pgmap v535: 97 pgs: 97 active+clean; 155 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2023-09-13T09:47:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:21 smithi131 ceph-mon[102785]: pgmap v535: 97 pgs: 97 active+clean; 155 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 2.4 MiB/s wr, 234 op/s 2023-09-13T09:47:23.171 INFO:tasks.workunit.client.0.smithi006.stdout: 1 358481 5.06 MB/sec execute 283 sec latency 17.957 ms 2023-09-13T09:47:23.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:47:23.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:23.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:47:23.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:23.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:47:23.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:23.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:23.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:24.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 359481 5.06 MB/sec execute 284 sec latency 13.301 ms 2023-09-13T09:47:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:23 smithi006 ceph-mon[98665]: pgmap v536: 97 pgs: 97 active+clean; 156 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 2.4 MiB/s wr, 265 op/s 2023-09-13T09:47:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:23 smithi053 ceph-mon[102373]: pgmap v536: 97 pgs: 97 active+clean; 156 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 2.4 MiB/s wr, 265 op/s 2023-09-13T09:47:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:23 smithi131 ceph-mon[102785]: pgmap v536: 97 pgs: 97 active+clean; 156 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 2.4 MiB/s wr, 265 op/s 2023-09-13T09:47:25.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 361737 5.09 MB/sec execute 285 sec latency 14.123 ms 2023-09-13T09:47:26.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 362384 5.08 MB/sec execute 286 sec latency 57.761 ms 2023-09-13T09:47:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:25 smithi053 ceph-mon[102373]: pgmap v537: 97 pgs: 97 active+clean; 156 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 2.3 MiB/s wr, 269 op/s 2023-09-13T09:47:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:25 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:47:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:25 smithi006 ceph-mon[98665]: pgmap v537: 97 pgs: 97 active+clean; 156 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 2.3 MiB/s wr, 269 op/s 2023-09-13T09:47:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:25 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:47:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:25 smithi131 ceph-mon[102785]: pgmap v537: 97 pgs: 97 active+clean; 156 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1001 KiB/s rd, 2.3 MiB/s wr, 269 op/s 2023-09-13T09:47:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:25 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:47:27.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 364270 5.09 MB/sec execute 287 sec latency 28.875 ms 2023-09-13T09:47:27.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:47:27.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:47:27.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:47:27.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:47:27.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:47:27.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:47:27.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:47:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:47:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:47:27.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:47:28.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 365711 5.11 MB/sec execute 288 sec latency 16.227 ms 2023-09-13T09:47:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:27 smithi053 ceph-mon[102373]: pgmap v538: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-13T09:47:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:27 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-09-13T09:47:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:27 smithi053 ceph-mon[102373]: Unable to set osd_memory_target on smithi006 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-09-13T09:47:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:27 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi053 to 197.2M 2023-09-13T09:47:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:27 smithi053 ceph-mon[102373]: Unable to set osd_memory_target on smithi053 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-09-13T09:47:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:27 smithi006 ceph-mon[98665]: pgmap v538: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-13T09:47:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:27 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-09-13T09:47:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:27 smithi006 ceph-mon[98665]: Unable to set osd_memory_target on smithi006 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-09-13T09:47:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:27 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi053 to 197.2M 2023-09-13T09:47:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:27 smithi006 ceph-mon[98665]: Unable to set osd_memory_target on smithi053 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-09-13T09:47:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:27 smithi131 ceph-mon[102785]: pgmap v538: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1000 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-13T09:47:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:27 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-09-13T09:47:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:27 smithi131 ceph-mon[102785]: Unable to set osd_memory_target on smithi006 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-09-13T09:47:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:27 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi053 to 197.2M 2023-09-13T09:47:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:27 smithi131 ceph-mon[102785]: Unable to set osd_memory_target on smithi053 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-09-13T09:47:29.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 366999 5.11 MB/sec execute 289 sec latency 14.802 ms 2023-09-13T09:47:30.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 369042 5.14 MB/sec execute 290 sec latency 14.435 ms 2023-09-13T09:47:30.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:29 smithi006 ceph-mon[98665]: pgmap v539: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.9 MiB/s wr, 238 op/s 2023-09-13T09:47:30.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:29 smithi053 ceph-mon[102373]: pgmap v539: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.9 MiB/s wr, 238 op/s 2023-09-13T09:47:30.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:29 smithi131 ceph-mon[102785]: pgmap v539: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 869 KiB/s rd, 1.9 MiB/s wr, 238 op/s 2023-09-13T09:47:31.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 369786 5.13 MB/sec execute 291 sec latency 24.193 ms 2023-09-13T09:47:32.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 371856 5.15 MB/sec execute 292 sec latency 16.563 ms 2023-09-13T09:47:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:31 smithi006 ceph-mon[98665]: pgmap v540: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.0 MiB/s wr, 236 op/s 2023-09-13T09:47:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:31 smithi053 ceph-mon[102373]: pgmap v540: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.0 MiB/s wr, 236 op/s 2023-09-13T09:47:32.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:31 smithi131 ceph-mon[102785]: pgmap v540: 97 pgs: 97 active+clean; 159 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 877 KiB/s rd, 2.0 MiB/s wr, 236 op/s 2023-09-13T09:47:33.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 372816 5.15 MB/sec execute 293 sec latency 75.024 ms 2023-09-13T09:47:34.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 374126 5.15 MB/sec execute 294 sec latency 31.168 ms 2023-09-13T09:47:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:33 smithi006 ceph-mon[98665]: pgmap v541: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:47:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:33 smithi053 ceph-mon[102373]: pgmap v541: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:47:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:33 smithi131 ceph-mon[102785]: pgmap v541: 97 pgs: 97 active+clean; 162 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:47:35.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 376203 5.18 MB/sec execute 295 sec latency 14.827 ms 2023-09-13T09:47:35.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:34 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:35.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:34 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:35.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:34 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:35.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:34 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:35.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:34 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:35.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:34 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:35.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:34 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:35.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:34 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:34 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:34 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:34 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:35.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:34 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:36.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 377043 5.17 MB/sec execute 296 sec latency 33.093 ms 2023-09-13T09:47:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:47:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:35 smithi006 ceph-mon[98665]: pgmap v542: 97 pgs: 97 active+clean; 163 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.2 MiB/s wr, 243 op/s 2023-09-13T09:47:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:47:36.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:35 smithi053 ceph-mon[102373]: pgmap v542: 97 pgs: 97 active+clean; 163 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.2 MiB/s wr, 243 op/s 2023-09-13T09:47:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:47:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:35 smithi131 ceph-mon[102785]: pgmap v542: 97 pgs: 97 active+clean; 163 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 893 KiB/s rd, 2.2 MiB/s wr, 243 op/s 2023-09-13T09:47:37.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 379363 5.20 MB/sec execute 297 sec latency 16.593 ms 2023-09-13T09:47:38.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 380229 5.20 MB/sec execute 298 sec latency 14.524 ms 2023-09-13T09:47:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:37 smithi006 ceph-mon[98665]: pgmap v543: 97 pgs: 97 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-09-13T09:47:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:37 smithi053 ceph-mon[102373]: pgmap v543: 97 pgs: 97 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-09-13T09:47:38.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:37 smithi131 ceph-mon[102785]: pgmap v543: 97 pgs: 97 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 986 KiB/s rd, 2.3 MiB/s wr, 267 op/s 2023-09-13T09:47:39.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 382322 5.22 MB/sec execute 299 sec latency 35.663 ms 2023-09-13T09:47:40.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 383531 5.23 MB/sec execute 300 sec latency 16.971 ms 2023-09-13T09:47:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:39 smithi053 ceph-mon[102373]: pgmap v544: 97 pgs: 97 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 1.9 MiB/s wr, 201 op/s 2023-09-13T09:47:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:39 smithi006 ceph-mon[98665]: pgmap v544: 97 pgs: 97 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 1.9 MiB/s wr, 201 op/s 2023-09-13T09:47:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:39 smithi131 ceph-mon[102785]: pgmap v544: 97 pgs: 97 active+clean; 161 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 1.9 MiB/s wr, 201 op/s 2023-09-13T09:47:41.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 385421 5.23 MB/sec execute 301 sec latency 34.998 ms 2023-09-13T09:47:42.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 386929 5.25 MB/sec execute 302 sec latency 20.461 ms 2023-09-13T09:47:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:41 smithi006 ceph-mon[98665]: pgmap v545: 97 pgs: 97 active+clean; 163 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:47:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:41 smithi053 ceph-mon[102373]: pgmap v545: 97 pgs: 97 active+clean; 163 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:47:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:41 smithi131 ceph-mon[102785]: pgmap v545: 97 pgs: 97 active+clean; 163 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 976 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:47:43.172 INFO:tasks.workunit.client.0.smithi006.stdout: 1 388078 5.25 MB/sec execute 303 sec latency 15.719 ms 2023-09-13T09:47:44.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 390203 5.28 MB/sec execute 304 sec latency 35.504 ms 2023-09-13T09:47:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:43 smithi006 ceph-mon[98665]: pgmap v546: 97 pgs: 97 active+clean; 164 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 263 op/s 2023-09-13T09:47:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:43 smithi053 ceph-mon[102373]: pgmap v546: 97 pgs: 97 active+clean; 164 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 263 op/s 2023-09-13T09:47:44.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:43 smithi131 ceph-mon[102785]: pgmap v546: 97 pgs: 97 active+clean; 164 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 263 op/s 2023-09-13T09:47:45.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 391010 5.27 MB/sec execute 305 sec latency 16.736 ms 2023-09-13T09:47:46.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 392978 5.28 MB/sec execute 306 sec latency 53.180 ms 2023-09-13T09:47:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:45 smithi006 ceph-mon[98665]: pgmap v547: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2023-09-13T09:47:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:45 smithi053 ceph-mon[102373]: pgmap v547: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2023-09-13T09:47:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:45 smithi131 ceph-mon[102785]: pgmap v547: 97 pgs: 97 active+clean; 166 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2023-09-13T09:47:47.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 394181 5.29 MB/sec execute 307 sec latency 17.073 ms 2023-09-13T09:47:48.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 396122 5.30 MB/sec execute 308 sec latency 12.260 ms 2023-09-13T09:47:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:47 smithi006 ceph-mon[98665]: pgmap v548: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 268 op/s 2023-09-13T09:47:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:47 smithi053 ceph-mon[102373]: pgmap v548: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 268 op/s 2023-09-13T09:47:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:47 smithi131 ceph-mon[102785]: pgmap v548: 97 pgs: 97 active+clean; 165 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.2 MiB/s wr, 268 op/s 2023-09-13T09:47:49.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 397573 5.32 MB/sec execute 309 sec latency 17.514 ms 2023-09-13T09:47:50.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 398568 5.31 MB/sec execute 310 sec latency 12.721 ms 2023-09-13T09:47:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:49 smithi006 ceph-mon[98665]: pgmap v549: 97 pgs: 97 active+clean; 166 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2023-09-13T09:47:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:49 smithi053 ceph-mon[102373]: pgmap v549: 97 pgs: 97 active+clean; 166 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2023-09-13T09:47:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:49 smithi131 ceph-mon[102785]: pgmap v549: 97 pgs: 97 active+clean; 166 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 812 KiB/s rd, 1.9 MiB/s wr, 228 op/s 2023-09-13T09:47:51.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 400844 5.34 MB/sec execute 311 sec latency 42.185 ms 2023-09-13T09:47:52.036 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:47:52.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 401581 5.33 MB/sec execute 312 sec latency 24.555 ms 2023-09-13T09:47:52.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 -- 172.21.15.6:0/4162348069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2200ffb90 msgr2=0x7fc2200fffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 --2- 172.21.15.6:0/4162348069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2200ffb90 0x7fc2200fffb0 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7fc2100099c0 tx=0x7fc210009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 -- 172.21.15.6:0/4162348069 shutdown_connections 2023-09-13T09:47:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 --2- 172.21.15.6:0/4162348069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc220101720 0x7fc220107fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 --2- 172.21.15.6:0/4162348069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2200ffb90 0x7fc2200fffb0 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 --2- 172.21.15.6:0/4162348069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc220100d80 0x7fc2201011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 -- 172.21.15.6:0/4162348069 >> 172.21.15.6:0/4162348069 conn(0x7fc2200fb120 msgr2=0x7fc2200fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 -- 172.21.15.6:0/4162348069 shutdown_connections 2023-09-13T09:47:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 -- 172.21.15.6:0/4162348069 wait complete. 2023-09-13T09:47:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.177+0000 7fc22557e700 1 Processor -- start 2023-09-13T09:47:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc22557e700 1 -- start start 2023-09-13T09:47:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc22557e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2200ffb90 0x7fc220194750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc22557e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc220100d80 0x7fc220194c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc22557e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc220101720 0x7fc22019bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc22557e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22019c2d0 con 0x7fc220101720 2023-09-13T09:47:52.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc22557e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22019c410 con 0x7fc2200ffb90 2023-09-13T09:47:52.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc22557e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc22019c5a0 con 0x7fc220100d80 2023-09-13T09:47:52.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc220101720 0x7fc22019bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2200ffb90 0x7fc220194750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc220101720 0x7fc22019bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38942/0 (socket says 172.21.15.6:38942) 2023-09-13T09:47:52.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 -- 172.21.15.6:0/3732193787 learned_addr learned my addr 172.21.15.6:0/3732193787 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc2167fc700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc220100d80 0x7fc220194c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 -- 172.21.15.6:0/3732193787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc220100d80 msgr2=0x7fc220194c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc220100d80 0x7fc220194c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 -- 172.21.15.6:0/3732193787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2200ffb90 msgr2=0x7fc220194750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2200ffb90 0x7fc220194750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 -- 172.21.15.6:0/3732193787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2100095f0 con 0x7fc220101720 2023-09-13T09:47:52.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.178+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc220101720 0x7fc22019bd00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc2180049d0 tx=0x7fc21800f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.179+0000 7fc21cff9700 1 -- 172.21.15.6:0/3732193787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218014040 con 0x7fc220101720 2023-09-13T09:47:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.179+0000 7fc21cff9700 1 -- 172.21.15.6:0/3732193787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc218004db0 con 0x7fc220101720 2023-09-13T09:47:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.179+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc22019c820 con 0x7fc220101720 2023-09-13T09:47:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.179+0000 7fc21cff9700 1 -- 172.21.15.6:0/3732193787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218019480 con 0x7fc220101720 2023-09-13T09:47:52.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.179+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22019cce0 con 0x7fc220101720 2023-09-13T09:47:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.182+0000 7fc21cff9700 1 -- 172.21.15.6:0/3732193787 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc218007500 con 0x7fc220101720 2023-09-13T09:47:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.182+0000 7fc21cff9700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc20c0a0640 0x7fc20c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.182+0000 7fc21effd700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc20c0a0640 0x7fc20c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.182+0000 7fc21cff9700 1 -- 172.21.15.6:0/3732193787 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc2180cf900 con 0x7fc220101720 2023-09-13T09:47:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc21effd700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc20c0a0640 0x7fc20c0a2b00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc210009990 tx=0x7fc210005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 Processor -- start 2023-09-13T09:47:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 -- start start 2023-09-13T09:47:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d123700 0x55952d123b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d122e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d07b780 con 0x55952d122a00 2023-09-13T09:47:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d0790a0 con 0x55952d123700 2023-09-13T09:47:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.183+0000 7fc231763b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d074990 con 0x55952d124060 2023-09-13T09:47:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d122e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc2167fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d123700 0x55952d123b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc2167fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42004/0 (socket says 172.21.15.6:42004) 2023-09-13T09:47:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d122e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38952/0 (socket says 172.21.15.6:38952) 2023-09-13T09:47:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc2167fc700 1 -- 172.21.15.6:0/2645000626 learned_addr learned my addr 172.21.15.6:0/2645000626 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21effd700 1 -- 172.21.15.6:0/2645000626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 msgr2=0x55952d1224c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21effd700 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1224c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21effd700 1 -- 172.21.15.6:0/2645000626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 msgr2=0x55952d122e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21effd700 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d122e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21effd700 1 -- 172.21.15.6:0/2645000626 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55952cef4630 con 0x55952d123700 2023-09-13T09:47:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc21effd700 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d123700 0x55952d123b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098e0 tx=0x7fc21001f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66c6c79d6d9cfdc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc2157fa700 1 -- 172.21.15.6:0/2645000626 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210029070 con 0x55952d123700 2023-09-13T09:47:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc2157fa700 1 -- 172.21.15.6:0/2645000626 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc21001e040 con 0x55952d123700 2023-09-13T09:47:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.184+0000 7fc2157fa700 1 -- 172.21.15.6:0/2645000626 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21000f750 con 0x55952d123700 2023-09-13T09:47:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 -- 172.21.15.6:0/2645000626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d123700 msgr2=0x55952d123b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d123700 0x55952d123b20 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc2100098e0 tx=0x7fc21001f000 comp rx=0 tx=0).stop 2023-09-13T09:47:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 -- 172.21.15.6:0/2645000626 shutdown_connections 2023-09-13T09:47:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d122e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d123700 0x55952d123b20 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 --2- 172.21.15.6:0/2645000626 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1224c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 -- 172.21.15.6:0/2645000626 >> 172.21.15.6:0/2645000626 conn(0x55952d080c80 msgr2=0x55952d11cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 -- 172.21.15.6:0/2645000626 shutdown_connections 2023-09-13T09:47:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.185+0000 7fc231763b80 1 -- 172.21.15.6:0/2645000626 wait complete. 2023-09-13T09:47:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 -- start start 2023-09-13T09:47:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 Processor -- start 2023-09-13T09:47:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d122a00 0x55952d12bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d12c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1334c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d012bb0 con 0x55952d123700 2023-09-13T09:47:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d0128b0 con 0x55952d122a00 2023-09-13T09:47:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952cef6920 con 0x55952d124060 2023-09-13T09:47:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc231763b80 10 client.0 _ll_register_callbacks cb 0x55952d010680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc21effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d122a00 0x55952d12bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc21effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d122a00 0x55952d12bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60710/0 (socket says 172.21.15.6:60710) 2023-09-13T09:47:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc21effd700 1 -- 172.21.15.6:0/1891320531 learned_addr learned my addr 172.21.15.6:0/1891320531 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.186+0000 7fc2167fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d12c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc21effd700 1 -- 172.21.15.6:0/1891320531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 msgr2=0x55952d1334c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc21effd700 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1334c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc21effd700 1 -- 172.21.15.6:0/1891320531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 msgr2=0x55952d12c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc21effd700 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d12c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc21effd700 1 -- 172.21.15.6:0/1891320531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc220108920 con 0x55952d122a00 2023-09-13T09:47:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc21effd700 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d122a00 0x55952d12bf40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc210009d10 tx=0x7fc21000fcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38e24266b962a46c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc2067fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:47:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc2067fc700 1 -- 172.21.15.6:0/1891320531 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc210029040 con 0x55952d122a00 2023-09-13T09:47:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55952d115670 con 0x55952d122a00 2023-09-13T09:47:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc2067fc700 1 -- 172.21.15.6:0/1891320531 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc210005450 con 0x55952d122a00 2023-09-13T09:47:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc2067fc700 1 -- 172.21.15.6:0/1891320531 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc210003be0 con 0x55952d122a00 2023-09-13T09:47:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc231763b80 10 client.26993 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55952d08c7a0 con 0x55952d122a00 2023-09-13T09:47:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.187+0000 7fc2067fc700 1 -- 172.21.15.6:0/1891320531 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55952d115670 con 0x55952d122a00 2023-09-13T09:47:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc2067fc700 1 -- 172.21.15.6:0/1891320531 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc21003e400 con 0x55952d122a00 2023-09-13T09:47:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc231763b80 10 client.26993 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc231763b80 10 client.26993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc231763b80 20 client.26993 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc231763b80 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d137780 0x55952d139b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc231763b80 4 client.26993 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55952d06d970 con 0x55952d137780 2023-09-13T09:47:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc2167fc700 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d137780 0x55952d139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc2067fc700 10 client.26993 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.188+0000 7fc2167fc700 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d137780 0x55952d139b70 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6a047f7cf2b7e35 server_cookie=5b51d79c46fecd02 in_seq=0 out_seq=0 2023-09-13T09:47:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc2067fc700 1 -- 172.21.15.6:0/1891320531 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55952d06d970 con 0x55952d137780 2023-09-13T09:47:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc2067fc700 10 client.26993 handle_command_reply: tid=0 2023-09-13T09:47:52.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 client.26993 shutdown 2023-09-13T09:47:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d122a00 msgr2=0x55952d12bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d122a00 0x55952d12bf40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fc210009d10 tx=0x7fc21000fcc0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 shutdown_connections 2023-09-13T09:47:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d124060 0x55952d1334c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d122a00 0x55952d12bf40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d137780 0x55952d139b70 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 --2- 172.21.15.6:0/1891320531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d12c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc2067fc700 0 client.26993 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.189+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 >> 172.21.15.6:0/1891320531 conn(0x55952d080c80 msgr2=0x55952d1177f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.190+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 shutdown_connections 2023-09-13T09:47:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.190+0000 7fc231763b80 1 -- 172.21.15.6:0/1891320531 wait complete. 2023-09-13T09:47:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.190+0000 7fc231763b80 20 client.26993 trim_cache size 0 max 16384 2023-09-13T09:47:52.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 Processor -- start 2023-09-13T09:47:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 -- start start 2023-09-13T09:47:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d1224c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d123700 0x55952d133480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d126980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d12b3f0 con 0x55952d122a00 2023-09-13T09:47:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d115650 con 0x55952d124060 2023-09-13T09:47:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.207+0000 7fc231763b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d12bab0 con 0x55952d123700 2023-09-13T09:47:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d1224c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d1224c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38962/0 (socket says 172.21.15.6:38962) 2023-09-13T09:47:52.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 -- 172.21.15.6:0/4086759382 learned_addr learned my addr 172.21.15.6:0/4086759382 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d126980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc2167fc700 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d123700 0x55952d133480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 -- 172.21.15.6:0/4086759382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d123700 msgr2=0x55952d133480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d123700 0x55952d133480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 -- 172.21.15.6:0/4086759382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 msgr2=0x55952d126980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d126980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 -- 172.21.15.6:0/4086759382 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55952cea0de0 con 0x55952d122a00 2023-09-13T09:47:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d126980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc21effd700 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d1224c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc210005040 tx=0x7fc2100092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5834fb999c11a7f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc215ffb700 1 -- 172.21.15.6:0/4086759382 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21003ea80 con 0x55952d122a00 2023-09-13T09:47:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc215ffb700 1 -- 172.21.15.6:0/4086759382 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc21000fde0 con 0x55952d122a00 2023-09-13T09:47:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.208+0000 7fc215ffb700 1 -- 172.21.15.6:0/4086759382 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21002d8d0 con 0x55952d122a00 2023-09-13T09:47:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 -- 172.21.15.6:0/4086759382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 msgr2=0x55952d1224c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d1224c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fc210005040 tx=0x7fc2100092b0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 -- 172.21.15.6:0/4086759382 shutdown_connections 2023-09-13T09:47:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d126980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d122a00 0x55952d1224c0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 --2- 172.21.15.6:0/4086759382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d123700 0x55952d133480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 -- 172.21.15.6:0/4086759382 >> 172.21.15.6:0/4086759382 conn(0x55952d080c80 msgr2=0x55952d12ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 -- 172.21.15.6:0/4086759382 shutdown_connections 2023-09-13T09:47:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 -- 172.21.15.6:0/4086759382 wait complete. 2023-09-13T09:47:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.209+0000 7fc231763b80 1 -- start start 2023-09-13T09:47:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 1 Processor -- start 2023-09-13T09:47:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d122a00 0x55952d132cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d1331f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d12f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d12fce0 con 0x55952d123700 2023-09-13T09:47:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d12fe50 con 0x55952d124060 2023-09-13T09:47:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55952d130010 con 0x55952d122a00 2023-09-13T09:47:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc231763b80 10 client.0 _ll_register_callbacks cb 0x55952d010680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d1331f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d1331f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38970/0 (socket says 172.21.15.6:38970) 2023-09-13T09:47:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 -- 172.21.15.6:0/4201722542 learned_addr learned my addr 172.21.15.6:0/4201722542 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d12f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc21effd700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d122a00 0x55952d132cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 -- 172.21.15.6:0/4201722542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d122a00 msgr2=0x55952d132cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d122a00 0x55952d132cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 -- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 msgr2=0x55952d12f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d12f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc2167fc700 1 -- 172.21.15.6:0/4201722542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22019c820 con 0x55952d123700 2023-09-13T09:47:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.210+0000 7fc21f7fe700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d12f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc2167fc700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d1331f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc20800d930 tx=0x7fc208004480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b16cc303f13e2e57 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc2067fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc2067fc700 1 -- 172.21.15.6:0/4201722542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc208023070 con 0x55952d123700 2023-09-13T09:47:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc21001e040 con 0x55952d123700 2023-09-13T09:47:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc2067fc700 1 -- 172.21.15.6:0/4201722542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc208003bf0 con 0x55952d123700 2023-09-13T09:47:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc2067fc700 1 -- 172.21.15.6:0/4201722542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc208012040 con 0x55952d123700 2023-09-13T09:47:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 10 client.17592 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55952d08c7a0 con 0x55952d123700 2023-09-13T09:47:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc2067fc700 1 -- 172.21.15.6:0/4201722542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc21001e040 con 0x55952d123700 2023-09-13T09:47:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc2067fc700 1 -- 172.21.15.6:0/4201722542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc208032400 con 0x55952d123700 2023-09-13T09:47:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 10 client.17592 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 10 client.17592 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 20 client.17592 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d18cb00 0x55952d18ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 4 client.17592 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:47:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55952d02e050 con 0x55952d18cb00 2023-09-13T09:47:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.211+0000 7fc21effd700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d18cb00 0x55952d18ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc21effd700 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d18cb00 0x55952d18ef20 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=429c4cc3bc7785ef server_cookie=70af3ec63fc974b6 in_seq=0 out_seq=0 2023-09-13T09:47:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc2067fc700 10 client.17592 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc2067fc700 1 -- 172.21.15.6:0/4201722542 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55952d02e050 con 0x55952d18cb00 2023-09-13T09:47:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc2067fc700 10 client.17592 handle_command_reply: tid=0 2023-09-13T09:47:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 client.17592 shutdown 2023-09-13T09:47:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 msgr2=0x55952d1331f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d1331f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fc20800d930 tx=0x7fc208004480 comp rx=0 tx=0).stop 2023-09-13T09:47:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 shutdown_connections 2023-09-13T09:47:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55952d124060 0x55952d12f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55952d122a00 0x55952d132cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55952d18cb00 0x55952d18ef20 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 --2- 172.21.15.6:0/4201722542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55952d123700 0x55952d1331f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc2067fc700 0 client.17592 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 >> 172.21.15.6:0/4201722542 conn(0x55952d080c80 msgr2=0x55952d126980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 shutdown_connections 2023-09-13T09:47:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 1 -- 172.21.15.6:0/4201722542 wait complete. 2023-09-13T09:47:52.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.212+0000 7fc231763b80 20 client.17592 trim_cache size 0 max 16384 2023-09-13T09:47:52.232 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:47:52.232 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:47:52.233 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:47:52.233 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:47:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc20c0a0640 msgr2=0x7fc20c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc20c0a0640 0x7fc20c0a2b00 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fc210009990 tx=0x7fc210005fb0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc220101720 msgr2=0x7fc22019bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc220101720 0x7fc22019bd00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7fc2180049d0 tx=0x7fc21800f740 comp rx=0 tx=0).stop 2023-09-13T09:47:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 shutdown_connections 2023-09-13T09:47:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc20c0a0640 0x7fc20c0a2b00 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc220101720 0x7fc22019bd00 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2200ffb90 0x7fc220194750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 --2- 172.21.15.6:0/3732193787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc220100d80 0x7fc220194c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 >> 172.21.15.6:0/3732193787 conn(0x7fc2200fb120 msgr2=0x7fc2200fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 shutdown_connections 2023-09-13T09:47:52.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.213+0000 7fc22557e700 1 -- 172.21.15.6:0/3732193787 wait complete. 2023-09-13T09:47:52.236 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:51 smithi006 ceph-mon[98665]: pgmap v550: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-09-13T09:47:52.237 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:47:52.238 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:47:52.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:51 smithi053 ceph-mon[102373]: pgmap v550: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-09-13T09:47:52.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:51 smithi131 ceph-mon[102785]: pgmap v550: 97 pgs: 97 active+clean; 167 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 957 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-09-13T09:47:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- 172.21.15.6:0/1923811853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450101870 msgr2=0x7f7450103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1923811853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450101870 0x7f7450103c60 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f744c009990 tx=0x7f744c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- 172.21.15.6:0/1923811853 shutdown_connections 2023-09-13T09:47:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1923811853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450106ad0 0x7f7450108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1923811853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450101870 0x7f7450103c60 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1923811853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74501041a0 0x7f7450106590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- 172.21.15.6:0/1923811853 >> 172.21.15.6:0/1923811853 conn(0x7f74500fb220 msgr2=0x7f74500fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- 172.21.15.6:0/1923811853 shutdown_connections 2023-09-13T09:47:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- 172.21.15.6:0/1923811853 wait complete. 2023-09-13T09:47:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 Processor -- start 2023-09-13T09:47:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- start start 2023-09-13T09:47:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450101870 0x7f74501011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74501041a0 0x7f74500ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450106ad0 0x7f74500ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450100500 con 0x7f7450106ad0 2023-09-13T09:47:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7450100670 con 0x7f7450101870 2023-09-13T09:47:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.371+0000 7f7457c2d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74501a0ab0 con 0x7f74501041a0 2023-09-13T09:47:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74561ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450106ad0 0x7f74500ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74559c9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450101870 0x7f74501011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74559c9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450101870 0x7f74501011e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60738/0 (socket says 172.21.15.6:60738) 2023-09-13T09:47:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74551c8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74501041a0 0x7f74500ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74559c9700 1 -- 172.21.15.6:0/1642513330 learned_addr learned my addr 172.21.15.6:0/1642513330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74561ca700 1 -- 172.21.15.6:0/1642513330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74501041a0 msgr2=0x7f74500ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74561ca700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74501041a0 0x7f74500ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74561ca700 1 -- 172.21.15.6:0/1642513330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450101870 msgr2=0x7f74501011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74561ca700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450101870 0x7f74501011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74561ca700 1 -- 172.21.15.6:0/1642513330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c0095f0 con 0x7f7450106ad0 2023-09-13T09:47:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f74561ca700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450106ad0 0x7f74500ffd60 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f744800efc0 tx=0x7f744800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f7446ffd700 1 -- 172.21.15.6:0/1642513330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7448018070 con 0x7f7450106ad0 2023-09-13T09:47:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f7446ffd700 1 -- 172.21.15.6:0/1642513330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f744800f040 con 0x7f7450106ad0 2023-09-13T09:47:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74501a0d30 con 0x7f7450106ad0 2023-09-13T09:47:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f7446ffd700 1 -- 172.21.15.6:0/1642513330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800cd40 con 0x7f7450106ad0 2023-09-13T09:47:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.372+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74501a11e0 con 0x7f7450106ad0 2023-09-13T09:47:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.373+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74500fcda0 con 0x7f7450106ad0 2023-09-13T09:47:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.374+0000 7f7446ffd700 1 -- 172.21.15.6:0/1642513330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7448003a00 con 0x7f7450106ad0 2023-09-13T09:47:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.375+0000 7f7446ffd700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f743c0a0640 0x7f743c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.375+0000 7f7446ffd700 1 -- 172.21.15.6:0/1642513330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74480cc110 con 0x7f7450106ad0 2023-09-13T09:47:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.375+0000 7f74559c9700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f743c0a0640 0x7f743c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.376+0000 7f74559c9700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f743c0a0640 0x7f743c0a2b00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f744c00b2e0 tx=0x7f744c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.379+0000 7f7446ffd700 1 -- 172.21.15.6:0/1642513330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7448095c80 con 0x7f7450106ad0 2023-09-13T09:47:52.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.643+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f745002cfc0 con 0x7f7450106ad0 2023-09-13T09:47:52.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.644+0000 7f7446ffd700 1 -- 172.21.15.6:0/1642513330 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f74480992a0 con 0x7f7450106ad0 2023-09-13T09:47:52.644 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:47:52.645 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:47:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f743c0a0640 msgr2=0x7f743c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f743c0a0640 0x7f743c0a2b00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f744c00b2e0 tx=0x7f744c005960 comp rx=0 tx=0).stop 2023-09-13T09:47:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450106ad0 msgr2=0x7f74500ffd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450106ad0 0x7f74500ffd60 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f744800efc0 tx=0x7f744800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 shutdown_connections 2023-09-13T09:47:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f743c0a0640 0x7f743c0a2b00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7450106ad0 0x7f74500ffd60 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7450101870 0x7f74501011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 --2- 172.21.15.6:0/1642513330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74501041a0 0x7f74500ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.646+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 >> 172.21.15.6:0/1642513330 conn(0x7f74500fb220 msgr2=0x7f74501024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.647+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 shutdown_connections 2023-09-13T09:47:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.647+0000 7f7457c2d700 1 -- 172.21.15.6:0/1642513330 wait complete. 2023-09-13T09:47:52.649 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:47:52.659 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:47:52.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 -- 172.21.15.6:0/53489753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 msgr2=0x7f79781011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 --2- 172.21.15.6:0/53489753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f79781011e0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f796c0099c0 tx=0x7f796c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 -- 172.21.15.6:0/53489753 shutdown_connections 2023-09-13T09:47:52.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 --2- 172.21.15.6:0/53489753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7978102950 0x7f7978109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 --2- 172.21.15.6:0/53489753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f79781011e0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 --2- 172.21.15.6:0/53489753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7978101fb0 0x7f7978102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 -- 172.21.15.6:0/53489753 >> 172.21.15.6:0/53489753 conn(0x7f79780fc330 msgr2=0x7f79780fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 -- 172.21.15.6:0/53489753 shutdown_connections 2023-09-13T09:47:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 -- 172.21.15.6:0/53489753 wait complete. 2023-09-13T09:47:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 Processor -- start 2023-09-13T09:47:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.798+0000 7f797e3d5700 1 -- start start 2023-09-13T09:47:52.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797e3d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f7978196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797e3d5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7978101fb0 0x7f7978196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797e3d5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7978102950 0x7f797819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797e3d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797819e5d0 con 0x7f7978100dc0 2023-09-13T09:47:52.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797e3d5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797819e710 con 0x7f7978101fb0 2023-09-13T09:47:52.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797e3d5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f797819e8a0 con 0x7f7978102950 2023-09-13T09:47:52.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f7978196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f7978196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38996/0 (socket says 172.21.15.6:38996) 2023-09-13T09:47:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 -- 172.21.15.6:0/631558675 learned_addr learned my addr 172.21.15.6:0/631558675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f79777fe700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7978101fb0 0x7f7978196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797c972700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7978102950 0x7f797819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 -- 172.21.15.6:0/631558675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7978102950 msgr2=0x7f797819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7978102950 0x7f797819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 -- 172.21.15.6:0/631558675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7978101fb0 msgr2=0x7f7978196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7978101fb0 0x7f7978196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 -- 172.21.15.6:0/631558675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0095f0 con 0x7f7978100dc0 2023-09-13T09:47:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797c972700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7978102950 0x7f797819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:47:52.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f7977fff700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f7978196a50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f796c009fd0 tx=0x7f796c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f79757fa700 1 -- 172.21.15.6:0/631558675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c01d070 con 0x7f7978100dc0 2023-09-13T09:47:52.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f79757fa700 1 -- 172.21.15.6:0/631558675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f796c005030 con 0x7f7978100dc0 2023-09-13T09:47:52.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f797819eb20 con 0x7f7978100dc0 2023-09-13T09:47:52.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.799+0000 7f79757fa700 1 -- 172.21.15.6:0/631558675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c004b30 con 0x7f7978100dc0 2023-09-13T09:47:52.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.800+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f797819ef40 con 0x7f7978100dc0 2023-09-13T09:47:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.802+0000 7f79757fa700 1 -- 172.21.15.6:0/631558675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f796c0051a0 con 0x7f7978100dc0 2023-09-13T09:47:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.802+0000 7f79757fa700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79600a0640 0x7f79600a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.802+0000 7f79777fe700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79600a0640 0x7f79600a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.802+0000 7f79757fa700 1 -- 172.21.15.6:0/631558675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f796c0cc9b0 con 0x7f7978100dc0 2023-09-13T09:47:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.803+0000 7f79777fe700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79600a0640 0x7f79600a2b00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7968009c60 tx=0x7f7968009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.803+0000 7f798a5bab80 1 Processor -- start 2023-09-13T09:47:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f798a5bab80 1 -- start start 2023-09-13T09:47:52.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668dbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668dc060 0x5654668da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668dae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f798a5bab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x565466833780 con 0x5654668dc060 2023-09-13T09:47:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f798a5bab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654668310a0 con 0x5654668daa00 2023-09-13T09:47:52.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f798a5bab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56546682c990 con 0x5654668db700 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668dc060 0x5654668da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668dc060 0x5654668da4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39004/0 (socket says 172.21.15.6:39004) 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 -- 172.21.15.6:0/554344672 learned_addr learned my addr 172.21.15.6:0/554344672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f797c972700 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668dae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f7977fff700 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668dbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 -- 172.21.15.6:0/554344672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 msgr2=0x5654668dbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668dbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 -- 172.21.15.6:0/554344672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 msgr2=0x5654668dae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668dae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 -- 172.21.15.6:0/554344672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654666ac630 con 0x5654668dc060 2023-09-13T09:47:52.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f7977fff700 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668dbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.804+0000 7f79777fe700 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668dc060 0x5654668da4c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f796800e4e0 tx=0x7f7968014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9aba0741ebb1ce2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f795e7fc700 1 -- 172.21.15.6:0/554344672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796800ee00 con 0x5654668dc060 2023-09-13T09:47:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f795e7fc700 1 -- 172.21.15.6:0/554344672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7968021070 con 0x5654668dc060 2023-09-13T09:47:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f795e7fc700 1 -- 172.21.15.6:0/554344672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796801d810 con 0x5654668dc060 2023-09-13T09:47:52.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 -- 172.21.15.6:0/554344672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668dc060 msgr2=0x5654668da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668dc060 0x5654668da4c0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f796800e4e0 tx=0x7f7968014000 comp rx=0 tx=0).stop 2023-09-13T09:47:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 -- 172.21.15.6:0/554344672 shutdown_connections 2023-09-13T09:47:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668dae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668dbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 --2- 172.21.15.6:0/554344672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668dc060 0x5654668da4c0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 -- 172.21.15.6:0/554344672 >> 172.21.15.6:0/554344672 conn(0x565466838c80 msgr2=0x5654668d4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 -- 172.21.15.6:0/554344672 shutdown_connections 2023-09-13T09:47:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.805+0000 7f798a5bab80 1 -- 172.21.15.6:0/554344672 wait complete. 2023-09-13T09:47:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 -- start start 2023-09-13T09:47:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 Processor -- start 2023-09-13T09:47:52.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668db700 0x5654668e4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668eb480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654667cabb0 con 0x5654668db700 2023-09-13T09:47:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654667ca8b0 con 0x5654668daa00 2023-09-13T09:47:52.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654666ae920 con 0x5654668dc060 2023-09-13T09:47:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f798a5bab80 10 client.0 _ll_register_callbacks cb 0x5654667c8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f79777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668db700 0x5654668e4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f7977fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f79777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668db700 0x5654668e4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39012/0 (socket says 172.21.15.6:39012) 2023-09-13T09:47:52.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f79777fe700 1 -- 172.21.15.6:0/2061644612 learned_addr learned my addr 172.21.15.6:0/2061644612 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.806+0000 7f797c972700 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668eb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79777fe700 1 -- 172.21.15.6:0/2061644612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 msgr2=0x5654668eb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79777fe700 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668eb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79777fe700 1 -- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 msgr2=0x5654668e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79777fe700 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668e3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79777fe700 1 -- 172.21.15.6:0/2061644612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7968017070 con 0x5654668db700 2023-09-13T09:47:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f7977fff700 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79777fe700 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668db700 0x5654668e4440 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f796800edc0 tx=0x7f796800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fbac05cbc6da145 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79577fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79577fe700 1 -- 172.21.15.6:0/2061644612 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79680052d0 con 0x5654668db700 2023-09-13T09:47:52.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79577fe700 1 -- 172.21.15.6:0/2061644612 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7968005430 con 0x5654668db700 2023-09-13T09:47:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654668cd670 con 0x5654668db700 2023-09-13T09:47:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79577fe700 1 -- 172.21.15.6:0/2061644612 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79680055f0 con 0x5654668db700 2023-09-13T09:47:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f798a5bab80 10 client.17610 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5654668447a0 con 0x5654668db700 2023-09-13T09:47:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.807+0000 7f79577fe700 1 -- 172.21.15.6:0/2061644612 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f796803d080 con 0x5654668db700 2023-09-13T09:47:52.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f79577fe700 1 -- 172.21.15.6:0/2061644612 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f796801c770 con 0x5654668db700 2023-09-13T09:47:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f798a5bab80 10 client.17610 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f798a5bab80 10 client.17610 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:47:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f798a5bab80 20 client.17610 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5654668efc20 0x5654668f2040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f798a5bab80 4 client.17610 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565466825970 con 0x5654668efc20 2023-09-13T09:47:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f7977fff700 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5654668efc20 0x5654668f2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f79577fe700 10 client.17610 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.808+0000 7f7977fff700 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5654668efc20 0x5654668f2040 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=34ede51b0901c465 server_cookie=432bdd325cdfd1f3 in_seq=0 out_seq=0 2023-09-13T09:47:52.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.809+0000 7f79577fe700 1 -- 172.21.15.6:0/2061644612 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565466825970 con 0x5654668efc20 2023-09-13T09:47:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.809+0000 7f79577fe700 10 client.17610 handle_command_reply: tid=0 2023-09-13T09:47:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.809+0000 7f798a5bab80 1 client.17610 shutdown 2023-09-13T09:47:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668db700 msgr2=0x5654668e4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668db700 0x5654668e4440 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f796800edc0 tx=0x7f796800edf0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 shutdown_connections 2023-09-13T09:47:52.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5654668efc20 0x5654668f2040 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668eb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f79577fe700 0 client.17610 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:52.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668daa00 0x5654668e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2061644612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668db700 0x5654668e4440 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 >> 172.21.15.6:0/2061644612 conn(0x565466838c80 msgr2=0x5654668cf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 shutdown_connections 2023-09-13T09:47:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 1 -- 172.21.15.6:0/2061644612 wait complete. 2023-09-13T09:47:52.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.810+0000 7f798a5bab80 20 client.17610 trim_cache size 0 max 16384 2023-09-13T09:47:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.824+0000 7f798a5bab80 1 Processor -- start 2023-09-13T09:47:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.824+0000 7f798a5bab80 1 -- start start 2023-09-13T09:47:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668eb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668dc060 0x5654668e3ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f798a5bab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654668e3a70 con 0x5654668daa00 2023-09-13T09:47:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f798a5bab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654668d6730 con 0x5654668dc060 2023-09-13T09:47:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f798a5bab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654668cd490 con 0x5654668db700 2023-09-13T09:47:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f7977fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f79777fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668eb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f7977fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668da4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39018/0 (socket says 172.21.15.6:39018) 2023-09-13T09:47:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f7977fff700 1 -- 172.21.15.6:0/2174707322 learned_addr learned my addr 172.21.15.6:0/2174707322 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f797c972700 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668dc060 0x5654668e3ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f79777fe700 1 -- 172.21.15.6:0/2174707322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668dc060 msgr2=0x5654668e3ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f79777fe700 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668dc060 0x5654668e3ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f79777fe700 1 -- 172.21.15.6:0/2174707322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 msgr2=0x5654668da4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f79777fe700 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668da4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f79777fe700 1 -- 172.21.15.6:0/2174707322 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565466658de0 con 0x5654668db700 2023-09-13T09:47:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f797c972700 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668dc060 0x5654668e3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:52.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f79777fe700 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668eb440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f796801cbd0 tx=0x7f7968009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84f4e039bd88910b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f795effd700 1 -- 172.21.15.6:0/2174707322 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796801cdc0 con 0x5654668db700 2023-09-13T09:47:52.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f795effd700 1 -- 172.21.15.6:0/2174707322 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5654668cd670 con 0x5654668db700 2023-09-13T09:47:52.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.825+0000 7f795effd700 1 -- 172.21.15.6:0/2174707322 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7968003900 con 0x5654668db700 2023-09-13T09:47:52.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 -- 172.21.15.6:0/2174707322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 msgr2=0x5654668eb440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668eb440 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f796801cbd0 tx=0x7f7968009e50 comp rx=0 tx=0).stop 2023-09-13T09:47:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 -- 172.21.15.6:0/2174707322 shutdown_connections 2023-09-13T09:47:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668dc060 0x5654668e3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668da4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2174707322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668db700 0x5654668eb440 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 -- 172.21.15.6:0/2174707322 >> 172.21.15.6:0/2174707322 conn(0x565466838c80 msgr2=0x5654668e2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 -- 172.21.15.6:0/2174707322 shutdown_connections 2023-09-13T09:47:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 -- 172.21.15.6:0/2174707322 wait complete. 2023-09-13T09:47:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.826+0000 7f798a5bab80 1 -- start start 2023-09-13T09:47:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 1 Processor -- start 2023-09-13T09:47:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668e71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668db700 0x5654668e7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668ea750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654668eac90 con 0x5654668daa00 2023-09-13T09:47:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654668eae00 con 0x5654668db700 2023-09-13T09:47:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654668eafc0 con 0x5654668dc060 2023-09-13T09:47:52.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f798a5bab80 10 client.0 _ll_register_callbacks cb 0x5654667c8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668e71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668e71f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39024/0 (socket says 172.21.15.6:39024) 2023-09-13T09:47:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 -- 172.21.15.6:0/2268649540 learned_addr learned my addr 172.21.15.6:0/2268649540 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f79777fe700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668db700 0x5654668e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f797c972700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668ea750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 -- 172.21.15.6:0/2268649540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 msgr2=0x5654668ea750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668ea750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 -- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668db700 msgr2=0x5654668e7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:52.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668db700 0x5654668e7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 -- 172.21.15.6:0/2268649540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79700091c0 con 0x5654668daa00 2023-09-13T09:47:52.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f79777fe700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668db700 0x5654668e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:52.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f7977fff700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668e71f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f796c000c00 tx=0x7f796c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdb7f6a89a8b050 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:52.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.827+0000 7f79577fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:52.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f79577fe700 1 -- 172.21.15.6:0/2268649540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796c0b2070 con 0x5654668daa00 2023-09-13T09:47:52.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f79577fe700 1 -- 172.21.15.6:0/2268649540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f796c098580 con 0x5654668daa00 2023-09-13T09:47:52.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7968021070 con 0x5654668daa00 2023-09-13T09:47:52.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f79577fe700 1 -- 172.21.15.6:0/2268649540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f796c0b81b0 con 0x5654668daa00 2023-09-13T09:47:52.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 10 client.17616 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:52.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5654668447a0 con 0x5654668daa00 2023-09-13T09:47:52.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f79577fe700 1 -- 172.21.15.6:0/2268649540 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7968021070 con 0x5654668daa00 2023-09-13T09:47:52.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f79577fe700 1 -- 172.21.15.6:0/2268649540 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f796c099760 con 0x5654668daa00 2023-09-13T09:47:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 10 client.17616 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 10 client.17616 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:47:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 20 client.17616 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x565466944700 0x565466946b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 4 client.17616 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5654667e6050 con 0x565466944700 2023-09-13T09:47:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.828+0000 7f79777fe700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x565466944700 0x565466946b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f79577fe700 10 client.17616 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f79777fe700 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x565466944700 0x565466946b20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=75ac10a69043c493 server_cookie=bbbaba60d15c50cb in_seq=0 out_seq=0 2023-09-13T09:47:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f79577fe700 1 -- 172.21.15.6:0/2268649540 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5654667e6050 con 0x565466944700 2023-09-13T09:47:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f79577fe700 10 client.17616 handle_command_reply: tid=0 2023-09-13T09:47:52.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 client.17616 shutdown 2023-09-13T09:47:52.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 msgr2=0x5654668e71f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668e71f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f796c000c00 tx=0x7f796c01a040 comp rx=0 tx=0).stop 2023-09-13T09:47:52.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 shutdown_connections 2023-09-13T09:47:52.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x565466944700 0x565466946b20 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5654668dc060 0x5654668ea750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5654668daa00 0x5654668e71f0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 --2- 172.21.15.6:0/2268649540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5654668db700 0x5654668e7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 >> 172.21.15.6:0/2268649540 conn(0x565466838c80 msgr2=0x5654668de8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f79577fe700 0 client.17616 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:47:52.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 shutdown_connections 2023-09-13T09:47:52.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 1 -- 172.21.15.6:0/2268649540 wait complete. 2023-09-13T09:47:52.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.829+0000 7f798a5bab80 20 client.17616 trim_cache size 0 max 16384 2023-09-13T09:47:52.851 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:52.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79600a0640 msgr2=0x7f79600a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79600a0640 0x7f79600a2b00 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7968009c60 tx=0x7f7968009260 comp rx=0 tx=0).stop 2023-09-13T09:47:52.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 msgr2=0x7f7978196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f7978196a50 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f796c009fd0 tx=0x7f796c009580 comp rx=0 tx=0).stop 2023-09-13T09:47:52.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 shutdown_connections 2023-09-13T09:47:52.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7978102950 0x7f797819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79600a0640 0x7f79600a2b00 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7978100dc0 0x7f7978196a50 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 --2- 172.21.15.6:0/631558675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7978101fb0 0x7f7978196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 >> 172.21.15.6:0/631558675 conn(0x7f79780fc330 msgr2=0x7f7978105440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 shutdown_connections 2023-09-13T09:47:52.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.830+0000 7f797e3d5700 1 -- 172.21.15.6:0/631558675 wait complete. 2023-09-13T09:47:52.855 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:47:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 -- 172.21.15.6:0/2121252284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 msgr2=0x7fef700ffa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:52.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 --2- 172.21.15.6:0/2121252284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef700ffa50 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009990 tx=0x7fef6c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 -- 172.21.15.6:0/2121252284 shutdown_connections 2023-09-13T09:47:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 --2- 172.21.15.6:0/2121252284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef70100950 0x7fef70100dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 --2- 172.21.15.6:0/2121252284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef700ffa50 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 --2- 172.21.15.6:0/2121252284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef700fff90 0x7fef70100410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:52.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 -- 172.21.15.6:0/2121252284 >> 172.21.15.6:0/2121252284 conn(0x7fef700fb210 msgr2=0x7fef700fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 -- 172.21.15.6:0/2121252284 shutdown_connections 2023-09-13T09:47:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.993+0000 7fef773f1700 1 -- 172.21.15.6:0/2121252284 wait complete. 2023-09-13T09:47:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 Processor -- start 2023-09-13T09:47:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 -- start start 2023-09-13T09:47:52.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef70198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef700fff90 0x7fef70199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef70100950 0x7fef701a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef701a0860 con 0x7fef700ff630 2023-09-13T09:47:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef701a09d0 con 0x7fef700fff90 2023-09-13T09:47:52.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef773f1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef701a0b90 con 0x7fef70100950 2023-09-13T09:47:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef7518d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef70198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef7518d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef70198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39038/0 (socket says 172.21.15.6:39038) 2023-09-13T09:47:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef7518d700 1 -- 172.21.15.6:0/570306837 learned_addr learned my addr 172.21.15.6:0/570306837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef7498c700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef700fff90 0x7fef70199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:52.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.994+0000 7fef7598e700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef70100950 0x7fef701a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef7518d700 1 -- 172.21.15.6:0/570306837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef70100950 msgr2=0x7fef701a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef7518d700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef70100950 0x7fef701a0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef7518d700 1 -- 172.21.15.6:0/570306837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef700fff90 msgr2=0x7fef70199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef7518d700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef700fff90 0x7fef70199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef7518d700 1 -- 172.21.15.6:0/570306837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0095f0 con 0x7fef700ff630 2023-09-13T09:47:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef7498c700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef700fff90 0x7fef70199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef7518d700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef70198d20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0059d0 tx=0x7fef6c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef667fc700 1 -- 172.21.15.6:0/570306837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c01d070 con 0x7fef700ff630 2023-09-13T09:47:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef667fc700 1 -- 172.21.15.6:0/570306837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef6c00fb90 con 0x7fef700ff630 2023-09-13T09:47:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef667fc700 1 -- 172.21.15.6:0/570306837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0173f0 con 0x7fef700ff630 2023-09-13T09:47:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef701a0e10 con 0x7fef700ff630 2023-09-13T09:47:53.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.995+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef701a1180 con 0x7fef700ff630 2023-09-13T09:47:53.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.998+0000 7fef667fc700 1 -- 172.21.15.6:0/570306837 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fef6c00fd00 con 0x7fef700ff630 2023-09-13T09:47:53.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.999+0000 7fef667fc700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef5c0a0640 0x7fef5c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.999+0000 7fef667fc700 1 -- 172.21.15.6:0/570306837 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef6c0ccfc0 con 0x7fef700ff630 2023-09-13T09:47:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.999+0000 7fef7498c700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef5c0a0640 0x7fef5c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:52.999+0000 7fef7498c700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef5c0a0640 0x7fef5c0a2b00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fef60011490 tx=0x7fef60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 Processor -- start 2023-09-13T09:47:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 -- start start 2023-09-13T09:47:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee47b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee46e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eed9f780 con 0x5565eee46a00 2023-09-13T09:47:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eed9d0a0 con 0x5565eee47700 2023-09-13T09:47:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef835d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eed98990 con 0x5565eee48060 2023-09-13T09:47:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee46e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee46e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39050/0 (socket says 172.21.15.6:39050) 2023-09-13T09:47:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7498c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 -- 172.21.15.6:0/3985144986 learned_addr learned my addr 172.21.15.6:0/3985144986 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7518d700 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee47b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 -- 172.21.15.6:0/3985144986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 msgr2=0x5565eee464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 -- 172.21.15.6:0/3985144986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 msgr2=0x5565eee47b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee47b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.000+0000 7fef7598e700 1 -- 172.21.15.6:0/3985144986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565eec18630 con 0x5565eee46a00 2023-09-13T09:47:53.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.001+0000 7fef7598e700 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee46e80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fef68011680 tx=0x7fef68009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37fb103ba80fc78 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.001+0000 7fef5b7fe700 1 -- 172.21.15.6:0/3985144986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6800e040 con 0x5565eee46a00 2023-09-13T09:47:53.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.001+0000 7fef5b7fe700 1 -- 172.21.15.6:0/3985144986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef6800f040 con 0x5565eee46a00 2023-09-13T09:47:53.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.001+0000 7fef5b7fe700 1 -- 172.21.15.6:0/3985144986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68004860 con 0x5565eee46a00 2023-09-13T09:47:53.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.001+0000 7fef835d6b80 1 -- 172.21.15.6:0/3985144986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 msgr2=0x5565eee46e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.001+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee46e80 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7fef68011680 tx=0x7fef68009920 comp rx=0 tx=0).stop 2023-09-13T09:47:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- 172.21.15.6:0/3985144986 shutdown_connections 2023-09-13T09:47:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee46e80 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee47b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3985144986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- 172.21.15.6:0/3985144986 >> 172.21.15.6:0/3985144986 conn(0x5565eeda4c80 msgr2=0x5565eee40f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- 172.21.15.6:0/3985144986 shutdown_connections 2023-09-13T09:47:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- 172.21.15.6:0/3985144986 wait complete. 2023-09-13T09:47:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- start start 2023-09-13T09:47:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 Processor -- start 2023-09-13T09:47:53.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee46a00 0x5565eee4fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee503d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee48060 0x5565eee57410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eed36bb0 con 0x5565eee48060 2023-09-13T09:47:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eed368b0 con 0x5565eee47700 2023-09-13T09:47:53.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.002+0000 7fef835d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eec1a920 con 0x5565eee46a00 2023-09-13T09:47:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef835d6b80 10 client.0 _ll_register_callbacks cb 0x5565eed34680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7598e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee48060 0x5565eee57410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7518d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee46a00 0x5565eee4fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7498c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7518d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee46a00 0x5565eee4fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42106/0 (socket says 172.21.15.6:42106) 2023-09-13T09:47:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7518d700 1 -- 172.21.15.6:0/3498767410 learned_addr learned my addr 172.21.15.6:0/3498767410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7598e700 1 -- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee46a00 msgr2=0x5565eee4fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7598e700 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee46a00 0x5565eee4fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7598e700 1 -- 172.21.15.6:0/3498767410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 msgr2=0x5565eee503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7598e700 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee503d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7598e700 1 -- 172.21.15.6:0/3498767410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef68011330 con 0x5565eee48060 2023-09-13T09:47:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7518d700 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee46a00 0x5565eee4fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7498c700 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef7598e700 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee48060 0x5565eee57410 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fef68011650 tx=0x7fef68009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8513179d3c9c7e6d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:53.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef58ff9700 1 -- 172.21.15.6:0/3498767410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6800e070 con 0x5565eee48060 2023-09-13T09:47:53.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5565eee39670 con 0x5565eee48060 2023-09-13T09:47:53.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.003+0000 7fef58ff9700 1 -- 172.21.15.6:0/3498767410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef68003c10 con 0x5565eee48060 2023-09-13T09:47:53.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef58ff9700 1 -- 172.21.15.6:0/3498767410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef68003dd0 con 0x5565eee48060 2023-09-13T09:47:53.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 10 client.17628 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5565eedb07a0 con 0x5565eee48060 2023-09-13T09:47:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef58ff9700 1 -- 172.21.15.6:0/3498767410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5565eee39670 con 0x5565eee48060 2023-09-13T09:47:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef58ff9700 1 -- 172.21.15.6:0/3498767410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fef68015450 con 0x5565eee48060 2023-09-13T09:47:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 10 client.17628 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 10 client.17628 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:47:53.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 20 client.17628 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eee5bb00 0x5565eee5df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 4 client.17628 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:53.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5565eed91970 con 0x5565eee5bb00 2023-09-13T09:47:53.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.004+0000 7fef7518d700 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eee5bb00 0x5565eee5df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.005+0000 7fef58ff9700 10 client.17628 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:53.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.005+0000 7fef7518d700 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eee5bb00 0x5565eee5df20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f5a296ee343f7a8a server_cookie=c074d0d468a42f2e in_seq=0 out_seq=0 2023-09-13T09:47:53.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef58ff9700 1 -- 172.21.15.6:0/3498767410 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5565eed91970 con 0x5565eee5bb00 2023-09-13T09:47:53.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef58ff9700 10 client.17628 handle_command_reply: tid=0 2023-09-13T09:47:53.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 client.17628 shutdown 2023-09-13T09:47:53.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee48060 msgr2=0x5565eee57410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee48060 0x5565eee57410 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7fef68011650 tx=0x7fef68009510 comp rx=0 tx=0).stop 2023-09-13T09:47:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 shutdown_connections 2023-09-13T09:47:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eee5bb00 0x5565eee5df20 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee48060 0x5565eee57410 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee46a00 0x5565eee4fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 --2- 172.21.15.6:0/3498767410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 >> 172.21.15.6:0/3498767410 conn(0x5565eeda4c80 msgr2=0x5565eee40ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef58ff9700 0 client.17628 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 shutdown_connections 2023-09-13T09:47:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 1 -- 172.21.15.6:0/3498767410 wait complete. 2023-09-13T09:47:53.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.006+0000 7fef835d6b80 20 client.17628 trim_cache size 0 max 16384 2023-09-13T09:47:53.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 Processor -- start 2023-09-13T09:47:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 -- start start 2023-09-13T09:47:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee46a00 0x5565eee464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee47700 0x5565eee573d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee57d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eee41990 con 0x5565eee47700 2023-09-13T09:47:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eee5b640 con 0x5565eee46a00 2023-09-13T09:47:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef835d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eee42730 con 0x5565eee48060 2023-09-13T09:47:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee47700 0x5565eee573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee47700 0x5565eee573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39062/0 (socket says 172.21.15.6:39062) 2023-09-13T09:47:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 -- 172.21.15.6:0/1801788536 learned_addr learned my addr 172.21.15.6:0/1801788536 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7518d700 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee46a00 0x5565eee464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7598e700 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee57d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 -- 172.21.15.6:0/1801788536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 msgr2=0x5565eee57d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee57d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 -- 172.21.15.6:0/1801788536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee46a00 msgr2=0x5565eee464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee46a00 0x5565eee464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.020+0000 7fef7498c700 1 -- 172.21.15.6:0/1801788536 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5565eebc4de0 con 0x5565eee47700 2023-09-13T09:47:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef7498c700 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee47700 0x5565eee573d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fef600037e0 tx=0x7fef60014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760d029448167dc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef5bfff700 1 -- 172.21.15.6:0/1801788536 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60024070 con 0x5565eee47700 2023-09-13T09:47:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef5bfff700 1 -- 172.21.15.6:0/1801788536 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef6001e8b0 con 0x5565eee47700 2023-09-13T09:47:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef5bfff700 1 -- 172.21.15.6:0/1801788536 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef60028820 con 0x5565eee47700 2023-09-13T09:47:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef835d6b80 1 -- 172.21.15.6:0/1801788536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee47700 msgr2=0x5565eee573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef835d6b80 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee47700 0x5565eee573d0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fef600037e0 tx=0x7fef60014000 comp rx=0 tx=0).stop 2023-09-13T09:47:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef835d6b80 1 -- 172.21.15.6:0/1801788536 shutdown_connections 2023-09-13T09:47:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef835d6b80 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee57d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef835d6b80 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee46a00 0x5565eee464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef835d6b80 1 --2- 172.21.15.6:0/1801788536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee47700 0x5565eee573d0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.021+0000 7fef835d6b80 1 -- 172.21.15.6:0/1801788536 >> 172.21.15.6:0/1801788536 conn(0x5565eeda4c80 msgr2=0x5565eee40e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 -- 172.21.15.6:0/1801788536 shutdown_connections 2023-09-13T09:47:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 -- 172.21.15.6:0/1801788536 wait complete. 2023-09-13T09:47:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 -- start start 2023-09-13T09:47:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 Processor -- start 2023-09-13T09:47:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee52fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee53510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee56530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eee56a70 con 0x5565eee46a00 2023-09-13T09:47:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eee56be0 con 0x5565eee47700 2023-09-13T09:47:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.022+0000 7fef835d6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5565eee56da0 con 0x5565eee48060 2023-09-13T09:47:53.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef835d6b80 10 client.0 _ll_register_callbacks cb 0x5565eed34680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee52fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee52fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39066/0 (socket says 172.21.15.6:39066) 2023-09-13T09:47:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 -- 172.21.15.6:0/2013303270 learned_addr learned my addr 172.21.15.6:0/2013303270 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7498c700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee53510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7598e700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee56530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 -- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 msgr2=0x5565eee56530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee56530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 -- 172.21.15.6:0/2013303270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 msgr2=0x5565eee53510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee53510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 -- 172.21.15.6:0/2013303270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef60017070 con 0x5565eee46a00 2023-09-13T09:47:53.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7598e700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee56530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:47:53.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef7518d700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee52fd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0caac0 tx=0x7fef6c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbc38a3b5655e0b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef58ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:53.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef58ff9700 1 -- 172.21.15.6:0/2013303270 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c0a27d0 con 0x5565eee46a00 2023-09-13T09:47:53.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef6800f040 con 0x5565eee46a00 2023-09-13T09:47:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.023+0000 7fef58ff9700 1 -- 172.21.15.6:0/2013303270 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef6c0a2340 con 0x5565eee46a00 2023-09-13T09:47:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef58ff9700 1 -- 172.21.15.6:0/2013303270 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef6c0a2500 con 0x5565eee46a00 2023-09-13T09:47:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 10 client.17634 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5565eebadc60 con 0x5565eee46a00 2023-09-13T09:47:53.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef58ff9700 1 -- 172.21.15.6:0/2013303270 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef6800f040 con 0x5565eee46a00 2023-09-13T09:47:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef58ff9700 1 -- 172.21.15.6:0/2013303270 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fef6c099750 con 0x5565eee46a00 2023-09-13T09:47:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 10 client.17634 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 10 client.17634 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:47:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 20 client.17634 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eeeb03a0 0x5565eeeb27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 4 client.17634 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5565eed52050 con 0x5565eeeb03a0 2023-09-13T09:47:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef7498c700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eeeb03a0 0x5565eeeb27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.024+0000 7fef58ff9700 10 client.17634 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:53.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef7498c700 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eeeb03a0 0x5565eeeb27c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ab6289b2f6f523bb server_cookie=9be19b7601c6bd8c in_seq=0 out_seq=0 2023-09-13T09:47:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef58ff9700 1 -- 172.21.15.6:0/2013303270 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5565eed52050 con 0x5565eeeb03a0 2023-09-13T09:47:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef58ff9700 10 client.17634 handle_command_reply: tid=0 2023-09-13T09:47:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 client.17634 shutdown 2023-09-13T09:47:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 msgr2=0x5565eee52fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee52fd0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0caac0 tx=0x7fef6c005ef0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 shutdown_connections 2023-09-13T09:47:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5565eeeb03a0 0x5565eeeb27c0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5565eee48060 0x5565eee56530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5565eee46a00 0x5565eee52fd0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 --2- 172.21.15.6:0/2013303270 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5565eee47700 0x5565eee53510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef58ff9700 0 client.17634 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:47:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 >> 172.21.15.6:0/2013303270 conn(0x5565eeda4c80 msgr2=0x5565eee57d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 shutdown_connections 2023-09-13T09:47:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 1 -- 172.21.15.6:0/2013303270 wait complete. 2023-09-13T09:47:53.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.025+0000 7fef835d6b80 20 client.17634 trim_cache size 0 max 16384 2023-09-13T09:47:53.047 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:53.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef5c0a0640 msgr2=0x7fef5c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef5c0a0640 0x7fef5c0a2b00 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fef60011490 tx=0x7fef60009260 comp rx=0 tx=0).stop 2023-09-13T09:47:53.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 msgr2=0x7fef70198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef70198d20 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0059d0 tx=0x7fef6c004730 comp rx=0 tx=0).stop 2023-09-13T09:47:53.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 shutdown_connections 2023-09-13T09:47:53.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef70100950 0x7fef701a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef5c0a0640 0x7fef5c0a2b00 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef700ff630 0x7fef70198d20 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 --2- 172.21.15.6:0/570306837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef700fff90 0x7fef70199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 >> 172.21.15.6:0/570306837 conn(0x7fef700fb210 msgr2=0x7fef700fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 shutdown_connections 2023-09-13T09:47:53.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.026+0000 7fef773f1700 1 -- 172.21.15.6:0/570306837 wait complete. 2023-09-13T09:47:53.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:47:53.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 403467 5.34 MB/sec execute 313 sec latency 26.453 ms 2023-09-13T09:47:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/3222736684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c102950 msgr2=0x7fca9c109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/3222736684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c102950 0x7fca9c109200 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fca9400b0d0 tx=0x7fca9400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/3222736684 shutdown_connections 2023-09-13T09:47:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/3222736684 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c102950 0x7fca9c109200 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/3222736684 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c100dc0 0x7fca9c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/3222736684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c101fb0 0x7fca9c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/3222736684 >> 172.21.15.6:0/3222736684 conn(0x7fca9c0fc350 msgr2=0x7fca9c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/3222736684 shutdown_connections 2023-09-13T09:47:53.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.189+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/3222736684 wait complete. 2023-09-13T09:47:53.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 Processor -- start 2023-09-13T09:47:53.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 -- start start 2023-09-13T09:47:53.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c100dc0 0x7fca9c196c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c101fb0 0x7fca9c1971d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c102950 0x7fca9c19e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c19e800 con 0x7fca9c101fb0 2023-09-13T09:47:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c19e970 con 0x7fca9c102950 2023-09-13T09:47:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa2ad5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c19eb30 con 0x7fca9c100dc0 2023-09-13T09:47:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa0871700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c100dc0 0x7fca9c196c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa1072700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c102950 0x7fca9c19e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa0871700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c100dc0 0x7fca9c196c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42134/0 (socket says 172.21.15.6:42134) 2023-09-13T09:47:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa1072700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c102950 0x7fca9c19e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60838/0 (socket says 172.21.15.6:60838) 2023-09-13T09:47:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa0871700 1 -- 172.21.15.6:0/2521866776 learned_addr learned my addr 172.21.15.6:0/2521866776 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fca9bfff700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c101fb0 0x7fca9c1971d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa1072700 1 -- 172.21.15.6:0/2521866776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c100dc0 msgr2=0x7fca9c196c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa1072700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c100dc0 0x7fca9c196c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa1072700 1 -- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c101fb0 msgr2=0x7fca9c1971d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa1072700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c101fb0 0x7fca9c1971d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.190+0000 7fcaa1072700 1 -- 172.21.15.6:0/2521866776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009d00 con 0x7fca9c102950 2023-09-13T09:47:53.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.191+0000 7fcaa1072700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c102950 0x7fca9c19e230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca94007a30 tx=0x7fca94008eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.191+0000 7fca99ffb700 1 -- 172.21.15.6:0/2521866776 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400e040 con 0x7fca9c102950 2023-09-13T09:47:53.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.191+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c19edb0 con 0x7fca9c102950 2023-09-13T09:47:53.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.191+0000 7fca99ffb700 1 -- 172.21.15.6:0/2521866776 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca9400bd30 con 0x7fca9c102950 2023-09-13T09:47:53.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.191+0000 7fca99ffb700 1 -- 172.21.15.6:0/2521866776 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940058d0 con 0x7fca9c102950 2023-09-13T09:47:53.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.191+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c19f220 con 0x7fca9c102950 2023-09-13T09:47:53.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.193+0000 7fca99ffb700 1 -- 172.21.15.6:0/2521866776 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fca94005020 con 0x7fca9c102950 2023-09-13T09:47:53.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.194+0000 7fca99ffb700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca8c0a0640 0x7fca8c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.194+0000 7fca99ffb700 1 -- 172.21.15.6:0/2521866776 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fca940ccbf0 con 0x7fca9c102950 2023-09-13T09:47:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.194+0000 7fcaa0871700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca8c0a0640 0x7fca8c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.194+0000 7fcaaecbab80 1 Processor -- start 2023-09-13T09:47:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.194+0000 7fcaaecbab80 1 -- start start 2023-09-13T09:47:53.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaa0871700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca8c0a0640 0x7fca8c0a2b00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca9c197b60 tx=0x7fca90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab01a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab00f9780 con 0x562ab01a0a00 2023-09-13T09:47:53.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab00f70a0 con 0x562ab01a2060 2023-09-13T09:47:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab00f2990 con 0x562ab01a1700 2023-09-13T09:47:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaa1072700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab01a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60846/0 (socket says 172.21.15.6:60846) 2023-09-13T09:47:53.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 -- 172.21.15.6:0/1253970114 learned_addr learned my addr 172.21.15.6:0/1253970114 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaa1072700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab01a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39092/0 (socket says 172.21.15.6:39092) 2023-09-13T09:47:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 -- 172.21.15.6:0/1253970114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 msgr2=0x562ab01a1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 -- 172.21.15.6:0/1253970114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 msgr2=0x562ab01a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab01a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 -- 172.21.15.6:0/1253970114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aaff72630 con 0x562ab01a2060 2023-09-13T09:47:53.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fcaa1072700 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab01a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.195+0000 7fca9bfff700 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a04c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca88009ac0 tx=0x7fca88009dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=375e1095a3ae4974 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fca86ffd700 1 -- 172.21.15.6:0/1253970114 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88009590 con 0x562ab01a2060 2023-09-13T09:47:53.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fca86ffd700 1 -- 172.21.15.6:0/1253970114 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca8800ed90 con 0x562ab01a2060 2023-09-13T09:47:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fca86ffd700 1 -- 172.21.15.6:0/1253970114 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880123d0 con 0x562ab01a2060 2023-09-13T09:47:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1253970114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 msgr2=0x562ab01a04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a04c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fca88009ac0 tx=0x7fca88009dd0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1253970114 shutdown_connections 2023-09-13T09:47:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab01a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01a1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1253970114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a04c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.196+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1253970114 >> 172.21.15.6:0/1253970114 conn(0x562ab00fec80 msgr2=0x562ab019af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1253970114 shutdown_connections 2023-09-13T09:47:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1253970114 wait complete. 2023-09-13T09:47:53.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 -- start start 2023-09-13T09:47:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 Processor -- start 2023-09-13T09:47:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a0a00 0x562ab01a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01aa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a2060 0x562ab01b1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab0090bb0 con 0x562ab01a2060 2023-09-13T09:47:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab00908b0 con 0x562ab01a0a00 2023-09-13T09:47:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aaff74920 con 0x562ab01a1700 2023-09-13T09:47:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaaecbab80 10 client.0 _ll_register_callbacks cb 0x562ab008e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaa0871700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a0a00 0x562ab01a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaa0871700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a0a00 0x562ab01a9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60850/0 (socket says 172.21.15.6:60850) 2023-09-13T09:47:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaa0871700 1 -- 172.21.15.6:0/1600082733 learned_addr learned my addr 172.21.15.6:0/1600082733 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.197+0000 7fcaa1072700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a2060 0x562ab01b1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fca9bfff700 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01aa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaa0871700 1 -- 172.21.15.6:0/1600082733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 msgr2=0x562ab01aa440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaa0871700 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01aa440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaa0871700 1 -- 172.21.15.6:0/1600082733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a2060 msgr2=0x562ab01b1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaa0871700 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a2060 0x562ab01b1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaa0871700 1 -- 172.21.15.6:0/1600082733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca880096f0 con 0x562ab01a0a00 2023-09-13T09:47:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fca9bfff700 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:47:53.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaa0871700 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a0a00 0x562ab01a9f00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca90003900 tx=0x7fca90004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd57f5173dff18d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fca7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:47:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fca7bfff700 1 -- 172.21.15.6:0/1600082733 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9000e840 con 0x562ab01a0a00 2023-09-13T09:47:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ab0193670 con 0x562ab01a0a00 2023-09-13T09:47:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fca7bfff700 1 -- 172.21.15.6:0/1600082733 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fca9000e9a0 con 0x562ab01a0a00 2023-09-13T09:47:53.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fca7bfff700 1 -- 172.21.15.6:0/1600082733 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca9000eb60 con 0x562ab01a0a00 2023-09-13T09:47:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaaecbab80 10 client.27053 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.198+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562ab010a7a0 con 0x562ab01a0a00 2023-09-13T09:47:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fca7bfff700 1 -- 172.21.15.6:0/1600082733 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562ab0193670 con 0x562ab01a0a00 2023-09-13T09:47:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fca7bfff700 1 -- 172.21.15.6:0/1600082733 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fca90024020 con 0x562ab01a0a00 2023-09-13T09:47:53.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fcaaecbab80 10 client.27053 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fcaaecbab80 10 client.27053 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:47:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fcaaecbab80 20 client.27053 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab01b5c90 0x562ab01b80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fcaaecbab80 4 client.27053 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:53.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ab00eb970 con 0x562ab01b5c90 2023-09-13T09:47:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fca9bfff700 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab01b5c90 0x562ab01b80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fca9bfff700 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab01b5c90 0x562ab01b80b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7a883aff2196a62 server_cookie=7cac069b911d8539 in_seq=0 out_seq=0 2023-09-13T09:47:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.199+0000 7fca7bfff700 10 client.27053 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fca7bfff700 1 -- 172.21.15.6:0/1600082733 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562ab00eb970 con 0x562ab01b5c90 2023-09-13T09:47:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fca7bfff700 10 client.27053 handle_command_reply: tid=0 2023-09-13T09:47:53.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 client.27053 shutdown 2023-09-13T09:47:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a0a00 msgr2=0x562ab01a9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a0a00 0x562ab01a9f00 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fca90003900 tx=0x7fca90004750 comp rx=0 tx=0).stop 2023-09-13T09:47:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 shutdown_connections 2023-09-13T09:47:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab01b5c90 0x562ab01b80b0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a2060 0x562ab01b1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fca7bfff700 0 client.27053 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a0a00 0x562ab01a9f00 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/1600082733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab01aa440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.200+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 >> 172.21.15.6:0/1600082733 conn(0x562ab00fec80 msgr2=0x562ab01957f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.201+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 shutdown_connections 2023-09-13T09:47:53.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.201+0000 7fcaaecbab80 1 -- 172.21.15.6:0/1600082733 wait complete. 2023-09-13T09:47:53.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.201+0000 7fcaaecbab80 20 client.27053 trim_cache size 0 max 16384 2023-09-13T09:47:53.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.214+0000 7fcaaecbab80 1 Processor -- start 2023-09-13T09:47:53.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.214+0000 7fcaaecbab80 1 -- start start 2023-09-13T09:47:53.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a0a00 0x562ab01a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a1700 0x562ab01b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab019ca10 con 0x562ab01a1700 2023-09-13T09:47:53.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab01978e0 con 0x562ab01a2060 2023-09-13T09:47:53.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab019c310 con 0x562ab01a0a00 2023-09-13T09:47:53.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a1700 0x562ab01b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a1700 0x562ab01b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39104/0 (socket says 172.21.15.6:39104) 2023-09-13T09:47:53.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 -- 172.21.15.6:0/395792277 learned_addr learned my addr 172.21.15.6:0/395792277 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaa0871700 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a0a00 0x562ab01a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaa1072700 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 -- 172.21.15.6:0/395792277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a0a00 msgr2=0x562ab01a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a0a00 0x562ab01a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 -- 172.21.15.6:0/395792277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 msgr2=0x562ab01a4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 -- 172.21.15.6:0/395792277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aaff1ede0 con 0x562ab01a1700 2023-09-13T09:47:53.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fcaa1072700 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:47:53.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca9bfff700 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a1700 0x562ab01b1410 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fca880099e0 tx=0x7fca88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2e94a28f8651f26 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca877fe700 1 -- 172.21.15.6:0/395792277 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88025390 con 0x562ab01a1700 2023-09-13T09:47:53.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca877fe700 1 -- 172.21.15.6:0/395792277 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca880254f0 con 0x562ab01a1700 2023-09-13T09:47:53.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.215+0000 7fca877fe700 1 -- 172.21.15.6:0/395792277 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8801c450 con 0x562ab01a1700 2023-09-13T09:47:53.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 -- 172.21.15.6:0/395792277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a1700 msgr2=0x562ab01b1410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a1700 0x562ab01b1410 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fca880099e0 tx=0x7fca88008040 comp rx=0 tx=0).stop 2023-09-13T09:47:53.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 -- 172.21.15.6:0/395792277 shutdown_connections 2023-09-13T09:47:53.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab01a4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a0a00 0x562ab01a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/395792277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a1700 0x562ab01b1410 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 -- 172.21.15.6:0/395792277 >> 172.21.15.6:0/395792277 conn(0x562ab00fec80 msgr2=0x562ab01a8bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 -- 172.21.15.6:0/395792277 shutdown_connections 2023-09-13T09:47:53.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.216+0000 7fcaaecbab80 1 -- 172.21.15.6:0/395792277 wait complete. 2023-09-13T09:47:53.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 -- start start 2023-09-13T09:47:53.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 Processor -- start 2023-09-13T09:47:53.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab0205ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab0206220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab020d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab020d720 con 0x562ab01a0a00 2023-09-13T09:47:53.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab020d890 con 0x562ab01a2060 2023-09-13T09:47:53.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ab020da50 con 0x562ab01a1700 2023-09-13T09:47:53.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaa0871700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab0205ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaaecbab80 10 client.0 _ll_register_callbacks cb 0x562ab008e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaa0871700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab0205ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39108/0 (socket says 172.21.15.6:39108) 2023-09-13T09:47:53.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaa0871700 1 -- 172.21.15.6:0/920921772 learned_addr learned my addr 172.21.15.6:0/920921772 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fcaa1072700 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab020d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.217+0000 7fca9bfff700 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab0206220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaa0871700 1 -- 172.21.15.6:0/920921772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 msgr2=0x562ab0206220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaa0871700 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab0206220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaa0871700 1 -- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 msgr2=0x562ab020d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaa0871700 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab020d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaa0871700 1 -- 172.21.15.6:0/920921772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562aaff72630 con 0x562ab01a0a00 2023-09-13T09:47:53.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaa0871700 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab0205ce0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fca90003900 tx=0x7fca90030720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df8047113f8c44c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fca7bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:53.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fca7bfff700 1 -- 172.21.15.6:0/920921772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca90030d30 con 0x562ab01a0a00 2023-09-13T09:47:53.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fca7bfff700 1 -- 172.21.15.6:0/920921772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fca9002c030 con 0x562ab01a0a00 2023-09-13T09:47:53.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca8800ed90 con 0x562ab01a0a00 2023-09-13T09:47:53.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fca7bfff700 1 -- 172.21.15.6:0/920921772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca90030e90 con 0x562ab01a0a00 2023-09-13T09:47:53.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 10 client.17652 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562aaff07c60 con 0x562ab01a0a00 2023-09-13T09:47:53.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fca7bfff700 1 -- 172.21.15.6:0/920921772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca8800ed90 con 0x562ab01a0a00 2023-09-13T09:47:53.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fca7bfff700 1 -- 172.21.15.6:0/920921772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fca90003930 con 0x562ab01a0a00 2023-09-13T09:47:53.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 10 client.17652 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 10 client.17652 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:47:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 20 client.17652 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab020f3e0 0x562ab0211800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 4 client.17652 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:53.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.218+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562ab00ac050 con 0x562ab020f3e0 2023-09-13T09:47:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fca9bfff700 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab020f3e0 0x562ab0211800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fca9bfff700 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab020f3e0 0x562ab0211800 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bdec6d8de26a250d server_cookie=4bc5859b7a7885c5 in_seq=0 out_seq=0 2023-09-13T09:47:53.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fca7bfff700 10 client.17652 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fca7bfff700 1 -- 172.21.15.6:0/920921772 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562ab00ac050 con 0x562ab020f3e0 2023-09-13T09:47:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fca7bfff700 10 client.17652 handle_command_reply: tid=0 2023-09-13T09:47:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 client.17652 shutdown 2023-09-13T09:47:53.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 msgr2=0x562ab0205ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab0205ce0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fca90003900 tx=0x7fca90030720 comp rx=0 tx=0).stop 2023-09-13T09:47:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 shutdown_connections 2023-09-13T09:47:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562ab020f3e0 0x562ab0211800 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ab01a2060 0x562ab020d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ab01a0a00 0x562ab0205ce0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 --2- 172.21.15.6:0/920921772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ab01a1700 0x562ab0206220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fca7bfff700 0 client.17652 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:47:53.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.219+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 >> 172.21.15.6:0/920921772 conn(0x562ab00fec80 msgr2=0x562ab01a4980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 shutdown_connections 2023-09-13T09:47:53.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaaecbab80 1 -- 172.21.15.6:0/920921772 wait complete. 2023-09-13T09:47:53.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaaecbab80 20 client.17652 trim_cache size 0 max 16384 2023-09-13T09:47:53.248 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca8c0a0640 msgr2=0x7fca8c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca8c0a0640 0x7fca8c0a2b00 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fca9c197b60 tx=0x7fca90009260 comp rx=0 tx=0).stop 2023-09-13T09:47:53.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c102950 msgr2=0x7fca9c19e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c102950 0x7fca9c19e230 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fca94007a30 tx=0x7fca94008eb0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 shutdown_connections 2023-09-13T09:47:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9c102950 0x7fca9c19e230 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c100dc0 0x7fca9c196c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca8c0a0640 0x7fca8c0a2b00 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 --2- 172.21.15.6:0/2521866776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c101fb0 0x7fca9c1971d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 >> 172.21.15.6:0/2521866776 conn(0x7fca9c0fc350 msgr2=0x7fca9c105470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 shutdown_connections 2023-09-13T09:47:53.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.220+0000 7fcaa2ad5700 1 -- 172.21.15.6:0/2521866776 wait complete. 2023-09-13T09:47:53.252 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:52 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1642513330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:47:53.253 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:47:53.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:52 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1642513330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:47:53.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:52 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1642513330' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:47:53.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 -- 172.21.15.6:0/2960463133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50440ffcc0 msgr2=0x7f50441000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 --2- 172.21.15.6:0/2960463133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50440ffcc0 0x7f50441000e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f50340099c0 tx=0x7f5034009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 -- 172.21.15.6:0/2960463133 shutdown_connections 2023-09-13T09:47:53.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 --2- 172.21.15.6:0/2960463133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5044101850 0x7f5044108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 --2- 172.21.15.6:0/2960463133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50440ffcc0 0x7f50441000e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 --2- 172.21.15.6:0/2960463133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044100eb0 0x7f5044101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 -- 172.21.15.6:0/2960463133 >> 172.21.15.6:0/2960463133 conn(0x7f50440fb250 msgr2=0x7f50440fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 -- 172.21.15.6:0/2960463133 shutdown_connections 2023-09-13T09:47:53.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 -- 172.21.15.6:0/2960463133 wait complete. 2023-09-13T09:47:53.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 Processor -- start 2023-09-13T09:47:53.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.385+0000 7f504a98c700 1 -- start start 2023-09-13T09:47:53.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f504a98c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50440ffcc0 0x7f5044196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f504a98c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044100eb0 0x7f5044196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f504a98c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5044101850 0x7f504419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f504a98c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504419e5d0 con 0x7f50440ffcc0 2023-09-13T09:47:53.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f504a98c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504419e710 con 0x7f5044101850 2023-09-13T09:47:53.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f504a98c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f504419e8a0 con 0x7f5044100eb0 2023-09-13T09:47:53.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50440ffcc0 0x7f5044196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50440ffcc0 0x7f5044196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39122/0 (socket says 172.21.15.6:39122) 2023-09-13T09:47:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 -- 172.21.15.6:0/2031029618 learned_addr learned my addr 172.21.15.6:0/2031029618 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f50437fe700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044100eb0 0x7f5044196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5048f29700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5044101850 0x7f504419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 -- 172.21.15.6:0/2031029618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044100eb0 msgr2=0x7f5044196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044100eb0 0x7f5044196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 -- 172.21.15.6:0/2031029618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5044101850 msgr2=0x7f504419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5044101850 0x7f504419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 -- 172.21.15.6:0/2031029618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340095f0 con 0x7f50440ffcc0 2023-09-13T09:47:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f5043fff700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50440ffcc0 0x7f5044196a50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5034009fd0 tx=0x7f5034009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f50417fa700 1 -- 172.21.15.6:0/2031029618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503401d070 con 0x7f50440ffcc0 2023-09-13T09:47:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f504419eb20 con 0x7f50440ffcc0 2023-09-13T09:47:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f50417fa700 1 -- 172.21.15.6:0/2031029618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5034005030 con 0x7f50440ffcc0 2023-09-13T09:47:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.386+0000 7f50417fa700 1 -- 172.21.15.6:0/2031029618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034004a90 con 0x7f50440ffcc0 2023-09-13T09:47:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.387+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504419efa0 con 0x7f50440ffcc0 2023-09-13T09:47:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.389+0000 7f50417fa700 1 -- 172.21.15.6:0/2031029618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f50340051a0 con 0x7f50440ffcc0 2023-09-13T09:47:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.390+0000 7f50417fa700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f502c0a0640 0x7f502c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.390+0000 7f50417fa700 1 -- 172.21.15.6:0/2031029618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50340cc970 con 0x7f50440ffcc0 2023-09-13T09:47:53.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.390+0000 7f50437fe700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f502c0a0640 0x7f502c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.390+0000 7f50437fe700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f502c0a0640 0x7f502c0a2b00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5038009c60 tx=0x7f5038009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.390+0000 7f5056b71b80 1 Processor -- start 2023-09-13T09:47:53.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.390+0000 7f5056b71b80 1 -- start start 2023-09-13T09:47:53.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2385b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df23844c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df2384e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5056b71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df22dd780 con 0x560df2384a00 2023-09-13T09:47:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5056b71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df22db0a0 con 0x560df2386060 2023-09-13T09:47:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5056b71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df22d6990 con 0x560df2385700 2023-09-13T09:47:53.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5048f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df2384e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5043fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2385b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5048f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df2384e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39132/0 (socket says 172.21.15.6:39132) 2023-09-13T09:47:53.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5048f29700 1 -- 172.21.15.6:0/3151537933 learned_addr learned my addr 172.21.15.6:0/3151537933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f50437fe700 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df23844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5043fff700 1 -- 172.21.15.6:0/3151537933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 msgr2=0x560df23844c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5043fff700 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df23844c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5043fff700 1 -- 172.21.15.6:0/3151537933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 msgr2=0x560df2384e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5043fff700 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df2384e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5043fff700 1 -- 172.21.15.6:0/3151537933 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560df2156630 con 0x560df2385700 2023-09-13T09:47:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f50437fe700 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df23844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5048f29700 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df2384e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.391+0000 7f5043fff700 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2385b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f503400b580 tx=0x7f503409a910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1b4656a0e24d96 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f502a7fc700 1 -- 172.21.15.6:0/3151537933 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340a0070 con 0x560df2385700 2023-09-13T09:47:53.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f502a7fc700 1 -- 172.21.15.6:0/3151537933 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50340a2120 con 0x560df2385700 2023-09-13T09:47:53.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f502a7fc700 1 -- 172.21.15.6:0/3151537933 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5034099870 con 0x560df2385700 2023-09-13T09:47:53.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 -- 172.21.15.6:0/3151537933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 msgr2=0x560df2385b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2385b20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f503400b580 tx=0x7f503409a910 comp rx=0 tx=0).stop 2023-09-13T09:47:53.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 -- 172.21.15.6:0/3151537933 shutdown_connections 2023-09-13T09:47:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df2384e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2385b20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 --2- 172.21.15.6:0/3151537933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df23844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 -- 172.21.15.6:0/3151537933 >> 172.21.15.6:0/3151537933 conn(0x560df22e2c80 msgr2=0x560df237ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 -- 172.21.15.6:0/3151537933 shutdown_connections 2023-09-13T09:47:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.392+0000 7f5056b71b80 1 -- 172.21.15.6:0/3151537933 wait complete. 2023-09-13T09:47:53.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 -- start start 2023-09-13T09:47:53.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 Processor -- start 2023-09-13T09:47:53.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df238dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df238e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df2395130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df2274bb0 con 0x560df2384a00 2023-09-13T09:47:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df22748b0 con 0x560df2386060 2023-09-13T09:47:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df2158920 con 0x560df2385700 2023-09-13T09:47:53.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5056b71b80 10 client.0 _ll_register_callbacks cb 0x560df2272680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5043fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df238dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5043fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df238dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39134/0 (socket says 172.21.15.6:39134) 2023-09-13T09:47:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5043fff700 1 -- 172.21.15.6:0/4262962893 learned_addr learned my addr 172.21.15.6:0/4262962893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f5048f29700 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df2395130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.393+0000 7f50437fe700 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df238e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5043fff700 1 -- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 msgr2=0x560df238e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5043fff700 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df238e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5043fff700 1 -- 172.21.15.6:0/4262962893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 msgr2=0x560df2395130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5043fff700 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df2395130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5043fff700 1 -- 172.21.15.6:0/4262962893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f504419efa0 con 0x560df2384a00 2023-09-13T09:47:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5043fff700 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df238dbb0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f50340965f0 tx=0x7f5034096480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982e1da21680de78 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f50237fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f50237fe700 1 -- 172.21.15.6:0/4262962893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340a1e90 con 0x560df2384a00 2023-09-13T09:47:53.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f50237fe700 1 -- 172.21.15.6:0/4262962893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f503409a3a0 con 0x560df2384a00 2023-09-13T09:47:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560df2377670 con 0x560df2384a00 2023-09-13T09:47:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f50237fe700 1 -- 172.21.15.6:0/4262962893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5034004bf0 con 0x560df2384a00 2023-09-13T09:47:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5056b71b80 10 client.17664 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560df22ee7a0 con 0x560df2384a00 2023-09-13T09:47:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.394+0000 7f50237fe700 1 -- 172.21.15.6:0/4262962893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560df2377670 con 0x560df2384a00 2023-09-13T09:47:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f50237fe700 1 -- 172.21.15.6:0/4262962893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5034095f30 con 0x560df2384a00 2023-09-13T09:47:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f5056b71b80 10 client.17664 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f5056b71b80 10 client.17664 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:47:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f5056b71b80 20 client.17664 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23994d0 0x560df239b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f5056b71b80 4 client.17664 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560df22cf970 con 0x560df23994d0 2023-09-13T09:47:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f50437fe700 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23994d0 0x560df239b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f50237fe700 10 client.17664 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.395+0000 7f50437fe700 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23994d0 0x560df239b8f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=997f0b0ee1644854 server_cookie=728efd83c91191e9 in_seq=0 out_seq=0 2023-09-13T09:47:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f50237fe700 1 -- 172.21.15.6:0/4262962893 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560df22cf970 con 0x560df23994d0 2023-09-13T09:47:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f50237fe700 10 client.17664 handle_command_reply: tid=0 2023-09-13T09:47:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 client.17664 shutdown 2023-09-13T09:47:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 msgr2=0x560df238dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df238dbb0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f50340965f0 tx=0x7f5034096480 comp rx=0 tx=0).stop 2023-09-13T09:47:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 shutdown_connections 2023-09-13T09:47:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23994d0 0x560df239b8f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2386060 0x560df2395130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f50237fe700 0 client.17664 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2384a00 0x560df238dbb0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4262962893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df238e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 >> 172.21.15.6:0/4262962893 conn(0x560df22e2c80 msgr2=0x560df23797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 shutdown_connections 2023-09-13T09:47:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 1 -- 172.21.15.6:0/4262962893 wait complete. 2023-09-13T09:47:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.396+0000 7f5056b71b80 20 client.17664 trim_cache size 0 max 16384 2023-09-13T09:47:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.409+0000 7f5056b71b80 1 Processor -- start 2023-09-13T09:47:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.409+0000 7f5056b71b80 1 -- start start 2023-09-13T09:47:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2384a00 0x560df23844c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2385700 0x560df23950f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2395a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5056b71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df238d720 con 0x560df2386060 2023-09-13T09:47:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5056b71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df2380730 con 0x560df2385700 2023-09-13T09:47:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5056b71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df2380970 con 0x560df2384a00 2023-09-13T09:47:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5048f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2395a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5043fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2384a00 0x560df23844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5048f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2395a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39146/0 (socket says 172.21.15.6:39146) 2023-09-13T09:47:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5043fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2384a00 0x560df23844c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42196/0 (socket says 172.21.15.6:42196) 2023-09-13T09:47:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f50437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2385700 0x560df23950f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5048f29700 1 -- 172.21.15.6:0/2059603074 learned_addr learned my addr 172.21.15.6:0/2059603074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f50437fe700 1 -- 172.21.15.6:0/2059603074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2384a00 msgr2=0x560df23844c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f50437fe700 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2384a00 0x560df23844c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f50437fe700 1 -- 172.21.15.6:0/2059603074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 msgr2=0x560df2395a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f50437fe700 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2395a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f50437fe700 1 -- 172.21.15.6:0/2059603074 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560df2102de0 con 0x560df2385700 2023-09-13T09:47:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f5048f29700 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2395a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.410+0000 7f50437fe700 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2385700 0x560df23950f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x560df23998b0 tx=0x7f5038014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84b96a2cbeefca0c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f502affd700 1 -- 172.21.15.6:0/2059603074 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5038022030 con 0x560df2385700 2023-09-13T09:47:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f502affd700 1 -- 172.21.15.6:0/2059603074 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5038023040 con 0x560df2385700 2023-09-13T09:47:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f502affd700 1 -- 172.21.15.6:0/2059603074 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f503801dd30 con 0x560df2385700 2023-09-13T09:47:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 -- 172.21.15.6:0/2059603074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2385700 msgr2=0x560df23950f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2385700 0x560df23950f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x560df23998b0 tx=0x7f5038014000 comp rx=0 tx=0).stop 2023-09-13T09:47:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 -- 172.21.15.6:0/2059603074 shutdown_connections 2023-09-13T09:47:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2395a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2384a00 0x560df23844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 --2- 172.21.15.6:0/2059603074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2385700 0x560df23950f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 -- 172.21.15.6:0/2059603074 >> 172.21.15.6:0/2059603074 conn(0x560df22e2c80 msgr2=0x560df238c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 -- 172.21.15.6:0/2059603074 shutdown_connections 2023-09-13T09:47:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.411+0000 7f5056b71b80 1 -- 172.21.15.6:0/2059603074 wait complete. 2023-09-13T09:47:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 -- start start 2023-09-13T09:47:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 Processor -- start 2023-09-13T09:47:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2384a00 0x560df2394d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2391830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2391d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df23922b0 con 0x560df2386060 2023-09-13T09:47:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df2392420 con 0x560df2384a00 2023-09-13T09:47:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560df23ed2f0 con 0x560df2385700 2023-09-13T09:47:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5056b71b80 10 client.0 _ll_register_callbacks cb 0x560df2272680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5048f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2391d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5043fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2384a00 0x560df2394d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5048f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2391d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39152/0 (socket says 172.21.15.6:39152) 2023-09-13T09:47:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f50437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2391830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.412+0000 7f5048f29700 1 -- 172.21.15.6:0/4099724463 learned_addr learned my addr 172.21.15.6:0/4099724463 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5043fff700 1 -- 172.21.15.6:0/4099724463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 msgr2=0x560df2391830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5043fff700 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2391830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5043fff700 1 -- 172.21.15.6:0/4099724463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 msgr2=0x560df2391d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5043fff700 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2391d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5043fff700 1 -- 172.21.15.6:0/4099724463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f503c017530 con 0x560df2384a00 2023-09-13T09:47:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5048f29700 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2391d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5043fff700 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2384a00 0x560df2394d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5034096bb0 tx=0x7f5034099580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=affbc0743243bf3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f50237fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:47:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f50237fe700 1 -- 172.21.15.6:0/4099724463 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50340a00c0 con 0x560df2384a00 2023-09-13T09:47:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f50237fe700 1 -- 172.21.15.6:0/4099724463 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f503409a840 con 0x560df2384a00 2023-09-13T09:47:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50340a2120 con 0x560df2384a00 2023-09-13T09:47:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f50237fe700 1 -- 172.21.15.6:0/4099724463 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f503407d070 con 0x560df2384a00 2023-09-13T09:47:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 10 client.27074 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f503802ba60 con 0x560df2384a00 2023-09-13T09:47:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f50237fe700 1 -- 172.21.15.6:0/4099724463 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50340a2120 con 0x560df2384a00 2023-09-13T09:47:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f50237fe700 1 -- 172.21.15.6:0/4099724463 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5034004cf0 con 0x560df2384a00 2023-09-13T09:47:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 10 client.27074 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 10 client.27074 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:47:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 20 client.27074 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23ee800 0x560df23f0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.413+0000 7f5056b71b80 4 client.27074 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.414+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560df2290050 con 0x560df23ee800 2023-09-13T09:47:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.414+0000 7f50437fe700 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23ee800 0x560df23f0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.414+0000 7f50237fe700 10 client.27074 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.414+0000 7f50437fe700 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23ee800 0x560df23f0c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f7780455f2f5894 server_cookie=af4066439cf4daf7 in_seq=0 out_seq=0 2023-09-13T09:47:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.414+0000 7f50237fe700 1 -- 172.21.15.6:0/4099724463 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560df2290050 con 0x560df23ee800 2023-09-13T09:47:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.414+0000 7f50237fe700 10 client.27074 handle_command_reply: tid=0 2023-09-13T09:47:53.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.414+0000 7f5056b71b80 1 client.27074 shutdown 2023-09-13T09:47:53.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2384a00 msgr2=0x560df2394d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2384a00 0x560df2394d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5034096bb0 tx=0x7f5034099580 comp rx=0 tx=0).stop 2023-09-13T09:47:53.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 shutdown_connections 2023-09-13T09:47:53.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560df23ee800 0x560df23f0c20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560df2386060 0x560df2391d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f50237fe700 0 client.27074 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:47:53.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560df2384a00 0x560df2394d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 --2- 172.21.15.6:0/4099724463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560df2385700 0x560df2391830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 >> 172.21.15.6:0/4099724463 conn(0x560df22e2c80 msgr2=0x560df23888e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 shutdown_connections 2023-09-13T09:47:53.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 1 -- 172.21.15.6:0/4099724463 wait complete. 2023-09-13T09:47:53.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f5056b71b80 20 client.27074 trim_cache size 0 max 16384 2023-09-13T09:47:53.446 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:53.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f502c0a0640 msgr2=0x7f502c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f502c0a0640 0x7f502c0a2b00 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f5038009c60 tx=0x7f5038009260 comp rx=0 tx=0).stop 2023-09-13T09:47:53.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50440ffcc0 msgr2=0x7f5044196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50440ffcc0 0x7f5044196a50 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f5034009fd0 tx=0x7f5034009580 comp rx=0 tx=0).stop 2023-09-13T09:47:53.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 shutdown_connections 2023-09-13T09:47:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5044101850 0x7f504419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f502c0a0640 0x7f502c0a2b00 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50440ffcc0 0x7f5044196a50 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 --2- 172.21.15.6:0/2031029618 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5044100eb0 0x7f5044196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.415+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 >> 172.21.15.6:0/2031029618 conn(0x7f50440fb250 msgr2=0x7f5044067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.416+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 shutdown_connections 2023-09-13T09:47:53.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.416+0000 7f504a98c700 1 -- 172.21.15.6:0/2031029618 wait complete. 2023-09-13T09:47:53.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:47:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 -- 172.21.15.6:0/1332408235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910101850 msgr2=0x7f6910108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 --2- 172.21.15.6:0/1332408235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910101850 0x7f6910108100 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f690800b0d0 tx=0x7f690800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 -- 172.21.15.6:0/1332408235 shutdown_connections 2023-09-13T09:47:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 --2- 172.21.15.6:0/1332408235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910101850 0x7f6910108100 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 --2- 172.21.15.6:0/1332408235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69100ffcc0 0x7f69101000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 --2- 172.21.15.6:0/1332408235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6910100eb0 0x7f6910101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 -- 172.21.15.6:0/1332408235 >> 172.21.15.6:0/1332408235 conn(0x7f69100fb250 msgr2=0x7f69100fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 -- 172.21.15.6:0/1332408235 shutdown_connections 2023-09-13T09:47:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.584+0000 7f6916ba8700 1 -- 172.21.15.6:0/1332408235 wait complete. 2023-09-13T09:47:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 Processor -- start 2023-09-13T09:47:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 -- start start 2023-09-13T09:47:53.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69100ffcc0 0x7f6910196b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910100eb0 0x7f69101970d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6910101850 0x7f691019e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691019e710 con 0x7f6910100eb0 2023-09-13T09:47:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691019e850 con 0x7f69100ffcc0 2023-09-13T09:47:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6916ba8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f691019e9e0 con 0x7f6910101850 2023-09-13T09:47:53.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910100eb0 0x7f69101970d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910100eb0 0x7f69101970d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39164/0 (socket says 172.21.15.6:39164) 2023-09-13T09:47:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 -- 172.21.15.6:0/935604052 learned_addr learned my addr 172.21.15.6:0/935604052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6914944700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69100ffcc0 0x7f6910196b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f6915145700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6910101850 0x7f691019e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 -- 172.21.15.6:0/935604052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6910101850 msgr2=0x7f691019e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6910101850 0x7f691019e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 -- 172.21.15.6:0/935604052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69100ffcc0 msgr2=0x7f6910196b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69100ffcc0 0x7f6910196b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 -- 172.21.15.6:0/935604052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908009d00 con 0x7f6910100eb0 2023-09-13T09:47:53.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.585+0000 7f690ffff700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910100eb0 0x7f69101970d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e9a0 tx=0x7f68fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.586+0000 7f690dffb700 1 -- 172.21.15.6:0/935604052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc009790 con 0x7f6910100eb0 2023-09-13T09:47:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.586+0000 7f690dffb700 1 -- 172.21.15.6:0/935604052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68fc010430 con 0x7f6910100eb0 2023-09-13T09:47:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.586+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f691019ecc0 con 0x7f6910100eb0 2023-09-13T09:47:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.586+0000 7f690dffb700 1 -- 172.21.15.6:0/935604052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc018680 con 0x7f6910100eb0 2023-09-13T09:47:53.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.586+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691019f1d0 con 0x7f6910100eb0 2023-09-13T09:47:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.588+0000 7f690dffb700 1 -- 172.21.15.6:0/935604052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f68fc0105a0 con 0x7f6910100eb0 2023-09-13T09:47:53.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.588+0000 7f690dffb700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69000a0640 0x7f69000a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.589+0000 7f6914944700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69000a0640 0x7f69000a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.589+0000 7f690dffb700 1 -- 172.21.15.6:0/935604052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f68fc014070 con 0x7f6910100eb0 2023-09-13T09:47:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.589+0000 7f6914944700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69000a0640 0x7f69000a2b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6910100d10 tx=0x7f6904009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.589+0000 7f6922d8db80 1 Processor -- start 2023-09-13T09:47:53.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.589+0000 7f6922d8db80 1 -- start start 2023-09-13T09:47:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab44b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab43e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6922d8db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005aa9c780 con 0x56005ab45060 2023-09-13T09:47:53.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6922d8db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005aa9a0a0 con 0x56005ab44700 2023-09-13T09:47:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6922d8db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005aa95990 con 0x56005ab43a00 2023-09-13T09:47:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6914944700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab44b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6915145700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab43e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39172/0 (socket says 172.21.15.6:39172) 2023-09-13T09:47:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6914944700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab44b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60926/0 (socket says 172.21.15.6:60926) 2023-09-13T09:47:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 -- 172.21.15.6:0/1117948121 learned_addr learned my addr 172.21.15.6:0/1117948121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 -- 172.21.15.6:0/1117948121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 msgr2=0x56005ab43e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab43e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 -- 172.21.15.6:0/1117948121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 msgr2=0x56005ab44b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab44b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 -- 172.21.15.6:0/1117948121 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005a915630 con 0x56005ab45060 2023-09-13T09:47:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6914944700 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab44b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f6915145700 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab43e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f690ffff700 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab434c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f68fc095a10 tx=0x7f68fc099410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390c143c2bd98cce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f68faffd700 1 -- 172.21.15.6:0/1117948121 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc09d170 con 0x56005ab45060 2023-09-13T09:47:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f68faffd700 1 -- 172.21.15.6:0/1117948121 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68fc099510 con 0x56005ab45060 2023-09-13T09:47:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.590+0000 7f68faffd700 1 -- 172.21.15.6:0/1117948121 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc098a00 con 0x56005ab45060 2023-09-13T09:47:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 -- 172.21.15.6:0/1117948121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 msgr2=0x56005ab434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab434c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f68fc095a10 tx=0x7f68fc099410 comp rx=0 tx=0).stop 2023-09-13T09:47:53.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 -- 172.21.15.6:0/1117948121 shutdown_connections 2023-09-13T09:47:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab43e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab44b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 --2- 172.21.15.6:0/1117948121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab434c0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 -- 172.21.15.6:0/1117948121 >> 172.21.15.6:0/1117948121 conn(0x56005aaa1c80 msgr2=0x56005ab3df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 -- 172.21.15.6:0/1117948121 shutdown_connections 2023-09-13T09:47:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.591+0000 7f6922d8db80 1 -- 172.21.15.6:0/1117948121 wait complete. 2023-09-13T09:47:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 -- start start 2023-09-13T09:47:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 Processor -- start 2023-09-13T09:47:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab4cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab4d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005aa33bb0 con 0x56005ab45060 2023-09-13T09:47:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005aa338b0 con 0x56005ab44700 2023-09-13T09:47:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005a917920 con 0x56005ab43a00 2023-09-13T09:47:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6922d8db80 10 client.0 _ll_register_callbacks cb 0x56005aa31680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6915145700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6914944700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab4cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f690ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab4d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6915145700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39180/0 (socket says 172.21.15.6:39180) 2023-09-13T09:47:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6914944700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab4cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42230/0 (socket says 172.21.15.6:42230) 2023-09-13T09:47:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.592+0000 7f6915145700 1 -- 172.21.15.6:0/2883357154 learned_addr learned my addr 172.21.15.6:0/2883357154 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6915145700 1 -- 172.21.15.6:0/2883357154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 msgr2=0x56005ab4cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6915145700 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab4cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6915145700 1 -- 172.21.15.6:0/2883357154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 msgr2=0x56005ab4d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6915145700 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab4d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6915145700 1 -- 172.21.15.6:0/2883357154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f691019f1d0 con 0x56005ab45060 2023-09-13T09:47:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6914944700 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab4cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6915145700 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab544e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6908008f80 tx=0x7f6908008fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d22b97fb100c08 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f68effff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f68effff700 1 -- 172.21.15.6:0/2883357154 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800e040 con 0x56005ab45060 2023-09-13T09:47:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f68effff700 1 -- 172.21.15.6:0/2883357154 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f69080077f0 con 0x56005ab45060 2023-09-13T09:47:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56005ab36670 con 0x56005ab45060 2023-09-13T09:47:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f68effff700 1 -- 172.21.15.6:0/2883357154 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f690800bca0 con 0x56005ab45060 2023-09-13T09:47:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6922d8db80 10 client.17682 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.593+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56005aaad7a0 con 0x56005ab45060 2023-09-13T09:47:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f68effff700 1 -- 172.21.15.6:0/2883357154 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56005ab36670 con 0x56005ab45060 2023-09-13T09:47:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f68effff700 1 -- 172.21.15.6:0/2883357154 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f690800b100 con 0x56005ab45060 2023-09-13T09:47:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f6922d8db80 10 client.17682 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f6922d8db80 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f6922d8db80 20 client.17682 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005ab58db0 0x56005ab5b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f6922d8db80 4 client.17682 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56005aa8e970 con 0x56005ab58db0 2023-09-13T09:47:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.594+0000 7f6914944700 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005ab58db0 0x56005ab5b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.595+0000 7f6914944700 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005ab58db0 0x56005ab5b1d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbebe41807ec0b7b server_cookie=998f6629c4bd6f33 in_seq=0 out_seq=0 2023-09-13T09:47:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.595+0000 7f68effff700 10 client.17682 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.595+0000 7f68effff700 1 -- 172.21.15.6:0/2883357154 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56005aa8e970 con 0x56005ab58db0 2023-09-13T09:47:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.595+0000 7f68effff700 10 client.17682 handle_command_reply: tid=0 2023-09-13T09:47:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.595+0000 7f6922d8db80 1 client.17682 shutdown 2023-09-13T09:47:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.595+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 msgr2=0x56005ab544e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.595+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab544e0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f6908008f80 tx=0x7f6908008fb0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 shutdown_connections 2023-09-13T09:47:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005ab58db0 0x56005ab5b1d0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab45060 0x56005ab544e0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab43a00 0x56005ab4cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f68effff700 0 client.17682 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:53.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2883357154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005ab4d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 >> 172.21.15.6:0/2883357154 conn(0x56005aaa1c80 msgr2=0x56005ab387f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 shutdown_connections 2023-09-13T09:47:53.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 1 -- 172.21.15.6:0/2883357154 wait complete. 2023-09-13T09:47:53.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.596+0000 7f6922d8db80 20 client.17682 trim_cache size 0 max 16384 2023-09-13T09:47:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 Processor -- start 2023-09-13T09:47:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 -- start start 2023-09-13T09:47:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab44700 0x56005ab54400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab45060 0x56005ab4ae30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005ab54940 con 0x56005ab43a00 2023-09-13T09:47:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005ab3a8e0 con 0x56005ab45060 2023-09-13T09:47:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6922d8db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005ab4abe0 con 0x56005ab44700 2023-09-13T09:47:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6914944700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6915145700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab45060 0x56005ab4ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6914944700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39184/0 (socket says 172.21.15.6:39184) 2023-09-13T09:47:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6914944700 1 -- 172.21.15.6:0/2329392857 learned_addr learned my addr 172.21.15.6:0/2329392857 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f690ffff700 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab44700 0x56005ab54400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6915145700 1 -- 172.21.15.6:0/2329392857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab44700 msgr2=0x56005ab54400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6915145700 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab44700 0x56005ab54400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6915145700 1 -- 172.21.15.6:0/2329392857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 msgr2=0x56005ab434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6915145700 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.609+0000 7f6915145700 1 -- 172.21.15.6:0/2329392857 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56005a8c1de0 con 0x56005ab45060 2023-09-13T09:47:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.610+0000 7f6914944700 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.610+0000 7f6915145700 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab45060 0x56005ab4ae30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6908009040 tx=0x7f6908009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e999850795770c6b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.610+0000 7f68fb7fe700 1 -- 172.21.15.6:0/2329392857 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690800e040 con 0x56005ab45060 2023-09-13T09:47:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.610+0000 7f68fb7fe700 1 -- 172.21.15.6:0/2329392857 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f690802b030 con 0x56005ab45060 2023-09-13T09:47:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.610+0000 7f68fb7fe700 1 -- 172.21.15.6:0/2329392857 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6908005420 con 0x56005ab45060 2023-09-13T09:47:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 -- 172.21.15.6:0/2329392857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab45060 msgr2=0x56005ab4ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab45060 0x56005ab4ae30 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6908009040 tx=0x7f6908009780 comp rx=0 tx=0).stop 2023-09-13T09:47:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 -- 172.21.15.6:0/2329392857 shutdown_connections 2023-09-13T09:47:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab45060 0x56005ab4ae30 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2329392857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab44700 0x56005ab54400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 -- 172.21.15.6:0/2329392857 >> 172.21.15.6:0/2329392857 conn(0x56005aaa1c80 msgr2=0x56005ab4bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 -- 172.21.15.6:0/2329392857 shutdown_connections 2023-09-13T09:47:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 -- 172.21.15.6:0/2329392857 wait complete. 2023-09-13T09:47:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 -- start start 2023-09-13T09:47:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.611+0000 7f6922d8db80 1 Processor -- start 2023-09-13T09:47:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab523f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005aba8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6922d8db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab45060 0x56005abab1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6922d8db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005abab930 con 0x56005ab43a00 2023-09-13T09:47:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6922d8db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005ababaa0 con 0x56005ab44700 2023-09-13T09:47:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6922d8db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56005ababc60 con 0x56005ab45060 2023-09-13T09:47:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6922d8db80 10 client.0 _ll_register_callbacks cb 0x56005aa31680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005aba8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6914944700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005aba8bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60946/0 (socket says 172.21.15.6:60946) 2023-09-13T09:47:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 -- 172.21.15.6:0/2026919147 learned_addr learned my addr 172.21.15.6:0/2026919147 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6914944700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39188/0 (socket says 172.21.15.6:39188) 2023-09-13T09:47:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6915145700 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab45060 0x56005abab1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 -- 172.21.15.6:0/2026919147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab45060 msgr2=0x56005abab1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab45060 0x56005abab1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 -- 172.21.15.6:0/2026919147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 msgr2=0x56005ab523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 -- 172.21.15.6:0/2026919147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f690401d650 con 0x56005ab44700 2023-09-13T09:47:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f6915145700 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab45060 0x56005abab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:47:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f690ffff700 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005aba8bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0994a0 tx=0x7f68fc0992e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a3da3a5408f08d8b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f68effff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:47:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.612+0000 7f68effff700 1 -- 172.21.15.6:0/2026919147 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68fc063070 con 0x56005ab44700 2023-09-13T09:47:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f68effff700 1 -- 172.21.15.6:0/2026919147 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f68fc0b7030 con 0x56005ab44700 2023-09-13T09:47:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68fc099510 con 0x56005ab44700 2023-09-13T09:47:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f68effff700 1 -- 172.21.15.6:0/2026919147 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68fc0652b0 con 0x56005ab44700 2023-09-13T09:47:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 10 client.27092 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56005aaad7a0 con 0x56005ab44700 2023-09-13T09:47:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f68effff700 1 -- 172.21.15.6:0/2026919147 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68fc07e080 con 0x56005ab44700 2023-09-13T09:47:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f68effff700 1 -- 172.21.15.6:0/2026919147 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68fc098a90 con 0x56005ab44700 2023-09-13T09:47:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 10 client.27092 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 10 client.27092 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 20 client.27092 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005abad370 0x56005abaf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 4 client.27092 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:47:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56005aa4f050 con 0x56005abad370 2023-09-13T09:47:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.613+0000 7f6914944700 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005abad370 0x56005abaf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.614+0000 7f68effff700 10 client.27092 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.614+0000 7f6914944700 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005abad370 0x56005abaf790 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99bfba508dc57605 server_cookie=91c2959134cacff8 in_seq=0 out_seq=0 2023-09-13T09:47:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.614+0000 7f68effff700 1 -- 172.21.15.6:0/2026919147 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56005aa4f050 con 0x56005abad370 2023-09-13T09:47:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f68effff700 10 client.27092 handle_command_reply: tid=0 2023-09-13T09:47:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 client.27092 shutdown 2023-09-13T09:47:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 msgr2=0x56005aba8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005aba8bb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0994a0 tx=0x7f68fc0992e0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 shutdown_connections 2023-09-13T09:47:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56005ab45060 0x56005abab1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56005abad370 0x56005abaf790 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56005ab43a00 0x56005ab523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 --2- 172.21.15.6:0/2026919147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56005ab44700 0x56005aba8bb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f68effff700 0 client.27092 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 >> 172.21.15.6:0/2026919147 conn(0x56005aaa1c80 msgr2=0x56005ab47980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 shutdown_connections 2023-09-13T09:47:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 1 -- 172.21.15.6:0/2026919147 wait complete. 2023-09-13T09:47:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6922d8db80 20 client.27092 trim_cache size 0 max 16384 2023-09-13T09:47:53.638 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:47:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69000a0640 msgr2=0x7f69000a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6916ba8700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69000a0640 0x7f69000a2b00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6910100d10 tx=0x7f6904009260 comp rx=0 tx=0).stop 2023-09-13T09:47:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910100eb0 msgr2=0x7f69101970d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.615+0000 7f6916ba8700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910100eb0 0x7f69101970d0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f68fc00e9a0 tx=0x7f68fc00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 shutdown_connections 2023-09-13T09:47:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6910101850 0x7f691019e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f69100ffcc0 0x7f6910196b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f69000a0640 0x7f69000a2b00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 --2- 172.21.15.6:0/935604052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6910100eb0 0x7f69101970d0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 >> 172.21.15.6:0/935604052 conn(0x7f69100fb250 msgr2=0x7f6910068d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 shutdown_connections 2023-09-13T09:47:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:53.616+0000 7f6916ba8700 1 -- 172.21.15.6:0/935604052 wait complete. 2023-09-13T09:47:54.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 404821 5.36 MB/sec execute 314 sec latency 13.774 ms 2023-09-13T09:47:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:53 smithi006 ceph-mon[98665]: pgmap v551: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:47:54.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:53 smithi053 ceph-mon[102373]: pgmap v551: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:47:54.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:53 smithi131 ceph-mon[102785]: pgmap v551: 97 pgs: 97 active+clean; 168 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:47:54.643 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:47:54.643 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:47:54.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4087746594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 msgr2=0x7fc9a81080b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4087746594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 0x7fc9a81080b0 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7fc9a00099c0 tx=0x7fc9a0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4087746594 shutdown_connections 2023-09-13T09:47:54.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4087746594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 0x7fc9a81080b0 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4087746594 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 0x7fc9a8100090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4087746594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a8100e60 0x7fc9a81012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4087746594 >> 172.21.15.6:0/4087746594 conn(0x7fc9a80fb1c0 msgr2=0x7fc9a80fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4087746594 shutdown_connections 2023-09-13T09:47:54.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.781+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4087746594 wait complete. 2023-09-13T09:47:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 Processor -- start 2023-09-13T09:47:54.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 -- start start 2023-09-13T09:47:54.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 0x7fc9a81958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a8100e60 0x7fc9a8195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 0x7fc9a819ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a819d450 con 0x7fc9a8101800 2023-09-13T09:47:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a819d590 con 0x7fc9a80ffc70 2023-09-13T09:47:54.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9aeb99700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9a819d720 con 0x7fc9a8100e60 2023-09-13T09:47:54.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 0x7fc9a81958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 0x7fc9a81958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:60958/0 (socket says 172.21.15.6:60958) 2023-09-13T09:47:54.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 -- 172.21.15.6:0/4030697631 learned_addr learned my addr 172.21.15.6:0/4030697631 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:54.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ad136700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 0x7fc9a819ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a8100e60 0x7fc9a8195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 -- 172.21.15.6:0/4030697631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a8100e60 msgr2=0x7fc9a8195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a8100e60 0x7fc9a8195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 -- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 msgr2=0x7fc9a819ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 0x7fc9a819ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.782+0000 7fc9ac935700 1 -- 172.21.15.6:0/4030697631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9a00095f0 con 0x7fc9a80ffc70 2023-09-13T09:47:54.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.783+0000 7fc9ac935700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 0x7fc9a81958d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc99800efc0 tx=0x7fc99800c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:54.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.783+0000 7fc9a5ffb700 1 -- 172.21.15.6:0/4030697631 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980092e0 con 0x7fc9a80ffc70 2023-09-13T09:47:54.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.783+0000 7fc9a5ffb700 1 -- 172.21.15.6:0/4030697631 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc99800f040 con 0x7fc9a80ffc70 2023-09-13T09:47:54.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.783+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9a806a730 con 0x7fc9a80ffc70 2023-09-13T09:47:54.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.783+0000 7fc9a5ffb700 1 -- 172.21.15.6:0/4030697631 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980043a0 con 0x7fc9a80ffc70 2023-09-13T09:47:54.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.783+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a806ac40 con 0x7fc9a80ffc70 2023-09-13T09:47:54.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.785+0000 7fc9a5ffb700 1 -- 172.21.15.6:0/4030697631 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc99800c9c0 con 0x7fc9a80ffc70 2023-09-13T09:47:54.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.786+0000 7fc9a5ffb700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9940a0640 0x7fc9940a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.786+0000 7fc9a5ffb700 1 -- 172.21.15.6:0/4030697631 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc9980dc9c0 con 0x7fc9a80ffc70 2023-09-13T09:47:54.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.786+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9940a0640 0x7fc9940a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.786+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9940a0640 0x7fc9940a2b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc990009c60 tx=0x7fc990009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:54.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 Processor -- start 2023-09-13T09:47:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 -- start start 2023-09-13T09:47:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c019990 0x561d6c019db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c018750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c018c90 0x561d6c0190f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6bf6f800 con 0x561d6c019990 2023-09-13T09:47:54.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6bf6d120 con 0x561d6c01a2f0 2023-09-13T09:47:54.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6bf68a10 con 0x561d6c018c90 2023-09-13T09:47:54.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c019990 0x561d6c019db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c019990 0x561d6c019db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39210/0 (socket says 172.21.15.6:39210) 2023-09-13T09:47:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ac935700 1 -- 172.21.15.6:0/3751376544 learned_addr learned my addr 172.21.15.6:0/3751376544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c018750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ad136700 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c018c90 0x561d6c0190f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ac935700 1 -- 172.21.15.6:0/3751376544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c018c90 msgr2=0x561d6c0190f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ac935700 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c018c90 0x561d6c0190f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ac935700 1 -- 172.21.15.6:0/3751376544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 msgr2=0x561d6c018750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.787+0000 7fc9ac935700 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c018750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.788+0000 7fc9ac935700 1 -- 172.21.15.6:0/3751376544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d6bde86b0 con 0x561d6c019990 2023-09-13T09:47:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.788+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c018750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.788+0000 7fc9ad136700 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c018c90 0x561d6c0190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:47:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.788+0000 7fc9ac935700 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c019990 0x561d6c019db0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc9980090a0 tx=0x7fc9980a9cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70035cd2197bd17 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.788+0000 7fc99effd700 1 -- 172.21.15.6:0/3751376544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998009440 con 0x561d6c019990 2023-09-13T09:47:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.788+0000 7fc99effd700 1 -- 172.21.15.6:0/3751376544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9980aa800 con 0x561d6c019990 2023-09-13T09:47:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.788+0000 7fc99effd700 1 -- 172.21.15.6:0/3751376544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980b1ce0 con 0x561d6c019990 2023-09-13T09:47:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/3751376544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c019990 msgr2=0x561d6c019db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c019990 0x561d6c019db0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fc9980090a0 tx=0x7fc9980a9cc0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/3751376544 shutdown_connections 2023-09-13T09:47:54.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c018c90 0x561d6c0190f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c019990 0x561d6c019db0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/3751376544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c018750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/3751376544 >> 172.21.15.6:0/3751376544 conn(0x561d6bf74d00 msgr2=0x561d6c010f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:54.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/3751376544 shutdown_connections 2023-09-13T09:47:54.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/3751376544 wait complete. 2023-09-13T09:47:54.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 -- start start 2023-09-13T09:47:54.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.789+0000 7fc9bad7eb80 1 Processor -- start 2023-09-13T09:47:54.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c0221c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c022700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c029740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6bf06c30 con 0x561d6c018c90 2023-09-13T09:47:54.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6bf06930 con 0x561d6c01a2f0 2023-09-13T09:47:54.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6bdea9a0 con 0x561d6c019990 2023-09-13T09:47:54.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 10 client.0 _ll_register_callbacks cb 0x561d6bf04700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:54.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c0221c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c0221c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39216/0 (socket says 172.21.15.6:39216) 2023-09-13T09:47:54.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 -- 172.21.15.6:0/1240285583 learned_addr learned my addr 172.21.15.6:0/1240285583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:54.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ad136700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c029740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c022700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 -- 172.21.15.6:0/1240285583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 msgr2=0x561d6c022700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c022700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 -- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 msgr2=0x561d6c029740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c029740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 -- 172.21.15.6:0/1240285583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9a806ac40 con 0x561d6c018c90 2023-09-13T09:47:54.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ad136700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c029740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:54.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9ac935700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c0221c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc9980aa760 tx=0x7fc9980a84a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2adc67272ca6702 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:54.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc987fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:54.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc987fff700 1 -- 172.21.15.6:0/1240285583 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980adf30 con 0x561d6c018c90 2023-09-13T09:47:54.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc987fff700 1 -- 172.21.15.6:0/1240285583 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc9980b2170 con 0x561d6c018c90 2023-09-13T09:47:54.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.790+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d6c0096f0 con 0x561d6c018c90 2023-09-13T09:47:54.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc987fff700 1 -- 172.21.15.6:0/1240285583 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc998009440 con 0x561d6c018c90 2023-09-13T09:47:54.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 10 client.17700 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:54.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561d6bf80820 con 0x561d6c018c90 2023-09-13T09:47:54.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc987fff700 1 -- 172.21.15.6:0/1240285583 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561d6c0096f0 con 0x561d6c018c90 2023-09-13T09:47:54.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc987fff700 1 -- 172.21.15.6:0/1240285583 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc9980a6120 con 0x561d6c018c90 2023-09-13T09:47:54.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 10 client.17700 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:54.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 10 client.17700 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:54.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 20 client.17700 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:54.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c02dab0 0x561d6c02fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 4 client.17700 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:54.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d6bf619f0 con 0x561d6c02dab0 2023-09-13T09:47:54.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.791+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c02dab0 0x561d6c02fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.792+0000 7fc987fff700 10 client.17700 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:54.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.792+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c02dab0 0x561d6c02fed0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2224ad42a34611f server_cookie=fed199ce6a4ef8b5 in_seq=0 out_seq=0 2023-09-13T09:47:54.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.792+0000 7fc987fff700 1 -- 172.21.15.6:0/1240285583 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561d6bf619f0 con 0x561d6c02dab0 2023-09-13T09:47:54.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.792+0000 7fc987fff700 10 client.17700 handle_command_reply: tid=0 2023-09-13T09:47:54.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.792+0000 7fc9bad7eb80 1 client.17700 shutdown 2023-09-13T09:47:54.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.792+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 msgr2=0x561d6c0221c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.792+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c0221c0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fc9980aa760 tx=0x7fc9980a84a0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 shutdown_connections 2023-09-13T09:47:54.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c01a2f0 0x561d6c029740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c02dab0 0x561d6c02fed0 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c0221c0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/1240285583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c022700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc987fff700 0 client.17700 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:54.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 >> 172.21.15.6:0/1240285583 conn(0x561d6bf74d00 msgr2=0x561d6c00b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:54.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 shutdown_connections 2023-09-13T09:47:54.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/1240285583 wait complete. 2023-09-13T09:47:54.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.793+0000 7fc9bad7eb80 20 client.17700 trim_cache size 0 max 16384 2023-09-13T09:47:54.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 Processor -- start 2023-09-13T09:47:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 -- start start 2023-09-13T09:47:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c021f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c019990 0x561d6c0296d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c01a2f0 0x561d6c0224b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6c0216b0 con 0x561d6c018c90 2023-09-13T09:47:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6c0096d0 con 0x561d6c019990 2023-09-13T09:47:54.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6c021d60 con 0x561d6c01a2f0 2023-09-13T09:47:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c021f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c021f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39224/0 (socket says 172.21.15.6:39224) 2023-09-13T09:47:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9ad136700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c01a2f0 0x561d6c0224b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9ac935700 1 -- 172.21.15.6:0/425868324 learned_addr learned my addr 172.21.15.6:0/425868324 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:54.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.812+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c019990 0x561d6c0296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc9ac935700 1 -- 172.21.15.6:0/425868324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c01a2f0 msgr2=0x561d6c0224b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc9ac935700 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c01a2f0 0x561d6c0224b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc9ac935700 1 -- 172.21.15.6:0/425868324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c019990 msgr2=0x561d6c0296d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc9ac935700 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c019990 0x561d6c0296d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc9ac935700 1 -- 172.21.15.6:0/425868324 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d6bd94e60 con 0x561d6c018c90 2023-09-13T09:47:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c019990 0x561d6c0296d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc9ac935700 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c021f70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc9980a8450 tx=0x7fc9980a95f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52641cd10bb3331 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:54.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc99f7fe700 1 -- 172.21.15.6:0/425868324 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc998009440 con 0x561d6c018c90 2023-09-13T09:47:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc99f7fe700 1 -- 172.21.15.6:0/425868324 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc99808d020 con 0x561d6c018c90 2023-09-13T09:47:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.813+0000 7fc99f7fe700 1 -- 172.21.15.6:0/425868324 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9980c2470 con 0x561d6c018c90 2023-09-13T09:47:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/425868324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 msgr2=0x561d6c021f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c021f70 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fc9980a8450 tx=0x7fc9980a95f0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/425868324 shutdown_connections 2023-09-13T09:47:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c01a2f0 0x561d6c0224b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c018c90 0x561d6c021f70 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/425868324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c019990 0x561d6c0296d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/425868324 >> 172.21.15.6:0/425868324 conn(0x561d6bf74d00 msgr2=0x561d6c02a030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/425868324 shutdown_connections 2023-09-13T09:47:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/425868324 wait complete. 2023-09-13T09:47:54.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 -- start start 2023-09-13T09:47:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.814+0000 7fc9bad7eb80 1 Processor -- start 2023-09-13T09:47:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c018c90 0x561d6c024230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c024770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9bad7eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c01a2f0 0x561d6c07f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6c0297a0 con 0x561d6c01a2f0 2023-09-13T09:47:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6c029910 con 0x561d6c018c90 2023-09-13T09:47:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9bad7eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d6c029ad0 con 0x561d6c019990 2023-09-13T09:47:54.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9bad7eb80 10 client.0 _ll_register_callbacks cb 0x561d6bf04700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c01a2f0 0x561d6c07f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c01a2f0 0x561d6c07f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39234/0 (socket says 172.21.15.6:39234) 2023-09-13T09:47:54.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ac935700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c018c90 0x561d6c024230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 -- 172.21.15.6:0/606078260 learned_addr learned my addr 172.21.15.6:0/606078260 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9a7fff700 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c024770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 -- 172.21.15.6:0/606078260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 msgr2=0x561d6c024770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c024770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 -- 172.21.15.6:0/606078260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c018c90 msgr2=0x561d6c024230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c018c90 0x561d6c024230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 -- 172.21.15.6:0/606078260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc990004400 con 0x561d6c01a2f0 2023-09-13T09:47:54.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc9ad136700 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c01a2f0 0x561d6c07f8c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a0003a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5556f33ea99ca9b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:54.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc987fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:54.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.815+0000 7fc987fff700 1 -- 172.21.15.6:0/606078260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9a001d070 con 0x561d6c01a2f0 2023-09-13T09:47:54.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc9980aa800 con 0x561d6c01a2f0 2023-09-13T09:47:54.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc987fff700 1 -- 172.21.15.6:0/606078260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc9a0003e20 con 0x561d6c01a2f0 2023-09-13T09:47:54.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc987fff700 1 -- 172.21.15.6:0/606078260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc9a0028070 con 0x561d6c01a2f0 2023-09-13T09:47:54.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 10 client.17706 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:54.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561d6bf80820 con 0x561d6c01a2f0 2023-09-13T09:47:54.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc987fff700 1 -- 172.21.15.6:0/606078260 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc9980aa800 con 0x561d6c01a2f0 2023-09-13T09:47:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc987fff700 1 -- 172.21.15.6:0/606078260 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc9a0022bc0 con 0x561d6c01a2f0 2023-09-13T09:47:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 10 client.17706 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 10 client.17706 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 20 client.17706 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:54.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c0816d0 0x561d6c083af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 4 client.17706 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:47:54.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561d6bf220d0 con 0x561d6c0816d0 2023-09-13T09:47:54.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.816+0000 7fc9ac935700 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c0816d0 0x561d6c083af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.817+0000 7fc987fff700 10 client.17706 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:54.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.817+0000 7fc9ac935700 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c0816d0 0x561d6c083af0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfde0c825699db58 server_cookie=4a1cafd59a4666d5 in_seq=0 out_seq=0 2023-09-13T09:47:54.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc987fff700 1 -- 172.21.15.6:0/606078260 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561d6bf220d0 con 0x561d6c0816d0 2023-09-13T09:47:54.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc987fff700 10 client.17706 handle_command_reply: tid=0 2023-09-13T09:47:54.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 client.17706 shutdown 2023-09-13T09:47:54.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c01a2f0 msgr2=0x561d6c07f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c01a2f0 0x561d6c07f8c0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc9a0009fd0 tx=0x7fc9a0003a70 comp rx=0 tx=0).stop 2023-09-13T09:47:54.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 shutdown_connections 2023-09-13T09:47:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561d6c0816d0 0x561d6c083af0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561d6c01a2f0 0x561d6c07f8c0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561d6c018c90 0x561d6c024230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc987fff700 0 client.17706 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:54.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 --2- 172.21.15.6:0/606078260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561d6c019990 0x561d6c024770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 >> 172.21.15.6:0/606078260 conn(0x561d6bf74d00 msgr2=0x561d6c021f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 shutdown_connections 2023-09-13T09:47:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 1 -- 172.21.15.6:0/606078260 wait complete. 2023-09-13T09:47:54.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.818+0000 7fc9bad7eb80 20 client.17706 trim_cache size 0 max 16384 2023-09-13T09:47:54.844 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:47:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:47:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "f8458753-f630-48fb-969d-ae586695ff1f", 2023-09-13T09:47:54.844 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:47:54.845 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:47:54.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9940a0640 msgr2=0x7fc9940a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9940a0640 0x7fc9940a2b00 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc990009c60 tx=0x7fc990009260 comp rx=0 tx=0).stop 2023-09-13T09:47:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 msgr2=0x7fc9a81958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 0x7fc9a81958d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc99800efc0 tx=0x7fc99800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 shutdown_connections 2023-09-13T09:47:54.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc9940a0640 0x7fc9940a2b00 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc9a8101800 0x7fc9a819ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc9a80ffc70 0x7fc9a81958d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 --2- 172.21.15.6:0/4030697631 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9a8100e60 0x7fc9a8195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 >> 172.21.15.6:0/4030697631 conn(0x7fc9a80fb1c0 msgr2=0x7fc9a80fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 shutdown_connections 2023-09-13T09:47:54.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.819+0000 7fc9aeb99700 1 -- 172.21.15.6:0/4030697631 wait complete. 2023-09-13T09:47:54.850 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:47:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 -- 172.21.15.6:0/2200625662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778101f70 msgr2=0x7fb7781023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 --2- 172.21.15.6:0/2200625662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778101f70 0x7fb7781023d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb7740098f0 tx=0x7fb774009c00 comp rx=0 tx=0).stop 2023-09-13T09:47:54.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 -- 172.21.15.6:0/2200625662 shutdown_connections 2023-09-13T09:47:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 --2- 172.21.15.6:0/2200625662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778102910 0x7fb7781091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 --2- 172.21.15.6:0/2200625662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb778100d80 0x7fb7781011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 --2- 172.21.15.6:0/2200625662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778101f70 0x7fb7781023d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 -- 172.21.15.6:0/2200625662 >> 172.21.15.6:0/2200625662 conn(0x7fb7780fc310 msgr2=0x7fb7780fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:54.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 -- 172.21.15.6:0/2200625662 shutdown_connections 2023-09-13T09:47:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.986+0000 7fb77f45c700 1 -- 172.21.15.6:0/2200625662 wait complete. 2023-09-13T09:47:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 Processor -- start 2023-09-13T09:47:54.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 -- start start 2023-09-13T09:47:54.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778100d80 0x7fb778074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb778101f70 0x7fb7780730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778102910 0x7fb7780735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778073d80 con 0x7fb778100d80 2023-09-13T09:47:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb778073ef0 con 0x7fb778101f70 2023-09-13T09:47:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77f45c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7781a0b30 con 0x7fb778102910 2023-09-13T09:47:54.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778100d80 0x7fb778074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77c9f7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb778101f70 0x7fb7780730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77d9f9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778102910 0x7fb7780735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778100d80 0x7fb778074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39244/0 (socket says 172.21.15.6:39244) 2023-09-13T09:47:54.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.987+0000 7fb77d1f8700 1 -- 172.21.15.6:0/3983491219 learned_addr learned my addr 172.21.15.6:0/3983491219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77d1f8700 1 -- 172.21.15.6:0/3983491219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778102910 msgr2=0x7fb7780735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778102910 0x7fb7780735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77d1f8700 1 -- 172.21.15.6:0/3983491219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb778101f70 msgr2=0x7fb7780730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb778101f70 0x7fb7780730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:54.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77d1f8700 1 -- 172.21.15.6:0/3983491219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7680095f0 con 0x7fb778100d80 2023-09-13T09:47:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77d9f9700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778102910 0x7fb7780735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb778101f70 0x7fb7780730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778100d80 0x7fb778074a60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb76800ebf0 tx=0x7fb76800ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb76e7fc700 1 -- 172.21.15.6:0/3983491219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768009a10 con 0x7fb778100d80 2023-09-13T09:47:54.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb770009c40 con 0x7fb778100d80 2023-09-13T09:47:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb76e7fc700 1 -- 172.21.15.6:0/3983491219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb76800cc80 con 0x7fb778100d80 2023-09-13T09:47:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb76e7fc700 1 -- 172.21.15.6:0/3983491219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768018710 con 0x7fb778100d80 2023-09-13T09:47:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.988+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb774009520 con 0x7fb778100d80 2023-09-13T09:47:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.990+0000 7fb76e7fc700 1 -- 172.21.15.6:0/3983491219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb768010430 con 0x7fb778100d80 2023-09-13T09:47:54.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.991+0000 7fb76e7fc700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7640a0640 0x7fb7640a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.991+0000 7fb76e7fc700 1 -- 172.21.15.6:0/3983491219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb768014070 con 0x7fb778100d80 2023-09-13T09:47:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.991+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7640a0640 0x7fb7640a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:54.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.991+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7640a0640 0x7fb7640a2b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb77400fa70 tx=0x7fb774019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:55.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 Processor -- start 2023-09-13T09:47:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 -- start start 2023-09-13T09:47:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94eab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94e9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed9442780 con 0x55eed94e9a00 2023-09-13T09:47:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed94400a0 con 0x55eed94ea700 2023-09-13T09:47:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb78b641b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed943b990 con 0x55eed94eb060 2023-09-13T09:47:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb77d9f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94e9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb77c9f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94eab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb77d9f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94e9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39256/0 (socket says 172.21.15.6:39256) 2023-09-13T09:47:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb77c9f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94e94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42308/0 (socket says 172.21.15.6:42308) 2023-09-13T09:47:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94eab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32776/0 (socket says 172.21.15.6:32776) 2023-09-13T09:47:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.992+0000 7fb77d9f9700 1 -- 172.21.15.6:0/78237203 learned_addr learned my addr 172.21.15.6:0/78237203 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb77d1f8700 1 -- 172.21.15.6:0/78237203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 msgr2=0x55eed94e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94e94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb77d1f8700 1 -- 172.21.15.6:0/78237203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 msgr2=0x55eed94e9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94e9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb77d1f8700 1 -- 172.21.15.6:0/78237203 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed92bb630 con 0x55eed94ea700 2023-09-13T09:47:55.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb77d9f9700 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94e9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94eab20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb76800c660 tx=0x7fb768099500 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb79125aa567b364 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb7637fe700 1 -- 172.21.15.6:0/78237203 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768099f90 con 0x55eed94ea700 2023-09-13T09:47:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb7637fe700 1 -- 172.21.15.6:0/78237203 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7680b1e90 con 0x55eed94ea700 2023-09-13T09:47:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.993+0000 7fb7637fe700 1 -- 172.21.15.6:0/78237203 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb768010980 con 0x55eed94ea700 2023-09-13T09:47:55.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 -- 172.21.15.6:0/78237203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 msgr2=0x55eed94eab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94eab20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb76800c660 tx=0x7fb768099500 comp rx=0 tx=0).stop 2023-09-13T09:47:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 -- 172.21.15.6:0/78237203 shutdown_connections 2023-09-13T09:47:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94e9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94eab20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 --2- 172.21.15.6:0/78237203 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 -- 172.21.15.6:0/78237203 >> 172.21.15.6:0/78237203 conn(0x55eed9447c80 msgr2=0x55eed94e3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 -- 172.21.15.6:0/78237203 shutdown_connections 2023-09-13T09:47:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 -- 172.21.15.6:0/78237203 wait complete. 2023-09-13T09:47:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 -- start start 2023-09-13T09:47:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.994+0000 7fb78b641b80 1 Processor -- start 2023-09-13T09:47:55.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94e9a00 0x55eed94f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94ea700 0x55eed94f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94eb060 0x55eed94fa4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb78b641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed93d9bb0 con 0x55eed94eb060 2023-09-13T09:47:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb78b641b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed93d98b0 con 0x55eed94e9a00 2023-09-13T09:47:55.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb78b641b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed92bd920 con 0x55eed94ea700 2023-09-13T09:47:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb78b641b80 10 client.0 _ll_register_callbacks cb 0x55eed93d7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94eb060 0x55eed94fa4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94e9a00 0x55eed94f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77c9f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94ea700 0x55eed94f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94eb060 0x55eed94fa4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39262/0 (socket says 172.21.15.6:39262) 2023-09-13T09:47:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77c9f7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94ea700 0x55eed94f34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42314/0 (socket says 172.21.15.6:42314) 2023-09-13T09:47:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 -- 172.21.15.6:0/2582191482 learned_addr learned my addr 172.21.15.6:0/2582191482 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94e9a00 0x55eed94f2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32782/0 (socket says 172.21.15.6:32782) 2023-09-13T09:47:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 -- 172.21.15.6:0/2582191482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94ea700 msgr2=0x55eed94f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94ea700 0x55eed94f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 -- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94e9a00 msgr2=0x55eed94f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94e9a00 0x55eed94f2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 -- 172.21.15.6:0/2582191482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb774009520 con 0x55eed94eb060 2023-09-13T09:47:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94e9a00 0x55eed94f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:47:55.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb77d9f9700 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94eb060 0x55eed94fa4f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb770009320 tx=0x7fb77000e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=addf072963250e09 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.995+0000 7fb760ff9700 1 -- 172.21.15.6:0/2582191482 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb770020610 con 0x55eed94eb060 2023-09-13T09:47:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eed94dc670 con 0x55eed94eb060 2023-09-13T09:47:55.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb760ff9700 1 -- 172.21.15.6:0/2582191482 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb770020770 con 0x55eed94eb060 2023-09-13T09:47:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb760ff9700 1 -- 172.21.15.6:0/2582191482 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb77000eec0 con 0x55eed94eb060 2023-09-13T09:47:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 10 client.17718 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55eed94537a0 con 0x55eed94eb060 2023-09-13T09:47:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb760ff9700 1 -- 172.21.15.6:0/2582191482 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55eed94dc670 con 0x55eed94eb060 2023-09-13T09:47:55.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb760ff9700 1 -- 172.21.15.6:0/2582191482 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb7700169c0 con 0x55eed94eb060 2023-09-13T09:47:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 10 client.17718 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 10 client.17718 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 20 client.17718 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed94fee50 0x55eed9501270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 4 client.17718 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:47:55.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eed9434970 con 0x55eed94fee50 2023-09-13T09:47:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.996+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed94fee50 0x55eed9501270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.997+0000 7fb760ff9700 10 client.17718 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.997+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed94fee50 0x55eed9501270 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c38f7be2f3e251b4 server_cookie=138234a44493bab7 in_seq=0 out_seq=0 2023-09-13T09:47:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.997+0000 7fb760ff9700 1 -- 172.21.15.6:0/2582191482 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eed9434970 con 0x55eed94fee50 2023-09-13T09:47:55.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.997+0000 7fb760ff9700 10 client.17718 handle_command_reply: tid=0 2023-09-13T09:47:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.997+0000 7fb78b641b80 1 client.17718 shutdown 2023-09-13T09:47:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94eb060 msgr2=0x55eed94fa4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94eb060 0x55eed94fa4f0 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fb770009320 tx=0x7fb77000e7d0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 shutdown_connections 2023-09-13T09:47:55.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed94fee50 0x55eed9501270 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94eb060 0x55eed94fa4f0 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94e9a00 0x55eed94f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2582191482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94ea700 0x55eed94f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 >> 172.21.15.6:0/2582191482 conn(0x55eed9447c80 msgr2=0x55eed94de7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb760ff9700 0 client.17718 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 shutdown_connections 2023-09-13T09:47:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 1 -- 172.21.15.6:0/2582191482 wait complete. 2023-09-13T09:47:55.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:54.998+0000 7fb78b641b80 20 client.17718 trim_cache size 0 max 16384 2023-09-13T09:47:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 Processor -- start 2023-09-13T09:47:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 -- start start 2023-09-13T09:47:55.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94e9a00 0x55eed94e94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94ea700 0x55eed94fa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94eb060 0x55eed94eda20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed94fa950 con 0x55eed94ea700 2023-09-13T09:47:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed94f2230 con 0x55eed94eb060 2023-09-13T09:47:55.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.016+0000 7fb78b641b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed94e5350 con 0x55eed94e9a00 2023-09-13T09:47:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94ea700 0x55eed94fa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94ea700 0x55eed94fa410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39266/0 (socket says 172.21.15.6:39266) 2023-09-13T09:47:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 -- 172.21.15.6:0/2724814467 learned_addr learned my addr 172.21.15.6:0/2724814467 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77d9f9700 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94eb060 0x55eed94eda20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 -- 172.21.15.6:0/2724814467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94e9a00 msgr2=0x55eed94e94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94e9a00 0x55eed94e94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 -- 172.21.15.6:0/2724814467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94eb060 msgr2=0x55eed94eda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94eb060 0x55eed94eda20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 -- 172.21.15.6:0/2724814467 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eed9505ea0 con 0x55eed94ea700 2023-09-13T09:47:55.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94ea700 0x55eed94fa410 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb774016000 tx=0x7fb77401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ed063842b30ae6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb763fff700 1 -- 172.21.15.6:0/2724814467 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400bc10 con 0x55eed94ea700 2023-09-13T09:47:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb763fff700 1 -- 172.21.15.6:0/2724814467 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb77401d040 con 0x55eed94ea700 2023-09-13T09:47:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.017+0000 7fb763fff700 1 -- 172.21.15.6:0/2724814467 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774003e70 con 0x55eed94ea700 2023-09-13T09:47:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 -- 172.21.15.6:0/2724814467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94ea700 msgr2=0x55eed94fa410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:55.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94ea700 0x55eed94fa410 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fb774016000 tx=0x7fb77401f000 comp rx=0 tx=0).stop 2023-09-13T09:47:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 -- 172.21.15.6:0/2724814467 shutdown_connections 2023-09-13T09:47:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94eb060 0x55eed94eda20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94e9a00 0x55eed94e94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2724814467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94ea700 0x55eed94fa410 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 -- 172.21.15.6:0/2724814467 >> 172.21.15.6:0/2724814467 conn(0x55eed9447c80 msgr2=0x55eed9500e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 -- 172.21.15.6:0/2724814467 shutdown_connections 2023-09-13T09:47:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 -- 172.21.15.6:0/2724814467 wait complete. 2023-09-13T09:47:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 -- start start 2023-09-13T09:47:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.018+0000 7fb78b641b80 1 Processor -- start 2023-09-13T09:47:55.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94f7f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94f8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb78b641b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb78b641b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed94f99e0 con 0x55eed94e9a00 2023-09-13T09:47:55.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb78b641b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed94f9b50 con 0x55eed94ea700 2023-09-13T09:47:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb78b641b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eed94f9d10 con 0x55eed94eb060 2023-09-13T09:47:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb78b641b80 10 client.0 _ll_register_callbacks cb 0x55eed93d7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:47:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94f7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94f7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39272/0 (socket says 172.21.15.6:39272) 2023-09-13T09:47:55.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 -- 172.21.15.6:0/2823794266 learned_addr learned my addr 172.21.15.6:0/2823794266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:47:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d9f9700 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94f8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 -- 172.21.15.6:0/2823794266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 msgr2=0x55eed94f94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94f94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 -- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 msgr2=0x55eed94f8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:47:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94f8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 -- 172.21.15.6:0/2823794266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb778109b10 con 0x55eed94e9a00 2023-09-13T09:47:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb77d1f8700 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94f7f50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb768096300 tx=0x7fb76800efd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9de3951d194017d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:47:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.019+0000 7fb760ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:47:55.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb760ff9700 1 -- 172.21.15.6:0/2823794266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7680a1900 con 0x55eed94e9a00 2023-09-13T09:47:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb760ff9700 1 -- 172.21.15.6:0/2823794266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb76809d6c0 con 0x55eed94e9a00 2023-09-13T09:47:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb7680b1e90 con 0x55eed94e9a00 2023-09-13T09:47:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb760ff9700 1 -- 172.21.15.6:0/2823794266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb768099890 con 0x55eed94e9a00 2023-09-13T09:47:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 10 client.17724 fetch_fsmap learned FSMap version 34 2023-09-13T09:47:55.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55eed9267de0 con 0x55eed94e9a00 2023-09-13T09:47:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb760ff9700 1 -- 172.21.15.6:0/2823794266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb7680b1e90 con 0x55eed94e9a00 2023-09-13T09:47:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb760ff9700 1 -- 172.21.15.6:0/2823794266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb7680b0020 con 0x55eed94e9a00 2023-09-13T09:47:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 10 client.17724 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:47:55.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 10 client.17724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:47:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 20 client.17724 populate_metadata read hostname 'smithi006' 2023-09-13T09:47:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed9553810 0x55eed9555c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:47:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 4 client.17724 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:47:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eed93f5050 con 0x55eed9553810 2023-09-13T09:47:55.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.020+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed9553810 0x55eed9555c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:47:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb760ff9700 10 client.17724 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb77c9f7700 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed9553810 0x55eed9555c30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5f44353b7128c2d server_cookie=d56e21d18d276679 in_seq=0 out_seq=0 2023-09-13T09:47:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb760ff9700 1 -- 172.21.15.6:0/2823794266 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55eed93f5050 con 0x55eed9553810 2023-09-13T09:47:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb760ff9700 10 client.17724 handle_command_reply: tid=0 2023-09-13T09:47:55.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 client.17724 shutdown 2023-09-13T09:47:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 msgr2=0x55eed94f7f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94f7f50 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fb768096300 tx=0x7fb76800efd0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 shutdown_connections 2023-09-13T09:47:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eed94eb060 0x55eed94f94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55eed9553810 0x55eed9555c30 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eed94e9a00 0x55eed94f7f50 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb760ff9700 0 client.17724 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:47:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 --2- 172.21.15.6:0/2823794266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eed94ea700 0x55eed94f8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 >> 172.21.15.6:0/2823794266 conn(0x55eed9447c80 msgr2=0x55eed94eda20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:55.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 shutdown_connections 2023-09-13T09:47:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 1 -- 172.21.15.6:0/2823794266 wait complete. 2023-09-13T09:47:55.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.021+0000 7fb78b641b80 20 client.17724 trim_cache size 0 max 16384 2023-09-13T09:47:55.044 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:47:55.044 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:47:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:47:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "f8458753-f630-48fb-969d-ae586695ff1f": { 2023-09-13T09:47:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:47:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "f8458753-f630-48fb-969d-ae586695ff1f", 2023-09-13T09:47:55.045 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:47:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:47:55.046 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:47:55.046 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:47:55.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7640a0640 msgr2=0x7fb7640a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7640a0640 0x7fb7640a2b00 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb77400fa70 tx=0x7fb774019040 comp rx=0 tx=0).stop 2023-09-13T09:47:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778100d80 msgr2=0x7fb778074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:47:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778100d80 0x7fb778074a60 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fb76800ebf0 tx=0x7fb76800ef00 comp rx=0 tx=0).stop 2023-09-13T09:47:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 shutdown_connections 2023-09-13T09:47:55.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb778102910 0x7fb7780735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb7640a0640 0x7fb7640a2b00 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb778100d80 0x7fb778074a60 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 --2- 172.21.15.6:0/3983491219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb778101f70 0x7fb7780730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:47:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 >> 172.21.15.6:0/3983491219 conn(0x7fb7780fc310 msgr2=0x7fb7780fe590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:47:55.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 shutdown_connections 2023-09-13T09:47:55.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:47:55.022+0000 7fb77f45c700 1 -- 172.21.15.6:0/3983491219 wait complete. 2023-09-13T09:47:55.050 INFO:tasks.cephfs.filesystem:scrub status for tag:f8458753-f630-48fb-969d-ae586695ff1f - {'path': '/', 'tag': 'f8458753-f630-48fb-969d-ae586695ff1f', 'options': 'recursive,force'} 2023-09-13T09:47:55.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 406059 5.36 MB/sec execute 315 sec latency 17.252 ms 2023-09-13T09:47:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:55.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 408157 5.38 MB/sec execute 316 sec latency 13.470 ms 2023-09-13T09:47:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: pgmap v552: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2023-09-13T09:47:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:47:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:56.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:56.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:47:56.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:55 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: pgmap v552: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2023-09-13T09:47:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:47:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:56.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:56.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:47:56.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:55 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: pgmap v552: 97 pgs: 97 active+clean; 169 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 867 KiB/s rd, 2.3 MiB/s wr, 260 op/s 2023-09-13T09:47:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:47:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:56.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:56.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:56.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:56.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:56.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:56.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:47:56.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:55 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:47:57.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 409018 5.37 MB/sec execute 317 sec latency 46.008 ms 2023-09-13T09:47:58.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 411310 5.40 MB/sec execute 318 sec latency 11.729 ms 2023-09-13T09:47:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:57 smithi006 ceph-mon[98665]: pgmap v553: 97 pgs: 97 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 2.4 MiB/s wr, 261 op/s 2023-09-13T09:47:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:57 smithi053 ceph-mon[102373]: pgmap v553: 97 pgs: 97 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 2.4 MiB/s wr, 261 op/s 2023-09-13T09:47:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:57 smithi131 ceph-mon[102785]: pgmap v553: 97 pgs: 97 active+clean; 171 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 899 KiB/s rd, 2.4 MiB/s wr, 261 op/s 2023-09-13T09:47:59.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 412213 5.39 MB/sec execute 319 sec latency 12.444 ms 2023-09-13T09:48:00.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 414421 5.42 MB/sec execute 320 sec latency 13.008 ms 2023-09-13T09:48:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:47:59 smithi006 ceph-mon[98665]: pgmap v554: 97 pgs: 97 active+clean; 172 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2023-09-13T09:48:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:47:59 smithi053 ceph-mon[102373]: pgmap v554: 97 pgs: 97 active+clean; 172 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2023-09-13T09:48:00.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:47:59 smithi131 ceph-mon[102785]: pgmap v554: 97 pgs: 97 active+clean; 172 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2023-09-13T09:48:01.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 415495 5.42 MB/sec execute 321 sec latency 84.177 ms 2023-09-13T09:48:02.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 417430 5.42 MB/sec execute 322 sec latency 33.059 ms 2023-09-13T09:48:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:01 smithi006 ceph-mon[98665]: pgmap v555: 97 pgs: 97 active+clean; 172 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.2 MiB/s wr, 232 op/s 2023-09-13T09:48:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:01 smithi053 ceph-mon[102373]: pgmap v555: 97 pgs: 97 active+clean; 172 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.2 MiB/s wr, 232 op/s 2023-09-13T09:48:02.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:01 smithi131 ceph-mon[102785]: pgmap v555: 97 pgs: 97 active+clean; 172 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 814 KiB/s rd, 2.2 MiB/s wr, 232 op/s 2023-09-13T09:48:03.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 418907 5.44 MB/sec execute 323 sec latency 19.711 ms 2023-09-13T09:48:04.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 420251 5.44 MB/sec execute 324 sec latency 12.247 ms 2023-09-13T09:48:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:03 smithi006 ceph-mon[98665]: pgmap v556: 97 pgs: 97 active+clean; 174 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:48:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:03 smithi053 ceph-mon[102373]: pgmap v556: 97 pgs: 97 active+clean; 174 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:48:04.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:03 smithi131 ceph-mon[102785]: pgmap v556: 97 pgs: 97 active+clean; 174 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 930 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:48:05.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 422363 5.47 MB/sec execute 325 sec latency 12.755 ms 2023-09-13T09:48:06.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 423353 5.46 MB/sec execute 326 sec latency 44.607 ms 2023-09-13T09:48:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:05 smithi006 ceph-mon[98665]: pgmap v557: 97 pgs: 97 active+clean; 176 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:48:06.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:05 smithi053 ceph-mon[102373]: pgmap v557: 97 pgs: 97 active+clean; 176 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:48:06.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:05 smithi131 ceph-mon[102785]: pgmap v557: 97 pgs: 97 active+clean; 176 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 956 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:48:07.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 425506 5.48 MB/sec execute 327 sec latency 17.239 ms 2023-09-13T09:48:08.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 426463 5.48 MB/sec execute 328 sec latency 19.606 ms 2023-09-13T09:48:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:07 smithi006 ceph-mon[98665]: pgmap v558: 97 pgs: 97 active+clean; 176 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 280 op/s 2023-09-13T09:48:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:07 smithi053 ceph-mon[102373]: pgmap v558: 97 pgs: 97 active+clean; 176 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 280 op/s 2023-09-13T09:48:08.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:07 smithi131 ceph-mon[102785]: pgmap v558: 97 pgs: 97 active+clean; 176 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.3 MiB/s wr, 280 op/s 2023-09-13T09:48:09.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 428695 5.50 MB/sec execute 329 sec latency 11.955 ms 2023-09-13T09:48:10.173 INFO:tasks.workunit.client.0.smithi006.stdout: 1 429706 5.50 MB/sec execute 330 sec latency 15.492 ms 2023-09-13T09:48:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:09 smithi053 ceph-mon[102373]: pgmap v559: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 1.9 MiB/s wr, 239 op/s 2023-09-13T09:48:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:09 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:09 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:09 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:09 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:10.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:09 smithi006 ceph-mon[98665]: pgmap v559: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 1.9 MiB/s wr, 239 op/s 2023-09-13T09:48:10.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:09 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:10.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:09 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:10.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:09 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:10.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:09 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:09 smithi131 ceph-mon[102785]: pgmap v559: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 908 KiB/s rd, 1.9 MiB/s wr, 239 op/s 2023-09-13T09:48:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:09 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:09 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:10.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:09 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:10.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:09 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:11.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 431780 5.51 MB/sec execute 331 sec latency 21.254 ms 2023-09-13T09:48:11.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:11.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:11.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:12.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 433155 5.53 MB/sec execute 332 sec latency 37.163 ms 2023-09-13T09:48:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:11 smithi006 ceph-mon[98665]: pgmap v560: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 1.9 MiB/s wr, 229 op/s 2023-09-13T09:48:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:11 smithi053 ceph-mon[102373]: pgmap v560: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 1.9 MiB/s wr, 229 op/s 2023-09-13T09:48:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:11 smithi131 ceph-mon[102785]: pgmap v560: 97 pgs: 97 active+clean; 177 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 921 KiB/s rd, 1.9 MiB/s wr, 229 op/s 2023-09-13T09:48:13.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 435064 5.53 MB/sec execute 333 sec latency 13.604 ms 2023-09-13T09:48:14.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 436612 5.55 MB/sec execute 334 sec latency 13.150 ms 2023-09-13T09:48:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:13 smithi006 ceph-mon[98665]: pgmap v561: 97 pgs: 97 active+clean; 179 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2023-09-13T09:48:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:13 smithi053 ceph-mon[102373]: pgmap v561: 97 pgs: 97 active+clean; 179 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2023-09-13T09:48:14.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:13 smithi131 ceph-mon[102785]: pgmap v561: 97 pgs: 97 active+clean; 179 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2023-09-13T09:48:15.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 437843 5.55 MB/sec execute 335 sec latency 15.514 ms 2023-09-13T09:48:16.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 440067 5.57 MB/sec execute 336 sec latency 15.792 ms 2023-09-13T09:48:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:15 smithi006 ceph-mon[98665]: pgmap v562: 97 pgs: 97 active+clean; 180 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 2.4 MiB/s wr, 255 op/s 2023-09-13T09:48:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:15 smithi053 ceph-mon[102373]: pgmap v562: 97 pgs: 97 active+clean; 180 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 2.4 MiB/s wr, 255 op/s 2023-09-13T09:48:16.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:15 smithi131 ceph-mon[102785]: pgmap v562: 97 pgs: 97 active+clean; 180 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 981 KiB/s rd, 2.4 MiB/s wr, 255 op/s 2023-09-13T09:48:17.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 440758 5.56 MB/sec execute 337 sec latency 83.667 ms 2023-09-13T09:48:18.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 443158 5.59 MB/sec execute 338 sec latency 20.469 ms 2023-09-13T09:48:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:17 smithi006 ceph-mon[98665]: pgmap v563: 97 pgs: 97 active+clean; 183 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 292 op/s 2023-09-13T09:48:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:17 smithi053 ceph-mon[102373]: pgmap v563: 97 pgs: 97 active+clean; 183 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 292 op/s 2023-09-13T09:48:18.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:17 smithi131 ceph-mon[102785]: pgmap v563: 97 pgs: 97 active+clean; 183 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 292 op/s 2023-09-13T09:48:19.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 444126 5.58 MB/sec execute 339 sec latency 13.504 ms 2023-09-13T09:48:20.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 446335 5.60 MB/sec execute 340 sec latency 12.349 ms 2023-09-13T09:48:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:19 smithi006 ceph-mon[98665]: pgmap v564: 97 pgs: 97 active+clean; 184 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:48:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:19 smithi053 ceph-mon[102373]: pgmap v564: 97 pgs: 97 active+clean; 184 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:48:20.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:19 smithi131 ceph-mon[102785]: pgmap v564: 97 pgs: 97 active+clean; 184 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 882 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:48:21.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 447428 5.61 MB/sec execute 341 sec latency 13.353 ms 2023-09-13T09:48:22.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 449425 5.61 MB/sec execute 342 sec latency 28.835 ms 2023-09-13T09:48:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:21 smithi006 ceph-mon[98665]: pgmap v565: 97 pgs: 97 active+clean; 184 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-13T09:48:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:21 smithi053 ceph-mon[102373]: pgmap v565: 97 pgs: 97 active+clean; 184 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-13T09:48:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:21 smithi131 ceph-mon[102785]: pgmap v565: 97 pgs: 97 active+clean; 184 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-13T09:48:23.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 450866 5.63 MB/sec execute 343 sec latency 27.039 ms 2023-09-13T09:48:24.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 452695 5.63 MB/sec execute 344 sec latency 15.183 ms 2023-09-13T09:48:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:23 smithi006 ceph-mon[98665]: pgmap v566: 97 pgs: 97 active+clean; 185 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2023-09-13T09:48:24.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:23 smithi053 ceph-mon[102373]: pgmap v566: 97 pgs: 97 active+clean; 185 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2023-09-13T09:48:24.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:23 smithi131 ceph-mon[102785]: pgmap v566: 97 pgs: 97 active+clean; 185 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 2.6 MiB/s wr, 291 op/s 2023-09-13T09:48:25.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:48:25.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 454324 5.65 MB/sec execute 345 sec latency 17.375 ms 2023-09-13T09:48:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 -- 172.21.15.6:0/2753048265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 msgr2=0x7ff314101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 --2- 172.21.15.6:0/2753048265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314101310 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0099c0 tx=0x7ff2fc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 -- 172.21.15.6:0/2753048265 shutdown_connections 2023-09-13T09:48:25.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 --2- 172.21.15.6:0/2753048265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff314101850 0x7ff314108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 --2- 172.21.15.6:0/2753048265 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 0x7ff3141000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 --2- 172.21.15.6:0/2753048265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314101310 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 -- 172.21.15.6:0/2753048265 >> 172.21.15.6:0/2753048265 conn(0x7ff3140fb250 msgr2=0x7ff3140fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 -- 172.21.15.6:0/2753048265 shutdown_connections 2023-09-13T09:48:25.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.181+0000 7ff318fa8700 1 -- 172.21.15.6:0/2753048265 wait complete. 2023-09-13T09:48:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 Processor -- start 2023-09-13T09:48:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 -- start start 2023-09-13T09:48:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 0x7ff3141958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314195e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff314101850 0x7ff31419ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31419d450 con 0x7ff314100eb0 2023-09-13T09:48:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31419d590 con 0x7ff3140ffcc0 2023-09-13T09:48:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.182+0000 7ff318fa8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31419d720 con 0x7ff314101850 2023-09-13T09:48:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314195e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 0x7ff3141958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314195e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39288/0 (socket says 172.21.15.6:39288) 2023-09-13T09:48:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 0x7ff3141958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32810/0 (socket says 172.21.15.6:32810) 2023-09-13T09:48:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff311d9b700 1 -- 172.21.15.6:0/3731787554 learned_addr learned my addr 172.21.15.6:0/3731787554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff312d9d700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff314101850 0x7ff31419ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 -- 172.21.15.6:0/3731787554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff314101850 msgr2=0x7ff31419ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff314101850 0x7ff31419ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 -- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 msgr2=0x7ff314195e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314195e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 -- 172.21.15.6:0/3731787554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2fc0095f0 con 0x7ff3140ffcc0 2023-09-13T09:48:25.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff311d9b700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff31259c700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 0x7ff3141958d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff30400e9c0 tx=0x7ff30400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff30b7fe700 1 -- 172.21.15.6:0/3731787554 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304004220 con 0x7ff3140ffcc0 2023-09-13T09:48:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff31419da00 con 0x7ff3140ffcc0 2023-09-13T09:48:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff30b7fe700 1 -- 172.21.15.6:0/3731787554 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff304004380 con 0x7ff3140ffcc0 2023-09-13T09:48:25.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff30b7fe700 1 -- 172.21.15.6:0/3731787554 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304003be0 con 0x7ff3140ffcc0 2023-09-13T09:48:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.183+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31419df10 con 0x7ff3140ffcc0 2023-09-13T09:48:25.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.186+0000 7ff30b7fe700 1 -- 172.21.15.6:0/3731787554 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff304003d40 con 0x7ff3140ffcc0 2023-09-13T09:48:25.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.187+0000 7ff30b7fe700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3000a0640 0x7ff3000a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.187+0000 7ff311d9b700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3000a0640 0x7ff3000a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.187+0000 7ff30b7fe700 1 -- 172.21.15.6:0/3731787554 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff304014070 con 0x7ff3140ffcc0 2023-09-13T09:48:25.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.187+0000 7ff311d9b700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3000a0640 0x7ff3000a2b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004800 tx=0x7ff2fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.187+0000 7ff32518db80 1 Processor -- start 2023-09-13T09:48:25.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.187+0000 7ff32518db80 1 -- start start 2023-09-13T09:48:25.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff32518db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386d9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff32518db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386da490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff32518db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386dae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff32518db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee38632780 con 0x55ee386da010 2023-09-13T09:48:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff32518db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee386300a0 con 0x55ee386d96b0 2023-09-13T09:48:25.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff32518db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee3862b990 con 0x55ee386da9d0 2023-09-13T09:48:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386da490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386da490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39296/0 (socket says 172.21.15.6:39296) 2023-09-13T09:48:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 -- 172.21.15.6:0/1681025891 learned_addr learned my addr 172.21.15.6:0/1681025891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff31259c700 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386d9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff312d9d700 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386dae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 -- 172.21.15.6:0/1681025891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 msgr2=0x55ee386dae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386dae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 -- 172.21.15.6:0/1681025891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 msgr2=0x55ee386d9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386d9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 -- 172.21.15.6:0/1681025891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee384ab630 con 0x55ee386da010 2023-09-13T09:48:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff312d9d700 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386dae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:48:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff311d9b700 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386da490 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00f590 tx=0x7ff2fc01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3fe9974906d87 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.188+0000 7ff308ff9700 1 -- 172.21.15.6:0/1681025891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc02a070 con 0x55ee386da010 2023-09-13T09:48:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff308ff9700 1 -- 172.21.15.6:0/1681025891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2fc01e040 con 0x55ee386da010 2023-09-13T09:48:25.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff308ff9700 1 -- 172.21.15.6:0/1681025891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc02fe80 con 0x55ee386da010 2023-09-13T09:48:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 -- 172.21.15.6:0/1681025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 msgr2=0x55ee386da490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386da490 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00f590 tx=0x7ff2fc01f000 comp rx=0 tx=0).stop 2023-09-13T09:48:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 -- 172.21.15.6:0/1681025891 shutdown_connections 2023-09-13T09:48:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386dae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386d9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 --2- 172.21.15.6:0/1681025891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386da490 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 -- 172.21.15.6:0/1681025891 >> 172.21.15.6:0/1681025891 conn(0x55ee38637c80 msgr2=0x55ee386d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 -- 172.21.15.6:0/1681025891 shutdown_connections 2023-09-13T09:48:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.189+0000 7ff32518db80 1 -- 172.21.15.6:0/1681025891 wait complete. 2023-09-13T09:48:25.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 -- start start 2023-09-13T09:48:25.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 Processor -- start 2023-09-13T09:48:25.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386d96b0 0x55ee386df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386df560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da9d0 0x55ee386dbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee385c9bb0 con 0x55ee386da010 2023-09-13T09:48:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee385c98b0 con 0x55ee386da9d0 2023-09-13T09:48:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee384ad920 con 0x55ee386d96b0 2023-09-13T09:48:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff32518db80 10 client.0 _ll_register_callbacks cb 0x55ee385c7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386df560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386df560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39302/0 (socket says 172.21.15.6:39302) 2023-09-13T09:48:25.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff311d9b700 1 -- 172.21.15.6:0/3073466969 learned_addr learned my addr 172.21.15.6:0/3073466969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff31259c700 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386d96b0 0x55ee386df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.190+0000 7ff312d9d700 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da9d0 0x55ee386dbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff31259c700 1 -- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da9d0 msgr2=0x55ee386dbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff31259c700 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da9d0 0x55ee386dbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff31259c700 1 -- 172.21.15.6:0/3073466969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 msgr2=0x55ee386df560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff31259c700 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386df560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff31259c700 1 -- 172.21.15.6:0/3073466969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff314108a50 con 0x55ee386d96b0 2023-09-13T09:48:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff31259c700 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386d96b0 0x55ee386df020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3040c9940 tx=0x7ff304004630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=894a5b443c348606 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff2f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:48:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/3073466969 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff30409d460 con 0x55ee386d96b0 2023-09-13T09:48:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/3073466969 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3040a16a0 con 0x55ee386d96b0 2023-09-13T09:48:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee386cc670 con 0x55ee386d96b0 2023-09-13T09:48:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/3073466969 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff30401fde0 con 0x55ee386d96b0 2023-09-13T09:48:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff32518db80 10 client.27061 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ee386437a0 con 0x55ee386d96b0 2023-09-13T09:48:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.191+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/3073466969 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee386cc670 con 0x55ee386d96b0 2023-09-13T09:48:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/3073466969 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff304098b20 con 0x55ee386d96b0 2023-09-13T09:48:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff32518db80 10 client.27061 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff32518db80 10 client.27061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff32518db80 20 client.27061 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff32518db80 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee386eabe0 0x55ee386ed000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff32518db80 4 client.27061 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee38624970 con 0x55ee386eabe0 2023-09-13T09:48:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff311d9b700 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee386eabe0 0x55ee386ed000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff2f9ffb700 10 client.27061 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.192+0000 7ff311d9b700 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee386eabe0 0x55ee386ed000 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed88c99628b5cd25 server_cookie=eab129d77fa321aa in_seq=0 out_seq=0 2023-09-13T09:48:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/3073466969 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee38624970 con 0x55ee386eabe0 2023-09-13T09:48:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff2f9ffb700 10 client.27061 handle_command_reply: tid=0 2023-09-13T09:48:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 client.27061 shutdown 2023-09-13T09:48:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386d96b0 msgr2=0x55ee386df020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386d96b0 0x55ee386df020 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff3040c9940 tx=0x7ff304004630 comp rx=0 tx=0).stop 2023-09-13T09:48:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 shutdown_connections 2023-09-13T09:48:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da9d0 0x55ee386dbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386d96b0 0x55ee386df020 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee386eabe0 0x55ee386ed000 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 --2- 172.21.15.6:0/3073466969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da010 0x55ee386df560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff2f9ffb700 0 client.27061 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:25.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 >> 172.21.15.6:0/3073466969 conn(0x55ee38637c80 msgr2=0x55ee386ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 shutdown_connections 2023-09-13T09:48:25.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 1 -- 172.21.15.6:0/3073466969 wait complete. 2023-09-13T09:48:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.193+0000 7ff32518db80 20 client.27061 trim_cache size 0 max 16384 2023-09-13T09:48:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 Processor -- start 2023-09-13T09:48:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 -- start start 2023-09-13T09:48:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386f1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da010 0x55ee386d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da9d0 0x55ee386e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee386e67d0 con 0x55ee386da9d0 2023-09-13T09:48:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee386db630 con 0x55ee386d96b0 2023-09-13T09:48:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff32518db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee386ed390 con 0x55ee386da010 2023-09-13T09:48:25.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da010 0x55ee386d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff31259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386f1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da010 0x55ee386d3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42364/0 (socket says 172.21.15.6:42364) 2023-09-13T09:48:25.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff31259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386f1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32832/0 (socket says 172.21.15.6:32832) 2023-09-13T09:48:25.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 -- 172.21.15.6:0/2362707120 learned_addr learned my addr 172.21.15.6:0/2362707120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff312d9d700 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da9d0 0x55ee386e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 -- 172.21.15.6:0/2362707120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 msgr2=0x55ee386f1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386f1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 -- 172.21.15.6:0/2362707120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da9d0 msgr2=0x55ee386e5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da9d0 0x55ee386e5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.212+0000 7ff311d9b700 1 -- 172.21.15.6:0/2362707120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee38457de0 con 0x55ee386da010 2023-09-13T09:48:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff311d9b700 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da010 0x55ee386d3e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009990 tx=0x7ff2fc027040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f328f07abce8401d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff3097fa700 1 -- 172.21.15.6:0/2362707120 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc02a040 con 0x55ee386da010 2023-09-13T09:48:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff3097fa700 1 -- 172.21.15.6:0/2362707120 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2fc02b040 con 0x55ee386da010 2023-09-13T09:48:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff3097fa700 1 -- 172.21.15.6:0/2362707120 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc004830 con 0x55ee386da010 2023-09-13T09:48:25.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff32518db80 1 -- 172.21.15.6:0/2362707120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da010 msgr2=0x55ee386d3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff32518db80 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da010 0x55ee386d3e60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009990 tx=0x7ff2fc027040 comp rx=0 tx=0).stop 2023-09-13T09:48:25.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff32518db80 1 -- 172.21.15.6:0/2362707120 shutdown_connections 2023-09-13T09:48:25.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff32518db80 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386da9d0 0x55ee386e5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff32518db80 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386d96b0 0x55ee386f1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff32518db80 1 --2- 172.21.15.6:0/2362707120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da010 0x55ee386d3e60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.213+0000 7ff32518db80 1 -- 172.21.15.6:0/2362707120 >> 172.21.15.6:0/2362707120 conn(0x55ee38637c80 msgr2=0x55ee386dadb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 -- 172.21.15.6:0/2362707120 shutdown_connections 2023-09-13T09:48:25.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 -- 172.21.15.6:0/2362707120 wait complete. 2023-09-13T09:48:25.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 -- start start 2023-09-13T09:48:25.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 Processor -- start 2023-09-13T09:48:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386d96b0 0x55ee386f13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da010 0x55ee386f1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386efa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee386f0020 con 0x55ee386d96b0 2023-09-13T09:48:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee386f0160 con 0x55ee386da010 2023-09-13T09:48:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee386f0320 con 0x55ee386da9d0 2023-09-13T09:48:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff32518db80 10 client.0 _ll_register_callbacks cb 0x55ee385c7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff31259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386d96b0 0x55ee386f13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff31259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386d96b0 0x55ee386f13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39314/0 (socket says 172.21.15.6:39314) 2023-09-13T09:48:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff31259c700 1 -- 172.21.15.6:0/2322770988 learned_addr learned my addr 172.21.15.6:0/2322770988 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff311d9b700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da010 0x55ee386f1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.214+0000 7ff312d9d700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386efa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff31259c700 1 -- 172.21.15.6:0/2322770988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 msgr2=0x55ee386efa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff31259c700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386efa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff31259c700 1 -- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da010 msgr2=0x55ee386f1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff31259c700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da010 0x55ee386f1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff31259c700 1 -- 172.21.15.6:0/2322770988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee384ab630 con 0x55ee386d96b0 2023-09-13T09:48:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff312d9d700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff311d9b700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da010 0x55ee386f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff31259c700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386d96b0 0x55ee386f13f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff3040960a0 tx=0x7ff304003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c594f60e57200f5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff2f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/2322770988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff304099170 con 0x55ee386d96b0 2023-09-13T09:48:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/2322770988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3040a16a0 con 0x55ee386d96b0 2023-09-13T09:48:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff2fc01e040 con 0x55ee386d96b0 2023-09-13T09:48:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/2322770988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff304099400 con 0x55ee386d96b0 2023-09-13T09:48:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff32518db80 10 client.17742 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ee38440c60 con 0x55ee386d96b0 2023-09-13T09:48:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/2322770988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff2fc01e040 con 0x55ee386d96b0 2023-09-13T09:48:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.215+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/2322770988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff3040841f0 con 0x55ee386d96b0 2023-09-13T09:48:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 10 client.17742 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 10 client.17742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 20 client.17742 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee38743740 0x55ee38745b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 4 client.17742 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:48:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ee385e5050 con 0x55ee38743740 2023-09-13T09:48:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff311d9b700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee38743740 0x55ee38745b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff2f9ffb700 10 client.17742 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff311d9b700 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee38743740 0x55ee38745b60 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb0a4b81d5a12d38 server_cookie=369d9df071627457 in_seq=0 out_seq=0 2023-09-13T09:48:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff2f9ffb700 1 -- 172.21.15.6:0/2322770988 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55ee385e5050 con 0x55ee38743740 2023-09-13T09:48:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff2f9ffb700 10 client.17742 handle_command_reply: tid=0 2023-09-13T09:48:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 1 client.17742 shutdown 2023-09-13T09:48:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386d96b0 msgr2=0x55ee386f13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386d96b0 0x55ee386f13f0 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7ff3040960a0 tx=0x7ff304003680 comp rx=0 tx=0).stop 2023-09-13T09:48:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.216+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 shutdown_connections 2023-09-13T09:48:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee386da9d0 0x55ee386efa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ee38743740 0x55ee38745b60 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee386d96b0 0x55ee386f13f0 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 1 --2- 172.21.15.6:0/2322770988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee386da010 0x55ee386f1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 >> 172.21.15.6:0/2322770988 conn(0x55ee38637c80 msgr2=0x55ee386d3e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff2f9ffb700 0 client.17742 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 shutdown_connections 2023-09-13T09:48:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 1 -- 172.21.15.6:0/2322770988 wait complete. 2023-09-13T09:48:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff32518db80 20 client.17742 trim_cache size 0 max 16384 2023-09-13T09:48:25.240 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:48:25.240 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:48:25.241 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:48:25.241 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:48:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3000a0640 msgr2=0x7ff3000a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3000a0640 0x7ff3000a2b00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc004800 tx=0x7ff2fc01a040 comp rx=0 tx=0).stop 2023-09-13T09:48:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 msgr2=0x7ff3141958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 0x7ff3141958d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff30400e9c0 tx=0x7ff30400ecd0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 shutdown_connections 2023-09-13T09:48:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff314101850 0x7ff31419ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3140ffcc0 0x7ff3141958d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3000a0640 0x7ff3000a2b00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 --2- 172.21.15.6:0/3731787554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff314100eb0 0x7ff314195e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 >> 172.21.15.6:0/3731787554 conn(0x7ff3140fb250 msgr2=0x7ff3140fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 shutdown_connections 2023-09-13T09:48:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.217+0000 7ff318fa8700 1 -- 172.21.15.6:0/3731787554 wait complete. 2023-09-13T09:48:25.245 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:48:25.245 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:48:25.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 -- 172.21.15.6:0/2540921708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe24100e80 msgr2=0x7fbe241012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 --2- 172.21.15.6:0/2540921708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe24100e80 0x7fbe241012e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbe180099c0 tx=0x7fbe18009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 -- 172.21.15.6:0/2540921708 shutdown_connections 2023-09-13T09:48:25.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 --2- 172.21.15.6:0/2540921708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe24101820 0x7fbe241080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 --2- 172.21.15.6:0/2540921708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe240ffc90 0x7fbe241000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 --2- 172.21.15.6:0/2540921708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe24100e80 0x7fbe241012e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 -- 172.21.15.6:0/2540921708 >> 172.21.15.6:0/2540921708 conn(0x7fbe240fb220 msgr2=0x7fbe240fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 -- 172.21.15.6:0/2540921708 shutdown_connections 2023-09-13T09:48:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.380+0000 7fbe28984700 1 -- 172.21.15.6:0/2540921708 wait complete. 2023-09-13T09:48:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 Processor -- start 2023-09-13T09:48:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 -- start start 2023-09-13T09:48:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe240ffc90 0x7fbe24196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe24100e80 0x7fbe24196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe24101820 0x7fbe2419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e5c0 con 0x7fbe24101820 2023-09-13T09:48:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e700 con 0x7fbe240ffc90 2023-09-13T09:48:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe28984700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2419e890 con 0x7fbe24100e80 2023-09-13T09:48:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe22d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe24101820 0x7fbe2419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe2259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe240ffc90 0x7fbe24196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe2259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe240ffc90 0x7fbe24196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32852/0 (socket says 172.21.15.6:32852) 2023-09-13T09:48:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.381+0000 7fbe2259c700 1 -- 172.21.15.6:0/3994882139 learned_addr learned my addr 172.21.15.6:0/3994882139 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe21d9b700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe24100e80 0x7fbe24196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe22d9d700 1 -- 172.21.15.6:0/3994882139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe24100e80 msgr2=0x7fbe24196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe22d9d700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe24100e80 0x7fbe24196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe22d9d700 1 -- 172.21.15.6:0/3994882139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe240ffc90 msgr2=0x7fbe24196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe22d9d700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe240ffc90 0x7fbe24196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe22d9d700 1 -- 172.21.15.6:0/3994882139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009c40 con 0x7fbe24101820 2023-09-13T09:48:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe22d9d700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe24101820 0x7fbe2419dff0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00efb0 tx=0x7fbe1c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe137fe700 1 -- 172.21.15.6:0/3994882139 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00ca50 con 0x7fbe24101820 2023-09-13T09:48:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe180095f0 con 0x7fbe24101820 2023-09-13T09:48:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe137fe700 1 -- 172.21.15.6:0/3994882139 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbe1c00f040 con 0x7fbe24101820 2023-09-13T09:48:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe137fe700 1 -- 172.21.15.6:0/3994882139 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c004660 con 0x7fbe24101820 2023-09-13T09:48:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.382+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2419eef0 con 0x7fbe24101820 2023-09-13T09:48:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.383+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2410b4a0 con 0x7fbe24101820 2023-09-13T09:48:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.384+0000 7fbe137fe700 1 -- 172.21.15.6:0/3994882139 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbe1c0047c0 con 0x7fbe24101820 2023-09-13T09:48:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.385+0000 7fbe137fe700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe0c0a0640 0x7fbe0c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.385+0000 7fbe2259c700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe0c0a0640 0x7fbe0c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.385+0000 7fbe137fe700 1 -- 172.21.15.6:0/3994882139 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbe1c0cb930 con 0x7fbe24101820 2023-09-13T09:48:25.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.385+0000 7fbe2259c700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe0c0a0640 0x7fbe0c0a2b00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbe14005950 tx=0x7fbe14009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.389+0000 7fbe137fe700 1 -- 172.21.15.6:0/3994882139 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fbe1c0954a0 con 0x7fbe24101820 2023-09-13T09:48:25.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.651+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbe2410b660 con 0x7fbe24101820 2023-09-13T09:48:25.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.652+0000 7fbe137fe700 1 -- 172.21.15.6:0/3994882139 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fbe1c098ac0 con 0x7fbe24101820 2023-09-13T09:48:25.653 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:48:25.653 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:48:25.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe0c0a0640 msgr2=0x7fbe0c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe0c0a0640 0x7fbe0c0a2b00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fbe14005950 tx=0x7fbe14009260 comp rx=0 tx=0).stop 2023-09-13T09:48:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe24101820 msgr2=0x7fbe2419dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe24101820 0x7fbe2419dff0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c00efb0 tx=0x7fbe1c00c3a0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 shutdown_connections 2023-09-13T09:48:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbe0c0a0640 0x7fbe0c0a2b00 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe24101820 0x7fbe2419dff0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbe240ffc90 0x7fbe24196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 --2- 172.21.15.6:0/3994882139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbe24100e80 0x7fbe24196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 >> 172.21.15.6:0/3994882139 conn(0x7fbe240fb220 msgr2=0x7fbe240fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 shutdown_connections 2023-09-13T09:48:25.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.654+0000 7fbe28984700 1 -- 172.21.15.6:0/3994882139 wait complete. 2023-09-13T09:48:25.658 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:48:25.668 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:48:25.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 -- 172.21.15.6:0/1950642833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 msgr2=0x7f96e0102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 --2- 172.21.15.6:0/1950642833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0102410 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0099c0 tx=0x7f96cc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 -- 172.21.15.6:0/1950642833 shutdown_connections 2023-09-13T09:48:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 --2- 172.21.15.6:0/1950642833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e0102950 0x7f96e0109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 --2- 172.21.15.6:0/1950642833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e0100dc0 0x7f96e01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 --2- 172.21.15.6:0/1950642833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0102410 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 -- 172.21.15.6:0/1950642833 >> 172.21.15.6:0/1950642833 conn(0x7f96e00fc330 msgr2=0x7f96e00fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 -- 172.21.15.6:0/1950642833 shutdown_connections 2023-09-13T09:48:25.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 -- 172.21.15.6:0/1950642833 wait complete. 2023-09-13T09:48:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 Processor -- start 2023-09-13T09:48:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 -- start start 2023-09-13T09:48:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.799+0000 7f96e707e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e0100dc0 0x7f96e0196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e707e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e707e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e0102950 0x7f96e019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e707e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e019e590 con 0x7f96e0101fb0 2023-09-13T09:48:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e707e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e019e6d0 con 0x7f96e0100dc0 2023-09-13T09:48:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e707e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e019e860 con 0x7f96e0102950 2023-09-13T09:48:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0196f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39344/0 (socket says 172.21.15.6:39344) 2023-09-13T09:48:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 -- 172.21.15.6:0/1680976030 learned_addr learned my addr 172.21.15.6:0/1680976030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e0100dc0 0x7f96e0196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e561b700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e0102950 0x7f96e019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 -- 172.21.15.6:0/1680976030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e0102950 msgr2=0x7f96e019dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e0102950 0x7f96e019dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 -- 172.21.15.6:0/1680976030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e0100dc0 msgr2=0x7f96e0196a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e0100dc0 0x7f96e0196a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 -- 172.21.15.6:0/1680976030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0095f0 con 0x7f96e0101fb0 2023-09-13T09:48:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e561b700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e0102950 0x7f96e019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:25.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96dffff700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0196f50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009fd0 tx=0x7f96cc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96ddffb700 1 -- 172.21.15.6:0/1680976030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc01d070 con 0x7f96e0101fb0 2023-09-13T09:48:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96ddffb700 1 -- 172.21.15.6:0/1680976030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96cc005030 con 0x7f96e0101fb0 2023-09-13T09:48:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e019eae0 con 0x7f96e0101fb0 2023-09-13T09:48:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.800+0000 7f96ddffb700 1 -- 172.21.15.6:0/1680976030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc004b30 con 0x7f96e0101fb0 2023-09-13T09:48:25.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.801+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e019ef00 con 0x7f96e0101fb0 2023-09-13T09:48:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.803+0000 7f96ddffb700 1 -- 172.21.15.6:0/1680976030 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f96cc0051a0 con 0x7f96e0101fb0 2023-09-13T09:48:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.803+0000 7f96ddffb700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.803+0000 7f96ddffb700 1 -- 172.21.15.6:0/1680976030 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96cc0cca90 con 0x7f96e0101fb0 2023-09-13T09:48:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.803+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f96e0101e10 tx=0x7f96d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 Processor -- start 2023-09-13T09:48:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 -- start start 2023-09-13T09:48:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cf6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf7470 0x558551cf58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf5e10 0x558551cf6270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551c4a780 con 0x558551cf6b10 2023-09-13T09:48:25.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551c480a0 con 0x558551cf7470 2023-09-13T09:48:25.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96f3263b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551c43990 con 0x558551cf5e10 2023-09-13T09:48:25.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96e4e1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cf6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96e4e1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cf6f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39350/0 (socket says 172.21.15.6:39350) 2023-09-13T09:48:25.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96e4e1a700 1 -- 172.21.15.6:0/3584656947 learned_addr learned my addr 172.21.15.6:0/3584656947 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96dffff700 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf7470 0x558551cf58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.804+0000 7f96e561b700 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf5e10 0x558551cf6270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96e4e1a700 1 -- 172.21.15.6:0/3584656947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf5e10 msgr2=0x558551cf6270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf5e10 0x558551cf6270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96e4e1a700 1 -- 172.21.15.6:0/3584656947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf7470 msgr2=0x558551cf58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf7470 0x558551cf58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96e4e1a700 1 -- 172.21.15.6:0/3584656947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558551ac3630 con 0x558551cf6b10 2023-09-13T09:48:25.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96dffff700 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf7470 0x558551cf58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:25.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cf6f30 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f96d4011d50 tx=0x7f96d4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc164842456db8d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96caffd700 1 -- 172.21.15.6:0/3584656947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400ed20 con 0x558551cf6b10 2023-09-13T09:48:25.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96caffd700 1 -- 172.21.15.6:0/3584656947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96d4021070 con 0x558551cf6b10 2023-09-13T09:48:25.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.805+0000 7f96caffd700 1 -- 172.21.15.6:0/3584656947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d401d670 con 0x558551cf6b10 2023-09-13T09:48:25.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 -- 172.21.15.6:0/3584656947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 msgr2=0x558551cf6f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cf6f30 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f96d4011d50 tx=0x7f96d4014000 comp rx=0 tx=0).stop 2023-09-13T09:48:25.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 -- 172.21.15.6:0/3584656947 shutdown_connections 2023-09-13T09:48:25.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf5e10 0x558551cf6270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cf6f30 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3584656947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf7470 0x558551cf58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 -- 172.21.15.6:0/3584656947 >> 172.21.15.6:0/3584656947 conn(0x558551c4fc80 msgr2=0x558551cebf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 -- 172.21.15.6:0/3584656947 shutdown_connections 2023-09-13T09:48:25.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 -- 172.21.15.6:0/3584656947 wait complete. 2023-09-13T09:48:25.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 -- start start 2023-09-13T09:48:25.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.806+0000 7f96f3263b80 1 Processor -- start 2023-09-13T09:48:25.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cff340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cff880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551be1bb0 con 0x558551cf6b10 2023-09-13T09:48:25.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551be18b0 con 0x558551cf5e10 2023-09-13T09:48:25.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551ac5920 con 0x558551cf7470 2023-09-13T09:48:25.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 10 client.0 _ll_register_callbacks cb 0x558551bdf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96e4e1a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cff340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cff880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39358/0 (socket says 172.21.15.6:39358) 2023-09-13T09:48:25.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96e4e1a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cff340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32880/0 (socket says 172.21.15.6:32880) 2023-09-13T09:48:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 -- 172.21.15.6:0/1679509846 learned_addr learned my addr 172.21.15.6:0/1679509846 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96e561b700 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 -- 172.21.15.6:0/1679509846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 msgr2=0x558551d068c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d068c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 -- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 msgr2=0x558551cff340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cff340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 -- 172.21.15.6:0/1679509846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d4017070 con 0x558551cf6b10 2023-09-13T09:48:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:25.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96dffff700 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cff880 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0a1d10 tx=0x7f96cc09a260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65cab5d227ce821 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96bffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96bffff700 1 -- 172.21.15.6:0/1679509846 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0b1070 con 0x558551cf6b10 2023-09-13T09:48:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558551ce4670 con 0x558551cf6b10 2023-09-13T09:48:25.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.807+0000 7f96bffff700 1 -- 172.21.15.6:0/1679509846 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96cc09e090 con 0x558551cf6b10 2023-09-13T09:48:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96bffff700 1 -- 172.21.15.6:0/1679509846 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96cc0a2240 con 0x558551cf6b10 2023-09-13T09:48:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 10 client.17760 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558551c5b7a0 con 0x558551cf6b10 2023-09-13T09:48:25.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96bffff700 1 -- 172.21.15.6:0/1679509846 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96cc064080 con 0x558551cf6b10 2023-09-13T09:48:25.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96bffff700 1 -- 172.21.15.6:0/1679509846 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f96cc099750 con 0x558551cf6b10 2023-09-13T09:48:25.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 10 client.17760 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:25.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 10 client.17760 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:48:25.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 20 client.17760 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d0d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 4 client.17760 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558551c3c970 con 0x558551d0acb0 2023-09-13T09:48:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.808+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d0d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.809+0000 7f96bffff700 10 client.17760 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.809+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d0d0d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=bbca72656111cfa8 server_cookie=29049e11383c252 in_seq=0 out_seq=0 2023-09-13T09:48:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.809+0000 7f96bffff700 1 -- 172.21.15.6:0/1679509846 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558551c3c970 con 0x558551d0acb0 2023-09-13T09:48:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.809+0000 7f96bffff700 10 client.17760 handle_command_reply: tid=0 2023-09-13T09:48:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.809+0000 7f96f3263b80 1 client.17760 shutdown 2023-09-13T09:48:25.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 msgr2=0x558551cff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cff880 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0a1d10 tx=0x7f96cc09a260 comp rx=0 tx=0).stop 2023-09-13T09:48:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 shutdown_connections 2023-09-13T09:48:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d0d0d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96bffff700 0 client.17760 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cff340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 --2- 172.21.15.6:0/1679509846 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551cff880 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 >> 172.21.15.6:0/1679509846 conn(0x558551c4fc80 msgr2=0x558551ce67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 shutdown_connections 2023-09-13T09:48:25.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 1 -- 172.21.15.6:0/1679509846 wait complete. 2023-09-13T09:48:25.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.810+0000 7f96f3263b80 20 client.17760 trim_cache size 0 max 16384 2023-09-13T09:48:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 Processor -- start 2023-09-13T09:48:25.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 -- start start 2023-09-13T09:48:25.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cecfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551d06880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551d00530 con 0x558551cf6b10 2023-09-13T09:48:25.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551cfeeb0 con 0x558551cf5e10 2023-09-13T09:48:25.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96f3263b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551cfdab0 con 0x558551cf7470 2023-09-13T09:48:25.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551d06880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551d06880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39366/0 (socket says 172.21.15.6:39366) 2023-09-13T09:48:25.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 -- 172.21.15.6:0/3876959598 learned_addr learned my addr 172.21.15.6:0/3876959598 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96e561b700 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cecfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 -- 172.21.15.6:0/3876959598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 msgr2=0x558551d071b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d071b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 -- 172.21.15.6:0/3876959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 msgr2=0x558551cecfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cecfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 -- 172.21.15.6:0/3876959598 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558551a6fde0 con 0x558551cf6b10 2023-09-13T09:48:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96e561b700 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.824+0000 7f96dffff700 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551d06880 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00bf40 tx=0x7f96cc09a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8a874f2f4938c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96cb7fe700 1 -- 172.21.15.6:0/3876959598 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0b1070 con 0x558551cf6b10 2023-09-13T09:48:25.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96cb7fe700 1 -- 172.21.15.6:0/3876959598 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558551ce4670 con 0x558551cf6b10 2023-09-13T09:48:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96cb7fe700 1 -- 172.21.15.6:0/3876959598 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96cc0a1ff0 con 0x558551cf6b10 2023-09-13T09:48:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 -- 172.21.15.6:0/3876959598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 msgr2=0x558551d06880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551d06880 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f96cc00bf40 tx=0x7f96cc09a6f0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 -- 172.21.15.6:0/3876959598 shutdown_connections 2023-09-13T09:48:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf5e10 0x558551cecfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 --2- 172.21.15.6:0/3876959598 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf6b10 0x558551d06880 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 -- 172.21.15.6:0/3876959598 >> 172.21.15.6:0/3876959598 conn(0x558551c4fc80 msgr2=0x558551cebee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 -- 172.21.15.6:0/3876959598 shutdown_connections 2023-09-13T09:48:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.825+0000 7f96f3263b80 1 -- 172.21.15.6:0/3876959598 wait complete. 2023-09-13T09:48:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 -- start start 2023-09-13T09:48:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 Processor -- start 2023-09-13T09:48:25.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf5e10 0x558551d01e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf6b10 0x558551d023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d053d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551d05910 con 0x558551cf5e10 2023-09-13T09:48:25.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551d05a80 con 0x558551cf6b10 2023-09-13T09:48:25.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558551d05c40 con 0x558551cf7470 2023-09-13T09:48:25.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96f3263b80 10 client.0 _ll_register_callbacks cb 0x558551bdf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:25.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf5e10 0x558551d01e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf5e10 0x558551d01e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39370/0 (socket says 172.21.15.6:39370) 2023-09-13T09:48:25.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 -- 172.21.15.6:0/4020643354 learned_addr learned my addr 172.21.15.6:0/4020643354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:25.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e561b700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d053d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96dffff700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf6b10 0x558551d023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 -- 172.21.15.6:0/4020643354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 msgr2=0x558551d053d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d053d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 -- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf6b10 msgr2=0x558551d023b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:25.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf6b10 0x558551d023b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96e4e1a700 1 -- 172.21.15.6:0/4020643354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558551c5b7a0 con 0x558551cf5e10 2023-09-13T09:48:25.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.826+0000 7f96dffff700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf6b10 0x558551d023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96e4e1a700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf5e10 0x558551d01e70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f96d4011d20 tx=0x7f96d4009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4ae7c75844d310 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96bffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96bffff700 1 -- 172.21.15.6:0/4020643354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d401cc90 con 0x558551cf5e10 2023-09-13T09:48:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96bffff700 1 -- 172.21.15.6:0/4020643354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96d400eb20 con 0x558551cf5e10 2023-09-13T09:48:25.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96d4021070 con 0x558551cf5e10 2023-09-13T09:48:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96bffff700 1 -- 172.21.15.6:0/4020643354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96d400ece0 con 0x558551cf5e10 2023-09-13T09:48:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 10 client.17766 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558551a58c60 con 0x558551cf5e10 2023-09-13T09:48:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96bffff700 1 -- 172.21.15.6:0/4020643354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96d4021070 con 0x558551cf5e10 2023-09-13T09:48:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96bffff700 1 -- 172.21.15.6:0/4020643354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f96d4032050 con 0x558551cf5e10 2023-09-13T09:48:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 10 client.17766 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 10 client.17766 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:48:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 20 client.17766 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d61250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 4 client.17766 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.827+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558551bfd050 con 0x558551d0acb0 2023-09-13T09:48:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96dffff700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d61250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96bffff700 10 client.17766 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96dffff700 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d61250 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7cab63c83d9c3995 server_cookie=3d9cdd2a14857049 in_seq=0 out_seq=0 2023-09-13T09:48:25.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96bffff700 1 -- 172.21.15.6:0/4020643354 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558551bfd050 con 0x558551d0acb0 2023-09-13T09:48:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96bffff700 10 client.17766 handle_command_reply: tid=0 2023-09-13T09:48:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 client.17766 shutdown 2023-09-13T09:48:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf5e10 msgr2=0x558551d01e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf5e10 0x558551d01e70 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f96d4011d20 tx=0x7f96d4009490 comp rx=0 tx=0).stop 2023-09-13T09:48:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 shutdown_connections 2023-09-13T09:48:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558551d0acb0 0x558551d61250 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558551cf7470 0x558551d053d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96bffff700 0 client.17766 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558551cf5e10 0x558551d01e70 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 --2- 172.21.15.6:0/4020643354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558551cf6b10 0x558551d023b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 >> 172.21.15.6:0/4020643354 conn(0x558551c4fc80 msgr2=0x558551cfe020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 shutdown_connections 2023-09-13T09:48:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.828+0000 7f96f3263b80 1 -- 172.21.15.6:0/4020643354 wait complete. 2023-09-13T09:48:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96f3263b80 20 client.17766 trim_cache size 0 max 16384 2023-09-13T09:48:25.859 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:25.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 msgr2=0x7f96d00a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f96e0101e10 tx=0x7f96d4009260 comp rx=0 tx=0).stop 2023-09-13T09:48:25.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 msgr2=0x7f96e0196f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0196f50 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f96cc009fd0 tx=0x7f96cc009580 comp rx=0 tx=0).stop 2023-09-13T09:48:25.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 shutdown_connections 2023-09-13T09:48:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e0102950 0x7f96e019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e0100dc0 0x7f96e0196a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 --2- 172.21.15.6:0/1680976030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e0101fb0 0x7f96e0196f50 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 >> 172.21.15.6:0/1680976030 conn(0x7f96e00fc330 msgr2=0x7f96e00fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 shutdown_connections 2023-09-13T09:48:25.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.829+0000 7f96e707e700 1 -- 172.21.15.6:0/1680976030 wait complete. 2023-09-13T09:48:25.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:48:25.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 -- 172.21.15.6:0/4161724458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c4100eb0 msgr2=0x7f46c4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:25.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4161724458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c4100eb0 0x7f46c4101310 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f46b00099c0 tx=0x7f46b0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 -- 172.21.15.6:0/4161724458 shutdown_connections 2023-09-13T09:48:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4161724458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46c4101850 0x7f46c4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4161724458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c40ffcc0 0x7f46c41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4161724458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c4100eb0 0x7f46c4101310 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 -- 172.21.15.6:0/4161724458 >> 172.21.15.6:0/4161724458 conn(0x7f46c40fb250 msgr2=0x7f46c40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 -- 172.21.15.6:0/4161724458 shutdown_connections 2023-09-13T09:48:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.995+0000 7f46cae6c700 1 -- 172.21.15.6:0/4161724458 wait complete. 2023-09-13T09:48:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.996+0000 7f46cae6c700 1 Processor -- start 2023-09-13T09:48:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.996+0000 7f46cae6c700 1 -- start start 2023-09-13T09:48:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.996+0000 7f46cae6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c40ffcc0 0x7f46c4195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.996+0000 7f46cae6c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46c4100eb0 0x7f46c4195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46cae6c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c4101850 0x7f46c419cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46cae6c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c419d500 con 0x7f46c40ffcc0 2023-09-13T09:48:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46cae6c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c419d640 con 0x7f46c4100eb0 2023-09-13T09:48:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46cae6c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c419d7d0 con 0x7f46c4101850 2023-09-13T09:48:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c40ffcc0 0x7f46c4195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c40ffcc0 0x7f46c4195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39384/0 (socket says 172.21.15.6:39384) 2023-09-13T09:48:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 -- 172.21.15.6:0/4046621289 learned_addr learned my addr 172.21.15.6:0/4046621289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c3fff700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46c4100eb0 0x7f46c4195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c9409700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c4101850 0x7f46c419cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 -- 172.21.15.6:0/4046621289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c4101850 msgr2=0x7f46c419cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c4101850 0x7f46c419cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 -- 172.21.15.6:0/4046621289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46c4100eb0 msgr2=0x7f46c4195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46c4100eb0 0x7f46c4195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 -- 172.21.15.6:0/4046621289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46b00095f0 con 0x7f46c40ffcc0 2023-09-13T09:48:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c8c08700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c40ffcc0 0x7f46c4195980 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f46b800e970 tx=0x7f46b800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c1ffb700 1 -- 172.21.15.6:0/4046621289 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8009790 con 0x7f46c40ffcc0 2023-09-13T09:48:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c1ffb700 1 -- 172.21.15.6:0/4046621289 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46b800eec0 con 0x7f46c40ffcc0 2023-09-13T09:48:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c419dab0 con 0x7f46c40ffcc0 2023-09-13T09:48:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46c1ffb700 1 -- 172.21.15.6:0/4046621289 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8003cf0 con 0x7f46c40ffcc0 2023-09-13T09:48:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:25.997+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c419dfc0 con 0x7f46c40ffcc0 2023-09-13T09:48:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.000+0000 7f46c1ffb700 1 -- 172.21.15.6:0/4046621289 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f46b800ccd0 con 0x7f46c40ffcc0 2023-09-13T09:48:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.001+0000 7f46c1ffb700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46b40a0640 0x7f46b40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.001+0000 7f46c1ffb700 1 -- 172.21.15.6:0/4046621289 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46b8014070 con 0x7f46c40ffcc0 2023-09-13T09:48:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.001+0000 7f46c3fff700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46b40a0640 0x7f46b40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.001+0000 7f46c3fff700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46b40a0640 0x7f46b40a2b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b580 tx=0x7f46b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 Processor -- start 2023-09-13T09:48:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 -- start start 2023-09-13T09:48:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc5700 0x55eb24bc5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bc44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24b1d780 con 0x55eb24bc4a00 2023-09-13T09:48:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24b1b0a0 con 0x55eb24bc6060 2023-09-13T09:48:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46d7051b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24b16990 con 0x55eb24bc5700 2023-09-13T09:48:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bc44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc5700 0x55eb24bc5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bc44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32918/0 (socket says 172.21.15.6:32918) 2023-09-13T09:48:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c9409700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c3fff700 1 -- 172.21.15.6:0/628430703 learned_addr learned my addr 172.21.15.6:0/628430703 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c8c08700 1 -- 172.21.15.6:0/628430703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 msgr2=0x55eb24bc44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c8c08700 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bc44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c8c08700 1 -- 172.21.15.6:0/628430703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 msgr2=0x55eb24bc4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c8c08700 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c8c08700 1 -- 172.21.15.6:0/628430703 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb24996630 con 0x55eb24bc5700 2023-09-13T09:48:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.002+0000 7f46c9409700 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.003+0000 7f46c8c08700 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc5700 0x55eb24bc5b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46b8099300 tx=0x7f46b8099260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fe9701a2dd96024 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.003+0000 7f46aeffd700 1 -- 172.21.15.6:0/628430703 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8099600 con 0x55eb24bc5700 2023-09-13T09:48:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.003+0000 7f46aeffd700 1 -- 172.21.15.6:0/628430703 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46b809d430 con 0x55eb24bc5700 2023-09-13T09:48:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.003+0000 7f46aeffd700 1 -- 172.21.15.6:0/628430703 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8084320 con 0x55eb24bc5700 2023-09-13T09:48:26.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.003+0000 7f46d7051b80 1 -- 172.21.15.6:0/628430703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc5700 msgr2=0x55eb24bc5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.003+0000 7f46d7051b80 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc5700 0x55eb24bc5b20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f46b8099300 tx=0x7f46b8099260 comp rx=0 tx=0).stop 2023-09-13T09:48:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- 172.21.15.6:0/628430703 shutdown_connections 2023-09-13T09:48:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc5700 0x55eb24bc5b20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 --2- 172.21.15.6:0/628430703 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bc44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- 172.21.15.6:0/628430703 >> 172.21.15.6:0/628430703 conn(0x55eb24b22c80 msgr2=0x55eb24bbef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- 172.21.15.6:0/628430703 shutdown_connections 2023-09-13T09:48:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- 172.21.15.6:0/628430703 wait complete. 2023-09-13T09:48:26.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- start start 2023-09-13T09:48:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 Processor -- start 2023-09-13T09:48:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bcdfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd5530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24ab4bb0 con 0x55eb24bc5700 2023-09-13T09:48:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24ab48b0 con 0x55eb24bc6060 2023-09-13T09:48:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24998920 con 0x55eb24bc4a00 2023-09-13T09:48:26.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46d7051b80 10 client.0 _ll_register_callbacks cb 0x55eb24ab2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bce4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39400/0 (socket says 172.21.15.6:39400) 2023-09-13T09:48:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bcdfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.004+0000 7f46c3fff700 1 -- 172.21.15.6:0/2232394347 learned_addr learned my addr 172.21.15.6:0/2232394347 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c9409700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c3fff700 1 -- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 msgr2=0x55eb24bcdfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c3fff700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bcdfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c3fff700 1 -- 172.21.15.6:0/2232394347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 msgr2=0x55eb24bd5530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c3fff700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd5530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c3fff700 1 -- 172.21.15.6:0/2232394347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c419dfc0 con 0x55eb24bc5700 2023-09-13T09:48:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c8c08700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bcdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c9409700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46c3fff700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bce4f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f46b00058e0 tx=0x7f46b0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4f67b4390568689 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:26.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46a3fff700 1 -- 172.21.15.6:0/2232394347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0029050 con 0x55eb24bc5700 2023-09-13T09:48:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46a3fff700 1 -- 172.21.15.6:0/2232394347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46b000f660 con 0x55eb24bc5700 2023-09-13T09:48:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb24bb7670 con 0x55eb24bc5700 2023-09-13T09:48:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46a3fff700 1 -- 172.21.15.6:0/2232394347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46b0003e90 con 0x55eb24bc5700 2023-09-13T09:48:26.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46d7051b80 10 client.17778 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.005+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55eb24b2e7a0 con 0x55eb24bc5700 2023-09-13T09:48:26.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46a3fff700 1 -- 172.21.15.6:0/2232394347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46b003d020 con 0x55eb24bc5700 2023-09-13T09:48:26.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46a3fff700 1 -- 172.21.15.6:0/2232394347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46b0022820 con 0x55eb24bc5700 2023-09-13T09:48:26.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46d7051b80 10 client.17778 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46d7051b80 10 client.17778 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:48:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46d7051b80 20 client.17778 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24bdc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46d7051b80 4 client.17778 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb24b0f970 con 0x55eb24bd9e80 2023-09-13T09:48:26.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46c8c08700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24bdc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46a3fff700 10 client.17778 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.006+0000 7f46c8c08700 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24bdc2a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3c293338791f78d7 server_cookie=2055cfa4420f95df in_seq=0 out_seq=0 2023-09-13T09:48:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46a3fff700 1 -- 172.21.15.6:0/2232394347 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eb24b0f970 con 0x55eb24bd9e80 2023-09-13T09:48:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46a3fff700 10 client.17778 handle_command_reply: tid=0 2023-09-13T09:48:26.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 client.17778 shutdown 2023-09-13T09:48:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 msgr2=0x55eb24bce4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bce4f0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f46b00058e0 tx=0x7f46b0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 shutdown_connections 2023-09-13T09:48:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24bdc2a0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd5530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bcdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46a3fff700 0 client.17778 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2232394347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bce4f0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 >> 172.21.15.6:0/2232394347 conn(0x55eb24b22c80 msgr2=0x55eb24bb97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 shutdown_connections 2023-09-13T09:48:26.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 1 -- 172.21.15.6:0/2232394347 wait complete. 2023-09-13T09:48:26.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.007+0000 7f46d7051b80 20 client.17778 trim_cache size 0 max 16384 2023-09-13T09:48:26.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.020+0000 7f46d7051b80 1 Processor -- start 2023-09-13T09:48:26.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.020+0000 7f46d7051b80 1 -- start start 2023-09-13T09:48:26.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc5700 0x55eb24bd54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc6060 0x55eb24bccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46d7051b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24bcd460 con 0x55eb24bc4a00 2023-09-13T09:48:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46d7051b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24bcdb20 con 0x55eb24bc5700 2023-09-13T09:48:26.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46d7051b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24bc1000 con 0x55eb24bc6060 2023-09-13T09:48:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39406/0 (socket says 172.21.15.6:39406) 2023-09-13T09:48:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 -- 172.21.15.6:0/2786733436 learned_addr learned my addr 172.21.15.6:0/2786733436 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c3fff700 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc5700 0x55eb24bd54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c9409700 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc6060 0x55eb24bccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 -- 172.21.15.6:0/2786733436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc6060 msgr2=0x55eb24bccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc6060 0x55eb24bccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 -- 172.21.15.6:0/2786733436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc5700 msgr2=0x55eb24bd54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc5700 0x55eb24bd54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 -- 172.21.15.6:0/2786733436 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb24942de0 con 0x55eb24bc4a00 2023-09-13T09:48:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46c8c08700 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc44c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f46b8096070 tx=0x7f46b8095a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c2b2b459bd1a3e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46af7fe700 1 -- 172.21.15.6:0/2786733436 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8099600 con 0x55eb24bc4a00 2023-09-13T09:48:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46af7fe700 1 -- 172.21.15.6:0/2786733436 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46b80a1670 con 0x55eb24bc4a00 2023-09-13T09:48:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.021+0000 7f46af7fe700 1 -- 172.21.15.6:0/2786733436 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b8098af0 con 0x55eb24bc4a00 2023-09-13T09:48:26.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 -- 172.21.15.6:0/2786733436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 msgr2=0x55eb24bc44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc44c0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f46b8096070 tx=0x7f46b8095a70 comp rx=0 tx=0).stop 2023-09-13T09:48:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 -- 172.21.15.6:0/2786733436 shutdown_connections 2023-09-13T09:48:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc6060 0x55eb24bccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc4a00 0x55eb24bc44c0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 --2- 172.21.15.6:0/2786733436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc5700 0x55eb24bd54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 -- 172.21.15.6:0/2786733436 >> 172.21.15.6:0/2786733436 conn(0x55eb24b22c80 msgr2=0x55eb24bcbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 -- 172.21.15.6:0/2786733436 shutdown_connections 2023-09-13T09:48:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 -- 172.21.15.6:0/2786733436 wait complete. 2023-09-13T09:48:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 -- start start 2023-09-13T09:48:26.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.022+0000 7f46d7051b80 1 Processor -- start 2023-09-13T09:48:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bd2e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bd3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46d7051b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd4370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46d7051b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24bd48b0 con 0x55eb24bc5700 2023-09-13T09:48:26.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46d7051b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24bd4a20 con 0x55eb24bc6060 2023-09-13T09:48:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46d7051b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb24bd4be0 con 0x55eb24bc4a00 2023-09-13T09:48:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46d7051b80 10 client.0 _ll_register_callbacks cb 0x55eb24ab2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bd3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bd2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bd3360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39414/0 (socket says 172.21.15.6:39414) 2023-09-13T09:48:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c3fff700 1 -- 172.21.15.6:0/1006726306 learned_addr learned my addr 172.21.15.6:0/1006726306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bd2e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42466/0 (socket says 172.21.15.6:42466) 2023-09-13T09:48:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c9409700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 -- 172.21.15.6:0/1006726306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 msgr2=0x55eb24bd4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 -- 172.21.15.6:0/1006726306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 msgr2=0x55eb24bd3360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bd3360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 -- 172.21.15.6:0/1006726306 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb24996630 con 0x55eb24bc4a00 2023-09-13T09:48:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c3fff700 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bd3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c9409700 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46c8c08700 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bd2e20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46b8099300 tx=0x7f46b8004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ad8143614cf8182 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.023+0000 7f46a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:48:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46a3fff700 1 -- 172.21.15.6:0/1006726306 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b809d170 con 0x55eb24bc4a00 2023-09-13T09:48:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46a3fff700 1 -- 172.21.15.6:0/1006726306 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46b8098af0 con 0x55eb24bc4a00 2023-09-13T09:48:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f46b809d430 con 0x55eb24bc4a00 2023-09-13T09:48:26.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46a3fff700 1 -- 172.21.15.6:0/1006726306 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46b8099600 con 0x55eb24bc4a00 2023-09-13T09:48:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 10 client.27109 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55eb2492bc60 con 0x55eb24bc4a00 2023-09-13T09:48:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46a3fff700 1 -- 172.21.15.6:0/1006726306 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46b809d430 con 0x55eb24bc4a00 2023-09-13T09:48:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46a3fff700 1 -- 172.21.15.6:0/1006726306 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46b8098560 con 0x55eb24bc4a00 2023-09-13T09:48:26.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 10 client.27109 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 10 client.27109 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:48:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 20 client.27109 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24c30460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 4 client.27109 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55eb24ad0050 con 0x55eb24bd9e80 2023-09-13T09:48:26.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.024+0000 7f46c3fff700 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24c30460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46a3fff700 10 client.27109 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46c3fff700 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24c30460 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=dddb68c0e80a7ed9 server_cookie=37a1a0f04a145362 in_seq=0 out_seq=0 2023-09-13T09:48:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46a3fff700 1 -- 172.21.15.6:0/1006726306 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55eb24ad0050 con 0x55eb24bd9e80 2023-09-13T09:48:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46a3fff700 10 client.27109 handle_command_reply: tid=0 2023-09-13T09:48:26.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 client.27109 shutdown 2023-09-13T09:48:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 msgr2=0x55eb24bd2e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bd2e20 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f46b8099300 tx=0x7f46b8004750 comp rx=0 tx=0).stop 2023-09-13T09:48:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 shutdown_connections 2023-09-13T09:48:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55eb24bd9e80 0x55eb24c30460 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55eb24bc6060 0x55eb24bd4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46a3fff700 0 client.27109 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55eb24bc4a00 0x55eb24bd2e20 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 --2- 172.21.15.6:0/1006726306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55eb24bc5700 0x55eb24bd3360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 >> 172.21.15.6:0/1006726306 conn(0x55eb24b22c80 msgr2=0x55eb24bc8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 shutdown_connections 2023-09-13T09:48:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 1 -- 172.21.15.6:0/1006726306 wait complete. 2023-09-13T09:48:26.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.025+0000 7f46d7051b80 20 client.27109 trim_cache size 0 max 16384 2023-09-13T09:48:26.054 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46b40a0640 msgr2=0x7f46b40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46b40a0640 0x7f46b40a2b00 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f46b000b580 tx=0x7f46b0005fb0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c40ffcc0 msgr2=0x7f46c4195980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c40ffcc0 0x7f46c4195980 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f46b800e970 tx=0x7f46b800ec80 comp rx=0 tx=0).stop 2023-09-13T09:48:26.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 shutdown_connections 2023-09-13T09:48:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c4101850 0x7f46c419cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46b40a0640 0x7f46b40a2b00 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46c40ffcc0 0x7f46c4195980 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 --2- 172.21.15.6:0/4046621289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46c4100eb0 0x7f46c4195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 >> 172.21.15.6:0/4046621289 conn(0x7f46c40fb250 msgr2=0x7f46c40fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 shutdown_connections 2023-09-13T09:48:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.026+0000 7f46cae6c700 1 -- 172.21.15.6:0/4046621289 wait complete. 2023-09-13T09:48:26.058 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:48:26.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 455269 5.64 MB/sec execute 346 sec latency 34.683 ms 2023-09-13T09:48:26.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 -- 172.21.15.6:0/2737689910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881041d0 msgr2=0x7f86881065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2737689910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881041d0 0x7f86881065c0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f8684009990 tx=0x7f8684009ca0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 -- 172.21.15.6:0/2737689910 shutdown_connections 2023-09-13T09:48:26.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2737689910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688106b00 0x7f8688108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2737689910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86881018a0 0x7f8688103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2737689910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881041d0 0x7f86881065c0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 -- 172.21.15.6:0/2737689910 >> 172.21.15.6:0/2737689910 conn(0x7f86880fb250 msgr2=0x7f86880fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 -- 172.21.15.6:0/2737689910 shutdown_connections 2023-09-13T09:48:26.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.190+0000 7f868fbdc700 1 -- 172.21.15.6:0/2737689910 wait complete. 2023-09-13T09:48:26.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 Processor -- start 2023-09-13T09:48:26.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 -- start start 2023-09-13T09:48:26.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881018a0 0x7f8688196a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86881041d0 0x7f8688196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688106b00 0x7f868819dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819e590 con 0x7f86881018a0 2023-09-13T09:48:26.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819e6d0 con 0x7f8688106b00 2023-09-13T09:48:26.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868fbdc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868819e860 con 0x7f86881041d0 2023-09-13T09:48:26.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868d978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881018a0 0x7f8688196a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868d978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881018a0 0x7f8688196a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39426/0 (socket says 172.21.15.6:39426) 2023-09-13T09:48:26.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868d978700 1 -- 172.21.15.6:0/2225076173 learned_addr learned my addr 172.21.15.6:0/2225076173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868d177700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86881041d0 0x7f8688196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.191+0000 7f868e179700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688106b00 0x7f868819dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868d978700 1 -- 172.21.15.6:0/2225076173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86881041d0 msgr2=0x7f8688196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868d978700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86881041d0 0x7f8688196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868d978700 1 -- 172.21.15.6:0/2225076173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688106b00 msgr2=0x7f868819dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868d978700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688106b00 0x7f868819dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868d978700 1 -- 172.21.15.6:0/2225076173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86840095f0 con 0x7f86881018a0 2023-09-13T09:48:26.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868e179700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688106b00 0x7f868819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868d978700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881018a0 0x7f8688196a10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f867800e9a0 tx=0x7f867800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f867effd700 1 -- 172.21.15.6:0/2225076173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678009790 con 0x7f86881018a0 2023-09-13T09:48:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f867effd700 1 -- 172.21.15.6:0/2225076173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f867800cbd0 con 0x7f86881018a0 2023-09-13T09:48:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868819eb40 con 0x7f86881018a0 2023-09-13T09:48:26.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f867effd700 1 -- 172.21.15.6:0/2225076173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678018680 con 0x7f86881018a0 2023-09-13T09:48:26.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.192+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868819f050 con 0x7f86881018a0 2023-09-13T09:48:26.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.195+0000 7f867effd700 1 -- 172.21.15.6:0/2225076173 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f867800cd40 con 0x7f86881018a0 2023-09-13T09:48:26.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.195+0000 7f867effd700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86740a0640 0x7f86740a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 Processor -- start 2023-09-13T09:48:26.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d177700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86740a0640 0x7f86740a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f867effd700 1 -- 172.21.15.6:0/2225076173 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8678014070 con 0x7f86881018a0 2023-09-13T09:48:26.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 -- start start 2023-09-13T09:48:26.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c991b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9904c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c990e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c8e9780 con 0x55599c992060 2023-09-13T09:48:26.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c8e70a0 con 0x55599c990a00 2023-09-13T09:48:26.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c8e2990 con 0x55599c991700 2023-09-13T09:48:26.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d177700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86740a0640 0x7f86740a2b00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f868400b2e0 tx=0x7f8684005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c991b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868e179700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c990e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c991b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42488/0 (socket says 172.21.15.6:42488) 2023-09-13T09:48:26.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d177700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9904c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 -- 172.21.15.6:0/1521966476 learned_addr learned my addr 172.21.15.6:0/1521966476 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 -- 172.21.15.6:0/1521966476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 msgr2=0x55599c990e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c990e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 -- 172.21.15.6:0/1521966476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 msgr2=0x55599c9904c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9904c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.196+0000 7f868d978700 1 -- 172.21.15.6:0/1521966476 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55599c762630 con 0x55599c991700 2023-09-13T09:48:26.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.197+0000 7f868e179700 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c990e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.197+0000 7f868d978700 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c991b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86780a1120 tx=0x7f86780991f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9246f51098261b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.197+0000 7f8673fff700 1 -- 172.21.15.6:0/1521966476 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780995e0 con 0x55599c991700 2023-09-13T09:48:26.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.197+0000 7f8673fff700 1 -- 172.21.15.6:0/1521966476 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f867809d410 con 0x55599c991700 2023-09-13T09:48:26.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.197+0000 7f8673fff700 1 -- 172.21.15.6:0/1521966476 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780842f0 con 0x55599c991700 2023-09-13T09:48:26.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1521966476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 msgr2=0x55599c991b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c991b20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f86780a1120 tx=0x7f86780991f0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1521966476 shutdown_connections 2023-09-13T09:48:26.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c990e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c991b20 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1521966476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9904c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1521966476 >> 172.21.15.6:0/1521966476 conn(0x55599c8eec80 msgr2=0x55599c98af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1521966476 shutdown_connections 2023-09-13T09:48:26.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1521966476 wait complete. 2023-09-13T09:48:26.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 -- start start 2023-09-13T09:48:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 Processor -- start 2023-09-13T09:48:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c990a00 0x55599c999f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c99a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.198+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c880bb0 con 0x55599c992060 2023-09-13T09:48:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c8808b0 con 0x55599c991700 2023-09-13T09:48:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c764920 con 0x55599c990a00 2023-09-13T09:48:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f869bdc1b80 10 client.0 _ll_register_callbacks cb 0x55599c87e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39444/0 (socket says 172.21.15.6:39444) 2023-09-13T09:48:26.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 -- 172.21.15.6:0/1910282906 learned_addr learned my addr 172.21.15.6:0/1910282906 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868d177700 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c99a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868d978700 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c990a00 0x55599c999f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 -- 172.21.15.6:0/1910282906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c990a00 msgr2=0x55599c999f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c990a00 0x55599c999f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 -- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 msgr2=0x55599c99a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c99a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 -- 172.21.15.6:0/1910282906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868819f050 con 0x55599c992060 2023-09-13T09:48:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f868e179700 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a14a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f86800094f0 tx=0x7f8680007b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f2a3e2c80091cc2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f86717fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:26.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f86717fa700 1 -- 172.21.15.6:0/1910282906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000e070 con 0x55599c992060 2023-09-13T09:48:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f86717fa700 1 -- 172.21.15.6:0/1910282906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8680016640 con 0x55599c992060 2023-09-13T09:48:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55599c983670 con 0x55599c992060 2023-09-13T09:48:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.199+0000 7f86717fa700 1 -- 172.21.15.6:0/1910282906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8680016840 con 0x55599c992060 2023-09-13T09:48:26.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 10 client.17796 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55599c8fa7a0 con 0x55599c992060 2023-09-13T09:48:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f86717fa700 1 -- 172.21.15.6:0/1910282906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55599c983670 con 0x55599c992060 2023-09-13T09:48:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f86717fa700 1 -- 172.21.15.6:0/1910282906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f868001fb40 con 0x55599c992060 2023-09-13T09:48:26.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 10 client.17796 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 10 client.17796 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:48:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 20 client.17796 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9a5e70 0x55599c9a8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 4 client.17796 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:26.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55599c8db970 con 0x55599c9a5e70 2023-09-13T09:48:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.200+0000 7f868d978700 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9a5e70 0x55599c9a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.201+0000 7f86717fa700 10 client.17796 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.201+0000 7f868d978700 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9a5e70 0x55599c9a8290 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dfb6aa7da40f3863 server_cookie=fd0b73678161281d in_seq=0 out_seq=0 2023-09-13T09:48:26.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.201+0000 7f86717fa700 1 -- 172.21.15.6:0/1910282906 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55599c8db970 con 0x55599c9a5e70 2023-09-13T09:48:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.201+0000 7f86717fa700 10 client.17796 handle_command_reply: tid=0 2023-09-13T09:48:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.201+0000 7f869bdc1b80 1 client.17796 shutdown 2023-09-13T09:48:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.201+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 msgr2=0x55599c9a14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.201+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a14a0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f86800094f0 tx=0x7f8680007b50 comp rx=0 tx=0).stop 2023-09-13T09:48:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 shutdown_connections 2023-09-13T09:48:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9a5e70 0x55599c9a8290 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a14a0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f86717fa700 0 client.17796 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c990a00 0x55599c999f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/1910282906 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c99a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 >> 172.21.15.6:0/1910282906 conn(0x55599c8eec80 msgr2=0x55599c9857f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 shutdown_connections 2023-09-13T09:48:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 1 -- 172.21.15.6:0/1910282906 wait complete. 2023-09-13T09:48:26.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.202+0000 7f869bdc1b80 20 client.17796 trim_cache size 0 max 16384 2023-09-13T09:48:26.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 Processor -- start 2023-09-13T09:48:26.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 -- start start 2023-09-13T09:48:26.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c990a00 0x55599c9904c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c9a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c992060 0x55599c997e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c98ca10 con 0x55599c990a00 2023-09-13T09:48:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9878e0 con 0x55599c991700 2023-09-13T09:48:26.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c98b9c0 con 0x55599c992060 2023-09-13T09:48:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c990a00 0x55599c9904c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c990a00 0x55599c9904c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39448/0 (socket says 172.21.15.6:39448) 2023-09-13T09:48:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 -- 172.21.15.6:0/2444185228 learned_addr learned my addr 172.21.15.6:0/2444185228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d177700 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c9a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868e179700 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c992060 0x55599c997e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 -- 172.21.15.6:0/2444185228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c992060 msgr2=0x55599c997e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c992060 0x55599c997e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 -- 172.21.15.6:0/2444185228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 msgr2=0x55599c9a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c9a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.215+0000 7f868d978700 1 -- 172.21.15.6:0/2444185228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55599c70ede0 con 0x55599c990a00 2023-09-13T09:48:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f868d978700 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c990a00 0x55599c9904c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f867800c5b0 tx=0x7f8678099040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57f6b492abb8cc52 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f867cd82700 1 -- 172.21.15.6:0/2444185228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86780977a0 con 0x55599c990a00 2023-09-13T09:48:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f867cd82700 1 -- 172.21.15.6:0/2444185228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86780995e0 con 0x55599c990a00 2023-09-13T09:48:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f867cd82700 1 -- 172.21.15.6:0/2444185228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8678098d30 con 0x55599c990a00 2023-09-13T09:48:26.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 -- 172.21.15.6:0/2444185228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c990a00 msgr2=0x55599c9904c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c990a00 0x55599c9904c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f867800c5b0 tx=0x7f8678099040 comp rx=0 tx=0).stop 2023-09-13T09:48:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 -- 172.21.15.6:0/2444185228 shutdown_connections 2023-09-13T09:48:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c992060 0x55599c997e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c990a00 0x55599c9904c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/2444185228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c991700 0x55599c9a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 -- 172.21.15.6:0/2444185228 >> 172.21.15.6:0/2444185228 conn(0x55599c8eec80 msgr2=0x55599c998b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.216+0000 7f869bdc1b80 1 -- 172.21.15.6:0/2444185228 shutdown_connections 2023-09-13T09:48:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 -- 172.21.15.6:0/2444185228 wait complete. 2023-09-13T09:48:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 -- start start 2023-09-13T09:48:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 Processor -- start 2023-09-13T09:48:26.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c99d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c99db50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9a0db0 con 0x55599c992060 2023-09-13T09:48:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9a0f20 con 0x55599c990a00 2023-09-13T09:48:26.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55599c9a10e0 con 0x55599c991700 2023-09-13T09:48:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f869bdc1b80 10 client.0 _ll_register_callbacks cb 0x55599c87e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f868e179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f868d177700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c99db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f868e179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39458/0 (socket says 172.21.15.6:39458) 2023-09-13T09:48:26.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f868e179700 1 -- 172.21.15.6:0/4009872573 learned_addr learned my addr 172.21.15.6:0/4009872573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.217+0000 7f868d978700 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c99d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f868d177700 1 -- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 msgr2=0x55599c99d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f868d177700 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c99d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f868d177700 1 -- 172.21.15.6:0/4009872573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 msgr2=0x55599c9a0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f868d177700 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f868d177700 1 -- 172.21.15.6:0/4009872573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55599c762630 con 0x55599c991700 2023-09-13T09:48:26.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f868e179700 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f868d177700 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c99db50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8684000c00 tx=0x7f8684009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2223f3a44411ffb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f86717fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:48:26.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f86717fa700 1 -- 172.21.15.6:0/4009872573 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8684019870 con 0x55599c991700 2023-09-13T09:48:26.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f867809d410 con 0x55599c991700 2023-09-13T09:48:26.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f86717fa700 1 -- 172.21.15.6:0/4009872573 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f86840199d0 con 0x55599c991700 2023-09-13T09:48:26.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f86717fa700 1 -- 172.21.15.6:0/4009872573 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8684019b90 con 0x55599c991700 2023-09-13T09:48:26.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f869bdc1b80 10 client.27127 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55599c6f7c60 con 0x55599c991700 2023-09-13T09:48:26.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.218+0000 7f86717fa700 1 -- 172.21.15.6:0/4009872573 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f867809d410 con 0x55599c991700 2023-09-13T09:48:26.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f86717fa700 1 -- 172.21.15.6:0/4009872573 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f868403d410 con 0x55599c991700 2023-09-13T09:48:26.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f869bdc1b80 10 client.27127 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f869bdc1b80 10 client.27127 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:48:26.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f869bdc1b80 20 client.27127 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9face0 0x55599c9fd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f869bdc1b80 4 client.27127 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:26.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55599c89c050 con 0x55599c9face0 2023-09-13T09:48:26.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f868d978700 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9face0 0x55599c9fd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f86717fa700 10 client.27127 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.219+0000 7f868d978700 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9face0 0x55599c9fd100 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a944a3cd8dac3cb8 server_cookie=4200e6d40a627f95 in_seq=0 out_seq=0 2023-09-13T09:48:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f86717fa700 1 -- 172.21.15.6:0/4009872573 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55599c89c050 con 0x55599c9face0 2023-09-13T09:48:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f86717fa700 10 client.27127 handle_command_reply: tid=0 2023-09-13T09:48:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 client.27127 shutdown 2023-09-13T09:48:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 msgr2=0x55599c99db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c99db50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8684000c00 tx=0x7f8684009ca0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 shutdown_connections 2023-09-13T09:48:26.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55599c9face0 0x55599c9fd100 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f86717fa700 0 client.27127 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:26.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55599c992060 0x55599c9a0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55599c990a00 0x55599c99d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 --2- 172.21.15.6:0/4009872573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55599c991700 0x55599c99db50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 >> 172.21.15.6:0/4009872573 conn(0x55599c8eec80 msgr2=0x55599c994980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.220+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 shutdown_connections 2023-09-13T09:48:26.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f869bdc1b80 1 -- 172.21.15.6:0/4009872573 wait complete. 2023-09-13T09:48:26.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f869bdc1b80 20 client.27127 trim_cache size 0 max 16384 2023-09-13T09:48:26.251 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86740a0640 msgr2=0x7f86740a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86740a0640 0x7f86740a2b00 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f868400b2e0 tx=0x7f8684005fb0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881018a0 msgr2=0x7f8688196a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881018a0 0x7f8688196a10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f867800e9a0 tx=0x7f867800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 shutdown_connections 2023-09-13T09:48:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8688106b00 0x7f868819dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86740a0640 0x7f86740a2b00 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86881018a0 0x7f8688196a10 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 --2- 172.21.15.6:0/2225076173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86881041d0 0x7f8688196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 >> 172.21.15.6:0/2225076173 conn(0x7f86880fb250 msgr2=0x7f8688102510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 shutdown_connections 2023-09-13T09:48:26.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.221+0000 7f868fbdc700 1 -- 172.21.15.6:0/2225076173 wait complete. 2023-09-13T09:48:26.254 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:25 smithi006 ceph-mon[98665]: pgmap v567: 97 pgs: 97 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.5 MiB/s wr, 257 op/s 2023-09-13T09:48:26.255 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:25 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3994882139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:48:26.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:48:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:25 smithi053 ceph-mon[102373]: pgmap v567: 97 pgs: 97 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.5 MiB/s wr, 257 op/s 2023-09-13T09:48:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:25 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3994882139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:48:26.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:25 smithi131 ceph-mon[102785]: pgmap v567: 97 pgs: 97 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 892 KiB/s rd, 2.5 MiB/s wr, 257 op/s 2023-09-13T09:48:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:25 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3994882139' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:48:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 -- 172.21.15.6:0/1834076191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc0ffcc0 msgr2=0x7f70bc1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/1834076191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc1000e0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0099c0 tx=0x7f70ac009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 -- 172.21.15.6:0/1834076191 shutdown_connections 2023-09-13T09:48:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/1834076191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc101850 0x7f70bc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/1834076191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc1000e0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/1834076191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 0x7f70bc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 -- 172.21.15.6:0/1834076191 >> 172.21.15.6:0/1834076191 conn(0x7f70bc0fb250 msgr2=0x7f70bc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 -- 172.21.15.6:0/1834076191 shutdown_connections 2023-09-13T09:48:26.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.386+0000 7f70c1eb2700 1 -- 172.21.15.6:0/1834076191 wait complete. 2023-09-13T09:48:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.387+0000 7f70c1eb2700 1 Processor -- start 2023-09-13T09:48:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.387+0000 7f70c1eb2700 1 -- start start 2023-09-13T09:48:26.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70c1eb2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70c1eb2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 0x7f70bc195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70c1eb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc101850 0x7f70bc19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70c1eb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc19d500 con 0x7f70bc101850 2023-09-13T09:48:26.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70c1eb2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc19d640 con 0x7f70bc100eb0 2023-09-13T09:48:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70c1eb2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70bc19d7d0 con 0x7f70bc0ffcc0 2023-09-13T09:48:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc101850 0x7f70bc19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70baffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 0x7f70bc195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc101850 0x7f70bc19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39472/0 (socket says 172.21.15.6:39472) 2023-09-13T09:48:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70baffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 0x7f70bc195ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:32994/0 (socket says 172.21.15.6:32994) 2023-09-13T09:48:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc195980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42522/0 (socket says 172.21.15.6:42522) 2023-09-13T09:48:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 -- 172.21.15.6:0/3548329735 learned_addr learned my addr 172.21.15.6:0/3548329735 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 -- 172.21.15.6:0/3548329735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc0ffcc0 msgr2=0x7f70bc195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 -- 172.21.15.6:0/3548329735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 msgr2=0x7f70bc195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 0x7f70bc195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 -- 172.21.15.6:0/3548329735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac0095f0 con 0x7f70bc101850 2023-09-13T09:48:26.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70baffd700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 0x7f70bc195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.388+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc101850 0x7f70bc19cf30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f70b400ef30 tx=0x7f70b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.389+0000 7f70b8ff9700 1 -- 172.21.15.6:0/3548329735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4018070 con 0x7f70bc101850 2023-09-13T09:48:26.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.389+0000 7f70b8ff9700 1 -- 172.21.15.6:0/3548329735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70b400f040 con 0x7f70bc101850 2023-09-13T09:48:26.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.389+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70bc19da50 con 0x7f70bc101850 2023-09-13T09:48:26.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.389+0000 7f70b8ff9700 1 -- 172.21.15.6:0/3548329735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b400cd00 con 0x7f70bc101850 2023-09-13T09:48:26.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.389+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70bc19df60 con 0x7f70bc101850 2023-09-13T09:48:26.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.391+0000 7f70b8ff9700 1 -- 172.21.15.6:0/3548329735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f70b4003a00 con 0x7f70bc101850 2023-09-13T09:48:26.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.392+0000 7f70b8ff9700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70a40a0640 0x7f70a40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.392+0000 7f70b8ff9700 1 -- 172.21.15.6:0/3548329735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70b40cb710 con 0x7f70bc101850 2023-09-13T09:48:26.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.392+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70a40a0640 0x7f70a40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 Processor -- start 2023-09-13T09:48:26.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70a40a0640 0x7f70a40a2b00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009990 tx=0x7f70ac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 -- start start 2023-09-13T09:48:26.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85ce6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85ce54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85ce5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85c3e780 con 0x55ac85ce7060 2023-09-13T09:48:26.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85c3c0a0 con 0x55ac85ce5a00 2023-09-13T09:48:26.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70ce097b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85c37990 con 0x55ac85ce6700 2023-09-13T09:48:26.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85ce54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85ce54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39478/0 (socket says 172.21.15.6:39478) 2023-09-13T09:48:26.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 -- 172.21.15.6:0/633746036 learned_addr learned my addr 172.21.15.6:0/633746036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85ce6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70bbfff700 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85ce5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 -- 172.21.15.6:0/633746036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 msgr2=0x55ac85ce6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85ce6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 -- 172.21.15.6:0/633746036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 msgr2=0x55ac85ce5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85ce5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 -- 172.21.15.6:0/633746036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac85ab7630 con 0x55ac85ce7060 2023-09-13T09:48:26.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.393+0000 7f70baffd700 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85ce54c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f70b00115f0 tx=0x7f70b0011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10556a0e6e3ba4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70a1ffb700 1 -- 172.21.15.6:0/633746036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b0019630 con 0x55ac85ce7060 2023-09-13T09:48:26.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70a1ffb700 1 -- 172.21.15.6:0/633746036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70b0019c50 con 0x55ac85ce7060 2023-09-13T09:48:26.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70a1ffb700 1 -- 172.21.15.6:0/633746036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b000ebc0 con 0x55ac85ce7060 2023-09-13T09:48:26.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 -- 172.21.15.6:0/633746036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 msgr2=0x55ac85ce54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85ce54c0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f70b00115f0 tx=0x7f70b0011900 comp rx=0 tx=0).stop 2023-09-13T09:48:26.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 -- 172.21.15.6:0/633746036 shutdown_connections 2023-09-13T09:48:26.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85ce5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85ce6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 --2- 172.21.15.6:0/633746036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85ce54c0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 -- 172.21.15.6:0/633746036 >> 172.21.15.6:0/633746036 conn(0x55ac85c43c80 msgr2=0x55ac85cdff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 -- 172.21.15.6:0/633746036 shutdown_connections 2023-09-13T09:48:26.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.394+0000 7f70ce097b80 1 -- 172.21.15.6:0/633746036 wait complete. 2023-09-13T09:48:26.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.395+0000 7f70ce097b80 1 -- start start 2023-09-13T09:48:26.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.395+0000 7f70ce097b80 1 Processor -- start 2023-09-13T09:48:26.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.395+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.395+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce6700 0x55ac85cf1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.395+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce7060 0x55ac85cf8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70ce097b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85bd5bb0 con 0x55ac85ce6700 2023-09-13T09:48:26.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70ce097b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85bd58b0 con 0x55ac85ce5a00 2023-09-13T09:48:26.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce6700 0x55ac85cf1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70ce097b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85ab9920 con 0x55ac85ce7060 2023-09-13T09:48:26.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce6700 0x55ac85cf1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39484/0 (socket says 172.21.15.6:39484) 2023-09-13T09:48:26.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33006/0 (socket says 172.21.15.6:33006) 2023-09-13T09:48:26.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70baffd700 1 -- 172.21.15.6:0/1930020744 learned_addr learned my addr 172.21.15.6:0/1930020744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bbfff700 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce7060 0x55ac85cf8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70ce097b80 10 client.0 _ll_register_callbacks cb 0x55ac85bd3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bbfff700 1 -- 172.21.15.6:0/1930020744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 msgr2=0x55ac85cf1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bbfff700 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bbfff700 1 -- 172.21.15.6:0/1930020744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce6700 msgr2=0x55ac85cf1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bbfff700 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce6700 0x55ac85cf1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bbfff700 1 -- 172.21.15.6:0/1930020744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b0009dd0 con 0x55ac85ce7060 2023-09-13T09:48:26.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70baffd700 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce6700 0x55ac85cf1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70bbfff700 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce7060 0x55ac85cf8690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f70b40c9210 tx=0x7f70b4004b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=221010bd113633df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f709affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:48:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f709affd700 1 -- 172.21.15.6:0/1930020744 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4099640 con 0x55ac85ce7060 2023-09-13T09:48:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f709affd700 1 -- 172.21.15.6:0/1930020744 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70b400ce60 con 0x55ac85ce7060 2023-09-13T09:48:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac85cd8670 con 0x55ac85ce7060 2023-09-13T09:48:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.396+0000 7f709affd700 1 -- 172.21.15.6:0/1930020744 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70b4098f40 con 0x55ac85ce7060 2023-09-13T09:48:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 10 client.27139 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ac85c4f7a0 con 0x55ac85ce7060 2023-09-13T09:48:26.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f709affd700 1 -- 172.21.15.6:0/1930020744 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ac85cd8670 con 0x55ac85ce7060 2023-09-13T09:48:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f709affd700 1 -- 172.21.15.6:0/1930020744 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f70b4062070 con 0x55ac85ce7060 2023-09-13T09:48:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 10 client.27139 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 10 client.27139 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:48:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 20 client.27139 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85cfac30 0x55ac85cfd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 4 client.27139 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac85c30970 con 0x55ac85cfac30 2023-09-13T09:48:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85cfac30 0x55ac85cfd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f709affd700 10 client.27139 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:26.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.397+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85cfac30 0x55ac85cfd020 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ecd6f986f7d7fb19 server_cookie=83d70407a3395372 in_seq=0 out_seq=0 2023-09-13T09:48:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f709affd700 1 -- 172.21.15.6:0/1930020744 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ac85c30970 con 0x55ac85cfac30 2023-09-13T09:48:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f709affd700 10 client.27139 handle_command_reply: tid=0 2023-09-13T09:48:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 client.27139 shutdown 2023-09-13T09:48:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce7060 msgr2=0x55ac85cf8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce7060 0x55ac85cf8690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f70b40c9210 tx=0x7f70b4004b50 comp rx=0 tx=0).stop 2023-09-13T09:48:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 shutdown_connections 2023-09-13T09:48:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85cfac30 0x55ac85cfd020 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce7060 0x55ac85cf8690 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 --2- 172.21.15.6:0/1930020744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce6700 0x55ac85cf1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f709affd700 0 client.27139 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 >> 172.21.15.6:0/1930020744 conn(0x55ac85c43c80 msgr2=0x55ac85cda7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 shutdown_connections 2023-09-13T09:48:26.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.398+0000 7f70ce097b80 1 -- 172.21.15.6:0/1930020744 wait complete. 2023-09-13T09:48:26.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.399+0000 7f70ce097b80 20 client.27139 trim_cache size 0 max 16384 2023-09-13T09:48:26.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 Processor -- start 2023-09-13T09:48:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 -- start start 2023-09-13T09:48:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce5a00 0x55ac85ce54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce6700 0x55ac85cf8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85ce0cf0 con 0x55ac85ce7060 2023-09-13T09:48:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85ce1730 con 0x55ac85ce6700 2023-09-13T09:48:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.411+0000 7f70ce097b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85cf1df0 con 0x55ac85ce5a00 2023-09-13T09:48:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39494/0 (socket says 172.21.15.6:39494) 2023-09-13T09:48:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 -- 172.21.15.6:0/3295836007 learned_addr learned my addr 172.21.15.6:0/3295836007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70baffd700 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce6700 0x55ac85cf8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce5a00 0x55ac85ce54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 -- 172.21.15.6:0/3295836007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce5a00 msgr2=0x55ac85ce54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce5a00 0x55ac85ce54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 -- 172.21.15.6:0/3295836007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce6700 msgr2=0x55ac85cf8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce6700 0x55ac85cf8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 -- 172.21.15.6:0/3295836007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac85a63de0 con 0x55ac85ce7060 2023-09-13T09:48:26.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf1110 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f70b4095440 tx=0x7f70b4095310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eb83711656ea331 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70a27fc700 1 -- 172.21.15.6:0/3295836007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40a0cf0 con 0x55ac85ce7060 2023-09-13T09:48:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70a27fc700 1 -- 172.21.15.6:0/3295836007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70b400ce60 con 0x55ac85ce7060 2023-09-13T09:48:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.412+0000 7f70a27fc700 1 -- 172.21.15.6:0/3295836007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b40a0f20 con 0x55ac85ce7060 2023-09-13T09:48:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 -- 172.21.15.6:0/3295836007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 msgr2=0x55ac85cf1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf1110 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f70b4095440 tx=0x7f70b4095310 comp rx=0 tx=0).stop 2023-09-13T09:48:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 -- 172.21.15.6:0/3295836007 shutdown_connections 2023-09-13T09:48:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf1110 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce5a00 0x55ac85ce54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3295836007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce6700 0x55ac85cf8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 -- 172.21.15.6:0/3295836007 >> 172.21.15.6:0/3295836007 conn(0x55ac85c43c80 msgr2=0x55ac85cedbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 -- 172.21.15.6:0/3295836007 shutdown_connections 2023-09-13T09:48:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 -- 172.21.15.6:0/3295836007 wait complete. 2023-09-13T09:48:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 -- start start 2023-09-13T09:48:26.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.413+0000 7f70ce097b80 1 Processor -- start 2023-09-13T09:48:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85cf4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70ce097b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70ce097b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85cf7c90 con 0x55ac85ce7060 2023-09-13T09:48:26.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70ce097b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85cf7e00 con 0x55ac85ce5a00 2023-09-13T09:48:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70ce097b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac85cf7fc0 con 0x55ac85ce6700 2023-09-13T09:48:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70ce097b80 10 client.0 _ll_register_callbacks cb 0x55ac85bd3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70baffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85cf4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33020/0 (socket says 172.21.15.6:33020) 2023-09-13T09:48:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bb7fe700 1 -- 172.21.15.6:0/3515746322 learned_addr learned my addr 172.21.15.6:0/3515746322 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bbfff700 1 -- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 msgr2=0x55ac85cf4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85cf4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bbfff700 1 -- 172.21.15.6:0/3515746322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 msgr2=0x55ac85cf41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bbfff700 1 -- 172.21.15.6:0/3515746322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac85c4f7a0 con 0x55ac85ce7060 2023-09-13T09:48:26.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70baffd700 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85cf4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f70bbfff700 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf7750 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f70b40c9530 tx=0x7f70b40974f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfb6f50caa76f74 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.414+0000 7f709affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f709affd700 1 -- 172.21.15.6:0/3515746322 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70b4099640 con 0x55ac85ce7060 2023-09-13T09:48:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f709affd700 1 -- 172.21.15.6:0/3515746322 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70b40a0f20 con 0x55ac85ce7060 2023-09-13T09:48:26.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f70b0019c50 con 0x55ac85ce7060 2023-09-13T09:48:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f709affd700 1 -- 172.21.15.6:0/3515746322 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70b4093b50 con 0x55ac85ce7060 2023-09-13T09:48:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 10 client.17820 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ac85a4cc60 con 0x55ac85ce7060 2023-09-13T09:48:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f709affd700 1 -- 172.21.15.6:0/3515746322 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f70b0019c50 con 0x55ac85ce7060 2023-09-13T09:48:26.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f709affd700 1 -- 172.21.15.6:0/3515746322 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f70b4062070 con 0x55ac85ce7060 2023-09-13T09:48:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 10 client.17820 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 10 client.17820 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:48:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 20 client.17820 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85d4f360 0x55ac85d51750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 4 client.17820 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ac85bf1050 con 0x55ac85d4f360 2023-09-13T09:48:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.415+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85d4f360 0x55ac85d51750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f709affd700 10 client.17820 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:26.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70bb7fe700 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85d4f360 0x55ac85d51750 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39b503e84f572eb server_cookie=1f6c5a0e0767d594 in_seq=0 out_seq=0 2023-09-13T09:48:26.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f709affd700 1 -- 172.21.15.6:0/3515746322 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ac85bf1050 con 0x55ac85d4f360 2023-09-13T09:48:26.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f709affd700 10 client.17820 handle_command_reply: tid=0 2023-09-13T09:48:26.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 client.17820 shutdown 2023-09-13T09:48:26.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 msgr2=0x55ac85cf7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf7750 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f70b40c9530 tx=0x7f70b40974f0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 shutdown_connections 2023-09-13T09:48:26.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55ac85d4f360 0x55ac85d51750 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ac85ce7060 0x55ac85cf7750 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ac85ce5a00 0x55ac85cf41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f709affd700 0 client.17820 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 --2- 172.21.15.6:0/3515746322 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ac85ce6700 0x55ac85cf4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 >> 172.21.15.6:0/3515746322 conn(0x55ac85c43c80 msgr2=0x55ac85ce98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 shutdown_connections 2023-09-13T09:48:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.416+0000 7f70ce097b80 1 -- 172.21.15.6:0/3515746322 wait complete. 2023-09-13T09:48:26.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70ce097b80 20 client.17820 trim_cache size 0 max 16384 2023-09-13T09:48:26.462 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70a40a0640 msgr2=0x7f70a40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70a40a0640 0x7f70a40a2b00 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009990 tx=0x7f70ac01a040 comp rx=0 tx=0).stop 2023-09-13T09:48:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc101850 msgr2=0x7f70bc19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc101850 0x7f70bc19cf30 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f70b400ef30 tx=0x7f70b400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 shutdown_connections 2023-09-13T09:48:26.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70a40a0640 0x7f70a40a2b00 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70bc101850 0x7f70bc19cf30 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70bc0ffcc0 0x7f70bc195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 --2- 172.21.15.6:0/3548329735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70bc100eb0 0x7f70bc195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 >> 172.21.15.6:0/3548329735 conn(0x7f70bc0fb250 msgr2=0x7f70bc0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 shutdown_connections 2023-09-13T09:48:26.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.417+0000 7f70c1eb2700 1 -- 172.21.15.6:0/3548329735 wait complete. 2023-09-13T09:48:26.467 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:48:26.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 -- 172.21.15.6:0/452413978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 msgr2=0x7f320c108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 --2- 172.21.15.6:0/452413978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c108120 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f320400b0a0 tx=0x7f320400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 -- 172.21.15.6:0/452413978 shutdown_connections 2023-09-13T09:48:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 --2- 172.21.15.6:0/452413978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c108120 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 --2- 172.21.15.6:0/452413978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320c101270 0x7f320c101690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 --2- 172.21.15.6:0/452413978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f320c0ffec0 0x7f320c100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 -- 172.21.15.6:0/452413978 >> 172.21.15.6:0/452413978 conn(0x7f320c0fa9b0 msgr2=0x7f320c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 -- 172.21.15.6:0/452413978 shutdown_connections 2023-09-13T09:48:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.597+0000 7f3213088700 1 -- 172.21.15.6:0/452413978 wait complete. 2023-09-13T09:48:26.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 Processor -- start 2023-09-13T09:48:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 -- start start 2023-09-13T09:48:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320c0ffec0 0x7f320c198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f320c101270 0x7f320c1a0370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c1a0940 con 0x7f320c100880 2023-09-13T09:48:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c1a0a80 con 0x7f320c0ffec0 2023-09-13T09:48:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3213088700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f320c1a0c10 con 0x7f320c101270 2023-09-13T09:48:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39510/0 (socket says 172.21.15.6:39510) 2023-09-13T09:48:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 -- 172.21.15.6:0/2316264578 learned_addr learned my addr 172.21.15.6:0/2316264578 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3210e24700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320c0ffec0 0x7f320c198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3211625700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f320c101270 0x7f320c1a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 -- 172.21.15.6:0/2316264578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f320c101270 msgr2=0x7f320c1a0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f320c101270 0x7f320c1a0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 -- 172.21.15.6:0/2316264578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320c0ffec0 msgr2=0x7f320c198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320c0ffec0 0x7f320c198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 -- 172.21.15.6:0/2316264578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204009d00 con 0x7f320c100880 2023-09-13T09:48:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f320bfff700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c199300 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f31f800e9a0 tx=0x7f31f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.598+0000 7f3209ffb700 1 -- 172.21.15.6:0/2316264578 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8009790 con 0x7f320c100880 2023-09-13T09:48:26.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.599+0000 7f3209ffb700 1 -- 172.21.15.6:0/2316264578 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31f8010430 con 0x7f320c100880 2023-09-13T09:48:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.599+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f320c1a0ef0 con 0x7f320c100880 2023-09-13T09:48:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.599+0000 7f3209ffb700 1 -- 172.21.15.6:0/2316264578 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8018680 con 0x7f320c100880 2023-09-13T09:48:26.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.599+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c1a13c0 con 0x7f320c100880 2023-09-13T09:48:26.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.601+0000 7f3209ffb700 1 -- 172.21.15.6:0/2316264578 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f31f80105a0 con 0x7f320c100880 2023-09-13T09:48:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.601+0000 7f3209ffb700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31fc0a06c0 0x7f31fc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.602+0000 7f3209ffb700 1 -- 172.21.15.6:0/2316264578 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31f8014070 con 0x7f320c100880 2023-09-13T09:48:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.602+0000 7f3210e24700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31fc0a06c0 0x7f31fc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.602+0000 7f3210e24700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31fc0a06c0 0x7f31fc0a2b80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3200009c60 tx=0x7f3200009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.602+0000 7f321f26db80 1 Processor -- start 2023-09-13T09:48:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f321f26db80 1 -- start start 2023-09-13T09:48:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f321f26db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c38b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f321f26db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c39060 0x557bd2c374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f321f26db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c37e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f321f26db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2b90780 con 0x557bd2c37a00 2023-09-13T09:48:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f321f26db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2b8e0a0 con 0x557bd2c38700 2023-09-13T09:48:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f321f26db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2b89990 con 0x557bd2c39060 2023-09-13T09:48:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c37e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c37e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39520/0 (socket says 172.21.15.6:39520) 2023-09-13T09:48:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 -- 172.21.15.6:0/1762018008 learned_addr learned my addr 172.21.15.6:0/1762018008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3210e24700 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c38b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f320bfff700 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c39060 0x557bd2c374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 -- 172.21.15.6:0/1762018008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c39060 msgr2=0x557bd2c374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c39060 0x557bd2c374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 -- 172.21.15.6:0/1762018008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 msgr2=0x557bd2c38b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c38b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 -- 172.21.15.6:0/1762018008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd2a09630 con 0x557bd2c37a00 2023-09-13T09:48:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3210e24700 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c38b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:26.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f3211625700 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c37e80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f32040079f0 tx=0x7f3204009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d650f220df504cdd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.603+0000 7f31f6ffd700 1 -- 172.21.15.6:0/1762018008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400e040 con 0x557bd2c37a00 2023-09-13T09:48:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f31f6ffd700 1 -- 172.21.15.6:0/1762018008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32040094a0 con 0x557bd2c37a00 2023-09-13T09:48:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f31f6ffd700 1 -- 172.21.15.6:0/1762018008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204003c60 con 0x557bd2c37a00 2023-09-13T09:48:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 -- 172.21.15.6:0/1762018008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 msgr2=0x557bd2c37e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c37e80 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f32040079f0 tx=0x7f3204009c60 comp rx=0 tx=0).stop 2023-09-13T09:48:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 -- 172.21.15.6:0/1762018008 shutdown_connections 2023-09-13T09:48:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c37e80 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c38b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 --2- 172.21.15.6:0/1762018008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c39060 0x557bd2c374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 -- 172.21.15.6:0/1762018008 >> 172.21.15.6:0/1762018008 conn(0x557bd2b95c80 msgr2=0x557bd2c31f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 -- 172.21.15.6:0/1762018008 shutdown_connections 2023-09-13T09:48:26.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.604+0000 7f321f26db80 1 -- 172.21.15.6:0/1762018008 wait complete. 2023-09-13T09:48:26.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 -- start start 2023-09-13T09:48:26.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 Processor -- start 2023-09-13T09:48:26.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c40ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c413e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c48420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2b27bb0 con 0x557bd2c39060 2023-09-13T09:48:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2b278b0 con 0x557bd2c38700 2023-09-13T09:48:26.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2a0b920 con 0x557bd2c37a00 2023-09-13T09:48:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f321f26db80 10 client.0 _ll_register_callbacks cb 0x557bd2b25680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f3211625700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c48420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f3211625700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c48420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39526/0 (socket says 172.21.15.6:39526) 2023-09-13T09:48:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f3211625700 1 -- 172.21.15.6:0/246227691 learned_addr learned my addr 172.21.15.6:0/246227691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f3210e24700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c40ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.605+0000 7f320bfff700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c413e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f3211625700 1 -- 172.21.15.6:0/246227691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 msgr2=0x557bd2c40ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f3211625700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c40ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f3211625700 1 -- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 msgr2=0x557bd2c413e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f3211625700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c413e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f3211625700 1 -- 172.21.15.6:0/246227691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c108a50 con 0x557bd2c39060 2023-09-13T09:48:26.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f320bfff700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f3211625700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c48420 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f320400b3f0 tx=0x7f320400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6142b8c1c1d61871 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f31ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:26.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f31ebfff700 1 -- 172.21.15.6:0/246227691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400e040 con 0x557bd2c39060 2023-09-13T09:48:26.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557bd2c2a670 con 0x557bd2c39060 2023-09-13T09:48:26.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f31ebfff700 1 -- 172.21.15.6:0/246227691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3204003c10 con 0x557bd2c39060 2023-09-13T09:48:26.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f31ebfff700 1 -- 172.21.15.6:0/246227691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3204003dd0 con 0x557bd2c39060 2023-09-13T09:48:26.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f321f26db80 10 client.17832 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557bd2ba17a0 con 0x557bd2c39060 2023-09-13T09:48:26.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.606+0000 7f31ebfff700 1 -- 172.21.15.6:0/246227691 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557bd2c2a670 con 0x557bd2c39060 2023-09-13T09:48:26.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f31ebfff700 1 -- 172.21.15.6:0/246227691 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3204019070 con 0x557bd2c39060 2023-09-13T09:48:26.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f321f26db80 10 client.17832 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f321f26db80 10 client.17832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:26.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f321f26db80 20 client.17832 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f321f26db80 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2c4c950 0x557bd2c4ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f321f26db80 4 client.17832 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:26.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557bd2b82970 con 0x557bd2c4c950 2023-09-13T09:48:26.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f3210e24700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2c4c950 0x557bd2c4ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f3210e24700 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2c4c950 0x557bd2c4ed70 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6db31bdc5d099c02 server_cookie=12a039425f9de97b in_seq=0 out_seq=0 2023-09-13T09:48:26.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.607+0000 7f31ebfff700 10 client.17832 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:26.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f31ebfff700 1 -- 172.21.15.6:0/246227691 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557bd2b82970 con 0x557bd2c4c950 2023-09-13T09:48:26.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f31ebfff700 10 client.17832 handle_command_reply: tid=0 2023-09-13T09:48:26.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 client.17832 shutdown 2023-09-13T09:48:26.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 msgr2=0x557bd2c48420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c48420 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f320400b3f0 tx=0x7f320400bc80 comp rx=0 tx=0).stop 2023-09-13T09:48:26.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 shutdown_connections 2023-09-13T09:48:26.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2c4c950 0x557bd2c4ed70 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c48420 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c40ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 --2- 172.21.15.6:0/246227691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c413e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f31ebfff700 0 client.17832 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:26.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 >> 172.21.15.6:0/246227691 conn(0x557bd2b95c80 msgr2=0x557bd2c31ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 shutdown_connections 2023-09-13T09:48:26.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 1 -- 172.21.15.6:0/246227691 wait complete. 2023-09-13T09:48:26.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.608+0000 7f321f26db80 20 client.17832 trim_cache size 0 max 16384 2023-09-13T09:48:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 Processor -- start 2023-09-13T09:48:26.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 -- start start 2023-09-13T09:48:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c374c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c38700 0x557bd2c483e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c39060 0x557bd2c40550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2c33770 con 0x557bd2c37a00 2023-09-13T09:48:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2c3eb30 con 0x557bd2c39060 2023-09-13T09:48:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f321f26db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2c3f610 con 0x557bd2c38700 2023-09-13T09:48:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f3210e24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c374c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f320bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c38700 0x557bd2c483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f3210e24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c374c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39530/0 (socket says 172.21.15.6:39530) 2023-09-13T09:48:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f3210e24700 1 -- 172.21.15.6:0/28706442 learned_addr learned my addr 172.21.15.6:0/28706442 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f320bfff700 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c38700 0x557bd2c483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42586/0 (socket says 172.21.15.6:42586) 2023-09-13T09:48:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f3211625700 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c39060 0x557bd2c40550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f320bfff700 1 -- 172.21.15.6:0/28706442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c39060 msgr2=0x557bd2c40550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f320bfff700 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c39060 0x557bd2c40550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f320bfff700 1 -- 172.21.15.6:0/28706442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 msgr2=0x557bd2c374c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f320bfff700 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c374c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.622+0000 7f320bfff700 1 -- 172.21.15.6:0/28706442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557bd29b5de0 con 0x557bd2c38700 2023-09-13T09:48:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f320bfff700 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c38700 0x557bd2c483e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f80c97e0 tx=0x7f31f801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cd3495c539fe63c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f31f77fe700 1 -- 172.21.15.6:0/28706442 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8098e30 con 0x557bd2c38700 2023-09-13T09:48:26.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f31f77fe700 1 -- 172.21.15.6:0/28706442 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f31f8099bd0 con 0x557bd2c38700 2023-09-13T09:48:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f31f77fe700 1 -- 172.21.15.6:0/28706442 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31f8010880 con 0x557bd2c38700 2023-09-13T09:48:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f321f26db80 1 -- 172.21.15.6:0/28706442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c38700 msgr2=0x557bd2c483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f321f26db80 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c38700 0x557bd2c483e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f31f80c97e0 tx=0x7f31f801a040 comp rx=0 tx=0).stop 2023-09-13T09:48:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f321f26db80 1 -- 172.21.15.6:0/28706442 shutdown_connections 2023-09-13T09:48:26.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f321f26db80 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c39060 0x557bd2c40550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f321f26db80 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c37a00 0x557bd2c374c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f321f26db80 1 --2- 172.21.15.6:0/28706442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c38700 0x557bd2c483e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.623+0000 7f321f26db80 1 -- 172.21.15.6:0/28706442 >> 172.21.15.6:0/28706442 conn(0x557bd2b95c80 msgr2=0x557bd2c3fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.624+0000 7f321f26db80 1 -- 172.21.15.6:0/28706442 shutdown_connections 2023-09-13T09:48:26.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.624+0000 7f321f26db80 1 -- 172.21.15.6:0/28706442 wait complete. 2023-09-13T09:48:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.624+0000 7f321f26db80 1 -- start start 2023-09-13T09:48:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.624+0000 7f321f26db80 1 Processor -- start 2023-09-13T09:48:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.624+0000 7f321f26db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c43de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.624+0000 7f321f26db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c44320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.624+0000 7f321f26db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c47340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f321f26db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2c47880 con 0x557bd2c39060 2023-09-13T09:48:26.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f321f26db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2c479f0 con 0x557bd2c38700 2023-09-13T09:48:26.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f321f26db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557bd2c47bb0 con 0x557bd2c37a00 2023-09-13T09:48:26.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c43de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c43de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42590/0 (socket says 172.21.15.6:42590) 2023-09-13T09:48:26.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 -- 172.21.15.6:0/1670760587 learned_addr learned my addr 172.21.15.6:0/1670760587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:26.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f321f26db80 10 client.0 _ll_register_callbacks cb 0x557bd2b25680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:26.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f320bfff700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c44320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3211625700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c47340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 -- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 msgr2=0x557bd2c44320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c44320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 -- 172.21.15.6:0/1670760587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 msgr2=0x557bd2c47340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:26.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c47340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 -- 172.21.15.6:0/1670760587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c1a13c0 con 0x557bd2c37a00 2023-09-13T09:48:26.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f320bfff700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c44320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3211625700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c47340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:26.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f3210e24700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c43de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x557bd2c4f650 tx=0x7f32000047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12ffd9f66a7efd4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:26.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f31ebfff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:48:26.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f31ebfff700 1 -- 172.21.15.6:0/1670760587 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3200023040 con 0x557bd2c37a00 2023-09-13T09:48:26.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32040094a0 con 0x557bd2c37a00 2023-09-13T09:48:26.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.625+0000 7f31ebfff700 1 -- 172.21.15.6:0/1670760587 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3200003c60 con 0x557bd2c37a00 2023-09-13T09:48:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f31ebfff700 1 -- 172.21.15.6:0/1670760587 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32000045a0 con 0x557bd2c37a00 2023-09-13T09:48:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 10 client.27163 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557bd299ec60 con 0x557bd2c37a00 2023-09-13T09:48:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f31ebfff700 1 -- 172.21.15.6:0/1670760587 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32040094a0 con 0x557bd2c37a00 2023-09-13T09:48:26.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f31ebfff700 1 -- 172.21.15.6:0/1670760587 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f320003b840 con 0x557bd2c37a00 2023-09-13T09:48:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 10 client.27163 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 10 client.27163 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 20 client.27163 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2ca1450 0x557bd2ca3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:26.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 4 client.27163 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557bd2b43050 con 0x557bd2ca1450 2023-09-13T09:48:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.626+0000 7f320bfff700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2ca1450 0x557bd2ca3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f320bfff700 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2ca1450 0x557bd2ca3870 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88a2d5a45267051a server_cookie=8d4172f152bf2abf in_seq=0 out_seq=0 2023-09-13T09:48:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f31ebfff700 10 client.27163 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:26.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f31ebfff700 1 -- 172.21.15.6:0/1670760587 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557bd2b43050 con 0x557bd2ca1450 2023-09-13T09:48:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f31ebfff700 10 client.27163 handle_command_reply: tid=0 2023-09-13T09:48:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 client.27163 shutdown 2023-09-13T09:48:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 msgr2=0x557bd2c43de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c43de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x557bd2c4f650 tx=0x7f32000047c0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 shutdown_connections 2023-09-13T09:48:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557bd2ca1450 0x557bd2ca3870 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557bd2c39060 0x557bd2c47340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f31ebfff700 0 client.27163 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557bd2c37a00 0x557bd2c43de0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 --2- 172.21.15.6:0/1670760587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557bd2c38700 0x557bd2c44320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 >> 172.21.15.6:0/1670760587 conn(0x557bd2b95c80 msgr2=0x557bd2c31e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 shutdown_connections 2023-09-13T09:48:26.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 1 -- 172.21.15.6:0/1670760587 wait complete. 2023-09-13T09:48:26.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.627+0000 7f321f26db80 20 client.27163 trim_cache size 0 max 16384 2023-09-13T09:48:26.654 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31fc0a06c0 msgr2=0x7f31fc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31fc0a06c0 0x7f31fc0a2b80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f3200009c60 tx=0x7f3200009260 comp rx=0 tx=0).stop 2023-09-13T09:48:26.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 msgr2=0x7f320c199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c199300 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f31f800e9a0 tx=0x7f31f800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 shutdown_connections 2023-09-13T09:48:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f320c101270 0x7f320c1a0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f320c0ffec0 0x7f320c198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31fc0a06c0 0x7f31fc0a2b80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 --2- 172.21.15.6:0/2316264578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f320c100880 0x7f320c199300 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 >> 172.21.15.6:0/2316264578 conn(0x7f320c0fa9b0 msgr2=0x7f320c0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 shutdown_connections 2023-09-13T09:48:26.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:26.628+0000 7f3213088700 1 -- 172.21.15.6:0/2316264578 wait complete. 2023-09-13T09:48:27.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 457409 5.66 MB/sec execute 347 sec latency 36.914 ms 2023-09-13T09:48:27.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:26 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:48:27.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:26 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:48:27.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:26 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:48:27.659 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:48:27.660 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:48:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 -- 172.21.15.6:0/1763709179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec104170 msgr2=0x7f51ec106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 --2- 172.21.15.6:0/1763709179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec104170 0x7f51ec106560 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009990 tx=0x7f51dc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 -- 172.21.15.6:0/1763709179 shutdown_connections 2023-09-13T09:48:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 --2- 172.21.15.6:0/1763709179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec106aa0 0x7f51ec108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 --2- 172.21.15.6:0/1763709179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec101840 0x7f51ec103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 --2- 172.21.15.6:0/1763709179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec104170 0x7f51ec106560 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 -- 172.21.15.6:0/1763709179 >> 172.21.15.6:0/1763709179 conn(0x7f51ec0fb250 msgr2=0x7f51ec0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 -- 172.21.15.6:0/1763709179 shutdown_connections 2023-09-13T09:48:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.795+0000 7f51f1444700 1 -- 172.21.15.6:0/1763709179 wait complete. 2023-09-13T09:48:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 Processor -- start 2023-09-13T09:48:27.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 -- start start 2023-09-13T09:48:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec101840 0x7f51ec196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec104170 0x7f51ec196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec106aa0 0x7f51ec19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec19e5c0 con 0x7f51ec101840 2023-09-13T09:48:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec19e700 con 0x7f51ec106aa0 2023-09-13T09:48:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51f1444700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec19e890 con 0x7f51ec104170 2023-09-13T09:48:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec101840 0x7f51ec196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51eaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec101840 0x7f51ec196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39550/0 (socket says 172.21.15.6:39550) 2023-09-13T09:48:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51eaffd700 1 -- 172.21.15.6:0/3364339553 learned_addr learned my addr 172.21.15.6:0/3364339553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec104170 0x7f51ec196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.796+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec106aa0 0x7f51ec19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51eaffd700 1 -- 172.21.15.6:0/3364339553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec104170 msgr2=0x7f51ec196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51eaffd700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec104170 0x7f51ec196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51eaffd700 1 -- 172.21.15.6:0/3364339553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec106aa0 msgr2=0x7f51ec19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51eaffd700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec106aa0 0x7f51ec19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51eaffd700 1 -- 172.21.15.6:0/3364339553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc0095f0 con 0x7f51ec101840 2023-09-13T09:48:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec104170 0x7f51ec196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:27.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec106aa0 0x7f51ec19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51eaffd700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec101840 0x7f51ec196a40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f51e000e9a0 tx=0x7f51e000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51d3fff700 1 -- 172.21.15.6:0/3364339553 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0009790 con 0x7f51ec101840 2023-09-13T09:48:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec0ff690 con 0x7f51ec101840 2023-09-13T09:48:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51d3fff700 1 -- 172.21.15.6:0/3364339553 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51e0010430 con 0x7f51ec101840 2023-09-13T09:48:27.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.797+0000 7f51d3fff700 1 -- 172.21.15.6:0/3364339553 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e0018680 con 0x7f51ec101840 2023-09-13T09:48:27.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.798+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec0ffbf0 con 0x7f51ec101840 2023-09-13T09:48:27.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.799+0000 7f51d3fff700 1 -- 172.21.15.6:0/3364339553 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f51e00105a0 con 0x7f51ec101840 2023-09-13T09:48:27.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.800+0000 7f51d3fff700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51d40a0640 0x7f51d40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.800+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51d40a0640 0x7f51d40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.800+0000 7f51d3fff700 1 -- 172.21.15.6:0/3364339553 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f51e0014070 con 0x7f51ec101840 2023-09-13T09:48:27.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.800+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51d40a0640 0x7f51d40a2b00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00b2e0 tx=0x7f51dc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:27.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.801+0000 7f51fd629b80 1 Processor -- start 2023-09-13T09:48:27.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.801+0000 7f51fd629b80 1 -- start start 2023-09-13T09:48:27.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae58cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae58b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae58bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51fd629b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae4e4800 con 0x559fae58ba80 2023-09-13T09:48:27.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51fd629b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae4e2120 con 0x559fae58c780 2023-09-13T09:48:27.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51fd629b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae4dda10 con 0x559fae58d0e0 2023-09-13T09:48:27.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae58cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae58bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51ea7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae58b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae58bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39562/0 (socket says 172.21.15.6:39562) 2023-09-13T09:48:27.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae58cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33082/0 (socket says 172.21.15.6:33082) 2023-09-13T09:48:27.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 -- 172.21.15.6:0/262712531 learned_addr learned my addr 172.21.15.6:0/262712531 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:27.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 -- 172.21.15.6:0/262712531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 msgr2=0x559fae58b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae58b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 -- 172.21.15.6:0/262712531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 msgr2=0x559fae58cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae58cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 -- 172.21.15.6:0/262712531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fae35d6b0 con 0x559fae58ba80 2023-09-13T09:48:27.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae58b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae58bf00 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f51e4003eb0 tx=0x7f51e4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d27ee98bca45752 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.802+0000 7f51d17fa700 1 -- 172.21.15.6:0/262712531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e40092d0 con 0x559fae58ba80 2023-09-13T09:48:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51d17fa700 1 -- 172.21.15.6:0/262712531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51e400f040 con 0x559fae58ba80 2023-09-13T09:48:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51d17fa700 1 -- 172.21.15.6:0/262712531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400e8b0 con 0x559fae58ba80 2023-09-13T09:48:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 -- 172.21.15.6:0/262712531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 msgr2=0x559fae58bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae58bf00 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f51e4003eb0 tx=0x7f51e4009920 comp rx=0 tx=0).stop 2023-09-13T09:48:27.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 -- 172.21.15.6:0/262712531 shutdown_connections 2023-09-13T09:48:27.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae58bf00 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae58cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 --2- 172.21.15.6:0/262712531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae58b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 -- 172.21.15.6:0/262712531 >> 172.21.15.6:0/262712531 conn(0x559fae4e9d00 msgr2=0x559fae585f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 -- 172.21.15.6:0/262712531 shutdown_connections 2023-09-13T09:48:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.803+0000 7f51fd629b80 1 -- 172.21.15.6:0/262712531 wait complete. 2023-09-13T09:48:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 -- start start 2023-09-13T09:48:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 Processor -- start 2023-09-13T09:48:27.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58ba80 0x559fae594f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae595480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae59c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae47bc30 con 0x559fae58c780 2023-09-13T09:48:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae47b930 con 0x559fae58ba80 2023-09-13T09:48:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae35f9a0 con 0x559fae58d0e0 2023-09-13T09:48:27.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51fd629b80 10 client.0 _ll_register_callbacks cb 0x559fae479700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae595480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae595480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39566/0 (socket says 172.21.15.6:39566) 2023-09-13T09:48:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51ea7fc700 1 -- 172.21.15.6:0/4027224058 learned_addr learned my addr 172.21.15.6:0/4027224058 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51eaffd700 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58ba80 0x559fae594f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.804+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae59c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ea7fc700 1 -- 172.21.15.6:0/4027224058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 msgr2=0x559fae59c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae59c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ea7fc700 1 -- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58ba80 msgr2=0x559fae594f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58ba80 0x559fae594f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ea7fc700 1 -- 172.21.15.6:0/4027224058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4003b90 con 0x559fae58c780 2023-09-13T09:48:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae595480 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00fb90 tx=0x7f51dc01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e9b940875d4b3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ceff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ceff5700 1 -- 172.21.15.6:0/4027224058 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc02b050 con 0x559fae58c780 2023-09-13T09:48:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ceff5700 1 -- 172.21.15.6:0/4027224058 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f51dc026a40 con 0x559fae58c780 2023-09-13T09:48:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559fae57e6f0 con 0x559fae58c780 2023-09-13T09:48:27.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ceff5700 1 -- 172.21.15.6:0/4027224058 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51dc00fea0 con 0x559fae58c780 2023-09-13T09:48:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51fd629b80 10 client.17850 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559fae4f5820 con 0x559fae58c780 2023-09-13T09:48:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.805+0000 7f51ceff5700 1 -- 172.21.15.6:0/4027224058 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51dc03f020 con 0x559fae58c780 2023-09-13T09:48:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51ceff5700 1 -- 172.21.15.6:0/4027224058 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f51dc024bd0 con 0x559fae58c780 2023-09-13T09:48:27.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51fd629b80 10 client.17850 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51fd629b80 10 client.17850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51fd629b80 20 client.17850 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51fd629b80 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae5a0d60 0x559fae5a3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51fd629b80 4 client.17850 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559fae4d69f0 con 0x559fae5a0d60 2023-09-13T09:48:27.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51eaffd700 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae5a0d60 0x559fae5a3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51ceff5700 10 client.17850 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.806+0000 7f51eaffd700 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae5a0d60 0x559fae5a3180 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a99678f48566cf52 server_cookie=2d95d635d9ee3fab in_seq=0 out_seq=0 2023-09-13T09:48:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51ceff5700 1 -- 172.21.15.6:0/4027224058 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559fae4d69f0 con 0x559fae5a0d60 2023-09-13T09:48:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51ceff5700 10 client.17850 handle_command_reply: tid=0 2023-09-13T09:48:27.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 client.17850 shutdown 2023-09-13T09:48:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 msgr2=0x559fae595480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae595480 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00fb90 tx=0x7f51dc01a050 comp rx=0 tx=0).stop 2023-09-13T09:48:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 shutdown_connections 2023-09-13T09:48:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58d0e0 0x559fae59c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58ba80 0x559fae594f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae5a0d60 0x559fae5a3180 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 --2- 172.21.15.6:0/4027224058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae595480 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51ceff5700 0 client.17850 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 >> 172.21.15.6:0/4027224058 conn(0x559fae4e9d00 msgr2=0x559fae585f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 shutdown_connections 2023-09-13T09:48:27.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 1 -- 172.21.15.6:0/4027224058 wait complete. 2023-09-13T09:48:27.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.808+0000 7f51fd629b80 20 client.17850 trim_cache size 0 max 16384 2023-09-13T09:48:27.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.825+0000 7f51fd629b80 1 Processor -- start 2023-09-13T09:48:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.825+0000 7f51fd629b80 1 -- start start 2023-09-13T09:48:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.825+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae4e9d00 0x559fae580970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.825+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58ba80 0x559fae59c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.825+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae58ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51fd629b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae5877b0 con 0x559fae58c780 2023-09-13T09:48:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51fd629b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae586e40 con 0x559fae4e9d00 2023-09-13T09:48:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51fd629b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae592b70 con 0x559fae58ba80 2023-09-13T09:48:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae58ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51ea7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58ba80 0x559fae59c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae4e9d00 0x559fae580970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae58ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39576/0 (socket says 172.21.15.6:39576) 2023-09-13T09:48:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 -- 172.21.15.6:0/1733006474 learned_addr learned my addr 172.21.15.6:0/1733006474 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51ea7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58ba80 0x559fae59c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42628/0 (socket says 172.21.15.6:42628) 2023-09-13T09:48:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 -- 172.21.15.6:0/1733006474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58ba80 msgr2=0x559fae59c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58ba80 0x559fae59c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 -- 172.21.15.6:0/1733006474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae4e9d00 msgr2=0x559fae580970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae4e9d00 0x559fae580970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 -- 172.21.15.6:0/1733006474 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559fae309e60 con 0x559fae58c780 2023-09-13T09:48:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58ba80 0x559fae59c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae58ac40 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007f70 tx=0x7f51e40095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e52ba8a995f6df0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:27.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51d1ffb700 1 -- 172.21.15.6:0/1733006474 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e40092d0 con 0x559fae58c780 2023-09-13T09:48:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51d1ffb700 1 -- 172.21.15.6:0/1733006474 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51e4005a30 con 0x559fae58c780 2023-09-13T09:48:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.826+0000 7f51d1ffb700 1 -- 172.21.15.6:0/1733006474 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51e400e9c0 con 0x559fae58c780 2023-09-13T09:48:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 -- 172.21.15.6:0/1733006474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 msgr2=0x559fae58ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae58ac40 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f51e4007f70 tx=0x7f51e40095e0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 -- 172.21.15.6:0/1733006474 shutdown_connections 2023-09-13T09:48:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58c780 0x559fae58ac40 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae4e9d00 0x559fae580970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 --2- 172.21.15.6:0/1733006474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae58ba80 0x559fae59c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 -- 172.21.15.6:0/1733006474 >> 172.21.15.6:0/1733006474 conn(0x559fae5862c0 msgr2=0x559fae58a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 -- 172.21.15.6:0/1733006474 shutdown_connections 2023-09-13T09:48:27.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 -- 172.21.15.6:0/1733006474 wait complete. 2023-09-13T09:48:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 -- start start 2023-09-13T09:48:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.827+0000 7f51fd629b80 1 Processor -- start 2023-09-13T09:48:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae4e9d00 0x559fae59a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae59a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51fd629b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae59b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51fd629b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae59bc20 con 0x559fae58ba80 2023-09-13T09:48:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51fd629b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae59bd90 con 0x559fae58c780 2023-09-13T09:48:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51fd629b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559fae59bf50 con 0x559fae4e9d00 2023-09-13T09:48:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51fd629b80 10 client.0 _ll_register_callbacks cb 0x559fae479700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:27.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae59a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae59a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39580/0 (socket says 172.21.15.6:39580) 2023-09-13T09:48:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 -- 172.21.15.6:0/3007516234 learned_addr learned my addr 172.21.15.6:0/3007516234 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51eaffd700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae4e9d00 0x559fae59a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51eb7fe700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae59b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 -- 172.21.15.6:0/3007516234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae4e9d00 msgr2=0x559fae59a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae4e9d00 0x559fae59a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 -- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 msgr2=0x559fae59b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae59b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 -- 172.21.15.6:0/3007516234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559fae4f5820 con 0x559fae58ba80 2023-09-13T09:48:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51eaffd700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae4e9d00 0x559fae59a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:27.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ea7fc700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae59a6d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00b680 tx=0x7f51dc039bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23293dc6c489163e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.828+0000 7f51ceff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51ceff5700 1 -- 172.21.15.6:0/3007516234 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc02b040 con 0x559fae58ba80 2023-09-13T09:48:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f51e400f040 con 0x559fae58ba80 2023-09-13T09:48:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51ceff5700 1 -- 172.21.15.6:0/3007516234 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f51dc040080 con 0x559fae58ba80 2023-09-13T09:48:27.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51ceff5700 1 -- 172.21.15.6:0/3007516234 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f51dc00fea0 con 0x559fae58ba80 2023-09-13T09:48:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 10 client.17856 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559fae35d6b0 con 0x559fae58ba80 2023-09-13T09:48:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51ceff5700 1 -- 172.21.15.6:0/3007516234 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f51dc052020 con 0x559fae58ba80 2023-09-13T09:48:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51ceff5700 1 -- 172.21.15.6:0/3007516234 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f51dc024900 con 0x559fae58ba80 2023-09-13T09:48:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 10 client.17856 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:27.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 10 client.17856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 20 client.17856 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae58d0e0 0x559fae5f9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 4 client.17856 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:48:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559fae4970d0 con 0x559fae58d0e0 2023-09-13T09:48:27.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.829+0000 7f51eaffd700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae58d0e0 0x559fae5f9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.830+0000 7f51ceff5700 10 client.17856 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.830+0000 7f51eaffd700 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae58d0e0 0x559fae5f9640 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76fe0cf7e61469fd server_cookie=b3b25309b20ce468 in_seq=0 out_seq=0 2023-09-13T09:48:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51ceff5700 1 -- 172.21.15.6:0/3007516234 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559fae4970d0 con 0x559fae58d0e0 2023-09-13T09:48:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51ceff5700 10 client.17856 handle_command_reply: tid=0 2023-09-13T09:48:27.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 client.17856 shutdown 2023-09-13T09:48:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 msgr2=0x559fae59a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae59a6d0 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00b680 tx=0x7f51dc039bd0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 shutdown_connections 2023-09-13T09:48:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559fae58c780 0x559fae59b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559fae4e9d00 0x559fae59a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559fae58d0e0 0x559fae5f9640 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 --2- 172.21.15.6:0/3007516234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559fae58ba80 0x559fae59a6d0 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 >> 172.21.15.6:0/3007516234 conn(0x559fae5862c0 msgr2=0x559fae5953f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.831+0000 7f51ceff5700 0 client.17856 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 shutdown_connections 2023-09-13T09:48:27.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51fd629b80 1 -- 172.21.15.6:0/3007516234 wait complete. 2023-09-13T09:48:27.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51fd629b80 20 client.17856 trim_cache size 0 max 16384 2023-09-13T09:48:27.851 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:48:27.851 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:48:27.852 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "c5db2437-4205-4954-b863-0814cd7ad7af", 2023-09-13T09:48:27.852 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:48:27.852 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:48:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51d40a0640 msgr2=0x7f51d40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51d40a0640 0x7f51d40a2b00 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00b2e0 tx=0x7f51dc005fb0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec101840 msgr2=0x7f51ec196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec101840 0x7f51ec196a40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f51e000e9a0 tx=0x7f51e000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 shutdown_connections 2023-09-13T09:48:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f51ec106aa0 0x7f51ec19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f51d40a0640 0x7f51d40a2b00 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51ec101840 0x7f51ec196a40 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 --2- 172.21.15.6:0/3364339553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f51ec104170 0x7f51ec196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 >> 172.21.15.6:0/3364339553 conn(0x7f51ec0fb250 msgr2=0x7f51ec102cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 shutdown_connections 2023-09-13T09:48:27.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.832+0000 7f51f1444700 1 -- 172.21.15.6:0/3364339553 wait complete. 2023-09-13T09:48:27.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:48:27.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 -- 172.21.15.6:0/1667727944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 msgr2=0x7fd1e8102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/1667727944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8102410 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0099c0 tx=0x7fd1dc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 -- 172.21.15.6:0/1667727944 shutdown_connections 2023-09-13T09:48:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/1667727944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e8102950 0x7fd1e8109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/1667727944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1e8100dc0 0x7fd1e81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/1667727944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8102410 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 -- 172.21.15.6:0/1667727944 >> 172.21.15.6:0/1667727944 conn(0x7fd1e80fc350 msgr2=0x7fd1e80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 -- 172.21.15.6:0/1667727944 shutdown_connections 2023-09-13T09:48:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 -- 172.21.15.6:0/1667727944 wait complete. 2023-09-13T09:48:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.989+0000 7fd1f01cf700 1 Processor -- start 2023-09-13T09:48:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 -- start start 2023-09-13T09:48:27.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e8100dc0 0x7fd1e8198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1e8102950 0x7fd1e81a0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81a0840 con 0x7fd1e8101fb0 2023-09-13T09:48:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81a09b0 con 0x7fd1e8102950 2023-09-13T09:48:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e81a0b70 con 0x7fd1e8100dc0 2023-09-13T09:48:27.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8199240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39594/0 (socket says 172.21.15.6:39594) 2023-09-13T09:48:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 -- 172.21.15.6:0/3515239918 learned_addr learned my addr 172.21.15.6:0/3515239918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e8100dc0 0x7fd1e8198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ee76c700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1e8102950 0x7fd1e81a0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:27.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 -- 172.21.15.6:0/3515239918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e8100dc0 msgr2=0x7fd1e8198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e8100dc0 0x7fd1e8198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 -- 172.21.15.6:0/3515239918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1e8102950 msgr2=0x7fd1e81a0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1e8102950 0x7fd1e81a0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 -- 172.21.15.6:0/3515239918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1dc0095f0 con 0x7fd1e8101fb0 2023-09-13T09:48:27.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8199240 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c010 tx=0x7fd1dc009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1daffd700 1 -- 172.21.15.6:0/3515239918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc01d070 con 0x7fd1e8101fb0 2023-09-13T09:48:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1daffd700 1 -- 172.21.15.6:0/3515239918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1dc0040d0 con 0x7fd1e8101fb0 2023-09-13T09:48:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e81a0df0 con 0x7fd1e8101fb0 2023-09-13T09:48:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.990+0000 7fd1daffd700 1 -- 172.21.15.6:0/3515239918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc005290 con 0x7fd1e8101fb0 2023-09-13T09:48:27.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.991+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e81a11c0 con 0x7fd1e8101fb0 2023-09-13T09:48:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.993+0000 7fd1daffd700 1 -- 172.21.15.6:0/3515239918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd1dc004810 con 0x7fd1e8101fb0 2023-09-13T09:48:28.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.993+0000 7fd1daffd700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1d40a0640 0x7fd1d40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.993+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1d40a0640 0x7fd1d40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.993+0000 7fd1daffd700 1 -- 172.21.15.6:0/3515239918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1dc0ccc90 con 0x7fd1e8101fb0 2023-09-13T09:48:28.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 Processor -- start 2023-09-13T09:48:28.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1d40a0640 0x7fd1d40a2b00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd1e819a1d0 tx=0x7fd1e4007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:28.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 -- start start 2023-09-13T09:48:28.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c10fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c10fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c10fae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c1053780 con 0x55d7c10faa00 2023-09-13T09:48:28.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c10510a0 con 0x55d7c10fb700 2023-09-13T09:48:28.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c104c990 con 0x55d7c10fc060 2023-09-13T09:48:28.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1edf6b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c10fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1edf6b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c10fbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33124/0 (socket says 172.21.15.6:33124) 2023-09-13T09:48:28.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1edf6b700 1 -- 172.21.15.6:0/14013077 learned_addr learned my addr 172.21.15.6:0/14013077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:28.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c10fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.994+0000 7fd1ee76c700 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c10fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.995+0000 7fd1edf6b700 1 -- 172.21.15.6:0/14013077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 msgr2=0x55d7c10fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.995+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c10fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.995+0000 7fd1edf6b700 1 -- 172.21.15.6:0/14013077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 msgr2=0x55d7c10fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.995+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c10fae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.995+0000 7fd1edf6b700 1 -- 172.21.15.6:0/14013077 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7c0ecc630 con 0x55d7c10fb700 2023-09-13T09:48:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.995+0000 7fd1ee76c700 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c10fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.995+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c10fbb20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4010eb0 tx=0x7fd1e4013000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe52de986be03897 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.996+0000 7fd1d3fff700 1 -- 172.21.15.6:0/14013077 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4010ee0 con 0x55d7c10fb700 2023-09-13T09:48:28.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.996+0000 7fd1d3fff700 1 -- 172.21.15.6:0/14013077 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e4003b40 con 0x55d7c10fb700 2023-09-13T09:48:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.996+0000 7fd1d3fff700 1 -- 172.21.15.6:0/14013077 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4011b90 con 0x55d7c10fb700 2023-09-13T09:48:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/14013077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 msgr2=0x55d7c10fbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c10fbb20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd1e4010eb0 tx=0x7fd1e4013000 comp rx=0 tx=0).stop 2023-09-13T09:48:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/14013077 shutdown_connections 2023-09-13T09:48:28.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c10fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c10fbb20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/14013077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c10fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/14013077 >> 172.21.15.6:0/14013077 conn(0x55d7c1058c80 msgr2=0x55d7c10f4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/14013077 shutdown_connections 2023-09-13T09:48:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/14013077 wait complete. 2023-09-13T09:48:28.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 -- start start 2023-09-13T09:48:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.997+0000 7fd1fc3b4b80 1 Processor -- start 2023-09-13T09:48:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10faa00 0x55d7c1103fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c1104500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c110b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c0feabb0 con 0x55d7c10fb700 2023-09-13T09:48:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c0fea8b0 con 0x55d7c10faa00 2023-09-13T09:48:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c0ece920 con 0x55d7c10fc060 2023-09-13T09:48:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1fc3b4b80 10 client.0 _ll_register_callbacks cb 0x55d7c0fe8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c1104500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1edf6b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10faa00 0x55d7c1103fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c1104500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39608/0 (socket says 172.21.15.6:39608) 2023-09-13T09:48:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2255541087 learned_addr learned my addr 172.21.15.6:0/2255541087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ee76c700 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c110b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2255541087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 msgr2=0x55d7c110b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c110b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2255541087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10faa00 msgr2=0x55d7c1103fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10faa00 0x55d7c1103fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2255541087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e4010b90 con 0x55d7c10fb700 2023-09-13T09:48:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ee76c700 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c110b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c1104500 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0098e0 tx=0x7fd1dc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a3c4aa04fa906f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:28.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2255541087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc09e220 con 0x55d7c10fb700 2023-09-13T09:48:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.998+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2255541087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1dc09a5e0 con 0x55d7c10fb700 2023-09-13T09:48:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.999+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7c10ed670 con 0x55d7c10fb700 2023-09-13T09:48:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.999+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2255541087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1dc09e410 con 0x55d7c10fb700 2023-09-13T09:48:28.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.999+0000 7fd1fc3b4b80 10 client.17868 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.999+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d7c10647a0 con 0x55d7c10fb700 2023-09-13T09:48:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:27.999+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2255541087 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1dc0b8030 con 0x55d7c10fb700 2023-09-13T09:48:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2255541087 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd1dc0a2130 con 0x55d7c10fb700 2023-09-13T09:48:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1fc3b4b80 10 client.17868 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1fc3b4b80 10 client.17868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:28.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1fc3b4b80 20 client.17868 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c110fa70 0x55d7c1111e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1fc3b4b80 4 client.17868 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7c1045970 con 0x55d7c110fa70 2023-09-13T09:48:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c110fa70 0x55d7c1111e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c110fa70 0x55d7c1111e90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e409306d1e73828d server_cookie=7757b71be21004c1 in_seq=0 out_seq=0 2023-09-13T09:48:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.000+0000 7fd1d17fa700 10 client.17868 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2255541087 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d7c1045970 con 0x55d7c110fa70 2023-09-13T09:48:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1d17fa700 10 client.17868 handle_command_reply: tid=0 2023-09-13T09:48:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 client.17868 shutdown 2023-09-13T09:48:28.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 msgr2=0x55d7c1104500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c1104500 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0098e0 tx=0x7fd1dc0056d0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 shutdown_connections 2023-09-13T09:48:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c110b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10faa00 0x55d7c1103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c110fa70 0x55d7c1111e90 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2255541087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c1104500 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 >> 172.21.15.6:0/2255541087 conn(0x55d7c1058c80 msgr2=0x55d7c10ef7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1d17fa700 0 client.17868 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 shutdown_connections 2023-09-13T09:48:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2255541087 wait complete. 2023-09-13T09:48:28.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.001+0000 7fd1fc3b4b80 20 client.17868 trim_cache size 0 max 16384 2023-09-13T09:48:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.018+0000 7fd1fc3b4b80 1 Processor -- start 2023-09-13T09:48:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.018+0000 7fd1fc3b4b80 1 -- start start 2023-09-13T09:48:28.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.018+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10faa00 0x55d7c10fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c110b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fc060 0x55d7c10fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c1103b30 con 0x55d7c10fb700 2023-09-13T09:48:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c10f6fd0 con 0x55d7c10fc060 2023-09-13T09:48:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c10f69b0 con 0x55d7c10faa00 2023-09-13T09:48:28.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c110b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c110b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39616/0 (socket says 172.21.15.6:39616) 2023-09-13T09:48:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 -- 172.21.15.6:0/1073644137 learned_addr learned my addr 172.21.15.6:0/1073644137 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ee76c700 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fc060 0x55d7c10fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10faa00 0x55d7c10fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 -- 172.21.15.6:0/1073644137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10faa00 msgr2=0x55d7c10fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10faa00 0x55d7c10fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 -- 172.21.15.6:0/1073644137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fc060 msgr2=0x55d7c10fe9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fc060 0x55d7c10fe9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 -- 172.21.15.6:0/1073644137 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7c0e78de0 con 0x55d7c10fb700 2023-09-13T09:48:28.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c110b500 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000c00 tx=0x7fd1dc096a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf1a5de13bac58e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1d8ff9700 1 -- 172.21.15.6:0/1073644137 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc09a5e0 con 0x55d7c10fb700 2023-09-13T09:48:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1d8ff9700 1 -- 172.21.15.6:0/1073644137 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1dc0b8040 con 0x55d7c10fb700 2023-09-13T09:48:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.019+0000 7fd1d8ff9700 1 -- 172.21.15.6:0/1073644137 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc099cb0 con 0x55d7c10fb700 2023-09-13T09:48:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/1073644137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 msgr2=0x55d7c110b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:28.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c110b500 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc000c00 tx=0x7fd1dc096a20 comp rx=0 tx=0).stop 2023-09-13T09:48:28.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/1073644137 shutdown_connections 2023-09-13T09:48:28.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fc060 0x55d7c10fe9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10faa00 0x55d7c10fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/1073644137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10fb700 0x55d7c110b500 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/1073644137 >> 172.21.15.6:0/1073644137 conn(0x55d7c1058c80 msgr2=0x55d7c1103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:28.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/1073644137 shutdown_connections 2023-09-13T09:48:28.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/1073644137 wait complete. 2023-09-13T09:48:28.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 -- start start 2023-09-13T09:48:28.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.020+0000 7fd1fc3b4b80 1 Processor -- start 2023-09-13T09:48:28.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c110ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c110b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1fc3b4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c1107800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c1107dd0 con 0x55d7c10faa00 2023-09-13T09:48:28.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c1107f40 con 0x55d7c10fb700 2023-09-13T09:48:28.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1fc3b4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7c1108100 con 0x55d7c10fc060 2023-09-13T09:48:28.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1fc3b4b80 10 client.0 _ll_register_callbacks cb 0x55d7c0fe8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1edf6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c110ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c110b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c110b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33146/0 (socket says 172.21.15.6:33146) 2023-09-13T09:48:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2951761833 learned_addr learned my addr 172.21.15.6:0/2951761833 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ee76c700 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c1107800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2951761833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 msgr2=0x55d7c1107800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c1107800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2951761833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 msgr2=0x55d7c110ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c110ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 -- 172.21.15.6:0/2951761833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7c10647a0 con 0x55d7c10fb700 2023-09-13T09:48:28.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c110ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1ed76a700 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c110b2a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0a2090 tx=0x7fd1dc0a2360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a27d665e23a46509 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.021+0000 7fd1d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:48:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2951761833 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc066510 con 0x55d7c10fb700 2023-09-13T09:48:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2951761833 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1dc09a5e0 con 0x55d7c10fb700 2023-09-13T09:48:28.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1e4003b40 con 0x55d7c10fb700 2023-09-13T09:48:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2951761833 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1dc0a25c0 con 0x55d7c10fb700 2023-09-13T09:48:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 10 client.27278 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d7c0e61c60 con 0x55d7c10fb700 2023-09-13T09:48:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2951761833 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1e4003b40 con 0x55d7c10fb700 2023-09-13T09:48:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2951761833 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd1dc0963d0 con 0x55d7c10fb700 2023-09-13T09:48:28.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 10 client.27278 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 10 client.27278 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 20 client.27278 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c1164630 0x55d7c1166a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 4 client.27278 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:48:28.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d7c1006050 con 0x55d7c1164630 2023-09-13T09:48:28.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.022+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c1164630 0x55d7c1166a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:28.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.023+0000 7fd1edf6b700 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c1164630 0x55d7c1166a20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460385f40a91e2f2 server_cookie=95d40c16d1807b1 in_seq=0 out_seq=0 2023-09-13T09:48:28.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.023+0000 7fd1d17fa700 10 client.27278 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:28.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1d17fa700 1 -- 172.21.15.6:0/2951761833 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d7c1006050 con 0x55d7c1164630 2023-09-13T09:48:28.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1d17fa700 10 client.27278 handle_command_reply: tid=0 2023-09-13T09:48:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 client.27278 shutdown 2023-09-13T09:48:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 msgr2=0x55d7c110b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c110b2a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc0a2090 tx=0x7fd1dc0a2360 comp rx=0 tx=0).stop 2023-09-13T09:48:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 shutdown_connections 2023-09-13T09:48:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d7c10fc060 0x55d7c1107800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d7c1164630 0x55d7c1166a20 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d7c10faa00 0x55d7c110ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1d17fa700 0 client.27278 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 --2- 172.21.15.6:0/2951761833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d7c10fb700 0x55d7c110b2a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 >> 172.21.15.6:0/2951761833 conn(0x55d7c1058c80 msgr2=0x55d7c1103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:28.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 shutdown_connections 2023-09-13T09:48:28.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 1 -- 172.21.15.6:0/2951761833 wait complete. 2023-09-13T09:48:28.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1fc3b4b80 20 client.27278 trim_cache size 0 max 16384 2023-09-13T09:48:28.043 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:48:28.043 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:48:28.044 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:48:28.044 INFO:teuthology.orchestra.run.smithi006.stdout: "c5db2437-4205-4954-b863-0814cd7ad7af": { 2023-09-13T09:48:28.044 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:48:28.044 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "c5db2437-4205-4954-b863-0814cd7ad7af", 2023-09-13T09:48:28.044 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:48:28.045 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:48:28.045 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:48:28.045 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:48:28.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1d40a0640 msgr2=0x7fd1d40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1d40a0640 0x7fd1d40a2b00 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fd1e819a1d0 tx=0x7fd1e4007400 comp rx=0 tx=0).stop 2023-09-13T09:48:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 msgr2=0x7fd1e8199240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.024+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8199240 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c010 tx=0x7fd1dc009580 comp rx=0 tx=0).stop 2023-09-13T09:48:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 shutdown_connections 2023-09-13T09:48:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1e8102950 0x7fd1e81a0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1e8100dc0 0x7fd1e8198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1d40a0640 0x7fd1d40a2b00 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 --2- 172.21.15.6:0/3515239918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1e8101fb0 0x7fd1e8199240 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 >> 172.21.15.6:0/3515239918 conn(0x7fd1e80fc350 msgr2=0x7fd1e80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 shutdown_connections 2023-09-13T09:48:28.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:28.025+0000 7fd1f01cf700 1 -- 172.21.15.6:0/3515239918 wait complete. 2023-09-13T09:48:28.049 INFO:tasks.cephfs.filesystem:scrub status for tag:c5db2437-4205-4954-b863-0814cd7ad7af - {'path': '/', 'tag': 'c5db2437-4205-4954-b863-0814cd7ad7af', 'options': 'recursive,force'} 2023-09-13T09:48:28.174 INFO:tasks.workunit.client.0.smithi006.stdout: 1 458296 5.66 MB/sec execute 348 sec latency 23.930 ms 2023-09-13T09:48:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: pgmap v568: 97 pgs: 97 active+clean; 188 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2023-09-13T09:48:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:48:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:48:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:48:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:28.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:28.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:28.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: pgmap v568: 97 pgs: 97 active+clean; 188 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2023-09-13T09:48:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:48:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:48:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:48:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:28.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:28.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.262 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: pgmap v568: 97 pgs: 97 active+clean; 188 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 2.3 MiB/s wr, 286 op/s 2023-09-13T09:48:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:48:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:48:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:48:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:48:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 459313 5.71 MB/sec execute 349 sec latency 87.559 ms 2023-09-13T09:48:29.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi131 to 196.2M 2023-09-13T09:48:29.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: Unable to set osd_memory_target on smithi131 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-09-13T09:48:29.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:48:29.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:29.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:29.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:29.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:29.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:48:29.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:28 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi131 to 196.2M 2023-09-13T09:48:29.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: Unable to set osd_memory_target on smithi131 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-09-13T09:48:29.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:48:29.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:29.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:29.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:29.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:29.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:48:29.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:28 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi131 to 196.2M 2023-09-13T09:48:29.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: Unable to set osd_memory_target on smithi131 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-09-13T09:48:29.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:48:29.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:29.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:29.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:29.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:29.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:29.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:48:29.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:28 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:48:30.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 461718 5.73 MB/sec execute 350 sec latency 12.046 ms 2023-09-13T09:48:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:29 smithi006 ceph-mon[98665]: pgmap v569: 97 pgs: 97 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 2.0 MiB/s wr, 236 op/s 2023-09-13T09:48:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:29 smithi053 ceph-mon[102373]: pgmap v569: 97 pgs: 97 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 2.0 MiB/s wr, 236 op/s 2023-09-13T09:48:30.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:29 smithi131 ceph-mon[102785]: pgmap v569: 97 pgs: 97 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 2.0 MiB/s wr, 236 op/s 2023-09-13T09:48:31.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 462816 5.73 MB/sec execute 351 sec latency 12.856 ms 2023-09-13T09:48:32.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 465088 5.75 MB/sec execute 352 sec latency 48.890 ms 2023-09-13T09:48:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:31 smithi006 ceph-mon[98665]: pgmap v570: 97 pgs: 97 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 1.9 MiB/s wr, 217 op/s 2023-09-13T09:48:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:31 smithi053 ceph-mon[102373]: pgmap v570: 97 pgs: 97 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 1.9 MiB/s wr, 217 op/s 2023-09-13T09:48:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:31 smithi131 ceph-mon[102785]: pgmap v570: 97 pgs: 97 active+clean; 189 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 715 KiB/s rd, 1.9 MiB/s wr, 217 op/s 2023-09-13T09:48:33.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 466003 5.75 MB/sec execute 353 sec latency 32.019 ms 2023-09-13T09:48:34.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 468205 5.76 MB/sec execute 354 sec latency 19.976 ms 2023-09-13T09:48:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:33 smithi006 ceph-mon[98665]: pgmap v571: 97 pgs: 97 active+clean; 191 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 2.3 MiB/s wr, 270 op/s 2023-09-13T09:48:34.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:33 smithi053 ceph-mon[102373]: pgmap v571: 97 pgs: 97 active+clean; 191 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 2.3 MiB/s wr, 270 op/s 2023-09-13T09:48:34.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:33 smithi131 ceph-mon[102785]: pgmap v571: 97 pgs: 97 active+clean; 191 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 2.3 MiB/s wr, 270 op/s 2023-09-13T09:48:35.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 469409 5.77 MB/sec execute 355 sec latency 70.073 ms 2023-09-13T09:48:36.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 471447 5.77 MB/sec execute 356 sec latency 11.863 ms 2023-09-13T09:48:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:35 smithi006 ceph-mon[98665]: pgmap v572: 97 pgs: 97 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 2.2 MiB/s wr, 252 op/s 2023-09-13T09:48:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:35 smithi053 ceph-mon[102373]: pgmap v572: 97 pgs: 97 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 2.2 MiB/s wr, 252 op/s 2023-09-13T09:48:36.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:35 smithi131 ceph-mon[102785]: pgmap v572: 97 pgs: 97 active+clean; 186 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 2.2 MiB/s wr, 252 op/s 2023-09-13T09:48:37.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 472935 5.79 MB/sec execute 357 sec latency 14.053 ms 2023-09-13T09:48:38.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 474739 5.79 MB/sec execute 358 sec latency 40.324 ms 2023-09-13T09:48:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:37 smithi006 ceph-mon[98665]: pgmap v573: 97 pgs: 97 active+clean; 178 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 2.1 MiB/s wr, 256 op/s 2023-09-13T09:48:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:37 smithi053 ceph-mon[102373]: pgmap v573: 97 pgs: 97 active+clean; 178 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 2.1 MiB/s wr, 256 op/s 2023-09-13T09:48:38.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:37 smithi131 ceph-mon[102785]: pgmap v573: 97 pgs: 97 active+clean; 178 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 2.1 MiB/s wr, 256 op/s 2023-09-13T09:48:39.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 476338 5.81 MB/sec execute 359 sec latency 37.033 ms 2023-09-13T09:48:40.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 477682 5.81 MB/sec execute 360 sec latency 16.803 ms 2023-09-13T09:48:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:39 smithi006 ceph-mon[98665]: pgmap v574: 97 pgs: 97 active+clean; 182 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 2.1 MiB/s wr, 246 op/s 2023-09-13T09:48:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:39 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:48:40.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:39 smithi053 ceph-mon[102373]: pgmap v574: 97 pgs: 97 active+clean; 182 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 2.1 MiB/s wr, 246 op/s 2023-09-13T09:48:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:40.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:39 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:48:40.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:39 smithi131 ceph-mon[102785]: pgmap v574: 97 pgs: 97 active+clean; 182 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 596 KiB/s rd, 2.1 MiB/s wr, 246 op/s 2023-09-13T09:48:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:39 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:48:41.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 479898 5.83 MB/sec execute 361 sec latency 13.733 ms 2023-09-13T09:48:42.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 481121 5.83 MB/sec execute 362 sec latency 13.420 ms 2023-09-13T09:48:42.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:41 smithi053 ceph-mon[102373]: pgmap v575: 97 pgs: 97 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 2.1 MiB/s wr, 231 op/s 2023-09-13T09:48:42.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:41 smithi006 ceph-mon[98665]: pgmap v575: 97 pgs: 97 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 2.1 MiB/s wr, 231 op/s 2023-09-13T09:48:42.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:41 smithi131 ceph-mon[102785]: pgmap v575: 97 pgs: 97 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 534 KiB/s rd, 2.1 MiB/s wr, 231 op/s 2023-09-13T09:48:43.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 483323 5.85 MB/sec execute 363 sec latency 20.034 ms 2023-09-13T09:48:44.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 484277 5.84 MB/sec execute 364 sec latency 30.818 ms 2023-09-13T09:48:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:44 smithi006 ceph-mon[98665]: pgmap v576: 97 pgs: 97 active+clean; 182 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-13T09:48:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:44 smithi053 ceph-mon[102373]: pgmap v576: 97 pgs: 97 active+clean; 182 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-13T09:48:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:44 smithi131 ceph-mon[102785]: pgmap v576: 97 pgs: 97 active+clean; 182 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-13T09:48:45.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 486566 5.86 MB/sec execute 365 sec latency 23.342 ms 2023-09-13T09:48:46.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 487493 5.86 MB/sec execute 366 sec latency 44.499 ms 2023-09-13T09:48:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:46 smithi006 ceph-mon[98665]: pgmap v577: 97 pgs: 97 active+clean; 179 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.4 MiB/s wr, 270 op/s 2023-09-13T09:48:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:46 smithi053 ceph-mon[102373]: pgmap v577: 97 pgs: 97 active+clean; 179 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.4 MiB/s wr, 270 op/s 2023-09-13T09:48:46.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:46 smithi131 ceph-mon[102785]: pgmap v577: 97 pgs: 97 active+clean; 179 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 630 KiB/s rd, 2.4 MiB/s wr, 270 op/s 2023-09-13T09:48:47.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 489774 5.87 MB/sec execute 367 sec latency 11.608 ms 2023-09-13T09:48:48.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 490904 5.88 MB/sec execute 368 sec latency 36.999 ms 2023-09-13T09:48:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:48 smithi006 ceph-mon[98665]: pgmap v578: 97 pgs: 97 active+clean; 180 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 2.5 MiB/s wr, 251 op/s 2023-09-13T09:48:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:48 smithi053 ceph-mon[102373]: pgmap v578: 97 pgs: 97 active+clean; 180 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 2.5 MiB/s wr, 251 op/s 2023-09-13T09:48:48.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:48 smithi131 ceph-mon[102785]: pgmap v578: 97 pgs: 97 active+clean; 180 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 573 KiB/s rd, 2.5 MiB/s wr, 251 op/s 2023-09-13T09:48:49.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 493186 5.89 MB/sec execute 369 sec latency 14.357 ms 2023-09-13T09:48:50.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 494317 5.90 MB/sec execute 370 sec latency 34.308 ms 2023-09-13T09:48:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:50 smithi053 ceph-mon[102373]: pgmap v579: 97 pgs: 97 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 2.3 MiB/s wr, 265 op/s 2023-09-13T09:48:50.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:50 smithi131 ceph-mon[102785]: pgmap v579: 97 pgs: 97 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 2.3 MiB/s wr, 265 op/s 2023-09-13T09:48:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:50 smithi006 ceph-mon[98665]: pgmap v579: 97 pgs: 97 active+clean; 181 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 2.3 MiB/s wr, 265 op/s 2023-09-13T09:48:51.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 496409 5.90 MB/sec execute 371 sec latency 18.962 ms 2023-09-13T09:48:52.175 INFO:tasks.workunit.client.0.smithi006.stdout: 1 497814 5.92 MB/sec execute 372 sec latency 14.682 ms 2023-09-13T09:48:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:52 smithi131 ceph-mon[102785]: pgmap v580: 97 pgs: 97 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 2.2 MiB/s wr, 215 op/s 2023-09-13T09:48:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:52 smithi006 ceph-mon[98665]: pgmap v580: 97 pgs: 97 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 2.2 MiB/s wr, 215 op/s 2023-09-13T09:48:52.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:52 smithi053 ceph-mon[102373]: pgmap v580: 97 pgs: 97 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 467 KiB/s rd, 2.2 MiB/s wr, 215 op/s 2023-09-13T09:48:53.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 499762 5.92 MB/sec execute 373 sec latency 35.450 ms 2023-09-13T09:48:54.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 501242 5.93 MB/sec execute 374 sec latency 20.008 ms 2023-09-13T09:48:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:54 smithi131 ceph-mon[102785]: pgmap v581: 97 pgs: 97 active+clean; 186 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 2.5 MiB/s wr, 283 op/s 2023-09-13T09:48:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:54 smithi006 ceph-mon[98665]: pgmap v581: 97 pgs: 97 active+clean; 186 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 2.5 MiB/s wr, 283 op/s 2023-09-13T09:48:54.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:54 smithi053 ceph-mon[102373]: pgmap v581: 97 pgs: 97 active+clean; 186 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 671 KiB/s rd, 2.5 MiB/s wr, 283 op/s 2023-09-13T09:48:55.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 502464 5.93 MB/sec execute 375 sec latency 63.886 ms 2023-09-13T09:48:56.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 504648 5.95 MB/sec execute 376 sec latency 14.669 ms 2023-09-13T09:48:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:56 smithi131 ceph-mon[102785]: pgmap v582: 97 pgs: 97 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2023-09-13T09:48:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:56 smithi006 ceph-mon[98665]: pgmap v582: 97 pgs: 97 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2023-09-13T09:48:56.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:56 smithi053 ceph-mon[102373]: pgmap v582: 97 pgs: 97 active+clean; 184 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 598 KiB/s rd, 2.3 MiB/s wr, 259 op/s 2023-09-13T09:48:57.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 505712 5.94 MB/sec execute 377 sec latency 15.753 ms 2023-09-13T09:48:58.050 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:48:58.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 508045 5.97 MB/sec execute 378 sec latency 45.033 ms 2023-09-13T09:48:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 -- 172.21.15.6:0/4013185806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c106ae0 msgr2=0x7faa6c108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 --2- 172.21.15.6:0/4013185806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c106ae0 0x7faa6c108f10 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7faa6400b0a0 tx=0x7faa6400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 -- 172.21.15.6:0/4013185806 shutdown_connections 2023-09-13T09:48:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 --2- 172.21.15.6:0/4013185806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c106ae0 0x7faa6c108f10 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 --2- 172.21.15.6:0/4013185806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6c101880 0x7faa6c103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 --2- 172.21.15.6:0/4013185806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa6c1041b0 0x7faa6c1065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 -- 172.21.15.6:0/4013185806 >> 172.21.15.6:0/4013185806 conn(0x7faa6c0fb250 msgr2=0x7faa6c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 -- 172.21.15.6:0/4013185806 shutdown_connections 2023-09-13T09:48:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.196+0000 7faa721a6700 1 -- 172.21.15.6:0/4013185806 wait complete. 2023-09-13T09:48:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.197+0000 7faa721a6700 1 Processor -- start 2023-09-13T09:48:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.197+0000 7faa721a6700 1 -- start start 2023-09-13T09:48:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa721a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c101880 0x7faa6c1011f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa721a6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa6c1041b0 0x7faa6c0ff830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa721a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6c106ae0 0x7faa6c0ffd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa721a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c100510 con 0x7faa6c101880 2023-09-13T09:48:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa721a6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c100680 con 0x7faa6c1041b0 2023-09-13T09:48:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa721a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa6c1a0b40 con 0x7faa6c106ae0 2023-09-13T09:48:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c101880 0x7faa6c1011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c101880 0x7faa6c1011f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39636/0 (socket says 172.21.15.6:39636) 2023-09-13T09:48:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 -- 172.21.15.6:0/1368128079 learned_addr learned my addr 172.21.15.6:0/1368128079 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6bfff700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6c106ae0 0x7faa6c0ffd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6affd700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa6c1041b0 0x7faa6c0ff830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 -- 172.21.15.6:0/1368128079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6c106ae0 msgr2=0x7faa6c0ffd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6c106ae0 0x7faa6c0ffd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 -- 172.21.15.6:0/1368128079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa6c1041b0 msgr2=0x7faa6c0ff830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa6c1041b0 0x7faa6c0ff830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 -- 172.21.15.6:0/1368128079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa64009d00 con 0x7faa6c101880 2023-09-13T09:48:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.198+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c101880 0x7faa6c1011f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e9a0 tx=0x7faa6000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.199+0000 7faa68ff9700 1 -- 172.21.15.6:0/1368128079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60009790 con 0x7faa6c101880 2023-09-13T09:48:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.199+0000 7faa68ff9700 1 -- 172.21.15.6:0/1368128079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa60010430 con 0x7faa6c101880 2023-09-13T09:48:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.199+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa6c1a0e20 con 0x7faa6c101880 2023-09-13T09:48:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.199+0000 7faa68ff9700 1 -- 172.21.15.6:0/1368128079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60018680 con 0x7faa6c101880 2023-09-13T09:48:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.199+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa6c1a1240 con 0x7faa6c101880 2023-09-13T09:48:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.202+0000 7faa68ff9700 1 -- 172.21.15.6:0/1368128079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7faa600105a0 con 0x7faa6c101880 2023-09-13T09:48:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.203+0000 7faa68ff9700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa540a06c0 0x7faa540a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.203+0000 7faa6affd700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa540a06c0 0x7faa540a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.203+0000 7faa68ff9700 1 -- 172.21.15.6:0/1368128079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa60014070 con 0x7faa6c101880 2023-09-13T09:48:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa6affd700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa540a06c0 0x7faa540a2b80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009c60 tx=0x7faa5c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 Processor -- start 2023-09-13T09:48:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 -- start start 2023-09-13T09:48:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031eb8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb9060 0x55a031eb74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031eb7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031e10780 con 0x55a031eb9060 2023-09-13T09:48:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031e0e0a0 con 0x55a031eb8700 2023-09-13T09:48:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031e09990 con 0x55a031eb7a00 2023-09-13T09:48:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa6affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb9060 0x55a031eb74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031eb8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031eb7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031eb8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33168/0 (socket says 172.21.15.6:33168) 2023-09-13T09:48:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.204+0000 7faa6b7fe700 1 -- 172.21.15.6:0/1383042080 learned_addr learned my addr 172.21.15.6:0/1383042080 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6affd700 1 -- 172.21.15.6:0/1383042080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 msgr2=0x55a031eb7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6affd700 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031eb7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6affd700 1 -- 172.21.15.6:0/1383042080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 msgr2=0x55a031eb8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6affd700 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031eb8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6affd700 1 -- 172.21.15.6:0/1383042080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a031c89630 con 0x55a031eb9060 2023-09-13T09:48:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6bfff700 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031eb7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031eb8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa6affd700 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb9060 0x55a031eb74c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00e3b0 tx=0x7faa5c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7483986508d636 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa51ffb700 1 -- 172.21.15.6:0/1383042080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c00ed50 con 0x55a031eb9060 2023-09-13T09:48:58.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa51ffb700 1 -- 172.21.15.6:0/1383042080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa5c021070 con 0x55a031eb9060 2023-09-13T09:48:58.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.205+0000 7faa51ffb700 1 -- 172.21.15.6:0/1383042080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5c026470 con 0x55a031eb9060 2023-09-13T09:48:58.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 -- 172.21.15.6:0/1383042080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb9060 msgr2=0x55a031eb74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb9060 0x55a031eb74c0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7faa5c00e3b0 tx=0x7faa5c014000 comp rx=0 tx=0).stop 2023-09-13T09:48:58.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 -- 172.21.15.6:0/1383042080 shutdown_connections 2023-09-13T09:48:58.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031eb7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031eb8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/1383042080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb9060 0x55a031eb74c0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 -- 172.21.15.6:0/1383042080 >> 172.21.15.6:0/1383042080 conn(0x55a031e15c80 msgr2=0x55a031eb1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 -- 172.21.15.6:0/1383042080 shutdown_connections 2023-09-13T09:48:58.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 -- 172.21.15.6:0/1383042080 wait complete. 2023-09-13T09:48:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 -- start start 2023-09-13T09:48:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.206+0000 7faa7e38bb80 1 Processor -- start 2023-09-13T09:48:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031ed1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb8700 0x55a031ed2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb9060 0x55a031ed94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031da7bb0 con 0x55a031eb8700 2023-09-13T09:48:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031da78b0 con 0x55a031eb9060 2023-09-13T09:48:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031c8b920 con 0x55a031eb7a00 2023-09-13T09:48:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa7e38bb80 10 client.0 _ll_register_callbacks cb 0x55a031da5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:58.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031ed1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031ed1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42704/0 (socket says 172.21.15.6:42704) 2023-09-13T09:48:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 -- 172.21.15.6:0/3676671532 learned_addr learned my addr 172.21.15.6:0/3676671532 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6bfff700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb9060 0x55a031ed94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6affd700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb8700 0x55a031ed2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 -- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb9060 msgr2=0x55a031ed94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb9060 0x55a031ed94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 -- 172.21.15.6:0/3676671532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb8700 msgr2=0x55a031ed2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb8700 0x55a031ed2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 -- 172.21.15.6:0/3676671532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c017070 con 0x55a031eb7a00 2023-09-13T09:48:58.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6bfff700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb9060 0x55a031ed94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.207+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031ed1f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faa600959e0 tx=0x7faa60099380 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3486f25c3d081d6b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa4affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:48:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa4affd700 1 -- 172.21.15.6:0/3676671532 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6009d170 con 0x55a031eb7a00 2023-09-13T09:48:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa4affd700 1 -- 172.21.15.6:0/3676671532 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa60099530 con 0x55a031eb7a00 2023-09-13T09:48:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a031eaa670 con 0x55a031eb7a00 2023-09-13T09:48:58.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa4affd700 1 -- 172.21.15.6:0/3676671532 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa6009d360 con 0x55a031eb7a00 2023-09-13T09:48:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 10 client.27211 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a031e217a0 con 0x55a031eb7a00 2023-09-13T09:48:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa4affd700 1 -- 172.21.15.6:0/3676671532 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa60063080 con 0x55a031eb7a00 2023-09-13T09:48:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa4affd700 1 -- 172.21.15.6:0/3676671532 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faa60065120 con 0x55a031eb7a00 2023-09-13T09:48:58.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 10 client.27211 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 10 client.27211 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 20 client.27211 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031eddd50 0x55a031ee0170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 4 client.27211 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:58.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.208+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a031e02970 con 0x55a031eddd50 2023-09-13T09:48:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.209+0000 7faa6affd700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031eddd50 0x55a031ee0170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.209+0000 7faa4affd700 10 client.27211 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.209+0000 7faa6affd700 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031eddd50 0x55a031ee0170 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27baf3f326e0894b server_cookie=dcc4be03fe1e6c19 in_seq=0 out_seq=0 2023-09-13T09:48:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa4affd700 1 -- 172.21.15.6:0/3676671532 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a031e02970 con 0x55a031eddd50 2023-09-13T09:48:58.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa4affd700 10 client.27211 handle_command_reply: tid=0 2023-09-13T09:48:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 client.27211 shutdown 2023-09-13T09:48:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 msgr2=0x55a031ed1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031ed1f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7faa600959e0 tx=0x7faa60099380 comp rx=0 tx=0).stop 2023-09-13T09:48:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 shutdown_connections 2023-09-13T09:48:58.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb9060 0x55a031ed94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb7a00 0x55a031ed1f40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031eddd50 0x55a031ee0170 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/3676671532 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb8700 0x55a031ed2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 >> 172.21.15.6:0/3676671532 conn(0x55a031e15c80 msgr2=0x55a031eac7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa4affd700 0 client.27211 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:58.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 shutdown_connections 2023-09-13T09:48:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 1 -- 172.21.15.6:0/3676671532 wait complete. 2023-09-13T09:48:58.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.210+0000 7faa7e38bb80 20 client.27211 trim_cache size 0 max 16384 2023-09-13T09:48:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.229+0000 7faa7e38bb80 1 Processor -- start 2023-09-13T09:48:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.229+0000 7faa7e38bb80 1 -- start start 2023-09-13T09:48:58.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031eb74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031ed1270 con 0x55a031eb7a00 2023-09-13T09:48:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031ed1420 con 0x55a031eb8700 2023-09-13T09:48:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031eb3fd0 con 0x55a031eb9060 2023-09-13T09:48:58.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031eb74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed1cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42712/0 (socket says 172.21.15.6:42712) 2023-09-13T09:48:58.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6bfff700 1 -- 172.21.15.6:0/2738794245 learned_addr learned my addr 172.21.15.6:0/2738794245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6affd700 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6b7fe700 1 -- 172.21.15.6:0/2738794245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 msgr2=0x55a031ed1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6b7fe700 1 -- 172.21.15.6:0/2738794245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 msgr2=0x55a031ed9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6b7fe700 1 -- 172.21.15.6:0/2738794245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a031c35de0 con 0x55a031eb7a00 2023-09-13T09:48:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.230+0000 7faa6bfff700 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.231+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031eb74c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7faa60000c00 tx=0x7faa6000e8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6b5ea9de7a77447 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.231+0000 7faa527fc700 1 -- 172.21.15.6:0/2738794245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600a13d0 con 0x55a031eb7a00 2023-09-13T09:48:58.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.231+0000 7faa527fc700 1 -- 172.21.15.6:0/2738794245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a031eaa670 con 0x55a031eb7a00 2023-09-13T09:48:58.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.231+0000 7faa527fc700 1 -- 172.21.15.6:0/2738794245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60065180 con 0x55a031eb7a00 2023-09-13T09:48:58.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 -- 172.21.15.6:0/2738794245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 msgr2=0x55a031eb74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031eb74c0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7faa60000c00 tx=0x7faa6000e8f0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 -- 172.21.15.6:0/2738794245 shutdown_connections 2023-09-13T09:48:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031eb74c0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/2738794245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 -- 172.21.15.6:0/2738794245 >> 172.21.15.6:0/2738794245 conn(0x55a031e15c80 msgr2=0x55a031ebb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 -- 172.21.15.6:0/2738794245 shutdown_connections 2023-09-13T09:48:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 -- 172.21.15.6:0/2738794245 wait complete. 2023-09-13T09:48:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 -- start start 2023-09-13T09:48:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.232+0000 7faa7e38bb80 1 Processor -- start 2023-09-13T09:48:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031ed8d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa7e38bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031ed5e00 con 0x55a031eb7a00 2023-09-13T09:48:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031ed5f70 con 0x55a031eb8700 2023-09-13T09:48:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa7e38bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a031ed6130 con 0x55a031eb9060 2023-09-13T09:48:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa7e38bb80 10 client.0 _ll_register_callbacks cb 0x55a031da5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:58.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031ed8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031ed8d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39660/0 (socket says 172.21.15.6:39660) 2023-09-13T09:48:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 -- 172.21.15.6:0/827846013 learned_addr learned my addr 172.21.15.6:0/827846013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6bfff700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6affd700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 -- 172.21.15.6:0/827846013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 msgr2=0x55a031ed57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 -- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 msgr2=0x55a031ed9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 -- 172.21.15.6:0/827846013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa640075c0 con 0x55a031eb7a00 2023-09-13T09:48:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6bfff700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:58.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6affd700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:48:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa6b7fe700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031ed8d40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7faa60005830 tx=0x7faa60010a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bad6b1d7e13a93 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.233+0000 7faa4affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa4affd700 1 -- 172.21.15.6:0/827846013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa600a13d0 con 0x55a031eb7a00 2023-09-13T09:48:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa4affd700 1 -- 172.21.15.6:0/827846013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa60099530 con 0x55a031eb7a00 2023-09-13T09:48:58.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa5c021070 con 0x55a031eb7a00 2023-09-13T09:48:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa4affd700 1 -- 172.21.15.6:0/827846013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa6009d170 con 0x55a031eb7a00 2023-09-13T09:48:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 10 client.17892 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a031e217a0 con 0x55a031eb7a00 2023-09-13T09:48:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa4affd700 1 -- 172.21.15.6:0/827846013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa5c021070 con 0x55a031eb7a00 2023-09-13T09:48:58.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa4affd700 1 -- 172.21.15.6:0/827846013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faa6009e0a0 con 0x55a031eb7a00 2023-09-13T09:48:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 10 client.17892 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 10 client.17892 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 20 client.17892 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031f32cd0 0x55a031f350f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 4 client.17892 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:48:58.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.234+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a031dc3050 con 0x55a031f32cd0 2023-09-13T09:48:58.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.235+0000 7faa6affd700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031f32cd0 0x55a031f350f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.236+0000 7faa4affd700 10 client.17892 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:58.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.236+0000 7faa6affd700 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031f32cd0 0x55a031f350f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8320e03bba6913a server_cookie=f1b27b8832d2175e in_seq=0 out_seq=0 2023-09-13T09:48:58.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.236+0000 7faa4affd700 1 -- 172.21.15.6:0/827846013 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a031dc3050 con 0x55a031f32cd0 2023-09-13T09:48:58.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.236+0000 7faa4affd700 10 client.17892 handle_command_reply: tid=0 2023-09-13T09:48:58.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.236+0000 7faa7e38bb80 1 client.17892 shutdown 2023-09-13T09:48:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 msgr2=0x55a031ed8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031ed8d40 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7faa60005830 tx=0x7faa60010a90 comp rx=0 tx=0).stop 2023-09-13T09:48:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 shutdown_connections 2023-09-13T09:48:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a031eb9060 0x55a031ed57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a031f32cd0 0x55a031f350f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a031eb7a00 0x55a031ed8d40 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa4affd700 0 client.17892 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 --2- 172.21.15.6:0/827846013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a031eb8700 0x55a031ed9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 >> 172.21.15.6:0/827846013 conn(0x55a031e15c80 msgr2=0x55a031ed1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 shutdown_connections 2023-09-13T09:48:58.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 1 -- 172.21.15.6:0/827846013 wait complete. 2023-09-13T09:48:58.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.237+0000 7faa7e38bb80 20 client.17892 trim_cache size 0 max 16384 2023-09-13T09:48:58.251 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:48:58.251 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:48:58.252 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:48:58.252 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:48:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.238+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa540a06c0 msgr2=0x7faa540a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.238+0000 7faa721a6700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa540a06c0 0x7faa540a2b80 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7faa5c009c60 tx=0x7faa5c009260 comp rx=0 tx=0).stop 2023-09-13T09:48:58.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.238+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c101880 msgr2=0x7faa6c1011f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.238+0000 7faa721a6700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c101880 0x7faa6c1011f0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7faa6000e9a0 tx=0x7faa6000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.238+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 shutdown_connections 2023-09-13T09:48:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.238+0000 7faa721a6700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6c106ae0 0x7faa6c0ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.239+0000 7faa721a6700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa540a06c0 0x7faa540a2b80 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.239+0000 7faa721a6700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa6c101880 0x7faa6c1011f0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.239+0000 7faa721a6700 1 --2- 172.21.15.6:0/1368128079 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa6c1041b0 0x7faa6c0ff830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.239+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 >> 172.21.15.6:0/1368128079 conn(0x7faa6c0fb250 msgr2=0x7faa6c1024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.239+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 shutdown_connections 2023-09-13T09:48:58.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.239+0000 7faa721a6700 1 -- 172.21.15.6:0/1368128079 wait complete. 2023-09-13T09:48:58.255 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:48:58.256 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:48:58.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:58 smithi131 ceph-mon[102785]: pgmap v583: 97 pgs: 97 active+clean; 185 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 2.5 MiB/s wr, 267 op/s 2023-09-13T09:48:58.280 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:58 smithi006 ceph-mon[98665]: pgmap v583: 97 pgs: 97 active+clean; 185 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 2.5 MiB/s wr, 267 op/s 2023-09-13T09:48:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 -- 172.21.15.6:0/208107801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810100eb0 msgr2=0x7f1810101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 --2- 172.21.15.6:0/208107801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810100eb0 0x7f1810101310 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f1804009920 tx=0x7f1804009c30 comp rx=0 tx=0).stop 2023-09-13T09:48:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 -- 172.21.15.6:0/208107801 shutdown_connections 2023-09-13T09:48:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 --2- 172.21.15.6:0/208107801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1810101850 0x7f1810108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 --2- 172.21.15.6:0/208107801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18100ffcc0 0x7f18101000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 --2- 172.21.15.6:0/208107801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810100eb0 0x7f1810101310 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 -- 172.21.15.6:0/208107801 >> 172.21.15.6:0/208107801 conn(0x7f18100fb210 msgr2=0x7f18100fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 -- 172.21.15.6:0/208107801 shutdown_connections 2023-09-13T09:48:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.396+0000 7f181581b700 1 -- 172.21.15.6:0/208107801 wait complete. 2023-09-13T09:48:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 Processor -- start 2023-09-13T09:48:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 -- start start 2023-09-13T09:48:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18100ffcc0 0x7f1810196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1810100eb0 0x7f1810197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101850 0x7f181019e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019e670 con 0x7f1810101850 2023-09-13T09:48:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019e7b0 con 0x7f18100ffcc0 2023-09-13T09:48:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f181581b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f181019e940 con 0x7f1810100eb0 2023-09-13T09:48:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f180f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101850 0x7f181019e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f180effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18100ffcc0 0x7f1810196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f180f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101850 0x7f181019e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39678/0 (socket says 172.21.15.6:39678) 2023-09-13T09:48:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f180f7fe700 1 -- 172.21.15.6:0/532314496 learned_addr learned my addr 172.21.15.6:0/532314496 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.397+0000 7f180e7fc700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1810100eb0 0x7f1810197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f180f7fe700 1 -- 172.21.15.6:0/532314496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1810100eb0 msgr2=0x7f1810197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f180f7fe700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1810100eb0 0x7f1810197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f180f7fe700 1 -- 172.21.15.6:0/532314496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18100ffcc0 msgr2=0x7f1810196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f180f7fe700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18100ffcc0 0x7f1810196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f180f7fe700 1 -- 172.21.15.6:0/532314496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1804009520 con 0x7f1810101850 2023-09-13T09:48:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f180e7fc700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1810100eb0 0x7f1810197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f180f7fe700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101850 0x7f181019e0a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f180800ef30 tx=0x7f180800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f1814819700 1 -- 172.21.15.6:0/532314496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1808018070 con 0x7f1810101850 2023-09-13T09:48:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f1814819700 1 -- 172.21.15.6:0/532314496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f180800f040 con 0x7f1810101850 2023-09-13T09:48:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f181019ebc0 con 0x7f1810101850 2023-09-13T09:48:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f1814819700 1 -- 172.21.15.6:0/532314496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f180800ccf0 con 0x7f1810101850 2023-09-13T09:48:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.398+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f181019f0d0 con 0x7f1810101850 2023-09-13T09:48:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.399+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f181010b4d0 con 0x7f1810101850 2023-09-13T09:48:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.400+0000 7f1814819700 1 -- 172.21.15.6:0/532314496 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1808003a00 con 0x7f1810101850 2023-09-13T09:48:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.401+0000 7f1814819700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17f80a0640 0x7f17f80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.401+0000 7f180effd700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17f80a0640 0x7f17f80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.401+0000 7f1814819700 1 -- 172.21.15.6:0/532314496 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f18080cb740 con 0x7f1810101850 2023-09-13T09:48:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.401+0000 7f180effd700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17f80a0640 0x7f17f80a2b00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1810100d10 tx=0x7f1800009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.406+0000 7f1814819700 1 -- 172.21.15.6:0/532314496 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1808095250 con 0x7f1810101850 2023-09-13T09:48:58.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:58 smithi053 ceph-mon[102373]: pgmap v583: 97 pgs: 97 active+clean; 185 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 2.5 MiB/s wr, 267 op/s 2023-09-13T09:48:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.675+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f181010b690 con 0x7f1810101850 2023-09-13T09:48:58.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.676+0000 7f1814819700 1 -- 172.21.15.6:0/532314496 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f1808098870 con 0x7f1810101850 2023-09-13T09:48:58.677 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:48:58.677 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:48:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.678+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17f80a0640 msgr2=0x7f17f80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.678+0000 7f181581b700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17f80a0640 0x7f17f80a2b00 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f1810100d10 tx=0x7f1800009310 comp rx=0 tx=0).stop 2023-09-13T09:48:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.678+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101850 msgr2=0x7f181019e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.678+0000 7f181581b700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101850 0x7f181019e0a0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f180800ef30 tx=0x7f180800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.678+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 shutdown_connections 2023-09-13T09:48:58.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.679+0000 7f181581b700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17f80a0640 0x7f17f80a2b00 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.679+0000 7f181581b700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1810101850 0x7f181019e0a0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.679+0000 7f181581b700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18100ffcc0 0x7f1810196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.679+0000 7f181581b700 1 --2- 172.21.15.6:0/532314496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1810100eb0 0x7f1810197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.679+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 >> 172.21.15.6:0/532314496 conn(0x7f18100fb210 msgr2=0x7f1810068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.679+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 shutdown_connections 2023-09-13T09:48:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.679+0000 7f181581b700 1 -- 172.21.15.6:0/532314496 wait complete. 2023-09-13T09:48:58.682 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:48:58.691 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:48:58.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 -- 172.21.15.6:0/1030076475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4102950 msgr2=0x7f53b4109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 --2- 172.21.15.6:0/1030076475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4102950 0x7f53b4109200 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009f90 tx=0x7f53ac00b330 comp rx=0 tx=0).stop 2023-09-13T09:48:58.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 -- 172.21.15.6:0/1030076475 shutdown_connections 2023-09-13T09:48:58.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 --2- 172.21.15.6:0/1030076475 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4102950 0x7f53b4109200 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 --2- 172.21.15.6:0/1030076475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4100dc0 0x7f53b41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 --2- 172.21.15.6:0/1030076475 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4101fb0 0x7f53b4102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 -- 172.21.15.6:0/1030076475 >> 172.21.15.6:0/1030076475 conn(0x7f53b40fc330 msgr2=0x7f53b40fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 -- 172.21.15.6:0/1030076475 shutdown_connections 2023-09-13T09:48:58.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.866+0000 7f53ba472700 1 -- 172.21.15.6:0/1030076475 wait complete. 2023-09-13T09:48:58.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 Processor -- start 2023-09-13T09:48:58.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 -- start start 2023-09-13T09:48:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4100dc0 0x7f53b4196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4101fb0 0x7f53b4197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4102950 0x7f53b419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b419e6c0 con 0x7f53b4102950 2023-09-13T09:48:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b419e800 con 0x7f53b4101fb0 2023-09-13T09:48:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53ba472700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b419e990 con 0x7f53b4100dc0 2023-09-13T09:48:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4102950 0x7f53b419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4100dc0 0x7f53b4196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4102950 0x7f53b419e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39692/0 (socket says 172.21.15.6:39692) 2023-09-13T09:48:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4101fb0 0x7f53b4197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 -- 172.21.15.6:0/2050911104 learned_addr learned my addr 172.21.15.6:0/2050911104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 -- 172.21.15.6:0/2050911104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4100dc0 msgr2=0x7f53b4196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4100dc0 0x7f53b4196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 -- 172.21.15.6:0/2050911104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4101fb0 msgr2=0x7f53b4197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4101fb0 0x7f53b4197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.867+0000 7f53b8a0f700 1 -- 172.21.15.6:0/2050911104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a40095f0 con 0x7f53b4102950 2023-09-13T09:48:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.868+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4102950 0x7f53b419e0f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009f60 tx=0x7f53ac004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.868+0000 7f53b17fa700 1 -- 172.21.15.6:0/2050911104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac00e040 con 0x7f53b4102950 2023-09-13T09:48:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.868+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53ac009c40 con 0x7f53b4102950 2023-09-13T09:48:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.868+0000 7f53b17fa700 1 -- 172.21.15.6:0/2050911104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53ac008e80 con 0x7f53b4102950 2023-09-13T09:48:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.868+0000 7f53b17fa700 1 -- 172.21.15.6:0/2050911104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0052a0 con 0x7f53b4102950 2023-09-13T09:48:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.868+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b419ef50 con 0x7f53b4102950 2023-09-13T09:48:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.870+0000 7f53b17fa700 1 -- 172.21.15.6:0/2050911104 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f53ac01d470 con 0x7f53b4102950 2023-09-13T09:48:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.871+0000 7f53b17fa700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f539c0a0640 0x7f539c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.871+0000 7f53b3fff700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f539c0a0640 0x7f539c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.871+0000 7f53b17fa700 1 -- 172.21.15.6:0/2050911104 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f53ac0cd080 con 0x7f53b4102950 2023-09-13T09:48:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.871+0000 7f53b3fff700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f539c0a0640 0x7f539c0a2b00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53b4101e10 tx=0x7f53a4009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 Processor -- start 2023-09-13T09:48:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 -- start start 2023-09-13T09:48:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6ae700 0x55d32a6aeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6af060 0x55d32a6ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a606780 con 0x55d32a6ae700 2023-09-13T09:48:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a6040a0 con 0x55d32a6ada00 2023-09-13T09:48:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53c6657b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a5ff990 con 0x55d32a6af060 2023-09-13T09:48:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6ae700 0x55d32a6aeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53b3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6ae700 0x55d32a6aeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39696/0 (socket says 172.21.15.6:39696) 2023-09-13T09:48:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53b3fff700 1 -- 172.21.15.6:0/582887837 learned_addr learned my addr 172.21.15.6:0/582887837 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.872+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f53b37fe700 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6af060 0x55d32a6ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f53b3fff700 1 -- 172.21.15.6:0/582887837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6af060 msgr2=0x55d32a6ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f53b3fff700 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6af060 0x55d32a6ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f53b3fff700 1 -- 172.21.15.6:0/582887837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 msgr2=0x55d32a6ade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f53b3fff700 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ade80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f53b3fff700 1 -- 172.21.15.6:0/582887837 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d32a47f630 con 0x55d32a6ae700 2023-09-13T09:48:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f53b3fff700 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6ae700 0x55d32a6aeb20 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f53a400e680 tx=0x7f53a4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ad6c84b4a95fc83 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f539a7fc700 1 -- 172.21.15.6:0/582887837 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a4004a30 con 0x55d32a6ae700 2023-09-13T09:48:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f539a7fc700 1 -- 172.21.15.6:0/582887837 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a4021070 con 0x55d32a6ae700 2023-09-13T09:48:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.873+0000 7f539a7fc700 1 -- 172.21.15.6:0/582887837 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a40266e0 con 0x55d32a6ae700 2023-09-13T09:48:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 -- 172.21.15.6:0/582887837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6ae700 msgr2=0x55d32a6aeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6ae700 0x55d32a6aeb20 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f53a400e680 tx=0x7f53a4014000 comp rx=0 tx=0).stop 2023-09-13T09:48:58.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 -- 172.21.15.6:0/582887837 shutdown_connections 2023-09-13T09:48:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6ae700 0x55d32a6aeb20 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 --2- 172.21.15.6:0/582887837 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6af060 0x55d32a6ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 -- 172.21.15.6:0/582887837 >> 172.21.15.6:0/582887837 conn(0x55d32a60bc80 msgr2=0x55d32a6a7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 -- 172.21.15.6:0/582887837 shutdown_connections 2023-09-13T09:48:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.874+0000 7f53c6657b80 1 -- 172.21.15.6:0/582887837 wait complete. 2023-09-13T09:48:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 -- start start 2023-09-13T09:48:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 Processor -- start 2023-09-13T09:48:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6be590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a59dbb0 con 0x55d32a6af060 2023-09-13T09:48:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a59d8b0 con 0x55d32a6ada00 2023-09-13T09:48:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a481920 con 0x55d32a6ae700 2023-09-13T09:48:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53c6657b80 10 client.0 _ll_register_callbacks cb 0x55d32a59b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:58.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6be590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53b37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6be590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39704/0 (socket says 172.21.15.6:39704) 2023-09-13T09:48:58.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.875+0000 7f53b8a0f700 1 -- 172.21.15.6:0/1268548134 learned_addr learned my addr 172.21.15.6:0/1268548134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53b8a0f700 1 -- 172.21.15.6:0/1268548134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 msgr2=0x55d32a6b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53b8a0f700 1 -- 172.21.15.6:0/1268548134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 msgr2=0x55d32a6b7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6b7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53b8a0f700 1 -- 172.21.15.6:0/1268548134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a4017070 con 0x55d32a6af060 2023-09-13T09:48:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53b37fe700 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6be590 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f53ac007930 tx=0x7f53ac09a740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a94cfbdb57fb59 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53937fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53937fe700 1 -- 172.21.15.6:0/1268548134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac09aff0 con 0x55d32a6af060 2023-09-13T09:48:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53937fe700 1 -- 172.21.15.6:0/1268548134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f53ac09a8f0 con 0x55d32a6af060 2023-09-13T09:48:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d32a6a0670 con 0x55d32a6af060 2023-09-13T09:48:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53937fe700 1 -- 172.21.15.6:0/1268548134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53ac09e720 con 0x55d32a6af060 2023-09-13T09:48:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53c6657b80 10 client.17910 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d32a6177a0 con 0x55d32a6af060 2023-09-13T09:48:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.876+0000 7f53937fe700 1 -- 172.21.15.6:0/1268548134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53ac064020 con 0x55d32a6af060 2023-09-13T09:48:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53937fe700 1 -- 172.21.15.6:0/1268548134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f53ac099de0 con 0x55d32a6af060 2023-09-13T09:48:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53c6657b80 10 client.17910 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53c6657b80 10 client.17910 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:48:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53c6657b80 20 client.17910 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c7000 0x55d32a6c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53c6657b80 4 client.17910 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d32a5f8970 con 0x55d32a6c7000 2023-09-13T09:48:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53b3fff700 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c7000 0x55d32a6c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53937fe700 10 client.17910 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.877+0000 7f53b3fff700 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c7000 0x55d32a6c93f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e1943004096ba6ae server_cookie=f73743303d5f0d3d in_seq=0 out_seq=0 2023-09-13T09:48:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53937fe700 1 -- 172.21.15.6:0/1268548134 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d32a5f8970 con 0x55d32a6c7000 2023-09-13T09:48:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53937fe700 10 client.17910 handle_command_reply: tid=0 2023-09-13T09:48:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 client.17910 shutdown 2023-09-13T09:48:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 msgr2=0x55d32a6be590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6be590 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f53ac007930 tx=0x7f53ac09a740 comp rx=0 tx=0).stop 2023-09-13T09:48:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 shutdown_connections 2023-09-13T09:48:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c7000 0x55d32a6c93f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6be590 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53937fe700 0 client.17910 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6b7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1268548134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 >> 172.21.15.6:0/1268548134 conn(0x55d32a60bc80 msgr2=0x55d32a6a27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 shutdown_connections 2023-09-13T09:48:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 1 -- 172.21.15.6:0/1268548134 wait complete. 2023-09-13T09:48:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.878+0000 7f53c6657b80 20 client.17910 trim_cache size 0 max 16384 2023-09-13T09:48:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 Processor -- start 2023-09-13T09:48:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 -- start start 2023-09-13T09:48:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6be550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6b7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a6b7c90 con 0x55d32a6af060 2023-09-13T09:48:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a6b4c80 con 0x55d32a6ada00 2023-09-13T09:48:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53c6657b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a6b24d0 con 0x55d32a6ae700 2023-09-13T09:48:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6b7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33232/0 (socket says 172.21.15.6:33232) 2023-09-13T09:48:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6b7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39712/0 (socket says 172.21.15.6:39712) 2023-09-13T09:48:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b3fff700 1 -- 172.21.15.6:0/2098835102 learned_addr learned my addr 172.21.15.6:0/2098835102 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b37fe700 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6be550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b8a0f700 1 -- 172.21.15.6:0/2098835102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 msgr2=0x55d32a6be550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6be550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b8a0f700 1 -- 172.21.15.6:0/2098835102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 msgr2=0x55d32a6ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b8a0f700 1 -- 172.21.15.6:0/2098835102 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d32a42bde0 con 0x55d32a6af060 2023-09-13T09:48:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.892+0000 7f53b3fff700 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.893+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6b7010 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f53ac004cf0 tx=0x7f53ac0a24e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8564dd8e2c8a096b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.893+0000 7f539affd700 1 -- 172.21.15.6:0/2098835102 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac004ea0 con 0x55d32a6af060 2023-09-13T09:48:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.893+0000 7f539affd700 1 -- 172.21.15.6:0/2098835102 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53ac064020 con 0x55d32a6af060 2023-09-13T09:48:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.893+0000 7f539affd700 1 -- 172.21.15.6:0/2098835102 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53ac0a28d0 con 0x55d32a6af060 2023-09-13T09:48:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 -- 172.21.15.6:0/2098835102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 msgr2=0x55d32a6b7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6b7010 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f53ac004cf0 tx=0x7f53ac0a24e0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 -- 172.21.15.6:0/2098835102 shutdown_connections 2023-09-13T09:48:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6b7010 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 --2- 172.21.15.6:0/2098835102 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6be550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 -- 172.21.15.6:0/2098835102 >> 172.21.15.6:0/2098835102 conn(0x55d32a60bc80 msgr2=0x55d32a6b4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 -- 172.21.15.6:0/2098835102 shutdown_connections 2023-09-13T09:48:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 -- 172.21.15.6:0/2098835102 wait complete. 2023-09-13T09:48:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 -- start start 2023-09-13T09:48:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.894+0000 7f53c6657b80 1 Processor -- start 2023-09-13T09:48:58.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6baa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53c6657b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6bda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53c6657b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a6bdf70 con 0x55d32a6af060 2023-09-13T09:48:58.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53c6657b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a6be0e0 con 0x55d32a6ada00 2023-09-13T09:48:58.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53c6657b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d32a6be2a0 con 0x55d32a6ae700 2023-09-13T09:48:58.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53c6657b80 10 client.0 _ll_register_callbacks cb 0x55d32a59b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:58.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6bda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6baa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b8a0f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6bda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39716/0 (socket says 172.21.15.6:39716) 2023-09-13T09:48:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b8a0f700 1 -- 172.21.15.6:0/1986212371 learned_addr learned my addr 172.21.15.6:0/1986212371 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b3fff700 1 -- 172.21.15.6:0/1986212371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 msgr2=0x55d32a6baa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b3fff700 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6baa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b3fff700 1 -- 172.21.15.6:0/1986212371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 msgr2=0x55d32a6bda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:58.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b3fff700 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6bda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b3fff700 1 -- 172.21.15.6:0/1986212371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d32a47f630 con 0x55d32a6ada00 2023-09-13T09:48:58.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b8a0f700 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6bda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:58.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53b3fff700 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ba4d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005850 tx=0x7f53a4005900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21daf3e0d417066b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:58.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.895+0000 7f53937fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:48:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53937fe700 1 -- 172.21.15.6:0/1986212371 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a402a040 con 0x55d32a6ada00 2023-09-13T09:48:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53a4021070 con 0x55d32a6ada00 2023-09-13T09:48:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53937fe700 1 -- 172.21.15.6:0/1986212371 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f53a40049d0 con 0x55d32a6ada00 2023-09-13T09:48:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53937fe700 1 -- 172.21.15.6:0/1986212371 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53a400ed20 con 0x55d32a6ada00 2023-09-13T09:48:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 10 client.27317 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:58.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d32a6177a0 con 0x55d32a6ada00 2023-09-13T09:48:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53937fe700 1 -- 172.21.15.6:0/1986212371 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f53a4021070 con 0x55d32a6ada00 2023-09-13T09:48:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53937fe700 1 -- 172.21.15.6:0/1986212371 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f53a4005000 con 0x55d32a6ada00 2023-09-13T09:48:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 10 client.27317 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 10 client.27317 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:48:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 20 client.27317 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c09e0 0x55d32a6c2e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 4 client.27317 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.896+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d32a5b9050 con 0x55d32a6c09e0 2023-09-13T09:48:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53b37fe700 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c09e0 0x55d32a6c2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53937fe700 10 client.27317 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53b37fe700 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c09e0 0x55d32a6c2e00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8be7676f5ad44fc8 server_cookie=f56671ffdbf6c1db in_seq=0 out_seq=0 2023-09-13T09:48:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53937fe700 1 -- 172.21.15.6:0/1986212371 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d32a5b9050 con 0x55d32a6c09e0 2023-09-13T09:48:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53937fe700 10 client.27317 handle_command_reply: tid=0 2023-09-13T09:48:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 client.27317 shutdown 2023-09-13T09:48:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 msgr2=0x55d32a6ba4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ba4d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53a4005850 tx=0x7f53a4005900 comp rx=0 tx=0).stop 2023-09-13T09:48:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 shutdown_connections 2023-09-13T09:48:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d32a6c09e0 0x55d32a6c2e00 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d32a6af060 0x55d32a6bda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d32a6ada00 0x55d32a6ba4d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 --2- 172.21.15.6:0/1986212371 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d32a6ae700 0x55d32a6baa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53937fe700 0 client.27317 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:48:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 >> 172.21.15.6:0/1986212371 conn(0x55d32a60bc80 msgr2=0x55d32a6b1940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 shutdown_connections 2023-09-13T09:48:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 1 -- 172.21.15.6:0/1986212371 wait complete. 2023-09-13T09:48:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.897+0000 7f53c6657b80 20 client.27317 trim_cache size 0 max 16384 2023-09-13T09:48:58.921 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f539c0a0640 msgr2=0x7f539c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f539c0a0640 0x7f539c0a2b00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f53b4101e10 tx=0x7f53a4009310 comp rx=0 tx=0).stop 2023-09-13T09:48:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4102950 msgr2=0x7f53b419e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4102950 0x7f53b419e0f0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f53ac009f60 tx=0x7f53ac004c80 comp rx=0 tx=0).stop 2023-09-13T09:48:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 shutdown_connections 2023-09-13T09:48:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f539c0a0640 0x7f539c0a2b00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53b4102950 0x7f53b419e0f0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53b4100dc0 0x7f53b4196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 --2- 172.21.15.6:0/2050911104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f53b4101fb0 0x7f53b4197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 >> 172.21.15.6:0/2050911104 conn(0x7f53b40fc330 msgr2=0x7f53b4105400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 shutdown_connections 2023-09-13T09:48:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:58.898+0000 7f53ba472700 1 -- 172.21.15.6:0/2050911104 wait complete. 2023-09-13T09:48:58.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:48:59.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 -- 172.21.15.6:0/1689942623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 msgr2=0x7ffacc1080c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1689942623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1080c0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7ffac400b0d0 tx=0x7ffac400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 -- 172.21.15.6:0/1689942623 shutdown_connections 2023-09-13T09:48:59.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1689942623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1080c0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1689942623 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffacc0ffc80 0x7ffacc1000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1689942623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc100e70 0x7ffacc1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 -- 172.21.15.6:0/1689942623 >> 172.21.15.6:0/1689942623 conn(0x7ffacc0fb210 msgr2=0x7ffacc0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 -- 172.21.15.6:0/1689942623 shutdown_connections 2023-09-13T09:48:59.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.058+0000 7ffad1f19700 1 -- 172.21.15.6:0/1689942623 wait complete. 2023-09-13T09:48:59.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 Processor -- start 2023-09-13T09:48:59.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 -- start start 2023-09-13T09:48:59.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ffc80 0x7ffacc198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffacc100e70 0x7ffacc199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1a03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1a09a0 con 0x7ffacc101810 2023-09-13T09:48:59.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1a0ae0 con 0x7ffacc100e70 2023-09-13T09:48:59.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffad1f19700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffacc1a0c70 con 0x7ffacc0ffc80 2023-09-13T09:48:59.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1a03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffacc100e70 0x7ffacc199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1a03d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39730/0 (socket says 172.21.15.6:39730) 2023-09-13T09:48:59.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffacbfff700 1 -- 172.21.15.6:0/1833515776 learned_addr learned my addr 172.21.15.6:0/1833515776 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.059+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffacc100e70 0x7ffacc199360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33252/0 (socket says 172.21.15.6:33252) 2023-09-13T09:48:59.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ffc80 0x7ffacc198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffacbfff700 1 -- 172.21.15.6:0/1833515776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ffc80 msgr2=0x7ffacc198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffacbfff700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ffc80 0x7ffacc198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffacbfff700 1 -- 172.21.15.6:0/1833515776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffacc100e70 msgr2=0x7ffacc199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffacbfff700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffacc100e70 0x7ffacc199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffacbfff700 1 -- 172.21.15.6:0/1833515776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac4009d00 con 0x7ffacc101810 2023-09-13T09:48:59.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffacbfff700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1a03d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ffac4008eb0 tx=0x7ffac4008ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffac8ff9700 1 -- 172.21.15.6:0/1833515776 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac400e040 con 0x7ffacc101810 2023-09-13T09:48:59.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffac8ff9700 1 -- 172.21.15.6:0/1833515776 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffac400bdb0 con 0x7ffacc101810 2023-09-13T09:48:59.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffacc1a0ef0 con 0x7ffacc101810 2023-09-13T09:48:59.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffac8ff9700 1 -- 172.21.15.6:0/1833515776 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac401d470 con 0x7ffacc101810 2023-09-13T09:48:59.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.060+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc1a12c0 con 0x7ffacc101810 2023-09-13T09:48:59.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.062+0000 7ffac8ff9700 1 -- 172.21.15.6:0/1833515776 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ffac4005020 con 0x7ffacc101810 2023-09-13T09:48:59.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.063+0000 7ffac8ff9700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffab80a0640 0x7ffab80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.063+0000 7ffac8ff9700 1 -- 172.21.15.6:0/1833515776 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffac40cce10 con 0x7ffacc101810 2023-09-13T09:48:59.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.063+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffab80a0640 0x7ffab80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffab80a0640 0x7ffab80a2b00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffacc100cd0 tx=0x7ffabc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffade0feb80 1 Processor -- start 2023-09-13T09:48:59.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffade0feb80 1 -- start start 2023-09-13T09:48:59.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eae700 0x557934eaeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ead4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eada00 0x557934eade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffade0feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934e06780 con 0x557934eada00 2023-09-13T09:48:59.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.064+0000 7ffade0feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934e040a0 con 0x557934eaf060 2023-09-13T09:48:59.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffade0feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934dff990 con 0x557934eae700 2023-09-13T09:48:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ead4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eada00 0x557934eade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eae700 0x557934eaeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ead4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33260/0 (socket says 172.21.15.6:33260) 2023-09-13T09:48:59.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eada00 0x557934eade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39738/0 (socket says 172.21.15.6:39738) 2023-09-13T09:48:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacaffd700 1 -- 172.21.15.6:0/311585344 learned_addr learned my addr 172.21.15.6:0/311585344 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 -- 172.21.15.6:0/311585344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eae700 msgr2=0x557934eaeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eae700 0x557934eaeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 -- 172.21.15.6:0/311585344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 msgr2=0x557934ead4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ead4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 -- 172.21.15.6:0/311585344 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557934c7f630 con 0x557934eada00 2023-09-13T09:48:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacaffd700 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ead4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffacbfff700 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eada00 0x557934eade80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffac40cac30 tx=0x7ffac400b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6f26764ed22cbc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffac1ffb700 1 -- 172.21.15.6:0/311585344 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac4099fa0 con 0x557934eada00 2023-09-13T09:48:59.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffac1ffb700 1 -- 172.21.15.6:0/311585344 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffac4083e90 con 0x557934eada00 2023-09-13T09:48:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.065+0000 7ffac1ffb700 1 -- 172.21.15.6:0/311585344 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40989e0 con 0x557934eada00 2023-09-13T09:48:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 -- 172.21.15.6:0/311585344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eada00 msgr2=0x557934eade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eada00 0x557934eade80 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7ffac40cac30 tx=0x7ffac400b730 comp rx=0 tx=0).stop 2023-09-13T09:48:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 -- 172.21.15.6:0/311585344 shutdown_connections 2023-09-13T09:48:59.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eada00 0x557934eade80 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eae700 0x557934eaeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 --2- 172.21.15.6:0/311585344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ead4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 -- 172.21.15.6:0/311585344 >> 172.21.15.6:0/311585344 conn(0x557934e0bc80 msgr2=0x557934ea7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 -- 172.21.15.6:0/311585344 shutdown_connections 2023-09-13T09:48:59.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 -- 172.21.15.6:0/311585344 wait complete. 2023-09-13T09:48:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.066+0000 7ffade0feb80 1 -- start start 2023-09-13T09:48:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 1 Processor -- start 2023-09-13T09:48:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eada00 0x557934eb6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eb7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eaf060 0x557934ebe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934d9dbb0 con 0x557934eae700 2023-09-13T09:48:59.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934d9d8b0 con 0x557934eada00 2023-09-13T09:48:59.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934c81920 con 0x557934eaf060 2023-09-13T09:48:59.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffade0feb80 10 client.0 _ll_register_callbacks cb 0x557934d9b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eb7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacb7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eada00 0x557934eb6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eb7200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39742/0 (socket says 172.21.15.6:39742) 2023-09-13T09:48:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 -- 172.21.15.6:0/2179752452 learned_addr learned my addr 172.21.15.6:0/2179752452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacbfff700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eaf060 0x557934ebe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 -- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eaf060 msgr2=0x557934ebe240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eaf060 0x557934ebe240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 -- 172.21.15.6:0/2179752452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eada00 msgr2=0x557934eb6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eada00 0x557934eb6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacaffd700 1 -- 172.21.15.6:0/2179752452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffacc1a12c0 con 0x557934eae700 2023-09-13T09:48:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacbfff700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eaf060 0x557934ebe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:59.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.067+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eada00 0x557934eb6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffacaffd700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eb7200 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffab4011750 tx=0x7ffab4011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04ef6db1f28d277 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffaaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffaaaffd700 1 -- 172.21.15.6:0/2179752452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4016070 con 0x557934eae700 2023-09-13T09:48:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffaaaffd700 1 -- 172.21.15.6:0/2179752452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffab4004260 con 0x557934eae700 2023-09-13T09:48:59.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557934ea0670 con 0x557934eae700 2023-09-13T09:48:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffaaaffd700 1 -- 172.21.15.6:0/2179752452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffab4004420 con 0x557934eae700 2023-09-13T09:48:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 10 client.17928 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557934e177a0 con 0x557934eae700 2023-09-13T09:48:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffaaaffd700 1 -- 172.21.15.6:0/2179752452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffab4029080 con 0x557934eae700 2023-09-13T09:48:59.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffaaaffd700 1 -- 172.21.15.6:0/2179752452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffab400f750 con 0x557934eae700 2023-09-13T09:48:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 10 client.17928 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 10 client.17928 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:48:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 20 client.17928 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934ec2b20 0x557934ec4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 4 client.17928 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.068+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557934df8970 con 0x557934ec2b20 2023-09-13T09:48:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.069+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934ec2b20 0x557934ec4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.069+0000 7ffaaaffd700 10 client.17928 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.069+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934ec2b20 0x557934ec4f40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4d6cbb058523361b server_cookie=c6cf3b9803695e5b in_seq=0 out_seq=0 2023-09-13T09:48:59.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.069+0000 7ffaaaffd700 1 -- 172.21.15.6:0/2179752452 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557934df8970 con 0x557934ec2b20 2023-09-13T09:48:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.069+0000 7ffaaaffd700 10 client.17928 handle_command_reply: tid=0 2023-09-13T09:48:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.069+0000 7ffade0feb80 1 client.17928 shutdown 2023-09-13T09:48:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 msgr2=0x557934eb7200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eb7200 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ffab4011750 tx=0x7ffab4011b10 comp rx=0 tx=0).stop 2023-09-13T09:48:59.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 shutdown_connections 2023-09-13T09:48:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934ec2b20 0x557934ec4f40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eaf060 0x557934ebe240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eada00 0x557934eb6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 --2- 172.21.15.6:0/2179752452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eb7200 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffaaaffd700 0 client.17928 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 >> 172.21.15.6:0/2179752452 conn(0x557934e0bc80 msgr2=0x557934ea27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 shutdown_connections 2023-09-13T09:48:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 1 -- 172.21.15.6:0/2179752452 wait complete. 2023-09-13T09:48:59.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.070+0000 7ffade0feb80 20 client.17928 trim_cache size 0 max 16384 2023-09-13T09:48:59.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 Processor -- start 2023-09-13T09:48:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 -- start start 2023-09-13T09:48:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934ead4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eae700 0x557934ebe200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eaf060 0x557934eb6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934eb6830 con 0x557934eaf060 2023-09-13T09:48:59.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934ea8a60 con 0x557934eae700 2023-09-13T09:48:59.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffade0feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934ea9730 con 0x557934eada00 2023-09-13T09:48:59.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eaf060 0x557934eb6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eaf060 0x557934eb6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39752/0 (socket says 172.21.15.6:39752) 2023-09-13T09:48:59.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 -- 172.21.15.6:0/1094435938 learned_addr learned my addr 172.21.15.6:0/1094435938 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934ead4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacaffd700 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eae700 0x557934ebe200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 -- 172.21.15.6:0/1094435938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 msgr2=0x557934ead4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934ead4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 -- 172.21.15.6:0/1094435938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eae700 msgr2=0x557934ebe200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eae700 0x557934ebe200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 -- 172.21.15.6:0/1094435938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557934c2bde0 con 0x557934eaf060 2023-09-13T09:48:59.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacaffd700 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eae700 0x557934ebe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:48:59.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.083+0000 7ffacbfff700 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eaf060 0x557934eb6c80 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ffac409a5d0 tx=0x7ffac4009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14945dc3df1d0e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffac27fc700 1 -- 172.21.15.6:0/1094435938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac40a2690 con 0x557934eaf060 2023-09-13T09:48:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffac27fc700 1 -- 172.21.15.6:0/1094435938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffac40b1070 con 0x557934eaf060 2023-09-13T09:48:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffac27fc700 1 -- 172.21.15.6:0/1094435938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffac409e120 con 0x557934eaf060 2023-09-13T09:48:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 -- 172.21.15.6:0/1094435938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eaf060 msgr2=0x557934eb6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eaf060 0x557934eb6c80 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ffac409a5d0 tx=0x7ffac4009c30 comp rx=0 tx=0).stop 2023-09-13T09:48:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 -- 172.21.15.6:0/1094435938 shutdown_connections 2023-09-13T09:48:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eaf060 0x557934eb6c80 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934ead4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 --2- 172.21.15.6:0/1094435938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eae700 0x557934ebe200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 -- 172.21.15.6:0/1094435938 >> 172.21.15.6:0/1094435938 conn(0x557934e0bc80 msgr2=0x557934eb5970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 -- 172.21.15.6:0/1094435938 shutdown_connections 2023-09-13T09:48:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.084+0000 7ffade0feb80 1 -- 172.21.15.6:0/1094435938 wait complete. 2023-09-13T09:48:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 -- start start 2023-09-13T09:48:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 Processor -- start 2023-09-13T09:48:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934eb9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ebd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934ebd5a0 con 0x557934eae700 2023-09-13T09:48:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934ebd710 con 0x557934eaf060 2023-09-13T09:48:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557934ebd8d0 con 0x557934eada00 2023-09-13T09:48:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffade0feb80 10 client.0 _ll_register_callbacks cb 0x557934d9b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffacaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eba040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39756/0 (socket says 172.21.15.6:39756) 2023-09-13T09:48:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffacaffd700 1 -- 172.21.15.6:0/3766397504 learned_addr learned my addr 172.21.15.6:0/3766397504 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.085+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934eb9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffacaffd700 1 -- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 msgr2=0x557934eb9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffacaffd700 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934eb9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffacaffd700 1 -- 172.21.15.6:0/3766397504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 msgr2=0x557934ebd060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:48:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffacaffd700 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ebd060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffacaffd700 1 -- 172.21.15.6:0/3766397504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557934c7f630 con 0x557934eae700 2023-09-13T09:48:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffacaffd700 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eba040 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ffab4005a80 tx=0x7ffab400ffd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d09da16cfaa412 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffaaaffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffaaaffd700 1 -- 172.21.15.6:0/3766397504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab4016070 con 0x557934eae700 2023-09-13T09:48:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffac4083e90 con 0x557934eae700 2023-09-13T09:48:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffaaaffd700 1 -- 172.21.15.6:0/3766397504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ffab4000e40 con 0x557934eae700 2023-09-13T09:48:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffaaaffd700 1 -- 172.21.15.6:0/3766397504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffab400f8f0 con 0x557934eae700 2023-09-13T09:48:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffade0feb80 10 client.17934 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557934c14c60 con 0x557934eae700 2023-09-13T09:48:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffaaaffd700 1 -- 172.21.15.6:0/3766397504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ffac4083e90 con 0x557934eae700 2023-09-13T09:48:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.086+0000 7ffaaaffd700 1 -- 172.21.15.6:0/3766397504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ffab40039b0 con 0x557934eae700 2023-09-13T09:48:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffade0feb80 10 client.17934 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffade0feb80 10 client.17934 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:48:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffade0feb80 20 client.17934 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffade0feb80 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934f173e0 0x557934f19800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffade0feb80 4 client.17934 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557934db9050 con 0x557934f173e0 2023-09-13T09:48:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934f173e0 0x557934f19800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffaaaffd700 10 client.17934 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934f173e0 0x557934f19800 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b25922482a5184f1 server_cookie=952ab985fb4b9749 in_seq=0 out_seq=0 2023-09-13T09:48:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffaaaffd700 1 -- 172.21.15.6:0/3766397504 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557934db9050 con 0x557934f173e0 2023-09-13T09:48:59.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffaaaffd700 10 client.17934 handle_command_reply: tid=0 2023-09-13T09:48:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.087+0000 7ffade0feb80 1 client.17934 shutdown 2023-09-13T09:48:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 msgr2=0x557934eba040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eba040 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7ffab4005a80 tx=0x7ffab400ffd0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 shutdown_connections 2023-09-13T09:48:59.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x557934f173e0 0x557934f19800 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557934eaf060 0x557934ebd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffaaaffd700 0 client.17934 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:48:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557934eada00 0x557934eb9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 --2- 172.21.15.6:0/3766397504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557934eae700 0x557934eba040 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 >> 172.21.15.6:0/3766397504 conn(0x557934e0bc80 msgr2=0x557934eb18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 shutdown_connections 2023-09-13T09:48:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 1 -- 172.21.15.6:0/3766397504 wait complete. 2023-09-13T09:48:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffade0feb80 20 client.17934 trim_cache size 0 max 16384 2023-09-13T09:48:59.113 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffab80a0640 msgr2=0x7ffab80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffab80a0640 0x7ffab80a2b00 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ffacc100cd0 tx=0x7ffabc009260 comp rx=0 tx=0).stop 2023-09-13T09:48:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 msgr2=0x7ffacc1a03d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1a03d0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7ffac4008eb0 tx=0x7ffac4008ee0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 shutdown_connections 2023-09-13T09:48:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ffab80a0640 0x7ffab80a2b00 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffacc101810 0x7ffacc1a03d0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffacc0ffc80 0x7ffacc198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 --2- 172.21.15.6:0/1833515776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ffacc100e70 0x7ffacc199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.088+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 >> 172.21.15.6:0/1833515776 conn(0x7ffacc0fb210 msgr2=0x7ffacc069220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.089+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 shutdown_connections 2023-09-13T09:48:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.089+0000 7ffad1f19700 1 -- 172.21.15.6:0/1833515776 wait complete. 2023-09-13T09:48:59.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:48:59.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 508789 5.96 MB/sec execute 379 sec latency 28.941 ms 2023-09-13T09:48:59.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 -- 172.21.15.6:0/650698696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90100dc0 msgr2=0x7fdf901011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 --2- 172.21.15.6:0/650698696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90100dc0 0x7fdf901011e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fdf800099c0 tx=0x7fdf80009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 -- 172.21.15.6:0/650698696 shutdown_connections 2023-09-13T09:48:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 --2- 172.21.15.6:0/650698696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf90102950 0x7fdf90109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 --2- 172.21.15.6:0/650698696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90100dc0 0x7fdf901011e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 --2- 172.21.15.6:0/650698696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf90101fb0 0x7fdf90102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 -- 172.21.15.6:0/650698696 >> 172.21.15.6:0/650698696 conn(0x7fdf900fc350 msgr2=0x7fdf900fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 -- 172.21.15.6:0/650698696 shutdown_connections 2023-09-13T09:48:59.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.253+0000 7fdf95430700 1 -- 172.21.15.6:0/650698696 wait complete. 2023-09-13T09:48:59.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 Processor -- start 2023-09-13T09:48:59.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 -- start start 2023-09-13T09:48:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf90100dc0 0x7fdf90074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90101fb0 0x7fdf900730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf90102950 0x7fdf900735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf90073d80 con 0x7fdf90102950 2023-09-13T09:48:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf90073ef0 con 0x7fdf90101fb0 2023-09-13T09:48:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf95430700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf901a0af0 con 0x7fdf90100dc0 2023-09-13T09:48:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf8e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90101fb0 0x7fdf900730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf90102950 0x7fdf900735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf8e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90101fb0 0x7fdf900730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33290/0 (socket says 172.21.15.6:33290) 2023-09-13T09:48:59.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf8e7fc700 1 -- 172.21.15.6:0/2570279389 learned_addr learned my addr 172.21.15.6:0/2570279389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.254+0000 7fdf8effd700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf90100dc0 0x7fdf90074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/2570279389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf90100dc0 msgr2=0x7fdf90074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf90100dc0 0x7fdf90074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/2570279389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90101fb0 msgr2=0x7fdf900730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90101fb0 0x7fdf900730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/2570279389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf800095f0 con 0x7fdf90102950 2023-09-13T09:48:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf8e7fc700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90101fb0 0x7fdf900730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf90102950 0x7fdf900735e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800efc0 tx=0x7fdf8800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf77fff700 1 -- 172.21.15.6:0/2570279389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88018070 con 0x7fdf90102950 2023-09-13T09:48:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf901a0d70 con 0x7fdf90102950 2023-09-13T09:48:59.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf77fff700 1 -- 172.21.15.6:0/2570279389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf8800f040 con 0x7fdf90102950 2023-09-13T09:48:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf77fff700 1 -- 172.21.15.6:0/2570279389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8800cd40 con 0x7fdf90102950 2023-09-13T09:48:59.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.255+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf901a1220 con 0x7fdf90102950 2023-09-13T09:48:59.263 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:48:59 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/532314496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:48:59.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.259+0000 7fdf77fff700 1 -- 172.21.15.6:0/2570279389 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdf88003a00 con 0x7fdf90102950 2023-09-13T09:48:59.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.259+0000 7fdf77fff700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf780a0640 0x7fdf780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.259+0000 7fdfa1615b80 1 Processor -- start 2023-09-13T09:48:59.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.259+0000 7fdfa1615b80 1 -- start start 2023-09-13T09:48:59.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.259+0000 7fdf77fff700 1 -- 172.21.15.6:0/2570279389 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf880cb7d0 con 0x7fdf90102950 2023-09-13T09:48:59.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.259+0000 7fdf8effd700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf780a0640 0x7fdf780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20bfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20bee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a2017780 con 0x5623a20c0060 2023-09-13T09:48:59.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a20150a0 con 0x5623a20bea00 2023-09-13T09:48:59.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a2010990 con 0x5623a20bf700 2023-09-13T09:48:59.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20bee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20bee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33300/0 (socket says 172.21.15.6:33300) 2023-09-13T09:48:59.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/85174953 learned_addr learned my addr 172.21.15.6:0/85174953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8e7fc700 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8effd700 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20bfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/85174953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 msgr2=0x5623a20bfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20bfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/85174953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 msgr2=0x5623a20be4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20be4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/85174953 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623a1e90630 con 0x5623a20bea00 2023-09-13T09:48:59.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8e7fc700 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8effd700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf780a0640 0x7fdf780a2b00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009990 tx=0x7fdf8000b940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.260+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20bee80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdf880cbab0 tx=0x7fdf88095440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31f556a77c437976 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdf757fa700 1 -- 172.21.15.6:0/85174953 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf88098960 con 0x5623a20bea00 2023-09-13T09:48:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdf757fa700 1 -- 172.21.15.6:0/85174953 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf88004ad0 con 0x5623a20bea00 2023-09-13T09:48:59.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdf757fa700 1 -- 172.21.15.6:0/85174953 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8801b320 con 0x5623a20bea00 2023-09-13T09:48:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdfa1615b80 1 -- 172.21.15.6:0/85174953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 msgr2=0x5623a20bee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20bee80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fdf880cbab0 tx=0x7fdf88095440 comp rx=0 tx=0).stop 2023-09-13T09:48:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdfa1615b80 1 -- 172.21.15.6:0/85174953 shutdown_connections 2023-09-13T09:48:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20bee80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20bfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/85174953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20be4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.261+0000 7fdfa1615b80 1 -- 172.21.15.6:0/85174953 >> 172.21.15.6:0/85174953 conn(0x5623a201cc80 msgr2=0x5623a20b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 -- 172.21.15.6:0/85174953 shutdown_connections 2023-09-13T09:48:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 -- 172.21.15.6:0/85174953 wait complete. 2023-09-13T09:48:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 -- start start 2023-09-13T09:48:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 Processor -- start 2023-09-13T09:48:59.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20cf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a1faebb0 con 0x5623a20c0060 2023-09-13T09:48:59.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a1fae8b0 con 0x5623a20bea00 2023-09-13T09:48:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a1e92920 con 0x5623a20bf700 2023-09-13T09:48:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdfa1615b80 10 client.0 _ll_register_callbacks cb 0x5623a1fac680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdf8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20cf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdf8effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdf8e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdf8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20cf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39784/0 (socket says 172.21.15.6:39784) 2023-09-13T09:48:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.262+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/8727195 learned_addr learned my addr 172.21.15.6:0/8727195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/8727195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 msgr2=0x5623a20c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/8727195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 msgr2=0x5623a20c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf8f7fe700 1 -- 172.21.15.6:0/8727195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf901a1220 con 0x5623a20c0060 2023-09-13T09:48:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20cf4e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fdf880c95f0 tx=0x7fdf880989f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45a887576035f3f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf72ff5700 1 -- 172.21.15.6:0/8727195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880b1320 con 0x5623a20c0060 2023-09-13T09:48:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf72ff5700 1 -- 172.21.15.6:0/8727195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf8809ce30 con 0x5623a20c0060 2023-09-13T09:48:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623a20b1670 con 0x5623a20c0060 2023-09-13T09:48:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf72ff5700 1 -- 172.21.15.6:0/8727195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf88099700 con 0x5623a20c0060 2023-09-13T09:48:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdfa1615b80 10 client.17946 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5623a20287a0 con 0x5623a20c0060 2023-09-13T09:48:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.263+0000 7fdf72ff5700 1 -- 172.21.15.6:0/8727195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5623a20b1670 con 0x5623a20c0060 2023-09-13T09:48:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdf72ff5700 1 -- 172.21.15.6:0/8727195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdf880a0b50 con 0x5623a20c0060 2023-09-13T09:48:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdfa1615b80 10 client.17946 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdfa1615b80 10 client.17946 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:48:59.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdfa1615b80 20 client.17946 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a20d3860 0x5623a20d5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdfa1615b80 4 client.17946 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5623a2009970 con 0x5623a20d3860 2023-09-13T09:48:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdf8effd700 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a20d3860 0x5623a20d5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdf72ff5700 10 client.17946 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.264+0000 7fdf8effd700 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a20d3860 0x5623a20d5c50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b19429aba629916a server_cookie=d39850401b1b5c08 in_seq=0 out_seq=0 2023-09-13T09:48:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdf72ff5700 1 -- 172.21.15.6:0/8727195 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5623a2009970 con 0x5623a20d3860 2023-09-13T09:48:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdf72ff5700 10 client.17946 handle_command_reply: tid=0 2023-09-13T09:48:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 client.17946 shutdown 2023-09-13T09:48:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 msgr2=0x5623a20cf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20cf4e0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fdf880c95f0 tx=0x7fdf880989f0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 shutdown_connections 2023-09-13T09:48:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a20d3860 0x5623a20d5c50 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20c0060 0x5623a20cf4e0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20bea00 0x5623a20c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/8727195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 >> 172.21.15.6:0/8727195 conn(0x5623a201cc80 msgr2=0x5623a20b37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdf72ff5700 0 client.17946 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:59.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.265+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 shutdown_connections 2023-09-13T09:48:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.266+0000 7fdfa1615b80 1 -- 172.21.15.6:0/8727195 wait complete. 2023-09-13T09:48:59.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.266+0000 7fdfa1615b80 20 client.17946 trim_cache size 0 max 16384 2023-09-13T09:48:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 Processor -- start 2023-09-13T09:48:59.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 -- start start 2023-09-13T09:48:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20be4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a20c7b30 con 0x5623a20bea00 2023-09-13T09:48:59.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a20b9810 con 0x5623a20c0060 2023-09-13T09:48:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.280+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a20c34f0 con 0x5623a20bf700 2023-09-13T09:48:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20be4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20be4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39788/0 (socket says 172.21.15.6:39788) 2023-09-13T09:48:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 -- 172.21.15.6:0/3079020539 learned_addr learned my addr 172.21.15.6:0/3079020539 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 -- 172.21.15.6:0/3079020539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 msgr2=0x5623a20cf4a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:48:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20cf4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 -- 172.21.15.6:0/3079020539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 msgr2=0x5623a20c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 -- 172.21.15.6:0/3079020539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623a1e3cde0 con 0x5623a20bea00 2023-09-13T09:48:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf8effd700 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20be4c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fdf90101e10 tx=0x7fdf80027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3eefaf0ad99b39 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf75ffb700 1 -- 172.21.15.6:0/3079020539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf80036e90 con 0x5623a20bea00 2023-09-13T09:48:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf75ffb700 1 -- 172.21.15.6:0/3079020539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf8001e070 con 0x5623a20bea00 2023-09-13T09:48:59.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.281+0000 7fdf75ffb700 1 -- 172.21.15.6:0/3079020539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf800051a0 con 0x5623a20bea00 2023-09-13T09:48:59.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 -- 172.21.15.6:0/3079020539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 msgr2=0x5623a20be4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20be4c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fdf90101e10 tx=0x7fdf80027000 comp rx=0 tx=0).stop 2023-09-13T09:48:59.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 -- 172.21.15.6:0/3079020539 shutdown_connections 2023-09-13T09:48:59.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20be4c0 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/3079020539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 -- 172.21.15.6:0/3079020539 >> 172.21.15.6:0/3079020539 conn(0x5623a201cc80 msgr2=0x5623a20c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 -- 172.21.15.6:0/3079020539 shutdown_connections 2023-09-13T09:48:59.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 -- 172.21.15.6:0/3079020539 wait complete. 2023-09-13T09:48:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 -- start start 2023-09-13T09:48:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.282+0000 7fdfa1615b80 1 Processor -- start 2023-09-13T09:48:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20cb2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20cb820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdfa1615b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20ce840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a20ced80 con 0x5623a20bea00 2023-09-13T09:48:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a20ceef0 con 0x5623a20c0060 2023-09-13T09:48:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdfa1615b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623a20cf0b0 con 0x5623a20bf700 2023-09-13T09:48:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdfa1615b80 10 client.0 _ll_register_callbacks cb 0x5623a1fac680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20cb2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20cb2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39794/0 (socket says 172.21.15.6:39794) 2023-09-13T09:48:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 -- 172.21.15.6:0/701227970 learned_addr learned my addr 172.21.15.6:0/701227970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8e7fc700 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20cb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8f7fe700 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20ce840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 -- 172.21.15.6:0/701227970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 msgr2=0x5623a20cb820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20cb820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 -- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 msgr2=0x5623a20ce840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20ce840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 -- 172.21.15.6:0/701227970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5623a20287a0 con 0x5623a20bea00 2023-09-13T09:48:59.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf8effd700 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20cb2e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fdf800099c0 tx=0x7fdf80036f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c35b9fce5b601c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.283+0000 7fdf72ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdf72ff5700 1 -- 172.21.15.6:0/701227970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf8000bcd0 con 0x5623a20bea00 2023-09-13T09:48:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf88004ad0 con 0x5623a20bea00 2023-09-13T09:48:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdf72ff5700 1 -- 172.21.15.6:0/701227970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf80036140 con 0x5623a20bea00 2023-09-13T09:48:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdf72ff5700 1 -- 172.21.15.6:0/701227970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf80036300 con 0x5623a20bea00 2023-09-13T09:48:59.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 10 client.17952 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fdf8002c040 con 0x5623a20bea00 2023-09-13T09:48:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdf72ff5700 1 -- 172.21.15.6:0/701227970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf88004ad0 con 0x5623a20bea00 2023-09-13T09:48:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdf72ff5700 1 -- 172.21.15.6:0/701227970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdf800485e0 con 0x5623a20bea00 2023-09-13T09:48:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 10 client.17952 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 10 client.17952 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:48:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 20 client.17952 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a21281c0 0x5623a212a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 4 client.17952 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5623a1fca050 con 0x5623a21281c0 2023-09-13T09:48:59.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.284+0000 7fdf8e7fc700 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a21281c0 0x5623a212a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdf72ff5700 10 client.17952 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdf8e7fc700 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a21281c0 0x5623a212a5e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e72c59c704c687c9 server_cookie=b6aa305363ef7b32 in_seq=0 out_seq=0 2023-09-13T09:48:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdf72ff5700 1 -- 172.21.15.6:0/701227970 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5623a1fca050 con 0x5623a21281c0 2023-09-13T09:48:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdf72ff5700 10 client.17952 handle_command_reply: tid=0 2023-09-13T09:48:59.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 client.17952 shutdown 2023-09-13T09:48:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 msgr2=0x5623a20cb2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20cb2e0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fdf800099c0 tx=0x7fdf80036f00 comp rx=0 tx=0).stop 2023-09-13T09:48:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 shutdown_connections 2023-09-13T09:48:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5623a21281c0 0x5623a212a5e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5623a20c0060 0x5623a20ce840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5623a20bea00 0x5623a20cb2e0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 --2- 172.21.15.6:0/701227970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5623a20bf700 0x5623a20cb820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdf72ff5700 0 client.17952 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:48:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 >> 172.21.15.6:0/701227970 conn(0x5623a201cc80 msgr2=0x5623a20c2980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 shutdown_connections 2023-09-13T09:48:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 1 -- 172.21.15.6:0/701227970 wait complete. 2023-09-13T09:48:59.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.285+0000 7fdfa1615b80 20 client.17952 trim_cache size 0 max 16384 2023-09-13T09:48:59.311 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf780a0640 msgr2=0x7fdf780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf780a0640 0x7fdf780a2b00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdf80009990 tx=0x7fdf8000b940 comp rx=0 tx=0).stop 2023-09-13T09:48:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf90102950 msgr2=0x7fdf900735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf90102950 0x7fdf900735e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fdf8800efc0 tx=0x7fdf8800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 shutdown_connections 2023-09-13T09:48:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf780a0640 0x7fdf780a2b00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf90102950 0x7fdf900735e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf90100dc0 0x7fdf90074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 --2- 172.21.15.6:0/2570279389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf90101fb0 0x7fdf900730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 >> 172.21.15.6:0/2570279389 conn(0x7fdf900fc350 msgr2=0x7fdf900fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 shutdown_connections 2023-09-13T09:48:59.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.286+0000 7fdf95430700 1 -- 172.21.15.6:0/2570279389 wait complete. 2023-09-13T09:48:59.315 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:48:59.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 -- 172.21.15.6:0/144360527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8528100eb0 msgr2=0x7f8528101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 --2- 172.21.15.6:0/144360527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8528100eb0 0x7f8528101310 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f851c0099c0 tx=0x7f851c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 -- 172.21.15.6:0/144360527 shutdown_connections 2023-09-13T09:48:59.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 --2- 172.21.15.6:0/144360527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8528101850 0x7f8528108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 --2- 172.21.15.6:0/144360527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85280ffcc0 0x7f85281000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 --2- 172.21.15.6:0/144360527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8528100eb0 0x7f8528101310 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 -- 172.21.15.6:0/144360527 >> 172.21.15.6:0/144360527 conn(0x7f85280fb250 msgr2=0x7f85280fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 -- 172.21.15.6:0/144360527 shutdown_connections 2023-09-13T09:48:59.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.450+0000 7f852d312700 1 -- 172.21.15.6:0/144360527 wait complete. 2023-09-13T09:48:59.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 Processor -- start 2023-09-13T09:48:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 -- start start 2023-09-13T09:48:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280ffcc0 0x7f8528198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528100eb0 0x7f85281991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8528101850 0x7f85281a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281a07b0 con 0x7f85280ffcc0 2023-09-13T09:48:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281a0920 con 0x7f8528101850 2023-09-13T09:48:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f852d312700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85281a0ae0 con 0x7f8528100eb0 2023-09-13T09:48:59.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280ffcc0 0x7f8528198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280ffcc0 0x7f8528198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39808/0 (socket says 172.21.15.6:39808) 2023-09-13T09:48:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 -- 172.21.15.6:0/4160975671 learned_addr learned my addr 172.21.15.6:0/4160975671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f85277fe700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8528101850 0x7f85281a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f85267fc700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528100eb0 0x7f85281991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 -- 172.21.15.6:0/4160975671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528100eb0 msgr2=0x7f85281991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528100eb0 0x7f85281991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 -- 172.21.15.6:0/4160975671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8528101850 msgr2=0x7f85281a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8528101850 0x7f85281a01e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.451+0000 7f8526ffd700 1 -- 172.21.15.6:0/4160975671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0095f0 con 0x7f85280ffcc0 2023-09-13T09:48:59.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.452+0000 7f8526ffd700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280ffcc0 0x7f8528198c70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f851800e970 tx=0x7f851800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.452+0000 7f850ffff700 1 -- 172.21.15.6:0/4160975671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518009790 con 0x7f85280ffcc0 2023-09-13T09:48:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.452+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85281a0dc0 con 0x7f85280ffcc0 2023-09-13T09:48:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.452+0000 7f850ffff700 1 -- 172.21.15.6:0/4160975671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f851800c7e0 con 0x7f85280ffcc0 2023-09-13T09:48:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.452+0000 7f850ffff700 1 -- 172.21.15.6:0/4160975671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518003c70 con 0x7f85280ffcc0 2023-09-13T09:48:59.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.452+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85281a11f0 con 0x7f85280ffcc0 2023-09-13T09:48:59.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.454+0000 7f850ffff700 1 -- 172.21.15.6:0/4160975671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f851800cc50 con 0x7f85280ffcc0 2023-09-13T09:48:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.455+0000 7f850ffff700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85100a0640 0x7f85100a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.455+0000 7f85267fc700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85100a0640 0x7f85100a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.455+0000 7f850ffff700 1 -- 172.21.15.6:0/4160975671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8518014070 con 0x7f85280ffcc0 2023-09-13T09:48:59.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85267fc700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85100a0640 0x7f85100a2b00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f851c00b580 tx=0x7f851c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 Processor -- start 2023-09-13T09:48:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 -- start start 2023-09-13T09:48:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x5580202ffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558020300060 0x5580202fe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x5580202fee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558020257780 con 0x558020300060 2023-09-13T09:48:59.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580202550a0 con 0x5580202ff700 2023-09-13T09:48:59.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85394f7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558020250990 con 0x5580202fea00 2023-09-13T09:48:59.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f8526ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x5580202ffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f8526ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x5580202ffb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33340/0 (socket says 172.21.15.6:33340) 2023-09-13T09:48:59.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f85277fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x5580202fee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.456+0000 7f8526ffd700 1 -- 172.21.15.6:0/3618496314 learned_addr learned my addr 172.21.15.6:0/3618496314 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f85267fc700 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558020300060 0x5580202fe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f8526ffd700 1 -- 172.21.15.6:0/3618496314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 msgr2=0x5580202fee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f8526ffd700 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x5580202fee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f8526ffd700 1 -- 172.21.15.6:0/3618496314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558020300060 msgr2=0x5580202fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f8526ffd700 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558020300060 0x5580202fe4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f8526ffd700 1 -- 172.21.15.6:0/3618496314 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580200d0630 con 0x5580202ff700 2023-09-13T09:48:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f85277fe700 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x5580202fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f85267fc700 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558020300060 0x5580202fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:48:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f8526ffd700 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x5580202ffb20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f85180a1090 tx=0x7f8518003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a105157aa5789744 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f850d7fa700 1 -- 172.21.15.6:0/3618496314 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851809d170 con 0x5580202ff700 2023-09-13T09:48:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f850d7fa700 1 -- 172.21.15.6:0/3618496314 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8518099550 con 0x5580202ff700 2023-09-13T09:48:59.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.457+0000 7f850d7fa700 1 -- 172.21.15.6:0/3618496314 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180997b0 con 0x5580202ff700 2023-09-13T09:48:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 -- 172.21.15.6:0/3618496314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 msgr2=0x5580202ffb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x5580202ffb20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f85180a1090 tx=0x7f8518003680 comp rx=0 tx=0).stop 2023-09-13T09:48:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 -- 172.21.15.6:0/3618496314 shutdown_connections 2023-09-13T09:48:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x5580202fee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x5580202ffb20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3618496314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558020300060 0x5580202fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 -- 172.21.15.6:0/3618496314 >> 172.21.15.6:0/3618496314 conn(0x55802025cc80 msgr2=0x5580202f8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 -- 172.21.15.6:0/3618496314 shutdown_connections 2023-09-13T09:48:59.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 -- 172.21.15.6:0/3618496314 wait complete. 2023-09-13T09:48:59.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 -- start start 2023-09-13T09:48:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.458+0000 7f85394f7b80 1 Processor -- start 2023-09-13T09:48:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x558020307f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x5580203084c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558020300060 0x55802030f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85394f7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580201eebb0 con 0x5580202ff700 2023-09-13T09:48:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85394f7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580201ee8b0 con 0x5580202fea00 2023-09-13T09:48:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85394f7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580200d2920 con 0x558020300060 2023-09-13T09:48:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85394f7b80 10 client.0 _ll_register_callbacks cb 0x5580201ec680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x5580203084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x5580203084c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39824/0 (socket says 172.21.15.6:39824) 2023-09-13T09:48:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 -- 172.21.15.6:0/3485442445 learned_addr learned my addr 172.21.15.6:0/3485442445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f8526ffd700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x558020307f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85277fe700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558020300060 0x55802030f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 -- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558020300060 msgr2=0x55802030f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558020300060 0x55802030f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 -- 172.21.15.6:0/3485442445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 msgr2=0x558020307f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x558020307f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 -- 172.21.15.6:0/3485442445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85281a11f0 con 0x5580202ff700 2023-09-13T09:48:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f8526ffd700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x558020307f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f85267fc700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x5580203084c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f851c0095a0 tx=0x7f851c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895ecdf9b8d08f12 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f850aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.459+0000 7f850aff5700 1 -- 172.21.15.6:0/3485442445 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c00f660 con 0x5580202ff700 2023-09-13T09:48:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580202f1670 con 0x5580202ff700 2023-09-13T09:48:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f850aff5700 1 -- 172.21.15.6:0/3485442445 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f851c003e40 con 0x5580202ff700 2023-09-13T09:48:59.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f850aff5700 1 -- 172.21.15.6:0/3485442445 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f851c00f7c0 con 0x5580202ff700 2023-09-13T09:48:59.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 10 client.17961 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5580202687a0 con 0x5580202ff700 2023-09-13T09:48:59.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f850aff5700 1 -- 172.21.15.6:0/3485442445 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f851c03c080 con 0x5580202ff700 2023-09-13T09:48:59.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f850aff5700 1 -- 172.21.15.6:0/3485442445 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f851c02db40 con 0x5580202ff700 2023-09-13T09:48:59.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 10 client.17961 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 10 client.17961 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:48:59.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 20 client.17961 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020313ca0 0x5580203160c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 4 client.17961 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:59.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558020249970 con 0x558020313ca0 2023-09-13T09:48:59.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.460+0000 7f8526ffd700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020313ca0 0x5580203160c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.461+0000 7f8526ffd700 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020313ca0 0x5580203160c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5744d01c70641dda server_cookie=87d1c5959ac0f493 in_seq=0 out_seq=0 2023-09-13T09:48:59.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.461+0000 7f850aff5700 10 client.17961 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:59.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.461+0000 7f850aff5700 1 -- 172.21.15.6:0/3485442445 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558020249970 con 0x558020313ca0 2023-09-13T09:48:59.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.461+0000 7f850aff5700 10 client.17961 handle_command_reply: tid=0 2023-09-13T09:48:59.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.461+0000 7f85394f7b80 1 client.17961 shutdown 2023-09-13T09:48:59.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 msgr2=0x5580203084c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x5580203084c0 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f851c0095a0 tx=0x7f851c009310 comp rx=0 tx=0).stop 2023-09-13T09:48:59.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 shutdown_connections 2023-09-13T09:48:59.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020313ca0 0x5580203160c0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558020300060 0x55802030f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f850aff5700 0 client.17961 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:59.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x558020307f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 --2- 172.21.15.6:0/3485442445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x5580203084c0 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 >> 172.21.15.6:0/3485442445 conn(0x55802025cc80 msgr2=0x5580202f37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 shutdown_connections 2023-09-13T09:48:59.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 1 -- 172.21.15.6:0/3485442445 wait complete. 2023-09-13T09:48:59.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.462+0000 7f85394f7b80 20 client.17961 trim_cache size 0 max 16384 2023-09-13T09:48:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 Processor -- start 2023-09-13T09:48:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 -- start start 2023-09-13T09:48:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55802025cc80 0x5580202fe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x55802030f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x558020302980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558020307b20 con 0x55802025cc80 2023-09-13T09:48:59.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580202faa10 con 0x5580202ff700 2023-09-13T09:48:59.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f85394f7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580202f58e0 con 0x5580202fea00 2023-09-13T09:48:59.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.475+0000 7f8526ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55802025cc80 0x5580202fe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x558020302980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f8526ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55802025cc80 0x5580202fe4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39830/0 (socket says 172.21.15.6:39830) 2023-09-13T09:48:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85267fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x55802030f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x558020302980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33358/0 (socket says 172.21.15.6:33358) 2023-09-13T09:48:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f8526ffd700 1 -- 172.21.15.6:0/2552412548 learned_addr learned my addr 172.21.15.6:0/2552412548 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 -- 172.21.15.6:0/2552412548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 msgr2=0x55802030f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 --2- 172.21.15.6:0/2552412548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x55802030f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 -- 172.21.15.6:0/2552412548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55802025cc80 msgr2=0x5580202fe4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 --2- 172.21.15.6:0/2552412548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55802025cc80 0x5580202fe4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 -- 172.21.15.6:0/2552412548 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55802007cde0 con 0x5580202ff700 2023-09-13T09:48:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f85277fe700 1 --2- 172.21.15.6:0/2552412548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x558020302980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8520009e10 tx=0x7f8520009e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54bae56a216cec26 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f850dffb700 1 -- 172.21.15.6:0/2552412548 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520004db0 con 0x5580202ff700 2023-09-13T09:48:59.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f850dffb700 1 -- 172.21.15.6:0/2552412548 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f852000f040 con 0x5580202ff700 2023-09-13T09:48:59.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.476+0000 7f850dffb700 1 -- 172.21.15.6:0/2552412548 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8520017410 con 0x5580202ff700 2023-09-13T09:48:59.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 -- 172.21.15.6:0/2552412548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 msgr2=0x558020302980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 --2- 172.21.15.6:0/2552412548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x558020302980 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8520009e10 tx=0x7f8520009e40 comp rx=0 tx=0).stop 2023-09-13T09:48:59.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 -- 172.21.15.6:0/2552412548 shutdown_connections 2023-09-13T09:48:59.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 --2- 172.21.15.6:0/2552412548 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202ff700 0x558020302980 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 --2- 172.21.15.6:0/2552412548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55802025cc80 0x5580202fe4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 --2- 172.21.15.6:0/2552412548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580202fea00 0x55802030f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 -- 172.21.15.6:0/2552412548 >> 172.21.15.6:0/2552412548 conn(0x5580202f9240 msgr2=0x558020307f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 -- 172.21.15.6:0/2552412548 shutdown_connections 2023-09-13T09:48:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 -- 172.21.15.6:0/2552412548 wait complete. 2023-09-13T09:48:59.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.477+0000 7f85394f7b80 1 -- start start 2023-09-13T09:48:59.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 1 Processor -- start 2023-09-13T09:48:59.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55802025cc80 0x55802030f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x55802030bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x55802030c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802030f8c0 con 0x5580202ff700 2023-09-13T09:48:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802030c5f0 con 0x5580202fea00 2023-09-13T09:48:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55802030c7b0 con 0x55802025cc80 2023-09-13T09:48:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85394f7b80 10 client.0 _ll_register_callbacks cb 0x5580201ec680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x55802030c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f8526ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55802025cc80 0x55802030f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85267fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x55802030bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x55802030c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39840/0 (socket says 172.21.15.6:39840) 2023-09-13T09:48:59.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85277fe700 1 -- 172.21.15.6:0/721155195 learned_addr learned my addr 172.21.15.6:0/721155195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f8526ffd700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55802025cc80 0x55802030f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42890/0 (socket says 172.21.15.6:42890) 2023-09-13T09:48:59.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85267fc700 1 -- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55802025cc80 msgr2=0x55802030f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85267fc700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55802025cc80 0x55802030f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85267fc700 1 -- 172.21.15.6:0/721155195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 msgr2=0x55802030c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85267fc700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x55802030c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85267fc700 1 -- 172.21.15.6:0/721155195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8520009a90 con 0x5580202fea00 2023-09-13T09:48:59.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f8526ffd700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55802025cc80 0x55802030f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85277fe700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x55802030c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f85267fc700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x55802030bb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f851c02df20 tx=0x7f851c0387d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b005111cf93b8b20 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.478+0000 7f850aff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:48:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f850aff5700 1 -- 172.21.15.6:0/721155195 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851c003e40 con 0x5580202fea00 2023-09-13T09:48:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f850aff5700 1 -- 172.21.15.6:0/721155195 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f851c038920 con 0x5580202fea00 2023-09-13T09:48:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8518099550 con 0x5580202fea00 2023-09-13T09:48:59.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f850aff5700 1 -- 172.21.15.6:0/721155195 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f851c038ae0 con 0x5580202fea00 2023-09-13T09:48:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 10 client.27365 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558020065c60 con 0x5580202fea00 2023-09-13T09:48:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f850aff5700 1 -- 172.21.15.6:0/721155195 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8518099550 con 0x5580202fea00 2023-09-13T09:48:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f850aff5700 1 -- 172.21.15.6:0/721155195 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f851c00f460 con 0x5580202fea00 2023-09-13T09:48:59.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 10 client.27365 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 10 client.27365 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:48:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 20 client.27365 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020300060 0x55802036b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 4 client.27365 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:59.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.479+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55802020a050 con 0x558020300060 2023-09-13T09:48:59.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f8526ffd700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020300060 0x55802036b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f8526ffd700 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020300060 0x55802036b260 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c0739a26494f56e1 server_cookie=d892842e94016f94 in_seq=0 out_seq=0 2023-09-13T09:48:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f850aff5700 10 client.27365 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:59.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f850aff5700 1 -- 172.21.15.6:0/721155195 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55802020a050 con 0x558020300060 2023-09-13T09:48:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f850aff5700 10 client.27365 handle_command_reply: tid=0 2023-09-13T09:48:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 client.27365 shutdown 2023-09-13T09:48:59.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 msgr2=0x55802030bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x55802030bb40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f851c02df20 tx=0x7f851c0387d0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 shutdown_connections 2023-09-13T09:48:59.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558020300060 0x55802036b260 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580202ff700 0x55802030c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55802025cc80 0x55802030f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 --2- 172.21.15.6:0/721155195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580202fea00 0x55802030bb40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f850aff5700 0 client.27365 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:48:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 >> 172.21.15.6:0/721155195 conn(0x5580202f9240 msgr2=0x558020307f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 shutdown_connections 2023-09-13T09:48:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 1 -- 172.21.15.6:0/721155195 wait complete. 2023-09-13T09:48:59.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.480+0000 7f85394f7b80 20 client.27365 trim_cache size 0 max 16384 2023-09-13T09:48:59.513 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85100a0640 msgr2=0x7f85100a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85100a0640 0x7f85100a2b00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f851c00b580 tx=0x7f851c005fb0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280ffcc0 msgr2=0x7f8528198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280ffcc0 0x7f8528198c70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f851800e970 tx=0x7f851800ec80 comp rx=0 tx=0).stop 2023-09-13T09:48:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 shutdown_connections 2023-09-13T09:48:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8528101850 0x7f85281a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85100a0640 0x7f85100a2b00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85280ffcc0 0x7f8528198c70 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 --2- 172.21.15.6:0/4160975671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528100eb0 0x7f85281991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 >> 172.21.15.6:0/4160975671 conn(0x7f85280fb250 msgr2=0x7f85280fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 shutdown_connections 2023-09-13T09:48:59.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.481+0000 7f852d312700 1 -- 172.21.15.6:0/4160975671 wait complete. 2023-09-13T09:48:59.517 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:48:59.518 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:48:59 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/532314496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:48:59.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:48:59 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/532314496' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:48:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 -- 172.21.15.6:0/3289112606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 msgr2=0x7fb868100330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/3289112606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb868100330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb858009920 tx=0x7fb858009c30 comp rx=0 tx=0).stop 2023-09-13T09:48:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 -- 172.21.15.6:0/3289112606 shutdown_connections 2023-09-13T09:48:59.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/3289112606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8681015e0 0x7fb868107e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/3289112606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb868100330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/3289112606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb868100c20 0x7fb8681010a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 -- 172.21.15.6:0/3289112606 >> 172.21.15.6:0/3289112606 conn(0x7fb8680fa6a0 msgr2=0x7fb8680fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 -- 172.21.15.6:0/3289112606 shutdown_connections 2023-09-13T09:48:59.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.652+0000 7fb86cb9e700 1 -- 172.21.15.6:0/3289112606 wait complete. 2023-09-13T09:48:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 Processor -- start 2023-09-13T09:48:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 -- start start 2023-09-13T09:48:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb8680ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb868100c20 0x7fb86819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8681015e0 0x7fb86819dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86819e460 con 0x7fb868100c20 2023-09-13T09:48:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86819e5d0 con 0x7fb8681015e0 2023-09-13T09:48:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.653+0000 7fb86cb9e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb86819e790 con 0x7fb8680fff10 2023-09-13T09:48:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb8680ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb866ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb868100c20 0x7fb86819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb8680ff5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:42904/0 (socket says 172.21.15.6:42904) 2023-09-13T09:48:59.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 -- 172.21.15.6:0/1747838813 learned_addr learned my addr 172.21.15.6:0/1747838813 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb867fff700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8681015e0 0x7fb86819dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 -- 172.21.15.6:0/1747838813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8681015e0 msgr2=0x7fb86819dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8681015e0 0x7fb86819dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 -- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb868100c20 msgr2=0x7fb86819b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb868100c20 0x7fb86819b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 -- 172.21.15.6:0/1747838813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb858009520 con 0x7fb8680fff10 2023-09-13T09:48:59.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb866ffd700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb868100c20 0x7fb86819b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb8677fe700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb8680ff5f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb858009810 tx=0x7fb85800b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb864ff9700 1 -- 172.21.15.6:0/1747838813 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85801c070 con 0x7fb8680fff10 2023-09-13T09:48:59.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb864ff9700 1 -- 172.21.15.6:0/1747838813 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb85800f7d0 con 0x7fb8680fff10 2023-09-13T09:48:59.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb86819ea10 con 0x7fb8680fff10 2023-09-13T09:48:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb864ff9700 1 -- 172.21.15.6:0/1747838813 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858003a20 con 0x7fb8680fff10 2023-09-13T09:48:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.654+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86819eee0 con 0x7fb8680fff10 2023-09-13T09:48:59.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.657+0000 7fb864ff9700 1 -- 172.21.15.6:0/1747838813 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb858020030 con 0x7fb8680fff10 2023-09-13T09:48:59.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.657+0000 7fb864ff9700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8500a06c0 0x7fb8500a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.657+0000 7fb866ffd700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8500a06c0 0x7fb8500a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.657+0000 7fb864ff9700 1 -- 172.21.15.6:0/1747838813 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb8580ccb80 con 0x7fb8680fff10 2023-09-13T09:48:59.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb866ffd700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8500a06c0 0x7fb8500a2b80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb8680ff360 tx=0x7fb85c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 Processor -- start 2023-09-13T09:48:59.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 -- start start 2023-09-13T09:48:59.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e30345b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e303460a0 0x560e303465d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30346b60 0x560e30347010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3029e780 con 0x560e30345740 2023-09-13T09:48:59.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3029c0a0 con 0x560e303460a0 2023-09-13T09:48:59.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e30297990 con 0x560e30346b60 2023-09-13T09:48:59.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e30345b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e30345b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39858/0 (socket says 172.21.15.6:39858) 2023-09-13T09:48:59.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb8677fe700 1 -- 172.21.15.6:0/580915967 learned_addr learned my addr 172.21.15.6:0/580915967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb866ffd700 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e303460a0 0x560e303465d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.658+0000 7fb867fff700 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30346b60 0x560e30347010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb8677fe700 1 -- 172.21.15.6:0/580915967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30346b60 msgr2=0x560e30347010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb8677fe700 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30346b60 0x560e30347010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb8677fe700 1 -- 172.21.15.6:0/580915967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e303460a0 msgr2=0x560e303465d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb8677fe700 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e303460a0 0x560e303465d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb8677fe700 1 -- 172.21.15.6:0/580915967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e30117630 con 0x560e30345740 2023-09-13T09:48:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb866ffd700 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e303460a0 0x560e303465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:48:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb8677fe700 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e30345b60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb85800f9a0 tx=0x7fb85809a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29de7b66f3760f05 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb84dffb700 1 -- 172.21.15.6:0/580915967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85809aab0 con 0x560e30345740 2023-09-13T09:48:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb84dffb700 1 -- 172.21.15.6:0/580915967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb85809a3b0 con 0x560e30345740 2023-09-13T09:48:59.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.659+0000 7fb84dffb700 1 -- 172.21.15.6:0/580915967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580987e0 con 0x560e30345740 2023-09-13T09:48:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 -- 172.21.15.6:0/580915967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 msgr2=0x560e30345b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e30345b60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb85800f9a0 tx=0x7fb85809a270 comp rx=0 tx=0).stop 2023-09-13T09:48:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 -- 172.21.15.6:0/580915967 shutdown_connections 2023-09-13T09:48:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30346b60 0x560e30347010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e30345b60 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/580915967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e303460a0 0x560e303465d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 -- 172.21.15.6:0/580915967 >> 172.21.15.6:0/580915967 conn(0x560e302a3c80 msgr2=0x560e303400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 -- 172.21.15.6:0/580915967 shutdown_connections 2023-09-13T09:48:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 -- 172.21.15.6:0/580915967 wait complete. 2023-09-13T09:48:59.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 -- start start 2023-09-13T09:48:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.660+0000 7fb879fe5b80 1 Processor -- start 2023-09-13T09:48:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30345740 0x560e3034edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e303460a0 0x560e3034f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e30356330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e30235bb0 con 0x560e303460a0 2023-09-13T09:48:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e302358b0 con 0x560e30346b60 2023-09-13T09:48:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e30119920 con 0x560e30345740 2023-09-13T09:48:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb879fe5b80 10 client.0 _ll_register_callbacks cb 0x560e30233680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e303460a0 0x560e3034f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e303460a0 0x560e3034f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39866/0 (socket says 172.21.15.6:39866) 2023-09-13T09:48:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 -- 172.21.15.6:0/3511667653 learned_addr learned my addr 172.21.15.6:0/3511667653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb8677fe700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30345740 0x560e3034edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb867fff700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e30356330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 -- 172.21.15.6:0/3511667653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30345740 msgr2=0x560e3034edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30345740 0x560e3034edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 -- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 msgr2=0x560e30356330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e30356330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 -- 172.21.15.6:0/3511667653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb86819eee0 con 0x560e303460a0 2023-09-13T09:48:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb8677fe700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30345740 0x560e3034edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:48:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb866ffd700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e303460a0 0x560e3034f2f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009e70 tx=0x7fb85c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28101b41529ad02e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.661+0000 7fb846ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb846ffd700 1 -- 172.21.15.6:0/3511667653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85c01fca0 con 0x560e303460a0 2023-09-13T09:48:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb846ffd700 1 -- 172.21.15.6:0/3511667653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb85c003e20 con 0x560e303460a0 2023-09-13T09:48:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e30338670 con 0x560e303460a0 2023-09-13T09:48:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb846ffd700 1 -- 172.21.15.6:0/3511667653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb85c01fe00 con 0x560e303460a0 2023-09-13T09:48:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 10 client.17979 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560e302af7a0 con 0x560e303460a0 2023-09-13T09:48:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb846ffd700 1 -- 172.21.15.6:0/3511667653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560e30338670 con 0x560e303460a0 2023-09-13T09:48:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb846ffd700 1 -- 172.21.15.6:0/3511667653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb85c028560 con 0x560e303460a0 2023-09-13T09:48:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 10 client.17979 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 10 client.17979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:59.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 20 client.17979 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e3035abe0 0x560e3035d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 4 client.17979 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:48:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.662+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e30290970 con 0x560e3035abe0 2023-09-13T09:48:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.663+0000 7fb8677fe700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e3035abe0 0x560e3035d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.664+0000 7fb8677fe700 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e3035abe0 0x560e3035d000 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b6c54221c9dd0 server_cookie=8fcf16d08a8ba8d3 in_seq=0 out_seq=0 2023-09-13T09:48:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.664+0000 7fb846ffd700 10 client.17979 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.664+0000 7fb846ffd700 1 -- 172.21.15.6:0/3511667653 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e30290970 con 0x560e3035abe0 2023-09-13T09:48:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.664+0000 7fb846ffd700 10 client.17979 handle_command_reply: tid=0 2023-09-13T09:48:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.664+0000 7fb879fe5b80 1 client.17979 shutdown 2023-09-13T09:48:59.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.664+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e303460a0 msgr2=0x560e3034f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e303460a0 0x560e3034f2f0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fb85c009e70 tx=0x7fb85c0047c0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 shutdown_connections 2023-09-13T09:48:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e30356330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e30345740 0x560e3034edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e3035abe0 0x560e3035d000 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/3511667653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e303460a0 0x560e3034f2f0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb846ffd700 0 client.17979 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:59.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 >> 172.21.15.6:0/3511667653 conn(0x560e302a3c80 msgr2=0x560e303444b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 shutdown_connections 2023-09-13T09:48:59.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 1 -- 172.21.15.6:0/3511667653 wait complete. 2023-09-13T09:48:59.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.665+0000 7fb879fe5b80 20 client.17979 trim_cache size 0 max 16384 2023-09-13T09:48:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.679+0000 7fb879fe5b80 1 Processor -- start 2023-09-13T09:48:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.679+0000 7fb879fe5b80 1 -- start start 2023-09-13T09:48:59.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30345740 0x560e30345b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303400b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30346b60 0x560e3034dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e30338650 con 0x560e30346b60 2023-09-13T09:48:59.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3034e920 con 0x560e30345740 2023-09-13T09:48:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e3033ff00 con 0x560e303460a0 2023-09-13T09:48:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30346b60 0x560e3034dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30346b60 0x560e3034dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39876/0 (socket says 172.21.15.6:39876) 2023-09-13T09:48:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 -- 172.21.15.6:0/2930284077 learned_addr learned my addr 172.21.15.6:0/2930284077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb8677fe700 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30345740 0x560e30345b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb866ffd700 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303400b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 -- 172.21.15.6:0/2930284077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 msgr2=0x560e303400b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303400b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 -- 172.21.15.6:0/2930284077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30345740 msgr2=0x560e30345b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30345740 0x560e30345b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 -- 172.21.15.6:0/2930284077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e300c3de0 con 0x560e30346b60 2023-09-13T09:48:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb867fff700 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30346b60 0x560e3034dae0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb8600076c0 tx=0x7fb86000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ca272fe0804c95 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.680+0000 7fb84e7fc700 1 -- 172.21.15.6:0/2930284077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86000e040 con 0x560e30346b60 2023-09-13T09:48:59.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb84e7fc700 1 -- 172.21.15.6:0/2930284077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb86000f040 con 0x560e30346b60 2023-09-13T09:48:59.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb84e7fc700 1 -- 172.21.15.6:0/2930284077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb860017650 con 0x560e30346b60 2023-09-13T09:48:59.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2930284077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30346b60 msgr2=0x560e3034dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30346b60 0x560e3034dae0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7fb8600076c0 tx=0x7fb86000b040 comp rx=0 tx=0).stop 2023-09-13T09:48:59.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2930284077 shutdown_connections 2023-09-13T09:48:59.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30346b60 0x560e3034dae0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30345740 0x560e30345b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2930284077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303400b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2930284077 >> 172.21.15.6:0/2930284077 conn(0x560e302a3c80 msgr2=0x560e30361980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2930284077 shutdown_connections 2023-09-13T09:48:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.681+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2930284077 wait complete. 2023-09-13T09:48:59.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 -- start start 2023-09-13T09:48:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 Processor -- start 2023-09-13T09:48:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e303acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e303b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e303b1f00 con 0x560e30345740 2023-09-13T09:48:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e303b2070 con 0x560e30346b60 2023-09-13T09:48:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e303b2230 con 0x560e303460a0 2023-09-13T09:48:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb879fe5b80 10 client.0 _ll_register_callbacks cb 0x560e30233680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:48:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e303acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e303acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39878/0 (socket says 172.21.15.6:39878) 2023-09-13T09:48:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 -- 172.21.15.6:0/2318676700 learned_addr learned my addr 172.21.15.6:0/2318676700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:48:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb866ffd700 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb867fff700 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e303b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 -- 172.21.15.6:0/2318676700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 msgr2=0x560e303af270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303af270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 -- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 msgr2=0x560e303b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:48:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e303b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.682+0000 7fb8677fe700 1 -- 172.21.15.6:0/2318676700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e300acc60 con 0x560e30345740 2023-09-13T09:48:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb8677fe700 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e303acd20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb8580968b0 tx=0x7fb8580984f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37eab46bc42c27e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:48:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb846ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:48:59.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb846ffd700 1 -- 172.21.15.6:0/2318676700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85809a180 con 0x560e30345740 2023-09-13T09:48:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb846ffd700 1 -- 172.21.15.6:0/2318676700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb858098560 con 0x560e30345740 2023-09-13T09:48:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb85809a3b0 con 0x560e30345740 2023-09-13T09:48:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb846ffd700 1 -- 172.21.15.6:0/2318676700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8580a2390 con 0x560e30345740 2023-09-13T09:48:59.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 10 client.17985 fetch_fsmap learned FSMap version 34 2023-09-13T09:48:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560e300ea250 con 0x560e30345740 2023-09-13T09:48:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb846ffd700 1 -- 172.21.15.6:0/2318676700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb85809a3b0 con 0x560e30345740 2023-09-13T09:48:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb846ffd700 1 -- 172.21.15.6:0/2318676700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb858021380 con 0x560e30345740 2023-09-13T09:48:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 10 client.17985 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:48:59.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 10 client.17985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:48:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 20 client.17985 populate_metadata read hostname 'smithi006' 2023-09-13T09:48:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e303b3750 0x560e303b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:48:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 4 client.17985 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:48:59.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.683+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560e30251050 con 0x560e303b3750 2023-09-13T09:48:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb866ffd700 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e303b3750 0x560e303b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:48:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb846ffd700 10 client.17985 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb866ffd700 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e303b3750 0x560e303b5b40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e81d2aba854f89a3 server_cookie=264cce845fe1e8bd in_seq=0 out_seq=0 2023-09-13T09:48:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb846ffd700 1 -- 172.21.15.6:0/2318676700 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560e30251050 con 0x560e303b3750 2023-09-13T09:48:59.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb846ffd700 10 client.17985 handle_command_reply: tid=0 2023-09-13T09:48:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 client.17985 shutdown 2023-09-13T09:48:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 msgr2=0x560e303acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e303acd20 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fb8580968b0 tx=0x7fb8580984f0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 shutdown_connections 2023-09-13T09:48:59.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e30346b60 0x560e303b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e303b3750 0x560e303b5b40 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e30345740 0x560e303acd20 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb879fe5b80 1 --2- 172.21.15.6:0/2318676700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e303460a0 0x560e303af270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.684+0000 7fb846ffd700 0 client.17985 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:48:59.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 >> 172.21.15.6:0/2318676700 conn(0x560e302a3c80 msgr2=0x560e3034dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 shutdown_connections 2023-09-13T09:48:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb879fe5b80 1 -- 172.21.15.6:0/2318676700 wait complete. 2023-09-13T09:48:59.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb879fe5b80 20 client.17985 trim_cache size 0 max 16384 2023-09-13T09:48:59.710 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:48:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8500a06c0 msgr2=0x7fb8500a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8500a06c0 0x7fb8500a2b80 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb8680ff360 tx=0x7fb85c009310 comp rx=0 tx=0).stop 2023-09-13T09:48:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 msgr2=0x7fb8680ff5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:48:59.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb8680ff5f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fb858009810 tx=0x7fb85800b790 comp rx=0 tx=0).stop 2023-09-13T09:48:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 shutdown_connections 2023-09-13T09:48:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb8681015e0 0x7fb86819dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8680fff10 0x7fb8680ff5f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8500a06c0 0x7fb8500a2b80 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 --2- 172.21.15.6:0/1747838813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb868100c20 0x7fb86819b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:48:59.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 >> 172.21.15.6:0/1747838813 conn(0x7fb8680fa6a0 msgr2=0x7fb868104290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:48:59.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 shutdown_connections 2023-09-13T09:48:59.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:48:59.685+0000 7fb86cb9e700 1 -- 172.21.15.6:0/1747838813 wait complete. 2023-09-13T09:49:00.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 510962 5.98 MB/sec execute 380 sec latency 13.509 ms 2023-09-13T09:49:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:00 smithi006 ceph-mon[98665]: pgmap v584: 97 pgs: 97 active+clean; 186 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2023-09-13T09:49:00.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:00 smithi053 ceph-mon[102373]: pgmap v584: 97 pgs: 97 active+clean; 186 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2023-09-13T09:49:00.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:00 smithi131 ceph-mon[102785]: pgmap v584: 97 pgs: 97 active+clean; 186 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 643 KiB/s rd, 2.2 MiB/s wr, 260 op/s 2023-09-13T09:49:00.715 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:49:00.715 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:49:00.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 -- 172.21.15.6:0/4125189457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 msgr2=0x7f76381003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 --2- 172.21.15.6:0/4125189457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 0x7f76381003e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7620009990 tx=0x7f7620009ca0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 -- 172.21.15.6:0/4125189457 shutdown_connections 2023-09-13T09:49:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 --2- 172.21.15.6:0/4125189457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 0x7f76381081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 --2- 172.21.15.6:0/4125189457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7638101250 0x7f7638101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 --2- 172.21.15.6:0/4125189457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 0x7f76381003e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 -- 172.21.15.6:0/4125189457 >> 172.21.15.6:0/4125189457 conn(0x7f76380fa9b0 msgr2=0x7f76380fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 -- 172.21.15.6:0/4125189457 shutdown_connections 2023-09-13T09:49:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.854+0000 7f763e63f700 1 -- 172.21.15.6:0/4125189457 wait complete. 2023-09-13T09:49:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 Processor -- start 2023-09-13T09:49:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 -- start start 2023-09-13T09:49:00.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 0x7f7638196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 0x7f7638196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7638101250 0x7f763819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763819e610 con 0x7f7638100920 2023-09-13T09:49:00.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763819e750 con 0x7f7638101250 2023-09-13T09:49:00.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763e63f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763819e8e0 con 0x7f76380fff80 2023-09-13T09:49:00.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 0x7f7638196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f7637fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 0x7f7638196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 0x7f7638196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39892/0 (socket says 172.21.15.6:39892) 2023-09-13T09:49:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f762ffff700 1 -- 172.21.15.6:0/1513493447 learned_addr learned my addr 172.21.15.6:0/1513493447 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.855+0000 7f763cbdc700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7638101250 0x7f763819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7637fff700 1 -- 172.21.15.6:0/1513493447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7638101250 msgr2=0x7f763819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7637fff700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7638101250 0x7f763819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7637fff700 1 -- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 msgr2=0x7f7638196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7637fff700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 0x7f7638196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7637fff700 1 -- 172.21.15.6:0/1513493447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76200095f0 con 0x7f76380fff80 2023-09-13T09:49:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f762ffff700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 0x7f7638196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7637fff700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 0x7f7638196a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f762800e9c0 tx=0x7f762800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7635ffb700 1 -- 172.21.15.6:0/1513493447 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628004220 con 0x7f76380fff80 2023-09-13T09:49:00.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7635ffb700 1 -- 172.21.15.6:0/1513493447 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7628004380 con 0x7f76380fff80 2023-09-13T09:49:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763819ebc0 con 0x7f76380fff80 2023-09-13T09:49:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f7635ffb700 1 -- 172.21.15.6:0/1513493447 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628003be0 con 0x7f76380fff80 2023-09-13T09:49:00.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.856+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763819f120 con 0x7f76380fff80 2023-09-13T09:49:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.858+0000 7f7635ffb700 1 -- 172.21.15.6:0/1513493447 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7628003d40 con 0x7f76380fff80 2023-09-13T09:49:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.859+0000 7f7635ffb700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76240a06c0 0x7f76240a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.859+0000 7f7635ffb700 1 -- 172.21.15.6:0/1513493447 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7628014070 con 0x7f76380fff80 2023-09-13T09:49:00.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.859+0000 7f762ffff700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76240a06c0 0x7f76240a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f762ffff700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76240a06c0 0x7f76240a2b80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f762000b2e0 tx=0x7f7620005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 Processor -- start 2023-09-13T09:49:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 -- start start 2023-09-13T09:49:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a881cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a881bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a8774800 con 0x5618a881d0e0 2023-09-13T09:49:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a8772120 con 0x5618a881ba80 2023-09-13T09:49:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f764a824b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a876da10 con 0x5618a881c780 2023-09-13T09:49:00.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f7637fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a881cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39900/0 (socket says 172.21.15.6:39900) 2023-09-13T09:49:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f762ffff700 1 -- 172.21.15.6:0/3816287723 learned_addr learned my addr 172.21.15.6:0/3816287723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.860+0000 7f763cbdc700 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a881bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f7637fff700 1 -- 172.21.15.6:0/3816287723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 msgr2=0x5618a881bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f7637fff700 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a881bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f7637fff700 1 -- 172.21.15.6:0/3816287723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 msgr2=0x5618a881b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f7637fff700 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f7637fff700 1 -- 172.21.15.6:0/3816287723 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618a85ed6b0 con 0x5618a881c780 2023-09-13T09:49:00.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f7637fff700 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a881cba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76280c9910 tx=0x7f7628098f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5b01657c058970f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f762e7fc700 1 -- 172.21.15.6:0/3816287723 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280995b0 con 0x5618a881c780 2023-09-13T09:49:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f762e7fc700 1 -- 172.21.15.6:0/3816287723 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f762809d3e0 con 0x5618a881c780 2023-09-13T09:49:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.861+0000 7f762e7fc700 1 -- 172.21.15.6:0/3816287723 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628097a70 con 0x5618a881c780 2023-09-13T09:49:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 -- 172.21.15.6:0/3816287723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 msgr2=0x5618a881cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a881cba0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f76280c9910 tx=0x7f7628098f90 comp rx=0 tx=0).stop 2023-09-13T09:49:00.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 -- 172.21.15.6:0/3816287723 shutdown_connections 2023-09-13T09:49:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a881bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a881cba0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 --2- 172.21.15.6:0/3816287723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 -- 172.21.15.6:0/3816287723 >> 172.21.15.6:0/3816287723 conn(0x5618a8779d00 msgr2=0x5618a8815f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:00.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 -- 172.21.15.6:0/3816287723 shutdown_connections 2023-09-13T09:49:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 -- 172.21.15.6:0/3816287723 wait complete. 2023-09-13T09:49:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 -- start start 2023-09-13T09:49:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.862+0000 7f764a824b80 1 Processor -- start 2023-09-13T09:49:00.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f764a824b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881ba80 0x5618a8825010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f764a824b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a8825550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f764a824b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881d0e0 0x5618a882c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f764a824b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a870bc30 con 0x5618a881c780 2023-09-13T09:49:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f764a824b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a870b930 con 0x5618a881d0e0 2023-09-13T09:49:00.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f764a824b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a85ef9a0 con 0x5618a881ba80 2023-09-13T09:49:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f764a824b80 10 client.0 _ll_register_callbacks cb 0x5618a8709700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a8825550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a8825550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39906/0 (socket says 172.21.15.6:39906) 2023-09-13T09:49:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f7637fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881ba80 0x5618a8825010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 -- 172.21.15.6:0/412928649 learned_addr learned my addr 172.21.15.6:0/412928649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:00.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f763cbdc700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881d0e0 0x5618a882c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 -- 172.21.15.6:0/412928649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881ba80 msgr2=0x5618a8825010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881ba80 0x5618a8825010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 -- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881d0e0 msgr2=0x5618a882c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881d0e0 0x5618a882c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 -- 172.21.15.6:0/412928649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763819f120 con 0x5618a881c780 2023-09-13T09:49:00.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f7637fff700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881ba80 0x5618a8825010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:00.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f763cbdc700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881d0e0 0x5618a882c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:00.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f762ffff700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a8825550 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f762000fd00 tx=0x7f762001a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5489b34ee6cb9a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.863+0000 7f76177fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f76177fe700 1 -- 172.21.15.6:0/412928649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f762002b050 con 0x5618a881c780 2023-09-13T09:49:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f76177fe700 1 -- 172.21.15.6:0/412928649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7620026270 con 0x5618a881c780 2023-09-13T09:49:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5618a880e6f0 con 0x5618a881c780 2023-09-13T09:49:00.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f76177fe700 1 -- 172.21.15.6:0/412928649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7620026b20 con 0x5618a881c780 2023-09-13T09:49:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 10 client.17997 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5618a8785820 con 0x5618a881c780 2023-09-13T09:49:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f76177fe700 1 -- 172.21.15.6:0/412928649 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f762003f020 con 0x5618a881c780 2023-09-13T09:49:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f76177fe700 1 -- 172.21.15.6:0/412928649 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7620039400 con 0x5618a881c780 2023-09-13T09:49:00.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 10 client.17997 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 10 client.17997 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 20 client.17997 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8830e10 0x5618a8833230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 4 client.17997 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5618a87669f0 con 0x5618a8830e10 2023-09-13T09:49:00.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.864+0000 7f7637fff700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8830e10 0x5618a8833230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.865+0000 7f7637fff700 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8830e10 0x5618a8833230 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3410584ce9e9a5f6 server_cookie=efdffb20f44442ba in_seq=0 out_seq=0 2023-09-13T09:49:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.865+0000 7f76177fe700 10 client.17997 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.865+0000 7f76177fe700 1 -- 172.21.15.6:0/412928649 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5618a87669f0 con 0x5618a8830e10 2023-09-13T09:49:00.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.865+0000 7f76177fe700 10 client.17997 handle_command_reply: tid=0 2023-09-13T09:49:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.865+0000 7f764a824b80 1 client.17997 shutdown 2023-09-13T09:49:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 msgr2=0x5618a8825550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a8825550 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f762000fd00 tx=0x7f762001a050 comp rx=0 tx=0).stop 2023-09-13T09:49:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 shutdown_connections 2023-09-13T09:49:00.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881d0e0 0x5618a882c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881ba80 0x5618a8825010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8830e10 0x5618a8833230 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 --2- 172.21.15.6:0/412928649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a8825550 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f76177fe700 0 client.17997 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 >> 172.21.15.6:0/412928649 conn(0x5618a8779d00 msgr2=0x5618a8810870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:00.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 shutdown_connections 2023-09-13T09:49:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 1 -- 172.21.15.6:0/412928649 wait complete. 2023-09-13T09:49:00.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.866+0000 7f764a824b80 20 client.17997 trim_cache size 0 max 16384 2023-09-13T09:49:00.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 Processor -- start 2023-09-13T09:49:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 -- start start 2023-09-13T09:49:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8810970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a882c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a8824b80 con 0x5618a881d0e0 2023-09-13T09:49:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a8817a90 con 0x5618a881ba80 2023-09-13T09:49:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f764a824b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a8825c90 con 0x5618a881c780 2023-09-13T09:49:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f763cbdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f7637fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8810970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f7637fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8810970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33436/0 (socket says 172.21.15.6:33436) 2023-09-13T09:49:00.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f7637fff700 1 -- 172.21.15.6:0/724932186 learned_addr learned my addr 172.21.15.6:0/724932186 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f763cbdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39916/0 (socket says 172.21.15.6:39916) 2023-09-13T09:49:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.884+0000 7f762ffff700 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a882c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f7637fff700 1 -- 172.21.15.6:0/724932186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 msgr2=0x5618a882c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f7637fff700 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a882c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f7637fff700 1 -- 172.21.15.6:0/724932186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 msgr2=0x5618a881ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f7637fff700 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f7637fff700 1 -- 172.21.15.6:0/724932186 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5618a8816230 con 0x5618a881ba80 2023-09-13T09:49:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f7637fff700 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8810970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76280992b0 tx=0x7f762800cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd31c5fca8b68164 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:00.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f762effd700 1 -- 172.21.15.6:0/724932186 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628099630 con 0x5618a881ba80 2023-09-13T09:49:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f762effd700 1 -- 172.21.15.6:0/724932186 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f76280044f0 con 0x5618a881ba80 2023-09-13T09:49:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.885+0000 7f762effd700 1 -- 172.21.15.6:0/724932186 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628098aa0 con 0x5618a881ba80 2023-09-13T09:49:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 -- 172.21.15.6:0/724932186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 msgr2=0x5618a8810970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8810970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f76280992b0 tx=0x7f762800cf10 comp rx=0 tx=0).stop 2023-09-13T09:49:00.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 -- 172.21.15.6:0/724932186 shutdown_connections 2023-09-13T09:49:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881d0e0 0x5618a881ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8810970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 --2- 172.21.15.6:0/724932186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881c780 0x5618a882c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 -- 172.21.15.6:0/724932186 >> 172.21.15.6:0/724932186 conn(0x5618a8779d00 msgr2=0x5618a881a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 -- 172.21.15.6:0/724932186 shutdown_connections 2023-09-13T09:49:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 -- 172.21.15.6:0/724932186 wait complete. 2023-09-13T09:49:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 -- start start 2023-09-13T09:49:00.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.886+0000 7f764a824b80 1 Processor -- start 2023-09-13T09:49:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f764a824b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8829bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f764a824b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a882a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f764a824b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881d0e0 0x5618a882b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f764a824b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a882b650 con 0x5618a881c780 2023-09-13T09:49:00.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f764a824b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a882b7c0 con 0x5618a881ba80 2023-09-13T09:49:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f764a824b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5618a882b980 con 0x5618a881d0e0 2023-09-13T09:49:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f764a824b80 10 client.0 _ll_register_callbacks cb 0x5618a8709700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a882a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f7637fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8829bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f762ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a882a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39920/0 (socket says 172.21.15.6:39920) 2023-09-13T09:49:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f762ffff700 1 -- 172.21.15.6:0/3613876758 learned_addr learned my addr 172.21.15.6:0/3613876758 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f763cbdc700 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881d0e0 0x5618a882b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f7637fff700 1 -- 172.21.15.6:0/3613876758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881d0e0 msgr2=0x5618a882b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f7637fff700 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881d0e0 0x5618a882b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f7637fff700 1 -- 172.21.15.6:0/3613876758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 msgr2=0x5618a882a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f7637fff700 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a882a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f7637fff700 1 -- 172.21.15.6:0/3613876758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5618a85ed6b0 con 0x5618a881ba80 2023-09-13T09:49:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f7637fff700 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8829bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f76280c9910 tx=0x7f762801fde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecad78d1aefbe5f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.887+0000 7f76177fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:49:00.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f76177fe700 1 -- 172.21.15.6:0/3613876758 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628099630 con 0x5618a881ba80 2023-09-13T09:49:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f76177fe700 1 -- 172.21.15.6:0/3613876758 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f76280976f0 con 0x5618a881ba80 2023-09-13T09:49:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f762809d3e0 con 0x5618a881ba80 2023-09-13T09:49:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f76177fe700 1 -- 172.21.15.6:0/3613876758 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7628099880 con 0x5618a881ba80 2023-09-13T09:49:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 10 client.27401 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:00.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5618a8599e60 con 0x5618a881ba80 2023-09-13T09:49:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f76177fe700 1 -- 172.21.15.6:0/3613876758 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f762809d3e0 con 0x5618a881ba80 2023-09-13T09:49:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f76177fe700 1 -- 172.21.15.6:0/3613876758 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f76280a1190 con 0x5618a881ba80 2023-09-13T09:49:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 10 client.27401 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 10 client.27401 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:00.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 20 client.27401 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8887140 0x5618a8889530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 4 client.27401 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:49:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5618a87270d0 con 0x5618a8887140 2023-09-13T09:49:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.888+0000 7f762ffff700 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8887140 0x5618a8889530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.889+0000 7f76177fe700 10 client.27401 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:00.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.889+0000 7f762ffff700 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8887140 0x5618a8889530 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1c84293ddf8c4ed server_cookie=3f5f7423aa06c2b6 in_seq=0 out_seq=0 2023-09-13T09:49:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f76177fe700 1 -- 172.21.15.6:0/3613876758 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5618a87270d0 con 0x5618a8887140 2023-09-13T09:49:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f76177fe700 10 client.27401 handle_command_reply: tid=0 2023-09-13T09:49:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 client.27401 shutdown 2023-09-13T09:49:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 msgr2=0x5618a8829bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8829bc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f76280c9910 tx=0x7f762801fde0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 shutdown_connections 2023-09-13T09:49:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5618a881d0e0 0x5618a882b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5618a881ba80 0x5618a8829bc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5618a8887140 0x5618a8889530 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 --2- 172.21.15.6:0/3613876758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5618a881c780 0x5618a882a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f76177fe700 0 client.27401 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 >> 172.21.15.6:0/3613876758 conn(0x5618a8779d00 msgr2=0x5618a881adc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:00.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 shutdown_connections 2023-09-13T09:49:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 1 -- 172.21.15.6:0/3613876758 wait complete. 2023-09-13T09:49:00.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.891+0000 7f764a824b80 20 client.27401 trim_cache size 0 max 16384 2023-09-13T09:49:00.912 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:49:00.912 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:49:00.913 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "1f26a041-0165-4439-9a45-cfc13c54d880", 2023-09-13T09:49:00.913 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:49:00.913 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:49:00.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76240a06c0 msgr2=0x7f76240a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76240a06c0 0x7f76240a2b80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f762000b2e0 tx=0x7f7620005960 comp rx=0 tx=0).stop 2023-09-13T09:49:00.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 msgr2=0x7f7638196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:00.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 0x7f7638196a90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f762800e9c0 tx=0x7f762800ecd0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 shutdown_connections 2023-09-13T09:49:00.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7638101250 0x7f763819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f76380fff80 0x7f7638196a90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f76240a06c0 0x7f76240a2b80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 --2- 172.21.15.6:0/1513493447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7638100920 0x7f7638196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 >> 172.21.15.6:0/1513493447 conn(0x7f76380fa9b0 msgr2=0x7f7638104420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 shutdown_connections 2023-09-13T09:49:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:00.892+0000 7f763e63f700 1 -- 172.21.15.6:0/1513493447 wait complete. 2023-09-13T09:49:00.917 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:49:01.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 -- 172.21.15.6:0/702225591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 msgr2=0x7f62b4103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/702225591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 0x7f62b4103c30 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009990 tx=0x7f62a4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 -- 172.21.15.6:0/702225591 shutdown_connections 2023-09-13T09:49:01.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/702225591 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62b4106aa0 0x7f62b4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/702225591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 0x7f62b4103c30 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/702225591 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b4104170 0x7f62b4106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 -- 172.21.15.6:0/702225591 >> 172.21.15.6:0/702225591 conn(0x7f62b40fb250 msgr2=0x7f62b40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:01.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 -- 172.21.15.6:0/702225591 shutdown_connections 2023-09-13T09:49:01.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.059+0000 7f62b9cb9700 1 -- 172.21.15.6:0/702225591 wait complete. 2023-09-13T09:49:01.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.060+0000 7f62b9cb9700 1 Processor -- start 2023-09-13T09:49:01.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.060+0000 7f62b9cb9700 1 -- start start 2023-09-13T09:49:01.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.060+0000 7f62b9cb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 0x7f62b4196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.060+0000 7f62b9cb9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b4104170 0x7f62b4196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.060+0000 7f62b9cb9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62b4106aa0 0x7f62b419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b9cb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b419e5d0 con 0x7f62b4101840 2023-09-13T09:49:01.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b9cb9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b419e710 con 0x7f62b4104170 2023-09-13T09:49:01.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b9cb9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b419e8a0 con 0x7f62b4106aa0 2023-09-13T09:49:01.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 0x7f62b4196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 0x7f62b4196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39932/0 (socket says 172.21.15.6:39932) 2023-09-13T09:49:01.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b4104170 0x7f62b4196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b37fe700 1 -- 172.21.15.6:0/923293383 learned_addr learned my addr 172.21.15.6:0/923293383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:01.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b3fff700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62b4106aa0 0x7f62b419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b2ffd700 1 -- 172.21.15.6:0/923293383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62b4106aa0 msgr2=0x7f62b419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62b4106aa0 0x7f62b419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b2ffd700 1 -- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 msgr2=0x7f62b4196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 0x7f62b4196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b2ffd700 1 -- 172.21.15.6:0/923293383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a40095f0 con 0x7f62b4104170 2023-09-13T09:49:01.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b4104170 0x7f62b4196f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62a800e9f0 tx=0x7f62a800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:01.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b0ff9700 1 -- 172.21.15.6:0/923293383 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a800c9c0 con 0x7f62b4104170 2023-09-13T09:49:01.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.061+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b419eb80 con 0x7f62b4104170 2023-09-13T09:49:01.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.062+0000 7f62b0ff9700 1 -- 172.21.15.6:0/923293383 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a8010430 con 0x7f62b4104170 2023-09-13T09:49:01.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.062+0000 7f62b0ff9700 1 -- 172.21.15.6:0/923293383 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8018680 con 0x7f62b4104170 2023-09-13T09:49:01.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.062+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b419f090 con 0x7f62b4104170 2023-09-13T09:49:01.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.064+0000 7f62b0ff9700 1 -- 172.21.15.6:0/923293383 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f62a80105a0 con 0x7f62b4104170 2023-09-13T09:49:01.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62b0ff9700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f629c0a0640 0x7f629c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62b0ff9700 1 -- 172.21.15.6:0/923293383 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f62a8014070 con 0x7f62b4104170 2023-09-13T09:49:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62b37fe700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f629c0a0640 0x7f629c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62b37fe700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f629c0a0640 0x7f629c0a2b00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62a400b2e0 tx=0x7f62a4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62c5e9eb80 1 Processor -- start 2023-09-13T09:49:01.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62c5e9eb80 1 -- start start 2023-09-13T09:49:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf17700 0x55f08cf17b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf18060 0x55f08cf164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.065+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf16e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08ce6f780 con 0x55f08cf18060 2023-09-13T09:49:01.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08ce6d0a0 con 0x55f08cf16a00 2023-09-13T09:49:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08ce68990 con 0x55f08cf17700 2023-09-13T09:49:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf18060 0x55f08cf164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf18060 0x55f08cf164c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39942/0 (socket says 172.21.15.6:39942) 2023-09-13T09:49:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 -- 172.21.15.6:0/566497163 learned_addr learned my addr 172.21.15.6:0/566497163 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:01.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b37fe700 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf17700 0x55f08cf17b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b3fff700 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf16e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 -- 172.21.15.6:0/566497163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf17700 msgr2=0x55f08cf17b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf17700 0x55f08cf17b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 -- 172.21.15.6:0/566497163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 msgr2=0x55f08cf16e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf16e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 -- 172.21.15.6:0/566497163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f08cce8630 con 0x55f08cf18060 2023-09-13T09:49:01.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf18060 0x55f08cf164c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f62a8099450 tx=0x7f62a8099000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b894f469969c94 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:01.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f6299ffb700 1 -- 172.21.15.6:0/566497163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a809d120 con 0x55f08cf18060 2023-09-13T09:49:01.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f6299ffb700 1 -- 172.21.15.6:0/566497163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a8099bc0 con 0x55f08cf18060 2023-09-13T09:49:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.066+0000 7f6299ffb700 1 -- 172.21.15.6:0/566497163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8010880 con 0x55f08cf18060 2023-09-13T09:49:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/566497163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf18060 msgr2=0x55f08cf164c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf18060 0x55f08cf164c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f62a8099450 tx=0x7f62a8099000 comp rx=0 tx=0).stop 2023-09-13T09:49:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/566497163 shutdown_connections 2023-09-13T09:49:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf16e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf17700 0x55f08cf17b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/566497163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf18060 0x55f08cf164c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/566497163 >> 172.21.15.6:0/566497163 conn(0x55f08ce74c80 msgr2=0x55f08cf10f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/566497163 shutdown_connections 2023-09-13T09:49:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/566497163 wait complete. 2023-09-13T09:49:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.067+0000 7f62c5e9eb80 1 -- start start 2023-09-13T09:49:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 1 Processor -- start 2023-09-13T09:49:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf1feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf203f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf27430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08ce06bb0 con 0x55f08cf17700 2023-09-13T09:49:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08ce068b0 con 0x55f08cf16a00 2023-09-13T09:49:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08ccea920 con 0x55f08cf18060 2023-09-13T09:49:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62c5e9eb80 10 client.0 _ll_register_callbacks cb 0x55f08ce04680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:01.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf203f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf203f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39948/0 (socket says 172.21.15.6:39948) 2023-09-13T09:49:01.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf1feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 -- 172.21.15.6:0/3994269361 learned_addr learned my addr 172.21.15.6:0/3994269361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b3fff700 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf27430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 -- 172.21.15.6:0/3994269361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 msgr2=0x55f08cf27430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf27430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 -- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 msgr2=0x55f08cf1feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf1feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 -- 172.21.15.6:0/3994269361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b419f090 con 0x55f08cf17700 2023-09-13T09:49:01.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b37fe700 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf1feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:01.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf203f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f62a8099b20 tx=0x7f62a8010b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f23afa76348b48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:01.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.068+0000 7f6292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:01.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f6292ffd700 1 -- 172.21.15.6:0/3994269361 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80994c0 con 0x55f08cf17700 2023-09-13T09:49:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f6292ffd700 1 -- 172.21.15.6:0/3994269361 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f62a809d2f0 con 0x55f08cf17700 2023-09-13T09:49:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f08cf09670 con 0x55f08cf17700 2023-09-13T09:49:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f6292ffd700 1 -- 172.21.15.6:0/3994269361 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62a80a1530 con 0x55f08cf17700 2023-09-13T09:49:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 10 client.18015 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:01.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f08ce807a0 con 0x55f08cf17700 2023-09-13T09:49:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f6292ffd700 1 -- 172.21.15.6:0/3994269361 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f08cf09670 con 0x55f08cf17700 2023-09-13T09:49:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f6292ffd700 1 -- 172.21.15.6:0/3994269361 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f62a80b7250 con 0x55f08cf17700 2023-09-13T09:49:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 10 client.18015 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 10 client.18015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:01.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 20 client.18015 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf2b8c0 0x55f08cf2dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 4 client.18015 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f08ce61970 con 0x55f08cf2b8c0 2023-09-13T09:49:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.069+0000 7f62b37fe700 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf2b8c0 0x55f08cf2dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.070+0000 7f62b37fe700 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf2b8c0 0x55f08cf2dce0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2af55010f2e28747 server_cookie=90aabf18b1272684 in_seq=0 out_seq=0 2023-09-13T09:49:01.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.070+0000 7f6292ffd700 10 client.18015 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.070+0000 7f6292ffd700 1 -- 172.21.15.6:0/3994269361 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f08ce61970 con 0x55f08cf2b8c0 2023-09-13T09:49:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.070+0000 7f6292ffd700 10 client.18015 handle_command_reply: tid=0 2023-09-13T09:49:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.070+0000 7f62c5e9eb80 1 client.18015 shutdown 2023-09-13T09:49:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 msgr2=0x55f08cf203f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf203f0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f62a8099b20 tx=0x7f62a8010b80 comp rx=0 tx=0).stop 2023-09-13T09:49:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 shutdown_connections 2023-09-13T09:49:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf27430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf16a00 0x55f08cf1feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf2b8c0 0x55f08cf2dce0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/3994269361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf203f0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f6292ffd700 0 client.18015 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 >> 172.21.15.6:0/3994269361 conn(0x55f08ce74c80 msgr2=0x55f08cf0b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 shutdown_connections 2023-09-13T09:49:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/3994269361 wait complete. 2023-09-13T09:49:01.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.071+0000 7f62c5e9eb80 20 client.18015 trim_cache size 0 max 16384 2023-09-13T09:49:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 Processor -- start 2023-09-13T09:49:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 -- start start 2023-09-13T09:49:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf16a00 0x55f08cf164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf17700 0x55f08cf273f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf1eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08cf0d8e0 con 0x55f08cf16a00 2023-09-13T09:49:01.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08cf20b30 con 0x55f08cf17700 2023-09-13T09:49:01.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08cf1e620 con 0x55f08cf18060 2023-09-13T09:49:01.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62b37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf16a00 0x55f08cf164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf17700 0x55f08cf273f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf17700 0x55f08cf273f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33480/0 (socket says 172.21.15.6:33480) 2023-09-13T09:49:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.090+0000 7f62b2ffd700 1 -- 172.21.15.6:0/922845027 learned_addr learned my addr 172.21.15.6:0/922845027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b3fff700 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf1eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b2ffd700 1 -- 172.21.15.6:0/922845027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 msgr2=0x55f08cf1eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf1eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b2ffd700 1 -- 172.21.15.6:0/922845027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf16a00 msgr2=0x55f08cf164c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf16a00 0x55f08cf164c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b2ffd700 1 -- 172.21.15.6:0/922845027 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f08cc94de0 con 0x55f08cf17700 2023-09-13T09:49:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b37fe700 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf16a00 0x55f08cf164c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:01.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf17700 0x55f08cf273f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f62a8099450 tx=0x7f62a8005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2ece3c31109f7cd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f629a7fc700 1 -- 172.21.15.6:0/922845027 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a809d120 con 0x55f08cf17700 2023-09-13T09:49:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f629a7fc700 1 -- 172.21.15.6:0/922845027 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a80a10a0 con 0x55f08cf17700 2023-09-13T09:49:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.091+0000 7f629a7fc700 1 -- 172.21.15.6:0/922845027 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a80994c0 con 0x55f08cf17700 2023-09-13T09:49:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/922845027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf17700 msgr2=0x55f08cf273f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf17700 0x55f08cf273f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f62a8099450 tx=0x7f62a8005bb0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/922845027 shutdown_connections 2023-09-13T09:49:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf18060 0x55f08cf1eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf16a00 0x55f08cf164c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/922845027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf17700 0x55f08cf273f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/922845027 >> 172.21.15.6:0/922845027 conn(0x55f08ce74c80 msgr2=0x55f08cf10e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:01.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/922845027 shutdown_connections 2023-09-13T09:49:01.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/922845027 wait complete. 2023-09-13T09:49:01.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.092+0000 7f62c5e9eb80 1 -- start start 2023-09-13T09:49:01.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 1 Processor -- start 2023-09-13T09:49:01.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf16a00 0x55f08cf22d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf23250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf18060 0x55f08cf26270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08cf267b0 con 0x55f08cf17700 2023-09-13T09:49:01.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08cf26920 con 0x55f08cf18060 2023-09-13T09:49:01.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f08cf26ae0 con 0x55f08cf16a00 2023-09-13T09:49:01.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62c5e9eb80 10 client.0 _ll_register_callbacks cb 0x55f08ce04680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf23250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf23250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39962/0 (socket says 172.21.15.6:39962) 2023-09-13T09:49:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 -- 172.21.15.6:0/2971998466 learned_addr learned my addr 172.21.15.6:0/2971998466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b3fff700 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf18060 0x55f08cf26270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b37fe700 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf16a00 0x55f08cf22d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 -- 172.21.15.6:0/2971998466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf16a00 msgr2=0x55f08cf22d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf16a00 0x55f08cf22d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 -- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf18060 msgr2=0x55f08cf26270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf18060 0x55f08cf26270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 -- 172.21.15.6:0/2971998466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b4109b00 con 0x55f08cf17700 2023-09-13T09:49:01.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f62b2ffd700 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf23250 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f62a801e000 tx=0x7f62a8009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3147fc811505b623 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.093+0000 7f6292ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f6292ffd700 1 -- 172.21.15.6:0/2971998466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a809d120 con 0x55f08cf17700 2023-09-13T09:49:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f6292ffd700 1 -- 172.21.15.6:0/2971998466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f62a80994c0 con 0x55f08cf17700 2023-09-13T09:49:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62a8099bc0 con 0x55f08cf17700 2023-09-13T09:49:01.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f6292ffd700 1 -- 172.21.15.6:0/2971998466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62a8095300 con 0x55f08cf17700 2023-09-13T09:49:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 10 client.18021 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f08ce807a0 con 0x55f08cf17700 2023-09-13T09:49:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f6292ffd700 1 -- 172.21.15.6:0/2971998466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f62a8099bc0 con 0x55f08cf17700 2023-09-13T09:49:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f6292ffd700 1 -- 172.21.15.6:0/2971998466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f62a80b1cf0 con 0x55f08cf17700 2023-09-13T09:49:01.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 10 client.18021 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 10 client.18021 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 20 client.18021 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf7fd10 0x55f08cf82130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 4 client.18021 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:49:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f08ce22050 con 0x55f08cf7fd10 2023-09-13T09:49:01.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.094+0000 7f62b37fe700 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf7fd10 0x55f08cf82130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:01.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f6292ffd700 10 client.18021 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:01.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62b37fe700 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf7fd10 0x55f08cf82130 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97a9d87bc0e26ef5 server_cookie=706d10aecf121b27 in_seq=0 out_seq=0 2023-09-13T09:49:01.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f6292ffd700 1 -- 172.21.15.6:0/2971998466 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f08ce22050 con 0x55f08cf7fd10 2023-09-13T09:49:01.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f6292ffd700 10 client.18021 handle_command_reply: tid=0 2023-09-13T09:49:01.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 client.18021 shutdown 2023-09-13T09:49:01.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 msgr2=0x55f08cf23250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf23250 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f62a801e000 tx=0x7f62a8009790 comp rx=0 tx=0).stop 2023-09-13T09:49:01.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 shutdown_connections 2023-09-13T09:49:01.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f08cf18060 0x55f08cf26270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f08cf16a00 0x55f08cf22d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f08cf7fd10 0x55f08cf82130 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 --2- 172.21.15.6:0/2971998466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f08cf17700 0x55f08cf23250 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f6292ffd700 0 client.18021 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 >> 172.21.15.6:0/2971998466 conn(0x55f08ce74c80 msgr2=0x55f08cf1eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:01.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 shutdown_connections 2023-09-13T09:49:01.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 1 -- 172.21.15.6:0/2971998466 wait complete. 2023-09-13T09:49:01.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.095+0000 7f62c5e9eb80 20 client.18021 trim_cache size 0 max 16384 2023-09-13T09:49:01.118 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:49:01.118 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:49:01.119 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:49:01.119 INFO:teuthology.orchestra.run.smithi006.stdout: "1f26a041-0165-4439-9a45-cfc13c54d880": { 2023-09-13T09:49:01.119 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:49:01.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "1f26a041-0165-4439-9a45-cfc13c54d880", 2023-09-13T09:49:01.119 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:49:01.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:49:01.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:49:01.120 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:49:01.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f629c0a0640 msgr2=0x7f629c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f629c0a0640 0x7f629c0a2b00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f62a400b2e0 tx=0x7f62a4005960 comp rx=0 tx=0).stop 2023-09-13T09:49:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b4104170 msgr2=0x7f62b4196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b4104170 0x7f62b4196f90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f62a800e9f0 tx=0x7f62a800ed00 comp rx=0 tx=0).stop 2023-09-13T09:49:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 shutdown_connections 2023-09-13T09:49:01.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62b4106aa0 0x7f62b419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f629c0a0640 0x7f629c0a2b00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62b4101840 0x7f62b4196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 --2- 172.21.15.6:0/923293383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f62b4104170 0x7f62b4196f90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 >> 172.21.15.6:0/923293383 conn(0x7f62b40fb250 msgr2=0x7f62b41024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:01.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 shutdown_connections 2023-09-13T09:49:01.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:01.096+0000 7f62b9cb9700 1 -- 172.21.15.6:0/923293383 wait complete. 2023-09-13T09:49:01.124 INFO:tasks.cephfs.filesystem:scrub status for tag:1f26a041-0165-4439-9a45-cfc13c54d880 - {'path': '/', 'tag': '1f26a041-0165-4439-9a45-cfc13c54d880', 'options': 'recursive,force'} 2023-09-13T09:49:01.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 512013 5.98 MB/sec execute 381 sec latency 27.547 ms 2023-09-13T09:49:01.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:01 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:01.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:01 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:01.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:01 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:01.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:01 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:01.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:01 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:01.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:01 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:01.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:01 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:01.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:01 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:01.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:01 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:01.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:01 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:01.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:01 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:01.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:01 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 514029 5.98 MB/sec execute 382 sec latency 24.253 ms 2023-09-13T09:49:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: pgmap v585: 97 pgs: 97 active+clean; 186 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 2.1 MiB/s wr, 216 op/s 2023-09-13T09:49:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:49:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: pgmap v585: 97 pgs: 97 active+clean; 186 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 2.1 MiB/s wr, 216 op/s 2023-09-13T09:49:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:49:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: pgmap v585: 97 pgs: 97 active+clean; 186 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 484 KiB/s rd, 2.1 MiB/s wr, 216 op/s 2023-09-13T09:49:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:49:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:03.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 515428 5.99 MB/sec execute 383 sec latency 58.419 ms 2023-09-13T09:49:04.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 516764 5.99 MB/sec execute 384 sec latency 20.557 ms 2023-09-13T09:49:04.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:04 smithi006 ceph-mon[98665]: pgmap v586: 97 pgs: 97 active+clean; 189 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 2.4 MiB/s wr, 283 op/s 2023-09-13T09:49:04.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:04 smithi053 ceph-mon[102373]: pgmap v586: 97 pgs: 97 active+clean; 189 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 2.4 MiB/s wr, 283 op/s 2023-09-13T09:49:04.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:04 smithi131 ceph-mon[102785]: pgmap v586: 97 pgs: 97 active+clean; 189 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 2.4 MiB/s wr, 283 op/s 2023-09-13T09:49:05.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 518871 6.01 MB/sec execute 385 sec latency 24.636 ms 2023-09-13T09:49:06.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 519851 6.00 MB/sec execute 386 sec latency 29.231 ms 2023-09-13T09:49:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:06 smithi006 ceph-mon[98665]: pgmap v587: 97 pgs: 97 active+clean; 194 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 2.5 MiB/s wr, 234 op/s 2023-09-13T09:49:06.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:06 smithi053 ceph-mon[102373]: pgmap v587: 97 pgs: 97 active+clean; 194 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 2.5 MiB/s wr, 234 op/s 2023-09-13T09:49:06.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:06 smithi131 ceph-mon[102785]: pgmap v587: 97 pgs: 97 active+clean; 194 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 515 KiB/s rd, 2.5 MiB/s wr, 234 op/s 2023-09-13T09:49:07.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 522160 6.03 MB/sec execute 387 sec latency 16.332 ms 2023-09-13T09:49:08.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 523003 6.02 MB/sec execute 388 sec latency 22.391 ms 2023-09-13T09:49:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:08 smithi006 ceph-mon[98665]: pgmap v588: 97 pgs: 97 active+clean; 208 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 3.7 MiB/s wr, 263 op/s 2023-09-13T09:49:08.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:08 smithi053 ceph-mon[102373]: pgmap v588: 97 pgs: 97 active+clean; 208 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 3.7 MiB/s wr, 263 op/s 2023-09-13T09:49:08.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:08 smithi131 ceph-mon[102785]: pgmap v588: 97 pgs: 97 active+clean; 208 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 590 KiB/s rd, 3.7 MiB/s wr, 263 op/s 2023-09-13T09:49:09.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 525194 6.03 MB/sec execute 389 sec latency 20.262 ms 2023-09-13T09:49:10.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 526322 6.03 MB/sec execute 390 sec latency 17.377 ms 2023-09-13T09:49:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:10 smithi006 ceph-mon[98665]: pgmap v589: 97 pgs: 97 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 3.6 MiB/s wr, 254 op/s 2023-09-13T09:49:10.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:10 smithi053 ceph-mon[102373]: pgmap v589: 97 pgs: 97 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 3.6 MiB/s wr, 254 op/s 2023-09-13T09:49:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:10 smithi131 ceph-mon[102785]: pgmap v589: 97 pgs: 97 active+clean; 214 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 624 KiB/s rd, 3.6 MiB/s wr, 254 op/s 2023-09-13T09:49:11.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 528522 6.05 MB/sec execute 391 sec latency 12.984 ms 2023-09-13T09:49:12.176 INFO:tasks.workunit.client.0.smithi006.stdout: 1 529732 6.05 MB/sec execute 392 sec latency 55.429 ms 2023-09-13T09:49:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:12 smithi006 ceph-mon[98665]: pgmap v590: 97 pgs: 97 active+clean; 212 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 3.6 MiB/s wr, 232 op/s 2023-09-13T09:49:12.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:12 smithi053 ceph-mon[102373]: pgmap v590: 97 pgs: 97 active+clean; 212 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 3.6 MiB/s wr, 232 op/s 2023-09-13T09:49:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:12 smithi131 ceph-mon[102785]: pgmap v590: 97 pgs: 97 active+clean; 212 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 544 KiB/s rd, 3.6 MiB/s wr, 232 op/s 2023-09-13T09:49:13.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 531709 6.06 MB/sec execute 393 sec latency 30.809 ms 2023-09-13T09:49:14.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 533188 6.07 MB/sec execute 394 sec latency 14.366 ms 2023-09-13T09:49:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:14 smithi006 ceph-mon[98665]: pgmap v591: 97 pgs: 97 active+clean; 212 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 4.0 MiB/s wr, 260 op/s 2023-09-13T09:49:14.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:14 smithi053 ceph-mon[102373]: pgmap v591: 97 pgs: 97 active+clean; 212 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 4.0 MiB/s wr, 260 op/s 2023-09-13T09:49:14.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:14 smithi131 ceph-mon[102785]: pgmap v591: 97 pgs: 97 active+clean; 212 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 4.0 MiB/s wr, 260 op/s 2023-09-13T09:49:15.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 534546 6.07 MB/sec execute 395 sec latency 12.867 ms 2023-09-13T09:49:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:15.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:15.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:15.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:15.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:16.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 536654 6.09 MB/sec execute 396 sec latency 15.296 ms 2023-09-13T09:49:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:16 smithi053 ceph-mon[102373]: pgmap v592: 97 pgs: 97 active+clean; 216 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 3.8 MiB/s wr, 255 op/s 2023-09-13T09:49:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:16 smithi006 ceph-mon[98665]: pgmap v592: 97 pgs: 97 active+clean; 216 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 3.8 MiB/s wr, 255 op/s 2023-09-13T09:49:16.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:16 smithi131 ceph-mon[102785]: pgmap v592: 97 pgs: 97 active+clean; 216 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 666 KiB/s rd, 3.8 MiB/s wr, 255 op/s 2023-09-13T09:49:17.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 537614 6.08 MB/sec execute 397 sec latency 35.488 ms 2023-09-13T09:49:18.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 539805 6.09 MB/sec execute 398 sec latency 39.936 ms 2023-09-13T09:49:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:18 smithi006 ceph-mon[98665]: pgmap v593: 97 pgs: 97 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 3.8 MiB/s wr, 264 op/s 2023-09-13T09:49:18.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:18 smithi053 ceph-mon[102373]: pgmap v593: 97 pgs: 97 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 3.8 MiB/s wr, 264 op/s 2023-09-13T09:49:18.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:18 smithi131 ceph-mon[102785]: pgmap v593: 97 pgs: 97 active+clean; 217 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 3.8 MiB/s wr, 264 op/s 2023-09-13T09:49:19.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 540721 6.09 MB/sec execute 399 sec latency 50.660 ms 2023-09-13T09:49:20.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 542954 6.11 MB/sec execute 400 sec latency 15.573 ms 2023-09-13T09:49:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:20 smithi006 ceph-mon[98665]: pgmap v594: 97 pgs: 97 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-13T09:49:20.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:20 smithi053 ceph-mon[102373]: pgmap v594: 97 pgs: 97 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-13T09:49:20.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:20 smithi131 ceph-mon[102785]: pgmap v594: 97 pgs: 97 active+clean; 219 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 796 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-13T09:49:21.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 544085 6.11 MB/sec execute 401 sec latency 13.300 ms 2023-09-13T09:49:22.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 546122 6.11 MB/sec execute 402 sec latency 13.407 ms 2023-09-13T09:49:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:22 smithi006 ceph-mon[98665]: pgmap v595: 97 pgs: 97 active+clean; 220 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.3 MiB/s wr, 226 op/s 2023-09-13T09:49:22.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:22 smithi053 ceph-mon[102373]: pgmap v595: 97 pgs: 97 active+clean; 220 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.3 MiB/s wr, 226 op/s 2023-09-13T09:49:22.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:22 smithi131 ceph-mon[102785]: pgmap v595: 97 pgs: 97 active+clean; 220 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 610 KiB/s rd, 2.3 MiB/s wr, 226 op/s 2023-09-13T09:49:23.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 547477 6.12 MB/sec execute 403 sec latency 40.594 ms 2023-09-13T09:49:24.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 549405 6.13 MB/sec execute 404 sec latency 30.707 ms 2023-09-13T09:49:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:24 smithi006 ceph-mon[98665]: pgmap v596: 97 pgs: 97 active+clean; 220 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:49:24.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:24 smithi053 ceph-mon[102373]: pgmap v596: 97 pgs: 97 active+clean; 220 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:49:24.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:24 smithi131 ceph-mon[102785]: pgmap v596: 97 pgs: 97 active+clean; 220 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 667 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:49:25.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 550952 6.14 MB/sec execute 405 sec latency 19.970 ms 2023-09-13T09:49:26.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 552591 6.14 MB/sec execute 406 sec latency 13.922 ms 2023-09-13T09:49:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:26 smithi006 ceph-mon[98665]: pgmap v597: 97 pgs: 97 active+clean; 222 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.4 MiB/s wr, 286 op/s 2023-09-13T09:49:26.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:26 smithi053 ceph-mon[102373]: pgmap v597: 97 pgs: 97 active+clean; 222 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.4 MiB/s wr, 286 op/s 2023-09-13T09:49:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:26 smithi131 ceph-mon[102785]: pgmap v597: 97 pgs: 97 active+clean; 222 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.4 MiB/s wr, 286 op/s 2023-09-13T09:49:27.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 554454 6.16 MB/sec execute 407 sec latency 14.894 ms 2023-09-13T09:49:28.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 555666 6.16 MB/sec execute 408 sec latency 24.702 ms 2023-09-13T09:49:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:28 smithi006 ceph-mon[98665]: pgmap v598: 97 pgs: 97 active+clean; 223 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-13T09:49:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:28 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:49:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:28 smithi053 ceph-mon[102373]: pgmap v598: 97 pgs: 97 active+clean; 223 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-13T09:49:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:28 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:49:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:28 smithi131 ceph-mon[102785]: pgmap v598: 97 pgs: 97 active+clean; 223 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 652 KiB/s rd, 2.4 MiB/s wr, 269 op/s 2023-09-13T09:49:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:28 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:49:29.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 557672 6.17 MB/sec execute 409 sec latency 70.455 ms 2023-09-13T09:49:29.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:49:29.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:49:29.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:29 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:49:29.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:49:29.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:49:29.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:29 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:49:29.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:49:29.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:49:29.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:29 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:49:30.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 558506 6.16 MB/sec execute 410 sec latency 44.317 ms 2023-09-13T09:49:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:30 smithi006 ceph-mon[98665]: pgmap v599: 97 pgs: 97 active+clean; 225 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2023-09-13T09:49:30.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:30 smithi053 ceph-mon[102373]: pgmap v599: 97 pgs: 97 active+clean; 225 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2023-09-13T09:49:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:30 smithi131 ceph-mon[102785]: pgmap v599: 97 pgs: 97 active+clean; 225 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 744 KiB/s rd, 2.1 MiB/s wr, 259 op/s 2023-09-13T09:49:31.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:49:31.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 560898 6.18 MB/sec execute 411 sec latency 11.281 ms 2023-09-13T09:49:31.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 -- 172.21.15.6:0/3728613822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 msgr2=0x7f2eb0101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 --2- 172.21.15.6:0/3728613822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 0x7f2eb0101310 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2e980099c0 tx=0x7f2e98009cd0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 -- 172.21.15.6:0/3728613822 shutdown_connections 2023-09-13T09:49:31.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 --2- 172.21.15.6:0/3728613822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb0101850 0x7f2eb0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 --2- 172.21.15.6:0/3728613822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb00ffcc0 0x7f2eb01000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 --2- 172.21.15.6:0/3728613822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 0x7f2eb0101310 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 -- 172.21.15.6:0/3728613822 >> 172.21.15.6:0/3728613822 conn(0x7f2eb00fb250 msgr2=0x7f2eb00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 -- 172.21.15.6:0/3728613822 shutdown_connections 2023-09-13T09:49:31.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.259+0000 7f2eb6103700 1 -- 172.21.15.6:0/3728613822 wait complete. 2023-09-13T09:49:31.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 Processor -- start 2023-09-13T09:49:31.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 -- start start 2023-09-13T09:49:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00ffcc0 0x7f2eb0103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 0x7f2eb0102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb0101850 0x7f2eb01027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb0102f70 con 0x7f2eb00ffcc0 2023-09-13T09:49:31.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01030e0 con 0x7f2eb0100eb0 2023-09-13T09:49:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eb6103700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb01a0b50 con 0x7f2eb0101850 2023-09-13T09:49:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00ffcc0 0x7f2eb0103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.260+0000 7f2eaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00ffcc0 0x7f2eb0103c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39982/0 (socket says 172.21.15.6:39982) 2023-09-13T09:49:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/2150717185 learned_addr learned my addr 172.21.15.6:0/2150717185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 0x7f2eb0102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaffff700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb0101850 0x7f2eb01027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaeffd700 1 -- 172.21.15.6:0/2150717185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb0101850 msgr2=0x7f2eb01027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb0101850 0x7f2eb01027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaeffd700 1 -- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00ffcc0 msgr2=0x7f2eb0103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00ffcc0 0x7f2eb0103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaeffd700 1 -- 172.21.15.6:0/2150717185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea8009c40 con 0x7f2eb0100eb0 2023-09-13T09:49:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaffff700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb0101850 0x7f2eb01027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:49:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00ffcc0 0x7f2eb0103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 0x7f2eb0102290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e980098e0 tx=0x7f2e9800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eacff9700 1 -- 172.21.15.6:0/2150717185 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9801d070 con 0x7f2eb0100eb0 2023-09-13T09:49:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eacff9700 1 -- 172.21.15.6:0/2150717185 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e980054e0 con 0x7f2eb0100eb0 2023-09-13T09:49:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eacff9700 1 -- 172.21.15.6:0/2150717185 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98004a70 con 0x7f2eb0100eb0 2023-09-13T09:49:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e980095f0 con 0x7f2eb0100eb0 2023-09-13T09:49:31.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.261+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb01a0fb0 con 0x7f2eb0100eb0 2023-09-13T09:49:31.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.264+0000 7f2eacff9700 1 -- 172.21.15.6:0/2150717185 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2e9800fb80 con 0x7f2eb0100eb0 2023-09-13T09:49:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.264+0000 7f2eacff9700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e9c0a0640 0x7f2e9c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.264+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e9c0a0640 0x7f2e9c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.264+0000 7f2eacff9700 1 -- 172.21.15.6:0/2150717185 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2e980cc6c0 con 0x7f2eb0100eb0 2023-09-13T09:49:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.265+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e9c0a0640 0x7f2e9c0a2b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0005950 tx=0x7f2ea0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.265+0000 7f2ec22e8b80 1 Processor -- start 2023-09-13T09:49:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.265+0000 7f2ec22e8b80 1 -- start start 2023-09-13T09:49:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9acb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a904780 con 0x56549a9aba00 2023-09-13T09:49:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a9020a0 con 0x56549a9ad060 2023-09-13T09:49:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a8fd990 con 0x56549a9ac700 2023-09-13T09:49:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9abe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39994/0 (socket says 172.21.15.6:39994) 2023-09-13T09:49:31.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 -- 172.21.15.6:0/1274749074 learned_addr learned my addr 172.21.15.6:0/1274749074 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 -- 172.21.15.6:0/1274749074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 msgr2=0x56549a9acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 -- 172.21.15.6:0/1274749074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 msgr2=0x56549a9ab4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9ab4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 -- 172.21.15.6:0/1274749074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549a77d630 con 0x56549a9aba00 2023-09-13T09:49:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2eaffff700 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9abe80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8007550 tx=0x7f2ea8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edb8f8c3dec7faa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ea5ffb700 1 -- 172.21.15.6:0/1274749074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea800e070 con 0x56549a9aba00 2023-09-13T09:49:31.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ea5ffb700 1 -- 172.21.15.6:0/1274749074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea800f040 con 0x56549a9aba00 2023-09-13T09:49:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.266+0000 7f2ea5ffb700 1 -- 172.21.15.6:0/1274749074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8014ac0 con 0x56549a9aba00 2023-09-13T09:49:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/1274749074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 msgr2=0x56549a9abe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9abe80 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8007550 tx=0x7f2ea8009920 comp rx=0 tx=0).stop 2023-09-13T09:49:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/1274749074 shutdown_connections 2023-09-13T09:49:31.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9abe80 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/1274749074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9ab4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/1274749074 >> 172.21.15.6:0/1274749074 conn(0x56549a909c80 msgr2=0x56549a9a5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/1274749074 shutdown_connections 2023-09-13T09:49:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.267+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/1274749074 wait complete. 2023-09-13T09:49:31.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 -- start start 2023-09-13T09:49:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 Processor -- start 2023-09-13T09:49:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ac700 0x56549a9b5420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ad060 0x56549a9bc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a89bbb0 con 0x56549a9aba00 2023-09-13T09:49:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a89b8b0 con 0x56549a9ac700 2023-09-13T09:49:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a77f920 con 0x56549a9ad060 2023-09-13T09:49:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2eaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2ec22e8b80 10 client.0 _ll_register_callbacks cb 0x56549a899680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2eaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39996/0 (socket says 172.21.15.6:39996) 2023-09-13T09:49:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/3148064381 learned_addr learned my addr 172.21.15.6:0/3148064381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ac700 0x56549a9b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.268+0000 7f2eaffff700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ad060 0x56549a9bc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/3148064381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ad060 msgr2=0x56549a9bc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ad060 0x56549a9bc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ac700 msgr2=0x56549a9b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ac700 0x56549a9b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/3148064381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea8009280 con 0x56549a9aba00 2023-09-13T09:49:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ac700 0x56549a9b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b4ee0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000ee30 tx=0x7f2ea00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9781ce01381c42f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2e8effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2e8effd700 1 -- 172.21.15.6:0/3148064381 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0022070 con 0x56549a9aba00 2023-09-13T09:49:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2e8effd700 1 -- 172.21.15.6:0/3148064381 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2ea001dd10 con 0x56549a9aba00 2023-09-13T09:49:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56549a99e670 con 0x56549a9aba00 2023-09-13T09:49:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2e8effd700 1 -- 172.21.15.6:0/3148064381 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ea000ee60 con 0x56549a9aba00 2023-09-13T09:49:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2ec22e8b80 10 client.18033 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56549a9157a0 con 0x56549a9aba00 2023-09-13T09:49:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.269+0000 7f2e8effd700 1 -- 172.21.15.6:0/3148064381 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56549a99e670 con 0x56549a9aba00 2023-09-13T09:49:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2e8effd700 1 -- 172.21.15.6:0/3148064381 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2ea0005020 con 0x56549a9aba00 2023-09-13T09:49:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2ec22e8b80 10 client.18033 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:31.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2ec22e8b80 10 client.18033 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2ec22e8b80 20 client.18033 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549a9c0d80 0x56549a9c31a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2ec22e8b80 4 client.18033 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56549a8f6970 con 0x56549a9c0d80 2023-09-13T09:49:31.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549a9c0d80 0x56549a9c31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2e8effd700 10 client.18033 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.270+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549a9c0d80 0x56549a9c31a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8551d302e8a39a84 server_cookie=e78008b2ef79dc57 in_seq=0 out_seq=0 2023-09-13T09:49:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2e8effd700 1 -- 172.21.15.6:0/3148064381 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56549a8f6970 con 0x56549a9c0d80 2023-09-13T09:49:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2e8effd700 10 client.18033 handle_command_reply: tid=0 2023-09-13T09:49:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 client.18033 shutdown 2023-09-13T09:49:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 msgr2=0x56549a9b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b4ee0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2ea000ee30 tx=0x7f2ea00047c0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 shutdown_connections 2023-09-13T09:49:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ad060 0x56549a9bc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549a9c0d80 0x56549a9c31a0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b4ee0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3148064381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ac700 0x56549a9b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2e8effd700 0 client.18033 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 >> 172.21.15.6:0/3148064381 conn(0x56549a909c80 msgr2=0x56549a9a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 shutdown_connections 2023-09-13T09:49:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3148064381 wait complete. 2023-09-13T09:49:31.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.271+0000 7f2ec22e8b80 20 client.18033 trim_cache size 0 max 16384 2023-09-13T09:49:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.289+0000 7f2ec22e8b80 1 Processor -- start 2023-09-13T09:49:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.289+0000 7f2ec22e8b80 1 -- start start 2023-09-13T09:49:31.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9aba00 0x56549a9ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9bc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9ad060 0x56549a9b2d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a9b03d0 con 0x56549a9ad060 2023-09-13T09:49:31.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a9a6d50 con 0x56549a9aba00 2023-09-13T09:49:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a9c33c0 con 0x56549a9ac700 2023-09-13T09:49:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9ad060 0x56549a9b2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9aba00 0x56549a9ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9ad060 0x56549a9b2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40008/0 (socket says 172.21.15.6:40008) 2023-09-13T09:49:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaffff700 1 -- 172.21.15.6:0/3718689801 learned_addr learned my addr 172.21.15.6:0/3718689801 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9bc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/3718689801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 msgr2=0x56549a9bc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9bc420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/3718689801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9ad060 msgr2=0x56549a9b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9ad060 0x56549a9b2d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/3718689801 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56549a729de0 con 0x56549a9aba00 2023-09-13T09:49:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaffff700 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9ad060 0x56549a9b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.290+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9aba00 0x56549a9ab4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0005400 tx=0x7f2ea000e4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3464ef144b855278 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ea67fc700 1 -- 172.21.15.6:0/3718689801 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0022050 con 0x56549a9aba00 2023-09-13T09:49:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ea67fc700 1 -- 172.21.15.6:0/3718689801 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea0035070 con 0x56549a9aba00 2023-09-13T09:49:31.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ea67fc700 1 -- 172.21.15.6:0/3718689801 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea0003bd0 con 0x56549a9aba00 2023-09-13T09:49:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3718689801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9aba00 msgr2=0x56549a9ab4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9aba00 0x56549a9ab4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0005400 tx=0x7f2ea000e4e0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3718689801 shutdown_connections 2023-09-13T09:49:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9ad060 0x56549a9b2d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9aba00 0x56549a9ab4c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/3718689801 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9bc420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.291+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3718689801 >> 172.21.15.6:0/3718689801 conn(0x56549a909c80 msgr2=0x56549a9a5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3718689801 shutdown_connections 2023-09-13T09:49:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/3718689801 wait complete. 2023-09-13T09:49:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 -- start start 2023-09-13T09:49:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 Processor -- start 2023-09-13T09:49:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9b8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9bb5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a9bbaf0 con 0x56549a9aba00 2023-09-13T09:49:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a9bbc60 con 0x56549a9ad060 2023-09-13T09:49:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56549a9bbe20 con 0x56549a9ac700 2023-09-13T09:49:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2ec22e8b80 10 client.0 _ll_register_callbacks cb 0x56549a899680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2eaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2eaeffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2eaf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40010/0 (socket says 172.21.15.6:40010) 2023-09-13T09:49:31.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2eaf7fe700 1 -- 172.21.15.6:0/2015954011 learned_addr learned my addr 172.21.15.6:0/2015954011 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.292+0000 7f2eaffff700 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9bb5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2eaeffd700 1 -- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 msgr2=0x56549a9bb5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9bb5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2eaeffd700 1 -- 172.21.15.6:0/2015954011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 msgr2=0x56549a9b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2eaeffd700 1 -- 172.21.15.6:0/2015954011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea8007e70 con 0x56549a9ac700 2023-09-13T09:49:31.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2eaeffd700 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9b8590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e980ca170 tx=0x7f2e98005e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7985b7550d794277 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2e8effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:49:31.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2e8effd700 1 -- 172.21.15.6:0/2015954011 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980b2230 con 0x56549a9ac700 2023-09-13T09:49:31.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ea800f040 con 0x56549a9ac700 2023-09-13T09:49:31.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2e8effd700 1 -- 172.21.15.6:0/2015954011 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2e98061060 con 0x56549a9ac700 2023-09-13T09:49:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2e8effd700 1 -- 172.21.15.6:0/2015954011 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e98099ef0 con 0x56549a9ac700 2023-09-13T09:49:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2ec22e8b80 10 client.27361 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56549a9157a0 con 0x56549a9ac700 2023-09-13T09:49:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.293+0000 7f2e8effd700 1 -- 172.21.15.6:0/2015954011 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea800f040 con 0x56549a9ac700 2023-09-13T09:49:31.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2e8effd700 1 -- 172.21.15.6:0/2015954011 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f2e98064070 con 0x56549a9ac700 2023-09-13T09:49:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2ec22e8b80 10 client.27361 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2ec22e8b80 10 client.27361 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2ec22e8b80 20 client.27361 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549aa156b0 0x56549aa17aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2ec22e8b80 4 client.27361 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:49:31.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56549a8b7050 con 0x56549aa156b0 2023-09-13T09:49:31.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549aa156b0 0x56549aa17aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2eaf7fe700 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549aa156b0 0x56549aa17aa0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=626cfa5eb7a06805 server_cookie=9c3312944947c831 in_seq=0 out_seq=0 2023-09-13T09:49:31.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2e8effd700 10 client.27361 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:31.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2e8effd700 1 -- 172.21.15.6:0/2015954011 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56549a8b7050 con 0x56549aa156b0 2023-09-13T09:49:31.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2e8effd700 10 client.27361 handle_command_reply: tid=0 2023-09-13T09:49:31.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.294+0000 7f2ec22e8b80 1 client.27361 shutdown 2023-09-13T09:49:31.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 msgr2=0x56549a9b8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9b8590 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2e980ca170 tx=0x7f2e98005e80 comp rx=0 tx=0).stop 2023-09-13T09:49:31.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 shutdown_connections 2023-09-13T09:49:31.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56549a9ad060 0x56549a9bb5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56549aa156b0 0x56549aa17aa0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56549a9aba00 0x56549a9b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 --2- 172.21.15.6:0/2015954011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56549a9ac700 0x56549a9b8590 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 >> 172.21.15.6:0/2015954011 conn(0x56549a909c80 msgr2=0x56549a9b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2e8effd700 0 client.27361 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:31.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 shutdown_connections 2023-09-13T09:49:31.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 1 -- 172.21.15.6:0/2015954011 wait complete. 2023-09-13T09:49:31.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2ec22e8b80 20 client.27361 trim_cache size 0 max 16384 2023-09-13T09:49:31.315 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:49:31.315 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:49:31.315 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:49:31.316 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:49:31.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e9c0a0640 msgr2=0x7f2e9c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e9c0a0640 0x7f2e9c0a2b00 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2ea0005950 tx=0x7f2ea0009260 comp rx=0 tx=0).stop 2023-09-13T09:49:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 msgr2=0x7f2eb0102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 0x7f2eb0102290 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2e980098e0 tx=0x7f2e9800f690 comp rx=0 tx=0).stop 2023-09-13T09:49:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 shutdown_connections 2023-09-13T09:49:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb0101850 0x7f2eb01027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e9c0a0640 0x7f2e9c0a2b00 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb00ffcc0 0x7f2eb0103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 --2- 172.21.15.6:0/2150717185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb0100eb0 0x7f2eb0102290 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.295+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 >> 172.21.15.6:0/2150717185 conn(0x7f2eb00fb250 msgr2=0x7f2eb0068050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.296+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 shutdown_connections 2023-09-13T09:49:31.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.296+0000 7f2eb6103700 1 -- 172.21.15.6:0/2150717185 wait complete. 2023-09-13T09:49:31.320 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:49:31.320 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:49:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/794875278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88101820 msgr2=0x7f4f88103c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/794875278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88101820 0x7f4f88103c10 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f4f78009990 tx=0x7f4f78009ca0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/794875278 shutdown_connections 2023-09-13T09:49:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/794875278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f88106a80 0x7f4f88108ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/794875278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88101820 0x7f4f88103c10 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/794875278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f88104150 0x7f4f88106540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/794875278 >> 172.21.15.6:0/794875278 conn(0x7f4f880fb1f0 msgr2=0x7f4f880fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/794875278 shutdown_connections 2023-09-13T09:49:31.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.454+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/794875278 wait complete. 2023-09-13T09:49:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.455+0000 7f4f8d0c0700 1 Processor -- start 2023-09-13T09:49:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8d0c0700 1 -- start start 2023-09-13T09:49:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8d0c0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f88101820 0x7f4f88196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8d0c0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f88104150 0x7f4f88196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8d0c0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88106a80 0x7f4f8819e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8d0c0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8819e5f0 con 0x7f4f88106a80 2023-09-13T09:49:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8d0c0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8819e730 con 0x7f4f88104150 2023-09-13T09:49:31.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8d0c0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8819e8c0 con 0x7f4f88101820 2023-09-13T09:49:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88106a80 0x7f4f8819e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f88104150 0x7f4f88196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88106a80 0x7f4f8819e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40028/0 (socket says 172.21.15.6:40028) 2023-09-13T09:49:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 -- 172.21.15.6:0/4208170514 learned_addr learned my addr 172.21.15.6:0/4208170514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f86d9d700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f88101820 0x7f4f88196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 -- 172.21.15.6:0/4208170514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f88101820 msgr2=0x7f4f88196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f88101820 0x7f4f88196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 -- 172.21.15.6:0/4208170514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f88104150 msgr2=0x7f4f88196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f88104150 0x7f4f88196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8759e700 1 -- 172.21.15.6:0/4208170514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f780095f0 con 0x7f4f88106a80 2023-09-13T09:49:31.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.456+0000 7f4f8659c700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f88104150 0x7f4f88196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.457+0000 7f4f8759e700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88106a80 0x7f4f8819e020 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000ef30 tx=0x7f4f8000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.457+0000 7f4f6ffff700 1 -- 172.21.15.6:0/4208170514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f80018070 con 0x7f4f88106a80 2023-09-13T09:49:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.457+0000 7f4f6ffff700 1 -- 172.21.15.6:0/4208170514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4f8000f040 con 0x7f4f88106a80 2023-09-13T09:49:31.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.457+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f8819eb40 con 0x7f4f88106a80 2023-09-13T09:49:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.457+0000 7f4f6ffff700 1 -- 172.21.15.6:0/4208170514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000cd00 con 0x7f4f88106a80 2023-09-13T09:49:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.457+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f8819f000 con 0x7f4f88106a80 2023-09-13T09:49:31.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.458+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f880fcd70 con 0x7f4f88106a80 2023-09-13T09:49:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.459+0000 7f4f6ffff700 1 -- 172.21.15.6:0/4208170514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4f80003a00 con 0x7f4f88106a80 2023-09-13T09:49:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.459+0000 7f4f6ffff700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f700a0640 0x7f4f700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.460+0000 7f4f6ffff700 1 -- 172.21.15.6:0/4208170514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4f800cb740 con 0x7f4f88106a80 2023-09-13T09:49:31.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.460+0000 7f4f86d9d700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f700a0640 0x7f4f700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.460+0000 7f4f86d9d700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f700a0640 0x7f4f700a2b00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800b2e0 tx=0x7f4f78005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.464+0000 7f4f6ffff700 1 -- 172.21.15.6:0/4208170514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4f800952b0 con 0x7f4f88106a80 2023-09-13T09:49:31.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.720+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f8810c5d0 con 0x7f4f88106a80 2023-09-13T09:49:31.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.721+0000 7f4f6ffff700 1 -- 172.21.15.6:0/4208170514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f4f800988d0 con 0x7f4f88106a80 2023-09-13T09:49:31.721 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:49:31.722 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:49:31.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f700a0640 msgr2=0x7f4f700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f700a0640 0x7f4f700a2b00 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f4f7800b2e0 tx=0x7f4f78005fb0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88106a80 msgr2=0x7f4f8819e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88106a80 0x7f4f8819e020 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000ef30 tx=0x7f4f8000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 shutdown_connections 2023-09-13T09:49:31.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4f700a0640 0x7f4f700a2b00 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4f88106a80 0x7f4f8819e020 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f88101820 0x7f4f88196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 --2- 172.21.15.6:0/4208170514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4f88104150 0x7f4f88196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 >> 172.21.15.6:0/4208170514 conn(0x7f4f880fb1f0 msgr2=0x7f4f88102490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.723+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 shutdown_connections 2023-09-13T09:49:31.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.724+0000 7f4f8d0c0700 1 -- 172.21.15.6:0/4208170514 wait complete. 2023-09-13T09:49:31.726 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:49:31.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:49:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.868+0000 7fbaba936700 1 -- 172.21.15.6:0/1129730152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4100dc0 msgr2=0x7fbab41011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.868+0000 7fbaba936700 1 --2- 172.21.15.6:0/1129730152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4100dc0 0x7fbab41011e0 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40099c0 tx=0x7fbaa4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.868+0000 7fbaba936700 1 -- 172.21.15.6:0/1129730152 shutdown_connections 2023-09-13T09:49:31.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.868+0000 7fbaba936700 1 --2- 172.21.15.6:0/1129730152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab4102950 0x7fbab4109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.868+0000 7fbaba936700 1 --2- 172.21.15.6:0/1129730152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4100dc0 0x7fbab41011e0 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.869+0000 7fbaba936700 1 --2- 172.21.15.6:0/1129730152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbab4101fb0 0x7fbab4102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.869+0000 7fbaba936700 1 -- 172.21.15.6:0/1129730152 >> 172.21.15.6:0/1129730152 conn(0x7fbab40fc330 msgr2=0x7fbab40fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.869+0000 7fbaba936700 1 -- 172.21.15.6:0/1129730152 shutdown_connections 2023-09-13T09:49:31.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.869+0000 7fbaba936700 1 -- 172.21.15.6:0/1129730152 wait complete. 2023-09-13T09:49:31.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.869+0000 7fbaba936700 1 Processor -- start 2023-09-13T09:49:31.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.869+0000 7fbaba936700 1 -- start start 2023-09-13T09:49:31.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbab4100dc0 0x7fbab4074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4101fb0 0x7fbab40730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab4102950 0x7fbab40735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4073d80 con 0x7fbab4101fb0 2023-09-13T09:49:31.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab4073ef0 con 0x7fbab4102950 2023-09-13T09:49:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41a0b10 con 0x7fbab4100dc0 2023-09-13T09:49:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4101fb0 0x7fbab40730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4101fb0 0x7fbab40730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40040/0 (socket says 172.21.15.6:40040) 2023-09-13T09:49:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 -- 172.21.15.6:0/490888775 learned_addr learned my addr 172.21.15.6:0/490888775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab8ed3700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab4102950 0x7fbab40735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab3fff700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbab4100dc0 0x7fbab4074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 -- 172.21.15.6:0/490888775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbab4100dc0 msgr2=0x7fbab4074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbab4100dc0 0x7fbab4074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 -- 172.21.15.6:0/490888775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab4102950 msgr2=0x7fbab40735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab4102950 0x7fbab40735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 -- 172.21.15.6:0/490888775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40095f0 con 0x7fbab4101fb0 2023-09-13T09:49:31.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab37fe700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4101fb0 0x7fbab40730a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800e9a0 tx=0x7fbaa800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab17fa700 1 -- 172.21.15.6:0/490888775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8009790 con 0x7fbab4101fb0 2023-09-13T09:49:31.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab17fa700 1 -- 172.21.15.6:0/490888775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa8010430 con 0x7fbab4101fb0 2023-09-13T09:49:31.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab41a0df0 con 0x7fbab4101fb0 2023-09-13T09:49:31.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbab17fa700 1 -- 172.21.15.6:0/490888775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa8018680 con 0x7fbab4101fb0 2023-09-13T09:49:31.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.870+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41a1270 con 0x7fbab4101fb0 2023-09-13T09:49:31.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.872+0000 7fbab17fa700 1 -- 172.21.15.6:0/490888775 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbaa80105a0 con 0x7fbab4101fb0 2023-09-13T09:49:31.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.873+0000 7fbab17fa700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fba9c0a0640 0x7fba9c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.873+0000 7fbab3fff700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fba9c0a0640 0x7fba9c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.873+0000 7fbab17fa700 1 -- 172.21.15.6:0/490888775 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbaa8014070 con 0x7fbab4101fb0 2023-09-13T09:49:31.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbab3fff700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fba9c0a0640 0x7fba9c0a2b00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009990 tx=0x7fbaa4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 Processor -- start 2023-09-13T09:49:31.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 -- start start 2023-09-13T09:49:31.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a0621eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a0621d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0621de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a06176780 con 0x562a0621e700 2023-09-13T09:49:31.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a061740a0 con 0x562a0621da00 2023-09-13T09:49:31.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a0616f990 con 0x562a0621f060 2023-09-13T09:49:31.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a0621eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a0621eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40046/0 (socket says 172.21.15.6:40046) 2023-09-13T09:49:31.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbab3fff700 1 -- 172.21.15.6:0/1684134697 learned_addr learned my addr 172.21.15.6:0/1684134697 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.874+0000 7fbab8ed3700 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0621de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fbab37fe700 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a0621d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fbab3fff700 1 -- 172.21.15.6:0/1684134697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 msgr2=0x562a0621d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fbab3fff700 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a0621d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fbab3fff700 1 -- 172.21.15.6:0/1684134697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 msgr2=0x562a0621de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fbab3fff700 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0621de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fbab3fff700 1 -- 172.21.15.6:0/1684134697 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a05fef630 con 0x562a0621e700 2023-09-13T09:49:31.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fbab3fff700 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a0621eb20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4015000 tx=0x7fbaa401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2997d9f2ba6cc58f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fba9a7fc700 1 -- 172.21.15.6:0/1684134697 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4029070 con 0x562a0621e700 2023-09-13T09:49:31.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fba9a7fc700 1 -- 172.21.15.6:0/1684134697 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa401e040 con 0x562a0621e700 2023-09-13T09:49:31.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.875+0000 7fba9a7fc700 1 -- 172.21.15.6:0/1684134697 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa400f6c0 con 0x562a0621e700 2023-09-13T09:49:31.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1684134697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 msgr2=0x562a0621eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a0621eb20 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4015000 tx=0x7fbaa401f000 comp rx=0 tx=0).stop 2023-09-13T09:49:31.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1684134697 shutdown_connections 2023-09-13T09:49:31.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0621de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a0621eb20 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1684134697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a0621d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1684134697 >> 172.21.15.6:0/1684134697 conn(0x562a0617bc80 msgr2=0x562a06217f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1684134697 shutdown_connections 2023-09-13T09:49:31.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1684134697 wait complete. 2023-09-13T09:49:31.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.876+0000 7fbac6b1bb80 1 -- start start 2023-09-13T09:49:31.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 1 Processor -- start 2023-09-13T09:49:31.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a06226e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621e700 0x562a062273b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621f060 0x562a0622e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a0610dbb0 con 0x562a0621f060 2023-09-13T09:49:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a0610d8b0 con 0x562a0621da00 2023-09-13T09:49:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a05ff1920 con 0x562a0621e700 2023-09-13T09:49:31.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbac6b1bb80 10 client.0 _ll_register_callbacks cb 0x562a0610b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab8ed3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621f060 0x562a0622e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a06226e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621e700 0x562a062273b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a06226e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33576/0 (socket says 172.21.15.6:33576) 2023-09-13T09:49:31.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab3fff700 1 -- 172.21.15.6:0/1649364405 learned_addr learned my addr 172.21.15.6:0/1649364405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab8ed3700 1 -- 172.21.15.6:0/1649364405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621e700 msgr2=0x562a062273b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab8ed3700 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621e700 0x562a062273b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab8ed3700 1 -- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 msgr2=0x562a06226e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab8ed3700 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a06226e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab8ed3700 1 -- 172.21.15.6:0/1649364405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab4109b50 con 0x562a0621f060 2023-09-13T09:49:31.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.877+0000 7fbab3fff700 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a06226e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbab8ed3700 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621f060 0x562a0622e3f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fbaac011e60 tx=0x7fbaac014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b24ae5145ce27980 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fba937fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:31.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fba937fe700 1 -- 172.21.15.6:0/1649364405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac00e040 con 0x562a0621f060 2023-09-13T09:49:31.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fba937fe700 1 -- 172.21.15.6:0/1649364405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbaac0093a0 con 0x562a0621f060 2023-09-13T09:49:31.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a06210670 con 0x562a0621f060 2023-09-13T09:49:31.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fba937fe700 1 -- 172.21.15.6:0/1649364405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaac004db0 con 0x562a0621f060 2023-09-13T09:49:31.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 10 client.18057 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:31.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562a061877a0 con 0x562a0621f060 2023-09-13T09:49:31.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fba937fe700 1 -- 172.21.15.6:0/1649364405 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562a06210670 con 0x562a0621f060 2023-09-13T09:49:31.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fba937fe700 1 -- 172.21.15.6:0/1649364405 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbaac01c030 con 0x562a0621f060 2023-09-13T09:49:31.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 10 client.18057 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:31.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 10 client.18057 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:49:31.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 20 client.18057 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:31.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06232d50 0x562a06235170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 4 client.18057 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:31.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.878+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a06168970 con 0x562a06232d50 2023-09-13T09:49:31.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.879+0000 7fbab3fff700 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06232d50 0x562a06235170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.879+0000 7fba937fe700 10 client.18057 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:49:31.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.879+0000 7fbab3fff700 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06232d50 0x562a06235170 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3b61c27230c38ccf server_cookie=23cdd206abf8b167 in_seq=0 out_seq=0 2023-09-13T09:49:31.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fba937fe700 1 -- 172.21.15.6:0/1649364405 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562a06168970 con 0x562a06232d50 2023-09-13T09:49:31.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fba937fe700 10 client.18057 handle_command_reply: tid=0 2023-09-13T09:49:31.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 client.18057 shutdown 2023-09-13T09:49:31.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621f060 msgr2=0x562a0622e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621f060 0x562a0622e3f0 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fbaac011e60 tx=0x7fbaac014600 comp rx=0 tx=0).stop 2023-09-13T09:49:31.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 shutdown_connections 2023-09-13T09:49:31.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06232d50 0x562a06235170 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621f060 0x562a0622e3f0 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a06226e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fba937fe700 0 client.18057 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:49:31.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/1649364405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621e700 0x562a062273b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 >> 172.21.15.6:0/1649364405 conn(0x562a0617bc80 msgr2=0x562a062127f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 shutdown_connections 2023-09-13T09:49:31.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/1649364405 wait complete. 2023-09-13T09:49:31.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.880+0000 7fbac6b1bb80 20 client.18057 trim_cache size 0 max 16384 2023-09-13T09:49:31.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 Processor -- start 2023-09-13T09:49:31.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 -- start start 2023-09-13T09:49:31.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621da00 0x562a0621d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621e700 0x562a0622e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a06225af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a06219730 con 0x562a0621da00 2023-09-13T09:49:31.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a06224b80 con 0x562a0621e700 2023-09-13T09:49:31.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a06222490 con 0x562a0621f060 2023-09-13T09:49:31.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621da00 0x562a0621d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621e700 0x562a0622e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621da00 0x562a0621d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40060/0 (socket says 172.21.15.6:40060) 2023-09-13T09:49:31.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 -- 172.21.15.6:0/3987010357 learned_addr learned my addr 172.21.15.6:0/3987010357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab8ed3700 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a06225af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 -- 172.21.15.6:0/3987010357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 msgr2=0x562a06225af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a06225af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 -- 172.21.15.6:0/3987010357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621e700 msgr2=0x562a0622e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621e700 0x562a0622e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.894+0000 7fbab3fff700 1 -- 172.21.15.6:0/3987010357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a05f9bde0 con 0x562a0621da00 2023-09-13T09:49:31.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.895+0000 7fbab37fe700 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621e700 0x562a0622e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.895+0000 7fbab3fff700 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621da00 0x562a0621d4c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40099c0 tx=0x7fbaa4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61abd5d6aa1a3fef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.895+0000 7fba9affd700 1 -- 172.21.15.6:0/3987010357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4029040 con 0x562a0621da00 2023-09-13T09:49:31.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.895+0000 7fba9affd700 1 -- 172.21.15.6:0/3987010357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa40055f0 con 0x562a0621da00 2023-09-13T09:49:31.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.895+0000 7fba9affd700 1 -- 172.21.15.6:0/3987010357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4003a30 con 0x562a0621da00 2023-09-13T09:49:31.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/3987010357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621da00 msgr2=0x562a0621d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621da00 0x562a0621d4c0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40099c0 tx=0x7fbaa4009920 comp rx=0 tx=0).stop 2023-09-13T09:49:31.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/3987010357 shutdown_connections 2023-09-13T09:49:31.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a06225af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621da00 0x562a0621d4c0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/3987010357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621e700 0x562a0622e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/3987010357 >> 172.21.15.6:0/3987010357 conn(0x562a0617bc80 msgr2=0x562a06217e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/3987010357 shutdown_connections 2023-09-13T09:49:31.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/3987010357 wait complete. 2023-09-13T09:49:31.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 -- start start 2023-09-13T09:49:31.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.896+0000 7fbac6b1bb80 1 Processor -- start 2023-09-13T09:49:31.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0622c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a06282b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbac6b1bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a062850a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a06285620 con 0x562a0621e700 2023-09-13T09:49:31.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a06285760 con 0x562a0621da00 2023-09-13T09:49:31.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbac6b1bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a06285920 con 0x562a0621f060 2023-09-13T09:49:31.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbac6b1bb80 10 client.0 _ll_register_callbacks cb 0x562a0610b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:31.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a06282b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0622c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0622c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33590/0 (socket says 172.21.15.6:33590) 2023-09-13T09:49:31.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 -- 172.21.15.6:0/2376581928 learned_addr learned my addr 172.21.15.6:0/2376581928 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:31.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a06282b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40068/0 (socket says 172.21.15.6:40068) 2023-09-13T09:49:31.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab8ed3700 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a062850a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 -- 172.21.15.6:0/2376581928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 msgr2=0x562a062850a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a062850a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 -- 172.21.15.6:0/2376581928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 msgr2=0x562a06282b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:31.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a06282b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 -- 172.21.15.6:0/2376581928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab41a1270 con 0x562a0621da00 2023-09-13T09:49:31.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab37fe700 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a06282b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:31.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fbab3fff700 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0622c300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40058e0 tx=0x7fbaa4005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=266e070769678963 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fba937fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:49:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.897+0000 7fba937fe700 1 -- 172.21.15.6:0/2376581928 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa4029040 con 0x562a0621da00 2023-09-13T09:49:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbaa401e040 con 0x562a0621da00 2023-09-13T09:49:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fba937fe700 1 -- 172.21.15.6:0/2376581928 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbaa400fc80 con 0x562a0621da00 2023-09-13T09:49:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fba937fe700 1 -- 172.21.15.6:0/2376581928 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbaa403b350 con 0x562a0621da00 2023-09-13T09:49:31.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 10 client.27461 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562a05fef630 con 0x562a0621da00 2023-09-13T09:49:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fba937fe700 1 -- 172.21.15.6:0/2376581928 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbaa401e040 con 0x562a0621da00 2023-09-13T09:49:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fba937fe700 1 -- 172.21.15.6:0/2376581928 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbaa4005070 con 0x562a0621da00 2023-09-13T09:49:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 10 client.27461 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:31.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 10 client.27461 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:49:31.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 20 client.27461 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:31.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06286f30 0x562a06289350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:31.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 4 client.27461 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:49:31.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562a06129050 con 0x562a06286f30 2023-09-13T09:49:31.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.898+0000 7fbab37fe700 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06286f30 0x562a06289350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:31.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fba937fe700 10 client.27461 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:49:31.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbab37fe700 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06286f30 0x562a06289350 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dcb36aad1b771187 server_cookie=b0fe50774cb32bc9 in_seq=0 out_seq=0 2023-09-13T09:49:31.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fba937fe700 1 -- 172.21.15.6:0/2376581928 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562a06129050 con 0x562a06286f30 2023-09-13T09:49:31.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fba937fe700 10 client.27461 handle_command_reply: tid=0 2023-09-13T09:49:31.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 client.27461 shutdown 2023-09-13T09:49:31.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 msgr2=0x562a0622c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0622c300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40058e0 tx=0x7fbaa4005800 comp rx=0 tx=0).stop 2023-09-13T09:49:31.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 shutdown_connections 2023-09-13T09:49:31.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562a06286f30 0x562a06289350 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562a0621f060 0x562a062850a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562a0621da00 0x562a0622c300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 --2- 172.21.15.6:0/2376581928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562a0621e700 0x562a06282b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fba937fe700 0 client.27461 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:49:31.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 >> 172.21.15.6:0/2376581928 conn(0x562a0617bc80 msgr2=0x562a06225af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 shutdown_connections 2023-09-13T09:49:31.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 1 -- 172.21.15.6:0/2376581928 wait complete. 2023-09-13T09:49:31.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.899+0000 7fbac6b1bb80 20 client.27461 trim_cache size 0 max 16384 2023-09-13T09:49:31.923 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:49:31.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fba9c0a0640 msgr2=0x7fba9c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fba9c0a0640 0x7fba9c0a2b00 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fbaa4009990 tx=0x7fbaa4005fb0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4101fb0 msgr2=0x7fbab40730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4101fb0 0x7fbab40730a0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fbaa800e9a0 tx=0x7fbaa800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 shutdown_connections 2023-09-13T09:49:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbab4102950 0x7fbab40735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbab4100dc0 0x7fbab4074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fba9c0a0640 0x7fba9c0a2b00 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 --2- 172.21.15.6:0/490888775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbab4101fb0 0x7fbab40730a0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:31.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 >> 172.21.15.6:0/490888775 conn(0x7fbab40fc330 msgr2=0x7fbab40fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:31.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 shutdown_connections 2023-09-13T09:49:31.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:31.900+0000 7fbaba936700 1 -- 172.21.15.6:0/490888775 wait complete. 2023-09-13T09:49:31.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:49:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 -- 172.21.15.6:0/4254283089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c102950 msgr2=0x7f788c109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 --2- 172.21.15.6:0/4254283089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c102950 0x7f788c109200 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f788400b0d0 tx=0x7f788400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 -- 172.21.15.6:0/4254283089 shutdown_connections 2023-09-13T09:49:32.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 --2- 172.21.15.6:0/4254283089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c102950 0x7f788c109200 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 --2- 172.21.15.6:0/4254283089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788c100dc0 0x7f788c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 --2- 172.21.15.6:0/4254283089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f788c101fb0 0x7f788c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 -- 172.21.15.6:0/4254283089 >> 172.21.15.6:0/4254283089 conn(0x7f788c0fc350 msgr2=0x7f788c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.061+0000 7f789169a700 1 -- 172.21.15.6:0/4254283089 shutdown_connections 2023-09-13T09:49:32.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.062+0000 7f789169a700 1 -- 172.21.15.6:0/4254283089 wait complete. 2023-09-13T09:49:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.062+0000 7f789169a700 1 Processor -- start 2023-09-13T09:49:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.062+0000 7f789169a700 1 -- start start 2023-09-13T09:49:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.062+0000 7f789169a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788c100dc0 0x7f788c196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.062+0000 7f789169a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c101fb0 0x7f788c197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.062+0000 7f789169a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f788c102950 0x7f788c19e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f789169a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c19e6b0 con 0x7f788c101fb0 2023-09-13T09:49:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f789169a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c19e7f0 con 0x7f788c100dc0 2023-09-13T09:49:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f789169a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f788c19e980 con 0x7f788c102950 2023-09-13T09:49:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c101fb0 0x7f788c197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788c100dc0 0x7f788c196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c101fb0 0x7f788c197070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40082/0 (socket says 172.21.15.6:40082) 2023-09-13T09:49:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 -- 172.21.15.6:0/2373962330 learned_addr learned my addr 172.21.15.6:0/2373962330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788b7fe700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f788c102950 0x7f788c19e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 -- 172.21.15.6:0/2373962330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f788c102950 msgr2=0x7f788c19e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f788c102950 0x7f788c19e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 -- 172.21.15.6:0/2373962330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788c100dc0 msgr2=0x7f788c196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788c100dc0 0x7f788c196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 -- 172.21.15.6:0/2373962330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7884009d00 con 0x7f788c101fb0 2023-09-13T09:49:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788affd700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788c100dc0 0x7f788c196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f788a7fc700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c101fb0 0x7f788c197070 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f788000e9a0 tx=0x7f788000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f7873fff700 1 -- 172.21.15.6:0/2373962330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880009790 con 0x7f788c101fb0 2023-09-13T09:49:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f7873fff700 1 -- 172.21.15.6:0/2373962330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7880010430 con 0x7f788c101fb0 2023-09-13T09:49:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f788c19ec60 con 0x7f788c101fb0 2023-09-13T09:49:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f7873fff700 1 -- 172.21.15.6:0/2373962330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880018680 con 0x7f788c101fb0 2023-09-13T09:49:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.063+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c19f170 con 0x7f788c101fb0 2023-09-13T09:49:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.066+0000 7f7873fff700 1 -- 172.21.15.6:0/2373962330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f78800105a0 con 0x7f788c101fb0 2023-09-13T09:49:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.067+0000 7f7873fff700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f78740a0640 0x7f78740a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.067+0000 7f788affd700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f78740a0640 0x7f78740a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.067+0000 7f7873fff700 1 -- 172.21.15.6:0/2373962330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7880014070 con 0x7f788c101fb0 2023-09-13T09:49:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.067+0000 7f788affd700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f78740a0640 0x7f78740a2b00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f788c101e10 tx=0x7f787c007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.067+0000 7f789d87fb80 1 Processor -- start 2023-09-13T09:49:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f789d87fb80 1 -- start start 2023-09-13T09:49:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c5700 0x55c00e8c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c4a00 0x55c00e8c4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f789d87fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e81d780 con 0x55c00e8c6060 2023-09-13T09:49:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f789d87fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e81b0a0 con 0x55c00e8c4a00 2023-09-13T09:49:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f789d87fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e816990 con 0x55c00e8c5700 2023-09-13T09:49:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c5700 0x55c00e8c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c4a00 0x55c00e8c4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c4a00 0x55c00e8c4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33614/0 (socket says 172.21.15.6:33614) 2023-09-13T09:49:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c5700 0x55c00e8c5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43142/0 (socket says 172.21.15.6:43142) 2023-09-13T09:49:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788b7fe700 1 -- 172.21.15.6:0/2345480645 learned_addr learned my addr 172.21.15.6:0/2345480645 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788a7fc700 1 -- 172.21.15.6:0/2345480645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c5700 msgr2=0x55c00e8c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788a7fc700 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c5700 0x55c00e8c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788a7fc700 1 -- 172.21.15.6:0/2345480645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c4a00 msgr2=0x55c00e8c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788a7fc700 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c4a00 0x55c00e8c4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788a7fc700 1 -- 172.21.15.6:0/2345480645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c00e696630 con 0x55c00e8c6060 2023-09-13T09:49:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788b7fe700 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c4a00 0x55c00e8c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.068+0000 7f788a7fc700 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8c44c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7880099180 tx=0x7f7880098de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a66bddfd4ddf67d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.071+0000 7f78717fa700 1 -- 172.21.15.6:0/2345480645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880099be0 con 0x55c00e8c6060 2023-09-13T09:49:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.071+0000 7f78717fa700 1 -- 172.21.15.6:0/2345480645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7880099480 con 0x55c00e8c6060 2023-09-13T09:49:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.071+0000 7f78717fa700 1 -- 172.21.15.6:0/2345480645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7880098970 con 0x55c00e8c6060 2023-09-13T09:49:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- 172.21.15.6:0/2345480645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 msgr2=0x55c00e8c44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8c44c0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f7880099180 tx=0x7f7880098de0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- 172.21.15.6:0/2345480645 shutdown_connections 2023-09-13T09:49:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c4a00 0x55c00e8c4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c5700 0x55c00e8c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2345480645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8c44c0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- 172.21.15.6:0/2345480645 >> 172.21.15.6:0/2345480645 conn(0x55c00e822c80 msgr2=0x55c00e8bef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- 172.21.15.6:0/2345480645 shutdown_connections 2023-09-13T09:49:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- 172.21.15.6:0/2345480645 wait complete. 2023-09-13T09:49:32.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- start start 2023-09-13T09:49:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 Processor -- start 2023-09-13T09:49:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e7b4bb0 con 0x55c00e8c6060 2023-09-13T09:49:32.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e7b48b0 con 0x55c00e8c5700 2023-09-13T09:49:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e698920 con 0x55c00e8c4a00 2023-09-13T09:49:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.072+0000 7f789d87fb80 10 client.0 _ll_register_callbacks cb 0x55c00e7b2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43148/0 (socket says 172.21.15.6:43148) 2023-09-13T09:49:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788affd700 1 -- 172.21.15.6:0/4104670460 learned_addr learned my addr 172.21.15.6:0/4104670460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8ce400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33620/0 (socket says 172.21.15.6:33620) 2023-09-13T09:49:32.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 -- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 msgr2=0x55c00e8cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8cdec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 -- 172.21.15.6:0/4104670460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 msgr2=0x55c00e8d5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 -- 172.21.15.6:0/4104670460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f788c19f170 con 0x55c00e8c5700 2023-09-13T09:49:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788affd700 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f788a7fc700 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8ce400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55c00e8c54a0 tx=0x7f7880084220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=608ef8c492a22197 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f786eff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:49:32.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f786eff5700 1 -- 172.21.15.6:0/4104670460 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788009d2b0 con 0x55c00e8c5700 2023-09-13T09:49:32.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f786eff5700 1 -- 172.21.15.6:0/4104670460 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f78800a14f0 con 0x55c00e8c5700 2023-09-13T09:49:32.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c00e8b7670 con 0x55c00e8c5700 2023-09-13T09:49:32.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f786eff5700 1 -- 172.21.15.6:0/4104670460 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f78800b7250 con 0x55c00e8c5700 2023-09-13T09:49:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f789d87fb80 10 client.27473 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.073+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c00e82e7a0 con 0x55c00e8c5700 2023-09-13T09:49:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f786eff5700 1 -- 172.21.15.6:0/4104670460 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7880065020 con 0x55c00e8c5700 2023-09-13T09:49:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f786eff5700 1 -- 172.21.15.6:0/4104670460 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f78800983e0 con 0x55c00e8c5700 2023-09-13T09:49:32.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f789d87fb80 10 client.27473 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f789d87fb80 10 client.27473 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:49:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f789d87fb80 20 client.27473 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f789d87fb80 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e8d98d0 0x55c00e8dbcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f789d87fb80 4 client.27473 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:32.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c00e80f970 con 0x55c00e8d98d0 2023-09-13T09:49:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.074+0000 7f788affd700 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e8d98d0 0x55c00e8dbcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f786eff5700 10 client.27473 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:49:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f788affd700 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e8d98d0 0x55c00e8dbcc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fac6855e13a57a8a server_cookie=87e03f34872c7998 in_seq=0 out_seq=0 2023-09-13T09:49:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f786eff5700 1 -- 172.21.15.6:0/4104670460 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c00e80f970 con 0x55c00e8d98d0 2023-09-13T09:49:32.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f786eff5700 10 client.27473 handle_command_reply: tid=0 2023-09-13T09:49:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 client.27473 shutdown 2023-09-13T09:49:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 msgr2=0x55c00e8ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8ce400 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55c00e8c54a0 tx=0x7f7880084220 comp rx=0 tx=0).stop 2023-09-13T09:49:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 shutdown_connections 2023-09-13T09:49:32.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e8d98d0 0x55c00e8dbcc0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f786eff5700 0 client.27473 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:49:32.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 --2- 172.21.15.6:0/4104670460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8ce400 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 >> 172.21.15.6:0/4104670460 conn(0x55c00e822c80 msgr2=0x55c00e8b97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 shutdown_connections 2023-09-13T09:49:32.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 1 -- 172.21.15.6:0/4104670460 wait complete. 2023-09-13T09:49:32.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.075+0000 7f789d87fb80 20 client.27473 trim_cache size 0 max 16384 2023-09-13T09:49:32.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 Processor -- start 2023-09-13T09:49:32.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 -- start start 2023-09-13T09:49:32.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8c44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8d5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e8cf040 con 0x55c00e8c6060 2023-09-13T09:49:32.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e8dc320 con 0x55c00e8c5700 2023-09-13T09:49:32.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f789d87fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e8cbc00 con 0x55c00e8c4a00 2023-09-13T09:49:32.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40106/0 (socket says 172.21.15.6:40106) 2023-09-13T09:49:32.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8c44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 -- 172.21.15.6:0/2980476825 learned_addr learned my addr 172.21.15.6:0/2980476825 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788a7fc700 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8d5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 -- 172.21.15.6:0/2980476825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 msgr2=0x55c00e8c44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8c44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 -- 172.21.15.6:0/2980476825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 msgr2=0x55c00e8d5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8d5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.089+0000 7f788b7fe700 1 -- 172.21.15.6:0/2980476825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c00e8c50b0 con 0x55c00e8c6060 2023-09-13T09:49:32.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.090+0000 7f788b7fe700 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5d30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7884007590 tx=0x7f788400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a1633ebe70aba0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.090+0000 7f7871ffb700 1 -- 172.21.15.6:0/2980476825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f788400e040 con 0x55c00e8c6060 2023-09-13T09:49:32.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.090+0000 7f7871ffb700 1 -- 172.21.15.6:0/2980476825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7884003a00 con 0x55c00e8c6060 2023-09-13T09:49:32.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.090+0000 7f7871ffb700 1 -- 172.21.15.6:0/2980476825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7884005620 con 0x55c00e8c6060 2023-09-13T09:49:32.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.090+0000 7f789d87fb80 1 -- 172.21.15.6:0/2980476825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 msgr2=0x55c00e8d5d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.090+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5d30 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f7884007590 tx=0x7f788400b040 comp rx=0 tx=0).stop 2023-09-13T09:49:32.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- 172.21.15.6:0/2980476825 shutdown_connections 2023-09-13T09:49:32.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c6060 0x55c00e8d5d30 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8c44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 --2- 172.21.15.6:0/2980476825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c5700 0x55c00e8d5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- 172.21.15.6:0/2980476825 >> 172.21.15.6:0/2980476825 conn(0x55c00e822c80 msgr2=0x55c00e8ccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- 172.21.15.6:0/2980476825 shutdown_connections 2023-09-13T09:49:32.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- 172.21.15.6:0/2980476825 wait complete. 2023-09-13T09:49:32.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- start start 2023-09-13T09:49:32.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 Processor -- start 2023-09-13T09:49:32.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8d0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c5700 0x55c00e8d13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c6060 0x55c00e8d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e8d4950 con 0x55c00e8c5700 2023-09-13T09:49:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e8d4ac0 con 0x55c00e8c6060 2023-09-13T09:49:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c00e8d4c80 con 0x55c00e8c4a00 2023-09-13T09:49:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f789d87fb80 10 client.0 _ll_register_callbacks cb 0x55c00e7b2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f788a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c5700 0x55c00e8d13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f788affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8d0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f788affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8d0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43162/0 (socket says 172.21.15.6:43162) 2023-09-13T09:49:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f788a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c5700 0x55c00e8d13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40110/0 (socket says 172.21.15.6:40110) 2023-09-13T09:49:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f788affd700 1 -- 172.21.15.6:0/504089094 learned_addr learned my addr 172.21.15.6:0/504089094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.091+0000 7f788b7fe700 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c6060 0x55c00e8d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f788affd700 1 -- 172.21.15.6:0/504089094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c6060 msgr2=0x55c00e8d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f788affd700 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c6060 0x55c00e8d4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f788affd700 1 -- 172.21.15.6:0/504089094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c5700 msgr2=0x55c00e8d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f788affd700 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c5700 0x55c00e8d13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f788affd700 1 -- 172.21.15.6:0/504089094 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7884009470 con 0x55c00e8c4a00 2023-09-13T09:49:32.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f788affd700 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8d0eb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55c00e8dc530 tx=0x7f787c004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e74b8b32041491d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f786eff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:49:32.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f786eff5700 1 -- 172.21.15.6:0/504089094 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c024040 con 0x55c00e8c4a00 2023-09-13T09:49:32.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f786eff5700 1 -- 172.21.15.6:0/504089094 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f787c017070 con 0x55c00e8c4a00 2023-09-13T09:49:32.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7880099480 con 0x55c00e8c4a00 2023-09-13T09:49:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f786eff5700 1 -- 172.21.15.6:0/504089094 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f787c029560 con 0x55c00e8c4a00 2023-09-13T09:49:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f789d87fb80 10 client.27400 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.092+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c00e642de0 con 0x55c00e8c4a00 2023-09-13T09:49:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f786eff5700 1 -- 172.21.15.6:0/504089094 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7880099480 con 0x55c00e8c4a00 2023-09-13T09:49:32.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f786eff5700 1 -- 172.21.15.6:0/504089094 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f787c003680 con 0x55c00e8c4a00 2023-09-13T09:49:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f789d87fb80 10 client.27400 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f789d87fb80 10 client.27400 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:49:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f789d87fb80 20 client.27400 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f789d87fb80 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e92e460 0x55c00e930880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f789d87fb80 4 client.27400 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:49:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c00e7d0050 con 0x55c00e92e460 2023-09-13T09:49:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f788a7fc700 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e92e460 0x55c00e930880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f788a7fc700 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e92e460 0x55c00e930880 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=15bba512cdb6c870 server_cookie=af425ff3a04c17d9 in_seq=0 out_seq=0 2023-09-13T09:49:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f786eff5700 10 client.27400 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:49:32.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f786eff5700 1 -- 172.21.15.6:0/504089094 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c00e7d0050 con 0x55c00e92e460 2023-09-13T09:49:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f786eff5700 10 client.27400 handle_command_reply: tid=0 2023-09-13T09:49:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.093+0000 7f789d87fb80 1 client.27400 shutdown 2023-09-13T09:49:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 msgr2=0x55c00e8d0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8d0eb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x55c00e8dc530 tx=0x7f787c004750 comp rx=0 tx=0).stop 2023-09-13T09:49:32.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 shutdown_connections 2023-09-13T09:49:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c00e92e460 0x55c00e930880 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c00e8c6060 0x55c00e8d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f786eff5700 0 client.27400 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:49:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c00e8c4a00 0x55c00e8d0eb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 --2- 172.21.15.6:0/504089094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c00e8c5700 0x55c00e8d13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 >> 172.21.15.6:0/504089094 conn(0x55c00e822c80 msgr2=0x55c00e8c8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 shutdown_connections 2023-09-13T09:49:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 1 -- 172.21.15.6:0/504089094 wait complete. 2023-09-13T09:49:32.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789d87fb80 20 client.27400 trim_cache size 0 max 16384 2023-09-13T09:49:32.118 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:49:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f78740a0640 msgr2=0x7f78740a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f78740a0640 0x7f78740a2b00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f788c101e10 tx=0x7f787c007400 comp rx=0 tx=0).stop 2023-09-13T09:49:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c101fb0 msgr2=0x7f788c197070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c101fb0 0x7f788c197070 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f788000e9a0 tx=0x7f788000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 shutdown_connections 2023-09-13T09:49:32.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f788c102950 0x7f788c19e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f788c100dc0 0x7f788c196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f78740a0640 0x7f78740a2b00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 --2- 172.21.15.6:0/2373962330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f788c101fb0 0x7f788c197070 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 >> 172.21.15.6:0/2373962330 conn(0x7f788c0fc350 msgr2=0x7f788c0fe530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 shutdown_connections 2023-09-13T09:49:32.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.094+0000 7f789169a700 1 -- 172.21.15.6:0/2373962330 wait complete. 2023-09-13T09:49:32.122 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:49:32.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 561920 6.18 MB/sec execute 412 sec latency 13.643 ms 2023-09-13T09:49:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 -- 172.21.15.6:0/724587726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec1013c0 msgr2=0x7fedec1017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 --2- 172.21.15.6:0/724587726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec1013c0 0x7fedec1017e0 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fede8009990 tx=0x7fede8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 -- 172.21.15.6:0/724587726 shutdown_connections 2023-09-13T09:49:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 --2- 172.21.15.6:0/724587726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedec100290 0x7fedec108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 --2- 172.21.15.6:0/724587726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec1013c0 0x7fedec1017e0 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 --2- 172.21.15.6:0/724587726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedec0ff8f0 0x7fedec0ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 -- 172.21.15.6:0/724587726 >> 172.21.15.6:0/724587726 conn(0x7fedec0fb250 msgr2=0x7fedec0fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 -- 172.21.15.6:0/724587726 shutdown_connections 2023-09-13T09:49:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.257+0000 7fedf4597700 1 -- 172.21.15.6:0/724587726 wait complete. 2023-09-13T09:49:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 Processor -- start 2023-09-13T09:49:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 -- start start 2023-09-13T09:49:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedec0ff8f0 0x7fedec196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec100290 0x7fedec1970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedec1013c0 0x7fedec19e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec19e700 con 0x7fedec100290 2023-09-13T09:49:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec19e840 con 0x7fedec1013c0 2023-09-13T09:49:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf4597700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec19e9d0 con 0x7fedec0ff8f0 2023-09-13T09:49:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf1b32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec100290 0x7fedec1970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf1b32700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec100290 0x7fedec1970c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40122/0 (socket says 172.21.15.6:40122) 2023-09-13T09:49:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf1b32700 1 -- 172.21.15.6:0/1302971173 learned_addr learned my addr 172.21.15.6:0/1302971173 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf2333700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedec0ff8f0 0x7fedec196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.258+0000 7fedf2b34700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedec1013c0 0x7fedec19e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf1b32700 1 -- 172.21.15.6:0/1302971173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedec0ff8f0 msgr2=0x7fedec196b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf1b32700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedec0ff8f0 0x7fedec196b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf1b32700 1 -- 172.21.15.6:0/1302971173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedec1013c0 msgr2=0x7fedec19e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf1b32700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedec1013c0 0x7fedec19e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf1b32700 1 -- 172.21.15.6:0/1302971173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fede80095f0 con 0x7fedec100290 2023-09-13T09:49:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf1b32700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec100290 0x7fedec1970c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e9a0 tx=0x7feddc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fede37fe700 1 -- 172.21.15.6:0/1302971173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc009790 con 0x7fedec100290 2023-09-13T09:49:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fede37fe700 1 -- 172.21.15.6:0/1302971173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feddc010430 con 0x7fedec100290 2023-09-13T09:49:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedec19ecb0 con 0x7fedec100290 2023-09-13T09:49:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fede37fe700 1 -- 172.21.15.6:0/1302971173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feddc018680 con 0x7fedec100290 2023-09-13T09:49:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.259+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec19f1c0 con 0x7fedec100290 2023-09-13T09:49:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.261+0000 7fede37fe700 1 -- 172.21.15.6:0/1302971173 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7feddc0105a0 con 0x7fedec100290 2023-09-13T09:49:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.262+0000 7fede37fe700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fedd80a06c0 0x7fedd80a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.262+0000 7fedf2333700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fedd80a06c0 0x7fedd80a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.262+0000 7fede37fe700 1 -- 172.21.15.6:0/1302971173 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feddc014070 con 0x7fedec100290 2023-09-13T09:49:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.263+0000 7fedf2333700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fedd80a06c0 0x7fedd80a2b80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fede800b2e0 tx=0x7fede8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.263+0000 7fee0077cb80 1 Processor -- start 2023-09-13T09:49:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fee0077cb80 1 -- start start 2023-09-13T09:49:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5cfeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5cfd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5cfde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fee0077cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5c56780 con 0x5647c5cff060 2023-09-13T09:49:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fee0077cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5c540a0 con 0x5647c5cfda00 2023-09-13T09:49:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fee0077cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5c4f990 con 0x5647c5cfe700 2023-09-13T09:49:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5cfeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5cfeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43182/0 (socket says 172.21.15.6:43182) 2023-09-13T09:49:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 -- 172.21.15.6:0/3875395109 learned_addr learned my addr 172.21.15.6:0/3875395109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2b34700 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5cfde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf1b32700 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5cfd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 -- 172.21.15.6:0/3875395109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 msgr2=0x5647c5cfde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5cfde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 -- 172.21.15.6:0/3875395109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 msgr2=0x5647c5cfd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5cfd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2333700 1 -- 172.21.15.6:0/3875395109 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647c5acf630 con 0x5647c5cfe700 2023-09-13T09:49:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf2b34700 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5cfde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.264+0000 7fedf1b32700 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5cfd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:49:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.265+0000 7fedf2333700 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5cfeb20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fede8015000 tx=0x7fede8020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e77bcb19c2ba8173 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.265+0000 7fede0ff9700 1 -- 172.21.15.6:0/3875395109 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede802b070 con 0x5647c5cfe700 2023-09-13T09:49:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.265+0000 7fede0ff9700 1 -- 172.21.15.6:0/3875395109 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fede801e040 con 0x5647c5cfe700 2023-09-13T09:49:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.265+0000 7fede0ff9700 1 -- 172.21.15.6:0/3875395109 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800f7b0 con 0x5647c5cfe700 2023-09-13T09:49:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.265+0000 7fee0077cb80 1 -- 172.21.15.6:0/3875395109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 msgr2=0x5647c5cfeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5cfeb20 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fede8015000 tx=0x7fede8020000 comp rx=0 tx=0).stop 2023-09-13T09:49:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- 172.21.15.6:0/3875395109 shutdown_connections 2023-09-13T09:49:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5cfde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5cfeb20 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 --2- 172.21.15.6:0/3875395109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5cfd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- 172.21.15.6:0/3875395109 >> 172.21.15.6:0/3875395109 conn(0x5647c5c5bc80 msgr2=0x5647c5cf7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- 172.21.15.6:0/3875395109 shutdown_connections 2023-09-13T09:49:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- 172.21.15.6:0/3875395109 wait complete. 2023-09-13T09:49:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- start start 2023-09-13T09:49:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 Processor -- start 2023-09-13T09:49:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5d0b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d0b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5d12850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5bedbb0 con 0x5647c5cff060 2023-09-13T09:49:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5bed8b0 con 0x5647c5cfda00 2023-09-13T09:49:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5ad1920 con 0x5647c5cfe700 2023-09-13T09:49:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fee0077cb80 10 client.0 _ll_register_callbacks cb 0x5647c5beb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fedf2b34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5d12850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fedf1b32700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d0b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fedf2333700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5d0b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fedf2b34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5d12850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40138/0 (socket says 172.21.15.6:40138) 2023-09-13T09:49:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.266+0000 7fedf2b34700 1 -- 172.21.15.6:0/4132098562 learned_addr learned my addr 172.21.15.6:0/4132098562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf2b34700 1 -- 172.21.15.6:0/4132098562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 msgr2=0x5647c5d0b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf2b34700 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d0b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf2b34700 1 -- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 msgr2=0x5647c5d0b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf2b34700 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5d0b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf2b34700 1 -- 172.21.15.6:0/4132098562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedec108b50 con 0x5647c5cff060 2023-09-13T09:49:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf2333700 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5d0b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf1b32700 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d0b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedf2b34700 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5d12850 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fede4011f70 tx=0x7fede4014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c64114f69ca14d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedd5ffb700 1 -- 172.21.15.6:0/4132098562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede400e040 con 0x5647c5cff060 2023-09-13T09:49:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedd5ffb700 1 -- 172.21.15.6:0/4132098562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fede401a070 con 0x5647c5cff060 2023-09-13T09:49:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647c5cf0670 con 0x5647c5cff060 2023-09-13T09:49:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fedd5ffb700 1 -- 172.21.15.6:0/4132098562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fede4014ba0 con 0x5647c5cff060 2023-09-13T09:49:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fee0077cb80 10 client.18093 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.267+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5647c5c677a0 con 0x5647c5cff060 2023-09-13T09:49:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fedd5ffb700 1 -- 172.21.15.6:0/4132098562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5647c5cf0670 con 0x5647c5cff060 2023-09-13T09:49:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fedd5ffb700 1 -- 172.21.15.6:0/4132098562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fede401e430 con 0x5647c5cff060 2023-09-13T09:49:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fee0077cb80 10 client.18093 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fee0077cb80 10 client.18093 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:49:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fee0077cb80 20 client.18093 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fee0077cb80 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d170d0 0x5647c5d194f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fee0077cb80 4 client.18093 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647c5c48970 con 0x5647c5d170d0 2023-09-13T09:49:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fedf2333700 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d170d0 0x5647c5d194f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fedf2333700 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d170d0 0x5647c5d194f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9d1890187ad89d44 server_cookie=b0bf5a55028bdad in_seq=0 out_seq=0 2023-09-13T09:49:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.268+0000 7fedd5ffb700 10 client.18093 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:49:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fedd5ffb700 1 -- 172.21.15.6:0/4132098562 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5647c5c48970 con 0x5647c5d170d0 2023-09-13T09:49:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fedd5ffb700 10 client.18093 handle_command_reply: tid=0 2023-09-13T09:49:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 client.18093 shutdown 2023-09-13T09:49:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 msgr2=0x5647c5d12850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5d12850 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fede4011f70 tx=0x7fede4014600 comp rx=0 tx=0).stop 2023-09-13T09:49:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 shutdown_connections 2023-09-13T09:49:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d170d0 0x5647c5d194f0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cff060 0x5647c5d12850 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfda00 0x5647c5d0b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 --2- 172.21.15.6:0/4132098562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d0b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 >> 172.21.15.6:0/4132098562 conn(0x5647c5c5bc80 msgr2=0x5647c5cf27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fedd5ffb700 0 client.18093 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:49:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 shutdown_connections 2023-09-13T09:49:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 1 -- 172.21.15.6:0/4132098562 wait complete. 2023-09-13T09:49:32.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.269+0000 7fee0077cb80 20 client.18093 trim_cache size 0 max 16384 2023-09-13T09:49:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.282+0000 7fee0077cb80 1 Processor -- start 2023-09-13T09:49:32.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fee0077cb80 1 -- start start 2023-09-13T09:49:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5cfd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d12770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cff060 0x5647c5d13140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fee0077cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5d0ae40 con 0x5647c5cfda00 2023-09-13T09:49:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fee0077cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5d09cf0 con 0x5647c5cff060 2023-09-13T09:49:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fee0077cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5cf9a10 con 0x5647c5cfe700 2023-09-13T09:49:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5cfd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5cfd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40142/0 (socket says 172.21.15.6:40142) 2023-09-13T09:49:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 -- 172.21.15.6:0/31841859 learned_addr learned my addr 172.21.15.6:0/31841859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf1b32700 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d12770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2b34700 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cff060 0x5647c5d13140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 -- 172.21.15.6:0/31841859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 msgr2=0x5647c5d12770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d12770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 -- 172.21.15.6:0/31841859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cff060 msgr2=0x5647c5d13140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cff060 0x5647c5d13140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 -- 172.21.15.6:0/31841859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647c5a7bde0 con 0x5647c5cfda00 2023-09-13T09:49:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fedf2333700 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5cfd4c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fede8005600 tx=0x7fede8023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f63708f559551c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fede17fa700 1 -- 172.21.15.6:0/31841859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede802b040 con 0x5647c5cfda00 2023-09-13T09:49:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.283+0000 7fede17fa700 1 -- 172.21.15.6:0/31841859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fede8004df0 con 0x5647c5cfda00 2023-09-13T09:49:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fede17fa700 1 -- 172.21.15.6:0/31841859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede800fa40 con 0x5647c5cfda00 2023-09-13T09:49:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 -- 172.21.15.6:0/31841859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 msgr2=0x5647c5cfd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5cfd4c0 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fede8005600 tx=0x7fede8023000 comp rx=0 tx=0).stop 2023-09-13T09:49:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 -- 172.21.15.6:0/31841859 shutdown_connections 2023-09-13T09:49:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cff060 0x5647c5d13140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5cfd4c0 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 --2- 172.21.15.6:0/31841859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cfe700 0x5647c5d12770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 -- 172.21.15.6:0/31841859 >> 172.21.15.6:0/31841859 conn(0x5647c5c5bc80 msgr2=0x5647c5d09f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 -- 172.21.15.6:0/31841859 shutdown_connections 2023-09-13T09:49:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 -- 172.21.15.6:0/31841859 wait complete. 2023-09-13T09:49:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 -- start start 2023-09-13T09:49:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.284+0000 7fee0077cb80 1 Processor -- start 2023-09-13T09:49:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5d10760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfe700 0x5647c5d66ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fee0077cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cff060 0x5647c5d69420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fee0077cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5d69960 con 0x5647c5cfda00 2023-09-13T09:49:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fee0077cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5d69aa0 con 0x5647c5cfe700 2023-09-13T09:49:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fee0077cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647c5d69be0 con 0x5647c5cff060 2023-09-13T09:49:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fee0077cb80 10 client.0 _ll_register_callbacks cb 0x5647c5beb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5d10760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5d10760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40148/0 (socket says 172.21.15.6:40148) 2023-09-13T09:49:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 -- 172.21.15.6:0/657376168 learned_addr learned my addr 172.21.15.6:0/657376168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2b34700 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cff060 0x5647c5d69420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf1b32700 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfe700 0x5647c5d66ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 -- 172.21.15.6:0/657376168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cff060 msgr2=0x5647c5d69420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cff060 0x5647c5d69420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 -- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfe700 msgr2=0x5647c5d66ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfe700 0x5647c5d66ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 -- 172.21.15.6:0/657376168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647c5acf630 con 0x5647c5cfda00 2023-09-13T09:49:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedf2333700 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5d10760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fede8005850 tx=0x7fede803b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74358bcc7e05ce0f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedd5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedd5ffb700 1 -- 172.21.15.6:0/657376168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fede802b040 con 0x5647c5cfda00 2023-09-13T09:49:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.285+0000 7fedd5ffb700 1 -- 172.21.15.6:0/657376168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fede803be20 con 0x5647c5cfda00 2023-09-13T09:49:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fede801e040 con 0x5647c5cfda00 2023-09-13T09:49:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fedd5ffb700 1 -- 172.21.15.6:0/657376168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fede803b1d0 con 0x5647c5cfda00 2023-09-13T09:49:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 10 client.18099 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5647c5a64c60 con 0x5647c5cfda00 2023-09-13T09:49:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fedd5ffb700 1 -- 172.21.15.6:0/657376168 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fede801e040 con 0x5647c5cfda00 2023-09-13T09:49:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fedd5ffb700 1 -- 172.21.15.6:0/657376168 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fede8037070 con 0x5647c5cfda00 2023-09-13T09:49:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 10 client.18099 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 10 client.18099 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:49:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 20 client.18099 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d6aff0 0x5647c5d6d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 4 client.18099 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:49:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5647c5c09050 con 0x5647c5d6aff0 2023-09-13T09:49:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.286+0000 7fedf1b32700 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d6aff0 0x5647c5d6d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.287+0000 7fedd5ffb700 10 client.18099 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:49:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.287+0000 7fedf1b32700 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d6aff0 0x5647c5d6d410 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c555f19c057d82c server_cookie=57d5bd86c3c63eb8 in_seq=0 out_seq=0 2023-09-13T09:49:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fedd5ffb700 1 -- 172.21.15.6:0/657376168 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5647c5c09050 con 0x5647c5d6aff0 2023-09-13T09:49:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fedd5ffb700 10 client.18099 handle_command_reply: tid=0 2023-09-13T09:49:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 client.18099 shutdown 2023-09-13T09:49:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 msgr2=0x5647c5d10760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5d10760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fede8005850 tx=0x7fede803b670 comp rx=0 tx=0).stop 2023-09-13T09:49:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 shutdown_connections 2023-09-13T09:49:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5647c5d6aff0 0x5647c5d6d410 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5647c5cff060 0x5647c5d69420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5647c5cfda00 0x5647c5d10760 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 --2- 172.21.15.6:0/657376168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5647c5cfe700 0x5647c5d66ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fedd5ffb700 0 client.18099 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:49:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 >> 172.21.15.6:0/657376168 conn(0x5647c5c5bc80 msgr2=0x5647c5d13140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 shutdown_connections 2023-09-13T09:49:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 1 -- 172.21.15.6:0/657376168 wait complete. 2023-09-13T09:49:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.288+0000 7fee0077cb80 20 client.18099 trim_cache size 0 max 16384 2023-09-13T09:49:32.312 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:49:32.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fedd80a06c0 msgr2=0x7fedd80a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fedd80a06c0 0x7fedd80a2b80 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fede800b2e0 tx=0x7fede8005fb0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec100290 msgr2=0x7fedec1970c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec100290 0x7fedec1970c0 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7feddc00e9a0 tx=0x7feddc00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 shutdown_connections 2023-09-13T09:49:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fedec1013c0 0x7fedec19e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedec0ff8f0 0x7fedec196b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fedd80a06c0 0x7fedd80a2b80 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 --2- 172.21.15.6:0/1302971173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedec100290 0x7fedec1970c0 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 >> 172.21.15.6:0/1302971173 conn(0x7fedec0fb250 msgr2=0x7fedec068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 shutdown_connections 2023-09-13T09:49:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.289+0000 7fedf4597700 1 -- 172.21.15.6:0/1302971173 wait complete. 2023-09-13T09:49:32.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:49:32.341 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:32 smithi006 ceph-mon[98665]: pgmap v600: 97 pgs: 97 active+clean; 223 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.9 MiB/s wr, 212 op/s 2023-09-13T09:49:32.341 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:32 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4208170514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:49:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 -- 172.21.15.6:0/3221460058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8101840 msgr2=0x7f4ca8103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 --2- 172.21.15.6:0/3221460058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8101840 0x7f4ca8103c30 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009990 tx=0x7f4c98009ca0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 -- 172.21.15.6:0/3221460058 shutdown_connections 2023-09-13T09:49:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 --2- 172.21.15.6:0/3221460058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca8106aa0 0x7f4ca8108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 --2- 172.21.15.6:0/3221460058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8101840 0x7f4ca8103c30 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 --2- 172.21.15.6:0/3221460058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ca8104170 0x7f4ca8106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 -- 172.21.15.6:0/3221460058 >> 172.21.15.6:0/3221460058 conn(0x7f4ca80fb250 msgr2=0x7f4ca80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 -- 172.21.15.6:0/3221460058 shutdown_connections 2023-09-13T09:49:32.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.452+0000 7f4cacd38700 1 -- 172.21.15.6:0/3221460058 wait complete. 2023-09-13T09:49:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 Processor -- start 2023-09-13T09:49:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 -- start start 2023-09-13T09:49:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ca8101840 0x7f4ca8196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca8104170 0x7f4ca8196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8106aa0 0x7f4ca819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca819e5d0 con 0x7f4ca8106aa0 2023-09-13T09:49:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca819e710 con 0x7f4ca8101840 2023-09-13T09:49:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.453+0000 7f4cacd38700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca819e8a0 con 0x7f4ca8104170 2023-09-13T09:49:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca5d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca8104170 0x7f4ca8196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ca8101840 0x7f4ca8196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca5d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca8104170 0x7f4ca8196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43218/0 (socket says 172.21.15.6:43218) 2023-09-13T09:49:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca5d9b700 1 -- 172.21.15.6:0/1566461754 learned_addr learned my addr 172.21.15.6:0/1566461754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8106aa0 0x7f4ca819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca659c700 1 -- 172.21.15.6:0/1566461754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca8104170 msgr2=0x7f4ca8196f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca659c700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca8104170 0x7f4ca8196f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca659c700 1 -- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8106aa0 msgr2=0x7f4ca819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca659c700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8106aa0 0x7f4ca819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca659c700 1 -- 172.21.15.6:0/1566461754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c980095f0 con 0x7f4ca8101840 2023-09-13T09:49:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4ca659c700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ca8101840 0x7f4ca8196a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c980098e0 tx=0x7f4c98009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4c977fe700 1 -- 172.21.15.6:0/1566461754 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9801d070 con 0x7f4ca8101840 2023-09-13T09:49:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca819eb20 con 0x7f4ca8101840 2023-09-13T09:49:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4c977fe700 1 -- 172.21.15.6:0/1566461754 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c98021410 con 0x7f4ca8101840 2023-09-13T09:49:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.454+0000 7f4c977fe700 1 -- 172.21.15.6:0/1566461754 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98017650 con 0x7f4ca8101840 2023-09-13T09:49:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.455+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca819efa0 con 0x7f4ca8101840 2023-09-13T09:49:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.457+0000 7f4c977fe700 1 -- 172.21.15.6:0/1566461754 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4c98021810 con 0x7f4ca8101840 2023-09-13T09:49:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.457+0000 7f4c977fe700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c900a0640 0x7f4c900a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.458+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c900a0640 0x7f4c900a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.458+0000 7f4c977fe700 1 -- 172.21.15.6:0/1566461754 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4c980ccf60 con 0x7f4ca8101840 2023-09-13T09:49:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.458+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c900a0640 0x7f4c900a2b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009d20 tx=0x7f4c9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.458+0000 7f4cb8f1db80 1 Processor -- start 2023-09-13T09:49:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.458+0000 7f4cb8f1db80 1 -- start start 2023-09-13T09:49:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951137f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x5629511368d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951137290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56295108b780 con 0x562951137b10 2023-09-13T09:49:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629510890a0 con 0x562951136e10 2023-09-13T09:49:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562951084990 con 0x562951138470 2023-09-13T09:49:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951137f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951137f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40170/0 (socket says 172.21.15.6:40170) 2023-09-13T09:49:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 -- 172.21.15.6:0/451270040 learned_addr learned my addr 172.21.15.6:0/451270040 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x5629511368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951137290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 -- 172.21.15.6:0/451270040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 msgr2=0x5629511368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x5629511368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 -- 172.21.15.6:0/451270040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 msgr2=0x562951137290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951137290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 -- 172.21.15.6:0/451270040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562950f04630 con 0x562951137b10 2023-09-13T09:49:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4ca659c700 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951137f30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000c00 tx=0x7f4c9809a5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af1ccf12dc4d554e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4c94ff9700 1 -- 172.21.15.6:0/451270040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9809a0f0 con 0x562951137b10 2023-09-13T09:49:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4c94ff9700 1 -- 172.21.15.6:0/451270040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c9809ae90 con 0x562951137b10 2023-09-13T09:49:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.459+0000 7f4c94ff9700 1 -- 172.21.15.6:0/451270040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c98099c80 con 0x562951137b10 2023-09-13T09:49:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/451270040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 msgr2=0x562951137f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951137f30 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4c98000c00 tx=0x7f4c9809a5e0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/451270040 shutdown_connections 2023-09-13T09:49:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951137290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951137f30 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/451270040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x5629511368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/451270040 >> 172.21.15.6:0/451270040 conn(0x562951090c80 msgr2=0x56295112cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/451270040 shutdown_connections 2023-09-13T09:49:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/451270040 wait complete. 2023-09-13T09:49:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.460+0000 7f4cb8f1db80 1 -- start start 2023-09-13T09:49:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 1 Processor -- start 2023-09-13T09:49:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x56295113ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951140500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x562951147540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562951022bb0 con 0x562951137b10 2023-09-13T09:49:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629510228b0 con 0x562951136e10 2023-09-13T09:49:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562950f06920 con 0x562951138470 2023-09-13T09:49:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4cb8f1db80 10 client.0 _ll_register_callbacks cb 0x562951020680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951140500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951140500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40178/0 (socket says 172.21.15.6:40178) 2023-09-13T09:49:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 -- 172.21.15.6:0/2514096985 learned_addr learned my addr 172.21.15.6:0/2514096985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca659c700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x56295113ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x562951147540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 -- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 msgr2=0x562951147540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x562951147540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 -- 172.21.15.6:0/2514096985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 msgr2=0x56295113ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x56295113ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca5d9b700 1 -- 172.21.15.6:0/2514096985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca819efa0 con 0x562951137b10 2023-09-13T09:49:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.461+0000 7f4ca659c700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x56295113ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951140500 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c01dd20 tx=0x7f4c9c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510795194d7e7f96 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4c8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4c8dffb700 1 -- 172.21.15.6:0/2514096985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9c022070 con 0x562951137b10 2023-09-13T09:49:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4c8dffb700 1 -- 172.21.15.6:0/2514096985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4c9c01cd00 con 0x562951137b10 2023-09-13T09:49:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562951125670 con 0x562951137b10 2023-09-13T09:49:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4c8dffb700 1 -- 172.21.15.6:0/2514096985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c9c031430 con 0x562951137b10 2023-09-13T09:49:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 10 client.18111 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56295109c7a0 con 0x562951137b10 2023-09-13T09:49:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4c8dffb700 1 -- 172.21.15.6:0/2514096985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c9c035080 con 0x562951137b10 2023-09-13T09:49:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4c8dffb700 1 -- 172.21.15.6:0/2514096985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4c9c00e640 con 0x562951137b10 2023-09-13T09:49:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 10 client.18111 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 10 client.18111 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:49:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 20 client.18111 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56295114bda0 0x56295114e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 4 client.18111 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.462+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56295107d970 con 0x56295114bda0 2023-09-13T09:49:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.463+0000 7f4ca659c700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56295114bda0 0x56295114e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.463+0000 7f4c8dffb700 10 client.18111 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:49:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.463+0000 7f4ca659c700 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56295114bda0 0x56295114e1c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9bbd0de8c2c6aba5 server_cookie=f979d2b4f40d595b in_seq=0 out_seq=0 2023-09-13T09:49:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4c8dffb700 1 -- 172.21.15.6:0/2514096985 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56295107d970 con 0x56295114bda0 2023-09-13T09:49:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4c8dffb700 10 client.18111 handle_command_reply: tid=0 2023-09-13T09:49:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 client.18111 shutdown 2023-09-13T09:49:32.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 msgr2=0x562951140500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951140500 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c01dd20 tx=0x7f4c9c0047c0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 shutdown_connections 2023-09-13T09:49:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56295114bda0 0x56295114e1c0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951138470 0x562951147540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4c8dffb700 0 client.18111 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:49:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x56295113ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/2514096985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x562951140500 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 >> 172.21.15.6:0/2514096985 conn(0x562951090c80 msgr2=0x5629511277f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 shutdown_connections 2023-09-13T09:49:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/2514096985 wait complete. 2023-09-13T09:49:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.464+0000 7f4cb8f1db80 20 client.18111 trim_cache size 0 max 16384 2023-09-13T09:49:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.477+0000 7f4cb8f1db80 1 Processor -- start 2023-09-13T09:49:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.477+0000 7f4cb8f1db80 1 -- start start 2023-09-13T09:49:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.477+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951090c80 0x5629511368d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.477+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951147500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x56295113acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56295112dbb0 con 0x562951137b10 2023-09-13T09:49:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56295107d970 con 0x562951136e10 2023-09-13T09:49:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56295113f470 con 0x562951090c80 2023-09-13T09:49:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x56295113acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca5d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x56295113acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40188/0 (socket says 172.21.15.6:40188) 2023-09-13T09:49:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 -- 172.21.15.6:0/3869791545 learned_addr learned my addr 172.21.15.6:0/3869791545 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca659c700 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951090c80 0x5629511368d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 -- 172.21.15.6:0/3869791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951090c80 msgr2=0x5629511368d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951090c80 0x5629511368d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 -- 172.21.15.6:0/3869791545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 msgr2=0x562951147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 -- 172.21.15.6:0/3869791545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562950eb0de0 con 0x562951137b10 2023-09-13T09:49:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca659c700 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951090c80 0x5629511368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x56295113acf0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0007550 tx=0x7f4ca000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44812db267ba9851 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4c957fa700 1 -- 172.21.15.6:0/3869791545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000e040 con 0x562951137b10 2023-09-13T09:49:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4c957fa700 1 -- 172.21.15.6:0/3869791545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ca000f040 con 0x562951137b10 2023-09-13T09:49:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.478+0000 7f4c957fa700 1 -- 172.21.15.6:0/3869791545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0017740 con 0x562951137b10 2023-09-13T09:49:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/3869791545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 msgr2=0x56295113acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x56295113acf0 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f4ca0007550 tx=0x7f4ca000b040 comp rx=0 tx=0).stop 2023-09-13T09:49:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/3869791545 shutdown_connections 2023-09-13T09:49:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951137b10 0x56295113acf0 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951090c80 0x5629511368d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/3869791545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/3869791545 >> 172.21.15.6:0/3869791545 conn(0x56295112d240 msgr2=0x56295113ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/3869791545 shutdown_connections 2023-09-13T09:49:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/3869791545 wait complete. 2023-09-13T09:49:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 -- start start 2023-09-13T09:49:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.479+0000 7f4cb8f1db80 1 Processor -- start 2023-09-13T09:49:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951090c80 0x5629511437a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4cb8f1db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951137b10 0x562951146d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562951147240 con 0x562951090c80 2023-09-13T09:49:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629511473b0 con 0x562951136e10 2023-09-13T09:49:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4cb8f1db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562951147570 con 0x562951137b10 2023-09-13T09:49:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4cb8f1db80 10 client.0 _ll_register_callbacks cb 0x562951020680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951090c80 0x5629511437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951090c80 0x5629511437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40190/0 (socket says 172.21.15.6:40190) 2023-09-13T09:49:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 -- 172.21.15.6:0/257862456 learned_addr learned my addr 172.21.15.6:0/257862456 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951137b10 0x562951146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 -- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951137b10 msgr2=0x562951146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951137b10 0x562951146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 -- 172.21.15.6:0/257862456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 msgr2=0x562951143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 -- 172.21.15.6:0/257862456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562950f04630 con 0x562951090c80 2023-09-13T09:49:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca6d9d700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951137b10 0x562951146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:49:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:49:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4ca659c700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951090c80 0x5629511437a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009990 tx=0x7f4c98021580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b28bc84f25c061 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4c8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4c8dffb700 1 -- 172.21.15.6:0/257862456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c980a2770 con 0x562951090c80 2023-09-13T09:49:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.480+0000 7f4c8dffb700 1 -- 172.21.15.6:0/257862456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4c9809a790 con 0x562951090c80 2023-09-13T09:49:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c9809ae90 con 0x562951090c80 2023-09-13T09:49:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4c8dffb700 1 -- 172.21.15.6:0/257862456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c98098b30 con 0x562951090c80 2023-09-13T09:49:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 10 client.18117 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56295109c7a0 con 0x562951090c80 2023-09-13T09:49:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4c8dffb700 1 -- 172.21.15.6:0/257862456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4c9809ae90 con 0x562951090c80 2023-09-13T09:49:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4c8dffb700 1 -- 172.21.15.6:0/257862456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4c9809e120 con 0x562951090c80 2023-09-13T09:49:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 10 client.18117 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 10 client.18117 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:49:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 20 client.18117 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562951138470 0x5629511a2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 4 client.18117 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:49:32.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56295103e050 con 0x562951138470 2023-09-13T09:49:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.481+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562951138470 0x5629511a2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4ca5d9b700 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562951138470 0x5629511a2d20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5548e7f1f5c54008 server_cookie=a1abc92ca39c9f63 in_seq=0 out_seq=0 2023-09-13T09:49:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4c8dffb700 10 client.18117 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:49:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4c8dffb700 1 -- 172.21.15.6:0/257862456 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56295103e050 con 0x562951138470 2023-09-13T09:49:32.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4c8dffb700 10 client.18117 handle_command_reply: tid=0 2023-09-13T09:49:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 client.18117 shutdown 2023-09-13T09:49:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951090c80 msgr2=0x5629511437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951090c80 0x5629511437a0 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f4c98009990 tx=0x7f4c98021580 comp rx=0 tx=0).stop 2023-09-13T09:49:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 shutdown_connections 2023-09-13T09:49:32.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562951138470 0x5629511a2d20 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562951137b10 0x562951146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562951090c80 0x5629511437a0 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 --2- 172.21.15.6:0/257862456 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562951136e10 0x562951143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4c8dffb700 0 client.18117 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:49:32.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 >> 172.21.15.6:0/257862456 conn(0x56295112d240 msgr2=0x56295113ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 shutdown_connections 2023-09-13T09:49:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 1 -- 172.21.15.6:0/257862456 wait complete. 2023-09-13T09:49:32.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.482+0000 7f4cb8f1db80 20 client.18117 trim_cache size 0 max 16384 2023-09-13T09:49:32.510 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:49:32.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:32 smithi053 ceph-mon[102373]: pgmap v600: 97 pgs: 97 active+clean; 223 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.9 MiB/s wr, 212 op/s 2023-09-13T09:49:32.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:32 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4208170514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:49:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c900a0640 msgr2=0x7f4c900a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c900a0640 0x7f4c900a2b00 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4c9c009d20 tx=0x7f4c9c009260 comp rx=0 tx=0).stop 2023-09-13T09:49:32.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ca8101840 msgr2=0x7f4ca8196a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ca8101840 0x7f4ca8196a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4c980098e0 tx=0x7f4c98009580 comp rx=0 tx=0).stop 2023-09-13T09:49:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 shutdown_connections 2023-09-13T09:49:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4c900a0640 0x7f4c900a2b00 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ca8106aa0 0x7f4ca819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4ca8101840 0x7f4ca8196a50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 --2- 172.21.15.6:0/1566461754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ca8104170 0x7f4ca8196f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 >> 172.21.15.6:0/1566461754 conn(0x7f4ca80fb250 msgr2=0x7f4ca81024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 shutdown_connections 2023-09-13T09:49:32.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.483+0000 7f4cacd38700 1 -- 172.21.15.6:0/1566461754 wait complete. 2023-09-13T09:49:32.515 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:49:32.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:32 smithi131 ceph-mon[102785]: pgmap v600: 97 pgs: 97 active+clean; 223 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 531 KiB/s rd, 1.9 MiB/s wr, 212 op/s 2023-09-13T09:49:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:32 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4208170514' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:49:32.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 -- 172.21.15.6:0/835009664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 msgr2=0x7f6d8c1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 --2- 172.21.15.6:0/835009664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c1000e0 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f6d880099c0 tx=0x7f6d88009cd0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 -- 172.21.15.6:0/835009664 shutdown_connections 2023-09-13T09:49:32.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 --2- 172.21.15.6:0/835009664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d8c101850 0x7f6d8c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 --2- 172.21.15.6:0/835009664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c1000e0 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 --2- 172.21.15.6:0/835009664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d8c100eb0 0x7f6d8c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 -- 172.21.15.6:0/835009664 >> 172.21.15.6:0/835009664 conn(0x7f6d8c0fb250 msgr2=0x7f6d8c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 -- 172.21.15.6:0/835009664 shutdown_connections 2023-09-13T09:49:32.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.686+0000 7f6d9370e700 1 -- 172.21.15.6:0/835009664 wait complete. 2023-09-13T09:49:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 Processor -- start 2023-09-13T09:49:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 -- start start 2023-09-13T09:49:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d8c100eb0 0x7f6d8c19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d8c101850 0x7f6d8c19de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c19e5e0 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c19e750 con 0x7f6d8c100eb0 2023-09-13T09:49:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d9370e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d8c19e910 con 0x7f6d8c101850 2023-09-13T09:49:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c068b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40204/0 (socket says 172.21.15.6:40204) 2023-09-13T09:49:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 -- 172.21.15.6:0/863800688 learned_addr learned my addr 172.21.15.6:0/863800688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d8c100eb0 0x7f6d8c19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d91cab700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d8c101850 0x7f6d8c19de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 -- 172.21.15.6:0/863800688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d8c101850 msgr2=0x7f6d8c19de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d8c101850 0x7f6d8c19de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 -- 172.21.15.6:0/863800688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d8c100eb0 msgr2=0x7f6d8c19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d8c100eb0 0x7f6d8c19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.687+0000 7f6d914aa700 1 -- 172.21.15.6:0/863800688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c009520 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.688+0000 7f6d914aa700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c068b40 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009fd0 tx=0x7f6d88009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.688+0000 7f6d827fc700 1 -- 172.21.15.6:0/863800688 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8801d070 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.688+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d880095f0 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.688+0000 7f6d827fc700 1 -- 172.21.15.6:0/863800688 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d88005030 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.688+0000 7f6d827fc700 1 -- 172.21.15.6:0/863800688 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88004a90 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.688+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d8c19ee20 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.690+0000 7f6d827fc700 1 -- 172.21.15.6:0/863800688 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6d880051a0 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.691+0000 7f6d827fc700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d780a0640 0x7f6d780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.691+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d780a0640 0x7f6d780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.691+0000 7f6d827fc700 1 -- 172.21.15.6:0/863800688 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d880cc940 con 0x7f6d8c0ffcc0 2023-09-13T09:49:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.691+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d780a0640 0x7f6d780a2b00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0688b0 tx=0x7f6d7c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 Processor -- start 2023-09-13T09:49:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 -- start start 2023-09-13T09:49:32.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef86b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef85e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225eede780 con 0x56225ef87060 2023-09-13T09:49:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225eedc0a0 con 0x56225ef85a00 2023-09-13T09:49:32.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225eed7990 con 0x56225ef86700 2023-09-13T09:49:32.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d90ca9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d90ca9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef854c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40214/0 (socket says 172.21.15.6:40214) 2023-09-13T09:49:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef86b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d90ca9700 1 -- 172.21.15.6:0/2703362605 learned_addr learned my addr 172.21.15.6:0/2703362605 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.692+0000 7f6d91cab700 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef85e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d90ca9700 1 -- 172.21.15.6:0/2703362605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 msgr2=0x56225ef86b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef86b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d90ca9700 1 -- 172.21.15.6:0/2703362605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 msgr2=0x56225ef85e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef85e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d90ca9700 1 -- 172.21.15.6:0/2703362605 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56225ed57630 con 0x56225ef87060 2023-09-13T09:49:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d91cab700 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef85e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef854c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e610 tx=0x7f6d7c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2158d6411951d74b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d777fe700 1 -- 172.21.15.6:0/2703362605 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c004220 con 0x56225ef87060 2023-09-13T09:49:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d777fe700 1 -- 172.21.15.6:0/2703362605 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d7c021070 con 0x56225ef87060 2023-09-13T09:49:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.693+0000 7f6d777fe700 1 -- 172.21.15.6:0/2703362605 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c01c670 con 0x56225ef87060 2023-09-13T09:49:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2703362605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 msgr2=0x56225ef854c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef854c0 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c00e610 tx=0x7f6d7c014000 comp rx=0 tx=0).stop 2023-09-13T09:49:32.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2703362605 shutdown_connections 2023-09-13T09:49:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef85e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef86b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2703362605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef854c0 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2703362605 >> 172.21.15.6:0/2703362605 conn(0x56225eee3c80 msgr2=0x56225ef7ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2703362605 shutdown_connections 2023-09-13T09:49:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2703362605 wait complete. 2023-09-13T09:49:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 -- start start 2023-09-13T09:49:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.694+0000 7f6d9f8f3b80 1 Processor -- start 2023-09-13T09:49:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef8ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef86700 0x56225ef8f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef87060 0x56225ef964f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ee75bb0 con 0x56225ef85a00 2023-09-13T09:49:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ee758b0 con 0x56225ef86700 2023-09-13T09:49:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ed59920 con 0x56225ef87060 2023-09-13T09:49:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 10 client.0 _ll_register_callbacks cb 0x56225ee73680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef8ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef8ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40218/0 (socket says 172.21.15.6:40218) 2023-09-13T09:49:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 -- 172.21.15.6:0/1395475031 learned_addr learned my addr 172.21.15.6:0/1395475031 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef86700 0x56225ef8f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d91cab700 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef87060 0x56225ef964f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 -- 172.21.15.6:0/1395475031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef87060 msgr2=0x56225ef964f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef87060 0x56225ef964f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 -- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef86700 msgr2=0x56225ef8f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef86700 0x56225ef8f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 -- 172.21.15.6:0/1395475031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d7c017070 con 0x56225ef85a00 2023-09-13T09:49:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d914aa700 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef8ef70 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6d88096620 tx=0x7f6d88005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ec50309758bc2e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d74ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d74ff9700 1 -- 172.21.15.6:0/1395475031 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88099860 con 0x56225ef85a00 2023-09-13T09:49:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d74ff9700 1 -- 172.21.15.6:0/1395475031 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d880a1cc0 con 0x56225ef85a00 2023-09-13T09:49:32.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.695+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56225ef78670 con 0x56225ef85a00 2023-09-13T09:49:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d74ff9700 1 -- 172.21.15.6:0/1395475031 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d880a00c0 con 0x56225ef85a00 2023-09-13T09:49:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 10 client.18129 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56225eeef7a0 con 0x56225ef85a00 2023-09-13T09:49:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d74ff9700 1 -- 172.21.15.6:0/1395475031 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d88064080 con 0x56225ef85a00 2023-09-13T09:49:32.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d74ff9700 1 -- 172.21.15.6:0/1395475031 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6d880b2200 con 0x56225ef85a00 2023-09-13T09:49:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 10 client.18129 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 10 client.18129 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 20 client.18129 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225ef9a970 0x56225ef9cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 4 client.18129 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56225eed0970 con 0x56225ef9a970 2023-09-13T09:49:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.696+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225ef9a970 0x56225ef9cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.697+0000 7f6d74ff9700 10 client.18129 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:32.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.697+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225ef9a970 0x56225ef9cd60 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38b4cf966a7ec278 server_cookie=9689e68994d76634 in_seq=0 out_seq=0 2023-09-13T09:49:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.697+0000 7f6d74ff9700 1 -- 172.21.15.6:0/1395475031 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56225eed0970 con 0x56225ef9a970 2023-09-13T09:49:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.697+0000 7f6d74ff9700 10 client.18129 handle_command_reply: tid=0 2023-09-13T09:49:32.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.697+0000 7f6d9f8f3b80 1 client.18129 shutdown 2023-09-13T09:49:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 msgr2=0x56225ef8ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef8ef70 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6d88096620 tx=0x7f6d88005760 comp rx=0 tx=0).stop 2023-09-13T09:49:32.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 shutdown_connections 2023-09-13T09:49:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef87060 0x56225ef964f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225ef9a970 0x56225ef9cd60 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef8ef70 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/1395475031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef86700 0x56225ef8f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d74ff9700 0 client.18129 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 >> 172.21.15.6:0/1395475031 conn(0x56225eee3c80 msgr2=0x56225ef7a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 shutdown_connections 2023-09-13T09:49:32.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/1395475031 wait complete. 2023-09-13T09:49:32.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.698+0000 7f6d9f8f3b80 20 client.18129 trim_cache size 0 max 16384 2023-09-13T09:49:32.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 Processor -- start 2023-09-13T09:49:32.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 -- start start 2023-09-13T09:49:32.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef80fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ef8a490 con 0x56225ef87060 2023-09-13T09:49:32.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225efa1a80 con 0x56225ef85a00 2023-09-13T09:49:32.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225efa1c40 con 0x56225ef86700 2023-09-13T09:49:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d91cab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef854c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33750/0 (socket says 172.21.15.6:33750) 2023-09-13T09:49:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 -- 172.21.15.6:0/2314980360 learned_addr learned my addr 172.21.15.6:0/2314980360 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d91cab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef964b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40230/0 (socket says 172.21.15.6:40230) 2023-09-13T09:49:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef80fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 -- 172.21.15.6:0/2314980360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 msgr2=0x56225ef80fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef80fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 -- 172.21.15.6:0/2314980360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 msgr2=0x56225ef964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef964b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.712+0000 7f6d914aa700 1 -- 172.21.15.6:0/2314980360 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56225ed03de0 con 0x56225ef85a00 2023-09-13T09:49:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.713+0000 7f6d91cab700 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.713+0000 7f6d914aa700 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef854c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800bf40 tx=0x7f6d88099da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4507dd9efae48e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.713+0000 7f6d77fff700 1 -- 172.21.15.6:0/2314980360 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880a00b0 con 0x56225ef85a00 2023-09-13T09:49:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.713+0000 7f6d77fff700 1 -- 172.21.15.6:0/2314980360 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56225ef78670 con 0x56225ef85a00 2023-09-13T09:49:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.713+0000 7f6d77fff700 1 -- 172.21.15.6:0/2314980360 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d88099660 con 0x56225ef85a00 2023-09-13T09:49:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2314980360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 msgr2=0x56225ef854c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef854c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800bf40 tx=0x7f6d88099da0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2314980360 shutdown_connections 2023-09-13T09:49:32.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef87060 0x56225ef964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef85a00 0x56225ef854c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/2314980360 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef80fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2314980360 >> 172.21.15.6:0/2314980360 conn(0x56225eee3c80 msgr2=0x56225ef7fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2314980360 shutdown_connections 2023-09-13T09:49:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/2314980360 wait complete. 2023-09-13T09:49:32.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 -- start start 2023-09-13T09:49:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.714+0000 7f6d9f8f3b80 1 Processor -- start 2023-09-13T09:49:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef91ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef92430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef87060 0x56225ef95450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ef95990 con 0x56225ef85a00 2023-09-13T09:49:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ef95b00 con 0x56225ef87060 2023-09-13T09:49:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225ef95cc0 con 0x56225ef86700 2023-09-13T09:49:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 10 client.0 _ll_register_callbacks cb 0x56225ee73680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:32.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d91cab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef87060 0x56225ef95450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef91ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d91cab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef87060 0x56225ef95450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33760/0 (socket says 172.21.15.6:33760) 2023-09-13T09:49:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d90ca9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef92430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d91cab700 1 -- 172.21.15.6:0/985467743 learned_addr learned my addr 172.21.15.6:0/985467743 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:32.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef91ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40232/0 (socket says 172.21.15.6:40232) 2023-09-13T09:49:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 -- 172.21.15.6:0/985467743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 msgr2=0x56225ef92430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef92430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 -- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef87060 msgr2=0x56225ef95450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef87060 0x56225ef95450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 -- 172.21.15.6:0/985467743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d84009110 con 0x56225ef85a00 2023-09-13T09:49:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d91cab700 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef87060 0x56225ef95450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d914aa700 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef91ef0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800bf40 tx=0x7f6d88099f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=240a1628144187d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d74ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:32.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d74ff9700 1 -- 172.21.15.6:0/985467743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d880a00b0 con 0x56225ef85a00 2023-09-13T09:49:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d74ff9700 1 -- 172.21.15.6:0/985467743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d88096030 con 0x56225ef85a00 2023-09-13T09:49:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.715+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d7c021070 con 0x56225ef85a00 2023-09-13T09:49:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d74ff9700 1 -- 172.21.15.6:0/985467743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d880961f0 con 0x56225ef85a00 2023-09-13T09:49:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 10 client.18135 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:32.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56225eeef7a0 con 0x56225ef85a00 2023-09-13T09:49:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d74ff9700 1 -- 172.21.15.6:0/985467743 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d7c021070 con 0x56225ef85a00 2023-09-13T09:49:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d74ff9700 1 -- 172.21.15.6:0/985467743 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6d8807c050 con 0x56225ef85a00 2023-09-13T09:49:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 10 client.18135 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:32.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 10 client.18135 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:32.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 20 client.18135 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:32.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225efeec60 0x56225eff1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:32.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 4 client.18135 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:49:32.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56225ee91050 con 0x56225efeec60 2023-09-13T09:49:32.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.716+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225efeec60 0x56225eff1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:32.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d74ff9700 10 client.18135 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:32.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d90ca9700 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225efeec60 0x56225eff1050 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1c2dccd7953af05 server_cookie=62559adcbaff4659 in_seq=0 out_seq=0 2023-09-13T09:49:32.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d74ff9700 1 -- 172.21.15.6:0/985467743 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56225ee91050 con 0x56225efeec60 2023-09-13T09:49:32.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d74ff9700 10 client.18135 handle_command_reply: tid=0 2023-09-13T09:49:32.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 client.18135 shutdown 2023-09-13T09:49:32.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 msgr2=0x56225ef91ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef91ef0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f6d8800bf40 tx=0x7f6d88099f40 comp rx=0 tx=0).stop 2023-09-13T09:49:32.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 shutdown_connections 2023-09-13T09:49:32.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56225ef87060 0x56225ef95450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56225efeec60 0x56225eff1050 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56225ef85a00 0x56225ef91ef0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d74ff9700 0 client.18135 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:32.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 --2- 172.21.15.6:0/985467743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56225ef86700 0x56225ef92430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 >> 172.21.15.6:0/985467743 conn(0x56225eee3c80 msgr2=0x56225ef8cdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 shutdown_connections 2023-09-13T09:49:32.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 1 -- 172.21.15.6:0/985467743 wait complete. 2023-09-13T09:49:32.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.717+0000 7f6d9f8f3b80 20 client.18135 trim_cache size 0 max 16384 2023-09-13T09:49:32.758 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:49:32.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d780a0640 msgr2=0x7f6d780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d780a0640 0x7f6d780a2b00 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f6d8c0688b0 tx=0x7f6d7c009260 comp rx=0 tx=0).stop 2023-09-13T09:49:32.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 msgr2=0x7f6d8c068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:32.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c068b40 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f6d88009fd0 tx=0x7f6d88009580 comp rx=0 tx=0).stop 2023-09-13T09:49:32.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 shutdown_connections 2023-09-13T09:49:32.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d8c101850 0x7f6d8c19de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d780a0640 0x7f6d780a2b00 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d8c0ffcc0 0x7f6d8c068b40 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 --2- 172.21.15.6:0/863800688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d8c100eb0 0x7f6d8c19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:32.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 >> 172.21.15.6:0/863800688 conn(0x7f6d8c0fb250 msgr2=0x7f6d8c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:32.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 shutdown_connections 2023-09-13T09:49:32.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:32.718+0000 7f6d9370e700 1 -- 172.21.15.6:0/863800688 wait complete. 2023-09-13T09:49:33.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 563862 6.18 MB/sec execute 413 sec latency 17.454 ms 2023-09-13T09:49:33.763 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:49:33.763 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:49:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 -- 172.21.15.6:0/2519413800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c0fff80 msgr2=0x7fd16c1003e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 --2- 172.21.15.6:0/2519413800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c0fff80 0x7fd16c1003e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd15c009990 tx=0x7fd15c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 -- 172.21.15.6:0/2519413800 shutdown_connections 2023-09-13T09:49:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 --2- 172.21.15.6:0/2519413800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c100920 0x7fd16c1081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 --2- 172.21.15.6:0/2519413800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c101250 0x7fd16c101670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 --2- 172.21.15.6:0/2519413800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c0fff80 0x7fd16c1003e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 -- 172.21.15.6:0/2519413800 >> 172.21.15.6:0/2519413800 conn(0x7fd16c0fa9b0 msgr2=0x7fd16c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 -- 172.21.15.6:0/2519413800 shutdown_connections 2023-09-13T09:49:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.898+0000 7fd1732a9700 1 -- 172.21.15.6:0/2519413800 wait complete. 2023-09-13T09:49:33.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 Processor -- start 2023-09-13T09:49:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 -- start start 2023-09-13T09:49:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fff80 0x7fd16c103d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c100920 0x7fd16c102370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c101250 0x7fd16c1028b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c103050 con 0x7fd16c100920 2023-09-13T09:49:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c1031c0 con 0x7fd16c101250 2023-09-13T09:49:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd1732a9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c1a0b20 con 0x7fd16c0fff80 2023-09-13T09:49:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c100920 0x7fd16c102370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c100920 0x7fd16c102370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40246/0 (socket says 172.21.15.6:40246) 2023-09-13T09:49:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 -- 172.21.15.6:0/1674939450 learned_addr learned my addr 172.21.15.6:0/1674939450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd171045700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fff80 0x7fd16c103d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd171846700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c101250 0x7fd16c1028b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 -- 172.21.15.6:0/1674939450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fff80 msgr2=0x7fd16c103d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fff80 0x7fd16c103d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 -- 172.21.15.6:0/1674939450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c101250 msgr2=0x7fd16c1028b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c101250 0x7fd16c1028b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.899+0000 7fd170844700 1 -- 172.21.15.6:0/1674939450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd168009520 con 0x7fd16c100920 2023-09-13T09:49:33.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.900+0000 7fd170844700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c100920 0x7fd16c102370 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd15c004740 tx=0x7fd15c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:33.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.900+0000 7fd1627fc700 1 -- 172.21.15.6:0/1674939450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c01d070 con 0x7fd16c100920 2023-09-13T09:49:33.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.900+0000 7fd1627fc700 1 -- 172.21.15.6:0/1674939450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd15c004830 con 0x7fd16c100920 2023-09-13T09:49:33.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.900+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c0095f0 con 0x7fd16c100920 2023-09-13T09:49:33.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.900+0000 7fd1627fc700 1 -- 172.21.15.6:0/1674939450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c0053c0 con 0x7fd16c100920 2023-09-13T09:49:33.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.900+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c1a0fd0 con 0x7fd16c100920 2023-09-13T09:49:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.902+0000 7fd1627fc700 1 -- 172.21.15.6:0/1674939450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd15c005580 con 0x7fd16c100920 2023-09-13T09:49:33.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.902+0000 7fd1627fc700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1580a0640 0x7fd1580a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.903+0000 7fd1627fc700 1 -- 172.21.15.6:0/1674939450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd15c0ccde0 con 0x7fd16c100920 2023-09-13T09:49:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.903+0000 7fd171045700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1580a0640 0x7fd1580a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.903+0000 7fd171045700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1580a0640 0x7fd1580a2b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd16c067d30 tx=0x7fd168009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.903+0000 7fd17f48eb80 1 Processor -- start 2023-09-13T09:49:33.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.903+0000 7fd17f48eb80 1 -- start start 2023-09-13T09:49:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c5424ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5423540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5423a80 0x55d5c5423f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c537c800 con 0x55d5c54250e0 2023-09-13T09:49:33.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c537a120 con 0x55d5c5424780 2023-09-13T09:49:33.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c5375a10 con 0x55d5c5423a80 2023-09-13T09:49:33.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5423540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd171045700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c5424ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5423540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40254/0 (socket says 172.21.15.6:40254) 2023-09-13T09:49:33.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 -- 172.21.15.6:0/4116728828 learned_addr learned my addr 172.21.15.6:0/4116728828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:33.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd171846700 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5423a80 0x55d5c5423f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 -- 172.21.15.6:0/4116728828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5423a80 msgr2=0x55d5c5423f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5423a80 0x55d5c5423f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 -- 172.21.15.6:0/4116728828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 msgr2=0x55d5c5424ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c5424ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 -- 172.21.15.6:0/4116728828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5c51f56b0 con 0x55d5c54250e0 2023-09-13T09:49:33.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd171846700 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5423a80 0x55d5c5423f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:33.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd170844700 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5423540 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0a2060 tx=0x7fd15c099f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedfc3152d8535b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:33.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.904+0000 7fd1577fe700 1 -- 172.21.15.6:0/4116728828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c09a5b0 con 0x55d5c54250e0 2023-09-13T09:49:33.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd1577fe700 1 -- 172.21.15.6:0/4116728828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd15c09e3e0 con 0x55d5c54250e0 2023-09-13T09:49:33.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd1577fe700 1 -- 172.21.15.6:0/4116728828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15c09aa70 con 0x55d5c54250e0 2023-09-13T09:49:33.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 -- 172.21.15.6:0/4116728828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 msgr2=0x55d5c5423540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5423540 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7fd15c0a2060 tx=0x7fd15c099f10 comp rx=0 tx=0).stop 2023-09-13T09:49:33.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 -- 172.21.15.6:0/4116728828 shutdown_connections 2023-09-13T09:49:33.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5423a80 0x55d5c5423f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c5424ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/4116728828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5423540 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 -- 172.21.15.6:0/4116728828 >> 172.21.15.6:0/4116728828 conn(0x55d5c5381d00 msgr2=0x55d5c541df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:33.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 -- 172.21.15.6:0/4116728828 shutdown_connections 2023-09-13T09:49:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.905+0000 7fd17f48eb80 1 -- 172.21.15.6:0/4116728828 wait complete. 2023-09-13T09:49:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 -- start start 2023-09-13T09:49:33.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 Processor -- start 2023-09-13T09:49:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c542cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5424780 0x55d5c542d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c5434110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c5313c30 con 0x55d5c5424780 2023-09-13T09:49:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c5313930 con 0x55d5c5423a80 2023-09-13T09:49:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.906+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c51f79a0 con 0x55d5c54250e0 2023-09-13T09:49:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd170844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5424780 0x55d5c542d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171045700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c542cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd17f48eb80 10 client.0 _ll_register_callbacks cb 0x55d5c5311700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd170844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5424780 0x55d5c542d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40260/0 (socket says 172.21.15.6:40260) 2023-09-13T09:49:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd170844700 1 -- 172.21.15.6:0/3061622235 learned_addr learned my addr 172.21.15.6:0/3061622235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171846700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c5434110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171045700 1 -- 172.21.15.6:0/3061622235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 msgr2=0x55d5c5434110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171045700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c5434110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171045700 1 -- 172.21.15.6:0/3061622235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5424780 msgr2=0x55d5c542d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171045700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5424780 0x55d5c542d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171045700 1 -- 172.21.15.6:0/3061622235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c1a0fd0 con 0x55d5c5423a80 2023-09-13T09:49:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171846700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c5434110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:49:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd170844700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5424780 0x55d5c542d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd171045700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c542cb90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd168011ab0 tx=0x7fd1680047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebfb24e23a7c1385 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd154ff9700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:49:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd154ff9700 1 -- 172.21.15.6:0/3061622235 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16801fa80 con 0x55d5c5423a80 2023-09-13T09:49:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd154ff9700 1 -- 172.21.15.6:0/3061622235 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd16801fbe0 con 0x55d5c5423a80 2023-09-13T09:49:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5c54166f0 con 0x55d5c5423a80 2023-09-13T09:49:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.907+0000 7fd154ff9700 1 -- 172.21.15.6:0/3061622235 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd16801fda0 con 0x55d5c5423a80 2023-09-13T09:49:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 10 client.27545 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d5c538d820 con 0x55d5c5423a80 2023-09-13T09:49:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd154ff9700 1 -- 172.21.15.6:0/3061622235 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d5c54166f0 con 0x55d5c5423a80 2023-09-13T09:49:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd154ff9700 1 -- 172.21.15.6:0/3061622235 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd168028440 con 0x55d5c5423a80 2023-09-13T09:49:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 10 client.27545 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 10 client.27545 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:33.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 20 client.27545 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c54389c0 0x55d5c543ade0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 4 client.27545 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5c536e9f0 con 0x55d5c54389c0 2023-09-13T09:49:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.908+0000 7fd170844700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c54389c0 0x55d5c543ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.909+0000 7fd170844700 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c54389c0 0x55d5c543ade0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1584e50f39cd984 server_cookie=fe546a5436d3d0f1 in_seq=0 out_seq=0 2023-09-13T09:49:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.909+0000 7fd154ff9700 10 client.27545 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.909+0000 7fd154ff9700 1 -- 172.21.15.6:0/3061622235 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d5c536e9f0 con 0x55d5c54389c0 2023-09-13T09:49:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.909+0000 7fd154ff9700 10 client.27545 handle_command_reply: tid=0 2023-09-13T09:49:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.909+0000 7fd17f48eb80 1 client.27545 shutdown 2023-09-13T09:49:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.909+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 msgr2=0x55d5c542cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.909+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c542cb90 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd168011ab0 tx=0x7fd1680047c0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 shutdown_connections 2023-09-13T09:49:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c5434110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c542cb90 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c54389c0 0x55d5c543ade0 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3061622235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5424780 0x55d5c542d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd154ff9700 0 client.27545 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 >> 172.21.15.6:0/3061622235 conn(0x55d5c5381d00 msgr2=0x55d5c5418870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 shutdown_connections 2023-09-13T09:49:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3061622235 wait complete. 2023-09-13T09:49:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.910+0000 7fd17f48eb80 20 client.27545 trim_cache size 0 max 16384 2023-09-13T09:49:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 Processor -- start 2023-09-13T09:49:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 -- start start 2023-09-13T09:49:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c5418970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5424780 0x55d5c54340d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5422c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c54166c0 con 0x55d5c54250e0 2023-09-13T09:49:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c542c700 con 0x55d5c5423a80 2023-09-13T09:49:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c541f7b0 con 0x55d5c5424780 2023-09-13T09:49:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5422c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171045700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c5418970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5422c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40270/0 (socket says 172.21.15.6:40270) 2023-09-13T09:49:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171045700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c5418970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33790/0 (socket says 172.21.15.6:33790) 2023-09-13T09:49:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171846700 1 -- 172.21.15.6:0/3161077805 learned_addr learned my addr 172.21.15.6:0/3161077805 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd170844700 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5424780 0x55d5c54340d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171045700 1 -- 172.21.15.6:0/3161077805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5424780 msgr2=0x55d5c54340d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171045700 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5424780 0x55d5c54340d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171045700 1 -- 172.21.15.6:0/3161077805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 msgr2=0x55d5c5422c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171045700 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5422c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.927+0000 7fd171045700 1 -- 172.21.15.6:0/3161077805 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5c541e230 con 0x55d5c5423a80 2023-09-13T09:49:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd171045700 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c5418970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd168016040 tx=0x7fd168009b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d95a70fe1fd88 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd157fff700 1 -- 172.21.15.6:0/3161077805 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16801f040 con 0x55d5c5423a80 2023-09-13T09:49:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd157fff700 1 -- 172.21.15.6:0/3161077805 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd168028e80 con 0x55d5c5423a80 2023-09-13T09:49:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd157fff700 1 -- 172.21.15.6:0/3161077805 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16801fe40 con 0x55d5c5423a80 2023-09-13T09:49:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3161077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 msgr2=0x55d5c5418970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c5418970 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd168016040 tx=0x7fd168009b70 comp rx=0 tx=0).stop 2023-09-13T09:49:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3161077805 shutdown_connections 2023-09-13T09:49:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c54250e0 0x55d5c5422c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5423a80 0x55d5c5418970 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3161077805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c5424780 0x55d5c54340d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3161077805 >> 172.21.15.6:0/3161077805 conn(0x55d5c5381d00 msgr2=0x55d5c5422530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.928+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3161077805 shutdown_connections 2023-09-13T09:49:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.929+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3161077805 wait complete. 2023-09-13T09:49:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.929+0000 7fd17f48eb80 1 -- start start 2023-09-13T09:49:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.929+0000 7fd17f48eb80 1 Processor -- start 2023-09-13T09:49:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.929+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5423a80 0x55d5c5431360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.929+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c54318a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.929+0000 7fd17f48eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c54328b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.929+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c5432df0 con 0x55d5c5423a80 2023-09-13T09:49:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c5432f60 con 0x55d5c5424780 2023-09-13T09:49:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd17f48eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5c5433120 con 0x55d5c54250e0 2023-09-13T09:49:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd17f48eb80 10 client.0 _ll_register_callbacks cb 0x55d5c5311700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5423a80 0x55d5c5431360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5423a80 0x55d5c5431360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40272/0 (socket says 172.21.15.6:40272) 2023-09-13T09:49:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 -- 172.21.15.6:0/3762646708 learned_addr learned my addr 172.21.15.6:0/3762646708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd170844700 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c54318a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171846700 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c54328b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 -- 172.21.15.6:0/3762646708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 msgr2=0x55d5c54328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c54328b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 -- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 msgr2=0x55d5c54318a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c54318a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 -- 172.21.15.6:0/3762646708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5c538d820 con 0x55d5c5423a80 2023-09-13T09:49:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd171045700 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5423a80 0x55d5c5431360 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd168000c00 tx=0x7fd16801f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf49448bc982d9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd154ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd154ff9700 1 -- 172.21.15.6:0/3762646708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd16801fdc0 con 0x55d5c5423a80 2023-09-13T09:49:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd154ff9700 1 -- 172.21.15.6:0/3762646708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1680289c0 con 0x55d5c5423a80 2023-09-13T09:49:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5c532f0d0 con 0x55d5c5423a80 2023-09-13T09:49:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd154ff9700 1 -- 172.21.15.6:0/3762646708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd168028b80 con 0x55d5c5423a80 2023-09-13T09:49:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd17f48eb80 10 client.18153 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.930+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55d5c543fa10 con 0x55d5c5423a80 2023-09-13T09:49:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd154ff9700 1 -- 172.21.15.6:0/3762646708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd16804c080 con 0x55d5c5423a80 2023-09-13T09:49:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd154ff9700 1 -- 172.21.15.6:0/3762646708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd1680048c0 con 0x55d5c5423a80 2023-09-13T09:49:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd17f48eb80 10 client.18153 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd17f48eb80 10 client.18153 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd17f48eb80 20 client.18153 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c548e900 0x55d5c5490cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd17f48eb80 4 client.18153 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:49:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55d5c51c2ff0 con 0x55d5c548e900 2023-09-13T09:49:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd170844700 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c548e900 0x55d5c5490cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd154ff9700 10 client.18153 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.931+0000 7fd170844700 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c548e900 0x55d5c5490cf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=888464c9b5da9652 server_cookie=a5f0a8061d8e5b23 in_seq=0 out_seq=0 2023-09-13T09:49:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd154ff9700 1 -- 172.21.15.6:0/3762646708 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55d5c51c2ff0 con 0x55d5c548e900 2023-09-13T09:49:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd154ff9700 10 client.18153 handle_command_reply: tid=0 2023-09-13T09:49:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 client.18153 shutdown 2023-09-13T09:49:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5423a80 msgr2=0x55d5c5431360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5423a80 0x55d5c5431360 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7fd168000c00 tx=0x7fd16801f910 comp rx=0 tx=0).stop 2023-09-13T09:49:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 shutdown_connections 2023-09-13T09:49:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5c54250e0 0x55d5c54328b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d5c548e900 0x55d5c5490cf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5c5423a80 0x55d5c5431360 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 --2- 172.21.15.6:0/3762646708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5c5424780 0x55d5c54318a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd154ff9700 0 client.18153 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 >> 172.21.15.6:0/3762646708 conn(0x55d5c5381d00 msgr2=0x55d5c542d040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 shutdown_connections 2023-09-13T09:49:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 1 -- 172.21.15.6:0/3762646708 wait complete. 2023-09-13T09:49:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.933+0000 7fd17f48eb80 20 client.18153 trim_cache size 0 max 16384 2023-09-13T09:49:33.964 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:49:33.965 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:49:33.965 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "7065662f-0819-4258-85f1-ec4a2ec9f0d5", 2023-09-13T09:49:33.965 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:49:33.965 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:49:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1580a0640 msgr2=0x7fd1580a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1580a0640 0x7fd1580a2b00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd16c067d30 tx=0x7fd168009260 comp rx=0 tx=0).stop 2023-09-13T09:49:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c100920 msgr2=0x7fd16c102370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c100920 0x7fd16c102370 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7fd15c004740 tx=0x7fd15c009580 comp rx=0 tx=0).stop 2023-09-13T09:49:33.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 shutdown_connections 2023-09-13T09:49:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd16c101250 0x7fd16c1028b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fff80 0x7fd16c103d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1580a0640 0x7fd1580a2b00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 --2- 172.21.15.6:0/1674939450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd16c100920 0x7fd16c102370 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:33.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 >> 172.21.15.6:0/1674939450 conn(0x7fd16c0fa9b0 msgr2=0x7fd16c0fef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 shutdown_connections 2023-09-13T09:49:33.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:33.934+0000 7fd1732a9700 1 -- 172.21.15.6:0/1674939450 wait complete. 2023-09-13T09:49:33.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:49:34.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 -- 172.21.15.6:0/4187438709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 msgr2=0x7f21f41012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 --2- 172.21.15.6:0/4187438709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f41012f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f21e40099c0 tx=0x7f21e4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 -- 172.21.15.6:0/4187438709 shutdown_connections 2023-09-13T09:49:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 --2- 172.21.15.6:0/4187438709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f4101830 0x7f21f41080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 --2- 172.21.15.6:0/4187438709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f40ffca0 0x7f21f41000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 --2- 172.21.15.6:0/4187438709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f41012f0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 -- 172.21.15.6:0/4187438709 >> 172.21.15.6:0/4187438709 conn(0x7f21f40fb1f0 msgr2=0x7f21f40fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:34.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 -- 172.21.15.6:0/4187438709 shutdown_connections 2023-09-13T09:49:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.102+0000 7f21f920c700 1 -- 172.21.15.6:0/4187438709 wait complete. 2023-09-13T09:49:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 Processor -- start 2023-09-13T09:49:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 -- start start 2023-09-13T09:49:34.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40ffca0 0x7f21f4198c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f4199190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f4101830 0x7f21f41a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f41a0790 con 0x7f21f4100e90 2023-09-13T09:49:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f41a0900 con 0x7f21f40ffca0 2023-09-13T09:49:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.103+0000 7f21f920c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f41a0ac0 con 0x7f21f4101830 2023-09-13T09:49:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f4199190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f4199190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40286/0 (socket says 172.21.15.6:40286) 2023-09-13T09:49:34.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 -- 172.21.15.6:0/1329470664 learned_addr learned my addr 172.21.15.6:0/1329470664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40ffca0 0x7f21f4198c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f359e700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f4101830 0x7f21f41a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 -- 172.21.15.6:0/1329470664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f4101830 msgr2=0x7f21f41a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f4101830 0x7f21f41a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 -- 172.21.15.6:0/1329470664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40ffca0 msgr2=0x7f21f4198c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40ffca0 0x7f21f4198c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 -- 172.21.15.6:0/1329470664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e40095f0 con 0x7f21f4100e90 2023-09-13T09:49:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f259c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f4199190 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009fd0 tx=0x7f21e4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:34.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21dbfff700 1 -- 172.21.15.6:0/1329470664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e401d070 con 0x7f21f4100e90 2023-09-13T09:49:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f41a0d40 con 0x7f21f4100e90 2023-09-13T09:49:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21dbfff700 1 -- 172.21.15.6:0/1329470664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21e4005030 con 0x7f21f4100e90 2023-09-13T09:49:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21dbfff700 1 -- 172.21.15.6:0/1329470664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4004a90 con 0x7f21f4100e90 2023-09-13T09:49:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.104+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f41a1160 con 0x7f21f4100e90 2023-09-13T09:49:34.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.106+0000 7f21dbfff700 1 -- 172.21.15.6:0/1329470664 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f21e40051a0 con 0x7f21f4100e90 2023-09-13T09:49:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.107+0000 7f21dbfff700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21dc0a0640 0x7f21dc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.107+0000 7f21dbfff700 1 -- 172.21.15.6:0/1329470664 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21e40cc990 con 0x7f21f4100e90 2023-09-13T09:49:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.107+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21dc0a0640 0x7f21dc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21dc0a0640 0x7f21dc0a2b00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f21f419a120 tx=0x7f21e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 Processor -- start 2023-09-13T09:49:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 -- start start 2023-09-13T09:49:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089eeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ede80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559208946780 con 0x5592089eda00 2023-09-13T09:49:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592089440a0 con 0x5592089ef060 2023-09-13T09:49:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f22053f1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55920893f990 con 0x5592089ee700 2023-09-13T09:49:34.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f21f259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f21f259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33818/0 (socket says 172.21.15.6:33818) 2023-09-13T09:49:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f21f359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f21f259c700 1 -- 172.21.15.6:0/2377083910 learned_addr learned my addr 172.21.15.6:0/2377083910 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.108+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089eeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21f259c700 1 -- 172.21.15.6:0/2377083910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 msgr2=0x5592089eeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21f259c700 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089eeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21f259c700 1 -- 172.21.15.6:0/2377083910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 msgr2=0x5592089ede80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21f259c700 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ede80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21f259c700 1 -- 172.21.15.6:0/2377083910 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592087bf630 con 0x5592089ef060 2023-09-13T09:49:34.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21f259c700 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089ed4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f21e40a1c70 tx=0x7f21e409a940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c57b5553326a0f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21d97fa700 1 -- 172.21.15.6:0/2377083910 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e409dff0 con 0x5592089ef060 2023-09-13T09:49:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21d97fa700 1 -- 172.21.15.6:0/2377083910 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21e40a21a0 con 0x5592089ef060 2023-09-13T09:49:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.109+0000 7f21d97fa700 1 -- 172.21.15.6:0/2377083910 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e409a680 con 0x5592089ef060 2023-09-13T09:49:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 -- 172.21.15.6:0/2377083910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 msgr2=0x5592089ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089ed4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f21e40a1c70 tx=0x7f21e409a940 comp rx=0 tx=0).stop 2023-09-13T09:49:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 -- 172.21.15.6:0/2377083910 shutdown_connections 2023-09-13T09:49:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089eeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 --2- 172.21.15.6:0/2377083910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089ed4c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 -- 172.21.15.6:0/2377083910 >> 172.21.15.6:0/2377083910 conn(0x55920894bc80 msgr2=0x5592089e7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:34.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 -- 172.21.15.6:0/2377083910 shutdown_connections 2023-09-13T09:49:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 -- 172.21.15.6:0/2377083910 wait complete. 2023-09-13T09:49:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 -- start start 2023-09-13T09:49:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.110+0000 7f22053f1b80 1 Processor -- start 2023-09-13T09:49:34.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089f6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089f70f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ef060 0x5592089fe130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f22053f1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592088ddbb0 con 0x5592089eda00 2023-09-13T09:49:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f22053f1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592088dd8b0 con 0x5592089ee700 2023-09-13T09:49:34.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f22053f1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592087c1920 con 0x5592089ef060 2023-09-13T09:49:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f22053f1b80 10 client.0 _ll_register_callbacks cb 0x5592088db680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089f6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089f6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40298/0 (socket says 172.21.15.6:40298) 2023-09-13T09:49:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f2d9d700 1 -- 172.21.15.6:0/309508543 learned_addr learned my addr 172.21.15.6:0/309508543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:34.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089f70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f359e700 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ef060 0x5592089fe130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f259c700 1 -- 172.21.15.6:0/309508543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ef060 msgr2=0x5592089fe130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f259c700 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ef060 0x5592089fe130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f259c700 1 -- 172.21.15.6:0/309508543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 msgr2=0x5592089f6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f259c700 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089f6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f259c700 1 -- 172.21.15.6:0/309508543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f41a1160 con 0x5592089ee700 2023-09-13T09:49:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:49:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21f259c700 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089f70f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21e40ca7b0 tx=0x7f21e409a650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa384b8022ec6772 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.111+0000 7f21d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:49:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f21d6ff5700 1 -- 172.21.15.6:0/309508543 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e4098300 con 0x5592089ee700 2023-09-13T09:49:34.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f21d6ff5700 1 -- 172.21.15.6:0/309508543 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21e40a00c0 con 0x5592089ee700 2023-09-13T09:49:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592089e0670 con 0x5592089ee700 2023-09-13T09:49:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f21d6ff5700 1 -- 172.21.15.6:0/309508543 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21e409dff0 con 0x5592089ee700 2023-09-13T09:49:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 10 client.27563 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5592089577a0 con 0x5592089ee700 2023-09-13T09:49:34.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f21d6ff5700 1 -- 172.21.15.6:0/309508543 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5592089e0670 con 0x5592089ee700 2023-09-13T09:49:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f21d6ff5700 1 -- 172.21.15.6:0/309508543 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21e4096140 con 0x5592089ee700 2023-09-13T09:49:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 10 client.27563 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 10 client.27563 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:34.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 20 client.27563 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a02440 0x559208a04830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 4 client.27563 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:49:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559208938970 con 0x559208a02440 2023-09-13T09:49:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.112+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a02440 0x559208a04830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.113+0000 7f21d6ff5700 10 client.27563 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.113+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a02440 0x559208a04830 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aeb5da818f8649a server_cookie=f66dc49fe75c8529 in_seq=0 out_seq=0 2023-09-13T09:49:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.113+0000 7f21d6ff5700 1 -- 172.21.15.6:0/309508543 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559208938970 con 0x559208a02440 2023-09-13T09:49:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.113+0000 7f21d6ff5700 10 client.27563 handle_command_reply: tid=0 2023-09-13T09:49:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 client.27563 shutdown 2023-09-13T09:49:34.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 msgr2=0x5592089f70f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089f70f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f21e40ca7b0 tx=0x7f21e409a650 comp rx=0 tx=0).stop 2023-09-13T09:49:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 shutdown_connections 2023-09-13T09:49:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ef060 0x5592089fe130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a02440 0x559208a04830 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089f6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f21d6ff5700 0 client.27563 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:34.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 --2- 172.21.15.6:0/309508543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089f70f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 >> 172.21.15.6:0/309508543 conn(0x55920894bc80 msgr2=0x5592089e27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:34.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 shutdown_connections 2023-09-13T09:49:34.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 1 -- 172.21.15.6:0/309508543 wait complete. 2023-09-13T09:49:34.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.114+0000 7f22053f1b80 20 client.27563 trim_cache size 0 max 16384 2023-09-13T09:49:34.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.131+0000 7f22053f1b80 1 Processor -- start 2023-09-13T09:49:34.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.131+0000 7f22053f1b80 1 -- start start 2023-09-13T09:49:34.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089fe0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f22053f1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592089e06a0 con 0x5592089eda00 2023-09-13T09:49:34.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f22053f1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592089f7dd0 con 0x5592089ef060 2023-09-13T09:49:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f22053f1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592089f6060 con 0x5592089ee700 2023-09-13T09:49:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ed4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40306/0 (socket says 172.21.15.6:40306) 2023-09-13T09:49:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 -- 172.21.15.6:0/3387878119 learned_addr learned my addr 172.21.15.6:0/3387878119 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:34.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f359e700 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f259c700 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089fe0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 -- 172.21.15.6:0/3387878119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 msgr2=0x5592089fe0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089fe0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 -- 172.21.15.6:0/3387878119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 msgr2=0x5592089f6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089f6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 -- 172.21.15.6:0/3387878119 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55920876bde0 con 0x5592089eda00 2023-09-13T09:49:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ed4c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009600 tx=0x7f21e8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481525f1a888dcd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21d9ffb700 1 -- 172.21.15.6:0/3387878119 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8030070 con 0x5592089eda00 2023-09-13T09:49:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21d9ffb700 1 -- 172.21.15.6:0/3387878119 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21e8023040 con 0x5592089eda00 2023-09-13T09:49:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.132+0000 7f21d9ffb700 1 -- 172.21.15.6:0/3387878119 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8022070 con 0x5592089eda00 2023-09-13T09:49:34.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 -- 172.21.15.6:0/3387878119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 msgr2=0x5592089ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ed4c0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009600 tx=0x7f21e8014000 comp rx=0 tx=0).stop 2023-09-13T09:49:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 -- 172.21.15.6:0/3387878119 shutdown_connections 2023-09-13T09:49:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ef060 0x5592089f6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089eda00 0x5592089ed4c0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3387878119 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089ee700 0x5592089fe0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 -- 172.21.15.6:0/3387878119 >> 172.21.15.6:0/3387878119 conn(0x55920894bc80 msgr2=0x5592089f18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 -- 172.21.15.6:0/3387878119 shutdown_connections 2023-09-13T09:49:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 -- 172.21.15.6:0/3387878119 wait complete. 2023-09-13T09:49:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.133+0000 7f22053f1b80 1 -- start start 2023-09-13T09:49:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 1 Processor -- start 2023-09-13T09:49:34.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089eda00 0x5592089fd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089fdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089ef060 0x5592089fa440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592089fa9c0 con 0x5592089ef060 2023-09-13T09:49:34.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592089fab30 con 0x5592089ee700 2023-09-13T09:49:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592089facf0 con 0x5592089eda00 2023-09-13T09:49:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f22053f1b80 10 client.0 _ll_register_callbacks cb 0x5592088db680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:49:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089ef060 0x5592089fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089ef060 0x5592089fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40316/0 (socket says 172.21.15.6:40316) 2023-09-13T09:49:34.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089fdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 -- 172.21.15.6:0/3526333155 learned_addr learned my addr 172.21.15.6:0/3526333155 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:49:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089eda00 0x5592089fd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 -- 172.21.15.6:0/3526333155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089eda00 msgr2=0x5592089fd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089eda00 0x5592089fd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 -- 172.21.15.6:0/3526333155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 msgr2=0x5592089fdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:49:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089fdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 -- 172.21.15.6:0/3526333155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e8017070 con 0x5592089ef060 2023-09-13T09:49:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21f359e700 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089ef060 0x5592089fa440 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007c10 tx=0x7f21ec007f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7504e7d4560e8134 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:49:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21d6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:49:34.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21d6ff5700 1 -- 172.21.15.6:0/3526333155 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec01c070 con 0x5592089ef060 2023-09-13T09:49:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.134+0000 7f21d6ff5700 1 -- 172.21.15.6:0/3526333155 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f21ec011b90 con 0x5592089ef060 2023-09-13T09:49:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21e40a21a0 con 0x5592089ef060 2023-09-13T09:49:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f21d6ff5700 1 -- 172.21.15.6:0/3526333155 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ec00e040 con 0x5592089ef060 2023-09-13T09:49:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 10 client.18171 fetch_fsmap learned FSMap version 34 2023-09-13T09:49:34.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559208754c60 con 0x5592089ef060 2023-09-13T09:49:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f21d6ff5700 1 -- 172.21.15.6:0/3526333155 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21ec02f080 con 0x5592089ef060 2023-09-13T09:49:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f21d6ff5700 1 -- 172.21.15.6:0/3526333155 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f21ec016400 con 0x5592089ef060 2023-09-13T09:49:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 10 client.18171 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:49:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 10 client.18171 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:49:34.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 20 client.18171 populate_metadata read hostname 'smithi006' 2023-09-13T09:49:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a57820 0x559208a59c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:49:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 4 client.18171 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:49:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5592088f9050 con 0x559208a57820 2023-09-13T09:49:34.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.135+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a57820 0x559208a59c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:49:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f21d6ff5700 10 client.18171 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f21f2d9d700 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a57820 0x559208a59c40 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68547db864c37418 server_cookie=3847b252f4fac205 in_seq=0 out_seq=0 2023-09-13T09:49:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f21d6ff5700 1 -- 172.21.15.6:0/3526333155 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5592088f9050 con 0x559208a57820 2023-09-13T09:49:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f21d6ff5700 10 client.18171 handle_command_reply: tid=0 2023-09-13T09:49:34.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 client.18171 shutdown 2023-09-13T09:49:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089ef060 msgr2=0x5592089fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089ef060 0x5592089fa440 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f21ec007c10 tx=0x7f21ec007f20 comp rx=0 tx=0).stop 2023-09-13T09:49:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 shutdown_connections 2023-09-13T09:49:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559208a57820 0x559208a59c40 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5592089ef060 0x5592089fa440 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f21d6ff5700 0 client.18171 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:49:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5592089eda00 0x5592089fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 --2- 172.21.15.6:0/3526333155 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5592089ee700 0x5592089fdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 >> 172.21.15.6:0/3526333155 conn(0x55920894bc80 msgr2=0x5592089f6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 shutdown_connections 2023-09-13T09:49:34.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 1 -- 172.21.15.6:0/3526333155 wait complete. 2023-09-13T09:49:34.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.136+0000 7f22053f1b80 20 client.18171 trim_cache size 0 max 16384 2023-09-13T09:49:34.168 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:49:34.168 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:49:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:49:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "7065662f-0819-4258-85f1-ec4a2ec9f0d5": { 2023-09-13T09:49:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:49:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "7065662f-0819-4258-85f1-ec4a2ec9f0d5", 2023-09-13T09:49:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:49:34.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:49:34.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:49:34.170 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:49:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21dc0a0640 msgr2=0x7f21dc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21dc0a0640 0x7f21dc0a2b00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f21f419a120 tx=0x7f21e8009260 comp rx=0 tx=0).stop 2023-09-13T09:49:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 msgr2=0x7f21f4199190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:49:34.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f4199190 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f21e4009fd0 tx=0x7f21e4009580 comp rx=0 tx=0).stop 2023-09-13T09:49:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 shutdown_connections 2023-09-13T09:49:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21f4101830 0x7f21f41a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f21f40ffca0 0x7f21f4198c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21dc0a0640 0x7f21dc0a2b00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 --2- 172.21.15.6:0/1329470664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21f4100e90 0x7f21f4199190 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:49:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 >> 172.21.15.6:0/1329470664 conn(0x7f21f40fb1f0 msgr2=0x7f21f40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:49:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 shutdown_connections 2023-09-13T09:49:34.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:49:34.137+0000 7f21f920c700 1 -- 172.21.15.6:0/1329470664 wait complete. 2023-09-13T09:49:34.175 INFO:tasks.cephfs.filesystem:scrub status for tag:7065662f-0819-4258-85f1-ec4a2ec9f0d5 - {'path': '/', 'tag': '7065662f-0819-4258-85f1-ec4a2ec9f0d5', 'options': 'recursive,force'} 2023-09-13T09:49:34.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 565166 6.19 MB/sec execute 414 sec latency 75.744 ms 2023-09-13T09:49:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:34 smithi006 ceph-mon[98665]: pgmap v601: 97 pgs: 97 active+clean; 225 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.3 MiB/s wr, 274 op/s 2023-09-13T09:49:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:34 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:34 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:34 smithi053 ceph-mon[102373]: pgmap v601: 97 pgs: 97 active+clean; 225 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.3 MiB/s wr, 274 op/s 2023-09-13T09:49:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:34 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:34 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:34 smithi131 ceph-mon[102785]: pgmap v601: 97 pgs: 97 active+clean; 225 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.3 MiB/s wr, 274 op/s 2023-09-13T09:49:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:34 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:34 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 566994 6.19 MB/sec execute 415 sec latency 28.891 ms 2023-09-13T09:49:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:49:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:49:35.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:49:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:49:35.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:49:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:49:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:49:36.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 568653 6.21 MB/sec execute 416 sec latency 20.772 ms 2023-09-13T09:49:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:36 smithi006 ceph-mon[98665]: pgmap v602: 97 pgs: 97 active+clean; 227 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 2.4 MiB/s wr, 276 op/s 2023-09-13T09:49:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:36 smithi053 ceph-mon[102373]: pgmap v602: 97 pgs: 97 active+clean; 227 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 2.4 MiB/s wr, 276 op/s 2023-09-13T09:49:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:36 smithi131 ceph-mon[102785]: pgmap v602: 97 pgs: 97 active+clean; 227 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 2.4 MiB/s wr, 276 op/s 2023-09-13T09:49:37.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 570012 6.21 MB/sec execute 417 sec latency 13.183 ms 2023-09-13T09:49:38.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 572120 6.22 MB/sec execute 418 sec latency 13.920 ms 2023-09-13T09:49:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:38 smithi006 ceph-mon[98665]: pgmap v603: 97 pgs: 97 active+clean; 228 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 2.4 MiB/s wr, 272 op/s 2023-09-13T09:49:38.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:38 smithi053 ceph-mon[102373]: pgmap v603: 97 pgs: 97 active+clean; 228 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 2.4 MiB/s wr, 272 op/s 2023-09-13T09:49:38.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:38 smithi131 ceph-mon[102785]: pgmap v603: 97 pgs: 97 active+clean; 228 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 806 KiB/s rd, 2.4 MiB/s wr, 272 op/s 2023-09-13T09:49:39.177 INFO:tasks.workunit.client.0.smithi006.stdout: 1 573127 6.22 MB/sec execute 419 sec latency 45.855 ms 2023-09-13T09:49:40.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 575168 6.23 MB/sec execute 420 sec latency 48.601 ms 2023-09-13T09:49:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:40 smithi006 ceph-mon[98665]: pgmap v604: 97 pgs: 97 active+clean; 229 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.2 MiB/s wr, 239 op/s 2023-09-13T09:49:40.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:40 smithi053 ceph-mon[102373]: pgmap v604: 97 pgs: 97 active+clean; 229 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.2 MiB/s wr, 239 op/s 2023-09-13T09:49:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:40 smithi131 ceph-mon[102785]: pgmap v604: 97 pgs: 97 active+clean; 229 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 825 KiB/s rd, 2.2 MiB/s wr, 239 op/s 2023-09-13T09:49:41.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 576144 6.23 MB/sec execute 421 sec latency 24.895 ms 2023-09-13T09:49:42.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 578355 6.24 MB/sec execute 422 sec latency 11.302 ms 2023-09-13T09:49:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:42 smithi006 ceph-mon[98665]: pgmap v605: 97 pgs: 97 active+clean; 229 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-13T09:49:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:42 smithi053 ceph-mon[102373]: pgmap v605: 97 pgs: 97 active+clean; 229 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-13T09:49:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:42 smithi131 ceph-mon[102785]: pgmap v605: 97 pgs: 97 active+clean; 229 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.2 MiB/s wr, 227 op/s 2023-09-13T09:49:43.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 579420 6.24 MB/sec execute 423 sec latency 46.224 ms 2023-09-13T09:49:44.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 581366 6.24 MB/sec execute 424 sec latency 32.882 ms 2023-09-13T09:49:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:44 smithi006 ceph-mon[98665]: pgmap v606: 97 pgs: 97 active+clean; 231 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-13T09:49:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:44 smithi053 ceph-mon[102373]: pgmap v606: 97 pgs: 97 active+clean; 231 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-13T09:49:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:44 smithi131 ceph-mon[102785]: pgmap v606: 97 pgs: 97 active+clean; 231 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 842 KiB/s rd, 2.6 MiB/s wr, 276 op/s 2023-09-13T09:49:45.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 582801 6.26 MB/sec execute 425 sec latency 17.732 ms 2023-09-13T09:49:45.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:45.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:45.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:45.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:45.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:49:45.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:45 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:45.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:45 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:45.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:45 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:45.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:45 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:45.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:45 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:49:45.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:45 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:45.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:45 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:45.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:45 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:45.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:45 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:45.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:45 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:49:46.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 583758 6.25 MB/sec execute 426 sec latency 54.004 ms 2023-09-13T09:49:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:46 smithi006 ceph-mon[98665]: pgmap v607: 97 pgs: 97 active+clean; 232 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:49:46.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:46 smithi053 ceph-mon[102373]: pgmap v607: 97 pgs: 97 active+clean; 232 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:49:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:46 smithi131 ceph-mon[102785]: pgmap v607: 97 pgs: 97 active+clean; 232 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 803 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:49:47.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 586070 6.27 MB/sec execute 427 sec latency 14.956 ms 2023-09-13T09:49:48.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 586974 6.26 MB/sec execute 428 sec latency 13.790 ms 2023-09-13T09:49:48.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:48 smithi053 ceph-mon[102373]: pgmap v608: 97 pgs: 97 active+clean; 234 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-09-13T09:49:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:48 smithi006 ceph-mon[98665]: pgmap v608: 97 pgs: 97 active+clean; 234 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-09-13T09:49:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:48 smithi131 ceph-mon[102785]: pgmap v608: 97 pgs: 97 active+clean; 234 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 790 KiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-09-13T09:49:49.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 589001 6.27 MB/sec execute 429 sec latency 35.203 ms 2023-09-13T09:49:50.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 590075 6.27 MB/sec execute 430 sec latency 20.596 ms 2023-09-13T09:49:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:50 smithi006 ceph-mon[98665]: pgmap v609: 97 pgs: 97 active+clean; 235 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.1 MiB/s wr, 229 op/s 2023-09-13T09:49:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:50 smithi053 ceph-mon[102373]: pgmap v609: 97 pgs: 97 active+clean; 235 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.1 MiB/s wr, 229 op/s 2023-09-13T09:49:50.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:50 smithi131 ceph-mon[102785]: pgmap v609: 97 pgs: 97 active+clean; 235 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 722 KiB/s rd, 2.1 MiB/s wr, 229 op/s 2023-09-13T09:49:51.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 592052 6.28 MB/sec execute 431 sec latency 19.990 ms 2023-09-13T09:49:52.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 593477 6.29 MB/sec execute 432 sec latency 19.180 ms 2023-09-13T09:49:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:52 smithi006 ceph-mon[98665]: pgmap v610: 97 pgs: 97 active+clean; 234 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 2.2 MiB/s wr, 225 op/s 2023-09-13T09:49:52.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:52 smithi053 ceph-mon[102373]: pgmap v610: 97 pgs: 97 active+clean; 234 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 2.2 MiB/s wr, 225 op/s 2023-09-13T09:49:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:52 smithi131 ceph-mon[102785]: pgmap v610: 97 pgs: 97 active+clean; 234 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 2.2 MiB/s wr, 225 op/s 2023-09-13T09:49:53.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 594773 6.29 MB/sec execute 433 sec latency 13.118 ms 2023-09-13T09:49:54.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 596855 6.30 MB/sec execute 434 sec latency 42.977 ms 2023-09-13T09:49:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:54 smithi006 ceph-mon[98665]: pgmap v611: 97 pgs: 97 active+clean; 236 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 2.4 MiB/s wr, 280 op/s 2023-09-13T09:49:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:54 smithi053 ceph-mon[102373]: pgmap v611: 97 pgs: 97 active+clean; 236 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 2.4 MiB/s wr, 280 op/s 2023-09-13T09:49:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:54 smithi131 ceph-mon[102785]: pgmap v611: 97 pgs: 97 active+clean; 236 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 802 KiB/s rd, 2.4 MiB/s wr, 280 op/s 2023-09-13T09:49:55.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 597692 6.29 MB/sec execute 435 sec latency 28.410 ms 2023-09-13T09:49:56.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 599899 6.31 MB/sec execute 436 sec latency 22.732 ms 2023-09-13T09:49:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:56 smithi006 ceph-mon[98665]: pgmap v612: 97 pgs: 97 active+clean; 237 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:49:56.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:56 smithi053 ceph-mon[102373]: pgmap v612: 97 pgs: 97 active+clean; 237 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:49:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:56 smithi131 ceph-mon[102785]: pgmap v612: 97 pgs: 97 active+clean; 237 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 2.4 MiB/s wr, 252 op/s 2023-09-13T09:49:57.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 600852 6.30 MB/sec execute 437 sec latency 16.671 ms 2023-09-13T09:49:58.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 602850 6.31 MB/sec execute 438 sec latency 15.892 ms 2023-09-13T09:49:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:49:58 smithi006 ceph-mon[98665]: pgmap v613: 97 pgs: 97 active+clean; 238 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 2.4 MiB/s wr, 281 op/s 2023-09-13T09:49:58.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:49:58 smithi053 ceph-mon[102373]: pgmap v613: 97 pgs: 97 active+clean; 238 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 2.4 MiB/s wr, 281 op/s 2023-09-13T09:49:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:49:58 smithi131 ceph-mon[102785]: pgmap v613: 97 pgs: 97 active+clean; 238 MiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 2.4 MiB/s wr, 281 op/s 2023-09-13T09:49:59.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 604209 6.32 MB/sec execute 439 sec latency 63.334 ms 2023-09-13T09:50:00.178 INFO:tasks.workunit.client.0.smithi006.stdout: 1 606182 6.32 MB/sec execute 440 sec latency 69.769 ms 2023-09-13T09:50:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:00 smithi006 ceph-mon[98665]: pgmap v614: 97 pgs: 97 active+clean; 239 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.1 MiB/s wr, 235 op/s 2023-09-13T09:50:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:00 smithi006 ceph-mon[98665]: overall HEALTH_OK 2023-09-13T09:50:00.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:00 smithi053 ceph-mon[102373]: pgmap v614: 97 pgs: 97 active+clean; 239 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.1 MiB/s wr, 235 op/s 2023-09-13T09:50:00.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:00 smithi053 ceph-mon[102373]: overall HEALTH_OK 2023-09-13T09:50:00.518 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:00 smithi131 ceph-mon[102785]: pgmap v614: 97 pgs: 97 active+clean; 239 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.1 MiB/s wr, 235 op/s 2023-09-13T09:50:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:00 smithi131 ceph-mon[102785]: overall HEALTH_OK 2023-09-13T09:50:01.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 607653 6.33 MB/sec execute 441 sec latency 15.017 ms 2023-09-13T09:50:02.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 608925 6.33 MB/sec execute 442 sec latency 55.787 ms 2023-09-13T09:50:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:02 smithi006 ceph-mon[98665]: pgmap v615: 97 pgs: 97 active+clean; 239 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 2.1 MiB/s wr, 236 op/s 2023-09-13T09:50:02.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:02 smithi053 ceph-mon[102373]: pgmap v615: 97 pgs: 97 active+clean; 239 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 2.1 MiB/s wr, 236 op/s 2023-09-13T09:50:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:02 smithi131 ceph-mon[102785]: pgmap v615: 97 pgs: 97 active+clean; 239 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 692 KiB/s rd, 2.1 MiB/s wr, 236 op/s 2023-09-13T09:50:03.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 611051 6.35 MB/sec execute 443 sec latency 15.592 ms 2023-09-13T09:50:04.176 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:50:04.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 612081 6.34 MB/sec execute 444 sec latency 18.522 ms 2023-09-13T09:50:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 -- 172.21.15.6:0/1727902126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c100eb0 msgr2=0x7f8a7c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/1727902126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c100eb0 0x7f8a7c101310 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0099c0 tx=0x7f8a6c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 -- 172.21.15.6:0/1727902126 shutdown_connections 2023-09-13T09:50:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/1727902126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a7c101850 0x7f8a7c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/1727902126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a7c0ffcc0 0x7f8a7c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/1727902126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c100eb0 0x7f8a7c101310 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 -- 172.21.15.6:0/1727902126 >> 172.21.15.6:0/1727902126 conn(0x7f8a7c0fb250 msgr2=0x7f8a7c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 -- 172.21.15.6:0/1727902126 shutdown_connections 2023-09-13T09:50:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.324+0000 7f8a81aeb700 1 -- 172.21.15.6:0/1727902126 wait complete. 2023-09-13T09:50:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 Processor -- start 2023-09-13T09:50:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 -- start start 2023-09-13T09:50:04.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a7c0ffcc0 0x7f8a7c068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a7c100eb0 0x7f8a7c19b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c101850 0x7f8a7c19ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c19e580 con 0x7f8a7c101850 2023-09-13T09:50:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c19e6f0 con 0x7f8a7c0ffcc0 2023-09-13T09:50:04.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a81aeb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a7c19e8b0 con 0x7f8a7c100eb0 2023-09-13T09:50:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c101850 0x7f8a7c19ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c101850 0x7f8a7c19ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40330/0 (socket says 172.21.15.6:40330) 2023-09-13T09:50:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a7c0ffcc0 0x7f8a7c068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 -- 172.21.15.6:0/2274697122 learned_addr learned my addr 172.21.15.6:0/2274697122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7affd700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a7c100eb0 0x7f8a7c19b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 -- 172.21.15.6:0/2274697122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a7c100eb0 msgr2=0x7f8a7c19b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a7c100eb0 0x7f8a7c19b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 -- 172.21.15.6:0/2274697122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a7c0ffcc0 msgr2=0x7f8a7c068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a7c0ffcc0 0x7f8a7c068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.325+0000 7f8a7bfff700 1 -- 172.21.15.6:0/2274697122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a6c0095f0 con 0x7f8a7c101850 2023-09-13T09:50:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.326+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c101850 0x7f8a7c19ddb0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400ef30 tx=0x7f8a7400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.326+0000 7f8a78ff9700 1 -- 172.21.15.6:0/2274697122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74018070 con 0x7f8a7c101850 2023-09-13T09:50:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.326+0000 7f8a78ff9700 1 -- 172.21.15.6:0/2274697122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a7400f040 con 0x7f8a7c101850 2023-09-13T09:50:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.326+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a7c19eb30 con 0x7f8a7c101850 2023-09-13T09:50:04.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.326+0000 7f8a78ff9700 1 -- 172.21.15.6:0/2274697122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a7400cdb0 con 0x7f8a7c101850 2023-09-13T09:50:04.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.326+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c19f010 con 0x7f8a7c101850 2023-09-13T09:50:04.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.328+0000 7f8a78ff9700 1 -- 172.21.15.6:0/2274697122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8a74003a00 con 0x7f8a7c101850 2023-09-13T09:50:04.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.329+0000 7f8a78ff9700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a680a06c0 0x7f8a680a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.329+0000 7f8a78ff9700 1 -- 172.21.15.6:0/2274697122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a740cb840 con 0x7f8a7c101850 2023-09-13T09:50:04.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.329+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a680a06c0 0x7f8a680a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a680a06c0 0x7f8a680a2b80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c100d10 tx=0x7f8a64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 Processor -- start 2023-09-13T09:50:04.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 -- start start 2023-09-13T09:50:04.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4deb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4df060 0x5648ab4dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4dda00 0x5648ab4dde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab436780 con 0x5648ab4df060 2023-09-13T09:50:04.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab4340a0 con 0x5648ab4de700 2023-09-13T09:50:04.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab42f990 con 0x5648ab4dda00 2023-09-13T09:50:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4df060 0x5648ab4dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4df060 0x5648ab4dd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40336/0 (socket says 172.21.15.6:40336) 2023-09-13T09:50:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7affd700 1 -- 172.21.15.6:0/1929848432 learned_addr learned my addr 172.21.15.6:0/1929848432 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4dda00 0x5648ab4dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7affd700 1 -- 172.21.15.6:0/1929848432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4dda00 msgr2=0x5648ab4dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.330+0000 7f8a7affd700 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4dda00 0x5648ab4dde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a7affd700 1 -- 172.21.15.6:0/1929848432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 msgr2=0x5648ab4deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a7affd700 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4deb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a7affd700 1 -- 172.21.15.6:0/1929848432 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648ab2af630 con 0x5648ab4df060 2023-09-13T09:50:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a7affd700 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4df060 0x5648ab4dd4c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0058e0 tx=0x7f8a6c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7d55ba691b0060 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a71ffb700 1 -- 172.21.15.6:0/1929848432 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c01d040 con 0x5648ab4df060 2023-09-13T09:50:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a71ffb700 1 -- 172.21.15.6:0/1929848432 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a6c00b790 con 0x5648ab4df060 2023-09-13T09:50:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.331+0000 7f8a71ffb700 1 -- 172.21.15.6:0/1929848432 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c003aa0 con 0x5648ab4df060 2023-09-13T09:50:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1929848432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4df060 msgr2=0x5648ab4dd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4df060 0x5648ab4dd4c0 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c0058e0 tx=0x7f8a6c005e80 comp rx=0 tx=0).stop 2023-09-13T09:50:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1929848432 shutdown_connections 2023-09-13T09:50:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4dda00 0x5648ab4dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1929848432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4df060 0x5648ab4dd4c0 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1929848432 >> 172.21.15.6:0/1929848432 conn(0x5648ab43bc80 msgr2=0x5648ab4d7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1929848432 shutdown_connections 2023-09-13T09:50:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1929848432 wait complete. 2023-09-13T09:50:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 -- start start 2023-09-13T09:50:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 Processor -- start 2023-09-13T09:50:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4dda00 0x5648ab4e6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4de700 0x5648ab4e7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ee480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.332+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab3cdbb0 con 0x5648ab4de700 2023-09-13T09:50:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab3cd8b0 con 0x5648ab4dda00 2023-09-13T09:50:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab2b1920 con 0x5648ab4df060 2023-09-13T09:50:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a8dcd0b80 10 client.0 _ll_register_callbacks cb 0x5648ab3cb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4de700 0x5648ab4e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4dda00 0x5648ab4e6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4de700 0x5648ab4e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40342/0 (socket says 172.21.15.6:40342) 2023-09-13T09:50:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 -- 172.21.15.6:0/3638769272 learned_addr learned my addr 172.21.15.6:0/3638769272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ee480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 -- 172.21.15.6:0/3638769272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 msgr2=0x5648ab4ee480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ee480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 -- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4dda00 msgr2=0x5648ab4e6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4dda00 0x5648ab4e6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 -- 172.21.15.6:0/3638769272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a7c108a50 con 0x5648ab4de700 2023-09-13T09:50:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4dda00 0x5648ab4e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a7affd700 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4de700 0x5648ab4e7440 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c025040 tx=0x7f8a6c00bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced610c05476bdcc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a5affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a5affd700 1 -- 172.21.15.6:0/3638769272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a6c01d070 con 0x5648ab4de700 2023-09-13T09:50:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a5affd700 1 -- 172.21.15.6:0/3638769272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a6c0054e0 con 0x5648ab4de700 2023-09-13T09:50:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5648ab4d0670 con 0x5648ab4de700 2023-09-13T09:50:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a5affd700 1 -- 172.21.15.6:0/3638769272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a6c003840 con 0x5648ab4de700 2023-09-13T09:50:04.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a8dcd0b80 10 client.18183 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.333+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5648ab4477a0 con 0x5648ab4de700 2023-09-13T09:50:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a5affd700 1 -- 172.21.15.6:0/3638769272 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a6c03c080 con 0x5648ab4de700 2023-09-13T09:50:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a5affd700 1 -- 172.21.15.6:0/3638769272 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a6c00fa60 con 0x5648ab4de700 2023-09-13T09:50:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a8dcd0b80 10 client.18183 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:04.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a8dcd0b80 10 client.18183 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a8dcd0b80 20 client.18183 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab4f2790 0x5648ab4f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a8dcd0b80 4 client.18183 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5648ab428970 con 0x5648ab4f2790 2023-09-13T09:50:04.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab4f2790 0x5648ab4f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a5affd700 10 client.18183 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.334+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab4f2790 0x5648ab4f4b80 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=111a588eecef1988 server_cookie=452921718a020cd9 in_seq=0 out_seq=0 2023-09-13T09:50:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a5affd700 1 -- 172.21.15.6:0/3638769272 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5648ab428970 con 0x5648ab4f2790 2023-09-13T09:50:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a5affd700 10 client.18183 handle_command_reply: tid=0 2023-09-13T09:50:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 client.18183 shutdown 2023-09-13T09:50:04.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4de700 msgr2=0x5648ab4e7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4de700 0x5648ab4e7440 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8a6c025040 tx=0x7f8a6c00bcf0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 shutdown_connections 2023-09-13T09:50:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ee480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4dda00 0x5648ab4e6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab4f2790 0x5648ab4f4b80 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3638769272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4de700 0x5648ab4e7440 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a5affd700 0 client.18183 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 >> 172.21.15.6:0/3638769272 conn(0x5648ab43bc80 msgr2=0x5648ab4d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 shutdown_connections 2023-09-13T09:50:04.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.335+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3638769272 wait complete. 2023-09-13T09:50:04.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.336+0000 7f8a8dcd0b80 20 client.18183 trim_cache size 0 max 16384 2023-09-13T09:50:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 Processor -- start 2023-09-13T09:50:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 -- start start 2023-09-13T09:50:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ee440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab4e6a70 con 0x5648ab4dda00 2023-09-13T09:50:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab4e4bc0 con 0x5648ab4de700 2023-09-13T09:50:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab4f2530 con 0x5648ab4df060 2023-09-13T09:50:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a7affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ee440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4dd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40348/0 (socket says 172.21.15.6:40348) 2023-09-13T09:50:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/3927461263 learned_addr learned my addr 172.21.15.6:0/3927461263 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.353+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/3927461263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 msgr2=0x5648ab4e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/3927461263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 msgr2=0x5648ab4ee440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ee440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/3927461263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648ab25bde0 con 0x5648ab4dda00 2023-09-13T09:50:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a7affd700 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4dd4c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x5648ab4f5460 tx=0x7f8a64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=951b10ee737f54ee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a727fc700 1 -- 172.21.15.6:0/3927461263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64022040 con 0x5648ab4dda00 2023-09-13T09:50:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a727fc700 1 -- 172.21.15.6:0/3927461263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a64023040 con 0x5648ab4dda00 2023-09-13T09:50:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.354+0000 7f8a727fc700 1 -- 172.21.15.6:0/3927461263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64011ea0 con 0x5648ab4dda00 2023-09-13T09:50:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3927461263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 msgr2=0x5648ab4dd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4dd4c0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x5648ab4f5460 tx=0x7f8a64014000 comp rx=0 tx=0).stop 2023-09-13T09:50:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3927461263 shutdown_connections 2023-09-13T09:50:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4dd4c0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/3927461263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ee440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3927461263 >> 172.21.15.6:0/3927461263 conn(0x5648ab43bc80 msgr2=0x5648ab4e5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3927461263 shutdown_connections 2023-09-13T09:50:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/3927461263 wait complete. 2023-09-13T09:50:04.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- start start 2023-09-13T09:50:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 Processor -- start 2023-09-13T09:50:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4ea3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ea930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ed950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab4ede90 con 0x5648ab4dda00 2023-09-13T09:50:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab4ee000 con 0x5648ab4de700 2023-09-13T09:50:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.355+0000 7f8a8dcd0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648ab4ee1c0 con 0x5648ab4df060 2023-09-13T09:50:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a8dcd0b80 10 client.0 _ll_register_callbacks cb 0x5648ab3cb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4ea3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4ea3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40354/0 (socket says 172.21.15.6:40354) 2023-09-13T09:50:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/1607155033 learned_addr learned my addr 172.21.15.6:0/1607155033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7affd700 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ea930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7bfff700 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ed950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/1607155033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 msgr2=0x5648ab4ed950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ed950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 msgr2=0x5648ab4ea930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ea930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 -- 172.21.15.6:0/1607155033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648ab4477a0 con 0x5648ab4dda00 2023-09-13T09:50:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a7b7fe700 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4ea3f0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009ac0 tx=0x7f8a6402b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7e538de945fa959 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a5affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a5affd700 1 -- 172.21.15.6:0/1607155033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a64011ea0 con 0x5648ab4dda00 2023-09-13T09:50:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a5affd700 1 -- 172.21.15.6:0/1607155033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a64005240 con 0x5648ab4dda00 2023-09-13T09:50:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a6c00b790 con 0x5648ab4dda00 2023-09-13T09:50:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a5affd700 1 -- 172.21.15.6:0/1607155033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a64005400 con 0x5648ab4dda00 2023-09-13T09:50:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a8dcd0b80 10 client.18189 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:04.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.356+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f8a6401d6e0 con 0x5648ab4dda00 2023-09-13T09:50:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a5affd700 1 -- 172.21.15.6:0/1607155033 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a6c00b790 con 0x5648ab4dda00 2023-09-13T09:50:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a5affd700 1 -- 172.21.15.6:0/1607155033 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a64031030 con 0x5648ab4dda00 2023-09-13T09:50:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a8dcd0b80 10 client.18189 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a8dcd0b80 10 client.18189 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:04.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a8dcd0b80 20 client.18189 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab547700 0x5648ab549b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a8dcd0b80 4 client.18189 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:50:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5648ab3e9050 con 0x5648ab547700 2023-09-13T09:50:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a7affd700 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab547700 0x5648ab549b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a5affd700 10 client.18189 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.357+0000 7f8a7affd700 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab547700 0x5648ab549b20 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8013f034b9b09b98 server_cookie=b0298c2baebf88f6 in_seq=0 out_seq=0 2023-09-13T09:50:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a5affd700 1 -- 172.21.15.6:0/1607155033 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5648ab3e9050 con 0x5648ab547700 2023-09-13T09:50:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a5affd700 10 client.18189 handle_command_reply: tid=0 2023-09-13T09:50:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 client.18189 shutdown 2023-09-13T09:50:04.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 msgr2=0x5648ab4ea3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4ea3f0 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f8a64009ac0 tx=0x7f8a6402b5d0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 shutdown_connections 2023-09-13T09:50:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5648ab4df060 0x5648ab4ed950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5648ab547700 0x5648ab549b20 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5648ab4dda00 0x5648ab4ea3f0 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 --2- 172.21.15.6:0/1607155033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5648ab4de700 0x5648ab4ea930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a5affd700 0 client.18189 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 >> 172.21.15.6:0/1607155033 conn(0x5648ab43bc80 msgr2=0x5648ab4e1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 shutdown_connections 2023-09-13T09:50:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 1 -- 172.21.15.6:0/1607155033 wait complete. 2023-09-13T09:50:04.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a8dcd0b80 20 client.18189 trim_cache size 0 max 16384 2023-09-13T09:50:04.382 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:50:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:50:04.383 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:50:04.383 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:50:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a680a06c0 msgr2=0x7f8a680a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a680a06c0 0x7f8a680a2b80 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c100d10 tx=0x7f8a64009260 comp rx=0 tx=0).stop 2023-09-13T09:50:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c101850 msgr2=0x7f8a7c19ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.358+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c101850 0x7f8a7c19ddb0 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f8a7400ef30 tx=0x7f8a7400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 shutdown_connections 2023-09-13T09:50:04.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a680a06c0 0x7f8a680a2b80 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a7c101850 0x7f8a7c19ddb0 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a7c0ffcc0 0x7f8a7c068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 --2- 172.21.15.6:0/2274697122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a7c100eb0 0x7f8a7c19b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 >> 172.21.15.6:0/2274697122 conn(0x7f8a7c0fb250 msgr2=0x7f8a7c0fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 shutdown_connections 2023-09-13T09:50:04.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.359+0000 7f8a81aeb700 1 -- 172.21.15.6:0/2274697122 wait complete. 2023-09-13T09:50:04.386 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:04 smithi006 ceph-mon[98665]: pgmap v616: 97 pgs: 97 active+clean; 240 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.4 MiB/s wr, 272 op/s 2023-09-13T09:50:04.387 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:50:04.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:50:04.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:04 smithi053 ceph-mon[102373]: pgmap v616: 97 pgs: 97 active+clean; 240 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.4 MiB/s wr, 272 op/s 2023-09-13T09:50:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:04 smithi131 ceph-mon[102785]: pgmap v616: 97 pgs: 97 active+clean; 240 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.4 MiB/s wr, 272 op/s 2023-09-13T09:50:04.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 -- 172.21.15.6:0/2713831174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074102940 msgr2=0x7f40741091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 --2- 172.21.15.6:0/2713831174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074102940 0x7f40741091f0 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7f406c00b0d0 tx=0x7f406c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 -- 172.21.15.6:0/2713831174 shutdown_connections 2023-09-13T09:50:04.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 --2- 172.21.15.6:0/2713831174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074102940 0x7f40741091f0 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 --2- 172.21.15.6:0/2713831174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074100db0 0x7f40741011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 --2- 172.21.15.6:0/2713831174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4074101fa0 0x7f4074102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 -- 172.21.15.6:0/2713831174 >> 172.21.15.6:0/2713831174 conn(0x7f40740fc320 msgr2=0x7f40740fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 -- 172.21.15.6:0/2713831174 shutdown_connections 2023-09-13T09:50:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 -- 172.21.15.6:0/2713831174 wait complete. 2023-09-13T09:50:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.525+0000 7f4079c7a700 1 Processor -- start 2023-09-13T09:50:04.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4079c7a700 1 -- start start 2023-09-13T09:50:04.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4079c7a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4074100db0 0x7f4074196bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4079c7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074101fa0 0x7f4074197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4079c7a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074102940 0x7f407419e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4079c7a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407419e750 con 0x7f4074101fa0 2023-09-13T09:50:04.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4079c7a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407419e890 con 0x7f4074102940 2023-09-13T09:50:04.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4079c7a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f407419ea20 con 0x7f4074100db0 2023-09-13T09:50:04.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4072ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074101fa0 0x7f4074197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074102940 0x7f407419e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074102940 0x7f407419e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33896/0 (socket says 172.21.15.6:33896) 2023-09-13T09:50:04.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4072ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074101fa0 0x7f4074197110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40370/0 (socket says 172.21.15.6:40370) 2023-09-13T09:50:04.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 -- 172.21.15.6:0/743843913 learned_addr learned my addr 172.21.15.6:0/743843913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f40737fe700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4074100db0 0x7f4074196bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 -- 172.21.15.6:0/743843913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4074100db0 msgr2=0x7f4074196bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4074100db0 0x7f4074196bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 -- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074101fa0 msgr2=0x7f4074197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074101fa0 0x7f4074197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 -- 172.21.15.6:0/743843913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f406c009d00 con 0x7f4074102940 2023-09-13T09:50:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f40737fe700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4074100db0 0x7f4074196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:50:04.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4072ffd700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074101fa0 0x7f4074197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.526+0000 7f4073fff700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074102940 0x7f407419e180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f406c008eb0 tx=0x7f406c008ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.527+0000 7f4070ff9700 1 -- 172.21.15.6:0/743843913 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00e040 con 0x7f4074102940 2023-09-13T09:50:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.527+0000 7f4070ff9700 1 -- 172.21.15.6:0/743843913 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f406c00be30 con 0x7f4074102940 2023-09-13T09:50:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.527+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f407419eca0 con 0x7f4074102940 2023-09-13T09:50:04.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.527+0000 7f4070ff9700 1 -- 172.21.15.6:0/743843913 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c01d470 con 0x7f4074102940 2023-09-13T09:50:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.527+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407419f0d0 con 0x7f4074102940 2023-09-13T09:50:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.528+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f407410c620 con 0x7f4074102940 2023-09-13T09:50:04.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.529+0000 7f4070ff9700 1 -- 172.21.15.6:0/743843913 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f406c005190 con 0x7f4074102940 2023-09-13T09:50:04.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.529+0000 7f4070ff9700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40600a0640 0x7f40600a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.530+0000 7f4070ff9700 1 -- 172.21.15.6:0/743843913 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f406c0ccea0 con 0x7f4074102940 2023-09-13T09:50:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.530+0000 7f40737fe700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40600a0640 0x7f40600a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.530+0000 7f40737fe700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40600a0640 0x7f40600a2b00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4074101e00 tx=0x7f405c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.536+0000 7f4070ff9700 1 -- 172.21.15.6:0/743843913 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f406c096a10 con 0x7f4074102940 2023-09-13T09:50:04.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.795+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4074107c40 con 0x7f4074102940 2023-09-13T09:50:04.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.795+0000 7f4070ff9700 1 -- 172.21.15.6:0/743843913 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f406c09a030 con 0x7f4074102940 2023-09-13T09:50:04.797 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:50:04.798 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:50:04.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40600a0640 msgr2=0x7f40600a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40600a0640 0x7f40600a2b00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4074101e00 tx=0x7f405c009260 comp rx=0 tx=0).stop 2023-09-13T09:50:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074102940 msgr2=0x7f407419e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074102940 0x7f407419e180 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f406c008eb0 tx=0x7f406c008ee0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 shutdown_connections 2023-09-13T09:50:04.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4074102940 0x7f407419e180 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4074100db0 0x7f4074196bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40600a0640 0x7f40600a2b00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 --2- 172.21.15.6:0/743843913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4074101fa0 0x7f4074197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 >> 172.21.15.6:0/743843913 conn(0x7f40740fc320 msgr2=0x7f40740fe510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 shutdown_connections 2023-09-13T09:50:04.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.798+0000 7f4079c7a700 1 -- 172.21.15.6:0/743843913 wait complete. 2023-09-13T09:50:04.802 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:50:04.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:50:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 -- 172.21.15.6:0/734233165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c100ba0 msgr2=0x7fa55c101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 --2- 172.21.15.6:0/734233165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c100ba0 0x7fa55c101000 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fa5440099c0 tx=0x7fa544009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 -- 172.21.15.6:0/734233165 shutdown_connections 2023-09-13T09:50:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 --2- 172.21.15.6:0/734233165 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c101540 0x7fa55c107df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 --2- 172.21.15.6:0/734233165 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa55c0ff9b0 0x7fa55c0ffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 --2- 172.21.15.6:0/734233165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c100ba0 0x7fa55c101000 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 -- 172.21.15.6:0/734233165 >> 172.21.15.6:0/734233165 conn(0x7fa55c0faf20 msgr2=0x7fa55c0fd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 -- 172.21.15.6:0/734233165 shutdown_connections 2023-09-13T09:50:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.942+0000 7fa561802700 1 -- 172.21.15.6:0/734233165 wait complete. 2023-09-13T09:50:04.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 Processor -- start 2023-09-13T09:50:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 -- start start 2023-09-13T09:50:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0ff9b0 0x7fa55c1967f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa55c100ba0 0x7fa55c196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c101540 0x7fa55c19dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c19e370 con 0x7fa55c101540 2023-09-13T09:50:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c19e4b0 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.943+0000 7fa561802700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c19e640 con 0x7fa55c100ba0 2023-09-13T09:50:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0ff9b0 0x7fa55c1967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c101540 0x7fa55c19dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa55c100ba0 0x7fa55c196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0ff9b0 0x7fa55c1967f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33906/0 (socket says 172.21.15.6:33906) 2023-09-13T09:50:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 -- 172.21.15.6:0/3018623478 learned_addr learned my addr 172.21.15.6:0/3018623478 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 -- 172.21.15.6:0/3018623478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa55c100ba0 msgr2=0x7fa55c196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa55c100ba0 0x7fa55c196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 -- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c101540 msgr2=0x7fa55c19dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c101540 0x7fa55c19dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 -- 172.21.15.6:0/3018623478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5440095f0 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55b7fe700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c101540 0x7fa55c19dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa55affd700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0ff9b0 0x7fa55c1967f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e950 tx=0x7fa54c00ec60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa560800700 1 -- 172.21.15.6:0/3018623478 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c009770 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa560800700 1 -- 172.21.15.6:0/3018623478 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa54c00c7e0 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c19e920 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa560800700 1 -- 172.21.15.6:0/3018623478 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c003cf0 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.944+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c19ede0 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.946+0000 7fa560800700 1 -- 172.21.15.6:0/3018623478 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa54c00c950 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.947+0000 7fa560800700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5480a0640 0x7fa5480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.948+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5480a0640 0x7fa5480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.948+0000 7fa560800700 1 -- 172.21.15.6:0/3018623478 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa54c014070 con 0x7fa55c0ff9b0 2023-09-13T09:50:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.948+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5480a0640 0x7fa5480a2b00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b580 tx=0x7fa544005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.948+0000 7fa56d9e7b80 1 Processor -- start 2023-09-13T09:50:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.948+0000 7fa56d9e7b80 1 -- start start 2023-09-13T09:50:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.948+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a65e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.948+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a65ee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a665bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a5b2780 con 0x56198a65dbf0 2023-09-13T09:50:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a5b00a0 con 0x56198a65e9a0 2023-09-13T09:50:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a5ab990 con 0x56198a65f360 2023-09-13T09:50:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a65e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a65e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40390/0 (socket says 172.21.15.6:40390) 2023-09-13T09:50:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 -- 172.21.15.6:0/2566269366 learned_addr learned my addr 172.21.15.6:0/2566269366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a65ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55b7fe700 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a665bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 -- 172.21.15.6:0/2566269366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 msgr2=0x56198a665bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a665bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 -- 172.21.15.6:0/2566269366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 msgr2=0x56198a65ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a65ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 -- 172.21.15.6:0/2566269366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56198a42b630 con 0x56198a65dbf0 2023-09-13T09:50:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a65ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa55affd700 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a65e010 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa54c095a70 tx=0x7fa54c003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76555b7ae27e242e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa551ffb700 1 -- 172.21.15.6:0/2566269366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c09d170 con 0x56198a65dbf0 2023-09-13T09:50:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa551ffb700 1 -- 172.21.15.6:0/2566269366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa54c0ace90 con 0x56198a65dbf0 2023-09-13T09:50:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.949+0000 7fa551ffb700 1 -- 172.21.15.6:0/2566269366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0979a0 con 0x56198a65dbf0 2023-09-13T09:50:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/2566269366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 msgr2=0x56198a65e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a65e010 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7fa54c095a70 tx=0x7fa54c003710 comp rx=0 tx=0).stop 2023-09-13T09:50:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/2566269366 shutdown_connections 2023-09-13T09:50:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a665bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a65e010 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/2566269366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a65ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/2566269366 >> 172.21.15.6:0/2566269366 conn(0x56198a5b7c80 msgr2=0x56198a6540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/2566269366 shutdown_connections 2023-09-13T09:50:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/2566269366 wait complete. 2023-09-13T09:50:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.950+0000 7fa56d9e7b80 1 -- start start 2023-09-13T09:50:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 1 Processor -- start 2023-09-13T09:50:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a667600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a667b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a549bb0 con 0x56198a65dbf0 2023-09-13T09:50:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a5498b0 con 0x56198a65e9a0 2023-09-13T09:50:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a42d920 con 0x56198a65f360 2023-09-13T09:50:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa56d9e7b80 10 client.0 _ll_register_callbacks cb 0x56198a547680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a667600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a667600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40396/0 (socket says 172.21.15.6:40396) 2023-09-13T09:50:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 -- 172.21.15.6:0/3440358401 learned_addr learned my addr 172.21.15.6:0/3440358401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55b7fe700 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a667b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 -- 172.21.15.6:0/3440358401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 msgr2=0x56198a66eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 -- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 msgr2=0x56198a667b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a667b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 -- 172.21.15.6:0/3440358401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c19ede0 con 0x56198a65dbf0 2023-09-13T09:50:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa55affd700 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a667600 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0994b0 tx=0x7fa54c0995f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f980c7690548316a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.951+0000 7fa53affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa53affd700 1 -- 172.21.15.6:0/3440358401 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c09d170 con 0x56198a65dbf0 2023-09-13T09:50:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56198a64c670 con 0x56198a65dbf0 2023-09-13T09:50:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa53affd700 1 -- 172.21.15.6:0/3440358401 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa54c099c70 con 0x56198a65dbf0 2023-09-13T09:50:04.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa53affd700 1 -- 172.21.15.6:0/3440358401 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa54c0997d0 con 0x56198a65dbf0 2023-09-13T09:50:04.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 10 client.18207 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:04.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56198a5c37a0 con 0x56198a65dbf0 2023-09-13T09:50:04.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa53affd700 1 -- 172.21.15.6:0/3440358401 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56198a64c670 con 0x56198a65dbf0 2023-09-13T09:50:04.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa53affd700 1 -- 172.21.15.6:0/3440358401 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa54c0a1150 con 0x56198a65dbf0 2023-09-13T09:50:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 10 client.18207 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 10 client.18207 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:50:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 20 client.18207 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a672e90 0x56198a675280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 4 client.18207 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.952+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56198a5a4970 con 0x56198a672e90 2023-09-13T09:50:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.953+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a672e90 0x56198a675280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.953+0000 7fa53affd700 10 client.18207 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.953+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a672e90 0x56198a675280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a7100171fb607982 server_cookie=43aa69a3c3527fc4 in_seq=0 out_seq=0 2023-09-13T09:50:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa53affd700 1 -- 172.21.15.6:0/3440358401 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56198a5a4970 con 0x56198a672e90 2023-09-13T09:50:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa53affd700 10 client.18207 handle_command_reply: tid=0 2023-09-13T09:50:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 client.18207 shutdown 2023-09-13T09:50:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 msgr2=0x56198a667600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a667600 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0994b0 tx=0x7fa54c0995f0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 shutdown_connections 2023-09-13T09:50:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a672e90 0x56198a675280 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a667600 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa53affd700 0 client.18207 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:04.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/3440358401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a667b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 >> 172.21.15.6:0/3440358401 conn(0x56198a5b7c80 msgr2=0x56198a6584b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 shutdown_connections 2023-09-13T09:50:04.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/3440358401 wait complete. 2023-09-13T09:50:04.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.954+0000 7fa56d9e7b80 20 client.18207 trim_cache size 0 max 16384 2023-09-13T09:50:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 Processor -- start 2023-09-13T09:50:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 -- start start 2023-09-13T09:50:04.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a64ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a666cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a66f050 con 0x56198a65dbf0 2023-09-13T09:50:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a655fc0 con 0x56198a65e9a0 2023-09-13T09:50:04.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a65e4a0 con 0x56198a65f360 2023-09-13T09:50:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a64ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a64ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40404/0 (socket says 172.21.15.6:40404) 2023-09-13T09:50:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55affd700 1 -- 172.21.15.6:0/4218321833 learned_addr learned my addr 172.21.15.6:0/4218321833 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a666cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55b7fe700 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55affd700 1 -- 172.21.15.6:0/4218321833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 msgr2=0x56198a66eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55affd700 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55affd700 1 -- 172.21.15.6:0/4218321833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 msgr2=0x56198a666cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.968+0000 7fa55affd700 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a666cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.969+0000 7fa55affd700 1 -- 172.21.15.6:0/4218321833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56198a3d7de0 con 0x56198a65dbf0 2023-09-13T09:50:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.969+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a666cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.969+0000 7fa55affd700 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a64ea00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0a10b0 tx=0x7fa54c003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa86f70b7b82053 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.969+0000 7fa5527fc700 1 -- 172.21.15.6:0/4218321833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0b1b70 con 0x56198a65dbf0 2023-09-13T09:50:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.969+0000 7fa5527fc700 1 -- 172.21.15.6:0/4218321833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa54c09d170 con 0x56198a65dbf0 2023-09-13T09:50:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.969+0000 7fa5527fc700 1 -- 172.21.15.6:0/4218321833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54c0a1150 con 0x56198a65dbf0 2023-09-13T09:50:04.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4218321833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 msgr2=0x56198a64ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a64ea00 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0a10b0 tx=0x7fa54c003710 comp rx=0 tx=0).stop 2023-09-13T09:50:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4218321833 shutdown_connections 2023-09-13T09:50:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65dbf0 0x56198a64ea00 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4218321833 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65e9a0 0x56198a666cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4218321833 >> 172.21.15.6:0/4218321833 conn(0x56198a5b7c80 msgr2=0x56198a666230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4218321833 shutdown_connections 2023-09-13T09:50:04.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4218321833 wait complete. 2023-09-13T09:50:04.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- start start 2023-09-13T09:50:04.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 Processor -- start 2023-09-13T09:50:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65dbf0 0x56198a66c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65e9a0 0x56198a66c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a66dec0 con 0x56198a65e9a0 2023-09-13T09:50:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a66e030 con 0x56198a65dbf0 2023-09-13T09:50:04.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.970+0000 7fa56d9e7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198a66e1f0 con 0x56198a65f360 2023-09-13T09:50:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa56d9e7b80 10 client.0 _ll_register_callbacks cb 0x56198a547680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65e9a0 0x56198a66c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65e9a0 0x56198a66c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40412/0 (socket says 172.21.15.6:40412) 2023-09-13T09:50:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65dbf0 0x56198a66c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 -- 172.21.15.6:0/4206001452 learned_addr learned my addr 172.21.15.6:0/4206001452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55b7fe700 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 -- 172.21.15.6:0/4206001452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 msgr2=0x56198a66d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 -- 172.21.15.6:0/4206001452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65dbf0 msgr2=0x56198a66c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:04.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65dbf0 0x56198a66c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 -- 172.21.15.6:0/4206001452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa54400bc60 con 0x56198a65e9a0 2023-09-13T09:50:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa55a7fc700 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65e9a0 0x56198a66c9a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa544005060 tx=0x7fa54401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8948c843edae444 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa53affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa53affd700 1 -- 172.21.15.6:0/4206001452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54402b070 con 0x56198a65e9a0 2023-09-13T09:50:04.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa53affd700 1 -- 172.21.15.6:0/4206001452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa544032b80 con 0x56198a65e9a0 2023-09-13T09:50:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa54c0ace90 con 0x56198a65e9a0 2023-09-13T09:50:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa53affd700 1 -- 172.21.15.6:0/4206001452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa544032d40 con 0x56198a65e9a0 2023-09-13T09:50:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.971+0000 7fa56d9e7b80 10 client.18213 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56198a5c37a0 con 0x56198a65e9a0 2023-09-13T09:50:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa53affd700 1 -- 172.21.15.6:0/4206001452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa54c0ace90 con 0x56198a65e9a0 2023-09-13T09:50:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa53affd700 1 -- 172.21.15.6:0/4206001452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fa54400f670 con 0x56198a65e9a0 2023-09-13T09:50:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa56d9e7b80 10 client.18213 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa56d9e7b80 10 client.18213 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:50:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa56d9e7b80 20 client.18213 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a6c76d0 0x56198a6c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa56d9e7b80 4 client.18213 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56198a565050 con 0x56198a6c76d0 2023-09-13T09:50:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa55affd700 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a6c76d0 0x56198a6c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa53affd700 10 client.18213 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.972+0000 7fa55affd700 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a6c76d0 0x56198a6c9af0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1e9eaee08d5c111a server_cookie=22de2787c2726abb in_seq=0 out_seq=0 2023-09-13T09:50:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa53affd700 1 -- 172.21.15.6:0/4206001452 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56198a565050 con 0x56198a6c76d0 2023-09-13T09:50:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa53affd700 10 client.18213 handle_command_reply: tid=0 2023-09-13T09:50:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 client.18213 shutdown 2023-09-13T09:50:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65e9a0 msgr2=0x56198a66c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65e9a0 0x56198a66c9a0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7fa544005060 tx=0x7fa54401f000 comp rx=0 tx=0).stop 2023-09-13T09:50:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 shutdown_connections 2023-09-13T09:50:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x56198a6c76d0 0x56198a6c9af0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56198a65f360 0x56198a66d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56198a65dbf0 0x56198a66c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 --2- 172.21.15.6:0/4206001452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56198a65e9a0 0x56198a66c9a0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa53affd700 0 client.18213 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 >> 172.21.15.6:0/4206001452 conn(0x56198a5b7c80 msgr2=0x56198a653e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 shutdown_connections 2023-09-13T09:50:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 1 -- 172.21.15.6:0/4206001452 wait complete. 2023-09-13T09:50:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.973+0000 7fa56d9e7b80 20 client.18213 trim_cache size 0 max 16384 2023-09-13T09:50:04.999 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5480a0640 msgr2=0x7fa5480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5480a0640 0x7fa5480a2b00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa54400b580 tx=0x7fa544005fb0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0ff9b0 msgr2=0x7fa55c1967f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0ff9b0 0x7fa55c1967f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa54c00e950 tx=0x7fa54c00ec60 comp rx=0 tx=0).stop 2023-09-13T09:50:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 shutdown_connections 2023-09-13T09:50:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5480a0640 0x7fa5480a2b00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa55c101540 0x7fa55c19dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa55c0ff9b0 0x7fa55c1967f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 --2- 172.21.15.6:0/3018623478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa55c100ba0 0x7fa55c196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 >> 172.21.15.6:0/3018623478 conn(0x7fa55c0faf20 msgr2=0x7fa55c0fd200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 shutdown_connections 2023-09-13T09:50:05.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:04.974+0000 7fa561802700 1 -- 172.21.15.6:0/3018623478 wait complete. 2023-09-13T09:50:05.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:50:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 -- 172.21.15.6:0/2400490000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 msgr2=0x7f3880100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 --2- 172.21.15.6:0/2400490000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 0x7f3880100090 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f38740099c0 tx=0x7f3874009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 -- 172.21.15.6:0/2400490000 shutdown_connections 2023-09-13T09:50:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 --2- 172.21.15.6:0/2400490000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880101800 0x7f38801080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 --2- 172.21.15.6:0/2400490000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 0x7f3880100090 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 --2- 172.21.15.6:0/2400490000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3880100e60 0x7f38801012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 -- 172.21.15.6:0/2400490000 >> 172.21.15.6:0/2400490000 conn(0x7f38800fb1c0 msgr2=0x7f38800fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 -- 172.21.15.6:0/2400490000 shutdown_connections 2023-09-13T09:50:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 -- 172.21.15.6:0/2400490000 wait complete. 2023-09-13T09:50:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 Processor -- start 2023-09-13T09:50:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 -- start start 2023-09-13T09:50:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 0x7f3880103c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880100e60 0x7f3880102240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.139+0000 7f3886d2e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3880101800 0x7f3880102780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f3886d2e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880102f20 con 0x7f38800ffc70 2023-09-13T09:50:05.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f3886d2e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3880103090 con 0x7f3880100e60 2023-09-13T09:50:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f3886d2e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38801a0b30 con 0x7f3880101800 2023-09-13T09:50:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f3884aca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 0x7f3880103c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880100e60 0x7f3880102240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880100e60 0x7f3880102240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33950/0 (socket says 172.21.15.6:33950) 2023-09-13T09:50:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 -- 172.21.15.6:0/3455600445 learned_addr learned my addr 172.21.15.6:0/3455600445 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f38852cb700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3880101800 0x7f3880102780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 -- 172.21.15.6:0/3455600445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3880101800 msgr2=0x7f3880102780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3880101800 0x7f3880102780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 -- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 msgr2=0x7f3880103c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 0x7f3880103c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 -- 172.21.15.6:0/3455600445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c009520 con 0x7f3880100e60 2023-09-13T09:50:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387ffff700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880100e60 0x7f3880102240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f386c00eb30 tx=0x7f386c00ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387dffb700 1 -- 172.21.15.6:0/3455600445 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c009880 con 0x7f3880100e60 2023-09-13T09:50:05.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387dffb700 1 -- 172.21.15.6:0/3455600445 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f386c0044e0 con 0x7f3880100e60 2023-09-13T09:50:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f387dffb700 1 -- 172.21.15.6:0/3455600445 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c003d80 con 0x7f3880100e60 2023-09-13T09:50:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.140+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38740095f0 con 0x7f3880100e60 2023-09-13T09:50:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.141+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38801a1190 con 0x7f3880100e60 2023-09-13T09:50:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.143+0000 7f387dffb700 1 -- 172.21.15.6:0/3455600445 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f386c003f20 con 0x7f3880100e60 2023-09-13T09:50:05.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.143+0000 7f387dffb700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38700a06c0 0x7f38700a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.143+0000 7f387dffb700 1 -- 172.21.15.6:0/3455600445 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f386c014070 con 0x7f3880100e60 2023-09-13T09:50:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.143+0000 7f3884aca700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38700a06c0 0x7f38700a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.144+0000 7f3884aca700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38700a06c0 0x7f38700a2b80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3874009fd0 tx=0x7f3874005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.144+0000 7f3892f13b80 1 Processor -- start 2023-09-13T09:50:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.144+0000 7f3892f13b80 1 -- start start 2023-09-13T09:50:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b8fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b8e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f3892f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57ae7780 con 0x560e57b8ea00 2023-09-13T09:50:05.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f3892f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57ae50a0 con 0x560e57b90060 2023-09-13T09:50:05.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f3892f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57ae0990 con 0x560e57b8f700 2023-09-13T09:50:05.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40436/0 (socket says 172.21.15.6:40436) 2023-09-13T09:50:05.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f3884aca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b8fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 -- 172.21.15.6:0/267265622 learned_addr learned my addr 172.21.15.6:0/267265622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f387ffff700 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b8e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 -- 172.21.15.6:0/267265622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 msgr2=0x560e57b8fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b8fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 -- 172.21.15.6:0/267265622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 msgr2=0x560e57b8e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b8e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 -- 172.21.15.6:0/267265622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e57960630 con 0x560e57b8ea00 2023-09-13T09:50:05.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f38852cb700 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8ee80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f3878011600 tx=0x7f3878009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd52b5660cbfb91d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f386affd700 1 -- 172.21.15.6:0/267265622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f387800e040 con 0x560e57b8ea00 2023-09-13T09:50:05.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f386affd700 1 -- 172.21.15.6:0/267265622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f387800f040 con 0x560e57b8ea00 2023-09-13T09:50:05.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.145+0000 7f386affd700 1 -- 172.21.15.6:0/267265622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780047a0 con 0x560e57b8ea00 2023-09-13T09:50:05.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 -- 172.21.15.6:0/267265622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 msgr2=0x560e57b8ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8ee80 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f3878011600 tx=0x7f3878009920 comp rx=0 tx=0).stop 2023-09-13T09:50:05.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 -- 172.21.15.6:0/267265622 shutdown_connections 2023-09-13T09:50:05.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8ee80 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b8fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 --2- 172.21.15.6:0/267265622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b8e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 -- 172.21.15.6:0/267265622 >> 172.21.15.6:0/267265622 conn(0x560e57aecc80 msgr2=0x560e57b88f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 -- 172.21.15.6:0/267265622 shutdown_connections 2023-09-13T09:50:05.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 -- 172.21.15.6:0/267265622 wait complete. 2023-09-13T09:50:05.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.146+0000 7f3892f13b80 1 -- start start 2023-09-13T09:50:05.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 1 Processor -- start 2023-09-13T09:50:05.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8ea00 0x560e57b97ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8f700 0x560e57b983e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b9f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57a7ebb0 con 0x560e57b8f700 2023-09-13T09:50:05.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57a7e8b0 con 0x560e57b90060 2023-09-13T09:50:05.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57962920 con 0x560e57b8ea00 2023-09-13T09:50:05.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3892f13b80 10 client.0 _ll_register_callbacks cb 0x560e57a7c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8f700 0x560e57b983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8f700 0x560e57b983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40440/0 (socket says 172.21.15.6:40440) 2023-09-13T09:50:05.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 -- 172.21.15.6:0/1861680943 learned_addr learned my addr 172.21.15.6:0/1861680943 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f38852cb700 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b9f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f3884aca700 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8ea00 0x560e57b97ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 -- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8ea00 msgr2=0x560e57b97ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8ea00 0x560e57b97ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 -- 172.21.15.6:0/1861680943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 msgr2=0x560e57b9f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b9f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.147+0000 7f387ffff700 1 -- 172.21.15.6:0/1861680943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38780112b0 con 0x560e57b8f700 2023-09-13T09:50:05.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f387ffff700 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8f700 0x560e57b983e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f386c0c9b70 tx=0x7f386c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f6841b22dc32008 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f385ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:05.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f385ffff700 1 -- 172.21.15.6:0/1861680943 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f386c09d690 con 0x560e57b8f700 2023-09-13T09:50:05.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f385ffff700 1 -- 172.21.15.6:0/1861680943 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f386c0a18d0 con 0x560e57b8f700 2023-09-13T09:50:05.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e57b81670 con 0x560e57b8f700 2023-09-13T09:50:05.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f385ffff700 1 -- 172.21.15.6:0/1861680943 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f386c00cdd0 con 0x560e57b8f700 2023-09-13T09:50:05.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 10 client.18225 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560e57af87a0 con 0x560e57b8f700 2023-09-13T09:50:05.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f385ffff700 1 -- 172.21.15.6:0/1861680943 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560e57b81670 con 0x560e57b8f700 2023-09-13T09:50:05.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f385ffff700 1 -- 172.21.15.6:0/1861680943 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f386c098d50 con 0x560e57b8f700 2023-09-13T09:50:05.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 10 client.18225 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 10 client.18225 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:50:05.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 20 client.18225 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57ba3d00 0x560e57ba6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 4 client.18225 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e57ad9970 con 0x560e57ba3d00 2023-09-13T09:50:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.148+0000 7f3884aca700 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57ba3d00 0x560e57ba6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.149+0000 7f3884aca700 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57ba3d00 0x560e57ba6120 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=942c7b7a980dc471 server_cookie=56176852dd27ffe6 in_seq=0 out_seq=0 2023-09-13T09:50:05.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.149+0000 7f385ffff700 10 client.18225 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:05.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f385ffff700 1 -- 172.21.15.6:0/1861680943 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e57ad9970 con 0x560e57ba3d00 2023-09-13T09:50:05.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f385ffff700 10 client.18225 handle_command_reply: tid=0 2023-09-13T09:50:05.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 client.18225 shutdown 2023-09-13T09:50:05.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8f700 msgr2=0x560e57b983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8f700 0x560e57b983e0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f386c0c9b70 tx=0x7f386c00cca0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 shutdown_connections 2023-09-13T09:50:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57ba3d00 0x560e57ba6120 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b90060 0x560e57b9f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f385ffff700 0 client.18225 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8ea00 0x560e57b97ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 --2- 172.21.15.6:0/1861680943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8f700 0x560e57b983e0 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 >> 172.21.15.6:0/1861680943 conn(0x560e57aecc80 msgr2=0x560e57b88ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 shutdown_connections 2023-09-13T09:50:05.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 1 -- 172.21.15.6:0/1861680943 wait complete. 2023-09-13T09:50:05.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.150+0000 7f3892f13b80 20 client.18225 trim_cache size 0 max 16384 2023-09-13T09:50:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 Processor -- start 2023-09-13T09:50:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 -- start start 2023-09-13T09:50:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8f700 0x560e57b9f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b90060 0x560e57b88e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57b99020 con 0x560e57b8ea00 2023-09-13T09:50:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57b95aa0 con 0x560e57b8f700 2023-09-13T09:50:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3892f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57b933b0 con 0x560e57b90060 2023-09-13T09:50:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3884aca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3884aca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40446/0 (socket says 172.21.15.6:40446) 2023-09-13T09:50:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3884aca700 1 -- 172.21.15.6:0/40840824 learned_addr learned my addr 172.21.15.6:0/40840824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f387ffff700 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8f700 0x560e57b9f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f38852cb700 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b90060 0x560e57b88e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3884aca700 1 -- 172.21.15.6:0/40840824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b90060 msgr2=0x560e57b88e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3884aca700 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b90060 0x560e57b88e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3884aca700 1 -- 172.21.15.6:0/40840824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8f700 msgr2=0x560e57b9f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.164+0000 7f3884aca700 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8f700 0x560e57b9f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.165+0000 7f3884aca700 1 -- 172.21.15.6:0/40840824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e5790cde0 con 0x560e57b8ea00 2023-09-13T09:50:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.165+0000 7f3884aca700 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8e4c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f387400b580 tx=0x7f3874021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c6fb213407c7af server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.165+0000 7f386b7fe700 1 -- 172.21.15.6:0/40840824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874029040 con 0x560e57b8ea00 2023-09-13T09:50:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.165+0000 7f386b7fe700 1 -- 172.21.15.6:0/40840824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f387402a040 con 0x560e57b8ea00 2023-09-13T09:50:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.165+0000 7f386b7fe700 1 -- 172.21.15.6:0/40840824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874003c90 con 0x560e57b8ea00 2023-09-13T09:50:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 -- 172.21.15.6:0/40840824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 msgr2=0x560e57b8e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8e4c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f387400b580 tx=0x7f3874021000 comp rx=0 tx=0).stop 2023-09-13T09:50:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 -- 172.21.15.6:0/40840824 shutdown_connections 2023-09-13T09:50:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b90060 0x560e57b88e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b8ea00 0x560e57b8e4c0 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 --2- 172.21.15.6:0/40840824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8f700 0x560e57b9f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 -- 172.21.15.6:0/40840824 >> 172.21.15.6:0/40840824 conn(0x560e57aecc80 msgr2=0x560e57b89810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 -- 172.21.15.6:0/40840824 shutdown_connections 2023-09-13T09:50:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 -- 172.21.15.6:0/40840824 wait complete. 2023-09-13T09:50:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 -- start start 2023-09-13T09:50:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 Processor -- start 2023-09-13T09:50:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.166+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8ea00 0x560e57b9b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b9bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3892f13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b90060 0x560e57b9e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3892f13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57b9ee50 con 0x560e57b90060 2023-09-13T09:50:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3892f13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57b9efc0 con 0x560e57b8ea00 2023-09-13T09:50:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3892f13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e57b9f180 con 0x560e57b8f700 2023-09-13T09:50:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3892f13b80 10 client.0 _ll_register_callbacks cb 0x560e57a7c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8ea00 0x560e57b9b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f387ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b9bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8ea00 0x560e57b9b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:33976/0 (socket says 172.21.15.6:33976) 2023-09-13T09:50:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 -- 172.21.15.6:0/3821475488 learned_addr learned my addr 172.21.15.6:0/3821475488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f38852cb700 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b90060 0x560e57b9e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 -- 172.21.15.6:0/3821475488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 msgr2=0x560e57b9bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b9bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 -- 172.21.15.6:0/3821475488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b90060 msgr2=0x560e57b9e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b90060 0x560e57b9e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 -- 172.21.15.6:0/3821475488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3880108a00 con 0x560e57b8ea00 2023-09-13T09:50:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3884aca700 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8ea00 0x560e57b9b610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3874000c00 tx=0x7f3874033a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b37b343ded5b9937 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f385ffff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f385ffff700 1 -- 172.21.15.6:0/3821475488 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3874029040 con 0x560e57b8ea00 2023-09-13T09:50:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f385ffff700 1 -- 172.21.15.6:0/3821475488 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3874003c10 con 0x560e57b8ea00 2023-09-13T09:50:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.167+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f387800f040 con 0x560e57b8ea00 2023-09-13T09:50:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f385ffff700 1 -- 172.21.15.6:0/3821475488 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3874003dd0 con 0x560e57b8ea00 2023-09-13T09:50:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 10 client.27629 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x560e578f5c60 con 0x560e57b8ea00 2023-09-13T09:50:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f385ffff700 1 -- 172.21.15.6:0/3821475488 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f387800f040 con 0x560e57b8ea00 2023-09-13T09:50:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f385ffff700 1 -- 172.21.15.6:0/3821475488 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3874046a00 con 0x560e57b8ea00 2023-09-13T09:50:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 10 client.27629 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 10 client.27629 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:50:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 20 client.27629 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57bf88d0 0x560e57bfacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 4 client.27629 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560e57a9a050 con 0x560e57bf88d0 2023-09-13T09:50:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.168+0000 7f387ffff700 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57bf88d0 0x560e57bfacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f387ffff700 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57bf88d0 0x560e57bfacf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8854e269d867c661 server_cookie=e9c0a3fea59e64f9 in_seq=0 out_seq=0 2023-09-13T09:50:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f385ffff700 10 client.27629 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f385ffff700 1 -- 172.21.15.6:0/3821475488 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560e57a9a050 con 0x560e57bf88d0 2023-09-13T09:50:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f385ffff700 10 client.27629 handle_command_reply: tid=0 2023-09-13T09:50:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 client.27629 shutdown 2023-09-13T09:50:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8ea00 msgr2=0x560e57b9b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8ea00 0x560e57b9b610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3874000c00 tx=0x7f3874033a70 comp rx=0 tx=0).stop 2023-09-13T09:50:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 shutdown_connections 2023-09-13T09:50:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x560e57bf88d0 0x560e57bfacf0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e57b90060 0x560e57b9e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f385ffff700 0 client.27629 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e57b8ea00 0x560e57b9b610 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 --2- 172.21.15.6:0/3821475488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e57b8f700 0x560e57b9bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 >> 172.21.15.6:0/3821475488 conn(0x560e57aecc80 msgr2=0x560e57b88e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 shutdown_connections 2023-09-13T09:50:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 1 -- 172.21.15.6:0/3821475488 wait complete. 2023-09-13T09:50:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.169+0000 7f3892f13b80 20 client.27629 trim_cache size 0 max 16384 2023-09-13T09:50:05.200 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38700a06c0 msgr2=0x7f38700a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38700a06c0 0x7f38700a2b80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3874009fd0 tx=0x7f3874005fb0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880100e60 msgr2=0x7f3880102240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880100e60 0x7f3880102240 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f386c00eb30 tx=0x7f386c00ee40 comp rx=0 tx=0).stop 2023-09-13T09:50:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 shutdown_connections 2023-09-13T09:50:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3880101800 0x7f3880102780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f38700a06c0 0x7f38700a2b80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38800ffc70 0x7f3880103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 --2- 172.21.15.6:0/3455600445 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3880100e60 0x7f3880102240 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 >> 172.21.15.6:0/3455600445 conn(0x7f38800fb1c0 msgr2=0x7f3880069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 shutdown_connections 2023-09-13T09:50:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.170+0000 7f3886d2e700 1 -- 172.21.15.6:0/3455600445 wait complete. 2023-09-13T09:50:05.205 INFO:tasks.workunit.client.0.smithi006.stdout: 1 614160 6.35 MB/sec execute 445 sec latency 32.452 ms 2023-09-13T09:50:05.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:50:05.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 -- 172.21.15.6:0/3511776221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84901018a0 msgr2=0x7f8490103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 --2- 172.21.15.6:0/3511776221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84901018a0 0x7f8490103c90 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8480009990 tx=0x7f8480009ca0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 -- 172.21.15.6:0/3511776221 shutdown_connections 2023-09-13T09:50:05.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 --2- 172.21.15.6:0/3511776221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8490106b00 0x7f8490108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 --2- 172.21.15.6:0/3511776221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84901018a0 0x7f8490103c90 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 --2- 172.21.15.6:0/3511776221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84901041d0 0x7f84901065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 -- 172.21.15.6:0/3511776221 >> 172.21.15.6:0/3511776221 conn(0x7f84900fb250 msgr2=0x7f84900fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 -- 172.21.15.6:0/3511776221 shutdown_connections 2023-09-13T09:50:05.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.348+0000 7f8495100700 1 -- 172.21.15.6:0/3511776221 wait complete. 2023-09-13T09:50:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.349+0000 7f8495100700 1 Processor -- start 2023-09-13T09:50:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.349+0000 7f8495100700 1 -- start start 2023-09-13T09:50:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8495100700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84901018a0 0x7f8490196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8495100700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84901041d0 0x7f8490196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8495100700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8490106b00 0x7f849019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8495100700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849019e5a0 con 0x7f8490106b00 2023-09-13T09:50:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8495100700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849019e6e0 con 0x7f84901041d0 2023-09-13T09:50:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8495100700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849019e870 con 0x7f84901018a0 2023-09-13T09:50:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8490106b00 0x7f849019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84901041d0 0x7f8490196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8490106b00 0x7f849019dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40470/0 (socket says 172.21.15.6:40470) 2023-09-13T09:50:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84901018a0 0x7f8490196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 -- 172.21.15.6:0/788312700 learned_addr learned my addr 172.21.15.6:0/788312700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 -- 172.21.15.6:0/788312700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84901018a0 msgr2=0x7f8490196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84901018a0 0x7f8490196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 -- 172.21.15.6:0/788312700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84901041d0 msgr2=0x7f8490196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84901041d0 0x7f8490196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 -- 172.21.15.6:0/788312700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84800095f0 con 0x7f8490106b00 2023-09-13T09:50:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848ed9d700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84901018a0 0x7f8490196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f848f59e700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8490106b00 0x7f849019dfd0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8488007ee0 tx=0x7f848800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8487fff700 1 -- 172.21.15.6:0/788312700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800dd20 con 0x7f8490106b00 2023-09-13T09:50:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.350+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849019eb50 con 0x7f8490106b00 2023-09-13T09:50:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.351+0000 7f8487fff700 1 -- 172.21.15.6:0/788312700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f848800f040 con 0x7f8490106b00 2023-09-13T09:50:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.351+0000 7f8487fff700 1 -- 172.21.15.6:0/788312700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880048a0 con 0x7f8490106b00 2023-09-13T09:50:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.351+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849019f060 con 0x7f8490106b00 2023-09-13T09:50:05.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.353+0000 7f8487fff700 1 -- 172.21.15.6:0/788312700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8488003a00 con 0x7f8490106b00 2023-09-13T09:50:05.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.353+0000 7f8487fff700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f847c0a0640 0x7f847c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.353+0000 7f8487fff700 1 -- 172.21.15.6:0/788312700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f84880cb420 con 0x7f8490106b00 2023-09-13T09:50:05.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.353+0000 7f848ed9d700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f847c0a0640 0x7f847c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f848ed9d700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f847c0a0640 0x7f847c0a2b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f848000b680 tx=0x7f8480005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 Processor -- start 2023-09-13T09:50:05.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 -- start start 2023-09-13T09:50:05.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abedfb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abede4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abedee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abe37780 con 0x5639abedea00 2023-09-13T09:50:05.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abe350a0 con 0x5639abee0060 2023-09-13T09:50:05.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.354+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abe30990 con 0x5639abedf700 2023-09-13T09:50:05.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abedee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abede4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abedee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40478/0 (socket says 172.21.15.6:40478) 2023-09-13T09:50:05.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 -- 172.21.15.6:0/58713797 learned_addr learned my addr 172.21.15.6:0/58713797 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848ed9d700 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abedfb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 -- 172.21.15.6:0/58713797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 msgr2=0x5639abedfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abedfb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 -- 172.21.15.6:0/58713797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 msgr2=0x5639abede4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abede4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 -- 172.21.15.6:0/58713797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639abcb0630 con 0x5639abedea00 2023-09-13T09:50:05.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f848f59e700 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abedee80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f84880950c0 tx=0x7f8488098a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dc530d3e31545b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f84857fa700 1 -- 172.21.15.6:0/58713797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880992c0 con 0x5639abedea00 2023-09-13T09:50:05.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f84857fa700 1 -- 172.21.15.6:0/58713797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8488098bc0 con 0x5639abedea00 2023-09-13T09:50:05.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.355+0000 7f84857fa700 1 -- 172.21.15.6:0/58713797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488095460 con 0x5639abedea00 2023-09-13T09:50:05.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 -- 172.21.15.6:0/58713797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 msgr2=0x5639abedee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abedee80 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f84880950c0 tx=0x7f8488098a90 comp rx=0 tx=0).stop 2023-09-13T09:50:05.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 -- 172.21.15.6:0/58713797 shutdown_connections 2023-09-13T09:50:05.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abedee80 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abedfb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/58713797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abede4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 -- 172.21.15.6:0/58713797 >> 172.21.15.6:0/58713797 conn(0x5639abe3cc80 msgr2=0x5639abed8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 -- 172.21.15.6:0/58713797 shutdown_connections 2023-09-13T09:50:05.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 -- 172.21.15.6:0/58713797 wait complete. 2023-09-13T09:50:05.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.356+0000 7f84a12e5b80 1 -- start start 2023-09-13T09:50:05.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 1 Processor -- start 2023-09-13T09:50:05.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abee7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abee8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abeef4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abdcebb0 con 0x5639abedea00 2023-09-13T09:50:05.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abdce8b0 con 0x5639abee0060 2023-09-13T09:50:05.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abcb2920 con 0x5639abedf700 2023-09-13T09:50:05.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84a12e5b80 10 client.0 _ll_register_callbacks cb 0x5639abdcc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abee7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abee7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40480/0 (socket says 172.21.15.6:40480) 2023-09-13T09:50:05.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 -- 172.21.15.6:0/4125325255 learned_addr learned my addr 172.21.15.6:0/4125325255 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848f59e700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abeef4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848e59c700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abee8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 -- 172.21.15.6:0/4125325255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 msgr2=0x5639abee8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abee8470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 -- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 msgr2=0x5639abeef4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abeef4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 -- 172.21.15.6:0/4125325255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849019f060 con 0x5639abedea00 2023-09-13T09:50:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848e59c700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abee8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:50:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f848ed9d700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abee7f30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8480015000 tx=0x7f8480009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb58a24c82cf6e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.357+0000 7f84767fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:05.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84767fc700 1 -- 172.21.15.6:0/4125325255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000f770 con 0x5639abedea00 2023-09-13T09:50:05.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84767fc700 1 -- 172.21.15.6:0/4125325255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f848000f8d0 con 0x5639abedea00 2023-09-13T09:50:05.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639abed1670 con 0x5639abedea00 2023-09-13T09:50:05.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84767fc700 1 -- 172.21.15.6:0/4125325255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f848000fa90 con 0x5639abedea00 2023-09-13T09:50:05.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 10 client.18243 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5639abe487a0 con 0x5639abedea00 2023-09-13T09:50:05.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84767fc700 1 -- 172.21.15.6:0/4125325255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f848003f020 con 0x5639abedea00 2023-09-13T09:50:05.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84767fc700 1 -- 172.21.15.6:0/4125325255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f848002f070 con 0x5639abedea00 2023-09-13T09:50:05.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 10 client.18243 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 10 client.18243 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:50:05.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 20 client.18243 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abef3db0 0x5639abef61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 4 client.18243 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:05.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639abe29970 con 0x5639abef3db0 2023-09-13T09:50:05.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.358+0000 7f848e59c700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abef3db0 0x5639abef61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.359+0000 7f84767fc700 10 client.18243 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:05.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.359+0000 7f848e59c700 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abef3db0 0x5639abef61d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=59a3e2f1c682d280 server_cookie=eed30d7208e70010 in_seq=0 out_seq=0 2023-09-13T09:50:05.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.359+0000 7f84767fc700 1 -- 172.21.15.6:0/4125325255 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5639abe29970 con 0x5639abef3db0 2023-09-13T09:50:05.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.359+0000 7f84767fc700 10 client.18243 handle_command_reply: tid=0 2023-09-13T09:50:05.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.359+0000 7f84a12e5b80 1 client.18243 shutdown 2023-09-13T09:50:05.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 msgr2=0x5639abee7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abee7f30 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f8480015000 tx=0x7f8480009ca0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 shutdown_connections 2023-09-13T09:50:05.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abef3db0 0x5639abef61d0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abee0060 0x5639abeef4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedea00 0x5639abee7f30 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/4125325255 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedf700 0x5639abee8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84767fc700 0 client.18243 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:05.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 >> 172.21.15.6:0/4125325255 conn(0x5639abe3cc80 msgr2=0x5639abed37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 shutdown_connections 2023-09-13T09:50:05.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 1 -- 172.21.15.6:0/4125325255 wait complete. 2023-09-13T09:50:05.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.360+0000 7f84a12e5b80 20 client.18243 trim_cache size 0 max 16384 2023-09-13T09:50:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 Processor -- start 2023-09-13T09:50:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 -- start start 2023-09-13T09:50:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedea00 0x5639abede4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedf700 0x5639abeef470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abee0060 0x5639abee7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abee5b90 con 0x5639abee0060 2023-09-13T09:50:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abee3480 con 0x5639abedf700 2023-09-13T09:50:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abed99e0 con 0x5639abedea00 2023-09-13T09:50:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f848f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abee0060 0x5639abee7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f848f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abee0060 0x5639abee7ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40490/0 (socket says 172.21.15.6:40490) 2023-09-13T09:50:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f848f59e700 1 -- 172.21.15.6:0/2473738095 learned_addr learned my addr 172.21.15.6:0/2473738095 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.374+0000 7f848e59c700 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedf700 0x5639abeef470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f848ed9d700 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedea00 0x5639abede4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f848f59e700 1 -- 172.21.15.6:0/2473738095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedea00 msgr2=0x5639abede4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f848f59e700 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedea00 0x5639abede4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f848f59e700 1 -- 172.21.15.6:0/2473738095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedf700 msgr2=0x5639abeef470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f848f59e700 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedf700 0x5639abeef470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f848f59e700 1 -- 172.21.15.6:0/2473738095 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639abc5cde0 con 0x5639abee0060 2023-09-13T09:50:05.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f848f59e700 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abee0060 0x5639abee7ce0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f84880c9240 tx=0x7f84880092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6c2361c35fcb4c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f8485ffb700 1 -- 172.21.15.6:0/2473738095 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84880a0c30 con 0x5639abee0060 2023-09-13T09:50:05.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f8485ffb700 1 -- 172.21.15.6:0/2473738095 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f848809c9f0 con 0x5639abee0060 2023-09-13T09:50:05.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.375+0000 7f8485ffb700 1 -- 172.21.15.6:0/2473738095 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488098e20 con 0x5639abee0060 2023-09-13T09:50:05.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- 172.21.15.6:0/2473738095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abee0060 msgr2=0x5639abee7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abee0060 0x5639abee7ce0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f84880c9240 tx=0x7f84880092e0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- 172.21.15.6:0/2473738095 shutdown_connections 2023-09-13T09:50:05.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abee0060 0x5639abee7ce0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abedea00 0x5639abede4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/2473738095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedf700 0x5639abeef470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- 172.21.15.6:0/2473738095 >> 172.21.15.6:0/2473738095 conn(0x5639abe3cc80 msgr2=0x5639abee2920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- 172.21.15.6:0/2473738095 shutdown_connections 2023-09-13T09:50:05.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- 172.21.15.6:0/2473738095 wait complete. 2023-09-13T09:50:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- start start 2023-09-13T09:50:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 Processor -- start 2023-09-13T09:50:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedea00 0x5639abeeb210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedf700 0x5639abeeb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abee0060 0x5639abeee770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abeeecb0 con 0x5639abedf700 2023-09-13T09:50:05.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.376+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abeeee20 con 0x5639abedea00 2023-09-13T09:50:05.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84a12e5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639abeeefe0 con 0x5639abee0060 2023-09-13T09:50:05.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84a12e5b80 10 client.0 _ll_register_callbacks cb 0x5639abdcc680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedea00 0x5639abeeb210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedea00 0x5639abeeb210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34018/0 (socket says 172.21.15.6:34018) 2023-09-13T09:50:05.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848ed9d700 1 -- 172.21.15.6:0/1642762248 learned_addr learned my addr 172.21.15.6:0/1642762248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848e59c700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedf700 0x5639abeeb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848f59e700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abee0060 0x5639abeee770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848e59c700 1 -- 172.21.15.6:0/1642762248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abee0060 msgr2=0x5639abeee770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848e59c700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abee0060 0x5639abeee770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848e59c700 1 -- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedea00 msgr2=0x5639abeeb210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848e59c700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedea00 0x5639abeeb210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848e59c700 1 -- 172.21.15.6:0/1642762248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639abcb0630 con 0x5639abedf700 2023-09-13T09:50:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848ed9d700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedea00 0x5639abeeb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848f59e700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abee0060 0x5639abeee770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f848e59c700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedf700 0x5639abeeb750 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x5639abef67b0 tx=0x7f847801fcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef0f9c8b17a22888 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84767fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84767fc700 1 -- 172.21.15.6:0/1642762248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8478010a10 con 0x5639abedf700 2023-09-13T09:50:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8488098bc0 con 0x5639abedf700 2023-09-13T09:50:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84767fc700 1 -- 172.21.15.6:0/1642762248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8478010b70 con 0x5639abedf700 2023-09-13T09:50:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84767fc700 1 -- 172.21.15.6:0/1642762248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8478010d30 con 0x5639abedf700 2023-09-13T09:50:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.377+0000 7f84a12e5b80 10 client.18249 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5639abc45c60 con 0x5639abedf700 2023-09-13T09:50:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84767fc700 1 -- 172.21.15.6:0/1642762248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8488098bc0 con 0x5639abedf700 2023-09-13T09:50:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84767fc700 1 -- 172.21.15.6:0/1642762248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8478032400 con 0x5639abedf700 2023-09-13T09:50:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84a12e5b80 10 client.18249 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84a12e5b80 10 client.18249 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:50:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84a12e5b80 20 client.18249 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abf48c80 0x5639abf4b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84a12e5b80 4 client.18249 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5639abdea050 con 0x5639abf48c80 2023-09-13T09:50:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f848ed9d700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abf48c80 0x5639abf4b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f84767fc700 10 client.18249 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.378+0000 7f848ed9d700 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abf48c80 0x5639abf4b0a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4568cf85b27e9ae2 server_cookie=76e9a5836f3de4bb in_seq=0 out_seq=0 2023-09-13T09:50:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84767fc700 1 -- 172.21.15.6:0/1642762248 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5639abdea050 con 0x5639abf48c80 2023-09-13T09:50:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84767fc700 10 client.18249 handle_command_reply: tid=0 2023-09-13T09:50:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 client.18249 shutdown 2023-09-13T09:50:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedf700 msgr2=0x5639abeeb750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedf700 0x5639abeeb750 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x5639abef67b0 tx=0x7f847801fcd0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 shutdown_connections 2023-09-13T09:50:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5639abf48c80 0x5639abf4b0a0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5639abee0060 0x5639abeee770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5639abedea00 0x5639abeeb210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 --2- 172.21.15.6:0/1642762248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5639abedf700 0x5639abeeb750 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84767fc700 0 client.18249 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 >> 172.21.15.6:0/1642762248 conn(0x5639abe3cc80 msgr2=0x5639abee7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 shutdown_connections 2023-09-13T09:50:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 1 -- 172.21.15.6:0/1642762248 wait complete. 2023-09-13T09:50:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f84a12e5b80 20 client.18249 trim_cache size 0 max 16384 2023-09-13T09:50:05.403 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:05.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f847c0a0640 msgr2=0x7f847c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f8495100700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f847c0a0640 0x7f847c0a2b00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f848000b680 tx=0x7f8480005fd0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8490106b00 msgr2=0x7f849019dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.379+0000 7f8495100700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8490106b00 0x7f849019dfd0 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f8488007ee0 tx=0x7f848800d3b0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 shutdown_connections 2023-09-13T09:50:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f847c0a0640 0x7f847c0a2b00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8490106b00 0x7f849019dfd0 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84901018a0 0x7f8490196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 --2- 172.21.15.6:0/788312700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f84901041d0 0x7f8490196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 >> 172.21.15.6:0/788312700 conn(0x7f84900fb250 msgr2=0x7f8490102550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 shutdown_connections 2023-09-13T09:50:05.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.380+0000 7f8495100700 1 -- 172.21.15.6:0/788312700 wait complete. 2023-09-13T09:50:05.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:05 smithi006 ceph-mon[98665]: pgmap v617: 97 pgs: 97 active+clean; 242 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-13T09:50:05.409 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:05 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/743843913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:50:05.410 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:50:05.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:05 smithi053 ceph-mon[102373]: pgmap v617: 97 pgs: 97 active+clean; 242 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-13T09:50:05.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:05 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/743843913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:50:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:05 smithi131 ceph-mon[102785]: pgmap v617: 97 pgs: 97 active+clean; 242 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.5 MiB/s wr, 272 op/s 2023-09-13T09:50:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:05 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/743843913' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:50:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.542+0000 7fb8469e4700 1 -- 172.21.15.6:0/3283009792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 msgr2=0x7fb8401000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.542+0000 7fb8469e4700 1 --2- 172.21.15.6:0/3283009792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb8401000e0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb8300099c0 tx=0x7fb830009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.542+0000 7fb8469e4700 1 -- 172.21.15.6:0/3283009792 shutdown_connections 2023-09-13T09:50:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.542+0000 7fb8469e4700 1 --2- 172.21.15.6:0/3283009792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb840101850 0x7fb840108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.542+0000 7fb8469e4700 1 --2- 172.21.15.6:0/3283009792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb8401000e0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.542+0000 7fb8469e4700 1 --2- 172.21.15.6:0/3283009792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb840100eb0 0x7fb840101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.542+0000 7fb8469e4700 1 -- 172.21.15.6:0/3283009792 >> 172.21.15.6:0/3283009792 conn(0x7fb8400fb250 msgr2=0x7fb8400fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.543+0000 7fb8469e4700 1 -- 172.21.15.6:0/3283009792 shutdown_connections 2023-09-13T09:50:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.543+0000 7fb8469e4700 1 -- 172.21.15.6:0/3283009792 wait complete. 2023-09-13T09:50:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.543+0000 7fb8469e4700 1 Processor -- start 2023-09-13T09:50:05.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.543+0000 7fb8469e4700 1 -- start start 2023-09-13T09:50:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.543+0000 7fb8469e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb840196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.543+0000 7fb8469e4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb840100eb0 0x7fb840196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.543+0000 7fb8469e4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb840101850 0x7fb84019e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb8469e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84019e610 con 0x7fb8400ffcc0 2023-09-13T09:50:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb8469e4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84019e750 con 0x7fb840101850 2023-09-13T09:50:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb8469e4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84019e8e0 con 0x7fb840100eb0 2023-09-13T09:50:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb840196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb840196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40508/0 (socket says 172.21.15.6:40508) 2023-09-13T09:50:05.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 -- 172.21.15.6:0/2978115411 learned_addr learned my addr 172.21.15.6:0/2978115411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb844f81700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb840101850 0x7fb84019e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb840100eb0 0x7fb840196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 -- 172.21.15.6:0/2978115411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb840100eb0 msgr2=0x7fb840196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb840100eb0 0x7fb840196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 -- 172.21.15.6:0/2978115411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb840101850 msgr2=0x7fb84019e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb840101850 0x7fb84019e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 -- 172.21.15.6:0/2978115411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8300095f0 con 0x7fb8400ffcc0 2023-09-13T09:50:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83ffff700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb840196a90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb830009fd0 tx=0x7fb830009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83d7fa700 1 -- 172.21.15.6:0/2978115411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83001d070 con 0x7fb8400ffcc0 2023-09-13T09:50:05.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83d7fa700 1 -- 172.21.15.6:0/2978115411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb830005030 con 0x7fb8400ffcc0 2023-09-13T09:50:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb84019eb60 con 0x7fb8400ffcc0 2023-09-13T09:50:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb83d7fa700 1 -- 172.21.15.6:0/2978115411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830004a90 con 0x7fb8400ffcc0 2023-09-13T09:50:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.544+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84019ef80 con 0x7fb8400ffcc0 2023-09-13T09:50:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.546+0000 7fb83d7fa700 1 -- 172.21.15.6:0/2978115411 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb8300051a0 con 0x7fb8400ffcc0 2023-09-13T09:50:05.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.547+0000 7fb83d7fa700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8280a0640 0x7fb8280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.547+0000 7fb83d7fa700 1 -- 172.21.15.6:0/2978115411 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb8300cc940 con 0x7fb8400ffcc0 2023-09-13T09:50:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.547+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8280a0640 0x7fb8280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8280a0640 0x7fb8280a2b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb834009c60 tx=0x7fb834009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 Processor -- start 2023-09-13T09:50:05.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 -- start start 2023-09-13T09:50:05.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x559199613b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199614060 0x5591996124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x559199612e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55919956b780 con 0x559199614060 2023-09-13T09:50:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591995690a0 con 0x559199612a00 2023-09-13T09:50:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.548+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559199564990 con 0x559199613700 2023-09-13T09:50:05.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x559199613b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199614060 0x5591996124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x559199613b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43570/0 (socket says 172.21.15.6:43570) 2023-09-13T09:50:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199614060 0x5591996124c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40518/0 (socket says 172.21.15.6:40518) 2023-09-13T09:50:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 -- 172.21.15.6:0/4010320338 learned_addr learned my addr 172.21.15.6:0/4010320338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb844f81700 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x559199612e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 -- 172.21.15.6:0/4010320338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 msgr2=0x559199612e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x559199612e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 -- 172.21.15.6:0/4010320338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199614060 msgr2=0x5591996124c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199614060 0x5591996124c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 -- 172.21.15.6:0/4010320338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591993e4630 con 0x559199613700 2023-09-13T09:50:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb844f81700 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x559199612e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199614060 0x5591996124c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb83ffff700 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x559199613b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb830096be0 tx=0x7fb83009a960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3f6dd71b8afccaf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb8267fc700 1 -- 172.21.15.6:0/4010320338 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300a0070 con 0x559199613700 2023-09-13T09:50:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb8267fc700 1 -- 172.21.15.6:0/4010320338 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8300a2150 con 0x559199613700 2023-09-13T09:50:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.549+0000 7fb8267fc700 1 -- 172.21.15.6:0/4010320338 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8300998c0 con 0x559199613700 2023-09-13T09:50:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 -- 172.21.15.6:0/4010320338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 msgr2=0x559199613b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x559199613b20 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fb830096be0 tx=0x7fb83009a960 comp rx=0 tx=0).stop 2023-09-13T09:50:05.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 -- 172.21.15.6:0/4010320338 shutdown_connections 2023-09-13T09:50:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x559199612e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x559199613b20 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/4010320338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199614060 0x5591996124c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 -- 172.21.15.6:0/4010320338 >> 172.21.15.6:0/4010320338 conn(0x559199570c80 msgr2=0x55919960cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 -- 172.21.15.6:0/4010320338 shutdown_connections 2023-09-13T09:50:05.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 -- 172.21.15.6:0/4010320338 wait complete. 2023-09-13T09:50:05.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.550+0000 7fb852bc9b80 1 -- start start 2023-09-13T09:50:05.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 1 Processor -- start 2023-09-13T09:50:05.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x55919961bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199614060 0x559199623130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559199502bb0 con 0x559199613700 2023-09-13T09:50:05.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591995028b0 con 0x559199612a00 2023-09-13T09:50:05.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591993e6920 con 0x559199614060 2023-09-13T09:50:05.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb852bc9b80 10 client.0 _ll_register_callbacks cb 0x559199500680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x55919961bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x55919961bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34046/0 (socket says 172.21.15.6:34046) 2023-09-13T09:50:05.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40524/0 (socket says 172.21.15.6:40524) 2023-09-13T09:50:05.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 -- 172.21.15.6:0/2217321297 learned_addr learned my addr 172.21.15.6:0/2217321297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb844f81700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199614060 0x559199623130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 -- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199614060 msgr2=0x559199623130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199614060 0x559199623130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 -- 172.21.15.6:0/2217321297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 msgr2=0x55919961c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 -- 172.21.15.6:0/2217321297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb84019ef80 con 0x559199612a00 2023-09-13T09:50:05.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb844f81700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199614060 0x559199623130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:50:05.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb83ffff700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x55919961bbb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb83000b580 tx=0x7fb83009a070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c01adb0ac5dd0613 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.551+0000 7fb81f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb81f7fe700 1 -- 172.21.15.6:0/2217321297 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83009a670 con 0x559199612a00 2023-09-13T09:50:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559199605670 con 0x559199612a00 2023-09-13T09:50:05.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb81f7fe700 1 -- 172.21.15.6:0/2217321297 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb8300a1cc0 con 0x559199612a00 2023-09-13T09:50:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb81f7fe700 1 -- 172.21.15.6:0/2217321297 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb8300a1e80 con 0x559199612a00 2023-09-13T09:50:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 10 client.27659 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55919957c7a0 con 0x559199612a00 2023-09-13T09:50:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb81f7fe700 1 -- 172.21.15.6:0/2217321297 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559199605670 con 0x559199612a00 2023-09-13T09:50:05.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb81f7fe700 1 -- 172.21.15.6:0/2217321297 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb830095f60 con 0x559199612a00 2023-09-13T09:50:05.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 10 client.27659 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 10 client.27659 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:50:05.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 20 client.27659 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x559199629880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 4 client.27659 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:05.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55919955d970 con 0x559199627460 2023-09-13T09:50:05.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.552+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x559199629880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.553+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x559199629880 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef70192a934bcd86 server_cookie=f19e74e4eda2c32c in_seq=0 out_seq=0 2023-09-13T09:50:05.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.553+0000 7fb81f7fe700 10 client.27659 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:05.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.553+0000 7fb81f7fe700 1 -- 172.21.15.6:0/2217321297 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55919955d970 con 0x559199627460 2023-09-13T09:50:05.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.553+0000 7fb81f7fe700 10 client.27659 handle_command_reply: tid=0 2023-09-13T09:50:05.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.553+0000 7fb852bc9b80 1 client.27659 shutdown 2023-09-13T09:50:05.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 msgr2=0x55919961bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x55919961bbb0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb83000b580 tx=0x7fb83009a070 comp rx=0 tx=0).stop 2023-09-13T09:50:05.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 shutdown_connections 2023-09-13T09:50:05.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x559199629880 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199614060 0x559199623130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb81f7fe700 0 client.27659 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199612a00 0x55919961bbb0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/2217321297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 >> 172.21.15.6:0/2217321297 conn(0x559199570c80 msgr2=0x5591996077f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 shutdown_connections 2023-09-13T09:50:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 1 -- 172.21.15.6:0/2217321297 wait complete. 2023-09-13T09:50:05.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.554+0000 7fb852bc9b80 20 client.27659 trim_cache size 0 max 16384 2023-09-13T09:50:05.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 Processor -- start 2023-09-13T09:50:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 -- start start 2023-09-13T09:50:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199612a00 0x5591996124c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x5591996230f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199623a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559199605650 con 0x559199612a00 2023-09-13T09:50:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55919961b720 con 0x559199614060 2023-09-13T09:50:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591996098e0 con 0x559199613700 2023-09-13T09:50:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199612a00 0x5591996124c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199612a00 0x5591996124c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40530/0 (socket says 172.21.15.6:40530) 2023-09-13T09:50:05.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 -- 172.21.15.6:0/1420033349 learned_addr learned my addr 172.21.15.6:0/1420033349 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb844f81700 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199623a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x5591996230f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 -- 172.21.15.6:0/1420033349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 msgr2=0x5591996230f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x5591996230f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 -- 172.21.15.6:0/1420033349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 msgr2=0x559199623a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199623a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb83ffff700 1 -- 172.21.15.6:0/1420033349 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559199390de0 con 0x559199612a00 2023-09-13T09:50:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.567+0000 7fb844f81700 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199623a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:50:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb83ffff700 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199612a00 0x5591996124c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb83009a100 tx=0x7fb830099f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1f3809c8b370d0e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb826ffd700 1 -- 172.21.15.6:0/1420033349 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830099cb0 con 0x559199612a00 2023-09-13T09:50:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb826ffd700 1 -- 172.21.15.6:0/1420033349 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8300990d0 con 0x559199612a00 2023-09-13T09:50:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb826ffd700 1 -- 172.21.15.6:0/1420033349 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830099480 con 0x559199612a00 2023-09-13T09:50:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 -- 172.21.15.6:0/1420033349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199612a00 msgr2=0x5591996124c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199612a00 0x5591996124c0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fb83009a100 tx=0x7fb830099f40 comp rx=0 tx=0).stop 2023-09-13T09:50:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 -- 172.21.15.6:0/1420033349 shutdown_connections 2023-09-13T09:50:05.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199623a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199612a00 0x5591996124c0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/1420033349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199613700 0x5591996230f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 -- 172.21.15.6:0/1420033349 >> 172.21.15.6:0/1420033349 conn(0x559199570c80 msgr2=0x55919961a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 -- 172.21.15.6:0/1420033349 shutdown_connections 2023-09-13T09:50:05.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.568+0000 7fb852bc9b80 1 -- 172.21.15.6:0/1420033349 wait complete. 2023-09-13T09:50:05.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 -- start start 2023-09-13T09:50:05.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 Processor -- start 2023-09-13T09:50:05.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199612a00 0x55919961f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199622580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559199622ac0 con 0x559199613700 2023-09-13T09:50:05.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559199622c30 con 0x559199614060 2023-09-13T09:50:05.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559199622df0 con 0x559199612a00 2023-09-13T09:50:05.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb852bc9b80 10 client.0 _ll_register_callbacks cb 0x559199500680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40538/0 (socket says 172.21.15.6:40538) 2023-09-13T09:50:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199612a00 0x55919961f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb83f7fe700 1 -- 172.21.15.6:0/903683579 learned_addr learned my addr 172.21.15.6:0/903683579 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.569+0000 7fb844f81700 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199622580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb83f7fe700 1 -- 172.21.15.6:0/903683579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199612a00 msgr2=0x55919961f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199612a00 0x55919961f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb83f7fe700 1 -- 172.21.15.6:0/903683579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 msgr2=0x559199622580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199622580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb83f7fe700 1 -- 172.21.15.6:0/903683579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55919957c7a0 con 0x559199613700 2023-09-13T09:50:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb83f7fe700 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961f560 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x55919962a190 tx=0x7fb8340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c976fc721fb8047 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb81f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb81f7fe700 1 -- 172.21.15.6:0/903683579 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb834022050 con 0x559199613700 2023-09-13T09:50:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb8300a2150 con 0x559199613700 2023-09-13T09:50:05.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb81f7fe700 1 -- 172.21.15.6:0/903683579 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb83401ee70 con 0x559199613700 2023-09-13T09:50:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb81f7fe700 1 -- 172.21.15.6:0/903683579 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb83402b2c0 con 0x559199613700 2023-09-13T09:50:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb852bc9b80 10 client.18267 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559199379c60 con 0x559199613700 2023-09-13T09:50:05.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb81f7fe700 1 -- 172.21.15.6:0/903683579 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb8300a2150 con 0x559199613700 2023-09-13T09:50:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.570+0000 7fb81f7fe700 1 -- 172.21.15.6:0/903683579 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb8340039f0 con 0x559199613700 2023-09-13T09:50:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 10 client.18267 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 10 client.18267 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:50:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 20 client.18267 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x55919967e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 4 client.18267 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55919951e050 con 0x559199627460 2023-09-13T09:50:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb83ffff700 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x55919967e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb83ffff700 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x55919967e4b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4049ddaf61cbea20 server_cookie=8011b74515e997db in_seq=0 out_seq=0 2023-09-13T09:50:05.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb81f7fe700 10 client.18267 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb81f7fe700 1 -- 172.21.15.6:0/903683579 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55919951e050 con 0x559199627460 2023-09-13T09:50:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb81f7fe700 10 client.18267 handle_command_reply: tid=0 2023-09-13T09:50:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 client.18267 shutdown 2023-09-13T09:50:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 msgr2=0x55919961f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961f560 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x55919962a190 tx=0x7fb8340047c0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 shutdown_connections 2023-09-13T09:50:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559199627460 0x55919967e4b0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559199614060 0x559199622580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559199612a00 0x55919961f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 --2- 172.21.15.6:0/903683579 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559199613700 0x55919961f560 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 >> 172.21.15.6:0/903683579 conn(0x559199570c80 msgr2=0x5591996168e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.571+0000 7fb81f7fe700 0 client.18267 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 shutdown_connections 2023-09-13T09:50:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb852bc9b80 1 -- 172.21.15.6:0/903683579 wait complete. 2023-09-13T09:50:05.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb852bc9b80 20 client.18267 trim_cache size 0 max 16384 2023-09-13T09:50:05.601 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:05.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8280a0640 msgr2=0x7fb8280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8280a0640 0x7fb8280a2b00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fb834009c60 tx=0x7fb834009260 comp rx=0 tx=0).stop 2023-09-13T09:50:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 msgr2=0x7fb840196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb840196a90 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb830009fd0 tx=0x7fb830009580 comp rx=0 tx=0).stop 2023-09-13T09:50:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 shutdown_connections 2023-09-13T09:50:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb840101850 0x7fb84019e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb8280a0640 0x7fb8280a2b00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8400ffcc0 0x7fb840196a90 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 --2- 172.21.15.6:0/2978115411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb840100eb0 0x7fb840196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 >> 172.21.15.6:0/2978115411 conn(0x7fb8400fb250 msgr2=0x7fb840067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 shutdown_connections 2023-09-13T09:50:05.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.572+0000 7fb8469e4700 1 -- 172.21.15.6:0/2978115411 wait complete. 2023-09-13T09:50:05.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:50:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 -- 172.21.15.6:0/2271800975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 msgr2=0x7f3da0103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2271800975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 0x7f3da0103c30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3d940098f0 tx=0x7f3d94009c00 comp rx=0 tx=0).stop 2023-09-13T09:50:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 -- 172.21.15.6:0/2271800975 shutdown_connections 2023-09-13T09:50:05.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2271800975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da0106aa0 0x7f3da0108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2271800975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 0x7f3da0103c30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2271800975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 0x7f3da0106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 -- 172.21.15.6:0/2271800975 >> 172.21.15.6:0/2271800975 conn(0x7f3da00fb250 msgr2=0x7f3da00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 -- 172.21.15.6:0/2271800975 shutdown_connections 2023-09-13T09:50:05.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.736+0000 7f3da4d47700 1 -- 172.21.15.6:0/2271800975 wait complete. 2023-09-13T09:50:05.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 Processor -- start 2023-09-13T09:50:05.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 -- start start 2023-09-13T09:50:05.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 0x7f3da0196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 0x7f3da0196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da0106aa0 0x7f3da019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da019e630 con 0x7f3da0104170 2023-09-13T09:50:05.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da019e770 con 0x7f3da0106aa0 2023-09-13T09:50:05.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3da4d47700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da019e900 con 0x7f3da0101840 2023-09-13T09:50:05.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 0x7f3da0196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 0x7f3da0196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40552/0 (socket says 172.21.15.6:40552) 2023-09-13T09:50:05.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2457223149 learned_addr learned my addr 172.21.15.6:0/2457223149 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 0x7f3da0196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.737+0000 7f3d9ed9d700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da0106aa0 0x7f3da019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2457223149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 msgr2=0x7f3da0196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 0x7f3da0196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2457223149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da0106aa0 msgr2=0x7f3da019e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da0106aa0 0x7f3da019e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2457223149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d900095f0 con 0x7f3da0104170 2023-09-13T09:50:05.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 0x7f3da0196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 0x7f3da0196ff0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000ec10 tx=0x7f3d9000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d8f7fe700 1 -- 172.21.15.6:0/2457223149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9000cc90 con 0x7f3da0104170 2023-09-13T09:50:05.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d94009520 con 0x7f3da0104170 2023-09-13T09:50:05.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d8f7fe700 1 -- 172.21.15.6:0/2457223149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d900044e0 con 0x7f3da0104170 2023-09-13T09:50:05.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3d8f7fe700 1 -- 172.21.15.6:0/2457223149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90010430 con 0x7f3da0104170 2023-09-13T09:50:05.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.738+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da019efb0 con 0x7f3da0104170 2023-09-13T09:50:05.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.740+0000 7f3d8f7fe700 1 -- 172.21.15.6:0/2457223149 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3d90003fb0 con 0x7f3da0104170 2023-09-13T09:50:05.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.741+0000 7f3d8f7fe700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.741+0000 7f3d8f7fe700 1 -- 172.21.15.6:0/2457223149 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3d90014070 con 0x7f3da0104170 2023-09-13T09:50:05.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.741+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3d94005e90 tx=0x7f3d94019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 Processor -- start 2023-09-13T09:50:05.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 -- start start 2023-09-13T09:50:05.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed4700 0x562018ed4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed5060 0x562018ed34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018e2c780 con 0x562018ed5060 2023-09-13T09:50:05.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018e2a0a0 con 0x562018ed4700 2023-09-13T09:50:05.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018e25990 con 0x562018ed3a00 2023-09-13T09:50:05.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed5060 0x562018ed34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3d9e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed4700 0x562018ed4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed5060 0x562018ed34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40560/0 (socket says 172.21.15.6:40560) 2023-09-13T09:50:05.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3392219100 learned_addr learned my addr 172.21.15.6:0/3392219100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.742+0000 7f3d9ed9d700 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3392219100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 msgr2=0x562018ed3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3392219100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed4700 msgr2=0x562018ed4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed4700 0x562018ed4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3392219100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562018ca5630 con 0x562018ed5060 2023-09-13T09:50:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed4700 0x562018ed4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed5060 0x562018ed34c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3d90095e00 tx=0x7f3d90099440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b774d4e9d0bc1303 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d8cff9700 1 -- 172.21.15.6:0/3392219100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9009a000 con 0x562018ed5060 2023-09-13T09:50:05.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d8cff9700 1 -- 172.21.15.6:0/3392219100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d90099900 con 0x562018ed5060 2023-09-13T09:50:05.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.743+0000 7f3d8cff9700 1 -- 172.21.15.6:0/3392219100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90097ca0 con 0x562018ed5060 2023-09-13T09:50:05.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3392219100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed5060 msgr2=0x562018ed34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed5060 0x562018ed34c0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3d90095e00 tx=0x7f3d90099440 comp rx=0 tx=0).stop 2023-09-13T09:50:05.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3392219100 shutdown_connections 2023-09-13T09:50:05.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed4700 0x562018ed4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3392219100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed5060 0x562018ed34c0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3392219100 >> 172.21.15.6:0/3392219100 conn(0x562018e31c80 msgr2=0x562018ecdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3392219100 shutdown_connections 2023-09-13T09:50:05.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3392219100 wait complete. 2023-09-13T09:50:05.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 -- start start 2023-09-13T09:50:05.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.744+0000 7f3db0f2cb80 1 Processor -- start 2023-09-13T09:50:05.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed3a00 0x562018edcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed4700 0x562018edd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ee4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018dc3bb0 con 0x562018ed3a00 2023-09-13T09:50:05.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018dc38b0 con 0x562018ed5060 2023-09-13T09:50:05.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018ca7920 con 0x562018ed4700 2023-09-13T09:50:05.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3db0f2cb80 10 client.0 _ll_register_callbacks cb 0x562018dc1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed3a00 0x562018edcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed3a00 0x562018edcf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40564/0 (socket says 172.21.15.6:40564) 2023-09-13T09:50:05.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 -- 172.21.15.6:0/3222159616 learned_addr learned my addr 172.21.15.6:0/3222159616 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed4700 0x562018edd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9ed9d700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ee4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 -- 172.21.15.6:0/3222159616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed4700 msgr2=0x562018edd450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed4700 0x562018edd450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 -- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 msgr2=0x562018ee4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ee4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 -- 172.21.15.6:0/3222159616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da019efb0 con 0x562018ed3a00 2023-09-13T09:50:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed4700 0x562018edd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9ed9d700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ee4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed3a00 0x562018edcf10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3d940098c0 tx=0x7f3d94009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19650091867cfa42 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:05.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d85ffb700 1 -- 172.21.15.6:0/3222159616 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d940054a0 con 0x562018ed3a00 2023-09-13T09:50:05.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.745+0000 7f3d85ffb700 1 -- 172.21.15.6:0/3222159616 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3d94005600 con 0x562018ed3a00 2023-09-13T09:50:05.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562018ec6670 con 0x562018ed3a00 2023-09-13T09:50:05.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3d85ffb700 1 -- 172.21.15.6:0/3222159616 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d94003680 con 0x562018ed3a00 2023-09-13T09:50:05.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 10 client.18279 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562018e3d7a0 con 0x562018ed3a00 2023-09-13T09:50:05.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3d85ffb700 1 -- 172.21.15.6:0/3222159616 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562018ec6670 con 0x562018ed3a00 2023-09-13T09:50:05.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3d85ffb700 1 -- 172.21.15.6:0/3222159616 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3d9402e940 con 0x562018ed3a00 2023-09-13T09:50:05.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 10 client.18279 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 10 client.18279 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 20 client.18279 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018ee8d60 0x562018eeb180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 4 client.18279 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:05.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562018e1e970 con 0x562018ee8d60 2023-09-13T09:50:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.746+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018ee8d60 0x562018eeb180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.747+0000 7f3d85ffb700 10 client.18279 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.747+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018ee8d60 0x562018eeb180 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e58678e428c9df1 server_cookie=3941238d62066d6e in_seq=0 out_seq=0 2023-09-13T09:50:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3d85ffb700 1 -- 172.21.15.6:0/3222159616 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562018e1e970 con 0x562018ee8d60 2023-09-13T09:50:05.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3d85ffb700 10 client.18279 handle_command_reply: tid=0 2023-09-13T09:50:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 client.18279 shutdown 2023-09-13T09:50:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed3a00 msgr2=0x562018edcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed3a00 0x562018edcf10 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3d940098c0 tx=0x7f3d94009260 comp rx=0 tx=0).stop 2023-09-13T09:50:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 shutdown_connections 2023-09-13T09:50:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ee4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018ee8d60 0x562018eeb180 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed3a00 0x562018edcf10 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3222159616 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed4700 0x562018edd450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3d85ffb700 0 client.18279 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 >> 172.21.15.6:0/3222159616 conn(0x562018e31c80 msgr2=0x562018ec87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 shutdown_connections 2023-09-13T09:50:05.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3222159616 wait complete. 2023-09-13T09:50:05.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.749+0000 7f3db0f2cb80 20 client.18279 trim_cache size 0 max 16384 2023-09-13T09:50:05.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 Processor -- start 2023-09-13T09:50:05.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 -- start start 2023-09-13T09:50:05.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018ee4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ed7980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018edca80 con 0x562018ed4700 2023-09-13T09:50:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018ecffd0 con 0x562018ed5060 2023-09-13T09:50:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018ecfa10 con 0x562018ed3a00 2023-09-13T09:50:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018ee4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018ee4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40574/0 (socket says 172.21.15.6:40574) 2023-09-13T09:50:05.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3317193455 learned_addr learned my addr 172.21.15.6:0/3317193455 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9ed9d700 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ed7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3317193455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 msgr2=0x562018ed34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3317193455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 msgr2=0x562018ed7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ed7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/3317193455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562018c51de0 con 0x562018ed4700 2023-09-13T09:50:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:50:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9ed9d700 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ed7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:50:05.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018ee4450 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f3d90005d70 tx=0x7f3d90003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea44c870ea77861a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d8d7fa700 1 -- 172.21.15.6:0/3317193455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90063070 con 0x562018ed4700 2023-09-13T09:50:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d8d7fa700 1 -- 172.21.15.6:0/3317193455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d900cc030 con 0x562018ed4700 2023-09-13T09:50:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.763+0000 7f3d8d7fa700 1 -- 172.21.15.6:0/3317193455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90004260 con 0x562018ed4700 2023-09-13T09:50:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3317193455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 msgr2=0x562018ee4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018ee4450 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f3d90005d70 tx=0x7f3d90003910 comp rx=0 tx=0).stop 2023-09-13T09:50:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3317193455 shutdown_connections 2023-09-13T09:50:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed5060 0x562018ed7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed3a00 0x562018ed34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/3317193455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018ee4450 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3317193455 >> 172.21.15.6:0/3317193455 conn(0x562018e31c80 msgr2=0x562018edbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3317193455 shutdown_connections 2023-09-13T09:50:05.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/3317193455 wait complete. 2023-09-13T09:50:05.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 -- start start 2023-09-13T09:50:05.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.764+0000 7f3db0f2cb80 1 Processor -- start 2023-09-13T09:50:05.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed3a00 0x562018ee2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018f38b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed5060 0x562018f3b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018f3b700 con 0x562018ed4700 2023-09-13T09:50:05.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018f3b870 con 0x562018ed3a00 2023-09-13T09:50:05.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562018f3ba30 con 0x562018ed5060 2023-09-13T09:50:05.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 10 client.0 _ll_register_callbacks cb 0x562018dc1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:05.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018f38b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed3a00 0x562018ee2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018f38b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40580/0 (socket says 172.21.15.6:40580) 2023-09-13T09:50:05.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed3a00 0x562018ee2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34102/0 (socket says 172.21.15.6:34102) 2023-09-13T09:50:05.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2322964180 learned_addr learned my addr 172.21.15.6:0/2322964180 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:05.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9ed9d700 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed5060 0x562018f3b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2322964180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed5060 msgr2=0x562018f3b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed5060 0x562018f3b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2322964180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed3a00 msgr2=0x562018ee2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:05.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed3a00 0x562018ee2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 -- 172.21.15.6:0/2322964180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562018ca5630 con 0x562018ed4700 2023-09-13T09:50:05.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d9dd9b700 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018f38b60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3d900a1440 tx=0x7f3d900a1ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b54f81961862827 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:05.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:05.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d85ffb700 1 -- 172.21.15.6:0/2322964180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90063070 con 0x562018ed4700 2023-09-13T09:50:05.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3d85ffb700 1 -- 172.21.15.6:0/2322964180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3d90003680 con 0x562018ed4700 2023-09-13T09:50:05.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.765+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d90099900 con 0x562018ed4700 2023-09-13T09:50:05.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3d85ffb700 1 -- 172.21.15.6:0/2322964180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d90099440 con 0x562018ed4700 2023-09-13T09:50:05.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 10 client.18285 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:05.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562018c3ac60 con 0x562018ed4700 2023-09-13T09:50:05.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3d85ffb700 1 -- 172.21.15.6:0/2322964180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d90099900 con 0x562018ed4700 2023-09-13T09:50:05.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3d85ffb700 1 -- 172.21.15.6:0/2322964180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3d90080080 con 0x562018ed4700 2023-09-13T09:50:05.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 10 client.18285 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:05.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 10 client.18285 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:05.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 20 client.18285 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:05.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018f3cff0 0x562018f3f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:05.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 4 client.18285 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:05.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562018ddf050 con 0x562018f3cff0 2023-09-13T09:50:05.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.766+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018f3cff0 0x562018f3f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:05.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3d9e59c700 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018f3cff0 0x562018f3f410 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a603a52dda9b1b3 server_cookie=523b64e4a9cd727f in_seq=0 out_seq=0 2023-09-13T09:50:05.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3d85ffb700 10 client.18285 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3d85ffb700 1 -- 172.21.15.6:0/2322964180 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562018ddf050 con 0x562018f3cff0 2023-09-13T09:50:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3d85ffb700 10 client.18285 handle_command_reply: tid=0 2023-09-13T09:50:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 client.18285 shutdown 2023-09-13T09:50:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 msgr2=0x562018f38b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018f38b60 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f3d900a1440 tx=0x7f3d900a1ae0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 shutdown_connections 2023-09-13T09:50:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562018ed5060 0x562018f3b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562018ed3a00 0x562018ee2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562018f3cff0 0x562018f3f410 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 --2- 172.21.15.6:0/2322964180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562018ed4700 0x562018f38b60 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3d85ffb700 0 client.18285 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 >> 172.21.15.6:0/2322964180 conn(0x562018e31c80 msgr2=0x562018ed7980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 shutdown_connections 2023-09-13T09:50:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 1 -- 172.21.15.6:0/2322964180 wait complete. 2023-09-13T09:50:05.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3db0f2cb80 20 client.18285 trim_cache size 0 max 16384 2023-09-13T09:50:05.797 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 msgr2=0x7f3d880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3d94005e90 tx=0x7f3d94019040 comp rx=0 tx=0).stop 2023-09-13T09:50:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 msgr2=0x7f3da0196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:05.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.767+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 0x7f3da0196ff0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f3d9000ec10 tx=0x7f3d9000ef20 comp rx=0 tx=0).stop 2023-09-13T09:50:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 shutdown_connections 2023-09-13T09:50:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da0106aa0 0x7f3da019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da0101840 0x7f3da0196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 --2- 172.21.15.6:0/2457223149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0104170 0x7f3da0196ff0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:05.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 >> 172.21.15.6:0/2457223149 conn(0x7f3da00fb250 msgr2=0x7f3da01024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:05.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 shutdown_connections 2023-09-13T09:50:05.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:05.768+0000 7f3da4d47700 1 -- 172.21.15.6:0/2457223149 wait complete. 2023-09-13T09:50:06.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 615029 6.35 MB/sec execute 446 sec latency 32.928 ms 2023-09-13T09:50:06.801 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:50:06.802 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:50:06.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 -- 172.21.15.6:0/153677545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 msgr2=0x7fe5c41000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/153677545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41000e0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fe5b40099c0 tx=0x7fe5b4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 -- 172.21.15.6:0/153677545 shutdown_connections 2023-09-13T09:50:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/153677545 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c4101850 0x7fe5c4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/153677545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41000e0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/153677545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5c4100eb0 0x7fe5c4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 -- 172.21.15.6:0/153677545 >> 172.21.15.6:0/153677545 conn(0x7fe5c40fb250 msgr2=0x7fe5c40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:06.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 -- 172.21.15.6:0/153677545 shutdown_connections 2023-09-13T09:50:06.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.936+0000 7fe5caa1d700 1 -- 172.21.15.6:0/153677545 wait complete. 2023-09-13T09:50:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 Processor -- start 2023-09-13T09:50:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 -- start start 2023-09-13T09:50:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c4100eb0 0x7fe5c4195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5c4101850 0x7fe5c419cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419d570 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419d6b0 con 0x7fe5c4100eb0 2023-09-13T09:50:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5caa1d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c419d840 con 0x7fe5c4101850 2023-09-13T09:50:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c4100eb0 0x7fe5c4195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40592/0 (socket says 172.21.15.6:40592) 2023-09-13T09:50:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 -- 172.21.15.6:0/2417723224 learned_addr learned my addr 172.21.15.6:0/2417723224 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c8fba700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5c4101850 0x7fe5c419cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 -- 172.21.15.6:0/2417723224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5c4101850 msgr2=0x7fe5c419cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5c4101850 0x7fe5c419cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 -- 172.21.15.6:0/2417723224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c4100eb0 msgr2=0x7fe5c4195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c4100eb0 0x7fe5c4195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.937+0000 7fe5c3fff700 1 -- 172.21.15.6:0/2417723224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40095f0 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.938+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41959f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009fd0 tx=0x7fe5b4009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:06.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.938+0000 7fe5c17fa700 1 -- 172.21.15.6:0/2417723224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b400faa0 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.938+0000 7fe5c17fa700 1 -- 172.21.15.6:0/2417723224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b4004cd0 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.938+0000 7fe5c17fa700 1 -- 172.21.15.6:0/2417723224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4005610 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.938+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c4067fb0 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.938+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c4068410 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.940+0000 7fe5c17fa700 1 -- 172.21.15.6:0/2417723224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe5b400fc00 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.941+0000 7fe5c17fa700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5b00a0640 0x7fe5b00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.941+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5b00a0640 0x7fe5b00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.941+0000 7fe5c17fa700 1 -- 172.21.15.6:0/2417723224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe5b40cf3e0 con 0x7fe5c40ffcc0 2023-09-13T09:50:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.941+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5b00a0640 0x7fe5b00a2b00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009c60 tx=0x7fe5ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:06.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 Processor -- start 2023-09-13T09:50:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 -- start start 2023-09-13T09:50:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af67ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af66540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af66a80 0x55ce2af66f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2aebf800 con 0x55ce2af680e0 2023-09-13T09:50:06.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2aebd120 con 0x55ce2af67780 2023-09-13T09:50:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2aeb8a10 con 0x55ce2af66a80 2023-09-13T09:50:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af66540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af66540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40602/0 (socket says 172.21.15.6:40602) 2023-09-13T09:50:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af67ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 -- 172.21.15.6:0/3812095150 learned_addr learned my addr 172.21.15.6:0/3812095150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c8fba700 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af66a80 0x55ce2af66f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 -- 172.21.15.6:0/3812095150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af66a80 msgr2=0x55ce2af66f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af66a80 0x55ce2af66f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 -- 172.21.15.6:0/3812095150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 msgr2=0x55ce2af67ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af67ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c37fe700 1 -- 172.21.15.6:0/3812095150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2ad386b0 con 0x55ce2af680e0 2023-09-13T09:50:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.942+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af67ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:06.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af66540 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00e4e0 tx=0x7fe5ac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fa2143f155ebd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5ba7fc700 1 -- 172.21.15.6:0/3812095150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac00ee00 con 0x55ce2af680e0 2023-09-13T09:50:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5ba7fc700 1 -- 172.21.15.6:0/3812095150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5ac021070 con 0x55ce2af680e0 2023-09-13T09:50:06.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5ba7fc700 1 -- 172.21.15.6:0/3812095150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ac01d7d0 con 0x55ce2af680e0 2023-09-13T09:50:06.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3812095150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 msgr2=0x55ce2af66540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af66540 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac00e4e0 tx=0x7fe5ac014000 comp rx=0 tx=0).stop 2023-09-13T09:50:06.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3812095150 shutdown_connections 2023-09-13T09:50:06.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af66a80 0x55ce2af66f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af67ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3812095150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af66540 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3812095150 >> 172.21.15.6:0/3812095150 conn(0x55ce2aec4d00 msgr2=0x55ce2af60f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:06.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.943+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3812095150 shutdown_connections 2023-09-13T09:50:06.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.944+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3812095150 wait complete. 2023-09-13T09:50:06.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.944+0000 7fe5d6c02b80 1 -- start start 2023-09-13T09:50:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.944+0000 7fe5d6c02b80 1 Processor -- start 2023-09-13T09:50:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.944+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af6ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af680e0 0x55ce2af77500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2ae56c30 con 0x55ce2af66a80 2023-09-13T09:50:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2ae56930 con 0x55ce2af67780 2023-09-13T09:50:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2ad3a9a0 con 0x55ce2af680e0 2023-09-13T09:50:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 10 client.0 _ll_register_callbacks cb 0x55ce2ae54700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af6ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af6ff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40606/0 (socket says 172.21.15.6:40606) 2023-09-13T09:50:06.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 -- 172.21.15.6:0/3312843312 learned_addr learned my addr 172.21.15.6:0/3312843312 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c8fba700 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af680e0 0x55ce2af77500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 -- 172.21.15.6:0/3312843312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af680e0 msgr2=0x55ce2af77500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af680e0 0x55ce2af77500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 -- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 msgr2=0x55ce2af704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 -- 172.21.15.6:0/3312843312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ac017070 con 0x55ce2af66a80 2023-09-13T09:50:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af6ff80 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400bf40 tx=0x7fe5b409d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fb565d21d9dd4a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:06.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5a37fe700 1 -- 172.21.15.6:0/3312843312 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b409c2a0 con 0x55ce2af66a80 2023-09-13T09:50:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5a37fe700 1 -- 172.21.15.6:0/3312843312 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe5b409cbb0 con 0x55ce2af66a80 2023-09-13T09:50:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce2af596f0 con 0x55ce2af66a80 2023-09-13T09:50:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5a37fe700 1 -- 172.21.15.6:0/3312843312 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5b40a09e0 con 0x55ce2af66a80 2023-09-13T09:50:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 10 client.18297 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:06.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.945+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ce2aed0820 con 0x55ce2af66a80 2023-09-13T09:50:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5a37fe700 1 -- 172.21.15.6:0/3312843312 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b4066070 con 0x55ce2af66a80 2023-09-13T09:50:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5a37fe700 1 -- 172.21.15.6:0/3312843312 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe5b409dc30 con 0x55ce2af66a80 2023-09-13T09:50:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5d6c02b80 10 client.18297 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5d6c02b80 10 client.18297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:06.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5d6c02b80 20 client.18297 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2af7b990 0x55ce2af7ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5d6c02b80 4 client.18297 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce2aeb19f0 con 0x55ce2af7b990 2023-09-13T09:50:06.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2af7b990 0x55ce2af7ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5a37fe700 10 client.18297 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:06.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.946+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2af7b990 0x55ce2af7ddb0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6569b9826ab1ddf server_cookie=eb0b70fe4c2466a7 in_seq=0 out_seq=0 2023-09-13T09:50:06.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.947+0000 7fe5a37fe700 1 -- 172.21.15.6:0/3312843312 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ce2aeb19f0 con 0x55ce2af7b990 2023-09-13T09:50:06.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.947+0000 7fe5a37fe700 10 client.18297 handle_command_reply: tid=0 2023-09-13T09:50:06.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.947+0000 7fe5d6c02b80 1 client.18297 shutdown 2023-09-13T09:50:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.947+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 msgr2=0x55ce2af6ff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.947+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af6ff80 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400bf40 tx=0x7fe5b409d3a0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 shutdown_connections 2023-09-13T09:50:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af680e0 0x55ce2af77500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2af7b990 0x55ce2af7ddb0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af6ff80 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5a37fe700 0 client.18297 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:06.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/3312843312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af67780 0x55ce2af704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 >> 172.21.15.6:0/3312843312 conn(0x55ce2aec4d00 msgr2=0x55ce2af5b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:06.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 shutdown_connections 2023-09-13T09:50:06.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/3312843312 wait complete. 2023-09-13T09:50:06.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.948+0000 7fe5d6c02b80 20 client.18297 trim_cache size 0 max 16384 2023-09-13T09:50:06.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 Processor -- start 2023-09-13T09:50:06.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 -- start start 2023-09-13T09:50:06.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af5b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af680e0 0x55ce2af65c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2af6faf0 con 0x55ce2af66a80 2023-09-13T09:50:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2af5d960 con 0x55ce2af680e0 2023-09-13T09:50:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2af6dbd0 con 0x55ce2af67780 2023-09-13T09:50:06.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af5b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af5b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40614/0 (socket says 172.21.15.6:40614) 2023-09-13T09:50:06.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5c3fff700 1 -- 172.21.15.6:0/1043887242 learned_addr learned my addr 172.21.15.6:0/1043887242 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:06.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.965+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5c8fba700 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af680e0 0x55ce2af65c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5c3fff700 1 -- 172.21.15.6:0/1043887242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 msgr2=0x55ce2af774c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af774c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5c3fff700 1 -- 172.21.15.6:0/1043887242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af680e0 msgr2=0x55ce2af65c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af680e0 0x55ce2af65c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5c3fff700 1 -- 172.21.15.6:0/1043887242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce2af6ef00 con 0x55ce2af66a80 2023-09-13T09:50:06.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af5b970 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fe5b409cb40 tx=0x7fe5b409b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ad28329fa23da4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5baffd700 1 -- 172.21.15.6:0/1043887242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b409c6f0 con 0x55ce2af66a80 2023-09-13T09:50:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5baffd700 1 -- 172.21.15.6:0/1043887242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b4066030 con 0x55ce2af66a80 2023-09-13T09:50:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.966+0000 7fe5baffd700 1 -- 172.21.15.6:0/1043887242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40a4940 con 0x55ce2af66a80 2023-09-13T09:50:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1043887242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 msgr2=0x55ce2af5b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af5b970 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fe5b409cb40 tx=0x7fe5b409b160 comp rx=0 tx=0).stop 2023-09-13T09:50:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1043887242 shutdown_connections 2023-09-13T09:50:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af680e0 0x55ce2af65c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af66a80 0x55ce2af5b970 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1043887242 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af774c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1043887242 >> 172.21.15.6:0/1043887242 conn(0x55ce2aec4d00 msgr2=0x55ce2af65530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:06.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1043887242 shutdown_connections 2023-09-13T09:50:06.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1043887242 wait complete. 2023-09-13T09:50:06.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 -- start start 2023-09-13T09:50:06.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.967+0000 7fe5d6c02b80 1 Processor -- start 2023-09-13T09:50:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af66a80 0x55ce2af74ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af75220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af761c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2af76700 con 0x55ce2af680e0 2023-09-13T09:50:06.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2af76870 con 0x55ce2af66a80 2023-09-13T09:50:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce2af76a30 con 0x55ce2af67780 2023-09-13T09:50:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 10 client.0 _ll_register_callbacks cb 0x55ce2ae54700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c8fba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af761c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af66a80 0x55ce2af74ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c8fba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af761c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40624/0 (socket says 172.21.15.6:40624) 2023-09-13T09:50:06.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af66a80 0x55ce2af74ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34144/0 (socket says 172.21.15.6:34144) 2023-09-13T09:50:06.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c8fba700 1 -- 172.21.15.6:0/1196967244 learned_addr learned my addr 172.21.15.6:0/1196967244 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:06.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af75220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 -- 172.21.15.6:0/1196967244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 msgr2=0x55ce2af75220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af75220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 -- 172.21.15.6:0/1196967244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 msgr2=0x55ce2af761c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:06.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af761c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 -- 172.21.15.6:0/1196967244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce2aed0820 con 0x55ce2af66a80 2023-09-13T09:50:06.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c8fba700 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af761c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:06.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5c3fff700 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af66a80 0x55ce2af74ce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005cb0 tx=0x7fe5b4098ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72946f0193b798b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:06.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5a37fe700 1 -- 172.21.15.6:0/1196967244 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b40a09e0 con 0x55ce2af66a80 2023-09-13T09:50:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5a37fe700 1 -- 172.21.15.6:0/1196967244 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe5b409c0a0 con 0x55ce2af66a80 2023-09-13T09:50:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.968+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5ac021070 con 0x55ce2af66a80 2023-09-13T09:50:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5a37fe700 1 -- 172.21.15.6:0/1196967244 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5b409c2a0 con 0x55ce2af66a80 2023-09-13T09:50:06.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 10 client.27701 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:06.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ce2ace4e60 con 0x55ce2af66a80 2023-09-13T09:50:06.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5a37fe700 1 -- 172.21.15.6:0/1196967244 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe5b40a8080 con 0x55ce2af66a80 2023-09-13T09:50:06.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5a37fe700 1 -- 172.21.15.6:0/1196967244 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe5b409bb10 con 0x55ce2af66a80 2023-09-13T09:50:06.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 10 client.27701 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:06.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 10 client.27701 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:06.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 20 client.27701 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:06.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2afd1bf0 0x55ce2afd3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:06.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 4 client.27701 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:50:06.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ce2ae720d0 con 0x55ce2afd1bf0 2023-09-13T09:50:06.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.969+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2afd1bf0 0x55ce2afd3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:06.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.970+0000 7fe5a37fe700 10 client.27701 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:06.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.970+0000 7fe5c37fe700 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2afd1bf0 0x55ce2afd3fe0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fe8f4a26e99be3 server_cookie=f7bb82758ff9a6b6 in_seq=0 out_seq=0 2023-09-13T09:50:06.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5a37fe700 1 -- 172.21.15.6:0/1196967244 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ce2ae720d0 con 0x55ce2afd1bf0 2023-09-13T09:50:06.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5a37fe700 10 client.27701 handle_command_reply: tid=0 2023-09-13T09:50:06.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 client.27701 shutdown 2023-09-13T09:50:06.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af66a80 msgr2=0x55ce2af74ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af66a80 0x55ce2af74ce0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005cb0 tx=0x7fe5b4098ce0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 shutdown_connections 2023-09-13T09:50:06.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ce2afd1bf0 0x55ce2afd3fe0 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ce2af680e0 0x55ce2af761c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ce2af66a80 0x55ce2af74ce0 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4005cb0 tx=0x7fe5b4098ce0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 --2- 172.21.15.6:0/1196967244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ce2af67780 0x55ce2af75220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5a37fe700 0 client.27701 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:06.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 >> 172.21.15.6:0/1196967244 conn(0x55ce2aec4d00 msgr2=0x55ce2af70430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:06.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 shutdown_connections 2023-09-13T09:50:06.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.971+0000 7fe5d6c02b80 1 -- 172.21.15.6:0/1196967244 wait complete. 2023-09-13T09:50:06.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5d6c02b80 20 client.27701 trim_cache size 0 max 16384 2023-09-13T09:50:06.995 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:50:06.995 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:50:06.996 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "992e585b-da14-4021-8319-79f6494f1142", 2023-09-13T09:50:06.996 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:50:06.996 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:50:06.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5b00a0640 msgr2=0x7fe5b00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5b00a0640 0x7fe5b00a2b00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe5ac009c60 tx=0x7fe5ac009260 comp rx=0 tx=0).stop 2023-09-13T09:50:06.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 msgr2=0x7fe5c41959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:06.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41959f0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4009fd0 tx=0x7fe5b4009580 comp rx=0 tx=0).stop 2023-09-13T09:50:06.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 shutdown_connections 2023-09-13T09:50:06.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5c4101850 0x7fe5c419cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe5b00a0640 0x7fe5b00a2b00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5c40ffcc0 0x7fe5c41959f0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 --2- 172.21.15.6:0/2417723224 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe5c4100eb0 0x7fe5c4195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:06.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 >> 172.21.15.6:0/2417723224 conn(0x7fe5c40fb250 msgr2=0x7fe5c4104410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:06.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 shutdown_connections 2023-09-13T09:50:07.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:06.972+0000 7fe5caa1d700 1 -- 172.21.15.6:0/2417723224 wait complete. 2023-09-13T09:50:07.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:50:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.129+0000 7fe318729700 1 -- 172.21.15.6:0/3065484226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 msgr2=0x7fe3101000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.129+0000 7fe318729700 1 --2- 172.21.15.6:0/3065484226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe3101000e0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fe30c0099c0 tx=0x7fe30c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- 172.21.15.6:0/3065484226 shutdown_connections 2023-09-13T09:50:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 --2- 172.21.15.6:0/3065484226 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe310101850 0x7fe310108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 --2- 172.21.15.6:0/3065484226 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe3101000e0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 --2- 172.21.15.6:0/3065484226 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe310100eb0 0x7fe310101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- 172.21.15.6:0/3065484226 >> 172.21.15.6:0/3065484226 conn(0x7fe3100fb250 msgr2=0x7fe3100fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- 172.21.15.6:0/3065484226 shutdown_connections 2023-09-13T09:50:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- 172.21.15.6:0/3065484226 wait complete. 2023-09-13T09:50:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 Processor -- start 2023-09-13T09:50:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- start start 2023-09-13T09:50:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe310068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe310100eb0 0x7fe31019b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe310101850 0x7fe31019de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31019e610 con 0x7fe3100ffcc0 2023-09-13T09:50:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31019e780 con 0x7fe310100eb0 2023-09-13T09:50:07.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe318729700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31019e940 con 0x7fe310101850 2023-09-13T09:50:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.130+0000 7fe3164c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe310068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe310068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40634/0 (socket says 172.21.15.6:40634) 2023-09-13T09:50:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 -- 172.21.15.6:0/4206627368 learned_addr learned my addr 172.21.15.6:0/4206627368 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe315cc4700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe310100eb0 0x7fe31019b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe316cc6700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe310101850 0x7fe31019de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 -- 172.21.15.6:0/4206627368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe310101850 msgr2=0x7fe31019de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe310101850 0x7fe31019de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 -- 172.21.15.6:0/4206627368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe310100eb0 msgr2=0x7fe31019b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe310100eb0 0x7fe31019b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 -- 172.21.15.6:0/4206627368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe30c0095f0 con 0x7fe3100ffcc0 2023-09-13T09:50:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe315cc4700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe310100eb0 0x7fe31019b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3164c5700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe310068b20 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009990 tx=0x7fe30c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3077fe700 1 -- 172.21.15.6:0/4206627368 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c01d070 con 0x7fe3100ffcc0 2023-09-13T09:50:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3077fe700 1 -- 172.21.15.6:0/4206627368 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe30c005030 con 0x7fe3100ffcc0 2023-09-13T09:50:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31019ebc0 con 0x7fe3100ffcc0 2023-09-13T09:50:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe3077fe700 1 -- 172.21.15.6:0/4206627368 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c004a70 con 0x7fe3100ffcc0 2023-09-13T09:50:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.131+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31019efe0 con 0x7fe3100ffcc0 2023-09-13T09:50:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.134+0000 7fe3077fe700 1 -- 172.21.15.6:0/4206627368 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe30c005410 con 0x7fe3100ffcc0 2023-09-13T09:50:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.134+0000 7fe3077fe700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe2fc0a0640 0x7fe2fc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.134+0000 7fe315cc4700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe2fc0a0640 0x7fe2fc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.134+0000 7fe3077fe700 1 -- 172.21.15.6:0/4206627368 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe30c0cc970 con 0x7fe3100ffcc0 2023-09-13T09:50:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.135+0000 7fe315cc4700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe2fc0a0640 0x7fe2fc0a2b00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe300011490 tx=0x7fe300009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.135+0000 7fe32490eb80 1 Processor -- start 2023-09-13T09:50:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.135+0000 7fe32490eb80 1 -- start start 2023-09-13T09:50:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd083700 0x562ffd083b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd0824c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd082a00 0x562ffd082e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe32490eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffcfdb780 con 0x562ffd082a00 2023-09-13T09:50:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe32490eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffcfd90a0 con 0x562ffd084060 2023-09-13T09:50:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe32490eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffcfd4990 con 0x562ffd083700 2023-09-13T09:50:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd0824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe316cc6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd082a00 0x562ffd082e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd0824c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34168/0 (socket says 172.21.15.6:34168) 2023-09-13T09:50:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 -- 172.21.15.6:0/1985197357 learned_addr learned my addr 172.21.15.6:0/1985197357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe3164c5700 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd083700 0x562ffd083b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 -- 172.21.15.6:0/1985197357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd083700 msgr2=0x562ffd083b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd083700 0x562ffd083b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 -- 172.21.15.6:0/1985197357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd082a00 msgr2=0x562ffd082e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd082a00 0x562ffd082e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 -- 172.21.15.6:0/1985197357 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ffce54630 con 0x562ffd084060 2023-09-13T09:50:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.136+0000 7fe315cc4700 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd0824c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3000043c0 tx=0x7fe300014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d359f61620f564c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.137+0000 7fe304ff9700 1 -- 172.21.15.6:0/1985197357 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe300003d10 con 0x562ffd084060 2023-09-13T09:50:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.137+0000 7fe304ff9700 1 -- 172.21.15.6:0/1985197357 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe300003e70 con 0x562ffd084060 2023-09-13T09:50:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.137+0000 7fe304ff9700 1 -- 172.21.15.6:0/1985197357 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30001e7e0 con 0x562ffd084060 2023-09-13T09:50:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.137+0000 7fe32490eb80 1 -- 172.21.15.6:0/1985197357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 msgr2=0x562ffd0824c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.137+0000 7fe32490eb80 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd0824c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe3000043c0 tx=0x7fe300014000 comp rx=0 tx=0).stop 2023-09-13T09:50:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- 172.21.15.6:0/1985197357 shutdown_connections 2023-09-13T09:50:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd082a00 0x562ffd082e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd083700 0x562ffd083b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 --2- 172.21.15.6:0/1985197357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd0824c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- 172.21.15.6:0/1985197357 >> 172.21.15.6:0/1985197357 conn(0x562ffcfe0c80 msgr2=0x562ffd07cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- 172.21.15.6:0/1985197357 shutdown_connections 2023-09-13T09:50:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- 172.21.15.6:0/1985197357 wait complete. 2023-09-13T09:50:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- start start 2023-09-13T09:50:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 Processor -- start 2023-09-13T09:50:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd08bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd0932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffcf72bb0 con 0x562ffd083700 2023-09-13T09:50:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffcf728b0 con 0x562ffd082a00 2023-09-13T09:50:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffce56920 con 0x562ffd084060 2023-09-13T09:50:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.138+0000 7fe32490eb80 10 client.0 _ll_register_callbacks cb 0x562ffcf70680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe3164c5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd08bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe315cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe3164c5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd08bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34172/0 (socket says 172.21.15.6:34172) 2023-09-13T09:50:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe316cc6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd0932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe3164c5700 1 -- 172.21.15.6:0/49567085 learned_addr learned my addr 172.21.15.6:0/49567085 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe315cc4700 1 -- 172.21.15.6:0/49567085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 msgr2=0x562ffd0932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe315cc4700 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd0932d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe315cc4700 1 -- 172.21.15.6:0/49567085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 msgr2=0x562ffd08bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe315cc4700 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd08bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe315cc4700 1 -- 172.21.15.6:0/49567085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe300017070 con 0x562ffd083700 2023-09-13T09:50:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe316cc6700 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd0932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe315cc4700 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08c290 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe300003960 tx=0x7fe3000268f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364f43dc42a42e3f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:07.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe2f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/49567085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30002b070 con 0x562ffd083700 2023-09-13T09:50:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/49567085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe30001e560 con 0x562ffd083700 2023-09-13T09:50:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ffd075670 con 0x562ffd083700 2023-09-13T09:50:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/49567085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe300026de0 con 0x562ffd083700 2023-09-13T09:50:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe32490eb80 10 client.18315 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.139+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562ffcfec7a0 con 0x562ffd083700 2023-09-13T09:50:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/49567085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562ffd075670 con 0x562ffd083700 2023-09-13T09:50:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/49567085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe300024020 con 0x562ffd083700 2023-09-13T09:50:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe32490eb80 10 client.18315 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe32490eb80 10 client.18315 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe32490eb80 20 client.18315 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe32490eb80 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd097a30 0x562ffd099e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe32490eb80 4 client.18315 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ffcfcd970 con 0x562ffd097a30 2023-09-13T09:50:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe3164c5700 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd097a30 0x562ffd099e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe3164c5700 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd097a30 0x562ffd099e50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2aa3579be90cd621 server_cookie=5ab95cba9409a111 in_seq=0 out_seq=0 2023-09-13T09:50:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.140+0000 7fe2f9ffb700 10 client.18315 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/49567085 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562ffcfcd970 con 0x562ffd097a30 2023-09-13T09:50:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe2f9ffb700 10 client.18315 handle_command_reply: tid=0 2023-09-13T09:50:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 client.18315 shutdown 2023-09-13T09:50:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 msgr2=0x562ffd08c290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08c290 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fe300003960 tx=0x7fe3000268f0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 shutdown_connections 2023-09-13T09:50:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd0932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd08bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd097a30 0x562ffd099e50 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 --2- 172.21.15.6:0/49567085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08c290 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe2f9ffb700 0 client.18315 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 >> 172.21.15.6:0/49567085 conn(0x562ffcfe0c80 msgr2=0x562ffd0777f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:07.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 shutdown_connections 2023-09-13T09:50:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 1 -- 172.21.15.6:0/49567085 wait complete. 2023-09-13T09:50:07.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.141+0000 7fe32490eb80 20 client.18315 trim_cache size 0 max 16384 2023-09-13T09:50:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.159+0000 7fe32490eb80 1 Processor -- start 2023-09-13T09:50:07.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.159+0000 7fe32490eb80 1 -- start start 2023-09-13T09:50:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd0824c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd093290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd08b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe32490eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffd0872c0 con 0x562ffd083700 2023-09-13T09:50:07.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe32490eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffd08c5e0 con 0x562ffd082a00 2023-09-13T09:50:07.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe32490eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffd09a070 con 0x562ffd084060 2023-09-13T09:50:07.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd093290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd093290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40658/0 (socket says 172.21.15.6:40658) 2023-09-13T09:50:07.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 -- 172.21.15.6:0/3598410314 learned_addr learned my addr 172.21.15.6:0/3598410314 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:07.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe3164c5700 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd0824c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe316cc6700 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd08b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 -- 172.21.15.6:0/3598410314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 msgr2=0x562ffd08b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd08b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 -- 172.21.15.6:0/3598410314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 msgr2=0x562ffd0824c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd0824c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 -- 172.21.15.6:0/3598410314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ffd07ea00 con 0x562ffd083700 2023-09-13T09:50:07.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe315cc4700 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd093290 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fe3000097b0 tx=0x7fe300004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cacce368f79bd7dd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:07.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.160+0000 7fe3057fa700 1 -- 172.21.15.6:0/3598410314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30002b070 con 0x562ffd083700 2023-09-13T09:50:07.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe3057fa700 1 -- 172.21.15.6:0/3598410314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe300026d30 con 0x562ffd083700 2023-09-13T09:50:07.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe3057fa700 1 -- 172.21.15.6:0/3598410314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30001ebf0 con 0x562ffd083700 2023-09-13T09:50:07.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 -- 172.21.15.6:0/3598410314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 msgr2=0x562ffd093290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd093290 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fe3000097b0 tx=0x7fe300004340 comp rx=0 tx=0).stop 2023-09-13T09:50:07.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 -- 172.21.15.6:0/3598410314 shutdown_connections 2023-09-13T09:50:07.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd084060 0x562ffd08b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd082a00 0x562ffd0824c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 --2- 172.21.15.6:0/3598410314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd093290 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 -- 172.21.15.6:0/3598410314 >> 172.21.15.6:0/3598410314 conn(0x562ffcfe0c80 msgr2=0x562ffd082de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:07.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 -- 172.21.15.6:0/3598410314 shutdown_connections 2023-09-13T09:50:07.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.161+0000 7fe32490eb80 1 -- 172.21.15.6:0/3598410314 wait complete. 2023-09-13T09:50:07.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 -- start start 2023-09-13T09:50:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 Processor -- start 2023-09-13T09:50:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd082a00 0x562ffd08eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd092080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffd0925c0 con 0x562ffd083700 2023-09-13T09:50:07.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffd092730 con 0x562ffd084060 2023-09-13T09:50:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ffd0928f0 con 0x562ffd082a00 2023-09-13T09:50:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe32490eb80 10 client.0 _ll_register_callbacks cb 0x562ffcf70680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40664/0 (socket says 172.21.15.6:40664) 2023-09-13T09:50:07.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 -- 172.21.15.6:0/881893008 learned_addr learned my addr 172.21.15.6:0/881893008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:07.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe3164c5700 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd082a00 0x562ffd08eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe316cc6700 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd092080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 -- 172.21.15.6:0/881893008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd082a00 msgr2=0x562ffd08eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd082a00 0x562ffd08eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 -- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 msgr2=0x562ffd092080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:07.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd092080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.162+0000 7fe315cc4700 1 -- 172.21.15.6:0/881893008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562ffcfec7a0 con 0x562ffd083700 2023-09-13T09:50:07.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe315cc4700 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08f060 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe300021040 tx=0x7fe300026610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b907e7588a83ef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:07.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe2f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:07.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/881893008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30002b040 con 0x562ffd083700 2023-09-13T09:50:07.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe300003e70 con 0x562ffd083700 2023-09-13T09:50:07.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/881893008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe300005220 con 0x562ffd083700 2023-09-13T09:50:07.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/881893008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3000053e0 con 0x562ffd083700 2023-09-13T09:50:07.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 10 client.18321 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:07.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562ffce00de0 con 0x562ffd083700 2023-09-13T09:50:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/881893008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe300003e70 con 0x562ffd083700 2023-09-13T09:50:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/881893008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe300024070 con 0x562ffd083700 2023-09-13T09:50:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 10 client.18321 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 10 client.18321 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:07.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 20 client.18321 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd0ebd00 0x562ffd0ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 4 client.18321 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:50:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.163+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x562ffcf8e050 con 0x562ffd0ebd00 2023-09-13T09:50:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe3164c5700 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd0ebd00 0x562ffd0ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:07.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe2f9ffb700 10 client.18321 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe3164c5700 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd0ebd00 0x562ffd0ee120 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f4393efbe725c7 server_cookie=30baf6da425ddff2 in_seq=0 out_seq=0 2023-09-13T09:50:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe2f9ffb700 1 -- 172.21.15.6:0/881893008 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x562ffcf8e050 con 0x562ffd0ebd00 2023-09-13T09:50:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe2f9ffb700 10 client.18321 handle_command_reply: tid=0 2023-09-13T09:50:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 client.18321 shutdown 2023-09-13T09:50:07.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 msgr2=0x562ffd08f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08f060 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fe300021040 tx=0x7fe300026610 comp rx=0 tx=0).stop 2023-09-13T09:50:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 shutdown_connections 2023-09-13T09:50:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ffd084060 0x562ffd092080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ffd082a00 0x562ffd08eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ffd0ebd00 0x562ffd0ee120 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 --2- 172.21.15.6:0/881893008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ffd083700 0x562ffd08f060 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe2f9ffb700 0 client.18321 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.164+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 >> 172.21.15.6:0/881893008 conn(0x562ffcfe0c80 msgr2=0x562ffd08b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 shutdown_connections 2023-09-13T09:50:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe32490eb80 1 -- 172.21.15.6:0/881893008 wait complete. 2023-09-13T09:50:07.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe32490eb80 20 client.18321 trim_cache size 0 max 16384 2023-09-13T09:50:07.185 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:50:07.185 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:50:07.185 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:50:07.186 INFO:teuthology.orchestra.run.smithi006.stdout: "992e585b-da14-4021-8319-79f6494f1142": { 2023-09-13T09:50:07.186 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:50:07.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "992e585b-da14-4021-8319-79f6494f1142", 2023-09-13T09:50:07.186 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:50:07.186 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:50:07.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:50:07.187 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:50:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe2fc0a0640 msgr2=0x7fe2fc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe2fc0a0640 0x7fe2fc0a2b00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fe300011490 tx=0x7fe300009260 comp rx=0 tx=0).stop 2023-09-13T09:50:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 msgr2=0x7fe310068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe310068b20 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fe30c009990 tx=0x7fe30c00f690 comp rx=0 tx=0).stop 2023-09-13T09:50:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 shutdown_connections 2023-09-13T09:50:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe310101850 0x7fe31019de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe2fc0a0640 0x7fe2fc0a2b00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe3100ffcc0 0x7fe310068b20 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 --2- 172.21.15.6:0/4206627368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe310100eb0 0x7fe31019b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 >> 172.21.15.6:0/4206627368 conn(0x7fe3100fb250 msgr2=0x7fe3100fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 shutdown_connections 2023-09-13T09:50:07.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:07.165+0000 7fe318729700 1 -- 172.21.15.6:0/4206627368 wait complete. 2023-09-13T09:50:07.191 INFO:tasks.cephfs.filesystem:scrub status for tag:992e585b-da14-4021-8319-79f6494f1142 - {'path': '/', 'tag': '992e585b-da14-4021-8319-79f6494f1142', 'options': 'recursive,force'} 2023-09-13T09:50:07.191 INFO:tasks.workunit.client.0.smithi006.stdout: 1 616991 6.35 MB/sec execute 447 sec latency 27.503 ms 2023-09-13T09:50:08.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 618367 6.36 MB/sec execute 448 sec latency 32.259 ms 2023-09-13T09:50:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: pgmap v618: 97 pgs: 97 active+clean; 243 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 2.4 MiB/s wr, 267 op/s 2023-09-13T09:50:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:50:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:08.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:08.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:08.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:08.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:08.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: pgmap v618: 97 pgs: 97 active+clean; 243 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 2.4 MiB/s wr, 267 op/s 2023-09-13T09:50:08.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:50:08.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:08.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:08.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:08.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:08.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:08.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: pgmap v618: 97 pgs: 97 active+clean; 243 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 778 KiB/s rd, 2.4 MiB/s wr, 267 op/s 2023-09-13T09:50:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:50:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:08.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:08.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:08.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 620338 6.36 MB/sec execute 449 sec latency 14.641 ms 2023-09-13T09:50:09.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:09.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:09.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:09.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:09.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:09.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:09.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:10.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 621782 6.38 MB/sec execute 450 sec latency 41.196 ms 2023-09-13T09:50:10.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:09 smithi006 ceph-mon[98665]: pgmap v619: 97 pgs: 97 active+clean; 244 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 2.2 MiB/s wr, 222 op/s 2023-09-13T09:50:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:09 smithi053 ceph-mon[102373]: pgmap v619: 97 pgs: 97 active+clean; 244 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 2.2 MiB/s wr, 222 op/s 2023-09-13T09:50:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:09 smithi131 ceph-mon[102785]: pgmap v619: 97 pgs: 97 active+clean; 244 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 734 KiB/s rd, 2.2 MiB/s wr, 222 op/s 2023-09-13T09:50:11.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 622745 6.37 MB/sec execute 451 sec latency 40.324 ms 2023-09-13T09:50:12.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 625134 6.39 MB/sec execute 452 sec latency 13.505 ms 2023-09-13T09:50:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:11 smithi006 ceph-mon[98665]: pgmap v620: 97 pgs: 97 active+clean; 245 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.2 MiB/s wr, 246 op/s 2023-09-13T09:50:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:11 smithi053 ceph-mon[102373]: pgmap v620: 97 pgs: 97 active+clean; 245 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.2 MiB/s wr, 246 op/s 2023-09-13T09:50:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:11 smithi131 ceph-mon[102785]: pgmap v620: 97 pgs: 97 active+clean; 245 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.2 MiB/s wr, 246 op/s 2023-09-13T09:50:13.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 625951 6.38 MB/sec execute 453 sec latency 34.171 ms 2023-09-13T09:50:14.179 INFO:tasks.workunit.client.0.smithi006.stdout: 1 628249 6.39 MB/sec execute 454 sec latency 13.409 ms 2023-09-13T09:50:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:13 smithi053 ceph-mon[102373]: pgmap v621: 97 pgs: 97 active+clean; 246 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 2.6 MiB/s wr, 272 op/s 2023-09-13T09:50:14.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:13 smithi006 ceph-mon[98665]: pgmap v621: 97 pgs: 97 active+clean; 246 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 2.6 MiB/s wr, 272 op/s 2023-09-13T09:50:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:13 smithi131 ceph-mon[102785]: pgmap v621: 97 pgs: 97 active+clean; 246 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 832 KiB/s rd, 2.6 MiB/s wr, 272 op/s 2023-09-13T09:50:15.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 629155 6.39 MB/sec execute 455 sec latency 37.478 ms 2023-09-13T09:50:16.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 631208 6.40 MB/sec execute 456 sec latency 23.272 ms 2023-09-13T09:50:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:15 smithi006 ceph-mon[98665]: pgmap v622: 97 pgs: 97 active+clean; 248 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.5 MiB/s wr, 287 op/s 2023-09-13T09:50:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:15 smithi053 ceph-mon[102373]: pgmap v622: 97 pgs: 97 active+clean; 248 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.5 MiB/s wr, 287 op/s 2023-09-13T09:50:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:15 smithi131 ceph-mon[102785]: pgmap v622: 97 pgs: 97 active+clean; 248 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.5 MiB/s wr, 287 op/s 2023-09-13T09:50:17.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 632559 6.41 MB/sec execute 457 sec latency 14.614 ms 2023-09-13T09:50:18.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 634462 6.41 MB/sec execute 458 sec latency 15.137 ms 2023-09-13T09:50:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:17 smithi006 ceph-mon[98665]: pgmap v623: 97 pgs: 97 active+clean; 250 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.3 MiB/s wr, 250 op/s 2023-09-13T09:50:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:17 smithi053 ceph-mon[102373]: pgmap v623: 97 pgs: 97 active+clean; 250 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.3 MiB/s wr, 250 op/s 2023-09-13T09:50:18.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:17 smithi131 ceph-mon[102785]: pgmap v623: 97 pgs: 97 active+clean; 250 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 708 KiB/s rd, 2.3 MiB/s wr, 250 op/s 2023-09-13T09:50:19.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 635971 6.42 MB/sec execute 459 sec latency 16.016 ms 2023-09-13T09:50:20.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 636864 6.41 MB/sec execute 460 sec latency 59.802 ms 2023-09-13T09:50:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:19 smithi006 ceph-mon[98665]: pgmap v624: 97 pgs: 97 active+clean; 251 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 2.0 MiB/s wr, 246 op/s 2023-09-13T09:50:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:19 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:19 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:20.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:19 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:19 smithi053 ceph-mon[102373]: pgmap v624: 97 pgs: 97 active+clean; 251 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 2.0 MiB/s wr, 246 op/s 2023-09-13T09:50:20.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:19 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:19 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:20.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:19 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:19 smithi131 ceph-mon[102785]: pgmap v624: 97 pgs: 97 active+clean; 251 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 2.0 MiB/s wr, 246 op/s 2023-09-13T09:50:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:19 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:19 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:19 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:21.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 639084 6.42 MB/sec execute 461 sec latency 14.691 ms 2023-09-13T09:50:21.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:21.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:21.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:21.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:22.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 640041 6.42 MB/sec execute 462 sec latency 13.396 ms 2023-09-13T09:50:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:21 smithi006 ceph-mon[98665]: pgmap v625: 97 pgs: 97 active+clean; 252 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-13T09:50:22.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:21 smithi053 ceph-mon[102373]: pgmap v625: 97 pgs: 97 active+clean; 252 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-13T09:50:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:21 smithi131 ceph-mon[102785]: pgmap v625: 97 pgs: 97 active+clean; 252 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 2.2 MiB/s wr, 265 op/s 2023-09-13T09:50:23.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 642189 6.43 MB/sec execute 463 sec latency 11.857 ms 2023-09-13T09:50:24.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 643241 6.43 MB/sec execute 464 sec latency 74.068 ms 2023-09-13T09:50:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:23 smithi006 ceph-mon[98665]: pgmap v626: 97 pgs: 97 active+clean; 251 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 2.3 MiB/s wr, 264 op/s 2023-09-13T09:50:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:23 smithi053 ceph-mon[102373]: pgmap v626: 97 pgs: 97 active+clean; 251 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 2.3 MiB/s wr, 264 op/s 2023-09-13T09:50:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:23 smithi131 ceph-mon[102785]: pgmap v626: 97 pgs: 97 active+clean; 251 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 2.3 MiB/s wr, 264 op/s 2023-09-13T09:50:25.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 645154 6.43 MB/sec execute 465 sec latency 28.892 ms 2023-09-13T09:50:26.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 646601 6.45 MB/sec execute 466 sec latency 18.834 ms 2023-09-13T09:50:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:25 smithi006 ceph-mon[98665]: pgmap v627: 97 pgs: 97 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-09-13T09:50:26.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:25 smithi053 ceph-mon[102373]: pgmap v627: 97 pgs: 97 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-09-13T09:50:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:25 smithi131 ceph-mon[102785]: pgmap v627: 97 pgs: 97 active+clean; 253 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 777 KiB/s rd, 2.3 MiB/s wr, 273 op/s 2023-09-13T09:50:27.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 647570 6.44 MB/sec execute 467 sec latency 72.272 ms 2023-09-13T09:50:28.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 649900 6.46 MB/sec execute 468 sec latency 33.321 ms 2023-09-13T09:50:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:27 smithi006 ceph-mon[98665]: pgmap v628: 97 pgs: 97 active+clean; 255 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 2.2 MiB/s wr, 237 op/s 2023-09-13T09:50:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:27 smithi053 ceph-mon[102373]: pgmap v628: 97 pgs: 97 active+clean; 255 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 2.2 MiB/s wr, 237 op/s 2023-09-13T09:50:28.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:27 smithi131 ceph-mon[102785]: pgmap v628: 97 pgs: 97 active+clean; 255 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 620 KiB/s rd, 2.2 MiB/s wr, 237 op/s 2023-09-13T09:50:29.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 650681 6.45 MB/sec execute 469 sec latency 15.813 ms 2023-09-13T09:50:29.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:28 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:50:29.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:28 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:50:29.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:28 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:50:30.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 652382 6.45 MB/sec execute 470 sec latency 30.557 ms 2023-09-13T09:50:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:29 smithi006 ceph-mon[98665]: pgmap v629: 97 pgs: 97 active+clean; 257 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.2 MiB/s wr, 231 op/s 2023-09-13T09:50:30.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:29 smithi053 ceph-mon[102373]: pgmap v629: 97 pgs: 97 active+clean; 257 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.2 MiB/s wr, 231 op/s 2023-09-13T09:50:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:29 smithi131 ceph-mon[102785]: pgmap v629: 97 pgs: 97 active+clean; 257 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.2 MiB/s wr, 231 op/s 2023-09-13T09:50:31.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 653725 6.46 MB/sec execute 471 sec latency 25.746 ms 2023-09-13T09:50:32.180 INFO:tasks.workunit.client.0.smithi006.stdout: 1 654720 6.45 MB/sec execute 472 sec latency 18.227 ms 2023-09-13T09:50:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: pgmap v630: 97 pgs: 97 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 2.2 MiB/s wr, 239 op/s 2023-09-13T09:50:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:50:32.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:50:32.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: pgmap v630: 97 pgs: 97 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 2.2 MiB/s wr, 239 op/s 2023-09-13T09:50:32.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:50:32.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:50:32.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: pgmap v630: 97 pgs: 97 active+clean; 258 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 644 KiB/s rd, 2.2 MiB/s wr, 239 op/s 2023-09-13T09:50:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:50:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:50:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:50:33.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 656935 6.47 MB/sec execute 473 sec latency 17.060 ms 2023-09-13T09:50:34.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 657772 6.46 MB/sec execute 474 sec latency 14.175 ms 2023-09-13T09:50:34.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:34 smithi053 ceph-mon[102373]: pgmap v631: 97 pgs: 97 active+clean; 260 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.4 MiB/s wr, 239 op/s 2023-09-13T09:50:34.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:34 smithi006 ceph-mon[98665]: pgmap v631: 97 pgs: 97 active+clean; 260 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.4 MiB/s wr, 239 op/s 2023-09-13T09:50:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:34 smithi131 ceph-mon[102785]: pgmap v631: 97 pgs: 97 active+clean; 260 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 648 KiB/s rd, 2.4 MiB/s wr, 239 op/s 2023-09-13T09:50:35.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 659401 6.46 MB/sec execute 475 sec latency 64.218 ms 2023-09-13T09:50:36.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 660839 6.47 MB/sec execute 476 sec latency 22.603 ms 2023-09-13T09:50:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:36 smithi006 ceph-mon[98665]: pgmap v632: 97 pgs: 97 active+clean; 261 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.3 MiB/s wr, 253 op/s 2023-09-13T09:50:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:36 smithi053 ceph-mon[102373]: pgmap v632: 97 pgs: 97 active+clean; 261 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.3 MiB/s wr, 253 op/s 2023-09-13T09:50:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:36 smithi131 ceph-mon[102785]: pgmap v632: 97 pgs: 97 active+clean; 261 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 743 KiB/s rd, 2.3 MiB/s wr, 253 op/s 2023-09-13T09:50:37.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 662178 6.47 MB/sec execute 477 sec latency 16.969 ms 2023-09-13T09:50:37.192 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:50:37.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 -- 172.21.15.6:0/247526997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984101840 msgr2=0x7f1984103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 --2- 172.21.15.6:0/247526997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984101840 0x7f1984103c30 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f1980009990 tx=0x7f1980009ca0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 -- 172.21.15.6:0/247526997 shutdown_connections 2023-09-13T09:50:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 --2- 172.21.15.6:0/247526997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1984106aa0 0x7f1984108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 --2- 172.21.15.6:0/247526997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984101840 0x7f1984103c30 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 --2- 172.21.15.6:0/247526997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1984104170 0x7f1984106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 -- 172.21.15.6:0/247526997 >> 172.21.15.6:0/247526997 conn(0x7f19840fb250 msgr2=0x7f19840fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 -- 172.21.15.6:0/247526997 shutdown_connections 2023-09-13T09:50:37.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.330+0000 7f198c07b700 1 -- 172.21.15.6:0/247526997 wait complete. 2023-09-13T09:50:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 Processor -- start 2023-09-13T09:50:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 -- start start 2023-09-13T09:50:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1984101840 0x7f1984198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984104170 0x7f19841991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1984106aa0 0x7f19841a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841a07e0 con 0x7f1984104170 2023-09-13T09:50:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841a0950 con 0x7f1984106aa0 2023-09-13T09:50:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198c07b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19841a0b10 con 0x7f1984101840 2023-09-13T09:50:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f1989616700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984104170 0x7f19841991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f1989616700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984104170 0x7f19841991b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40676/0 (socket says 172.21.15.6:40676) 2023-09-13T09:50:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f1989616700 1 -- 172.21.15.6:0/1164209763 learned_addr learned my addr 172.21.15.6:0/1164209763 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f1989e17700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1984101840 0x7f1984198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.331+0000 7f198a618700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1984106aa0 0x7f19841a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f1989e17700 1 -- 172.21.15.6:0/1164209763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1984106aa0 msgr2=0x7f19841a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f1989e17700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1984106aa0 0x7f19841a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f1989e17700 1 -- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984104170 msgr2=0x7f19841991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f1989e17700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984104170 0x7f19841991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f1989e17700 1 -- 172.21.15.6:0/1164209763 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800095f0 con 0x7f1984101840 2023-09-13T09:50:37.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f1989616700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984104170 0x7f19841991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f198a618700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1984106aa0 0x7f19841a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f1989e17700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1984101840 0x7f1984198c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19800098e0 tx=0x7f1980009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f197affd700 1 -- 172.21.15.6:0/1164209763 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198001d070 con 0x7f1984101840 2023-09-13T09:50:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19841a0d90 con 0x7f1984101840 2023-09-13T09:50:37.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f197affd700 1 -- 172.21.15.6:0/1164209763 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1980021410 con 0x7f1984101840 2023-09-13T09:50:37.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f197affd700 1 -- 172.21.15.6:0/1164209763 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980017650 con 0x7f1984101840 2023-09-13T09:50:37.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.332+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19841a11c0 con 0x7f1984101840 2023-09-13T09:50:37.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.334+0000 7f197affd700 1 -- 172.21.15.6:0/1164209763 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1980021810 con 0x7f1984101840 2023-09-13T09:50:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.335+0000 7f197affd700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19700a0640 0x7f19700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.335+0000 7f197affd700 1 -- 172.21.15.6:0/1164209763 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f19800ccf60 con 0x7f1984101840 2023-09-13T09:50:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.335+0000 7f1989616700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19700a0640 0x7f19700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1989616700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19700a0640 0x7f19700a2b00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f198419a170 tx=0x7f1974009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 Processor -- start 2023-09-13T09:50:37.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 -- start start 2023-09-13T09:50:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301281700 0x560301281b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301282060 0x5603012804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301280a00 0x560301280e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603011d9780 con 0x560301281700 2023-09-13T09:50:37.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603011d70a0 con 0x560301280a00 2023-09-13T09:50:37.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1998260b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603011d2990 con 0x560301282060 2023-09-13T09:50:37.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301281700 0x560301281b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1989616700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301282060 0x5603012804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301281700 0x560301281b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40682/0 (socket says 172.21.15.6:40682) 2023-09-13T09:50:37.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f1989e17700 1 -- 172.21.15.6:0/311311209 learned_addr learned my addr 172.21.15.6:0/311311209 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.336+0000 7f198a618700 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301280a00 0x560301280e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f1989616700 1 -- 172.21.15.6:0/311311209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301280a00 msgr2=0x560301280e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f1989616700 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301280a00 0x560301280e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f1989616700 1 -- 172.21.15.6:0/311311209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301281700 msgr2=0x560301281b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f1989616700 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301281700 0x560301281b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f1989616700 1 -- 172.21.15.6:0/311311209 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560301052630 con 0x560301282060 2023-09-13T09:50:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f1989e17700 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301281700 0x560301281b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:37.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f1989616700 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301282060 0x5603012804c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1974011c70 tx=0x7f1974014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2765114c1b118fad server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f196ffff700 1 -- 172.21.15.6:0/311311209 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1974004830 con 0x560301282060 2023-09-13T09:50:37.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f196ffff700 1 -- 172.21.15.6:0/311311209 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1974021070 con 0x560301282060 2023-09-13T09:50:37.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.337+0000 7f196ffff700 1 -- 172.21.15.6:0/311311209 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197401c610 con 0x560301282060 2023-09-13T09:50:37.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 -- 172.21.15.6:0/311311209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301282060 msgr2=0x5603012804c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301282060 0x5603012804c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f1974011c70 tx=0x7f1974014000 comp rx=0 tx=0).stop 2023-09-13T09:50:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 -- 172.21.15.6:0/311311209 shutdown_connections 2023-09-13T09:50:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301280a00 0x560301280e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301281700 0x560301281b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 --2- 172.21.15.6:0/311311209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301282060 0x5603012804c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 -- 172.21.15.6:0/311311209 >> 172.21.15.6:0/311311209 conn(0x5603011dec80 msgr2=0x56030127af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 -- 172.21.15.6:0/311311209 shutdown_connections 2023-09-13T09:50:37.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 -- 172.21.15.6:0/311311209 wait complete. 2023-09-13T09:50:37.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 -- start start 2023-09-13T09:50:37.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.338+0000 7f1998260b80 1 Processor -- start 2023-09-13T09:50:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1998260b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x560301289f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1998260b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1998260b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x5603012914b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1998260b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560301170bb0 con 0x560301280a00 2023-09-13T09:50:37.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1998260b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603011708b0 con 0x560301282060 2023-09-13T09:50:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1998260b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560301054920 con 0x560301281700 2023-09-13T09:50:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1998260b80 10 client.0 _ll_register_callbacks cb 0x56030116e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x560301289f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x560301289f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40688/0 (socket says 172.21.15.6:40688) 2023-09-13T09:50:37.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 -- 172.21.15.6:0/1719910671 learned_addr learned my addr 172.21.15.6:0/1719910671 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f198a618700 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x5603012914b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989616700 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 -- 172.21.15.6:0/1719910671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 msgr2=0x56030128a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 -- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 msgr2=0x5603012914b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x5603012914b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 -- 172.21.15.6:0/1719910671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1974017070 con 0x560301280a00 2023-09-13T09:50:37.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f1989e17700 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x560301289f30 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f19800caa60 tx=0x7f198009acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ddb744dae0a9ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.339+0000 7f196d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f196d7fa700 1 -- 172.21.15.6:0/1719910671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198009ae90 con 0x560301280a00 2023-09-13T09:50:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560301273670 con 0x560301280a00 2023-09-13T09:50:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f196d7fa700 1 -- 172.21.15.6:0/1719910671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f198009a790 con 0x560301280a00 2023-09-13T09:50:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f196d7fa700 1 -- 172.21.15.6:0/1719910671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f198009e5c0 con 0x560301280a00 2023-09-13T09:50:37.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 10 client.18333 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5603011ea7a0 con 0x560301280a00 2023-09-13T09:50:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f196d7fa700 1 -- 172.21.15.6:0/1719910671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1980064020 con 0x560301280a00 2023-09-13T09:50:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f196d7fa700 1 -- 172.21.15.6:0/1719910671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f19800a2400 con 0x560301280a00 2023-09-13T09:50:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 10 client.18333 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:37.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 10 client.18333 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 20 client.18333 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012958e0 0x560301297cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 4 client.18333 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5603011cb970 con 0x5603012958e0 2023-09-13T09:50:37.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.340+0000 7f1989616700 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012958e0 0x560301297cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.341+0000 7f196d7fa700 10 client.18333 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:37.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.341+0000 7f1989616700 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012958e0 0x560301297cd0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281abaef45630285 server_cookie=5811604c594e5c8c in_seq=0 out_seq=0 2023-09-13T09:50:37.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.341+0000 7f196d7fa700 1 -- 172.21.15.6:0/1719910671 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5603011cb970 con 0x5603012958e0 2023-09-13T09:50:37.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.341+0000 7f196d7fa700 10 client.18333 handle_command_reply: tid=0 2023-09-13T09:50:37.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.341+0000 7f1998260b80 1 client.18333 shutdown 2023-09-13T09:50:37.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 msgr2=0x560301289f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x560301289f30 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f19800caa60 tx=0x7f198009acd0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 shutdown_connections 2023-09-13T09:50:37.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x5603012914b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012958e0 0x560301297cd0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x560301289f30 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 --2- 172.21.15.6:0/1719910671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f196d7fa700 0 client.18333 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:37.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 >> 172.21.15.6:0/1719910671 conn(0x5603011dec80 msgr2=0x5603012757f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 shutdown_connections 2023-09-13T09:50:37.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 1 -- 172.21.15.6:0/1719910671 wait complete. 2023-09-13T09:50:37.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.342+0000 7f1998260b80 20 client.18333 trim_cache size 0 max 16384 2023-09-13T09:50:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.359+0000 7f1998260b80 1 Processor -- start 2023-09-13T09:50:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.359+0000 7f1998260b80 1 -- start start 2023-09-13T09:50:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1998260b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x5603012804c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1998260b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x560301291470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1998260b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x56030127ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1998260b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560301285410 con 0x560301280a00 2023-09-13T09:50:37.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1998260b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560301288600 con 0x560301282060 2023-09-13T09:50:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1998260b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56030127c970 con 0x560301281700 2023-09-13T09:50:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x5603012804c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x5603012804c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40696/0 (socket says 172.21.15.6:40696) 2023-09-13T09:50:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 -- 172.21.15.6:0/2044459135 learned_addr learned my addr 172.21.15.6:0/2044459135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f198a618700 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x56030127ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989616700 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x560301291470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 -- 172.21.15.6:0/2044459135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 msgr2=0x560301291470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x560301291470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 -- 172.21.15.6:0/2044459135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 msgr2=0x56030127ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x56030127ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 -- 172.21.15.6:0/2044459135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560300ffede0 con 0x560301280a00 2023-09-13T09:50:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f198a618700 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x56030127ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1989e17700 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x5603012804c0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f1980009990 tx=0x7f19800092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=819688177d29adc3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.360+0000 7f1978ff9700 1 -- 172.21.15.6:0/2044459135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1980096910 con 0x560301280a00 2023-09-13T09:50:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1978ff9700 1 -- 172.21.15.6:0/2044459135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1980064030 con 0x560301280a00 2023-09-13T09:50:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1978ff9700 1 -- 172.21.15.6:0/2044459135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198009e3d0 con 0x560301280a00 2023-09-13T09:50:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 -- 172.21.15.6:0/2044459135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 msgr2=0x5603012804c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x5603012804c0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f1980009990 tx=0x7f19800092b0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 -- 172.21.15.6:0/2044459135 shutdown_connections 2023-09-13T09:50:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x56030127ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x5603012804c0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 --2- 172.21.15.6:0/2044459135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x560301291470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 -- 172.21.15.6:0/2044459135 >> 172.21.15.6:0/2044459135 conn(0x5603011dec80 msgr2=0x560301288c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 -- 172.21.15.6:0/2044459135 shutdown_connections 2023-09-13T09:50:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.361+0000 7f1998260b80 1 -- 172.21.15.6:0/2044459135 wait complete. 2023-09-13T09:50:37.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 -- start start 2023-09-13T09:50:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 Processor -- start 2023-09-13T09:50:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x56030128d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x560301290a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560301290fd0 con 0x560301280a00 2023-09-13T09:50:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560301291140 con 0x560301282060 2023-09-13T09:50:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560301291300 con 0x560301281700 2023-09-13T09:50:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1998260b80 10 client.0 _ll_register_callbacks cb 0x56030116e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x56030128d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x56030128d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40702/0 (socket says 172.21.15.6:40702) 2023-09-13T09:50:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 -- 172.21.15.6:0/3994750615 learned_addr learned my addr 172.21.15.6:0/3994750615 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989616700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f198a618700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x560301290a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 -- 172.21.15.6:0/3994750615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 msgr2=0x56030128da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 -- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 msgr2=0x560301290a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x560301290a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f1989e17700 1 -- 172.21.15.6:0/3994750615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f197c00e600 con 0x560301280a00 2023-09-13T09:50:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.362+0000 7f198a618700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x560301290a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:50:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1989e17700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x56030128d530 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f198000b2e0 tx=0x7f1980096700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee833164143639b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f196d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f196d7fa700 1 -- 172.21.15.6:0/3994750615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198009a790 con 0x560301280a00 2023-09-13T09:50:37.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f196d7fa700 1 -- 172.21.15.6:0/3994750615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1980065080 con 0x560301280a00 2023-09-13T09:50:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1974021070 con 0x560301280a00 2023-09-13T09:50:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f196d7fa700 1 -- 172.21.15.6:0/3994750615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f198009ae90 con 0x560301280a00 2023-09-13T09:50:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 10 client.18339 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5603011ea7a0 con 0x560301280a00 2023-09-13T09:50:37.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f196d7fa700 1 -- 172.21.15.6:0/3994750615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1974021070 con 0x560301280a00 2023-09-13T09:50:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f196d7fa700 1 -- 172.21.15.6:0/3994750615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f19800996f0 con 0x560301280a00 2023-09-13T09:50:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 10 client.18339 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 10 client.18339 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 20 client.18339 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012ea3c0 0x5603012ec7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 4 client.18339 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:50:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.363+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56030118c050 con 0x5603012ea3c0 2023-09-13T09:50:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1989616700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012ea3c0 0x5603012ec7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f196d7fa700 10 client.18339 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1989616700 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012ea3c0 0x5603012ec7b0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=427a6a2f5bba095f server_cookie=5e1848872023b4c9 in_seq=0 out_seq=0 2023-09-13T09:50:37.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f196d7fa700 1 -- 172.21.15.6:0/3994750615 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56030118c050 con 0x5603012ea3c0 2023-09-13T09:50:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f196d7fa700 10 client.18339 handle_command_reply: tid=0 2023-09-13T09:50:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 client.18339 shutdown 2023-09-13T09:50:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 msgr2=0x56030128d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x56030128d530 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f198000b2e0 tx=0x7f1980096700 comp rx=0 tx=0).stop 2023-09-13T09:50:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 shutdown_connections 2023-09-13T09:50:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560301282060 0x560301290a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5603012ea3c0 0x5603012ec7b0 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560301280a00 0x56030128d530 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 --2- 172.21.15.6:0/3994750615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560301281700 0x56030128da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f196d7fa700 0 client.18339 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 >> 172.21.15.6:0/3994750615 conn(0x5603011dec80 msgr2=0x56030127ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 shutdown_connections 2023-09-13T09:50:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.364+0000 7f1998260b80 1 -- 172.21.15.6:0/3994750615 wait complete. 2023-09-13T09:50:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f1998260b80 20 client.18339 trim_cache size 0 max 16384 2023-09-13T09:50:37.393 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:50:37.393 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:50:37.393 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:50:37.393 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:50:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19700a0640 msgr2=0x7f19700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19700a0640 0x7f19700a2b00 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f198419a170 tx=0x7f1974009260 comp rx=0 tx=0).stop 2023-09-13T09:50:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1984101840 msgr2=0x7f1984198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1984101840 0x7f1984198c70 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f19800098e0 tx=0x7f1980009580 comp rx=0 tx=0).stop 2023-09-13T09:50:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 shutdown_connections 2023-09-13T09:50:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1984106aa0 0x7f19841a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1984101840 0x7f1984198c70 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f19700a0640 0x7f19700a2b00 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 --2- 172.21.15.6:0/1164209763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1984104170 0x7f19841991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 >> 172.21.15.6:0/1164209763 conn(0x7f19840fb250 msgr2=0x7f19840ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 shutdown_connections 2023-09-13T09:50:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.365+0000 7f198c07b700 1 -- 172.21.15.6:0/1164209763 wait complete. 2023-09-13T09:50:37.397 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:50:37.398 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:50:37.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 -- 172.21.15.6:0/1787216435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b0101820 msgr2=0x7f99b01080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 --2- 172.21.15.6:0/1787216435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b0101820 0x7f99b01080d0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f99a800b0d0 tx=0x7f99a800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 -- 172.21.15.6:0/1787216435 shutdown_connections 2023-09-13T09:50:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 --2- 172.21.15.6:0/1787216435 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b0101820 0x7f99b01080d0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 --2- 172.21.15.6:0/1787216435 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b00ffc90 0x7f99b01000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 --2- 172.21.15.6:0/1787216435 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99b0100e80 0x7f99b01012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 -- 172.21.15.6:0/1787216435 >> 172.21.15.6:0/1787216435 conn(0x7f99b00fb220 msgr2=0x7f99b00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 -- 172.21.15.6:0/1787216435 shutdown_connections 2023-09-13T09:50:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.532+0000 7f99b87f1700 1 -- 172.21.15.6:0/1787216435 wait complete. 2023-09-13T09:50:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 Processor -- start 2023-09-13T09:50:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 -- start start 2023-09-13T09:50:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b00ffc90 0x7f99b0068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b0100e80 0x7f99b019b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99b0101820 0x7f99b019dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b019e660 con 0x7f99b00ffc90 2023-09-13T09:50:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b019e7d0 con 0x7f99b0101820 2023-09-13T09:50:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b87f1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b019e990 con 0x7f99b0100e80 2023-09-13T09:50:37.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b00ffc90 0x7f99b0068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b00ffc90 0x7f99b0068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40716/0 (socket says 172.21.15.6:40716) 2023-09-13T09:50:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 -- 172.21.15.6:0/858962883 learned_addr learned my addr 172.21.15.6:0/858962883 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b5d8c700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b0100e80 0x7f99b019b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b6d8e700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99b0101820 0x7f99b019dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 -- 172.21.15.6:0/858962883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b0100e80 msgr2=0x7f99b019b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b0100e80 0x7f99b019b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 -- 172.21.15.6:0/858962883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99b0101820 msgr2=0x7f99b019dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99b0101820 0x7f99b019dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 -- 172.21.15.6:0/858962883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a8009d00 con 0x7f99b00ffc90 2023-09-13T09:50:37.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.533+0000 7f99b658d700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b00ffc90 0x7f99b0068b20 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e970 tx=0x7f99ac00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.534+0000 7f99a77fe700 1 -- 172.21.15.6:0/858962883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac009790 con 0x7f99b00ffc90 2023-09-13T09:50:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.534+0000 7f99a77fe700 1 -- 172.21.15.6:0/858962883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f99ac00c7e0 con 0x7f99b00ffc90 2023-09-13T09:50:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.534+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b019ec70 con 0x7f99b00ffc90 2023-09-13T09:50:37.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.534+0000 7f99a77fe700 1 -- 172.21.15.6:0/858962883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac003c70 con 0x7f99b00ffc90 2023-09-13T09:50:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.534+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b019f1d0 con 0x7f99b00ffc90 2023-09-13T09:50:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.535+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b01071b0 con 0x7f99b00ffc90 2023-09-13T09:50:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.536+0000 7f99a77fe700 1 -- 172.21.15.6:0/858962883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f99ac00cc50 con 0x7f99b00ffc90 2023-09-13T09:50:37.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.537+0000 7f99a77fe700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f999c0a06c0 0x7f999c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.537+0000 7f99a77fe700 1 -- 172.21.15.6:0/858962883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f99ac014070 con 0x7f99b00ffc90 2023-09-13T09:50:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.537+0000 7f99b5d8c700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f999c0a06c0 0x7f999c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.537+0000 7f99b5d8c700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f999c0a06c0 0x7f999c0a2b80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009c60 tx=0x7f99a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.541+0000 7f99a77fe700 1 -- 172.21.15.6:0/858962883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f99ac095980 con 0x7f99b00ffc90 2023-09-13T09:50:37.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.808+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99b002cfc0 con 0x7f99b00ffc90 2023-09-13T09:50:37.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.809+0000 7f99a77fe700 1 -- 172.21.15.6:0/858962883 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f99ac003dd0 con 0x7f99b00ffc90 2023-09-13T09:50:37.809 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:50:37.810 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:50:37.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.811+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f999c0a06c0 msgr2=0x7f999c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.811+0000 7f99b87f1700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f999c0a06c0 0x7f999c0a2b80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f99a0009c60 tx=0x7f99a0009260 comp rx=0 tx=0).stop 2023-09-13T09:50:37.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.811+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b00ffc90 msgr2=0x7f99b0068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.811+0000 7f99b87f1700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b00ffc90 0x7f99b0068b20 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f99ac00e970 tx=0x7f99ac00ec80 comp rx=0 tx=0).stop 2023-09-13T09:50:37.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 shutdown_connections 2023-09-13T09:50:37.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f99b0101820 0x7f99b019dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f999c0a06c0 0x7f999c0a2b80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f99b00ffc90 0x7f99b0068b20 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 --2- 172.21.15.6:0/858962883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99b0100e80 0x7f99b019b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 >> 172.21.15.6:0/858962883 conn(0x7f99b00fb220 msgr2=0x7f99b01042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 shutdown_connections 2023-09-13T09:50:37.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.813+0000 7f99b87f1700 1 -- 172.21.15.6:0/858962883 wait complete. 2023-09-13T09:50:37.815 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:50:37.826 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:50:37.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 -- 172.21.15.6:0/3077968335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10101850 msgr2=0x7efc10108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 --2- 172.21.15.6:0/3077968335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10101850 0x7efc10108100 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc08009fc0 tx=0x7efc0800b330 comp rx=0 tx=0).stop 2023-09-13T09:50:37.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 -- 172.21.15.6:0/3077968335 shutdown_connections 2023-09-13T09:50:37.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 --2- 172.21.15.6:0/3077968335 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10101850 0x7efc10108100 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 --2- 172.21.15.6:0/3077968335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc100ffcc0 0x7efc101000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 --2- 172.21.15.6:0/3077968335 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc10100eb0 0x7efc10101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 -- 172.21.15.6:0/3077968335 >> 172.21.15.6:0/3077968335 conn(0x7efc100fb250 msgr2=0x7efc100fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 -- 172.21.15.6:0/3077968335 shutdown_connections 2023-09-13T09:50:37.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.962+0000 7efc16570700 1 -- 172.21.15.6:0/3077968335 wait complete. 2023-09-13T09:50:37.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 Processor -- start 2023-09-13T09:50:37.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 -- start start 2023-09-13T09:50:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc100ffcc0 0x7efc10110c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10100eb0 0x7efc1010f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc10101850 0x7efc1010f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1010fe00 con 0x7efc100ffcc0 2023-09-13T09:50:37.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc1010ff40 con 0x7efc10100eb0 2023-09-13T09:50:37.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc16570700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc10110100 con 0x7efc10101850 2023-09-13T09:50:37.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10100eb0 0x7efc1010f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10100eb0 0x7efc1010f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34256/0 (socket says 172.21.15.6:34256) 2023-09-13T09:50:37.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0f7fe700 1 -- 172.21.15.6:0/897532863 learned_addr learned my addr 172.21.15.6:0/897532863 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0ffff700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc100ffcc0 0x7efc10110c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc14b0d700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc10101850 0x7efc1010f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0f7fe700 1 -- 172.21.15.6:0/897532863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc10101850 msgr2=0x7efc1010f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc10101850 0x7efc1010f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0f7fe700 1 -- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc100ffcc0 msgr2=0x7efc10110c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.963+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc100ffcc0 0x7efc10110c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.964+0000 7efc0f7fe700 1 -- 172.21.15.6:0/897532863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc08009c40 con 0x7efc10100eb0 2023-09-13T09:50:37.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.964+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10100eb0 0x7efc1010f2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc0400e9a0 tx=0x7efc0400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.964+0000 7efc0d7fa700 1 -- 172.21.15.6:0/897532863 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04009790 con 0x7efc10100eb0 2023-09-13T09:50:37.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.964+0000 7efc0d7fa700 1 -- 172.21.15.6:0/897532863 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc0400ce80 con 0x7efc10100eb0 2023-09-13T09:50:37.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.964+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc101ada40 con 0x7efc10100eb0 2023-09-13T09:50:37.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.964+0000 7efc0d7fa700 1 -- 172.21.15.6:0/897532863 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04018680 con 0x7efc10100eb0 2023-09-13T09:50:37.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.964+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc101adfa0 con 0x7efc10100eb0 2023-09-13T09:50:37.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.966+0000 7efc0d7fa700 1 -- 172.21.15.6:0/897532863 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7efc04010430 con 0x7efc10100eb0 2023-09-13T09:50:37.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.967+0000 7efc0d7fa700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efbf80a06a0 0x7efbf80a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.967+0000 7efc0d7fa700 1 -- 172.21.15.6:0/897532863 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efc04014070 con 0x7efc10100eb0 2023-09-13T09:50:37.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.967+0000 7efc0ffff700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efbf80a06a0 0x7efbf80a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc0ffff700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efbf80a06a0 0x7efbf80a2b60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efc10100d10 tx=0x7efc00009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 Processor -- start 2023-09-13T09:50:37.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 -- start start 2023-09-13T09:50:37.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279367b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f2793664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279366a00 0x55f279366e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2792bf780 con 0x55f279368060 2023-09-13T09:50:37.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2792bd0a0 con 0x55f279366a00 2023-09-13T09:50:37.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc22755b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2792b8990 con 0x55f279367700 2023-09-13T09:50:37.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f2793664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279367b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f2793664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40740/0 (socket says 172.21.15.6:40740) 2023-09-13T09:50:37.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc0f7fe700 1 -- 172.21.15.6:0/3184289088 learned_addr learned my addr 172.21.15.6:0/3184289088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279367b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43792/0 (socket says 172.21.15.6:43792) 2023-09-13T09:50:37.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.968+0000 7efc14b0d700 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279366a00 0x55f279366e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efc0ffff700 1 -- 172.21.15.6:0/3184289088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279366a00 msgr2=0x55f279366e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efc0ffff700 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279366a00 0x55f279366e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efc0ffff700 1 -- 172.21.15.6:0/3184289088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 msgr2=0x55f2793664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efc0ffff700 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f2793664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efc0ffff700 1 -- 172.21.15.6:0/3184289088 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f279138630 con 0x55f279367700 2023-09-13T09:50:37.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efc0ffff700 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279367b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efc0000e3b0 tx=0x7efc00014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e00a52d40b6ca8d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efbf67fc700 1 -- 172.21.15.6:0/3184289088 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0000ecd0 con 0x55f279367700 2023-09-13T09:50:37.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efbf67fc700 1 -- 172.21.15.6:0/3184289088 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc00021070 con 0x55f279367700 2023-09-13T09:50:37.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.969+0000 7efbf67fc700 1 -- 172.21.15.6:0/3184289088 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc0001d670 con 0x55f279367700 2023-09-13T09:50:37.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 -- 172.21.15.6:0/3184289088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 msgr2=0x55f279367b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279367b20 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efc0000e3b0 tx=0x7efc00014000 comp rx=0 tx=0).stop 2023-09-13T09:50:37.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 -- 172.21.15.6:0/3184289088 shutdown_connections 2023-09-13T09:50:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279366a00 0x55f279366e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279367b20 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 --2- 172.21.15.6:0/3184289088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f2793664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 -- 172.21.15.6:0/3184289088 >> 172.21.15.6:0/3184289088 conn(0x55f2792c4c80 msgr2=0x55f279360f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 -- 172.21.15.6:0/3184289088 shutdown_connections 2023-09-13T09:50:37.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.970+0000 7efc22755b80 1 -- 172.21.15.6:0/3184289088 wait complete. 2023-09-13T09:50:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 -- start start 2023-09-13T09:50:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 Processor -- start 2023-09-13T09:50:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279366a00 0x55f27936ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279370440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f279377480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f279256bb0 con 0x55f279366a00 2023-09-13T09:50:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2792568b0 con 0x55f279368060 2023-09-13T09:50:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27913a920 con 0x55f279367700 2023-09-13T09:50:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc22755b80 10 client.0 _ll_register_callbacks cb 0x55f279254680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:37.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc0ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279366a00 0x55f27936ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc0ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279366a00 0x55f27936ff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40744/0 (socket says 172.21.15.6:40744) 2023-09-13T09:50:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc0ffff700 1 -- 172.21.15.6:0/4222572797 learned_addr learned my addr 172.21.15.6:0/4222572797 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc14b0d700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f279377480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.971+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279370440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc14b0d700 1 -- 172.21.15.6:0/4222572797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 msgr2=0x55f279370440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc14b0d700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279370440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc14b0d700 1 -- 172.21.15.6:0/4222572797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279366a00 msgr2=0x55f27936ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:37.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc14b0d700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279366a00 0x55f27936ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc14b0d700 1 -- 172.21.15.6:0/4222572797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc00017070 con 0x55f279368060 2023-09-13T09:50:37.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc0ffff700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279366a00 0x55f27936ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc14b0d700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f279377480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc08009f90 tx=0x7efc08009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=941a6a455406ac0d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efbef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efbef7fe700 1 -- 172.21.15.6:0/4222572797 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc08021070 con 0x55f279368060 2023-09-13T09:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efbef7fe700 1 -- 172.21.15.6:0/4222572797 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efc0800bc00 con 0x55f279368060 2023-09-13T09:50:37.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f279359670 con 0x55f279368060 2023-09-13T09:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efbef7fe700 1 -- 172.21.15.6:0/4222572797 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc08008f70 con 0x55f279368060 2023-09-13T09:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc22755b80 10 client.27752 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f2792d07a0 con 0x55f279368060 2023-09-13T09:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.972+0000 7efbef7fe700 1 -- 172.21.15.6:0/4222572797 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f279359670 con 0x55f279368060 2023-09-13T09:50:37.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efbef7fe700 1 -- 172.21.15.6:0/4222572797 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc08011730 con 0x55f279368060 2023-09-13T09:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc22755b80 10 client.27752 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc22755b80 10 client.27752 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc22755b80 20 client.27752 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc22755b80 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f27937bd00 0x55f27937e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:37.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc22755b80 4 client.27752 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f2792b1970 con 0x55f27937bd00 2023-09-13T09:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc0ffff700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f27937bd00 0x55f27937e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efbef7fe700 10 client.27752 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.973+0000 7efc0ffff700 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f27937bd00 0x55f27937e120 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3fd51b7680a85887 server_cookie=1dcb5f0c2e6d3f54 in_seq=0 out_seq=0 2023-09-13T09:50:37.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efbef7fe700 1 -- 172.21.15.6:0/4222572797 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f2792b1970 con 0x55f27937bd00 2023-09-13T09:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efbef7fe700 10 client.27752 handle_command_reply: tid=0 2023-09-13T09:50:37.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 client.27752 shutdown 2023-09-13T09:50:37.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 msgr2=0x55f279377480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:37.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f279377480 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efc08009f90 tx=0x7efc08009510 comp rx=0 tx=0).stop 2023-09-13T09:50:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 shutdown_connections 2023-09-13T09:50:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f27937bd00 0x55f27937e120 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f279377480 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279366a00 0x55f27936ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efbef7fe700 0 client.27752 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 --2- 172.21.15.6:0/4222572797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279367700 0x55f279370440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.974+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 >> 172.21.15.6:0/4222572797 conn(0x55f2792c4c80 msgr2=0x55f27935b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.975+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 shutdown_connections 2023-09-13T09:50:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.975+0000 7efc22755b80 1 -- 172.21.15.6:0/4222572797 wait complete. 2023-09-13T09:50:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.975+0000 7efc22755b80 20 client.27752 trim_cache size 0 max 16384 2023-09-13T09:50:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.988+0000 7efc22755b80 1 Processor -- start 2023-09-13T09:50:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc22755b80 1 -- start start 2023-09-13T09:50:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc22755b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f2793664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc22755b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279367700 0x55f279377440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc22755b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f27936fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc22755b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27935d8e0 con 0x55f279368060 2023-09-13T09:50:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc22755b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f279362730 con 0x55f279367700 2023-09-13T09:50:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc22755b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f27936db50 con 0x55f279366a00 2023-09-13T09:50:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc14b0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f27936fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279367700 0x55f279377440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f2793664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279367700 0x55f279377440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34278/0 (socket says 172.21.15.6:34278) 2023-09-13T09:50:38.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc14b0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f27936fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40756/0 (socket says 172.21.15.6:40756) 2023-09-13T09:50:38.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 -- 172.21.15.6:0/3129976946 learned_addr learned my addr 172.21.15.6:0/3129976946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 -- 172.21.15.6:0/3129976946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 msgr2=0x55f2793664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f2793664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 -- 172.21.15.6:0/3129976946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 msgr2=0x55f27936fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f27936fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0f7fe700 1 -- 172.21.15.6:0/3129976946 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f2790e4de0 con 0x55f279367700 2023-09-13T09:50:38.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc14b0d700 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f27936fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.989+0000 7efc0ffff700 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f2793664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279367700 0x55f279377440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc040c9be0 tx=0x7efc04084040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edca9623e7679875 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efbf6ffd700 1 -- 172.21.15.6:0/3129976946 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04099560 con 0x55f279367700 2023-09-13T09:50:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efbf6ffd700 1 -- 172.21.15.6:0/3129976946 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc0409d390 con 0x55f279367700 2023-09-13T09:50:38.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efbf6ffd700 1 -- 172.21.15.6:0/3129976946 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc04099a20 con 0x55f279367700 2023-09-13T09:50:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 -- 172.21.15.6:0/3129976946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279367700 msgr2=0x55f279377440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279367700 0x55f279377440 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7efc040c9be0 tx=0x7efc04084040 comp rx=0 tx=0).stop 2023-09-13T09:50:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 -- 172.21.15.6:0/3129976946 shutdown_connections 2023-09-13T09:50:38.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279368060 0x55f27936fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f2793664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 --2- 172.21.15.6:0/3129976946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279367700 0x55f279377440 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 -- 172.21.15.6:0/3129976946 >> 172.21.15.6:0/3129976946 conn(0x55f2792c4c80 msgr2=0x55f27936ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.990+0000 7efc22755b80 1 -- 172.21.15.6:0/3129976946 shutdown_connections 2023-09-13T09:50:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 -- 172.21.15.6:0/3129976946 wait complete. 2023-09-13T09:50:38.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 -- start start 2023-09-13T09:50:38.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 Processor -- start 2023-09-13T09:50:38.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f279376d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279367700 0x55f279377280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f2793737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f279373ec0 con 0x55f279367700 2023-09-13T09:50:38.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f279374030 con 0x55f279368060 2023-09-13T09:50:38.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f2793741f0 con 0x55f279366a00 2023-09-13T09:50:38.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc22755b80 10 client.0 _ll_register_callbacks cb 0x55f279254680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279367700 0x55f279377280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc0ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f279376d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc0f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279367700 0x55f279377280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40760/0 (socket says 172.21.15.6:40760) 2023-09-13T09:50:38.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc0f7fe700 1 -- 172.21.15.6:0/3916492104 learned_addr learned my addr 172.21.15.6:0/3916492104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.991+0000 7efc14b0d700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f2793737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc0ffff700 1 -- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 msgr2=0x55f2793737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc0ffff700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f2793737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc0ffff700 1 -- 172.21.15.6:0/3916492104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279367700 msgr2=0x55f279377280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc0ffff700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279367700 0x55f279377280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc0ffff700 1 -- 172.21.15.6:0/3916492104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc0002a040 con 0x55f279366a00 2023-09-13T09:50:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc14b0d700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f2793737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279367700 0x55f279377280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc0ffff700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f279376d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55f27937ea50 tx=0x7efc00009fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3171c2b381b7e08 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efbef7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:50:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efbef7fe700 1 -- 172.21.15.6:0/3916492104 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc00033a90 con 0x55f279366a00 2023-09-13T09:50:38.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efbef7fe700 1 -- 172.21.15.6:0/3916492104 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efc00033bf0 con 0x55f279366a00 2023-09-13T09:50:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc00021070 con 0x55f279366a00 2023-09-13T09:50:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efbef7fe700 1 -- 172.21.15.6:0/3916492104 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc00033df0 con 0x55f279366a00 2023-09-13T09:50:38.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc22755b80 10 client.27682 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.992+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f2792d07a0 con 0x55f279366a00 2023-09-13T09:50:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efbef7fe700 1 -- 172.21.15.6:0/3916492104 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efc00042020 con 0x55f279366a00 2023-09-13T09:50:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efbef7fe700 1 -- 172.21.15.6:0/3916492104 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efc00005580 con 0x55f279366a00 2023-09-13T09:50:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc22755b80 10 client.27682 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc22755b80 10 client.27682 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:50:38.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc22755b80 20 client.27682 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc22755b80 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f2793d10f0 0x55f2793d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc22755b80 4 client.27682 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:38.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f279272050 con 0x55f2793d10f0 2023-09-13T09:50:38.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f2793d10f0 0x55f2793d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efbef7fe700 10 client.27682 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:38.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.993+0000 7efc0f7fe700 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f2793d10f0 0x55f2793d3510 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ba0dba52ce53a46 server_cookie=ce0e96460720a616 in_seq=0 out_seq=0 2023-09-13T09:50:38.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efbef7fe700 1 -- 172.21.15.6:0/3916492104 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f279272050 con 0x55f2793d10f0 2023-09-13T09:50:38.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efbef7fe700 10 client.27682 handle_command_reply: tid=0 2023-09-13T09:50:38.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 client.27682 shutdown 2023-09-13T09:50:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 msgr2=0x55f279376d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f279376d40 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x55f27937ea50 tx=0x7efc00009fb0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 shutdown_connections 2023-09-13T09:50:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f2793d10f0 0x55f2793d3510 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f279368060 0x55f2793737e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f279366a00 0x55f279376d40 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 --2- 172.21.15.6:0/3916492104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f279367700 0x55f279377280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 >> 172.21.15.6:0/3916492104 conn(0x55f2792c4c80 msgr2=0x55f27936a8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efbef7fe700 0 client.27682 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:50:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 shutdown_connections 2023-09-13T09:50:38.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 1 -- 172.21.15.6:0/3916492104 wait complete. 2023-09-13T09:50:38.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc22755b80 20 client.27682 trim_cache size 0 max 16384 2023-09-13T09:50:38.019 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:38.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efbf80a06a0 msgr2=0x7efbf80a2b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc16570700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efbf80a06a0 0x7efbf80a2b60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7efc10100d10 tx=0x7efc00009310 comp rx=0 tx=0).stop 2023-09-13T09:50:38.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10100eb0 msgr2=0x7efc1010f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.994+0000 7efc16570700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10100eb0 0x7efc1010f2b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efc0400e9a0 tx=0x7efc0400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 shutdown_connections 2023-09-13T09:50:38.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc10101850 0x7efc1010f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efbf80a06a0 0x7efbf80a2b60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc100ffcc0 0x7efc10110c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 --2- 172.21.15.6:0/897532863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efc10100eb0 0x7efc1010f2b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 >> 172.21.15.6:0/897532863 conn(0x7efc100fb250 msgr2=0x7efc100fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 shutdown_connections 2023-09-13T09:50:38.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:37.995+0000 7efc16570700 1 -- 172.21.15.6:0/897532863 wait complete. 2023-09-13T09:50:38.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:50:38.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 -- 172.21.15.6:0/639591451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 msgr2=0x7f0d60109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 --2- 172.21.15.6:0/639591451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 0x7f0d60109200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009fc0 tx=0x7f0d5800b330 comp rx=0 tx=0).stop 2023-09-13T09:50:38.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 -- 172.21.15.6:0/639591451 shutdown_connections 2023-09-13T09:50:38.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 --2- 172.21.15.6:0/639591451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 0x7f0d60109200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 --2- 172.21.15.6:0/639591451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d60100dc0 0x7f0d601011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 --2- 172.21.15.6:0/639591451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d60101fb0 0x7f0d60102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 -- 172.21.15.6:0/639591451 >> 172.21.15.6:0/639591451 conn(0x7f0d600fc330 msgr2=0x7f0d600fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 -- 172.21.15.6:0/639591451 shutdown_connections 2023-09-13T09:50:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.163+0000 7f0d652b1700 1 -- 172.21.15.6:0/639591451 wait complete. 2023-09-13T09:50:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 Processor -- start 2023-09-13T09:50:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 -- start start 2023-09-13T09:50:38.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d60100dc0 0x7f0d60196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d60101fb0 0x7f0d60197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 0x7f0d6019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6019e6a0 con 0x7f0d60101fb0 2023-09-13T09:50:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6019e7e0 con 0x7f0d60102950 2023-09-13T09:50:38.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d652b1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d6019e970 con 0x7f0d60100dc0 2023-09-13T09:50:38.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d60101fb0 0x7f0d60197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d60100dc0 0x7f0d60196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 0x7f0d6019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d60100dc0 0x7f0d60196b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43824/0 (socket says 172.21.15.6:43824) 2023-09-13T09:50:38.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 0x7f0d6019e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34298/0 (socket says 172.21.15.6:34298) 2023-09-13T09:50:38.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5effd700 1 -- 172.21.15.6:0/1627523342 learned_addr learned my addr 172.21.15.6:0/1627523342 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5e7fc700 1 -- 172.21.15.6:0/1627523342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d60100dc0 msgr2=0x7f0d60196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d60100dc0 0x7f0d60196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5e7fc700 1 -- 172.21.15.6:0/1627523342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 msgr2=0x7f0d6019e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.164+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 0x7f0d6019e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.165+0000 7f0d5e7fc700 1 -- 172.21.15.6:0/1627523342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d500095f0 con 0x7f0d60101fb0 2023-09-13T09:50:38.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.165+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d60101fb0 0x7f0d60197060 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400e9f0 tx=0x7f0d5400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.165+0000 7f0d47fff700 1 -- 172.21.15.6:0/1627523342 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5400c9c0 con 0x7f0d60101fb0 2023-09-13T09:50:38.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.165+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d58009c40 con 0x7f0d60101fb0 2023-09-13T09:50:38.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.165+0000 7f0d47fff700 1 -- 172.21.15.6:0/1627523342 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d54010430 con 0x7f0d60101fb0 2023-09-13T09:50:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.165+0000 7f0d47fff700 1 -- 172.21.15.6:0/1627523342 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d54018680 con 0x7f0d60101fb0 2023-09-13T09:50:38.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.165+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d6019efd0 con 0x7f0d60101fb0 2023-09-13T09:50:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.167+0000 7f0d47fff700 1 -- 172.21.15.6:0/1627523342 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0d54010860 con 0x7f0d60101fb0 2023-09-13T09:50:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.168+0000 7f0d47fff700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d480a0640 0x7f0d480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.168+0000 7f0d47fff700 1 -- 172.21.15.6:0/1627523342 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0d54014070 con 0x7f0d60101fb0 2023-09-13T09:50:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.168+0000 7f0d5effd700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d480a0640 0x7f0d480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.168+0000 7f0d5effd700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d480a0640 0x7f0d480a2b00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0d50005950 tx=0x7f0d50009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 Processor -- start 2023-09-13T09:50:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 -- start start 2023-09-13T09:50:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdce9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdce88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdc3d780 con 0x5584cdce8e10 2023-09-13T09:50:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdc3b0a0 con 0x5584cdcea470 2023-09-13T09:50:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d71496b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdc36990 con 0x5584cdce9b10 2023-09-13T09:50:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40782/0 (socket says 172.21.15.6:40782) 2023-09-13T09:50:38.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d5f7fe700 1 -- 172.21.15.6:0/4272155177 learned_addr learned my addr 172.21.15.6:0/4272155177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdce88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.169+0000 7f0d5effd700 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdce9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d5f7fe700 1 -- 172.21.15.6:0/4272155177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 msgr2=0x5584cdce9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdce9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d5f7fe700 1 -- 172.21.15.6:0/4272155177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 msgr2=0x5584cdce88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdce88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d5f7fe700 1 -- 172.21.15.6:0/4272155177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584cdab6630 con 0x5584cdce8e10 2023-09-13T09:50:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdce88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce9290 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009c00 tx=0x7f0d580092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7cdcab8703bcc8f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d457fa700 1 -- 172.21.15.6:0/4272155177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800e040 con 0x5584cdce8e10 2023-09-13T09:50:38.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d457fa700 1 -- 172.21.15.6:0/4272155177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d580073e0 con 0x5584cdce8e10 2023-09-13T09:50:38.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.170+0000 7f0d457fa700 1 -- 172.21.15.6:0/4272155177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800bc50 con 0x5584cdce8e10 2023-09-13T09:50:38.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 -- 172.21.15.6:0/4272155177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 msgr2=0x5584cdce9290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce9290 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7f0d58009c00 tx=0x7f0d580092e0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 -- 172.21.15.6:0/4272155177 shutdown_connections 2023-09-13T09:50:38.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce9290 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdce9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4272155177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdce88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 -- 172.21.15.6:0/4272155177 >> 172.21.15.6:0/4272155177 conn(0x5584cdc42c80 msgr2=0x5584cdcdef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 -- 172.21.15.6:0/4272155177 shutdown_connections 2023-09-13T09:50:38.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 -- 172.21.15.6:0/4272155177 wait complete. 2023-09-13T09:50:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 -- start start 2023-09-13T09:50:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 Processor -- start 2023-09-13T09:50:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdcf2250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf2790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.171+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdcea470 0x5584cdcf97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d71496b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdbd4bb0 con 0x5584cdce8e10 2023-09-13T09:50:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d71496b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdbd48b0 con 0x5584cdce9b10 2023-09-13T09:50:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d71496b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdab8920 con 0x5584cdcea470 2023-09-13T09:50:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d71496b80 10 client.0 _ll_register_callbacks cb 0x5584cdbd2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdcf2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdcf2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40784/0 (socket says 172.21.15.6:40784) 2023-09-13T09:50:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 -- 172.21.15.6:0/3543743961 learned_addr learned my addr 172.21.15.6:0/3543743961 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdcea470 0x5584cdcf97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 -- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdcea470 msgr2=0x5584cdcf97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdcea470 0x5584cdcf97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 -- 172.21.15.6:0/3543743961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 msgr2=0x5584cdcf2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 -- 172.21.15.6:0/3543743961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d60109b50 con 0x5584cdce8e10 2023-09-13T09:50:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d5effd700 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdcf2250 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000ee00 tx=0x7f0d500047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dff604f321a97f1b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:38.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d42ff5700 1 -- 172.21.15.6:0/3543743961 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d50022070 con 0x5584cdce8e10 2023-09-13T09:50:38.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d42ff5700 1 -- 172.21.15.6:0/3543743961 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0d5000ee30 con 0x5584cdce8e10 2023-09-13T09:50:38.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584cdcd7670 con 0x5584cdce8e10 2023-09-13T09:50:38.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d42ff5700 1 -- 172.21.15.6:0/3543743961 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d5001dd10 con 0x5584cdce8e10 2023-09-13T09:50:38.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d71496b80 10 client.18375 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.172+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5584cdc4e7a0 con 0x5584cdce8e10 2023-09-13T09:50:38.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d42ff5700 1 -- 172.21.15.6:0/3543743961 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d50035080 con 0x5584cdce8e10 2023-09-13T09:50:38.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d42ff5700 1 -- 172.21.15.6:0/3543743961 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d500264a0 con 0x5584cdce8e10 2023-09-13T09:50:38.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d71496b80 10 client.18375 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d71496b80 10 client.18375 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:50:38.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d71496b80 20 client.18375 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d71496b80 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdcfe130 0x5584cdd00550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d71496b80 4 client.18375 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:38.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584cdc2f970 con 0x5584cdcfe130 2023-09-13T09:50:38.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdcfe130 0x5584cdd00550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d42ff5700 10 client.18375 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:38.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.173+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdcfe130 0x5584cdd00550 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=cca0246498ed54ef server_cookie=c1f99f73cec38958 in_seq=0 out_seq=0 2023-09-13T09:50:38.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d42ff5700 1 -- 172.21.15.6:0/3543743961 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5584cdc2f970 con 0x5584cdcfe130 2023-09-13T09:50:38.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d42ff5700 10 client.18375 handle_command_reply: tid=0 2023-09-13T09:50:38.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 client.18375 shutdown 2023-09-13T09:50:38.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 msgr2=0x5584cdcf2250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdcf2250 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f0d5000ee00 tx=0x7f0d500047c0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 shutdown_connections 2023-09-13T09:50:38.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdcfe130 0x5584cdd00550 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdcea470 0x5584cdcf97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d42ff5700 0 client.18375 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:38.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdcf2250 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 --2- 172.21.15.6:0/3543743961 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 >> 172.21.15.6:0/3543743961 conn(0x5584cdc42c80 msgr2=0x5584cdcdeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 shutdown_connections 2023-09-13T09:50:38.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 1 -- 172.21.15.6:0/3543743961 wait complete. 2023-09-13T09:50:38.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.174+0000 7f0d71496b80 20 client.18375 trim_cache size 0 max 16384 2023-09-13T09:50:38.196 INFO:tasks.workunit.client.0.smithi006.stdout: 1 664182 6.48 MB/sec execute 478 sec latency 15.796 ms 2023-09-13T09:50:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.188+0000 7f0d71496b80 1 Processor -- start 2023-09-13T09:50:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.188+0000 7f0d71496b80 1 -- start start 2023-09-13T09:50:38.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdcf9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdceccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d71496b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdced7c0 con 0x5584cdce8e10 2023-09-13T09:50:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d71496b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdcfde30 con 0x5584cdcea470 2023-09-13T09:50:38.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d71496b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdd04eb0 con 0x5584cdce9b10 2023-09-13T09:50:38.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdcf9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40792/0 (socket says 172.21.15.6:40792) 2023-09-13T09:50:38.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdceccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5effd700 1 -- 172.21.15.6:0/298223232 learned_addr learned my addr 172.21.15.6:0/298223232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5f7fe700 1 -- 172.21.15.6:0/298223232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 msgr2=0x5584cdcf9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdcf9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5f7fe700 1 -- 172.21.15.6:0/298223232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 msgr2=0x5584cdce88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5f7fe700 1 -- 172.21.15.6:0/298223232 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584cda62de0 con 0x5584cdcea470 2023-09-13T09:50:38.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdcf9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5effd700 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdceccb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d58007900 tx=0x7f0d580096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9c085ff763bea34 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.189+0000 7f0d45ffb700 1 -- 172.21.15.6:0/298223232 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5800e040 con 0x5584cdcea470 2023-09-13T09:50:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d45ffb700 1 -- 172.21.15.6:0/298223232 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d58007610 con 0x5584cdcea470 2023-09-13T09:50:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d45ffb700 1 -- 172.21.15.6:0/298223232 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d58025460 con 0x5584cdcea470 2023-09-13T09:50:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 -- 172.21.15.6:0/298223232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 msgr2=0x5584cdceccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdceccb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0d58007900 tx=0x7f0d580096c0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 -- 172.21.15.6:0/298223232 shutdown_connections 2023-09-13T09:50:38.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdcea470 0x5584cdceccb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdce8e10 0x5584cdce88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 --2- 172.21.15.6:0/298223232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce9b10 0x5584cdcf9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 -- 172.21.15.6:0/298223232 >> 172.21.15.6:0/298223232 conn(0x5584cdc42c80 msgr2=0x5584cdcf0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 -- 172.21.15.6:0/298223232 shutdown_connections 2023-09-13T09:50:38.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.190+0000 7f0d71496b80 1 -- 172.21.15.6:0/298223232 wait complete. 2023-09-13T09:50:38.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 -- start start 2023-09-13T09:50:38.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 Processor -- start 2023-09-13T09:50:38.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce8e10 0x5584cdcf59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdcea470 0x5584cdcf8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdcf90f0 con 0x5584cdcea470 2023-09-13T09:50:38.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdcf9260 con 0x5584cdce9b10 2023-09-13T09:50:38.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584cdcf9420 con 0x5584cdce8e10 2023-09-13T09:50:38.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d71496b80 10 client.0 _ll_register_callbacks cb 0x5584cdbd2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdcea470 0x5584cdcf8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34324/0 (socket says 172.21.15.6:34324) 2023-09-13T09:50:38.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 -- 172.21.15.6:0/4264960722 learned_addr learned my addr 172.21.15.6:0/4264960722 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5effd700 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce8e10 0x5584cdcf59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 -- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce8e10 msgr2=0x5584cdcf59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce8e10 0x5584cdcf59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 -- 172.21.15.6:0/4264960722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdcea470 msgr2=0x5584cdcf8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdcea470 0x5584cdcf8bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5e7fc700 1 -- 172.21.15.6:0/4264960722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584cdc4e7a0 con 0x5584cdce9b10 2023-09-13T09:50:38.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.191+0000 7f0d5f7fe700 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdcea470 0x5584cdcf8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d5e7fc700 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf5f00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0d540c9b40 tx=0x7f0d54084040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5beb0051d353ea7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d42ff5700 1 -- 172.21.15.6:0/4264960722 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d5409d2f0 con 0x5584cdce9b10 2023-09-13T09:50:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d42ff5700 1 -- 172.21.15.6:0/4264960722 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0d540a1530 con 0x5584cdce9b10 2023-09-13T09:50:38.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d580073e0 con 0x5584cdce9b10 2023-09-13T09:50:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d42ff5700 1 -- 172.21.15.6:0/4264960722 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d54065240 con 0x5584cdce9b10 2023-09-13T09:50:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 10 client.27776 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f0d58009c40 con 0x5584cdce9b10 2023-09-13T09:50:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d42ff5700 1 -- 172.21.15.6:0/4264960722 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d5407d080 con 0x5584cdce9b10 2023-09-13T09:50:38.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d42ff5700 1 -- 172.21.15.6:0/4264960722 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0d540b7260 con 0x5584cdce9b10 2023-09-13T09:50:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 10 client.27776 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 10 client.27776 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:50:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 20 client.27776 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdd530f0 0x5584cdd55510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 4 client.27776 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5584cdbf0050 con 0x5584cdd530f0 2023-09-13T09:50:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.192+0000 7f0d5effd700 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdd530f0 0x5584cdd55510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d42ff5700 10 client.27776 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d5effd700 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdd530f0 0x5584cdd55510 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=354c4e8e74425aa9 server_cookie=a572338d4366c4a7 in_seq=0 out_seq=0 2023-09-13T09:50:38.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d42ff5700 1 -- 172.21.15.6:0/4264960722 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5584cdbf0050 con 0x5584cdd530f0 2023-09-13T09:50:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d42ff5700 10 client.27776 handle_command_reply: tid=0 2023-09-13T09:50:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 client.27776 shutdown 2023-09-13T09:50:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 msgr2=0x5584cdcf5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf5f00 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0d540c9b40 tx=0x7f0d54084040 comp rx=0 tx=0).stop 2023-09-13T09:50:38.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 shutdown_connections 2023-09-13T09:50:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5584cdd530f0 0x5584cdd55510 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5584cdcea470 0x5584cdcf8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5584cdce8e10 0x5584cdcf59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 --2- 172.21.15.6:0/4264960722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5584cdce9b10 0x5584cdcf5f00 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d42ff5700 0 client.27776 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:50:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 >> 172.21.15.6:0/4264960722 conn(0x5584cdc42c80 msgr2=0x5584cdceccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 shutdown_connections 2023-09-13T09:50:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 1 -- 172.21.15.6:0/4264960722 wait complete. 2023-09-13T09:50:38.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.193+0000 7f0d71496b80 20 client.27776 trim_cache size 0 max 16384 2023-09-13T09:50:38.220 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d480a0640 msgr2=0x7f0d480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d480a0640 0x7f0d480a2b00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0d50005950 tx=0x7f0d50009310 comp rx=0 tx=0).stop 2023-09-13T09:50:38.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d60101fb0 msgr2=0x7f0d60197060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d60101fb0 0x7f0d60197060 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f0d5400e9f0 tx=0x7f0d5400ed00 comp rx=0 tx=0).stop 2023-09-13T09:50:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 shutdown_connections 2023-09-13T09:50:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d60102950 0x7f0d6019e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d60100dc0 0x7f0d60196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d480a0640 0x7f0d480a2b00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 --2- 172.21.15.6:0/1627523342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d60101fb0 0x7f0d60197060 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 >> 172.21.15.6:0/1627523342 conn(0x7f0d600fc330 msgr2=0x7f0d60105390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 shutdown_connections 2023-09-13T09:50:38.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.194+0000 7f0d652b1700 1 -- 172.21.15.6:0/1627523342 wait complete. 2023-09-13T09:50:38.224 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:50:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.356+0000 7f1c1a0de700 1 -- 172.21.15.6:0/410084673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c141041b0 msgr2=0x7f1c141065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.356+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/410084673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c141041b0 0x7f1c141065a0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f1c08009990 tx=0x7f1c08009ca0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.356+0000 7f1c1a0de700 1 -- 172.21.15.6:0/410084673 shutdown_connections 2023-09-13T09:50:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.356+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/410084673 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c14106ae0 0x7f1c14108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.356+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/410084673 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c14101880 0x7f1c14103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.356+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/410084673 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c141041b0 0x7f1c141065a0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.356+0000 7f1c1a0de700 1 -- 172.21.15.6:0/410084673 >> 172.21.15.6:0/410084673 conn(0x7f1c140fb250 msgr2=0x7f1c140fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 -- 172.21.15.6:0/410084673 shutdown_connections 2023-09-13T09:50:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 -- 172.21.15.6:0/410084673 wait complete. 2023-09-13T09:50:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 Processor -- start 2023-09-13T09:50:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 -- start start 2023-09-13T09:50:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c14101880 0x7f1c14196ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c141041b0 0x7f1c14197010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c14106ae0 0x7f1c1419e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1419e650 con 0x7f1c14106ae0 2023-09-13T09:50:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1419e790 con 0x7f1c141041b0 2023-09-13T09:50:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.357+0000 7f1c1a0de700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1419e920 con 0x7f1c14101880 2023-09-13T09:50:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c14106ae0 0x7f1c1419e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c14106ae0 0x7f1c1419e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40816/0 (socket says 172.21.15.6:40816) 2023-09-13T09:50:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 -- 172.21.15.6:0/3632217847 learned_addr learned my addr 172.21.15.6:0/3632217847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c141041b0 0x7f1c14197010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c137fe700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c14101880 0x7f1c14196ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 -- 172.21.15.6:0/3632217847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c14101880 msgr2=0x7f1c14196ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c14101880 0x7f1c14196ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 -- 172.21.15.6:0/3632217847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c141041b0 msgr2=0x7f1c14197010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c141041b0 0x7f1c14197010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 -- 172.21.15.6:0/3632217847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c080095f0 con 0x7f1c14106ae0 2023-09-13T09:50:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c13fff700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c14106ae0 0x7f1c1419e080 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c007ee0 tx=0x7f1c0c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c10ff9700 1 -- 172.21.15.6:0/3632217847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c00dd20 con 0x7f1c14106ae0 2023-09-13T09:50:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c10ff9700 1 -- 172.21.15.6:0/3632217847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c0c00f040 con 0x7f1c14106ae0 2023-09-13T09:50:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1419ec00 con 0x7f1c14106ae0 2023-09-13T09:50:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c10ff9700 1 -- 172.21.15.6:0/3632217847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0048a0 con 0x7f1c14106ae0 2023-09-13T09:50:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.358+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1419f0c0 con 0x7f1c14106ae0 2023-09-13T09:50:38.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.361+0000 7f1c10ff9700 1 -- 172.21.15.6:0/3632217847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1c0c003a00 con 0x7f1c14106ae0 2023-09-13T09:50:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.361+0000 7f1c10ff9700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bfc0a0640 0x7f1bfc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.361+0000 7f1c10ff9700 1 -- 172.21.15.6:0/3632217847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1c0c0cb440 con 0x7f1c14106ae0 2023-09-13T09:50:38.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.361+0000 7f1c137fe700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bfc0a0640 0x7f1bfc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c137fe700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bfc0a0640 0x7f1bfc0a2b00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009c60 tx=0x7f1c04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 Processor -- start 2023-09-13T09:50:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 -- start start 2023-09-13T09:50:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a7fab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fb060 0x55948a7f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7f9a00 0x55948a7f9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a752780 con 0x55948a7f9a00 2023-09-13T09:50:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a7500a0 con 0x55948a7fb060 2023-09-13T09:50:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a74b990 con 0x55948a7fa700 2023-09-13T09:50:38.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7f9a00 0x55948a7f9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7f9a00 0x55948a7f9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40824/0 (socket says 172.21.15.6:40824) 2023-09-13T09:50:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c13fff700 1 -- 172.21.15.6:0/3052342280 learned_addr learned my addr 172.21.15.6:0/3052342280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.362+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fb060 0x55948a7f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c137fe700 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a7fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c13fff700 1 -- 172.21.15.6:0/3052342280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 msgr2=0x55948a7fab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c13fff700 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a7fab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c13fff700 1 -- 172.21.15.6:0/3052342280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fb060 msgr2=0x55948a7f94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c13fff700 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fb060 0x55948a7f94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c13fff700 1 -- 172.21.15.6:0/3052342280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55948a5cb630 con 0x55948a7f9a00 2023-09-13T09:50:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fb060 0x55948a7f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1c13fff700 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7f9a00 0x55948a7f9e80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0a0720 tx=0x7f1c0c098ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7526384c6c6516 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1bf9ffb700 1 -- 172.21.15.6:0/3052342280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c09ca10 con 0x55948a7f9a00 2023-09-13T09:50:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1bf9ffb700 1 -- 172.21.15.6:0/3052342280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c0c0a0c50 con 0x55948a7f9a00 2023-09-13T09:50:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.363+0000 7f1bf9ffb700 1 -- 172.21.15.6:0/3052342280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c0b8070 con 0x55948a7f9a00 2023-09-13T09:50:38.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3052342280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7f9a00 msgr2=0x55948a7f9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7f9a00 0x55948a7f9e80 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0a0720 tx=0x7f1c0c098ac0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3052342280 shutdown_connections 2023-09-13T09:50:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7f9a00 0x55948a7f9e80 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a7fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3052342280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fb060 0x55948a7f94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3052342280 >> 172.21.15.6:0/3052342280 conn(0x55948a757c80 msgr2=0x55948a7f3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3052342280 shutdown_connections 2023-09-13T09:50:38.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3052342280 wait complete. 2023-09-13T09:50:38.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 -- start start 2023-09-13T09:50:38.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.364+0000 7f1c262c3b80 1 Processor -- start 2023-09-13T09:50:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a802f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a803480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7fb060 0x55948a80a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a6e9bb0 con 0x55948a7fb060 2023-09-13T09:50:38.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a6e98b0 con 0x55948a7f9a00 2023-09-13T09:50:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a5cd920 con 0x55948a7fa700 2023-09-13T09:50:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a802f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7fb060 0x55948a80a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c12ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a803480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c262c3b80 10 client.0 _ll_register_callbacks cb 0x55948a6e7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a802f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34350/0 (socket says 172.21.15.6:34350) 2023-09-13T09:50:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7fb060 0x55948a80a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40830/0 (socket says 172.21.15.6:40830) 2023-09-13T09:50:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c137fe700 1 -- 172.21.15.6:0/897029017 learned_addr learned my addr 172.21.15.6:0/897029017 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 -- 172.21.15.6:0/897029017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 msgr2=0x55948a803480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a803480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 -- 172.21.15.6:0/897029017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 msgr2=0x55948a802f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a802f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 -- 172.21.15.6:0/897029017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1419f0c0 con 0x55948a7fb060 2023-09-13T09:50:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1c13fff700 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7fb060 0x55948a80a4c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0c9260 tx=0x7f1c0c098d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a924685a05eef2b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.365+0000 7f1bf2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:38.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/897029017 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c0c09ca10 con 0x55948a7fb060 2023-09-13T09:50:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/897029017 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1c0c0980d0 con 0x55948a7fb060 2023-09-13T09:50:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55948a7ec670 con 0x55948a7fb060 2023-09-13T09:50:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/897029017 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c0c098290 con 0x55948a7fb060 2023-09-13T09:50:38.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 10 client.18393 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55948a7637a0 con 0x55948a7fb060 2023-09-13T09:50:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/897029017 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c0c07b020 con 0x55948a7fb060 2023-09-13T09:50:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/897029017 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1c0c0b8050 con 0x55948a7fb060 2023-09-13T09:50:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 10 client.18393 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 10 client.18393 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:50:38.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 20 client.18393 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a80e900 0x55948a810cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 4 client.18393 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55948a744970 con 0x55948a80e900 2023-09-13T09:50:38.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.366+0000 7f1c137fe700 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a80e900 0x55948a810cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.367+0000 7f1bf2ffd700 10 client.18393 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:38.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.367+0000 7f1c137fe700 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a80e900 0x55948a810cf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=30e40bc053ef9c98 server_cookie=f3e73551d1222c06 in_seq=0 out_seq=0 2023-09-13T09:50:38.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.367+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/897029017 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55948a744970 con 0x55948a80e900 2023-09-13T09:50:38.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.367+0000 7f1bf2ffd700 10 client.18393 handle_command_reply: tid=0 2023-09-13T09:50:38.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.367+0000 7f1c262c3b80 1 client.18393 shutdown 2023-09-13T09:50:38.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7fb060 msgr2=0x55948a80a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7fb060 0x55948a80a4c0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0c9260 tx=0x7f1c0c098d30 comp rx=0 tx=0).stop 2023-09-13T09:50:38.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 shutdown_connections 2023-09-13T09:50:38.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a80e900 0x55948a810cf0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a7fb060 0x55948a80a4c0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a802f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1bf2ffd700 0 client.18393 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/897029017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a803480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 >> 172.21.15.6:0/897029017 conn(0x55948a757c80 msgr2=0x55948a7ee7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 shutdown_connections 2023-09-13T09:50:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 1 -- 172.21.15.6:0/897029017 wait complete. 2023-09-13T09:50:38.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.368+0000 7f1c262c3b80 20 client.18393 trim_cache size 0 max 16384 2023-09-13T09:50:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.381+0000 7f1c262c3b80 1 Processor -- start 2023-09-13T09:50:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.381+0000 7f1c262c3b80 1 -- start start 2023-09-13T09:50:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a7f94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7f9a00 0x55948a80a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fa700 0x55948a801bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a803bf0 con 0x55948a757c80 2023-09-13T09:50:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a7fe490 con 0x55948a7fa700 2023-09-13T09:50:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a7f5970 con 0x55948a7f9a00 2023-09-13T09:50:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a7f94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a7f94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40834/0 (socket says 172.21.15.6:40834) 2023-09-13T09:50:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 -- 172.21.15.6:0/729435113 learned_addr learned my addr 172.21.15.6:0/729435113 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c13fff700 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fa700 0x55948a801bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7f9a00 0x55948a80a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 -- 172.21.15.6:0/729435113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7f9a00 msgr2=0x55948a80a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7f9a00 0x55948a80a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 -- 172.21.15.6:0/729435113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fa700 msgr2=0x55948a801bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fa700 0x55948a801bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 -- 172.21.15.6:0/729435113 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55948a577de0 con 0x55948a757c80 2023-09-13T09:50:38.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7f9a00 0x55948a80a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:50:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.382+0000 7f1c137fe700 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a7f94c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f1c04013010 tx=0x7f1c04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6976fc8c61449a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.383+0000 7f1bfa7fc700 1 -- 172.21.15.6:0/729435113 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04023070 con 0x55948a757c80 2023-09-13T09:50:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.383+0000 7f1bfa7fc700 1 -- 172.21.15.6:0/729435113 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c04024040 con 0x55948a757c80 2023-09-13T09:50:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.383+0000 7f1bfa7fc700 1 -- 172.21.15.6:0/729435113 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04027730 con 0x55948a757c80 2023-09-13T09:50:38.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 -- 172.21.15.6:0/729435113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 msgr2=0x55948a7f94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a7f94c0 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f1c04013010 tx=0x7f1c04014000 comp rx=0 tx=0).stop 2023-09-13T09:50:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 -- 172.21.15.6:0/729435113 shutdown_connections 2023-09-13T09:50:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7fa700 0x55948a801bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a7f94c0 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/729435113 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7f9a00 0x55948a80a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 -- 172.21.15.6:0/729435113 >> 172.21.15.6:0/729435113 conn(0x55948a7f4240 msgr2=0x55948a80ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 -- 172.21.15.6:0/729435113 shutdown_connections 2023-09-13T09:50:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 -- 172.21.15.6:0/729435113 wait complete. 2023-09-13T09:50:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.384+0000 7f1c262c3b80 1 -- start start 2023-09-13T09:50:38.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 1 Processor -- start 2023-09-13T09:50:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a80a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a806d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a807290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a807970 con 0x55948a757c80 2023-09-13T09:50:38.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a8626f0 con 0x55948a7f9a00 2023-09-13T09:50:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55948a862830 con 0x55948a7fa700 2023-09-13T09:50:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c262c3b80 10 client.0 _ll_register_callbacks cb 0x55948a6e7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a80a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a80a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40840/0 (socket says 172.21.15.6:40840) 2023-09-13T09:50:38.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c12ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a806d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 -- 172.21.15.6:0/3915142195 learned_addr learned my addr 172.21.15.6:0/3915142195 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c13fff700 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a807290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 -- 172.21.15.6:0/3915142195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 msgr2=0x55948a807290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a807290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 -- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 msgr2=0x55948a806d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a806d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c137fe700 1 -- 172.21.15.6:0/3915142195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c04017070 con 0x55948a757c80 2023-09-13T09:50:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.385+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a806d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c137fe700 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a80a2b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f1c0401e4b0 tx=0x7f1c04004680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c984b43328ab197 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1bf2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:38.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/3915142195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c04023040 con 0x55948a757c80 2023-09-13T09:50:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/3915142195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1c04005450 con 0x55948a757c80 2023-09-13T09:50:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c0c0a0c50 con 0x55948a757c80 2023-09-13T09:50:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/3915142195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c04005650 con 0x55948a757c80 2023-09-13T09:50:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 10 client.18399 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55948a560c60 con 0x55948a757c80 2023-09-13T09:50:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/3915142195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1c0c0a0c50 con 0x55948a757c80 2023-09-13T09:50:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/3915142195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1c04036020 con 0x55948a757c80 2023-09-13T09:50:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 10 client.18399 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 10 client.18399 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:50:38.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 20 client.18399 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a7fb060 0x55948a8662e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 4 client.18399 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55948a705050 con 0x55948a7fb060 2023-09-13T09:50:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.386+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a7fb060 0x55948a8662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1bf2ffd700 10 client.18399 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c12ffd700 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a7fb060 0x55948a8662e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=33d98fb4d16de1ce server_cookie=c0aae712a5a898f7 in_seq=0 out_seq=0 2023-09-13T09:50:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1bf2ffd700 1 -- 172.21.15.6:0/3915142195 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55948a705050 con 0x55948a7fb060 2023-09-13T09:50:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1bf2ffd700 10 client.18399 handle_command_reply: tid=0 2023-09-13T09:50:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 client.18399 shutdown 2023-09-13T09:50:38.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 msgr2=0x55948a80a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a80a2b0 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f1c0401e4b0 tx=0x7f1c04004680 comp rx=0 tx=0).stop 2023-09-13T09:50:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 shutdown_connections 2023-09-13T09:50:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55948a7fb060 0x55948a8662e0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55948a7fa700 0x55948a807290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55948a757c80 0x55948a80a2b0 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1bf2ffd700 0 client.18399 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:50:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 --2- 172.21.15.6:0/3915142195 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55948a7f9a00 0x55948a806d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 >> 172.21.15.6:0/3915142195 conn(0x55948a7f4240 msgr2=0x55948a801bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 shutdown_connections 2023-09-13T09:50:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 1 -- 172.21.15.6:0/3915142195 wait complete. 2023-09-13T09:50:38.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.387+0000 7f1c262c3b80 20 client.18399 trim_cache size 0 max 16384 2023-09-13T09:50:38.415 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bfc0a0640 msgr2=0x7f1bfc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bfc0a0640 0x7f1bfc0a2b00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f1c04009c60 tx=0x7f1c04009260 comp rx=0 tx=0).stop 2023-09-13T09:50:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c14106ae0 msgr2=0x7f1c1419e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c14106ae0 0x7f1c1419e080 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c007ee0 tx=0x7f1c0c00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 shutdown_connections 2023-09-13T09:50:38.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1bfc0a0640 0x7f1bfc0a2b00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c14106ae0 0x7f1c1419e080 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c14101880 0x7f1c14196ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 --2- 172.21.15.6:0/3632217847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1c141041b0 0x7f1c14197010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 >> 172.21.15.6:0/3632217847 conn(0x7f1c140fb250 msgr2=0x7f1c141024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 shutdown_connections 2023-09-13T09:50:38.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.388+0000 7f1c1a0de700 1 -- 172.21.15.6:0/3632217847 wait complete. 2023-09-13T09:50:38.418 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:38 smithi006 ceph-mon[98665]: pgmap v633: 97 pgs: 97 active+clean; 261 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:50:38.419 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:38 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/858962883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:50:38.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:50:38.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:38 smithi053 ceph-mon[102373]: pgmap v633: 97 pgs: 97 active+clean; 261 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:50:38.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:38 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/858962883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:50:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:38 smithi131 ceph-mon[102785]: pgmap v633: 97 pgs: 97 active+clean; 261 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 653 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:50:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:38 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/858962883' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:50:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/1230450948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac101270 msgr2=0x7f8cac101690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/1230450948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac101270 0x7f8cac101690 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009990 tx=0x7f8c9c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/1230450948 shutdown_connections 2023-09-13T09:50:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/1230450948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cac100880 0x7f8cac108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/1230450948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac101270 0x7f8cac101690 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/1230450948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ffec0 0x7f8cac100340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/1230450948 >> 172.21.15.6:0/1230450948 conn(0x7f8cac0fa9b0 msgr2=0x7f8cac0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/1230450948 shutdown_connections 2023-09-13T09:50:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/1230450948 wait complete. 2023-09-13T09:50:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 Processor -- start 2023-09-13T09:50:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.554+0000 7f8cb1dcb700 1 -- start start 2023-09-13T09:50:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cb1dcb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ffec0 0x7f8cac195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cb1dcb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac100880 0x7f8cac195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cb1dcb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cac101270 0x7f8cac19cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cb1dcb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac19d4e0 con 0x7f8cac100880 2023-09-13T09:50:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cb1dcb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac19d620 con 0x7f8cac101270 2023-09-13T09:50:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cb1dcb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac19d7b0 con 0x7f8cac0ffec0 2023-09-13T09:50:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac100880 0x7f8cac195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cac101270 0x7f8cac19cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ffec0 0x7f8cac195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac100880 0x7f8cac195ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40856/0 (socket says 172.21.15.6:40856) 2023-09-13T09:50:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 -- 172.21.15.6:0/4109728329 learned_addr learned my addr 172.21.15.6:0/4109728329 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 -- 172.21.15.6:0/4109728329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ffec0 msgr2=0x7f8cac195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ffec0 0x7f8cac195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 -- 172.21.15.6:0/4109728329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cac101270 msgr2=0x7f8cac19cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cac101270 0x7f8cac19cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 -- 172.21.15.6:0/4109728329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c9c0095f0 con 0x7f8cac100880 2023-09-13T09:50:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cabfff700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cac101270 0x7f8cac19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ffec0 0x7f8cac195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8caaffd700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac100880 0x7f8cac195ea0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000eab0 tx=0x7f8ca000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.555+0000 7f8ca8ff9700 1 -- 172.21.15.6:0/4109728329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca0013070 con 0x7f8cac100880 2023-09-13T09:50:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.556+0000 7f8ca8ff9700 1 -- 172.21.15.6:0/4109728329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ca000be80 con 0x7f8cac100880 2023-09-13T09:50:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.556+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cac0fee10 con 0x7f8cac100880 2023-09-13T09:50:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.556+0000 7f8ca8ff9700 1 -- 172.21.15.6:0/4109728329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca00163b0 con 0x7f8cac100880 2023-09-13T09:50:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.556+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac0ff320 con 0x7f8cac100880 2023-09-13T09:50:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.558+0000 7f8ca8ff9700 1 -- 172.21.15.6:0/4109728329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8ca00175a0 con 0x7f8cac100880 2023-09-13T09:50:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.558+0000 7f8ca8ff9700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c940a0640 0x7f8c940a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.559+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c940a0640 0x7f8c940a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.559+0000 7f8ca8ff9700 1 -- 172.21.15.6:0/4109728329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8ca00cd1a0 con 0x7f8cac100880 2023-09-13T09:50:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.559+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c940a0640 0x7f8c940a2b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00b2e0 tx=0x7f8c9c005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.559+0000 7f8cbdfb0b80 1 Processor -- start 2023-09-13T09:50:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.559+0000 7f8cbdfb0b80 1 -- start start 2023-09-13T09:50:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.559+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140c5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31401e780 con 0x55f3140c7060 2023-09-13T09:50:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f31401c0a0 con 0x55f3140c6700 2023-09-13T09:50:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f314017990 con 0x55f3140c5a00 2023-09-13T09:50:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8caaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34386/0 (socket says 172.21.15.6:34386) 2023-09-13T09:50:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 -- 172.21.15.6:0/490181517 learned_addr learned my addr 172.21.15.6:0/490181517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8caaffd700 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140c54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40864/0 (socket says 172.21.15.6:40864) 2023-09-13T09:50:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 -- 172.21.15.6:0/490181517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 msgr2=0x55f3140c5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140c5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 -- 172.21.15.6:0/490181517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 msgr2=0x55f3140c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 -- 172.21.15.6:0/490181517 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f313e97630 con 0x55f3140c6700 2023-09-13T09:50:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140c6b20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c015000 tx=0x7f8c9c020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=906d9f17581b62fc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8c91ffb700 1 -- 172.21.15.6:0/490181517 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c02b070 con 0x55f3140c6700 2023-09-13T09:50:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8c91ffb700 1 -- 172.21.15.6:0/490181517 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c9c01e040 con 0x55f3140c6700 2023-09-13T09:50:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.560+0000 7f8c91ffb700 1 -- 172.21.15.6:0/490181517 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c02f400 con 0x55f3140c6700 2023-09-13T09:50:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.561+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/490181517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 msgr2=0x55f3140c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.561+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140c6b20 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c015000 tx=0x7f8c9c020000 comp rx=0 tx=0).stop 2023-09-13T09:50:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/490181517 shutdown_connections 2023-09-13T09:50:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140c5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140c6b20 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/490181517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/490181517 >> 172.21.15.6:0/490181517 conn(0x55f314023c80 msgr2=0x55f3140bff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/490181517 shutdown_connections 2023-09-13T09:50:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/490181517 wait complete. 2023-09-13T09:50:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 -- start start 2023-09-13T09:50:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.562+0000 7f8cbdfb0b80 1 Processor -- start 2023-09-13T09:50:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c6700 0x55f3140cf3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c7060 0x55f3140d63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f313fb5bb0 con 0x55f3140c6700 2023-09-13T09:50:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f313fb58b0 con 0x55f3140c7060 2023-09-13T09:50:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f313e99920 con 0x55f3140c5a00 2023-09-13T09:50:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cbdfb0b80 10 client.0 _ll_register_callbacks cb 0x55f313fb3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8caaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c6700 0x55f3140cf3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c7060 0x55f3140d63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43922/0 (socket says 172.21.15.6:43922) 2023-09-13T09:50:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c7060 0x55f3140d63f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34396/0 (socket says 172.21.15.6:34396) 2023-09-13T09:50:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8caaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c6700 0x55f3140cf3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40870/0 (socket says 172.21.15.6:40870) 2023-09-13T09:50:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cab7fe700 1 -- 172.21.15.6:0/2858794309 learned_addr learned my addr 172.21.15.6:0/2858794309 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 -- 172.21.15.6:0/2858794309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 msgr2=0x55f3140cee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140cee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 -- 172.21.15.6:0/2858794309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c6700 msgr2=0x55f3140cf3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c6700 0x55f3140cf3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 -- 172.21.15.6:0/2858794309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac108a50 con 0x55f3140c7060 2023-09-13T09:50:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8cabfff700 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c7060 0x55f3140d63f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4004630 tx=0x7f8ca4004940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f224d96759ea98ef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.563+0000 7f8c8affd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8c8affd700 1 -- 172.21.15.6:0/2858794309 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400eb60 con 0x55f3140c7060 2023-09-13T09:50:38.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8c8affd700 1 -- 172.21.15.6:0/2858794309 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8ca40093a0 con 0x55f3140c7060 2023-09-13T09:50:38.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f3140b8670 con 0x55f3140c7060 2023-09-13T09:50:38.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8c8affd700 1 -- 172.21.15.6:0/2858794309 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ca400ecc0 con 0x55f3140c7060 2023-09-13T09:50:38.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 10 client.27806 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f31402f7a0 con 0x55f3140c7060 2023-09-13T09:50:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8c8affd700 1 -- 172.21.15.6:0/2858794309 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f3140b8670 con 0x55f3140c7060 2023-09-13T09:50:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8c8affd700 1 -- 172.21.15.6:0/2858794309 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8ca4015450 con 0x55f3140c7060 2023-09-13T09:50:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 10 client.27806 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 10 client.27806 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:50:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 20 client.27806 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f3140dadf0 0x55f3140dd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 4 client.27806 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.564+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f314010970 con 0x55f3140dadf0 2023-09-13T09:50:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.565+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f3140dadf0 0x55f3140dd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.565+0000 7f8c8affd700 10 client.27806 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.565+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f3140dadf0 0x55f3140dd210 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bd6301e068973bd9 server_cookie=8bc1a22bfbf7bf9e in_seq=0 out_seq=0 2023-09-13T09:50:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.565+0000 7f8c8affd700 1 -- 172.21.15.6:0/2858794309 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f314010970 con 0x55f3140dadf0 2023-09-13T09:50:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.565+0000 7f8c8affd700 10 client.27806 handle_command_reply: tid=0 2023-09-13T09:50:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.565+0000 7f8cbdfb0b80 1 client.27806 shutdown 2023-09-13T09:50:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c7060 msgr2=0x55f3140d63f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c7060 0x55f3140d63f0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4004630 tx=0x7f8ca4004940 comp rx=0 tx=0).stop 2023-09-13T09:50:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 shutdown_connections 2023-09-13T09:50:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f3140dadf0 0x55f3140dd210 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c7060 0x55f3140d63f0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140cee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8c8affd700 0 client.27806 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/2858794309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c6700 0x55f3140cf3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 >> 172.21.15.6:0/2858794309 conn(0x55f314023c80 msgr2=0x55f3140bfee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 shutdown_connections 2023-09-13T09:50:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/2858794309 wait complete. 2023-09-13T09:50:38.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.566+0000 7f8cbdfb0b80 20 client.27806 trim_cache size 0 max 16384 2023-09-13T09:50:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 Processor -- start 2023-09-13T09:50:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 -- start start 2023-09-13T09:50:38.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140c54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140cee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3140ce320 con 0x55f3140c7060 2023-09-13T09:50:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3140ce9e0 con 0x55f3140c6700 2023-09-13T09:50:38.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3140c1fd0 con 0x55f3140c5a00 2023-09-13T09:50:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140cee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cabfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140cee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40880/0 (socket says 172.21.15.6:40880) 2023-09-13T09:50:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cabfff700 1 -- 172.21.15.6:0/1925068339 learned_addr learned my addr 172.21.15.6:0/1925068339 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140c54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.579+0000 7f8caaffd700 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cabfff700 1 -- 172.21.15.6:0/1925068339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 msgr2=0x55f3140c54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cabfff700 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140c54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cabfff700 1 -- 172.21.15.6:0/1925068339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 msgr2=0x55f3140d63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cabfff700 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cabfff700 1 -- 172.21.15.6:0/1925068339 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f313e43de0 con 0x55f3140c7060 2023-09-13T09:50:38.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cabfff700 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140cee70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000f80 tx=0x7f8ca4003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d179a0ddca907b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8c927fc700 1 -- 172.21.15.6:0/1925068339 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4009990 con 0x55f3140c7060 2023-09-13T09:50:38.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8c927fc700 1 -- 172.21.15.6:0/1925068339 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8ca400f040 con 0x55f3140c7060 2023-09-13T09:50:38.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8c927fc700 1 -- 172.21.15.6:0/1925068339 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4007500 con 0x55f3140c7060 2023-09-13T09:50:38.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/1925068339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 msgr2=0x55f3140cee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.580+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140cee70 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4000f80 tx=0x7f8ca4003f80 comp rx=0 tx=0).stop 2023-09-13T09:50:38.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/1925068339 shutdown_connections 2023-09-13T09:50:38.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140cee70 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140c54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/1925068339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/1925068339 >> 172.21.15.6:0/1925068339 conn(0x55f314023c80 msgr2=0x55f3140cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/1925068339 shutdown_connections 2023-09-13T09:50:38.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/1925068339 wait complete. 2023-09-13T09:50:38.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 -- start start 2023-09-13T09:50:38.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.581+0000 7f8cbdfb0b80 1 Processor -- start 2023-09-13T09:50:38.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140d2460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cbdfb0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140d59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3140d5f00 con 0x55f3140c7060 2023-09-13T09:50:38.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3140d6070 con 0x55f3140c6700 2023-09-13T09:50:38.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cbdfb0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3140d6230 con 0x55f3140c5a00 2023-09-13T09:50:38.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cbdfb0b80 10 client.0 _ll_register_callbacks cb 0x55f313fb3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140d2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140d2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:43936/0 (socket says 172.21.15.6:43936) 2023-09-13T09:50:38.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8caaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 -- 172.21.15.6:0/56568600 learned_addr learned my addr 172.21.15.6:0/56568600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cabfff700 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140d59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 -- 172.21.15.6:0/56568600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 msgr2=0x55f3140d29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 -- 172.21.15.6:0/56568600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 msgr2=0x55f3140d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140d59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 -- 172.21.15.6:0/56568600 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f31402f7a0 con 0x55f3140c5a00 2023-09-13T09:50:38.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8caaffd700 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8cab7fe700 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140d2460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0059d0 tx=0x7f8c9c0247e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4dce47748c329b95 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.582+0000 7f8c8affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:50:38.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8c8affd700 1 -- 172.21.15.6:0/56568600 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c02b040 con 0x55f3140c5a00 2023-09-13T09:50:38.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8c8affd700 1 -- 172.21.15.6:0/56568600 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8c9c024a60 con 0x55f3140c5a00 2023-09-13T09:50:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c9c01e040 con 0x55f3140c5a00 2023-09-13T09:50:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8c8affd700 1 -- 172.21.15.6:0/56568600 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c9c024c40 con 0x55f3140c5a00 2023-09-13T09:50:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 10 client.27733 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55f313e2cc60 con 0x55f3140c5a00 2023-09-13T09:50:38.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8c8affd700 1 -- 172.21.15.6:0/56568600 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c9c01e040 con 0x55f3140c5a00 2023-09-13T09:50:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8c8affd700 1 -- 172.21.15.6:0/56568600 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8c9c00f460 con 0x55f3140c5a00 2023-09-13T09:50:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 10 client.27733 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 10 client.27733 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:50:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 20 client.27733 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f31412fb30 0x55f314131f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 4 client.27733 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f313fd1050 con 0x55f31412fb30 2023-09-13T09:50:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.583+0000 7f8caaffd700 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f31412fb30 0x55f314131f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8caaffd700 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f31412fb30 0x55f314131f20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff659c6ad26d8e7 server_cookie=79a8a9737978daec in_seq=0 out_seq=0 2023-09-13T09:50:38.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8c8affd700 10 client.27733 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8c8affd700 1 -- 172.21.15.6:0/56568600 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f313fd1050 con 0x55f31412fb30 2023-09-13T09:50:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8c8affd700 10 client.27733 handle_command_reply: tid=0 2023-09-13T09:50:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 client.27733 shutdown 2023-09-13T09:50:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 msgr2=0x55f3140d2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140d2460 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0059d0 tx=0x7f8c9c0247e0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 shutdown_connections 2023-09-13T09:50:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f31412fb30 0x55f314131f20 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f3140c7060 0x55f3140d59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8c8affd700 0 client.27733 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:50:38.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f3140c5a00 0x55f3140d2460 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 --2- 172.21.15.6:0/56568600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f3140c6700 0x55f3140d29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 >> 172.21.15.6:0/56568600 conn(0x55f314023c80 msgr2=0x55f3140cee10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 shutdown_connections 2023-09-13T09:50:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 1 -- 172.21.15.6:0/56568600 wait complete. 2023-09-13T09:50:38.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.584+0000 7f8cbdfb0b80 20 client.27733 trim_cache size 0 max 16384 2023-09-13T09:50:38.609 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c940a0640 msgr2=0x7f8c940a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c940a0640 0x7f8c940a2b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00b2e0 tx=0x7f8c9c005960 comp rx=0 tx=0).stop 2023-09-13T09:50:38.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac100880 msgr2=0x7f8cac195ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac100880 0x7f8cac195ea0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8ca000eab0 tx=0x7f8ca000edc0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 shutdown_connections 2023-09-13T09:50:38.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8cac101270 0x7f8cac19cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cac0ffec0 0x7f8cac195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c940a0640 0x7f8c940a2b00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 --2- 172.21.15.6:0/4109728329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cac100880 0x7f8cac195ea0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 >> 172.21.15.6:0/4109728329 conn(0x7f8cac0fa9b0 msgr2=0x7f8cac0fcc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 shutdown_connections 2023-09-13T09:50:38.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.585+0000 7f8cb1dcb700 1 -- 172.21.15.6:0/4109728329 wait complete. 2023-09-13T09:50:38.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:50:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 -- 172.21.15.6:0/3616321732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e41018a0 msgr2=0x7f10e4103c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 --2- 172.21.15.6:0/3616321732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e41018a0 0x7f10e4103c90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f10d40098f0 tx=0x7f10d4009c00 comp rx=0 tx=0).stop 2023-09-13T09:50:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 -- 172.21.15.6:0/3616321732 shutdown_connections 2023-09-13T09:50:38.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 --2- 172.21.15.6:0/3616321732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e4106b00 0x7f10e4108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 --2- 172.21.15.6:0/3616321732 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e41018a0 0x7f10e4103c90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 --2- 172.21.15.6:0/3616321732 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e41041d0 0x7f10e41065c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 -- 172.21.15.6:0/3616321732 >> 172.21.15.6:0/3616321732 conn(0x7f10e40fb250 msgr2=0x7f10e40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 -- 172.21.15.6:0/3616321732 shutdown_connections 2023-09-13T09:50:38.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.746+0000 7f10e8a69700 1 -- 172.21.15.6:0/3616321732 wait complete. 2023-09-13T09:50:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 Processor -- start 2023-09-13T09:50:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 -- start start 2023-09-13T09:50:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e41018a0 0x7f10e4196a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e41041d0 0x7f10e4196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e4106b00 0x7f10e419dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e419e580 con 0x7f10e41018a0 2023-09-13T09:50:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e419e6c0 con 0x7f10e4106b00 2023-09-13T09:50:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e8a69700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e419e850 con 0x7f10e41041d0 2023-09-13T09:50:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e41018a0 0x7f10e4196a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e41018a0 0x7f10e4196a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40896/0 (socket says 172.21.15.6:40896) 2023-09-13T09:50:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e1d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e41041d0 0x7f10e4196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e4106b00 0x7f10e419dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.747+0000 7f10e259c700 1 -- 172.21.15.6:0/1960024188 learned_addr learned my addr 172.21.15.6:0/1960024188 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e259c700 1 -- 172.21.15.6:0/1960024188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e41041d0 msgr2=0x7f10e4196f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e259c700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e41041d0 0x7f10e4196f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e259c700 1 -- 172.21.15.6:0/1960024188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e4106b00 msgr2=0x7f10e419dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e259c700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e4106b00 0x7f10e419dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e259c700 1 -- 172.21.15.6:0/1960024188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4009520 con 0x7f10e41018a0 2023-09-13T09:50:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e2d9d700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e4106b00 0x7f10e419dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e259c700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e41018a0 0x7f10e4196a00 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f10d4011040 tx=0x7f10d400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10d37fe700 1 -- 172.21.15.6:0/1960024188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d401c070 con 0x7f10e41018a0 2023-09-13T09:50:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10d37fe700 1 -- 172.21.15.6:0/1960024188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d400f7d0 con 0x7f10e41018a0 2023-09-13T09:50:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10d37fe700 1 -- 172.21.15.6:0/1960024188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40049c0 con 0x7f10e41018a0 2023-09-13T09:50:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e419ead0 con 0x7f10e41018a0 2023-09-13T09:50:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.748+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e419eea0 con 0x7f10e41018a0 2023-09-13T09:50:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.751+0000 7f10d37fe700 1 -- 172.21.15.6:0/1960024188 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f10d4020070 con 0x7f10e41018a0 2023-09-13T09:50:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.752+0000 7f10d37fe700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10cc0a0640 0x7f10cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.752+0000 7f10e1d9b700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10cc0a0640 0x7f10cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.752+0000 7f10d37fe700 1 -- 172.21.15.6:0/1960024188 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10d40cca00 con 0x7f10e41018a0 2023-09-13T09:50:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.752+0000 7f10e1d9b700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10cc0a0640 0x7f10cc0a2b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009c60 tx=0x7f10d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 Processor -- start 2023-09-13T09:50:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 -- start start 2023-09-13T09:50:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306c470 0x55c55306a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c55306b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c552fbf780 con 0x55c55306bb10 2023-09-13T09:50:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c552fbd0a0 con 0x55c55306c470 2023-09-13T09:50:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c552fb8990 con 0x55c55306ae10 2023-09-13T09:50:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40904/0 (socket says 172.21.15.6:40904) 2023-09-13T09:50:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 -- 172.21.15.6:0/3644391430 learned_addr learned my addr 172.21.15.6:0/3644391430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e1d9b700 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306c470 0x55c55306a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e2d9d700 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c55306b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 -- 172.21.15.6:0/3644391430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 msgr2=0x55c55306b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c55306b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 -- 172.21.15.6:0/3644391430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306c470 msgr2=0x55c55306a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306c470 0x55c55306a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e259c700 1 -- 172.21.15.6:0/3644391430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c552e38630 con 0x55c55306bb10 2023-09-13T09:50:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.753+0000 7f10e1d9b700 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306c470 0x55c55306a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.754+0000 7f10e259c700 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306bf30 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f10d4096730 tx=0x7f10d4099d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d96be2550e045b14 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.754+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3644391430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409a230 con 0x55c55306bb10 2023-09-13T09:50:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.754+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3644391430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d409e060 con 0x55c55306bb10 2023-09-13T09:50:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.754+0000 7f10d0ff9700 1 -- 172.21.15.6:0/3644391430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409a490 con 0x55c55306bb10 2023-09-13T09:50:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.754+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3644391430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 msgr2=0x55c55306bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.754+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306bf30 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f10d4096730 tx=0x7f10d4099d70 comp rx=0 tx=0).stop 2023-09-13T09:50:38.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3644391430 shutdown_connections 2023-09-13T09:50:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c55306b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306bf30 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3644391430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306c470 0x55c55306a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3644391430 >> 172.21.15.6:0/3644391430 conn(0x55c552fc4c80 msgr2=0x55c553060f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3644391430 shutdown_connections 2023-09-13T09:50:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3644391430 wait complete. 2023-09-13T09:50:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- start start 2023-09-13T09:50:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 Processor -- start 2023-09-13T09:50:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c553073fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306bb10 0x55c5530744e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306c470 0x55c55307b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c552f56bb0 con 0x55c55306c470 2023-09-13T09:50:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c552f568b0 con 0x55c55306bb10 2023-09-13T09:50:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c552e3a920 con 0x55c55306ae10 2023-09-13T09:50:38.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10f4c4eb80 10 client.0 _ll_register_callbacks cb 0x55c552f54680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10e2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306c470 0x55c55307b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10e2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306c470 0x55c55307b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40914/0 (socket says 172.21.15.6:40914) 2023-09-13T09:50:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10e1d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306bb10 0x55c5530744e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10e2d9d700 1 -- 172.21.15.6:0/769463450 learned_addr learned my addr 172.21.15.6:0/769463450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.755+0000 7f10e259c700 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c553073fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10e2d9d700 1 -- 172.21.15.6:0/769463450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 msgr2=0x55c553073fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10e2d9d700 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c553073fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10e2d9d700 1 -- 172.21.15.6:0/769463450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306bb10 msgr2=0x55c5530744e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10e2d9d700 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306bb10 0x55c5530744e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10e2d9d700 1 -- 172.21.15.6:0/769463450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e419eea0 con 0x55c55306c470 2023-09-13T09:50:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10e2d9d700 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306c470 0x55c55307b520 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f10dc004770 tx=0x7f10dc00e4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91e2817f93c00e8a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10c9ffb700 1 -- 172.21.15.6:0/769463450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc00eae0 con 0x55c55306c470 2023-09-13T09:50:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10c9ffb700 1 -- 172.21.15.6:0/769463450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10dc00ec40 con 0x55c55306c470 2023-09-13T09:50:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c553059670 con 0x55c55306c470 2023-09-13T09:50:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10c9ffb700 1 -- 172.21.15.6:0/769463450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10dc00ee00 con 0x55c55306c470 2023-09-13T09:50:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10f4c4eb80 10 client.18429 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c552fd07a0 con 0x55c55306c470 2023-09-13T09:50:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.756+0000 7f10c9ffb700 1 -- 172.21.15.6:0/769463450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c553059670 con 0x55c55306c470 2023-09-13T09:50:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10c9ffb700 1 -- 172.21.15.6:0/769463450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f10dc01c020 con 0x55c55306c470 2023-09-13T09:50:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10f4c4eb80 10 client.18429 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10f4c4eb80 10 client.18429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10f4c4eb80 20 client.18429 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c55307fe80 0x55c5530822a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10f4c4eb80 4 client.18429 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c552fb1970 con 0x55c55307fe80 2023-09-13T09:50:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10e259c700 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c55307fe80 0x55c5530822a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10c9ffb700 10 client.18429 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.757+0000 7f10e259c700 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c55307fe80 0x55c5530822a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e1b475909678809 server_cookie=84b59ab8caad7680 in_seq=0 out_seq=0 2023-09-13T09:50:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10c9ffb700 1 -- 172.21.15.6:0/769463450 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c552fb1970 con 0x55c55307fe80 2023-09-13T09:50:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10c9ffb700 10 client.18429 handle_command_reply: tid=0 2023-09-13T09:50:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 client.18429 shutdown 2023-09-13T09:50:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306c470 msgr2=0x55c55307b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306c470 0x55c55307b520 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f10dc004770 tx=0x7f10dc00e4f0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 shutdown_connections 2023-09-13T09:50:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c55307fe80 0x55c5530822a0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306c470 0x55c55307b520 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306ae10 0x55c553073fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10c9ffb700 0 client.18429 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/769463450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306bb10 0x55c5530744e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 >> 172.21.15.6:0/769463450 conn(0x55c552fc4c80 msgr2=0x55c55305b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 shutdown_connections 2023-09-13T09:50:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/769463450 wait complete. 2023-09-13T09:50:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.758+0000 7f10f4c4eb80 20 client.18429 trim_cache size 0 max 16384 2023-09-13T09:50:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 Processor -- start 2023-09-13T09:50:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 -- start start 2023-09-13T09:50:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c55306ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c553073b10 con 0x55c55306bb10 2023-09-13T09:50:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55305d8e0 con 0x55c55306ae10 2023-09-13T09:50:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55307b980 con 0x55c55306c470 2023-09-13T09:50:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10e259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c55306ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40920/0 (socket says 172.21.15.6:40920) 2023-09-13T09:50:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10e259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c55306ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34442/0 (socket says 172.21.15.6:34442) 2023-09-13T09:50:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10e1d9b700 1 -- 172.21.15.6:0/3790984213 learned_addr learned my addr 172.21.15.6:0/3790984213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.772+0000 7f10e2d9d700 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10e259c700 1 -- 172.21.15.6:0/3790984213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 msgr2=0x55c55307b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10e259c700 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10e259c700 1 -- 172.21.15.6:0/3790984213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 msgr2=0x55c55306f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10e259c700 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10e259c700 1 -- 172.21.15.6:0/3790984213 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c552de4de0 con 0x55c55306ae10 2023-09-13T09:50:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10e259c700 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c55306ecf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10d40ca500 tx=0x7f10d4005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdca2a19cffe4962 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10d17fa700 1 -- 172.21.15.6:0/3790984213 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409a230 con 0x55c55306ae10 2023-09-13T09:50:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10d17fa700 1 -- 172.21.15.6:0/3790984213 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d400b880 con 0x55c55306ae10 2023-09-13T09:50:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.773+0000 7f10d17fa700 1 -- 172.21.15.6:0/3790984213 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d409a6d0 con 0x55c55306ae10 2023-09-13T09:50:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3790984213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 msgr2=0x55c55306ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c55306ecf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f10d40ca500 tx=0x7f10d4005780 comp rx=0 tx=0).stop 2023-09-13T09:50:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3790984213 shutdown_connections 2023-09-13T09:50:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c55306ecf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/3790984213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c55306f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3790984213 >> 172.21.15.6:0/3790984213 conn(0x55c552fc4c80 msgr2=0x55c553060e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3790984213 shutdown_connections 2023-09-13T09:50:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/3790984213 wait complete. 2023-09-13T09:50:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- start start 2023-09-13T09:50:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 Processor -- start 2023-09-13T09:50:38.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c553079680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c553079bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55307a7e0 con 0x55c55306bb10 2023-09-13T09:50:38.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55307a920 con 0x55c55306ae10 2023-09-13T09:50:38.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c55307aae0 con 0x55c55306c470 2023-09-13T09:50:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.774+0000 7f10f4c4eb80 10 client.0 _ll_register_callbacks cb 0x55c552f54680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c553079bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c553079bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40926/0 (socket says 172.21.15.6:40926) 2023-09-13T09:50:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 -- 172.21.15.6:0/2981761574 learned_addr learned my addr 172.21.15.6:0/2981761574 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e2d9d700 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e259c700 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c553079680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 -- 172.21.15.6:0/2981761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 msgr2=0x55c55307a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 -- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 msgr2=0x55c553079680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c553079680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 -- 172.21.15.6:0/2981761574 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c552e38630 con 0x55c55306bb10 2023-09-13T09:50:38.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10e1d9b700 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c553079bc0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f10d801ed90 tx=0x7f10d80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdca26cfce7199e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:38.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:38.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10c9ffb700 1 -- 172.21.15.6:0/2981761574 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d8022070 con 0x55c55306bb10 2023-09-13T09:50:38.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10c9ffb700 1 -- 172.21.15.6:0/2981761574 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10d801e070 con 0x55c55306bb10 2023-09-13T09:50:38.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10d409e060 con 0x55c55306bb10 2023-09-13T09:50:38.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10c9ffb700 1 -- 172.21.15.6:0/2981761574 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10d801cea0 con 0x55c55306bb10 2023-09-13T09:50:38.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10f4c4eb80 10 client.18435 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:38.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c552dcdc60 con 0x55c55306bb10 2023-09-13T09:50:38.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.775+0000 7f10c9ffb700 1 -- 172.21.15.6:0/2981761574 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10d8038080 con 0x55c55306bb10 2023-09-13T09:50:38.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10c9ffb700 1 -- 172.21.15.6:0/2981761574 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f10d8003ad0 con 0x55c55306bb10 2023-09-13T09:50:38.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10f4c4eb80 10 client.18435 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:38.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10f4c4eb80 10 client.18435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:38.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10f4c4eb80 20 client.18435 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:38.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c5530d48c0 0x55c5530d6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:38.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10f4c4eb80 4 client.18435 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:50:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c552f72050 con 0x55c5530d48c0 2023-09-13T09:50:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10e259c700 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c5530d48c0 0x55c5530d6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10c9ffb700 10 client.18435 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.776+0000 7f10e259c700 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c5530d48c0 0x55c5530d6ce0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c10d682baa46fe7 server_cookie=a84fd739823aa54 in_seq=0 out_seq=0 2023-09-13T09:50:38.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10c9ffb700 1 -- 172.21.15.6:0/2981761574 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c552f72050 con 0x55c5530d48c0 2023-09-13T09:50:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10c9ffb700 10 client.18435 handle_command_reply: tid=0 2023-09-13T09:50:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 client.18435 shutdown 2023-09-13T09:50:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 msgr2=0x55c553079bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c553079bc0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f10d801ed90 tx=0x7f10d80047c0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 shutdown_connections 2023-09-13T09:50:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c55306c470 0x55c55307a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c55306ae10 0x55c553079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c5530d48c0 0x55c5530d6ce0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 --2- 172.21.15.6:0/2981761574 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c55306bb10 0x55c553079bc0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10c9ffb700 0 client.18435 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:38.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 >> 172.21.15.6:0/2981761574 conn(0x55c552fc4c80 msgr2=0x55c55306ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 shutdown_connections 2023-09-13T09:50:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 1 -- 172.21.15.6:0/2981761574 wait complete. 2023-09-13T09:50:38.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.777+0000 7f10f4c4eb80 20 client.18435 trim_cache size 0 max 16384 2023-09-13T09:50:38.801 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:50:38.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10cc0a0640 msgr2=0x7f10cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10cc0a0640 0x7f10cc0a2b00 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f10d8009c60 tx=0x7f10d8009260 comp rx=0 tx=0).stop 2023-09-13T09:50:38.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e41018a0 msgr2=0x7f10e4196a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:38.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e41018a0 0x7f10e4196a00 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f10d4011040 tx=0x7f10d400b790 comp rx=0 tx=0).stop 2023-09-13T09:50:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 shutdown_connections 2023-09-13T09:50:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10e4106b00 0x7f10e419dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10cc0a0640 0x7f10cc0a2b00 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10e41018a0 0x7f10e4196a00 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 --2- 172.21.15.6:0/1960024188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10e41041d0 0x7f10e4196f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 >> 172.21.15.6:0/1960024188 conn(0x7f10e40fb250 msgr2=0x7f10e4102d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 shutdown_connections 2023-09-13T09:50:38.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:38.778+0000 7f10e8a69700 1 -- 172.21.15.6:0/1960024188 wait complete. 2023-09-13T09:50:39.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 664987 6.47 MB/sec execute 479 sec latency 17.945 ms 2023-09-13T09:50:39.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:39 smithi006 ceph-mon[98665]: pgmap v634: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2023-09-13T09:50:39.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:39 smithi053 ceph-mon[102373]: pgmap v634: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2023-09-13T09:50:39.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:39 smithi131 ceph-mon[102785]: pgmap v634: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2023-09-13T09:50:39.806 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:50:39.807 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:50:39.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.946+0000 7f5236858700 1 -- 172.21.15.6:0/1259911210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230101fb0 msgr2=0x7f5230102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:39.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.946+0000 7f5236858700 1 --2- 172.21.15.6:0/1259911210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230101fb0 0x7f5230102410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f52240099c0 tx=0x7f5224009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 -- 172.21.15.6:0/1259911210 shutdown_connections 2023-09-13T09:50:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 --2- 172.21.15.6:0/1259911210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5230102950 0x7f5230109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 --2- 172.21.15.6:0/1259911210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5230100dc0 0x7f52301011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 --2- 172.21.15.6:0/1259911210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230101fb0 0x7f5230102410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 -- 172.21.15.6:0/1259911210 >> 172.21.15.6:0/1259911210 conn(0x7f52300fc350 msgr2=0x7f52300fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 -- 172.21.15.6:0/1259911210 shutdown_connections 2023-09-13T09:50:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 -- 172.21.15.6:0/1259911210 wait complete. 2023-09-13T09:50:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 Processor -- start 2023-09-13T09:50:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.947+0000 7f5236858700 1 -- start start 2023-09-13T09:50:39.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5236858700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230100dc0 0x7f5230074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5236858700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5230101fb0 0x7f52300730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5236858700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5230102950 0x7f52300735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5236858700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230073d80 con 0x7f5230101fb0 2023-09-13T09:50:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5236858700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5230073ef0 con 0x7f5230100dc0 2023-09-13T09:50:39.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5236858700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52301a0ac0 con 0x7f5230102950 2023-09-13T09:50:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230100dc0 0x7f5230074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5230101fb0 0x7f52300730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230100dc0 0x7f5230074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34462/0 (socket says 172.21.15.6:34462) 2023-09-13T09:50:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 -- 172.21.15.6:0/409545879 learned_addr learned my addr 172.21.15.6:0/409545879 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:39.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5234df5700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5230102950 0x7f52300735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 -- 172.21.15.6:0/409545879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5230102950 msgr2=0x7f52300735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5230102950 0x7f52300735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 -- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5230101fb0 msgr2=0x7f52300730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:39.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5230101fb0 0x7f52300730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 -- 172.21.15.6:0/409545879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52240095f0 con 0x7f5230100dc0 2023-09-13T09:50:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522ffff700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230100dc0 0x7f5230074a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f522000e970 tx=0x7f522000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522d7fa700 1 -- 172.21.15.6:0/409545879 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220009790 con 0x7f5230100dc0 2023-09-13T09:50:39.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f522d7fa700 1 -- 172.21.15.6:0/409545879 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f522000c7e0 con 0x7f5230100dc0 2023-09-13T09:50:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.948+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52301a0da0 con 0x7f5230100dc0 2023-09-13T09:50:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.949+0000 7f522d7fa700 1 -- 172.21.15.6:0/409545879 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220003c70 con 0x7f5230100dc0 2023-09-13T09:50:39.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.949+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52301a1220 con 0x7f5230100dc0 2023-09-13T09:50:39.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.951+0000 7f522d7fa700 1 -- 172.21.15.6:0/409545879 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f522000cc50 con 0x7f5230100dc0 2023-09-13T09:50:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 Processor -- start 2023-09-13T09:50:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f522d7fa700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52180a06c0 0x7f52180a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 -- start start 2023-09-13T09:50:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f522d7fa700 1 -- 172.21.15.6:0/409545879 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5220014070 con 0x7f5230100dc0 2023-09-13T09:50:39.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d89ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d88540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5234df5700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52180a06c0 0x7f52180a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d88f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45ce1800 con 0x556b45d8a0e0 2023-09-13T09:50:39.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45cdf120 con 0x556b45d89780 2023-09-13T09:50:39.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5242a3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45cdaa10 con 0x556b45d88a80 2023-09-13T09:50:39.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.952+0000 7f5234df5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d88f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d89ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d89ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34470/0 (socket says 172.21.15.6:34470) 2023-09-13T09:50:39.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d88540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 -- 172.21.15.6:0/347417130 learned_addr learned my addr 172.21.15.6:0/347417130 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:39.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f5234df5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d88f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44002/0 (socket says 172.21.15.6:44002) 2023-09-13T09:50:39.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 -- 172.21.15.6:0/347417130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 msgr2=0x556b45d88f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:39.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d88f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 -- 172.21.15.6:0/347417130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 msgr2=0x556b45d88540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:39.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d88540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 -- 172.21.15.6:0/347417130 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b45b5a6b0 con 0x556b45d89780 2023-09-13T09:50:39.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522f7fe700 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d88540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:39.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f5234df5700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52180a06c0 0x7f52180a2b80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5228009ec0 tx=0x7f5228013480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:39.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f522ffff700 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d89ba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52200a0fd0 tx=0x7f5220003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca0de975867ffc36 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:39.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f52167fc700 1 -- 172.21.15.6:0/347417130 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220003dd0 con 0x556b45d89780 2023-09-13T09:50:39.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f52167fc700 1 -- 172.21.15.6:0/347417130 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5220099b90 con 0x556b45d89780 2023-09-13T09:50:39.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.953+0000 7f52167fc700 1 -- 172.21.15.6:0/347417130 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220097930 con 0x556b45d89780 2023-09-13T09:50:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 -- 172.21.15.6:0/347417130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 msgr2=0x556b45d89ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d89ba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f52200a0fd0 tx=0x7f5220003680 comp rx=0 tx=0).stop 2023-09-13T09:50:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 -- 172.21.15.6:0/347417130 shutdown_connections 2023-09-13T09:50:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d88f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d89ba0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 --2- 172.21.15.6:0/347417130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d88540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 -- 172.21.15.6:0/347417130 >> 172.21.15.6:0/347417130 conn(0x556b45ce6d00 msgr2=0x556b45d82f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 -- 172.21.15.6:0/347417130 shutdown_connections 2023-09-13T09:50:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 -- 172.21.15.6:0/347417130 wait complete. 2023-09-13T09:50:39.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.954+0000 7f5242a3db80 1 -- start start 2023-09-13T09:50:39.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 1 Processor -- start 2023-09-13T09:50:39.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d88a80 0x556b45d91f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d89780 0x556b45d924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d99500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45c78c30 con 0x556b45d8a0e0 2023-09-13T09:50:39.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45c78930 con 0x556b45d88a80 2023-09-13T09:50:39.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45b5c9a0 con 0x556b45d89780 2023-09-13T09:50:39.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5242a3db80 10 client.0 _ll_register_callbacks cb 0x556b45c76700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:39.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5234df5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d99500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f522ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d88a80 0x556b45d91f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5234df5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d99500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40956/0 (socket says 172.21.15.6:40956) 2023-09-13T09:50:39.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f522f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d89780 0x556b45d924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f5234df5700 1 -- 172.21.15.6:0/1346159909 learned_addr learned my addr 172.21.15.6:0/1346159909 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:39.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f522ffff700 1 -- 172.21.15.6:0/1346159909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d89780 msgr2=0x556b45d924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:39.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f522ffff700 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d89780 0x556b45d924c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f522ffff700 1 -- 172.21.15.6:0/1346159909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 msgr2=0x556b45d99500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:39.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f522ffff700 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d99500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.955+0000 7f522ffff700 1 -- 172.21.15.6:0/1346159909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52301a1220 con 0x556b45d88a80 2023-09-13T09:50:39.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f522ffff700 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d88a80 0x556b45d91f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52200a0fd0 tx=0x7f522000c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fecd95c1db136794 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:39.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f520f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:39.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f520f7fe700 1 -- 172.21.15.6:0/1346159909 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5220003dd0 con 0x556b45d88a80 2023-09-13T09:50:39.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f520f7fe700 1 -- 172.21.15.6:0/1346159909 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5220099490 con 0x556b45d88a80 2023-09-13T09:50:39.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b45d7b6f0 con 0x556b45d88a80 2023-09-13T09:50:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f520f7fe700 1 -- 172.21.15.6:0/1346159909 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f52200a1070 con 0x556b45d88a80 2023-09-13T09:50:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 10 client.27842 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x556b45cf2820 con 0x556b45d88a80 2023-09-13T09:50:39.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f520f7fe700 1 -- 172.21.15.6:0/1346159909 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556b45d7b6f0 con 0x556b45d88a80 2023-09-13T09:50:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f520f7fe700 1 -- 172.21.15.6:0/1346159909 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f52200983f0 con 0x556b45d88a80 2023-09-13T09:50:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 10 client.27842 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 10 client.27842 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 20 client.27842 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:39.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45d9d9e0 0x556b45d9fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 4 client.27842 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:39.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b45cd39f0 con 0x556b45d9d9e0 2023-09-13T09:50:39.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.956+0000 7f522f7fe700 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45d9d9e0 0x556b45d9fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.957+0000 7f520f7fe700 10 client.27842 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:39.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.957+0000 7f522f7fe700 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45d9d9e0 0x556b45d9fdd0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a586fd3decb328d server_cookie=fae39dba7f85dae5 in_seq=0 out_seq=0 2023-09-13T09:50:39.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f520f7fe700 1 -- 172.21.15.6:0/1346159909 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556b45cd39f0 con 0x556b45d9d9e0 2023-09-13T09:50:39.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f520f7fe700 10 client.27842 handle_command_reply: tid=0 2023-09-13T09:50:39.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 client.27842 shutdown 2023-09-13T09:50:39.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d88a80 msgr2=0x556b45d91f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:39.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d88a80 0x556b45d91f80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f52200a0fd0 tx=0x7f522000c9e0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 shutdown_connections 2023-09-13T09:50:39.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45d9d9e0 0x556b45d9fdd0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d99500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d88a80 0x556b45d91f80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f520f7fe700 0 client.27842 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:39.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1346159909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d89780 0x556b45d924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 >> 172.21.15.6:0/1346159909 conn(0x556b45ce6d00 msgr2=0x556b45d82f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:39.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 shutdown_connections 2023-09-13T09:50:39.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 1 -- 172.21.15.6:0/1346159909 wait complete. 2023-09-13T09:50:39.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.958+0000 7f5242a3db80 20 client.27842 trim_cache size 0 max 16384 2023-09-13T09:50:39.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 Processor -- start 2023-09-13T09:50:39.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 -- start start 2023-09-13T09:50:39.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d7d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d89780 0x556b45d994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d8a0e0 0x556b45d87c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45d7f960 con 0x556b45d89780 2023-09-13T09:50:39.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45d847b0 con 0x556b45d8a0e0 2023-09-13T09:50:39.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5242a3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45d93100 con 0x556b45d88a80 2023-09-13T09:50:39.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f522f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d89780 0x556b45d994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f522f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d89780 0x556b45d994c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40962/0 (socket says 172.21.15.6:40962) 2023-09-13T09:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f522ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d7d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f522f7fe700 1 -- 172.21.15.6:0/2694600144 learned_addr learned my addr 172.21.15.6:0/2694600144 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.976+0000 7f5234df5700 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d8a0e0 0x556b45d87c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f522f7fe700 1 -- 172.21.15.6:0/2694600144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 msgr2=0x556b45d7d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:39.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f522f7fe700 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d7d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f522f7fe700 1 -- 172.21.15.6:0/2694600144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d8a0e0 msgr2=0x556b45d87c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f522f7fe700 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d8a0e0 0x556b45d87c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f522f7fe700 1 -- 172.21.15.6:0/2694600144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b45b06e60 con 0x556b45d89780 2023-09-13T09:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f522ffff700 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d7d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:39.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f5234df5700 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d8a0e0 0x556b45d87c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f522f7fe700 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d89780 0x556b45d994c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f52240058e0 tx=0x7f5224005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7090bca89afbd8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f5216ffd700 1 -- 172.21.15.6:0/2694600144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224028ce0 con 0x556b45d89780 2023-09-13T09:50:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f5216ffd700 1 -- 172.21.15.6:0/2694600144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f522401e040 con 0x556b45d89780 2023-09-13T09:50:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.977+0000 7f5216ffd700 1 -- 172.21.15.6:0/2694600144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224003e10 con 0x556b45d89780 2023-09-13T09:50:39.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 -- 172.21.15.6:0/2694600144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d89780 msgr2=0x556b45d994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d89780 0x556b45d994c0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f52240058e0 tx=0x7f5224005fb0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 -- 172.21.15.6:0/2694600144 shutdown_connections 2023-09-13T09:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d8a0e0 0x556b45d87c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d7d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 --2- 172.21.15.6:0/2694600144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d89780 0x556b45d994c0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 -- 172.21.15.6:0/2694600144 >> 172.21.15.6:0/2694600144 conn(0x556b45ce6d00 msgr2=0x556b45d87530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 -- 172.21.15.6:0/2694600144 shutdown_connections 2023-09-13T09:50:39.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 -- 172.21.15.6:0/2694600144 wait complete. 2023-09-13T09:50:39.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 -- start start 2023-09-13T09:50:39.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.978+0000 7f5242a3db80 1 Processor -- start 2023-09-13T09:50:39.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d970c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d97600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5242a3db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d98610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5242a3db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45d98b50 con 0x556b45d8a0e0 2023-09-13T09:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5242a3db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45d98cc0 con 0x556b45d89780 2023-09-13T09:50:39.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5242a3db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b45d98e80 con 0x556b45d88a80 2023-09-13T09:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5242a3db80 10 client.0 _ll_register_callbacks cb 0x556b45c76700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5234df5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d98610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d97600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d97600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34492/0 (socket says 172.21.15.6:34492) 2023-09-13T09:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 -- 172.21.15.6:0/1941792896 learned_addr learned my addr 172.21.15.6:0/1941792896 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522ffff700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 -- 172.21.15.6:0/1941792896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 msgr2=0x556b45d970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:39.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 -- 172.21.15.6:0/1941792896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 msgr2=0x556b45d98610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d98610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 -- 172.21.15.6:0/1941792896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b45cf2820 con 0x556b45d89780 2023-09-13T09:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522ffff700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f5234df5700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d98610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:40.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f522f7fe700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d97600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5224005750 tx=0x7f5224009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f32666346f6a3439 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.979+0000 7f520f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f520f7fe700 1 -- 172.21.15.6:0/1941792896 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5224028ae0 con 0x556b45d89780 2023-09-13T09:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f520f7fe700 1 -- 172.21.15.6:0/1941792896 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5224028c40 con 0x556b45d89780 2023-09-13T09:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5220099b90 con 0x556b45d89780 2023-09-13T09:50:40.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f520f7fe700 1 -- 172.21.15.6:0/1941792896 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5224028e00 con 0x556b45d89780 2023-09-13T09:50:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 10 client.27848 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f5228013790 con 0x556b45d89780 2023-09-13T09:50:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f520f7fe700 1 -- 172.21.15.6:0/1941792896 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5220099b90 con 0x556b45d89780 2023-09-13T09:50:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f520f7fe700 1 -- 172.21.15.6:0/1941792896 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f522400bc90 con 0x556b45d89780 2023-09-13T09:50:40.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 10 client.27848 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 10 client.27848 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 20 client.27848 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45df4200 0x556b45df6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 4 client.27848 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:50:40.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x556b45c940d0 con 0x556b45df4200 2023-09-13T09:50:40.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.980+0000 7f522ffff700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45df4200 0x556b45df6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.981+0000 7f520f7fe700 10 client.27848 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:40.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.981+0000 7f522ffff700 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45df4200 0x556b45df6620 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=252af66e3a862f38 server_cookie=1ac07247361bfc43 in_seq=0 out_seq=0 2023-09-13T09:50:40.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f520f7fe700 1 -- 172.21.15.6:0/1941792896 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x556b45c940d0 con 0x556b45df4200 2023-09-13T09:50:40.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f520f7fe700 10 client.27848 handle_command_reply: tid=0 2023-09-13T09:50:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 client.27848 shutdown 2023-09-13T09:50:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 msgr2=0x556b45d97600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d97600 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5224005750 tx=0x7f5224009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 shutdown_connections 2023-09-13T09:50:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556b45df4200 0x556b45df6620 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556b45d8a0e0 0x556b45d98610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556b45d88a80 0x556b45d970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 --2- 172.21.15.6:0/1941792896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556b45d89780 0x556b45d97600 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 >> 172.21.15.6:0/1941792896 conn(0x556b45ce6d00 msgr2=0x556b45d92430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.982+0000 7f520f7fe700 0 client.27848 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 shutdown_connections 2023-09-13T09:50:40.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5242a3db80 1 -- 172.21.15.6:0/1941792896 wait complete. 2023-09-13T09:50:40.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5242a3db80 20 client.27848 trim_cache size 0 max 16384 2023-09-13T09:50:40.008 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:50:40.008 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:50:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "98568f8c-56b2-4a57-a511-56f1a4aae0ea", 2023-09-13T09:50:40.009 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:50:40.009 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:50:40.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52180a06c0 msgr2=0x7f52180a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52180a06c0 0x7f52180a2b80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5228009ec0 tx=0x7f5228013480 comp rx=0 tx=0).stop 2023-09-13T09:50:40.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230100dc0 msgr2=0x7f5230074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230100dc0 0x7f5230074a60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f522000e970 tx=0x7f522000ec80 comp rx=0 tx=0).stop 2023-09-13T09:50:40.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 shutdown_connections 2023-09-13T09:50:40.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5230102950 0x7f52300735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5230100dc0 0x7f5230074a60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f52180a06c0 0x7f52180a2b80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 --2- 172.21.15.6:0/409545879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5230101fb0 0x7f52300730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 >> 172.21.15.6:0/409545879 conn(0x7f52300fc350 msgr2=0x7f5230105490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 shutdown_connections 2023-09-13T09:50:40.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:39.983+0000 7f5236858700 1 -- 172.21.15.6:0/409545879 wait complete. 2023-09-13T09:50:40.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:50:40.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.163+0000 7fc888181700 1 -- 172.21.15.6:0/1833408133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 msgr2=0x7fc8801011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.163+0000 7fc888181700 1 --2- 172.21.15.6:0/1833408133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc8801011e0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7fc87c0099c0 tx=0x7fc87c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 -- 172.21.15.6:0/1833408133 shutdown_connections 2023-09-13T09:50:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 --2- 172.21.15.6:0/1833408133 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc880102950 0x7fc880109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 --2- 172.21.15.6:0/1833408133 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc8801011e0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 --2- 172.21.15.6:0/1833408133 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc880101fb0 0x7fc880102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 -- 172.21.15.6:0/1833408133 >> 172.21.15.6:0/1833408133 conn(0x7fc8800fc330 msgr2=0x7fc8800fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 -- 172.21.15.6:0/1833408133 shutdown_connections 2023-09-13T09:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 -- 172.21.15.6:0/1833408133 wait complete. 2023-09-13T09:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 Processor -- start 2023-09-13T09:50:40.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 -- start start 2023-09-13T09:50:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc88019d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.164+0000 7fc888181700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc880101fb0 0x7fc88019d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc888181700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc880102950 0x7fc8801a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc888181700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801a4c50 con 0x7fc880100dc0 2023-09-13T09:50:40.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc888181700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801a4d90 con 0x7fc880102950 2023-09-13T09:50:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc888181700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8801a4f20 con 0x7fc880101fb0 2023-09-13T09:50:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc88019d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc88019d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40980/0 (socket says 172.21.15.6:40980) 2023-09-13T09:50:40.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc88571c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc880101fb0 0x7fc88019d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 -- 172.21.15.6:0/2873423887 learned_addr learned my addr 172.21.15.6:0/2873423887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:40.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc88671e700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc880102950 0x7fc8801a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 -- 172.21.15.6:0/2873423887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc880101fb0 msgr2=0x7fc88019d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc880101fb0 0x7fc88019d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 -- 172.21.15.6:0/2873423887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc880102950 msgr2=0x7fc8801a4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc880102950 0x7fc8801a4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 -- 172.21.15.6:0/2873423887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c0095f0 con 0x7fc880100dc0 2023-09-13T09:50:40.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.165+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc88019d0d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009990 tx=0x7fc87c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:40.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.169+0000 7fc876ffd700 1 -- 172.21.15.6:0/2873423887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c01d070 con 0x7fc880100dc0 2023-09-13T09:50:40.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.169+0000 7fc876ffd700 1 -- 172.21.15.6:0/2873423887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc87c005030 con 0x7fc880100dc0 2023-09-13T09:50:40.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.169+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8801a51a0 con 0x7fc880100dc0 2023-09-13T09:50:40.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.170+0000 7fc876ffd700 1 -- 172.21.15.6:0/2873423887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c004a70 con 0x7fc880100dc0 2023-09-13T09:50:40.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.170+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8801a5620 con 0x7fc880100dc0 2023-09-13T09:50:40.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.172+0000 7fc876ffd700 1 -- 172.21.15.6:0/2873423887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc87c005410 con 0x7fc880100dc0 2023-09-13T09:50:40.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.173+0000 7fc876ffd700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc86c0a06c0 0x7fc86c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.173+0000 7fc876ffd700 1 -- 172.21.15.6:0/2873423887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc87c0cc880 con 0x7fc880100dc0 2023-09-13T09:50:40.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.173+0000 7fc88571c700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc86c0a06c0 0x7fc86c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.173+0000 7fc894366b80 1 Processor -- start 2023-09-13T09:50:40.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc88571c700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc86c0a06c0 0x7fc86c0a2b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc870009c60 tx=0x7fc870009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:40.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc894366b80 1 -- start start 2023-09-13T09:50:40.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc894366b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c039b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc894366b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c0384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc894366b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c038e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc894366b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3bf91780 con 0x55df3c039700 2023-09-13T09:50:40.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc894366b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3bf8f0a0 con 0x55df3c038a00 2023-09-13T09:50:40.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc894366b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3bf8a990 con 0x55df3c03a060 2023-09-13T09:50:40.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c039b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc88571c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c0384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c039b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40988/0 (socket says 172.21.15.6:40988) 2023-09-13T09:50:40.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 -- 172.21.15.6:0/2931259256 learned_addr learned my addr 172.21.15.6:0/2931259256 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:40.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc88671e700 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c038e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 -- 172.21.15.6:0/2931259256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 msgr2=0x55df3c0384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c0384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 -- 172.21.15.6:0/2931259256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 msgr2=0x55df3c038e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c038e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.174+0000 7fc885f1d700 1 -- 172.21.15.6:0/2931259256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df3be0a630 con 0x55df3c039700 2023-09-13T09:50:40.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.175+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c039b20 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc87c09a040 tx=0x7fc87c099d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded80844f6b12804 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:40.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.175+0000 7fc86bfff700 1 -- 172.21.15.6:0/2931259256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c09dee0 con 0x55df3c039700 2023-09-13T09:50:40.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.175+0000 7fc86bfff700 1 -- 172.21.15.6:0/2931259256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc87c0a2090 con 0x55df3c039700 2023-09-13T09:50:40.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.175+0000 7fc86bfff700 1 -- 172.21.15.6:0/2931259256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0995a0 con 0x55df3c039700 2023-09-13T09:50:40.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.175+0000 7fc894366b80 1 -- 172.21.15.6:0/2931259256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 msgr2=0x55df3c039b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.175+0000 7fc894366b80 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c039b20 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fc87c09a040 tx=0x7fc87c099d00 comp rx=0 tx=0).stop 2023-09-13T09:50:40.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- 172.21.15.6:0/2931259256 shutdown_connections 2023-09-13T09:50:40.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c038e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c039b20 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 --2- 172.21.15.6:0/2931259256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c0384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- 172.21.15.6:0/2931259256 >> 172.21.15.6:0/2931259256 conn(0x55df3bf96c80 msgr2=0x55df3c032f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- 172.21.15.6:0/2931259256 shutdown_connections 2023-09-13T09:50:40.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- 172.21.15.6:0/2931259256 wait complete. 2023-09-13T09:50:40.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- start start 2023-09-13T09:50:40.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 Processor -- start 2023-09-13T09:50:40.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c041bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c039700 0x55df3c042130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c03a060 0x55df3c049170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3bf28bb0 con 0x55df3c03a060 2023-09-13T09:50:40.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3bf288b0 con 0x55df3c038a00 2023-09-13T09:50:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.176+0000 7fc894366b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3be0c920 con 0x55df3c039700 2023-09-13T09:50:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc894366b80 10 client.0 _ll_register_callbacks cb 0x55df3bf26680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:40.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88671e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c03a060 0x55df3c049170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c041bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88571c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c039700 0x55df3c042130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c041bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34518/0 (socket says 172.21.15.6:34518) 2023-09-13T09:50:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc885f1d700 1 -- 172.21.15.6:0/500306898 learned_addr learned my addr 172.21.15.6:0/500306898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:40.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88671e700 1 -- 172.21.15.6:0/500306898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c039700 msgr2=0x55df3c042130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88671e700 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c039700 0x55df3c042130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88671e700 1 -- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 msgr2=0x55df3c041bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88671e700 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c041bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88671e700 1 -- 172.21.15.6:0/500306898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8801a5620 con 0x55df3c03a060 2023-09-13T09:50:40.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88571c700 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c039700 0x55df3c042130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc885f1d700 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c041bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc88671e700 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c03a060 0x55df3c049170 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc878012dc0 tx=0x7fc878014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ead95a671c33fd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:40.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc8697fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:50:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc8697fa700 1 -- 172.21.15.6:0/500306898 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800e040 con 0x55df3c03a060 2023-09-13T09:50:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc8697fa700 1 -- 172.21.15.6:0/500306898 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc878014b30 con 0x55df3c03a060 2023-09-13T09:50:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55df3c02b670 con 0x55df3c03a060 2023-09-13T09:50:40.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.177+0000 7fc8697fa700 1 -- 172.21.15.6:0/500306898 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc878014cf0 con 0x55df3c03a060 2023-09-13T09:50:40.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 10 client.18465 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:40.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55df3bfa27a0 con 0x55df3c03a060 2023-09-13T09:50:40.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc8697fa700 1 -- 172.21.15.6:0/500306898 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55df3c02b670 con 0x55df3c03a060 2023-09-13T09:50:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc8697fa700 1 -- 172.21.15.6:0/500306898 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc87801c020 con 0x55df3c03a060 2023-09-13T09:50:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 10 client.18465 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:40.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 10 client.18465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:40.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 20 client.18465 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:40.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c04d9a0 0x55df3c04fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 4 client.18465 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:50:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55df3bf83970 con 0x55df3c04d9a0 2023-09-13T09:50:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.178+0000 7fc885f1d700 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c04d9a0 0x55df3c04fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc8697fa700 10 client.18465 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:40.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc885f1d700 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c04d9a0 0x55df3c04fdc0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5caea46c28f555 server_cookie=7f97f7fda5d6748c in_seq=0 out_seq=0 2023-09-13T09:50:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc8697fa700 1 -- 172.21.15.6:0/500306898 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55df3bf83970 con 0x55df3c04d9a0 2023-09-13T09:50:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc8697fa700 10 client.18465 handle_command_reply: tid=0 2023-09-13T09:50:40.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 client.18465 shutdown 2023-09-13T09:50:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c03a060 msgr2=0x55df3c049170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c03a060 0x55df3c049170 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fc878012dc0 tx=0x7fc878014600 comp rx=0 tx=0).stop 2023-09-13T09:50:40.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 shutdown_connections 2023-09-13T09:50:40.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c04d9a0 0x55df3c04fdc0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c03a060 0x55df3c049170 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c041bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 --2- 172.21.15.6:0/500306898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c039700 0x55df3c042130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc8697fa700 0 client.18465 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.179+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 >> 172.21.15.6:0/500306898 conn(0x55df3bf96c80 msgr2=0x55df3c02d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.180+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 shutdown_connections 2023-09-13T09:50:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.180+0000 7fc894366b80 1 -- 172.21.15.6:0/500306898 wait complete. 2023-09-13T09:50:40.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.180+0000 7fc894366b80 20 client.18465 trim_cache size 0 max 16384 2023-09-13T09:50:40.225 INFO:tasks.workunit.client.0.smithi006.stdout: 1 667000 6.48 MB/sec execute 480 sec latency 40.737 ms 2023-09-13T09:50:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.197+0000 7fc894366b80 1 Processor -- start 2023-09-13T09:50:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.197+0000 7fc894366b80 1 -- start start 2023-09-13T09:50:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc894366b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c038a00 0x55df3c0384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc894366b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c049090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc894366b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c03a060 0x55df3c041bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc894366b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3c0410a0 con 0x55df3c039700 2023-09-13T09:50:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc894366b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3c02b650 con 0x55df3c03a060 2023-09-13T09:50:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc894366b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3c041790 con 0x55df3c038a00 2023-09-13T09:50:40.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88571c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c049090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88571c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c049090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41004/0 (socket says 172.21.15.6:41004) 2023-09-13T09:50:40.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c038a00 0x55df3c0384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88671e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c03a060 0x55df3c041bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88571c700 1 -- 172.21.15.6:0/2847682915 learned_addr learned my addr 172.21.15.6:0/2847682915 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:40.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88671e700 1 -- 172.21.15.6:0/2847682915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c038a00 msgr2=0x55df3c0384c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88671e700 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c038a00 0x55df3c0384c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88671e700 1 -- 172.21.15.6:0/2847682915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 msgr2=0x55df3c049090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88671e700 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c049090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88671e700 1 -- 172.21.15.6:0/2847682915 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55df3bdb6de0 con 0x55df3c03a060 2023-09-13T09:50:40.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88571c700 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c049090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:50:40.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.198+0000 7fc88671e700 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c03a060 0x55df3c041bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc878002230 tx=0x7fc878009e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a9bbab481a0f82 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:40.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc874ff9700 1 -- 172.21.15.6:0/2847682915 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87800e040 con 0x55df3c03a060 2023-09-13T09:50:40.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc874ff9700 1 -- 172.21.15.6:0/2847682915 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc878023020 con 0x55df3c03a060 2023-09-13T09:50:40.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc874ff9700 1 -- 172.21.15.6:0/2847682915 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc878003c60 con 0x55df3c03a060 2023-09-13T09:50:40.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 -- 172.21.15.6:0/2847682915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c03a060 msgr2=0x55df3c041bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c03a060 0x55df3c041bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc878002230 tx=0x7fc878009e50 comp rx=0 tx=0).stop 2023-09-13T09:50:40.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 -- 172.21.15.6:0/2847682915 shutdown_connections 2023-09-13T09:50:40.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c03a060 0x55df3c041bd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c038a00 0x55df3c0384c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 --2- 172.21.15.6:0/2847682915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c049090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 -- 172.21.15.6:0/2847682915 >> 172.21.15.6:0/2847682915 conn(0x55df3bf96c80 msgr2=0x55df3c049a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 -- 172.21.15.6:0/2847682915 shutdown_connections 2023-09-13T09:50:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.199+0000 7fc894366b80 1 -- 172.21.15.6:0/2847682915 wait complete. 2023-09-13T09:50:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 -- start start 2023-09-13T09:50:40.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 Processor -- start 2023-09-13T09:50:40.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c048a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c048fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c045520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3c045c30 con 0x55df3c039700 2023-09-13T09:50:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3c045da0 con 0x55df3c038a00 2023-09-13T09:50:40.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55df3c045f60 con 0x55df3c03a060 2023-09-13T09:50:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc894366b80 10 client.0 _ll_register_callbacks cb 0x55df3bf26680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:50:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.200+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c048a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c048a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34532/0 (socket says 172.21.15.6:34532) 2023-09-13T09:50:40.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 -- 172.21.15.6:0/2118827152 learned_addr learned my addr 172.21.15.6:0/2118827152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:50:40.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc88671e700 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c045520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc88571c700 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c048fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 -- 172.21.15.6:0/2118827152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 msgr2=0x55df3c045520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c045520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 -- 172.21.15.6:0/2118827152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 msgr2=0x55df3c048fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:50:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c048fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 -- 172.21.15.6:0/2118827152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc870017070 con 0x55df3c038a00 2023-09-13T09:50:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc885f1d700 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c048a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc87c09a040 tx=0x7fc87c009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9e0f914fa811ea3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:50:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc8697fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:50:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc8697fa700 1 -- 172.21.15.6:0/2118827152 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc87c0b2040 con 0x55df3c038a00 2023-09-13T09:50:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc8697fa700 1 -- 172.21.15.6:0/2118827152 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc87c0b21a0 con 0x55df3c038a00 2023-09-13T09:50:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc87c0a2090 con 0x55df3c038a00 2023-09-13T09:50:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc8697fa700 1 -- 172.21.15.6:0/2118827152 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc87c09df60 con 0x55df3c038a00 2023-09-13T09:50:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc894366b80 10 client.27866 fetch_fsmap learned FSMap version 34 2023-09-13T09:50:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55df3bfa27a0 con 0x55df3c038a00 2023-09-13T09:50:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.201+0000 7fc8697fa700 1 -- 172.21.15.6:0/2118827152 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc87c0a9080 con 0x55df3c038a00 2023-09-13T09:50:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc8697fa700 1 -- 172.21.15.6:0/2118827152 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc87c0a1c00 con 0x55df3c038a00 2023-09-13T09:50:40.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc894366b80 10 client.27866 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:50:40.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc894366b80 10 client.27866 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:50:40.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc894366b80 20 client.27866 populate_metadata read hostname 'smithi006' 2023-09-13T09:50:40.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc894366b80 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c0a2ad0 0x55df3c0a4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:50:40.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc894366b80 4 client.27866 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:50:40.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55df3bf44050 con 0x55df3c0a2ad0 2023-09-13T09:50:40.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc88571c700 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c0a2ad0 0x55df3c0a4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:50:40.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc8697fa700 10 client.27866 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:40.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc88571c700 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c0a2ad0 0x55df3c0a4ec0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59f2eb744eb6100a server_cookie=54ccb15cc1ef3977 in_seq=0 out_seq=0 2023-09-13T09:50:40.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc8697fa700 1 -- 172.21.15.6:0/2118827152 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55df3bf44050 con 0x55df3c0a2ad0 2023-09-13T09:50:40.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc8697fa700 10 client.27866 handle_command_reply: tid=0 2023-09-13T09:50:40.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.202+0000 7fc894366b80 1 client.27866 shutdown 2023-09-13T09:50:40.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 msgr2=0x55df3c048a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c048a80 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc87c09a040 tx=0x7fc87c009310 comp rx=0 tx=0).stop 2023-09-13T09:50:40.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 shutdown_connections 2023-09-13T09:50:40.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55df3c03a060 0x55df3c045520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55df3c038a00 0x55df3c048a80 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55df3c0a2ad0 0x55df3c0a4ec0 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 --2- 172.21.15.6:0/2118827152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55df3c039700 0x55df3c048fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc8697fa700 0 client.27866 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:50:40.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 >> 172.21.15.6:0/2118827152 conn(0x55df3bf96c80 msgr2=0x55df3c041b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 shutdown_connections 2023-09-13T09:50:40.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 1 -- 172.21.15.6:0/2118827152 wait complete. 2023-09-13T09:50:40.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc894366b80 20 client.27866 trim_cache size 0 max 16384 2023-09-13T09:50:40.254 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:50:40.254 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:50:40.254 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:50:40.254 INFO:teuthology.orchestra.run.smithi006.stdout: "98568f8c-56b2-4a57-a511-56f1a4aae0ea": { 2023-09-13T09:50:40.255 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:50:40.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "98568f8c-56b2-4a57-a511-56f1a4aae0ea", 2023-09-13T09:50:40.255 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:50:40.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:50:40.255 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:50:40.256 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:50:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc86c0a06c0 msgr2=0x7fc86c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc86c0a06c0 0x7fc86c0a2b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc870009c60 tx=0x7fc870009260 comp rx=0 tx=0).stop 2023-09-13T09:50:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 msgr2=0x7fc88019d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:50:40.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc88019d0d0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7fc87c009990 tx=0x7fc87c00f690 comp rx=0 tx=0).stop 2023-09-13T09:50:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 shutdown_connections 2023-09-13T09:50:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc880102950 0x7fc8801a4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc86c0a06c0 0x7fc86c0a2b80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc880100dc0 0x7fc88019d0d0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 --2- 172.21.15.6:0/2873423887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc880101fb0 0x7fc88019d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:50:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 >> 172.21.15.6:0/2873423887 conn(0x7fc8800fc330 msgr2=0x7fc8800fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:50:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.203+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 shutdown_connections 2023-09-13T09:50:40.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:50:40.204+0000 7fc888181700 1 -- 172.21.15.6:0/2873423887 wait complete. 2023-09-13T09:50:40.259 INFO:tasks.cephfs.filesystem:scrub status for tag:98568f8c-56b2-4a57-a511-56f1a4aae0ea - {'path': '/', 'tag': '98568f8c-56b2-4a57-a511-56f1a4aae0ea', 'options': 'recursive,force'} 2023-09-13T09:50:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:40 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:50:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:40 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:50:40.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:40.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:40.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:40 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:50:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:40.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 668076 6.48 MB/sec execute 481 sec latency 23.985 ms 2023-09-13T09:50:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:50:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:41 smithi006 ceph-mon[98665]: pgmap v635: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-13T09:50:41.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:41.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:41.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:41.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:41.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:50:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:41 smithi053 ceph-mon[102373]: pgmap v635: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-13T09:50:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:50:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:50:41.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:41 smithi131 ceph-mon[102785]: pgmap v635: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 673 KiB/s rd, 2.1 MiB/s wr, 225 op/s 2023-09-13T09:50:42.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 670077 6.48 MB/sec execute 482 sec latency 13.611 ms 2023-09-13T09:50:43.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 671504 6.50 MB/sec execute 483 sec latency 16.348 ms 2023-09-13T09:50:44.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 673066 6.49 MB/sec execute 484 sec latency 13.385 ms 2023-09-13T09:50:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:43 smithi006 ceph-mon[98665]: pgmap v636: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2023-09-13T09:50:44.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:43 smithi053 ceph-mon[102373]: pgmap v636: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2023-09-13T09:50:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:43 smithi131 ceph-mon[102785]: pgmap v636: 97 pgs: 97 active+clean; 263 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 760 KiB/s rd, 2.2 MiB/s wr, 258 op/s 2023-09-13T09:50:45.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 675012 6.51 MB/sec execute 485 sec latency 14.303 ms 2023-09-13T09:50:46.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 675922 6.50 MB/sec execute 486 sec latency 56.941 ms 2023-09-13T09:50:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:45 smithi006 ceph-mon[98665]: pgmap v637: 97 pgs: 97 active+clean; 264 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:50:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:45 smithi053 ceph-mon[102373]: pgmap v637: 97 pgs: 97 active+clean; 264 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:50:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:45 smithi131 ceph-mon[102785]: pgmap v637: 97 pgs: 97 active+clean; 264 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 763 KiB/s rd, 2.3 MiB/s wr, 245 op/s 2023-09-13T09:50:47.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 678141 6.51 MB/sec execute 487 sec latency 13.761 ms 2023-09-13T09:50:48.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 679099 6.51 MB/sec execute 488 sec latency 13.838 ms 2023-09-13T09:50:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:47 smithi006 ceph-mon[98665]: pgmap v638: 97 pgs: 97 active+clean; 266 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.3 MiB/s wr, 240 op/s 2023-09-13T09:50:48.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:47 smithi053 ceph-mon[102373]: pgmap v638: 97 pgs: 97 active+clean; 266 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.3 MiB/s wr, 240 op/s 2023-09-13T09:50:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:47 smithi131 ceph-mon[102785]: pgmap v638: 97 pgs: 97 active+clean; 266 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 679 KiB/s rd, 2.3 MiB/s wr, 240 op/s 2023-09-13T09:50:49.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 681284 6.52 MB/sec execute 489 sec latency 13.580 ms 2023-09-13T09:50:50.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 682392 6.52 MB/sec execute 490 sec latency 13.952 ms 2023-09-13T09:50:50.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:49 smithi053 ceph-mon[102373]: pgmap v639: 97 pgs: 97 active+clean; 268 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 2.1 MiB/s wr, 249 op/s 2023-09-13T09:50:50.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:49 smithi006 ceph-mon[98665]: pgmap v639: 97 pgs: 97 active+clean; 268 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 2.1 MiB/s wr, 249 op/s 2023-09-13T09:50:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:49 smithi131 ceph-mon[102785]: pgmap v639: 97 pgs: 97 active+clean; 268 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 2.1 MiB/s wr, 249 op/s 2023-09-13T09:50:51.181 INFO:tasks.workunit.client.0.smithi006.stdout: 1 684306 6.52 MB/sec execute 491 sec latency 36.646 ms 2023-09-13T09:50:52.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 685699 6.53 MB/sec execute 492 sec latency 23.169 ms 2023-09-13T09:50:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:51 smithi006 ceph-mon[98665]: pgmap v640: 97 pgs: 97 active+clean; 268 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 2.1 MiB/s wr, 216 op/s 2023-09-13T09:50:52.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:51 smithi053 ceph-mon[102373]: pgmap v640: 97 pgs: 97 active+clean; 268 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 2.1 MiB/s wr, 216 op/s 2023-09-13T09:50:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:51 smithi131 ceph-mon[102785]: pgmap v640: 97 pgs: 97 active+clean; 268 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 2.1 MiB/s wr, 216 op/s 2023-09-13T09:50:53.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 686930 6.53 MB/sec execute 493 sec latency 15.539 ms 2023-09-13T09:50:54.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 689173 6.54 MB/sec execute 494 sec latency 11.731 ms 2023-09-13T09:50:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:53 smithi006 ceph-mon[98665]: pgmap v641: 97 pgs: 97 active+clean; 271 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 2.3 MiB/s wr, 278 op/s 2023-09-13T09:50:54.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:53 smithi053 ceph-mon[102373]: pgmap v641: 97 pgs: 97 active+clean; 271 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 2.3 MiB/s wr, 278 op/s 2023-09-13T09:50:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:53 smithi131 ceph-mon[102785]: pgmap v641: 97 pgs: 97 active+clean; 271 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 2.3 MiB/s wr, 278 op/s 2023-09-13T09:50:55.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 690373 6.54 MB/sec execute 495 sec latency 12.729 ms 2023-09-13T09:50:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:54 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:54 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:54 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:54 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:54 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:55.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:54 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:54 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:54 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:55.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:54 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:56.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 692475 6.55 MB/sec execute 496 sec latency 35.152 ms 2023-09-13T09:50:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:50:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:55 smithi006 ceph-mon[98665]: pgmap v642: 97 pgs: 97 active+clean; 272 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.4 MiB/s wr, 237 op/s 2023-09-13T09:50:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:50:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:55 smithi053 ceph-mon[102373]: pgmap v642: 97 pgs: 97 active+clean; 272 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.4 MiB/s wr, 237 op/s 2023-09-13T09:50:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:50:56.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:55 smithi131 ceph-mon[102785]: pgmap v642: 97 pgs: 97 active+clean; 272 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 591 KiB/s rd, 2.4 MiB/s wr, 237 op/s 2023-09-13T09:50:57.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 693158 6.54 MB/sec execute 497 sec latency 134.895 ms 2023-09-13T09:50:58.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 695392 6.55 MB/sec execute 498 sec latency 12.316 ms 2023-09-13T09:50:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:57 smithi006 ceph-mon[98665]: pgmap v643: 97 pgs: 97 active+clean; 275 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2023-09-13T09:50:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:57 smithi053 ceph-mon[102373]: pgmap v643: 97 pgs: 97 active+clean; 275 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2023-09-13T09:50:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:57 smithi131 ceph-mon[102785]: pgmap v643: 97 pgs: 97 active+clean; 275 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2023-09-13T09:50:59.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 696598 6.56 MB/sec execute 499 sec latency 12.849 ms 2023-09-13T09:51:00.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 698635 6.56 MB/sec execute 500 sec latency 11.608 ms 2023-09-13T09:51:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:50:59 smithi006 ceph-mon[98665]: pgmap v644: 97 pgs: 97 active+clean; 278 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 2.3 MiB/s wr, 261 op/s 2023-09-13T09:51:00.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:50:59 smithi053 ceph-mon[102373]: pgmap v644: 97 pgs: 97 active+clean; 278 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 2.3 MiB/s wr, 261 op/s 2023-09-13T09:51:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:50:59 smithi131 ceph-mon[102785]: pgmap v644: 97 pgs: 97 active+clean; 278 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 780 KiB/s rd, 2.3 MiB/s wr, 261 op/s 2023-09-13T09:51:01.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 699983 6.57 MB/sec execute 501 sec latency 57.416 ms 2023-09-13T09:51:02.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 701647 6.57 MB/sec execute 502 sec latency 27.679 ms 2023-09-13T09:51:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:01 smithi006 ceph-mon[98665]: pgmap v645: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-13T09:51:02.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:01 smithi053 ceph-mon[102373]: pgmap v645: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-13T09:51:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:01 smithi131 ceph-mon[102785]: pgmap v645: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 636 KiB/s rd, 2.2 MiB/s wr, 228 op/s 2023-09-13T09:51:03.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 703383 6.58 MB/sec execute 503 sec latency 16.583 ms 2023-09-13T09:51:04.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 704768 6.58 MB/sec execute 504 sec latency 11.998 ms 2023-09-13T09:51:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:03 smithi006 ceph-mon[98665]: pgmap v646: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.5 MiB/s wr, 255 op/s 2023-09-13T09:51:04.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:03 smithi053 ceph-mon[102373]: pgmap v646: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.5 MiB/s wr, 255 op/s 2023-09-13T09:51:04.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:03 smithi131 ceph-mon[102785]: pgmap v646: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 728 KiB/s rd, 2.5 MiB/s wr, 255 op/s 2023-09-13T09:51:05.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 706897 6.59 MB/sec execute 505 sec latency 15.640 ms 2023-09-13T09:51:06.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 707857 6.58 MB/sec execute 506 sec latency 25.296 ms 2023-09-13T09:51:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:05 smithi006 ceph-mon[98665]: pgmap v647: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.4 MiB/s wr, 255 op/s 2023-09-13T09:51:06.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:05 smithi053 ceph-mon[102373]: pgmap v647: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.4 MiB/s wr, 255 op/s 2023-09-13T09:51:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:05 smithi131 ceph-mon[102785]: pgmap v647: 97 pgs: 97 active+clean; 280 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 859 KiB/s rd, 2.4 MiB/s wr, 255 op/s 2023-09-13T09:51:07.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 710185 6.60 MB/sec execute 507 sec latency 15.789 ms 2023-09-13T09:51:08.182 INFO:tasks.workunit.client.0.smithi006.stdout: 1 711050 6.59 MB/sec execute 508 sec latency 29.924 ms 2023-09-13T09:51:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:07 smithi006 ceph-mon[98665]: pgmap v648: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 2.3 MiB/s wr, 244 op/s 2023-09-13T09:51:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:07 smithi053 ceph-mon[102373]: pgmap v648: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 2.3 MiB/s wr, 244 op/s 2023-09-13T09:51:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:07 smithi131 ceph-mon[102785]: pgmap v648: 97 pgs: 97 active+clean; 277 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 808 KiB/s rd, 2.3 MiB/s wr, 244 op/s 2023-09-13T09:51:09.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 713243 6.60 MB/sec execute 509 sec latency 19.104 ms 2023-09-13T09:51:10.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 714379 6.60 MB/sec execute 510 sec latency 14.381 ms 2023-09-13T09:51:10.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:09 smithi006 ceph-mon[98665]: pgmap v649: 97 pgs: 97 active+clean; 280 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.1 MiB/s wr, 289 op/s 2023-09-13T09:51:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:09 smithi053 ceph-mon[102373]: pgmap v649: 97 pgs: 97 active+clean; 280 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.1 MiB/s wr, 289 op/s 2023-09-13T09:51:10.261 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:51:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:09 smithi131 ceph-mon[102785]: pgmap v649: 97 pgs: 97 active+clean; 280 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 923 KiB/s rd, 2.1 MiB/s wr, 289 op/s 2023-09-13T09:51:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 -- 172.21.15.6:0/2125591047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 msgr2=0x7f8a34102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/2125591047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34102410 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f8a300099c0 tx=0x7f8a30009cd0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 -- 172.21.15.6:0/2125591047 shutdown_connections 2023-09-13T09:51:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/2125591047 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a34102950 0x7f8a34109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/2125591047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a34100dc0 0x7f8a341011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/2125591047 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34102410 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 -- 172.21.15.6:0/2125591047 >> 172.21.15.6:0/2125591047 conn(0x7f8a340fc350 msgr2=0x7f8a340fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 -- 172.21.15.6:0/2125591047 shutdown_connections 2023-09-13T09:51:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.394+0000 7f8a3b43c700 1 -- 172.21.15.6:0/2125591047 wait complete. 2023-09-13T09:51:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 Processor -- start 2023-09-13T09:51:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 -- start start 2023-09-13T09:51:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a34100dc0 0x7f8a34196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a34102950 0x7f8a3419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e600 con 0x7f8a34101fb0 2023-09-13T09:51:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e740 con 0x7f8a34100dc0 2023-09-13T09:51:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a3b43c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3419e8d0 con 0x7f8a34102950 2023-09-13T09:51:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41024/0 (socket says 172.21.15.6:41024) 2023-09-13T09:51:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a389d7700 1 -- 172.21.15.6:0/3557300328 learned_addr learned my addr 172.21.15.6:0/3557300328 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a391d8700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a34100dc0 0x7f8a34196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.395+0000 7f8a399d9700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a34102950 0x7f8a3419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a389d7700 1 -- 172.21.15.6:0/3557300328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a34102950 msgr2=0x7f8a3419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a389d7700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a34102950 0x7f8a3419e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a389d7700 1 -- 172.21.15.6:0/3557300328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a34100dc0 msgr2=0x7f8a34196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a389d7700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a34100dc0 0x7f8a34196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a389d7700 1 -- 172.21.15.6:0/3557300328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a300095f0 con 0x7f8a34101fb0 2023-09-13T09:51:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a391d8700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a34100dc0 0x7f8a34196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a389d7700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34196fc0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009fd0 tx=0x7f8a30009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a2a7fc700 1 -- 172.21.15.6:0/3557300328 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3001d070 con 0x7f8a34101fb0 2023-09-13T09:51:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a2a7fc700 1 -- 172.21.15.6:0/3557300328 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a30005030 con 0x7f8a34101fb0 2023-09-13T09:51:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3419eb50 con 0x7f8a34101fb0 2023-09-13T09:51:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a2a7fc700 1 -- 172.21.15.6:0/3557300328 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30004a90 con 0x7f8a34101fb0 2023-09-13T09:51:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.396+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3419ef70 con 0x7f8a34101fb0 2023-09-13T09:51:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.398+0000 7f8a2a7fc700 1 -- 172.21.15.6:0/3557300328 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8a300051a0 con 0x7f8a34101fb0 2023-09-13T09:51:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.399+0000 7f8a2a7fc700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a200a0640 0x7f8a200a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.399+0000 7f8a391d8700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a200a0640 0x7f8a200a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.399+0000 7f8a2a7fc700 1 -- 172.21.15.6:0/3557300328 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a300cc960 con 0x7f8a34101fb0 2023-09-13T09:51:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.399+0000 7f8a391d8700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a200a0640 0x7f8a200a2b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a34101e10 tx=0x7f8a24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 Processor -- start 2023-09-13T09:51:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 -- start start 2023-09-13T09:51:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfca9ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9b060 0x561cfca994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca99e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfc9f2780 con 0x561cfca9a700 2023-09-13T09:51:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfc9f00a0 con 0x561cfca9b060 2023-09-13T09:51:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a47621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfc9eb990 con 0x561cfca99a00 2023-09-13T09:51:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a391d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfca9ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9b060 0x561cfca994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a391d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfca9ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41030/0 (socket says 172.21.15.6:41030) 2023-09-13T09:51:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a391d8700 1 -- 172.21.15.6:0/1895813069 learned_addr learned my addr 172.21.15.6:0/1895813069 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.400+0000 7f8a399d9700 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca99e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a389d7700 1 -- 172.21.15.6:0/1895813069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 msgr2=0x561cfca99e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a389d7700 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca99e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a389d7700 1 -- 172.21.15.6:0/1895813069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 msgr2=0x561cfca9ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a389d7700 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfca9ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a389d7700 1 -- 172.21.15.6:0/1895813069 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cfc86b630 con 0x561cfca9b060 2023-09-13T09:51:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a391d8700 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfca9ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a389d7700 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9b060 0x561cfca994c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a3009a0c0 tx=0x7f8a3009a8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c26b3c2492c967f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/1895813069 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300a0070 con 0x561cfca9b060 2023-09-13T09:51:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/1895813069 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a3009c020 con 0x561cfca9b060 2023-09-13T09:51:10.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.401+0000 7f8a1f7fe700 1 -- 172.21.15.6:0/1895813069 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a30099880 con 0x561cfca9b060 2023-09-13T09:51:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 -- 172.21.15.6:0/1895813069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9b060 msgr2=0x561cfca994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9b060 0x561cfca994c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8a3009a0c0 tx=0x7f8a3009a8b0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 -- 172.21.15.6:0/1895813069 shutdown_connections 2023-09-13T09:51:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca99e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfca9ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 --2- 172.21.15.6:0/1895813069 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9b060 0x561cfca994c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 -- 172.21.15.6:0/1895813069 >> 172.21.15.6:0/1895813069 conn(0x561cfc9f7c80 msgr2=0x561cfca93f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 -- 172.21.15.6:0/1895813069 shutdown_connections 2023-09-13T09:51:10.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 -- 172.21.15.6:0/1895813069 wait complete. 2023-09-13T09:51:10.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 -- start start 2023-09-13T09:51:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.402+0000 7f8a47621b80 1 Processor -- start 2023-09-13T09:51:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfcaa3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9b060 0x561cfcaaa0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfc989bb0 con 0x561cfca9a700 2023-09-13T09:51:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfc9898b0 con 0x561cfca99a00 2023-09-13T09:51:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfc86d920 con 0x561cfca9b060 2023-09-13T09:51:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 10 client.0 _ll_register_callbacks cb 0x561cfc987680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfcaa3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a391d8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfcaa3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41038/0 (socket says 172.21.15.6:41038) 2023-09-13T09:51:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a399d9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9b060 0x561cfcaaa0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a391d8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34560/0 (socket says 172.21.15.6:34560) 2023-09-13T09:51:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 -- 172.21.15.6:0/2673241875 learned_addr learned my addr 172.21.15.6:0/2673241875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 -- 172.21.15.6:0/2673241875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9b060 msgr2=0x561cfcaaa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9b060 0x561cfcaaa0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 -- 172.21.15.6:0/2673241875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 msgr2=0x561cfcaa2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 -- 172.21.15.6:0/2673241875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3419ef70 con 0x561cfca9a700 2023-09-13T09:51:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a389d7700 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfcaa3090 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8a30000c00 tx=0x7f8a30009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=528d35e81f68a856 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a1cff9700 1 -- 172.21.15.6:0/2673241875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a300a1e80 con 0x561cfca9a700 2023-09-13T09:51:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a1cff9700 1 -- 172.21.15.6:0/2673241875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a3009d070 con 0x561cfca9a700 2023-09-13T09:51:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.403+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561cfca8c670 con 0x561cfca9a700 2023-09-13T09:51:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a1cff9700 1 -- 172.21.15.6:0/2673241875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a3009df60 con 0x561cfca9a700 2023-09-13T09:51:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 10 client.18483 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561cfca037a0 con 0x561cfca9a700 2023-09-13T09:51:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a1cff9700 1 -- 172.21.15.6:0/2673241875 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561cfca8c670 con 0x561cfca9a700 2023-09-13T09:51:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a1cff9700 1 -- 172.21.15.6:0/2673241875 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a300b2170 con 0x561cfca9a700 2023-09-13T09:51:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 10 client.18483 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 10 client.18483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 20 client.18483 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcaae450 0x561cfcab0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 4 client.18483 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561cfc9e4970 con 0x561cfcaae450 2023-09-13T09:51:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.404+0000 7f8a391d8700 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcaae450 0x561cfcab0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.405+0000 7f8a1cff9700 10 client.18483 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:10.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.405+0000 7f8a391d8700 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcaae450 0x561cfcab0840 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d5bf444aa945b20 server_cookie=7f19a963df1aed86 in_seq=0 out_seq=0 2023-09-13T09:51:10.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.405+0000 7f8a1cff9700 1 -- 172.21.15.6:0/2673241875 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561cfc9e4970 con 0x561cfcaae450 2023-09-13T09:51:10.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.405+0000 7f8a1cff9700 10 client.18483 handle_command_reply: tid=0 2023-09-13T09:51:10.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.405+0000 7f8a47621b80 1 client.18483 shutdown 2023-09-13T09:51:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 msgr2=0x561cfcaa3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfcaa3090 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f8a30000c00 tx=0x7f8a30009cf0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 shutdown_connections 2023-09-13T09:51:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9b060 0x561cfcaaa0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcaae450 0x561cfcab0840 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2673241875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9a700 0x561cfcaa3090 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a1cff9700 0 client.18483 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 >> 172.21.15.6:0/2673241875 conn(0x561cfc9f7c80 msgr2=0x561cfca8e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 shutdown_connections 2023-09-13T09:51:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 1 -- 172.21.15.6:0/2673241875 wait complete. 2023-09-13T09:51:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.406+0000 7f8a47621b80 20 client.18483 trim_cache size 0 max 16384 2023-09-13T09:51:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.423+0000 7f8a47621b80 1 Processor -- start 2023-09-13T09:51:10.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.423+0000 7f8a47621b80 1 -- start start 2023-09-13T09:51:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca994c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9a700 0x561cfcaaa090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfca9d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a47621b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfcaa2000 con 0x561cfca9b060 2023-09-13T09:51:10.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a47621b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfcaa26c0 con 0x561cfca9a700 2023-09-13T09:51:10.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a47621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfca96000 con 0x561cfca99a00 2023-09-13T09:51:10.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a399d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfca9d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a391d8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9a700 0x561cfcaaa090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a399d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfca9d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41048/0 (socket says 172.21.15.6:41048) 2023-09-13T09:51:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a399d9700 1 -- 172.21.15.6:0/2046490068 learned_addr learned my addr 172.21.15.6:0/2046490068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a391d8700 1 -- 172.21.15.6:0/2046490068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9a700 msgr2=0x561cfcaaa090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a391d8700 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9a700 0x561cfcaaa090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a391d8700 1 -- 172.21.15.6:0/2046490068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 msgr2=0x561cfca9d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a391d8700 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfca9d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a391d8700 1 -- 172.21.15.6:0/2046490068 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561cfc817de0 con 0x561cfca99a00 2023-09-13T09:51:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a399d9700 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfca9d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a391d8700 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca994c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561cfc989cc0 tx=0x7f8a24014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b69908f717e9c58 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.424+0000 7f8a1ffff700 1 -- 172.21.15.6:0/2046490068 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2402d070 con 0x561cfca99a00 2023-09-13T09:51:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a1ffff700 1 -- 172.21.15.6:0/2046490068 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a24025040 con 0x561cfca99a00 2023-09-13T09:51:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a1ffff700 1 -- 172.21.15.6:0/2046490068 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24024070 con 0x561cfca99a00 2023-09-13T09:51:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 -- 172.21.15.6:0/2046490068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 msgr2=0x561cfca994c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca994c0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x561cfc989cc0 tx=0x7f8a24014000 comp rx=0 tx=0).stop 2023-09-13T09:51:10.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 -- 172.21.15.6:0/2046490068 shutdown_connections 2023-09-13T09:51:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfca9d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca99a00 0x561cfca994c0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 --2- 172.21.15.6:0/2046490068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca9a700 0x561cfcaaa090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 -- 172.21.15.6:0/2046490068 >> 172.21.15.6:0/2046490068 conn(0x561cfc9f7c80 msgr2=0x561cfcaa2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 -- 172.21.15.6:0/2046490068 shutdown_connections 2023-09-13T09:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 -- 172.21.15.6:0/2046490068 wait complete. 2023-09-13T09:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.425+0000 7f8a47621b80 1 -- start start 2023-09-13T09:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 1 Processor -- start 2023-09-13T09:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9a700 0x561cfcaa6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfcaa6d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfcaa72a0 con 0x561cfca9b060 2023-09-13T09:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfcaa7410 con 0x561cfca99a00 2023-09-13T09:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561cfcb02220 con 0x561cfca9a700 2023-09-13T09:51:10.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a47621b80 10 client.0 _ll_register_callbacks cb 0x561cfc987680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a399d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfcaa6d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9a700 0x561cfcaa6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a391d8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9a700 0x561cfcaa6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44106/0 (socket says 172.21.15.6:44106) 2023-09-13T09:51:10.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a399d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfcaa6d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41054/0 (socket says 172.21.15.6:41054) 2023-09-13T09:51:10.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a391d8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34574/0 (socket says 172.21.15.6:34574) 2023-09-13T09:51:10.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 -- 172.21.15.6:0/858193658 learned_addr learned my addr 172.21.15.6:0/858193658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:10.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 -- 172.21.15.6:0/858193658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 msgr2=0x561cfcaa9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 -- 172.21.15.6:0/858193658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 msgr2=0x561cfcaa6d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfcaa6d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.426+0000 7f8a389d7700 1 -- 172.21.15.6:0/858193658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c011610 con 0x561cfca9a700 2023-09-13T09:51:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a389d7700 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9a700 0x561cfcaa6820 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a30099e30 tx=0x7f8a3009a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c90cc900a890ba5c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a1cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:51:10.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a1cff9700 1 -- 172.21.15.6:0/858193658 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a3009df60 con 0x561cfca9a700 2023-09-13T09:51:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a1cff9700 1 -- 172.21.15.6:0/858193658 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8a3009d040 con 0x561cfca9a700 2023-09-13T09:51:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a3009c020 con 0x561cfca9a700 2023-09-13T09:51:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a1cff9700 1 -- 172.21.15.6:0/858193658 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a300961e0 con 0x561cfca9a700 2023-09-13T09:51:10.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 10 client.27805 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x561cfc800c60 con 0x561cfca9a700 2023-09-13T09:51:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a1cff9700 1 -- 172.21.15.6:0/858193658 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8a3009c020 con 0x561cfca9a700 2023-09-13T09:51:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a1cff9700 1 -- 172.21.15.6:0/858193658 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f8a300a1c80 con 0x561cfca9a700 2023-09-13T09:51:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 10 client.27805 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:10.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 10 client.27805 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 20 client.27805 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcb035e0 0x561cfcb05a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 4 client.27805 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:51:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.427+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561cfc9a5050 con 0x561cfcb035e0 2023-09-13T09:51:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a391d8700 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcb035e0 0x561cfcb05a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a1cff9700 10 client.27805 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a391d8700 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcb035e0 0x561cfcb05a00 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da088cf7e69f17d3 server_cookie=22e097410252a2dd in_seq=0 out_seq=0 2023-09-13T09:51:10.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a1cff9700 1 -- 172.21.15.6:0/858193658 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561cfc9a5050 con 0x561cfcb035e0 2023-09-13T09:51:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a1cff9700 10 client.27805 handle_command_reply: tid=0 2023-09-13T09:51:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a47621b80 1 client.27805 shutdown 2023-09-13T09:51:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9a700 msgr2=0x561cfcaa6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.428+0000 7f8a47621b80 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9a700 0x561cfcaa6820 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8a30099e30 tx=0x7f8a3009a400 comp rx=0 tx=0).stop 2023-09-13T09:51:10.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 shutdown_connections 2023-09-13T09:51:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561cfcb035e0 0x561cfcb05a00 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561cfca9b060 0x561cfcaa6d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561cfca99a00 0x561cfcaa9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 --2- 172.21.15.6:0/858193658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561cfca9a700 0x561cfcaa6820 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a1cff9700 0 client.27805 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 >> 172.21.15.6:0/858193658 conn(0x561cfc9f7c80 msgr2=0x561cfcaa2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 shutdown_connections 2023-09-13T09:51:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 1 -- 172.21.15.6:0/858193658 wait complete. 2023-09-13T09:51:10.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a47621b80 20 client.27805 trim_cache size 0 max 16384 2023-09-13T09:51:10.455 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:51:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:51:10.455 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:51:10.455 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:51:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a200a0640 msgr2=0x7f8a200a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a200a0640 0x7f8a200a2b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f8a34101e10 tx=0x7f8a24009260 comp rx=0 tx=0).stop 2023-09-13T09:51:10.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 msgr2=0x7f8a34196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34196fc0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f8a30009fd0 tx=0x7f8a30009580 comp rx=0 tx=0).stop 2023-09-13T09:51:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 shutdown_connections 2023-09-13T09:51:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8a34102950 0x7f8a3419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8a34100dc0 0x7f8a34196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8a200a0640 0x7f8a200a2b00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 --2- 172.21.15.6:0/3557300328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a34101fb0 0x7f8a34196fc0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 >> 172.21.15.6:0/3557300328 conn(0x7f8a340fc350 msgr2=0x7f8a340fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 shutdown_connections 2023-09-13T09:51:10.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.429+0000 7f8a3b43c700 1 -- 172.21.15.6:0/3557300328 wait complete. 2023-09-13T09:51:10.459 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:51:10.460 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:51:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 -- 172.21.15.6:0/2767947289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474100dc0 msgr2=0x7f14741011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 --2- 172.21.15.6:0/2767947289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474100dc0 0x7f14741011e0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f14640099c0 tx=0x7f1464009cd0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 -- 172.21.15.6:0/2767947289 shutdown_connections 2023-09-13T09:51:10.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 --2- 172.21.15.6:0/2767947289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1474102950 0x7f1474109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 --2- 172.21.15.6:0/2767947289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474100dc0 0x7f14741011e0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 --2- 172.21.15.6:0/2767947289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1474101fb0 0x7f1474102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 -- 172.21.15.6:0/2767947289 >> 172.21.15.6:0/2767947289 conn(0x7f14740fc330 msgr2=0x7f14740fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 -- 172.21.15.6:0/2767947289 shutdown_connections 2023-09-13T09:51:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.596+0000 7f147a962700 1 -- 172.21.15.6:0/2767947289 wait complete. 2023-09-13T09:51:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 Processor -- start 2023-09-13T09:51:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 -- start start 2023-09-13T09:51:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1474100dc0 0x7f1474196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1474101fb0 0x7f1474196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474102950 0x7f147419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147419e610 con 0x7f1474102950 2023-09-13T09:51:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147419e750 con 0x7f1474100dc0 2023-09-13T09:51:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f147a962700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f147419e8e0 con 0x7f1474101fb0 2023-09-13T09:51:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f1478eff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474102950 0x7f147419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f1473fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1474100dc0 0x7f1474196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f1478eff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474102950 0x7f147419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41068/0 (socket says 172.21.15.6:41068) 2023-09-13T09:51:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f1478eff700 1 -- 172.21.15.6:0/3441543467 learned_addr learned my addr 172.21.15.6:0/3441543467 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f14737fe700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1474101fb0 0x7f1474196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f1473fff700 1 -- 172.21.15.6:0/3441543467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1474101fb0 msgr2=0x7f1474196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f1473fff700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1474101fb0 0x7f1474196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.597+0000 7f1473fff700 1 -- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474102950 msgr2=0x7f147419e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f1473fff700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474102950 0x7f147419e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f1473fff700 1 -- 172.21.15.6:0/3441543467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14640095f0 con 0x7f1474100dc0 2023-09-13T09:51:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f1478eff700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474102950 0x7f147419e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f1473fff700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1474100dc0 0x7f1474196a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14640098e0 tx=0x7f1464009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f14717fa700 1 -- 172.21.15.6:0/3441543467 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f146401d070 con 0x7f1474100dc0 2023-09-13T09:51:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f147419eb60 con 0x7f1474100dc0 2023-09-13T09:51:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f14717fa700 1 -- 172.21.15.6:0/3441543467 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1464005020 con 0x7f1474100dc0 2023-09-13T09:51:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f14717fa700 1 -- 172.21.15.6:0/3441543467 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1464004a90 con 0x7f1474100dc0 2023-09-13T09:51:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.598+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f147419ef80 con 0x7f1474100dc0 2023-09-13T09:51:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.599+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1474107d40 con 0x7f1474100dc0 2023-09-13T09:51:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.600+0000 7f14717fa700 1 -- 172.21.15.6:0/3441543467 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1464005190 con 0x7f1474100dc0 2023-09-13T09:51:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.601+0000 7f14717fa700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f145c0a0640 0x7f145c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.601+0000 7f14737fe700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f145c0a0640 0x7f145c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.601+0000 7f14717fa700 1 -- 172.21.15.6:0/3441543467 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f14640cc880 con 0x7f1474100dc0 2023-09-13T09:51:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.601+0000 7f14737fe700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f145c0a0640 0x7f145c0a2b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1468009c60 tx=0x7f1468009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.604+0000 7f14717fa700 1 -- 172.21.15.6:0/3441543467 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1464096390 con 0x7f1474100dc0 2023-09-13T09:51:10.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.872+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f147410c840 con 0x7f1474100dc0 2023-09-13T09:51:10.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.873+0000 7f14717fa700 1 -- 172.21.15.6:0/3441543467 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f14640999b0 con 0x7f1474100dc0 2023-09-13T09:51:10.873 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:51:10.874 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:51:10.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f145c0a0640 msgr2=0x7f145c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f145c0a0640 0x7f145c0a2b00 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1468009c60 tx=0x7f1468009260 comp rx=0 tx=0).stop 2023-09-13T09:51:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1474100dc0 msgr2=0x7f1474196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1474100dc0 0x7f1474196a90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f14640098e0 tx=0x7f1464009580 comp rx=0 tx=0).stop 2023-09-13T09:51:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 shutdown_connections 2023-09-13T09:51:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f145c0a0640 0x7f145c0a2b00 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1474102950 0x7f147419e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1474100dc0 0x7f1474196a90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 --2- 172.21.15.6:0/3441543467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1474101fb0 0x7f1474196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 >> 172.21.15.6:0/3441543467 conn(0x7f14740fc330 msgr2=0x7f14740fe620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 shutdown_connections 2023-09-13T09:51:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:10.875+0000 7f147a962700 1 -- 172.21.15.6:0/3441543467 wait complete. 2023-09-13T09:51:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:51:10.888 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:51:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 -- 172.21.15.6:0/1639535735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55900ff440 msgr2=0x7f55900ff860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 --2- 172.21.15.6:0/1639535735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55900ff440 0x7f55900ff860 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f557800aad0 tx=0x7f557800ade0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 -- 172.21.15.6:0/1639535735 shutdown_connections 2023-09-13T09:51:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 --2- 172.21.15.6:0/1639535735 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5590100fd0 0x7f5590107880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 --2- 172.21.15.6:0/1639535735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f55900ff440 0x7f55900ff860 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 --2- 172.21.15.6:0/1639535735 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5590100630 0x7f5590100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 -- 172.21.15.6:0/1639535735 >> 172.21.15.6:0/1639535735 conn(0x7f55900fa9b0 msgr2=0x7f55900fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 -- 172.21.15.6:0/1639535735 shutdown_connections 2023-09-13T09:51:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 -- 172.21.15.6:0/1639535735 wait complete. 2023-09-13T09:51:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 Processor -- start 2023-09-13T09:51:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 -- start start 2023-09-13T09:51:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55900ff440 0x7f5590196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.024+0000 7f5596d6d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5590100630 0x7f5590197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5596d6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5590100fd0 0x7f559019e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5596d6d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559019e660 con 0x7f5590100fd0 2023-09-13T09:51:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5596d6d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559019e7a0 con 0x7f55900ff440 2023-09-13T09:51:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5596d6d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559019e930 con 0x7f5590100630 2023-09-13T09:51:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55900ff440 0x7f5590196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f559530a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5590100fd0 0x7f559019e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55900ff440 0x7f5590196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34602/0 (socket says 172.21.15.6:34602) 2023-09-13T09:51:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 -- 172.21.15.6:0/4092072302 learned_addr learned my addr 172.21.15.6:0/4092072302 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f558ffff700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5590100630 0x7f5590197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 -- 172.21.15.6:0/4092072302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5590100630 msgr2=0x7f5590197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5590100630 0x7f5590197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 -- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5590100fd0 msgr2=0x7f559019e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5590100fd0 0x7f559019e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 -- 172.21.15.6:0/4092072302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f557800a700 con 0x7f55900ff440 2023-09-13T09:51:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f559530a700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5590100fd0 0x7f559019e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5594b09700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55900ff440 0x7f5590196ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5578003ab0 tx=0x7f557800e4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f558dffb700 1 -- 172.21.15.6:0/4092072302 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557800e8d0 con 0x7f55900ff440 2023-09-13T09:51:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559019ebb0 con 0x7f55900ff440 2023-09-13T09:51:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f558dffb700 1 -- 172.21.15.6:0/4092072302 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f55780050d0 con 0x7f55900ff440 2023-09-13T09:51:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.025+0000 7f558dffb700 1 -- 172.21.15.6:0/4092072302 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5578016840 con 0x7f55900ff440 2023-09-13T09:51:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.026+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559019f030 con 0x7f55900ff440 2023-09-13T09:51:11.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.028+0000 7f558dffb700 1 -- 172.21.15.6:0/4092072302 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5578005240 con 0x7f55900ff440 2023-09-13T09:51:11.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.029+0000 7f558dffb700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f557c0a0640 0x7f557c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.029+0000 7f558dffb700 1 -- 172.21.15.6:0/4092072302 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5578012070 con 0x7f55900ff440 2023-09-13T09:51:11.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.029+0000 7f558ffff700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f557c0a0640 0x7f557c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.029+0000 7f55a2f52b80 1 Processor -- start 2023-09-13T09:51:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.029+0000 7f55a2f52b80 1 -- start start 2023-09-13T09:51:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.029+0000 7f558ffff700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f557c0a0640 0x7f557c0a2b00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5580009c60 tx=0x7f5580009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063e700 0x55cb2063eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063f060 0x55cb2063d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2063de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb20596780 con 0x55cb2063f060 2023-09-13T09:51:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb205940a0 con 0x55cb2063da00 2023-09-13T09:51:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2058f990 con 0x55cb2063e700 2023-09-13T09:51:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063f060 0x55cb2063d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063f060 0x55cb2063d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41088/0 (socket says 172.21.15.6:41088) 2023-09-13T09:51:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 -- 172.21.15.6:0/2764758600 learned_addr learned my addr 172.21.15.6:0/2764758600 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f5594b09700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063e700 0x55cb2063eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f559530a700 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2063de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 -- 172.21.15.6:0/2764758600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063e700 msgr2=0x55cb2063eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063e700 0x55cb2063eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 -- 172.21.15.6:0/2764758600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 msgr2=0x55cb2063de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2063de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 -- 172.21.15.6:0/2764758600 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb2040f630 con 0x55cb2063f060 2023-09-13T09:51:11.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f5594b09700 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063e700 0x55cb2063eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f558ffff700 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063f060 0x55cb2063d4c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f558000e4e0 tx=0x7f5580014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67bdd4ae20ec52d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.030+0000 7f5586ffd700 1 -- 172.21.15.6:0/2764758600 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558000ee00 con 0x55cb2063f060 2023-09-13T09:51:11.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f5586ffd700 1 -- 172.21.15.6:0/2764758600 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5580021070 con 0x55cb2063f060 2023-09-13T09:51:11.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f5586ffd700 1 -- 172.21.15.6:0/2764758600 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f558001d810 con 0x55cb2063f060 2023-09-13T09:51:11.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2764758600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063f060 msgr2=0x55cb2063d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063f060 0x55cb2063d4c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f558000e4e0 tx=0x7f5580014000 comp rx=0 tx=0).stop 2023-09-13T09:51:11.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2764758600 shutdown_connections 2023-09-13T09:51:11.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2063de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063e700 0x55cb2063eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2764758600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063f060 0x55cb2063d4c0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2764758600 >> 172.21.15.6:0/2764758600 conn(0x55cb2059bc80 msgr2=0x55cb20637f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2764758600 shutdown_connections 2023-09-13T09:51:11.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.031+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2764758600 wait complete. 2023-09-13T09:51:11.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 -- start start 2023-09-13T09:51:11.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 Processor -- start 2023-09-13T09:51:11.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063da00 0x55cb20646f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063e700 0x55cb20647440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2052dbb0 con 0x55cb2063da00 2023-09-13T09:51:11.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2052d8b0 con 0x55cb2063e700 2023-09-13T09:51:11.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb20411920 con 0x55cb2063f060 2023-09-13T09:51:11.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f55a2f52b80 10 client.0 _ll_register_callbacks cb 0x55cb2052b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f5594b09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063da00 0x55cb20646f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f5594b09700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063da00 0x55cb20646f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41092/0 (socket says 172.21.15.6:41092) 2023-09-13T09:51:11.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f5594b09700 1 -- 172.21.15.6:0/1230716408 learned_addr learned my addr 172.21.15.6:0/1230716408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.032+0000 7f559530a700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f558ffff700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063e700 0x55cb20647440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f5594b09700 1 -- 172.21.15.6:0/1230716408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 msgr2=0x55cb2064e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f5594b09700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f5594b09700 1 -- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063e700 msgr2=0x55cb20647440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f5594b09700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063e700 0x55cb20647440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f5594b09700 1 -- 172.21.15.6:0/1230716408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5580017070 con 0x55cb2063da00 2023-09-13T09:51:11.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f558ffff700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063e700 0x55cb20647440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:51:11.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f5594b09700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063da00 0x55cb20646f00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f55780cafb0 tx=0x7f557809b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ee7ec96dd1d7311 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f556ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:11.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f556ffff700 1 -- 172.21.15.6:0/1230716408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55780b8ea0 con 0x55cb2063da00 2023-09-13T09:51:11.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f556ffff700 1 -- 172.21.15.6:0/1230716408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5578026500 con 0x55cb2063da00 2023-09-13T09:51:11.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cb20630670 con 0x55cb2063da00 2023-09-13T09:51:11.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f556ffff700 1 -- 172.21.15.6:0/1230716408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55780a2cc0 con 0x55cb2063da00 2023-09-13T09:51:11.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f55a2f52b80 10 client.18507 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55cb205a77a0 con 0x55cb2063da00 2023-09-13T09:51:11.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.033+0000 7f556ffff700 1 -- 172.21.15.6:0/1230716408 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55cb20630670 con 0x55cb2063da00 2023-09-13T09:51:11.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f556ffff700 1 -- 172.21.15.6:0/1230716408 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f557809a1d0 con 0x55cb2063da00 2023-09-13T09:51:11.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f55a2f52b80 10 client.18507 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f55a2f52b80 10 client.18507 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:51:11.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f55a2f52b80 20 client.18507 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb20652aa0 0x55cb20654ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f55a2f52b80 4 client.18507 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:11.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cb20588970 con 0x55cb20652aa0 2023-09-13T09:51:11.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f558ffff700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb20652aa0 0x55cb20654ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f556ffff700 10 client.18507 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:11.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.034+0000 7f558ffff700 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb20652aa0 0x55cb20654ec0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5df10582fd7f07d3 server_cookie=aefab7e8e0982507 in_seq=0 out_seq=0 2023-09-13T09:51:11.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f556ffff700 1 -- 172.21.15.6:0/1230716408 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cb20588970 con 0x55cb20652aa0 2023-09-13T09:51:11.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f556ffff700 10 client.18507 handle_command_reply: tid=0 2023-09-13T09:51:11.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 client.18507 shutdown 2023-09-13T09:51:11.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063da00 msgr2=0x55cb20646f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063da00 0x55cb20646f00 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f55780cafb0 tx=0x7f557809b4d0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 shutdown_connections 2023-09-13T09:51:11.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb20652aa0 0x55cb20654ec0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f556ffff700 0 client.18507 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063da00 0x55cb20646f00 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/1230716408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063e700 0x55cb20647440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 >> 172.21.15.6:0/1230716408 conn(0x55cb2059bc80 msgr2=0x55cb206327f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 shutdown_connections 2023-09-13T09:51:11.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 1 -- 172.21.15.6:0/1230716408 wait complete. 2023-09-13T09:51:11.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.035+0000 7f55a2f52b80 20 client.18507 trim_cache size 0 max 16384 2023-09-13T09:51:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.050+0000 7f55a2f52b80 1 Processor -- start 2023-09-13T09:51:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.050+0000 7f55a2f52b80 1 -- start start 2023-09-13T09:51:11.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.050+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063da00 0x55cb2063d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.050+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.050+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063f060 0x55cb20641880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.050+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb20645600 con 0x55cb2063e700 2023-09-13T09:51:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb20644b20 con 0x55cb2063f060 2023-09-13T09:51:11.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb20642410 con 0x55cb2063da00 2023-09-13T09:51:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41102/0 (socket says 172.21.15.6:41102) 2023-09-13T09:51:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 -- 172.21.15.6:0/2425983087 learned_addr learned my addr 172.21.15.6:0/2425983087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f5594b09700 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063da00 0x55cb2063d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f559530a700 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063f060 0x55cb20641880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 -- 172.21.15.6:0/2425983087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063da00 msgr2=0x55cb2063d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063da00 0x55cb2063d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 -- 172.21.15.6:0/2425983087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063f060 msgr2=0x55cb20641880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063f060 0x55cb20641880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 -- 172.21.15.6:0/2425983087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cb203bbde0 con 0x55cb2063e700 2023-09-13T09:51:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f558ffff700 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064e440 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5580011ab0 tx=0x7f55800092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64af52f7d2245190 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f55877fe700 1 -- 172.21.15.6:0/2425983087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5580032a20 con 0x55cb2063e700 2023-09-13T09:51:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f55877fe700 1 -- 172.21.15.6:0/2425983087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5580032540 con 0x55cb2063e700 2023-09-13T09:51:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.051+0000 7f55877fe700 1 -- 172.21.15.6:0/2425983087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800038e0 con 0x55cb2063e700 2023-09-13T09:51:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2425983087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 msgr2=0x55cb2064e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064e440 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f5580011ab0 tx=0x7f55800092f0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2425983087 shutdown_connections 2023-09-13T09:51:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063f060 0x55cb20641880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063da00 0x55cb2063d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/2425983087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064e440 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2425983087 >> 172.21.15.6:0/2425983087 conn(0x55cb2059bc80 msgr2=0x55cb20645be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2425983087 shutdown_connections 2023-09-13T09:51:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.052+0000 7f55a2f52b80 1 -- 172.21.15.6:0/2425983087 wait complete. 2023-09-13T09:51:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 -- start start 2023-09-13T09:51:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 Processor -- start 2023-09-13T09:51:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2064e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2064b550 con 0x55cb2063e700 2023-09-13T09:51:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb2064b6c0 con 0x55cb2063da00 2023-09-13T09:51:11.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cb206a68c0 con 0x55cb2063f060 2023-09-13T09:51:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f55a2f52b80 10 client.0 _ll_register_callbacks cb 0x55cb2052b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f5594b09700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2064e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f558ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f5594b09700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2064e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34630/0 (socket says 172.21.15.6:34630) 2023-09-13T09:51:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.053+0000 7f558ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41108/0 (socket says 172.21.15.6:41108) 2023-09-13T09:51:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f5594b09700 1 -- 172.21.15.6:0/3920275123 learned_addr learned my addr 172.21.15.6:0/3920275123 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f559530a700 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f558ffff700 1 -- 172.21.15.6:0/3920275123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 msgr2=0x55cb2064b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f558ffff700 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f558ffff700 1 -- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 msgr2=0x55cb2064e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f558ffff700 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2064e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f558ffff700 1 -- 172.21.15.6:0/3920275123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cb2040f630 con 0x55cb2063e700 2023-09-13T09:51:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f5594b09700 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2064e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f558ffff700 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064aad0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x55cb206307b0 tx=0x7f558000eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424be058fdbdaf54 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f556ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f556ffff700 1 -- 172.21.15.6:0/3920275123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800320d0 con 0x55cb2063e700 2023-09-13T09:51:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5580021070 con 0x55cb2063e700 2023-09-13T09:51:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f556ffff700 1 -- 172.21.15.6:0/3920275123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5580032230 con 0x55cb2063e700 2023-09-13T09:51:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f556ffff700 1 -- 172.21.15.6:0/3920275123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55800050e0 con 0x55cb2063e700 2023-09-13T09:51:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f55a2f52b80 10 client.18513 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.054+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55cb203a4c60 con 0x55cb2063e700 2023-09-13T09:51:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f556ffff700 1 -- 172.21.15.6:0/3920275123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5580021070 con 0x55cb2063e700 2023-09-13T09:51:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f556ffff700 1 -- 172.21.15.6:0/3920275123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f5580003890 con 0x55cb2063e700 2023-09-13T09:51:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f55a2f52b80 10 client.18513 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f55a2f52b80 10 client.18513 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:51:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f55a2f52b80 20 client.18513 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb206a7e80 0x55cb206aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f55a2f52b80 4 client.18513 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55cb20549050 con 0x55cb206a7e80 2023-09-13T09:51:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f5594b09700 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb206a7e80 0x55cb206aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f5594b09700 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb206a7e80 0x55cb206aa2a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=e1b005c04fd6a322 server_cookie=e4bb448cf239b484 in_seq=0 out_seq=0 2023-09-13T09:51:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f556ffff700 10 client.18513 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.055+0000 7f556ffff700 1 -- 172.21.15.6:0/3920275123 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55cb20549050 con 0x55cb206a7e80 2023-09-13T09:51:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f556ffff700 10 client.18513 handle_command_reply: tid=0 2023-09-13T09:51:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 client.18513 shutdown 2023-09-13T09:51:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 msgr2=0x55cb2064aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064aad0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x55cb206307b0 tx=0x7f558000eb00 comp rx=0 tx=0).stop 2023-09-13T09:51:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 shutdown_connections 2023-09-13T09:51:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55cb206a7e80 0x55cb206aa2a0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55cb2063f060 0x55cb2064b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f556ffff700 0 client.18513 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55cb2063da00 0x55cb2064e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 --2- 172.21.15.6:0/3920275123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55cb2063e700 0x55cb2064aad0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 >> 172.21.15.6:0/3920275123 conn(0x55cb2059bc80 msgr2=0x55cb20641880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 shutdown_connections 2023-09-13T09:51:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 1 -- 172.21.15.6:0/3920275123 wait complete. 2023-09-13T09:51:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f55a2f52b80 20 client.18513 trim_cache size 0 max 16384 2023-09-13T09:51:11.079 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f557c0a0640 msgr2=0x7f557c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f557c0a0640 0x7f557c0a2b00 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5580009c60 tx=0x7f5580009260 comp rx=0 tx=0).stop 2023-09-13T09:51:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55900ff440 msgr2=0x7f5590196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55900ff440 0x7f5590196ae0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5578003ab0 tx=0x7f557800e4d0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 shutdown_connections 2023-09-13T09:51:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f557c0a0640 0x7f557c0a2b00 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5590100fd0 0x7f559019e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f55900ff440 0x7f5590196ae0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.056+0000 7f5596d6d700 1 --2- 172.21.15.6:0/4092072302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5590100630 0x7f5590197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.057+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 >> 172.21.15.6:0/4092072302 conn(0x7f55900fa9b0 msgr2=0x7f5590105d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.057+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 shutdown_connections 2023-09-13T09:51:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.057+0000 7f5596d6d700 1 -- 172.21.15.6:0/4092072302 wait complete. 2023-09-13T09:51:11.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:51:11.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 716361 6.60 MB/sec execute 511 sec latency 28.724 ms 2023-09-13T09:51:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 -- 172.21.15.6:0/1399308465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 msgr2=0x7f7914108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 --2- 172.21.15.6:0/1399308465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 0x7f7914108f10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f790c00b0a0 tx=0x7f790c00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 -- 172.21.15.6:0/1399308465 shutdown_connections 2023-09-13T09:51:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 --2- 172.21.15.6:0/1399308465 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 0x7f7914108f10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 --2- 172.21.15.6:0/1399308465 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914101840 0x7f7914103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 --2- 172.21.15.6:0/1399308465 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7914104170 0x7f7914106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 -- 172.21.15.6:0/1399308465 >> 172.21.15.6:0/1399308465 conn(0x7f79140fb250 msgr2=0x7f79140fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 -- 172.21.15.6:0/1399308465 shutdown_connections 2023-09-13T09:51:11.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.219+0000 7f791c59e700 1 -- 172.21.15.6:0/1399308465 wait complete. 2023-09-13T09:51:11.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 Processor -- start 2023-09-13T09:51:11.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 -- start start 2023-09-13T09:51:11.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7914101840 0x7f7914198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914104170 0x7f7914199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 0x7f79141a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79141a08c0 con 0x7f7914104170 2023-09-13T09:51:11.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79141a0a00 con 0x7f7914106aa0 2023-09-13T09:51:11.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791c59e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79141a0b90 con 0x7f7914101840 2023-09-13T09:51:11.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914104170 0x7f7914199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914104170 0x7f7914199280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41122/0 (socket says 172.21.15.6:41122) 2023-09-13T09:51:11.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 -- 172.21.15.6:0/2603786444 learned_addr learned my addr 172.21.15.6:0/2603786444 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791a33a700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7914101840 0x7f7914198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f791ab3b700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 0x7f79141a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 -- 172.21.15.6:0/2603786444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7914101840 msgr2=0x7f7914198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7914101840 0x7f7914198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 -- 172.21.15.6:0/2603786444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 msgr2=0x7f79141a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 0x7f79141a02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 -- 172.21.15.6:0/2603786444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7904009520 con 0x7f7914104170 2023-09-13T09:51:11.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.220+0000 7f7919b39700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914104170 0x7f7914199280 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9a0 tx=0x7f791000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.221+0000 7f790b7fe700 1 -- 172.21.15.6:0/2603786444 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910009790 con 0x7f7914104170 2023-09-13T09:51:11.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.221+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f790c009d00 con 0x7f7914104170 2023-09-13T09:51:11.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.221+0000 7f790b7fe700 1 -- 172.21.15.6:0/2603786444 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7910010430 con 0x7f7914104170 2023-09-13T09:51:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.221+0000 7f790b7fe700 1 -- 172.21.15.6:0/2603786444 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7910018680 con 0x7f7914104170 2023-09-13T09:51:11.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.221+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79141a11e0 con 0x7f7914104170 2023-09-13T09:51:11.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.223+0000 7f790b7fe700 1 -- 172.21.15.6:0/2603786444 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f79100105a0 con 0x7f7914104170 2023-09-13T09:51:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.223+0000 7f790b7fe700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79000a0640 0x7f79000a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.223+0000 7f791a33a700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79000a0640 0x7f79000a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.223+0000 7f790b7fe700 1 -- 172.21.15.6:0/2603786444 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7910014070 con 0x7f7914104170 2023-09-13T09:51:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.224+0000 7f791a33a700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79000a0640 0x7f79000a2b00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7904009df0 tx=0x7f7904009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.224+0000 7f7928783b80 1 Processor -- start 2023-09-13T09:51:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.224+0000 7f7928783b80 1 -- start start 2023-09-13T09:51:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7928783b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5b5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7928783b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7928783b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7928783b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a50d780 con 0x56170a5b5700 2023-09-13T09:51:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7928783b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a50b0a0 con 0x56170a5b6060 2023-09-13T09:51:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7928783b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a506990 con 0x56170a5b4a00 2023-09-13T09:51:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5b5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5b5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41128/0 (socket says 172.21.15.6:41128) 2023-09-13T09:51:11.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 -- 172.21.15.6:0/2474491473 learned_addr learned my addr 172.21.15.6:0/2474491473 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7919b39700 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791ab3b700 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 -- 172.21.15.6:0/2474491473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 msgr2=0x56170a5b4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 -- 172.21.15.6:0/2474491473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 msgr2=0x56170a5b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 -- 172.21.15.6:0/2474491473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56170a386630 con 0x56170a5b5700 2023-09-13T09:51:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f791a33a700 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5b5b20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f79040094f0 tx=0x7f7904014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311484e3aff1558 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7908ff9700 1 -- 172.21.15.6:0/2474491473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7904026630 con 0x56170a5b5700 2023-09-13T09:51:11.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7908ff9700 1 -- 172.21.15.6:0/2474491473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7904021070 con 0x56170a5b5700 2023-09-13T09:51:11.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.225+0000 7f7908ff9700 1 -- 172.21.15.6:0/2474491473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f790401d650 con 0x56170a5b5700 2023-09-13T09:51:11.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 -- 172.21.15.6:0/2474491473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 msgr2=0x56170a5b5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5b5b20 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f79040094f0 tx=0x7f7904014000 comp rx=0 tx=0).stop 2023-09-13T09:51:11.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 -- 172.21.15.6:0/2474491473 shutdown_connections 2023-09-13T09:51:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5b5b20 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 --2- 172.21.15.6:0/2474491473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 -- 172.21.15.6:0/2474491473 >> 172.21.15.6:0/2474491473 conn(0x56170a512c80 msgr2=0x56170a5aef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 -- 172.21.15.6:0/2474491473 shutdown_connections 2023-09-13T09:51:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.226+0000 7f7928783b80 1 -- 172.21.15.6:0/2474491473 wait complete. 2023-09-13T09:51:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 -- start start 2023-09-13T09:51:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 Processor -- start 2023-09-13T09:51:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b5700 0x56170a5be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b6060 0x56170a5c5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a4a4bb0 con 0x56170a5b6060 2023-09-13T09:51:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a4a48b0 con 0x56170a5b5700 2023-09-13T09:51:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a388920 con 0x56170a5b4a00 2023-09-13T09:51:11.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7928783b80 10 client.0 _ll_register_callbacks cb 0x56170a4a2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f791ab3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b6060 0x56170a5c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f791ab3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b6060 0x56170a5c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41138/0 (socket says 172.21.15.6:41138) 2023-09-13T09:51:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f791ab3b700 1 -- 172.21.15.6:0/3560020012 learned_addr learned my addr 172.21.15.6:0/3560020012 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7919b39700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b5700 0x56170a5be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f791a33a700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7919b39700 1 -- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 msgr2=0x56170a5bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7919b39700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7919b39700 1 -- 172.21.15.6:0/3560020012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b6060 msgr2=0x56170a5c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7919b39700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b6060 0x56170a5c5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f7919b39700 1 -- 172.21.15.6:0/3560020012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7904017070 con 0x56170a5b5700 2023-09-13T09:51:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.227+0000 7f791a33a700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7919b39700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b5700 0x56170a5be440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f79100c9820 tx=0x7f7910099c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13976c29261e9499 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f78fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:51:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f78fdffb700 1 -- 172.21.15.6:0/3560020012 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100b0070 con 0x56170a5b5700 2023-09-13T09:51:11.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f78fdffb700 1 -- 172.21.15.6:0/3560020012 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f79100a1580 con 0x56170a5b5700 2023-09-13T09:51:11.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56170a5a7670 con 0x56170a5b5700 2023-09-13T09:51:11.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f78fdffb700 1 -- 172.21.15.6:0/3560020012 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79100978b0 con 0x56170a5b5700 2023-09-13T09:51:11.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 10 client.27917 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56170a51e7a0 con 0x56170a5b5700 2023-09-13T09:51:11.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f78fdffb700 1 -- 172.21.15.6:0/3560020012 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7910063080 con 0x56170a5b5700 2023-09-13T09:51:11.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f78fdffb700 1 -- 172.21.15.6:0/3560020012 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7910065120 con 0x56170a5b5700 2023-09-13T09:51:11.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 10 client.27917 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 10 client.27917 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:51:11.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 20 client.27917 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a5c9cc0 0x56170a5cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 4 client.27917 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:11.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.228+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56170a4ff970 con 0x56170a5c9cc0 2023-09-13T09:51:11.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.229+0000 7f791a33a700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a5c9cc0 0x56170a5cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.229+0000 7f78fdffb700 10 client.27917 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:11.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.229+0000 7f791a33a700 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a5c9cc0 0x56170a5cc0e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a596482dc462dcb1 server_cookie=b21d3140eca743ae in_seq=0 out_seq=0 2023-09-13T09:51:11.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f78fdffb700 1 -- 172.21.15.6:0/3560020012 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56170a4ff970 con 0x56170a5c9cc0 2023-09-13T09:51:11.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f78fdffb700 10 client.27917 handle_command_reply: tid=0 2023-09-13T09:51:11.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 client.27917 shutdown 2023-09-13T09:51:11.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b5700 msgr2=0x56170a5be440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b5700 0x56170a5be440 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f79100c9820 tx=0x7f7910099c90 comp rx=0 tx=0).stop 2023-09-13T09:51:11.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 shutdown_connections 2023-09-13T09:51:11.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a5c9cc0 0x56170a5cc0e0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b6060 0x56170a5c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f78fdffb700 0 client.27917 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:11.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 --2- 172.21.15.6:0/3560020012 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b5700 0x56170a5be440 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 >> 172.21.15.6:0/3560020012 conn(0x56170a512c80 msgr2=0x56170a5a97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 shutdown_connections 2023-09-13T09:51:11.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 1 -- 172.21.15.6:0/3560020012 wait complete. 2023-09-13T09:51:11.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.230+0000 7f7928783b80 20 client.27917 trim_cache size 0 max 16384 2023-09-13T09:51:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 Processor -- start 2023-09-13T09:51:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 -- start start 2023-09-13T09:51:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a5bd3b0 con 0x56170a5b5700 2023-09-13T09:51:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a5bc610 con 0x56170a5b6060 2023-09-13T09:51:11.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7928783b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a5bdaa0 con 0x56170a5b4a00 2023-09-13T09:51:11.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.243+0000 7f7919b39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f791a33a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41144/0 (socket says 172.21.15.6:41144) 2023-09-13T09:51:11.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 -- 172.21.15.6:0/4029468562 learned_addr learned my addr 172.21.15.6:0/4029468562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f791ab3b700 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 -- 172.21.15.6:0/4029468562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 msgr2=0x56170a5b44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 -- 172.21.15.6:0/4029468562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 msgr2=0x56170a5b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 -- 172.21.15.6:0/4029468562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56170a332de0 con 0x56170a5b5700 2023-09-13T09:51:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f7919b39700 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c5440 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f7910095a10 tx=0x7f7910010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827711c3a4847e61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f79097fa700 1 -- 172.21.15.6:0/4029468562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100b0070 con 0x56170a5b5700 2023-09-13T09:51:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f79097fa700 1 -- 172.21.15.6:0/4029468562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56170a5a7670 con 0x56170a5b5700 2023-09-13T09:51:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.244+0000 7f79097fa700 1 -- 172.21.15.6:0/4029468562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100999f0 con 0x56170a5b5700 2023-09-13T09:51:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 -- 172.21.15.6:0/4029468562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 msgr2=0x56170a5c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c5440 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f7910095a10 tx=0x7f7910010c80 comp rx=0 tx=0).stop 2023-09-13T09:51:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 -- 172.21.15.6:0/4029468562 shutdown_connections 2023-09-13T09:51:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b6060 0x56170a5b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b4a00 0x56170a5b44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 --2- 172.21.15.6:0/4029468562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c5440 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 -- 172.21.15.6:0/4029468562 >> 172.21.15.6:0/4029468562 conn(0x56170a512c80 msgr2=0x56170a5aee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 -- 172.21.15.6:0/4029468562 shutdown_connections 2023-09-13T09:51:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 -- 172.21.15.6:0/4029468562 wait complete. 2023-09-13T09:51:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 -- start start 2023-09-13T09:51:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.245+0000 7f7928783b80 1 Processor -- start 2023-09-13T09:51:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b4a00 0x56170a5c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c17f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b6060 0x56170a5c4810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a5c4d50 con 0x56170a5b5700 2023-09-13T09:51:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a5c4ec0 con 0x56170a5b4a00 2023-09-13T09:51:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56170a5c5080 con 0x56170a5b6060 2023-09-13T09:51:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 10 client.0 _ll_register_callbacks cb 0x56170a4a2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41150/0 (socket says 172.21.15.6:41150) 2023-09-13T09:51:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 -- 172.21.15.6:0/1569139232 learned_addr learned my addr 172.21.15.6:0/1569139232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f791a33a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b4a00 0x56170a5c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f791ab3b700 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b6060 0x56170a5c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 -- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b6060 msgr2=0x56170a5c4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b6060 0x56170a5c4810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 -- 172.21.15.6:0/1569139232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b4a00 msgr2=0x56170a5c12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b4a00 0x56170a5c12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 -- 172.21.15.6:0/1569139232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56170a51e7a0 con 0x56170a5b5700 2023-09-13T09:51:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f791a33a700 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b4a00 0x56170a5c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7919b39700 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c17f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7910099210 tx=0x7f7910010ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6461e85d21ba4a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f78fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f78fdffb700 1 -- 172.21.15.6:0/1569139232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79100b0040 con 0x56170a5b5700 2023-09-13T09:51:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f78fdffb700 1 -- 172.21.15.6:0/1569139232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7910098aa0 con 0x56170a5b5700 2023-09-13T09:51:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7904021070 con 0x56170a5b5700 2023-09-13T09:51:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f78fdffb700 1 -- 172.21.15.6:0/1569139232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f79100a1600 con 0x56170a5b5700 2023-09-13T09:51:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 10 client.18531 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.246+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56170a31bc60 con 0x56170a5b5700 2023-09-13T09:51:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f78fdffb700 1 -- 172.21.15.6:0/1569139232 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7904021070 con 0x56170a5b5700 2023-09-13T09:51:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f78fdffb700 1 -- 172.21.15.6:0/1569139232 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f79100986e0 con 0x56170a5b5700 2023-09-13T09:51:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f7928783b80 10 client.18531 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f7928783b80 10 client.18531 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:51:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f7928783b80 20 client.18531 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f7928783b80 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a61e710 0x56170a620b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f7928783b80 4 client.18531 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56170a4c0050 con 0x56170a61e710 2023-09-13T09:51:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f791a33a700 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a61e710 0x56170a620b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f78fdffb700 10 client.18531 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.247+0000 7f791a33a700 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a61e710 0x56170a620b00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=395a044124337d90 server_cookie=b6c19aade62088f3 in_seq=0 out_seq=0 2023-09-13T09:51:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f78fdffb700 1 -- 172.21.15.6:0/1569139232 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56170a4c0050 con 0x56170a61e710 2023-09-13T09:51:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f78fdffb700 10 client.18531 handle_command_reply: tid=0 2023-09-13T09:51:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 client.18531 shutdown 2023-09-13T09:51:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 msgr2=0x56170a5c17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c17f0 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f7910099210 tx=0x7f7910010ab0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 shutdown_connections 2023-09-13T09:51:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56170a61e710 0x56170a620b00 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56170a5b6060 0x56170a5c4810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56170a5b4a00 0x56170a5c12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 --2- 172.21.15.6:0/1569139232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56170a5b5700 0x56170a5c17f0 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f78fdffb700 0 client.18531 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 >> 172.21.15.6:0/1569139232 conn(0x56170a512c80 msgr2=0x56170a5b88e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 shutdown_connections 2023-09-13T09:51:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 1 -- 172.21.15.6:0/1569139232 wait complete. 2023-09-13T09:51:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f7928783b80 20 client.18531 trim_cache size 0 max 16384 2023-09-13T09:51:11.318 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79000a0640 msgr2=0x7f79000a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79000a0640 0x7f79000a2b00 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f7904009df0 tx=0x7f7904009260 comp rx=0 tx=0).stop 2023-09-13T09:51:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914104170 msgr2=0x7f7914199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914104170 0x7f7914199280 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f791000e9a0 tx=0x7f791000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 shutdown_connections 2023-09-13T09:51:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7914106aa0 0x7f79141a02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7914101840 0x7f7914198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79000a0640 0x7f79000a2b00 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 --2- 172.21.15.6:0/2603786444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7914104170 0x7f7914199280 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 >> 172.21.15.6:0/2603786444 conn(0x7f79140fb250 msgr2=0x7f79140ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.248+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 shutdown_connections 2023-09-13T09:51:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.249+0000 7f791c59e700 1 -- 172.21.15.6:0/2603786444 wait complete. 2023-09-13T09:51:11.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:10 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3441543467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:51:11.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:51:11.324 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:10 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3441543467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:51:11.324 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:10 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3441543467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:51:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 -- 172.21.15.6:0/1918169516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c38100eb0 msgr2=0x7f6c38101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/1918169516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c38100eb0 0x7f6c38101310 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f6c280099c0 tx=0x7f6c28009cd0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 -- 172.21.15.6:0/1918169516 shutdown_connections 2023-09-13T09:51:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/1918169516 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c38101850 0x7f6c38108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/1918169516 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c380ffcc0 0x7f6c381000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/1918169516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c38100eb0 0x7f6c38101310 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 -- 172.21.15.6:0/1918169516 >> 172.21.15.6:0/1918169516 conn(0x7f6c380fb250 msgr2=0x7f6c380fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 -- 172.21.15.6:0/1918169516 shutdown_connections 2023-09-13T09:51:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.455+0000 7f6c3fac9700 1 -- 172.21.15.6:0/1918169516 wait complete. 2023-09-13T09:51:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 Processor -- start 2023-09-13T09:51:11.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 -- start start 2023-09-13T09:51:11.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c380ffcc0 0x7f6c38103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c38100eb0 0x7f6c38102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38101850 0x7f6c381027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c38102f70 con 0x7f6c380ffcc0 2023-09-13T09:51:11.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c381030e0 con 0x7f6c38101850 2023-09-13T09:51:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3fac9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c381a0b50 con 0x7f6c38100eb0 2023-09-13T09:51:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3d865700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c380ffcc0 0x7f6c38103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3d865700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c380ffcc0 0x7f6c38103c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41160/0 (socket says 172.21.15.6:41160) 2023-09-13T09:51:11.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3d865700 1 -- 172.21.15.6:0/3448467298 learned_addr learned my addr 172.21.15.6:0/3448467298 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c38100eb0 0x7f6c38102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.456+0000 7f6c3e066700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38101850 0x7f6c381027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3d865700 1 -- 172.21.15.6:0/3448467298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c38100eb0 msgr2=0x7f6c38102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3d865700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c38100eb0 0x7f6c38102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3d865700 1 -- 172.21.15.6:0/3448467298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38101850 msgr2=0x7f6c381027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3d865700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38101850 0x7f6c381027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3d865700 1 -- 172.21.15.6:0/3448467298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c280095f0 con 0x7f6c380ffcc0 2023-09-13T09:51:11.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3d865700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c380ffcc0 0x7f6c38103c50 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400e970 tx=0x7f6c3400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c2effd700 1 -- 172.21.15.6:0/3448467298 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34009790 con 0x7f6c380ffcc0 2023-09-13T09:51:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c2effd700 1 -- 172.21.15.6:0/3448467298 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c3400c7e0 con 0x7f6c380ffcc0 2023-09-13T09:51:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c381a0e30 con 0x7f6c380ffcc0 2023-09-13T09:51:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c2effd700 1 -- 172.21.15.6:0/3448467298 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c34003c70 con 0x7f6c380ffcc0 2023-09-13T09:51:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.457+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c381a1250 con 0x7f6c380ffcc0 2023-09-13T09:51:11.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.459+0000 7f6c2effd700 1 -- 172.21.15.6:0/3448467298 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6c3400cc50 con 0x7f6c380ffcc0 2023-09-13T09:51:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.460+0000 7f6c2effd700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c240a0640 0x7f6c240a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.460+0000 7f6c2effd700 1 -- 172.21.15.6:0/3448467298 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c34014070 con 0x7f6c380ffcc0 2023-09-13T09:51:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.460+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c240a0640 0x7f6c240a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.460+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c240a0640 0x7f6c240a2b00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800b580 tx=0x7f6c28005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 Processor -- start 2023-09-13T09:51:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 -- start start 2023-09-13T09:51:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2e1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f239780 con 0x56308f2e2060 2023-09-13T09:51:11.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f2370a0 con 0x56308f2e0a00 2023-09-13T09:51:11.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f232990 con 0x56308f2e1700 2023-09-13T09:51:11.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c3d064700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c3d064700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2e04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41170/0 (socket says 172.21.15.6:41170) 2023-09-13T09:51:11.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c3d064700 1 -- 172.21.15.6:0/3446589274 learned_addr learned my addr 172.21.15.6:0/3446589274 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.461+0000 7f6c3e066700 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3d865700 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2e1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3d064700 1 -- 172.21.15.6:0/3446589274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 msgr2=0x56308f2e1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2e1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3d064700 1 -- 172.21.15.6:0/3446589274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 msgr2=0x56308f2e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3d064700 1 -- 172.21.15.6:0/3446589274 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56308f0b2630 con 0x56308f2e2060 2023-09-13T09:51:11.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3e066700 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2e04c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f6c280099c0 tx=0x7f6c2801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf3296e6c804409 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c23fff700 1 -- 172.21.15.6:0/3446589274 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28029070 con 0x56308f2e2060 2023-09-13T09:51:11.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c23fff700 1 -- 172.21.15.6:0/3446589274 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c2801e040 con 0x56308f2e2060 2023-09-13T09:51:11.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.462+0000 7f6c23fff700 1 -- 172.21.15.6:0/3446589274 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800f750 con 0x56308f2e2060 2023-09-13T09:51:11.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3446589274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 msgr2=0x56308f2e04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2e04c0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f6c280099c0 tx=0x7f6c2801f000 comp rx=0 tx=0).stop 2023-09-13T09:51:11.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3446589274 shutdown_connections 2023-09-13T09:51:11.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2e1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3446589274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2e04c0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3446589274 >> 172.21.15.6:0/3446589274 conn(0x56308f23ec80 msgr2=0x56308f2daf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3446589274 shutdown_connections 2023-09-13T09:51:11.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3446589274 wait complete. 2023-09-13T09:51:11.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 -- start start 2023-09-13T09:51:11.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.463+0000 7f6c4bcaeb80 1 Processor -- start 2023-09-13T09:51:11.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e0a00 0x56308f2e9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2ea380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e2060 0x56308f2f13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f1d0bb0 con 0x56308f2e1700 2023-09-13T09:51:11.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f1d08b0 con 0x56308f2e2060 2023-09-13T09:51:11.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f0b4920 con 0x56308f2e0a00 2023-09-13T09:51:11.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c4bcaeb80 10 client.0 _ll_register_callbacks cb 0x56308f1ce680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d064700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2ea380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e0a00 0x56308f2e9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e0a00 0x56308f2e9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44228/0 (socket says 172.21.15.6:44228) 2023-09-13T09:51:11.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d064700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2ea380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41176/0 (socket says 172.21.15.6:41176) 2023-09-13T09:51:11.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 -- 172.21.15.6:0/2837005707 learned_addr learned my addr 172.21.15.6:0/2837005707 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3e066700 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e2060 0x56308f2f13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 -- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e2060 msgr2=0x56308f2f13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e2060 0x56308f2f13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 -- 172.21.15.6:0/2837005707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 msgr2=0x56308f2ea380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2ea380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d865700 1 -- 172.21.15.6:0/2837005707 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c38108a50 con 0x56308f2e0a00 2023-09-13T09:51:11.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.464+0000 7f6c3d064700 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2ea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c3d865700 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e0a00 0x56308f2e9e40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400efd0 tx=0x7f6c34099c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9ca791d308394bc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c217fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:51:11.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c217fa700 1 -- 172.21.15.6:0/2837005707 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c340842c0 con 0x56308f2e0a00 2023-09-13T09:51:11.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c217fa700 1 -- 172.21.15.6:0/2837005707 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c3409d170 con 0x56308f2e0a00 2023-09-13T09:51:11.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56308f2d3670 con 0x56308f2e0a00 2023-09-13T09:51:11.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c217fa700 1 -- 172.21.15.6:0/2837005707 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c3409d3a0 con 0x56308f2e0a00 2023-09-13T09:51:11.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 10 client.27859 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56308f24a7a0 con 0x56308f2e0a00 2023-09-13T09:51:11.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c217fa700 1 -- 172.21.15.6:0/2837005707 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56308f2d3670 con 0x56308f2e0a00 2023-09-13T09:51:11.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c217fa700 1 -- 172.21.15.6:0/2837005707 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c34098b60 con 0x56308f2e0a00 2023-09-13T09:51:11.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 10 client.27859 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 10 client.27859 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:51:11.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 20 client.27859 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f2f8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 4 client.27859 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:11.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.465+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56308f22b970 con 0x56308f2f5c20 2023-09-13T09:51:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.466+0000 7f6c3d064700 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f2f8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.466+0000 7f6c3d064700 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f2f8040 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=93d15682d9ca6e09 server_cookie=7782d2bd7da9a61c in_seq=0 out_seq=0 2023-09-13T09:51:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.466+0000 7f6c217fa700 10 client.27859 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c217fa700 1 -- 172.21.15.6:0/2837005707 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56308f22b970 con 0x56308f2f5c20 2023-09-13T09:51:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c217fa700 10 client.27859 handle_command_reply: tid=0 2023-09-13T09:51:11.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 client.27859 shutdown 2023-09-13T09:51:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e0a00 msgr2=0x56308f2e9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e0a00 0x56308f2e9e40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400efd0 tx=0x7f6c34099c70 comp rx=0 tx=0).stop 2023-09-13T09:51:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 shutdown_connections 2023-09-13T09:51:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f2f8040 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e2060 0x56308f2f13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c217fa700 0 client.27859 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:11.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e0a00 0x56308f2e9e40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/2837005707 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2ea380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 >> 172.21.15.6:0/2837005707 conn(0x56308f23ec80 msgr2=0x56308f2d57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 shutdown_connections 2023-09-13T09:51:11.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/2837005707 wait complete. 2023-09-13T09:51:11.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.467+0000 7f6c4bcaeb80 20 client.27859 trim_cache size 0 max 16384 2023-09-13T09:51:11.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 Processor -- start 2023-09-13T09:51:11.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 -- start start 2023-09-13T09:51:11.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2f1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e2060 0x56308f2e9bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f2f5740 con 0x56308f2e1700 2023-09-13T09:51:11.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f2dc730 con 0x56308f2e0a00 2023-09-13T09:51:11.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f2e7b60 con 0x56308f2e2060 2023-09-13T09:51:11.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2f1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2f1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41184/0 (socket says 172.21.15.6:41184) 2023-09-13T09:51:11.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 -- 172.21.15.6:0/3397762958 learned_addr learned my addr 172.21.15.6:0/3397762958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d865700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3e066700 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e2060 0x56308f2e9bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 -- 172.21.15.6:0/3397762958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e2060 msgr2=0x56308f2e9bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e2060 0x56308f2e9bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 -- 172.21.15.6:0/3397762958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 msgr2=0x56308f2e04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d064700 1 -- 172.21.15.6:0/3397762958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56308f05ede0 con 0x56308f2e1700 2023-09-13T09:51:11.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.480+0000 7f6c3d865700 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c3d064700 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2f1380 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f6c28000c00 tx=0x7f6c2800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbed776776d517c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c2cd82700 1 -- 172.21.15.6:0/3397762958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c28029040 con 0x56308f2e1700 2023-09-13T09:51:11.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c2cd82700 1 -- 172.21.15.6:0/3397762958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c2802a040 con 0x56308f2e1700 2023-09-13T09:51:11.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c2cd82700 1 -- 172.21.15.6:0/3397762958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2800fba0 con 0x56308f2e1700 2023-09-13T09:51:11.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3397762958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 msgr2=0x56308f2f1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2f1380 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f6c28000c00 tx=0x7f6c2800b840 comp rx=0 tx=0).stop 2023-09-13T09:51:11.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3397762958 shutdown_connections 2023-09-13T09:51:11.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e2060 0x56308f2e9bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2e04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/3397762958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e1700 0x56308f2f1380 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.481+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3397762958 >> 172.21.15.6:0/3397762958 conn(0x56308f23ec80 msgr2=0x56308f2e48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3397762958 shutdown_connections 2023-09-13T09:51:11.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/3397762958 wait complete. 2023-09-13T09:51:11.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 -- start start 2023-09-13T09:51:11.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 Processor -- start 2023-09-13T09:51:11.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2ed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2ed7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f2f0d10 con 0x56308f2e2060 2023-09-13T09:51:11.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f2f0e80 con 0x56308f2e0a00 2023-09-13T09:51:11.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56308f2f1040 con 0x56308f2e1700 2023-09-13T09:51:11.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c4bcaeb80 10 client.0 _ll_register_callbacks cb 0x56308f1ce680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c3e066700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c3e066700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41192/0 (socket says 172.21.15.6:41192) 2023-09-13T09:51:11.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c3e066700 1 -- 172.21.15.6:0/1143006754 learned_addr learned my addr 172.21.15.6:0/1143006754 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c3d064700 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2ed7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.482+0000 7f6c3d865700 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c3e066700 1 -- 172.21.15.6:0/1143006754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 msgr2=0x56308f2ed7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c3e066700 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2ed7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c3e066700 1 -- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 msgr2=0x56308f2ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c3e066700 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c3e066700 1 -- 172.21.15.6:0/1143006754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56308f24a7a0 con 0x56308f2e2060 2023-09-13T09:51:11.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c3e066700 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2f07d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f6c30018fa0 tx=0x7f6c30014740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671c2d83b9712485 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c217fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:11.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c217fa700 1 -- 172.21.15.6:0/1143006754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c3001d070 con 0x56308f2e2060 2023-09-13T09:51:11.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c217fa700 1 -- 172.21.15.6:0/1143006754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c30014c90 con 0x56308f2e2060 2023-09-13T09:51:11.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c2801e040 con 0x56308f2e2060 2023-09-13T09:51:11.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c217fa700 1 -- 172.21.15.6:0/1143006754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c3000e040 con 0x56308f2e2060 2023-09-13T09:51:11.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c4bcaeb80 10 client.18549 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.483+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56308f0b2630 con 0x56308f2e2060 2023-09-13T09:51:11.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c217fa700 1 -- 172.21.15.6:0/1143006754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c2801e040 con 0x56308f2e2060 2023-09-13T09:51:11.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c217fa700 1 -- 172.21.15.6:0/1143006754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f6c30004620 con 0x56308f2e2060 2023-09-13T09:51:11.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c4bcaeb80 10 client.18549 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c4bcaeb80 10 client.18549 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:51:11.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c4bcaeb80 20 client.18549 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f34cce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c4bcaeb80 4 client.18549 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:11.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56308f1ec050 con 0x56308f2f5c20 2023-09-13T09:51:11.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c3d865700 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f34cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c217fa700 10 client.18549 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c3d865700 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f34cce0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=316ff2da93a5079 server_cookie=b50b413717a2c5cb in_seq=0 out_seq=0 2023-09-13T09:51:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.484+0000 7f6c217fa700 1 -- 172.21.15.6:0/1143006754 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56308f1ec050 con 0x56308f2f5c20 2023-09-13T09:51:11.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c217fa700 10 client.18549 handle_command_reply: tid=0 2023-09-13T09:51:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 client.18549 shutdown 2023-09-13T09:51:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 msgr2=0x56308f2f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2f07d0 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f6c30018fa0 tx=0x7f6c30014740 comp rx=0 tx=0).stop 2023-09-13T09:51:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 shutdown_connections 2023-09-13T09:51:11.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56308f2f5c20 0x56308f34cce0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56308f2e2060 0x56308f2f07d0 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56308f2e0a00 0x56308f2ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 --2- 172.21.15.6:0/1143006754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56308f2e1700 0x56308f2ed7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c217fa700 0 client.18549 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:11.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 >> 172.21.15.6:0/1143006754 conn(0x56308f23ec80 msgr2=0x56308f2e9bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 shutdown_connections 2023-09-13T09:51:11.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 1 -- 172.21.15.6:0/1143006754 wait complete. 2023-09-13T09:51:11.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c4bcaeb80 20 client.18549 trim_cache size 0 max 16384 2023-09-13T09:51:11.522 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:11.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c240a0640 msgr2=0x7f6c240a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c240a0640 0x7f6c240a2b00 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f6c2800b580 tx=0x7f6c28005fb0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c380ffcc0 msgr2=0x7f6c38103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c380ffcc0 0x7f6c38103c50 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400e970 tx=0x7f6c3400ec80 comp rx=0 tx=0).stop 2023-09-13T09:51:11.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 shutdown_connections 2023-09-13T09:51:11.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c38101850 0x7f6c381027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c240a0640 0x7f6c240a2b00 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c380ffcc0 0x7f6c38103c50 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 --2- 172.21.15.6:0/3448467298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c38100eb0 0x7f6c38102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.485+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 >> 172.21.15.6:0/3448467298 conn(0x7f6c380fb250 msgr2=0x7f6c38067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.486+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 shutdown_connections 2023-09-13T09:51:11.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.486+0000 7f6c3fac9700 1 -- 172.21.15.6:0/3448467298 wait complete. 2023-09-13T09:51:11.527 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:51:11.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 -- 172.21.15.6:0/2102302690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb20101850 msgr2=0x7fdb20108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 --2- 172.21.15.6:0/2102302690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb20101850 0x7fdb20108100 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fdb1800b0d0 tx=0x7fdb1800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 -- 172.21.15.6:0/2102302690 shutdown_connections 2023-09-13T09:51:11.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 --2- 172.21.15.6:0/2102302690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb20101850 0x7fdb20108100 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 --2- 172.21.15.6:0/2102302690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb200ffcc0 0x7fdb201000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 --2- 172.21.15.6:0/2102302690 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb20100eb0 0x7fdb20101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 -- 172.21.15.6:0/2102302690 >> 172.21.15.6:0/2102302690 conn(0x7fdb200fb250 msgr2=0x7fdb200fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 -- 172.21.15.6:0/2102302690 shutdown_connections 2023-09-13T09:51:11.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.659+0000 7fdb2620d700 1 -- 172.21.15.6:0/2102302690 wait complete. 2023-09-13T09:51:11.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 Processor -- start 2023-09-13T09:51:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 -- start start 2023-09-13T09:51:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb200ffcc0 0x7fdb20103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb20100eb0 0x7fdb20102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb20101850 0x7fdb201027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb20102f70 con 0x7fdb200ffcc0 2023-09-13T09:51:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201030e0 con 0x7fdb20100eb0 2023-09-13T09:51:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb2620d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb201a0bd0 con 0x7fdb20101850 2023-09-13T09:51:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb200ffcc0 0x7fdb20103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb200ffcc0 0x7fdb20103c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41202/0 (socket says 172.21.15.6:41202) 2023-09-13T09:51:11.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/299998757 learned_addr learned my addr 172.21.15.6:0/299998757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1effd700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb20100eb0 0x7fdb20102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/299998757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb20101850 msgr2=0x7fdb201027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb20101850 0x7fdb201027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/299998757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb20100eb0 msgr2=0x7fdb20102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb20100eb0 0x7fdb20102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.660+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/299998757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb18009d00 con 0x7fdb200ffcc0 2023-09-13T09:51:11.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.661+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb200ffcc0 0x7fdb20103c50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e970 tx=0x7fdb1000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.661+0000 7fdb1cff9700 1 -- 172.21.15.6:0/299998757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10009790 con 0x7fdb200ffcc0 2023-09-13T09:51:11.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.661+0000 7fdb1cff9700 1 -- 172.21.15.6:0/299998757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb1000eec0 con 0x7fdb200ffcc0 2023-09-13T09:51:11.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.661+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb201a0eb0 con 0x7fdb200ffcc0 2023-09-13T09:51:11.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.661+0000 7fdb1cff9700 1 -- 172.21.15.6:0/299998757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10003cf0 con 0x7fdb200ffcc0 2023-09-13T09:51:11.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.661+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb201a1330 con 0x7fdb200ffcc0 2023-09-13T09:51:11.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.663+0000 7fdb1cff9700 1 -- 172.21.15.6:0/299998757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdb1000ccd0 con 0x7fdb200ffcc0 2023-09-13T09:51:11.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb1cff9700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb080a0640 0x7fdb080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb1effd700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb080a0640 0x7fdb080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb1cff9700 1 -- 172.21.15.6:0/299998757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb10014070 con 0x7fdb200ffcc0 2023-09-13T09:51:11.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb323f2b80 1 Processor -- start 2023-09-13T09:51:11.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb1effd700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb080a0640 0x7fdb080a2b00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009c60 tx=0x7fdb14009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb323f2b80 1 -- start start 2023-09-13T09:51:11.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d70f1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70f06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.664+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d7040780 con 0x5571d70f0f70 2023-09-13T09:51:11.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d703e0a0 con 0x5571d70f18d0 2023-09-13T09:51:11.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d7039990 con 0x5571d70f0260 2023-09-13T09:51:11.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d70f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d70f1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41210/0 (socket says 172.21.15.6:41210) 2023-09-13T09:51:11.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2967596811 learned_addr learned my addr 172.21.15.6:0/2967596811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1effd700 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1ffff700 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70f06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2967596811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 msgr2=0x5571d70f06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70f06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2967596811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 msgr2=0x5571d70efcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70efcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2967596811 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571d6eb9630 con 0x5571d70f0f70 2023-09-13T09:51:11.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d70f1390 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fdb10096060 tx=0x7fdb10098f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcea85e11e786b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb05ffb700 1 -- 172.21.15.6:0/2967596811 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1009d420 con 0x5571d70f0f70 2023-09-13T09:51:11.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb05ffb700 1 -- 172.21.15.6:0/2967596811 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb100a1660 con 0x5571d70f0f70 2023-09-13T09:51:11.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.665+0000 7fdb05ffb700 1 -- 172.21.15.6:0/2967596811 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb10084320 con 0x5571d70f0f70 2023-09-13T09:51:11.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2967596811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 msgr2=0x5571d70f1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d70f1390 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fdb10096060 tx=0x7fdb10098f50 comp rx=0 tx=0).stop 2023-09-13T09:51:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2967596811 shutdown_connections 2023-09-13T09:51:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70f06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d70f1390 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2967596811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70efcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2967596811 >> 172.21.15.6:0/2967596811 conn(0x5571d7045c80 msgr2=0x5571d70e1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2967596811 shutdown_connections 2023-09-13T09:51:11.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2967596811 wait complete. 2023-09-13T09:51:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.666+0000 7fdb323f2b80 1 -- start start 2023-09-13T09:51:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 1 Processor -- start 2023-09-13T09:51:11.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70e91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f0f70 0x5571d70e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f18d0 0x5571d70ee720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d6fd7bb0 con 0x5571d70f18d0 2023-09-13T09:51:11.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d6fd78b0 con 0x5571d70f0f70 2023-09-13T09:51:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d6ebb920 con 0x5571d70f0260 2023-09-13T09:51:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb323f2b80 10 client.0 _ll_register_callbacks cb 0x5571d6fd5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f18d0 0x5571d70ee720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f0f70 0x5571d70e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f18d0 0x5571d70ee720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41220/0 (socket says 172.21.15.6:41220) 2023-09-13T09:51:11.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70e91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1ffff700 1 -- 172.21.15.6:0/448715819 learned_addr learned my addr 172.21.15.6:0/448715819 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f0f70 0x5571d70e96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34742/0 (socket says 172.21.15.6:34742) 2023-09-13T09:51:11.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1effd700 1 -- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 msgr2=0x5571d70e91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1effd700 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70e91b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1effd700 1 -- 172.21.15.6:0/448715819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f18d0 msgr2=0x5571d70ee720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1effd700 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f18d0 0x5571d70ee720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1effd700 1 -- 172.21.15.6:0/448715819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb201a1330 con 0x5571d70f0f70 2023-09-13T09:51:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.667+0000 7fdb1ffff700 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f18d0 0x5571d70ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb1effd700 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f0f70 0x5571d70e96f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5571d70e2ef0 tx=0x7fdb140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62a2ce33d295a2ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdafeffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:51:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdafeffd700 1 -- 172.21.15.6:0/448715819 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb14022070 con 0x5571d70f0f70 2023-09-13T09:51:11.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdafeffd700 1 -- 172.21.15.6:0/448715819 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb1401d620 con 0x5571d70f0f70 2023-09-13T09:51:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571d70da670 con 0x5571d70f0f70 2023-09-13T09:51:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdafeffd700 1 -- 172.21.15.6:0/448715819 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb14004580 con 0x5571d70f0f70 2023-09-13T09:51:11.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 10 client.27953 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5571d70517a0 con 0x5571d70f0f70 2023-09-13T09:51:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdafeffd700 1 -- 172.21.15.6:0/448715819 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5571d70da670 con 0x5571d70f0f70 2023-09-13T09:51:11.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdafeffd700 1 -- 172.21.15.6:0/448715819 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb14031a20 con 0x5571d70f0f70 2023-09-13T09:51:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 10 client.27953 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 10 client.27953 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:51:11.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 20 client.27953 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d710de70 0x5571d7110290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 4 client.27953 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.668+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571d7032970 con 0x5571d710de70 2023-09-13T09:51:11.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.669+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d710de70 0x5571d7110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.669+0000 7fdafeffd700 10 client.27953 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.669+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d710de70 0x5571d7110290 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a5a19f8f1561036c server_cookie=7119ff86ff47ae48 in_seq=0 out_seq=0 2023-09-13T09:51:11.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdafeffd700 1 -- 172.21.15.6:0/448715819 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5571d7032970 con 0x5571d710de70 2023-09-13T09:51:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdafeffd700 10 client.27953 handle_command_reply: tid=0 2023-09-13T09:51:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 client.27953 shutdown 2023-09-13T09:51:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f0f70 msgr2=0x5571d70e96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f0f70 0x5571d70e96f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x5571d70e2ef0 tx=0x7fdb140047c0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 shutdown_connections 2023-09-13T09:51:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d710de70 0x5571d7110290 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f18d0 0x5571d70ee720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70e91b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/448715819 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f0f70 0x5571d70e96f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdafeffd700 0 client.27953 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 >> 172.21.15.6:0/448715819 conn(0x5571d7045c80 msgr2=0x5571d70dc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 shutdown_connections 2023-09-13T09:51:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 1 -- 172.21.15.6:0/448715819 wait complete. 2023-09-13T09:51:11.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.670+0000 7fdb323f2b80 20 client.27953 trim_cache size 0 max 16384 2023-09-13T09:51:11.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 Processor -- start 2023-09-13T09:51:11.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 -- start start 2023-09-13T09:51:11.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70ee6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d711da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70f4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d70e9e60 con 0x5571d70f0f70 2023-09-13T09:51:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d70f7db0 con 0x5571d70f18d0 2023-09-13T09:51:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d711dfb0 con 0x5571d70f0260 2023-09-13T09:51:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70ee6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70ee6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44278/0 (socket says 172.21.15.6:44278) 2023-09-13T09:51:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/3603143990 learned_addr learned my addr 172.21.15.6:0/3603143990 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1effd700 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d711da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1ffff700 1 -- 172.21.15.6:0/3603143990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 msgr2=0x5571d70ee6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1ffff700 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70ee6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1ffff700 1 -- 172.21.15.6:0/3603143990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 msgr2=0x5571d711da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1ffff700 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d711da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.683+0000 7fdb1ffff700 1 -- 172.21.15.6:0/3603143990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571d6e65de0 con 0x5571d70f18d0 2023-09-13T09:51:11.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.684+0000 7fdb1ffff700 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70f4690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009610 tx=0x7fdb18007590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fabe29cfca62a1c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.684+0000 7fdb067fc700 1 -- 172.21.15.6:0/3603143990 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1800e040 con 0x5571d70f18d0 2023-09-13T09:51:11.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.684+0000 7fdb067fc700 1 -- 172.21.15.6:0/3603143990 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb18020070 con 0x5571d70f18d0 2023-09-13T09:51:11.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.684+0000 7fdb067fc700 1 -- 172.21.15.6:0/3603143990 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb180258e0 con 0x5571d70f18d0 2023-09-13T09:51:11.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- 172.21.15.6:0/3603143990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 msgr2=0x5571d70f4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70f4690 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009610 tx=0x7fdb18007590 comp rx=0 tx=0).stop 2023-09-13T09:51:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- 172.21.15.6:0/3603143990 shutdown_connections 2023-09-13T09:51:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d70f4690 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0260 0x5571d70ee6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/3603143990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0f70 0x5571d711da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- 172.21.15.6:0/3603143990 >> 172.21.15.6:0/3603143990 conn(0x5571d7045c80 msgr2=0x5571d70e1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- 172.21.15.6:0/3603143990 shutdown_connections 2023-09-13T09:51:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- 172.21.15.6:0/3603143990 wait complete. 2023-09-13T09:51:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- start start 2023-09-13T09:51:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 Processor -- start 2023-09-13T09:51:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0260 0x5571d711d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0f70 0x5571d711d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d7160970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d7160eb0 con 0x5571d70f0260 2023-09-13T09:51:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d7160ff0 con 0x5571d70f18d0 2023-09-13T09:51:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.685+0000 7fdb323f2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571d7161180 con 0x5571d70f0f70 2023-09-13T09:51:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb323f2b80 10 client.0 _ll_register_callbacks cb 0x5571d6fd5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0260 0x5571d711d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0260 0x5571d711d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41230/0 (socket says 172.21.15.6:41230) 2023-09-13T09:51:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2044960568 learned_addr learned my addr 172.21.15.6:0/2044960568 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1effd700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0f70 0x5571d711d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1ffff700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d7160970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0f70 msgr2=0x5571d711d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0f70 0x5571d711d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2044960568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 msgr2=0x5571d7160970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d7160970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 -- 172.21.15.6:0/2044960568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb20108a50 con 0x5571d70f0260 2023-09-13T09:51:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1effd700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0f70 0x5571d711d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb1f7fe700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0260 0x5571d711d010 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdb100047d0 tx=0x7fdb10003680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a4e1f1f94b8d7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdafeffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdafeffd700 1 -- 172.21.15.6:0/2044960568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1001fde0 con 0x5571d70f0260 2023-09-13T09:51:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdafeffd700 1 -- 172.21.15.6:0/2044960568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb10082e40 con 0x5571d70f0260 2023-09-13T09:51:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb100a1660 con 0x5571d70f0260 2023-09-13T09:51:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdafeffd700 1 -- 172.21.15.6:0/2044960568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb10097990 con 0x5571d70f0260 2023-09-13T09:51:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb323f2b80 10 client.18567 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.686+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5571d6e4ec60 con 0x5571d70f0260 2023-09-13T09:51:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdafeffd700 1 -- 172.21.15.6:0/2044960568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb100a1660 con 0x5571d70f0260 2023-09-13T09:51:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdafeffd700 1 -- 172.21.15.6:0/2044960568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdb10098ae0 con 0x5571d70f0260 2023-09-13T09:51:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdb323f2b80 10 client.18567 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdb323f2b80 10 client.18567 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:51:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdb323f2b80 20 client.18567 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d7162810 0x5571d7164c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdb323f2b80 4 client.18567 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5571d6ff3050 con 0x5571d7162810 2023-09-13T09:51:11.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.687+0000 7fdb1effd700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d7162810 0x5571d7164c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdafeffd700 10 client.18567 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:11.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb1effd700 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d7162810 0x5571d7164c30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f923c919544aaa7 server_cookie=a77a4915fcc21b57 in_seq=0 out_seq=0 2023-09-13T09:51:11.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdafeffd700 1 -- 172.21.15.6:0/2044960568 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5571d6ff3050 con 0x5571d7162810 2023-09-13T09:51:11.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdafeffd700 10 client.18567 handle_command_reply: tid=0 2023-09-13T09:51:11.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 client.18567 shutdown 2023-09-13T09:51:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0260 msgr2=0x5571d711d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0260 0x5571d711d010 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fdb100047d0 tx=0x7fdb10003680 comp rx=0 tx=0).stop 2023-09-13T09:51:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 shutdown_connections 2023-09-13T09:51:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x5571d7162810 0x5571d7164c30 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5571d70f18d0 0x5571d7160970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5571d70f0260 0x5571d711d010 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdafeffd700 0 client.18567 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 --2- 172.21.15.6:0/2044960568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5571d70f0f70 0x5571d711d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 >> 172.21.15.6:0/2044960568 conn(0x5571d7045c80 msgr2=0x5571d70e9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 shutdown_connections 2023-09-13T09:51:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 1 -- 172.21.15.6:0/2044960568 wait complete. 2023-09-13T09:51:11.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.688+0000 7fdb323f2b80 20 client.18567 trim_cache size 0 max 16384 2023-09-13T09:51:11.720 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb080a0640 msgr2=0x7fdb080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb080a0640 0x7fdb080a2b00 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009c60 tx=0x7fdb14009260 comp rx=0 tx=0).stop 2023-09-13T09:51:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb200ffcc0 msgr2=0x7fdb20103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb200ffcc0 0x7fdb20103c50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fdb1000e970 tx=0x7fdb1000ec80 comp rx=0 tx=0).stop 2023-09-13T09:51:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 shutdown_connections 2023-09-13T09:51:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb20101850 0x7fdb201027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb080a0640 0x7fdb080a2b00 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb200ffcc0 0x7fdb20103c50 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 --2- 172.21.15.6:0/299998757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdb20100eb0 0x7fdb20102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 >> 172.21.15.6:0/299998757 conn(0x7fdb200fb250 msgr2=0x7fdb20067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 shutdown_connections 2023-09-13T09:51:11.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.689+0000 7fdb2620d700 1 -- 172.21.15.6:0/299998757 wait complete. 2023-09-13T09:51:11.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:51:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 -- 172.21.15.6:0/2630340198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 msgr2=0x7efe701000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 --2- 172.21.15.6:0/2630340198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe701000e0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7efe600099c0 tx=0x7efe60009cd0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 -- 172.21.15.6:0/2630340198 shutdown_connections 2023-09-13T09:51:11.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 --2- 172.21.15.6:0/2630340198 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe70101850 0x7efe70108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 --2- 172.21.15.6:0/2630340198 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe701000e0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 --2- 172.21.15.6:0/2630340198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe70100eb0 0x7efe70101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 -- 172.21.15.6:0/2630340198 >> 172.21.15.6:0/2630340198 conn(0x7efe700fb250 msgr2=0x7efe700fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 -- 172.21.15.6:0/2630340198 shutdown_connections 2023-09-13T09:51:11.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 -- 172.21.15.6:0/2630340198 wait complete. 2023-09-13T09:51:11.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.856+0000 7efe753ad700 1 Processor -- start 2023-09-13T09:51:11.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe753ad700 1 -- start start 2023-09-13T09:51:11.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe753ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe70195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe753ad700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe70100eb0 0x7efe70195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe753ad700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe70101850 0x7efe7019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe753ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7019d510 con 0x7efe700ffcc0 2023-09-13T09:51:11.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe753ad700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7019d650 con 0x7efe70101850 2023-09-13T09:51:11.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe753ad700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7019d7e0 con 0x7efe70100eb0 2023-09-13T09:51:11.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe70195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe70195990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41244/0 (socket says 172.21.15.6:41244) 2023-09-13T09:51:11.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 -- 172.21.15.6:0/3038615970 learned_addr learned my addr 172.21.15.6:0/3038615970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6f7fe700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe70101850 0x7efe7019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe70100eb0 0x7efe70195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 -- 172.21.15.6:0/3038615970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe70100eb0 msgr2=0x7efe70195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe70100eb0 0x7efe70195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 -- 172.21.15.6:0/3038615970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe70101850 msgr2=0x7efe7019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe70101850 0x7efe7019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.857+0000 7efe6effd700 1 -- 172.21.15.6:0/3038615970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe68009c40 con 0x7efe700ffcc0 2023-09-13T09:51:11.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.858+0000 7efe6effd700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe70195990 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7efe60009fd0 tx=0x7efe60009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.858+0000 7efe57fff700 1 -- 172.21.15.6:0/3038615970 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6001d070 con 0x7efe700ffcc0 2023-09-13T09:51:11.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.858+0000 7efe57fff700 1 -- 172.21.15.6:0/3038615970 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe60005030 con 0x7efe700ffcc0 2023-09-13T09:51:11.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.858+0000 7efe57fff700 1 -- 172.21.15.6:0/3038615970 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60004a90 con 0x7efe700ffcc0 2023-09-13T09:51:11.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.858+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe600095f0 con 0x7efe700ffcc0 2023-09-13T09:51:11.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.858+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe7019dca0 con 0x7efe700ffcc0 2023-09-13T09:51:11.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.860+0000 7efe57fff700 1 -- 172.21.15.6:0/3038615970 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7efe600054a0 con 0x7efe700ffcc0 2023-09-13T09:51:11.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.861+0000 7efe57fff700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe580a0640 0x7efe580a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.861+0000 7efe57fff700 1 -- 172.21.15.6:0/3038615970 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe600cc910 con 0x7efe700ffcc0 2023-09-13T09:51:11.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.861+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe580a0640 0x7efe580a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.861+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe580a0640 0x7efe580a2b00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efe64009c60 tx=0x7efe64009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.861+0000 7efe81592b80 1 Processor -- start 2023-09-13T09:51:11.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.861+0000 7efe81592b80 1 -- start start 2023-09-13T09:51:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe81592b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05d700 0x557deb05db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe81592b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb05c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe81592b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05ca00 0x557deb05ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe81592b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deafb5780 con 0x557deb05ca00 2023-09-13T09:51:11.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe81592b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deafb30a0 con 0x557deb05d700 2023-09-13T09:51:11.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe81592b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deafae990 con 0x557deb05e060 2023-09-13T09:51:11.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05ca00 0x557deb05ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb05c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05ca00 0x557deb05ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41256/0 (socket says 172.21.15.6:41256) 2023-09-13T09:51:11.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6f7fe700 1 -- 172.21.15.6:0/2174976042 learned_addr learned my addr 172.21.15.6:0/2174976042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6effd700 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05d700 0x557deb05db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6effd700 1 -- 172.21.15.6:0/2174976042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 msgr2=0x557deb05c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6effd700 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb05c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6effd700 1 -- 172.21.15.6:0/2174976042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05ca00 msgr2=0x557deb05ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6effd700 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05ca00 0x557deb05ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6effd700 1 -- 172.21.15.6:0/2174976042 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557deae2e630 con 0x557deb05d700 2023-09-13T09:51:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6f7fe700 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05ca00 0x557deb05ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb05c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe6effd700 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05d700 0x557deb05db20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b580 tx=0x7efe600057b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a75c36cb10b4708a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.862+0000 7efe557fa700 1 -- 172.21.15.6:0/2174976042 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6009a960 con 0x557deb05d700 2023-09-13T09:51:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe557fa700 1 -- 172.21.15.6:0/2174976042 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe6009a260 con 0x557deb05d700 2023-09-13T09:51:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe557fa700 1 -- 172.21.15.6:0/2174976042 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe60098720 con 0x557deb05d700 2023-09-13T09:51:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 -- 172.21.15.6:0/2174976042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05d700 msgr2=0x557deb05db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05d700 0x557deb05db20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7efe6000b580 tx=0x7efe600057b0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 -- 172.21.15.6:0/2174976042 shutdown_connections 2023-09-13T09:51:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05ca00 0x557deb05ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05d700 0x557deb05db20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 --2- 172.21.15.6:0/2174976042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb05c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 -- 172.21.15.6:0/2174976042 >> 172.21.15.6:0/2174976042 conn(0x557deafbac80 msgr2=0x557deb056f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 -- 172.21.15.6:0/2174976042 shutdown_connections 2023-09-13T09:51:11.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.863+0000 7efe81592b80 1 -- 172.21.15.6:0/2174976042 wait complete. 2023-09-13T09:51:11.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 -- start start 2023-09-13T09:51:11.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 Processor -- start 2023-09-13T09:51:11.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05ca00 0x557deb065bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb0660f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05e060 0x557deb06d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deaf4cbb0 con 0x557deb05d700 2023-09-13T09:51:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deaf4c8b0 con 0x557deb05e060 2023-09-13T09:51:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deae30920 con 0x557deb05ca00 2023-09-13T09:51:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe81592b80 10 client.0 _ll_register_callbacks cb 0x557deaf4a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb0660f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb0660f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41260/0 (socket says 172.21.15.6:41260) 2023-09-13T09:51:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 -- 172.21.15.6:0/1372413823 learned_addr learned my addr 172.21.15.6:0/1372413823 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6f7fe700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05e060 0x557deb06d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6effd700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05ca00 0x557deb065bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 -- 172.21.15.6:0/1372413823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05ca00 msgr2=0x557deb065bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05ca00 0x557deb065bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 -- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05e060 msgr2=0x557deb06d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05e060 0x557deb06d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6e7fc700 1 -- 172.21.15.6:0/1372413823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe60094e70 con 0x557deb05d700 2023-09-13T09:51:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.864+0000 7efe6effd700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05ca00 0x557deb065bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb0660f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7efe6401dc40 tx=0x7efe640047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb131bf97ada236a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe52ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe52ff5700 1 -- 172.21.15.6:0/1372413823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64022070 con 0x557deb05d700 2023-09-13T09:51:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe52ff5700 1 -- 172.21.15.6:0/1372413823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe64004240 con 0x557deb05d700 2023-09-13T09:51:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557deb04f670 con 0x557deb05d700 2023-09-13T09:51:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe52ff5700 1 -- 172.21.15.6:0/1372413823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe64004400 con 0x557deb05d700 2023-09-13T09:51:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe81592b80 10 client.18579 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.865+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x557deafc67a0 con 0x557deb05d700 2023-09-13T09:51:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe52ff5700 1 -- 172.21.15.6:0/1372413823 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557deb04f670 con 0x557deb05d700 2023-09-13T09:51:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe52ff5700 1 -- 172.21.15.6:0/1372413823 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efe64003ac0 con 0x557deb05d700 2023-09-13T09:51:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe81592b80 10 client.18579 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe81592b80 10 client.18579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe81592b80 20 client.18579 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe81592b80 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0719f0 0x557deb073e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe81592b80 4 client.18579 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557deafa7970 con 0x557deb0719f0 2023-09-13T09:51:11.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.866+0000 7efe6effd700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0719f0 0x557deb073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.867+0000 7efe6effd700 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0719f0 0x557deb073e10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e34153e41ee34bc server_cookie=70890c91a90dd23c in_seq=0 out_seq=0 2023-09-13T09:51:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.867+0000 7efe52ff5700 10 client.18579 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe52ff5700 1 -- 172.21.15.6:0/1372413823 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557deafa7970 con 0x557deb0719f0 2023-09-13T09:51:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe52ff5700 10 client.18579 handle_command_reply: tid=0 2023-09-13T09:51:11.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 client.18579 shutdown 2023-09-13T09:51:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 msgr2=0x557deb0660f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb0660f0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7efe6401dc40 tx=0x7efe640047c0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 shutdown_connections 2023-09-13T09:51:11.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05e060 0x557deb06d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05ca00 0x557deb065bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0719f0 0x557deb073e10 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 --2- 172.21.15.6:0/1372413823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb0660f0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe52ff5700 0 client.18579 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 >> 172.21.15.6:0/1372413823 conn(0x557deafbac80 msgr2=0x557deb0517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 shutdown_connections 2023-09-13T09:51:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 1 -- 172.21.15.6:0/1372413823 wait complete. 2023-09-13T09:51:11.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.868+0000 7efe81592b80 20 client.18579 trim_cache size 0 max 16384 2023-09-13T09:51:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 Processor -- start 2023-09-13T09:51:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 -- start start 2023-09-13T09:51:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb05c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb065b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deb04f650 con 0x557deb05d700 2023-09-13T09:51:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deb065720 con 0x557deb05ca00 2023-09-13T09:51:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe81592b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deb0538e0 con 0x557deb05e060 2023-09-13T09:51:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.882+0000 7efe6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb05c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb065b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41268/0 (socket says 172.21.15.6:41268) 2023-09-13T09:51:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 -- 172.21.15.6:0/2913660900 learned_addr learned my addr 172.21.15.6:0/2913660900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 -- 172.21.15.6:0/2913660900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 msgr2=0x557deb065b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb065b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 -- 172.21.15.6:0/2913660900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 msgr2=0x557deb05c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb05c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 -- 172.21.15.6:0/2913660900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557deaddade0 con 0x557deb05d700 2023-09-13T09:51:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6f7fe700 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6effd700 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb05c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb06d0f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7efe64013010 tx=0x7efe64009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d732a5ec9f8f6917 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe55ffb700 1 -- 172.21.15.6:0/2913660900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64022040 con 0x557deb05d700 2023-09-13T09:51:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe55ffb700 1 -- 172.21.15.6:0/2913660900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe6402c020 con 0x557deb05d700 2023-09-13T09:51:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.883+0000 7efe55ffb700 1 -- 172.21.15.6:0/2913660900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe6401c8e0 con 0x557deb05d700 2023-09-13T09:51:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 -- 172.21.15.6:0/2913660900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 msgr2=0x557deb06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb06d0f0 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7efe64013010 tx=0x7efe64009350 comp rx=0 tx=0).stop 2023-09-13T09:51:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 -- 172.21.15.6:0/2913660900 shutdown_connections 2023-09-13T09:51:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb065b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb05c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 --2- 172.21.15.6:0/2913660900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb06d0f0 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 -- 172.21.15.6:0/2913660900 >> 172.21.15.6:0/2913660900 conn(0x557deafbac80 msgr2=0x557deb0608e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 -- 172.21.15.6:0/2913660900 shutdown_connections 2023-09-13T09:51:11.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 -- 172.21.15.6:0/2913660900 wait complete. 2023-09-13T09:51:11.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.884+0000 7efe81592b80 1 -- start start 2023-09-13T09:51:11.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 1 Processor -- start 2023-09-13T09:51:11.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb0691e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb069720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb06c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deb06cc80 con 0x557deb05d700 2023-09-13T09:51:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deb06cdf0 con 0x557deb05ca00 2023-09-13T09:51:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557deb06cfb0 con 0x557deb05e060 2023-09-13T09:51:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe81592b80 10 client.0 _ll_register_callbacks cb 0x557deaf4a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb069720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb069720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41274/0 (socket says 172.21.15.6:41274) 2023-09-13T09:51:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 -- 172.21.15.6:0/3411095306 learned_addr learned my addr 172.21.15.6:0/3411095306 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6effd700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb0691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6f7fe700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb06c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 -- 172.21.15.6:0/3411095306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 msgr2=0x557deb06c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb06c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 -- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 msgr2=0x557deb0691e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb0691e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6e7fc700 1 -- 172.21.15.6:0/3411095306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557deae2e630 con 0x557deb05d700 2023-09-13T09:51:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.885+0000 7efe6effd700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb0691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe6e7fc700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb069720 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7efe64003d70 tx=0x7efe64003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b034bc006b755b94 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe52ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe52ff5700 1 -- 172.21.15.6:0/3411095306 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe64022070 con 0x557deb05d700 2023-09-13T09:51:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efe6009a260 con 0x557deb05d700 2023-09-13T09:51:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe52ff5700 1 -- 172.21.15.6:0/3411095306 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7efe6402d030 con 0x557deb05d700 2023-09-13T09:51:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe52ff5700 1 -- 172.21.15.6:0/3411095306 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7efe64005040 con 0x557deb05d700 2023-09-13T09:51:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 10 client.18585 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7efe6800e5c0 con 0x557deb05d700 2023-09-13T09:51:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe52ff5700 1 -- 172.21.15.6:0/3411095306 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7efe6009a260 con 0x557deb05d700 2023-09-13T09:51:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe52ff5700 1 -- 172.21.15.6:0/3411095306 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7efe64004c10 con 0x557deb05d700 2023-09-13T09:51:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 10 client.18585 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 10 client.18585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 20 client.18585 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0caa90 0x557deb0cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 4 client.18585 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557deaf68050 con 0x557deb0caa90 2023-09-13T09:51:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.886+0000 7efe6effd700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0caa90 0x557deb0cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe6effd700 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0caa90 0x557deb0cce80 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7361dc086e0d3da server_cookie=4b735ec7d8db11ce in_seq=0 out_seq=0 2023-09-13T09:51:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe52ff5700 10 client.18585 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe52ff5700 1 -- 172.21.15.6:0/3411095306 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557deaf68050 con 0x557deb0caa90 2023-09-13T09:51:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe52ff5700 10 client.18585 handle_command_reply: tid=0 2023-09-13T09:51:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 client.18585 shutdown 2023-09-13T09:51:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 msgr2=0x557deb069720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb069720 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7efe64003d70 tx=0x7efe64003f10 comp rx=0 tx=0).stop 2023-09-13T09:51:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 shutdown_connections 2023-09-13T09:51:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557deb05e060 0x557deb06c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557deb05ca00 0x557deb0691e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557deb0caa90 0x557deb0cce80 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 --2- 172.21.15.6:0/3411095306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557deb05d700 0x557deb069720 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 >> 172.21.15.6:0/3411095306 conn(0x557deafbac80 msgr2=0x557deb065b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe52ff5700 0 client.18585 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:11.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 shutdown_connections 2023-09-13T09:51:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 1 -- 172.21.15.6:0/3411095306 wait complete. 2023-09-13T09:51:11.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.887+0000 7efe81592b80 20 client.18585 trim_cache size 0 max 16384 2023-09-13T09:51:11.936 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:11.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe580a0640 msgr2=0x7efe580a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe580a0640 0x7efe580a2b00 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7efe64009c60 tx=0x7efe64009260 comp rx=0 tx=0).stop 2023-09-13T09:51:11.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 msgr2=0x7efe70195990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:11.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe70195990 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7efe60009fd0 tx=0x7efe60009580 comp rx=0 tx=0).stop 2023-09-13T09:51:11.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 shutdown_connections 2023-09-13T09:51:11.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7efe70101850 0x7efe7019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7efe580a0640 0x7efe580a2b00 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe700ffcc0 0x7efe70195990 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 --2- 172.21.15.6:0/3038615970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe70100eb0 0x7efe70195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:11.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 >> 172.21.15.6:0/3038615970 conn(0x7efe700fb250 msgr2=0x7efe700fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 shutdown_connections 2023-09-13T09:51:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:11.888+0000 7efe753ad700 1 -- 172.21.15.6:0/3038615970 wait complete. 2023-09-13T09:51:12.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 717673 6.61 MB/sec execute 512 sec latency 21.144 ms 2023-09-13T09:51:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:11 smithi006 ceph-mon[98665]: pgmap v650: 97 pgs: 97 active+clean; 280 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.9 MiB/s wr, 223 op/s 2023-09-13T09:51:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:11 smithi053 ceph-mon[102373]: pgmap v650: 97 pgs: 97 active+clean; 280 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.9 MiB/s wr, 223 op/s 2023-09-13T09:51:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:11 smithi131 ceph-mon[102785]: pgmap v650: 97 pgs: 97 active+clean; 280 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 616 KiB/s rd, 1.9 MiB/s wr, 223 op/s 2023-09-13T09:51:12.941 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:51:12.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:51:13.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 -- 172.21.15.6:0/3587119038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4101850 msgr2=0x7fd4f4108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 --2- 172.21.15.6:0/3587119038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4101850 0x7fd4f4108100 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec00b0d0 tx=0x7fd4ec00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 -- 172.21.15.6:0/3587119038 shutdown_connections 2023-09-13T09:51:13.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 --2- 172.21.15.6:0/3587119038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4101850 0x7fd4f4108100 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 --2- 172.21.15.6:0/3587119038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4f40ffcc0 0x7fd4f41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 --2- 172.21.15.6:0/3587119038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f4100eb0 0x7fd4f4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 -- 172.21.15.6:0/3587119038 >> 172.21.15.6:0/3587119038 conn(0x7fd4f40fb250 msgr2=0x7fd4f40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 -- 172.21.15.6:0/3587119038 shutdown_connections 2023-09-13T09:51:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 -- 172.21.15.6:0/3587119038 wait complete. 2023-09-13T09:51:13.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.076+0000 7fd4f987d700 1 Processor -- start 2023-09-13T09:51:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f987d700 1 -- start start 2023-09-13T09:51:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f987d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f40ffcc0 0x7fd4f4196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f987d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4100eb0 0x7fd4f41970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f987d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4f4101850 0x7fd4f419e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f987d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f419e6f0 con 0x7fd4f4100eb0 2023-09-13T09:51:13.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f987d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f419e830 con 0x7fd4f4101850 2023-09-13T09:51:13.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f987d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f419e9c0 con 0x7fd4f40ffcc0 2023-09-13T09:51:13.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4100eb0 0x7fd4f41970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f40ffcc0 0x7fd4f4196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4100eb0 0x7fd4f41970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41290/0 (socket says 172.21.15.6:41290) 2023-09-13T09:51:13.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 -- 172.21.15.6:0/608636506 learned_addr learned my addr 172.21.15.6:0/608636506 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4f4101850 0x7fd4f419e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 -- 172.21.15.6:0/608636506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f40ffcc0 msgr2=0x7fd4f4196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f40ffcc0 0x7fd4f4196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 -- 172.21.15.6:0/608636506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4f4101850 msgr2=0x7fd4f419e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4f4101850 0x7fd4f419e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f27fc700 1 -- 172.21.15.6:0/608636506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4009520 con 0x7fd4f4100eb0 2023-09-13T09:51:13.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.077+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f40ffcc0 0x7fd4f4196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.078+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4100eb0 0x7fd4f41970b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800eb30 tx=0x7fd4e800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.078+0000 7fd4f887b700 1 -- 172.21.15.6:0/608636506 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8009880 con 0x7fd4f4100eb0 2023-09-13T09:51:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.078+0000 7fd4f887b700 1 -- 172.21.15.6:0/608636506 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4e80044e0 con 0x7fd4f4100eb0 2023-09-13T09:51:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.078+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e8009520 con 0x7fd4f4100eb0 2023-09-13T09:51:13.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.078+0000 7fd4f887b700 1 -- 172.21.15.6:0/608636506 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8003d80 con 0x7fd4f4100eb0 2023-09-13T09:51:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.078+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4ec009d00 con 0x7fd4f4100eb0 2023-09-13T09:51:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.080+0000 7fd4f887b700 1 -- 172.21.15.6:0/608636506 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd4e8003f20 con 0x7fd4f4100eb0 2023-09-13T09:51:13.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.081+0000 7fd4f887b700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd4dc0a0640 0x7fd4dc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.081+0000 7fd4f887b700 1 -- 172.21.15.6:0/608636506 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd4e8014070 con 0x7fd4f4100eb0 2023-09-13T09:51:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.081+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd4dc0a0640 0x7fd4dc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.082+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd4dc0a0640 0x7fd4dc0a2b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009fd0 tx=0x7fd4e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.082+0000 7fd505a62b80 1 Processor -- start 2023-09-13T09:51:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd505a62b80 1 -- start start 2023-09-13T09:51:13.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab8aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab89540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab89f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd505a62b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdaae2800 con 0x55bbdab8b0e0 2023-09-13T09:51:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd505a62b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdaae0120 con 0x55bbdab89a80 2023-09-13T09:51:13.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd505a62b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdaadba10 con 0x55bbdab8a780 2023-09-13T09:51:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab8aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab8aba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44348/0 (socket says 172.21.15.6:44348) 2023-09-13T09:51:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab89540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab89f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 -- 172.21.15.6:0/1688420120 learned_addr learned my addr 172.21.15.6:0/1688420120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 -- 172.21.15.6:0/1688420120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 msgr2=0x55bbdab89f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab89f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 -- 172.21.15.6:0/1688420120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 msgr2=0x55bbdab89540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab89540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f2ffd700 1 -- 172.21.15.6:0/1688420120 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbda95b6b0 con 0x55bbdab8a780 2023-09-13T09:51:13.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.083+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab89f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.084+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab8aba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40043b0 tx=0x7fd4e4018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca23be82b8d57ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.084+0000 7fd4d9ffb700 1 -- 172.21.15.6:0/1688420120 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e4003ce0 con 0x55bbdab8a780 2023-09-13T09:51:13.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.084+0000 7fd4d9ffb700 1 -- 172.21.15.6:0/1688420120 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4e4003e40 con 0x55bbdab8a780 2023-09-13T09:51:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.084+0000 7fd4d9ffb700 1 -- 172.21.15.6:0/1688420120 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e401e880 con 0x55bbdab8a780 2023-09-13T09:51:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 -- 172.21.15.6:0/1688420120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 msgr2=0x55bbdab8aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab8aba0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd4e40043b0 tx=0x7fd4e4018000 comp rx=0 tx=0).stop 2023-09-13T09:51:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 -- 172.21.15.6:0/1688420120 shutdown_connections 2023-09-13T09:51:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab89f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab8aba0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1688420120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab89540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 -- 172.21.15.6:0/1688420120 >> 172.21.15.6:0/1688420120 conn(0x55bbdaae7d00 msgr2=0x55bbdab83f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 -- 172.21.15.6:0/1688420120 shutdown_connections 2023-09-13T09:51:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 -- 172.21.15.6:0/1688420120 wait complete. 2023-09-13T09:51:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 -- start start 2023-09-13T09:51:13.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.085+0000 7fd505a62b80 1 Processor -- start 2023-09-13T09:51:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab97440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab97980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdaa79c30 con 0x55bbdab8b0e0 2023-09-13T09:51:13.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdaa79930 con 0x55bbdab89a80 2023-09-13T09:51:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbda95d9a0 con 0x55bbdab8a780 2023-09-13T09:51:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 10 client.0 _ll_register_callbacks cb 0x55bbdaa77700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:13.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab97440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41304/0 (socket says 172.21.15.6:41304) 2023-09-13T09:51:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 -- 172.21.15.6:0/418119694 learned_addr learned my addr 172.21.15.6:0/418119694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab97980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 -- 172.21.15.6:0/418119694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 msgr2=0x55bbdab97980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab97980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 -- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 msgr2=0x55bbdab97440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab97440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 -- 172.21.15.6:0/418119694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e4017050 con 0x55bbdab8b0e0 2023-09-13T09:51:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab97440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9e9c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec008f80 tx=0x7fd4ec008fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7a68a94af3677f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:13.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/418119694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00e040 con 0x55bbdab8b0e0 2023-09-13T09:51:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bbdab7c6f0 con 0x55bbdab8b0e0 2023-09-13T09:51:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.086+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/418119694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd4ec00bca0 con 0x55bbdab8b0e0 2023-09-13T09:51:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/418119694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4ec00be60 con 0x55bbdab8b0e0 2023-09-13T09:51:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 10 client.18597 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:13.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55bbdaaf3820 con 0x55bbdab8b0e0 2023-09-13T09:51:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/418119694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bbdab7c6f0 con 0x55bbdab8b0e0 2023-09-13T09:51:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/418119694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd4ec00b100 con 0x55bbdab8b0e0 2023-09-13T09:51:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 10 client.18597 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:13.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 10 client.18597 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 20 client.18597 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdaba55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 4 client.18597 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bbdaad49f0 con 0x55bbdaba31c0 2023-09-13T09:51:13.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.087+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdaba55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.088+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdaba55e0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9df9f4ec92988119 server_cookie=73e3dd231a08943c in_seq=0 out_seq=0 2023-09-13T09:51:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.088+0000 7fd4d2ffd700 10 client.18597 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.088+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/418119694 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bbdaad49f0 con 0x55bbdaba31c0 2023-09-13T09:51:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.088+0000 7fd4d2ffd700 10 client.18597 handle_command_reply: tid=0 2023-09-13T09:51:13.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.088+0000 7fd505a62b80 1 client.18597 shutdown 2023-09-13T09:51:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 msgr2=0x55bbdab9e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9e9c0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec008f80 tx=0x7fd4ec008fb0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 shutdown_connections 2023-09-13T09:51:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdaba55e0 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9e9c0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab89a80 0x55bbdab97440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd4d2ffd700 0 client.18597 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 --2- 172.21.15.6:0/418119694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab8a780 0x55bbdab97980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 >> 172.21.15.6:0/418119694 conn(0x55bbdaae7d00 msgr2=0x55bbdab7e870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 shutdown_connections 2023-09-13T09:51:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 1 -- 172.21.15.6:0/418119694 wait complete. 2023-09-13T09:51:13.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.089+0000 7fd505a62b80 20 client.18597 trim_cache size 0 max 16384 2023-09-13T09:51:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 Processor -- start 2023-09-13T09:51:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 -- start start 2023-09-13T09:51:13.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab89540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8a780 0x55bbdab9e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdab96fb0 con 0x55bbdab8b0e0 2023-09-13T09:51:13.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdab80960 con 0x55bbdab8a780 2023-09-13T09:51:13.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd505a62b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdab857b0 con 0x55bbdab89a80 2023-09-13T09:51:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8a780 0x55bbdab9e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab89540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8a780 0x55bbdab9e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34832/0 (socket says 172.21.15.6:34832) 2023-09-13T09:51:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab89540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44364/0 (socket says 172.21.15.6:44364) 2023-09-13T09:51:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41312/0 (socket says 172.21.15.6:41312) 2023-09-13T09:51:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f27fc700 1 -- 172.21.15.6:0/1266474314 learned_addr learned my addr 172.21.15.6:0/1266474314 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f37fe700 1 -- 172.21.15.6:0/1266474314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 msgr2=0x55bbdab89540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab89540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f37fe700 1 -- 172.21.15.6:0/1266474314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8a780 msgr2=0x55bbdab9e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8a780 0x55bbdab9e8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f37fe700 1 -- 172.21.15.6:0/1266474314 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bbda907e60 con 0x55bbdab8b0e0 2023-09-13T09:51:13.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8a780 0x55bbdab9e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.107+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab89540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.108+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9f2b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009040 tx=0x7fd4ec007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea625d38162dcc9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.108+0000 7fd4da7fc700 1 -- 172.21.15.6:0/1266474314 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec00e070 con 0x55bbdab8b0e0 2023-09-13T09:51:13.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.108+0000 7fd4da7fc700 1 -- 172.21.15.6:0/1266474314 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4ec00f040 con 0x55bbdab8b0e0 2023-09-13T09:51:13.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.108+0000 7fd4da7fc700 1 -- 172.21.15.6:0/1266474314 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ec0053c0 con 0x55bbdab8b0e0 2023-09-13T09:51:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.108+0000 7fd505a62b80 1 -- 172.21.15.6:0/1266474314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 msgr2=0x55bbdab9f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9f2b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fd4ec009040 tx=0x7fd4ec007610 comp rx=0 tx=0).stop 2023-09-13T09:51:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 -- 172.21.15.6:0/1266474314 shutdown_connections 2023-09-13T09:51:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9f2b0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab89540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 --2- 172.21.15.6:0/1266474314 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8a780 0x55bbdab9e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 -- 172.21.15.6:0/1266474314 >> 172.21.15.6:0/1266474314 conn(0x55bbdaae7d00 msgr2=0x55bbdab960a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 -- 172.21.15.6:0/1266474314 shutdown_connections 2023-09-13T09:51:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 -- 172.21.15.6:0/1266474314 wait complete. 2023-09-13T09:51:13.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 -- start start 2023-09-13T09:51:13.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 Processor -- start 2023-09-13T09:51:13.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.109+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab9a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8a780 0x55bbdab9ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd505a62b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd505a62b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdab9e290 con 0x55bbdab8a780 2023-09-13T09:51:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd505a62b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdab9e400 con 0x55bbdab8b0e0 2023-09-13T09:51:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd505a62b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bbdab9e5c0 con 0x55bbdab89a80 2023-09-13T09:51:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd505a62b80 10 client.0 _ll_register_callbacks cb 0x55bbdaa77700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8a780 0x55bbdab9ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab9a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8a780 0x55bbdab9ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41316/0 (socket says 172.21.15.6:41316) 2023-09-13T09:51:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 -- 172.21.15.6:0/2848956452 learned_addr learned my addr 172.21.15.6:0/2848956452 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 -- 172.21.15.6:0/2848956452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 msgr2=0x55bbdab9a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab9a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 -- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8b0e0 msgr2=0x55bbdab9dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 -- 172.21.15.6:0/2848956452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bbda95b6b0 con 0x55bbdab8a780 2023-09-13T09:51:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f37fe700 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8a780 0x55bbdab9ad30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80c9c20 tx=0x7fd4e800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b061cf6a896c3666 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4d2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.110+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/2848956452 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e80998c0 con 0x55bbdab8a780 2023-09-13T09:51:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/2848956452 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd4e809d6f0 con 0x55bbdab8a780 2023-09-13T09:51:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd4e4003e40 con 0x55bbdab8a780 2023-09-13T09:51:13.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/2848956452 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd4e80a1930 con 0x55bbdab8a780 2023-09-13T09:51:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd505a62b80 10 client.18603 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fd4ec009d00 con 0x55bbdab8a780 2023-09-13T09:51:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/2848956452 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd4e807c020 con 0x55bbdab8a780 2023-09-13T09:51:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/2848956452 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd4e8099b90 con 0x55bbdab8a780 2023-09-13T09:51:13.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd505a62b80 10 client.18603 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd505a62b80 10 client.18603 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd505a62b80 20 client.18603 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.111+0000 7fd505a62b80 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdabfa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.112+0000 7fd505a62b80 4 client.18603 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:51:13.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.112+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55bbdaa950d0 con 0x55bbdaba31c0 2023-09-13T09:51:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.112+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdabfa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.112+0000 7fd4d2ffd700 10 client.18603 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.112+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdabfa0a0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f39dda2036009 server_cookie=4b7ac675a50d143 in_seq=0 out_seq=0 2023-09-13T09:51:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd4d2ffd700 1 -- 172.21.15.6:0/2848956452 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55bbdaa950d0 con 0x55bbdaba31c0 2023-09-13T09:51:13.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd4d2ffd700 10 client.18603 handle_command_reply: tid=0 2023-09-13T09:51:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 client.18603 shutdown 2023-09-13T09:51:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8a780 msgr2=0x55bbdab9ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8a780 0x55bbdab9ad30 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80c9c20 tx=0x7fd4e800cbd0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 shutdown_connections 2023-09-13T09:51:13.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bbdab8b0e0 0x55bbdab9dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bbdab89a80 0x55bbdab9a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55bbdaba31c0 0x55bbdabfa0a0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 --2- 172.21.15.6:0/2848956452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bbdab8a780 0x55bbdab9ad30 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 >> 172.21.15.6:0/2848956452 conn(0x55bbdaae7d00 msgr2=0x55bbdab9f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd4d2ffd700 0 client.18603 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 shutdown_connections 2023-09-13T09:51:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 1 -- 172.21.15.6:0/2848956452 wait complete. 2023-09-13T09:51:13.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.114+0000 7fd505a62b80 20 client.18603 trim_cache size 0 max 16384 2023-09-13T09:51:13.140 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:51:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:51:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "07427127-f9d7-49bf-aa38-50dec8e2b952", 2023-09-13T09:51:13.140 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:51:13.141 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:51:13.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd4dc0a0640 msgr2=0x7fd4dc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd4dc0a0640 0x7fd4dc0a2b00 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fd4e4009fd0 tx=0x7fd4e4009260 comp rx=0 tx=0).stop 2023-09-13T09:51:13.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4100eb0 msgr2=0x7fd4f41970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4100eb0 0x7fd4f41970b0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7fd4e800eb30 tx=0x7fd4e800ee40 comp rx=0 tx=0).stop 2023-09-13T09:51:13.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 shutdown_connections 2023-09-13T09:51:13.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd4f4101850 0x7fd4f419e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4f40ffcc0 0x7fd4f4196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd4dc0a0640 0x7fd4dc0a2b00 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 --2- 172.21.15.6:0/608636506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f4100eb0 0x7fd4f41970b0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 >> 172.21.15.6:0/608636506 conn(0x7fd4f40fb250 msgr2=0x7fd4f4068050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 shutdown_connections 2023-09-13T09:51:13.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.115+0000 7fd4f987d700 1 -- 172.21.15.6:0/608636506 wait complete. 2023-09-13T09:51:13.145 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:51:13.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 718962 6.61 MB/sec execute 513 sec latency 17.259 ms 2023-09-13T09:51:13.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 -- 172.21.15.6:0/328925792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4101850 msgr2=0x7f7ff4108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/328925792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4101850 0x7f7ff4108100 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7fec00b0d0 tx=0x7f7fec00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 -- 172.21.15.6:0/328925792 shutdown_connections 2023-09-13T09:51:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/328925792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4101850 0x7f7ff4108100 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/328925792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff40ffcc0 0x7f7ff41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/328925792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ff4100eb0 0x7f7ff4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 -- 172.21.15.6:0/328925792 >> 172.21.15.6:0/328925792 conn(0x7f7ff40fb250 msgr2=0x7f7ff40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 -- 172.21.15.6:0/328925792 shutdown_connections 2023-09-13T09:51:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 -- 172.21.15.6:0/328925792 wait complete. 2023-09-13T09:51:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 Processor -- start 2023-09-13T09:51:13.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 -- start start 2023-09-13T09:51:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff40ffcc0 0x7f7ff4068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4100eb0 0x7f7ff419b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ff4101850 0x7f7ff419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.291+0000 7f7ffaec3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff419e6b0 con 0x7f7ff4100eb0 2023-09-13T09:51:13.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ffaec3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff419e820 con 0x7f7ff4101850 2023-09-13T09:51:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ffaec3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff419e9e0 con 0x7f7ff40ffcc0 2023-09-13T09:51:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4100eb0 0x7f7ff419b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff8c5f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff40ffcc0 0x7f7ff4068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4100eb0 0x7f7ff419b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41330/0 (socket says 172.21.15.6:41330) 2023-09-13T09:51:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1140755862 learned_addr learned my addr 172.21.15.6:0/1140755862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff9460700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ff4101850 0x7f7ff419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1140755862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff40ffcc0 msgr2=0x7f7ff4068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff40ffcc0 0x7f7ff4068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1140755862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ff4101850 msgr2=0x7f7ff419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ff4101850 0x7f7ff419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1140755862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec009d00 con 0x7f7ff4100eb0 2023-09-13T09:51:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4100eb0 0x7f7ff419b890 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e9a0 tx=0x7f7fe000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff1ffb700 1 -- 172.21.15.6:0/1140755862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0009790 con 0x7f7ff4100eb0 2023-09-13T09:51:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff419ecc0 con 0x7f7ff4100eb0 2023-09-13T09:51:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff1ffb700 1 -- 172.21.15.6:0/1140755862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fe0010430 con 0x7f7ff4100eb0 2023-09-13T09:51:13.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.292+0000 7f7ff1ffb700 1 -- 172.21.15.6:0/1140755862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe0018680 con 0x7f7ff4100eb0 2023-09-13T09:51:13.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.293+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff419f1d0 con 0x7f7ff4100eb0 2023-09-13T09:51:13.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.295+0000 7f7ff1ffb700 1 -- 172.21.15.6:0/1140755862 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7fe00105a0 con 0x7f7ff4100eb0 2023-09-13T09:51:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.295+0000 7f7ff1ffb700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7fe40a0640 0x7f7fe40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.295+0000 7f7ff1ffb700 1 -- 172.21.15.6:0/1140755862 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7fe0014070 con 0x7f7ff4100eb0 2023-09-13T09:51:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7fe40a0640 0x7f7fe40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7fe40a0640 0x7f7fe40a2b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4100d10 tx=0x7f7fe8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 Processor -- start 2023-09-13T09:51:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 -- start start 2023-09-13T09:51:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341cb10 0x56009341cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341d470 0x56009341b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560093370780 con 0x56009341d470 2023-09-13T09:51:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009336e0a0 con 0x56009341cb10 2023-09-13T09:51:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.296+0000 7f80070a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560093369990 con 0x56009341be10 2023-09-13T09:51:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341d470 0x56009341b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341d470 0x56009341b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41338/0 (socket says 172.21.15.6:41338) 2023-09-13T09:51:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 -- 172.21.15.6:0/709030168 learned_addr learned my addr 172.21.15.6:0/709030168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341cb10 0x56009341cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff9460700 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 -- 172.21.15.6:0/709030168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 msgr2=0x56009341c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 -- 172.21.15.6:0/709030168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341cb10 msgr2=0x56009341cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341cb10 0x56009341cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 -- 172.21.15.6:0/709030168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600931e9630 con 0x56009341d470 2023-09-13T09:51:13.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341d470 0x56009341b8d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0099510 tx=0x7f7fe0098fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddbe3c2a71f0cd6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7fdeffd700 1 -- 172.21.15.6:0/709030168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00acea0 con 0x56009341d470 2023-09-13T09:51:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7fdeffd700 1 -- 172.21.15.6:0/709030168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fe009d170 con 0x56009341d470 2023-09-13T09:51:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.297+0000 7f7fdeffd700 1 -- 172.21.15.6:0/709030168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00997e0 con 0x56009341d470 2023-09-13T09:51:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 -- 172.21.15.6:0/709030168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341d470 msgr2=0x56009341b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341d470 0x56009341b8d0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0099510 tx=0x7f7fe0098fe0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 -- 172.21.15.6:0/709030168 shutdown_connections 2023-09-13T09:51:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341cb10 0x56009341cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 --2- 172.21.15.6:0/709030168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341d470 0x56009341b8d0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 -- 172.21.15.6:0/709030168 >> 172.21.15.6:0/709030168 conn(0x560093375c80 msgr2=0x560093411f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 -- 172.21.15.6:0/709030168 shutdown_connections 2023-09-13T09:51:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.298+0000 7f80070a8b80 1 -- 172.21.15.6:0/709030168 wait complete. 2023-09-13T09:51:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 -- start start 2023-09-13T09:51:13.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 Processor -- start 2023-09-13T09:51:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341be10 0x5600934253a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341cb10 0x5600934258e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x56009342c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560093307bb0 con 0x56009341be10 2023-09-13T09:51:13.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600933078b0 con 0x56009341d470 2023-09-13T09:51:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600931eb920 con 0x56009341cb10 2023-09-13T09:51:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f80070a8b80 10 client.0 _ll_register_callbacks cb 0x560093305680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f7ff8c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341be10 0x5600934253a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f7ff8c5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341be10 0x5600934253a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41342/0 (socket says 172.21.15.6:41342) 2023-09-13T09:51:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f7ff8c5f700 1 -- 172.21.15.6:0/2584622648 learned_addr learned my addr 172.21.15.6:0/2584622648 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f7ff9460700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x56009342c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.299+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341cb10 0x5600934258e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff8c5f700 1 -- 172.21.15.6:0/2584622648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341cb10 msgr2=0x5600934258e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341cb10 0x5600934258e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff8c5f700 1 -- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 msgr2=0x56009342c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x56009342c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff8c5f700 1 -- 172.21.15.6:0/2584622648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff419f1d0 con 0x56009341be10 2023-09-13T09:51:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341cb10 0x5600934258e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff9460700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x56009342c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341be10 0x5600934253a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7fe801d8f0 tx=0x7f7fe80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9391827e1e0d275 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7fd3fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7fd3fff700 1 -- 172.21.15.6:0/2584622648 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8022070 con 0x56009341be10 2023-09-13T09:51:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7fd3fff700 1 -- 172.21.15.6:0/2584622648 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7fe8004020 con 0x56009341be10 2023-09-13T09:51:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56009340a670 con 0x56009341be10 2023-09-13T09:51:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7fd3fff700 1 -- 172.21.15.6:0/2584622648 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fe80041e0 con 0x56009341be10 2023-09-13T09:51:13.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f80070a8b80 10 client.18615 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:13.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5600933817a0 con 0x56009341be10 2023-09-13T09:51:13.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.300+0000 7f7fd3fff700 1 -- 172.21.15.6:0/2584622648 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56009340a670 con 0x56009341be10 2023-09-13T09:51:13.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f7fd3fff700 1 -- 172.21.15.6:0/2584622648 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7fe800e640 con 0x56009341be10 2023-09-13T09:51:13.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f80070a8b80 10 client.18615 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:13.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f80070a8b80 10 client.18615 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:13.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f80070a8b80 20 client.18615 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:13.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560093431190 0x5600934335b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f80070a8b80 4 client.18615 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:13.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560093362970 con 0x560093431190 2023-09-13T09:51:13.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560093431190 0x5600934335b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560093431190 0x5600934335b0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f88a070a79bfb9 server_cookie=b913b3fb14ce4296 in_seq=0 out_seq=0 2023-09-13T09:51:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.301+0000 7f7fd3fff700 10 client.18615 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f7fd3fff700 1 -- 172.21.15.6:0/2584622648 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560093362970 con 0x560093431190 2023-09-13T09:51:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f7fd3fff700 10 client.18615 handle_command_reply: tid=0 2023-09-13T09:51:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 client.18615 shutdown 2023-09-13T09:51:13.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341be10 msgr2=0x5600934253a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341be10 0x5600934253a0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7fe801d8f0 tx=0x7f7fe80047c0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 shutdown_connections 2023-09-13T09:51:13.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x56009342c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560093431190 0x5600934335b0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341be10 0x5600934253a0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2584622648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341cb10 0x5600934258e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f7fd3fff700 0 client.18615 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 >> 172.21.15.6:0/2584622648 conn(0x560093375c80 msgr2=0x56009340c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 shutdown_connections 2023-09-13T09:51:13.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 1 -- 172.21.15.6:0/2584622648 wait complete. 2023-09-13T09:51:13.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.302+0000 7f80070a8b80 20 client.18615 trim_cache size 0 max 16384 2023-09-13T09:51:13.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.319+0000 7f80070a8b80 1 Processor -- start 2023-09-13T09:51:13.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.319+0000 7f80070a8b80 1 -- start start 2023-09-13T09:51:13.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x56009342c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093423240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f80070a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56009342e650 con 0x56009341cb10 2023-09-13T09:51:13.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f80070a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600934139b0 con 0x56009341d470 2023-09-13T09:51:13.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f80070a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560093420900 con 0x56009341be10 2023-09-13T09:51:13.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x56009342c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x56009342c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41352/0 (socket says 172.21.15.6:41352) 2023-09-13T09:51:13.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 -- 172.21.15.6:0/2969887010 learned_addr learned my addr 172.21.15.6:0/2969887010 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff9460700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093423240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 -- 172.21.15.6:0/2969887010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 msgr2=0x56009341b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 -- 172.21.15.6:0/2969887010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 msgr2=0x560093423240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093423240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 -- 172.21.15.6:0/2969887010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560093195de0 con 0x56009341cb10 2023-09-13T09:51:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:51:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff9460700 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093423240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x56009342c8e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0099280 tx=0x7f7fe0098fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=890c9fd113707d89 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7fdf7fe700 1 -- 172.21.15.6:0/2969887010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe007c070 con 0x56009341cb10 2023-09-13T09:51:13.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7fdf7fe700 1 -- 172.21.15.6:0/2969887010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fe00b5070 con 0x56009341cb10 2023-09-13T09:51:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.320+0000 7f7fdf7fe700 1 -- 172.21.15.6:0/2969887010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe00acea0 con 0x56009341cb10 2023-09-13T09:51:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 -- 172.21.15.6:0/2969887010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 msgr2=0x56009342c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x56009342c8e0 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0099280 tx=0x7f7fe0098fe0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 -- 172.21.15.6:0/2969887010 shutdown_connections 2023-09-13T09:51:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093423240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009341b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 --2- 172.21.15.6:0/2969887010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x56009342c8e0 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 -- 172.21.15.6:0/2969887010 >> 172.21.15.6:0/2969887010 conn(0x560093375c80 msgr2=0x56009342d210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 -- 172.21.15.6:0/2969887010 shutdown_connections 2023-09-13T09:51:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 -- 172.21.15.6:0/2969887010 wait complete. 2023-09-13T09:51:13.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.321+0000 7f80070a8b80 1 -- start start 2023-09-13T09:51:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 1 Processor -- start 2023-09-13T09:51:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009342a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x560093480f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093483590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560093483cd0 con 0x56009341cb10 2023-09-13T09:51:13.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560093483e40 con 0x56009341d470 2023-09-13T09:51:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560093484000 con 0x56009341be10 2023-09-13T09:51:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f80070a8b80 10 client.0 _ll_register_callbacks cb 0x560093305680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x560093480f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f7ff3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x560093480f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41358/0 (socket says 172.21.15.6:41358) 2023-09-13T09:51:13.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f7ff8c5f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009342a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1208353027 learned_addr learned my addr 172.21.15.6:0/1208353027 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.322+0000 7f7ff9460700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093483590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1208353027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 msgr2=0x56009342a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009342a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 msgr2=0x560093483590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093483590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff3fff700 1 -- 172.21.15.6:0/1208353027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff4108a50 con 0x56009341cb10 2023-09-13T09:51:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009342a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff9460700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093483590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:13.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7ff3fff700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x560093480f90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0099050 tx=0x7f7fe009d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecf4ecca53fbd73b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7fd3fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7fd3fff700 1 -- 172.21.15.6:0/1208353027 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe007c070 con 0x56009341cb10 2023-09-13T09:51:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7fe009d170 con 0x56009341cb10 2023-09-13T09:51:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7fd3fff700 1 -- 172.21.15.6:0/1208353027 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7fe0095040 con 0x56009341cb10 2023-09-13T09:51:13.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7fd3fff700 1 -- 172.21.15.6:0/1208353027 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fe00acea0 con 0x56009341cb10 2023-09-13T09:51:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f80070a8b80 10 client.18621 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5600931e9630 con 0x56009341cb10 2023-09-13T09:51:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7fd3fff700 1 -- 172.21.15.6:0/1208353027 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7fe009d170 con 0x56009341cb10 2023-09-13T09:51:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f7fd3fff700 1 -- 172.21.15.6:0/1208353027 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7fe00a1160 con 0x56009341cb10 2023-09-13T09:51:13.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f80070a8b80 10 client.18621 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f80070a8b80 10 client.18621 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f80070a8b80 20 client.18621 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.323+0000 7f80070a8b80 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5600934147e0 0x560093416bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f80070a8b80 4 client.18621 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:51:13.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560093323050 con 0x5600934147e0 2023-09-13T09:51:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5600934147e0 0x560093416bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f7fd3fff700 10 client.18621 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f7ff8c5f700 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5600934147e0 0x560093416bd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f5afdbec0268870 server_cookie=f5c4423778a158c6 in_seq=0 out_seq=0 2023-09-13T09:51:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f7fd3fff700 1 -- 172.21.15.6:0/1208353027 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560093323050 con 0x5600934147e0 2023-09-13T09:51:13.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f7fd3fff700 10 client.18621 handle_command_reply: tid=0 2023-09-13T09:51:13.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.324+0000 7f80070a8b80 1 client.18621 shutdown 2023-09-13T09:51:13.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 msgr2=0x560093480f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x560093480f90 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0099050 tx=0x7f7fe009d2e0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 shutdown_connections 2023-09-13T09:51:13.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56009341d470 0x560093483590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56009341be10 0x56009342a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5600934147e0 0x560093416bd0 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 --2- 172.21.15.6:0/1208353027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56009341cb10 0x560093480f90 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f7fd3fff700 0 client.18621 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:13.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 >> 172.21.15.6:0/1208353027 conn(0x560093375c80 msgr2=0x56009341fd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 shutdown_connections 2023-09-13T09:51:13.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 1 -- 172.21.15.6:0/1208353027 wait complete. 2023-09-13T09:51:13.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f80070a8b80 20 client.18621 trim_cache size 0 max 16384 2023-09-13T09:51:13.355 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:51:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:51:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:51:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "07427127-f9d7-49bf-aa38-50dec8e2b952": { 2023-09-13T09:51:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:51:13.356 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "07427127-f9d7-49bf-aa38-50dec8e2b952", 2023-09-13T09:51:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:51:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:51:13.357 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:51:13.357 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:51:13.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7fe40a0640 msgr2=0x7f7fe40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7fe40a0640 0x7f7fe40a2b00 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4100d10 tx=0x7f7fe8009260 comp rx=0 tx=0).stop 2023-09-13T09:51:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4100eb0 msgr2=0x7f7ff419b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.325+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4100eb0 0x7f7ff419b890 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e9a0 tx=0x7f7fe000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 shutdown_connections 2023-09-13T09:51:13.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7ff4101850 0x7f7ff419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff40ffcc0 0x7f7ff4068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7fe40a0640 0x7f7fe40a2b00 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 --2- 172.21.15.6:0/1140755862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff4100eb0 0x7f7ff419b890 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 >> 172.21.15.6:0/1140755862 conn(0x7f7ff40fb250 msgr2=0x7f7ff40fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 shutdown_connections 2023-09-13T09:51:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:13.326+0000 7f7ffaec3700 1 -- 172.21.15.6:0/1140755862 wait complete. 2023-09-13T09:51:13.361 INFO:tasks.cephfs.filesystem:scrub status for tag:07427127-f9d7-49bf-aa38-50dec8e2b952 - {'path': '/', 'tag': '07427127-f9d7-49bf-aa38-50dec8e2b952', 'options': 'recursive,force'} 2023-09-13T09:51:14.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 720995 6.62 MB/sec execute 514 sec latency 45.737 ms 2023-09-13T09:51:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: pgmap v651: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 2.2 MiB/s wr, 254 op/s 2023-09-13T09:51:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: pgmap v651: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 2.2 MiB/s wr, 254 op/s 2023-09-13T09:51:14.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:14.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:14.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:14.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:14.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:14.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: pgmap v651: 97 pgs: 97 active+clean; 279 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 682 KiB/s rd, 2.2 MiB/s wr, 254 op/s 2023-09-13T09:51:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:14.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:14.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 722040 6.62 MB/sec execute 515 sec latency 14.750 ms 2023-09-13T09:51:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:51:15.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:15.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:15.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:51:15.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:15.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:15.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:15.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:15.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:51:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:15.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:15.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:15.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:16.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 724398 6.63 MB/sec execute 516 sec latency 30.965 ms 2023-09-13T09:51:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:15 smithi006 ceph-mon[98665]: pgmap v652: 97 pgs: 97 active+clean; 281 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.1 MiB/s wr, 264 op/s 2023-09-13T09:51:16.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:15 smithi053 ceph-mon[102373]: pgmap v652: 97 pgs: 97 active+clean; 281 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.1 MiB/s wr, 264 op/s 2023-09-13T09:51:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:15 smithi131 ceph-mon[102785]: pgmap v652: 97 pgs: 97 active+clean; 281 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 2.1 MiB/s wr, 264 op/s 2023-09-13T09:51:17.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 725348 6.63 MB/sec execute 517 sec latency 18.223 ms 2023-09-13T09:51:18.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 727753 6.64 MB/sec execute 518 sec latency 11.780 ms 2023-09-13T09:51:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:17 smithi006 ceph-mon[98665]: pgmap v653: 97 pgs: 97 active+clean; 282 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 2.0 MiB/s wr, 245 op/s 2023-09-13T09:51:18.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:17 smithi053 ceph-mon[102373]: pgmap v653: 97 pgs: 97 active+clean; 282 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 2.0 MiB/s wr, 245 op/s 2023-09-13T09:51:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:17 smithi131 ceph-mon[102785]: pgmap v653: 97 pgs: 97 active+clean; 282 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 611 KiB/s rd, 2.0 MiB/s wr, 245 op/s 2023-09-13T09:51:19.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 728686 6.64 MB/sec execute 519 sec latency 26.517 ms 2023-09-13T09:51:20.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 730934 6.65 MB/sec execute 520 sec latency 15.987 ms 2023-09-13T09:51:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:19 smithi006 ceph-mon[98665]: pgmap v654: 97 pgs: 97 active+clean; 283 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 2.0 MiB/s wr, 259 op/s 2023-09-13T09:51:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:19 smithi053 ceph-mon[102373]: pgmap v654: 97 pgs: 97 active+clean; 283 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 2.0 MiB/s wr, 259 op/s 2023-09-13T09:51:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:19 smithi131 ceph-mon[102785]: pgmap v654: 97 pgs: 97 active+clean; 283 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 785 KiB/s rd, 2.0 MiB/s wr, 259 op/s 2023-09-13T09:51:21.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 731973 6.65 MB/sec execute 521 sec latency 43.492 ms 2023-09-13T09:51:22.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 733993 6.65 MB/sec execute 522 sec latency 19.440 ms 2023-09-13T09:51:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:21 smithi006 ceph-mon[98665]: pgmap v655: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.9 MiB/s wr, 203 op/s 2023-09-13T09:51:22.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:21 smithi053 ceph-mon[102373]: pgmap v655: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.9 MiB/s wr, 203 op/s 2023-09-13T09:51:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:21 smithi131 ceph-mon[102785]: pgmap v655: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 615 KiB/s rd, 1.9 MiB/s wr, 203 op/s 2023-09-13T09:51:23.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 735448 6.66 MB/sec execute 523 sec latency 15.791 ms 2023-09-13T09:51:24.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 737439 6.66 MB/sec execute 524 sec latency 20.072 ms 2023-09-13T09:51:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:23 smithi006 ceph-mon[98665]: pgmap v656: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2023-09-13T09:51:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:23 smithi053 ceph-mon[102373]: pgmap v656: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2023-09-13T09:51:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:23 smithi131 ceph-mon[102785]: pgmap v656: 97 pgs: 97 active+clean; 284 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2023-09-13T09:51:25.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 738941 6.67 MB/sec execute 525 sec latency 17.031 ms 2023-09-13T09:51:25.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:51:25.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:51:25.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:51:25.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:24 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:51:25.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:51:25.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:51:25.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:51:25.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:24 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:51:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:51:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:51:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:51:25.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:24 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:51:26.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 740481 6.67 MB/sec execute 526 sec latency 20.636 ms 2023-09-13T09:51:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:25 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:51:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:25 smithi006 ceph-mon[98665]: pgmap v657: 97 pgs: 97 active+clean; 286 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 2.2 MiB/s wr, 262 op/s 2023-09-13T09:51:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:25 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:51:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:25 smithi053 ceph-mon[102373]: pgmap v657: 97 pgs: 97 active+clean; 286 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 2.2 MiB/s wr, 262 op/s 2023-09-13T09:51:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:25 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:51:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:25 smithi131 ceph-mon[102785]: pgmap v657: 97 pgs: 97 active+clean; 286 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 797 KiB/s rd, 2.2 MiB/s wr, 262 op/s 2023-09-13T09:51:27.183 INFO:tasks.workunit.client.0.smithi006.stdout: 1 742368 6.68 MB/sec execute 527 sec latency 20.133 ms 2023-09-13T09:51:28.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 743553 6.68 MB/sec execute 528 sec latency 16.842 ms 2023-09-13T09:51:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:27 smithi006 ceph-mon[98665]: pgmap v658: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 2.2 MiB/s wr, 278 op/s 2023-09-13T09:51:28.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:27 smithi053 ceph-mon[102373]: pgmap v658: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 2.2 MiB/s wr, 278 op/s 2023-09-13T09:51:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:27 smithi131 ceph-mon[102785]: pgmap v658: 97 pgs: 97 active+clean; 288 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 750 KiB/s rd, 2.2 MiB/s wr, 278 op/s 2023-09-13T09:51:29.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 745812 6.69 MB/sec execute 529 sec latency 11.982 ms 2023-09-13T09:51:30.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 746655 6.68 MB/sec execute 530 sec latency 81.841 ms 2023-09-13T09:51:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:29 smithi006 ceph-mon[98665]: pgmap v659: 97 pgs: 97 active+clean; 289 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 2.1 MiB/s wr, 251 op/s 2023-09-13T09:51:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:29 smithi053 ceph-mon[102373]: pgmap v659: 97 pgs: 97 active+clean; 289 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 2.1 MiB/s wr, 251 op/s 2023-09-13T09:51:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:29 smithi131 ceph-mon[102785]: pgmap v659: 97 pgs: 97 active+clean; 289 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 721 KiB/s rd, 2.1 MiB/s wr, 251 op/s 2023-09-13T09:51:31.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 748979 6.69 MB/sec execute 531 sec latency 13.457 ms 2023-09-13T09:51:32.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 749822 6.69 MB/sec execute 532 sec latency 42.892 ms 2023-09-13T09:51:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:31 smithi006 ceph-mon[98665]: pgmap v660: 97 pgs: 97 active+clean; 289 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-13T09:51:32.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:31 smithi053 ceph-mon[102373]: pgmap v660: 97 pgs: 97 active+clean; 289 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-13T09:51:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:31 smithi131 ceph-mon[102785]: pgmap v660: 97 pgs: 97 active+clean; 289 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 576 KiB/s rd, 2.1 MiB/s wr, 239 op/s 2023-09-13T09:51:33.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 751780 6.69 MB/sec execute 533 sec latency 19.354 ms 2023-09-13T09:51:33.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:51:33.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:51:33.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:51:33.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:32 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:51:33.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:51:33.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:51:33.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:51:33.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:32 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:51:33.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:51:33.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:51:33.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:51:33.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:32 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:51:34.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 753174 6.70 MB/sec execute 534 sec latency 17.827 ms 2023-09-13T09:51:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:33 smithi006 ceph-mon[98665]: pgmap v661: 97 pgs: 97 active+clean; 290 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 2.4 MiB/s wr, 283 op/s 2023-09-13T09:51:34.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:33 smithi053 ceph-mon[102373]: pgmap v661: 97 pgs: 97 active+clean; 290 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 2.4 MiB/s wr, 283 op/s 2023-09-13T09:51:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:33 smithi131 ceph-mon[102785]: pgmap v661: 97 pgs: 97 active+clean; 290 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 2.4 MiB/s wr, 283 op/s 2023-09-13T09:51:35.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 755161 6.70 MB/sec execute 535 sec latency 11.739 ms 2023-09-13T09:51:36.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 756613 6.71 MB/sec execute 536 sec latency 34.992 ms 2023-09-13T09:51:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:35 smithi006 ceph-mon[98665]: pgmap v662: 97 pgs: 97 active+clean; 292 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 2.4 MiB/s wr, 263 op/s 2023-09-13T09:51:36.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:35 smithi053 ceph-mon[102373]: pgmap v662: 97 pgs: 97 active+clean; 292 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 2.4 MiB/s wr, 263 op/s 2023-09-13T09:51:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:35 smithi131 ceph-mon[102785]: pgmap v662: 97 pgs: 97 active+clean; 292 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 2.4 MiB/s wr, 263 op/s 2023-09-13T09:51:37.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 757847 6.71 MB/sec execute 537 sec latency 33.296 ms 2023-09-13T09:51:38.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 760014 6.72 MB/sec execute 538 sec latency 14.829 ms 2023-09-13T09:51:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:37 smithi006 ceph-mon[98665]: pgmap v663: 97 pgs: 97 active+clean; 294 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:51:38.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:37 smithi053 ceph-mon[102373]: pgmap v663: 97 pgs: 97 active+clean; 294 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:51:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:37 smithi131 ceph-mon[102785]: pgmap v663: 97 pgs: 97 active+clean; 294 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 788 KiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:51:39.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 761054 6.71 MB/sec execute 539 sec latency 12.469 ms 2023-09-13T09:51:40.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 763228 6.72 MB/sec execute 540 sec latency 50.620 ms 2023-09-13T09:51:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:39 smithi006 ceph-mon[98665]: pgmap v664: 97 pgs: 97 active+clean; 294 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2023-09-13T09:51:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:39 smithi053 ceph-mon[102373]: pgmap v664: 97 pgs: 97 active+clean; 294 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2023-09-13T09:51:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:39 smithi131 ceph-mon[102785]: pgmap v664: 97 pgs: 97 active+clean; 294 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 754 KiB/s rd, 2.3 MiB/s wr, 241 op/s 2023-09-13T09:51:41.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 764164 6.72 MB/sec execute 541 sec latency 32.516 ms 2023-09-13T09:51:42.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 766203 6.73 MB/sec execute 542 sec latency 59.184 ms 2023-09-13T09:51:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:41 smithi006 ceph-mon[98665]: pgmap v665: 97 pgs: 97 active+clean; 295 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.2 MiB/s wr, 233 op/s 2023-09-13T09:51:42.267 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:41 smithi053 ceph-mon[102373]: pgmap v665: 97 pgs: 97 active+clean; 295 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.2 MiB/s wr, 233 op/s 2023-09-13T09:51:42.268 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:41 smithi131 ceph-mon[102785]: pgmap v665: 97 pgs: 97 active+clean; 295 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 2.2 MiB/s wr, 233 op/s 2023-09-13T09:51:43.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 767403 6.73 MB/sec execute 543 sec latency 21.558 ms 2023-09-13T09:51:43.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:51:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 -- 172.21.15.6:0/76264741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4560101250 msgr2=0x7f4560101670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 --2- 172.21.15.6:0/76264741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4560101250 0x7f4560101670 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f4550009990 tx=0x7f4550009ca0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 -- 172.21.15.6:0/76264741 shutdown_connections 2023-09-13T09:51:43.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 --2- 172.21.15.6:0/76264741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 0x7f45601081e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 --2- 172.21.15.6:0/76264741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4560101250 0x7f4560101670 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 --2- 172.21.15.6:0/76264741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45600fff80 0x7f45601003e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 -- 172.21.15.6:0/76264741 >> 172.21.15.6:0/76264741 conn(0x7f45600fa9b0 msgr2=0x7f45600fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 -- 172.21.15.6:0/76264741 shutdown_connections 2023-09-13T09:51:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.502+0000 7f4565257700 1 -- 172.21.15.6:0/76264741 wait complete. 2023-09-13T09:51:43.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 Processor -- start 2023-09-13T09:51:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 -- start start 2023-09-13T09:51:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45600fff80 0x7f45601959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 0x7f4560195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4560101250 0x7f456019cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456019d570 con 0x7f45600fff80 2023-09-13T09:51:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456019d6b0 con 0x7f4560100920 2023-09-13T09:51:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.503+0000 7f4565257700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456019d840 con 0x7f4560101250 2023-09-13T09:51:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45600fff80 0x7f45601959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 0x7f4560195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 0x7f4560195f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34900/0 (socket says 172.21.15.6:34900) 2023-09-13T09:51:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45600fff80 0x7f45601959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41374/0 (socket says 172.21.15.6:41374) 2023-09-13T09:51:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455e59c700 1 -- 172.21.15.6:0/896357850 learned_addr learned my addr 172.21.15.6:0/896357850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455f59e700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4560101250 0x7f456019cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 -- 172.21.15.6:0/896357850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4560101250 msgr2=0x7f456019cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4560101250 0x7f456019cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 -- 172.21.15.6:0/896357850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 msgr2=0x7f4560195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 0x7f4560195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 -- 172.21.15.6:0/896357850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45500095f0 con 0x7f45600fff80 2023-09-13T09:51:43.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455e59c700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 0x7f4560195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f455ed9d700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45600fff80 0x7f45601959f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f45500098e0 tx=0x7f4550004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f4547fff700 1 -- 172.21.15.6:0/896357850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455001d070 con 0x7f45600fff80 2023-09-13T09:51:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45600fee70 con 0x7f45600fff80 2023-09-13T09:51:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f4547fff700 1 -- 172.21.15.6:0/896357850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f45500054e0 con 0x7f45600fff80 2023-09-13T09:51:43.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.504+0000 7f4547fff700 1 -- 172.21.15.6:0/896357850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4550004bd0 con 0x7f45600fff80 2023-09-13T09:51:43.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.505+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45600ff370 con 0x7f45600fff80 2023-09-13T09:51:43.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.507+0000 7f4547fff700 1 -- 172.21.15.6:0/896357850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f455000fb90 con 0x7f45600fff80 2023-09-13T09:51:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.507+0000 7f4547fff700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45480a0640 0x7f45480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.507+0000 7f455e59c700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45480a0640 0x7f45480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.507+0000 7f4547fff700 1 -- 172.21.15.6:0/896357850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f45500cce50 con 0x7f45600fff80 2023-09-13T09:51:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455e59c700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45480a0640 0x7f45480a2b00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4554009570 tx=0x7f455400d650 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 Processor -- start 2023-09-13T09:51:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 -- start start 2023-09-13T09:51:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb671b10 0x55fccb671f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb6708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb670e10 0x55fccb671270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb5c5780 con 0x55fccb670e10 2023-09-13T09:51:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb5c30a0 con 0x55fccb672470 2023-09-13T09:51:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f457143cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb5be990 con 0x55fccb671b10 2023-09-13T09:51:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb670e10 0x55fccb671270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb671b10 0x55fccb671f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb6708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb670e10 0x55fccb671270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41386/0 (socket says 172.21.15.6:41386) 2023-09-13T09:51:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455f59e700 1 -- 172.21.15.6:0/1269985268 learned_addr learned my addr 172.21.15.6:0/1269985268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb6708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34908/0 (socket says 172.21.15.6:34908) 2023-09-13T09:51:43.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.508+0000 7f455ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb671b10 0x55fccb671f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44436/0 (socket says 172.21.15.6:44436) 2023-09-13T09:51:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f455f59e700 1 -- 172.21.15.6:0/1269985268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb671b10 msgr2=0x55fccb671f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f455f59e700 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb671b10 0x55fccb671f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f455f59e700 1 -- 172.21.15.6:0/1269985268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 msgr2=0x55fccb6708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f455f59e700 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb6708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f455f59e700 1 -- 172.21.15.6:0/1269985268 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fccb43e630 con 0x55fccb670e10 2023-09-13T09:51:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f455ed9d700 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb671b10 0x55fccb671f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f455f59e700 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb670e10 0x55fccb671270 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4558011680 tx=0x7f4558009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f8075d4f76fc930 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f45457fa700 1 -- 172.21.15.6:0/1269985268 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455800e040 con 0x55fccb670e10 2023-09-13T09:51:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f45457fa700 1 -- 172.21.15.6:0/1269985268 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f455800f040 con 0x55fccb670e10 2023-09-13T09:51:43.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.509+0000 7f45457fa700 1 -- 172.21.15.6:0/1269985268 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45580048c0 con 0x55fccb670e10 2023-09-13T09:51:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 -- 172.21.15.6:0/1269985268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb670e10 msgr2=0x55fccb671270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb670e10 0x55fccb671270 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f4558011680 tx=0x7f4558009920 comp rx=0 tx=0).stop 2023-09-13T09:51:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 -- 172.21.15.6:0/1269985268 shutdown_connections 2023-09-13T09:51:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb670e10 0x55fccb671270 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb671b10 0x55fccb671f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 --2- 172.21.15.6:0/1269985268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb6708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 -- 172.21.15.6:0/1269985268 >> 172.21.15.6:0/1269985268 conn(0x55fccb5cac80 msgr2=0x55fccb666f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 -- 172.21.15.6:0/1269985268 shutdown_connections 2023-09-13T09:51:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 -- 172.21.15.6:0/1269985268 wait complete. 2023-09-13T09:51:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 -- start start 2023-09-13T09:51:43.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.510+0000 7f457143cb80 1 Processor -- start 2023-09-13T09:51:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f457143cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f457143cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f457143cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb681890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f457143cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb55cbb0 con 0x55fccb671b10 2023-09-13T09:51:43.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f457143cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb55c8b0 con 0x55fccb670e10 2023-09-13T09:51:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f457143cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb440920 con 0x55fccb672470 2023-09-13T09:51:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f457143cb80 10 client.0 _ll_register_callbacks cb 0x55fccb55a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41390/0 (socket says 172.21.15.6:41390) 2023-09-13T09:51:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455e59c700 1 -- 172.21.15.6:0/3995477656 learned_addr learned my addr 172.21.15.6:0/3995477656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455f59e700 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb681890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455ed9d700 1 -- 172.21.15.6:0/3995477656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 msgr2=0x55fccb681890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455ed9d700 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb681890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455ed9d700 1 -- 172.21.15.6:0/3995477656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 msgr2=0x55fccb67a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455ed9d700 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455ed9d700 1 -- 172.21.15.6:0/3995477656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4558011330 con 0x55fccb670e10 2023-09-13T09:51:43.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455e59c700 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:43.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f455ed9d700 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67a310 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4550009990 tx=0x7f4550009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78c38b4178ca898d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f4542ff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:51:43.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.511+0000 7f4542ff5700 1 -- 172.21.15.6:0/3995477656 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455009a620 con 0x55fccb670e10 2023-09-13T09:51:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f4542ff5700 1 -- 172.21.15.6:0/3995477656 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f45500a0040 con 0x55fccb670e10 2023-09-13T09:51:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fccb65f670 con 0x55fccb670e10 2023-09-13T09:51:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f4542ff5700 1 -- 172.21.15.6:0/3995477656 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f455009e450 con 0x55fccb670e10 2023-09-13T09:51:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 10 client.28025 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:43.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fccb5d67a0 con 0x55fccb670e10 2023-09-13T09:51:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f4542ff5700 1 -- 172.21.15.6:0/3995477656 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fccb65f670 con 0x55fccb670e10 2023-09-13T09:51:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f4542ff5700 1 -- 172.21.15.6:0/3995477656 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4550099b10 con 0x55fccb670e10 2023-09-13T09:51:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 10 client.28025 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 10 client.28025 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:43.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 20 client.28025 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb685cd0 0x55fccb6880f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 4 client.28025 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fccb5b7970 con 0x55fccb685cd0 2023-09-13T09:51:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.512+0000 7f455e59c700 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb685cd0 0x55fccb6880f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.513+0000 7f455e59c700 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb685cd0 0x55fccb6880f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de85468d85a44224 server_cookie=a32bfdd62d9e966c in_seq=0 out_seq=0 2023-09-13T09:51:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.513+0000 7f4542ff5700 10 client.28025 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.513+0000 7f4542ff5700 1 -- 172.21.15.6:0/3995477656 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fccb5b7970 con 0x55fccb685cd0 2023-09-13T09:51:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.513+0000 7f4542ff5700 10 client.28025 handle_command_reply: tid=0 2023-09-13T09:51:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.513+0000 7f457143cb80 1 client.28025 shutdown 2023-09-13T09:51:43.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 msgr2=0x55fccb67a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67a310 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4550009990 tx=0x7f4550009ca0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 shutdown_connections 2023-09-13T09:51:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb681890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67a310 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb685cd0 0x55fccb6880f0 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 --2- 172.21.15.6:0/3995477656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f4542ff5700 0 client.28025 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 >> 172.21.15.6:0/3995477656 conn(0x55fccb5cac80 msgr2=0x55fccb666ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 shutdown_connections 2023-09-13T09:51:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 1 -- 172.21.15.6:0/3995477656 wait complete. 2023-09-13T09:51:43.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.514+0000 7f457143cb80 20 client.28025 trim_cache size 0 max 16384 2023-09-13T09:51:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.531+0000 7f457143cb80 1 Processor -- start 2023-09-13T09:51:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f457143cb80 1 -- start start 2023-09-13T09:51:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f457143cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb670e10 0x55fccb678ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f457143cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb681850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f457143cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb682180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f457143cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb6689f0 con 0x55fccb671b10 2023-09-13T09:51:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f457143cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb6638e0 con 0x55fccb672470 2023-09-13T09:51:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f457143cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb67b490 con 0x55fccb670e10 2023-09-13T09:51:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb681850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb681850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41398/0 (socket says 172.21.15.6:41398) 2023-09-13T09:51:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 -- 172.21.15.6:0/1207991431 learned_addr learned my addr 172.21.15.6:0/1207991431 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455f59e700 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb682180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455ed9d700 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb670e10 0x55fccb678ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 -- 172.21.15.6:0/1207991431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb670e10 msgr2=0x55fccb678ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb670e10 0x55fccb678ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 -- 172.21.15.6:0/1207991431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 msgr2=0x55fccb682180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb682180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 -- 172.21.15.6:0/1207991431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fccb3eade0 con 0x55fccb671b10 2023-09-13T09:51:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.532+0000 7f455e59c700 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb681850 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x55fccb688a00 tx=0x7f4554015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45ff572be5a990c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f4545ffb700 1 -- 172.21.15.6:0/1207991431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455401f030 con 0x55fccb671b10 2023-09-13T09:51:43.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f4545ffb700 1 -- 172.21.15.6:0/1207991431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4554020040 con 0x55fccb671b10 2023-09-13T09:51:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f4545ffb700 1 -- 172.21.15.6:0/1207991431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45540173c0 con 0x55fccb671b10 2023-09-13T09:51:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 -- 172.21.15.6:0/1207991431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 msgr2=0x55fccb681850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb681850 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x55fccb688a00 tx=0x7f4554015000 comp rx=0 tx=0).stop 2023-09-13T09:51:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 -- 172.21.15.6:0/1207991431 shutdown_connections 2023-09-13T09:51:43.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb672470 0x55fccb682180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb670e10 0x55fccb678ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 --2- 172.21.15.6:0/1207991431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb681850 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 -- 172.21.15.6:0/1207991431 >> 172.21.15.6:0/1207991431 conn(0x55fccb5cac80 msgr2=0x55fccb666ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 -- 172.21.15.6:0/1207991431 shutdown_connections 2023-09-13T09:51:43.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.533+0000 7f457143cb80 1 -- 172.21.15.6:0/1207991431 wait complete. 2023-09-13T09:51:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 -- start start 2023-09-13T09:51:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 Processor -- start 2023-09-13T09:51:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb680d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb6812d0 con 0x55fccb671b10 2023-09-13T09:51:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb681440 con 0x55fccb670e10 2023-09-13T09:51:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fccb681600 con 0x55fccb672470 2023-09-13T09:51:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f457143cb80 10 client.0 _ll_register_callbacks cb 0x55fccb55a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41404/0 (socket says 172.21.15.6:41404) 2023-09-13T09:51:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 -- 172.21.15.6:0/1447380213 learned_addr learned my addr 172.21.15.6:0/1447380213 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455f59e700 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb680d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 -- 172.21.15.6:0/1447380213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 msgr2=0x55fccb680d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb680d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 -- 172.21.15.6:0/1447380213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 msgr2=0x55fccb67d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.534+0000 7f455e59c700 1 -- 172.21.15.6:0/1447380213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4554019b20 con 0x55fccb671b10 2023-09-13T09:51:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f455e59c700 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67dd70 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4554009350 tx=0x7f4554004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6557701109d4538 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f4542ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:43.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f4542ff5700 1 -- 172.21.15.6:0/1447380213 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455401f050 con 0x55fccb671b10 2023-09-13T09:51:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f4542ff5700 1 -- 172.21.15.6:0/1447380213 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4554027cf0 con 0x55fccb671b10 2023-09-13T09:51:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f455800f040 con 0x55fccb671b10 2023-09-13T09:51:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f4542ff5700 1 -- 172.21.15.6:0/1447380213 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f455402aae0 con 0x55fccb671b10 2023-09-13T09:51:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 10 client.18639 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:43.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fccb3d3c60 con 0x55fccb671b10 2023-09-13T09:51:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f4542ff5700 1 -- 172.21.15.6:0/1447380213 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f455800f040 con 0x55fccb671b10 2023-09-13T09:51:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f4542ff5700 1 -- 172.21.15.6:0/1447380213 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4554030020 con 0x55fccb671b10 2023-09-13T09:51:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 10 client.18639 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 10 client.18639 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 20 client.18639 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:43.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb6dab00 0x55fccb6dcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 4 client.18639 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:51:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fccb578050 con 0x55fccb6dab00 2023-09-13T09:51:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.535+0000 7f455ed9d700 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb6dab00 0x55fccb6dcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f4542ff5700 10 client.18639 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:43.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f455ed9d700 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb6dab00 0x55fccb6dcef0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f33d3e6ea97a78 server_cookie=acdc41a12d431a0a in_seq=0 out_seq=0 2023-09-13T09:51:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f4542ff5700 1 -- 172.21.15.6:0/1447380213 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fccb578050 con 0x55fccb6dab00 2023-09-13T09:51:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f4542ff5700 10 client.18639 handle_command_reply: tid=0 2023-09-13T09:51:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 client.18639 shutdown 2023-09-13T09:51:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 msgr2=0x55fccb67dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67dd70 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4554009350 tx=0x7f4554004750 comp rx=0 tx=0).stop 2023-09-13T09:51:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 shutdown_connections 2023-09-13T09:51:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fccb672470 0x55fccb680d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fccb670e10 0x55fccb67d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fccb6dab00 0x55fccb6dcef0 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 --2- 172.21.15.6:0/1447380213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fccb671b10 0x55fccb67dd70 secure :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f4554009350 tx=0x7f4554004750 comp rx=0 tx=0).stop 2023-09-13T09:51:43.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f4542ff5700 0 client.18639 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 >> 172.21.15.6:0/1447380213 conn(0x55fccb5cac80 msgr2=0x55fccb682180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 shutdown_connections 2023-09-13T09:51:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.536+0000 7f457143cb80 1 -- 172.21.15.6:0/1447380213 wait complete. 2023-09-13T09:51:43.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f457143cb80 20 client.18639 trim_cache size 0 max 16384 2023-09-13T09:51:43.560 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:51:43.560 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:51:43.560 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:51:43.560 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:51:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45480a0640 msgr2=0x7f45480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45480a0640 0x7f45480a2b00 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f4554009570 tx=0x7f455400d650 comp rx=0 tx=0).stop 2023-09-13T09:51:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45600fff80 msgr2=0x7f45601959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45600fff80 0x7f45601959f0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f45500098e0 tx=0x7f4550004730 comp rx=0 tx=0).stop 2023-09-13T09:51:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 shutdown_connections 2023-09-13T09:51:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4560101250 0x7f456019cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45480a0640 0x7f45480a2b00 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45600fff80 0x7f45601959f0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 --2- 172.21.15.6:0/896357850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4560100920 0x7f4560195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 >> 172.21.15.6:0/896357850 conn(0x7f45600fa9b0 msgr2=0x7f45601044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 shutdown_connections 2023-09-13T09:51:43.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.537+0000 7f4565257700 1 -- 172.21.15.6:0/896357850 wait complete. 2023-09-13T09:51:43.564 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:51:43.565 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:51:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 -- 172.21.15.6:0/3358013290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e41041a0 msgr2=0x7fa6e4106590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3358013290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e41041a0 0x7fa6e4106590 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7fa6d4009990 tx=0x7fa6d4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 -- 172.21.15.6:0/3358013290 shutdown_connections 2023-09-13T09:51:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3358013290 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6e4106ad0 0x7fa6e4108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3358013290 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e4101870 0x7fa6e4103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3358013290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e41041a0 0x7fa6e4106590 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 -- 172.21.15.6:0/3358013290 >> 172.21.15.6:0/3358013290 conn(0x7fa6e40fb220 msgr2=0x7fa6e40fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.695+0000 7fa6eb732700 1 -- 172.21.15.6:0/3358013290 shutdown_connections 2023-09-13T09:51:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 -- 172.21.15.6:0/3358013290 wait complete. 2023-09-13T09:51:43.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 Processor -- start 2023-09-13T09:51:43.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 -- start start 2023-09-13T09:51:43.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e4101870 0x7fa6e41011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6e41041a0 0x7fa6e40ff820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e4106ad0 0x7fa6e40ffd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4100500 con 0x7fa6e4101870 2023-09-13T09:51:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e4100670 con 0x7fa6e41041a0 2023-09-13T09:51:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.696+0000 7fa6eb732700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6e41a0a90 con 0x7fa6e4106ad0 2023-09-13T09:51:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e94ce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e4101870 0x7fa6e41011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e8ccd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6e41041a0 0x7fa6e40ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e9ccf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e4106ad0 0x7fa6e40ffd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e8ccd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6e41041a0 0x7fa6e40ff820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34942/0 (socket says 172.21.15.6:34942) 2023-09-13T09:51:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e8ccd700 1 -- 172.21.15.6:0/3514177237 learned_addr learned my addr 172.21.15.6:0/3514177237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e94ce700 1 -- 172.21.15.6:0/3514177237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e4106ad0 msgr2=0x7fa6e40ffd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e94ce700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e4106ad0 0x7fa6e40ffd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e94ce700 1 -- 172.21.15.6:0/3514177237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6e41041a0 msgr2=0x7fa6e40ff820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e94ce700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6e41041a0 0x7fa6e40ff820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e94ce700 1 -- 172.21.15.6:0/3514177237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6d40095f0 con 0x7fa6e4101870 2023-09-13T09:51:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6e94ce700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e4101870 0x7fa6e41011e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000e9f0 tx=0x7fa6e000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6da7fc700 1 -- 172.21.15.6:0/3514177237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e000c9c0 con 0x7fa6e4101870 2023-09-13T09:51:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6e41a0d70 con 0x7fa6e4101870 2023-09-13T09:51:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6da7fc700 1 -- 172.21.15.6:0/3514177237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa6e0010430 con 0x7fa6e4101870 2023-09-13T09:51:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6da7fc700 1 -- 172.21.15.6:0/3514177237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6e0018680 con 0x7fa6e4101870 2023-09-13T09:51:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.697+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6e41a11d0 con 0x7fa6e4101870 2023-09-13T09:51:43.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.698+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6e40fcda0 con 0x7fa6e4101870 2023-09-13T09:51:43.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.699+0000 7fa6da7fc700 1 -- 172.21.15.6:0/3514177237 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa6e0010860 con 0x7fa6e4101870 2023-09-13T09:51:43.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.700+0000 7fa6da7fc700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6d00a0640 0x7fa6d00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.700+0000 7fa6da7fc700 1 -- 172.21.15.6:0/3514177237 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa6e0014070 con 0x7fa6e4101870 2023-09-13T09:51:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.700+0000 7fa6e8ccd700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6d00a0640 0x7fa6d00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.700+0000 7fa6e8ccd700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6d00a0640 0x7fa6d00a2b00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400b2e0 tx=0x7fa6d4005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:43.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.703+0000 7fa6da7fc700 1 -- 172.21.15.6:0/3514177237 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa6e00959e0 con 0x7fa6e4101870 2023-09-13T09:51:43.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.960+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa6e410c7f0 con 0x7fa6e4101870 2023-09-13T09:51:43.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.961+0000 7fa6da7fc700 1 -- 172.21.15.6:0/3514177237 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fa6e0099000 con 0x7fa6e4101870 2023-09-13T09:51:43.962 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:51:43.965 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:51:43.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.962+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6d00a0640 msgr2=0x7fa6d00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.962+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6d00a0640 0x7fa6d00a2b00 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fa6d400b2e0 tx=0x7fa6d4005960 comp rx=0 tx=0).stop 2023-09-13T09:51:43.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.962+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e4101870 msgr2=0x7fa6e41011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:43.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.962+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e4101870 0x7fa6e41011e0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7fa6e000e9f0 tx=0x7fa6e000ed00 comp rx=0 tx=0).stop 2023-09-13T09:51:43.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 shutdown_connections 2023-09-13T09:51:43.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6e4106ad0 0x7fa6e40ffd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa6d00a0640 0x7fa6d00a2b00 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6e4101870 0x7fa6e41011e0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 --2- 172.21.15.6:0/3514177237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa6e41041a0 0x7fa6e40ff820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:43.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 >> 172.21.15.6:0/3514177237 conn(0x7fa6e40fb220 msgr2=0x7fa6e41024e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:43.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 shutdown_connections 2023-09-13T09:51:43.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:43.963+0000 7fa6eb732700 1 -- 172.21.15.6:0/3514177237 wait complete. 2023-09-13T09:51:43.968 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:51:43.978 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:51:44.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 -- 172.21.15.6:0/2691764057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c102950 msgr2=0x7f253c109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 --2- 172.21.15.6:0/2691764057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c102950 0x7f253c109200 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f253400b0d0 tx=0x7f253400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 -- 172.21.15.6:0/2691764057 shutdown_connections 2023-09-13T09:51:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 --2- 172.21.15.6:0/2691764057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c102950 0x7f253c109200 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 --2- 172.21.15.6:0/2691764057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f253c100dc0 0x7f253c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 --2- 172.21.15.6:0/2691764057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 0x7f253c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 -- 172.21.15.6:0/2691764057 >> 172.21.15.6:0/2691764057 conn(0x7f253c0fc330 msgr2=0x7f253c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 -- 172.21.15.6:0/2691764057 shutdown_connections 2023-09-13T09:51:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 -- 172.21.15.6:0/2691764057 wait complete. 2023-09-13T09:51:44.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 Processor -- start 2023-09-13T09:51:44.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.109+0000 7f2542237700 1 -- start start 2023-09-13T09:51:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2542237700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c100dc0 0x7f253c074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2542237700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 0x7f253c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2542237700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f253c102950 0x7f253c0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2542237700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c073d80 con 0x7f253c100dc0 2023-09-13T09:51:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2542237700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c073ef0 con 0x7f253c101fb0 2023-09-13T09:51:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2542237700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f253c1a0bb0 con 0x7f253c102950 2023-09-13T09:51:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c100dc0 0x7f253c074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 0x7f253c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f253bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f253c102950 0x7f253c0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 0x7f253c0730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34956/0 (socket says 172.21.15.6:34956) 2023-09-13T09:51:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c100dc0 0x7f253c074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41430/0 (socket says 172.21.15.6:41430) 2023-09-13T09:51:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 -- 172.21.15.6:0/2894224551 learned_addr learned my addr 172.21.15.6:0/2894224551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 -- 172.21.15.6:0/2894224551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f253c102950 msgr2=0x7f253c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f253c102950 0x7f253c0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 -- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c100dc0 msgr2=0x7f253c074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c100dc0 0x7f253c074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 -- 172.21.15.6:0/2894224551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2534009d00 con 0x7f253c101fb0 2023-09-13T09:51:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f253b7fe700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c100dc0 0x7f253c074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.110+0000 7f2532ffd700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 0x7f253c0730a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f252400e9a0 tx=0x7f252400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.111+0000 7f25397fa700 1 -- 172.21.15.6:0/2894224551 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524009790 con 0x7f253c101fb0 2023-09-13T09:51:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.111+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253c1a0e90 con 0x7f253c101fb0 2023-09-13T09:51:44.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.111+0000 7f25397fa700 1 -- 172.21.15.6:0/2894224551 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2524010430 con 0x7f253c101fb0 2023-09-13T09:51:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.111+0000 7f25397fa700 1 -- 172.21.15.6:0/2894224551 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524018680 con 0x7f253c101fb0 2023-09-13T09:51:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.111+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c1a1310 con 0x7f253c101fb0 2023-09-13T09:51:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.113+0000 7f25397fa700 1 -- 172.21.15.6:0/2894224551 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f25240105a0 con 0x7f253c101fb0 2023-09-13T09:51:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.114+0000 7f25397fa700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25280a0640 0x7f25280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.114+0000 7f253b7fe700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25280a0640 0x7f25280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.114+0000 7f25397fa700 1 -- 172.21.15.6:0/2894224551 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2524014070 con 0x7f253c101fb0 2023-09-13T09:51:44.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.114+0000 7f253b7fe700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25280a0640 0x7f25280a2b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f253c101e10 tx=0x7f252c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 Processor -- start 2023-09-13T09:51:44.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 -- start start 2023-09-13T09:51:44.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f485b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4844c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f484e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f3dd780 con 0x55ab0f485700 2023-09-13T09:51:44.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f3db0a0 con 0x55ab0f486060 2023-09-13T09:51:44.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f254e41cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f3d6990 con 0x55ab0f484a00 2023-09-13T09:51:44.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f485b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f485b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41438/0 (socket says 172.21.15.6:41438) 2023-09-13T09:51:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 -- 172.21.15.6:0/4138544106 learned_addr learned my addr 172.21.15.6:0/4138544106 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f2532ffd700 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253bfff700 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f484e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 -- 172.21.15.6:0/4138544106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 msgr2=0x55ab0f484e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f484e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 -- 172.21.15.6:0/4138544106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 msgr2=0x55ab0f4844c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4844c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.115+0000 7f253b7fe700 1 -- 172.21.15.6:0/4138544106 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0f256630 con 0x55ab0f485700 2023-09-13T09:51:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.116+0000 7f253bfff700 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f484e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:51:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.116+0000 7f253b7fe700 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f485b20 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f252c0043d0 tx=0x7f252c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5da5bf3ce4b2bf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.116+0000 7f2531ffb700 1 -- 172.21.15.6:0/4138544106 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c003ce0 con 0x55ab0f485700 2023-09-13T09:51:44.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.116+0000 7f2531ffb700 1 -- 172.21.15.6:0/4138544106 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f252c003e40 con 0x55ab0f485700 2023-09-13T09:51:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.116+0000 7f2531ffb700 1 -- 172.21.15.6:0/4138544106 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c026840 con 0x55ab0f485700 2023-09-13T09:51:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 -- 172.21.15.6:0/4138544106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 msgr2=0x55ab0f485b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f485b20 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f252c0043d0 tx=0x7f252c014000 comp rx=0 tx=0).stop 2023-09-13T09:51:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 -- 172.21.15.6:0/4138544106 shutdown_connections 2023-09-13T09:51:44.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f484e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f485b20 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 --2- 172.21.15.6:0/4138544106 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 -- 172.21.15.6:0/4138544106 >> 172.21.15.6:0/4138544106 conn(0x55ab0f3e2c80 msgr2=0x55ab0f47ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 -- 172.21.15.6:0/4138544106 shutdown_connections 2023-09-13T09:51:44.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 -- 172.21.15.6:0/4138544106 wait complete. 2023-09-13T09:51:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.117+0000 7f254e41cb80 1 -- start start 2023-09-13T09:51:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 1 Processor -- start 2023-09-13T09:51:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f484a00 0x55ab0f48df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f485700 0x55ab0f48e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4954e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f374bb0 con 0x55ab0f484a00 2023-09-13T09:51:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f3748b0 con 0x55ab0f486060 2023-09-13T09:51:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f258920 con 0x55ab0f485700 2023-09-13T09:51:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f484a00 0x55ab0f48df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f254e41cb80 10 client.0 _ll_register_callbacks cb 0x55ab0f372680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f484a00 0x55ab0f48df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41444/0 (socket says 172.21.15.6:41444) 2023-09-13T09:51:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 -- 172.21.15.6:0/785269884 learned_addr learned my addr 172.21.15.6:0/785269884 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f2532ffd700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f485700 0x55ab0f48e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253bfff700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4954e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 -- 172.21.15.6:0/785269884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f485700 msgr2=0x55ab0f48e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f485700 0x55ab0f48e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 -- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 msgr2=0x55ab0f4954e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4954e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253b7fe700 1 -- 172.21.15.6:0/785269884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252c017070 con 0x55ab0f484a00 2023-09-13T09:51:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f2532ffd700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f485700 0x55ab0f48e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.118+0000 7f253bfff700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f253b7fe700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f484a00 0x55ab0f48df60 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f252c0041e0 tx=0x7f252c0052e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c001e3947abee8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f251affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f251affd700 1 -- 172.21.15.6:0/785269884 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c02c070 con 0x55ab0f484a00 2023-09-13T09:51:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f251affd700 1 -- 172.21.15.6:0/785269884 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f252c005660 con 0x55ab0f484a00 2023-09-13T09:51:44.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab0f477670 con 0x55ab0f484a00 2023-09-13T09:51:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f251affd700 1 -- 172.21.15.6:0/785269884 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f252c0046e0 con 0x55ab0f484a00 2023-09-13T09:51:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 10 client.18657 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ab0f3ee7a0 con 0x55ab0f484a00 2023-09-13T09:51:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f251affd700 1 -- 172.21.15.6:0/785269884 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab0f477670 con 0x55ab0f484a00 2023-09-13T09:51:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f251affd700 1 -- 172.21.15.6:0/785269884 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f252c024020 con 0x55ab0f484a00 2023-09-13T09:51:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 10 client.18657 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 10 client.18657 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:51:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 20 client.18657 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f499b70 0x55ab0f49bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 4 client.18657 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.119+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab0f3cf970 con 0x55ab0f499b70 2023-09-13T09:51:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.120+0000 7f2532ffd700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f499b70 0x55ab0f49bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.120+0000 7f251affd700 10 client.18657 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.120+0000 7f2532ffd700 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f499b70 0x55ab0f49bf90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ed8d567bfe2039a6 server_cookie=965dba346d631675 in_seq=0 out_seq=0 2023-09-13T09:51:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f251affd700 1 -- 172.21.15.6:0/785269884 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ab0f3cf970 con 0x55ab0f499b70 2023-09-13T09:51:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f251affd700 10 client.18657 handle_command_reply: tid=0 2023-09-13T09:51:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 client.18657 shutdown 2023-09-13T09:51:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f484a00 msgr2=0x55ab0f48df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f484a00 0x55ab0f48df60 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f252c0041e0 tx=0x7f252c0052e0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 shutdown_connections 2023-09-13T09:51:44.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f499b70 0x55ab0f49bf90 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f4954e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f484a00 0x55ab0f48df60 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 --2- 172.21.15.6:0/785269884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f485700 0x55ab0f48e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f251affd700 0 client.18657 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:44.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 >> 172.21.15.6:0/785269884 conn(0x55ab0f3e2c80 msgr2=0x55ab0f4797f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 shutdown_connections 2023-09-13T09:51:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 1 -- 172.21.15.6:0/785269884 wait complete. 2023-09-13T09:51:44.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.121+0000 7f254e41cb80 20 client.18657 trim_cache size 0 max 16384 2023-09-13T09:51:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.134+0000 7f254e41cb80 1 Processor -- start 2023-09-13T09:51:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.134+0000 7f254e41cb80 1 -- start start 2023-09-13T09:51:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.134+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f484a00 0x55ab0f4844c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f4954a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f486060 0x55ab0f4888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f254e41cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f4807a0 con 0x55ab0f485700 2023-09-13T09:51:44.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f254e41cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f48bb60 con 0x55ab0f484a00 2023-09-13T09:51:44.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f254e41cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f489450 con 0x55ab0f486060 2023-09-13T09:51:44.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f4954a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f4954a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41454/0 (socket says 172.21.15.6:41454) 2023-09-13T09:51:44.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 -- 172.21.15.6:0/1567976658 learned_addr learned my addr 172.21.15.6:0/1567976658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f253b7fe700 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f484a00 0x55ab0f4844c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f253bfff700 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f486060 0x55ab0f4888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 -- 172.21.15.6:0/1567976658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f486060 msgr2=0x55ab0f4888e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f486060 0x55ab0f4888e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 -- 172.21.15.6:0/1567976658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f484a00 msgr2=0x55ab0f4844c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f484a00 0x55ab0f4844c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 -- 172.21.15.6:0/1567976658 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab0f202de0 con 0x55ab0f485700 2023-09-13T09:51:44.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f253bfff700 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f486060 0x55ab0f4888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:51:44.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f2532ffd700 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f4954a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f25240c9820 tx=0x7f252401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97227fbbd75886ea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f25327fc700 1 -- 172.21.15.6:0/1567976658 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252409d150 con 0x55ab0f485700 2023-09-13T09:51:44.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f25327fc700 1 -- 172.21.15.6:0/1567976658 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f252409d340 con 0x55ab0f485700 2023-09-13T09:51:44.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.135+0000 7f25327fc700 1 -- 172.21.15.6:0/1567976658 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2524099790 con 0x55ab0f485700 2023-09-13T09:51:44.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 -- 172.21.15.6:0/1567976658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 msgr2=0x55ab0f4954a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f4954a0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f25240c9820 tx=0x7f252401a040 comp rx=0 tx=0).stop 2023-09-13T09:51:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 -- 172.21.15.6:0/1567976658 shutdown_connections 2023-09-13T09:51:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f486060 0x55ab0f4888e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f484a00 0x55ab0f4844c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 --2- 172.21.15.6:0/1567976658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f4954a0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 -- 172.21.15.6:0/1567976658 >> 172.21.15.6:0/1567976658 conn(0x55ab0f3e2c80 msgr2=0x55ab0f48cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 -- 172.21.15.6:0/1567976658 shutdown_connections 2023-09-13T09:51:44.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 -- 172.21.15.6:0/1567976658 wait complete. 2023-09-13T09:51:44.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.136+0000 7f254e41cb80 1 -- start start 2023-09-13T09:51:44.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 1 Processor -- start 2023-09-13T09:51:44.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f491680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f491bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f494be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f495120 con 0x55ab0f485700 2023-09-13T09:51:44.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f495290 con 0x55ab0f486060 2023-09-13T09:51:44.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab0f495450 con 0x55ab0f484a00 2023-09-13T09:51:44.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f254e41cb80 10 client.0 _ll_register_callbacks cb 0x55ab0f372680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f2532ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f491bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f2532ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f491bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41460/0 (socket says 172.21.15.6:41460) 2023-09-13T09:51:44.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f2532ffd700 1 -- 172.21.15.6:0/2757169103 learned_addr learned my addr 172.21.15.6:0/2757169103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f253b7fe700 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f491680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f253bfff700 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f494be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.137+0000 7f2532ffd700 1 -- 172.21.15.6:0/2757169103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 msgr2=0x55ab0f491680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f2532ffd700 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f491680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f2532ffd700 1 -- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 msgr2=0x55ab0f494be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f2532ffd700 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f494be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f2532ffd700 1 -- 172.21.15.6:0/2757169103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f253c1a1310 con 0x55ab0f485700 2023-09-13T09:51:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f2532ffd700 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f491bc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f25240994a0 tx=0x7f2524099d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551847ec05d4f2c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f251affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f251affd700 1 -- 172.21.15.6:0/2757169103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25240c99f0 con 0x55ab0f485700 2023-09-13T09:51:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f251affd700 1 -- 172.21.15.6:0/2757169103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f25240aee40 con 0x55ab0f485700 2023-09-13T09:51:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f252c003e40 con 0x55ab0f485700 2023-09-13T09:51:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f251affd700 1 -- 172.21.15.6:0/2757169103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2524098a00 con 0x55ab0f485700 2023-09-13T09:51:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f254e41cb80 10 client.18663 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55ab0f1ebc60 con 0x55ab0f485700 2023-09-13T09:51:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.138+0000 7f251affd700 1 -- 172.21.15.6:0/2757169103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f252c003e40 con 0x55ab0f485700 2023-09-13T09:51:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f251affd700 1 -- 172.21.15.6:0/2757169103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f25240b7280 con 0x55ab0f485700 2023-09-13T09:51:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f254e41cb80 10 client.18663 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f254e41cb80 10 client.18663 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:51:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f254e41cb80 20 client.18663 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f254e41cb80 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f4ee9e0 0x55ab0f4f0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f254e41cb80 4 client.18663 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ab0f390050 con 0x55ab0f4ee9e0 2023-09-13T09:51:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f253b7fe700 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f4ee9e0 0x55ab0f4f0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f253b7fe700 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f4ee9e0 0x55ab0f4f0e00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=247cb55bdcdae7ac server_cookie=3e368a2e647a800e in_seq=0 out_seq=0 2023-09-13T09:51:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f251affd700 10 client.18663 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f251affd700 1 -- 172.21.15.6:0/2757169103 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ab0f390050 con 0x55ab0f4ee9e0 2023-09-13T09:51:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f251affd700 10 client.18663 handle_command_reply: tid=0 2023-09-13T09:51:44.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.139+0000 7f254e41cb80 1 client.18663 shutdown 2023-09-13T09:51:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 msgr2=0x55ab0f491bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f491bc0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f25240994a0 tx=0x7f2524099d80 comp rx=0 tx=0).stop 2023-09-13T09:51:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 shutdown_connections 2023-09-13T09:51:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab0f4ee9e0 0x55ab0f4f0e00 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab0f486060 0x55ab0f494be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab0f484a00 0x55ab0f491680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 --2- 172.21.15.6:0/2757169103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab0f485700 0x55ab0f491bc0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 >> 172.21.15.6:0/2757169103 conn(0x55ab0f3e2c80 msgr2=0x55ab0f4888e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f251affd700 0 client.18663 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:51:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 shutdown_connections 2023-09-13T09:51:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 1 -- 172.21.15.6:0/2757169103 wait complete. 2023-09-13T09:51:44.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f254e41cb80 20 client.18663 trim_cache size 0 max 16384 2023-09-13T09:51:44.170 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25280a0640 msgr2=0x7f25280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25280a0640 0x7f25280a2b00 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f253c101e10 tx=0x7f252c009260 comp rx=0 tx=0).stop 2023-09-13T09:51:44.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 msgr2=0x7f253c0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 0x7f253c0730a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f252400e9a0 tx=0x7f252400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 shutdown_connections 2023-09-13T09:51:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f253c102950 0x7f253c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25280a0640 0x7f25280a2b00 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f253c100dc0 0x7f253c074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 --2- 172.21.15.6:0/2894224551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f253c101fb0 0x7f253c0730a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 >> 172.21.15.6:0/2894224551 conn(0x7f253c0fc330 msgr2=0x7f253c105420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 shutdown_connections 2023-09-13T09:51:44.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.140+0000 7f2542237700 1 -- 172.21.15.6:0/2894224551 wait complete. 2023-09-13T09:51:44.174 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:51:44.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 769353 6.73 MB/sec execute 544 sec latency 18.961 ms 2023-09-13T09:51:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:43 smithi006 ceph-mon[98665]: pgmap v666: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:51:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:43 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3514177237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:51:44.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:43 smithi053 ceph-mon[102373]: pgmap v666: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:51:44.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:43 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3514177237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:51:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:43 smithi131 ceph-mon[102785]: pgmap v666: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 829 KiB/s rd, 2.5 MiB/s wr, 282 op/s 2023-09-13T09:51:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:43 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3514177237' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:51:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 -- 172.21.15.6:0/3395918216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8106aa0 msgr2=0x7f0ea8108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3395918216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8106aa0 0x7f0ea8108f10 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b0a0 tx=0x7f0ea000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 -- 172.21.15.6:0/3395918216 shutdown_connections 2023-09-13T09:51:44.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3395918216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8106aa0 0x7f0ea8108f10 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3395918216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 0x7f0ea8103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3395918216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea8104170 0x7f0ea8106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 -- 172.21.15.6:0/3395918216 >> 172.21.15.6:0/3395918216 conn(0x7f0ea80fb250 msgr2=0x7f0ea80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 -- 172.21.15.6:0/3395918216 shutdown_connections 2023-09-13T09:51:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.305+0000 7f0eae7de700 1 -- 172.21.15.6:0/3395918216 wait complete. 2023-09-13T09:51:44.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 Processor -- start 2023-09-13T09:51:44.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 -- start start 2023-09-13T09:51:44.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 0x7f0ea81011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8104170 0x7f0ea80ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea8106aa0 0x7f0ea80ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea819a9d0 con 0x7f0ea8104170 2023-09-13T09:51:44.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8100270 con 0x7f0ea8101840 2023-09-13T09:51:44.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eae7de700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea8100430 con 0x7f0ea8106aa0 2023-09-13T09:51:44.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8104170 0x7f0ea80ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 0x7f0ea81011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8104170 0x7f0ea80ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41474/0 (socket says 172.21.15.6:41474) 2023-09-13T09:51:44.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 0x7f0ea81011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:34996/0 (socket says 172.21.15.6:34996) 2023-09-13T09:51:44.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0ea77fe700 1 -- 172.21.15.6:0/3037793030 learned_addr learned my addr 172.21.15.6:0/3037793030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.306+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea8106aa0 0x7f0ea80ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea7fff700 1 -- 172.21.15.6:0/3037793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea8106aa0 msgr2=0x7f0ea80ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea8106aa0 0x7f0ea80ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea7fff700 1 -- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8104170 msgr2=0x7f0ea80ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8104170 0x7f0ea80ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea7fff700 1 -- 172.21.15.6:0/3037793030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98009520 con 0x7f0ea8101840 2023-09-13T09:51:44.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8104170 0x7f0ea80ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 0x7f0ea81011b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800e9f0 tx=0x7f0e9800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea57fa700 1 -- 172.21.15.6:0/3037793030 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9800cb70 con 0x7f0ea8101840 2023-09-13T09:51:44.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea57fa700 1 -- 172.21.15.6:0/3037793030 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e9800ee90 con 0x7f0ea8101840 2023-09-13T09:51:44.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0ea57fa700 1 -- 172.21.15.6:0/3037793030 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98003cf0 con 0x7f0ea8101840 2023-09-13T09:51:44.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea0009d00 con 0x7f0ea8101840 2023-09-13T09:51:44.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.307+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81a5610 con 0x7f0ea8101840 2023-09-13T09:51:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.310+0000 7f0ea57fa700 1 -- 172.21.15.6:0/3037793030 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0e9800ccd0 con 0x7f0ea8101840 2023-09-13T09:51:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.310+0000 7f0ea57fa700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e900a06c0 0x7f0e900a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 Processor -- start 2023-09-13T09:51:44.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0ea57fa700 1 -- 172.21.15.6:0/3037793030 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0e98014070 con 0x7f0ea8101840 2023-09-13T09:51:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 -- start start 2023-09-13T09:51:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c60b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c5f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5bb8780 con 0x55c1d5c61060 2023-09-13T09:51:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5bb60a0 con 0x55c1d5c5fa00 2023-09-13T09:51:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5bb1990 con 0x55c1d5c60700 2023-09-13T09:51:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c60b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c60b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44534/0 (socket says 172.21.15.6:44534) 2023-09-13T09:51:44.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0ea7fff700 1 -- 172.21.15.6:0/2422618554 learned_addr learned my addr 172.21.15.6:0/2422618554 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.311+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c5f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea7fff700 1 -- 172.21.15.6:0/2422618554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 msgr2=0x55c1d5c5fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea7fff700 1 -- 172.21.15.6:0/2422618554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 msgr2=0x55c1d5c5f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c5f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea7fff700 1 -- 172.21.15.6:0/2422618554 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1d5a31630 con 0x55c1d5c60700 2023-09-13T09:51:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e900a06c0 0x7f0e900a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c60b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e98099550 tx=0x7f0e98098f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30d5272330a4ee81 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e900a06c0 0x7f0e900a2b80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009880 tx=0x7f0e9c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0e8e7fc700 1 -- 172.21.15.6:0/2422618554 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980995c0 con 0x55c1d5c60700 2023-09-13T09:51:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0e8e7fc700 1 -- 172.21.15.6:0/2422618554 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e9809d3f0 con 0x55c1d5c60700 2023-09-13T09:51:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.312+0000 7f0e8e7fc700 1 -- 172.21.15.6:0/2422618554 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98099a40 con 0x55c1d5c60700 2023-09-13T09:51:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/2422618554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 msgr2=0x55c1d5c60b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c60b20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0e98099550 tx=0x7f0e98098f20 comp rx=0 tx=0).stop 2023-09-13T09:51:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/2422618554 shutdown_connections 2023-09-13T09:51:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c60b20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/2422618554 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c5f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/2422618554 >> 172.21.15.6:0/2422618554 conn(0x55c1d5bbdc80 msgr2=0x55c1d5c59f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/2422618554 shutdown_connections 2023-09-13T09:51:44.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/2422618554 wait complete. 2023-09-13T09:51:44.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.313+0000 7f0eba9c3b80 1 -- start start 2023-09-13T09:51:44.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 1 Processor -- start 2023-09-13T09:51:44.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c68f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c69480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5b4fbb0 con 0x55c1d5c61060 2023-09-13T09:51:44.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5b4f8b0 con 0x55c1d5c5fa00 2023-09-13T09:51:44.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5a33920 con 0x55c1d5c60700 2023-09-13T09:51:44.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eba9c3b80 10 client.0 _ll_register_callbacks cb 0x55c1d5b4d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c704c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41490/0 (socket says 172.21.15.6:41490) 2023-09-13T09:51:44.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 -- 172.21.15.6:0/1587370441 learned_addr learned my addr 172.21.15.6:0/1587370441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c68f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c69480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 -- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 msgr2=0x55c1d5c69480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c69480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 -- 172.21.15.6:0/1587370441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 msgr2=0x55c1d5c68f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c68f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 -- 172.21.15.6:0/1587370441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea81a5610 con 0x55c1d5c61060 2023-09-13T09:51:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c68f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c704c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0015000 tx=0x7f0ea0007970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef698851b546e3c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.314+0000 7f0e877fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0e877fe700 1 -- 172.21.15.6:0/1587370441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000e040 con 0x55c1d5c61060 2023-09-13T09:51:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c1d5c52670 con 0x55c1d5c61060 2023-09-13T09:51:44.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0e877fe700 1 -- 172.21.15.6:0/1587370441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0ea000be30 con 0x55c1d5c61060 2023-09-13T09:51:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0e877fe700 1 -- 172.21.15.6:0/1587370441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea0003a00 con 0x55c1d5c61060 2023-09-13T09:51:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 10 client.18675 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c1d5bc97a0 con 0x55c1d5c61060 2023-09-13T09:51:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0e877fe700 1 -- 172.21.15.6:0/1587370441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c1d5c52670 con 0x55c1d5c61060 2023-09-13T09:51:44.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0e877fe700 1 -- 172.21.15.6:0/1587370441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0ea0019070 con 0x55c1d5c61060 2023-09-13T09:51:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 10 client.18675 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 10 client.18675 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:51:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 20 client.18675 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5c74c90 0x55c1d5c770b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 4 client.18675 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c1d5baa970 con 0x55c1d5c74c90 2023-09-13T09:51:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.315+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5c74c90 0x55c1d5c770b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.316+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5c74c90 0x55c1d5c770b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4f647a225d8c4d82 server_cookie=dd612c76b7db32f8 in_seq=0 out_seq=0 2023-09-13T09:51:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.316+0000 7f0e877fe700 10 client.18675 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.316+0000 7f0e877fe700 1 -- 172.21.15.6:0/1587370441 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c1d5baa970 con 0x55c1d5c74c90 2023-09-13T09:51:44.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.316+0000 7f0e877fe700 10 client.18675 handle_command_reply: tid=0 2023-09-13T09:51:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.316+0000 7f0eba9c3b80 1 client.18675 shutdown 2023-09-13T09:51:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.316+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 msgr2=0x55c1d5c704c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c704c0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0015000 tx=0x7f0ea0007970 comp rx=0 tx=0).stop 2023-09-13T09:51:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 shutdown_connections 2023-09-13T09:51:44.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5c74c90 0x55c1d5c770b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c704c0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0e877fe700 0 client.18675 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c68f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/1587370441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c60700 0x55c1d5c69480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 >> 172.21.15.6:0/1587370441 conn(0x55c1d5bbdc80 msgr2=0x55c1d5c547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 shutdown_connections 2023-09-13T09:51:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/1587370441 wait complete. 2023-09-13T09:51:44.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.317+0000 7f0eba9c3b80 20 client.18675 trim_cache size 0 max 16384 2023-09-13T09:51:44.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 Processor -- start 2023-09-13T09:51:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 -- start start 2023-09-13T09:51:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c703e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c61060 0x55c1d5c70db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5c5b730 con 0x55c1d5c5fa00 2023-09-13T09:51:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5c66ba0 con 0x55c1d5c60700 2023-09-13T09:51:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5c64490 con 0x55c1d5c61060 2023-09-13T09:51:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41494/0 (socket says 172.21.15.6:41494) 2023-09-13T09:51:44.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0ea7fff700 1 -- 172.21.15.6:0/4206112499 learned_addr learned my addr 172.21.15.6:0/4206112499 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.330+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c61060 0x55c1d5c70db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0ea7fff700 1 -- 172.21.15.6:0/4206112499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c61060 msgr2=0x55c1d5c70db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c61060 0x55c1d5c70db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0ea7fff700 1 -- 172.21.15.6:0/4206112499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 msgr2=0x55c1d5c703e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c703e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0ea7fff700 1 -- 172.21.15.6:0/4206112499 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1d59ddde0 con 0x55c1d5c5fa00 2023-09-13T09:51:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c61060 0x55c1d5c70db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:51:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5f4c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0e98097bb0 tx=0x7f0e98003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82bfbca0e8f4f98d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0e8effd700 1 -- 172.21.15.6:0/4206112499 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98097960 con 0x55c1d5c5fa00 2023-09-13T09:51:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0e8effd700 1 -- 172.21.15.6:0/4206112499 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e980995c0 con 0x55c1d5c5fa00 2023-09-13T09:51:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.331+0000 7f0e8effd700 1 -- 172.21.15.6:0/4206112499 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98099820 con 0x55c1d5c5fa00 2023-09-13T09:51:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4206112499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c5fa00 msgr2=0x55c1d5c5f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5f4c0 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f0e98097bb0 tx=0x7f0e98003780 comp rx=0 tx=0).stop 2023-09-13T09:51:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4206112499 shutdown_connections 2023-09-13T09:51:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c61060 0x55c1d5c70db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c5f4c0 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4206112499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c703e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4206112499 >> 172.21.15.6:0/4206112499 conn(0x55c1d5bbdc80 msgr2=0x55c1d5c67bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4206112499 shutdown_connections 2023-09-13T09:51:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4206112499 wait complete. 2023-09-13T09:51:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 -- start start 2023-09-13T09:51:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.332+0000 7f0eba9c3b80 1 Processor -- start 2023-09-13T09:51:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c6c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c6c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eba9c3b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c6f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5c6fcd0 con 0x55c1d5c61060 2023-09-13T09:51:44.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5c6fe40 con 0x55c1d5c60700 2023-09-13T09:51:44.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eba9c3b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c1d5c70000 con 0x55c1d5c5fa00 2023-09-13T09:51:44.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eba9c3b80 10 client.0 _ll_register_callbacks cb 0x55c1d5b4d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c6c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c6c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0ea7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c6c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44554/0 (socket says 172.21.15.6:44554) 2023-09-13T09:51:44.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0ea77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c6c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35026/0 (socket says 172.21.15.6:35026) 2023-09-13T09:51:44.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eacd7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c6f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0ea7fff700 1 -- 172.21.15.6:0/4237049843 learned_addr learned my addr 172.21.15.6:0/4237049843 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eacd7b700 1 -- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c5fa00 msgr2=0x55c1d5c6c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c6c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eacd7b700 1 -- 172.21.15.6:0/4237049843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 msgr2=0x55c1d5c6c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c6c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eacd7b700 1 -- 172.21.15.6:0/4237049843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e9c00f6f0 con 0x55c1d5c61060 2023-09-13T09:51:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c6c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0ea77fe700 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c6c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0eacd7b700 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c6f790 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x55c1d5c70a20 tx=0x7f0ea00095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12daa26b54504a91 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.333+0000 7f0e877fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0e877fe700 1 -- 172.21.15.6:0/4237049843 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea000e070 con 0x55c1d5c61060 2023-09-13T09:51:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0e877fe700 1 -- 172.21.15.6:0/4237049843 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0ea002c030 con 0x55c1d5c61060 2023-09-13T09:51:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0e9809d3f0 con 0x55c1d5c61060 2023-09-13T09:51:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0e877fe700 1 -- 172.21.15.6:0/4237049843 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea0003c10 con 0x55c1d5c61060 2023-09-13T09:51:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 10 client.18681 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55c1d5a31630 con 0x55c1d5c61060 2023-09-13T09:51:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0e877fe700 1 -- 172.21.15.6:0/4237049843 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0e9809d3f0 con 0x55c1d5c61060 2023-09-13T09:51:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0e877fe700 1 -- 172.21.15.6:0/4237049843 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0ea000b420 con 0x55c1d5c61060 2023-09-13T09:51:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 10 client.18681 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 10 client.18681 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:51:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 20 client.18681 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5cc9850 0x55c1d5ccbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 4 client.18681 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c1d5b6b050 con 0x55c1d5cc9850 2023-09-13T09:51:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.334+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5cc9850 0x55c1d5ccbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0e877fe700 10 client.18681 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:44.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0ea7fff700 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5cc9850 0x55c1d5ccbc70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a4e7f9d6dfe9b1d8 server_cookie=4bd2d72d4f0f8e61 in_seq=0 out_seq=0 2023-09-13T09:51:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0e877fe700 1 -- 172.21.15.6:0/4237049843 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c1d5b6b050 con 0x55c1d5cc9850 2023-09-13T09:51:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0e877fe700 10 client.18681 handle_command_reply: tid=0 2023-09-13T09:51:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 client.18681 shutdown 2023-09-13T09:51:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 msgr2=0x55c1d5c6f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c6f790 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x55c1d5c70a20 tx=0x7f0ea00095f0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 shutdown_connections 2023-09-13T09:51:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55c1d5cc9850 0x55c1d5ccbc70 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c1d5c61060 0x55c1d5c6f790 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0e877fe700 0 client.18681 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:51:44.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c1d5c5fa00 0x55c1d5c6c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 --2- 172.21.15.6:0/4237049843 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c1d5c60700 0x55c1d5c6c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 >> 172.21.15.6:0/4237049843 conn(0x55c1d5bbdc80 msgr2=0x55c1d5c63920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 shutdown_connections 2023-09-13T09:51:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 1 -- 172.21.15.6:0/4237049843 wait complete. 2023-09-13T09:51:44.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.335+0000 7f0eba9c3b80 20 client.18681 trim_cache size 0 max 16384 2023-09-13T09:51:44.361 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e900a06c0 msgr2=0x7f0e900a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e900a06c0 0x7f0e900a2b80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0e9c009880 tx=0x7f0e9c009260 comp rx=0 tx=0).stop 2023-09-13T09:51:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 msgr2=0x7f0ea81011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 0x7f0ea81011b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800e9f0 tx=0x7f0e9800ed00 comp rx=0 tx=0).stop 2023-09-13T09:51:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 shutdown_connections 2023-09-13T09:51:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ea8106aa0 0x7f0ea80ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0ea8101840 0x7f0ea81011b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0e900a06c0 0x7f0e900a2b80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 --2- 172.21.15.6:0/3037793030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ea8104170 0x7f0ea80ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 >> 172.21.15.6:0/3037793030 conn(0x7f0ea80fb250 msgr2=0x7f0ea81024d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 shutdown_connections 2023-09-13T09:51:44.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.336+0000 7f0eae7de700 1 -- 172.21.15.6:0/3037793030 wait complete. 2023-09-13T09:51:44.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:51:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.535+0000 7fc50c855700 1 -- 172.21.15.6:0/242394325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5081041d0 msgr2=0x7fc5081065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.535+0000 7fc50c855700 1 --2- 172.21.15.6:0/242394325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5081041d0 0x7fc5081065c0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc009990 tx=0x7fc4fc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 -- 172.21.15.6:0/242394325 shutdown_connections 2023-09-13T09:51:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 --2- 172.21.15.6:0/242394325 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc508106b00 0x7fc508108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 --2- 172.21.15.6:0/242394325 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5081018a0 0x7fc508103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 --2- 172.21.15.6:0/242394325 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5081041d0 0x7fc5081065c0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 -- 172.21.15.6:0/242394325 >> 172.21.15.6:0/242394325 conn(0x7fc5080fb250 msgr2=0x7fc5080fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 -- 172.21.15.6:0/242394325 shutdown_connections 2023-09-13T09:51:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 -- 172.21.15.6:0/242394325 wait complete. 2023-09-13T09:51:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 Processor -- start 2023-09-13T09:51:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.536+0000 7fc50c855700 1 -- start start 2023-09-13T09:51:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc50c855700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5081018a0 0x7fc508101210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc50c855700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5081041d0 0x7fc5080ff850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc50c855700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508106b00 0x7fc5080ffd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc50c855700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc508100530 con 0x7fc508106b00 2023-09-13T09:51:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc50c855700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081006a0 con 0x7fc5081041d0 2023-09-13T09:51:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc50c855700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081a0b10 con 0x7fc5081018a0 2023-09-13T09:51:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508106b00 0x7fc5080ffd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508106b00 0x7fc5080ffd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41518/0 (socket says 172.21.15.6:41518) 2023-09-13T09:51:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 -- 172.21.15.6:0/1135292901 learned_addr learned my addr 172.21.15.6:0/1135292901 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc50659c700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5081018a0 0x7fc508101210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc505d9b700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5081041d0 0x7fc5080ff850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 -- 172.21.15.6:0/1135292901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5081018a0 msgr2=0x7fc508101210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5081018a0 0x7fc508101210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 -- 172.21.15.6:0/1135292901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5081041d0 msgr2=0x7fc5080ff850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5081041d0 0x7fc5080ff850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 -- 172.21.15.6:0/1135292901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4fc0095f0 con 0x7fc508106b00 2023-09-13T09:51:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc506d9d700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508106b00 0x7fc5080ffd90 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc500007ee0 tx=0x7fc50000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.537+0000 7fc4f77fe700 1 -- 172.21.15.6:0/1135292901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500017070 con 0x7fc508106b00 2023-09-13T09:51:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.538+0000 7fc4f77fe700 1 -- 172.21.15.6:0/1135292901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc50000f040 con 0x7fc508106b00 2023-09-13T09:51:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.538+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5081a0df0 con 0x7fc508106b00 2023-09-13T09:51:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.538+0000 7fc4f77fe700 1 -- 172.21.15.6:0/1135292901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500005580 con 0x7fc508106b00 2023-09-13T09:51:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.538+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5081a1220 con 0x7fc508106b00 2023-09-13T09:51:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.540+0000 7fc4f77fe700 1 -- 172.21.15.6:0/1135292901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc500005760 con 0x7fc508106b00 2023-09-13T09:51:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.541+0000 7fc4f77fe700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4f00a0640 0x7fc4f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.541+0000 7fc50659c700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4f00a0640 0x7fc4f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.541+0000 7fc4f77fe700 1 -- 172.21.15.6:0/1135292901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc5000cb320 con 0x7fc508106b00 2023-09-13T09:51:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.541+0000 7fc50659c700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4f00a0640 0x7fc4f00a2b00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8007c60 tx=0x7fc4f80073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.541+0000 7fc518a3ab80 1 Processor -- start 2023-09-13T09:51:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc518a3ab80 1 -- start start 2023-09-13T09:51:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f99700 0x558d36f99b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f984c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f98a00 0x558d36f98e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36ef1780 con 0x558d36f99700 2023-09-13T09:51:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36eef0a0 con 0x558d36f9a060 2023-09-13T09:51:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36eea990 con 0x558d36f98a00 2023-09-13T09:51:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc50659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f99700 0x558d36f99b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc505d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc50659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f99700 0x558d36f99b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41522/0 (socket says 172.21.15.6:41522) 2023-09-13T09:51:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc50659c700 1 -- 172.21.15.6:0/2270073963 learned_addr learned my addr 172.21.15.6:0/2270073963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc506d9d700 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f98a00 0x558d36f98e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc505d9b700 1 -- 172.21.15.6:0/2270073963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f98a00 msgr2=0x558d36f98e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc505d9b700 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f98a00 0x558d36f98e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc505d9b700 1 -- 172.21.15.6:0/2270073963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f99700 msgr2=0x558d36f99b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc505d9b700 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f99700 0x558d36f99b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc505d9b700 1 -- 172.21.15.6:0/2270073963 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d36d6a630 con 0x558d36f9a060 2023-09-13T09:51:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.542+0000 7fc50659c700 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f99700 0x558d36f99b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.543+0000 7fc505d9b700 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f984c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc000c00 tx=0x7fc4fc009ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751398aa5ecb211f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.543+0000 7fc4f4ff9700 1 -- 172.21.15.6:0/2270073963 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc01d050 con 0x558d36f9a060 2023-09-13T09:51:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.543+0000 7fc4f4ff9700 1 -- 172.21.15.6:0/2270073963 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4fc01e040 con 0x558d36f9a060 2023-09-13T09:51:44.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.543+0000 7fc4f4ff9700 1 -- 172.21.15.6:0/2270073963 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc0052d0 con 0x558d36f9a060 2023-09-13T09:51:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.543+0000 7fc518a3ab80 1 -- 172.21.15.6:0/2270073963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 msgr2=0x558d36f984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.543+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f984c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc000c00 tx=0x7fc4fc009ee0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- 172.21.15.6:0/2270073963 shutdown_connections 2023-09-13T09:51:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f98a00 0x558d36f98e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f99700 0x558d36f99b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/2270073963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f984c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- 172.21.15.6:0/2270073963 >> 172.21.15.6:0/2270073963 conn(0x558d36ef6c80 msgr2=0x558d36f92f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- 172.21.15.6:0/2270073963 shutdown_connections 2023-09-13T09:51:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- 172.21.15.6:0/2270073963 wait complete. 2023-09-13T09:51:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- start start 2023-09-13T09:51:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 Processor -- start 2023-09-13T09:51:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36fa1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36fa9450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36e88bb0 con 0x558d36f98a00 2023-09-13T09:51:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36e888b0 con 0x558d36f9a060 2023-09-13T09:51:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36d6c920 con 0x558d36f99700 2023-09-13T09:51:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc518a3ab80 10 client.0 _ll_register_callbacks cb 0x558d36e86680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc50659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36fa1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc50659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36fa1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41528/0 (socket says 172.21.15.6:41528) 2023-09-13T09:51:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc506d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36fa9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc505d9b700 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.544+0000 7fc50659c700 1 -- 172.21.15.6:0/4096351677 learned_addr learned my addr 172.21.15.6:0/4096351677 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc50659c700 1 -- 172.21.15.6:0/4096351677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 msgr2=0x558d36fa2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc50659c700 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc50659c700 1 -- 172.21.15.6:0/4096351677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 msgr2=0x558d36fa9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc50659c700 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36fa9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc50659c700 1 -- 172.21.15.6:0/4096351677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc508109b00 con 0x558d36f98a00 2023-09-13T09:51:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc50659c700 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36fa1ed0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80116c0 tx=0x7fc4f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24e48ec59f58213 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc4edffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc4edffb700 1 -- 172.21.15.6:0/4096351677 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8004050 con 0x558d36f98a00 2023-09-13T09:51:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d36f8b670 con 0x558d36f98a00 2023-09-13T09:51:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc4edffb700 1 -- 172.21.15.6:0/4096351677 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc4f8017070 con 0x558d36f98a00 2023-09-13T09:51:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc4edffb700 1 -- 172.21.15.6:0/4096351677 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4f80041b0 con 0x558d36f98a00 2023-09-13T09:51:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc518a3ab80 10 client.18693 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558d36f027a0 con 0x558d36f98a00 2023-09-13T09:51:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.545+0000 7fc4edffb700 1 -- 172.21.15.6:0/4096351677 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558d36f8b670 con 0x558d36f98a00 2023-09-13T09:51:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc4edffb700 1 -- 172.21.15.6:0/4096351677 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc4f801f430 con 0x558d36f98a00 2023-09-13T09:51:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc518a3ab80 10 client.18693 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc518a3ab80 10 client.18693 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:51:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc518a3ab80 20 client.18693 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d36fb01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc518a3ab80 4 client.18693 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d36ee3970 con 0x558d36fadda0 2023-09-13T09:51:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc505d9b700 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d36fb01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc4edffb700 10 client.18693 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.546+0000 7fc505d9b700 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d36fb01c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81032791682af2ca server_cookie=10572a80d3f29eb4 in_seq=0 out_seq=0 2023-09-13T09:51:44.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc4edffb700 1 -- 172.21.15.6:0/4096351677 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d36ee3970 con 0x558d36fadda0 2023-09-13T09:51:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc4edffb700 10 client.18693 handle_command_reply: tid=0 2023-09-13T09:51:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 client.18693 shutdown 2023-09-13T09:51:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 msgr2=0x558d36fa1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36fa1ed0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fc4f80116c0 tx=0x7fc4f80047c0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 shutdown_connections 2023-09-13T09:51:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d36fb01c0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36fa9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc4edffb700 0 client.18693 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36fa1ed0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/4096351677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 >> 172.21.15.6:0/4096351677 conn(0x558d36ef6c80 msgr2=0x558d36f8d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.547+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 shutdown_connections 2023-09-13T09:51:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.548+0000 7fc518a3ab80 1 -- 172.21.15.6:0/4096351677 wait complete. 2023-09-13T09:51:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.548+0000 7fc518a3ab80 20 client.18693 trim_cache size 0 max 16384 2023-09-13T09:51:44.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 Processor -- start 2023-09-13T09:51:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 -- start start 2023-09-13T09:51:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36f984c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f9fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36f94730 con 0x558d36f98a00 2023-09-13T09:51:44.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36f9fb20 con 0x558d36f9a060 2023-09-13T09:51:44.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36f9d410 con 0x558d36f99700 2023-09-13T09:51:44.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc50659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36f984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc50659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36f984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41536/0 (socket says 172.21.15.6:41536) 2023-09-13T09:51:44.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc50659c700 1 -- 172.21.15.6:0/3080591991 learned_addr learned my addr 172.21.15.6:0/3080591991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc506d9d700 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f9fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.561+0000 7fc505d9b700 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc50659c700 1 -- 172.21.15.6:0/3080591991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 msgr2=0x558d36fa9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc50659c700 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc50659c700 1 -- 172.21.15.6:0/3080591991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 msgr2=0x558d36f9fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc50659c700 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f9fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc50659c700 1 -- 172.21.15.6:0/3080591991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d36d16de0 con 0x558d36f98a00 2023-09-13T09:51:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc505d9b700 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:51:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc506d9d700 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f9fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc50659c700 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36f984c0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc4f801f7e0 tx=0x7fc4f8010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fc06c0684f80db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc4f57fa700 1 -- 172.21.15.6:0/3080591991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80119d0 con 0x558d36f98a00 2023-09-13T09:51:44.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc4f57fa700 1 -- 172.21.15.6:0/3080591991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4f802d030 con 0x558d36f98a00 2023-09-13T09:51:44.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.562+0000 7fc4f57fa700 1 -- 172.21.15.6:0/3080591991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8028420 con 0x558d36f98a00 2023-09-13T09:51:44.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- 172.21.15.6:0/3080591991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 msgr2=0x558d36f984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36f984c0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fc4f801f7e0 tx=0x7fc4f8010f30 comp rx=0 tx=0).stop 2023-09-13T09:51:44.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- 172.21.15.6:0/3080591991 shutdown_connections 2023-09-13T09:51:44.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f9a060 0x558d36f9fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f98a00 0x558d36f984c0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/3080591991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa9410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- 172.21.15.6:0/3080591991 >> 172.21.15.6:0/3080591991 conn(0x558d36ef6c80 msgr2=0x558d36f93810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- 172.21.15.6:0/3080591991 shutdown_connections 2023-09-13T09:51:44.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- 172.21.15.6:0/3080591991 wait complete. 2023-09-13T09:51:44.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- start start 2023-09-13T09:51:44.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 Processor -- start 2023-09-13T09:51:44.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f98a00 0x558d36fa50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f9a060 0x558d36fa8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36fa8b60 con 0x558d36f9a060 2023-09-13T09:51:44.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36fa8cd0 con 0x558d36f98a00 2023-09-13T09:51:44.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d36fa8e90 con 0x558d36f99700 2023-09-13T09:51:44.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc518a3ab80 10 client.0 _ll_register_callbacks cb 0x558d36e86680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc506d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f9a060 0x558d36fa8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc50659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f98a00 0x558d36fa50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc506d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f9a060 0x558d36fa8620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41546/0 (socket says 172.21.15.6:41546) 2023-09-13T09:51:44.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc506d9d700 1 -- 172.21.15.6:0/1390743723 learned_addr learned my addr 172.21.15.6:0/1390743723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.563+0000 7fc505d9b700 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc506d9d700 1 -- 172.21.15.6:0/1390743723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 msgr2=0x558d36fa5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc506d9d700 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc506d9d700 1 -- 172.21.15.6:0/1390743723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f98a00 msgr2=0x558d36fa50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc506d9d700 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f98a00 0x558d36fa50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc506d9d700 1 -- 172.21.15.6:0/1390743723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5081a1220 con 0x558d36f9a060 2023-09-13T09:51:44.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc506d9d700 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f9a060 0x558d36fa8620 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc5000987c0 tx=0x7fc50000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7f50e7033655e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc4edffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc4edffb700 1 -- 172.21.15.6:0/1390743723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500004c40 con 0x558d36f9a060 2023-09-13T09:51:44.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc4edffb700 1 -- 172.21.15.6:0/1390743723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc5000b80b0 con 0x558d36f9a060 2023-09-13T09:51:44.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc4fc01e040 con 0x558d36f9a060 2023-09-13T09:51:44.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc4edffb700 1 -- 172.21.15.6:0/1390743723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc500022250 con 0x558d36f9a060 2023-09-13T09:51:44.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 10 client.18699 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558d36f027a0 con 0x558d36f9a060 2023-09-13T09:51:44.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc4edffb700 1 -- 172.21.15.6:0/1390743723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc4fc01e040 con 0x558d36f9a060 2023-09-13T09:51:44.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc4edffb700 1 -- 172.21.15.6:0/1390743723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fc500097fb0 con 0x558d36f9a060 2023-09-13T09:51:44.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 10 client.18699 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 10 client.18699 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:51:44.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 20 client.18699 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d37004be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 4 client.18699 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:44.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.564+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558d36ea4050 con 0x558d36fadda0 2023-09-13T09:51:44.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc50659c700 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d37004be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc50659c700 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d37004be0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f24d4ebc99a702aa server_cookie=295d5c553b3cdd4c in_seq=0 out_seq=0 2023-09-13T09:51:44.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc4edffb700 10 client.18699 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:44.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc4edffb700 1 -- 172.21.15.6:0/1390743723 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558d36ea4050 con 0x558d36fadda0 2023-09-13T09:51:44.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc4edffb700 10 client.18699 handle_command_reply: tid=0 2023-09-13T09:51:44.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 client.18699 shutdown 2023-09-13T09:51:44.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f9a060 msgr2=0x558d36fa8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f9a060 0x558d36fa8620 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7fc5000987c0 tx=0x7fc50000b040 comp rx=0 tx=0).stop 2023-09-13T09:51:44.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 shutdown_connections 2023-09-13T09:51:44.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558d36fadda0 0x558d37004be0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d36f9a060 0x558d36fa8620 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d36f98a00 0x558d36fa50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 --2- 172.21.15.6:0/1390743723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d36f99700 0x558d36fa5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 >> 172.21.15.6:0/1390743723 conn(0x558d36ef6c80 msgr2=0x558d36f9fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc4edffb700 0 client.18699 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:51:44.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 shutdown_connections 2023-09-13T09:51:44.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.565+0000 7fc518a3ab80 1 -- 172.21.15.6:0/1390743723 wait complete. 2023-09-13T09:51:44.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc518a3ab80 20 client.18699 trim_cache size 0 max 16384 2023-09-13T09:51:44.593 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:44.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4f00a0640 msgr2=0x7fc4f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4f00a0640 0x7fc4f00a2b00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8007c60 tx=0x7fc4f80073d0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508106b00 msgr2=0x7fc5080ffd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508106b00 0x7fc5080ffd90 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fc500007ee0 tx=0x7fc50000d3b0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 shutdown_connections 2023-09-13T09:51:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4f00a0640 0x7fc4f00a2b00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc508106b00 0x7fc5080ffd90 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5081018a0 0x7fc508101210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 --2- 172.21.15.6:0/1135292901 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc5081041d0 0x7fc5080ff850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 >> 172.21.15.6:0/1135292901 conn(0x7fc5080fb250 msgr2=0x7fc5081025d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 shutdown_connections 2023-09-13T09:51:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.566+0000 7fc50c855700 1 -- 172.21.15.6:0/1135292901 wait complete. 2023-09-13T09:51:44.597 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:51:44.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 -- 172.21.15.6:0/1677870822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40102910 msgr2=0x7fcc401091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/1677870822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40102910 0x7fcc401091c0 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800b0d0 tx=0x7fcc3800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 -- 172.21.15.6:0/1677870822 shutdown_connections 2023-09-13T09:51:44.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/1677870822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40102910 0x7fcc401091c0 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/1677870822 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40100d80 0x7fcc401011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/1677870822 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc40101f70 0x7fcc401023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 -- 172.21.15.6:0/1677870822 >> 172.21.15.6:0/1677870822 conn(0x7fcc400fc310 msgr2=0x7fcc400fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 -- 172.21.15.6:0/1677870822 shutdown_connections 2023-09-13T09:51:44.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.729+0000 7fcc46fbc700 1 -- 172.21.15.6:0/1677870822 wait complete. 2023-09-13T09:51:44.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 Processor -- start 2023-09-13T09:51:44.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 -- start start 2023-09-13T09:51:44.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc40100d80 0x7fcc40074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40101f70 0x7fcc400730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40102910 0x7fcc400735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc4019a9e0 con 0x7fcc40101f70 2023-09-13T09:51:44.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc40073b20 con 0x7fcc40100d80 2023-09-13T09:51:44.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc46fbc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc40073ce0 con 0x7fcc40102910 2023-09-13T09:51:44.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40101f70 0x7fcc400730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40101f70 0x7fcc400730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41558/0 (socket says 172.21.15.6:41558) 2023-09-13T09:51:44.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc44d58700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc40100d80 0x7fcc40074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 -- 172.21.15.6:0/2670939551 learned_addr learned my addr 172.21.15.6:0/2670939551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc45559700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40102910 0x7fcc400735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 -- 172.21.15.6:0/2670939551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40102910 msgr2=0x7fcc400735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40102910 0x7fcc400735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 -- 172.21.15.6:0/2670939551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc40100d80 msgr2=0x7fcc40074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc40100d80 0x7fcc40074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 -- 172.21.15.6:0/2670939551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc38009d00 con 0x7fcc40101f70 2023-09-13T09:51:44.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc45559700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40102910 0x7fcc400735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.730+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40101f70 0x7fcc400730a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00e9a0 tx=0x7fcc2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.731+0000 7fcc3dffb700 1 -- 172.21.15.6:0/2670939551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c009790 con 0x7fcc40101f70 2023-09-13T09:51:44.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.731+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc401a5390 con 0x7fcc40101f70 2023-09-13T09:51:44.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.731+0000 7fcc3dffb700 1 -- 172.21.15.6:0/2670939551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc2c010430 con 0x7fcc40101f70 2023-09-13T09:51:44.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.731+0000 7fcc3dffb700 1 -- 172.21.15.6:0/2670939551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c018680 con 0x7fcc40101f70 2023-09-13T09:51:44.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.731+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc401a57c0 con 0x7fcc40101f70 2023-09-13T09:51:44.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.733+0000 7fcc3dffb700 1 -- 172.21.15.6:0/2670939551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcc2c0105a0 con 0x7fcc40101f70 2023-09-13T09:51:44.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.733+0000 7fcc3dffb700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc300a0640 0x7fcc300a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.734+0000 7fcc3dffb700 1 -- 172.21.15.6:0/2670939551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc2c014070 con 0x7fcc40101f70 2023-09-13T09:51:44.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.734+0000 7fcc44d58700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc300a0640 0x7fcc300a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.734+0000 7fcc44d58700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc300a0640 0x7fcc300a2b00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcc40101dd0 tx=0x7fcc34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.734+0000 7fcc531a1b80 1 Processor -- start 2023-09-13T09:51:44.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.734+0000 7fcc531a1b80 1 -- start start 2023-09-13T09:51:44.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.734+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b16cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b16b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b16be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b0c4780 con 0x56146b16ba00 2023-09-13T09:51:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b0c20a0 con 0x56146b16c700 2023-09-13T09:51:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b0bd990 con 0x56146b16d060 2023-09-13T09:51:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b16be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b16be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41568/0 (socket says 172.21.15.6:41568) 2023-09-13T09:51:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 -- 172.21.15.6:0/896853508 learned_addr learned my addr 172.21.15.6:0/896853508 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b16b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc44d58700 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b16cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 -- 172.21.15.6:0/896853508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 msgr2=0x56146b16b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b16b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 -- 172.21.15.6:0/896853508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 msgr2=0x56146b16cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b16cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 -- 172.21.15.6:0/896853508 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56146af3d630 con 0x56146b16ba00 2023-09-13T09:51:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc45559700 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b16be80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800b0d0 tx=0x7fcc38009b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9959f9e75f1aefe server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc2affd700 1 -- 172.21.15.6:0/896853508 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc3800e040 con 0x56146b16ba00 2023-09-13T09:51:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc2affd700 1 -- 172.21.15.6:0/896853508 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc38003a00 con 0x56146b16ba00 2023-09-13T09:51:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.735+0000 7fcc2affd700 1 -- 172.21.15.6:0/896853508 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc38005540 con 0x56146b16ba00 2023-09-13T09:51:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 -- 172.21.15.6:0/896853508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 msgr2=0x56146b16be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b16be80 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7fcc3800b0d0 tx=0x7fcc38009b80 comp rx=0 tx=0).stop 2023-09-13T09:51:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 -- 172.21.15.6:0/896853508 shutdown_connections 2023-09-13T09:51:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b16be80 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b16cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/896853508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b16b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 -- 172.21.15.6:0/896853508 >> 172.21.15.6:0/896853508 conn(0x56146b0c9c80 msgr2=0x56146b165f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 -- 172.21.15.6:0/896853508 shutdown_connections 2023-09-13T09:51:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 -- 172.21.15.6:0/896853508 wait complete. 2023-09-13T09:51:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.736+0000 7fcc531a1b80 1 -- start start 2023-09-13T09:51:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 1 Processor -- start 2023-09-13T09:51:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b174e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16c700 0x56146b1753a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16d060 0x56146b17c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b05bbb0 con 0x56146b16ba00 2023-09-13T09:51:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b05b8b0 con 0x56146b16d060 2023-09-13T09:51:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146af3f920 con 0x56146b16c700 2023-09-13T09:51:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc531a1b80 10 client.0 _ll_register_callbacks cb 0x56146b059680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b174e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b174e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41570/0 (socket says 172.21.15.6:41570) 2023-09-13T09:51:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 -- 172.21.15.6:0/2782304085 learned_addr learned my addr 172.21.15.6:0/2782304085 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc45559700 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16d060 0x56146b17c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16c700 0x56146b1753a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 -- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16c700 msgr2=0x56146b1753a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16c700 0x56146b1753a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 -- 172.21.15.6:0/2782304085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16d060 msgr2=0x56146b17c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16d060 0x56146b17c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.737+0000 7fcc44d58700 1 -- 172.21.15.6:0/2782304085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc40109b10 con 0x56146b16ba00 2023-09-13T09:51:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc44d58700 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b174e60 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcc3401d810 tx=0x7fcc340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8941aa68475a1bd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc1ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2782304085 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc34022070 con 0x56146b16ba00 2023-09-13T09:51:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2782304085 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc34004020 con 0x56146b16ba00 2023-09-13T09:51:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56146b15e670 con 0x56146b16ba00 2023-09-13T09:51:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2782304085 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc34004220 con 0x56146b16ba00 2023-09-13T09:51:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 10 client.18711 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56146b0d57a0 con 0x56146b16ba00 2023-09-13T09:51:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2782304085 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56146b15e670 con 0x56146b16ba00 2023-09-13T09:51:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2782304085 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc3401c740 con 0x56146b16ba00 2023-09-13T09:51:44.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 10 client.18711 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 10 client.18711 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:51:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 20 client.18711 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b180d10 0x56146b183130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 4 client.18711 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.738+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56146b0b6970 con 0x56146b180d10 2023-09-13T09:51:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.739+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b180d10 0x56146b183130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.739+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b180d10 0x56146b183130 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1348d6e0590353d4 server_cookie=dfe778d42bc12116 in_seq=0 out_seq=0 2023-09-13T09:51:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.739+0000 7fcc1ffff700 10 client.18711 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2782304085 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56146b0b6970 con 0x56146b180d10 2023-09-13T09:51:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc1ffff700 10 client.18711 handle_command_reply: tid=0 2023-09-13T09:51:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 client.18711 shutdown 2023-09-13T09:51:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 msgr2=0x56146b174e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b174e60 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fcc3401d810 tx=0x7fcc340047c0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 shutdown_connections 2023-09-13T09:51:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b180d10 0x56146b183130 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16d060 0x56146b17c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc1ffff700 0 client.18711 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16ba00 0x56146b174e60 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2782304085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16c700 0x56146b1753a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 >> 172.21.15.6:0/2782304085 conn(0x56146b0c9c80 msgr2=0x56146b165ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 shutdown_connections 2023-09-13T09:51:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2782304085 wait complete. 2023-09-13T09:51:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.740+0000 7fcc531a1b80 20 client.18711 trim_cache size 0 max 16384 2023-09-13T09:51:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 Processor -- start 2023-09-13T09:51:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 -- start start 2023-09-13T09:51:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16ba00 0x56146b16b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16c700 0x56146b166fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b17c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b1735d0 con 0x56146b16c700 2023-09-13T09:51:44.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b1703e0 con 0x56146b16ba00 2023-09-13T09:51:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b180a10 con 0x56146b16d060 2023-09-13T09:51:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16c700 0x56146b166fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16c700 0x56146b166fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41578/0 (socket says 172.21.15.6:41578) 2023-09-13T09:51:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc3ffff700 1 -- 172.21.15.6:0/594149876 learned_addr learned my addr 172.21.15.6:0/594149876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc45559700 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b17c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.753+0000 7fcc44d58700 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16ba00 0x56146b16b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc3ffff700 1 -- 172.21.15.6:0/594149876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 msgr2=0x56146b17c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b17c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc3ffff700 1 -- 172.21.15.6:0/594149876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16ba00 msgr2=0x56146b16b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16ba00 0x56146b16b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc3ffff700 1 -- 172.21.15.6:0/594149876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56146aee9de0 con 0x56146b16c700 2023-09-13T09:51:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16c700 0x56146b166fb0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0c9b90 tx=0x7fcc2c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1627129465cf3ec server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc2b7fe700 1 -- 172.21.15.6:0/594149876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c09d340 con 0x56146b16c700 2023-09-13T09:51:44.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc2b7fe700 1 -- 172.21.15.6:0/594149876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc2c0a1580 con 0x56146b16c700 2023-09-13T09:51:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc2b7fe700 1 -- 172.21.15.6:0/594149876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c0999d0 con 0x56146b16c700 2023-09-13T09:51:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc531a1b80 1 -- 172.21.15.6:0/594149876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16c700 msgr2=0x56146b166fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.754+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16c700 0x56146b166fb0 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c0c9b90 tx=0x7fcc2c01a040 comp rx=0 tx=0).stop 2023-09-13T09:51:44.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 -- 172.21.15.6:0/594149876 shutdown_connections 2023-09-13T09:51:44.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16d060 0x56146b17c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16ba00 0x56146b16b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/594149876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16c700 0x56146b166fb0 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 -- 172.21.15.6:0/594149876 >> 172.21.15.6:0/594149876 conn(0x56146b0c9c80 msgr2=0x56146b16bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 -- 172.21.15.6:0/594149876 shutdown_connections 2023-09-13T09:51:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 -- 172.21.15.6:0/594149876 wait complete. 2023-09-13T09:51:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 -- start start 2023-09-13T09:51:44.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 Processor -- start 2023-09-13T09:51:44.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16ba00 0x56146b178330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b178870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16d060 0x56146b17b890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b17bdd0 con 0x56146b16d060 2023-09-13T09:51:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.755+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b17bf40 con 0x56146b16c700 2023-09-13T09:51:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc531a1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56146b17c100 con 0x56146b16ba00 2023-09-13T09:51:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc531a1b80 10 client.0 _ll_register_callbacks cb 0x56146b059680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc44d58700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16ba00 0x56146b178330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b178870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc44d58700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16ba00 0x56146b178330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44638/0 (socket says 172.21.15.6:44638) 2023-09-13T09:51:44.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc44d58700 1 -- 172.21.15.6:0/2476132847 learned_addr learned my addr 172.21.15.6:0/2476132847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b178870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35110/0 (socket says 172.21.15.6:35110) 2023-09-13T09:51:44.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc45559700 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16d060 0x56146b17b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 -- 172.21.15.6:0/2476132847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16ba00 msgr2=0x56146b178330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16ba00 0x56146b178330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 -- 172.21.15.6:0/2476132847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16d060 msgr2=0x56146b17b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16d060 0x56146b17b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 -- 172.21.15.6:0/2476132847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc401a57c0 con 0x56146b16c700 2023-09-13T09:51:44.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc3ffff700 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b178870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c099450 tx=0x7fcc2c0c97b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a8c5b277f37eccd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc1ffff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:51:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.756+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2476132847 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc2c09d340 con 0x56146b16c700 2023-09-13T09:51:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2476132847 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcc2c0aee40 con 0x56146b16c700 2023-09-13T09:51:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcc38003a00 con 0x56146b16c700 2023-09-13T09:51:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2476132847 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcc2c098a00 con 0x56146b16c700 2023-09-13T09:51:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 10 client.28109 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56146aed2c60 con 0x56146b16c700 2023-09-13T09:51:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2476132847 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcc2c065020 con 0x56146b16c700 2023-09-13T09:51:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2476132847 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fcc2c099890 con 0x56146b16c700 2023-09-13T09:51:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 10 client.28109 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 10 client.28109 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:51:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 20 client.28109 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b1d59e0 0x56146b1d7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 4 client.28109 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56146b077050 con 0x56146b1d59e0 2023-09-13T09:51:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.757+0000 7fcc44d58700 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b1d59e0 0x56146b1d7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc1ffff700 10 client.28109 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc44d58700 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b1d59e0 0x56146b1d7e00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=efe44c55ab11996b server_cookie=901eaf12dc77b3de in_seq=0 out_seq=0 2023-09-13T09:51:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc1ffff700 1 -- 172.21.15.6:0/2476132847 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56146b077050 con 0x56146b1d59e0 2023-09-13T09:51:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc1ffff700 10 client.28109 handle_command_reply: tid=0 2023-09-13T09:51:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 client.28109 shutdown 2023-09-13T09:51:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 msgr2=0x56146b178870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b178870 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c099450 tx=0x7fcc2c0c97b0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 shutdown_connections 2023-09-13T09:51:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56146b1d59e0 0x56146b1d7e00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56146b16d060 0x56146b17b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc1ffff700 0 client.28109 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:51:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56146b16ba00 0x56146b178330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 --2- 172.21.15.6:0/2476132847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56146b16c700 0x56146b178870 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 >> 172.21.15.6:0/2476132847 conn(0x56146b0c9c80 msgr2=0x56146b165e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 shutdown_connections 2023-09-13T09:51:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.758+0000 7fcc531a1b80 1 -- 172.21.15.6:0/2476132847 wait complete. 2023-09-13T09:51:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc531a1b80 20 client.28109 trim_cache size 0 max 16384 2023-09-13T09:51:44.806 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc300a0640 msgr2=0x7fcc300a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc300a0640 0x7fcc300a2b00 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fcc40101dd0 tx=0x7fcc34009260 comp rx=0 tx=0).stop 2023-09-13T09:51:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40101f70 msgr2=0x7fcc400730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40101f70 0x7fcc400730a0 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fcc2c00e9a0 tx=0x7fcc2c00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 shutdown_connections 2023-09-13T09:51:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc40102910 0x7fcc400735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcc40100d80 0x7fcc40074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcc300a0640 0x7fcc300a2b00 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 --2- 172.21.15.6:0/2670939551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc40101f70 0x7fcc400730a0 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 >> 172.21.15.6:0/2670939551 conn(0x7fcc400fc310 msgr2=0x7fcc401053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 shutdown_connections 2023-09-13T09:51:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.759+0000 7fcc46fbc700 1 -- 172.21.15.6:0/2670939551 wait complete. 2023-09-13T09:51:44.811 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:51:44.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/3109692378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f981008c0 msgr2=0x7f7f98108160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/3109692378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f981008c0 0x7f7f98108160 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000b0a0 tx=0x7f7f9000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/3109692378 shutdown_connections 2023-09-13T09:51:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/3109692378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f981008c0 0x7f7f98108160 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/3109692378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f98101340 0x7f7f98101760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/3109692378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f980fff00 0x7f7f98100380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/3109692378 >> 172.21.15.6:0/3109692378 conn(0x7f7f980fa9b0 msgr2=0x7f7f980fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/3109692378 shutdown_connections 2023-09-13T09:51:44.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.941+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/3109692378 wait complete. 2023-09-13T09:51:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 Processor -- start 2023-09-13T09:51:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 -- start start 2023-09-13T09:51:44.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f980fff00 0x7f7f98195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f981008c0 0x7f7f98195fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98101340 0x7f7f9819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9819d5f0 con 0x7f7f980fff00 2023-09-13T09:51:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9819d730 con 0x7f7f98101340 2023-09-13T09:51:44.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9cbf1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9819d8c0 con 0x7f7f981008c0 2023-09-13T09:51:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f980fff00 0x7f7f98195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f980fff00 0x7f7f98195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41598/0 (socket says 172.21.15.6:41598) 2023-09-13T09:51:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 -- 172.21.15.6:0/346360081 learned_addr learned my addr 172.21.15.6:0/346360081 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98101340 0x7f7f9819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f981008c0 0x7f7f98195fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 -- 172.21.15.6:0/346360081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f981008c0 msgr2=0x7f7f98195fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f981008c0 0x7f7f98195fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 -- 172.21.15.6:0/346360081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98101340 msgr2=0x7f7f9819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98101340 0x7f7f9819d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 -- 172.21.15.6:0/346360081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f90009d00 con 0x7f7f980fff00 2023-09-13T09:51:44.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.942+0000 7f7f9659c700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f980fff00 0x7f7f98195a70 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e9a0 tx=0x7f7f8800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.943+0000 7f7f877fe700 1 -- 172.21.15.6:0/346360081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88009790 con 0x7f7f980fff00 2023-09-13T09:51:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.943+0000 7f7f877fe700 1 -- 172.21.15.6:0/346360081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f88010430 con 0x7f7f980fff00 2023-09-13T09:51:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.943+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9819dba0 con 0x7f7f980fff00 2023-09-13T09:51:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.943+0000 7f7f877fe700 1 -- 172.21.15.6:0/346360081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88018680 con 0x7f7f980fff00 2023-09-13T09:51:44.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.943+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9819e100 con 0x7f7f980fff00 2023-09-13T09:51:44.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.946+0000 7f7f877fe700 1 -- 172.21.15.6:0/346360081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7f880105a0 con 0x7f7f980fff00 2023-09-13T09:51:44.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.946+0000 7f7f877fe700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f800a06c0 0x7f7f800a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.946+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f800a06c0 0x7f7f800a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.946+0000 7f7f877fe700 1 -- 172.21.15.6:0/346360081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f88014070 con 0x7f7f980fff00 2023-09-13T09:51:44.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f800a06c0 0x7f7f800a2b80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009c60 tx=0x7f7f8c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 Processor -- start 2023-09-13T09:51:44.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 -- start start 2023-09-13T09:51:44.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549ccf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549cd4d0 0x5580549cd950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549dc3d0 0x5580549de7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55805492b780 con 0x5580549dc3d0 2023-09-13T09:51:44.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580549290a0 con 0x5580549ce980 2023-09-13T09:51:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558054924990 con 0x5580549cd4d0 2023-09-13T09:51:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7f96d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549dc3d0 0x5580549de7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549ccf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7f96d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549dc3d0 0x5580549de7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41610/0 (socket says 172.21.15.6:41610) 2023-09-13T09:51:44.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7f96d9d700 1 -- 172.21.15.6:0/369346397 learned_addr learned my addr 172.21.15.6:0/369346397 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.947+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549cd4d0 0x5580549cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f96d9d700 1 -- 172.21.15.6:0/369346397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549cd4d0 msgr2=0x5580549cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549cd4d0 0x5580549cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f96d9d700 1 -- 172.21.15.6:0/369346397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 msgr2=0x5580549ccf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549ccf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f96d9d700 1 -- 172.21.15.6:0/369346397 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580547a4630 con 0x5580549dc3d0 2023-09-13T09:51:44.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f9659c700 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549dc3d0 0x5580549de7c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009c40 tx=0x7f7f90009c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e665be3aac49df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f84ff9700 1 -- 172.21.15.6:0/369346397 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9000e040 con 0x5580549dc3d0 2023-09-13T09:51:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f84ff9700 1 -- 172.21.15.6:0/369346397 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f9000bab0 con 0x5580549dc3d0 2023-09-13T09:51:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.948+0000 7f7f84ff9700 1 -- 172.21.15.6:0/369346397 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f9001c6a0 con 0x5580549dc3d0 2023-09-13T09:51:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/369346397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549dc3d0 msgr2=0x5580549de7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549dc3d0 0x5580549de7c0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009c40 tx=0x7f7f90009c70 comp rx=0 tx=0).stop 2023-09-13T09:51:44.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/369346397 shutdown_connections 2023-09-13T09:51:44.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549dc3d0 0x5580549de7c0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549ccf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/369346397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549cd4d0 0x5580549cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/369346397 >> 172.21.15.6:0/369346397 conn(0x558054930c80 msgr2=0x5580549cf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/369346397 shutdown_connections 2023-09-13T09:51:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/369346397 wait complete. 2023-09-13T09:51:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 -- start start 2023-09-13T09:51:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.949+0000 7f7fa8dd6b80 1 Processor -- start 2023-09-13T09:51:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549cd4d0 0x5580549e0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549e07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e7800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580548c2bb0 con 0x5580549cd4d0 2023-09-13T09:51:44.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580548c28b0 con 0x5580549ce980 2023-09-13T09:51:44.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580547a6920 con 0x5580549dc3d0 2023-09-13T09:51:44.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 10 client.0 _ll_register_callbacks cb 0x5580548c0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549cd4d0 0x5580549e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549cd4d0 0x5580549e0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41612/0 (socket says 172.21.15.6:41612) 2023-09-13T09:51:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 -- 172.21.15.6:0/1660279152 learned_addr learned my addr 172.21.15.6:0/1660279152 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549e07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 -- 172.21.15.6:0/1660279152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 msgr2=0x5580549e7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 -- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 msgr2=0x5580549e07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549e07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 -- 172.21.15.6:0/1660279152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f98108b10 con 0x5580549cd4d0 2023-09-13T09:51:44.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549e07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f9659c700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549cd4d0 0x5580549e0280 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7f880c9b60 tx=0x7f7f88099be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c466e807ee7e8443 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f7dffb700 1 -- 172.21.15.6:0/1660279152 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88099540 con 0x5580549cd4d0 2023-09-13T09:51:44.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7f7dffb700 1 -- 172.21.15.6:0/1660279152 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f8809d310 con 0x5580549cd4d0 2023-09-13T09:51:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.950+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580549c5670 con 0x5580549cd4d0 2023-09-13T09:51:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7f7dffb700 1 -- 172.21.15.6:0/1660279152 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f880a1550 con 0x5580549cd4d0 2023-09-13T09:51:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 10 client.18729 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55805493c7a0 con 0x5580549cd4d0 2023-09-13T09:51:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7f7dffb700 1 -- 172.21.15.6:0/1660279152 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f8807c080 con 0x5580549cd4d0 2023-09-13T09:51:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7f7dffb700 1 -- 172.21.15.6:0/1660279152 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7f880a10c0 con 0x5580549cd4d0 2023-09-13T09:51:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 10 client.18729 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 10 client.18729 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:44.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 20 client.18729 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5580549ec030 0x5580549ee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 4 client.18729 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:44.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55805491d970 con 0x5580549ec030 2023-09-13T09:51:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.951+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5580549ec030 0x5580549ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.952+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5580549ec030 0x5580549ee450 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=902afcbcabc3e369 server_cookie=d25ebe65cad4a3c3 in_seq=0 out_seq=0 2023-09-13T09:51:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.952+0000 7f7f7dffb700 10 client.18729 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7f7dffb700 1 -- 172.21.15.6:0/1660279152 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55805491d970 con 0x5580549ec030 2023-09-13T09:51:44.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7f7dffb700 10 client.18729 handle_command_reply: tid=0 2023-09-13T09:51:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 client.18729 shutdown 2023-09-13T09:51:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549cd4d0 msgr2=0x5580549e0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549cd4d0 0x5580549e0280 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f7f880c9b60 tx=0x7f7f88099be0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 shutdown_connections 2023-09-13T09:51:44.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5580549ec030 0x5580549ee450 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549cd4d0 0x5580549e0280 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7f7dffb700 0 client.18729 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/1660279152 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549ce980 0x5580549e07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 >> 172.21.15.6:0/1660279152 conn(0x558054930c80 msgr2=0x5580549d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 shutdown_connections 2023-09-13T09:51:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/1660279152 wait complete. 2023-09-13T09:51:44.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.953+0000 7f7fa8dd6b80 20 client.18729 trim_cache size 0 max 16384 2023-09-13T09:51:44.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 Processor -- start 2023-09-13T09:51:44.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 -- start start 2023-09-13T09:51:44.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549d1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549cce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580549d9090 con 0x5580549ce980 2023-09-13T09:51:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580549ebdc0 con 0x5580549cd4d0 2023-09-13T09:51:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580549f3190 con 0x5580549dc3d0 2023-09-13T09:51:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41622/0 (socket says 172.21.15.6:41622) 2023-09-13T09:51:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.966+0000 7f7f95d9b700 1 -- 172.21.15.6:0/2475083201 learned_addr learned my addr 172.21.15.6:0/2475083201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549cce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f9659c700 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549d1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f95d9b700 1 -- 172.21.15.6:0/2475083201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 msgr2=0x5580549cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549cce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f95d9b700 1 -- 172.21.15.6:0/2475083201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 msgr2=0x5580549d1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549d1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f95d9b700 1 -- 172.21.15.6:0/2475083201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558054750de0 con 0x5580549ce980 2023-09-13T09:51:44.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f95d9b700 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e77c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c013010 tx=0x7f7f8c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e215b44277b9fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f857fa700 1 -- 172.21.15.6:0/2475083201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c022030 con 0x5580549ce980 2023-09-13T09:51:44.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f857fa700 1 -- 172.21.15.6:0/2475083201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f8c023040 con 0x5580549ce980 2023-09-13T09:51:44.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.967+0000 7f7f857fa700 1 -- 172.21.15.6:0/2475083201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c01d670 con 0x5580549ce980 2023-09-13T09:51:44.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/2475083201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 msgr2=0x5580549e77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e77c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c013010 tx=0x7f7f8c014000 comp rx=0 tx=0).stop 2023-09-13T09:51:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/2475083201 shutdown_connections 2023-09-13T09:51:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549cce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549d1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/2475083201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e77c0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/2475083201 >> 172.21.15.6:0/2475083201 conn(0x558054930c80 msgr2=0x5580549def90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:44.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/2475083201 shutdown_connections 2023-09-13T09:51:44.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/2475083201 wait complete. 2023-09-13T09:51:44.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- start start 2023-09-13T09:51:44.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 Processor -- start 2023-09-13T09:51:44.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549e5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580549e6cb0 con 0x5580549ce980 2023-09-13T09:51:44.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580549e6e20 con 0x5580549cd4d0 2023-09-13T09:51:44.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580549e6fe0 con 0x5580549dc3d0 2023-09-13T09:51:44.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.968+0000 7f7fa8dd6b80 10 client.0 _ll_register_callbacks cb 0x5580548c0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:44.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549e5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f96d9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f95d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41626/0 (socket says 172.21.15.6:41626) 2023-09-13T09:51:44.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f95d9b700 1 -- 172.21.15.6:0/562387178 learned_addr learned my addr 172.21.15.6:0/562387178 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:44.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f9659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549e5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35152/0 (socket says 172.21.15.6:35152) 2023-09-13T09:51:44.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f96d9d700 1 -- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 msgr2=0x5580549e5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549e5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f96d9d700 1 -- 172.21.15.6:0/562387178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 msgr2=0x5580549e5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:44.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f96d9d700 1 -- 172.21.15.6:0/562387178 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c017070 con 0x5580549dc3d0 2023-09-13T09:51:44.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f9659c700 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549e5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:44.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f96d9d700 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e6770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000b3f0 tx=0x7f7f90009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e12d8bb5e5abfc13 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:44.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.969+0000 7f7f7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:51:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.971+0000 7f7f7dffb700 1 -- 172.21.15.6:0/562387178 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90029070 con 0x5580549dc3d0 2023-09-13T09:51:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.971+0000 7f7f7dffb700 1 -- 172.21.15.6:0/562387178 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f90007770 con 0x5580549dc3d0 2023-09-13T09:51:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.971+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f9000bab0 con 0x5580549dc3d0 2023-09-13T09:51:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.971+0000 7f7f7dffb700 1 -- 172.21.15.6:0/562387178 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f9000e040 con 0x5580549dc3d0 2023-09-13T09:51:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 10 client.28045 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x558054739c60 con 0x5580549dc3d0 2023-09-13T09:51:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7f7dffb700 1 -- 172.21.15.6:0/562387178 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f9000bab0 con 0x5580549dc3d0 2023-09-13T09:51:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7f7dffb700 1 -- 172.21.15.6:0/562387178 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7f90019030 con 0x5580549dc3d0 2023-09-13T09:51:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 10 client.28045 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 10 client.28045 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 20 client.28045 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558054a40680 0x558054a42aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 4 client.28045 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:51:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5580548de050 con 0x558054a40680 2023-09-13T09:51:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7f9659c700 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558054a40680 0x558054a42aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7f7dffb700 10 client.28045 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.972+0000 7f7f9659c700 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558054a40680 0x558054a42aa0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7051905db4754efb server_cookie=918c97a804412f67 in_seq=0 out_seq=0 2023-09-13T09:51:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7f7dffb700 1 -- 172.21.15.6:0/562387178 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5580548de050 con 0x558054a40680 2023-09-13T09:51:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7f7dffb700 10 client.28045 handle_command_reply: tid=0 2023-09-13T09:51:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 client.28045 shutdown 2023-09-13T09:51:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 msgr2=0x5580549e6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e6770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f9000b3f0 tx=0x7f7f90009550 comp rx=0 tx=0).stop 2023-09-13T09:51:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 shutdown_connections 2023-09-13T09:51:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5580549dc3d0 0x5580549e6770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5580549cd4d0 0x5580549e5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558054a40680 0x558054a42aa0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 --2- 172.21.15.6:0/562387178 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5580549ce980 0x5580549e5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7f7dffb700 0 client.28045 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 >> 172.21.15.6:0/562387178 conn(0x558054930c80 msgr2=0x5580549dbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 shutdown_connections 2023-09-13T09:51:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 1 -- 172.21.15.6:0/562387178 wait complete. 2023-09-13T09:51:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7fa8dd6b80 20 client.28045 trim_cache size 0 max 16384 2023-09-13T09:51:45.001 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:51:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f800a06c0 msgr2=0x7f7f800a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f800a06c0 0x7f7f800a2b80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7f8c009c60 tx=0x7f7f8c009260 comp rx=0 tx=0).stop 2023-09-13T09:51:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f980fff00 msgr2=0x7f7f98195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:45.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.973+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f980fff00 0x7f7f98195a70 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7f8800e9a0 tx=0x7f7f8800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 shutdown_connections 2023-09-13T09:51:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f98101340 0x7f7f9819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f800a06c0 0x7f7f800a2b80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f980fff00 0x7f7f98195a70 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 --2- 172.21.15.6:0/346360081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f981008c0 0x7f7f98195fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 >> 172.21.15.6:0/346360081 conn(0x7f7f980fa9b0 msgr2=0x7f7f981043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 shutdown_connections 2023-09-13T09:51:45.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:44.974+0000 7f7f9cbf1700 1 -- 172.21.15.6:0/346360081 wait complete. 2023-09-13T09:51:45.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 770787 6.74 MB/sec execute 545 sec latency 23.796 ms 2023-09-13T09:51:46.006 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:51:46.006 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:51:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 -- 172.21.15.6:0/2583340815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100eb0 msgr2=0x7fd70c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2583340815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100eb0 0x7fd70c101310 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fd7000099c0 tx=0x7fd700009cd0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 -- 172.21.15.6:0/2583340815 shutdown_connections 2023-09-13T09:51:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2583340815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c101850 0x7fd70c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2583340815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c0ffcc0 0x7fd70c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2583340815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c100eb0 0x7fd70c101310 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 -- 172.21.15.6:0/2583340815 >> 172.21.15.6:0/2583340815 conn(0x7fd70c0fb250 msgr2=0x7fd70c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 -- 172.21.15.6:0/2583340815 shutdown_connections 2023-09-13T09:51:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 -- 172.21.15.6:0/2583340815 wait complete. 2023-09-13T09:51:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.139+0000 7fd7115fc700 1 Processor -- start 2023-09-13T09:51:46.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd7115fc700 1 -- start start 2023-09-13T09:51:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd7115fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffcc0 0x7fd70c1959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd7115fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c100eb0 0x7fd70c195ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd7115fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101850 0x7fd70c19cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd7115fc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19d530 con 0x7fd70c101850 2023-09-13T09:51:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd7115fc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19d670 con 0x7fd70c100eb0 2023-09-13T09:51:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd7115fc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70c19d800 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffcc0 0x7fd70c1959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffcc0 0x7fd70c1959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44696/0 (socket says 172.21.15.6:44696) 2023-09-13T09:51:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101850 0x7fd70c19cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 -- 172.21.15.6:0/2795167960 learned_addr learned my addr 172.21.15.6:0/2795167960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c100eb0 0x7fd70c195ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 -- 172.21.15.6:0/2795167960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c100eb0 msgr2=0x7fd70c195ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c100eb0 0x7fd70c195ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 -- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101850 msgr2=0x7fd70c19cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101850 0x7fd70c19cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 -- 172.21.15.6:0/2795167960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7000095f0 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101850 0x7fd70c19cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.140+0000 7fd70affd700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffcc0 0x7fd70c1959b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00e970 tx=0x7fd6fc00ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.141+0000 7fd6f3fff700 1 -- 172.21.15.6:0/2795167960 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc009790 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.141+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd70c19dae0 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.141+0000 7fd6f3fff700 1 -- 172.21.15.6:0/2795167960 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6fc00c7e0 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.141+0000 7fd6f3fff700 1 -- 172.21.15.6:0/2795167960 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc003c70 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.141+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c19dff0 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.143+0000 7fd6f3fff700 1 -- 172.21.15.6:0/2795167960 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd6fc00cc50 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.143+0000 7fd6f3fff700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f40a0640 0x7fd6f40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd6f3fff700 1 -- 172.21.15.6:0/2795167960 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6fc014070 con 0x7fd70c0ffcc0 2023-09-13T09:51:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f40a0640 0x7fd6f40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 Processor -- start 2023-09-13T09:51:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f40a0640 0x7fd6f40a2b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd70000b580 tx=0x7fd700005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 -- start start 2023-09-13T09:51:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 0x56014a44fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a44e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a3a7800 con 0x56014a4500e0 2023-09-13T09:51:46.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a3a5120 con 0x56014a44ea80 2023-09-13T09:51:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a3a0a10 con 0x56014a44f780 2023-09-13T09:51:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd70a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a44e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.144+0000 7fd70a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a44e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41652/0 (socket says 172.21.15.6:41652) 2023-09-13T09:51:46.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2996674982 learned_addr learned my addr 172.21.15.6:0/2996674982 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2996674982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 msgr2=0x56014a44fba0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:51:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 0x56014a44fba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2996674982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 msgr2=0x56014a44ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2996674982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56014a2206b0 con 0x56014a4500e0 2023-09-13T09:51:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a44e540 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd7000099c0 tx=0x7fd70001f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3eec952f40f14df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd6f17fa700 1 -- 172.21.15.6:0/2996674982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70002b070 con 0x56014a4500e0 2023-09-13T09:51:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd6f17fa700 1 -- 172.21.15.6:0/2996674982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd70001e040 con 0x56014a4500e0 2023-09-13T09:51:46.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.145+0000 7fd6f17fa700 1 -- 172.21.15.6:0/2996674982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700024930 con 0x56014a4500e0 2023-09-13T09:51:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2996674982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 msgr2=0x56014a44e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a44e540 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fd7000099c0 tx=0x7fd70001f000 comp rx=0 tx=0).stop 2023-09-13T09:51:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2996674982 shutdown_connections 2023-09-13T09:51:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 0x56014a44fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2996674982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a44e540 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2996674982 >> 172.21.15.6:0/2996674982 conn(0x56014a3acd00 msgr2=0x56014a448f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2996674982 shutdown_connections 2023-09-13T09:51:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2996674982 wait complete. 2023-09-13T09:51:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.146+0000 7fd71d7e1b80 1 -- start start 2023-09-13T09:51:46.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 1 Processor -- start 2023-09-13T09:51:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44ea80 0x56014a457f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44f780 0x56014a458490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a4500e0 0x56014a45f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a33ec30 con 0x56014a44f780 2023-09-13T09:51:46.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a33e930 con 0x56014a4500e0 2023-09-13T09:51:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a2229a0 con 0x56014a44ea80 2023-09-13T09:51:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd71d7e1b80 10 client.0 _ll_register_callbacks cb 0x56014a33c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44f780 0x56014a458490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44ea80 0x56014a457f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44f780 0x56014a458490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41658/0 (socket says 172.21.15.6:41658) 2023-09-13T09:51:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2192772859 learned_addr learned my addr 172.21.15.6:0/2192772859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a4500e0 0x56014a45f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2192772859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44ea80 msgr2=0x56014a457f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44ea80 0x56014a457f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a4500e0 msgr2=0x56014a45f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a4500e0 0x56014a45f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.147+0000 7fd70a7fc700 1 -- 172.21.15.6:0/2192772859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd70c108a50 con 0x56014a44f780 2023-09-13T09:51:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44f780 0x56014a458490 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fd700009ff0 tx=0x7fd70000b670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f079d23359cae631 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd6eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2192772859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd70002b040 con 0x56014a44f780 2023-09-13T09:51:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2192772859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd700003c10 con 0x56014a44f780 2023-09-13T09:51:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56014a4416f0 con 0x56014a44f780 2023-09-13T09:51:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2192772859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd700003dd0 con 0x56014a44f780 2023-09-13T09:51:46.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd71d7e1b80 10 client.18747 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56014a3b8820 con 0x56014a44f780 2023-09-13T09:51:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2192772859 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56014a4416f0 con 0x56014a44f780 2023-09-13T09:51:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2192772859 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd7000395f0 con 0x56014a44f780 2023-09-13T09:51:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd71d7e1b80 10 client.18747 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd71d7e1b80 10 client.18747 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:46.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd71d7e1b80 20 client.18747 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.148+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a463870 0x56014a465c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.149+0000 7fd71d7e1b80 4 client.18747 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.149+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56014a3999f0 con 0x56014a463870 2023-09-13T09:51:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.149+0000 7fd70affd700 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a463870 0x56014a465c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.149+0000 7fd6eeff5700 10 client.18747 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.149+0000 7fd70affd700 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a463870 0x56014a465c90 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b0671001bb25635 server_cookie=4d2f56a50906d077 in_seq=0 out_seq=0 2023-09-13T09:51:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2192772859 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56014a3999f0 con 0x56014a463870 2023-09-13T09:51:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd6eeff5700 10 client.18747 handle_command_reply: tid=0 2023-09-13T09:51:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 client.18747 shutdown 2023-09-13T09:51:46.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44f780 msgr2=0x56014a458490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44f780 0x56014a458490 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fd700009ff0 tx=0x7fd70000b670 comp rx=0 tx=0).stop 2023-09-13T09:51:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 shutdown_connections 2023-09-13T09:51:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a4500e0 0x56014a45f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44ea80 0x56014a457f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a463870 0x56014a465c90 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2192772859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44f780 0x56014a458490 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd6eeff5700 0 client.18747 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 >> 172.21.15.6:0/2192772859 conn(0x56014a3acd00 msgr2=0x56014a443870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 shutdown_connections 2023-09-13T09:51:46.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2192772859 wait complete. 2023-09-13T09:51:46.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.150+0000 7fd71d7e1b80 20 client.18747 trim_cache size 0 max 16384 2023-09-13T09:51:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 Processor -- start 2023-09-13T09:51:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 -- start start 2023-09-13T09:51:46.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 0x56014a456570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a442960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a457ac0 con 0x56014a4500e0 2023-09-13T09:51:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a449a10 con 0x56014a44ea80 2023-09-13T09:51:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a445960 con 0x56014a44f780 2023-09-13T09:51:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a442960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd70b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a442960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41668/0 (socket says 172.21.15.6:41668) 2023-09-13T09:51:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd70b7fe700 1 -- 172.21.15.6:0/2502270807 learned_addr learned my addr 172.21.15.6:0/2502270807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd70affd700 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.167+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 0x56014a456570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd70b7fe700 1 -- 172.21.15.6:0/2502270807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 msgr2=0x56014a456570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 0x56014a456570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd70b7fe700 1 -- 172.21.15.6:0/2502270807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 msgr2=0x56014a44e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd70b7fe700 1 -- 172.21.15.6:0/2502270807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56014a1cce60 con 0x56014a4500e0 2023-09-13T09:51:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd70affd700 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a442960 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fd70400e9d0 tx=0x7fd704009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ad13bb3d209c1c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd6f1ffb700 1 -- 172.21.15.6:0/2502270807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704017a40 con 0x56014a4500e0 2023-09-13T09:51:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd6f1ffb700 1 -- 172.21.15.6:0/2502270807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd70400f040 con 0x56014a4500e0 2023-09-13T09:51:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.168+0000 7fd6f1ffb700 1 -- 172.21.15.6:0/2502270807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7040073e0 con 0x56014a4500e0 2023-09-13T09:51:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2502270807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 msgr2=0x56014a442960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a442960 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fd70400e9d0 tx=0x7fd704009920 comp rx=0 tx=0).stop 2023-09-13T09:51:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2502270807 shutdown_connections 2023-09-13T09:51:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a4500e0 0x56014a442960 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44ea80 0x56014a44e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2502270807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a44f780 0x56014a456570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2502270807 >> 172.21.15.6:0/2502270807 conn(0x56014a3acd00 msgr2=0x56014a455e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2502270807 shutdown_connections 2023-09-13T09:51:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2502270807 wait complete. 2023-09-13T09:51:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 -- start start 2023-09-13T09:51:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.169+0000 7fd71d7e1b80 1 Processor -- start 2023-09-13T09:51:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44ea80 0x56014a4b4380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44f780 0x56014a4b48c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a4500e0 0x56014a4bb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a4bbe40 con 0x56014a44ea80 2023-09-13T09:51:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a4bbf80 con 0x56014a44f780 2023-09-13T09:51:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56014a4bc110 con 0x56014a4500e0 2023-09-13T09:51:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 10 client.0 _ll_register_callbacks cb 0x56014a33c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:46.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44ea80 0x56014a4b4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44ea80 0x56014a4b4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41670/0 (socket says 172.21.15.6:41670) 2023-09-13T09:51:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 -- 172.21.15.6:0/2165481653 learned_addr learned my addr 172.21.15.6:0/2165481653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44f780 0x56014a4b48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a4500e0 0x56014a4bb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 -- 172.21.15.6:0/2165481653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a4500e0 msgr2=0x56014a4bb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a4500e0 0x56014a4bb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 -- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44f780 msgr2=0x56014a4b48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44f780 0x56014a4b48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 -- 172.21.15.6:0/2165481653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc095040 con 0x56014a44ea80 2023-09-13T09:51:46.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd70affd700 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44ea80 0x56014a4b4380 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc095fc0 tx=0x7fd6fc003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72be24e977dbe5f0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd6eeff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2165481653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc0a15c0 con 0x56014a44ea80 2023-09-13T09:51:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd70001e040 con 0x56014a44ea80 2023-09-13T09:51:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2165481653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6fc0978f0 con 0x56014a44ea80 2023-09-13T09:51:46.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2165481653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6fc065240 con 0x56014a44ea80 2023-09-13T09:51:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.170+0000 7fd71d7e1b80 10 client.18753 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7fd70400e680 con 0x56014a44ea80 2023-09-13T09:51:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2165481653 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd6fc07c080 con 0x56014a44ea80 2023-09-13T09:51:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2165481653 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd6fc0840b0 con 0x56014a44ea80 2023-09-13T09:51:46.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd71d7e1b80 10 client.18753 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd71d7e1b80 10 client.18753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd71d7e1b80 20 client.18753 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a4bdba0 0x56014a4bffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd71d7e1b80 4 client.18753 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:51:46.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56014a35a0d0 con 0x56014a4bdba0 2023-09-13T09:51:46.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.171+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a4bdba0 0x56014a4bffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.172+0000 7fd6eeff5700 10 client.18753 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.172+0000 7fd70a7fc700 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a4bdba0 0x56014a4bffc0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3345bfef8361c19f server_cookie=470bea72a26bac12 in_seq=0 out_seq=0 2023-09-13T09:51:46.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd6eeff5700 1 -- 172.21.15.6:0/2165481653 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56014a35a0d0 con 0x56014a4bdba0 2023-09-13T09:51:46.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd6eeff5700 10 client.18753 handle_command_reply: tid=0 2023-09-13T09:51:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 client.18753 shutdown 2023-09-13T09:51:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44ea80 msgr2=0x56014a4b4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44ea80 0x56014a4b4380 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc095fc0 tx=0x7fd6fc003710 comp rx=0 tx=0).stop 2023-09-13T09:51:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 shutdown_connections 2023-09-13T09:51:46.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56014a4500e0 0x56014a4bb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56014a4bdba0 0x56014a4bffc0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56014a44ea80 0x56014a4b4380 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 --2- 172.21.15.6:0/2165481653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56014a44f780 0x56014a4b48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 >> 172.21.15.6:0/2165481653 conn(0x56014a3acd00 msgr2=0x56014a44d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.173+0000 7fd6eeff5700 0 client.18753 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 shutdown_connections 2023-09-13T09:51:46.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd71d7e1b80 1 -- 172.21.15.6:0/2165481653 wait complete. 2023-09-13T09:51:46.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd71d7e1b80 20 client.18753 trim_cache size 0 max 16384 2023-09-13T09:51:46.196 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:51:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:51:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "5a03d0d3-3a48-4544-9249-b66344d24ad2", 2023-09-13T09:51:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:51:46.197 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:51:46.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f40a0640 msgr2=0x7fd6f40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f40a0640 0x7fd6f40a2b00 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd70000b580 tx=0x7fd700005fb0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffcc0 msgr2=0x7fd70c1959b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffcc0 0x7fd70c1959b0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc00e970 tx=0x7fd6fc00ec80 comp rx=0 tx=0).stop 2023-09-13T09:51:46.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 shutdown_connections 2023-09-13T09:51:46.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6f40a0640 0x7fd6f40a2b00 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd70c101850 0x7fd70c19cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd70c0ffcc0 0x7fd70c1959b0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 --2- 172.21.15.6:0/2795167960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd70c100eb0 0x7fd70c195ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 >> 172.21.15.6:0/2795167960 conn(0x7fd70c0fb250 msgr2=0x7fd70c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 shutdown_connections 2023-09-13T09:51:46.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.174+0000 7fd7115fc700 1 -- 172.21.15.6:0/2795167960 wait complete. 2023-09-13T09:51:46.201 INFO:tasks.workunit.client.0.smithi006.stdout: 1 771901 6.74 MB/sec execute 546 sec latency 29.523 ms 2023-09-13T09:51:46.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:51:46.227 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:45 smithi006 ceph-mon[98665]: pgmap v667: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.3 MiB/s wr, 254 op/s 2023-09-13T09:51:46.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:45 smithi053 ceph-mon[102373]: pgmap v667: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.3 MiB/s wr, 254 op/s 2023-09-13T09:51:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:45 smithi131 ceph-mon[102785]: pgmap v667: 97 pgs: 97 active+clean; 297 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 771 KiB/s rd, 2.3 MiB/s wr, 254 op/s 2023-09-13T09:51:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 -- 172.21.15.6:0/914095977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 msgr2=0x7f17cc101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 --2- 172.21.15.6:0/914095977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 0x7f17cc101310 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009990 tx=0x7f17c0009ca0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 -- 172.21.15.6:0/914095977 shutdown_connections 2023-09-13T09:51:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 --2- 172.21.15.6:0/914095977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 --2- 172.21.15.6:0/914095977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 --2- 172.21.15.6:0/914095977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 0x7f17cc101310 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 -- 172.21.15.6:0/914095977 >> 172.21.15.6:0/914095977 conn(0x7f17cc0fb250 msgr2=0x7f17cc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 -- 172.21.15.6:0/914095977 shutdown_connections 2023-09-13T09:51:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.340+0000 7f17d1440700 1 -- 172.21.15.6:0/914095977 wait complete. 2023-09-13T09:51:46.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 Processor -- start 2023-09-13T09:51:46.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 -- start start 2023-09-13T09:51:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc10b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc100eb0 0x7f17cc109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc109f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc10a720 con 0x7f17cc101850 2023-09-13T09:51:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc10a890 con 0x7f17cc100eb0 2023-09-13T09:51:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17d1440700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc1a0b10 con 0x7f17cc0ffcc0 2023-09-13T09:51:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc109f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17ca7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc100eb0 0x7f17cc109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17ca7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc100eb0 0x7f17cc109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35208/0 (socket says 172.21.15.6:35208) 2023-09-13T09:51:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc109f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41686/0 (socket says 172.21.15.6:41686) 2023-09-13T09:51:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17ca7fc700 1 -- 172.21.15.6:0/3521431183 learned_addr learned my addr 172.21.15.6:0/3521431183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.341+0000 7f17caffd700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc10b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17cb7fe700 1 -- 172.21.15.6:0/3521431183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc0ffcc0 msgr2=0x7f17cc10b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc10b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17cb7fe700 1 -- 172.21.15.6:0/3521431183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc100eb0 msgr2=0x7f17cc109a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc100eb0 0x7f17cc109a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17cb7fe700 1 -- 172.21.15.6:0/3521431183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c00095f0 con 0x7f17cc101850 2023-09-13T09:51:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc109f80 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f17c400be20 tx=0x7f17c4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17b3fff700 1 -- 172.21.15.6:0/3521431183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400cb90 con 0x7f17cc101850 2023-09-13T09:51:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc1a0df0 con 0x7f17cc101850 2023-09-13T09:51:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17b3fff700 1 -- 172.21.15.6:0/3521431183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17c400ccf0 con 0x7f17cc101850 2023-09-13T09:51:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17b3fff700 1 -- 172.21.15.6:0/3521431183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4012670 con 0x7f17cc101850 2023-09-13T09:51:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.342+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc1a12f0 con 0x7f17cc101850 2023-09-13T09:51:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 Processor -- start 2023-09-13T09:51:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17b3fff700 1 -- 172.21.15.6:0/3521431183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f17c4014440 con 0x7f17cc101850 2023-09-13T09:51:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 -- start start 2023-09-13T09:51:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee991b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee992060 0x55e4ee9904c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee990a00 0x55e4ee990e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee8e9780 con 0x55e4ee991700 2023-09-13T09:51:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee8e70a0 con 0x55e4ee992060 2023-09-13T09:51:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.346+0000 7f17dd625b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee8e2990 con 0x55e4ee990a00 2023-09-13T09:51:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17ca7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee991b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee992060 0x55e4ee9904c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee992060 0x55e4ee9904c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35216/0 (socket says 172.21.15.6:35216) 2023-09-13T09:51:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17ca7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee991b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41690/0 (socket says 172.21.15.6:41690) 2023-09-13T09:51:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 -- 172.21.15.6:0/591560279 learned_addr learned my addr 172.21.15.6:0/591560279 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee990a00 0x55e4ee990e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17b3fff700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17b40a0640 0x7f17b40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 -- 172.21.15.6:0/591560279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee990a00 msgr2=0x55e4ee990e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee990a00 0x55e4ee990e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 -- 172.21.15.6:0/591560279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 msgr2=0x55e4ee991b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee991b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 -- 172.21.15.6:0/591560279 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ee762630 con 0x55e4ee992060 2023-09-13T09:51:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee990a00 0x55e4ee990e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:51:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17b40a0640 0x7f17b40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17b3fff700 1 -- 172.21.15.6:0/3521431183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17c4006e40 con 0x7f17cc101850 2023-09-13T09:51:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17caffd700 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee992060 0x55e4ee9904c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009d30 tx=0x7f17bc011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fca06cf61e257806 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17b17fa700 1 -- 172.21.15.6:0/591560279 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc004220 con 0x55e4ee992060 2023-09-13T09:51:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17b17fa700 1 -- 172.21.15.6:0/591560279 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17bc004380 con 0x55e4ee992060 2023-09-13T09:51:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.347+0000 7f17b17fa700 1 -- 172.21.15.6:0/591560279 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc0197d0 con 0x55e4ee992060 2023-09-13T09:51:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 -- 172.21.15.6:0/591560279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee992060 msgr2=0x55e4ee9904c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee992060 0x55e4ee9904c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009d30 tx=0x7f17bc011720 comp rx=0 tx=0).stop 2023-09-13T09:51:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17cb7fe700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17b40a0640 0x7f17b40a2b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f17c40c8f40 tx=0x7f17c4018500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 -- 172.21.15.6:0/591560279 shutdown_connections 2023-09-13T09:51:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee990a00 0x55e4ee990e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee991b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 --2- 172.21.15.6:0/591560279 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee992060 0x55e4ee9904c0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 -- 172.21.15.6:0/591560279 >> 172.21.15.6:0/591560279 conn(0x55e4ee8eec80 msgr2=0x55e4ee98af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 -- 172.21.15.6:0/591560279 shutdown_connections 2023-09-13T09:51:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.348+0000 7f17dd625b80 1 -- 172.21.15.6:0/591560279 wait complete. 2023-09-13T09:51:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 -- start start 2023-09-13T09:51:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 Processor -- start 2023-09-13T09:51:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee999ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee991700 0x55e4ee99a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee992060 0x55e4ee9a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee880bb0 con 0x55e4ee992060 2023-09-13T09:51:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee8808b0 con 0x55e4ee990a00 2023-09-13T09:51:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee764920 con 0x55e4ee991700 2023-09-13T09:51:46.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17dd625b80 10 client.0 _ll_register_callbacks cb 0x55e4ee87e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:46.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee999ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee999ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35222/0 (socket says 172.21.15.6:35222) 2023-09-13T09:51:46.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 -- 172.21.15.6:0/979195491 learned_addr learned my addr 172.21.15.6:0/979195491 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17caffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee991700 0x55e4ee99a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee992060 0x55e4ee9a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 -- 172.21.15.6:0/979195491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee991700 msgr2=0x55e4ee99a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee991700 0x55e4ee99a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 -- 172.21.15.6:0/979195491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 msgr2=0x55e4ee999ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee999ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17ca7fc700 1 -- 172.21.15.6:0/979195491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17bc009960 con 0x55e4ee992060 2023-09-13T09:51:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.349+0000 7f17caffd700 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee991700 0x55e4ee99a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:51:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee992060 0x55e4ee9a1460 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f17c0000c00 tx=0x7f17c0005960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad7df63b9b6c5ed9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17aeff5700 1 -- 172.21.15.6:0/979195491 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c001d070 con 0x55e4ee992060 2023-09-13T09:51:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17aeff5700 1 -- 172.21.15.6:0/979195491 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17c000fcd0 con 0x55e4ee992060 2023-09-13T09:51:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4ee983670 con 0x55e4ee992060 2023-09-13T09:51:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17aeff5700 1 -- 172.21.15.6:0/979195491 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17c000fe90 con 0x55e4ee992060 2023-09-13T09:51:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 10 client.18762 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e4ee8fa7a0 con 0x55e4ee992060 2023-09-13T09:51:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17aeff5700 1 -- 172.21.15.6:0/979195491 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17c0039080 con 0x55e4ee992060 2023-09-13T09:51:46.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17aeff5700 1 -- 172.21.15.6:0/979195491 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f17c0028520 con 0x55e4ee992060 2023-09-13T09:51:46.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 10 client.18762 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:46.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 10 client.18762 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:46.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 20 client.18762 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:46.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9a5c70 0x55e4ee9a8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 4 client.18762 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:51:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.350+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4ee8db970 con 0x55e4ee9a5c70 2023-09-13T09:51:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.351+0000 7f17caffd700 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9a5c70 0x55e4ee9a8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.351+0000 7f17caffd700 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9a5c70 0x55e4ee9a8090 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5c5c0833cb03b8 server_cookie=b996658c1b730bac in_seq=0 out_seq=0 2023-09-13T09:51:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.351+0000 7f17aeff5700 10 client.18762 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17aeff5700 1 -- 172.21.15.6:0/979195491 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e4ee8db970 con 0x55e4ee9a5c70 2023-09-13T09:51:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17aeff5700 10 client.18762 handle_command_reply: tid=0 2023-09-13T09:51:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 client.18762 shutdown 2023-09-13T09:51:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee992060 msgr2=0x55e4ee9a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee992060 0x55e4ee9a1460 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f17c0000c00 tx=0x7f17c0005960 comp rx=0 tx=0).stop 2023-09-13T09:51:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 shutdown_connections 2023-09-13T09:51:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9a5c70 0x55e4ee9a8090 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee992060 0x55e4ee9a1460 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee999ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 --2- 172.21.15.6:0/979195491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee991700 0x55e4ee99a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17aeff5700 0 client.18762 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 >> 172.21.15.6:0/979195491 conn(0x55e4ee8eec80 msgr2=0x55e4ee9857f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 shutdown_connections 2023-09-13T09:51:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 1 -- 172.21.15.6:0/979195491 wait complete. 2023-09-13T09:51:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.352+0000 7f17dd625b80 20 client.18762 trim_cache size 0 max 16384 2023-09-13T09:51:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.369+0000 7f17dd625b80 1 Processor -- start 2023-09-13T09:51:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17dd625b80 1 -- start start 2023-09-13T09:51:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee9904c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee9a1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee994920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17dd625b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee999ab0 con 0x55e4ee991700 2023-09-13T09:51:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17dd625b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee98cfd0 con 0x55e4ee990a00 2023-09-13T09:51:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17dd625b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee9878e0 con 0x55e4ee992060 2023-09-13T09:51:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee9a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee9a1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41708/0 (socket says 172.21.15.6:41708) 2023-09-13T09:51:46.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 -- 172.21.15.6:0/289693251 learned_addr learned my addr 172.21.15.6:0/289693251 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee9904c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee994920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 -- 172.21.15.6:0/289693251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 msgr2=0x55e4ee994920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee994920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 -- 172.21.15.6:0/289693251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 msgr2=0x55e4ee9904c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee9904c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 -- 172.21.15.6:0/289693251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4ee70ede0 con 0x55e4ee991700 2023-09-13T09:51:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.370+0000 7f17caffd700 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee9a1380 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009fb0 tx=0x7f17bc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5e7a72d1f862861 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17b1ffb700 1 -- 172.21.15.6:0/289693251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc029040 con 0x55e4ee991700 2023-09-13T09:51:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17b1ffb700 1 -- 172.21.15.6:0/289693251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17bc003780 con 0x55e4ee991700 2023-09-13T09:51:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17b1ffb700 1 -- 172.21.15.6:0/289693251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc005460 con 0x55e4ee991700 2023-09-13T09:51:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17dd625b80 1 -- 172.21.15.6:0/289693251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 msgr2=0x55e4ee9a1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17dd625b80 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee9a1380 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f17bc009fb0 tx=0x7f17bc011720 comp rx=0 tx=0).stop 2023-09-13T09:51:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17dd625b80 1 -- 172.21.15.6:0/289693251 shutdown_connections 2023-09-13T09:51:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17dd625b80 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee994920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17dd625b80 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee9904c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17dd625b80 1 --2- 172.21.15.6:0/289693251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee9a1380 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.371+0000 7f17dd625b80 1 -- 172.21.15.6:0/289693251 >> 172.21.15.6:0/289693251 conn(0x55e4ee8eec80 msgr2=0x55e4ee98ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 -- 172.21.15.6:0/289693251 shutdown_connections 2023-09-13T09:51:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 -- 172.21.15.6:0/289693251 wait complete. 2023-09-13T09:51:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 -- start start 2023-09-13T09:51:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 Processor -- start 2023-09-13T09:51:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee99d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee99dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee9a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee9a1040 con 0x55e4ee991700 2023-09-13T09:51:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee9a11b0 con 0x55e4ee990a00 2023-09-13T09:51:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4ee9a1370 con 0x55e4ee992060 2023-09-13T09:51:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17dd625b80 10 client.0 _ll_register_callbacks cb 0x55e4ee87e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:51:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee99dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee99dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41714/0 (socket says 172.21.15.6:41714) 2023-09-13T09:51:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17caffd700 1 -- 172.21.15.6:0/3610150055 learned_addr learned my addr 172.21.15.6:0/3610150055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:51:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.372+0000 7f17ca7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee99d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee9a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17caffd700 1 -- 172.21.15.6:0/3610150055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 msgr2=0x55e4ee9a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17caffd700 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee9a0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17caffd700 1 -- 172.21.15.6:0/3610150055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 msgr2=0x55e4ee99d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:51:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17caffd700 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee99d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17caffd700 1 -- 172.21.15.6:0/3610150055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e4ee762630 con 0x55e4ee991700 2023-09-13T09:51:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17caffd700 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee99dae0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f17bc01b040 tx=0x7f17bc02a240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8862782dcff85d17 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:51:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17aeff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:51:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17aeff5700 1 -- 172.21.15.6:0/3610150055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17bc029050 con 0x55e4ee991700 2023-09-13T09:51:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17aeff5700 1 -- 172.21.15.6:0/3610150055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17bc0053e0 con 0x55e4ee991700 2023-09-13T09:51:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17bc004380 con 0x55e4ee991700 2023-09-13T09:51:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17aeff5700 1 -- 172.21.15.6:0/3610150055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17bc0055a0 con 0x55e4ee991700 2023-09-13T09:51:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17dd625b80 10 client.18768 fetch_fsmap learned FSMap version 34 2023-09-13T09:51:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e4ee6f7c60 con 0x55e4ee991700 2023-09-13T09:51:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.373+0000 7f17aeff5700 1 -- 172.21.15.6:0/3610150055 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17bc004380 con 0x55e4ee991700 2023-09-13T09:51:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17aeff5700 1 -- 172.21.15.6:0/3610150055 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f17bc011440 con 0x55e4ee991700 2023-09-13T09:51:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17dd625b80 10 client.18768 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:51:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17dd625b80 10 client.18768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:51:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17dd625b80 20 client.18768 populate_metadata read hostname 'smithi006' 2023-09-13T09:51:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17dd625b80 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9faa70 0x55e4ee9fce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:51:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17dd625b80 4 client.18768 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:51:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e4ee89c050 con 0x55e4ee9faa70 2023-09-13T09:51:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9faa70 0x55e4ee9fce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:51:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17aeff5700 10 client.18768 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.374+0000 7f17ca7fc700 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9faa70 0x55e4ee9fce90 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749ab5ccdfc2341c server_cookie=733fc948747206eb in_seq=0 out_seq=0 2023-09-13T09:51:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17aeff5700 1 -- 172.21.15.6:0/3610150055 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55e4ee89c050 con 0x55e4ee9faa70 2023-09-13T09:51:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17aeff5700 10 client.18768 handle_command_reply: tid=0 2023-09-13T09:51:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 client.18768 shutdown 2023-09-13T09:51:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 msgr2=0x55e4ee99dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee99dae0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f17bc01b040 tx=0x7f17bc02a240 comp rx=0 tx=0).stop 2023-09-13T09:51:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 shutdown_connections 2023-09-13T09:51:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4ee992060 0x55e4ee9a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4ee990a00 0x55e4ee99d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e4ee9faa70 0x55e4ee9fce90 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 --2- 172.21.15.6:0/3610150055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4ee991700 0x55e4ee99dae0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17aeff5700 0 client.18768 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:51:46.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 >> 172.21.15.6:0/3610150055 conn(0x55e4ee8eec80 msgr2=0x55e4ee994920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 shutdown_connections 2023-09-13T09:51:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 1 -- 172.21.15.6:0/3610150055 wait complete. 2023-09-13T09:51:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17dd625b80 20 client.18768 trim_cache size 0 max 16384 2023-09-13T09:51:46.396 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:51:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:51:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:51:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "5a03d0d3-3a48-4544-9249-b66344d24ad2": { 2023-09-13T09:51:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:51:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "5a03d0d3-3a48-4544-9249-b66344d24ad2", 2023-09-13T09:51:46.398 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:51:46.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:51:46.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:51:46.398 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:51:46.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17b40a0640 msgr2=0x7f17b40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17d1440700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17b40a0640 0x7f17b40a2b00 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f17c40c8f40 tx=0x7f17c4018500 comp rx=0 tx=0).stop 2023-09-13T09:51:46.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 msgr2=0x7f17cc109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:51:46.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.375+0000 7f17d1440700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc109f80 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f17c400be20 tx=0x7f17c4009ed0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 shutdown_connections 2023-09-13T09:51:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17b40a0640 0x7f17b40a2b00 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc109f80 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc10b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 --2- 172.21.15.6:0/3521431183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc100eb0 0x7f17cc109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:51:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 >> 172.21.15.6:0/3521431183 conn(0x7f17cc0fb250 msgr2=0x7f17cc0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:51:46.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 shutdown_connections 2023-09-13T09:51:46.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:51:46.376+0000 7f17d1440700 1 -- 172.21.15.6:0/3521431183 wait complete. 2023-09-13T09:51:46.402 INFO:tasks.cephfs.filesystem:scrub status for tag:5a03d0d3-3a48-4544-9249-b66344d24ad2 - {'path': '/', 'tag': '5a03d0d3-3a48-4544-9249-b66344d24ad2', 'options': 'recursive,force'} 2023-09-13T09:51:47.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 773786 6.74 MB/sec execute 547 sec latency 58.324 ms 2023-09-13T09:51:47.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:47.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:47.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:47.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:47.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:47.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:47.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:46 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:47.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:47.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:47.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:47.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:47.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:47.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:46 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:47.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:47.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:47.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:47.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:46 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.184 INFO:tasks.workunit.client.0.smithi006.stdout: 1 774668 6.74 MB/sec execute 548 sec latency 31.340 ms 2023-09-13T09:51:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:47 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:51:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:47 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:48.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:47 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:51:48.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:47 smithi006 ceph-mon[98665]: pgmap v668: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-13T09:51:48.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:47 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:51:48.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:47 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:48.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:47 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:51:48.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:47 smithi053 ceph-mon[102373]: pgmap v668: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-13T09:51:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:47 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:51:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:47 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:48.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:47 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:51:48.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:51:48.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:47 smithi131 ceph-mon[102785]: pgmap v668: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 747 KiB/s rd, 2.6 MiB/s wr, 277 op/s 2023-09-13T09:51:49.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 776650 6.74 MB/sec execute 549 sec latency 11.991 ms 2023-09-13T09:51:50.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 777993 6.75 MB/sec execute 550 sec latency 16.102 ms 2023-09-13T09:51:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:49 smithi006 ceph-mon[98665]: pgmap v669: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:51:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:49 smithi053 ceph-mon[102373]: pgmap v669: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:51:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:49 smithi131 ceph-mon[102785]: pgmap v669: 97 pgs: 97 active+clean; 299 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 649 KiB/s rd, 2.2 MiB/s wr, 230 op/s 2023-09-13T09:51:51.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 779505 6.75 MB/sec execute 551 sec latency 15.050 ms 2023-09-13T09:51:52.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 781253 6.76 MB/sec execute 552 sec latency 52.640 ms 2023-09-13T09:51:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:51 smithi006 ceph-mon[98665]: pgmap v670: 97 pgs: 97 active+clean; 301 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 2.3 MiB/s wr, 248 op/s 2023-09-13T09:51:52.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:51 smithi053 ceph-mon[102373]: pgmap v670: 97 pgs: 97 active+clean; 301 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 2.3 MiB/s wr, 248 op/s 2023-09-13T09:51:52.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:51 smithi131 ceph-mon[102785]: pgmap v670: 97 pgs: 97 active+clean; 301 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 2.3 MiB/s wr, 248 op/s 2023-09-13T09:51:53.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 782107 6.75 MB/sec execute 553 sec latency 20.550 ms 2023-09-13T09:51:54.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 784126 6.76 MB/sec execute 554 sec latency 17.311 ms 2023-09-13T09:51:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:53 smithi006 ceph-mon[98665]: pgmap v671: 97 pgs: 97 active+clean; 301 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 2.4 MiB/s wr, 264 op/s 2023-09-13T09:51:54.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:53 smithi053 ceph-mon[102373]: pgmap v671: 97 pgs: 97 active+clean; 301 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 2.4 MiB/s wr, 264 op/s 2023-09-13T09:51:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:53 smithi131 ceph-mon[102785]: pgmap v671: 97 pgs: 97 active+clean; 301 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 2.4 MiB/s wr, 264 op/s 2023-09-13T09:51:55.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 785158 6.76 MB/sec execute 555 sec latency 15.391 ms 2023-09-13T09:51:56.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 787089 6.76 MB/sec execute 556 sec latency 12.857 ms 2023-09-13T09:51:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:55 smithi006 ceph-mon[98665]: pgmap v672: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:51:56.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:55 smithi053 ceph-mon[102373]: pgmap v672: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:51:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:55 smithi131 ceph-mon[102785]: pgmap v672: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 739 KiB/s rd, 2.4 MiB/s wr, 260 op/s 2023-09-13T09:51:57.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 788470 6.77 MB/sec execute 557 sec latency 42.423 ms 2023-09-13T09:51:58.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 789399 6.76 MB/sec execute 558 sec latency 21.879 ms 2023-09-13T09:51:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:57 smithi006 ceph-mon[98665]: pgmap v673: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.4 MiB/s wr, 256 op/s 2023-09-13T09:51:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:57 smithi053 ceph-mon[102373]: pgmap v673: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.4 MiB/s wr, 256 op/s 2023-09-13T09:51:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:57 smithi131 ceph-mon[102785]: pgmap v673: 97 pgs: 97 active+clean; 303 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 720 KiB/s rd, 2.4 MiB/s wr, 256 op/s 2023-09-13T09:51:59.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 791567 6.77 MB/sec execute 559 sec latency 17.703 ms 2023-09-13T09:52:00.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 792378 6.76 MB/sec execute 560 sec latency 21.593 ms 2023-09-13T09:52:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:59 smithi006 ceph-mon[98665]: pgmap v674: 97 pgs: 97 active+clean; 305 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 1.9 MiB/s wr, 206 op/s 2023-09-13T09:52:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:00.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:00.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:00.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:51:59 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:59 smithi053 ceph-mon[102373]: pgmap v674: 97 pgs: 97 active+clean; 305 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 1.9 MiB/s wr, 206 op/s 2023-09-13T09:52:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:00.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:00.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:51:59 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:59 smithi131 ceph-mon[102785]: pgmap v674: 97 pgs: 97 active+clean; 305 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 661 KiB/s rd, 1.9 MiB/s wr, 206 op/s 2023-09-13T09:52:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:00.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:51:59 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:01.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 794324 6.77 MB/sec execute 561 sec latency 14.448 ms 2023-09-13T09:52:02.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 795638 6.77 MB/sec execute 562 sec latency 48.302 ms 2023-09-13T09:52:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:01 smithi006 ceph-mon[98665]: pgmap v675: 97 pgs: 97 active+clean; 306 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 2.0 MiB/s wr, 239 op/s 2023-09-13T09:52:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:01 smithi053 ceph-mon[102373]: pgmap v675: 97 pgs: 97 active+clean; 306 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 2.0 MiB/s wr, 239 op/s 2023-09-13T09:52:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:01 smithi131 ceph-mon[102785]: pgmap v675: 97 pgs: 97 active+clean; 306 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 713 KiB/s rd, 2.0 MiB/s wr, 239 op/s 2023-09-13T09:52:03.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 796579 6.77 MB/sec execute 563 sec latency 74.643 ms 2023-09-13T09:52:04.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 798871 6.78 MB/sec execute 564 sec latency 13.903 ms 2023-09-13T09:52:04.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:03 smithi053 ceph-mon[102373]: pgmap v676: 97 pgs: 97 active+clean; 307 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:52:04.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:03 smithi006 ceph-mon[98665]: pgmap v676: 97 pgs: 97 active+clean; 307 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:52:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:03 smithi131 ceph-mon[102785]: pgmap v676: 97 pgs: 97 active+clean; 307 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 714 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:52:05.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 799799 6.77 MB/sec execute 565 sec latency 15.418 ms 2023-09-13T09:52:06.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 801873 6.78 MB/sec execute 566 sec latency 13.552 ms 2023-09-13T09:52:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:05 smithi006 ceph-mon[98665]: pgmap v677: 97 pgs: 97 active+clean; 308 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 2.2 MiB/s wr, 256 op/s 2023-09-13T09:52:06.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:05 smithi053 ceph-mon[102373]: pgmap v677: 97 pgs: 97 active+clean; 308 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 2.2 MiB/s wr, 256 op/s 2023-09-13T09:52:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:05 smithi131 ceph-mon[102785]: pgmap v677: 97 pgs: 97 active+clean; 308 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 787 KiB/s rd, 2.2 MiB/s wr, 256 op/s 2023-09-13T09:52:07.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 802917 6.78 MB/sec execute 567 sec latency 44.571 ms 2023-09-13T09:52:08.185 INFO:tasks.workunit.client.0.smithi006.stdout: 1 804852 6.78 MB/sec execute 568 sec latency 19.386 ms 2023-09-13T09:52:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:07 smithi006 ceph-mon[98665]: pgmap v678: 97 pgs: 97 active+clean; 309 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 2.3 MiB/s wr, 233 op/s 2023-09-13T09:52:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:07 smithi053 ceph-mon[102373]: pgmap v678: 97 pgs: 97 active+clean; 309 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 2.3 MiB/s wr, 233 op/s 2023-09-13T09:52:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:07 smithi131 ceph-mon[102785]: pgmap v678: 97 pgs: 97 active+clean; 309 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 681 KiB/s rd, 2.3 MiB/s wr, 233 op/s 2023-09-13T09:52:09.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 806312 6.79 MB/sec execute 569 sec latency 14.446 ms 2023-09-13T09:52:10.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 807863 6.79 MB/sec execute 570 sec latency 15.228 ms 2023-09-13T09:52:10.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:10 smithi006 ceph-mon[98665]: pgmap v679: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.2 MiB/s wr, 244 op/s 2023-09-13T09:52:10.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:10 smithi053 ceph-mon[102373]: pgmap v679: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.2 MiB/s wr, 244 op/s 2023-09-13T09:52:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:10 smithi131 ceph-mon[102785]: pgmap v679: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.2 MiB/s wr, 244 op/s 2023-09-13T09:52:11.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 809727 6.80 MB/sec execute 571 sec latency 14.185 ms 2023-09-13T09:52:12.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 810644 6.79 MB/sec execute 572 sec latency 59.382 ms 2023-09-13T09:52:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:12 smithi006 ceph-mon[98665]: pgmap v680: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 2.2 MiB/s wr, 236 op/s 2023-09-13T09:52:12.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:12 smithi053 ceph-mon[102373]: pgmap v680: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 2.2 MiB/s wr, 236 op/s 2023-09-13T09:52:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:12 smithi131 ceph-mon[102785]: pgmap v680: 97 pgs: 97 active+clean; 310 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 2.2 MiB/s wr, 236 op/s 2023-09-13T09:52:13.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 812524 6.80 MB/sec execute 573 sec latency 68.076 ms 2023-09-13T09:52:14.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 813511 6.80 MB/sec execute 574 sec latency 44.174 ms 2023-09-13T09:52:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:14 smithi006 ceph-mon[98665]: pgmap v681: 97 pgs: 97 active+clean; 311 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 2.4 MiB/s wr, 232 op/s 2023-09-13T09:52:14.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:14 smithi053 ceph-mon[102373]: pgmap v681: 97 pgs: 97 active+clean; 311 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 2.4 MiB/s wr, 232 op/s 2023-09-13T09:52:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:14 smithi131 ceph-mon[102785]: pgmap v681: 97 pgs: 97 active+clean; 311 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 614 KiB/s rd, 2.4 MiB/s wr, 232 op/s 2023-09-13T09:52:15.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 815379 6.80 MB/sec execute 575 sec latency 104.672 ms 2023-09-13T09:52:16.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 816849 6.81 MB/sec execute 576 sec latency 14.900 ms 2023-09-13T09:52:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:16 smithi131 ceph-mon[102785]: pgmap v682: 97 pgs: 97 active+clean; 313 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:52:16.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:52:16.428 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:16 smithi006 ceph-mon[98665]: pgmap v682: 97 pgs: 97 active+clean; 313 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:52:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:16 smithi053 ceph-mon[102373]: pgmap v682: 97 pgs: 97 active+clean; 313 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 640 KiB/s rd, 2.3 MiB/s wr, 243 op/s 2023-09-13T09:52:16.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 -- 172.21.15.6:0/2962229688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 msgr2=0x7f019c0ff2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 --2- 172.21.15.6:0/2962229688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c0ff2b0 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f0198009990 tx=0x7f0198009ca0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 -- 172.21.15.6:0/2962229688 shutdown_connections 2023-09-13T09:52:16.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 --2- 172.21.15.6:0/2962229688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019c0ff7f0 0x7f019c1093c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 --2- 172.21.15.6:0/2962229688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f019c1023e0 0x7f019c102800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 --2- 172.21.15.6:0/2962229688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c0ff2b0 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 -- 172.21.15.6:0/2962229688 >> 172.21.15.6:0/2962229688 conn(0x7f019c0fa9b0 msgr2=0x7f019c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:16.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 -- 172.21.15.6:0/2962229688 shutdown_connections 2023-09-13T09:52:16.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.535+0000 7f01a422e700 1 -- 172.21.15.6:0/2962229688 wait complete. 2023-09-13T09:52:16.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 Processor -- start 2023-09-13T09:52:16.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 -- start start 2023-09-13T09:52:16.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019c0ff7f0 0x7f019c197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f019c1023e0 0x7f019c19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c19e660 con 0x7f019c0fee50 2023-09-13T09:52:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c19e7a0 con 0x7f019c0ff7f0 2023-09-13T09:52:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a422e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c19e930 con 0x7f019c1023e0 2023-09-13T09:52:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a17c9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019c0ff7f0 0x7f019c197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41726/0 (socket says 172.21.15.6:41726) 2023-09-13T09:52:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 -- 172.21.15.6:0/2804016884 learned_addr learned my addr 172.21.15.6:0/2804016884 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a27cb700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f019c1023e0 0x7f019c19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 -- 172.21.15.6:0/2804016884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f019c1023e0 msgr2=0x7f019c19e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f019c1023e0 0x7f019c19e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 -- 172.21.15.6:0/2804016884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019c0ff7f0 msgr2=0x7f019c197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019c0ff7f0 0x7f019c197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 -- 172.21.15.6:0/2804016884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980095f0 con 0x7f019c0fee50 2023-09-13T09:52:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a17c9700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019c0ff7f0 0x7f019c197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.536+0000 7f01a1fca700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c196ae0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f018c00e970 tx=0x7f018c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.537+0000 7f0192ffd700 1 -- 172.21.15.6:0/2804016884 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c009790 con 0x7f019c0fee50 2023-09-13T09:52:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.537+0000 7f0192ffd700 1 -- 172.21.15.6:0/2804016884 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f018c00c7e0 con 0x7f019c0fee50 2023-09-13T09:52:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.537+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f019c19ec10 con 0x7f019c0fee50 2023-09-13T09:52:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.537+0000 7f0192ffd700 1 -- 172.21.15.6:0/2804016884 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c003c70 con 0x7f019c0fee50 2023-09-13T09:52:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.537+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c19f120 con 0x7f019c0fee50 2023-09-13T09:52:16.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.540+0000 7f0192ffd700 1 -- 172.21.15.6:0/2804016884 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f018c00cc50 con 0x7f019c0fee50 2023-09-13T09:52:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.540+0000 7f0192ffd700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01880a0640 0x7f01880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.540+0000 7f0192ffd700 1 -- 172.21.15.6:0/2804016884 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f018c014070 con 0x7f019c0fee50 2023-09-13T09:52:16.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.540+0000 7f01a17c9700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01880a0640 0x7f01880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.541+0000 7f01a17c9700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01880a0640 0x7f01880a2b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f019800b2e0 tx=0x7f0198005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.541+0000 7f01b0413b80 1 Processor -- start 2023-09-13T09:52:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.541+0000 7f01b0413b80 1 -- start start 2023-09-13T09:52:16.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda1fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda20060 0x55a7fda1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda1ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01b0413b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fd977780 con 0x55a7fda1ea00 2023-09-13T09:52:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01b0413b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fd9750a0 con 0x55a7fda1f700 2023-09-13T09:52:16.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01b0413b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fd970990 con 0x55a7fda20060 2023-09-13T09:52:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda1fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a27cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda1ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda1fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35258/0 (socket says 172.21.15.6:35258) 2023-09-13T09:52:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a27cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda1ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41738/0 (socket says 172.21.15.6:41738) 2023-09-13T09:52:16.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 -- 172.21.15.6:0/1918581713 learned_addr learned my addr 172.21.15.6:0/1918581713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a17c9700 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda20060 0x55a7fda1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 -- 172.21.15.6:0/1918581713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda20060 msgr2=0x55a7fda1e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda20060 0x55a7fda1e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 -- 172.21.15.6:0/1918581713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 msgr2=0x55a7fda1ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda1ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 -- 172.21.15.6:0/1918581713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7fd7f0630 con 0x55a7fda1f700 2023-09-13T09:52:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f01a1fca700 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda1fb20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f018c095f30 tx=0x7f018c003710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa557f427cd88ca2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.542+0000 7f0187fff700 1 -- 172.21.15.6:0/1918581713 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0994c0 con 0x55a7fda1f700 2023-09-13T09:52:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f0187fff700 1 -- 172.21.15.6:0/1918581713 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f018c09d2f0 con 0x55a7fda1f700 2023-09-13T09:52:16.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f0187fff700 1 -- 172.21.15.6:0/1918581713 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c099720 con 0x55a7fda1f700 2023-09-13T09:52:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 -- 172.21.15.6:0/1918581713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 msgr2=0x55a7fda1fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda1fb20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f018c095f30 tx=0x7f018c003710 comp rx=0 tx=0).stop 2023-09-13T09:52:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 -- 172.21.15.6:0/1918581713 shutdown_connections 2023-09-13T09:52:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda1ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda1fb20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 --2- 172.21.15.6:0/1918581713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda20060 0x55a7fda1e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 -- 172.21.15.6:0/1918581713 >> 172.21.15.6:0/1918581713 conn(0x55a7fd97cc80 msgr2=0x55a7fda18f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 -- 172.21.15.6:0/1918581713 shutdown_connections 2023-09-13T09:52:16.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.543+0000 7f01b0413b80 1 -- 172.21.15.6:0/1918581713 wait complete. 2023-09-13T09:52:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 -- start start 2023-09-13T09:52:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 Processor -- start 2023-09-13T09:52:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda27e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1f700 0x55a7fda28380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda20060 0x55a7fda2f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fd90ebb0 con 0x55a7fda1f700 2023-09-13T09:52:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fd90e8b0 con 0x55a7fda20060 2023-09-13T09:52:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fd7f2920 con 0x55a7fda1ea00 2023-09-13T09:52:16.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01b0413b80 10 client.0 _ll_register_callbacks cb 0x55a7fd90c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:16.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01a17c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1f700 0x55a7fda28380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01a17c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1f700 0x55a7fda28380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41742/0 (socket says 172.21.15.6:41742) 2023-09-13T09:52:16.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda27e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01a17c9700 1 -- 172.21.15.6:0/4066840553 learned_addr learned my addr 172.21.15.6:0/4066840553 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:16.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.544+0000 7f01a27cb700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda20060 0x55a7fda2f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a1fca700 1 -- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda20060 msgr2=0x55a7fda2f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a1fca700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda20060 0x55a7fda2f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a1fca700 1 -- 172.21.15.6:0/4066840553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1f700 msgr2=0x55a7fda28380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a1fca700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1f700 0x55a7fda28380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a1fca700 1 -- 172.21.15.6:0/4066840553 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f019c19f120 con 0x55a7fda1ea00 2023-09-13T09:52:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a27cb700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda20060 0x55a7fda2f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a17c9700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1f700 0x55a7fda28380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01a1fca700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda27e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f018c0c9b40 tx=0x7f018c09d1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78204b0dbfbf9f83 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01857fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:52:16.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01857fa700 1 -- 172.21.15.6:0/4066840553 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0989b0 con 0x55a7fda1ea00 2023-09-13T09:52:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01857fa700 1 -- 172.21.15.6:0/4066840553 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f018c098b10 con 0x55a7fda1ea00 2023-09-13T09:52:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7fda11670 con 0x55a7fda1ea00 2023-09-13T09:52:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01857fa700 1 -- 172.21.15.6:0/4066840553 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f018c099720 con 0x55a7fda1ea00 2023-09-13T09:52:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01b0413b80 10 client.28090 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:16.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a7fd9887a0 con 0x55a7fda1ea00 2023-09-13T09:52:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.545+0000 7f01857fa700 1 -- 172.21.15.6:0/4066840553 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a7fda11670 con 0x55a7fda1ea00 2023-09-13T09:52:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01857fa700 1 -- 172.21.15.6:0/4066840553 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f018c0952b0 con 0x55a7fda1ea00 2023-09-13T09:52:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01b0413b80 10 client.28090 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:16.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01b0413b80 10 client.28090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01b0413b80 20 client.28090 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda33760 0x55a7fda35b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01b0413b80 4 client.28090 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7fd969970 con 0x55a7fda33760 2023-09-13T09:52:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01a17c9700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda33760 0x55a7fda35b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01857fa700 10 client.28090 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:16.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.546+0000 7f01a17c9700 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda33760 0x55a7fda35b80 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32a642c8383c9eb6 server_cookie=d00a7ba500509295 in_seq=0 out_seq=0 2023-09-13T09:52:16.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.548+0000 7f01857fa700 1 -- 172.21.15.6:0/4066840553 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7fd969970 con 0x55a7fda33760 2023-09-13T09:52:16.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.548+0000 7f01857fa700 10 client.28090 handle_command_reply: tid=0 2023-09-13T09:52:16.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.548+0000 7f01b0413b80 1 client.28090 shutdown 2023-09-13T09:52:16.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 msgr2=0x55a7fda27e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda27e40 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f018c0c9b40 tx=0x7f018c09d1f0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 shutdown_connections 2023-09-13T09:52:16.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda20060 0x55a7fda2f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda27e40 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda33760 0x55a7fda35b80 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4066840553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1f700 0x55a7fda28380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01857fa700 0 client.28090 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 >> 172.21.15.6:0/4066840553 conn(0x55a7fd97cc80 msgr2=0x55a7fda137f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 shutdown_connections 2023-09-13T09:52:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 1 -- 172.21.15.6:0/4066840553 wait complete. 2023-09-13T09:52:16.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.549+0000 7f01b0413b80 20 client.28090 trim_cache size 0 max 16384 2023-09-13T09:52:16.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 Processor -- start 2023-09-13T09:52:16.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 -- start start 2023-09-13T09:52:16.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fd97cc80 0x55a7fda1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda27bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fd969970 con 0x55a7fd97cc80 2023-09-13T09:52:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fda29030 con 0x55a7fda1f700 2023-09-13T09:52:16.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01b0413b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fda19df0 con 0x55a7fda1ea00 2023-09-13T09:52:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fd97cc80 0x55a7fda1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fd97cc80 0x55a7fda1e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41748/0 (socket says 172.21.15.6:41748) 2023-09-13T09:52:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01a1fca700 1 -- 172.21.15.6:0/163541297 learned_addr learned my addr 172.21.15.6:0/163541297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01a17c9700 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.566+0000 7f01a27cb700 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda27bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f01a1fca700 1 -- 172.21.15.6:0/163541297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 msgr2=0x55a7fda2f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f01a1fca700 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f01a1fca700 1 -- 172.21.15.6:0/163541297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 msgr2=0x55a7fda27bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f01a1fca700 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda27bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f01a1fca700 1 -- 172.21.15.6:0/163541297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7fd79cde0 con 0x55a7fd97cc80 2023-09-13T09:52:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f01a1fca700 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fd97cc80 0x55a7fda1e4c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f018c095f30 tx=0x7f018c097a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb40916aab175c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f0190ff9700 1 -- 172.21.15.6:0/163541297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c0841d0 con 0x55a7fd97cc80 2023-09-13T09:52:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f0190ff9700 1 -- 172.21.15.6:0/163541297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f018c0994c0 con 0x55a7fd97cc80 2023-09-13T09:52:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.567+0000 7f0190ff9700 1 -- 172.21.15.6:0/163541297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c099980 con 0x55a7fd97cc80 2023-09-13T09:52:16.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 -- 172.21.15.6:0/163541297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fd97cc80 msgr2=0x55a7fda1e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fd97cc80 0x55a7fda1e4c0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f018c095f30 tx=0x7f018c097a70 comp rx=0 tx=0).stop 2023-09-13T09:52:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 -- 172.21.15.6:0/163541297 shutdown_connections 2023-09-13T09:52:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda27bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fd97cc80 0x55a7fda1e4c0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 --2- 172.21.15.6:0/163541297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 -- 172.21.15.6:0/163541297 >> 172.21.15.6:0/163541297 conn(0x55a7fda19240 msgr2=0x55a7fda2fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:16.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 -- 172.21.15.6:0/163541297 shutdown_connections 2023-09-13T09:52:16.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 -- 172.21.15.6:0/163541297 wait complete. 2023-09-13T09:52:16.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 -- start start 2023-09-13T09:52:16.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.568+0000 7f01b0413b80 1 Processor -- start 2023-09-13T09:52:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fd97cc80 0x55a7fda2ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda2b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fda2be10 con 0x55a7fda1ea00 2023-09-13T09:52:16.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fda2bf80 con 0x55a7fda1f700 2023-09-13T09:52:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7fda2c140 con 0x55a7fd97cc80 2023-09-13T09:52:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 10 client.0 _ll_register_callbacks cb 0x55a7fd90c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41756/0 (socket says 172.21.15.6:41756) 2023-09-13T09:52:16.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 -- 172.21.15.6:0/4033504054 learned_addr learned my addr 172.21.15.6:0/4033504054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a1fca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fd97cc80 0x55a7fda2ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a27cb700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda2b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 -- 172.21.15.6:0/4033504054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fd97cc80 msgr2=0x55a7fda2ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fd97cc80 0x55a7fda2ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 -- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 msgr2=0x55a7fda2b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda2b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 -- 172.21.15.6:0/4033504054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7fd9887a0 con 0x55a7fda1ea00 2023-09-13T09:52:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a1fca700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fd97cc80 0x55a7fda2ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a27cb700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda2b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:16.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01a17c9700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f1d0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f01980098e0 tx=0x7f0198009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe8b49c8db46505 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01857fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01857fa700 1 -- 172.21.15.6:0/4033504054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019802b040 con 0x55a7fda1ea00 2023-09-13T09:52:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01857fa700 1 -- 172.21.15.6:0/4033504054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0198036560 con 0x55a7fda1ea00 2023-09-13T09:52:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.569+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f018c09d2f0 con 0x55a7fda1ea00 2023-09-13T09:52:16.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01857fa700 1 -- 172.21.15.6:0/4033504054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0198036e80 con 0x55a7fda1ea00 2023-09-13T09:52:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 10 client.18786 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a7fd785c60 con 0x55a7fda1ea00 2023-09-13T09:52:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01857fa700 1 -- 172.21.15.6:0/4033504054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f018c09d2f0 con 0x55a7fda1ea00 2023-09-13T09:52:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01857fa700 1 -- 172.21.15.6:0/4033504054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0198033400 con 0x55a7fda1ea00 2023-09-13T09:52:16.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 10 client.18786 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 10 client.18786 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 20 client.18786 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda20060 0x55a7fda8acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 4 client.18786 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:52:16.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a7fd92a050 con 0x55a7fda20060 2023-09-13T09:52:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.570+0000 7f01a1fca700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda20060 0x55a7fda8acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.571+0000 7f01857fa700 10 client.18786 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.571+0000 7f01a1fca700 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda20060 0x55a7fda8acc0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=525ee939e0c973db server_cookie=67b16fc3457cc9f9 in_seq=0 out_seq=0 2023-09-13T09:52:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01857fa700 1 -- 172.21.15.6:0/4033504054 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a7fd92a050 con 0x55a7fda20060 2023-09-13T09:52:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01857fa700 10 client.18786 handle_command_reply: tid=0 2023-09-13T09:52:16.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 client.18786 shutdown 2023-09-13T09:52:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 msgr2=0x55a7fda2f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f1d0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f01980098e0 tx=0x7f0198009310 comp rx=0 tx=0).stop 2023-09-13T09:52:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 shutdown_connections 2023-09-13T09:52:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7fda1f700 0x55a7fda2b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7fd97cc80 0x55a7fda2ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a7fda20060 0x55a7fda8acc0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 --2- 172.21.15.6:0/4033504054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7fda1ea00 0x55a7fda2f1d0 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01857fa700 0 client.18786 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.572+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 >> 172.21.15.6:0/4033504054 conn(0x55a7fda19240 msgr2=0x55a7fda27bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:16.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 shutdown_connections 2023-09-13T09:52:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01b0413b80 1 -- 172.21.15.6:0/4033504054 wait complete. 2023-09-13T09:52:16.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01b0413b80 20 client.18786 trim_cache size 0 max 16384 2023-09-13T09:52:16.599 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:52:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:52:16.600 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:52:16.600 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:52:16.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01880a0640 msgr2=0x7f01880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01880a0640 0x7f01880a2b00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f019800b2e0 tx=0x7f0198005fb0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 msgr2=0x7f019c196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c196ae0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f018c00e970 tx=0x7f018c00ec80 comp rx=0 tx=0).stop 2023-09-13T09:52:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 shutdown_connections 2023-09-13T09:52:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f019c1023e0 0x7f019c19e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f01880a0640 0x7f01880a2b00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f019c0fee50 0x7f019c196ae0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 --2- 172.21.15.6:0/2804016884 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f019c0ff7f0 0x7f019c197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 >> 172.21.15.6:0/2804016884 conn(0x7f019c0fa9b0 msgr2=0x7f019c105640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 shutdown_connections 2023-09-13T09:52:16.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.573+0000 7f01a422e700 1 -- 172.21.15.6:0/2804016884 wait complete. 2023-09-13T09:52:16.605 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:52:16.605 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:52:16.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 -- 172.21.15.6:0/1270060880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00ffc90 msgr2=0x7f15a01000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 --2- 172.21.15.6:0/1270060880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00ffc90 0x7f15a01000b0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f159c0099c0 tx=0x7f159c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 -- 172.21.15.6:0/1270060880 shutdown_connections 2023-09-13T09:52:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 --2- 172.21.15.6:0/1270060880 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a0101820 0x7f15a01080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 --2- 172.21.15.6:0/1270060880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a00ffc90 0x7f15a01000b0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 --2- 172.21.15.6:0/1270060880 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15a0100e80 0x7f15a01012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 -- 172.21.15.6:0/1270060880 >> 172.21.15.6:0/1270060880 conn(0x7f15a00fb220 msgr2=0x7f15a00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 -- 172.21.15.6:0/1270060880 shutdown_connections 2023-09-13T09:52:16.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.770+0000 7f15a879c700 1 -- 172.21.15.6:0/1270060880 wait complete. 2023-09-13T09:52:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 Processor -- start 2023-09-13T09:52:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 -- start start 2023-09-13T09:52:16.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a00ffc90 0x7f15a0068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a0100e80 0x7f15a019b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15a0101820 0x7f15a019dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019e5b0 con 0x7f15a0100e80 2023-09-13T09:52:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019e720 con 0x7f15a0101820 2023-09-13T09:52:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a879c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15a019e8e0 con 0x7f15a00ffc90 2023-09-13T09:52:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a5d37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a0100e80 0x7f15a019b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a5d37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a0100e80 0x7f15a019b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41770/0 (socket says 172.21.15.6:41770) 2023-09-13T09:52:16.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a5d37700 1 -- 172.21.15.6:0/1544110282 learned_addr learned my addr 172.21.15.6:0/1544110282 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a6538700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a00ffc90 0x7f15a0068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.771+0000 7f15a6d39700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15a0101820 0x7f15a019dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a5d37700 1 -- 172.21.15.6:0/1544110282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a00ffc90 msgr2=0x7f15a0068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a5d37700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a00ffc90 0x7f15a0068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a5d37700 1 -- 172.21.15.6:0/1544110282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15a0101820 msgr2=0x7f15a019dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a5d37700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15a0101820 0x7f15a019dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a5d37700 1 -- 172.21.15.6:0/1544110282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c0095f0 con 0x7f15a0100e80 2023-09-13T09:52:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a5d37700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a0100e80 0x7f15a019b790 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f159000d980 tx=0x7f159000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15977fe700 1 -- 172.21.15.6:0/1544110282 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590004220 con 0x7f15a0100e80 2023-09-13T09:52:16.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15977fe700 1 -- 172.21.15.6:0/1544110282 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1590007640 con 0x7f15a0100e80 2023-09-13T09:52:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15a019ebc0 con 0x7f15a0100e80 2023-09-13T09:52:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15977fe700 1 -- 172.21.15.6:0/1544110282 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1590005690 con 0x7f15a0100e80 2023-09-13T09:52:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.772+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15a019f0d0 con 0x7f15a0100e80 2023-09-13T09:52:16.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.773+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15a0107280 con 0x7f15a0100e80 2023-09-13T09:52:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.774+0000 7f15977fe700 1 -- 172.21.15.6:0/1544110282 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1590004750 con 0x7f15a0100e80 2023-09-13T09:52:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.775+0000 7f15977fe700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f158c0a0640 0x7f158c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.775+0000 7f15a6538700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f158c0a0640 0x7f158c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:16.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.775+0000 7f15977fe700 1 -- 172.21.15.6:0/1544110282 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15900cba10 con 0x7f15a0100e80 2023-09-13T09:52:16.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.775+0000 7f15a6538700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f158c0a0640 0x7f158c0a2b00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f159c009f50 tx=0x7f159c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:16.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:16.780+0000 7f15977fe700 1 -- 172.21.15.6:0/1544110282 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f15900954f0 con 0x7f15a0100e80 2023-09-13T09:52:17.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.035+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15a010b4a0 con 0x7f15a0100e80 2023-09-13T09:52:17.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.035+0000 7f15977fe700 1 -- 172.21.15.6:0/1544110282 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f1590016020 con 0x7f15a0100e80 2023-09-13T09:52:17.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:52:17.036 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:43:54.017363+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:52:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f158c0a0640 msgr2=0x7f158c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f158c0a0640 0x7f158c0a2b00 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f159c009f50 tx=0x7f159c00b540 comp rx=0 tx=0).stop 2023-09-13T09:52:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a0100e80 msgr2=0x7f15a019b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a0100e80 0x7f15a019b790 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f159000d980 tx=0x7f159000dc90 comp rx=0 tx=0).stop 2023-09-13T09:52:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 shutdown_connections 2023-09-13T09:52:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15a0101820 0x7f15a019dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15a00ffc90 0x7f15a0068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f158c0a0640 0x7f158c0a2b00 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 --2- 172.21.15.6:0/1544110282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15a0100e80 0x7f15a019b790 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 >> 172.21.15.6:0/1544110282 conn(0x7f15a00fb220 msgr2=0x7f15a01043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 shutdown_connections 2023-09-13T09:52:17.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.038+0000 7f15a879c700 1 -- 172.21.15.6:0/1544110282 wait complete. 2023-09-13T09:52:17.041 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 34 2023-09-13T09:52:17.051 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:52:17.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 817845 6.80 MB/sec execute 577 sec latency 14.210 ms 2023-09-13T09:52:17.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 -- 172.21.15.6:0/4240486584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 msgr2=0x7fdf501023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 --2- 172.21.15.6:0/4240486584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501023e0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fdf440099c0 tx=0x7fdf44009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 -- 172.21.15.6:0/4240486584 shutdown_connections 2023-09-13T09:52:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 --2- 172.21.15.6:0/4240486584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf50102920 0x7fdf501091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 --2- 172.21.15.6:0/4240486584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50100d90 0x7fdf501011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 --2- 172.21.15.6:0/4240486584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501023e0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 -- 172.21.15.6:0/4240486584 >> 172.21.15.6:0/4240486584 conn(0x7fdf500fc300 msgr2=0x7fdf500fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 -- 172.21.15.6:0/4240486584 shutdown_connections 2023-09-13T09:52:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 -- 172.21.15.6:0/4240486584 wait complete. 2023-09-13T09:52:17.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.189+0000 7fdf560da700 1 Processor -- start 2023-09-13T09:52:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf560da700 1 -- start start 2023-09-13T09:52:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf560da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50100d90 0x7fdf50198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf560da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf560da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf50102920 0x7fdf501a0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf560da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501a07f0 con 0x7fdf50101f80 2023-09-13T09:52:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf560da700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501a0960 con 0x7fdf50100d90 2023-09-13T09:52:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf560da700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf501a0b20 con 0x7fdf50102920 2023-09-13T09:52:17.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501991c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41784/0 (socket says 172.21.15.6:41784) 2023-09-13T09:52:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 -- 172.21.15.6:0/813699948 learned_addr learned my addr 172.21.15.6:0/813699948 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50100d90 0x7fdf50198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf50102920 0x7fdf501a0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 -- 172.21.15.6:0/813699948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf50102920 msgr2=0x7fdf501a0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf50102920 0x7fdf501a0220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 -- 172.21.15.6:0/813699948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50100d90 msgr2=0x7fdf50198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50100d90 0x7fdf50198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 -- 172.21.15.6:0/813699948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf440095f0 con 0x7fdf50101f80 2023-09-13T09:52:17.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.190+0000 7fdf4effd700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501991c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009fd0 tx=0x7fdf44009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.191+0000 7fdf4cff9700 1 -- 172.21.15.6:0/813699948 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4401d070 con 0x7fdf50101f80 2023-09-13T09:52:17.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.191+0000 7fdf4cff9700 1 -- 172.21.15.6:0/813699948 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf44005030 con 0x7fdf50101f80 2023-09-13T09:52:17.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.191+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf501a0da0 con 0x7fdf50101f80 2023-09-13T09:52:17.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.191+0000 7fdf4cff9700 1 -- 172.21.15.6:0/813699948 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44004a90 con 0x7fdf50101f80 2023-09-13T09:52:17.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.191+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf501a11c0 con 0x7fdf50101f80 2023-09-13T09:52:17.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.193+0000 7fdf4cff9700 1 -- 172.21.15.6:0/813699948 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdf440051a0 con 0x7fdf50101f80 2023-09-13T09:52:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.194+0000 7fdf4cff9700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf380a0640 0x7fdf380a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.194+0000 7fdf4cff9700 1 -- 172.21.15.6:0/813699948 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf440cc9a0 con 0x7fdf50101f80 2023-09-13T09:52:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.194+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf380a0640 0x7fdf380a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.194+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf380a0640 0x7fdf380a2b00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdf50199b50 tx=0x7fdf40009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 Processor -- start 2023-09-13T09:52:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 -- start start 2023-09-13T09:52:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc72561b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72560a00 0x55fc72560e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc724b9780 con 0x55fc72562060 2023-09-13T09:52:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc724b70a0 con 0x55fc72560a00 2023-09-13T09:52:17.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc724b2990 con 0x55fc72561700 2023-09-13T09:52:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72560a00 0x55fc72560e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725604c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41792/0 (socket says 172.21.15.6:41792) 2023-09-13T09:52:17.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72560a00 0x55fc72560e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35318/0 (socket says 172.21.15.6:35318) 2023-09-13T09:52:17.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4effd700 1 -- 172.21.15.6:0/1520247527 learned_addr learned my addr 172.21.15.6:0/1520247527 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc72561b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 -- 172.21.15.6:0/1520247527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 msgr2=0x55fc72561b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc72561b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 -- 172.21.15.6:0/1520247527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 msgr2=0x55fc725604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 -- 172.21.15.6:0/1520247527 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc72332630 con 0x55fc72560a00 2023-09-13T09:52:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.195+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72560a00 0x55fc72560e80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf48011580 tx=0x7fdf48009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f36f6e1d6392b8de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf35ffb700 1 -- 172.21.15.6:0/1520247527 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800e040 con 0x55fc72560a00 2023-09-13T09:52:17.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf35ffb700 1 -- 172.21.15.6:0/1520247527 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf4800f040 con 0x55fc72560a00 2023-09-13T09:52:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf35ffb700 1 -- 172.21.15.6:0/1520247527 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf48004390 con 0x55fc72560a00 2023-09-13T09:52:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 -- 172.21.15.6:0/1520247527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72560a00 msgr2=0x55fc72560e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72560a00 0x55fc72560e80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fdf48011580 tx=0x7fdf48009920 comp rx=0 tx=0).stop 2023-09-13T09:52:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 -- 172.21.15.6:0/1520247527 shutdown_connections 2023-09-13T09:52:17.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72560a00 0x55fc72560e80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc72561b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/1520247527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 -- 172.21.15.6:0/1520247527 >> 172.21.15.6:0/1520247527 conn(0x55fc724bec80 msgr2=0x55fc7255af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 -- 172.21.15.6:0/1520247527 shutdown_connections 2023-09-13T09:52:17.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.196+0000 7fdf622bfb80 1 -- 172.21.15.6:0/1520247527 wait complete. 2023-09-13T09:52:17.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 -- start start 2023-09-13T09:52:17.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 Processor -- start 2023-09-13T09:52:17.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72560a00 0x55fc72569eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc7256a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc72571430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72450bb0 con 0x55fc72560a00 2023-09-13T09:52:17.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc724508b0 con 0x55fc72562060 2023-09-13T09:52:17.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.197+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72334920 con 0x55fc72561700 2023-09-13T09:52:17.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf622bfb80 10 client.0 _ll_register_callbacks cb 0x55fc7244e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72560a00 0x55fc72569eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72560a00 0x55fc72569eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41796/0 (socket says 172.21.15.6:41796) 2023-09-13T09:52:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 -- 172.21.15.6:0/307903920 learned_addr learned my addr 172.21.15.6:0/307903920 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc72571430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4effd700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc7256a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 -- 172.21.15.6:0/307903920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 msgr2=0x55fc7256a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc7256a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 -- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 msgr2=0x55fc72571430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc72571430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 -- 172.21.15.6:0/307903920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf48011230 con 0x55fc72560a00 2023-09-13T09:52:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc72571430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72560a00 0x55fc72569eb0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fdf4001d8f0 tx=0x7fdf400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b563e9ff0fa1e7f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf2effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf2effd700 1 -- 172.21.15.6:0/307903920 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf40022070 con 0x55fc72560a00 2023-09-13T09:52:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf2effd700 1 -- 172.21.15.6:0/307903920 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf40004240 con 0x55fc72560a00 2023-09-13T09:52:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc72553670 con 0x55fc72560a00 2023-09-13T09:52:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf2effd700 1 -- 172.21.15.6:0/307903920 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf40004400 con 0x55fc72560a00 2023-09-13T09:52:17.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf622bfb80 10 client.18804 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.198+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fc724ca7a0 con 0x55fc72560a00 2023-09-13T09:52:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf2effd700 1 -- 172.21.15.6:0/307903920 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fc72553670 con 0x55fc72560a00 2023-09-13T09:52:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf2effd700 1 -- 172.21.15.6:0/307903920 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdf4000e660 con 0x55fc72560a00 2023-09-13T09:52:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf622bfb80 10 client.18804 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf622bfb80 10 client.18804 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:52:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf622bfb80 20 client.18804 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc72575d10 0x55fc72578130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf622bfb80 4 client.18804 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:17.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc724ab970 con 0x55fc72575d10 2023-09-13T09:52:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.199+0000 7fdf4effd700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc72575d10 0x55fc72578130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.200+0000 7fdf4effd700 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc72575d10 0x55fc72578130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5b2b01a55c478e74 server_cookie=e809b9dc8cef4f63 in_seq=0 out_seq=0 2023-09-13T09:52:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.200+0000 7fdf2effd700 10 client.18804 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.200+0000 7fdf2effd700 1 -- 172.21.15.6:0/307903920 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc724ab970 con 0x55fc72575d10 2023-09-13T09:52:17.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.200+0000 7fdf2effd700 10 client.18804 handle_command_reply: tid=0 2023-09-13T09:52:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.200+0000 7fdf622bfb80 1 client.18804 shutdown 2023-09-13T09:52:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.200+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72560a00 msgr2=0x55fc72569eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.200+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72560a00 0x55fc72569eb0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fdf4001d8f0 tx=0x7fdf400047c0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 shutdown_connections 2023-09-13T09:52:17.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc72575d10 0x55fc72578130 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc72571430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf2effd700 0 client.18804 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72560a00 0x55fc72569eb0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/307903920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72561700 0x55fc7256a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 >> 172.21.15.6:0/307903920 conn(0x55fc724bec80 msgr2=0x55fc7255aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 shutdown_connections 2023-09-13T09:52:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 1 -- 172.21.15.6:0/307903920 wait complete. 2023-09-13T09:52:17.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.201+0000 7fdf622bfb80 20 client.18804 trim_cache size 0 max 16384 2023-09-13T09:52:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.213+0000 7fdf622bfb80 1 Processor -- start 2023-09-13T09:52:17.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf622bfb80 1 -- start start 2023-09-13T09:52:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc725604c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72561700 0x55fc72578100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725713f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72567b60 con 0x55fc72562060 2023-09-13T09:52:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc7255c310 con 0x55fc72561700 2023-09-13T09:52:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72565450 con 0x55fc72560a00 2023-09-13T09:52:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725713f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41808/0 (socket says 172.21.15.6:41808) 2023-09-13T09:52:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc725604c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 -- 172.21.15.6:0/2406600136 learned_addr learned my addr 172.21.15.6:0/2406600136 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4effd700 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72561700 0x55fc72578100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 -- 172.21.15.6:0/2406600136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 msgr2=0x55fc725604c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc725604c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 -- 172.21.15.6:0/2406600136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72561700 msgr2=0x55fc72578100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72561700 0x55fc72578100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 -- 172.21.15.6:0/2406600136 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc722dede0 con 0x55fc72562060 2023-09-13T09:52:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725713f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009b30 tx=0x7fdf48009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df89d926281f16e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.214+0000 7fdf367fc700 1 -- 172.21.15.6:0/2406600136 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf4800e040 con 0x55fc72562060 2023-09-13T09:52:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf367fc700 1 -- 172.21.15.6:0/2406600136 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf480079c0 con 0x55fc72562060 2023-09-13T09:52:17.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf367fc700 1 -- 172.21.15.6:0/2406600136 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf480055a0 con 0x55fc72562060 2023-09-13T09:52:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 -- 172.21.15.6:0/2406600136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 msgr2=0x55fc725713f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725713f0 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fdf48009b30 tx=0x7fdf48009e70 comp rx=0 tx=0).stop 2023-09-13T09:52:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 -- 172.21.15.6:0/2406600136 shutdown_connections 2023-09-13T09:52:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72562060 0x55fc725713f0 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc725604c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/2406600136 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72561700 0x55fc72578100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 -- 172.21.15.6:0/2406600136 >> 172.21.15.6:0/2406600136 conn(0x55fc724bec80 msgr2=0x55fc7255ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 -- 172.21.15.6:0/2406600136 shutdown_connections 2023-09-13T09:52:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 -- 172.21.15.6:0/2406600136 wait complete. 2023-09-13T09:52:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.215+0000 7fdf622bfb80 1 -- start start 2023-09-13T09:52:17.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 1 Processor -- start 2023-09-13T09:52:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc7256cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72561700 0x55fc7256d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc725701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72570730 con 0x55fc72561700 2023-09-13T09:52:17.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc725708a0 con 0x55fc72562060 2023-09-13T09:52:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc72570a60 con 0x55fc72560a00 2023-09-13T09:52:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf622bfb80 10 client.0 _ll_register_callbacks cb 0x55fc7244e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72561700 0x55fc7256d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72561700 0x55fc7256d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41812/0 (socket says 172.21.15.6:41812) 2023-09-13T09:52:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 -- 172.21.15.6:0/3437772487 learned_addr learned my addr 172.21.15.6:0/3437772487 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc7256cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4ffff700 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc725701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 -- 172.21.15.6:0/3437772487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 msgr2=0x55fc7256cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc7256cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 -- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 msgr2=0x55fc725701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc725701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.216+0000 7fdf4effd700 1 -- 172.21.15.6:0/3437772487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fc72332630 con 0x55fc72561700 2023-09-13T09:52:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf4effd700 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72561700 0x55fc7256d1d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdf4409a110 tx=0x7fdf44096640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=415ffe2784cef793 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf2effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf2effd700 1 -- 172.21.15.6:0/3437772487 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf44098310 con 0x55fc72561700 2023-09-13T09:52:17.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf2effd700 1 -- 172.21.15.6:0/3437772487 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf44098570 con 0x55fc72561700 2023-09-13T09:52:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf4800f040 con 0x55fc72561700 2023-09-13T09:52:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf2effd700 1 -- 172.21.15.6:0/3437772487 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf4409a430 con 0x55fc72561700 2023-09-13T09:52:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 10 client.18810 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55fc722c7c60 con 0x55fc72561700 2023-09-13T09:52:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf2effd700 1 -- 172.21.15.6:0/3437772487 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf4800f040 con 0x55fc72561700 2023-09-13T09:52:17.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf2effd700 1 -- 172.21.15.6:0/3437772487 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdf440a1d20 con 0x55fc72561700 2023-09-13T09:52:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 10 client.18810 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 10 client.18810 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:52:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 20 client.18810 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc725ca2b0 0x55fc725cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 4 client.18810 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.217+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fc7246c050 con 0x55fc725ca2b0 2023-09-13T09:52:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc725ca2b0 0x55fc725cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf2effd700 10 client.18810 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf4f7fe700 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc725ca2b0 0x55fc725cc6d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6f2d8ba871a3527e server_cookie=904ab3a7ef8b950 in_seq=0 out_seq=0 2023-09-13T09:52:17.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf2effd700 1 -- 172.21.15.6:0/3437772487 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fc7246c050 con 0x55fc725ca2b0 2023-09-13T09:52:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf2effd700 10 client.18810 handle_command_reply: tid=0 2023-09-13T09:52:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 client.18810 shutdown 2023-09-13T09:52:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72561700 msgr2=0x55fc7256d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72561700 0x55fc7256d1d0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fdf4409a110 tx=0x7fdf44096640 comp rx=0 tx=0).stop 2023-09-13T09:52:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 shutdown_connections 2023-09-13T09:52:17.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55fc725ca2b0 0x55fc725cc6d0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf2effd700 0 client.18810 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fc72562060 0x55fc725701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fc72560a00 0x55fc7256cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 --2- 172.21.15.6:0/3437772487 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fc72561700 0x55fc7256d1d0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 >> 172.21.15.6:0/3437772487 conn(0x55fc724bec80 msgr2=0x55fc72571c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 shutdown_connections 2023-09-13T09:52:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 1 -- 172.21.15.6:0/3437772487 wait complete. 2023-09-13T09:52:17.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.218+0000 7fdf622bfb80 20 client.18810 trim_cache size 0 max 16384 2023-09-13T09:52:17.244 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf380a0640 msgr2=0x7fdf380a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf380a0640 0x7fdf380a2b00 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fdf50199b50 tx=0x7fdf40009260 comp rx=0 tx=0).stop 2023-09-13T09:52:17.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 msgr2=0x7fdf501991c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501991c0 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fdf44009fd0 tx=0x7fdf44009580 comp rx=0 tx=0).stop 2023-09-13T09:52:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 shutdown_connections 2023-09-13T09:52:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf50102920 0x7fdf501a0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf50100d90 0x7fdf50198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdf380a0640 0x7fdf380a2b00 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 --2- 172.21.15.6:0/813699948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf50101f80 0x7fdf501991c0 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 >> 172.21.15.6:0/813699948 conn(0x7fdf500fc300 msgr2=0x7fdf501078c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 shutdown_connections 2023-09-13T09:52:17.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.219+0000 7fdf560da700 1 -- 172.21.15.6:0/813699948 wait complete. 2023-09-13T09:52:17.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:52:17.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 -- 172.21.15.6:0/853438530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8100790 msgr2=0x7f4af8108030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 --2- 172.21.15.6:0/853438530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8100790 0x7f4af8108030 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b0a0 tx=0x7f4af000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 -- 172.21.15.6:0/853438530 shutdown_connections 2023-09-13T09:52:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 --2- 172.21.15.6:0/853438530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8100790 0x7f4af8108030 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 --2- 172.21.15.6:0/853438530 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af8101210 0x7f4af8101630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 --2- 172.21.15.6:0/853438530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af80ffdd0 0x7f4af8100250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 -- 172.21.15.6:0/853438530 >> 172.21.15.6:0/853438530 conn(0x7f4af80fa880 msgr2=0x7f4af80fccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 -- 172.21.15.6:0/853438530 shutdown_connections 2023-09-13T09:52:17.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.391+0000 7f4aff015700 1 -- 172.21.15.6:0/853438530 wait complete. 2023-09-13T09:52:17.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 Processor -- start 2023-09-13T09:52:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 -- start start 2023-09-13T09:52:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af80ffdd0 0x7f4af8195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af8100790 0x7f4af8195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8101210 0x7f4af819cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af819d500 con 0x7f4af8101210 2023-09-13T09:52:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af819d640 con 0x7f4af80ffdd0 2023-09-13T09:52:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4aff015700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af819d7d0 con 0x7f4af8100790 2023-09-13T09:52:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4afd5b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8101210 0x7f4af819cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af80ffdd0 0x7f4af8195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4afd5b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8101210 0x7f4af819cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41828/0 (socket says 172.21.15.6:41828) 2023-09-13T09:52:17.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4afd5b2700 1 -- 172.21.15.6:0/1010308129 learned_addr learned my addr 172.21.15.6:0/1010308129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.392+0000 7f4af7fff700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af8100790 0x7f4af8195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4afd5b2700 1 -- 172.21.15.6:0/1010308129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af8100790 msgr2=0x7f4af8195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af8100790 0x7f4af8195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4afd5b2700 1 -- 172.21.15.6:0/1010308129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af80ffdd0 msgr2=0x7f4af8195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af80ffdd0 0x7f4af8195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4afd5b2700 1 -- 172.21.15.6:0/1010308129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af0009d00 con 0x7f4af8101210 2023-09-13T09:52:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4af7fff700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af8100790 0x7f4af8195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8101210 0x7f4af819cf30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009fd0 tx=0x7f4af000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4af5ffb700 1 -- 172.21.15.6:0/1010308129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af000e040 con 0x7f4af8101210 2023-09-13T09:52:17.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4af5ffb700 1 -- 172.21.15.6:0/1010308129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af00094a0 con 0x7f4af8101210 2023-09-13T09:52:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af819da50 con 0x7f4af8101210 2023-09-13T09:52:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4af5ffb700 1 -- 172.21.15.6:0/1010308129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001b6a0 con 0x7f4af8101210 2023-09-13T09:52:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.393+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af819de70 con 0x7f4af8101210 2023-09-13T09:52:17.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.395+0000 7f4af5ffb700 1 -- 172.21.15.6:0/1010308129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4af001d470 con 0x7f4af8101210 2023-09-13T09:52:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.396+0000 7f4af5ffb700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae80a0640 0x7f4ae80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.396+0000 7f4af5ffb700 1 -- 172.21.15.6:0/1010308129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4af00ccd60 con 0x7f4af8101210 2023-09-13T09:52:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.396+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae80a0640 0x7f4ae80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae80a0640 0x7f4ae80a2b00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009c60 tx=0x7f4aec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 Processor -- start 2023-09-13T09:52:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 -- start start 2023-09-13T09:52:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88e3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e4060 0x55e4e88e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88e2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e883b780 con 0x55e4e88e2a00 2023-09-13T09:52:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e88390a0 con 0x55e4e88e3700 2023-09-13T09:52:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e8834990 con 0x55e4e88e4060 2023-09-13T09:52:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88e3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afd5b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88e2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88e3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35356/0 (socket says 172.21.15.6:35356) 2023-09-13T09:52:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afd5b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88e2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41836/0 (socket says 172.21.15.6:41836) 2023-09-13T09:52:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afcdb1700 1 -- 172.21.15.6:0/1131265748 learned_addr learned my addr 172.21.15.6:0/1131265748 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4af7fff700 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e4060 0x55e4e88e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afd5b2700 1 -- 172.21.15.6:0/1131265748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e4060 msgr2=0x55e4e88e24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e4060 0x55e4e88e24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afd5b2700 1 -- 172.21.15.6:0/1131265748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 msgr2=0x55e4e88e3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88e3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.397+0000 7f4afd5b2700 1 -- 172.21.15.6:0/1131265748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4e86b4630 con 0x55e4e88e2a00 2023-09-13T09:52:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.398+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88e2e80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b070 tx=0x7f4af001dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac230713aec82d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.398+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1131265748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af009a530 con 0x55e4e88e2a00 2023-09-13T09:52:17.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.398+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1131265748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af0096040 con 0x55e4e88e2a00 2023-09-13T09:52:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.398+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1131265748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af009a790 con 0x55e4e88e2a00 2023-09-13T09:52:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.398+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1131265748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 msgr2=0x55e4e88e2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.398+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88e2e80 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f4af000b070 tx=0x7f4af001dcd0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1131265748 shutdown_connections 2023-09-13T09:52:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88e2e80 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88e3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1131265748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e4060 0x55e4e88e24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1131265748 >> 172.21.15.6:0/1131265748 conn(0x55e4e8840c80 msgr2=0x55e4e88dcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1131265748 shutdown_connections 2023-09-13T09:52:17.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1131265748 wait complete. 2023-09-13T09:52:17.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- start start 2023-09-13T09:52:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 Processor -- start 2023-09-13T09:52:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e3700 0x55e4e88ee3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e4060 0x55e4e88f5400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e87d2bb0 con 0x55e4e88e2a00 2023-09-13T09:52:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e87d28b0 con 0x55e4e88e4060 2023-09-13T09:52:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e86b6920 con 0x55e4e88e3700 2023-09-13T09:52:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.399+0000 7f4b0b1fab80 10 client.0 _ll_register_callbacks cb 0x55e4e87d0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e3700 0x55e4e88ee3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e3700 0x55e4e88ee3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44894/0 (socket says 172.21.15.6:44894) 2023-09-13T09:52:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4afd5b2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e4060 0x55e4e88f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 -- 172.21.15.6:0/1062005014 learned_addr learned my addr 172.21.15.6:0/1062005014 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 -- 172.21.15.6:0/1062005014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e4060 msgr2=0x55e4e88f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e4060 0x55e4e88f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 -- 172.21.15.6:0/1062005014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 msgr2=0x55e4e88ede80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 -- 172.21.15.6:0/1062005014 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af819de70 con 0x55e4e88e3700 2023-09-13T09:52:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4af7fff700 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e3700 0x55e4e88ee3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4012880 tx=0x7f4ae4012b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a01ae40c0a8b2a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4ad7fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:52:17.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4ad7fff700 1 -- 172.21.15.6:0/1062005014 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4017070 con 0x55e4e88e3700 2023-09-13T09:52:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4ad7fff700 1 -- 172.21.15.6:0/1062005014 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4ae40117f0 con 0x55e4e88e3700 2023-09-13T09:52:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e4e88d5670 con 0x55e4e88e3700 2023-09-13T09:52:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4ad7fff700 1 -- 172.21.15.6:0/1062005014 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ae40119b0 con 0x55e4e88e3700 2023-09-13T09:52:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4b0b1fab80 10 client.28132 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.400+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e4e884c7a0 con 0x55e4e88e3700 2023-09-13T09:52:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4ad7fff700 1 -- 172.21.15.6:0/1062005014 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e4e88d5670 con 0x55e4e88e3700 2023-09-13T09:52:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4ad7fff700 1 -- 172.21.15.6:0/1062005014 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4ae4026450 con 0x55e4e88e3700 2023-09-13T09:52:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4b0b1fab80 10 client.28132 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4b0b1fab80 10 client.28132 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:52:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4b0b1fab80 20 client.28132 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e88f9cb0 0x55e4e88fc0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4b0b1fab80 4 client.28132 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:17.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e4e882d970 con 0x55e4e88f9cb0 2023-09-13T09:52:17.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e88f9cb0 0x55e4e88fc0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4ad7fff700 10 client.28132 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:17.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.401+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e88f9cb0 0x55e4e88fc0d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e03ffb100ffb7ac9 server_cookie=1a2fea0d969eecea in_seq=0 out_seq=0 2023-09-13T09:52:17.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4ad7fff700 1 -- 172.21.15.6:0/1062005014 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e4e882d970 con 0x55e4e88f9cb0 2023-09-13T09:52:17.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4ad7fff700 10 client.28132 handle_command_reply: tid=0 2023-09-13T09:52:17.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 client.28132 shutdown 2023-09-13T09:52:17.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e3700 msgr2=0x55e4e88ee3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e3700 0x55e4e88ee3c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4012880 tx=0x7f4ae4012b90 comp rx=0 tx=0).stop 2023-09-13T09:52:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 shutdown_connections 2023-09-13T09:52:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e88f9cb0 0x55e4e88fc0d0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e4060 0x55e4e88f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4ad7fff700 0 client.28132 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/1062005014 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e3700 0x55e4e88ee3c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 >> 172.21.15.6:0/1062005014 conn(0x55e4e8840c80 msgr2=0x55e4e88d77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 shutdown_connections 2023-09-13T09:52:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/1062005014 wait complete. 2023-09-13T09:52:17.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.402+0000 7f4b0b1fab80 20 client.28132 trim_cache size 0 max 16384 2023-09-13T09:52:17.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.415+0000 7f4b0b1fab80 1 Processor -- start 2023-09-13T09:52:17.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4b0b1fab80 1 -- start start 2023-09-13T09:52:17.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88ee380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e88eefd0 con 0x55e4e88e4060 2023-09-13T09:52:17.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e88de730 con 0x55e4e88e3700 2023-09-13T09:52:17.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e88eeb00 con 0x55e4e88e2a00 2023-09-13T09:52:17.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4afd5b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88ee380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88ee380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35372/0 (socket says 172.21.15.6:35372) 2023-09-13T09:52:17.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 -- 172.21.15.6:0/2716567105 learned_addr learned my addr 172.21.15.6:0/2716567105 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44900/0 (socket says 172.21.15.6:44900) 2023-09-13T09:52:17.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 -- 172.21.15.6:0/2716567105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 msgr2=0x55e4e88ede40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 -- 172.21.15.6:0/2716567105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 msgr2=0x55e4e88f53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 -- 172.21.15.6:0/2716567105 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e4e8660de0 con 0x55e4e88e3700 2023-09-13T09:52:17.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.416+0000 7f4af7fff700 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88ee380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000c00 tx=0x7f4ae40057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7854a53a192efa9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4ae37fe700 1 -- 172.21.15.6:0/2716567105 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4017040 con 0x55e4e88e3700 2023-09-13T09:52:17.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4ae37fe700 1 -- 172.21.15.6:0/2716567105 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ae40054f0 con 0x55e4e88e3700 2023-09-13T09:52:17.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4ae37fe700 1 -- 172.21.15.6:0/2716567105 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4011db0 con 0x55e4e88e3700 2023-09-13T09:52:17.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/2716567105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 msgr2=0x55e4e88ee380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88ee380 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4ae4000c00 tx=0x7f4ae40057e0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/2716567105 shutdown_connections 2023-09-13T09:52:17.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88ede40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/2716567105 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88ee380 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/2716567105 >> 172.21.15.6:0/2716567105 conn(0x55e4e8840c80 msgr2=0x55e4e88dce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/2716567105 shutdown_connections 2023-09-13T09:52:17.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/2716567105 wait complete. 2023-09-13T09:52:17.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.417+0000 7f4b0b1fab80 1 -- start start 2023-09-13T09:52:17.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 1 Processor -- start 2023-09-13T09:52:17.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88f1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88f1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f45c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e88f4b00 con 0x55e4e88e4060 2023-09-13T09:52:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e88f4c70 con 0x55e4e88e3700 2023-09-13T09:52:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e4e88f4e30 con 0x55e4e88e2a00 2023-09-13T09:52:17.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4b0b1fab80 10 client.0 _ll_register_callbacks cb 0x55e4e87d0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4afd5b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f45c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4af7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88f1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4afcdb1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88f1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44906/0 (socket says 172.21.15.6:44906) 2023-09-13T09:52:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.418+0000 7f4afcdb1700 1 -- 172.21.15.6:0/652564088 learned_addr learned my addr 172.21.15.6:0/652564088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4afd5b2700 1 -- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 msgr2=0x55e4e88f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4afd5b2700 1 -- 172.21.15.6:0/652564088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 msgr2=0x55e4e88f1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88f1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4afd5b2700 1 -- 172.21.15.6:0/652564088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aec017070 con 0x55e4e88e4060 2023-09-13T09:52:17.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4afd5b2700 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f45c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x55e4e88e34a0 tx=0x7f4af0018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c34207033ac0523 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4ad7fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4ad7fff700 1 -- 172.21.15.6:0/652564088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af00988d0 con 0x55e4e88e4060 2023-09-13T09:52:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4ad7fff700 1 -- 172.21.15.6:0/652564088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4af009e120 con 0x55e4e88e4060 2023-09-13T09:52:17.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4af0096040 con 0x55e4e88e4060 2023-09-13T09:52:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4ad7fff700 1 -- 172.21.15.6:0/652564088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af009a530 con 0x55e4e88e4060 2023-09-13T09:52:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4b0b1fab80 10 client.18828 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e4e86b4630 con 0x55e4e88e4060 2023-09-13T09:52:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4ad7fff700 1 -- 172.21.15.6:0/652564088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af0096040 con 0x55e4e88e4060 2023-09-13T09:52:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.419+0000 7f4ad7fff700 1 -- 172.21.15.6:0/652564088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4af00a2080 con 0x55e4e88e4060 2023-09-13T09:52:17.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4b0b1fab80 10 client.18828 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4b0b1fab80 10 client.18828 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:52:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4b0b1fab80 20 client.18828 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e894e4a0 0x55e4e89508c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4b0b1fab80 4 client.18828 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:17.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e4e87ee050 con 0x55e4e894e4a0 2023-09-13T09:52:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e894e4a0 0x55e4e89508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4ad7fff700 10 client.18828 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4afcdb1700 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e894e4a0 0x55e4e89508c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa6aed32fa4c65bd server_cookie=47aa5143ded2581e in_seq=0 out_seq=0 2023-09-13T09:52:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4ad7fff700 1 -- 172.21.15.6:0/652564088 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e4e87ee050 con 0x55e4e894e4a0 2023-09-13T09:52:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4ad7fff700 10 client.18828 handle_command_reply: tid=0 2023-09-13T09:52:17.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.420+0000 7f4b0b1fab80 1 client.18828 shutdown 2023-09-13T09:52:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 msgr2=0x55e4e88f45c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f45c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x55e4e88e34a0 tx=0x7f4af0018f90 comp rx=0 tx=0).stop 2023-09-13T09:52:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 shutdown_connections 2023-09-13T09:52:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e4e894e4a0 0x55e4e89508c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e4e88e4060 0x55e4e88f45c0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e4e88e2a00 0x55e4e88f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 --2- 172.21.15.6:0/652564088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e4e88e3700 0x55e4e88f1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 >> 172.21.15.6:0/652564088 conn(0x55e4e8840c80 msgr2=0x55e4e88e8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4ad7fff700 0 client.18828 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:17.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.421+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 shutdown_connections 2023-09-13T09:52:17.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.422+0000 7f4b0b1fab80 1 -- 172.21.15.6:0/652564088 wait complete. 2023-09-13T09:52:17.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.422+0000 7f4b0b1fab80 20 client.18828 trim_cache size 0 max 16384 2023-09-13T09:52:17.446 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae80a0640 msgr2=0x7f4ae80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae80a0640 0x7f4ae80a2b00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f4aec009c60 tx=0x7f4aec009260 comp rx=0 tx=0).stop 2023-09-13T09:52:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8101210 msgr2=0x7f4af819cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8101210 0x7f4af819cf30 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4af0009fd0 tx=0x7f4af000bce0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 shutdown_connections 2023-09-13T09:52:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae80a0640 0x7f4ae80a2b00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af8101210 0x7f4af819cf30 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af80ffdd0 0x7f4af8195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 --2- 172.21.15.6:0/1010308129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af8100790 0x7f4af8195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 >> 172.21.15.6:0/1010308129 conn(0x7f4af80fa880 msgr2=0x7f4af8104270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.423+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 shutdown_connections 2023-09-13T09:52:17.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.424+0000 7f4aff015700 1 -- 172.21.15.6:0/1010308129 wait complete. 2023-09-13T09:52:17.450 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:52:17.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 -- 172.21.15.6:0/726215624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 msgr2=0x7fe680108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 --2- 172.21.15.6:0/726215624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 0x7fe680108180 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fe67800b0a0 tx=0x7fe67800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 -- 172.21.15.6:0/726215624 shutdown_connections 2023-09-13T09:52:17.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 --2- 172.21.15.6:0/726215624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 0x7fe680108180 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 --2- 172.21.15.6:0/726215624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6801012d0 0x7fe6801016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 --2- 172.21.15.6:0/726215624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6800fff20 0x7fe6801003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 -- 172.21.15.6:0/726215624 >> 172.21.15.6:0/726215624 conn(0x7fe6800fa9b0 msgr2=0x7fe6800fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 -- 172.21.15.6:0/726215624 shutdown_connections 2023-09-13T09:52:17.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 -- 172.21.15.6:0/726215624 wait complete. 2023-09-13T09:52:17.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.589+0000 7fe68517f700 1 Processor -- start 2023-09-13T09:52:17.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe68517f700 1 -- start start 2023-09-13T09:52:17.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe68517f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6800fff20 0x7fe6800ff980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe68517f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 0x7fe68019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe68517f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6801012d0 0x7fe68019df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe68517f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019e700 con 0x7fe6801008e0 2023-09-13T09:52:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe68517f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019e870 con 0x7fe6800fff20 2023-09-13T09:52:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe68517f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68019ea30 con 0x7fe6801012d0 2023-09-13T09:52:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 0x7fe68019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6800fff20 0x7fe6800ff980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 0x7fe68019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41868/0 (socket says 172.21.15.6:41868) 2023-09-13T09:52:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67e59c700 1 -- 172.21.15.6:0/2098333331 learned_addr learned my addr 172.21.15.6:0/2098333331 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67f59e700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6801012d0 0x7fe68019df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67ed9d700 1 -- 172.21.15.6:0/2098333331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6801012d0 msgr2=0x7fe68019df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6801012d0 0x7fe68019df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67ed9d700 1 -- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 msgr2=0x7fe68019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 0x7fe68019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.590+0000 7fe67ed9d700 1 -- 172.21.15.6:0/2098333331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678009d00 con 0x7fe6800fff20 2023-09-13T09:52:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.591+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6800fff20 0x7fe6800ff980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e9c0 tx=0x7fe67000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.591+0000 7fe677fff700 1 -- 172.21.15.6:0/2098333331 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670004220 con 0x7fe6800fff20 2023-09-13T09:52:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.591+0000 7fe677fff700 1 -- 172.21.15.6:0/2098333331 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe670004380 con 0x7fe6800fff20 2023-09-13T09:52:17.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.591+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68019ed10 con 0x7fe6800fff20 2023-09-13T09:52:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.591+0000 7fe677fff700 1 -- 172.21.15.6:0/2098333331 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670003be0 con 0x7fe6800fff20 2023-09-13T09:52:17.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.591+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68019f1c0 con 0x7fe6800fff20 2023-09-13T09:52:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.594+0000 7fe677fff700 1 -- 172.21.15.6:0/2098333331 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe670003d40 con 0x7fe6800fff20 2023-09-13T09:52:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.594+0000 7fe677fff700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe66c0a06c0 0x7fe66c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.595+0000 7fe677fff700 1 -- 172.21.15.6:0/2098333331 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe670014070 con 0x7fe6800fff20 2023-09-13T09:52:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.595+0000 7fe67e59c700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe66c0a06c0 0x7fe66c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.595+0000 7fe691364b80 1 Processor -- start 2023-09-13T09:52:17.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.595+0000 7fe691364b80 1 -- start start 2023-09-13T09:52:17.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.595+0000 7fe67e59c700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe66c0a06c0 0x7fe66c0a2b80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe668009d20 tx=0x7fe668009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe691364b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef86b0 0x556498ef8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe691364b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498ef9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe691364b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef99b0 0x556498ef9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe691364b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498e51780 con 0x556498ef86b0 2023-09-13T09:52:17.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe691364b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498e4f0a0 con 0x556498ef99b0 2023-09-13T09:52:17.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe691364b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498e4a990 con 0x556498ef8ff0 2023-09-13T09:52:17.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef86b0 0x556498ef8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef86b0 0x556498ef8ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41874/0 (socket says 172.21.15.6:41874) 2023-09-13T09:52:17.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 -- 172.21.15.6:0/3501750824 learned_addr learned my addr 172.21.15.6:0/3501750824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67e59c700 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498ef9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 -- 172.21.15.6:0/3501750824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 msgr2=0x556498ef9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498ef9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 -- 172.21.15.6:0/3501750824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef99b0 msgr2=0x556498ef9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef99b0 0x556498ef9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 -- 172.21.15.6:0/3501750824 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556498cca630 con 0x556498ef86b0 2023-09-13T09:52:17.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.596+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef86b0 0x556498ef8ab0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe6700a1070 tx=0x7fe670098f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e38f13ba00ad2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.597+0000 7fe6757fa700 1 -- 172.21.15.6:0/3501750824 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67009d170 con 0x556498ef86b0 2023-09-13T09:52:17.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.597+0000 7fe6757fa700 1 -- 172.21.15.6:0/3501750824 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe670099530 con 0x556498ef86b0 2023-09-13T09:52:17.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.597+0000 7fe6757fa700 1 -- 172.21.15.6:0/3501750824 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67001ff00 con 0x556498ef86b0 2023-09-13T09:52:17.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.597+0000 7fe691364b80 1 -- 172.21.15.6:0/3501750824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef86b0 msgr2=0x556498ef8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.597+0000 7fe691364b80 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef86b0 0x556498ef8ab0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fe6700a1070 tx=0x7fe670098f10 comp rx=0 tx=0).stop 2023-09-13T09:52:17.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 -- 172.21.15.6:0/3501750824 shutdown_connections 2023-09-13T09:52:17.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef99b0 0x556498ef9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef86b0 0x556498ef8ab0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 --2- 172.21.15.6:0/3501750824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498ef9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 -- 172.21.15.6:0/3501750824 >> 172.21.15.6:0/3501750824 conn(0x556498e56c80 msgr2=0x556498ef2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 -- 172.21.15.6:0/3501750824 shutdown_connections 2023-09-13T09:52:17.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 -- 172.21.15.6:0/3501750824 wait complete. 2023-09-13T09:52:17.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 -- start start 2023-09-13T09:52:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.598+0000 7fe691364b80 1 Processor -- start 2023-09-13T09:52:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe691364b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f02020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe691364b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f02560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe691364b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef99b0 0x556498f095a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe691364b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498de8bb0 con 0x556498ef99b0 2023-09-13T09:52:17.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe691364b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498de88b0 con 0x556498ef86b0 2023-09-13T09:52:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe691364b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498ccc920 con 0x556498ef8ff0 2023-09-13T09:52:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe691364b80 10 client.0 _ll_register_callbacks cb 0x556498de6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f02020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f02020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35404/0 (socket says 172.21.15.6:35404) 2023-09-13T09:52:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef99b0 0x556498f095a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 -- 172.21.15.6:0/1273075138 learned_addr learned my addr 172.21.15.6:0/1273075138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67e59c700 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f02560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 -- 172.21.15.6:0/1273075138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 msgr2=0x556498f02560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f02560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 -- 172.21.15.6:0/1273075138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef99b0 msgr2=0x556498f095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef99b0 0x556498f095a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67ed9d700 1 -- 172.21.15.6:0/1273075138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68019f1c0 con 0x556498ef86b0 2023-09-13T09:52:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.599+0000 7fe67f59e700 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef99b0 0x556498f095a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f02020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c5b0 tx=0x7fe67009d360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1edec6e26c2bc64a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe6667fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:52:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe6667fc700 1 -- 172.21.15.6:0/1273075138 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67001fee0 con 0x556498ef86b0 2023-09-13T09:52:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe6667fc700 1 -- 172.21.15.6:0/1273075138 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe6700a15a0 con 0x556498ef86b0 2023-09-13T09:52:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556498eeb670 con 0x556498ef86b0 2023-09-13T09:52:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe6667fc700 1 -- 172.21.15.6:0/1273075138 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe670098a20 con 0x556498ef86b0 2023-09-13T09:52:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe691364b80 10 client.28232 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x556498e627a0 con 0x556498ef86b0 2023-09-13T09:52:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.600+0000 7fe6667fc700 1 -- 172.21.15.6:0/1273075138 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556498eeb670 con 0x556498ef86b0 2023-09-13T09:52:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe6667fc700 1 -- 172.21.15.6:0/1273075138 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe6700953b0 con 0x556498ef86b0 2023-09-13T09:52:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe691364b80 10 client.28232 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe691364b80 10 client.28232 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:52:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe691364b80 20 client.28232 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe691364b80 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498f0d8b0 0x556498f0fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe691364b80 4 client.28232 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:17.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556498e43970 con 0x556498f0d8b0 2023-09-13T09:52:17.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe67e59c700 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498f0d8b0 0x556498f0fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe6667fc700 10 client.28232 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.601+0000 7fe67e59c700 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498f0d8b0 0x556498f0fca0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5562adefad89758f server_cookie=eae86d74d73645ea in_seq=0 out_seq=0 2023-09-13T09:52:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.602+0000 7fe6667fc700 1 -- 172.21.15.6:0/1273075138 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556498e43970 con 0x556498f0d8b0 2023-09-13T09:52:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.602+0000 7fe6667fc700 10 client.28232 handle_command_reply: tid=0 2023-09-13T09:52:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.602+0000 7fe691364b80 1 client.28232 shutdown 2023-09-13T09:52:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 msgr2=0x556498f02020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f02020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c5b0 tx=0x7fe67009d360 comp rx=0 tx=0).stop 2023-09-13T09:52:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 shutdown_connections 2023-09-13T09:52:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498f0d8b0 0x556498f0fca0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef99b0 0x556498f095a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f02020 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 --2- 172.21.15.6:0/1273075138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f02560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe6667fc700 0 client.28232 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 >> 172.21.15.6:0/1273075138 conn(0x556498e56c80 msgr2=0x556498eed7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 shutdown_connections 2023-09-13T09:52:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 1 -- 172.21.15.6:0/1273075138 wait complete. 2023-09-13T09:52:17.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.603+0000 7fe691364b80 20 client.28232 trim_cache size 0 max 16384 2023-09-13T09:52:17.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 Processor -- start 2023-09-13T09:52:17.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 -- start start 2023-09-13T09:52:17.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498e56c80 0x556498f12580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f12ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef8ff0 0x556498f09560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498e43970 con 0x556498ef8ff0 2023-09-13T09:52:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498f01b90 con 0x556498ef86b0 2023-09-13T09:52:17.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe691364b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498ef4370 con 0x556498e56c80 2023-09-13T09:52:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498e56c80 0x556498f12580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.622+0000 7fe67f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef8ff0 0x556498f09560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef8ff0 0x556498f09560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41892/0 (socket says 172.21.15.6:41892) 2023-09-13T09:52:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498e56c80 0x556498f12580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:44942/0 (socket says 172.21.15.6:44942) 2023-09-13T09:52:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67f59e700 1 -- 172.21.15.6:0/581803072 learned_addr learned my addr 172.21.15.6:0/581803072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67ed9d700 1 -- 172.21.15.6:0/581803072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 msgr2=0x556498f12ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f12ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67ed9d700 1 -- 172.21.15.6:0/581803072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef8ff0 msgr2=0x556498f09560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef8ff0 0x556498f09560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67ed9d700 1 -- 172.21.15.6:0/581803072 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556498c76de0 con 0x556498e56c80 2023-09-13T09:52:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67f59e700 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef8ff0 0x556498f09560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498e56c80 0x556498f12580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe670099230 tx=0x7fe670003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=760b3acfde593174 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe675ffb700 1 -- 172.21.15.6:0/581803072 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700978d0 con 0x556498e56c80 2023-09-13T09:52:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe675ffb700 1 -- 172.21.15.6:0/581803072 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe670095040 con 0x556498e56c80 2023-09-13T09:52:17.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.623+0000 7fe675ffb700 1 -- 172.21.15.6:0/581803072 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe670095560 con 0x556498e56c80 2023-09-13T09:52:17.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.624+0000 7fe691364b80 1 -- 172.21.15.6:0/581803072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498e56c80 msgr2=0x556498f12580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.624+0000 7fe691364b80 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498e56c80 0x556498f12580 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe670099230 tx=0x7fe670003680 comp rx=0 tx=0).stop 2023-09-13T09:52:17.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.624+0000 7fe691364b80 1 -- 172.21.15.6:0/581803072 shutdown_connections 2023-09-13T09:52:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.624+0000 7fe691364b80 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498ef8ff0 0x556498f09560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.624+0000 7fe691364b80 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498e56c80 0x556498f12580 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.624+0000 7fe691364b80 1 --2- 172.21.15.6:0/581803072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f12ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.624+0000 7fe691364b80 1 -- 172.21.15.6:0/581803072 >> 172.21.15.6:0/581803072 conn(0x556498efa080 msgr2=0x556498efca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 -- 172.21.15.6:0/581803072 shutdown_connections 2023-09-13T09:52:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 -- 172.21.15.6:0/581803072 wait complete. 2023-09-13T09:52:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 -- start start 2023-09-13T09:52:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 Processor -- start 2023-09-13T09:52:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498e56c80 0x556498f042f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f04830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f93190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.625+0000 7fe691364b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498f04db0 con 0x556498e56c80 2023-09-13T09:52:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe691364b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498f04f20 con 0x556498ef86b0 2023-09-13T09:52:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe691364b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556498f93700 con 0x556498ef8ff0 2023-09-13T09:52:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe691364b80 10 client.0 _ll_register_callbacks cb 0x556498de6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f04830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f04830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35420/0 (socket says 172.21.15.6:35420) 2023-09-13T09:52:17.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498e56c80 0x556498f042f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67e59c700 1 -- 172.21.15.6:0/2494107859 learned_addr learned my addr 172.21.15.6:0/2494107859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67f59e700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f93190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67ed9d700 1 -- 172.21.15.6:0/2494107859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 msgr2=0x556498f93190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f93190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67ed9d700 1 -- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 msgr2=0x556498f04830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f04830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67ed9d700 1 -- 172.21.15.6:0/2494107859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe680108a80 con 0x556498e56c80 2023-09-13T09:52:17.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67f59e700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f93190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67e59c700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f04830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe67ed9d700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498e56c80 0x556498f042f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fe670095a30 tx=0x7fe670000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89a4fc9836f524ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.626+0000 7fe6667fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe6667fc700 1 -- 172.21.15.6:0/2494107859 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6700978d0 con 0x556498e56c80 2023-09-13T09:52:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe670099530 con 0x556498e56c80 2023-09-13T09:52:17.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe6667fc700 1 -- 172.21.15.6:0/2494107859 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe6700a15a0 con 0x556498e56c80 2023-09-13T09:52:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe6667fc700 1 -- 172.21.15.6:0/2494107859 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6700a1110 con 0x556498e56c80 2023-09-13T09:52:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 10 client.18846 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x556498e627a0 con 0x556498e56c80 2023-09-13T09:52:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe6667fc700 1 -- 172.21.15.6:0/2494107859 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe670099530 con 0x556498e56c80 2023-09-13T09:52:17.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe6667fc700 1 -- 172.21.15.6:0/2494107859 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe670098570 con 0x556498e56c80 2023-09-13T09:52:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 10 client.18846 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 10 client.18846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:52:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 20 client.18846 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498ef99b0 0x556498f96ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 4 client.18846 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.627+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556498e04050 con 0x556498ef99b0 2023-09-13T09:52:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.628+0000 7fe67e59c700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498ef99b0 0x556498f96ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.628+0000 7fe6667fc700 10 client.18846 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.628+0000 7fe67e59c700 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498ef99b0 0x556498f96ae0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db9621a7cca2244b server_cookie=6ca4027354ab8792 in_seq=0 out_seq=0 2023-09-13T09:52:17.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.628+0000 7fe6667fc700 1 -- 172.21.15.6:0/2494107859 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556498e04050 con 0x556498ef99b0 2023-09-13T09:52:17.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.628+0000 7fe6667fc700 10 client.18846 handle_command_reply: tid=0 2023-09-13T09:52:17.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.628+0000 7fe691364b80 1 client.18846 shutdown 2023-09-13T09:52:17.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.629+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498e56c80 msgr2=0x556498f042f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.629+0000 7fe691364b80 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498e56c80 0x556498f042f0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fe670095a30 tx=0x7fe670000bc0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.629+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 shutdown_connections 2023-09-13T09:52:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.629+0000 7fe691364b80 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x556498ef99b0 0x556498f96ae0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.629+0000 7fe691364b80 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556498ef8ff0 0x556498f93190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.629+0000 7fe691364b80 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556498e56c80 0x556498f042f0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.629+0000 7fe691364b80 1 --2- 172.21.15.6:0/2494107859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556498ef86b0 0x556498f04830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.630+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 >> 172.21.15.6:0/2494107859 conn(0x556498efa080 msgr2=0x556498efff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.630+0000 7fe6667fc700 0 client.18846 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:17.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.630+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 shutdown_connections 2023-09-13T09:52:17.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.630+0000 7fe691364b80 1 -- 172.21.15.6:0/2494107859 wait complete. 2023-09-13T09:52:17.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.630+0000 7fe691364b80 20 client.18846 trim_cache size 0 max 16384 2023-09-13T09:52:17.642 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:17.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe66c0a06c0 msgr2=0x7fe66c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe66c0a06c0 0x7fe66c0a2b80 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe668009d20 tx=0x7fe668009260 comp rx=0 tx=0).stop 2023-09-13T09:52:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6800fff20 msgr2=0x7fe6800ff980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6800fff20 0x7fe6800ff980 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe67000e9c0 tx=0x7fe67000ecd0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 shutdown_connections 2023-09-13T09:52:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe6801012d0 0x7fe68019df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe6800fff20 0x7fe6800ff980 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe66c0a06c0 0x7fe66c0a2b80 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 --2- 172.21.15.6:0/2098333331 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6801008e0 0x7fe68019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 >> 172.21.15.6:0/2098333331 conn(0x7fe6800fa9b0 msgr2=0x7fe680104410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.631+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 shutdown_connections 2023-09-13T09:52:17.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.632+0000 7fe68517f700 1 -- 172.21.15.6:0/2098333331 wait complete. 2023-09-13T09:52:17.646 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:52:17.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.783+0000 7f151d501700 1 -- 172.21.15.6:0/1792758666 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508003a90 con 0x7f1518100eb0 2023-09-13T09:52:17.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 -- 172.21.15.6:0/1792758666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 msgr2=0x7f1518101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 --2- 172.21.15.6:0/1792758666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518101310 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f15080099c0 tx=0x7f1508009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 -- 172.21.15.6:0/1792758666 shutdown_connections 2023-09-13T09:52:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 --2- 172.21.15.6:0/1792758666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1518101850 0x7f1518108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 --2- 172.21.15.6:0/1792758666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15180ffcc0 0x7f15181000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 --2- 172.21.15.6:0/1792758666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518101310 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 -- 172.21.15.6:0/1792758666 >> 172.21.15.6:0/1792758666 conn(0x7f15180fb250 msgr2=0x7f15180fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 -- 172.21.15.6:0/1792758666 shutdown_connections 2023-09-13T09:52:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.784+0000 7f1520767700 1 -- 172.21.15.6:0/1792758666 wait complete. 2023-09-13T09:52:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 Processor -- start 2023-09-13T09:52:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 -- start start 2023-09-13T09:52:17.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15180ffcc0 0x7f1518196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1518101850 0x7f151819e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151819e600 con 0x7f1518100eb0 2023-09-13T09:52:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151819e740 con 0x7f1518101850 2023-09-13T09:52:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f1520767700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f151819e8d0 con 0x7f15180ffcc0 2023-09-13T09:52:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41910/0 (socket says 172.21.15.6:41910) 2023-09-13T09:52:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 -- 172.21.15.6:0/1900125196 learned_addr learned my addr 172.21.15.6:0/1900125196 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151e503700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15180ffcc0 0x7f1518196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151ed04700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1518101850 0x7f151819e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 -- 172.21.15.6:0/1900125196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15180ffcc0 msgr2=0x7f1518196a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15180ffcc0 0x7f1518196a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 -- 172.21.15.6:0/1900125196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1518101850 msgr2=0x7f151819e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1518101850 0x7f151819e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 -- 172.21.15.6:0/1900125196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15080095f0 con 0x7f1518100eb0 2023-09-13T09:52:17.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.785+0000 7f151dd02700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518196fc0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f150800c010 tx=0x7f150800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.786+0000 7f150f7fe700 1 -- 172.21.15.6:0/1900125196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150801d070 con 0x7f1518100eb0 2023-09-13T09:52:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.786+0000 7f150f7fe700 1 -- 172.21.15.6:0/1900125196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1508005050 con 0x7f1518100eb0 2023-09-13T09:52:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.786+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f151819eb50 con 0x7f1518100eb0 2023-09-13T09:52:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.786+0000 7f150f7fe700 1 -- 172.21.15.6:0/1900125196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1508004ad0 con 0x7f1518100eb0 2023-09-13T09:52:17.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.786+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151819ef70 con 0x7f1518100eb0 2023-09-13T09:52:17.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.788+0000 7f150f7fe700 1 -- 172.21.15.6:0/1900125196 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f15080051c0 con 0x7f1518100eb0 2023-09-13T09:52:17.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.788+0000 7f150f7fe700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15040a0640 0x7f15040a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.789+0000 7f150f7fe700 1 -- 172.21.15.6:0/1900125196 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15080ccb30 con 0x7f1518100eb0 2023-09-13T09:52:17.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.789+0000 7f151e503700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15040a0640 0x7f15040a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.789+0000 7f151e503700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15040a0640 0x7f15040a2b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1518100d10 tx=0x7f1514009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.789+0000 7f152c94cb80 1 Processor -- start 2023-09-13T09:52:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f152c94cb80 1 -- start start 2023-09-13T09:52:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518178700 0x55a518178b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a5181774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518177a00 0x55a518177e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f152c94cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5180d0780 con 0x55a518177a00 2023-09-13T09:52:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f152c94cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5180ce0a0 con 0x55a518178700 2023-09-13T09:52:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f152c94cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5180c9990 con 0x55a518179060 2023-09-13T09:52:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518177a00 0x55a518177e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518177a00 0x55a518177e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41920/0 (socket says 172.21.15.6:41920) 2023-09-13T09:52:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 -- 172.21.15.6:0/609238048 learned_addr learned my addr 172.21.15.6:0/609238048 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151dd02700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a5181774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151e503700 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518178700 0x55a518178b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 -- 172.21.15.6:0/609238048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 msgr2=0x55a5181774c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a5181774c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 -- 172.21.15.6:0/609238048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518178700 msgr2=0x55a518178b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518178700 0x55a518178b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 -- 172.21.15.6:0/609238048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a517f49630 con 0x55a518177a00 2023-09-13T09:52:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.790+0000 7f151ed04700 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518177a00 0x55a518177e80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f1510011680 tx=0x7f1510009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993b6b0132f11ba8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f150cff9700 1 -- 172.21.15.6:0/609238048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000e040 con 0x55a518177a00 2023-09-13T09:52:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f150cff9700 1 -- 172.21.15.6:0/609238048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f151000f040 con 0x55a518177a00 2023-09-13T09:52:17.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f150cff9700 1 -- 172.21.15.6:0/609238048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1510004860 con 0x55a518177a00 2023-09-13T09:52:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 -- 172.21.15.6:0/609238048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518177a00 msgr2=0x55a518177e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518177a00 0x55a518177e80 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f1510011680 tx=0x7f1510009920 comp rx=0 tx=0).stop 2023-09-13T09:52:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 -- 172.21.15.6:0/609238048 shutdown_connections 2023-09-13T09:52:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518177a00 0x55a518177e80 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518178700 0x55a518178b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 --2- 172.21.15.6:0/609238048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a5181774c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 -- 172.21.15.6:0/609238048 >> 172.21.15.6:0/609238048 conn(0x55a5180d5c80 msgr2=0x55a518171f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 -- 172.21.15.6:0/609238048 shutdown_connections 2023-09-13T09:52:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.791+0000 7f152c94cb80 1 -- 172.21.15.6:0/609238048 wait complete. 2023-09-13T09:52:17.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 -- start start 2023-09-13T09:52:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 Processor -- start 2023-09-13T09:52:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a518180f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518181440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a518067bb0 con 0x55a518179060 2023-09-13T09:52:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5180678b0 con 0x55a518177a00 2023-09-13T09:52:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a517f4b920 con 0x55a518178700 2023-09-13T09:52:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f152c94cb80 10 client.0 _ll_register_callbacks cb 0x55a518065680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a518180f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151ed04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a518180f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35446/0 (socket says 172.21.15.6:35446) 2023-09-13T09:52:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 -- 172.21.15.6:0/486566775 learned_addr learned my addr 172.21.15.6:0/486566775 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151ed04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41926/0 (socket says 172.21.15.6:41926) 2023-09-13T09:52:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151dd02700 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518181440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 -- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 msgr2=0x55a518181440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518181440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 -- 172.21.15.6:0/486566775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 msgr2=0x55a518188480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.792+0000 7f151e503700 1 -- 172.21.15.6:0/486566775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1510011330 con 0x55a518177a00 2023-09-13T09:52:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f151ed04700 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f151e503700 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a518180f00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f151401d8f0 tx=0x7f15140047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c9794e5f504741e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f1501ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:52:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f1501ffb700 1 -- 172.21.15.6:0/486566775 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1514022070 con 0x55a518177a00 2023-09-13T09:52:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a51816a670 con 0x55a518177a00 2023-09-13T09:52:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f1501ffb700 1 -- 172.21.15.6:0/486566775 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1514004020 con 0x55a518177a00 2023-09-13T09:52:17.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f1501ffb700 1 -- 172.21.15.6:0/486566775 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1514011b90 con 0x55a518177a00 2023-09-13T09:52:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f152c94cb80 10 client.28247 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a5180e17a0 con 0x55a518177a00 2023-09-13T09:52:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f1501ffb700 1 -- 172.21.15.6:0/486566775 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a51816a670 con 0x55a518177a00 2023-09-13T09:52:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f1501ffb700 1 -- 172.21.15.6:0/486566775 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1514003680 con 0x55a518177a00 2023-09-13T09:52:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f152c94cb80 10 client.28247 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f152c94cb80 10 client.28247 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:52:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f152c94cb80 20 client.28247 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.793+0000 7f152c94cb80 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a51818cd00 0x55a51818f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.794+0000 7f152c94cb80 4 client.28247 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:17.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.794+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5180c2970 con 0x55a51818cd00 2023-09-13T09:52:17.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.794+0000 7f151dd02700 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a51818cd00 0x55a51818f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.794+0000 7f151dd02700 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a51818cd00 0x55a51818f120 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ff48835de63640a server_cookie=d83a683264376462 in_seq=0 out_seq=0 2023-09-13T09:52:17.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.794+0000 7f1501ffb700 10 client.28247 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:17.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f1501ffb700 1 -- 172.21.15.6:0/486566775 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a5180c2970 con 0x55a51818cd00 2023-09-13T09:52:17.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f1501ffb700 10 client.28247 handle_command_reply: tid=0 2023-09-13T09:52:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 client.28247 shutdown 2023-09-13T09:52:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 msgr2=0x55a518180f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a518180f00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f151401d8f0 tx=0x7f15140047c0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 shutdown_connections 2023-09-13T09:52:17.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a51818cd00 0x55a51818f120 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f1501ffb700 0 client.28247 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a518180f00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 --2- 172.21.15.6:0/486566775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518181440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 >> 172.21.15.6:0/486566775 conn(0x55a5180d5c80 msgr2=0x55a518171ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 shutdown_connections 2023-09-13T09:52:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 1 -- 172.21.15.6:0/486566775 wait complete. 2023-09-13T09:52:17.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.795+0000 7f152c94cb80 20 client.28247 trim_cache size 0 max 16384 2023-09-13T09:52:17.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 Processor -- start 2023-09-13T09:52:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 -- start start 2023-09-13T09:52:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518188410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a518173fd0 con 0x55a518179060 2023-09-13T09:52:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a518172810 con 0x55a518177a00 2023-09-13T09:52:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f152c94cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a51818a170 con 0x55a518178700 2023-09-13T09:52:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151e503700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151dd02700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518188410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41934/0 (socket says 172.21.15.6:41934) 2023-09-13T09:52:17.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151e503700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181774c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35454/0 (socket says 172.21.15.6:35454) 2023-09-13T09:52:17.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 -- 172.21.15.6:0/605724810 learned_addr learned my addr 172.21.15.6:0/605724810 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 -- 172.21.15.6:0/605724810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 msgr2=0x55a518188410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518188410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 -- 172.21.15.6:0/605724810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 msgr2=0x55a5181774c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181774c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151ed04700 1 -- 172.21.15.6:0/605724810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a517ef5de0 con 0x55a518179060 2023-09-13T09:52:17.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.809+0000 7f151e503700 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181774c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.810+0000 7f151ed04700 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188d70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1510000f80 tx=0x7f15100095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef08f8912fcdd43d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.810+0000 7f150d7fa700 1 -- 172.21.15.6:0/605724810 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151000e070 con 0x55a518179060 2023-09-13T09:52:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.810+0000 7f150d7fa700 1 -- 172.21.15.6:0/605724810 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1510004d30 con 0x55a518179060 2023-09-13T09:52:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.810+0000 7f150d7fa700 1 -- 172.21.15.6:0/605724810 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15100041c0 con 0x55a518179060 2023-09-13T09:52:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- 172.21.15.6:0/605724810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 msgr2=0x55a518188d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188d70 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1510000f80 tx=0x7f15100095e0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- 172.21.15.6:0/605724810 shutdown_connections 2023-09-13T09:52:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518179060 0x55a518188d70 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181774c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 --2- 172.21.15.6:0/605724810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518178700 0x55a518188410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- 172.21.15.6:0/605724810 >> 172.21.15.6:0/605724810 conn(0x55a5180d5c80 msgr2=0x55a51817fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- 172.21.15.6:0/605724810 shutdown_connections 2023-09-13T09:52:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- 172.21.15.6:0/605724810 wait complete. 2023-09-13T09:52:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- start start 2023-09-13T09:52:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 Processor -- start 2023-09-13T09:52:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181842a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518178700 0x55a5181847e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a518187800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a518187d40 con 0x55a518178700 2023-09-13T09:52:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a518187eb0 con 0x55a518177a00 2023-09-13T09:52:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a518188070 con 0x55a518179060 2023-09-13T09:52:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f152c94cb80 10 client.0 _ll_register_callbacks cb 0x55a518065680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:17.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f151dd02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518178700 0x55a5181847e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f151e503700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181842a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f151dd02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518178700 0x55a5181847e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41938/0 (socket says 172.21.15.6:41938) 2023-09-13T09:52:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f151e503700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181842a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35460/0 (socket says 172.21.15.6:35460) 2023-09-13T09:52:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f151dd02700 1 -- 172.21.15.6:0/3672980098 learned_addr learned my addr 172.21.15.6:0/3672980098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.811+0000 7f151ed04700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a518187800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151dd02700 1 -- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 msgr2=0x55a518187800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151dd02700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a518187800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151dd02700 1 -- 172.21.15.6:0/3672980098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 msgr2=0x55a5181842a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151dd02700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181842a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151dd02700 1 -- 172.21.15.6:0/3672980098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5180e17a0 con 0x55a518178700 2023-09-13T09:52:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151e503700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151ed04700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a518187800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f151dd02700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518178700 0x55a5181847e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f15080ca580 tx=0x7f1508005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3272294e00239197 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f1501ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:17.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f1501ffb700 1 -- 172.21.15.6:0/3672980098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15080ca750 con 0x55a518178700 2023-09-13T09:52:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f1501ffb700 1 -- 172.21.15.6:0/3672980098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15080b8240 con 0x55a518178700 2023-09-13T09:52:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f151000f040 con 0x55a518178700 2023-09-13T09:52:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f1501ffb700 1 -- 172.21.15.6:0/3672980098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1508004c30 con 0x55a518178700 2023-09-13T09:52:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f152c94cb80 10 client.18864 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:17.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a517f49630 con 0x55a518178700 2023-09-13T09:52:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.812+0000 7f1501ffb700 1 -- 172.21.15.6:0/3672980098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f151000f040 con 0x55a518178700 2023-09-13T09:52:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f1501ffb700 1 -- 172.21.15.6:0/3672980098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f15080997f0 con 0x55a518178700 2023-09-13T09:52:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f152c94cb80 10 client.18864 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f152c94cb80 10 client.18864 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:52:17.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f152c94cb80 20 client.18864 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f152c94cb80 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a5181e1820 0x55a5181e3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f152c94cb80 4 client.18864 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a518083050 con 0x55a5181e1820 2023-09-13T09:52:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f151e503700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a5181e1820 0x55a5181e3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f1501ffb700 10 client.18864 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f151e503700 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a5181e1820 0x55a5181e3c40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b08aa88a7c5659d0 server_cookie=b1fb1c62f21fa15f in_seq=0 out_seq=0 2023-09-13T09:52:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f1501ffb700 1 -- 172.21.15.6:0/3672980098 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a518083050 con 0x55a5181e1820 2023-09-13T09:52:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f1501ffb700 10 client.18864 handle_command_reply: tid=0 2023-09-13T09:52:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.813+0000 7f152c94cb80 1 client.18864 shutdown 2023-09-13T09:52:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518178700 msgr2=0x55a5181847e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518178700 0x55a5181847e0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f15080ca580 tx=0x7f1508005c00 comp rx=0 tx=0).stop 2023-09-13T09:52:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 shutdown_connections 2023-09-13T09:52:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55a5181e1820 0x55a5181e3c40 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a518179060 0x55a518187800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1501ffb700 0 client.18864 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a518177a00 0x55a5181842a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 --2- 172.21.15.6:0/3672980098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a518178700 0x55a5181847e0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 >> 172.21.15.6:0/3672980098 conn(0x55a5180d5c80 msgr2=0x55a51817b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 shutdown_connections 2023-09-13T09:52:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 1 -- 172.21.15.6:0/3672980098 wait complete. 2023-09-13T09:52:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f152c94cb80 20 client.18864 trim_cache size 0 max 16384 2023-09-13T09:52:17.839 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:17.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15040a0640 msgr2=0x7f15040a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15040a0640 0x7f15040a2b00 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1518100d10 tx=0x7f1514009260 comp rx=0 tx=0).stop 2023-09-13T09:52:17.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 msgr2=0x7f1518196fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518196fc0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f150800c010 tx=0x7f150800f690 comp rx=0 tx=0).stop 2023-09-13T09:52:17.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 shutdown_connections 2023-09-13T09:52:17.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1518101850 0x7f151819e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15180ffcc0 0x7f1518196a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15040a0640 0x7f15040a2b00 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 --2- 172.21.15.6:0/1900125196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1518100eb0 0x7f1518196fc0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 >> 172.21.15.6:0/1900125196 conn(0x7f15180fb250 msgr2=0x7f1518104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 shutdown_connections 2023-09-13T09:52:17.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.814+0000 7f1520767700 1 -- 172.21.15.6:0/1900125196 wait complete. 2023-09-13T09:52:17.843 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:52:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 -- 172.21.15.6:0/1573808026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa54100e90 msgr2=0x7faa541012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 --2- 172.21.15.6:0/1573808026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa54100e90 0x7faa541012f0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7faa480099c0 tx=0x7faa48009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 -- 172.21.15.6:0/1573808026 shutdown_connections 2023-09-13T09:52:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 --2- 172.21.15.6:0/1573808026 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54101830 0x7faa541080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 --2- 172.21.15.6:0/1573808026 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa540ffca0 0x7faa541000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 --2- 172.21.15.6:0/1573808026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa54100e90 0x7faa541012f0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 -- 172.21.15.6:0/1573808026 >> 172.21.15.6:0/1573808026 conn(0x7faa540fb230 msgr2=0x7faa540fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 -- 172.21.15.6:0/1573808026 shutdown_connections 2023-09-13T09:52:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 -- 172.21.15.6:0/1573808026 wait complete. 2023-09-13T09:52:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.975+0000 7faa59a8c700 1 Processor -- start 2023-09-13T09:52:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa59a8c700 1 -- start start 2023-09-13T09:52:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa59a8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa540ffca0 0x7faa54103c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa59a8c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100e90 0x7faa54102270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa59a8c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa54101830 0x7faa541027b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa59a8c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa54102f50 con 0x7faa540ffca0 2023-09-13T09:52:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa59a8c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541030c0 con 0x7faa54100e90 2023-09-13T09:52:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa59a8c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa541a0b00 con 0x7faa54101830 2023-09-13T09:52:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa540ffca0 0x7faa54103c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa540ffca0 0x7faa54103c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41950/0 (socket says 172.21.15.6:41950) 2023-09-13T09:52:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 -- 172.21.15.6:0/2774641790 learned_addr learned my addr 172.21.15.6:0/2774641790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa52ffd700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100e90 0x7faa54102270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa53fff700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa54101830 0x7faa541027b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 -- 172.21.15.6:0/2774641790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa54101830 msgr2=0x7faa541027b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa54101830 0x7faa541027b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 -- 172.21.15.6:0/2774641790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100e90 msgr2=0x7faa54102270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100e90 0x7faa54102270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 -- 172.21.15.6:0/2774641790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480095f0 con 0x7faa540ffca0 2023-09-13T09:52:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa537fe700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa540ffca0 0x7faa54103c30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7faa4400efc0 tx=0x7faa4400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.976+0000 7faa50ff9700 1 -- 172.21.15.6:0/2774641790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44018070 con 0x7faa540ffca0 2023-09-13T09:52:17.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.977+0000 7faa50ff9700 1 -- 172.21.15.6:0/2774641790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa4400f040 con 0x7faa540ffca0 2023-09-13T09:52:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.977+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa541a0d80 con 0x7faa540ffca0 2023-09-13T09:52:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.977+0000 7faa50ff9700 1 -- 172.21.15.6:0/2774641790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44004280 con 0x7faa540ffca0 2023-09-13T09:52:17.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.977+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa541a1220 con 0x7faa540ffca0 2023-09-13T09:52:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.979+0000 7faa50ff9700 1 -- 172.21.15.6:0/2774641790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7faa44003a00 con 0x7faa540ffca0 2023-09-13T09:52:17.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.979+0000 7faa50ff9700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa3c0a06c0 0x7faa3c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa50ff9700 1 -- 172.21.15.6:0/2774641790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa440cba10 con 0x7faa540ffca0 2023-09-13T09:52:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa52ffd700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa3c0a06c0 0x7faa3c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa52ffd700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa3c0a06c0 0x7faa3c0a2b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faa4800b580 tx=0x7faa48005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 Processor -- start 2023-09-13T09:52:17.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 -- start start 2023-09-13T09:52:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac064b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac063a00 0x562eac063e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eabfbc780 con 0x562eac064700 2023-09-13T09:52:17.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eabfba0a0 con 0x562eac063a00 2023-09-13T09:52:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa65c71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eabfb5990 con 0x562eac065060 2023-09-13T09:52:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.980+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac064b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac064b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41958/0 (socket says 172.21.15.6:41958) 2023-09-13T09:52:17.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 -- 172.21.15.6:0/3806932797 learned_addr learned my addr 172.21.15.6:0/3806932797 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa53fff700 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac063a00 0x562eac063e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa52ffd700 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 -- 172.21.15.6:0/3806932797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 msgr2=0x562eac0634c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac0634c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 -- 172.21.15.6:0/3806932797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac063a00 msgr2=0x562eac063e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac063a00 0x562eac063e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 -- 172.21.15.6:0/3806932797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eabe35630 con 0x562eac064700 2023-09-13T09:52:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa53fff700 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac063a00 0x562eac063e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:17.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa537fe700 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac064b20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7faa44095cb0 tx=0x7faa44094f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd2926e15cf4bd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa39ffb700 1 -- 172.21.15.6:0/3806932797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44098ba0 con 0x562eac064700 2023-09-13T09:52:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa39ffb700 1 -- 172.21.15.6:0/3806932797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa44099940 con 0x562eac064700 2023-09-13T09:52:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.981+0000 7faa39ffb700 1 -- 172.21.15.6:0/3806932797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa440976c0 con 0x562eac064700 2023-09-13T09:52:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 -- 172.21.15.6:0/3806932797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 msgr2=0x562eac064b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:17.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac064b20 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7faa44095cb0 tx=0x7faa44094f50 comp rx=0 tx=0).stop 2023-09-13T09:52:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 -- 172.21.15.6:0/3806932797 shutdown_connections 2023-09-13T09:52:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac063a00 0x562eac063e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac064b20 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 --2- 172.21.15.6:0/3806932797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac0634c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:17.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 -- 172.21.15.6:0/3806932797 >> 172.21.15.6:0/3806932797 conn(0x562eabfc1c80 msgr2=0x562eac05df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:17.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 -- 172.21.15.6:0/3806932797 shutdown_connections 2023-09-13T09:52:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 -- 172.21.15.6:0/3806932797 wait complete. 2023-09-13T09:52:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.982+0000 7faa65c71b80 1 -- start start 2023-09-13T09:52:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 1 Processor -- start 2023-09-13T09:52:18.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac063a00 0x562eac06cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac074500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eabf53bb0 con 0x562eac063a00 2023-09-13T09:52:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eabf538b0 con 0x562eac064700 2023-09-13T09:52:18.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eabe37920 con 0x562eac065060 2023-09-13T09:52:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa65c71b80 10 client.0 _ll_register_callbacks cb 0x562eabf51680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac063a00 0x562eac06cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa52ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac063a00 0x562eac06cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41964/0 (socket says 172.21.15.6:41964) 2023-09-13T09:52:18.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa537fe700 1 -- 172.21.15.6:0/827228009 learned_addr learned my addr 172.21.15.6:0/827228009 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa53fff700 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac074500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa52ffd700 1 -- 172.21.15.6:0/827228009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 msgr2=0x562eac074500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa52ffd700 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac074500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa52ffd700 1 -- 172.21.15.6:0/827228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac063a00 msgr2=0x562eac06cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa52ffd700 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac063a00 0x562eac06cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa52ffd700 1 -- 172.21.15.6:0/827228009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa541a1220 con 0x562eac064700 2023-09-13T09:52:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa537fe700 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac063a00 0x562eac06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa52ffd700 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06d4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa480098e0 tx=0x7faa48009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84864fa289957ff4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:18.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.983+0000 7faa32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:52:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa32ffd700 1 -- 172.21.15.6:0/827228009 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa48029050 con 0x562eac064700 2023-09-13T09:52:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562eac056670 con 0x562eac064700 2023-09-13T09:52:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa32ffd700 1 -- 172.21.15.6:0/827228009 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa4800f660 con 0x562eac064700 2023-09-13T09:52:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa32ffd700 1 -- 172.21.15.6:0/827228009 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa48003e90 con 0x562eac064700 2023-09-13T09:52:18.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 10 client.28265 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562eabfcd7a0 con 0x562eac064700 2023-09-13T09:52:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa32ffd700 1 -- 172.21.15.6:0/827228009 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa4803d020 con 0x562eac064700 2023-09-13T09:52:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa32ffd700 1 -- 172.21.15.6:0/827228009 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faa48022830 con 0x562eac064700 2023-09-13T09:52:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 10 client.28265 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 10 client.28265 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:18.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 20 client.28265 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac078d50 0x562eac07b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 4 client.28265 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.984+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562eabfae970 con 0x562eac078d50 2023-09-13T09:52:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.985+0000 7faa537fe700 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac078d50 0x562eac07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.985+0000 7faa537fe700 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac078d50 0x562eac07b170 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73c8b7ab2e3afd3 server_cookie=a108cfed0ef513e1 in_seq=0 out_seq=0 2023-09-13T09:52:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.985+0000 7faa32ffd700 10 client.28265 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa32ffd700 1 -- 172.21.15.6:0/827228009 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562eabfae970 con 0x562eac078d50 2023-09-13T09:52:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa32ffd700 10 client.28265 handle_command_reply: tid=0 2023-09-13T09:52:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 client.28265 shutdown 2023-09-13T09:52:18.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 msgr2=0x562eac06d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06d4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7faa480098e0 tx=0x7faa48009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 shutdown_connections 2023-09-13T09:52:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac065060 0x562eac074500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac078d50 0x562eac07b170 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac063a00 0x562eac06cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa32ffd700 0 client.28265 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 --2- 172.21.15.6:0/827228009 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06d4c0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 >> 172.21.15.6:0/827228009 conn(0x562eabfc1c80 msgr2=0x562eac0587f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 shutdown_connections 2023-09-13T09:52:18.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 1 -- 172.21.15.6:0/827228009 wait complete. 2023-09-13T09:52:18.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.986+0000 7faa65c71b80 20 client.28265 trim_cache size 0 max 16384 2023-09-13T09:52:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 Processor -- start 2023-09-13T09:52:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 -- start start 2023-09-13T09:52:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eabfc1c80 0x562eac0634c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac0744c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eac0788a0 con 0x562eabfc1c80 2023-09-13T09:52:18.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eac05a8e0 con 0x562eac064700 2023-09-13T09:52:18.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa65c71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eac06c230 con 0x562eac063a00 2023-09-13T09:52:18.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eabfc1c80 0x562eac0634c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eabfc1c80 0x562eac0634c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41972/0 (socket says 172.21.15.6:41972) 2023-09-13T09:52:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa537fe700 1 -- 172.21.15.6:0/4251939448 learned_addr learned my addr 172.21.15.6:0/4251939448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa53fff700 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:17.999+0000 7faa52ffd700 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac0744c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa537fe700 1 -- 172.21.15.6:0/4251939448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 msgr2=0x562eac0744c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:18.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa537fe700 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac0744c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa537fe700 1 -- 172.21.15.6:0/4251939448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 msgr2=0x562eac06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:18.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa537fe700 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa537fe700 1 -- 172.21.15.6:0/4251939448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562eabde1de0 con 0x562eabfc1c80 2023-09-13T09:52:18.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa537fe700 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eabfc1c80 0x562eac0634c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c6f0 tx=0x7faa440092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6920bf9c25bd0da server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa3a7fc700 1 -- 172.21.15.6:0/4251939448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44099240 con 0x562eabfc1c80 2023-09-13T09:52:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa3a7fc700 1 -- 172.21.15.6:0/4251939448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa4409d070 con 0x562eabfc1c80 2023-09-13T09:52:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.000+0000 7faa3a7fc700 1 -- 172.21.15.6:0/4251939448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa44099700 con 0x562eabfc1c80 2023-09-13T09:52:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- 172.21.15.6:0/4251939448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eabfc1c80 msgr2=0x562eac0634c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:18.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eabfc1c80 0x562eac0634c0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7faa4400c6f0 tx=0x7faa440092e0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- 172.21.15.6:0/4251939448 shutdown_connections 2023-09-13T09:52:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eac064700 0x562eac06cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eabfc1c80 0x562eac0634c0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 --2- 172.21.15.6:0/4251939448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac0744c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- 172.21.15.6:0/4251939448 >> 172.21.15.6:0/4251939448 conn(0x562eac05e240 msgr2=0x562eac0679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:18.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- 172.21.15.6:0/4251939448 shutdown_connections 2023-09-13T09:52:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- 172.21.15.6:0/4251939448 wait complete. 2023-09-13T09:52:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- start start 2023-09-13T09:52:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 Processor -- start 2023-09-13T09:52:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eabfc1c80 0x562eac0705f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac070b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac073b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eac074090 con 0x562eac064700 2023-09-13T09:52:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eac074200 con 0x562eabfc1c80 2023-09-13T09:52:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562eac0743c0 con 0x562eac063a00 2023-09-13T09:52:18.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.001+0000 7faa65c71b80 10 client.0 _ll_register_callbacks cb 0x562eabf51680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac073b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa537fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eabfc1c80 0x562eac0705f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac073b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41982/0 (socket says 172.21.15.6:41982) 2023-09-13T09:52:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 -- 172.21.15.6:0/2632239207 learned_addr learned my addr 172.21.15.6:0/2632239207 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:18.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa52ffd700 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac070b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 -- 172.21.15.6:0/2632239207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 msgr2=0x562eac070b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac070b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 -- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eabfc1c80 msgr2=0x562eac0705f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:18.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eabfc1c80 0x562eac0705f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 -- 172.21.15.6:0/2632239207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562eabe35630 con 0x562eac064700 2023-09-13T09:52:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa537fe700 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eabfc1c80 0x562eac0705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa53fff700 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac073b50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0129a0 tx=0x7faa4c012cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=450dddba0e799332 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa32ffd700 1 -- 172.21.15.6:0/2632239207 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa4c022070 con 0x562eac064700 2023-09-13T09:52:18.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa32ffd700 1 -- 172.21.15.6:0/2632239207 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa4c004830 con 0x562eac064700 2023-09-13T09:52:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa44099940 con 0x562eac064700 2023-09-13T09:52:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa32ffd700 1 -- 172.21.15.6:0/2632239207 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa4c017040 con 0x562eac064700 2023-09-13T09:52:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa65c71b80 10 client.18882 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.002+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x562eabdcac60 con 0x562eac064700 2023-09-13T09:52:18.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa32ffd700 1 -- 172.21.15.6:0/2632239207 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa4c02c020 con 0x562eac064700 2023-09-13T09:52:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa32ffd700 1 -- 172.21.15.6:0/2632239207 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7faa4c025030 con 0x562eac064700 2023-09-13T09:52:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa65c71b80 10 client.18882 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa65c71b80 10 client.18882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa65c71b80 20 client.18882 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:18.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa65c71b80 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac065060 0x562eac0cffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa65c71b80 4 client.18882 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562eabf6f050 con 0x562eac065060 2023-09-13T09:52:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa537fe700 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac065060 0x562eac0cffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa32ffd700 10 client.18882 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:18.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa537fe700 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac065060 0x562eac0cffe0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b45f56daed1a005 server_cookie=6b22df49d058dde2 in_seq=0 out_seq=0 2023-09-13T09:52:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.003+0000 7faa32ffd700 1 -- 172.21.15.6:0/2632239207 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562eabf6f050 con 0x562eac065060 2023-09-13T09:52:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa32ffd700 10 client.18882 handle_command_reply: tid=0 2023-09-13T09:52:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 client.18882 shutdown 2023-09-13T09:52:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 msgr2=0x562eac073b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac073b50 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7faa4c0129a0 tx=0x7faa4c012cb0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 shutdown_connections 2023-09-13T09:52:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562eac065060 0x562eac0cffe0 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562eac064700 0x562eac073b50 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa32ffd700 0 client.18882 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562eabfc1c80 0x562eac0705f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 --2- 172.21.15.6:0/2632239207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562eac063a00 0x562eac070b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 >> 172.21.15.6:0/2632239207 conn(0x562eac05e240 msgr2=0x562eac06cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 shutdown_connections 2023-09-13T09:52:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 1 -- 172.21.15.6:0/2632239207 wait complete. 2023-09-13T09:52:18.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa65c71b80 20 client.18882 trim_cache size 0 max 16384 2023-09-13T09:52:18.034 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa3c0a06c0 msgr2=0x7faa3c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa3c0a06c0 0x7faa3c0a2b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7faa4800b580 tx=0x7faa48005fb0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa540ffca0 msgr2=0x7faa54103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa540ffca0 0x7faa54103c30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7faa4400efc0 tx=0x7faa4400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 shutdown_connections 2023-09-13T09:52:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa54101830 0x7faa541027b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa3c0a06c0 0x7faa3c0a2b80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa540ffca0 0x7faa54103c30 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 --2- 172.21.15.6:0/2774641790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa54100e90 0x7faa54102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:18.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.004+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 >> 172.21.15.6:0/2774641790 conn(0x7faa540fb230 msgr2=0x7faa54069220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:18.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.005+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 shutdown_connections 2023-09-13T09:52:18.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:18.005+0000 7faa59a8c700 1 -- 172.21.15.6:0/2774641790 wait complete. 2023-09-13T09:52:18.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 819955 6.81 MB/sec execute 578 sec latency 26.699 ms 2023-09-13T09:52:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:18 smithi006 ceph-mon[98665]: pgmap v683: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 2.5 MiB/s wr, 244 op/s 2023-09-13T09:52:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:18 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1544110282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:52:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:18 smithi131 ceph-mon[102785]: pgmap v683: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 2.5 MiB/s wr, 244 op/s 2023-09-13T09:52:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:18 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1544110282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:52:18.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:18 smithi053 ceph-mon[102373]: pgmap v683: 97 pgs: 97 active+clean; 314 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 628 KiB/s rd, 2.5 MiB/s wr, 244 op/s 2023-09-13T09:52:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:18 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1544110282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:52:19.038 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:52:19.039 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:52:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.172+0000 7f339646d700 1 -- 172.21.15.6:0/90229584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 msgr2=0x7f3390108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.172+0000 7f339646d700 1 --2- 172.21.15.6:0/90229584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 0x7f3390108100 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f338800b0d0 tx=0x7f338800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.172+0000 7f339646d700 1 -- 172.21.15.6:0/90229584 shutdown_connections 2023-09-13T09:52:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.172+0000 7f339646d700 1 --2- 172.21.15.6:0/90229584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 0x7f3390108100 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.172+0000 7f339646d700 1 --2- 172.21.15.6:0/90229584 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f33900ffcc0 0x7f33901000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.172+0000 7f339646d700 1 --2- 172.21.15.6:0/90229584 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3390100eb0 0x7f3390101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.173+0000 7f339646d700 1 -- 172.21.15.6:0/90229584 >> 172.21.15.6:0/90229584 conn(0x7f33900fb250 msgr2=0x7f33900fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.173+0000 7f339646d700 1 -- 172.21.15.6:0/90229584 shutdown_connections 2023-09-13T09:52:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.173+0000 7f339646d700 1 -- 172.21.15.6:0/90229584 wait complete. 2023-09-13T09:52:19.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.173+0000 7f339646d700 1 Processor -- start 2023-09-13T09:52:19.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.173+0000 7f339646d700 1 -- start start 2023-09-13T09:52:19.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f339646d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33900ffcc0 0x7f33901959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f339646d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3390100eb0 0x7f3390195f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f339646d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 0x7f339019cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f339646d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339019d560 con 0x7f3390101850 2023-09-13T09:52:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f339646d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339019d6a0 con 0x7f33900ffcc0 2023-09-13T09:52:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f339646d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339019d830 con 0x7f3390100eb0 2023-09-13T09:52:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33900ffcc0 0x7f33901959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f3394a0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 0x7f339019cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33900ffcc0 0x7f33901959e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35516/0 (socket says 172.21.15.6:35516) 2023-09-13T09:52:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 -- 172.21.15.6:0/764959205 learned_addr learned my addr 172.21.15.6:0/764959205 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338f7fe700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3390100eb0 0x7f3390195f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 -- 172.21.15.6:0/764959205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3390100eb0 msgr2=0x7f3390195f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3390100eb0 0x7f3390195f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 -- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 msgr2=0x7f339019cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 0x7f339019cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 -- 172.21.15.6:0/764959205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3388009d00 con 0x7f33900ffcc0 2023-09-13T09:52:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f3394a0a700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 0x7f339019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.174+0000 7f338ffff700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33900ffcc0 0x7f33901959e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f338000e970 tx=0x7f338000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.175+0000 7f338d7fa700 1 -- 172.21.15.6:0/764959205 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380009790 con 0x7f33900ffcc0 2023-09-13T09:52:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.175+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3390068010 con 0x7f33900ffcc0 2023-09-13T09:52:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.175+0000 7f338d7fa700 1 -- 172.21.15.6:0/764959205 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f338000c7e0 con 0x7f33900ffcc0 2023-09-13T09:52:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.175+0000 7f338d7fa700 1 -- 172.21.15.6:0/764959205 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3380003c70 con 0x7f33900ffcc0 2023-09-13T09:52:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.175+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3390068570 con 0x7f33900ffcc0 2023-09-13T09:52:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.177+0000 7f338d7fa700 1 -- 172.21.15.6:0/764959205 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f338000cc50 con 0x7f33900ffcc0 2023-09-13T09:52:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.177+0000 7f338d7fa700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33780a0640 0x7f33780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f338f7fe700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33780a0640 0x7f33780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f338d7fa700 1 -- 172.21.15.6:0/764959205 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3380014070 con 0x7f33900ffcc0 2023-09-13T09:52:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f33a2652b80 1 Processor -- start 2023-09-13T09:52:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f338f7fe700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33780a0640 0x7f33780a2b00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3384009c60 tx=0x7f3384010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f33a2652b80 1 -- start start 2023-09-13T09:52:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9ca7cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7d0e0 0x55da9ca7b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca7bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f33a2652b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9c9d4800 con 0x55da9ca7d0e0 2023-09-13T09:52:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.178+0000 7f33a2652b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9c9d2120 con 0x55da9ca7c780 2023-09-13T09:52:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f33a2652b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9c9cda10 con 0x55da9ca7ba80 2023-09-13T09:52:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7d0e0 0x55da9ca7b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9ca7cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7d0e0 0x55da9ca7b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42002/0 (socket says 172.21.15.6:42002) 2023-09-13T09:52:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 -- 172.21.15.6:0/2263846138 learned_addr learned my addr 172.21.15.6:0/2263846138 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f3394a0a700 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca7bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 -- 172.21.15.6:0/2263846138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 msgr2=0x55da9ca7bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca7bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 -- 172.21.15.6:0/2263846138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 msgr2=0x55da9ca7cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9ca7cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 -- 172.21.15.6:0/2263846138 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da9c84d6b0 con 0x55da9ca7d0e0 2023-09-13T09:52:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338ffff700 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9ca7cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f338f7fe700 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7d0e0 0x55da9ca7b540 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f338401a580 tx=0x7f3384016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a699f9aaf3476483 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f33767fc700 1 -- 172.21.15.6:0/2263846138 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384024420 con 0x55da9ca7d0e0 2023-09-13T09:52:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f33767fc700 1 -- 172.21.15.6:0/2263846138 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3384014040 con 0x55da9ca7d0e0 2023-09-13T09:52:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.179+0000 7f33767fc700 1 -- 172.21.15.6:0/2263846138 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33840188d0 con 0x55da9ca7d0e0 2023-09-13T09:52:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 -- 172.21.15.6:0/2263846138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7d0e0 msgr2=0x55da9ca7b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7d0e0 0x55da9ca7b540 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f338401a580 tx=0x7f3384016000 comp rx=0 tx=0).stop 2023-09-13T09:52:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 -- 172.21.15.6:0/2263846138 shutdown_connections 2023-09-13T09:52:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca7bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9ca7cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2263846138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7d0e0 0x55da9ca7b540 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 -- 172.21.15.6:0/2263846138 >> 172.21.15.6:0/2263846138 conn(0x55da9c9d9d00 msgr2=0x55da9ca75f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 -- 172.21.15.6:0/2263846138 shutdown_connections 2023-09-13T09:52:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 -- 172.21.15.6:0/2263846138 wait complete. 2023-09-13T09:52:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.180+0000 7f33a2652b80 1 -- start start 2023-09-13T09:52:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 1 Processor -- start 2023-09-13T09:52:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca84f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca85490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7d0e0 0x55da9ca8c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9c96bc30 con 0x55da9ca7c780 2023-09-13T09:52:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9c96b930 con 0x55da9ca7d0e0 2023-09-13T09:52:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9c84f9a0 con 0x55da9ca7ba80 2023-09-13T09:52:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f33a2652b80 10 client.0 _ll_register_callbacks cb 0x55da9c969700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca85490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca85490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42008/0 (socket says 172.21.15.6:42008) 2023-09-13T09:52:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 -- 172.21.15.6:0/363766167 learned_addr learned my addr 172.21.15.6:0/363766167 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f3394a0a700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7d0e0 0x55da9ca8c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338ffff700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca84f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 -- 172.21.15.6:0/363766167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 msgr2=0x55da9ca84f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca84f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 -- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7d0e0 msgr2=0x55da9ca8c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7d0e0 0x55da9ca8c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f338f7fe700 1 -- 172.21.15.6:0/363766167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3384009e40 con 0x55da9ca7c780 2023-09-13T09:52:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.181+0000 7f3394a0a700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7d0e0 0x55da9ca8c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f338f7fe700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca85490 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3384009fd0 tx=0x7f338401bd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0b76a063072a96 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f336f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f336f7fe700 1 -- 172.21.15.6:0/363766167 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3384005450 con 0x55da9ca7c780 2023-09-13T09:52:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f336f7fe700 1 -- 172.21.15.6:0/363766167 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f33840055b0 con 0x55da9ca7c780 2023-09-13T09:52:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da9ca6e6f0 con 0x55da9ca7c780 2023-09-13T09:52:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f336f7fe700 1 -- 172.21.15.6:0/363766167 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3384003680 con 0x55da9ca7c780 2023-09-13T09:52:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 10 client.18894 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55da9c9e5820 con 0x55da9ca7c780 2023-09-13T09:52:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f336f7fe700 1 -- 172.21.15.6:0/363766167 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55da9ca6e6f0 con 0x55da9ca7c780 2023-09-13T09:52:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f336f7fe700 1 -- 172.21.15.6:0/363766167 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3384024860 con 0x55da9ca7c780 2023-09-13T09:52:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 10 client.18894 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 10 client.18894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 20 client.18894 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:19.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca90cc0 0x55da9ca930e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 4 client.18894 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.182+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da9c9c69f0 con 0x55da9ca90cc0 2023-09-13T09:52:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.183+0000 7f338ffff700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca90cc0 0x55da9ca930e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.183+0000 7f336f7fe700 10 client.18894 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.183+0000 7f338ffff700 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca90cc0 0x55da9ca930e0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324d54379c737570 server_cookie=3bf4dc292171a14c in_seq=0 out_seq=0 2023-09-13T09:52:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f336f7fe700 1 -- 172.21.15.6:0/363766167 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55da9c9c69f0 con 0x55da9ca90cc0 2023-09-13T09:52:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f336f7fe700 10 client.18894 handle_command_reply: tid=0 2023-09-13T09:52:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 client.18894 shutdown 2023-09-13T09:52:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 msgr2=0x55da9ca85490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca85490 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f3384009fd0 tx=0x7f338401bd50 comp rx=0 tx=0).stop 2023-09-13T09:52:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 shutdown_connections 2023-09-13T09:52:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7d0e0 0x55da9ca8c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca84f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca90cc0 0x55da9ca930e0 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 --2- 172.21.15.6:0/363766167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca85490 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f336f7fe700 0 client.18894 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 >> 172.21.15.6:0/363766167 conn(0x55da9c9d9d00 msgr2=0x55da9ca70870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 shutdown_connections 2023-09-13T09:52:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 1 -- 172.21.15.6:0/363766167 wait complete. 2023-09-13T09:52:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.184+0000 7f33a2652b80 20 client.18894 trim_cache size 0 max 16384 2023-09-13T09:52:19.207 INFO:tasks.workunit.client.0.smithi006.stdout: 1 820868 6.81 MB/sec execute 579 sec latency 16.852 ms 2023-09-13T09:52:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 Processor -- start 2023-09-13T09:52:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 -- start start 2023-09-13T09:52:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9c9d9d00 0x55da9ca7b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca8c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca6f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9ca84b20 con 0x55da9ca7c780 2023-09-13T09:52:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9ca86140 con 0x55da9c9d9d00 2023-09-13T09:52:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f33a2652b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9ca6e4d0 con 0x55da9ca7ba80 2023-09-13T09:52:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca6f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca6f960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42018/0 (socket says 172.21.15.6:42018) 2023-09-13T09:52:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f338ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9c9d9d00 0x55da9ca7b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 -- 172.21.15.6:0/2285098582 learned_addr learned my addr 172.21.15.6:0/2285098582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f338f7fe700 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca8c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 -- 172.21.15.6:0/2285098582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 msgr2=0x55da9ca8c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca8c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 -- 172.21.15.6:0/2285098582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9c9d9d00 msgr2=0x55da9ca7b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9c9d9d00 0x55da9ca7b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.202+0000 7f3394a0a700 1 -- 172.21.15.6:0/2285098582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da9c7f9e60 con 0x55da9ca7c780 2023-09-13T09:52:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f3394a0a700 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca6f960 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f338800b0d0 tx=0x7f338800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c524b21843c11da5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f3376ffd700 1 -- 172.21.15.6:0/2285098582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3388021070 con 0x55da9ca7c780 2023-09-13T09:52:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f3376ffd700 1 -- 172.21.15.6:0/2285098582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3388008d70 con 0x55da9ca7c780 2023-09-13T09:52:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f3376ffd700 1 -- 172.21.15.6:0/2285098582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338800e040 con 0x55da9ca7c780 2023-09-13T09:52:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f33a2652b80 1 -- 172.21.15.6:0/2285098582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 msgr2=0x55da9ca6f960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca6f960 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f338800b0d0 tx=0x7f338800b040 comp rx=0 tx=0).stop 2023-09-13T09:52:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f33a2652b80 1 -- 172.21.15.6:0/2285098582 shutdown_connections 2023-09-13T09:52:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9ca7c780 0x55da9ca6f960 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9c9d9d00 0x55da9ca7b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f33a2652b80 1 --2- 172.21.15.6:0/2285098582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca8c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.203+0000 7f33a2652b80 1 -- 172.21.15.6:0/2285098582 >> 172.21.15.6:0/2285098582 conn(0x55da9ca841b0 msgr2=0x55da9ca84f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 -- 172.21.15.6:0/2285098582 shutdown_connections 2023-09-13T09:52:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 -- 172.21.15.6:0/2285098582 wait complete. 2023-09-13T09:52:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 -- start start 2023-09-13T09:52:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 Processor -- start 2023-09-13T09:52:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9c9d9d00 0x55da9ca89320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca89860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9cae4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9ca89f40 con 0x55da9c9d9d00 2023-09-13T09:52:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9cae4fe0 con 0x55da9ca7c780 2023-09-13T09:52:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da9cae5170 con 0x55da9ca7ba80 2023-09-13T09:52:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f33a2652b80 10 client.0 _ll_register_callbacks cb 0x55da9c969700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f338ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9c9d9d00 0x55da9ca89320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f338ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9c9d9d00 0x55da9ca89320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42020/0 (socket says 172.21.15.6:42020) 2023-09-13T09:52:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f338ffff700 1 -- 172.21.15.6:0/3695924694 learned_addr learned my addr 172.21.15.6:0/3695924694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.204+0000 7f3394a0a700 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9cae4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f338ffff700 1 -- 172.21.15.6:0/3695924694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 msgr2=0x55da9ca89860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f338ffff700 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca89860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f338ffff700 1 -- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 msgr2=0x55da9cae4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f338ffff700 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9cae4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f338ffff700 1 -- 172.21.15.6:0/3695924694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3390108a50 con 0x55da9c9d9d00 2023-09-13T09:52:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f3394a0a700 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9cae4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f338ffff700 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9c9d9d00 0x55da9ca89320 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3380005950 tx=0x7f3380099440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b80703d4c915f25 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f336f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f336f7fe700 1 -- 172.21.15.6:0/3695924694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f338009d130 con 0x55da9c9d9d00 2023-09-13T09:52:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f336f7fe700 1 -- 172.21.15.6:0/3695924694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3380095c60 con 0x55da9c9d9d00 2023-09-13T09:52:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3384014040 con 0x55da9c9d9d00 2023-09-13T09:52:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f336f7fe700 1 -- 172.21.15.6:0/3695924694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3380095e20 con 0x55da9c9d9d00 2023-09-13T09:52:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f33a2652b80 10 client.18900 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55da9c7e2ce0 con 0x55da9c9d9d00 2023-09-13T09:52:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.205+0000 7f336f7fe700 1 -- 172.21.15.6:0/3695924694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3384014040 con 0x55da9c9d9d00 2023-09-13T09:52:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f336f7fe700 1 -- 172.21.15.6:0/3695924694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f33800998d0 con 0x55da9c9d9d00 2023-09-13T09:52:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f33a2652b80 10 client.18900 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f33a2652b80 10 client.18900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f33a2652b80 20 client.18900 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f33a2652b80 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca7d0e0 0x55da9cae8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f33a2652b80 4 client.18900 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:52:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55da9c9870d0 con 0x55da9ca7d0e0 2023-09-13T09:52:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f338f7fe700 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca7d0e0 0x55da9cae8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f336f7fe700 10 client.18900 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.206+0000 7f338f7fe700 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca7d0e0 0x55da9cae8c60 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5fbb8bc4a4bd9ebe server_cookie=d62a5c29956b4caa in_seq=0 out_seq=0 2023-09-13T09:52:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f336f7fe700 1 -- 172.21.15.6:0/3695924694 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55da9c9870d0 con 0x55da9ca7d0e0 2023-09-13T09:52:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f336f7fe700 10 client.18900 handle_command_reply: tid=0 2023-09-13T09:52:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 client.18900 shutdown 2023-09-13T09:52:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9c9d9d00 msgr2=0x55da9ca89320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9c9d9d00 0x55da9ca89320 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3380005950 tx=0x7f3380099440 comp rx=0 tx=0).stop 2023-09-13T09:52:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 shutdown_connections 2023-09-13T09:52:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da9ca7c780 0x55da9cae4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da9ca7d0e0 0x55da9cae8c60 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da9c9d9d00 0x55da9ca89320 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 --2- 172.21.15.6:0/3695924694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da9ca7ba80 0x55da9ca89860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f336f7fe700 0 client.18900 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 >> 172.21.15.6:0/3695924694 conn(0x55da9ca841b0 msgr2=0x55da9ca7a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 shutdown_connections 2023-09-13T09:52:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 1 -- 172.21.15.6:0/3695924694 wait complete. 2023-09-13T09:52:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.208+0000 7f33a2652b80 20 client.18900 trim_cache size 0 max 16384 2023-09-13T09:52:19.231 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:52:19.232 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:52:19.232 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "af8615f0-e960-43ab-a57f-235bedd4bf67", 2023-09-13T09:52:19.232 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:52:19.232 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:52:19.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33780a0640 msgr2=0x7f33780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33780a0640 0x7f33780a2b00 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f3384009c60 tx=0x7f3384010040 comp rx=0 tx=0).stop 2023-09-13T09:52:19.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33900ffcc0 msgr2=0x7f33901959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33900ffcc0 0x7f33901959e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f338000e970 tx=0x7f338000ec80 comp rx=0 tx=0).stop 2023-09-13T09:52:19.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 shutdown_connections 2023-09-13T09:52:19.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33780a0640 0x7f33780a2b00 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3390101850 0x7f339019cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f33900ffcc0 0x7f33901959e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 --2- 172.21.15.6:0/764959205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3390100eb0 0x7f3390195f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 >> 172.21.15.6:0/764959205 conn(0x7f33900fb250 msgr2=0x7f33900fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 shutdown_connections 2023-09-13T09:52:19.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.209+0000 7f339646d700 1 -- 172.21.15.6:0/764959205 wait complete. 2023-09-13T09:52:19.237 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:52:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 -- 172.21.15.6:0/3565867645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 msgr2=0x7f613c103cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 --2- 172.21.15.6:0/3565867645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c103cd0 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f6124009990 tx=0x7f6124009ca0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 -- 172.21.15.6:0/3565867645 shutdown_connections 2023-09-13T09:52:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 --2- 172.21.15.6:0/3565867645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f613c106b40 0x7f613c108f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 --2- 172.21.15.6:0/3565867645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c103cd0 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 --2- 172.21.15.6:0/3565867645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c104210 0x7f613c106600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 -- 172.21.15.6:0/3565867645 >> 172.21.15.6:0/3565867645 conn(0x7f613c0fb250 msgr2=0x7f613c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 -- 172.21.15.6:0/3565867645 shutdown_connections 2023-09-13T09:52:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 -- 172.21.15.6:0/3565867645 wait complete. 2023-09-13T09:52:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.409+0000 7f6142019700 1 Processor -- start 2023-09-13T09:52:19.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f6142019700 1 -- start start 2023-09-13T09:52:19.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f6142019700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f6142019700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f613c104210 0x7f613c196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f6142019700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c106b40 0x7f613c19e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f6142019700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c19e620 con 0x7f613c1018e0 2023-09-13T09:52:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f6142019700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c19e760 con 0x7f613c104210 2023-09-13T09:52:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f6142019700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f613c19e8f0 con 0x7f613c106b40 2023-09-13T09:52:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42032/0 (socket says 172.21.15.6:42032) 2023-09-13T09:52:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 -- 172.21.15.6:0/582907446 learned_addr learned my addr 172.21.15.6:0/582907446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613affd700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f613c104210 0x7f613c196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613bfff700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c106b40 0x7f613c19e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 -- 172.21.15.6:0/582907446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c106b40 msgr2=0x7f613c19e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c106b40 0x7f613c19e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 -- 172.21.15.6:0/582907446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f613c104210 msgr2=0x7f613c196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f613c104210 0x7f613c196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 -- 172.21.15.6:0/582907446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61240095f0 con 0x7f613c1018e0 2023-09-13T09:52:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.410+0000 7f613b7fe700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c196aa0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6124004730 tx=0x7f6124004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.411+0000 7f6138ff9700 1 -- 172.21.15.6:0/582907446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612401d070 con 0x7f613c1018e0 2023-09-13T09:52:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.411+0000 7f6138ff9700 1 -- 172.21.15.6:0/582907446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6124004c90 con 0x7f613c1018e0 2023-09-13T09:52:19.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.411+0000 7f6138ff9700 1 -- 172.21.15.6:0/582907446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61240054b0 con 0x7f613c1018e0 2023-09-13T09:52:19.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.411+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f613c19eb70 con 0x7f613c1018e0 2023-09-13T09:52:19.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.411+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c19eee0 con 0x7f613c1018e0 2023-09-13T09:52:19.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.413+0000 7f6138ff9700 1 -- 172.21.15.6:0/582907446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f612400fbc0 con 0x7f613c1018e0 2023-09-13T09:52:19.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.413+0000 7f6138ff9700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61280a0640 0x7f61280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f6138ff9700 1 -- 172.21.15.6:0/582907446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f61240cce60 con 0x7f613c1018e0 2023-09-13T09:52:19.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f613affd700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61280a0640 0x7f61280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f613affd700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61280a0640 0x7f61280a2b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f612c009c60 tx=0x7f612c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f614e1feb80 1 Processor -- start 2023-09-13T09:52:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f614e1feb80 1 -- start start 2023-09-13T09:52:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318572700 0x556318572b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318573060 0x5563185714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x556318571e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f614e1feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563184ca780 con 0x556318571a00 2023-09-13T09:52:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.414+0000 7f614e1feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563184c80a0 con 0x556318572700 2023-09-13T09:52:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f614e1feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563184c3990 con 0x556318573060 2023-09-13T09:52:19.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x556318571e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x556318571e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42044/0 (socket says 172.21.15.6:42044) 2023-09-13T09:52:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318572700 0x556318572b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 -- 172.21.15.6:0/1662246239 learned_addr learned my addr 172.21.15.6:0/1662246239 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613affd700 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318573060 0x5563185714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 -- 172.21.15.6:0/1662246239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318573060 msgr2=0x5563185714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318573060 0x5563185714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 -- 172.21.15.6:0/1662246239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318572700 msgr2=0x556318572b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318572700 0x556318572b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 -- 172.21.15.6:0/1662246239 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556318343630 con 0x556318571a00 2023-09-13T09:52:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f613bfff700 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x556318571e80 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6134003f90 tx=0x7f6134009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d87b0fad8c9e916 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f6131ffb700 1 -- 172.21.15.6:0/1662246239 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340046f0 con 0x556318571a00 2023-09-13T09:52:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f6131ffb700 1 -- 172.21.15.6:0/1662246239 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f613400f040 con 0x556318571a00 2023-09-13T09:52:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.415+0000 7f6131ffb700 1 -- 172.21.15.6:0/1662246239 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61340156e0 con 0x556318571a00 2023-09-13T09:52:19.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 -- 172.21.15.6:0/1662246239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 msgr2=0x556318571e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x556318571e80 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f6134003f90 tx=0x7f6134009c20 comp rx=0 tx=0).stop 2023-09-13T09:52:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 -- 172.21.15.6:0/1662246239 shutdown_connections 2023-09-13T09:52:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x556318571e80 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318572700 0x556318572b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1662246239 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318573060 0x5563185714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 -- 172.21.15.6:0/1662246239 >> 172.21.15.6:0/1662246239 conn(0x5563184cfc80 msgr2=0x55631856bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 -- 172.21.15.6:0/1662246239 shutdown_connections 2023-09-13T09:52:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 -- 172.21.15.6:0/1662246239 wait complete. 2023-09-13T09:52:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.416+0000 7f614e1feb80 1 -- start start 2023-09-13T09:52:19.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 1 Processor -- start 2023-09-13T09:52:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x55631857af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631857b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x556318582480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556318461bb0 con 0x556318573060 2023-09-13T09:52:19.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563184618b0 con 0x556318571a00 2023-09-13T09:52:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556318345920 con 0x556318572700 2023-09-13T09:52:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f614e1feb80 10 client.0 _ll_register_callbacks cb 0x55631845f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x556318582480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x556318582480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42048/0 (socket says 172.21.15.6:42048) 2023-09-13T09:52:19.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 -- 172.21.15.6:0/1021915665 learned_addr learned my addr 172.21.15.6:0/1021915665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613affd700 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631857b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 -- 172.21.15.6:0/1021915665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 msgr2=0x55631857b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631857b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 -- 172.21.15.6:0/1021915665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 msgr2=0x55631857af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x55631857af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.417+0000 7f613bfff700 1 -- 172.21.15.6:0/1021915665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6134003bf0 con 0x556318573060 2023-09-13T09:52:19.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f613bfff700 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x556318582480 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f61340077e0 tx=0x7f61340078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4993d7acec1b3114 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f611affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:19.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f611affd700 1 -- 172.21.15.6:0/1021915665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134009550 con 0x556318573060 2023-09-13T09:52:19.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f611affd700 1 -- 172.21.15.6:0/1021915665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6134005050 con 0x556318573060 2023-09-13T09:52:19.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556318564670 con 0x556318573060 2023-09-13T09:52:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f611affd700 1 -- 172.21.15.6:0/1021915665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6134005210 con 0x556318573060 2023-09-13T09:52:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 10 client.18912 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5563184db7a0 con 0x556318573060 2023-09-13T09:52:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f611affd700 1 -- 172.21.15.6:0/1021915665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556318564670 con 0x556318573060 2023-09-13T09:52:19.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f611affd700 1 -- 172.21.15.6:0/1021915665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61340156e0 con 0x556318573060 2023-09-13T09:52:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 10 client.18912 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 10 client.18912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 20 client.18912 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556318586c00 0x556318589020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 4 client.18912 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.418+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5563184bc970 con 0x556318586c00 2023-09-13T09:52:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.419+0000 7f613b7fe700 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556318586c00 0x556318589020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.419+0000 7f611affd700 10 client.18912 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.419+0000 7f613b7fe700 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556318586c00 0x556318589020 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b69376583c4baac server_cookie=36e7f851131ff608 in_seq=0 out_seq=0 2023-09-13T09:52:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f611affd700 1 -- 172.21.15.6:0/1021915665 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5563184bc970 con 0x556318586c00 2023-09-13T09:52:19.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f611affd700 10 client.18912 handle_command_reply: tid=0 2023-09-13T09:52:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 client.18912 shutdown 2023-09-13T09:52:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 msgr2=0x556318582480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x556318582480 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f61340077e0 tx=0x7f61340078c0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 shutdown_connections 2023-09-13T09:52:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x556318586c00 0x556318589020 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x556318582480 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x55631857af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1021915665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631857b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f611affd700 0 client.18912 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.420+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 >> 172.21.15.6:0/1021915665 conn(0x5563184cfc80 msgr2=0x55631856bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.421+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 shutdown_connections 2023-09-13T09:52:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.421+0000 7f614e1feb80 1 -- 172.21.15.6:0/1021915665 wait complete. 2023-09-13T09:52:19.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.421+0000 7f614e1feb80 20 client.18912 trim_cache size 0 max 16384 2023-09-13T09:52:19.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 Processor -- start 2023-09-13T09:52:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 -- start start 2023-09-13T09:52:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x5563185714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631856be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318573060 0x5563185758e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556318578b30 con 0x556318571a00 2023-09-13T09:52:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556318576420 con 0x556318573060 2023-09-13T09:52:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f614e1feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556318586900 con 0x556318572700 2023-09-13T09:52:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.440+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x5563185714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x5563185714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42054/0 (socket says 172.21.15.6:42054) 2023-09-13T09:52:19.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 -- 172.21.15.6:0/1139132766 learned_addr learned my addr 172.21.15.6:0/1139132766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613affd700 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631856be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613bfff700 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318573060 0x5563185758e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 -- 172.21.15.6:0/1139132766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 msgr2=0x55631856be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631856be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 -- 172.21.15.6:0/1139132766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318573060 msgr2=0x5563185758e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318573060 0x5563185758e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 -- 172.21.15.6:0/1139132766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5563182efde0 con 0x556318571a00 2023-09-13T09:52:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f613b7fe700 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x5563185714c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6124005000 tx=0x7f6124005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad77938e5538f70 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f61327fc700 1 -- 172.21.15.6:0/1139132766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612409ad90 con 0x556318571a00 2023-09-13T09:52:19.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f61327fc700 1 -- 172.21.15.6:0/1139132766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f612409a690 con 0x556318571a00 2023-09-13T09:52:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.441+0000 7f61327fc700 1 -- 172.21.15.6:0/1139132766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6124099b80 con 0x556318571a00 2023-09-13T09:52:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 -- 172.21.15.6:0/1139132766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 msgr2=0x5563185714c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x5563185714c0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f6124005000 tx=0x7f6124005a90 comp rx=0 tx=0).stop 2023-09-13T09:52:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 -- 172.21.15.6:0/1139132766 shutdown_connections 2023-09-13T09:52:19.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318573060 0x5563185758e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318571a00 0x5563185714c0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 --2- 172.21.15.6:0/1139132766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x55631856be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 -- 172.21.15.6:0/1139132766 >> 172.21.15.6:0/1139132766 conn(0x5563184cfc80 msgr2=0x556318579be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 -- 172.21.15.6:0/1139132766 shutdown_connections 2023-09-13T09:52:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 -- 172.21.15.6:0/1139132766 wait complete. 2023-09-13T09:52:19.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.442+0000 7f614e1feb80 1 -- start start 2023-09-13T09:52:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 1 Processor -- start 2023-09-13T09:52:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x5563185d6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x5563185d71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x5563185ddcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563185de200 con 0x556318573060 2023-09-13T09:52:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563185de340 con 0x556318571a00 2023-09-13T09:52:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5563185de4d0 con 0x556318572700 2023-09-13T09:52:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f614e1feb80 10 client.0 _ll_register_callbacks cb 0x55631845f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x5563185d71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x5563185d6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x5563185ddcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x5563185d71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45116/0 (socket says 172.21.15.6:45116) 2023-09-13T09:52:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x5563185d6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35584/0 (socket says 172.21.15.6:35584) 2023-09-13T09:52:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 -- 172.21.15.6:0/406306691 learned_addr learned my addr 172.21.15.6:0/406306691 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:19.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 -- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 msgr2=0x5563185d6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x5563185d6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 -- 172.21.15.6:0/406306691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 msgr2=0x5563185ddcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x5563185ddcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613affd700 1 -- 172.21.15.6:0/406306691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f613c19eee0 con 0x556318572700 2023-09-13T09:52:19.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613b7fe700 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x5563185d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.443+0000 7f613bfff700 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x5563185ddcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f613affd700 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x5563185d71b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f612c0039d0 tx=0x7f612c0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=89652871faf25f6e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f611affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:52:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f611affd700 1 -- 172.21.15.6:0/406306691 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f612c022070 con 0x556318572700 2023-09-13T09:52:19.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f613400f040 con 0x556318572700 2023-09-13T09:52:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f611affd700 1 -- 172.21.15.6:0/406306691 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f612c01d920 con 0x556318572700 2023-09-13T09:52:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f611affd700 1 -- 172.21.15.6:0/406306691 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f612c01dae0 con 0x556318572700 2023-09-13T09:52:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 10 client.28225 fetch_fsmap learned FSMap version 34 2023-09-13T09:52:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5563182d8c60 con 0x556318572700 2023-09-13T09:52:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f611affd700 1 -- 172.21.15.6:0/406306691 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f612c037080 con 0x556318572700 2023-09-13T09:52:19.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f611affd700 1 -- 172.21.15.6:0/406306691 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 34) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f612c028430 con 0x556318572700 2023-09-13T09:52:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 10 client.28225 fetch_fsmap finished waiting for FSMap version 34 2023-09-13T09:52:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 10 client.28225 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 20 client.28225 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5563185e0010 0x5563185e2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 4 client.28225 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:52:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.444+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55631847d050 con 0x5563185e0010 2023-09-13T09:52:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f613b7fe700 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5563185e0010 0x5563185e2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f613b7fe700 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5563185e0010 0x5563185e2430 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecbca49ff6c93b38 server_cookie=a141470f043de9ef in_seq=0 out_seq=0 2023-09-13T09:52:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f611affd700 10 client.28225 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f611affd700 1 -- 172.21.15.6:0/406306691 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55631847d050 con 0x5563185e0010 2023-09-13T09:52:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f611affd700 10 client.28225 handle_command_reply: tid=0 2023-09-13T09:52:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 client.28225 shutdown 2023-09-13T09:52:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 msgr2=0x5563185d71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x5563185d71b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f612c0039d0 tx=0x7f612c0047c0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 shutdown_connections 2023-09-13T09:52:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5563185e0010 0x5563185e2430 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556318573060 0x5563185ddcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556318571a00 0x5563185d6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f611affd700 0 client.28225 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 --2- 172.21.15.6:0/406306691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556318572700 0x5563185d71b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.445+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 >> 172.21.15.6:0/406306691 conn(0x5563184cfc80 msgr2=0x55631856be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 shutdown_connections 2023-09-13T09:52:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f614e1feb80 1 -- 172.21.15.6:0/406306691 wait complete. 2023-09-13T09:52:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f614e1feb80 20 client.28225 trim_cache size 0 max 16384 2023-09-13T09:52:19.471 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:52:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:52:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:52:19.471 INFO:teuthology.orchestra.run.smithi006.stdout: "af8615f0-e960-43ab-a57f-235bedd4bf67": { 2023-09-13T09:52:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:52:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "af8615f0-e960-43ab-a57f-235bedd4bf67", 2023-09-13T09:52:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:52:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:52:19.472 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:52:19.472 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:52:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61280a0640 msgr2=0x7f61280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61280a0640 0x7f61280a2b00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f612c009c60 tx=0x7f612c009260 comp rx=0 tx=0).stop 2023-09-13T09:52:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 msgr2=0x7f613c196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:19.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c196aa0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f6124004730 tx=0x7f6124004760 comp rx=0 tx=0).stop 2023-09-13T09:52:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 shutdown_connections 2023-09-13T09:52:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f613c106b40 0x7f613c19e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61280a0640 0x7f61280a2b00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f613c1018e0 0x7f613c196aa0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 --2- 172.21.15.6:0/582907446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f613c104210 0x7f613c196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 >> 172.21.15.6:0/582907446 conn(0x7f613c0fb250 msgr2=0x7f613c102550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 shutdown_connections 2023-09-13T09:52:19.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:19.446+0000 7f6142019700 1 -- 172.21.15.6:0/582907446 wait complete. 2023-09-13T09:52:19.476 INFO:tasks.cephfs.filesystem:scrub status for tag:af8615f0-e960-43ab-a57f-235bedd4bf67 - {'path': '/', 'tag': 'af8615f0-e960-43ab-a57f-235bedd4bf67', 'options': 'recursive,force'} 2023-09-13T09:52:20.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 822717 6.81 MB/sec execute 580 sec latency 42.320 ms 2023-09-13T09:52:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: pgmap v684: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 2.3 MiB/s wr, 247 op/s 2023-09-13T09:52:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:20 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: pgmap v684: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 2.3 MiB/s wr, 247 op/s 2023-09-13T09:52:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:20.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:20.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:20 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: pgmap v684: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 2.3 MiB/s wr, 247 op/s 2023-09-13T09:52:20.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:20.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:20.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:20.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:20.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:20.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:20.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:20.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:20 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 824068 6.82 MB/sec execute 581 sec latency 19.503 ms 2023-09-13T09:52:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:21 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:52:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:21.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:21.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:21 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:52:21.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:21 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:52:21.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:21.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:21.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:21.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:22.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 825379 6.81 MB/sec execute 582 sec latency 16.135 ms 2023-09-13T09:52:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:22 smithi131 ceph-mon[102785]: pgmap v685: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.2 MiB/s wr, 212 op/s 2023-09-13T09:52:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:22 smithi006 ceph-mon[98665]: pgmap v685: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.2 MiB/s wr, 212 op/s 2023-09-13T09:52:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:22 smithi053 ceph-mon[102373]: pgmap v685: 97 pgs: 97 active+clean; 317 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 565 KiB/s rd, 2.2 MiB/s wr, 212 op/s 2023-09-13T09:52:23.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 827311 6.82 MB/sec execute 583 sec latency 47.607 ms 2023-09-13T09:52:24.186 INFO:tasks.workunit.client.0.smithi006.stdout: 1 828140 6.81 MB/sec execute 584 sec latency 16.718 ms 2023-09-13T09:52:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:24 smithi131 ceph-mon[102785]: pgmap v686: 97 pgs: 97 active+clean; 318 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2023-09-13T09:52:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:24 smithi006 ceph-mon[98665]: pgmap v686: 97 pgs: 97 active+clean; 318 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2023-09-13T09:52:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:24 smithi053 ceph-mon[102373]: pgmap v686: 97 pgs: 97 active+clean; 318 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 696 KiB/s rd, 2.5 MiB/s wr, 258 op/s 2023-09-13T09:52:25.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 830156 6.82 MB/sec execute 585 sec latency 23.134 ms 2023-09-13T09:52:26.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 831211 6.82 MB/sec execute 586 sec latency 19.685 ms 2023-09-13T09:52:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:26 smithi006 ceph-mon[98665]: pgmap v687: 97 pgs: 97 active+clean; 318 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.2 MiB/s wr, 266 op/s 2023-09-13T09:52:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:26 smithi053 ceph-mon[102373]: pgmap v687: 97 pgs: 97 active+clean; 318 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.2 MiB/s wr, 266 op/s 2023-09-13T09:52:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:26 smithi131 ceph-mon[102785]: pgmap v687: 97 pgs: 97 active+clean; 318 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 767 KiB/s rd, 2.2 MiB/s wr, 266 op/s 2023-09-13T09:52:27.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 832866 6.82 MB/sec execute 587 sec latency 13.454 ms 2023-09-13T09:52:28.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 834522 6.83 MB/sec execute 588 sec latency 49.320 ms 2023-09-13T09:52:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:28 smithi006 ceph-mon[98665]: pgmap v688: 97 pgs: 97 active+clean; 319 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-09-13T09:52:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:28 smithi053 ceph-mon[102373]: pgmap v688: 97 pgs: 97 active+clean; 319 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-09-13T09:52:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:28 smithi131 ceph-mon[102785]: pgmap v688: 97 pgs: 97 active+clean; 319 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 2.3 MiB/s wr, 262 op/s 2023-09-13T09:52:29.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 835377 6.82 MB/sec execute 589 sec latency 19.329 ms 2023-09-13T09:52:30.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 837380 6.83 MB/sec execute 590 sec latency 15.496 ms 2023-09-13T09:52:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:30 smithi006 ceph-mon[98665]: pgmap v689: 97 pgs: 97 active+clean; 319 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 1.9 MiB/s wr, 220 op/s 2023-09-13T09:52:30.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:30 smithi053 ceph-mon[102373]: pgmap v689: 97 pgs: 97 active+clean; 319 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 1.9 MiB/s wr, 220 op/s 2023-09-13T09:52:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:30 smithi131 ceph-mon[102785]: pgmap v689: 97 pgs: 97 active+clean; 319 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 674 KiB/s rd, 1.9 MiB/s wr, 220 op/s 2023-09-13T09:52:31.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 838380 6.83 MB/sec execute 591 sec latency 58.336 ms 2023-09-13T09:52:32.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 840297 6.83 MB/sec execute 592 sec latency 19.238 ms 2023-09-13T09:52:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:32 smithi006 ceph-mon[98665]: pgmap v690: 97 pgs: 97 active+clean; 321 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.7 MiB/s wr, 210 op/s 2023-09-13T09:52:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:32 smithi053 ceph-mon[102373]: pgmap v690: 97 pgs: 97 active+clean; 321 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.7 MiB/s wr, 210 op/s 2023-09-13T09:52:32.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:32 smithi131 ceph-mon[102785]: pgmap v690: 97 pgs: 97 active+clean; 321 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 583 KiB/s rd, 1.7 MiB/s wr, 210 op/s 2023-09-13T09:52:33.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 841613 6.84 MB/sec execute 593 sec latency 49.259 ms 2023-09-13T09:52:33.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:33 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:52:33.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:33 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:52:33.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:33 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:52:34.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 842362 6.83 MB/sec execute 594 sec latency 26.279 ms 2023-09-13T09:52:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:34 smithi006 ceph-mon[98665]: pgmap v691: 97 pgs: 97 active+clean; 322 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:52:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:34 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:34.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:34 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:34 smithi053 ceph-mon[102373]: pgmap v691: 97 pgs: 97 active+clean; 322 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:52:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:34 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:34 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:34 smithi131 ceph-mon[102785]: pgmap v691: 97 pgs: 97 active+clean; 322 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 716 KiB/s rd, 2.1 MiB/s wr, 253 op/s 2023-09-13T09:52:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:34 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:34 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:35.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 844246 6.83 MB/sec execute 595 sec latency 16.762 ms 2023-09-13T09:52:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:52:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:52:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:52:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:35.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:35.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:35.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:52:35.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:52:35.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:52:35.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:52:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:52:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:52:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:52:36.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 845428 6.84 MB/sec execute 596 sec latency 14.510 ms 2023-09-13T09:52:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:36 smithi006 ceph-mon[98665]: pgmap v692: 97 pgs: 97 active+clean; 324 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 2.0 MiB/s wr, 242 op/s 2023-09-13T09:52:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:36 smithi053 ceph-mon[102373]: pgmap v692: 97 pgs: 97 active+clean; 324 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 2.0 MiB/s wr, 242 op/s 2023-09-13T09:52:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:36 smithi131 ceph-mon[102785]: pgmap v692: 97 pgs: 97 active+clean; 324 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 690 KiB/s rd, 2.0 MiB/s wr, 242 op/s 2023-09-13T09:52:37.189 INFO:tasks.workunit.client.0.smithi006.stdout: 1 846613 6.83 MB/sec execute 597 sec latency 32.915 ms 2023-09-13T09:52:38.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 848376 6.84 MB/sec execute 598 sec latency 35.180 ms 2023-09-13T09:52:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:38 smithi006 ceph-mon[98665]: pgmap v693: 97 pgs: 97 active+clean; 325 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2023-09-13T09:52:38.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:38 smithi053 ceph-mon[102373]: pgmap v693: 97 pgs: 97 active+clean; 325 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2023-09-13T09:52:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:38 smithi131 ceph-mon[102785]: pgmap v693: 97 pgs: 97 active+clean; 325 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 683 KiB/s rd, 2.1 MiB/s wr, 241 op/s 2023-09-13T09:52:39.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 849183 6.83 MB/sec execute 599 sec latency 18.812 ms 2023-09-13T09:52:40.187 INFO:tasks.workunit.client.0.smithi006.stdout: 1 cleanup 600 sec 2023-09-13T09:52:40.450 INFO:tasks.workunit.client.0.smithi006.stdout: 0 cleanup 600 sec 2023-09-13T09:52:40.451 INFO:tasks.workunit.client.0.smithi006.stdout: 2023-09-13T09:52:40.451 INFO:tasks.workunit.client.0.smithi006.stdout: Operation Count AvgLat MaxLat 2023-09-13T09:52:40.451 INFO:tasks.workunit.client.0.smithi006.stdout: ---------------------------------------- 2023-09-13T09:52:40.451 INFO:tasks.workunit.client.0.smithi006.stdout: NTCreateX 131077 2.532 5043.940 2023-09-13T09:52:40.452 INFO:tasks.workunit.client.0.smithi006.stdout: Close 96309 0.002 0.095 2023-09-13T09:52:40.452 INFO:tasks.workunit.client.0.smithi006.stdout: Rename 5552 6.708 92.964 2023-09-13T09:52:40.453 INFO:tasks.workunit.client.0.smithi006.stdout: Unlink 26449 1.812 75.736 2023-09-13T09:52:40.453 INFO:tasks.workunit.client.0.smithi006.stdout: Deltree 2 125.237 162.921 2023-09-13T09:52:40.454 INFO:tasks.workunit.client.0.smithi006.stdout: Mkdir 1 0.005 0.005 2023-09-13T09:52:40.455 INFO:tasks.workunit.client.0.smithi006.stdout: Qpathinfo 118859 1.159 84.163 2023-09-13T09:52:40.455 INFO:tasks.workunit.client.0.smithi006.stdout: Qfileinfo 20792 0.002 0.026 2023-09-13T09:52:40.456 INFO:tasks.workunit.client.0.smithi006.stdout: Qfsinfo 21764 0.196 13.075 2023-09-13T09:52:40.456 INFO:tasks.workunit.client.0.smithi006.stdout: Sfileinfo 10694 0.010 5.058 2023-09-13T09:52:40.456 INFO:tasks.workunit.client.0.smithi006.stdout: Find 45925 0.195 104.665 2023-09-13T09:52:40.456 INFO:tasks.workunit.client.0.smithi006.stdout: WriteX 65135 0.013 2.325 2023-09-13T09:52:40.457 INFO:tasks.workunit.client.0.smithi006.stdout: ReadX 205397 0.010 28.167 2023-09-13T09:52:40.457 INFO:tasks.workunit.client.0.smithi006.stdout: LockX 426 0.586 4.861 2023-09-13T09:52:40.457 INFO:tasks.workunit.client.0.smithi006.stdout: UnlockX 426 0.554 2.132 2023-09-13T09:52:40.457 INFO:tasks.workunit.client.0.smithi006.stdout: Flush 9187 2.945 178.551 2023-09-13T09:52:40.458 INFO:tasks.workunit.client.0.smithi006.stdout: 2023-09-13T09:52:40.458 INFO:tasks.workunit.client.0.smithi006.stdout:Throughput 6.83431 MB/sec 1 clients 1 procs max_latency=5043.955 ms 2023-09-13T09:52:40.458 INFO:tasks.workunit.client.0.smithi006.stderr:+ dbench 10 2023-09-13T09:52:40.459 INFO:tasks.workunit.client.0.smithi006.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2023-09-13T09:52:40.459 INFO:tasks.workunit.client.0.smithi006.stdout: 2023-09-13T09:52:40.460 INFO:tasks.workunit.client.0.smithi006.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2023-09-13T09:52:40.460 INFO:tasks.workunit.client.0.smithi006.stdout:8 of 10 processes prepared for launch 0 sec 2023-09-13T09:52:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:40 smithi006 ceph-mon[98665]: pgmap v694: 97 pgs: 97 active+clean; 325 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 1.8 MiB/s wr, 196 op/s 2023-09-13T09:52:40.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:40 smithi053 ceph-mon[102373]: pgmap v694: 97 pgs: 97 active+clean; 325 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 1.8 MiB/s wr, 196 op/s 2023-09-13T09:52:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:40 smithi131 ceph-mon[102785]: pgmap v694: 97 pgs: 97 active+clean; 325 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 587 KiB/s rd, 1.8 MiB/s wr, 196 op/s 2023-09-13T09:52:40.552 INFO:tasks.workunit.client.0.smithi006.stdout:10 of 10 processes prepared for launch 0 sec 2023-09-13T09:52:40.552 INFO:tasks.workunit.client.0.smithi006.stdout:releasing clients 2023-09-13T09:52:41.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 260 98.39 MB/sec warmup 1 sec latency 125.137 ms 2023-09-13T09:52:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:42 smithi006 ceph-mon[98665]: pgmap v695: 97 pgs: 97 active+clean; 327 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 2.0 MiB/s wr, 226 op/s 2023-09-13T09:52:42.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:42 smithi053 ceph-mon[102373]: pgmap v695: 97 pgs: 97 active+clean; 327 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 2.0 MiB/s wr, 226 op/s 2023-09-13T09:52:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:42 smithi131 ceph-mon[102785]: pgmap v695: 97 pgs: 97 active+clean; 327 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 664 KiB/s rd, 2.0 MiB/s wr, 226 op/s 2023-09-13T09:52:42.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 462 80.96 MB/sec warmup 2 sec latency 78.954 ms 2023-09-13T09:52:43.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 775 71.27 MB/sec warmup 3 sec latency 88.634 ms 2023-09-13T09:52:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:44 smithi006 ceph-mon[98665]: pgmap v696: 97 pgs: 97 active+clean; 328 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.4 MiB/s wr, 240 op/s 2023-09-13T09:52:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:44 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:44 smithi053 ceph-mon[102373]: pgmap v696: 97 pgs: 97 active+clean; 328 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.4 MiB/s wr, 240 op/s 2023-09-13T09:52:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:44 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:44 smithi131 ceph-mon[102785]: pgmap v696: 97 pgs: 97 active+clean; 328 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 729 KiB/s rd, 2.4 MiB/s wr, 240 op/s 2023-09-13T09:52:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:44 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:44.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1114 57.40 MB/sec warmup 4 sec latency 76.768 ms 2023-09-13T09:52:45.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:45 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:45.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:45 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:45.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:45 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:45.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 1608 52.31 MB/sec warmup 5 sec latency 102.123 ms 2023-09-13T09:52:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:46 smithi006 ceph-mon[98665]: pgmap v697: 97 pgs: 97 active+clean; 324 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.2 MiB/s wr, 220 op/s 2023-09-13T09:52:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:46 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:46.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:46 smithi053 ceph-mon[102373]: pgmap v697: 97 pgs: 97 active+clean; 324 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.2 MiB/s wr, 220 op/s 2023-09-13T09:52:46.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:46 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:46 smithi131 ceph-mon[102785]: pgmap v697: 97 pgs: 97 active+clean; 324 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 655 KiB/s rd, 2.2 MiB/s wr, 220 op/s 2023-09-13T09:52:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:46 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:46.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 2486 48.46 MB/sec warmup 6 sec latency 151.963 ms 2023-09-13T09:52:47.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 3038 48.30 MB/sec warmup 7 sec latency 61.437 ms 2023-09-13T09:52:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:48 smithi006 ceph-mon[98665]: pgmap v698: 97 pgs: 97 active+clean; 321 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 2.6 MiB/s wr, 274 op/s 2023-09-13T09:52:48.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:48 smithi053 ceph-mon[102373]: pgmap v698: 97 pgs: 97 active+clean; 321 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 2.6 MiB/s wr, 274 op/s 2023-09-13T09:52:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:48 smithi131 ceph-mon[102785]: pgmap v698: 97 pgs: 97 active+clean; 321 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 861 KiB/s rd, 2.6 MiB/s wr, 274 op/s 2023-09-13T09:52:48.552 INFO:tasks.workunit.client.0.smithi006.stdout: 10 3568 45.71 MB/sec warmup 8 sec latency 88.640 ms 2023-09-13T09:52:49.478 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:52:49.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:49 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:49.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:49 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:49.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:49 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:49.558 INFO:tasks.workunit.client.0.smithi006.stdout: 10 4056 44.44 MB/sec warmup 9 sec latency 105.888 ms 2023-09-13T09:52:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 -- 172.21.15.6:0/3193605789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 msgr2=0x7f10c41011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 --2- 172.21.15.6:0/3193605789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c41011a0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f10b40099c0 tx=0x7f10b4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 -- 172.21.15.6:0/3193605789 shutdown_connections 2023-09-13T09:52:49.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 --2- 172.21.15.6:0/3193605789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10c4102910 0x7f10c41091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 --2- 172.21.15.6:0/3193605789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c41011a0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 --2- 172.21.15.6:0/3193605789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c4101f70 0x7f10c41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 -- 172.21.15.6:0/3193605789 >> 172.21.15.6:0/3193605789 conn(0x7f10c40fc310 msgr2=0x7f10c40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 -- 172.21.15.6:0/3193605789 shutdown_connections 2023-09-13T09:52:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.635+0000 7f10ca587700 1 -- 172.21.15.6:0/3193605789 wait complete. 2023-09-13T09:52:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 Processor -- start 2023-09-13T09:52:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 -- start start 2023-09-13T09:52:49.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c4196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c4101f70 0x7f10c4196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10c4102910 0x7f10c419e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c419e600 con 0x7f10c4100d80 2023-09-13T09:52:49.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c419e740 con 0x7f10c4101f70 2023-09-13T09:52:49.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10ca587700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10c419e8d0 con 0x7f10c4102910 2023-09-13T09:52:49.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c4196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c4196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42078/0 (socket says 172.21.15.6:42078) 2023-09-13T09:52:49.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10c3fff700 1 -- 172.21.15.6:0/2427300077 learned_addr learned my addr 172.21.15.6:0/2427300077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:49.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c4101f70 0x7f10c4196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.636+0000 7f10c8b24700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10c4102910 0x7f10c419e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c3fff700 1 -- 172.21.15.6:0/2427300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10c4102910 msgr2=0x7f10c419e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10c4102910 0x7f10c419e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c3fff700 1 -- 172.21.15.6:0/2427300077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c4101f70 msgr2=0x7f10c4196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c4101f70 0x7f10c4196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c3fff700 1 -- 172.21.15.6:0/2427300077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40095f0 con 0x7f10c4100d80 2023-09-13T09:52:49.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c4196a80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009990 tx=0x7f10b400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c17fa700 1 -- 172.21.15.6:0/2427300077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b401d070 con 0x7f10c4100d80 2023-09-13T09:52:49.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c17fa700 1 -- 172.21.15.6:0/2427300077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10b4005030 con 0x7f10c4100d80 2023-09-13T09:52:49.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10c419eb50 con 0x7f10c4100d80 2023-09-13T09:52:49.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10c17fa700 1 -- 172.21.15.6:0/2427300077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4004b30 con 0x7f10c4100d80 2023-09-13T09:52:49.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.637+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c419ef70 con 0x7f10c4100d80 2023-09-13T09:52:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.640+0000 7f10c17fa700 1 -- 172.21.15.6:0/2427300077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f10b4004cd0 con 0x7f10c4100d80 2023-09-13T09:52:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.640+0000 7f10c17fa700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10ac0a0640 0x7f10ac0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.640+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10ac0a0640 0x7f10ac0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.640+0000 7f10c17fa700 1 -- 172.21.15.6:0/2427300077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10b40cca10 con 0x7f10c4100d80 2023-09-13T09:52:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10ac0a0640 0x7f10ac0a2b00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009c60 tx=0x7f10b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 Processor -- start 2023-09-13T09:52:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 -- start start 2023-09-13T09:52:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb83cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83d060 0x555beb83b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83ba00 0x555beb83be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb794780 con 0x555beb83d060 2023-09-13T09:52:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb7920a0 con 0x555beb83c700 2023-09-13T09:52:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10d676cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb78d990 con 0x555beb83ba00 2023-09-13T09:52:49.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83d060 0x555beb83b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10c3fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb83cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83d060 0x555beb83b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42086/0 (socket says 172.21.15.6:42086) 2023-09-13T09:52:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.641+0000 7f10c37fe700 1 -- 172.21.15.6:0/424341470 learned_addr learned my addr 172.21.15.6:0/424341470 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c8b24700 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83ba00 0x555beb83be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c37fe700 1 -- 172.21.15.6:0/424341470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83ba00 msgr2=0x555beb83be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c37fe700 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83ba00 0x555beb83be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c37fe700 1 -- 172.21.15.6:0/424341470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 msgr2=0x555beb83cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c37fe700 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb83cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c37fe700 1 -- 172.21.15.6:0/424341470 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555beb60d630 con 0x555beb83d060 2023-09-13T09:52:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c8b24700 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83ba00 0x555beb83be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:49.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c3fff700 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb83cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10c37fe700 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83d060 0x555beb83b4c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f10b800e4e0 tx=0x7f10b8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=455848ebb8d6e44d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10aa7fc700 1 -- 172.21.15.6:0/424341470 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b800ee00 con 0x555beb83d060 2023-09-13T09:52:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10aa7fc700 1 -- 172.21.15.6:0/424341470 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10b8021070 con 0x555beb83d060 2023-09-13T09:52:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.642+0000 7f10aa7fc700 1 -- 172.21.15.6:0/424341470 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b801d810 con 0x555beb83d060 2023-09-13T09:52:49.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 -- 172.21.15.6:0/424341470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83d060 msgr2=0x555beb83b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83d060 0x555beb83b4c0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f10b800e4e0 tx=0x7f10b8014000 comp rx=0 tx=0).stop 2023-09-13T09:52:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 -- 172.21.15.6:0/424341470 shutdown_connections 2023-09-13T09:52:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83ba00 0x555beb83be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb83cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 --2- 172.21.15.6:0/424341470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83d060 0x555beb83b4c0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 -- 172.21.15.6:0/424341470 >> 172.21.15.6:0/424341470 conn(0x555beb799c80 msgr2=0x555beb835f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 -- 172.21.15.6:0/424341470 shutdown_connections 2023-09-13T09:52:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 -- 172.21.15.6:0/424341470 wait complete. 2023-09-13T09:52:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.643+0000 7f10d676cb80 1 -- start start 2023-09-13T09:52:49.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 1 Processor -- start 2023-09-13T09:52:49.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb845180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb84cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb72bbb0 con 0x555beb83ba00 2023-09-13T09:52:49.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb72b8b0 con 0x555beb83c700 2023-09-13T09:52:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb60f920 con 0x555beb84a6f0 2023-09-13T09:52:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10d676cb80 10 client.0 _ll_register_callbacks cb 0x555beb729680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb845180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35616/0 (socket says 172.21.15.6:35616) 2023-09-13T09:52:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10c37fe700 1 -- 172.21.15.6:0/2967902763 learned_addr learned my addr 172.21.15.6:0/2967902763 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.644+0000 7f10c8b24700 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb84cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10c37fe700 1 -- 172.21.15.6:0/2967902763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 msgr2=0x555beb84cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb84cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10c37fe700 1 -- 172.21.15.6:0/2967902763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 msgr2=0x555beb845180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb845180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10c37fe700 1 -- 172.21.15.6:0/2967902763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b8017070 con 0x555beb83c700 2023-09-13T09:52:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10c8b24700 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb84cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8456c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f10b8011ab0 tx=0x7f10b800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19d33f299062daa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:52:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10a37fe700 1 -- 172.21.15.6:0/2967902763 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b80053d0 con 0x555beb83c700 2023-09-13T09:52:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10a37fe700 1 -- 172.21.15.6:0/2967902763 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10b8005530 con 0x555beb83c700 2023-09-13T09:52:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555beb82e670 con 0x555beb83c700 2023-09-13T09:52:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10a37fe700 1 -- 172.21.15.6:0/2967902763 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10b80056f0 con 0x555beb83c700 2023-09-13T09:52:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10d676cb80 10 client.28316 fetch_fsmap learned FSMap version 38 2023-09-13T09:52:49.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.645+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x555beb7a57a0 con 0x555beb83c700 2023-09-13T09:52:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10a37fe700 1 -- 172.21.15.6:0/2967902763 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555beb82e670 con 0x555beb83c700 2023-09-13T09:52:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10a37fe700 1 -- 172.21.15.6:0/2967902763 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 38) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f10b801c7e0 con 0x555beb83c700 2023-09-13T09:52:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10d676cb80 10 client.28316 fetch_fsmap finished waiting for FSMap version 38 2023-09-13T09:52:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10d676cb80 10 client.28316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:49.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10d676cb80 20 client.28316 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:49.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb850ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10d676cb80 4 client.28316 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:49.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555beb786970 con 0x555beb8506a0 2023-09-13T09:52:49.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.646+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb850ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.647+0000 7f10a37fe700 10 client.28316 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.647+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb850ab0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7178d04c9f851840 server_cookie=34835d7d66d0f7f1 in_seq=0 out_seq=0 2023-09-13T09:52:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10a37fe700 1 -- 172.21.15.6:0/2967902763 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555beb786970 con 0x555beb8506a0 2023-09-13T09:52:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10a37fe700 10 client.28316 handle_command_reply: tid=0 2023-09-13T09:52:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 client.28316 shutdown 2023-09-13T09:52:49.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 msgr2=0x555beb8456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8456c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f10b8011ab0 tx=0x7f10b800ee40 comp rx=0 tx=0).stop 2023-09-13T09:52:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 shutdown_connections 2023-09-13T09:52:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb84cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb850ab0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb845180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10a37fe700 0 client.28316 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2967902763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8456c0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.648+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 >> 172.21.15.6:0/2967902763 conn(0x555beb799c80 msgr2=0x555beb8307f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.649+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 shutdown_connections 2023-09-13T09:52:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.649+0000 7f10d676cb80 1 -- 172.21.15.6:0/2967902763 wait complete. 2023-09-13T09:52:49.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.649+0000 7f10d676cb80 20 client.28316 trim_cache size 0 max 16384 2023-09-13T09:52:49.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 Processor -- start 2023-09-13T09:52:49.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 -- start start 2023-09-13T09:52:49.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb83b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8608d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb83fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb82e490 con 0x555beb83ba00 2023-09-13T09:52:49.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb844490 con 0x555beb83c700 2023-09-13T09:52:49.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10d676cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb832930 con 0x555beb84a6f0 2023-09-13T09:52:49.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb83b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10c8b24700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb83fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb83b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42098/0 (socket says 172.21.15.6:42098) 2023-09-13T09:52:49.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10c3fff700 1 -- 172.21.15.6:0/4083804868 learned_addr learned my addr 172.21.15.6:0/4083804868 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:49.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.667+0000 7f10c37fe700 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8608d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10c8b24700 1 -- 172.21.15.6:0/4083804868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 msgr2=0x555beb8608d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10c8b24700 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8608d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10c8b24700 1 -- 172.21.15.6:0/4083804868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 msgr2=0x555beb83b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10c8b24700 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb83b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10c8b24700 1 -- 172.21.15.6:0/4083804868 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555beb5b9de0 con 0x555beb84a6f0 2023-09-13T09:52:49.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10c3fff700 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb83b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:49.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10c8b24700 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb83fb00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f10bc003fd0 tx=0x7f10bc009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a222bf78a608b5d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10aaffd700 1 -- 172.21.15.6:0/4083804868 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc004450 con 0x555beb84a6f0 2023-09-13T09:52:49.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10aaffd700 1 -- 172.21.15.6:0/4083804868 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10bc00f040 con 0x555beb84a6f0 2023-09-13T09:52:49.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.668+0000 7f10aaffd700 1 -- 172.21.15.6:0/4083804868 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10bc016430 con 0x555beb84a6f0 2023-09-13T09:52:49.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 -- 172.21.15.6:0/4083804868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 msgr2=0x555beb83fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb83fb00 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f10bc003fd0 tx=0x7f10bc009940 comp rx=0 tx=0).stop 2023-09-13T09:52:49.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 -- 172.21.15.6:0/4083804868 shutdown_connections 2023-09-13T09:52:49.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb84a6f0 0x555beb83fb00 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb83b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 --2- 172.21.15.6:0/4083804868 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb83c700 0x555beb8608d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 -- 172.21.15.6:0/4083804868 >> 172.21.15.6:0/4083804868 conn(0x555beb799c80 msgr2=0x555beb851810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 -- 172.21.15.6:0/4083804868 shutdown_connections 2023-09-13T09:52:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.669+0000 7f10d676cb80 1 -- 172.21.15.6:0/4083804868 wait complete. 2023-09-13T09:52:49.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 -- start start 2023-09-13T09:52:49.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 Processor -- start 2023-09-13T09:52:49.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb85e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83c700 0x555beb85eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb84a6f0 0x555beb85ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb860440 con 0x555beb83ba00 2023-09-13T09:52:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb8605b0 con 0x555beb84a6f0 2023-09-13T09:52:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555beb860770 con 0x555beb83c700 2023-09-13T09:52:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10d676cb80 10 client.0 _ll_register_callbacks cb 0x555beb729680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83c700 0x555beb85eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb85e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10c37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83c700 0x555beb85eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45160/0 (socket says 172.21.15.6:45160) 2023-09-13T09:52:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.670+0000 7f10c37fe700 1 -- 172.21.15.6:0/2194604953 learned_addr learned my addr 172.21.15.6:0/2194604953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c8b24700 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb84a6f0 0x555beb85ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c37fe700 1 -- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb84a6f0 msgr2=0x555beb85ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb84a6f0 0x555beb85ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c37fe700 1 -- 172.21.15.6:0/2194604953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 msgr2=0x555beb85e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb85e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c37fe700 1 -- 172.21.15.6:0/2194604953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10c419eb50 con 0x555beb83c700 2023-09-13T09:52:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb85e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:49.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10c37fe700 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83c700 0x555beb85eef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10b801cbc0 tx=0x7f10b801cd30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c471de300da023de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10a37fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:52:49.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10a37fe700 1 -- 172.21.15.6:0/2194604953 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b803e070 con 0x555beb83c700 2023-09-13T09:52:49.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10a37fe700 1 -- 172.21.15.6:0/2194604953 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10b80053d0 con 0x555beb83c700 2023-09-13T09:52:49.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.671+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f10b8021070 con 0x555beb83c700 2023-09-13T09:52:49.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10a37fe700 1 -- 172.21.15.6:0/2194604953 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10b8005590 con 0x555beb83c700 2023-09-13T09:52:49.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 10 client.28243 fetch_fsmap learned FSMap version 38 2023-09-13T09:52:49.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) v3 -- 0x7f10bc003cb0 con 0x555beb83c700 2023-09-13T09:52:49.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10a37fe700 1 -- 172.21.15.6:0/2194604953 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f10b8048020 con 0x555beb83c700 2023-09-13T09:52:49.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10a37fe700 1 -- 172.21.15.6:0/2194604953 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 38) v1 ==== 7902+0+0 (secure 0 0 0) 0x7f10b8041030 con 0x555beb83c700 2023-09-13T09:52:49.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 10 client.28243 fetch_fsmap finished waiting for FSMap version 38 2023-09-13T09:52:49.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 10 client.28243 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:49.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 20 client.28243 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:49.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb8b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 4 client.28243 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:52:49.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555beb747050 con 0x555beb8506a0 2023-09-13T09:52:49.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.672+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb8b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.673+0000 7f10a37fe700 10 client.28243 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:49.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.673+0000 7f10c3fff700 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb8b08c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32eec6e268cc1c84 server_cookie=33469f1175d0a774 in_seq=0 out_seq=0 2023-09-13T09:52:49.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.675+0000 7f10a37fe700 1 -- 172.21.15.6:0/2194604953 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555beb747050 con 0x555beb8506a0 2023-09-13T09:52:49.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.675+0000 7f10a37fe700 10 client.28243 handle_command_reply: tid=0 2023-09-13T09:52:49.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.675+0000 7f10d676cb80 1 client.28243 shutdown 2023-09-13T09:52:49.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83c700 msgr2=0x555beb85eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83c700 0x555beb85eef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f10b801cbc0 tx=0x7f10b801cd30 comp rx=0 tx=0).stop 2023-09-13T09:52:49.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 shutdown_connections 2023-09-13T09:52:49.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555beb84a6f0 0x555beb85ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x555beb8506a0 0x555beb8b08c0 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555beb83ba00 0x555beb85e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10a37fe700 0 client.28243 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:49.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 --2- 172.21.15.6:0/2194604953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555beb83c700 0x555beb85eef0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 >> 172.21.15.6:0/2194604953 conn(0x555beb799c80 msgr2=0x555beb83fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:49.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 shutdown_connections 2023-09-13T09:52:49.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 1 -- 172.21.15.6:0/2194604953 wait complete. 2023-09-13T09:52:49.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10d676cb80 20 client.28243 trim_cache size 0 max 16384 2023-09-13T09:52:49.693 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:52:49.694 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:52:49.694 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:52:49.694 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:52:49.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10ac0a0640 msgr2=0x7f10ac0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10ca587700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10ac0a0640 0x7f10ac0a2b00 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f10b8009c60 tx=0x7f10b8009260 comp rx=0 tx=0).stop 2023-09-13T09:52:49.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 msgr2=0x7f10c4196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.676+0000 7f10ca587700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c4196a80 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009990 tx=0x7f10b400f690 comp rx=0 tx=0).stop 2023-09-13T09:52:49.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 shutdown_connections 2023-09-13T09:52:49.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10c4102910 0x7f10c419e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10ac0a0640 0x7f10ac0a2b00 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10c4100d80 0x7f10c4196a80 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 --2- 172.21.15.6:0/2427300077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10c4101f70 0x7f10c4196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 >> 172.21.15.6:0/2427300077 conn(0x7f10c40fc310 msgr2=0x7f10c40fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:49.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 shutdown_connections 2023-09-13T09:52:49.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.677+0000 7f10ca587700 1 -- 172.21.15.6:0/2427300077 wait complete. 2023-09-13T09:52:49.698 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:52:49.698 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:52:49.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 -- 172.21.15.6:0/1399936494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 msgr2=0x7f4e781000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 --2- 172.21.15.6:0/1399936494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 0x7f4e781000b0 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800d990 tx=0x7f4e6800dca0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 -- 172.21.15.6:0/1399936494 shutdown_connections 2023-09-13T09:52:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 --2- 172.21.15.6:0/1399936494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e78101820 0x7f4e781080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 --2- 172.21.15.6:0/1399936494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 0x7f4e781000b0 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 --2- 172.21.15.6:0/1399936494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e78100e80 0x7f4e781012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 -- 172.21.15.6:0/1399936494 >> 172.21.15.6:0/1399936494 conn(0x7f4e780fb220 msgr2=0x7f4e780fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:49.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 -- 172.21.15.6:0/1399936494 shutdown_connections 2023-09-13T09:52:49.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.880+0000 7f4e7de74700 1 -- 172.21.15.6:0/1399936494 wait complete. 2023-09-13T09:52:49.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 Processor -- start 2023-09-13T09:52:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 -- start start 2023-09-13T09:52:49.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 0x7f4e78198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e78100e80 0x7f4e78199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e78101820 0x7f4e781a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781a0880 con 0x7f4e780ffc90 2023-09-13T09:52:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781a09f0 con 0x7f4e78101820 2023-09-13T09:52:49.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e7de74700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e781a0bb0 con 0x7f4e78100e80 2023-09-13T09:52:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 0x7f4e78198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 0x7f4e78198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42118/0 (socket says 172.21.15.6:42118) 2023-09-13T09:52:49.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.881+0000 7f4e777fe700 1 -- 172.21.15.6:0/2341282361 learned_addr learned my addr 172.21.15.6:0/2341282361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e76ffd700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e78100e80 0x7f4e78199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e77fff700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e78101820 0x7f4e781a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e76ffd700 1 -- 172.21.15.6:0/2341282361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e78101820 msgr2=0x7f4e781a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e76ffd700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e78101820 0x7f4e781a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e76ffd700 1 -- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 msgr2=0x7f4e78198d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:49.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e76ffd700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 0x7f4e78198d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e76ffd700 1 -- 172.21.15.6:0/2341282361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0095f0 con 0x7f4e78100e80 2023-09-13T09:52:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e76ffd700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e78100e80 0x7f4e78199280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00eb90 tx=0x7f4e6c00eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e74ff9700 1 -- 172.21.15.6:0/2341282361 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c009970 con 0x7f4e78100e80 2023-09-13T09:52:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6800d590 con 0x7f4e78100e80 2023-09-13T09:52:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e74ff9700 1 -- 172.21.15.6:0/2341282361 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4e6c0044e0 con 0x7f4e78100e80 2023-09-13T09:52:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e74ff9700 1 -- 172.21.15.6:0/2341282361 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c003e50 con 0x7f4e78100e80 2023-09-13T09:52:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.882+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e781a11b0 con 0x7f4e78100e80 2023-09-13T09:52:49.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.883+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e78107320 con 0x7f4e78100e80 2023-09-13T09:52:49.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.885+0000 7f4e74ff9700 1 -- 172.21.15.6:0/2341282361 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4e6c003fd0 con 0x7f4e78100e80 2023-09-13T09:52:49.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.885+0000 7f4e74ff9700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4e600a0640 0x7f4e600a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:49.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.885+0000 7f4e777fe700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4e600a0640 0x7f4e600a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.886+0000 7f4e74ff9700 1 -- 172.21.15.6:0/2341282361 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4e6c014070 con 0x7f4e78100e80 2023-09-13T09:52:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.886+0000 7f4e777fe700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4e600a0640 0x7f4e600a2b00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c7f0 tx=0x7f4e6800cf40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:49.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:49.889+0000 7f4e74ff9700 1 -- 172.21.15.6:0/2341282361 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4e6c095e90 con 0x7f4e78100e80 2023-09-13T09:52:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.166+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4e7802cfc0 con 0x7f4e78100e80 2023-09-13T09:52:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.167+0000 7f4e74ff9700 1 -- 172.21.15.6:0/2341282361 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) v1 ==== 94+0+11344 (secure 0 0 0) 0x7f4e6c0994b0 con 0x7f4e78100e80 2023-09-13T09:52:50.169 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:52:50.169 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":39,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":39,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:52:49.853534+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:52:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4e600a0640 msgr2=0x7f4e600a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4e600a0640 0x7f4e600a2b00 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c7f0 tx=0x7f4e6800cf40 comp rx=0 tx=0).stop 2023-09-13T09:52:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e78100e80 msgr2=0x7f4e78199280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e78100e80 0x7f4e78199280 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c00eb90 tx=0x7f4e6c00eea0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 shutdown_connections 2023-09-13T09:52:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4e78101820 0x7f4e781a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4e600a0640 0x7f4e600a2b00 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e780ffc90 0x7f4e78198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 --2- 172.21.15.6:0/2341282361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4e78100e80 0x7f4e78199280 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 >> 172.21.15.6:0/2341282361 conn(0x7f4e780fb220 msgr2=0x7f4e78104460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 shutdown_connections 2023-09-13T09:52:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.170+0000 7f4e7de74700 1 -- 172.21.15.6:0/2341282361 wait complete. 2023-09-13T09:52:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 39 2023-09-13T09:52:50.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:52:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 -- 172.21.15.6:0/3237939204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644101850 msgr2=0x7f0644108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 --2- 172.21.15.6:0/3237939204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644101850 0x7f0644108100 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f063c00b0d0 tx=0x7f063c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 -- 172.21.15.6:0/3237939204 shutdown_connections 2023-09-13T09:52:50.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 --2- 172.21.15.6:0/3237939204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644101850 0x7f0644108100 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 --2- 172.21.15.6:0/3237939204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06440ffcc0 0x7f06441000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 --2- 172.21.15.6:0/3237939204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0644100eb0 0x7f0644101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 -- 172.21.15.6:0/3237939204 >> 172.21.15.6:0/3237939204 conn(0x7f06440fb250 msgr2=0x7f06440fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 -- 172.21.15.6:0/3237939204 shutdown_connections 2023-09-13T09:52:50.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.321+0000 7f06488ae700 1 -- 172.21.15.6:0/3237939204 wait complete. 2023-09-13T09:52:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 Processor -- start 2023-09-13T09:52:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 -- start start 2023-09-13T09:52:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06440ffcc0 0x7f0644196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644100eb0 0x7f06441970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0644101850 0x7f064419e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064419e6e0 con 0x7f0644100eb0 2023-09-13T09:52:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064419e820 con 0x7f06440ffcc0 2023-09-13T09:52:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f06488ae700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064419e9b0 con 0x7f0644101850 2023-09-13T09:52:50.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644100eb0 0x7f06441970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f064259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06440ffcc0 0x7f0644196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f064259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06440ffcc0 0x7f0644196b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35656/0 (socket says 172.21.15.6:35656) 2023-09-13T09:52:50.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f064259c700 1 -- 172.21.15.6:0/2999313680 learned_addr learned my addr 172.21.15.6:0/2999313680 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.322+0000 7f0642d9d700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0644101850 0x7f064419e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f0641d9b700 1 -- 172.21.15.6:0/2999313680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0644101850 msgr2=0x7f064419e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f0641d9b700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0644101850 0x7f064419e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f0641d9b700 1 -- 172.21.15.6:0/2999313680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06440ffcc0 msgr2=0x7f0644196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f0641d9b700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06440ffcc0 0x7f0644196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f0641d9b700 1 -- 172.21.15.6:0/2999313680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c009d00 con 0x7f0644100eb0 2023-09-13T09:52:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f0641d9b700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644100eb0 0x7f06441970a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f063800d950 tx=0x7f063800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f06337fe700 1 -- 172.21.15.6:0/2999313680 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800f890 con 0x7f0644100eb0 2023-09-13T09:52:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f06337fe700 1 -- 172.21.15.6:0/2999313680 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0638010460 con 0x7f0644100eb0 2023-09-13T09:52:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0644108ab0 con 0x7f0644100eb0 2023-09-13T09:52:50.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f06337fe700 1 -- 172.21.15.6:0/2999313680 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063800e610 con 0x7f0644100eb0 2023-09-13T09:52:50.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.323+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0644108fc0 con 0x7f0644100eb0 2023-09-13T09:52:50.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.325+0000 7f06337fe700 1 -- 172.21.15.6:0/2999313680 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f06380108d0 con 0x7f0644100eb0 2023-09-13T09:52:50.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.326+0000 7f06337fe700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f062c0a0640 0x7f062c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.326+0000 7f064259c700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f062c0a0640 0x7f062c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.326+0000 7f06337fe700 1 -- 172.21.15.6:0/2999313680 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f06380cb880 con 0x7f0644100eb0 2023-09-13T09:52:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.327+0000 7f064259c700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f062c0a0640 0x7f062c0a2b00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0634005950 tx=0x7f0634012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.327+0000 7f0654a93b80 1 Processor -- start 2023-09-13T09:52:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.327+0000 7f0654a93b80 1 -- start start 2023-09-13T09:52:50.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f8700 0x5568855f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x5568855f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x5568855f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0654a93b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556885550780 con 0x5568855f9060 2023-09-13T09:52:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0654a93b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55688554e0a0 con 0x5568855f7a00 2023-09-13T09:52:50.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0654a93b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556885549990 con 0x5568855f8700 2023-09-13T09:52:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x5568855f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f064259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f8700 0x5568855f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x5568855f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42142/0 (socket says 172.21.15.6:42142) 2023-09-13T09:52:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 -- 172.21.15.6:0/503432753 learned_addr learned my addr 172.21.15.6:0/503432753 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0642d9d700 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x5568855f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 -- 172.21.15.6:0/503432753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f8700 msgr2=0x5568855f8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f8700 0x5568855f8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 -- 172.21.15.6:0/503432753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 msgr2=0x5568855f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x5568855f7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 -- 172.21.15.6:0/503432753 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568853c9630 con 0x5568855f9060 2023-09-13T09:52:50.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0641d9b700 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x5568855f74c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f0638098d20 tx=0x7f0638098c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98770396f93fb695 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.328+0000 7f0630ff9700 1 -- 172.21.15.6:0/503432753 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063809ce50 con 0x5568855f9060 2023-09-13T09:52:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0630ff9700 1 -- 172.21.15.6:0/503432753 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f06380a1090 con 0x5568855f9060 2023-09-13T09:52:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0630ff9700 1 -- 172.21.15.6:0/503432753 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380987c0 con 0x5568855f9060 2023-09-13T09:52:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 -- 172.21.15.6:0/503432753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 msgr2=0x5568855f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x5568855f74c0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f0638098d20 tx=0x7f0638098c70 comp rx=0 tx=0).stop 2023-09-13T09:52:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 -- 172.21.15.6:0/503432753 shutdown_connections 2023-09-13T09:52:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x5568855f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f8700 0x5568855f8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 --2- 172.21.15.6:0/503432753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x5568855f74c0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 -- 172.21.15.6:0/503432753 >> 172.21.15.6:0/503432753 conn(0x556885555c80 msgr2=0x5568855f1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 -- 172.21.15.6:0/503432753 shutdown_connections 2023-09-13T09:52:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.329+0000 7f0654a93b80 1 -- 172.21.15.6:0/503432753 wait complete. 2023-09-13T09:52:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 -- start start 2023-09-13T09:52:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 Processor -- start 2023-09-13T09:52:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x556885600ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f8700 0x556885601420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568854e7bb0 con 0x5568855f8700 2023-09-13T09:52:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568854e78b0 con 0x5568855f7a00 2023-09-13T09:52:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568853cb920 con 0x5568855f9060 2023-09-13T09:52:50.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0654a93b80 10 client.0 _ll_register_callbacks cb 0x5568854e5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f8700 0x556885601420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f8700 0x556885601420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42148/0 (socket says 172.21.15.6:42148) 2023-09-13T09:52:50.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f064259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x556885600ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0641d9b700 1 -- 172.21.15.6:0/2052184917 learned_addr learned my addr 172.21.15.6:0/2052184917 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.330+0000 7f0642d9d700 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0641d9b700 1 -- 172.21.15.6:0/2052184917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 msgr2=0x556885608460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0641d9b700 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0641d9b700 1 -- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 msgr2=0x556885600ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0641d9b700 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x556885600ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0641d9b700 1 -- 172.21.15.6:0/2052184917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0644108fc0 con 0x5568855f8700 2023-09-13T09:52:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f064259c700 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x556885600ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0641d9b700 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f8700 0x556885601420 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f0638005950 tx=0x7f063809cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bceb49058263bb10 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0629ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0629ffb700 1 -- 172.21.15.6:0/2052184917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06380b1460 con 0x5568855f8700 2023-09-13T09:52:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0629ffb700 1 -- 172.21.15.6:0/2052184917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0638098580 con 0x5568855f8700 2023-09-13T09:52:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568855ea670 con 0x5568855f8700 2023-09-13T09:52:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.331+0000 7f0629ffb700 1 -- 172.21.15.6:0/2052184917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0638098740 con 0x5568855f8700 2023-09-13T09:52:50.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 10 client.18954 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5568855617a0 con 0x5568855f8700 2023-09-13T09:52:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0629ffb700 1 -- 172.21.15.6:0/2052184917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5568855ea670 con 0x5568855f8700 2023-09-13T09:52:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0629ffb700 1 -- 172.21.15.6:0/2052184917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f063809db90 con 0x5568855f8700 2023-09-13T09:52:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 10 client.18954 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 10 client.18954 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:52:50.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 20 client.18954 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55688560c7c0 0x55688560ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 4 client.18954 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:50.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.332+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556885542970 con 0x55688560c7c0 2023-09-13T09:52:50.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.333+0000 7f064259c700 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55688560c7c0 0x55688560ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.333+0000 7f064259c700 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55688560c7c0 0x55688560ebe0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f899c7728d870fbc server_cookie=95fe3a44f3508c58 in_seq=0 out_seq=0 2023-09-13T09:52:50.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.333+0000 7f0629ffb700 10 client.18954 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:50.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.334+0000 7f0629ffb700 1 -- 172.21.15.6:0/2052184917 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556885542970 con 0x55688560c7c0 2023-09-13T09:52:50.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.334+0000 7f0629ffb700 10 client.18954 handle_command_reply: tid=0 2023-09-13T09:52:50.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.334+0000 7f0654a93b80 1 client.18954 shutdown 2023-09-13T09:52:50.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.334+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f8700 msgr2=0x556885601420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.334+0000 7f0654a93b80 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f8700 0x556885601420 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f0638005950 tx=0x7f063809cec0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 shutdown_connections 2023-09-13T09:52:50.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55688560c7c0 0x55688560ebe0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0629ffb700 0 client.18954 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:50.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f7a00 0x556885600ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 --2- 172.21.15.6:0/2052184917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f8700 0x556885601420 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 >> 172.21.15.6:0/2052184917 conn(0x556885555c80 msgr2=0x5568855ec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 shutdown_connections 2023-09-13T09:52:50.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 1 -- 172.21.15.6:0/2052184917 wait complete. 2023-09-13T09:52:50.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.335+0000 7f0654a93b80 20 client.18954 trim_cache size 0 max 16384 2023-09-13T09:52:50.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 Processor -- start 2023-09-13T09:52:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 -- start start 2023-09-13T09:52:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f7a00 0x5568855f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885608420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556885600390 con 0x5568855f7a00 2023-09-13T09:52:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556885600a50 con 0x5568855f8700 2023-09-13T09:52:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0654a93b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568855f2810 con 0x5568855f9060 2023-09-13T09:52:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f064259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f7a00 0x5568855f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f064259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f7a00 0x5568855f74c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42154/0 (socket says 172.21.15.6:42154) 2023-09-13T09:52:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f064259c700 1 -- 172.21.15.6:0/3915887723 learned_addr learned my addr 172.21.15.6:0/3915887723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.349+0000 7f0641d9b700 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885608420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f0642d9d700 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f064259c700 1 -- 172.21.15.6:0/3915887723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 msgr2=0x556885608d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f064259c700 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f064259c700 1 -- 172.21.15.6:0/3915887723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 msgr2=0x556885608420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f064259c700 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885608420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f064259c700 1 -- 172.21.15.6:0/3915887723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556885375de0 con 0x5568855f7a00 2023-09-13T09:52:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f064259c700 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f7a00 0x5568855f74c0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x55688560f4e0 tx=0x7f063401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b34999587e95e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f06317fa700 1 -- 172.21.15.6:0/3915887723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063402e040 con 0x5568855f7a00 2023-09-13T09:52:50.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f06317fa700 1 -- 172.21.15.6:0/3915887723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0634016040 con 0x5568855f7a00 2023-09-13T09:52:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.350+0000 7f06317fa700 1 -- 172.21.15.6:0/3915887723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06340299f0 con 0x5568855f7a00 2023-09-13T09:52:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 -- 172.21.15.6:0/3915887723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f7a00 msgr2=0x5568855f74c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f7a00 0x5568855f74c0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x55688560f4e0 tx=0x7f063401c000 comp rx=0 tx=0).stop 2023-09-13T09:52:50.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 -- 172.21.15.6:0/3915887723 shutdown_connections 2023-09-13T09:52:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f9060 0x556885608d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f7a00 0x5568855f74c0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 --2- 172.21.15.6:0/3915887723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885608420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 -- 172.21.15.6:0/3915887723 >> 172.21.15.6:0/3915887723 conn(0x556885555c80 msgr2=0x5568855ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 -- 172.21.15.6:0/3915887723 shutdown_connections 2023-09-13T09:52:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 -- 172.21.15.6:0/3915887723 wait complete. 2023-09-13T09:52:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 -- start start 2023-09-13T09:52:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 Processor -- start 2023-09-13T09:52:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f7a00 0x5568856045b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.351+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885604af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0654a93b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x556885607940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0654a93b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556885607ef0 con 0x5568855f9060 2023-09-13T09:52:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0654a93b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556885608060 con 0x5568855f8700 2023-09-13T09:52:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0654a93b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556885608220 con 0x5568855f7a00 2023-09-13T09:52:50.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0654a93b80 10 client.0 _ll_register_callbacks cb 0x5568854e5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x556885607940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f064259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f7a00 0x5568856045b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x556885607940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42164/0 (socket says 172.21.15.6:42164) 2023-09-13T09:52:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0641d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885604af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f064259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f7a00 0x5568856045b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45214/0 (socket says 172.21.15.6:45214) 2023-09-13T09:52:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 -- 172.21.15.6:0/607545016 learned_addr learned my addr 172.21.15.6:0/607545016 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 -- 172.21.15.6:0/607545016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f7a00 msgr2=0x5568856045b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f7a00 0x5568856045b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 -- 172.21.15.6:0/607545016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 msgr2=0x556885604af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885604af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 -- 172.21.15.6:0/607545016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0634009e00 con 0x5568855f9060 2023-09-13T09:52:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0642d9d700 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x556885607940 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f063c00b0d0 tx=0x7f063c007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1092c0b4e308a5f9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0629ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0629ffb700 1 -- 172.21.15.6:0/607545016 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f063c00e040 con 0x5568855f9060 2023-09-13T09:52:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0629ffb700 1 -- 172.21.15.6:0/607545016 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f063c007800 con 0x5568855f9060 2023-09-13T09:52:50.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.352+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06380a1090 con 0x5568855f9060 2023-09-13T09:52:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0629ffb700 1 -- 172.21.15.6:0/607545016 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f063c003a00 con 0x5568855f9060 2023-09-13T09:52:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 10 client.18960 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x55688535ec60 con 0x5568855f9060 2023-09-13T09:52:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0629ffb700 1 -- 172.21.15.6:0/607545016 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f063c035080 con 0x5568855f9060 2023-09-13T09:52:50.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0629ffb700 1 -- 172.21.15.6:0/607545016 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f063c00b100 con 0x5568855f9060 2023-09-13T09:52:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 10 client.18960 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 10 client.18960 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:52:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 20 client.18960 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556885661990 0x556885663db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 4 client.18960 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:50.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556885503050 con 0x556885661990 2023-09-13T09:52:50.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.353+0000 7f064259c700 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556885661990 0x556885663db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.354+0000 7f0629ffb700 10 client.18960 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.354+0000 7f064259c700 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556885661990 0x556885663db0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=63482a542086e65d server_cookie=bed185295fb78b6b in_seq=0 out_seq=0 2023-09-13T09:52:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0629ffb700 1 -- 172.21.15.6:0/607545016 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556885503050 con 0x556885661990 2023-09-13T09:52:50.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0629ffb700 10 client.18960 handle_command_reply: tid=0 2023-09-13T09:52:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 client.18960 shutdown 2023-09-13T09:52:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 msgr2=0x556885607940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x556885607940 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f063c00b0d0 tx=0x7f063c007710 comp rx=0 tx=0).stop 2023-09-13T09:52:50.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 shutdown_connections 2023-09-13T09:52:50.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x556885661990 0x556885663db0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5568855f9060 0x556885607940 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5568855f7a00 0x5568856045b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 --2- 172.21.15.6:0/607545016 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5568855f8700 0x556885604af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.357+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 >> 172.21.15.6:0/607545016 conn(0x556885555c80 msgr2=0x5568855fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.358+0000 7f0629ffb700 0 client.18960 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:52:50.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.358+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 shutdown_connections 2023-09-13T09:52:50.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.358+0000 7f0654a93b80 1 -- 172.21.15.6:0/607545016 wait complete. 2023-09-13T09:52:50.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f0654a93b80 20 client.18960 trim_cache size 0 max 16384 2023-09-13T09:52:50.379 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f062c0a0640 msgr2=0x7f062c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f062c0a0640 0x7f062c0a2b00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f0634005950 tx=0x7f0634012040 comp rx=0 tx=0).stop 2023-09-13T09:52:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644100eb0 msgr2=0x7f06441970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644100eb0 0x7f06441970a0 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f063800d950 tx=0x7f063800dc60 comp rx=0 tx=0).stop 2023-09-13T09:52:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 shutdown_connections 2023-09-13T09:52:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0644101850 0x7f064419e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f06440ffcc0 0x7f0644196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f062c0a0640 0x7f062c0a2b00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 --2- 172.21.15.6:0/2999313680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0644100eb0 0x7f06441970a0 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 >> 172.21.15.6:0/2999313680 conn(0x7f06440fb250 msgr2=0x7f06440fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 shutdown_connections 2023-09-13T09:52:50.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.359+0000 7f06488ae700 1 -- 172.21.15.6:0/2999313680 wait complete. 2023-09-13T09:52:50.382 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:50 smithi006 ceph-mon[98665]: pgmap v699: 97 pgs: 97 active+clean; 322 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 2.6 MiB/s wr, 237 op/s 2023-09-13T09:52:50.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:52:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:50 smithi053 ceph-mon[102373]: pgmap v699: 97 pgs: 97 active+clean; 322 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 2.6 MiB/s wr, 237 op/s 2023-09-13T09:52:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:50 smithi131 ceph-mon[102785]: pgmap v699: 97 pgs: 97 active+clean; 322 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 709 KiB/s rd, 2.6 MiB/s wr, 237 op/s 2023-09-13T09:52:50.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 -- 172.21.15.6:0/1307346595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 msgr2=0x7f4aa81011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/1307346595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa81011e0 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40099c0 tx=0x7f4aa4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 -- 172.21.15.6:0/1307346595 shutdown_connections 2023-09-13T09:52:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/1307346595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa8102950 0x7f4aa8109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/1307346595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa81011e0 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/1307346595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa8101fb0 0x7f4aa8102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 -- 172.21.15.6:0/1307346595 >> 172.21.15.6:0/1307346595 conn(0x7f4aa80fc350 msgr2=0x7f4aa80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 -- 172.21.15.6:0/1307346595 shutdown_connections 2023-09-13T09:52:50.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.527+0000 7f4ab03e7700 1 -- 172.21.15.6:0/1307346595 wait complete. 2023-09-13T09:52:50.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 Processor -- start 2023-09-13T09:52:50.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 -- start start 2023-09-13T09:52:50.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa8196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa8101fb0 0x7f4aa8196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa8102950 0x7f4aa819e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa819e610 con 0x7f4aa8100dc0 2023-09-13T09:52:50.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa819e750 con 0x7f4aa8102950 2023-09-13T09:52:50.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4ab03e7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa819e8e0 con 0x7f4aa8101fb0 2023-09-13T09:52:50.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4aae183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa8196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4aad982700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa8101fb0 0x7f4aa8196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4aae183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa8196a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42174/0 (socket says 172.21.15.6:42174) 2023-09-13T09:52:50.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.528+0000 7f4aae183700 1 -- 172.21.15.6:0/3488252126 learned_addr learned my addr 172.21.15.6:0/3488252126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4aae984700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa8102950 0x7f4aa819e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4aae183700 1 -- 172.21.15.6:0/3488252126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa8101fb0 msgr2=0x7f4aa8196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4aae183700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa8101fb0 0x7f4aa8196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4aae183700 1 -- 172.21.15.6:0/3488252126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa8102950 msgr2=0x7f4aa819e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4aae183700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa8102950 0x7f4aa819e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4aae183700 1 -- 172.21.15.6:0/3488252126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40095f0 con 0x7f4aa8100dc0 2023-09-13T09:52:50.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4aae183700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa8196a90 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40058e0 tx=0x7f4aa400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3488252126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa401d070 con 0x7f4aa8100dc0 2023-09-13T09:52:50.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3488252126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4aa4005050 con 0x7f4aa8100dc0 2023-09-13T09:52:50.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa819eb60 con 0x7f4aa8100dc0 2023-09-13T09:52:50.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3488252126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4004b10 con 0x7f4aa8100dc0 2023-09-13T09:52:50.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.529+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa819ef80 con 0x7f4aa8100dc0 2023-09-13T09:52:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.532+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3488252126 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4aa40051c0 con 0x7f4aa8100dc0 2023-09-13T09:52:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.532+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a940a0640 0x7f4a940a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.532+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3488252126 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4aa40cca60 con 0x7f4aa8100dc0 2023-09-13T09:52:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.532+0000 7f4aad982700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a940a0640 0x7f4a940a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.533+0000 7f4aad982700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a940a0640 0x7f4a940a2b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009c60 tx=0x7f4a98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.533+0000 7f4abc5ccb80 1 Processor -- start 2023-09-13T09:52:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.533+0000 7f4abc5ccb80 1 -- start start 2023-09-13T09:52:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.533+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043759b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.533+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x5590437584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.533+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043758e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590436b1780 con 0x559043759700 2023-09-13T09:52:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590436af0a0 con 0x55904375a060 2023-09-13T09:52:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590436aa990 con 0x559043758a00 2023-09-13T09:52:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043759b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043759b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42182/0 (socket says 172.21.15.6:42182) 2023-09-13T09:52:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 -- 172.21.15.6:0/482808844 learned_addr learned my addr 172.21.15.6:0/482808844 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aad982700 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x5590437584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae984700 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043758e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 -- 172.21.15.6:0/482808844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 msgr2=0x559043758e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043758e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 -- 172.21.15.6:0/482808844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 msgr2=0x5590437584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x5590437584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 -- 172.21.15.6:0/482808844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55904352a630 con 0x559043759700 2023-09-13T09:52:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4aae183700 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043759b20 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4aa409a220 tx=0x7f4aa4099c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e86063f87f20678 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4a9cd82700 1 -- 172.21.15.6:0/482808844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa4094ea0 con 0x559043759700 2023-09-13T09:52:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4a9cd82700 1 -- 172.21.15.6:0/482808844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4aa409a290 con 0x559043759700 2023-09-13T09:52:50.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.534+0000 7f4a9cd82700 1 -- 172.21.15.6:0/482808844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa40986c0 con 0x559043759700 2023-09-13T09:52:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/482808844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 msgr2=0x559043759b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043759b20 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7f4aa409a220 tx=0x7f4aa4099c70 comp rx=0 tx=0).stop 2023-09-13T09:52:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/482808844 shutdown_connections 2023-09-13T09:52:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043758e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043759b20 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/482808844 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x5590437584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/482808844 >> 172.21.15.6:0/482808844 conn(0x5590436b6c80 msgr2=0x559043752f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/482808844 shutdown_connections 2023-09-13T09:52:50.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.535+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/482808844 wait complete. 2023-09-13T09:52:50.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 -- start start 2023-09-13T09:52:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 Processor -- start 2023-09-13T09:52:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x559043761b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043762090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55904375a060 0x5590437690d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559043648bb0 con 0x559043759700 2023-09-13T09:52:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590436488b0 con 0x559043758a00 2023-09-13T09:52:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904352c920 con 0x55904375a060 2023-09-13T09:52:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4abc5ccb80 10 client.0 _ll_register_callbacks cb 0x559043646680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043762090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043762090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42190/0 (socket says 172.21.15.6:42190) 2023-09-13T09:52:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aae183700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x559043761b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 -- 172.21.15.6:0/1279040419 learned_addr learned my addr 172.21.15.6:0/1279040419 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aae984700 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55904375a060 0x5590437690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 -- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55904375a060 msgr2=0x5590437690d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55904375a060 0x5590437690d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 -- 172.21.15.6:0/1279040419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 msgr2=0x559043761b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x559043761b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.536+0000 7f4aad982700 1 -- 172.21.15.6:0/1279040419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa819ef80 con 0x559043759700 2023-09-13T09:52:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4aae183700 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x559043761b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4aad982700 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043762090 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4a98005910 tx=0x7f4a980047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a1adcb3eabc480 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4a91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4a91ffb700 1 -- 172.21.15.6:0/1279040419 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98022070 con 0x559043759700 2023-09-13T09:52:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4a91ffb700 1 -- 172.21.15.6:0/1279040419 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a9801d820 con 0x559043759700 2023-09-13T09:52:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55904374b670 con 0x559043759700 2023-09-13T09:52:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4a91ffb700 1 -- 172.21.15.6:0/1279040419 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a9801d9e0 con 0x559043759700 2023-09-13T09:52:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4abc5ccb80 10 client.18972 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5590436c27a0 con 0x559043759700 2023-09-13T09:52:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4a91ffb700 1 -- 172.21.15.6:0/1279040419 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55904374b670 con 0x559043759700 2023-09-13T09:52:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4a91ffb700 1 -- 172.21.15.6:0/1279040419 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4a98031bf0 con 0x559043759700 2023-09-13T09:52:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4abc5ccb80 10 client.18972 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.537+0000 7f4abc5ccb80 10 client.18972 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:52:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.538+0000 7f4abc5ccb80 20 client.18972 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.538+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55904376d930 0x55904376fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.538+0000 7f4abc5ccb80 4 client.18972 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.538+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5590436a3970 con 0x55904376d930 2023-09-13T09:52:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.538+0000 7f4aae183700 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55904376d930 0x55904376fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.538+0000 7f4aae183700 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55904376d930 0x55904376fd50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4880c37e59434d63 server_cookie=8ccea91ff44a9f3a in_seq=0 out_seq=0 2023-09-13T09:52:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.538+0000 7f4a91ffb700 10 client.18972 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4a91ffb700 1 -- 172.21.15.6:0/1279040419 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5590436a3970 con 0x55904376d930 2023-09-13T09:52:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4a91ffb700 10 client.18972 handle_command_reply: tid=0 2023-09-13T09:52:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 client.18972 shutdown 2023-09-13T09:52:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 msgr2=0x559043762090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043762090 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f4a98005910 tx=0x7f4a980047c0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 shutdown_connections 2023-09-13T09:52:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55904376d930 0x55904376fd50 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55904375a060 0x5590437690d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x559043761b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4a91ffb700 0 client.18972 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/1279040419 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043762090 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 >> 172.21.15.6:0/1279040419 conn(0x5590436b6c80 msgr2=0x55904374d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 shutdown_connections 2023-09-13T09:52:50.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/1279040419 wait complete. 2023-09-13T09:52:50.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.539+0000 7f4abc5ccb80 20 client.18972 trim_cache size 0 max 16384 2023-09-13T09:52:50.561 INFO:tasks.workunit.client.0.smithi006.stdout: 10 4478 42.76 MB/sec warmup 10 sec latency 127.921 ms 2023-09-13T09:52:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.555+0000 7f4abc5ccb80 1 Processor -- start 2023-09-13T09:52:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.555+0000 7f4abc5ccb80 1 -- start start 2023-09-13T09:52:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.555+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x5590437584c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043759700 0x559043769090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55904375a060 0x559043761b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590437616f0 con 0x55904375a060 2023-09-13T09:52:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559043760600 con 0x559043758a00 2023-09-13T09:52:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55904376a100 con 0x559043759700 2023-09-13T09:52:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55904375a060 0x559043761b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55904375a060 0x559043761b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42198/0 (socket says 172.21.15.6:42198) 2023-09-13T09:52:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 -- 172.21.15.6:0/2835732380 learned_addr learned my addr 172.21.15.6:0/2835732380 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae183700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x5590437584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aad982700 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043759700 0x559043769090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 -- 172.21.15.6:0/2835732380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043759700 msgr2=0x559043769090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043759700 0x559043769090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 -- 172.21.15.6:0/2835732380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 msgr2=0x5590437584c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x5590437584c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 -- 172.21.15.6:0/2835732380 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590434d6de0 con 0x55904375a060 2023-09-13T09:52:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4aae984700 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55904375a060 0x559043761b10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009890 tx=0x7f4aa00098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e406eee976679e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4a9d583700 1 -- 172.21.15.6:0/2835732380 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0003c30 con 0x55904375a060 2023-09-13T09:52:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4a9d583700 1 -- 172.21.15.6:0/2835732380 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4aa000f040 con 0x55904375a060 2023-09-13T09:52:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.556+0000 7f4a9d583700 1 -- 172.21.15.6:0/2835732380 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aa0007ea0 con 0x55904375a060 2023-09-13T09:52:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2835732380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55904375a060 msgr2=0x559043761b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55904375a060 0x559043761b10 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0009890 tx=0x7f4aa00098c0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2835732380 shutdown_connections 2023-09-13T09:52:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55904375a060 0x559043761b10 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559043758a00 0x5590437584c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2835732380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043759700 0x559043769090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2835732380 >> 172.21.15.6:0/2835732380 conn(0x5590436b6c80 msgr2=0x5590437699c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2835732380 shutdown_connections 2023-09-13T09:52:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.557+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2835732380 wait complete. 2023-09-13T09:52:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 -- start start 2023-09-13T09:52:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 Processor -- start 2023-09-13T09:52:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043764ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043765530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x559043768550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559043768a90 con 0x559043759700 2023-09-13T09:52:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559043768c00 con 0x55904375a060 2023-09-13T09:52:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559043768dc0 con 0x559043758a00 2023-09-13T09:52:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4abc5ccb80 10 client.0 _ll_register_callbacks cb 0x559043646680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043765530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043765530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42202/0 (socket says 172.21.15.6:42202) 2023-09-13T09:52:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 -- 172.21.15.6:0/2919613848 learned_addr learned my addr 172.21.15.6:0/2919613848 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aae984700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x559043768550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aae183700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043764ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 -- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 msgr2=0x559043764ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043764ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 -- 172.21.15.6:0/2919613848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 msgr2=0x559043768550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x559043768550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aad982700 1 -- 172.21.15.6:0/2919613848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa0003d90 con 0x559043759700 2023-09-13T09:52:50.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.558+0000 7f4aae984700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x559043768550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:50.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4aad982700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043765530 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097c0 tx=0x7f4a98011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97635cde1b40d900 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4a91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:50.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4a91ffb700 1 -- 172.21.15.6:0/2919613848 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98037050 con 0x559043759700 2023-09-13T09:52:50.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4a91ffb700 1 -- 172.21.15.6:0/2919613848 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a98027b90 con 0x559043759700 2023-09-13T09:52:50.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4aa409a290 con 0x559043759700 2023-09-13T09:52:50.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4a91ffb700 1 -- 172.21.15.6:0/2919613848 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a98022040 con 0x559043759700 2023-09-13T09:52:50.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 10 client.18978 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5590434bfc60 con 0x559043759700 2023-09-13T09:52:50.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4a91ffb700 1 -- 172.21.15.6:0/2919613848 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4aa409a290 con 0x559043759700 2023-09-13T09:52:50.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4a91ffb700 1 -- 172.21.15.6:0/2919613848 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f4a98031610 con 0x559043759700 2023-09-13T09:52:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 10 client.18978 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 10 client.18978 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:52:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 20 client.18978 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5590437c2950 0x5590437c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 4 client.18978 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.559+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559043664050 con 0x5590437c2950 2023-09-13T09:52:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4aae183700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5590437c2950 0x5590437c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4a91ffb700 10 client.18978 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4aae183700 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5590437c2950 0x5590437c4d70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2157ed11a1bb210f server_cookie=5796c58a78ac59fa in_seq=0 out_seq=0 2023-09-13T09:52:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4a91ffb700 1 -- 172.21.15.6:0/2919613848 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559043664050 con 0x5590437c2950 2023-09-13T09:52:50.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4a91ffb700 10 client.18978 handle_command_reply: tid=0 2023-09-13T09:52:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 client.18978 shutdown 2023-09-13T09:52:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 msgr2=0x559043765530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043765530 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f4a980097c0 tx=0x7f4a98011b30 comp rx=0 tx=0).stop 2023-09-13T09:52:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 shutdown_connections 2023-09-13T09:52:50.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5590437c2950 0x5590437c4d70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55904375a060 0x559043768550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559043758a00 0x559043764ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4a91ffb700 0 client.18978 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:52:50.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 --2- 172.21.15.6:0/2919613848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559043759700 0x559043765530 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 >> 172.21.15.6:0/2919613848 conn(0x5590436b6c80 msgr2=0x559043761af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.560+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 shutdown_connections 2023-09-13T09:52:50.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4abc5ccb80 1 -- 172.21.15.6:0/2919613848 wait complete. 2023-09-13T09:52:50.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4abc5ccb80 20 client.18978 trim_cache size 0 max 16384 2023-09-13T09:52:50.587 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:50.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a940a0640 msgr2=0x7f4a940a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a940a0640 0x7f4a940a2b00 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009c60 tx=0x7f4a98009260 comp rx=0 tx=0).stop 2023-09-13T09:52:50.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 msgr2=0x7f4aa8196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa8196a90 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f4aa40058e0 tx=0x7f4aa400f690 comp rx=0 tx=0).stop 2023-09-13T09:52:50.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 shutdown_connections 2023-09-13T09:52:50.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa8102950 0x7f4aa819e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a940a0640 0x7f4a940a2b00 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa8100dc0 0x7f4aa8196a90 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 --2- 172.21.15.6:0/3488252126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa8101fb0 0x7f4aa8196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 >> 172.21.15.6:0/3488252126 conn(0x7f4aa80fc350 msgr2=0x7f4aa80fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 shutdown_connections 2023-09-13T09:52:50.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.561+0000 7f4ab03e7700 1 -- 172.21.15.6:0/3488252126 wait complete. 2023-09-13T09:52:50.591 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:52:50.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.729+0000 7f50c1772700 1 -- 172.21.15.6:0/483361839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc100eb0 msgr2=0x7f50bc101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.729+0000 7f50c1772700 1 --2- 172.21.15.6:0/483361839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc100eb0 0x7f50bc101310 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f50b00099c0 tx=0x7f50b0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 -- 172.21.15.6:0/483361839 shutdown_connections 2023-09-13T09:52:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 --2- 172.21.15.6:0/483361839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50bc101850 0x7f50bc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 --2- 172.21.15.6:0/483361839 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc0ffcc0 0x7f50bc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 --2- 172.21.15.6:0/483361839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc100eb0 0x7f50bc101310 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 -- 172.21.15.6:0/483361839 >> 172.21.15.6:0/483361839 conn(0x7f50bc0fb210 msgr2=0x7f50bc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 -- 172.21.15.6:0/483361839 shutdown_connections 2023-09-13T09:52:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 -- 172.21.15.6:0/483361839 wait complete. 2023-09-13T09:52:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.730+0000 7f50c1772700 1 Processor -- start 2023-09-13T09:52:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50c1772700 1 -- start start 2023-09-13T09:52:50.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50c1772700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50bc0ffcc0 0x7f50bc10a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50c1772700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc100eb0 0x7f50bc108c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50c1772700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc101850 0x7f50bc109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50c1772700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1098f0 con 0x7f50bc101850 2023-09-13T09:52:50.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50c1772700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc109a60 con 0x7f50bc100eb0 2023-09-13T09:52:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50c1772700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc1a0ad0 con 0x7f50bc0ffcc0 2023-09-13T09:52:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc100eb0 0x7f50bc108c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc101850 0x7f50bc109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc100eb0 0x7f50bc108c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35740/0 (socket says 172.21.15.6:35740) 2023-09-13T09:52:50.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50ba7fc700 1 -- 172.21.15.6:0/3303528981 learned_addr learned my addr 172.21.15.6:0/3303528981 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50baffd700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50bc0ffcc0 0x7f50bc10a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50bb7fe700 1 -- 172.21.15.6:0/3303528981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50bc0ffcc0 msgr2=0x7f50bc10a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50bb7fe700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50bc0ffcc0 0x7f50bc10a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50bb7fe700 1 -- 172.21.15.6:0/3303528981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc100eb0 msgr2=0x7f50bc108c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50bb7fe700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc100eb0 0x7f50bc108c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50bb7fe700 1 -- 172.21.15.6:0/3303528981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b00095f0 con 0x7f50bc101850 2023-09-13T09:52:50.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.731+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc100eb0 0x7f50bc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:50.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.732+0000 7f50bb7fe700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc101850 0x7f50bc109150 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f50b400efc0 tx=0x7f50b400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.732+0000 7f50a3fff700 1 -- 172.21.15.6:0/3303528981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b4018070 con 0x7f50bc101850 2023-09-13T09:52:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.732+0000 7f50a3fff700 1 -- 172.21.15.6:0/3303528981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50b400f040 con 0x7f50bc101850 2023-09-13T09:52:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.732+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc1a0d50 con 0x7f50bc101850 2023-09-13T09:52:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.732+0000 7f50a3fff700 1 -- 172.21.15.6:0/3303528981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b400cc30 con 0x7f50bc101850 2023-09-13T09:52:50.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.732+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc1a1250 con 0x7f50bc101850 2023-09-13T09:52:50.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.735+0000 7f50a3fff700 1 -- 172.21.15.6:0/3303528981 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f50b4003a00 con 0x7f50bc101850 2023-09-13T09:52:50.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 Processor -- start 2023-09-13T09:52:50.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 -- start start 2023-09-13T09:52:50.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da779db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da779c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da76f5780 con 0x564da779d700 2023-09-13T09:52:50.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da76f30a0 con 0x564da779ca00 2023-09-13T09:52:50.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50cd957b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da76ee990 con 0x564da779e060 2023-09-13T09:52:50.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da779db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50a3fff700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50a40a0710 0x7f50a40a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da779db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42220/0 (socket says 172.21.15.6:42220) 2023-09-13T09:52:50.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50ba7fc700 1 -- 172.21.15.6:0/2121088052 learned_addr learned my addr 172.21.15.6:0/2121088052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.736+0000 7f50baffd700 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da779c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50bb7fe700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50a40a0710 0x7f50a40a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50ba7fc700 1 -- 172.21.15.6:0/2121088052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 msgr2=0x564da779c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da779c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50ba7fc700 1 -- 172.21.15.6:0/2121088052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 msgr2=0x564da779ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50ba7fc700 1 -- 172.21.15.6:0/2121088052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564da756e630 con 0x564da779d700 2023-09-13T09:52:50.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50a3fff700 1 -- 172.21.15.6:0/3303528981 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50b40cb630 con 0x7f50bc101850 2023-09-13T09:52:50.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da779db20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f50b00095c0 tx=0x7f50b0009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af932e91116b224 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50a17fa700 1 -- 172.21.15.6:0/2121088052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b0004a30 con 0x564da779d700 2023-09-13T09:52:50.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50bb7fe700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50a40a0710 0x7f50a40a2bd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f50b40958d0 tx=0x7f50b4000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50a17fa700 1 -- 172.21.15.6:0/2121088052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50b00054e0 con 0x564da779d700 2023-09-13T09:52:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.737+0000 7f50a17fa700 1 -- 172.21.15.6:0/2121088052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b00287f0 con 0x564da779d700 2023-09-13T09:52:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 -- 172.21.15.6:0/2121088052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 msgr2=0x564da779db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da779db20 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f50b00095c0 tx=0x7f50b0009510 comp rx=0 tx=0).stop 2023-09-13T09:52:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 -- 172.21.15.6:0/2121088052 shutdown_connections 2023-09-13T09:52:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da779db20 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 --2- 172.21.15.6:0/2121088052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da779c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 -- 172.21.15.6:0/2121088052 >> 172.21.15.6:0/2121088052 conn(0x564da76fac80 msgr2=0x564da7796f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 -- 172.21.15.6:0/2121088052 shutdown_connections 2023-09-13T09:52:50.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 -- 172.21.15.6:0/2121088052 wait complete. 2023-09-13T09:52:50.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.738+0000 7f50cd957b80 1 -- start start 2023-09-13T09:52:50.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 1 Processor -- start 2023-09-13T09:52:50.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da77a6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da77ad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da768cbb0 con 0x564da779d700 2023-09-13T09:52:50.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da768c8b0 con 0x564da779ca00 2023-09-13T09:52:50.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da7570920 con 0x564da779e060 2023-09-13T09:52:50.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50cd957b80 10 client.0 _ll_register_callbacks cb 0x564da768a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da77a6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50baffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da77a6430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42230/0 (socket says 172.21.15.6:42230) 2023-09-13T09:52:50.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50baffd700 1 -- 172.21.15.6:0/1778091429 learned_addr learned my addr 172.21.15.6:0/1778091429 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da77ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50baffd700 1 -- 172.21.15.6:0/1778091429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 msgr2=0x564da77ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50baffd700 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da77ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50baffd700 1 -- 172.21.15.6:0/1778091429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 msgr2=0x564da77a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.739+0000 7f50baffd700 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50baffd700 1 -- 172.21.15.6:0/1778091429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc068cb0 con 0x564da779d700 2023-09-13T09:52:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50baffd700 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da77a6430 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0127f0 tx=0x7f50ac012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4910c6f6b4aaf84c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f509eff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f509eff5700 1 -- 172.21.15.6:0/1778091429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac017070 con 0x564da779d700 2023-09-13T09:52:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564da778f670 con 0x564da779d700 2023-09-13T09:52:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f509eff5700 1 -- 172.21.15.6:0/1778091429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50ac004050 con 0x564da779d700 2023-09-13T09:52:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f509eff5700 1 -- 172.21.15.6:0/1778091429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50ac004210 con 0x564da779d700 2023-09-13T09:52:50.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 10 client.18990 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x564da77067a0 con 0x564da779d700 2023-09-13T09:52:50.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f509eff5700 1 -- 172.21.15.6:0/1778091429 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564da778f670 con 0x564da779d700 2023-09-13T09:52:50.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f509eff5700 1 -- 172.21.15.6:0/1778091429 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f50ac00f500 con 0x564da779d700 2023-09-13T09:52:50.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 10 client.18990 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 10 client.18990 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:52:50.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 20 client.18990 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da77b1cd0 0x564da77b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.740+0000 7f50cd957b80 4 client.18990 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:50.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.741+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564da76e7970 con 0x564da77b1cd0 2023-09-13T09:52:50.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.741+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da77b1cd0 0x564da77b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.741+0000 7f509eff5700 10 client.18990 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:50.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.741+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da77b1cd0 0x564da77b40f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=47bec24e5a9364bc server_cookie=dd1e45086816c142 in_seq=0 out_seq=0 2023-09-13T09:52:50.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f509eff5700 1 -- 172.21.15.6:0/1778091429 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564da76e7970 con 0x564da77b1cd0 2023-09-13T09:52:50.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f509eff5700 10 client.18990 handle_command_reply: tid=0 2023-09-13T09:52:50.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 client.18990 shutdown 2023-09-13T09:52:50.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 msgr2=0x564da77a6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da77a6430 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0127f0 tx=0x7f50ac012b00 comp rx=0 tx=0).stop 2023-09-13T09:52:50.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 shutdown_connections 2023-09-13T09:52:50.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da77b1cd0 0x564da77b40f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779e060 0x564da77ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1778091429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779d700 0x564da77a6430 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 >> 172.21.15.6:0/1778091429 conn(0x564da76fac80 msgr2=0x564da77917f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f509eff5700 0 client.18990 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:50.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 shutdown_connections 2023-09-13T09:52:50.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 1 -- 172.21.15.6:0/1778091429 wait complete. 2023-09-13T09:52:50.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.744+0000 7f50cd957b80 20 client.18990 trim_cache size 0 max 16384 2023-09-13T09:52:50.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 Processor -- start 2023-09-13T09:52:50.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 -- start start 2023-09-13T09:52:50.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da77938e0 con 0x564da779e060 2023-09-13T09:52:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da77a3bc0 con 0x564da779ca00 2023-09-13T09:52:50.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50cd957b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da77a6fe0 con 0x564da779d700 2023-09-13T09:52:50.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50baffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.760+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35760/0 (socket says 172.21.15.6:35760) 2023-09-13T09:52:50.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50ba7fc700 1 -- 172.21.15.6:0/1648606480 learned_addr learned my addr 172.21.15.6:0/1648606480 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50baffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77ad430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45292/0 (socket says 172.21.15.6:45292) 2023-09-13T09:52:50.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50baffd700 1 -- 172.21.15.6:0/1648606480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 msgr2=0x564da779c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50baffd700 1 --2- 172.21.15.6:0/1648606480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50baffd700 1 -- 172.21.15.6:0/1648606480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 msgr2=0x564da77add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50baffd700 1 --2- 172.21.15.6:0/1648606480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77add60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50baffd700 1 -- 172.21.15.6:0/1648606480 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564da751ade0 con 0x564da779d700 2023-09-13T09:52:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50baffd700 1 --2- 172.21.15.6:0/1648606480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77ad430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0127c0 tx=0x7f50ac00fe80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe88aa6f02bbe84f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50a1ffb700 1 -- 172.21.15.6:0/1648606480 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac017070 con 0x564da779d700 2023-09-13T09:52:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50a1ffb700 1 -- 172.21.15.6:0/1648606480 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50ac02b070 con 0x564da779d700 2023-09-13T09:52:50.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.761+0000 7f50a1ffb700 1 -- 172.21.15.6:0/1648606480 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50ac0038e0 con 0x564da779d700 2023-09-13T09:52:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 -- 172.21.15.6:0/1648606480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 msgr2=0x564da77ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1648606480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77ad430 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f50ac0127c0 tx=0x7f50ac00fe80 comp rx=0 tx=0).stop 2023-09-13T09:52:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 -- 172.21.15.6:0/1648606480 shutdown_connections 2023-09-13T09:52:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1648606480 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77add60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1648606480 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da779c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 --2- 172.21.15.6:0/1648606480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77ad430 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 -- 172.21.15.6:0/1648606480 >> 172.21.15.6:0/1648606480 conn(0x564da76fac80 msgr2=0x564da77a4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 -- 172.21.15.6:0/1648606480 shutdown_connections 2023-09-13T09:52:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 -- 172.21.15.6:0/1648606480 wait complete. 2023-09-13T09:52:50.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.762+0000 7f50cd957b80 1 -- start start 2023-09-13T09:52:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 1 Processor -- start 2023-09-13T09:52:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77a9290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da77ac7f0 con 0x564da779e060 2023-09-13T09:52:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da77ac960 con 0x564da779ca00 2023-09-13T09:52:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564da77acb20 con 0x564da779d700 2023-09-13T09:52:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50cd957b80 10 client.0 _ll_register_callbacks cb 0x564da768a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50baffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35766/0 (socket says 172.21.15.6:35766) 2023-09-13T09:52:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50baffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77a9290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45300/0 (socket says 172.21.15.6:45300) 2023-09-13T09:52:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 -- 172.21.15.6:0/486198110 learned_addr learned my addr 172.21.15.6:0/486198110 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 -- 172.21.15.6:0/486198110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 msgr2=0x564da77a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 -- 172.21.15.6:0/486198110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 msgr2=0x564da77ac2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77ac2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.763+0000 7f50ba7fc700 1 -- 172.21.15.6:0/486198110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564da77067a0 con 0x564da779ca00 2023-09-13T09:52:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f50ba7fc700 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a8d50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f50b0005a40 tx=0x7f50b002c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21949fa142a62d48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f509eff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:52:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f509eff5700 1 -- 172.21.15.6:0/486198110 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b002f040 con 0x564da779ca00 2023-09-13T09:52:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f509eff5700 1 -- 172.21.15.6:0/486198110 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f50b0005210 con 0x564da779ca00 2023-09-13T09:52:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f50b00054e0 con 0x564da779ca00 2023-09-13T09:52:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f509eff5700 1 -- 172.21.15.6:0/486198110 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f50b003aa20 con 0x564da779ca00 2023-09-13T09:52:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f50cd957b80 10 client.28382 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.764+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x564da7503c60 con 0x564da779ca00 2023-09-13T09:52:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f509eff5700 1 -- 172.21.15.6:0/486198110 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f50b00054e0 con 0x564da779ca00 2023-09-13T09:52:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f509eff5700 1 -- 172.21.15.6:0/486198110 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f50b0028470 con 0x564da779ca00 2023-09-13T09:52:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f50cd957b80 10 client.28382 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f50cd957b80 10 client.28382 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:52:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f50cd957b80 20 client.28382 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f50cd957b80 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da780eab0 0x564da7810ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f50cd957b80 4 client.28382 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564da76a8050 con 0x564da780eab0 2023-09-13T09:52:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.765+0000 7f50baffd700 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da780eab0 0x564da7810ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.766+0000 7f509eff5700 10 client.28382 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.766+0000 7f50baffd700 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da780eab0 0x564da7810ed0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e398fef714b5d3fe server_cookie=5082458f6f41e329 in_seq=0 out_seq=0 2023-09-13T09:52:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.768+0000 7f509eff5700 1 -- 172.21.15.6:0/486198110 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564da76a8050 con 0x564da780eab0 2023-09-13T09:52:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.768+0000 7f509eff5700 10 client.28382 handle_command_reply: tid=0 2023-09-13T09:52:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.768+0000 7f50cd957b80 1 client.28382 shutdown 2023-09-13T09:52:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.768+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 msgr2=0x564da77a8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.768+0000 7f50cd957b80 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a8d50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f50b0005a40 tx=0x7f50b002c040 comp rx=0 tx=0).stop 2023-09-13T09:52:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 shutdown_connections 2023-09-13T09:52:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x564da780eab0 0x564da7810ed0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564da779e060 0x564da77ac2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564da779ca00 0x564da77a8d50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 --2- 172.21.15.6:0/486198110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564da779d700 0x564da77a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 >> 172.21.15.6:0/486198110 conn(0x564da76fac80 msgr2=0x564da77a3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f509eff5700 0 client.28382 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:52:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 shutdown_connections 2023-09-13T09:52:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 1 -- 172.21.15.6:0/486198110 wait complete. 2023-09-13T09:52:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50cd957b80 20 client.28382 trim_cache size 0 max 16384 2023-09-13T09:52:50.787 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:50.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50a40a0710 msgr2=0x7f50a40a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.769+0000 7f50c1772700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50a40a0710 0x7f50a40a2bd0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f50b40958d0 tx=0x7f50b4000f40 comp rx=0 tx=0).stop 2023-09-13T09:52:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc101850 msgr2=0x7f50bc109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc101850 0x7f50bc109150 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f50b400efc0 tx=0x7f50b400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 shutdown_connections 2023-09-13T09:52:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f50a40a0710 0x7f50a40a2bd0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50bc101850 0x7f50bc109150 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50bc0ffcc0 0x7f50bc10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 --2- 172.21.15.6:0/3303528981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f50bc100eb0 0x7f50bc108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 >> 172.21.15.6:0/3303528981 conn(0x7f50bc0fb210 msgr2=0x7f50bc0fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 shutdown_connections 2023-09-13T09:52:50.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.770+0000 7f50c1772700 1 -- 172.21.15.6:0/3303528981 wait complete. 2023-09-13T09:52:50.791 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:52:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 -- 172.21.15.6:0/3661493763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90100eb0 msgr2=0x7fdd90101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 --2- 172.21.15.6:0/3661493763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90100eb0 0x7fdd90101310 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7fdd840099c0 tx=0x7fdd84009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 -- 172.21.15.6:0/3661493763 shutdown_connections 2023-09-13T09:52:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 --2- 172.21.15.6:0/3661493763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd90101850 0x7fdd90108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 --2- 172.21.15.6:0/3661493763 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd900ffcc0 0x7fdd901000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 --2- 172.21.15.6:0/3661493763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd90100eb0 0x7fdd90101310 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 -- 172.21.15.6:0/3661493763 >> 172.21.15.6:0/3661493763 conn(0x7fdd900fb250 msgr2=0x7fdd900fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 -- 172.21.15.6:0/3661493763 shutdown_connections 2023-09-13T09:52:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 -- 172.21.15.6:0/3661493763 wait complete. 2023-09-13T09:52:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.931+0000 7fdd95d14700 1 Processor -- start 2023-09-13T09:52:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd95d14700 1 -- start start 2023-09-13T09:52:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd95d14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900ffcc0 0x7fdd90068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd95d14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd90100eb0 0x7fdd9019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd95d14700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd90101850 0x7fdd9019de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd95d14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9019e5c0 con 0x7fdd900ffcc0 2023-09-13T09:52:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd95d14700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9019e730 con 0x7fdd90100eb0 2023-09-13T09:52:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd95d14700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9019e8f0 con 0x7fdd90101850 2023-09-13T09:52:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900ffcc0 0x7fdd90068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900ffcc0 0x7fdd90068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42256/0 (socket says 172.21.15.6:42256) 2023-09-13T09:52:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/1040022777 learned_addr learned my addr 172.21.15.6:0/1040022777 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8effd700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd90100eb0 0x7fdd9019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd90101850 0x7fdd9019de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/1040022777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd90101850 msgr2=0x7fdd9019de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd90101850 0x7fdd9019de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/1040022777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd90100eb0 msgr2=0x7fdd9019b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd90100eb0 0x7fdd9019b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/1040022777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80009520 con 0x7fdd900ffcc0 2023-09-13T09:52:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.932+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900ffcc0 0x7fdd90068b20 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000ea50 tx=0x7fdd8000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.933+0000 7fdd8cff9700 1 -- 172.21.15.6:0/1040022777 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000eee0 con 0x7fdd900ffcc0 2023-09-13T09:52:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.933+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd88009c40 con 0x7fdd900ffcc0 2023-09-13T09:52:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.933+0000 7fdd8cff9700 1 -- 172.21.15.6:0/1040022777 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd8000cbd0 con 0x7fdd900ffcc0 2023-09-13T09:52:50.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.933+0000 7fdd8cff9700 1 -- 172.21.15.6:0/1040022777 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80018680 con 0x7fdd900ffcc0 2023-09-13T09:52:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.933+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd840095f0 con 0x7fdd900ffcc0 2023-09-13T09:52:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.935+0000 7fdd8cff9700 1 -- 172.21.15.6:0/1040022777 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdd80010430 con 0x7fdd900ffcc0 2023-09-13T09:52:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.935+0000 7fdd8cff9700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd780a0640 0x7fdd780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.936+0000 7fdd8cff9700 1 -- 172.21.15.6:0/1040022777 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd80014070 con 0x7fdd900ffcc0 2023-09-13T09:52:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.936+0000 7fdd8effd700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd780a0640 0x7fdd780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.936+0000 7fdd8effd700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd780a0640 0x7fdd780a2b00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400b580 tx=0x7fdd84005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.936+0000 7fdda1ef9b80 1 Processor -- start 2023-09-13T09:52:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.936+0000 7fdda1ef9b80 1 -- start start 2023-09-13T09:52:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df8378b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df83774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df8377e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df82d0780 con 0x556df8377a00 2023-09-13T09:52:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df82ce0a0 con 0x556df8378700 2023-09-13T09:52:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df82c9990 con 0x556df8379060 2023-09-13T09:52:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df8377e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df8377e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42268/0 (socket says 172.21.15.6:42268) 2023-09-13T09:52:50.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 -- 172.21.15.6:0/926281492 learned_addr learned my addr 172.21.15.6:0/926281492 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df8378b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8effd700 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df83774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 -- 172.21.15.6:0/926281492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 msgr2=0x556df83774c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df83774c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 -- 172.21.15.6:0/926281492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 msgr2=0x556df8378b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df8378b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 -- 172.21.15.6:0/926281492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556df8149630 con 0x556df8377a00 2023-09-13T09:52:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df8378b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:50.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df8377e80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800e730 tx=0x7fdd88009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b86626f9952bd5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd75ffb700 1 -- 172.21.15.6:0/926281492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8800e040 con 0x556df8377a00 2023-09-13T09:52:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.937+0000 7fdd75ffb700 1 -- 172.21.15.6:0/926281492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd8800f040 con 0x556df8377a00 2023-09-13T09:52:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdd75ffb700 1 -- 172.21.15.6:0/926281492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd88007500 con 0x556df8377a00 2023-09-13T09:52:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/926281492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 msgr2=0x556df8377e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df8377e80 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7fdd8800e730 tx=0x7fdd88009920 comp rx=0 tx=0).stop 2023-09-13T09:52:50.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/926281492 shutdown_connections 2023-09-13T09:52:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df8377e80 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df8378b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/926281492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df83774c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.938+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/926281492 >> 172.21.15.6:0/926281492 conn(0x556df82d5c80 msgr2=0x556df8371f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.939+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/926281492 shutdown_connections 2023-09-13T09:52:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.939+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/926281492 wait complete. 2023-09-13T09:52:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.939+0000 7fdda1ef9b80 1 -- start start 2023-09-13T09:52:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.939+0000 7fdda1ef9b80 1 Processor -- start 2023-09-13T09:52:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.939+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8377a00 0x556df8380ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.939+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df83813e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.939+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df8388420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df8267bb0 con 0x556df8378700 2023-09-13T09:52:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df82678b0 con 0x556df8377a00 2023-09-13T09:52:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df814b920 con 0x556df8379060 2023-09-13T09:52:50.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdda1ef9b80 10 client.0 _ll_register_callbacks cb 0x556df8265680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df83813e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8377a00 0x556df8380ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df83813e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42272/0 (socket says 172.21.15.6:42272) 2023-09-13T09:52:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 -- 172.21.15.6:0/967120918 learned_addr learned my addr 172.21.15.6:0/967120918 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df8388420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 -- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 msgr2=0x556df8388420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df8388420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 -- 172.21.15.6:0/967120918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8377a00 msgr2=0x556df8380ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8377a00 0x556df8380ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 -- 172.21.15.6:0/967120918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8800e410 con 0x556df8378700 2023-09-13T09:52:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8377a00 0x556df8380ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd8effd700 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df83813e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fdd840099c0 tx=0x7fdd84009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b58fb31f04496c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd6effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.940+0000 7fdd6effd700 1 -- 172.21.15.6:0/967120918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd84029050 con 0x556df8378700 2023-09-13T09:52:50.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556df836a670 con 0x556df8378700 2023-09-13T09:52:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdd6effd700 1 -- 172.21.15.6:0/967120918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd8400f460 con 0x556df8378700 2023-09-13T09:52:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdd6effd700 1 -- 172.21.15.6:0/967120918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd840059e0 con 0x556df8378700 2023-09-13T09:52:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 10 client.19008 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x556df82e17a0 con 0x556df8378700 2023-09-13T09:52:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdd6effd700 1 -- 172.21.15.6:0/967120918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd8403d020 con 0x556df8378700 2023-09-13T09:52:50.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdd6effd700 1 -- 172.21.15.6:0/967120918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fdd84022770 con 0x556df8378700 2023-09-13T09:52:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 10 client.19008 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 10 client.19008 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:52:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 20 client.19008 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df838cd70 0x556df838f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 4 client.19008 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556df82c2970 con 0x556df838cd70 2023-09-13T09:52:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.941+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df838cd70 0x556df838f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.942+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df838cd70 0x556df838f190 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e546614c4a25c148 server_cookie=b79b3374fe348858 in_seq=0 out_seq=0 2023-09-13T09:52:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.942+0000 7fdd6effd700 10 client.19008 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:50.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.942+0000 7fdd6effd700 1 -- 172.21.15.6:0/967120918 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556df82c2970 con 0x556df838cd70 2023-09-13T09:52:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.942+0000 7fdd6effd700 10 client.19008 handle_command_reply: tid=0 2023-09-13T09:52:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.942+0000 7fdda1ef9b80 1 client.19008 shutdown 2023-09-13T09:52:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 msgr2=0x556df83813e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df83813e0 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fdd840099c0 tx=0x7fdd84009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 shutdown_connections 2023-09-13T09:52:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df838cd70 0x556df838f190 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df8388420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8377a00 0x556df8380ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdd6effd700 0 client.19008 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:50.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/967120918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df83813e0 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 >> 172.21.15.6:0/967120918 conn(0x556df82d5c80 msgr2=0x556df8371ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 shutdown_connections 2023-09-13T09:52:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/967120918 wait complete. 2023-09-13T09:52:50.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.943+0000 7fdda1ef9b80 20 client.19008 trim_cache size 0 max 16384 2023-09-13T09:52:50.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 Processor -- start 2023-09-13T09:52:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 -- start start 2023-09-13T09:52:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df83774c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df83883e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df837b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df8380a10 con 0x556df8377a00 2023-09-13T09:52:50.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df8372990 con 0x556df8378700 2023-09-13T09:52:50.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.957+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df8373730 con 0x556df8379060 2023-09-13T09:52:50.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df83883e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df83774c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df83883e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35802/0 (socket says 172.21.15.6:35802) 2023-09-13T09:52:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8effd700 1 -- 172.21.15.6:0/3393304075 learned_addr learned my addr 172.21.15.6:0/3393304075 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df837b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/3393304075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 msgr2=0x556df837b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df837b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/3393304075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 msgr2=0x556df83883e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df83883e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/3393304075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556df80f5de0 con 0x556df8377a00 2023-09-13T09:52:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df83774c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fdd800c9c20 tx=0x7fdd800c9aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fcd778d1593c2be server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd767fc700 1 -- 172.21.15.6:0/3393304075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8009d6f0 con 0x556df8377a00 2023-09-13T09:52:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd767fc700 1 -- 172.21.15.6:0/3393304075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd800a1930 con 0x556df8377a00 2023-09-13T09:52:50.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.958+0000 7fdd767fc700 1 -- 172.21.15.6:0/3393304075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800a1700 con 0x556df8377a00 2023-09-13T09:52:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/3393304075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 msgr2=0x556df83774c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df83774c0 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fdd800c9c20 tx=0x7fdd800c9aa0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/3393304075 shutdown_connections 2023-09-13T09:52:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8379060 0x556df837b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8377a00 0x556df83774c0 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/3393304075 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8378700 0x556df83883e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/3393304075 >> 172.21.15.6:0/3393304075 conn(0x556df82d5c80 msgr2=0x556df837fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/3393304075 shutdown_connections 2023-09-13T09:52:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/3393304075 wait complete. 2023-09-13T09:52:50.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.959+0000 7fdda1ef9b80 1 -- start start 2023-09-13T09:52:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 1 Processor -- start 2023-09-13T09:52:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8377a00 0x556df8384560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df8384aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8379060 0x556df8387ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df8388000 con 0x556df8378700 2023-09-13T09:52:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df8388170 con 0x556df8379060 2023-09-13T09:52:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556df8388330 con 0x556df8377a00 2023-09-13T09:52:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdda1ef9b80 10 client.0 _ll_register_callbacks cb 0x556df8265680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df8384aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8377a00 0x556df8384560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df8384aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42286/0 (socket says 172.21.15.6:42286) 2023-09-13T09:52:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8effd700 1 -- 172.21.15.6:0/1351364706 learned_addr learned my addr 172.21.15.6:0/1351364706 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8379060 0x556df8387ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/1351364706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8379060 msgr2=0x556df8387ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8379060 0x556df8387ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/1351364706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 msgr2=0x556df8384aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df8384aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8f7fe700 1 -- 172.21.15.6:0/1351364706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd88009c40 con 0x556df8377a00 2023-09-13T09:52:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8effd700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df8384aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:50.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.960+0000 7fdd8ffff700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8379060 0x556df8387ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:50.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd8f7fe700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8377a00 0x556df8384560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd800b7fd0 tx=0x7fdd80099710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9b1d2b32c3c94a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:50.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd6effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:52:50.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd6effd700 1 -- 172.21.15.6:0/1351364706 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd800a16a0 con 0x556df8377a00 2023-09-13T09:52:50.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd6effd700 1 -- 172.21.15.6:0/1351364706 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd80097a00 con 0x556df8377a00 2023-09-13T09:52:50.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd8800f040 con 0x556df8377a00 2023-09-13T09:52:50.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd6effd700 1 -- 172.21.15.6:0/1351364706 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd80097c60 con 0x556df8377a00 2023-09-13T09:52:50.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 10 client.28321 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:50.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x556df80dec60 con 0x556df8377a00 2023-09-13T09:52:50.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd6effd700 1 -- 172.21.15.6:0/1351364706 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd8800f040 con 0x556df8377a00 2023-09-13T09:52:50.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd6effd700 1 -- 172.21.15.6:0/1351364706 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fdd8005fc60 con 0x556df8377a00 2023-09-13T09:52:50.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 10 client.28321 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:50.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 10 client.28321 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:52:50.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 20 client.28321 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:50.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df83e1b70 0x556df83e3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:50.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 4 client.28321 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:50.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556df8283050 con 0x556df83e1b70 2023-09-13T09:52:50.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.961+0000 7fdd8effd700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df83e1b70 0x556df83e3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:50.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdd6effd700 10 client.28321 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:50.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdd8effd700 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df83e1b70 0x556df83e3f90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e6d1a0037d7dca69 server_cookie=df5ecbf913cb183c in_seq=0 out_seq=0 2023-09-13T09:52:50.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdd6effd700 1 -- 172.21.15.6:0/1351364706 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556df8283050 con 0x556df83e1b70 2023-09-13T09:52:50.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdd6effd700 10 client.28321 handle_command_reply: tid=0 2023-09-13T09:52:50.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 client.28321 shutdown 2023-09-13T09:52:50.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8377a00 msgr2=0x556df8384560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8377a00 0x556df8384560 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd800b7fd0 tx=0x7fdd80099710 comp rx=0 tx=0).stop 2023-09-13T09:52:50.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 shutdown_connections 2023-09-13T09:52:50.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556df83e1b70 0x556df83e3f90 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556df8379060 0x556df8387ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556df8377a00 0x556df8384560 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 --2- 172.21.15.6:0/1351364706 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556df8378700 0x556df8384aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdd6effd700 0 client.28321 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:52:50.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 >> 172.21.15.6:0/1351364706 conn(0x556df82d5c80 msgr2=0x556df837b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 shutdown_connections 2023-09-13T09:52:50.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 1 -- 172.21.15.6:0/1351364706 wait complete. 2023-09-13T09:52:50.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.962+0000 7fdda1ef9b80 20 client.28321 trim_cache size 0 max 16384 2023-09-13T09:52:50.987 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd780a0640 msgr2=0x7fdd780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd780a0640 0x7fdd780a2b00 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fdd8400b580 tx=0x7fdd84005fb0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900ffcc0 msgr2=0x7fdd90068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:50.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900ffcc0 0x7fdd90068b20 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7fdd8000ea50 tx=0x7fdd8000ed60 comp rx=0 tx=0).stop 2023-09-13T09:52:50.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 shutdown_connections 2023-09-13T09:52:50.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd90101850 0x7fdd9019de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd780a0640 0x7fdd780a2b00 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd900ffcc0 0x7fdd90068b20 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 --2- 172.21.15.6:0/1040022777 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd90100eb0 0x7fdd9019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 >> 172.21.15.6:0/1040022777 conn(0x7fdd900fb250 msgr2=0x7fdd900fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 shutdown_connections 2023-09-13T09:52:50.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:50.963+0000 7fdd95d14700 1 -- 172.21.15.6:0/1040022777 wait complete. 2023-09-13T09:52:50.991 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:52:51.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 -- 172.21.15.6:0/2903065921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c1029f0 msgr2=0x7f651c1092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 --2- 172.21.15.6:0/2903065921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c1029f0 0x7f651c1092a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f651400b0a0 tx=0x7f651400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 -- 172.21.15.6:0/2903065921 shutdown_connections 2023-09-13T09:52:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 --2- 172.21.15.6:0/2903065921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c1029f0 0x7f651c1092a0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 --2- 172.21.15.6:0/2903065921 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f651c0ff080 0x7f651c0ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 --2- 172.21.15.6:0/2903065921 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f651c102050 0x7f651c1024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 -- 172.21.15.6:0/2903065921 >> 172.21.15.6:0/2903065921 conn(0x7f651c0fa9b0 msgr2=0x7f651c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 -- 172.21.15.6:0/2903065921 shutdown_connections 2023-09-13T09:52:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.131+0000 7f65236ec700 1 -- 172.21.15.6:0/2903065921 wait complete. 2023-09-13T09:52:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 Processor -- start 2023-09-13T09:52:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 -- start start 2023-09-13T09:52:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c0ff080 0x7f651c1019c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f651c102050 0x7f651c100000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f651c1029f0 0x7f651c100540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c100ce0 con 0x7f651c0ff080 2023-09-13T09:52:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c100e50 con 0x7f651c102050 2023-09-13T09:52:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f65236ec700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f651c1a0ba0 con 0x7f651c1029f0 2023-09-13T09:52:51.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c0ff080 0x7f651c1019c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c0ff080 0x7f651c1019c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42298/0 (socket says 172.21.15.6:42298) 2023-09-13T09:52:51.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 -- 172.21.15.6:0/2221727861 learned_addr learned my addr 172.21.15.6:0/2221727861 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:51.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6520c87700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f651c102050 0x7f651c100000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521c89700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f651c1029f0 0x7f651c100540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 -- 172.21.15.6:0/2221727861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f651c1029f0 msgr2=0x7f651c100540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f651c1029f0 0x7f651c100540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 -- 172.21.15.6:0/2221727861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f651c102050 msgr2=0x7f651c100000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f651c102050 0x7f651c100000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 -- 172.21.15.6:0/2221727861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6514009d00 con 0x7f651c0ff080 2023-09-13T09:52:51.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521c89700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f651c1029f0 0x7f651c100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:51.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.132+0000 7f6521488700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c0ff080 0x7f651c1019c0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f651800e970 tx=0x7f651800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:51.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.133+0000 7f65127fc700 1 -- 172.21.15.6:0/2221727861 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518009790 con 0x7f651c0ff080 2023-09-13T09:52:51.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.133+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f651c1a0e80 con 0x7f651c0ff080 2023-09-13T09:52:51.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.133+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f651c1a1300 con 0x7f651c0ff080 2023-09-13T09:52:51.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.133+0000 7f65127fc700 1 -- 172.21.15.6:0/2221727861 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f651800eec0 con 0x7f651c0ff080 2023-09-13T09:52:51.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.133+0000 7f65127fc700 1 -- 172.21.15.6:0/2221727861 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518003cf0 con 0x7f651c0ff080 2023-09-13T09:52:51.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.135+0000 7f65127fc700 1 -- 172.21.15.6:0/2221727861 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f651800ccd0 con 0x7f651c0ff080 2023-09-13T09:52:51.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.136+0000 7f65127fc700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65080a0640 0x7f65080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.136+0000 7f65127fc700 1 -- 172.21.15.6:0/2221727861 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6518014070 con 0x7f651c0ff080 2023-09-13T09:52:51.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f6520c87700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65080a0640 0x7f65080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 Processor -- start 2023-09-13T09:52:51.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 -- start start 2023-09-13T09:52:51.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f6520c87700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65080a0640 0x7f65080a2b00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f650c009c60 tx=0x7f650c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:51.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab7bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab7a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab7ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555baad3780 con 0x5555bab7c060 2023-09-13T09:52:51.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555baad10a0 con 0x5555bab7b700 2023-09-13T09:52:51.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.137+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555baacc990 con 0x5555bab7aa00 2023-09-13T09:52:51.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab7a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab7a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42306/0 (socket says 172.21.15.6:42306) 2023-09-13T09:52:51.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 -- 172.21.15.6:0/4258121156 learned_addr learned my addr 172.21.15.6:0/4258121156 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:51.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6521c89700 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab7ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6521488700 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab7bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 -- 172.21.15.6:0/4258121156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 msgr2=0x5555bab7ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab7ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 -- 172.21.15.6:0/4258121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 msgr2=0x5555bab7bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab7bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 -- 172.21.15.6:0/4258121156 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555ba94c630 con 0x5555bab7c060 2023-09-13T09:52:51.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f6520c87700 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab7a4c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f650c00e4e0 tx=0x7f650c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78cd211de33fb0d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:51.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f65077fe700 1 -- 172.21.15.6:0/4258121156 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c00ee00 con 0x5555bab7c060 2023-09-13T09:52:51.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f65077fe700 1 -- 172.21.15.6:0/4258121156 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f650c021070 con 0x5555bab7c060 2023-09-13T09:52:51.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.138+0000 7f65077fe700 1 -- 172.21.15.6:0/4258121156 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c01d810 con 0x5555bab7c060 2023-09-13T09:52:51.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 -- 172.21.15.6:0/4258121156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 msgr2=0x5555bab7a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab7a4c0 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f650c00e4e0 tx=0x7f650c014000 comp rx=0 tx=0).stop 2023-09-13T09:52:51.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 -- 172.21.15.6:0/4258121156 shutdown_connections 2023-09-13T09:52:51.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab7ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab7bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/4258121156 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab7a4c0 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 -- 172.21.15.6:0/4258121156 >> 172.21.15.6:0/4258121156 conn(0x5555baad8c80 msgr2=0x5555bab74f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 -- 172.21.15.6:0/4258121156 shutdown_connections 2023-09-13T09:52:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.139+0000 7f652f8d1b80 1 -- 172.21.15.6:0/4258121156 wait complete. 2023-09-13T09:52:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 -- start start 2023-09-13T09:52:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 Processor -- start 2023-09-13T09:52:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7aa00 0x5555bab83ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7b700 0x5555bab84420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab8b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555baa6abb0 con 0x5555bab7c060 2023-09-13T09:52:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555baa6a8b0 con 0x5555bab7aa00 2023-09-13T09:52:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555ba94e920 con 0x5555bab7b700 2023-09-13T09:52:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f652f8d1b80 10 client.0 _ll_register_callbacks cb 0x5555baa68680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f6520c87700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7b700 0x5555bab84420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f6521488700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7aa00 0x5555bab83ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f6520c87700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7b700 0x5555bab84420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45368/0 (socket says 172.21.15.6:45368) 2023-09-13T09:52:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f6520c87700 1 -- 172.21.15.6:0/3775386588 learned_addr learned my addr 172.21.15.6:0/3775386588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.140+0000 7f6521c89700 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab8b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6521488700 1 -- 172.21.15.6:0/3775386588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7b700 msgr2=0x5555bab84420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6521488700 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7b700 0x5555bab84420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6521488700 1 -- 172.21.15.6:0/3775386588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 msgr2=0x5555bab8b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6521488700 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab8b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6521488700 1 -- 172.21.15.6:0/3775386588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f650c017070 con 0x5555bab7aa00 2023-09-13T09:52:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6520c87700 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7b700 0x5555bab84420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6521488700 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7aa00 0x5555bab83ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f65180c9950 tx=0x7f6518099cf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=276d5b335b48217b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:52:51.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6504ff9700 1 -- 172.21.15.6:0/3775386588 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651809d420 con 0x5555bab7aa00 2023-09-13T09:52:51.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f6504ff9700 1 -- 172.21.15.6:0/3775386588 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6518082e40 con 0x5555bab7aa00 2023-09-13T09:52:51.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.141+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555bab6d670 con 0x5555bab7aa00 2023-09-13T09:52:51.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f6504ff9700 1 -- 172.21.15.6:0/3775386588 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65180a1660 con 0x5555bab7aa00 2023-09-13T09:52:51.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 10 client.28412 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:51.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5555baae47a0 con 0x5555bab7aa00 2023-09-13T09:52:51.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f6504ff9700 1 -- 172.21.15.6:0/3775386588 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5555bab6d670 con 0x5555bab7aa00 2023-09-13T09:52:51.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f6504ff9700 1 -- 172.21.15.6:0/3775386588 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f6518065150 con 0x5555bab7aa00 2023-09-13T09:52:51.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 10 client.28412 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:51.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 10 client.28412 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 20 client.28412 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555bab920c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 4 client.28412 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555baac5970 con 0x5555bab8fca0 2023-09-13T09:52:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.142+0000 7f6520c87700 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555bab920c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.143+0000 7f6504ff9700 10 client.28412 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.143+0000 7f6520c87700 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555bab920c0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0c57d67a844f8ee server_cookie=f6b5502a9872bafb in_seq=0 out_seq=0 2023-09-13T09:52:51.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f6504ff9700 1 -- 172.21.15.6:0/3775386588 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5555baac5970 con 0x5555bab8fca0 2023-09-13T09:52:51.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f6504ff9700 10 client.28412 handle_command_reply: tid=0 2023-09-13T09:52:51.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 client.28412 shutdown 2023-09-13T09:52:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7aa00 msgr2=0x5555bab83ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7aa00 0x5555bab83ee0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f65180c9950 tx=0x7f6518099cf0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 shutdown_connections 2023-09-13T09:52:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555bab920c0 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7c060 0x5555bab8b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f6504ff9700 0 client.28412 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7aa00 0x5555bab83ee0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3775386588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7b700 0x5555bab84420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 >> 172.21.15.6:0/3775386588 conn(0x5555baad8c80 msgr2=0x5555bab6f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.146+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 shutdown_connections 2023-09-13T09:52:51.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.147+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3775386588 wait complete. 2023-09-13T09:52:51.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.147+0000 7f652f8d1b80 20 client.28412 trim_cache size 0 max 16384 2023-09-13T09:52:51.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 Processor -- start 2023-09-13T09:52:51.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 -- start start 2023-09-13T09:52:51.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7aa00 0x5555bab7a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab8b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7c060 0x5555bab7e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bab8d120 con 0x5555bab7aa00 2023-09-13T09:52:51.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bab718e0 con 0x5555bab7b700 2023-09-13T09:52:51.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.160+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bab81ab0 con 0x5555bab7c060 2023-09-13T09:52:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7aa00 0x5555bab7a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7aa00 0x5555bab7a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42320/0 (socket says 172.21.15.6:42320) 2023-09-13T09:52:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 -- 172.21.15.6:0/2034332549 learned_addr learned my addr 172.21.15.6:0/2034332549 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6520c87700 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab8b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521c89700 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7c060 0x5555bab7e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 -- 172.21.15.6:0/2034332549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7c060 msgr2=0x5555bab7e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7c060 0x5555bab7e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 -- 172.21.15.6:0/2034332549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 msgr2=0x5555bab8b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab8b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 -- 172.21.15.6:0/2034332549 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555ba8f8de0 con 0x5555bab7aa00 2023-09-13T09:52:51.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6521488700 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7aa00 0x5555bab7a4c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f6518099580 tx=0x7f6518099770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f3911739a7007b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6507fff700 1 -- 172.21.15.6:0/2034332549 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6518099d60 con 0x5555bab7aa00 2023-09-13T09:52:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6507fff700 1 -- 172.21.15.6:0/2034332549 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6518098d90 con 0x5555bab7aa00 2023-09-13T09:52:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.161+0000 7f6507fff700 1 -- 172.21.15.6:0/2034332549 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65180a11d0 con 0x5555bab7aa00 2023-09-13T09:52:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 -- 172.21.15.6:0/2034332549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7aa00 msgr2=0x5555bab7a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7aa00 0x5555bab7a4c0 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f6518099580 tx=0x7f6518099770 comp rx=0 tx=0).stop 2023-09-13T09:52:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 -- 172.21.15.6:0/2034332549 shutdown_connections 2023-09-13T09:52:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7c060 0x5555bab7e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7aa00 0x5555bab7a4c0 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/2034332549 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7b700 0x5555bab8b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 -- 172.21.15.6:0/2034332549 >> 172.21.15.6:0/2034332549 conn(0x5555baad8c80 msgr2=0x5555bab81d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 -- 172.21.15.6:0/2034332549 shutdown_connections 2023-09-13T09:52:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 -- 172.21.15.6:0/2034332549 wait complete. 2023-09-13T09:52:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 -- start start 2023-09-13T09:52:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.162+0000 7f652f8d1b80 1 Processor -- start 2023-09-13T09:52:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab87380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7b700 0x5555bab878c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f652f8d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7c060 0x5555bab8a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bab8ae20 con 0x5555bab7b700 2023-09-13T09:52:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bab8af90 con 0x5555bab7c060 2023-09-13T09:52:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f652f8d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555bab8b150 con 0x5555bab7aa00 2023-09-13T09:52:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f652f8d1b80 10 client.0 _ll_register_callbacks cb 0x5555baa68680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7b700 0x5555bab878c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7b700 0x5555bab878c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42328/0 (socket says 172.21.15.6:42328) 2023-09-13T09:52:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6521488700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab87380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6521c89700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7c060 0x5555bab8a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 -- 172.21.15.6:0/3972309952 learned_addr learned my addr 172.21.15.6:0/3972309952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 -- 172.21.15.6:0/3972309952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 msgr2=0x5555bab87380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab87380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 -- 172.21.15.6:0/3972309952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7c060 msgr2=0x5555bab8a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7c060 0x5555bab8a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.163+0000 7f6520c87700 1 -- 172.21.15.6:0/3972309952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555baae47a0 con 0x5555bab7b700 2023-09-13T09:52:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f6520c87700 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7b700 0x5555bab878c0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f650c00e4b0 tx=0x7f650c009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d59813d092a97b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f6504ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f6504ff9700 1 -- 172.21.15.6:0/3972309952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650c005b40 con 0x5555bab7b700 2023-09-13T09:52:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f6504ff9700 1 -- 172.21.15.6:0/3972309952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f650c033a90 con 0x5555bab7b700 2023-09-13T09:52:51.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555baa86050 con 0x5555bab7b700 2023-09-13T09:52:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f6504ff9700 1 -- 172.21.15.6:0/3972309952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f650c033c50 con 0x5555bab7b700 2023-09-13T09:52:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 10 client.19032 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x5555ba8e1c60 con 0x5555bab7b700 2023-09-13T09:52:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f6504ff9700 1 -- 172.21.15.6:0/3972309952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5555baa86050 con 0x5555bab7b700 2023-09-13T09:52:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f6504ff9700 1 -- 172.21.15.6:0/3972309952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f650c03a060 con 0x5555bab7b700 2023-09-13T09:52:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 10 client.19032 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 10 client.19032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 20 client.19032 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555babe6c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:51.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 4 client.19032 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:52:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.164+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5555ba919f70 con 0x5555bab8fca0 2023-09-13T09:52:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.165+0000 7f6521488700 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555babe6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.165+0000 7f6521488700 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555babe6c00 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e25a1fc98c550710 server_cookie=c05355b93cf7c83e in_seq=0 out_seq=0 2023-09-13T09:52:51.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.165+0000 7f6504ff9700 10 client.19032 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:51.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.169+0000 7f6504ff9700 1 -- 172.21.15.6:0/3972309952 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5555ba919f70 con 0x5555bab8fca0 2023-09-13T09:52:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.169+0000 7f6504ff9700 10 client.19032 handle_command_reply: tid=0 2023-09-13T09:52:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.169+0000 7f652f8d1b80 1 client.19032 shutdown 2023-09-13T09:52:51.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7b700 msgr2=0x5555bab878c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7b700 0x5555bab878c0 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f650c00e4b0 tx=0x7f650c009e50 comp rx=0 tx=0).stop 2023-09-13T09:52:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 shutdown_connections 2023-09-13T09:52:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5555bab7c060 0x5555bab8a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5555bab7aa00 0x5555bab87380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5555bab8fca0 0x5555babe6c00 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 --2- 172.21.15.6:0/3972309952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5555bab7b700 0x5555bab878c0 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f6504ff9700 0 client.19032 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 >> 172.21.15.6:0/3972309952 conn(0x5555baad8c80 msgr2=0x5555bab7e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 shutdown_connections 2023-09-13T09:52:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 1 -- 172.21.15.6:0/3972309952 wait complete. 2023-09-13T09:52:51.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f652f8d1b80 20 client.19032 trim_cache size 0 max 16384 2023-09-13T09:52:51.188 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:52:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65080a0640 msgr2=0x7f65080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65080a0640 0x7f65080a2b00 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f650c009c60 tx=0x7f650c009260 comp rx=0 tx=0).stop 2023-09-13T09:52:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c0ff080 msgr2=0x7f651c1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c0ff080 0x7f651c1019c0 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7f651800e970 tx=0x7f651800ec80 comp rx=0 tx=0).stop 2023-09-13T09:52:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 shutdown_connections 2023-09-13T09:52:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f651c1029f0 0x7f651c100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65080a0640 0x7f65080a2b00 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f651c0ff080 0x7f651c1019c0 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 --2- 172.21.15.6:0/2221727861 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f651c102050 0x7f651c100000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.170+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 >> 172.21.15.6:0/2221727861 conn(0x7f651c0fa9b0 msgr2=0x7f651c0fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.171+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 shutdown_connections 2023-09-13T09:52:51.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:51.171+0000 7f65236ec700 1 -- 172.21.15.6:0/2221727861 wait complete. 2023-09-13T09:52:51.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:51 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:51.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:51 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2341282361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:52:51.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:51 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:51.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:51 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2341282361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:52:51.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:51 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:51.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:51 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2341282361' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:52:51.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 4939 40.35 MB/sec warmup 11 sec latency 68.954 ms 2023-09-13T09:52:52.193 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:52:52.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:52:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/795280983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 msgr2=0x7fa2ec1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/795280983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec1000f0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80099c0 tx=0x7fa2e8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/795280983 shutdown_connections 2023-09-13T09:52:52.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/795280983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ec101860 0x7fa2ec108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/795280983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec1000f0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/795280983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2ec100ec0 0x7fa2ec101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/795280983 >> 172.21.15.6:0/795280983 conn(0x7fa2ec0fb280 msgr2=0x7fa2ec0fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/795280983 shutdown_connections 2023-09-13T09:52:52.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.345+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/795280983 wait complete. 2023-09-13T09:52:52.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 Processor -- start 2023-09-13T09:52:52.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 -- start start 2023-09-13T09:52:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec103c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2ec100ec0 0x7fa2ec1022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ec101860 0x7fa2ec1027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec102f80 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1030f0 con 0x7fa2ec101860 2023-09-13T09:52:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.346+0000 7fa2f3d9c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec1a0af0 con 0x7fa2ec100ec0 2023-09-13T09:52:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec103c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec103c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42340/0 (socket says 172.21.15.6:42340) 2023-09-13T09:52:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 -- 172.21.15.6:0/2765606230 learned_addr learned my addr 172.21.15.6:0/2765606230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f2339700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ec101860 0x7fa2ec1027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1337700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2ec100ec0 0x7fa2ec1022a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 -- 172.21.15.6:0/2765606230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2ec100ec0 msgr2=0x7fa2ec1022a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2ec100ec0 0x7fa2ec1022a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 -- 172.21.15.6:0/2765606230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ec101860 msgr2=0x7fa2ec1027e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ec101860 0x7fa2ec1027e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 -- 172.21.15.6:0/2765606230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80095f0 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1337700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2ec100ec0 0x7fa2ec1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec103c60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009fd0 tx=0x7fa2e8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/2765606230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e801d070 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec1a0d70 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/2765606230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2e8005030 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.347+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/2765606230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8004b30 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.348+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec1a11a0 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.350+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/2765606230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa2e80051a0 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.351+0000 7fa2e2ffd700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa2d80a0640 0x7fa2d80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.351+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/2765606230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2e80cc9c0 con 0x7fa2ec0ffcd0 2023-09-13T09:52:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.351+0000 7fa2f1337700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa2d80a0640 0x7fa2d80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.352+0000 7fa2f1337700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa2d80a0640 0x7fa2d80a2b00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009cb0 tx=0x7fa2dc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.352+0000 7fa2fff81b80 1 Processor -- start 2023-09-13T09:52:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2fff81b80 1 -- start start 2023-09-13T09:52:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26607780 0x564b26607ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26606540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26606f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2655f800 con 0x564b26606a80 2023-09-13T09:52:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2655d120 con 0x564b266080e0 2023-09-13T09:52:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b26558a10 con 0x564b26607780 2023-09-13T09:52:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26606f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26606f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42352/0 (socket says 172.21.15.6:42352) 2023-09-13T09:52:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 -- 172.21.15.6:0/3868902011 learned_addr learned my addr 172.21.15.6:0/3868902011 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f1337700 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26606540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26607780 0x564b26607ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 -- 172.21.15.6:0/3868902011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26607780 msgr2=0x564b26607ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26607780 0x564b26607ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 -- 172.21.15.6:0/3868902011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 msgr2=0x564b26606540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26606540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f2339700 1 -- 172.21.15.6:0/3868902011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b263d86b0 con 0x564b26606a80 2023-09-13T09:52:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.353+0000 7fa2f1337700 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26606540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:52:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.354+0000 7fa2f2339700 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26606f00 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4011600 tx=0x7fa2e4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca24af3f344b450c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.354+0000 7fa2d7fff700 1 -- 172.21.15.6:0/3868902011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400e040 con 0x564b26606a80 2023-09-13T09:52:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.354+0000 7fa2d7fff700 1 -- 172.21.15.6:0/3868902011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2e400f040 con 0x564b26606a80 2023-09-13T09:52:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.354+0000 7fa2d7fff700 1 -- 172.21.15.6:0/3868902011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4004800 con 0x564b26606a80 2023-09-13T09:52:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.354+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3868902011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 msgr2=0x564b26606f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.354+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26606f00 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4011600 tx=0x7fa2e4009920 comp rx=0 tx=0).stop 2023-09-13T09:52:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3868902011 shutdown_connections 2023-09-13T09:52:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26606f00 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26607780 0x564b26607ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3868902011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26606540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3868902011 >> 172.21.15.6:0/3868902011 conn(0x564b26564d00 msgr2=0x564b26600f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3868902011 shutdown_connections 2023-09-13T09:52:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3868902011 wait complete. 2023-09-13T09:52:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 -- start start 2023-09-13T09:52:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 Processor -- start 2023-09-13T09:52:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.355+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26606a80 0x564b2660ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26610500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26617540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b264f6c30 con 0x564b26607780 2023-09-13T09:52:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b264f6930 con 0x564b26606a80 2023-09-13T09:52:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b263da9a0 con 0x564b266080e0 2023-09-13T09:52:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2fff81b80 10 client.0 _ll_register_callbacks cb 0x564b264f4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26610500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26610500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42356/0 (socket says 172.21.15.6:42356) 2023-09-13T09:52:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 -- 172.21.15.6:0/1160168812 learned_addr learned my addr 172.21.15.6:0/1160168812 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26606a80 0x564b2660ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f2339700 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26617540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 -- 172.21.15.6:0/1160168812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 msgr2=0x564b26617540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26617540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 -- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26606a80 msgr2=0x564b2660ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26606a80 0x564b2660ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 -- 172.21.15.6:0/1160168812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e40112b0 con 0x564b26607780 2023-09-13T09:52:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2f1337700 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26610500 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc003930 tx=0x7fa2dc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87ce1b55b9927ad server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2d57fa700 1 -- 172.21.15.6:0/1160168812 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2dc012650 con 0x564b26607780 2023-09-13T09:52:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2d57fa700 1 -- 172.21.15.6:0/1160168812 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2dc018030 con 0x564b26607780 2023-09-13T09:52:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.356+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b265f96f0 con 0x564b26607780 2023-09-13T09:52:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2d57fa700 1 -- 172.21.15.6:0/1160168812 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2dc004570 con 0x564b26607780 2023-09-13T09:52:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 10 client.19044 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x564b26570820 con 0x564b26607780 2023-09-13T09:52:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2d57fa700 1 -- 172.21.15.6:0/1160168812 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564b265f96f0 con 0x564b26607780 2023-09-13T09:52:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2d57fa700 1 -- 172.21.15.6:0/1160168812 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa2dc026020 con 0x564b26607780 2023-09-13T09:52:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 10 client.19044 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 10 client.19044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 20 client.19044 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2661be70 0x564b2661e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 4 client.19044 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b265519f0 con 0x564b2661be70 2023-09-13T09:52:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.357+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2661be70 0x564b2661e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.358+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2661be70 0x564b2661e290 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d35747f8c112a240 server_cookie=6063d13570ea436f in_seq=0 out_seq=0 2023-09-13T09:52:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.358+0000 7fa2d57fa700 10 client.19044 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2d57fa700 1 -- 172.21.15.6:0/1160168812 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564b265519f0 con 0x564b2661be70 2023-09-13T09:52:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2d57fa700 10 client.19044 handle_command_reply: tid=0 2023-09-13T09:52:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 client.19044 shutdown 2023-09-13T09:52:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 msgr2=0x564b26610500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26610500 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc003930 tx=0x7fa2dc0047c0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 shutdown_connections 2023-09-13T09:52:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26617540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26606a80 0x564b2660ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2661be70 0x564b2661e290 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/1160168812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26610500 unknown :-1 s=CLOSED pgs=1388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2d57fa700 0 client.19044 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 >> 172.21.15.6:0/1160168812 conn(0x564b26564d00 msgr2=0x564b26600f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 shutdown_connections 2023-09-13T09:52:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 1 -- 172.21.15.6:0/1160168812 wait complete. 2023-09-13T09:52:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.360+0000 7fa2fff81b80 20 client.19044 trim_cache size 0 max 16384 2023-09-13T09:52:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 Processor -- start 2023-09-13T09:52:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 -- start start 2023-09-13T09:52:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26606a80 0x564b265fb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26617460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26605c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b266179a0 con 0x564b26607780 2023-09-13T09:52:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b266027b0 con 0x564b266080e0 2023-09-13T09:52:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2660dbc0 con 0x564b26606a80 2023-09-13T09:52:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2f1b38700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26606a80 0x564b265fb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2f1b38700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26606a80 0x564b265fb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45416/0 (socket says 172.21.15.6:45416) 2023-09-13T09:52:52.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2f2339700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26605c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.382+0000 7fa2f1b38700 1 -- 172.21.15.6:0/3378691740 learned_addr learned my addr 172.21.15.6:0/3378691740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2f1b38700 1 -- 172.21.15.6:0/3378691740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 msgr2=0x564b26605c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/3378691740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26605c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2f1b38700 1 -- 172.21.15.6:0/3378691740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 msgr2=0x564b26617460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/3378691740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26617460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2f1b38700 1 -- 172.21.15.6:0/3378691740 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b26601230 con 0x564b26606a80 2023-09-13T09:52:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/3378691740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26606a80 0x564b265fb970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8099ef0 tx=0x7fa2e80ca340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5b8f37b6c11ffea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2e0ff9700 1 -- 172.21.15.6:0/3378691740 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e80ca580 con 0x564b26606a80 2023-09-13T09:52:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2e0ff9700 1 -- 172.21.15.6:0/3378691740 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2e80a00b0 con 0x564b26606a80 2023-09-13T09:52:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.383+0000 7fa2e0ff9700 1 -- 172.21.15.6:0/3378691740 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e809a450 con 0x564b26606a80 2023-09-13T09:52:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.384+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3378691740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26606a80 msgr2=0x564b265fb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.384+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3378691740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26606a80 0x564b265fb970 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8099ef0 tx=0x7fa2e80ca340 comp rx=0 tx=0).stop 2023-09-13T09:52:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.384+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3378691740 shutdown_connections 2023-09-13T09:52:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.384+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3378691740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b266080e0 0x564b26605c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.384+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3378691740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b26606a80 0x564b265fb970 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.384+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/3378691740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26607780 0x564b26617460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.384+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3378691740 >> 172.21.15.6:0/3378691740 conn(0x564b26564d00 msgr2=0x564b26605530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.385+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3378691740 shutdown_connections 2023-09-13T09:52:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.385+0000 7fa2fff81b80 1 -- 172.21.15.6:0/3378691740 wait complete. 2023-09-13T09:52:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.385+0000 7fa2fff81b80 1 -- start start 2023-09-13T09:52:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.385+0000 7fa2fff81b80 1 Processor -- start 2023-09-13T09:52:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26614800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26607780 0x564b26614d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2fff81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26615d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b26616290 con 0x564b26606a80 2023-09-13T09:52:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b26616400 con 0x564b26607780 2023-09-13T09:52:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2fff81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b266165c0 con 0x564b266080e0 2023-09-13T09:52:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2fff81b80 10 client.0 _ll_register_callbacks cb 0x564b264f4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2f1337700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26607780 0x564b26614d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2f1337700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26607780 0x564b26614d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35892/0 (socket says 172.21.15.6:35892) 2023-09-13T09:52:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2f1337700 1 -- 172.21.15.6:0/2768507560 learned_addr learned my addr 172.21.15.6:0/2768507560 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.386+0000 7fa2f2339700 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26615d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2f2339700 1 -- 172.21.15.6:0/2768507560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26607780 msgr2=0x564b26614d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2f2339700 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26607780 0x564b26614d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2f2339700 1 -- 172.21.15.6:0/2768507560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 msgr2=0x564b26614800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2f2339700 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26614800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2f2339700 1 -- 172.21.15.6:0/2768507560 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec1a11a0 con 0x564b266080e0 2023-09-13T09:52:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2f2339700 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26615d50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4004450 tx=0x7fa2e40041e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=425b81a481cbf1b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2d57fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:52:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2d57fa700 1 -- 172.21.15.6:0/2768507560 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e400e040 con 0x564b266080e0 2023-09-13T09:52:52.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2d57fa700 1 -- 172.21.15.6:0/2768507560 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa2e4007500 con 0x564b266080e0 2023-09-13T09:52:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.387+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa2e400f040 con 0x564b266080e0 2023-09-13T09:52:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2d57fa700 1 -- 172.21.15.6:0/2768507560 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2e40076c0 con 0x564b266080e0 2023-09-13T09:52:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 10 client.28357 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x564b26384e60 con 0x564b266080e0 2023-09-13T09:52:52.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2d57fa700 1 -- 172.21.15.6:0/2768507560 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa2e400f040 con 0x564b266080e0 2023-09-13T09:52:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2d57fa700 1 -- 172.21.15.6:0/2768507560 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7fa2e40049e0 con 0x564b266080e0 2023-09-13T09:52:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 10 client.28357 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 10 client.28357 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 20 client.28357 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:52.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2668b9c0 0x564b2668dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 4 client.28357 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:52:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.388+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x564b265120d0 con 0x564b2668b9c0 2023-09-13T09:52:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.390+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2668b9c0 0x564b2668dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.391+0000 7fa2d57fa700 10 client.28357 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.391+0000 7fa2f1b38700 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2668b9c0 0x564b2668dde0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb9a3948a5e9835 server_cookie=2caf4fd32086bd20 in_seq=0 out_seq=0 2023-09-13T09:52:52.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.393+0000 7fa2d57fa700 1 -- 172.21.15.6:0/2768507560 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564b265120d0 con 0x564b2668b9c0 2023-09-13T09:52:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.393+0000 7fa2d57fa700 10 client.28357 handle_command_reply: tid=0 2023-09-13T09:52:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.393+0000 7fa2fff81b80 1 client.28357 shutdown 2023-09-13T09:52:52.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 msgr2=0x564b26615d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26615d50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa2e4004450 tx=0x7fa2e40041e0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 shutdown_connections 2023-09-13T09:52:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564b266080e0 0x564b26615d50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564b2668b9c0 0x564b2668dde0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564b26606a80 0x564b26614800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 --2- 172.21.15.6:0/2768507560 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564b26607780 0x564b26614d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2d57fa700 0 client.28357 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 >> 172.21.15.6:0/2768507560 conn(0x564b26564d00 msgr2=0x564b26610470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 shutdown_connections 2023-09-13T09:52:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 1 -- 172.21.15.6:0/2768507560 wait complete. 2023-09-13T09:52:52.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.394+0000 7fa2fff81b80 20 client.28357 trim_cache size 0 max 16384 2023-09-13T09:52:52.403 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:52:52.403 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:52:52.403 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "80a83015-95b3-429c-8049-73e4bae53cd2", 2023-09-13T09:52:52.403 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:52:52.404 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:52:52.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa2d80a0640 msgr2=0x7fa2d80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa2d80a0640 0x7fa2d80a2b00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc009cb0 tx=0x7fa2dc009260 comp rx=0 tx=0).stop 2023-09-13T09:52:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 msgr2=0x7fa2ec103c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec103c60 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009fd0 tx=0x7fa2e8009580 comp rx=0 tx=0).stop 2023-09-13T09:52:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 shutdown_connections 2023-09-13T09:52:52.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa2ec101860 0x7fa2ec1027e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa2d80a0640 0x7fa2d80a2b00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0ffcd0 0x7fa2ec103c60 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 --2- 172.21.15.6:0/2765606230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2ec100ec0 0x7fa2ec1022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 >> 172.21.15.6:0/2765606230 conn(0x7fa2ec0fb280 msgr2=0x7fa2ec0691a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 shutdown_connections 2023-09-13T09:52:52.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.395+0000 7fa2f3d9c700 1 -- 172.21.15.6:0/2765606230 wait complete. 2023-09-13T09:52:52.412 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:52 smithi006 ceph-mon[98665]: pgmap v700: 97 pgs: 97 active+clean; 323 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-13T09:52:52.414 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:52:52.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:52 smithi053 ceph-mon[102373]: pgmap v700: 97 pgs: 97 active+clean; 323 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-13T09:52:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:52 smithi131 ceph-mon[102785]: pgmap v700: 97 pgs: 97 active+clean; 323 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 657 KiB/s rd, 2.6 MiB/s wr, 243 op/s 2023-09-13T09:52:52.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 5474 38.94 MB/sec warmup 12 sec latency 155.834 ms 2023-09-13T09:52:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 -- 172.21.15.6:0/2752438472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 msgr2=0x7f0280100470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 --2- 172.21.15.6:0/2752438472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f0280100470 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f02700099c0 tx=0x7f0270009cd0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 -- 172.21.15.6:0/2752438472 shutdown_connections 2023-09-13T09:52:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 --2- 172.21.15.6:0/2752438472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02801009b0 0x7f0280100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 --2- 172.21.15.6:0/2752438472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02800ff690 0x7f02800ffab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 --2- 172.21.15.6:0/2752438472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f0280100470 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 -- 172.21.15.6:0/2752438472 >> 172.21.15.6:0/2752438472 conn(0x7f02800fb250 msgr2=0x7f02800fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 -- 172.21.15.6:0/2752438472 shutdown_connections 2023-09-13T09:52:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 -- 172.21.15.6:0/2752438472 wait complete. 2023-09-13T09:52:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 Processor -- start 2023-09-13T09:52:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.565+0000 7f028834b700 1 -- start start 2023-09-13T09:52:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f028834b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02800ff690 0x7f0280198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f028834b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f02801991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f028834b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02801009b0 0x7f02801a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f028834b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801a0800 con 0x7f02800ffff0 2023-09-13T09:52:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f028834b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801a0970 con 0x7f02801009b0 2023-09-13T09:52:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f028834b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02801a0b30 con 0x7f02800ff690 2023-09-13T09:52:52.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f02801991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f02801991d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42382/0 (socket says 172.21.15.6:42382) 2023-09-13T09:52:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 -- 172.21.15.6:0/2460815262 learned_addr learned my addr 172.21.15.6:0/2460815262 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02860e7700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02800ff690 0x7f0280198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02868e8700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02801009b0 0x7f02801a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 -- 172.21.15.6:0/2460815262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02800ff690 msgr2=0x7f0280198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02800ff690 0x7f0280198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 -- 172.21.15.6:0/2460815262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02801009b0 msgr2=0x7f02801a0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02801009b0 0x7f02801a0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 -- 172.21.15.6:0/2460815262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02700095f0 con 0x7f02800ffff0 2023-09-13T09:52:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02858e6700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f02801991d0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0270009990 tx=0x7f027000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02777fe700 1 -- 172.21.15.6:0/2460815262 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027001d070 con 0x7f02800ffff0 2023-09-13T09:52:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02777fe700 1 -- 172.21.15.6:0/2460815262 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0270005030 con 0x7f02800ffff0 2023-09-13T09:52:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f02777fe700 1 -- 172.21.15.6:0/2460815262 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0270004a70 con 0x7f02800ffff0 2023-09-13T09:52:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.566+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02801a0db0 con 0x7f02800ffff0 2023-09-13T09:52:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.567+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02801a1180 con 0x7f02800ffff0 2023-09-13T09:52:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.570+0000 7f02777fe700 1 -- 172.21.15.6:0/2460815262 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0270005410 con 0x7f02800ffff0 2023-09-13T09:52:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.570+0000 7f02777fe700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f026c0a0640 0x7f026c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.571+0000 7f02777fe700 1 -- 172.21.15.6:0/2460815262 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f02700cc9a0 con 0x7f02800ffff0 2023-09-13T09:52:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.571+0000 7f02860e7700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f026c0a0640 0x7f026c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.571+0000 7f0294530b80 1 Processor -- start 2023-09-13T09:52:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.571+0000 7f0294530b80 1 -- start start 2023-09-13T09:52:52.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.571+0000 7f02860e7700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f026c0a0640 0x7f026c0a2b00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0280199b60 tx=0x7f027c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f0294530b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c5939b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f0294530b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c59399cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f0294530b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 0x558c5939a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f0294530b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c592ea780 con 0x558c5939b870 2023-09-13T09:52:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f0294530b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c592e80a0 con 0x558c5939a210 2023-09-13T09:52:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f0294530b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c592e3990 con 0x558c5939af10 2023-09-13T09:52:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c5939b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c5939b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45442/0 (socket says 172.21.15.6:45442) 2023-09-13T09:52:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 -- 172.21.15.6:0/2126430827 learned_addr learned my addr 172.21.15.6:0/2126430827 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02858e6700 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c59399cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 -- 172.21.15.6:0/2126430827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 msgr2=0x558c5939a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 0x558c5939a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 -- 172.21.15.6:0/2126430827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 msgr2=0x558c59399cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c59399cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02860e7700 1 -- 172.21.15.6:0/2126430827 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c59163630 con 0x558c5939af10 2023-09-13T09:52:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.572+0000 7f02858e6700 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c59399cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.573+0000 7f02860e7700 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c5939b330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f027c011d50 tx=0x7f027c014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea3935467ad03c45 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.573+0000 7f0274d82700 1 -- 172.21.15.6:0/2126430827 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c00ebd0 con 0x558c5939af10 2023-09-13T09:52:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.573+0000 7f0274d82700 1 -- 172.21.15.6:0/2126430827 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f027c021070 con 0x558c5939af10 2023-09-13T09:52:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.573+0000 7f0274d82700 1 -- 172.21.15.6:0/2126430827 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c003ce0 con 0x558c5939af10 2023-09-13T09:52:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 -- 172.21.15.6:0/2126430827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 msgr2=0x558c5939b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c5939b330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f027c011d50 tx=0x7f027c014000 comp rx=0 tx=0).stop 2023-09-13T09:52:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 -- 172.21.15.6:0/2126430827 shutdown_connections 2023-09-13T09:52:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 0x558c5939a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c5939b330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 --2- 172.21.15.6:0/2126430827 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c59399cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 -- 172.21.15.6:0/2126430827 >> 172.21.15.6:0/2126430827 conn(0x558c592efc80 msgr2=0x558c5938bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 -- 172.21.15.6:0/2126430827 shutdown_connections 2023-09-13T09:52:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 -- 172.21.15.6:0/2126430827 wait complete. 2023-09-13T09:52:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 -- start start 2023-09-13T09:52:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.574+0000 7f0294530b80 1 Processor -- start 2023-09-13T09:52:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0294530b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c593a3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0294530b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593a3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0294530b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593aad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0294530b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c59281bb0 con 0x558c5939b870 2023-09-13T09:52:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0294530b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c592818b0 con 0x558c5939af10 2023-09-13T09:52:52.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0294530b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c59165920 con 0x558c5939a210 2023-09-13T09:52:52.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0294530b80 10 client.0 _ll_register_callbacks cb 0x558c5927f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:52.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c593a3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c593a3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45448/0 (socket says 172.21.15.6:45448) 2023-09-13T09:52:52.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 -- 172.21.15.6:0/1823487243 learned_addr learned my addr 172.21.15.6:0/1823487243 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02858e6700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593a3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02868e8700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593aad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 -- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 msgr2=0x558c593a3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593a3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 -- 172.21.15.6:0/1823487243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 msgr2=0x558c593aad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593aad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 -- 172.21.15.6:0/1823487243 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f027c017070 con 0x558c5939a210 2023-09-13T09:52:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02868e8700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:52:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f02860e7700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c593a3780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f027c011d20 tx=0x7f027c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ba78893d951e6dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.575+0000 7f0269ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:52:52.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0269ffb700 1 -- 172.21.15.6:0/1823487243 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027c02a040 con 0x558c5939a210 2023-09-13T09:52:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0269ffb700 1 -- 172.21.15.6:0/1823487243 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f027c0050c0 con 0x558c5939a210 2023-09-13T09:52:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c59384670 con 0x558c5939a210 2023-09-13T09:52:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0269ffb700 1 -- 172.21.15.6:0/1823487243 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f027c003e70 con 0x558c5939a210 2023-09-13T09:52:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 10 client.28369 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:52.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558c592fb7a0 con 0x558c5939a210 2023-09-13T09:52:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0269ffb700 1 -- 172.21.15.6:0/1823487243 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558c59384670 con 0x558c5939a210 2023-09-13T09:52:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0269ffb700 1 -- 172.21.15.6:0/1823487243 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f027c026c40 con 0x558c5939a210 2023-09-13T09:52:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 10 client.28369 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 10 client.28369 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:52.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 20 client.28369 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c593af420 0x558c593b1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 4 client.28369 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:52:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c592dc970 con 0x558c593af420 2023-09-13T09:52:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.576+0000 7f02858e6700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c593af420 0x558c593b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.577+0000 7f0269ffb700 10 client.28369 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.577+0000 7f02858e6700 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c593af420 0x558c593b1840 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bb4d77bec8c1219 server_cookie=1c8cb58dc19483fc in_seq=0 out_seq=0 2023-09-13T09:52:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.581+0000 7f0269ffb700 1 -- 172.21.15.6:0/1823487243 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558c592dc970 con 0x558c593af420 2023-09-13T09:52:52.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.581+0000 7f0269ffb700 10 client.28369 handle_command_reply: tid=0 2023-09-13T09:52:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.581+0000 7f0294530b80 1 client.28369 shutdown 2023-09-13T09:52:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 msgr2=0x558c593a3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c593a3780 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f027c011d20 tx=0x7f027c00ed00 comp rx=0 tx=0).stop 2023-09-13T09:52:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 shutdown_connections 2023-09-13T09:52:52.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c593af420 0x558c593b1840 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593aad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c593a3780 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 --2- 172.21.15.6:0/1823487243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593a3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0269ffb700 0 client.28369 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 >> 172.21.15.6:0/1823487243 conn(0x558c592efc80 msgr2=0x558c593867f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 shutdown_connections 2023-09-13T09:52:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 1 -- 172.21.15.6:0/1823487243 wait complete. 2023-09-13T09:52:52.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.582+0000 7f0294530b80 20 client.28369 trim_cache size 0 max 16384 2023-09-13T09:52:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.602+0000 7f0294530b80 1 Processor -- start 2023-09-13T09:52:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.602+0000 7f0294530b80 1 -- start start 2023-09-13T09:52:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.602+0000 7f0294530b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c59399cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.602+0000 7f0294530b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.602+0000 7f0294530b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c5939e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.602+0000 7f0294530b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c593a32f0 con 0x558c5939b870 2023-09-13T09:52:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f0294530b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c5938da10 con 0x558c5939af10 2023-09-13T09:52:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f0294530b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c5938dfd0 con 0x558c5939a210 2023-09-13T09:52:52.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c5939e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02858e6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02860e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c59399cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02860e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c59399cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45456/0 (socket says 172.21.15.6:45456) 2023-09-13T09:52:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c5939e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42406/0 (socket says 172.21.15.6:42406) 2023-09-13T09:52:52.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02858e6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35928/0 (socket says 172.21.15.6:35928) 2023-09-13T09:52:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 -- 172.21.15.6:0/912373830 learned_addr learned my addr 172.21.15.6:0/912373830 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 -- 172.21.15.6:0/912373830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 msgr2=0x558c59399cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 --2- 172.21.15.6:0/912373830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c59399cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 -- 172.21.15.6:0/912373830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 msgr2=0x558c593aacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 --2- 172.21.15.6:0/912373830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593aacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 -- 172.21.15.6:0/912373830 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c5910fde0 con 0x558c5939b870 2023-09-13T09:52:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f02868e8700 1 --2- 172.21.15.6:0/912373830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c5939e190 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0278009430 tx=0x7f0278009460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a49ac1b9c5e0a227 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f0275583700 1 -- 172.21.15.6:0/912373830 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800e040 con 0x558c5939b870 2023-09-13T09:52:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f0275583700 1 -- 172.21.15.6:0/912373830 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f027800f040 con 0x558c5939b870 2023-09-13T09:52:52.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.603+0000 7f0275583700 1 -- 172.21.15.6:0/912373830 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02780155f0 con 0x558c5939b870 2023-09-13T09:52:52.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 -- 172.21.15.6:0/912373830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 msgr2=0x558c5939e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 --2- 172.21.15.6:0/912373830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c5939e190 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f0278009430 tx=0x7f0278009460 comp rx=0 tx=0).stop 2023-09-13T09:52:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 -- 172.21.15.6:0/912373830 shutdown_connections 2023-09-13T09:52:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 --2- 172.21.15.6:0/912373830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c5939e190 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 --2- 172.21.15.6:0/912373830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939a210 0x558c59399cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 --2- 172.21.15.6:0/912373830 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939af10 0x558c593aacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 -- 172.21.15.6:0/912373830 >> 172.21.15.6:0/912373830 conn(0x558c592efc80 msgr2=0x558c593a23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 -- 172.21.15.6:0/912373830 shutdown_connections 2023-09-13T09:52:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 -- 172.21.15.6:0/912373830 wait complete. 2023-09-13T09:52:52.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.604+0000 7f0294530b80 1 -- start start 2023-09-13T09:52:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 1 Processor -- start 2023-09-13T09:52:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 0x558c593aab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c593a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593a7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c593a8100 con 0x558c5939b870 2023-09-13T09:52:52.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c59403240 con 0x558c5939a210 2023-09-13T09:52:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c59403380 con 0x558c5939af10 2023-09-13T09:52:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0294530b80 10 client.0 _ll_register_callbacks cb 0x558c5927f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:52:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593a7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02860e7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 0x558c593aab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593a7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42412/0 (socket says 172.21.15.6:42412) 2023-09-13T09:52:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 -- 172.21.15.6:0/3092088 learned_addr learned my addr 172.21.15.6:0/3092088 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:52:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02858e6700 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c593a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 -- 172.21.15.6:0/3092088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 msgr2=0x558c593a75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c593a75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 -- 172.21.15.6:0/3092088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 msgr2=0x558c593aab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:52:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 0x558c593aab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 -- 172.21.15.6:0/3092088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0278009110 con 0x558c5939b870 2023-09-13T09:52:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f02868e8700 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593a7ae0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f02780060b0 tx=0x7f0278015640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35144d51bb700973 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:52:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.605+0000 7f0269ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:52:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0269ffb700 1 -- 172.21.15.6:0/3092088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f027800e070 con 0x558c5939b870 2023-09-13T09:52:52.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0269ffb700 1 -- 172.21.15.6:0/3092088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0278003a00 con 0x558c5939b870 2023-09-13T09:52:52.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f027c021070 con 0x558c5939b870 2023-09-13T09:52:52.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0269ffb700 1 -- 172.21.15.6:0/3092088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0278003bc0 con 0x558c5939b870 2023-09-13T09:52:52.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 10 client.19062 fetch_fsmap learned FSMap version 39 2023-09-13T09:52:52.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=4+}) v3 -- 0x558c590f8c60 con 0x558c5939b870 2023-09-13T09:52:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0269ffb700 1 -- 172.21.15.6:0/3092088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f027c021070 con 0x558c5939b870 2023-09-13T09:52:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0269ffb700 1 -- 172.21.15.6:0/3092088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 39) v1 ==== 7906+0+0 (secure 0 0 0) 0x7f0278015a80 con 0x558c5939b870 2023-09-13T09:52:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 10 client.19062 fetch_fsmap finished waiting for FSMap version 39 2023-09-13T09:52:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 10 client.19062 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:52:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 20 client.19062 populate_metadata read hostname 'smithi006' 2023-09-13T09:52:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c59404cb0 0x558c594070d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:52:52.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 4 client.19062 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:52:52.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.606+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558c5929d050 con 0x558c59404cb0 2023-09-13T09:52:52.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.607+0000 7f02860e7700 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c59404cb0 0x558c594070d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:52:52.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.607+0000 7f0269ffb700 10 client.19062 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.607+0000 7f02860e7700 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c59404cb0 0x558c594070d0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f71d678ffa826f3d server_cookie=cbb1a3a8481ba7fd in_seq=0 out_seq=0 2023-09-13T09:52:52.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0269ffb700 1 -- 172.21.15.6:0/3092088 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x558c5929d050 con 0x558c59404cb0 2023-09-13T09:52:52.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0269ffb700 10 client.19062 handle_command_reply: tid=0 2023-09-13T09:52:52.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 client.19062 shutdown 2023-09-13T09:52:52.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 msgr2=0x558c593a7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593a7ae0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f02780060b0 tx=0x7f0278015640 comp rx=0 tx=0).stop 2023-09-13T09:52:52.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 shutdown_connections 2023-09-13T09:52:52.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558c59404cb0 0x558c594070d0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558c5939b870 0x558c593a7ae0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558c5939a210 0x558c593aab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0269ffb700 0 client.19062 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:52:52.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 --2- 172.21.15.6:0/3092088 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558c5939af10 0x558c593a75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 >> 172.21.15.6:0/3092088 conn(0x558c592efc80 msgr2=0x558c5939e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 shutdown_connections 2023-09-13T09:52:52.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 1 -- 172.21.15.6:0/3092088 wait complete. 2023-09-13T09:52:52.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.612+0000 7f0294530b80 20 client.19062 trim_cache size 0 max 16384 2023-09-13T09:52:52.626 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:52:52.626 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (36 inodes in the stack)", 2023-09-13T09:52:52.626 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:52:52.627 INFO:teuthology.orchestra.run.smithi006.stdout: "80a83015-95b3-429c-8049-73e4bae53cd2": { 2023-09-13T09:52:52.627 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:52:52.627 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "80a83015-95b3-429c-8049-73e4bae53cd2", 2023-09-13T09:52:52.627 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:52:52.627 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:52:52.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:52:52.628 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:52:52.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f026c0a0640 msgr2=0x7f026c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f026c0a0640 0x7f026c0a2b00 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f0280199b60 tx=0x7f027c009260 comp rx=0 tx=0).stop 2023-09-13T09:52:52.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 msgr2=0x7f02801991d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:52:52.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f02801991d0 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0270009990 tx=0x7f027000f690 comp rx=0 tx=0).stop 2023-09-13T09:52:52.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 shutdown_connections 2023-09-13T09:52:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02801009b0 0x7f02801a0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02800ff690 0x7f0280198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f026c0a0640 0x7f026c0a2b00 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 --2- 172.21.15.6:0/2460815262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02800ffff0 0x7f02801991d0 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:52:52.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 >> 172.21.15.6:0/2460815262 conn(0x7f02800fb250 msgr2=0x7f02800fcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:52:52.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 shutdown_connections 2023-09-13T09:52:52.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:52:52.613+0000 7f028834b700 1 -- 172.21.15.6:0/2460815262 wait complete. 2023-09-13T09:52:52.632 INFO:tasks.cephfs.filesystem:scrub status for tag:80a83015-95b3-429c-8049-73e4bae53cd2 - {'path': '/', 'tag': '80a83015-95b3-429c-8049-73e4bae53cd2', 'options': 'recursive,force'} 2023-09-13T09:52:53.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:53.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:53.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:53.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:53.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:53.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:53 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:53.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:53.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:53.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:53.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:53.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:53 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:53.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:53.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:53.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:53.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:53.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:53 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:53.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 6141 39.12 MB/sec warmup 13 sec latency 126.219 ms 2023-09-13T09:52:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: pgmap v701: 97 pgs: 97 active+clean; 335 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2023-09-13T09:52:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:52:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:52:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: pgmap v701: 97 pgs: 97 active+clean; 335 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2023-09-13T09:52:54.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:52:54.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:54.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:52:54.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: pgmap v701: 97 pgs: 97 active+clean; 335 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.6 MiB/s wr, 319 op/s 2023-09-13T09:52:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:52:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:52:54.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:52:54.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 6897 38.64 MB/sec warmup 14 sec latency 80.716 ms 2023-09-13T09:52:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:55 smithi006 ceph-mon[98665]: pgmap v702: 97 pgs: 97 active+clean; 339 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 312 op/s 2023-09-13T09:52:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:55 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:55.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:55 smithi053 ceph-mon[102373]: pgmap v702: 97 pgs: 97 active+clean; 339 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 312 op/s 2023-09-13T09:52:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:55 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:55 smithi131 ceph-mon[102785]: pgmap v702: 97 pgs: 97 active+clean; 339 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.7 MiB/s wr, 312 op/s 2023-09-13T09:52:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:55 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:52:55.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 7572 38.81 MB/sec warmup 15 sec latency 79.390 ms 2023-09-13T09:52:56.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 8416 39.39 MB/sec warmup 16 sec latency 129.826 ms 2023-09-13T09:52:57.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 9338 40.02 MB/sec warmup 17 sec latency 42.395 ms 2023-09-13T09:52:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:57 smithi006 ceph-mon[98665]: pgmap v703: 97 pgs: 97 active+clean; 346 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 387 op/s 2023-09-13T09:52:58.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:57 smithi053 ceph-mon[102373]: pgmap v703: 97 pgs: 97 active+clean; 346 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 387 op/s 2023-09-13T09:52:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:57 smithi131 ceph-mon[102785]: pgmap v703: 97 pgs: 97 active+clean; 346 MiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.6 MiB/s wr, 387 op/s 2023-09-13T09:52:58.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 10176 40.03 MB/sec warmup 18 sec latency 63.204 ms 2023-09-13T09:52:59.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 11112 40.55 MB/sec warmup 19 sec latency 417.110 ms 2023-09-13T09:53:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:59 smithi006 ceph-mon[98665]: pgmap v704: 97 pgs: 97 active+clean; 352 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 369 op/s 2023-09-13T09:53:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:52:59 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:59 smithi053 ceph-mon[102373]: pgmap v704: 97 pgs: 97 active+clean; 352 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 369 op/s 2023-09-13T09:53:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:52:59 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:59 smithi131 ceph-mon[102785]: pgmap v704: 97 pgs: 97 active+clean; 352 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 369 op/s 2023-09-13T09:53:00.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:52:59 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:00.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 11988 41.10 MB/sec warmup 20 sec latency 1417.142 ms 2023-09-13T09:53:01.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 12899 41.37 MB/sec warmup 21 sec latency 1980.000 ms 2023-09-13T09:53:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:01 smithi006 ceph-mon[98665]: pgmap v705: 97 pgs: 97 active+clean; 354 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 372 op/s 2023-09-13T09:53:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:01 smithi053 ceph-mon[102373]: pgmap v705: 97 pgs: 97 active+clean; 354 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 372 op/s 2023-09-13T09:53:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:01 smithi131 ceph-mon[102785]: pgmap v705: 97 pgs: 97 active+clean; 354 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 4.4 MiB/s wr, 372 op/s 2023-09-13T09:53:02.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 13772 41.79 MB/sec warmup 22 sec latency 822.280 ms 2023-09-13T09:53:03.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 14625 41.93 MB/sec warmup 23 sec latency 879.381 ms 2023-09-13T09:53:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:03 smithi006 ceph-mon[98665]: pgmap v706: 97 pgs: 97 active+clean; 364 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 510 op/s 2023-09-13T09:53:04.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:03 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:04.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:03 smithi053 ceph-mon[102373]: pgmap v706: 97 pgs: 97 active+clean; 364 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 510 op/s 2023-09-13T09:53:04.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:03 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:03 smithi131 ceph-mon[102785]: pgmap v706: 97 pgs: 97 active+clean; 364 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.6 MiB/s wr, 510 op/s 2023-09-13T09:53:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:03 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:04.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 15574 42.30 MB/sec warmup 24 sec latency 1502.043 ms 2023-09-13T09:53:05.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:05.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:05.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:05.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:04 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:05.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:05.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:05.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:05.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:04 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:05.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:04 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:05.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 16308 42.26 MB/sec warmup 25 sec latency 2052.977 ms 2023-09-13T09:53:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:05 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:05 smithi006 ceph-mon[98665]: pgmap v707: 97 pgs: 97 active+clean; 370 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 476 op/s 2023-09-13T09:53:06.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:05 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:06.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:05 smithi053 ceph-mon[102373]: pgmap v707: 97 pgs: 97 active+clean; 370 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 476 op/s 2023-09-13T09:53:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:05 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:05 smithi131 ceph-mon[102785]: pgmap v707: 97 pgs: 97 active+clean; 370 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 5.1 MiB/s wr, 476 op/s 2023-09-13T09:53:06.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 17165 42.41 MB/sec warmup 26 sec latency 1018.695 ms 2023-09-13T09:53:07.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 17975 42.34 MB/sec warmup 27 sec latency 988.686 ms 2023-09-13T09:53:08.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:07 smithi006 ceph-mon[98665]: pgmap v708: 97 pgs: 97 active+clean; 381 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 583 op/s 2023-09-13T09:53:08.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:07 smithi053 ceph-mon[102373]: pgmap v708: 97 pgs: 97 active+clean; 381 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 583 op/s 2023-09-13T09:53:08.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:07 smithi131 ceph-mon[102785]: pgmap v708: 97 pgs: 97 active+clean; 381 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.9 MiB/s wr, 583 op/s 2023-09-13T09:53:08.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 18775 42.20 MB/sec warmup 28 sec latency 1056.601 ms 2023-09-13T09:53:09.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 19469 42.26 MB/sec warmup 29 sec latency 212.312 ms 2023-09-13T09:53:10.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:09 smithi006 ceph-mon[98665]: pgmap v709: 97 pgs: 97 active+clean; 383 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 514 op/s 2023-09-13T09:53:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:09 smithi053 ceph-mon[102373]: pgmap v709: 97 pgs: 97 active+clean; 383 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 514 op/s 2023-09-13T09:53:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:09 smithi131 ceph-mon[102785]: pgmap v709: 97 pgs: 97 active+clean; 383 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.1 MiB/s wr, 514 op/s 2023-09-13T09:53:10.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 20125 41.96 MB/sec warmup 30 sec latency 63.560 ms 2023-09-13T09:53:11.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:10 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:11.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:10 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:11.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:10 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:11.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 20919 42.00 MB/sec warmup 31 sec latency 55.297 ms 2023-09-13T09:53:12.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:11 smithi006 ceph-mon[98665]: pgmap v710: 97 pgs: 97 active+clean; 390 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 506 op/s 2023-09-13T09:53:12.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:11 smithi053 ceph-mon[102373]: pgmap v710: 97 pgs: 97 active+clean; 390 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 506 op/s 2023-09-13T09:53:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:11 smithi131 ceph-mon[102785]: pgmap v710: 97 pgs: 97 active+clean; 390 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.2 MiB/s wr, 506 op/s 2023-09-13T09:53:12.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 21814 42.04 MB/sec warmup 32 sec latency 38.848 ms 2023-09-13T09:53:13.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 22689 42.26 MB/sec warmup 33 sec latency 51.098 ms 2023-09-13T09:53:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:13 smithi006 ceph-mon[98665]: pgmap v711: 97 pgs: 97 active+clean; 396 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 611 op/s 2023-09-13T09:53:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:13 smithi053 ceph-mon[102373]: pgmap v711: 97 pgs: 97 active+clean; 396 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 611 op/s 2023-09-13T09:53:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:13 smithi131 ceph-mon[102785]: pgmap v711: 97 pgs: 97 active+clean; 396 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.1 MiB/s wr, 611 op/s 2023-09-13T09:53:14.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 23228 42.03 MB/sec warmup 34 sec latency 354.680 ms 2023-09-13T09:53:15.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 23938 41.81 MB/sec warmup 35 sec latency 81.861 ms 2023-09-13T09:53:16.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:15 smithi006 ceph-mon[98665]: pgmap v712: 97 pgs: 97 active+clean; 418 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.1 MiB/s wr, 566 op/s 2023-09-13T09:53:16.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:15 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:16.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:15 smithi053 ceph-mon[102373]: pgmap v712: 97 pgs: 97 active+clean; 418 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.1 MiB/s wr, 566 op/s 2023-09-13T09:53:16.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:15 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:15 smithi131 ceph-mon[102785]: pgmap v712: 97 pgs: 97 active+clean; 418 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 7.1 MiB/s wr, 566 op/s 2023-09-13T09:53:16.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:15 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:16.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 24815 41.80 MB/sec warmup 36 sec latency 60.183 ms 2023-09-13T09:53:17.553 INFO:tasks.workunit.client.0.smithi006.stdout: 10 25885 42.36 MB/sec warmup 37 sec latency 42.394 ms 2023-09-13T09:53:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:17 smithi006 ceph-mon[98665]: pgmap v713: 97 pgs: 97 active+clean; 529 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 619 op/s 2023-09-13T09:53:18.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:17 smithi053 ceph-mon[102373]: pgmap v713: 97 pgs: 97 active+clean; 529 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 619 op/s 2023-09-13T09:53:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:17 smithi131 ceph-mon[102785]: pgmap v713: 97 pgs: 97 active+clean; 529 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 16 MiB/s wr, 619 op/s 2023-09-13T09:53:18.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 26613 42.52 MB/sec warmup 38 sec latency 66.376 ms 2023-09-13T09:53:19.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:18 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:19.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:18 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:19.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:18 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:19.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 27064 41.97 MB/sec warmup 39 sec latency 266.695 ms 2023-09-13T09:53:20.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:19 smithi006 ceph-mon[98665]: pgmap v714: 97 pgs: 97 active+clean; 579 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 19 MiB/s wr, 499 op/s 2023-09-13T09:53:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:19 smithi053 ceph-mon[102373]: pgmap v714: 97 pgs: 97 active+clean; 579 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 19 MiB/s wr, 499 op/s 2023-09-13T09:53:20.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:19 smithi131 ceph-mon[102785]: pgmap v714: 97 pgs: 97 active+clean; 579 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 19 MiB/s wr, 499 op/s 2023-09-13T09:53:20.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 27539 41.41 MB/sec warmup 40 sec latency 995.809 ms 2023-09-13T09:53:21.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 28440 41.46 MB/sec warmup 41 sec latency 1612.122 ms 2023-09-13T09:53:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:21 smithi006 ceph-mon[98665]: pgmap v715: 97 pgs: 97 active+clean; 619 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 22 MiB/s wr, 609 op/s 2023-09-13T09:53:22.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:21 smithi053 ceph-mon[102373]: pgmap v715: 97 pgs: 97 active+clean; 619 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 22 MiB/s wr, 609 op/s 2023-09-13T09:53:22.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:21 smithi131 ceph-mon[102785]: pgmap v715: 97 pgs: 97 active+clean; 619 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 22 MiB/s wr, 609 op/s 2023-09-13T09:53:22.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 29479 41.94 MB/sec warmup 42 sec latency 81.619 ms 2023-09-13T09:53:22.633 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:53:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 -- 172.21.15.6:0/1362192713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 msgr2=0x7f0c00108f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 --2- 172.21.15.6:0/1362192713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c00108f40 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b0a0 tx=0x7f0bf800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 -- 172.21.15.6:0/1362192713 shutdown_connections 2023-09-13T09:53:22.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 --2- 172.21.15.6:0/1362192713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c00108f40 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 --2- 172.21.15.6:0/1362192713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c001018d0 0x7f0c00103cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 --2- 172.21.15.6:0/1362192713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c00104200 0x7f0c001065f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 -- 172.21.15.6:0/1362192713 >> 172.21.15.6:0/1362192713 conn(0x7f0c000fb260 msgr2=0x7f0c000fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:22.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 -- 172.21.15.6:0/1362192713 shutdown_connections 2023-09-13T09:53:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.786+0000 7f0c05a03700 1 -- 172.21.15.6:0/1362192713 wait complete. 2023-09-13T09:53:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 Processor -- start 2023-09-13T09:53:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 -- start start 2023-09-13T09:53:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c001018d0 0x7f0c00196b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c00104200 0x7f0c00197070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c0019e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0019e6b0 con 0x7f0c00106b30 2023-09-13T09:53:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0019e7f0 con 0x7f0c001018d0 2023-09-13T09:53:22.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0c05a03700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0019e980 con 0x7f0c00104200 2023-09-13T09:53:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c0019e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c0019e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42432/0 (socket says 172.21.15.6:42432) 2023-09-13T09:53:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0bff7fe700 1 -- 172.21.15.6:0/2763555446 learned_addr learned my addr 172.21.15.6:0/2763555446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c001018d0 0x7f0c00196b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.787+0000 7f0bfe7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c00104200 0x7f0c00197070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0bff7fe700 1 -- 172.21.15.6:0/2763555446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c00104200 msgr2=0x7f0c00197070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0bff7fe700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c00104200 0x7f0c00197070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0bff7fe700 1 -- 172.21.15.6:0/2763555446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c001018d0 msgr2=0x7f0c00196b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0bff7fe700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c001018d0 0x7f0c00196b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0bff7fe700 1 -- 172.21.15.6:0/2763555446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0009520 con 0x7f0c00106b30 2023-09-13T09:53:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0bff7fe700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c0019e0e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b780 tx=0x7f0bf800bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0c04a01700 1 -- 172.21.15.6:0/2763555446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800e040 con 0x7f0c00106b30 2023-09-13T09:53:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0c04a01700 1 -- 172.21.15.6:0/2763555446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bf8004c50 con 0x7f0c00106b30 2023-09-13T09:53:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bf8009d00 con 0x7f0c00106b30 2023-09-13T09:53:22.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0c04a01700 1 -- 172.21.15.6:0/2763555446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf8005280 con 0x7f0c00106b30 2023-09-13T09:53:22.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.788+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0019ef40 con 0x7f0c00106b30 2023-09-13T09:53:22.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.791+0000 7f0c04a01700 1 -- 172.21.15.6:0/2763555446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0bf801d470 con 0x7f0c00106b30 2023-09-13T09:53:22.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.791+0000 7f0c04a01700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0be80a06c0 0x7f0be80a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.791+0000 7f0c04a01700 1 -- 172.21.15.6:0/2763555446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bf80cd000 con 0x7f0c00106b30 2023-09-13T09:53:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.791+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0be80a06c0 0x7f0be80a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.792+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0be80a06c0 0x7f0be80a2b80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009df0 tx=0x7f0bf0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.792+0000 7f0c11be8b80 1 Processor -- start 2023-09-13T09:53:22.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.792+0000 7f0c11be8b80 1 -- start start 2023-09-13T09:53:22.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1a8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf100780 con 0x55a2bf1a7a00 2023-09-13T09:53:22.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf0fe0a0 con 0x55a2bf1a9060 2023-09-13T09:53:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf0f9990 con 0x55a2bf1a8700 2023-09-13T09:53:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1a8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1a8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45490/0 (socket says 172.21.15.6:45490) 2023-09-13T09:53:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 -- 172.21.15.6:0/3123216737 learned_addr learned my addr 172.21.15.6:0/3123216737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:22.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 -- 172.21.15.6:0/3123216737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 msgr2=0x55a2bf1a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 -- 172.21.15.6:0/3123216737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 msgr2=0x55a2bf1a7e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:53:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a7e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 -- 172.21.15.6:0/3123216737 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2bef79630 con 0x55a2bf1a8700 2023-09-13T09:53:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1a8b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00094f0 tx=0x7f0bf0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af15b3fa3761b50c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.793+0000 7f0be5ffb700 1 -- 172.21.15.6:0/3123216737 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf0026630 con 0x55a2bf1a8700 2023-09-13T09:53:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0be5ffb700 1 -- 172.21.15.6:0/3123216737 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bf0021070 con 0x55a2bf1a8700 2023-09-13T09:53:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0be5ffb700 1 -- 172.21.15.6:0/3123216737 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf001d720 con 0x55a2bf1a8700 2023-09-13T09:53:22.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3123216737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 msgr2=0x55a2bf1a8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1a8b20 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00094f0 tx=0x7f0bf0014000 comp rx=0 tx=0).stop 2023-09-13T09:53:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3123216737 shutdown_connections 2023-09-13T09:53:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1a8b20 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3123216737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3123216737 >> 172.21.15.6:0/3123216737 conn(0x55a2bf105c80 msgr2=0x55a2bf1a1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.794+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3123216737 shutdown_connections 2023-09-13T09:53:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.795+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3123216737 wait complete. 2023-09-13T09:53:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.795+0000 7f0c11be8b80 1 -- start start 2023-09-13T09:53:22.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.795+0000 7f0c11be8b80 1 Processor -- start 2023-09-13T09:53:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b1470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b84b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf097bb0 con 0x55a2bf1a9060 2023-09-13T09:53:22.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf0978b0 con 0x55a2bf1a7a00 2023-09-13T09:53:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bef7b920 con 0x55a2bf1a8700 2023-09-13T09:53:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0c11be8b80 10 client.0 _ll_register_callbacks cb 0x55a2bf095680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:22.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfe7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfeffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b0f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35964/0 (socket says 172.21.15.6:35964) 2023-09-13T09:53:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfeffd700 1 -- 172.21.15.6:0/3294555197 learned_addr learned my addr 172.21.15.6:0/3294555197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bff7fe700 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/3294555197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 msgr2=0x55a2bf1b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/3294555197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 msgr2=0x55a2bf1b84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:22.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b84b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/3294555197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bf0017070 con 0x55a2bf1a8700 2023-09-13T09:53:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bff7fe700 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b1470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4012770 tx=0x7f0bf4012a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f74efad1673184df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.796+0000 7f0bdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:22.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3294555197 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4017070 con 0x55a2bf1a8700 2023-09-13T09:53:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2bf19a670 con 0x55a2bf1a8700 2023-09-13T09:53:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3294555197 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bf400f540 con 0x55a2bf1a8700 2023-09-13T09:53:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3294555197 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bf400f700 con 0x55a2bf1a8700 2023-09-13T09:53:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 10 client.28387 fetch_fsmap learned FSMap version 45 2023-09-13T09:53:22.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a2bf1117a0 con 0x55a2bf1a8700 2023-09-13T09:53:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3294555197 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a2bf19a670 con 0x55a2bf1a8700 2023-09-13T09:53:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3294555197 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 45) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0bf4026910 con 0x55a2bf1a8700 2023-09-13T09:53:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 10 client.28387 fetch_fsmap finished waiting for FSMap version 45 2023-09-13T09:53:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 10 client.28387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:22.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 20 client.28387 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf1ded80 0x55a2bf1e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 4 client.28387 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.797+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2bf0f2970 con 0x55a2bf1ded80 2023-09-13T09:53:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.798+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf1ded80 0x55a2bf1e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.798+0000 7f0bdeffd700 10 client.28387 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:22.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.798+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf1ded80 0x55a2bf1e11a0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ee637247cc5ebd server_cookie=5e1f6f6f4b1dabe0 in_seq=0 out_seq=0 2023-09-13T09:53:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3294555197 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a2bf0f2970 con 0x55a2bf1ded80 2023-09-13T09:53:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0bdeffd700 10 client.28387 handle_command_reply: tid=0 2023-09-13T09:53:22.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 client.28387 shutdown 2023-09-13T09:53:22.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 msgr2=0x55a2bf1b1470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b1470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4012770 tx=0x7f0bf4012a80 comp rx=0 tx=0).stop 2023-09-13T09:53:22.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 shutdown_connections 2023-09-13T09:53:22.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf1ded80 0x55a2bf1e11a0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0bdeffd700 0 client.28387 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:22.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3294555197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b1470 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 >> 172.21.15.6:0/3294555197 conn(0x55a2bf105c80 msgr2=0x55a2bf19c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:22.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 shutdown_connections 2023-09-13T09:53:22.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3294555197 wait complete. 2023-09-13T09:53:22.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.804+0000 7f0c11be8b80 20 client.28387 trim_cache size 0 max 16384 2023-09-13T09:53:22.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 Processor -- start 2023-09-13T09:53:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 -- start start 2023-09-13T09:53:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b83d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1ab8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf1ba120 con 0x55a2bf1a9060 2023-09-13T09:53:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf1af660 con 0x55a2bf1a7a00 2023-09-13T09:53:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf1b1bb0 con 0x55a2bf1a8700 2023-09-13T09:53:22.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0bfe7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0bfe7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45504/0 (socket says 172.21.15.6:45504) 2023-09-13T09:53:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.823+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/2739695950 learned_addr learned my addr 172.21.15.6:0/2739695950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bff7fe700 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1ab8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/2739695950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 msgr2=0x55a2bf1a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:22.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/2739695950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 msgr2=0x55a2bf1ab8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1ab8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/2739695950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2bef25de0 con 0x55a2bf1a8700 2023-09-13T09:53:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:22.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bff7fe700 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:53:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b83d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4026c40 tx=0x7f0bf40096d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e9c6fcc466f4dd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0be67fc700 1 -- 172.21.15.6:0/2739695950 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf402b070 con 0x55a2bf1a8700 2023-09-13T09:53:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0be67fc700 1 -- 172.21.15.6:0/2739695950 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bf4013e90 con 0x55a2bf1a8700 2023-09-13T09:53:22.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.824+0000 7f0be67fc700 1 -- 172.21.15.6:0/2739695950 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4017040 con 0x55a2bf1a8700 2023-09-13T09:53:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 -- 172.21.15.6:0/2739695950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 msgr2=0x55a2bf1b83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b83d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0bf4026c40 tx=0x7f0bf40096d0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 -- 172.21.15.6:0/2739695950 shutdown_connections 2023-09-13T09:53:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a9060 0x55a2bf1ab8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1a74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/2739695950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b83d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 -- 172.21.15.6:0/2739695950 >> 172.21.15.6:0/2739695950 conn(0x55a2bf105c80 msgr2=0x55a2bf1afbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:22.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 -- 172.21.15.6:0/2739695950 shutdown_connections 2023-09-13T09:53:22.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.825+0000 7f0c11be8b80 1 -- 172.21.15.6:0/2739695950 wait complete. 2023-09-13T09:53:22.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.826+0000 7f0c11be8b80 1 -- start start 2023-09-13T09:53:22.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.826+0000 7f0c11be8b80 1 Processor -- start 2023-09-13T09:53:22.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0c11be8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b79c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf1b7f00 con 0x55a2bf1a7a00 2023-09-13T09:53:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf1b8070 con 0x55a2bf1a9060 2023-09-13T09:53:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0c11be8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2bf1b8230 con 0x55a2bf1a8700 2023-09-13T09:53:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0c11be8b80 10 client.0 _ll_register_callbacks cb 0x55a2bf095680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0bff7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:35980/0 (socket says 172.21.15.6:35980) 2023-09-13T09:53:22.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0bff7fe700 1 -- 172.21.15.6:0/3660426897 learned_addr learned my addr 172.21.15.6:0/3660426897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.827+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.828+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/3660426897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 msgr2=0x55a2bf1b79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.828+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.828+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/3660426897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 msgr2=0x55a2bf1b4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:22.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.828+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.828+0000 7f0bfe7fc700 1 -- 172.21.15.6:0/3660426897 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2bf1117a0 con 0x55a2bf1a8700 2023-09-13T09:53:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.828+0000 7f0bfe7fc700 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b49a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55a2bf19e7f0 tx=0x7f0bf4012410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e77aa074a991bec0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0bdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3660426897 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bf4017040 con 0x55a2bf1a8700 2023-09-13T09:53:22.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3660426897 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0bf4000e40 con 0x55a2bf1a8700 2023-09-13T09:53:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bf0021070 con 0x55a2bf1a8700 2023-09-13T09:53:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3660426897 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bf402b040 con 0x55a2bf1a8700 2023-09-13T09:53:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0c11be8b80 10 client.28393 fetch_fsmap learned FSMap version 45 2023-09-13T09:53:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55a2bef0ec60 con 0x55a2bf1a8700 2023-09-13T09:53:22.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.829+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3660426897 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0bf0021070 con 0x55a2bf1a8700 2023-09-13T09:53:22.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.830+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3660426897 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 45) v1 ==== 7934+0+0 (secure 0 0 0) 0x7f0bf4038070 con 0x55a2bf1a8700 2023-09-13T09:53:22.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.830+0000 7f0c11be8b80 10 client.28393 fetch_fsmap finished waiting for FSMap version 45 2023-09-13T09:53:22.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.830+0000 7f0c11be8b80 10 client.28393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:22.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.830+0000 7f0c11be8b80 20 client.28393 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:22.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.830+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf233ab0 0x55a2bf235ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:22.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.830+0000 7f0c11be8b80 4 client.28393 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:53:22.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.830+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a2bf0b3050 con 0x55a2bf233ab0 2023-09-13T09:53:22.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.831+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf233ab0 0x55a2bf235ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:22.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.831+0000 7f0bdeffd700 10 client.28393 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:22.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.831+0000 7f0bfeffd700 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf233ab0 0x55a2bf235ea0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30bae62b39cf3eb6 server_cookie=28c6dcd50c7d81b2 in_seq=0 out_seq=0 2023-09-13T09:53:22.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0bdeffd700 1 -- 172.21.15.6:0/3660426897 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55a2bf0b3050 con 0x55a2bf233ab0 2023-09-13T09:53:22.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0bdeffd700 10 client.28393 handle_command_reply: tid=0 2023-09-13T09:53:22.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 client.28393 shutdown 2023-09-13T09:53:22.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 msgr2=0x55a2bf1b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b49a0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x55a2bf19e7f0 tx=0x7f0bf4012410 comp rx=0 tx=0).stop 2023-09-13T09:53:22.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 shutdown_connections 2023-09-13T09:53:22.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a2bf1a9060 0x55a2bf1b79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a2bf233ab0 0x55a2bf235ea0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a2bf1a7a00 0x55a2bf1b4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 --2- 172.21.15.6:0/3660426897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a2bf1a8700 0x55a2bf1b49a0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0bdeffd700 0 client.28393 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:22.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 >> 172.21.15.6:0/3660426897 conn(0x55a2bf105c80 msgr2=0x55a2bf1ab8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:22.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 shutdown_connections 2023-09-13T09:53:22.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 1 -- 172.21.15.6:0/3660426897 wait complete. 2023-09-13T09:53:22.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.832+0000 7f0c11be8b80 20 client.28393 trim_cache size 0 max 16384 2023-09-13T09:53:22.846 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:53:22.846 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:53:22.846 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:53:22.847 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:53:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0be80a06c0 msgr2=0x7f0be80a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0be80a06c0 0x7f0be80a2b80 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009df0 tx=0x7f0bf0009260 comp rx=0 tx=0).stop 2023-09-13T09:53:22.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 msgr2=0x7f0c0019e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c0019e0e0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7f0bf800b780 tx=0x7f0bf800bab0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 shutdown_connections 2023-09-13T09:53:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0be80a06c0 0x7f0be80a2b80 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0c00106b30 0x7f0c0019e0e0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0c001018d0 0x7f0c00196b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 --2- 172.21.15.6:0/2763555446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c00104200 0x7f0c00197070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:22.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 >> 172.21.15.6:0/2763555446 conn(0x7f0c000fb260 msgr2=0x7f0c00102580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:22.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 shutdown_connections 2023-09-13T09:53:22.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:22.833+0000 7f0c05a03700 1 -- 172.21.15.6:0/2763555446 wait complete. 2023-09-13T09:53:22.850 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:53:22.851 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:53:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.001+0000 7f628957a700 1 -- 172.21.15.6:0/1301111365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6284101850 msgr2=0x7f6284108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.001+0000 7f628957a700 1 --2- 172.21.15.6:0/1301111365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6284101850 0x7f6284108100 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f627c00b0d0 tx=0x7f627c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.001+0000 7f628957a700 1 -- 172.21.15.6:0/1301111365 shutdown_connections 2023-09-13T09:53:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.001+0000 7f628957a700 1 --2- 172.21.15.6:0/1301111365 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6284101850 0x7f6284108100 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.001+0000 7f628957a700 1 --2- 172.21.15.6:0/1301111365 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f62840ffcc0 0x7f62841000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.001+0000 7f628957a700 1 --2- 172.21.15.6:0/1301111365 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6284100eb0 0x7f6284101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.001+0000 7f628957a700 1 -- 172.21.15.6:0/1301111365 >> 172.21.15.6:0/1301111365 conn(0x7f62840fb210 msgr2=0x7f62840fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 -- 172.21.15.6:0/1301111365 shutdown_connections 2023-09-13T09:53:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 -- 172.21.15.6:0/1301111365 wait complete. 2023-09-13T09:53:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 Processor -- start 2023-09-13T09:53:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 -- start start 2023-09-13T09:53:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62840ffcc0 0x7f6284196b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6284100eb0 0x7f62841970c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6284101850 0x7f628419e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.002+0000 7f628957a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628419e700 con 0x7f62840ffcc0 2023-09-13T09:53:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f628957a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628419e840 con 0x7f6284101850 2023-09-13T09:53:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f628957a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f628419e9d0 con 0x7f6284100eb0 2023-09-13T09:53:23.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62840ffcc0 0x7f6284196b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62840ffcc0 0x7f6284196b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42468/0 (socket says 172.21.15.6:42468) 2023-09-13T09:53:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 -- 172.21.15.6:0/1778899537 learned_addr learned my addr 172.21.15.6:0/1778899537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f62827fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6284100eb0 0x7f62841970c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f62837fe700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6284101850 0x7f628419e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 -- 172.21.15.6:0/1778899537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6284100eb0 msgr2=0x7f62841970c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6284100eb0 0x7f62841970c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 -- 172.21.15.6:0/1778899537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6284101850 msgr2=0x7f628419e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6284101850 0x7f628419e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 -- 172.21.15.6:0/1778899537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f627c009d00 con 0x7f62840ffcc0 2023-09-13T09:53:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f6282ffd700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62840ffcc0 0x7f6284196b80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f627400e970 tx=0x7f627400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f626bfff700 1 -- 172.21.15.6:0/1778899537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274009790 con 0x7f62840ffcc0 2023-09-13T09:53:23.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f628419ecb0 con 0x7f62840ffcc0 2023-09-13T09:53:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.003+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628419f1c0 con 0x7f62840ffcc0 2023-09-13T09:53:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.004+0000 7f626bfff700 1 -- 172.21.15.6:0/1778899537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f627400c7e0 con 0x7f62840ffcc0 2023-09-13T09:53:23.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.004+0000 7f626bfff700 1 -- 172.21.15.6:0/1778899537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6274003c70 con 0x7f62840ffcc0 2023-09-13T09:53:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.004+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6270005320 con 0x7f62840ffcc0 2023-09-13T09:53:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.006+0000 7f626bfff700 1 -- 172.21.15.6:0/1778899537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6274004220 con 0x7f62840ffcc0 2023-09-13T09:53:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.006+0000 7f626bfff700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f626c0a0640 0x7f626c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.006+0000 7f626bfff700 1 -- 172.21.15.6:0/1778899537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6274014070 con 0x7f62840ffcc0 2023-09-13T09:53:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.006+0000 7f62827fc700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f626c0a0640 0x7f626c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.007+0000 7f62827fc700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f626c0a0640 0x7f626c0a2b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6278009a10 tx=0x7f6278009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.010+0000 7f626bfff700 1 -- 172.21.15.6:0/1778899537 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f6274095950 con 0x7f62840ffcc0 2023-09-13T09:53:23.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.317+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62700058a0 con 0x7f62840ffcc0 2023-09-13T09:53:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.318+0000 7f626bfff700 1 -- 172.21.15.6:0/1778899537 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) v1 ==== 94+0+11362 (secure 0 0 0) 0x7f6274082e60 con 0x7f62840ffcc0 2023-09-13T09:53:23.320 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:53:23.320 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":46,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:53:22.147048+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:53:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f626c0a0640 msgr2=0x7f626c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f626c0a0640 0x7f626c0a2b00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f6278009a10 tx=0x7f6278009190 comp rx=0 tx=0).stop 2023-09-13T09:53:23.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62840ffcc0 msgr2=0x7f6284196b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62840ffcc0 0x7f6284196b80 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f627400e970 tx=0x7f627400ec80 comp rx=0 tx=0).stop 2023-09-13T09:53:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 shutdown_connections 2023-09-13T09:53:23.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6284101850 0x7f628419e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f626c0a0640 0x7f626c0a2b00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62840ffcc0 0x7f6284196b80 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 --2- 172.21.15.6:0/1778899537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6284100eb0 0x7f62841970c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 >> 172.21.15.6:0/1778899537 conn(0x7f62840fb210 msgr2=0x7f6284068ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 shutdown_connections 2023-09-13T09:53:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.320+0000 7f628957a700 1 -- 172.21.15.6:0/1778899537 wait complete. 2023-09-13T09:53:23.325 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 46 2023-09-13T09:53:23.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:53:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 -- 172.21.15.6:0/2245672978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8102910 msgr2=0x7fdab81091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 --2- 172.21.15.6:0/2245672978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8102910 0x7fdab81091c0 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fdab000b0d0 tx=0x7fdab000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 -- 172.21.15.6:0/2245672978 shutdown_connections 2023-09-13T09:53:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 --2- 172.21.15.6:0/2245672978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8102910 0x7fdab81091c0 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 --2- 172.21.15.6:0/2245672978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdab8100d80 0x7fdab81011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 --2- 172.21.15.6:0/2245672978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab8101f70 0x7fdab81023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 -- 172.21.15.6:0/2245672978 >> 172.21.15.6:0/2245672978 conn(0x7fdab80fc310 msgr2=0x7fdab80fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 -- 172.21.15.6:0/2245672978 shutdown_connections 2023-09-13T09:53:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.487+0000 7fdabedc8700 1 -- 172.21.15.6:0/2245672978 wait complete. 2023-09-13T09:53:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 Processor -- start 2023-09-13T09:53:23.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 -- start start 2023-09-13T09:53:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab8100d80 0x7fdab8196b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8101f70 0x7fdab81970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdab8102910 0x7fdab819e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab819e6e0 con 0x7fdab8101f70 2023-09-13T09:53:23.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab819e820 con 0x7fdab8102910 2023-09-13T09:53:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabedc8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab819e9b0 con 0x7fdab8100d80 2023-09-13T09:53:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8101f70 0x7fdab81970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8101f70 0x7fdab81970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42484/0 (socket says 172.21.15.6:42484) 2023-09-13T09:53:23.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdab7fff700 1 -- 172.21.15.6:0/3779097610 learned_addr learned my addr 172.21.15.6:0/3779097610 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.488+0000 7fdabd365700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdab8102910 0x7fdab819e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdabcb64700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab8100d80 0x7fdab8196b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab7fff700 1 -- 172.21.15.6:0/3779097610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab8100d80 msgr2=0x7fdab8196b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab7fff700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab8100d80 0x7fdab8196b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab7fff700 1 -- 172.21.15.6:0/3779097610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdab8102910 msgr2=0x7fdab819e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab7fff700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdab8102910 0x7fdab819e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab7fff700 1 -- 172.21.15.6:0/3779097610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdab0009d00 con 0x7fdab8101f70 2023-09-13T09:53:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdabcb64700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab8100d80 0x7fdab8196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:23.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab7fff700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8101f70 0x7fdab81970a0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400d950 tx=0x7fdaa400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab5ffb700 1 -- 172.21.15.6:0/3779097610 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4009940 con 0x7fdab8101f70 2023-09-13T09:53:23.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab819ec90 con 0x7fdab8101f70 2023-09-13T09:53:23.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab5ffb700 1 -- 172.21.15.6:0/3779097610 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdaa4010460 con 0x7fdab8101f70 2023-09-13T09:53:23.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdab5ffb700 1 -- 172.21.15.6:0/3779097610 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400f620 con 0x7fdab8101f70 2023-09-13T09:53:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.489+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab819f1a0 con 0x7fdab8101f70 2023-09-13T09:53:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.492+0000 7fdab5ffb700 1 -- 172.21.15.6:0/3779097610 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdaa40108d0 con 0x7fdab8101f70 2023-09-13T09:53:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.492+0000 7fdab5ffb700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdaa80a0640 0x7fdaa80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.492+0000 7fdab5ffb700 1 -- 172.21.15.6:0/3779097610 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdaa40cba40 con 0x7fdab8101f70 2023-09-13T09:53:23.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.492+0000 7fdabcb64700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdaa80a0640 0x7fdaa80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.493+0000 7fdabcb64700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdaa80a0640 0x7fdaa80a2b00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdab8101dd0 tx=0x7fdaac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 Processor -- start 2023-09-13T09:53:23.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 -- start start 2023-09-13T09:53:23.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254d4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254d38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254d4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560025428780 con 0x5600254d3e10 2023-09-13T09:53:23.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600254260a0 con 0x5600254d4b10 2023-09-13T09:53:23.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdacafadb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560025421990 con 0x5600254d5470 2023-09-13T09:53:23.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdabd365700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254d4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdabd365700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254d4270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42492/0 (socket says 172.21.15.6:42492) 2023-09-13T09:53:23.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdabd365700 1 -- 172.21.15.6:0/4054288957 learned_addr learned my addr 172.21.15.6:0/4054288957 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdab7fff700 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254d38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.494+0000 7fdabcb64700 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254d4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdab7fff700 1 -- 172.21.15.6:0/4054288957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 msgr2=0x5600254d4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdab7fff700 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254d4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdab7fff700 1 -- 172.21.15.6:0/4054288957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 msgr2=0x5600254d4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdab7fff700 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254d4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdab7fff700 1 -- 172.21.15.6:0/4054288957 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600252a1630 con 0x5600254d5470 2023-09-13T09:53:23.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdabd365700 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254d4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:23.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdab7fff700 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254d38d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40c9540 tx=0x7fdaa4010cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fa8a023b0b28199 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdaa2ffd700 1 -- 172.21.15.6:0/4054288957 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa409d010 con 0x5600254d5470 2023-09-13T09:53:23.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdaa2ffd700 1 -- 172.21.15.6:0/4054288957 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdaa40a1250 con 0x5600254d5470 2023-09-13T09:53:23.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.495+0000 7fdaa2ffd700 1 -- 172.21.15.6:0/4054288957 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40988d0 con 0x5600254d5470 2023-09-13T09:53:23.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 -- 172.21.15.6:0/4054288957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 msgr2=0x5600254d38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254d38d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40c9540 tx=0x7fdaa4010cd0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 -- 172.21.15.6:0/4054288957 shutdown_connections 2023-09-13T09:53:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254d4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254d4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4054288957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254d38d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 -- 172.21.15.6:0/4054288957 >> 172.21.15.6:0/4054288957 conn(0x56002542dc80 msgr2=0x5600254c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 -- 172.21.15.6:0/4054288957 shutdown_connections 2023-09-13T09:53:23.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 -- 172.21.15.6:0/4054288957 wait complete. 2023-09-13T09:53:23.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.496+0000 7fdacafadb80 1 -- start start 2023-09-13T09:53:23.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 1 Processor -- start 2023-09-13T09:53:23.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d3e10 0x5600254dd3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254dd8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d5470 0x5600254e4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600253bfbb0 con 0x5600254d4b10 2023-09-13T09:53:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600253bf8b0 con 0x5600254d5470 2023-09-13T09:53:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600252a3920 con 0x5600254d3e10 2023-09-13T09:53:23.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdacafadb80 10 client.0 _ll_register_callbacks cb 0x5600253bd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254dd8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdabcb64700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d3e10 0x5600254dd3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdabd365700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d5470 0x5600254e4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254dd8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42500/0 (socket says 172.21.15.6:42500) 2023-09-13T09:53:23.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdab7fff700 1 -- 172.21.15.6:0/2297156802 learned_addr learned my addr 172.21.15.6:0/2297156802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdabcb64700 1 -- 172.21.15.6:0/2297156802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d5470 msgr2=0x5600254e4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.497+0000 7fdabcb64700 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d5470 0x5600254e4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdabcb64700 1 -- 172.21.15.6:0/2297156802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 msgr2=0x5600254dd8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdabcb64700 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254dd8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdabcb64700 1 -- 172.21.15.6:0/2297156802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab819f1a0 con 0x5600254d3e10 2023-09-13T09:53:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdab7fff700 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdabcb64700 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d3e10 0x5600254dd3b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009810 tx=0x7fdaac0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68a8ef64b389140 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fda97fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fda97fff700 1 -- 172.21.15.6:0/2297156802 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac004520 con 0x5600254d3e10 2023-09-13T09:53:23.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600254c2670 con 0x5600254d3e10 2023-09-13T09:53:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fda97fff700 1 -- 172.21.15.6:0/2297156802 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdaac018070 con 0x5600254d3e10 2023-09-13T09:53:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fda97fff700 1 -- 172.21.15.6:0/2297156802 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaac012450 con 0x5600254d3e10 2023-09-13T09:53:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdacafadb80 10 client.28411 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x5600254397a0 con 0x5600254d3e10 2023-09-13T09:53:23.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.498+0000 7fda97fff700 1 -- 172.21.15.6:0/2297156802 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5600254c2670 con 0x5600254d3e10 2023-09-13T09:53:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fda97fff700 1 -- 172.21.15.6:0/2297156802 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fdaac021530 con 0x5600254d3e10 2023-09-13T09:53:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdacafadb80 10 client.28411 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdacafadb80 10 client.28411 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:53:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdacafadb80 20 client.28411 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:23.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5600254e92e0 0x5600254eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdacafadb80 4 client.28411 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56002541a970 con 0x5600254e92e0 2023-09-13T09:53:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdab7fff700 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5600254e92e0 0x5600254eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fda97fff700 10 client.28411 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:23.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.499+0000 7fdab7fff700 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5600254e92e0 0x5600254eb700 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5f0a79f0556eb91b server_cookie=98c9eaa97d74f9c3 in_seq=0 out_seq=0 2023-09-13T09:53:23.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.508+0000 7fda97fff700 1 -- 172.21.15.6:0/2297156802 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56002541a970 con 0x5600254e92e0 2023-09-13T09:53:23.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.508+0000 7fda97fff700 10 client.28411 handle_command_reply: tid=0 2023-09-13T09:53:23.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.508+0000 7fdacafadb80 1 client.28411 shutdown 2023-09-13T09:53:23.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d3e10 msgr2=0x5600254dd3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d3e10 0x5600254dd3b0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009810 tx=0x7fdaac0047c0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 shutdown_connections 2023-09-13T09:53:23.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5600254e92e0 0x5600254eb700 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d5470 0x5600254e4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d3e10 0x5600254dd3b0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2297156802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254dd8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fda97fff700 0 client.28411 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:23.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 >> 172.21.15.6:0/2297156802 conn(0x56002542dc80 msgr2=0x5600254c47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 shutdown_connections 2023-09-13T09:53:23.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 1 -- 172.21.15.6:0/2297156802 wait complete. 2023-09-13T09:53:23.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.509+0000 7fdacafadb80 20 client.28411 trim_cache size 0 max 16384 2023-09-13T09:53:23.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.526+0000 7fdacafadb80 1 Processor -- start 2023-09-13T09:53:23.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdacafadb80 1 -- start start 2023-09-13T09:53:23.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254eb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254e48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254dc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdacafadb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600254e8e10 con 0x5600254d3e10 2023-09-13T09:53:23.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdacafadb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600254cb9f0 con 0x5600254d4b10 2023-09-13T09:53:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdacafadb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600254cada0 con 0x5600254d5470 2023-09-13T09:53:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254eb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254eb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42504/0 (socket says 172.21.15.6:42504) 2023-09-13T09:53:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254e48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 -- 172.21.15.6:0/2091842814 learned_addr learned my addr 172.21.15.6:0/2091842814 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabd365700 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254dc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 -- 172.21.15.6:0/2091842814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 msgr2=0x5600254dc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254dc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 -- 172.21.15.6:0/2091842814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 msgr2=0x5600254e48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254e48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.527+0000 7fdabcb64700 1 -- 172.21.15.6:0/2091842814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56002524dde0 con 0x5600254d3e10 2023-09-13T09:53:23.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.528+0000 7fdabcb64700 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254eb6d0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009e70 tx=0x7fdaac005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535c63355f7a6a12 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.528+0000 7fdaa37fe700 1 -- 172.21.15.6:0/2091842814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac003cf0 con 0x5600254d3e10 2023-09-13T09:53:23.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.528+0000 7fdaa37fe700 1 -- 172.21.15.6:0/2091842814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdaac003e50 con 0x5600254d3e10 2023-09-13T09:53:23.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.528+0000 7fdaa37fe700 1 -- 172.21.15.6:0/2091842814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaac012b70 con 0x5600254d3e10 2023-09-13T09:53:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.529+0000 7fdacafadb80 1 -- 172.21.15.6:0/2091842814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 msgr2=0x5600254eb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.529+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254eb6d0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009e70 tx=0x7fdaac005ba0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.529+0000 7fdacafadb80 1 -- 172.21.15.6:0/2091842814 shutdown_connections 2023-09-13T09:53:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.529+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254dc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.529+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d3e10 0x5600254eb6d0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.529+0000 7fdacafadb80 1 --2- 172.21.15.6:0/2091842814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d4b10 0x5600254e48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.529+0000 7fdacafadb80 1 -- 172.21.15.6:0/2091842814 >> 172.21.15.6:0/2091842814 conn(0x56002542dc80 msgr2=0x5600254c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.530+0000 7fdacafadb80 1 -- 172.21.15.6:0/2091842814 shutdown_connections 2023-09-13T09:53:23.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.530+0000 7fdacafadb80 1 -- 172.21.15.6:0/2091842814 wait complete. 2023-09-13T09:53:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.530+0000 7fdacafadb80 1 -- start start 2023-09-13T09:53:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 1 Processor -- start 2023-09-13T09:53:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d3e10 0x5600254d2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254d3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254cf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600254cff20 con 0x5600254d4b10 2023-09-13T09:53:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600254d0090 con 0x5600254d3e10 2023-09-13T09:53:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600254d0250 con 0x5600254d5470 2023-09-13T09:53:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdacafadb80 10 client.0 _ll_register_callbacks cb 0x5600253bd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254d3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdabcb64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d3e10 0x5600254d2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdabcb64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d3e10 0x5600254d2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36034/0 (socket says 172.21.15.6:36034) 2023-09-13T09:53:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdab7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254d3290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42512/0 (socket says 172.21.15.6:42512) 2023-09-13T09:53:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdabcb64700 1 -- 172.21.15.6:0/4123604613 learned_addr learned my addr 172.21.15.6:0/4123604613 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.531+0000 7fdabd365700 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254cf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdab7fff700 1 -- 172.21.15.6:0/4123604613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 msgr2=0x5600254cf810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdab7fff700 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254cf810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdab7fff700 1 -- 172.21.15.6:0/4123604613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d3e10 msgr2=0x5600254d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdab7fff700 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d3e10 0x5600254d2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdab7fff700 1 -- 172.21.15.6:0/4123604613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600254397a0 con 0x5600254d4b10 2023-09-13T09:53:23.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdab7fff700 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254d3290 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40a0d20 tx=0x7fdaa4099440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06a2dbdd41d3baa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fda97fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fda97fff700 1 -- 172.21.15.6:0/4123604613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaa40b7210 con 0x5600254d4b10 2023-09-13T09:53:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fda97fff700 1 -- 172.21.15.6:0/4123604613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdaa40b1040 con 0x5600254d4b10 2023-09-13T09:53:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdaa40a1250 con 0x5600254d4b10 2023-09-13T09:53:23.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fda97fff700 1 -- 172.21.15.6:0/4123604613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdaa40994b0 con 0x5600254d4b10 2023-09-13T09:53:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdacafadb80 10 client.19095 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.532+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x560025236c60 con 0x5600254d4b10 2023-09-13T09:53:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fda97fff700 1 -- 172.21.15.6:0/4123604613 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdaa40a1250 con 0x5600254d4b10 2023-09-13T09:53:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fda97fff700 1 -- 172.21.15.6:0/4123604613 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fdaa40987d0 con 0x5600254d4b10 2023-09-13T09:53:23.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fdacafadb80 10 client.19095 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fdacafadb80 10 client.19095 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:53:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fdacafadb80 20 client.19095 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560025541da0 0x5600255441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fdacafadb80 4 client.19095 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:23.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5600253db050 con 0x560025541da0 2023-09-13T09:53:23.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.533+0000 7fdabcb64700 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560025541da0 0x5600255441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.534+0000 7fda97fff700 10 client.19095 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:23.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.534+0000 7fdabcb64700 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560025541da0 0x5600255441c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=43872e01b1a1abb server_cookie=81f1d7a351430ef3 in_seq=0 out_seq=0 2023-09-13T09:53:23.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fda97fff700 1 -- 172.21.15.6:0/4123604613 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5600253db050 con 0x560025541da0 2023-09-13T09:53:23.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fda97fff700 10 client.19095 handle_command_reply: tid=0 2023-09-13T09:53:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 client.19095 shutdown 2023-09-13T09:53:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 msgr2=0x5600254d3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254d3290 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7fdaa40a0d20 tx=0x7fdaa4099440 comp rx=0 tx=0).stop 2023-09-13T09:53:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 shutdown_connections 2023-09-13T09:53:23.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560025541da0 0x5600255441c0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5600254d5470 0x5600254cf810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5600254d3e10 0x5600254d2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 --2- 172.21.15.6:0/4123604613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5600254d4b10 0x5600254d3290 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fda97fff700 0 client.19095 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:23.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 >> 172.21.15.6:0/4123604613 conn(0x56002542dc80 msgr2=0x5600254dc020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 shutdown_connections 2023-09-13T09:53:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 1 -- 172.21.15.6:0/4123604613 wait complete. 2023-09-13T09:53:23.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.537+0000 7fdacafadb80 20 client.19095 trim_cache size 0 max 16384 2023-09-13T09:53:23.549 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdaa80a0640 msgr2=0x7fdaa80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdaa80a0640 0x7fdaa80a2b00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fdab8101dd0 tx=0x7fdaac009260 comp rx=0 tx=0).stop 2023-09-13T09:53:23.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8101f70 msgr2=0x7fdab81970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8101f70 0x7fdab81970a0 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400d950 tx=0x7fdaa400dc60 comp rx=0 tx=0).stop 2023-09-13T09:53:23.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 shutdown_connections 2023-09-13T09:53:23.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdab8102910 0x7fdab819e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab8100d80 0x7fdab8196b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdaa80a0640 0x7fdaa80a2b00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 --2- 172.21.15.6:0/3779097610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdab8101f70 0x7fdab81970a0 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 >> 172.21.15.6:0/3779097610 conn(0x7fdab80fc310 msgr2=0x7fdab8105410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 shutdown_connections 2023-09-13T09:53:23.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.538+0000 7fdabedc8700 1 -- 172.21.15.6:0/3779097610 wait complete. 2023-09-13T09:53:23.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 30177 41.79 MB/sec warmup 43 sec latency 62.150 ms 2023-09-13T09:53:23.556 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:53:23.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.726+0000 7fc2ad426700 1 -- 172.21.15.6:0/882788324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 msgr2=0x7fc2a8102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.726+0000 7fc2ad426700 1 --2- 172.21.15.6:0/882788324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 0x7fc2a8102410 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7fc29c0099c0 tx=0x7fc29c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 -- 172.21.15.6:0/882788324 shutdown_connections 2023-09-13T09:53:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 --2- 172.21.15.6:0/882788324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 0x7fc2a8109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 --2- 172.21.15.6:0/882788324 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a8100dc0 0x7fc2a81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 --2- 172.21.15.6:0/882788324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 0x7fc2a8102410 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 -- 172.21.15.6:0/882788324 >> 172.21.15.6:0/882788324 conn(0x7fc2a80fc350 msgr2=0x7fc2a80fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 -- 172.21.15.6:0/882788324 shutdown_connections 2023-09-13T09:53:23.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 -- 172.21.15.6:0/882788324 wait complete. 2023-09-13T09:53:23.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.727+0000 7fc2ad426700 1 Processor -- start 2023-09-13T09:53:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2ad426700 1 -- start start 2023-09-13T09:53:23.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2ad426700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a8100dc0 0x7fc2a8074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2ad426700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 0x7fc2a80730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2ad426700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 0x7fc2a80735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2ad426700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a819a950 con 0x7fc2a8101fb0 2023-09-13T09:53:23.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2ad426700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a819aac0 con 0x7fc2a8100dc0 2023-09-13T09:53:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2ad426700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a819ac80 con 0x7fc2a8102950 2023-09-13T09:53:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 0x7fc2a80730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 0x7fc2a80735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 0x7fc2a80735e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45582/0 (socket says 172.21.15.6:45582) 2023-09-13T09:53:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 -- 172.21.15.6:0/3547543247 learned_addr learned my addr 172.21.15.6:0/3547543247 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a8100dc0 0x7fc2a8074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 -- 172.21.15.6:0/3547543247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a8100dc0 msgr2=0x7fc2a8074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a8100dc0 0x7fc2a8074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 -- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 msgr2=0x7fc2a80730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 0x7fc2a80730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a77fe700 1 -- 172.21.15.6:0/3547543247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc29c0095f0 con 0x7fc2a8102950 2023-09-13T09:53:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.728+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 0x7fc2a80730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.729+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 0x7fc2a80735e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000ef30 tx=0x7fc2a000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.729+0000 7fc28ffff700 1 -- 172.21.15.6:0/3547543247 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0018070 con 0x7fc2a8102950 2023-09-13T09:53:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.729+0000 7fc28ffff700 1 -- 172.21.15.6:0/3547543247 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2a000f040 con 0x7fc2a8102950 2023-09-13T09:53:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.729+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a819af00 con 0x7fc2a8102950 2023-09-13T09:53:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.729+0000 7fc28ffff700 1 -- 172.21.15.6:0/3547543247 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a000cd00 con 0x7fc2a8102950 2023-09-13T09:53:23.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.729+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a819b3c0 con 0x7fc2a8102950 2023-09-13T09:53:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.732+0000 7fc28ffff700 1 -- 172.21.15.6:0/3547543247 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc2a0003a00 con 0x7fc2a8102950 2023-09-13T09:53:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.732+0000 7fc28ffff700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2900a0640 0x7fc2900a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2900a0640 0x7fc2900a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc28ffff700 1 -- 172.21.15.6:0/3547543247 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc2a00cb750 con 0x7fc2a8102950 2023-09-13T09:53:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 Processor -- start 2023-09-13T09:53:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 -- start start 2023-09-13T09:53:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc3503b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3504060 0x55fbc35024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3502a00 0x55fbc3502e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc345b780 con 0x55fbc3503700 2023-09-13T09:53:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc34590a0 con 0x55fbc3504060 2023-09-13T09:53:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc3454990 con 0x55fbc3502a00 2023-09-13T09:53:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2900a0640 0x7fc2900a2b00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8101e10 tx=0x7fc298009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc3503b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc3503b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42532/0 (socket says 172.21.15.6:42532) 2023-09-13T09:53:23.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/265469197 learned_addr learned my addr 172.21.15.6:0/265469197 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3504060 0x55fbc35024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3502a00 0x55fbc3502e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/265469197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3502a00 msgr2=0x55fbc3502e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3502a00 0x55fbc3502e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/265469197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3504060 msgr2=0x55fbc35024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.733+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3504060 0x55fbc35024c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.734+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/265469197 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbc32d4630 con 0x55fbc3503700 2023-09-13T09:53:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.734+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc3503b20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fc298011d30 tx=0x7fc298014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf34dabf513c5a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc28d7fa700 1 -- 172.21.15.6:0/265469197 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29800eb20 con 0x55fbc3503700 2023-09-13T09:53:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc28d7fa700 1 -- 172.21.15.6:0/265469197 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc298021070 con 0x55fbc3503700 2023-09-13T09:53:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc28d7fa700 1 -- 172.21.15.6:0/265469197 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2980253d0 con 0x55fbc3503700 2023-09-13T09:53:23.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 -- 172.21.15.6:0/265469197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 msgr2=0x55fbc3503b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc3503b20 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fc298011d30 tx=0x7fc298014000 comp rx=0 tx=0).stop 2023-09-13T09:53:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 -- 172.21.15.6:0/265469197 shutdown_connections 2023-09-13T09:53:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3502a00 0x55fbc3502e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc3503b20 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/265469197 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3504060 0x55fbc35024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 -- 172.21.15.6:0/265469197 >> 172.21.15.6:0/265469197 conn(0x55fbc3460c80 msgr2=0x55fbc34fcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.735+0000 7fc2b960bb80 1 -- 172.21.15.6:0/265469197 shutdown_connections 2023-09-13T09:53:23.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 -- 172.21.15.6:0/265469197 wait complete. 2023-09-13T09:53:23.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 -- start start 2023-09-13T09:53:23.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 Processor -- start 2023-09-13T09:53:23.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3502a00 0x55fbc350bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3503700 0x55fbc350c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc3513540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc33f2bb0 con 0x55fbc3502a00 2023-09-13T09:53:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc33f28b0 con 0x55fbc3503700 2023-09-13T09:53:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc32d6920 con 0x55fbc3504060 2023-09-13T09:53:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2b960bb80 10 client.0 _ll_register_callbacks cb 0x55fbc33f0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3502a00 0x55fbc350bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3502a00 0x55fbc350bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42538/0 (socket says 172.21.15.6:42538) 2023-09-13T09:53:23.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/1951658460 learned_addr learned my addr 172.21.15.6:0/1951658460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc3513540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.736+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3503700 0x55fbc350c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 msgr2=0x55fbc3513540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc3513540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/1951658460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3503700 msgr2=0x55fbc350c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3503700 0x55fbc350c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2a6ffd700 1 -- 172.21.15.6:0/1951658460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc298017070 con 0x55fbc3502a00 2023-09-13T09:53:23.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3502a00 0x55fbc350bfc0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fc298005920 tx=0x7fc29800eb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8d7c0985616819 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc28aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc28aff5700 1 -- 172.21.15.6:0/1951658460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc298004020 con 0x55fbc3502a00 2023-09-13T09:53:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc28aff5700 1 -- 172.21.15.6:0/1951658460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc298004180 con 0x55fbc3502a00 2023-09-13T09:53:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fbc34f5670 con 0x55fbc3502a00 2023-09-13T09:53:23.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc28aff5700 1 -- 172.21.15.6:0/1951658460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc298004340 con 0x55fbc3502a00 2023-09-13T09:53:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2b960bb80 10 client.19107 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.737+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55fbc346c7a0 con 0x55fbc3502a00 2023-09-13T09:53:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc28aff5700 1 -- 172.21.15.6:0/1951658460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fbc34f5670 con 0x55fbc3502a00 2023-09-13T09:53:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc28aff5700 1 -- 172.21.15.6:0/1951658460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc298005490 con 0x55fbc3502a00 2023-09-13T09:53:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc2b960bb80 10 client.19107 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:23.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc2b960bb80 10 client.19107 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:53:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc2b960bb80 20 client.19107 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc3519fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc2b960bb80 4 client.19107 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fbc344d970 con 0x55fbc3517b80 2023-09-13T09:53:23.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.738+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc3519fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.740+0000 7fc28aff5700 10 client.19107 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:23.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.740+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc3519fa0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b36cb3cb7d6fe08f server_cookie=75261e145e6aefd6 in_seq=0 out_seq=0 2023-09-13T09:53:23.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.742+0000 7fc28aff5700 1 -- 172.21.15.6:0/1951658460 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fbc344d970 con 0x55fbc3517b80 2023-09-13T09:53:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.742+0000 7fc28aff5700 10 client.19107 handle_command_reply: tid=0 2023-09-13T09:53:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.742+0000 7fc2b960bb80 1 client.19107 shutdown 2023-09-13T09:53:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3502a00 msgr2=0x55fbc350bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3502a00 0x55fbc350bfc0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fc298005920 tx=0x7fc29800eb20 comp rx=0 tx=0).stop 2023-09-13T09:53:23.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 shutdown_connections 2023-09-13T09:53:23.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc3519fa0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc3513540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc28aff5700 0 client.19107 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:23.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3502a00 0x55fbc350bfc0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/1951658460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3503700 0x55fbc350c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 >> 172.21.15.6:0/1951658460 conn(0x55fbc3460c80 msgr2=0x55fbc34f77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 shutdown_connections 2023-09-13T09:53:23.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 1 -- 172.21.15.6:0/1951658460 wait complete. 2023-09-13T09:53:23.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.743+0000 7fc2b960bb80 20 client.19107 trim_cache size 0 max 16384 2023-09-13T09:53:23.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 Processor -- start 2023-09-13T09:53:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 -- start start 2023-09-13T09:53:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 0x55fbc35024c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3503700 0x55fbc3513500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3504060 0x55fbc35069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc34fefd0 con 0x55fbc3504060 2023-09-13T09:53:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc35176f0 con 0x55fbc3502a00 2023-09-13T09:53:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc34fe370 con 0x55fbc3503700 2023-09-13T09:53:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.758+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3504060 0x55fbc35069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3504060 0x55fbc35069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42548/0 (socket says 172.21.15.6:42548) 2023-09-13T09:53:23.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 -- 172.21.15.6:0/2467206471 learned_addr learned my addr 172.21.15.6:0/2467206471 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 -- 172.21.15.6:0/2467206471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3503700 msgr2=0x55fbc3513500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:53:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/2467206471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3503700 0x55fbc3513500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 -- 172.21.15.6:0/2467206471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 msgr2=0x55fbc35024c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/2467206471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 0x55fbc35024c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 -- 172.21.15.6:0/2467206471 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fbc3280de0 con 0x55fbc3504060 2023-09-13T09:53:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/2467206471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3504060 0x55fbc35069c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c9200 tx=0x7fc2a00cb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb15969aa06e1de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.759+0000 7fc28dffb700 1 -- 172.21.15.6:0/2467206471 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a0099680 con 0x55fbc3504060 2023-09-13T09:53:23.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc28dffb700 1 -- 172.21.15.6:0/2467206471 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc2a00b8040 con 0x55fbc3504060 2023-09-13T09:53:23.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc28dffb700 1 -- 172.21.15.6:0/2467206471 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2a00b11c0 con 0x55fbc3504060 2023-09-13T09:53:23.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 -- 172.21.15.6:0/2467206471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3504060 msgr2=0x55fbc35069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/2467206471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3504060 0x55fbc35069c0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7fc2a00c9200 tx=0x7fc2a00cb040 comp rx=0 tx=0).stop 2023-09-13T09:53:23.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 -- 172.21.15.6:0/2467206471 shutdown_connections 2023-09-13T09:53:23.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/2467206471 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3504060 0x55fbc35069c0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/2467206471 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 0x55fbc35024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/2467206471 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3503700 0x55fbc3513500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 -- 172.21.15.6:0/2467206471 >> 172.21.15.6:0/2467206471 conn(0x55fbc3460c80 msgr2=0x55fbc3513e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 -- 172.21.15.6:0/2467206471 shutdown_connections 2023-09-13T09:53:23.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.760+0000 7fc2b960bb80 1 -- 172.21.15.6:0/2467206471 wait complete. 2023-09-13T09:53:23.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 -- start start 2023-09-13T09:53:23.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 Processor -- start 2023-09-13T09:53:23.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 0x55fbc3512e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc35133a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc350f900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc350ffe0 con 0x55fbc3503700 2023-09-13T09:53:23.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc3510150 con 0x55fbc3502a00 2023-09-13T09:53:23.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fbc3510310 con 0x55fbc3504060 2023-09-13T09:53:23.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2b960bb80 10 client.0 _ll_register_callbacks cb 0x55fbc33f0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:23.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2a67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc35133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2a67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc35133a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42552/0 (socket says 172.21.15.6:42552) 2023-09-13T09:53:23.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.761+0000 7fc2a67fc700 1 -- 172.21.15.6:0/230953431 learned_addr learned my addr 172.21.15.6:0/230953431 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2a77fe700 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc350f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2a67fc700 1 -- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 msgr2=0x55fbc350f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc350f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2a67fc700 1 -- 172.21.15.6:0/230953431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 msgr2=0x55fbc3512e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 0x55fbc3512e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2a67fc700 1 -- 172.21.15.6:0/230953431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a819b3c0 con 0x55fbc3503700 2023-09-13T09:53:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2a67fc700 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc35133a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fc29c000c00 tx=0x7fc29c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f984aa9903bfbcc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc28aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:23.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc28aff5700 1 -- 172.21.15.6:0/230953431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29c004cc0 con 0x55fbc3503700 2023-09-13T09:53:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc28aff5700 1 -- 172.21.15.6:0/230953431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc29c004e20 con 0x55fbc3503700 2023-09-13T09:53:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc298021070 con 0x55fbc3503700 2023-09-13T09:53:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc28aff5700 1 -- 172.21.15.6:0/230953431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc29c005040 con 0x55fbc3503700 2023-09-13T09:53:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2b960bb80 10 client.19113 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:23.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.762+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55fbc3269c60 con 0x55fbc3503700 2023-09-13T09:53:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc28aff5700 1 -- 172.21.15.6:0/230953431 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc298021070 con 0x55fbc3503700 2023-09-13T09:53:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc28aff5700 1 -- 172.21.15.6:0/230953431 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc29c00fb80 con 0x55fbc3503700 2023-09-13T09:53:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2b960bb80 10 client.19113 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2b960bb80 10 client.19113 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:53:23.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2b960bb80 20 client.19113 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc356f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2b960bb80 4 client.19113 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55fbc340e050 con 0x55fbc3517b80 2023-09-13T09:53:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc356f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc2a6ffd700 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc356f020 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=847cca34278d6279 server_cookie=647ca6bed55d5de2 in_seq=0 out_seq=0 2023-09-13T09:53:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.763+0000 7fc28aff5700 10 client.19113 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc28aff5700 1 -- 172.21.15.6:0/230953431 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55fbc340e050 con 0x55fbc3517b80 2023-09-13T09:53:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc28aff5700 10 client.19113 handle_command_reply: tid=0 2023-09-13T09:53:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 client.19113 shutdown 2023-09-13T09:53:23.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 msgr2=0x55fbc35133a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc35133a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7fc29c000c00 tx=0x7fc29c0047e0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 shutdown_connections 2023-09-13T09:53:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55fbc3517b80 0x55fbc356f020 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fbc3504060 0x55fbc350f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fbc3502a00 0x55fbc3512e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 --2- 172.21.15.6:0/230953431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fbc3503700 0x55fbc35133a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 >> 172.21.15.6:0/230953431 conn(0x55fbc3460c80 msgr2=0x55fbc35069c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc28aff5700 0 client.19113 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 shutdown_connections 2023-09-13T09:53:23.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 1 -- 172.21.15.6:0/230953431 wait complete. 2023-09-13T09:53:23.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.764+0000 7fc2b960bb80 20 client.19113 trim_cache size 0 max 16384 2023-09-13T09:53:23.785 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2900a0640 msgr2=0x7fc2900a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2900a0640 0x7fc2900a2b00 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8101e10 tx=0x7fc298009260 comp rx=0 tx=0).stop 2023-09-13T09:53:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 msgr2=0x7fc2a80735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 0x7fc2a80735e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc2a000ef30 tx=0x7fc2a000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 shutdown_connections 2023-09-13T09:53:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2a8102950 0x7fc2a80735e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc2a8100dc0 0x7fc2a8074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2900a0640 0x7fc2900a2b00 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 --2- 172.21.15.6:0/3547543247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a8101fb0 0x7fc2a80730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 >> 172.21.15.6:0/3547543247 conn(0x7fc2a80fc350 msgr2=0x7fc2a8105490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 shutdown_connections 2023-09-13T09:53:23.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.765+0000 7fc2ad426700 1 -- 172.21.15.6:0/3547543247 wait complete. 2023-09-13T09:53:23.789 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:53:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.975+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2706691850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c280ff630 msgr2=0x7f8c28101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.975+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2706691850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c280ff630 0x7f8c28101a60 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c009990 tx=0x7f8c1c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.976+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2706691850 shutdown_connections 2023-09-13T09:53:23.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.976+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2706691850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c28104970 0x7f8c28104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.976+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2706691850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c280ff630 0x7f8c28101a60 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.976+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2706691850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c28101fa0 0x7f8c28104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.976+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2706691850 >> 172.21.15.6:0/2706691850 conn(0x7f8c280fb250 msgr2=0x7f8c280fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:23.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.983+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2706691850 shutdown_connections 2023-09-13T09:53:23.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.983+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2706691850 wait complete. 2023-09-13T09:53:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.984+0000 7f8c2ef03700 1 Processor -- start 2023-09-13T09:53:23.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2ef03700 1 -- start start 2023-09-13T09:53:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2ef03700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c280ff630 0x7f8c2810aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2ef03700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c28101fa0 0x7f8c2810b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2ef03700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c28104970 0x7f8c281ad2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:23.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2ef03700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2810e0f0 con 0x7f8c28104970 2023-09-13T09:53:23.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2ef03700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c2810e260 con 0x7f8c280ff630 2023-09-13T09:53:23.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2ef03700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c281ad810 con 0x7f8c28101fa0 2023-09-13T09:53:23.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c28104970 0x7f8c281ad2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c28104970 0x7f8c281ad2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42564/0 (socket says 172.21.15.6:42564) 2023-09-13T09:53:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.985+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/2389469179 learned_addr learned my addr 172.21.15.6:0/2389469179 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/2389469179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c28101fa0 msgr2=0x7f8c2810b010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T09:53:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c2d4a0700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c28101fa0 0x7f8c2810b010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/2389469179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c280ff630 msgr2=0x7f8c2810aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:23.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c280ff630 0x7f8c2810aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:23.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c2d4a0700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c280ff630 0x7f8c2810aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:23.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/2389469179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c0095f0 con 0x7f8c28104970 2023-09-13T09:53:23.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c2d4a0700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c28104970 0x7f8c281ad2d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000b7b0 tx=0x7f8c2000bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:23.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c25ffb700 1 -- 172.21.15.6:0/2389469179 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20010880 con 0x7f8c28104970 2023-09-13T09:53:23.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c25ffb700 1 -- 172.21.15.6:0/2389469179 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c2000f3d0 con 0x7f8c28104970 2023-09-13T09:53:23.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.986+0000 7f8c25ffb700 1 -- 172.21.15.6:0/2389469179 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20010ea0 con 0x7f8c28104970 2023-09-13T09:53:23.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.987+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c281ada70 con 0x7f8c28104970 2023-09-13T09:53:23.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.987+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c281adf30 con 0x7f8c28104970 2023-09-13T09:53:24.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.991+0000 7f8c25ffb700 1 -- 172.21.15.6:0/2389469179 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8c2000f840 con 0x7f8c28104970 2023-09-13T09:53:24.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.991+0000 7f8c25ffb700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c180a06c0 0x7f8c180a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c25ffb700 1 -- 172.21.15.6:0/2389469179 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8c200cba10 con 0x7f8c28104970 2023-09-13T09:53:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 Processor -- start 2023-09-13T09:53:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 -- start start 2023-09-13T09:53:24.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c180a06c0 0x7f8c180a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d4cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4d060 0x562e67d4b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d4be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67ca4780 con 0x562e67d4ba00 2023-09-13T09:53:24.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67ca20a0 con 0x562e67d4c700 2023-09-13T09:53:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67c9d990 con 0x562e67d4d060 2023-09-13T09:53:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d4be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d4be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42576/0 (socket says 172.21.15.6:42576) 2023-09-13T09:53:24.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.992+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/3894307638 learned_addr learned my addr 172.21.15.6:0/3894307638 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4d060 0x562e67d4b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d4cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c180a06c0 0x7f8c180a2b80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c000c00 tx=0x7f8c1c004110 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c27fff700 1 -- 172.21.15.6:0/3894307638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 msgr2=0x562e67d4cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d4cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c27fff700 1 -- 172.21.15.6:0/3894307638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 msgr2=0x562e67d4be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d4be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.993+0000 7f8c27fff700 1 -- 172.21.15.6:0/3894307638 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e67b1d630 con 0x562e67d4d060 2023-09-13T09:53:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.994+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4d060 0x562e67d4b4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009b60 tx=0x7f8c14009e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6078df3fbd2fb20e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.994+0000 7f8c12ffd700 1 -- 172.21.15.6:0/3894307638 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14004230 con 0x562e67d4d060 2023-09-13T09:53:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.994+0000 7f8c12ffd700 1 -- 172.21.15.6:0/3894307638 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c14004cf0 con 0x562e67d4d060 2023-09-13T09:53:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.994+0000 7f8c12ffd700 1 -- 172.21.15.6:0/3894307638 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1400eec0 con 0x562e67d4d060 2023-09-13T09:53:24.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3894307638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4d060 msgr2=0x562e67d4b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4d060 0x562e67d4b4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009b60 tx=0x7f8c14009e70 comp rx=0 tx=0).stop 2023-09-13T09:53:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3894307638 shutdown_connections 2023-09-13T09:53:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d4be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d4cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3894307638 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4d060 0x562e67d4b4c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3894307638 >> 172.21.15.6:0/3894307638 conn(0x562e67ca9c80 msgr2=0x562e67d45f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3894307638 shutdown_connections 2023-09-13T09:53:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.995+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3894307638 wait complete. 2023-09-13T09:53:24.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 -- start start 2023-09-13T09:53:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 Processor -- start 2023-09-13T09:53:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d54f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d55460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4d060 0x562e67d5c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67c3bbb0 con 0x562e67d4ba00 2023-09-13T09:53:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67c3b8b0 con 0x562e67d4d060 2023-09-13T09:53:24.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67b1f920 con 0x562e67d4c700 2023-09-13T09:53:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.996+0000 7f8c3b0e8b80 10 client.0 _ll_register_callbacks cb 0x562e67c39680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c2cc9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d54f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d55460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d55460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45634/0 (socket says 172.21.15.6:45634) 2023-09-13T09:53:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 -- 172.21.15.6:0/3253754565 learned_addr learned my addr 172.21.15.6:0/3253754565 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d54f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42578/0 (socket says 172.21.15.6:42578) 2023-09-13T09:53:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 -- 172.21.15.6:0/3253754565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4d060 msgr2=0x562e67d5c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4d060 0x562e67d5c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 -- 172.21.15.6:0/3253754565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 msgr2=0x562e67d54f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d54f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 -- 172.21.15.6:0/3253754565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c14009810 con 0x562e67d4c700 2023-09-13T09:53:24.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d54f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d55460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009b30 tx=0x7f8c14004980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95383af0e86cc145 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c07fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:24.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c07fff700 1 -- 172.21.15.6:0/3253754565 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14004450 con 0x562e67d4c700 2023-09-13T09:53:24.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c07fff700 1 -- 172.21.15.6:0/3253754565 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8c14014070 con 0x562e67d4c700 2023-09-13T09:53:24.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:23.997+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562e67d3e670 con 0x562e67d4c700 2023-09-13T09:53:24.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c07fff700 1 -- 172.21.15.6:0/3253754565 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c140045b0 con 0x562e67d4c700 2023-09-13T09:53:24.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 10 client.28441 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:24.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x562e67cb57a0 con 0x562e67d4c700 2023-09-13T09:53:24.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c07fff700 1 -- 172.21.15.6:0/3253754565 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c14032080 con 0x562e67d4c700 2023-09-13T09:53:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c07fff700 1 -- 172.21.15.6:0/3253754565 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f8c140051a0 con 0x562e67d4c700 2023-09-13T09:53:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 10 client.28441 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 10 client.28441 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:53:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 20 client.28441 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67d60be0 0x562e67d63000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 4 client.28441 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.008+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562e67c96970 con 0x562e67d60be0 2023-09-13T09:53:24.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.009+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67d60be0 0x562e67d63000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.016+0000 7f8c07fff700 10 client.28441 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:24.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.016+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67d60be0 0x562e67d63000 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89240e9097e27f7c server_cookie=4d02757784d370a2 in_seq=0 out_seq=0 2023-09-13T09:53:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c07fff700 1 -- 172.21.15.6:0/3253754565 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562e67c96970 con 0x562e67d60be0 2023-09-13T09:53:24.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c07fff700 10 client.28441 handle_command_reply: tid=0 2023-09-13T09:53:24.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 client.28441 shutdown 2023-09-13T09:53:24.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 msgr2=0x562e67d55460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d55460 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8c14009b30 tx=0x7f8c14004980 comp rx=0 tx=0).stop 2023-09-13T09:53:24.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 shutdown_connections 2023-09-13T09:53:24.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67d60be0 0x562e67d63000 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4d060 0x562e67d5c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c07fff700 0 client.28441 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:24.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4ba00 0x562e67d54f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3253754565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d55460 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 >> 172.21.15.6:0/3253754565 conn(0x562e67ca9c80 msgr2=0x562e67d407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 shutdown_connections 2023-09-13T09:53:24.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3253754565 wait complete. 2023-09-13T09:53:24.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.019+0000 7f8c3b0e8b80 20 client.28441 trim_cache size 0 max 16384 2023-09-13T09:53:24.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 Processor -- start 2023-09-13T09:53:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 -- start start 2023-09-13T09:53:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4ba00 0x562e67d4b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d5c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d5cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67d47730 con 0x562e67d4d060 2023-09-13T09:53:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67d46810 con 0x562e67d4c700 2023-09-13T09:53:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67d55ba0 con 0x562e67d4ba00 2023-09-13T09:53:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d5cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c2cc9f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4ba00 0x562e67d4b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d5cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42588/0 (socket says 172.21.15.6:42588) 2023-09-13T09:53:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c2cc9f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4ba00 0x562e67d4b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45640/0 (socket says 172.21.15.6:45640) 2023-09-13T09:53:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/3976947897 learned_addr learned my addr 172.21.15.6:0/3976947897 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c27fff700 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d5c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/3976947897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4ba00 msgr2=0x562e67d4b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.036+0000 7f8c2d4a0700 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4ba00 0x562e67d4b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/3976947897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 msgr2=0x562e67d5c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c2d4a0700 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d5c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/3976947897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562e67ac9de0 con 0x562e67d4d060 2023-09-13T09:53:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4ba00 0x562e67d4b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:24.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c2d4a0700 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d5cd90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c9510 tx=0x7f8c20098c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d8b16029681f41 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c137fe700 1 -- 172.21.15.6:0/3976947897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2009cfe0 con 0x562e67d4d060 2023-09-13T09:53:24.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c137fe700 1 -- 172.21.15.6:0/3976947897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c200a1220 con 0x562e67d4d060 2023-09-13T09:53:24.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.037+0000 7f8c137fe700 1 -- 172.21.15.6:0/3976947897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c20099610 con 0x562e67d4d060 2023-09-13T09:53:24.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3976947897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 msgr2=0x562e67d5cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d5cd90 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f8c200c9510 tx=0x7f8c20098c10 comp rx=0 tx=0).stop 2023-09-13T09:53:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3976947897 shutdown_connections 2023-09-13T09:53:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d5cd90 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4ba00 0x562e67d4b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/3976947897 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4c700 0x562e67d5c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3976947897 >> 172.21.15.6:0/3976947897 conn(0x562e67ca9c80 msgr2=0x562e67d45e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3976947897 shutdown_connections 2023-09-13T09:53:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/3976947897 wait complete. 2023-09-13T09:53:24.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 -- start start 2023-09-13T09:53:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.038+0000 7f8c3b0e8b80 1 Processor -- start 2023-09-13T09:53:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4ba00 0x562e67d5bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d5c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c3b0e8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d58ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67d591d0 con 0x562e67d4d060 2023-09-13T09:53:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67d59340 con 0x562e67d4ba00 2023-09-13T09:53:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c3b0e8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562e67d59500 con 0x562e67d4c700 2023-09-13T09:53:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c3b0e8b80 10 client.0 _ll_register_callbacks cb 0x562e67c39680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d58ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c27fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d5c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c2d4a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d58ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42596/0 (socket says 172.21.15.6:42596) 2023-09-13T09:53:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c2d4a0700 1 -- 172.21.15.6:0/2143792023 learned_addr learned my addr 172.21.15.6:0/2143792023 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c27fff700 1 -- 172.21.15.6:0/2143792023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4ba00 msgr2=0x562e67d5bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c27fff700 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4ba00 0x562e67d5bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c27fff700 1 -- 172.21.15.6:0/2143792023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 msgr2=0x562e67d58ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c27fff700 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d58ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c27fff700 1 -- 172.21.15.6:0/2143792023 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c28105920 con 0x562e67d4c700 2023-09-13T09:53:24.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.039+0000 7f8c2d4a0700 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d58ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c27fff700 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d5c490 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c14005530 tx=0x7f8c14005720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5efd18f078edaf0d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c07fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c07fff700 1 -- 172.21.15.6:0/2143792023 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c14004450 con 0x562e67d4c700 2023-09-13T09:53:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8c14004cf0 con 0x562e67d4c700 2023-09-13T09:53:24.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c07fff700 1 -- 172.21.15.6:0/2143792023 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8c14000e40 con 0x562e67d4c700 2023-09-13T09:53:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c07fff700 1 -- 172.21.15.6:0/2143792023 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c140045b0 con 0x562e67d4c700 2023-09-13T09:53:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c3b0e8b80 10 client.28447 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x7f8c281adf30 con 0x562e67d4c700 2023-09-13T09:53:24.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c07fff700 1 -- 172.21.15.6:0/2143792023 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8c14004cf0 con 0x562e67d4c700 2023-09-13T09:53:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c07fff700 1 -- 172.21.15.6:0/2143792023 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f8c14018a40 con 0x562e67d4c700 2023-09-13T09:53:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c3b0e8b80 10 client.28447 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c3b0e8b80 10 client.28447 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:53:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.040+0000 7f8c3b0e8b80 20 client.28447 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:24.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.041+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67db5e70 0x562e67db8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.041+0000 7f8c3b0e8b80 4 client.28447 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.041+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562e67c57050 con 0x562e67db5e70 2023-09-13T09:53:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.041+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67db5e70 0x562e67db8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.042+0000 7f8c07fff700 10 client.28447 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:24.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.042+0000 7f8c2cc9f700 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67db5e70 0x562e67db8290 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7e14a6e583617869 server_cookie=b20e0f95aa0cc58b in_seq=0 out_seq=0 2023-09-13T09:53:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c07fff700 1 -- 172.21.15.6:0/2143792023 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562e67c57050 con 0x562e67db5e70 2023-09-13T09:53:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c07fff700 10 client.28447 handle_command_reply: tid=0 2023-09-13T09:53:24.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 client.28447 shutdown 2023-09-13T09:53:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 msgr2=0x562e67d5c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d5c490 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8c14005530 tx=0x7f8c14005720 comp rx=0 tx=0).stop 2023-09-13T09:53:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 shutdown_connections 2023-09-13T09:53:24.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x562e67db5e70 0x562e67db8290 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562e67d4d060 0x562e67d58ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c07fff700 0 client.28447 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562e67d4ba00 0x562e67d5bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 --2- 172.21.15.6:0/2143792023 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562e67d4c700 0x562e67d5c490 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 >> 172.21.15.6:0/2143792023 conn(0x562e67ca9c80 msgr2=0x562e67d4f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 shutdown_connections 2023-09-13T09:53:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.046+0000 7f8c3b0e8b80 1 -- 172.21.15.6:0/2143792023 wait complete. 2023-09-13T09:53:24.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c3b0e8b80 20 client.28447 trim_cache size 0 max 16384 2023-09-13T09:53:24.063 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c180a06c0 msgr2=0x7f8c180a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c180a06c0 0x7f8c180a2b80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c000c00 tx=0x7f8c1c004110 comp rx=0 tx=0).stop 2023-09-13T09:53:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c28104970 msgr2=0x7f8c281ad2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c28104970 0x7f8c281ad2d0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000b7b0 tx=0x7f8c2000bb70 comp rx=0 tx=0).stop 2023-09-13T09:53:24.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 shutdown_connections 2023-09-13T09:53:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8c180a06c0 0x7f8c180a2b80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c28104970 0x7f8c281ad2d0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8c280ff630 0x7f8c2810aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 --2- 172.21.15.6:0/2389469179 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c28101fa0 0x7f8c2810b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 >> 172.21.15.6:0/2389469179 conn(0x7f8c280fb250 msgr2=0x7f8c28102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 shutdown_connections 2023-09-13T09:53:24.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.047+0000 7f8c2ef03700 1 -- 172.21.15.6:0/2389469179 wait complete. 2023-09-13T09:53:24.069 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:53:24.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.226+0000 7f6fda7c1700 1 -- 172.21.15.6:0/3788763321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd40ffcc0 msgr2=0x7f6fd41000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.226+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/3788763321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd40ffcc0 0x7f6fd41000e0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f6fc40099c0 tx=0x7f6fc4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 -- 172.21.15.6:0/3788763321 shutdown_connections 2023-09-13T09:53:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/3788763321 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fd4101850 0x7f6fd4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/3788763321 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd40ffcc0 0x7f6fd41000e0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/3788763321 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd4100eb0 0x7f6fd4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 -- 172.21.15.6:0/3788763321 >> 172.21.15.6:0/3788763321 conn(0x7f6fd40fb250 msgr2=0x7f6fd40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 -- 172.21.15.6:0/3788763321 shutdown_connections 2023-09-13T09:53:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 -- 172.21.15.6:0/3788763321 wait complete. 2023-09-13T09:53:24.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 Processor -- start 2023-09-13T09:53:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.227+0000 7f6fda7c1700 1 -- start start 2023-09-13T09:53:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fda7c1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd40ffcc0 0x7f6fd4196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fda7c1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fd4100eb0 0x7f6fd4196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fda7c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd4101850 0x7f6fd419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fda7c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd419e610 con 0x7f6fd4101850 2023-09-13T09:53:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fda7c1700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd419e750 con 0x7f6fd4100eb0 2023-09-13T09:53:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fda7c1700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd419e8e0 con 0x7f6fd40ffcc0 2023-09-13T09:53:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd4101850 0x7f6fd419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd4101850 0x7f6fd419e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42608/0 (socket says 172.21.15.6:42608) 2023-09-13T09:53:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 -- 172.21.15.6:0/1852221422 learned_addr learned my addr 172.21.15.6:0/1852221422 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fd4100eb0 0x7f6fd4196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd40ffcc0 0x7f6fd4196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 -- 172.21.15.6:0/1852221422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd40ffcc0 msgr2=0x7f6fd4196a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd40ffcc0 0x7f6fd4196a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 -- 172.21.15.6:0/1852221422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fd4100eb0 msgr2=0x7f6fd4196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fd4100eb0 0x7f6fd4196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 -- 172.21.15.6:0/1852221422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc40095f0 con 0x7f6fd4101850 2023-09-13T09:53:24.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.228+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd4101850 0x7f6fd419e040 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc007ee0 tx=0x7f6fcc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.229+0000 7f6fd17fa700 1 -- 172.21.15.6:0/1852221422 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc017070 con 0x7f6fd4101850 2023-09-13T09:53:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.229+0000 7f6fd17fa700 1 -- 172.21.15.6:0/1852221422 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fcc00f040 con 0x7f6fd4101850 2023-09-13T09:53:24.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.229+0000 7f6fd17fa700 1 -- 172.21.15.6:0/1852221422 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc005580 con 0x7f6fd4101850 2023-09-13T09:53:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.229+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd419ebc0 con 0x7f6fd4101850 2023-09-13T09:53:24.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.229+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd419f080 con 0x7f6fd4101850 2023-09-13T09:53:24.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.232+0000 7f6fd17fa700 1 -- 172.21.15.6:0/1852221422 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6fcc00db20 con 0x7f6fd4101850 2023-09-13T09:53:24.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.232+0000 7f6fd17fa700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6fbc0a06c0 0x7f6fbc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.232+0000 7f6fd17fa700 1 -- 172.21.15.6:0/1852221422 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6fcc0cb2f0 con 0x7f6fd4101850 2023-09-13T09:53:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.232+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6fbc0a06c0 0x7f6fbc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6fbc0a06c0 0x7f6fbc0a2b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009990 tx=0x7f6fc4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 Processor -- start 2023-09-13T09:53:24.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 -- start start 2023-09-13T09:53:24.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaabf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaaae10 0x560debaab270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560deb9ff780 con 0x560debaabb10 2023-09-13T09:53:24.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560deb9fd0a0 con 0x560debaaae10 2023-09-13T09:53:24.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560deb9f8990 con 0x560debaac470 2023-09-13T09:53:24.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaabf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaabf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42612/0 (socket says 172.21.15.6:42612) 2023-09-13T09:53:24.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fd3fff700 1 -- 172.21.15.6:0/1825861520 learned_addr learned my addr 172.21.15.6:0/1825861520 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.233+0000 7f6fd37fe700 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaaae10 0x560debaab270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd3fff700 1 -- 172.21.15.6:0/1825861520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 msgr2=0x560debaaa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd3fff700 1 -- 172.21.15.6:0/1825861520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaaae10 msgr2=0x560debaab270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaaae10 0x560debaab270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd3fff700 1 -- 172.21.15.6:0/1825861520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560deb878630 con 0x560debaabb10 2023-09-13T09:53:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaaae10 0x560debaab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:24.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaabf30 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4100d10 tx=0x7f6fc401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38b27edfba860a35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fba7fc700 1 -- 172.21.15.6:0/1825861520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4029070 con 0x560debaabb10 2023-09-13T09:53:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fba7fc700 1 -- 172.21.15.6:0/1825861520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fc401e040 con 0x560debaabb10 2023-09-13T09:53:24.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.234+0000 7f6fba7fc700 1 -- 172.21.15.6:0/1825861520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400f880 con 0x560debaabb10 2023-09-13T09:53:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.235+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/1825861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 msgr2=0x560debaabf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.235+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaabf30 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f6fd4100d10 tx=0x7f6fc401f000 comp rx=0 tx=0).stop 2023-09-13T09:53:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.235+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/1825861520 shutdown_connections 2023-09-13T09:53:24.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.235+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaaae10 0x560debaab270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.235+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaabf30 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.235+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/1825861520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.235+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/1825861520 >> 172.21.15.6:0/1825861520 conn(0x560deba04c80 msgr2=0x560debaa0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/1825861520 shutdown_connections 2023-09-13T09:53:24.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/1825861520 wait complete. 2023-09-13T09:53:24.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 -- start start 2023-09-13T09:53:24.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 Processor -- start 2023-09-13T09:53:24.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debab4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debab47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaac470 0x560debabb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560deb996bb0 con 0x560debaac470 2023-09-13T09:53:24.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.236+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560deb9968b0 con 0x560debaabb10 2023-09-13T09:53:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560deb87a920 con 0x560debaaae10 2023-09-13T09:53:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fe69a6b80 10 client.0 _ll_register_callbacks cb 0x560deb994680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:24.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaac470 0x560debabb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debab47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debab4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debab47a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36144/0 (socket says 172.21.15.6:36144) 2023-09-13T09:53:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaac470 0x560debabb7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42622/0 (socket says 172.21.15.6:42622) 2023-09-13T09:53:24.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd37fe700 1 -- 172.21.15.6:0/3370435157 learned_addr learned my addr 172.21.15.6:0/3370435157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 -- 172.21.15.6:0/3370435157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 msgr2=0x560debab4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debab4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 -- 172.21.15.6:0/3370435157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 msgr2=0x560debab47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debab47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 -- 172.21.15.6:0/3370435157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd4067fb0 con 0x560debaac470 2023-09-13T09:53:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaac470 0x560debabb7e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0c9110 tx=0x7f6fcc098b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af9b5d4b43c02e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fb37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fb37fe700 1 -- 172.21.15.6:0/3370435157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fcc004c40 con 0x560debaac470 2023-09-13T09:53:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560deba99670 con 0x560debaac470 2023-09-13T09:53:24.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.237+0000 7f6fb37fe700 1 -- 172.21.15.6:0/3370435157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6fcc0951a0 con 0x560debaac470 2023-09-13T09:53:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fb37fe700 1 -- 172.21.15.6:0/3370435157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fcc095360 con 0x560debaac470 2023-09-13T09:53:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 10 client.19143 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x560deba107a0 con 0x560debaac470 2023-09-13T09:53:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fb37fe700 1 -- 172.21.15.6:0/3370435157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560deba99670 con 0x560debaac470 2023-09-13T09:53:24.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fb37fe700 1 -- 172.21.15.6:0/3370435157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f6fcc097f80 con 0x560debaac470 2023-09-13T09:53:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 10 client.19143 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 10 client.19143 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:53:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 20 client.19143 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debabff80 0x560debac23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 4 client.19143 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:24.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560deb9f1970 con 0x560debabff80 2023-09-13T09:53:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.238+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debabff80 0x560debac23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.239+0000 7f6fb37fe700 10 client.19143 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.239+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debabff80 0x560debac23a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2bce463bb7916fee server_cookie=741f08e0f2857365 in_seq=0 out_seq=0 2023-09-13T09:53:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.240+0000 7f6fb37fe700 1 -- 172.21.15.6:0/3370435157 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560deb9f1970 con 0x560debabff80 2023-09-13T09:53:24.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.240+0000 7f6fb37fe700 10 client.19143 handle_command_reply: tid=0 2023-09-13T09:53:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.240+0000 7f6fe69a6b80 1 client.19143 shutdown 2023-09-13T09:53:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaac470 msgr2=0x560debabb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaac470 0x560debabb7e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc0c9110 tx=0x7f6fcc098b10 comp rx=0 tx=0).stop 2023-09-13T09:53:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 shutdown_connections 2023-09-13T09:53:24.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debabff80 0x560debac23a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaac470 0x560debabb7e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debab4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3370435157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debab47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 >> 172.21.15.6:0/3370435157 conn(0x560deba04c80 msgr2=0x560deba9b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fb37fe700 0 client.19143 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 shutdown_connections 2023-09-13T09:53:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3370435157 wait complete. 2023-09-13T09:53:24.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.241+0000 7f6fe69a6b80 20 client.19143 trim_cache size 0 max 16384 2023-09-13T09:53:24.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:24 smithi131 ceph-mon[102785]: pgmap v716: 97 pgs: 97 active+clean; 624 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 23 MiB/s wr, 685 op/s 2023-09-13T09:53:24.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:24 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:24.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:24 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1778899537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:53:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.256+0000 7f6fe69a6b80 1 Processor -- start 2023-09-13T09:53:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.256+0000 7f6fe69a6b80 1 -- start start 2023-09-13T09:53:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaaae10 0x560debab21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debaaecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaf1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560debaa2fd0 con 0x560debaaae10 2023-09-13T09:53:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560debabd3c0 con 0x560debaabb10 2023-09-13T09:53:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560debabfa70 con 0x560debaac470 2023-09-13T09:53:24.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaaae10 0x560debab21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaaae10 0x560debab21a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42626/0 (socket says 172.21.15.6:42626) 2023-09-13T09:53:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 -- 172.21.15.6:0/3120755765 learned_addr learned my addr 172.21.15.6:0/3120755765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd37fe700 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debaaecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd8d5e700 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaf1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 -- 172.21.15.6:0/3120755765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 msgr2=0x560debaaf1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaf1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 -- 172.21.15.6:0/3120755765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 msgr2=0x560debaaecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debaaecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 -- 172.21.15.6:0/3120755765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560deb824de0 con 0x560debaaae10 2023-09-13T09:53:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.257+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaaae10 0x560debab21a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400bf40 tx=0x7f6fc40054f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfd4a25742c73f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.258+0000 7f6fbaffd700 1 -- 172.21.15.6:0/3120755765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc4029040 con 0x560debaaae10 2023-09-13T09:53:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.258+0000 7f6fbaffd700 1 -- 172.21.15.6:0/3120755765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fc400f4e0 con 0x560debaaae10 2023-09-13T09:53:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.258+0000 7f6fbaffd700 1 -- 172.21.15.6:0/3120755765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc400f720 con 0x560debaaae10 2023-09-13T09:53:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.258+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3120755765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaaae10 msgr2=0x560debab21a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.258+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaaae10 0x560debab21a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f6fc400bf40 tx=0x7f6fc40054f0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3120755765 shutdown_connections 2023-09-13T09:53:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaac470 0x560debaaf1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaaae10 0x560debab21a0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/3120755765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaabb10 0x560debaaecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3120755765 >> 172.21.15.6:0/3120755765 conn(0x560deba04c80 msgr2=0x560debaa0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3120755765 shutdown_connections 2023-09-13T09:53:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/3120755765 wait complete. 2023-09-13T09:53:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 -- start start 2023-09-13T09:53:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.259+0000 7f6fe69a6b80 1 Processor -- start 2023-09-13T09:53:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debaa80b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaa85f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fe69a6b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaac470 0x560debabb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560debaa8c70 con 0x560debaabb10 2023-09-13T09:53:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560debaa9600 con 0x560debaac470 2023-09-13T09:53:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fe69a6b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560debaa97c0 con 0x560debaaae10 2023-09-13T09:53:24.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fe69a6b80 10 client.0 _ll_register_callbacks cb 0x560deb994680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaa85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd8d5e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaac470 0x560debabb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaa85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42634/0 (socket says 172.21.15.6:42634) 2023-09-13T09:53:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd3fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debaa80b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 -- 172.21.15.6:0/2180973967 learned_addr learned my addr 172.21.15.6:0/2180973967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 -- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 msgr2=0x560debaa80b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debaa80b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 -- 172.21.15.6:0/2180973967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaac470 msgr2=0x560debabb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaac470 0x560debabb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 -- 172.21.15.6:0/2180973967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560deb878630 con 0x560debaabb10 2023-09-13T09:53:24.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debaa80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:24.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fd37fe700 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaa85f0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8010700 tx=0x7f6fc8010a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419e5b29006d9ec2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.260+0000 7f6fb37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:24.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fb37fe700 1 -- 172.21.15.6:0/2180973967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc800f950 con 0x560debaabb10 2023-09-13T09:53:24.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fb37fe700 1 -- 172.21.15.6:0/2180973967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6fc800fab0 con 0x560debaabb10 2023-09-13T09:53:24.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fc401e040 con 0x560debaabb10 2023-09-13T09:53:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fb37fe700 1 -- 172.21.15.6:0/2180973967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fc800fc70 con 0x560debaabb10 2023-09-13T09:53:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 10 client.19149 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x560deb80dc60 con 0x560debaabb10 2023-09-13T09:53:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fb37fe700 1 -- 172.21.15.6:0/2180973967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6fc802d080 con 0x560debaabb10 2023-09-13T09:53:24.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fb37fe700 1 -- 172.21.15.6:0/2180973967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7f6fc801d3e0 con 0x560debaabb10 2023-09-13T09:53:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 10 client.19149 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 10 client.19149 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:53:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 20 client.19149 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debb107e0 0x560debb12c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 4 client.19149 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:24.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.261+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560deb9b2050 con 0x560debb107e0 2023-09-13T09:53:24.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.262+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debb107e0 0x560debb12c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.262+0000 7f6fb37fe700 10 client.19149 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:24.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.262+0000 7f6fd3fff700 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debb107e0 0x560debb12c00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f739765ede32a430 server_cookie=4aa5caad6aa4b1d2 in_seq=0 out_seq=0 2023-09-13T09:53:24.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.263+0000 7f6fb37fe700 1 -- 172.21.15.6:0/2180973967 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560deb9b2050 con 0x560debb107e0 2023-09-13T09:53:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.263+0000 7f6fb37fe700 10 client.19149 handle_command_reply: tid=0 2023-09-13T09:53:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.263+0000 7f6fe69a6b80 1 client.19149 shutdown 2023-09-13T09:53:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 msgr2=0x560debaa85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaa85f0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8010700 tx=0x7f6fc8010a10 comp rx=0 tx=0).stop 2023-09-13T09:53:24.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 shutdown_connections 2023-09-13T09:53:24.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560debb107e0 0x560debb12c00 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560debaac470 0x560debabb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560debaaae10 0x560debaa80b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 --2- 172.21.15.6:0/2180973967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560debaabb10 0x560debaa85f0 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 >> 172.21.15.6:0/2180973967 conn(0x560deba04c80 msgr2=0x560debab21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fb37fe700 0 client.19149 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:24.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 shutdown_connections 2023-09-13T09:53:24.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 1 -- 172.21.15.6:0/2180973967 wait complete. 2023-09-13T09:53:24.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fe69a6b80 20 client.19149 trim_cache size 0 max 16384 2023-09-13T09:53:24.294 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:24.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6fbc0a06c0 msgr2=0x7f6fbc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6fbc0a06c0 0x7f6fbc0a2b80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f6fc4009990 tx=0x7f6fc4005fb0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd4101850 msgr2=0x7f6fd419e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.264+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd4101850 0x7f6fd419e040 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f6fcc007ee0 tx=0x7f6fcc00d3b0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 shutdown_connections 2023-09-13T09:53:24.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6fbc0a06c0 0x7f6fbc0a2b80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6fd4101850 0x7f6fd419e040 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6fd40ffcc0 0x7f6fd4196a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 --2- 172.21.15.6:0/1852221422 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6fd4100eb0 0x7f6fd4196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 >> 172.21.15.6:0/1852221422 conn(0x7f6fd40fb250 msgr2=0x7f6fd40fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 shutdown_connections 2023-09-13T09:53:24.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.265+0000 7f6fda7c1700 1 -- 172.21.15.6:0/1852221422 wait complete. 2023-09-13T09:53:24.297 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:24 smithi006 ceph-mon[98665]: pgmap v716: 97 pgs: 97 active+clean; 624 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 23 MiB/s wr, 685 op/s 2023-09-13T09:53:24.297 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:24 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:24.298 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:24 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1778899537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:53:24.299 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:53:24.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 -- 172.21.15.6:0/2677915147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 msgr2=0x7ff744107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/2677915147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff744107880 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00b0d0 tx=0x7ff73c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 -- 172.21.15.6:0/2677915147 shutdown_connections 2023-09-13T09:53:24.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/2677915147 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff744107880 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/2677915147 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff7440ff440 0x7ff7440ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/2677915147 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff744100630 0x7ff744100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 -- 172.21.15.6:0/2677915147 >> 172.21.15.6:0/2677915147 conn(0x7ff7440fa9b0 msgr2=0x7ff7440fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 -- 172.21.15.6:0/2677915147 shutdown_connections 2023-09-13T09:53:24.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 -- 172.21.15.6:0/2677915147 wait complete. 2023-09-13T09:53:24.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 Processor -- start 2023-09-13T09:53:24.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.456+0000 7ff74bb9a700 1 -- start start 2023-09-13T09:53:24.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74bb9a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7440ff440 0x7ff74410c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74bb9a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff744100630 0x7ff74419b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74bb9a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff74419df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74bb9a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74419e6c0 con 0x7ff744100fd0 2023-09-13T09:53:24.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74bb9a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74419e830 con 0x7ff744100630 2023-09-13T09:53:24.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74bb9a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff74419e9f0 con 0x7ff7440ff440 2023-09-13T09:53:24.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74a137700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff74419df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7440ff440 0x7ff74410c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749135700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff744100630 0x7ff74419b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74a137700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff74419df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42650/0 (socket says 172.21.15.6:42650) 2023-09-13T09:53:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7440ff440 0x7ff74410c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45700/0 (socket says 172.21.15.6:45700) 2023-09-13T09:53:24.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74a137700 1 -- 172.21.15.6:0/4184767302 learned_addr learned my addr 172.21.15.6:0/4184767302 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 -- 172.21.15.6:0/4184767302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff744100630 msgr2=0x7ff74419b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff744100630 0x7ff74419b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 -- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 msgr2=0x7ff74419df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff74419df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 -- 172.21.15.6:0/4184767302 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff73c009d00 con 0x7ff7440ff440 2023-09-13T09:53:24.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff74a137700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff74419df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:24.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.457+0000 7ff749936700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7440ff440 0x7ff74410c150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff74000e9c0 tx=0x7ff74000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.458+0000 7ff73affd700 1 -- 172.21.15.6:0/4184767302 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74000cbd0 con 0x7ff7440ff440 2023-09-13T09:53:24.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.458+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff74419ecd0 con 0x7ff7440ff440 2023-09-13T09:53:24.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.458+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff74419f180 con 0x7ff7440ff440 2023-09-13T09:53:24.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.458+0000 7ff73affd700 1 -- 172.21.15.6:0/4184767302 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff74000eeb0 con 0x7ff7440ff440 2023-09-13T09:53:24.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.458+0000 7ff73affd700 1 -- 172.21.15.6:0/4184767302 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff740003c10 con 0x7ff7440ff440 2023-09-13T09:53:24.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.461+0000 7ff73affd700 1 -- 172.21.15.6:0/4184767302 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff740004020 con 0x7ff7440ff440 2023-09-13T09:53:24.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.461+0000 7ff73affd700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7300a0640 0x7ff7300a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.461+0000 7ff73affd700 1 -- 172.21.15.6:0/4184767302 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff740014070 con 0x7ff7440ff440 2023-09-13T09:53:24.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.461+0000 7ff749135700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7300a0640 0x7ff7300a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 Processor -- start 2023-09-13T09:53:24.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 -- start start 2023-09-13T09:53:24.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff749135700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7300a0640 0x7ff7300a2b00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff734009bf0 tx=0x7ff734009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c309b10 0x559f9c309f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c3088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c309290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c25d780 con 0x559f9c308e10 2023-09-13T09:53:24.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c25b0a0 con 0x559f9c30a470 2023-09-13T09:53:24.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c256990 con 0x559f9c309b10 2023-09-13T09:53:24.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff74a137700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c309290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff74a137700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c309290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42658/0 (socket says 172.21.15.6:42658) 2023-09-13T09:53:24.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff74a137700 1 -- 172.21.15.6:0/1440304653 learned_addr learned my addr 172.21.15.6:0/1440304653 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff749936700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c309b10 0x559f9c309f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.462+0000 7ff749135700 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c3088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff74a137700 1 -- 172.21.15.6:0/1440304653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c309b10 msgr2=0x559f9c309f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff74a137700 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c309b10 0x559f9c309f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff74a137700 1 -- 172.21.15.6:0/1440304653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 msgr2=0x559f9c3088d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff74a137700 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c3088d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff74a137700 1 -- 172.21.15.6:0/1440304653 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f9c0d6630 con 0x559f9c308e10 2023-09-13T09:53:24.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff749936700 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c309b10 0x559f9c309f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:24.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff74a137700 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c309290 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009bb0 tx=0x7ff73c009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb9f82595c1056f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff72ffff700 1 -- 172.21.15.6:0/1440304653 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00e040 con 0x559f9c308e10 2023-09-13T09:53:24.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff72ffff700 1 -- 172.21.15.6:0/1440304653 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff73c003a00 con 0x559f9c308e10 2023-09-13T09:53:24.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.463+0000 7ff72ffff700 1 -- 172.21.15.6:0/1440304653 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c005530 con 0x559f9c308e10 2023-09-13T09:53:24.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 -- 172.21.15.6:0/1440304653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 msgr2=0x559f9c309290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c309290 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009bb0 tx=0x7ff73c009be0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 -- 172.21.15.6:0/1440304653 shutdown_connections 2023-09-13T09:53:24.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c309290 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c309b10 0x559f9c309f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/1440304653 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c3088d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 -- 172.21.15.6:0/1440304653 >> 172.21.15.6:0/1440304653 conn(0x559f9c262c80 msgr2=0x559f9c2fef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 -- 172.21.15.6:0/1440304653 shutdown_connections 2023-09-13T09:53:24.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 -- 172.21.15.6:0/1440304653 wait complete. 2023-09-13T09:53:24.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 -- start start 2023-09-13T09:53:24.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.464+0000 7ff757d7fb80 1 Processor -- start 2023-09-13T09:53:24.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c3122b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c3127f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c30a470 0x559f9c319830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c1f4bb0 con 0x559f9c308e10 2023-09-13T09:53:24.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c1f48b0 con 0x559f9c309b10 2023-09-13T09:53:24.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c0d8920 con 0x559f9c30a470 2023-09-13T09:53:24.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 10 client.0 _ll_register_callbacks cb 0x559f9c1f2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:24.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c3122b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749135700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c3127f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c3122b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42660/0 (socket says 172.21.15.6:42660) 2023-09-13T09:53:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 -- 172.21.15.6:0/214390336 learned_addr learned my addr 172.21.15.6:0/214390336 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff74a137700 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c30a470 0x559f9c319830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 -- 172.21.15.6:0/214390336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c30a470 msgr2=0x559f9c319830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c30a470 0x559f9c319830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 -- 172.21.15.6:0/214390336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 msgr2=0x559f9c3127f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c3127f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 -- 172.21.15.6:0/214390336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7441081d0 con 0x559f9c308e10 2023-09-13T09:53:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff749936700 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c3122b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff7400c9990 tx=0x7ff740099e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d835067d21a9870b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff72d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff72d7fa700 1 -- 172.21.15.6:0/214390336 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400a16f0 con 0x559f9c308e10 2023-09-13T09:53:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f9c2f7670 con 0x559f9c308e10 2023-09-13T09:53:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.465+0000 7ff72d7fa700 1 -- 172.21.15.6:0/214390336 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff740003d70 con 0x559f9c308e10 2023-09-13T09:53:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff72d7fa700 1 -- 172.21.15.6:0/214390336 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff74000cd30 con 0x559f9c308e10 2023-09-13T09:53:24.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 10 client.19161 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x559f9c26e7a0 con 0x559f9c308e10 2023-09-13T09:53:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff72d7fa700 1 -- 172.21.15.6:0/214390336 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559f9c2f7670 con 0x559f9c308e10 2023-09-13T09:53:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff72d7fa700 1 -- 172.21.15.6:0/214390336 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7ff740098b70 con 0x559f9c308e10 2023-09-13T09:53:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 10 client.19161 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 10 client.19161 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:24.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 20 client.19161 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c31e110 0x559f9c320530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 4 client.19161 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f9c24f970 con 0x559f9c31e110 2023-09-13T09:53:24.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.466+0000 7ff749135700 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c31e110 0x559f9c320530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.467+0000 7ff749135700 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c31e110 0x559f9c320530 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff8d3e36a5adf92b server_cookie=e8baa25fc70d8ef6 in_seq=0 out_seq=0 2023-09-13T09:53:24.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.467+0000 7ff72d7fa700 10 client.19161 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:24.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff72d7fa700 1 -- 172.21.15.6:0/214390336 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559f9c24f970 con 0x559f9c31e110 2023-09-13T09:53:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff72d7fa700 10 client.19161 handle_command_reply: tid=0 2023-09-13T09:53:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 client.19161 shutdown 2023-09-13T09:53:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 msgr2=0x559f9c3122b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c3122b0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7ff7400c9990 tx=0x7ff740099e00 comp rx=0 tx=0).stop 2023-09-13T09:53:24.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 shutdown_connections 2023-09-13T09:53:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c30a470 0x559f9c319830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c31e110 0x559f9c320530 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c308e10 0x559f9c3122b0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff72d7fa700 0 client.19161 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:24.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/214390336 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c3127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 >> 172.21.15.6:0/214390336 conn(0x559f9c262c80 msgr2=0x559f9c2feee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 shutdown_connections 2023-09-13T09:53:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 1 -- 172.21.15.6:0/214390336 wait complete. 2023-09-13T09:53:24.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.476+0000 7ff757d7fb80 20 client.19161 trim_cache size 0 max 16384 2023-09-13T09:53:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 Processor -- start 2023-09-13T09:53:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 -- start start 2023-09-13T09:53:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c3088d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c309b10 0x559f9c3197f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c312060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c2ff840 con 0x559f9c309b10 2023-09-13T09:53:24.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c300730 con 0x559f9c30a470 2023-09-13T09:53:24.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.490+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c30ff70 con 0x559f9c308e10 2023-09-13T09:53:24.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749135700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c309b10 0x559f9c3197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749135700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c309b10 0x559f9c3197f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42668/0 (socket says 172.21.15.6:42668) 2023-09-13T09:53:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749135700 1 -- 172.21.15.6:0/2904961718 learned_addr learned my addr 172.21.15.6:0/2904961718 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749936700 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c3088d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff74a137700 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c312060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749936700 1 -- 172.21.15.6:0/2904961718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 msgr2=0x559f9c312060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749936700 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c312060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749936700 1 -- 172.21.15.6:0/2904961718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c309b10 msgr2=0x559f9c3197f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749936700 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c309b10 0x559f9c3197f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749936700 1 -- 172.21.15.6:0/2904961718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f9c082de0 con 0x559f9c308e10 2023-09-13T09:53:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749135700 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c309b10 0x559f9c3197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:24.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff749936700 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c3088d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff740098f20 tx=0x7ff7400997c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d5e6465eaaaefea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff738d82700 1 -- 172.21.15.6:0/2904961718 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7400998e0 con 0x559f9c308e10 2023-09-13T09:53:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff738d82700 1 -- 172.21.15.6:0/2904961718 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff7400a16f0 con 0x559f9c308e10 2023-09-13T09:53:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.491+0000 7ff738d82700 1 -- 172.21.15.6:0/2904961718 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff74009d170 con 0x559f9c308e10 2023-09-13T09:53:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 -- 172.21.15.6:0/2904961718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 msgr2=0x559f9c3088d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c3088d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff740098f20 tx=0x7ff7400997c0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 -- 172.21.15.6:0/2904961718 shutdown_connections 2023-09-13T09:53:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c30a470 0x559f9c312060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c3088d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/2904961718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c309b10 0x559f9c3197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 -- 172.21.15.6:0/2904961718 >> 172.21.15.6:0/2904961718 conn(0x559f9c262c80 msgr2=0x559f9c30ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 -- 172.21.15.6:0/2904961718 shutdown_connections 2023-09-13T09:53:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 -- 172.21.15.6:0/2904961718 wait complete. 2023-09-13T09:53:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.492+0000 7ff757d7fb80 1 -- start start 2023-09-13T09:53:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 1 Processor -- start 2023-09-13T09:53:24.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c315860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c315da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c30a470 0x559f9c318dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c319300 con 0x559f9c30a470 2023-09-13T09:53:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c319470 con 0x559f9c309b10 2023-09-13T09:53:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f9c319630 con 0x559f9c308e10 2023-09-13T09:53:24.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff757d7fb80 10 client.0 _ll_register_callbacks cb 0x559f9c1f2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff749135700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c315da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff74a137700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c30a470 0x559f9c318dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff749135700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c315da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36200/0 (socket says 172.21.15.6:36200) 2023-09-13T09:53:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff749936700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c315860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.493+0000 7ff749135700 1 -- 172.21.15.6:0/724934725 learned_addr learned my addr 172.21.15.6:0/724934725 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff74a137700 1 -- 172.21.15.6:0/724934725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 msgr2=0x559f9c315860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff74a137700 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c315860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff74a137700 1 -- 172.21.15.6:0/724934725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 msgr2=0x559f9c315da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:24.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff74a137700 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c315da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff74a137700 1 -- 172.21.15.6:0/724934725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7340119e0 con 0x559f9c30a470 2023-09-13T09:53:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff74a137700 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c30a470 0x559f9c318dc0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00b770 tx=0x7ff73c003ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fcfb11919a9b091 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:24.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff72d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff72d7fa700 1 -- 172.21.15.6:0/724934725 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff73c00e040 con 0x559f9c30a470 2023-09-13T09:53:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff72d7fa700 1 -- 172.21.15.6:0/724934725 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff73c02a070 con 0x559f9c30a470 2023-09-13T09:53:24.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff73c003a00 con 0x559f9c30a470 2023-09-13T09:53:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff72d7fa700 1 -- 172.21.15.6:0/724934725 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff73c005170 con 0x559f9c30a470 2023-09-13T09:53:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff757d7fb80 10 client.19167 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x559f9c26e7a0 con 0x559f9c30a470 2023-09-13T09:53:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff72d7fa700 1 -- 172.21.15.6:0/724934725 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff73c003a00 con 0x559f9c30a470 2023-09-13T09:53:24.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.494+0000 7ff72d7fa700 1 -- 172.21.15.6:0/724934725 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7ff73c019070 con 0x559f9c30a470 2023-09-13T09:53:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff757d7fb80 10 client.19167 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff757d7fb80 10 client.19167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff757d7fb80 20 client.19167 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c373000 0x559f9c375420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:24.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff757d7fb80 4 client.19167 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559f9c210050 con 0x559f9c373000 2023-09-13T09:53:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff749936700 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c373000 0x559f9c375420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff72d7fa700 10 client.19167 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.495+0000 7ff749936700 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c373000 0x559f9c375420 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4be8eb0ca19cab93 server_cookie=515c7280d3527658 in_seq=0 out_seq=0 2023-09-13T09:53:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.500+0000 7ff72d7fa700 1 -- 172.21.15.6:0/724934725 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559f9c210050 con 0x559f9c373000 2023-09-13T09:53:24.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.500+0000 7ff72d7fa700 10 client.19167 handle_command_reply: tid=0 2023-09-13T09:53:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.500+0000 7ff757d7fb80 1 client.19167 shutdown 2023-09-13T09:53:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.500+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c30a470 msgr2=0x559f9c318dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.500+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c30a470 0x559f9c318dc0 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff73c00b770 tx=0x7ff73c003ee0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 shutdown_connections 2023-09-13T09:53:24.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559f9c373000 0x559f9c375420 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559f9c30a470 0x559f9c318dc0 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559f9c308e10 0x559f9c315860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff72d7fa700 0 client.19167 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 --2- 172.21.15.6:0/724934725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559f9c309b10 0x559f9c315da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 >> 172.21.15.6:0/724934725 conn(0x559f9c262c80 msgr2=0x559f9c312060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 shutdown_connections 2023-09-13T09:53:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 1 -- 172.21.15.6:0/724934725 wait complete. 2023-09-13T09:53:24.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff757d7fb80 20 client.19167 trim_cache size 0 max 16384 2023-09-13T09:53:24.516 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:24.517 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:24 smithi053 ceph-mon[102373]: pgmap v716: 97 pgs: 97 active+clean; 624 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 23 MiB/s wr, 685 op/s 2023-09-13T09:53:24.518 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:24 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:24.518 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:24 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1778899537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:53:24.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7300a0640 msgr2=0x7ff7300a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7300a0640 0x7ff7300a2b00 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff734009bf0 tx=0x7ff734009260 comp rx=0 tx=0).stop 2023-09-13T09:53:24.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7440ff440 msgr2=0x7ff74410c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7440ff440 0x7ff74410c150 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff74000e9c0 tx=0x7ff74000ecd0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 shutdown_connections 2023-09-13T09:53:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7300a0640 0x7ff7300a2b00 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff744100fd0 0x7ff74419df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7440ff440 0x7ff74410c150 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 --2- 172.21.15.6:0/4184767302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff744100630 0x7ff74419b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 >> 172.21.15.6:0/4184767302 conn(0x7ff7440fa9b0 msgr2=0x7ff7440fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 shutdown_connections 2023-09-13T09:53:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:24.501+0000 7ff74bb9a700 1 -- 172.21.15.6:0/4184767302 wait complete. 2023-09-13T09:53:24.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 30786 41.79 MB/sec warmup 44 sec latency 218.225 ms 2023-09-13T09:53:25.522 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:53:25.522 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:53:25.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 31382 41.41 MB/sec warmup 45 sec latency 133.080 ms 2023-09-13T09:53:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 -- 172.21.15.6:0/460678518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c80ffca0 msgr2=0x7fc6c81000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/460678518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c80ffca0 0x7fc6c81000c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc6b8009990 tx=0x7fc6b8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 -- 172.21.15.6:0/460678518 shutdown_connections 2023-09-13T09:53:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/460678518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c8101830 0x7fc6c81080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/460678518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c80ffca0 0x7fc6c81000c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/460678518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c8100e90 0x7fc6c81012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 -- 172.21.15.6:0/460678518 >> 172.21.15.6:0/460678518 conn(0x7fc6c80fb1f0 msgr2=0x7fc6c80fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 -- 172.21.15.6:0/460678518 shutdown_connections 2023-09-13T09:53:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 -- 172.21.15.6:0/460678518 wait complete. 2023-09-13T09:53:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.672+0000 7fc6ce48b700 1 Processor -- start 2023-09-13T09:53:25.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6ce48b700 1 -- start start 2023-09-13T09:53:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6ce48b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c80ffca0 0x7fc6c8072000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6ce48b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c8100e90 0x7fc6c8072540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6ce48b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c8101830 0x7fc6c8102a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6ce48b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8102fd0 con 0x7fc6c8100e90 2023-09-13T09:53:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6ce48b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8103140 con 0x7fc6c80ffca0 2023-09-13T09:53:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6ce48b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c8103300 con 0x7fc6c8101830 2023-09-13T09:53:25.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6cca28700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c8101830 0x7fc6c8102a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c8100e90 0x7fc6c8072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6c7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c80ffca0 0x7fc6c8072000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6cca28700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c8101830 0x7fc6c8102a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45746/0 (socket says 172.21.15.6:45746) 2023-09-13T09:53:25.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6cca28700 1 -- 172.21.15.6:0/2801301789 learned_addr learned my addr 172.21.15.6:0/2801301789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.673+0000 7fc6cca28700 1 -- 172.21.15.6:0/2801301789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c80ffca0 msgr2=0x7fc6c8072000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6cca28700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c80ffca0 0x7fc6c8072000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6cca28700 1 -- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c8100e90 msgr2=0x7fc6c8072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6cca28700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c8100e90 0x7fc6c8072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6cca28700 1 -- 172.21.15.6:0/2801301789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6b80095f0 con 0x7fc6c8101830 2023-09-13T09:53:25.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6cca28700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c8101830 0x7fc6c8102a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000ef30 tx=0x7fc6c000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6c57fa700 1 -- 172.21.15.6:0/2801301789 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0018070 con 0x7fc6c8101830 2023-09-13T09:53:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6c57fa700 1 -- 172.21.15.6:0/2801301789 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6c000f040 con 0x7fc6c8101830 2023-09-13T09:53:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6c57fa700 1 -- 172.21.15.6:0/2801301789 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c000cd00 con 0x7fc6c8101830 2023-09-13T09:53:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c8103520 con 0x7fc6c8101830 2023-09-13T09:53:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.674+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c8103a30 con 0x7fc6c8101830 2023-09-13T09:53:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.677+0000 7fc6c57fa700 1 -- 172.21.15.6:0/2801301789 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc6c0003a00 con 0x7fc6c8101830 2023-09-13T09:53:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.677+0000 7fc6c57fa700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc6b00a06c0 0x7fc6b00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.677+0000 7fc6c57fa700 1 -- 172.21.15.6:0/2801301789 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc6c00cb660 con 0x7fc6c8101830 2023-09-13T09:53:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.677+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc6b00a06c0 0x7fc6b00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.678+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc6b00a06c0 0x7fc6b00a2b80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b2e0 tx=0x7fc6b8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.678+0000 7fc6da670b80 1 Processor -- start 2023-09-13T09:53:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.678+0000 7fc6da670b80 1 -- start start 2023-09-13T09:53:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e10050ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e1004f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1004ff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6da670b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0ffa8800 con 0x561e100510e0 2023-09-13T09:53:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6da670b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0ffa6120 con 0x561e1004fa80 2023-09-13T09:53:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6da670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0ffa1a10 con 0x561e10050780 2023-09-13T09:53:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e1004f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e10050ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e1004f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42698/0 (socket says 172.21.15.6:42698) 2023-09-13T09:53:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 -- 172.21.15.6:0/4212564194 learned_addr learned my addr 172.21.15.6:0/4212564194 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6cca28700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1004ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 -- 172.21.15.6:0/4212564194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 msgr2=0x561e10050ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e10050ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 -- 172.21.15.6:0/4212564194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 msgr2=0x561e1004ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1004ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 -- 172.21.15.6:0/4212564194 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e0fe216b0 con 0x561e100510e0 2023-09-13T09:53:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6cca28700 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1004ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.679+0000 7fc6c77fe700 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e1004f540 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009d80 tx=0x7fc6bc011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be82f7f616d5e3a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.680+0000 7fc6ae7fc700 1 -- 172.21.15.6:0/4212564194 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc004230 con 0x561e100510e0 2023-09-13T09:53:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.680+0000 7fc6ae7fc700 1 -- 172.21.15.6:0/4212564194 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6bc004390 con 0x561e100510e0 2023-09-13T09:53:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.680+0000 7fc6ae7fc700 1 -- 172.21.15.6:0/4212564194 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc019860 con 0x561e100510e0 2023-09-13T09:53:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.680+0000 7fc6da670b80 1 -- 172.21.15.6:0/4212564194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 msgr2=0x561e1004f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e1004f540 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc009d80 tx=0x7fc6bc011720 comp rx=0 tx=0).stop 2023-09-13T09:53:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 -- 172.21.15.6:0/4212564194 shutdown_connections 2023-09-13T09:53:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1004ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e10050ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 --2- 172.21.15.6:0/4212564194 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e1004f540 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 -- 172.21.15.6:0/4212564194 >> 172.21.15.6:0/4212564194 conn(0x561e0ffadd00 msgr2=0x561e10049f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 -- 172.21.15.6:0/4212564194 shutdown_connections 2023-09-13T09:53:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 -- 172.21.15.6:0/4212564194 wait complete. 2023-09-13T09:53:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 -- start start 2023-09-13T09:53:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.681+0000 7fc6da670b80 1 Processor -- start 2023-09-13T09:53:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e1004fa80 0x561e10069f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e10050780 0x561e1006a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e100714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6da670b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0ff3fc30 con 0x561e100510e0 2023-09-13T09:53:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6da670b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0ff3f930 con 0x561e10050780 2023-09-13T09:53:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6da670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0fe239a0 con 0x561e1004fa80 2023-09-13T09:53:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6da670b80 10 client.0 _ll_register_callbacks cb 0x561e0ff3d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e100714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6c7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e1004fa80 0x561e10069f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e100714e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42706/0 (socket says 172.21.15.6:42706) 2023-09-13T09:53:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6c7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e1004fa80 0x561e10069f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45756/0 (socket says 172.21.15.6:45756) 2023-09-13T09:53:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 -- 172.21.15.6:0/1590320362 learned_addr learned my addr 172.21.15.6:0/1590320362 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6c77fe700 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e10050780 0x561e1006a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 -- 172.21.15.6:0/1590320362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e1004fa80 msgr2=0x561e10069f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e1004fa80 0x561e10069f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 -- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e10050780 msgr2=0x561e1006a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e10050780 0x561e1006a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.682+0000 7fc6cca28700 1 -- 172.21.15.6:0/1590320362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6bc0099e0 con 0x561e100510e0 2023-09-13T09:53:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6cca28700 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e100714e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0098b90 tx=0x7fc6c0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62b0743cd27ebfd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6a77fe700 1 -- 172.21.15.6:0/1590320362 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0099ea0 con 0x561e100510e0 2023-09-13T09:53:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6a77fe700 1 -- 172.21.15.6:0/1590320362 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc6c0099590 con 0x561e100510e0 2023-09-13T09:53:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e100426f0 con 0x561e100510e0 2023-09-13T09:53:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6a77fe700 1 -- 172.21.15.6:0/1590320362 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6c00b1200 con 0x561e100510e0 2023-09-13T09:53:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 10 client.19179 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x561e0ffb9820 con 0x561e100510e0 2023-09-13T09:53:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6a77fe700 1 -- 172.21.15.6:0/1590320362 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6c007b020 con 0x561e100510e0 2023-09-13T09:53:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6a77fe700 1 -- 172.21.15.6:0/1590320362 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc6c00a09e0 con 0x561e100510e0 2023-09-13T09:53:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 10 client.19179 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 10 client.19179 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 20 client.19179 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:25.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e10075ca0 0x561e100780c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 4 client.19179 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.683+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e0ff9a9f0 con 0x561e10075ca0 2023-09-13T09:53:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.684+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e10075ca0 0x561e100780c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.684+0000 7fc6a77fe700 10 client.19179 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:25.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.684+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e10075ca0 0x561e100780c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3d6daca6e10e1f95 server_cookie=bfe82648c4b53e24 in_seq=0 out_seq=0 2023-09-13T09:53:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6a77fe700 1 -- 172.21.15.6:0/1590320362 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561e0ff9a9f0 con 0x561e10075ca0 2023-09-13T09:53:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6a77fe700 10 client.19179 handle_command_reply: tid=0 2023-09-13T09:53:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 client.19179 shutdown 2023-09-13T09:53:25.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 msgr2=0x561e100714e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e100714e0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0098b90 tx=0x7fc6c0004ad0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 shutdown_connections 2023-09-13T09:53:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e10075ca0 0x561e100780c0 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e100510e0 0x561e100714e0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e1004fa80 0x561e10069f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 --2- 172.21.15.6:0/1590320362 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e10050780 0x561e1006a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6a77fe700 0 client.19179 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 >> 172.21.15.6:0/1590320362 conn(0x561e0ffadd00 msgr2=0x561e10044870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 shutdown_connections 2023-09-13T09:53:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 1 -- 172.21.15.6:0/1590320362 wait complete. 2023-09-13T09:53:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.690+0000 7fc6da670b80 20 client.19179 trim_cache size 0 max 16384 2023-09-13T09:53:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 Processor -- start 2023-09-13T09:53:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 -- start start 2023-09-13T09:53:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e1004fa80 0x561e1004f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e100714a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e100510e0 0x561e10043960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1004aae0 con 0x561e1004fa80 2023-09-13T09:53:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e1004b7b0 con 0x561e100510e0 2023-09-13T09:53:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6da670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e10042480 con 0x561e10050780 2023-09-13T09:53:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e1004fa80 0x561e1004f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6c7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e1004fa80 0x561e1004f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42710/0 (socket says 172.21.15.6:42710) 2023-09-13T09:53:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6c7fff700 1 -- 172.21.15.6:0/2123216962 learned_addr learned my addr 172.21.15.6:0/2123216962 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6cca28700 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e100510e0 0x561e10043960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6c77fe700 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e100714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6c7fff700 1 -- 172.21.15.6:0/2123216962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 msgr2=0x561e100714a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.711+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e100714a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.712+0000 7fc6c7fff700 1 -- 172.21.15.6:0/2123216962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e100510e0 msgr2=0x561e10043960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.712+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e100510e0 0x561e10043960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.712+0000 7fc6c7fff700 1 -- 172.21.15.6:0/2123216962 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e0fdcde60 con 0x561e1004fa80 2023-09-13T09:53:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.712+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e1004fa80 0x561e1004f540 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b960 tx=0x7fc6b8020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c193b2308906cc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.712+0000 7fc6aeffd700 1 -- 172.21.15.6:0/2123216962 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b802b040 con 0x561e1004fa80 2023-09-13T09:53:25.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.712+0000 7fc6aeffd700 1 -- 172.21.15.6:0/2123216962 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6b802c040 con 0x561e1004fa80 2023-09-13T09:53:25.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.712+0000 7fc6aeffd700 1 -- 172.21.15.6:0/2123216962 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b8004d40 con 0x561e1004fa80 2023-09-13T09:53:25.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 -- 172.21.15.6:0/2123216962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e1004fa80 msgr2=0x561e1004f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e1004fa80 0x561e1004f540 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b960 tx=0x7fc6b8020000 comp rx=0 tx=0).stop 2023-09-13T09:53:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 -- 172.21.15.6:0/2123216962 shutdown_connections 2023-09-13T09:53:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e100510e0 0x561e10043960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e1004fa80 0x561e1004f540 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 --2- 172.21.15.6:0/2123216962 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e10050780 0x561e100714a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 -- 172.21.15.6:0/2123216962 >> 172.21.15.6:0/2123216962 conn(0x561e0ffadd00 msgr2=0x561e10069f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.713+0000 7fc6da670b80 1 -- 172.21.15.6:0/2123216962 shutdown_connections 2023-09-13T09:53:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 -- 172.21.15.6:0/2123216962 wait complete. 2023-09-13T09:53:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 -- start start 2023-09-13T09:53:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 Processor -- start 2023-09-13T09:53:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1006e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e10050780 0x561e1006e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e100510e0 0x561e100c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e100ca000 con 0x561e10050780 2023-09-13T09:53:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e100ca140 con 0x561e1004fa80 2023-09-13T09:53:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e100ca280 con 0x561e100510e0 2023-09-13T09:53:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.714+0000 7fc6da670b80 10 client.0 _ll_register_callbacks cb 0x561e0ff3d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e10050780 0x561e1006e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6c77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e10050780 0x561e1006e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42718/0 (socket says 172.21.15.6:42718) 2023-09-13T09:53:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6c77fe700 1 -- 172.21.15.6:0/442090007 learned_addr learned my addr 172.21.15.6:0/442090007 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1006e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6cca28700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e100510e0 0x561e100c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6cca28700 1 -- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 msgr2=0x561e1006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6cca28700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1006e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6cca28700 1 -- 172.21.15.6:0/442090007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e10050780 msgr2=0x561e1006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6cca28700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e10050780 0x561e1006e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6cca28700 1 -- 172.21.15.6:0/442090007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c8108a30 con 0x561e100510e0 2023-09-13T09:53:25.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:25.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6c77fe700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e10050780 0x561e1006e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:25.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6cca28700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e100510e0 0x561e100c9ac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0097df0 tx=0x7fc6c00985b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c123fe4f3fa0c3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.715+0000 7fc6a77fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:25.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6a77fe700 1 -- 172.21.15.6:0/442090007 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c0099ea0 con 0x561e100510e0 2023-09-13T09:53:25.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6a77fe700 1 -- 172.21.15.6:0/442090007 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc6c007c080 con 0x561e100510e0 2023-09-13T09:53:25.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc6bc004390 con 0x561e100510e0 2023-09-13T09:53:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6a77fe700 1 -- 172.21.15.6:0/442090007 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc6c00b1200 con 0x561e100510e0 2023-09-13T09:53:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 10 client.28501 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x561e0fdb6ce0 con 0x561e100510e0 2023-09-13T09:53:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6a77fe700 1 -- 172.21.15.6:0/442090007 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc6bc004390 con 0x561e100510e0 2023-09-13T09:53:25.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6a77fe700 1 -- 172.21.15.6:0/442090007 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fc6c00826e0 con 0x561e100510e0 2023-09-13T09:53:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 10 client.28501 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 10 client.28501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 20 client.28501 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e100cb920 0x561e100cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 4 client.28501 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:53:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.716+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561e0ff5b0d0 con 0x561e100cb920 2023-09-13T09:53:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.717+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e100cb920 0x561e100cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.717+0000 7fc6a77fe700 10 client.28501 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:25.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.717+0000 7fc6c7fff700 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e100cb920 0x561e100cdd40 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3996cd7ed0ec3da server_cookie=f790b1049a6c48e0 in_seq=0 out_seq=0 2023-09-13T09:53:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6a77fe700 1 -- 172.21.15.6:0/442090007 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561e0ff5b0d0 con 0x561e100cb920 2023-09-13T09:53:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6a77fe700 10 client.28501 handle_command_reply: tid=0 2023-09-13T09:53:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 client.28501 shutdown 2023-09-13T09:53:25.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e100510e0 msgr2=0x561e100c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e100510e0 0x561e100c9ac0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc6c0097df0 tx=0x7fc6c00985b0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 shutdown_connections 2023-09-13T09:53:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561e100510e0 0x561e100c9ac0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561e1004fa80 0x561e1006e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561e100cb920 0x561e100cdd40 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 --2- 172.21.15.6:0/442090007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561e10050780 0x561e1006e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6a77fe700 0 client.28501 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 >> 172.21.15.6:0/442090007 conn(0x561e0ffadd00 msgr2=0x561e1004e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 shutdown_connections 2023-09-13T09:53:25.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 1 -- 172.21.15.6:0/442090007 wait complete. 2023-09-13T09:53:25.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.723+0000 7fc6da670b80 20 client.28501 trim_cache size 0 max 16384 2023-09-13T09:53:25.736 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:53:25.736 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:53:25.736 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "12bc82d5-22b5-4882-aa57-302843a99e5a", 2023-09-13T09:53:25.737 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:53:25.737 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:53:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc6b00a06c0 msgr2=0x7fc6b00a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc6b00a06c0 0x7fc6b00a2b80 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc6b800b2e0 tx=0x7fc6b8005fb0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c8101830 msgr2=0x7fc6c8102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c8101830 0x7fc6c8102a00 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc6c000ef30 tx=0x7fc6c000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 shutdown_connections 2023-09-13T09:53:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c8101830 0x7fc6c8102a00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc6c80ffca0 0x7fc6c8072000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc6b00a06c0 0x7fc6b00a2b80 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 --2- 172.21.15.6:0/2801301789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6c8100e90 0x7fc6c8072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 >> 172.21.15.6:0/2801301789 conn(0x7fc6c80fb1f0 msgr2=0x7fc6c80fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 shutdown_connections 2023-09-13T09:53:25.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.724+0000 7fc6ce48b700 1 -- 172.21.15.6:0/2801301789 wait complete. 2023-09-13T09:53:25.741 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:53:25.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 -- 172.21.15.6:0/3091173853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea34101290 msgr2=0x7fea341016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 --2- 172.21.15.6:0/3091173853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea34101290 0x7fea341016b0 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7fea24009990 tx=0x7fea24009ca0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 -- 172.21.15.6:0/3091173853 shutdown_connections 2023-09-13T09:53:25.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 --2- 172.21.15.6:0/3091173853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea341008a0 0x7fea34108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 --2- 172.21.15.6:0/3091173853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea34101290 0x7fea341016b0 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 --2- 172.21.15.6:0/3091173853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea340ffee0 0x7fea34100360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 -- 172.21.15.6:0/3091173853 >> 172.21.15.6:0/3091173853 conn(0x7fea340fa9b0 msgr2=0x7fea340fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 -- 172.21.15.6:0/3091173853 shutdown_connections 2023-09-13T09:53:25.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.945+0000 7fea3999c700 1 -- 172.21.15.6:0/3091173853 wait complete. 2023-09-13T09:53:25.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 Processor -- start 2023-09-13T09:53:25.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 -- start start 2023-09-13T09:53:25.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea340ffee0 0x7fea34196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea341008a0 0x7fea34197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea34101290 0x7fea3419e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3419e660 con 0x7fea340ffee0 2023-09-13T09:53:25.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3419e7a0 con 0x7fea341008a0 2023-09-13T09:53:25.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.946+0000 7fea3999c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3419e930 con 0x7fea34101290 2023-09-13T09:53:25.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea340ffee0 0x7fea34196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea340ffee0 0x7fea34196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42730/0 (socket says 172.21.15.6:42730) 2023-09-13T09:53:25.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 -- 172.21.15.6:0/192550713 learned_addr learned my addr 172.21.15.6:0/192550713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea337fe700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea34101290 0x7fea3419e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 -- 172.21.15.6:0/192550713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea34101290 msgr2=0x7fea3419e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea34101290 0x7fea3419e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 -- 172.21.15.6:0/192550713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea341008a0 msgr2=0x7fea34197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea341008a0 0x7fea34197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 -- 172.21.15.6:0/192550713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea240095f0 con 0x7fea340ffee0 2023-09-13T09:53:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea32ffd700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea340ffee0 0x7fea34196ae0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fea24004730 tx=0x7fea24004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea3899a700 1 -- 172.21.15.6:0/192550713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2401d070 con 0x7fea340ffee0 2023-09-13T09:53:25.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea3899a700 1 -- 172.21.15.6:0/192550713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea24021410 con 0x7fea340ffee0 2023-09-13T09:53:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.947+0000 7fea3899a700 1 -- 172.21.15.6:0/192550713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24017650 con 0x7fea340ffee0 2023-09-13T09:53:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.948+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3419ebb0 con 0x7fea340ffee0 2023-09-13T09:53:25.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.948+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3419ef80 con 0x7fea340ffee0 2023-09-13T09:53:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.951+0000 7fea3899a700 1 -- 172.21.15.6:0/192550713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fea2400fad0 con 0x7fea340ffee0 2023-09-13T09:53:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.951+0000 7fea3899a700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea1c0a0640 0x7fea1c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.952+0000 7fea3899a700 1 -- 172.21.15.6:0/192550713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea240cd080 con 0x7fea340ffee0 2023-09-13T09:53:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.952+0000 7fea327fc700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea1c0a0640 0x7fea1c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.952+0000 7fea327fc700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea1c0a0640 0x7fea1c0a2b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fea34100fb0 tx=0x7fea280096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.953+0000 7fea45b81b80 1 Processor -- start 2023-09-13T09:53:25.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea45b81b80 1 -- start start 2023-09-13T09:53:25.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee0658f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee06578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee0658270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea45b81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee05ac780 con 0x564ee0658b10 2023-09-13T09:53:25.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea45b81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee05aa0a0 con 0x564ee0657e10 2023-09-13T09:53:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea45b81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee05a5990 con 0x564ee0659470 2023-09-13T09:53:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea327fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee06578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea327fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee06578d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45794/0 (socket says 172.21.15.6:45794) 2023-09-13T09:53:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea327fc700 1 -- 172.21.15.6:0/3341718602 learned_addr learned my addr 172.21.15.6:0/3341718602 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea32ffd700 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee0658f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.954+0000 7fea337fe700 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee0658270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.955+0000 7fea327fc700 1 -- 172.21.15.6:0/3341718602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 msgr2=0x564ee0658270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.955+0000 7fea327fc700 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee0658270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.955+0000 7fea327fc700 1 -- 172.21.15.6:0/3341718602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 msgr2=0x564ee0658f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.955+0000 7fea327fc700 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee0658f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.955+0000 7fea327fc700 1 -- 172.21.15.6:0/3341718602 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ee0425630 con 0x564ee0659470 2023-09-13T09:53:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.955+0000 7fea327fc700 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee06578d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea2800ebf0 tx=0x7fea28009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d3a6644b537f31d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.955+0000 7fea19ffb700 1 -- 172.21.15.6:0/3341718602 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28010ac0 con 0x564ee0659470 2023-09-13T09:53:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.956+0000 7fea19ffb700 1 -- 172.21.15.6:0/3341718602 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea28010c20 con 0x564ee0659470 2023-09-13T09:53:25.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.956+0000 7fea19ffb700 1 -- 172.21.15.6:0/3341718602 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2801c680 con 0x564ee0659470 2023-09-13T09:53:25.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 -- 172.21.15.6:0/3341718602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 msgr2=0x564ee06578d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee06578d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea2800ebf0 tx=0x7fea28009f90 comp rx=0 tx=0).stop 2023-09-13T09:53:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 -- 172.21.15.6:0/3341718602 shutdown_connections 2023-09-13T09:53:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee0658270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee0658f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3341718602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee06578d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 -- 172.21.15.6:0/3341718602 >> 172.21.15.6:0/3341718602 conn(0x564ee05b1c80 msgr2=0x564ee064df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 -- 172.21.15.6:0/3341718602 shutdown_connections 2023-09-13T09:53:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 -- 172.21.15.6:0/3341718602 wait complete. 2023-09-13T09:53:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.957+0000 7fea45b81b80 1 -- start start 2023-09-13T09:53:25.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 1 Processor -- start 2023-09-13T09:53:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06613a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee06618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee0543bb0 con 0x564ee0658b10 2023-09-13T09:53:25.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee05438b0 con 0x564ee0657e10 2023-09-13T09:53:25.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee0427920 con 0x564ee0659470 2023-09-13T09:53:25.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea45b81b80 10 client.0 _ll_register_callbacks cb 0x564ee0541680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:25.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee06618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee06618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42744/0 (socket says 172.21.15.6:42744) 2023-09-13T09:53:25.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea327fc700 1 -- 172.21.15.6:0/1846107629 learned_addr learned my addr 172.21.15.6:0/1846107629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea337fe700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.958+0000 7fea32ffd700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06613a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea337fe700 1 -- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 msgr2=0x564ee06613a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea337fe700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06613a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea337fe700 1 -- 172.21.15.6:0/1846107629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 msgr2=0x564ee06618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea337fe700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee06618e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea337fe700 1 -- 172.21.15.6:0/1846107629 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2800e8d0 con 0x564ee0659470 2023-09-13T09:53:25.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea32ffd700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:25.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea337fe700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea2c011e90 tx=0x7fea2c014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=838fe65a2a7af682 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea12ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:25.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea12ffd700 1 -- 172.21.15.6:0/1846107629 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c00e040 con 0x564ee0659470 2023-09-13T09:53:25.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea12ffd700 1 -- 172.21.15.6:0/1846107629 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea2c0093a0 con 0x564ee0659470 2023-09-13T09:53:25.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ee0646670 con 0x564ee0659470 2023-09-13T09:53:25.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea12ffd700 1 -- 172.21.15.6:0/1846107629 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea2c004db0 con 0x564ee0659470 2023-09-13T09:53:25.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea45b81b80 10 client.28513 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:25.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.959+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x564ee05bd7a0 con 0x564ee0659470 2023-09-13T09:53:25.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea12ffd700 1 -- 172.21.15.6:0/1846107629 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564ee0646670 con 0x564ee0659470 2023-09-13T09:53:25.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea12ffd700 1 -- 172.21.15.6:0/1846107629 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fea2c01c030 con 0x564ee0659470 2023-09-13T09:53:25.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea45b81b80 10 client.28513 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:25.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea45b81b80 10 client.28513 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:25.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea45b81b80 20 client.28513 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:25.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee066d330 0x564ee066f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea45b81b80 4 client.28513 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:25.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.960+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ee059e970 con 0x564ee066d330 2023-09-13T09:53:25.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.961+0000 7fea32ffd700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee066d330 0x564ee066f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.961+0000 7fea12ffd700 10 client.28513 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:25.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.961+0000 7fea32ffd700 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee066d330 0x564ee066f750 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be22711695d645df server_cookie=59ce8d6b2814464b in_seq=0 out_seq=0 2023-09-13T09:53:25.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea12ffd700 1 -- 172.21.15.6:0/1846107629 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564ee059e970 con 0x564ee066d330 2023-09-13T09:53:25.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea12ffd700 10 client.28513 handle_command_reply: tid=0 2023-09-13T09:53:25.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 client.28513 shutdown 2023-09-13T09:53:25.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 msgr2=0x564ee0668920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668920 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fea2c011e90 tx=0x7fea2c014600 comp rx=0 tx=0).stop 2023-09-13T09:53:25.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 shutdown_connections 2023-09-13T09:53:25.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668920 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06613a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee066d330 0x564ee066f750 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1846107629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee06618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea12ffd700 0 client.28513 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 >> 172.21.15.6:0/1846107629 conn(0x564ee05b1c80 msgr2=0x564ee06487f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 shutdown_connections 2023-09-13T09:53:25.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 1 -- 172.21.15.6:0/1846107629 wait complete. 2023-09-13T09:53:25.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.966+0000 7fea45b81b80 20 client.28513 trim_cache size 0 max 16384 2023-09-13T09:53:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 Processor -- start 2023-09-13T09:53:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 -- start start 2023-09-13T09:53:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06488f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee065bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee065c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee064ffd0 con 0x564ee0658b10 2023-09-13T09:53:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee0646490 con 0x564ee0657e10 2023-09-13T09:53:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea45b81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee064f730 con 0x564ee0659470 2023-09-13T09:53:25.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee065bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.987+0000 7fea327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee065bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42754/0 (socket says 172.21.15.6:42754) 2023-09-13T09:53:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea327fc700 1 -- 172.21.15.6:0/1133907048 learned_addr learned my addr 172.21.15.6:0/1133907048 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea32ffd700 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06488f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea337fe700 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee065c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:25.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea327fc700 1 -- 172.21.15.6:0/1133907048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 msgr2=0x564ee065c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea327fc700 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee065c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea327fc700 1 -- 172.21.15.6:0/1133907048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 msgr2=0x564ee06488f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea327fc700 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06488f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea327fc700 1 -- 172.21.15.6:0/1133907048 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ee03d1de0 con 0x564ee0658b10 2023-09-13T09:53:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea327fc700 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee065bcf0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fea28009300 tx=0x7fea28005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67712c0a50418b3d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:25.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea1a7fc700 1 -- 172.21.15.6:0/1133907048 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea280108c0 con 0x564ee0658b10 2023-09-13T09:53:25.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea1a7fc700 1 -- 172.21.15.6:0/1133907048 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea2802a040 con 0x564ee0658b10 2023-09-13T09:53:25.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.988+0000 7fea1a7fc700 1 -- 172.21.15.6:0/1133907048 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2802e8f0 con 0x564ee0658b10 2023-09-13T09:53:25.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.989+0000 7fea45b81b80 1 -- 172.21.15.6:0/1133907048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 msgr2=0x564ee065bcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:25.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.989+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee065bcf0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7fea28009300 tx=0x7fea28005ce0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 -- 172.21.15.6:0/1133907048 shutdown_connections 2023-09-13T09:53:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee065c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0657e10 0x564ee06488f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 --2- 172.21.15.6:0/1133907048 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0658b10 0x564ee065bcf0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:25.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 -- 172.21.15.6:0/1133907048 >> 172.21.15.6:0/1133907048 conn(0x564ee05b1c80 msgr2=0x564ee0669210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 -- 172.21.15.6:0/1133907048 shutdown_connections 2023-09-13T09:53:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 -- 172.21.15.6:0/1133907048 wait complete. 2023-09-13T09:53:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 -- start start 2023-09-13T09:53:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 Processor -- start 2023-09-13T09:53:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.990+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0657e10 0x564ee0657220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:25.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0658b10 0x564ee0655830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea45b81b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea45b81b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee0655d70 con 0x564ee0657e10 2023-09-13T09:53:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea45b81b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee0655eb0 con 0x564ee0658b10 2023-09-13T09:53:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea45b81b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ee0656070 con 0x564ee0659470 2023-09-13T09:53:26.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea45b81b80 10 client.0 _ll_register_callbacks cb 0x564ee0541680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0657e10 0x564ee0657220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0657e10 0x564ee0657220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42758/0 (socket says 172.21.15.6:42758) 2023-09-13T09:53:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 -- 172.21.15.6:0/3837995212 learned_addr learned my addr 172.21.15.6:0/3837995212 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea327fc700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0658b10 0x564ee0655830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea337fe700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 -- 172.21.15.6:0/3837995212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 msgr2=0x564ee0668840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 -- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0658b10 msgr2=0x564ee0655830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0658b10 0x564ee0655830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 -- 172.21.15.6:0/3837995212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ee0425630 con 0x564ee0657e10 2023-09-13T09:53:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea337fe700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea32ffd700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0657e10 0x564ee0657220 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fea240095c0 tx=0x7fea24021bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8590eea2c6047705 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.991+0000 7fea12ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea12ffd700 1 -- 172.21.15.6:0/3837995212 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24098ab0 con 0x564ee0657e10 2023-09-13T09:53:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea12ffd700 1 -- 172.21.15.6:0/3837995212 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fea240a2400 con 0x564ee0657e10 2023-09-13T09:53:26.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea28010c20 con 0x564ee0657e10 2023-09-13T09:53:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea12ffd700 1 -- 172.21.15.6:0/3837995212 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea240a25c0 con 0x564ee0657e10 2023-09-13T09:53:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 10 client.19203 fetch_fsmap learned FSMap version 46 2023-09-13T09:53:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x564ee03bac60 con 0x564ee0657e10 2023-09-13T09:53:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea12ffd700 1 -- 172.21.15.6:0/3837995212 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fea2407d020 con 0x564ee0657e10 2023-09-13T09:53:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea12ffd700 1 -- 172.21.15.6:0/3837995212 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 46) v1 ==== 7942+0+0 (secure 0 0 0) 0x7fea2409e250 con 0x564ee0657e10 2023-09-13T09:53:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 10 client.19203 fetch_fsmap finished waiting for FSMap version 46 2023-09-13T09:53:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 10 client.19203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 20 client.19203 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee06c6950 0x564ee06c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 4 client.19203 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:53:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.992+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564ee055f050 con 0x564ee06c6950 2023-09-13T09:53:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.994+0000 7fea327fc700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee06c6950 0x564ee06c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.994+0000 7fea12ffd700 10 client.19203 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:26.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:25.994+0000 7fea327fc700 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee06c6950 0x564ee06c8d70 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f39f8d1791559b53 server_cookie=99cb350b70e4a11f in_seq=0 out_seq=0 2023-09-13T09:53:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.001+0000 7fea12ffd700 1 -- 172.21.15.6:0/3837995212 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x564ee055f050 con 0x564ee06c6950 2023-09-13T09:53:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.001+0000 7fea12ffd700 10 client.19203 handle_command_reply: tid=0 2023-09-13T09:53:26.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.001+0000 7fea45b81b80 1 client.19203 shutdown 2023-09-13T09:53:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0657e10 msgr2=0x564ee0657220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0657e10 0x564ee0657220 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fea240095c0 tx=0x7fea24021bb0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 shutdown_connections 2023-09-13T09:53:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ee0659470 0x564ee0668840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564ee06c6950 0x564ee06c8d70 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ee0657e10 0x564ee0657220 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea12ffd700 0 client.19203 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 --2- 172.21.15.6:0/3837995212 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ee0658b10 0x564ee0655830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 >> 172.21.15.6:0/3837995212 conn(0x564ee05b1c80 msgr2=0x564ee065bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 shutdown_connections 2023-09-13T09:53:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 1 -- 172.21.15.6:0/3837995212 wait complete. 2023-09-13T09:53:26.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea45b81b80 20 client.19203 trim_cache size 0 max 16384 2023-09-13T09:53:26.011 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:53:26.011 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (9 inodes in the stack)", 2023-09-13T09:53:26.012 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:53:26.012 INFO:teuthology.orchestra.run.smithi006.stdout: "12bc82d5-22b5-4882-aa57-302843a99e5a": { 2023-09-13T09:53:26.012 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:53:26.012 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "12bc82d5-22b5-4882-aa57-302843a99e5a", 2023-09-13T09:53:26.012 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:53:26.012 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:53:26.013 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:53:26.013 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:53:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea1c0a0640 msgr2=0x7fea1c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea3999c700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea1c0a0640 0x7fea1c0a2b00 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fea34100fb0 tx=0x7fea280096c0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea340ffee0 msgr2=0x7fea34196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.002+0000 7fea3999c700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea340ffee0 0x7fea34196ae0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7fea24004730 tx=0x7fea24004760 comp rx=0 tx=0).stop 2023-09-13T09:53:26.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 shutdown_connections 2023-09-13T09:53:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fea34101290 0x7fea3419e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fea1c0a0640 0x7fea1c0a2b00 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea340ffee0 0x7fea34196ae0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 --2- 172.21.15.6:0/192550713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fea341008a0 0x7fea34197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 >> 172.21.15.6:0/192550713 conn(0x7fea340fa9b0 msgr2=0x7fea340fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 shutdown_connections 2023-09-13T09:53:26.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:26.003+0000 7fea3999c700 1 -- 172.21.15.6:0/192550713 wait complete. 2023-09-13T09:53:26.018 INFO:tasks.cephfs.filesystem:scrub status for tag:12bc82d5-22b5-4882-aa57-302843a99e5a - {'path': '/', 'tag': '12bc82d5-22b5-4882-aa57-302843a99e5a', 'options': 'recursive,force'} 2023-09-13T09:53:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:26 smithi006 ceph-mon[98665]: pgmap v717: 97 pgs: 97 active+clean; 627 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 23 MiB/s wr, 708 op/s 2023-09-13T09:53:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:26 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:26 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:26 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:26 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:26.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:26 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:26 smithi131 ceph-mon[102785]: pgmap v717: 97 pgs: 97 active+clean; 627 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 23 MiB/s wr, 708 op/s 2023-09-13T09:53:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:26 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:26 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:26.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:26 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:26 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:26 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:26.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:26 smithi053 ceph-mon[102373]: pgmap v717: 97 pgs: 97 active+clean; 627 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 23 MiB/s wr, 708 op/s 2023-09-13T09:53:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:26 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:26 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:26 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:26.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:26 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:26.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:26 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:26.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 32111 41.45 MB/sec warmup 46 sec latency 188.036 ms 2023-09-13T09:53:27.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:53:27.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:27.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:53:27.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:27.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:53:27.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:27.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:53:27.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 32922 41.50 MB/sec warmup 47 sec latency 66.357 ms 2023-09-13T09:53:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:28 smithi006 ceph-mon[98665]: pgmap v718: 97 pgs: 97 active+clean; 635 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 23 MiB/s wr, 778 op/s 2023-09-13T09:53:28.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:28 smithi053 ceph-mon[102373]: pgmap v718: 97 pgs: 97 active+clean; 635 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 23 MiB/s wr, 778 op/s 2023-09-13T09:53:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:28 smithi131 ceph-mon[102785]: pgmap v718: 97 pgs: 97 active+clean; 635 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 23 MiB/s wr, 778 op/s 2023-09-13T09:53:28.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 33651 41.37 MB/sec warmup 48 sec latency 51.351 ms 2023-09-13T09:53:29.554 INFO:tasks.workunit.client.0.smithi006.stdout: 10 34155 41.09 MB/sec warmup 49 sec latency 209.473 ms 2023-09-13T09:53:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:30 smithi006 ceph-mon[98665]: pgmap v719: 97 pgs: 97 active+clean; 635 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 14 MiB/s wr, 679 op/s 2023-09-13T09:53:30.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:30 smithi053 ceph-mon[102373]: pgmap v719: 97 pgs: 97 active+clean; 635 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 14 MiB/s wr, 679 op/s 2023-09-13T09:53:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:30 smithi131 ceph-mon[102785]: pgmap v719: 97 pgs: 97 active+clean; 635 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 14 MiB/s wr, 679 op/s 2023-09-13T09:53:30.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 34831 40.87 MB/sec warmup 50 sec latency 69.254 ms 2023-09-13T09:53:31.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 35717 41.12 MB/sec warmup 51 sec latency 47.866 ms 2023-09-13T09:53:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:32 smithi006 ceph-mon[98665]: pgmap v720: 97 pgs: 97 active+clean; 638 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 731 op/s 2023-09-13T09:53:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:32 smithi053 ceph-mon[102373]: pgmap v720: 97 pgs: 97 active+clean; 638 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 731 op/s 2023-09-13T09:53:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:32 smithi131 ceph-mon[102785]: pgmap v720: 97 pgs: 97 active+clean; 638 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 731 op/s 2023-09-13T09:53:32.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 36514 41.23 MB/sec warmup 52 sec latency 54.457 ms 2023-09-13T09:53:33.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 37203 41.21 MB/sec warmup 53 sec latency 66.932 ms 2023-09-13T09:53:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:34 smithi006 ceph-mon[98665]: pgmap v721: 97 pgs: 97 active+clean; 647 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.7 MiB/s wr, 816 op/s 2023-09-13T09:53:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:34 smithi053 ceph-mon[102373]: pgmap v721: 97 pgs: 97 active+clean; 647 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.7 MiB/s wr, 816 op/s 2023-09-13T09:53:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:34 smithi131 ceph-mon[102785]: pgmap v721: 97 pgs: 97 active+clean; 647 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.7 MiB/s wr, 816 op/s 2023-09-13T09:53:34.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 37708 40.86 MB/sec warmup 54 sec latency 236.008 ms 2023-09-13T09:53:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:53:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:53:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:53:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:35.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 38382 40.72 MB/sec warmup 55 sec latency 89.534 ms 2023-09-13T09:53:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:36 smithi006 ceph-mon[98665]: pgmap v722: 97 pgs: 97 active+clean; 648 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.2 MiB/s wr, 765 op/s 2023-09-13T09:53:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:36 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:53:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:36 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:53:36.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:36 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:36 smithi053 ceph-mon[102373]: pgmap v722: 97 pgs: 97 active+clean; 648 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.2 MiB/s wr, 765 op/s 2023-09-13T09:53:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:36 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:53:36.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:36 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:53:36.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:36 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:36 smithi131 ceph-mon[102785]: pgmap v722: 97 pgs: 97 active+clean; 648 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.2 MiB/s wr, 765 op/s 2023-09-13T09:53:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:36 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:53:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:36 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:53:36.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:36 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:53:36.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 39205 40.88 MB/sec warmup 56 sec latency 59.920 ms 2023-09-13T09:53:37.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 39918 40.76 MB/sec warmup 57 sec latency 61.016 ms 2023-09-13T09:53:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:38 smithi006 ceph-mon[98665]: pgmap v723: 97 pgs: 97 active+clean; 656 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-09-13T09:53:38.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:38 smithi053 ceph-mon[102373]: pgmap v723: 97 pgs: 97 active+clean; 656 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-09-13T09:53:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:38 smithi131 ceph-mon[102785]: pgmap v723: 97 pgs: 97 active+clean; 656 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-09-13T09:53:38.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 40738 40.87 MB/sec warmup 58 sec latency 64.213 ms 2023-09-13T09:53:39.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 41303 40.70 MB/sec warmup 59 sec latency 226.378 ms 2023-09-13T09:53:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:40 smithi006 ceph-mon[98665]: pgmap v724: 97 pgs: 97 active+clean; 661 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.9 MiB/s wr, 768 op/s 2023-09-13T09:53:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:53:40.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:40 smithi053 ceph-mon[102373]: pgmap v724: 97 pgs: 97 active+clean; 661 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.9 MiB/s wr, 768 op/s 2023-09-13T09:53:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:53:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:40 smithi131 ceph-mon[102785]: pgmap v724: 97 pgs: 97 active+clean; 661 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.9 MiB/s wr, 768 op/s 2023-09-13T09:53:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:40.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:40.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:40.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:53:40.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 41931 40.59 MB/sec warmup 60 sec latency 91.043 ms 2023-09-13T09:53:41.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 42622 40.49 MB/sec warmup 61 sec latency 72.349 ms 2023-09-13T09:53:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:42 smithi006 ceph-mon[98665]: pgmap v725: 97 pgs: 97 active+clean; 661 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 794 op/s 2023-09-13T09:53:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:42 smithi053 ceph-mon[102373]: pgmap v725: 97 pgs: 97 active+clean; 661 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 794 op/s 2023-09-13T09:53:42.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:42 smithi131 ceph-mon[102785]: pgmap v725: 97 pgs: 97 active+clean; 661 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 794 op/s 2023-09-13T09:53:42.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 43486 40.57 MB/sec warmup 62 sec latency 72.776 ms 2023-09-13T09:53:43.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 44247 40.64 MB/sec warmup 63 sec latency 66.259 ms 2023-09-13T09:53:44.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:44 smithi053 ceph-mon[102373]: pgmap v726: 97 pgs: 97 active+clean; 665 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 869 op/s 2023-09-13T09:53:44.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:44 smithi006 ceph-mon[98665]: pgmap v726: 97 pgs: 97 active+clean; 665 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 869 op/s 2023-09-13T09:53:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:44 smithi131 ceph-mon[102785]: pgmap v726: 97 pgs: 97 active+clean; 665 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 869 op/s 2023-09-13T09:53:44.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 44905 40.54 MB/sec warmup 64 sec latency 153.044 ms 2023-09-13T09:53:45.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 45422 40.44 MB/sec warmup 65 sec latency 258.723 ms 2023-09-13T09:53:46.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:46 smithi006 ceph-mon[98665]: pgmap v727: 97 pgs: 97 active+clean; 673 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 816 op/s 2023-09-13T09:53:46.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:46 smithi053 ceph-mon[102373]: pgmap v727: 97 pgs: 97 active+clean; 673 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 816 op/s 2023-09-13T09:53:46.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:46 smithi131 ceph-mon[102785]: pgmap v727: 97 pgs: 97 active+clean; 673 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 816 op/s 2023-09-13T09:53:46.555 INFO:tasks.workunit.client.0.smithi006.stdout: 10 46125 40.32 MB/sec warmup 66 sec latency 49.303 ms 2023-09-13T09:53:47.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 46968 40.28 MB/sec warmup 67 sec latency 98.215 ms 2023-09-13T09:53:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:48 smithi006 ceph-mon[98665]: pgmap v728: 97 pgs: 97 active+clean; 680 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 888 op/s 2023-09-13T09:53:48.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:48 smithi053 ceph-mon[102373]: pgmap v728: 97 pgs: 97 active+clean; 680 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 888 op/s 2023-09-13T09:53:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:48 smithi131 ceph-mon[102785]: pgmap v728: 97 pgs: 97 active+clean; 680 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 888 op/s 2023-09-13T09:53:48.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 47997 40.65 MB/sec warmup 68 sec latency 145.055 ms 2023-09-13T09:53:49.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 48636 40.61 MB/sec warmup 69 sec latency 45.514 ms 2023-09-13T09:53:50.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:50 smithi006 ceph-mon[98665]: pgmap v729: 97 pgs: 97 active+clean; 684 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 768 op/s 2023-09-13T09:53:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:50 smithi053 ceph-mon[102373]: pgmap v729: 97 pgs: 97 active+clean; 684 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 768 op/s 2023-09-13T09:53:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:50 smithi131 ceph-mon[102785]: pgmap v729: 97 pgs: 97 active+clean; 684 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 768 op/s 2023-09-13T09:53:50.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 49062 40.26 MB/sec warmup 70 sec latency 198.701 ms 2023-09-13T09:53:51.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:51 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:51.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:51 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:51.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:51 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:53:51.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 49901 40.31 MB/sec warmup 71 sec latency 54.712 ms 2023-09-13T09:53:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:52 smithi006 ceph-mon[98665]: pgmap v730: 97 pgs: 97 active+clean; 685 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 717 op/s 2023-09-13T09:53:52.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:52 smithi053 ceph-mon[102373]: pgmap v730: 97 pgs: 97 active+clean; 685 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 717 op/s 2023-09-13T09:53:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:52 smithi131 ceph-mon[102785]: pgmap v730: 97 pgs: 97 active+clean; 685 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 717 op/s 2023-09-13T09:53:52.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 50828 40.40 MB/sec warmup 72 sec latency 492.870 ms 2023-09-13T09:53:53.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 51628 40.52 MB/sec warmup 73 sec latency 619.367 ms 2023-09-13T09:53:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:54 smithi006 ceph-mon[98665]: pgmap v731: 97 pgs: 97 active+clean; 698 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 12 MiB/s wr, 884 op/s 2023-09-13T09:53:54.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:54 smithi053 ceph-mon[102373]: pgmap v731: 97 pgs: 97 active+clean; 698 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 12 MiB/s wr, 884 op/s 2023-09-13T09:53:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:54 smithi131 ceph-mon[102785]: pgmap v731: 97 pgs: 97 active+clean; 698 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 12 MiB/s wr, 884 op/s 2023-09-13T09:53:54.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 52443 40.61 MB/sec warmup 74 sec latency 55.277 ms 2023-09-13T09:53:55.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 52951 40.40 MB/sec warmup 75 sec latency 215.756 ms 2023-09-13T09:53:56.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:53:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 -- 172.21.15.6:0/1748553140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd258100fd0 msgr2=0x7fd258107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 --2- 172.21.15.6:0/1748553140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd258100fd0 0x7fd258107880 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fd25000aad0 tx=0x7fd25000ade0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 -- 172.21.15.6:0/1748553140 shutdown_connections 2023-09-13T09:53:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 --2- 172.21.15.6:0/1748553140 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd258100fd0 0x7fd258107880 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 --2- 172.21.15.6:0/1748553140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2580ff440 0x7fd2580ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 --2- 172.21.15.6:0/1748553140 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd258100630 0x7fd258100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 -- 172.21.15.6:0/1748553140 >> 172.21.15.6:0/1748553140 conn(0x7fd2580fa9b0 msgr2=0x7fd2580fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 -- 172.21.15.6:0/1748553140 shutdown_connections 2023-09-13T09:53:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.165+0000 7fd25ee50700 1 -- 172.21.15.6:0/1748553140 wait complete. 2023-09-13T09:53:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 Processor -- start 2023-09-13T09:53:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 -- start start 2023-09-13T09:53:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2580ff440 0x7fd2581033d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd258100630 0x7fd258101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd258100fd0 0x7fd258101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581026f0 con 0x7fd2580ff440 2023-09-13T09:53:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd258102860 con 0x7fd258100630 2023-09-13T09:53:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25ee50700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2581a0ad0 con 0x7fd258100fd0 2023-09-13T09:53:56.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2580ff440 0x7fd2581033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2580ff440 0x7fd2581033d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42772/0 (socket says 172.21.15.6:42772) 2023-09-13T09:53:56.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25cbec700 1 -- 172.21.15.6:0/2558093493 learned_addr learned my addr 172.21.15.6:0/2558093493 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd257fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd258100630 0x7fd258101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.166+0000 7fd25d3ed700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd258100fd0 0x7fd258101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25cbec700 1 -- 172.21.15.6:0/2558093493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd258100fd0 msgr2=0x7fd258101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25cbec700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd258100fd0 0x7fd258101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25cbec700 1 -- 172.21.15.6:0/2558093493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd258100630 msgr2=0x7fd258101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25cbec700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd258100630 0x7fd258101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25cbec700 1 -- 172.21.15.6:0/2558093493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd25000a700 con 0x7fd2580ff440 2023-09-13T09:53:56.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25cbec700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2580ff440 0x7fd2581033d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd24800efc0 tx=0x7fd24800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd255ffb700 1 -- 172.21.15.6:0/2558093493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248018070 con 0x7fd2580ff440 2023-09-13T09:53:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd255ffb700 1 -- 172.21.15.6:0/2558093493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd24800f040 con 0x7fd2580ff440 2023-09-13T09:53:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd255ffb700 1 -- 172.21.15.6:0/2558093493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248004280 con 0x7fd2580ff440 2023-09-13T09:53:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2581a0d50 con 0x7fd2580ff440 2023-09-13T09:53:56.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.167+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2581a1180 con 0x7fd2580ff440 2023-09-13T09:53:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.170+0000 7fd255ffb700 1 -- 172.21.15.6:0/2558093493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd248003a00 con 0x7fd2580ff440 2023-09-13T09:53:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.171+0000 7fd255ffb700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2440a0640 0x7fd2440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.171+0000 7fd255ffb700 1 -- 172.21.15.6:0/2558093493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd2480cbac0 con 0x7fd2580ff440 2023-09-13T09:53:56.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.171+0000 7fd257fff700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2440a0640 0x7fd2440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.171+0000 7fd26b035b80 1 Processor -- start 2023-09-13T09:53:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.171+0000 7fd257fff700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2440a0640 0x7fd2440a2b00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd240009c60 tx=0x7fd240009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.171+0000 7fd26b035b80 1 -- start start 2023-09-13T09:53:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed90db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed90c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed90ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd26b035b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed865780 con 0x55b2ed90e060 2023-09-13T09:53:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd26b035b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed8630a0 con 0x55b2ed90ca00 2023-09-13T09:53:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd26b035b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed85e990 con 0x55b2ed90d700 2023-09-13T09:53:56.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed90db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd257fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed90c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25d3ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed90ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed90db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45834/0 (socket says 172.21.15.6:45834) 2023-09-13T09:53:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 -- 172.21.15.6:0/3054753409 learned_addr learned my addr 172.21.15.6:0/3054753409 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd257fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed90c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42782/0 (socket says 172.21.15.6:42782) 2023-09-13T09:53:56.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 -- 172.21.15.6:0/3054753409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 msgr2=0x55b2ed90ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed90ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 -- 172.21.15.6:0/3054753409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 msgr2=0x55b2ed90c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed90c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd25cbec700 1 -- 172.21.15.6:0/3054753409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2ed6de630 con 0x55b2ed90d700 2023-09-13T09:53:56.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.172+0000 7fd257fff700 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed90c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:56.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.173+0000 7fd25cbec700 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed90db20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd2480957f0 tx=0x7fd24800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dabf722c32c7373c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.173+0000 7fd24effd700 1 -- 172.21.15.6:0/3054753409 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248098e30 con 0x55b2ed90d700 2023-09-13T09:53:56.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.173+0000 7fd24effd700 1 -- 172.21.15.6:0/3054753409 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd248098c50 con 0x55b2ed90d700 2023-09-13T09:53:56.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.173+0000 7fd24effd700 1 -- 172.21.15.6:0/3054753409 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24809f070 con 0x55b2ed90d700 2023-09-13T09:53:56.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.174+0000 7fd26b035b80 1 -- 172.21.15.6:0/3054753409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 msgr2=0x55b2ed90db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.174+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed90db20 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd2480957f0 tx=0x7fd24800cc70 comp rx=0 tx=0).stop 2023-09-13T09:53:56.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 -- 172.21.15.6:0/3054753409 shutdown_connections 2023-09-13T09:53:56.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed90ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed90db20 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3054753409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed90c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 -- 172.21.15.6:0/3054753409 >> 172.21.15.6:0/3054753409 conn(0x55b2ed86ac80 msgr2=0x55b2ed906f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 -- 172.21.15.6:0/3054753409 shutdown_connections 2023-09-13T09:53:56.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 -- 172.21.15.6:0/3054753409 wait complete. 2023-09-13T09:53:56.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 -- start start 2023-09-13T09:53:56.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 Processor -- start 2023-09-13T09:53:56.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed915f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed9164a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.175+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed91d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd26b035b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed7fcbb0 con 0x55b2ed90d700 2023-09-13T09:53:56.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd26b035b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed7fc8b0 con 0x55b2ed90e060 2023-09-13T09:53:56.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd26b035b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed6e0920 con 0x55b2ed90ca00 2023-09-13T09:53:56.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd26b035b80 10 client.0 _ll_register_callbacks cb 0x55b2ed7fa680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:56.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed915f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25d3ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed91d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed915f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45840/0 (socket says 172.21.15.6:45840) 2023-09-13T09:53:56.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 -- 172.21.15.6:0/2743985666 learned_addr learned my addr 172.21.15.6:0/2743985666 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25d3ed700 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed91d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36314/0 (socket says 172.21.15.6:36314) 2023-09-13T09:53:56.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 -- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 msgr2=0x55b2ed91d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed91d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 -- 172.21.15.6:0/2743985666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 msgr2=0x55b2ed9164a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed9164a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 -- 172.21.15.6:0/2743985666 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2581a1180 con 0x55b2ed90ca00 2023-09-13T09:53:56.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd25cbec700 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed915f60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd2480090a0 tx=0x7fd248000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4ed8bdcfb3fdf5f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd237fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:56.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.176+0000 7fd237fff700 1 -- 172.21.15.6:0/2743985666 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480b5070 con 0x55b2ed90ca00 2023-09-13T09:53:56.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd237fff700 1 -- 172.21.15.6:0/2743985666 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd2480992f0 con 0x55b2ed90ca00 2023-09-13T09:53:56.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2ed8ff670 con 0x55b2ed90ca00 2023-09-13T09:53:56.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd237fff700 1 -- 172.21.15.6:0/2743985666 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2480b72b0 con 0x55b2ed90ca00 2023-09-13T09:53:56.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 10 client.28531 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:56.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55b2ed8767a0 con 0x55b2ed90ca00 2023-09-13T09:53:56.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd237fff700 1 -- 172.21.15.6:0/2743985666 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2ed8ff670 con 0x55b2ed90ca00 2023-09-13T09:53:56.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd237fff700 1 -- 172.21.15.6:0/2743985666 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fd2480a0e40 con 0x55b2ed90ca00 2023-09-13T09:53:56.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 10 client.28531 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:56.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 10 client.28531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:56.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 20 client.28531 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:56.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed921930 0x55b2ed923d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 4 client.28531 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:56.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.177+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2ed857970 con 0x55b2ed921930 2023-09-13T09:53:56.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.178+0000 7fd257fff700 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed921930 0x55b2ed923d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.178+0000 7fd257fff700 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed921930 0x55b2ed923d50 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfcf14ea6992dd39 server_cookie=e6d425afc89f7223 in_seq=0 out_seq=0 2023-09-13T09:53:56.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.178+0000 7fd237fff700 10 client.28531 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:56.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd237fff700 1 -- 172.21.15.6:0/2743985666 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b2ed857970 con 0x55b2ed921930 2023-09-13T09:53:56.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd237fff700 10 client.28531 handle_command_reply: tid=0 2023-09-13T09:53:56.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 client.28531 shutdown 2023-09-13T09:53:56.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 msgr2=0x55b2ed915f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed915f60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd2480090a0 tx=0x7fd248000f40 comp rx=0 tx=0).stop 2023-09-13T09:53:56.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 shutdown_connections 2023-09-13T09:53:56.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed91d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed915f60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed921930 0x55b2ed923d50 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 --2- 172.21.15.6:0/2743985666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed9164a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd237fff700 0 client.28531 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:56.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 >> 172.21.15.6:0/2743985666 conn(0x55b2ed86ac80 msgr2=0x55b2ed9017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 shutdown_connections 2023-09-13T09:53:56.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.184+0000 7fd26b035b80 1 -- 172.21.15.6:0/2743985666 wait complete. 2023-09-13T09:53:56.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.185+0000 7fd26b035b80 20 client.28531 trim_cache size 0 max 16384 2023-09-13T09:53:56.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 Processor -- start 2023-09-13T09:53:56.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 -- start start 2023-09-13T09:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed90c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed91d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed910920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed915410 con 0x55b2ed90d700 2023-09-13T09:53:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed915ad0 con 0x55b2ed90e060 2023-09-13T09:53:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.203+0000 7fd26b035b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed9038e0 con 0x55b2ed90ca00 2023-09-13T09:53:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25d3ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed910920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd257fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed91d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed90c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25d3ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed910920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36322/0 (socket says 172.21.15.6:36322) 2023-09-13T09:53:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd257fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed91d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42796/0 (socket says 172.21.15.6:42796) 2023-09-13T09:53:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25d3ed700 1 -- 172.21.15.6:0/3603495432 learned_addr learned my addr 172.21.15.6:0/3603495432 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed90c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45848/0 (socket says 172.21.15.6:45848) 2023-09-13T09:53:56.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 -- 172.21.15.6:0/3603495432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 msgr2=0x55b2ed910920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed910920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 -- 172.21.15.6:0/3603495432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 msgr2=0x55b2ed91d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed91d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 -- 172.21.15.6:0/3603495432 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2ed68ade0 con 0x55b2ed90ca00 2023-09-13T09:53:56.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25d3ed700 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed910920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:56.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.204+0000 7fd25cbec700 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed90c4c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd248009f90 tx=0x7fd24800cc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1e3ee444ed2903 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.205+0000 7fd24f7fe700 1 -- 172.21.15.6:0/3603495432 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480b72b0 con 0x55b2ed90ca00 2023-09-13T09:53:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd24f7fe700 1 -- 172.21.15.6:0/3603495432 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd2480a1340 con 0x55b2ed90ca00 2023-09-13T09:53:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd24f7fe700 1 -- 172.21.15.6:0/3603495432 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd248099550 con 0x55b2ed90ca00 2023-09-13T09:53:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd26b035b80 1 -- 172.21.15.6:0/3603495432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 msgr2=0x55b2ed90c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed90c4c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd248009f90 tx=0x7fd24800cc70 comp rx=0 tx=0).stop 2023-09-13T09:53:56.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd26b035b80 1 -- 172.21.15.6:0/3603495432 shutdown_connections 2023-09-13T09:53:56.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90e060 0x55b2ed910920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90ca00 0x55b2ed90c4c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd26b035b80 1 --2- 172.21.15.6:0/3603495432 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90d700 0x55b2ed91d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.206+0000 7fd26b035b80 1 -- 172.21.15.6:0/3603495432 >> 172.21.15.6:0/3603495432 conn(0x55b2ed86ac80 msgr2=0x55b2ed914bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.207+0000 7fd26b035b80 1 -- 172.21.15.6:0/3603495432 shutdown_connections 2023-09-13T09:53:56.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.207+0000 7fd26b035b80 1 -- 172.21.15.6:0/3603495432 wait complete. 2023-09-13T09:53:56.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.207+0000 7fd26b035b80 1 -- start start 2023-09-13T09:53:56.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.207+0000 7fd26b035b80 1 Processor -- start 2023-09-13T09:53:56.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.207+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed9176c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed917c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd26b035b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed91c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd26b035b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed91ce90 con 0x55b2ed90e060 2023-09-13T09:53:56.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd26b035b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed91d000 con 0x55b2ed90ca00 2023-09-13T09:53:56.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd26b035b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2ed91d1c0 con 0x55b2ed90d700 2023-09-13T09:53:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd26b035b80 10 client.0 _ll_register_callbacks cb 0x55b2ed7fa680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed9176c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25d3ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed91c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed9176c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36324/0 (socket says 172.21.15.6:36324) 2023-09-13T09:53:56.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25d3ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed91c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42804/0 (socket says 172.21.15.6:42804) 2023-09-13T09:53:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 -- 172.21.15.6:0/1579924291 learned_addr learned my addr 172.21.15.6:0/1579924291 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd257fff700 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed917c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 -- 172.21.15.6:0/1579924291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 msgr2=0x55b2ed917c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed917c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 -- 172.21.15.6:0/1579924291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 msgr2=0x55b2ed91c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed91c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 -- 172.21.15.6:0/1579924291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25001a040 con 0x55b2ed90ca00 2023-09-13T09:53:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25d3ed700 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed91c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd25cbec700 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed9176c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd2480c98e0 tx=0x7fd24801c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b6a091b6f5074b1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.208+0000 7fd237fff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:53:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd237fff700 1 -- 172.21.15.6:0/1579924291 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2480b5020 con 0x55b2ed90ca00 2023-09-13T09:53:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd237fff700 1 -- 172.21.15.6:0/1579924291 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd248082d40 con 0x55b2ed90ca00 2023-09-13T09:53:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2ed818050 con 0x55b2ed90ca00 2023-09-13T09:53:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd237fff700 1 -- 172.21.15.6:0/1579924291 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2480a1340 con 0x55b2ed90ca00 2023-09-13T09:53:56.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 10 client.28595 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55b2ed8767a0 con 0x55b2ed90ca00 2023-09-13T09:53:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd237fff700 1 -- 172.21.15.6:0/1579924291 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b2ed818050 con 0x55b2ed90ca00 2023-09-13T09:53:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd237fff700 1 -- 172.21.15.6:0/1579924291 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fd2480982e0 con 0x55b2ed90ca00 2023-09-13T09:53:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 10 client.28595 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:56.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 10 client.28595 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 20 client.28595 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed987380 0x55b2ed989770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 4 client.28595 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:53:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b2ed6abf70 con 0x55b2ed987380 2023-09-13T09:53:56.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.209+0000 7fd257fff700 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed987380 0x55b2ed989770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.210+0000 7fd257fff700 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed987380 0x55b2ed989770 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50afc64c4549d0fa server_cookie=75f6e9b4f2f8ee91 in_seq=0 out_seq=0 2023-09-13T09:53:56.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.210+0000 7fd237fff700 10 client.28595 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:56.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd237fff700 1 -- 172.21.15.6:0/1579924291 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55b2ed6abf70 con 0x55b2ed987380 2023-09-13T09:53:56.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd237fff700 10 client.28595 handle_command_reply: tid=0 2023-09-13T09:53:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 client.28595 shutdown 2023-09-13T09:53:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 msgr2=0x55b2ed9176c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed9176c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd2480c98e0 tx=0x7fd24801c000 comp rx=0 tx=0).stop 2023-09-13T09:53:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 shutdown_connections 2023-09-13T09:53:56.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b2ed987380 0x55b2ed989770 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b2ed90e060 0x55b2ed91c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd237fff700 0 client.28595 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:56.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b2ed90ca00 0x55b2ed9176c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 --2- 172.21.15.6:0/1579924291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b2ed90d700 0x55b2ed917c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 >> 172.21.15.6:0/1579924291 conn(0x55b2ed86ac80 msgr2=0x55b2ed910920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 shutdown_connections 2023-09-13T09:53:56.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 1 -- 172.21.15.6:0/1579924291 wait complete. 2023-09-13T09:53:56.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.216+0000 7fd26b035b80 20 client.28595 trim_cache size 0 max 16384 2023-09-13T09:53:56.227 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:53:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:53:56.228 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:53:56.228 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:53:56.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2440a0640 msgr2=0x7fd2440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2440a0640 0x7fd2440a2b00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd240009c60 tx=0x7fd240009260 comp rx=0 tx=0).stop 2023-09-13T09:53:56.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2580ff440 msgr2=0x7fd2581033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2580ff440 0x7fd2581033d0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7fd24800efc0 tx=0x7fd24800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 shutdown_connections 2023-09-13T09:53:56.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd258100fd0 0x7fd258101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd2440a0640 0x7fd2440a2b00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2580ff440 0x7fd2581033d0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 --2- 172.21.15.6:0/2558093493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd258100630 0x7fd258101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 >> 172.21.15.6:0/2558093493 conn(0x7fd2580fa9b0 msgr2=0x7fd2580fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 shutdown_connections 2023-09-13T09:53:56.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.217+0000 7fd25ee50700 1 -- 172.21.15.6:0/2558093493 wait complete. 2023-09-13T09:53:56.232 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:53:56.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:53:56.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 -- 172.21.15.6:0/1918080915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec106a70 msgr2=0x7f25ec108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 --2- 172.21.15.6:0/1918080915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec106a70 0x7f25ec108ee0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f25e400b0a0 tx=0x7f25e400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 -- 172.21.15.6:0/1918080915 shutdown_connections 2023-09-13T09:53:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 --2- 172.21.15.6:0/1918080915 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec106a70 0x7f25ec108ee0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 --2- 172.21.15.6:0/1918080915 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec101810 0x7f25ec103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 --2- 172.21.15.6:0/1918080915 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ec104140 0x7f25ec106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 -- 172.21.15.6:0/1918080915 >> 172.21.15.6:0/1918080915 conn(0x7f25ec0fb220 msgr2=0x7f25ec0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 -- 172.21.15.6:0/1918080915 shutdown_connections 2023-09-13T09:53:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.372+0000 7f25f45ed700 1 -- 172.21.15.6:0/1918080915 wait complete. 2023-09-13T09:53:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 Processor -- start 2023-09-13T09:53:56.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 -- start start 2023-09-13T09:53:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ec101810 0x7f25ec101180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec104140 0x7f25ec0ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec106a70 0x7f25ec0ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec1004a0 con 0x7f25ec104140 2023-09-13T09:53:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec100610 con 0x7f25ec101810 2023-09-13T09:53:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f45ed700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25ec1a0be0 con 0x7f25ec106a70 2023-09-13T09:53:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec104140 0x7f25ec0ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f2389700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ec101810 0x7f25ec101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f2b8a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec106a70 0x7f25ec0ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec104140 0x7f25ec0ff7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42816/0 (socket says 172.21.15.6:42816) 2023-09-13T09:53:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 -- 172.21.15.6:0/2617065143 learned_addr learned my addr 172.21.15.6:0/2617065143 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 -- 172.21.15.6:0/2617065143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec106a70 msgr2=0x7f25ec0ffd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec106a70 0x7f25ec0ffd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 -- 172.21.15.6:0/2617065143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ec101810 msgr2=0x7f25ec101180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ec101810 0x7f25ec101180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.373+0000 7f25f1b88700 1 -- 172.21.15.6:0/2617065143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25e4009d00 con 0x7f25ec104140 2023-09-13T09:53:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.374+0000 7f25f1b88700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec104140 0x7f25ec0ff7c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e9a0 tx=0x7f25dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.374+0000 7f25e37fe700 1 -- 172.21.15.6:0/2617065143 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc009790 con 0x7f25ec104140 2023-09-13T09:53:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.374+0000 7f25e37fe700 1 -- 172.21.15.6:0/2617065143 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25dc010430 con 0x7f25ec104140 2023-09-13T09:53:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.374+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25ec1a0ec0 con 0x7f25ec104140 2023-09-13T09:53:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.374+0000 7f25e37fe700 1 -- 172.21.15.6:0/2617065143 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25dc018680 con 0x7f25ec104140 2023-09-13T09:53:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.374+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25ec1a12f0 con 0x7f25ec104140 2023-09-13T09:53:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.375+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25ec0fcda0 con 0x7f25ec104140 2023-09-13T09:53:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.376+0000 7f25e37fe700 1 -- 172.21.15.6:0/2617065143 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f25dc0105a0 con 0x7f25ec104140 2023-09-13T09:53:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.377+0000 7f25e37fe700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25d80a0640 0x7f25d80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.377+0000 7f25f2389700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25d80a0640 0x7f25d80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.377+0000 7f25e37fe700 1 -- 172.21.15.6:0/2617065143 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f25dc014070 con 0x7f25ec104140 2023-09-13T09:53:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.378+0000 7f25f2389700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25d80a0640 0x7f25d80a2b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009c60 tx=0x7f25e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.381+0000 7f25e37fe700 1 -- 172.21.15.6:0/2617065143 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f25dc095a80 con 0x7f25ec104140 2023-09-13T09:53:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:56 smithi006 ceph-mon[98665]: pgmap v732: 97 pgs: 97 active+clean; 701 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 12 MiB/s wr, 849 op/s 2023-09-13T09:53:56.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:56 smithi053 ceph-mon[102373]: pgmap v732: 97 pgs: 97 active+clean; 701 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 12 MiB/s wr, 849 op/s 2023-09-13T09:53:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:56 smithi131 ceph-mon[102785]: pgmap v732: 97 pgs: 97 active+clean; 701 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 12 MiB/s wr, 849 op/s 2023-09-13T09:53:56.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 53752 40.35 MB/sec warmup 76 sec latency 62.615 ms 2023-09-13T09:53:56.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.653+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f25ec10c810 con 0x7f25ec104140 2023-09-13T09:53:56.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.653+0000 7f25e37fe700 1 -- 172.21.15.6:0/2617065143 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+11364 (secure 0 0 0) 0x7f25dc026090 con 0x7f25ec104140 2023-09-13T09:53:56.654 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:53:56.654 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:53:49.864535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:53:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.655+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25d80a0640 msgr2=0x7f25d80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.655+0000 7f25f45ed700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25d80a0640 0x7f25d80a2b00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f25e8009c60 tx=0x7f25e8009260 comp rx=0 tx=0).stop 2023-09-13T09:53:56.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.655+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec104140 msgr2=0x7f25ec0ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.655+0000 7f25f45ed700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec104140 0x7f25ec0ff7c0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f25dc00e9a0 tx=0x7f25dc00ecb0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 shutdown_connections 2023-09-13T09:53:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25ec106a70 0x7f25ec0ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f25ec101810 0x7f25ec101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f25d80a0640 0x7f25d80a2b00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 --2- 172.21.15.6:0/2617065143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25ec104140 0x7f25ec0ff7c0 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 >> 172.21.15.6:0/2617065143 conn(0x7f25ec0fb220 msgr2=0x7f25ec1024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 shutdown_connections 2023-09-13T09:53:56.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.656+0000 7f25f45ed700 1 -- 172.21.15.6:0/2617065143 wait complete. 2023-09-13T09:53:56.659 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-09-13T09:53:56.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:53:56.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.815+0000 7f96ebe1b700 1 -- 172.21.15.6:0/658846540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 msgr2=0x7f96e41000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.815+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/658846540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e41000e0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f96e00099c0 tx=0x7f96e0009cd0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.815+0000 7f96ebe1b700 1 -- 172.21.15.6:0/658846540 shutdown_connections 2023-09-13T09:53:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.815+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/658846540 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e4101850 0x7f96e4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.815+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/658846540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e41000e0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.816+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/658846540 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e4100eb0 0x7f96e4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.816+0000 7f96ebe1b700 1 -- 172.21.15.6:0/658846540 >> 172.21.15.6:0/658846540 conn(0x7f96e40fb210 msgr2=0x7f96e40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.816+0000 7f96ebe1b700 1 -- 172.21.15.6:0/658846540 shutdown_connections 2023-09-13T09:53:56.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.816+0000 7f96ebe1b700 1 -- 172.21.15.6:0/658846540 wait complete. 2023-09-13T09:53:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.816+0000 7f96ebe1b700 1 Processor -- start 2023-09-13T09:53:56.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.816+0000 7f96ebe1b700 1 -- start start 2023-09-13T09:53:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96ebe1b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e410a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96ebe1b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e4100eb0 0x7f96e4108c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96ebe1b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e4101850 0x7f96e4109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96ebe1b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e41098f0 con 0x7f96e40ffcc0 2023-09-13T09:53:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96ebe1b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e4109a60 con 0x7f96e4100eb0 2023-09-13T09:53:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96ebe1b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e41a0b10 con 0x7f96e4101850 2023-09-13T09:53:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e410a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e410a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42828/0 (socket says 172.21.15.6:42828) 2023-09-13T09:53:56.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 -- 172.21.15.6:0/2998025757 learned_addr learned my addr 172.21.15.6:0/2998025757 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e93b6700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e4100eb0 0x7f96e4108c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96ea3b8700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e4101850 0x7f96e4109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 -- 172.21.15.6:0/2998025757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e4101850 msgr2=0x7f96e4109150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e4101850 0x7f96e4109150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 -- 172.21.15.6:0/2998025757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e4100eb0 msgr2=0x7f96e4108c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e4100eb0 0x7f96e4108c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 -- 172.21.15.6:0/2998025757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e00095f0 con 0x7f96e40ffcc0 2023-09-13T09:53:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.817+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e410a5d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009fd0 tx=0x7f96e000f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.818+0000 7f96daffd700 1 -- 172.21.15.6:0/2998025757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e001d070 con 0x7f96e40ffcc0 2023-09-13T09:53:56.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.818+0000 7f96daffd700 1 -- 172.21.15.6:0/2998025757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96e0005030 con 0x7f96e40ffcc0 2023-09-13T09:53:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.818+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e41a0d90 con 0x7f96e40ffcc0 2023-09-13T09:53:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.818+0000 7f96daffd700 1 -- 172.21.15.6:0/2998025757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e0004aa0 con 0x7f96e40ffcc0 2023-09-13T09:53:56.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.818+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e41a11c0 con 0x7f96e40ffcc0 2023-09-13T09:53:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.820+0000 7f96daffd700 1 -- 172.21.15.6:0/2998025757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f96e0005410 con 0x7f96e40ffcc0 2023-09-13T09:53:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.821+0000 7f96daffd700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.821+0000 7f96daffd700 1 -- 172.21.15.6:0/2998025757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96e00cc940 con 0x7f96e40ffcc0 2023-09-13T09:53:56.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.821+0000 7f96e93b6700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.822+0000 7f96e93b6700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009c60 tx=0x7f96d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 Processor -- start 2023-09-13T09:53:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 -- start start 2023-09-13T09:53:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b4f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b4dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4e210 0x559066b4e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066a9e780 con 0x559066b4ef10 2023-09-13T09:53:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066a9c0a0 con 0x559066b4f870 2023-09-13T09:53:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.823+0000 7f96f8000b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066a97990 con 0x559066b4e210 2023-09-13T09:53:56.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b4f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e93b6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b4dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b4f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42836/0 (socket says 172.21.15.6:42836) 2023-09-13T09:53:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e9bb7700 1 -- 172.21.15.6:0/3982350561 learned_addr learned my addr 172.21.15.6:0/3982350561 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96ea3b8700 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4e210 0x559066b4e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e93b6700 1 -- 172.21.15.6:0/3982350561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4e210 msgr2=0x559066b4e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e93b6700 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4e210 0x559066b4e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e93b6700 1 -- 172.21.15.6:0/3982350561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 msgr2=0x559066b4f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e93b6700 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b4f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e93b6700 1 -- 172.21.15.6:0/3982350561 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559066917630 con 0x559066b4f870 2023-09-13T09:53:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b4f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96e93b6700 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b4dcd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96d400e3b0 tx=0x7f96d4014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9a9d05fd0bacb82 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.824+0000 7f96cffff700 1 -- 172.21.15.6:0/3982350561 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d400ed50 con 0x559066b4f870 2023-09-13T09:53:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96cffff700 1 -- 172.21.15.6:0/3982350561 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96d4021070 con 0x559066b4f870 2023-09-13T09:53:56.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96cffff700 1 -- 172.21.15.6:0/3982350561 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4003ea0 con 0x559066b4f870 2023-09-13T09:53:56.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96f8000b80 1 -- 172.21.15.6:0/3982350561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 msgr2=0x559066b4dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b4dcd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f96d400e3b0 tx=0x7f96d4014000 comp rx=0 tx=0).stop 2023-09-13T09:53:56.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96f8000b80 1 -- 172.21.15.6:0/3982350561 shutdown_connections 2023-09-13T09:53:56.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4e210 0x559066b4e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b4f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3982350561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b4dcd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.825+0000 7f96f8000b80 1 -- 172.21.15.6:0/3982350561 >> 172.21.15.6:0/3982350561 conn(0x559066aa3c80 msgr2=0x559066b3ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.826+0000 7f96f8000b80 1 -- 172.21.15.6:0/3982350561 shutdown_connections 2023-09-13T09:53:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.826+0000 7f96f8000b80 1 -- 172.21.15.6:0/3982350561 wait complete. 2023-09-13T09:53:56.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.826+0000 7f96f8000b80 1 -- start start 2023-09-13T09:53:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.826+0000 7f96f8000b80 1 Processor -- start 2023-09-13T09:53:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b57720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b57c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4f870 0x559066b5eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96f8000b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066a35bb0 con 0x559066b4ef10 2023-09-13T09:53:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96f8000b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066a358b0 con 0x559066b4e210 2023-09-13T09:53:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96f8000b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066919920 con 0x559066b4f870 2023-09-13T09:53:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96f8000b80 10 client.0 _ll_register_callbacks cb 0x559066a33680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b57720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b57720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36366/0 (socket says 172.21.15.6:36366) 2023-09-13T09:53:56.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 -- 172.21.15.6:0/3635977043 learned_addr learned my addr 172.21.15.6:0/3635977043 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 -- 172.21.15.6:0/3635977043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4f870 msgr2=0x559066b5eca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:53:56.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4f870 0x559066b5eca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 -- 172.21.15.6:0/3635977043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 msgr2=0x559066b57c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b57c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.827+0000 7f96e9bb7700 1 -- 172.21.15.6:0/3635977043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d4017070 con 0x559066b4e210 2023-09-13T09:53:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b57720 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009d70 tx=0x7f96e0004f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a2f3d479e05a674 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:53:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3635977043 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a00c0 con 0x559066b4e210 2023-09-13T09:53:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3635977043 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96e00a2150 con 0x559066b4e210 2023-09-13T09:53:56.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559066b38670 con 0x559066b4e210 2023-09-13T09:53:56.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3635977043 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96e0099660 con 0x559066b4e210 2023-09-13T09:53:56.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96f8000b80 10 client.28613 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:56.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.828+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559066aaf7a0 con 0x559066b4e210 2023-09-13T09:53:56.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3635977043 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559066b38670 con 0x559066b4e210 2023-09-13T09:53:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3635977043 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f96e00b2200 con 0x559066b4e210 2023-09-13T09:53:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96f8000b80 10 client.28613 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96f8000b80 10 client.28613 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:53:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96f8000b80 20 client.28613 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:56.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066b631a0 0x559066b655c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96f8000b80 4 client.28613 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559066a90970 con 0x559066b631a0 2023-09-13T09:53:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.829+0000 7f96e93b6700 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066b631a0 0x559066b655c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.830+0000 7f96cd7fa700 10 client.28613 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.830+0000 7f96e93b6700 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066b631a0 0x559066b655c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=15a0349e3b3ca927 server_cookie=9d190316b5d21656 in_seq=0 out_seq=0 2023-09-13T09:53:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3635977043 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559066a90970 con 0x559066b631a0 2023-09-13T09:53:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96cd7fa700 10 client.28613 handle_command_reply: tid=0 2023-09-13T09:53:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 client.28613 shutdown 2023-09-13T09:53:56.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 msgr2=0x559066b57720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b57720 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009d70 tx=0x7f96e0004f40 comp rx=0 tx=0).stop 2023-09-13T09:53:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 shutdown_connections 2023-09-13T09:53:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066b631a0 0x559066b655c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4f870 0x559066b5eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b57720 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96cd7fa700 0 client.28613 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3635977043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4ef10 0x559066b57c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 >> 172.21.15.6:0/3635977043 conn(0x559066aa3c80 msgr2=0x559066b3a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 shutdown_connections 2023-09-13T09:53:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 1 -- 172.21.15.6:0/3635977043 wait complete. 2023-09-13T09:53:56.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.833+0000 7f96f8000b80 20 client.28613 trim_cache size 0 max 16384 2023-09-13T09:53:56.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 Processor -- start 2023-09-13T09:53:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 -- start start 2023-09-13T09:53:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4e210 0x559066b52190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 0x559066b5ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b526d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066b58620 con 0x559066b4e210 2023-09-13T09:53:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066b57290 con 0x559066b4f870 2023-09-13T09:53:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96f8000b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066b40bf0 con 0x559066b4ef10 2023-09-13T09:53:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4e210 0x559066b52190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4e210 0x559066b52190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42848/0 (socket says 172.21.15.6:42848) 2023-09-13T09:53:56.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 -- 172.21.15.6:0/1628008739 learned_addr learned my addr 172.21.15.6:0/1628008739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96ea3b8700 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 -- 172.21.15.6:0/1628008739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 msgr2=0x559066b5ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 0x559066b5ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 -- 172.21.15.6:0/1628008739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 msgr2=0x559066b526d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b526d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.849+0000 7f96e9bb7700 1 -- 172.21.15.6:0/1628008739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590668c3de0 con 0x559066b4e210 2023-09-13T09:53:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.850+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4e210 0x559066b52190 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f96e00ca760 tx=0x7f96e009a9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b11d7c62492f1ed7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.850+0000 7f96d8ff9700 1 -- 172.21.15.6:0/1628008739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a00b0 con 0x559066b4e210 2023-09-13T09:53:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.850+0000 7f96d8ff9700 1 -- 172.21.15.6:0/1628008739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96e00a2150 con 0x559066b4e210 2023-09-13T09:53:56.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.850+0000 7f96d8ff9700 1 -- 172.21.15.6:0/1628008739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e00a1cc0 con 0x559066b4e210 2023-09-13T09:53:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 -- 172.21.15.6:0/1628008739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4e210 msgr2=0x559066b52190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4e210 0x559066b52190 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f96e00ca760 tx=0x7f96e009a9b0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 -- 172.21.15.6:0/1628008739 shutdown_connections 2023-09-13T09:53:56.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4f870 0x559066b526d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4e210 0x559066b52190 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 --2- 172.21.15.6:0/1628008739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 0x559066b5ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 -- 172.21.15.6:0/1628008739 >> 172.21.15.6:0/1628008739 conn(0x559066aa3c80 msgr2=0x559066b5f590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 -- 172.21.15.6:0/1628008739 shutdown_connections 2023-09-13T09:53:56.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 -- 172.21.15.6:0/1628008739 wait complete. 2023-09-13T09:53:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 -- start start 2023-09-13T09:53:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.851+0000 7f96f8000b80 1 Processor -- start 2023-09-13T09:53:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b5ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 0x559066b5b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96f8000b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4f870 0x559066b5e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96f8000b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066b5e840 con 0x559066b4f870 2023-09-13T09:53:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96f8000b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066b5e9b0 con 0x559066b4e210 2023-09-13T09:53:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96f8000b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559066b5eb70 con 0x559066b4ef10 2023-09-13T09:53:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96f8000b80 10 client.0 _ll_register_callbacks cb 0x559066a33680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4f870 0x559066b5e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4f870 0x559066b5e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42856/0 (socket says 172.21.15.6:42856) 2023-09-13T09:53:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 -- 172.21.15.6:0/3080232278 learned_addr learned my addr 172.21.15.6:0/3080232278 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96e93b6700 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 0x559066b5b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 -- 172.21.15.6:0/3080232278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 msgr2=0x559066b5b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 0x559066b5b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 -- 172.21.15.6:0/3080232278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 msgr2=0x559066b5ae90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:53:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b5ae90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.852+0000 7f96ea3b8700 1 -- 172.21.15.6:0/3080232278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559066aaf7a0 con 0x559066b4f870 2023-09-13T09:53:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96ea3b8700 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4f870 0x559066b5e300 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f96dc007ab0 tx=0x7f96dc007ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710d0e8cdc3a17f7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3080232278 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc0178e0 con 0x559066b4f870 2023-09-13T09:53:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3080232278 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f96dc017a40 con 0x559066b4f870 2023-09-13T09:53:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f96d4021070 con 0x559066b4f870 2023-09-13T09:53:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3080232278 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96dc017c00 con 0x559066b4f870 2023-09-13T09:53:56.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 10 client.19239 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5590668acc60 con 0x559066b4f870 2023-09-13T09:53:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3080232278 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f96d4021070 con 0x559066b4f870 2023-09-13T09:53:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3080232278 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f96dc02a490 con 0x559066b4f870 2023-09-13T09:53:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 10 client.19239 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 10 client.19239 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:53:56.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 20 client.19239 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066bb84d0 0x559066bba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 4 client.19239 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.853+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559066a51050 con 0x559066bb84d0 2023-09-13T09:53:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.854+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066bb84d0 0x559066bba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:56.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.854+0000 7f96e9bb7700 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066bb84d0 0x559066bba8f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d4ad157d8c0ad96b server_cookie=96ef1facfe57155f in_seq=0 out_seq=0 2023-09-13T09:53:56.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.854+0000 7f96cd7fa700 10 client.19239 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.857+0000 7f96cd7fa700 1 -- 172.21.15.6:0/3080232278 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559066a51050 con 0x559066bb84d0 2023-09-13T09:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.857+0000 7f96cd7fa700 10 client.19239 handle_command_reply: tid=0 2023-09-13T09:53:56.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.857+0000 7f96f8000b80 1 client.19239 shutdown 2023-09-13T09:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.857+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4f870 msgr2=0x559066b5e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.857+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4f870 0x559066b5e300 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f96dc007ab0 tx=0x7f96dc007ae0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 shutdown_connections 2023-09-13T09:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559066bb84d0 0x559066bba8f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559066b4f870 0x559066b5e300 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559066b4e210 0x559066b5ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96cd7fa700 0 client.19239 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 --2- 172.21.15.6:0/3080232278 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559066b4ef10 0x559066b5b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 >> 172.21.15.6:0/3080232278 conn(0x559066aa3c80 msgr2=0x559066b52190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 shutdown_connections 2023-09-13T09:53:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 1 -- 172.21.15.6:0/3080232278 wait complete. 2023-09-13T09:53:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96f8000b80 20 client.19239 trim_cache size 0 max 16384 2023-09-13T09:53:56.871 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 msgr2=0x7f96d00a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f96d4009c60 tx=0x7f96d4009260 comp rx=0 tx=0).stop 2023-09-13T09:53:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 msgr2=0x7f96e410a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e410a5d0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009fd0 tx=0x7f96e000f690 comp rx=0 tx=0).stop 2023-09-13T09:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 shutdown_connections 2023-09-13T09:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f96e4101850 0x7f96e4109150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f96d00a06c0 0x7f96d00a2b80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96e40ffcc0 0x7f96e410a5d0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 --2- 172.21.15.6:0/2998025757 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f96e4100eb0 0x7f96e4108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 >> 172.21.15.6:0/2998025757 conn(0x7f96e40fb210 msgr2=0x7f96e41043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 shutdown_connections 2023-09-13T09:53:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:56.858+0000 7f96ebe1b700 1 -- 172.21.15.6:0/2998025757 wait complete. 2023-09-13T09:53:56.876 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:53:57.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 -- 172.21.15.6:0/1267256172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 msgr2=0x7f653c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 --2- 172.21.15.6:0/1267256172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 0x7f653c101310 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f652c0099c0 tx=0x7f652c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 -- 172.21.15.6:0/1267256172 shutdown_connections 2023-09-13T09:53:57.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 --2- 172.21.15.6:0/1267256172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c101850 0x7f653c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 --2- 172.21.15.6:0/1267256172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 0x7f653c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 --2- 172.21.15.6:0/1267256172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 0x7f653c101310 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 -- 172.21.15.6:0/1267256172 >> 172.21.15.6:0/1267256172 conn(0x7f653c0fb250 msgr2=0x7f653c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 -- 172.21.15.6:0/1267256172 shutdown_connections 2023-09-13T09:53:57.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.021+0000 7f6544447700 1 -- 172.21.15.6:0/1267256172 wait complete. 2023-09-13T09:53:57.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 Processor -- start 2023-09-13T09:53:57.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 -- start start 2023-09-13T09:53:57.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 0x7f653c196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 0x7f653c197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c101850 0x7f653c19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c19e670 con 0x7f653c100eb0 2023-09-13T09:53:57.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c19e7b0 con 0x7f653c0ffcc0 2023-09-13T09:53:57.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f6544447700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c19e940 con 0x7f653c101850 2023-09-13T09:53:57.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f65421e3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 0x7f653c196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f65419e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 0x7f653c197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f65421e3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 0x7f653c196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36392/0 (socket says 172.21.15.6:36392) 2023-09-13T09:53:57.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f65421e3700 1 -- 172.21.15.6:0/1366860041 learned_addr learned my addr 172.21.15.6:0/1366860041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.022+0000 7f65429e4700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c101850 0x7f653c19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65419e2700 1 -- 172.21.15.6:0/1366860041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c101850 msgr2=0x7f653c19e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65419e2700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c101850 0x7f653c19e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65419e2700 1 -- 172.21.15.6:0/1366860041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 msgr2=0x7f653c196af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65419e2700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 0x7f653c196af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65419e2700 1 -- 172.21.15.6:0/1366860041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0095f0 con 0x7f653c100eb0 2023-09-13T09:53:57.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65421e3700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 0x7f653c196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65419e2700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 0x7f653c197030 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f652c0098e0 tx=0x7f652c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65337fe700 1 -- 172.21.15.6:0/1366860041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c01d070 con 0x7f653c100eb0 2023-09-13T09:53:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65337fe700 1 -- 172.21.15.6:0/1366860041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f652c005020 con 0x7f653c100eb0 2023-09-13T09:53:57.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c19ebc0 con 0x7f653c100eb0 2023-09-13T09:53:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f65337fe700 1 -- 172.21.15.6:0/1366860041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f652c004a70 con 0x7f653c100eb0 2023-09-13T09:53:57.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.023+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c19efe0 con 0x7f653c100eb0 2023-09-13T09:53:57.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.025+0000 7f65337fe700 1 -- 172.21.15.6:0/1366860041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f652c005400 con 0x7f653c100eb0 2023-09-13T09:53:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.026+0000 7f65337fe700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65280a06c0 0x7f65280a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.026+0000 7f65421e3700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65280a06c0 0x7f65280a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.026+0000 7f65337fe700 1 -- 172.21.15.6:0/1366860041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f652c0cc5a0 con 0x7f653c100eb0 2023-09-13T09:53:57.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f65421e3700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65280a06c0 0x7f65280a2b80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6538005950 tx=0x7f6538009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 Processor -- start 2023-09-13T09:53:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 -- start start 2023-09-13T09:53:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0d700 0x564ab5d0db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d0c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d0ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5c65780 con 0x564ab5d0d700 2023-09-13T09:53:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5c630a0 con 0x564ab5d0ca00 2023-09-13T09:53:57.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f655062cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5c5e990 con 0x564ab5d0e060 2023-09-13T09:53:57.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f65421e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0d700 0x564ab5d0db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f65419e2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d0c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f65429e4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d0ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f65421e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0d700 0x564ab5d0db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42876/0 (socket says 172.21.15.6:42876) 2023-09-13T09:53:57.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f65419e2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d0c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45932/0 (socket says 172.21.15.6:45932) 2023-09-13T09:53:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.027+0000 7f65421e3700 1 -- 172.21.15.6:0/3048712094 learned_addr learned my addr 172.21.15.6:0/3048712094 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65421e3700 1 -- 172.21.15.6:0/3048712094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 msgr2=0x564ab5d0c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65421e3700 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d0c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65421e3700 1 -- 172.21.15.6:0/3048712094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 msgr2=0x564ab5d0ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65421e3700 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d0ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65421e3700 1 -- 172.21.15.6:0/3048712094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ab5ade630 con 0x564ab5d0d700 2023-09-13T09:53:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65419e2700 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d0c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65429e4700 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d0ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:57.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f65421e3700 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0d700 0x564ab5d0db20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f6538009880 tx=0x7f6538014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e63ac2869e8accac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f6530d82700 1 -- 172.21.15.6:0/3048712094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538004a30 con 0x564ab5d0d700 2023-09-13T09:53:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f6530d82700 1 -- 172.21.15.6:0/3048712094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6538021070 con 0x564ab5d0d700 2023-09-13T09:53:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.028+0000 7f6530d82700 1 -- 172.21.15.6:0/3048712094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653801c670 con 0x564ab5d0d700 2023-09-13T09:53:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 -- 172.21.15.6:0/3048712094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0d700 msgr2=0x564ab5d0db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0d700 0x564ab5d0db20 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f6538009880 tx=0x7f6538014000 comp rx=0 tx=0).stop 2023-09-13T09:53:57.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 -- 172.21.15.6:0/3048712094 shutdown_connections 2023-09-13T09:53:57.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d0ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0d700 0x564ab5d0db20 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 --2- 172.21.15.6:0/3048712094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d0c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 -- 172.21.15.6:0/3048712094 >> 172.21.15.6:0/3048712094 conn(0x564ab5c6ac80 msgr2=0x564ab5d06f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 -- 172.21.15.6:0/3048712094 shutdown_connections 2023-09-13T09:53:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 -- 172.21.15.6:0/3048712094 wait complete. 2023-09-13T09:53:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 -- start start 2023-09-13T09:53:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.029+0000 7f655062cb80 1 Processor -- start 2023-09-13T09:53:57.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d15f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d164c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0e060 0x564ab5d1d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5bfcbb0 con 0x564ab5d0ca00 2023-09-13T09:53:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5bfc8b0 con 0x564ab5d0e060 2023-09-13T09:53:57.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5ae0920 con 0x564ab5d0d700 2023-09-13T09:53:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d15f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 10 client.0 _ll_register_callbacks cb 0x564ab5bfa680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d15f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42882/0 (socket says 172.21.15.6:42882) 2023-09-13T09:53:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 -- 172.21.15.6:0/3865359891 learned_addr learned my addr 172.21.15.6:0/3865359891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65419e2700 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d164c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65429e4700 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0e060 0x564ab5d1d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 -- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 msgr2=0x564ab5d164c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d164c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 -- 172.21.15.6:0/3865359891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0e060 msgr2=0x564ab5d1d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0e060 0x564ab5d1d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 -- 172.21.15.6:0/3865359891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6538017070 con 0x564ab5d0ca00 2023-09-13T09:53:57.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f65421e3700 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d15f80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f6538005820 tx=0x7f653800eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794464308d0b8c27 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f6525ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:57.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f6525ffb700 1 -- 172.21.15.6:0/3865359891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538004e90 con 0x564ab5d0ca00 2023-09-13T09:53:57.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f6525ffb700 1 -- 172.21.15.6:0/3865359891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6538004ff0 con 0x564ab5d0ca00 2023-09-13T09:53:57.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.030+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ab5cff670 con 0x564ab5d0ca00 2023-09-13T09:53:57.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f6525ffb700 1 -- 172.21.15.6:0/3865359891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65380051b0 con 0x564ab5d0ca00 2023-09-13T09:53:57.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 10 client.19251 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x564ab5c767a0 con 0x564ab5d0ca00 2023-09-13T09:53:57.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f6525ffb700 1 -- 172.21.15.6:0/3865359891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x564ab5cff670 con 0x564ab5d0ca00 2023-09-13T09:53:57.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f6525ffb700 1 -- 172.21.15.6:0/3865359891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f6538003ac0 con 0x564ab5d0ca00 2023-09-13T09:53:57.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 10 client.19251 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 10 client.19251 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:53:57.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 20 client.19251 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d21cd0 0x564ab5d240f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 4 client.19251 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:57.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ab5c57970 con 0x564ab5d21cd0 2023-09-13T09:53:57.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.031+0000 7f65419e2700 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d21cd0 0x564ab5d240f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.032+0000 7f6525ffb700 10 client.19251 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:57.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.032+0000 7f65419e2700 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d21cd0 0x564ab5d240f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8722177781df4533 server_cookie=8d97b48e0f4137d4 in_seq=0 out_seq=0 2023-09-13T09:53:57.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f6525ffb700 1 -- 172.21.15.6:0/3865359891 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564ab5c57970 con 0x564ab5d21cd0 2023-09-13T09:53:57.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f6525ffb700 10 client.19251 handle_command_reply: tid=0 2023-09-13T09:53:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 client.19251 shutdown 2023-09-13T09:53:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 msgr2=0x564ab5d15f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d15f80 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f6538005820 tx=0x7f653800eed0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 shutdown_connections 2023-09-13T09:53:57.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d21cd0 0x564ab5d240f0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0e060 0x564ab5d1d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d15f80 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f6525ffb700 0 client.19251 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 --2- 172.21.15.6:0/3865359891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d164c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 >> 172.21.15.6:0/3865359891 conn(0x564ab5c6ac80 msgr2=0x564ab5d017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 shutdown_connections 2023-09-13T09:53:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 1 -- 172.21.15.6:0/3865359891 wait complete. 2023-09-13T09:53:57.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.034+0000 7f655062cb80 20 client.19251 trim_cache size 0 max 16384 2023-09-13T09:53:57.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 Processor -- start 2023-09-13T09:53:57.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 -- start start 2023-09-13T09:53:57.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d0c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0d700 0x564ab5d240c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d1d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5d038e0 con 0x564ab5d0ca00 2023-09-13T09:53:57.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5d114f0 con 0x564ab5d0d700 2023-09-13T09:53:57.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f655062cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5d219a0 con 0x564ab5d0e060 2023-09-13T09:53:57.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f65421e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d0c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65419e2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0d700 0x564ab5d240c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.050+0000 7f65421e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d0c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42890/0 (socket says 172.21.15.6:42890) 2023-09-13T09:53:57.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65421e3700 1 -- 172.21.15.6:0/3852523264 learned_addr learned my addr 172.21.15.6:0/3852523264 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65429e4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d1d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65421e3700 1 -- 172.21.15.6:0/3852523264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 msgr2=0x564ab5d1d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65421e3700 1 --2- 172.21.15.6:0/3852523264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d1d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65421e3700 1 -- 172.21.15.6:0/3852523264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0d700 msgr2=0x564ab5d240c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65421e3700 1 --2- 172.21.15.6:0/3852523264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0d700 0x564ab5d240c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65421e3700 1 -- 172.21.15.6:0/3852523264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ab5a8ade0 con 0x564ab5d0ca00 2023-09-13T09:53:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f65421e3700 1 --2- 172.21.15.6:0/3852523264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d0c4c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6538003ea0 tx=0x7f6538004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2812a37d1f3f28b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f6531583700 1 -- 172.21.15.6:0/3852523264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65380092d0 con 0x564ab5d0ca00 2023-09-13T09:53:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f6531583700 1 -- 172.21.15.6:0/3852523264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6538004460 con 0x564ab5d0ca00 2023-09-13T09:53:57.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.051+0000 7f6531583700 1 -- 172.21.15.6:0/3852523264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6538026b10 con 0x564ab5d0ca00 2023-09-13T09:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 -- 172.21.15.6:0/3852523264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 msgr2=0x564ab5d0c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 --2- 172.21.15.6:0/3852523264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d0c4c0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f6538003ea0 tx=0x7f6538004770 comp rx=0 tx=0).stop 2023-09-13T09:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 -- 172.21.15.6:0/3852523264 shutdown_connections 2023-09-13T09:53:57.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 --2- 172.21.15.6:0/3852523264 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0e060 0x564ab5d1d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 --2- 172.21.15.6:0/3852523264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0ca00 0x564ab5d0c4c0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 --2- 172.21.15.6:0/3852523264 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0d700 0x564ab5d240c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 -- 172.21.15.6:0/3852523264 >> 172.21.15.6:0/3852523264 conn(0x564ab5c6ac80 msgr2=0x564ab5d06e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 -- 172.21.15.6:0/3852523264 shutdown_connections 2023-09-13T09:53:57.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 -- 172.21.15.6:0/3852523264 wait complete. 2023-09-13T09:53:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.052+0000 7f655062cb80 1 -- start start 2023-09-13T09:53:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 1 Processor -- start 2023-09-13T09:53:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d1b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d1bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0e060 0x564ab5d1c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5d1c8d0 con 0x564ab5d0e060 2023-09-13T09:53:57.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5d1ca40 con 0x564ab5d0ca00 2023-09-13T09:53:57.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ab5d1cc00 con 0x564ab5d0d700 2023-09-13T09:53:57.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f655062cb80 10 client.0 _ll_register_callbacks cb 0x564ab5bfa680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65421e3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d1b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65429e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0e060 0x564ab5d1c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65421e3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d1b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36420/0 (socket says 172.21.15.6:36420) 2023-09-13T09:53:57.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65419e2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d1bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65421e3700 1 -- 172.21.15.6:0/1217523305 learned_addr learned my addr 172.21.15.6:0/1217523305 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65429e4700 1 -- 172.21.15.6:0/1217523305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 msgr2=0x564ab5d1bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65429e4700 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d1bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65429e4700 1 -- 172.21.15.6:0/1217523305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 msgr2=0x564ab5d1b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65429e4700 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d1b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65429e4700 1 -- 172.21.15.6:0/1217523305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ab5c767a0 con 0x564ab5d0e060 2023-09-13T09:53:57.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.053+0000 7f65421e3700 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d1b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:57.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f65429e4700 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0e060 0x564ab5d1c1c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x564ab5d15540 tx=0x7f65340049c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e2b1cf4c880cac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f6525ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:57.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f6525ffb700 1 -- 172.21.15.6:0/1217523305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f653401c070 con 0x564ab5d0e060 2023-09-13T09:53:57.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f6525ffb700 1 -- 172.21.15.6:0/1217523305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f65340093a0 con 0x564ab5d0e060 2023-09-13T09:53:57.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6538021070 con 0x564ab5d0e060 2023-09-13T09:53:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f6525ffb700 1 -- 172.21.15.6:0/1217523305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f653400e040 con 0x564ab5d0e060 2023-09-13T09:53:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 10 client.19257 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x564ab5a73c60 con 0x564ab5d0e060 2023-09-13T09:53:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f6525ffb700 1 -- 172.21.15.6:0/1217523305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6538021070 con 0x564ab5d0e060 2023-09-13T09:53:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f6525ffb700 1 -- 172.21.15.6:0/1217523305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f65340077a0 con 0x564ab5d0e060 2023-09-13T09:53:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 10 client.19257 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 10 client.19257 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:53:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 20 client.19257 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d76790 0x564ab5d78bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 4 client.19257 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:57.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.054+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x564ab5c18050 con 0x564ab5d76790 2023-09-13T09:53:57.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.055+0000 7f65421e3700 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d76790 0x564ab5d78bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.057+0000 7f65421e3700 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d76790 0x564ab5d78bb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f8e22ffbaff3a446 server_cookie=1e946db6cb0cfea in_seq=0 out_seq=0 2023-09-13T09:53:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.057+0000 7f6525ffb700 10 client.19257 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f6525ffb700 1 -- 172.21.15.6:0/1217523305 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x564ab5c18050 con 0x564ab5d76790 2023-09-13T09:53:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f6525ffb700 10 client.19257 handle_command_reply: tid=0 2023-09-13T09:53:57.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 client.19257 shutdown 2023-09-13T09:53:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0e060 msgr2=0x564ab5d1c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0e060 0x564ab5d1c1c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x564ab5d15540 tx=0x7f65340049c0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 shutdown_connections 2023-09-13T09:53:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x564ab5d76790 0x564ab5d78bb0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564ab5d0e060 0x564ab5d1c1c0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564ab5d0ca00 0x564ab5d1b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f6525ffb700 0 client.19257 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:53:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 --2- 172.21.15.6:0/1217523305 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564ab5d0d700 0x564ab5d1bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 >> 172.21.15.6:0/1217523305 conn(0x564ab5c6ac80 msgr2=0x564ab5d14be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 shutdown_connections 2023-09-13T09:53:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 1 -- 172.21.15.6:0/1217523305 wait complete. 2023-09-13T09:53:57.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.059+0000 7f655062cb80 20 client.19257 trim_cache size 0 max 16384 2023-09-13T09:53:57.079 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65280a06c0 msgr2=0x7f65280a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65280a06c0 0x7f65280a2b80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f6538005950 tx=0x7f6538009260 comp rx=0 tx=0).stop 2023-09-13T09:53:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 msgr2=0x7f653c197030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 0x7f653c197030 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f652c0098e0 tx=0x7f652c00f690 comp rx=0 tx=0).stop 2023-09-13T09:53:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 shutdown_connections 2023-09-13T09:53:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f653c101850 0x7f653c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f653c0ffcc0 0x7f653c196af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65280a06c0 0x7f65280a2b80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 --2- 172.21.15.6:0/1366860041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f653c100eb0 0x7f653c197030 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 >> 172.21.15.6:0/1366860041 conn(0x7f653c0fb250 msgr2=0x7f653c067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 shutdown_connections 2023-09-13T09:53:57.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.060+0000 7f6544447700 1 -- 172.21.15.6:0/1366860041 wait complete. 2023-09-13T09:53:57.084 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:53:57.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 -- 172.21.15.6:0/475619488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 msgr2=0x7f3da01024b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 --2- 172.21.15.6:0/475619488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da01024b0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f3d94009990 tx=0x7f3d94009ca0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 -- 172.21.15.6:0/475619488 shutdown_connections 2023-09-13T09:53:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 --2- 172.21.15.6:0/475619488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da01029f0 0x7f3da01092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 --2- 172.21.15.6:0/475619488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da00ff080 0x7f3da00ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 --2- 172.21.15.6:0/475619488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da01024b0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 -- 172.21.15.6:0/475619488 >> 172.21.15.6:0/475619488 conn(0x7f3da00fa9b0 msgr2=0x7f3da00fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 -- 172.21.15.6:0/475619488 shutdown_connections 2023-09-13T09:53:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.235+0000 7f3da614b700 1 -- 172.21.15.6:0/475619488 wait complete. 2023-09-13T09:53:57.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 Processor -- start 2023-09-13T09:53:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 -- start start 2023-09-13T09:53:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00ff080 0x7f3da0196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da0196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da01029f0 0x7f3da019e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da019e5d0 con 0x7f3da0102050 2023-09-13T09:53:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da019e710 con 0x7f3da01029f0 2023-09-13T09:53:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3da614b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da019e8a0 con 0x7f3da00ff080 2023-09-13T09:53:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.236+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da0196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da0196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42912/0 (socket says 172.21.15.6:42912) 2023-09-13T09:53:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 -- 172.21.15.6:0/1491320297 learned_addr learned my addr 172.21.15.6:0/1491320297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da01029f0 0x7f3da019e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00ff080 0x7f3da0196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 -- 172.21.15.6:0/1491320297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00ff080 msgr2=0x7f3da0196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00ff080 0x7f3da0196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 -- 172.21.15.6:0/1491320297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da01029f0 msgr2=0x7f3da019e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da01029f0 0x7f3da019e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 -- 172.21.15.6:0/1491320297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d940095f0 con 0x7f3da0102050 2023-09-13T09:53:57.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9effd700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da0196f90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3d940059d0 tx=0x7f3d94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9cff9700 1 -- 172.21.15.6:0/1491320297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9401d070 con 0x7f3da0102050 2023-09-13T09:53:57.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da019eb20 con 0x7f3da0102050 2023-09-13T09:53:57.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9cff9700 1 -- 172.21.15.6:0/1491320297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d9400fb90 con 0x7f3da0102050 2023-09-13T09:53:57.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3d9cff9700 1 -- 172.21.15.6:0/1491320297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d940173f0 con 0x7f3da0102050 2023-09-13T09:53:57.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.237+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da019efa0 con 0x7f3da0102050 2023-09-13T09:53:57.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.240+0000 7f3d9cff9700 1 -- 172.21.15.6:0/1491320297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3d9400fd00 con 0x7f3da0102050 2023-09-13T09:53:57.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.240+0000 7f3d9cff9700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.240+0000 7f3d9cff9700 1 -- 172.21.15.6:0/1491320297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3d940ccf70 con 0x7f3da0102050 2023-09-13T09:53:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.240+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3da0067db0 tx=0x7f3d90009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 Processor -- start 2023-09-13T09:53:57.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 -- start start 2023-09-13T09:53:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568801700 0x555568801b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688004c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568800a00 0x555568800e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568759780 con 0x555568802060 2023-09-13T09:53:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555687570a0 con 0x555568800a00 2023-09-13T09:53:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3db2330b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568752990 con 0x555568801700 2023-09-13T09:53:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.241+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688004c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42918/0 (socket says 172.21.15.6:42918) 2023-09-13T09:53:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568800a00 0x555568800e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 -- 172.21.15.6:0/171255992 learned_addr learned my addr 172.21.15.6:0/171255992 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568801700 0x555568801b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 -- 172.21.15.6:0/171255992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568801700 msgr2=0x555568801b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568801700 0x555568801b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 -- 172.21.15.6:0/171255992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568800a00 msgr2=0x555568800e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568800a00 0x555568800e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 -- 172.21.15.6:0/171255992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555685d2630 con 0x555568802060 2023-09-13T09:53:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568800a00 0x555568800e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d9effd700 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688004c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3d940a2250 tx=0x7f3d94005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d38740b35b58894 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d85ffb700 1 -- 172.21.15.6:0/171255992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9409a7a0 con 0x555568802060 2023-09-13T09:53:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d85ffb700 1 -- 172.21.15.6:0/171255992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d9409e5d0 con 0x555568802060 2023-09-13T09:53:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.242+0000 7f3d85ffb700 1 -- 172.21.15.6:0/171255992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94099ef0 con 0x555568802060 2023-09-13T09:53:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 -- 172.21.15.6:0/171255992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 msgr2=0x5555688004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688004c0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f3d940a2250 tx=0x7f3d94005ef0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 -- 172.21.15.6:0/171255992 shutdown_connections 2023-09-13T09:53:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568800a00 0x555568800e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568801700 0x555568801b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 --2- 172.21.15.6:0/171255992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688004c0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 -- 172.21.15.6:0/171255992 >> 172.21.15.6:0/171255992 conn(0x55556875ec80 msgr2=0x5555687faf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 -- 172.21.15.6:0/171255992 shutdown_connections 2023-09-13T09:53:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.243+0000 7f3db2330b80 1 -- 172.21.15.6:0/171255992 wait complete. 2023-09-13T09:53:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 -- start start 2023-09-13T09:53:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 Processor -- start 2023-09-13T09:53:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568800a00 0x555568809b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x55556880a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688110b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555686f0bb0 con 0x555568802060 2023-09-13T09:53:57.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555686f08b0 con 0x555568801700 2023-09-13T09:53:57.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555685d4920 con 0x555568800a00 2023-09-13T09:53:57.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3db2330b80 10 client.0 _ll_register_callbacks cb 0x5555686ee680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3d9f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568800a00 0x555568809b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568800a00 0x555568809b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:45978/0 (socket says 172.21.15.6:45978) 2023-09-13T09:53:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.244+0000 7f3d9effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x55556880a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/504580121 learned_addr learned my addr 172.21.15.6:0/504580121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688110b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/504580121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 msgr2=0x55556880a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x55556880a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/504580121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 msgr2=0x5555688110b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688110b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/504580121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da019efa0 con 0x555568800a00 2023-09-13T09:53:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568800a00 0x555568809b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d9001d8f0 tx=0x7f3d900047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9aae2a9dd65f2e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d7effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:53:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d7effd700 1 -- 172.21.15.6:0/504580121 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90022070 con 0x555568800a00 2023-09-13T09:53:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555687f3670 con 0x555568800a00 2023-09-13T09:53:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d7effd700 1 -- 172.21.15.6:0/504580121 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3d90004020 con 0x555568800a00 2023-09-13T09:53:57.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3d7effd700 1 -- 172.21.15.6:0/504580121 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d900041e0 con 0x555568800a00 2023-09-13T09:53:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3db2330b80 10 client.28585 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.245+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55556876a7a0 con 0x555568800a00 2023-09-13T09:53:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3d7effd700 1 -- 172.21.15.6:0/504580121 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5555687f3670 con 0x555568800a00 2023-09-13T09:53:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3d7effd700 1 -- 172.21.15.6:0/504580121 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3d9001c6b0 con 0x555568800a00 2023-09-13T09:53:57.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3db2330b80 10 client.28585 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3db2330b80 10 client.28585 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:53:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3db2330b80 20 client.28585 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3db2330b80 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x555568817e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3db2330b80 4 client.28585 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55556874b970 con 0x555568815a40 2023-09-13T09:53:57.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.246+0000 7f3d9effd700 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x555568817e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.247+0000 7f3d9effd700 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x555568817e60 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a9eec8de4fd265ab server_cookie=1daae75c07cb54ad in_seq=0 out_seq=0 2023-09-13T09:53:57.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.247+0000 7f3d7effd700 10 client.28585 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:57.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3d7effd700 1 -- 172.21.15.6:0/504580121 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55556874b970 con 0x555568815a40 2023-09-13T09:53:57.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3d7effd700 10 client.28585 handle_command_reply: tid=0 2023-09-13T09:53:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 client.28585 shutdown 2023-09-13T09:53:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568800a00 msgr2=0x555568809b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568800a00 0x555568809b30 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3d9001d8f0 tx=0x7f3d900047c0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 shutdown_connections 2023-09-13T09:53:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x555568817e60 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568802060 0x5555688110b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568800a00 0x555568809b30 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3d7effd700 0 client.28585 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 --2- 172.21.15.6:0/504580121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x55556880a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 >> 172.21.15.6:0/504580121 conn(0x55556875ec80 msgr2=0x5555687f57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 shutdown_connections 2023-09-13T09:53:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 1 -- 172.21.15.6:0/504580121 wait complete. 2023-09-13T09:53:57.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.251+0000 7f3db2330b80 20 client.28585 trim_cache size 0 max 16384 2023-09-13T09:53:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 Processor -- start 2023-09-13T09:53:57.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 -- start start 2023-09-13T09:53:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x5555687fbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x555568811040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x5555688119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555687fc730 con 0x555568800a00 2023-09-13T09:53:57.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555687f78e0 con 0x555568801700 2023-09-13T09:53:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3db2330b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555687f3400 con 0x555568802060 2023-09-13T09:53:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3d9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x5555687fbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3d9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x5555687fbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42932/0 (socket says 172.21.15.6:42932) 2023-09-13T09:53:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/1218340538 learned_addr learned my addr 172.21.15.6:0/1218340538 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3d9effd700 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x555568811040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.266+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x5555688119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/1218340538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 msgr2=0x5555688119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x5555688119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/1218340538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 msgr2=0x555568811040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x555568811040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/1218340538 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55556857ede0 con 0x555568800a00 2023-09-13T09:53:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x5555687fbfb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3d90013010 tx=0x7f3d900046f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364d285aadf4f64e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d867fc700 1 -- 172.21.15.6:0/1218340538 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90036070 con 0x555568800a00 2023-09-13T09:53:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d867fc700 1 -- 172.21.15.6:0/1218340538 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d9002c030 con 0x555568800a00 2023-09-13T09:53:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.267+0000 7f3d867fc700 1 -- 172.21.15.6:0/1218340538 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90022040 con 0x555568800a00 2023-09-13T09:53:57.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.268+0000 7f3db2330b80 1 -- 172.21.15.6:0/1218340538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 msgr2=0x5555687fbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.268+0000 7f3db2330b80 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x5555687fbfb0 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f3d90013010 tx=0x7f3d900046f0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.268+0000 7f3db2330b80 1 -- 172.21.15.6:0/1218340538 shutdown_connections 2023-09-13T09:53:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.268+0000 7f3db2330b80 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x5555688119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.268+0000 7f3db2330b80 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x5555687fbfb0 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.268+0000 7f3db2330b80 1 --2- 172.21.15.6:0/1218340538 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x555568811040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.268+0000 7f3db2330b80 1 -- 172.21.15.6:0/1218340538 >> 172.21.15.6:0/1218340538 conn(0x55556875ec80 msgr2=0x5555687fae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.269+0000 7f3db2330b80 1 -- 172.21.15.6:0/1218340538 shutdown_connections 2023-09-13T09:53:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.270+0000 7f3db2330b80 1 -- 172.21.15.6:0/1218340538 wait complete. 2023-09-13T09:53:57.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.270+0000 7f3db2330b80 1 -- start start 2023-09-13T09:53:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.270+0000 7f3db2330b80 1 Processor -- start 2023-09-13T09:53:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x55556880c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x55556880cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3db2330b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x55556880ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3db2330b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568810490 con 0x555568800a00 2023-09-13T09:53:57.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3db2330b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555568810600 con 0x555568801700 2023-09-13T09:53:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3db2330b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555688107c0 con 0x555568802060 2023-09-13T09:53:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3db2330b80 10 client.0 _ll_register_callbacks cb 0x5555686ee680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x55556880c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x55556880c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42936/0 (socket says 172.21.15.6:42936) 2023-09-13T09:53:57.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/960143330 learned_addr learned my addr 172.21.15.6:0/960143330 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x55556880ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/960143330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 msgr2=0x55556880ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x55556880ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/960143330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 msgr2=0x55556880cf30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:53:57.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x55556880cf30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 -- 172.21.15.6:0/960143330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55556876a7a0 con 0x555568800a00 2023-09-13T09:53:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d9f7fe700 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x55556880c9f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3d9001c800 tx=0x7f3d9001cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb1a920e8e779bc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.271+0000 7f3d7effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3d7effd700 1 -- 172.21.15.6:0/960143330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d90022040 con 0x555568800a00 2023-09-13T09:53:57.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3d7effd700 1 -- 172.21.15.6:0/960143330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3d900044e0 con 0x555568800a00 2023-09-13T09:53:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3d9409e5d0 con 0x555568800a00 2023-09-13T09:53:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3d7effd700 1 -- 172.21.15.6:0/960143330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3d90005260 con 0x555568800a00 2023-09-13T09:53:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3db2330b80 10 client.19275 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x555568567c60 con 0x555568800a00 2023-09-13T09:53:57.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3d7effd700 1 -- 172.21.15.6:0/960143330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3d9409e5d0 con 0x555568800a00 2023-09-13T09:53:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.272+0000 7f3d7effd700 1 -- 172.21.15.6:0/960143330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3d90003680 con 0x555568800a00 2023-09-13T09:53:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3db2330b80 10 client.19275 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3db2330b80 10 client.19275 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:53:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3db2330b80 20 client.19275 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3db2330b80 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x55556886c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3db2330b80 4 client.19275 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:57.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55556870c050 con 0x555568815a40 2023-09-13T09:53:57.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3d9effd700 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x55556886c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3d7effd700 10 client.19275 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:57.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.273+0000 7f3d9effd700 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x55556886c080 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5181c3a976a3a5b3 server_cookie=62da8351e45e57b3 in_seq=0 out_seq=0 2023-09-13T09:53:57.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3d7effd700 1 -- 172.21.15.6:0/960143330 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55556870c050 con 0x555568815a40 2023-09-13T09:53:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3d7effd700 10 client.19275 handle_command_reply: tid=0 2023-09-13T09:53:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 client.19275 shutdown 2023-09-13T09:53:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 msgr2=0x55556880c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x55556880c9f0 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f3d9001c800 tx=0x7f3d9001cf40 comp rx=0 tx=0).stop 2023-09-13T09:53:57.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 shutdown_connections 2023-09-13T09:53:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x555568815a40 0x55556886c080 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555568802060 0x55556880ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3d7effd700 0 client.19275 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:53:57.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555568800a00 0x55556880c9f0 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 --2- 172.21.15.6:0/960143330 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555568801700 0x55556880cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 >> 172.21.15.6:0/960143330 conn(0x55556875ec80 msgr2=0x5555688098e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 shutdown_connections 2023-09-13T09:53:57.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 1 -- 172.21.15.6:0/960143330 wait complete. 2023-09-13T09:53:57.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.276+0000 7f3db2330b80 20 client.19275 trim_cache size 0 max 16384 2023-09-13T09:53:57.291 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 msgr2=0x7f3d880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f3da0067db0 tx=0x7f3d90009260 comp rx=0 tx=0).stop 2023-09-13T09:53:57.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 msgr2=0x7f3da0196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da0196f90 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f3d940059d0 tx=0x7f3d94004730 comp rx=0 tx=0).stop 2023-09-13T09:53:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 shutdown_connections 2023-09-13T09:53:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3da01029f0 0x7f3da019e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3da00ff080 0x7f3da0196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3d880a0640 0x7f3d880a2b00 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 --2- 172.21.15.6:0/1491320297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3da0102050 0x7f3da0196f90 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 >> 172.21.15.6:0/1491320297 conn(0x7f3da00fa9b0 msgr2=0x7f3da00fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 shutdown_connections 2023-09-13T09:53:57.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.277+0000 7f3da614b700 1 -- 172.21.15.6:0/1491320297 wait complete. 2023-09-13T09:53:57.295 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:53:57.322 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:57 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2617065143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:53:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 -- 172.21.15.6:0/1845113116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530101850 msgr2=0x7ff530108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 --2- 172.21.15.6:0/1845113116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530101850 0x7ff530108100 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7ff528009fc0 tx=0x7ff52800b330 comp rx=0 tx=0).stop 2023-09-13T09:53:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 -- 172.21.15.6:0/1845113116 shutdown_connections 2023-09-13T09:53:57.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 --2- 172.21.15.6:0/1845113116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff530101850 0x7ff530108100 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 --2- 172.21.15.6:0/1845113116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5300ffcc0 0x7ff5301000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 --2- 172.21.15.6:0/1845113116 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff530100eb0 0x7ff530101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 -- 172.21.15.6:0/1845113116 >> 172.21.15.6:0/1845113116 conn(0x7ff5300fb250 msgr2=0x7ff5300fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 -- 172.21.15.6:0/1845113116 shutdown_connections 2023-09-13T09:53:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.444+0000 7ff537c66700 1 -- 172.21.15.6:0/1845113116 wait complete. 2023-09-13T09:53:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 Processor -- start 2023-09-13T09:53:57.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 -- start start 2023-09-13T09:53:57.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5300ffcc0 0x7ff530198db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff530100eb0 0x7ff5301992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff530101850 0x7ff5301a0360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301a0930 con 0x7ff5300ffcc0 2023-09-13T09:53:57.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301a0a70 con 0x7ff530100eb0 2023-09-13T09:53:57.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff537c66700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5301a0c00 con 0x7ff530101850 2023-09-13T09:53:57.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535a02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5300ffcc0 0x7ff530198db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535a02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5300ffcc0 0x7ff530198db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42948/0 (socket says 172.21.15.6:42948) 2023-09-13T09:53:57.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535a02700 1 -- 172.21.15.6:0/1263862018 learned_addr learned my addr 172.21.15.6:0/1263862018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535201700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff530100eb0 0x7ff5301992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff536203700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff530101850 0x7ff5301a0360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535a02700 1 -- 172.21.15.6:0/1263862018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff530101850 msgr2=0x7ff5301a0360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535a02700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff530101850 0x7ff5301a0360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535a02700 1 -- 172.21.15.6:0/1263862018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff530100eb0 msgr2=0x7ff5301992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.445+0000 7ff535a02700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff530100eb0 0x7ff5301992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.446+0000 7ff535a02700 1 -- 172.21.15.6:0/1263862018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff52c0095f0 con 0x7ff5300ffcc0 2023-09-13T09:53:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.446+0000 7ff535a02700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5300ffcc0 0x7ff530198db0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00ebf0 tx=0x7ff52c00ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.446+0000 7ff526ffd700 1 -- 172.21.15.6:0/1263862018 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c009a10 con 0x7ff5300ffcc0 2023-09-13T09:53:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.446+0000 7ff526ffd700 1 -- 172.21.15.6:0/1263862018 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff52c00cc90 con 0x7ff5300ffcc0 2023-09-13T09:53:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.446+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff520009520 con 0x7ff5300ffcc0 2023-09-13T09:53:57.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.446+0000 7ff526ffd700 1 -- 172.21.15.6:0/1263862018 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c018750 con 0x7ff5300ffcc0 2023-09-13T09:53:57.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.446+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff528009c40 con 0x7ff5300ffcc0 2023-09-13T09:53:57.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.448+0000 7ff526ffd700 1 -- 172.21.15.6:0/1263862018 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff52c0188b0 con 0x7ff5300ffcc0 2023-09-13T09:53:57.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.449+0000 7ff526ffd700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff51c0a0640 0x7ff51c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.449+0000 7ff526ffd700 1 -- 172.21.15.6:0/1263862018 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff52c014070 con 0x7ff5300ffcc0 2023-09-13T09:53:57.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.449+0000 7ff535201700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff51c0a0640 0x7ff51c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff535201700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff51c0a0640 0x7ff51c0a2b00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff520009df0 tx=0x7ff520009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 Processor -- start 2023-09-13T09:53:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 -- start start 2023-09-13T09:53:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce549b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce54a060 0x562bce5484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce548e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce4a1780 con 0x562bce548a00 2023-09-13T09:53:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce49f0a0 con 0x562bce54a060 2023-09-13T09:53:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.450+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce49a990 con 0x562bce549700 2023-09-13T09:53:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce548e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff535201700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce54a060 0x562bce5484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce548e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42960/0 (socket says 172.21.15.6:42960) 2023-09-13T09:53:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff535a02700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce549b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 -- 172.21.15.6:0/1781240429 learned_addr learned my addr 172.21.15.6:0/1781240429 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 -- 172.21.15.6:0/1781240429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 msgr2=0x562bce549b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 --2- 172.21.15.6:0/1781240429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce549b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 -- 172.21.15.6:0/1781240429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce54a060 msgr2=0x562bce5484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 --2- 172.21.15.6:0/1781240429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce54a060 0x562bce5484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 -- 172.21.15.6:0/1781240429 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bce31a630 con 0x562bce548a00 2023-09-13T09:53:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff536203700 1 --2- 172.21.15.6:0/1781240429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce548e80 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff528009bf0 tx=0x7ff528009320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac411a4e9b4a8412 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff51bfff700 1 -- 172.21.15.6:0/1781240429 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800e040 con 0x562bce548a00 2023-09-13T09:53:57.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff51bfff700 1 -- 172.21.15.6:0/1781240429 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5280073e0 con 0x562bce548a00 2023-09-13T09:53:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.451+0000 7ff51bfff700 1 -- 172.21.15.6:0/1781240429 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800bc50 con 0x562bce548a00 2023-09-13T09:53:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1781240429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 msgr2=0x562bce548e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1781240429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce548e80 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7ff528009bf0 tx=0x7ff528009320 comp rx=0 tx=0).stop 2023-09-13T09:53:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1781240429 shutdown_connections 2023-09-13T09:53:57.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1781240429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce548e80 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1781240429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce549b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1781240429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce54a060 0x562bce5484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1781240429 >> 172.21.15.6:0/1781240429 conn(0x562bce4a6c80 msgr2=0x562bce542f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1781240429 shutdown_connections 2023-09-13T09:53:57.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.452+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1781240429 wait complete. 2023-09-13T09:53:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 -- start start 2023-09-13T09:53:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 Processor -- start 2023-09-13T09:53:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce551e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce552380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce54a060 0x562bce5593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce438bb0 con 0x562bce548a00 2023-09-13T09:53:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce4388b0 con 0x562bce549700 2023-09-13T09:53:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce31c920 con 0x562bce54a060 2023-09-13T09:53:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff543e4bb80 10 client.0 _ll_register_callbacks cb 0x562bce436680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff535a02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce551e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff535a02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce551e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42962/0 (socket says 172.21.15.6:42962) 2023-09-13T09:53:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff535a02700 1 -- 172.21.15.6:0/3662127466 learned_addr learned my addr 172.21.15.6:0/3662127466 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.453+0000 7ff535201700 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce552380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff536203700 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce54a060 0x562bce5593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff535a02700 1 -- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce54a060 msgr2=0x562bce5593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff535a02700 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce54a060 0x562bce5593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff535a02700 1 -- 172.21.15.6:0/3662127466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 msgr2=0x562bce552380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff535a02700 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce552380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff535a02700 1 -- 172.21.15.6:0/3662127466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff530108a50 con 0x562bce548a00 2023-09-13T09:53:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff535a02700 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce551e40 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0c9c80 tx=0x7ff52c099eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fdf58b340f549cc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff5197fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff5197fa700 1 -- 172.21.15.6:0/3662127466 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52c0a1750 con 0x562bce548a00 2023-09-13T09:53:57.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff5197fa700 1 -- 172.21.15.6:0/3662127466 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff52c099970 con 0x562bce548a00 2023-09-13T09:53:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562bce53b670 con 0x562bce548a00 2023-09-13T09:53:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff5197fa700 1 -- 172.21.15.6:0/3662127466 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff52c09d7a0 con 0x562bce548a00 2023-09-13T09:53:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff543e4bb80 10 client.19287 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.454+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x562bce4b27a0 con 0x562bce548a00 2023-09-13T09:53:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff5197fa700 1 -- 172.21.15.6:0/3662127466 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562bce53b670 con 0x562bce548a00 2023-09-13T09:53:57.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff5197fa700 1 -- 172.21.15.6:0/3662127466 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff52c018b60 con 0x562bce548a00 2023-09-13T09:53:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff543e4bb80 10 client.19287 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff543e4bb80 10 client.19287 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:53:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff543e4bb80 20 client.19287 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff543e4bb80 4 client.19287 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562bce493970 con 0x562bce55dc90 2023-09-13T09:53:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.455+0000 7ff535201700 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.456+0000 7ff5197fa700 10 client.19287 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.456+0000 7ff535201700 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5600b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=26c4cfef6b4c54cc server_cookie=1692ae9c15c0a5e6 in_seq=0 out_seq=0 2023-09-13T09:53:57.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.456+0000 7ff5197fa700 1 -- 172.21.15.6:0/3662127466 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562bce493970 con 0x562bce55dc90 2023-09-13T09:53:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.456+0000 7ff5197fa700 10 client.19287 handle_command_reply: tid=0 2023-09-13T09:53:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 client.19287 shutdown 2023-09-13T09:53:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 msgr2=0x562bce551e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce551e40 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7ff52c0c9c80 tx=0x7ff52c099eb0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 shutdown_connections 2023-09-13T09:53:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5600b0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce54a060 0x562bce5593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce548a00 0x562bce551e40 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff5197fa700 0 client.19287 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:57.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/3662127466 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce552380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 >> 172.21.15.6:0/3662127466 conn(0x562bce4a6c80 msgr2=0x562bce542ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 shutdown_connections 2023-09-13T09:53:57.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 1 -- 172.21.15.6:0/3662127466 wait complete. 2023-09-13T09:53:57.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.457+0000 7ff543e4bb80 20 client.19287 trim_cache size 0 max 16384 2023-09-13T09:53:57.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 Processor -- start 2023-09-13T09:53:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 -- start start 2023-09-13T09:53:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce548a00 0x562bce5484c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce559380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce543810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce55b030 con 0x562bce54a060 2023-09-13T09:53:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce552e50 con 0x562bce548a00 2023-09-13T09:53:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce55d780 con 0x562bce549700 2023-09-13T09:53:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff536203700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce543810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff536203700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce543810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42974/0 (socket says 172.21.15.6:42974) 2023-09-13T09:53:57.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff535a02700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce548a00 0x562bce5484c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff536203700 1 -- 172.21.15.6:0/1715725034 learned_addr learned my addr 172.21.15.6:0/1715725034 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff535201700 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce559380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff536203700 1 -- 172.21.15.6:0/1715725034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 msgr2=0x562bce559380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff536203700 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce559380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff536203700 1 -- 172.21.15.6:0/1715725034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce548a00 msgr2=0x562bce5484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.473+0000 7ff536203700 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce548a00 0x562bce5484c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.474+0000 7ff536203700 1 -- 172.21.15.6:0/1715725034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562bce2c6de0 con 0x562bce54a060 2023-09-13T09:53:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.474+0000 7ff536203700 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce543810 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7ff528009390 tx=0x7ff528009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ced48ad28c8de83 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.474+0000 7ff524d82700 1 -- 172.21.15.6:0/1715725034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800e070 con 0x562bce54a060 2023-09-13T09:53:57.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.474+0000 7ff524d82700 1 -- 172.21.15.6:0/1715725034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff528003a00 con 0x562bce54a060 2023-09-13T09:53:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.474+0000 7ff524d82700 1 -- 172.21.15.6:0/1715725034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff528025460 con 0x562bce54a060 2023-09-13T09:53:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1715725034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 msgr2=0x562bce543810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce543810 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7ff528009390 tx=0x7ff528009b00 comp rx=0 tx=0).stop 2023-09-13T09:53:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1715725034 shutdown_connections 2023-09-13T09:53:57.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce543810 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce548a00 0x562bce5484c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1715725034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce549700 0x562bce559380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1715725034 >> 172.21.15.6:0/1715725034 conn(0x562bce4a6c80 msgr2=0x562bce542ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1715725034 shutdown_connections 2023-09-13T09:53:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1715725034 wait complete. 2023-09-13T09:53:57.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 -- start start 2023-09-13T09:53:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.475+0000 7ff543e4bb80 1 Processor -- start 2023-09-13T09:53:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce548a00 0x562bce5555d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce555b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff543e4bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce558410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce558950 con 0x562bce54a060 2023-09-13T09:53:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce558ac0 con 0x562bce549700 2023-09-13T09:53:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff543e4bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562bce558c80 con 0x562bce548a00 2023-09-13T09:53:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff543e4bb80 10 client.0 _ll_register_callbacks cb 0x562bce436680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce558410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff535201700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce555b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce558410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42980/0 (socket says 172.21.15.6:42980) 2023-09-13T09:53:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 -- 172.21.15.6:0/1197439293 learned_addr learned my addr 172.21.15.6:0/1197439293 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff535a02700 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce548a00 0x562bce5555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 -- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce548a00 msgr2=0x562bce5555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce548a00 0x562bce5555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 -- 172.21.15.6:0/1197439293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 msgr2=0x562bce555b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce555b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 -- 172.21.15.6:0/1197439293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562bce31a630 con 0x562bce54a060 2023-09-13T09:53:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff536203700 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce558410 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7ff528000f80 tx=0x7ff528007d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc057fa26a01516 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.476+0000 7ff5197fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:57.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff5197fa700 1 -- 172.21.15.6:0/1197439293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff52800e040 con 0x562bce54a060 2023-09-13T09:53:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5280073e0 con 0x562bce54a060 2023-09-13T09:53:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff5197fa700 1 -- 172.21.15.6:0/1197439293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff528003b70 con 0x562bce54a060 2023-09-13T09:53:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff5197fa700 1 -- 172.21.15.6:0/1197439293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff528025670 con 0x562bce54a060 2023-09-13T09:53:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 10 client.19293 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x562bce2afc60 con 0x562bce54a060 2023-09-13T09:53:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff5197fa700 1 -- 172.21.15.6:0/1197439293 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5280073e0 con 0x562bce54a060 2023-09-13T09:53:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff5197fa700 1 -- 172.21.15.6:0/1197439293 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff52802b020 con 0x562bce54a060 2023-09-13T09:53:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 10 client.19293 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 10 client.19293 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:53:57.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 20 client.19293 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5bcc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 4 client.19293 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562bce454050 con 0x562bce55dc90 2023-09-13T09:53:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.477+0000 7ff535a02700 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5bcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.478+0000 7ff5197fa700 10 client.19293 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:57.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.478+0000 7ff535a02700 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5bcc00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=685ca27311e98189 server_cookie=1b49bc3e9ea504db in_seq=0 out_seq=0 2023-09-13T09:53:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff5197fa700 1 -- 172.21.15.6:0/1197439293 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562bce454050 con 0x562bce55dc90 2023-09-13T09:53:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff5197fa700 10 client.19293 handle_command_reply: tid=0 2023-09-13T09:53:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 client.19293 shutdown 2023-09-13T09:53:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 msgr2=0x562bce558410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce558410 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7ff528000f80 tx=0x7ff528007d80 comp rx=0 tx=0).stop 2023-09-13T09:53:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 shutdown_connections 2023-09-13T09:53:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x562bce55dc90 0x562bce5bcc00 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562bce54a060 0x562bce558410 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff5197fa700 0 client.19293 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:53:57.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562bce548a00 0x562bce5555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 --2- 172.21.15.6:0/1197439293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562bce549700 0x562bce555b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 >> 172.21.15.6:0/1197439293 conn(0x562bce4a6c80 msgr2=0x562bce542e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 shutdown_connections 2023-09-13T09:53:57.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.481+0000 7ff543e4bb80 1 -- 172.21.15.6:0/1197439293 wait complete. 2023-09-13T09:53:57.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff543e4bb80 20 client.19293 trim_cache size 0 max 16384 2023-09-13T09:53:57.499 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff51c0a0640 msgr2=0x7ff51c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff51c0a0640 0x7ff51c0a2b00 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff520009df0 tx=0x7ff520009260 comp rx=0 tx=0).stop 2023-09-13T09:53:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5300ffcc0 msgr2=0x7ff530198db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5300ffcc0 0x7ff530198db0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00ebf0 tx=0x7ff52c00ef00 comp rx=0 tx=0).stop 2023-09-13T09:53:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 shutdown_connections 2023-09-13T09:53:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff530101850 0x7ff5301a0360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff51c0a0640 0x7ff51c0a2b00 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5300ffcc0 0x7ff530198db0 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 --2- 172.21.15.6:0/1263862018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff530100eb0 0x7ff5301992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 >> 172.21.15.6:0/1263862018 conn(0x7ff5300fb250 msgr2=0x7ff530067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 shutdown_connections 2023-09-13T09:53:57.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.482+0000 7ff537c66700 1 -- 172.21.15.6:0/1263862018 wait complete. 2023-09-13T09:53:57.503 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:53:57.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:57 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2617065143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:53:57.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:57 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2617065143' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:53:57.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 54653 40.54 MB/sec warmup 77 sec latency 54.505 ms 2023-09-13T09:53:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 -- 172.21.15.6:0/2985177372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d400ff2e0 msgr2=0x7f0d400ff700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 --2- 172.21.15.6:0/2985177372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d400ff2e0 0x7f0d400ff700 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0099c0 tx=0x7f0d3c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 -- 172.21.15.6:0/2985177372 shutdown_connections 2023-09-13T09:53:57.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 --2- 172.21.15.6:0/2985177372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d40100e70 0x7f0d40107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 --2- 172.21.15.6:0/2985177372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d400ff2e0 0x7f0d400ff700 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 --2- 172.21.15.6:0/2985177372 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d401004d0 0x7f0d40100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 -- 172.21.15.6:0/2985177372 >> 172.21.15.6:0/2985177372 conn(0x7f0d400fa850 msgr2=0x7f0d400fcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 -- 172.21.15.6:0/2985177372 shutdown_connections 2023-09-13T09:53:57.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.709+0000 7f0d4811e700 1 -- 172.21.15.6:0/2985177372 wait complete. 2023-09-13T09:53:57.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 Processor -- start 2023-09-13T09:53:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 -- start start 2023-09-13T09:53:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d400ff2e0 0x7f0d401969e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d401004d0 0x7f0d40196f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40100e70 0x7f0d4019df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4019e560 con 0x7f0d401004d0 2023-09-13T09:53:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4019e6a0 con 0x7f0d40100e70 2023-09-13T09:53:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.710+0000 7f0d4811e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4019e830 con 0x7f0d400ff2e0 2023-09-13T09:53:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d401004d0 0x7f0d40196f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d401004d0 0x7f0d40196f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42992/0 (socket says 172.21.15.6:42992) 2023-09-13T09:53:57.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 -- 172.21.15.6:0/1385777061 learned_addr learned my addr 172.21.15.6:0/1385777061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d45eba700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d400ff2e0 0x7f0d401969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d466bb700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40100e70 0x7f0d4019df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 -- 172.21.15.6:0/1385777061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d400ff2e0 msgr2=0x7f0d401969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d400ff2e0 0x7f0d401969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 -- 172.21.15.6:0/1385777061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40100e70 msgr2=0x7f0d4019df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40100e70 0x7f0d4019df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 -- 172.21.15.6:0/1385777061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3c0095f0 con 0x7f0d401004d0 2023-09-13T09:53:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d466bb700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40100e70 0x7f0d4019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:53:57.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d456b9700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d401004d0 0x7f0d40196f20 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000e9a0 tx=0x7f0d3000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d36ffd700 1 -- 172.21.15.6:0/1385777061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30009790 con 0x7f0d401004d0 2023-09-13T09:53:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4019eb10 con 0x7f0d401004d0 2023-09-13T09:53:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d36ffd700 1 -- 172.21.15.6:0/1385777061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d3000cbd0 con 0x7f0d401004d0 2023-09-13T09:53:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d36ffd700 1 -- 172.21.15.6:0/1385777061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d30018680 con 0x7f0d401004d0 2023-09-13T09:53:57.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.711+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4019f070 con 0x7f0d401004d0 2023-09-13T09:53:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.716+0000 7f0d36ffd700 1 -- 172.21.15.6:0/1385777061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0d3000cd40 con 0x7f0d401004d0 2023-09-13T09:53:57.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.716+0000 7f0d54303b80 1 Processor -- start 2023-09-13T09:53:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.716+0000 7f0d54303b80 1 -- start start 2023-09-13T09:53:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b15b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b144d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b14ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d54303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8a5c780 con 0x55b9e8b14a60 2023-09-13T09:53:57.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d36ffd700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d2c0a06c0 0x7f0d2c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d54303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8a5a0a0 con 0x55b9e8b15770 2023-09-13T09:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d54303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8a55990 con 0x55b9e8b160d0 2023-09-13T09:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b15b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d45eba700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b144d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d36ffd700 1 -- 172.21.15.6:0/1385777061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0d30014070 con 0x7f0d401004d0 2023-09-13T09:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b15b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36520/0 (socket says 172.21.15.6:36520) 2023-09-13T09:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 -- 172.21.15.6:0/2737324129 learned_addr learned my addr 172.21.15.6:0/2737324129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d456b9700 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b14ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 -- 172.21.15.6:0/2737324129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 msgr2=0x55b9e8b144d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b144d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 -- 172.21.15.6:0/2737324129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 msgr2=0x55b9e8b14ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b14ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.717+0000 7f0d466bb700 1 -- 172.21.15.6:0/2737324129 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9e88d5630 con 0x55b9e8b15770 2023-09-13T09:53:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.718+0000 7f0d456b9700 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b14ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:53:57.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.718+0000 7f0d45eba700 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.718+0000 7f0d466bb700 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b15b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d38011560 tx=0x7f0d38009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a893d231df4d1290 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.718+0000 7f0d466bb700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d2c0a06c0 0x7f0d2c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.718+0000 7f0d2bfff700 1 -- 172.21.15.6:0/2737324129 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3801f070 con 0x55b9e8b15770 2023-09-13T09:53:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.718+0000 7f0d2bfff700 1 -- 172.21.15.6:0/2737324129 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d38011050 con 0x55b9e8b15770 2023-09-13T09:53:57.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.718+0000 7f0d2bfff700 1 -- 172.21.15.6:0/2737324129 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3801ac00 con 0x55b9e8b15770 2023-09-13T09:53:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.719+0000 7f0d54303b80 1 -- 172.21.15.6:0/2737324129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 msgr2=0x55b9e8b15b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.719+0000 7f0d466bb700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d2c0a06c0 0x7f0d2c0a2b80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0d3801e000 tx=0x7f0d380196c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.719+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b15b90 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0d38011560 tx=0x7f0d38009920 comp rx=0 tx=0).stop 2023-09-13T09:53:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.721+0000 7f0d54303b80 1 -- 172.21.15.6:0/2737324129 shutdown_connections 2023-09-13T09:53:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.721+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b14ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.721+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b15b90 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.721+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2737324129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b144d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.721+0000 7f0d54303b80 1 -- 172.21.15.6:0/2737324129 >> 172.21.15.6:0/2737324129 conn(0x55b9e8a61c80 msgr2=0x55b9e8afdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.721+0000 7f0d54303b80 1 -- 172.21.15.6:0/2737324129 shutdown_connections 2023-09-13T09:53:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.721+0000 7f0d54303b80 1 -- 172.21.15.6:0/2737324129 wait complete. 2023-09-13T09:53:57.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 -- start start 2023-09-13T09:53:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 Processor -- start 2023-09-13T09:53:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b1df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b1e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e89f3bb0 con 0x55b9e8b15770 2023-09-13T09:53:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e89f38b0 con 0x55b9e8b14a60 2023-09-13T09:53:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e88d7920 con 0x55b9e8b160d0 2023-09-13T09:53:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d54303b80 10 client.0 _ll_register_callbacks cb 0x55b9e89f1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d456b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b1e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d45eba700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b1df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d45eba700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b1df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36526/0 (socket says 172.21.15.6:36526) 2023-09-13T09:53:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d45eba700 1 -- 172.21.15.6:0/2005906607 learned_addr learned my addr 172.21.15.6:0/2005906607 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.722+0000 7f0d456b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b1e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43002/0 (socket says 172.21.15.6:43002) 2023-09-13T09:53:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d456b9700 1 -- 172.21.15.6:0/2005906607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 msgr2=0x55b9e8b254c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d456b9700 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d456b9700 1 -- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 msgr2=0x55b9e8b1df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d456b9700 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b1df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d456b9700 1 -- 172.21.15.6:0/2005906607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d38011210 con 0x55b9e8b15770 2023-09-13T09:53:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d45eba700 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b1df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d456b9700 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b1e480 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0d300c98f0 tx=0x7f0d30099b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45d9b1a6970dfe5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d297fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d297fa700 1 -- 172.21.15.6:0/2005906607 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3009d410 con 0x55b9e8b15770 2023-09-13T09:53:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9e8af6670 con 0x55b9e8b15770 2023-09-13T09:53:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d297fa700 1 -- 172.21.15.6:0/2005906607 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0d300a1650 con 0x55b9e8b15770 2023-09-13T09:53:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d297fa700 1 -- 172.21.15.6:0/2005906607 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d300840f0 con 0x55b9e8b15770 2023-09-13T09:53:57.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d54303b80 10 client.19302 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.723+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55b9e8a6d7a0 con 0x55b9e8b15770 2023-09-13T09:53:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d297fa700 1 -- 172.21.15.6:0/2005906607 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d300b5080 con 0x55b9e8b15770 2023-09-13T09:53:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d297fa700 1 -- 172.21.15.6:0/2005906607 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0d30098540 con 0x55b9e8b15770 2023-09-13T09:53:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d54303b80 10 client.19302 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d54303b80 10 client.19302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:57.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d54303b80 20 client.19302 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b29d80 0x55b9e8b2c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d54303b80 4 client.19302 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9e8a4e970 con 0x55b9e8b29d80 2023-09-13T09:53:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d45eba700 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b29d80 0x55b9e8b2c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d297fa700 10 client.19302 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:57.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.724+0000 7f0d45eba700 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b29d80 0x55b9e8b2c1a0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11fac60085d368e server_cookie=9ea25c1ef014ec39 in_seq=0 out_seq=0 2023-09-13T09:53:57.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d297fa700 1 -- 172.21.15.6:0/2005906607 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b9e8a4e970 con 0x55b9e8b29d80 2023-09-13T09:53:57.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d297fa700 10 client.19302 handle_command_reply: tid=0 2023-09-13T09:53:57.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 client.19302 shutdown 2023-09-13T09:53:57.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 msgr2=0x55b9e8b1e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b1e480 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7f0d300c98f0 tx=0x7f0d30099b20 comp rx=0 tx=0).stop 2023-09-13T09:53:57.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 shutdown_connections 2023-09-13T09:53:57.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b254c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b1df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b29d80 0x55b9e8b2c1a0 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d54303b80 1 --2- 172.21.15.6:0/2005906607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b1e480 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.731+0000 7f0d297fa700 0 client.19302 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.732+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 >> 172.21.15.6:0/2005906607 conn(0x55b9e8a61c80 msgr2=0x55b9e8af87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.732+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 shutdown_connections 2023-09-13T09:53:57.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.732+0000 7f0d54303b80 1 -- 172.21.15.6:0/2005906607 wait complete. 2023-09-13T09:53:57.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.732+0000 7f0d54303b80 20 client.19302 trim_cache size 0 max 16384 2023-09-13T09:53:57.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 Processor -- start 2023-09-13T09:53:57.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 -- start start 2023-09-13T09:53:57.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b18990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b25480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b18ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8b1d3f0 con 0x55b9e8b14a60 2023-09-13T09:53:57.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8b1dab0 con 0x55b9e8b15770 2023-09-13T09:53:57.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d54303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8afffd0 con 0x55b9e8b160d0 2023-09-13T09:53:57.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.746+0000 7f0d45eba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b18990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b18990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43010/0 (socket says 172.21.15.6:43010) 2023-09-13T09:53:57.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 -- 172.21.15.6:0/1211546390 learned_addr learned my addr 172.21.15.6:0/1211546390 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d456b9700 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b25480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d466bb700 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b18ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 -- 172.21.15.6:0/1211546390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 msgr2=0x55b9e8b18ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b18ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 -- 172.21.15.6:0/1211546390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 msgr2=0x55b9e8b25480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b25480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 -- 172.21.15.6:0/1211546390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9e8881de0 con 0x55b9e8b14a60 2023-09-13T09:53:57.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d466bb700 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b18ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:57.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d45eba700 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b18990 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0058e0 tx=0x7f0d3c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=720ad57d8262ac00 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d34ff9700 1 -- 172.21.15.6:0/1211546390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c00b630 con 0x55b9e8b14a60 2023-09-13T09:53:57.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d34ff9700 1 -- 172.21.15.6:0/1211546390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d3c02c070 con 0x55b9e8b14a60 2023-09-13T09:53:57.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.747+0000 7f0d34ff9700 1 -- 172.21.15.6:0/1211546390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c0037d0 con 0x55b9e8b14a60 2023-09-13T09:53:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 -- 172.21.15.6:0/1211546390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 msgr2=0x55b9e8b18990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b18990 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c0058e0 tx=0x7f0d3c005040 comp rx=0 tx=0).stop 2023-09-13T09:53:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 -- 172.21.15.6:0/1211546390 shutdown_connections 2023-09-13T09:53:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b18ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b14a60 0x55b9e8b18990 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 --2- 172.21.15.6:0/1211546390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b15770 0x55b9e8b25480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 -- 172.21.15.6:0/1211546390 >> 172.21.15.6:0/1211546390 conn(0x55b9e8a61c80 msgr2=0x55b9e8afde60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 -- 172.21.15.6:0/1211546390 shutdown_connections 2023-09-13T09:53:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.748+0000 7f0d54303b80 1 -- 172.21.15.6:0/1211546390 wait complete. 2023-09-13T09:53:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 -- start start 2023-09-13T09:53:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 Processor -- start 2023-09-13T09:53:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b211e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b21720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b24740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8b24c80 con 0x55b9e8b15770 2023-09-13T09:53:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8b24df0 con 0x55b9e8b14a60 2023-09-13T09:53:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e8b24fb0 con 0x55b9e8b160d0 2023-09-13T09:53:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d54303b80 10 client.0 _ll_register_callbacks cb 0x55b9e8b154d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d456b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b21720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d456b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b21720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43016/0 (socket says 172.21.15.6:43016) 2023-09-13T09:53:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d456b9700 1 -- 172.21.15.6:0/173821896 learned_addr learned my addr 172.21.15.6:0/173821896 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:57.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d45eba700 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.749+0000 7f0d466bb700 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b24740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d456b9700 1 -- 172.21.15.6:0/173821896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 msgr2=0x55b9e8b24740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d456b9700 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b24740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d456b9700 1 -- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 msgr2=0x55b9e8b211e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:57.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d456b9700 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b211e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d456b9700 1 -- 172.21.15.6:0/173821896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d3c028ae0 con 0x55b9e8b15770 2023-09-13T09:53:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d456b9700 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b21720 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0d30099570 tx=0x7f0d300991d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f77f46afabfc9dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d297fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d297fa700 1 -- 172.21.15.6:0/173821896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300b1de0 con 0x55b9e8b15770 2023-09-13T09:53:57.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d297fa700 1 -- 172.21.15.6:0/173821896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0d300a1650 con 0x55b9e8b15770 2023-09-13T09:53:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0d38011050 con 0x55b9e8b15770 2023-09-13T09:53:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d297fa700 1 -- 172.21.15.6:0/173821896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0d3009d410 con 0x55b9e8b15770 2023-09-13T09:53:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d54303b80 10 client.19308 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55b9e886ac60 con 0x55b9e8b15770 2023-09-13T09:53:57.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.750+0000 7f0d297fa700 1 -- 172.21.15.6:0/173821896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0d38011050 con 0x55b9e8b15770 2023-09-13T09:53:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.751+0000 7f0d297fa700 1 -- 172.21.15.6:0/173821896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f0d3009e270 con 0x55b9e8b15770 2023-09-13T09:53:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.751+0000 7f0d54303b80 10 client.19308 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.751+0000 7f0d54303b80 10 client.19308 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.751+0000 7f0d54303b80 20 client.19308 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:57.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.751+0000 7f0d54303b80 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b7e920 0x55b9e8b80d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.751+0000 7f0d54303b80 4 client.19308 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:53:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.751+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b9e8a0f050 con 0x55b9e8b7e920 2023-09-13T09:53:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.752+0000 7f0d45eba700 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b7e920 0x55b9e8b80d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.753+0000 7f0d297fa700 10 client.19308 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:57.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.753+0000 7f0d45eba700 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b7e920 0x55b9e8b80d40 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=674cbf1aa1fb7f5d server_cookie=920e2eab79fda16f in_seq=0 out_seq=0 2023-09-13T09:53:57.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d297fa700 1 -- 172.21.15.6:0/173821896 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b9e8a0f050 con 0x55b9e8b7e920 2023-09-13T09:53:57.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d297fa700 10 client.19308 handle_command_reply: tid=0 2023-09-13T09:53:57.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 client.19308 shutdown 2023-09-13T09:53:57.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 msgr2=0x55b9e8b21720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b21720 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f0d30099570 tx=0x7f0d300991d0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 shutdown_connections 2023-09-13T09:53:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b9e8b160d0 0x55b9e8b24740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b9e8b14a60 0x55b9e8b211e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b9e8b7e920 0x55b9e8b80d40 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 --2- 172.21.15.6:0/173821896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b9e8b15770 0x55b9e8b21720 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d297fa700 0 client.19308 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 >> 172.21.15.6:0/173821896 conn(0x55b9e8a61c80 msgr2=0x55b9e8b18990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 shutdown_connections 2023-09-13T09:53:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 1 -- 172.21.15.6:0/173821896 wait complete. 2023-09-13T09:53:57.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.755+0000 7f0d54303b80 20 client.19308 trim_cache size 0 max 16384 2023-09-13T09:53:57.770 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:53:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d2c0a06c0 msgr2=0x7f0d2c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d2c0a06c0 0x7f0d2c0a2b80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0d3801e000 tx=0x7f0d380196c0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d401004d0 msgr2=0x7f0d40196f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d401004d0 0x7f0d40196f20 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f0d3000e9a0 tx=0x7f0d3000ecb0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 shutdown_connections 2023-09-13T09:53:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0d40100e70 0x7f0d4019df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d400ff2e0 0x7f0d401969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0d2c0a06c0 0x7f0d2c0a2b80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 --2- 172.21.15.6:0/1385777061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d401004d0 0x7f0d40196f20 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 >> 172.21.15.6:0/1385777061 conn(0x7f0d400fa850 msgr2=0x7f0d4010a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 shutdown_connections 2023-09-13T09:53:57.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:57.756+0000 7f0d4811e700 1 -- 172.21.15.6:0/1385777061 wait complete. 2023-09-13T09:53:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:58 smithi006 ceph-mon[98665]: pgmap v733: 97 pgs: 97 active+clean; 707 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 11 MiB/s wr, 876 op/s 2023-09-13T09:53:58.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:58 smithi053 ceph-mon[102373]: pgmap v733: 97 pgs: 97 active+clean; 707 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 11 MiB/s wr, 876 op/s 2023-09-13T09:53:58.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:58 smithi131 ceph-mon[102785]: pgmap v733: 97 pgs: 97 active+clean; 707 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 11 MiB/s wr, 876 op/s 2023-09-13T09:53:58.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 55397 40.50 MB/sec warmup 78 sec latency 54.149 ms 2023-09-13T09:53:58.777 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:53:58.777 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:53:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 -- 172.21.15.6:0/2419445328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a41008e0 msgr2=0x7f05a41081a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 --2- 172.21.15.6:0/2419445328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a41008e0 0x7f05a41081a0 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f059c00b0a0 tx=0x7f059c00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 -- 172.21.15.6:0/2419445328 shutdown_connections 2023-09-13T09:53:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 --2- 172.21.15.6:0/2419445328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a41008e0 0x7f05a41081a0 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 --2- 172.21.15.6:0/2419445328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a41012a0 0x7f05a41016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 --2- 172.21.15.6:0/2419445328 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a40fff40 0x7f05a41003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 -- 172.21.15.6:0/2419445328 >> 172.21.15.6:0/2419445328 conn(0x7f05a40fa9b0 msgr2=0x7f05a40fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 -- 172.21.15.6:0/2419445328 shutdown_connections 2023-09-13T09:53:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.934+0000 7f05ab273700 1 -- 172.21.15.6:0/2419445328 wait complete. 2023-09-13T09:53:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 Processor -- start 2023-09-13T09:53:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 -- start start 2023-09-13T09:53:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a40fff40 0x7f05a40ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a41008e0 0x7f05a419b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a41012a0 0x7f05a419df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a419e740 con 0x7f05a40fff40 2023-09-13T09:53:58.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a419e8b0 con 0x7f05a41012a0 2023-09-13T09:53:58.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05ab273700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a419ea70 con 0x7f05a41008e0 2023-09-13T09:53:58.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.935+0000 7f05a9810700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a41012a0 0x7f05a419df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a41012a0 0x7f05a419df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36552/0 (socket says 172.21.15.6:36552) 2023-09-13T09:53:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 -- 172.21.15.6:0/2759622373 learned_addr learned my addr 172.21.15.6:0/2759622373 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a900f700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a40fff40 0x7f05a40ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 -- 172.21.15.6:0/2759622373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a41008e0 msgr2=0x7f05a419b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:58.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a41008e0 0x7f05a419b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 -- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a40fff40 msgr2=0x7f05a40ff9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a40fff40 0x7f05a40ff9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 -- 172.21.15.6:0/2759622373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f059c009d00 con 0x7f05a41012a0 2023-09-13T09:53:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05a9810700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a41012a0 0x7f05a419df70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f059c00b780 tx=0x7f059c00bd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:58.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f059a7fc700 1 -- 172.21.15.6:0/2759622373 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c00e040 con 0x7f05a41012a0 2023-09-13T09:53:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.936+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05a419ecf0 con 0x7f05a41012a0 2023-09-13T09:53:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.937+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05a419f1c0 con 0x7f05a41012a0 2023-09-13T09:53:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.937+0000 7f059a7fc700 1 -- 172.21.15.6:0/2759622373 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f059c009b80 con 0x7f05a41012a0 2023-09-13T09:53:58.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.937+0000 7f059a7fc700 1 -- 172.21.15.6:0/2759622373 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0052a0 con 0x7f05a41012a0 2023-09-13T09:53:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.940+0000 7f059a7fc700 1 -- 172.21.15.6:0/2759622373 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f059c005400 con 0x7f05a41012a0 2023-09-13T09:53:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.940+0000 7f059a7fc700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05900a06c0 0x7f05900a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.941+0000 7f059a7fc700 1 -- 172.21.15.6:0/2759622373 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f059c0ce0d0 con 0x7f05a41012a0 2023-09-13T09:53:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.941+0000 7f05a900f700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05900a06c0 0x7f05900a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.941+0000 7f05b7458b80 1 Processor -- start 2023-09-13T09:53:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.941+0000 7f05b7458b80 1 -- start start 2023-09-13T09:53:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.941+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd70960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.941+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd70ea0 0x55581bd7e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.941+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd7e6a0 0x55581bd80a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05b7458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bcc9800 con 0x55581bd70ea0 2023-09-13T09:53:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05b7458b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bcc7120 con 0x55581bd70540 2023-09-13T09:53:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a900f700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05900a06c0 0x7f05900a2b80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f05a4068f60 tx=0x7f05a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05b7458b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bcc2a10 con 0x55581bd7e6a0 2023-09-13T09:53:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd70ea0 0x55581bd7e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd70ea0 0x55581bd7e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43040/0 (socket says 172.21.15.6:43040) 2023-09-13T09:53:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a900f700 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd70960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 -- 172.21.15.6:0/1310319983 learned_addr learned my addr 172.21.15.6:0/1310319983 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a9810700 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd7e6a0 0x55581bd80a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 -- 172.21.15.6:0/1310319983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd7e6a0 msgr2=0x55581bd80a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd7e6a0 0x55581bd80a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 -- 172.21.15.6:0/1310319983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 msgr2=0x55581bd70960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd70960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 -- 172.21.15.6:0/1310319983 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55581bb426b0 con 0x55581bd70ea0 2023-09-13T09:53:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a9810700 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd7e6a0 0x55581bd80a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:53:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a900f700 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd70960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f05a880e700 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd70ea0 0x55581bd7e160 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f059400bb60 tx=0x7f059400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b633e3d438986103 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.942+0000 7f058f7fe700 1 -- 172.21.15.6:0/1310319983 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0594004830 con 0x55581bd70ea0 2023-09-13T09:53:58.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f058f7fe700 1 -- 172.21.15.6:0/1310319983 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0594004e50 con 0x55581bd70ea0 2023-09-13T09:53:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f058f7fe700 1 -- 172.21.15.6:0/1310319983 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05940053e0 con 0x55581bd70ea0 2023-09-13T09:53:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 -- 172.21.15.6:0/1310319983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd70ea0 msgr2=0x55581bd7e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd70ea0 0x55581bd7e160 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7f059400bb60 tx=0x7f059400be70 comp rx=0 tx=0).stop 2023-09-13T09:53:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 -- 172.21.15.6:0/1310319983 shutdown_connections 2023-09-13T09:53:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd7e6a0 0x55581bd80a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd70960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1310319983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd70ea0 0x55581bd7e160 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 -- 172.21.15.6:0/1310319983 >> 172.21.15.6:0/1310319983 conn(0x55581bcced00 msgr2=0x55581bd6af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 -- 172.21.15.6:0/1310319983 shutdown_connections 2023-09-13T09:53:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.943+0000 7f05b7458b80 1 -- 172.21.15.6:0/1310319983 wait complete. 2023-09-13T09:53:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 -- start start 2023-09-13T09:53:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 Processor -- start 2023-09-13T09:53:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd82780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd82cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd89d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bc60c30 con 0x55581bd7e6a0 2023-09-13T09:53:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bc60930 con 0x55581bd70ea0 2023-09-13T09:53:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bb449a0 con 0x55581bd70540 2023-09-13T09:53:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05b7458b80 10 client.0 _ll_register_callbacks cb 0x55581bc5e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05a9810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd89d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05a9810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd89d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43046/0 (socket says 172.21.15.6:43046) 2023-09-13T09:53:58.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05a9810700 1 -- 172.21.15.6:0/3053925370 learned_addr learned my addr 172.21.15.6:0/3053925370 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05a880e700 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd82cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.944+0000 7f05a900f700 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd82780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05a9810700 1 -- 172.21.15.6:0/3053925370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 msgr2=0x55581bd82780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05a9810700 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd82780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05a9810700 1 -- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 msgr2=0x55581bd82cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05a9810700 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd82cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05a9810700 1 -- 172.21.15.6:0/3053925370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f059400b7c0 con 0x55581bd7e6a0 2023-09-13T09:53:58.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05a9810700 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd89d00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f059c007a60 tx=0x7f059c09b2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fedd59b170e5995f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:58.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f058cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:58.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f058cff9700 1 -- 172.21.15.6:0/3053925370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c09b900 con 0x55581bd7e6a0 2023-09-13T09:53:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55581bd636f0 con 0x55581bd7e6a0 2023-09-13T09:53:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f058cff9700 1 -- 172.21.15.6:0/3053925370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f059c0b0020 con 0x55581bd7e6a0 2023-09-13T09:53:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f058cff9700 1 -- 172.21.15.6:0/3053925370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f059c09f730 con 0x55581bd7e6a0 2023-09-13T09:53:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05b7458b80 10 client.19320 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:58.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.945+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55581bcda820 con 0x55581bd7e6a0 2023-09-13T09:53:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f058cff9700 1 -- 172.21.15.6:0/3053925370 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55581bd636f0 con 0x55581bd7e6a0 2023-09-13T09:53:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f058cff9700 1 -- 172.21.15.6:0/3053925370 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f059c0a3450 con 0x55581bd7e6a0 2023-09-13T09:53:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f05b7458b80 10 client.19320 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f05b7458b80 10 client.19320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f05b7458b80 20 client.19320 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bd8e350 0x55581bd90770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f05b7458b80 4 client.19320 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.946+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55581bcbb9f0 con 0x55581bd8e350 2023-09-13T09:53:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.947+0000 7f05a900f700 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bd8e350 0x55581bd90770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.948+0000 7f058cff9700 10 client.19320 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:58.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.948+0000 7f05a900f700 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bd8e350 0x55581bd90770 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8878ab3932aac72 server_cookie=7e2117d764c9084 in_seq=0 out_seq=0 2023-09-13T09:53:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f058cff9700 1 -- 172.21.15.6:0/3053925370 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55581bcbb9f0 con 0x55581bd8e350 2023-09-13T09:53:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f058cff9700 10 client.19320 handle_command_reply: tid=0 2023-09-13T09:53:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 client.19320 shutdown 2023-09-13T09:53:58.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 msgr2=0x55581bd89d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd89d00 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f059c007a60 tx=0x7f059c09b2e0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 shutdown_connections 2023-09-13T09:53:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bd8e350 0x55581bd90770 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd89d00 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f058cff9700 0 client.19320 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:58.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd82780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3053925370 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd82cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.951+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 >> 172.21.15.6:0/3053925370 conn(0x55581bcced00 msgr2=0x55581bd65870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.952+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 shutdown_connections 2023-09-13T09:53:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.952+0000 7f05b7458b80 1 -- 172.21.15.6:0/3053925370 wait complete. 2023-09-13T09:53:58.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.952+0000 7f05b7458b80 20 client.19320 trim_cache size 0 max 16384 2023-09-13T09:53:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.972+0000 7f05b7458b80 1 Processor -- start 2023-09-13T09:53:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05b7458b80 1 -- start start 2023-09-13T09:53:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd64960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70ea0 0x55581bd89cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd64ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05b7458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bd67960 con 0x55581bd7e6a0 2023-09-13T09:53:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05b7458b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bd83400 con 0x55581bd70540 2023-09-13T09:53:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05b7458b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bd7da60 con 0x55581bd70ea0 2023-09-13T09:53:58.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd64ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd64ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43054/0 (socket says 172.21.15.6:43054) 2023-09-13T09:53:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 -- 172.21.15.6:0/1866590235 learned_addr learned my addr 172.21.15.6:0/1866590235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a900f700 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd64960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a880e700 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70ea0 0x55581bd89cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 -- 172.21.15.6:0/1866590235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70ea0 msgr2=0x55581bd89cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70ea0 0x55581bd89cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 -- 172.21.15.6:0/1866590235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 msgr2=0x55581bd64960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd64960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 -- 172.21.15.6:0/1866590235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55581baeee60 con 0x55581bd7e6a0 2023-09-13T09:53:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.973+0000 7f05a9810700 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd64ea0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f059c009fd0 tx=0x7f059c0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf7e36bb90812a06 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:58.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f058ffff700 1 -- 172.21.15.6:0/1866590235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0b9b60 con 0x55581bd7e6a0 2023-09-13T09:53:58.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f058ffff700 1 -- 172.21.15.6:0/1866590235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f059c09b900 con 0x55581bd7e6a0 2023-09-13T09:53:58.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f058ffff700 1 -- 172.21.15.6:0/1866590235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c09a860 con 0x55581bd7e6a0 2023-09-13T09:53:58.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f05b7458b80 1 -- 172.21.15.6:0/1866590235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 msgr2=0x55581bd64ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:58.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd64ea0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f059c009fd0 tx=0x7f059c0099e0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f05b7458b80 1 -- 172.21.15.6:0/1866590235 shutdown_connections 2023-09-13T09:53:58.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bd64ea0 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70540 0x55581bd64960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f05b7458b80 1 --2- 172.21.15.6:0/1866590235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70ea0 0x55581bd89cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.974+0000 7f05b7458b80 1 -- 172.21.15.6:0/1866590235 >> 172.21.15.6:0/1866590235 conn(0x55581bcced00 msgr2=0x55581bd7a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:58.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.976+0000 7f05b7458b80 1 -- 172.21.15.6:0/1866590235 shutdown_connections 2023-09-13T09:53:58.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.976+0000 7f05b7458b80 1 -- 172.21.15.6:0/1866590235 wait complete. 2023-09-13T09:53:58.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.976+0000 7f05b7458b80 1 -- start start 2023-09-13T09:53:58.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.976+0000 7f05b7458b80 1 Processor -- start 2023-09-13T09:53:58.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd88cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd89200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bde21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bde26f0 con 0x55581bd7e6a0 2023-09-13T09:53:58.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bde2830 con 0x55581bd70ea0 2023-09-13T09:53:58.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55581bde29c0 con 0x55581bd70540 2023-09-13T09:53:58.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 10 client.0 _ll_register_callbacks cb 0x55581bc5e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:58.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bde21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a880e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd89200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bde21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43060/0 (socket says 172.21.15.6:43060) 2023-09-13T09:53:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 -- 172.21.15.6:0/3412776622 learned_addr learned my addr 172.21.15.6:0/3412776622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a900f700 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd88cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 -- 172.21.15.6:0/3412776622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 msgr2=0x55581bd88cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd88cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 -- 172.21.15.6:0/3412776622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 msgr2=0x55581bd89200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd89200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 -- 172.21.15.6:0/3412776622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55581bcda820 con 0x55581bd7e6a0 2023-09-13T09:53:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a900f700 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd88cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:58.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05a9810700 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bde21b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f059c098320 tx=0x7f059c097ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=992c6beb82131d3c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f058cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f058cff9700 1 -- 172.21.15.6:0/3412776622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f059c0b9b60 con 0x55581bd7e6a0 2023-09-13T09:53:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0594004e50 con 0x55581bd7e6a0 2023-09-13T09:53:58.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.977+0000 7f058cff9700 1 -- 172.21.15.6:0/3412776622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f059c0b0070 con 0x55581bd7e6a0 2023-09-13T09:53:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f058cff9700 1 -- 172.21.15.6:0/3412776622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f059c0a38e0 con 0x55581bd7e6a0 2023-09-13T09:53:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 10 client.19326 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55581bad7ce0 con 0x55581bd7e6a0 2023-09-13T09:53:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f058cff9700 1 -- 172.21.15.6:0/3412776622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f059c0a7080 con 0x55581bd7e6a0 2023-09-13T09:53:58.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f058cff9700 1 -- 172.21.15.6:0/3412776622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f059c09a980 con 0x55581bd7e6a0 2023-09-13T09:53:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 10 client.19326 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 10 client.19326 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 20 client.19326 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:58.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bde3ca0 0x55581bde60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:58.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 4 client.19326 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:53:58.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55581bc7c0d0 con 0x55581bde3ca0 2023-09-13T09:53:58.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.978+0000 7f05a900f700 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bde3ca0 0x55581bde60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:58.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.979+0000 7f058cff9700 10 client.19326 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:58.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.979+0000 7f05a900f700 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bde3ca0 0x55581bde60c0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d384f18a2c2c2fb server_cookie=996858c1bd9756fb in_seq=0 out_seq=0 2023-09-13T09:53:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f058cff9700 1 -- 172.21.15.6:0/3412776622 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55581bc7c0d0 con 0x55581bde3ca0 2023-09-13T09:53:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f058cff9700 10 client.19326 handle_command_reply: tid=0 2023-09-13T09:53:58.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 client.19326 shutdown 2023-09-13T09:53:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 msgr2=0x55581bde21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bde21b0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f059c098320 tx=0x7f059c097ad0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 shutdown_connections 2023-09-13T09:53:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55581bde3ca0 0x55581bde60c0 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55581bd7e6a0 0x55581bde21b0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55581bd70540 0x55581bd88cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 --2- 172.21.15.6:0/3412776622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55581bd70ea0 0x55581bd89200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 >> 172.21.15.6:0/3412776622 conn(0x55581bcced00 msgr2=0x55581bd6f530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f058cff9700 0 client.19326 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 shutdown_connections 2023-09-13T09:53:58.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 1 -- 172.21.15.6:0/3412776622 wait complete. 2023-09-13T09:53:58.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.985+0000 7f05b7458b80 20 client.19326 trim_cache size 0 max 16384 2023-09-13T09:53:58.998 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:53:58.998 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:53:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "dc5fb05d-38ce-4f16-b152-1ae7b5de9c24", 2023-09-13T09:53:58.999 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:53:58.999 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:53:59.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05900a06c0 msgr2=0x7f05900a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05900a06c0 0x7f05900a2b80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f05a4068f60 tx=0x7f05a0009260 comp rx=0 tx=0).stop 2023-09-13T09:53:59.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a41012a0 msgr2=0x7f05a419df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a41012a0 0x7f05a419df70 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f059c00b780 tx=0x7f059c00bd60 comp rx=0 tx=0).stop 2023-09-13T09:53:59.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 shutdown_connections 2023-09-13T09:53:59.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f05a41012a0 0x7f05a419df70 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f05900a06c0 0x7f05900a2b80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05a40fff40 0x7f05a40ff9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 --2- 172.21.15.6:0/2759622373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f05a41008e0 0x7f05a419b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 >> 172.21.15.6:0/2759622373 conn(0x7f05a40fa9b0 msgr2=0x7f05a41043e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:59.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 shutdown_connections 2023-09-13T09:53:59.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:58.986+0000 7f05ab273700 1 -- 172.21.15.6:0/2759622373 wait complete. 2023-09-13T09:53:59.003 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:53:59.106 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:53:59 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:53:59.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 -- 172.21.15.6:0/2233976038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 msgr2=0x7fa7fc101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 --2- 172.21.15.6:0/2233976038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc101a40 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0098f0 tx=0x7fa7ec009c00 comp rx=0 tx=0).stop 2023-09-13T09:53:59.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 -- 172.21.15.6:0/2233976038 shutdown_connections 2023-09-13T09:53:59.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 --2- 172.21.15.6:0/2233976038 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7fc104950 0x7fa7fc104dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 --2- 172.21.15.6:0/2233976038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc101a40 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 --2- 172.21.15.6:0/2233976038 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7fc101f80 0x7fa7fc104410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 -- 172.21.15.6:0/2233976038 >> 172.21.15.6:0/2233976038 conn(0x7fa7fc0fb1f0 msgr2=0x7fa7fc0fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 -- 172.21.15.6:0/2233976038 shutdown_connections 2023-09-13T09:53:59.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.173+0000 7fa801068700 1 -- 172.21.15.6:0/2233976038 wait complete. 2023-09-13T09:53:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.174+0000 7fa801068700 1 Processor -- start 2023-09-13T09:53:59.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.174+0000 7fa801068700 1 -- start start 2023-09-13T09:53:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa801068700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc19d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa801068700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7fc101f80 0x7fa7fc19d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa801068700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7fc104950 0x7fa7fc1a4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa801068700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1a4c30 con 0x7fa7fc104950 2023-09-13T09:53:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa801068700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1a4d70 con 0x7fa7fc101f80 2023-09-13T09:53:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa801068700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7fc1a4f00 con 0x7fa7fc0ff610 2023-09-13T09:53:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc19d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7fc104950 0x7fa7fc1a4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc19d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46124/0 (socket says 172.21.15.6:46124) 2023-09-13T09:53:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 -- 172.21.15.6:0/3655356101 learned_addr learned my addr 172.21.15.6:0/3655356101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7fc101f80 0x7fa7fc19d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 -- 172.21.15.6:0/3655356101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7fc101f80 msgr2=0x7fa7fc19d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7fc101f80 0x7fa7fc19d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 -- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7fc104950 msgr2=0x7fa7fc1a4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7fc104950 0x7fa7fc1a4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fad9d700 1 -- 172.21.15.6:0/3655356101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7ec009520 con 0x7fa7fc0ff610 2023-09-13T09:53:59.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.175+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7fc104950 0x7fa7fc1a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.176+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc19d0b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009230 tx=0x7fa7ec00b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.176+0000 7fa7e3fff700 1 -- 172.21.15.6:0/3655356101 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec01c070 con 0x7fa7fc0ff610 2023-09-13T09:53:59.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.176+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7fc1a5180 con 0x7fa7fc0ff610 2023-09-13T09:53:59.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.176+0000 7fa7e3fff700 1 -- 172.21.15.6:0/3655356101 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7ec00f840 con 0x7fa7fc0ff610 2023-09-13T09:53:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.176+0000 7fa7e3fff700 1 -- 172.21.15.6:0/3655356101 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec003a00 con 0x7fa7fc0ff610 2023-09-13T09:53:59.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.176+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7fc1a5600 con 0x7fa7fc0ff610 2023-09-13T09:53:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.179+0000 7fa7e3fff700 1 -- 172.21.15.6:0/3655356101 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa7ec020030 con 0x7fa7fc0ff610 2023-09-13T09:53:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.179+0000 7fa7e3fff700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa7e40a0640 0x7fa7e40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.180+0000 7fa7e3fff700 1 -- 172.21.15.6:0/3655356101 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa7ec0ccbc0 con 0x7fa7fc0ff610 2023-09-13T09:53:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.180+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa7e40a0640 0x7fa7e40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.180+0000 7fa80d24db80 1 Processor -- start 2023-09-13T09:53:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa80d24db80 1 -- start start 2023-09-13T09:53:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd72eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72f060 0x55f5dd72d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd72de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa80d24db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd686780 con 0x55f5dd72da00 2023-09-13T09:53:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa80d24db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd6840a0 con 0x55f5dd72f060 2023-09-13T09:53:59.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa80d24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd67f990 con 0x55f5dd72e700 2023-09-13T09:53:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa7e40a0640 0x7fa7e40a2b00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005fd0 tx=0x7fa7f0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd72de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd72de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43080/0 (socket says 172.21.15.6:43080) 2023-09-13T09:53:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 -- 172.21.15.6:0/1716140134 learned_addr learned my addr 172.21.15.6:0/1716140134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:59.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd72eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72f060 0x55f5dd72d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 -- 172.21.15.6:0/1716140134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 msgr2=0x55f5dd72eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd72eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 -- 172.21.15.6:0/1716140134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72f060 msgr2=0x55f5dd72d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72f060 0x55f5dd72d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fb59e700 1 -- 172.21.15.6:0/1716140134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5dd4ff630 con 0x55f5dd72da00 2023-09-13T09:53:59.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.181+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd72eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:53:59.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.182+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd72de80 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4003eb0 tx=0x7fa7f4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3719d7f326fac2b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:59.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.182+0000 7fa7e17fa700 1 -- 172.21.15.6:0/1716140134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f40092d0 con 0x55f5dd72da00 2023-09-13T09:53:59.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.182+0000 7fa7e17fa700 1 -- 172.21.15.6:0/1716140134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7f400f040 con 0x55f5dd72da00 2023-09-13T09:53:59.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.182+0000 7fa7e17fa700 1 -- 172.21.15.6:0/1716140134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400e820 con 0x55f5dd72da00 2023-09-13T09:53:59.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.183+0000 7fa80d24db80 1 -- 172.21.15.6:0/1716140134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 msgr2=0x55f5dd72de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.183+0000 7fa80d24db80 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd72de80 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4003eb0 tx=0x7fa7f4009920 comp rx=0 tx=0).stop 2023-09-13T09:53:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 -- 172.21.15.6:0/1716140134 shutdown_connections 2023-09-13T09:53:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd72de80 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd72eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 --2- 172.21.15.6:0/1716140134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72f060 0x55f5dd72d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 -- 172.21.15.6:0/1716140134 >> 172.21.15.6:0/1716140134 conn(0x55f5dd68bc80 msgr2=0x55f5dd727f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:59.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 -- 172.21.15.6:0/1716140134 shutdown_connections 2023-09-13T09:53:59.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 -- 172.21.15.6:0/1716140134 wait complete. 2023-09-13T09:53:59.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 -- start start 2023-09-13T09:53:59.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.184+0000 7fa80d24db80 1 Processor -- start 2023-09-13T09:53:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd736f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd737470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72f060 0x55f5dd73e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa80d24db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd61dbb0 con 0x55f5dd72da00 2023-09-13T09:53:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa80d24db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd61d8b0 con 0x55f5dd72e700 2023-09-13T09:53:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa80d24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd501920 con 0x55f5dd72f060 2023-09-13T09:53:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa80d24db80 10 client.0 _ll_register_callbacks cb 0x55f5dd61b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:59.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd737470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd736f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd737470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36610/0 (socket says 172.21.15.6:36610) 2023-09-13T09:53:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fa59c700 1 -- 172.21.15.6:0/3024569150 learned_addr learned my addr 172.21.15.6:0/3024569150 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd736f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43084/0 (socket says 172.21.15.6:43084) 2023-09-13T09:53:59.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72f060 0x55f5dd73e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fad9d700 1 -- 172.21.15.6:0/3024569150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72f060 msgr2=0x55f5dd73e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72f060 0x55f5dd73e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fad9d700 1 -- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 msgr2=0x55f5dd737470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd737470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fad9d700 1 -- 172.21.15.6:0/3024569150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f4003b90 con 0x55f5dd72da00 2023-09-13T09:53:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.185+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd737470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd736f30 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0ca670 tx=0x7fa7ec099f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fb0cea342e72e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa7deff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:59.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa7deff5700 1 -- 172.21.15.6:0/3024569150 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ec09e020 con 0x55f5dd72da00 2023-09-13T09:53:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa7deff5700 1 -- 172.21.15.6:0/3024569150 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa7ec021380 con 0x55f5dd72da00 2023-09-13T09:53:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f5dd720670 con 0x55f5dd72da00 2023-09-13T09:53:59.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa7deff5700 1 -- 172.21.15.6:0/3024569150 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7ec09aaf0 con 0x55f5dd72da00 2023-09-13T09:53:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 10 client.19338 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55f5dd6977a0 con 0x55f5dd72da00 2023-09-13T09:53:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa7deff5700 1 -- 172.21.15.6:0/3024569150 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f5dd720670 con 0x55f5dd72da00 2023-09-13T09:53:59.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa7deff5700 1 -- 172.21.15.6:0/3024569150 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa7ec0a00b0 con 0x55f5dd72da00 2023-09-13T09:53:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 10 client.19338 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 10 client.19338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 20 client.19338 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:59.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd742980 0x55f5dd744da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 4 client.19338 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:53:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.186+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f5dd678970 con 0x55f5dd742980 2023-09-13T09:53:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.188+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd742980 0x55f5dd744da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.189+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd742980 0x55f5dd744da0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c32224aae0a5732 server_cookie=de30d64eb7cbd43d in_seq=0 out_seq=0 2023-09-13T09:53:59.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.189+0000 7fa7deff5700 10 client.19338 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa7deff5700 1 -- 172.21.15.6:0/3024569150 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f5dd678970 con 0x55f5dd742980 2023-09-13T09:53:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa7deff5700 10 client.19338 handle_command_reply: tid=0 2023-09-13T09:53:59.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 client.19338 shutdown 2023-09-13T09:53:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 msgr2=0x55f5dd736f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd736f30 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec0ca670 tx=0x7fa7ec099f30 comp rx=0 tx=0).stop 2023-09-13T09:53:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 shutdown_connections 2023-09-13T09:53:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72f060 0x55f5dd73e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd742980 0x55f5dd744da0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72da00 0x55f5dd736f30 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa7deff5700 0 client.19338 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 --2- 172.21.15.6:0/3024569150 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd737470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 >> 172.21.15.6:0/3024569150 conn(0x55f5dd68bc80 msgr2=0x55f5dd727ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 shutdown_connections 2023-09-13T09:53:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 1 -- 172.21.15.6:0/3024569150 wait complete. 2023-09-13T09:53:59.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.192+0000 7fa80d24db80 20 client.19338 trim_cache size 0 max 16384 2023-09-13T09:53:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 Processor -- start 2023-09-13T09:53:59.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 -- start start 2023-09-13T09:53:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72da00 0x55f5dd72d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd73e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd736ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd728df0 con 0x55f5dd72f060 2023-09-13T09:53:59.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd736aa0 con 0x55f5dd72da00 2023-09-13T09:53:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.217+0000 7fa80d24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd72a000 con 0x55f5dd72e700 2023-09-13T09:53:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd736ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd73e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72da00 0x55f5dd72d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd736ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43096/0 (socket says 172.21.15.6:43096) 2023-09-13T09:53:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd73e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46148/0 (socket says 172.21.15.6:46148) 2023-09-13T09:53:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 -- 172.21.15.6:0/138483700 learned_addr learned my addr 172.21.15.6:0/138483700 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 -- 172.21.15.6:0/138483700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 msgr2=0x55f5dd73e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/138483700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd73e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 -- 172.21.15.6:0/138483700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72da00 msgr2=0x55f5dd72d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/138483700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72da00 0x55f5dd72d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 -- 172.21.15.6:0/138483700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f5dd749990 con 0x55f5dd72f060 2023-09-13T09:53:59.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/138483700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd736ce0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4000f80 tx=0x7fa7f4009e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fecf4fd1bdcfc97 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.218+0000 7fa7e1ffb700 1 -- 172.21.15.6:0/138483700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4009350 con 0x55f5dd72f060 2023-09-13T09:53:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.219+0000 7fa7e1ffb700 1 -- 172.21.15.6:0/138483700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7f4007500 con 0x55f5dd72f060 2023-09-13T09:53:59.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.219+0000 7fa7e1ffb700 1 -- 172.21.15.6:0/138483700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f400e730 con 0x55f5dd72f060 2023-09-13T09:53:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.219+0000 7fa80d24db80 1 -- 172.21.15.6:0/138483700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 msgr2=0x55f5dd736ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.219+0000 7fa80d24db80 1 --2- 172.21.15.6:0/138483700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd736ce0 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4000f80 tx=0x7fa7f4009e50 comp rx=0 tx=0).stop 2023-09-13T09:53:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 -- 172.21.15.6:0/138483700 shutdown_connections 2023-09-13T09:53:59.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 --2- 172.21.15.6:0/138483700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd736ce0 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 --2- 172.21.15.6:0/138483700 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72da00 0x55f5dd72d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 --2- 172.21.15.6:0/138483700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72e700 0x55f5dd73e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 -- 172.21.15.6:0/138483700 >> 172.21.15.6:0/138483700 conn(0x55f5dd68bc80 msgr2=0x55f5dd7318e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 -- 172.21.15.6:0/138483700 shutdown_connections 2023-09-13T09:53:59.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 -- 172.21.15.6:0/138483700 wait complete. 2023-09-13T09:53:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 -- start start 2023-09-13T09:53:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.220+0000 7fa80d24db80 1 Processor -- start 2023-09-13T09:53:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72da00 0x55f5dd73a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd73a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa80d24db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd73d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa80d24db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd73dda0 con 0x55f5dd72f060 2023-09-13T09:53:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa80d24db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd73df10 con 0x55f5dd72e700 2023-09-13T09:53:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa80d24db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f5dd73e0d0 con 0x55f5dd72da00 2023-09-13T09:53:59.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa80d24db80 10 client.0 _ll_register_callbacks cb 0x55f5dd728570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:53:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd73a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72da00 0x55f5dd73a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fa59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd73a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36624/0 (socket says 172.21.15.6:36624) 2023-09-13T09:53:59.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fa59c700 1 -- 172.21.15.6:0/2579572608 learned_addr learned my addr 172.21.15.6:0/2579572608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:53:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72da00 0x55f5dd73a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46152/0 (socket says 172.21.15.6:46152) 2023-09-13T09:53:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd73d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fb59e700 1 -- 172.21.15.6:0/2579572608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72da00 msgr2=0x55f5dd73a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72da00 0x55f5dd73a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fb59e700 1 -- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 msgr2=0x55f5dd73a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:53:59.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd73a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fb59e700 1 -- 172.21.15.6:0/2579572608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f5dd4ff630 con 0x55f5dd72f060 2023-09-13T09:53:59.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fa59c700 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd73a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:53:59.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7fb59e700 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd73d860 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4000f80 tx=0x7fa7f4004cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca321907154d30ea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:53:59.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.221+0000 7fa7deff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:53:59.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.222+0000 7fa7deff5700 1 -- 172.21.15.6:0/2579572608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f4007a80 con 0x55f5dd72f060 2023-09-13T09:53:59.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.222+0000 7fa7deff5700 1 -- 172.21.15.6:0/2579572608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa7f400e4f0 con 0x55f5dd72f060 2023-09-13T09:53:59.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.222+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7f400f040 con 0x55f5dd72f060 2023-09-13T09:53:59.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa7deff5700 1 -- 172.21.15.6:0/2579572608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7f400e6b0 con 0x55f5dd72f060 2023-09-13T09:53:59.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 10 client.19344 fetch_fsmap learned FSMap version 47 2023-09-13T09:53:59.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55f5dd4abde0 con 0x55f5dd72f060 2023-09-13T09:53:59.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa7deff5700 1 -- 172.21.15.6:0/2579572608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa7f400f040 con 0x55f5dd72f060 2023-09-13T09:53:59.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa7deff5700 1 -- 172.21.15.6:0/2579572608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa7f4015790 con 0x55f5dd72f060 2023-09-13T09:53:59.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 10 client.19344 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:53:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 10 client.19344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:53:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 20 client.19344 populate_metadata read hostname 'smithi006' 2023-09-13T09:53:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd797650 0x55f5dd799a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:53:59.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 4 client.19344 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:53:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.223+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f5dd639050 con 0x55f5dd797650 2023-09-13T09:53:59.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.225+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd797650 0x55f5dd799a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:53:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.227+0000 7fa7deff5700 10 client.19344 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:59.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.227+0000 7fa7fad9d700 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd797650 0x55f5dd799a70 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8059aac4fc86970 server_cookie=55593d0d560b2e4 in_seq=0 out_seq=0 2023-09-13T09:53:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa7deff5700 1 -- 172.21.15.6:0/2579572608 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55f5dd639050 con 0x55f5dd797650 2023-09-13T09:53:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa7deff5700 10 client.19344 handle_command_reply: tid=0 2023-09-13T09:53:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 client.19344 shutdown 2023-09-13T09:53:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 msgr2=0x55f5dd73d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd73d860 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fa7f4000f80 tx=0x7fa7f4004cc0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 shutdown_connections 2023-09-13T09:53:59.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f5dd797650 0x55f5dd799a70 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f5dd72f060 0x55f5dd73d860 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa7deff5700 0 client.19344 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:53:59.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f5dd72da00 0x55f5dd73a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 --2- 172.21.15.6:0/2579572608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f5dd72e700 0x55f5dd73a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 >> 172.21.15.6:0/2579572608 conn(0x55f5dd68bc80 msgr2=0x55f5dd736ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:59.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 shutdown_connections 2023-09-13T09:53:59.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 1 -- 172.21.15.6:0/2579572608 wait complete. 2023-09-13T09:53:59.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.230+0000 7fa80d24db80 20 client.19344 trim_cache size 0 max 16384 2023-09-13T09:53:59.244 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:53:59.244 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (60 inodes in the stack)", 2023-09-13T09:53:59.244 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:53:59.245 INFO:teuthology.orchestra.run.smithi006.stdout: "dc5fb05d-38ce-4f16-b152-1ae7b5de9c24": { 2023-09-13T09:53:59.245 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:53:59.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "dc5fb05d-38ce-4f16-b152-1ae7b5de9c24", 2023-09-13T09:53:59.246 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:53:59.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:53:59.246 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:53:59.246 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:53:59.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa7e40a0640 msgr2=0x7fa7e40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa7e40a0640 0x7fa7e40a2b00 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fa7f0005fd0 tx=0x7fa7f0009310 comp rx=0 tx=0).stop 2023-09-13T09:53:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 msgr2=0x7fa7fc19d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:53:59.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc19d0b0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa7ec009230 tx=0x7fa7ec00b790 comp rx=0 tx=0).stop 2023-09-13T09:53:59.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 shutdown_connections 2023-09-13T09:53:59.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa7e40a0640 0x7fa7e40a2b00 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7fc104950 0x7fa7fc1a4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7fc0ff610 0x7fa7fc19d0b0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 --2- 172.21.15.6:0/3655356101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa7fc101f80 0x7fa7fc19d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:53:59.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 >> 172.21.15.6:0/3655356101 conn(0x7fa7fc0fb1f0 msgr2=0x7fa7fc102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:53:59.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 shutdown_connections 2023-09-13T09:53:59.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:53:59.231+0000 7fa801068700 1 -- 172.21.15.6:0/3655356101 wait complete. 2023-09-13T09:53:59.252 INFO:tasks.cephfs.filesystem:scrub status for tag:dc5fb05d-38ce-4f16-b152-1ae7b5de9c24 - {'path': '/', 'tag': 'dc5fb05d-38ce-4f16-b152-1ae7b5de9c24', 'options': 'recursive,force'} 2023-09-13T09:53:59.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:53:59 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:53:59.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:53:59 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:53:59.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 56138 40.47 MB/sec warmup 79 sec latency 77.916 ms 2023-09-13T09:54:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: pgmap v734: 97 pgs: 97 active+clean; 713 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 10 MiB/s wr, 840 op/s 2023-09-13T09:54:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:54:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:00.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:00 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: pgmap v734: 97 pgs: 97 active+clean; 713 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 10 MiB/s wr, 840 op/s 2023-09-13T09:54:00.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:54:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:00.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:00 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: pgmap v734: 97 pgs: 97 active+clean; 713 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 10 MiB/s wr, 840 op/s 2023-09-13T09:54:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:54:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:00.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:00 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:00.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 56809 40.47 MB/sec warmup 80 sec latency 165.314 ms 2023-09-13T09:54:01.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:01 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:01.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:01 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:01.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:01 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:01.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 57539 40.46 MB/sec warmup 81 sec latency 111.798 ms 2023-09-13T09:54:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:02 smithi006 ceph-mon[98665]: pgmap v735: 97 pgs: 97 active+clean; 715 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 10 MiB/s wr, 804 op/s 2023-09-13T09:54:02.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:02 smithi053 ceph-mon[102373]: pgmap v735: 97 pgs: 97 active+clean; 715 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 10 MiB/s wr, 804 op/s 2023-09-13T09:54:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:02 smithi131 ceph-mon[102785]: pgmap v735: 97 pgs: 97 active+clean; 715 MiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 10 MiB/s wr, 804 op/s 2023-09-13T09:54:02.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 58245 40.51 MB/sec warmup 82 sec latency 77.649 ms 2023-09-13T09:54:03.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 58963 40.28 MB/sec warmup 83 sec latency 59.914 ms 2023-09-13T09:54:04.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:04 smithi006 ceph-mon[98665]: pgmap v736: 97 pgs: 97 active+clean; 717 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 844 op/s 2023-09-13T09:54:04.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:04 smithi053 ceph-mon[102373]: pgmap v736: 97 pgs: 97 active+clean; 717 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 844 op/s 2023-09-13T09:54:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:04 smithi131 ceph-mon[102785]: pgmap v736: 97 pgs: 97 active+clean; 717 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 844 op/s 2023-09-13T09:54:04.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 59834 40.46 MB/sec warmup 84 sec latency 149.100 ms 2023-09-13T09:54:05.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 60557 40.41 MB/sec warmup 85 sec latency 209.637 ms 2023-09-13T09:54:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:06 smithi006 ceph-mon[98665]: pgmap v737: 97 pgs: 97 active+clean; 729 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 849 op/s 2023-09-13T09:54:06.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:06 smithi053 ceph-mon[102373]: pgmap v737: 97 pgs: 97 active+clean; 729 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 849 op/s 2023-09-13T09:54:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:06 smithi131 ceph-mon[102785]: pgmap v737: 97 pgs: 97 active+clean; 729 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 849 op/s 2023-09-13T09:54:06.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 61291 40.44 MB/sec warmup 86 sec latency 44.695 ms 2023-09-13T09:54:07.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 62024 40.42 MB/sec warmup 87 sec latency 70.711 ms 2023-09-13T09:54:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:08 smithi006 ceph-mon[98665]: pgmap v738: 97 pgs: 97 active+clean; 739 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 825 op/s 2023-09-13T09:54:08.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:08 smithi053 ceph-mon[102373]: pgmap v738: 97 pgs: 97 active+clean; 739 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 825 op/s 2023-09-13T09:54:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:08 smithi131 ceph-mon[102785]: pgmap v738: 97 pgs: 97 active+clean; 739 MiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 825 op/s 2023-09-13T09:54:08.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 62833 40.49 MB/sec warmup 88 sec latency 67.429 ms 2023-09-13T09:54:09.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 63698 40.50 MB/sec warmup 89 sec latency 73.511 ms 2023-09-13T09:54:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:10 smithi006 ceph-mon[98665]: pgmap v739: 97 pgs: 97 active+clean; 747 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.5 MiB/s wr, 778 op/s 2023-09-13T09:54:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:10.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:10 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:10 smithi053 ceph-mon[102373]: pgmap v739: 97 pgs: 97 active+clean; 747 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.5 MiB/s wr, 778 op/s 2023-09-13T09:54:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:10.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:10.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:10.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:10.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:10 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:10 smithi131 ceph-mon[102785]: pgmap v739: 97 pgs: 97 active+clean; 747 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.5 MiB/s wr, 778 op/s 2023-09-13T09:54:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:10.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:10.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:10.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:10.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:10 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:10.556 INFO:tasks.workunit.client.0.smithi006.stdout: 10 64315 40.47 MB/sec warmup 90 sec latency 187.450 ms 2023-09-13T09:54:11.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 65024 40.45 MB/sec warmup 91 sec latency 58.527 ms 2023-09-13T09:54:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:12 smithi006 ceph-mon[98665]: pgmap v740: 97 pgs: 97 active+clean; 748 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.1 MiB/s wr, 697 op/s 2023-09-13T09:54:12.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:12 smithi053 ceph-mon[102373]: pgmap v740: 97 pgs: 97 active+clean; 748 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.1 MiB/s wr, 697 op/s 2023-09-13T09:54:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:12 smithi131 ceph-mon[102785]: pgmap v740: 97 pgs: 97 active+clean; 748 MiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.1 MiB/s wr, 697 op/s 2023-09-13T09:54:12.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 65830 40.47 MB/sec warmup 92 sec latency 41.612 ms 2023-09-13T09:54:13.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 66704 40.49 MB/sec warmup 93 sec latency 43.603 ms 2023-09-13T09:54:14.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:14 smithi006 ceph-mon[98665]: pgmap v741: 97 pgs: 97 active+clean; 756 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 783 op/s 2023-09-13T09:54:14.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:14 smithi053 ceph-mon[102373]: pgmap v741: 97 pgs: 97 active+clean; 756 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 783 op/s 2023-09-13T09:54:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:14 smithi131 ceph-mon[102785]: pgmap v741: 97 pgs: 97 active+clean; 756 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 783 op/s 2023-09-13T09:54:14.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 67684 40.60 MB/sec warmup 94 sec latency 49.673 ms 2023-09-13T09:54:15.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:15 smithi053 ceph-mon[102373]: pgmap v742: 97 pgs: 97 active+clean; 763 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 882 op/s 2023-09-13T09:54:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:15 smithi006 ceph-mon[98665]: pgmap v742: 97 pgs: 97 active+clean; 763 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 882 op/s 2023-09-13T09:54:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:15 smithi131 ceph-mon[102785]: pgmap v742: 97 pgs: 97 active+clean; 763 MiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 882 op/s 2023-09-13T09:54:15.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 68402 40.67 MB/sec warmup 95 sec latency 194.410 ms 2023-09-13T09:54:16.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 69040 40.67 MB/sec warmup 96 sec latency 78.655 ms 2023-09-13T09:54:17.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 69764 40.51 MB/sec warmup 97 sec latency 52.793 ms 2023-09-13T09:54:18.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:17 smithi006 ceph-mon[98665]: pgmap v743: 97 pgs: 97 active+clean; 769 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 820 op/s 2023-09-13T09:54:18.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:17 smithi053 ceph-mon[102373]: pgmap v743: 97 pgs: 97 active+clean; 769 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 820 op/s 2023-09-13T09:54:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:17 smithi131 ceph-mon[102785]: pgmap v743: 97 pgs: 97 active+clean; 769 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 820 op/s 2023-09-13T09:54:18.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 70649 40.62 MB/sec warmup 98 sec latency 73.210 ms 2023-09-13T09:54:19.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 71643 40.69 MB/sec warmup 99 sec latency 80.809 ms 2023-09-13T09:54:20.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:19 smithi053 ceph-mon[102373]: pgmap v744: 97 pgs: 97 active+clean; 774 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 821 op/s 2023-09-13T09:54:20.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:19 smithi006 ceph-mon[98665]: pgmap v744: 97 pgs: 97 active+clean; 774 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 821 op/s 2023-09-13T09:54:20.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:19 smithi131 ceph-mon[102785]: pgmap v744: 97 pgs: 97 active+clean; 774 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 821 op/s 2023-09-13T09:54:20.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 72243 40.66 MB/sec warmup 100 sec latency 250.730 ms 2023-09-13T09:54:21.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 72905 40.68 MB/sec warmup 101 sec latency 180.963 ms 2023-09-13T09:54:22.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:21 smithi006 ceph-mon[98665]: pgmap v745: 97 pgs: 97 active+clean; 776 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 739 op/s 2023-09-13T09:54:22.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:21 smithi053 ceph-mon[102373]: pgmap v745: 97 pgs: 97 active+clean; 776 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 739 op/s 2023-09-13T09:54:22.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:21 smithi131 ceph-mon[102785]: pgmap v745: 97 pgs: 97 active+clean; 776 MiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 739 op/s 2023-09-13T09:54:22.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 73603 40.62 MB/sec warmup 102 sec latency 54.414 ms 2023-09-13T09:54:23.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 74519 40.69 MB/sec warmup 103 sec latency 61.988 ms 2023-09-13T09:54:24.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:23 smithi006 ceph-mon[98665]: pgmap v746: 97 pgs: 97 active+clean; 785 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 857 op/s 2023-09-13T09:54:24.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:23 smithi053 ceph-mon[102373]: pgmap v746: 97 pgs: 97 active+clean; 785 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 857 op/s 2023-09-13T09:54:24.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:23 smithi131 ceph-mon[102785]: pgmap v746: 97 pgs: 97 active+clean; 785 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 857 op/s 2023-09-13T09:54:24.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 75382 40.73 MB/sec warmup 104 sec latency 56.283 ms 2023-09-13T09:54:25.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 76040 40.74 MB/sec warmup 105 sec latency 182.735 ms 2023-09-13T09:54:26.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:25 smithi006 ceph-mon[98665]: pgmap v747: 97 pgs: 97 active+clean; 794 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 892 op/s 2023-09-13T09:54:26.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:25 smithi053 ceph-mon[102373]: pgmap v747: 97 pgs: 97 active+clean; 794 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 892 op/s 2023-09-13T09:54:26.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:25 smithi131 ceph-mon[102785]: pgmap v747: 97 pgs: 97 active+clean; 794 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 892 op/s 2023-09-13T09:54:26.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 76577 40.53 MB/sec warmup 106 sec latency 214.497 ms 2023-09-13T09:54:27.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 77532 40.67 MB/sec warmup 107 sec latency 49.471 ms 2023-09-13T09:54:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:27 smithi006 ceph-mon[98665]: pgmap v748: 97 pgs: 97 active+clean; 795 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 835 op/s 2023-09-13T09:54:28.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:27 smithi053 ceph-mon[102373]: pgmap v748: 97 pgs: 97 active+clean; 795 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 835 op/s 2023-09-13T09:54:28.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:27 smithi131 ceph-mon[102785]: pgmap v748: 97 pgs: 97 active+clean; 795 MiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 835 op/s 2023-09-13T09:54:28.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 78398 40.72 MB/sec warmup 108 sec latency 46.903 ms 2023-09-13T09:54:29.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:54:29.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 -- 172.21.15.6:0/458067785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c100eb0 msgr2=0x7fb64c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 --2- 172.21.15.6:0/458067785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c100eb0 0x7fb64c101310 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb6400099c0 tx=0x7fb640009cd0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 -- 172.21.15.6:0/458067785 shutdown_connections 2023-09-13T09:54:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 --2- 172.21.15.6:0/458067785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb64c101850 0x7fb64c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 --2- 172.21.15.6:0/458067785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb64c0ffcc0 0x7fb64c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 --2- 172.21.15.6:0/458067785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c100eb0 0x7fb64c101310 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 -- 172.21.15.6:0/458067785 >> 172.21.15.6:0/458067785 conn(0x7fb64c0fb250 msgr2=0x7fb64c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 -- 172.21.15.6:0/458067785 shutdown_connections 2023-09-13T09:54:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.403+0000 7fb651b72700 1 -- 172.21.15.6:0/458067785 wait complete. 2023-09-13T09:54:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 Processor -- start 2023-09-13T09:54:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 -- start start 2023-09-13T09:54:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c0ffcc0 0x7fb64c196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb64c100eb0 0x7fb64c197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb64c101850 0x7fb64c19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c19e670 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c19e7b0 con 0x7fb64c100eb0 2023-09-13T09:54:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.404+0000 7fb651b72700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb64c19e940 con 0x7fb64c101850 2023-09-13T09:54:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c0ffcc0 0x7fb64c196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb64c100eb0 0x7fb64c197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c0ffcc0 0x7fb64c196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43110/0 (socket says 172.21.15.6:43110) 2023-09-13T09:54:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1489528383 learned_addr learned my addr 172.21.15.6:0/1489528383 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:29.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64bfff700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb64c101850 0x7fb64c19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1489528383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb64c101850 msgr2=0x7fb64c19e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb64c101850 0x7fb64c19e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1489528383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb64c100eb0 msgr2=0x7fb64c197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb64c100eb0 0x7fb64c197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1489528383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6400095f0 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64affd700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb64c100eb0 0x7fb64c197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c0ffcc0 0x7fb64c196af0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00d980 tx=0x7fb63c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb648ff9700 1 -- 172.21.15.6:0/1489528383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00f890 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb648ff9700 1 -- 172.21.15.6:0/1489528383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb63c010460 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb648ff9700 1 -- 172.21.15.6:0/1489528383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c00e610 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb64c19ec20 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.405+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c19f0e0 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.408+0000 7fb648ff9700 1 -- 172.21.15.6:0/1489528383 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb63c0108d0 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.409+0000 7fb65dd57b80 1 Processor -- start 2023-09-13T09:54:29.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.409+0000 7fb648ff9700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb6340a0640 0x7fb6340a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.409+0000 7fb65dd57b80 1 -- start start 2023-09-13T09:54:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.409+0000 7fb648ff9700 1 -- 172.21.15.6:0/1489528383 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb63c0cb620 con 0x7fb64c0ffcc0 2023-09-13T09:54:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.409+0000 7fb64bfff700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb6340a0640 0x7fb6340a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcd700 0x558d99fcdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fcc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcca00 0x558d99fcce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99f25780 con 0x558d99fcd700 2023-09-13T09:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99f230a0 con 0x558d99fcca00 2023-09-13T09:54:29.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99f1e990 con 0x558d99fce060 2023-09-13T09:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcd700 0x558d99fcdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcd700 0x558d99fcdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43118/0 (socket says 172.21.15.6:43118) 2023-09-13T09:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1150700656 learned_addr learned my addr 172.21.15.6:0/1150700656 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64affd700 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fcc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64bfff700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb6340a0640 0x7fb6340a2b00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb64400f590 tx=0x7fb644009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1150700656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 msgr2=0x558d99fcc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fcc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1150700656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcca00 msgr2=0x558d99fcce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcca00 0x558d99fcce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 -- 172.21.15.6:0/1150700656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d99d9e630 con 0x558d99fcd700 2023-09-13T09:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.410+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcd700 0x558d99fcdb20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb63c098d50 tx=0x7fb63c099540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8710fa6d3b108098 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb631ffb700 1 -- 172.21.15.6:0/1150700656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0a0e30 con 0x558d99fcd700 2023-09-13T09:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb631ffb700 1 -- 172.21.15.6:0/1150700656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb63c097160 con 0x558d99fcd700 2023-09-13T09:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb631ffb700 1 -- 172.21.15.6:0/1150700656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0a09a0 con 0x558d99fcd700 2023-09-13T09:54:29.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 -- 172.21.15.6:0/1150700656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcd700 msgr2=0x558d99fcdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcd700 0x558d99fcdb20 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb63c098d50 tx=0x7fb63c099540 comp rx=0 tx=0).stop 2023-09-13T09:54:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 -- 172.21.15.6:0/1150700656 shutdown_connections 2023-09-13T09:54:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcca00 0x558d99fcce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcd700 0x558d99fcdb20 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/1150700656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fcc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 -- 172.21.15.6:0/1150700656 >> 172.21.15.6:0/1150700656 conn(0x558d99f2ac80 msgr2=0x558d99fc6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 -- 172.21.15.6:0/1150700656 shutdown_connections 2023-09-13T09:54:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.411+0000 7fb65dd57b80 1 -- 172.21.15.6:0/1150700656 wait complete. 2023-09-13T09:54:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 -- start start 2023-09-13T09:54:29.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 Processor -- start 2023-09-13T09:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcca00 0x558d99fd5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fce060 0x558d99fdd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99ebcbb0 con 0x558d99fce060 2023-09-13T09:54:29.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99ebc8b0 con 0x558d99fcd700 2023-09-13T09:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99da0920 con 0x558d99fcca00 2023-09-13T09:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb65dd57b80 10 client.0 _ll_register_callbacks cb 0x558d99eba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb64bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fce060 0x558d99fdd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb64affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb64bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fce060 0x558d99fdd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43128/0 (socket says 172.21.15.6:43128) 2023-09-13T09:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb64bfff700 1 -- 172.21.15.6:0/4267456219 learned_addr learned my addr 172.21.15.6:0/4267456219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.412+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcca00 0x558d99fd5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb64bfff700 1 -- 172.21.15.6:0/4267456219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcca00 msgr2=0x558d99fd5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb64bfff700 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcca00 0x558d99fd5ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb64bfff700 1 -- 172.21.15.6:0/4267456219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 msgr2=0x558d99fd6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb64bfff700 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb64bfff700 1 -- 172.21.15.6:0/4267456219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb64c19f0e0 con 0x558d99fce060 2023-09-13T09:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb64bfff700 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fce060 0x558d99fdd440 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb644009fa0 tx=0x7fb644004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b224f05865c5e3a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb62affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb62affd700 1 -- 172.21.15.6:0/4267456219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb64400e040 con 0x558d99fce060 2023-09-13T09:54:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb62affd700 1 -- 172.21.15.6:0/4267456219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb64401e040 con 0x558d99fce060 2023-09-13T09:54:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d99fbf670 con 0x558d99fce060 2023-09-13T09:54:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb62affd700 1 -- 172.21.15.6:0/4267456219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb644017d20 con 0x558d99fce060 2023-09-13T09:54:29.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb65dd57b80 10 client.19356 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.413+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x558d99f367a0 con 0x558d99fce060 2023-09-13T09:54:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb62affd700 1 -- 172.21.15.6:0/4267456219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558d99fbf670 con 0x558d99fce060 2023-09-13T09:54:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb62affd700 1 -- 172.21.15.6:0/4267456219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fb644029060 con 0x558d99fce060 2023-09-13T09:54:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb65dd57b80 10 client.19356 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:29.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb65dd57b80 10 client.19356 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb65dd57b80 20 client.19356 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d99fe1e40 0x558d99fe4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb65dd57b80 4 client.19356 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d99f17970 con 0x558d99fe1e40 2023-09-13T09:54:29.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d99fe1e40 0x558d99fe4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d99fe1e40 0x558d99fe4260 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8fa07480a035174 server_cookie=13498e9237388349 in_seq=0 out_seq=0 2023-09-13T09:54:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.414+0000 7fb62affd700 10 client.19356 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb62affd700 1 -- 172.21.15.6:0/4267456219 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d99f17970 con 0x558d99fe1e40 2023-09-13T09:54:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb62affd700 10 client.19356 handle_command_reply: tid=0 2023-09-13T09:54:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 client.19356 shutdown 2023-09-13T09:54:29.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fce060 msgr2=0x558d99fdd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fce060 0x558d99fdd440 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb644009fa0 tx=0x7fb644004ad0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 shutdown_connections 2023-09-13T09:54:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d99fe1e40 0x558d99fe4260 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fce060 0x558d99fdd440 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcca00 0x558d99fd5ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb62affd700 0 client.19356 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4267456219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 >> 172.21.15.6:0/4267456219 conn(0x558d99f2ac80 msgr2=0x558d99fc17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 shutdown_connections 2023-09-13T09:54:29.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.416+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4267456219 wait complete. 2023-09-13T09:54:29.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.417+0000 7fb65dd57b80 20 client.19356 trim_cache size 0 max 16384 2023-09-13T09:54:29.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 Processor -- start 2023-09-13T09:54:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 -- start start 2023-09-13T09:54:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fcc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcd700 0x558d99fdd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fce060 0x558d99fd09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99fdd8a0 con 0x558d99fcca00 2023-09-13T09:54:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99fc8a10 con 0x558d99fce060 2023-09-13T09:54:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99fc38e0 con 0x558d99fcd700 2023-09-13T09:54:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fcc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fcc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43134/0 (socket says 172.21.15.6:43134) 2023-09-13T09:54:29.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 -- 172.21.15.6:0/4292894408 learned_addr learned my addr 172.21.15.6:0/4292894408 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:29.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64affd700 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcd700 0x558d99fdd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64bfff700 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fce060 0x558d99fd09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 -- 172.21.15.6:0/4292894408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcd700 msgr2=0x558d99fdd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcd700 0x558d99fdd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 -- 172.21.15.6:0/4292894408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fce060 msgr2=0x558d99fd09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fce060 0x558d99fd09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64b7fe700 1 -- 172.21.15.6:0/4292894408 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d99d4ade0 con 0x558d99fcca00 2023-09-13T09:54:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.438+0000 7fb64affd700 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcd700 0x558d99fdd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:54:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.439+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fcc4c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0c9120 tx=0x7fb63c09cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=715cbafa387db6ca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.439+0000 7fb6327fc700 1 -- 172.21.15.6:0/4292894408 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c099220 con 0x558d99fcca00 2023-09-13T09:54:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.439+0000 7fb6327fc700 1 -- 172.21.15.6:0/4292894408 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb63c098340 con 0x558d99fcca00 2023-09-13T09:54:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.439+0000 7fb6327fc700 1 -- 172.21.15.6:0/4292894408 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c0b6b20 con 0x558d99fcca00 2023-09-13T09:54:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4292894408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 msgr2=0x558d99fcc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fcc4c0 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0c9120 tx=0x7fb63c09cd70 comp rx=0 tx=0).stop 2023-09-13T09:54:29.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4292894408 shutdown_connections 2023-09-13T09:54:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fce060 0x558d99fd09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fcc4c0 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/4292894408 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fcd700 0x558d99fdd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4292894408 >> 172.21.15.6:0/4292894408 conn(0x558d99f2ac80 msgr2=0x558d99fd4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4292894408 shutdown_connections 2023-09-13T09:54:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 -- 172.21.15.6:0/4292894408 wait complete. 2023-09-13T09:54:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.440+0000 7fb65dd57b80 1 -- start start 2023-09-13T09:54:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 1 Processor -- start 2023-09-13T09:54:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fd8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fdc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99fdc8a0 con 0x558d99fcca00 2023-09-13T09:54:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99fdca10 con 0x558d99fcd700 2023-09-13T09:54:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d99fdcbd0 con 0x558d99fce060 2023-09-13T09:54:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb65dd57b80 10 client.0 _ll_register_callbacks cb 0x558d99eba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb64affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb64affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd9340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36664/0 (socket says 172.21.15.6:36664) 2023-09-13T09:54:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb64affd700 1 -- 172.21.15.6:0/2135539101 learned_addr learned my addr 172.21.15.6:0/2135539101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fd8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.441+0000 7fb64bfff700 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fdc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb64b7fe700 1 -- 172.21.15.6:0/2135539101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 msgr2=0x558d99fdc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fdc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb64b7fe700 1 -- 172.21.15.6:0/2135539101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 msgr2=0x558d99fd9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb64b7fe700 1 -- 172.21.15.6:0/2135539101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d99d9e630 con 0x558d99fcca00 2023-09-13T09:54:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb64b7fe700 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fd8e00 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0952c0 tx=0x7fb63c0b1210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0680d621cf0bca6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb62affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb62affd700 1 -- 172.21.15.6:0/2135539101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63c099020 con 0x558d99fcca00 2023-09-13T09:54:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb62affd700 1 -- 172.21.15.6:0/2135539101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb63c099180 con 0x558d99fcca00 2023-09-13T09:54:29.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb63c097160 con 0x558d99fcca00 2023-09-13T09:54:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb62affd700 1 -- 172.21.15.6:0/2135539101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb63c0b6b20 con 0x558d99fcca00 2023-09-13T09:54:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb65dd57b80 10 client.19362 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.442+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x558d99d33c60 con 0x558d99fcca00 2023-09-13T09:54:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb62affd700 1 -- 172.21.15.6:0/2135539101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb63c097160 con 0x558d99fcca00 2023-09-13T09:54:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb62affd700 1 -- 172.21.15.6:0/2135539101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fb63c094c40 con 0x558d99fcca00 2023-09-13T09:54:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb65dd57b80 10 client.19362 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb65dd57b80 10 client.19362 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb65dd57b80 20 client.19362 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d9a036360 0x558d9a038780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb65dd57b80 4 client.19362 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:54:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558d99ed8050 con 0x558d9a036360 2023-09-13T09:54:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.443+0000 7fb64affd700 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d9a036360 0x558d9a038780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.444+0000 7fb62affd700 10 client.19362 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:29.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.444+0000 7fb64affd700 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d9a036360 0x558d9a038780 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bec54f169c847286 server_cookie=af0d33465b2c18 in_seq=0 out_seq=0 2023-09-13T09:54:29.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.449+0000 7fb62affd700 1 -- 172.21.15.6:0/2135539101 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558d99ed8050 con 0x558d9a036360 2023-09-13T09:54:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.449+0000 7fb62affd700 10 client.19362 handle_command_reply: tid=0 2023-09-13T09:54:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.449+0000 7fb65dd57b80 1 client.19362 shutdown 2023-09-13T09:54:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.449+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 msgr2=0x558d99fd8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.449+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fd8e00 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fb63c0952c0 tx=0x7fb63c0b1210 comp rx=0 tx=0).stop 2023-09-13T09:54:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 shutdown_connections 2023-09-13T09:54:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d99fce060 0x558d99fdc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558d9a036360 0x558d9a038780 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d99fcca00 0x558d99fd8e00 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb62affd700 0 client.19362 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 --2- 172.21.15.6:0/2135539101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d99fcd700 0x558d99fd9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 >> 172.21.15.6:0/2135539101 conn(0x558d99f2ac80 msgr2=0x558d99fd09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 shutdown_connections 2023-09-13T09:54:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 1 -- 172.21.15.6:0/2135539101 wait complete. 2023-09-13T09:54:29.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb65dd57b80 20 client.19362 trim_cache size 0 max 16384 2023-09-13T09:54:29.464 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:54:29.464 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:54:29.465 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:54:29.465 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:54:29.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb6340a0640 msgr2=0x7fb6340a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb6340a0640 0x7fb6340a2b00 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fb64400f590 tx=0x7fb644009920 comp rx=0 tx=0).stop 2023-09-13T09:54:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c0ffcc0 msgr2=0x7fb64c196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c0ffcc0 0x7fb64c196af0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb63c00d980 tx=0x7fb63c00dc90 comp rx=0 tx=0).stop 2023-09-13T09:54:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 shutdown_connections 2023-09-13T09:54:29.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb64c101850 0x7fb64c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb6340a0640 0x7fb6340a2b00 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb64c0ffcc0 0x7fb64c196af0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 --2- 172.21.15.6:0/1489528383 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb64c100eb0 0x7fb64c197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.450+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 >> 172.21.15.6:0/1489528383 conn(0x7fb64c0fb250 msgr2=0x7fb64c1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.451+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 shutdown_connections 2023-09-13T09:54:29.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.451+0000 7fb651b72700 1 -- 172.21.15.6:0/1489528383 wait complete. 2023-09-13T09:54:29.469 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:54:29.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:54:29.557 INFO:tasks.workunit.client.0.smithi006.stdout: 10 79157 40.76 MB/sec warmup 109 sec latency 43.164 ms 2023-09-13T09:54:29.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 -- 172.21.15.6:0/2296840291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218100dc0 msgr2=0x7f02181011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 --2- 172.21.15.6:0/2296840291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218100dc0 0x7f02181011e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098f0 tx=0x7f020c009c00 comp rx=0 tx=0).stop 2023-09-13T09:54:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 -- 172.21.15.6:0/2296840291 shutdown_connections 2023-09-13T09:54:29.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 --2- 172.21.15.6:0/2296840291 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218102950 0x7f0218109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 --2- 172.21.15.6:0/2296840291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218100dc0 0x7f02181011e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 --2- 172.21.15.6:0/2296840291 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0218101fb0 0x7f0218102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 -- 172.21.15.6:0/2296840291 >> 172.21.15.6:0/2296840291 conn(0x7f02180fc330 msgr2=0x7f02180fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 -- 172.21.15.6:0/2296840291 shutdown_connections 2023-09-13T09:54:29.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.614+0000 7f021f23f700 1 -- 172.21.15.6:0/2296840291 wait complete. 2023-09-13T09:54:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 Processor -- start 2023-09-13T09:54:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 -- start start 2023-09-13T09:54:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0218100dc0 0x7f0218196ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218101fb0 0x7f0218197000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218102950 0x7f021819e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021819e640 con 0x7f0218101fb0 2023-09-13T09:54:29.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021819e780 con 0x7f0218100dc0 2023-09-13T09:54:29.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021f23f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021819e910 con 0x7f0218102950 2023-09-13T09:54:29.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f0217fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218101fb0 0x7f0218197000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021cfdb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0218100dc0 0x7f0218196ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f0217fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218101fb0 0x7f0218197000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43154/0 (socket says 172.21.15.6:43154) 2023-09-13T09:54:29.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f0217fff700 1 -- 172.21.15.6:0/3292338043 learned_addr learned my addr 172.21.15.6:0/3292338043 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:29.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.615+0000 7f021d7dc700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218102950 0x7f021819e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0217fff700 1 -- 172.21.15.6:0/3292338043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218102950 msgr2=0x7f021819e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0217fff700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218102950 0x7f021819e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0217fff700 1 -- 172.21.15.6:0/3292338043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0218100dc0 msgr2=0x7f0218196ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0217fff700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0218100dc0 0x7f0218196ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0217fff700 1 -- 172.21.15.6:0/3292338043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0210009d00 con 0x7f0218101fb0 2023-09-13T09:54:29.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0217fff700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218101fb0 0x7f0218197000 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f020400e9a0 tx=0x7f020400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0215ffb700 1 -- 172.21.15.6:0/3292338043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204009790 con 0x7f0218101fb0 2023-09-13T09:54:29.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0215ffb700 1 -- 172.21.15.6:0/3292338043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0204010430 con 0x7f0218101fb0 2023-09-13T09:54:29.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f020c009520 con 0x7f0218101fb0 2023-09-13T09:54:29.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f0215ffb700 1 -- 172.21.15.6:0/3292338043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0204018680 con 0x7f0218101fb0 2023-09-13T09:54:29.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.616+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021819ef70 con 0x7f0218101fb0 2023-09-13T09:54:29.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.617+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0218108400 con 0x7f0218101fb0 2023-09-13T09:54:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.619+0000 7f0215ffb700 1 -- 172.21.15.6:0/3292338043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f02040105a0 con 0x7f0218101fb0 2023-09-13T09:54:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.619+0000 7f0215ffb700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02080a0640 0x7f02080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.620+0000 7f021cfdb700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02080a0640 0x7f02080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:29.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.620+0000 7f0215ffb700 1 -- 172.21.15.6:0/3292338043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0204014070 con 0x7f0218101fb0 2023-09-13T09:54:29.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.620+0000 7f021cfdb700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02080a0640 0x7f02080a2b00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098c0 tx=0x7f020c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:29.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.625+0000 7f0215ffb700 1 -- 172.21.15.6:0/3292338043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f0204051e10 con 0x7f0218101fb0 2023-09-13T09:54:29.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.924+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f021810c5d0 con 0x7f0218101fb0 2023-09-13T09:54:29.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.924+0000 7f0215ffb700 1 -- 172.21.15.6:0/3292338043 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+11364 (secure 0 0 0) 0x7f0204095850 con 0x7f0218101fb0 2023-09-13T09:54:29.926 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:54:29.926 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":47,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":47,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:53:49.864535+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:54:29.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02080a0640 msgr2=0x7f02080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02080a0640 0x7f02080a2b00 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f020c0098c0 tx=0x7f020c019040 comp rx=0 tx=0).stop 2023-09-13T09:54:29.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218101fb0 msgr2=0x7f0218197000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:29.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218101fb0 0x7f0218197000 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f020400e9a0 tx=0x7f020400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 shutdown_connections 2023-09-13T09:54:29.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0218102950 0x7f021819e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0218100dc0 0x7f0218196ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02080a0640 0x7f02080a2b00 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 --2- 172.21.15.6:0/3292338043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0218101fb0 0x7f0218197000 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 >> 172.21.15.6:0/3292338043 conn(0x7f02180fc330 msgr2=0x7f0218105540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:29.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 shutdown_connections 2023-09-13T09:54:29.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:29.927+0000 7f021f23f700 1 -- 172.21.15.6:0/3292338043 wait complete. 2023-09-13T09:54:29.931 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 47 2023-09-13T09:54:29.943 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:54:30.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 -- 172.21.15.6:0/2437530563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 msgr2=0x7fda14101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 --2- 172.21.15.6:0/2437530563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda14101310 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7fda080099c0 tx=0x7fda08009cd0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 -- 172.21.15.6:0/2437530563 shutdown_connections 2023-09-13T09:54:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 --2- 172.21.15.6:0/2437530563 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda14101850 0x7fda14108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 --2- 172.21.15.6:0/2437530563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda140ffcc0 0x7fda141000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 --2- 172.21.15.6:0/2437530563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda14101310 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 -- 172.21.15.6:0/2437530563 >> 172.21.15.6:0/2437530563 conn(0x7fda140fb250 msgr2=0x7fda140fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 -- 172.21.15.6:0/2437530563 shutdown_connections 2023-09-13T09:54:30.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.100+0000 7fda1a58d700 1 -- 172.21.15.6:0/2437530563 wait complete. 2023-09-13T09:54:30.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 Processor -- start 2023-09-13T09:54:30.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 -- start start 2023-09-13T09:54:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda140ffcc0 0x7fda14068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda1419b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda14101850 0x7fda1419ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1419e560 con 0x7fda14100eb0 2023-09-13T09:54:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1419e6d0 con 0x7fda14101850 2023-09-13T09:54:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.101+0000 7fda1a58d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1419e890 con 0x7fda140ffcc0 2023-09-13T09:54:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda1419b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda1419b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43168/0 (socket says 172.21.15.6:43168) 2023-09-13T09:54:30.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 -- 172.21.15.6:0/918841354 learned_addr learned my addr 172.21.15.6:0/918841354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda13fff700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda140ffcc0 0x7fda14068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda18b2a700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda14101850 0x7fda1419ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 -- 172.21.15.6:0/918841354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda140ffcc0 msgr2=0x7fda14068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda140ffcc0 0x7fda14068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 -- 172.21.15.6:0/918841354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda14101850 msgr2=0x7fda1419ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda14101850 0x7fda1419ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 -- 172.21.15.6:0/918841354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda080095f0 con 0x7fda14100eb0 2023-09-13T09:54:30.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda137fe700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda1419b730 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fda08009fd0 tx=0x7fda08009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda117fa700 1 -- 172.21.15.6:0/918841354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0801d070 con 0x7fda14100eb0 2023-09-13T09:54:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda117fa700 1 -- 172.21.15.6:0/918841354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda08005030 con 0x7fda14100eb0 2023-09-13T09:54:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1419eb10 con 0x7fda14100eb0 2023-09-13T09:54:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda117fa700 1 -- 172.21.15.6:0/918841354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda08004a90 con 0x7fda14100eb0 2023-09-13T09:54:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.102+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda14195500 con 0x7fda14100eb0 2023-09-13T09:54:30.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.105+0000 7fda117fa700 1 -- 172.21.15.6:0/918841354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fda080051a0 con 0x7fda14100eb0 2023-09-13T09:54:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.106+0000 7fda117fa700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd9fc0a4a50 0x7fd9fc0a6f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.106+0000 7fda117fa700 1 -- 172.21.15.6:0/918841354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fda080cc9b0 con 0x7fda14100eb0 2023-09-13T09:54:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.106+0000 7fda13fff700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd9fc0a4a50 0x7fd9fc0a6f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.106+0000 7fda26772b80 1 Processor -- start 2023-09-13T09:54:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda26772b80 1 -- start start 2023-09-13T09:54:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda26772b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99d3b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda26772b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d4060 0x5597e99d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda26772b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda26772b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e992b780 con 0x5597e99d3700 2023-09-13T09:54:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda26772b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e99290a0 con 0x5597e99d2a00 2023-09-13T09:54:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda26772b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e9924990 con 0x5597e99d4060 2023-09-13T09:54:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99d3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99d3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43174/0 (socket says 172.21.15.6:43174) 2023-09-13T09:54:30.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 -- 172.21.15.6:0/3563899947 learned_addr learned my addr 172.21.15.6:0/3563899947 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd9fc0a4a50 0x7fd9fc0a6f10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fda14100d10 tx=0x7fda04009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda137fe700 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d4060 0x5597e99d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda18b2a700 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 -- 172.21.15.6:0/3563899947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d4060 msgr2=0x5597e99d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d4060 0x5597e99d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 -- 172.21.15.6:0/3563899947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 msgr2=0x5597e99d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda13fff700 1 -- 172.21.15.6:0/3563899947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597e97a4630 con 0x5597e99d3700 2023-09-13T09:54:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.107+0000 7fda137fe700 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d4060 0x5597e99d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:30.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.108+0000 7fda13fff700 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99d3b20 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fda04011d10 tx=0x7fda04014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd49deb02463c56 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.108+0000 7fd9fa7fc700 1 -- 172.21.15.6:0/3563899947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400eb20 con 0x5597e99d3700 2023-09-13T09:54:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.108+0000 7fd9fa7fc700 1 -- 172.21.15.6:0/3563899947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda04021070 con 0x5597e99d3700 2023-09-13T09:54:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.108+0000 7fd9fa7fc700 1 -- 172.21.15.6:0/3563899947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04003c20 con 0x5597e99d3700 2023-09-13T09:54:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.108+0000 7fda26772b80 1 -- 172.21.15.6:0/3563899947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 msgr2=0x5597e99d3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.108+0000 7fda26772b80 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99d3b20 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7fda04011d10 tx=0x7fda04014000 comp rx=0 tx=0).stop 2023-09-13T09:54:30.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 -- 172.21.15.6:0/3563899947 shutdown_connections 2023-09-13T09:54:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99d3b20 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 --2- 172.21.15.6:0/3563899947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d4060 0x5597e99d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 -- 172.21.15.6:0/3563899947 >> 172.21.15.6:0/3563899947 conn(0x5597e9930c80 msgr2=0x5597e99ccf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 -- 172.21.15.6:0/3563899947 shutdown_connections 2023-09-13T09:54:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 -- 172.21.15.6:0/3563899947 wait complete. 2023-09-13T09:54:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 -- start start 2023-09-13T09:54:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.109+0000 7fda26772b80 1 Processor -- start 2023-09-13T09:54:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda26772b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99e4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda26772b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda26772b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda26772b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e98c2bb0 con 0x5597e99d3700 2023-09-13T09:54:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda26772b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e98c28b0 con 0x5597e99d4060 2023-09-13T09:54:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda26772b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e97a6920 con 0x5597e99d2a00 2023-09-13T09:54:30.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda26772b80 10 client.0 _ll_register_callbacks cb 0x5597e98c0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99e4cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43184/0 (socket says 172.21.15.6:43184) 2023-09-13T09:54:30.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 -- 172.21.15.6:0/2984394562 learned_addr learned my addr 172.21.15.6:0/2984394562 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda18b2a700 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 -- 172.21.15.6:0/2984394562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 msgr2=0x5597e99e4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 -- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 msgr2=0x5597e99ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99ebcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.110+0000 7fda137fe700 1 -- 172.21.15.6:0/2984394562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda04017070 con 0x5597e99d3700 2023-09-13T09:54:30.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fda137fe700 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99e4cb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fda08096c50 tx=0x7fda08005760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938f461cf84d3cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fd9f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:30.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fd9f37fe700 1 -- 172.21.15.6:0/2984394562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda08098580 con 0x5597e99d3700 2023-09-13T09:54:30.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597e99c5670 con 0x5597e99d3700 2023-09-13T09:54:30.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fd9f37fe700 1 -- 172.21.15.6:0/2984394562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fda080996d0 con 0x5597e99d3700 2023-09-13T09:54:30.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fd9f37fe700 1 -- 172.21.15.6:0/2984394562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda080b8170 con 0x5597e99d3700 2023-09-13T09:54:30.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fda26772b80 10 client.19380 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5597e993c7a0 con 0x5597e99d3700 2023-09-13T09:54:30.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fd9f37fe700 1 -- 172.21.15.6:0/2984394562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda08064080 con 0x5597e99d3700 2023-09-13T09:54:30.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fd9f37fe700 1 -- 172.21.15.6:0/2984394562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fda08004bf0 con 0x5597e99d3700 2023-09-13T09:54:30.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fda26772b80 10 client.19380 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fda26772b80 10 client.19380 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:54:30.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.111+0000 7fda26772b80 20 client.19380 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.112+0000 7fda26772b80 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e99f0210 0x5597e99f2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.112+0000 7fda26772b80 4 client.19380 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:30.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.112+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597e991d970 con 0x5597e99f0210 2023-09-13T09:54:30.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.112+0000 7fda13fff700 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e99f0210 0x5597e99f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.112+0000 7fda13fff700 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e99f0210 0x5597e99f2630 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b8cdd00b3cf6d094 server_cookie=a333e00d38a81f5a in_seq=0 out_seq=0 2023-09-13T09:54:30.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.112+0000 7fd9f37fe700 10 client.19380 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:54:30.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.116+0000 7fd9f37fe700 1 -- 172.21.15.6:0/2984394562 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5597e991d970 con 0x5597e99f0210 2023-09-13T09:54:30.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.116+0000 7fd9f37fe700 10 client.19380 handle_command_reply: tid=0 2023-09-13T09:54:30.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.116+0000 7fda26772b80 1 client.19380 shutdown 2023-09-13T09:54:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 msgr2=0x5597e99e4cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99e4cb0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7fda08096c50 tx=0x7fda08005760 comp rx=0 tx=0).stop 2023-09-13T09:54:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 shutdown_connections 2023-09-13T09:54:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e99f0210 0x5597e99f2630 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fd9f37fe700 0 client.19380 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:54:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99e4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 --2- 172.21.15.6:0/2984394562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99e4cb0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 >> 172.21.15.6:0/2984394562 conn(0x5597e9930c80 msgr2=0x5597e99c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 shutdown_connections 2023-09-13T09:54:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 1 -- 172.21.15.6:0/2984394562 wait complete. 2023-09-13T09:54:30.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.117+0000 7fda26772b80 20 client.19380 trim_cache size 0 max 16384 2023-09-13T09:54:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 Processor -- start 2023-09-13T09:54:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 -- start start 2023-09-13T09:54:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99d24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99ebc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99e4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e991d970 con 0x5597e99d3700 2023-09-13T09:54:30.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e99da6a0 con 0x5597e99d4060 2023-09-13T09:54:30.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.131+0000 7fda26772b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e99db410 con 0x5597e99d2a00 2023-09-13T09:54:30.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda13fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99d24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99ebc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda13fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99d24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46242/0 (socket says 172.21.15.6:46242) 2023-09-13T09:54:30.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda18b2a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99e4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda13fff700 1 -- 172.21.15.6:0/2717547191 learned_addr learned my addr 172.21.15.6:0/2717547191 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda137fe700 1 -- 172.21.15.6:0/2717547191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 msgr2=0x5597e99d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda137fe700 1 --2- 172.21.15.6:0/2717547191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99d24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda137fe700 1 -- 172.21.15.6:0/2717547191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 msgr2=0x5597e99e4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda137fe700 1 --2- 172.21.15.6:0/2717547191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99e4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda137fe700 1 -- 172.21.15.6:0/2717547191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597e9750de0 con 0x5597e99d3700 2023-09-13T09:54:30.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fda137fe700 1 --2- 172.21.15.6:0/2717547191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99ebc10 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fda08000c00 tx=0x7fda080a0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f506b003c004baa1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.132+0000 7fd9faffd700 1 -- 172.21.15.6:0/2717547191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda080b8170 con 0x5597e99d3700 2023-09-13T09:54:30.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.133+0000 7fd9faffd700 1 -- 172.21.15.6:0/2717547191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5597e99c5670 con 0x5597e99d3700 2023-09-13T09:54:30.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.133+0000 7fd9faffd700 1 -- 172.21.15.6:0/2717547191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda080a1f90 con 0x5597e99d3700 2023-09-13T09:54:30.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 -- 172.21.15.6:0/2717547191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 msgr2=0x5597e99ebc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 --2- 172.21.15.6:0/2717547191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99ebc10 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7fda08000c00 tx=0x7fda080a0040 comp rx=0 tx=0).stop 2023-09-13T09:54:30.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 -- 172.21.15.6:0/2717547191 shutdown_connections 2023-09-13T09:54:30.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 --2- 172.21.15.6:0/2717547191 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d4060 0x5597e99e4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 --2- 172.21.15.6:0/2717547191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d2a00 0x5597e99d24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 --2- 172.21.15.6:0/2717547191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d3700 0x5597e99ebc10 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 -- 172.21.15.6:0/2717547191 >> 172.21.15.6:0/2717547191 conn(0x5597e9930c80 msgr2=0x5597e99dabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 -- 172.21.15.6:0/2717547191 shutdown_connections 2023-09-13T09:54:30.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 -- 172.21.15.6:0/2717547191 wait complete. 2023-09-13T09:54:30.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.134+0000 7fda26772b80 1 -- start start 2023-09-13T09:54:30.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 1 Processor -- start 2023-09-13T09:54:30.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99e7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d3700 0x5597e99e7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d4060 0x5597e99eb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e99eb550 con 0x5597e99d4060 2023-09-13T09:54:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e99eb6c0 con 0x5597e99d2a00 2023-09-13T09:54:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597e99eb880 con 0x5597e99d3700 2023-09-13T09:54:30.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda26772b80 10 client.0 _ll_register_callbacks cb 0x5597e98c0680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99e7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99e7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36718/0 (socket says 172.21.15.6:36718) 2023-09-13T09:54:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda137fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d3700 0x5597e99e7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 -- 172.21.15.6:0/1221803380 learned_addr learned my addr 172.21.15.6:0/1221803380 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda18b2a700 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d4060 0x5597e99eb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 -- 172.21.15.6:0/1221803380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d3700 msgr2=0x5597e99e7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d3700 0x5597e99e7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 -- 172.21.15.6:0/1221803380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d4060 msgr2=0x5597e99eb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d4060 0x5597e99eb010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.135+0000 7fda13fff700 1 -- 172.21.15.6:0/1221803380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597e993c7a0 con 0x5597e99d2a00 2023-09-13T09:54:30.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fda13fff700 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99e7ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda0400e970 tx=0x7fda04011860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8502f488f6332d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fd9f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:54:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fd9f37fe700 1 -- 172.21.15.6:0/1221803380 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0402c040 con 0x5597e99d2a00 2023-09-13T09:54:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda04021070 con 0x5597e99d2a00 2023-09-13T09:54:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fd9f37fe700 1 -- 172.21.15.6:0/1221803380 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fda0400eaa0 con 0x5597e99d2a00 2023-09-13T09:54:30.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fd9f37fe700 1 -- 172.21.15.6:0/1221803380 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda0402e280 con 0x5597e99d2a00 2023-09-13T09:54:30.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fda26772b80 10 client.28754 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.136+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5597e9739c60 con 0x5597e99d2a00 2023-09-13T09:54:30.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fd9f37fe700 1 -- 172.21.15.6:0/1221803380 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fda04021070 con 0x5597e99d2a00 2023-09-13T09:54:30.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fd9f37fe700 1 -- 172.21.15.6:0/1221803380 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fda04005220 con 0x5597e99d2a00 2023-09-13T09:54:30.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fda26772b80 10 client.28754 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fda26772b80 10 client.28754 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:54:30.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fda26772b80 20 client.28754 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fda26772b80 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e9a45210 0x5597e9a47630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fda26772b80 4 client.28754 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:54:30.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5597e98de050 con 0x5597e9a45210 2023-09-13T09:54:30.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fda137fe700 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e9a45210 0x5597e9a47630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.137+0000 7fd9f37fe700 10 client.28754 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:54:30.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.138+0000 7fda137fe700 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e9a45210 0x5597e9a47630 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ff01340553fbb1cc server_cookie=78fc72ffa7d40259 in_seq=0 out_seq=0 2023-09-13T09:54:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.141+0000 7fd9f37fe700 1 -- 172.21.15.6:0/1221803380 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5597e98de050 con 0x5597e9a45210 2023-09-13T09:54:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.141+0000 7fd9f37fe700 10 client.28754 handle_command_reply: tid=0 2023-09-13T09:54:30.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.141+0000 7fda26772b80 1 client.28754 shutdown 2023-09-13T09:54:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 msgr2=0x5597e99e7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99e7ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fda0400e970 tx=0x7fda04011860 comp rx=0 tx=0).stop 2023-09-13T09:54:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 shutdown_connections 2023-09-13T09:54:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5597e9a45210 0x5597e9a47630 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5597e99d4060 0x5597e99eb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5597e99d2a00 0x5597e99e7ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 --2- 172.21.15.6:0/1221803380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5597e99d3700 0x5597e99e7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 >> 172.21.15.6:0/1221803380 conn(0x5597e9930c80 msgr2=0x5597e99d6920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fd9f37fe700 0 client.28754 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:54:30.157 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:54:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 shutdown_connections 2023-09-13T09:54:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 1 -- 172.21.15.6:0/1221803380 wait complete. 2023-09-13T09:54:30.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.142+0000 7fda26772b80 20 client.28754 trim_cache size 0 max 16384 2023-09-13T09:54:30.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd9fc0a4a50 msgr2=0x7fd9fc0a6f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd9fc0a4a50 0x7fd9fc0a6f10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fda14100d10 tx=0x7fda04009260 comp rx=0 tx=0).stop 2023-09-13T09:54:30.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 msgr2=0x7fda1419b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda1419b730 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7fda08009fd0 tx=0x7fda08009580 comp rx=0 tx=0).stop 2023-09-13T09:54:30.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 shutdown_connections 2023-09-13T09:54:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fda14101850 0x7fda1419ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda140ffcc0 0x7fda14068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd9fc0a4a50 0x7fd9fc0a6f10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 --2- 172.21.15.6:0/918841354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fda14100eb0 0x7fda1419b730 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 >> 172.21.15.6:0/918841354 conn(0x7fda140fb250 msgr2=0x7fda141043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 shutdown_connections 2023-09-13T09:54:30.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.143+0000 7fda1a58d700 1 -- 172.21.15.6:0/918841354 wait complete. 2023-09-13T09:54:30.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:54:30.190 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:29 smithi006 ceph-mon[98665]: pgmap v749: 97 pgs: 97 active+clean; 801 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.8 MiB/s wr, 786 op/s 2023-09-13T09:54:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:29 smithi053 ceph-mon[102373]: pgmap v749: 97 pgs: 97 active+clean; 801 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.8 MiB/s wr, 786 op/s 2023-09-13T09:54:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:29 smithi131 ceph-mon[102785]: pgmap v749: 97 pgs: 97 active+clean; 801 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.8 MiB/s wr, 786 op/s 2023-09-13T09:54:30.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 -- 172.21.15.6:0/710101941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 msgr2=0x7f1750108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 --2- 172.21.15.6:0/710101941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f1750108120 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f174800b0a0 tx=0x7f174800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 -- 172.21.15.6:0/710101941 shutdown_connections 2023-09-13T09:54:30.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 --2- 172.21.15.6:0/710101941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f1750108120 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 --2- 172.21.15.6:0/710101941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17501013c0 0x7f17501017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 --2- 172.21.15.6:0/710101941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 0x7f17500ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 -- 172.21.15.6:0/710101941 >> 172.21.15.6:0/710101941 conn(0x7f17500fb250 msgr2=0x7f17500fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 -- 172.21.15.6:0/710101941 shutdown_connections 2023-09-13T09:54:30.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.326+0000 7f1754cea700 1 -- 172.21.15.6:0/710101941 wait complete. 2023-09-13T09:54:30.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 Processor -- start 2023-09-13T09:54:30.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 -- start start 2023-09-13T09:54:30.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 0x7f175019fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f17501a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17501013c0 0x7f17501a45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17501a4db0 con 0x7f1750100290 2023-09-13T09:54:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17501a4f20 con 0x7f17501013c0 2023-09-13T09:54:30.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.327+0000 7f1754cea700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17501a50e0 con 0x7f17500ff8f0 2023-09-13T09:54:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f17501a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 0x7f175019fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 0x7f175019fa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46262/0 (socket says 172.21.15.6:46262) 2023-09-13T09:54:30.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17501013c0 0x7f17501a45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 -- 172.21.15.6:0/2357409389 learned_addr learned my addr 172.21.15.6:0/2357409389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f17501a1f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43210/0 (socket says 172.21.15.6:43210) 2023-09-13T09:54:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 -- 172.21.15.6:0/2357409389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17501013c0 msgr2=0x7f17501a45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17501013c0 0x7f17501a45e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 -- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 msgr2=0x7f17501a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f17501a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 -- 172.21.15.6:0/2357409389 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1748009d00 con 0x7f17500ff8f0 2023-09-13T09:54:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174dd9b700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f17501a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174ed9d700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17501013c0 0x7f17501a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f174e59c700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 0x7f175019fa40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f174400e970 tx=0x7f174400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f173f7fe700 1 -- 172.21.15.6:0/2357409389 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744009790 con 0x7f17500ff8f0 2023-09-13T09:54:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17501a53c0 con 0x7f17500ff8f0 2023-09-13T09:54:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f173f7fe700 1 -- 172.21.15.6:0/2357409389 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f174400c7e0 con 0x7f17500ff8f0 2023-09-13T09:54:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f173f7fe700 1 -- 172.21.15.6:0/2357409389 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744003c70 con 0x7f17500ff8f0 2023-09-13T09:54:30.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.328+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17501a5920 con 0x7f17500ff8f0 2023-09-13T09:54:30.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.331+0000 7f173f7fe700 1 -- 172.21.15.6:0/2357409389 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f174400cc50 con 0x7f17500ff8f0 2023-09-13T09:54:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 Processor -- start 2023-09-13T09:54:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f173f7fe700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17380a0640 0x7f17380a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f173f7fe700 1 -- 172.21.15.6:0/2357409389 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1744014070 con 0x7f17500ff8f0 2023-09-13T09:54:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174ed9d700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17380a0640 0x7f17380a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 -- start start 2023-09-13T09:54:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557110b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x55955710f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x55955710fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559557068780 con 0x559557110700 2023-09-13T09:54:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595570660a0 con 0x559557111060 2023-09-13T09:54:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559557061990 con 0x55955710fa00 2023-09-13T09:54:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557110b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x55955710f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x55955710f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36742/0 (socket says 172.21.15.6:36742) 2023-09-13T09:54:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174dd9b700 1 -- 172.21.15.6:0/2569763505 learned_addr learned my addr 172.21.15.6:0/2569763505 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557110b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43216/0 (socket says 172.21.15.6:43216) 2023-09-13T09:54:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174ed9d700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17380a0640 0x7f17380a2b00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1748009fd0 tx=0x7f174800b720 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.332+0000 7f174ed9d700 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x55955710fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f174dd9b700 1 -- 172.21.15.6:0/2569763505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 msgr2=0x55955710fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f174dd9b700 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x55955710fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f174dd9b700 1 -- 172.21.15.6:0/2569763505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 msgr2=0x559557110b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f174dd9b700 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557110b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f174dd9b700 1 -- 172.21.15.6:0/2569763505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559556ee1630 con 0x559557111060 2023-09-13T09:54:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f174e59c700 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f174dd9b700 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x55955710f4c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17400115f0 tx=0x7f1740011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d97ce452c6f3e892 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f173cff9700 1 -- 172.21.15.6:0/2569763505 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740004230 con 0x559557111060 2023-09-13T09:54:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f173cff9700 1 -- 172.21.15.6:0/2569763505 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1740004390 con 0x559557111060 2023-09-13T09:54:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.333+0000 7f173cff9700 1 -- 172.21.15.6:0/2569763505 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17400198c0 con 0x559557111060 2023-09-13T09:54:30.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 -- 172.21.15.6:0/2569763505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 msgr2=0x55955710f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x55955710f4c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17400115f0 tx=0x7f1740011900 comp rx=0 tx=0).stop 2023-09-13T09:54:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 -- 172.21.15.6:0/2569763505 shutdown_connections 2023-09-13T09:54:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x55955710fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557110b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/2569763505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x55955710f4c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 -- 172.21.15.6:0/2569763505 >> 172.21.15.6:0/2569763505 conn(0x55955706dc80 msgr2=0x559557109f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 -- 172.21.15.6:0/2569763505 shutdown_connections 2023-09-13T09:54:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 -- 172.21.15.6:0/2569763505 wait complete. 2023-09-13T09:54:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.334+0000 7f1760ecfb80 1 -- start start 2023-09-13T09:54:30.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 1 Processor -- start 2023-09-13T09:54:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557118e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557119380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x5595571203c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559556fffbb0 con 0x559557110700 2023-09-13T09:54:30.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559556fff8b0 con 0x559557111060 2023-09-13T09:54:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559556ee3920 con 0x55955710fa00 2023-09-13T09:54:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f1760ecfb80 10 client.0 _ll_register_callbacks cb 0x559556ffd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557119380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557119380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43224/0 (socket says 172.21.15.6:43224) 2023-09-13T09:54:30.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 -- 172.21.15.6:0/72565057 learned_addr learned my addr 172.21.15.6:0/72565057 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174ed9d700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x5595571203c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174e59c700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557118e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 -- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 msgr2=0x559557118e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557118e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 -- 172.21.15.6:0/72565057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 msgr2=0x5595571203c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x5595571203c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174dd9b700 1 -- 172.21.15.6:0/72565057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1740009d50 con 0x559557110700 2023-09-13T09:54:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174ed9d700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x5595571203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.335+0000 7f174e59c700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:30.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f174dd9b700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557119380 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f1740011c50 tx=0x7f1740005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db44c4979285bed server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1735ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1735ffb700 1 -- 172.21.15.6:0/72565057 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1740003680 con 0x559557110700 2023-09-13T09:54:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559557102670 con 0x559557110700 2023-09-13T09:54:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1735ffb700 1 -- 172.21.15.6:0/72565057 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17400037e0 con 0x559557110700 2023-09-13T09:54:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1735ffb700 1 -- 172.21.15.6:0/72565057 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17400039a0 con 0x559557110700 2023-09-13T09:54:30.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 10 client.19398 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5595570797a0 con 0x559557110700 2023-09-13T09:54:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1735ffb700 1 -- 172.21.15.6:0/72565057 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559557102670 con 0x559557110700 2023-09-13T09:54:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1735ffb700 1 -- 172.21.15.6:0/72565057 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f1740021040 con 0x559557110700 2023-09-13T09:54:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 10 client.19398 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 10 client.19398 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:54:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 20 client.19398 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557124b00 0x559557126f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 4 client.19398 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.336+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55955705a970 con 0x559557124b00 2023-09-13T09:54:30.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.338+0000 7f174e59c700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557124b00 0x559557126f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.339+0000 7f174e59c700 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557124b00 0x559557126f20 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=50a5413f6029b42d server_cookie=92b2bd475e88af30 in_seq=0 out_seq=0 2023-09-13T09:54:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.339+0000 7f1735ffb700 10 client.19398 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:54:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.340+0000 7f1735ffb700 1 -- 172.21.15.6:0/72565057 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55955705a970 con 0x559557124b00 2023-09-13T09:54:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.340+0000 7f1735ffb700 10 client.19398 handle_command_reply: tid=0 2023-09-13T09:54:30.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 client.19398 shutdown 2023-09-13T09:54:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 msgr2=0x559557119380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557119380 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f1740011c50 tx=0x7f1740005040 comp rx=0 tx=0).stop 2023-09-13T09:54:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 shutdown_connections 2023-09-13T09:54:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557124b00 0x559557126f20 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557111060 0x5595571203c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1735ffb700 0 client.19398 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:54:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557118e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/72565057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x559557119380 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 >> 172.21.15.6:0/72565057 conn(0x55955706dc80 msgr2=0x5595571047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 shutdown_connections 2023-09-13T09:54:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 1 -- 172.21.15.6:0/72565057 wait complete. 2023-09-13T09:54:30.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.341+0000 7f1760ecfb80 20 client.19398 trim_cache size 0 max 16384 2023-09-13T09:54:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.355+0000 7f1760ecfb80 1 Processor -- start 2023-09-13T09:54:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.355+0000 7f1760ecfb80 1 -- start start 2023-09-13T09:54:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955706dc80 0x55955710f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557120380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557110700 0x559557120cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595571068e0 con 0x55955706dc80 2023-09-13T09:54:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559557102400 con 0x559557110700 2023-09-13T09:54:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559557119ac0 con 0x55955710fa00 2023-09-13T09:54:30.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955706dc80 0x55955710f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955706dc80 0x55955710f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43232/0 (socket says 172.21.15.6:43232) 2023-09-13T09:54:30.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 -- 172.21.15.6:0/3117538011 learned_addr learned my addr 172.21.15.6:0/3117538011 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174dd9b700 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557120380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174ed9d700 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557110700 0x559557120cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 -- 172.21.15.6:0/3117538011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 msgr2=0x559557120380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557120380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 -- 172.21.15.6:0/3117538011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557110700 msgr2=0x559557120cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557110700 0x559557120cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 -- 172.21.15.6:0/3117538011 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559556e8dde0 con 0x55955706dc80 2023-09-13T09:54:30.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f174e59c700 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955706dc80 0x55955710f4c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1744099250 tx=0x7f1744084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdde3a0319ef5f76 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.356+0000 7f173d7fa700 1 -- 172.21.15.6:0/3117538011 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174409d380 con 0x55955706dc80 2023-09-13T09:54:30.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f173d7fa700 1 -- 172.21.15.6:0/3117538011 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17440b0070 con 0x55955706dc80 2023-09-13T09:54:30.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f173d7fa700 1 -- 172.21.15.6:0/3117538011 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440978f0 con 0x55955706dc80 2023-09-13T09:54:30.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 -- 172.21.15.6:0/3117538011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955706dc80 msgr2=0x55955710f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955706dc80 0x55955710f4c0 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f1744099250 tx=0x7f1744084040 comp rx=0 tx=0).stop 2023-09-13T09:54:30.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 -- 172.21.15.6:0/3117538011 shutdown_connections 2023-09-13T09:54:30.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559557110700 0x559557120cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55955706dc80 0x55955710f4c0 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/3117538011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955710fa00 0x559557120380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 -- 172.21.15.6:0/3117538011 >> 172.21.15.6:0/3117538011 conn(0x559557117ee0 msgr2=0x559557109e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.357+0000 7f1760ecfb80 1 -- 172.21.15.6:0/3117538011 shutdown_connections 2023-09-13T09:54:30.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 -- 172.21.15.6:0/3117538011 wait complete. 2023-09-13T09:54:30.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 -- start start 2023-09-13T09:54:30.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 Processor -- start 2023-09-13T09:54:30.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955706dc80 0x55955711c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55955710fa00 0x55955711c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x55955711f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955711fae0 con 0x559557110700 2023-09-13T09:54:30.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955711fc50 con 0x55955710fa00 2023-09-13T09:54:30.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55955711fe10 con 0x55955706dc80 2023-09-13T09:54:30.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.358+0000 7f1760ecfb80 10 client.0 _ll_register_callbacks cb 0x559556ffd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955706dc80 0x55955711c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955706dc80 0x55955711c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46290/0 (socket says 172.21.15.6:46290) 2023-09-13T09:54:30.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 -- 172.21.15.6:0/4273711672 learned_addr learned my addr 172.21.15.6:0/4273711672 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174ed9d700 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x55955711f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55955710fa00 0x55955711c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 -- 172.21.15.6:0/4273711672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55955710fa00 msgr2=0x55955711c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55955710fa00 0x55955711c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 -- 172.21.15.6:0/4273711672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 msgr2=0x55955711f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x55955711f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 -- 172.21.15.6:0/4273711672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17440ace70 con 0x55955706dc80 2023-09-13T09:54:30.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f174e59c700 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955706dc80 0x55955711c040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17440994e0 tx=0x7f1744003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ac7807e746c8f3f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f1735ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:54:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.359+0000 7f1735ffb700 1 -- 172.21.15.6:0/4273711672 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17440652e0 con 0x55955706dc80 2023-09-13T09:54:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1735ffb700 1 -- 172.21.15.6:0/4273711672 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17440a15c0 con 0x55955706dc80 2023-09-13T09:54:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1740004390 con 0x55955706dc80 2023-09-13T09:54:30.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1735ffb700 1 -- 172.21.15.6:0/4273711672 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f174401fe00 con 0x55955706dc80 2023-09-13T09:54:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 10 client.28711 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x559556e76c60 con 0x55955706dc80 2023-09-13T09:54:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1735ffb700 1 -- 172.21.15.6:0/4273711672 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1740004390 con 0x55955706dc80 2023-09-13T09:54:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1735ffb700 1 -- 172.21.15.6:0/4273711672 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f17440997b0 con 0x55955706dc80 2023-09-13T09:54:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 10 client.28711 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 10 client.28711 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:54:30.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 20 client.28711 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557111060 0x55955717b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 4 client.28711 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:54:30.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55955701b050 con 0x559557111060 2023-09-13T09:54:30.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.360+0000 7f174dd9b700 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557111060 0x55955717b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.361+0000 7f174dd9b700 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557111060 0x55955717b430 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=60f51d67f4e8221d server_cookie=5026682cd26a7cd2 in_seq=0 out_seq=0 2023-09-13T09:54:30.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.361+0000 7f1735ffb700 10 client.28711 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:54:30.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1735ffb700 1 -- 172.21.15.6:0/4273711672 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55955701b050 con 0x559557111060 2023-09-13T09:54:30.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1735ffb700 10 client.28711 handle_command_reply: tid=0 2023-09-13T09:54:30.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 client.28711 shutdown 2023-09-13T09:54:30.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955706dc80 msgr2=0x55955711c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955706dc80 0x55955711c040 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f17440994e0 tx=0x7f1744003680 comp rx=0 tx=0).stop 2023-09-13T09:54:30.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 shutdown_connections 2023-09-13T09:54:30.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x559557111060 0x55955717b430 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559557110700 0x55955711f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55955706dc80 0x55955711c040 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1735ffb700 0 client.28711 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:54:30.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 --2- 172.21.15.6:0/4273711672 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55955710fa00 0x55955711c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 >> 172.21.15.6:0/4273711672 conn(0x559557117ee0 msgr2=0x559557113840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 shutdown_connections 2023-09-13T09:54:30.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 1 -- 172.21.15.6:0/4273711672 wait complete. 2023-09-13T09:54:30.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.364+0000 7f1760ecfb80 20 client.28711 trim_cache size 0 max 16384 2023-09-13T09:54:30.384 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:54:30.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17380a0640 msgr2=0x7f17380a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17380a0640 0x7f17380a2b00 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f1748009fd0 tx=0x7f174800b720 comp rx=0 tx=0).stop 2023-09-13T09:54:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 msgr2=0x7f175019fa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 0x7f175019fa40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f174400e970 tx=0x7f174400ec80 comp rx=0 tx=0).stop 2023-09-13T09:54:30.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 shutdown_connections 2023-09-13T09:54:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17501013c0 0x7f17501a45e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17500ff8f0 0x7f175019fa40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17380a0640 0x7f17380a2b00 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 --2- 172.21.15.6:0/2357409389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1750100290 0x7f17501a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 >> 172.21.15.6:0/2357409389 conn(0x7f17500fb250 msgr2=0x7f1750068dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 shutdown_connections 2023-09-13T09:54:30.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.365+0000 7f1754cea700 1 -- 172.21.15.6:0/2357409389 wait complete. 2023-09-13T09:54:30.388 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:54:30.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 79785 40.70 MB/sec warmup 110 sec latency 103.740 ms 2023-09-13T09:54:30.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.638+0000 7f3e0dac2700 1 -- 172.21.15.6:0/3905110299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 msgr2=0x7f3e08104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.638+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/3905110299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e08104df0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000b0a0 tx=0x7f3e0000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.641+0000 7f3e0dac2700 1 -- 172.21.15.6:0/3905110299 shutdown_connections 2023-09-13T09:54:30.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.641+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/3905110299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e08104df0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.641+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/3905110299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e080ff630 0x7f3e08101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.641+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/3905110299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e08101fa0 0x7f3e08104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.641+0000 7f3e0dac2700 1 -- 172.21.15.6:0/3905110299 >> 172.21.15.6:0/3905110299 conn(0x7f3e080fb250 msgr2=0x7f3e080fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.641+0000 7f3e0dac2700 1 -- 172.21.15.6:0/3905110299 shutdown_connections 2023-09-13T09:54:30.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.641+0000 7f3e0dac2700 1 -- 172.21.15.6:0/3905110299 wait complete. 2023-09-13T09:54:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 Processor -- start 2023-09-13T09:54:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 -- start start 2023-09-13T09:54:30.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e080ff630 0x7f3e0819d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e08101fa0 0x7f3e0819d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e081a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e081a4d30 con 0x7f3e08104970 2023-09-13T09:54:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e081a4e70 con 0x7f3e08101fa0 2023-09-13T09:54:30.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e0dac2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e081a5000 con 0x7f3e080ff630 2023-09-13T09:54:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e081a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e077fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e080ff630 0x7f3e0819d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e081a4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43254/0 (socket says 172.21.15.6:43254) 2023-09-13T09:54:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e07fff700 1 -- 172.21.15.6:0/845679682 learned_addr learned my addr 172.21.15.6:0/845679682 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e077fe700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e080ff630 0x7f3e0819d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46304/0 (socket says 172.21.15.6:46304) 2023-09-13T09:54:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.642+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e08101fa0 0x7f3e0819d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e07fff700 1 -- 172.21.15.6:0/845679682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e080ff630 msgr2=0x7f3e0819d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e07fff700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e080ff630 0x7f3e0819d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e07fff700 1 -- 172.21.15.6:0/845679682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e08101fa0 msgr2=0x7f3e0819d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e07fff700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e08101fa0 0x7f3e0819d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e07fff700 1 -- 172.21.15.6:0/845679682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e00009d00 con 0x7f3e08104970 2023-09-13T09:54:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e07fff700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e081a4760 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000b780 tx=0x7f3e0000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e04ff9700 1 -- 172.21.15.6:0/845679682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0000e040 con 0x7f3e08104970 2023-09-13T09:54:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e04ff9700 1 -- 172.21.15.6:0/845679682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e00004c50 con 0x7f3e08104970 2023-09-13T09:54:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.643+0000 7f3e04ff9700 1 -- 172.21.15.6:0/845679682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e00005280 con 0x7f3e08104970 2023-09-13T09:54:30.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.644+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e081a5280 con 0x7f3e08104970 2023-09-13T09:54:30.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.644+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e081a56b0 con 0x7f3e08104970 2023-09-13T09:54:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e04ff9700 1 -- 172.21.15.6:0/845679682 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3e0001d470 con 0x7f3e08104970 2023-09-13T09:54:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 Processor -- start 2023-09-13T09:54:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 -- start start 2023-09-13T09:54:30.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x5602748fbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x5602748fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x5602748fae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560274853780 con 0x5602748fb700 2023-09-13T09:54:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602748510a0 con 0x5602748fc060 2023-09-13T09:54:30.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56027484c990 con 0x5602748faa00 2023-09-13T09:54:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e04ff9700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3df00a0640 0x7f3df00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.648+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x5602748fbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x5602748fbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43256/0 (socket says 172.21.15.6:43256) 2023-09-13T09:54:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 -- 172.21.15.6:0/3334403960 learned_addr learned my addr 172.21.15.6:0/3334403960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x5602748fae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e07fff700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3df00a0640 0x7f3df00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e077fe700 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x5602748fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e04ff9700 1 -- 172.21.15.6:0/845679682 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e000cd190 con 0x7f3e08104970 2023-09-13T09:54:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 -- 172.21.15.6:0/3334403960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 msgr2=0x5602748fae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x5602748fae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 -- 172.21.15.6:0/3334403960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 msgr2=0x5602748fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x5602748fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 -- 172.21.15.6:0/3334403960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602746cc630 con 0x5602748fb700 2023-09-13T09:54:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e07fff700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3df00a0640 0x7f3df00a2b00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3e00007a60 tx=0x7f3e00090340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x5602748fbb20 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0138f0 tx=0x7f3dfc009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1828927cbeb0a991 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.649+0000 7f3df5ffb700 1 -- 172.21.15.6:0/3334403960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc004830 con 0x5602748fb700 2023-09-13T09:54:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3df5ffb700 1 -- 172.21.15.6:0/3334403960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dfc004e50 con 0x5602748fb700 2023-09-13T09:54:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3df5ffb700 1 -- 172.21.15.6:0/3334403960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc010460 con 0x5602748fb700 2023-09-13T09:54:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/3334403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 msgr2=0x5602748fbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x5602748fbb20 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc0138f0 tx=0x7f3dfc009850 comp rx=0 tx=0).stop 2023-09-13T09:54:30.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/3334403960 shutdown_connections 2023-09-13T09:54:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x5602748fae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x5602748fbb20 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.650+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/3334403960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x5602748fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/3334403960 >> 172.21.15.6:0/3334403960 conn(0x560274858c80 msgr2=0x5602748f4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/3334403960 shutdown_connections 2023-09-13T09:54:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/3334403960 wait complete. 2023-09-13T09:54:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 -- start start 2023-09-13T09:54:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 Processor -- start 2023-09-13T09:54:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x560274903f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x560274904460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x56027490b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602747eabb0 con 0x5602748fb700 2023-09-13T09:54:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602747ea8b0 con 0x5602748fc060 2023-09-13T09:54:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.651+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602746ce920 con 0x5602748faa00 2023-09-13T09:54:30.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e19ca7b80 10 client.0 _ll_register_callbacks cb 0x5602747e8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x560274904460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x560274903f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x56027490b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x560274904460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43266/0 (socket says 172.21.15.6:43266) 2023-09-13T09:54:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 -- 172.21.15.6:0/1260777967 learned_addr learned my addr 172.21.15.6:0/1260777967 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 -- 172.21.15.6:0/1260777967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 msgr2=0x560274903f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x560274903f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 -- 172.21.15.6:0/1260777967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 msgr2=0x56027490b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x56027490b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 -- 172.21.15.6:0/1260777967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc01b040 con 0x5602748fb700 2023-09-13T09:54:30.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e077fe700 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x560274904460 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3df8012860 tx=0x7f3df8012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4de1691adc2a70b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3deaffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3deaffd700 1 -- 172.21.15.6:0/1260777967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8017070 con 0x5602748fb700 2023-09-13T09:54:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3deaffd700 1 -- 172.21.15.6:0/1260777967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3df800f5e0 con 0x5602748fb700 2023-09-13T09:54:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.652+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5602748ed670 con 0x5602748fb700 2023-09-13T09:54:30.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3deaffd700 1 -- 172.21.15.6:0/1260777967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3df80122e0 con 0x5602748fb700 2023-09-13T09:54:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 10 client.19416 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x5602748647a0 con 0x5602748fb700 2023-09-13T09:54:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3deaffd700 1 -- 172.21.15.6:0/1260777967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5602748ed670 con 0x5602748fb700 2023-09-13T09:54:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3deaffd700 1 -- 172.21.15.6:0/1260777967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3df80269e0 con 0x5602748fb700 2023-09-13T09:54:30.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 10 client.19416 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 10 client.19416 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:54:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 20 client.19416 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56027490fea0 0x5602749122c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 4 client.19416 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.653+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560274845970 con 0x56027490fea0 2023-09-13T09:54:30.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.654+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56027490fea0 0x5602749122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.654+0000 7f3deaffd700 10 client.19416 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:54:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.654+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56027490fea0 0x5602749122c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e911bee2f3d317d3 server_cookie=c7337e91eeaaa906 in_seq=0 out_seq=0 2023-09-13T09:54:30.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.656+0000 7f3deaffd700 1 -- 172.21.15.6:0/1260777967 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560274845970 con 0x56027490fea0 2023-09-13T09:54:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.656+0000 7f3deaffd700 10 client.19416 handle_command_reply: tid=0 2023-09-13T09:54:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.656+0000 7f3e19ca7b80 1 client.19416 shutdown 2023-09-13T09:54:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 msgr2=0x560274904460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x560274904460 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f3df8012860 tx=0x7f3df8012b70 comp rx=0 tx=0).stop 2023-09-13T09:54:30.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 shutdown_connections 2023-09-13T09:54:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56027490fea0 0x5602749122c0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x56027490b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x560274903f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3deaffd700 0 client.19416 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:54:30.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1260777967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x560274904460 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 >> 172.21.15.6:0/1260777967 conn(0x560274858c80 msgr2=0x5602748ef7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 shutdown_connections 2023-09-13T09:54:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1260777967 wait complete. 2023-09-13T09:54:30.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.657+0000 7f3e19ca7b80 20 client.19416 trim_cache size 0 max 16384 2023-09-13T09:54:30.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 Processor -- start 2023-09-13T09:54:30.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 -- start start 2023-09-13T09:54:30.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748faa00 0x5602748fa4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748fb700 0x56027490b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274901e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56027490d110 con 0x5602748faa00 2023-09-13T09:54:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560274901be0 con 0x5602748fc060 2023-09-13T09:54:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602748ff4d0 con 0x5602748fb700 2023-09-13T09:54:30.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748faa00 0x5602748fa4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748faa00 0x5602748fa4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43272/0 (socket says 172.21.15.6:43272) 2023-09-13T09:54:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e06ffd700 1 -- 172.21.15.6:0/415339142 learned_addr learned my addr 172.21.15.6:0/415339142 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e077fe700 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748fb700 0x56027490b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274901e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e077fe700 1 -- 172.21.15.6:0/415339142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 msgr2=0x560274901e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e077fe700 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274901e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e077fe700 1 -- 172.21.15.6:0/415339142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748faa00 msgr2=0x5602748fa4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e077fe700 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748faa00 0x5602748fa4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.671+0000 7f3e077fe700 1 -- 172.21.15.6:0/415339142 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560274678de0 con 0x5602748fb700 2023-09-13T09:54:30.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.672+0000 7f3e077fe700 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748fb700 0x56027490b460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3df8026fd0 tx=0x7f3df80092d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42bad5f0e57d3410 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.672+0000 7f3df67fc700 1 -- 172.21.15.6:0/415339142 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8017040 con 0x5602748fb700 2023-09-13T09:54:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.672+0000 7f3df67fc700 1 -- 172.21.15.6:0/415339142 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3df8010430 con 0x5602748fb700 2023-09-13T09:54:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.672+0000 7f3df67fc700 1 -- 172.21.15.6:0/415339142 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8005620 con 0x5602748fb700 2023-09-13T09:54:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/415339142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748fb700 msgr2=0x56027490b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748fb700 0x56027490b460 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f3df8026fd0 tx=0x7f3df80092d0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/415339142 shutdown_connections 2023-09-13T09:54:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274901e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748faa00 0x5602748fa4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/415339142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748fb700 0x56027490b460 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/415339142 >> 172.21.15.6:0/415339142 conn(0x560274858c80 msgr2=0x560274902b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/415339142 shutdown_connections 2023-09-13T09:54:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/415339142 wait complete. 2023-09-13T09:54:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 -- start start 2023-09-13T09:54:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.673+0000 7f3e19ca7b80 1 Processor -- start 2023-09-13T09:54:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x56027490acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x56027490b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e19ca7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274907750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560274907d20 con 0x5602748fb700 2023-09-13T09:54:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560274907e90 con 0x5602748fc060 2023-09-13T09:54:30.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e19ca7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560274908050 con 0x5602748faa00 2023-09-13T09:54:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e19ca7b80 10 client.0 _ll_register_callbacks cb 0x5602747e8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x56027490acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x56027490acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46332/0 (socket says 172.21.15.6:46332) 2023-09-13T09:54:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 -- 172.21.15.6:0/1503041018 learned_addr learned my addr 172.21.15.6:0/1503041018 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274907750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e077fe700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x56027490b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 -- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 msgr2=0x560274907750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274907750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 -- 172.21.15.6:0/1503041018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 msgr2=0x56027490b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x56027490b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.674+0000 7f3e06ffd700 1 -- 172.21.15.6:0/1503041018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5602748647a0 con 0x5602748faa00 2023-09-13T09:54:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3e077fe700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x56027490b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:54:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3e06ffd700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x56027490acb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005850 tx=0x7f3dfc009cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be3a5a98d93d4b8b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3deaffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:54:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3deaffd700 1 -- 172.21.15.6:0/1503041018 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc025070 con 0x5602748faa00 2023-09-13T09:54:30.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3deaffd700 1 -- 172.21.15.6:0/1503041018 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3dfc013320 con 0x5602748faa00 2023-09-13T09:54:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3dfc004e50 con 0x5602748faa00 2023-09-13T09:54:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3deaffd700 1 -- 172.21.15.6:0/1503041018 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dfc005310 con 0x5602748faa00 2023-09-13T09:54:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3e19ca7b80 10 client.28729 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x560274661c60 con 0x5602748faa00 2023-09-13T09:54:30.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3deaffd700 1 -- 172.21.15.6:0/1503041018 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dfc03d020 con 0x5602748faa00 2023-09-13T09:54:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.675+0000 7f3deaffd700 1 -- 172.21.15.6:0/1503041018 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3dfc003840 con 0x5602748faa00 2023-09-13T09:54:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.676+0000 7f3e19ca7b80 10 client.28729 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.676+0000 7f3e19ca7b80 10 client.28729 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:54:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.676+0000 7f3e19ca7b80 20 client.28729 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.676+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5602749650c0 0x5602749674e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.676+0000 7f3e19ca7b80 4 client.28729 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:54:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.676+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560274806050 con 0x5602749650c0 2023-09-13T09:54:30.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.676+0000 7f3e077fe700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5602749650c0 0x5602749674e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.679+0000 7f3deaffd700 10 client.28729 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:54:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.679+0000 7f3e077fe700 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5602749650c0 0x5602749674e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=eae3aa3765ed5d9e server_cookie=6829398c345ef98e in_seq=0 out_seq=0 2023-09-13T09:54:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.689+0000 7f3deaffd700 1 -- 172.21.15.6:0/1503041018 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560274806050 con 0x5602749650c0 2023-09-13T09:54:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.689+0000 7f3deaffd700 10 client.28729 handle_command_reply: tid=0 2023-09-13T09:54:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.689+0000 7f3e19ca7b80 1 client.28729 shutdown 2023-09-13T09:54:30.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 msgr2=0x56027490acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x56027490acb0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc005850 tx=0x7f3dfc009cb0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 shutdown_connections 2023-09-13T09:54:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5602749650c0 0x5602749674e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5602748fc060 0x560274907750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3deaffd700 0 client.28729 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:54:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5602748faa00 0x56027490acb0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 --2- 172.21.15.6:0/1503041018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5602748fb700 0x56027490b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 >> 172.21.15.6:0/1503041018 conn(0x560274858c80 msgr2=0x5602748fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 shutdown_connections 2023-09-13T09:54:30.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 1 -- 172.21.15.6:0/1503041018 wait complete. 2023-09-13T09:54:30.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.690+0000 7f3e19ca7b80 20 client.28729 trim_cache size 0 max 16384 2023-09-13T09:54:30.696 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:54:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3df00a0640 msgr2=0x7f3df00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3df00a0640 0x7f3df00a2b00 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3e00007a60 tx=0x7f3e00090340 comp rx=0 tx=0).stop 2023-09-13T09:54:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 msgr2=0x7f3e081a4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e081a4760 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f3e0000b780 tx=0x7f3e0000bab0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 shutdown_connections 2023-09-13T09:54:30.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3df00a0640 0x7f3df00a2b00 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e08104970 0x7f3e081a4760 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e080ff630 0x7f3e0819d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 --2- 172.21.15.6:0/845679682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e08101fa0 0x7f3e0819d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 >> 172.21.15.6:0/845679682 conn(0x7f3e080fb250 msgr2=0x7f3e081002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 shutdown_connections 2023-09-13T09:54:30.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.691+0000 7f3e0dac2700 1 -- 172.21.15.6:0/845679682 wait complete. 2023-09-13T09:54:30.707 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:54:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2019117416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e981020f0 msgr2=0x7f8e98102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2019117416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e981020f0 0x7f8e98102550 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8e80009990 tx=0x7f8e80009ca0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2019117416 shutdown_connections 2023-09-13T09:54:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2019117416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e98102a90 0x7f8e98109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2019117416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e980ff080 0x7f8e980ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2019117416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e981020f0 0x7f8e98102550 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2019117416 >> 172.21.15.6:0/2019117416 conn(0x7f8e980fa9b0 msgr2=0x7f8e980fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2019117416 shutdown_connections 2023-09-13T09:54:30.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.850+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2019117416 wait complete. 2023-09-13T09:54:30.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 Processor -- start 2023-09-13T09:54:30.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 -- start start 2023-09-13T09:54:30.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e980ff080 0x7f8e98101a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e981020f0 0x7f8e981000a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e98102a90 0x7f8e981005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98100d80 con 0x7f8e981020f0 2023-09-13T09:54:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98100ef0 con 0x7f8e98102a90 2023-09-13T09:54:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e9e78f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e981a0ba0 con 0x7f8e980ff080 2023-09-13T09:54:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e981020f0 0x7f8e981000a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.851+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e981020f0 0x7f8e981000a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43294/0 (socket says 172.21.15.6:43294) 2023-09-13T09:54:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e8ffff700 1 -- 172.21.15.6:0/2909033744 learned_addr learned my addr 172.21.15.6:0/2909033744 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e97fff700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e980ff080 0x7f8e98101a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e9cd2c700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e98102a90 0x7f8e981005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e8ffff700 1 -- 172.21.15.6:0/2909033744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e980ff080 msgr2=0x7f8e98101a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e980ff080 0x7f8e98101a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e8ffff700 1 -- 172.21.15.6:0/2909033744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e98102a90 msgr2=0x7f8e981005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e98102a90 0x7f8e981005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e8ffff700 1 -- 172.21.15.6:0/2909033744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800095f0 con 0x7f8e981020f0 2023-09-13T09:54:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e981020f0 0x7f8e981000a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f8e80004730 tx=0x7f8e80004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e95ffb700 1 -- 172.21.15.6:0/2909033744 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8001d070 con 0x7f8e981020f0 2023-09-13T09:54:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e981a0e20 con 0x7f8e981020f0 2023-09-13T09:54:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e95ffb700 1 -- 172.21.15.6:0/2909033744 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e80004c90 con 0x7f8e981020f0 2023-09-13T09:54:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e95ffb700 1 -- 172.21.15.6:0/2909033744 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e800054b0 con 0x7f8e981020f0 2023-09-13T09:54:30.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.852+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e981a1260 con 0x7f8e981020f0 2023-09-13T09:54:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.855+0000 7f8e95ffb700 1 -- 172.21.15.6:0/2909033744 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8e8000fbc0 con 0x7f8e981020f0 2023-09-13T09:54:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.855+0000 7f8e95ffb700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e840a0640 0x7f8e840a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8e97fff700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e840a0640 0x7f8e840a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8e95ffb700 1 -- 172.21.15.6:0/2909033744 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8e800cce40 con 0x7f8e981020f0 2023-09-13T09:54:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8e97fff700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e840a0640 0x7f8e840a2b00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8e98067d10 tx=0x7f8e88009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8eaa974b80 1 Processor -- start 2023-09-13T09:54:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8eaa974b80 1 -- start start 2023-09-13T09:54:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d182b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d183060 0x55dd5d1814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.856+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d181a00 0x55dd5d181e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d0da780 con 0x55dd5d182700 2023-09-13T09:54:30.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d0d80a0 con 0x55dd5d183060 2023-09-13T09:54:30.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d0d3990 con 0x55dd5d181a00 2023-09-13T09:54:30.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d182b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d182b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43300/0 (socket says 172.21.15.6:43300) 2023-09-13T09:54:30.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 -- 172.21.15.6:0/589769100 learned_addr learned my addr 172.21.15.6:0/589769100 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e9cd2c700 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d181a00 0x55dd5d181e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d183060 0x55dd5d1814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 -- 172.21.15.6:0/589769100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d181a00 msgr2=0x55dd5d181e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d181a00 0x55dd5d181e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 -- 172.21.15.6:0/589769100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d183060 msgr2=0x55dd5d1814c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d183060 0x55dd5d1814c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 -- 172.21.15.6:0/589769100 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd5cf53630 con 0x55dd5d182700 2023-09-13T09:54:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e97fff700 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d182b20 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009fd0 tx=0x7f8e88011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf0f7002c0cb0d1a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/589769100 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800ee90 con 0x55dd5d182700 2023-09-13T09:54:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/589769100 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e88015940 con 0x55dd5d182700 2023-09-13T09:54:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.857+0000 7f8e8e7fc700 1 -- 172.21.15.6:0/589769100 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880139d0 con 0x55dd5d182700 2023-09-13T09:54:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 -- 172.21.15.6:0/589769100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 msgr2=0x55dd5d182b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d182b20 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009fd0 tx=0x7f8e88011000 comp rx=0 tx=0).stop 2023-09-13T09:54:30.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 -- 172.21.15.6:0/589769100 shutdown_connections 2023-09-13T09:54:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d181a00 0x55dd5d181e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d182b20 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/589769100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d183060 0x55dd5d1814c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 -- 172.21.15.6:0/589769100 >> 172.21.15.6:0/589769100 conn(0x55dd5d0dfc80 msgr2=0x55dd5d17bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 -- 172.21.15.6:0/589769100 shutdown_connections 2023-09-13T09:54:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 -- 172.21.15.6:0/589769100 wait complete. 2023-09-13T09:54:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.858+0000 7f8eaa974b80 1 -- start start 2023-09-13T09:54:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 1 Processor -- start 2023-09-13T09:54:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d182700 0x55dd5d18b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d183060 0x55dd5d1924e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d071bb0 con 0x55dd5d183060 2023-09-13T09:54:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d0718b0 con 0x55dd5d181a00 2023-09-13T09:54:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5cf55920 con 0x55dd5d182700 2023-09-13T09:54:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8eaa974b80 10 client.0 _ll_register_callbacks cb 0x55dd5d06f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8e9cd2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d183060 0x55dd5d1924e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8e97fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d182700 0x55dd5d18b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8e9cd2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d183060 0x55dd5d1924e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43310/0 (socket says 172.21.15.6:43310) 2023-09-13T09:54:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.859+0000 7f8e9cd2c700 1 -- 172.21.15.6:0/531932272 learned_addr learned my addr 172.21.15.6:0/531932272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e97fff700 1 -- 172.21.15.6:0/531932272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d182700 msgr2=0x55dd5d18b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e97fff700 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d182700 0x55dd5d18b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e97fff700 1 -- 172.21.15.6:0/531932272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d183060 msgr2=0x55dd5d1924e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e97fff700 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d183060 0x55dd5d1924e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e97fff700 1 -- 172.21.15.6:0/531932272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8800e6c0 con 0x55dd5d181a00 2023-09-13T09:54:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e9cd2c700 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d183060 0x55dd5d1924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e97fff700 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18af60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e88017010 tx=0x7f8e88015ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f96000b4364c80 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e777fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:54:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e777fe700 1 -- 172.21.15.6:0/531932272 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88013b20 con 0x55dd5d181a00 2023-09-13T09:54:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dd5d174670 con 0x55dd5d181a00 2023-09-13T09:54:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e777fe700 1 -- 172.21.15.6:0/531932272 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8e88013c80 con 0x55dd5d181a00 2023-09-13T09:54:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8e777fe700 1 -- 172.21.15.6:0/531932272 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e88013e40 con 0x55dd5d181a00 2023-09-13T09:54:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8eaa974b80 10 client.28796 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.860+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55dd5d0eb7a0 con 0x55dd5d181a00 2023-09-13T09:54:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8e777fe700 1 -- 172.21.15.6:0/531932272 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55dd5d174670 con 0x55dd5d181a00 2023-09-13T09:54:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8e777fe700 1 -- 172.21.15.6:0/531932272 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f8e880283f0 con 0x55dd5d181a00 2023-09-13T09:54:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8eaa974b80 10 client.28796 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8eaa974b80 10 client.28796 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:54:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8eaa974b80 20 client.28796 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d196db0 0x55dd5d1991d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8eaa974b80 4 client.28796 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dd5d0cc970 con 0x55dd5d196db0 2023-09-13T09:54:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.861+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d196db0 0x55dd5d1991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.862+0000 7f8e777fe700 10 client.28796 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:54:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.862+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d196db0 0x55dd5d1991d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0878a1742db6818 server_cookie=5af984f5fb2bb506 in_seq=0 out_seq=0 2023-09-13T09:54:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8e777fe700 1 -- 172.21.15.6:0/531932272 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55dd5d0cc970 con 0x55dd5d196db0 2023-09-13T09:54:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8e777fe700 10 client.28796 handle_command_reply: tid=0 2023-09-13T09:54:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 client.28796 shutdown 2023-09-13T09:54:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 msgr2=0x55dd5d18af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18af60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8e88017010 tx=0x7f8e88015ee0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 shutdown_connections 2023-09-13T09:54:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d196db0 0x55dd5d1991d0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d183060 0x55dd5d1924e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18af60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/531932272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d182700 0x55dd5d18b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 >> 172.21.15.6:0/531932272 conn(0x55dd5d0dfc80 msgr2=0x55dd5d1767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8e777fe700 0 client.28796 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:54:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 shutdown_connections 2023-09-13T09:54:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 1 -- 172.21.15.6:0/531932272 wait complete. 2023-09-13T09:54:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.863+0000 7f8eaa974b80 20 client.28796 trim_cache size 0 max 16384 2023-09-13T09:54:30.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 Processor -- start 2023-09-13T09:54:30.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 -- start start 2023-09-13T09:54:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d181a00 0x55dd5d1814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d182700 0x55dd5d1924a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d188de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d18a410 con 0x55dd5d181a00 2023-09-13T09:54:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d18aad0 con 0x55dd5d182700 2023-09-13T09:54:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d194150 con 0x55dd5d183060 2023-09-13T09:54:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8e97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d181a00 0x55dd5d1814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8e97fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d181a00 0x55dd5d1814c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43314/0 (socket says 172.21.15.6:43314) 2023-09-13T09:54:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8e97fff700 1 -- 172.21.15.6:0/2559846780 learned_addr learned my addr 172.21.15.6:0/2559846780 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d182700 0x55dd5d1924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.878+0000 7f8e9cd2c700 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d188de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e97fff700 1 -- 172.21.15.6:0/2559846780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 msgr2=0x55dd5d188de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e97fff700 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d188de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e97fff700 1 -- 172.21.15.6:0/2559846780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d182700 msgr2=0x55dd5d1924a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e97fff700 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d182700 0x55dd5d1924a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e97fff700 1 -- 172.21.15.6:0/2559846780 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd5ceffde0 con 0x55dd5d181a00 2023-09-13T09:54:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e97fff700 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d181a00 0x55dd5d1814c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009270 tx=0x7f8e88006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c9e5569ab83ba4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e8effd700 1 -- 172.21.15.6:0/2559846780 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e880134c0 con 0x55dd5d181a00 2023-09-13T09:54:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e8effd700 1 -- 172.21.15.6:0/2559846780 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e8800ee90 con 0x55dd5d181a00 2023-09-13T09:54:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.879+0000 7f8e8effd700 1 -- 172.21.15.6:0/2559846780 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8801f670 con 0x55dd5d181a00 2023-09-13T09:54:30.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 -- 172.21.15.6:0/2559846780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d181a00 msgr2=0x55dd5d1814c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d181a00 0x55dd5d1814c0 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f8e88009270 tx=0x7f8e88006e10 comp rx=0 tx=0).stop 2023-09-13T09:54:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 -- 172.21.15.6:0/2559846780 shutdown_connections 2023-09-13T09:54:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d188de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d181a00 0x55dd5d1814c0 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/2559846780 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d182700 0x55dd5d1924a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 -- 172.21.15.6:0/2559846780 >> 172.21.15.6:0/2559846780 conn(0x55dd5d0dfc80 msgr2=0x55dd5d189be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 -- 172.21.15.6:0/2559846780 shutdown_connections 2023-09-13T09:54:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 -- 172.21.15.6:0/2559846780 wait complete. 2023-09-13T09:54:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 -- start start 2023-09-13T09:54:30.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.880+0000 7f8eaa974b80 1 Processor -- start 2023-09-13T09:54:30.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d18e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8eaa974b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d191100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d191640 con 0x55dd5d182700 2023-09-13T09:54:30.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d1917b0 con 0x55dd5d181a00 2023-09-13T09:54:30.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8eaa974b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd5d191970 con 0x55dd5d183060 2023-09-13T09:54:30.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8eaa974b80 10 client.0 _ll_register_callbacks cb 0x55dd5d06f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:30.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d18e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d18e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43322/0 (socket says 172.21.15.6:43322) 2023-09-13T09:54:30.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 -- 172.21.15.6:0/844699448 learned_addr learned my addr 172.21.15.6:0/844699448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:30.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e97fff700 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e9cd2c700 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d191100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 -- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 msgr2=0x55dd5d191100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d191100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 -- 172.21.15.6:0/844699448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 msgr2=0x55dd5d18dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:30.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 -- 172.21.15.6:0/844699448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd5d0eb7a0 con 0x55dd5d182700 2023-09-13T09:54:30.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e8ffff700 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d18e0e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000b2e0 tx=0x7f8e80005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6785f83b7b507b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:30.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e777fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:30.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.881+0000 7f8e777fe700 1 -- 172.21.15.6:0/844699448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e800a2650 con 0x55dd5d182700 2023-09-13T09:54:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8e777fe700 1 -- 172.21.15.6:0/844699448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8e80098a10 con 0x55dd5d182700 2023-09-13T09:54:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8e88015940 con 0x55dd5d182700 2023-09-13T09:54:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8e777fe700 1 -- 172.21.15.6:0/844699448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8e80005630 con 0x55dd5d182700 2023-09-13T09:54:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 10 client.19440 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55dd5cee8c60 con 0x55dd5d182700 2023-09-13T09:54:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8e777fe700 1 -- 172.21.15.6:0/844699448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8e800b6080 con 0x55dd5d182700 2023-09-13T09:54:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8e777fe700 1 -- 172.21.15.6:0/844699448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f8e80099b60 con 0x55dd5d182700 2023-09-13T09:54:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 10 client.19440 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 10 client.19440 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:54:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 20 client.19440 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d1eb120 0x55dd5d1ed540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 4 client.19440 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:54:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55dd5d08d050 con 0x55dd5d1eb120 2023-09-13T09:54:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.882+0000 7f8e97fff700 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d1eb120 0x55dd5d1ed540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8e777fe700 10 client.19440 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:54:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8e97fff700 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d1eb120 0x55dd5d1ed540 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60308b54a556b23 server_cookie=94de0583a50246c1 in_seq=0 out_seq=0 2023-09-13T09:54:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8e777fe700 1 -- 172.21.15.6:0/844699448 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55dd5d08d050 con 0x55dd5d1eb120 2023-09-13T09:54:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8e777fe700 10 client.19440 handle_command_reply: tid=0 2023-09-13T09:54:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 client.19440 shutdown 2023-09-13T09:54:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 msgr2=0x55dd5d18e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d18e0e0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f8e8000b2e0 tx=0x7f8e80005a90 comp rx=0 tx=0).stop 2023-09-13T09:54:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 shutdown_connections 2023-09-13T09:54:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55dd5d1eb120 0x55dd5d1ed540 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5d183060 0x55dd5d191100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55dd5d181a00 0x55dd5d18dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 --2- 172.21.15.6:0/844699448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55dd5d182700 0x55dd5d18e0e0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8e777fe700 0 client.19440 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:54:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 >> 172.21.15.6:0/844699448 conn(0x55dd5d0dfc80 msgr2=0x55dd5d188de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 shutdown_connections 2023-09-13T09:54:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.883+0000 7f8eaa974b80 1 -- 172.21.15.6:0/844699448 wait complete. 2023-09-13T09:54:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8eaa974b80 20 client.19440 trim_cache size 0 max 16384 2023-09-13T09:54:30.905 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:54:30.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e840a0640 msgr2=0x7f8e840a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e840a0640 0x7f8e840a2b00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8e98067d10 tx=0x7f8e88009190 comp rx=0 tx=0).stop 2023-09-13T09:54:30.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e981020f0 msgr2=0x7f8e981000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:30.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e981020f0 0x7f8e981000a0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f8e80004730 tx=0x7f8e80004760 comp rx=0 tx=0).stop 2023-09-13T09:54:30.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 shutdown_connections 2023-09-13T09:54:30.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8e98102a90 0x7f8e981005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e980ff080 0x7f8e98101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8e840a0640 0x7f8e840a2b00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 --2- 172.21.15.6:0/2909033744 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e981020f0 0x7f8e981000a0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:30.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 >> 172.21.15.6:0/2909033744 conn(0x7f8e980fa9b0 msgr2=0x7f8e980fcc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:30.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 shutdown_connections 2023-09-13T09:54:30.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:30.884+0000 7f8e9e78f700 1 -- 172.21.15.6:0/2909033744 wait complete. 2023-09-13T09:54:30.909 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:54:31.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:30 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3292338043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:54:31.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 -- 172.21.15.6:0/1470296479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080101840 msgr2=0x7f4080103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 --2- 172.21.15.6:0/1470296479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080101840 0x7f4080103c30 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f4074009990 tx=0x7f4074009ca0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 -- 172.21.15.6:0/1470296479 shutdown_connections 2023-09-13T09:54:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 --2- 172.21.15.6:0/1470296479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4080106aa0 0x7f4080108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 --2- 172.21.15.6:0/1470296479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080101840 0x7f4080103c30 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 --2- 172.21.15.6:0/1470296479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080104170 0x7f4080106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 -- 172.21.15.6:0/1470296479 >> 172.21.15.6:0/1470296479 conn(0x7f40800fb250 msgr2=0x7f40800fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 -- 172.21.15.6:0/1470296479 shutdown_connections 2023-09-13T09:54:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.057+0000 7f4087033700 1 -- 172.21.15.6:0/1470296479 wait complete. 2023-09-13T09:54:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 Processor -- start 2023-09-13T09:54:31.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 -- start start 2023-09-13T09:54:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080101840 0x7f40801011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4080104170 0x7f40800ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080106aa0 0x7f40800ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408019a950 con 0x7f4080106aa0 2023-09-13T09:54:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080100270 con 0x7f4080104170 2023-09-13T09:54:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4087033700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080100430 con 0x7f4080101840 2023-09-13T09:54:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4084dcf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080101840 0x7f40801011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f407ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4080104170 0x7f40800ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f40855d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080106aa0 0x7f40800ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4084dcf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080101840 0x7f40801011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46388/0 (socket says 172.21.15.6:46388) 2023-09-13T09:54:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f407ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4080104170 0x7f40800ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36860/0 (socket says 172.21.15.6:36860) 2023-09-13T09:54:31.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4084dcf700 1 -- 172.21.15.6:0/1963119431 learned_addr learned my addr 172.21.15.6:0/1963119431 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4084dcf700 1 -- 172.21.15.6:0/1963119431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4080104170 msgr2=0x7f40800ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4084dcf700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4080104170 0x7f40800ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4084dcf700 1 -- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080106aa0 msgr2=0x7f40800ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.058+0000 7f4084dcf700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080106aa0 0x7f40800ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f4084dcf700 1 -- 172.21.15.6:0/1963119431 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40740095f0 con 0x7f4080101840 2023-09-13T09:54:31.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f40855d0700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080106aa0 0x7f40800ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:31.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f4084dcf700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080101840 0x7f40801011b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40740059d0 tx=0x7f40740047a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f407dffb700 1 -- 172.21.15.6:0/1963119431 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407401d070 con 0x7f4080101840 2023-09-13T09:54:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40801a5300 con 0x7f4080101840 2023-09-13T09:54:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f407dffb700 1 -- 172.21.15.6:0/1963119431 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f407400fb90 con 0x7f4080101840 2023-09-13T09:54:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f407dffb700 1 -- 172.21.15.6:0/1963119431 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074017650 con 0x7f4080101840 2023-09-13T09:54:31.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.059+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40801a56f0 con 0x7f4080101840 2023-09-13T09:54:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.062+0000 7f407dffb700 1 -- 172.21.15.6:0/1963119431 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f407400fd00 con 0x7f4080101840 2023-09-13T09:54:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.063+0000 7f407dffb700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40700a0640 0x7f40700a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.063+0000 7f407dffb700 1 -- 172.21.15.6:0/1963119431 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f40740cd360 con 0x7f4080101840 2023-09-13T09:54:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.063+0000 7f407ffff700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40700a0640 0x7f40700a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.063+0000 7f4093218b80 1 Processor -- start 2023-09-13T09:54:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.063+0000 7f4093218b80 1 -- start start 2023-09-13T09:54:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4093218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca26b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4093218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca27060 0x55b6cca254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4093218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 0x55b6cca25e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4093218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cc97e780 con 0x55b6cca25a00 2023-09-13T09:54:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4093218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cc97c0a0 con 0x55b6cca27060 2023-09-13T09:54:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4093218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cc977990 con 0x55b6cca26700 2023-09-13T09:54:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f407ffff700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40700a0640 0x7f40700a2b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f406c009c60 tx=0x7f406c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4084dcf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca26b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4084dcf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca26b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46396/0 (socket says 172.21.15.6:46396) 2023-09-13T09:54:31.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f40855d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 0x55b6cca25e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f4084dcf700 1 -- 172.21.15.6:0/45267590 learned_addr learned my addr 172.21.15.6:0/45267590 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:31.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f407ffff700 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca27060 0x55b6cca254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f407ffff700 1 -- 172.21.15.6:0/45267590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 msgr2=0x55b6cca26b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f407ffff700 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca26b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f407ffff700 1 -- 172.21.15.6:0/45267590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 msgr2=0x55b6cca25e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f407ffff700 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 0x55b6cca25e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.064+0000 7f407ffff700 1 -- 172.21.15.6:0/45267590 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6cc7f7630 con 0x55b6cca27060 2023-09-13T09:54:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.065+0000 7f407ffff700 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca27060 0x55b6cca254c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f406c005950 tx=0x7f406c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917bd2326a5cfadf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.065+0000 7f406affd700 1 -- 172.21.15.6:0/45267590 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c00ecf0 con 0x55b6cca27060 2023-09-13T09:54:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.065+0000 7f406affd700 1 -- 172.21.15.6:0/45267590 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f406c021070 con 0x55b6cca27060 2023-09-13T09:54:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.065+0000 7f406affd700 1 -- 172.21.15.6:0/45267590 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c026480 con 0x55b6cca27060 2023-09-13T09:54:31.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.066+0000 7f4093218b80 1 -- 172.21.15.6:0/45267590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca27060 msgr2=0x55b6cca254c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.066+0000 7f4093218b80 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca27060 0x55b6cca254c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f406c005950 tx=0x7f406c014000 comp rx=0 tx=0).stop 2023-09-13T09:54:31.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.066+0000 7f4093218b80 1 -- 172.21.15.6:0/45267590 shutdown_connections 2023-09-13T09:54:31.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.066+0000 7f4093218b80 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 0x55b6cca25e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.066+0000 7f4093218b80 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca26b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.066+0000 7f4093218b80 1 --2- 172.21.15.6:0/45267590 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca27060 0x55b6cca254c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.066+0000 7f4093218b80 1 -- 172.21.15.6:0/45267590 >> 172.21.15.6:0/45267590 conn(0x55b6cc983c80 msgr2=0x55b6cca1ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.067+0000 7f4093218b80 1 -- 172.21.15.6:0/45267590 shutdown_connections 2023-09-13T09:54:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.067+0000 7f4093218b80 1 -- 172.21.15.6:0/45267590 wait complete. 2023-09-13T09:54:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.067+0000 7f4093218b80 1 -- start start 2023-09-13T09:54:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 1 Processor -- start 2023-09-13T09:54:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 0x55b6cca3ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca40450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca27060 0x55b6cca47490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cc915bb0 con 0x55b6cca25a00 2023-09-13T09:54:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cc9158b0 con 0x55b6cca26700 2023-09-13T09:54:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cc7f9920 con 0x55b6cca27060 2023-09-13T09:54:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f4093218b80 10 client.0 _ll_register_callbacks cb 0x55b6cc913680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f407ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca40450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f407ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca40450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36872/0 (socket says 172.21.15.6:36872) 2023-09-13T09:54:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.068+0000 7f407ffff700 1 -- 172.21.15.6:0/223496093 learned_addr learned my addr 172.21.15.6:0/223496093 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f407ffff700 1 -- 172.21.15.6:0/223496093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca27060 msgr2=0x55b6cca47490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f407ffff700 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca27060 0x55b6cca47490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f407ffff700 1 -- 172.21.15.6:0/223496093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 msgr2=0x55b6cca3ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f407ffff700 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 0x55b6cca3ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f407ffff700 1 -- 172.21.15.6:0/223496093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f406c017070 con 0x55b6cca26700 2023-09-13T09:54:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f407ffff700 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca40450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f406c005850 tx=0x7f406c00eba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=edd16a36e7e86a9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f405ffff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:54:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.069+0000 7f405ffff700 1 -- 172.21.15.6:0/223496093 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f406c02a040 con 0x55b6cca26700 2023-09-13T09:54:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b6cca18670 con 0x55b6cca26700 2023-09-13T09:54:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f405ffff700 1 -- 172.21.15.6:0/223496093 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f406c004220 con 0x55b6cca26700 2023-09-13T09:54:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f405ffff700 1 -- 172.21.15.6:0/223496093 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f406c00ee70 con 0x55b6cca26700 2023-09-13T09:54:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 10 client.28811 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55b6cc98f7a0 con 0x55b6cca26700 2023-09-13T09:54:31.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f405ffff700 1 -- 172.21.15.6:0/223496093 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b6cca18670 con 0x55b6cca26700 2023-09-13T09:54:31.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f405ffff700 1 -- 172.21.15.6:0/223496093 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f406c003ac0 con 0x55b6cca26700 2023-09-13T09:54:31.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 10 client.28811 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:31.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 10 client.28811 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:31.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 20 client.28811 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:31.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca4bc80 0x55b6cca4e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 4 client.28811 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:31.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.070+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b6cc970970 con 0x55b6cca4bc80 2023-09-13T09:54:31.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.073+0000 7f4084dcf700 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca4bc80 0x55b6cca4e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.074+0000 7f405ffff700 10 client.28811 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:31.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.074+0000 7f4084dcf700 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca4bc80 0x55b6cca4e0c0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8279d8e81139bc71 server_cookie=71958fbbddca7d19 in_seq=0 out_seq=0 2023-09-13T09:54:31.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.074+0000 7f405ffff700 1 -- 172.21.15.6:0/223496093 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b6cc970970 con 0x55b6cca4bc80 2023-09-13T09:54:31.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.074+0000 7f405ffff700 10 client.28811 handle_command_reply: tid=0 2023-09-13T09:54:31.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.074+0000 7f4093218b80 1 client.28811 shutdown 2023-09-13T09:54:31.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.075+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 msgr2=0x55b6cca40450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.075+0000 7f4093218b80 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca40450 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f406c005850 tx=0x7f406c00eba0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 shutdown_connections 2023-09-13T09:54:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca27060 0x55b6cca47490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca4bc80 0x55b6cca4e0c0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cca25a00 0x55b6cca3ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 --2- 172.21.15.6:0/223496093 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca40450 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 >> 172.21.15.6:0/223496093 conn(0x55b6cc983c80 msgr2=0x55b6cca1a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f405ffff700 0 client.28811 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 shutdown_connections 2023-09-13T09:54:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 1 -- 172.21.15.6:0/223496093 wait complete. 2023-09-13T09:54:31.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.076+0000 7f4093218b80 20 client.28811 trim_cache size 0 max 16384 2023-09-13T09:54:31.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.098+0000 7f4093218b80 1 Processor -- start 2023-09-13T09:54:31.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.098+0000 7f4093218b80 1 -- start start 2023-09-13T09:54:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4093218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca254c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4093218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca25a00 0x55b6cca47450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4093218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca3ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4093218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cca4b7c0 con 0x55b6cc983c80 2023-09-13T09:54:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4093218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cca3f3c0 con 0x55b6cca25a00 2023-09-13T09:54:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4093218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cca21fd0 con 0x55b6cca26700 2023-09-13T09:54:31.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f407ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca25a00 0x55b6cca47450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f407ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca25a00 0x55b6cca47450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36880/0 (socket says 172.21.15.6:36880) 2023-09-13T09:54:31.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f407ffff700 1 -- 172.21.15.6:0/1775892049 learned_addr learned my addr 172.21.15.6:0/1775892049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:31.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4084dcf700 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca254c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f40855d0700 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca3ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4084dcf700 1 -- 172.21.15.6:0/1775892049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 msgr2=0x55b6cca3ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4084dcf700 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca3ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4084dcf700 1 -- 172.21.15.6:0/1775892049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca25a00 msgr2=0x55b6cca47450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4084dcf700 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca25a00 0x55b6cca47450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f4084dcf700 1 -- 172.21.15.6:0/1775892049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6cc7a3de0 con 0x55b6cc983c80 2023-09-13T09:54:31.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.099+0000 7f40855d0700 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca3ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.100+0000 7f4084dcf700 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca254c0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f40740a25e0 tx=0x7f407401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f5c64fd386506ba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.100+0000 7f406b7fe700 1 -- 172.21.15.6:0/1775892049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40740a2b10 con 0x55b6cc983c80 2023-09-13T09:54:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.100+0000 7f406b7fe700 1 -- 172.21.15.6:0/1775892049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40740caec0 con 0x55b6cc983c80 2023-09-13T09:54:31.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.100+0000 7f406b7fe700 1 -- 172.21.15.6:0/1775892049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407409a020 con 0x55b6cc983c80 2023-09-13T09:54:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.101+0000 7f4093218b80 1 -- 172.21.15.6:0/1775892049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 msgr2=0x55b6cca254c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.101+0000 7f4093218b80 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca254c0 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7f40740a25e0 tx=0x7f407401a040 comp rx=0 tx=0).stop 2023-09-13T09:54:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.101+0000 7f4093218b80 1 -- 172.21.15.6:0/1775892049 shutdown_connections 2023-09-13T09:54:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.101+0000 7f4093218b80 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca26700 0x55b6cca3ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.101+0000 7f4093218b80 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca254c0 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.101+0000 7f4093218b80 1 --2- 172.21.15.6:0/1775892049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca25a00 0x55b6cca47450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.101+0000 7f4093218b80 1 -- 172.21.15.6:0/1775892049 >> 172.21.15.6:0/1775892049 conn(0x55b6cca20240 msgr2=0x55b6cca2cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.102+0000 7f4093218b80 1 -- 172.21.15.6:0/1775892049 shutdown_connections 2023-09-13T09:54:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.102+0000 7f4093218b80 1 -- 172.21.15.6:0/1775892049 wait complete. 2023-09-13T09:54:31.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.102+0000 7f4093218b80 1 -- start start 2023-09-13T09:54:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.102+0000 7f4093218b80 1 Processor -- start 2023-09-13T09:54:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4093218b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca43410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4093218b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca25a00 0x55b6cca43950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4093218b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca46970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4093218b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cca46eb0 con 0x55b6cc983c80 2023-09-13T09:54:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4093218b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cca47020 con 0x55b6cca26700 2023-09-13T09:54:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4093218b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6cca471e0 con 0x55b6cca25a00 2023-09-13T09:54:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4093218b80 10 client.0 _ll_register_callbacks cb 0x55b6cc913680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:31.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca43410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca43410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43362/0 (socket says 172.21.15.6:43362) 2023-09-13T09:54:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 -- 172.21.15.6:0/2914204228 learned_addr learned my addr 172.21.15.6:0/2914204228 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f407ffff700 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca25a00 0x55b6cca43950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f40855d0700 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca46970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 -- 172.21.15.6:0/2914204228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca25a00 msgr2=0x55b6cca43950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca25a00 0x55b6cca43950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 -- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 msgr2=0x55b6cca46970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:31.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca46970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.103+0000 7f4084dcf700 1 -- 172.21.15.6:0/2914204228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f407800a400 con 0x55b6cc983c80 2023-09-13T09:54:31.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f4084dcf700 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca43410 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4074005f50 tx=0x7f4074009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99838d50b183822 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:31.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f405ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f405ffff700 1 -- 172.21.15.6:0/2914204228 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407409a020 con 0x55b6cc983c80 2023-09-13T09:54:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f406c021070 con 0x55b6cc983c80 2023-09-13T09:54:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f405ffff700 1 -- 172.21.15.6:0/2914204228 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f407409a180 con 0x55b6cc983c80 2023-09-13T09:54:31.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f405ffff700 1 -- 172.21.15.6:0/2914204228 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f40740a2680 con 0x55b6cc983c80 2023-09-13T09:54:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f4093218b80 10 client.19455 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.104+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x7f40801a56f0 con 0x55b6cc983c80 2023-09-13T09:54:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f405ffff700 1 -- 172.21.15.6:0/2914204228 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f40740a6020 con 0x55b6cc983c80 2023-09-13T09:54:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f405ffff700 1 -- 172.21.15.6:0/2914204228 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f40740b8800 con 0x55b6cc983c80 2023-09-13T09:54:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f4093218b80 10 client.19455 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f4093218b80 10 client.19455 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f4093218b80 20 client.19455 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f4093218b80 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca27060 0x55b6ccaa2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f4093218b80 4 client.19455 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:54:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.105+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b6cc931050 con 0x55b6cca27060 2023-09-13T09:54:31.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.106+0000 7f407ffff700 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca27060 0x55b6ccaa2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.107+0000 7f407ffff700 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca27060 0x55b6ccaa2a60 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d1a80d7f99825f1 server_cookie=cb5b7f789ab0e36a in_seq=0 out_seq=0 2023-09-13T09:54:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.108+0000 7f405ffff700 10 client.19455 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:31.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.115+0000 7f405ffff700 1 -- 172.21.15.6:0/2914204228 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b6cc931050 con 0x55b6cca27060 2023-09-13T09:54:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.115+0000 7f405ffff700 10 client.19455 handle_command_reply: tid=0 2023-09-13T09:54:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.115+0000 7f4093218b80 1 client.19455 shutdown 2023-09-13T09:54:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 msgr2=0x55b6cca43410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca43410 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7f4074005f50 tx=0x7f4074009310 comp rx=0 tx=0).stop 2023-09-13T09:54:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 shutdown_connections 2023-09-13T09:54:31.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b6cca26700 0x55b6cca46970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b6cca27060 0x55b6ccaa2a60 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b6cc983c80 0x55b6cca43410 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f405ffff700 0 client.19455 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 --2- 172.21.15.6:0/2914204228 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b6cca25a00 0x55b6cca43950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 >> 172.21.15.6:0/2914204228 conn(0x55b6cca20240 msgr2=0x55b6cca29880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:31.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 shutdown_connections 2023-09-13T09:54:31.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 1 -- 172.21.15.6:0/2914204228 wait complete. 2023-09-13T09:54:31.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.116+0000 7f4093218b80 20 client.19455 trim_cache size 0 max 16384 2023-09-13T09:54:31.121 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:54:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40700a0640 msgr2=0x7f40700a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40700a0640 0x7f40700a2b00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f406c009c60 tx=0x7f406c009260 comp rx=0 tx=0).stop 2023-09-13T09:54:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080101840 msgr2=0x7f40801011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080101840 0x7f40801011b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f40740059d0 tx=0x7f40740047a0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 shutdown_connections 2023-09-13T09:54:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f40700a0640 0x7f40700a2b00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4080106aa0 0x7f40800ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4080101840 0x7f40801011b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 --2- 172.21.15.6:0/1963119431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4080104170 0x7f40800ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 >> 172.21.15.6:0/1963119431 conn(0x7f40800fb250 msgr2=0x7f40801024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 shutdown_connections 2023-09-13T09:54:31.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:31.117+0000 7f4087033700 1 -- 172.21.15.6:0/1963119431 wait complete. 2023-09-13T09:54:31.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:30 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3292338043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:54:31.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:30 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3292338043' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:54:31.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 80340 40.55 MB/sec warmup 111 sec latency 194.824 ms 2023-09-13T09:54:32.133 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:54:32.134 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:54:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:31 smithi006 ceph-mon[98665]: pgmap v750: 97 pgs: 97 active+clean; 804 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 770 op/s 2023-09-13T09:54:32.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:31 smithi053 ceph-mon[102373]: pgmap v750: 97 pgs: 97 active+clean; 804 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 770 op/s 2023-09-13T09:54:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:31 smithi131 ceph-mon[102785]: pgmap v750: 97 pgs: 97 active+clean; 804 MiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 770 op/s 2023-09-13T09:54:32.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 -- 172.21.15.6:0/4100005902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc100eb0 msgr2=0x7ff6dc101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 --2- 172.21.15.6:0/4100005902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc100eb0 0x7ff6dc101310 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0099c0 tx=0x7ff6cc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 -- 172.21.15.6:0/4100005902 shutdown_connections 2023-09-13T09:54:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 --2- 172.21.15.6:0/4100005902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6dc101850 0x7ff6dc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 --2- 172.21.15.6:0/4100005902 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6dc0ffcc0 0x7ff6dc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 --2- 172.21.15.6:0/4100005902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc100eb0 0x7ff6dc101310 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 -- 172.21.15.6:0/4100005902 >> 172.21.15.6:0/4100005902 conn(0x7ff6dc0fb250 msgr2=0x7ff6dc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 -- 172.21.15.6:0/4100005902 shutdown_connections 2023-09-13T09:54:32.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.295+0000 7ff6e203f700 1 -- 172.21.15.6:0/4100005902 wait complete. 2023-09-13T09:54:32.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 Processor -- start 2023-09-13T09:54:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 -- start start 2023-09-13T09:54:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6dc0ffcc0 0x7ff6dc06f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6dc100eb0 0x7ff6dc06fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc101850 0x7ff6dc193a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc072b70 con 0x7ff6dc101850 2023-09-13T09:54:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc072ce0 con 0x7ff6dc100eb0 2023-09-13T09:54:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.296+0000 7ff6e203f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6dc193f70 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc101850 0x7ff6dc193a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc101850 0x7ff6dc193a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43380/0 (socket says 172.21.15.6:43380) 2023-09-13T09:54:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6dbfff700 1 -- 172.21.15.6:0/532936710 learned_addr learned my addr 172.21.15.6:0/532936710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6dc0ffcc0 0x7ff6dc06f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6daffd700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6dc100eb0 0x7ff6dc06fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6db7fe700 1 -- 172.21.15.6:0/532936710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6dc100eb0 msgr2=0x7ff6dc06fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6dc100eb0 0x7ff6dc06fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6db7fe700 1 -- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc101850 msgr2=0x7ff6dc193a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc101850 0x7ff6dc193a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6db7fe700 1 -- 172.21.15.6:0/532936710 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0095f0 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6dbfff700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc101850 0x7ff6dc193a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:54:32.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.297+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6dc0ffcc0 0x7ff6dc06f4e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bfd0 tx=0x7ff6d0007c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.299+0000 7ff6d8ff9700 1 -- 172.21.15.6:0/532936710 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0010040 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.299+0000 7ff6d8ff9700 1 -- 172.21.15.6:0/532936710 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6d00044e0 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.299+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6dc194250 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.299+0000 7ff6d8ff9700 1 -- 172.21.15.6:0/532936710 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00158e0 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.299+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc194780 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.303+0000 7ff6d8ff9700 1 -- 172.21.15.6:0/532936710 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff6d0003810 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.303+0000 7ff6d8ff9700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff6c40a06c0 0x7ff6c40a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.303+0000 7ff6d8ff9700 1 -- 172.21.15.6:0/532936710 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff6d00cb940 con 0x7ff6dc0ffcc0 2023-09-13T09:54:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6daffd700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff6c40a06c0 0x7ff6c40a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 Processor -- start 2023-09-13T09:54:32.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 -- start start 2023-09-13T09:54:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6daffd700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff6c40a06c0 0x7ff6c40a2b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b580 tx=0x7ff6cc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e6bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bc8f0 0x562c8e6bad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6bb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e60b800 con 0x562c8e6bbf90 2023-09-13T09:54:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e609120 con 0x562c8e6bb290 2023-09-13T09:54:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.304+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e604a10 con 0x562c8e6bc8f0 2023-09-13T09:54:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e6bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e6bc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43384/0 (socket says 172.21.15.6:43384) 2023-09-13T09:54:32.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bc8f0 0x562c8e6bad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 -- 172.21.15.6:0/1510455030 learned_addr learned my addr 172.21.15.6:0/1510455030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 -- 172.21.15.6:0/1510455030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bc8f0 msgr2=0x562c8e6bad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/1510455030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bc8f0 0x562c8e6bad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 -- 172.21.15.6:0/1510455030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 msgr2=0x562c8e6bb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/1510455030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6bb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 -- 172.21.15.6:0/1510455030 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c8e4846b0 con 0x562c8e6bbf90 2023-09-13T09:54:32.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.305+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/1510455030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e6bc3b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0095b50 tx=0x7ff6d0098ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79a11bd719d317cd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.306+0000 7ff6c1ffb700 1 -- 172.21.15.6:0/1510455030 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00b0070 con 0x562c8e6bbf90 2023-09-13T09:54:32.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.306+0000 7ff6c1ffb700 1 -- 172.21.15.6:0/1510455030 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6d00997e0 con 0x562c8e6bbf90 2023-09-13T09:54:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.306+0000 7ff6c1ffb700 1 -- 172.21.15.6:0/1510455030 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00b1270 con 0x562c8e6bbf90 2023-09-13T09:54:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1510455030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 msgr2=0x562c8e6bc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1510455030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e6bc3b0 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0095b50 tx=0x7ff6d0098ca0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1510455030 shutdown_connections 2023-09-13T09:54:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1510455030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6bb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1510455030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e6bc3b0 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1510455030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bc8f0 0x562c8e6bad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1510455030 >> 172.21.15.6:0/1510455030 conn(0x562c8e610d00 msgr2=0x562c8e6acf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1510455030 shutdown_connections 2023-09-13T09:54:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.307+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1510455030 wait complete. 2023-09-13T09:54:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.308+0000 7ff6ee224b80 1 -- start start 2023-09-13T09:54:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.308+0000 7ff6ee224b80 1 Processor -- start 2023-09-13T09:54:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e6b42a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bbf90 0x562c8e6b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6b9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e5a2c30 con 0x562c8e6bc8f0 2023-09-13T09:54:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e5a2930 con 0x562c8e6bbf90 2023-09-13T09:54:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e4869a0 con 0x562c8e6bb290 2023-09-13T09:54:32.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6ee224b80 10 client.0 _ll_register_callbacks cb 0x562c8e5a0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e6b42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6db7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e6b42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46444/0 (socket says 172.21.15.6:46444) 2023-09-13T09:54:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6db7fe700 1 -- 172.21.15.6:0/2945943332 learned_addr learned my addr 172.21.15.6:0/2945943332 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.309+0000 7ff6dbfff700 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6b9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6db7fe700 1 -- 172.21.15.6:0/2945943332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bbf90 msgr2=0x562c8e6b47e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:54:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bbf90 0x562c8e6b47e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6db7fe700 1 -- 172.21.15.6:0/2945943332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 msgr2=0x562c8e6b9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6b9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6db7fe700 1 -- 172.21.15.6:0/2945943332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6dc194780 con 0x562c8e6bb290 2023-09-13T09:54:32.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6dbfff700 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:54:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e6b42a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00a0c20 tx=0x7ff6d00973d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0682eb70e088c29 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6baffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:54:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6baffd700 1 -- 172.21.15.6:0/2945943332 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00b7070 con 0x562c8e6bb290 2023-09-13T09:54:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6baffd700 1 -- 172.21.15.6:0/2945943332 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff6d009c070 con 0x562c8e6bb290 2023-09-13T09:54:32.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c8e6a56f0 con 0x562c8e6bb290 2023-09-13T09:54:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6baffd700 1 -- 172.21.15.6:0/2945943332 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6d00b0040 con 0x562c8e6bb290 2023-09-13T09:54:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6ee224b80 10 client.28774 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.310+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x562c8e61c820 con 0x562c8e6bb290 2023-09-13T09:54:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6baffd700 1 -- 172.21.15.6:0/2945943332 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562c8e6a56f0 con 0x562c8e6bb290 2023-09-13T09:54:32.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6baffd700 1 -- 172.21.15.6:0/2945943332 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff6d0082410 con 0x562c8e6bb290 2023-09-13T09:54:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6ee224b80 10 client.28774 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6ee224b80 10 client.28774 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6ee224b80 20 client.28774 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e6d8a50 0x562c8e6dae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6ee224b80 4 client.28774 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:32.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.311+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c8e5fd9f0 con 0x562c8e6d8a50 2023-09-13T09:54:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.314+0000 7ff6daffd700 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e6d8a50 0x562c8e6dae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.316+0000 7ff6daffd700 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e6d8a50 0x562c8e6dae70 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c558f1ba0f6b68af server_cookie=e696526593a18080 in_seq=0 out_seq=0 2023-09-13T09:54:32.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.316+0000 7ff6baffd700 10 client.28774 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6baffd700 1 -- 172.21.15.6:0/2945943332 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562c8e5fd9f0 con 0x562c8e6d8a50 2023-09-13T09:54:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6baffd700 10 client.28774 handle_command_reply: tid=0 2023-09-13T09:54:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 client.28774 shutdown 2023-09-13T09:54:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 msgr2=0x562c8e6b42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e6b42a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00a0c20 tx=0x7ff6d00973d0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 shutdown_connections 2023-09-13T09:54:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e6d8a50 0x562c8e6dae70 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6b9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6baffd700 0 client.28774 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e6b42a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2945943332 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bbf90 0x562c8e6b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 >> 172.21.15.6:0/2945943332 conn(0x562c8e610d00 msgr2=0x562c8e6a7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 shutdown_connections 2023-09-13T09:54:32.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2945943332 wait complete. 2023-09-13T09:54:32.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.319+0000 7ff6ee224b80 20 client.28774 trim_cache size 0 max 16384 2023-09-13T09:54:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 Processor -- start 2023-09-13T09:54:32.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 -- start start 2023-09-13T09:54:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6b4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bbf90 0x562c8e6e8650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6a6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e6ae7e0 con 0x562c8e6bc8f0 2023-09-13T09:54:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e6b3780 con 0x562c8e6bb290 2023-09-13T09:54:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e6b3e10 con 0x562c8e6bbf90 2023-09-13T09:54:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43398/0 (socket says 172.21.15.6:43398) 2023-09-13T09:54:32.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6dbfff700 1 -- 172.21.15.6:0/2598648292 learned_addr learned my addr 172.21.15.6:0/2598648292 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6b4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.347+0000 7ff6daffd700 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bbf90 0x562c8e6e8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6dbfff700 1 -- 172.21.15.6:0/2598648292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bbf90 msgr2=0x562c8e6e8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6dbfff700 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bbf90 0x562c8e6e8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6dbfff700 1 -- 172.21.15.6:0/2598648292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 msgr2=0x562c8e6b4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6dbfff700 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6b4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6dbfff700 1 -- 172.21.15.6:0/2598648292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c8e6ad230 con 0x562c8e6bc8f0 2023-09-13T09:54:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:54:32.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6dbfff700 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6a6960 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400bda0 tx=0x7ff6d400b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8973af89ee8fcb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6c27fc700 1 -- 172.21.15.6:0/2598648292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d4012040 con 0x562c8e6bc8f0 2023-09-13T09:54:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6c27fc700 1 -- 172.21.15.6:0/2598648292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6d4013040 con 0x562c8e6bc8f0 2023-09-13T09:54:32.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.348+0000 7ff6c27fc700 1 -- 172.21.15.6:0/2598648292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d40186d0 con 0x562c8e6bc8f0 2023-09-13T09:54:32.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2598648292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 msgr2=0x562c8e6a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6a6960 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7ff6d400bda0 tx=0x7ff6d400b330 comp rx=0 tx=0).stop 2023-09-13T09:54:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2598648292 shutdown_connections 2023-09-13T09:54:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bc8f0 0x562c8e6a6960 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bb290 0x562c8e6b4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/2598648292 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bbf90 0x562c8e6e8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2598648292 >> 172.21.15.6:0/2598648292 conn(0x562c8e610d00 msgr2=0x562c8e6b4050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2598648292 shutdown_connections 2023-09-13T09:54:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.349+0000 7ff6ee224b80 1 -- 172.21.15.6:0/2598648292 wait complete. 2023-09-13T09:54:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 -- start start 2023-09-13T09:54:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 Processor -- start 2023-09-13T09:54:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e725510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e725a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bc8f0 0x562c8e72ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e72cfd0 con 0x562c8e6bbf90 2023-09-13T09:54:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e72d110 con 0x562c8e6bc8f0 2023-09-13T09:54:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c8e72d2a0 con 0x562c8e6bb290 2023-09-13T09:54:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6ee224b80 10 client.0 _ll_register_callbacks cb 0x562c8e5a0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.350+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e725a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e725a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43404/0 (socket says 172.21.15.6:43404) 2023-09-13T09:54:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 -- 172.21.15.6:0/1415182132 learned_addr learned my addr 172.21.15.6:0/1415182132 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 -- 172.21.15.6:0/1415182132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 msgr2=0x562c8e725510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:54:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e725510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 -- 172.21.15.6:0/1415182132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bc8f0 msgr2=0x562c8e72ca90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:54:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bc8f0 0x562c8e72ca90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 -- 172.21.15.6:0/1415182132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d400ba80 con 0x562c8e6bbf90 2023-09-13T09:54:32.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6daffd700 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e725a50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0099c0 tx=0x7ff6cc009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d71d47c42a58e88 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.351+0000 7ff6baffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:32.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.352+0000 7ff6baffd700 1 -- 172.21.15.6:0/1415182132 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc029040 con 0x562c8e6bbf90 2023-09-13T09:54:32.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.352+0000 7ff6baffd700 1 -- 172.21.15.6:0/1415182132 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff6cc031b70 con 0x562c8e6bbf90 2023-09-13T09:54:32.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.352+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6d00997e0 con 0x562c8e6bbf90 2023-09-13T09:54:32.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.352+0000 7ff6baffd700 1 -- 172.21.15.6:0/1415182132 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6cc02b040 con 0x562c8e6bbf90 2023-09-13T09:54:32.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.352+0000 7ff6ee224b80 10 client.19473 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:32.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.352+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x562c8e430e60 con 0x562c8e6bbf90 2023-09-13T09:54:32.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.353+0000 7ff6baffd700 1 -- 172.21.15.6:0/1415182132 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff6d00997e0 con 0x562c8e6bbf90 2023-09-13T09:54:32.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6baffd700 1 -- 172.21.15.6:0/1415182132 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7ff6cc003850 con 0x562c8e6bbf90 2023-09-13T09:54:32.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6ee224b80 10 client.19473 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:32.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6ee224b80 10 client.19473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:32.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6ee224b80 20 client.19473 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:32.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e72ed20 0x562c8e731110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6ee224b80 4 client.19473 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:54:32.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562c8e5be0d0 con 0x562c8e72ed20 2023-09-13T09:54:32.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.354+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e72ed20 0x562c8e731110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.355+0000 7ff6db7fe700 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e72ed20 0x562c8e731110 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f546af44123708f server_cookie=6d8460cbe5ce178d in_seq=0 out_seq=0 2023-09-13T09:54:32.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.355+0000 7ff6baffd700 10 client.19473 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.368+0000 7ff6baffd700 1 -- 172.21.15.6:0/1415182132 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562c8e5be0d0 con 0x562c8e72ed20 2023-09-13T09:54:32.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.368+0000 7ff6baffd700 10 client.19473 handle_command_reply: tid=0 2023-09-13T09:54:32.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.368+0000 7ff6ee224b80 1 client.19473 shutdown 2023-09-13T09:54:32.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 msgr2=0x562c8e725a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e725a50 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc0099c0 tx=0x7ff6cc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 shutdown_connections 2023-09-13T09:54:32.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562c8e6bc8f0 0x562c8e72ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562c8e6bb290 0x562c8e725510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562c8e72ed20 0x562c8e731110 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 --2- 172.21.15.6:0/1415182132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562c8e6bbf90 0x562c8e725a50 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 >> 172.21.15.6:0/1415182132 conn(0x562c8e610d00 msgr2=0x562c8e6b1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6baffd700 0 client.19473 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 shutdown_connections 2023-09-13T09:54:32.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 1 -- 172.21.15.6:0/1415182132 wait complete. 2023-09-13T09:54:32.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6ee224b80 20 client.19473 trim_cache size 0 max 16384 2023-09-13T09:54:32.374 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:54:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:54:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "0fcae9f7-f35e-4b9a-be27-4239224dc81e", 2023-09-13T09:54:32.374 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:54:32.374 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:54:32.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff6c40a06c0 msgr2=0x7ff6c40a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6e203f700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff6c40a06c0 0x7ff6c40a2b80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff6cc00b580 tx=0x7ff6cc005fb0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6dc0ffcc0 msgr2=0x7ff6dc06f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.369+0000 7ff6e203f700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6dc0ffcc0 0x7ff6dc06f4e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000bfd0 tx=0x7ff6d0007c50 comp rx=0 tx=0).stop 2023-09-13T09:54:32.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 shutdown_connections 2023-09-13T09:54:32.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff6c40a06c0 0x7ff6c40a2b80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff6dc101850 0x7ff6dc193a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff6dc0ffcc0 0x7ff6dc06f4e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 --2- 172.21.15.6:0/532936710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff6dc100eb0 0x7ff6dc06fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 >> 172.21.15.6:0/532936710 conn(0x7ff6dc0fb250 msgr2=0x7ff6dc0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 shutdown_connections 2023-09-13T09:54:32.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.370+0000 7ff6e203f700 1 -- 172.21.15.6:0/532936710 wait complete. 2023-09-13T09:54:32.384 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:54:32.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.533+0000 7f38a7ef0700 1 -- 172.21.15.6:0/3749969489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a00ffcd0 msgr2=0x7f38a01000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.533+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/3749969489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a00ffcd0 0x7f38a01000f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f389c009990 tx=0x7f389c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 -- 172.21.15.6:0/3749969489 shutdown_connections 2023-09-13T09:54:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/3749969489 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a0101860 0x7f38a0108110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/3749969489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a00ffcd0 0x7f38a01000f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/3749969489 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a0100ec0 0x7f38a0101320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 -- 172.21.15.6:0/3749969489 >> 172.21.15.6:0/3749969489 conn(0x7f38a00fb260 msgr2=0x7f38a00fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 -- 172.21.15.6:0/3749969489 shutdown_connections 2023-09-13T09:54:32.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 -- 172.21.15.6:0/3749969489 wait complete. 2023-09-13T09:54:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 Processor -- start 2023-09-13T09:54:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.534+0000 7f38a7ef0700 1 -- start start 2023-09-13T09:54:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a7ef0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a00ffcd0 0x7f38a0103c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a7ef0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a0100ec0 0x7f38a01022a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a7ef0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a0101860 0x7f38a01027e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a7ef0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a0102f80 con 0x7f38a0100ec0 2023-09-13T09:54:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a7ef0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01030f0 con 0x7f38a00ffcd0 2023-09-13T09:54:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a7ef0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38a01a0c00 con 0x7f38a0101860 2023-09-13T09:54:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a0101860 0x7f38a01027e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a0101860 0x7f38a01027e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46472/0 (socket says 172.21.15.6:46472) 2023-09-13T09:54:32.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 -- 172.21.15.6:0/813712914 learned_addr learned my addr 172.21.15.6:0/813712914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a00ffcd0 0x7f38a0103c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 -- 172.21.15.6:0/813712914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a00ffcd0 msgr2=0x7f38a0103c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a00ffcd0 0x7f38a0103c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 -- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a0100ec0 msgr2=0x7f38a01022a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:54:32.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a0100ec0 0x7f38a01022a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.535+0000 7f38a648d700 1 -- 172.21.15.6:0/813712914 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3898009c40 con 0x7f38a0101860 2023-09-13T09:54:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.536+0000 7f38a648d700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a0101860 0x7f38a01027e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f389800c370 tx=0x7f389800c680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.536+0000 7f3896ffd700 1 -- 172.21.15.6:0/813712914 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898017070 con 0x7f38a0101860 2023-09-13T09:54:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.536+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f389c0095f0 con 0x7f38a0101860 2023-09-13T09:54:32.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.536+0000 7f3896ffd700 1 -- 172.21.15.6:0/813712914 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f389800f040 con 0x7f38a0101860 2023-09-13T09:54:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.536+0000 7f3896ffd700 1 -- 172.21.15.6:0/813712914 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389800e050 con 0x7f38a0101860 2023-09-13T09:54:32.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.536+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a01a1200 con 0x7f38a0101860 2023-09-13T09:54:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.539+0000 7f3896ffd700 1 -- 172.21.15.6:0/813712914 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3898004460 con 0x7f38a0101860 2023-09-13T09:54:32.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.540+0000 7f3896ffd700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f388c0a0640 0x7f388c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.540+0000 7f3896ffd700 1 -- 172.21.15.6:0/813712914 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f38980cb580 con 0x7f38a0101860 2023-09-13T09:54:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.540+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f388c0a0640 0x7f388c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.540+0000 7f38b40d5b80 1 Processor -- start 2023-09-13T09:54:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.540+0000 7f38b40d5b80 1 -- start start 2023-09-13T09:54:32.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f388c0a0640 0x7f388c0a2b00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f389c00b2e0 tx=0x7f389c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e05b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e044c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e04e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72d5d780 con 0x55ad72e04a00 2023-09-13T09:54:32.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72d5b0a0 con 0x55ad72e05700 2023-09-13T09:54:32.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72d56990 con 0x55ad72e06060 2023-09-13T09:54:32.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e04e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e04e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43426/0 (socket says 172.21.15.6:43426) 2023-09-13T09:54:32.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 -- 172.21.15.6:0/2151444604 learned_addr learned my addr 172.21.15.6:0/2151444604 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a548b700 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e05b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 -- 172.21.15.6:0/2151444604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 msgr2=0x55ad72e044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 -- 172.21.15.6:0/2151444604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 msgr2=0x55ad72e05b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e05b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 -- 172.21.15.6:0/2151444604 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad72bd6630 con 0x55ad72e04a00 2023-09-13T09:54:32.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f38a648d700 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e04e80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f38980951c0 tx=0x7f3898095130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30ba75d280317ba1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.541+0000 7f388bfff700 1 -- 172.21.15.6:0/2151444604 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980192c0 con 0x55ad72e04a00 2023-09-13T09:54:32.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.542+0000 7f388bfff700 1 -- 172.21.15.6:0/2151444604 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38980993c0 con 0x55ad72e04a00 2023-09-13T09:54:32.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.542+0000 7f388bfff700 1 -- 172.21.15.6:0/2151444604 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898098f20 con 0x55ad72e04a00 2023-09-13T09:54:32.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.542+0000 7f38b40d5b80 1 -- 172.21.15.6:0/2151444604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 msgr2=0x55ad72e04e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.542+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e04e80 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f38980951c0 tx=0x7f3898095130 comp rx=0 tx=0).stop 2023-09-13T09:54:32.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 -- 172.21.15.6:0/2151444604 shutdown_connections 2023-09-13T09:54:32.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e04e80 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e05b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/2151444604 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 -- 172.21.15.6:0/2151444604 >> 172.21.15.6:0/2151444604 conn(0x55ad72d62c80 msgr2=0x55ad72dfef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 -- 172.21.15.6:0/2151444604 shutdown_connections 2023-09-13T09:54:32.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 -- 172.21.15.6:0/2151444604 wait complete. 2023-09-13T09:54:32.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 -- start start 2023-09-13T09:54:32.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.543+0000 7f38b40d5b80 1 Processor -- start 2023-09-13T09:54:32.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e0ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e0e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e15450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72cf4bb0 con 0x55ad72e04a00 2023-09-13T09:54:32.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72cf48b0 con 0x55ad72e05700 2023-09-13T09:54:32.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72bd8920 con 0x55ad72e06060 2023-09-13T09:54:32.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38b40d5b80 10 client.0 _ll_register_callbacks cb 0x55ad72cf2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:32.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e0ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e0ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43430/0 (socket says 172.21.15.6:43430) 2023-09-13T09:54:32.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 -- 172.21.15.6:0/3461123377 learned_addr learned my addr 172.21.15.6:0/3461123377 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a648d700 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e15450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a548b700 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e0e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 -- 172.21.15.6:0/3461123377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 msgr2=0x55ad72e15450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e15450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 -- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 msgr2=0x55ad72e0e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e0e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.544+0000 7f38a5c8c700 1 -- 172.21.15.6:0/3461123377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38a01a1200 con 0x55ad72e04a00 2023-09-13T09:54:32.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e0ded0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f38a0100d20 tx=0x7f389c01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c650325c5e1198 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38897fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:32.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38897fa700 1 -- 172.21.15.6:0/3461123377 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f389c02b070 con 0x55ad72e04a00 2023-09-13T09:54:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38897fa700 1 -- 172.21.15.6:0/3461123377 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f389c031460 con 0x55ad72e04a00 2023-09-13T09:54:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ad72df7670 con 0x55ad72e04a00 2023-09-13T09:54:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38897fa700 1 -- 172.21.15.6:0/3461123377 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f389c031620 con 0x55ad72e04a00 2023-09-13T09:54:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 10 client.19482 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55ad72d6e7a0 con 0x55ad72e04a00 2023-09-13T09:54:32.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38897fa700 1 -- 172.21.15.6:0/3461123377 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f389c040080 con 0x55ad72e04a00 2023-09-13T09:54:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38897fa700 1 -- 172.21.15.6:0/3461123377 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f389c00f880 con 0x55ad72e04a00 2023-09-13T09:54:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 10 client.19482 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 10 client.19482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 20 client.19482 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:32.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e19d30 0x55ad72e1c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 4 client.19482 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:54:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.545+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ad72d4f970 con 0x55ad72e19d30 2023-09-13T09:54:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.546+0000 7f38a548b700 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e19d30 0x55ad72e1c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.546+0000 7f38897fa700 10 client.19482 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.546+0000 7f38a548b700 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e19d30 0x55ad72e1c150 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9dd13279ab87187 server_cookie=5a4c2378102a0be8 in_seq=0 out_seq=0 2023-09-13T09:54:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38897fa700 1 -- 172.21.15.6:0/3461123377 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ad72d4f970 con 0x55ad72e19d30 2023-09-13T09:54:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38897fa700 10 client.19482 handle_command_reply: tid=0 2023-09-13T09:54:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 client.19482 shutdown 2023-09-13T09:54:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 msgr2=0x55ad72e0ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e0ded0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f38a0100d20 tx=0x7f389c01a050 comp rx=0 tx=0).stop 2023-09-13T09:54:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 shutdown_connections 2023-09-13T09:54:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e15450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e19d30 0x55ad72e1c150 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e04a00 0x55ad72e0ded0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38897fa700 0 client.19482 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/3461123377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e05700 0x55ad72e0e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 >> 172.21.15.6:0/3461123377 conn(0x55ad72d62c80 msgr2=0x55ad72df97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 shutdown_connections 2023-09-13T09:54:32.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 1 -- 172.21.15.6:0/3461123377 wait complete. 2023-09-13T09:54:32.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.556+0000 7f38b40d5b80 20 client.19482 trim_cache size 0 max 16384 2023-09-13T09:54:32.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 81073 40.60 MB/sec warmup 112 sec latency 65.840 ms 2023-09-13T09:54:32.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 Processor -- start 2023-09-13T09:54:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 -- start start 2023-09-13T09:54:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 0x55ad72e044c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e05700 0x55ad72e15410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e06060 0x55ad72e0dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72e0da40 con 0x55ad72e06060 2023-09-13T09:54:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72e170c0 con 0x55ad72e04a00 2023-09-13T09:54:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72e00730 con 0x55ad72e05700 2023-09-13T09:54:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38a648d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e06060 0x55ad72e0dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38a648d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e06060 0x55ad72e0dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43440/0 (socket says 172.21.15.6:43440) 2023-09-13T09:54:32.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38a648d700 1 -- 172.21.15.6:0/1839044759 learned_addr learned my addr 172.21.15.6:0/1839044759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.576+0000 7f38a548b700 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e05700 0x55ad72e15410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f38a648d700 1 -- 172.21.15.6:0/1839044759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e05700 msgr2=0x55ad72e15410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f38a648d700 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e05700 0x55ad72e15410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f38a648d700 1 -- 172.21.15.6:0/1839044759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 msgr2=0x55ad72e044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f38a648d700 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 0x55ad72e044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f38a648d700 1 -- 172.21.15.6:0/1839044759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ad72b82de0 con 0x55ad72e06060 2023-09-13T09:54:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f38a648d700 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e06060 0x55ad72e0dc80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x55ad72e054a0 tx=0x7f389800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=130884d1dc6e2fe1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f3894ff9700 1 -- 172.21.15.6:0/1839044759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38980a0d30 con 0x55ad72e06060 2023-09-13T09:54:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f3894ff9700 1 -- 172.21.15.6:0/1839044759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3898098cc0 con 0x55ad72e06060 2023-09-13T09:54:32.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.577+0000 7f3894ff9700 1 -- 172.21.15.6:0/1839044759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3898004bd0 con 0x55ad72e06060 2023-09-13T09:54:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 -- 172.21.15.6:0/1839044759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e06060 msgr2=0x55ad72e0dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e06060 0x55ad72e0dc80 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x55ad72e054a0 tx=0x7f389800cf90 comp rx=0 tx=0).stop 2023-09-13T09:54:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 -- 172.21.15.6:0/1839044759 shutdown_connections 2023-09-13T09:54:32.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e06060 0x55ad72e0dc80 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 0x55ad72e044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/1839044759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e05700 0x55ad72e15410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 -- 172.21.15.6:0/1839044759 >> 172.21.15.6:0/1839044759 conn(0x55ad72d62c80 msgr2=0x55ad72e08920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 -- 172.21.15.6:0/1839044759 shutdown_connections 2023-09-13T09:54:32.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 -- 172.21.15.6:0/1839044759 wait complete. 2023-09-13T09:54:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 -- start start 2023-09-13T09:54:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.578+0000 7f38b40d5b80 1 Processor -- start 2023-09-13T09:54:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 0x55ad72e113d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e05700 0x55ad72e11910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38b40d5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e14930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72e14e70 con 0x55ad72e05700 2023-09-13T09:54:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72e14fe0 con 0x55ad72e04a00 2023-09-13T09:54:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38b40d5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ad72e151a0 con 0x55ad72e06060 2023-09-13T09:54:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38b40d5b80 10 client.0 _ll_register_callbacks cb 0x55ad72dff570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:54:32.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e05700 0x55ad72e11910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e05700 0x55ad72e11910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43444/0 (socket says 172.21.15.6:43444) 2023-09-13T09:54:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a5c8c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 0x55ad72e113d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 -- 172.21.15.6:0/737926253 learned_addr learned my addr 172.21.15.6:0/737926253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:54:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a648d700 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e14930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 -- 172.21.15.6:0/737926253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 msgr2=0x55ad72e14930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e14930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 -- 172.21.15.6:0/737926253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 msgr2=0x55ad72e113d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:54:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 0x55ad72e113d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 -- 172.21.15.6:0/737926253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ad72bd6630 con 0x55ad72e05700 2023-09-13T09:54:32.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38a548b700 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e05700 0x55ad72e11910 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x55ad72e1ca10 tx=0x7f389001c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de664b90a246a72 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:54:32.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.579+0000 7f38897fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:54:32.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38897fa700 1 -- 172.21.15.6:0/737926253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3890017040 con 0x55ad72e05700 2023-09-13T09:54:32.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f38980993c0 con 0x55ad72e05700 2023-09-13T09:54:32.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38897fa700 1 -- 172.21.15.6:0/737926253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f389001cb00 con 0x55ad72e05700 2023-09-13T09:54:32.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38897fa700 1 -- 172.21.15.6:0/737926253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7f389001ccc0 con 0x55ad72e05700 2023-09-13T09:54:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 10 client.19488 fetch_fsmap learned FSMap version 47 2023-09-13T09:54:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x55ad72b6bc60 con 0x55ad72e05700 2023-09-13T09:54:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38897fa700 1 -- 172.21.15.6:0/737926253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f38980993c0 con 0x55ad72e05700 2023-09-13T09:54:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38897fa700 1 -- 172.21.15.6:0/737926253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 47) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f38900254d0 con 0x55ad72e05700 2023-09-13T09:54:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 10 client.19488 fetch_fsmap finished waiting for FSMap version 47 2023-09-13T09:54:32.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 10 client.19488 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:54:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 20 client.19488 populate_metadata read hostname 'smithi006' 2023-09-13T09:54:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e6ee80 0x55ad72e712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:54:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 4 client.19488 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:54:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.580+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ad72d10050 con 0x55ad72e6ee80 2023-09-13T09:54:32.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.581+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e6ee80 0x55ad72e712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:54:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.581+0000 7f38897fa700 10 client.19488 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.581+0000 7f38a5c8c700 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e6ee80 0x55ad72e712a0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ac9b5a276420c32 server_cookie=52d0b7cd3e64a573 in_seq=0 out_seq=0 2023-09-13T09:54:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38897fa700 1 -- 172.21.15.6:0/737926253 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55ad72d10050 con 0x55ad72e6ee80 2023-09-13T09:54:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38897fa700 10 client.19488 handle_command_reply: tid=0 2023-09-13T09:54:32.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 client.19488 shutdown 2023-09-13T09:54:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e05700 msgr2=0x55ad72e11910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e05700 0x55ad72e11910 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x55ad72e1ca10 tx=0x7f389001c590 comp rx=0 tx=0).stop 2023-09-13T09:54:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 shutdown_connections 2023-09-13T09:54:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ad72e06060 0x55ad72e14930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ad72e04a00 0x55ad72e113d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55ad72e6ee80 0x55ad72e712a0 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 --2- 172.21.15.6:0/737926253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ad72e05700 0x55ad72e11910 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38897fa700 0 client.19488 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:54:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 >> 172.21.15.6:0/737926253 conn(0x55ad72d62c80 msgr2=0x55ad72e0dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 shutdown_connections 2023-09-13T09:54:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 1 -- 172.21.15.6:0/737926253 wait complete. 2023-09-13T09:54:32.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.587+0000 7f38b40d5b80 20 client.19488 trim_cache size 0 max 16384 2023-09-13T09:54:32.599 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:54:32.599 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (6 inodes in the stack)", 2023-09-13T09:54:32.599 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:54:32.600 INFO:teuthology.orchestra.run.smithi006.stdout: "0fcae9f7-f35e-4b9a-be27-4239224dc81e": { 2023-09-13T09:54:32.600 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:54:32.600 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "0fcae9f7-f35e-4b9a-be27-4239224dc81e", 2023-09-13T09:54:32.600 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:54:32.600 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:54:32.601 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:54:32.601 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:54:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f388c0a0640 msgr2=0x7f388c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f388c0a0640 0x7f388c0a2b00 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f389c00b2e0 tx=0x7f389c005fb0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a0101860 msgr2=0x7f38a01027e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:54:32.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a0101860 0x7f38a01027e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f389800c370 tx=0x7f389800c680 comp rx=0 tx=0).stop 2023-09-13T09:54:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 shutdown_connections 2023-09-13T09:54:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38a0101860 0x7f38a01027e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f38a00ffcd0 0x7f38a0103c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f388c0a0640 0x7f388c0a2b00 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 --2- 172.21.15.6:0/813712914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f38a0100ec0 0x7f38a01022a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:54:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 >> 172.21.15.6:0/813712914 conn(0x7f38a00fb260 msgr2=0x7f38a0069240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:54:32.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 shutdown_connections 2023-09-13T09:54:32.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:54:32.588+0000 7f38a7ef0700 1 -- 172.21.15.6:0/813712914 wait complete. 2023-09-13T09:54:32.605 INFO:tasks.cephfs.filesystem:scrub status for tag:0fcae9f7-f35e-4b9a-be27-4239224dc81e - {'path': '/', 'tag': '0fcae9f7-f35e-4b9a-be27-4239224dc81e', 'options': 'recursive,force'} 2023-09-13T09:54:33.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:33.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:33.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:33.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:33.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:32 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:33.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:33.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:33.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:33.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:32 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:33.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:33.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:33.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:33.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:32 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:33.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 81822 40.57 MB/sec warmup 113 sec latency 53.878 ms 2023-09-13T09:54:34.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:54:34.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:34.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:34.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:34.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:54:34.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: pgmap v751: 97 pgs: 97 active+clean; 810 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 856 op/s 2023-09-13T09:54:34.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:33 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:34.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:54:34.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:34.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:34.260 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:34.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:54:34.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: pgmap v751: 97 pgs: 97 active+clean; 810 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 856 op/s 2023-09-13T09:54:34.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:33 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:34.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:54:34.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:34.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:34.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:34.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:54:34.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: pgmap v751: 97 pgs: 97 active+clean; 810 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 856 op/s 2023-09-13T09:54:34.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:54:34.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:33 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:34.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 82531 40.57 MB/sec warmup 114 sec latency 63.770 ms 2023-09-13T09:54:35.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 83249 40.49 MB/sec warmup 115 sec latency 66.439 ms 2023-09-13T09:54:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:35 smithi006 ceph-mon[98665]: pgmap v752: 97 pgs: 97 active+clean; 816 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 854 op/s 2023-09-13T09:54:36.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:35 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:54:36.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:35 smithi053 ceph-mon[102373]: pgmap v752: 97 pgs: 97 active+clean; 816 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 854 op/s 2023-09-13T09:54:36.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:35 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:54:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:35 smithi131 ceph-mon[102785]: pgmap v752: 97 pgs: 97 active+clean; 816 MiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 854 op/s 2023-09-13T09:54:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:35 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:54:36.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 83698 40.33 MB/sec warmup 116 sec latency 224.291 ms 2023-09-13T09:54:37.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 84443 40.41 MB/sec warmup 117 sec latency 55.599 ms 2023-09-13T09:54:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:37 smithi006 ceph-mon[98665]: pgmap v753: 97 pgs: 97 active+clean; 817 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 803 op/s 2023-09-13T09:54:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:37 smithi053 ceph-mon[102373]: pgmap v753: 97 pgs: 97 active+clean; 817 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 803 op/s 2023-09-13T09:54:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:37 smithi131 ceph-mon[102785]: pgmap v753: 97 pgs: 97 active+clean; 817 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 803 op/s 2023-09-13T09:54:38.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 85199 40.40 MB/sec warmup 118 sec latency 84.746 ms 2023-09-13T09:54:39.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:38 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:39.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:54:39.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:54:39.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:38 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:54:39.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:38 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:39.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:38 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:54:39.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:38 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:54:39.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:38 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:54:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:38 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:38 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:54:39.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:38 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:54:39.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:38 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:54:39.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 85929 40.39 MB/sec warmup 119 sec latency 60.500 ms 2023-09-13T09:54:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:39 smithi006 ceph-mon[98665]: pgmap v754: 97 pgs: 97 active+clean; 823 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-09-13T09:54:40.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:39 smithi053 ceph-mon[102373]: pgmap v754: 97 pgs: 97 active+clean; 823 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-09-13T09:54:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:39 smithi131 ceph-mon[102785]: pgmap v754: 97 pgs: 97 active+clean; 823 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-09-13T09:54:41.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 87278 35.27 MB/sec execute 1 sec latency 224.216 ms 2023-09-13T09:54:42.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:41 smithi006 ceph-mon[98665]: pgmap v755: 97 pgs: 97 active+clean; 823 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 718 op/s 2023-09-13T09:54:42.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:41 smithi053 ceph-mon[102373]: pgmap v755: 97 pgs: 97 active+clean; 823 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 718 op/s 2023-09-13T09:54:42.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:41 smithi131 ceph-mon[102785]: pgmap v755: 97 pgs: 97 active+clean; 823 MiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.0 MiB/s wr, 718 op/s 2023-09-13T09:54:42.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 87941 34.21 MB/sec execute 2 sec latency 48.904 ms 2023-09-13T09:54:43.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 88709 35.25 MB/sec execute 3 sec latency 66.343 ms 2023-09-13T09:54:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:43 smithi006 ceph-mon[98665]: pgmap v756: 97 pgs: 97 active+clean; 835 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 835 op/s 2023-09-13T09:54:44.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:43 smithi053 ceph-mon[102373]: pgmap v756: 97 pgs: 97 active+clean; 835 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 835 op/s 2023-09-13T09:54:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:43 smithi131 ceph-mon[102785]: pgmap v756: 97 pgs: 97 active+clean; 835 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 835 op/s 2023-09-13T09:54:44.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 89600 37.68 MB/sec execute 4 sec latency 51.847 ms 2023-09-13T09:54:45.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:45.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:45.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:45.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:45.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:45.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:45.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:45.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:45.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:45.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:45.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 90487 42.50 MB/sec execute 5 sec latency 44.228 ms 2023-09-13T09:54:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:45 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:54:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:45 smithi006 ceph-mon[98665]: pgmap v757: 97 pgs: 97 active+clean; 837 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 767 op/s 2023-09-13T09:54:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:46 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:54:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:46 smithi053 ceph-mon[102373]: pgmap v757: 97 pgs: 97 active+clean; 837 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 767 op/s 2023-09-13T09:54:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:46 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:54:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:46 smithi131 ceph-mon[102785]: pgmap v757: 97 pgs: 97 active+clean; 837 MiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 767 op/s 2023-09-13T09:54:46.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 90999 39.58 MB/sec execute 6 sec latency 264.151 ms 2023-09-13T09:54:47.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 91714 38.35 MB/sec execute 7 sec latency 61.225 ms 2023-09-13T09:54:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:48 smithi006 ceph-mon[98665]: pgmap v758: 97 pgs: 97 active+clean; 842 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-09-13T09:54:48.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:48 smithi053 ceph-mon[102373]: pgmap v758: 97 pgs: 97 active+clean; 842 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-09-13T09:54:48.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:48 smithi131 ceph-mon[102785]: pgmap v758: 97 pgs: 97 active+clean; 842 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 844 op/s 2023-09-13T09:54:48.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 92602 40.74 MB/sec execute 8 sec latency 116.851 ms 2023-09-13T09:54:49.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 93312 39.38 MB/sec execute 9 sec latency 90.428 ms 2023-09-13T09:54:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:50 smithi006 ceph-mon[98665]: pgmap v759: 97 pgs: 97 active+clean; 845 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-09-13T09:54:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:50 smithi053 ceph-mon[102373]: pgmap v759: 97 pgs: 97 active+clean; 845 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-09-13T09:54:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:50 smithi131 ceph-mon[102785]: pgmap v759: 97 pgs: 97 active+clean; 845 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-09-13T09:54:50.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 94087 39.89 MB/sec execute 10 sec latency 246.860 ms 2023-09-13T09:54:51.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 94867 40.10 MB/sec execute 11 sec latency 199.686 ms 2023-09-13T09:54:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:52 smithi006 ceph-mon[98665]: pgmap v760: 97 pgs: 97 active+clean; 846 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 708 op/s 2023-09-13T09:54:52.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:52 smithi053 ceph-mon[102373]: pgmap v760: 97 pgs: 97 active+clean; 846 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 708 op/s 2023-09-13T09:54:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:52 smithi131 ceph-mon[102785]: pgmap v760: 97 pgs: 97 active+clean; 846 MiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 708 op/s 2023-09-13T09:54:52.559 INFO:tasks.workunit.client.0.smithi006.stdout: 10 95595 40.25 MB/sec execute 12 sec latency 54.450 ms 2023-09-13T09:54:53.561 INFO:tasks.workunit.client.0.smithi006.stdout: 10 96351 40.60 MB/sec execute 13 sec latency 59.870 ms 2023-09-13T09:54:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:54 smithi006 ceph-mon[98665]: pgmap v761: 97 pgs: 97 active+clean; 847 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 859 op/s 2023-09-13T09:54:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:54 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:54 smithi053 ceph-mon[102373]: pgmap v761: 97 pgs: 97 active+clean; 847 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 859 op/s 2023-09-13T09:54:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:54 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:54.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:54 smithi131 ceph-mon[102785]: pgmap v761: 97 pgs: 97 active+clean; 847 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 859 op/s 2023-09-13T09:54:54.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:54 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:54:54.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 97042 39.62 MB/sec execute 14 sec latency 73.607 ms 2023-09-13T09:54:55.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 97951 40.89 MB/sec execute 15 sec latency 47.125 ms 2023-09-13T09:54:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:56 smithi006 ceph-mon[98665]: pgmap v762: 97 pgs: 97 active+clean; 853 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 826 op/s 2023-09-13T09:54:56.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:56 smithi053 ceph-mon[102373]: pgmap v762: 97 pgs: 97 active+clean; 853 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 826 op/s 2023-09-13T09:54:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:56 smithi131 ceph-mon[102785]: pgmap v762: 97 pgs: 97 active+clean; 853 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 826 op/s 2023-09-13T09:54:56.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 98484 39.72 MB/sec execute 16 sec latency 303.772 ms 2023-09-13T09:54:57.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 99201 39.76 MB/sec execute 17 sec latency 53.315 ms 2023-09-13T09:54:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:54:58 smithi006 ceph-mon[98665]: pgmap v763: 97 pgs: 97 active+clean; 859 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 893 op/s 2023-09-13T09:54:58.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:54:58 smithi053 ceph-mon[102373]: pgmap v763: 97 pgs: 97 active+clean; 859 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 893 op/s 2023-09-13T09:54:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:54:58 smithi131 ceph-mon[102785]: pgmap v763: 97 pgs: 97 active+clean; 859 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 893 op/s 2023-09-13T09:54:58.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 99993 39.86 MB/sec execute 18 sec latency 48.296 ms 2023-09-13T09:54:59.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 100791 40.13 MB/sec execute 19 sec latency 60.633 ms 2023-09-13T09:55:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:00 smithi006 ceph-mon[98665]: pgmap v764: 97 pgs: 97 active+clean; 862 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 728 op/s 2023-09-13T09:55:00.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:00 smithi053 ceph-mon[102373]: pgmap v764: 97 pgs: 97 active+clean; 862 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 728 op/s 2023-09-13T09:55:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:00 smithi131 ceph-mon[102785]: pgmap v764: 97 pgs: 97 active+clean; 862 MiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.9 MiB/s wr, 728 op/s 2023-09-13T09:55:00.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 101510 40.07 MB/sec execute 20 sec latency 63.936 ms 2023-09-13T09:55:01.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 102034 39.33 MB/sec execute 21 sec latency 196.173 ms 2023-09-13T09:55:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:02 smithi006 ceph-mon[98665]: pgmap v765: 97 pgs: 97 active+clean; 863 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.7 MiB/s wr, 715 op/s 2023-09-13T09:55:02.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:02 smithi053 ceph-mon[102373]: pgmap v765: 97 pgs: 97 active+clean; 863 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.7 MiB/s wr, 715 op/s 2023-09-13T09:55:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:02 smithi131 ceph-mon[102785]: pgmap v765: 97 pgs: 97 active+clean; 863 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.7 MiB/s wr, 715 op/s 2023-09-13T09:55:02.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 102771 39.42 MB/sec execute 22 sec latency 122.635 ms 2023-09-13T09:55:02.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:55:02.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 -- 172.21.15.6:0/4223953680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 msgr2=0x7fa5b4101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 --2- 172.21.15.6:0/4223953680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b4101310 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80099c0 tx=0x7fa5a8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 -- 172.21.15.6:0/4223953680 shutdown_connections 2023-09-13T09:55:02.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 --2- 172.21.15.6:0/4223953680 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b4101850 0x7fa5b4108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 --2- 172.21.15.6:0/4223953680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5b40ffcc0 0x7fa5b41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 --2- 172.21.15.6:0/4223953680 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b4101310 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 -- 172.21.15.6:0/4223953680 >> 172.21.15.6:0/4223953680 conn(0x7fa5b40fb250 msgr2=0x7fa5b40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:02.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 -- 172.21.15.6:0/4223953680 shutdown_connections 2023-09-13T09:55:02.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.766+0000 7fa5b9142700 1 -- 172.21.15.6:0/4223953680 wait complete. 2023-09-13T09:55:02.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.767+0000 7fa5b9142700 1 Processor -- start 2023-09-13T09:55:02.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.767+0000 7fa5b9142700 1 -- start start 2023-09-13T09:55:02.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b9142700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b40ffcc0 0x7fa5b4068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b9142700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b419b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b9142700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5b4101850 0x7fa5b419de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b9142700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b419e5e0 con 0x7fa5b4100eb0 2023-09-13T09:55:02.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b9142700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b419e750 con 0x7fa5b40ffcc0 2023-09-13T09:55:02.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b9142700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b419e910 con 0x7fa5b4101850 2023-09-13T09:55:02.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b419b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b419b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43458/0 (socket says 172.21.15.6:43458) 2023-09-13T09:55:02.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 -- 172.21.15.6:0/576499945 learned_addr learned my addr 172.21.15.6:0/576499945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:02.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b359e700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5b4101850 0x7fa5b419de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b40ffcc0 0x7fa5b4068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 -- 172.21.15.6:0/576499945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5b4101850 msgr2=0x7fa5b419de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5b4101850 0x7fa5b419de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 -- 172.21.15.6:0/576499945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b40ffcc0 msgr2=0x7fa5b4068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b40ffcc0 0x7fa5b4068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 -- 172.21.15.6:0/576499945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a4009520 con 0x7fa5b4100eb0 2023-09-13T09:55:02.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa5b259c700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b419b800 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009fd0 tx=0x7fa5a800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.768+0000 7fa59bfff700 1 -- 172.21.15.6:0/576499945 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a801d070 con 0x7fa5b4100eb0 2023-09-13T09:55:02.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.769+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a80095f0 con 0x7fa5b4100eb0 2023-09-13T09:55:02.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.769+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b419ee80 con 0x7fa5b4100eb0 2023-09-13T09:55:02.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.769+0000 7fa59bfff700 1 -- 172.21.15.6:0/576499945 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5a8005050 con 0x7fa5b4100eb0 2023-09-13T09:55:02.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.769+0000 7fa59bfff700 1 -- 172.21.15.6:0/576499945 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8004a90 con 0x7fa5b4100eb0 2023-09-13T09:55:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.772+0000 7fa59bfff700 1 -- 172.21.15.6:0/576499945 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa5a8004bf0 con 0x7fa5b4100eb0 2023-09-13T09:55:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.773+0000 7fa59bfff700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa59c0a06c0 0x7fa59c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.773+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa59c0a06c0 0x7fa59c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.773+0000 7fa59bfff700 1 -- 172.21.15.6:0/576499945 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5a80cc770 con 0x7fa5b4100eb0 2023-09-13T09:55:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 Processor -- start 2023-09-13T09:55:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa59c0a06c0 0x7fa59c0a2b80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4100d10 tx=0x7fa5a4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 -- start start 2023-09-13T09:55:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab670f6b0 0x55fab670fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab6710010 0x55fab6710490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab67109d0 0x55fab6710e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab6668780 con 0x55fab67109d0 2023-09-13T09:55:02.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab66660a0 con 0x55fab670f6b0 2023-09-13T09:55:02.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab6661990 con 0x55fab6710010 2023-09-13T09:55:02.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5b2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab670f6b0 0x55fab670fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5b259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab6710010 0x55fab6710490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5b2d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab670f6b0 0x55fab670fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:36988/0 (socket says 172.21.15.6:36988) 2023-09-13T09:55:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5b2d9d700 1 -- 172.21.15.6:0/241792101 learned_addr learned my addr 172.21.15.6:0/241792101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.774+0000 7fa5b359e700 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab67109d0 0x55fab6710e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5b259c700 1 -- 172.21.15.6:0/241792101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab670f6b0 msgr2=0x55fab670fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5b259c700 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab670f6b0 0x55fab670fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5b259c700 1 -- 172.21.15.6:0/241792101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab67109d0 msgr2=0x55fab6710e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5b259c700 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab67109d0 0x55fab6710e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5b259c700 1 -- 172.21.15.6:0/241792101 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fab64e1630 con 0x55fab6710010 2023-09-13T09:55:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5b359e700 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab67109d0 0x55fab6710e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5b259c700 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab6710010 0x55fab6710490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ca270 tx=0x7fa5a8099c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5aff27e6df691ce server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5997fa700 1 -- 172.21.15.6:0/241792101 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a8099fa0 con 0x55fab6710010 2023-09-13T09:55:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5997fa700 1 -- 172.21.15.6:0/241792101 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5a809ddd0 con 0x55fab6710010 2023-09-13T09:55:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.775+0000 7fa5997fa700 1 -- 172.21.15.6:0/241792101 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a1af0 con 0x55fab6710010 2023-09-13T09:55:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 -- 172.21.15.6:0/241792101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab6710010 msgr2=0x55fab6710490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab6710010 0x55fab6710490 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ca270 tx=0x7fa5a8099c10 comp rx=0 tx=0).stop 2023-09-13T09:55:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 -- 172.21.15.6:0/241792101 shutdown_connections 2023-09-13T09:55:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab67109d0 0x55fab6710e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab670f6b0 0x55fab670fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/241792101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab6710010 0x55fab6710490 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 -- 172.21.15.6:0/241792101 >> 172.21.15.6:0/241792101 conn(0x55fab666dc80 msgr2=0x55fab6709f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:02.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.776+0000 7fa5c5327b80 1 -- 172.21.15.6:0/241792101 shutdown_connections 2023-09-13T09:55:02.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.777+0000 7fa5c5327b80 1 -- 172.21.15.6:0/241792101 wait complete. 2023-09-13T09:55:02.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.777+0000 7fa5c5327b80 1 -- start start 2023-09-13T09:55:02.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.777+0000 7fa5c5327b80 1 Processor -- start 2023-09-13T09:55:02.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.777+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6721370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.777+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67218b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab67109d0 0x55fab67288f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab65ffbb0 con 0x55fab670f6b0 2023-09-13T09:55:02.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab65ff8b0 con 0x55fab6710010 2023-09-13T09:55:02.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab64e3920 con 0x55fab67109d0 2023-09-13T09:55:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5c5327b80 10 client.0 _ll_register_callbacks cb 0x55fab65fd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6721370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6721370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43470/0 (socket says 172.21.15.6:43470) 2023-09-13T09:55:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 -- 172.21.15.6:0/1293413103 learned_addr learned my addr 172.21.15.6:0/1293413103 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:02.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b359e700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab67109d0 0x55fab67288f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b259c700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67218b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 -- 172.21.15.6:0/1293413103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab67109d0 msgr2=0x55fab67288f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:02.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab67109d0 0x55fab67288f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 -- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 msgr2=0x55fab67218b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:02.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67218b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b2d9d700 1 -- 172.21.15.6:0/1293413103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a80b9040 con 0x55fab670f6b0 2023-09-13T09:55:02.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.778+0000 7fa5b259c700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:55:02.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6721370 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4003920 tx=0x7fa5a40047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec9b2e6bcdc6a9b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa596ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa596ff5700 1 -- 172.21.15.6:0/1293413103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a401f9f0 con 0x55fab670f6b0 2023-09-13T09:55:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa596ff5700 1 -- 172.21.15.6:0/1293413103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5a401fb50 con 0x55fab670f6b0 2023-09-13T09:55:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fab6702670 con 0x55fab670f6b0 2023-09-13T09:55:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa596ff5700 1 -- 172.21.15.6:0/1293413103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5a401fd10 con 0x55fab670f6b0 2023-09-13T09:55:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa5c5327b80 10 client.19500 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.781+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55fab66797a0 con 0x55fab670f6b0 2023-09-13T09:55:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa596ff5700 1 -- 172.21.15.6:0/1293413103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55fab6702670 con 0x55fab670f6b0 2023-09-13T09:55:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa596ff5700 1 -- 172.21.15.6:0/1293413103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa5a4028510 con 0x55fab670f6b0 2023-09-13T09:55:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa5c5327b80 10 client.19500 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa5c5327b80 10 client.19500 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa5c5327b80 20 client.19500 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab672d270 0x55fab672f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa5c5327b80 4 client.19500 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fab665a970 con 0x55fab672d270 2023-09-13T09:55:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.782+0000 7fa5b259c700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab672d270 0x55fab672f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.783+0000 7fa596ff5700 10 client.19500 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.783+0000 7fa5b259c700 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab672d270 0x55fab672f690 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2fecf77a1d5ea6e server_cookie=e25318f471cdccd1 in_seq=0 out_seq=0 2023-09-13T09:55:02.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa596ff5700 1 -- 172.21.15.6:0/1293413103 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fab665a970 con 0x55fab672d270 2023-09-13T09:55:02.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa596ff5700 10 client.19500 handle_command_reply: tid=0 2023-09-13T09:55:02.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 client.19500 shutdown 2023-09-13T09:55:02.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 msgr2=0x55fab6721370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6721370 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7fa5a4003920 tx=0x7fa5a40047c0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 shutdown_connections 2023-09-13T09:55:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab67109d0 0x55fab67288f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab672d270 0x55fab672f690 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6721370 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/1293413103 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67218b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa596ff5700 0 client.19500 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:02.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 >> 172.21.15.6:0/1293413103 conn(0x55fab666dc80 msgr2=0x55fab67047f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:02.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 shutdown_connections 2023-09-13T09:55:02.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 1 -- 172.21.15.6:0/1293413103 wait complete. 2023-09-13T09:55:02.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.784+0000 7fa5c5327b80 20 client.19500 trim_cache size 0 max 16384 2023-09-13T09:55:02.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 Processor -- start 2023-09-13T09:55:02.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 -- start start 2023-09-13T09:55:02.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 0x55fab670ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6728880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67038e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab6706930 con 0x55fab670f6b0 2023-09-13T09:55:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab670a940 con 0x55fab6710010 2023-09-13T09:55:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab6720820 con 0x55fab666dc80 2023-09-13T09:55:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5b259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6728880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5b259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6728880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43480/0 (socket says 172.21.15.6:43480) 2023-09-13T09:55:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5b259c700 1 -- 172.21.15.6:0/3437527566 learned_addr learned my addr 172.21.15.6:0/3437527566 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.809+0000 7fa5b359e700 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67038e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa5b259c700 1 -- 172.21.15.6:0/3437527566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 msgr2=0x55fab670ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa5b259c700 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 0x55fab670ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa5b259c700 1 -- 172.21.15.6:0/3437527566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 msgr2=0x55fab67038e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa5b259c700 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67038e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa5b259c700 1 -- 172.21.15.6:0/3437527566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fab648dde0 con 0x55fab670f6b0 2023-09-13T09:55:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa5b259c700 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6728880 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8099f30 tx=0x7fa5a8096410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be445423f6f261d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa599ffb700 1 -- 172.21.15.6:0/3437527566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a1f80 con 0x55fab670f6b0 2023-09-13T09:55:02.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa599ffb700 1 -- 172.21.15.6:0/3437527566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5a8098340 con 0x55fab670f6b0 2023-09-13T09:55:02.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.810+0000 7fa599ffb700 1 -- 172.21.15.6:0/3437527566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a1af0 con 0x55fab670f6b0 2023-09-13T09:55:02.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3437527566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 msgr2=0x55fab6728880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6728880 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8099f30 tx=0x7fa5a8096410 comp rx=0 tx=0).stop 2023-09-13T09:55:02.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3437527566 shutdown_connections 2023-09-13T09:55:02.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab67038e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 0x55fab670ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3437527566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab6728880 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3437527566 >> 172.21.15.6:0/3437527566 conn(0x55fab670a240 msgr2=0x55fab670e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:02.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3437527566 shutdown_connections 2023-09-13T09:55:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3437527566 wait complete. 2023-09-13T09:55:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.811+0000 7fa5c5327b80 1 -- start start 2023-09-13T09:55:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 1 Processor -- start 2023-09-13T09:55:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 0x55fab6727260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab67277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab6727ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab67810d0 con 0x55fab670f6b0 2023-09-13T09:55:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab6781240 con 0x55fab6710010 2023-09-13T09:55:02.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fab6781400 con 0x55fab666dc80 2023-09-13T09:55:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5c5327b80 10 client.0 _ll_register_callbacks cb 0x55fab65fd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b359e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab6727ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b359e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab6727ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37008/0 (socket says 172.21.15.6:37008) 2023-09-13T09:55:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b359e700 1 -- 172.21.15.6:0/3806417122 learned_addr learned my addr 172.21.15.6:0/3806417122 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:02.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b259c700 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab67277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b259c700 1 -- 172.21.15.6:0/3806417122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 msgr2=0x55fab6727260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:55:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b259c700 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 0x55fab6727260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b259c700 1 -- 172.21.15.6:0/3806417122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 msgr2=0x55fab6727ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b259c700 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab6727ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.812+0000 7fa5b259c700 1 -- 172.21.15.6:0/3806417122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fab64e1630 con 0x55fab670f6b0 2023-09-13T09:55:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa5b259c700 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab67277a0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ca590 tx=0x7fa5a80963a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c20f5c49f4ada14a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa596ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa596ff5700 1 -- 172.21.15.6:0/3806417122 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5a80a1f80 con 0x55fab670f6b0 2023-09-13T09:55:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa596ff5700 1 -- 172.21.15.6:0/3806417122 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5a80b2220 con 0x55fab670f6b0 2023-09-13T09:55:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5a809ddd0 con 0x55fab670f6b0 2023-09-13T09:55:02.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa596ff5700 1 -- 172.21.15.6:0/3806417122 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5a80a1af0 con 0x55fab670f6b0 2023-09-13T09:55:02.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa5c5327b80 10 client.19506 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:02.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55fab6476c60 con 0x55fab670f6b0 2023-09-13T09:55:02.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.813+0000 7fa596ff5700 1 -- 172.21.15.6:0/3806417122 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5a809ddd0 con 0x55fab670f6b0 2023-09-13T09:55:02.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.814+0000 7fa596ff5700 1 -- 172.21.15.6:0/3806417122 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa5a8095d90 con 0x55fab670f6b0 2023-09-13T09:55:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.814+0000 7fa5c5327b80 10 client.19506 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.814+0000 7fa5c5327b80 10 client.19506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.814+0000 7fa5c5327b80 20 client.19506 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:02.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.814+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab67109d0 0x55fab67849e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.814+0000 7fa5c5327b80 4 client.19506 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:55:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.814+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fab661b050 con 0x55fab67109d0 2023-09-13T09:55:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.815+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab67109d0 0x55fab67849e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.815+0000 7fa5b2d9d700 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab67109d0 0x55fab67849e0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46e1cd5a095bb952 server_cookie=9b6296bbdda43146 in_seq=0 out_seq=0 2023-09-13T09:55:02.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.815+0000 7fa596ff5700 10 client.19506 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.819+0000 7fa596ff5700 1 -- 172.21.15.6:0/3806417122 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fab661b050 con 0x55fab67109d0 2023-09-13T09:55:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.819+0000 7fa596ff5700 10 client.19506 handle_command_reply: tid=0 2023-09-13T09:55:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.819+0000 7fa5c5327b80 1 client.19506 shutdown 2023-09-13T09:55:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.819+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 msgr2=0x55fab67277a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.819+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab67277a0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fa5a80ca590 tx=0x7fa5a80963a0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 shutdown_connections 2023-09-13T09:55:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55fab6710010 0x55fab6727ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55fab666dc80 0x55fab6727260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55fab67109d0 0x55fab67849e0 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 --2- 172.21.15.6:0/3806417122 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55fab670f6b0 0x55fab67277a0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa596ff5700 0 client.19506 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 >> 172.21.15.6:0/3806417122 conn(0x55fab670a240 msgr2=0x55fab670ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 shutdown_connections 2023-09-13T09:55:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 1 -- 172.21.15.6:0/3806417122 wait complete. 2023-09-13T09:55:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.821+0000 7fa5c5327b80 20 client.19506 trim_cache size 0 max 16384 2023-09-13T09:55:02.832 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:55:02.832 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:55:02.832 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:55:02.833 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:55:02.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa59c0a06c0 msgr2=0x7fa59c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa59c0a06c0 0x7fa59c0a2b80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4100d10 tx=0x7fa5a4009260 comp rx=0 tx=0).stop 2023-09-13T09:55:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 msgr2=0x7fa5b419b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b419b800 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009fd0 tx=0x7fa5a800f690 comp rx=0 tx=0).stop 2023-09-13T09:55:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 shutdown_connections 2023-09-13T09:55:02.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5b4101850 0x7fa5b419de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5b40ffcc0 0x7fa5b4068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa59c0a06c0 0x7fa59c0a2b80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 --2- 172.21.15.6:0/576499945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b4100eb0 0x7fa5b419b800 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 >> 172.21.15.6:0/576499945 conn(0x7fa5b40fb250 msgr2=0x7fa5b4104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 shutdown_connections 2023-09-13T09:55:02.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.822+0000 7fa5b9142700 1 -- 172.21.15.6:0/576499945 wait complete. 2023-09-13T09:55:02.837 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:55:02.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:55:02.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.982+0000 7f58657ac700 1 -- 172.21.15.6:0/707871337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 msgr2=0x7f58601080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.982+0000 7f58657ac700 1 --2- 172.21.15.6:0/707871337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 0x7f58601080d0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f585800b0d0 tx=0x7f585800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.982+0000 7f58657ac700 1 -- 172.21.15.6:0/707871337 shutdown_connections 2023-09-13T09:55:02.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 --2- 172.21.15.6:0/707871337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 0x7f58601080d0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 --2- 172.21.15.6:0/707871337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f58600ffc90 0x7f58601000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 --2- 172.21.15.6:0/707871337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5860100e80 0x7f58601012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 -- 172.21.15.6:0/707871337 >> 172.21.15.6:0/707871337 conn(0x7f58600fb220 msgr2=0x7f58600fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:02.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 -- 172.21.15.6:0/707871337 shutdown_connections 2023-09-13T09:55:02.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 -- 172.21.15.6:0/707871337 wait complete. 2023-09-13T09:55:02.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 Processor -- start 2023-09-13T09:55:02.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.983+0000 7f58657ac700 1 -- start start 2023-09-13T09:55:02.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f58657ac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58600ffc90 0x7f5860068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f58657ac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5860100e80 0x7f586019b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f58657ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 0x7f586019ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f58657ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586019e560 con 0x7f5860101820 2023-09-13T09:55:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f58657ac700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586019e6d0 con 0x7f5860100e80 2023-09-13T09:55:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f58657ac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f586019e890 con 0x7f58600ffc90 2023-09-13T09:55:02.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 0x7f586019ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5860100e80 0x7f586019b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58600ffc90 0x7f5860068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 0x7f586019ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43498/0 (socket says 172.21.15.6:43498) 2023-09-13T09:55:02.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585f7fe700 1 -- 172.21.15.6:0/2413731698 learned_addr learned my addr 172.21.15.6:0/2413731698 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585e7fc700 1 -- 172.21.15.6:0/2413731698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58600ffc90 msgr2=0x7f5860068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585e7fc700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58600ffc90 0x7f5860068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585e7fc700 1 -- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 msgr2=0x7f586019ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585e7fc700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 0x7f586019ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:02.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585e7fc700 1 -- 172.21.15.6:0/2413731698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5858009d00 con 0x7f5860100e80 2023-09-13T09:55:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.984+0000 7f585effd700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58600ffc90 0x7f5860068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.985+0000 7f585e7fc700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5860100e80 0x7f586019b780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f584800e9f0 tx=0x7f584800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.985+0000 7f5857fff700 1 -- 172.21.15.6:0/2413731698 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584800c9c0 con 0x7f5860100e80 2023-09-13T09:55:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.985+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f586019eb70 con 0x7f5860100e80 2023-09-13T09:55:02.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.985+0000 7f5857fff700 1 -- 172.21.15.6:0/2413731698 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5848010430 con 0x7f5860100e80 2023-09-13T09:55:02.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.985+0000 7f5857fff700 1 -- 172.21.15.6:0/2413731698 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5848018680 con 0x7f5860100e80 2023-09-13T09:55:02.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.985+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f586019f0d0 con 0x7f5860100e80 2023-09-13T09:55:02.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.986+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5860107180 con 0x7f5860100e80 2023-09-13T09:55:02.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.989+0000 7f5857fff700 1 -- 172.21.15.6:0/2413731698 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5848010860 con 0x7f5860100e80 2023-09-13T09:55:02.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.989+0000 7f5857fff700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f584c0a0640 0x7f584c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:02.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.990+0000 7f5857fff700 1 -- 172.21.15.6:0/2413731698 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5848014070 con 0x7f5860100e80 2023-09-13T09:55:02.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.990+0000 7f585effd700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f584c0a0640 0x7f584c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:02.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.990+0000 7f585effd700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f584c0a0640 0x7f584c0a2b00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5860100ce0 tx=0x7f585000a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:02.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:02.997+0000 7f5857fff700 1 -- 172.21.15.6:0/2413731698 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f58480959e0 con 0x7f5860100e80 2023-09-13T09:55:03.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.295+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f586010b500 con 0x7f5860100e80 2023-09-13T09:55:03.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.297+0000 7f5857fff700 1 -- 172.21.15.6:0/2413731698 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+11363 (secure 0 0 0) 0x7f5848099000 con 0x7f5860100e80 2023-09-13T09:55:03.298 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:55:03.298 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":50,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:54:52.923885+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:55:03.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f584c0a0640 msgr2=0x7f584c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f584c0a0640 0x7f584c0a2b00 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5860100ce0 tx=0x7f585000a380 comp rx=0 tx=0).stop 2023-09-13T09:55:03.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5860100e80 msgr2=0x7f586019b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5860100e80 0x7f586019b780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f584800e9f0 tx=0x7f584800ed00 comp rx=0 tx=0).stop 2023-09-13T09:55:03.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 shutdown_connections 2023-09-13T09:55:03.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f584c0a0640 0x7f584c0a2b00 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5860101820 0x7f586019ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58600ffc90 0x7f5860068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 --2- 172.21.15.6:0/2413731698 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5860100e80 0x7f586019b780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 >> 172.21.15.6:0/2413731698 conn(0x7f58600fb220 msgr2=0x7f58601042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 shutdown_connections 2023-09-13T09:55:03.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.300+0000 7f58657ac700 1 -- 172.21.15.6:0/2413731698 wait complete. 2023-09-13T09:55:03.303 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 50 2023-09-13T09:55:03.316 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:55:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 -- 172.21.15.6:0/1399406393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c0ffcc0 msgr2=0x7f496c1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 --2- 172.21.15.6:0/1399406393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c0ffcc0 0x7f496c1000e0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f495c0099c0 tx=0x7f495c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 -- 172.21.15.6:0/1399406393 shutdown_connections 2023-09-13T09:55:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 --2- 172.21.15.6:0/1399406393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c101850 0x7f496c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 --2- 172.21.15.6:0/1399406393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c0ffcc0 0x7f496c1000e0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 --2- 172.21.15.6:0/1399406393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c100eb0 0x7f496c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 -- 172.21.15.6:0/1399406393 >> 172.21.15.6:0/1399406393 conn(0x7f496c0fb250 msgr2=0x7f496c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 -- 172.21.15.6:0/1399406393 shutdown_connections 2023-09-13T09:55:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 -- 172.21.15.6:0/1399406393 wait complete. 2023-09-13T09:55:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.468+0000 7f4971432700 1 Processor -- start 2023-09-13T09:55:03.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f4971432700 1 -- start start 2023-09-13T09:55:03.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f4971432700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c0ffcc0 0x7f496c10fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f4971432700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c100eb0 0x7f496c115150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f4971432700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c101850 0x7f496c1100f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f4971432700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1107a0 con 0x7f496c101850 2023-09-13T09:55:03.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f4971432700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1ad5f0 con 0x7f496c0ffcc0 2023-09-13T09:55:03.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f4971432700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f496c1ad730 con 0x7f496c100eb0 2023-09-13T09:55:03.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c101850 0x7f496c1100f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f496affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c0ffcc0 0x7f496c10fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f496affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c0ffcc0 0x7f496c10fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37034/0 (socket says 172.21.15.6:37034) 2023-09-13T09:55:03.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f496affd700 1 -- 172.21.15.6:0/280191779 learned_addr learned my addr 172.21.15.6:0/280191779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.469+0000 7f496a7fc700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c100eb0 0x7f496c115150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.470+0000 7f496affd700 1 -- 172.21.15.6:0/280191779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c100eb0 msgr2=0x7f496c115150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.470+0000 7f496affd700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c100eb0 0x7f496c115150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.470+0000 7f496affd700 1 -- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c101850 msgr2=0x7f496c1100f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.470+0000 7f496affd700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c101850 0x7f496c1100f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.470+0000 7f496affd700 1 -- 172.21.15.6:0/280191779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f495c0095f0 con 0x7f496c0ffcc0 2023-09-13T09:55:03.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.470+0000 7f496a7fc700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c100eb0 0x7f496c115150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:03.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.470+0000 7f496affd700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c0ffcc0 0x7f496c10fbb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f495c009fd0 tx=0x7f495c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.472+0000 7f4953fff700 1 -- 172.21.15.6:0/280191779 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c01d070 con 0x7f496c0ffcc0 2023-09-13T09:55:03.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.472+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f496c1ad9b0 con 0x7f496c0ffcc0 2023-09-13T09:55:03.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.472+0000 7f4953fff700 1 -- 172.21.15.6:0/280191779 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f495c005050 con 0x7f496c0ffcc0 2023-09-13T09:55:03.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.472+0000 7f4953fff700 1 -- 172.21.15.6:0/280191779 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f495c004a70 con 0x7f496c0ffcc0 2023-09-13T09:55:03.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.472+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f496c1ade30 con 0x7f496c0ffcc0 2023-09-13T09:55:03.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.475+0000 7f4953fff700 1 -- 172.21.15.6:0/280191779 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f495c005450 con 0x7f496c0ffcc0 2023-09-13T09:55:03.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.475+0000 7f4953fff700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49540a0620 0x7f49540a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.476+0000 7f496a7fc700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49540a0620 0x7f49540a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.476+0000 7f4953fff700 1 -- 172.21.15.6:0/280191779 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f495c0cc9b0 con 0x7f496c0ffcc0 2023-09-13T09:55:03.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.476+0000 7f497d617b80 1 Processor -- start 2023-09-13T09:55:03.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.476+0000 7f497d617b80 1 -- start start 2023-09-13T09:55:03.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.476+0000 7f497d617b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f31b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.476+0000 7f497d617b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.476+0000 7f497d617b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 0x555db7f30e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f497d617b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7e89780 con 0x555db7f32060 2023-09-13T09:55:03.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f497d617b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7e870a0 con 0x555db7f31700 2023-09-13T09:55:03.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f497d617b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7e82990 con 0x555db7f30a00 2023-09-13T09:55:03.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f304c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43520/0 (socket says 172.21.15.6:43520) 2023-09-13T09:55:03.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 -- 172.21.15.6:0/3827722759 learned_addr learned my addr 172.21.15.6:0/3827722759 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496b7fe700 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 0x555db7f30e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496affd700 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f31b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 -- 172.21.15.6:0/3827722759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 msgr2=0x555db7f30e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 0x555db7f30e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 -- 172.21.15.6:0/3827722759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 msgr2=0x555db7f31b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f31b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 -- 172.21.15.6:0/3827722759 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555db7d02630 con 0x555db7f32060 2023-09-13T09:55:03.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f304c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f496000f470 tx=0x7f496000f780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78eb4e255d038b9e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f496a7fc700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49540a0620 0x7f49540a2ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f496000fad0 tx=0x7f4960013000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.477+0000 7f49517fa700 1 -- 172.21.15.6:0/3827722759 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000ec50 con 0x555db7f32060 2023-09-13T09:55:03.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f49517fa700 1 -- 172.21.15.6:0/3827722759 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4960015070 con 0x555db7f32060 2023-09-13T09:55:03.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f49517fa700 1 -- 172.21.15.6:0/3827722759 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496001fca0 con 0x555db7f32060 2023-09-13T09:55:03.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 -- 172.21.15.6:0/3827722759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 msgr2=0x555db7f304c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f304c0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7f496000f470 tx=0x7f496000f780 comp rx=0 tx=0).stop 2023-09-13T09:55:03.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 -- 172.21.15.6:0/3827722759 shutdown_connections 2023-09-13T09:55:03.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 0x555db7f30e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f31b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 --2- 172.21.15.6:0/3827722759 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f304c0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 -- 172.21.15.6:0/3827722759 >> 172.21.15.6:0/3827722759 conn(0x555db7e8ec80 msgr2=0x555db7f2af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 -- 172.21.15.6:0/3827722759 shutdown_connections 2023-09-13T09:55:03.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.478+0000 7f497d617b80 1 -- 172.21.15.6:0/3827722759 wait complete. 2023-09-13T09:55:03.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 -- start start 2023-09-13T09:55:03.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 Processor -- start 2023-09-13T09:55:03.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f30a00 0x555db7f39f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7e20bb0 con 0x555db7f32060 2023-09-13T09:55:03.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7e208b0 con 0x555db7f30a00 2023-09-13T09:55:03.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7d04920 con 0x555db7f31700 2023-09-13T09:55:03.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f497d617b80 10 client.0 _ll_register_callbacks cb 0x555db7e1e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:03.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f496a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f496affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f30a00 0x555db7f39f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f496a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46580/0 (socket says 172.21.15.6:46580) 2023-09-13T09:55:03.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f496a7fc700 1 -- 172.21.15.6:0/1213403933 learned_addr learned my addr 172.21.15.6:0/1213403933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.479+0000 7f496affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f30a00 0x555db7f39f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37048/0 (socket says 172.21.15.6:37048) 2023-09-13T09:55:03.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f496b7fe700 1 -- 172.21.15.6:0/1213403933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 msgr2=0x555db7f3a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f496b7fe700 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f496b7fe700 1 -- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f30a00 msgr2=0x555db7f39f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f496b7fe700 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f30a00 0x555db7f39f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f496b7fe700 1 -- 172.21.15.6:0/1213403933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4960011ce0 con 0x555db7f32060 2023-09-13T09:55:03.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f496affd700 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f30a00 0x555db7f39f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:03.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f496b7fe700 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f414e0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f4964011e90 tx=0x7f4964014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2200d0f23f5db5c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f494eff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:03.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f494eff5700 1 -- 172.21.15.6:0/1213403933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400e040 con 0x555db7f32060 2023-09-13T09:55:03.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f494eff5700 1 -- 172.21.15.6:0/1213403933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4964004bb0 con 0x555db7f32060 2023-09-13T09:55:03.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555db7f23670 con 0x555db7f32060 2023-09-13T09:55:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f494eff5700 1 -- 172.21.15.6:0/1213403933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4964004d70 con 0x555db7f32060 2023-09-13T09:55:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f497d617b80 10 client.19524 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.480+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x555db7e9a7a0 con 0x555db7f32060 2023-09-13T09:55:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f494eff5700 1 -- 172.21.15.6:0/1213403933 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555db7f23670 con 0x555db7f32060 2023-09-13T09:55:03.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f494eff5700 1 -- 172.21.15.6:0/1213403933 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f496401c030 con 0x555db7f32060 2023-09-13T09:55:03.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f497d617b80 10 client.19524 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:03.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f497d617b80 10 client.19524 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:55:03.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f497d617b80 20 client.19524 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:03.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f497d617b80 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7f45e90 0x555db7f482b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f497d617b80 4 client.19524 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555db7e7b970 con 0x555db7f45e90 2023-09-13T09:55:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f496affd700 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7f45e90 0x555db7f482b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f494eff5700 10 client.19524 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.481+0000 7f496affd700 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7f45e90 0x555db7f482b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=df104e1c52b29f09 server_cookie=1458cbf5d20a2da2 in_seq=0 out_seq=0 2023-09-13T09:55:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f494eff5700 1 -- 172.21.15.6:0/1213403933 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555db7e7b970 con 0x555db7f45e90 2023-09-13T09:55:03.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f494eff5700 10 client.19524 handle_command_reply: tid=0 2023-09-13T09:55:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 client.19524 shutdown 2023-09-13T09:55:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 msgr2=0x555db7f414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f414e0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f4964011e90 tx=0x7f4964014600 comp rx=0 tx=0).stop 2023-09-13T09:55:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 shutdown_connections 2023-09-13T09:55:03.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7f45e90 0x555db7f482b0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f414e0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f30a00 0x555db7f39f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 --2- 172.21.15.6:0/1213403933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 >> 172.21.15.6:0/1213403933 conn(0x555db7e8ec80 msgr2=0x555db7f257f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f494eff5700 0 client.19524 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 shutdown_connections 2023-09-13T09:55:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 1 -- 172.21.15.6:0/1213403933 wait complete. 2023-09-13T09:55:03.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.485+0000 7f497d617b80 20 client.19524 trim_cache size 0 max 16384 2023-09-13T09:55:03.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.508+0000 7f497d617b80 1 Processor -- start 2023-09-13T09:55:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.508+0000 7f497d617b80 1 -- start start 2023-09-13T09:55:03.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f497d617b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 0x555db7f304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f497d617b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f41400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f497d617b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f37e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f497d617b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7f278e0 con 0x555db7f32060 2023-09-13T09:55:03.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f497d617b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7f2b990 con 0x555db7f31700 2023-09-13T09:55:03.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f497d617b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7f2c350 con 0x555db7f30a00 2023-09-13T09:55:03.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f496a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f41400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f496a7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f41400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37060/0 (socket says 172.21.15.6:37060) 2023-09-13T09:55:03.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.509+0000 7f496a7fc700 1 -- 172.21.15.6:0/1984954193 learned_addr learned my addr 172.21.15.6:0/1984954193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f496a7fc700 1 -- 172.21.15.6:0/1984954193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 msgr2=0x555db7f304c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:55:03.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f496a7fc700 1 --2- 172.21.15.6:0/1984954193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 0x555db7f304c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f496a7fc700 1 -- 172.21.15.6:0/1984954193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 msgr2=0x555db7f37e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f496a7fc700 1 --2- 172.21.15.6:0/1984954193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f37e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f496a7fc700 1 -- 172.21.15.6:0/1984954193 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555db7caede0 con 0x555db7f31700 2023-09-13T09:55:03.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f496a7fc700 1 --2- 172.21.15.6:0/1984954193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f41400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f49600097a0 tx=0x7f4960005fa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb0aa051211f2b2c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f4951ffb700 1 -- 172.21.15.6:0/1984954193 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496002d040 con 0x555db7f31700 2023-09-13T09:55:03.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f4951ffb700 1 -- 172.21.15.6:0/1984954193 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4960009240 con 0x555db7f31700 2023-09-13T09:55:03.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.510+0000 7f4951ffb700 1 -- 172.21.15.6:0/1984954193 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960003680 con 0x555db7f31700 2023-09-13T09:55:03.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.511+0000 7f497d617b80 1 -- 172.21.15.6:0/1984954193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 msgr2=0x555db7f41400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.511+0000 7f497d617b80 1 --2- 172.21.15.6:0/1984954193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f41400 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f49600097a0 tx=0x7f4960005fa0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- 172.21.15.6:0/1984954193 shutdown_connections 2023-09-13T09:55:03.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 --2- 172.21.15.6:0/1984954193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f32060 0x555db7f37e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 --2- 172.21.15.6:0/1984954193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f30a00 0x555db7f304c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 --2- 172.21.15.6:0/1984954193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f31700 0x555db7f41400 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- 172.21.15.6:0/1984954193 >> 172.21.15.6:0/1984954193 conn(0x555db7e8ec80 msgr2=0x555db7f38b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- 172.21.15.6:0/1984954193 shutdown_connections 2023-09-13T09:55:03.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- 172.21.15.6:0/1984954193 wait complete. 2023-09-13T09:55:03.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- start start 2023-09-13T09:55:03.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 Processor -- start 2023-09-13T09:55:03.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f30a00 0x555db7f3b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f32060 0x555db7f406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7f40c20 con 0x555db7f30a00 2023-09-13T09:55:03.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7f40d90 con 0x555db7f32060 2023-09-13T09:55:03.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.512+0000 7f497d617b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555db7f40f50 con 0x555db7f31700 2023-09-13T09:55:03.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f497d617b80 10 client.0 _ll_register_callbacks cb 0x555db7e1e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:03.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f30a00 0x555db7f3b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f30a00 0x555db7f3b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43538/0 (socket says 172.21.15.6:43538) 2023-09-13T09:55:03.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f32060 0x555db7f406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496affd700 1 -- 172.21.15.6:0/2170064957 learned_addr learned my addr 172.21.15.6:0/2170064957 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496a7fc700 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496b7fe700 1 -- 172.21.15.6:0/2170064957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 msgr2=0x555db7f3bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496b7fe700 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496b7fe700 1 -- 172.21.15.6:0/2170064957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f30a00 msgr2=0x555db7f3b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496b7fe700 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f30a00 0x555db7f3b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496b7fe700 1 -- 172.21.15.6:0/2170064957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555db7d02630 con 0x555db7f32060 2023-09-13T09:55:03.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496a7fc700 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:03.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f496b7fe700 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f32060 0x555db7f406e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49640043e0 tx=0x7f4964009650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0a7831f288775f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.513+0000 7f494eff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:55:03.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.514+0000 7f494eff5700 1 -- 172.21.15.6:0/2170064957 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496400e070 con 0x555db7f32060 2023-09-13T09:55:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.514+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4960015070 con 0x555db7f32060 2023-09-13T09:55:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.514+0000 7f494eff5700 1 -- 172.21.15.6:0/2170064957 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f496402c070 con 0x555db7f32060 2023-09-13T09:55:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.514+0000 7f494eff5700 1 -- 172.21.15.6:0/2170064957 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4964004890 con 0x555db7f32060 2023-09-13T09:55:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.514+0000 7f497d617b80 10 client.28877 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:03.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.514+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x555db7c97c60 con 0x555db7f32060 2023-09-13T09:55:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.514+0000 7f494eff5700 1 -- 172.21.15.6:0/2170064957 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4960015070 con 0x555db7f32060 2023-09-13T09:55:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f494eff5700 1 -- 172.21.15.6:0/2170064957 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f4964014320 con 0x555db7f32060 2023-09-13T09:55:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f497d617b80 10 client.28877 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f497d617b80 10 client.28877 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:55:03.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f497d617b80 20 client.28877 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f497d617b80 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7fabc70 0x555db7fae090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f497d617b80 4 client.28877 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555db7e3c050 con 0x555db7fabc70 2023-09-13T09:55:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f496affd700 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7fabc70 0x555db7fae090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f494eff5700 10 client.28877 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.515+0000 7f496affd700 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7fabc70 0x555db7fae090 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a1524bcd3e9682ec server_cookie=f4e3cd515beddb64 in_seq=0 out_seq=0 2023-09-13T09:55:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f494eff5700 1 -- 172.21.15.6:0/2170064957 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555db7e3c050 con 0x555db7fabc70 2023-09-13T09:55:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f494eff5700 10 client.28877 handle_command_reply: tid=0 2023-09-13T09:55:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 client.28877 shutdown 2023-09-13T09:55:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f32060 msgr2=0x555db7f406e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f32060 0x555db7f406e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49640043e0 tx=0x7f4964009650 comp rx=0 tx=0).stop 2023-09-13T09:55:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 shutdown_connections 2023-09-13T09:55:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x555db7fabc70 0x555db7fae090 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555db7f32060 0x555db7f406e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555db7f30a00 0x555db7f3b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f494eff5700 0 client.28877 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 --2- 172.21.15.6:0/2170064957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555db7f31700 0x555db7f3bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 >> 172.21.15.6:0/2170064957 conn(0x555db7e8ec80 msgr2=0x555db7f34980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 shutdown_connections 2023-09-13T09:55:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 1 -- 172.21.15.6:0/2170064957 wait complete. 2023-09-13T09:55:03.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.516+0000 7f497d617b80 20 client.28877 trim_cache size 0 max 16384 2023-09-13T09:55:03.530 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:03.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49540a0620 msgr2=0x7f49540a2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49540a0620 0x7f49540a2ae0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f496000fad0 tx=0x7f4960013000 comp rx=0 tx=0).stop 2023-09-13T09:55:03.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c0ffcc0 msgr2=0x7f496c10fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c0ffcc0 0x7f496c10fbb0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f495c009fd0 tx=0x7f495c00f690 comp rx=0 tx=0).stop 2023-09-13T09:55:03.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 shutdown_connections 2023-09-13T09:55:03.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f49540a0620 0x7f49540a2ae0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f496c101850 0x7f496c1100f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f496c0ffcc0 0x7f496c10fbb0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 --2- 172.21.15.6:0/280191779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f496c100eb0 0x7f496c115150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 >> 172.21.15.6:0/280191779 conn(0x7f496c0fb250 msgr2=0x7f496c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 shutdown_connections 2023-09-13T09:55:03.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.517+0000 7f4971432700 1 -- 172.21.15.6:0/280191779 wait complete. 2023-09-13T09:55:03.534 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:55:03.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 103670 39.81 MB/sec execute 23 sec latency 55.840 ms 2023-09-13T09:55:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 -- 172.21.15.6:0/2874522339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d540ffd20 msgr2=0x7f6d54100140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 --2- 172.21.15.6:0/2874522339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d540ffd20 0x7f6d54100140 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f6d440099c0 tx=0x7f6d44009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 -- 172.21.15.6:0/2874522339 shutdown_connections 2023-09-13T09:55:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 --2- 172.21.15.6:0/2874522339 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d541018b0 0x7f6d54108160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 --2- 172.21.15.6:0/2874522339 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d540ffd20 0x7f6d54100140 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 --2- 172.21.15.6:0/2874522339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d54100f10 0x7f6d54101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 -- 172.21.15.6:0/2874522339 >> 172.21.15.6:0/2874522339 conn(0x7f6d540fb290 msgr2=0x7f6d540fd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 -- 172.21.15.6:0/2874522339 shutdown_connections 2023-09-13T09:55:03.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.691+0000 7f6d58d64700 1 -- 172.21.15.6:0/2874522339 wait complete. 2023-09-13T09:55:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 Processor -- start 2023-09-13T09:55:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 -- start start 2023-09-13T09:55:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d540ffd20 0x7f6d54196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d54100f10 0x7f6d54197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d541018b0 0x7f6d5419e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5419e660 con 0x7f6d541018b0 2023-09-13T09:55:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5419e7a0 con 0x7f6d54100f10 2023-09-13T09:55:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.692+0000 7f6d58d64700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d5419e930 con 0x7f6d540ffd20 2023-09-13T09:55:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d540ffd20 0x7f6d54196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d540ffd20 0x7f6d54196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46606/0 (socket says 172.21.15.6:46606) 2023-09-13T09:55:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 -- 172.21.15.6:0/58476791 learned_addr learned my addr 172.21.15.6:0/58476791 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d54100f10 0x7f6d54197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 -- 172.21.15.6:0/58476791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d54100f10 msgr2=0x7f6d54197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d54100f10 0x7f6d54197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 -- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d541018b0 msgr2=0x7f6d5419e090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:55:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d541018b0 0x7f6d5419e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 -- 172.21.15.6:0/58476791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d440095f0 con 0x7f6d540ffd20 2023-09-13T09:55:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d5259c700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d540ffd20 0x7f6d54196ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009fd0 tx=0x7f6d4400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d437fe700 1 -- 172.21.15.6:0/58476791 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4401d070 con 0x7f6d540ffd20 2023-09-13T09:55:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d5419ebb0 con 0x7f6d540ffd20 2023-09-13T09:55:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.693+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d5419f030 con 0x7f6d540ffd20 2023-09-13T09:55:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.694+0000 7f6d437fe700 1 -- 172.21.15.6:0/58476791 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d440054f0 con 0x7f6d540ffd20 2023-09-13T09:55:03.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.694+0000 7f6d437fe700 1 -- 172.21.15.6:0/58476791 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d44004bd0 con 0x7f6d540ffd20 2023-09-13T09:55:03.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.698+0000 7f6d64f49b80 1 Processor -- start 2023-09-13T09:55:03.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d64f49b80 1 -- start start 2023-09-13T09:55:03.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d437fe700 1 -- 172.21.15.6:0/58476791 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6d4400fb80 con 0x7f6d540ffd20 2023-09-13T09:55:03.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9aedf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9aec8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9aed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9a41780 con 0x562df9aee470 2023-09-13T09:55:03.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9a3f0a0 con 0x562df9aedb10 2023-09-13T09:55:03.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9a3a990 con 0x562df9aece10 2023-09-13T09:55:03.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9aec8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d52d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9aedf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9aec8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43558/0 (socket says 172.21.15.6:43558) 2023-09-13T09:55:03.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d5259c700 1 -- 172.21.15.6:0/769700838 learned_addr learned my addr 172.21.15.6:0/769700838 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d51d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9aed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d52d9d700 1 -- 172.21.15.6:0/769700838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 msgr2=0x562df9aed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9aed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d437fe700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d3c0a06c0 0x7f6d3c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d52d9d700 1 -- 172.21.15.6:0/769700838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 msgr2=0x562df9aec8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9aec8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d52d9d700 1 -- 172.21.15.6:0/769700838 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df98ba630 con 0x562df9aedb10 2023-09-13T09:55:03.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.699+0000 7f6d5259c700 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9aec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.700+0000 7f6d437fe700 1 -- 172.21.15.6:0/58476791 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d440cca00 con 0x7f6d540ffd20 2023-09-13T09:55:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.700+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d3c0a06c0 0x7f6d3c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.700+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9aedf30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009cc0 tx=0x7f6d4c00b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d26eb8887c72994c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.700+0000 7f6d40ff9700 1 -- 172.21.15.6:0/769700838 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c014550 con 0x562df9aedb10 2023-09-13T09:55:03.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.700+0000 7f6d40ff9700 1 -- 172.21.15.6:0/769700838 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d4c014cc0 con 0x562df9aedb10 2023-09-13T09:55:03.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.700+0000 7f6d40ff9700 1 -- 172.21.15.6:0/769700838 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c01fd20 con 0x562df9aedb10 2023-09-13T09:55:03.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 -- 172.21.15.6:0/769700838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 msgr2=0x562df9aedf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9aedf30 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c009cc0 tx=0x7f6d4c00b410 comp rx=0 tx=0).stop 2023-09-13T09:55:03.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d3c0a06c0 0x7f6d3c0a2b80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c01b000 tx=0x7f6d4c01c000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 -- 172.21.15.6:0/769700838 shutdown_connections 2023-09-13T09:55:03.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9aed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9aedf30 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/769700838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9aec8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 -- 172.21.15.6:0/769700838 >> 172.21.15.6:0/769700838 conn(0x562df9a46c80 msgr2=0x562df9ae2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 -- 172.21.15.6:0/769700838 shutdown_connections 2023-09-13T09:55:03.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.701+0000 7f6d64f49b80 1 -- 172.21.15.6:0/769700838 wait complete. 2023-09-13T09:55:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 -- start start 2023-09-13T09:55:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 Processor -- start 2023-09-13T09:55:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9af6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9af6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9afd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df99d8bb0 con 0x562df9aece10 2023-09-13T09:55:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df99d88b0 con 0x562df9aedb10 2023-09-13T09:55:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df98bc920 con 0x562df9aee470 2023-09-13T09:55:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d64f49b80 10 client.0 _ll_register_callbacks cb 0x562df99d6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:03.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9af6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9af6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43566/0 (socket says 172.21.15.6:43566) 2023-09-13T09:55:03.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d5259c700 1 -- 172.21.15.6:0/337466622 learned_addr learned my addr 172.21.15.6:0/337466622 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.702+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9afd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d5259c700 1 -- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 msgr2=0x562df9afd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d5259c700 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9afd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d5259c700 1 -- 172.21.15.6:0/337466622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 msgr2=0x562df9af6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d5259c700 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9af6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d5259c700 1 -- 172.21.15.6:0/337466622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d4c0098f0 con 0x562df9aece10 2023-09-13T09:55:03.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9afd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:03.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d5259c700 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9af6340 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6d44096850 tx=0x7f6d4400ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96bcdebc38d1c33 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d39ffb700 1 -- 172.21.15.6:0/337466622 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d440a0270 con 0x562df9aece10 2023-09-13T09:55:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d39ffb700 1 -- 172.21.15.6:0/337466622 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d44005660 con 0x562df9aece10 2023-09-13T09:55:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562df9adb670 con 0x562df9aece10 2023-09-13T09:55:03.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d39ffb700 1 -- 172.21.15.6:0/337466622 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d44096690 con 0x562df9aece10 2023-09-13T09:55:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d64f49b80 10 client.19536 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.703+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x562df9a527a0 con 0x562df9aece10 2023-09-13T09:55:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d39ffb700 1 -- 172.21.15.6:0/337466622 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d440b1070 con 0x562df9aece10 2023-09-13T09:55:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d39ffb700 1 -- 172.21.15.6:0/337466622 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f6d440d4070 con 0x562df9aece10 2023-09-13T09:55:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d64f49b80 10 client.19536 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:03.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d64f49b80 10 client.19536 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:55:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d64f49b80 20 client.19536 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9b01e00 0x562df9b04220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d64f49b80 4 client.19536 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.704+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562df9a33970 con 0x562df9b01e00 2023-09-13T09:55:03.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.705+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9b01e00 0x562df9b04220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.705+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9b01e00 0x562df9b04220 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aacb106bc81c7df4 server_cookie=ffad09cbf40c115d in_seq=0 out_seq=0 2023-09-13T09:55:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.705+0000 7f6d39ffb700 10 client.19536 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:03.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d39ffb700 1 -- 172.21.15.6:0/337466622 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562df9a33970 con 0x562df9b01e00 2023-09-13T09:55:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d39ffb700 10 client.19536 handle_command_reply: tid=0 2023-09-13T09:55:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 client.19536 shutdown 2023-09-13T09:55:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 msgr2=0x562df9af6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9af6340 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7f6d44096850 tx=0x7f6d4400ff20 comp rx=0 tx=0).stop 2023-09-13T09:55:03.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 shutdown_connections 2023-09-13T09:55:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9b01e00 0x562df9b04220 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9afd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9af6340 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/337466622 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9af6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 >> 172.21.15.6:0/337466622 conn(0x562df9a46c80 msgr2=0x562df9add7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d39ffb700 0 client.19536 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:03.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 shutdown_connections 2023-09-13T09:55:03.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 1 -- 172.21.15.6:0/337466622 wait complete. 2023-09-13T09:55:03.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.709+0000 7f6d64f49b80 20 client.19536 trim_cache size 0 max 16384 2023-09-13T09:55:03.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 Processor -- start 2023-09-13T09:55:03.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 -- start start 2023-09-13T09:55:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9ae3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9ae2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9af5eb0 con 0x562df9aece10 2023-09-13T09:55:03.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9adb400 con 0x562df9aedb10 2023-09-13T09:55:03.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9b01970 con 0x562df9aee470 2023-09-13T09:55:03.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d51d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d51d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37098/0 (socket says 172.21.15.6:37098) 2023-09-13T09:55:03.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d51d9b700 1 -- 172.21.15.6:0/1912922957 learned_addr learned my addr 172.21.15.6:0/1912922957 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.728+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9ae2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d51d9b700 1 -- 172.21.15.6:0/1912922957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 msgr2=0x562df9ae2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9ae2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d51d9b700 1 -- 172.21.15.6:0/1912922957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 msgr2=0x562df9ae3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9ae3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d51d9b700 1 -- 172.21.15.6:0/1912922957 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df9866de0 con 0x562df9aedb10 2023-09-13T09:55:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9ae2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afd850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009ce0 tx=0x7f6d48009d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14a65b2598bae02c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d417fa700 1 -- 172.21.15.6:0/1912922957 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48016070 con 0x562df9aedb10 2023-09-13T09:55:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d417fa700 1 -- 172.21.15.6:0/1912922957 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d48017040 con 0x562df9aedb10 2023-09-13T09:55:03.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.729+0000 7f6d417fa700 1 -- 172.21.15.6:0/1912922957 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d4801a730 con 0x562df9aedb10 2023-09-13T09:55:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.730+0000 7f6d64f49b80 1 -- 172.21.15.6:0/1912922957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 msgr2=0x562df9afd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.730+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afd850 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6d48009ce0 tx=0x7f6d48009d10 comp rx=0 tx=0).stop 2023-09-13T09:55:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 -- 172.21.15.6:0/1912922957 shutdown_connections 2023-09-13T09:55:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aee470 0x562df9ae2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.737 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aece10 0x562df9ae3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/1912922957 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afd850 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 -- 172.21.15.6:0/1912922957 >> 172.21.15.6:0/1912922957 conn(0x562df9a46c80 msgr2=0x562df9af5080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 -- 172.21.15.6:0/1912922957 shutdown_connections 2023-09-13T09:55:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 -- 172.21.15.6:0/1912922957 wait complete. 2023-09-13T09:55:03.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 -- start start 2023-09-13T09:55:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.731+0000 7f6d64f49b80 1 Processor -- start 2023-09-13T09:55:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9af97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afbd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d64f49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9afc340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9afca10 con 0x562df9aee470 2023-09-13T09:55:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9afcb80 con 0x562df9aedb10 2023-09-13T09:55:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d64f49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df9afcd40 con 0x562df9aece10 2023-09-13T09:55:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d64f49b80 10 client.0 _ll_register_callbacks cb 0x562df99d6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9af97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d51d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d5259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9af97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46634/0 (socket says 172.21.15.6:46634) 2023-09-13T09:55:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d51d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37106/0 (socket says 172.21.15.6:37106) 2023-09-13T09:55:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d5259c700 1 -- 172.21.15.6:0/3751761410 learned_addr learned my addr 172.21.15.6:0/3751761410 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d52d9d700 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9afc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d51d9b700 1 -- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 msgr2=0x562df9af97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9af97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d51d9b700 1 -- 172.21.15.6:0/3751761410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 msgr2=0x562df9afc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9afc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d51d9b700 1 -- 172.21.15.6:0/3751761410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562df98ba630 con 0x562df9aedb10 2023-09-13T09:55:03.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.732+0000 7f6d5259c700 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9af97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d51d9b700 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afbd10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562df9b04aa0 tx=0x7f6d4801a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1457e27cda7b297 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:55:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d39ffb700 1 -- 172.21.15.6:0/3751761410 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d48016070 con 0x562df9aedb10 2023-09-13T09:55:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d39ffb700 1 -- 172.21.15.6:0/3751761410 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6d48003820 con 0x562df9aedb10 2023-09-13T09:55:03.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6d4c014cc0 con 0x562df9aedb10 2023-09-13T09:55:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d39ffb700 1 -- 172.21.15.6:0/3751761410 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6d48004e70 con 0x562df9aedb10 2023-09-13T09:55:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 10 client.28889 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7f6d48009de0 con 0x562df9aedb10 2023-09-13T09:55:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d39ffb700 1 -- 172.21.15.6:0/3751761410 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6d4c014cc0 con 0x562df9aedb10 2023-09-13T09:55:03.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d39ffb700 1 -- 172.21.15.6:0/3751761410 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f6d48004fd0 con 0x562df9aedb10 2023-09-13T09:55:03.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 10 client.28889 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:03.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 10 client.28889 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:55:03.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 20 client.28889 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:03.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9ae8e60 0x562df9aeb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 4 client.28889 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:03.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.733+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562df99f4050 con 0x562df9ae8e60 2023-09-13T09:55:03.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.734+0000 7f6d5259c700 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9ae8e60 0x562df9aeb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.734+0000 7f6d5259c700 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9ae8e60 0x562df9aeb280 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5dde7c157bd04599 server_cookie=52393e978f94f93b in_seq=0 out_seq=0 2023-09-13T09:55:03.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.734+0000 7f6d39ffb700 10 client.28889 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:03.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d39ffb700 1 -- 172.21.15.6:0/3751761410 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562df99f4050 con 0x562df9ae8e60 2023-09-13T09:55:03.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d39ffb700 10 client.28889 handle_command_reply: tid=0 2023-09-13T09:55:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 client.28889 shutdown 2023-09-13T09:55:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 msgr2=0x562df9afbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afbd10 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x562df9b04aa0 tx=0x7f6d4801a400 comp rx=0 tx=0).stop 2023-09-13T09:55:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 shutdown_connections 2023-09-13T09:55:03.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x562df9ae8e60 0x562df9aeb280 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562df9aee470 0x562df9afc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562df9aece10 0x562df9af97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 --2- 172.21.15.6:0/3751761410 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562df9aedb10 0x562df9afbd10 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 >> 172.21.15.6:0/3751761410 conn(0x562df9a46c80 msgr2=0x562df9ae2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d39ffb700 0 client.28889 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 shutdown_connections 2023-09-13T09:55:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 1 -- 172.21.15.6:0/3751761410 wait complete. 2023-09-13T09:55:03.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.736+0000 7f6d64f49b80 20 client.28889 trim_cache size 0 max 16384 2023-09-13T09:55:03.750 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:03.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d3c0a06c0 msgr2=0x7f6d3c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d3c0a06c0 0x7f6d3c0a2b80 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c01b000 tx=0x7f6d4c01c000 comp rx=0 tx=0).stop 2023-09-13T09:55:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d540ffd20 msgr2=0x7f6d54196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d540ffd20 0x7f6d54196ae0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d44009fd0 tx=0x7f6d4400f690 comp rx=0 tx=0).stop 2023-09-13T09:55:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 shutdown_connections 2023-09-13T09:55:03.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6d3c0a06c0 0x7f6d3c0a2b80 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6d541018b0 0x7f6d5419e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6d540ffd20 0x7f6d54196ae0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 --2- 172.21.15.6:0/58476791 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6d54100f10 0x7f6d54197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.738+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 >> 172.21.15.6:0/58476791 conn(0x7f6d540fb290 msgr2=0x7f6d54069200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.741+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 shutdown_connections 2023-09-13T09:55:03.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.741+0000 7f6d58d64700 1 -- 172.21.15.6:0/58476791 wait complete. 2023-09-13T09:55:03.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:55:03.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 -- 172.21.15.6:0/492230607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c1003b0 msgr2=0x7f3b6c100810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 --2- 172.21.15.6:0/492230607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c1003b0 0x7f3b6c100810 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000a9d0 tx=0x7f3b6000ace0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 -- 172.21.15.6:0/492230607 shutdown_connections 2023-09-13T09:55:03.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 --2- 172.21.15.6:0/492230607 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b6c100d50 0x7f3b6c107600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 --2- 172.21.15.6:0/492230607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b6c0ff1c0 0x7f3b6c0ff5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 --2- 172.21.15.6:0/492230607 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c1003b0 0x7f3b6c100810 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 -- 172.21.15.6:0/492230607 >> 172.21.15.6:0/492230607 conn(0x7f3b6c0fa710 msgr2=0x7f3b6c0fcb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 -- 172.21.15.6:0/492230607 shutdown_connections 2023-09-13T09:55:03.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.961+0000 7f3b7099d700 1 -- 172.21.15.6:0/492230607 wait complete. 2023-09-13T09:55:03.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 Processor -- start 2023-09-13T09:55:03.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 -- start start 2023-09-13T09:55:03.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b6c0ff1c0 0x7f3b6c194600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b6c1003b0 0x7f3b6c194b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c100d50 0x7f3b6c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c19c180 con 0x7f3b6c100d50 2023-09-13T09:55:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c19c2c0 con 0x7f3b6c1003b0 2023-09-13T09:55:03.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.962+0000 7f3b7099d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b6c19c450 con 0x7f3b6c0ff1c0 2023-09-13T09:55:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b6c1003b0 0x7f3b6c194b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c100d50 0x7f3b6c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b6c1003b0 0x7f3b6c194b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37120/0 (socket says 172.21.15.6:37120) 2023-09-13T09:55:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6affd700 1 -- 172.21.15.6:0/1278978326 learned_addr learned my addr 172.21.15.6:0/1278978326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c100d50 0x7f3b6c19bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43598/0 (socket says 172.21.15.6:43598) 2023-09-13T09:55:03.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 -- 172.21.15.6:0/1278978326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b6c0ff1c0 msgr2=0x7f3b6c194600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b6c0ff1c0 0x7f3b6c194600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 -- 172.21.15.6:0/1278978326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b6c1003b0 msgr2=0x7f3b6c194b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b6c1003b0 0x7f3b6c194b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 -- 172.21.15.6:0/1278978326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6000a610 con 0x7f3b6c100d50 2023-09-13T09:55:03.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c100d50 0x7f3b6c19bbb0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e390 tx=0x7f3b6400e6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b68ff9700 1 -- 172.21.15.6:0/1278978326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64019070 con 0x7f3b6c100d50 2023-09-13T09:55:03.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.963+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b6c19c6d0 con 0x7f3b6c100d50 2023-09-13T09:55:03.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.964+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c19cc30 con 0x7f3b6c100d50 2023-09-13T09:55:03.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.964+0000 7f3b68ff9700 1 -- 172.21.15.6:0/1278978326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b64011040 con 0x7f3b6c100d50 2023-09-13T09:55:03.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.964+0000 7f3b68ff9700 1 -- 172.21.15.6:0/1278978326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64010050 con 0x7f3b6c100d50 2023-09-13T09:55:03.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.967+0000 7f3b68ff9700 1 -- 172.21.15.6:0/1278978326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3b64004ad0 con 0x7f3b6c100d50 2023-09-13T09:55:03.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.967+0000 7f3b68ff9700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b540a06c0 0x7f3b540a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.968+0000 7f3b68ff9700 1 -- 172.21.15.6:0/1278978326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b640cd5b0 con 0x7f3b6c100d50 2023-09-13T09:55:03.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.968+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b540a06c0 0x7f3b540a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.968+0000 7f3b7dde4b80 1 Processor -- start 2023-09-13T09:55:03.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.968+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b540a06c0 0x7f3b540a2b80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c100210 tx=0x7f3b5c0096c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.968+0000 7f3b7dde4b80 1 -- start start 2023-09-13T09:55:03.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689bfbf0 0x561a689c0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c09a0 0x561a689c0e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a68914780 con 0x561a689bfbf0 2023-09-13T09:55:03.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a689120a0 con 0x561a689c09a0 2023-09-13T09:55:03.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6890d990 con 0x561a689c1360 2023-09-13T09:55:03.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689bfbf0 0x561a689c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c09a0 0x561a689c0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689bfbf0 0x561a689c0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43602/0 (socket says 172.21.15.6:43602) 2023-09-13T09:55:03.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c09a0 0x561a689c0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37128/0 (socket says 172.21.15.6:37128) 2023-09-13T09:55:03.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/828047752 learned_addr learned my addr 172.21.15.6:0/828047752 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6bfff700 1 -- 172.21.15.6:0/828047752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c09a0 msgr2=0x561a689c0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c09a0 0x561a689c0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6bfff700 1 -- 172.21.15.6:0/828047752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689bfbf0 msgr2=0x561a689c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689bfbf0 0x561a689c0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6bfff700 1 -- 172.21.15.6:0/828047752 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a6878d630 con 0x561a689c1360 2023-09-13T09:55:03.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.969+0000 7f3b6affd700 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c09a0 0x561a689c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:03.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.970+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689c7bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e360 tx=0x7f3b6400ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1de8e1e150e81004 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.970+0000 7f3b51ffb700 1 -- 172.21.15.6:0/828047752 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6409ad50 con 0x561a689c1360 2023-09-13T09:55:03.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.970+0000 7f3b51ffb700 1 -- 172.21.15.6:0/828047752 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b6409eb80 con 0x561a689c1360 2023-09-13T09:55:03.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.970+0000 7f3b51ffb700 1 -- 172.21.15.6:0/828047752 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b64084350 con 0x561a689c1360 2023-09-13T09:55:03.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/828047752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 msgr2=0x561a689c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689c7bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e360 tx=0x7f3b6400ee40 comp rx=0 tx=0).stop 2023-09-13T09:55:03.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/828047752 shutdown_connections 2023-09-13T09:55:03.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689c7bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689bfbf0 0x561a689c0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/828047752 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c09a0 0x561a689c0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/828047752 >> 172.21.15.6:0/828047752 conn(0x561a68919c80 msgr2=0x561a689b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/828047752 shutdown_connections 2023-09-13T09:55:03.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/828047752 wait complete. 2023-09-13T09:55:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 -- start start 2023-09-13T09:55:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.971+0000 7f3b7dde4b80 1 Processor -- start 2023-09-13T09:55:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689cc6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a688abbb0 con 0x561a689c09a0 2023-09-13T09:55:03.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a688ab8b0 con 0x561a689bfbf0 2023-09-13T09:55:03.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a6878f920 con 0x561a689c1360 2023-09-13T09:55:03.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b7dde4b80 10 client.0 _ll_register_callbacks cb 0x561a688a9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:03.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689cc6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689cc6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46664/0 (socket says 172.21.15.6:46664) 2023-09-13T09:55:03.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 -- 172.21.15.6:0/1038290919 learned_addr learned my addr 172.21.15.6:0/1038290919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:03.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6affd700 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 -- 172.21.15.6:0/1038290919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 msgr2=0x561a689c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 -- 172.21.15.6:0/1038290919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 msgr2=0x561a689c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689c56a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.972+0000 7f3b6bfff700 1 -- 172.21.15.6:0/1038290919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c19cc30 con 0x561a689c1360 2023-09-13T09:55:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689cc6e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3b64097250 tx=0x7f3b6409ab20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac790cf4cca19a47 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b4affd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:55:03.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b4affd700 1 -- 172.21.15.6:0/1038290919 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b640a2b30 con 0x561a689c1360 2023-09-13T09:55:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b4affd700 1 -- 172.21.15.6:0/1038290919 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b640a2dc0 con 0x561a689c1360 2023-09-13T09:55:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a689ae670 con 0x561a689c1360 2023-09-13T09:55:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b4affd700 1 -- 172.21.15.6:0/1038290919 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b6409ad50 con 0x561a689c1360 2023-09-13T09:55:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b7dde4b80 10 client.28855 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:03.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x561a689257a0 con 0x561a689c1360 2023-09-13T09:55:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b4affd700 1 -- 172.21.15.6:0/1038290919 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561a689ae670 con 0x561a689c1360 2023-09-13T09:55:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.973+0000 7f3b4affd700 1 -- 172.21.15.6:0/1038290919 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3b640cd0e0 con 0x561a689c1360 2023-09-13T09:55:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.974+0000 7f3b7dde4b80 10 client.28855 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.974+0000 7f3b7dde4b80 10 client.28855 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:55:03.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.974+0000 7f3b7dde4b80 20 client.28855 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.974+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a689d0da0 0x561a689d31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.974+0000 7f3b7dde4b80 4 client.28855 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.974+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a68906970 con 0x561a689d0da0 2023-09-13T09:55:03.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.974+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a689d0da0 0x561a689d31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:03.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.978+0000 7f3b4affd700 10 client.28855 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.978+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a689d0da0 0x561a689d31c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=2e0fc42e61f3337d server_cookie=f2d8f3863758039e in_seq=0 out_seq=0 2023-09-13T09:55:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b4affd700 1 -- 172.21.15.6:0/1038290919 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561a68906970 con 0x561a689d0da0 2023-09-13T09:55:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b4affd700 10 client.28855 handle_command_reply: tid=0 2023-09-13T09:55:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 client.28855 shutdown 2023-09-13T09:55:03.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 msgr2=0x561a689cc6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689cc6e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3b64097250 tx=0x7f3b6409ab20 comp rx=0 tx=0).stop 2023-09-13T09:55:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 shutdown_connections 2023-09-13T09:55:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a689d0da0 0x561a689d31c0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c1360 0x561a689cc6e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b4affd700 0 client.28855 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1038290919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 >> 172.21.15.6:0/1038290919 conn(0x561a68919c80 msgr2=0x561a689ba4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 shutdown_connections 2023-09-13T09:55:03.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1038290919 wait complete. 2023-09-13T09:55:03.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:03.985+0000 7f3b7dde4b80 20 client.28855 trim_cache size 0 max 16384 2023-09-13T09:55:04.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.001+0000 7f3b7dde4b80 1 Processor -- start 2023-09-13T09:55:04.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.001+0000 7f3b7dde4b80 1 -- start start 2023-09-13T09:55:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689bfbf0 0x561a689b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c1360 0x561a689c0220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a689d3820 con 0x561a689c09a0 2023-09-13T09:55:04.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a689c32d0 con 0x561a689c1360 2023-09-13T09:55:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a689b5e60 con 0x561a689bfbf0 2023-09-13T09:55:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689bfbf0 0x561a689b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689bfbf0 0x561a689b0a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46670/0 (socket says 172.21.15.6:46670) 2023-09-13T09:55:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1299540144 learned_addr learned my addr 172.21.15.6:0/1299540144 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1299540144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c1360 msgr2=0x561a689c0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c1360 0x561a689c0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1299540144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 msgr2=0x561a689cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1299540144 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a68739de0 con 0x561a689bfbf0 2023-09-13T09:55:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.002+0000 7f3b6affd700 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.003+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689bfbf0 0x561a689b0a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c005d60 tx=0x7f3b5c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe94a276a61db2ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.003+0000 7f3b527fc700 1 -- 172.21.15.6:0/1299540144 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c022050 con 0x561a689bfbf0 2023-09-13T09:55:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.003+0000 7f3b527fc700 1 -- 172.21.15.6:0/1299540144 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b5c023040 con 0x561a689bfbf0 2023-09-13T09:55:04.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.003+0000 7f3b527fc700 1 -- 172.21.15.6:0/1299540144 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c010b90 con 0x561a689bfbf0 2023-09-13T09:55:04.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1299540144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689bfbf0 msgr2=0x561a689b0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689bfbf0 0x561a689b0a00 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c005d60 tx=0x7f3b5c009f90 comp rx=0 tx=0).stop 2023-09-13T09:55:04.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1299540144 shutdown_connections 2023-09-13T09:55:04.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689c1360 0x561a689c0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689bfbf0 0x561a689b0a00 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1299540144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1299540144 >> 172.21.15.6:0/1299540144 conn(0x561a68919c80 msgr2=0x561a689b6090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1299540144 shutdown_connections 2023-09-13T09:55:04.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1299540144 wait complete. 2023-09-13T09:55:04.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.004+0000 7f3b7dde4b80 1 -- start start 2023-09-13T09:55:04.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 1 Processor -- start 2023-09-13T09:55:04.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689cc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c1360 0x561a689ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a689cae40 con 0x561a689c1360 2023-09-13T09:55:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a689cafb0 con 0x561a689bfbf0 2023-09-13T09:55:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a689cb170 con 0x561a689c09a0 2023-09-13T09:55:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b7dde4b80 10 client.0 _ll_register_callbacks cb 0x561a688a9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689cc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689cc0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37146/0 (socket says 172.21.15.6:37146) 2023-09-13T09:55:04.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1506007166 learned_addr learned my addr 172.21.15.6:0/1506007166 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6bfff700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c1360 0x561a689ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6affd700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1506007166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c09a0 msgr2=0x561a689cc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1506007166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c1360 msgr2=0x561a689ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c1360 0x561a689ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.005+0000 7f3b6b7fe700 1 -- 172.21.15.6:0/1506007166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b6c107f50 con 0x561a689bfbf0 2023-09-13T09:55:04.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.006+0000 7f3b6affd700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:04.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.008+0000 7f3b6b7fe700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689cc0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c013040 tx=0x7f3b5c00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa617ef9242adaef server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.008+0000 7f3b4affd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:55:04.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.009+0000 7f3b4affd700 1 -- 172.21.15.6:0/1506007166 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c038480 con 0x561a689bfbf0 2023-09-13T09:55:04.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.009+0000 7f3b4affd700 1 -- 172.21.15.6:0/1506007166 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3b5c033070 con 0x561a689bfbf0 2023-09-13T09:55:04.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.009+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b6409eb80 con 0x561a689bfbf0 2023-09-13T09:55:04.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b4affd700 1 -- 172.21.15.6:0/1506007166 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b5c022020 con 0x561a689bfbf0 2023-09-13T09:55:04.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 10 client.28901 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:04.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7f3b5c00eba0 con 0x561a689bfbf0 2023-09-13T09:55:04.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b4affd700 1 -- 172.21.15.6:0/1506007166 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3b6409eb80 con 0x561a689bfbf0 2023-09-13T09:55:04.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b4affd700 1 -- 172.21.15.6:0/1506007166 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3b5c02d7a0 con 0x561a689bfbf0 2023-09-13T09:55:04.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 10 client.28901 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 10 client.28901 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:55:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 20 client.28901 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a68a26040 0x561a68a28460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 4 client.28901 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:04.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x561a688c7050 con 0x561a68a26040 2023-09-13T09:55:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.010+0000 7f3b6affd700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a68a26040 0x561a68a28460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.011+0000 7f3b6affd700 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a68a26040 0x561a68a28460 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c5b35979eca4a68c server_cookie=b77255ac08e69114 in_seq=0 out_seq=0 2023-09-13T09:55:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.011+0000 7f3b4affd700 10 client.28901 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b4affd700 1 -- 172.21.15.6:0/1506007166 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x561a688c7050 con 0x561a68a26040 2023-09-13T09:55:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b4affd700 10 client.28901 handle_command_reply: tid=0 2023-09-13T09:55:04.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 client.28901 shutdown 2023-09-13T09:55:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 msgr2=0x561a689cc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689cc0c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c013040 tx=0x7f3b5c00ef60 comp rx=0 tx=0).stop 2023-09-13T09:55:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 shutdown_connections 2023-09-13T09:55:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561a68a26040 0x561a68a28460 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561a689c1360 0x561a689ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561a689bfbf0 0x561a689cc0c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 --2- 172.21.15.6:0/1506007166 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561a689c09a0 0x561a689cc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b4affd700 0 client.28901 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 >> 172.21.15.6:0/1506007166 conn(0x561a68919c80 msgr2=0x561a689c0220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 shutdown_connections 2023-09-13T09:55:04.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 1 -- 172.21.15.6:0/1506007166 wait complete. 2023-09-13T09:55:04.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7dde4b80 20 client.28901 trim_cache size 0 max 16384 2023-09-13T09:55:04.023 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b540a06c0 msgr2=0x7f3b540a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7099d700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b540a06c0 0x7f3b540a2b80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3b6c100210 tx=0x7f3b5c0096c0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c100d50 msgr2=0x7f3b6c19bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.014+0000 7f3b7099d700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c100d50 0x7f3b6c19bbb0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400e390 tx=0x7f3b6400e6a0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 shutdown_connections 2023-09-13T09:55:04.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3b540a06c0 0x7f3b540a2b80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b6c100d50 0x7f3b6c19bbb0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3b6c0ff1c0 0x7f3b6c194600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 --2- 172.21.15.6:0/1278978326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3b6c1003b0 0x7f3b6c194b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 >> 172.21.15.6:0/1278978326 conn(0x7f3b6c0fa710 msgr2=0x7f3b6c0fc8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 shutdown_connections 2023-09-13T09:55:04.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.015+0000 7f3b7099d700 1 -- 172.21.15.6:0/1278978326 wait complete. 2023-09-13T09:55:04.028 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:55:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 -- 172.21.15.6:0/2120736825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040ffcc0 msgr2=0x7f3e041000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 --2- 172.21.15.6:0/2120736825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040ffcc0 0x7f3e041000e0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3df40099c0 tx=0x7f3df4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 -- 172.21.15.6:0/2120736825 shutdown_connections 2023-09-13T09:55:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 --2- 172.21.15.6:0/2120736825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e04101850 0x7f3e04108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 --2- 172.21.15.6:0/2120736825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e040ffcc0 0x7f3e041000e0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 --2- 172.21.15.6:0/2120736825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04100eb0 0x7f3e04101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 -- 172.21.15.6:0/2120736825 >> 172.21.15.6:0/2120736825 conn(0x7f3e040fb250 msgr2=0x7f3e040fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 -- 172.21.15.6:0/2120736825 shutdown_connections 2023-09-13T09:55:04.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.182+0000 7f3e0982c700 1 -- 172.21.15.6:0/2120736825 wait complete. 2023-09-13T09:55:04.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 Processor -- start 2023-09-13T09:55:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 -- start start 2023-09-13T09:55:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e040ffcc0 0x7f3e04069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e04100eb0 0x7f3e0419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04101850 0x7f3e041a01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e041a0870 con 0x7f3e04100eb0 2023-09-13T09:55:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e041a09e0 con 0x7f3e04101850 2023-09-13T09:55:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e0982c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e041a0ba0 con 0x7f3e040ffcc0 2023-09-13T09:55:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e027fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e04100eb0 0x7f3e0419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e027fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e04100eb0 0x7f3e0419dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43638/0 (socket says 172.21.15.6:43638) 2023-09-13T09:55:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e027fc700 1 -- 172.21.15.6:0/1360083544 learned_addr learned my addr 172.21.15.6:0/1360083544 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.183+0000 7f3e037fe700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04101850 0x7f3e041a01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e027fc700 1 -- 172.21.15.6:0/1360083544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e040ffcc0 msgr2=0x7f3e04069880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e027fc700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e040ffcc0 0x7f3e04069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e027fc700 1 -- 172.21.15.6:0/1360083544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04101850 msgr2=0x7f3e041a01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e027fc700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04101850 0x7f3e041a01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e027fc700 1 -- 172.21.15.6:0/1360083544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3df40095f0 con 0x7f3e04100eb0 2023-09-13T09:55:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e027fc700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e04100eb0 0x7f3e0419dc70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e9a0 tx=0x7f3df800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e0882a700 1 -- 172.21.15.6:0/1360083544 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8009790 con 0x7f3e04100eb0 2023-09-13T09:55:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e0882a700 1 -- 172.21.15.6:0/1360083544 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3df800cbd0 con 0x7f3e04100eb0 2023-09-13T09:55:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e041a0e80 con 0x7f3e04100eb0 2023-09-13T09:55:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e0882a700 1 -- 172.21.15.6:0/1360083544 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8018680 con 0x7f3e04100eb0 2023-09-13T09:55:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.184+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e041a1300 con 0x7f3e04100eb0 2023-09-13T09:55:04.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.187+0000 7f3e0882a700 1 -- 172.21.15.6:0/1360083544 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3df800cd40 con 0x7f3e04100eb0 2023-09-13T09:55:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.187+0000 7f3e0882a700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3dec0a0640 0x7f3dec0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.187+0000 7f3e0882a700 1 -- 172.21.15.6:0/1360083544 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3df8014070 con 0x7f3e04100eb0 2023-09-13T09:55:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.187+0000 7f3e02ffd700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3dec0a0640 0x7f3dec0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e02ffd700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3dec0a0640 0x7f3dec0a2b00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009990 tx=0x7f3df4000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 Processor -- start 2023-09-13T09:55:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 -- start start 2023-09-13T09:55:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04942700 0x556e04942b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04943060 0x556e049414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e04941e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0489a780 con 0x556e04941a00 2023-09-13T09:55:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e048980a0 con 0x556e04943060 2023-09-13T09:55:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.188+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e04893990 con 0x556e04942700 2023-09-13T09:55:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04942700 0x556e04942b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04942700 0x556e04942b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46698/0 (socket says 172.21.15.6:46698) 2023-09-13T09:55:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04943060 0x556e049414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e04941e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e02ffd700 1 -- 172.21.15.6:0/3469446200 learned_addr learned my addr 172.21.15.6:0/3469446200 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e037fe700 1 -- 172.21.15.6:0/3469446200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04942700 msgr2=0x556e04942b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e037fe700 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04942700 0x556e04942b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e037fe700 1 -- 172.21.15.6:0/3469446200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04943060 msgr2=0x556e049414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e037fe700 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04943060 0x556e049414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e037fe700 1 -- 172.21.15.6:0/3469446200 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e04713630 con 0x556e04941a00 2023-09-13T09:55:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e027fc700 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04943060 0x556e049414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:04.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3e037fe700 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e04941e80 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc011580 tx=0x7f3dfc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=289110b4757bde96 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3de9ffb700 1 -- 172.21.15.6:0/3469446200 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00e040 con 0x556e04941a00 2023-09-13T09:55:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3de9ffb700 1 -- 172.21.15.6:0/3469446200 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dfc00f040 con 0x556e04941a00 2023-09-13T09:55:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.189+0000 7f3de9ffb700 1 -- 172.21.15.6:0/3469446200 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc004430 con 0x556e04941a00 2023-09-13T09:55:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 -- 172.21.15.6:0/3469446200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 msgr2=0x556e04941e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e04941e80 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc011580 tx=0x7f3dfc009920 comp rx=0 tx=0).stop 2023-09-13T09:55:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 -- 172.21.15.6:0/3469446200 shutdown_connections 2023-09-13T09:55:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e04941e80 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04942700 0x556e04942b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/3469446200 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04943060 0x556e049414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 -- 172.21.15.6:0/3469446200 >> 172.21.15.6:0/3469446200 conn(0x556e0489fc80 msgr2=0x556e0493bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 -- 172.21.15.6:0/3469446200 shutdown_connections 2023-09-13T09:55:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 -- 172.21.15.6:0/3469446200 wait complete. 2023-09-13T09:55:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.190+0000 7f3e15a11b80 1 -- start start 2023-09-13T09:55:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 1 Processor -- start 2023-09-13T09:55:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e0494af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04942700 0x556e0494b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04943060 0x556e04952490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e04831bb0 con 0x556e04941a00 2023-09-13T09:55:04.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e048318b0 con 0x556e04942700 2023-09-13T09:55:04.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e04715920 con 0x556e04943060 2023-09-13T09:55:04.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e15a11b80 10 client.0 _ll_register_callbacks cb 0x556e0482f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:04.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e0494af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e0494af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43650/0 (socket says 172.21.15.6:43650) 2023-09-13T09:55:04.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e02ffd700 1 -- 172.21.15.6:0/2600300287 learned_addr learned my addr 172.21.15.6:0/2600300287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e027fc700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04942700 0x556e0494b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e037fe700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04943060 0x556e04952490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.191+0000 7f3e02ffd700 1 -- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04943060 msgr2=0x556e04952490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e02ffd700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04943060 0x556e04952490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e02ffd700 1 -- 172.21.15.6:0/2600300287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04942700 msgr2=0x556e0494b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e02ffd700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04942700 0x556e0494b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e02ffd700 1 -- 172.21.15.6:0/2600300287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dfc011230 con 0x556e04941a00 2023-09-13T09:55:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e027fc700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04942700 0x556e0494b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e02ffd700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e0494af10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbd5bc8f2b7c8ae server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3de2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3de2ffd700 1 -- 172.21.15.6:0/2600300287 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df4028070 con 0x556e04941a00 2023-09-13T09:55:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3de2ffd700 1 -- 172.21.15.6:0/2600300287 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3df4005070 con 0x556e04941a00 2023-09-13T09:55:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e04934670 con 0x556e04941a00 2023-09-13T09:55:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3de2ffd700 1 -- 172.21.15.6:0/2600300287 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3df401c070 con 0x556e04941a00 2023-09-13T09:55:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e15a11b80 10 client.19569 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x556e048ab7a0 con 0x556e04941a00 2023-09-13T09:55:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.192+0000 7f3de2ffd700 1 -- 172.21.15.6:0/2600300287 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3df403d080 con 0x556e04941a00 2023-09-13T09:55:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3de2ffd700 1 -- 172.21.15.6:0/2600300287 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3df402e460 con 0x556e04941a00 2023-09-13T09:55:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3e15a11b80 10 client.19569 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3e15a11b80 10 client.19569 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:55:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3e15a11b80 20 client.19569 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04956de0 0x556e04959200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3e15a11b80 4 client.19569 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:04.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e0488c970 con 0x556e04956de0 2023-09-13T09:55:04.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.193+0000 7f3e027fc700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04956de0 0x556e04959200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.197+0000 7f3de2ffd700 10 client.19569 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.197+0000 7f3e027fc700 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04956de0 0x556e04959200 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=44ef23eccc83b52b server_cookie=5fe68604af38b56a in_seq=0 out_seq=0 2023-09-13T09:55:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3de2ffd700 1 -- 172.21.15.6:0/2600300287 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556e0488c970 con 0x556e04956de0 2023-09-13T09:55:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3de2ffd700 10 client.19569 handle_command_reply: tid=0 2023-09-13T09:55:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 client.19569 shutdown 2023-09-13T09:55:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 msgr2=0x556e0494af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e0494af10 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df400b540 comp rx=0 tx=0).stop 2023-09-13T09:55:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 shutdown_connections 2023-09-13T09:55:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04956de0 0x556e04959200 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e04943060 0x556e04952490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04941a00 0x556e0494af10 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3de2ffd700 0 client.19569 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:04.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/2600300287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04942700 0x556e0494b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 >> 172.21.15.6:0/2600300287 conn(0x556e0489fc80 msgr2=0x556e0493bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 shutdown_connections 2023-09-13T09:55:04.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 1 -- 172.21.15.6:0/2600300287 wait complete. 2023-09-13T09:55:04.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.199+0000 7f3e15a11b80 20 client.19569 trim_cache size 0 max 16384 2023-09-13T09:55:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 Processor -- start 2023-09-13T09:55:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 -- start start 2023-09-13T09:55:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e04952450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e04945940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0493dfd0 con 0x556e04942700 2023-09-13T09:55:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0493d730 con 0x556e04941a00 2023-09-13T09:55:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e04946450 con 0x556e0489fc80 2023-09-13T09:55:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e04952450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e04952450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37184/0 (socket says 172.21.15.6:37184) 2023-09-13T09:55:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e027fc700 1 -- 172.21.15.6:0/1923407484 learned_addr learned my addr 172.21.15.6:0/1923407484 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e037fe700 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e04945940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e027fc700 1 -- 172.21.15.6:0/1923407484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 msgr2=0x556e049414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e027fc700 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e027fc700 1 -- 172.21.15.6:0/1923407484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 msgr2=0x556e04945940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.214+0000 7f3e027fc700 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e04945940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.215+0000 7f3e027fc700 1 -- 172.21.15.6:0/1923407484 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e046bfde0 con 0x556e04941a00 2023-09-13T09:55:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.216+0000 7f3e027fc700 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e04952450 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3df800c5b0 tx=0x7f3df80cb040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c1c2c354ac5ef84 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.216+0000 7f3dea7fc700 1 -- 172.21.15.6:0/1923407484 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df809d410 con 0x556e04941a00 2023-09-13T09:55:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.216+0000 7f3dea7fc700 1 -- 172.21.15.6:0/1923407484 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3df80a1650 con 0x556e04941a00 2023-09-13T09:55:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.216+0000 7f3dea7fc700 1 -- 172.21.15.6:0/1923407484 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8099aa0 con 0x556e04941a00 2023-09-13T09:55:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 -- 172.21.15.6:0/1923407484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 msgr2=0x556e04952450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e04952450 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f3df800c5b0 tx=0x7f3df80cb040 comp rx=0 tx=0).stop 2023-09-13T09:55:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 -- 172.21.15.6:0/1923407484 shutdown_connections 2023-09-13T09:55:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e04945940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/1923407484 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e04952450 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 -- 172.21.15.6:0/1923407484 >> 172.21.15.6:0/1923407484 conn(0x556e0493c240 msgr2=0x556e04952d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 -- 172.21.15.6:0/1923407484 shutdown_connections 2023-09-13T09:55:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.217+0000 7f3e15a11b80 1 -- 172.21.15.6:0/1923407484 wait complete. 2023-09-13T09:55:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 -- start start 2023-09-13T09:55:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 Processor -- start 2023-09-13T09:55:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049520a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e0494ec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e0494f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0494f6c0 con 0x556e04942700 2023-09-13T09:55:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e0494f830 con 0x556e04941a00 2023-09-13T09:55:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e049aac00 con 0x556e0489fc80 2023-09-13T09:55:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e15a11b80 10 client.0 _ll_register_callbacks cb 0x556e0482f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e0494f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e027fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e0494ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e02ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e0494f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43668/0 (socket says 172.21.15.6:43668) 2023-09-13T09:55:04.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.218+0000 7f3e037fe700 1 -- 172.21.15.6:0/844696065 learned_addr learned my addr 172.21.15.6:0/844696065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e037fe700 1 -- 172.21.15.6:0/844696065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 msgr2=0x556e049520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e037fe700 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e037fe700 1 -- 172.21.15.6:0/844696065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 msgr2=0x556e0494ec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e037fe700 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e0494ec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e037fe700 1 -- 172.21.15.6:0/844696065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e041a0e80 con 0x556e04942700 2023-09-13T09:55:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e027fc700 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e0494ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e037fe700 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e0494f180 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc019000 tx=0x7f3dfc009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0dfbb959dac7c55 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3de2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3de2ffd700 1 -- 172.21.15.6:0/844696065 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00e040 con 0x556e04942700 2023-09-13T09:55:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3de2ffd700 1 -- 172.21.15.6:0/844696065 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3dfc011e80 con 0x556e04942700 2023-09-13T09:55:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3dfc00f040 con 0x556e04942700 2023-09-13T09:55:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3de2ffd700 1 -- 172.21.15.6:0/844696065 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3dfc005550 con 0x556e04942700 2023-09-13T09:55:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.219+0000 7f3e15a11b80 10 client.19575 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x556e046a8c60 con 0x556e04942700 2023-09-13T09:55:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3de2ffd700 1 -- 172.21.15.6:0/844696065 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3dfc00f040 con 0x556e04942700 2023-09-13T09:55:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3de2ffd700 1 -- 172.21.15.6:0/844696065 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7f3dfc01b020 con 0x556e04942700 2023-09-13T09:55:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e15a11b80 10 client.19575 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e15a11b80 10 client.19575 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:55:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e15a11b80 20 client.19575 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04943060 0x556e049ae5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e15a11b80 4 client.19575 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556e0484d050 con 0x556e04943060 2023-09-13T09:55:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.220+0000 7f3e02ffd700 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04943060 0x556e049ae5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e02ffd700 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04943060 0x556e049ae5d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c811c0c36ac920b9 server_cookie=23ebd1878e638fd0 in_seq=0 out_seq=0 2023-09-13T09:55:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3de2ffd700 10 client.19575 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3de2ffd700 1 -- 172.21.15.6:0/844696065 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556e0484d050 con 0x556e04943060 2023-09-13T09:55:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3de2ffd700 10 client.19575 handle_command_reply: tid=0 2023-09-13T09:55:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 client.19575 shutdown 2023-09-13T09:55:04.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 msgr2=0x556e0494f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e0494f180 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc019000 tx=0x7f3dfc009510 comp rx=0 tx=0).stop 2023-09-13T09:55:04.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 shutdown_connections 2023-09-13T09:55:04.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x556e04943060 0x556e049ae5d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556e04942700 0x556e0494f180 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556e0489fc80 0x556e049520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3de2ffd700 0 client.19575 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 --2- 172.21.15.6:0/844696065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556e04941a00 0x556e0494ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 >> 172.21.15.6:0/844696065 conn(0x556e0493c240 msgr2=0x556e04945940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 shutdown_connections 2023-09-13T09:55:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 1 -- 172.21.15.6:0/844696065 wait complete. 2023-09-13T09:55:04.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.221+0000 7f3e15a11b80 20 client.19575 trim_cache size 0 max 16384 2023-09-13T09:55:04.238 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:04.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3dec0a0640 msgr2=0x7f3dec0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3dec0a0640 0x7f3dec0a2b00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009990 tx=0x7f3df4000bc0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e04100eb0 msgr2=0x7f3e0419dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e04100eb0 0x7f3e0419dc70 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f3df800e9a0 tx=0x7f3df800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 shutdown_connections 2023-09-13T09:55:04.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e04101850 0x7f3e041a01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e040ffcc0 0x7f3e04069880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3dec0a0640 0x7f3dec0a2b00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 --2- 172.21.15.6:0/1360083544 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e04100eb0 0x7f3e0419dc70 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 >> 172.21.15.6:0/1360083544 conn(0x7f3e040fb250 msgr2=0x7f3e041043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 shutdown_connections 2023-09-13T09:55:04.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.222+0000 7f3e0982c700 1 -- 172.21.15.6:0/1360083544 wait complete. 2023-09-13T09:55:04.242 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:55:04.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 -- 172.21.15.6:0/479072497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864104170 msgr2=0x7fa864106560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 --2- 172.21.15.6:0/479072497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864104170 0x7fa864106560 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fa854009990 tx=0x7fa854009ca0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 -- 172.21.15.6:0/479072497 shutdown_connections 2023-09-13T09:55:04.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 --2- 172.21.15.6:0/479072497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa864106aa0 0x7fa864108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 --2- 172.21.15.6:0/479072497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa864101840 0x7fa864103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 --2- 172.21.15.6:0/479072497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864104170 0x7fa864106560 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 -- 172.21.15.6:0/479072497 >> 172.21.15.6:0/479072497 conn(0x7fa8640fb250 msgr2=0x7fa8640fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 -- 172.21.15.6:0/479072497 shutdown_connections 2023-09-13T09:55:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.403+0000 7fa86bc75700 1 -- 172.21.15.6:0/479072497 wait complete. 2023-09-13T09:55:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 Processor -- start 2023-09-13T09:55:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 -- start start 2023-09-13T09:55:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864101840 0x7fa8641011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa864104170 0x7fa8640ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa864106aa0 0x7fa8640ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8641004d0 con 0x7fa864101840 2023-09-13T09:55:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa864100640 con 0x7fa864104170 2023-09-13T09:55:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86bc75700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8641a0ab0 con 0x7fa864106aa0 2023-09-13T09:55:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa869a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864101840 0x7fa8641011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa869a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864101840 0x7fa8641011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43678/0 (socket says 172.21.15.6:43678) 2023-09-13T09:55:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa869a11700 1 -- 172.21.15.6:0/3639681490 learned_addr learned my addr 172.21.15.6:0/3639681490 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa869210700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa864104170 0x7fa8640ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.404+0000 7fa86a212700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa864106aa0 0x7fa8640ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa869a11700 1 -- 172.21.15.6:0/3639681490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa864106aa0 msgr2=0x7fa8640ffd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa869a11700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa864106aa0 0x7fa8640ffd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa869a11700 1 -- 172.21.15.6:0/3639681490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa864104170 msgr2=0x7fa8640ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa869a11700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa864104170 0x7fa8640ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa869a11700 1 -- 172.21.15.6:0/3639681490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8540095f0 con 0x7fa864101840 2023-09-13T09:55:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa869a11700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864101840 0x7fa8641011b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fa86000d950 tx=0x7fa86000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa85affd700 1 -- 172.21.15.6:0/3639681490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000f890 con 0x7fa864101840 2023-09-13T09:55:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8641a0d90 con 0x7fa864101840 2023-09-13T09:55:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa85affd700 1 -- 172.21.15.6:0/3639681490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa860010460 con 0x7fa864101840 2023-09-13T09:55:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa85affd700 1 -- 172.21.15.6:0/3639681490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa86000e610 con 0x7fa864101840 2023-09-13T09:55:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.405+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8641a1200 con 0x7fa864101840 2023-09-13T09:55:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.409+0000 7fa85affd700 1 -- 172.21.15.6:0/3639681490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa8600105d0 con 0x7fa864101840 2023-09-13T09:55:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.409+0000 7fa85affd700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa8500a0640 0x7fa8500a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 Processor -- start 2023-09-13T09:55:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa85affd700 1 -- 172.21.15.6:0/3639681490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa8600cbca0 con 0x7fa864101840 2023-09-13T09:55:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa869210700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa8500a0640 0x7fa8500a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 -- start start 2023-09-13T09:55:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec6700 0x557c33ec6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec7060 0x557c33ec54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ec5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33e1e780 con 0x557c33ec7060 2023-09-13T09:55:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33e1c0a0 con 0x557c33ec5a00 2023-09-13T09:55:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.410+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33e17990 con 0x557c33ec6700 2023-09-13T09:55:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.411+0000 7fa869210700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa8500a0640 0x7fa8500a2b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa854003790 tx=0x7fa854005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.411+0000 7fa869210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec7060 0x557c33ec54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.411+0000 7fa869210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec7060 0x557c33ec54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43688/0 (socket says 172.21.15.6:43688) 2023-09-13T09:55:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.411+0000 7fa869210700 1 -- 172.21.15.6:0/4063695639 learned_addr learned my addr 172.21.15.6:0/4063695639 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.411+0000 7fa86a212700 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ec5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa869210700 1 -- 172.21.15.6:0/4063695639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec6700 msgr2=0x557c33ec6b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:55:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa869210700 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec6700 0x557c33ec6b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa869210700 1 -- 172.21.15.6:0/4063695639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 msgr2=0x557c33ec5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa869210700 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ec5e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa869210700 1 -- 172.21.15.6:0/4063695639 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c33c97630 con 0x557c33ec7060 2023-09-13T09:55:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa869210700 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec7060 0x557c33ec54c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa854015000 tx=0x7fa854020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94ed70428d4e432 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa84ffff700 1 -- 172.21.15.6:0/4063695639 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8540050c0 con 0x557c33ec7060 2023-09-13T09:55:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa84ffff700 1 -- 172.21.15.6:0/4063695639 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa85401e040 con 0x557c33ec7060 2023-09-13T09:55:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.412+0000 7fa84ffff700 1 -- 172.21.15.6:0/4063695639 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854024cf0 con 0x557c33ec7060 2023-09-13T09:55:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 -- 172.21.15.6:0/4063695639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec7060 msgr2=0x557c33ec54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec7060 0x557c33ec54c0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fa854015000 tx=0x7fa854020000 comp rx=0 tx=0).stop 2023-09-13T09:55:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 -- 172.21.15.6:0/4063695639 shutdown_connections 2023-09-13T09:55:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ec5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec6700 0x557c33ec6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/4063695639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec7060 0x557c33ec54c0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 -- 172.21.15.6:0/4063695639 >> 172.21.15.6:0/4063695639 conn(0x557c33e23c80 msgr2=0x557c33ebff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 -- 172.21.15.6:0/4063695639 shutdown_connections 2023-09-13T09:55:04.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.413+0000 7fa877e5ab80 1 -- 172.21.15.6:0/4063695639 wait complete. 2023-09-13T09:55:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.414+0000 7fa877e5ab80 1 -- start start 2023-09-13T09:55:04.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.414+0000 7fa877e5ab80 1 Processor -- start 2023-09-13T09:55:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec5a00 0x557c33edfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee03f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec7060 0x557c33ee7430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33db5bb0 con 0x557c33ec6700 2023-09-13T09:55:04.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33db58b0 con 0x557c33ec7060 2023-09-13T09:55:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33c99920 con 0x557c33ec5a00 2023-09-13T09:55:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa877e5ab80 10 client.0 _ll_register_callbacks cb 0x557c33db3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43692/0 (socket says 172.21.15.6:43692) 2023-09-13T09:55:04.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 -- 172.21.15.6:0/3263018253 learned_addr learned my addr 172.21.15.6:0/3263018253 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869a11700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec5a00 0x557c33edfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa86a212700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec7060 0x557c33ee7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 -- 172.21.15.6:0/3263018253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec5a00 msgr2=0x557c33edfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec5a00 0x557c33edfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 -- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec7060 msgr2=0x557c33ee7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec7060 0x557c33ee7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 -- 172.21.15.6:0/3263018253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa864109b00 con 0x557c33ec6700 2023-09-13T09:55:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa86a212700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec7060 0x557c33ee7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa869210700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee03f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa854009350 tx=0x7fa854005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c83f892e65acb0c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.415+0000 7fa84d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa84d7fa700 1 -- 172.21.15.6:0/3263018253 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854029040 con 0x557c33ec6700 2023-09-13T09:55:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa84d7fa700 1 -- 172.21.15.6:0/3263018253 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa8540054d0 con 0x557c33ec6700 2023-09-13T09:55:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c33eb8670 con 0x557c33ec6700 2023-09-13T09:55:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa84d7fa700 1 -- 172.21.15.6:0/3263018253 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa854005690 con 0x557c33ec6700 2023-09-13T09:55:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 10 client.19587 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:04.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x557c33e2f7a0 con 0x557c33ec6700 2023-09-13T09:55:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa84d7fa700 1 -- 172.21.15.6:0/3263018253 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557c33eb8670 con 0x557c33ec6700 2023-09-13T09:55:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa84d7fa700 1 -- 172.21.15.6:0/3263018253 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa8540374d0 con 0x557c33ec6700 2023-09-13T09:55:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 10 client.19587 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 10 client.19587 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:04.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 20 client.19587 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:04.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33eeb980 0x557c33eedda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 4 client.19587 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:04.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.416+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c33e10970 con 0x557c33eeb980 2023-09-13T09:55:04.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.418+0000 7fa869a11700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33eeb980 0x557c33eedda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.419+0000 7fa84d7fa700 10 client.19587 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:04.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.419+0000 7fa869a11700 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33eeb980 0x557c33eedda0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1141e8a2b718b9d3 server_cookie=fc27dc23c92fe331 in_seq=0 out_seq=0 2023-09-13T09:55:04.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.423+0000 7fa84d7fa700 1 -- 172.21.15.6:0/3263018253 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c33e10970 con 0x557c33eeb980 2023-09-13T09:55:04.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.423+0000 7fa84d7fa700 10 client.19587 handle_command_reply: tid=0 2023-09-13T09:55:04.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.423+0000 7fa877e5ab80 1 client.19587 shutdown 2023-09-13T09:55:04.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 msgr2=0x557c33ee03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee03f0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7fa854009350 tx=0x7fa854005f10 comp rx=0 tx=0).stop 2023-09-13T09:55:04.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 shutdown_connections 2023-09-13T09:55:04.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec7060 0x557c33ee7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec5a00 0x557c33edfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33eeb980 0x557c33eedda0 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/3263018253 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee03f0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa84d7fa700 0 client.19587 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 >> 172.21.15.6:0/3263018253 conn(0x557c33e23c80 msgr2=0x557c33eba7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 shutdown_connections 2023-09-13T09:55:04.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 1 -- 172.21.15.6:0/3263018253 wait complete. 2023-09-13T09:55:04.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.424+0000 7fa877e5ab80 20 client.19587 trim_cache size 0 max 16384 2023-09-13T09:55:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.440+0000 7fa877e5ab80 1 Processor -- start 2023-09-13T09:55:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.440+0000 7fa877e5ab80 1 -- start start 2023-09-13T09:55:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec5a00 0x557c33ec54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec6700 0x557c33ee7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ec9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33edfa20 con 0x557c33ec5a00 2023-09-13T09:55:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33ee7890 con 0x557c33ec6700 2023-09-13T09:55:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33ec0940 con 0x557c33ec7060 2023-09-13T09:55:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec5a00 0x557c33ec54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec5a00 0x557c33ec54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43698/0 (socket says 172.21.15.6:43698) 2023-09-13T09:55:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 -- 172.21.15.6:0/2356009025 learned_addr learned my addr 172.21.15.6:0/2356009025 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa86a212700 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ec9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869210700 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec6700 0x557c33ee7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 -- 172.21.15.6:0/2356009025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 msgr2=0x557c33ec9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ec9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 -- 172.21.15.6:0/2356009025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec6700 msgr2=0x557c33ee7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec6700 0x557c33ee7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 -- 172.21.15.6:0/2356009025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c33c43de0 con 0x557c33ec5a00 2023-09-13T09:55:04.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.441+0000 7fa869a11700 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec5a00 0x557c33ec54c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fa8600c9750 tx=0x7fa860000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b532e0b969ce828 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.442+0000 7fa858d82700 1 -- 172.21.15.6:0/2356009025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860014070 con 0x557c33ec5a00 2023-09-13T09:55:04.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.442+0000 7fa858d82700 1 -- 172.21.15.6:0/2356009025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa86009d270 con 0x557c33ec5a00 2023-09-13T09:55:04.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.442+0000 7fa858d82700 1 -- 172.21.15.6:0/2356009025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa860010b30 con 0x557c33ec5a00 2023-09-13T09:55:04.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 -- 172.21.15.6:0/2356009025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec5a00 msgr2=0x557c33ec54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec5a00 0x557c33ec54c0 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7fa8600c9750 tx=0x7fa860000bc0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 -- 172.21.15.6:0/2356009025 shutdown_connections 2023-09-13T09:55:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ec9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec5a00 0x557c33ec54c0 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/2356009025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec6700 0x557c33ee7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 -- 172.21.15.6:0/2356009025 >> 172.21.15.6:0/2356009025 conn(0x557c33e23c80 msgr2=0x557c33eccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 -- 172.21.15.6:0/2356009025 shutdown_connections 2023-09-13T09:55:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 -- 172.21.15.6:0/2356009025 wait complete. 2023-09-13T09:55:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 -- start start 2023-09-13T09:55:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.443+0000 7fa877e5ab80 1 Processor -- start 2023-09-13T09:55:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ee33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa877e5ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ee6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33ee6e80 con 0x557c33ec6700 2023-09-13T09:55:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33ee6ff0 con 0x557c33ec5a00 2023-09-13T09:55:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa877e5ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c33ee71b0 con 0x557c33ec7060 2023-09-13T09:55:04.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa877e5ab80 10 client.0 _ll_register_callbacks cb 0x557c33db3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43706/0 (socket says 172.21.15.6:43706) 2023-09-13T09:55:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869a11700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ee33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 -- 172.21.15.6:0/253129374 learned_addr learned my addr 172.21.15.6:0/253129374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:04.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa86a212700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ee6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 -- 172.21.15.6:0/253129374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 msgr2=0x557c33ee6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ee6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 -- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 msgr2=0x557c33ee33e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ee33e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869210700 1 -- 172.21.15.6:0/253129374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8641a1200 con 0x557c33ec6700 2023-09-13T09:55:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa869a11700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ee33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.444+0000 7fa86a212700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ee6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:55:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa869210700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee3920 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa854005090 tx=0x7fa854005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6deb09f68c0bbdbf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa84d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:04.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa84d7fa700 1 -- 172.21.15.6:0/253129374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa854029040 con 0x557c33ec6700 2023-09-13T09:55:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa84d7fa700 1 -- 172.21.15.6:0/253129374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa8540054d0 con 0x557c33ec6700 2023-09-13T09:55:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa85401e040 con 0x557c33ec6700 2023-09-13T09:55:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa84d7fa700 1 -- 172.21.15.6:0/253129374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa854037650 con 0x557c33ec6700 2023-09-13T09:55:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa877e5ab80 10 client.19593 fetch_fsmap learned FSMap version 50 2023-09-13T09:55:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x557c33c2cc60 con 0x557c33ec6700 2023-09-13T09:55:04.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa84d7fa700 1 -- 172.21.15.6:0/253129374 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa85401e040 con 0x557c33ec6700 2023-09-13T09:55:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.445+0000 7fa84d7fa700 1 -- 172.21.15.6:0/253129374 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 50) v1 ==== 7946+0+0 (secure 0 0 0) 0x7fa854010470 con 0x557c33ec6700 2023-09-13T09:55:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa877e5ab80 10 client.19593 fetch_fsmap finished waiting for FSMap version 50 2023-09-13T09:55:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa877e5ab80 10 client.19593 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa877e5ab80 20 client.19593 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:04.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33f40690 0x557c33f42ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa877e5ab80 4 client.19593 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557c33dd1050 con 0x557c33f40690 2023-09-13T09:55:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa869a11700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33f40690 0x557c33f42ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa84d7fa700 10 client.19593 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:04.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.446+0000 7fa869a11700 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33f40690 0x557c33f42ab0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8881e003eb65c3e server_cookie=f5e7bbc42a15a2ad in_seq=0 out_seq=0 2023-09-13T09:55:04.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa84d7fa700 1 -- 172.21.15.6:0/253129374 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557c33dd1050 con 0x557c33f40690 2023-09-13T09:55:04.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa84d7fa700 10 client.19593 handle_command_reply: tid=0 2023-09-13T09:55:04.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 client.19593 shutdown 2023-09-13T09:55:04.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 msgr2=0x557c33ee3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee3920 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fa854005090 tx=0x7fa854005d20 comp rx=0 tx=0).stop 2023-09-13T09:55:04.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 shutdown_connections 2023-09-13T09:55:04.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557c33ec7060 0x557c33ee6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557c33ec5a00 0x557c33ee33e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557c33f40690 0x557c33f42ab0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 --2- 172.21.15.6:0/253129374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557c33ec6700 0x557c33ee3920 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa84d7fa700 0 client.19593 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 >> 172.21.15.6:0/253129374 conn(0x557c33e23c80 msgr2=0x557c33ec9880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 shutdown_connections 2023-09-13T09:55:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 1 -- 172.21.15.6:0/253129374 wait complete. 2023-09-13T09:55:04.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.447+0000 7fa877e5ab80 20 client.19593 trim_cache size 0 max 16384 2023-09-13T09:55:04.463 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:04.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa8500a0640 msgr2=0x7fa8500a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa8500a0640 0x7fa8500a2b00 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa854003790 tx=0x7fa854005fd0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864101840 msgr2=0x7fa8641011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:04.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864101840 0x7fa8641011b0 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fa86000d950 tx=0x7fa86000dc60 comp rx=0 tx=0).stop 2023-09-13T09:55:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 shutdown_connections 2023-09-13T09:55:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa864106aa0 0x7fa8640ffd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa8500a0640 0x7fa8500a2b00 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa864101840 0x7fa8641011b0 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 --2- 172.21.15.6:0/3639681490 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa864104170 0x7fa8640ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:04.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 >> 172.21.15.6:0/3639681490 conn(0x7fa8640fb250 msgr2=0x7fa864102c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:04.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 shutdown_connections 2023-09-13T09:55:04.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:04.448+0000 7fa86bc75700 1 -- 172.21.15.6:0/3639681490 wait complete. 2023-09-13T09:55:04.467 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:04 smithi006 ceph-mon[98665]: pgmap v766: 97 pgs: 97 active+clean; 872 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 864 op/s 2023-09-13T09:55:04.467 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:04 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2413731698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:55:04.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:04 smithi053 ceph-mon[102373]: pgmap v766: 97 pgs: 97 active+clean; 872 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 864 op/s 2023-09-13T09:55:04.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:04 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2413731698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:55:04.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:04 smithi131 ceph-mon[102785]: pgmap v766: 97 pgs: 97 active+clean; 872 MiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 11 MiB/s wr, 864 op/s 2023-09-13T09:55:04.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:04 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2413731698' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:55:04.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 104447 40.35 MB/sec execute 24 sec latency 50.086 ms 2023-09-13T09:55:05.469 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:55:05.469 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:55:05.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 105072 39.74 MB/sec execute 25 sec latency 111.033 ms 2023-09-13T09:55:05.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.658+0000 7f3121435700 1 -- 172.21.15.6:0/400578060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c100eb0 msgr2=0x7f311c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.658+0000 7f3121435700 1 --2- 172.21.15.6:0/400578060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c100eb0 0x7f311c101310 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7f31100099c0 tx=0x7f3110009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.659+0000 7f3121435700 1 -- 172.21.15.6:0/400578060 shutdown_connections 2023-09-13T09:55:05.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.659+0000 7f3121435700 1 --2- 172.21.15.6:0/400578060 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c101850 0x7f311c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.659+0000 7f3121435700 1 --2- 172.21.15.6:0/400578060 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f311c0ffcc0 0x7f311c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.659+0000 7f3121435700 1 --2- 172.21.15.6:0/400578060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c100eb0 0x7f311c101310 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.659+0000 7f3121435700 1 -- 172.21.15.6:0/400578060 >> 172.21.15.6:0/400578060 conn(0x7f311c0fb210 msgr2=0x7f311c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.659+0000 7f3121435700 1 -- 172.21.15.6:0/400578060 shutdown_connections 2023-09-13T09:55:05.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.659+0000 7f3121435700 1 -- 172.21.15.6:0/400578060 wait complete. 2023-09-13T09:55:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 Processor -- start 2023-09-13T09:55:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 -- start start 2023-09-13T09:55:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c0ffcc0 0x7f311c19d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c100eb0 0x7f311c19d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f311c101850 0x7f311c1a4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1a4d30 con 0x7f311c0ffcc0 2023-09-13T09:55:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1a4e70 con 0x7f311c101850 2023-09-13T09:55:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f3121435700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c1a5000 con 0x7f311c100eb0 2023-09-13T09:55:05.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f311a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c100eb0 0x7f311c19d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f311a7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c100eb0 0x7f311c19d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46774/0 (socket says 172.21.15.6:46774) 2023-09-13T09:55:05.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f311a7fc700 1 -- 172.21.15.6:0/1099698126 learned_addr learned my addr 172.21.15.6:0/1099698126 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f311b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f311c101850 0x7f311c1a4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.660+0000 7f311affd700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c0ffcc0 0x7f311c19d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f311a7fc700 1 -- 172.21.15.6:0/1099698126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f311c101850 msgr2=0x7f311c1a4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f311a7fc700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f311c101850 0x7f311c1a4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f311a7fc700 1 -- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c0ffcc0 msgr2=0x7f311c19d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f311a7fc700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c0ffcc0 0x7f311c19d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f311a7fc700 1 -- 172.21.15.6:0/1099698126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100095f0 con 0x7f311c100eb0 2023-09-13T09:55:05.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f311a7fc700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c100eb0 0x7f311c19d6f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f311000b580 tx=0x7f3110005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f3103fff700 1 -- 172.21.15.6:0/1099698126 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311001d070 con 0x7f311c100eb0 2023-09-13T09:55:05.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c1a5280 con 0x7f311c100eb0 2023-09-13T09:55:05.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f3103fff700 1 -- 172.21.15.6:0/1099698126 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3110004030 con 0x7f311c100eb0 2023-09-13T09:55:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.661+0000 7f3103fff700 1 -- 172.21.15.6:0/1099698126 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110022d60 con 0x7f311c100eb0 2023-09-13T09:55:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.662+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c1a56b0 con 0x7f311c100eb0 2023-09-13T09:55:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.665+0000 7f3103fff700 1 -- 172.21.15.6:0/1099698126 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3110022470 con 0x7f311c100eb0 2023-09-13T09:55:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.666+0000 7f3103fff700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31040a0640 0x7f31040a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.666+0000 7f3103fff700 1 -- 172.21.15.6:0/1099698126 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f31100ccf30 con 0x7f311c100eb0 2023-09-13T09:55:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.666+0000 7f311affd700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31040a0640 0x7f31040a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.667+0000 7f312d61ab80 1 Processor -- start 2023-09-13T09:55:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f312d61ab80 1 -- start start 2023-09-13T09:55:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b94ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b950e0 0x561505b93540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b93a80 0x561505b93f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f312d61ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505aec800 con 0x561505b950e0 2023-09-13T09:55:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f312d61ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505aea120 con 0x561505b93a80 2023-09-13T09:55:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f312d61ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505ae5a10 con 0x561505b94780 2023-09-13T09:55:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b950e0 0x561505b93540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b950e0 0x561505b93540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43728/0 (socket says 172.21.15.6:43728) 2023-09-13T09:55:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 -- 172.21.15.6:0/2161787683 learned_addr learned my addr 172.21.15.6:0/2161787683 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311affd700 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b94ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311b7fe700 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b93a80 0x561505b93f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311affd700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31040a0640 0x7f31040a2b00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f310c006fd0 tx=0x7f310c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 -- 172.21.15.6:0/2161787683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 msgr2=0x561505b94ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b94ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 -- 172.21.15.6:0/2161787683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b93a80 msgr2=0x561505b93f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b93a80 0x561505b93f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311a7fc700 1 -- 172.21.15.6:0/2161787683 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615059656b0 con 0x561505b950e0 2023-09-13T09:55:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.668+0000 7f311b7fe700 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b93a80 0x561505b93f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.669+0000 7f311a7fc700 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b950e0 0x561505b93540 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3110096d80 tx=0x7f3110005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43fe1880ae33384 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.669+0000 7f31017fa700 1 -- 172.21.15.6:0/2161787683 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31100caea0 con 0x561505b950e0 2023-09-13T09:55:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.669+0000 7f31017fa700 1 -- 172.21.15.6:0/2161787683 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f311009af80 con 0x561505b950e0 2023-09-13T09:55:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.669+0000 7f31017fa700 1 -- 172.21.15.6:0/2161787683 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110099d70 con 0x561505b950e0 2023-09-13T09:55:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 -- 172.21.15.6:0/2161787683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b950e0 msgr2=0x561505b93540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b950e0 0x561505b93540 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7f3110096d80 tx=0x7f3110005ee0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 -- 172.21.15.6:0/2161787683 shutdown_connections 2023-09-13T09:55:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b93a80 0x561505b93f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b94ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 --2- 172.21.15.6:0/2161787683 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b950e0 0x561505b93540 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 -- 172.21.15.6:0/2161787683 >> 172.21.15.6:0/2161787683 conn(0x561505af1d00 msgr2=0x561505b8df90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 -- 172.21.15.6:0/2161787683 shutdown_connections 2023-09-13T09:55:05.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 -- 172.21.15.6:0/2161787683 wait complete. 2023-09-13T09:55:05.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 -- start start 2023-09-13T09:55:05.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.670+0000 7f312d61ab80 1 Processor -- start 2023-09-13T09:55:05.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505b9cc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505b9d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b950e0 0x561505ba4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f312d61ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505a83c30 con 0x561505b93a80 2023-09-13T09:55:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f312d61ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505a83930 con 0x561505b94780 2023-09-13T09:55:05.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f312d61ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615059679a0 con 0x561505b950e0 2023-09-13T09:55:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f312d61ab80 10 client.0 _ll_register_callbacks cb 0x561505a81700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505b9cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505b9cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43732/0 (socket says 172.21.15.6:43732) 2023-09-13T09:55:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 -- 172.21.15.6:0/3143171717 learned_addr learned my addr 172.21.15.6:0/3143171717 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311b7fe700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b950e0 0x561505ba4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311a7fc700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505b9d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 -- 172.21.15.6:0/3143171717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b950e0 msgr2=0x561505ba4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b950e0 0x561505ba4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 -- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 msgr2=0x561505b9d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505b9d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 -- 172.21.15.6:0/3143171717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c1a56b0 con 0x561505b93a80 2023-09-13T09:55:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311a7fc700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505b9d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f311affd700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505b9cc10 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f310c00ef50 tx=0x7f310c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f48cc674bcb68c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.671+0000 7f30feff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:05.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f30feff5700 1 -- 172.21.15.6:0/3143171717 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c015b20 con 0x561505b93a80 2023-09-13T09:55:05.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f30feff5700 1 -- 172.21.15.6:0/3143171717 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f310c015c80 con 0x561505b93a80 2023-09-13T09:55:05.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561505b866f0 con 0x561505b93a80 2023-09-13T09:55:05.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f30feff5700 1 -- 172.21.15.6:0/3143171717 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f310c015e80 con 0x561505b93a80 2023-09-13T09:55:05.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 10 client.19605 fetch_fsmap learned FSMap version 51 2023-09-13T09:55:05.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x561505afd820 con 0x561505b93a80 2023-09-13T09:55:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f30feff5700 1 -- 172.21.15.6:0/3143171717 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561505b866f0 con 0x561505b93a80 2023-09-13T09:55:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f30feff5700 1 -- 172.21.15.6:0/3143171717 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 51) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f310c021600 con 0x561505b93a80 2023-09-13T09:55:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 10 client.19605 fetch_fsmap finished waiting for FSMap version 51 2023-09-13T09:55:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 10 client.19605 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:05.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 20 client.19605 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:05.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505ba8a40 0x561505baae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 4 client.19605 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:05.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.672+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561505ade9f0 con 0x561505ba8a40 2023-09-13T09:55:05.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.673+0000 7f311a7fc700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505ba8a40 0x561505baae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.673+0000 7f311a7fc700 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505ba8a40 0x561505baae60 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11dc67a172bded28 server_cookie=e397619240b3a5ca in_seq=0 out_seq=0 2023-09-13T09:55:05.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.673+0000 7f30feff5700 10 client.19605 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.679+0000 7f30feff5700 1 -- 172.21.15.6:0/3143171717 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561505ade9f0 con 0x561505ba8a40 2023-09-13T09:55:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.679+0000 7f30feff5700 10 client.19605 handle_command_reply: tid=0 2023-09-13T09:55:05.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.679+0000 7f312d61ab80 1 client.19605 shutdown 2023-09-13T09:55:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.680+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 msgr2=0x561505b9cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505b9cc10 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7f310c00ef50 tx=0x7f310c0047e0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 shutdown_connections 2023-09-13T09:55:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b950e0 0x561505ba4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505ba8a40 0x561505baae60 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505b9cc10 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 --2- 172.21.15.6:0/3143171717 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505b9d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 >> 172.21.15.6:0/3143171717 conn(0x561505af1d00 msgr2=0x561505b88870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f30feff5700 0 client.19605 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 shutdown_connections 2023-09-13T09:55:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 1 -- 172.21.15.6:0/3143171717 wait complete. 2023-09-13T09:55:05.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.681+0000 7f312d61ab80 20 client.19605 trim_cache size 0 max 16384 2023-09-13T09:55:05.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 Processor -- start 2023-09-13T09:55:05.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 -- start start 2023-09-13T09:55:05.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505af1d00 0x561505b93540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505ba4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b9c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505ba5190 con 0x561505b93a80 2023-09-13T09:55:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505b866c0 con 0x561505af1d00 2023-09-13T09:55:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f312d61ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505b9c7b0 con 0x561505b94780 2023-09-13T09:55:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f311a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505ba4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f311b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b9c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f311affd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505af1d00 0x561505b93540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f311a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505ba4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43742/0 (socket says 172.21.15.6:43742) 2023-09-13T09:55:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f311a7fc700 1 -- 172.21.15.6:0/916739629 learned_addr learned my addr 172.21.15.6:0/916739629 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f311a7fc700 1 -- 172.21.15.6:0/916739629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 msgr2=0x561505b9c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.706+0000 7f311a7fc700 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b9c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f311a7fc700 1 -- 172.21.15.6:0/916739629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505af1d00 msgr2=0x561505b93540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f311a7fc700 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505af1d00 0x561505b93540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f311a7fc700 1 -- 172.21.15.6:0/916739629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561505b94130 con 0x561505b93a80 2023-09-13T09:55:05.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f311affd700 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505af1d00 0x561505b93540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f311a7fc700 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505ba4150 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f31100058b0 tx=0x7f3110009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e261617145077d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f3101ffb700 1 -- 172.21.15.6:0/916739629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31100caea0 con 0x561505b93a80 2023-09-13T09:55:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f3101ffb700 1 -- 172.21.15.6:0/916739629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f311009e6b0 con 0x561505b93a80 2023-09-13T09:55:05.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.707+0000 7f3101ffb700 1 -- 172.21.15.6:0/916739629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31100a2630 con 0x561505b93a80 2023-09-13T09:55:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 -- 172.21.15.6:0/916739629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 msgr2=0x561505ba4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505ba4150 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f31100058b0 tx=0x7f3110009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 -- 172.21.15.6:0/916739629 shutdown_connections 2023-09-13T09:55:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b94780 0x561505b9c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505af1d00 0x561505b93540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 --2- 172.21.15.6:0/916739629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505b93a80 0x561505ba4150 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 -- 172.21.15.6:0/916739629 >> 172.21.15.6:0/916739629 conn(0x561505b8e2c0 msgr2=0x561505ba4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 -- 172.21.15.6:0/916739629 shutdown_connections 2023-09-13T09:55:05.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 -- 172.21.15.6:0/916739629 wait complete. 2023-09-13T09:55:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 -- start start 2023-09-13T09:55:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.708+0000 7f312d61ab80 1 Processor -- start 2023-09-13T09:55:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505af1d00 0x561505ba3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b93a80 0x561505ba40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f312d61ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505ba06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f312d61ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505ba0d90 con 0x561505af1d00 2023-09-13T09:55:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f312d61ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505ba0f00 con 0x561505b94780 2023-09-13T09:55:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f312d61ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561505ba10c0 con 0x561505b93a80 2023-09-13T09:55:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f312d61ab80 10 client.0 _ll_register_callbacks cb 0x561505a81700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:05.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505af1d00 0x561505ba3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505af1d00 0x561505ba3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43746/0 (socket says 172.21.15.6:43746) 2023-09-13T09:55:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 -- 172.21.15.6:0/442098807 learned_addr learned my addr 172.21.15.6:0/442098807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311a7fc700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b93a80 0x561505ba40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311b7fe700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505ba06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 -- 172.21.15.6:0/442098807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b93a80 msgr2=0x561505ba40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b93a80 0x561505ba40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 -- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 msgr2=0x561505ba06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505ba06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 -- 172.21.15.6:0/442098807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561505afd820 con 0x561505af1d00 2023-09-13T09:55:05.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311a7fc700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b93a80 0x561505ba40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:05.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f311affd700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505af1d00 0x561505ba3b80 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f310c00ef50 tx=0x7f310c015760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3997a2f33e709c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f30feff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:05.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f30feff5700 1 -- 172.21.15.6:0/442098807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c015d20 con 0x561505af1d00 2023-09-13T09:55:05.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.709+0000 7f30feff5700 1 -- 172.21.15.6:0/442098807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f310c021440 con 0x561505af1d00 2023-09-13T09:55:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f311009af80 con 0x561505af1d00 2023-09-13T09:55:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f30feff5700 1 -- 172.21.15.6:0/442098807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f310c021e10 con 0x561505af1d00 2023-09-13T09:55:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 10 client.19611 fetch_fsmap learned FSMap version 51 2023-09-13T09:55:05.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x5615059656b0 con 0x561505af1d00 2023-09-13T09:55:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f30feff5700 1 -- 172.21.15.6:0/442098807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f311009af80 con 0x561505af1d00 2023-09-13T09:55:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f30feff5700 1 -- 172.21.15.6:0/442098807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 51) v1 ==== 7938+0+0 (secure 0 0 0) 0x7f310c003980 con 0x561505af1d00 2023-09-13T09:55:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 10 client.19611 fetch_fsmap finished waiting for FSMap version 51 2023-09-13T09:55:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 10 client.19611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:05.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 20 client.19611 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505b950e0 0x561505bffeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 4 client.19611 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:55:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.710+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561505a9f0d0 con 0x561505b950e0 2023-09-13T09:55:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.711+0000 7f311a7fc700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505b950e0 0x561505bffeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.711+0000 7f30feff5700 10 client.19611 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.711+0000 7f311a7fc700 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505b950e0 0x561505bffeb0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6375c224029b5b2 server_cookie=eee32d7dcdf66799 in_seq=0 out_seq=0 2023-09-13T09:55:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f30feff5700 1 -- 172.21.15.6:0/442098807 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561505a9f0d0 con 0x561505b950e0 2023-09-13T09:55:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f30feff5700 10 client.19611 handle_command_reply: tid=0 2023-09-13T09:55:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 client.19611 shutdown 2023-09-13T09:55:05.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505af1d00 msgr2=0x561505ba3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505af1d00 0x561505ba3b80 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f310c00ef50 tx=0x7f310c015760 comp rx=0 tx=0).stop 2023-09-13T09:55:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 shutdown_connections 2023-09-13T09:55:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561505b94780 0x561505ba06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561505b950e0 0x561505bffeb0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561505af1d00 0x561505ba3b80 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 --2- 172.21.15.6:0/442098807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561505b93a80 0x561505ba40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 >> 172.21.15.6:0/442098807 conn(0x561505b8e2c0 msgr2=0x561505b9c9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.715+0000 7f30feff5700 0 client.19611 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.716+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 shutdown_connections 2023-09-13T09:55:05.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.716+0000 7f312d61ab80 1 -- 172.21.15.6:0/442098807 wait complete. 2023-09-13T09:55:05.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.716+0000 7f312d61ab80 20 client.19611 trim_cache size 0 max 16384 2023-09-13T09:55:05.730 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:55:05.730 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:55:05.731 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "8ee2c9f0-10a1-4e65-b418-ae84e2f83561", 2023-09-13T09:55:05.731 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:55:05.731 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:55:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.716+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31040a0640 msgr2=0x7f31040a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.716+0000 7f3121435700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31040a0640 0x7f31040a2b00 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f310c006fd0 tx=0x7f310c009190 comp rx=0 tx=0).stop 2023-09-13T09:55:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.716+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c100eb0 msgr2=0x7f311c19d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.716+0000 7f3121435700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c100eb0 0x7f311c19d6f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f311000b580 tx=0x7f3110005740 comp rx=0 tx=0).stop 2023-09-13T09:55:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 shutdown_connections 2023-09-13T09:55:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f311c101850 0x7f311c1a4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f31040a0640 0x7f31040a2b00 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f311c0ffcc0 0x7f311c19d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 --2- 172.21.15.6:0/1099698126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f311c100eb0 0x7f311c19d6f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 >> 172.21.15.6:0/1099698126 conn(0x7f311c0fb210 msgr2=0x7f311c10c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 shutdown_connections 2023-09-13T09:55:05.736 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.718+0000 7f3121435700 1 -- 172.21.15.6:0/1099698126 wait complete. 2023-09-13T09:55:05.737 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:55:05.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.917+0000 7fc223c2b700 1 -- 172.21.15.6:0/1569335091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 msgr2=0x7fc21c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.917+0000 7fc223c2b700 1 --2- 172.21.15.6:0/1569335091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 0x7fc21c101310 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009920 tx=0x7fc20c009c30 comp rx=0 tx=0).stop 2023-09-13T09:55:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 -- 172.21.15.6:0/1569335091 shutdown_connections 2023-09-13T09:55:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 --2- 172.21.15.6:0/1569335091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c101850 0x7fc21c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 --2- 172.21.15.6:0/1569335091 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c0ffcc0 0x7fc21c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 --2- 172.21.15.6:0/1569335091 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 0x7fc21c101310 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 -- 172.21.15.6:0/1569335091 >> 172.21.15.6:0/1569335091 conn(0x7fc21c0fb250 msgr2=0x7fc21c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 -- 172.21.15.6:0/1569335091 shutdown_connections 2023-09-13T09:55:05.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 -- 172.21.15.6:0/1569335091 wait complete. 2023-09-13T09:55:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.918+0000 7fc223c2b700 1 Processor -- start 2023-09-13T09:55:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc223c2b700 1 -- start start 2023-09-13T09:55:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc223c2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c0ffcc0 0x7fc21c104030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc223c2b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 0x7fc21c102670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc223c2b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c101850 0x7fc21c102bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc223c2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c103350 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc223c2b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1034c0 con 0x7fc21c100eb0 2023-09-13T09:55:05.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc223c2b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc21c1a0b70 con 0x7fc21c101850 2023-09-13T09:55:05.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c0ffcc0 0x7fc21c104030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c0ffcc0 0x7fc21c104030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43760/0 (socket says 172.21.15.6:43760) 2023-09-13T09:55:05.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc2211c6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 0x7fc21c102670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc2219c7700 1 -- 172.21.15.6:0/453419810 learned_addr learned my addr 172.21.15.6:0/453419810 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.919+0000 7fc2221c8700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c101850 0x7fc21c102bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc2219c7700 1 -- 172.21.15.6:0/453419810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c101850 msgr2=0x7fc21c102bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc2219c7700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c101850 0x7fc21c102bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc2219c7700 1 -- 172.21.15.6:0/453419810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 msgr2=0x7fc21c102670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc2219c7700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 0x7fc21c102670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc2219c7700 1 -- 172.21.15.6:0/453419810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc20c009520 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc2211c6700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 0x7fc21c102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc2219c7700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c0ffcc0 0x7fc21c104030 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fc21800e970 tx=0x7fc21800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc212ffd700 1 -- 172.21.15.6:0/453419810 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218009790 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc212ffd700 1 -- 172.21.15.6:0/453419810 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc21800c7e0 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc21c1a0e50 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc212ffd700 1 -- 172.21.15.6:0/453419810 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc218003c70 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.920+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c1a1270 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.923+0000 7fc212ffd700 1 -- 172.21.15.6:0/453419810 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc21800cc50 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.924+0000 7fc212ffd700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2080a0640 0x7fc2080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.924+0000 7fc212ffd700 1 -- 172.21.15.6:0/453419810 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc218014070 con 0x7fc21c0ffcc0 2023-09-13T09:55:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.924+0000 7fc2211c6700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2080a0640 0x7fc2080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.924+0000 7fc2211c6700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2080a0640 0x7fc2080a2b00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00fa40 tx=0x7fc20c019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.925+0000 7fc22fe10b80 1 Processor -- start 2023-09-13T09:55:05.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.925+0000 7fc22fe10b80 1 -- start start 2023-09-13T09:55:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.925+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7deb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7df060 0x56490e7dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7dda00 0x56490e7dde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e736780 con 0x56490e7df060 2023-09-13T09:55:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e7340a0 con 0x56490e7de700 2023-09-13T09:55:05.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e72f990 con 0x56490e7dda00 2023-09-13T09:55:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7df060 0x56490e7dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2221c8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7dda00 0x56490e7dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7df060 0x56490e7dd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43768/0 (socket says 172.21.15.6:43768) 2023-09-13T09:55:05.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 -- 172.21.15.6:0/3871843937 learned_addr learned my addr 172.21.15.6:0/3871843937 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 -- 172.21.15.6:0/3871843937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7dda00 msgr2=0x56490e7dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 --2- 172.21.15.6:0/3871843937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7dda00 0x56490e7dde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 -- 172.21.15.6:0/3871843937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 msgr2=0x56490e7deb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 --2- 172.21.15.6:0/3871843937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7deb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 -- 172.21.15.6:0/3871843937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56490e5af630 con 0x56490e7df060 2023-09-13T09:55:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.926+0000 7fc2211c6700 1 --2- 172.21.15.6:0/3871843937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7df060 0x56490e7dd4c0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009920 tx=0x7fc20c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8a259e51315705 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.927+0000 7fc207fff700 1 -- 172.21.15.6:0/3871843937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c00bbc0 con 0x56490e7df060 2023-09-13T09:55:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.927+0000 7fc207fff700 1 -- 172.21.15.6:0/3871843937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc20c01d040 con 0x56490e7df060 2023-09-13T09:55:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.927+0000 7fc207fff700 1 -- 172.21.15.6:0/3871843937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc20c004c30 con 0x56490e7df060 2023-09-13T09:55:05.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 -- 172.21.15.6:0/3871843937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7df060 msgr2=0x56490e7dd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/3871843937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7df060 0x56490e7dd4c0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fc20c009920 tx=0x7fc20c01f000 comp rx=0 tx=0).stop 2023-09-13T09:55:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 -- 172.21.15.6:0/3871843937 shutdown_connections 2023-09-13T09:55:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/3871843937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7dda00 0x56490e7dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/3871843937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7deb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/3871843937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7df060 0x56490e7dd4c0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 -- 172.21.15.6:0/3871843937 >> 172.21.15.6:0/3871843937 conn(0x56490e73bc80 msgr2=0x56490e7d7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 -- 172.21.15.6:0/3871843937 shutdown_connections 2023-09-13T09:55:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 -- 172.21.15.6:0/3871843937 wait complete. 2023-09-13T09:55:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.928+0000 7fc22fe10b80 1 -- start start 2023-09-13T09:55:05.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 1 Processor -- start 2023-09-13T09:55:05.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7dda00 0x56490e7e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7de700 0x56490e7e73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ee420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e6cdbb0 con 0x56490e7de700 2023-09-13T09:55:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e6cd8b0 con 0x56490e7dda00 2023-09-13T09:55:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e5b1920 con 0x56490e7df060 2023-09-13T09:55:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc22fe10b80 10 client.0 _ll_register_callbacks cb 0x56490e6cb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7dda00 0x56490e7e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7dda00 0x56490e7e6ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37298/0 (socket says 172.21.15.6:37298) 2023-09-13T09:55:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc2219c7700 1 -- 172.21.15.6:0/1317137887 learned_addr learned my addr 172.21.15.6:0/1317137887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.929+0000 7fc2211c6700 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7de700 0x56490e7e73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.930+0000 7fc2219c7700 1 -- 172.21.15.6:0/1317137887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 msgr2=0x56490e7ee420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:55:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.930+0000 7fc2219c7700 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ee420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.930+0000 7fc2219c7700 1 -- 172.21.15.6:0/1317137887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7de700 msgr2=0x56490e7e73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.930+0000 7fc2219c7700 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7de700 0x56490e7e73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.930+0000 7fc2219c7700 1 -- 172.21.15.6:0/1317137887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc21c108a50 con 0x56490e7dda00 2023-09-13T09:55:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.930+0000 7fc2219c7700 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7dda00 0x56490e7e6ea0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc2180c9bd0 tx=0x7fc218098f30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766595f5351bbb28 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.930+0000 7fc2057fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:55:05.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.931+0000 7fc2057fa700 1 -- 172.21.15.6:0/1317137887 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21809d170 con 0x56490e7dda00 2023-09-13T09:55:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.931+0000 7fc2057fa700 1 -- 172.21.15.6:0/1317137887 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc21809d380 con 0x56490e7dda00 2023-09-13T09:55:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.931+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56490e7d0670 con 0x56490e7dda00 2023-09-13T09:55:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.931+0000 7fc2057fa700 1 -- 172.21.15.6:0/1317137887 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc2180a15c0 con 0x56490e7dda00 2023-09-13T09:55:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.931+0000 7fc22fe10b80 10 client.28964 fetch_fsmap learned FSMap version 51 2023-09-13T09:55:05.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.931+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x56490e7477a0 con 0x56490e7dda00 2023-09-13T09:55:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.931+0000 7fc2057fa700 1 -- 172.21.15.6:0/1317137887 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56490e7d0670 con 0x56490e7dda00 2023-09-13T09:55:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc2057fa700 1 -- 172.21.15.6:0/1317137887 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 51) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fc2180997b0 con 0x56490e7dda00 2023-09-13T09:55:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc22fe10b80 10 client.28964 fetch_fsmap finished waiting for FSMap version 51 2023-09-13T09:55:05.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc22fe10b80 10 client.28964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc22fe10b80 20 client.28964 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e7f2d70 0x56490e7f5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc22fe10b80 4 client.28964 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:05.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56490e728970 con 0x56490e7f2d70 2023-09-13T09:55:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.932+0000 7fc2211c6700 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e7f2d70 0x56490e7f5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.933+0000 7fc2057fa700 10 client.28964 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.933+0000 7fc2211c6700 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e7f2d70 0x56490e7f5190 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a88b1976e63ffb79 server_cookie=3de90bfb267fec01 in_seq=0 out_seq=0 2023-09-13T09:55:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.938+0000 7fc2057fa700 1 -- 172.21.15.6:0/1317137887 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56490e728970 con 0x56490e7f2d70 2023-09-13T09:55:05.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.938+0000 7fc2057fa700 10 client.28964 handle_command_reply: tid=0 2023-09-13T09:55:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.938+0000 7fc22fe10b80 1 client.28964 shutdown 2023-09-13T09:55:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7dda00 msgr2=0x56490e7e6ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7dda00 0x56490e7e6ea0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc2180c9bd0 tx=0x7fc218098f30 comp rx=0 tx=0).stop 2023-09-13T09:55:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 shutdown_connections 2023-09-13T09:55:05.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ee420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7dda00 0x56490e7e6ea0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e7f2d70 0x56490e7f5190 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1317137887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7de700 0x56490e7e73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc2057fa700 0 client.28964 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 >> 172.21.15.6:0/1317137887 conn(0x56490e73bc80 msgr2=0x56490e7d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 shutdown_connections 2023-09-13T09:55:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1317137887 wait complete. 2023-09-13T09:55:05.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.939+0000 7fc22fe10b80 20 client.28964 trim_cache size 0 max 16384 2023-09-13T09:55:05.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 Processor -- start 2023-09-13T09:55:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 -- start start 2023-09-13T09:55:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7de700 0x56490e7ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7df060 0x56490e7e18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e7e6390 con 0x56490e7dda00 2023-09-13T09:55:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e7e6a40 con 0x56490e7df060 2023-09-13T09:55:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.959+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e7f00e0 con 0x56490e7de700 2023-09-13T09:55:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7dd4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43780/0 (socket says 172.21.15.6:43780) 2023-09-13T09:55:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 -- 172.21.15.6:0/1940134997 learned_addr learned my addr 172.21.15.6:0/1940134997 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2211c6700 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7de700 0x56490e7ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 -- 172.21.15.6:0/1940134997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7de700 msgr2=0x56490e7ee3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7de700 0x56490e7ee3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 -- 172.21.15.6:0/1940134997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7df060 msgr2=0x56490e7e18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7df060 0x56490e7e18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 -- 172.21.15.6:0/1940134997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56490e7f9de0 con 0x56490e7dda00 2023-09-13T09:55:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2211c6700 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7de700 0x56490e7ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc2219c7700 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7dd4c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fc218099250 tx=0x7fc2180959c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ecee9ab89645a0a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc210d82700 1 -- 172.21.15.6:0/1940134997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180840b0 con 0x56490e7dda00 2023-09-13T09:55:05.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc210d82700 1 -- 172.21.15.6:0/1940134997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc218098cf0 con 0x56490e7dda00 2023-09-13T09:55:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.960+0000 7fc210d82700 1 -- 172.21.15.6:0/1940134997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2180997b0 con 0x56490e7dda00 2023-09-13T09:55:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1940134997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 msgr2=0x56490e7dd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7dd4c0 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7fc218099250 tx=0x7fc2180959c0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1940134997 shutdown_connections 2023-09-13T09:55:05.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7df060 0x56490e7e18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7dd4c0 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/1940134997 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7de700 0x56490e7ee3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1940134997 >> 172.21.15.6:0/1940134997 conn(0x56490e73bc80 msgr2=0x56490e7e5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1940134997 shutdown_connections 2023-09-13T09:55:05.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.961+0000 7fc22fe10b80 1 -- 172.21.15.6:0/1940134997 wait complete. 2023-09-13T09:55:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 -- start start 2023-09-13T09:55:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 Processor -- start 2023-09-13T09:55:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7ea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7ea7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e7edd40 con 0x56490e7dda00 2023-09-13T09:55:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e7edeb0 con 0x56490e7de700 2023-09-13T09:55:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56490e7ee070 con 0x56490e7df060 2023-09-13T09:55:05.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc22fe10b80 10 client.0 _ll_register_callbacks cb 0x56490e6cb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc2219c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7ea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc2211c6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7ea7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc2221c8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc2221c8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ed800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46842/0 (socket says 172.21.15.6:46842) 2023-09-13T09:55:05.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc2211c6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7ea7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37310/0 (socket says 172.21.15.6:37310) 2023-09-13T09:55:05.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.962+0000 7fc2221c8700 1 -- 172.21.15.6:0/2048681366 learned_addr learned my addr 172.21.15.6:0/2048681366 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:05.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2221c8700 1 -- 172.21.15.6:0/2048681366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 msgr2=0x56490e7ea7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2221c8700 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7ea7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2221c8700 1 -- 172.21.15.6:0/2048681366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 msgr2=0x56490e7ea2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:05.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2221c8700 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7ea2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2221c8700 1 -- 172.21.15.6:0/2048681366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56490e5af630 con 0x56490e7df060 2023-09-13T09:55:05.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2221c8700 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ed800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc214014dd0 tx=0x7fc214012580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bc0a55bfa503b7d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:05.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2057fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:55:05.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2057fa700 1 -- 172.21.15.6:0/2048681366 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc21400e040 con 0x56490e7df060 2023-09-13T09:55:05.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2057fa700 1 -- 172.21.15.6:0/2048681366 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc21401a070 con 0x56490e7df060 2023-09-13T09:55:05.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56490e6e9050 con 0x56490e7df060 2023-09-13T09:55:05.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc2057fa700 1 -- 172.21.15.6:0/2048681366 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc214012a60 con 0x56490e7df060 2023-09-13T09:55:05.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc22fe10b80 10 client.28921 fetch_fsmap learned FSMap version 51 2023-09-13T09:55:05.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.963+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=4+}) v3 -- 0x56490e7477a0 con 0x56490e7df060 2023-09-13T09:55:05.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc2057fa700 1 -- 172.21.15.6:0/2048681366 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56490e6e9050 con 0x56490e7df060 2023-09-13T09:55:05.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc2057fa700 1 -- 172.21.15.6:0/2048681366 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 51) v1 ==== 7938+0+0 (secure 0 0 0) 0x7fc214007bd0 con 0x56490e7df060 2023-09-13T09:55:05.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc22fe10b80 10 client.28921 fetch_fsmap finished waiting for FSMap version 51 2023-09-13T09:55:05.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc22fe10b80 10 client.28921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:05.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc22fe10b80 20 client.28921 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:05.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e847df0 0x56490e84a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:05.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc22fe10b80 4 client.28921 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:55:05.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56490e57cf70 con 0x56490e847df0 2023-09-13T09:55:05.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.964+0000 7fc2219c7700 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e847df0 0x56490e84a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:05.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.965+0000 7fc2057fa700 10 client.28921 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.965+0000 7fc2219c7700 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e847df0 0x56490e84a210 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b08036dea1267a0d server_cookie=fedfeec7c3ef3563 in_seq=0 out_seq=0 2023-09-13T09:55:05.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc2057fa700 1 -- 172.21.15.6:0/2048681366 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x56490e57cf70 con 0x56490e847df0 2023-09-13T09:55:05.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc2057fa700 10 client.28921 handle_command_reply: tid=0 2023-09-13T09:55:05.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 client.28921 shutdown 2023-09-13T09:55:05.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 msgr2=0x56490e7ed800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ed800 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc214014dd0 tx=0x7fc214012580 comp rx=0 tx=0).stop 2023-09-13T09:55:05.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 shutdown_connections 2023-09-13T09:55:05.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56490e7df060 0x56490e7ed800 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56490e847df0 0x56490e84a210 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56490e7dda00 0x56490e7ea2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 --2- 172.21.15.6:0/2048681366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56490e7de700 0x56490e7ea7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc2057fa700 0 client.28921 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:05.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 >> 172.21.15.6:0/2048681366 conn(0x56490e73bc80 msgr2=0x56490e7e18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 shutdown_connections 2023-09-13T09:55:05.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 1 -- 172.21.15.6:0/2048681366 wait complete. 2023-09-13T09:55:05.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.967+0000 7fc22fe10b80 20 client.28921 trim_cache size 0 max 16384 2023-09-13T09:55:05.982 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:55:05.982 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (15 inodes in the stack)", 2023-09-13T09:55:05.982 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:55:05.982 INFO:teuthology.orchestra.run.smithi006.stdout: "8ee2c9f0-10a1-4e65-b418-ae84e2f83561": { 2023-09-13T09:55:05.983 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:55:05.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "8ee2c9f0-10a1-4e65-b418-ae84e2f83561", 2023-09-13T09:55:05.983 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:55:05.983 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:55:05.983 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:55:05.984 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:55:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2080a0640 msgr2=0x7fc2080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2080a0640 0x7fc2080a2b00 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fc20c00fa40 tx=0x7fc20c019040 comp rx=0 tx=0).stop 2023-09-13T09:55:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c0ffcc0 msgr2=0x7fc21c104030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:05.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c0ffcc0 0x7fc21c104030 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fc21800e970 tx=0x7fc21800ec80 comp rx=0 tx=0).stop 2023-09-13T09:55:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 shutdown_connections 2023-09-13T09:55:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc21c101850 0x7fc21c102bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc2080a0640 0x7fc2080a2b00 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc21c0ffcc0 0x7fc21c104030 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 --2- 172.21.15.6:0/453419810 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc21c100eb0 0x7fc21c102670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:05.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.968+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 >> 172.21.15.6:0/453419810 conn(0x7fc21c0fb250 msgr2=0x7fc21c0fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:05.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.970+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 shutdown_connections 2023-09-13T09:55:05.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:05.970+0000 7fc223c2b700 1 -- 172.21.15.6:0/453419810 wait complete. 2023-09-13T09:55:05.987 INFO:tasks.cephfs.filesystem:scrub status for tag:8ee2c9f0-10a1-4e65-b418-ae84e2f83561 - {'path': '/', 'tag': '8ee2c9f0-10a1-4e65-b418-ae84e2f83561', 'options': 'recursive,force'} 2023-09-13T09:55:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:06 smithi006 ceph-mon[98665]: pgmap v767: 97 pgs: 97 active+clean; 877 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 814 op/s 2023-09-13T09:55:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:06 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:06 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:06 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:06 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:06.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:06 smithi053 ceph-mon[102373]: pgmap v767: 97 pgs: 97 active+clean; 877 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 814 op/s 2023-09-13T09:55:06.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:06 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:06.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:06 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:06.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:06 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:06.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:06 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:06 smithi131 ceph-mon[102785]: pgmap v767: 97 pgs: 97 active+clean; 877 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 814 op/s 2023-09-13T09:55:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:06 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:06.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:06 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:06.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:06 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:06.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:06 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:06.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 105495 38.97 MB/sec execute 26 sec latency 256.872 ms 2023-09-13T09:55:07.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:55:07.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:07.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:07 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:55:07.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:07.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:07 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:55:07.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:07.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:07 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:07.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 106276 38.89 MB/sec execute 27 sec latency 295.782 ms 2023-09-13T09:55:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:08 smithi006 ceph-mon[98665]: pgmap v768: 97 pgs: 97 active+clean; 885 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 843 op/s 2023-09-13T09:55:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:08 smithi053 ceph-mon[102373]: pgmap v768: 97 pgs: 97 active+clean; 885 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 843 op/s 2023-09-13T09:55:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:08 smithi131 ceph-mon[102785]: pgmap v768: 97 pgs: 97 active+clean; 885 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 843 op/s 2023-09-13T09:55:08.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 107238 39.55 MB/sec execute 28 sec latency 49.324 ms 2023-09-13T09:55:09.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 108052 39.99 MB/sec execute 29 sec latency 44.126 ms 2023-09-13T09:55:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:10 smithi006 ceph-mon[98665]: pgmap v769: 97 pgs: 97 active+clean; 888 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.7 MiB/s wr, 759 op/s 2023-09-13T09:55:10.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:10 smithi053 ceph-mon[102373]: pgmap v769: 97 pgs: 97 active+clean; 888 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.7 MiB/s wr, 759 op/s 2023-09-13T09:55:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:10 smithi131 ceph-mon[102785]: pgmap v769: 97 pgs: 97 active+clean; 888 MiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.7 MiB/s wr, 759 op/s 2023-09-13T09:55:10.560 INFO:tasks.workunit.client.0.smithi006.stdout: 10 108654 39.47 MB/sec execute 30 sec latency 87.655 ms 2023-09-13T09:55:11.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:11 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:11.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:11 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:11.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:11 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:11.562 INFO:tasks.workunit.client.0.smithi006.stdout: 10 109410 39.62 MB/sec execute 31 sec latency 130.280 ms 2023-09-13T09:55:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:12 smithi006 ceph-mon[98665]: pgmap v770: 97 pgs: 97 active+clean; 888 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 728 op/s 2023-09-13T09:55:12.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:12 smithi053 ceph-mon[102373]: pgmap v770: 97 pgs: 97 active+clean; 888 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 728 op/s 2023-09-13T09:55:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:12 smithi131 ceph-mon[102785]: pgmap v770: 97 pgs: 97 active+clean; 888 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 728 op/s 2023-09-13T09:55:12.562 INFO:tasks.workunit.client.0.smithi006.stdout: 10 110066 39.29 MB/sec execute 32 sec latency 177.482 ms 2023-09-13T09:55:13.562 INFO:tasks.workunit.client.0.smithi006.stdout: 10 110875 39.55 MB/sec execute 33 sec latency 58.550 ms 2023-09-13T09:55:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:14 smithi006 ceph-mon[98665]: pgmap v771: 97 pgs: 97 active+clean; 898 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 877 op/s 2023-09-13T09:55:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:14 smithi053 ceph-mon[102373]: pgmap v771: 97 pgs: 97 active+clean; 898 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 877 op/s 2023-09-13T09:55:14.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:14 smithi131 ceph-mon[102785]: pgmap v771: 97 pgs: 97 active+clean; 898 MiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 877 op/s 2023-09-13T09:55:14.562 INFO:tasks.workunit.client.0.smithi006.stdout: 10 111650 39.44 MB/sec execute 34 sec latency 84.855 ms 2023-09-13T09:55:15.563 INFO:tasks.workunit.client.0.smithi006.stdout: 10 112518 39.74 MB/sec execute 35 sec latency 77.978 ms 2023-09-13T09:55:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:16 smithi006 ceph-mon[98665]: pgmap v772: 97 pgs: 97 active+clean; 903 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 790 op/s 2023-09-13T09:55:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:16 smithi053 ceph-mon[102373]: pgmap v772: 97 pgs: 97 active+clean; 903 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 790 op/s 2023-09-13T09:55:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:16 smithi131 ceph-mon[102785]: pgmap v772: 97 pgs: 97 active+clean; 903 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 790 op/s 2023-09-13T09:55:16.563 INFO:tasks.workunit.client.0.smithi006.stdout: 10 113183 39.79 MB/sec execute 36 sec latency 97.129 ms 2023-09-13T09:55:17.563 INFO:tasks.workunit.client.0.smithi006.stdout: 10 113676 39.29 MB/sec execute 37 sec latency 173.677 ms 2023-09-13T09:55:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:18 smithi006 ceph-mon[98665]: pgmap v773: 97 pgs: 97 active+clean; 910 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 835 op/s 2023-09-13T09:55:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:18 smithi053 ceph-mon[102373]: pgmap v773: 97 pgs: 97 active+clean; 910 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 835 op/s 2023-09-13T09:55:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:18 smithi131 ceph-mon[102785]: pgmap v773: 97 pgs: 97 active+clean; 910 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 835 op/s 2023-09-13T09:55:18.563 INFO:tasks.workunit.client.0.smithi006.stdout: 10 114279 39.26 MB/sec execute 38 sec latency 155.583 ms 2023-09-13T09:55:19.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:19 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:19.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:19 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:19 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:19.563 INFO:tasks.workunit.client.0.smithi006.stdout: 10 115011 39.03 MB/sec execute 39 sec latency 60.414 ms 2023-09-13T09:55:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:20 smithi006 ceph-mon[98665]: pgmap v774: 97 pgs: 97 active+clean; 917 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.6 MiB/s wr, 738 op/s 2023-09-13T09:55:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:20 smithi053 ceph-mon[102373]: pgmap v774: 97 pgs: 97 active+clean; 917 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.6 MiB/s wr, 738 op/s 2023-09-13T09:55:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:20.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:20 smithi131 ceph-mon[102785]: pgmap v774: 97 pgs: 97 active+clean; 917 MiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.6 MiB/s wr, 738 op/s 2023-09-13T09:55:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:20.563 INFO:tasks.workunit.client.0.smithi006.stdout: 10 115768 39.24 MB/sec execute 40 sec latency 64.087 ms 2023-09-13T09:55:21.563 INFO:tasks.workunit.client.0.smithi006.stdout: 10 116503 39.32 MB/sec execute 41 sec latency 67.789 ms 2023-09-13T09:55:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:22 smithi006 ceph-mon[98665]: pgmap v775: 97 pgs: 97 active+clean; 917 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.7 MiB/s wr, 699 op/s 2023-09-13T09:55:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:22 smithi053 ceph-mon[102373]: pgmap v775: 97 pgs: 97 active+clean; 917 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.7 MiB/s wr, 699 op/s 2023-09-13T09:55:22.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:22 smithi131 ceph-mon[102785]: pgmap v775: 97 pgs: 97 active+clean; 917 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.7 MiB/s wr, 699 op/s 2023-09-13T09:55:22.565 INFO:tasks.workunit.client.0.smithi006.stdout: 10 117026 38.99 MB/sec execute 42 sec latency 235.384 ms 2023-09-13T09:55:23.565 INFO:tasks.workunit.client.0.smithi006.stdout: 10 117559 38.75 MB/sec execute 43 sec latency 116.661 ms 2023-09-13T09:55:24.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:24 smithi006 ceph-mon[98665]: pgmap v776: 97 pgs: 97 active+clean; 923 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 873 op/s 2023-09-13T09:55:24.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:24 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:24.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:24 smithi053 ceph-mon[102373]: pgmap v776: 97 pgs: 97 active+clean; 923 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 873 op/s 2023-09-13T09:55:24.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:24 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:24.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:24 smithi131 ceph-mon[102785]: pgmap v776: 97 pgs: 97 active+clean; 923 MiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 11 MiB/s wr, 873 op/s 2023-09-13T09:55:24.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:24 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:24.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 118205 38.48 MB/sec execute 44 sec latency 62.706 ms 2023-09-13T09:55:25.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 119053 38.76 MB/sec execute 45 sec latency 98.148 ms 2023-09-13T09:55:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:26 smithi006 ceph-mon[98665]: pgmap v777: 97 pgs: 97 active+clean; 929 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 756 op/s 2023-09-13T09:55:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:26 smithi053 ceph-mon[102373]: pgmap v777: 97 pgs: 97 active+clean; 929 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 756 op/s 2023-09-13T09:55:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:26 smithi131 ceph-mon[102785]: pgmap v777: 97 pgs: 97 active+clean; 929 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 756 op/s 2023-09-13T09:55:26.566 INFO:tasks.workunit.client.0.smithi006.stdout: 10 119794 38.77 MB/sec execute 46 sec latency 79.879 ms 2023-09-13T09:55:27.566 INFO:tasks.workunit.client.0.smithi006.stdout: 10 120376 38.79 MB/sec execute 47 sec latency 204.554 ms 2023-09-13T09:55:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:28 smithi006 ceph-mon[98665]: pgmap v778: 97 pgs: 97 active+clean; 936 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 841 op/s 2023-09-13T09:55:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:28 smithi053 ceph-mon[102373]: pgmap v778: 97 pgs: 97 active+clean; 936 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 841 op/s 2023-09-13T09:55:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:28 smithi131 ceph-mon[102785]: pgmap v778: 97 pgs: 97 active+clean; 936 MiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 841 op/s 2023-09-13T09:55:28.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 120977 38.55 MB/sec execute 48 sec latency 96.624 ms 2023-09-13T09:55:29.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:29 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:29.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:29 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:29.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:29 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:29.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 121751 38.62 MB/sec execute 49 sec latency 48.524 ms 2023-09-13T09:55:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:30 smithi006 ceph-mon[98665]: pgmap v779: 97 pgs: 97 active+clean; 935 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 719 op/s 2023-09-13T09:55:30.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:30 smithi053 ceph-mon[102373]: pgmap v779: 97 pgs: 97 active+clean; 935 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 719 op/s 2023-09-13T09:55:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:30 smithi131 ceph-mon[102785]: pgmap v779: 97 pgs: 97 active+clean; 935 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 719 op/s 2023-09-13T09:55:30.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 122493 38.62 MB/sec execute 50 sec latency 65.440 ms 2023-09-13T09:55:31.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 123285 38.67 MB/sec execute 51 sec latency 67.524 ms 2023-09-13T09:55:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:32 smithi006 ceph-mon[98665]: pgmap v780: 97 pgs: 97 active+clean; 935 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.1 MiB/s wr, 660 op/s 2023-09-13T09:55:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:32 smithi053 ceph-mon[102373]: pgmap v780: 97 pgs: 97 active+clean; 935 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.1 MiB/s wr, 660 op/s 2023-09-13T09:55:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:32 smithi131 ceph-mon[102785]: pgmap v780: 97 pgs: 97 active+clean; 935 MiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.1 MiB/s wr, 660 op/s 2023-09-13T09:55:32.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 123729 38.27 MB/sec execute 52 sec latency 274.678 ms 2023-09-13T09:55:33.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 124491 38.47 MB/sec execute 53 sec latency 87.144 ms 2023-09-13T09:55:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:34 smithi006 ceph-mon[98665]: pgmap v781: 97 pgs: 97 active+clean; 946 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 865 op/s 2023-09-13T09:55:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:34 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:34 smithi053 ceph-mon[102373]: pgmap v781: 97 pgs: 97 active+clean; 946 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 865 op/s 2023-09-13T09:55:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:34 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:34 smithi131 ceph-mon[102785]: pgmap v781: 97 pgs: 97 active+clean; 946 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 865 op/s 2023-09-13T09:55:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:34 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:34.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 125349 38.63 MB/sec execute 54 sec latency 55.384 ms 2023-09-13T09:55:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:35 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:35.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:35 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:35 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:35.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 126083 38.69 MB/sec execute 55 sec latency 62.113 ms 2023-09-13T09:55:35.989 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:55:36.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 -- 172.21.15.6:0/4023458557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc100eb0 msgr2=0x7f17cc101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 --2- 172.21.15.6:0/4023458557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc100eb0 0x7f17cc101310 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f17b80099c0 tx=0x7f17b8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 -- 172.21.15.6:0/4023458557 shutdown_connections 2023-09-13T09:55:36.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 --2- 172.21.15.6:0/4023458557 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc101850 0x7f17cc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 --2- 172.21.15.6:0/4023458557 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 --2- 172.21.15.6:0/4023458557 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc100eb0 0x7f17cc101310 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 -- 172.21.15.6:0/4023458557 >> 172.21.15.6:0/4023458557 conn(0x7f17cc0fb250 msgr2=0x7f17cc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 -- 172.21.15.6:0/4023458557 shutdown_connections 2023-09-13T09:55:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.128+0000 7f17d2c55700 1 -- 172.21.15.6:0/4023458557 wait complete. 2023-09-13T09:55:36.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 Processor -- start 2023-09-13T09:55:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 -- start start 2023-09-13T09:55:36.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 0x7f17cc19b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc19dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc19e580 con 0x7f17cc101850 2023-09-13T09:55:36.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc19e6f0 con 0x7f17cc0ffcc0 2023-09-13T09:55:36.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d2c55700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17cc19e8b0 con 0x7f17cc100eb0 2023-09-13T09:55:36.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d09f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d09f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37322/0 (socket says 172.21.15.6:37322) 2023-09-13T09:55:36.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d09f1700 1 -- 172.21.15.6:0/1410770216 learned_addr learned my addr 172.21.15.6:0/1410770216 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.129+0000 7f17d11f2700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc19dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17cbfff700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 0x7f17cc19b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d11f2700 1 -- 172.21.15.6:0/1410770216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 msgr2=0x7f17cc19b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d11f2700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 0x7f17cc19b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d11f2700 1 -- 172.21.15.6:0/1410770216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 msgr2=0x7f17cc068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d11f2700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d11f2700 1 -- 172.21.15.6:0/1410770216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b80095f0 con 0x7f17cc101850 2023-09-13T09:55:36.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d09f1700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:36.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d11f2700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc19dde0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f17c400efc0 tx=0x7f17c400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17c9ffb700 1 -- 172.21.15.6:0/1410770216 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c4018070 con 0x7f17cc101850 2023-09-13T09:55:36.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17c9ffb700 1 -- 172.21.15.6:0/1410770216 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17c400f040 con 0x7f17cc101850 2023-09-13T09:55:36.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17c9ffb700 1 -- 172.21.15.6:0/1410770216 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c400cd40 con 0x7f17cc101850 2023-09-13T09:55:36.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17cc195570 con 0x7f17cc101850 2023-09-13T09:55:36.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.130+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc195a30 con 0x7f17cc101850 2023-09-13T09:55:36.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.133+0000 7f17c9ffb700 1 -- 172.21.15.6:0/1410770216 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f17c4003a00 con 0x7f17cc101850 2023-09-13T09:55:36.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.133+0000 7f17c9ffb700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17bc0a06c0 0x7f17bc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.134+0000 7f17c9ffb700 1 -- 172.21.15.6:0/1410770216 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17c40cb700 con 0x7f17cc101850 2023-09-13T09:55:36.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.134+0000 7f17d09f1700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17bc0a06c0 0x7f17bc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.134+0000 7f17d09f1700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17bc0a06c0 0x7f17bc0a2b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f17c0005950 tx=0x7f17c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.134+0000 7f17dee3ab80 1 Processor -- start 2023-09-13T09:55:36.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.134+0000 7f17dee3ab80 1 -- start start 2023-09-13T09:55:36.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46757b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46758060 0x55da467564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46756a00 0x55da46756e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da466af780 con 0x55da46758060 2023-09-13T09:55:36.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da466ad0a0 con 0x55da46757700 2023-09-13T09:55:36.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da466a8990 con 0x55da46756a00 2023-09-13T09:55:36.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46758060 0x55da467564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17d09f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46757b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46758060 0x55da467564c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43808/0 (socket says 172.21.15.6:43808) 2023-09-13T09:55:36.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 -- 172.21.15.6:0/2527021704 learned_addr learned my addr 172.21.15.6:0/2527021704 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17d11f2700 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46756a00 0x55da46756e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 -- 172.21.15.6:0/2527021704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46756a00 msgr2=0x55da46756e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46756a00 0x55da46756e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 -- 172.21.15.6:0/2527021704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 msgr2=0x55da46757b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46757b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 -- 172.21.15.6:0/2527021704 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da46528630 con 0x55da46758060 2023-09-13T09:55:36.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.135+0000 7f17cbfff700 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46758060 0x55da467564c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f17b80099c0 tx=0x7f17b8005ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdabfc6bd5e6118f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17b6ffd700 1 -- 172.21.15.6:0/2527021704 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800ba10 con 0x55da46758060 2023-09-13T09:55:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17b6ffd700 1 -- 172.21.15.6:0/2527021704 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17b8022040 con 0x55da46758060 2023-09-13T09:55:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17b6ffd700 1 -- 172.21.15.6:0/2527021704 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8005430 con 0x55da46758060 2023-09-13T09:55:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 -- 172.21.15.6:0/2527021704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46758060 msgr2=0x55da467564c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46758060 0x55da467564c0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f17b80099c0 tx=0x7f17b8005ee0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 -- 172.21.15.6:0/2527021704 shutdown_connections 2023-09-13T09:55:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46756a00 0x55da46756e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46757b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/2527021704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46758060 0x55da467564c0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 -- 172.21.15.6:0/2527021704 >> 172.21.15.6:0/2527021704 conn(0x55da466b4c80 msgr2=0x55da46750f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 -- 172.21.15.6:0/2527021704 shutdown_connections 2023-09-13T09:55:36.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.136+0000 7f17dee3ab80 1 -- 172.21.15.6:0/2527021704 wait complete. 2023-09-13T09:55:36.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 -- start start 2023-09-13T09:55:36.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 Processor -- start 2023-09-13T09:55:36.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46756a00 0x55da4675fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46757700 0x55da46760410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da46767450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da46646bb0 con 0x55da46757700 2023-09-13T09:55:36.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da466468b0 con 0x55da46756a00 2023-09-13T09:55:36.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4652a920 con 0x55da46758060 2023-09-13T09:55:36.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17dee3ab80 10 client.0 _ll_register_callbacks cb 0x55da46644680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:36.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46757700 0x55da46760410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17d09f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46756a00 0x55da4675fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46757700 0x55da46760410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43814/0 (socket says 172.21.15.6:43814) 2023-09-13T09:55:36.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17d09f1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46756a00 0x55da4675fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37336/0 (socket says 172.21.15.6:37336) 2023-09-13T09:55:36.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.137+0000 7f17cbfff700 1 -- 172.21.15.6:0/3244165019 learned_addr learned my addr 172.21.15.6:0/3244165019 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17d11f2700 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da46767450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17d09f1700 1 -- 172.21.15.6:0/3244165019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 msgr2=0x55da46767450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17d09f1700 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da46767450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17d09f1700 1 -- 172.21.15.6:0/3244165019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46757700 msgr2=0x55da46760410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17d09f1700 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46757700 0x55da46760410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17d09f1700 1 -- 172.21.15.6:0/3244165019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17cc108a50 con 0x55da46756a00 2023-09-13T09:55:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17d09f1700 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46756a00 0x55da4675fed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009cf0 tx=0x7f17c00047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730be3b556f77138 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17abfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:55:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17abfff700 1 -- 172.21.15.6:0/3244165019 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17c0022070 con 0x55da46756a00 2023-09-13T09:55:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da46749670 con 0x55da46756a00 2023-09-13T09:55:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17abfff700 1 -- 172.21.15.6:0/3244165019 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17c001dad0 con 0x55da46756a00 2023-09-13T09:55:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.138+0000 7f17abfff700 1 -- 172.21.15.6:0/3244165019 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17c001dc90 con 0x55da46756a00 2023-09-13T09:55:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.139+0000 7f17dee3ab80 10 client.28979 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:36.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.139+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55da466c07a0 con 0x55da46756a00 2023-09-13T09:55:36.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.139+0000 7f17abfff700 1 -- 172.21.15.6:0/3244165019 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55da46749670 con 0x55da46756a00 2023-09-13T09:55:36.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.141+0000 7f17abfff700 1 -- 172.21.15.6:0/3244165019 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f17c0005510 con 0x55da46756a00 2023-09-13T09:55:36.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.141+0000 7f17dee3ab80 10 client.28979 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.141+0000 7f17dee3ab80 10 client.28979 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.141+0000 7f17dee3ab80 20 client.28979 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.141+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da4676bd20 0x55da4676e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.141+0000 7f17dee3ab80 4 client.28979 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.141+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da466a1970 con 0x55da4676bd20 2023-09-13T09:55:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.142+0000 7f17cbfff700 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da4676bd20 0x55da4676e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.142+0000 7f17abfff700 10 client.28979 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:36.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.142+0000 7f17cbfff700 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da4676bd20 0x55da4676e140 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f8a1488e66cbeaa server_cookie=5bfada13f41db16 in_seq=0 out_seq=0 2023-09-13T09:55:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17abfff700 1 -- 172.21.15.6:0/3244165019 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55da466a1970 con 0x55da4676bd20 2023-09-13T09:55:36.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17abfff700 10 client.28979 handle_command_reply: tid=0 2023-09-13T09:55:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 client.28979 shutdown 2023-09-13T09:55:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46756a00 msgr2=0x55da4675fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46756a00 0x55da4675fed0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f17c0009cf0 tx=0x7f17c00047c0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 shutdown_connections 2023-09-13T09:55:36.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da46767450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46756a00 0x55da4675fed0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da4676bd20 0x55da4676e140 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3244165019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46757700 0x55da46760410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17abfff700 0 client.28979 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:36.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 >> 172.21.15.6:0/3244165019 conn(0x55da466b4c80 msgr2=0x55da4674b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 shutdown_connections 2023-09-13T09:55:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.149+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3244165019 wait complete. 2023-09-13T09:55:36.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.150+0000 7f17dee3ab80 20 client.28979 trim_cache size 0 max 16384 2023-09-13T09:55:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.168+0000 7f17dee3ab80 1 Processor -- start 2023-09-13T09:55:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.168+0000 7f17dee3ab80 1 -- start start 2023-09-13T09:55:36.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.168+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da467564c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.168+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46757700 0x55da46767410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46758060 0x55da4675a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da46752730 con 0x55da46756a00 2023-09-13T09:55:36.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da4675b480 con 0x55da46758060 2023-09-13T09:55:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da46752970 con 0x55da46757700 2023-09-13T09:55:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46757700 0x55da46767410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17d11f2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46758060 0x55da4675a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46757700 0x55da46767410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46876/0 (socket says 172.21.15.6:46876) 2023-09-13T09:55:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17d11f2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46758060 0x55da4675a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37348/0 (socket says 172.21.15.6:37348) 2023-09-13T09:55:36.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 -- 172.21.15.6:0/1840128446 learned_addr learned my addr 172.21.15.6:0/1840128446 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17d09f1700 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da467564c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 -- 172.21.15.6:0/1840128446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46758060 msgr2=0x55da4675a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46758060 0x55da4675a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 -- 172.21.15.6:0/1840128446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 msgr2=0x55da467564c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da467564c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17cbfff700 1 -- 172.21.15.6:0/1840128446 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da464d4de0 con 0x55da46757700 2023-09-13T09:55:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.169+0000 7f17d09f1700 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da467564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:36.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.170+0000 7f17cbfff700 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46757700 0x55da46767410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f17b80099c0 tx=0x7f17b8005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17025007d59f9391 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.172+0000 7f17b77fe700 1 -- 172.21.15.6:0/1840128446 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8005940 con 0x55da46757700 2023-09-13T09:55:36.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.172+0000 7f17b77fe700 1 -- 172.21.15.6:0/1840128446 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17b801bcc0 con 0x55da46757700 2023-09-13T09:55:36.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.172+0000 7f17b77fe700 1 -- 172.21.15.6:0/1840128446 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8003e70 con 0x55da46757700 2023-09-13T09:55:36.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 -- 172.21.15.6:0/1840128446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46757700 msgr2=0x55da46767410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46757700 0x55da46767410 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f17b80099c0 tx=0x7f17b8005fb0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 -- 172.21.15.6:0/1840128446 shutdown_connections 2023-09-13T09:55:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46758060 0x55da4675a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da467564c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/1840128446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46757700 0x55da46767410 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 -- 172.21.15.6:0/1840128446 >> 172.21.15.6:0/1840128446 conn(0x55da466b4c80 msgr2=0x55da4675eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 -- 172.21.15.6:0/1840128446 shutdown_connections 2023-09-13T09:55:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 -- 172.21.15.6:0/1840128446 wait complete. 2023-09-13T09:55:36.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.173+0000 7f17dee3ab80 1 -- start start 2023-09-13T09:55:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 1 Processor -- start 2023-09-13T09:55:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da46766e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46767370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da467638f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da46764000 con 0x55da46756a00 2023-09-13T09:55:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da46764170 con 0x55da46757700 2023-09-13T09:55:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da46764330 con 0x55da46758060 2023-09-13T09:55:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17dee3ab80 10 client.0 _ll_register_callbacks cb 0x55da46644680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:36.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46767370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17cbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46767370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37352/0 (socket says 172.21.15.6:37352) 2023-09-13T09:55:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.174+0000 7f17cbfff700 1 -- 172.21.15.6:0/3884508350 learned_addr learned my addr 172.21.15.6:0/3884508350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17d11f2700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da467638f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17d09f1700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da46766e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17cbfff700 1 -- 172.21.15.6:0/3884508350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 msgr2=0x55da467638f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17cbfff700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da467638f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17cbfff700 1 -- 172.21.15.6:0/3884508350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 msgr2=0x55da46766e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17cbfff700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da46766e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17cbfff700 1 -- 172.21.15.6:0/3884508350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da46528630 con 0x55da46757700 2023-09-13T09:55:36.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17d09f1700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da46766e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17cbfff700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46767370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f17b800a010 tx=0x7f17b80059f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4365d6b0984dac40 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17abfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:55:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17abfff700 1 -- 172.21.15.6:0/3884508350 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b8003db0 con 0x55da46757700 2023-09-13T09:55:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17b8022040 con 0x55da46757700 2023-09-13T09:55:36.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.175+0000 7f17abfff700 1 -- 172.21.15.6:0/3884508350 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f17b801b800 con 0x55da46757700 2023-09-13T09:55:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17abfff700 1 -- 172.21.15.6:0/3884508350 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17b8003890 con 0x55da46757700 2023-09-13T09:55:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 10 client.28985 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55da464bdc60 con 0x55da46757700 2023-09-13T09:55:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17abfff700 1 -- 172.21.15.6:0/3884508350 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f17b8022040 con 0x55da46757700 2023-09-13T09:55:36.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17abfff700 1 -- 172.21.15.6:0/3884508350 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f17b803ad00 con 0x55da46757700 2023-09-13T09:55:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 10 client.28985 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 10 client.28985 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 20 client.28985 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da467c0c70 0x55da467c3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 4 client.28985 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:55:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55da46662050 con 0x55da467c0c70 2023-09-13T09:55:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.176+0000 7f17d09f1700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da467c0c70 0x55da467c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.177+0000 7f17d09f1700 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da467c0c70 0x55da467c3060 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e189a81622d191d7 server_cookie=5aed31e9291c4ddd in_seq=0 out_seq=0 2023-09-13T09:55:36.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.177+0000 7f17abfff700 10 client.28985 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17abfff700 1 -- 172.21.15.6:0/3884508350 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55da46662050 con 0x55da467c0c70 2023-09-13T09:55:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17abfff700 10 client.28985 handle_command_reply: tid=0 2023-09-13T09:55:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 client.28985 shutdown 2023-09-13T09:55:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 msgr2=0x55da46767370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46767370 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f17b800a010 tx=0x7f17b80059f0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 shutdown_connections 2023-09-13T09:55:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55da46758060 0x55da467638f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55da467c0c70 0x55da467c3060 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55da46756a00 0x55da46766e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17abfff700 0 client.28985 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 --2- 172.21.15.6:0/3884508350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55da46757700 0x55da46767370 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 >> 172.21.15.6:0/3884508350 conn(0x55da466b4c80 msgr2=0x55da4675a920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 shutdown_connections 2023-09-13T09:55:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 1 -- 172.21.15.6:0/3884508350 wait complete. 2023-09-13T09:55:36.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.179+0000 7f17dee3ab80 20 client.28985 trim_cache size 0 max 16384 2023-09-13T09:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:55:36.194 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:55:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17bc0a06c0 msgr2=0x7f17bc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17bc0a06c0 0x7f17bc0a2b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f17c0005950 tx=0x7f17c0009260 comp rx=0 tx=0).stop 2023-09-13T09:55:36.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 msgr2=0x7f17cc19dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc19dde0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f17c400efc0 tx=0x7f17c400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 shutdown_connections 2023-09-13T09:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f17bc0a06c0 0x7f17bc0a2b80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17cc101850 0x7f17cc19dde0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f17cc0ffcc0 0x7f17cc068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 --2- 172.21.15.6:0/1410770216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17cc100eb0 0x7f17cc19b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 >> 172.21.15.6:0/1410770216 conn(0x7f17cc0fb250 msgr2=0x7f17cc0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 shutdown_connections 2023-09-13T09:55:36.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.180+0000 7f17d2c55700 1 -- 172.21.15.6:0/1410770216 wait complete. 2023-09-13T09:55:36.198 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:55:36.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:55:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 -- 172.21.15.6:0/2250993518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 msgr2=0x7f81081000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 --2- 172.21.15.6:0/2250993518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f81081000b0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f81040099c0 tx=0x7f8104009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 -- 172.21.15.6:0/2250993518 shutdown_connections 2023-09-13T09:55:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 --2- 172.21.15.6:0/2250993518 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8108101820 0x7f81081080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 --2- 172.21.15.6:0/2250993518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f81081000b0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 --2- 172.21.15.6:0/2250993518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8108100e80 0x7f81081012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 -- 172.21.15.6:0/2250993518 >> 172.21.15.6:0/2250993518 conn(0x7f81080fb220 msgr2=0x7f81080fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 -- 172.21.15.6:0/2250993518 shutdown_connections 2023-09-13T09:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.346+0000 7f810f83a700 1 -- 172.21.15.6:0/2250993518 wait complete. 2023-09-13T09:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 Processor -- start 2023-09-13T09:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 -- start start 2023-09-13T09:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f8108195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8108100e80 0x7f8108195e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8108101820 0x7f810819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810819d4c0 con 0x7f81080ffc90 2023-09-13T09:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810819d600 con 0x7f8108101820 2023-09-13T09:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810f83a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810819d790 con 0x7f8108100e80 2023-09-13T09:55:36.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810d5d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f8108195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810d5d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f8108195940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43840/0 (socket says 172.21.15.6:43840) 2023-09-13T09:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810d5d6700 1 -- 172.21.15.6:0/4114816363 learned_addr learned my addr 172.21.15.6:0/4114816363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810ddd7700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8108101820 0x7f810819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810d5d6700 1 -- 172.21.15.6:0/4114816363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8108100e80 msgr2=0x7f8108195e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810cdd5700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8108100e80 0x7f8108195e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810d5d6700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8108100e80 0x7f8108195e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810d5d6700 1 -- 172.21.15.6:0/4114816363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8108101820 msgr2=0x7f810819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.347+0000 7f810d5d6700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8108101820 0x7f810819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f810d5d6700 1 -- 172.21.15.6:0/4114816363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040095f0 con 0x7f81080ffc90 2023-09-13T09:55:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f810cdd5700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8108100e80 0x7f8108195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:55:36.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f810d5d6700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f8108195940 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f8104009990 tx=0x7f8104004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f80fe7fc700 1 -- 172.21.15.6:0/4114816363 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810401d070 con 0x7f81080ffc90 2023-09-13T09:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810819da10 con 0x7f81080ffc90 2023-09-13T09:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f80fe7fc700 1 -- 172.21.15.6:0/4114816363 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8104004090 con 0x7f81080ffc90 2023-09-13T09:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f80fe7fc700 1 -- 172.21.15.6:0/4114816363 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104022d00 con 0x7f81080ffc90 2023-09-13T09:55:36.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.348+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810819dec0 con 0x7f81080ffc90 2023-09-13T09:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.349+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8108106c10 con 0x7f81080ffc90 2023-09-13T09:55:36.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.350+0000 7f80fe7fc700 1 -- 172.21.15.6:0/4114816363 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8104022470 con 0x7f81080ffc90 2023-09-13T09:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.350+0000 7f80fe7fc700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80f40a0640 0x7f80f40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.351+0000 7f810cdd5700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80f40a0640 0x7f80f40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.351+0000 7f80fe7fc700 1 -- 172.21.15.6:0/4114816363 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f81040cce30 con 0x7f81080ffc90 2023-09-13T09:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.351+0000 7f810cdd5700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80f40a0640 0x7f80f40a2b00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f80f8005fd0 tx=0x7f80f8005dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.355+0000 7f80fe7fc700 1 -- 172.21.15.6:0/4114816363 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f81040969a0 con 0x7f81080ffc90 2023-09-13T09:55:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:36 smithi006 ceph-mon[98665]: pgmap v782: 97 pgs: 97 active+clean; 951 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 716 op/s 2023-09-13T09:55:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:36 smithi053 ceph-mon[102373]: pgmap v782: 97 pgs: 97 active+clean; 951 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 716 op/s 2023-09-13T09:55:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:36 smithi131 ceph-mon[102785]: pgmap v782: 97 pgs: 97 active+clean; 951 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 716 op/s 2023-09-13T09:55:36.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 126730 38.59 MB/sec execute 56 sec latency 104.335 ms 2023-09-13T09:55:36.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.638+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f810810b4a0 con 0x7f81080ffc90 2023-09-13T09:55:36.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.639+0000 7f80fe7fc700 1 -- 172.21.15.6:0/4114816363 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+11347 (secure 0 0 0) 0x7f8104022e60 con 0x7f81080ffc90 2023-09-13T09:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:55:36.640 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":57,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":57,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:55:34.079029+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:55:36.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80f40a0640 msgr2=0x7f80f40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80f40a0640 0x7f80f40a2b00 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f80f8005fd0 tx=0x7f80f8005dc0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 msgr2=0x7f8108195940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f8108195940 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f8104009990 tx=0x7f8104004730 comp rx=0 tx=0).stop 2023-09-13T09:55:36.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 shutdown_connections 2023-09-13T09:55:36.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8108101820 0x7f810819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80f40a0640 0x7f80f40a2b00 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81080ffc90 0x7f8108195940 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 --2- 172.21.15.6:0/4114816363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8108100e80 0x7f8108195e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 >> 172.21.15.6:0/4114816363 conn(0x7f81080fb220 msgr2=0x7f81080fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 shutdown_connections 2023-09-13T09:55:36.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.641+0000 7f810f83a700 1 -- 172.21.15.6:0/4114816363 wait complete. 2023-09-13T09:55:36.645 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 57 2023-09-13T09:55:36.656 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:55:36.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 -- 172.21.15.6:0/1426754654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c1018b0 msgr2=0x7f748c108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 --2- 172.21.15.6:0/1426754654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c1018b0 0x7f748c108140 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f748400b0a0 tx=0x7f748400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 -- 172.21.15.6:0/1426754654 shutdown_connections 2023-09-13T09:55:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 --2- 172.21.15.6:0/1426754654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c1018b0 0x7f748c108140 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 --2- 172.21.15.6:0/1426754654 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f748c1001e0 0x7f748c100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 --2- 172.21.15.6:0/1426754654 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f748c100ef0 0x7f748c101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 -- 172.21.15.6:0/1426754654 >> 172.21.15.6:0/1426754654 conn(0x7f748c0fa990 msgr2=0x7f748c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 -- 172.21.15.6:0/1426754654 shutdown_connections 2023-09-13T09:55:36.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.812+0000 7f7493d42700 1 -- 172.21.15.6:0/1426754654 wait complete. 2023-09-13T09:55:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 Processor -- start 2023-09-13T09:55:36.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 -- start start 2023-09-13T09:55:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f748c1001e0 0x7f748c196c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c100ef0 0x7f748c197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f748c1018b0 0x7f748c19e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c19e780 con 0x7f748c100ef0 2023-09-13T09:55:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c19e8f0 con 0x7f748c1001e0 2023-09-13T09:55:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7493d42700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f748c19eab0 con 0x7f748c1018b0 2023-09-13T09:55:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f74912dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c100ef0 0x7f748c197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7491ade700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f748c1001e0 0x7f748c196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f74912dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c100ef0 0x7f748c197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43856/0 (socket says 172.21.15.6:43856) 2023-09-13T09:55:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f74912dd700 1 -- 172.21.15.6:0/3114836220 learned_addr learned my addr 172.21.15.6:0/3114836220 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f7491ade700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f748c1001e0 0x7f748c196c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37378/0 (socket says 172.21.15.6:37378) 2023-09-13T09:55:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.813+0000 7f74922df700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f748c1018b0 0x7f748c19e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f74912dd700 1 -- 172.21.15.6:0/3114836220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f748c1018b0 msgr2=0x7f748c19e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f74912dd700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f748c1018b0 0x7f748c19e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f74912dd700 1 -- 172.21.15.6:0/3114836220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f748c1001e0 msgr2=0x7f748c196c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f74912dd700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f748c1001e0 0x7f748c196c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f74912dd700 1 -- 172.21.15.6:0/3114836220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7484009d00 con 0x7f748c100ef0 2023-09-13T09:55:36.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f74912dd700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c100ef0 0x7f748c197180 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f747c00e950 tx=0x7f747c00ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f7482ffd700 1 -- 172.21.15.6:0/3114836220 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c009770 con 0x7f748c100ef0 2023-09-13T09:55:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f7482ffd700 1 -- 172.21.15.6:0/3114836220 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f747c00c7e0 con 0x7f748c100ef0 2023-09-13T09:55:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f748c19ed90 con 0x7f748c100ef0 2023-09-13T09:55:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f7482ffd700 1 -- 172.21.15.6:0/3114836220 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f747c003cf0 con 0x7f748c100ef0 2023-09-13T09:55:36.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.814+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748c19f1e0 con 0x7f748c100ef0 2023-09-13T09:55:36.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.817+0000 7f7482ffd700 1 -- 172.21.15.6:0/3114836220 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f747c00c950 con 0x7f748c100ef0 2023-09-13T09:55:36.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.817+0000 7f7482ffd700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74780a0790 0x7f74780a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.817+0000 7f7482ffd700 1 -- 172.21.15.6:0/3114836220 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f747c014070 con 0x7f748c100ef0 2023-09-13T09:55:36.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.818+0000 7f7491ade700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74780a0790 0x7f74780a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.818+0000 7f7491ade700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74780a0790 0x7f74780a2c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f748c198110 tx=0x7f7488009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.818+0000 7f749ff27b80 1 Processor -- start 2023-09-13T09:55:36.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f749ff27b80 1 -- start start 2023-09-13T09:55:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cd700 0x55d4e17cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 0x55d4e17cce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f749ff27b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e1725780 con 0x55d4e17cd700 2023-09-13T09:55:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f749ff27b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e17230a0 con 0x55d4e17ce060 2023-09-13T09:55:36.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f749ff27b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e171e990 con 0x55d4e17cca00 2023-09-13T09:55:36.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f7491ade700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cd700 0x55d4e17cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f7491ade700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cd700 0x55d4e17cdb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43862/0 (socket says 172.21.15.6:43862) 2023-09-13T09:55:36.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f7491ade700 1 -- 172.21.15.6:0/1661277644 learned_addr learned my addr 172.21.15.6:0/1661277644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f74912dd700 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f74922df700 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 0x55d4e17cce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f7491ade700 1 -- 172.21.15.6:0/1661277644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 msgr2=0x55d4e17cce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f7491ade700 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 0x55d4e17cce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f7491ade700 1 -- 172.21.15.6:0/1661277644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 msgr2=0x55d4e17cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.819+0000 7f7491ade700 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.820+0000 7f7491ade700 1 -- 172.21.15.6:0/1661277644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4e159e630 con 0x55d4e17cd700 2023-09-13T09:55:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.820+0000 7f7491ade700 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cd700 0x55d4e17cdb20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f748800e9d0 tx=0x7f7488011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f43063fb594ab59 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.820+0000 7f7477fff700 1 -- 172.21.15.6:0/1661277644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748800ee90 con 0x55d4e17cd700 2023-09-13T09:55:36.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.820+0000 7f7477fff700 1 -- 172.21.15.6:0/1661277644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7488015940 con 0x55d4e17cd700 2023-09-13T09:55:36.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.820+0000 7f7477fff700 1 -- 172.21.15.6:0/1661277644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488013970 con 0x55d4e17cd700 2023-09-13T09:55:36.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 -- 172.21.15.6:0/1661277644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cd700 msgr2=0x55d4e17cdb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cd700 0x55d4e17cdb20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f748800e9d0 tx=0x7f7488011000 comp rx=0 tx=0).stop 2023-09-13T09:55:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 -- 172.21.15.6:0/1661277644 shutdown_connections 2023-09-13T09:55:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 0x55d4e17cce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cd700 0x55d4e17cdb20 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 --2- 172.21.15.6:0/1661277644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 -- 172.21.15.6:0/1661277644 >> 172.21.15.6:0/1661277644 conn(0x55d4e172ac80 msgr2=0x55d4e17c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 -- 172.21.15.6:0/1661277644 shutdown_connections 2023-09-13T09:55:36.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 -- 172.21.15.6:0/1661277644 wait complete. 2023-09-13T09:55:36.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 -- start start 2023-09-13T09:55:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.821+0000 7f749ff27b80 1 Processor -- start 2023-09-13T09:55:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17d5f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17d6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f749ff27b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e16bcbb0 con 0x55d4e17cca00 2023-09-13T09:55:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f749ff27b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e16bc8b0 con 0x55d4e17ce060 2023-09-13T09:55:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f749ff27b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e15a0920 con 0x55d4e17cd700 2023-09-13T09:55:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f749ff27b80 10 client.0 _ll_register_callbacks cb 0x55d4e16ba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17d5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17d5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43868/0 (socket says 172.21.15.6:43868) 2023-09-13T09:55:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 -- 172.21.15.6:0/2098024052 learned_addr learned my addr 172.21.15.6:0/2098024052 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f74912dd700 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17d6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f74922df700 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 -- 172.21.15.6:0/2098024052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 msgr2=0x55d4e17d6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17d6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 -- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 msgr2=0x55d4e17dd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 -- 172.21.15.6:0/2098024052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f748800e6b0 con 0x55d4e17cca00 2023-09-13T09:55:36.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.822+0000 7f7491ade700 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17d5f00 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7488004790 tx=0x7f748800ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ce8f2c64f9282a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f74757fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:36.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f74757fa700 1 -- 172.21.15.6:0/2098024052 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748802b990 con 0x55d4e17cca00 2023-09-13T09:55:36.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4e17bf670 con 0x55d4e17cca00 2023-09-13T09:55:36.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f74757fa700 1 -- 172.21.15.6:0/2098024052 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f748802baf0 con 0x55d4e17cca00 2023-09-13T09:55:36.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f74757fa700 1 -- 172.21.15.6:0/2098024052 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f748802bcb0 con 0x55d4e17cca00 2023-09-13T09:55:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 10 client.19665 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55d4e17367a0 con 0x55d4e17cca00 2023-09-13T09:55:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f74757fa700 1 -- 172.21.15.6:0/2098024052 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d4e17bf670 con 0x55d4e17cca00 2023-09-13T09:55:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f74757fa700 1 -- 172.21.15.6:0/2098024052 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f7488033030 con 0x55d4e17cca00 2023-09-13T09:55:36.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 10 client.19665 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 10 client.19665 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:55:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 20 client.19665 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e17e1c60 0x55d4e17e4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 4 client.19665 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.823+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4e1717970 con 0x55d4e17e1c60 2023-09-13T09:55:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.824+0000 7f74912dd700 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e17e1c60 0x55d4e17e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.824+0000 7f74757fa700 10 client.19665 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:36.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.824+0000 7f74912dd700 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e17e1c60 0x55d4e17e4080 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=30054070117ea4ee server_cookie=854ac51e4a7da8f0 in_seq=0 out_seq=0 2023-09-13T09:55:36.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.829+0000 7f74757fa700 1 -- 172.21.15.6:0/2098024052 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d4e1717970 con 0x55d4e17e1c60 2023-09-13T09:55:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.829+0000 7f74757fa700 10 client.19665 handle_command_reply: tid=0 2023-09-13T09:55:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.829+0000 7f749ff27b80 1 client.19665 shutdown 2023-09-13T09:55:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.829+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 msgr2=0x55d4e17d5f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.829+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17d5f00 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f7488004790 tx=0x7f748800ff30 comp rx=0 tx=0).stop 2023-09-13T09:55:36.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 shutdown_connections 2023-09-13T09:55:36.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e17e1c60 0x55d4e17e4080 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f74757fa700 0 client.19665 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:36.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17d5f00 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2098024052 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17d6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 >> 172.21.15.6:0/2098024052 conn(0x55d4e172ac80 msgr2=0x55d4e17c17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 shutdown_connections 2023-09-13T09:55:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 1 -- 172.21.15.6:0/2098024052 wait complete. 2023-09-13T09:55:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.830+0000 7f749ff27b80 20 client.19665 trim_cache size 0 max 16384 2023-09-13T09:55:36.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.844+0000 7f749ff27b80 1 Processor -- start 2023-09-13T09:55:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.844+0000 7f749ff27b80 1 -- start start 2023-09-13T09:55:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17e4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f749ff27b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e17d4610 con 0x55d4e17cca00 2023-09-13T09:55:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f749ff27b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e17d1420 con 0x55d4e17ce060 2023-09-13T09:55:36.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f749ff27b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e17e1960 con 0x55d4e17cd700 2023-09-13T09:55:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43876/0 (socket says 172.21.15.6:43876) 2023-09-13T09:55:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 -- 172.21.15.6:0/2685980675 learned_addr learned my addr 172.21.15.6:0/2685980675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f74922df700 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f74912dd700 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17e4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 -- 172.21.15.6:0/2685980675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 msgr2=0x55d4e17e4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17e4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 -- 172.21.15.6:0/2685980675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 msgr2=0x55d4e17dd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 -- 172.21.15.6:0/2685980675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4e154ade0 con 0x55d4e17cca00 2023-09-13T09:55:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7491ade700 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17cc4c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f748803f830 tx=0x7f748803f860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bec6fe7efa0796 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7480ff9700 1 -- 172.21.15.6:0/2685980675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488009730 con 0x55d4e17cca00 2023-09-13T09:55:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7480ff9700 1 -- 172.21.15.6:0/2685980675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f748802f070 con 0x55d4e17cca00 2023-09-13T09:55:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.845+0000 7f7480ff9700 1 -- 172.21.15.6:0/2685980675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7488013600 con 0x55d4e17cca00 2023-09-13T09:55:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 -- 172.21.15.6:0/2685980675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 msgr2=0x55d4e17cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17cc4c0 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f748803f830 tx=0x7f748803f860 comp rx=0 tx=0).stop 2023-09-13T09:55:36.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 -- 172.21.15.6:0/2685980675 shutdown_connections 2023-09-13T09:55:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17ce060 0x55d4e17dd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17cca00 0x55d4e17cc4c0 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 --2- 172.21.15.6:0/2685980675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cd700 0x55d4e17e4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 -- 172.21.15.6:0/2685980675 >> 172.21.15.6:0/2685980675 conn(0x55d4e172ac80 msgr2=0x55d4e17d4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 -- 172.21.15.6:0/2685980675 shutdown_connections 2023-09-13T09:55:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.846+0000 7f749ff27b80 1 -- 172.21.15.6:0/2685980675 wait complete. 2023-09-13T09:55:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 -- start start 2023-09-13T09:55:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 Processor -- start 2023-09-13T09:55:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 0x55d4e17d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17cd700 0x55d4e17d9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17ce060 0x55d4e17dc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e17dc770 con 0x55d4e17ce060 2023-09-13T09:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e17dc8e0 con 0x55d4e17cd700 2023-09-13T09:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4e17dcaa0 con 0x55d4e17cca00 2023-09-13T09:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f749ff27b80 10 client.0 _ll_register_callbacks cb 0x55d4e16ba680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:36.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f74922df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17ce060 0x55d4e17dc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f74922df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17ce060 0x55d4e17dc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43886/0 (socket says 172.21.15.6:43886) 2023-09-13T09:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f74922df700 1 -- 172.21.15.6:0/19172727 learned_addr learned my addr 172.21.15.6:0/19172727 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.847+0000 7f74912dd700 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17cd700 0x55d4e17d9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74922df700 1 -- 172.21.15.6:0/19172727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 msgr2=0x55d4e17d8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74922df700 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 0x55d4e17d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74922df700 1 -- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17cd700 msgr2=0x55d4e17d9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74922df700 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17cd700 0x55d4e17d9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74922df700 1 -- 172.21.15.6:0/19172727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4e17367a0 con 0x55d4e17ce060 2023-09-13T09:55:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74912dd700 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17cd700 0x55d4e17d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:36.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74922df700 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17ce060 0x55d4e17dc230 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f748400d010 tx=0x7f748400bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a81813a2e921051 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74757fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74757fa700 1 -- 172.21.15.6:0/19172727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484022040 con 0x55d4e17ce060 2023-09-13T09:55:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74757fa700 1 -- 172.21.15.6:0/19172727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7484005240 con 0x55d4e17ce060 2023-09-13T09:55:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7488015940 con 0x55d4e17ce060 2023-09-13T09:55:36.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f74757fa700 1 -- 172.21.15.6:0/19172727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f748400e040 con 0x55d4e17ce060 2023-09-13T09:55:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f749ff27b80 10 client.19671 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.848+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55d4e1533c60 con 0x55d4e17ce060 2023-09-13T09:55:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f74757fa700 1 -- 172.21.15.6:0/19172727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7488015940 con 0x55d4e17ce060 2023-09-13T09:55:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f74757fa700 1 -- 172.21.15.6:0/19172727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f748400b0d0 con 0x55d4e17ce060 2023-09-13T09:55:36.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f749ff27b80 10 client.19671 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f749ff27b80 10 client.19671 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:55:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f749ff27b80 20 client.19671 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f749ff27b80 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e1836650 0x55d4e1838a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f749ff27b80 4 client.19671 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:36.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.849+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d4e16d8050 con 0x55d4e1836650 2023-09-13T09:55:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.850+0000 7f7491ade700 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e1836650 0x55d4e1838a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.850+0000 7f74757fa700 10 client.19671 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:36.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.850+0000 7f7491ade700 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e1836650 0x55d4e1838a70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=de778804792b137c server_cookie=987d741ec6b1d5ec in_seq=0 out_seq=0 2023-09-13T09:55:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.854+0000 7f74757fa700 1 -- 172.21.15.6:0/19172727 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d4e16d8050 con 0x55d4e1836650 2023-09-13T09:55:36.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.854+0000 7f74757fa700 10 client.19671 handle_command_reply: tid=0 2023-09-13T09:55:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 client.19671 shutdown 2023-09-13T09:55:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17ce060 msgr2=0x55d4e17dc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17ce060 0x55d4e17dc230 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f748400d010 tx=0x7f748400bcf0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 shutdown_connections 2023-09-13T09:55:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55d4e1836650 0x55d4e1838a70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d4e17ce060 0x55d4e17dc230 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f74757fa700 0 client.19671 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:55:36.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d4e17cca00 0x55d4e17d8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 --2- 172.21.15.6:0/19172727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d4e17cd700 0x55d4e17d9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 >> 172.21.15.6:0/19172727 conn(0x55d4e172ac80 msgr2=0x55d4e17d3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 shutdown_connections 2023-09-13T09:55:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 1 -- 172.21.15.6:0/19172727 wait complete. 2023-09-13T09:55:36.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f749ff27b80 20 client.19671 trim_cache size 0 max 16384 2023-09-13T09:55:36.876 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74780a0790 msgr2=0x7f74780a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f7493d42700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74780a0790 0x7f74780a2c50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f748c198110 tx=0x7f7488009190 comp rx=0 tx=0).stop 2023-09-13T09:55:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c100ef0 msgr2=0x7f748c197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.855+0000 7f7493d42700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c100ef0 0x7f748c197180 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f747c00e950 tx=0x7f747c00ec60 comp rx=0 tx=0).stop 2023-09-13T09:55:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 shutdown_connections 2023-09-13T09:55:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f748c1018b0 0x7f748c19e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f748c1001e0 0x7f748c196c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74780a0790 0x7f74780a2c50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 --2- 172.21.15.6:0/3114836220 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f748c100ef0 0x7f748c197180 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 >> 172.21.15.6:0/3114836220 conn(0x7f748c0fa990 msgr2=0x7f748c0fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 shutdown_connections 2023-09-13T09:55:36.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:36.856+0000 7f7493d42700 1 -- 172.21.15.6:0/3114836220 wait complete. 2023-09-13T09:55:36.880 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:55:37.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.064+0000 7fd0fc038700 1 -- 172.21.15.6:0/308776340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4101850 msgr2=0x7fd0f4108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.064+0000 7fd0fc038700 1 --2- 172.21.15.6:0/308776340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4101850 0x7fd0f4108100 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec01c100 tx=0x7fd0ec01c410 comp rx=0 tx=0).stop 2023-09-13T09:55:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.074+0000 7fd0fc038700 1 -- 172.21.15.6:0/308776340 shutdown_connections 2023-09-13T09:55:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.074+0000 7fd0fc038700 1 --2- 172.21.15.6:0/308776340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4101850 0x7fd0f4108100 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.074+0000 7fd0fc038700 1 --2- 172.21.15.6:0/308776340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0f40ffcc0 0x7fd0f41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.074+0000 7fd0fc038700 1 --2- 172.21.15.6:0/308776340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4100eb0 0x7fd0f4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.074+0000 7fd0fc038700 1 -- 172.21.15.6:0/308776340 >> 172.21.15.6:0/308776340 conn(0x7fd0f40fb210 msgr2=0x7fd0f40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.081+0000 7fd0fc038700 1 -- 172.21.15.6:0/308776340 shutdown_connections 2023-09-13T09:55:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.083+0000 7fd0fc038700 1 -- 172.21.15.6:0/308776340 wait complete. 2023-09-13T09:55:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 Processor -- start 2023-09-13T09:55:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 -- start start 2023-09-13T09:55:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0f40ffcc0 0x7fd0f4106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4100eb0 0x7fd0f41070f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4101850 0x7fd0f41939e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4107940 con 0x7fd0f40ffcc0 2023-09-13T09:55:37.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f4193f20 con 0x7fd0f4100eb0 2023-09-13T09:55:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.084+0000 7fd0fc038700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0f41940e0 con 0x7fd0f4101850 2023-09-13T09:55:37.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.089+0000 7fd0fa5d5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4101850 0x7fd0f41939e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.089+0000 7fd0fa5d5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4101850 0x7fd0f41939e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:46950/0 (socket says 172.21.15.6:46950) 2023-09-13T09:55:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.089+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/153448935 learned_addr learned my addr 172.21.15.6:0/153448935 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.090+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4100eb0 0x7fd0f41070f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.090+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0f40ffcc0 0x7fd0f4106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.093+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/153448935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4100eb0 msgr2=0x7fd0f41070f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.093+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4100eb0 0x7fd0f41070f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.093+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0f40ffcc0 msgr2=0x7fd0f4106bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.093+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0f40ffcc0 0x7fd0f4106bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.093+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/153448935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0ec01ad10 con 0x7fd0f4101850 2023-09-13T09:55:37.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.102+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4101850 0x7fd0f41939e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec01c0d0 tx=0x7fd0ec004c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.104+0000 7fd0eaffd700 1 -- 172.21.15.6:0/153448935 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec01f040 con 0x7fd0f4101850 2023-09-13T09:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.104+0000 7fd0eaffd700 1 -- 172.21.15.6:0/153448935 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0ec023cc0 con 0x7fd0f4101850 2023-09-13T09:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.104+0000 7fd0eaffd700 1 -- 172.21.15.6:0/153448935 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec02cd90 con 0x7fd0f4101850 2023-09-13T09:55:37.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.104+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0f4194360 con 0x7fd0f4101850 2023-09-13T09:55:37.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.104+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0f4194840 con 0x7fd0f4101850 2023-09-13T09:55:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.110+0000 7fd10821db80 1 Processor -- start 2023-09-13T09:55:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.111+0000 7fd10821db80 1 -- start start 2023-09-13T09:55:37.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.111+0000 7fd10821db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae42700 0x55a09ae42b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.111+0000 7fd10821db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae43060 0x55a09ae414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.111+0000 7fd10821db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae41e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.111+0000 7fd10821db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ad9a780 con 0x55a09ae42700 2023-09-13T09:55:37.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.111+0000 7fd10821db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ad980a0 con 0x55a09ae43060 2023-09-13T09:55:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.111+0000 7fd10821db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ad93990 con 0x55a09ae41a00 2023-09-13T09:55:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.113+0000 7fd0f95d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae42700 0x55a09ae42b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.113+0000 7fd0f95d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae42700 0x55a09ae42b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43902/0 (socket says 172.21.15.6:43902) 2023-09-13T09:55:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.113+0000 7fd0f95d3700 1 -- 172.21.15.6:0/4280037111 learned_addr learned my addr 172.21.15.6:0/4280037111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.114+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae41e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.115+0000 7fd0f95d3700 1 -- 172.21.15.6:0/4280037111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 msgr2=0x55a09ae41e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.115+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae41e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.115+0000 7fd0f95d3700 1 -- 172.21.15.6:0/4280037111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae43060 msgr2=0x55a09ae414c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:55:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.115+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae43060 0x55a09ae414c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.115+0000 7fd0f95d3700 1 -- 172.21.15.6:0/4280037111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09ac13630 con 0x55a09ae42700 2023-09-13T09:55:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.115+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae42700 0x55a09ae42b20 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4007f30 tx=0x7fd0e40071e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d993b45979ff5e0a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.116+0000 7fd0dffff700 1 -- 172.21.15.6:0/4280037111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4039410 con 0x55a09ae42700 2023-09-13T09:55:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.116+0000 7fd0dffff700 1 -- 172.21.15.6:0/4280037111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0e4039a30 con 0x55a09ae42700 2023-09-13T09:55:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.116+0000 7fd0dffff700 1 -- 172.21.15.6:0/4280037111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40376e0 con 0x55a09ae42700 2023-09-13T09:55:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.117+0000 7fd10821db80 1 -- 172.21.15.6:0/4280037111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae42700 msgr2=0x55a09ae42b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.117+0000 7fd10821db80 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae42700 0x55a09ae42b20 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4007f30 tx=0x7fd0e40071e0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.117+0000 7fd10821db80 1 -- 172.21.15.6:0/4280037111 shutdown_connections 2023-09-13T09:55:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.117+0000 7fd10821db80 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae41e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.117+0000 7fd10821db80 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae42700 0x55a09ae42b20 secure :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7fd0e4007f30 tx=0x7fd0e40071e0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.117+0000 7fd10821db80 1 --2- 172.21.15.6:0/4280037111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae43060 0x55a09ae414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.117+0000 7fd10821db80 1 -- 172.21.15.6:0/4280037111 >> 172.21.15.6:0/4280037111 conn(0x55a09ad9fc80 msgr2=0x55a09ae3bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.128+0000 7fd0eaffd700 1 -- 172.21.15.6:0/153448935 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd0ec02c460 con 0x7fd0f4101850 2023-09-13T09:55:37.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.129+0000 7fd0eaffd700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0e00a0840 0x7fd0e00a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.129+0000 7fd0eaffd700 1 -- 172.21.15.6:0/153448935 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd0ec0ccf20 con 0x7fd0f4101850 2023-09-13T09:55:37.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.132+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0e00a0840 0x7fd0e00a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.134+0000 7fd10821db80 1 -- 172.21.15.6:0/4280037111 shutdown_connections 2023-09-13T09:55:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.138+0000 7fd10821db80 1 -- 172.21.15.6:0/4280037111 wait complete. 2023-09-13T09:55:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.138+0000 7fd10821db80 1 -- start start 2023-09-13T09:55:37.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.138+0000 7fd10821db80 1 Processor -- start 2023-09-13T09:55:37.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.139+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0e00a0840 0x7fd0e00a2d00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55a09ae3e030 tx=0x7fd0f0009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd10821db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae4b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd10821db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae50860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd10821db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4bcb0 0x55a09ae52e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd10821db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ad31bb0 con 0x55a09ae4b830 2023-09-13T09:55:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd10821db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ad318b0 con 0x55a09ae4bcb0 2023-09-13T09:55:37.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd10821db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ac15920 con 0x55a09ae41a00 2023-09-13T09:55:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd10821db80 10 client.0 _ll_register_callbacks cb 0x55a09ad2f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd0f95d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae50860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd0f95d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae50860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43912/0 (socket says 172.21.15.6:43912) 2023-09-13T09:55:37.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.151+0000 7fd0f95d3700 1 -- 172.21.15.6:0/2141123300 learned_addr learned my addr 172.21.15.6:0/2141123300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.152+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae4b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4bcb0 0x55a09ae52e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0f95d3700 1 -- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 msgr2=0x55a09ae4b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae4b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0f95d3700 1 -- 172.21.15.6:0/2141123300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4bcb0 msgr2=0x55a09ae52e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4bcb0 0x55a09ae52e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0f95d3700 1 -- 172.21.15.6:0/2141123300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0e4007c10 con 0x55a09ae4b830 2023-09-13T09:55:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae50860 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd0e403b000 tx=0x7fd0e4006e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d8591288218f33 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/2141123300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4004040 con 0x55a09ae4b830 2023-09-13T09:55:37.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.153+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/2141123300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd0e4032040 con 0x55a09ae4b830 2023-09-13T09:55:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.154+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a09ae34670 con 0x55a09ae4b830 2023-09-13T09:55:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.154+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/2141123300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0e40041a0 con 0x55a09ae4b830 2023-09-13T09:55:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.154+0000 7fd10821db80 10 client.19680 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.154+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55a09adab7a0 con 0x55a09ae4b830 2023-09-13T09:55:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.154+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/2141123300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a09ae34670 con 0x55a09ae4b830 2023-09-13T09:55:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.155+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/2141123300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fd0e40362a0 con 0x55a09ae4b830 2023-09-13T09:55:37.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.155+0000 7fd10821db80 10 client.19680 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.155+0000 7fd10821db80 10 client.19680 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:55:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.155+0000 7fd10821db80 20 client.19680 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.155+0000 7fd10821db80 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09ae57750 0x55a09ae59b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.155+0000 7fd10821db80 4 client.19680 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:37.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.155+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a09ad8c970 con 0x55a09ae57750 2023-09-13T09:55:37.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.168+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09ae57750 0x55a09ae59b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.169+0000 7fd0dd7fa700 10 client.19680 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:37.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.169+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09ae57750 0x55a09ae59b70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=551ec5e4da2ac11b server_cookie=76709ded5d5ff0e3 in_seq=0 out_seq=0 2023-09-13T09:55:37.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/2141123300 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a09ad8c970 con 0x55a09ae57750 2023-09-13T09:55:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd0dd7fa700 10 client.19680 handle_command_reply: tid=0 2023-09-13T09:55:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 client.19680 shutdown 2023-09-13T09:55:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 msgr2=0x55a09ae50860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae50860 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fd0e403b000 tx=0x7fd0e4006e10 comp rx=0 tx=0).stop 2023-09-13T09:55:37.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 shutdown_connections 2023-09-13T09:55:37.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09ae57750 0x55a09ae59b70 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4bcb0 0x55a09ae52e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae4b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 --2- 172.21.15.6:0/2141123300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae50860 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.171+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 >> 172.21.15.6:0/2141123300 conn(0x55a09ad9fc80 msgr2=0x55a09ae367f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.172+0000 7fd0dd7fa700 0 client.19680 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.172+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 shutdown_connections 2023-09-13T09:55:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.172+0000 7fd10821db80 1 -- 172.21.15.6:0/2141123300 wait complete. 2023-09-13T09:55:37.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.172+0000 7fd10821db80 20 client.19680 trim_cache size 0 max 16384 2023-09-13T09:55:37.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 Processor -- start 2023-09-13T09:55:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 -- start start 2023-09-13T09:55:37.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae41a00 0x55a09ae414c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae4a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae4bcb0 0x55a09ae50780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ae34670 con 0x55a09ae4b830 2023-09-13T09:55:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ae4c4e0 con 0x55a09ae41a00 2023-09-13T09:55:37.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd10821db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ae3d980 con 0x55a09ae4bcb0 2023-09-13T09:55:37.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd0f9dd4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae41a00 0x55a09ae414c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd0f9dd4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae41a00 0x55a09ae414c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37442/0 (socket says 172.21.15.6:37442) 2023-09-13T09:55:37.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.195+0000 7fd0f9dd4700 1 -- 172.21.15.6:0/2600011721 learned_addr learned my addr 172.21.15.6:0/2600011721 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae4a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae4bcb0 0x55a09ae50780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0f95d3700 1 -- 172.21.15.6:0/2600011721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae4bcb0 msgr2=0x55a09ae50780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae4bcb0 0x55a09ae50780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0f95d3700 1 -- 172.21.15.6:0/2600011721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae41a00 msgr2=0x55a09ae414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae41a00 0x55a09ae414c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0f95d3700 1 -- 172.21.15.6:0/2600011721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a09abbfde0 con 0x55a09ae4b830 2023-09-13T09:55:37.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.196+0000 7fd0f95d3700 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae4a9a0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fd0e403c040 tx=0x7fd0e4036fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f223f89d66a2408a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.200 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:37 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4114816363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:55:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.200+0000 7fd0e8ff9700 1 -- 172.21.15.6:0/2600011721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e40074f0 con 0x55a09ae4b830 2023-09-13T09:55:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.200+0000 7fd0e8ff9700 1 -- 172.21.15.6:0/2600011721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0e4045e40 con 0x55a09ae4b830 2023-09-13T09:55:37.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.200+0000 7fd0e8ff9700 1 -- 172.21.15.6:0/2600011721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0e4003b10 con 0x55a09ae4b830 2023-09-13T09:55:37.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 -- 172.21.15.6:0/2600011721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 msgr2=0x55a09ae4a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae4a9a0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fd0e403c040 tx=0x7fd0e4036fa0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 -- 172.21.15.6:0/2600011721 shutdown_connections 2023-09-13T09:55:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae4bcb0 0x55a09ae50780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae41a00 0x55a09ae414c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 --2- 172.21.15.6:0/2600011721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4b830 0x55a09ae4a9a0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 -- 172.21.15.6:0/2600011721 >> 172.21.15.6:0/2600011721 conn(0x55a09ad9fc80 msgr2=0x55a09ae3be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 -- 172.21.15.6:0/2600011721 shutdown_connections 2023-09-13T09:55:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.201+0000 7fd10821db80 1 -- 172.21.15.6:0/2600011721 wait complete. 2023-09-13T09:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 -- start start 2023-09-13T09:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 Processor -- start 2023-09-13T09:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae47db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4b830 0x55a09ae482f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4bcb0 0x55a09ae4ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ae4f440 con 0x55a09ae4bcb0 2023-09-13T09:55:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ae4f5b0 con 0x55a09ae4b830 2023-09-13T09:55:37.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.202+0000 7fd10821db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a09ae4f770 con 0x55a09ae41a00 2023-09-13T09:55:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd10821db80 10 client.0 _ll_register_callbacks cb 0x55a09ad2f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4bcb0 0x55a09ae4ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4bcb0 0x55a09ae4ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43928/0 (socket says 172.21.15.6:43928) 2023-09-13T09:55:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/3914836938 learned_addr learned my addr 172.21.15.6:0/3914836938 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae47db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 msgr2=0x55a09ae47db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae47db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/3914836938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4b830 msgr2=0x55a09ae482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4b830 0x55a09ae482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 -- 172.21.15.6:0/3914836938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a09adab7a0 con 0x55a09ae4bcb0 2023-09-13T09:55:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0fa5d5700 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4bcb0 0x55a09ae4ef00 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec09a680 tx=0x7fd0ec09a540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970c3652e9569379 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0dd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/3914836938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0ec09adf0 con 0x55a09ae4bcb0 2023-09-13T09:55:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/3914836938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd0ec0cbe40 con 0x55a09ae4bcb0 2023-09-13T09:55:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.203+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0e4039a30 con 0x55a09ae4bcb0 2023-09-13T09:55:37.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/3914836938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0ec09a6f0 con 0x55a09ae4bcb0 2023-09-13T09:55:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 10 client.19686 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55a09aba8c60 con 0x55a09ae4bcb0 2023-09-13T09:55:37.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/3914836938 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd0ec00b020 con 0x55a09ae4bcb0 2023-09-13T09:55:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/3914836938 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fd0ec099be0 con 0x55a09ae4bcb0 2023-09-13T09:55:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 10 client.19686 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 10 client.19686 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:55:37.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 20 client.19686 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09aeab630 0x55a09aeada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 4 client.19686 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.204+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a09ad4d050 con 0x55a09aeab630 2023-09-13T09:55:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.205+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09aeab630 0x55a09aeada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.205+0000 7fd0dd7fa700 10 client.19686 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:37.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.205+0000 7fd0f9dd4700 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09aeab630 0x55a09aeada50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ae9e9cac24080e06 server_cookie=8fa18bd22f413f93 in_seq=0 out_seq=0 2023-09-13T09:55:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd0dd7fa700 1 -- 172.21.15.6:0/3914836938 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a09ad4d050 con 0x55a09aeab630 2023-09-13T09:55:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd0dd7fa700 10 client.19686 handle_command_reply: tid=0 2023-09-13T09:55:37.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 client.19686 shutdown 2023-09-13T09:55:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4bcb0 msgr2=0x55a09ae4ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4bcb0 0x55a09ae4ef00 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec09a680 tx=0x7fd0ec09a540 comp rx=0 tx=0).stop 2023-09-13T09:55:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 shutdown_connections 2023-09-13T09:55:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55a09aeab630 0x55a09aeada50 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a09ae4bcb0 0x55a09ae4ef00 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a09ae41a00 0x55a09ae47db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd0dd7fa700 0 client.19686 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:55:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 --2- 172.21.15.6:0/3914836938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a09ae4b830 0x55a09ae482f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 >> 172.21.15.6:0/3914836938 conn(0x55a09ad9fc80 msgr2=0x55a09ae53930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 shutdown_connections 2023-09-13T09:55:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 1 -- 172.21.15.6:0/3914836938 wait complete. 2023-09-13T09:55:37.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.206+0000 7fd10821db80 20 client.19686 trim_cache size 0 max 16384 2023-09-13T09:55:37.221 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0e00a0840 msgr2=0x7fd0e00a2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0e00a0840 0x7fd0e00a2d00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x55a09ae3e030 tx=0x7fd0f0009190 comp rx=0 tx=0).stop 2023-09-13T09:55:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4101850 msgr2=0x7fd0f41939e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4101850 0x7fd0f41939e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fd0ec01c0d0 tx=0x7fd0ec004c40 comp rx=0 tx=0).stop 2023-09-13T09:55:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 shutdown_connections 2023-09-13T09:55:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0f4101850 0x7fd0f41939e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0e00a0840 0x7fd0e00a2d00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0f40ffcc0 0x7fd0f4106bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 --2- 172.21.15.6:0/153448935 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd0f4100eb0 0x7fd0f41070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 >> 172.21.15.6:0/153448935 conn(0x7fd0f40fb210 msgr2=0x7fd0f40fb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 shutdown_connections 2023-09-13T09:55:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.207+0000 7fd0fc038700 1 -- 172.21.15.6:0/153448935 wait complete. 2023-09-13T09:55:37.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 -- 172.21.15.6:0/2187111160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c100dc0 msgr2=0x7ff78c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 --2- 172.21.15.6:0/2187111160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c100dc0 0x7ff78c1011e0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7ff7880099c0 tx=0x7ff788009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 -- 172.21.15.6:0/2187111160 shutdown_connections 2023-09-13T09:55:37.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 --2- 172.21.15.6:0/2187111160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff78c102950 0x7ff78c109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 --2- 172.21.15.6:0/2187111160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c100dc0 0x7ff78c1011e0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 --2- 172.21.15.6:0/2187111160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff78c101fb0 0x7ff78c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 -- 172.21.15.6:0/2187111160 >> 172.21.15.6:0/2187111160 conn(0x7ff78c0fc350 msgr2=0x7ff78c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 -- 172.21.15.6:0/2187111160 shutdown_connections 2023-09-13T09:55:37.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.373+0000 7ff79352a700 1 -- 172.21.15.6:0/2187111160 wait complete. 2023-09-13T09:55:37.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 Processor -- start 2023-09-13T09:55:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 -- start start 2023-09-13T09:55:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff78c100dc0 0x7ff78c108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff78c101fb0 0x7ff78c1086d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c102950 0x7ff78c1a6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1a6e50 con 0x7ff78c102950 2023-09-13T09:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1a6f90 con 0x7ff78c101fb0 2023-09-13T09:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff79352a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff78c1a7150 con 0x7ff78c100dc0 2023-09-13T09:55:37.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff791ac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c102950 0x7ff78c1a6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff791ac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c102950 0x7ff78c1a6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43942/0 (socket says 172.21.15.6:43942) 2023-09-13T09:55:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff791ac7700 1 -- 172.21.15.6:0/321431829 learned_addr learned my addr 172.21.15.6:0/321431829 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff790ac5700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff78c101fb0 0x7ff78c1086d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.374+0000 7ff7912c6700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff78c100dc0 0x7ff78c108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff791ac7700 1 -- 172.21.15.6:0/321431829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff78c100dc0 msgr2=0x7ff78c108190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff791ac7700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff78c100dc0 0x7ff78c108190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff791ac7700 1 -- 172.21.15.6:0/321431829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff78c101fb0 msgr2=0x7ff78c1086d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff791ac7700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff78c101fb0 0x7ff78c1086d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff791ac7700 1 -- 172.21.15.6:0/321431829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7880095f0 con 0x7ff78c102950 2023-09-13T09:55:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff791ac7700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c102950 0x7ff78c1a6880 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7ff784007ee0 tx=0x7ff78400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff7827fc700 1 -- 172.21.15.6:0/321431829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784017070 con 0x7ff78c102950 2023-09-13T09:55:37.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff7827fc700 1 -- 172.21.15.6:0/321431829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff78400f040 con 0x7ff78c102950 2023-09-13T09:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff7827fc700 1 -- 172.21.15.6:0/321431829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784005580 con 0x7ff78c102950 2023-09-13T09:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff78c1a7430 con 0x7ff78c102950 2023-09-13T09:55:37.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.375+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff78c1a78f0 con 0x7ff78c102950 2023-09-13T09:55:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.378+0000 7ff7827fc700 1 -- 172.21.15.6:0/321431829 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff78400db20 con 0x7ff78c102950 2023-09-13T09:55:37.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.379+0000 7ff7827fc700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7780a0640 0x7ff7780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.379+0000 7ff7827fc700 1 -- 172.21.15.6:0/321431829 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff7840caa70 con 0x7ff78c102950 2023-09-13T09:55:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.379+0000 7ff7912c6700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7780a0640 0x7ff7780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 Processor -- start 2023-09-13T09:55:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 -- start start 2023-09-13T09:55:37.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff7912c6700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7780a0640 0x7ff7780a2b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff78c109710 tx=0x7ff78800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ddb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41de060 0x5625c41dc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41dca00 0x5625c41dce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c4135780 con 0x5625c41dca00 2023-09-13T09:55:37.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c41330a0 con 0x5625c41de060 2023-09-13T09:55:37.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c412e990 con 0x5625c41dd700 2023-09-13T09:55:37.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff791ac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41dca00 0x5625c41dce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff790ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41de060 0x5625c41dc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff790ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41de060 0x5625c41dc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37472/0 (socket says 172.21.15.6:37472) 2023-09-13T09:55:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff7912c6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ddb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff791ac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41dca00 0x5625c41dce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43950/0 (socket says 172.21.15.6:43950) 2023-09-13T09:55:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.380+0000 7ff790ac5700 1 -- 172.21.15.6:0/2457359900 learned_addr learned my addr 172.21.15.6:0/2457359900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.381+0000 7ff790ac5700 1 -- 172.21.15.6:0/2457359900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 msgr2=0x5625c41ddb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.381+0000 7ff790ac5700 1 --2- 172.21.15.6:0/2457359900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ddb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.381+0000 7ff790ac5700 1 -- 172.21.15.6:0/2457359900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41dca00 msgr2=0x5625c41dce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.381+0000 7ff790ac5700 1 --2- 172.21.15.6:0/2457359900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41dca00 0x5625c41dce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.381+0000 7ff790ac5700 1 -- 172.21.15.6:0/2457359900 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625c3fae630 con 0x5625c41de060 2023-09-13T09:55:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.382+0000 7ff790ac5700 1 --2- 172.21.15.6:0/2457359900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41de060 0x5625c41dc4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00bd30 tx=0x7ff77c0106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b85d52d70c74c21 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.382+0000 7ff7777fe700 1 -- 172.21.15.6:0/2457359900 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c010e10 con 0x5625c41de060 2023-09-13T09:55:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.382+0000 7ff7777fe700 1 -- 172.21.15.6:0/2457359900 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff77c015070 con 0x5625c41de060 2023-09-13T09:55:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.382+0000 7ff7777fe700 1 -- 172.21.15.6:0/2457359900 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77c011710 con 0x5625c41de060 2023-09-13T09:55:37.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2457359900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41de060 msgr2=0x5625c41dc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2457359900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41de060 0x5625c41dc4c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff77c00bd30 tx=0x7ff77c0106b0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2457359900 shutdown_connections 2023-09-13T09:55:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2457359900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41dca00 0x5625c41dce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2457359900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ddb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2457359900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41de060 0x5625c41dc4c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2457359900 >> 172.21.15.6:0/2457359900 conn(0x5625c413ac80 msgr2=0x5625c41d6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2457359900 shutdown_connections 2023-09-13T09:55:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.383+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2457359900 wait complete. 2023-09-13T09:55:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 -- start start 2023-09-13T09:55:37.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 Processor -- start 2023-09-13T09:55:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41e5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41e6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41ed4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c40ccbb0 con 0x5625c41de060 2023-09-13T09:55:37.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c40cc8b0 con 0x5625c41dd700 2023-09-13T09:55:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.384+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c3fb0920 con 0x5625c41dca00 2023-09-13T09:55:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff79f70fb80 10 client.0 _ll_register_callbacks cb 0x5625c40ca680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41e5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41e5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47006/0 (socket says 172.21.15.6:47006) 2023-09-13T09:55:37.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 -- 172.21.15.6:0/2985012587 learned_addr learned my addr 172.21.15.6:0/2985012587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff790ac5700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41e6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff791ac7700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41ed4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 -- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 msgr2=0x5625c41e6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41e6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 -- 172.21.15.6:0/2985012587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 msgr2=0x5625c41ed4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41ed4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 -- 172.21.15.6:0/2985012587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77c00b960 con 0x5625c41dca00 2023-09-13T09:55:37.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff7912c6700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41e5f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff7880099c0 tx=0x7ff788009cd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33b0d4626dced33 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff774ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:55:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff774ff9700 1 -- 172.21.15.6:0/2985012587 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff788030e50 con 0x5625c41dca00 2023-09-13T09:55:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625c41cf670 con 0x5625c41dca00 2023-09-13T09:55:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.385+0000 7ff774ff9700 1 -- 172.21.15.6:0/2985012587 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff7880038c0 con 0x5625c41dca00 2023-09-13T09:55:37.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff774ff9700 1 -- 172.21.15.6:0/2985012587 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff788003a80 con 0x5625c41dca00 2023-09-13T09:55:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 10 client.28981 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x5625c41467a0 con 0x5625c41dca00 2023-09-13T09:55:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff774ff9700 1 -- 172.21.15.6:0/2985012587 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5625c41cf670 con 0x5625c41dca00 2023-09-13T09:55:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff790ac5700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:55:37.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff774ff9700 1 -- 172.21.15.6:0/2985012587 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ff78800fa60 con 0x5625c41dca00 2023-09-13T09:55:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 10 client.28981 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 10 client.28981 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:55:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 20 client.28981 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c41f1cd0 0x5625c41f40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 4 client.28981 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.386+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625c4127970 con 0x5625c41f1cd0 2023-09-13T09:55:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.387+0000 7ff790ac5700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c41f1cd0 0x5625c41f40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.387+0000 7ff774ff9700 10 client.28981 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:37.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.387+0000 7ff790ac5700 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c41f1cd0 0x5625c41f40f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c2355c4c71aae9aa server_cookie=5ce9dfa1890baf16 in_seq=0 out_seq=0 2023-09-13T09:55:37.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff774ff9700 1 -- 172.21.15.6:0/2985012587 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5625c4127970 con 0x5625c41f1cd0 2023-09-13T09:55:37.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff774ff9700 10 client.28981 handle_command_reply: tid=0 2023-09-13T09:55:37.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 client.28981 shutdown 2023-09-13T09:55:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 msgr2=0x5625c41e5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41e5f30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff7880099c0 tx=0x7ff788009cd0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 shutdown_connections 2023-09-13T09:55:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c41f1cd0 0x5625c41f40f0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41ed4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41e5f30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff774ff9700 0 client.28981 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/2985012587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41e6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.393+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 >> 172.21.15.6:0/2985012587 conn(0x5625c413ac80 msgr2=0x5625c41d17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.394+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 shutdown_connections 2023-09-13T09:55:37.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.394+0000 7ff79f70fb80 1 -- 172.21.15.6:0/2985012587 wait complete. 2023-09-13T09:55:37.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.395+0000 7ff79f70fb80 20 client.28981 trim_cache size 0 max 16384 2023-09-13T09:55:37.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 Processor -- start 2023-09-13T09:55:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 -- start start 2023-09-13T09:55:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dca00 0x5625c41dc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ed470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41edda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c41e5aa0 con 0x5625c41de060 2023-09-13T09:55:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c41d8fd0 con 0x5625c41dca00 2023-09-13T09:55:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c41e3b50 con 0x5625c41dd700 2023-09-13T09:55:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff791ac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff7912c6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dca00 0x5625c41dc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff791ac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41edda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43964/0 (socket says 172.21.15.6:43964) 2023-09-13T09:55:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff791ac7700 1 -- 172.21.15.6:0/621801068 learned_addr learned my addr 172.21.15.6:0/621801068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.410+0000 7ff790ac5700 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ed470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff791ac7700 1 -- 172.21.15.6:0/621801068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 msgr2=0x5625c41ed470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff791ac7700 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ed470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff791ac7700 1 -- 172.21.15.6:0/621801068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dca00 msgr2=0x5625c41dc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff791ac7700 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dca00 0x5625c41dc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff791ac7700 1 -- 172.21.15.6:0/621801068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625c3f5ade0 con 0x5625c41de060 2023-09-13T09:55:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff790ac5700 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff791ac7700 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41edda0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7ff7840c8520 tx=0x7ff7840ca040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393f0bc9cf428469 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff777fff700 1 -- 172.21.15.6:0/621801068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7840a0280 con 0x5625c41de060 2023-09-13T09:55:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff777fff700 1 -- 172.21.15.6:0/621801068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff784096350 con 0x5625c41de060 2023-09-13T09:55:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.411+0000 7ff777fff700 1 -- 172.21.15.6:0/621801068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff784097700 con 0x5625c41de060 2023-09-13T09:55:37.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 -- 172.21.15.6:0/621801068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 msgr2=0x5625c41edda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41edda0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7ff7840c8520 tx=0x7ff7840ca040 comp rx=0 tx=0).stop 2023-09-13T09:55:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 -- 172.21.15.6:0/621801068 shutdown_connections 2023-09-13T09:55:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41edda0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dca00 0x5625c41dc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/621801068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dd700 0x5625c41ed470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 -- 172.21.15.6:0/621801068 >> 172.21.15.6:0/621801068 conn(0x5625c413ac80 msgr2=0x5625c41e4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 -- 172.21.15.6:0/621801068 shutdown_connections 2023-09-13T09:55:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 -- 172.21.15.6:0/621801068 wait complete. 2023-09-13T09:55:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 -- start start 2023-09-13T09:55:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.412+0000 7ff79f70fb80 1 Processor -- start 2023-09-13T09:55:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41ecc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41ed190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff79f70fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41e96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c41e9c30 con 0x5625c41de060 2023-09-13T09:55:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c41e9da0 con 0x5625c41dd700 2023-09-13T09:55:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff79f70fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625c41e9f60 con 0x5625c41dca00 2023-09-13T09:55:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff79f70fb80 10 client.0 _ll_register_callbacks cb 0x5625c40ca680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff791ac7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41e96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff790ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41ed190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff7912c6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41ecc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff790ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41ed190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37492/0 (socket says 172.21.15.6:37492) 2023-09-13T09:55:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff790ac5700 1 -- 172.21.15.6:0/3375308375 learned_addr learned my addr 172.21.15.6:0/3375308375 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff7912c6700 1 -- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 msgr2=0x5625c41ed190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff7912c6700 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41ed190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff7912c6700 1 -- 172.21.15.6:0/3375308375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 msgr2=0x5625c41e96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff7912c6700 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41e96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff7912c6700 1 -- 172.21.15.6:0/3375308375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625c3fae630 con 0x5625c41dca00 2023-09-13T09:55:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff791ac7700 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff790ac5700 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff7912c6700 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41ecc50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff78800ffb0 tx=0x7ff78800f4e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b01bb27f14757fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.413+0000 7ff774ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff774ff9700 1 -- 172.21.15.6:0/3375308375 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff78800f9a0 con 0x5625c41dca00 2023-09-13T09:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff77c015070 con 0x5625c41dca00 2023-09-13T09:55:37.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff774ff9700 1 -- 172.21.15.6:0/3375308375 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff78800fb00 con 0x5625c41dca00 2023-09-13T09:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff774ff9700 1 -- 172.21.15.6:0/3375308375 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7880038c0 con 0x5625c41dca00 2023-09-13T09:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 10 client.28987 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x7ff78c1a78f0 con 0x5625c41dca00 2023-09-13T09:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff774ff9700 1 -- 172.21.15.6:0/3375308375 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff77c015070 con 0x5625c41dca00 2023-09-13T09:55:37.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff774ff9700 1 -- 172.21.15.6:0/3375308375 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7ff788043680 con 0x5625c41dca00 2023-09-13T09:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 10 client.28987 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 10 client.28987 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 20 client.28987 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c4246d30 0x5625c4249150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 4 client.28987 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:37.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.414+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5625c40e8050 con 0x5625c4246d30 2023-09-13T09:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.415+0000 7ff790ac5700 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c4246d30 0x5625c4249150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.415+0000 7ff774ff9700 10 client.28987 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.415+0000 7ff790ac5700 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c4246d30 0x5625c4249150 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bab9db3794e99144 server_cookie=d895a7212fcbe2d6 in_seq=0 out_seq=0 2023-09-13T09:55:37.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff774ff9700 1 -- 172.21.15.6:0/3375308375 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5625c40e8050 con 0x5625c4246d30 2023-09-13T09:55:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff774ff9700 10 client.28987 handle_command_reply: tid=0 2023-09-13T09:55:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 client.28987 shutdown 2023-09-13T09:55:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 msgr2=0x5625c41ecc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41ecc50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ff78800ffb0 tx=0x7ff78800f4e0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 shutdown_connections 2023-09-13T09:55:37.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5625c4246d30 0x5625c4249150 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5625c41de060 0x5625c41e96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5625c41dca00 0x5625c41ecc50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff774ff9700 0 client.28987 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:55:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 --2- 172.21.15.6:0/3375308375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5625c41dd700 0x5625c41ed190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 >> 172.21.15.6:0/3375308375 conn(0x5625c413ac80 msgr2=0x5625c41e08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 shutdown_connections 2023-09-13T09:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 1 -- 172.21.15.6:0/3375308375 wait complete. 2023-09-13T09:55:37.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.418+0000 7ff79f70fb80 20 client.28987 trim_cache size 0 max 16384 2023-09-13T09:55:37.437 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7780a0640 msgr2=0x7ff7780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7780a0640 0x7ff7780a2b00 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7ff78c109710 tx=0x7ff78800b540 comp rx=0 tx=0).stop 2023-09-13T09:55:37.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c102950 msgr2=0x7ff78c1a6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c102950 0x7ff78c1a6880 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7ff784007ee0 tx=0x7ff78400d3b0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 shutdown_connections 2023-09-13T09:55:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff7780a0640 0x7ff7780a2b00 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff78c102950 0x7ff78c1a6880 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff78c100dc0 0x7ff78c108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 --2- 172.21.15.6:0/321431829 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff78c101fb0 0x7ff78c1086d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 >> 172.21.15.6:0/321431829 conn(0x7ff78c0fc350 msgr2=0x7ff78c0fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 shutdown_connections 2023-09-13T09:55:37.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.419+0000 7ff79352a700 1 -- 172.21.15.6:0/321431829 wait complete. 2023-09-13T09:55:37.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:55:37.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:37 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4114816363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:55:37.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:37 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4114816363' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:55:37.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 127231 38.32 MB/sec execute 57 sec latency 201.664 ms 2023-09-13T09:55:37.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.592+0000 7fd08623f700 1 -- 172.21.15.6:0/1524128896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd080101850 msgr2=0x7fd080108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.592+0000 7fd08623f700 1 --2- 172.21.15.6:0/1524128896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd080101850 0x7fd080108100 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fd07800b0d0 tx=0x7fd07800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 -- 172.21.15.6:0/1524128896 shutdown_connections 2023-09-13T09:55:37.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 --2- 172.21.15.6:0/1524128896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd080101850 0x7fd080108100 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 --2- 172.21.15.6:0/1524128896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0800ffcc0 0x7fd0801000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 --2- 172.21.15.6:0/1524128896 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd080100eb0 0x7fd080101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 -- 172.21.15.6:0/1524128896 >> 172.21.15.6:0/1524128896 conn(0x7fd0800fb250 msgr2=0x7fd0800fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 -- 172.21.15.6:0/1524128896 shutdown_connections 2023-09-13T09:55:37.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 -- 172.21.15.6:0/1524128896 wait complete. 2023-09-13T09:55:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.593+0000 7fd08623f700 1 Processor -- start 2023-09-13T09:55:37.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd08623f700 1 -- start start 2023-09-13T09:55:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd08623f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0800ffcc0 0x7fd08010cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd08623f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd080100eb0 0x7fd08010b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd08623f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd080101850 0x7fd08010b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd08623f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08019aa90 con 0x7fd0800ffcc0 2023-09-13T09:55:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd08623f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08019ac00 con 0x7fd080101850 2023-09-13T09:55:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd08623f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd08019adc0 con 0x7fd080100eb0 2023-09-13T09:55:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0800ffcc0 0x7fd08010cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0800ffcc0 0x7fd08010cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43980/0 (socket says 172.21.15.6:43980) 2023-09-13T09:55:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2040894974 learned_addr learned my addr 172.21.15.6:0/2040894974 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07effd700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd080100eb0 0x7fd08010b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07ffff700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd080101850 0x7fd08010b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2040894974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd080100eb0 msgr2=0x7fd08010b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd080100eb0 0x7fd08010b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2040894974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd080101850 msgr2=0x7fd08010b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd080101850 0x7fd08010b690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.594+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2040894974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd078009d00 con 0x7fd0800ffcc0 2023-09-13T09:55:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.595+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0800ffcc0 0x7fd08010cb10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b500 tx=0x7fd07000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.595+0000 7fd07cff9700 1 -- 172.21.15.6:0/2040894974 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070011830 con 0x7fd0800ffcc0 2023-09-13T09:55:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.595+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd08019b0a0 con 0x7fd0800ffcc0 2023-09-13T09:55:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.595+0000 7fd07cff9700 1 -- 172.21.15.6:0/2040894974 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd070011e50 con 0x7fd0800ffcc0 2023-09-13T09:55:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.595+0000 7fd07cff9700 1 -- 172.21.15.6:0/2040894974 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070010dc0 con 0x7fd0800ffcc0 2023-09-13T09:55:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.595+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd08019b600 con 0x7fd0800ffcc0 2023-09-13T09:55:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.597+0000 7fd07cff9700 1 -- 172.21.15.6:0/2040894974 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd070010380 con 0x7fd0800ffcc0 2023-09-13T09:55:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.598+0000 7fd07cff9700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0680a0640 0x7fd0680a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.598+0000 7fd07cff9700 1 -- 172.21.15.6:0/2040894974 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd0700cb5f0 con 0x7fd0800ffcc0 2023-09-13T09:55:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.598+0000 7fd07effd700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0680a0640 0x7fd0680a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.599+0000 7fd07effd700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0680a0640 0x7fd0680a2b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd074007c60 tx=0x7fd0740073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.599+0000 7fd092424b80 1 Processor -- start 2023-09-13T09:55:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.599+0000 7fd092424b80 1 -- start start 2023-09-13T09:55:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.599+0000 7fd092424b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef6f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.599+0000 7fd092424b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f7060 0x558aef6f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd092424b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 0x558aef6f5e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd092424b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef64e780 con 0x558aef6f7060 2023-09-13T09:55:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd092424b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef64c0a0 con 0x558aef6f6700 2023-09-13T09:55:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd092424b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef647990 con 0x558aef6f5a00 2023-09-13T09:55:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f7060 0x558aef6f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f7060 0x558aef6f54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43990/0 (socket says 172.21.15.6:43990) 2023-09-13T09:55:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 -- 172.21.15.6:0/3576778841 learned_addr learned my addr 172.21.15.6:0/3576778841 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 -- 172.21.15.6:0/3576778841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 msgr2=0x558aef6f5e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:55:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 --2- 172.21.15.6:0/3576778841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 0x558aef6f5e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 -- 172.21.15.6:0/3576778841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 msgr2=0x558aef6f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 --2- 172.21.15.6:0/3576778841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef6f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 -- 172.21.15.6:0/3576778841 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558aef4c7630 con 0x558aef6f7060 2023-09-13T09:55:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.600+0000 7fd07effd700 1 --2- 172.21.15.6:0/3576778841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f7060 0x558aef6f54c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd074010f70 tx=0x7fd074013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d670fcddce2b403 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.601+0000 7fd065ffb700 1 -- 172.21.15.6:0/3576778841 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074004220 con 0x558aef6f7060 2023-09-13T09:55:37.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.601+0000 7fd065ffb700 1 -- 172.21.15.6:0/3576778841 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd074015070 con 0x558aef6f7060 2023-09-13T09:55:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.601+0000 7fd065ffb700 1 -- 172.21.15.6:0/3576778841 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd07401e640 con 0x558aef6f7060 2023-09-13T09:55:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.602+0000 7fd092424b80 1 -- 172.21.15.6:0/3576778841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f7060 msgr2=0x558aef6f54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.602+0000 7fd092424b80 1 --2- 172.21.15.6:0/3576778841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f7060 0x558aef6f54c0 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fd074010f70 tx=0x7fd074013000 comp rx=0 tx=0).stop 2023-09-13T09:55:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.603+0000 7fd092424b80 1 -- 172.21.15.6:0/3576778841 shutdown_connections 2023-09-13T09:55:37.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.603+0000 7fd092424b80 1 --2- 172.21.15.6:0/3576778841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 0x558aef6f5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.603+0000 7fd092424b80 1 --2- 172.21.15.6:0/3576778841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef6f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.603+0000 7fd092424b80 1 --2- 172.21.15.6:0/3576778841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f7060 0x558aef6f54c0 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.603+0000 7fd092424b80 1 -- 172.21.15.6:0/3576778841 >> 172.21.15.6:0/3576778841 conn(0x558aef653c80 msgr2=0x558aef6eff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.603+0000 7fd092424b80 1 -- 172.21.15.6:0/3576778841 shutdown_connections 2023-09-13T09:55:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.603+0000 7fd092424b80 1 -- 172.21.15.6:0/3576778841 wait complete. 2023-09-13T09:55:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 -- start start 2023-09-13T09:55:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 Processor -- start 2023-09-13T09:55:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef70ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f6700 0x558aef710510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 0x558aef717550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef5e5bb0 con 0x558aef6f5a00 2023-09-13T09:55:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef5e58b0 con 0x558aef6f7060 2023-09-13T09:55:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef4c9920 con 0x558aef6f6700 2023-09-13T09:55:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd092424b80 10 client.0 _ll_register_callbacks cb 0x558aef5e3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef70ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef70ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43992/0 (socket says 172.21.15.6:43992) 2023-09-13T09:55:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2234565377 learned_addr learned my addr 172.21.15.6:0/2234565377 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.604+0000 7fd07effd700 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f6700 0x558aef710510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f6700 msgr2=0x558aef710510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f6700 0x558aef710510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2234565377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 msgr2=0x558aef717550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 0x558aef717550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd07f7fe700 1 -- 172.21.15.6:0/2234565377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd074010c50 con 0x558aef6f5a00 2023-09-13T09:55:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef70ffd0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b4d0 tx=0x7fd0700092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c14ddfaaba0ae8c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd05effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd05effd700 1 -- 172.21.15.6:0/2234565377 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070098480 con 0x558aef6f5a00 2023-09-13T09:55:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd05effd700 1 -- 172.21.15.6:0/2234565377 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd070098d90 con 0x558aef6f5a00 2023-09-13T09:55:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558aef6e8670 con 0x558aef6f5a00 2023-09-13T09:55:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd05effd700 1 -- 172.21.15.6:0/2234565377 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd07009cbc0 con 0x558aef6f5a00 2023-09-13T09:55:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd092424b80 10 client.19716 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.605+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x558aef65f7a0 con 0x558aef6f5a00 2023-09-13T09:55:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd05effd700 1 -- 172.21.15.6:0/2234565377 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558aef6e8670 con 0x558aef6f5a00 2023-09-13T09:55:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd05effd700 1 -- 172.21.15.6:0/2234565377 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fd0700cb110 con 0x558aef6f5a00 2023-09-13T09:55:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd092424b80 10 client.19716 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd092424b80 10 client.19716 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:55:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd092424b80 20 client.19716 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd092424b80 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef71bd80 0x558aef71e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd092424b80 4 client.19716 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.606+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558aef640970 con 0x558aef71bd80 2023-09-13T09:55:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.607+0000 7fd07effd700 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef71bd80 0x558aef71e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.607+0000 7fd05effd700 10 client.19716 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.607+0000 7fd07effd700 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef71bd80 0x558aef71e1a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80d34f28de98eae4 server_cookie=40ccb5e57c420c42 in_seq=0 out_seq=0 2023-09-13T09:55:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd05effd700 1 -- 172.21.15.6:0/2234565377 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558aef640970 con 0x558aef71bd80 2023-09-13T09:55:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd05effd700 10 client.19716 handle_command_reply: tid=0 2023-09-13T09:55:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 client.19716 shutdown 2023-09-13T09:55:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 msgr2=0x558aef70ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef70ffd0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b4d0 tx=0x7fd0700092b0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 shutdown_connections 2023-09-13T09:55:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef71bd80 0x558aef71e1a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 0x558aef717550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef70ffd0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd05effd700 0 client.19716 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 --2- 172.21.15.6:0/2234565377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f6700 0x558aef710510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 >> 172.21.15.6:0/2234565377 conn(0x558aef653c80 msgr2=0x558aef6ea7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 shutdown_connections 2023-09-13T09:55:37.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 1 -- 172.21.15.6:0/2234565377 wait complete. 2023-09-13T09:55:37.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.609+0000 7fd092424b80 20 client.19716 trim_cache size 0 max 16384 2023-09-13T09:55:37.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.626+0000 7fd092424b80 1 Processor -- start 2023-09-13T09:55:37.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.626+0000 7fd092424b80 1 -- start start 2023-09-13T09:55:37.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.626+0000 7fd092424b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 0x558aef6f54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.626+0000 7fd092424b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f6700 0x558aef717510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.626+0000 7fd092424b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 0x558aef6f99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd092424b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef70fb40 con 0x558aef6f6700 2023-09-13T09:55:37.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd092424b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef719210 con 0x558aef6f7060 2023-09-13T09:55:37.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd092424b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef6f1a10 con 0x558aef6f5a00 2023-09-13T09:55:37.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f6700 0x558aef717510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 0x558aef6f54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f6700 0x558aef717510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44002/0 (socket says 172.21.15.6:44002) 2023-09-13T09:55:37.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 -- 172.21.15.6:0/2411346483 learned_addr learned my addr 172.21.15.6:0/2411346483 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 -- 172.21.15.6:0/2411346483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 msgr2=0x558aef6f54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 --2- 172.21.15.6:0/2411346483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 0x558aef6f54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 -- 172.21.15.6:0/2411346483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 msgr2=0x558aef6f99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 --2- 172.21.15.6:0/2411346483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 0x558aef6f99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 -- 172.21.15.6:0/2411346483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558aef473de0 con 0x558aef6f6700 2023-09-13T09:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.627+0000 7fd07effd700 1 --2- 172.21.15.6:0/2411346483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f6700 0x558aef717510 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd074010a40 tx=0x7fd074016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbe71c78d47a292 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.628+0000 7fd0667fc700 1 -- 172.21.15.6:0/2411346483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd074035a10 con 0x558aef6f6700 2023-09-13T09:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.628+0000 7fd0667fc700 1 -- 172.21.15.6:0/2411346483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd07402a070 con 0x558aef6f6700 2023-09-13T09:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.628+0000 7fd0667fc700 1 -- 172.21.15.6:0/2411346483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0740052b0 con 0x558aef6f6700 2023-09-13T09:55:37.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 -- 172.21.15.6:0/2411346483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f6700 msgr2=0x558aef717510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 --2- 172.21.15.6:0/2411346483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f6700 0x558aef717510 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7fd074010a40 tx=0x7fd074016000 comp rx=0 tx=0).stop 2023-09-13T09:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 -- 172.21.15.6:0/2411346483 shutdown_connections 2023-09-13T09:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 --2- 172.21.15.6:0/2411346483 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f7060 0x558aef6f99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 --2- 172.21.15.6:0/2411346483 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f5a00 0x558aef6f54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 --2- 172.21.15.6:0/2411346483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f6700 0x558aef717510 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 -- 172.21.15.6:0/2411346483 >> 172.21.15.6:0/2411346483 conn(0x558aef653c80 msgr2=0x558aef6fceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 -- 172.21.15.6:0/2411346483 shutdown_connections 2023-09-13T09:55:37.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 -- 172.21.15.6:0/2411346483 wait complete. 2023-09-13T09:55:37.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 -- start start 2023-09-13T09:55:37.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.629+0000 7fd092424b80 1 Processor -- start 2023-09-13T09:55:37.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd092424b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef7132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd092424b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef713800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd092424b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f7060 0x558aef716820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd092424b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef716d60 con 0x558aef6f5a00 2023-09-13T09:55:37.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd092424b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef716ed0 con 0x558aef6f6700 2023-09-13T09:55:37.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd092424b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558aef717090 con 0x558aef6f7060 2023-09-13T09:55:37.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd092424b80 10 client.0 _ll_register_callbacks cb 0x558aef6f0570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef7132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd07effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef713800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd07f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef7132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44006/0 (socket says 172.21.15.6:44006) 2023-09-13T09:55:37.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd07f7fe700 1 -- 172.21.15.6:0/4175264940 learned_addr learned my addr 172.21.15.6:0/4175264940 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd07effd700 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef713800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37532/0 (socket says 172.21.15.6:37532) 2023-09-13T09:55:37.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd07f7fe700 1 -- 172.21.15.6:0/4175264940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f7060 msgr2=0x558aef716820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:55:37.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.630+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f7060 0x558aef716820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd07f7fe700 1 -- 172.21.15.6:0/4175264940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 msgr2=0x558aef713800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef713800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd07f7fe700 1 -- 172.21.15.6:0/4175264940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558aef4c7630 con 0x558aef6f5a00 2023-09-13T09:55:37.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd07f7fe700 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef7132c0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fd0700c90f0 tx=0x7fd070011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5592252d85466606 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd05effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:37.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd05effd700 1 -- 172.21.15.6:0/4175264940 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd070094ca0 con 0x558aef6f5a00 2023-09-13T09:55:37.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd05effd700 1 -- 172.21.15.6:0/4175264940 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd0700b1020 con 0x558aef6f5a00 2023-09-13T09:55:37.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd074015070 con 0x558aef6f5a00 2023-09-13T09:55:37.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd05effd700 1 -- 172.21.15.6:0/4175264940 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd070094f00 con 0x558aef6f5a00 2023-09-13T09:55:37.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd092424b80 10 client.19722 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.631+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x558aef45cc60 con 0x558aef6f5a00 2023-09-13T09:55:37.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd05effd700 1 -- 172.21.15.6:0/4175264940 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd074015070 con 0x558aef6f5a00 2023-09-13T09:55:37.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd05effd700 1 -- 172.21.15.6:0/4175264940 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fd070097cf0 con 0x558aef6f5a00 2023-09-13T09:55:37.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd092424b80 10 client.19722 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd092424b80 10 client.19722 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:55:37.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd092424b80 20 client.19722 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd092424b80 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef7709c0 0x558aef772de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd092424b80 4 client.19722 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:37.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558aef601050 con 0x558aef7709c0 2023-09-13T09:55:37.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.632+0000 7fd07effd700 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef7709c0 0x558aef772de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.633+0000 7fd05effd700 10 client.19722 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:37.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.633+0000 7fd07effd700 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef7709c0 0x558aef772de0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=80f197d8668bbc3e server_cookie=d0d4e962d0fc8651 in_seq=0 out_seq=0 2023-09-13T09:55:37.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd05effd700 1 -- 172.21.15.6:0/4175264940 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558aef601050 con 0x558aef7709c0 2023-09-13T09:55:37.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd05effd700 10 client.19722 handle_command_reply: tid=0 2023-09-13T09:55:37.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 client.19722 shutdown 2023-09-13T09:55:37.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 msgr2=0x558aef7132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef7132c0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7fd0700c90f0 tx=0x7fd070011000 comp rx=0 tx=0).stop 2023-09-13T09:55:37.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 shutdown_connections 2023-09-13T09:55:37.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558aef7709c0 0x558aef772de0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558aef6f7060 0x558aef716820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558aef6f5a00 0x558aef7132c0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 --2- 172.21.15.6:0/4175264940 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558aef6f6700 0x558aef713800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 >> 172.21.15.6:0/4175264940 conn(0x558aef653c80 msgr2=0x558aef6f99c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd05effd700 0 client.19722 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:55:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 shutdown_connections 2023-09-13T09:55:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 1 -- 172.21.15.6:0/4175264940 wait complete. 2023-09-13T09:55:37.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.634+0000 7fd092424b80 20 client.19722 trim_cache size 0 max 16384 2023-09-13T09:55:37.648 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0680a0640 msgr2=0x7fd0680a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0680a0640 0x7fd0680a2b00 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd074007c60 tx=0x7fd0740073d0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0800ffcc0 msgr2=0x7fd08010cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0800ffcc0 0x7fd08010cb10 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fd07000b500 tx=0x7fd07000b810 comp rx=0 tx=0).stop 2023-09-13T09:55:37.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 shutdown_connections 2023-09-13T09:55:37.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd080101850 0x7fd08010b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd0680a0640 0x7fd0680a2b00 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd0800ffcc0 0x7fd08010cb10 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 --2- 172.21.15.6:0/2040894974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd080100eb0 0x7fd08010b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 >> 172.21.15.6:0/2040894974 conn(0x7fd0800fb250 msgr2=0x7fd0800fd210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 shutdown_connections 2023-09-13T09:55:37.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.635+0000 7fd08623f700 1 -- 172.21.15.6:0/2040894974 wait complete. 2023-09-13T09:55:37.652 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:55:37.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.839+0000 7f01083b3700 1 -- 172.21.15.6:0/3304571473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0100108f60 msgr2=0x7f010010f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.839+0000 7f01083b3700 1 --2- 172.21.15.6:0/3304571473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0100108f60 0x7f010010f810 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f00f801c100 tx=0x7f00f801c410 comp rx=0 tx=0).stop 2023-09-13T09:55:37.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.839+0000 7f01083b3700 1 -- 172.21.15.6:0/3304571473 shutdown_connections 2023-09-13T09:55:37.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.839+0000 7f01083b3700 1 --2- 172.21.15.6:0/3304571473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0100108f60 0x7f010010f810 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.839+0000 7f01083b3700 1 --2- 172.21.15.6:0/3304571473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f01001073d0 0x7f01001077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.839+0000 7f01083b3700 1 --2- 172.21.15.6:0/3304571473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01001085c0 0x7f0100108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.839+0000 7f01083b3700 1 -- 172.21.15.6:0/3304571473 >> 172.21.15.6:0/3304571473 conn(0x7f0100076340 msgr2=0x7f01000787a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.841+0000 7f01083b3700 1 -- 172.21.15.6:0/3304571473 shutdown_connections 2023-09-13T09:55:37.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.841+0000 7f01083b3700 1 -- 172.21.15.6:0/3304571473 wait complete. 2023-09-13T09:55:37.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.842+0000 7f01083b3700 1 Processor -- start 2023-09-13T09:55:37.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.843+0000 7f01083b3700 1 -- start start 2023-09-13T09:55:37.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.843+0000 7f01083b3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01001073d0 0x7f01001b90e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.843+0000 7f01083b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01001085c0 0x7f01001bb630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.843+0000 7f01083b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0100108f60 0x7f01001bdca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.843+0000 7f01083b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001be470 con 0x7f01001085c0 2023-09-13T09:55:37.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.843+0000 7f01083b3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001be5e0 con 0x7f01001073d0 2023-09-13T09:55:37.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.843+0000 7f01083b3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001be7a0 con 0x7f0100108f60 2023-09-13T09:55:37.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.844+0000 7f0106950700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0100108f60 0x7f01001bdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010614f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01001073d0 0x7f01001b90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01001085c0 0x7f01001bb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01001085c0 0x7f01001bb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44024/0 (socket says 172.21.15.6:44024) 2023-09-13T09:55:37.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f0106950700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0100108f60 0x7f01001bdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47076/0 (socket says 172.21.15.6:47076) 2023-09-13T09:55:37.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 -- 172.21.15.6:0/2659874789 learned_addr learned my addr 172.21.15.6:0/2659874789 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 -- 172.21.15.6:0/2659874789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0100108f60 msgr2=0x7f01001bdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0100108f60 0x7f01001bdca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 -- 172.21.15.6:0/2659874789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01001073d0 msgr2=0x7f01001b90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01001073d0 0x7f01001b90e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 -- 172.21.15.6:0/2659874789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f801ad10 con 0x7f01001085c0 2023-09-13T09:55:37.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.845+0000 7f010594e700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01001085c0 0x7f01001bb630 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f00f000d980 tx=0x7f00f000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.846+0000 7f00f77fe700 1 -- 172.21.15.6:0/2659874789 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0004220 con 0x7f01001085c0 2023-09-13T09:55:37.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.846+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01001bea80 con 0x7f01001085c0 2023-09-13T09:55:37.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.846+0000 7f00f77fe700 1 -- 172.21.15.6:0/2659874789 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00f0004cf0 con 0x7f01001085c0 2023-09-13T09:55:37.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.846+0000 7f00f77fe700 1 -- 172.21.15.6:0/2659874789 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f0005720 con 0x7f01001085c0 2023-09-13T09:55:37.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.846+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01001befe0 con 0x7f01001085c0 2023-09-13T09:55:37.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.851+0000 7f0114598b80 1 Processor -- start 2023-09-13T09:55:37.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.852+0000 7f00f77fe700 1 -- 172.21.15.6:0/2659874789 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f00f0004410 con 0x7f01001085c0 2023-09-13T09:55:37.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.855+0000 7f00f77fe700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00ec0a06c0 0x7f00ec0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.855+0000 7f00f77fe700 1 -- 172.21.15.6:0/2659874789 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f00f00cd220 con 0x7f01001085c0 2023-09-13T09:55:37.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.855+0000 7f0106950700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00ec0a06c0 0x7f00ec0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.855+0000 7f0114598b80 1 -- start start 2023-09-13T09:55:37.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.856+0000 7f0106950700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00ec0a06c0 0x7f00ec0a2b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f00f801c0d0 tx=0x7f00f801c040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.857+0000 7f0114598b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d306b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.857+0000 7f0114598b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d307060 0x563a7d3054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.857+0000 7f0114598b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d305a00 0x563a7d305e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.857+0000 7f0114598b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d25e780 con 0x563a7d305a00 2023-09-13T09:55:37.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.857+0000 7f0114598b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d25c0a0 con 0x563a7d307060 2023-09-13T09:55:37.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.857+0000 7f0114598b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d257990 con 0x563a7d306700 2023-09-13T09:55:37.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d305a00 0x563a7d305e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d305a00 0x563a7d305e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44030/0 (socket says 172.21.15.6:44030) 2023-09-13T09:55:37.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 -- 172.21.15.6:0/3556693938 learned_addr learned my addr 172.21.15.6:0/3556693938 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f010614f700 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d306b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f010594e700 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d307060 0x563a7d3054c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 -- 172.21.15.6:0/3556693938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 msgr2=0x563a7d306b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d306b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 -- 172.21.15.6:0/3556693938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d307060 msgr2=0x563a7d3054c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d307060 0x563a7d3054c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 -- 172.21.15.6:0/3556693938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a7d0d7630 con 0x563a7d305a00 2023-09-13T09:55:37.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f010614f700 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d306b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:37.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f010594e700 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d307060 0x563a7d3054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:55:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.859+0000 7f0106950700 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d305a00 0x563a7d305e80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f00f801dd90 tx=0x7f00f8005070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48804bf51bf5a4c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.860+0000 7f00f4d82700 1 -- 172.21.15.6:0/3556693938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f801f040 con 0x563a7d305a00 2023-09-13T09:55:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.860+0000 7f00f4d82700 1 -- 172.21.15.6:0/3556693938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00f8003e50 con 0x563a7d305a00 2023-09-13T09:55:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.860+0000 7f00f4d82700 1 -- 172.21.15.6:0/3556693938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8008710 con 0x563a7d305a00 2023-09-13T09:55:37.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.861+0000 7f0114598b80 1 -- 172.21.15.6:0/3556693938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d305a00 msgr2=0x563a7d305e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.861+0000 7f0114598b80 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d305a00 0x563a7d305e80 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f00f801dd90 tx=0x7f00f8005070 comp rx=0 tx=0).stop 2023-09-13T09:55:37.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.862+0000 7f0114598b80 1 -- 172.21.15.6:0/3556693938 shutdown_connections 2023-09-13T09:55:37.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.862+0000 7f0114598b80 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d305a00 0x563a7d305e80 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.862+0000 7f0114598b80 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d306b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.862+0000 7f0114598b80 1 --2- 172.21.15.6:0/3556693938 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d307060 0x563a7d3054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.862+0000 7f0114598b80 1 -- 172.21.15.6:0/3556693938 >> 172.21.15.6:0/3556693938 conn(0x563a7d263c80 msgr2=0x563a7d2fff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.863+0000 7f0114598b80 1 -- 172.21.15.6:0/3556693938 shutdown_connections 2023-09-13T09:55:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.863+0000 7f0114598b80 1 -- 172.21.15.6:0/3556693938 wait complete. 2023-09-13T09:55:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 -- start start 2023-09-13T09:55:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 Processor -- start 2023-09-13T09:55:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d305a00 0x563a7d30ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d306700 0x563a7d30f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d3164d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d1f5bb0 con 0x563a7d307060 2023-09-13T09:55:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d1f58b0 con 0x563a7d306700 2023-09-13T09:55:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d0d9920 con 0x563a7d305a00 2023-09-13T09:55:37.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.864+0000 7f0114598b80 10 client.0 _ll_register_callbacks cb 0x563a7d1f3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d305a00 0x563a7d30ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d305a00 0x563a7d30ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47090/0 (socket says 172.21.15.6:47090) 2023-09-13T09:55:37.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 -- 172.21.15.6:0/2598729571 learned_addr learned my addr 172.21.15.6:0/2598729571 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f0106950700 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d3164d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 -- 172.21.15.6:0/2598729571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d306700 msgr2=0x563a7d30f490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:55:37.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d306700 0x563a7d30f490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 -- 172.21.15.6:0/2598729571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 msgr2=0x563a7d3164d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d3164d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.865+0000 7f010614f700 1 -- 172.21.15.6:0/2598729571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0100110160 con 0x563a7d305a00 2023-09-13T09:55:37.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.868+0000 7f010614f700 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d305a00 0x563a7d30ef50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009fb0 tx=0x7f00fc0126d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b4b62ac974a81aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.868+0000 7f00e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:55:37.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.868+0000 7f00e9ffb700 1 -- 172.21.15.6:0/2598729571 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00e5f0 con 0x563a7d305a00 2023-09-13T09:55:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.868+0000 7f00e9ffb700 1 -- 172.21.15.6:0/2598729571 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f00fc00e750 con 0x563a7d305a00 2023-09-13T09:55:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.868+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a7d2f8670 con 0x563a7d305a00 2023-09-13T09:55:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f00e9ffb700 1 -- 172.21.15.6:0/2598729571 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00fc00e910 con 0x563a7d305a00 2023-09-13T09:55:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 10 client.29008 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x563a7d26f7a0 con 0x563a7d305a00 2023-09-13T09:55:37.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f00e9ffb700 1 -- 172.21.15.6:0/2598729571 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563a7d2f8670 con 0x563a7d305a00 2023-09-13T09:55:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f00e9ffb700 1 -- 172.21.15.6:0/2598729571 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f00fc025cf0 con 0x563a7d305a00 2023-09-13T09:55:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 10 client.29008 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 10 client.29008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 20 client.29008 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d31ad20 0x563a7d31d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 4 client.29008 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:37.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.869+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a7d250970 con 0x563a7d31ad20 2023-09-13T09:55:37.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.870+0000 7f010594e700 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d31ad20 0x563a7d31d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.870+0000 7f00e9ffb700 10 client.29008 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:37.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.870+0000 7f010594e700 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d31ad20 0x563a7d31d140 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4c18a2829a71dc0 server_cookie=74a669f36053fac9 in_seq=0 out_seq=0 2023-09-13T09:55:37.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f00e9ffb700 1 -- 172.21.15.6:0/2598729571 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563a7d250970 con 0x563a7d31ad20 2023-09-13T09:55:37.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f00e9ffb700 10 client.29008 handle_command_reply: tid=0 2023-09-13T09:55:37.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 client.29008 shutdown 2023-09-13T09:55:37.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d305a00 msgr2=0x563a7d30ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d305a00 0x563a7d30ef50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f00fc009fb0 tx=0x7f00fc0126d0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 shutdown_connections 2023-09-13T09:55:37.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d31ad20 0x563a7d31d140 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d3164d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d305a00 0x563a7d30ef50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f00e9ffb700 0 client.29008 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:37.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 --2- 172.21.15.6:0/2598729571 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d306700 0x563a7d30f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.875+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 >> 172.21.15.6:0/2598729571 conn(0x563a7d263c80 msgr2=0x563a7d2fa7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.876+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 shutdown_connections 2023-09-13T09:55:37.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.876+0000 7f0114598b80 1 -- 172.21.15.6:0/2598729571 wait complete. 2023-09-13T09:55:37.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.876+0000 7f0114598b80 20 client.29008 trim_cache size 0 max 16384 2023-09-13T09:55:37.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 Processor -- start 2023-09-13T09:55:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 -- start start 2023-09-13T09:55:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 0x563a7d3054c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d306700 0x563a7d316460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d307060 0x563a7d30ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d30e400 con 0x563a7d306700 2023-09-13T09:55:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d301fd0 con 0x563a7d305a00 2023-09-13T09:55:37.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0114598b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d300fe0 con 0x563a7d307060 2023-09-13T09:55:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0106950700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d307060 0x563a7d30ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0106950700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d307060 0x563a7d30ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47096/0 (socket says 172.21.15.6:47096) 2023-09-13T09:55:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.895+0000 7f0106950700 1 -- 172.21.15.6:0/3658303512 learned_addr learned my addr 172.21.15.6:0/3658303512 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.896+0000 7f0106950700 1 -- 172.21.15.6:0/3658303512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 msgr2=0x563a7d3054c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:55:37.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.896+0000 7f0106950700 1 --2- 172.21.15.6:0/3658303512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 0x563a7d3054c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.896+0000 7f0106950700 1 -- 172.21.15.6:0/3658303512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d306700 msgr2=0x563a7d316460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:55:37.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.896+0000 7f0106950700 1 --2- 172.21.15.6:0/3658303512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d306700 0x563a7d316460 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.896+0000 7f0106950700 1 -- 172.21.15.6:0/3658303512 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a7d083de0 con 0x563a7d307060 2023-09-13T09:55:37.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.896+0000 7f0106950700 1 --2- 172.21.15.6:0/3658303512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d307060 0x563a7d30ceb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00f801acb0 tx=0x7f00f801ac40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e3b2c01e4a1156c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.898+0000 7f00f5583700 1 -- 172.21.15.6:0/3658303512 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f801f040 con 0x563a7d307060 2023-09-13T09:55:37.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.898+0000 7f00f5583700 1 -- 172.21.15.6:0/3658303512 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00f801de80 con 0x563a7d307060 2023-09-13T09:55:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.898+0000 7f00f5583700 1 -- 172.21.15.6:0/3658303512 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8008b60 con 0x563a7d307060 2023-09-13T09:55:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 -- 172.21.15.6:0/3658303512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d307060 msgr2=0x563a7d30ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 --2- 172.21.15.6:0/3658303512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d307060 0x563a7d30ceb0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f00f801acb0 tx=0x7f00f801ac40 comp rx=0 tx=0).stop 2023-09-13T09:55:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 -- 172.21.15.6:0/3658303512 shutdown_connections 2023-09-13T09:55:37.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 --2- 172.21.15.6:0/3658303512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d307060 0x563a7d30ceb0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 --2- 172.21.15.6:0/3658303512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 0x563a7d3054c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 --2- 172.21.15.6:0/3658303512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d306700 0x563a7d316460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 -- 172.21.15.6:0/3658303512 >> 172.21.15.6:0/3658303512 conn(0x563a7d263c80 msgr2=0x563a7d30db80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 -- 172.21.15.6:0/3658303512 shutdown_connections 2023-09-13T09:55:37.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.899+0000 7f0114598b80 1 -- 172.21.15.6:0/3658303512 wait complete. 2023-09-13T09:55:37.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 -- start start 2023-09-13T09:55:37.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 Processor -- start 2023-09-13T09:55:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 0x563a7d315d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d316240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d314310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d3148e0 con 0x563a7d307060 2023-09-13T09:55:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d314a50 con 0x563a7d305a00 2023-09-13T09:55:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.900+0000 7f0114598b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a7d314c10 con 0x563a7d306700 2023-09-13T09:55:37.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f0114598b80 10 client.0 _ll_register_callbacks cb 0x563a7d1f3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f010594e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d316240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f010594e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d316240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47102/0 (socket says 172.21.15.6:47102) 2023-09-13T09:55:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f010594e700 1 -- 172.21.15.6:0/3971900543 learned_addr learned my addr 172.21.15.6:0/3971900543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f0106950700 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d314310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f010614f700 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 0x563a7d315d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f0106950700 1 -- 172.21.15.6:0/3971900543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 msgr2=0x563a7d316240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f0106950700 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d316240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f0106950700 1 -- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 msgr2=0x563a7d315d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f0106950700 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 0x563a7d315d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.901+0000 7f0106950700 1 -- 172.21.15.6:0/3971900543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563a7d0d7630 con 0x563a7d307060 2023-09-13T09:55:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f0106950700 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d314310 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f00f801e010 tx=0x7f00f80057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caeeed376c775931 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f00e9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f00e9ffb700 1 -- 172.21.15.6:0/3971900543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f801f040 con 0x563a7d307060 2023-09-13T09:55:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f00e9ffb700 1 -- 172.21.15.6:0/3971900543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f00f8008520 con 0x563a7d307060 2023-09-13T09:55:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00f8003e50 con 0x563a7d307060 2023-09-13T09:55:37.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f00e9ffb700 1 -- 172.21.15.6:0/3971900543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00f8008cb0 con 0x563a7d307060 2023-09-13T09:55:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f0114598b80 10 client.19737 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x563a7d06cc60 con 0x563a7d307060 2023-09-13T09:55:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.902+0000 7f00e9ffb700 1 -- 172.21.15.6:0/3971900543 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f00f8003e50 con 0x563a7d307060 2023-09-13T09:55:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.903+0000 7f00e9ffb700 1 -- 172.21.15.6:0/3971900543 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f00f802a070 con 0x563a7d307060 2023-09-13T09:55:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.903+0000 7f0114598b80 10 client.19737 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.903+0000 7f0114598b80 10 client.19737 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.904+0000 7f0114598b80 20 client.19737 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.904+0000 7f0114598b80 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d36f870 0x563a7d371c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.904+0000 7f0114598b80 4 client.19737 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:55:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.904+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563a7d211050 con 0x563a7d36f870 2023-09-13T09:55:37.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.905+0000 7f010614f700 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d36f870 0x563a7d371c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:37.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.906+0000 7f00e9ffb700 10 client.19737 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.906+0000 7f010614f700 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d36f870 0x563a7d371c60 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=555fbb02aa5fb464 server_cookie=73f4c6f7c696fd1 in_seq=0 out_seq=0 2023-09-13T09:55:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.910+0000 7f00e9ffb700 1 -- 172.21.15.6:0/3971900543 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563a7d211050 con 0x563a7d36f870 2023-09-13T09:55:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.910+0000 7f00e9ffb700 10 client.19737 handle_command_reply: tid=0 2023-09-13T09:55:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.910+0000 7f0114598b80 1 client.19737 shutdown 2023-09-13T09:55:37.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 msgr2=0x563a7d314310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d314310 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f00f801e010 tx=0x7f00f80057d0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 shutdown_connections 2023-09-13T09:55:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563a7d36f870 0x563a7d371c60 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563a7d307060 0x563a7d314310 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563a7d305a00 0x563a7d315d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 --2- 172.21.15.6:0/3971900543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563a7d306700 0x563a7d316240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 >> 172.21.15.6:0/3971900543 conn(0x563a7d263c80 msgr2=0x563a7d30ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f00e9ffb700 0 client.19737 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:37.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 shutdown_connections 2023-09-13T09:55:37.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 1 -- 172.21.15.6:0/3971900543 wait complete. 2023-09-13T09:55:37.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.911+0000 7f0114598b80 20 client.19737 trim_cache size 0 max 16384 2023-09-13T09:55:37.917 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:55:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00ec0a06c0 msgr2=0x7f00ec0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00ec0a06c0 0x7f00ec0a2b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f00f801c0d0 tx=0x7f00f801c040 comp rx=0 tx=0).stop 2023-09-13T09:55:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01001085c0 msgr2=0x7f01001bb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01001085c0 0x7f01001bb630 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f00f000d980 tx=0x7f00f000dc90 comp rx=0 tx=0).stop 2023-09-13T09:55:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 shutdown_connections 2023-09-13T09:55:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0100108f60 0x7f01001bdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f01001073d0 0x7f01001b90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f00ec0a06c0 0x7f00ec0a2b80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 --2- 172.21.15.6:0/2659874789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01001085c0 0x7f01001bb630 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:37.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 >> 172.21.15.6:0/2659874789 conn(0x7f0100076340 msgr2=0x7f01000784c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:37.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 shutdown_connections 2023-09-13T09:55:37.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:37.912+0000 7f01083b3700 1 -- 172.21.15.6:0/2659874789 wait complete. 2023-09-13T09:55:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:38 smithi006 ceph-mon[98665]: pgmap v783: 97 pgs: 97 active+clean; 958 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 799 op/s 2023-09-13T09:55:38.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:38 smithi053 ceph-mon[102373]: pgmap v783: 97 pgs: 97 active+clean; 958 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 799 op/s 2023-09-13T09:55:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:38 smithi131 ceph-mon[102785]: pgmap v783: 97 pgs: 97 active+clean; 958 MiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 799 op/s 2023-09-13T09:55:38.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 127969 38.46 MB/sec execute 58 sec latency 123.428 ms 2023-09-13T09:55:38.931 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:55:38.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:55:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 -- 172.21.15.6:0/3692259745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 msgr2=0x7feb28101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 --2- 172.21.15.6:0/3692259745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28101310 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009920 tx=0x7feb1c009c30 comp rx=0 tx=0).stop 2023-09-13T09:55:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 -- 172.21.15.6:0/3692259745 shutdown_connections 2023-09-13T09:55:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 --2- 172.21.15.6:0/3692259745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb28101850 0x7feb28108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 --2- 172.21.15.6:0/3692259745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffcc0 0x7feb281000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 --2- 172.21.15.6:0/3692259745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28101310 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 -- 172.21.15.6:0/3692259745 >> 172.21.15.6:0/3692259745 conn(0x7feb280fb250 msgr2=0x7feb280fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 -- 172.21.15.6:0/3692259745 shutdown_connections 2023-09-13T09:55:39.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.111+0000 7feb2de55700 1 -- 172.21.15.6:0/3692259745 wait complete. 2023-09-13T09:55:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.112+0000 7feb2de55700 1 Processor -- start 2023-09-13T09:55:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.112+0000 7feb2de55700 1 -- start start 2023-09-13T09:55:39.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb2de55700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffcc0 0x7feb28198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb2de55700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb2de55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb28101850 0x7feb281a0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb2de55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb281a0860 con 0x7feb28101850 2023-09-13T09:55:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb2de55700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb281a09d0 con 0x7feb28100eb0 2023-09-13T09:55:39.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb2de55700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb281a0b90 con 0x7feb280ffcc0 2023-09-13T09:55:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37586/0 (socket says 172.21.15.6:37586) 2023-09-13T09:55:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 -- 172.21.15.6:0/2059950008 learned_addr learned my addr 172.21.15.6:0/2059950008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 -- 172.21.15.6:0/2059950008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffcc0 msgr2=0x7feb28198d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffcc0 0x7feb28198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 -- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb28101850 msgr2=0x7feb281a0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb28101850 0x7feb281a0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.113+0000 7feb26ffd700 1 -- 172.21.15.6:0/2059950008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb180095f0 con 0x7feb28100eb0 2023-09-13T09:55:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.114+0000 7feb26ffd700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28199260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009230 tx=0x7feb1c00b560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.114+0000 7feb24ff9700 1 -- 172.21.15.6:0/2059950008 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c01c070 con 0x7feb28100eb0 2023-09-13T09:55:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.114+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb1c009520 con 0x7feb28100eb0 2023-09-13T09:55:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.114+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb281a1100 con 0x7feb28100eb0 2023-09-13T09:55:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.114+0000 7feb24ff9700 1 -- 172.21.15.6:0/2059950008 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb1c005040 con 0x7feb28100eb0 2023-09-13T09:55:39.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.114+0000 7feb24ff9700 1 -- 172.21.15.6:0/2059950008 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c003a20 con 0x7feb28100eb0 2023-09-13T09:55:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.117+0000 7feb24ff9700 1 -- 172.21.15.6:0/2059950008 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7feb1c020030 con 0x7feb28100eb0 2023-09-13T09:55:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb24ff9700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb100a06c0 0x7feb100a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb3a03ab80 1 Processor -- start 2023-09-13T09:55:39.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb3a03ab80 1 -- start start 2023-09-13T09:55:39.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb277fe700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb100a06c0 0x7feb100a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb24ff9700 1 -- 172.21.15.6:0/2059950008 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feb1c0ccad0 con 0x7feb28100eb0 2023-09-13T09:55:39.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303f90 0x55a5973043b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5973048f0 0x55a597302d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.118+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a5973036f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a597253800 con 0x55a597303290 2023-09-13T09:55:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a597251120 con 0x55a5973048f0 2023-09-13T09:55:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a59724ca10 con 0x55a597303f90 2023-09-13T09:55:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a5973036f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a5973036f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44072/0 (socket says 172.21.15.6:44072) 2023-09-13T09:55:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb277fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303f90 0x55a5973043b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 -- 172.21.15.6:0/763182797 learned_addr learned my addr 172.21.15.6:0/763182797 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 -- 172.21.15.6:0/763182797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303f90 msgr2=0x55a5973043b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 --2- 172.21.15.6:0/763182797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303f90 0x55a5973043b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 -- 172.21.15.6:0/763182797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5973048f0 msgr2=0x55a597302d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 --2- 172.21.15.6:0/763182797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5973048f0 0x55a597302d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 -- 172.21.15.6:0/763182797 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5970cc6b0 con 0x55a597303290 2023-09-13T09:55:39.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb27fff700 1 --2- 172.21.15.6:0/763182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a5973036f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7feb2000e400 tx=0x7feb2000e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5f1ad6d239d9fea server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.119+0000 7feb0dffb700 1 -- 172.21.15.6:0/763182797 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20018070 con 0x55a597303290 2023-09-13T09:55:39.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb0dffb700 1 -- 172.21.15.6:0/763182797 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb2000f040 con 0x55a597303290 2023-09-13T09:55:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb0dffb700 1 -- 172.21.15.6:0/763182797 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb20004280 con 0x55a597303290 2023-09-13T09:55:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb3a03ab80 1 -- 172.21.15.6:0/763182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 msgr2=0x55a5973036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb277fe700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb100a06c0 0x7feb100a2b80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feb18009fd0 tx=0x7feb18009bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/763182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a5973036f0 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7feb2000e400 tx=0x7feb2000e710 comp rx=0 tx=0).stop 2023-09-13T09:55:39.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb3a03ab80 1 -- 172.21.15.6:0/763182797 shutdown_connections 2023-09-13T09:55:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/763182797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a5973036f0 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/763182797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303f90 0x55a5973043b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/763182797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a5973048f0 0x55a597302d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.120+0000 7feb3a03ab80 1 -- 172.21.15.6:0/763182797 >> 172.21.15.6:0/763182797 conn(0x55a597258d00 msgr2=0x55a5972f4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.121+0000 7feb3a03ab80 1 -- 172.21.15.6:0/763182797 shutdown_connections 2023-09-13T09:55:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.121+0000 7feb3a03ab80 1 -- 172.21.15.6:0/763182797 wait complete. 2023-09-13T09:55:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.121+0000 7feb3a03ab80 1 -- start start 2023-09-13T09:55:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.121+0000 7feb3a03ab80 1 Processor -- start 2023-09-13T09:55:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.121+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 0x55a59730c770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.121+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a59730ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.121+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5973048f0 0x55a597313cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5971eac30 con 0x55a5973048f0 2023-09-13T09:55:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5971ea930 con 0x55a597303f90 2023-09-13T09:55:39.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5970ce9a0 con 0x55a597303290 2023-09-13T09:55:39.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb3a03ab80 10 client.0 _ll_register_callbacks cb 0x55a5971e8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:39.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a59730ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a59730ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37600/0 (socket says 172.21.15.6:37600) 2023-09-13T09:55:39.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 -- 172.21.15.6:0/3671511990 learned_addr learned my addr 172.21.15.6:0/3671511990 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb27fff700 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5973048f0 0x55a597313cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 -- 172.21.15.6:0/3671511990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 msgr2=0x55a59730c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 0x55a59730c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 -- 172.21.15.6:0/3671511990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5973048f0 msgr2=0x55a597313cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5973048f0 0x55a597313cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 -- 172.21.15.6:0/3671511990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb2000e140 con 0x55a597303f90 2023-09-13T09:55:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb27fff700 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5973048f0 0x55a597313cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a59730ccb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feb1c09a000 tx=0x7feb1c09aa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43769deb331a32ba server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.122+0000 7feb06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:55:39.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb06ffd700 1 -- 172.21.15.6:0/3671511990 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0a22e0 con 0x55a597303f90 2023-09-13T09:55:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5972ed6f0 con 0x55a597303f90 2023-09-13T09:55:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb06ffd700 1 -- 172.21.15.6:0/3671511990 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feb1c096a10 con 0x55a597303f90 2023-09-13T09:55:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb06ffd700 1 -- 172.21.15.6:0/3671511990 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb1c096bf0 con 0x55a597303f90 2023-09-13T09:55:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 10 client.29060 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:39.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x55a597264820 con 0x55a597303f90 2023-09-13T09:55:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb06ffd700 1 -- 172.21.15.6:0/3671511990 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a5972ed6f0 con 0x55a597303f90 2023-09-13T09:55:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb06ffd700 1 -- 172.21.15.6:0/3671511990 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7feb1c0a1e50 con 0x55a597303f90 2023-09-13T09:55:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 10 client.29060 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:39.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 10 client.29060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 20 client.29060 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a597317f70 0x55a59731a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 4 client.29060 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5972459f0 con 0x55a597317f70 2023-09-13T09:55:39.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.124+0000 7feb277fe700 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a597317f70 0x55a59731a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.125+0000 7feb277fe700 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a597317f70 0x55a59731a360 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=420ce309afe8c798 server_cookie=558cea89d6c1c83e in_seq=0 out_seq=0 2023-09-13T09:55:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.125+0000 7feb06ffd700 10 client.29060 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.125+0000 7feb06ffd700 1 -- 172.21.15.6:0/3671511990 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a5972459f0 con 0x55a597317f70 2023-09-13T09:55:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb06ffd700 10 client.29060 handle_command_reply: tid=0 2023-09-13T09:55:39.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 client.29060 shutdown 2023-09-13T09:55:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 msgr2=0x55a59730ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a59730ccb0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feb1c09a000 tx=0x7feb1c09aa00 comp rx=0 tx=0).stop 2023-09-13T09:55:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 shutdown_connections 2023-09-13T09:55:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a597317f70 0x55a59731a360 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a5973048f0 0x55a597313cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 0x55a59730c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3671511990 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a59730ccb0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 >> 172.21.15.6:0/3671511990 conn(0x55a597258d00 msgr2=0x55a5972f4f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb06ffd700 0 client.29060 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 shutdown_connections 2023-09-13T09:55:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3671511990 wait complete. 2023-09-13T09:55:39.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.126+0000 7feb3a03ab80 20 client.29060 trim_cache size 0 max 16384 2023-09-13T09:55:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 Processor -- start 2023-09-13T09:55:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 -- start start 2023-09-13T09:55:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597258d00 0x55a5972ee960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a597313cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a5972eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a59730c340 con 0x55a597303290 2023-09-13T09:55:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5972f5ae0 con 0x55a597303f90 2023-09-13T09:55:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5972f7050 con 0x55a597258d00 2023-09-13T09:55:39.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb26ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a597313cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb277fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597258d00 0x55a5972ee960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb277fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597258d00 0x55a5972ee960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47136/0 (socket says 172.21.15.6:47136) 2023-09-13T09:55:39.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.149+0000 7feb277fe700 1 -- 172.21.15.6:0/3892953602 learned_addr learned my addr 172.21.15.6:0/3892953602 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb26ffd700 1 -- 172.21.15.6:0/3892953602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597258d00 msgr2=0x55a5972ee960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597258d00 0x55a5972ee960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb26ffd700 1 -- 172.21.15.6:0/3892953602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 msgr2=0x55a5972eeea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a5972eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb26ffd700 1 -- 172.21.15.6:0/3892953602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a597078e60 con 0x55a597303290 2023-09-13T09:55:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb277fe700 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597258d00 0x55a5972ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:55:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a597313cb0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0ca8f0 tx=0x7feb1c0a2210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0b6fb7157bad90 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb0e7fc700 1 -- 172.21.15.6:0/3892953602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c003e60 con 0x55a597303290 2023-09-13T09:55:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.150+0000 7feb0e7fc700 1 -- 172.21.15.6:0/3892953602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb1c003c50 con 0x55a597303290 2023-09-13T09:55:39.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.151+0000 7feb0e7fc700 1 -- 172.21.15.6:0/3892953602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb1c09a560 con 0x55a597303290 2023-09-13T09:55:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.152+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3892953602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 msgr2=0x55a597313cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.152+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a597313cb0 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0ca8f0 tx=0x7feb1c0a2210 comp rx=0 tx=0).stop 2023-09-13T09:55:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.152+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3892953602 shutdown_connections 2023-09-13T09:55:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.152+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a5972eeea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.152+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597258d00 0x55a5972ee960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.152+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3892953602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597303290 0x55a597313cb0 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.152+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3892953602 >> 172.21.15.6:0/3892953602 conn(0x55a5972f52c0 msgr2=0x55a59730c770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.153+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3892953602 shutdown_connections 2023-09-13T09:55:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.153+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3892953602 wait complete. 2023-09-13T09:55:39.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.153+0000 7feb3a03ab80 1 -- start start 2023-09-13T09:55:39.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.153+0000 7feb3a03ab80 1 Processor -- start 2023-09-13T09:55:39.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597258d00 0x55a597311210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 0x55a597311750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb3a03ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a597312760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a597312ca0 con 0x55a597258d00 2023-09-13T09:55:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a597312e10 con 0x55a597303f90 2023-09-13T09:55:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb3a03ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a597312fd0 con 0x55a597303290 2023-09-13T09:55:39.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb3a03ab80 10 client.0 _ll_register_callbacks cb 0x55a5971e8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:39.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597258d00 0x55a597311210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb277fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597258d00 0x55a597311210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44092/0 (socket says 172.21.15.6:44092) 2023-09-13T09:55:39.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb277fe700 1 -- 172.21.15.6:0/3521529581 learned_addr learned my addr 172.21.15.6:0/3521529581 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.154+0000 7feb27fff700 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a597312760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb277fe700 1 -- 172.21.15.6:0/3521529581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 msgr2=0x55a597311750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb277fe700 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 0x55a597311750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb277fe700 1 -- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 msgr2=0x55a597312760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb277fe700 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a597312760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb277fe700 1 -- 172.21.15.6:0/3521529581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb18012e70 con 0x55a597258d00 2023-09-13T09:55:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb277fe700 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597258d00 0x55a597311210 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7feb18009870 tx=0x7feb18009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d72de362b174f3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb06ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.155+0000 7feb06ffd700 1 -- 172.21.15.6:0/3521529581 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb18026040 con 0x55a597258d00 2023-09-13T09:55:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.156+0000 7feb06ffd700 1 -- 172.21.15.6:0/3521529581 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7feb18004c40 con 0x55a597258d00 2023-09-13T09:55:39.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.156+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb2000f040 con 0x55a597258d00 2023-09-13T09:55:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.156+0000 7feb06ffd700 1 -- 172.21.15.6:0/3521529581 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb18004e00 con 0x55a597258d00 2023-09-13T09:55:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.156+0000 7feb3a03ab80 10 client.19752 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.156+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x7feb2000e140 con 0x55a597258d00 2023-09-13T09:55:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.156+0000 7feb06ffd700 1 -- 172.21.15.6:0/3521529581 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7feb2000f040 con 0x55a597258d00 2023-09-13T09:55:39.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.157+0000 7feb06ffd700 1 -- 172.21.15.6:0/3521529581 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7feb18033070 con 0x55a597258d00 2023-09-13T09:55:39.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.157+0000 7feb3a03ab80 10 client.19752 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:39.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.157+0000 7feb3a03ab80 10 client.19752 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:39.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.157+0000 7feb3a03ab80 20 client.19752 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:39.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.157+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a5973048f0 0x55a5972fcc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.157+0000 7feb3a03ab80 4 client.19752 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:55:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.157+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55a5972060d0 con 0x55a5973048f0 2023-09-13T09:55:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.159+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a5973048f0 0x55a5972fcc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.160+0000 7feb26ffd700 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a5973048f0 0x55a5972fcc20 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f521505267bf3ced server_cookie=5cc153903da67f03 in_seq=0 out_seq=0 2023-09-13T09:55:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.160+0000 7feb06ffd700 10 client.19752 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb06ffd700 1 -- 172.21.15.6:0/3521529581 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a5972060d0 con 0x55a5973048f0 2023-09-13T09:55:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb06ffd700 10 client.19752 handle_command_reply: tid=0 2023-09-13T09:55:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 client.19752 shutdown 2023-09-13T09:55:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597258d00 msgr2=0x55a597311210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597258d00 0x55a597311210 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7feb18009870 tx=0x7feb18009510 comp rx=0 tx=0).stop 2023-09-13T09:55:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 shutdown_connections 2023-09-13T09:55:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a597303f90 0x55a597312760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a5973048f0 0x55a5972fcc20 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a597258d00 0x55a597311210 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 --2- 172.21.15.6:0/3521529581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a597303290 0x55a597311750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 >> 172.21.15.6:0/3521529581 conn(0x55a5972f52c0 msgr2=0x55a5972f9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb06ffd700 0 client.19752 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 shutdown_connections 2023-09-13T09:55:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 1 -- 172.21.15.6:0/3521529581 wait complete. 2023-09-13T09:55:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.166+0000 7feb3a03ab80 20 client.19752 trim_cache size 0 max 16384 2023-09-13T09:55:39.171 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:55:39.172 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:55:39.172 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "09a97505-2edc-4a9d-bceb-5bee579f10f1", 2023-09-13T09:55:39.172 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:55:39.172 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:55:39.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb100a06c0 msgr2=0x7feb100a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb100a06c0 0x7feb100a2b80 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7feb18009fd0 tx=0x7feb18009bd0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 msgr2=0x7feb28199260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28199260 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feb1c009230 tx=0x7feb1c00b560 comp rx=0 tx=0).stop 2023-09-13T09:55:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 shutdown_connections 2023-09-13T09:55:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feb100a06c0 0x7feb100a2b80 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb28101850 0x7feb281a0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280ffcc0 0x7feb28198d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 --2- 172.21.15.6:0/2059950008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7feb28100eb0 0x7feb28199260 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 >> 172.21.15.6:0/2059950008 conn(0x7feb280fb250 msgr2=0x7feb280fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 shutdown_connections 2023-09-13T09:55:39.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.167+0000 7feb2de55700 1 -- 172.21.15.6:0/2059950008 wait complete. 2023-09-13T09:55:39.184 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:55:39.218 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:39 smithi006 ceph-mon[98665]: pgmap v784: 97 pgs: 97 active+clean; 963 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.6 MiB/s wr, 710 op/s 2023-09-13T09:55:39.219 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:39 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:55:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 -- 172.21.15.6:0/642766981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4101820 msgr2=0x7f32c41080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/642766981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4101820 0x7f32c41080d0 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009990 tx=0x7f32bc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 -- 172.21.15.6:0/642766981 shutdown_connections 2023-09-13T09:55:39.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/642766981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4101820 0x7f32c41080d0 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/642766981 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40ffc90 0x7f32c41000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/642766981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c4100e80 0x7f32c41012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 -- 172.21.15.6:0/642766981 >> 172.21.15.6:0/642766981 conn(0x7f32c40fb220 msgr2=0x7f32c40fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 -- 172.21.15.6:0/642766981 shutdown_connections 2023-09-13T09:55:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.362+0000 7f32c9ea5700 1 -- 172.21.15.6:0/642766981 wait complete. 2023-09-13T09:55:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 Processor -- start 2023-09-13T09:55:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 -- start start 2023-09-13T09:55:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40ffc90 0x7f32c4196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4100e80 0x7f32c4196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c4101820 0x7f32c419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c419e5c0 con 0x7f32c4100e80 2023-09-13T09:55:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c419e700 con 0x7f32c40ffc90 2023-09-13T09:55:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.363+0000 7f32c9ea5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32c419e890 con 0x7f32c4101820 2023-09-13T09:55:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4100e80 0x7f32c4196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4100e80 0x7f32c4196f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44104/0 (socket says 172.21.15.6:44104) 2023-09-13T09:55:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 -- 172.21.15.6:0/2665460723 learned_addr learned my addr 172.21.15.6:0/2665460723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c37fe700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40ffc90 0x7f32c4196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c3fff700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c4101820 0x7f32c419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 -- 172.21.15.6:0/2665460723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c4101820 msgr2=0x7f32c419dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c4101820 0x7f32c419dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 -- 172.21.15.6:0/2665460723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40ffc90 msgr2=0x7f32c4196a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40ffc90 0x7f32c4196a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 -- 172.21.15.6:0/2665460723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32bc0095f0 con 0x7f32c4100e80 2023-09-13T09:55:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c2ffd700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4100e80 0x7f32c4196f80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f32b800e9a0 tx=0x7f32b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.364+0000 7f32c0ff9700 1 -- 172.21.15.6:0/2665460723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8009790 con 0x7f32c4100e80 2023-09-13T09:55:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.365+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32c419eb70 con 0x7f32c4100e80 2023-09-13T09:55:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.365+0000 7f32c0ff9700 1 -- 172.21.15.6:0/2665460723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b8010430 con 0x7f32c4100e80 2023-09-13T09:55:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.365+0000 7f32c0ff9700 1 -- 172.21.15.6:0/2665460723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b8018680 con 0x7f32c4100e80 2023-09-13T09:55:39.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.365+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32c419f0d0 con 0x7f32c4100e80 2023-09-13T09:55:39.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.369+0000 7f32d608ab80 1 Processor -- start 2023-09-13T09:55:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.370+0000 7f32c0ff9700 1 -- 172.21.15.6:0/2665460723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f32b80105a0 con 0x7f32c4100e80 2023-09-13T09:55:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32d608ab80 1 -- start start 2023-09-13T09:55:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec57b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 0x5557ec57be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32d608ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec4d4780 con 0x5557ec57d060 2023-09-13T09:55:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32d608ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec4d20a0 con 0x5557ec57c700 2023-09-13T09:55:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32d608ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec4cd990 con 0x5557ec57ba00 2023-09-13T09:55:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c0ff9700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32ac0a06c0 0x7f32ac0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec57b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec57b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44110/0 (socket says 172.21.15.6:44110) 2023-09-13T09:55:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 -- 172.21.15.6:0/1866755040 learned_addr learned my addr 172.21.15.6:0/1866755040 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c3fff700 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c0ff9700 1 -- 172.21.15.6:0/2665460723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32b8014070 con 0x7f32c4100e80 2023-09-13T09:55:39.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c3fff700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32ac0a06c0 0x7f32ac0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 -- 172.21.15.6:0/1866755040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 msgr2=0x5557ec57be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 0x5557ec57be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 -- 172.21.15.6:0/1866755040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 msgr2=0x5557ec57cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.371+0000 7f32c37fe700 1 -- 172.21.15.6:0/1866755040 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ec34d630 con 0x5557ec57d060 2023-09-13T09:55:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.372+0000 7f32c37fe700 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec57b4c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f32b4011600 tx=0x7f32b4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9624d38c3ee871ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.372+0000 7f32a9ffb700 1 -- 172.21.15.6:0/1866755040 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400e040 con 0x5557ec57d060 2023-09-13T09:55:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.372+0000 7f32c3fff700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32ac0a06c0 0x7f32ac0a2b80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0095c0 tx=0x7f32bc009ca0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.372+0000 7f32a9ffb700 1 -- 172.21.15.6:0/1866755040 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b400f040 con 0x5557ec57d060 2023-09-13T09:55:39.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.372+0000 7f32a9ffb700 1 -- 172.21.15.6:0/1866755040 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b40047e0 con 0x5557ec57d060 2023-09-13T09:55:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.373+0000 7f32d608ab80 1 -- 172.21.15.6:0/1866755040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 msgr2=0x5557ec57b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.373+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec57b4c0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f32b4011600 tx=0x7f32b4009920 comp rx=0 tx=0).stop 2023-09-13T09:55:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 -- 172.21.15.6:0/1866755040 shutdown_connections 2023-09-13T09:55:39.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 0x5557ec57be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1866755040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec57b4c0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 -- 172.21.15.6:0/1866755040 >> 172.21.15.6:0/1866755040 conn(0x5557ec4d9c80 msgr2=0x5557ec575f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 -- 172.21.15.6:0/1866755040 shutdown_connections 2023-09-13T09:55:39.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 -- 172.21.15.6:0/1866755040 wait complete. 2023-09-13T09:55:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 -- start start 2023-09-13T09:55:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.376+0000 7f32d608ab80 1 Processor -- start 2023-09-13T09:55:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 0x5557ec588440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec588980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec584fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32d608ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec46bbb0 con 0x5557ec57d060 2023-09-13T09:55:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32d608ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec46b8b0 con 0x5557ec57c700 2023-09-13T09:55:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32d608ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec34f920 con 0x5557ec57ba00 2023-09-13T09:55:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32d608ab80 10 client.0 _ll_register_callbacks cb 0x5557ec469680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:39.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec584fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec588980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec584fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44118/0 (socket says 172.21.15.6:44118) 2023-09-13T09:55:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 -- 172.21.15.6:0/1937779551 learned_addr learned my addr 172.21.15.6:0/1937779551 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 -- 172.21.15.6:0/1937779551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 msgr2=0x5557ec588440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 0x5557ec588440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 -- 172.21.15.6:0/1937779551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 msgr2=0x5557ec588980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec588980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.377+0000 7f32c3fff700 1 -- 172.21.15.6:0/1937779551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b40112b0 con 0x5557ec57d060 2023-09-13T09:55:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32c3fff700 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec584fd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f32bc015000 tx=0x7f32bc009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39a65cb8cb8d4ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:39.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32a2ffd700 1 -- 172.21.15.6:0/1937779551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc02c070 con 0x5557ec57d060 2023-09-13T09:55:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32a2ffd700 1 -- 172.21.15.6:0/1937779551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32bc005690 con 0x5557ec57d060 2023-09-13T09:55:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5557ec56e670 con 0x5557ec57d060 2023-09-13T09:55:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32a2ffd700 1 -- 172.21.15.6:0/1937779551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32bc01d040 con 0x5557ec57d060 2023-09-13T09:55:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32d608ab80 10 client.19764 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:39.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x5557ec4e57a0 con 0x5557ec57d060 2023-09-13T09:55:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32a2ffd700 1 -- 172.21.15.6:0/1937779551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32bc03f080 con 0x5557ec57d060 2023-09-13T09:55:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.378+0000 7f32a2ffd700 1 -- 172.21.15.6:0/1937779551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f32bc03b430 con 0x5557ec57d060 2023-09-13T09:55:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.379+0000 7f32d608ab80 10 client.19764 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.379+0000 7f32d608ab80 10 client.19764 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:39.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.379+0000 7f32d608ab80 20 client.19764 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.379+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec58cdf0 0x5557ec58f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.379+0000 7f32d608ab80 4 client.19764 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:55:39.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.379+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5557ec4c6970 con 0x5557ec58cdf0 2023-09-13T09:55:39.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.382+0000 7f32c37fe700 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec58cdf0 0x5557ec58f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.383+0000 7f32a2ffd700 10 client.19764 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.383+0000 7f32c37fe700 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec58cdf0 0x5557ec58f210 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0bf271de8486b29 server_cookie=f7d5dd7c142c4a32 in_seq=0 out_seq=0 2023-09-13T09:55:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.388+0000 7f32a2ffd700 1 -- 172.21.15.6:0/1937779551 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5557ec4c6970 con 0x5557ec58cdf0 2023-09-13T09:55:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.388+0000 7f32a2ffd700 10 client.19764 handle_command_reply: tid=0 2023-09-13T09:55:39.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.388+0000 7f32d608ab80 1 client.19764 shutdown 2023-09-13T09:55:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 msgr2=0x5557ec584fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec584fd0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f32bc015000 tx=0x7f32bc009310 comp rx=0 tx=0).stop 2023-09-13T09:55:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 shutdown_connections 2023-09-13T09:55:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec58cdf0 0x5557ec58f210 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec584fd0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57ba00 0x5557ec588440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32a2ffd700 0 client.19764 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 --2- 172.21.15.6:0/1937779551 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec588980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 >> 172.21.15.6:0/1937779551 conn(0x5557ec4d9c80 msgr2=0x5557ec5707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 shutdown_connections 2023-09-13T09:55:39.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 1 -- 172.21.15.6:0/1937779551 wait complete. 2023-09-13T09:55:39.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.389+0000 7f32d608ab80 20 client.19764 trim_cache size 0 max 16384 2023-09-13T09:55:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.412+0000 7f32d608ab80 1 Processor -- start 2023-09-13T09:55:39.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.412+0000 7f32d608ab80 1 -- start start 2023-09-13T09:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57ba00 0x5557ec583be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57d060 0x5557ec57a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32d608ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec586060 con 0x5557ec57ba00 2023-09-13T09:55:39.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32d608ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec582b80 con 0x5557ec57c700 2023-09-13T09:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32d608ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec589410 con 0x5557ec57d060 2023-09-13T09:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57ba00 0x5557ec583be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57ba00 0x5557ec583be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44124/0 (socket says 172.21.15.6:44124) 2023-09-13T09:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 -- 172.21.15.6:0/950626348 learned_addr learned my addr 172.21.15.6:0/950626348 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c2ffd700 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c3fff700 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57d060 0x5557ec57a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 -- 172.21.15.6:0/950626348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57d060 msgr2=0x5557ec57a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57d060 0x5557ec57a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 -- 172.21.15.6:0/950626348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 msgr2=0x5557ec57a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.413+0000 7f32c37fe700 1 -- 172.21.15.6:0/950626348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5557ec2f9de0 con 0x5557ec57ba00 2023-09-13T09:55:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.414+0000 7f32c37fe700 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57ba00 0x5557ec583be0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009eb0 tx=0x7f32b4009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2628ce2de94dcdbd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.414+0000 7f32aa7fc700 1 -- 172.21.15.6:0/950626348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b400e070 con 0x5557ec57ba00 2023-09-13T09:55:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.414+0000 7f32aa7fc700 1 -- 172.21.15.6:0/950626348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b4007500 con 0x5557ec57ba00 2023-09-13T09:55:39.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.414+0000 7f32aa7fc700 1 -- 172.21.15.6:0/950626348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4015690 con 0x5557ec57ba00 2023-09-13T09:55:39.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.414+0000 7f32d608ab80 1 -- 172.21.15.6:0/950626348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57ba00 msgr2=0x5557ec583be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57ba00 0x5557ec583be0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009eb0 tx=0x7f32b4009640 comp rx=0 tx=0).stop 2023-09-13T09:55:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 -- 172.21.15.6:0/950626348 shutdown_connections 2023-09-13T09:55:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57d060 0x5557ec57a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57ba00 0x5557ec583be0 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 --2- 172.21.15.6:0/950626348 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57c700 0x5557ec57a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 -- 172.21.15.6:0/950626348 >> 172.21.15.6:0/950626348 conn(0x5557ec4d9c80 msgr2=0x5557ec575e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 -- 172.21.15.6:0/950626348 shutdown_connections 2023-09-13T09:55:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 -- 172.21.15.6:0/950626348 wait complete. 2023-09-13T09:55:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 -- start start 2023-09-13T09:55:39.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.415+0000 7f32d608ab80 1 Processor -- start 2023-09-13T09:55:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57ba00 0x5557ec594b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57c700 0x5557ec595070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32d608ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec5915d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32d608ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec591bf0 con 0x5557ec57d060 2023-09-13T09:55:39.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32d608ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec591d60 con 0x5557ec57ba00 2023-09-13T09:55:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32d608ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5557ec591f20 con 0x5557ec57c700 2023-09-13T09:55:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32d608ab80 10 client.0 _ll_register_callbacks cb 0x5557ec469680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:55:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec5915d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec5915d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44132/0 (socket says 172.21.15.6:44132) 2023-09-13T09:55:39.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 -- 172.21.15.6:0/980148347 learned_addr learned my addr 172.21.15.6:0/980148347 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:55:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c37fe700 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57ba00 0x5557ec594b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 -- 172.21.15.6:0/980148347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57c700 msgr2=0x5557ec595070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:55:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57c700 0x5557ec595070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 -- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57ba00 msgr2=0x5557ec594b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:55:39.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57ba00 0x5557ec594b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 -- 172.21.15.6:0/980148347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5557ec34d630 con 0x5557ec57d060 2023-09-13T09:55:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32c3fff700 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec5915d0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c010 tx=0x7f32bc03b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7c76db80ccd987a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:55:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.416+0000 7f32a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:55:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.417+0000 7f32a2ffd700 1 -- 172.21.15.6:0/980148347 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32bc01d050 con 0x5557ec57d060 2023-09-13T09:55:39.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.417+0000 7f32a2ffd700 1 -- 172.21.15.6:0/980148347 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f32bc0058e0 con 0x5557ec57d060 2023-09-13T09:55:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.417+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f32b400f040 con 0x5557ec57d060 2023-09-13T09:55:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.417+0000 7f32a2ffd700 1 -- 172.21.15.6:0/980148347 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32bc02c040 con 0x5557ec57d060 2023-09-13T09:55:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.417+0000 7f32d608ab80 10 client.19770 fetch_fsmap learned FSMap version 57 2023-09-13T09:55:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.417+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=4+}) v3 -- 0x5557ec2e2c60 con 0x5557ec57d060 2023-09-13T09:55:39.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32a2ffd700 1 -- 172.21.15.6:0/980148347 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f32b400f040 con 0x5557ec57d060 2023-09-13T09:55:39.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32a2ffd700 1 -- 172.21.15.6:0/980148347 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 57) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f32bc026410 con 0x5557ec57d060 2023-09-13T09:55:39.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32d608ab80 10 client.19770 fetch_fsmap finished waiting for FSMap version 57 2023-09-13T09:55:39.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32d608ab80 10 client.19770 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:55:39.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32d608ab80 20 client.19770 populate_metadata read hostname 'smithi006' 2023-09-13T09:55:39.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32d608ab80 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec5f6a40 0x5557ec5f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:55:39.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32d608ab80 4 client.19770 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:55:39.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5557ec487050 con 0x5557ec5f6a40 2023-09-13T09:55:39.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32c37fe700 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec5f6a40 0x5557ec5f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:55:39.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32c37fe700 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec5f6a40 0x5557ec5f8e60 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=704595600f8f0928 server_cookie=e7f24d4f099d85e4 in_seq=0 out_seq=0 2023-09-13T09:55:39.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.418+0000 7f32a2ffd700 10 client.19770 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32a2ffd700 1 -- 172.21.15.6:0/980148347 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5557ec487050 con 0x5557ec5f6a40 2023-09-13T09:55:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32a2ffd700 10 client.19770 handle_command_reply: tid=0 2023-09-13T09:55:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 client.19770 shutdown 2023-09-13T09:55:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 msgr2=0x5557ec5915d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec5915d0 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f32bc00c010 tx=0x7f32bc03b6e0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 shutdown_connections 2023-09-13T09:55:39.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5557ec5f6a40 0x5557ec5f8e60 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5557ec57d060 0x5557ec5915d0 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5557ec57ba00 0x5557ec594b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 --2- 172.21.15.6:0/980148347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5557ec57c700 0x5557ec595070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 >> 172.21.15.6:0/980148347 conn(0x5557ec4d9c80 msgr2=0x5557ec583be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32a2ffd700 0 client.19770 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:55:39.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 shutdown_connections 2023-09-13T09:55:39.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.419+0000 7f32d608ab80 1 -- 172.21.15.6:0/980148347 wait complete. 2023-09-13T09:55:39.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32d608ab80 20 client.19770 trim_cache size 0 max 16384 2023-09-13T09:55:39.435 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:55:39.435 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:55:39.435 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:55:39.435 INFO:teuthology.orchestra.run.smithi006.stdout: "09a97505-2edc-4a9d-bceb-5bee579f10f1": { 2023-09-13T09:55:39.435 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:55:39.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "09a97505-2edc-4a9d-bceb-5bee579f10f1", 2023-09-13T09:55:39.436 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:55:39.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:55:39.436 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:55:39.436 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32ac0a06c0 msgr2=0x7f32ac0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32ac0a06c0 0x7f32ac0a2b80 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f32bc0095c0 tx=0x7f32bc009ca0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4100e80 msgr2=0x7f32c4196f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4100e80 0x7f32c4196f80 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f32b800e9a0 tx=0x7f32b800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 shutdown_connections 2023-09-13T09:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32c4101820 0x7f32c419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f32c40ffc90 0x7f32c4196a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f32ac0a06c0 0x7f32ac0a2b80 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 --2- 172.21.15.6:0/2665460723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32c4100e80 0x7f32c4196f80 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:55:39.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 >> 172.21.15.6:0/2665460723 conn(0x7f32c40fb220 msgr2=0x7f32c40fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:55:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 shutdown_connections 2023-09-13T09:55:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:55:39.420+0000 7f32c9ea5700 1 -- 172.21.15.6:0/2665460723 wait complete. 2023-09-13T09:55:39.440 INFO:tasks.cephfs.filesystem:scrub status for tag:09a97505-2edc-4a9d-bceb-5bee579f10f1 - {'path': '/', 'tag': '09a97505-2edc-4a9d-bceb-5bee579f10f1', 'options': 'recursive,force'} 2023-09-13T09:55:39.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:39 smithi053 ceph-mon[102373]: pgmap v784: 97 pgs: 97 active+clean; 963 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.6 MiB/s wr, 710 op/s 2023-09-13T09:55:39.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:39 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:55:39.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:39 smithi131 ceph-mon[102785]: pgmap v784: 97 pgs: 97 active+clean; 963 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.6 MiB/s wr, 710 op/s 2023-09-13T09:55:39.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:39 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:55:39.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 128742 38.31 MB/sec execute 59 sec latency 62.372 ms 2023-09-13T09:55:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:55:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:40.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:40.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:40.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:40.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:40 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:55:40.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:40.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:40.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:40.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:40.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:40 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:55:40.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:40.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:40.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:40.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:40.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:40.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:40.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:40.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:40 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:40.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 129534 38.48 MB/sec execute 60 sec latency 80.971 ms 2023-09-13T09:55:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:55:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:55:41.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:55:41.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: pgmap v785: 97 pgs: 97 active+clean; 964 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.8 MiB/s wr, 720 op/s 2023-09-13T09:55:41.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:55:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:41.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:55:41.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:55:41.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:55:41.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: pgmap v785: 97 pgs: 97 active+clean; 964 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.8 MiB/s wr, 720 op/s 2023-09-13T09:55:41.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:55:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:55:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:55:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:55:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:55:41.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: pgmap v785: 97 pgs: 97 active+clean; 964 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.8 MiB/s wr, 720 op/s 2023-09-13T09:55:41.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:55:41.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 130239 38.55 MB/sec execute 61 sec latency 48.909 ms 2023-09-13T09:55:42.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 130760 38.33 MB/sec execute 62 sec latency 266.176 ms 2023-09-13T09:55:43.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 131453 38.36 MB/sec execute 63 sec latency 129.357 ms 2023-09-13T09:55:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:43 smithi006 ceph-mon[98665]: pgmap v786: 97 pgs: 97 active+clean; 971 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 845 op/s 2023-09-13T09:55:44.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:43 smithi053 ceph-mon[102373]: pgmap v786: 97 pgs: 97 active+clean; 971 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 845 op/s 2023-09-13T09:55:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:43 smithi131 ceph-mon[102785]: pgmap v786: 97 pgs: 97 active+clean; 971 MiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 845 op/s 2023-09-13T09:55:44.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 132212 38.37 MB/sec execute 64 sec latency 67.165 ms 2023-09-13T09:55:45.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 132990 38.47 MB/sec execute 65 sec latency 54.065 ms 2023-09-13T09:55:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:45 smithi006 ceph-mon[98665]: pgmap v787: 97 pgs: 97 active+clean; 978 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 755 op/s 2023-09-13T09:55:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:45 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:45 smithi053 ceph-mon[102373]: pgmap v787: 97 pgs: 97 active+clean; 978 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 755 op/s 2023-09-13T09:55:46.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:45 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:45 smithi131 ceph-mon[102785]: pgmap v787: 97 pgs: 97 active+clean; 978 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 755 op/s 2023-09-13T09:55:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:45 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:46.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 133740 38.44 MB/sec execute 66 sec latency 53.249 ms 2023-09-13T09:55:47.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 134337 38.21 MB/sec execute 67 sec latency 243.827 ms 2023-09-13T09:55:48.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:47 smithi006 ceph-mon[98665]: pgmap v788: 97 pgs: 97 active+clean; 984 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 863 op/s 2023-09-13T09:55:48.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:47 smithi053 ceph-mon[102373]: pgmap v788: 97 pgs: 97 active+clean; 984 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 863 op/s 2023-09-13T09:55:48.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:47 smithi131 ceph-mon[102785]: pgmap v788: 97 pgs: 97 active+clean; 984 MiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 863 op/s 2023-09-13T09:55:48.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 135085 38.47 MB/sec execute 68 sec latency 82.702 ms 2023-09-13T09:55:49.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 135885 38.48 MB/sec execute 69 sec latency 52.385 ms 2023-09-13T09:55:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:49 smithi006 ceph-mon[98665]: pgmap v789: 97 pgs: 97 active+clean; 987 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 737 op/s 2023-09-13T09:55:50.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:49 smithi053 ceph-mon[102373]: pgmap v789: 97 pgs: 97 active+clean; 987 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 737 op/s 2023-09-13T09:55:50.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:49 smithi131 ceph-mon[102785]: pgmap v789: 97 pgs: 97 active+clean; 987 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.4 MiB/s wr, 737 op/s 2023-09-13T09:55:50.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 136590 38.53 MB/sec execute 70 sec latency 57.679 ms 2023-09-13T09:55:51.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:50 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:51.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:50 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:51.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:50 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:51.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 137405 38.53 MB/sec execute 71 sec latency 51.603 ms 2023-09-13T09:55:52.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:51 smithi006 ceph-mon[98665]: pgmap v790: 97 pgs: 97 active+clean; 992 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.5 MiB/s wr, 722 op/s 2023-09-13T09:55:52.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:51 smithi053 ceph-mon[102373]: pgmap v790: 97 pgs: 97 active+clean; 992 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.5 MiB/s wr, 722 op/s 2023-09-13T09:55:52.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:51 smithi131 ceph-mon[102785]: pgmap v790: 97 pgs: 97 active+clean; 992 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.5 MiB/s wr, 722 op/s 2023-09-13T09:55:52.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 138128 38.58 MB/sec execute 72 sec latency 195.008 ms 2023-09-13T09:55:53.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 138831 38.52 MB/sec execute 73 sec latency 246.441 ms 2023-09-13T09:55:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:53 smithi006 ceph-mon[98665]: pgmap v791: 97 pgs: 97 active+clean; 997 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 829 op/s 2023-09-13T09:55:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:53 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:54.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:53 smithi053 ceph-mon[102373]: pgmap v791: 97 pgs: 97 active+clean; 997 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 829 op/s 2023-09-13T09:55:54.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:53 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:54.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:53 smithi131 ceph-mon[102785]: pgmap v791: 97 pgs: 97 active+clean; 997 MiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 829 op/s 2023-09-13T09:55:54.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:53 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:55:54.567 INFO:tasks.workunit.client.0.smithi006.stdout: 10 139459 38.54 MB/sec execute 74 sec latency 152.129 ms 2023-09-13T09:55:55.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:54 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:55.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:54 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:55.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:54 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:55.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:54 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:55.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:54 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:55.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:54 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:55.275 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:54 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:55.275 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:54 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:55.276 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:54 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:55.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 139938 38.24 MB/sec execute 75 sec latency 520.972 ms 2023-09-13T09:55:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:55:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:55 smithi006 ceph-mon[98665]: pgmap v792: 97 pgs: 97 active+clean; 1003 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 841 op/s 2023-09-13T09:55:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:55:56.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:55 smithi053 ceph-mon[102373]: pgmap v792: 97 pgs: 97 active+clean; 1003 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 841 op/s 2023-09-13T09:55:56.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:56.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:55:56.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:55 smithi131 ceph-mon[102785]: pgmap v792: 97 pgs: 97 active+clean; 1003 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 841 op/s 2023-09-13T09:55:56.568 INFO:tasks.workunit.client.0.smithi006.stdout: 10 140673 38.25 MB/sec execute 76 sec latency 56.419 ms 2023-09-13T09:55:57.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 141558 38.47 MB/sec execute 77 sec latency 56.755 ms 2023-09-13T09:55:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:57 smithi006 ceph-mon[98665]: pgmap v793: 97 pgs: 97 active+clean; 1003 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 821 op/s 2023-09-13T09:55:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:57 smithi053 ceph-mon[102373]: pgmap v793: 97 pgs: 97 active+clean; 1003 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 821 op/s 2023-09-13T09:55:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:57 smithi131 ceph-mon[102785]: pgmap v793: 97 pgs: 97 active+clean; 1003 MiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 821 op/s 2023-09-13T09:55:58.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 142164 38.37 MB/sec execute 78 sec latency 199.024 ms 2023-09-13T09:55:59.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 142893 38.33 MB/sec execute 79 sec latency 71.635 ms 2023-09-13T09:56:00.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:55:59 smithi006 ceph-mon[98665]: pgmap v794: 97 pgs: 97 active+clean; 1006 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 9.5 MiB/s wr, 737 op/s 2023-09-13T09:56:00.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:55:59 smithi053 ceph-mon[102373]: pgmap v794: 97 pgs: 97 active+clean; 1006 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 9.5 MiB/s wr, 737 op/s 2023-09-13T09:56:00.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:55:59 smithi131 ceph-mon[102785]: pgmap v794: 97 pgs: 97 active+clean; 1006 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 9.5 MiB/s wr, 737 op/s 2023-09-13T09:56:00.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 143698 38.49 MB/sec execute 80 sec latency 65.954 ms 2023-09-13T09:56:01.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 144450 38.49 MB/sec execute 81 sec latency 56.200 ms 2023-09-13T09:56:02.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:01 smithi006 ceph-mon[98665]: pgmap v795: 97 pgs: 97 active+clean; 1010 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 754 op/s 2023-09-13T09:56:02.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:01 smithi053 ceph-mon[102373]: pgmap v795: 97 pgs: 97 active+clean; 1010 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 754 op/s 2023-09-13T09:56:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:01 smithi131 ceph-mon[102785]: pgmap v795: 97 pgs: 97 active+clean; 1010 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 754 op/s 2023-09-13T09:56:02.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 145270 38.52 MB/sec execute 82 sec latency 54.544 ms 2023-09-13T09:56:03.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 145898 38.42 MB/sec execute 83 sec latency 312.534 ms 2023-09-13T09:56:04.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:04 smithi006 ceph-mon[98665]: pgmap v796: 97 pgs: 97 active+clean; 1018 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-09-13T09:56:04.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:04 smithi053 ceph-mon[102373]: pgmap v796: 97 pgs: 97 active+clean; 1018 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-09-13T09:56:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:04 smithi131 ceph-mon[102785]: pgmap v796: 97 pgs: 97 active+clean; 1018 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-09-13T09:56:04.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 146687 38.50 MB/sec execute 84 sec latency 75.968 ms 2023-09-13T09:56:05.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 147458 38.67 MB/sec execute 85 sec latency 63.577 ms 2023-09-13T09:56:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:06 smithi006 ceph-mon[98665]: pgmap v797: 97 pgs: 97 active+clean; 1020 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 809 op/s 2023-09-13T09:56:06.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:06 smithi053 ceph-mon[102373]: pgmap v797: 97 pgs: 97 active+clean; 1020 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 809 op/s 2023-09-13T09:56:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:06 smithi131 ceph-mon[102785]: pgmap v797: 97 pgs: 97 active+clean; 1020 MiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 809 op/s 2023-09-13T09:56:06.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 148088 38.51 MB/sec execute 86 sec latency 65.110 ms 2023-09-13T09:56:07.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 148931 38.60 MB/sec execute 87 sec latency 83.080 ms 2023-09-13T09:56:08.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:08 smithi131 ceph-mon[102785]: pgmap v798: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 820 op/s 2023-09-13T09:56:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:08 smithi006 ceph-mon[98665]: pgmap v798: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 820 op/s 2023-09-13T09:56:08.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:08 smithi053 ceph-mon[102373]: pgmap v798: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 11 MiB/s wr, 820 op/s 2023-09-13T09:56:08.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 149596 38.53 MB/sec execute 88 sec latency 286.371 ms 2023-09-13T09:56:09.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:56:09.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 150267 38.53 MB/sec execute 89 sec latency 96.298 ms 2023-09-13T09:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 -- 172.21.15.6:0/3993113344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728100eb0 msgr2=0x7fe728101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/3993113344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728100eb0 0x7fe728101310 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7fe7180099c0 tx=0x7fe718009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 -- 172.21.15.6:0/3993113344 shutdown_connections 2023-09-13T09:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/3993113344 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe728101850 0x7fe728108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/3993113344 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7280ffcc0 0x7fe7281000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/3993113344 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe728100eb0 0x7fe728101310 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 -- 172.21.15.6:0/3993113344 >> 172.21.15.6:0/3993113344 conn(0x7fe7280fb250 msgr2=0x7fe7280fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 -- 172.21.15.6:0/3993113344 shutdown_connections 2023-09-13T09:56:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.610+0000 7fe72fbb3700 1 -- 172.21.15.6:0/3993113344 wait complete. 2023-09-13T09:56:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 Processor -- start 2023-09-13T09:56:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 -- start start 2023-09-13T09:56:09.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7280ffcc0 0x7fe728198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe728100eb0 0x7fe7281991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe728101850 0x7fe7281a0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281a07e0 con 0x7fe7280ffcc0 2023-09-13T09:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281a0950 con 0x7fe728100eb0 2023-09-13T09:56:09.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72fbb3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7281a0b10 con 0x7fe728101850 2023-09-13T09:56:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72d94f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7280ffcc0 0x7fe728198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72d94f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7280ffcc0 0x7fe728198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44142/0 (socket says 172.21.15.6:44142) 2023-09-13T09:56:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72e150700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe728101850 0x7fe7281a0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72d14e700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe728100eb0 0x7fe7281991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.611+0000 7fe72d94f700 1 -- 172.21.15.6:0/1491236375 learned_addr learned my addr 172.21.15.6:0/1491236375 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72d94f700 1 -- 172.21.15.6:0/1491236375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe728101850 msgr2=0x7fe7281a0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72d94f700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe728101850 0x7fe7281a0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72d94f700 1 -- 172.21.15.6:0/1491236375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe728100eb0 msgr2=0x7fe7281991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72d94f700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe728100eb0 0x7fe7281991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72d94f700 1 -- 172.21.15.6:0/1491236375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7180095f0 con 0x7fe7280ffcc0 2023-09-13T09:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72d14e700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe728100eb0 0x7fe7281991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:09.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72d94f700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7280ffcc0 0x7fe728198c70 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0099f0 tx=0x7fe71c009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe726ffd700 1 -- 172.21.15.6:0/1491236375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c012070 con 0x7fe7280ffcc0 2023-09-13T09:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe726ffd700 1 -- 172.21.15.6:0/1491236375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe71c0044e0 con 0x7fe7280ffcc0 2023-09-13T09:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7281a0df0 con 0x7fe7280ffcc0 2023-09-13T09:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe726ffd700 1 -- 172.21.15.6:0/1491236375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0038e0 con 0x7fe7280ffcc0 2023-09-13T09:56:09.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.612+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7281a1210 con 0x7fe7280ffcc0 2023-09-13T09:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.615+0000 7fe726ffd700 1 -- 172.21.15.6:0/1491236375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe71c003a40 con 0x7fe7280ffcc0 2023-09-13T09:56:09.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.615+0000 7fe726ffd700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7100a0640 0x7fe7100a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.616+0000 7fe726ffd700 1 -- 172.21.15.6:0/1491236375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe71c0cb150 con 0x7fe7280ffcc0 2023-09-13T09:56:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.616+0000 7fe72d14e700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7100a0640 0x7fe7100a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.616+0000 7fe72d14e700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7100a0640 0x7fe7100a2b00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe71800b580 tx=0x7fe71801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 Processor -- start 2023-09-13T09:56:09.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 -- start start 2023-09-13T09:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9d7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9d64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d6a00 0x55f47d9d6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d92f780 con 0x55f47d9d7700 2023-09-13T09:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d92d0a0 con 0x55f47d9d6a00 2023-09-13T09:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d928990 con 0x55f47d9d8060 2023-09-13T09:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe72d94f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9d7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe72d94f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9d7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44150/0 (socket says 172.21.15.6:44150) 2023-09-13T09:56:09.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe72d94f700 1 -- 172.21.15.6:0/2647542793 learned_addr learned my addr 172.21.15.6:0/2647542793 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe72d14e700 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9d64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.617+0000 7fe72e150700 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d6a00 0x55f47d9d6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe72d94f700 1 -- 172.21.15.6:0/2647542793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 msgr2=0x55f47d9d64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe72d94f700 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9d64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe72d94f700 1 -- 172.21.15.6:0/2647542793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d6a00 msgr2=0x55f47d9d6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe72d94f700 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d6a00 0x55f47d9d6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe72d94f700 1 -- 172.21.15.6:0/2647542793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f47d7a8630 con 0x55f47d9d7700 2023-09-13T09:56:09.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe72e150700 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d6a00 0x55f47d9d6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:09.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe72d94f700 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9d7b20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe71c094df0 tx=0x7fe71c00d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79c7a3bcdc80d0cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe70ffff700 1 -- 172.21.15.6:0/2647542793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c098ff0 con 0x55f47d9d7700 2023-09-13T09:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe70ffff700 1 -- 172.21.15.6:0/2647542793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe71c083050 con 0x55f47d9d7700 2023-09-13T09:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.618+0000 7fe70ffff700 1 -- 172.21.15.6:0/2647542793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c098b50 con 0x55f47d9d7700 2023-09-13T09:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2647542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 msgr2=0x55f47d9d7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9d7b20 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fe71c094df0 tx=0x7fe71c00d720 comp rx=0 tx=0).stop 2023-09-13T09:56:09.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2647542793 shutdown_connections 2023-09-13T09:56:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d6a00 0x55f47d9d6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9d7b20 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2647542793 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9d64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2647542793 >> 172.21.15.6:0/2647542793 conn(0x55f47d934c80 msgr2=0x55f47d9d0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:09.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2647542793 shutdown_connections 2023-09-13T09:56:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.619+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2647542793 wait complete. 2023-09-13T09:56:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 -- start start 2023-09-13T09:56:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 Processor -- start 2023-09-13T09:56:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9e0010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9e0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d8060 0x55f47d9e7590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d8c6bb0 con 0x55f47d9d7700 2023-09-13T09:56:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d8c68b0 con 0x55f47d9d8060 2023-09-13T09:56:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d7aa920 con 0x55f47d9d6a00 2023-09-13T09:56:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.620+0000 7fe73bd98b80 10 client.0 _ll_register_callbacks cb 0x55f47d8c4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:09.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72d14e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9e0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d8060 0x55f47d9e7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d8060 0x55f47d9e7590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37684/0 (socket says 172.21.15.6:37684) 2023-09-13T09:56:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72d94f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9e0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72d14e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9e0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44158/0 (socket says 172.21.15.6:44158) 2023-09-13T09:56:09.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 -- 172.21.15.6:0/3856501233 learned_addr learned my addr 172.21.15.6:0/3856501233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 -- 172.21.15.6:0/3856501233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 msgr2=0x55f47d9e0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9e0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 -- 172.21.15.6:0/3856501233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 msgr2=0x55f47d9e0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9e0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 -- 172.21.15.6:0/3856501233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7281a1210 con 0x55f47d9d8060 2023-09-13T09:56:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72d94f700 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9e0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe72e150700 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d8060 0x55f47d9e7590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe720011ea0 tx=0x7fe720014600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7438a9e817549485 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe70d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:09.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.621+0000 7fe70d7fa700 1 -- 172.21.15.6:0/3856501233 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000e040 con 0x55f47d9d8060 2023-09-13T09:56:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f47d9c9670 con 0x55f47d9d8060 2023-09-13T09:56:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe70d7fa700 1 -- 172.21.15.6:0/3856501233 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe72002b070 con 0x55f47d9d8060 2023-09-13T09:56:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe70d7fa700 1 -- 172.21.15.6:0/3856501233 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe720014e70 con 0x55f47d9d8060 2023-09-13T09:56:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 10 client.29093 fetch_fsmap learned FSMap version 60 2023-09-13T09:56:09.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55f47d9407a0 con 0x55f47d9d8060 2023-09-13T09:56:09.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe70d7fa700 1 -- 172.21.15.6:0/3856501233 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f47d9c9670 con 0x55f47d9d8060 2023-09-13T09:56:09.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe70d7fa700 1 -- 172.21.15.6:0/3856501233 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe720027550 con 0x55f47d9d8060 2023-09-13T09:56:09.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 10 client.29093 fetch_fsmap finished waiting for FSMap version 60 2023-09-13T09:56:09.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 10 client.29093 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:09.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 20 client.29093 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47d9ebe10 0x55f47d9ee230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 4 client.29093 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:09.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.622+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f47d921970 con 0x55f47d9ebe10 2023-09-13T09:56:09.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.632+0000 7fe72d94f700 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47d9ebe10 0x55f47d9ee230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.633+0000 7fe72d94f700 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47d9ebe10 0x55f47d9ee230 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89031efc33c482a server_cookie=f0262420ef87e20 in_seq=0 out_seq=0 2023-09-13T09:56:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.633+0000 7fe70d7fa700 10 client.29093 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe70d7fa700 1 -- 172.21.15.6:0/3856501233 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f47d921970 con 0x55f47d9ebe10 2023-09-13T09:56:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe70d7fa700 10 client.29093 handle_command_reply: tid=0 2023-09-13T09:56:09.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 client.29093 shutdown 2023-09-13T09:56:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d8060 msgr2=0x55f47d9e7590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d8060 0x55f47d9e7590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe720011ea0 tx=0x7fe720014600 comp rx=0 tx=0).stop 2023-09-13T09:56:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 shutdown_connections 2023-09-13T09:56:09.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d8060 0x55f47d9e7590 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9e0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47d9ebe10 0x55f47d9ee230 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3856501233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d7700 0x55f47d9e0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe70d7fa700 0 client.29093 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:09.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 >> 172.21.15.6:0/3856501233 conn(0x55f47d934c80 msgr2=0x55f47d9cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:09.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 shutdown_connections 2023-09-13T09:56:09.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3856501233 wait complete. 2023-09-13T09:56:09.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.636+0000 7fe73bd98b80 20 client.29093 trim_cache size 0 max 16384 2023-09-13T09:56:09.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 Processor -- start 2023-09-13T09:56:09.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 -- start start 2023-09-13T09:56:09.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9d64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d8060 0x55f47d9dffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d9df4c0 con 0x55f47d9d8060 2023-09-13T09:56:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d9dfb80 con 0x55f47d9d7700 2023-09-13T09:56:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d9d2a40 con 0x55f47d9d6a00 2023-09-13T09:56:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe72e150700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d8060 0x55f47d9dffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe72e150700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d8060 0x55f47d9dffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44168/0 (socket says 172.21.15.6:44168) 2023-09-13T09:56:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe72e150700 1 -- 172.21.15.6:0/3091714911 learned_addr learned my addr 172.21.15.6:0/3091714911 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.660+0000 7fe72d14e700 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe72e150700 1 -- 172.21.15.6:0/3091714911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 msgr2=0x55f47d9d64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe72e150700 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9d64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe72e150700 1 -- 172.21.15.6:0/3091714911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 msgr2=0x55f47d9e7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe72e150700 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe72e150700 1 -- 172.21.15.6:0/3091714911 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f47d754de0 con 0x55f47d9d8060 2023-09-13T09:56:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe72d14e700 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe72e150700 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d8060 0x55f47d9dffd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fe7200278d0 tx=0x7fe720009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47e80eab08970ec9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe724d82700 1 -- 172.21.15.6:0/3091714911 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72000e070 con 0x55f47d9d8060 2023-09-13T09:56:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe724d82700 1 -- 172.21.15.6:0/3091714911 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe72000f040 con 0x55f47d9d8060 2023-09-13T09:56:09.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.661+0000 7fe724d82700 1 -- 172.21.15.6:0/3091714911 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe720027ea0 con 0x55f47d9d8060 2023-09-13T09:56:09.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3091714911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d8060 msgr2=0x55f47d9dffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d8060 0x55f47d9dffd0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fe7200278d0 tx=0x7fe720009510 comp rx=0 tx=0).stop 2023-09-13T09:56:09.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3091714911 shutdown_connections 2023-09-13T09:56:09.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d8060 0x55f47d9dffd0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d6a00 0x55f47d9d64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/3091714911 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3091714911 >> 172.21.15.6:0/3091714911 conn(0x55f47d934c80 msgr2=0x55f47d9da980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3091714911 shutdown_connections 2023-09-13T09:56:09.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 -- 172.21.15.6:0/3091714911 wait complete. 2023-09-13T09:56:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.662+0000 7fe73bd98b80 1 -- start start 2023-09-13T09:56:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 1 Processor -- start 2023-09-13T09:56:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d6a00 0x55f47d9e32f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9e6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d9e6d90 con 0x55f47d9d6a00 2023-09-13T09:56:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d9e6f00 con 0x55f47d9d7700 2023-09-13T09:56:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f47d9e70c0 con 0x55f47d9d8060 2023-09-13T09:56:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe73bd98b80 10 client.0 _ll_register_callbacks cb 0x55f47d8c4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:09.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe72d94f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d6a00 0x55f47d9e32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe72d14e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe72d94f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d6a00 0x55f47d9e32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44170/0 (socket says 172.21.15.6:44170) 2023-09-13T09:56:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe72d94f700 1 -- 172.21.15.6:0/2993763181 learned_addr learned my addr 172.21.15.6:0/2993763181 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.663+0000 7fe72e150700 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9e6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe72d14e700 1 -- 172.21.15.6:0/2993763181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 msgr2=0x55f47d9e6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe72d14e700 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9e6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe72d14e700 1 -- 172.21.15.6:0/2993763181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d6a00 msgr2=0x55f47d9e32f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe72d14e700 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d6a00 0x55f47d9e32f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe72d14e700 1 -- 172.21.15.6:0/2993763181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe728108a50 con 0x55f47d9d7700 2023-09-13T09:56:09.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe72d14e700 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e3830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe718009fd0 tx=0x7fe718009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b66ff3c806310ee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe70d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe70d7fa700 1 -- 172.21.15.6:0/2993763181 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71802a070 con 0x55f47d9d7700 2023-09-13T09:56:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe70d7fa700 1 -- 172.21.15.6:0/2993763181 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe718030350 con 0x55f47d9d7700 2023-09-13T09:56:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe71c083050 con 0x55f47d9d7700 2023-09-13T09:56:09.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.664+0000 7fe70d7fa700 1 -- 172.21.15.6:0/2993763181 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe718030510 con 0x55f47d9d7700 2023-09-13T09:56:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 10 client.29099 fetch_fsmap learned FSMap version 60 2023-09-13T09:56:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55f47d9407a0 con 0x55f47d9d7700 2023-09-13T09:56:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe70d7fa700 1 -- 172.21.15.6:0/2993763181 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe71c083050 con 0x55f47d9d7700 2023-09-13T09:56:09.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe70d7fa700 1 -- 172.21.15.6:0/2993763181 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 60) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fe718038020 con 0x55f47d9d7700 2023-09-13T09:56:09.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 10 client.29099 fetch_fsmap finished waiting for FSMap version 60 2023-09-13T09:56:09.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 10 client.29099 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:09.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 20 client.29099 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:09.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47da40ce0 0x55f47da43100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 4 client.29099 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:56:09.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f47d8e2050 con 0x55f47da40ce0 2023-09-13T09:56:09.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.665+0000 7fe72d94f700 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47da40ce0 0x55f47da43100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.666+0000 7fe70d7fa700 10 client.29099 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:09.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.666+0000 7fe72d94f700 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47da40ce0 0x55f47da43100 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6253304e7dc5cf4b server_cookie=942d07e1e00f50dd in_seq=0 out_seq=0 2023-09-13T09:56:09.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.667+0000 7fe70d7fa700 1 -- 172.21.15.6:0/2993763181 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55f47d8e2050 con 0x55f47da40ce0 2023-09-13T09:56:09.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.667+0000 7fe70d7fa700 10 client.29099 handle_command_reply: tid=0 2023-09-13T09:56:09.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.667+0000 7fe73bd98b80 1 client.29099 shutdown 2023-09-13T09:56:09.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 msgr2=0x55f47d9e3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e3830 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe718009fd0 tx=0x7fe718009310 comp rx=0 tx=0).stop 2023-09-13T09:56:09.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 shutdown_connections 2023-09-13T09:56:09.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f47d9d8060 0x55f47d9e6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f47da40ce0 0x55f47da43100 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f47d9d6a00 0x55f47d9e32f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 --2- 172.21.15.6:0/2993763181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f47d9d7700 0x55f47d9e3830 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe70d7fa700 0 client.29099 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:09.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 >> 172.21.15.6:0/2993763181 conn(0x55f47d934c80 msgr2=0x55f47d9dffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:09.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 shutdown_connections 2023-09-13T09:56:09.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 1 -- 172.21.15.6:0/2993763181 wait complete. 2023-09-13T09:56:09.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe73bd98b80 20 client.29099 trim_cache size 0 max 16384 2023-09-13T09:56:09.683 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:56:09.684 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:56:09.684 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:56:09.684 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:56:09.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7100a0640 msgr2=0x7fe7100a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7100a0640 0x7fe7100a2b00 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe71800b580 tx=0x7fe71801a040 comp rx=0 tx=0).stop 2023-09-13T09:56:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7280ffcc0 msgr2=0x7fe728198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7280ffcc0 0x7fe728198c70 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0099f0 tx=0x7fe71c009d00 comp rx=0 tx=0).stop 2023-09-13T09:56:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 shutdown_connections 2023-09-13T09:56:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe728101850 0x7fe7281a0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.668+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe7100a0640 0x7fe7100a2b00 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.669+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7280ffcc0 0x7fe728198c70 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.669+0000 7fe72fbb3700 1 --2- 172.21.15.6:0/1491236375 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe728100eb0 0x7fe7281991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.669+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 >> 172.21.15.6:0/1491236375 conn(0x7fe7280fb250 msgr2=0x7fe728106750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:09.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.669+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 shutdown_connections 2023-09-13T09:56:09.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.669+0000 7fe72fbb3700 1 -- 172.21.15.6:0/1491236375 wait complete. 2023-09-13T09:56:09.688 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:56:09.688 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:56:09.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 -- 172.21.15.6:0/2063940164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38101820 msgr2=0x7fad381080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2063940164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38101820 0x7fad381080d0 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fad3000b0d0 tx=0x7fad3000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 -- 172.21.15.6:0/2063940164 shutdown_connections 2023-09-13T09:56:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2063940164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad38101820 0x7fad381080d0 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2063940164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad380ffc90 0x7fad381000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2063940164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad38100e80 0x7fad381012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 -- 172.21.15.6:0/2063940164 >> 172.21.15.6:0/2063940164 conn(0x7fad380fb220 msgr2=0x7fad380fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 -- 172.21.15.6:0/2063940164 shutdown_connections 2023-09-13T09:56:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.837+0000 7fad3faf5700 1 -- 172.21.15.6:0/2063940164 wait complete. 2023-09-13T09:56:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 Processor -- start 2023-09-13T09:56:09.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 -- start start 2023-09-13T09:56:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad380ffc90 0x7fad381944c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad38100e80 0x7fad38194a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad38101820 0x7fad38191050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad381917f0 con 0x7fad380ffc90 2023-09-13T09:56:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad38191960 con 0x7fad38101820 2023-09-13T09:56:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3faf5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad38191b20 con 0x7fad38100e80 2023-09-13T09:56:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad380ffc90 0x7fad381944c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad380ffc90 0x7fad381944c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44184/0 (socket says 172.21.15.6:44184) 2023-09-13T09:56:09.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 -- 172.21.15.6:0/2312534495 learned_addr learned my addr 172.21.15.6:0/2312534495 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d090700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad38100e80 0x7fad38194a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 -- 172.21.15.6:0/2312534495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad38100e80 msgr2=0x7fad38194a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad38100e80 0x7fad38194a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 -- 172.21.15.6:0/2312534495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad38101820 msgr2=0x7fad38191050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:09.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad38101820 0x7fad38191050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 -- 172.21.15.6:0/2312534495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad28009520 con 0x7fad380ffc90 2023-09-13T09:56:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.838+0000 7fad3d891700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad380ffc90 0x7fad381944c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fad3400e970 tx=0x7fad3400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.839+0000 7fad2effd700 1 -- 172.21.15.6:0/2312534495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34009790 con 0x7fad380ffc90 2023-09-13T09:56:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.839+0000 7fad2effd700 1 -- 172.21.15.6:0/2312534495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fad3400eec0 con 0x7fad380ffc90 2023-09-13T09:56:09.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.839+0000 7fad2effd700 1 -- 172.21.15.6:0/2312534495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34003cf0 con 0x7fad380ffc90 2023-09-13T09:56:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.839+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad30009d00 con 0x7fad380ffc90 2023-09-13T09:56:09.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.839+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad381a5630 con 0x7fad380ffc90 2023-09-13T09:56:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.840+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad3810b500 con 0x7fad380ffc90 2023-09-13T09:56:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.842+0000 7fad2effd700 1 -- 172.21.15.6:0/2312534495 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fad3400ccd0 con 0x7fad380ffc90 2023-09-13T09:56:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.842+0000 7fad2effd700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fad240a0640 0x7fad240a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:09.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.843+0000 7fad2effd700 1 -- 172.21.15.6:0/2312534495 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fad34014070 con 0x7fad380ffc90 2023-09-13T09:56:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.843+0000 7fad3d090700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fad240a0640 0x7fad240a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.843+0000 7fad3d090700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fad240a0640 0x7fad240a2b00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fad28009df0 tx=0x7fad28009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:09.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:09.847+0000 7fad2effd700 1 -- 172.21.15.6:0/2312534495 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fad34095ac0 con 0x7fad380ffc90 2023-09-13T09:56:10.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.186+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad3810b790 con 0x7fad380ffc90 2023-09-13T09:56:10.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.187+0000 7fad2effd700 1 -- 172.21.15.6:0/2312534495 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+11340 (secure 0 0 0) 0x7fad340990e0 con 0x7fad380ffc90 2023-09-13T09:56:10.189 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:56:10.189 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":61,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":61,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:56:09.903299+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:56:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.189+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fad240a0640 msgr2=0x7fad240a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.189+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fad240a0640 0x7fad240a2b00 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fad28009df0 tx=0x7fad28009260 comp rx=0 tx=0).stop 2023-09-13T09:56:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.189+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad380ffc90 msgr2=0x7fad381944c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.189+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad380ffc90 0x7fad381944c0 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7fad3400e970 tx=0x7fad3400ec80 comp rx=0 tx=0).stop 2023-09-13T09:56:10.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 shutdown_connections 2023-09-13T09:56:10.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fad38101820 0x7fad38191050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fad240a0640 0x7fad240a2b00 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad380ffc90 0x7fad381944c0 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 --2- 172.21.15.6:0/2312534495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fad38100e80 0x7fad38194a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 >> 172.21.15.6:0/2312534495 conn(0x7fad380fb220 msgr2=0x7fad38067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 shutdown_connections 2023-09-13T09:56:10.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.191+0000 7fad3faf5700 1 -- 172.21.15.6:0/2312534495 wait complete. 2023-09-13T09:56:10.194 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 61 2023-09-13T09:56:10.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:56:10.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.366+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/3961551775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 msgr2=0x7f2eb8101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.366+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/3961551775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 0x7f2eb8101310 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0099c0 tx=0x7f2eac009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.366+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/3961551775 shutdown_connections 2023-09-13T09:56:10.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.366+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/3961551775 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb8101850 0x7f2eb8108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.366+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/3961551775 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb80ffcc0 0x7f2eb81000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.366+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/3961551775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 0x7f2eb8101310 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.367+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/3961551775 >> 172.21.15.6:0/3961551775 conn(0x7f2eb80fb250 msgr2=0x7f2eb80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.367+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/3961551775 shutdown_connections 2023-09-13T09:56:10.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.367+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/3961551775 wait complete. 2023-09-13T09:56:10.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.367+0000 7f2ebf6a0700 1 Processor -- start 2023-09-13T09:56:10.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebf6a0700 1 -- start start 2023-09-13T09:56:10.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebf6a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 0x7f2eb8195bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebf6a0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb8101850 0x7f2eb8196100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebf6a0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb819b160 0x7f2eb819d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebf6a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8067fb0 con 0x7f2eb8100eb0 2023-09-13T09:56:10.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebf6a0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb8068120 con 0x7f2eb819b160 2023-09-13T09:56:10.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebf6a0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb80682e0 con 0x7f2eb8101850 2023-09-13T09:56:10.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebdc3d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb819b160 0x7f2eb819d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebcc3b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb8101850 0x7f2eb8196100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebdc3d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb819b160 0x7f2eb819d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37722/0 (socket says 172.21.15.6:37722) 2023-09-13T09:56:10.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebdc3d700 1 -- 172.21.15.6:0/2783865087 learned_addr learned my addr 172.21.15.6:0/2783865087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.368+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 0x7f2eb8195bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebdc3d700 1 -- 172.21.15.6:0/2783865087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb8101850 msgr2=0x7f2eb8196100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebdc3d700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb8101850 0x7f2eb8196100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebdc3d700 1 -- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 msgr2=0x7f2eb8195bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebdc3d700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 0x7f2eb8195bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebdc3d700 1 -- 172.21.15.6:0/2783865087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eac0095f0 con 0x7f2eb819b160 2023-09-13T09:56:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 0x7f2eb8195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebdc3d700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb819b160 0x7f2eb819d550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000ef30 tx=0x7f2eb000c3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2eb67fc700 1 -- 172.21.15.6:0/2783865087 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb0018070 con 0x7f2eb819b160 2023-09-13T09:56:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb8068500 con 0x7f2eb819b160 2023-09-13T09:56:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2eb67fc700 1 -- 172.21.15.6:0/2783865087 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2eb000f040 con 0x7f2eb819b160 2023-09-13T09:56:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2eb67fc700 1 -- 172.21.15.6:0/2783865087 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eb000cd00 con 0x7f2eb819b160 2023-09-13T09:56:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.369+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb8068a90 con 0x7f2eb819b160 2023-09-13T09:56:10.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.373+0000 7f2eb67fc700 1 -- 172.21.15.6:0/2783865087 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2eb0003a00 con 0x7f2eb819b160 2023-09-13T09:56:10.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 Processor -- start 2023-09-13T09:56:10.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 -- start start 2023-09-13T09:56:10.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 0x558f1ea8ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea8b060 0x558f1ea894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea89a00 0x558f1ea89e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1e9e2780 con 0x558f1ea8b060 2023-09-13T09:56:10.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1e9e00a0 con 0x558f1ea8a700 2023-09-13T09:56:10.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1e9db990 con 0x558f1ea89a00 2023-09-13T09:56:10.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2eb67fc700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea00a0640 0x7f2ea00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ebd43c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea8b060 0x558f1ea894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ebd43c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea8b060 0x558f1ea894c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44206/0 (socket says 172.21.15.6:44206) 2023-09-13T09:56:10.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.374+0000 7f2ebd43c700 1 -- 172.21.15.6:0/2089672586 learned_addr learned my addr 172.21.15.6:0/2089672586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebdc3d700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea00a0640 0x7f2ea00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 0x558f1ea8ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea89a00 0x558f1ea89e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2eb67fc700 1 -- 172.21.15.6:0/2783865087 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2eb00cb7b0 con 0x7f2eb819b160 2023-09-13T09:56:10.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebd43c700 1 -- 172.21.15.6:0/2089672586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea89a00 msgr2=0x558f1ea89e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea89a00 0x558f1ea89e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebd43c700 1 -- 172.21.15.6:0/2089672586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 msgr2=0x558f1ea8ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 0x558f1ea8ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebd43c700 1 -- 172.21.15.6:0/2089672586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f1e85b630 con 0x558f1ea8b060 2023-09-13T09:56:10.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea8b060 0x558f1ea894c0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009de0 tx=0x7f2ea800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1765123cfb8cd648 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2ebdc3d700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea00a0640 0x7f2ea00a2b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00c9200 tx=0x7f2eb00092e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2e9f7fe700 1 -- 172.21.15.6:0/2089672586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8009900 con 0x558f1ea8b060 2023-09-13T09:56:10.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2e9f7fe700 1 -- 172.21.15.6:0/2089672586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea800ec20 con 0x558f1ea8b060 2023-09-13T09:56:10.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.375+0000 7f2e9f7fe700 1 -- 172.21.15.6:0/2089672586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80125d0 con 0x558f1ea8b060 2023-09-13T09:56:10.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2089672586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea8b060 msgr2=0x558f1ea894c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea8b060 0x558f1ea894c0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8009de0 tx=0x7f2ea800e4b0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2089672586 shutdown_connections 2023-09-13T09:56:10.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea89a00 0x558f1ea89e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 0x558f1ea8ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2089672586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea8b060 0x558f1ea894c0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2089672586 >> 172.21.15.6:0/2089672586 conn(0x558f1e9e7c80 msgr2=0x558f1ea83f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2089672586 shutdown_connections 2023-09-13T09:56:10.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.376+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2089672586 wait complete. 2023-09-13T09:56:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 -- start start 2023-09-13T09:56:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 Processor -- start 2023-09-13T09:56:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea92ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea93410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea9a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1e979bb0 con 0x558f1ea89a00 2023-09-13T09:56:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1e9798b0 con 0x558f1ea8b060 2023-09-13T09:56:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1e85d920 con 0x558f1ea8a700 2023-09-13T09:56:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.377+0000 7f2ecb885b80 10 client.0 _ll_register_callbacks cb 0x558f1e977680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:10.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea92ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea92ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44212/0 (socket says 172.21.15.6:44212) 2023-09-13T09:56:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2775791082 learned_addr learned my addr 172.21.15.6:0/2775791082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea9a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2775791082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 msgr2=0x558f1ea93410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea93410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 msgr2=0x558f1ea9a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea9a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2775791082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea8009a60 con 0x558f1ea89a00 2023-09-13T09:56:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea92ed0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098e0 tx=0x7f2eac009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e75dda81e89ef1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2e9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2775791082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac01d070 con 0x558f1ea89a00 2023-09-13T09:56:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2775791082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2eac005310 con 0x558f1ea89a00 2023-09-13T09:56:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.378+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f1ea7c670 con 0x558f1ea89a00 2023-09-13T09:56:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2775791082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eac0054d0 con 0x558f1ea89a00 2023-09-13T09:56:10.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 10 client.19806 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x558f1e9f37a0 con 0x558f1ea89a00 2023-09-13T09:56:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2775791082 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558f1ea7c670 con 0x558f1ea89a00 2023-09-13T09:56:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2775791082 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2eac02a450 con 0x558f1ea89a00 2023-09-13T09:56:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 10 client.19806 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:10.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 10 client.19806 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:56:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 20 client.19806 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1ea9ed20 0x558f1eaa1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 4 client.19806 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:10.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f1e9d4970 con 0x558f1ea9ed20 2023-09-13T09:56:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.379+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1ea9ed20 0x558f1eaa1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.380+0000 7f2e9cff9700 10 client.19806 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:10.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.380+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1ea9ed20 0x558f1eaa1140 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2891a7e64305e765 server_cookie=3441079ee1b349dc in_seq=0 out_seq=0 2023-09-13T09:56:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2775791082 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558f1e9d4970 con 0x558f1ea9ed20 2023-09-13T09:56:10.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2e9cff9700 10 client.19806 handle_command_reply: tid=0 2023-09-13T09:56:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 client.19806 shutdown 2023-09-13T09:56:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 msgr2=0x558f1ea92ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea92ed0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f2eac0098e0 tx=0x7f2eac009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 shutdown_connections 2023-09-13T09:56:10.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1ea9ed20 0x558f1eaa1140 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea9a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2e9cff9700 0 client.19806 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea92ed0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2775791082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea93410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 >> 172.21.15.6:0/2775791082 conn(0x558f1e9e7c80 msgr2=0x558f1ea7e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 shutdown_connections 2023-09-13T09:56:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2775791082 wait complete. 2023-09-13T09:56:10.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.387+0000 7f2ecb885b80 20 client.19806 trim_cache size 0 max 16384 2023-09-13T09:56:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.405+0000 7f2ecb885b80 1 Processor -- start 2023-09-13T09:56:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.405+0000 7f2ecb885b80 1 -- start start 2023-09-13T09:56:10.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea9a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea8d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ea91600 con 0x558f1ea89a00 2023-09-13T09:56:10.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ea808e0 con 0x558f1ea8b060 2023-09-13T09:56:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ea85730 con 0x558f1ea8a700 2023-09-13T09:56:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebcc3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebcc3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea894c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44220/0 (socket says 172.21.15.6:44220) 2023-09-13T09:56:10.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebd43c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea9a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2704556234 learned_addr learned my addr 172.21.15.6:0/2704556234 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea8d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebd43c700 1 -- 172.21.15.6:0/2704556234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 msgr2=0x558f1ea8d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea8d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebd43c700 1 -- 172.21.15.6:0/2704556234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 msgr2=0x558f1ea894c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea894c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebd43c700 1 -- 172.21.15.6:0/2704556234 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f1e807de0 con 0x558f1ea8a700 2023-09-13T09:56:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:10.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.406+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea9a410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8013ce0 tx=0x7f2ea8015040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7711eb5a969f1a0a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.407+0000 7f2e9ffff700 1 -- 172.21.15.6:0/2704556234 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea80244c0 con 0x558f1ea8a700 2023-09-13T09:56:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.407+0000 7f2e9ffff700 1 -- 172.21.15.6:0/2704556234 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2ea8013e90 con 0x558f1ea8a700 2023-09-13T09:56:10.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.407+0000 7f2e9ffff700 1 -- 172.21.15.6:0/2704556234 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea8013470 con 0x558f1ea8a700 2023-09-13T09:56:10.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2704556234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 msgr2=0x558f1ea9a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea9a410 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8013ce0 tx=0x7f2ea8015040 comp rx=0 tx=0).stop 2023-09-13T09:56:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2704556234 shutdown_connections 2023-09-13T09:56:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8b060 0x558f1ea8d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2704556234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8a700 0x558f1ea9a410 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2704556234 >> 172.21.15.6:0/2704556234 conn(0x558f1e9e7c80 msgr2=0x558f1ea91bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2704556234 shutdown_connections 2023-09-13T09:56:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2704556234 wait complete. 2023-09-13T09:56:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 -- start start 2023-09-13T09:56:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.408+0000 7f2ecb885b80 1 Processor -- start 2023-09-13T09:56:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea99d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 0x558f1ea9a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8b060 0x558f1ea967f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ea96e90 con 0x558f1ea89a00 2023-09-13T09:56:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ea97000 con 0x558f1ea8a700 2023-09-13T09:56:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f1ea971c0 con 0x558f1ea8b060 2023-09-13T09:56:10.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 10 client.0 _ll_register_callbacks cb 0x558f1e977680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:10.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea99d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea99d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44226/0 (socket says 172.21.15.6:44226) 2023-09-13T09:56:10.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2625366913 learned_addr learned my addr 172.21.15.6:0/2625366913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8b060 0x558f1ea967f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2625366913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8b060 msgr2=0x558f1ea967f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8b060 0x558f1ea967f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2625366913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 msgr2=0x558f1ea9a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 0x558f1ea9a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 -- 172.21.15.6:0/2625366913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f1e9f37a0 con 0x558f1ea89a00 2023-09-13T09:56:10.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ebcc3b700 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea99d50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02a860 tx=0x7f2eac009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143af89686413568 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2e9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2625366913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2eac01d040 con 0x558f1ea89a00 2023-09-13T09:56:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2625366913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2eac0055c0 con 0x558f1ea89a00 2023-09-13T09:56:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.409+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ea800ec20 con 0x558f1ea89a00 2023-09-13T09:56:10.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2625366913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2eac005780 con 0x558f1ea89a00 2023-09-13T09:56:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 10 client.19812 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x558f1e85b630 con 0x558f1ea89a00 2023-09-13T09:56:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2625366913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2eac049080 con 0x558f1ea89a00 2023-09-13T09:56:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2625366913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f2eac00f460 con 0x558f1ea89a00 2023-09-13T09:56:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 10 client.19812 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 10 client.19812 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:56:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 20 client.19812 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1eaf3c70 0x558f1eaf6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 4 client.19812 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:10.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.410+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558f1e995050 con 0x558f1eaf3c70 2023-09-13T09:56:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.411+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1eaf3c70 0x558f1eaf6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.411+0000 7f2e9cff9700 10 client.19812 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.411+0000 7f2ebd43c700 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1eaf3c70 0x558f1eaf6060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=31c64ac25b93da14 server_cookie=571ab7de59d161c3 in_seq=0 out_seq=0 2023-09-13T09:56:10.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2e9cff9700 1 -- 172.21.15.6:0/2625366913 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558f1e995050 con 0x558f1eaf3c70 2023-09-13T09:56:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2e9cff9700 10 client.19812 handle_command_reply: tid=0 2023-09-13T09:56:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 client.19812 shutdown 2023-09-13T09:56:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 msgr2=0x558f1ea99d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea99d50 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f2eac02a860 tx=0x7f2eac009350 comp rx=0 tx=0).stop 2023-09-13T09:56:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 shutdown_connections 2023-09-13T09:56:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x558f1eaf3c70 0x558f1eaf6060 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558f1ea8b060 0x558f1ea967f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558f1ea89a00 0x558f1ea99d50 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 --2- 172.21.15.6:0/2625366913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558f1ea8a700 0x558f1ea9a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2e9cff9700 0 client.19812 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 >> 172.21.15.6:0/2625366913 conn(0x558f1e9e7c80 msgr2=0x558f1ea8d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 shutdown_connections 2023-09-13T09:56:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 1 -- 172.21.15.6:0/2625366913 wait complete. 2023-09-13T09:56:10.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.421+0000 7f2ecb885b80 20 client.19812 trim_cache size 0 max 16384 2023-09-13T09:56:10.432 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:10.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea00a0640 msgr2=0x7f2ea00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea00a0640 0x7f2ea00a2b00 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2eb00c9200 tx=0x7f2eb00092e0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb819b160 msgr2=0x7f2eb819d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb819b160 0x7f2eb819d550 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2eb000ef30 tx=0x7f2eb000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 shutdown_connections 2023-09-13T09:56:10.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2eb819b160 0x7f2eb819d550 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2ea00a0640 0x7f2ea00a2b00 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2eb8100eb0 0x7f2eb8195bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 --2- 172.21.15.6:0/2783865087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2eb8101850 0x7f2eb8196100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 >> 172.21.15.6:0/2783865087 conn(0x7f2eb80fb250 msgr2=0x7f2eb80fd590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 shutdown_connections 2023-09-13T09:56:10.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.422+0000 7f2ebf6a0700 1 -- 172.21.15.6:0/2783865087 wait complete. 2023-09-13T09:56:10.436 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:10 smithi006 ceph-mon[98665]: pgmap v799: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 783 op/s 2023-09-13T09:56:10.438 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:56:10.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:10 smithi053 ceph-mon[102373]: pgmap v799: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 783 op/s 2023-09-13T09:56:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:10 smithi131 ceph-mon[102785]: pgmap v799: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 9.1 MiB/s wr, 783 op/s 2023-09-13T09:56:10.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 150988 38.52 MB/sec execute 90 sec latency 51.148 ms 2023-09-13T09:56:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 -- 172.21.15.6:0/3651927086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f34108dc0 msgr2=0x7f0f3410b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 --2- 172.21.15.6:0/3651927086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f34108dc0 0x7f0f3410b1b0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f0f24009990 tx=0x7f0f24009ca0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 -- 172.21.15.6:0/3651927086 shutdown_connections 2023-09-13T09:56:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 --2- 172.21.15.6:0/3651927086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f3410e130 0x7f0f341105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 --2- 172.21.15.6:0/3651927086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f34108dc0 0x7f0f3410b1b0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 --2- 172.21.15.6:0/3651927086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f3410b6f0 0x7f0f3410dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 -- 172.21.15.6:0/3651927086 >> 172.21.15.6:0/3651927086 conn(0x7f0f3406dc70 msgr2=0x7f0f340700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 -- 172.21.15.6:0/3651927086 shutdown_connections 2023-09-13T09:56:10.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.592+0000 7f0f393b7700 1 -- 172.21.15.6:0/3651927086 wait complete. 2023-09-13T09:56:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.593+0000 7f0f393b7700 1 Processor -- start 2023-09-13T09:56:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.593+0000 7f0f393b7700 1 -- start start 2023-09-13T09:56:10.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.593+0000 7f0f393b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f34108dc0 0x7f0f34108840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.593+0000 7f0f393b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3410b6f0 0x7f0f341a40b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f393b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f3410e130 0x7f0f341a6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f393b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341a6ed0 con 0x7f0f3410b6f0 2023-09-13T09:56:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f393b7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341a7040 con 0x7f0f3410e130 2023-09-13T09:56:10.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f393b7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341a7200 con 0x7f0f34108dc0 2023-09-13T09:56:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f34108dc0 0x7f0f34108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f34108dc0 0x7f0f34108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47294/0 (socket says 172.21.15.6:47294) 2023-09-13T09:56:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f337fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f3410e130 0x7f0f341a6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f32ffd700 1 -- 172.21.15.6:0/296653978 learned_addr learned my addr 172.21.15.6:0/296653978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.594+0000 7f0f327fc700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3410b6f0 0x7f0f341a40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f32ffd700 1 -- 172.21.15.6:0/296653978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f3410e130 msgr2=0x7f0f341a6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f3410e130 0x7f0f341a6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f32ffd700 1 -- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3410b6f0 msgr2=0x7f0f341a40b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3410b6f0 0x7f0f341a40b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f32ffd700 1 -- 172.21.15.6:0/296653978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f240095f0 con 0x7f0f34108dc0 2023-09-13T09:56:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f34108dc0 0x7f0f34108840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f240098e0 tx=0x7f0f2400f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f1bfff700 1 -- 172.21.15.6:0/296653978 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2401d070 con 0x7f0f34108dc0 2023-09-13T09:56:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f341a7480 con 0x7f0f34108dc0 2023-09-13T09:56:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f341a7980 con 0x7f0f34108dc0 2023-09-13T09:56:10.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f1bfff700 1 -- 172.21.15.6:0/296653978 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f2400be60 con 0x7f0f34108dc0 2023-09-13T09:56:10.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.595+0000 7f0f1bfff700 1 -- 172.21.15.6:0/296653978 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24017410 con 0x7f0f34108dc0 2023-09-13T09:56:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.598+0000 7f0f1bfff700 1 -- 172.21.15.6:0/296653978 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0f24021410 con 0x7f0f34108dc0 2023-09-13T09:56:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.599+0000 7f0f1bfff700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f1c0a0710 0x7f0f1c0a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.599+0000 7f0f327fc700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f1c0a0710 0x7f0f1c0a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.599+0000 7f0f1bfff700 1 -- 172.21.15.6:0/296653978 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f240ccdb0 con 0x7f0f34108dc0 2023-09-13T09:56:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.600+0000 7f0f327fc700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f1c0a0710 0x7f0f1c0a2bd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0f341085b0 tx=0x7f0f28009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.601+0000 7f0f4559cb80 1 Processor -- start 2023-09-13T09:56:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f4559cb80 1 -- start start 2023-09-13T09:56:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5b7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd50f780 con 0x55d2bd5b7700 2023-09-13T09:56:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd50d0a0 con 0x55d2bd5b6a00 2023-09-13T09:56:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd508990 con 0x55d2bd5b8060 2023-09-13T09:56:10.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5b7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5b7b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44248/0 (socket says 172.21.15.6:44248) 2023-09-13T09:56:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f32ffd700 1 -- 172.21.15.6:0/3352658266 learned_addr learned my addr 172.21.15.6:0/3352658266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f327fc700 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f337fe700 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f327fc700 1 -- 172.21.15.6:0/3352658266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 msgr2=0x55d2bd5b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f327fc700 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f327fc700 1 -- 172.21.15.6:0/3352658266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 msgr2=0x55d2bd5b7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f327fc700 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5b7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f327fc700 1 -- 172.21.15.6:0/3352658266 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2bd388630 con 0x55d2bd5b8060 2023-09-13T09:56:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.602+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:10.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.603+0000 7f0f327fc700 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5b64c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800e9e0 tx=0x7f0f28011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae5b8bf33f168d47 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.603+0000 7f0f197fa700 1 -- 172.21.15.6:0/3352658266 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28009660 con 0x55d2bd5b8060 2023-09-13T09:56:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.603+0000 7f0f197fa700 1 -- 172.21.15.6:0/3352658266 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f28015940 con 0x55d2bd5b8060 2023-09-13T09:56:10.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.603+0000 7f0f197fa700 1 -- 172.21.15.6:0/3352658266 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28013950 con 0x55d2bd5b8060 2023-09-13T09:56:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.604+0000 7f0f4559cb80 1 -- 172.21.15.6:0/3352658266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 msgr2=0x55d2bd5b64c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.604+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5b64c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800e9e0 tx=0x7f0f28011000 comp rx=0 tx=0).stop 2023-09-13T09:56:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.604+0000 7f0f4559cb80 1 -- 172.21.15.6:0/3352658266 shutdown_connections 2023-09-13T09:56:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.604+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.604+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5b7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.604+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/3352658266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5b64c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.604+0000 7f0f4559cb80 1 -- 172.21.15.6:0/3352658266 >> 172.21.15.6:0/3352658266 conn(0x55d2bd514c80 msgr2=0x55d2bd5b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.605+0000 7f0f4559cb80 1 -- 172.21.15.6:0/3352658266 shutdown_connections 2023-09-13T09:56:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.605+0000 7f0f4559cb80 1 -- 172.21.15.6:0/3352658266 wait complete. 2023-09-13T09:56:10.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 -- start start 2023-09-13T09:56:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 Processor -- start 2023-09-13T09:56:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5bff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd4a6bb0 con 0x55d2bd5b6a00 2023-09-13T09:56:10.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd4a68b0 con 0x55d2bd5b7700 2023-09-13T09:56:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.606+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd38a920 con 0x55d2bd5b8060 2023-09-13T09:56:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f4559cb80 10 client.0 _ll_register_callbacks cb 0x55d2bd4a4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5bff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f327fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f327fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37778/0 (socket says 172.21.15.6:37778) 2023-09-13T09:56:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5bff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44254/0 (socket says 172.21.15.6:44254) 2023-09-13T09:56:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f327fc700 1 -- 172.21.15.6:0/2102628890 learned_addr learned my addr 172.21.15.6:0/2102628890 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f337fe700 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 -- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 msgr2=0x55d2bd5c74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 -- 172.21.15.6:0/2102628890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 msgr2=0x55d2bd5c0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c0470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 -- 172.21.15.6:0/2102628890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2800e6c0 con 0x55d2bd5b6a00 2023-09-13T09:56:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f327fc700 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:10.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5bff30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f0f24096ae0 tx=0x7f0f24009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c982360be165307 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.607+0000 7f0f16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.608+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2102628890 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f240b6070 con 0x55d2bd5b6a00 2023-09-13T09:56:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.608+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2102628890 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f2409a5e0 con 0x55d2bd5b6a00 2023-09-13T09:56:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.608+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d2bd5a9670 con 0x55d2bd5b6a00 2023-09-13T09:56:10.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.608+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2102628890 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f2409e410 con 0x55d2bd5b6a00 2023-09-13T09:56:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.608+0000 7f0f4559cb80 10 client.19824 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.608+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x55d2bd5207a0 con 0x55d2bd5b6a00 2023-09-13T09:56:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.608+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2102628890 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d2bd5a9670 con 0x55d2bd5b6a00 2023-09-13T09:56:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2102628890 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0f240a2130 con 0x55d2bd5b6a00 2023-09-13T09:56:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f4559cb80 10 client.19824 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:10.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f4559cb80 10 client.19824 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:56:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f4559cb80 20 client.19824 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd5cb9a0 0x55d2bd5cddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f4559cb80 4 client.19824 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d2bd501970 con 0x55d2bd5cb9a0 2023-09-13T09:56:10.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.609+0000 7f0f327fc700 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd5cb9a0 0x55d2bd5cddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f16ff5700 10 client.19824 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f327fc700 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd5cb9a0 0x55d2bd5cddc0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=db110d7b0cd747c0 server_cookie=bc08bdbf53a2a5ec in_seq=0 out_seq=0 2023-09-13T09:56:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2102628890 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d2bd501970 con 0x55d2bd5cb9a0 2023-09-13T09:56:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f16ff5700 10 client.19824 handle_command_reply: tid=0 2023-09-13T09:56:10.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f4559cb80 1 client.19824 shutdown 2023-09-13T09:56:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b6a00 msgr2=0x55d2bd5bff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5bff30 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f0f24096ae0 tx=0x7f0f24009ca0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 shutdown_connections 2023-09-13T09:56:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.610+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd5cb9a0 0x55d2bd5cddc0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5bff30 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2102628890 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 >> 172.21.15.6:0/2102628890 conn(0x55d2bd514c80 msgr2=0x55d2bd5ab7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f16ff5700 0 client.19824 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:10.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 shutdown_connections 2023-09-13T09:56:10.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2102628890 wait complete. 2023-09-13T09:56:10.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.611+0000 7f0f4559cb80 20 client.19824 trim_cache size 0 max 16384 2023-09-13T09:56:10.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.626+0000 7f0f4559cb80 1 Processor -- start 2023-09-13T09:56:10.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f4559cb80 1 -- start start 2023-09-13T09:56:10.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b64c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c7470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b8060 0x55d2bd5bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd5bfb00 con 0x55d2bd5b8060 2023-09-13T09:56:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd5b2fd0 con 0x55d2bd5b7700 2023-09-13T09:56:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd5b2730 con 0x55d2bd5b6a00 2023-09-13T09:56:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b8060 0x55d2bd5bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f327fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f327fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37786/0 (socket says 172.21.15.6:37786) 2023-09-13T09:56:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f327fc700 1 -- 172.21.15.6:0/1000451914 learned_addr learned my addr 172.21.15.6:0/1000451914 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b8060 0x55d2bd5bdd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44266/0 (socket says 172.21.15.6:44266) 2023-09-13T09:56:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f337fe700 1 -- 172.21.15.6:0/1000451914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b6a00 msgr2=0x55d2bd5b64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f337fe700 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f337fe700 1 -- 172.21.15.6:0/1000451914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 msgr2=0x55d2bd5c7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f337fe700 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.627+0000 7f0f337fe700 1 -- 172.21.15.6:0/1000451914 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d2bd334de0 con 0x55d2bd5b8060 2023-09-13T09:56:10.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.628+0000 7f0f337fe700 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b8060 0x55d2bd5bdd70 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0117f0 tx=0x7f0f2c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbb2a529ec2badfc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.628+0000 7f0f19ffb700 1 -- 172.21.15.6:0/1000451914 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c00e040 con 0x55d2bd5b8060 2023-09-13T09:56:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.628+0000 7f0f19ffb700 1 -- 172.21.15.6:0/1000451914 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f2c00f040 con 0x55d2bd5b8060 2023-09-13T09:56:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.628+0000 7f0f19ffb700 1 -- 172.21.15.6:0/1000451914 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2c007500 con 0x55d2bd5b8060 2023-09-13T09:56:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 -- 172.21.15.6:0/1000451914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b8060 msgr2=0x55d2bd5bdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b8060 0x55d2bd5bdd70 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c0117f0 tx=0x7f0f2c009920 comp rx=0 tx=0).stop 2023-09-13T09:56:10.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 -- 172.21.15.6:0/1000451914 shutdown_connections 2023-09-13T09:56:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b8060 0x55d2bd5bdd70 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5b64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/1000451914 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 -- 172.21.15.6:0/1000451914 >> 172.21.15.6:0/1000451914 conn(0x55d2bd514c80 msgr2=0x55d2bd5b0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 -- 172.21.15.6:0/1000451914 shutdown_connections 2023-09-13T09:56:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.629+0000 7f0f4559cb80 1 -- 172.21.15.6:0/1000451914 wait complete. 2023-09-13T09:56:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 -- start start 2023-09-13T09:56:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 Processor -- start 2023-09-13T09:56:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5c2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd5c6950 con 0x55d2bd5b7700 2023-09-13T09:56:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd5c6ac0 con 0x55d2bd5b6a00 2023-09-13T09:56:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2bd5c6c80 con 0x55d2bd5b8060 2023-09-13T09:56:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f4559cb80 10 client.0 _ll_register_callbacks cb 0x55d2bd4a4680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:10.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f32ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5c2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44270/0 (socket says 172.21.15.6:44270) 2023-09-13T09:56:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f327fc700 1 -- 172.21.15.6:0/2711315049 learned_addr learned my addr 172.21.15.6:0/2711315049 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.630+0000 7f0f337fe700 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f327fc700 1 -- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 msgr2=0x55d2bd5c6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f327fc700 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f327fc700 1 -- 172.21.15.6:0/2711315049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 msgr2=0x55d2bd5c2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f327fc700 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5c2eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f327fc700 1 -- 172.21.15.6:0/2711315049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f2c0114d0 con 0x55d2bd5b7700 2023-09-13T09:56:10.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f327fc700 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c33f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f0f28004790 tx=0x7f0f2800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af27373d329cef7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2711315049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f280315d0 con 0x55d2bd5b7700 2023-09-13T09:56:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f28015940 con 0x55d2bd5b7700 2023-09-13T09:56:10.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2711315049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0f2802d040 con 0x55d2bd5b7700 2023-09-13T09:56:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2711315049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f28015700 con 0x55d2bd5b7700 2023-09-13T09:56:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f4559cb80 10 client.19830 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.631+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x55d2bd31dc60 con 0x55d2bd5b7700 2023-09-13T09:56:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2711315049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0f28015940 con 0x55d2bd5b7700 2023-09-13T09:56:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2711315049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f0f28039030 con 0x55d2bd5b7700 2023-09-13T09:56:10.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f4559cb80 10 client.19830 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f4559cb80 10 client.19830 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:56:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f4559cb80 20 client.19830 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd6204d0 0x55d2bd6228f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f4559cb80 4 client.19830 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:10.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55d2bd4c2050 con 0x55d2bd6204d0 2023-09-13T09:56:10.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.632+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd6204d0 0x55d2bd6228f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.633+0000 7f0f16ff5700 10 client.19830 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:10.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.633+0000 7f0f32ffd700 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd6204d0 0x55d2bd6228f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3d0df89a4c41ae16 server_cookie=c7bd156e7ea31ad0 in_seq=0 out_seq=0 2023-09-13T09:56:10.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.633+0000 7f0f16ff5700 1 -- 172.21.15.6:0/2711315049 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55d2bd4c2050 con 0x55d2bd6204d0 2023-09-13T09:56:10.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.633+0000 7f0f16ff5700 10 client.19830 handle_command_reply: tid=0 2023-09-13T09:56:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.633+0000 7f0f4559cb80 1 client.19830 shutdown 2023-09-13T09:56:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 msgr2=0x55d2bd5c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c33f0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7f0f28004790 tx=0x7f0f2800e4b0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 shutdown_connections 2023-09-13T09:56:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55d2bd6204d0 0x55d2bd6228f0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d2bd5b8060 0x55d2bd5c6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f16ff5700 0 client.19830 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d2bd5b6a00 0x55d2bd5c2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 --2- 172.21.15.6:0/2711315049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d2bd5b7700 0x55d2bd5c33f0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 >> 172.21.15.6:0/2711315049 conn(0x55d2bd514c80 msgr2=0x55d2bd5bdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 shutdown_connections 2023-09-13T09:56:10.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 1 -- 172.21.15.6:0/2711315049 wait complete. 2023-09-13T09:56:10.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.634+0000 7f0f4559cb80 20 client.19830 trim_cache size 0 max 16384 2023-09-13T09:56:10.649 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f1c0a0710 msgr2=0x7f0f1c0a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f1c0a0710 0x7f0f1c0a2bd0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0f341085b0 tx=0x7f0f28009190 comp rx=0 tx=0).stop 2023-09-13T09:56:10.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f34108dc0 msgr2=0x7f0f34108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f34108dc0 0x7f0f34108840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0f240098e0 tx=0x7f0f2400f690 comp rx=0 tx=0).stop 2023-09-13T09:56:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 shutdown_connections 2023-09-13T09:56:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0f3410e130 0x7f0f341a6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f34108dc0 0x7f0f34108840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0f1c0a0710 0x7f0f1c0a2bd0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 --2- 172.21.15.6:0/296653978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f3410b6f0 0x7f0f341a40b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.635+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 >> 172.21.15.6:0/296653978 conn(0x7f0f3406dc70 msgr2=0x7f0f3410a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.636+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 shutdown_connections 2023-09-13T09:56:10.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.636+0000 7f0f393b7700 1 -- 172.21.15.6:0/296653978 wait complete. 2023-09-13T09:56:10.655 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:56:10.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 -- 172.21.15.6:0/3349437889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66810a620 msgr2=0x7fd6681113f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 --2- 172.21.15.6:0/3349437889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66810a620 0x7fd6681113f0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009990 tx=0x7fd65c009ca0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 -- 172.21.15.6:0/3349437889 shutdown_connections 2023-09-13T09:56:10.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 --2- 172.21.15.6:0/3349437889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810aaf0 0x7fd668113940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 --2- 172.21.15.6:0/3349437889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd668107cb0 0x7fd66810a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 --2- 172.21.15.6:0/3349437889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd66810a620 0x7fd6681113f0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 -- 172.21.15.6:0/3349437889 >> 172.21.15.6:0/3349437889 conn(0x7fd66806e500 msgr2=0x7fd668070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 -- 172.21.15.6:0/3349437889 shutdown_connections 2023-09-13T09:56:10.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.831+0000 7fd66d083700 1 -- 172.21.15.6:0/3349437889 wait complete. 2023-09-13T09:56:10.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.832+0000 7fd66d083700 1 Processor -- start 2023-09-13T09:56:10.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66d083700 1 -- start start 2023-09-13T09:56:10.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66d083700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668107cb0 0x7fd6681a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66d083700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810a620 0x7fd6681a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66d083700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd66810aaf0 0x7fd6681a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66d083700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6681a9000 con 0x7fd668107cb0 2023-09-13T09:56:10.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66d083700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6681a9140 con 0x7fd66810a620 2023-09-13T09:56:10.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66d083700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6681a92d0 con 0x7fd66810aaf0 2023-09-13T09:56:10.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.833+0000 7fd66659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810a620 0x7fd6681a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810a620 0x7fd6681a19c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37806/0 (socket says 172.21.15.6:37806) 2023-09-13T09:56:10.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 -- 172.21.15.6:0/2053031107 learned_addr learned my addr 172.21.15.6:0/2053031107 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd666d9d700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668107cb0 0x7fd6681a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 -- 172.21.15.6:0/2053031107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd66810aaf0 msgr2=0x7fd6681a8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd66810aaf0 0x7fd6681a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 -- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668107cb0 msgr2=0x7fd6681a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668107cb0 0x7fd6681a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 -- 172.21.15.6:0/2053031107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd65c0095f0 con 0x7fd66810a620 2023-09-13T09:56:10.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.834+0000 7fd66659c700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810a620 0x7fd6681a19c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00b680 tx=0x7fd65c005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.840+0000 7fd64ffff700 1 -- 172.21.15.6:0/2053031107 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c01d070 con 0x7fd66810a620 2023-09-13T09:56:10.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.840+0000 7fd64ffff700 1 -- 172.21.15.6:0/2053031107 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd65c004ca0 con 0x7fd66810a620 2023-09-13T09:56:10.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.840+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6681a9550 con 0x7fd66810a620 2023-09-13T09:56:10.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.840+0000 7fd64ffff700 1 -- 172.21.15.6:0/2053031107 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd65c005590 con 0x7fd66810a620 2023-09-13T09:56:10.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.840+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6681a99d0 con 0x7fd66810a620 2023-09-13T09:56:10.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.843+0000 7fd64ffff700 1 -- 172.21.15.6:0/2053031107 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd65c00fc70 con 0x7fd66810a620 2023-09-13T09:56:10.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd64ffff700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6500a06c0 0x7fd6500a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd64ffff700 1 -- 172.21.15.6:0/2053031107 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd65c0ccf70 con 0x7fd66810a620 2023-09-13T09:56:10.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 Processor -- start 2023-09-13T09:56:10.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd666d9d700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6500a06c0 0x7fd6500a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 -- start start 2023-09-13T09:56:10.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba2700 0x55b8c1ba2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1ba14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1afa780 con 0x55b8c1ba2700 2023-09-13T09:56:10.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1af80a0 con 0x55b8c1ba3060 2023-09-13T09:56:10.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.844+0000 7fd679268b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1af3990 con 0x55b8c1ba1a00 2023-09-13T09:56:10.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba2700 0x55b8c1ba2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba2700 0x55b8c1ba2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44294/0 (socket says 172.21.15.6:44294) 2023-09-13T09:56:10.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd66759e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 -- 172.21.15.6:0/1479298087 learned_addr learned my addr 172.21.15.6:0/1479298087 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd66659c700 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1ba14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6500a06c0 0x7fd6500a2b80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd658013650 tx=0x7fd658009b80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 -- 172.21.15.6:0/1479298087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba1a00 msgr2=0x55b8c1ba1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 -- 172.21.15.6:0/1479298087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 msgr2=0x55b8c1ba14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1ba14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 -- 172.21.15.6:0/1479298087 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8c1973630 con 0x55b8c1ba2700 2023-09-13T09:56:10.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.845+0000 7fd666d9d700 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba2700 0x55b8c1ba2b20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd658009fd0 tx=0x7fd658020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd869b272a50df84 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.846+0000 7fd64d7fa700 1 -- 172.21.15.6:0/1479298087 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658013030 con 0x55b8c1ba2700 2023-09-13T09:56:10.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.846+0000 7fd64d7fa700 1 -- 172.21.15.6:0/1479298087 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd658013190 con 0x55b8c1ba2700 2023-09-13T09:56:10.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.846+0000 7fd64d7fa700 1 -- 172.21.15.6:0/1479298087 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658010630 con 0x55b8c1ba2700 2023-09-13T09:56:10.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.847+0000 7fd679268b80 1 -- 172.21.15.6:0/1479298087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba2700 msgr2=0x55b8c1ba2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.847+0000 7fd679268b80 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba2700 0x55b8c1ba2b20 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd658009fd0 tx=0x7fd658020000 comp rx=0 tx=0).stop 2023-09-13T09:56:10.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.847+0000 7fd679268b80 1 -- 172.21.15.6:0/1479298087 shutdown_connections 2023-09-13T09:56:10.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.847+0000 7fd679268b80 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.847+0000 7fd679268b80 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba2700 0x55b8c1ba2b20 secure :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fd658009fd0 tx=0x7fd658020000 comp rx=0 tx=0).stop 2023-09-13T09:56:10.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.847+0000 7fd679268b80 1 --2- 172.21.15.6:0/1479298087 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1ba14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.847+0000 7fd679268b80 1 -- 172.21.15.6:0/1479298087 >> 172.21.15.6:0/1479298087 conn(0x55b8c1affc80 msgr2=0x55b8c1b9bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.849+0000 7fd679268b80 1 -- 172.21.15.6:0/1479298087 shutdown_connections 2023-09-13T09:56:10.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.849+0000 7fd679268b80 1 -- 172.21.15.6:0/1479298087 wait complete. 2023-09-13T09:56:10.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 -- start start 2023-09-13T09:56:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 Processor -- start 2023-09-13T09:56:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bab110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bab650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1bb0680 0x55b8c1bb2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1a91bb0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1a918b0 con 0x55b8c1bb0680 2023-09-13T09:56:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1975920 con 0x55b8c1ba3060 2023-09-13T09:56:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd679268b80 10 client.0 _ll_register_callbacks cb 0x55b8c1a8f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bab110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bab110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44296/0 (socket says 172.21.15.6:44296) 2023-09-13T09:56:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.850+0000 7fd666d9d700 1 -- 172.21.15.6:0/3924015494 learned_addr learned my addr 172.21.15.6:0/3924015494 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd66659c700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bab650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd66759e700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1bb0680 0x55b8c1bb2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd666d9d700 1 -- 172.21.15.6:0/3924015494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 msgr2=0x55b8c1bab650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd666d9d700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bab650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd666d9d700 1 -- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1bb0680 msgr2=0x55b8c1bb2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd666d9d700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1bb0680 0x55b8c1bb2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd666d9d700 1 -- 172.21.15.6:0/3924015494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd658020430 con 0x55b8c1ba1a00 2023-09-13T09:56:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd66759e700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1bb0680 0x55b8c1bb2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:56:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd666d9d700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bab110 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd658009650 tx=0x7fd6580092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd0dd28d38ebacc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd64aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd64aff5700 1 -- 172.21.15.6:0/3924015494 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658005ce0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd64aff5700 1 -- 172.21.15.6:0/3924015494 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd658005450 con 0x55b8c1ba1a00 2023-09-13T09:56:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8c1b94670 con 0x55b8c1ba1a00 2023-09-13T09:56:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd64aff5700 1 -- 172.21.15.6:0/3924015494 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd658011e50 con 0x55b8c1ba1a00 2023-09-13T09:56:10.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd679268b80 10 client.19842 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.851+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x55b8c1b0b7a0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd64aff5700 1 -- 172.21.15.6:0/3924015494 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b8c1b94670 con 0x55b8c1ba1a00 2023-09-13T09:56:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd64aff5700 1 -- 172.21.15.6:0/3924015494 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd65802e070 con 0x55b8c1ba1a00 2023-09-13T09:56:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd679268b80 10 client.19842 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:10.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd679268b80 10 client.19842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:56:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd679268b80 20 client.19842 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd679268b80 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1bb7150 0x55b8c1bb9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd679268b80 4 client.19842 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:10.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.852+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8c1aec970 con 0x55b8c1bb7150 2023-09-13T09:56:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.854+0000 7fd66659c700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1bb7150 0x55b8c1bb9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.855+0000 7fd64aff5700 10 client.19842 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.855+0000 7fd66659c700 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1bb7150 0x55b8c1bb9570 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7264107f455fc0f0 server_cookie=3355156c608f6ed1 in_seq=0 out_seq=0 2023-09-13T09:56:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd64aff5700 1 -- 172.21.15.6:0/3924015494 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b8c1aec970 con 0x55b8c1bb7150 2023-09-13T09:56:10.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd64aff5700 10 client.19842 handle_command_reply: tid=0 2023-09-13T09:56:10.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 client.19842 shutdown 2023-09-13T09:56:10.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 msgr2=0x55b8c1bab110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bab110 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fd658009650 tx=0x7fd6580092e0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 shutdown_connections 2023-09-13T09:56:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1bb7150 0x55b8c1bb9570 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1bb0680 0x55b8c1bb2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bab110 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 --2- 172.21.15.6:0/3924015494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bab650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 >> 172.21.15.6:0/3924015494 conn(0x55b8c1affc80 msgr2=0x55b8c1b967f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd64aff5700 0 client.19842 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 shutdown_connections 2023-09-13T09:56:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 1 -- 172.21.15.6:0/3924015494 wait complete. 2023-09-13T09:56:10.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.856+0000 7fd679268b80 20 client.19842 trim_cache size 0 max 16384 2023-09-13T09:56:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 Processor -- start 2023-09-13T09:56:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 -- start start 2023-09-13T09:56:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1bb0680 0x55b8c1ba5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1b9cb20 con 0x55b8c1bb0680 2023-09-13T09:56:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1bac290 con 0x55b8c1ba1a00 2023-09-13T09:56:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd679268b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1ba22e0 con 0x55b8c1ba3060 2023-09-13T09:56:10.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37828/0 (socket says 172.21.15.6:37828) 2023-09-13T09:56:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd666d9d700 1 -- 172.21.15.6:0/1330905536 learned_addr learned my addr 172.21.15.6:0/1330905536 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd66759e700 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1bb0680 0x55b8c1ba5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.876+0000 7fd66659c700 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.877+0000 7fd666d9d700 1 -- 172.21.15.6:0/1330905536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 msgr2=0x55b8c1bc6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.877+0000 7fd666d9d700 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.877+0000 7fd666d9d700 1 -- 172.21.15.6:0/1330905536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1bb0680 msgr2=0x55b8c1ba5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.877+0000 7fd666d9d700 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1bb0680 0x55b8c1ba5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.877+0000 7fd666d9d700 1 -- 172.21.15.6:0/1330905536 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8c191fde0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.877+0000 7fd66759e700 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1bb0680 0x55b8c1ba5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.877+0000 7fd666d9d700 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba14c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6580058f0 tx=0x7fd658004fc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc93132a45551868 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd64dffb700 1 -- 172.21.15.6:0/1330905536 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658005ce0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd64dffb700 1 -- 172.21.15.6:0/1330905536 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd658004be0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd64dffb700 1 -- 172.21.15.6:0/1330905536 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658013300 con 0x55b8c1ba1a00 2023-09-13T09:56:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 -- 172.21.15.6:0/1330905536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba1a00 msgr2=0x55b8c1ba14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba14c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd6580058f0 tx=0x7fd658004fc0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 -- 172.21.15.6:0/1330905536 shutdown_connections 2023-09-13T09:56:10.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1bb0680 0x55b8c1ba5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba1a00 0x55b8c1ba14c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 --2- 172.21.15.6:0/1330905536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 -- 172.21.15.6:0/1330905536 >> 172.21.15.6:0/1330905536 conn(0x55b8c1affc80 msgr2=0x55b8c1ba9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 -- 172.21.15.6:0/1330905536 shutdown_connections 2023-09-13T09:56:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.879+0000 7fd679268b80 1 -- 172.21.15.6:0/1330905536 wait complete. 2023-09-13T09:56:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 -- start start 2023-09-13T09:56:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 Processor -- start 2023-09-13T09:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bc5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1bb0680 0x55b8c1c096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1bc6820 con 0x55b8c1ba1a00 2023-09-13T09:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1bc6990 con 0x55b8c1ba3060 2023-09-13T09:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8c1c09c80 con 0x55b8c1bb0680 2023-09-13T09:56:10.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd679268b80 10 client.0 _ll_register_callbacks cb 0x55b8c1a8f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.880+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bc5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bc5ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44310/0 (socket says 172.21.15.6:44310) 2023-09-13T09:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 -- 172.21.15.6:0/3448317263 learned_addr learned my addr 172.21.15.6:0/3448317263 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd66659c700 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd66759e700 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1bb0680 0x55b8c1c096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 -- 172.21.15.6:0/3448317263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1bb0680 msgr2=0x55b8c1c096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1bb0680 0x55b8c1c096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 -- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 msgr2=0x55b8c1bc6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:10.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 -- 172.21.15.6:0/3448317263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd660009940 con 0x55b8c1ba1a00 2023-09-13T09:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd666d9d700 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bc5ac0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd6580098f0 tx=0x7fd658012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439ddaba528fb3b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd64aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd64aff5700 1 -- 172.21.15.6:0/3448317263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd658013300 con 0x55b8c1ba1a00 2023-09-13T09:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd64aff5700 1 -- 172.21.15.6:0/3448317263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd658004d50 con 0x55b8c1ba1a00 2023-09-13T09:56:10.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.881+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd658013190 con 0x55b8c1ba1a00 2023-09-13T09:56:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd64aff5700 1 -- 172.21.15.6:0/3448317263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd658005ce0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 10 client.19848 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x55b8c1b0b7a0 con 0x55b8c1ba1a00 2023-09-13T09:56:10.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd64aff5700 1 -- 172.21.15.6:0/3448317263 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd658054080 con 0x55b8c1ba1a00 2023-09-13T09:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd64aff5700 1 -- 172.21.15.6:0/3448317263 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7fd65802e070 con 0x55b8c1ba1a00 2023-09-13T09:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 10 client.19848 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 10 client.19848 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 20 client.19848 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:10.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1c0b1f0 0x55b8c1c0d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 4 client.19848 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.882+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b8c1aad050 con 0x55b8c1c0b1f0 2023-09-13T09:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.883+0000 7fd66659c700 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1c0b1f0 0x55b8c1c0d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.883+0000 7fd66659c700 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1c0b1f0 0x55b8c1c0d610 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3452bf5077d237bd server_cookie=b594b4d49587ca5f in_seq=0 out_seq=0 2023-09-13T09:56:10.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.883+0000 7fd64aff5700 10 client.19848 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.884+0000 7fd64aff5700 1 -- 172.21.15.6:0/3448317263 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b8c1aad050 con 0x55b8c1c0b1f0 2023-09-13T09:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.884+0000 7fd64aff5700 10 client.19848 handle_command_reply: tid=0 2023-09-13T09:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.884+0000 7fd679268b80 1 client.19848 shutdown 2023-09-13T09:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 msgr2=0x55b8c1bc5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bc5ac0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fd6580098f0 tx=0x7fd658012ed0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 shutdown_connections 2023-09-13T09:56:10.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55b8c1c0b1f0 0x55b8c1c0d610 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b8c1bb0680 0x55b8c1c096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b8c1ba1a00 0x55b8c1bc5ac0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 --2- 172.21.15.6:0/3448317263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b8c1ba3060 0x55b8c1bc6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 >> 172.21.15.6:0/3448317263 conn(0x55b8c1affc80 msgr2=0x55b8c1ba9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd64aff5700 0 client.19848 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 shutdown_connections 2023-09-13T09:56:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 1 -- 172.21.15.6:0/3448317263 wait complete. 2023-09-13T09:56:10.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.885+0000 7fd679268b80 20 client.19848 trim_cache size 0 max 16384 2023-09-13T09:56:10.900 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:10.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6500a06c0 msgr2=0x7fd6500a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6500a06c0 0x7fd6500a2b80 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd658013650 tx=0x7fd658009b80 comp rx=0 tx=0).stop 2023-09-13T09:56:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810a620 msgr2=0x7fd6681a19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810a620 0x7fd6681a19c0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00b680 tx=0x7fd65c005ef0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 shutdown_connections 2023-09-13T09:56:10.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd66810aaf0 0x7fd6681a8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6500a06c0 0x7fd6500a2b80 secure :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fd658013650 tx=0x7fd658009b80 comp rx=0 tx=0).stop 2023-09-13T09:56:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd668107cb0 0x7fd6681a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 --2- 172.21.15.6:0/2053031107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd66810a620 0x7fd6681a19c0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.886+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 >> 172.21.15.6:0/2053031107 conn(0x7fd66806e500 msgr2=0x7fd66806fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:10.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.888+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 shutdown_connections 2023-09-13T09:56:10.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:10.888+0000 7fd66d083700 1 -- 172.21.15.6:0/2053031107 wait complete. 2023-09-13T09:56:10.904 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:56:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.065+0000 7f66a6599700 1 -- 172.21.15.6:0/4198760366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0101830 msgr2=0x7f66a01080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.065+0000 7f66a6599700 1 --2- 172.21.15.6:0/4198760366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0101830 0x7f66a01080e0 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f6698009fc0 tx=0x7f669800b330 comp rx=0 tx=0).stop 2023-09-13T09:56:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.066+0000 7f66a6599700 1 -- 172.21.15.6:0/4198760366 shutdown_connections 2023-09-13T09:56:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.066+0000 7f66a6599700 1 --2- 172.21.15.6:0/4198760366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0101830 0x7f66a01080e0 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.066+0000 7f66a6599700 1 --2- 172.21.15.6:0/4198760366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66a00ffca0 0x7f66a01000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.066+0000 7f66a6599700 1 --2- 172.21.15.6:0/4198760366 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66a0100e90 0x7f66a01012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.066+0000 7f66a6599700 1 -- 172.21.15.6:0/4198760366 >> 172.21.15.6:0/4198760366 conn(0x7f66a00fb1f0 msgr2=0x7f66a00fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.066+0000 7f66a6599700 1 -- 172.21.15.6:0/4198760366 shutdown_connections 2023-09-13T09:56:11.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.066+0000 7f66a6599700 1 -- 172.21.15.6:0/4198760366 wait complete. 2023-09-13T09:56:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 Processor -- start 2023-09-13T09:56:11.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 -- start start 2023-09-13T09:56:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66a00ffca0 0x7f66a01949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0100e90 0x7f66a0194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66a0101830 0x7f66a01ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0197fc0 con 0x7f66a0100e90 2023-09-13T09:56:11.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a0198130 con 0x7f66a0101830 2023-09-13T09:56:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a6599700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66a01ad820 con 0x7f66a00ffca0 2023-09-13T09:56:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0100e90 0x7f66a0194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f66a4b36700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66a0101830 0x7f66a01ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0100e90 0x7f66a0194ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44326/0 (socket says 172.21.15.6:44326) 2023-09-13T09:56:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.067+0000 7f669f7fe700 1 -- 172.21.15.6:0/1893926779 learned_addr learned my addr 172.21.15.6:0/1893926779 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669f7fe700 1 -- 172.21.15.6:0/1893926779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66a00ffca0 msgr2=0x7f66a01949a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:56:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669f7fe700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66a00ffca0 0x7f66a01949a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669f7fe700 1 -- 172.21.15.6:0/1893926779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66a0101830 msgr2=0x7f66a01ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669f7fe700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66a0101830 0x7f66a01ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669f7fe700 1 -- 172.21.15.6:0/1893926779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900095f0 con 0x7f66a0100e90 2023-09-13T09:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669f7fe700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0100e90 0x7f66a0194ee0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f6694009940 tx=0x7f6694009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669d7fa700 1 -- 172.21.15.6:0/1893926779 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6694010040 con 0x7f66a0100e90 2023-09-13T09:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669d7fa700 1 -- 172.21.15.6:0/1893926779 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f66940044e0 con 0x7f66a0100e90 2023-09-13T09:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669400b730 con 0x7f66a0100e90 2023-09-13T09:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f669d7fa700 1 -- 172.21.15.6:0/1893926779 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940038e0 con 0x7f66a0100e90 2023-09-13T09:56:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.068+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6698009c40 con 0x7f66a0100e90 2023-09-13T09:56:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.071+0000 7f669d7fa700 1 -- 172.21.15.6:0/1893926779 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f669400e7f0 con 0x7f66a0100e90 2023-09-13T09:56:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.071+0000 7f669d7fa700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66880a0640 0x7f66880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.072+0000 7f669d7fa700 1 -- 172.21.15.6:0/1893926779 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f66940cb630 con 0x7f66a0100e90 2023-09-13T09:56:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.072+0000 7f669ffff700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66880a0640 0x7f66880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.072+0000 7f669ffff700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66880a0640 0x7f66880a2b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f66a0100cf0 tx=0x7f6690009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.072+0000 7f66b277eb80 1 Processor -- start 2023-09-13T09:56:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.072+0000 7f66b277eb80 1 -- start start 2023-09-13T09:56:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed7cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed7b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66b277eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfecd4780 con 0x558bfed7d060 2023-09-13T09:56:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66b277eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfecd20a0 con 0x558bfed7c700 2023-09-13T09:56:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66b277eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfeccd990 con 0x558bfed7ba00 2023-09-13T09:56:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed7cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed7b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed7cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37854/0 (socket says 172.21.15.6:37854) 2023-09-13T09:56:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669ffff700 1 -- 172.21.15.6:0/1216312223 learned_addr learned my addr 172.21.15.6:0/1216312223 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66a4b36700 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669f7fe700 1 -- 172.21.15.6:0/1216312223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 msgr2=0x558bfed7be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669f7fe700 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669f7fe700 1 -- 172.21.15.6:0/1216312223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 msgr2=0x558bfed7cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669f7fe700 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed7cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669f7fe700 1 -- 172.21.15.6:0/1216312223 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bfeb4d630 con 0x558bfed7d060 2023-09-13T09:56:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f669f7fe700 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed7b4c0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f66940c9450 tx=0x7f669400e760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50b0d477d013aa8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.073+0000 7f66867fc700 1 -- 172.21.15.6:0/1216312223 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940994d0 con 0x558bfed7d060 2023-09-13T09:56:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.074+0000 7f66867fc700 1 -- 172.21.15.6:0/1216312223 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6694098dd0 con 0x558bfed7d060 2023-09-13T09:56:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.074+0000 7f66867fc700 1 -- 172.21.15.6:0/1216312223 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66940a09b0 con 0x558bfed7d060 2023-09-13T09:56:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.074+0000 7f66b277eb80 1 -- 172.21.15.6:0/1216312223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 msgr2=0x558bfed7b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed7b4c0 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f66940c9450 tx=0x7f669400e760 comp rx=0 tx=0).stop 2023-09-13T09:56:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 -- 172.21.15.6:0/1216312223 shutdown_connections 2023-09-13T09:56:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed7cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1216312223 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed7b4c0 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 -- 172.21.15.6:0/1216312223 >> 172.21.15.6:0/1216312223 conn(0x558bfecd9c80 msgr2=0x558bfed75f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 -- 172.21.15.6:0/1216312223 shutdown_connections 2023-09-13T09:56:11.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 -- 172.21.15.6:0/1216312223 wait complete. 2023-09-13T09:56:11.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.075+0000 7f66b277eb80 1 -- start start 2023-09-13T09:56:11.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 1 Processor -- start 2023-09-13T09:56:11.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7ba00 0x558bfed84f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7c700 0x558bfed854d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7d060 0x558bfed8c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfec6bbb0 con 0x558bfed7ba00 2023-09-13T09:56:11.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfec6b8b0 con 0x558bfed7d060 2023-09-13T09:56:11.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfeb4f920 con 0x558bfed7c700 2023-09-13T09:56:11.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66b277eb80 10 client.0 _ll_register_callbacks cb 0x558bfec69680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:11.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f669ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7ba00 0x558bfed84f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f669ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7ba00 0x558bfed84f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44336/0 (socket says 172.21.15.6:44336) 2023-09-13T09:56:11.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f669ffff700 1 -- 172.21.15.6:0/4192726098 learned_addr learned my addr 172.21.15.6:0/4192726098 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f66a4b36700 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7d060 0x558bfed8c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.076+0000 7f669f7fe700 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7c700 0x558bfed854d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f66a4b36700 1 -- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7c700 msgr2=0x558bfed854d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f66a4b36700 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7c700 0x558bfed854d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f66a4b36700 1 -- 172.21.15.6:0/4192726098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7ba00 msgr2=0x558bfed84f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f66a4b36700 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7ba00 0x558bfed84f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f66a4b36700 1 -- 172.21.15.6:0/4192726098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6698009c40 con 0x558bfed7d060 2023-09-13T09:56:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f66a4b36700 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7d060 0x558bfed8c510 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6698009f90 tx=0x7f6698007d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84792392483a51a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f667f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f667f7fe700 1 -- 172.21.15.6:0/4192726098 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800e040 con 0x558bfed7d060 2023-09-13T09:56:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558bfed6e670 con 0x558bfed7d060 2023-09-13T09:56:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.077+0000 7f667f7fe700 1 -- 172.21.15.6:0/4192726098 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6698022070 con 0x558bfed7d060 2023-09-13T09:56:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f667f7fe700 1 -- 172.21.15.6:0/4192726098 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6698007e70 con 0x558bfed7d060 2023-09-13T09:56:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 10 client.29162 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x558bfece57a0 con 0x558bfed7d060 2023-09-13T09:56:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f667f7fe700 1 -- 172.21.15.6:0/4192726098 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558bfed6e670 con 0x558bfed7d060 2023-09-13T09:56:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f667f7fe700 1 -- 172.21.15.6:0/4192726098 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f669800b050 con 0x558bfed7d060 2023-09-13T09:56:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 10 client.29162 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 10 client.29162 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:56:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 20 client.29162 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfed90d30 0x558bfed93150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 4 client.29162 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.078+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558bfecc6970 con 0x558bfed90d30 2023-09-13T09:56:11.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.079+0000 7f669ffff700 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfed90d30 0x558bfed93150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.079+0000 7f667f7fe700 10 client.29162 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:11.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.079+0000 7f669ffff700 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfed90d30 0x558bfed93150 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a11813a463054bd6 server_cookie=486f129ac6a1c10e in_seq=0 out_seq=0 2023-09-13T09:56:11.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f667f7fe700 1 -- 172.21.15.6:0/4192726098 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558bfecc6970 con 0x558bfed90d30 2023-09-13T09:56:11.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f667f7fe700 10 client.29162 handle_command_reply: tid=0 2023-09-13T09:56:11.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 client.29162 shutdown 2023-09-13T09:56:11.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7d060 msgr2=0x558bfed8c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7d060 0x558bfed8c510 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f6698009f90 tx=0x7f6698007d00 comp rx=0 tx=0).stop 2023-09-13T09:56:11.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 shutdown_connections 2023-09-13T09:56:11.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfed90d30 0x558bfed93150 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7d060 0x558bfed8c510 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7ba00 0x558bfed84f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f667f7fe700 0 client.29162 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 --2- 172.21.15.6:0/4192726098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7c700 0x558bfed854d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 >> 172.21.15.6:0/4192726098 conn(0x558bfecd9c80 msgr2=0x558bfed707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 shutdown_connections 2023-09-13T09:56:11.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 1 -- 172.21.15.6:0/4192726098 wait complete. 2023-09-13T09:56:11.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.081+0000 7f66b277eb80 20 client.29162 trim_cache size 0 max 16384 2023-09-13T09:56:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.099+0000 7f66b277eb80 1 Processor -- start 2023-09-13T09:56:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66b277eb80 1 -- start start 2023-09-13T09:56:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed8c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed84f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66b277eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfed77a10 con 0x558bfed7d060 2023-09-13T09:56:11.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66b277eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfed6e400 con 0x558bfed7c700 2023-09-13T09:56:11.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66b277eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfed85c10 con 0x558bfed7ba00 2023-09-13T09:56:11.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed84f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed8c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed84f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44348/0 (socket says 172.21.15.6:44348) 2023-09-13T09:56:11.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f669ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 -- 172.21.15.6:0/2287347766 learned_addr learned my addr 172.21.15.6:0/2287347766 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 -- 172.21.15.6:0/2287347766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 msgr2=0x558bfed7b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 --2- 172.21.15.6:0/2287347766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 -- 172.21.15.6:0/2287347766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 msgr2=0x558bfed8c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 --2- 172.21.15.6:0/2287347766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed8c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.100+0000 7f66a4b36700 1 -- 172.21.15.6:0/2287347766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558bfeaf9de0 con 0x558bfed7d060 2023-09-13T09:56:11.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f66a4b36700 1 --2- 172.21.15.6:0/2287347766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed84f90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f669800d010 tx=0x7f6698005b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f373b3a89464f410 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f6686ffd700 1 -- 172.21.15.6:0/2287347766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800e070 con 0x558bfed7d060 2023-09-13T09:56:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f6686ffd700 1 -- 172.21.15.6:0/2287347766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f669802b020 con 0x558bfed7d060 2023-09-13T09:56:11.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f6686ffd700 1 -- 172.21.15.6:0/2287347766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698009460 con 0x558bfed7d060 2023-09-13T09:56:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f66b277eb80 1 -- 172.21.15.6:0/2287347766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 msgr2=0x558bfed84f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f66b277eb80 1 --2- 172.21.15.6:0/2287347766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed84f90 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f669800d010 tx=0x7f6698005b80 comp rx=0 tx=0).stop 2023-09-13T09:56:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f66b277eb80 1 -- 172.21.15.6:0/2287347766 shutdown_connections 2023-09-13T09:56:11.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f66b277eb80 1 --2- 172.21.15.6:0/2287347766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed84f90 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f66b277eb80 1 --2- 172.21.15.6:0/2287347766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed7b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.101+0000 7f66b277eb80 1 --2- 172.21.15.6:0/2287347766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed8c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 -- 172.21.15.6:0/2287347766 >> 172.21.15.6:0/2287347766 conn(0x558bfecd9c80 msgr2=0x558bfed7f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 -- 172.21.15.6:0/2287347766 shutdown_connections 2023-09-13T09:56:11.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 -- 172.21.15.6:0/2287347766 wait complete. 2023-09-13T09:56:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 -- start start 2023-09-13T09:56:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 Processor -- start 2023-09-13T09:56:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed88180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed886c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed8b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfed8bc20 con 0x558bfed7d060 2023-09-13T09:56:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfed8bd90 con 0x558bfed7c700 2023-09-13T09:56:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558bfed8bf50 con 0x558bfed7ba00 2023-09-13T09:56:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66b277eb80 10 client.0 _ll_register_callbacks cb 0x558bfec69680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.102+0000 7f66a4b36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed8b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f669ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed88180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f669f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed886c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed8b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44354/0 (socket says 172.21.15.6:44354) 2023-09-13T09:56:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 -- 172.21.15.6:0/1209776815 learned_addr learned my addr 172.21.15.6:0/1209776815 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 -- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 msgr2=0x558bfed88180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed88180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 -- 172.21.15.6:0/1209776815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 msgr2=0x558bfed886c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed886c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 -- 172.21.15.6:0/1209776815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558bfece57a0 con 0x558bfed7d060 2023-09-13T09:56:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f669ffff700 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed88180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:11.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f669f7fe700 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66a4b36700 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed8b6e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f6698007900 tx=0x7f66980059c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a148ca90e16539 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f667f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f667f7fe700 1 -- 172.21.15.6:0/1209776815 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669800e040 con 0x558bfed7d060 2023-09-13T09:56:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6694098dd0 con 0x558bfed7d060 2023-09-13T09:56:11.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f667f7fe700 1 -- 172.21.15.6:0/1209776815 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6698022040 con 0x558bfed7d060 2023-09-13T09:56:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f667f7fe700 1 -- 172.21.15.6:0/1209776815 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f669800b9f0 con 0x558bfed7d060 2023-09-13T09:56:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.103+0000 7f66b277eb80 10 client.19866 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x558bfeae2c60 con 0x558bfed7d060 2023-09-13T09:56:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f667f7fe700 1 -- 172.21.15.6:0/1209776815 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6694098dd0 con 0x558bfed7d060 2023-09-13T09:56:11.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f667f7fe700 1 -- 172.21.15.6:0/1209776815 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f6698026430 con 0x558bfed7d060 2023-09-13T09:56:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f66b277eb80 10 client.19866 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f66b277eb80 10 client.19866 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:56:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f66b277eb80 20 client.19866 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfede5590 0x558bfede79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f66b277eb80 4 client.19866 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558bfec87050 con 0x558bfede5590 2023-09-13T09:56:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.104+0000 7f669ffff700 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfede5590 0x558bfede79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f669ffff700 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfede5590 0x558bfede79b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=882f137174910a8b server_cookie=7740f736374a1bd3 in_seq=0 out_seq=0 2023-09-13T09:56:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f667f7fe700 10 client.19866 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f667f7fe700 1 -- 172.21.15.6:0/1209776815 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558bfec87050 con 0x558bfede5590 2023-09-13T09:56:11.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f667f7fe700 10 client.19866 handle_command_reply: tid=0 2023-09-13T09:56:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 client.19866 shutdown 2023-09-13T09:56:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 msgr2=0x558bfed8b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed8b6e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f6698007900 tx=0x7f66980059c0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 shutdown_connections 2023-09-13T09:56:11.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558bfede5590 0x558bfede79b0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558bfed7d060 0x558bfed8b6e0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558bfed7ba00 0x558bfed88180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 --2- 172.21.15.6:0/1209776815 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558bfed7c700 0x558bfed886c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 >> 172.21.15.6:0/1209776815 conn(0x558bfecd9c80 msgr2=0x558bfed84f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f667f7fe700 0 client.19866 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 shutdown_connections 2023-09-13T09:56:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.105+0000 7f66b277eb80 1 -- 172.21.15.6:0/1209776815 wait complete. 2023-09-13T09:56:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66b277eb80 20 client.19866 trim_cache size 0 max 16384 2023-09-13T09:56:11.122 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66880a0640 msgr2=0x7f66880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66880a0640 0x7f66880a2b00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f66a0100cf0 tx=0x7f6690009310 comp rx=0 tx=0).stop 2023-09-13T09:56:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0100e90 msgr2=0x7f66a0194ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0100e90 0x7f66a0194ee0 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f6694009940 tx=0x7f6694009d00 comp rx=0 tx=0).stop 2023-09-13T09:56:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 shutdown_connections 2023-09-13T09:56:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66a0101830 0x7f66a01ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66a00ffca0 0x7f66a01949a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66880a0640 0x7f66880a2b00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 --2- 172.21.15.6:0/1893926779 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66a0100e90 0x7f66a0194ee0 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 >> 172.21.15.6:0/1893926779 conn(0x7f66a00fb1f0 msgr2=0x7f66a01066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 shutdown_connections 2023-09-13T09:56:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.106+0000 7f66a6599700 1 -- 172.21.15.6:0/1893926779 wait complete. 2023-09-13T09:56:11.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:56:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 -- 172.21.15.6:0/3161382002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1058100ef0 msgr2=0x7f1058101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 --2- 172.21.15.6:0/3161382002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1058100ef0 0x7f1058101370 secure :-1 s=READY pgs=1591 cs=0 l=1 rev1=1 crypto rx=0x7f1048009990 tx=0x7f1048009ca0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 -- 172.21.15.6:0/3161382002 shutdown_connections 2023-09-13T09:56:11.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 --2- 172.21.15.6:0/3161382002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10581018b0 0x7f1058108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 --2- 172.21.15.6:0/3161382002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10581001e0 0x7f1058100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 --2- 172.21.15.6:0/3161382002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1058100ef0 0x7f1058101370 unknown :-1 s=CLOSED pgs=1591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 -- 172.21.15.6:0/3161382002 >> 172.21.15.6:0/3161382002 conn(0x7f10580fa9b0 msgr2=0x7f10580fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 -- 172.21.15.6:0/3161382002 shutdown_connections 2023-09-13T09:56:11.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.277+0000 7f105fe39700 1 -- 172.21.15.6:0/3161382002 wait complete. 2023-09-13T09:56:11.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 Processor -- start 2023-09-13T09:56:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 -- start start 2023-09-13T09:56:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10581001e0 0x7f1058196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1058100ef0 0x7f1058197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10581018b0 0x7f105819e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105819e660 con 0x7f10581018b0 2023-09-13T09:56:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105819e7a0 con 0x7f1058100ef0 2023-09-13T09:56:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105fe39700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105819e930 con 0x7f10581001e0 2023-09-13T09:56:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105dbd5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10581001e0 0x7f1058196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105dbd5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10581001e0 0x7f1058196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47418/0 (socket says 172.21.15.6:47418) 2023-09-13T09:56:11.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105e3d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10581018b0 0x7f105819e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.278+0000 7f105dbd5700 1 -- 172.21.15.6:0/1609868034 learned_addr learned my addr 172.21.15.6:0/1609868034 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105d3d4700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1058100ef0 0x7f1058197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105e3d6700 1 -- 172.21.15.6:0/1609868034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10581001e0 msgr2=0x7f1058196ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105e3d6700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10581001e0 0x7f1058196ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105e3d6700 1 -- 172.21.15.6:0/1609868034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1058100ef0 msgr2=0x7f1058197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105e3d6700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1058100ef0 0x7f1058197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105e3d6700 1 -- 172.21.15.6:0/1609868034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10480095f0 con 0x7f10581018b0 2023-09-13T09:56:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105d3d4700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1058100ef0 0x7f1058197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:56:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105e3d6700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10581018b0 0x7f105819e090 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f105000efc0 tx=0x7f105000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f104effd700 1 -- 172.21.15.6:0/1609868034 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050018070 con 0x7f10581018b0 2023-09-13T09:56:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105819ebb0 con 0x7f10581018b0 2023-09-13T09:56:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f104effd700 1 -- 172.21.15.6:0/1609868034 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f105000f040 con 0x7f10581018b0 2023-09-13T09:56:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.279+0000 7f104effd700 1 -- 172.21.15.6:0/1609868034 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105000ce10 con 0x7f10581018b0 2023-09-13T09:56:11.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.280+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105819f070 con 0x7f10581018b0 2023-09-13T09:56:11.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.282+0000 7f104effd700 1 -- 172.21.15.6:0/1609868034 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1050003a00 con 0x7f10581018b0 2023-09-13T09:56:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.282+0000 7f104effd700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10440a0640 0x7f10440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.283+0000 7f105dbd5700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10440a0640 0x7f10440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.283+0000 7f104effd700 1 -- 172.21.15.6:0/1609868034 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10500cb7a0 con 0x7f10581018b0 2023-09-13T09:56:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.283+0000 7f105dbd5700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10440a0640 0x7f10440a2b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1054005950 tx=0x7f1054009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.284+0000 7f106c01eb80 1 Processor -- start 2023-09-13T09:56:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.284+0000 7f106c01eb80 1 -- start start 2023-09-13T09:56:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bd1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bd04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f106c01eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2b29780 con 0x55e6a2bd2060 2023-09-13T09:56:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f106c01eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2b270a0 con 0x55e6a2bd0a00 2023-09-13T09:56:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f106c01eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2b22990 con 0x55e6a2bd1700 2023-09-13T09:56:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bd04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bd04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44374/0 (socket says 172.21.15.6:44374) 2023-09-13T09:56:11.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 -- 172.21.15.6:0/3256632941 learned_addr learned my addr 172.21.15.6:0/3256632941 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105dbd5700 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bd1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105e3d6700 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 -- 172.21.15.6:0/3256632941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 msgr2=0x55e6a2bd1b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bd1b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 -- 172.21.15.6:0/3256632941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 msgr2=0x55e6a2bd0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 -- 172.21.15.6:0/3256632941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6a29a2630 con 0x55e6a2bd2060 2023-09-13T09:56:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f105d3d4700 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bd04c0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f1048005b40 tx=0x7f1048005ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eedfddef9b5434f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.285+0000 7f1043fff700 1 -- 172.21.15.6:0/3256632941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104801e070 con 0x55e6a2bd2060 2023-09-13T09:56:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f1043fff700 1 -- 172.21.15.6:0/3256632941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f104800bd30 con 0x55e6a2bd2060 2023-09-13T09:56:11.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f1043fff700 1 -- 172.21.15.6:0/3256632941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048005290 con 0x55e6a2bd2060 2023-09-13T09:56:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 -- 172.21.15.6:0/3256632941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 msgr2=0x55e6a2bd04c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bd04c0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f1048005b40 tx=0x7f1048005ec0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 -- 172.21.15.6:0/3256632941 shutdown_connections 2023-09-13T09:56:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bd1b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3256632941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bd04c0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 -- 172.21.15.6:0/3256632941 >> 172.21.15.6:0/3256632941 conn(0x55e6a2b2ec80 msgr2=0x55e6a2bcaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 -- 172.21.15.6:0/3256632941 shutdown_connections 2023-09-13T09:56:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.286+0000 7f106c01eb80 1 -- 172.21.15.6:0/3256632941 wait complete. 2023-09-13T09:56:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 -- start start 2023-09-13T09:56:11.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 Processor -- start 2023-09-13T09:56:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bda350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2ac0bb0 con 0x55e6a2bd0a00 2023-09-13T09:56:11.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2ac08b0 con 0x55e6a2bd2060 2023-09-13T09:56:11.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a29a4920 con 0x55e6a2bd1700 2023-09-13T09:56:11.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f106c01eb80 10 client.0 _ll_register_callbacks cb 0x55e6a2abe680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:11.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f105dbd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f105dbd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44378/0 (socket says 172.21.15.6:44378) 2023-09-13T09:56:11.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.287+0000 7f105dbd5700 1 -- 172.21.15.6:0/3288840987 learned_addr learned my addr 172.21.15.6:0/3288840987 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105e3d6700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105d3d4700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bda350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105dbd5700 1 -- 172.21.15.6:0/3288840987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 msgr2=0x55e6a2bda350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105dbd5700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bda350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105dbd5700 1 -- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd2060 msgr2=0x55e6a2be1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105dbd5700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105dbd5700 1 -- 172.21.15.6:0/3288840987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1058108a70 con 0x55e6a2bd0a00 2023-09-13T09:56:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105e3d6700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f105dbd5700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd9e10 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f105401dd20 tx=0x7f10540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b8f45ce2850073 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f10417fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:11.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f10417fa700 1 -- 172.21.15.6:0/3288840987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054022070 con 0x55e6a2bd0a00 2023-09-13T09:56:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f10417fa700 1 -- 172.21.15.6:0/3288840987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f105401cd00 con 0x55e6a2bd0a00 2023-09-13T09:56:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6a2bc3670 con 0x55e6a2bd0a00 2023-09-13T09:56:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f10417fa700 1 -- 172.21.15.6:0/3288840987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f105401cec0 con 0x55e6a2bd0a00 2023-09-13T09:56:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f106c01eb80 10 client.19878 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.288+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x55e6a2b3a7a0 con 0x55e6a2bd0a00 2023-09-13T09:56:11.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f10417fa700 1 -- 172.21.15.6:0/3288840987 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e6a2bc3670 con 0x55e6a2bd0a00 2023-09-13T09:56:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f10417fa700 1 -- 172.21.15.6:0/3288840987 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1054005020 con 0x55e6a2bd0a00 2023-09-13T09:56:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f106c01eb80 10 client.19878 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f106c01eb80 10 client.19878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f106c01eb80 20 client.19878 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:11.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2be9fc0 0x55e6a2bec3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f106c01eb80 4 client.19878 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6a2b1b970 con 0x55e6a2be9fc0 2023-09-13T09:56:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f105d3d4700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2be9fc0 0x55e6a2bec3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f10417fa700 10 client.19878 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:11.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.289+0000 7f105d3d4700 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2be9fc0 0x55e6a2bec3e0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5526853dd3529bdd server_cookie=37620ae7adec9b2c in_seq=0 out_seq=0 2023-09-13T09:56:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f10417fa700 1 -- 172.21.15.6:0/3288840987 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e6a2b1b970 con 0x55e6a2be9fc0 2023-09-13T09:56:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f10417fa700 10 client.19878 handle_command_reply: tid=0 2023-09-13T09:56:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 client.19878 shutdown 2023-09-13T09:56:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd0a00 msgr2=0x55e6a2bd9e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd9e10 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f105401dd20 tx=0x7f10540047c0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 shutdown_connections 2023-09-13T09:56:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2be9fc0 0x55e6a2bec3e0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd9e10 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f10417fa700 0 client.19878 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 --2- 172.21.15.6:0/3288840987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bda350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.294+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 >> 172.21.15.6:0/3288840987 conn(0x55e6a2b2ec80 msgr2=0x55e6a2bc57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.295+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 shutdown_connections 2023-09-13T09:56:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.295+0000 7f106c01eb80 1 -- 172.21.15.6:0/3288840987 wait complete. 2023-09-13T09:56:11.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.295+0000 7f106c01eb80 20 client.19878 trim_cache size 0 max 16384 2023-09-13T09:56:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 Processor -- start 2023-09-13T09:56:11.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 -- start start 2023-09-13T09:56:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd1700 0x55e6a2bcbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2bd99b0 con 0x55e6a2bd1700 2023-09-13T09:56:11.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2bccfd0 con 0x55e6a2bd0a00 2023-09-13T09:56:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f106c01eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2bd8620 con 0x55e6a2bd2060 2023-09-13T09:56:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f105d3d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd1700 0x55e6a2bcbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f105d3d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd1700 0x55e6a2bcbfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44388/0 (socket says 172.21.15.6:44388) 2023-09-13T09:56:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f105d3d4700 1 -- 172.21.15.6:0/2355218664 learned_addr learned my addr 172.21.15.6:0/2355218664 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f105dbd5700 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.310+0000 7f105e3d6700 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f105d3d4700 1 -- 172.21.15.6:0/2355218664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd2060 msgr2=0x55e6a2be1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f105d3d4700 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f105d3d4700 1 -- 172.21.15.6:0/2355218664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 msgr2=0x55e6a2bd04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f105d3d4700 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f105d3d4700 1 -- 172.21.15.6:0/2355218664 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6a294ede0 con 0x55e6a2bd1700 2023-09-13T09:56:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f105dbd5700 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f105d3d4700 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd1700 0x55e6a2bcbfb0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1048024040 tx=0x7f104800b3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42f5b495166fbd5a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f104cff9700 1 -- 172.21.15.6:0/2355218664 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f104801e040 con 0x55e6a2bd1700 2023-09-13T09:56:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f104cff9700 1 -- 172.21.15.6:0/2355218664 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f104800b7f0 con 0x55e6a2bd1700 2023-09-13T09:56:11.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.311+0000 7f104cff9700 1 -- 172.21.15.6:0/2355218664 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1048005080 con 0x55e6a2bd1700 2023-09-13T09:56:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 -- 172.21.15.6:0/2355218664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd1700 msgr2=0x55e6a2bcbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd1700 0x55e6a2bcbfb0 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f1048024040 tx=0x7f104800b3d0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 -- 172.21.15.6:0/2355218664 shutdown_connections 2023-09-13T09:56:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd2060 0x55e6a2be1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bd04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2355218664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd1700 0x55e6a2bcbfb0 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 -- 172.21.15.6:0/2355218664 >> 172.21.15.6:0/2355218664 conn(0x55e6a2b2ec80 msgr2=0x55e6a2bd0de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 -- 172.21.15.6:0/2355218664 shutdown_connections 2023-09-13T09:56:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 -- 172.21.15.6:0/2355218664 wait complete. 2023-09-13T09:56:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 -- start start 2023-09-13T09:56:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.312+0000 7f106c01eb80 1 Processor -- start 2023-09-13T09:56:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bdc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bdccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f106c01eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bdfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f106c01eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2be0230 con 0x55e6a2bd2060 2023-09-13T09:56:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f106c01eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2be03a0 con 0x55e6a2bd0a00 2023-09-13T09:56:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f106c01eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6a2be0560 con 0x55e6a2bd1700 2023-09-13T09:56:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f106c01eb80 10 client.0 _ll_register_callbacks cb 0x55e6a2abe680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bdfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105dbd5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bdc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105d3d4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bdccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bdfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44396/0 (socket says 172.21.15.6:44396) 2023-09-13T09:56:11.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 -- 172.21.15.6:0/2495888080 learned_addr learned my addr 172.21.15.6:0/2495888080 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:11.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105dbd5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bdc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:37916/0 (socket says 172.21.15.6:37916) 2023-09-13T09:56:11.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 -- 172.21.15.6:0/2495888080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 msgr2=0x55e6a2bdccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bdccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 -- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 msgr2=0x55e6a2bdc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bdc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 -- 172.21.15.6:0/2495888080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e6a2b3a7a0 con 0x55e6a2bd2060 2023-09-13T09:56:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105dbd5700 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bdc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:56:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105d3d4700 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bdccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:11.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f105e3d6700 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bdfcf0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f1050098f60 tx=0x7f1050099510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd96bff571d4844 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.313+0000 7f10417fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f10417fa700 1 -- 172.21.15.6:0/2495888080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105009ce00 con 0x55e6a2bd2060 2023-09-13T09:56:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f10417fa700 1 -- 172.21.15.6:0/2495888080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f10500b8040 con 0x55e6a2bd2060 2023-09-13T09:56:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f104800bd30 con 0x55e6a2bd2060 2023-09-13T09:56:11.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f10417fa700 1 -- 172.21.15.6:0/2495888080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10500a0fb0 con 0x55e6a2bd2060 2023-09-13T09:56:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 10 client.19884 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x55e6a29a2630 con 0x55e6a2bd2060 2023-09-13T09:56:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f10417fa700 1 -- 172.21.15.6:0/2495888080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f104800bd30 con 0x55e6a2bd2060 2023-09-13T09:56:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f10417fa700 1 -- 172.21.15.6:0/2495888080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f1050094f50 con 0x55e6a2bd2060 2023-09-13T09:56:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 10 client.19884 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:11.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 10 client.19884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 20 client.19884 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2c3e290 0x55e6a2c406b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 4 client.19884 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e6a2adc050 con 0x55e6a2c3e290 2023-09-13T09:56:11.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.314+0000 7f105dbd5700 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2c3e290 0x55e6a2c406b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.315+0000 7f105dbd5700 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2c3e290 0x55e6a2c406b0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8e866925feab2b server_cookie=67d7cca1f219bf97 in_seq=0 out_seq=0 2023-09-13T09:56:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.315+0000 7f10417fa700 10 client.19884 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f10417fa700 1 -- 172.21.15.6:0/2495888080 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e6a2adc050 con 0x55e6a2c3e290 2023-09-13T09:56:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f10417fa700 10 client.19884 handle_command_reply: tid=0 2023-09-13T09:56:11.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 client.19884 shutdown 2023-09-13T09:56:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 msgr2=0x55e6a2bdfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bdfcf0 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f1050098f60 tx=0x7f1050099510 comp rx=0 tx=0).stop 2023-09-13T09:56:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 shutdown_connections 2023-09-13T09:56:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e6a2c3e290 0x55e6a2c406b0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e6a2bd2060 0x55e6a2bdfcf0 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f10417fa700 0 client.19884 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e6a2bd0a00 0x55e6a2bdc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 --2- 172.21.15.6:0/2495888080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e6a2bd1700 0x55e6a2bdccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 >> 172.21.15.6:0/2495888080 conn(0x55e6a2b2ec80 msgr2=0x55e6a2bd8b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 shutdown_connections 2023-09-13T09:56:11.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 1 -- 172.21.15.6:0/2495888080 wait complete. 2023-09-13T09:56:11.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.316+0000 7f106c01eb80 20 client.19884 trim_cache size 0 max 16384 2023-09-13T09:56:11.333 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:11.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10440a0640 msgr2=0x7f10440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10440a0640 0x7f10440a2b00 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f1054005950 tx=0x7f1054009260 comp rx=0 tx=0).stop 2023-09-13T09:56:11.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10581018b0 msgr2=0x7f105819e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:11.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10581018b0 0x7f105819e090 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f105000efc0 tx=0x7f105000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 shutdown_connections 2023-09-13T09:56:11.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10440a0640 0x7f10440a2b00 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10581018b0 0x7f105819e090 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10581001e0 0x7f1058196ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 --2- 172.21.15.6:0/1609868034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1058100ef0 0x7f1058197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 >> 172.21.15.6:0/1609868034 conn(0x7f10580fa9b0 msgr2=0x7f10580fb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 shutdown_connections 2023-09-13T09:56:11.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:11.317+0000 7f105fe39700 1 -- 172.21.15.6:0/1609868034 wait complete. 2023-09-13T09:56:11.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:11 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:11.337 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:11 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2312534495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:56:11.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:11 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:11.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:11 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2312534495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:56:11.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:11 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:11.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:11 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2312534495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:56:11.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 151747 38.51 MB/sec execute 91 sec latency 97.814 ms 2023-09-13T09:56:12.339 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:56:12.339 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:56:12.369 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:12 smithi006 ceph-mon[98665]: pgmap v800: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.8 MiB/s wr, 732 op/s 2023-09-13T09:56:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 -- 172.21.15.6:0/2897790385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e20100eb0 msgr2=0x7f3e20101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 --2- 172.21.15.6:0/2897790385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e20100eb0 0x7f3e20101310 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f3e14009920 tx=0x7f3e14009c30 comp rx=0 tx=0).stop 2023-09-13T09:56:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 -- 172.21.15.6:0/2897790385 shutdown_connections 2023-09-13T09:56:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 --2- 172.21.15.6:0/2897790385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20101850 0x7f3e20108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 --2- 172.21.15.6:0/2897790385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e200ffcc0 0x7f3e201000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 --2- 172.21.15.6:0/2897790385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e20100eb0 0x7f3e20101310 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 -- 172.21.15.6:0/2897790385 >> 172.21.15.6:0/2897790385 conn(0x7f3e200fb210 msgr2=0x7f3e200fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.504+0000 7f3e25148700 1 -- 172.21.15.6:0/2897790385 shutdown_connections 2023-09-13T09:56:12.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.505+0000 7f3e25148700 1 -- 172.21.15.6:0/2897790385 wait complete. 2023-09-13T09:56:12.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:12 smithi053 ceph-mon[102373]: pgmap v800: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.8 MiB/s wr, 732 op/s 2023-09-13T09:56:12.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.505+0000 7f3e25148700 1 Processor -- start 2023-09-13T09:56:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e25148700 1 -- start start 2023-09-13T09:56:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e25148700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e200ffcc0 0x7f3e20103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e25148700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20100eb0 0x7f3e20102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e25148700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e20101850 0x7f3e201027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e25148700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e20102f70 con 0x7f3e20100eb0 2023-09-13T09:56:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e25148700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e201030e0 con 0x7f3e200ffcc0 2023-09-13T09:56:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e25148700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e201a0b30 con 0x7f3e20101850 2023-09-13T09:56:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20100eb0 0x7f3e20102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20100eb0 0x7f3e20102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44408/0 (socket says 172.21.15.6:44408) 2023-09-13T09:56:12.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1ed9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e200ffcc0 0x7f3e20103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1e59c700 1 -- 172.21.15.6:0/2003859675 learned_addr learned my addr 172.21.15.6:0/2003859675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1f59e700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e20101850 0x7f3e201027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/2003859675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e20101850 msgr2=0x7f3e201027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e20101850 0x7f3e201027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20100eb0 msgr2=0x7f3e20102290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20100eb0 0x7f3e20102290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/2003859675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e14009520 con 0x7f3e200ffcc0 2023-09-13T09:56:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.506+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20100eb0 0x7f3e20102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.507+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e200ffcc0 0x7f3e20103c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000e9c0 tx=0x7f3e1000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.507+0000 7f3e07fff700 1 -- 172.21.15.6:0/2003859675 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10004220 con 0x7f3e200ffcc0 2023-09-13T09:56:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.507+0000 7f3e07fff700 1 -- 172.21.15.6:0/2003859675 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e10004380 con 0x7f3e200ffcc0 2023-09-13T09:56:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.507+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e201a0e10 con 0x7f3e200ffcc0 2023-09-13T09:56:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.507+0000 7f3e07fff700 1 -- 172.21.15.6:0/2003859675 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10003be0 con 0x7f3e200ffcc0 2023-09-13T09:56:12.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.507+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e201a1230 con 0x7f3e200ffcc0 2023-09-13T09:56:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.510+0000 7f3e07fff700 1 -- 172.21.15.6:0/2003859675 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3e10003d40 con 0x7f3e200ffcc0 2023-09-13T09:56:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e07fff700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e080a0640 0x7f3e080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 Processor -- start 2023-09-13T09:56:12.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e07fff700 1 -- 172.21.15.6:0/2003859675 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e10014070 con 0x7f3e200ffcc0 2023-09-13T09:56:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 -- start start 2023-09-13T09:56:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d07ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d06540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d06f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81c5f800 con 0x560e81d06a80 2023-09-13T09:56:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81c5d120 con 0x560e81d080e0 2023-09-13T09:56:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e3132db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81c58a10 con 0x560e81d07780 2023-09-13T09:56:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e1f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d06f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e1ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d07ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e1f59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d06f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44416/0 (socket says 172.21.15.6:44416) 2023-09-13T09:56:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.511+0000 7f3e1f59e700 1 -- 172.21.15.6:0/713000077 learned_addr learned my addr 172.21.15.6:0/713000077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d06540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/713000077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 msgr2=0x560e81d06540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d06540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/713000077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 msgr2=0x560e81d06f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d06f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/713000077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e81ad86b0 con 0x560e81d07780 2023-09-13T09:56:12.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d07ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e100c9900 tx=0x7f3e10099050 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9dd23f743578c6b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e057fa700 1 -- 172.21.15.6:0/713000077 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e100995f0 con 0x560e81d07780 2023-09-13T09:56:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e057fa700 1 -- 172.21.15.6:0/713000077 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e1009d420 con 0x560e81d07780 2023-09-13T09:56:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.512+0000 7f3e057fa700 1 -- 172.21.15.6:0/713000077 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e100840c0 con 0x560e81d07780 2023-09-13T09:56:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e080a0640 0x7f3e080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 -- 172.21.15.6:0/713000077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 msgr2=0x560e81d07ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d07ba0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3e100c9900 tx=0x7f3e10099050 comp rx=0 tx=0).stop 2023-09-13T09:56:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 -- 172.21.15.6:0/713000077 shutdown_connections 2023-09-13T09:56:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d06f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d07ba0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 --2- 172.21.15.6:0/713000077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d06540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 -- 172.21.15.6:0/713000077 >> 172.21.15.6:0/713000077 conn(0x560e81c64d00 msgr2=0x560e81d00f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e080a0640 0x7f3e080a2b00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c010 tx=0x7f3e14009c30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 -- 172.21.15.6:0/713000077 shutdown_connections 2023-09-13T09:56:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.513+0000 7f3e3132db80 1 -- 172.21.15.6:0/713000077 wait complete. 2023-09-13T09:56:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 -- start start 2023-09-13T09:56:12.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 Processor -- start 2023-09-13T09:56:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d06a80 0x560e81d10000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d07780 0x560e81d10540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d17580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81bf6c30 con 0x560e81d07780 2023-09-13T09:56:12.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81bf6930 con 0x560e81d080e0 2023-09-13T09:56:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81ada9a0 con 0x560e81d06a80 2023-09-13T09:56:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d07780 0x560e81d10540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e3132db80 10 client.0 _ll_register_callbacks cb 0x560e81bf4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e1e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d07780 0x560e81d10540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44422/0 (socket says 172.21.15.6:44422) 2023-09-13T09:56:12.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e1e59c700 1 -- 172.21.15.6:0/2327441301 learned_addr learned my addr 172.21.15.6:0/2327441301 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d06a80 0x560e81d10000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.514+0000 7f3e1f59e700 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d17580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e1e59c700 1 -- 172.21.15.6:0/2327441301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d06a80 msgr2=0x560e81d10000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d06a80 0x560e81d10000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e1e59c700 1 -- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 msgr2=0x560e81d17580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d17580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e1e59c700 1 -- 172.21.15.6:0/2327441301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e201a1230 con 0x560e81d07780 2023-09-13T09:56:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d07780 0x560e81d10540 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005340 tx=0x7f3e14009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=495798d7068984fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e02ff5700 1 -- 172.21.15.6:0/2327441301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1402b070 con 0x560e81d07780 2023-09-13T09:56:12.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560e81cf96f0 con 0x560e81d07780 2023-09-13T09:56:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e02ff5700 1 -- 172.21.15.6:0/2327441301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e1400b770 con 0x560e81d07780 2023-09-13T09:56:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e02ff5700 1 -- 172.21.15.6:0/2327441301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e14005700 con 0x560e81d07780 2023-09-13T09:56:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e3132db80 10 client.19896 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x560e81c70820 con 0x560e81d07780 2023-09-13T09:56:12.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e02ff5700 1 -- 172.21.15.6:0/2327441301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e1403e080 con 0x560e81d07780 2023-09-13T09:56:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e02ff5700 1 -- 172.21.15.6:0/2327441301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3e14024480 con 0x560e81d07780 2023-09-13T09:56:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e3132db80 10 client.19896 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.515+0000 7f3e3132db80 10 client.19896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.516+0000 7f3e3132db80 20 client.19896 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:12.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.516+0000 7f3e3132db80 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d1bdf0 0x560e81d1e210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.516+0000 7f3e3132db80 4 client.19896 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.516+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560e81c519f0 con 0x560e81d1bdf0 2023-09-13T09:56:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.516+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d1bdf0 0x560e81d1e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.516+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d1bdf0 0x560e81d1e210 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f24f211288cfd188 server_cookie=4b7959aa69f77ecd in_seq=0 out_seq=0 2023-09-13T09:56:12.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.516+0000 7f3e02ff5700 10 client.19896 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.518+0000 7f3e02ff5700 1 -- 172.21.15.6:0/2327441301 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560e81c519f0 con 0x560e81d1bdf0 2023-09-13T09:56:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.518+0000 7f3e02ff5700 10 client.19896 handle_command_reply: tid=0 2023-09-13T09:56:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.518+0000 7f3e3132db80 1 client.19896 shutdown 2023-09-13T09:56:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d07780 msgr2=0x560e81d10540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d07780 0x560e81d10540 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f3e14005340 tx=0x7f3e14009260 comp rx=0 tx=0).stop 2023-09-13T09:56:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 shutdown_connections 2023-09-13T09:56:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d17580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d06a80 0x560e81d10000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d1bdf0 0x560e81d1e210 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 --2- 172.21.15.6:0/2327441301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d07780 0x560e81d10540 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e02ff5700 0 client.19896 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 >> 172.21.15.6:0/2327441301 conn(0x560e81c64d00 msgr2=0x560e81cfb870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 shutdown_connections 2023-09-13T09:56:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 1 -- 172.21.15.6:0/2327441301 wait complete. 2023-09-13T09:56:12.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.519+0000 7f3e3132db80 20 client.19896 trim_cache size 0 max 16384 2023-09-13T09:56:12.539 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:12 smithi131 ceph-mon[102785]: pgmap v800: 97 pgs: 97 active+clean; 1.0 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 8.8 MiB/s wr, 732 op/s 2023-09-13T09:56:12.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.540+0000 7f3e3132db80 1 Processor -- start 2023-09-13T09:56:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.540+0000 7f3e3132db80 1 -- start start 2023-09-13T09:56:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.540+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81cfb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d17540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d05c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e3132db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81d0fba0 con 0x560e81d06a80 2023-09-13T09:56:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e3132db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81d01a60 con 0x560e81d080e0 2023-09-13T09:56:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e3132db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81d02ac0 con 0x560e81d07780 2023-09-13T09:56:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81cfb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81cfb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44428/0 (socket says 172.21.15.6:44428) 2023-09-13T09:56:12.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/1858252712 learned_addr learned my addr 172.21.15.6:0/1858252712 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1f59e700 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d05c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/1858252712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 msgr2=0x560e81d17540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d17540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/1858252712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 msgr2=0x560e81d05c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d05c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/1858252712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560e81a84e60 con 0x560e81d06a80 2023-09-13T09:56:12.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81cfb970 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000f010 tx=0x7f3e1000cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9e93da01809f2e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e05ffb700 1 -- 172.21.15.6:0/1858252712 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1009d170 con 0x560e81d06a80 2023-09-13T09:56:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e05ffb700 1 -- 172.21.15.6:0/1858252712 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e1001fde0 con 0x560e81d06a80 2023-09-13T09:56:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.541+0000 7f3e05ffb700 1 -- 172.21.15.6:0/1858252712 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10099850 con 0x560e81d06a80 2023-09-13T09:56:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 -- 172.21.15.6:0/1858252712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 msgr2=0x560e81cfb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81cfb970 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000f010 tx=0x7f3e1000cf10 comp rx=0 tx=0).stop 2023-09-13T09:56:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 -- 172.21.15.6:0/1858252712 shutdown_connections 2023-09-13T09:56:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d05c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81cfb970 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 --2- 172.21.15.6:0/1858252712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d17540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 -- 172.21.15.6:0/1858252712 >> 172.21.15.6:0/1858252712 conn(0x560e81c64d00 msgr2=0x560e81d05530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 -- 172.21.15.6:0/1858252712 shutdown_connections 2023-09-13T09:56:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.542+0000 7f3e3132db80 1 -- 172.21.15.6:0/1858252712 wait complete. 2023-09-13T09:56:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 -- start start 2023-09-13T09:56:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 Processor -- start 2023-09-13T09:56:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d149e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d14f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d15f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81d16470 con 0x560e81d06a80 2023-09-13T09:56:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81d165e0 con 0x560e81d080e0 2023-09-13T09:56:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560e81d167a0 con 0x560e81d07780 2023-09-13T09:56:12.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e3132db80 10 client.0 _ll_register_callbacks cb 0x560e81bf4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e1ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d149e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e1ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d149e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44434/0 (socket says 172.21.15.6:44434) 2023-09-13T09:56:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/3853450586 learned_addr learned my addr 172.21.15.6:0/3853450586 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d14f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.543+0000 7f3e1f59e700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d15f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/3853450586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 msgr2=0x560e81d14f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d14f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 msgr2=0x560e81d15f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d15f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e1ed9d700 1 -- 172.21.15.6:0/3853450586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560e81ad86b0 con 0x560e81d06a80 2023-09-13T09:56:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e1f59e700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d15f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:56:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e1ed9d700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d149e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3e10000c00 tx=0x7f3e10099260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f58398dfcf489eb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e02ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e02ff5700 1 -- 172.21.15.6:0/3853450586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e10063070 con 0x560e81d06a80 2023-09-13T09:56:12.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e02ff5700 1 -- 172.21.15.6:0/3853450586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3e10082e40 con 0x560e81d06a80 2023-09-13T09:56:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e1009d420 con 0x560e81d06a80 2023-09-13T09:56:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e02ff5700 1 -- 172.21.15.6:0/3853450586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e10097990 con 0x560e81d06a80 2023-09-13T09:56:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e3132db80 10 client.19902 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x560e81a6dce0 con 0x560e81d06a80 2023-09-13T09:56:12.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.544+0000 7f3e02ff5700 1 -- 172.21.15.6:0/3853450586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3e1009d420 con 0x560e81d06a80 2023-09-13T09:56:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e02ff5700 1 -- 172.21.15.6:0/3853450586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f3e10099850 con 0x560e81d06a80 2023-09-13T09:56:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e3132db80 10 client.19902 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e3132db80 10 client.19902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e3132db80 20 client.19902 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:12.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e3132db80 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d71e30 0x560e81d74220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e3132db80 4 client.19902 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:56:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x560e81c120d0 con 0x560e81d71e30 2023-09-13T09:56:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d71e30 0x560e81d74220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e02ff5700 10 client.19902 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.545+0000 7f3e1e59c700 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d71e30 0x560e81d74220 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5bd4a6805ce1562 server_cookie=4573b9e14b932be0 in_seq=0 out_seq=0 2023-09-13T09:56:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e02ff5700 1 -- 172.21.15.6:0/3853450586 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x560e81c120d0 con 0x560e81d71e30 2023-09-13T09:56:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e02ff5700 10 client.19902 handle_command_reply: tid=0 2023-09-13T09:56:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 client.19902 shutdown 2023-09-13T09:56:12.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 msgr2=0x560e81d149e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d149e0 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3e10000c00 tx=0x7f3e10099260 comp rx=0 tx=0).stop 2023-09-13T09:56:12.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 shutdown_connections 2023-09-13T09:56:12.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560e81d080e0 0x560e81d15f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560e81d71e30 0x560e81d74220 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560e81d06a80 0x560e81d149e0 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e02ff5700 0 client.19902 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 --2- 172.21.15.6:0/3853450586 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560e81d07780 0x560e81d14f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 >> 172.21.15.6:0/3853450586 conn(0x560e81c64d00 msgr2=0x560e81d05dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 shutdown_connections 2023-09-13T09:56:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.555+0000 7f3e3132db80 1 -- 172.21.15.6:0/3853450586 wait complete. 2023-09-13T09:56:12.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e3132db80 20 client.19902 trim_cache size 0 max 16384 2023-09-13T09:56:12.567 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:56:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:56:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "0edd6900-7077-4543-b308-fa1256e527ee", 2023-09-13T09:56:12.567 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:56:12.567 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:56:12.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e080a0640 msgr2=0x7f3e080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e080a0640 0x7f3e080a2b00 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f3e1400c010 tx=0x7f3e14009c30 comp rx=0 tx=0).stop 2023-09-13T09:56:12.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e200ffcc0 msgr2=0x7f3e20103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e200ffcc0 0x7f3e20103c50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f3e1000e9c0 tx=0x7f3e1000ecd0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 shutdown_connections 2023-09-13T09:56:12.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e20101850 0x7f3e201027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3e200ffcc0 0x7f3e20103c50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3e080a0640 0x7f3e080a2b00 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 --2- 172.21.15.6:0/2003859675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e20100eb0 0x7f3e20102290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.556+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 >> 172.21.15.6:0/2003859675 conn(0x7f3e200fb210 msgr2=0x7f3e200fbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.557+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 shutdown_connections 2023-09-13T09:56:12.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.557+0000 7f3e25148700 1 -- 172.21.15.6:0/2003859675 wait complete. 2023-09-13T09:56:12.571 INFO:tasks.workunit.client.0.smithi006.stdout: 10 152610 38.65 MB/sec execute 92 sec latency 47.642 ms 2023-09-13T09:56:12.572 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:56:12.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 -- 172.21.15.6:0/2336757960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4850108f60 msgr2=0x7f485010f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 --2- 172.21.15.6:0/2336757960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4850108f60 0x7f485010f810 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f484800b0d0 tx=0x7f484800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 -- 172.21.15.6:0/2336757960 shutdown_connections 2023-09-13T09:56:12.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 --2- 172.21.15.6:0/2336757960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4850108f60 0x7f485010f810 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 --2- 172.21.15.6:0/2336757960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f48501073d0 0x7f48501077f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 --2- 172.21.15.6:0/2336757960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48501085c0 0x7f4850108a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 -- 172.21.15.6:0/2336757960 >> 172.21.15.6:0/2336757960 conn(0x7f4850076350 msgr2=0x7f48500787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 -- 172.21.15.6:0/2336757960 shutdown_connections 2023-09-13T09:56:12.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.783+0000 7f4855c19700 1 -- 172.21.15.6:0/2336757960 wait complete. 2023-09-13T09:56:12.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 Processor -- start 2023-09-13T09:56:12.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 -- start start 2023-09-13T09:56:12.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48501073d0 0x7f485019d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48501085c0 0x7f485019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4850108f60 0x7f48501a46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48501a4cc0 con 0x7f48501073d0 2023-09-13T09:56:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48501a4e00 con 0x7f48501085c0 2023-09-13T09:56:12.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f4855c19700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48501a4f90 con 0x7f4850108f60 2023-09-13T09:56:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.784+0000 7f484f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48501073d0 0x7f485019d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48501073d0 0x7f485019d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44448/0 (socket says 172.21.15.6:44448) 2023-09-13T09:56:12.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484f7fe700 1 -- 172.21.15.6:0/3832317182 learned_addr learned my addr 172.21.15.6:0/3832317182 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484effd700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48501085c0 0x7f485019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484effd700 1 -- 172.21.15.6:0/3832317182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4850108f60 msgr2=0x7f48501a46f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T09:56:12.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484effd700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4850108f60 0x7f48501a46f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484effd700 1 -- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48501073d0 msgr2=0x7f485019d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484effd700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48501073d0 0x7f485019d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484effd700 1 -- 172.21.15.6:0/3832317182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844009520 con 0x7f48501085c0 2023-09-13T09:56:12.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.785+0000 7f484effd700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48501085c0 0x7f485019d680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9f0 tx=0x7f484400ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.787+0000 7f484cff9700 1 -- 172.21.15.6:0/3832317182 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400cb70 con 0x7f48501085c0 2023-09-13T09:56:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.787+0000 7f484cff9700 1 -- 172.21.15.6:0/3832317182 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48440044e0 con 0x7f48501085c0 2023-09-13T09:56:12.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.787+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4848009d00 con 0x7f48501085c0 2023-09-13T09:56:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.787+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48501a5640 con 0x7f48501085c0 2023-09-13T09:56:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.787+0000 7f484cff9700 1 -- 172.21.15.6:0/3832317182 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844003d50 con 0x7f48501085c0 2023-09-13T09:56:12.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.790+0000 7f484cff9700 1 -- 172.21.15.6:0/3832317182 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4844004020 con 0x7f48501085c0 2023-09-13T09:56:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.791+0000 7f484cff9700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48380a06c0 0x7f48380a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.791+0000 7f484cff9700 1 -- 172.21.15.6:0/3832317182 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4844014070 con 0x7f48501085c0 2023-09-13T09:56:12.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.791+0000 7f484f7fe700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48380a06c0 0x7f48380a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.791+0000 7f4861dfeb80 1 Processor -- start 2023-09-13T09:56:12.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f4861dfeb80 1 -- start start 2023-09-13T09:56:12.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefaeb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefaf060 0x558dcefad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484f7fe700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48380a06c0 0x7f48380a2b80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4840005950 tx=0x7f4840009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefade80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcef06780 con 0x558dcefaf060 2023-09-13T09:56:12.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcef040a0 con 0x558dcefada00 2023-09-13T09:56:12.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dceeff990 con 0x558dcefae700 2023-09-13T09:56:12.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefaf060 0x558dcefad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefaf060 0x558dcefad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44456/0 (socket says 172.21.15.6:44456) 2023-09-13T09:56:12.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 -- 172.21.15.6:0/2902781271 learned_addr learned my addr 172.21.15.6:0/2902781271 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484f7fe700 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefaeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 -- 172.21.15.6:0/2902781271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 msgr2=0x558dcefaeb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefaeb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 -- 172.21.15.6:0/2902781271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 msgr2=0x558dcefade80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 -- 172.21.15.6:0/2902781271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558dced7f630 con 0x558dcefaf060 2023-09-13T09:56:12.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.792+0000 7f484effd700 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefaf060 0x558dcefad4c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f48440a1150 tx=0x7f4844099220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b0b39a88fede8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.793+0000 7f4835ffb700 1 -- 172.21.15.6:0/2902781271 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484409d440 con 0x558dcefaf060 2023-09-13T09:56:12.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.793+0000 7f4835ffb700 1 -- 172.21.15.6:0/2902781271 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48440a1680 con 0x558dcefaf060 2023-09-13T09:56:12.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.793+0000 7f4835ffb700 1 -- 172.21.15.6:0/2902781271 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844084320 con 0x558dcefaf060 2023-09-13T09:56:12.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.793+0000 7f4861dfeb80 1 -- 172.21.15.6:0/2902781271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefaf060 msgr2=0x558dcefad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.793+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefaf060 0x558dcefad4c0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f48440a1150 tx=0x7f4844099220 comp rx=0 tx=0).stop 2023-09-13T09:56:12.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 -- 172.21.15.6:0/2902781271 shutdown_connections 2023-09-13T09:56:12.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefade80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefaeb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/2902781271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefaf060 0x558dcefad4c0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 -- 172.21.15.6:0/2902781271 >> 172.21.15.6:0/2902781271 conn(0x558dcef0bc80 msgr2=0x558dcefa7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 -- 172.21.15.6:0/2902781271 shutdown_connections 2023-09-13T09:56:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 -- 172.21.15.6:0/2902781271 wait complete. 2023-09-13T09:56:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 -- start start 2023-09-13T09:56:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.794+0000 7f4861dfeb80 1 Processor -- start 2023-09-13T09:56:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefc7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefc84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefcf530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcee9dbb0 con 0x558dcefae700 2023-09-13T09:56:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcee9d8b0 con 0x558dcefada00 2023-09-13T09:56:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dced81920 con 0x558dcefaf060 2023-09-13T09:56:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f4861dfeb80 10 client.0 _ll_register_callbacks cb 0x558dcee9b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:12.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefc84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefc84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44464/0 (socket says 172.21.15.6:44464) 2023-09-13T09:56:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 -- 172.21.15.6:0/529195389 learned_addr learned my addr 172.21.15.6:0/529195389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484f7fe700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefc7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484ffff700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefcf530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 -- 172.21.15.6:0/529195389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 msgr2=0x558dcefcf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefcf530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 -- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 msgr2=0x558dcefc7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefc7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 -- 172.21.15.6:0/529195389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48501a5640 con 0x558dcefae700 2023-09-13T09:56:12.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484f7fe700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefc7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:56:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f484effd700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefc84f0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4844096080 tx=0x7f4844099be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13dc538e7c7268b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.795+0000 7f482effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f482effd700 1 -- 172.21.15.6:0/529195389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484401fee0 con 0x558dcefae700 2023-09-13T09:56:12.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f482effd700 1 -- 172.21.15.6:0/529195389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f484409d440 con 0x558dcefae700 2023-09-13T09:56:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558dcefa0670 con 0x558dcefae700 2023-09-13T09:56:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f482effd700 1 -- 172.21.15.6:0/529195389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f484409d170 con 0x558dcefae700 2023-09-13T09:56:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f4861dfeb80 10 client.19914 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:12.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x558dcef177a0 con 0x558dcefae700 2023-09-13T09:56:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f482effd700 1 -- 172.21.15.6:0/529195389 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558dcefa0670 con 0x558dcefae700 2023-09-13T09:56:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f482effd700 1 -- 172.21.15.6:0/529195389 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4844081030 con 0x558dcefae700 2023-09-13T09:56:12.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f4861dfeb80 10 client.19914 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f4861dfeb80 10 client.19914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f4861dfeb80 20 client.19914 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.796+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcefd3940 0x558dcefd5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.797+0000 7f4861dfeb80 4 client.19914 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.797+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558dceef8970 con 0x558dcefd3940 2023-09-13T09:56:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.797+0000 7f484f7fe700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcefd3940 0x558dcefd5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.797+0000 7f482effd700 10 client.19914 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.797+0000 7f484f7fe700 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcefd3940 0x558dcefd5d60 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8261d103be6a25a server_cookie=44191ee38a12a4b6 in_seq=0 out_seq=0 2023-09-13T09:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.804+0000 7f482effd700 1 -- 172.21.15.6:0/529195389 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558dceef8970 con 0x558dcefd3940 2023-09-13T09:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.804+0000 7f482effd700 10 client.19914 handle_command_reply: tid=0 2023-09-13T09:56:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.804+0000 7f4861dfeb80 1 client.19914 shutdown 2023-09-13T09:56:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 msgr2=0x558dcefc84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefc84f0 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7f4844096080 tx=0x7f4844099be0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 shutdown_connections 2023-09-13T09:56:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefcf530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefc7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcefd3940 0x558dcefd5d60 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/529195389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefc84f0 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 >> 172.21.15.6:0/529195389 conn(0x558dcef0bc80 msgr2=0x558dcefa27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f482effd700 0 client.19914 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 shutdown_connections 2023-09-13T09:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 1 -- 172.21.15.6:0/529195389 wait complete. 2023-09-13T09:56:12.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.805+0000 7f4861dfeb80 20 client.19914 trim_cache size 0 max 16384 2023-09-13T09:56:12.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.825+0000 7f4861dfeb80 1 Processor -- start 2023-09-13T09:56:12.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.825+0000 7f4861dfeb80 1 -- start start 2023-09-13T09:56:12.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefcf450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefc7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcefa9a10 con 0x558dcefae700 2023-09-13T09:56:12.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcefa0400 con 0x558dcefada00 2023-09-13T09:56:12.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcefb4c10 con 0x558dcefaf060 2023-09-13T09:56:12.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefcf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefcf450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44472/0 (socket says 172.21.15.6:44472) 2023-09-13T09:56:12.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 -- 172.21.15.6:0/3551649377 learned_addr learned my addr 172.21.15.6:0/3551649377 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484ffff700 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefc7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 -- 172.21.15.6:0/3551649377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 msgr2=0x558dcefc7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefc7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 -- 172.21.15.6:0/3551649377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 msgr2=0x558dcefad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 -- 172.21.15.6:0/3551649377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558dced2bde0 con 0x558dcefae700 2023-09-13T09:56:12.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484ffff700 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefc7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:56:12.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.826+0000 7f484effd700 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefcf450 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f4844099310 tx=0x7f48440a1560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fc50416602c5a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f48367fc700 1 -- 172.21.15.6:0/3551649377 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844084330 con 0x558dcefae700 2023-09-13T09:56:12.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f48367fc700 1 -- 172.21.15.6:0/3551649377 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f484407e070 con 0x558dcefae700 2023-09-13T09:56:12.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f48367fc700 1 -- 172.21.15.6:0/3551649377 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48440a11f0 con 0x558dcefae700 2023-09-13T09:56:12.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 -- 172.21.15.6:0/3551649377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 msgr2=0x558dcefcf450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefcf450 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f4844099310 tx=0x7f48440a1560 comp rx=0 tx=0).stop 2023-09-13T09:56:12.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 -- 172.21.15.6:0/3551649377 shutdown_connections 2023-09-13T09:56:12.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefaf060 0x558dcefc7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefada00 0x558dcefad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/3551649377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefae700 0x558dcefcf450 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 -- 172.21.15.6:0/3551649377 >> 172.21.15.6:0/3551649377 conn(0x558dcef0bc80 msgr2=0x558dcefc6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 -- 172.21.15.6:0/3551649377 shutdown_connections 2023-09-13T09:56:12.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.827+0000 7f4861dfeb80 1 -- 172.21.15.6:0/3551649377 wait complete. 2023-09-13T09:56:12.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 -- start start 2023-09-13T09:56:12.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 Processor -- start 2023-09-13T09:56:12.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefada00 0x558dcefcb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefcb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefaf060 0x558dcefce7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcefcecf0 con 0x558dcefada00 2023-09-13T09:56:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcefcee60 con 0x558dcefaf060 2023-09-13T09:56:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.828+0000 7f4861dfeb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558dcefcf020 con 0x558dcefae700 2023-09-13T09:56:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f4861dfeb80 10 client.0 _ll_register_callbacks cb 0x558dcee9b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:12.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefada00 0x558dcefcb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefada00 0x558dcefcb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44476/0 (socket says 172.21.15.6:44476) 2023-09-13T09:56:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 -- 172.21.15.6:0/1213452973 learned_addr learned my addr 172.21.15.6:0/1213452973 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484effd700 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefcb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484ffff700 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefaf060 0x558dcefce7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 -- 172.21.15.6:0/1213452973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 msgr2=0x558dcefcb790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefcb790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 -- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefaf060 msgr2=0x558dcefce7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:12.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefaf060 0x558dcefce7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 -- 172.21.15.6:0/1213452973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558dcef177a0 con 0x558dcefada00 2023-09-13T09:56:12.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f484f7fe700 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefada00 0x558dcefcb250 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f4840009be0 tx=0x7f48400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdd57ba71e38f7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:12.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f482effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:12.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f482effd700 1 -- 172.21.15.6:0/1213452973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4840023040 con 0x558dcefada00 2023-09-13T09:56:12.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f482effd700 1 -- 172.21.15.6:0/1213452973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f484002a3b0 con 0x558dcefada00 2023-09-13T09:56:12.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f48440a1680 con 0x558dcefada00 2023-09-13T09:56:12.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f482effd700 1 -- 172.21.15.6:0/1213452973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f484002a570 con 0x558dcefada00 2023-09-13T09:56:12.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f4861dfeb80 10 client.19920 fetch_fsmap learned FSMap version 61 2023-09-13T09:56:12.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.829+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x558dced14c60 con 0x558dcefada00 2023-09-13T09:56:12.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f482effd700 1 -- 172.21.15.6:0/1213452973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f48440a1680 con 0x558dcefada00 2023-09-13T09:56:12.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f482effd700 1 -- 172.21.15.6:0/1213452973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 61) v1 ==== 7894+0+0 (secure 0 0 0) 0x7f4840005020 con 0x558dcefada00 2023-09-13T09:56:12.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f4861dfeb80 10 client.19920 fetch_fsmap finished waiting for FSMap version 61 2023-09-13T09:56:12.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f4861dfeb80 10 client.19920 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:12.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f4861dfeb80 20 client.19920 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:12.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcf028840 0x558dcf02ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:12.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f4861dfeb80 4 client.19920 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:56:12.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558dceeb9050 con 0x558dcf028840 2023-09-13T09:56:12.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.830+0000 7f484effd700 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcf028840 0x558dcf02ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:12.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.831+0000 7f482effd700 10 client.19920 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.831+0000 7f484effd700 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcf028840 0x558dcf02ac60 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd522457825abb4d server_cookie=33907193d1e048f9 in_seq=0 out_seq=0 2023-09-13T09:56:12.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.835+0000 7f482effd700 1 -- 172.21.15.6:0/1213452973 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x558dceeb9050 con 0x558dcf028840 2023-09-13T09:56:12.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.835+0000 7f482effd700 10 client.19920 handle_command_reply: tid=0 2023-09-13T09:56:12.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.835+0000 7f4861dfeb80 1 client.19920 shutdown 2023-09-13T09:56:12.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefada00 msgr2=0x558dcefcb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefada00 0x558dcefcb250 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f4840009be0 tx=0x7f48400047c0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 shutdown_connections 2023-09-13T09:56:12.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558dcefaf060 0x558dcefce7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558dcf028840 0x558dcf02ac60 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558dcefada00 0x558dcefcb250 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f482effd700 0 client.19920 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 --2- 172.21.15.6:0/1213452973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558dcefae700 0x558dcefcb790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 >> 172.21.15.6:0/1213452973 conn(0x558dcef0bc80 msgr2=0x558dcefb19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 shutdown_connections 2023-09-13T09:56:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 1 -- 172.21.15.6:0/1213452973 wait complete. 2023-09-13T09:56:12.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.836+0000 7f4861dfeb80 20 client.19920 trim_cache size 0 max 16384 2023-09-13T09:56:12.857 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:56:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:56:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:56:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "0edd6900-7077-4543-b308-fa1256e527ee": { 2023-09-13T09:56:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:56:12.858 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "0edd6900-7077-4543-b308-fa1256e527ee", 2023-09-13T09:56:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:56:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:56:12.859 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:56:12.859 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:56:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48380a06c0 msgr2=0x7f48380a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48380a06c0 0x7f48380a2b80 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4840005950 tx=0x7f4840009260 comp rx=0 tx=0).stop 2023-09-13T09:56:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48501085c0 msgr2=0x7f485019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48501085c0 0x7f485019d680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f484400e9f0 tx=0x7f484400ed00 comp rx=0 tx=0).stop 2023-09-13T09:56:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 shutdown_connections 2023-09-13T09:56:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4850108f60 0x7f48501a46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f48380a06c0 0x7f48380a2b80 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48501073d0 0x7f485019d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 --2- 172.21.15.6:0/3832317182 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f48501085c0 0x7f485019d680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 >> 172.21.15.6:0/3832317182 conn(0x7f4850076350 msgr2=0x7f485010ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 shutdown_connections 2023-09-13T09:56:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:12.837+0000 7f4855c19700 1 -- 172.21.15.6:0/3832317182 wait complete. 2023-09-13T09:56:12.863 INFO:tasks.cephfs.filesystem:scrub status for tag:0edd6900-7077-4543-b308-fa1256e527ee - {'path': '/', 'tag': '0edd6900-7077-4543-b308-fa1256e527ee', 'options': 'recursive,force'} 2023-09-13T09:56:13.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:13.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:13.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:13.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:13.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:13.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:13 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:13.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:13.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:13.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:13.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:13.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:13 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:13.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:13.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:13.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:13.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:13.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:13 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:13.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 153167 38.63 MB/sec execute 93 sec latency 302.455 ms 2023-09-13T09:56:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: pgmap v801: 97 pgs: 97 active+clean; 1.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 859 op/s 2023-09-13T09:56:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:56:14.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:14.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:14.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:14.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:14.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:14.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:14 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: pgmap v801: 97 pgs: 97 active+clean; 1.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 859 op/s 2023-09-13T09:56:14.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:56:14.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:14.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:14.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:14.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:14.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:14.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:14 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: pgmap v801: 97 pgs: 97 active+clean; 1.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 10 MiB/s wr, 859 op/s 2023-09-13T09:56:14.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:56:14.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:14.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:14.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:14.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:14.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:14.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:14 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:14.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 153639 38.49 MB/sec execute 94 sec latency 77.157 ms 2023-09-13T09:56:15.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 154311 38.38 MB/sec execute 95 sec latency 64.322 ms 2023-09-13T09:56:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:16 smithi006 ceph-mon[98665]: pgmap v802: 97 pgs: 97 active+clean; 1.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 795 op/s 2023-09-13T09:56:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:16 smithi053 ceph-mon[102373]: pgmap v802: 97 pgs: 97 active+clean; 1.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 795 op/s 2023-09-13T09:56:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:16 smithi131 ceph-mon[102785]: pgmap v802: 97 pgs: 97 active+clean; 1.0 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 10 MiB/s wr, 795 op/s 2023-09-13T09:56:16.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 155042 38.32 MB/sec execute 96 sec latency 221.574 ms 2023-09-13T09:56:17.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 155895 38.49 MB/sec execute 97 sec latency 86.994 ms 2023-09-13T09:56:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:18 smithi006 ceph-mon[98665]: pgmap v803: 97 pgs: 97 active+clean; 1.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 816 op/s 2023-09-13T09:56:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:18 smithi053 ceph-mon[102373]: pgmap v803: 97 pgs: 97 active+clean; 1.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 816 op/s 2023-09-13T09:56:18.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:18 smithi131 ceph-mon[102785]: pgmap v803: 97 pgs: 97 active+clean; 1.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 816 op/s 2023-09-13T09:56:18.569 INFO:tasks.workunit.client.0.smithi006.stdout: 10 156401 38.43 MB/sec execute 98 sec latency 212.577 ms 2023-09-13T09:56:19.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 157014 38.33 MB/sec execute 99 sec latency 79.273 ms 2023-09-13T09:56:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:20 smithi006 ceph-mon[98665]: pgmap v804: 97 pgs: 97 active+clean; 1.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.3 MiB/s wr, 747 op/s 2023-09-13T09:56:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:20 smithi053 ceph-mon[102373]: pgmap v804: 97 pgs: 97 active+clean; 1.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.3 MiB/s wr, 747 op/s 2023-09-13T09:56:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:20 smithi131 ceph-mon[102785]: pgmap v804: 97 pgs: 97 active+clean; 1.0 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 9.3 MiB/s wr, 747 op/s 2023-09-13T09:56:20.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 157734 38.30 MB/sec execute 100 sec latency 110.863 ms 2023-09-13T09:56:21.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 158650 38.45 MB/sec execute 101 sec latency 64.743 ms 2023-09-13T09:56:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:22 smithi006 ceph-mon[98665]: pgmap v805: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.8 MiB/s wr, 734 op/s 2023-09-13T09:56:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:22 smithi053 ceph-mon[102373]: pgmap v805: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.8 MiB/s wr, 734 op/s 2023-09-13T09:56:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:22 smithi131 ceph-mon[102785]: pgmap v805: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.8 MiB/s wr, 734 op/s 2023-09-13T09:56:22.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 159291 38.42 MB/sec execute 102 sec latency 68.089 ms 2023-09-13T09:56:23.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 159874 38.28 MB/sec execute 103 sec latency 206.629 ms 2023-09-13T09:56:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:24 smithi006 ceph-mon[98665]: pgmap v806: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 818 op/s 2023-09-13T09:56:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:24 smithi053 ceph-mon[102373]: pgmap v806: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 818 op/s 2023-09-13T09:56:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:24 smithi131 ceph-mon[102785]: pgmap v806: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 818 op/s 2023-09-13T09:56:24.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 160478 38.22 MB/sec execute 104 sec latency 70.239 ms 2023-09-13T09:56:25.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:25 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:56:25.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:25 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:56:25.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:25 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:56:25.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:25 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:56:25.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:25 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:56:25.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:25 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:56:25.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:25 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:56:25.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:25 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:56:25.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:25 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:56:25.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:25 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:56:25.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:25 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:56:25.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:25 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:56:25.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:25 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:56:25.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:25 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:56:25.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:25 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:56:25.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 161250 38.28 MB/sec execute 105 sec latency 79.955 ms 2023-09-13T09:56:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:26 smithi006 ceph-mon[98665]: pgmap v807: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 795 op/s 2023-09-13T09:56:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:26 smithi053 ceph-mon[102373]: pgmap v807: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 795 op/s 2023-09-13T09:56:26.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:26 smithi131 ceph-mon[102785]: pgmap v807: 97 pgs: 97 active+clean; 1.0 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 795 op/s 2023-09-13T09:56:26.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 162134 38.40 MB/sec execute 106 sec latency 53.869 ms 2023-09-13T09:56:27.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 162869 38.40 MB/sec execute 107 sec latency 70.265 ms 2023-09-13T09:56:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:28 smithi006 ceph-mon[98665]: pgmap v808: 97 pgs: 97 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 826 op/s 2023-09-13T09:56:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:28 smithi053 ceph-mon[102373]: pgmap v808: 97 pgs: 97 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 826 op/s 2023-09-13T09:56:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:28 smithi131 ceph-mon[102785]: pgmap v808: 97 pgs: 97 active+clean; 1.1 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 826 op/s 2023-09-13T09:56:28.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 163357 38.25 MB/sec execute 108 sec latency 214.534 ms 2023-09-13T09:56:29.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 163980 38.29 MB/sec execute 109 sec latency 98.267 ms 2023-09-13T09:56:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:30 smithi006 ceph-mon[98665]: pgmap v809: 97 pgs: 97 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 725 op/s 2023-09-13T09:56:30.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:30 smithi053 ceph-mon[102373]: pgmap v809: 97 pgs: 97 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 725 op/s 2023-09-13T09:56:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:30 smithi131 ceph-mon[102785]: pgmap v809: 97 pgs: 97 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 725 op/s 2023-09-13T09:56:30.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 164707 38.19 MB/sec execute 110 sec latency 79.915 ms 2023-09-13T09:56:31.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 165625 38.38 MB/sec execute 111 sec latency 67.750 ms 2023-09-13T09:56:32.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:32 smithi006 ceph-mon[98665]: pgmap v810: 97 pgs: 97 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.0 MiB/s wr, 678 op/s 2023-09-13T09:56:32.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:32 smithi053 ceph-mon[102373]: pgmap v810: 97 pgs: 97 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.0 MiB/s wr, 678 op/s 2023-09-13T09:56:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:32 smithi131 ceph-mon[102785]: pgmap v810: 97 pgs: 97 active+clean; 1.1 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.0 MiB/s wr, 678 op/s 2023-09-13T09:56:32.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 166356 38.38 MB/sec execute 112 sec latency 54.358 ms 2023-09-13T09:56:33.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 166937 38.34 MB/sec execute 113 sec latency 219.106 ms 2023-09-13T09:56:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:34 smithi006 ceph-mon[98665]: pgmap v811: 97 pgs: 97 active+clean; 1.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 808 op/s 2023-09-13T09:56:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:34 smithi053 ceph-mon[102373]: pgmap v811: 97 pgs: 97 active+clean; 1.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 808 op/s 2023-09-13T09:56:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:34 smithi131 ceph-mon[102785]: pgmap v811: 97 pgs: 97 active+clean; 1.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 808 op/s 2023-09-13T09:56:34.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 167384 38.16 MB/sec execute 114 sec latency 293.069 ms 2023-09-13T09:56:35.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 168296 38.23 MB/sec execute 115 sec latency 52.702 ms 2023-09-13T09:56:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:36 smithi006 ceph-mon[98665]: pgmap v812: 97 pgs: 97 active+clean; 1.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-09-13T09:56:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:36 smithi053 ceph-mon[102373]: pgmap v812: 97 pgs: 97 active+clean; 1.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-09-13T09:56:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:36 smithi131 ceph-mon[102785]: pgmap v812: 97 pgs: 97 active+clean; 1.1 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 789 op/s 2023-09-13T09:56:36.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 169209 38.39 MB/sec execute 116 sec latency 75.610 ms 2023-09-13T09:56:37.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 169938 38.43 MB/sec execute 117 sec latency 69.878 ms 2023-09-13T09:56:38.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:38 smithi053 ceph-mon[102373]: pgmap v813: 97 pgs: 97 active+clean; 1.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 765 op/s 2023-09-13T09:56:38.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:38 smithi006 ceph-mon[98665]: pgmap v813: 97 pgs: 97 active+clean; 1.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 765 op/s 2023-09-13T09:56:38.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:38 smithi131 ceph-mon[102785]: pgmap v813: 97 pgs: 97 active+clean; 1.1 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 765 op/s 2023-09-13T09:56:38.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 170427 38.28 MB/sec execute 118 sec latency 109.145 ms 2023-09-13T09:56:39.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:39 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:39.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:39 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:39.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:39 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:39.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 170918 38.14 MB/sec execute 119 sec latency 361.611 ms 2023-09-13T09:56:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:40 smithi006 ceph-mon[98665]: pgmap v814: 97 pgs: 97 active+clean; 1.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 724 op/s 2023-09-13T09:56:40.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:40 smithi053 ceph-mon[102373]: pgmap v814: 97 pgs: 97 active+clean; 1.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 724 op/s 2023-09-13T09:56:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:40 smithi131 ceph-mon[102785]: pgmap v814: 97 pgs: 97 active+clean; 1.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 724 op/s 2023-09-13T09:56:40.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 171666 38.19 MB/sec execute 120 sec latency 77.660 ms 2023-09-13T09:56:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:41 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:56:41.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:41 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:56:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:41 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:56:41.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 172502 38.24 MB/sec execute 121 sec latency 45.251 ms 2023-09-13T09:56:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:42 smithi006 ceph-mon[98665]: pgmap v815: 97 pgs: 97 active+clean; 1.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 724 op/s 2023-09-13T09:56:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:42 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:56:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:42 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:56:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:42 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:56:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:42 smithi053 ceph-mon[102373]: pgmap v815: 97 pgs: 97 active+clean; 1.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 724 op/s 2023-09-13T09:56:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:42 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:56:42.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:42 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:56:42.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:42 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:56:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:42 smithi131 ceph-mon[102785]: pgmap v815: 97 pgs: 97 active+clean; 1.1 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 724 op/s 2023-09-13T09:56:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:42 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:56:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:42 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:56:42.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:42 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:56:42.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 173276 38.31 MB/sec execute 122 sec latency 87.747 ms 2023-09-13T09:56:42.864 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:56:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 -- 172.21.15.6:0/135293656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4360100eb0 msgr2=0x7f4360101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 --2- 172.21.15.6:0/135293656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4360100eb0 0x7f4360101310 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f4354009920 tx=0x7f4354009c30 comp rx=0 tx=0).stop 2023-09-13T09:56:43.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 -- 172.21.15.6:0/135293656 shutdown_connections 2023-09-13T09:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 --2- 172.21.15.6:0/135293656 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4360101850 0x7f4360108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 --2- 172.21.15.6:0/135293656 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f43600ffcc0 0x7f43601000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 --2- 172.21.15.6:0/135293656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4360100eb0 0x7f4360101310 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 -- 172.21.15.6:0/135293656 >> 172.21.15.6:0/135293656 conn(0x7f43600fb250 msgr2=0x7f43600fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 -- 172.21.15.6:0/135293656 shutdown_connections 2023-09-13T09:56:43.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.071+0000 7f4366161700 1 -- 172.21.15.6:0/135293656 wait complete. 2023-09-13T09:56:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.072+0000 7f4366161700 1 Processor -- start 2023-09-13T09:56:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.072+0000 7f4366161700 1 -- start start 2023-09-13T09:56:43.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.072+0000 7f4366161700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43600ffcc0 0x7f43601959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f4366161700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4360100eb0 0x7f4360195f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f4366161700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4360101850 0x7f436019cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f4366161700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360067fb0 con 0x7f4360101850 2023-09-13T09:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f4366161700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4360068120 con 0x7f4360100eb0 2023-09-13T09:56:43.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f4366161700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43600682e0 con 0x7f43600ffcc0 2023-09-13T09:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43600ffcc0 0x7f43601959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43600ffcc0 0x7f43601959f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47546/0 (socket says 172.21.15.6:47546) 2023-09-13T09:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 -- 172.21.15.6:0/2097599266 learned_addr learned my addr 172.21.15.6:0/2097599266 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435effd700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4360100eb0 0x7f4360195f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 -- 172.21.15.6:0/2097599266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4360100eb0 msgr2=0x7f4360195f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4360100eb0 0x7f4360195f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 -- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4360101850 msgr2=0x7f436019cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4360101850 0x7f436019cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 -- 172.21.15.6:0/2097599266 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4354009520 con 0x7f43600ffcc0 2023-09-13T09:56:43.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435f7fe700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43600ffcc0 0x7f43601959f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f435000d950 tx=0x7f435000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.073+0000 7f435cff9700 1 -- 172.21.15.6:0/2097599266 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500098b0 con 0x7f43600ffcc0 2023-09-13T09:56:43.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.074+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4360068560 con 0x7f43600ffcc0 2023-09-13T09:56:43.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.074+0000 7f435cff9700 1 -- 172.21.15.6:0/2097599266 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4350010460 con 0x7f43600ffcc0 2023-09-13T09:56:43.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.074+0000 7f435cff9700 1 -- 172.21.15.6:0/2097599266 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435000f620 con 0x7f43600ffcc0 2023-09-13T09:56:43.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.074+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4360068ac0 con 0x7f43600ffcc0 2023-09-13T09:56:43.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.077+0000 7f435cff9700 1 -- 172.21.15.6:0/2097599266 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f435000f780 con 0x7f43600ffcc0 2023-09-13T09:56:43.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.077+0000 7f435cff9700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43480a0640 0x7f43480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.077+0000 7f435cff9700 1 -- 172.21.15.6:0/2097599266 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43500cbbc0 con 0x7f43600ffcc0 2023-09-13T09:56:43.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.077+0000 7f435effd700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43480a0640 0x7f43480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 Processor -- start 2023-09-13T09:56:43.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 -- start start 2023-09-13T09:56:43.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f435effd700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43480a0640 0x7f43480a2b00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f435400fa40 tx=0x7f4354019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x5594673b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b3ff0 0x5594673b4470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946730c780 con 0x5594673b49b0 2023-09-13T09:56:43.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946730a0a0 con 0x5594673b3ff0 2023-09-13T09:56:43.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f4372346b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559467305990 con 0x5594673b36b0 2023-09-13T09:56:43.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f435ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.078+0000 7f435effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b3ff0 0x5594673b4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x5594673b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673b4e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44504/0 (socket says 172.21.15.6:44504) 2023-09-13T09:56:43.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 -- 172.21.15.6:0/716061535 learned_addr learned my addr 172.21.15.6:0/716061535 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 -- 172.21.15.6:0/716061535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 msgr2=0x5594673b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x5594673b3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 -- 172.21.15.6:0/716061535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b3ff0 msgr2=0x5594673b4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b3ff0 0x5594673b4470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 -- 172.21.15.6:0/716061535 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559467185630 con 0x5594673b49b0 2023-09-13T09:56:43.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435effd700 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b3ff0 0x5594673b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:43.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f435ffff700 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673b4e60 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f435800e400 tx=0x7f435800e710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351a1442b1e8de23 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f4345ffb700 1 -- 172.21.15.6:0/716061535 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358018070 con 0x5594673b49b0 2023-09-13T09:56:43.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f4345ffb700 1 -- 172.21.15.6:0/716061535 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f435800f040 con 0x5594673b49b0 2023-09-13T09:56:43.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.079+0000 7f4345ffb700 1 -- 172.21.15.6:0/716061535 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4358004280 con 0x5594673b49b0 2023-09-13T09:56:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 -- 172.21.15.6:0/716061535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 msgr2=0x5594673b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673b4e60 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f435800e400 tx=0x7f435800e710 comp rx=0 tx=0).stop 2023-09-13T09:56:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 -- 172.21.15.6:0/716061535 shutdown_connections 2023-09-13T09:56:43.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673b4e60 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x5594673b3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 --2- 172.21.15.6:0/716061535 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b3ff0 0x5594673b4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 -- 172.21.15.6:0/716061535 >> 172.21.15.6:0/716061535 conn(0x559467311c80 msgr2=0x5594673adf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 -- 172.21.15.6:0/716061535 shutdown_connections 2023-09-13T09:56:43.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.080+0000 7f4372346b80 1 -- 172.21.15.6:0/716061535 wait complete. 2023-09-13T09:56:43.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 -- start start 2023-09-13T09:56:43.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 Processor -- start 2023-09-13T09:56:43.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b36b0 0x5594673bcdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673bd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673c2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594672a3bb0 con 0x5594673b49b0 2023-09-13T09:56:43.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594672a38b0 con 0x5594673b36b0 2023-09-13T09:56:43.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559467187920 con 0x5594673b3ff0 2023-09-13T09:56:43.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f4372346b80 10 client.0 _ll_register_callbacks cb 0x5594672a1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:43.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f435effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673bd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b36b0 0x5594673bcdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f435effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673bd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47560/0 (socket says 172.21.15.6:47560) 2023-09-13T09:56:43.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.081+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b36b0 0x5594673bcdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38032/0 (socket says 172.21.15.6:38032) 2023-09-13T09:56:43.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435effd700 1 -- 172.21.15.6:0/1188603257 learned_addr learned my addr 172.21.15.6:0/1188603257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435ffff700 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673c2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435effd700 1 -- 172.21.15.6:0/1188603257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b36b0 msgr2=0x5594673bcdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435effd700 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b36b0 0x5594673bcdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435effd700 1 -- 172.21.15.6:0/1188603257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 msgr2=0x5594673c2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435effd700 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673c2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435effd700 1 -- 172.21.15.6:0/1188603257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435800e140 con 0x5594673b3ff0 2023-09-13T09:56:43.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f435effd700 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673bd330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4354009230 tx=0x7f4354009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de96a5c2ee62282d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f433effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:56:43.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f433effd700 1 -- 172.21.15.6:0/1188603257 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435402a050 con 0x5594673b3ff0 2023-09-13T09:56:43.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594673a6670 con 0x5594673b3ff0 2023-09-13T09:56:43.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.082+0000 7f433effd700 1 -- 172.21.15.6:0/1188603257 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43540054d0 con 0x5594673b3ff0 2023-09-13T09:56:43.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f433effd700 1 -- 172.21.15.6:0/1188603257 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f435400f7d0 con 0x5594673b3ff0 2023-09-13T09:56:43.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 10 client.29173 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:43.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55946731d7a0 con 0x5594673b3ff0 2023-09-13T09:56:43.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f433effd700 1 -- 172.21.15.6:0/1188603257 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f435403d020 con 0x5594673b3ff0 2023-09-13T09:56:43.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f433effd700 1 -- 172.21.15.6:0/1188603257 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4354023610 con 0x5594673b3ff0 2023-09-13T09:56:43.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 10 client.29173 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:43.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 10 client.29173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:43.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 20 client.29173 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:43.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x5594673cb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 4 client.29173 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:43.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594672fe970 con 0x5594673c8d20 2023-09-13T09:56:43.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.083+0000 7f435f7fe700 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x5594673cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.084+0000 7f435f7fe700 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x5594673cb140 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=515d06fc9f78948b server_cookie=7a39b69d5d2327a5 in_seq=0 out_seq=0 2023-09-13T09:56:43.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.084+0000 7f433effd700 10 client.29173 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:43.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.087+0000 7f433effd700 1 -- 172.21.15.6:0/1188603257 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594672fe970 con 0x5594673c8d20 2023-09-13T09:56:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.087+0000 7f433effd700 10 client.29173 handle_command_reply: tid=0 2023-09-13T09:56:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.087+0000 7f4372346b80 1 client.29173 shutdown 2023-09-13T09:56:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.087+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 msgr2=0x5594673bd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673bd330 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4354009230 tx=0x7f4354009c30 comp rx=0 tx=0).stop 2023-09-13T09:56:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 shutdown_connections 2023-09-13T09:56:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x5594673cb140 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b49b0 0x5594673c2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f433effd700 0 client.29173 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:43.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b36b0 0x5594673bcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 --2- 172.21.15.6:0/1188603257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673bd330 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 >> 172.21.15.6:0/1188603257 conn(0x559467311c80 msgr2=0x5594673b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 shutdown_connections 2023-09-13T09:56:43.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 1 -- 172.21.15.6:0/1188603257 wait complete. 2023-09-13T09:56:43.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.088+0000 7f4372346b80 20 client.29173 trim_cache size 0 max 16384 2023-09-13T09:56:43.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 Processor -- start 2023-09-13T09:56:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 -- start start 2023-09-13T09:56:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b36b0 0x5594673d88e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x5594673bb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594673af730 con 0x5594673b36b0 2023-09-13T09:56:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594673d8e20 con 0x5594673b49b0 2023-09-13T09:56:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f4372346b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594673baf60 con 0x5594673b3ff0 2023-09-13T09:56:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b36b0 0x5594673d88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b36b0 0x5594673d88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44514/0 (socket says 172.21.15.6:44514) 2023-09-13T09:56:43.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f435f7fe700 1 -- 172.21.15.6:0/3556001721 learned_addr learned my addr 172.21.15.6:0/3556001721 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f435ffff700 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x5594673bb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.111+0000 7f435effd700 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f435f7fe700 1 -- 172.21.15.6:0/3556001721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 msgr2=0x5594673c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f435f7fe700 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f435f7fe700 1 -- 172.21.15.6:0/3556001721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 msgr2=0x5594673bb1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f435f7fe700 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x5594673bb1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f435f7fe700 1 -- 172.21.15.6:0/3556001721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559467131de0 con 0x5594673b36b0 2023-09-13T09:56:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f435f7fe700 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b36b0 0x5594673d88e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4350096dc0 tx=0x7f43500c9540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2db341ddf0865659 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f43467fc700 1 -- 172.21.15.6:0/3556001721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435009e180 con 0x5594673b36b0 2023-09-13T09:56:43.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f43467fc700 1 -- 172.21.15.6:0/3556001721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f43500a23c0 con 0x5594673b36b0 2023-09-13T09:56:43.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.112+0000 7f43467fc700 1 -- 172.21.15.6:0/3556001721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435009a5b0 con 0x5594673b36b0 2023-09-13T09:56:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 -- 172.21.15.6:0/3556001721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b36b0 msgr2=0x5594673d88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b36b0 0x5594673d88e0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4350096dc0 tx=0x7f43500c9540 comp rx=0 tx=0).stop 2023-09-13T09:56:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 -- 172.21.15.6:0/3556001721 shutdown_connections 2023-09-13T09:56:43.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x5594673bb1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b36b0 0x5594673d88e0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 --2- 172.21.15.6:0/3556001721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b3ff0 0x5594673c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 -- 172.21.15.6:0/3556001721 >> 172.21.15.6:0/3556001721 conn(0x559467311c80 msgr2=0x5594673ade60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 -- 172.21.15.6:0/3556001721 shutdown_connections 2023-09-13T09:56:43.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 -- 172.21.15.6:0/3556001721 wait complete. 2023-09-13T09:56:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 -- start start 2023-09-13T09:56:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.113+0000 7f4372346b80 1 Processor -- start 2023-09-13T09:56:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f4372346b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x559467417210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f4372346b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b3ff0 0x559467419760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f4372346b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x55946741bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f4372346b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946741c1f0 con 0x5594673b3ff0 2023-09-13T09:56:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f4372346b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946741c330 con 0x5594673b49b0 2023-09-13T09:56:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f4372346b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55946741c4c0 con 0x5594673b36b0 2023-09-13T09:56:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f4372346b80 10 client.0 _ll_register_callbacks cb 0x5594672a1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:43.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b3ff0 0x559467419760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x55946741bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x559467417210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b3ff0 0x559467419760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44522/0 (socket says 172.21.15.6:44522) 2023-09-13T09:56:43.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 -- 172.21.15.6:0/3459783008 learned_addr learned my addr 172.21.15.6:0/3459783008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 -- 172.21.15.6:0/3459783008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 msgr2=0x559467417210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x559467417210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 -- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 msgr2=0x55946741bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x55946741bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 -- 172.21.15.6:0/3459783008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4360068ac0 con 0x5594673b3ff0 2023-09-13T09:56:43.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435ffff700 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x55946741bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:43.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f433effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:56:43.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.114+0000 7f435effd700 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b3ff0 0x559467419760 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f435400c010 tx=0x7f435400f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386e25752d02b1a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f433effd700 1 -- 172.21.15.6:0/3459783008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435402a040 con 0x5594673b3ff0 2023-09-13T09:56:43.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f433effd700 1 -- 172.21.15.6:0/3459783008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f435403e080 con 0x5594673b3ff0 2023-09-13T09:56:43.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f435800f040 con 0x5594673b3ff0 2023-09-13T09:56:43.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f433effd700 1 -- 172.21.15.6:0/3459783008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4354023be0 con 0x5594673b3ff0 2023-09-13T09:56:43.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 10 client.19935 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:43.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55946711ac60 con 0x5594673b3ff0 2023-09-13T09:56:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f433effd700 1 -- 172.21.15.6:0/3459783008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f435800f040 con 0x5594673b3ff0 2023-09-13T09:56:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f433effd700 1 -- 172.21.15.6:0/3459783008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4354041540 con 0x5594673b3ff0 2023-09-13T09:56:43.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 10 client.19935 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 10 client.19935 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 20 client.19935 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x55946741fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 4 client.19935 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:56:43.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.115+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5594672bf050 con 0x5594673c8d20 2023-09-13T09:56:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.116+0000 7f435f7fe700 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x55946741fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.116+0000 7f433effd700 10 client.19935 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.116+0000 7f435f7fe700 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x55946741fb20 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=135f0523b9193dee server_cookie=8a59fa24090513dd in_seq=0 out_seq=0 2023-09-13T09:56:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f433effd700 1 -- 172.21.15.6:0/3459783008 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5594672bf050 con 0x5594673c8d20 2023-09-13T09:56:43.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f433effd700 10 client.19935 handle_command_reply: tid=0 2023-09-13T09:56:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f4372346b80 1 client.19935 shutdown 2023-09-13T09:56:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b3ff0 msgr2=0x559467419760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f4372346b80 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b3ff0 0x559467419760 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f435400c010 tx=0x7f435400f940 comp rx=0 tx=0).stop 2023-09-13T09:56:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 shutdown_connections 2023-09-13T09:56:43.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f4372346b80 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594673b49b0 0x55946741bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.118+0000 7f4372346b80 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594673b36b0 0x559467417210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.119+0000 7f4372346b80 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594673c8d20 0x55946741fb20 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.119+0000 7f4372346b80 1 --2- 172.21.15.6:0/3459783008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594673b3ff0 0x559467419760 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.119+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 >> 172.21.15.6:0/3459783008 conn(0x559467311c80 msgr2=0x5594673bcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.119+0000 7f433effd700 0 client.19935 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.119+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 shutdown_connections 2023-09-13T09:56:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.119+0000 7f4372346b80 1 -- 172.21.15.6:0/3459783008 wait complete. 2023-09-13T09:56:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.119+0000 7f4372346b80 20 client.19935 trim_cache size 0 max 16384 2023-09-13T09:56:43.135 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:56:43.135 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:56:43.135 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:56:43.135 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:56:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43480a0640 msgr2=0x7f43480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43480a0640 0x7f43480a2b00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f435400fa40 tx=0x7f4354019040 comp rx=0 tx=0).stop 2023-09-13T09:56:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43600ffcc0 msgr2=0x7f43601959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43600ffcc0 0x7f43601959f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f435000d950 tx=0x7f435000dc60 comp rx=0 tx=0).stop 2023-09-13T09:56:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 shutdown_connections 2023-09-13T09:56:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43480a0640 0x7f43480a2b00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4360101850 0x7f436019cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43600ffcc0 0x7f43601959f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 --2- 172.21.15.6:0/2097599266 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4360100eb0 0x7f4360195f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 >> 172.21.15.6:0/2097599266 conn(0x7f43600fb250 msgr2=0x7f43600fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 shutdown_connections 2023-09-13T09:56:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.120+0000 7f4366161700 1 -- 172.21.15.6:0/2097599266 wait complete. 2023-09-13T09:56:43.139 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:56:43.140 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:56:43.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 -- 172.21.15.6:0/2567951659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65600ffc90 msgr2=0x7f65601000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 --2- 172.21.15.6:0/2567951659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65600ffc90 0x7f65601000b0 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f65500099c0 tx=0x7f6550009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 -- 172.21.15.6:0/2567951659 shutdown_connections 2023-09-13T09:56:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 --2- 172.21.15.6:0/2567951659 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560101820 0x7f65601080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 --2- 172.21.15.6:0/2567951659 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65600ffc90 0x7f65601000b0 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 --2- 172.21.15.6:0/2567951659 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6560100e80 0x7f65601012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 -- 172.21.15.6:0/2567951659 >> 172.21.15.6:0/2567951659 conn(0x7f65600fb220 msgr2=0x7f65600fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 -- 172.21.15.6:0/2567951659 shutdown_connections 2023-09-13T09:56:43.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.321+0000 7f6564fac700 1 -- 172.21.15.6:0/2567951659 wait complete. 2023-09-13T09:56:43.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.322+0000 7f6564fac700 1 Processor -- start 2023-09-13T09:56:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.322+0000 7f6564fac700 1 -- start start 2023-09-13T09:56:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.322+0000 7f6564fac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6560100e80 0x7f656010fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f6564fac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6560101820 0x7f65601153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f6564fac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560110360 0x7f65601ad790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f6564fac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6560110980 con 0x7f6560101820 2023-09-13T09:56:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f6564fac700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656006a6d0 con 0x7f6560110360 2023-09-13T09:56:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f6564fac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f656006a890 con 0x7f6560100e80 2023-09-13T09:56:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f655dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6560101820 0x7f65601153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f655dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6560101820 0x7f65601153c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44536/0 (socket says 172.21.15.6:44536) 2023-09-13T09:56:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f655dd9b700 1 -- 172.21.15.6:0/607686991 learned_addr learned my addr 172.21.15.6:0/607686991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.323+0000 7f655ed9d700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560110360 0x7f65601ad790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f655e59c700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6560100e80 0x7f656010fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f655ed9d700 1 -- 172.21.15.6:0/607686991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6560100e80 msgr2=0x7f656010fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f655ed9d700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6560100e80 0x7f656010fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f655ed9d700 1 -- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6560101820 msgr2=0x7f65601153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f655ed9d700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6560101820 0x7f65601153c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f655ed9d700 1 -- 172.21.15.6:0/607686991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65500095f0 con 0x7f6560110360 2023-09-13T09:56:43.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f655ed9d700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560110360 0x7f65601ad790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6558007e90 tx=0x7f655800e5b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f654f7fe700 1 -- 172.21.15.6:0/607686991 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f655800ee10 con 0x7f6560110360 2023-09-13T09:56:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f656006ab70 con 0x7f6560110360 2023-09-13T09:56:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f654f7fe700 1 -- 172.21.15.6:0/607686991 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6558004bb0 con 0x7f6560110360 2023-09-13T09:56:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f654f7fe700 1 -- 172.21.15.6:0/607686991 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6558004730 con 0x7f6560110360 2023-09-13T09:56:43.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.324+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f656006b080 con 0x7f6560110360 2023-09-13T09:56:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.328+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6560104850 con 0x7f6560110360 2023-09-13T09:56:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.330+0000 7f654f7fe700 1 -- 172.21.15.6:0/607686991 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6558003a00 con 0x7f6560110360 2023-09-13T09:56:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.331+0000 7f654f7fe700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65480a0640 0x7f65480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.331+0000 7f655e59c700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65480a0640 0x7f65480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.331+0000 7f654f7fe700 1 -- 172.21.15.6:0/607686991 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f65580cb810 con 0x7f6560110360 2023-09-13T09:56:43.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.332+0000 7f655e59c700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65480a0640 0x7f65480a2b00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6550009fd0 tx=0x7f655001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.337+0000 7f654f7fe700 1 -- 172.21.15.6:0/607686991 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f65580952f0 con 0x7f6560110360 2023-09-13T09:56:43.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 173791 38.18 MB/sec execute 123 sec latency 106.865 ms 2023-09-13T09:56:43.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.742+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f656002cd70 con 0x7f6560110360 2023-09-13T09:56:43.761 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:56:43.762 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":62,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":62,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:56:37.565603+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:56:43.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.749+0000 7f654f7fe700 1 -- 172.21.15.6:0/607686991 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 62 v62) v1 ==== 94+0+11338 (secure 0 0 0) 0x7f6558015090 con 0x7f6560110360 2023-09-13T09:56:43.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.767+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65480a0640 msgr2=0x7f65480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.767+0000 7f6564fac700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65480a0640 0x7f65480a2b00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6550009fd0 tx=0x7f655001a040 comp rx=0 tx=0).stop 2023-09-13T09:56:43.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.767+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560110360 msgr2=0x7f65601ad790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.767+0000 7f6564fac700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560110360 0x7f65601ad790 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6558007e90 tx=0x7f655800e5b0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.769+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 shutdown_connections 2023-09-13T09:56:43.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.769+0000 7f6564fac700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6560110360 0x7f65601ad790 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.769+0000 7f6564fac700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6560100e80 0x7f656010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.769+0000 7f6564fac700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f65480a0640 0x7f65480a2b00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.769+0000 7f6564fac700 1 --2- 172.21.15.6:0/607686991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6560101820 0x7f65601153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.769+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 >> 172.21.15.6:0/607686991 conn(0x7f65600fb220 msgr2=0x7f65600fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.771+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 shutdown_connections 2023-09-13T09:56:43.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.771+0000 7f6564fac700 1 -- 172.21.15.6:0/607686991 wait complete. 2023-09-13T09:56:43.781 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 62 2023-09-13T09:56:43.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:56:43.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2715287942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0100e80 msgr2=0x7f24b01012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2715287942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0100e80 0x7f24b01012e0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f249c0099c0 tx=0x7f249c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2715287942 shutdown_connections 2023-09-13T09:56:43.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2715287942 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b0101820 0x7f24b01080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2715287942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b00ffc90 0x7f24b01000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2715287942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b0100e80 0x7f24b01012e0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2715287942 >> 172.21.15.6:0/2715287942 conn(0x7f24b00fb220 msgr2=0x7f24b00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2715287942 shutdown_connections 2023-09-13T09:56:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.975+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2715287942 wait complete. 2023-09-13T09:56:43.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 Processor -- start 2023-09-13T09:56:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 -- start start 2023-09-13T09:56:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b00ffc90 0x7f24b0196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b0100e80 0x7f24b0196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b0101820 0x7f24b019e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b019e630 con 0x7f24b00ffc90 2023-09-13T09:56:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b006a6d0 con 0x7f24b0100e80 2023-09-13T09:56:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b6ad8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24b006a860 con 0x7f24b0101820 2023-09-13T09:56:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b4874700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b00ffc90 0x7f24b0196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b4874700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b00ffc90 0x7f24b0196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44548/0 (socket says 172.21.15.6:44548) 2023-09-13T09:56:43.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b4874700 1 -- 172.21.15.6:0/2052006849 learned_addr learned my addr 172.21.15.6:0/2052006849 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24affff700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b0100e80 0x7f24b0196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.976+0000 7f24b5075700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b0101820 0x7f24b019e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24b4874700 1 -- 172.21.15.6:0/2052006849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b0101820 msgr2=0x7f24b019e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24b4874700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b0101820 0x7f24b019e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24b4874700 1 -- 172.21.15.6:0/2052006849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b0100e80 msgr2=0x7f24b0196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24b4874700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b0100e80 0x7f24b0196ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24b4874700 1 -- 172.21.15.6:0/2052006849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0095f0 con 0x7f24b00ffc90 2023-09-13T09:56:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24b4874700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b00ffc90 0x7f24b0196ab0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f24a400e970 tx=0x7f24a400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24adffb700 1 -- 172.21.15.6:0/2052006849 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4009790 con 0x7f24b00ffc90 2023-09-13T09:56:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24adffb700 1 -- 172.21.15.6:0/2052006849 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24a400c7e0 con 0x7f24b00ffc90 2023-09-13T09:56:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24adffb700 1 -- 172.21.15.6:0/2052006849 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a4003c70 con 0x7f24b00ffc90 2023-09-13T09:56:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.977+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24b006ab40 con 0x7f24b00ffc90 2023-09-13T09:56:43.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.978+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b006b000 con 0x7f24b00ffc90 2023-09-13T09:56:43.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.980+0000 7f24adffb700 1 -- 172.21.15.6:0/2052006849 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f24a400cc50 con 0x7f24b00ffc90 2023-09-13T09:56:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.981+0000 7f24adffb700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24a00a0640 0x7f24a00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.981+0000 7f24adffb700 1 -- 172.21.15.6:0/2052006849 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f24a4014070 con 0x7f24b00ffc90 2023-09-13T09:56:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.981+0000 7f24affff700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24a00a0640 0x7f24a00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 Processor -- start 2023-09-13T09:56:43.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 -- start start 2023-09-13T09:56:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24affff700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24a00a0640 0x7f24a00a2b00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f249c00b580 tx=0x7f249c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73e1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73dfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e06e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c7330780 con 0x55c0c73e0260 2023-09-13T09:56:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c732e0a0 con 0x55c0c73e18d0 2023-09-13T09:56:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c7329990 con 0x55c0c73e0f70 2023-09-13T09:56:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24b4874700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24b5075700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73dfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:43.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24b4874700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73e1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47610/0 (socket says 172.21.15.6:47610) 2023-09-13T09:56:43.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73dfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38082/0 (socket says 172.21.15.6:38082) 2023-09-13T09:56:43.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24b5075700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44560/0 (socket says 172.21.15.6:44560) 2023-09-13T09:56:43.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.982+0000 7f24b4874700 1 -- 172.21.15.6:0/3808266438 learned_addr learned my addr 172.21.15.6:0/3808266438 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:43.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f24affff700 1 -- 172.21.15.6:0/3808266438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 msgr2=0x55c0c73e1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f24affff700 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73e1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f24affff700 1 -- 172.21.15.6:0/3808266438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 msgr2=0x55c0c73e06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f24affff700 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e06e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f24affff700 1 -- 172.21.15.6:0/3808266438 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c71a9630 con 0x55c0c73e18d0 2023-09-13T09:56:43.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f24b5075700 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f24affff700 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73dfcd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f249c0098e0 tx=0x7f249c01f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6de055c88ec01e68 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f249affd700 1 -- 172.21.15.6:0/3808266438 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c029070 con 0x55c0c73e18d0 2023-09-13T09:56:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f249affd700 1 -- 172.21.15.6:0/3808266438 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f249c01e040 con 0x55c0c73e18d0 2023-09-13T09:56:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.983+0000 7f249affd700 1 -- 172.21.15.6:0/3808266438 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c00f6c0 con 0x55c0c73e18d0 2023-09-13T09:56:43.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3808266438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 msgr2=0x55c0c73dfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73dfcd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f249c0098e0 tx=0x7f249c01f000 comp rx=0 tx=0).stop 2023-09-13T09:56:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3808266438 shutdown_connections 2023-09-13T09:56:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73e1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3808266438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73dfcd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3808266438 >> 172.21.15.6:0/3808266438 conn(0x55c0c7335c80 msgr2=0x55c0c73d1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3808266438 shutdown_connections 2023-09-13T09:56:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3808266438 wait complete. 2023-09-13T09:56:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.984+0000 7f24c2cbdb80 1 -- start start 2023-09-13T09:56:43.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 1 Processor -- start 2023-09-13T09:56:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0f70 0x55c0c73e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e18d0 0x55c0c73f0be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c72c7bb0 con 0x55c0c73e0260 2023-09-13T09:56:43.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c72c78b0 con 0x55c0c73e0f70 2023-09-13T09:56:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c71ab920 con 0x55c0c73e18d0 2023-09-13T09:56:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24c2cbdb80 10 client.0 _ll_register_callbacks cb 0x55c0c72c5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24b4874700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0f70 0x55c0c73e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24b4874700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44562/0 (socket says 172.21.15.6:44562) 2023-09-13T09:56:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24affff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0f70 0x55c0c73e9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38088/0 (socket says 172.21.15.6:38088) 2023-09-13T09:56:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24b4874700 1 -- 172.21.15.6:0/4248723850 learned_addr learned my addr 172.21.15.6:0/4248723850 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24b5075700 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e18d0 0x55c0c73f0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24affff700 1 -- 172.21.15.6:0/4248723850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e18d0 msgr2=0x55c0c73f0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24affff700 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e18d0 0x55c0c73f0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24affff700 1 -- 172.21.15.6:0/4248723850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 msgr2=0x55c0c73e9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24affff700 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.985+0000 7f24affff700 1 -- 172.21.15.6:0/4248723850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b0108a20 con 0x55c0c73e0f70 2023-09-13T09:56:44.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f24affff700 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0f70 0x55c0c73e9ba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f249c000c00 tx=0x7f249c00fbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c797f93078068b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f248ffff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f248ffff700 1 -- 172.21.15.6:0/4248723850 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c029040 con 0x55c0c73e0f70 2023-09-13T09:56:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f248ffff700 1 -- 172.21.15.6:0/4248723850 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f249c005450 con 0x55c0c73e0f70 2023-09-13T09:56:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c0c73ca670 con 0x55c0c73e0f70 2023-09-13T09:56:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f248ffff700 1 -- 172.21.15.6:0/4248723850 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f249c0039e0 con 0x55c0c73e0f70 2023-09-13T09:56:44.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f24c2cbdb80 10 client.29252 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55c0c73417a0 con 0x55c0c73e0f70 2023-09-13T09:56:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.986+0000 7f248ffff700 1 -- 172.21.15.6:0/4248723850 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c0c73ca670 con 0x55c0c73e0f70 2023-09-13T09:56:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f248ffff700 1 -- 172.21.15.6:0/4248723850 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f249c041bc0 con 0x55c0c73e0f70 2023-09-13T09:56:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24c2cbdb80 10 client.29252 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24c2cbdb80 10 client.29252 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:56:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24c2cbdb80 20 client.29252 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c73f4f10 0x55c0c73f7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24c2cbdb80 4 client.29252 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c0c7322970 con 0x55c0c73f4f10 2023-09-13T09:56:44.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24b4874700 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c73f4f10 0x55c0c73f7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f248ffff700 10 client.29252 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.987+0000 7f24b4874700 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c73f4f10 0x55c0c73f7300 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=b239db0f9fd504fc server_cookie=6c7d3b0471681454 in_seq=0 out_seq=0 2023-09-13T09:56:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f248ffff700 1 -- 172.21.15.6:0/4248723850 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c0c7322970 con 0x55c0c73f4f10 2023-09-13T09:56:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f248ffff700 10 client.29252 handle_command_reply: tid=0 2023-09-13T09:56:44.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 client.29252 shutdown 2023-09-13T09:56:44.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0f70 msgr2=0x55c0c73e9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0f70 0x55c0c73e9ba0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f249c000c00 tx=0x7f249c00fbb0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 shutdown_connections 2023-09-13T09:56:44.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c73f4f10 0x55c0c73f7300 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e18d0 0x55c0c73f0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73e9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f248ffff700 0 client.29252 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/4248723850 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0f70 0x55c0c73e9ba0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 >> 172.21.15.6:0/4248723850 conn(0x55c0c7335c80 msgr2=0x55c0c73cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 shutdown_connections 2023-09-13T09:56:44.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.989+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/4248723850 wait complete. 2023-09-13T09:56:44.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:43.990+0000 7f24c2cbdb80 20 client.29252 trim_cache size 0 max 16384 2023-09-13T09:56:44.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 Processor -- start 2023-09-13T09:56:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 -- start start 2023-09-13T09:56:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73d2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c73d3fd0 con 0x55c0c73e0260 2023-09-13T09:56:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c73ca400 con 0x55c0c73e18d0 2023-09-13T09:56:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c73e80e0 con 0x55c0c73e0f70 2023-09-13T09:56:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24b5075700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24affff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.004+0000 7f24b5075700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73f14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38096/0 (socket says 172.21.15.6:38096) 2023-09-13T09:56:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b5075700 1 -- 172.21.15.6:0/709004740 learned_addr learned my addr 172.21.15.6:0/709004740 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b4874700 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73d2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b5075700 1 -- 172.21.15.6:0/709004740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 msgr2=0x55c0c73f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b5075700 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b5075700 1 -- 172.21.15.6:0/709004740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 msgr2=0x55c0c73d2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b5075700 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73d2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b5075700 1 -- 172.21.15.6:0/709004740 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c0c7155de0 con 0x55c0c73e18d0 2023-09-13T09:56:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24affff700 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b4874700 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f24b5075700 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73f14d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24a8017880 tx=0x7f24a8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbc2a50460b7ce96 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f249b7fe700 1 -- 172.21.15.6:0/709004740 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a800e040 con 0x55c0c73e18d0 2023-09-13T09:56:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f249b7fe700 1 -- 172.21.15.6:0/709004740 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24a800f040 con 0x55c0c73e18d0 2023-09-13T09:56:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.005+0000 7f249b7fe700 1 -- 172.21.15.6:0/709004740 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a8004700 con 0x55c0c73e18d0 2023-09-13T09:56:44.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/709004740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 msgr2=0x55c0c73f14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73f14d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f24a8017880 tx=0x7f24a8009920 comp rx=0 tx=0).stop 2023-09-13T09:56:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/709004740 shutdown_connections 2023-09-13T09:56:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e18d0 0x55c0c73f14d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e0260 0x55c0c73d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/709004740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/709004740 >> 172.21.15.6:0/709004740 conn(0x55c0c7335c80 msgr2=0x55c0c73d1e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/709004740 shutdown_connections 2023-09-13T09:56:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/709004740 wait complete. 2023-09-13T09:56:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 -- start start 2023-09-13T09:56:44.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.006+0000 7f24c2cbdb80 1 Processor -- start 2023-09-13T09:56:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0260 0x55c0c73ee3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73ee930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24c2cbdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e18d0 0x55c0c73ef940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c73efe80 con 0x55c0c73e18d0 2023-09-13T09:56:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c73efff0 con 0x55c0c73e0260 2023-09-13T09:56:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24c2cbdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c0c73f01b0 con 0x55c0c73e0f70 2023-09-13T09:56:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24c2cbdb80 10 client.0 _ll_register_callbacks cb 0x55c0c72c5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0260 0x55c0c73ee3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b5075700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e18d0 0x55c0c73ef940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0260 0x55c0c73ee3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38100/0 (socket says 172.21.15.6:38100) 2023-09-13T09:56:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b5075700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e18d0 0x55c0c73ef940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44580/0 (socket says 172.21.15.6:44580) 2023-09-13T09:56:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24affff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73ee930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 -- 172.21.15.6:0/3160824994 learned_addr learned my addr 172.21.15.6:0/3160824994 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 -- 172.21.15.6:0/3160824994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 msgr2=0x55c0c73ee930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73ee930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 -- 172.21.15.6:0/3160824994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e18d0 msgr2=0x55c0c73ef940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e18d0 0x55c0c73ef940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b4874700 1 -- 172.21.15.6:0/3160824994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24b006b000 con 0x55c0c73e0260 2023-09-13T09:56:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24affff700 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.007+0000 7f24b5075700 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e18d0 0x55c0c73ef940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24b4874700 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0260 0x55c0c73ee3f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f24a4095fc0 tx=0x7f24a4084040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdf0e56b2d0b2399 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f248ffff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f248ffff700 1 -- 172.21.15.6:0/3160824994 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a40a15c0 con 0x55c0c73e0260 2023-09-13T09:56:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f248ffff700 1 -- 172.21.15.6:0/3160824994 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f24a40978f0 con 0x55c0c73e0260 2023-09-13T09:56:44.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f249c01e040 con 0x55c0c73e0260 2023-09-13T09:56:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f248ffff700 1 -- 172.21.15.6:0/3160824994 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24a400c950 con 0x55c0c73e0260 2023-09-13T09:56:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 10 client.29258 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55c0c73417a0 con 0x55c0c73e0260 2023-09-13T09:56:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f248ffff700 1 -- 172.21.15.6:0/3160824994 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f249c01e040 con 0x55c0c73e0260 2023-09-13T09:56:44.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f248ffff700 1 -- 172.21.15.6:0/3160824994 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f24a40840b0 con 0x55c0c73e0260 2023-09-13T09:56:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 10 client.29258 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 10 client.29258 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:56:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 20 client.29258 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c74496f0 0x55c0c744bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 4 client.29258 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c0c72e3050 con 0x55c0c74496f0 2023-09-13T09:56:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.008+0000 7f24affff700 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c74496f0 0x55c0c744bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.009+0000 7f248ffff700 10 client.29258 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.009+0000 7f24affff700 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c74496f0 0x55c0c744bb10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=29ebf55edcc538c3 server_cookie=7dca56bbe6e10f9e in_seq=0 out_seq=0 2023-09-13T09:56:44.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.009+0000 7f248ffff700 1 -- 172.21.15.6:0/3160824994 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c0c72e3050 con 0x55c0c74496f0 2023-09-13T09:56:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.009+0000 7f248ffff700 10 client.29258 handle_command_reply: tid=0 2023-09-13T09:56:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.009+0000 7f24c2cbdb80 1 client.29258 shutdown 2023-09-13T09:56:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0260 msgr2=0x55c0c73ee3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0260 0x55c0c73ee3f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f24a4095fc0 tx=0x7f24a4084040 comp rx=0 tx=0).stop 2023-09-13T09:56:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 shutdown_connections 2023-09-13T09:56:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55c0c74496f0 0x55c0c744bb10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c0c73e18d0 0x55c0c73ef940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f248ffff700 0 client.29258 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:56:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c0c73e0260 0x55c0c73ee3f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 --2- 172.21.15.6:0/3160824994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c0c73e0f70 0x55c0c73ee930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 >> 172.21.15.6:0/3160824994 conn(0x55c0c7335c80 msgr2=0x55c0c73e42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 shutdown_connections 2023-09-13T09:56:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 1 -- 172.21.15.6:0/3160824994 wait complete. 2023-09-13T09:56:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24c2cbdb80 20 client.29258 trim_cache size 0 max 16384 2023-09-13T09:56:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24a00a0640 msgr2=0x7f24a00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24a00a0640 0x7f24a00a2b00 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f249c00b580 tx=0x7f249c005fb0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b00ffc90 msgr2=0x7f24b0196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b00ffc90 0x7f24b0196ab0 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f24a400e970 tx=0x7f24a400ec80 comp rx=0 tx=0).stop 2023-09-13T09:56:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 shutdown_connections 2023-09-13T09:56:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.010+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f24b0101820 0x7f24b019e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.011+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24a00a0640 0x7f24a00a2b00 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.011+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24b00ffc90 0x7f24b0196ab0 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.011+0000 7f24b6ad8700 1 --2- 172.21.15.6:0/2052006849 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f24b0100e80 0x7f24b0196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.011+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 >> 172.21.15.6:0/2052006849 conn(0x7f24b00fb220 msgr2=0x7f24b00691c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.011+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 shutdown_connections 2023-09-13T09:56:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.011+0000 7f24b6ad8700 1 -- 172.21.15.6:0/2052006849 wait complete. 2023-09-13T09:56:44.037 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:56:44.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.232+0000 7f87c995b700 1 -- 172.21.15.6:0/2522242840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4102960 msgr2=0x7f87c4109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.232+0000 7f87c995b700 1 --2- 172.21.15.6:0/2522242840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4102960 0x7f87c4109210 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009f90 tx=0x7f87bc00b330 comp rx=0 tx=0).stop 2023-09-13T09:56:44.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.232+0000 7f87c995b700 1 -- 172.21.15.6:0/2522242840 shutdown_connections 2023-09-13T09:56:44.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.232+0000 7f87c995b700 1 --2- 172.21.15.6:0/2522242840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4102960 0x7f87c4109210 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.232+0000 7f87c995b700 1 --2- 172.21.15.6:0/2522242840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c4100dd0 0x7f87c41011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.232+0000 7f87c995b700 1 --2- 172.21.15.6:0/2522242840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c4101fc0 0x7f87c4102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.232+0000 7f87c995b700 1 -- 172.21.15.6:0/2522242840 >> 172.21.15.6:0/2522242840 conn(0x7f87c40fc320 msgr2=0x7f87c40fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.234+0000 7f87c995b700 1 -- 172.21.15.6:0/2522242840 shutdown_connections 2023-09-13T09:56:44.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.234+0000 7f87c995b700 1 -- 172.21.15.6:0/2522242840 wait complete. 2023-09-13T09:56:44.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.235+0000 7f87c995b700 1 Processor -- start 2023-09-13T09:56:44.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.235+0000 7f87c995b700 1 -- start start 2023-09-13T09:56:44.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.235+0000 7f87c995b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4100dd0 0x7f87c419d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c995b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c4101fc0 0x7f87c419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4100dd0 0x7f87c419d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4100dd0 0x7f87c419d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47644/0 (socket says 172.21.15.6:47644) 2023-09-13T09:56:44.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c995b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c4102960 0x7f87c41a46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 -- 172.21.15.6:0/3233035945 learned_addr learned my addr 172.21.15.6:0/3233035945 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41a4cb0 con 0x7f87c4101fc0 2023-09-13T09:56:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41a4df0 con 0x7f87c4102960 2023-09-13T09:56:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c41a4f80 con 0x7f87c4100dd0 2023-09-13T09:56:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c27fc700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c4101fc0 0x7f87c419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c37fe700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c4102960 0x7f87c41a46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 -- 172.21.15.6:0/3233035945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c4102960 msgr2=0x7f87c41a46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c4102960 0x7f87c41a46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 -- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c4101fc0 msgr2=0x7f87c419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c4101fc0 0x7f87c419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c2ffd700 1 -- 172.21.15.6:0/3233035945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b80095f0 con 0x7f87c4100dd0 2023-09-13T09:56:44.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.236+0000 7f87c37fe700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c4102960 0x7f87c41a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:56:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.237+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4100dd0 0x7f87c419d130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e970 tx=0x7f87b400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.237+0000 7f87c8959700 1 -- 172.21.15.6:0/3233035945 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4009790 con 0x7f87c4100dd0 2023-09-13T09:56:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.237+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc009c40 con 0x7f87c4100dd0 2023-09-13T09:56:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.237+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c41a5630 con 0x7f87c4100dd0 2023-09-13T09:56:44.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.237+0000 7f87c8959700 1 -- 172.21.15.6:0/3233035945 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87b400eec0 con 0x7f87c4100dd0 2023-09-13T09:56:44.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.237+0000 7f87c8959700 1 -- 172.21.15.6:0/3233035945 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4003cb0 con 0x7f87c4100dd0 2023-09-13T09:56:44.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.240+0000 7f87c8959700 1 -- 172.21.15.6:0/3233035945 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f87b400cbd0 con 0x7f87c4100dd0 2023-09-13T09:56:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.241+0000 7f87c8959700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f87ac0a0640 0x7f87ac0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.242+0000 7f87c8959700 1 -- 172.21.15.6:0/3233035945 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f87b4014070 con 0x7f87c4100dd0 2023-09-13T09:56:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.242+0000 7f87c27fc700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f87ac0a0640 0x7f87ac0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.242+0000 7f87d5b40b80 1 Processor -- start 2023-09-13T09:56:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87d5b40b80 1 -- start start 2023-09-13T09:56:44.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a425700 0x55ae1a425b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a424a00 0x55ae1a424e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a37d780 con 0x55ae1a425700 2023-09-13T09:56:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a37b0a0 con 0x55ae1a426060 2023-09-13T09:56:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a376990 con 0x55ae1a424a00 2023-09-13T09:56:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.243+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a425700 0x55ae1a425b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a425700 0x55ae1a425b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44598/0 (socket says 172.21.15.6:44598) 2023-09-13T09:56:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 -- 172.21.15.6:0/4227822356 learned_addr learned my addr 172.21.15.6:0/4227822356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 -- 172.21.15.6:0/4227822356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a424a00 msgr2=0x55ae1a424e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/4227822356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a424a00 0x55ae1a424e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 -- 172.21.15.6:0/4227822356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 msgr2=0x55ae1a4244c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:56:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/4227822356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4244c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 -- 172.21.15.6:0/4227822356 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae1a1f6630 con 0x55ae1a425700 2023-09-13T09:56:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/4227822356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a425700 0x55ae1a425b20 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f87b40995d0 tx=0x7f87b4099540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90799a707d3095c2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87c27fc700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f87ac0a0640 0x7f87ac0a2b00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005fd0 tx=0x7f87b8009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.244+0000 7f87a9ffb700 1 -- 172.21.15.6:0/4227822356 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b409d470 con 0x55ae1a425700 2023-09-13T09:56:44.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.245+0000 7f87a9ffb700 1 -- 172.21.15.6:0/4227822356 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87b4082e90 con 0x55ae1a425700 2023-09-13T09:56:44.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.245+0000 7f87a9ffb700 1 -- 172.21.15.6:0/4227822356 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b40a1480 con 0x55ae1a425700 2023-09-13T09:56:44.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 -- 172.21.15.6:0/4227822356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a425700 msgr2=0x55ae1a425b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/4227822356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a425700 0x55ae1a425b20 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f87b40995d0 tx=0x7f87b4099540 comp rx=0 tx=0).stop 2023-09-13T09:56:44.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 -- 172.21.15.6:0/4227822356 shutdown_connections 2023-09-13T09:56:44.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/4227822356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a424a00 0x55ae1a424e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/4227822356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a425700 0x55ae1a425b20 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/4227822356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4244c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 -- 172.21.15.6:0/4227822356 >> 172.21.15.6:0/4227822356 conn(0x55ae1a382c80 msgr2=0x55ae1a41ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 -- 172.21.15.6:0/4227822356 shutdown_connections 2023-09-13T09:56:44.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 -- 172.21.15.6:0/4227822356 wait complete. 2023-09-13T09:56:44.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.246+0000 7f87d5b40b80 1 -- start start 2023-09-13T09:56:44.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 1 Processor -- start 2023-09-13T09:56:44.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a42dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a42e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4352c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a314bb0 con 0x55ae1a424a00 2023-09-13T09:56:44.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a3148b0 con 0x55ae1a426060 2023-09-13T09:56:44.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a1f8920 con 0x55ae1a425700 2023-09-13T09:56:44.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87d5b40b80 10 client.0 _ll_register_callbacks cb 0x55ae1a312680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87c27fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a42e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4352c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38130/0 (socket says 172.21.15.6:38130) 2023-09-13T09:56:44.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.247+0000 7f87c37fe700 1 -- 172.21.15.6:0/1001421420 learned_addr learned my addr 172.21.15.6:0/1001421420 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87c37fe700 1 -- 172.21.15.6:0/1001421420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 msgr2=0x55ae1a42e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87c37fe700 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a42e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87c37fe700 1 -- 172.21.15.6:0/1001421420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 msgr2=0x55ae1a42dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87c37fe700 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a42dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87c37fe700 1 -- 172.21.15.6:0/1001421420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c41a5630 con 0x55ae1a426060 2023-09-13T09:56:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87c37fe700 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4352c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009510 tx=0x7f87bc007bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a30ce175b91b00e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87a2ffd700 1 -- 172.21.15.6:0/1001421420 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc00e070 con 0x55ae1a426060 2023-09-13T09:56:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87a2ffd700 1 -- 172.21.15.6:0/1001421420 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f87bc007e00 con 0x55ae1a426060 2023-09-13T09:56:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.248+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae1a417670 con 0x55ae1a426060 2023-09-13T09:56:44.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.249+0000 7f87a2ffd700 1 -- 172.21.15.6:0/1001421420 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87bc004c40 con 0x55ae1a426060 2023-09-13T09:56:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.249+0000 7f87d5b40b80 10 client.29267 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.249+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55ae1a38e7a0 con 0x55ae1a426060 2023-09-13T09:56:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.249+0000 7f87a2ffd700 1 -- 172.21.15.6:0/1001421420 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ae1a417670 con 0x55ae1a426060 2023-09-13T09:56:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87a2ffd700 1 -- 172.21.15.6:0/1001421420 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f87bc00b050 con 0x55ae1a426060 2023-09-13T09:56:44.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87d5b40b80 10 client.29267 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87d5b40b80 10 client.29267 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:56:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87d5b40b80 20 client.29267 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a439b90 0x55ae1a43bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87d5b40b80 4 client.29267 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:44.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ae1a36f970 con 0x55ae1a439b90 2023-09-13T09:56:44.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.250+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a439b90 0x55ae1a43bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.252+0000 7f87a2ffd700 10 client.29267 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.252+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a439b90 0x55ae1a43bfb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b856129e546b4797 server_cookie=962db707cde265e7 in_seq=0 out_seq=0 2023-09-13T09:56:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.257+0000 7f87a2ffd700 1 -- 172.21.15.6:0/1001421420 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ae1a36f970 con 0x55ae1a439b90 2023-09-13T09:56:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.257+0000 7f87a2ffd700 10 client.29267 handle_command_reply: tid=0 2023-09-13T09:56:44.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.257+0000 7f87d5b40b80 1 client.29267 shutdown 2023-09-13T09:56:44.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.257+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 msgr2=0x55ae1a4352c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.257+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4352c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009510 tx=0x7f87bc007bb0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 shutdown_connections 2023-09-13T09:56:44.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a439b90 0x55ae1a43bfb0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a4352c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87a2ffd700 0 client.29267 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a42dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/1001421420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a42e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 >> 172.21.15.6:0/1001421420 conn(0x55ae1a382c80 msgr2=0x55ae1a4197f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 shutdown_connections 2023-09-13T09:56:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 1 -- 172.21.15.6:0/1001421420 wait complete. 2023-09-13T09:56:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.258+0000 7f87d5b40b80 20 client.29267 trim_cache size 0 max 16384 2023-09-13T09:56:44.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 Processor -- start 2023-09-13T09:56:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 -- start start 2023-09-13T09:56:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a4244c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a435280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a42dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a42bc70 con 0x55ae1a424a00 2023-09-13T09:56:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a4294c0 con 0x55ae1a426060 2023-09-13T09:56:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.277+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a439890 con 0x55ae1a425700 2023-09-13T09:56:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a4244c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a4244c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44610/0 (socket says 172.21.15.6:44610) 2023-09-13T09:56:44.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 -- 172.21.15.6:0/286975072 learned_addr learned my addr 172.21.15.6:0/286975072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c37fe700 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a42dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 -- 172.21.15.6:0/286975072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 msgr2=0x55ae1a435280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a435280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 -- 172.21.15.6:0/286975072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 msgr2=0x55ae1a42dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a42dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 -- 172.21.15.6:0/286975072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ae1a1a2de0 con 0x55ae1a424a00 2023-09-13T09:56:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a4244c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f87b4099340 tx=0x7f87b4099dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d48a322427a3f93 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87aa7fc700 1 -- 172.21.15.6:0/286975072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b40a1730 con 0x55ae1a424a00 2023-09-13T09:56:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87aa7fc700 1 -- 172.21.15.6:0/286975072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f87b409d170 con 0x55ae1a424a00 2023-09-13T09:56:44.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.278+0000 7f87aa7fc700 1 -- 172.21.15.6:0/286975072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4099b00 con 0x55ae1a424a00 2023-09-13T09:56:44.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 -- 172.21.15.6:0/286975072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 msgr2=0x55ae1a4244c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a4244c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f87b4099340 tx=0x7f87b4099dc0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 -- 172.21.15.6:0/286975072 shutdown_connections 2023-09-13T09:56:44.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a426060 0x55ae1a42dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a424a00 0x55ae1a4244c0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/286975072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a435280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 -- 172.21.15.6:0/286975072 >> 172.21.15.6:0/286975072 conn(0x55ae1a382c80 msgr2=0x55ae1a428960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.279+0000 7f87d5b40b80 1 -- 172.21.15.6:0/286975072 shutdown_connections 2023-09-13T09:56:44.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.280+0000 7f87d5b40b80 1 -- 172.21.15.6:0/286975072 wait complete. 2023-09-13T09:56:44.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.280+0000 7f87d5b40b80 1 -- start start 2023-09-13T09:56:44.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.280+0000 7f87d5b40b80 1 Processor -- start 2023-09-13T09:56:44.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a424a00 0x55ae1a430010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a430550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87d5b40b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a426060 0x55ae1a48c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a430b30 con 0x55ae1a426060 2023-09-13T09:56:44.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a48cee0 con 0x55ae1a424a00 2023-09-13T09:56:44.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87d5b40b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ae1a48d020 con 0x55ae1a425700 2023-09-13T09:56:44.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87d5b40b80 10 client.0 _ll_register_callbacks cb 0x55ae1a312680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a426060 0x55ae1a48c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a424a00 0x55ae1a430010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a426060 0x55ae1a48c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44618/0 (socket says 172.21.15.6:44618) 2023-09-13T09:56:44.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c37fe700 1 -- 172.21.15.6:0/492401289 learned_addr learned my addr 172.21.15.6:0/492401289 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a424a00 0x55ae1a430010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38140/0 (socket says 172.21.15.6:38140) 2023-09-13T09:56:44.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c27fc700 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a430550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 -- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 msgr2=0x55ae1a430550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a430550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 -- 172.21.15.6:0/492401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a426060 msgr2=0x55ae1a48c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a426060 0x55ae1a48c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 -- 172.21.15.6:0/492401289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ae1a1f6630 con 0x55ae1a424a00 2023-09-13T09:56:44.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c37fe700 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a426060 0x55ae1a48c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87c2ffd700 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a424a00 0x55ae1a430010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87b40c9cc0 tx=0x7f87b40a1730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6791d4559095c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.281+0000 7f87a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:44.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87a2ffd700 1 -- 172.21.15.6:0/492401289 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b4097780 con 0x55ae1a424a00 2023-09-13T09:56:44.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87a2ffd700 1 -- 172.21.15.6:0/492401289 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f87b409d170 con 0x55ae1a424a00 2023-09-13T09:56:44.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ae1a330050 con 0x55ae1a424a00 2023-09-13T09:56:44.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87a2ffd700 1 -- 172.21.15.6:0/492401289 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f87b4098b30 con 0x55ae1a424a00 2023-09-13T09:56:44.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 10 client.29273 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55ae1a18bc60 con 0x55ae1a424a00 2023-09-13T09:56:44.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87a2ffd700 1 -- 172.21.15.6:0/492401289 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ae1a330050 con 0x55ae1a424a00 2023-09-13T09:56:44.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87a2ffd700 1 -- 172.21.15.6:0/492401289 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f87b40998a0 con 0x55ae1a424a00 2023-09-13T09:56:44.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 10 client.29273 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 10 client.29273 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:56:44.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 20 client.29273 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a48e530 0x55ae1a490950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 4 client.29273 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:44.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.282+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ae1a1c3f70 con 0x55ae1a48e530 2023-09-13T09:56:44.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.283+0000 7f87c27fc700 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a48e530 0x55ae1a490950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.283+0000 7f87a2ffd700 10 client.29273 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:44.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.283+0000 7f87c27fc700 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a48e530 0x55ae1a490950 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8a887510df5be38f server_cookie=1e6e2c2fac75b6be in_seq=0 out_seq=0 2023-09-13T09:56:44.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87a2ffd700 1 -- 172.21.15.6:0/492401289 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ae1a1c3f70 con 0x55ae1a48e530 2023-09-13T09:56:44.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87a2ffd700 10 client.29273 handle_command_reply: tid=0 2023-09-13T09:56:44.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 client.29273 shutdown 2023-09-13T09:56:44.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a424a00 msgr2=0x55ae1a430010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a424a00 0x55ae1a430010 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87b40c9cc0 tx=0x7f87b40a1730 comp rx=0 tx=0).stop 2023-09-13T09:56:44.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 shutdown_connections 2023-09-13T09:56:44.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ae1a48e530 0x55ae1a490950 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ae1a426060 0x55ae1a48c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ae1a424a00 0x55ae1a430010 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87a2ffd700 0 client.29273 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:56:44.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 --2- 172.21.15.6:0/492401289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ae1a425700 0x55ae1a430550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 >> 172.21.15.6:0/492401289 conn(0x55ae1a382c80 msgr2=0x55ae1a42dc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 shutdown_connections 2023-09-13T09:56:44.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 1 -- 172.21.15.6:0/492401289 wait complete. 2023-09-13T09:56:44.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.285+0000 7f87d5b40b80 20 client.29273 trim_cache size 0 max 16384 2023-09-13T09:56:44.299 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:44.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.286+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f87ac0a0640 msgr2=0x7f87ac0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.286+0000 7f87c995b700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f87ac0a0640 0x7f87ac0a2b00 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f87b8005fd0 tx=0x7f87b8009310 comp rx=0 tx=0).stop 2023-09-13T09:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.286+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4100dd0 msgr2=0x7f87c419d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.286+0000 7f87c995b700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4100dd0 0x7f87c419d130 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f87b400e970 tx=0x7f87b400ec80 comp rx=0 tx=0).stop 2023-09-13T09:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.287+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 shutdown_connections 2023-09-13T09:56:44.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.287+0000 7f87c995b700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f87c4102960 0x7f87c41a46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.287+0000 7f87c995b700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87c4100dd0 0x7f87c419d130 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.287+0000 7f87c995b700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f87ac0a0640 0x7f87ac0a2b00 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.287+0000 7f87c995b700 1 --2- 172.21.15.6:0/3233035945 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87c4101fc0 0x7f87c419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.287+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 >> 172.21.15.6:0/3233035945 conn(0x7f87c40fc320 msgr2=0x7f87c40fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.288+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 shutdown_connections 2023-09-13T09:56:44.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.288+0000 7f87c995b700 1 -- 172.21.15.6:0/3233035945 wait complete. 2023-09-13T09:56:44.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:56:44.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:44 smithi006 ceph-mon[98665]: pgmap v816: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 833 op/s 2023-09-13T09:56:44.350 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:44 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/607686991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:56:44.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 -- 172.21.15.6:0/664737668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9328100e80 msgr2=0x7f93281012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 --2- 172.21.15.6:0/664737668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9328100e80 0x7f93281012e0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f931c0099c0 tx=0x7f931c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 -- 172.21.15.6:0/664737668 shutdown_connections 2023-09-13T09:56:44.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 --2- 172.21.15.6:0/664737668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9328101820 0x7f93281080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 --2- 172.21.15.6:0/664737668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93280ffc90 0x7f93281000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 --2- 172.21.15.6:0/664737668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9328100e80 0x7f93281012e0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 -- 172.21.15.6:0/664737668 >> 172.21.15.6:0/664737668 conn(0x7f93280fb220 msgr2=0x7f93280fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 -- 172.21.15.6:0/664737668 shutdown_connections 2023-09-13T09:56:44.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.494+0000 7f932c82b700 1 -- 172.21.15.6:0/664737668 wait complete. 2023-09-13T09:56:44.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 Processor -- start 2023-09-13T09:56:44.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 -- start start 2023-09-13T09:56:44.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93280ffc90 0x7f93281959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9328100e80 0x7f9328195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9328101820 0x7f932819cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932819d520 con 0x7f9328101820 2023-09-13T09:56:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932819d660 con 0x7f9328100e80 2023-09-13T09:56:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932c82b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932819d7f0 con 0x7f93280ffc90 2023-09-13T09:56:44.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93280ffc90 0x7f93281959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93280ffc90 0x7f93281959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47684/0 (socket says 172.21.15.6:47684) 2023-09-13T09:56:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.495+0000 7f932659c700 1 -- 172.21.15.6:0/2680621824 learned_addr learned my addr 172.21.15.6:0/2680621824 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f9325d9b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9328100e80 0x7f9328195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932659c700 1 -- 172.21.15.6:0/2680621824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9328100e80 msgr2=0x7f9328195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932659c700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9328100e80 0x7f9328195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932659c700 1 -- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9328101820 msgr2=0x7f932819cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932659c700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9328101820 0x7f932819cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932659c700 1 -- 172.21.15.6:0/2680621824 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0095f0 con 0x7f93280ffc90 2023-09-13T09:56:44.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932659c700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93280ffc90 0x7f93281959a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f931800ea80 tx=0x7f931800ed90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f93177fe700 1 -- 172.21.15.6:0/2680621824 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318013070 con 0x7f93280ffc90 2023-09-13T09:56:44.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93280691c0 con 0x7f93280ffc90 2023-09-13T09:56:44.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9328069720 con 0x7f93280ffc90 2023-09-13T09:56:44.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f93177fe700 1 -- 172.21.15.6:0/2680621824 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f931800be80 con 0x7f93280ffc90 2023-09-13T09:56:44.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.496+0000 7f93177fe700 1 -- 172.21.15.6:0/2680621824 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318003aa0 con 0x7f93280ffc90 2023-09-13T09:56:44.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.499+0000 7f93177fe700 1 -- 172.21.15.6:0/2680621824 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9318003c00 con 0x7f93280ffc90 2023-09-13T09:56:44.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.500+0000 7f93177fe700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93100a4ad0 0x7f93100a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.500+0000 7f93177fe700 1 -- 172.21.15.6:0/2680621824 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f93180cafd0 con 0x7f93280ffc90 2023-09-13T09:56:44.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.501+0000 7f9325d9b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93100a4ad0 0x7f93100a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.501+0000 7f9338a10b80 1 Processor -- start 2023-09-13T09:56:44.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.501+0000 7f9338a10b80 1 -- start start 2023-09-13T09:56:44.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.501+0000 7f9325d9b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93100a4ad0 0x7f93100a6f90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f931c00b580 tx=0x7f931c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791df10 0x55af3791e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af3791ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791d210 0x55af3791d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9338a10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3786d780 con 0x55af3791df10 2023-09-13T09:56:44.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9338a10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3786b0a0 con 0x55af3791e870 2023-09-13T09:56:44.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9338a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af37866990 con 0x55af3791d210 2023-09-13T09:56:44.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791df10 0x55af3791e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791df10 0x55af3791e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44638/0 (socket says 172.21.15.6:44638) 2023-09-13T09:56:44.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 -- 172.21.15.6:0/1532022107 learned_addr learned my addr 172.21.15.6:0/1532022107 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9326d9d700 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791d210 0x55af3791d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f9325d9b700 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af3791ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 -- 172.21.15.6:0/1532022107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791d210 msgr2=0x55af3791d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791d210 0x55af3791d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 -- 172.21.15.6:0/1532022107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 msgr2=0x55af3791ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af3791ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 -- 172.21.15.6:0/1532022107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af376e6630 con 0x55af3791df10 2023-09-13T09:56:44.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.502+0000 7f932659c700 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791df10 0x55af3791e330 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9318094c70 tx=0x7f9318098380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c15f8d8dcb11aa3e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.503+0000 7f9314ff9700 1 -- 172.21.15.6:0/1532022107 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318098ed0 con 0x55af3791df10 2023-09-13T09:56:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.503+0000 7f9314ff9700 1 -- 172.21.15.6:0/1532022107 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9318098770 con 0x55af3791df10 2023-09-13T09:56:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.503+0000 7f9314ff9700 1 -- 172.21.15.6:0/1532022107 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931801e310 con 0x55af3791df10 2023-09-13T09:56:44.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:44 smithi053 ceph-mon[102373]: pgmap v816: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 833 op/s 2023-09-13T09:56:44.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:44 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/607686991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:56:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 -- 172.21.15.6:0/1532022107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791df10 msgr2=0x55af3791e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791df10 0x55af3791e330 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9318094c70 tx=0x7f9318098380 comp rx=0 tx=0).stop 2023-09-13T09:56:44.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 -- 172.21.15.6:0/1532022107 shutdown_connections 2023-09-13T09:56:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791d210 0x55af3791d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791df10 0x55af3791e330 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1532022107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af3791ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 -- 172.21.15.6:0/1532022107 >> 172.21.15.6:0/1532022107 conn(0x55af37872c80 msgr2=0x55af3790ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 -- 172.21.15.6:0/1532022107 shutdown_connections 2023-09-13T09:56:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.504+0000 7f9338a10b80 1 -- 172.21.15.6:0/1532022107 wait complete. 2023-09-13T09:56:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 -- start start 2023-09-13T09:56:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 Processor -- start 2023-09-13T09:56:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af379161e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af37916720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3791b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af37804bb0 con 0x55af3791e870 2023-09-13T09:56:44.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af378048b0 con 0x55af3791d210 2023-09-13T09:56:44.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af376e8920 con 0x55af3791df10 2023-09-13T09:56:44.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9338a10b80 10 client.0 _ll_register_callbacks cb 0x55af37802680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f932659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af379161e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f932659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af379161e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38168/0 (socket says 172.21.15.6:38168) 2023-09-13T09:56:44.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f932659c700 1 -- 172.21.15.6:0/2702475095 learned_addr learned my addr 172.21.15.6:0/2702475095 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9326d9d700 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3791b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f9325d9b700 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af37916720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f932659c700 1 -- 172.21.15.6:0/2702475095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 msgr2=0x55af37916720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.505+0000 7f932659c700 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af37916720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f932659c700 1 -- 172.21.15.6:0/2702475095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 msgr2=0x55af3791b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f932659c700 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3791b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f932659c700 1 -- 172.21.15.6:0/2702475095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9328069720 con 0x55af3791d210 2023-09-13T09:56:44.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f932659c700 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af379161e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f93180c8ad0 tx=0x7f93180092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2fb9d647e49b7ed server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f930dffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f930dffb700 1 -- 172.21.15.6:0/2702475095 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180ae030 con 0x55af3791d210 2023-09-13T09:56:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af37907670 con 0x55af3791d210 2023-09-13T09:56:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f930dffb700 1 -- 172.21.15.6:0/2702475095 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f93180af070 con 0x55af3791d210 2023-09-13T09:56:44.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f930dffb700 1 -- 172.21.15.6:0/2702475095 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9318098ed0 con 0x55af3791d210 2023-09-13T09:56:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f9338a10b80 10 client.29285 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55af3787e7a0 con 0x55af3791d210 2023-09-13T09:56:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.506+0000 7f930dffb700 1 -- 172.21.15.6:0/2702475095 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55af37907670 con 0x55af3791d210 2023-09-13T09:56:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f930dffb700 1 -- 172.21.15.6:0/2702475095 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9318097c60 con 0x55af3791d210 2023-09-13T09:56:44.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9338a10b80 10 client.29285 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9338a10b80 10 client.29285 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:56:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9338a10b80 20 client.29285 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9338a10b80 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af3793ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9338a10b80 4 client.29285 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:44.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af3785f970 con 0x55af3793aab0 2023-09-13T09:56:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9325d9b700 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af3793ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.507+0000 7f9325d9b700 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af3793ced0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9231104fdd8a08a0 server_cookie=d48658ef2e5bae38 in_seq=0 out_seq=0 2023-09-13T09:56:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.508+0000 7f930dffb700 10 client.29285 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f930dffb700 1 -- 172.21.15.6:0/2702475095 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55af3785f970 con 0x55af3793aab0 2023-09-13T09:56:44.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f930dffb700 10 client.29285 handle_command_reply: tid=0 2023-09-13T09:56:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 client.29285 shutdown 2023-09-13T09:56:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 msgr2=0x55af379161e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af379161e0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f93180c8ad0 tx=0x7f93180092d0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 shutdown_connections 2023-09-13T09:56:44.523 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af3793ced0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3791b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f930dffb700 0 client.29285 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af379161e0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 --2- 172.21.15.6:0/2702475095 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af37916720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.524 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 >> 172.21.15.6:0/2702475095 conn(0x55af37872c80 msgr2=0x55af379097f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 shutdown_connections 2023-09-13T09:56:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 1 -- 172.21.15.6:0/2702475095 wait complete. 2023-09-13T09:56:44.525 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.511+0000 7f9338a10b80 20 client.29285 trim_cache size 0 max 16384 2023-09-13T09:56:44.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:44 smithi131 ceph-mon[102785]: pgmap v816: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 833 op/s 2023-09-13T09:56:44.526 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:44 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/607686991' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:56:44.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.531+0000 7f9338a10b80 1 Processor -- start 2023-09-13T09:56:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.533+0000 7f9338a10b80 1 -- start start 2023-09-13T09:56:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.533+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791d210 0x55af3793cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.533+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af3794a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.533+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af37915f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.533+0000 7f9338a10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3791e6b0 con 0x55af3791d210 2023-09-13T09:56:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.533+0000 7f9338a10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3790b8e0 con 0x55af3791e870 2023-09-13T09:56:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.533+0000 7f9338a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3794abf0 con 0x55af3791df10 2023-09-13T09:56:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f9326d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af37915f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f9326d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af37915f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38178/0 (socket says 172.21.15.6:38178) 2023-09-13T09:56:44.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f9326d9d700 1 -- 172.21.15.6:0/1175636054 learned_addr learned my addr 172.21.15.6:0/1175636054 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f9325d9b700 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af3794a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f932659c700 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791d210 0x55af3793cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f932659c700 1 -- 172.21.15.6:0/1175636054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 msgr2=0x55af3794a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f932659c700 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af3794a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f932659c700 1 -- 172.21.15.6:0/1175636054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 msgr2=0x55af37915f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f932659c700 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af37915f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f932659c700 1 -- 172.21.15.6:0/1175636054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af37692de0 con 0x55af3791d210 2023-09-13T09:56:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f9325d9b700 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af3794a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f9326d9d700 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af37915f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.534+0000 7f932659c700 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791d210 0x55af3793cea0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f93180951e0 tx=0x7f9318094440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164f4c5a86feba32 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.535+0000 7f93157fa700 1 -- 172.21.15.6:0/1175636054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180ae020 con 0x55af3791d210 2023-09-13T09:56:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.535+0000 7f93157fa700 1 -- 172.21.15.6:0/1175636054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9318098ed0 con 0x55af3791d210 2023-09-13T09:56:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.535+0000 7f93157fa700 1 -- 172.21.15.6:0/1175636054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9318097c60 con 0x55af3791d210 2023-09-13T09:56:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.535+0000 7f9338a10b80 1 -- 172.21.15.6:0/1175636054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791d210 msgr2=0x55af3793cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.535+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791d210 0x55af3793cea0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f93180951e0 tx=0x7f9318094440 comp rx=0 tx=0).stop 2023-09-13T09:56:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 -- 172.21.15.6:0/1175636054 shutdown_connections 2023-09-13T09:56:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791e870 0x55af37915f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791d210 0x55af3793cea0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1175636054 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af3794a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 -- 172.21.15.6:0/1175636054 >> 172.21.15.6:0/1175636054 conn(0x55af37872c80 msgr2=0x55af3790ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 -- 172.21.15.6:0/1175636054 shutdown_connections 2023-09-13T09:56:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 -- 172.21.15.6:0/1175636054 wait complete. 2023-09-13T09:56:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.537+0000 7f9338a10b80 1 -- start start 2023-09-13T09:56:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 1 Processor -- start 2023-09-13T09:56:44.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af37949580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af37949ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3798d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3794a1d0 con 0x55af3791e870 2023-09-13T09:56:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3798d540 con 0x55af3791d210 2023-09-13T09:56:44.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af3798d700 con 0x55af3791df10 2023-09-13T09:56:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9338a10b80 10 client.0 _ll_register_callbacks cb 0x55af37802680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f932659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af37949580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f932659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af37949580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38182/0 (socket says 172.21.15.6:38182) 2023-09-13T09:56:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f932659c700 1 -- 172.21.15.6:0/1412303966 learned_addr learned my addr 172.21.15.6:0/1412303966 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.538+0000 7f9326d9d700 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3798d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.539+0000 7f932659c700 1 -- 172.21.15.6:0/1412303966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 msgr2=0x55af37949ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:56:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.539+0000 7f932659c700 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af37949ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.539+0000 7f932659c700 1 -- 172.21.15.6:0/1412303966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 msgr2=0x55af3798d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.539+0000 7f932659c700 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3798d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.539+0000 7f932659c700 1 -- 172.21.15.6:0/1412303966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9328108a20 con 0x55af3791d210 2023-09-13T09:56:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.539+0000 7f9326d9d700 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3798d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.540+0000 7f932659c700 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af37949580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f93180045c0 tx=0x7f93180044a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dae9282c96f8150c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.540+0000 7f930dffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.540+0000 7f930dffb700 1 -- 172.21.15.6:0/1412303966 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93180ae070 con 0x55af3791d210 2023-09-13T09:56:44.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.540+0000 7f930dffb700 1 -- 172.21.15.6:0/1412303966 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f931801e510 con 0x55af3791d210 2023-09-13T09:56:44.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.540+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af37820050 con 0x55af3791d210 2023-09-13T09:56:44.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.541+0000 7f930dffb700 1 -- 172.21.15.6:0/1412303966 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9318098ed0 con 0x55af3791d210 2023-09-13T09:56:44.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.541+0000 7f9338a10b80 10 client.29291 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.541+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x7f93200143a0 con 0x55af3791d210 2023-09-13T09:56:44.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f930dffb700 1 -- 172.21.15.6:0/1412303966 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55af37820050 con 0x55af3791d210 2023-09-13T09:56:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f930dffb700 1 -- 172.21.15.6:0/1412303966 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9318094660 con 0x55af3791d210 2023-09-13T09:56:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f9338a10b80 10 client.29291 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f9338a10b80 10 client.29291 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:56:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f9338a10b80 20 client.29291 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af37990e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f9338a10b80 4 client.29291 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.542+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55af376b3f70 con 0x55af3793aab0 2023-09-13T09:56:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.543+0000 7f9325d9b700 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af37990e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.543+0000 7f930dffb700 10 client.29291 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:44.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.543+0000 7f9325d9b700 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af37990e70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e2336bf4331ecab1 server_cookie=1102e7086710750f in_seq=0 out_seq=0 2023-09-13T09:56:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f930dffb700 1 -- 172.21.15.6:0/1412303966 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55af376b3f70 con 0x55af3793aab0 2023-09-13T09:56:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f930dffb700 10 client.29291 handle_command_reply: tid=0 2023-09-13T09:56:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 client.29291 shutdown 2023-09-13T09:56:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 msgr2=0x55af37949580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af37949580 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f93180045c0 tx=0x7f93180044a0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 shutdown_connections 2023-09-13T09:56:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55af3793aab0 0x55af37990e70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55af3791e870 0x55af3798d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55af3791d210 0x55af37949580 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f930dffb700 0 client.29291 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:56:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 --2- 172.21.15.6:0/1412303966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55af3791df10 0x55af37949ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 >> 172.21.15.6:0/1412303966 conn(0x55af37872c80 msgr2=0x55af37915f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 shutdown_connections 2023-09-13T09:56:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.547+0000 7f9338a10b80 1 -- 172.21.15.6:0/1412303966 wait complete. 2023-09-13T09:56:44.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.548+0000 7f9338a10b80 20 client.29291 trim_cache size 0 max 16384 2023-09-13T09:56:44.556 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.550+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93100a4ad0 msgr2=0x7f93100a6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.550+0000 7f932c82b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93100a4ad0 0x7f93100a6f90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f931c00b580 tx=0x7f931c005fb0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.550+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93280ffc90 msgr2=0x7f93281959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.550+0000 7f932c82b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93280ffc90 0x7f93281959a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f931800ea80 tx=0x7f931800ed90 comp rx=0 tx=0).stop 2023-09-13T09:56:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 shutdown_connections 2023-09-13T09:56:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93100a4ad0 0x7f93100a6f90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9328101820 0x7f932819cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93280ffc90 0x7f93281959a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 --2- 172.21.15.6:0/2680621824 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9328100e80 0x7f9328195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 >> 172.21.15.6:0/2680621824 conn(0x7f93280fb220 msgr2=0x7f93280fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 shutdown_connections 2023-09-13T09:56:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.551+0000 7f932c82b700 1 -- 172.21.15.6:0/2680621824 wait complete. 2023-09-13T09:56:44.569 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:56:44.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 174256 38.08 MB/sec execute 124 sec latency 315.098 ms 2023-09-13T09:56:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.752+0000 7f093918d700 1 -- 172.21.15.6:0/2156164363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 msgr2=0x7f0934101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.752+0000 7f093918d700 1 --2- 172.21.15.6:0/2156164363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 0x7f0934101310 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7f09240099c0 tx=0x7f0924009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.753+0000 7f093918d700 1 -- 172.21.15.6:0/2156164363 shutdown_connections 2023-09-13T09:56:44.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.753+0000 7f093918d700 1 --2- 172.21.15.6:0/2156164363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 0x7f0934108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.753+0000 7f093918d700 1 --2- 172.21.15.6:0/2156164363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340ffcc0 0x7f09341000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.753+0000 7f093918d700 1 --2- 172.21.15.6:0/2156164363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 0x7f0934101310 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.753+0000 7f093918d700 1 -- 172.21.15.6:0/2156164363 >> 172.21.15.6:0/2156164363 conn(0x7f09340fb250 msgr2=0x7f09340fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.753+0000 7f093918d700 1 -- 172.21.15.6:0/2156164363 shutdown_connections 2023-09-13T09:56:44.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.753+0000 7f093918d700 1 -- 172.21.15.6:0/2156164363 wait complete. 2023-09-13T09:56:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 Processor -- start 2023-09-13T09:56:44.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 -- start start 2023-09-13T09:56:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340ffcc0 0x7f0934068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 0x7f093419b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 0x7f093419de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093419e5b0 con 0x7f0934100eb0 2023-09-13T09:56:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093419e720 con 0x7f09340ffcc0 2023-09-13T09:56:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093918d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093419e8e0 con 0x7f0934101850 2023-09-13T09:56:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f0932d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340ffcc0 0x7f0934068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 0x7f093419de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093359e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 0x7f093419de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47724/0 (socket says 172.21.15.6:47724) 2023-09-13T09:56:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.754+0000 7f093359e700 1 -- 172.21.15.6:0/3648258900 learned_addr learned my addr 172.21.15.6:0/3648258900 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093259c700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 0x7f093419b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093359e700 1 -- 172.21.15.6:0/3648258900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340ffcc0 msgr2=0x7f0934068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093359e700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340ffcc0 0x7f0934068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093359e700 1 -- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 msgr2=0x7f093419b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093359e700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 0x7f093419b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093359e700 1 -- 172.21.15.6:0/3648258900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240095f0 con 0x7f0934101850 2023-09-13T09:56:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093359e700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 0x7f093419de10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f092c00ef30 tx=0x7f092c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f091bfff700 1 -- 172.21.15.6:0/3648258900 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c018070 con 0x7f0934101850 2023-09-13T09:56:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093419eb60 con 0x7f0934101850 2023-09-13T09:56:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.755+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093419f0c0 con 0x7f0934101850 2023-09-13T09:56:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.756+0000 7f091bfff700 1 -- 172.21.15.6:0/3648258900 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f092c00f040 con 0x7f0934101850 2023-09-13T09:56:44.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.756+0000 7f091bfff700 1 -- 172.21.15.6:0/3648258900 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092c00cbe0 con 0x7f0934101850 2023-09-13T09:56:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.760+0000 7f0945372b80 1 Processor -- start 2023-09-13T09:56:44.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f091bfff700 1 -- 172.21.15.6:0/3648258900 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f092c004ad0 con 0x7f0934101850 2023-09-13T09:56:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0945372b80 1 -- start start 2023-09-13T09:56:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0945372b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0dab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0945372b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0db060 0x56063e0d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0945372b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0d9a00 0x56063e0d9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0945372b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e032780 con 0x56063e0d9a00 2023-09-13T09:56:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0945372b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e0300a0 con 0x56063e0db060 2023-09-13T09:56:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0945372b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e02b990 con 0x56063e0da700 2023-09-13T09:56:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0932d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0db060 0x56063e0d94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0932d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0db060 0x56063e0d94c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38202/0 (socket says 172.21.15.6:38202) 2023-09-13T09:56:44.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f0932d9d700 1 -- 172.21.15.6:0/4183287770 learned_addr learned my addr 172.21.15.6:0/4183287770 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f093259c700 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0d9a00 0x56063e0d9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f093259c700 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0dab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.761+0000 7f091bfff700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f091c0a0690 0x7f091c0a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f093359e700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f091c0a0690 0x7f091c0a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f0932d9d700 1 -- 172.21.15.6:0/4183287770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 msgr2=0x56063e0dab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f0932d9d700 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0dab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f0932d9d700 1 -- 172.21.15.6:0/4183287770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0d9a00 msgr2=0x56063e0d9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f0932d9d700 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0d9a00 0x56063e0d9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f0932d9d700 1 -- 172.21.15.6:0/4183287770 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56063deab630 con 0x56063e0db060 2023-09-13T09:56:44.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f091bfff700 1 -- 172.21.15.6:0/3648258900 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f092c0cb5e0 con 0x7f0934101850 2023-09-13T09:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f0932d9d700 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0db060 0x56063e0d94c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0928009d30 tx=0x7f0928011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=297a8043ad0c4bdb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f09197fa700 1 -- 172.21.15.6:0/4183287770 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928004220 con 0x56063e0db060 2023-09-13T09:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f093359e700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f091c0a0690 0x7f091c0a2b50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f092c098b10 tx=0x7f092c08e7f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f09197fa700 1 -- 172.21.15.6:0/4183287770 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0928004380 con 0x56063e0db060 2023-09-13T09:56:44.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.762+0000 7f09197fa700 1 -- 172.21.15.6:0/4183287770 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0928019810 con 0x56063e0db060 2023-09-13T09:56:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.763+0000 7f0945372b80 1 -- 172.21.15.6:0/4183287770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0db060 msgr2=0x56063e0d94c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.763+0000 7f0945372b80 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0db060 0x56063e0d94c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f0928009d30 tx=0x7f0928011720 comp rx=0 tx=0).stop 2023-09-13T09:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.764+0000 7f0945372b80 1 -- 172.21.15.6:0/4183287770 shutdown_connections 2023-09-13T09:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.764+0000 7f0945372b80 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0d9a00 0x56063e0d9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.764+0000 7f0945372b80 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0dab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.764+0000 7f0945372b80 1 --2- 172.21.15.6:0/4183287770 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0db060 0x56063e0d94c0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.764+0000 7f0945372b80 1 -- 172.21.15.6:0/4183287770 >> 172.21.15.6:0/4183287770 conn(0x56063e037c80 msgr2=0x56063e0d3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.766+0000 7f0945372b80 1 -- 172.21.15.6:0/4183287770 shutdown_connections 2023-09-13T09:56:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.766+0000 7f0945372b80 1 -- 172.21.15.6:0/4183287770 wait complete. 2023-09-13T09:56:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 -- start start 2023-09-13T09:56:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 Processor -- start 2023-09-13T09:56:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0e50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0da700 0x56063e0e5610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0db060 0x56063e0e1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063dfc9bb0 con 0x56063e0da700 2023-09-13T09:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063dfc98b0 con 0x56063e0d9a00 2023-09-13T09:56:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063dead920 con 0x56063e0db060 2023-09-13T09:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f0945372b80 10 client.0 _ll_register_callbacks cb 0x56063dfc7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f093259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0e50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f093259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0e50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38208/0 (socket says 172.21.15.6:38208) 2023-09-13T09:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.767+0000 7f093259c700 1 -- 172.21.15.6:0/419492853 learned_addr learned my addr 172.21.15.6:0/419492853 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f093259c700 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0db060 0x56063e0e1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f0932d9d700 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0da700 0x56063e0e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f093259c700 1 -- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0db060 msgr2=0x56063e0e1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f093259c700 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0db060 0x56063e0e1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f093259c700 1 -- 172.21.15.6:0/419492853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0da700 msgr2=0x56063e0e5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f093259c700 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0da700 0x56063e0e5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f093259c700 1 -- 172.21.15.6:0/419492853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0928009960 con 0x56063e0d9a00 2023-09-13T09:56:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f093259c700 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0e50d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09240099c0 tx=0x7f0924009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=27b0c1b7ec39d333 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f0916ff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.768+0000 7f0916ff5700 1 -- 172.21.15.6:0/419492853 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400f730 con 0x56063e0d9a00 2023-09-13T09:56:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56063e0cc670 con 0x56063e0d9a00 2023-09-13T09:56:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0916ff5700 1 -- 172.21.15.6:0/419492853 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f092400f890 con 0x56063e0d9a00 2023-09-13T09:56:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0916ff5700 1 -- 172.21.15.6:0/419492853 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f092400fa50 con 0x56063e0d9a00 2023-09-13T09:56:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 10 client.29303 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x56063e0437a0 con 0x56063e0d9a00 2023-09-13T09:56:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0916ff5700 1 -- 172.21.15.6:0/419492853 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56063e0cc670 con 0x56063e0d9a00 2023-09-13T09:56:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0916ff5700 1 -- 172.21.15.6:0/419492853 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f092402ace0 con 0x56063e0d9a00 2023-09-13T09:56:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 10 client.29303 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 10 client.29303 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:56:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 20 client.29303 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e0ead50 0x56063e0ed170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 4 client.29303 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.769+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56063e024970 con 0x56063e0ead50 2023-09-13T09:56:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.770+0000 7f0932d9d700 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e0ead50 0x56063e0ed170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.770+0000 7f0916ff5700 10 client.29303 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.770+0000 7f0932d9d700 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e0ead50 0x56063e0ed170 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=527cb30927aab6cf server_cookie=3006b4a5d061de8c in_seq=0 out_seq=0 2023-09-13T09:56:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0916ff5700 1 -- 172.21.15.6:0/419492853 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56063e024970 con 0x56063e0ead50 2023-09-13T09:56:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0916ff5700 10 client.29303 handle_command_reply: tid=0 2023-09-13T09:56:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 client.29303 shutdown 2023-09-13T09:56:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 msgr2=0x56063e0e50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0e50d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f09240099c0 tx=0x7f0924009cd0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 shutdown_connections 2023-09-13T09:56:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e0ead50 0x56063e0ed170 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0db060 0x56063e0e1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0916ff5700 0 client.29303 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:44.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0e50d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 --2- 172.21.15.6:0/419492853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0da700 0x56063e0e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 >> 172.21.15.6:0/419492853 conn(0x56063e037c80 msgr2=0x56063e0ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 shutdown_connections 2023-09-13T09:56:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 1 -- 172.21.15.6:0/419492853 wait complete. 2023-09-13T09:56:44.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.772+0000 7f0945372b80 20 client.29303 trim_cache size 0 max 16384 2023-09-13T09:56:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 Processor -- start 2023-09-13T09:56:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 -- start start 2023-09-13T09:56:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0d9a00 0x56063e0d94c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0da700 0x56063e0d3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0dd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e0d4bd0 con 0x56063e0db060 2023-09-13T09:56:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e0e1630 con 0x56063e0da700 2023-09-13T09:56:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f0945372b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e0d43a0 con 0x56063e0d9a00 2023-09-13T09:56:44.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f093259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0dd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f093259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0dd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44694/0 (socket says 172.21.15.6:44694) 2023-09-13T09:56:44.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f093259c700 1 -- 172.21.15.6:0/1655933667 learned_addr learned my addr 172.21.15.6:0/1655933667 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f093259c700 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0d9a00 0x56063e0d94c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f093259c700 1 -- 172.21.15.6:0/1655933667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0d9a00 msgr2=0x56063e0d94c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f093259c700 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0d9a00 0x56063e0d94c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.792+0000 7f093259c700 1 -- 172.21.15.6:0/1655933667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0da700 msgr2=0x56063e0d3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.793+0000 7f093259c700 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0da700 0x56063e0d3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.793+0000 7f093259c700 1 -- 172.21.15.6:0/1655933667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56063de57de0 con 0x56063e0db060 2023-09-13T09:56:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.793+0000 7f093259c700 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0dd8e0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0924029790 tx=0x7f0924009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba64d4c57a095df9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.793+0000 7f0919ffb700 1 -- 172.21.15.6:0/1655933667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924027b30 con 0x56063e0db060 2023-09-13T09:56:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.793+0000 7f0919ffb700 1 -- 172.21.15.6:0/1655933667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f092401e040 con 0x56063e0db060 2023-09-13T09:56:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.793+0000 7f0919ffb700 1 -- 172.21.15.6:0/1655933667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924029c90 con 0x56063e0db060 2023-09-13T09:56:44.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.794+0000 7f0945372b80 1 -- 172.21.15.6:0/1655933667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 msgr2=0x56063e0dd8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.794+0000 7f0945372b80 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0dd8e0 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f0924029790 tx=0x7f0924009310 comp rx=0 tx=0).stop 2023-09-13T09:56:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 -- 172.21.15.6:0/1655933667 shutdown_connections 2023-09-13T09:56:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0dd8e0 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0d9a00 0x56063e0d94c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 --2- 172.21.15.6:0/1655933667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0da700 0x56063e0d3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 -- 172.21.15.6:0/1655933667 >> 172.21.15.6:0/1655933667 conn(0x56063e037c80 msgr2=0x56063e0e6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 -- 172.21.15.6:0/1655933667 shutdown_connections 2023-09-13T09:56:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 -- 172.21.15.6:0/1655933667 wait complete. 2023-09-13T09:56:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.795+0000 7f0945372b80 1 -- start start 2023-09-13T09:56:44.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 1 Processor -- start 2023-09-13T09:56:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0ef100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0ef640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0f2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e0f2ba0 con 0x56063e0db060 2023-09-13T09:56:44.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e0f2d10 con 0x56063e0d9a00 2023-09-13T09:56:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56063e0f2ed0 con 0x56063e0da700 2023-09-13T09:56:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0945372b80 10 client.0 _ll_register_callbacks cb 0x56063dfc7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f093259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0ef100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f093259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0ef100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38222/0 (socket says 172.21.15.6:38222) 2023-09-13T09:56:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f093259c700 1 -- 172.21.15.6:0/3646213792 learned_addr learned my addr 172.21.15.6:0/3646213792 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:44.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f093259c700 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0f2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.796+0000 7f0932d9d700 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0ef640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0932d9d700 1 -- 172.21.15.6:0/3646213792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 msgr2=0x56063e0ef100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0932d9d700 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0ef100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0932d9d700 1 -- 172.21.15.6:0/3646213792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 msgr2=0x56063e0f2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0932d9d700 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0f2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0932d9d700 1 -- 172.21.15.6:0/3646213792 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56063e0437a0 con 0x56063e0da700 2023-09-13T09:56:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0932d9d700 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0ef640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0928011a70 tx=0x7f09280092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a34f0932a6b6edc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0916ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:56:44.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0916ff5700 1 -- 172.21.15.6:0/3646213792 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092802a500 con 0x56063e0da700 2023-09-13T09:56:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0916ff5700 1 -- 172.21.15.6:0/3646213792 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f092802f030 con 0x56063e0da700 2023-09-13T09:56:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0928004380 con 0x56063e0da700 2023-09-13T09:56:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0916ff5700 1 -- 172.21.15.6:0/3646213792 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0928003e20 con 0x56063e0da700 2023-09-13T09:56:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0945372b80 10 client.29245 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:44.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.797+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x56063de40c60 con 0x56063e0da700 2023-09-13T09:56:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0916ff5700 1 -- 172.21.15.6:0/3646213792 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0928004380 con 0x56063e0da700 2023-09-13T09:56:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0916ff5700 1 -- 172.21.15.6:0/3646213792 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f0928011440 con 0x56063e0da700 2023-09-13T09:56:44.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0945372b80 10 client.29245 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0945372b80 10 client.29245 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:56:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0945372b80 20 client.29245 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0945372b80 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e154980 0x56063e156da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0945372b80 4 client.29245 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:44.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56063dfe5050 con 0x56063e154980 2023-09-13T09:56:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.798+0000 7f093259c700 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e154980 0x56063e156da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f093259c700 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e154980 0x56063e156da0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=36570e71c18f3dfe server_cookie=7818552eaaa17005 in_seq=0 out_seq=0 2023-09-13T09:56:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0916ff5700 10 client.29245 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0916ff5700 1 -- 172.21.15.6:0/3646213792 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56063dfe5050 con 0x56063e154980 2023-09-13T09:56:44.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0916ff5700 10 client.29245 handle_command_reply: tid=0 2023-09-13T09:56:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 client.29245 shutdown 2023-09-13T09:56:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 msgr2=0x56063e0ef640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0ef640 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0928011a70 tx=0x7f09280092a0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 shutdown_connections 2023-09-13T09:56:44.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56063e154980 0x56063e156da0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56063e0db060 0x56063e0f2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0916ff5700 0 client.29245 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:56:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56063e0d9a00 0x56063e0ef100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 --2- 172.21.15.6:0/3646213792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56063e0da700 0x56063e0ef640 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 >> 172.21.15.6:0/3646213792 conn(0x56063e037c80 msgr2=0x56063e0dd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 shutdown_connections 2023-09-13T09:56:44.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 1 -- 172.21.15.6:0/3646213792 wait complete. 2023-09-13T09:56:44.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.800+0000 7f0945372b80 20 client.29245 trim_cache size 0 max 16384 2023-09-13T09:56:44.813 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f091c0a0690 msgr2=0x7f091c0a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f091c0a0690 0x7f091c0a2b50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f092c098b10 tx=0x7f092c08e7f0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 msgr2=0x7f093419de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 0x7f093419de10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f092c00ef30 tx=0x7f092c00c3a0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 shutdown_connections 2023-09-13T09:56:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0934101850 0x7f093419de10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f09340ffcc0 0x7f0934068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f091c0a0690 0x7f091c0a2b50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 --2- 172.21.15.6:0/3648258900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0934100eb0 0x7f093419b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 >> 172.21.15.6:0/3648258900 conn(0x7f09340fb250 msgr2=0x7f09340fd450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 shutdown_connections 2023-09-13T09:56:44.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:44.801+0000 7f093918d700 1 -- 172.21.15.6:0/3648258900 wait complete. 2023-09-13T09:56:44.824 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:56:45.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.016+0000 7f7f29943700 1 -- 172.21.15.6:0/1804179926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 msgr2=0x7f7f2410a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.016+0000 7f7f29943700 1 --2- 172.21.15.6:0/1804179926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f2410a0e0 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f7f14009990 tx=0x7f7f14009ca0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.017+0000 7f7f29943700 1 -- 172.21.15.6:0/1804179926 shutdown_connections 2023-09-13T09:56:45.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.017+0000 7f7f29943700 1 --2- 172.21.15.6:0/1804179926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f2410d040 0x7f7f2410d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.017+0000 7f7f29943700 1 --2- 172.21.15.6:0/1804179926 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f2410a0e0 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.017+0000 7f7f29943700 1 --2- 172.21.15.6:0/1804179926 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2410a620 0x7f7f2410cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.017+0000 7f7f29943700 1 -- 172.21.15.6:0/1804179926 >> 172.21.15.6:0/1804179926 conn(0x7f7f2406e500 msgr2=0x7f7f24070940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:45.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.017+0000 7f7f29943700 1 -- 172.21.15.6:0/1804179926 shutdown_connections 2023-09-13T09:56:45.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.018+0000 7f7f29943700 1 -- 172.21.15.6:0/1804179926 wait complete. 2023-09-13T09:56:45.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 Processor -- start 2023-09-13T09:56:45.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 -- start start 2023-09-13T09:56:45.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f24114220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2410a620 0x7f7f24114760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f2410d040 0x7f7f241b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f24117840 con 0x7f7f24107cb0 2023-09-13T09:56:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f241179b0 con 0x7f7f2410a620 2023-09-13T09:56:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.019+0000 7f7f29943700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f241b5ff0 con 0x7f7f2410d040 2023-09-13T09:56:45.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f227fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2410a620 0x7f7f24114760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f24114220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f24114220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44712/0 (socket says 172.21.15.6:44712) 2023-09-13T09:56:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 -- 172.21.15.6:0/2134177741 learned_addr learned my addr 172.21.15.6:0/2134177741 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f237fe700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f2410d040 0x7f7f241b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 -- 172.21.15.6:0/2134177741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f2410d040 msgr2=0x7f7f241b5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f2410d040 0x7f7f241b5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 -- 172.21.15.6:0/2134177741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2410a620 msgr2=0x7f7f24114760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2410a620 0x7f7f24114760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 -- 172.21.15.6:0/2134177741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f140095f0 con 0x7f7f24107cb0 2023-09-13T09:56:45.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f237fe700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f2410d040 0x7f7f241b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:56:45.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.020+0000 7f7f22ffd700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f24114220 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400b5c0 tx=0x7f7f14003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:45.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.021+0000 7f7f28941700 1 -- 172.21.15.6:0/2134177741 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1401d070 con 0x7f7f24107cb0 2023-09-13T09:56:45.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.021+0000 7f7f28941700 1 -- 172.21.15.6:0/2134177741 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f14005580 con 0x7f7f24107cb0 2023-09-13T09:56:45.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.021+0000 7f7f28941700 1 -- 172.21.15.6:0/2134177741 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1400fe40 con 0x7f7f24107cb0 2023-09-13T09:56:45.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.022+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f241b61f0 con 0x7f7f24107cb0 2023-09-13T09:56:45.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.022+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f241b6560 con 0x7f7f24107cb0 2023-09-13T09:56:45.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.029+0000 7f7f35b28b80 1 Processor -- start 2023-09-13T09:56:45.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f35b28b80 1 -- start start 2023-09-13T09:56:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d02700 0x559669d02b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 0x559669d014c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d01a00 0x559669d01e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669c5a780 con 0x559669d02700 2023-09-13T09:56:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669c580a0 con 0x559669d01a00 2023-09-13T09:56:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669c53990 con 0x559669d03060 2023-09-13T09:56:45.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.030+0000 7f7f237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d02700 0x559669d02b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d02700 0x559669d02b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44718/0 (socket says 172.21.15.6:44718) 2023-09-13T09:56:45.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 -- 172.21.15.6:0/4159082185 learned_addr learned my addr 172.21.15.6:0/4159082185 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:45.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 -- 172.21.15.6:0/4159082185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 msgr2=0x559669d014c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:56:45.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 --2- 172.21.15.6:0/4159082185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 0x559669d014c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 -- 172.21.15.6:0/4159082185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d01a00 msgr2=0x559669d01e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:56:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 --2- 172.21.15.6:0/4159082185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d01a00 0x559669d01e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 -- 172.21.15.6:0/4159082185 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559669ad3630 con 0x559669d02700 2023-09-13T09:56:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f237fe700 1 --2- 172.21.15.6:0/4159082185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d02700 0x559669d02b20 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009e60 tx=0x7f7f1c0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ddf575a6c6dc34 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:45.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.031+0000 7f7f28941700 1 -- 172.21.15.6:0/2134177741 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7f1400f460 con 0x7f7f24107cb0 2023-09-13T09:56:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.032+0000 7f7f09ffb700 1 -- 172.21.15.6:0/4159082185 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c014610 con 0x559669d02700 2023-09-13T09:56:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.032+0000 7f7f09ffb700 1 -- 172.21.15.6:0/4159082185 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f1c00f050 con 0x559669d02700 2023-09-13T09:56:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.032+0000 7f7f09ffb700 1 -- 172.21.15.6:0/4159082185 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c013ae0 con 0x559669d02700 2023-09-13T09:56:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.032+0000 7f7f28941700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f0c0a0810 0x7f7f0c0a2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.032+0000 7f7f28941700 1 -- 172.21.15.6:0/2134177741 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f140ccd70 con 0x7f7f24107cb0 2023-09-13T09:56:45.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f35b28b80 1 -- 172.21.15.6:0/4159082185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d02700 msgr2=0x559669d02b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/4159082185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d02700 0x559669d02b20 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c009e60 tx=0x7f7f1c0077e0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f35b28b80 1 -- 172.21.15.6:0/4159082185 shutdown_connections 2023-09-13T09:56:45.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/4159082185 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d01a00 0x559669d01e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/4159082185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d02700 0x559669d02b20 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/4159082185 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 0x559669d014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f35b28b80 1 -- 172.21.15.6:0/4159082185 >> 172.21.15.6:0/4159082185 conn(0x559669c5fc80 msgr2=0x559669cfbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:45.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.033+0000 7f7f22ffd700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f0c0a0810 0x7f7f0c0a2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.034+0000 7f7f22ffd700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f0c0a0810 0x7f7f0c0a2cd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7f14096fb0 tx=0x7f7f1400f8e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:45.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.038+0000 7f7f35b28b80 1 -- 172.21.15.6:0/4159082185 shutdown_connections 2023-09-13T09:56:45.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.038+0000 7f7f35b28b80 1 -- 172.21.15.6:0/4159082185 wait complete. 2023-09-13T09:56:45.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 -- start start 2023-09-13T09:56:45.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 Processor -- start 2023-09-13T09:56:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d01a00 0x559669d0af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d03060 0x559669d124f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669bf1bb0 con 0x559669d03060 2023-09-13T09:56:45.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669bf18b0 con 0x559669d02700 2023-09-13T09:56:45.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669ad5920 con 0x559669d01a00 2023-09-13T09:56:45.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.039+0000 7f7f35b28b80 10 client.0 _ll_register_callbacks cb 0x559669bef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:45.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38246/0 (socket says 172.21.15.6:38246) 2023-09-13T09:56:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 -- 172.21.15.6:0/2895543934 learned_addr learned my addr 172.21.15.6:0/2895543934 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 -- 172.21.15.6:0/2895543934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d01a00 msgr2=0x559669d0af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d01a00 0x559669d0af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 -- 172.21.15.6:0/2895543934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d03060 msgr2=0x559669d124f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:45.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d03060 0x559669d124f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 -- 172.21.15.6:0/2895543934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c009a90 con 0x559669d02700 2023-09-13T09:56:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f227fc700 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0b4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800f780 tx=0x7f7f1800fb40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=290a37521743a119 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.040+0000 7f7f02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.041+0000 7f7f02ffd700 1 -- 172.21.15.6:0/2895543934 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18004a30 con 0x559669d02700 2023-09-13T09:56:45.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.041+0000 7f7f02ffd700 1 -- 172.21.15.6:0/2895543934 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f18004b90 con 0x559669d02700 2023-09-13T09:56:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.041+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559669cf4670 con 0x559669d02700 2023-09-13T09:56:45.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.044+0000 7f7f02ffd700 1 -- 172.21.15.6:0/2895543934 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f18004d50 con 0x559669d02700 2023-09-13T09:56:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.044+0000 7f7f35b28b80 10 client.29312 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.044+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x559669c6b7a0 con 0x559669d02700 2023-09-13T09:56:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.045+0000 7f7f02ffd700 1 -- 172.21.15.6:0/2895543934 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559669cf4670 con 0x559669d02700 2023-09-13T09:56:45.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f02ffd700 1 -- 172.21.15.6:0/2895543934 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f18005450 con 0x559669d02700 2023-09-13T09:56:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f35b28b80 10 client.29312 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f35b28b80 10 client.29312 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f35b28b80 20 client.29312 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:45.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d16e40 0x559669d19260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f35b28b80 4 client.29312 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559669c4c970 con 0x559669d16e40 2023-09-13T09:56:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.046+0000 7f7f237fe700 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d16e40 0x559669d19260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.047+0000 7f7f02ffd700 10 client.29312 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:45.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.047+0000 7f7f237fe700 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d16e40 0x559669d19260 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d58a7005917f496 server_cookie=51e1890e145522b in_seq=0 out_seq=0 2023-09-13T09:56:45.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.053+0000 7f7f02ffd700 1 -- 172.21.15.6:0/2895543934 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559669c4c970 con 0x559669d16e40 2023-09-13T09:56:45.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.053+0000 7f7f02ffd700 10 client.29312 handle_command_reply: tid=0 2023-09-13T09:56:45.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.053+0000 7f7f35b28b80 1 client.29312 shutdown 2023-09-13T09:56:45.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.053+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 msgr2=0x559669d0b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.053+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0b4b0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7f1800f780 tx=0x7f7f1800fb40 comp rx=0 tx=0).stop 2023-09-13T09:56:45.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.054+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 shutdown_connections 2023-09-13T09:56:45.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.054+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d16e40 0x559669d19260 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.054+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d03060 0x559669d124f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.054+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d01a00 0x559669d0af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.054+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/2895543934 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0b4b0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.054+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 >> 172.21.15.6:0/2895543934 conn(0x559669c5fc80 msgr2=0x559669cf67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:45.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.054+0000 7f7f02ffd700 0 client.29312 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:45.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.055+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 shutdown_connections 2023-09-13T09:56:45.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.056+0000 7f7f35b28b80 1 -- 172.21.15.6:0/2895543934 wait complete. 2023-09-13T09:56:45.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.056+0000 7f7f35b28b80 20 client.29312 trim_cache size 0 max 16384 2023-09-13T09:56:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 Processor -- start 2023-09-13T09:56:45.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 -- start start 2023-09-13T09:56:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d014c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d02700 0x559669d12480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d03060 0x559669d08e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669d0a420 con 0x559669d01a00 2023-09-13T09:56:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669cf4650 con 0x559669d03060 2023-09-13T09:56:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669d0aae0 con 0x559669d02700 2023-09-13T09:56:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f227fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d02700 0x559669d12480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f227fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d02700 0x559669d12480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47786/0 (socket says 172.21.15.6:47786) 2023-09-13T09:56:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f227fc700 1 -- 172.21.15.6:0/193829451 learned_addr learned my addr 172.21.15.6:0/193829451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f237fe700 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.081+0000 7f7f237fe700 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d03060 0x559669d08e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f227fc700 1 -- 172.21.15.6:0/193829451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d03060 msgr2=0x559669d08e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f227fc700 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d03060 0x559669d08e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f227fc700 1 -- 172.21.15.6:0/193829451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 msgr2=0x559669d014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f227fc700 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f227fc700 1 -- 172.21.15.6:0/193829451 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559669a7fde0 con 0x559669d02700 2023-09-13T09:56:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f227fc700 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d02700 0x559669d12480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7f18010760 tx=0x7f7f18010790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac06558cf79e9f67 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f0a7fc700 1 -- 172.21.15.6:0/193829451 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18010bb0 con 0x559669d02700 2023-09-13T09:56:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f0a7fc700 1 -- 172.21.15.6:0/193829451 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f18010d10 con 0x559669d02700 2023-09-13T09:56:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.082+0000 7f7f0a7fc700 1 -- 172.21.15.6:0/193829451 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18023730 con 0x559669d02700 2023-09-13T09:56:45.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.083+0000 7f7f35b28b80 1 -- 172.21.15.6:0/193829451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d02700 msgr2=0x559669d12480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.083+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d02700 0x559669d12480 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7f18010760 tx=0x7f7f18010790 comp rx=0 tx=0).stop 2023-09-13T09:56:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 -- 172.21.15.6:0/193829451 shutdown_connections 2023-09-13T09:56:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d03060 0x559669d08e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/193829451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d02700 0x559669d12480 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 -- 172.21.15.6:0/193829451 >> 172.21.15.6:0/193829451 conn(0x559669c5fc80 msgr2=0x559669d09c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 -- 172.21.15.6:0/193829451 shutdown_connections 2023-09-13T09:56:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 -- 172.21.15.6:0/193829451 wait complete. 2023-09-13T09:56:45.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 -- start start 2023-09-13T09:56:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.084+0000 7f7f35b28b80 1 Processor -- start 2023-09-13T09:56:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d0e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f35b28b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 0x559669d11af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669d12030 con 0x559669d01a00 2023-09-13T09:56:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669d121a0 con 0x559669d02700 2023-09-13T09:56:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f35b28b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559669d12360 con 0x559669d03060 2023-09-13T09:56:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f35b28b80 10 client.0 _ll_register_callbacks cb 0x559669bef680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f227fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f227fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38260/0 (socket says 172.21.15.6:38260) 2023-09-13T09:56:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f227fc700 1 -- 172.21.15.6:0/563780522 learned_addr learned my addr 172.21.15.6:0/563780522 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f237fe700 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d0e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.085+0000 7f7f237fe700 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 0x559669d11af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.086+0000 7f7f227fc700 1 -- 172.21.15.6:0/563780522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 msgr2=0x559669d11af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:45.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.086+0000 7f7f227fc700 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 0x559669d11af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.086+0000 7f7f227fc700 1 -- 172.21.15.6:0/563780522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 msgr2=0x559669d0e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.086+0000 7f7f227fc700 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d0e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.086+0000 7f7f227fc700 1 -- 172.21.15.6:0/563780522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559669c6b7a0 con 0x559669d02700 2023-09-13T09:56:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.087+0000 7f7f227fc700 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0eb80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7f18005880 tx=0x7f7f18005aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ce0ec4ed1f317e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:45.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.087+0000 7f7f02ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.087+0000 7f7f02ffd700 1 -- 172.21.15.6:0/563780522 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18018bb0 con 0x559669d02700 2023-09-13T09:56:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.088+0000 7f7f02ffd700 1 -- 172.21.15.6:0/563780522 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7f18000e40 con 0x559669d02700 2023-09-13T09:56:45.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.088+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f1c00f050 con 0x559669d02700 2023-09-13T09:56:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.089+0000 7f7f02ffd700 1 -- 172.21.15.6:0/563780522 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f180234d0 con 0x559669d02700 2023-09-13T09:56:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.089+0000 7f7f35b28b80 10 client.29318 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.089+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x559669a68c60 con 0x559669d02700 2023-09-13T09:56:45.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f02ffd700 1 -- 172.21.15.6:0/563780522 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7f1c00f050 con 0x559669d02700 2023-09-13T09:56:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f02ffd700 1 -- 172.21.15.6:0/563780522 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7f180346e0 con 0x559669d02700 2023-09-13T09:56:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f35b28b80 10 client.29318 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f35b28b80 10 client.29318 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f35b28b80 20 client.29318 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:45.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d6bd00 0x559669d6e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f35b28b80 4 client.29318 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:56:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.093+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559669c0d050 con 0x559669d6bd00 2023-09-13T09:56:45.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.097+0000 7f7f237fe700 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d6bd00 0x559669d6e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.100+0000 7f7f02ffd700 10 client.29318 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:45.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.100+0000 7f7f237fe700 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d6bd00 0x559669d6e0f0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a807b4bc83b96d89 server_cookie=6417ca5e9b7089bb in_seq=0 out_seq=0 2023-09-13T09:56:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.100+0000 7f7f02ffd700 1 -- 172.21.15.6:0/563780522 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559669c0d050 con 0x559669d6bd00 2023-09-13T09:56:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.100+0000 7f7f02ffd700 10 client.29318 handle_command_reply: tid=0 2023-09-13T09:56:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.100+0000 7f7f35b28b80 1 client.29318 shutdown 2023-09-13T09:56:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.100+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 msgr2=0x559669d0eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.100+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0eb80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7f18005880 tx=0x7f7f18005aa0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 shutdown_connections 2023-09-13T09:56:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559669d03060 0x559669d11af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559669d6bd00 0x559669d6e0f0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559669d01a00 0x559669d0e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 --2- 172.21.15.6:0/563780522 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559669d02700 0x559669d0eb80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f02ffd700 0 client.29318 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 >> 172.21.15.6:0/563780522 conn(0x559669c5fc80 msgr2=0x559669d18e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 shutdown_connections 2023-09-13T09:56:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 1 -- 172.21.15.6:0/563780522 wait complete. 2023-09-13T09:56:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.101+0000 7f7f35b28b80 20 client.29318 trim_cache size 0 max 16384 2023-09-13T09:56:45.105 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:56:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.102+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f0c0a0810 msgr2=0x7f7f0c0a2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.102+0000 7f7f29943700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f0c0a0810 0x7f7f0c0a2cd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7f14096fb0 tx=0x7f7f1400f8e0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.102+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 msgr2=0x7f7f24114220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.102+0000 7f7f29943700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f24114220 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f7f1400b5c0 tx=0x7f7f14003b90 comp rx=0 tx=0).stop 2023-09-13T09:56:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.103+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 shutdown_connections 2023-09-13T09:56:45.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.103+0000 7f7f29943700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f2410d040 0x7f7f241b5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.103+0000 7f7f29943700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7f0c0a0810 0x7f7f0c0a2cd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.103+0000 7f7f29943700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f24107cb0 0x7f7f24114220 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.103+0000 7f7f29943700 1 --2- 172.21.15.6:0/2134177741 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7f2410a620 0x7f7f24114760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.103+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 >> 172.21.15.6:0/2134177741 conn(0x7f7f2406e500 msgr2=0x7f7f2410be90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.105+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 shutdown_connections 2023-09-13T09:56:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:45.106+0000 7f7f29943700 1 -- 172.21.15.6:0/2134177741 wait complete. 2023-09-13T09:56:45.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 174963 38.04 MB/sec execute 125 sec latency 89.524 ms 2023-09-13T09:56:46.125 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:56:46.126 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:56:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.326+0000 7f63d0c92700 1 -- 172.21.15.6:0/3170632107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc107cb0 msgr2=0x7f63cc1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.326+0000 7f63d0c92700 1 --2- 172.21.15.6:0/3170632107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc107cb0 0x7f63cc1080d0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f63c400b0a0 tx=0x7f63c400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.328+0000 7f63d0c92700 1 -- 172.21.15.6:0/3170632107 shutdown_connections 2023-09-13T09:56:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.328+0000 7f63d0c92700 1 --2- 172.21.15.6:0/3170632107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc10f530 0x7f63cc111920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.328+0000 7f63d0c92700 1 --2- 172.21.15.6:0/3170632107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc107cb0 0x7f63cc1080d0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.328+0000 7f63d0c92700 1 --2- 172.21.15.6:0/3170632107 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc108610 0x7f63cc10eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.328+0000 7f63d0c92700 1 -- 172.21.15.6:0/3170632107 >> 172.21.15.6:0/3170632107 conn(0x7f63cc06dc70 msgr2=0x7f63cc0700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.328+0000 7f63d0c92700 1 -- 172.21.15.6:0/3170632107 shutdown_connections 2023-09-13T09:56:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.328+0000 7f63d0c92700 1 -- 172.21.15.6:0/3170632107 wait complete. 2023-09-13T09:56:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 Processor -- start 2023-09-13T09:56:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 -- start start 2023-09-13T09:56:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc107cb0 0x7f63cc19f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc108610 0x7f63cc19f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc10f530 0x7f63cc1a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1a6fe0 con 0x7f63cc108610 2023-09-13T09:56:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1a7120 con 0x7f63cc10f530 2023-09-13T09:56:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.329+0000 7f63d0c92700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63cc1a72b0 con 0x7f63cc107cb0 2023-09-13T09:56:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc108610 0x7f63cc19f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc10f530 0x7f63cc1a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc10f530 0x7f63cc1a6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38274/0 (socket says 172.21.15.6:38274) 2023-09-13T09:56:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc108610 0x7f63cc19f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44750/0 (socket says 172.21.15.6:44750) 2023-09-13T09:56:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63cad9d700 1 -- 172.21.15.6:0/511144345 learned_addr learned my addr 172.21.15.6:0/511144345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63ca59c700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc107cb0 0x7f63cc19f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 -- 172.21.15.6:0/511144345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc107cb0 msgr2=0x7f63cc19f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc107cb0 0x7f63cc19f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 -- 172.21.15.6:0/511144345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc10f530 msgr2=0x7f63cc1a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc10f530 0x7f63cc1a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 -- 172.21.15.6:0/511144345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63c4009d00 con 0x7f63cc108610 2023-09-13T09:56:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63cad9d700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc10f530 0x7f63cc1a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.330+0000 7f63c9d9b700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc108610 0x7f63cc19f9a0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00d720 tx=0x7f63bc00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.331+0000 7f63bb7fe700 1 -- 172.21.15.6:0/511144345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc012a20 con 0x7f63cc108610 2023-09-13T09:56:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.331+0000 7f63bb7fe700 1 -- 172.21.15.6:0/511144345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63bc016070 con 0x7f63cc108610 2023-09-13T09:56:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.331+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63cc108e20 con 0x7f63cc108610 2023-09-13T09:56:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.331+0000 7f63bb7fe700 1 -- 172.21.15.6:0/511144345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63bc019380 con 0x7f63cc108610 2023-09-13T09:56:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.331+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc109330 con 0x7f63cc108610 2023-09-13T09:56:46.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.336+0000 7f63dce77b80 1 Processor -- start 2023-09-13T09:56:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.336+0000 7f63dce77b80 1 -- start start 2023-09-13T09:56:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.336+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b506780 0x55e28b506ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.336+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b5070e0 0x55e28b505540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.336+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 0x55e28b505f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.336+0000 7f63dce77b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b45e800 con 0x55e28b5070e0 2023-09-13T09:56:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.336+0000 7f63dce77b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b45c120 con 0x55e28b506780 2023-09-13T09:56:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63dce77b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b457a10 con 0x55e28b505a80 2023-09-13T09:56:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b506780 0x55e28b506ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b506780 0x55e28b506ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38280/0 (socket says 172.21.15.6:38280) 2023-09-13T09:56:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 -- 172.21.15.6:0/4177772092 learned_addr learned my addr 172.21.15.6:0/4177772092 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63ca59c700 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b5070e0 0x55e28b505540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 -- 172.21.15.6:0/4177772092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 msgr2=0x55e28b505f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:56:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 0x55e28b505f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 -- 172.21.15.6:0/4177772092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b5070e0 msgr2=0x55e28b505540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b5070e0 0x55e28b505540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 -- 172.21.15.6:0/4177772092 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e28b2d76b0 con 0x55e28b506780 2023-09-13T09:56:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.337+0000 7f63cad9d700 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b506780 0x55e28b506ba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f63c0011600 tx=0x7f63c0011910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97b4e174e9aa71fa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.338+0000 7f63b8ff9700 1 -- 172.21.15.6:0/4177772092 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0019410 con 0x55e28b506780 2023-09-13T09:56:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.338+0000 7f63b8ff9700 1 -- 172.21.15.6:0/4177772092 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63c0019a30 con 0x55e28b506780 2023-09-13T09:56:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.338+0000 7f63b8ff9700 1 -- 172.21.15.6:0/4177772092 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c000fa50 con 0x55e28b506780 2023-09-13T09:56:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.338+0000 7f63bb7fe700 1 -- 172.21.15.6:0/511144345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f63bc018030 con 0x7f63cc108610 2023-09-13T09:56:46.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 -- 172.21.15.6:0/4177772092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b506780 msgr2=0x55e28b506ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b506780 0x55e28b506ba0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f63c0011600 tx=0x7f63c0011910 comp rx=0 tx=0).stop 2023-09-13T09:56:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 -- 172.21.15.6:0/4177772092 shutdown_connections 2023-09-13T09:56:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 0x55e28b505f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b506780 0x55e28b506ba0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 --2- 172.21.15.6:0/4177772092 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b5070e0 0x55e28b505540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 -- 172.21.15.6:0/4177772092 >> 172.21.15.6:0/4177772092 conn(0x55e28b463d00 msgr2=0x55e28b4fff90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63bb7fe700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 -- 172.21.15.6:0/4177772092 shutdown_connections 2023-09-13T09:56:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 -- 172.21.15.6:0/4177772092 wait complete. 2023-09-13T09:56:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63ca59c700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63bb7fe700 1 -- 172.21.15.6:0/511144345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f63bc0d1220 con 0x7f63cc108610 2023-09-13T09:56:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 -- start start 2023-09-13T09:56:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.339+0000 7f63dce77b80 1 Processor -- start 2023-09-13T09:56:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63ca59c700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f63c40062a0 tx=0x7f63c4006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 0x55e28b50ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b50f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b5070e0 0x55e28b5164f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63dce77b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b3f5c30 con 0x55e28b506780 2023-09-13T09:56:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63dce77b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b3f5930 con 0x55e28b5070e0 2023-09-13T09:56:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63dce77b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b2d99a0 con 0x55e28b505a80 2023-09-13T09:56:46.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63dce77b80 10 client.0 _ll_register_callbacks cb 0x55e28b3f3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b5070e0 0x55e28b5164f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b5070e0 0x55e28b5164f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38290/0 (socket says 172.21.15.6:38290) 2023-09-13T09:56:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 -- 172.21.15.6:0/1311375299 learned_addr learned my addr 172.21.15.6:0/1311375299 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63ca59c700 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 0x55e28b50ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63c9d9b700 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b50f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 -- 172.21.15.6:0/1311375299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 msgr2=0x55e28b50ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 0x55e28b50ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 -- 172.21.15.6:0/1311375299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 msgr2=0x55e28b50f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b50f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.340+0000 7f63cad9d700 1 -- 172.21.15.6:0/1311375299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63c0009e30 con 0x55e28b5070e0 2023-09-13T09:56:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63cad9d700 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b5070e0 0x55e28b5164f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f63c001c040 tx=0x7f63c00196a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=655b743b18eb7a44 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63b1ffb700 1 -- 172.21.15.6:0/1311375299 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c0005260 con 0x55e28b5070e0 2023-09-13T09:56:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63b1ffb700 1 -- 172.21.15.6:0/1311375299 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f63c00053c0 con 0x55e28b5070e0 2023-09-13T09:56:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e28b4f86f0 con 0x55e28b5070e0 2023-09-13T09:56:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63b1ffb700 1 -- 172.21.15.6:0/1311375299 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c00055c0 con 0x55e28b5070e0 2023-09-13T09:56:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63dce77b80 10 client.29330 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.341+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55e28b46f820 con 0x55e28b5070e0 2023-09-13T09:56:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.342+0000 7f63b1ffb700 1 -- 172.21.15.6:0/1311375299 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e28b4f86f0 con 0x55e28b5070e0 2023-09-13T09:56:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.343+0000 7f63b1ffb700 1 -- 172.21.15.6:0/1311375299 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f63c000f790 con 0x55e28b5070e0 2023-09-13T09:56:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.343+0000 7f63dce77b80 10 client.29330 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.343+0000 7f63dce77b80 10 client.29330 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.343+0000 7f63dce77b80 20 client.29330 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.343+0000 7f63dce77b80 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b51acb0 0x55e28b51d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.343+0000 7f63dce77b80 4 client.29330 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.343+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e28b4509f0 con 0x55e28b51acb0 2023-09-13T09:56:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.344+0000 7f63ca59c700 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b51acb0 0x55e28b51d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.344+0000 7f63b1ffb700 10 client.29330 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.344+0000 7f63ca59c700 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b51acb0 0x55e28b51d0d0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb89984afeb82a6b server_cookie=eb1c3127e35170dd in_seq=0 out_seq=0 2023-09-13T09:56:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63b1ffb700 1 -- 172.21.15.6:0/1311375299 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e28b4509f0 con 0x55e28b51acb0 2023-09-13T09:56:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63b1ffb700 10 client.29330 handle_command_reply: tid=0 2023-09-13T09:56:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 client.29330 shutdown 2023-09-13T09:56:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b5070e0 msgr2=0x55e28b5164f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b5070e0 0x55e28b5164f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f63c001c040 tx=0x7f63c00196a0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 shutdown_connections 2023-09-13T09:56:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b5070e0 0x55e28b5164f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b505a80 0x55e28b50ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b51acb0 0x55e28b51d0d0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 --2- 172.21.15.6:0/1311375299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b50f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63b1ffb700 0 client.29330 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 >> 172.21.15.6:0/1311375299 conn(0x55e28b463d00 msgr2=0x55e28b4fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 shutdown_connections 2023-09-13T09:56:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 1 -- 172.21.15.6:0/1311375299 wait complete. 2023-09-13T09:56:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.347+0000 7f63dce77b80 20 client.29330 trim_cache size 0 max 16384 2023-09-13T09:56:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 Processor -- start 2023-09-13T09:56:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 -- start start 2023-09-13T09:56:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b505540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b5164b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b50ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b50a500 con 0x55e28b506780 2023-09-13T09:56:46.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b51aa40 con 0x55e28b505a80 2023-09-13T09:56:46.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63dce77b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b5017b0 con 0x55e28b5070e0 2023-09-13T09:56:46.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63c9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b5164b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63c9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b5164b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44772/0 (socket says 172.21.15.6:44772) 2023-09-13T09:56:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63c9d9b700 1 -- 172.21.15.6:0/113144627 learned_addr learned my addr 172.21.15.6:0/113144627 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63cad9d700 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b50ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.373+0000 7f63ca59c700 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b505540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63ca59c700 1 -- 172.21.15.6:0/113144627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 msgr2=0x55e28b50ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63ca59c700 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b50ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63ca59c700 1 -- 172.21.15.6:0/113144627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 msgr2=0x55e28b5164b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63ca59c700 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b5164b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63ca59c700 1 -- 172.21.15.6:0/113144627 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e28b283e60 con 0x55e28b505a80 2023-09-13T09:56:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63ca59c700 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b505540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f63c400b070 tx=0x7f63c401e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9fdce0163cbc107 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63b97fa700 1 -- 172.21.15.6:0/113144627 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c4031070 con 0x55e28b505a80 2023-09-13T09:56:46.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63b97fa700 1 -- 172.21.15.6:0/113144627 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63c400be90 con 0x55e28b505a80 2023-09-13T09:56:46.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.374+0000 7f63b97fa700 1 -- 172.21.15.6:0/113144627 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400e040 con 0x55e28b505a80 2023-09-13T09:56:46.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.375+0000 7f63dce77b80 1 -- 172.21.15.6:0/113144627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 msgr2=0x55e28b505540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.375+0000 7f63dce77b80 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b505540 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f63c400b070 tx=0x7f63c401e000 comp rx=0 tx=0).stop 2023-09-13T09:56:46.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 -- 172.21.15.6:0/113144627 shutdown_connections 2023-09-13T09:56:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b50ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b505540 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 --2- 172.21.15.6:0/113144627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b5164b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 -- 172.21.15.6:0/113144627 >> 172.21.15.6:0/113144627 conn(0x55e28b463d00 msgr2=0x55e28b5099a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 -- 172.21.15.6:0/113144627 shutdown_connections 2023-09-13T09:56:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 -- 172.21.15.6:0/113144627 wait complete. 2023-09-13T09:56:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 -- start start 2023-09-13T09:56:46.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 Processor -- start 2023-09-13T09:56:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b5132f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b513830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b56eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b513e50 con 0x55e28b506780 2023-09-13T09:56:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.376+0000 7f63dce77b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b56f030 con 0x55e28b505a80 2023-09-13T09:56:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63dce77b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e28b56f170 con 0x55e28b5070e0 2023-09-13T09:56:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63dce77b80 10 client.0 _ll_register_callbacks cb 0x55e28b3f3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:46.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b5132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63c9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b513830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b5132f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38304/0 (socket says 172.21.15.6:38304) 2023-09-13T09:56:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 -- 172.21.15.6:0/2205783448 learned_addr learned my addr 172.21.15.6:0/2205783448 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63cad9d700 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b56eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 -- 172.21.15.6:0/2205783448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 msgr2=0x55e28b56eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b56eaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 -- 172.21.15.6:0/2205783448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 msgr2=0x55e28b513830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b513830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 -- 172.21.15.6:0/2205783448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63cc112410 con 0x55e28b505a80 2023-09-13T09:56:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63c9d9b700 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b513830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:46.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63ca59c700 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b5132f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f63c400b0a0 tx=0x7f63c40050e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4ddbc715f89a616 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.377+0000 7f63b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63b1ffb700 1 -- 172.21.15.6:0/2205783448 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63c400e030 con 0x55e28b505a80 2023-09-13T09:56:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63b1ffb700 1 -- 172.21.15.6:0/2205783448 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f63c4003a00 con 0x55e28b505a80 2023-09-13T09:56:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f63c0019a30 con 0x55e28b505a80 2023-09-13T09:56:46.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63b1ffb700 1 -- 172.21.15.6:0/2205783448 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f63c4031040 con 0x55e28b505a80 2023-09-13T09:56:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63dce77b80 10 client.29336 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55e28b26cce0 con 0x55e28b505a80 2023-09-13T09:56:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63b1ffb700 1 -- 172.21.15.6:0/2205783448 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f63c0019a30 con 0x55e28b505a80 2023-09-13T09:56:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.378+0000 7f63b1ffb700 1 -- 172.21.15.6:0/2205783448 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f63c402bc50 con 0x55e28b505a80 2023-09-13T09:56:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.381+0000 7f63dce77b80 10 client.29336 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:46.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.381+0000 7f63dce77b80 10 client.29336 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.381+0000 7f63dce77b80 20 client.29336 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.381+0000 7f63dce77b80 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b5707c0 0x55e28b572be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.381+0000 7f63dce77b80 4 client.29336 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:56:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.381+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55e28b4110d0 con 0x55e28b5707c0 2023-09-13T09:56:46.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.382+0000 7f63c9d9b700 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b5707c0 0x55e28b572be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.382+0000 7f63b1ffb700 10 client.29336 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.382+0000 7f63c9d9b700 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b5707c0 0x55e28b572be0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bb0a06ea328f435 server_cookie=251d463eb568f2ef in_seq=0 out_seq=0 2023-09-13T09:56:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.385+0000 7f63b1ffb700 1 -- 172.21.15.6:0/2205783448 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55e28b4110d0 con 0x55e28b5707c0 2023-09-13T09:56:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.385+0000 7f63b1ffb700 10 client.29336 handle_command_reply: tid=0 2023-09-13T09:56:46.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 client.29336 shutdown 2023-09-13T09:56:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 msgr2=0x55e28b5132f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b5132f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f63c400b0a0 tx=0x7f63c40050e0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 shutdown_connections 2023-09-13T09:56:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e28b5070e0 0x55e28b56eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e28b505a80 0x55e28b5132f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e28b5707c0 0x55e28b572be0 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 --2- 172.21.15.6:0/2205783448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e28b506780 0x55e28b513830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63b1ffb700 0 client.29336 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 >> 172.21.15.6:0/2205783448 conn(0x55e28b463d00 msgr2=0x55e28b50ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 shutdown_connections 2023-09-13T09:56:46.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 1 -- 172.21.15.6:0/2205783448 wait complete. 2023-09-13T09:56:46.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.386+0000 7f63dce77b80 20 client.29336 trim_cache size 0 max 16384 2023-09-13T09:56:46.394 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:56:46.394 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:56:46.395 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "f194bb68-ea03-4e59-b373-7bf60e305d1b", 2023-09-13T09:56:46.395 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:56:46.395 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:56:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 msgr2=0x7f63b40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f63c40062a0 tx=0x7f63c4006210 comp rx=0 tx=0).stop 2023-09-13T09:56:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc108610 msgr2=0x7f63cc19f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc108610 0x7f63cc19f9a0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f63bc00d720 tx=0x7f63bc00da30 comp rx=0 tx=0).stop 2023-09-13T09:56:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 shutdown_connections 2023-09-13T09:56:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f63cc10f530 0x7f63cc1a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f63cc107cb0 0x7f63cc19f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f63b40a0640 0x7f63b40a2b00 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 --2- 172.21.15.6:0/511144345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f63cc108610 0x7f63cc19f9a0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 >> 172.21.15.6:0/511144345 conn(0x7f63cc06dc70 msgr2=0x7f63cc06fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 shutdown_connections 2023-09-13T09:56:46.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.387+0000 7f63d0c92700 1 -- 172.21.15.6:0/511144345 wait complete. 2023-09-13T09:56:46.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:56:46.442 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:46 smithi006 ceph-mon[98665]: pgmap v817: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 738 op/s 2023-09-13T09:56:46.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:46 smithi053 ceph-mon[102373]: pgmap v817: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 738 op/s 2023-09-13T09:56:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:46 smithi131 ceph-mon[102785]: pgmap v817: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 738 op/s 2023-09-13T09:56:46.571 INFO:tasks.workunit.client.0.smithi006.stdout: 10 175718 38.12 MB/sec execute 126 sec latency 90.303 ms 2023-09-13T09:56:46.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.599+0000 7f37aef2f700 1 -- 172.21.15.6:0/1241527766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8101850 msgr2=0x7f37a8108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.599+0000 7f37aef2f700 1 --2- 172.21.15.6:0/1241527766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8101850 0x7f37a8108100 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f37a0009fc0 tx=0x7f37a000b330 comp rx=0 tx=0).stop 2023-09-13T09:56:46.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.601+0000 7f37aef2f700 1 -- 172.21.15.6:0/1241527766 shutdown_connections 2023-09-13T09:56:46.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.601+0000 7f37aef2f700 1 --2- 172.21.15.6:0/1241527766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8101850 0x7f37a8108100 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.601+0000 7f37aef2f700 1 --2- 172.21.15.6:0/1241527766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 0x7f37a81000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.601+0000 7f37aef2f700 1 --2- 172.21.15.6:0/1241527766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a8100eb0 0x7f37a8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.601+0000 7f37aef2f700 1 -- 172.21.15.6:0/1241527766 >> 172.21.15.6:0/1241527766 conn(0x7f37a80fb250 msgr2=0x7f37a80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.601+0000 7f37aef2f700 1 -- 172.21.15.6:0/1241527766 shutdown_connections 2023-09-13T09:56:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.603+0000 7f37aef2f700 1 -- 172.21.15.6:0/1241527766 wait complete. 2023-09-13T09:56:46.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.603+0000 7f37aef2f700 1 Processor -- start 2023-09-13T09:56:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.603+0000 7f37aef2f700 1 -- start start 2023-09-13T09:56:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37aef2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 0x7f37a8194940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37aef2f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8100eb0 0x7f37a8194e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37aef2f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a8101850 0x7f37a819bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37aef2f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a819c4c0 con 0x7f37a80ffcc0 2023-09-13T09:56:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37aef2f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a806a6d0 con 0x7f37a8100eb0 2023-09-13T09:56:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37aef2f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a806a860 con 0x7f37a8101850 2023-09-13T09:56:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 0x7f37a8194940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37ad4cc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a8101850 0x7f37a819bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 0x7f37a8194940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44790/0 (socket says 172.21.15.6:44790) 2023-09-13T09:56:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8100eb0 0x7f37a8194e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 -- 172.21.15.6:0/3955797863 learned_addr learned my addr 172.21.15.6:0/3955797863 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 -- 172.21.15.6:0/3955797863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a8101850 msgr2=0x7f37a819bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a8101850 0x7f37a819bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 -- 172.21.15.6:0/3955797863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8100eb0 msgr2=0x7f37a8194e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8100eb0 0x7f37a8194e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37acccb700 1 -- 172.21.15.6:0/3955797863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37980095f0 con 0x7f37a80ffcc0 2023-09-13T09:56:46.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.604+0000 7f37ad4cc700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a8101850 0x7f37a819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.608+0000 7f37acccb700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 0x7f37a8194940 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f379800cc90 tx=0x7f37980100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.608+0000 7f37a5ffb700 1 -- 172.21.15.6:0/3955797863 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798012040 con 0x7f37a80ffcc0 2023-09-13T09:56:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.608+0000 7f37a5ffb700 1 -- 172.21.15.6:0/3955797863 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3798016400 con 0x7f37a80ffcc0 2023-09-13T09:56:46.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.608+0000 7f37a5ffb700 1 -- 172.21.15.6:0/3955797863 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798009a10 con 0x7f37a80ffcc0 2023-09-13T09:56:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.608+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a0009c40 con 0x7f37a80ffcc0 2023-09-13T09:56:46.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.608+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a806ae70 con 0x7f37a80ffcc0 2023-09-13T09:56:46.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.611+0000 7f37a5ffb700 1 -- 172.21.15.6:0/3955797863 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3798016570 con 0x7f37a80ffcc0 2023-09-13T09:56:46.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.612+0000 7f37a5ffb700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f37900a0640 0x7f37900a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.612+0000 7f37a5ffb700 1 -- 172.21.15.6:0/3955797863 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f37980cd9c0 con 0x7f37a80ffcc0 2023-09-13T09:56:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.612+0000 7f37a7fff700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f37900a0640 0x7f37900a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.613+0000 7f37a7fff700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f37900a0640 0x7f37900a2b00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f379c009c60 tx=0x7f379c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.614+0000 7f37bb114b80 1 Processor -- start 2023-09-13T09:56:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.614+0000 7f37bb114b80 1 -- start start 2023-09-13T09:56:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 0x55d8771d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37bb114b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d877128780 con 0x55d8771d0700 2023-09-13T09:56:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37bb114b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8771260a0 con 0x55d8771d1060 2023-09-13T09:56:46.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37bb114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d877121990 con 0x55d8771cfa00 2023-09-13T09:56:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37ad4cc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37ad4cc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47852/0 (socket says 172.21.15.6:47852) 2023-09-13T09:56:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37ad4cc700 1 -- 172.21.15.6:0/1026614287 learned_addr learned my addr 172.21.15.6:0/1026614287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37a7fff700 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.615+0000 7f37ad4cc700 1 -- 172.21.15.6:0/1026614287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 msgr2=0x55d8771cf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f37ad4cc700 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771cf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f37ad4cc700 1 -- 172.21.15.6:0/1026614287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 msgr2=0x55d8771d0b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:56:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f37ad4cc700 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 0x55d8771d0b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f37ad4cc700 1 -- 172.21.15.6:0/1026614287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d876fa1630 con 0x55d8771cfa00 2023-09-13T09:56:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f37a7fff700 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:56:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f37ad4cc700 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771cfe80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f37a0008f00 tx=0x7f37a0008f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd424639bf1b1c27 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f378effd700 1 -- 172.21.15.6:0/1026614287 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a000e040 con 0x55d8771cfa00 2023-09-13T09:56:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f378effd700 1 -- 172.21.15.6:0/1026614287 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f37a00093e0 con 0x55d8771cfa00 2023-09-13T09:56:46.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.616+0000 7f378effd700 1 -- 172.21.15.6:0/1026614287 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37a00052a0 con 0x55d8771cfa00 2023-09-13T09:56:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 -- 172.21.15.6:0/1026614287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 msgr2=0x55d8771cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771cfe80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f37a0008f00 tx=0x7f37a0008f30 comp rx=0 tx=0).stop 2023-09-13T09:56:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 -- 172.21.15.6:0/1026614287 shutdown_connections 2023-09-13T09:56:46.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771cfe80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 0x55d8771d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 --2- 172.21.15.6:0/1026614287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771cf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 -- 172.21.15.6:0/1026614287 >> 172.21.15.6:0/1026614287 conn(0x55d87712dc80 msgr2=0x55d8771c9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 -- 172.21.15.6:0/1026614287 shutdown_connections 2023-09-13T09:56:46.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.617+0000 7f37bb114b80 1 -- 172.21.15.6:0/1026614287 wait complete. 2023-09-13T09:56:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 -- start start 2023-09-13T09:56:46.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 Processor -- start 2023-09-13T09:56:46.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771d8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 0x55d8771d94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8770bfbb0 con 0x55d8771d0700 2023-09-13T09:56:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8770bf8b0 con 0x55d8771d1060 2023-09-13T09:56:46.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d876fa3920 con 0x55d8771cfa00 2023-09-13T09:56:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.618+0000 7f37bb114b80 10 client.0 _ll_register_callbacks cb 0x55d8770bd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37a7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 0x55d8771d94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771d8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771d8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47856/0 (socket says 172.21.15.6:47856) 2023-09-13T09:56:46.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 -- 172.21.15.6:0/3236943675 learned_addr learned my addr 172.21.15.6:0/3236943675 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37ad4cc700 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771e04e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 -- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 msgr2=0x55d8771e04e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771e04e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 -- 172.21.15.6:0/3236943675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 msgr2=0x55d8771d94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 0x55d8771d94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 -- 172.21.15.6:0/3236943675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a8108a50 con 0x55d8771cfa00 2023-09-13T09:56:46.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37acccb700 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771d8f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f379809ae60 tx=0x7f379809b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad664513f4ebf2d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f3787fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:56:46.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f3787fff700 1 -- 172.21.15.6:0/3236943675 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379809ef90 con 0x55d8771cfa00 2023-09-13T09:56:46.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f3787fff700 1 -- 172.21.15.6:0/3236943675 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f37980a31d0 con 0x55d8771cfa00 2023-09-13T09:56:46.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8771c2670 con 0x55d8771cfa00 2023-09-13T09:56:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.619+0000 7f3787fff700 1 -- 172.21.15.6:0/3236943675 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37980b9170 con 0x55d8771cfa00 2023-09-13T09:56:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 10 client.29284 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55d8771397a0 con 0x55d8771cfa00 2023-09-13T09:56:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f3787fff700 1 -- 172.21.15.6:0/3236943675 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3798065080 con 0x55d8771cfa00 2023-09-13T09:56:46.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f3787fff700 1 -- 172.21.15.6:0/3236943675 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3798096f50 con 0x55d8771cfa00 2023-09-13T09:56:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 10 client.29284 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 10 client.29284 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 20 client.29284 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771e4c70 0x55d8771e7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 4 client.29284 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:56:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d87711a970 con 0x55d8771e4c70 2023-09-13T09:56:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.620+0000 7f37a7fff700 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771e4c70 0x55d8771e7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.621+0000 7f3787fff700 10 client.29284 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.621+0000 7f37a7fff700 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771e4c70 0x55d8771e7090 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a33081b57e68138c server_cookie=472ec7b983bd46a in_seq=0 out_seq=0 2023-09-13T09:56:46.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.621+0000 7f3787fff700 1 -- 172.21.15.6:0/3236943675 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d87711a970 con 0x55d8771e4c70 2023-09-13T09:56:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.621+0000 7f3787fff700 10 client.29284 handle_command_reply: tid=0 2023-09-13T09:56:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.621+0000 7f37bb114b80 1 client.29284 shutdown 2023-09-13T09:56:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 msgr2=0x55d8771d8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771d8f60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f379809ae60 tx=0x7f379809b8e0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 shutdown_connections 2023-09-13T09:56:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d1060 0x55d8771e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771d8f60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771e4c70 0x55d8771e7090 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 --2- 172.21.15.6:0/3236943675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d8771d0700 0x55d8771d94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f3787fff700 0 client.29284 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 >> 172.21.15.6:0/3236943675 conn(0x55d87712dc80 msgr2=0x55d8771c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 shutdown_connections 2023-09-13T09:56:46.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 1 -- 172.21.15.6:0/3236943675 wait complete. 2023-09-13T09:56:46.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.622+0000 7f37bb114b80 20 client.29284 trim_cache size 0 max 16384 2023-09-13T09:56:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.644+0000 7f37bb114b80 1 Processor -- start 2023-09-13T09:56:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37bb114b80 1 -- start start 2023-09-13T09:56:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771e04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d0700 0x55d8771d8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37bb114b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8771d8ad0 con 0x55d87712dc80 2023-09-13T09:56:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37bb114b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8771d6c20 con 0x55d8771d0700 2023-09-13T09:56:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37bb114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8771d81d0 con 0x55d8771cfa00 2023-09-13T09:56:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37acccb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37ad4cc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d0700 0x55d8771d8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37ad4cc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d0700 0x55d8771d8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38336/0 (socket says 172.21.15.6:38336) 2023-09-13T09:56:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37ad4cc700 1 -- 172.21.15.6:0/4122087782 learned_addr learned my addr 172.21.15.6:0/4122087782 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37a7fff700 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771e04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37acccb700 1 -- 172.21.15.6:0/4122087782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 msgr2=0x55d8771e04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37acccb700 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771e04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37acccb700 1 -- 172.21.15.6:0/4122087782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d0700 msgr2=0x55d8771d8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.645+0000 7f37acccb700 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d0700 0x55d8771d8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.646+0000 7f37acccb700 1 -- 172.21.15.6:0/4122087782 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d876f4dde0 con 0x55d87712dc80 2023-09-13T09:56:46.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.646+0000 7f37acccb700 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771cf4c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3798097660 tx=0x7f3798099710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3441304a76b91df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.646+0000 7f378f7fe700 1 -- 172.21.15.6:0/4122087782 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37980b9170 con 0x55d87712dc80 2023-09-13T09:56:46.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.646+0000 7f378f7fe700 1 -- 172.21.15.6:0/4122087782 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55d8771c2670 con 0x55d87712dc80 2023-09-13T09:56:46.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.646+0000 7f378f7fe700 1 -- 172.21.15.6:0/4122087782 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379809a2b0 con 0x55d87712dc80 2023-09-13T09:56:46.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 -- 172.21.15.6:0/4122087782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 msgr2=0x55d8771cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771cf4c0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f3798097660 tx=0x7f3798099710 comp rx=0 tx=0).stop 2023-09-13T09:56:46.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 -- 172.21.15.6:0/4122087782 shutdown_connections 2023-09-13T09:56:46.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771d0700 0x55d8771d8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771cf4c0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 --2- 172.21.15.6:0/4122087782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771cfa00 0x55d8771e04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 -- 172.21.15.6:0/4122087782 >> 172.21.15.6:0/4122087782 conn(0x55d8771ca240 msgr2=0x55d8771d3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 -- 172.21.15.6:0/4122087782 shutdown_connections 2023-09-13T09:56:46.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 -- 172.21.15.6:0/4122087782 wait complete. 2023-09-13T09:56:46.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 -- start start 2023-09-13T09:56:46.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.647+0000 7f37bb114b80 1 Processor -- start 2023-09-13T09:56:46.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771e0460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771cfa00 0x55d8771dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37bb114b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771d0700 0x55d8771dd510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37bb114b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d877238a90 con 0x55d87712dc80 2023-09-13T09:56:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37bb114b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d877238bd0 con 0x55d8771cfa00 2023-09-13T09:56:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37bb114b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d877238d60 con 0x55d8771d0700 2023-09-13T09:56:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37bb114b80 10 client.0 _ll_register_callbacks cb 0x55d8770bd680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:56:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37acccb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771e0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771cfa00 0x55d8771dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771cfa00 0x55d8771dcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38342/0 (socket says 172.21.15.6:38342) 2023-09-13T09:56:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 -- 172.21.15.6:0/507163031 learned_addr learned my addr 172.21.15.6:0/507163031 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:56:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37ad4cc700 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771d0700 0x55d8771dd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37acccb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771e0460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44816/0 (socket says 172.21.15.6:44816) 2023-09-13T09:56:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 -- 172.21.15.6:0/507163031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771d0700 msgr2=0x55d8771dd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771d0700 0x55d8771dd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 -- 172.21.15.6:0/507163031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 msgr2=0x55d8771e0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:56:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771e0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.648+0000 7f37a7fff700 1 -- 172.21.15.6:0/507163031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8771397a0 con 0x55d8771cfa00 2023-09-13T09:56:46.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f37a7fff700 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771cfa00 0x55d8771dcf00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f379c013010 tx=0x7f379c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17d98aae36d9bc0f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:56:46.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f3787fff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:56:46.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f3787fff700 1 -- 172.21.15.6:0/507163031 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379c022040 con 0x55d8771cfa00 2023-09-13T09:56:46.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f37a00093e0 con 0x55d8771cfa00 2023-09-13T09:56:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f3787fff700 1 -- 172.21.15.6:0/507163031 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f379c003680 con 0x55d8771cfa00 2023-09-13T09:56:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f3787fff700 1 -- 172.21.15.6:0/507163031 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) v2 ==== 24+0+0 (secure 0 0 0) 0x7f379c0045a0 con 0x55d8771cfa00 2023-09-13T09:56:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f37bb114b80 10 client.29354 fetch_fsmap learned FSMap version 62 2023-09-13T09:56:46.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) v3 -- 0x55d876f36c60 con 0x55d8771cfa00 2023-09-13T09:56:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f3787fff700 1 -- 172.21.15.6:0/507163031 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f379c042080 con 0x55d8771cfa00 2023-09-13T09:56:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.649+0000 7f3787fff700 1 -- 172.21.15.6:0/507163031 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 62) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f379c03e770 con 0x55d8771cfa00 2023-09-13T09:56:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37bb114b80 10 client.29354 fetch_fsmap finished waiting for FSMap version 62 2023-09-13T09:56:46.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37bb114b80 10 client.29354 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:56:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37bb114b80 20 client.29354 populate_metadata read hostname 'smithi006' 2023-09-13T09:56:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37bb114b80 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771d1060 0x55d87723c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:56:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37bb114b80 4 client.29354 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:56:46.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d8770db050 con 0x55d8771d1060 2023-09-13T09:56:46.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37acccb700 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771d1060 0x55d87723c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:56:46.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f3787fff700 10 client.29354 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.650+0000 7f37acccb700 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771d1060 0x55d87723c840 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d83317d2a41f3e4 server_cookie=cc4e58c2a61491c7 in_seq=0 out_seq=0 2023-09-13T09:56:46.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.655+0000 7f3787fff700 1 -- 172.21.15.6:0/507163031 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55d8770db050 con 0x55d8771d1060 2023-09-13T09:56:46.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.655+0000 7f3787fff700 10 client.29354 handle_command_reply: tid=0 2023-09-13T09:56:46.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.655+0000 7f37bb114b80 1 client.29354 shutdown 2023-09-13T09:56:46.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.655+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771cfa00 msgr2=0x55d8771dcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.655+0000 7f37bb114b80 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771cfa00 0x55d8771dcf00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f379c013010 tx=0x7f379c0047c0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 shutdown_connections 2023-09-13T09:56:46.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d8771d0700 0x55d8771dd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d8771d1060 0x55d87723c840 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d87712dc80 0x55d8771e0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f3787fff700 0 client.29354 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:56:46.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 --2- 172.21.15.6:0/507163031 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d8771cfa00 0x55d8771dcf00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 >> 172.21.15.6:0/507163031 conn(0x55d8771ca240 msgr2=0x55d8771d8d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 shutdown_connections 2023-09-13T09:56:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 1 -- 172.21.15.6:0/507163031 wait complete. 2023-09-13T09:56:46.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.656+0000 7f37bb114b80 20 client.29354 trim_cache size 0 max 16384 2023-09-13T09:56:46.669 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:56:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:56:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:56:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: "f194bb68-ea03-4e59-b373-7bf60e305d1b": { 2023-09-13T09:56:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:56:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "f194bb68-ea03-4e59-b373-7bf60e305d1b", 2023-09-13T09:56:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:56:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:56:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:56:46.670 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:56:46.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f37900a0640 msgr2=0x7f37900a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f37900a0640 0x7f37900a2b00 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f379c009c60 tx=0x7f379c009260 comp rx=0 tx=0).stop 2023-09-13T09:56:46.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 msgr2=0x7f37a8194940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:56:46.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 0x7f37a8194940 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f379800cc90 tx=0x7f37980100c0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 shutdown_connections 2023-09-13T09:56:46.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37a8101850 0x7f37a819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f37900a0640 0x7f37900a2b00 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37a80ffcc0 0x7f37a8194940 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 --2- 172.21.15.6:0/3955797863 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f37a8100eb0 0x7f37a8194e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:56:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 >> 172.21.15.6:0/3955797863 conn(0x7f37a80fb250 msgr2=0x7f37a80fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:56:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 shutdown_connections 2023-09-13T09:56:46.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:56:46.657+0000 7f37aef2f700 1 -- 172.21.15.6:0/3955797863 wait complete. 2023-09-13T09:56:46.674 INFO:tasks.cephfs.filesystem:scrub status for tag:f194bb68-ea03-4e59-b373-7bf60e305d1b - {'path': '/', 'tag': 'f194bb68-ea03-4e59-b373-7bf60e305d1b', 'options': 'recursive,force'} 2023-09-13T09:56:47.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:47.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:47.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:47.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:47 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:47.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:47.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:47.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:47.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:47.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:47 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:47.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:47.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:47.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:47.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:47.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:47 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:47.570 INFO:tasks.workunit.client.0.smithi006.stdout: 10 176547 38.18 MB/sec execute 127 sec latency 66.518 ms 2023-09-13T09:56:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:48 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:56:48.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:48 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:48 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:48.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:48 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:56:48.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:48 smithi006 ceph-mon[98665]: pgmap v818: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 837 op/s 2023-09-13T09:56:48.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:48 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:48 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:48 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:56:48.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:48 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:48 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:48.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:48 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:56:48.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:48 smithi053 ceph-mon[102373]: pgmap v818: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 837 op/s 2023-09-13T09:56:48.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:48 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:48 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:48 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:56:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:48 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:48 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:48 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:56:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:48 smithi131 ceph-mon[102785]: pgmap v818: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 837 op/s 2023-09-13T09:56:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:48 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:48 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:56:48.571 INFO:tasks.workunit.client.0.smithi006.stdout: 10 177231 38.17 MB/sec execute 128 sec latency 68.625 ms 2023-09-13T09:56:49.571 INFO:tasks.workunit.client.0.smithi006.stdout: 10 177676 38.09 MB/sec execute 129 sec latency 256.258 ms 2023-09-13T09:56:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:50 smithi006 ceph-mon[98665]: pgmap v819: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 745 op/s 2023-09-13T09:56:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:50 smithi053 ceph-mon[102373]: pgmap v819: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 745 op/s 2023-09-13T09:56:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:50 smithi131 ceph-mon[102785]: pgmap v819: 97 pgs: 97 active+clean; 1.1 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 745 op/s 2023-09-13T09:56:50.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 178300 37.99 MB/sec execute 130 sec latency 72.491 ms 2023-09-13T09:56:51.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 179162 38.04 MB/sec execute 131 sec latency 52.163 ms 2023-09-13T09:56:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:52 smithi006 ceph-mon[98665]: pgmap v820: 97 pgs: 97 active+clean; 1.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.7 MiB/s wr, 656 op/s 2023-09-13T09:56:52.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:52 smithi053 ceph-mon[102373]: pgmap v820: 97 pgs: 97 active+clean; 1.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.7 MiB/s wr, 656 op/s 2023-09-13T09:56:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:52 smithi131 ceph-mon[102785]: pgmap v820: 97 pgs: 97 active+clean; 1.1 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.7 MiB/s wr, 656 op/s 2023-09-13T09:56:52.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 180057 38.13 MB/sec execute 132 sec latency 50.124 ms 2023-09-13T09:56:53.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 180761 38.17 MB/sec execute 133 sec latency 65.235 ms 2023-09-13T09:56:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:54 smithi006 ceph-mon[98665]: pgmap v821: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 823 op/s 2023-09-13T09:56:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:54 smithi053 ceph-mon[102373]: pgmap v821: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 823 op/s 2023-09-13T09:56:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:54 smithi131 ceph-mon[102785]: pgmap v821: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 11 MiB/s wr, 823 op/s 2023-09-13T09:56:54.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 181225 38.10 MB/sec execute 134 sec latency 213.512 ms 2023-09-13T09:56:55.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 181732 37.99 MB/sec execute 135 sec latency 89.713 ms 2023-09-13T09:56:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:56 smithi006 ceph-mon[98665]: pgmap v822: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 740 op/s 2023-09-13T09:56:56.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:56 smithi053 ceph-mon[102373]: pgmap v822: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 740 op/s 2023-09-13T09:56:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:56 smithi131 ceph-mon[102785]: pgmap v822: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 740 op/s 2023-09-13T09:56:56.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 182439 37.92 MB/sec execute 136 sec latency 66.442 ms 2023-09-13T09:56:57.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 183235 37.98 MB/sec execute 137 sec latency 61.845 ms 2023-09-13T09:56:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:57 smithi006 ceph-mon[98665]: pgmap v823: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 807 op/s 2023-09-13T09:56:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:57 smithi053 ceph-mon[102373]: pgmap v823: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 807 op/s 2023-09-13T09:56:58.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:57 smithi131 ceph-mon[102785]: pgmap v823: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 807 op/s 2023-09-13T09:56:58.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 184032 38.03 MB/sec execute 138 sec latency 111.666 ms 2023-09-13T09:56:59.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:59 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:59.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:56:59 smithi006 ceph-mon[98665]: pgmap v824: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 661 op/s 2023-09-13T09:56:59.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:59 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:59.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:56:59 smithi053 ceph-mon[102373]: pgmap v824: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 661 op/s 2023-09-13T09:56:59.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:59 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:56:59.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:56:59 smithi131 ceph-mon[102785]: pgmap v824: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 661 op/s 2023-09-13T09:56:59.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 184580 37.98 MB/sec execute 139 sec latency 326.060 ms 2023-09-13T09:57:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:00.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:00.572 INFO:tasks.workunit.client.0.smithi006.stdout: 10 185093 37.88 MB/sec execute 140 sec latency 85.983 ms 2023-09-13T09:57:01.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:01 smithi006 ceph-mon[98665]: pgmap v825: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.5 MiB/s wr, 695 op/s 2023-09-13T09:57:01.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:01 smithi053 ceph-mon[102373]: pgmap v825: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.5 MiB/s wr, 695 op/s 2023-09-13T09:57:01.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:01 smithi131 ceph-mon[102785]: pgmap v825: 97 pgs: 97 active+clean; 1.1 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.5 MiB/s wr, 695 op/s 2023-09-13T09:57:01.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 185810 37.90 MB/sec execute 141 sec latency 99.382 ms 2023-09-13T09:57:02.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 186523 37.91 MB/sec execute 142 sec latency 84.634 ms 2023-09-13T09:57:03.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 187237 37.92 MB/sec execute 143 sec latency 109.642 ms 2023-09-13T09:57:04.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:03 smithi006 ceph-mon[98665]: pgmap v826: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 824 op/s 2023-09-13T09:57:04.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:03 smithi053 ceph-mon[102373]: pgmap v826: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 824 op/s 2023-09-13T09:57:04.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:03 smithi131 ceph-mon[102785]: pgmap v826: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 824 op/s 2023-09-13T09:57:04.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 187784 37.87 MB/sec execute 144 sec latency 253.525 ms 2023-09-13T09:57:05.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 188376 37.80 MB/sec execute 145 sec latency 86.589 ms 2023-09-13T09:57:06.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:05 smithi006 ceph-mon[98665]: pgmap v827: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 753 op/s 2023-09-13T09:57:06.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:05 smithi053 ceph-mon[102373]: pgmap v827: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 753 op/s 2023-09-13T09:57:06.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:05 smithi131 ceph-mon[102785]: pgmap v827: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 753 op/s 2023-09-13T09:57:06.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 189149 37.86 MB/sec execute 146 sec latency 184.158 ms 2023-09-13T09:57:07.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 189896 37.86 MB/sec execute 147 sec latency 65.253 ms 2023-09-13T09:57:08.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:07 smithi053 ceph-mon[102373]: pgmap v828: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 778 op/s 2023-09-13T09:57:08.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:07 smithi006 ceph-mon[98665]: pgmap v828: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 778 op/s 2023-09-13T09:57:08.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:07 smithi131 ceph-mon[102785]: pgmap v828: 97 pgs: 97 active+clean; 1.1 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 10 MiB/s wr, 778 op/s 2023-09-13T09:57:08.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 190589 37.87 MB/sec execute 148 sec latency 105.353 ms 2023-09-13T09:57:09.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 191162 37.80 MB/sec execute 149 sec latency 223.945 ms 2023-09-13T09:57:10.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:09 smithi053 ceph-mon[102373]: pgmap v829: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 696 op/s 2023-09-13T09:57:10.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:09 smithi006 ceph-mon[98665]: pgmap v829: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 696 op/s 2023-09-13T09:57:10.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:09 smithi131 ceph-mon[102785]: pgmap v829: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.3 MiB/s wr, 696 op/s 2023-09-13T09:57:10.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 191818 37.78 MB/sec execute 150 sec latency 59.627 ms 2023-09-13T09:57:11.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 192671 37.86 MB/sec execute 151 sec latency 70.763 ms 2023-09-13T09:57:12.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:11 smithi053 ceph-mon[102373]: pgmap v830: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.1 MiB/s wr, 683 op/s 2023-09-13T09:57:12.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:11 smithi006 ceph-mon[98665]: pgmap v830: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.1 MiB/s wr, 683 op/s 2023-09-13T09:57:12.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:11 smithi131 ceph-mon[102785]: pgmap v830: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.1 MiB/s wr, 683 op/s 2023-09-13T09:57:12.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 193318 37.83 MB/sec execute 152 sec latency 217.745 ms 2023-09-13T09:57:13.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 193958 37.84 MB/sec execute 153 sec latency 55.234 ms 2023-09-13T09:57:14.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:13 smithi006 ceph-mon[98665]: pgmap v831: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 753 op/s 2023-09-13T09:57:14.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:13 smithi053 ceph-mon[102373]: pgmap v831: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 753 op/s 2023-09-13T09:57:14.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:13 smithi131 ceph-mon[102785]: pgmap v831: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 753 op/s 2023-09-13T09:57:14.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 194342 37.71 MB/sec execute 154 sec latency 251.108 ms 2023-09-13T09:57:15.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 194441 37.51 MB/sec execute 155 sec latency 799.428 ms 2023-09-13T09:57:16.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:16 smithi131 ceph-mon[102785]: pgmap v832: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.5 MiB/s wr, 706 op/s 2023-09-13T09:57:16.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:16 smithi006 ceph-mon[98665]: pgmap v832: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.5 MiB/s wr, 706 op/s 2023-09-13T09:57:16.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:16 smithi053 ceph-mon[102373]: pgmap v832: 97 pgs: 97 active+clean; 1.1 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.5 MiB/s wr, 706 op/s 2023-09-13T09:57:16.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 194857 37.39 MB/sec execute 156 sec latency 803.943 ms 2023-09-13T09:57:16.676 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:57:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 -- 172.21.15.6:0/126673302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd134100290 msgr2=0x7fd134108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 --2- 172.21.15.6:0/126673302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd134100290 0x7fd134108120 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00b0a0 tx=0x7fd12c00b3b0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 -- 172.21.15.6:0/126673302 shutdown_connections 2023-09-13T09:57:16.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 --2- 172.21.15.6:0/126673302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd134100290 0x7fd134108120 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 --2- 172.21.15.6:0/126673302 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1341013c0 0x7fd1341017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 --2- 172.21.15.6:0/126673302 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1340ff8f0 0x7fd1340ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 -- 172.21.15.6:0/126673302 >> 172.21.15.6:0/126673302 conn(0x7fd1340fb250 msgr2=0x7fd1340fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:16.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.881+0000 7fd13aa14700 1 -- 172.21.15.6:0/126673302 shutdown_connections 2023-09-13T09:57:16.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.882+0000 7fd13aa14700 1 -- 172.21.15.6:0/126673302 wait complete. 2023-09-13T09:57:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.882+0000 7fd13aa14700 1 Processor -- start 2023-09-13T09:57:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.882+0000 7fd13aa14700 1 -- start start 2023-09-13T09:57:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd13aa14700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1340ff8f0 0x7fd134069900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd13aa14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd134100290 0x7fd13419baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd13aa14700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1341013c0 0x7fd13419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd13aa14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13419e8c0 con 0x7fd134100290 2023-09-13T09:57:16.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd13aa14700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13419ea30 con 0x7fd1340ff8f0 2023-09-13T09:57:16.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd13aa14700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13419ebf0 con 0x7fd1341013c0 2023-09-13T09:57:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd134100290 0x7fd13419baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd134100290 0x7fd13419baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44832/0 (socket says 172.21.15.6:44832) 2023-09-13T09:57:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 -- 172.21.15.6:0/3564840256 learned_addr learned my addr 172.21.15.6:0/3564840256 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd138fb1700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1341013c0 0x7fd13419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 -- 172.21.15.6:0/3564840256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1341013c0 msgr2=0x7fd13419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1341013c0 0x7fd13419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 -- 172.21.15.6:0/3564840256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1340ff8f0 msgr2=0x7fd134069900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1340ff8f0 0x7fd134069900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 -- 172.21.15.6:0/3564840256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009520 con 0x7fd134100290 2023-09-13T09:57:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1337fe700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd134100290 0x7fd13419baa0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fd12800eb30 tx=0x7fd12800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1317fa700 1 -- 172.21.15.6:0/3564840256 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128009880 con 0x7fd134100290 2023-09-13T09:57:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1317fa700 1 -- 172.21.15.6:0/3564840256 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1280044e0 con 0x7fd134100290 2023-09-13T09:57:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd1317fa700 1 -- 172.21.15.6:0/3564840256 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128003e90 con 0x7fd134100290 2023-09-13T09:57:16.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.883+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12c009d00 con 0x7fd134100290 2023-09-13T09:57:16.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.884+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13419f220 con 0x7fd134100290 2023-09-13T09:57:16.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.886+0000 7fd1317fa700 1 -- 172.21.15.6:0/3564840256 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd128004000 con 0x7fd134100290 2023-09-13T09:57:16.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.886+0000 7fd1317fa700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd11c0a0640 0x7fd11c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.886+0000 7fd1317fa700 1 -- 172.21.15.6:0/3564840256 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd128014070 con 0x7fd134100290 2023-09-13T09:57:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.886+0000 7fd133fff700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd11c0a0640 0x7fd11c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd133fff700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd11c0a0640 0x7fd11c0a2b00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd134100d30 tx=0x7fd124006d20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:16.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 Processor -- start 2023-09-13T09:57:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 -- start start 2023-09-13T09:57:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a2f8b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a2f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a2f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a250780 con 0x56193a2f8700 2023-09-13T09:57:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a24e0a0 con 0x56193a2f7a00 2023-09-13T09:57:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.887+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a249990 con 0x56193a2f9060 2023-09-13T09:57:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a2f8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a2f8b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44838/0 (socket says 172.21.15.6:44838) 2023-09-13T09:57:16.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 -- 172.21.15.6:0/192190894 learned_addr learned my addr 172.21.15.6:0/192190894 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd1337fe700 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a2f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 -- 172.21.15.6:0/192190894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 msgr2=0x56193a2f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a2f74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 -- 172.21.15.6:0/192190894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 msgr2=0x56193a2f7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a2f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 -- 172.21.15.6:0/192190894 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56193a0c9630 con 0x56193a2f8700 2023-09-13T09:57:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd133fff700 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a2f8b20 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd124015950 tx=0x7fd124006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9215b20cd4648026 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd11a7fc700 1 -- 172.21.15.6:0/192190894 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12401a070 con 0x56193a2f8700 2023-09-13T09:57:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd11a7fc700 1 -- 172.21.15.6:0/192190894 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd124012950 con 0x56193a2f8700 2023-09-13T09:57:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.888+0000 7fd11a7fc700 1 -- 172.21.15.6:0/192190894 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124013920 con 0x56193a2f8700 2023-09-13T09:57:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 -- 172.21.15.6:0/192190894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 msgr2=0x56193a2f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a2f8b20 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fd124015950 tx=0x7fd124006f90 comp rx=0 tx=0).stop 2023-09-13T09:57:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 -- 172.21.15.6:0/192190894 shutdown_connections 2023-09-13T09:57:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a2f7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a2f8b20 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/192190894 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a2f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 -- 172.21.15.6:0/192190894 >> 172.21.15.6:0/192190894 conn(0x56193a255c80 msgr2=0x56193a2f1f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 -- 172.21.15.6:0/192190894 shutdown_connections 2023-09-13T09:57:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.889+0000 7fd146bf9b80 1 -- 172.21.15.6:0/192190894 wait complete. 2023-09-13T09:57:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.890+0000 7fd146bf9b80 1 -- start start 2023-09-13T09:57:16.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.890+0000 7fd146bf9b80 1 Processor -- start 2023-09-13T09:57:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.890+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a300f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.890+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a301470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.890+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a3084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a1e7bb0 con 0x56193a2f9060 2023-09-13T09:57:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a1e78b0 con 0x56193a2f7a00 2023-09-13T09:57:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a0cb920 con 0x56193a2f8700 2023-09-13T09:57:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd146bf9b80 10 client.0 _ll_register_callbacks cb 0x56193a1e5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a3084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd133fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a300f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a3084b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44848/0 (socket says 172.21.15.6:44848) 2023-09-13T09:57:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 -- 172.21.15.6:0/1777618807 learned_addr learned my addr 172.21.15.6:0/1777618807 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd133fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a300f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38368/0 (socket says 172.21.15.6:38368) 2023-09-13T09:57:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd1337fe700 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a301470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 -- 172.21.15.6:0/1777618807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 msgr2=0x56193a301470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a301470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 -- 172.21.15.6:0/1777618807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 msgr2=0x56193a300f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a300f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 -- 172.21.15.6:0/1777618807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd124015630 con 0x56193a2f9060 2023-09-13T09:57:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd138fb1700 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a3084b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009a20 tx=0x7fd12c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea627aeba561cd21 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.891+0000 7fd1137fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:16.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd1137fe700 1 -- 172.21.15.6:0/1777618807 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00e040 con 0x56193a2f9060 2023-09-13T09:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd1137fe700 1 -- 172.21.15.6:0/1777618807 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd12c003e10 con 0x56193a2f9060 2023-09-13T09:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56193a2ea670 con 0x56193a2f9060 2023-09-13T09:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd1137fe700 1 -- 172.21.15.6:0/1777618807 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd12c0094c0 con 0x56193a2f9060 2023-09-13T09:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 10 client.20067 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:16.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x56193a2617a0 con 0x56193a2f9060 2023-09-13T09:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd1137fe700 1 -- 172.21.15.6:0/1777618807 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56193a2ea670 con 0x56193a2f9060 2023-09-13T09:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd1137fe700 1 -- 172.21.15.6:0/1777618807 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fd12c019030 con 0x56193a2f9060 2023-09-13T09:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 10 client.20067 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 10 client.20067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:16.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 20 client.20067 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a30cc80 0x56193a30f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 4 client.20067 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:16.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.892+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56193a242970 con 0x56193a30cc80 2023-09-13T09:57:16.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.898+0000 7fd133fff700 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a30cc80 0x56193a30f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.899+0000 7fd1137fe700 10 client.20067 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.899+0000 7fd133fff700 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a30cc80 0x56193a30f0a0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb7bab3a7a9964f server_cookie=b30bb993415ce3fc in_seq=0 out_seq=0 2023-09-13T09:57:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd1137fe700 1 -- 172.21.15.6:0/1777618807 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56193a242970 con 0x56193a30cc80 2023-09-13T09:57:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd1137fe700 10 client.20067 handle_command_reply: tid=0 2023-09-13T09:57:16.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 client.20067 shutdown 2023-09-13T09:57:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 msgr2=0x56193a3084b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a3084b0 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fd12c009a20 tx=0x7fd12c00bce0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 shutdown_connections 2023-09-13T09:57:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a30cc80 0x56193a30f0a0 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a3084b0 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a300f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1777618807 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a301470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 >> 172.21.15.6:0/1777618807 conn(0x56193a255c80 msgr2=0x56193a2ec7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.901+0000 7fd1137fe700 0 client.20067 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:16.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.902+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 shutdown_connections 2023-09-13T09:57:16.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.902+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1777618807 wait complete. 2023-09-13T09:57:16.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.902+0000 7fd146bf9b80 20 client.20067 trim_cache size 0 max 16384 2023-09-13T09:57:16.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.928+0000 7fd146bf9b80 1 Processor -- start 2023-09-13T09:57:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd146bf9b80 1 -- start start 2023-09-13T09:57:16.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a2f74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a308da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a300f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a2ee8e0 con 0x56193a2f9060 2023-09-13T09:57:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a308860 con 0x56193a2f7a00 2023-09-13T09:57:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a2feb60 con 0x56193a2f8700 2023-09-13T09:57:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a308da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a308da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47910/0 (socket says 172.21.15.6:47910) 2023-09-13T09:57:16.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd1337fe700 1 -- 172.21.15.6:0/1246219977 learned_addr learned my addr 172.21.15.6:0/1246219977 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.929+0000 7fd138fb1700 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a300f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd138fb1700 1 -- 172.21.15.6:0/1246219977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 msgr2=0x56193a308da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd138fb1700 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a308da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd138fb1700 1 -- 172.21.15.6:0/1246219977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 msgr2=0x56193a2f74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd138fb1700 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a2f74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd138fb1700 1 -- 172.21.15.6:0/1246219977 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56193a075de0 con 0x56193a2f9060 2023-09-13T09:57:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd1337fe700 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a308da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd138fb1700 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a300f30 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007a60 tx=0x7fd12c009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffd934461ac0523 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd11affd700 1 -- 172.21.15.6:0/1246219977 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00e040 con 0x56193a2f9060 2023-09-13T09:57:16.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd11affd700 1 -- 172.21.15.6:0/1246219977 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd12c006160 con 0x56193a2f9060 2023-09-13T09:57:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.930+0000 7fd11affd700 1 -- 172.21.15.6:0/1246219977 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c01c7c0 con 0x56193a2f9060 2023-09-13T09:57:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1246219977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 msgr2=0x56193a300f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a300f30 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7fd12c007a60 tx=0x7fd12c009800 comp rx=0 tx=0).stop 2023-09-13T09:57:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1246219977 shutdown_connections 2023-09-13T09:57:16.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f9060 0x56193a300f30 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a2f74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/1246219977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f8700 0x56193a308da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1246219977 >> 172.21.15.6:0/1246219977 conn(0x56193a255c80 msgr2=0x56193a2ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1246219977 shutdown_connections 2023-09-13T09:57:16.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.931+0000 7fd146bf9b80 1 -- 172.21.15.6:0/1246219977 wait complete. 2023-09-13T09:57:16.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 -- start start 2023-09-13T09:57:16.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 Processor -- start 2023-09-13T09:57:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a307d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a308240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a3047e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a304ef0 con 0x56193a2f8700 2023-09-13T09:57:16.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a305060 con 0x56193a2f7a00 2023-09-13T09:57:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56193a305220 con 0x56193a2f9060 2023-09-13T09:57:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd146bf9b80 10 client.0 _ll_register_callbacks cb 0x56193a1e5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a308240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd1337fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a308240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44858/0 (socket says 172.21.15.6:44858) 2023-09-13T09:57:16.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.932+0000 7fd1337fe700 1 -- 172.21.15.6:0/2767274468 learned_addr learned my addr 172.21.15.6:0/2767274468 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd138fb1700 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a3047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1337fe700 1 -- 172.21.15.6:0/2767274468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 msgr2=0x56193a3047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1337fe700 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a3047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1337fe700 1 -- 172.21.15.6:0/2767274468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 msgr2=0x56193a307d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:16.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1337fe700 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a307d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1337fe700 1 -- 172.21.15.6:0/2767274468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13419f220 con 0x56193a2f8700 2023-09-13T09:57:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1337fe700 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a308240 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fd12800eb00 tx=0x7fd128095480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bf81c3e8c33707 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1137fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1137fe700 1 -- 172.21.15.6:0/2767274468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12809d5e0 con 0x56193a2f8700 2023-09-13T09:57:16.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1137fe700 1 -- 172.21.15.6:0/2767274468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1280a1820 con 0x56193a2f8700 2023-09-13T09:57:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd124012950 con 0x56193a2f8700 2023-09-13T09:57:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.933+0000 7fd1137fe700 1 -- 172.21.15.6:0/2767274468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd128097b50 con 0x56193a2f8700 2023-09-13T09:57:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 10 client.20073 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x56193a2617a0 con 0x56193a2f8700 2023-09-13T09:57:16.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd1137fe700 1 -- 172.21.15.6:0/2767274468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd12807c080 con 0x56193a2f8700 2023-09-13T09:57:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd1137fe700 1 -- 172.21.15.6:0/2767274468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fd1280b7020 con 0x56193a2f8700 2023-09-13T09:57:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 10 client.20073 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 10 client.20073 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 20 client.20073 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:16.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a35e320 0x56193a360740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 4 client.20073 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:57:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.934+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56193a203050 con 0x56193a35e320 2023-09-13T09:57:16.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.939+0000 7fd133fff700 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a35e320 0x56193a360740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.942+0000 7fd1137fe700 10 client.20073 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.942+0000 7fd133fff700 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a35e320 0x56193a360740 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c8c9dd6156b76fa server_cookie=e838532172d5ec85 in_seq=0 out_seq=0 2023-09-13T09:57:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd1137fe700 1 -- 172.21.15.6:0/2767274468 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56193a203050 con 0x56193a35e320 2023-09-13T09:57:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd1137fe700 10 client.20073 handle_command_reply: tid=0 2023-09-13T09:57:16.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 client.20073 shutdown 2023-09-13T09:57:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 msgr2=0x56193a308240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a308240 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7fd12800eb00 tx=0x7fd128095480 comp rx=0 tx=0).stop 2023-09-13T09:57:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 shutdown_connections 2023-09-13T09:57:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56193a2f9060 0x56193a3047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56193a2f7a00 0x56193a307d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56193a35e320 0x56193a360740 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 --2- 172.21.15.6:0/2767274468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56193a2f8700 0x56193a308240 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd1137fe700 0 client.20073 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 >> 172.21.15.6:0/2767274468 conn(0x56193a255c80 msgr2=0x56193a2fb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:16.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 shutdown_connections 2023-09-13T09:57:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 1 -- 172.21.15.6:0/2767274468 wait complete. 2023-09-13T09:57:16.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.945+0000 7fd146bf9b80 20 client.20073 trim_cache size 0 max 16384 2023-09-13T09:57:16.951 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:57:16.951 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:57:16.952 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:57:16.952 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:57:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd11c0a0640 msgr2=0x7fd11c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd11c0a0640 0x7fd11c0a2b00 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd134100d30 tx=0x7fd124006d20 comp rx=0 tx=0).stop 2023-09-13T09:57:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd134100290 msgr2=0x7fd13419baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:16.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd134100290 0x7fd13419baa0 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7fd12800eb30 tx=0x7fd12800ee40 comp rx=0 tx=0).stop 2023-09-13T09:57:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 shutdown_connections 2023-09-13T09:57:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1341013c0 0x7fd13419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1340ff8f0 0x7fd134069900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd11c0a0640 0x7fd11c0a2b00 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 --2- 172.21.15.6:0/3564840256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd134100290 0x7fd13419baa0 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 >> 172.21.15.6:0/3564840256 conn(0x7fd1340fb250 msgr2=0x7fd1340fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 shutdown_connections 2023-09-13T09:57:16.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:16.946+0000 7fd13aa14700 1 -- 172.21.15.6:0/3564840256 wait complete. 2023-09-13T09:57:16.966 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:57:16.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:57:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.145+0000 7f9b222e0700 1 -- 172.21.15.6:0/2520528056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c100eb0 msgr2=0x7f9b1c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.145+0000 7f9b222e0700 1 --2- 172.21.15.6:0/2520528056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c101310 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f9b100099c0 tx=0x7f9b10009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.145+0000 7f9b222e0700 1 -- 172.21.15.6:0/2520528056 shutdown_connections 2023-09-13T09:57:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.145+0000 7f9b222e0700 1 --2- 172.21.15.6:0/2520528056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c101850 0x7f9b1c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.145+0000 7f9b222e0700 1 --2- 172.21.15.6:0/2520528056 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c0ffcc0 0x7f9b1c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.145+0000 7f9b222e0700 1 --2- 172.21.15.6:0/2520528056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c101310 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.145+0000 7f9b222e0700 1 -- 172.21.15.6:0/2520528056 >> 172.21.15.6:0/2520528056 conn(0x7f9b1c0fb210 msgr2=0x7f9b1c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.147+0000 7f9b222e0700 1 -- 172.21.15.6:0/2520528056 shutdown_connections 2023-09-13T09:57:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.148+0000 7f9b222e0700 1 -- 172.21.15.6:0/2520528056 wait complete. 2023-09-13T09:57:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.149+0000 7f9b222e0700 1 Processor -- start 2023-09-13T09:57:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.149+0000 7f9b222e0700 1 -- start start 2023-09-13T09:57:17.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b222e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c0ffcc0 0x7f9b1c06a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b222e0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c06ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b222e0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c101850 0x7f9b1c071b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b222e0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c072120 con 0x7f9b1c0ffcc0 2023-09-13T09:57:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b222e0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c072290 con 0x7f9b1c100eb0 2023-09-13T09:57:17.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b222e0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c072450 con 0x7f9b1c101850 2023-09-13T09:57:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b2087d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c101850 0x7f9b1c071b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c06ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b2087d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c101850 0x7f9b1c071b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47926/0 (socket says 172.21.15.6:47926) 2023-09-13T09:57:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b1b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c06ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38398/0 (socket says 172.21.15.6:38398) 2023-09-13T09:57:17.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b2087d700 1 -- 172.21.15.6:0/691208029 learned_addr learned my addr 172.21.15.6:0/691208029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.150+0000 7f9b1bfff700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c0ffcc0 0x7f9b1c06a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.151+0000 7f9b1b7fe700 1 -- 172.21.15.6:0/691208029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c101850 msgr2=0x7f9b1c071b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.151+0000 7f9b1b7fe700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c101850 0x7f9b1c071b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.151+0000 7f9b1b7fe700 1 -- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c0ffcc0 msgr2=0x7f9b1c06a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.151+0000 7f9b1b7fe700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c0ffcc0 0x7f9b1c06a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.151+0000 7f9b1b7fe700 1 -- 172.21.15.6:0/691208029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b100095f0 con 0x7f9b1c100eb0 2023-09-13T09:57:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.151+0000 7f9b1b7fe700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c06ae30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9b100098e0 tx=0x7f9b10003ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.153+0000 7f9b197fa700 1 -- 172.21.15.6:0/691208029 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1001d070 con 0x7f9b1c100eb0 2023-09-13T09:57:17.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.153+0000 7f9b197fa700 1 -- 172.21.15.6:0/691208029 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9b100054f0 con 0x7f9b1c100eb0 2023-09-13T09:57:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.153+0000 7f9b197fa700 1 -- 172.21.15.6:0/691208029 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b10004ca0 con 0x7f9b1c100eb0 2023-09-13T09:57:17.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.156+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c072670 con 0x7f9b1c100eb0 2023-09-13T09:57:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.156+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c072aa0 con 0x7f9b1c100eb0 2023-09-13T09:57:17.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.157+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c072c90 con 0x7f9b1c100eb0 2023-09-13T09:57:17.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.163+0000 7f9b197fa700 1 -- 172.21.15.6:0/691208029 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9b100042e0 con 0x7f9b1c100eb0 2023-09-13T09:57:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.164+0000 7f9b197fa700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b040a0670 0x7f9b040a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.164+0000 7f9b1bfff700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b040a0670 0x7f9b040a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.164+0000 7f9b197fa700 1 -- 172.21.15.6:0/691208029 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9b100ccbf0 con 0x7f9b1c100eb0 2023-09-13T09:57:17.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.164+0000 7f9b1bfff700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b040a0670 0x7f9b040a2b30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c100d10 tx=0x7f9b0c009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.170+0000 7f9b197fa700 1 -- 172.21.15.6:0/691208029 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f9b10096760 con 0x7f9b1c100eb0 2023-09-13T09:57:17.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.475+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9b1c10f740 con 0x7f9b1c100eb0 2023-09-13T09:57:17.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.476+0000 7f9b197fa700 1 -- 172.21.15.6:0/691208029 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+11337 (secure 0 0 0) 0x7f9b10099d80 con 0x7f9b1c100eb0 2023-09-13T09:57:17.477 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:57:17.477 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":63,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":63,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:56:57.566879+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:57:17.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b040a0670 msgr2=0x7f9b040a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b040a0670 0x7f9b040a2b30 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c100d10 tx=0x7f9b0c009190 comp rx=0 tx=0).stop 2023-09-13T09:57:17.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c100eb0 msgr2=0x7f9b1c06ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c06ae30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f9b100098e0 tx=0x7f9b10003ee0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 shutdown_connections 2023-09-13T09:57:17.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b1c101850 0x7f9b1c071b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9b040a0670 0x7f9b040a2b30 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b1c0ffcc0 0x7f9b1c06a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 --2- 172.21.15.6:0/691208029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9b1c100eb0 0x7f9b1c06ae30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.478+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 >> 172.21.15.6:0/691208029 conn(0x7f9b1c0fb210 msgr2=0x7f9b1c0fd300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.479+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 shutdown_connections 2023-09-13T09:57:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.479+0000 7f9b222e0700 1 -- 172.21.15.6:0/691208029 wait complete. 2023-09-13T09:57:17.483 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 63 2023-09-13T09:57:17.495 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:57:17.573 INFO:tasks.workunit.client.0.smithi006.stdout: 10 195441 37.28 MB/sec execute 157 sec latency 135.787 ms 2023-09-13T09:57:17.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 -- 172.21.15.6:0/2877882750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab740ffcc0 msgr2=0x7fab741000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2877882750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab740ffcc0 0x7fab741000e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fab68009920 tx=0x7fab68009c30 comp rx=0 tx=0).stop 2023-09-13T09:57:17.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 -- 172.21.15.6:0/2877882750 shutdown_connections 2023-09-13T09:57:17.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2877882750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab74101850 0x7fab74108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2877882750 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab740ffcc0 0x7fab741000e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2877882750 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 0x7fab74101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 -- 172.21.15.6:0/2877882750 >> 172.21.15.6:0/2877882750 conn(0x7fab740fb250 msgr2=0x7fab740fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 -- 172.21.15.6:0/2877882750 shutdown_connections 2023-09-13T09:57:17.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.655+0000 7fab7b02e700 1 -- 172.21.15.6:0/2877882750 wait complete. 2023-09-13T09:57:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 Processor -- start 2023-09-13T09:57:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 -- start start 2023-09-13T09:57:17.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab740ffcc0 0x7fab74068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 0x7fab74199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74101850 0x7fab74199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7419a460 con 0x7fab740ffcc0 2023-09-13T09:57:17.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7419a5d0 con 0x7fab74101850 2023-09-13T09:57:17.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab7b02e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab7419a790 con 0x7fab74100eb0 2023-09-13T09:57:17.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab73fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 0x7fab74199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab73fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 0x7fab74199640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47938/0 (socket says 172.21.15.6:47938) 2023-09-13T09:57:17.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab73fff700 1 -- 172.21.15.6:0/2666358046 learned_addr learned my addr 172.21.15.6:0/2666358046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab78dca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab740ffcc0 0x7fab74068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.656+0000 7fab795cb700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74101850 0x7fab74199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab73fff700 1 -- 172.21.15.6:0/2666358046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74101850 msgr2=0x7fab74199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab73fff700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74101850 0x7fab74199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab73fff700 1 -- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab740ffcc0 msgr2=0x7fab74068b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab73fff700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab740ffcc0 0x7fab74068b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab73fff700 1 -- 172.21.15.6:0/2666358046 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab60009520 con 0x7fab74100eb0 2023-09-13T09:57:17.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab78dca700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab740ffcc0 0x7fab74068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab73fff700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 0x7fab74199640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab6000eb30 tx=0x7fab6000ee40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab71ffb700 1 -- 172.21.15.6:0/2666358046 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60009880 con 0x7fab74100eb0 2023-09-13T09:57:17.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab68009520 con 0x7fab74100eb0 2023-09-13T09:57:17.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab71ffb700 1 -- 172.21.15.6:0/2666358046 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab600044e0 con 0x7fab74100eb0 2023-09-13T09:57:17.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab71ffb700 1 -- 172.21.15.6:0/2666358046 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab60003d80 con 0x7fab74100eb0 2023-09-13T09:57:17.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.657+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7419ae40 con 0x7fab74100eb0 2023-09-13T09:57:17.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.660+0000 7fab71ffb700 1 -- 172.21.15.6:0/2666358046 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fab60004000 con 0x7fab74100eb0 2023-09-13T09:57:17.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.661+0000 7fab71ffb700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab640a06c0 0x7fab640a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.661+0000 7fab71ffb700 1 -- 172.21.15.6:0/2666358046 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fab60014070 con 0x7fab74100eb0 2023-09-13T09:57:17.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.661+0000 7fab78dca700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab640a06c0 0x7fab640a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab78dca700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab640a06c0 0x7fab640a2b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fab680098f0 tx=0x7fab68019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 Processor -- start 2023-09-13T09:57:17.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 -- start start 2023-09-13T09:57:17.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f919700 0x55ba8f919b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f91a060 0x55ba8f9184c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f918a00 0x55ba8f918e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f871780 con 0x55ba8f91a060 2023-09-13T09:57:17.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f86f0a0 con 0x55ba8f919700 2023-09-13T09:57:17.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.662+0000 7fab87213b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f86a990 con 0x55ba8f918a00 2023-09-13T09:57:17.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab795cb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f918a00 0x55ba8f918e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab795cb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f918a00 0x55ba8f918e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47946/0 (socket says 172.21.15.6:47946) 2023-09-13T09:57:17.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab795cb700 1 -- 172.21.15.6:0/2504835142 learned_addr learned my addr 172.21.15.6:0/2504835142 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab73fff700 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f91a060 0x55ba8f9184c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab73fff700 1 -- 172.21.15.6:0/2504835142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f918a00 msgr2=0x55ba8f918e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab73fff700 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f918a00 0x55ba8f918e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab73fff700 1 -- 172.21.15.6:0/2504835142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f919700 msgr2=0x55ba8f919b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.663+0000 7fab73fff700 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f919700 0x55ba8f919b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.664+0000 7fab73fff700 1 -- 172.21.15.6:0/2504835142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba8f6ea630 con 0x55ba8f91a060 2023-09-13T09:57:17.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.664+0000 7fab73fff700 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f91a060 0x55ba8f9184c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fab600c9c30 tx=0x7fab60095d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0972c0f07760fb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.664+0000 7fab5effd700 1 -- 172.21.15.6:0/2504835142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab600b9070 con 0x55ba8f91a060 2023-09-13T09:57:17.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.664+0000 7fab5effd700 1 -- 172.21.15.6:0/2504835142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab6009a020 con 0x55ba8f91a060 2023-09-13T09:57:17.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.664+0000 7fab5effd700 1 -- 172.21.15.6:0/2504835142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab600c9d40 con 0x55ba8f91a060 2023-09-13T09:57:17.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 -- 172.21.15.6:0/2504835142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f91a060 msgr2=0x55ba8f9184c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f91a060 0x55ba8f9184c0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fab600c9c30 tx=0x7fab60095d90 comp rx=0 tx=0).stop 2023-09-13T09:57:17.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 -- 172.21.15.6:0/2504835142 shutdown_connections 2023-09-13T09:57:17.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f918a00 0x55ba8f918e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f919700 0x55ba8f919b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 --2- 172.21.15.6:0/2504835142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f91a060 0x55ba8f9184c0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 -- 172.21.15.6:0/2504835142 >> 172.21.15.6:0/2504835142 conn(0x55ba8f876c80 msgr2=0x55ba8f912f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 -- 172.21.15.6:0/2504835142 shutdown_connections 2023-09-13T09:57:17.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.665+0000 7fab87213b80 1 -- 172.21.15.6:0/2504835142 wait complete. 2023-09-13T09:57:17.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 -- start start 2023-09-13T09:57:17.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 Processor -- start 2023-09-13T09:57:17.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f921f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f922450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f929870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f808bb0 con 0x55ba8f927480 2023-09-13T09:57:17.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f8088b0 con 0x55ba8f918a00 2023-09-13T09:57:17.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f6ec920 con 0x55ba8f91a060 2023-09-13T09:57:17.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab87213b80 10 client.0 _ll_register_callbacks cb 0x55ba8f806680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:17.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab795cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f929870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab795cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f929870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44900/0 (socket says 172.21.15.6:44900) 2023-09-13T09:57:17.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab73fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f922450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.666+0000 7fab795cb700 1 -- 172.21.15.6:0/2110374858 learned_addr learned my addr 172.21.15.6:0/2110374858 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab78dca700 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f921f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab795cb700 1 -- 172.21.15.6:0/2110374858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 msgr2=0x55ba8f922450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab795cb700 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f922450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab795cb700 1 -- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 msgr2=0x55ba8f921f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab795cb700 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f921f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab795cb700 1 -- 172.21.15.6:0/2110374858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab7419ae40 con 0x55ba8f927480 2023-09-13T09:57:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab73fff700 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f922450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab795cb700 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f929870 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007ba0 tx=0x7fab6c007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de6a2dcda0251c2e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab53fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab53fff700 1 -- 172.21.15.6:0/2110374858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6c00e040 con 0x55ba8f927480 2023-09-13T09:57:17.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.667+0000 7fab53fff700 1 -- 172.21.15.6:0/2110374858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fab6c003c00 con 0x55ba8f927480 2023-09-13T09:57:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ba8f90b670 con 0x55ba8f927480 2023-09-13T09:57:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab53fff700 1 -- 172.21.15.6:0/2110374858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab6c003dc0 con 0x55ba8f927480 2023-09-13T09:57:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 10 client.20091 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55ba8f8827a0 con 0x55ba8f927480 2023-09-13T09:57:17.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab53fff700 1 -- 172.21.15.6:0/2110374858 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ba8f90b670 con 0x55ba8f927480 2023-09-13T09:57:17.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab53fff700 1 -- 172.21.15.6:0/2110374858 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fab6c0044f0 con 0x55ba8f927480 2023-09-13T09:57:17.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 10 client.20091 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:17.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 10 client.20091 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:57:17.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 20 client.20091 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:17.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f930620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 4 client.20091 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:17.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.668+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ba8f863970 con 0x55ba8f92e200 2023-09-13T09:57:17.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.670+0000 7fab78dca700 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f930620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.670+0000 7fab53fff700 10 client.20091 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.670+0000 7fab78dca700 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f930620 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7fc716f3d04d49d8 server_cookie=7c3d141b2af3aa22 in_seq=0 out_seq=0 2023-09-13T09:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab53fff700 1 -- 172.21.15.6:0/2110374858 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ba8f863970 con 0x55ba8f92e200 2023-09-13T09:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab53fff700 10 client.20091 handle_command_reply: tid=0 2023-09-13T09:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 client.20091 shutdown 2023-09-13T09:57:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 msgr2=0x55ba8f929870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f929870 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fab6c007ba0 tx=0x7fab6c007bd0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 shutdown_connections 2023-09-13T09:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f930620 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f929870 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab53fff700 0 client.20091 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f921f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 --2- 172.21.15.6:0/2110374858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f922450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.671+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 >> 172.21.15.6:0/2110374858 conn(0x55ba8f876c80 msgr2=0x55ba8f90d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.672+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 shutdown_connections 2023-09-13T09:57:17.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.672+0000 7fab87213b80 1 -- 172.21.15.6:0/2110374858 wait complete. 2023-09-13T09:57:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.672+0000 7fab87213b80 20 client.20091 trim_cache size 0 max 16384 2023-09-13T09:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.690+0000 7fab87213b80 1 Processor -- start 2023-09-13T09:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.690+0000 7fab87213b80 1 -- start start 2023-09-13T09:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.690+0000 7fab87213b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f9184c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.690+0000 7fab87213b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f919ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab87213b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f93de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab87213b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f929c30 con 0x55ba8f927480 2023-09-13T09:57:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab87213b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f9213c0 con 0x55ba8f918a00 2023-09-13T09:57:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab87213b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f90b680 con 0x55ba8f91a060 2023-09-13T09:57:17.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab795cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f93de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f9184c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f9184c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38430/0 (socket says 172.21.15.6:38430) 2023-09-13T09:57:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 -- 172.21.15.6:0/2715646681 learned_addr learned my addr 172.21.15.6:0/2715646681 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab795cb700 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f93de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44908/0 (socket says 172.21.15.6:44908) 2023-09-13T09:57:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab73fff700 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f919ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 -- 172.21.15.6:0/2715646681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 msgr2=0x55ba8f919ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f919ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 -- 172.21.15.6:0/2715646681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 msgr2=0x55ba8f93de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f93de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 -- 172.21.15.6:0/2715646681 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ba8f696de0 con 0x55ba8f918a00 2023-09-13T09:57:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab795cb700 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f93de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.691+0000 7fab78dca700 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f9184c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab74100d10 tx=0x7fab6801f000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78d93e5299b1ff8d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.692+0000 7fab5f7fe700 1 -- 172.21.15.6:0/2715646681 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab6800bb60 con 0x55ba8f918a00 2023-09-13T09:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.692+0000 7fab5f7fe700 1 -- 172.21.15.6:0/2715646681 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab6801d040 con 0x55ba8f918a00 2023-09-13T09:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.692+0000 7fab5f7fe700 1 -- 172.21.15.6:0/2715646681 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab680053c0 con 0x55ba8f918a00 2023-09-13T09:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 -- 172.21.15.6:0/2715646681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 msgr2=0x55ba8f9184c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f9184c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fab74100d10 tx=0x7fab6801f000 comp rx=0 tx=0).stop 2023-09-13T09:57:17.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 -- 172.21.15.6:0/2715646681 shutdown_connections 2023-09-13T09:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f927480 0x55ba8f93de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f918a00 0x55ba8f9184c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 --2- 172.21.15.6:0/2715646681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f91a060 0x55ba8f919ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 -- 172.21.15.6:0/2715646681 >> 172.21.15.6:0/2715646681 conn(0x55ba8f876c80 msgr2=0x55ba8f912e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 -- 172.21.15.6:0/2715646681 shutdown_connections 2023-09-13T09:57:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 -- 172.21.15.6:0/2715646681 wait complete. 2023-09-13T09:57:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 -- start start 2023-09-13T09:57:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.693+0000 7fab87213b80 1 Processor -- start 2023-09-13T09:57:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab87213b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f918a00 0x55ba8f93af30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab87213b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f91a060 0x55ba8f93b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab87213b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f927480 0x55ba8f980750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab87213b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f980c90 con 0x55ba8f918a00 2023-09-13T09:57:17.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab87213b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f980dd0 con 0x55ba8f91a060 2023-09-13T09:57:17.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab87213b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ba8f980f10 con 0x55ba8f927480 2023-09-13T09:57:17.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab87213b80 10 client.0 _ll_register_callbacks cb 0x55ba8f806680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:17.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f918a00 0x55ba8f93af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab73fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f91a060 0x55ba8f93b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab73fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f91a060 0x55ba8f93b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38438/0 (socket says 172.21.15.6:38438) 2023-09-13T09:57:17.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f918a00 0x55ba8f93af30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44912/0 (socket says 172.21.15.6:44912) 2023-09-13T09:57:17.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab73fff700 1 -- 172.21.15.6:0/210585803 learned_addr learned my addr 172.21.15.6:0/210585803 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab795cb700 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f927480 0x55ba8f980750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 -- 172.21.15.6:0/210585803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f927480 msgr2=0x55ba8f980750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f927480 0x55ba8f980750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 -- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f91a060 msgr2=0x55ba8f93b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f91a060 0x55ba8f93b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 -- 172.21.15.6:0/210585803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ba8f8827a0 con 0x55ba8f918a00 2023-09-13T09:57:17.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab73fff700 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f91a060 0x55ba8f93b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab78dca700 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f918a00 0x55ba8f93af30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c010 tx=0x7fab680344f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60b9e5e916645bd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.694+0000 7fab53fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:17.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab53fff700 1 -- 172.21.15.6:0/210585803 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab68034d20 con 0x55ba8f918a00 2023-09-13T09:57:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab53fff700 1 -- 172.21.15.6:0/210585803 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fab6800bba0 con 0x55ba8f918a00 2023-09-13T09:57:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab6009a020 con 0x55ba8f918a00 2023-09-13T09:57:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab53fff700 1 -- 172.21.15.6:0/210585803 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab68034e80 con 0x55ba8f918a00 2023-09-13T09:57:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 10 client.20097 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:17.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x7fab74108a50 con 0x55ba8f918a00 2023-09-13T09:57:17.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab53fff700 1 -- 172.21.15.6:0/210585803 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fab6804e080 con 0x55ba8f918a00 2023-09-13T09:57:17.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab53fff700 1 -- 172.21.15.6:0/210585803 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fab68003b10 con 0x55ba8f918a00 2023-09-13T09:57:17.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 10 client.20097 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:17.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 10 client.20097 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:57:17.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 20 client.20097 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f984480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 4 client.20097 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.695+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ba8f824050 con 0x55ba8f92e200 2023-09-13T09:57:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.696+0000 7fab73fff700 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f984480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.696+0000 7fab53fff700 10 client.20097 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:17.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.696+0000 7fab73fff700 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f984480 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a0aa225280c0d557 server_cookie=589c4b9a17df0a01 in_seq=0 out_seq=0 2023-09-13T09:57:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab53fff700 1 -- 172.21.15.6:0/210585803 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ba8f824050 con 0x55ba8f92e200 2023-09-13T09:57:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab53fff700 10 client.20097 handle_command_reply: tid=0 2023-09-13T09:57:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 client.20097 shutdown 2023-09-13T09:57:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f918a00 msgr2=0x55ba8f93af30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f918a00 0x55ba8f93af30 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7fab6800c010 tx=0x7fab680344f0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 shutdown_connections 2023-09-13T09:57:17.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ba8f92e200 0x55ba8f984480 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ba8f927480 0x55ba8f980750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ba8f918a00 0x55ba8f93af30 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab53fff700 0 client.20097 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:17.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 --2- 172.21.15.6:0/210585803 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ba8f91a060 0x55ba8f93b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 >> 172.21.15.6:0/210585803 conn(0x55ba8f876c80 msgr2=0x55ba8f920b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 shutdown_connections 2023-09-13T09:57:17.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 1 -- 172.21.15.6:0/210585803 wait complete. 2023-09-13T09:57:17.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.697+0000 7fab87213b80 20 client.20097 trim_cache size 0 max 16384 2023-09-13T09:57:17.713 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab640a06c0 msgr2=0x7fab640a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab640a06c0 0x7fab640a2b80 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fab680098f0 tx=0x7fab68019040 comp rx=0 tx=0).stop 2023-09-13T09:57:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 msgr2=0x7fab74199640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 0x7fab74199640 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fab6000eb30 tx=0x7fab6000ee40 comp rx=0 tx=0).stop 2023-09-13T09:57:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 shutdown_connections 2023-09-13T09:57:17.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fab74101850 0x7fab74199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fab640a06c0 0x7fab640a2b80 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab740ffcc0 0x7fab74068b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 --2- 172.21.15.6:0/2666358046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab74100eb0 0x7fab74199640 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 >> 172.21.15.6:0/2666358046 conn(0x7fab740fb250 msgr2=0x7fab740fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 shutdown_connections 2023-09-13T09:57:17.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.698+0000 7fab7b02e700 1 -- 172.21.15.6:0/2666358046 wait complete. 2023-09-13T09:57:17.717 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:57:17.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/396621606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb81012d0 msgr2=0x7f6eb81016f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/396621606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb81012d0 0x7f6eb81016f0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009990 tx=0x7f6ea8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/396621606 shutdown_connections 2023-09-13T09:57:17.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/396621606 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb81008e0 0x7f6eb8108180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/396621606 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb81012d0 0x7f6eb81016f0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/396621606 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb80fff20 0x7f6eb81003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/396621606 >> 172.21.15.6:0/396621606 conn(0x7f6eb80fa9b0 msgr2=0x7f6eb80fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/396621606 shutdown_connections 2023-09-13T09:57:17.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/396621606 wait complete. 2023-09-13T09:57:17.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.879+0000 7f6ebe7c3700 1 Processor -- start 2023-09-13T09:57:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebe7c3700 1 -- start start 2023-09-13T09:57:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebe7c3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb80fff20 0x7f6eb810fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebe7c3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb81008e0 0x7f6eb81100d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebe7c3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb81012d0 0x7f6eb8117140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebe7c3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8117710 con 0x7f6eb80fff20 2023-09-13T09:57:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebe7c3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8117880 con 0x7f6eb81012d0 2023-09-13T09:57:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebe7c3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6eb8117a40 con 0x7f6eb81008e0 2023-09-13T09:57:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb80fff20 0x7f6eb810fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb81008e0 0x7f6eb81100d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebcd60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb81012d0 0x7f6eb8117140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb80fff20 0x7f6eb810fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44926/0 (socket says 172.21.15.6:44926) 2023-09-13T09:57:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb81008e0 0x7f6eb81100d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47984/0 (socket says 172.21.15.6:47984) 2023-09-13T09:57:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6ebcd60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb81012d0 0x7f6eb8117140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38452/0 (socket says 172.21.15.6:38452) 2023-09-13T09:57:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6eb7fff700 1 -- 172.21.15.6:0/3415988559 learned_addr learned my addr 172.21.15.6:0/3415988559 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6eb7fff700 1 -- 172.21.15.6:0/3415988559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb81008e0 msgr2=0x7f6eb81100d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.880+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb81008e0 0x7f6eb81100d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb7fff700 1 -- 172.21.15.6:0/3415988559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb81012d0 msgr2=0x7f6eb8117140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb81012d0 0x7f6eb8117140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb7fff700 1 -- 172.21.15.6:0/3415988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea80095f0 con 0x7f6eb80fff20 2023-09-13T09:57:17.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb81008e0 0x7f6eb81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb80fff20 0x7f6eb810fb90 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8004710 tx=0x7f6ea8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb57fa700 1 -- 172.21.15.6:0/3415988559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea8061070 con 0x7f6eb80fff20 2023-09-13T09:57:17.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eb8117c60 con 0x7f6eb80fff20 2023-09-13T09:57:17.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb57fa700 1 -- 172.21.15.6:0/3415988559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6ea8065410 con 0x7f6eb80fff20 2023-09-13T09:57:17.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6eb57fa700 1 -- 172.21.15.6:0/3415988559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea805b660 con 0x7f6eb80fff20 2023-09-13T09:57:17.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.881+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eb8118160 con 0x7f6eb80fff20 2023-09-13T09:57:17.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.884+0000 7f6eb57fa700 1 -- 172.21.15.6:0/3415988559 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6ea8065580 con 0x7f6eb80fff20 2023-09-13T09:57:17.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.884+0000 7f6eb57fa700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6ea00a0640 0x7f6ea00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.884+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6ea00a0640 0x7f6ea00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.885+0000 7f6eb57fa700 1 -- 172.21.15.6:0/3415988559 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6ea8111000 con 0x7f6eb80fff20 2023-09-13T09:57:17.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.885+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6ea00a0640 0x7f6ea00a2b00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6eac011490 tx=0x7f6eac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.885+0000 7f6eca9a8b80 1 Processor -- start 2023-09-13T09:57:17.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.885+0000 7f6eca9a8b80 1 -- start start 2023-09-13T09:57:17.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee6eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee6d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56edc6780 con 0x55f56ee6f060 2023-09-13T09:57:17.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56edc40a0 con 0x55f56ee6e700 2023-09-13T09:57:17.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56edbf990 con 0x55f56ee6da00 2023-09-13T09:57:17.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee6d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee6d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44936/0 (socket says 172.21.15.6:44936) 2023-09-13T09:57:17.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee6eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 -- 172.21.15.6:0/2060377272 learned_addr learned my addr 172.21.15.6:0/2060377272 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6ebcd60700 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 -- 172.21.15.6:0/2060377272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 msgr2=0x55f56ee6de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 -- 172.21.15.6:0/2060377272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 msgr2=0x55f56ee6eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee6eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 -- 172.21.15.6:0/2060377272 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56ec3f630 con 0x55f56ee6f060 2023-09-13T09:57:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6ebcd60700 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee6eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.886+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee6d4c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0043c0 tx=0x7f6eac014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11b6f5d7beb0ec43 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6e9e7fc700 1 -- 172.21.15.6:0/2060377272 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac003d10 con 0x55f56ee6f060 2023-09-13T09:57:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6e9e7fc700 1 -- 172.21.15.6:0/2060377272 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6eac003e70 con 0x55f56ee6f060 2023-09-13T09:57:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6e9e7fc700 1 -- 172.21.15.6:0/2060377272 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00e7d0 con 0x55f56ee6f060 2023-09-13T09:57:17.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2060377272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 msgr2=0x55f56ee6d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee6d4c0 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f6eac0043c0 tx=0x7f6eac014000 comp rx=0 tx=0).stop 2023-09-13T09:57:17.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2060377272 shutdown_connections 2023-09-13T09:57:17.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee6eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2060377272 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee6d4c0 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2060377272 >> 172.21.15.6:0/2060377272 conn(0x55f56edcbc80 msgr2=0x55f56ee67f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2060377272 shutdown_connections 2023-09-13T09:57:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.887+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2060377272 wait complete. 2023-09-13T09:57:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 -- start start 2023-09-13T09:57:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 Processor -- start 2023-09-13T09:57:17.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee76f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee7e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ed5dbb0 con 0x55f56ee6f060 2023-09-13T09:57:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ed5d8b0 con 0x55f56ee6e700 2023-09-13T09:57:17.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ec41920 con 0x55f56ee6da00 2023-09-13T09:57:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.888+0000 7f6eca9a8b80 10 client.0 _ll_register_callbacks cb 0x55f56ed5b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee76f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee76f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:47994/0 (socket says 172.21.15.6:47994) 2023-09-13T09:57:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 -- 172.21.15.6:0/2219763946 learned_addr learned my addr 172.21.15.6:0/2219763946 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6ebcd60700 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee7e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 -- 172.21.15.6:0/2219763946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 msgr2=0x55f56ee774d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee774d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 -- 172.21.15.6:0/2219763946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 msgr2=0x55f56ee7e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee7e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 -- 172.21.15.6:0/2219763946 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6eac017070 con 0x55f56ee6da00 2023-09-13T09:57:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee76f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80de530 tx=0x7f6ea8065b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce3044774d005508 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6e977fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6e977fe700 1 -- 172.21.15.6:0/2219763946 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea80ddf20 con 0x55f56ee6da00 2023-09-13T09:57:17.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f56ee60670 con 0x55f56ee6da00 2023-09-13T09:57:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.889+0000 7f6e977fe700 1 -- 172.21.15.6:0/2219763946 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6ea80def30 con 0x55f56ee6da00 2023-09-13T09:57:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6e977fe700 1 -- 172.21.15.6:0/2219763946 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ea80de830 con 0x55f56ee6da00 2023-09-13T09:57:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 10 client.29344 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55f56edd77a0 con 0x55f56ee6da00 2023-09-13T09:57:17.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6e977fe700 1 -- 172.21.15.6:0/2219763946 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f56ee60670 con 0x55f56ee6da00 2023-09-13T09:57:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6e977fe700 1 -- 172.21.15.6:0/2219763946 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f6ea80e2170 con 0x55f56ee6da00 2023-09-13T09:57:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 10 client.29344 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 10 client.29344 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:57:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 20 client.29344 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:17.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56ee829a0 0x55f56ee84d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 4 client.29344 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f56edb8970 con 0x55f56ee829a0 2023-09-13T09:57:17.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.890+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56ee829a0 0x55f56ee84d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.891+0000 7f6e977fe700 10 client.29344 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.891+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56ee829a0 0x55f56ee84d90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=993e66c13aa1212b server_cookie=6ebdd6d8a7d29deb in_seq=0 out_seq=0 2023-09-13T09:57:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6e977fe700 1 -- 172.21.15.6:0/2219763946 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f56edb8970 con 0x55f56ee829a0 2023-09-13T09:57:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6e977fe700 10 client.29344 handle_command_reply: tid=0 2023-09-13T09:57:17.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 client.29344 shutdown 2023-09-13T09:57:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 msgr2=0x55f56ee76f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee76f90 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f6ea80de530 tx=0x7f6ea8065b60 comp rx=0 tx=0).stop 2023-09-13T09:57:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 shutdown_connections 2023-09-13T09:57:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56ee829a0 0x55f56ee84d90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee7e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6e977fe700 0 client.29344 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee76f90 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/2219763946 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 >> 172.21.15.6:0/2219763946 conn(0x55f56edcbc80 msgr2=0x55f56ee627f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 shutdown_connections 2023-09-13T09:57:17.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.893+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/2219763946 wait complete. 2023-09-13T09:57:17.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.894+0000 7f6eca9a8b80 20 client.29344 trim_cache size 0 max 16384 2023-09-13T09:57:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 Processor -- start 2023-09-13T09:57:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 -- start start 2023-09-13T09:57:17.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee7e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee75bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ee60650 con 0x55f56ee6f060 2023-09-13T09:57:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ee76b00 con 0x55f56ee6e700 2023-09-13T09:57:17.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ee648e0 con 0x55f56ee6da00 2023-09-13T09:57:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6ebcd60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee75bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee7e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6ebcd60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee75bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44952/0 (socket says 172.21.15.6:44952) 2023-09-13T09:57:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6ebcd60700 1 -- 172.21.15.6:0/697955991 learned_addr learned my addr 172.21.15.6:0/697955991 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.913+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6ebcd60700 1 -- 172.21.15.6:0/697955991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 msgr2=0x55f56ee6d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6ebcd60700 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6ebcd60700 1 -- 172.21.15.6:0/697955991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 msgr2=0x55f56ee7e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6ebcd60700 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee7e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6ebcd60700 1 -- 172.21.15.6:0/697955991 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f56ebebde0 con 0x55f56ee6f060 2023-09-13T09:57:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee7e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6ebcd60700 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee75bb0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0011960 tx=0x7f6eb0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46b6c7c77912254d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6e9effd700 1 -- 172.21.15.6:0/697955991 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb000e040 con 0x55f56ee6f060 2023-09-13T09:57:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6e9effd700 1 -- 172.21.15.6:0/697955991 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6eb000f040 con 0x55f56ee6f060 2023-09-13T09:57:17.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.914+0000 7f6e9effd700 1 -- 172.21.15.6:0/697955991 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb00175b0 con 0x55f56ee6f060 2023-09-13T09:57:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/697955991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 msgr2=0x55f56ee75bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee75bb0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0011960 tx=0x7f6eb0009920 comp rx=0 tx=0).stop 2023-09-13T09:57:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/697955991 shutdown_connections 2023-09-13T09:57:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6f060 0x55f56ee75bb0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6da00 0x55f56ee6d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/697955991 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6e700 0x55f56ee7e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/697955991 >> 172.21.15.6:0/697955991 conn(0x55f56edcbc80 msgr2=0x55f56ee7ee00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/697955991 shutdown_connections 2023-09-13T09:57:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/697955991 wait complete. 2023-09-13T09:57:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.915+0000 7f6eca9a8b80 1 -- start start 2023-09-13T09:57:17.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 1 Processor -- start 2023-09-13T09:57:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6da00 0x55f56ee7df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6e700 0x55f56ee7e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6f060 0x55f56ee7abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ee7b2c0 con 0x55f56ee6da00 2023-09-13T09:57:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ee7b430 con 0x55f56ee6f060 2023-09-13T09:57:17.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f56ee7b5f0 con 0x55f56ee6e700 2023-09-13T09:57:17.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eca9a8b80 10 client.0 _ll_register_callbacks cb 0x55f56ed5b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:17.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6da00 0x55f56ee7df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6e700 0x55f56ee7e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6e700 0x55f56ee7e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48010/0 (socket says 172.21.15.6:48010) 2023-09-13T09:57:17.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6da00 0x55f56ee7df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44954/0 (socket says 172.21.15.6:44954) 2023-09-13T09:57:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 -- 172.21.15.6:0/1984010283 learned_addr learned my addr 172.21.15.6:0/1984010283 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6ebcd60700 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6f060 0x55f56ee7abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 -- 172.21.15.6:0/1984010283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6f060 msgr2=0x55f56ee7abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6f060 0x55f56ee7abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 -- 172.21.15.6:0/1984010283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6da00 msgr2=0x55f56ee7df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6da00 0x55f56ee7df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.916+0000 7f6eb77fe700 1 -- 172.21.15.6:0/1984010283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f56ec3f630 con 0x55f56ee6e700 2023-09-13T09:57:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6eb77fe700 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6e700 0x55f56ee7e490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005950 tx=0x7f6eac003d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec4edb90a92b347 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6e977fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:17.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6e977fe700 1 -- 172.21.15.6:0/1984010283 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac02c040 con 0x55f56ee6e700 2023-09-13T09:57:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6e977fe700 1 -- 172.21.15.6:0/1984010283 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6eac033480 con 0x55f56ee6e700 2023-09-13T09:57:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6eac003e70 con 0x55f56ee6e700 2023-09-13T09:57:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6e977fe700 1 -- 172.21.15.6:0/1984010283 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6eac033980 con 0x55f56ee6e700 2023-09-13T09:57:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6eca9a8b80 10 client.29350 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x7f6eb0011610 con 0x55f56ee6e700 2023-09-13T09:57:17.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.917+0000 7f6e977fe700 1 -- 172.21.15.6:0/1984010283 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6eac003e70 con 0x55f56ee6e700 2023-09-13T09:57:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6e977fe700 1 -- 172.21.15.6:0/1984010283 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f6eac024020 con 0x55f56ee6e700 2023-09-13T09:57:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eca9a8b80 10 client.29350 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eca9a8b80 10 client.29350 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:57:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eca9a8b80 20 client.29350 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:17.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56eed7e60 0x55f56eeda280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:17.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eca9a8b80 4 client.29350 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:17.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f56ed79050 con 0x55f56eed7e60 2023-09-13T09:57:17.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56eed7e60 0x55f56eeda280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:17.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6e977fe700 10 client.29350 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:17.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eb7fff700 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56eed7e60 0x55f56eeda280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f47271d639597862 server_cookie=b5808db63fb0219f in_seq=0 out_seq=0 2023-09-13T09:57:17.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6e977fe700 1 -- 172.21.15.6:0/1984010283 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f56ed79050 con 0x55f56eed7e60 2023-09-13T09:57:17.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6e977fe700 10 client.29350 handle_command_reply: tid=0 2023-09-13T09:57:17.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.918+0000 7f6eca9a8b80 1 client.29350 shutdown 2023-09-13T09:57:17.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6e700 msgr2=0x55f56ee7e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6e700 0x55f56ee7e490 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005950 tx=0x7f6eac003d60 comp rx=0 tx=0).stop 2023-09-13T09:57:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 shutdown_connections 2023-09-13T09:57:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55f56eed7e60 0x55f56eeda280 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f56ee6f060 0x55f56ee7abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f56ee6da00 0x55f56ee7df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 --2- 172.21.15.6:0/1984010283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f56ee6e700 0x55f56ee7e490 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6e977fe700 0 client.29350 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:17.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 >> 172.21.15.6:0/1984010283 conn(0x55f56edcbc80 msgr2=0x55f56ee75bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 shutdown_connections 2023-09-13T09:57:17.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 1 -- 172.21.15.6:0/1984010283 wait complete. 2023-09-13T09:57:17.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6eca9a8b80 20 client.29350 trim_cache size 0 max 16384 2023-09-13T09:57:17.937 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:17.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6ea00a0640 msgr2=0x7f6ea00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6ea00a0640 0x7f6ea00a2b00 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f6eac011490 tx=0x7f6eac009260 comp rx=0 tx=0).stop 2023-09-13T09:57:17.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb80fff20 msgr2=0x7f6eb810fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:17.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.919+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb80fff20 0x7f6eb810fb90 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8004710 tx=0x7f6ea8009580 comp rx=0 tx=0).stop 2023-09-13T09:57:17.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 shutdown_connections 2023-09-13T09:57:17.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6eb81012d0 0x7f6eb8117140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6ea00a0640 0x7f6ea00a2b00 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6eb80fff20 0x7f6eb810fb90 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 --2- 172.21.15.6:0/3415988559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6eb81008e0 0x7f6eb81100d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 >> 172.21.15.6:0/3415988559 conn(0x7f6eb80fa9b0 msgr2=0x7f6eb8104460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 shutdown_connections 2023-09-13T09:57:17.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:17.920+0000 7f6ebe7c3700 1 -- 172.21.15.6:0/3415988559 wait complete. 2023-09-13T09:57:17.941 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:57:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.102+0000 7f454ba16700 1 -- 172.21.15.6:0/1836158645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4544102fc0 msgr2=0x7f45441033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.102+0000 7f454ba16700 1 --2- 172.21.15.6:0/1836158645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4544102fc0 0x7f45441033e0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f45400099c0 tx=0x7f4540009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.103+0000 7f454ba16700 1 -- 172.21.15.6:0/1836158645 shutdown_connections 2023-09-13T09:57:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.103+0000 7f454ba16700 1 --2- 172.21.15.6:0/1836158645 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4544104b50 0x7f454410b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.103+0000 7f454ba16700 1 --2- 172.21.15.6:0/1836158645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4544102fc0 0x7f45441033e0 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.103+0000 7f454ba16700 1 --2- 172.21.15.6:0/1836158645 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45441041b0 0x7f4544104610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.103+0000 7f454ba16700 1 -- 172.21.15.6:0/1836158645 >> 172.21.15.6:0/1836158645 conn(0x7f45440fe570 msgr2=0x7f4544100990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.105+0000 7f454ba16700 1 -- 172.21.15.6:0/1836158645 shutdown_connections 2023-09-13T09:57:18.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.106+0000 7f454ba16700 1 -- 172.21.15.6:0/1836158645 wait complete. 2023-09-13T09:57:18.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.106+0000 7f454ba16700 1 Processor -- start 2023-09-13T09:57:18.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.106+0000 7f454ba16700 1 -- start start 2023-09-13T09:57:18.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f454ba16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4544102fc0 0x7f454419d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f454ba16700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45441041b0 0x7f454419d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f454ba16700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4544104b50 0x7f45441a4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f454ba16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45441a4e00 con 0x7f4544102fc0 2023-09-13T09:57:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f454ba16700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454410d8e0 con 0x7f45441041b0 2023-09-13T09:57:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f454ba16700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f454410da70 con 0x7f4544104b50 2023-09-13T09:57:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f4548fb1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45441041b0 0x7f454419d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f4548fb1700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45441041b0 0x7f454419d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38492/0 (socket says 172.21.15.6:38492) 2023-09-13T09:57:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f4548fb1700 1 -- 172.21.15.6:0/525622597 learned_addr learned my addr 172.21.15.6:0/525622597 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.107+0000 7f4549fb3700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4544104b50 0x7f45441a4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.108+0000 7f4548fb1700 1 -- 172.21.15.6:0/525622597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4544104b50 msgr2=0x7f45441a4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.108+0000 7f4548fb1700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4544104b50 0x7f45441a4830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.108+0000 7f4548fb1700 1 -- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4544102fc0 msgr2=0x7f454419d280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:57:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.108+0000 7f4548fb1700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4544102fc0 0x7f454419d280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.108+0000 7f4548fb1700 1 -- 172.21.15.6:0/525622597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45400095f0 con 0x7f45441041b0 2023-09-13T09:57:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.108+0000 7f4548fb1700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45441041b0 0x7f454419d7c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f453400b550 tx=0x7f453400b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.109+0000 7f453a7fc700 1 -- 172.21.15.6:0/525622597 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4534011830 con 0x7f45441041b0 2023-09-13T09:57:18.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.109+0000 7f453a7fc700 1 -- 172.21.15.6:0/525622597 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4534011e50 con 0x7f45441041b0 2023-09-13T09:57:18.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.109+0000 7f453a7fc700 1 -- 172.21.15.6:0/525622597 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453400f2e0 con 0x7f45441041b0 2023-09-13T09:57:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.111+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f454410dd50 con 0x7f45441041b0 2023-09-13T09:57:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.111+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454410e260 con 0x7f45441041b0 2023-09-13T09:57:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.114+0000 7f453a7fc700 1 -- 172.21.15.6:0/525622597 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f45340105f0 con 0x7f45441041b0 2023-09-13T09:57:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.115+0000 7f453a7fc700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45300a06c0 0x7f45300a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.116+0000 7f4557bfbb80 1 Processor -- start 2023-09-13T09:57:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.116+0000 7f453a7fc700 1 -- 172.21.15.6:0/525622597 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f45340cb640 con 0x7f45441041b0 2023-09-13T09:57:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.116+0000 7f45497b2700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45300a06c0 0x7f45300a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.116+0000 7f4557bfbb80 1 -- start start 2023-09-13T09:57:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.116+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c4ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.116+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 0x55c7a4c494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c49e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4ba2780 con 0x55c7a4c4a700 2023-09-13T09:57:18.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4ba00a0 con 0x55c7a4c49a00 2023-09-13T09:57:18.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4b9b990 con 0x55c7a4c4b060 2023-09-13T09:57:18.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c4ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c4ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44978/0 (socket says 172.21.15.6:44978) 2023-09-13T09:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 -- 172.21.15.6:0/2638211345 learned_addr learned my addr 172.21.15.6:0/2638211345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45300a06c0 0x7f45300a2b80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4540009fd0 tx=0x7f4540000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 -- 172.21.15.6:0/2638211345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 msgr2=0x55c7a4c494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 --2- 172.21.15.6:0/2638211345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 0x55c7a4c494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 -- 172.21.15.6:0/2638211345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 msgr2=0x55c7a4c49e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 --2- 172.21.15.6:0/2638211345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c49e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 -- 172.21.15.6:0/2638211345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a4a1b630 con 0x55c7a4c4a700 2023-09-13T09:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f45497b2700 1 --2- 172.21.15.6:0/2638211345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c4ab20 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f4540015000 tx=0x7f454001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47dfea7adbb7c73b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.117+0000 7f452f7fe700 1 -- 172.21.15.6:0/2638211345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454001d070 con 0x55c7a4c4a700 2023-09-13T09:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f452f7fe700 1 -- 172.21.15.6:0/2638211345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4540003e20 con 0x55c7a4c4a700 2023-09-13T09:57:18.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f452f7fe700 1 -- 172.21.15.6:0/2638211345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4540025a20 con 0x55c7a4c4a700 2023-09-13T09:57:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2638211345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 msgr2=0x55c7a4c4ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2638211345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c4ab20 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f4540015000 tx=0x7f454001d000 comp rx=0 tx=0).stop 2023-09-13T09:57:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2638211345 shutdown_connections 2023-09-13T09:57:18.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2638211345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c49e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2638211345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c4ab20 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.118+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2638211345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 0x55c7a4c494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2638211345 >> 172.21.15.6:0/2638211345 conn(0x55c7a4ba7c80 msgr2=0x55c7a4c43f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2638211345 shutdown_connections 2023-09-13T09:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2638211345 wait complete. 2023-09-13T09:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 -- start start 2023-09-13T09:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 Processor -- start 2023-09-13T09:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c52f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c53460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 0x55c7a4c5a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4b39bb0 con 0x55c7a4c4a700 2023-09-13T09:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4b398b0 con 0x55c7a4c49a00 2023-09-13T09:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.119+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4a1d920 con 0x55c7a4c4b060 2023-09-13T09:57:18.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4557bfbb80 10 client.0 _ll_register_callbacks cb 0x55c7a4b37680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f45497b2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c52f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f45497b2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c52f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38504/0 (socket says 172.21.15.6:38504) 2023-09-13T09:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4549fb3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 0x55c7a4c5a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f45497b2700 1 -- 172.21.15.6:0/3559284300 learned_addr learned my addr 172.21.15.6:0/3559284300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4548fb1700 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c53460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4548fb1700 1 -- 172.21.15.6:0/3559284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 msgr2=0x55c7a4c5a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4548fb1700 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 0x55c7a4c5a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4548fb1700 1 -- 172.21.15.6:0/3559284300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 msgr2=0x55c7a4c52f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4548fb1700 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c52f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4548fb1700 1 -- 172.21.15.6:0/3559284300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f454410bd50 con 0x55c7a4c4a700 2023-09-13T09:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f4548fb1700 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c53460 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f453400bc60 tx=0x7f45340987c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfdc940a959e736 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f452cff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.120+0000 7f452cff9700 1 -- 172.21.15.6:0/3559284300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45340b1200 con 0x55c7a4c4a700 2023-09-13T09:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f452cff9700 1 -- 172.21.15.6:0/3559284300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4534098de0 con 0x55c7a4c4a700 2023-09-13T09:57:18.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7a4c3c670 con 0x55c7a4c4a700 2023-09-13T09:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f452cff9700 1 -- 172.21.15.6:0/3559284300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f453409cc10 con 0x55c7a4c4a700 2023-09-13T09:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 10 client.20124 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55c7a4bb37a0 con 0x55c7a4c4a700 2023-09-13T09:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f452cff9700 1 -- 172.21.15.6:0/3559284300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f453407b020 con 0x55c7a4c4a700 2023-09-13T09:57:18.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f452cff9700 1 -- 172.21.15.6:0/3559284300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f45340a09c0 con 0x55c7a4c4a700 2023-09-13T09:57:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 10 client.20124 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 10 client.20124 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:57:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 20 client.20124 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4c5ecd0 0x55c7a4c610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 4 client.20124 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.121+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7a4b94970 con 0x55c7a4c5ecd0 2023-09-13T09:57:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.122+0000 7f45497b2700 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4c5ecd0 0x55c7a4c610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.122+0000 7f452cff9700 10 client.20124 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.122+0000 7f45497b2700 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4c5ecd0 0x55c7a4c610f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b49295c335051b6d server_cookie=b2f97901650b83b5 in_seq=0 out_seq=0 2023-09-13T09:57:18.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.123+0000 7f452cff9700 1 -- 172.21.15.6:0/3559284300 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c7a4b94970 con 0x55c7a4c5ecd0 2023-09-13T09:57:18.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.123+0000 7f452cff9700 10 client.20124 handle_command_reply: tid=0 2023-09-13T09:57:18.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.123+0000 7f4557bfbb80 1 client.20124 shutdown 2023-09-13T09:57:18.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.123+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 msgr2=0x55c7a4c53460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.123+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c53460 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7f453400bc60 tx=0x7f45340987c0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 shutdown_connections 2023-09-13T09:57:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4c5ecd0 0x55c7a4c610f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4b060 0x55c7a4c5a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f452cff9700 0 client.20124 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c52f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3559284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4a700 0x55c7a4c53460 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 >> 172.21.15.6:0/3559284300 conn(0x55c7a4ba7c80 msgr2=0x55c7a4c3e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 shutdown_connections 2023-09-13T09:57:18.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.126+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3559284300 wait complete. 2023-09-13T09:57:18.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.127+0000 7f4557bfbb80 20 client.20124 trim_cache size 0 max 16384 2023-09-13T09:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 Processor -- start 2023-09-13T09:57:18.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 -- start start 2023-09-13T09:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c49a00 0x55c7a4c494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c4a700 0x55c7a4c5a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c43ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4c44460 con 0x55c7a4c4b060 2023-09-13T09:57:18.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4c4e4f0 con 0x55c7a4c4a700 2023-09-13T09:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.145+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4c52cd0 con 0x55c7a4c49a00 2023-09-13T09:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c43ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c43ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44992/0 (socket says 172.21.15.6:44992) 2023-09-13T09:57:18.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 -- 172.21.15.6:0/2090714406 learned_addr learned my addr 172.21.15.6:0/2090714406 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4548fb1700 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c4a700 0x55c7a4c5a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f45497b2700 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c49a00 0x55c7a4c494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 -- 172.21.15.6:0/2090714406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c49a00 msgr2=0x55c7a4c494c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c49a00 0x55c7a4c494c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 -- 172.21.15.6:0/2090714406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c4a700 msgr2=0x55c7a4c5a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c4a700 0x55c7a4c5a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 -- 172.21.15.6:0/2090714406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7a49c7de0 con 0x55c7a4c4b060 2023-09-13T09:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4548fb1700 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c4a700 0x55c7a4c5a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f4549fb3700 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c43ee0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ec0 tx=0x7f453c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6632afcd7ac18c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f452ffff700 1 -- 172.21.15.6:0/2090714406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c010040 con 0x55c7a4c4b060 2023-09-13T09:57:18.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f452ffff700 1 -- 172.21.15.6:0/2090714406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f453c00ae80 con 0x55c7a4c4b060 2023-09-13T09:57:18.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.146+0000 7f452ffff700 1 -- 172.21.15.6:0/2090714406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f453c015930 con 0x55c7a4c4b060 2023-09-13T09:57:18.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2090714406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 msgr2=0x55c7a4c43ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c43ee0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f453c009ec0 tx=0x7f453c00a6e0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2090714406 shutdown_connections 2023-09-13T09:57:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c43ee0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c49a00 0x55c7a4c494c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/2090714406 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c4a700 0x55c7a4c5a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2090714406 >> 172.21.15.6:0/2090714406 conn(0x55c7a4ba7c80 msgr2=0x55c7a4c49de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2090714406 shutdown_connections 2023-09-13T09:57:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.147+0000 7f4557bfbb80 1 -- 172.21.15.6:0/2090714406 wait complete. 2023-09-13T09:57:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 -- start start 2023-09-13T09:57:18.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 Processor -- start 2023-09-13T09:57:18.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c56690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4a700 0x55c7a4c56bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c59740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4c59c80 con 0x55c7a4c4b060 2023-09-13T09:57:18.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4c59df0 con 0x55c7a4c49a00 2023-09-13T09:57:18.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7a4c59fb0 con 0x55c7a4c4a700 2023-09-13T09:57:18.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4557bfbb80 10 client.0 _ll_register_callbacks cb 0x55c7a4b37680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:18.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4549fb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c59740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4548fb1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4a700 0x55c7a4c56bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4548fb1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4a700 0x55c7a4c56bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48050/0 (socket says 172.21.15.6:48050) 2023-09-13T09:57:18.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4549fb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c59740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44998/0 (socket says 172.21.15.6:44998) 2023-09-13T09:57:18.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f4548fb1700 1 -- 172.21.15.6:0/3929456090 learned_addr learned my addr 172.21.15.6:0/3929456090 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.148+0000 7f45497b2700 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c56690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4548fb1700 1 -- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 msgr2=0x55c7a4c56690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4548fb1700 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c56690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4548fb1700 1 -- 172.21.15.6:0/3929456090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 msgr2=0x55c7a4c59740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4548fb1700 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c59740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4548fb1700 1 -- 172.21.15.6:0/3929456090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7a4bb37a0 con 0x55c7a4c4a700 2023-09-13T09:57:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4548fb1700 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4a700 0x55c7a4c56bd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f453400bfd0 tx=0x7f453400b4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8af7525abad199e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f452cff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f452cff9700 1 -- 172.21.15.6:0/3929456090 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45340984d0 con 0x55c7a4c4a700 2023-09-13T09:57:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f452cff9700 1 -- 172.21.15.6:0/3929456090 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f453407c080 con 0x55c7a4c4a700 2023-09-13T09:57:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7a4b55050 con 0x55c7a4c4a700 2023-09-13T09:57:18.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f452cff9700 1 -- 172.21.15.6:0/3929456090 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f45340b1200 con 0x55c7a4c4a700 2023-09-13T09:57:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4557bfbb80 10 client.29362 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.149+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x7f453c009ba0 con 0x55c7a4c4a700 2023-09-13T09:57:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f452cff9700 1 -- 172.21.15.6:0/3929456090 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c7a4b55050 con 0x55c7a4c4a700 2023-09-13T09:57:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f452cff9700 1 -- 172.21.15.6:0/3929456090 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f4534097d40 con 0x55c7a4c4a700 2023-09-13T09:57:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f4557bfbb80 10 client.29362 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f4557bfbb80 10 client.29362 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:57:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f4557bfbb80 20 client.29362 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4cb3870 0x55c7a4cb5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f4557bfbb80 4 client.29362 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.150+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c7a49e8f70 con 0x55c7a4cb3870 2023-09-13T09:57:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f45497b2700 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4cb3870 0x55c7a4cb5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f45497b2700 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4cb3870 0x55c7a4cb5c90 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e93820c82303932c server_cookie=acf1b4c32d60c7f4 in_seq=0 out_seq=0 2023-09-13T09:57:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f452cff9700 10 client.29362 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f452cff9700 1 -- 172.21.15.6:0/3929456090 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c7a49e8f70 con 0x55c7a4cb3870 2023-09-13T09:57:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f452cff9700 10 client.29362 handle_command_reply: tid=0 2023-09-13T09:57:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f4557bfbb80 1 client.29362 shutdown 2023-09-13T09:57:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4a700 msgr2=0x55c7a4c56bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.153+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4a700 0x55c7a4c56bd0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f453400bfd0 tx=0x7f453400b4c0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 shutdown_connections 2023-09-13T09:57:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c7a4cb3870 0x55c7a4cb5c90 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c7a4c4b060 0x55c7a4c59740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f452cff9700 0 client.29362 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c7a4c49a00 0x55c7a4c56690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 --2- 172.21.15.6:0/3929456090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c7a4c4a700 0x55c7a4c56bd0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 >> 172.21.15.6:0/3929456090 conn(0x55c7a4ba7c80 msgr2=0x55c7a4c50e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 shutdown_connections 2023-09-13T09:57:18.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 1 -- 172.21.15.6:0/3929456090 wait complete. 2023-09-13T09:57:18.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f4557bfbb80 20 client.29362 trim_cache size 0 max 16384 2023-09-13T09:57:18.169 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:18.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45300a06c0 msgr2=0x7f45300a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f454ba16700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45300a06c0 0x7f45300a2b80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4540009fd0 tx=0x7f4540000bc0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45441041b0 msgr2=0x7f454419d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.154+0000 7f454ba16700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45441041b0 0x7f454419d7c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f453400b550 tx=0x7f453400b860 comp rx=0 tx=0).stop 2023-09-13T09:57:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 shutdown_connections 2023-09-13T09:57:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4544104b50 0x7f45441a4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f45300a06c0 0x7f45300a2b80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4544102fc0 0x7f454419d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 --2- 172.21.15.6:0/525622597 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f45441041b0 0x7f454419d7c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 >> 172.21.15.6:0/525622597 conn(0x7f45440fe570 msgr2=0x7f4544100890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 shutdown_connections 2023-09-13T09:57:18.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.155+0000 7f454ba16700 1 -- 172.21.15.6:0/525622597 wait complete. 2023-09-13T09:57:18.175 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:57:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:18 smithi131 ceph-mon[102785]: pgmap v833: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 800 op/s 2023-09-13T09:57:18.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:18 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/691208029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:57:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.344+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/210424851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0101f70 msgr2=0x7fa5d01023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.344+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/210424851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0101f70 0x7fa5d01023d0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc0099c0 tx=0x7fa5bc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/210424851 shutdown_connections 2023-09-13T09:57:18.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/210424851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5d0102910 0x7fa5d01091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/210424851 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5d0100d80 0x7fa5d01011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/210424851 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0101f70 0x7fa5d01023d0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/210424851 >> 172.21.15.6:0/210424851 conn(0x7fa5d00fc310 msgr2=0x7fa5d00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/210424851 shutdown_connections 2023-09-13T09:57:18.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/210424851 wait complete. 2023-09-13T09:57:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 Processor -- start 2023-09-13T09:57:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.345+0000 7fa5d6d1a700 1 -- start start 2023-09-13T09:57:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d6d1a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0100d80 0x7fa5d0196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d6d1a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5d0101f70 0x7fa5d0196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d6d1a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5d0102910 0x7fa5d019e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d6d1a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d019e620 con 0x7fa5d0100d80 2023-09-13T09:57:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d6d1a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d019e760 con 0x7fa5d0101f70 2023-09-13T09:57:18.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d6d1a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5d019e8f0 con 0x7fa5d0102910 2023-09-13T09:57:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0100d80 0x7fa5d0196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0100d80 0x7fa5d0196aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45006/0 (socket says 172.21.15.6:45006) 2023-09-13T09:57:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 -- 172.21.15.6:0/1726716284 learned_addr learned my addr 172.21.15.6:0/1726716284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5cffff700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5d0101f70 0x7fa5d0196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 -- 172.21.15.6:0/1726716284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5d0102910 msgr2=0x7fa5d019e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5d0102910 0x7fa5d019e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5d0102910 0x7fa5d019e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 -- 172.21.15.6:0/1726716284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5d0101f70 msgr2=0x7fa5d0196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5d0101f70 0x7fa5d0196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 -- 172.21.15.6:0/1726716284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5bc0095f0 con 0x7fa5d0100d80 2023-09-13T09:57:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5d0102910 0x7fa5d019e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:57:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.346+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0100d80 0x7fa5d0196aa0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400b500 tx=0x7fa5c400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.347+0000 7fa5cdffb700 1 -- 172.21.15.6:0/1726716284 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c4011830 con 0x7fa5d0100d80 2023-09-13T09:57:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.347+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5d0073000 con 0x7fa5d0100d80 2023-09-13T09:57:18.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.347+0000 7fa5cdffb700 1 -- 172.21.15.6:0/1726716284 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5c4011e50 con 0x7fa5d0100d80 2023-09-13T09:57:18.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.347+0000 7fa5cdffb700 1 -- 172.21.15.6:0/1726716284 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c400f2e0 con 0x7fa5d0100d80 2023-09-13T09:57:18.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.347+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d0073560 con 0x7fa5d0100d80 2023-09-13T09:57:18.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.350+0000 7fa5cdffb700 1 -- 172.21.15.6:0/1726716284 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa5c4010580 con 0x7fa5d0100d80 2023-09-13T09:57:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.351+0000 7fa5cdffb700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5c00a0670 0x7fa5c00a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.351+0000 7fa5cdffb700 1 -- 172.21.15.6:0/1726716284 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5c40cb670 con 0x7fa5d0100d80 2023-09-13T09:57:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.351+0000 7fa5e2effb80 1 Processor -- start 2023-09-13T09:57:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.351+0000 7fa5cffff700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5c00a0670 0x7fa5c00a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.352+0000 7fa5cffff700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5c00a0670 0x7fa5c00a2b30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009990 tx=0x7fa5bc009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5e2effb80 1 -- start start 2023-09-13T09:57:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6e700 0x559a71c6eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 0x559a71c6d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c6de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71bc6780 con 0x559a71c6da00 2023-09-13T09:57:18.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71bc40a0 con 0x559a71c6f060 2023-09-13T09:57:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71bbf990 con 0x559a71c6e700 2023-09-13T09:57:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c6de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c6de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45016/0 (socket says 172.21.15.6:45016) 2023-09-13T09:57:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 -- 172.21.15.6:0/3466343785 learned_addr learned my addr 172.21.15.6:0/3466343785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 -- 172.21.15.6:0/3466343785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6e700 msgr2=0x559a71c6eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/3466343785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6e700 0x559a71c6eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 -- 172.21.15.6:0/3466343785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 msgr2=0x559a71c6d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/3466343785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 0x559a71c6d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.354+0000 7fa5d52b7700 1 -- 172.21.15.6:0/3466343785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a71a3f630 con 0x559a71c6da00 2023-09-13T09:57:18.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.355+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/3466343785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c6de80 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8007f10 tx=0x7fa5c800c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabfaa8a2faf4a59 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.355+0000 7fa5baffd700 1 -- 172.21.15.6:0/3466343785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800cea0 con 0x559a71c6da00 2023-09-13T09:57:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.355+0000 7fa5baffd700 1 -- 172.21.15.6:0/3466343785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5c800fae0 con 0x559a71c6da00 2023-09-13T09:57:18.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.355+0000 7fa5baffd700 1 -- 172.21.15.6:0/3466343785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c800eb90 con 0x559a71c6da00 2023-09-13T09:57:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.356+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3466343785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 msgr2=0x559a71c6de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.356+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3466343785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c6de80 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fa5c8007f10 tx=0x7fa5c800c580 comp rx=0 tx=0).stop 2023-09-13T09:57:18.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.358+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3466343785 shutdown_connections 2023-09-13T09:57:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.358+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3466343785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c6de80 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.358+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3466343785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6e700 0x559a71c6eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.358+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3466343785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 0x559a71c6d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.358+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3466343785 >> 172.21.15.6:0/3466343785 conn(0x559a71bcbc80 msgr2=0x559a71c67f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.359+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3466343785 shutdown_connections 2023-09-13T09:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.359+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3466343785 wait complete. 2023-09-13T09:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.359+0000 7fa5e2effb80 1 -- start start 2023-09-13T09:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.359+0000 7fa5e2effb80 1 Processor -- start 2023-09-13T09:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c7f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c7fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6f060 0x559a71c86d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71b5dbb0 con 0x559a71c6da00 2023-09-13T09:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71b5d8b0 con 0x559a71c6e700 2023-09-13T09:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71a41920 con 0x559a71c6f060 2023-09-13T09:57:18.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5e2effb80 10 client.0 _ll_register_callbacks cb 0x559a71b5b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5d52b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6f060 0x559a71c86d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5d52b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6f060 0x559a71c86d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48074/0 (socket says 172.21.15.6:48074) 2023-09-13T09:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5d52b7700 1 -- 172.21.15.6:0/4062309699 learned_addr learned my addr 172.21.15.6:0/4062309699 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.360+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c7f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5d52b7700 1 -- 172.21.15.6:0/4062309699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 msgr2=0x559a71c7fd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c7fd40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5d52b7700 1 -- 172.21.15.6:0/4062309699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 msgr2=0x559a71c7f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c7f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5d52b7700 1 -- 172.21.15.6:0/4062309699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5c8007b40 con 0x559a71c6f060 2023-09-13T09:57:18.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c7f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:57:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6f060 0x559a71c86d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800e3c0 tx=0x7fa5c800cfc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cb9ce8d8268ce94 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5affff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5affff700 1 -- 172.21.15.6:0/4062309699 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c801e070 con 0x559a71c6f060 2023-09-13T09:57:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a71c60670 con 0x559a71c6f060 2023-09-13T09:57:18.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5affff700 1 -- 172.21.15.6:0/4062309699 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5c8008040 con 0x559a71c6f060 2023-09-13T09:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5affff700 1 -- 172.21.15.6:0/4062309699 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c800f420 con 0x559a71c6f060 2023-09-13T09:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5e2effb80 10 client.29365 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.361+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x559a71bd77a0 con 0x559a71c6f060 2023-09-13T09:57:18.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.362+0000 7fa5affff700 1 -- 172.21.15.6:0/4062309699 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5c8031080 con 0x559a71c6f060 2023-09-13T09:57:18.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.363+0000 7fa5affff700 1 -- 172.21.15.6:0/4062309699 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa5c800f580 con 0x559a71c6f060 2023-09-13T09:57:18.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.363+0000 7fa5e2effb80 10 client.29365 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.363+0000 7fa5e2effb80 10 client.29365 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:57:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.363+0000 7fa5e2effb80 20 client.29365 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.363+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71c8b4a0 0x559a71c8d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.363+0000 7fa5e2effb80 4 client.29365 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:18.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.363+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a71bb8970 con 0x559a71c8b4a0 2023-09-13T09:57:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.364+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71c8b4a0 0x559a71c8d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.365+0000 7fa5affff700 10 client.29365 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.365+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71c8b4a0 0x559a71c8d890 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fcc4f635daf0a306 server_cookie=f6fe8dc9a82729e2 in_seq=0 out_seq=0 2023-09-13T09:57:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5affff700 1 -- 172.21.15.6:0/4062309699 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a71bb8970 con 0x559a71c8b4a0 2023-09-13T09:57:18.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5affff700 10 client.29365 handle_command_reply: tid=0 2023-09-13T09:57:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 client.29365 shutdown 2023-09-13T09:57:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6f060 msgr2=0x559a71c86d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6f060 0x559a71c86d80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa5c800e3c0 tx=0x7fa5c800cfc0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 shutdown_connections 2023-09-13T09:57:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71c8b4a0 0x559a71c8d890 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6f060 0x559a71c86d80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6da00 0x559a71c7f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/4062309699 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c7fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 >> 172.21.15.6:0/4062309699 conn(0x559a71bcbc80 msgr2=0x559a71c67ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.367+0000 7fa5affff700 0 client.29365 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.368+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 shutdown_connections 2023-09-13T09:57:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.368+0000 7fa5e2effb80 1 -- 172.21.15.6:0/4062309699 wait complete. 2023-09-13T09:57:18.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.370+0000 7fa5e2effb80 20 client.29365 trim_cache size 0 max 16384 2023-09-13T09:57:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.386+0000 7fa5e2effb80 1 Processor -- start 2023-09-13T09:57:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5e2effb80 1 -- start start 2023-09-13T09:57:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c6d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6e700 0x559a71c86d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 0x559a71c74e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71c8dbc0 con 0x559a71c6e700 2023-09-13T09:57:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71c72530 con 0x559a71c6f060 2023-09-13T09:57:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71c80460 con 0x559a71c6da00 2023-09-13T09:57:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6e700 0x559a71c86d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6e700 0x559a71c86d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45028/0 (socket says 172.21.15.6:45028) 2023-09-13T09:57:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 -- 172.21.15.6:0/1984405620 learned_addr learned my addr 172.21.15.6:0/1984405620 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c6d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 0x559a71c74e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 -- 172.21.15.6:0/1984405620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 msgr2=0x559a71c6d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c6d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 -- 172.21.15.6:0/1984405620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 msgr2=0x559a71c74e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 0x559a71c74e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 -- 172.21.15.6:0/1984405620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a719ebde0 con 0x559a71c6e700 2023-09-13T09:57:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.387+0000 7fa5cffff700 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6e700 0x559a71c86d40 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc015000 tx=0x7fa5bc01a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df57849c58303c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.388+0000 7fa5bb7fe700 1 -- 172.21.15.6:0/1984405620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc02a070 con 0x559a71c6e700 2023-09-13T09:57:18.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.388+0000 7fa5bb7fe700 1 -- 172.21.15.6:0/1984405620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5bc01e040 con 0x559a71c6e700 2023-09-13T09:57:18.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.388+0000 7fa5bb7fe700 1 -- 172.21.15.6:0/1984405620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc004760 con 0x559a71c6e700 2023-09-13T09:57:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 -- 172.21.15.6:0/1984405620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6e700 msgr2=0x559a71c86d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6e700 0x559a71c86d40 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc015000 tx=0x7fa5bc01a050 comp rx=0 tx=0).stop 2023-09-13T09:57:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 -- 172.21.15.6:0/1984405620 shutdown_connections 2023-09-13T09:57:18.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6f060 0x559a71c74e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c6d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/1984405620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6e700 0x559a71c86d40 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 -- 172.21.15.6:0/1984405620 >> 172.21.15.6:0/1984405620 conn(0x559a71bcbc80 msgr2=0x559a71c8d4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 -- 172.21.15.6:0/1984405620 shutdown_connections 2023-09-13T09:57:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 -- 172.21.15.6:0/1984405620 wait complete. 2023-09-13T09:57:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 -- start start 2023-09-13T09:57:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.389+0000 7fa5e2effb80 1 Processor -- start 2023-09-13T09:57:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c86670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c86bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5e2effb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6f060 0x559a71c84c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71c85310 con 0x559a71c6f060 2023-09-13T09:57:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71c85480 con 0x559a71c6e700 2023-09-13T09:57:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5e2effb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a71c85640 con 0x559a71c6da00 2023-09-13T09:57:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5e2effb80 10 client.0 _ll_register_callbacks cb 0x559a71b5b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:18.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d4ab6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c86670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5cffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c86bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5cffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c86bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38558/0 (socket says 172.21.15.6:38558) 2023-09-13T09:57:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5cffff700 1 -- 172.21.15.6:0/3337353077 learned_addr learned my addr 172.21.15.6:0/3337353077 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d4ab6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c86670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48086/0 (socket says 172.21.15.6:48086) 2023-09-13T09:57:18.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d52b7700 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6f060 0x559a71c84c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d4ab6700 1 -- 172.21.15.6:0/3337353077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 msgr2=0x559a71c86bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c86bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d4ab6700 1 -- 172.21.15.6:0/3337353077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6f060 msgr2=0x559a71c84c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6f060 0x559a71c84c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5d4ab6700 1 -- 172.21.15.6:0/3337353077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5d0109b10 con 0x559a71c6da00 2023-09-13T09:57:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.390+0000 7fa5cffff700 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c86bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5d4ab6700 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c86670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40c9120 tx=0x7fa5c4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3f06ebe8c2e4454 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5affff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5affff700 1 -- 172.21.15.6:0/3337353077 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5c409cc40 con 0x559a71c6da00 2023-09-13T09:57:18.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5affff700 1 -- 172.21.15.6:0/3337353077 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa5c40a0e80 con 0x559a71c6da00 2023-09-13T09:57:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa5c800fae0 con 0x559a71c6da00 2023-09-13T09:57:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5affff700 1 -- 172.21.15.6:0/3337353077 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5c4098300 con 0x559a71c6da00 2023-09-13T09:57:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5e2effb80 10 client.29371 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x559a719d4c60 con 0x559a71c6da00 2023-09-13T09:57:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5affff700 1 -- 172.21.15.6:0/3337353077 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa5c407b020 con 0x559a71c6da00 2023-09-13T09:57:18.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5affff700 1 -- 172.21.15.6:0/3337353077 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fa5c4094c00 con 0x559a71c6da00 2023-09-13T09:57:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5e2effb80 10 client.29371 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5e2effb80 10 client.29371 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:57:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.391+0000 7fa5e2effb80 20 client.29371 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.392+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71ce0690 0x559a71ce2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.392+0000 7fa5e2effb80 4 client.29371 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.392+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559a71b79050 con 0x559a71ce0690 2023-09-13T09:57:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.392+0000 7fa5cffff700 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71ce0690 0x559a71ce2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.394+0000 7fa5affff700 10 client.29371 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.394+0000 7fa5cffff700 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71ce0690 0x559a71ce2ab0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6e83b83759596026 server_cookie=4f0376b59cc0889c in_seq=0 out_seq=0 2023-09-13T09:57:18.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5affff700 1 -- 172.21.15.6:0/3337353077 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559a71b79050 con 0x559a71ce0690 2023-09-13T09:57:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5affff700 10 client.29371 handle_command_reply: tid=0 2023-09-13T09:57:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 client.29371 shutdown 2023-09-13T09:57:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 msgr2=0x559a71c86670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c86670 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa5c40c9120 tx=0x7fa5c4000bc0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 shutdown_connections 2023-09-13T09:57:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559a71ce0690 0x559a71ce2ab0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a71c6f060 0x559a71c84c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5affff700 0 client.29371 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:18.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a71c6da00 0x559a71c86670 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 --2- 172.21.15.6:0/3337353077 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a71c6e700 0x559a71c86bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 >> 172.21.15.6:0/3337353077 conn(0x559a71bcbc80 msgr2=0x559a71c74e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 shutdown_connections 2023-09-13T09:57:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 1 -- 172.21.15.6:0/3337353077 wait complete. 2023-09-13T09:57:18.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.396+0000 7fa5e2effb80 20 client.29371 trim_cache size 0 max 16384 2023-09-13T09:57:18.410 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5c00a0670 msgr2=0x7fa5c00a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5c00a0670 0x7fa5c00a2b30 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc009990 tx=0x7fa5bc009f10 comp rx=0 tx=0).stop 2023-09-13T09:57:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0100d80 msgr2=0x7fa5d0196aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0100d80 0x7fa5d0196aa0 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7fa5c400b500 tx=0x7fa5c400b810 comp rx=0 tx=0).stop 2023-09-13T09:57:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 shutdown_connections 2023-09-13T09:57:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5d0102910 0x7fa5d019e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa5c00a0670 0x7fa5c00a2b30 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5d0100d80 0x7fa5d0196aa0 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 --2- 172.21.15.6:0/1726716284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa5d0101f70 0x7fa5d0196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 >> 172.21.15.6:0/1726716284 conn(0x7fa5d00fc310 msgr2=0x7fa5d0105360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 shutdown_connections 2023-09-13T09:57:18.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.397+0000 7fa5d6d1a700 1 -- 172.21.15.6:0/1726716284 wait complete. 2023-09-13T09:57:18.413 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:18 smithi006 ceph-mon[98665]: pgmap v833: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 800 op/s 2023-09-13T09:57:18.414 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:18 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/691208029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:57:18.415 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:57:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:18 smithi053 ceph-mon[102373]: pgmap v833: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 800 op/s 2023-09-13T09:57:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:18 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/691208029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:57:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 -- 172.21.15.6:0/3244494312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1481018b0 msgr2=0x7fe148108140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 --2- 172.21.15.6:0/3244494312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1481018b0 0x7fe148108140 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fe14000b0a0 tx=0x7fe14000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 -- 172.21.15.6:0/3244494312 shutdown_connections 2023-09-13T09:57:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 --2- 172.21.15.6:0/3244494312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1481018b0 0x7fe148108140 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 --2- 172.21.15.6:0/3244494312 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1481001e0 0x7fe148100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 --2- 172.21.15.6:0/3244494312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe148100ef0 0x7fe148101370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 -- 172.21.15.6:0/3244494312 >> 172.21.15.6:0/3244494312 conn(0x7fe1480fa9b0 msgr2=0x7fe1480fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 -- 172.21.15.6:0/3244494312 shutdown_connections 2023-09-13T09:57:18.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.568+0000 7fe150365700 1 -- 172.21.15.6:0/3244494312 wait complete. 2023-09-13T09:57:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.569+0000 7fe150365700 1 Processor -- start 2023-09-13T09:57:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.569+0000 7fe150365700 1 -- start start 2023-09-13T09:57:18.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe150365700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1481001e0 0x7fe148195ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe150365700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe148100ef0 0x7fe148196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe150365700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1481018b0 0x7fe14819d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe150365700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14819d660 con 0x7fe148100ef0 2023-09-13T09:57:18.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe150365700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14819d7a0 con 0x7fe1481018b0 2023-09-13T09:57:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe150365700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe14819d930 con 0x7fe1481001e0 2023-09-13T09:57:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1481001e0 0x7fe148195ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e902700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1481018b0 0x7fe14819d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1481001e0 0x7fe148195ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48100/0 (socket says 172.21.15.6:48100) 2023-09-13T09:57:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 -- 172.21.15.6:0/1480637167 learned_addr learned my addr 172.21.15.6:0/1480637167 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14d900700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe148100ef0 0x7fe148196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 -- 172.21.15.6:0/1480637167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1481018b0 msgr2=0x7fe14819d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1481018b0 0x7fe14819d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 -- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe148100ef0 msgr2=0x7fe148196020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe148100ef0 0x7fe148196020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 -- 172.21.15.6:0/1480637167 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe140009d00 con 0x7fe1481001e0 2023-09-13T09:57:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.570+0000 7fe14e101700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1481001e0 0x7fe148195ae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe14400f9e0 tx=0x7fe14400fcf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.571+0000 7fe13f7fe700 1 -- 172.21.15.6:0/1480637167 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14401a680 con 0x7fe1481001e0 2023-09-13T09:57:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.571+0000 7fe13f7fe700 1 -- 172.21.15.6:0/1480637167 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe14400d7d0 con 0x7fe1481001e0 2023-09-13T09:57:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.571+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1480fed90 con 0x7fe1481001e0 2023-09-13T09:57:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.571+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1480ff2f0 con 0x7fe1481001e0 2023-09-13T09:57:18.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.571+0000 7fe13f7fe700 1 -- 172.21.15.6:0/1480637167 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14400bbc0 con 0x7fe1481001e0 2023-09-13T09:57:18.579 INFO:tasks.workunit.client.0.smithi006.stdout: 10 196365 37.43 MB/sec execute 158 sec latency 76.386 ms 2023-09-13T09:57:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.574+0000 7fe13f7fe700 1 -- 172.21.15.6:0/1480637167 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe14401a7e0 con 0x7fe1481001e0 2023-09-13T09:57:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.575+0000 7fe13f7fe700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1340a06c0 0x7fe1340a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.575+0000 7fe13f7fe700 1 -- 172.21.15.6:0/1480637167 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe144015070 con 0x7fe1481001e0 2023-09-13T09:57:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.575+0000 7fe15c54ab80 1 Processor -- start 2023-09-13T09:57:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.575+0000 7fe14d900700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1340a06c0 0x7fe1340a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.575+0000 7fe15c54ab80 1 -- start start 2023-09-13T09:57:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f53713f70 0x562f53714390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f537148d0 0x562f53712cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f537136e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f53663780 con 0x562f53713f70 2023-09-13T09:57:18.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f536610a0 con 0x562f537148d0 2023-09-13T09:57:18.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f5365c990 con 0x562f53713260 2023-09-13T09:57:18.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f53713f70 0x562f53714390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f53713f70 0x562f53714390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45054/0 (socket says 172.21.15.6:45054) 2023-09-13T09:57:18.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 -- 172.21.15.6:0/2462074241 learned_addr learned my addr 172.21.15.6:0/2462074241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e902700 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f537136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14d900700 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f537148d0 0x562f53712cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 -- 172.21.15.6:0/2462074241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 msgr2=0x562f537136e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f537136e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 -- 172.21.15.6:0/2462074241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f537148d0 msgr2=0x562f53712cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f537148d0 0x562f53712cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 -- 172.21.15.6:0/2462074241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f534dc630 con 0x562f53713f70 2023-09-13T09:57:18.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14d900700 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f537148d0 0x562f53712cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:57:18.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14d900700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1340a06c0 0x7fe1340a2b80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe1480fff00 tx=0x7fe138009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.576+0000 7fe14e101700 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f53713f70 0x562f53714390 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe1440a4640 tx=0x7fe144004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75bbce1b22c325d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.577+0000 7fe13cd82700 1 -- 172.21.15.6:0/2462074241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14409c460 con 0x562f53713f70 2023-09-13T09:57:18.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.577+0000 7fe13cd82700 1 -- 172.21.15.6:0/2462074241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe14409d200 con 0x562f53713f70 2023-09-13T09:57:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.577+0000 7fe13cd82700 1 -- 172.21.15.6:0/2462074241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14409af30 con 0x562f53713f70 2023-09-13T09:57:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2462074241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f53713f70 msgr2=0x562f53714390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f53713f70 0x562f53714390 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fe1440a4640 tx=0x7fe144004750 comp rx=0 tx=0).stop 2023-09-13T09:57:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2462074241 shutdown_connections 2023-09-13T09:57:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f537136e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f53713f70 0x562f53714390 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2462074241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f537148d0 0x562f53712cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2462074241 >> 172.21.15.6:0/2462074241 conn(0x562f53668c80 msgr2=0x562f53704f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2462074241 shutdown_connections 2023-09-13T09:57:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2462074241 wait complete. 2023-09-13T09:57:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.578+0000 7fe15c54ab80 1 -- start start 2023-09-13T09:57:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 1 Processor -- start 2023-09-13T09:57:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5370c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f5370c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53711710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f535fabb0 con 0x562f537148d0 2023-09-13T09:57:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f535fa8b0 con 0x562f53713260 2023-09-13T09:57:18.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f534de920 con 0x562f53713f70 2023-09-13T09:57:18.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe15c54ab80 10 client.0 _ll_register_callbacks cb 0x562f535f8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:18.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe14d900700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f5370c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe14e902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53711710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe14d900700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f5370c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48114/0 (socket says 172.21.15.6:48114) 2023-09-13T09:57:18.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe14d900700 1 -- 172.21.15.6:0/3972113814 learned_addr learned my addr 172.21.15.6:0/3972113814 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.579+0000 7fe14e101700 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5370c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe14e902700 1 -- 172.21.15.6:0/3972113814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 msgr2=0x562f5370c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe14e902700 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f5370c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe14e902700 1 -- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 msgr2=0x562f5370c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe14e902700 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5370c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe14e902700 1 -- 172.21.15.6:0/3972113814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1480ff2f0 con 0x562f537148d0 2023-09-13T09:57:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe14e902700 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53711710 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fe140007a20 tx=0x7fe14000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38deb4ace6d57ea4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe131ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:18.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe131ffb700 1 -- 172.21.15.6:0/3972113814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000e040 con 0x562f537148d0 2023-09-13T09:57:18.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe131ffb700 1 -- 172.21.15.6:0/3972113814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe140023070 con 0x562f537148d0 2023-09-13T09:57:18.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562f536fd670 con 0x562f537148d0 2023-09-13T09:57:18.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe131ffb700 1 -- 172.21.15.6:0/3972113814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe140005240 con 0x562f537148d0 2023-09-13T09:57:18.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe15c54ab80 10 client.20160 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:18.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.580+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x562f536747a0 con 0x562f537148d0 2023-09-13T09:57:18.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe131ffb700 1 -- 172.21.15.6:0/3972113814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562f536fd670 con 0x562f537148d0 2023-09-13T09:57:18.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe131ffb700 1 -- 172.21.15.6:0/3972113814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe14000b0d0 con 0x562f537148d0 2023-09-13T09:57:18.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe15c54ab80 10 client.20160 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:18.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe15c54ab80 10 client.20160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe15c54ab80 20 client.20160 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53730bd0 0x562f53732ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe15c54ab80 4 client.20160 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562f53655970 con 0x562f53730bd0 2023-09-13T09:57:18.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.581+0000 7fe14e101700 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53730bd0 0x562f53732ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.582+0000 7fe131ffb700 10 client.20160 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:18.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.582+0000 7fe14e101700 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53730bd0 0x562f53732ff0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50b68929bcf53be2 server_cookie=eff52882509c457f in_seq=0 out_seq=0 2023-09-13T09:57:18.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe131ffb700 1 -- 172.21.15.6:0/3972113814 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562f53655970 con 0x562f53730bd0 2023-09-13T09:57:18.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe131ffb700 10 client.20160 handle_command_reply: tid=0 2023-09-13T09:57:18.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 client.20160 shutdown 2023-09-13T09:57:18.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 msgr2=0x562f53711710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53711710 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fe140007a20 tx=0x7fe14000bc80 comp rx=0 tx=0).stop 2023-09-13T09:57:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 shutdown_connections 2023-09-13T09:57:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53730bd0 0x562f53732ff0 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53711710 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe131ffb700 0 client.20160 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:18.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5370c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/3972113814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f5370c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 >> 172.21.15.6:0/3972113814 conn(0x562f53668c80 msgr2=0x562f536ff7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 shutdown_connections 2023-09-13T09:57:18.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 1 -- 172.21.15.6:0/3972113814 wait complete. 2023-09-13T09:57:18.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.588+0000 7fe15c54ab80 20 client.20160 trim_cache size 0 max 16384 2023-09-13T09:57:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 Processor -- start 2023-09-13T09:57:18.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 -- start start 2023-09-13T09:57:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f53732fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713f70 0x562f537116d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53740810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f5371ad90 con 0x562f537148d0 2023-09-13T09:57:18.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f53706370 con 0x562f53713f70 2023-09-13T09:57:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f5370a6b0 con 0x562f53713260 2023-09-13T09:57:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e101700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f53732fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53740810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e101700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f53732fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48122/0 (socket says 172.21.15.6:48122) 2023-09-13T09:57:18.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e101700 1 -- 172.21.15.6:0/4200470117 learned_addr learned my addr 172.21.15.6:0/4200470117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14d900700 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713f70 0x562f537116d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e902700 1 -- 172.21.15.6:0/4200470117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 msgr2=0x562f53732fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e902700 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f53732fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e902700 1 -- 172.21.15.6:0/4200470117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713f70 msgr2=0x562f537116d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.606+0000 7fe14e902700 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713f70 0x562f537116d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.607+0000 7fe14e902700 1 -- 172.21.15.6:0/4200470117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562f53488de0 con 0x562f537148d0 2023-09-13T09:57:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.607+0000 7fe14e902700 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53740810 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fe140009fd0 tx=0x7fe140027bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb92c6e35436b5db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.607+0000 7fe13d583700 1 -- 172.21.15.6:0/4200470117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14000e070 con 0x562f537148d0 2023-09-13T09:57:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.607+0000 7fe13d583700 1 -- 172.21.15.6:0/4200470117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe14002c020 con 0x562f537148d0 2023-09-13T09:57:18.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.607+0000 7fe13d583700 1 -- 172.21.15.6:0/4200470117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe140027660 con 0x562f537148d0 2023-09-13T09:57:18.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 -- 172.21.15.6:0/4200470117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 msgr2=0x562f53740810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53740810 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fe140009fd0 tx=0x7fe140027bc0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 -- 172.21.15.6:0/4200470117 shutdown_connections 2023-09-13T09:57:18.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f53740810 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713260 0x562f53732fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/4200470117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713f70 0x562f537116d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 -- 172.21.15.6:0/4200470117 >> 172.21.15.6:0/4200470117 conn(0x562f53668c80 msgr2=0x562f53704e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 -- 172.21.15.6:0/4200470117 shutdown_connections 2023-09-13T09:57:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 -- 172.21.15.6:0/4200470117 wait complete. 2023-09-13T09:57:18.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.608+0000 7fe15c54ab80 1 -- start start 2023-09-13T09:57:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 1 Processor -- start 2023-09-13T09:57:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5373fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f537401b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f537833d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f53783910 con 0x562f537148d0 2023-09-13T09:57:18.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f53783a50 con 0x562f53713260 2023-09-13T09:57:18.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562f53783be0 con 0x562f53713f70 2023-09-13T09:57:18.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe15c54ab80 10 client.0 _ll_register_callbacks cb 0x562f535f8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14e902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f537833d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14d900700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f537401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14e902700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f537833d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45078/0 (socket says 172.21.15.6:45078) 2023-09-13T09:57:18.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14e101700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5373fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14e902700 1 -- 172.21.15.6:0/2274464469 learned_addr learned my addr 172.21.15.6:0/2274464469 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14d900700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f537401b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48130/0 (socket says 172.21.15.6:48130) 2023-09-13T09:57:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14d900700 1 -- 172.21.15.6:0/2274464469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 msgr2=0x562f5373fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14d900700 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5373fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14d900700 1 -- 172.21.15.6:0/2274464469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 msgr2=0x562f537833d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:18.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14d900700 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f537833d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.609+0000 7fe14d900700 1 -- 172.21.15.6:0/2274464469 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562f536747a0 con 0x562f53713f70 2023-09-13T09:57:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe14d900700 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f537401b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1380097c0 tx=0x7fe1380047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35ad239b1d455629 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe131ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe131ffb700 1 -- 172.21.15.6:0/2274464469 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe13801b610 con 0x562f53713f70 2023-09-13T09:57:18.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe131ffb700 1 -- 172.21.15.6:0/2274464469 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe13801b770 con 0x562f53713f70 2023-09-13T09:57:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe14409d200 con 0x562f53713f70 2023-09-13T09:57:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe131ffb700 1 -- 172.21.15.6:0/2274464469 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe13801b930 con 0x562f53713f70 2023-09-13T09:57:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe15c54ab80 10 client.29389 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x562f53471c60 con 0x562f53713f70 2023-09-13T09:57:18.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe131ffb700 1 -- 172.21.15.6:0/2274464469 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe14409d200 con 0x562f53713f70 2023-09-13T09:57:18.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe131ffb700 1 -- 172.21.15.6:0/2274464469 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7fe138027b30 con 0x562f53713f70 2023-09-13T09:57:18.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe15c54ab80 10 client.29389 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:18.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.610+0000 7fe15c54ab80 10 client.29389 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:18.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.611+0000 7fe15c54ab80 20 client.29389 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.611+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53785710 0x562f53787b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.611+0000 7fe15c54ab80 4 client.29389 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.611+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x562f53616050 con 0x562f53785710 2023-09-13T09:57:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.611+0000 7fe14e101700 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53785710 0x562f53787b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:18.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.611+0000 7fe131ffb700 10 client.29389 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:18.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.611+0000 7fe14e101700 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53785710 0x562f53787b30 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b135f605d68a2e1 server_cookie=cc92ee30d25f4f7f in_seq=0 out_seq=0 2023-09-13T09:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe131ffb700 1 -- 172.21.15.6:0/2274464469 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x562f53616050 con 0x562f53785710 2023-09-13T09:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe131ffb700 10 client.29389 handle_command_reply: tid=0 2023-09-13T09:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 client.29389 shutdown 2023-09-13T09:57:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 msgr2=0x562f537401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f537401b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe1380097c0 tx=0x7fe1380047c0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 shutdown_connections 2023-09-13T09:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562f53785710 0x562f53787b30 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562f537148d0 0x562f537833d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562f53713260 0x562f5373fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe131ffb700 0 client.29389 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 --2- 172.21.15.6:0/2274464469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562f53713f70 0x562f537401b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 >> 172.21.15.6:0/2274464469 conn(0x562f53668c80 msgr2=0x562f5370c140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 shutdown_connections 2023-09-13T09:57:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.613+0000 7fe15c54ab80 1 -- 172.21.15.6:0/2274464469 wait complete. 2023-09-13T09:57:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe15c54ab80 20 client.29389 trim_cache size 0 max 16384 2023-09-13T09:57:18.632 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:18.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1340a06c0 msgr2=0x7fe1340a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1340a06c0 0x7fe1340a2b80 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fe1480fff00 tx=0x7fe138009260 comp rx=0 tx=0).stop 2023-09-13T09:57:18.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1481001e0 msgr2=0x7fe148195ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:18.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1481001e0 0x7fe148195ae0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe14400f9e0 tx=0x7fe14400fcf0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 shutdown_connections 2023-09-13T09:57:18.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe1481018b0 0x7fe14819d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1481001e0 0x7fe148195ae0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe1340a06c0 0x7fe1340a2b80 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 --2- 172.21.15.6:0/1480637167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe148100ef0 0x7fe148196020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 >> 172.21.15.6:0/1480637167 conn(0x7fe1480fa9b0 msgr2=0x7fe1480fcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:18.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 shutdown_connections 2023-09-13T09:57:18.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:18.614+0000 7fe150365700 1 -- 172.21.15.6:0/1480637167 wait complete. 2023-09-13T09:57:19.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 197081 37.47 MB/sec execute 159 sec latency 144.618 ms 2023-09-13T09:57:19.637 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:57:19.638 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:57:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 -- 172.21.15.6:0/2418549784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c90100eb0 msgr2=0x7f9c90101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 --2- 172.21.15.6:0/2418549784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c90100eb0 0x7f9c90101310 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f9c840099c0 tx=0x7f9c84009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 -- 172.21.15.6:0/2418549784 shutdown_connections 2023-09-13T09:57:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 --2- 172.21.15.6:0/2418549784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c90101850 0x7f9c90108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 --2- 172.21.15.6:0/2418549784 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c900ffcc0 0x7f9c901000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 --2- 172.21.15.6:0/2418549784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c90100eb0 0x7f9c90101310 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 -- 172.21.15.6:0/2418549784 >> 172.21.15.6:0/2418549784 conn(0x7f9c900fb210 msgr2=0x7f9c900fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 -- 172.21.15.6:0/2418549784 shutdown_connections 2023-09-13T09:57:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.925+0000 7f9c965a6700 1 -- 172.21.15.6:0/2418549784 wait complete. 2023-09-13T09:57:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 Processor -- start 2023-09-13T09:57:19.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 -- start start 2023-09-13T09:57:19.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c900ffcc0 0x7f9c90195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c90100eb0 0x7f9c90195ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c90101850 0x7f9c9019cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9019d4e0 con 0x7f9c900ffcc0 2023-09-13T09:57:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9019d620 con 0x7f9c90100eb0 2023-09-13T09:57:19.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c965a6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9019d7b0 con 0x7f9c90101850 2023-09-13T09:57:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c900ffcc0 0x7f9c90195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c900ffcc0 0x7f9c90195960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45088/0 (socket says 172.21.15.6:45088) 2023-09-13T09:57:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3113782980 learned_addr learned my addr 172.21.15.6:0/3113782980 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c94b43700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c90101850 0x7f9c9019cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.926+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c90100eb0 0x7f9c90195ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3113782980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c90101850 msgr2=0x7f9c9019cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c90101850 0x7f9c9019cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3113782980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c90100eb0 msgr2=0x7f9c90195ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c90100eb0 0x7f9c90195ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3113782980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c840095f0 con 0x7f9c900ffcc0 2023-09-13T09:57:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c900ffcc0 0x7f9c90195960 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000ea80 tx=0x7f9c8000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8d7fa700 1 -- 172.21.15.6:0/3113782980 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c80013070 con 0x7f9c900ffcc0 2023-09-13T09:57:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c90068d50 con 0x7f9c900ffcc0 2023-09-13T09:57:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8d7fa700 1 -- 172.21.15.6:0/3113782980 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c8000be80 con 0x7f9c900ffcc0 2023-09-13T09:57:19.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c8d7fa700 1 -- 172.21.15.6:0/3113782980 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c800039c0 con 0x7f9c900ffcc0 2023-09-13T09:57:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.927+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c90069260 con 0x7f9c900ffcc0 2023-09-13T09:57:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.930+0000 7f9c8d7fa700 1 -- 172.21.15.6:0/3113782980 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9c80004120 con 0x7f9c900ffcc0 2023-09-13T09:57:19.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.930+0000 7f9c8d7fa700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c780a0640 0x7f9c780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.930+0000 7f9c8d7fa700 1 -- 172.21.15.6:0/3113782980 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9c800cd170 con 0x7f9c900ffcc0 2023-09-13T09:57:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.930+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c780a0640 0x7f9c780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c780a0640 0x7f9c780a2b00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400b580 tx=0x7f9c84005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 Processor -- start 2023-09-13T09:57:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 -- start start 2023-09-13T09:57:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d7b90 0x55b0f18d7fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d84f0 0x55b0f18d6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f182b800 con 0x55b0f18d84f0 2023-09-13T09:57:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f1829120 con 0x55b0f18d6e90 2023-09-13T09:57:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f1824a10 con 0x55b0f18d7b90 2023-09-13T09:57:19.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d84f0 0x55b0f18d6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d7b90 0x55b0f18d7fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d7b90 0x55b0f18d7fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48150/0 (socket says 172.21.15.6:48150) 2023-09-13T09:57:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9c8ffff700 1 -- 172.21.15.6:0/428449823 learned_addr learned my addr 172.21.15.6:0/428449823 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d84f0 0x55b0f18d6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45098/0 (socket says 172.21.15.6:45098) 2023-09-13T09:57:19.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.931+0000 7f9c94b43700 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/428449823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d7b90 msgr2=0x55b0f18d7fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d7b90 0x55b0f18d7fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/428449823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 msgr2=0x55b0f18d72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18d72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/428449823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f16a46b0 con 0x55b0f18d84f0 2023-09-13T09:57:19.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d7b90 0x55b0f18d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d84f0 0x55b0f18d6950 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009fd0 tx=0x7f9c8401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319fce341eb6ed3b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c767fc700 1 -- 172.21.15.6:0/428449823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84029070 con 0x55b0f18d84f0 2023-09-13T09:57:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c767fc700 1 -- 172.21.15.6:0/428449823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c8401e040 con 0x55b0f18d84f0 2023-09-13T09:57:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.932+0000 7f9c767fc700 1 -- 172.21.15.6:0/428449823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8400f680 con 0x55b0f18d84f0 2023-09-13T09:57:19.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 -- 172.21.15.6:0/428449823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d84f0 msgr2=0x55b0f18d6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d84f0 0x55b0f18d6950 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f9c84009fd0 tx=0x7f9c8401f000 comp rx=0 tx=0).stop 2023-09-13T09:57:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 -- 172.21.15.6:0/428449823 shutdown_connections 2023-09-13T09:57:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18d72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d7b90 0x55b0f18d7fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/428449823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d84f0 0x55b0f18d6950 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 -- 172.21.15.6:0/428449823 >> 172.21.15.6:0/428449823 conn(0x55b0f1830d00 msgr2=0x55b0f18ccf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 -- 172.21.15.6:0/428449823 shutdown_connections 2023-09-13T09:57:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 -- 172.21.15.6:0/428449823 wait complete. 2023-09-13T09:57:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 -- start start 2023-09-13T09:57:19.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.933+0000 7f9ca278bb80 1 Processor -- start 2023-09-13T09:57:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f17c2c30 con 0x55b0f18d7b90 2023-09-13T09:57:19.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f17c2930 con 0x55b0f18d6e90 2023-09-13T09:57:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f16a69a0 con 0x55b0f18d84f0 2023-09-13T09:57:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9ca278bb80 10 client.0 _ll_register_callbacks cb 0x55b0f17c0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45104/0 (socket says 172.21.15.6:45104) 2023-09-13T09:57:19.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/40132229 learned_addr learned my addr 172.21.15.6:0/40132229 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c94b43700 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/40132229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 msgr2=0x55b0f18e7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 msgr2=0x55b0f18e02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/40132229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c90108a50 con 0x55b0f18d7b90 2023-09-13T09:57:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e0810 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f9c84005040 tx=0x7f9c8400bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468dd8d07af4acbd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.934+0000 7f9c6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:19.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/40132229 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84029040 con 0x55b0f18d7b90 2023-09-13T09:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0f18c56f0 con 0x55b0f18d7b90 2023-09-13T09:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/40132229 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9c84005450 con 0x55b0f18d7b90 2023-09-13T09:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/40132229 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c840037d0 con 0x55b0f18d7b90 2023-09-13T09:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 10 client.20178 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55b0f183c820 con 0x55b0f18d7b90 2023-09-13T09:57:19.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/40132229 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b0f18c56f0 con 0x55b0f18d7b90 2023-09-13T09:57:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/40132229 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f9c84022aa0 con 0x55b0f18d7b90 2023-09-13T09:57:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 10 client.20178 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 10 client.20178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 20 client.20178 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:19.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f18ebba0 0x55b0f18edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 4 client.20178 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b0f181d9f0 con 0x55b0f18ebba0 2023-09-13T09:57:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.935+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f18ebba0 0x55b0f18edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.936+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f18ebba0 0x55b0f18edfc0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f95cf58ca68dcc7 server_cookie=90c8b6bf8f8b31e9 in_seq=0 out_seq=0 2023-09-13T09:57:19.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.936+0000 7f9c6f7fe700 10 client.20178 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.938+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/40132229 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b0f181d9f0 con 0x55b0f18ebba0 2023-09-13T09:57:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.938+0000 7f9c6f7fe700 10 client.20178 handle_command_reply: tid=0 2023-09-13T09:57:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.938+0000 7f9ca278bb80 1 client.20178 shutdown 2023-09-13T09:57:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.938+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 msgr2=0x55b0f18e0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.938+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e0810 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f9c84005040 tx=0x7f9c8400bf00 comp rx=0 tx=0).stop 2023-09-13T09:57:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 shutdown_connections 2023-09-13T09:57:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f18ebba0 0x55b0f18edfc0 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/40132229 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e0810 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 >> 172.21.15.6:0/40132229 conn(0x55b0f1830d00 msgr2=0x55b0f18c7870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9c6f7fe700 0 client.20178 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 shutdown_connections 2023-09-13T09:57:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 1 -- 172.21.15.6:0/40132229 wait complete. 2023-09-13T09:57:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.939+0000 7f9ca278bb80 20 client.20178 trim_cache size 0 max 16384 2023-09-13T09:57:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.955+0000 7f9ca278bb80 1 Processor -- start 2023-09-13T09:57:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9ca278bb80 1 -- start start 2023-09-13T09:57:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e7810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18de240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f18dfe40 con 0x55b0f18d7b90 2023-09-13T09:57:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f18cf050 con 0x55b0f18d6e90 2023-09-13T09:57:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f18ce030 con 0x55b0f18d84f0 2023-09-13T09:57:19.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e7810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e7810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45112/0 (socket says 172.21.15.6:45112) 2023-09-13T09:57:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/671602350 learned_addr learned my addr 172.21.15.6:0/671602350 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c94b43700 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18de240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/671602350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 msgr2=0x55b0f18de240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18de240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/671602350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 msgr2=0x55b0f18e8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 -- 172.21.15.6:0/671602350 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0f18cdc20 con 0x55b0f18d7b90 2023-09-13T09:57:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c94b43700 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:57:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e7810 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f9c84022e00 tx=0x7f9c84009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=988e944c0f1c29ff server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.956+0000 7f9c76ffd700 1 -- 172.21.15.6:0/671602350 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84029050 con 0x55b0f18d7b90 2023-09-13T09:57:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9c76ffd700 1 -- 172.21.15.6:0/671602350 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c84005710 con 0x55b0f18d7b90 2023-09-13T09:57:19.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9c76ffd700 1 -- 172.21.15.6:0/671602350 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c84003a30 con 0x55b0f18d7b90 2023-09-13T09:57:19.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 -- 172.21.15.6:0/671602350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 msgr2=0x55b0f18e7810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e7810 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f9c84022e00 tx=0x7f9c84009fd0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 -- 172.21.15.6:0/671602350 shutdown_connections 2023-09-13T09:57:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18de240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d6e90 0x55b0f18e8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/671602350 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d7b90 0x55b0f18e7810 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 -- 172.21.15.6:0/671602350 >> 172.21.15.6:0/671602350 conn(0x55b0f1830d00 msgr2=0x55b0f18ccee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 -- 172.21.15.6:0/671602350 shutdown_connections 2023-09-13T09:57:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 -- 172.21.15.6:0/671602350 wait complete. 2023-09-13T09:57:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.957+0000 7f9ca278bb80 1 -- start start 2023-09-13T09:57:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 1 Processor -- start 2023-09-13T09:57:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d6e90 0x55b0f18e7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d7b90 0x55b0f18e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f18e49c0 con 0x55b0f18d6e90 2023-09-13T09:57:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f18e7980 con 0x55b0f18d7b90 2023-09-13T09:57:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0f18e7b10 con 0x55b0f18d84f0 2023-09-13T09:57:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9ca278bb80 10 client.0 _ll_register_callbacks cb 0x55b0f17c0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d6e90 0x55b0f18e7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d6e90 0x55b0f18e7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45116/0 (socket says 172.21.15.6:45116) 2023-09-13T09:57:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3799874010 learned_addr learned my addr 172.21.15.6:0/3799874010 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c94b43700 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d7b90 0x55b0f18e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3799874010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 msgr2=0x55b0f18e42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d7b90 msgr2=0x55b0f18e3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d7b90 0x55b0f18e3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.958+0000 7f9c8ffff700 1 -- 172.21.15.6:0/3799874010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0f183c820 con 0x55b0f18d6e90 2023-09-13T09:57:19.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9c8ffff700 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d6e90 0x55b0f18e7300 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f9c800a2450 tx=0x7f9c800cd100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35e2de60ab8bba9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9c6f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/3799874010 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c8009b010 con 0x55b0f18d6e90 2023-09-13T09:57:19.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/3799874010 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9c8009a910 con 0x55b0f18d6e90 2023-09-13T09:57:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c8401e040 con 0x55b0f18d6e90 2023-09-13T09:57:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/3799874010 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c8009e740 con 0x55b0f18d6e90 2023-09-13T09:57:19.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 10 client.20184 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55b0f1650e60 con 0x55b0f18d6e90 2023-09-13T09:57:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/3799874010 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c8007d020 con 0x55b0f18d6e90 2023-09-13T09:57:19.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/3799874010 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f9c800b1040 con 0x55b0f18d6e90 2023-09-13T09:57:19.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 10 client.20184 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:19.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 10 client.20184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:19.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 20 client.20184 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:19.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f19412a0 0x55b0f1943690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:19.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 4 client.20184 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:57:19.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.959+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b0f17de0d0 con 0x55b0f19412a0 2023-09-13T09:57:19.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.963+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f19412a0 0x55b0f1943690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:19.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.965+0000 7f9c6f7fe700 10 client.20184 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.965+0000 7f9c8f7fe700 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f19412a0 0x55b0f1943690 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=685c39025bd633de server_cookie=47b93ad404a6cd73 in_seq=0 out_seq=0 2023-09-13T09:57:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9c6f7fe700 1 -- 172.21.15.6:0/3799874010 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b0f17de0d0 con 0x55b0f19412a0 2023-09-13T09:57:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9c6f7fe700 10 client.20184 handle_command_reply: tid=0 2023-09-13T09:57:19.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 client.20184 shutdown 2023-09-13T09:57:19.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d6e90 msgr2=0x55b0f18e7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d6e90 0x55b0f18e7300 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f9c800a2450 tx=0x7f9c800cd100 comp rx=0 tx=0).stop 2023-09-13T09:57:19.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 shutdown_connections 2023-09-13T09:57:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b0f18d84f0 0x55b0f18e42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b0f19412a0 0x55b0f1943690 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b0f18d6e90 0x55b0f18e7300 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 --2- 172.21.15.6:0/3799874010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b0f18d7b90 0x55b0f18e3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9c6f7fe700 0 client.20184 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 >> 172.21.15.6:0/3799874010 conn(0x55b0f1830d00 msgr2=0x55b0f18e0270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 shutdown_connections 2023-09-13T09:57:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 1 -- 172.21.15.6:0/3799874010 wait complete. 2023-09-13T09:57:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.971+0000 7f9ca278bb80 20 client.20184 trim_cache size 0 max 16384 2023-09-13T09:57:19.992 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:57:19.992 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:57:19.993 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "4a09d04b-1541-4b86-8e02-48552dfff93d", 2023-09-13T09:57:19.993 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:57:19.993 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:57:19.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c780a0640 msgr2=0x7f9c780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c780a0640 0x7f9c780a2b00 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9c8400b580 tx=0x7f9c84005fb0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c900ffcc0 msgr2=0x7f9c90195960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c900ffcc0 0x7f9c90195960 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f9c8000ea80 tx=0x7f9c8000ed90 comp rx=0 tx=0).stop 2023-09-13T09:57:19.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 shutdown_connections 2023-09-13T09:57:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c90101850 0x7f9c9019cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c780a0640 0x7f9c780a2b00 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c900ffcc0 0x7f9c90195960 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 --2- 172.21.15.6:0/3113782980 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c90100eb0 0x7f9c90195ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:19.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 >> 172.21.15.6:0/3113782980 conn(0x7f9c900fb210 msgr2=0x7f9c90104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 shutdown_connections 2023-09-13T09:57:19.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:19.972+0000 7f9c965a6700 1 -- 172.21.15.6:0/3113782980 wait complete. 2023-09-13T09:57:19.997 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:57:20.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 -- 172.21.15.6:0/503508472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc100eb0 msgr2=0x7f04cc101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 --2- 172.21.15.6:0/503508472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc100eb0 0x7f04cc101310 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009990 tx=0x7f04b8009ca0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 -- 172.21.15.6:0/503508472 shutdown_connections 2023-09-13T09:57:20.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 --2- 172.21.15.6:0/503508472 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04cc101850 0x7f04cc068cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 --2- 172.21.15.6:0/503508472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04cc0ffcc0 0x7f04cc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 --2- 172.21.15.6:0/503508472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc100eb0 0x7f04cc101310 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 -- 172.21.15.6:0/503508472 >> 172.21.15.6:0/503508472 conn(0x7f04cc0fb210 msgr2=0x7f04cc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:20.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 -- 172.21.15.6:0/503508472 shutdown_connections 2023-09-13T09:57:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.163+0000 7f04d3015700 1 -- 172.21.15.6:0/503508472 wait complete. 2023-09-13T09:57:20.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 Processor -- start 2023-09-13T09:57:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 -- start start 2023-09-13T09:57:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc0ffcc0 0x7f04cc10dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04cc100eb0 0x7f04cc10e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04cc101850 0x7f04cc10a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc10afb0 con 0x7f04cc101850 2023-09-13T09:57:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc10b120 con 0x7f04cc100eb0 2023-09-13T09:57:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.164+0000 7f04d3015700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04cc10b2e0 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc0ffcc0 0x7f04cc10dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04cbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04cc100eb0 0x7f04cc10e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc0ffcc0 0x7f04cc10dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48184/0 (socket says 172.21.15.6:48184) 2023-09-13T09:57:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 -- 172.21.15.6:0/3655614648 learned_addr learned my addr 172.21.15.6:0/3655614648 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04cbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04cc100eb0 0x7f04cc10e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38654/0 (socket says 172.21.15.6:38654) 2023-09-13T09:57:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d15b2700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04cc101850 0x7f04cc10a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 -- 172.21.15.6:0/3655614648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04cc100eb0 msgr2=0x7f04cc10e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04cc100eb0 0x7f04cc10e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 -- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04cc101850 msgr2=0x7f04cc10a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04cc101850 0x7f04cc10a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 -- 172.21.15.6:0/3655614648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c0009520 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.165+0000 7f04d0db1700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc0ffcc0 0x7f04cc10dc80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04c000ea50 tx=0x7f04c000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.166+0000 7f04c9ffb700 1 -- 172.21.15.6:0/3655614648 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c000cbd0 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.166+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b80095f0 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.166+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc198d90 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.166+0000 7f04c9ffb700 1 -- 172.21.15.6:0/3655614648 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c000cd30 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.166+0000 7f04c9ffb700 1 -- 172.21.15.6:0/3655614648 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00186c0 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.169+0000 7f04c9ffb700 1 -- 172.21.15.6:0/3655614648 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f04c0018920 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.170+0000 7f04c9ffb700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04bc0a06c0 0x7f04bc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.170+0000 7f04c9ffb700 1 -- 172.21.15.6:0/3655614648 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04c0014070 con 0x7f04cc0ffcc0 2023-09-13T09:57:20.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.170+0000 7f04cbfff700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04bc0a06c0 0x7f04bc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.170+0000 7f04cbfff700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04bc0a06c0 0x7f04bc0a2b80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f04b800b2e0 tx=0x7f04b8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:20.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.170+0000 7f04df1fab80 1 Processor -- start 2023-09-13T09:57:20.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.170+0000 7f04df1fab80 1 -- start start 2023-09-13T09:57:20.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be73b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 0x55942be724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be72e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04df1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bdcb780 con 0x55942be73700 2023-09-13T09:57:20.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04df1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bdc90a0 con 0x55942be74060 2023-09-13T09:57:20.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04df1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bdc4990 con 0x55942be72a00 2023-09-13T09:57:20.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be73b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be73b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45138/0 (socket says 172.21.15.6:45138) 2023-09-13T09:57:20.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 -- 172.21.15.6:0/1624283665 learned_addr learned my addr 172.21.15.6:0/1624283665 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:20.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d15b2700 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be72e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04cbfff700 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 0x55942be724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 -- 172.21.15.6:0/1624283665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 msgr2=0x55942be72e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be72e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 -- 172.21.15.6:0/1624283665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 msgr2=0x55942be724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 0x55942be724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 -- 172.21.15.6:0/1624283665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942bc44630 con 0x55942be73700 2023-09-13T09:57:20.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04d0db1700 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be73b20 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f04c0096280 tx=0x7f04c00b9050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9185010a1ffccbb3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.171+0000 7f04b6ffd700 1 -- 172.21.15.6:0/1624283665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00ae070 con 0x55942be73700 2023-09-13T09:57:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04b6ffd700 1 -- 172.21.15.6:0/1624283665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c0099810 con 0x55942be73700 2023-09-13T09:57:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04b6ffd700 1 -- 172.21.15.6:0/1624283665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c0099cd0 con 0x55942be73700 2023-09-13T09:57:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 -- 172.21.15.6:0/1624283665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 msgr2=0x55942be73b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be73b20 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f04c0096280 tx=0x7f04c00b9050 comp rx=0 tx=0).stop 2023-09-13T09:57:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 -- 172.21.15.6:0/1624283665 shutdown_connections 2023-09-13T09:57:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be72e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be73b20 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 --2- 172.21.15.6:0/1624283665 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 0x55942be724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 -- 172.21.15.6:0/1624283665 >> 172.21.15.6:0/1624283665 conn(0x55942bdd0c80 msgr2=0x55942be6cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:20.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 -- 172.21.15.6:0/1624283665 shutdown_connections 2023-09-13T09:57:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.172+0000 7f04df1fab80 1 -- 172.21.15.6:0/1624283665 wait complete. 2023-09-13T09:57:20.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 -- start start 2023-09-13T09:57:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 Processor -- start 2023-09-13T09:57:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be72a00 0x55942be7bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be73700 0x55942be7c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 0x55942be83510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bd62bb0 con 0x55942be72a00 2023-09-13T09:57:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bd628b0 con 0x55942be74060 2023-09-13T09:57:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bc46920 con 0x55942be73700 2023-09-13T09:57:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04df1fab80 10 client.0 _ll_register_callbacks cb 0x55942bd60680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04d0db1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be72a00 0x55942be7bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04d0db1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be72a00 0x55942be7bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45144/0 (socket says 172.21.15.6:45144) 2023-09-13T09:57:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.173+0000 7f04d0db1700 1 -- 172.21.15.6:0/537789620 learned_addr learned my addr 172.21.15.6:0/537789620 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04cbfff700 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be73700 0x55942be7c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04d0db1700 1 -- 172.21.15.6:0/537789620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be73700 msgr2=0x55942be7c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04d0db1700 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be73700 0x55942be7c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04d0db1700 1 -- 172.21.15.6:0/537789620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 msgr2=0x55942be83510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04d0db1700 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 0x55942be83510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04d0db1700 1 -- 172.21.15.6:0/537789620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04cc198d90 con 0x55942be72a00 2023-09-13T09:57:20.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04d0db1700 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be72a00 0x55942be7bf90 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f04c00c9b70 tx=0x7f04c00995e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52fc34ba8be40921 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04abfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04abfff700 1 -- 172.21.15.6:0/537789620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c00ae070 con 0x55942be72a00 2023-09-13T09:57:20.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04abfff700 1 -- 172.21.15.6:0/537789620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04c00a1880 con 0x55942be72a00 2023-09-13T09:57:20.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55942be65670 con 0x55942be72a00 2023-09-13T09:57:20.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04abfff700 1 -- 172.21.15.6:0/537789620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04c0099c80 con 0x55942be72a00 2023-09-13T09:57:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04df1fab80 10 client.20196 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.174+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55942bddc7a0 con 0x55942be72a00 2023-09-13T09:57:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04abfff700 1 -- 172.21.15.6:0/537789620 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c00a5080 con 0x55942be72a00 2023-09-13T09:57:20.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04abfff700 1 -- 172.21.15.6:0/537789620 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f04c00a1bb0 con 0x55942be72a00 2023-09-13T09:57:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04df1fab80 10 client.20196 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04df1fab80 10 client.20196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04df1fab80 20 client.20196 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04df1fab80 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942be87910 0x55942be89d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04df1fab80 4 client.20196 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.175+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55942bdbd970 con 0x55942be87910 2023-09-13T09:57:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.176+0000 7f04cbfff700 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942be87910 0x55942be89d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.177+0000 7f04abfff700 10 client.20196 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:20.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.177+0000 7f04cbfff700 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942be87910 0x55942be89d30 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=966a21b249ee7aee server_cookie=44b67f313fd8243e in_seq=0 out_seq=0 2023-09-13T09:57:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.183+0000 7f04abfff700 1 -- 172.21.15.6:0/537789620 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55942bdbd970 con 0x55942be87910 2023-09-13T09:57:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.183+0000 7f04abfff700 10 client.20196 handle_command_reply: tid=0 2023-09-13T09:57:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.183+0000 7f04df1fab80 1 client.20196 shutdown 2023-09-13T09:57:20.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be72a00 msgr2=0x55942be7bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be72a00 0x55942be7bf90 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f04c00c9b70 tx=0x7f04c00995e0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 shutdown_connections 2023-09-13T09:57:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be74060 0x55942be83510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942be87910 0x55942be89d30 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be72a00 0x55942be7bf90 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04abfff700 0 client.20196 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 --2- 172.21.15.6:0/537789620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be73700 0x55942be7c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 >> 172.21.15.6:0/537789620 conn(0x55942bdd0c80 msgr2=0x55942be677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 shutdown_connections 2023-09-13T09:57:20.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 1 -- 172.21.15.6:0/537789620 wait complete. 2023-09-13T09:57:20.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.184+0000 7f04df1fab80 20 client.20196 trim_cache size 0 max 16384 2023-09-13T09:57:20.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 Processor -- start 2023-09-13T09:57:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 -- start start 2023-09-13T09:57:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be73700 0x55942be834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be74060 0x55942be83e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942be6d8a0 con 0x55942be74060 2023-09-13T09:57:20.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942be6e380 con 0x55942be73700 2023-09-13T09:57:20.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04df1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942be79bc0 con 0x55942be72a00 2023-09-13T09:57:20.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04d15b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be74060 0x55942be83e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04d15b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be74060 0x55942be83e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45156/0 (socket says 172.21.15.6:45156) 2023-09-13T09:57:20.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04d15b2700 1 -- 172.21.15.6:0/2061019181 learned_addr learned my addr 172.21.15.6:0/2061019181 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.205+0000 7f04d0db1700 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04d15b2700 1 -- 172.21.15.6:0/2061019181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 msgr2=0x55942be724c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04cbfff700 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be73700 0x55942be834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04d15b2700 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be724c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04d15b2700 1 -- 172.21.15.6:0/2061019181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be73700 msgr2=0x55942be834a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04d15b2700 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be73700 0x55942be834a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04d15b2700 1 -- 172.21.15.6:0/2061019181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55942bbf0de0 con 0x55942be74060 2023-09-13T09:57:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04cbfff700 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be73700 0x55942be834a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:57:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04d15b2700 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be74060 0x55942be83e00 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f04c40091e0 tx=0x7f04c40076e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab85db0b13f22d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:20.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04b77fe700 1 -- 172.21.15.6:0/2061019181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4016660 con 0x55942be74060 2023-09-13T09:57:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04b77fe700 1 -- 172.21.15.6:0/2061019181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04c400f040 con 0x55942be74060 2023-09-13T09:57:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.206+0000 7f04b77fe700 1 -- 172.21.15.6:0/2061019181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4015920 con 0x55942be74060 2023-09-13T09:57:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 -- 172.21.15.6:0/2061019181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be74060 msgr2=0x55942be83e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be74060 0x55942be83e00 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f04c40091e0 tx=0x7f04c40076e0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 -- 172.21.15.6:0/2061019181 shutdown_connections 2023-09-13T09:57:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be74060 0x55942be83e00 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be72a00 0x55942be724c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2061019181 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be73700 0x55942be834a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 -- 172.21.15.6:0/2061019181 >> 172.21.15.6:0/2061019181 conn(0x55942bdd0c80 msgr2=0x55942be7ac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:20.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 -- 172.21.15.6:0/2061019181 shutdown_connections 2023-09-13T09:57:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 -- 172.21.15.6:0/2061019181 wait complete. 2023-09-13T09:57:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 -- start start 2023-09-13T09:57:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.207+0000 7f04df1fab80 1 Processor -- start 2023-09-13T09:57:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be72a00 0x55942be83350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be7fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04df1fab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be74060 0x55942be80330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04df1fab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942be80a10 con 0x55942be73700 2023-09-13T09:57:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04df1fab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bedb730 con 0x55942be72a00 2023-09-13T09:57:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04df1fab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55942bedb8c0 con 0x55942be74060 2023-09-13T09:57:20.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04df1fab80 10 client.0 _ll_register_callbacks cb 0x55942bd60680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be7fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be7fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45160/0 (socket says 172.21.15.6:45160) 2023-09-13T09:57:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 -- 172.21.15.6:0/2239465823 learned_addr learned my addr 172.21.15.6:0/2239465823 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04d15b2700 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be74060 0x55942be80330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04d0db1700 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be72a00 0x55942be83350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 -- 172.21.15.6:0/2239465823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be74060 msgr2=0x55942be80330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be74060 0x55942be80330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 -- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be72a00 msgr2=0x55942be83350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be72a00 0x55942be83350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.208+0000 7f04cbfff700 1 -- 172.21.15.6:0/2239465823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c4009a10 con 0x55942be73700 2023-09-13T09:57:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04cbfff700 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be7fdf0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009990 tx=0x7f04b801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d2979c1c776fd0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04abfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04abfff700 1 -- 172.21.15.6:0/2239465823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b802d030 con 0x55942be73700 2023-09-13T09:57:20.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04abfff700 1 -- 172.21.15.6:0/2239465823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04b8034b80 con 0x55942be73700 2023-09-13T09:57:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04c0099810 con 0x55942be73700 2023-09-13T09:57:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04abfff700 1 -- 172.21.15.6:0/2239465823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04b8034d40 con 0x55942be73700 2023-09-13T09:57:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04df1fab80 10 client.20202 fetch_fsmap learned FSMap version 63 2023-09-13T09:57:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55942bbd9c60 con 0x55942be73700 2023-09-13T09:57:20.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.209+0000 7f04abfff700 1 -- 172.21.15.6:0/2239465823 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04b8043020 con 0x55942be73700 2023-09-13T09:57:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.210+0000 7f04abfff700 1 -- 172.21.15.6:0/2239465823 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 63) v1 ==== 7886+0+0 (secure 0 0 0) 0x7f04b800f6c0 con 0x55942be73700 2023-09-13T09:57:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.210+0000 7f04df1fab80 10 client.20202 fetch_fsmap finished waiting for FSMap version 63 2023-09-13T09:57:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.210+0000 7f04df1fab80 10 client.20202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.210+0000 7f04df1fab80 20 client.20202 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:20.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.210+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942bedd2b0 0x55942bedf6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.210+0000 7f04df1fab80 4 client.20202 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:57:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.210+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55942bd7e050 con 0x55942bedd2b0 2023-09-13T09:57:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.211+0000 7f04d0db1700 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942bedd2b0 0x55942bedf6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.211+0000 7f04d0db1700 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942bedd2b0 0x55942bedf6d0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecab15f1f5b2f2da server_cookie=5d888f526ad20be3 in_seq=0 out_seq=0 2023-09-13T09:57:20.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.211+0000 7f04abfff700 10 client.20202 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.216+0000 7f04abfff700 1 -- 172.21.15.6:0/2239465823 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55942bd7e050 con 0x55942bedd2b0 2023-09-13T09:57:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.216+0000 7f04abfff700 10 client.20202 handle_command_reply: tid=0 2023-09-13T09:57:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.216+0000 7f04df1fab80 1 client.20202 shutdown 2023-09-13T09:57:20.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.216+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 msgr2=0x55942be7fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.216+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be7fdf0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f04b8009990 tx=0x7f04b801a050 comp rx=0 tx=0).stop 2023-09-13T09:57:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 shutdown_connections 2023-09-13T09:57:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55942be74060 0x55942be80330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55942be72a00 0x55942be83350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55942bedd2b0 0x55942bedf6d0 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 --2- 172.21.15.6:0/2239465823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55942be73700 0x55942be7fdf0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 >> 172.21.15.6:0/2239465823 conn(0x55942bdd0c80 msgr2=0x55942be76940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04abfff700 0 client.20202 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 shutdown_connections 2023-09-13T09:57:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 1 -- 172.21.15.6:0/2239465823 wait complete. 2023-09-13T09:57:20.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.217+0000 7f04df1fab80 20 client.20202 trim_cache size 0 max 16384 2023-09-13T09:57:20.242 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:57:20.242 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (17 inodes in the stack)", 2023-09-13T09:57:20.242 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:57:20.243 INFO:teuthology.orchestra.run.smithi006.stdout: "4a09d04b-1541-4b86-8e02-48552dfff93d": { 2023-09-13T09:57:20.243 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:57:20.243 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "4a09d04b-1541-4b86-8e02-48552dfff93d", 2023-09-13T09:57:20.243 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:57:20.243 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:57:20.244 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:57:20.244 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:57:20.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04bc0a06c0 msgr2=0x7f04bc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04bc0a06c0 0x7f04bc0a2b80 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f04b800b2e0 tx=0x7f04b8005fb0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc0ffcc0 msgr2=0x7f04cc10dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc0ffcc0 0x7f04cc10dc80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f04c000ea50 tx=0x7f04c000ed60 comp rx=0 tx=0).stop 2023-09-13T09:57:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 shutdown_connections 2023-09-13T09:57:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04bc0a06c0 0x7f04bc0a2b80 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04cc101850 0x7f04cc10a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04cc0ffcc0 0x7f04cc10dc80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 --2- 172.21.15.6:0/3655614648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04cc100eb0 0x7f04cc10e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 >> 172.21.15.6:0/3655614648 conn(0x7f04cc0fb210 msgr2=0x7f04cc109c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 shutdown_connections 2023-09-13T09:57:20.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:20.218+0000 7f04d3015700 1 -- 172.21.15.6:0/3655614648 wait complete. 2023-09-13T09:57:20.247 INFO:tasks.cephfs.filesystem:scrub status for tag:4a09d04b-1541-4b86-8e02-48552dfff93d - {'path': '/', 'tag': '4a09d04b-1541-4b86-8e02-48552dfff93d', 'options': 'recursive,force'} 2023-09-13T09:57:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:20 smithi006 ceph-mon[98665]: pgmap v834: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 799 op/s 2023-09-13T09:57:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:20 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:20 smithi053 ceph-mon[102373]: pgmap v834: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 799 op/s 2023-09-13T09:57:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:20 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:20 smithi131 ceph-mon[102785]: pgmap v834: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 799 op/s 2023-09-13T09:57:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:20 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:20.574 INFO:tasks.workunit.client.0.smithi006.stdout: 10 197272 37.30 MB/sec execute 160 sec latency 556.401 ms 2023-09-13T09:57:21.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:57:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:21.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:21 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:57:21.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:21.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:21 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:57:21.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:21.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:21 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:21.574 INFO:tasks.workunit.client.0.smithi006.stdout: 10 197722 37.23 MB/sec execute 161 sec latency 100.240 ms 2023-09-13T09:57:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:22 smithi006 ceph-mon[98665]: pgmap v835: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 812 op/s 2023-09-13T09:57:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:22.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:22 smithi053 ceph-mon[102373]: pgmap v835: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 812 op/s 2023-09-13T09:57:22.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:22 smithi131 ceph-mon[102785]: pgmap v835: 97 pgs: 97 active+clean; 1.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 17 MiB/s wr, 812 op/s 2023-09-13T09:57:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:22.574 INFO:tasks.workunit.client.0.smithi006.stdout: 10 198338 37.14 MB/sec execute 162 sec latency 83.072 ms 2023-09-13T09:57:23.574 INFO:tasks.workunit.client.0.smithi006.stdout: 10 199223 37.22 MB/sec execute 163 sec latency 70.866 ms 2023-09-13T09:57:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:24 smithi006 ceph-mon[98665]: pgmap v836: 97 pgs: 97 active+clean; 1.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 20 MiB/s wr, 1.04k op/s 2023-09-13T09:57:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:24 smithi053 ceph-mon[102373]: pgmap v836: 97 pgs: 97 active+clean; 1.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 20 MiB/s wr, 1.04k op/s 2023-09-13T09:57:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:24 smithi131 ceph-mon[102785]: pgmap v836: 97 pgs: 97 active+clean; 1.1 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 20 MiB/s wr, 1.04k op/s 2023-09-13T09:57:24.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 200085 37.30 MB/sec execute 164 sec latency 46.203 ms 2023-09-13T09:57:25.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 200778 37.33 MB/sec execute 165 sec latency 60.769 ms 2023-09-13T09:57:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:26 smithi006 ceph-mon[98665]: pgmap v837: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.05k op/s 2023-09-13T09:57:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:26 smithi053 ceph-mon[102373]: pgmap v837: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.05k op/s 2023-09-13T09:57:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:26 smithi131 ceph-mon[102785]: pgmap v837: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 21 MiB/s wr, 1.05k op/s 2023-09-13T09:57:26.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 201404 37.26 MB/sec execute 166 sec latency 74.544 ms 2023-09-13T09:57:27.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 202215 37.26 MB/sec execute 167 sec latency 73.785 ms 2023-09-13T09:57:28.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:28 smithi006 ceph-mon[98665]: pgmap v838: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 20 MiB/s wr, 1.08k op/s 2023-09-13T09:57:28.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:28 smithi053 ceph-mon[102373]: pgmap v838: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 20 MiB/s wr, 1.08k op/s 2023-09-13T09:57:28.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:28 smithi131 ceph-mon[102785]: pgmap v838: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 20 MiB/s wr, 1.08k op/s 2023-09-13T09:57:28.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 203067 37.36 MB/sec execute 168 sec latency 63.874 ms 2023-09-13T09:57:29.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 203787 37.36 MB/sec execute 169 sec latency 72.208 ms 2023-09-13T09:57:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:30 smithi006 ceph-mon[98665]: pgmap v839: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 14 MiB/s wr, 942 op/s 2023-09-13T09:57:30.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:30 smithi053 ceph-mon[102373]: pgmap v839: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 14 MiB/s wr, 942 op/s 2023-09-13T09:57:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:30 smithi131 ceph-mon[102785]: pgmap v839: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 14 MiB/s wr, 942 op/s 2023-09-13T09:57:30.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 204514 37.38 MB/sec execute 170 sec latency 58.029 ms 2023-09-13T09:57:31.575 INFO:tasks.workunit.client.0.smithi006.stdout: 10 205327 37.41 MB/sec execute 171 sec latency 53.616 ms 2023-09-13T09:57:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:32 smithi006 ceph-mon[98665]: pgmap v840: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 853 op/s 2023-09-13T09:57:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:32 smithi053 ceph-mon[102373]: pgmap v840: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 853 op/s 2023-09-13T09:57:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:32 smithi131 ceph-mon[102785]: pgmap v840: 97 pgs: 97 active+clean; 1.1 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 12 MiB/s wr, 853 op/s 2023-09-13T09:57:32.576 INFO:tasks.workunit.client.0.smithi006.stdout: 10 206013 37.40 MB/sec execute 172 sec latency 64.457 ms 2023-09-13T09:57:33.576 INFO:tasks.workunit.client.0.smithi006.stdout: 10 206708 37.42 MB/sec execute 173 sec latency 71.610 ms 2023-09-13T09:57:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:34 smithi006 ceph-mon[98665]: pgmap v841: 97 pgs: 97 active+clean; 1.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 887 op/s 2023-09-13T09:57:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:34 smithi053 ceph-mon[102373]: pgmap v841: 97 pgs: 97 active+clean; 1.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 887 op/s 2023-09-13T09:57:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:34 smithi131 ceph-mon[102785]: pgmap v841: 97 pgs: 97 active+clean; 1.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 887 op/s 2023-09-13T09:57:34.576 INFO:tasks.workunit.client.0.smithi006.stdout: 10 207430 37.38 MB/sec execute 174 sec latency 80.524 ms 2023-09-13T09:57:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:35.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:35.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:35.576 INFO:tasks.workunit.client.0.smithi006.stdout: 10 208260 37.47 MB/sec execute 175 sec latency 70.959 ms 2023-09-13T09:57:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:36 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:57:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:36 smithi006 ceph-mon[98665]: pgmap v842: 97 pgs: 97 active+clean; 1.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.3 MiB/s wr, 704 op/s 2023-09-13T09:57:36.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:36 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:36 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:57:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:36 smithi053 ceph-mon[102373]: pgmap v842: 97 pgs: 97 active+clean; 1.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.3 MiB/s wr, 704 op/s 2023-09-13T09:57:36.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:36 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:36.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:36 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:57:36.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:36 smithi131 ceph-mon[102785]: pgmap v842: 97 pgs: 97 active+clean; 1.1 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 7.3 MiB/s wr, 704 op/s 2023-09-13T09:57:36.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:36 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:36.576 INFO:tasks.workunit.client.0.smithi006.stdout: 10 209011 37.51 MB/sec execute 176 sec latency 52.506 ms 2023-09-13T09:57:37.576 INFO:tasks.workunit.client.0.smithi006.stdout: 10 209621 37.47 MB/sec execute 177 sec latency 108.667 ms 2023-09-13T09:57:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:38 smithi006 ceph-mon[98665]: pgmap v843: 97 pgs: 97 active+clean; 1.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 661 op/s 2023-09-13T09:57:38.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:38 smithi053 ceph-mon[102373]: pgmap v843: 97 pgs: 97 active+clean; 1.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 661 op/s 2023-09-13T09:57:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:38 smithi131 ceph-mon[102785]: pgmap v843: 97 pgs: 97 active+clean; 1.2 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.4 MiB/s wr, 661 op/s 2023-09-13T09:57:38.577 INFO:tasks.workunit.client.0.smithi006.stdout: 10 210338 37.43 MB/sec execute 178 sec latency 63.818 ms 2023-09-13T09:57:39.577 INFO:tasks.workunit.client.0.smithi006.stdout: 10 211032 37.47 MB/sec execute 179 sec latency 186.646 ms 2023-09-13T09:57:40.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:40 smithi053 ceph-mon[102373]: pgmap v844: 97 pgs: 97 active+clean; 1.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 582 op/s 2023-09-13T09:57:40.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:40 smithi006 ceph-mon[98665]: pgmap v844: 97 pgs: 97 active+clean; 1.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 582 op/s 2023-09-13T09:57:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:40 smithi131 ceph-mon[102785]: pgmap v844: 97 pgs: 97 active+clean; 1.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 582 op/s 2023-09-13T09:57:40.577 INFO:tasks.workunit.client.0.smithi006.stdout: 10 211342 37.36 MB/sec execute 180 sec latency 544.828 ms 2023-09-13T09:57:41.577 INFO:tasks.workunit.client.0.smithi006.stdout: 10 211981 37.32 MB/sec execute 181 sec latency 56.555 ms 2023-09-13T09:57:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:42 smithi006 ceph-mon[98665]: pgmap v845: 97 pgs: 97 active+clean; 1.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-13T09:57:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:42 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:57:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:42 smithi053 ceph-mon[102373]: pgmap v845: 97 pgs: 97 active+clean; 1.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-13T09:57:42.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:42 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:57:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:42 smithi131 ceph-mon[102785]: pgmap v845: 97 pgs: 97 active+clean; 1.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-13T09:57:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:42 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:57:42.577 INFO:tasks.workunit.client.0.smithi006.stdout: 10 212546 37.29 MB/sec execute 182 sec latency 118.126 ms 2023-09-13T09:57:43.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:43 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:43 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:43 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:43.577 INFO:tasks.workunit.client.0.smithi006.stdout: 10 213185 37.27 MB/sec execute 183 sec latency 87.546 ms 2023-09-13T09:57:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: pgmap v846: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 621 op/s 2023-09-13T09:57:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-09-13T09:57:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: Unable to set osd_memory_target on smithi006 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-09-13T09:57:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:57:44.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:57:44.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:57:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: pgmap v846: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 621 op/s 2023-09-13T09:57:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-09-13T09:57:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: Unable to set osd_memory_target on smithi006 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-09-13T09:57:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:57:44.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:57:44.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:57:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: pgmap v846: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.5 MiB/s wr, 621 op/s 2023-09-13T09:57:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi006 to 197.2M 2023-09-13T09:57:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: Unable to set osd_memory_target on smithi006 to 206875648: error parsing value: Value '206875648' is below minimum 939524096 2023-09-13T09:57:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:57:44.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:57:44.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:57:44.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:57:44.577 INFO:tasks.workunit.client.0.smithi006.stdout: 10 213845 37.24 MB/sec execute 184 sec latency 191.385 ms 2023-09-13T09:57:45.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:45 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi053 to 197.2M 2023-09-13T09:57:45.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:45 smithi006 ceph-mon[98665]: Unable to set osd_memory_target on smithi053 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-09-13T09:57:45.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:45 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi053 to 197.2M 2023-09-13T09:57:45.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:45 smithi053 ceph-mon[102373]: Unable to set osd_memory_target on smithi053 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-09-13T09:57:45.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:45 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi053 to 197.2M 2023-09-13T09:57:45.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:45 smithi131 ceph-mon[102785]: Unable to set osd_memory_target on smithi053 to 206877081: error parsing value: Value '206877081' is below minimum 939524096 2023-09-13T09:57:45.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 214128 37.12 MB/sec execute 185 sec latency 542.009 ms 2023-09-13T09:57:46.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:46 smithi006 ceph-mon[98665]: pgmap v847: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 550 op/s 2023-09-13T09:57:46.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:46 smithi053 ceph-mon[102373]: pgmap v847: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 550 op/s 2023-09-13T09:57:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:46 smithi131 ceph-mon[102785]: pgmap v847: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 550 op/s 2023-09-13T09:57:46.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 214233 36.95 MB/sec execute 186 sec latency 1291.655 ms 2023-09-13T09:57:47.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 214669 36.89 MB/sec execute 187 sec latency 120.536 ms 2023-09-13T09:57:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:48 smithi006 ceph-mon[98665]: pgmap v848: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 700 op/s 2023-09-13T09:57:48.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:48 smithi053 ceph-mon[102373]: pgmap v848: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 700 op/s 2023-09-13T09:57:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:48 smithi131 ceph-mon[102785]: pgmap v848: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 700 op/s 2023-09-13T09:57:48.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 215205 36.88 MB/sec execute 188 sec latency 99.426 ms 2023-09-13T09:57:49.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 215813 36.82 MB/sec execute 189 sec latency 62.779 ms 2023-09-13T09:57:50.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:57:50.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 -- 172.21.15.6:0/2978580738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f393c100dc0 msgr2=0x7f393c1011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 --2- 172.21.15.6:0/2978580738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f393c100dc0 0x7f393c1011e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f392c0098f0 tx=0x7f392c009c00 comp rx=0 tx=0).stop 2023-09-13T09:57:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 -- 172.21.15.6:0/2978580738 shutdown_connections 2023-09-13T09:57:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 --2- 172.21.15.6:0/2978580738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c102950 0x7f393c109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 --2- 172.21.15.6:0/2978580738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f393c100dc0 0x7f393c1011e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 --2- 172.21.15.6:0/2978580738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393c101fb0 0x7f393c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 -- 172.21.15.6:0/2978580738 >> 172.21.15.6:0/2978580738 conn(0x7f393c0fc330 msgr2=0x7f393c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 -- 172.21.15.6:0/2978580738 shutdown_connections 2023-09-13T09:57:50.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.481+0000 7f3940a87700 1 -- 172.21.15.6:0/2978580738 wait complete. 2023-09-13T09:57:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 Processor -- start 2023-09-13T09:57:50.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 -- start start 2023-09-13T09:57:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393c100dc0 0x7f393c074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c101fb0 0x7f393c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f393c102950 0x7f393c0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c073d80 con 0x7f393c100dc0 2023-09-13T09:57:50.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c073ef0 con 0x7f393c101fb0 2023-09-13T09:57:50.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3940a87700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f393c1a0bc0 con 0x7f393c102950 2023-09-13T09:57:50.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f393a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393c100dc0 0x7f393c074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.483+0000 7f3939d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c101fb0 0x7f393c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.484+0000 7f3939d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c101fb0 0x7f393c0730a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38696/0 (socket says 172.21.15.6:38696) 2023-09-13T09:57:50.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.484+0000 7f3939d9b700 1 -- 172.21.15.6:0/2476362153 learned_addr learned my addr 172.21.15.6:0/2476362153 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:50.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.484+0000 7f3939d9b700 1 -- 172.21.15.6:0/2476362153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f393c102950 msgr2=0x7f393c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.484+0000 7f3939d9b700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f393c102950 0x7f393c0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.484+0000 7f3939d9b700 1 -- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393c100dc0 msgr2=0x7f393c074a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.484+0000 7f3939d9b700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393c100dc0 0x7f393c074a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.484+0000 7f3939d9b700 1 -- 172.21.15.6:0/2476362153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c009520 con 0x7f393c101fb0 2023-09-13T09:57:50.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.485+0000 7f3939d9b700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c101fb0 0x7f393c0730a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f393000e9c0 tx=0x7f393000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.485+0000 7f392b7fe700 1 -- 172.21.15.6:0/2476362153 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393000cbd0 con 0x7f393c101fb0 2023-09-13T09:57:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.485+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f393c1967e0 con 0x7f393c101fb0 2023-09-13T09:57:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.485+0000 7f392b7fe700 1 -- 172.21.15.6:0/2476362153 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f393000eeb0 con 0x7f393c101fb0 2023-09-13T09:57:50.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.485+0000 7f392b7fe700 1 -- 172.21.15.6:0/2476362153 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3930005580 con 0x7f393c101fb0 2023-09-13T09:57:50.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.485+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c196d70 con 0x7f393c101fb0 2023-09-13T09:57:50.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.489+0000 7f392b7fe700 1 -- 172.21.15.6:0/2476362153 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3930010430 con 0x7f393c101fb0 2023-09-13T09:57:50.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.489+0000 7f394cc6cb80 1 Processor -- start 2023-09-13T09:57:50.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.490+0000 7f392b7fe700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39240a06c0 0x7f39240a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.490+0000 7f392b7fe700 1 -- 172.21.15.6:0/2476362153 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3930014070 con 0x7f393c101fb0 2023-09-13T09:57:50.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f394cc6cb80 1 -- start start 2023-09-13T09:57:50.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e6cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 0x559df0e6b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e6be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0db3780 con 0x559df0e6c710 2023-09-13T09:57:50.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0db10a0 con 0x559df0e6d070 2023-09-13T09:57:50.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0dac990 con 0x559df0e6ba10 2023-09-13T09:57:50.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f393a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e6cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f393a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e6cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45180/0 (socket says 172.21.15.6:45180) 2023-09-13T09:57:50.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.491+0000 7f393a59c700 1 -- 172.21.15.6:0/303082025 learned_addr learned my addr 172.21.15.6:0/303082025 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:50.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f393a59c700 1 -- 172.21.15.6:0/303082025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 msgr2=0x559df0e6be70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:50.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f393a59c700 1 --2- 172.21.15.6:0/303082025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e6be70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f393a59c700 1 -- 172.21.15.6:0/303082025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 msgr2=0x559df0e6b4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:50.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f393a59c700 1 --2- 172.21.15.6:0/303082025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 0x559df0e6b4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f393a59c700 1 -- 172.21.15.6:0/303082025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559df0c2c630 con 0x559df0e6c710 2023-09-13T09:57:50.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f393ad9d700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39240a06c0 0x7f39240a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f393a59c700 1 --2- 172.21.15.6:0/303082025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e6cb30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f392c0098c0 tx=0x7f392c005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425c3e0fe26d29a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f3928ff9700 1 -- 172.21.15.6:0/303082025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c00b560 con 0x559df0e6c710 2023-09-13T09:57:50.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f3928ff9700 1 -- 172.21.15.6:0/303082025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f392c01d040 con 0x559df0e6c710 2023-09-13T09:57:50.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.492+0000 7f3928ff9700 1 -- 172.21.15.6:0/303082025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c003680 con 0x559df0e6c710 2023-09-13T09:57:50.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.493+0000 7f394cc6cb80 1 -- 172.21.15.6:0/303082025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 msgr2=0x559df0e6cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.493+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/303082025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e6cb30 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f392c0098c0 tx=0x7f392c005dc0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.494+0000 7f394cc6cb80 1 -- 172.21.15.6:0/303082025 shutdown_connections 2023-09-13T09:57:50.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.494+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/303082025 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e6be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.494+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/303082025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e6cb30 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.494+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/303082025 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 0x559df0e6b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.494+0000 7f394cc6cb80 1 -- 172.21.15.6:0/303082025 >> 172.21.15.6:0/303082025 conn(0x559df0db8c80 msgr2=0x559df0e54f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:50.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.495+0000 7f393ad9d700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39240a06c0 0x7f39240a2b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f393c0750c0 tx=0x7f3934009250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.496+0000 7f394cc6cb80 1 -- 172.21.15.6:0/303082025 shutdown_connections 2023-09-13T09:57:50.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.498+0000 7f394cc6cb80 1 -- 172.21.15.6:0/303082025 wait complete. 2023-09-13T09:57:50.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 -- start start 2023-09-13T09:57:50.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 Processor -- start 2023-09-13T09:57:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 0x559df0e5c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e63640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0d4abb0 con 0x559df0e6d070 2023-09-13T09:57:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0d4a8b0 con 0x559df0e6ba10 2023-09-13T09:57:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0c2e920 con 0x559df0e6c710 2023-09-13T09:57:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.499+0000 7f394cc6cb80 10 client.0 _ll_register_callbacks cb 0x559df0d48680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:50.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5c0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38708/0 (socket says 172.21.15.6:38708) 2023-09-13T09:57:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 -- 172.21.15.6:0/1230880958 learned_addr learned my addr 172.21.15.6:0/1230880958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 -- 172.21.15.6:0/1230880958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 msgr2=0x559df0e5c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 0x559df0e5c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 -- 172.21.15.6:0/1230880958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 msgr2=0x559df0e63640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:50.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e63640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 -- 172.21.15.6:0/1230880958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393c109b50 con 0x559df0e6ba10 2023-09-13T09:57:50.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f393a59c700 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5c0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f392c00bbc0 tx=0x7f392c00bbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51dc1ffcce0110b3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.500+0000 7f3921ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:57:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f3921ffb700 1 -- 172.21.15.6:0/1230880958 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c005070 con 0x559df0e6ba10 2023-09-13T09:57:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559df0e4d670 con 0x559df0e6ba10 2023-09-13T09:57:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f3921ffb700 1 -- 172.21.15.6:0/1230880958 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f392c003680 con 0x559df0e6ba10 2023-09-13T09:57:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f3921ffb700 1 -- 172.21.15.6:0/1230880958 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f392c0051d0 con 0x559df0e6ba10 2023-09-13T09:57:50.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 10 client.29462 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x559df0dc47a0 con 0x559df0e6ba10 2023-09-13T09:57:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f3921ffb700 1 -- 172.21.15.6:0/1230880958 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f392c039020 con 0x559df0e6ba10 2023-09-13T09:57:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f3921ffb700 1 -- 172.21.15.6:0/1230880958 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f392c015020 con 0x559df0e6ba10 2023-09-13T09:57:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 10 client.29462 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 10 client.29462 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:50.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 20 client.29462 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0e67ac0 0x559df0e69ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 4 client.29462 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.502+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559df0da5970 con 0x559df0e67ac0 2023-09-13T09:57:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.503+0000 7f3939d9b700 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0e67ac0 0x559df0e69ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.505+0000 7f3939d9b700 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0e67ac0 0x559df0e69ee0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee15d446fdf377e0 server_cookie=b52267a5f6feaef9 in_seq=0 out_seq=0 2023-09-13T09:57:50.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.505+0000 7f3921ffb700 10 client.29462 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:50.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:50 smithi006 ceph-mon[98665]: pgmap v849: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 12 MiB/s wr, 672 op/s 2023-09-13T09:57:50.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.506+0000 7f3921ffb700 1 -- 172.21.15.6:0/1230880958 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559df0da5970 con 0x559df0e67ac0 2023-09-13T09:57:50.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.506+0000 7f3921ffb700 10 client.29462 handle_command_reply: tid=0 2023-09-13T09:57:50.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.507+0000 7f394cc6cb80 1 client.29462 shutdown 2023-09-13T09:57:50.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:50 smithi053 ceph-mon[102373]: pgmap v849: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 12 MiB/s wr, 672 op/s 2023-09-13T09:57:50.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 msgr2=0x559df0e5c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5c0c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f392c00bbc0 tx=0x7f392c00bbf0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 shutdown_connections 2023-09-13T09:57:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0e67ac0 0x559df0e69ee0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e63640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5c0c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/1230880958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 0x559df0e5c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f3921ffb700 0 client.29462 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 >> 172.21.15.6:0/1230880958 conn(0x559df0db8c80 msgr2=0x559df0e4f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 shutdown_connections 2023-09-13T09:57:50.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 1 -- 172.21.15.6:0/1230880958 wait complete. 2023-09-13T09:57:50.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.510+0000 7f394cc6cb80 20 client.29462 trim_cache size 0 max 16384 2023-09-13T09:57:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:50 smithi131 ceph-mon[102785]: pgmap v849: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 12 MiB/s wr, 672 op/s 2023-09-13T09:57:50.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 Processor -- start 2023-09-13T09:57:50.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 -- start start 2023-09-13T09:57:50.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5a880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 0x559df0e63600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e5adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0e5cf90 con 0x559df0e6d070 2023-09-13T09:57:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0da5970 con 0x559df0e6ba10 2023-09-13T09:57:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0e56370 con 0x559df0e6c710 2023-09-13T09:57:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f393ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e5adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f393ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e5adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45190/0 (socket says 172.21.15.6:45190) 2023-09-13T09:57:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f3939d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 0x559df0e63600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.540+0000 7f393ad9d700 1 -- 172.21.15.6:0/3404611411 learned_addr learned my addr 172.21.15.6:0/3404611411 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.541+0000 7f393ad9d700 1 -- 172.21.15.6:0/3404611411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 msgr2=0x559df0e63600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.541+0000 7f393ad9d700 1 --2- 172.21.15.6:0/3404611411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 0x559df0e63600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.541+0000 7f393ad9d700 1 -- 172.21.15.6:0/3404611411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 msgr2=0x559df0e5a880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.541+0000 7f393ad9d700 1 --2- 172.21.15.6:0/3404611411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5a880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.541+0000 7f393ad9d700 1 -- 172.21.15.6:0/3404611411 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559df0bd8de0 con 0x559df0e6d070 2023-09-13T09:57:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.541+0000 7f393ad9d700 1 --2- 172.21.15.6:0/3404611411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e5adc0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f393400cdd0 tx=0x7f393400f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681c47249096747 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.542+0000 7f39297fa700 1 -- 172.21.15.6:0/3404611411 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f393400dd10 con 0x559df0e6d070 2023-09-13T09:57:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.542+0000 7f39297fa700 1 -- 172.21.15.6:0/3404611411 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f393400de70 con 0x559df0e6d070 2023-09-13T09:57:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.542+0000 7f39297fa700 1 -- 172.21.15.6:0/3404611411 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934018730 con 0x559df0e6d070 2023-09-13T09:57:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.543+0000 7f394cc6cb80 1 -- 172.21.15.6:0/3404611411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 msgr2=0x559df0e5adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.543+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/3404611411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e5adc0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f393400cdd0 tx=0x7f393400f000 comp rx=0 tx=0).stop 2023-09-13T09:57:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 -- 172.21.15.6:0/3404611411 shutdown_connections 2023-09-13T09:57:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/3404611411 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6d070 0x559df0e5adc0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/3404611411 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6ba10 0x559df0e5a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/3404611411 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6c710 0x559df0e63600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 -- 172.21.15.6:0/3404611411 >> 172.21.15.6:0/3404611411 conn(0x559df0db8c80 msgr2=0x559df0e6fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 -- 172.21.15.6:0/3404611411 shutdown_connections 2023-09-13T09:57:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 -- 172.21.15.6:0/3404611411 wait complete. 2023-09-13T09:57:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 -- start start 2023-09-13T09:57:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.544+0000 7f394cc6cb80 1 Processor -- start 2023-09-13T09:57:50.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e60750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e60c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f394cc6cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 0x559df0e61ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0e621e0 con 0x559df0e6c710 2023-09-13T09:57:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0e62350 con 0x559df0e6d070 2023-09-13T09:57:50.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f394cc6cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df0e62510 con 0x559df0e6ba10 2023-09-13T09:57:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f394cc6cb80 10 client.0 _ll_register_callbacks cb 0x559df0d48680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e60750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e60750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48248/0 (socket says 172.21.15.6:48248) 2023-09-13T09:57:50.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 -- 172.21.15.6:0/4012153233 learned_addr learned my addr 172.21.15.6:0/4012153233 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 -- 172.21.15.6:0/4012153233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 msgr2=0x559df0e61ca0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:57:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 0x559df0e61ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 -- 172.21.15.6:0/4012153233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 msgr2=0x559df0e60c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e60c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.545+0000 7f393a59c700 1 -- 172.21.15.6:0/4012153233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f393400ca80 con 0x559df0e6ba10 2023-09-13T09:57:50.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f393a59c700 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e60750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f392c035fd0 tx=0x7f392c001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363515b55574e1de server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f3921ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f3921ffb700 1 -- 172.21.15.6:0/4012153233 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f392c0054d0 con 0x559df0e6ba10 2023-09-13T09:57:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f392c01d040 con 0x559df0e6ba10 2023-09-13T09:57:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f3921ffb700 1 -- 172.21.15.6:0/4012153233 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f392c03a080 con 0x559df0e6ba10 2023-09-13T09:57:50.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f3921ffb700 1 -- 172.21.15.6:0/4012153233 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f392c005630 con 0x559df0e6ba10 2023-09-13T09:57:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f394cc6cb80 10 client.29434 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x559df0bc1c60 con 0x559df0e6ba10 2023-09-13T09:57:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.546+0000 7f3921ffb700 1 -- 172.21.15.6:0/4012153233 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f392c01d040 con 0x559df0e6ba10 2023-09-13T09:57:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.547+0000 7f3921ffb700 1 -- 172.21.15.6:0/4012153233 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f392c015030 con 0x559df0e6ba10 2023-09-13T09:57:50.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.547+0000 7f394cc6cb80 10 client.29434 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.547+0000 7f394cc6cb80 10 client.29434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.547+0000 7f394cc6cb80 20 client.29434 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.547+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0ee6930 0x559df0ee8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.547+0000 7f394cc6cb80 4 client.29434 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:57:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.547+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559df0d66050 con 0x559df0ee6930 2023-09-13T09:57:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.549+0000 7f3939d9b700 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0ee6930 0x559df0ee8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.550+0000 7f3921ffb700 10 client.29434 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:50.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.550+0000 7f3939d9b700 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0ee6930 0x559df0ee8d20 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ed6c5417140730 server_cookie=cb33d09dc0be46f3 in_seq=0 out_seq=0 2023-09-13T09:57:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.558+0000 7f3921ffb700 1 -- 172.21.15.6:0/4012153233 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559df0d66050 con 0x559df0ee6930 2023-09-13T09:57:50.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.558+0000 7f3921ffb700 10 client.29434 handle_command_reply: tid=0 2023-09-13T09:57:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 client.29434 shutdown 2023-09-13T09:57:50.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 msgr2=0x559df0e60750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e60750 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f392c035fd0 tx=0x7f392c001e70 comp rx=0 tx=0).stop 2023-09-13T09:57:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 shutdown_connections 2023-09-13T09:57:50.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559df0e6d070 0x559df0e61ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559df0e6ba10 0x559df0e60750 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559df0ee6930 0x559df0ee8d20 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 --2- 172.21.15.6:0/4012153233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559df0e6c710 0x559df0e60c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f3921ffb700 0 client.29434 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:50.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.562+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 >> 172.21.15.6:0/4012153233 conn(0x559df0db8c80 msgr2=0x559df0e594b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:50.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.563+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 shutdown_connections 2023-09-13T09:57:50.567 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:57:50.568 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:57:50.568 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:57:50.568 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:57:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.566+0000 7f394cc6cb80 1 -- 172.21.15.6:0/4012153233 wait complete. 2023-09-13T09:57:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.566+0000 7f394cc6cb80 20 client.29434 trim_cache size 0 max 16384 2023-09-13T09:57:50.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39240a06c0 msgr2=0x7f39240a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39240a06c0 0x7f39240a2b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f393c0750c0 tx=0x7f3934009250 comp rx=0 tx=0).stop 2023-09-13T09:57:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c101fb0 msgr2=0x7f393c0730a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c101fb0 0x7f393c0730a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f393000e9c0 tx=0x7f393000ecd0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 shutdown_connections 2023-09-13T09:57:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f393c102950 0x7f393c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f39240a06c0 0x7f39240a2b80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f393c100dc0 0x7f393c074a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 --2- 172.21.15.6:0/2476362153 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f393c101fb0 0x7f393c0730a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 >> 172.21.15.6:0/2476362153 conn(0x7f393c0fc330 msgr2=0x7f393c0fe580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:50.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.567+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 shutdown_connections 2023-09-13T09:57:50.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.568+0000 7f3940a87700 1 -- 172.21.15.6:0/2476362153 wait complete. 2023-09-13T09:57:50.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 216285 36.79 MB/sec execute 190 sec latency 228.806 ms 2023-09-13T09:57:50.588 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:57:50.588 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:57:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/1415734910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 msgr2=0x7f8ce01012f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/1415734910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce01012f0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40099c0 tx=0x7f8cd4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/1415734910 shutdown_connections 2023-09-13T09:57:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/1415734910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce0101830 0x7f8ce01080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/1415734910 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce00ffca0 0x7f8ce01000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/1415734910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce01012f0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/1415734910 >> 172.21.15.6:0/1415734910 conn(0x7f8ce00fb1f0 msgr2=0x7f8ce00fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/1415734910 shutdown_connections 2023-09-13T09:57:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.775+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/1415734910 wait complete. 2023-09-13T09:57:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 Processor -- start 2023-09-13T09:57:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 -- start start 2023-09-13T09:57:50.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce00ffca0 0x7f8ce0195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce0195ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce0101830 0x7f8ce019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce019d510 con 0x7f8ce0100e90 2023-09-13T09:57:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce019d650 con 0x7f8ce00ffca0 2023-09-13T09:57:50.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8ce5ea0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce019d7e0 con 0x7f8ce0101830 2023-09-13T09:57:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8cdeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce0195ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8cdf7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce00ffca0 0x7f8ce0195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8cdeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce0195ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45206/0 (socket says 172.21.15.6:45206) 2023-09-13T09:57:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8cdeffd700 1 -- 172.21.15.6:0/3176614797 learned_addr learned my addr 172.21.15.6:0/3176614797 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:50.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.776+0000 7f8cdffff700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce0101830 0x7f8ce019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdffff700 1 -- 172.21.15.6:0/3176614797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce00ffca0 msgr2=0x7f8ce0195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdffff700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce00ffca0 0x7f8ce0195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdffff700 1 -- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 msgr2=0x7f8ce0195ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdffff700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce0195ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:50.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdffff700 1 -- 172.21.15.6:0/3176614797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd40095f0 con 0x7f8ce0101830 2023-09-13T09:57:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdeffd700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce0195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdffff700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce0101830 0x7f8ce019cf40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800efc0 tx=0x7f8cd800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdcff9700 1 -- 172.21.15.6:0/3176614797 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8018070 con 0x7f8ce0101830 2023-09-13T09:57:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce0069200 con 0x7f8ce0101830 2023-09-13T09:57:50.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdcff9700 1 -- 172.21.15.6:0/3176614797 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8cd800f040 con 0x7f8ce0101830 2023-09-13T09:57:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8cdcff9700 1 -- 172.21.15.6:0/3176614797 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800cd40 con 0x7f8ce0101830 2023-09-13T09:57:50.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.777+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce0069710 con 0x7f8ce0101830 2023-09-13T09:57:50.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.778+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce010b500 con 0x7f8ce0101830 2023-09-13T09:57:50.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.780+0000 7f8cdcff9700 1 -- 172.21.15.6:0/3176614797 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8cd8003a00 con 0x7f8ce0101830 2023-09-13T09:57:50.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.781+0000 7f8cdcff9700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a0640 0x7f8cc80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:50.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.781+0000 7f8cdf7fe700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a0640 0x7f8cc80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:50.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.781+0000 7f8cdcff9700 1 -- 172.21.15.6:0/3176614797 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8cd80cc160 con 0x7f8ce0101830 2023-09-13T09:57:50.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.781+0000 7f8cdf7fe700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a0640 0x7f8cc80a2b00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0100cf0 tx=0x7f8cd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:50.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:50.788+0000 7f8cdcff9700 1 -- 172.21.15.6:0/3176614797 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f8cd8095cd0 con 0x7f8ce0101830 2023-09-13T09:57:51.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.129+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ce0106830 con 0x7f8ce0101830 2023-09-13T09:57:51.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.130+0000 7f8cdcff9700 1 -- 172.21.15.6:0/3176614797 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 64 v64) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f8cd80992f0 con 0x7f8ce0101830 2023-09-13T09:57:51.131 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:57:51.132 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":64,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":64,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:57:34.947057+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:57:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a0640 msgr2=0x7f8cc80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a0640 0x7f8cc80a2b00 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0100cf0 tx=0x7f8cd0009260 comp rx=0 tx=0).stop 2023-09-13T09:57:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce0101830 msgr2=0x7f8ce019cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce0101830 0x7f8ce019cf40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800efc0 tx=0x7f8cd800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 shutdown_connections 2023-09-13T09:57:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ce0101830 0x7f8ce019cf40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ce00ffca0 0x7f8ce0195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8cc80a0640 0x7f8cc80a2b00 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 --2- 172.21.15.6:0/3176614797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ce0100e90 0x7f8ce0195ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 >> 172.21.15.6:0/3176614797 conn(0x7f8ce00fb1f0 msgr2=0x7f8ce00fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 shutdown_connections 2023-09-13T09:57:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.132+0000 7f8ce5ea0700 1 -- 172.21.15.6:0/3176614797 wait complete. 2023-09-13T09:57:51.136 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 64 2023-09-13T09:57:51.149 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:57:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.334+0000 7f98f6b26700 1 -- 172.21.15.6:0/3078518043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f0072af0 msgr2=0x7f98f0072f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.334+0000 7f98f6b26700 1 --2- 172.21.15.6:0/3078518043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f0072af0 0x7f98f0072f10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f98e4009990 tx=0x7f98e4009ca0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.336+0000 7f98f6b26700 1 -- 172.21.15.6:0/3078518043 shutdown_connections 2023-09-13T09:57:51.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.336+0000 7f98f6b26700 1 --2- 172.21.15.6:0/3078518043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00783a0 0x7f98f007a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.336+0000 7f98f6b26700 1 --2- 172.21.15.6:0/3078518043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f0072af0 0x7f98f0072f10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.336+0000 7f98f6b26700 1 --2- 172.21.15.6:0/3078518043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98f00759d0 0x7f98f0077e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.336+0000 7f98f6b26700 1 -- 172.21.15.6:0/3078518043 >> 172.21.15.6:0/3078518043 conn(0x7f98f006d9e0 msgr2=0x7f98f006fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.336+0000 7f98f6b26700 1 -- 172.21.15.6:0/3078518043 shutdown_connections 2023-09-13T09:57:51.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.336+0000 7f98f6b26700 1 -- 172.21.15.6:0/3078518043 wait complete. 2023-09-13T09:57:51.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 Processor -- start 2023-09-13T09:57:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 -- start start 2023-09-13T09:57:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98f0072af0 0x7f98f012bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00759d0 0x7f98f012e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f00783a0 0x7f98f0130770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0130e00 con 0x7f98f00759d0 2023-09-13T09:57:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0130f70 con 0x7f98f0072af0 2023-09-13T09:57:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f6b26700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98f0131130 con 0x7f98f00783a0 2023-09-13T09:57:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98effff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00759d0 0x7f98f012e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98effff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00759d0 0x7f98f012e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45218/0 (socket says 172.21.15.6:45218) 2023-09-13T09:57:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98effff700 1 -- 172.21.15.6:0/923757964 learned_addr learned my addr 172.21.15.6:0/923757964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.337+0000 7f98f50c3700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f00783a0 0x7f98f0130770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98f50c3700 1 -- 172.21.15.6:0/923757964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98f0072af0 msgr2=0x7f98f012bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98f50c3700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98f0072af0 0x7f98f012bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98f50c3700 1 -- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00759d0 msgr2=0x7f98f012e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98f50c3700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00759d0 0x7f98f012e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98f50c3700 1 -- 172.21.15.6:0/923757964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98e40095f0 con 0x7f98f00783a0 2023-09-13T09:57:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98effff700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00759d0 0x7f98f012e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98f50c3700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f00783a0 0x7f98f0130770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f98e800efc0 tx=0x7f98e800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98edffb700 1 -- 172.21.15.6:0/923757964 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e8018070 con 0x7f98f00783a0 2023-09-13T09:57:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98edffb700 1 -- 172.21.15.6:0/923757964 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e800f040 con 0x7f98f00783a0 2023-09-13T09:57:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98edffb700 1 -- 172.21.15.6:0/923757964 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e800cdf0 con 0x7f98f00783a0 2023-09-13T09:57:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.338+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98f01313b0 con 0x7f98f00783a0 2023-09-13T09:57:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.339+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f0131870 con 0x7f98f00783a0 2023-09-13T09:57:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.344+0000 7f9902d0bb80 1 Processor -- start 2023-09-13T09:57:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.345+0000 7f9902d0bb80 1 -- start start 2023-09-13T09:57:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.345+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755400700 0x558755400b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.345+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558755401060 0x5587553ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.345+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587553ffa00 0x5587553ffe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.345+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558755358780 con 0x5587553ffa00 2023-09-13T09:57:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.345+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587553560a0 con 0x558755400700 2023-09-13T09:57:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.345+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558755351990 con 0x558755401060 2023-09-13T09:57:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.346+0000 7f98edffb700 1 -- 172.21.15.6:0/923757964 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f98e8003fc0 con 0x7f98f00783a0 2023-09-13T09:57:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.347+0000 7f98effff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587553ffa00 0x5587553ffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.347+0000 7f98effff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587553ffa00 0x5587553ffe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45226/0 (socket says 172.21.15.6:45226) 2023-09-13T09:57:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.347+0000 7f98effff700 1 -- 172.21.15.6:0/4093904587 learned_addr learned my addr 172.21.15.6:0/4093904587 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.348+0000 7f98edffb700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f98e00a0740 0x7f98e00a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.348+0000 7f98effff700 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755400700 0x558755400b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.348+0000 7f98f48c2700 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558755401060 0x5587553ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.348+0000 7f98f50c3700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f98e00a0740 0x7f98e00a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.348+0000 7f98edffb700 1 -- 172.21.15.6:0/923757964 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f98e80cb770 con 0x7f98f00783a0 2023-09-13T09:57:51.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.349+0000 7f98f48c2700 1 -- 172.21.15.6:0/4093904587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755400700 msgr2=0x558755400b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.349+0000 7f98f48c2700 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755400700 0x558755400b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.349+0000 7f98f48c2700 1 -- 172.21.15.6:0/4093904587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587553ffa00 msgr2=0x5587553ffe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.349+0000 7f98f48c2700 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587553ffa00 0x5587553ffe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.349+0000 7f98f48c2700 1 -- 172.21.15.6:0/4093904587 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5587551d1630 con 0x558755401060 2023-09-13T09:57:51.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.349+0000 7f98f48c2700 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558755401060 0x5587553ff4c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f98e400b680 tx=0x7f98e4005c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1c88faa65813edf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.350+0000 7f98f50c3700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f98e00a0740 0x7f98e00a2c00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f98e8093a80 tx=0x7f98e8083d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.350+0000 7f98daffd700 1 -- 172.21.15.6:0/4093904587 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e401d070 con 0x558755401060 2023-09-13T09:57:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.350+0000 7f98daffd700 1 -- 172.21.15.6:0/4093904587 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e400bd10 con 0x558755401060 2023-09-13T09:57:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.350+0000 7f98daffd700 1 -- 172.21.15.6:0/4093904587 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e4022cf0 con 0x558755401060 2023-09-13T09:57:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.351+0000 7f9902d0bb80 1 -- 172.21.15.6:0/4093904587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558755401060 msgr2=0x5587553ff4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.351+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558755401060 0x5587553ff4c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f98e400b680 tx=0x7f98e4005c00 comp rx=0 tx=0).stop 2023-09-13T09:57:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 -- 172.21.15.6:0/4093904587 shutdown_connections 2023-09-13T09:57:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5587553ffa00 0x5587553ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755400700 0x558755400b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/4093904587 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558755401060 0x5587553ff4c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 -- 172.21.15.6:0/4093904587 >> 172.21.15.6:0/4093904587 conn(0x55875535dc80 msgr2=0x5587553f9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 -- 172.21.15.6:0/4093904587 shutdown_connections 2023-09-13T09:57:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 -- 172.21.15.6:0/4093904587 wait complete. 2023-09-13T09:57:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 -- start start 2023-09-13T09:57:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.352+0000 7f9902d0bb80 1 Processor -- start 2023-09-13T09:57:51.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x558755408f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755409470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 0x5587554104b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587552efbb0 con 0x558755400700 2023-09-13T09:57:51.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587552ef8b0 con 0x558755401060 2023-09-13T09:57:51.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587551d3920 con 0x5587553ffa00 2023-09-13T09:57:51.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f9902d0bb80 10 client.0 _ll_register_callbacks cb 0x5587552ed680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:51.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f98f48c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755409470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f98f48c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755409470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45232/0 (socket says 172.21.15.6:45232) 2023-09-13T09:57:51.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.353+0000 7f98f48c2700 1 -- 172.21.15.6:0/1970069135 learned_addr learned my addr 172.21.15.6:0/1970069135 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98f48c2700 1 -- 172.21.15.6:0/1970069135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 msgr2=0x558755408f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:51.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98f48c2700 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x558755408f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98f48c2700 1 -- 172.21.15.6:0/1970069135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 msgr2=0x5587554104b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:51.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98f48c2700 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 0x5587554104b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98f48c2700 1 -- 172.21.15.6:0/1970069135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98f007b6b0 con 0x558755400700 2023-09-13T09:57:51.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98f48c2700 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755409470 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f98e4005850 tx=0x7f98e400ba80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b098aad6ab8fe7d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98cffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:51.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98cffff700 1 -- 172.21.15.6:0/1970069135 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e401d040 con 0x558755400700 2023-09-13T09:57:51.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f98cffff700 1 -- 172.21.15.6:0/1970069135 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f98e400f660 con 0x558755400700 2023-09-13T09:57:51.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.354+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5587553f2670 con 0x558755400700 2023-09-13T09:57:51.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.355+0000 7f98cffff700 1 -- 172.21.15.6:0/1970069135 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98e400f820 con 0x558755400700 2023-09-13T09:57:51.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.355+0000 7f9902d0bb80 10 client.20232 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:51.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.355+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5587553697a0 con 0x558755400700 2023-09-13T09:57:51.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f98cffff700 1 -- 172.21.15.6:0/1970069135 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e403a020 con 0x558755400700 2023-09-13T09:57:51.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f98cffff700 1 -- 172.21.15.6:0/1970069135 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f98e4029030 con 0x558755400700 2023-09-13T09:57:51.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f9902d0bb80 10 client.20232 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:51.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f9902d0bb80 10 client.20232 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:57:51.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f9902d0bb80 20 client.20232 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:51.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5587554147f0 0x558755416c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f9902d0bb80 4 client.20232 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:51.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.356+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55875534a970 con 0x5587554147f0 2023-09-13T09:57:51.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.359+0000 7f98effff700 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5587554147f0 0x558755416c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.368+0000 7f98effff700 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5587554147f0 0x558755416c50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3d69c2ba5f387bb4 server_cookie=6ec1470a6b3aa263 in_seq=0 out_seq=0 2023-09-13T09:57:51.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.370+0000 7f98cffff700 10 client.20232 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:51.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.375+0000 7f98cffff700 1 -- 172.21.15.6:0/1970069135 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55875534a970 con 0x5587554147f0 2023-09-13T09:57:51.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.375+0000 7f98cffff700 10 client.20232 handle_command_reply: tid=0 2023-09-13T09:57:51.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.375+0000 7f9902d0bb80 1 client.20232 shutdown 2023-09-13T09:57:51.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.375+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 msgr2=0x558755409470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.375+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755409470 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f98e4005850 tx=0x7f98e400ba80 comp rx=0 tx=0).stop 2023-09-13T09:57:51.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.376+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 shutdown_connections 2023-09-13T09:57:51.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.376+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5587554147f0 0x558755416c50 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.376+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 0x5587554104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.376+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x558755408f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.376+0000 7f98cffff700 0 client.20232 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:51.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.376+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/1970069135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755409470 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.376+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 >> 172.21.15.6:0/1970069135 conn(0x55875535dc80 msgr2=0x5587553f47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.378+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 shutdown_connections 2023-09-13T09:57:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.384+0000 7f9902d0bb80 1 -- 172.21.15.6:0/1970069135 wait complete. 2023-09-13T09:57:51.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.384+0000 7f9902d0bb80 20 client.20232 trim_cache size 0 max 16384 2023-09-13T09:57:51.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 Processor -- start 2023-09-13T09:57:51.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 -- start start 2023-09-13T09:57:51.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55875535dc80 0x5587553ff4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x5587554103d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755408f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558755414560 con 0x558755400700 2023-09-13T09:57:51.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558755409f20 con 0x55875535dc80 2023-09-13T09:57:51.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587553fa810 con 0x5587553ffa00 2023-09-13T09:57:51.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f98effff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55875535dc80 0x5587553ff4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f98effff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55875535dc80 0x5587553ff4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38760/0 (socket says 172.21.15.6:38760) 2023-09-13T09:57:51.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.411+0000 7f98effff700 1 -- 172.21.15.6:0/2596153451 learned_addr learned my addr 172.21.15.6:0/2596153451 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.412+0000 7f98effff700 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755408f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.412+0000 7f98effff700 1 -- 172.21.15.6:0/2596153451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 msgr2=0x5587554103d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:51.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.412+0000 7f98effff700 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x5587554103d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.412+0000 7f98effff700 1 -- 172.21.15.6:0/2596153451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55875535dc80 msgr2=0x5587553ff4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.412+0000 7f98effff700 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55875535dc80 0x5587553ff4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.412+0000 7f98effff700 1 -- 172.21.15.6:0/2596153451 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55875517dde0 con 0x558755400700 2023-09-13T09:57:51.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.412+0000 7f98effff700 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755408f30 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x558755417530 tx=0x7f98dc00ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39954742889e5f16 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.413+0000 7f98db7fe700 1 -- 172.21.15.6:0/2596153451 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0043e0 con 0x558755400700 2023-09-13T09:57:51.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.413+0000 7f98db7fe700 1 -- 172.21.15.6:0/2596153451 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98dc004540 con 0x558755400700 2023-09-13T09:57:51.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.413+0000 7f98db7fe700 1 -- 172.21.15.6:0/2596153451 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc005280 con 0x558755400700 2023-09-13T09:57:51.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 -- 172.21.15.6:0/2596153451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 msgr2=0x558755408f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755408f30 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x558755417530 tx=0x7f98dc00ad60 comp rx=0 tx=0).stop 2023-09-13T09:57:51.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 -- 172.21.15.6:0/2596153451 shutdown_connections 2023-09-13T09:57:51.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558755400700 0x558755408f30 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55875535dc80 0x5587553ff4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/2596153451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x5587554103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 -- 172.21.15.6:0/2596153451 >> 172.21.15.6:0/2596153451 conn(0x5587553fa240 msgr2=0x5587554038e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 -- 172.21.15.6:0/2596153451 shutdown_connections 2023-09-13T09:57:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 -- 172.21.15.6:0/2596153451 wait complete. 2023-09-13T09:57:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 -- start start 2023-09-13T09:57:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.414+0000 7f9902d0bb80 1 Processor -- start 2023-09-13T09:57:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55875535dc80 0x5587554102e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x55875540cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f9902d0bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 0x55875540d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558755468650 con 0x55875535dc80 2023-09-13T09:57:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558755468790 con 0x558755401060 2023-09-13T09:57:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f9902d0bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5587554688d0 con 0x5587553ffa00 2023-09-13T09:57:51.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f9902d0bb80 10 client.0 _ll_register_callbacks cb 0x5587552ed680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f98effff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55875535dc80 0x5587554102e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f98effff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55875535dc80 0x5587554102e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45240/0 (socket says 172.21.15.6:45240) 2023-09-13T09:57:51.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f98effff700 1 -- 172.21.15.6:0/974830919 learned_addr learned my addr 172.21.15.6:0/974830919 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.415+0000 7f98effff700 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 0x55875540d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98effff700 1 -- 172.21.15.6:0/974830919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 msgr2=0x55875540cd80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:51.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98effff700 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x55875540cd80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98effff700 1 -- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 msgr2=0x55875540d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98effff700 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 0x55875540d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98effff700 1 -- 172.21.15.6:0/974830919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc0203f0 con 0x55875535dc80 2023-09-13T09:57:51.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98effff700 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55875535dc80 0x5587554102e0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f98dc004f60 tx=0x7f98dc00e8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b454b3a4786be137 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98cffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:51.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98cffff700 1 -- 172.21.15.6:0/974830919 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc020c40 con 0x55875535dc80 2023-09-13T09:57:51.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98e400bd10 con 0x55875535dc80 2023-09-13T09:57:51.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.416+0000 7f98cffff700 1 -- 172.21.15.6:0/974830919 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f98dc004ad0 con 0x55875535dc80 2023-09-13T09:57:51.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f98cffff700 1 -- 172.21.15.6:0/974830919 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98dc020da0 con 0x55875535dc80 2023-09-13T09:57:51.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 10 client.20238 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:51.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x558755166c60 con 0x55875535dc80 2023-09-13T09:57:51.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f98cffff700 1 -- 172.21.15.6:0/974830919 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f98e400bd10 con 0x55875535dc80 2023-09-13T09:57:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f98cffff700 1 -- 172.21.15.6:0/974830919 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f98dc022290 con 0x55875535dc80 2023-09-13T09:57:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 10 client.20238 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 10 client.20238 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:57:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 20 client.20238 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:51.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55875546a0a0 0x55875546c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 4 client.20238 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:51.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.417+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55875530b050 con 0x55875546a0a0 2023-09-13T09:57:51.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.418+0000 7f98f48c2700 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55875546a0a0 0x55875546c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.419+0000 7f98f48c2700 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55875546a0a0 0x55875546c4c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dbd50a118fbf4f8a server_cookie=7b8cd92ec9db9b90 in_seq=0 out_seq=0 2023-09-13T09:57:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.419+0000 7f98cffff700 10 client.20238 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.422+0000 7f98cffff700 1 -- 172.21.15.6:0/974830919 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55875530b050 con 0x55875546a0a0 2023-09-13T09:57:51.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.422+0000 7f98cffff700 10 client.20238 handle_command_reply: tid=0 2023-09-13T09:57:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 client.20238 shutdown 2023-09-13T09:57:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55875535dc80 msgr2=0x5587554102e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55875535dc80 0x5587554102e0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f98dc004f60 tx=0x7f98dc00e8c0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 shutdown_connections 2023-09-13T09:57:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55875546a0a0 0x55875546c4c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558755401060 0x55875540d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55875535dc80 0x5587554102e0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 --2- 172.21.15.6:0/974830919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5587553ffa00 0x55875540cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 >> 172.21.15.6:0/974830919 conn(0x5587553fa240 msgr2=0x558755408ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.423+0000 7f98cffff700 0 client.20238 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:57:51.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.424+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 shutdown_connections 2023-09-13T09:57:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.424+0000 7f9902d0bb80 1 -- 172.21.15.6:0/974830919 wait complete. 2023-09-13T09:57:51.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.424+0000 7f9902d0bb80 20 client.20238 trim_cache size 0 max 16384 2023-09-13T09:57:51.438 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.424+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f98e00a0740 msgr2=0x7f98e00a2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.424+0000 7f98f6b26700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f98e00a0740 0x7f98e00a2c00 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f98e8093a80 tx=0x7f98e8083d80 comp rx=0 tx=0).stop 2023-09-13T09:57:51.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.424+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f00783a0 msgr2=0x7f98f0130770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.424+0000 7f98f6b26700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f00783a0 0x7f98f0130770 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f98e800efc0 tx=0x7f98e800c3a0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 shutdown_connections 2023-09-13T09:57:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98f00783a0 0x7f98f0130770 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f98f0072af0 0x7f98f012bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f98e00a0740 0x7f98e00a2c00 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 --2- 172.21.15.6:0/923757964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98f00759d0 0x7f98f012e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 >> 172.21.15.6:0/923757964 conn(0x7f98f006d9e0 msgr2=0x7f98f00749e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 shutdown_connections 2023-09-13T09:57:51.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.425+0000 7f98f6b26700 1 -- 172.21.15.6:0/923757964 wait complete. 2023-09-13T09:57:51.444 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:57:51.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:51 smithi006 ceph-mon[98665]: pgmap v850: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 714 op/s 2023-09-13T09:57:51.445 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:51 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3176614797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:57:51.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:51 smithi053 ceph-mon[102373]: pgmap v850: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 714 op/s 2023-09-13T09:57:51.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:51 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3176614797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:57:51.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:51 smithi131 ceph-mon[102785]: pgmap v850: 97 pgs: 97 active+clean; 1.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 14 MiB/s wr, 714 op/s 2023-09-13T09:57:51.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:51 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3176614797' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:57:51.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 216804 36.75 MB/sec execute 191 sec latency 97.719 ms 2023-09-13T09:57:51.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.635+0000 7fae01b67700 1 -- 172.21.15.6:0/291417094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffcc0 msgr2=0x7fadfc1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.635+0000 7fae01b67700 1 --2- 172.21.15.6:0/291417094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc1000e0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7fadec0099c0 tx=0x7fadec009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.635+0000 7fae01b67700 1 -- 172.21.15.6:0/291417094 shutdown_connections 2023-09-13T09:57:51.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.635+0000 7fae01b67700 1 --2- 172.21.15.6:0/291417094 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc101850 0x7fadfc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.635+0000 7fae01b67700 1 --2- 172.21.15.6:0/291417094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc1000e0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.635+0000 7fae01b67700 1 --2- 172.21.15.6:0/291417094 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadfc100eb0 0x7fadfc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.635+0000 7fae01b67700 1 -- 172.21.15.6:0/291417094 >> 172.21.15.6:0/291417094 conn(0x7fadfc0fb250 msgr2=0x7fadfc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.636+0000 7fae01b67700 1 -- 172.21.15.6:0/291417094 shutdown_connections 2023-09-13T09:57:51.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.636+0000 7fae01b67700 1 -- 172.21.15.6:0/291417094 wait complete. 2023-09-13T09:57:51.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.636+0000 7fae01b67700 1 Processor -- start 2023-09-13T09:57:51.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fae01b67700 1 -- start start 2023-09-13T09:57:51.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fae01b67700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc196ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fae01b67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100eb0 0x7fadfc197020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fae01b67700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadfc101850 0x7fadfc19e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fae01b67700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc19e660 con 0x7fadfc100eb0 2023-09-13T09:57:51.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fae01b67700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc06a6d0 con 0x7fadfc101850 2023-09-13T09:57:51.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fae01b67700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadfc06a860 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc196ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc196ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48306/0 (socket says 172.21.15.6:48306) 2023-09-13T09:57:51.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 -- 172.21.15.6:0/2391338739 learned_addr learned my addr 172.21.15.6:0/2391338739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfbfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadfc101850 0x7fadfc19e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfaffd700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100eb0 0x7fadfc197020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 -- 172.21.15.6:0/2391338739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadfc101850 msgr2=0x7fadfc19e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadfc101850 0x7fadfc19e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 -- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100eb0 msgr2=0x7fadfc197020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100eb0 0x7fadfc197020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.637+0000 7fadfb7fe700 1 -- 172.21.15.6:0/2391338739 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadec0095f0 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.638+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc196ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fadec009fd0 tx=0x7fadec00f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.638+0000 7fadf8ff9700 1 -- 172.21.15.6:0/2391338739 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec01d070 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.638+0000 7fadf8ff9700 1 -- 172.21.15.6:0/2391338739 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadec0054f0 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.638+0000 7fadf8ff9700 1 -- 172.21.15.6:0/2391338739 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec004bd0 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.638+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadfc1020d0 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.638+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadfc102580 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.641+0000 7fadf8ff9700 1 -- 172.21.15.6:0/2391338739 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fadec00fb80 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.642+0000 7fadf8ff9700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fade40a06c0 0x7fade40a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.642+0000 7fadfaffd700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fade40a06c0 0x7fade40a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.642+0000 7fadf8ff9700 1 -- 172.21.15.6:0/2391338739 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fadec0cca50 con 0x7fadfc0ffcc0 2023-09-13T09:57:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.642+0000 7fae0dd4cb80 1 Processor -- start 2023-09-13T09:57:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fae0dd4cb80 1 -- start start 2023-09-13T09:57:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697345b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x556697344e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669729d780 con 0x556697344a00 2023-09-13T09:57:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55669729b0a0 con 0x556697346060 2023-09-13T09:57:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697296990 con 0x556697345700 2023-09-13T09:57:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfaffd700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fade40a06c0 0x7fade40a2b80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fadf00163f0 tx=0x7fadf0013040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697345b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x556697344e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697345b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48314/0 (socket says 172.21.15.6:48314) 2023-09-13T09:57:51.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfb7fe700 1 -- 172.21.15.6:0/1543499765 learned_addr learned my addr 172.21.15.6:0/1543499765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfaffd700 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfbfff700 1 -- 172.21.15.6:0/1543499765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 msgr2=0x556697345b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfbfff700 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697345b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfbfff700 1 -- 172.21.15.6:0/1543499765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 msgr2=0x5566973444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfbfff700 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.643+0000 7fadfbfff700 1 -- 172.21.15.6:0/1543499765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556697116630 con 0x556697344a00 2023-09-13T09:57:51.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.644+0000 7fadfbfff700 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x556697344e80 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fadf40092f0 tx=0x7fadf4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddaca5156c8fffe server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.644+0000 7fade1ffb700 1 -- 172.21.15.6:0/1543499765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4009df0 con 0x556697344a00 2023-09-13T09:57:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.644+0000 7fade1ffb700 1 -- 172.21.15.6:0/1543499765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadf400f050 con 0x556697344a00 2023-09-13T09:57:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.644+0000 7fade1ffb700 1 -- 172.21.15.6:0/1543499765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4017630 con 0x556697344a00 2023-09-13T09:57:51.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1543499765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 msgr2=0x556697344e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x556697344e80 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fadf40092f0 tx=0x7fadf4009920 comp rx=0 tx=0).stop 2023-09-13T09:57:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1543499765 shutdown_connections 2023-09-13T09:57:51.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x556697344e80 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697345b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1543499765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1543499765 >> 172.21.15.6:0/1543499765 conn(0x5566972a2c80 msgr2=0x55669733ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1543499765 shutdown_connections 2023-09-13T09:57:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1543499765 wait complete. 2023-09-13T09:57:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 -- start start 2023-09-13T09:57:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.645+0000 7fae0dd4cb80 1 Processor -- start 2023-09-13T09:57:51.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x55669734df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x55669734e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x556697355490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697234bb0 con 0x556697344a00 2023-09-13T09:57:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566972348b0 con 0x556697346060 2023-09-13T09:57:51.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697118920 con 0x556697345700 2023-09-13T09:57:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fae0dd4cb80 10 client.0 _ll_register_callbacks cb 0x556697232680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x55669734df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x55669734e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x55669734df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45266/0 (socket says 172.21.15.6:45266) 2023-09-13T09:57:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfaffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x55669734e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48322/0 (socket says 172.21.15.6:48322) 2023-09-13T09:57:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 -- 172.21.15.6:0/897463241 learned_addr learned my addr 172.21.15.6:0/897463241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfbfff700 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x556697355490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 -- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 msgr2=0x55669734e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x55669734e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 -- 172.21.15.6:0/897463241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 msgr2=0x556697355490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x556697355490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 -- 172.21.15.6:0/897463241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf4009050 con 0x556697344a00 2023-09-13T09:57:51.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfaffd700 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x55669734e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x55669734df10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fadec0ca550 tx=0x7fadec0056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5089a57c3779a30d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.646+0000 7faddaffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7faddaffd700 1 -- 172.21.15.6:0/897463241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadec09e0b0 con 0x556697344a00 2023-09-13T09:57:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7faddaffd700 1 -- 172.21.15.6:0/897463241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fadec0a2260 con 0x556697344a00 2023-09-13T09:57:51.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556697337670 con 0x556697344a00 2023-09-13T09:57:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7faddaffd700 1 -- 172.21.15.6:0/897463241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadec0b8240 con 0x556697344a00 2023-09-13T09:57:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 10 client.20250 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5566972ae7a0 con 0x556697344a00 2023-09-13T09:57:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7faddaffd700 1 -- 172.21.15.6:0/897463241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556697337670 con 0x556697344a00 2023-09-13T09:57:51.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7faddaffd700 1 -- 172.21.15.6:0/897463241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fadec0a1f20 con 0x556697344a00 2023-09-13T09:57:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 10 client.20250 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 10 client.20250 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:57:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 20 client.20250 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x55669735bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 4 client.20250 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.647+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55669728f970 con 0x5566973598d0 2023-09-13T09:57:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.648+0000 7fadfaffd700 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x55669735bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.648+0000 7faddaffd700 10 client.20250 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.648+0000 7fadfaffd700 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x55669735bcf0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fef7d10a839ea44 server_cookie=5bfd94ea5a82703e in_seq=0 out_seq=0 2023-09-13T09:57:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.650+0000 7faddaffd700 1 -- 172.21.15.6:0/897463241 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55669728f970 con 0x5566973598d0 2023-09-13T09:57:51.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.650+0000 7faddaffd700 10 client.20250 handle_command_reply: tid=0 2023-09-13T09:57:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.650+0000 7fae0dd4cb80 1 client.20250 shutdown 2023-09-13T09:57:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 msgr2=0x55669734df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x55669734df10 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fadec0ca550 tx=0x7fadec0056e0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 shutdown_connections 2023-09-13T09:57:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x55669735bcf0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x556697355490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7faddaffd700 0 client.20250 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:51.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x55669734df10 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/897463241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x55669734e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 >> 172.21.15.6:0/897463241 conn(0x5566972a2c80 msgr2=0x55669733eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 shutdown_connections 2023-09-13T09:57:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/897463241 wait complete. 2023-09-13T09:57:51.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.651+0000 7fae0dd4cb80 20 client.20250 trim_cache size 0 max 16384 2023-09-13T09:57:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 Processor -- start 2023-09-13T09:57:51.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 -- start start 2023-09-13T09:57:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697344a00 0x5566973444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697345700 0x556697355450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697346060 0x556697355d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697340fd0 con 0x556697346060 2023-09-13T09:57:51.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697349450 con 0x556697345700 2023-09-13T09:57:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.668+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5566973402f0 con 0x556697344a00 2023-09-13T09:57:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697346060 0x556697355d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697346060 0x556697355d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45278/0 (socket says 172.21.15.6:45278) 2023-09-13T09:57:51.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697344a00 0x5566973444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfaffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697345700 0x556697355450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 -- 172.21.15.6:0/1708386042 learned_addr learned my addr 172.21.15.6:0/1708386042 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 -- 172.21.15.6:0/1708386042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697344a00 msgr2=0x5566973444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 --2- 172.21.15.6:0/1708386042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697344a00 0x5566973444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 -- 172.21.15.6:0/1708386042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697345700 msgr2=0x556697355450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 --2- 172.21.15.6:0/1708386042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697345700 0x556697355450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 -- 172.21.15.6:0/1708386042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5566970c2de0 con 0x556697346060 2023-09-13T09:57:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fadfbfff700 1 --2- 172.21.15.6:0/1708386042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697346060 0x556697355d80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fadf40092c0 tx=0x7fadf40060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cde8cc81a8a6da server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.669+0000 7fade27fc700 1 -- 172.21.15.6:0/1708386042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4004c90 con 0x556697346060 2023-09-13T09:57:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fade27fc700 1 -- 172.21.15.6:0/1708386042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadf40095e0 con 0x556697346060 2023-09-13T09:57:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fade27fc700 1 -- 172.21.15.6:0/1708386042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4004810 con 0x556697346060 2023-09-13T09:57:51.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1708386042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697346060 msgr2=0x556697355d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1708386042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697346060 0x556697355d80 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fadf40092c0 tx=0x7fadf40060e0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1708386042 shutdown_connections 2023-09-13T09:57:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1708386042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697346060 0x556697355d80 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1708386042 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697344a00 0x5566973444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/1708386042 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697345700 0x556697355450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1708386042 >> 172.21.15.6:0/1708386042 conn(0x5566972a2c80 msgr2=0x55669734cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.670+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1708386042 shutdown_connections 2023-09-13T09:57:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/1708386042 wait complete. 2023-09-13T09:57:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 -- start start 2023-09-13T09:57:51.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 Processor -- start 2023-09-13T09:57:51.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x5566973515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697351b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697354f20 con 0x556697344a00 2023-09-13T09:57:51.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697355090 con 0x556697346060 2023-09-13T09:57:51.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556697355250 con 0x556697345700 2023-09-13T09:57:51.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.671+0000 7fae0dd4cb80 10 client.0 _ll_register_callbacks cb 0x556697232680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:51.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.673+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x5566973515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.673+0000 7fadfb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x5566973515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45280/0 (socket says 172.21.15.6:45280) 2023-09-13T09:57:51.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.673+0000 7fadfb7fe700 1 -- 172.21.15.6:0/4173209800 learned_addr learned my addr 172.21.15.6:0/4173209800 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.674+0000 7fadfbfff700 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.674+0000 7fadfaffd700 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697351b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.675+0000 7fadfbfff700 1 -- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 msgr2=0x556697351b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.675+0000 7fadfbfff700 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697351b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.675+0000 7fadfbfff700 1 -- 172.21.15.6:0/4173209800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 msgr2=0x5566973515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.675+0000 7fadfbfff700 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x5566973515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.675+0000 7fadfbfff700 1 -- 172.21.15.6:0/4173209800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556697116630 con 0x556697346060 2023-09-13T09:57:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.675+0000 7fadfbfff700 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973549e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55669733ff50 tx=0x7fadf4004180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0184e22f7059300 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.675+0000 7faddaffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:57:51.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7faddaffd700 1 -- 172.21.15.6:0/4173209800 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf4004020 con 0x556697346060 2023-09-13T09:57:51.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7faddaffd700 1 -- 172.21.15.6:0/4173209800 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fadf4003a00 con 0x556697346060 2023-09-13T09:57:51.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fadf400f050 con 0x556697346060 2023-09-13T09:57:51.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7faddaffd700 1 -- 172.21.15.6:0/4173209800 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadf4004e20 con 0x556697346060 2023-09-13T09:57:51.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7fae0dd4cb80 10 client.29495 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:51.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5566970abc60 con 0x556697346060 2023-09-13T09:57:51.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7faddaffd700 1 -- 172.21.15.6:0/4173209800 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fadf400f050 con 0x556697346060 2023-09-13T09:57:51.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.678+0000 7faddaffd700 1 -- 172.21.15.6:0/4173209800 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fadf402b450 con 0x556697346060 2023-09-13T09:57:51.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fae0dd4cb80 10 client.29495 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:51.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fae0dd4cb80 10 client.29495 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:57:51.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fae0dd4cb80 20 client.29495 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:51.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x5566973c1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fae0dd4cb80 4 client.29495 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:51.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x556697250050 con 0x5566973598d0 2023-09-13T09:57:51.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x5566973c1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7fadfb7fe700 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x5566973c1550 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d0d02ba8e2ae7b2 server_cookie=8493d2e977aac788 in_seq=0 out_seq=0 2023-09-13T09:57:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.679+0000 7faddaffd700 10 client.29495 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7faddaffd700 1 -- 172.21.15.6:0/4173209800 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x556697250050 con 0x5566973598d0 2023-09-13T09:57:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7faddaffd700 10 client.29495 handle_command_reply: tid=0 2023-09-13T09:57:51.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 client.29495 shutdown 2023-09-13T09:57:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 msgr2=0x5566973549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973549e0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55669733ff50 tx=0x7fadf4004180 comp rx=0 tx=0).stop 2023-09-13T09:57:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 shutdown_connections 2023-09-13T09:57:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5566973598d0 0x5566973c1550 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x556697346060 0x5566973549e0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x556697344a00 0x5566973515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 --2- 172.21.15.6:0/4173209800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x556697345700 0x556697351b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 >> 172.21.15.6:0/4173209800 conn(0x5566972a2c80 msgr2=0x556697355d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7faddaffd700 0 client.29495 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:57:51.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 shutdown_connections 2023-09-13T09:57:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 1 -- 172.21.15.6:0/4173209800 wait complete. 2023-09-13T09:57:51.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.680+0000 7fae0dd4cb80 20 client.29495 trim_cache size 0 max 16384 2023-09-13T09:57:51.709 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fade40a06c0 msgr2=0x7fade40a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fade40a06c0 0x7fade40a2b80 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fadf00163f0 tx=0x7fadf0013040 comp rx=0 tx=0).stop 2023-09-13T09:57:51.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc0ffcc0 msgr2=0x7fadfc196ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc196ae0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fadec009fd0 tx=0x7fadec00f690 comp rx=0 tx=0).stop 2023-09-13T09:57:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 shutdown_connections 2023-09-13T09:57:51.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fadfc101850 0x7fadfc19e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fadfc0ffcc0 0x7fadfc196ae0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fade40a06c0 0x7fade40a2b80 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 --2- 172.21.15.6:0/2391338739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadfc100eb0 0x7fadfc197020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 >> 172.21.15.6:0/2391338739 conn(0x7fadfc0fb250 msgr2=0x7fadfc0fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 shutdown_connections 2023-09-13T09:57:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.682+0000 7fae01b67700 1 -- 172.21.15.6:0/2391338739 wait complete. 2023-09-13T09:57:51.716 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:57:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 -- 172.21.15.6:0/4024583667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010e130 msgr2=0x7f3c701105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4024583667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010e130 0x7f3c701105d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800b0a0 tx=0x7f3c6800b3b0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 -- 172.21.15.6:0/4024583667 shutdown_connections 2023-09-13T09:57:51.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4024583667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010e130 0x7f3c701105d0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4024583667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c70108dc0 0x7f3c7010b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4024583667 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c7010b6f0 0x7f3c7010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 -- 172.21.15.6:0/4024583667 >> 172.21.15.6:0/4024583667 conn(0x7f3c7006dc70 msgr2=0x7f3c700700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 -- 172.21.15.6:0/4024583667 shutdown_connections 2023-09-13T09:57:51.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.878+0000 7f3c7485d700 1 -- 172.21.15.6:0/4024583667 wait complete. 2023-09-13T09:57:51.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 Processor -- start 2023-09-13T09:57:51.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 -- start start 2023-09-13T09:57:51.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c70108dc0 0x7f3c7019e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010b6f0 0x7f3c7019e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c7010e130 0x7f3c701a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701a5e20 con 0x7f3c7010b6f0 2023-09-13T09:57:51.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701a5f60 con 0x7f3c70108dc0 2023-09-13T09:57:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.879+0000 7f3c7485d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c701a60f0 con 0x7f3c7010e130 2023-09-13T09:57:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010b6f0 0x7f3c7019e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c70108dc0 0x7f3c7019e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010b6f0 0x7f3c7019e7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45296/0 (socket says 172.21.15.6:45296) 2023-09-13T09:57:51.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/4017450964 learned_addr learned my addr 172.21.15.6:0/4017450964 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6ed9d700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c7010e130 0x7f3c701a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6e59c700 1 -- 172.21.15.6:0/4017450964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c7010e130 msgr2=0x7f3c701a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c7010e130 0x7f3c701a5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6e59c700 1 -- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010b6f0 msgr2=0x7f3c7019e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010b6f0 0x7f3c7019e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6e59c700 1 -- 172.21.15.6:0/4017450964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c68009d00 con 0x7f3c70108dc0 2023-09-13T09:57:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.880+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c70108dc0 0x7f3c7019e2a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3c700726e0 tx=0x7f3c6400eca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.881+0000 7f3c5f7fe700 1 -- 172.21.15.6:0/4017450964 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64004220 con 0x7f3c70108dc0 2023-09-13T09:57:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.881+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c70107d10 con 0x7f3c70108dc0 2023-09-13T09:57:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.881+0000 7f3c5f7fe700 1 -- 172.21.15.6:0/4017450964 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c64004380 con 0x7f3c70108dc0 2023-09-13T09:57:51.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.881+0000 7f3c5f7fe700 1 -- 172.21.15.6:0/4017450964 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c64003be0 con 0x7f3c70108dc0 2023-09-13T09:57:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.881+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c70108270 con 0x7f3c70108dc0 2023-09-13T09:57:51.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.884+0000 7f3c5f7fe700 1 -- 172.21.15.6:0/4017450964 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3c64003d40 con 0x7f3c70108dc0 2023-09-13T09:57:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.885+0000 7f3c5f7fe700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c580a0640 0x7f3c580a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.885+0000 7f3c5f7fe700 1 -- 172.21.15.6:0/4017450964 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3c64014070 con 0x7f3c70108dc0 2023-09-13T09:57:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.885+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c580a0640 0x7f3c580a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.885+0000 7f3c80a42b80 1 Processor -- start 2023-09-13T09:57:51.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.885+0000 7f3c80a42b80 1 -- start start 2023-09-13T09:57:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c580a0640 0x7f3c580a2b00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009d20 tx=0x7f3c60009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b3bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b3a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485b3b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485a8f780 con 0x558485b3c470 2023-09-13T09:57:51.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485a8d0a0 con 0x558485b3ae10 2023-09-13T09:57:51.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485a88990 con 0x558485b3bb10 2023-09-13T09:57:51.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b3a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b3bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b3a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45304/0 (socket says 172.21.15.6:45304) 2023-09-13T09:57:51.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/2614768215 learned_addr learned my addr 172.21.15.6:0/2614768215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/2614768215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 msgr2=0x558485b3bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b3bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/2614768215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 msgr2=0x558485b3b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485b3b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/2614768215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558485908630 con 0x558485b3c470 2023-09-13T09:57:51.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b3bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:51.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.886+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b3a8d0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e540 tx=0x7f3c60014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3040f82331fbc93 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.887+0000 7f3c5cff9700 1 -- 172.21.15.6:0/2614768215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60026430 con 0x558485b3c470 2023-09-13T09:57:51.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.887+0000 7f3c5cff9700 1 -- 172.21.15.6:0/2614768215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c60021070 con 0x558485b3c470 2023-09-13T09:57:51.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.887+0000 7f3c5cff9700 1 -- 172.21.15.6:0/2614768215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6001d720 con 0x558485b3c470 2023-09-13T09:57:51.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.889+0000 7f3c80a42b80 1 -- 172.21.15.6:0/2614768215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 msgr2=0x558485b3a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.889+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b3a8d0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000e540 tx=0x7f3c60014000 comp rx=0 tx=0).stop 2023-09-13T09:57:51.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 -- 172.21.15.6:0/2614768215 shutdown_connections 2023-09-13T09:57:51.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485b3b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b3bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/2614768215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b3a8d0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 -- 172.21.15.6:0/2614768215 >> 172.21.15.6:0/2614768215 conn(0x558485a94c80 msgr2=0x558485b30f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 -- 172.21.15.6:0/2614768215 shutdown_connections 2023-09-13T09:57:51.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 -- 172.21.15.6:0/2614768215 wait complete. 2023-09-13T09:57:51.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 -- start start 2023-09-13T09:57:51.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.890+0000 7f3c80a42b80 1 Processor -- start 2023-09-13T09:57:51.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3ae10 0x558485b380b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b385f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3c470 0x558485b39600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485a26bb0 con 0x558485b3ae10 2023-09-13T09:57:51.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485a268b0 con 0x558485b3c470 2023-09-13T09:57:51.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55848590a920 con 0x558485b3bb10 2023-09-13T09:57:51.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 10 client.0 _ll_register_callbacks cb 0x558485a24680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:51.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3ae10 0x558485b380b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3ae10 0x558485b380b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45308/0 (socket says 172.21.15.6:45308) 2023-09-13T09:57:51.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 -- 172.21.15.6:0/534183061 learned_addr learned my addr 172.21.15.6:0/534183061 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b385f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 -- 172.21.15.6:0/534183061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 msgr2=0x558485b385f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b385f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 -- 172.21.15.6:0/534183061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3c470 msgr2=0x558485b39600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3c470 0x558485b39600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 -- 172.21.15.6:0/534183061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c60017070 con 0x558485b3ae10 2023-09-13T09:57:51.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3ae10 0x558485b380b0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009ef0 tx=0x7f3c640044f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9131fb7f8c2751d5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:51.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c55ffb700 1 -- 172.21.15.6:0/534183061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c640acea0 con 0x558485b3ae10 2023-09-13T09:57:51.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558485b29670 con 0x558485b3ae10 2023-09-13T09:57:51.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.891+0000 7f3c55ffb700 1 -- 172.21.15.6:0/534183061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3c64095040 con 0x558485b3ae10 2023-09-13T09:57:51.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c55ffb700 1 -- 172.21.15.6:0/534183061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c64099580 con 0x558485b3ae10 2023-09-13T09:57:51.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 10 client.20268 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:51.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x558485aa07a0 con 0x558485b3ae10 2023-09-13T09:57:51.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c55ffb700 1 -- 172.21.15.6:0/534183061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558485b29670 con 0x558485b3ae10 2023-09-13T09:57:51.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c55ffb700 1 -- 172.21.15.6:0/534183061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3c64065130 con 0x558485b3ae10 2023-09-13T09:57:51.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 10 client.20268 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 10 client.20268 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:57:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 20 client.20268 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:51.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485b545d0 0x558485b56a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 4 client.20268 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:51.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558485a81970 con 0x558485b545d0 2023-09-13T09:57:51.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.892+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485b545d0 0x558485b56a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.893+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485b545d0 0x558485b56a10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=65e59d5a73e67c6d server_cookie=ed32a28979d31db0 in_seq=0 out_seq=0 2023-09-13T09:57:51.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.893+0000 7f3c55ffb700 10 client.20268 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c55ffb700 1 -- 172.21.15.6:0/534183061 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558485a81970 con 0x558485b545d0 2023-09-13T09:57:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c55ffb700 10 client.20268 handle_command_reply: tid=0 2023-09-13T09:57:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 client.20268 shutdown 2023-09-13T09:57:51.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3ae10 msgr2=0x558485b380b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3ae10 0x558485b380b0 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f3c64009ef0 tx=0x7f3c640044f0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 shutdown_connections 2023-09-13T09:57:51.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485b545d0 0x558485b56a10 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3c470 0x558485b39600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c55ffb700 0 client.20268 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:51.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3ae10 0x558485b380b0 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/534183061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b385f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 >> 172.21.15.6:0/534183061 conn(0x558485a94c80 msgr2=0x558485b2b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 shutdown_connections 2023-09-13T09:57:51.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 1 -- 172.21.15.6:0/534183061 wait complete. 2023-09-13T09:57:51.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.896+0000 7f3c80a42b80 20 client.20268 trim_cache size 0 max 16384 2023-09-13T09:57:51.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 Processor -- start 2023-09-13T09:57:51.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 -- start start 2023-09-13T09:57:51.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485b569c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b37e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b383a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485b29650 con 0x558485b3c470 2023-09-13T09:57:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485b37c20 con 0x558485b3ae10 2023-09-13T09:57:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.913+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485b390e0 con 0x558485b3bb10 2023-09-13T09:57:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b383a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45318/0 (socket says 172.21.15.6:45318) 2023-09-13T09:57:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 -- 172.21.15.6:0/825497357 learned_addr learned my addr 172.21.15.6:0/825497357 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b37e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 -- 172.21.15.6:0/825497357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 msgr2=0x558485b37e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b37e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 -- 172.21.15.6:0/825497357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 msgr2=0x558485b569c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485b569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 -- 172.21.15.6:0/825497357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584858b4de0 con 0x558485b3c470 2023-09-13T09:57:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c6ed9d700 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b383a0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f3c68007a60 tx=0x7f3c68009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c25731d0cbb56f9a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c5d7fa700 1 -- 172.21.15.6:0/825497357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6800e040 con 0x558485b3c470 2023-09-13T09:57:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c5d7fa700 1 -- 172.21.15.6:0/825497357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c68009460 con 0x558485b3c470 2023-09-13T09:57:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.914+0000 7f3c5d7fa700 1 -- 172.21.15.6:0/825497357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6801c6a0 con 0x558485b3c470 2023-09-13T09:57:51.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 -- 172.21.15.6:0/825497357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 msgr2=0x558485b383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b383a0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f3c68007a60 tx=0x7f3c68009c60 comp rx=0 tx=0).stop 2023-09-13T09:57:51.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 -- 172.21.15.6:0/825497357 shutdown_connections 2023-09-13T09:57:51.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3c470 0x558485b383a0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485b569c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/825497357 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3bb10 0x558485b37e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 -- 172.21.15.6:0/825497357 >> 172.21.15.6:0/825497357 conn(0x558485a94c80 msgr2=0x558485b30ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 -- 172.21.15.6:0/825497357 shutdown_connections 2023-09-13T09:57:51.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.915+0000 7f3c80a42b80 1 -- 172.21.15.6:0/825497357 wait complete. 2023-09-13T09:57:51.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 -- start start 2023-09-13T09:57:51.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 Processor -- start 2023-09-13T09:57:51.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485ba2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3bb10 0x558485ba4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3c470 0x558485ba6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485ba76f0 con 0x558485b3bb10 2023-09-13T09:57:51.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485ba7860 con 0x558485b3ae10 2023-09-13T09:57:51.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558485ba7a20 con 0x558485b3c470 2023-09-13T09:57:51.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c80a42b80 10 client.0 _ll_register_callbacks cb 0x558485a24680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:51.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3bb10 0x558485ba4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3bb10 0x558485ba4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45324/0 (socket says 172.21.15.6:45324) 2023-09-13T09:57:51.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/156881276 learned_addr learned my addr 172.21.15.6:0/156881276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:51.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.916+0000 7f3c6ed9d700 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3c470 0x558485ba6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/156881276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3c470 msgr2=0x558485ba6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3c470 0x558485ba6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/156881276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 msgr2=0x558485ba2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:51.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485ba2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c6dd9b700 1 -- 172.21.15.6:0/156881276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c701111f0 con 0x558485b3bb10 2023-09-13T09:57:51.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c6dd9b700 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3bb10 0x558485ba4970 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000eb30 tx=0x7f3c6000ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd68a61dcd6856a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:51.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:51.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c55ffb700 1 -- 172.21.15.6:0/156881276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6001cd00 con 0x558485b3bb10 2023-09-13T09:57:51.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c55ffb700 1 -- 172.21.15.6:0/156881276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3c6001ce60 con 0x558485b3bb10 2023-09-13T09:57:51.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3c60021070 con 0x558485b3bb10 2023-09-13T09:57:51.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c55ffb700 1 -- 172.21.15.6:0/156881276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c60033a90 con 0x558485b3bb10 2023-09-13T09:57:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c80a42b80 10 client.20274 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55848589dc60 con 0x558485b3bb10 2023-09-13T09:57:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.917+0000 7f3c55ffb700 1 -- 172.21.15.6:0/156881276 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3c60042020 con 0x558485b3bb10 2023-09-13T09:57:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c55ffb700 1 -- 172.21.15.6:0/156881276 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f3c600053d0 con 0x558485b3bb10 2023-09-13T09:57:51.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c80a42b80 10 client.20274 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c80a42b80 10 client.20274 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:57:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c80a42b80 20 client.20274 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485ba9440 0x558485bab860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c80a42b80 4 client.20274 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:51.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558485a42050 con 0x558485ba9440 2023-09-13T09:57:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485ba9440 0x558485bab860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c55ffb700 10 client.20274 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.918+0000 7f3c6e59c700 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485ba9440 0x558485bab860 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b50c34d994a70d server_cookie=3da8cd6ab3e9e47a in_seq=0 out_seq=0 2023-09-13T09:57:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.919+0000 7f3c55ffb700 1 -- 172.21.15.6:0/156881276 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558485a42050 con 0x558485ba9440 2023-09-13T09:57:51.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.919+0000 7f3c55ffb700 10 client.20274 handle_command_reply: tid=0 2023-09-13T09:57:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.919+0000 7f3c80a42b80 1 client.20274 shutdown 2023-09-13T09:57:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.919+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3bb10 msgr2=0x558485ba4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.919+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3bb10 0x558485ba4970 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000eb30 tx=0x7f3c6000ee60 comp rx=0 tx=0).stop 2023-09-13T09:57:51.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 shutdown_connections 2023-09-13T09:57:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x558485ba9440 0x558485bab860 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558485b3c470 0x558485ba6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c55ffb700 0 client.20274 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:57:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558485b3ae10 0x558485ba2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 --2- 172.21.15.6:0/156881276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558485b3bb10 0x558485ba4970 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 >> 172.21.15.6:0/156881276 conn(0x558485a94c80 msgr2=0x558485b37e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 shutdown_connections 2023-09-13T09:57:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 1 -- 172.21.15.6:0/156881276 wait complete. 2023-09-13T09:57:51.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c80a42b80 20 client.20274 trim_cache size 0 max 16384 2023-09-13T09:57:51.945 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:51.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c580a0640 msgr2=0x7f3c580a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c580a0640 0x7f3c580a2b00 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f3c60009d20 tx=0x7f3c60009260 comp rx=0 tx=0).stop 2023-09-13T09:57:51.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c70108dc0 msgr2=0x7f3c7019e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c70108dc0 0x7f3c7019e2a0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3c700726e0 tx=0x7f3c6400eca0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 shutdown_connections 2023-09-13T09:57:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3c7010e130 0x7f3c701a5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3c70108dc0 0x7f3c7019e2a0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f3c580a0640 0x7f3c580a2b00 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 --2- 172.21.15.6:0/4017450964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c7010b6f0 0x7f3c7019e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 >> 172.21.15.6:0/4017450964 conn(0x7f3c7006dc70 msgr2=0x7f3c7010a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.920+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 shutdown_connections 2023-09-13T09:57:51.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:51.921+0000 7f3c7485d700 1 -- 172.21.15.6:0/4017450964 wait complete. 2023-09-13T09:57:51.949 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:57:52.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 -- 172.21.15.6:0/3471164580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160101850 msgr2=0x7f6160108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 --2- 172.21.15.6:0/3471164580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160101850 0x7f6160108100 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f615800b0d0 tx=0x7f615800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 -- 172.21.15.6:0/3471164580 shutdown_connections 2023-09-13T09:57:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 --2- 172.21.15.6:0/3471164580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160101850 0x7f6160108100 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 --2- 172.21.15.6:0/3471164580 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61600ffcc0 0x7f61601000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 --2- 172.21.15.6:0/3471164580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6160100eb0 0x7f6160101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 -- 172.21.15.6:0/3471164580 >> 172.21.15.6:0/3471164580 conn(0x7f61600fb250 msgr2=0x7f61600fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 -- 172.21.15.6:0/3471164580 shutdown_connections 2023-09-13T09:57:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.102+0000 7f6165864700 1 -- 172.21.15.6:0/3471164580 wait complete. 2023-09-13T09:57:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 Processor -- start 2023-09-13T09:57:52.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 -- start start 2023-09-13T09:57:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61600ffcc0 0x7f6160198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160100eb0 0x7f61601992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6160101850 0x7f61601a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61601a08e0 con 0x7f6160100eb0 2023-09-13T09:57:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61601a0a50 con 0x7f61600ffcc0 2023-09-13T09:57:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f6165864700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61601a0c10 con 0x7f6160101850 2023-09-13T09:57:52.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f615effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61600ffcc0 0x7f6160198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f615e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160100eb0 0x7f61601992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f615e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160100eb0 0x7f61601992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45340/0 (socket says 172.21.15.6:45340) 2023-09-13T09:57:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f615effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61600ffcc0 0x7f6160198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38860/0 (socket says 172.21.15.6:38860) 2023-09-13T09:57:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6160101850 0x7f61601a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.103+0000 7f615e7fc700 1 -- 172.21.15.6:0/3379387511 learned_addr learned my addr 172.21.15.6:0/3379387511 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f615e7fc700 1 -- 172.21.15.6:0/3379387511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6160101850 msgr2=0x7f61601a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f615e7fc700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6160101850 0x7f61601a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f615e7fc700 1 -- 172.21.15.6:0/3379387511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61600ffcc0 msgr2=0x7f6160198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f615e7fc700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61600ffcc0 0x7f6160198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f615e7fc700 1 -- 172.21.15.6:0/3379387511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158009d00 con 0x7f6160100eb0 2023-09-13T09:57:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f615e7fc700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160100eb0 0x7f61601992e0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f615400e9a0 tx=0x7f615400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f6164862700 1 -- 172.21.15.6:0/3379387511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154009790 con 0x7f6160100eb0 2023-09-13T09:57:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f6164862700 1 -- 172.21.15.6:0/3379387511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6154010430 con 0x7f6160100eb0 2023-09-13T09:57:52.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f6164862700 1 -- 172.21.15.6:0/3379387511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6154018680 con 0x7f6160100eb0 2023-09-13T09:57:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61601a0ef0 con 0x7f6160100eb0 2023-09-13T09:57:52.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.104+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61601a1310 con 0x7f6160100eb0 2023-09-13T09:57:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.107+0000 7f6164862700 1 -- 172.21.15.6:0/3379387511 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f61540105a0 con 0x7f6160100eb0 2023-09-13T09:57:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.108+0000 7f6164862700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61480a06c0 0x7f61480a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.108+0000 7f6164862700 1 -- 172.21.15.6:0/3379387511 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6154014070 con 0x7f6160100eb0 2023-09-13T09:57:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 Processor -- start 2023-09-13T09:57:52.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 -- start start 2023-09-13T09:57:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fcab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fcb070 0x55c809fc94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fc9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809f11780 con 0x55c809fc9a10 2023-09-13T09:57:52.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f615effd700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61480a06c0 0x7f61480a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809f0f0a0 con 0x55c809fcb070 2023-09-13T09:57:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f6171a49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809f0a990 con 0x55c809fca710 2023-09-13T09:57:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f615effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fcab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f615effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fcab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48398/0 (socket says 172.21.15.6:48398) 2023-09-13T09:57:52.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.109+0000 7f615effd700 1 -- 172.21.15.6:0/1447755053 learned_addr learned my addr 172.21.15.6:0/1447755053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615e7fc700 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fcb070 0x55c809fc94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615effd700 1 -- 172.21.15.6:0/1447755053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fcb070 msgr2=0x55c809fc94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615effd700 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fcb070 0x55c809fc94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615effd700 1 -- 172.21.15.6:0/1447755053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 msgr2=0x55c809fc9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615effd700 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fc9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615effd700 1 -- 172.21.15.6:0/1447755053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c809d8a630 con 0x55c809fca710 2023-09-13T09:57:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615effd700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61480a06c0 0x7f61480a2b80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6150013a30 tx=0x7f6150009bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.110+0000 7f615effd700 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fcab30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f615000f6a0 tx=0x7f615001d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0c18b82e259c37d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.111+0000 7f6145ffb700 1 -- 172.21.15.6:0/1447755053 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150013050 con 0x55c809fca710 2023-09-13T09:57:52.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.111+0000 7f6145ffb700 1 -- 172.21.15.6:0/1447755053 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61500044e0 con 0x55c809fca710 2023-09-13T09:57:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.111+0000 7f6145ffb700 1 -- 172.21.15.6:0/1447755053 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150003ac0 con 0x55c809fca710 2023-09-13T09:57:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 -- 172.21.15.6:0/1447755053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 msgr2=0x55c809fcab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fcab30 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f615000f6a0 tx=0x7f615001d000 comp rx=0 tx=0).stop 2023-09-13T09:57:52.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 -- 172.21.15.6:0/1447755053 shutdown_connections 2023-09-13T09:57:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fc9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fcab30 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1447755053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fcb070 0x55c809fc94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 -- 172.21.15.6:0/1447755053 >> 172.21.15.6:0/1447755053 conn(0x55c809f16c80 msgr2=0x55c809fb2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 -- 172.21.15.6:0/1447755053 shutdown_connections 2023-09-13T09:57:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 -- 172.21.15.6:0/1447755053 wait complete. 2023-09-13T09:57:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.112+0000 7f6171a49b80 1 -- start start 2023-09-13T09:57:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 1 Processor -- start 2023-09-13T09:57:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fc9a10 0x55c809fd2ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fd33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fda420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809ea8bb0 con 0x55c809fcb070 2023-09-13T09:57:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809ea88b0 con 0x55c809fca710 2023-09-13T09:57:52.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809d8c920 con 0x55c809fc9a10 2023-09-13T09:57:52.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f6171a49b80 10 client.0 _ll_register_callbacks cb 0x55c809ea6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:52.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f615effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fc9a10 0x55c809fd2ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f615effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fc9a10 0x55c809fd2ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48404/0 (socket says 172.21.15.6:48404) 2023-09-13T09:57:52.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f615effd700 1 -- 172.21.15.6:0/1803274688 learned_addr learned my addr 172.21.15.6:0/1803274688 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f615e7fc700 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fd33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.113+0000 7f615f7fe700 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fda420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f615e7fc700 1 -- 172.21.15.6:0/1803274688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fc9a10 msgr2=0x55c809fd2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f615e7fc700 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fc9a10 0x55c809fd2ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f615e7fc700 1 -- 172.21.15.6:0/1803274688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 msgr2=0x55c809fda420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f615e7fc700 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fda420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f615e7fc700 1 -- 172.21.15.6:0/1803274688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f615001b040 con 0x55c809fca710 2023-09-13T09:57:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f615e7fc700 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fd33e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f61540c97f0 tx=0x7f6154098f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6dd353c8e3221c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f613effd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:57:52.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f613effd700 1 -- 172.21.15.6:0/1803274688 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f615409d310 con 0x55c809fca710 2023-09-13T09:57:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f613effd700 1 -- 172.21.15.6:0/1803274688 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f61540a1550 con 0x55c809fca710 2023-09-13T09:57:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.114+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c809fab670 con 0x55c809fca710 2023-09-13T09:57:52.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f613effd700 1 -- 172.21.15.6:0/1803274688 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6154010880 con 0x55c809fca710 2023-09-13T09:57:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 10 client.29513 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55c809f227a0 con 0x55c809fca710 2023-09-13T09:57:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f613effd700 1 -- 172.21.15.6:0/1803274688 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f615407c080 con 0x55c809fca710 2023-09-13T09:57:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f613effd700 1 -- 172.21.15.6:0/1803274688 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f61540a11c0 con 0x55c809fca710 2023-09-13T09:57:52.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 10 client.29513 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 10 client.29513 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:57:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 20 client.29513 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c809fdeca0 0x55c809fe10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 4 client.29513 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:52.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.115+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c809f03970 con 0x55c809fdeca0 2023-09-13T09:57:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.117+0000 7f615effd700 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c809fdeca0 0x55c809fe10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.117+0000 7f613effd700 10 client.29513 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.117+0000 7f615effd700 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c809fdeca0 0x55c809fe10c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=99c35d85eb570400 server_cookie=f693663433ec37bd in_seq=0 out_seq=0 2023-09-13T09:57:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f613effd700 1 -- 172.21.15.6:0/1803274688 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c809f03970 con 0x55c809fdeca0 2023-09-13T09:57:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f613effd700 10 client.29513 handle_command_reply: tid=0 2023-09-13T09:57:52.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 client.29513 shutdown 2023-09-13T09:57:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 msgr2=0x55c809fd33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fd33e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f61540c97f0 tx=0x7f6154098f10 comp rx=0 tx=0).stop 2023-09-13T09:57:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 shutdown_connections 2023-09-13T09:57:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c809fdeca0 0x55c809fe10c0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fda420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f613effd700 0 client.29513 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fc9a10 0x55c809fd2ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1803274688 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fd33e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 >> 172.21.15.6:0/1803274688 conn(0x55c809f16c80 msgr2=0x55c809fad7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 shutdown_connections 2023-09-13T09:57:52.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.118+0000 7f6171a49b80 1 -- 172.21.15.6:0/1803274688 wait complete. 2023-09-13T09:57:52.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.119+0000 7f6171a49b80 20 client.29513 trim_cache size 0 max 16384 2023-09-13T09:57:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 Processor -- start 2023-09-13T09:57:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 -- start start 2023-09-13T09:57:52.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fd2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fda3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fcb070 0x55c809fb2e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809fb38a0 con 0x55c809fc9a10 2023-09-13T09:57:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809fce540 con 0x55c809fca710 2023-09-13T09:57:52.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f6171a49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809fdea30 con 0x55c809fcb070 2023-09-13T09:57:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fd2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fda3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fda3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38882/0 (socket says 172.21.15.6:38882) 2023-09-13T09:57:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fcb070 0x55c809fb2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fd2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45360/0 (socket says 172.21.15.6:45360) 2023-09-13T09:57:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615e7fc700 1 -- 172.21.15.6:0/163927728 learned_addr learned my addr 172.21.15.6:0/163927728 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615effd700 1 -- 172.21.15.6:0/163927728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fcb070 msgr2=0x55c809fb2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615effd700 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fcb070 0x55c809fb2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615effd700 1 -- 172.21.15.6:0/163927728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 msgr2=0x55c809fda3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.137+0000 7f615effd700 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fda3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.138+0000 7f615effd700 1 -- 172.21.15.6:0/163927728 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c809d36de0 con 0x55c809fc9a10 2023-09-13T09:57:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.138+0000 7f615e7fc700 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fda3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.138+0000 7f615effd700 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fd2550 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x55c809fe19a0 tx=0x7f61500137c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3828a45308112dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.138+0000 7f61467fc700 1 -- 172.21.15.6:0/163927728 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150013150 con 0x55c809fc9a10 2023-09-13T09:57:52.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.138+0000 7f61467fc700 1 -- 172.21.15.6:0/163927728 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6150033070 con 0x55c809fc9a10 2023-09-13T09:57:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.138+0000 7f61467fc700 1 -- 172.21.15.6:0/163927728 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6150005040 con 0x55c809fc9a10 2023-09-13T09:57:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 -- 172.21.15.6:0/163927728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 msgr2=0x55c809fd2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fd2550 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x55c809fe19a0 tx=0x7f61500137c0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 -- 172.21.15.6:0/163927728 shutdown_connections 2023-09-13T09:57:52.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fcb070 0x55c809fb2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fc9a10 0x55c809fd2550 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 --2- 172.21.15.6:0/163927728 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fca710 0x55c809fda3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 -- 172.21.15.6:0/163927728 >> 172.21.15.6:0/163927728 conn(0x55c809f16c80 msgr2=0x55c809fd1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 -- 172.21.15.6:0/163927728 shutdown_connections 2023-09-13T09:57:52.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 -- 172.21.15.6:0/163927728 wait complete. 2023-09-13T09:57:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 -- start start 2023-09-13T09:57:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.139+0000 7f6171a49b80 1 Processor -- start 2023-09-13T09:57:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fc9a10 0x55c809fd6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fd6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f6171a49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fd9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f6171a49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809fd9ab0 con 0x55c809fcb070 2023-09-13T09:57:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f6171a49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809fd9c20 con 0x55c809fc9a10 2023-09-13T09:57:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f6171a49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c809fd9de0 con 0x55c809fca710 2023-09-13T09:57:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f6171a49b80 10 client.0 _ll_register_callbacks cb 0x55c809ea6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fd9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615e7fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fd6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fd9570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45368/0 (socket says 172.21.15.6:45368) 2023-09-13T09:57:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 -- 172.21.15.6:0/1538197507 learned_addr learned my addr 172.21.15.6:0/1538197507 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fc9a10 0x55c809fd6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 -- 172.21.15.6:0/1538197507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 msgr2=0x55c809fd6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fd6550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 -- 172.21.15.6:0/1538197507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fc9a10 msgr2=0x55c809fd6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fc9a10 0x55c809fd6010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.140+0000 7f615f7fe700 1 -- 172.21.15.6:0/1538197507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c809f227a0 con 0x55c809fcb070 2023-09-13T09:57:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f615f7fe700 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fd9570 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f6158009fd0 tx=0x7f6158007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d526f2008ee954 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f613effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:52.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f613effd700 1 -- 172.21.15.6:0/1538197507 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158021070 con 0x55c809fcb070 2023-09-13T09:57:52.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f613effd700 1 -- 172.21.15.6:0/1538197507 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6158007800 con 0x55c809fcb070 2023-09-13T09:57:52.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f61500044e0 con 0x55c809fcb070 2023-09-13T09:57:52.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f613effd700 1 -- 172.21.15.6:0/1538197507 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f615800e040 con 0x55c809fcb070 2023-09-13T09:57:52.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f6171a49b80 10 client.20289 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.141+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55c809d8a630 con 0x55c809fcb070 2023-09-13T09:57:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f613effd700 1 -- 172.21.15.6:0/1538197507 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f61500044e0 con 0x55c809fcb070 2023-09-13T09:57:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f613effd700 1 -- 172.21.15.6:0/1538197507 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f615800b100 con 0x55c809fcb070 2023-09-13T09:57:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f6171a49b80 10 client.20289 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f6171a49b80 10 client.20289 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:57:52.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f6171a49b80 20 client.20289 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c80a0339c0 0x55c80a035de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f6171a49b80 4 client.20289 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c809ec4050 con 0x55c80a0339c0 2023-09-13T09:57:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f615effd700 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c80a0339c0 0x55c80a035de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f613effd700 10 client.20289 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:52.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.142+0000 7f615effd700 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c80a0339c0 0x55c80a035de0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9355c3df7a085fc7 server_cookie=b5ce0aa2fd0343cb in_seq=0 out_seq=0 2023-09-13T09:57:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.143+0000 7f613effd700 1 -- 172.21.15.6:0/1538197507 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c809ec4050 con 0x55c80a0339c0 2023-09-13T09:57:52.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.143+0000 7f613effd700 10 client.20289 handle_command_reply: tid=0 2023-09-13T09:57:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.143+0000 7f6171a49b80 1 client.20289 shutdown 2023-09-13T09:57:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 msgr2=0x55c809fd9570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fd9570 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f6158009fd0 tx=0x7f6158007710 comp rx=0 tx=0).stop 2023-09-13T09:57:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 shutdown_connections 2023-09-13T09:57:52.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55c80a0339c0 0x55c80a035de0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c809fcb070 0x55c809fd9570 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c809fc9a10 0x55c809fd6010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 --2- 172.21.15.6:0/1538197507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c809fca710 0x55c809fd6550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 >> 172.21.15.6:0/1538197507 conn(0x55c809f16c80 msgr2=0x55c809fb2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f613effd700 0 client.20289 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:57:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 shutdown_connections 2023-09-13T09:57:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.144+0000 7f6171a49b80 1 -- 172.21.15.6:0/1538197507 wait complete. 2023-09-13T09:57:52.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6171a49b80 20 client.20289 trim_cache size 0 max 16384 2023-09-13T09:57:52.163 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:52.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61480a06c0 msgr2=0x7f61480a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61480a06c0 0x7f61480a2b80 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f6150013a30 tx=0x7f6150009bc0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160100eb0 msgr2=0x7f61601992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160100eb0 0x7f61601992e0 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f615400e9a0 tx=0x7f615400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 shutdown_connections 2023-09-13T09:57:52.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6160101850 0x7f61601a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f61600ffcc0 0x7f6160198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f61480a06c0 0x7f61480a2b80 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 --2- 172.21.15.6:0/3379387511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6160100eb0 0x7f61601992e0 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.145+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 >> 172.21.15.6:0/3379387511 conn(0x7f61600fb250 msgr2=0x7f61600fc710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.146+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 shutdown_connections 2023-09-13T09:57:52.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.146+0000 7f6165864700 1 -- 172.21.15.6:0/3379387511 wait complete. 2023-09-13T09:57:52.168 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:57:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 -- 172.21.15.6:0/3227255840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a80ffcc0 msgr2=0x7fd1a81000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 --2- 172.21.15.6:0/3227255840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a80ffcc0 0x7fd1a81000e0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7fd1a40099c0 tx=0x7fd1a4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 -- 172.21.15.6:0/3227255840 shutdown_connections 2023-09-13T09:57:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 --2- 172.21.15.6:0/3227255840 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a8101850 0x7fd1a8108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 --2- 172.21.15.6:0/3227255840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a80ffcc0 0x7fd1a81000e0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 --2- 172.21.15.6:0/3227255840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a8100eb0 0x7fd1a8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 -- 172.21.15.6:0/3227255840 >> 172.21.15.6:0/3227255840 conn(0x7fd1a80fb250 msgr2=0x7fd1a80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 -- 172.21.15.6:0/3227255840 shutdown_connections 2023-09-13T09:57:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.357+0000 7fd1af73d700 1 -- 172.21.15.6:0/3227255840 wait complete. 2023-09-13T09:57:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 Processor -- start 2023-09-13T09:57:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 -- start start 2023-09-13T09:57:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a80ffcc0 0x7fd1a81948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a8100eb0 0x7fd1a8194de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a8101850 0x7fd1a819be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1accd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a8100eb0 0x7fd1a8194de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a819c420 con 0x7fd1a8100eb0 2023-09-13T09:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a819c560 con 0x7fd1a8101850 2023-09-13T09:57:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1accd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a8100eb0 0x7fd1a8194de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45380/0 (socket says 172.21.15.6:45380) 2023-09-13T09:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1af73d700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a819c6f0 con 0x7fd1a80ffcc0 2023-09-13T09:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1accd8700 1 -- 172.21.15.6:0/1073237922 learned_addr learned my addr 172.21.15.6:0/1073237922 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.358+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a80ffcc0 0x7fd1a81948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1adcda700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a8101850 0x7fd1a819be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1accd8700 1 -- 172.21.15.6:0/1073237922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a80ffcc0 msgr2=0x7fd1a81948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1accd8700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a80ffcc0 0x7fd1a81948a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1accd8700 1 -- 172.21.15.6:0/1073237922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a8101850 msgr2=0x7fd1a819be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1accd8700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a8101850 0x7fd1a819be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1accd8700 1 -- 172.21.15.6:0/1073237922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a40095f0 con 0x7fd1a8100eb0 2023-09-13T09:57:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1accd8700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a8100eb0 0x7fd1a8194de0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fd198007bd0 tx=0x7fd198007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd19e7fc700 1 -- 172.21.15.6:0/1073237922 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198010040 con 0x7fd1a8100eb0 2023-09-13T09:57:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd19e7fc700 1 -- 172.21.15.6:0/1073237922 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd19800fe90 con 0x7fd1a8100eb0 2023-09-13T09:57:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a819c9d0 con 0x7fd1a8100eb0 2023-09-13T09:57:52.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd19e7fc700 1 -- 172.21.15.6:0/1073237922 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1980143d0 con 0x7fd1a8100eb0 2023-09-13T09:57:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.359+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a819cee0 con 0x7fd1a8100eb0 2023-09-13T09:57:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.360+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a80ffcc0 0x7fd1a81948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.364+0000 7fd1bb922b80 1 Processor -- start 2023-09-13T09:57:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.365+0000 7fd1bb922b80 1 -- start start 2023-09-13T09:57:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.365+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486f10 0x55e5a1487330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.365+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1485cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.365+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486210 0x55e5a1486670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.365+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a13d6780 con 0x55e5a1487870 2023-09-13T09:57:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.365+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a13d40a0 con 0x55e5a1486f10 2023-09-13T09:57:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.365+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a13cf990 con 0x55e5a1486210 2023-09-13T09:57:52.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486f10 0x55e5a1487330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486f10 0x55e5a1487330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38910/0 (socket says 172.21.15.6:38910) 2023-09-13T09:57:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 -- 172.21.15.6:0/2657682053 learned_addr learned my addr 172.21.15.6:0/2657682053 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1485cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 -- 172.21.15.6:0/2657682053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486210 msgr2=0x55e5a1486670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:52.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486210 0x55e5a1486670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 -- 172.21.15.6:0/2657682053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 msgr2=0x55e5a1485cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1485cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.366+0000 7fd1adcda700 1 -- 172.21.15.6:0/2657682053 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a124f630 con 0x55e5a1486f10 2023-09-13T09:57:52.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.368+0000 7fd19e7fc700 1 -- 172.21.15.6:0/1073237922 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd198015570 con 0x7fd1a8100eb0 2023-09-13T09:57:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.368+0000 7fd1adcda700 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486f10 0x55e5a1487330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000f8c0 tx=0x7fd1a000dd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42e396aa4be3d659 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.368+0000 7fd1937fe700 1 -- 172.21.15.6:0/2657682053 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0012040 con 0x55e5a1486f10 2023-09-13T09:57:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.368+0000 7fd19e7fc700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1940a0640 0x7fd1940a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.368+0000 7fd1937fe700 1 -- 172.21.15.6:0/2657682053 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a0013040 con 0x55e5a1486f10 2023-09-13T09:57:52.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.368+0000 7fd1937fe700 1 -- 172.21.15.6:0/2657682053 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a000d330 con 0x55e5a1486f10 2023-09-13T09:57:52.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd19e7fc700 1 -- 172.21.15.6:0/1073237922 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1980cc020 con 0x7fd1a8100eb0 2023-09-13T09:57:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd1bb922b80 1 -- 172.21.15.6:0/2657682053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486f10 msgr2=0x55e5a1487330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486f10 0x55e5a1487330 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000f8c0 tx=0x7fd1a000dd30 comp rx=0 tx=0).stop 2023-09-13T09:57:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd1bb922b80 1 -- 172.21.15.6:0/2657682053 shutdown_connections 2023-09-13T09:57:52.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486210 0x55e5a1486670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486f10 0x55e5a1487330 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/2657682053 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1485cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.369+0000 7fd1bb922b80 1 -- 172.21.15.6:0/2657682053 >> 172.21.15.6:0/2657682053 conn(0x55e5a13dbc80 msgr2=0x55e5a1477f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.370+0000 7fd1bb922b80 1 -- 172.21.15.6:0/2657682053 shutdown_connections 2023-09-13T09:57:52.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.370+0000 7fd1bb922b80 1 -- 172.21.15.6:0/2657682053 wait complete. 2023-09-13T09:57:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.370+0000 7fd1bb922b80 1 -- start start 2023-09-13T09:57:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.370+0000 7fd1bb922b80 1 Processor -- start 2023-09-13T09:57:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a147f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a147f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1484850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a136dbb0 con 0x55e5a1487870 2023-09-13T09:57:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a136d8b0 con 0x55e5a1486210 2023-09-13T09:57:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a1251920 con 0x55e5a1486f10 2023-09-13T09:57:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1bb922b80 10 client.0 _ll_register_callbacks cb 0x55e5a136b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:52.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1940a0640 0x7fd1940a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1ad4d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a147f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1ad4d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a147f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38916/0 (socket says 172.21.15.6:38916) 2023-09-13T09:57:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.371+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3216594073 learned_addr learned my addr 172.21.15.6:0/3216594073 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1adcda700 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1484850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3216594073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 msgr2=0x55e5a147f820 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a147f820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3216594073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 msgr2=0x55e5a1484850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1484850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3216594073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a000f570 con 0x55e5a1486210 2023-09-13T09:57:52.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1940a0640 0x7fd1940a2b00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4005cd0 tx=0x7fd1a4005c20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.372+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a147f2e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4000c00 tx=0x7fd1a4009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8324749f10396506 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.373+0000 7fd190ff9700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:57:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.374+0000 7fd190ff9700 1 -- 172.21.15.6:0/3216594073 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a402acc0 con 0x55e5a1486210 2023-09-13T09:57:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.374+0000 7fd190ff9700 1 -- 172.21.15.6:0/3216594073 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1a402ae20 con 0x55e5a1486210 2023-09-13T09:57:52.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.374+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5a1470670 con 0x55e5a1486210 2023-09-13T09:57:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.376+0000 7fd190ff9700 1 -- 172.21.15.6:0/3216594073 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1a4005030 con 0x55e5a1486210 2023-09-13T09:57:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.376+0000 7fd1bb922b80 10 client.29531 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.376+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55e5a13e77a0 con 0x55e5a1486210 2023-09-13T09:57:52.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd190ff9700 1 -- 172.21.15.6:0/3216594073 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e5a1470670 con 0x55e5a1486210 2023-09-13T09:57:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd190ff9700 1 -- 172.21.15.6:0/3216594073 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd1a4021070 con 0x55e5a1486210 2023-09-13T09:57:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd1bb922b80 10 client.29531 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd1bb922b80 10 client.29531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd1bb922b80 20 client.29531 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:52.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14a3d60 0x55e5a14a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd1bb922b80 4 client.29531 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.377+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5a13c8970 con 0x55e5a14a3d60 2023-09-13T09:57:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.380+0000 7fd1accd8700 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14a3d60 0x55e5a14a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.380+0000 7fd190ff9700 10 client.29531 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.380+0000 7fd1accd8700 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14a3d60 0x55e5a14a6180 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94778f0718c250db server_cookie=dd25cf94462a71c2 in_seq=0 out_seq=0 2023-09-13T09:57:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.386+0000 7fd190ff9700 1 -- 172.21.15.6:0/3216594073 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e5a13c8970 con 0x55e5a14a3d60 2023-09-13T09:57:52.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.386+0000 7fd190ff9700 10 client.29531 handle_command_reply: tid=0 2023-09-13T09:57:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 client.29531 shutdown 2023-09-13T09:57:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 msgr2=0x55e5a147f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a147f2e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4000c00 tx=0x7fd1a4009cd0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 shutdown_connections 2023-09-13T09:57:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14a3d60 0x55e5a14a6180 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a1484850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd190ff9700 0 client.29531 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:52.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a147f2e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3216594073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a147f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 >> 172.21.15.6:0/3216594073 conn(0x55e5a13dbc80 msgr2=0x55e5a147c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 shutdown_connections 2023-09-13T09:57:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3216594073 wait complete. 2023-09-13T09:57:52.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.388+0000 7fd1bb922b80 20 client.29531 trim_cache size 0 max 16384 2023-09-13T09:57:52.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.409+0000 7fd1bb922b80 1 Processor -- start 2023-09-13T09:57:52.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.409+0000 7fd1bb922b80 1 -- start start 2023-09-13T09:57:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.409+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a1484810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.409+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a14b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.409+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a147f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.409+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a14876b0 con 0x55e5a1487870 2023-09-13T09:57:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.410+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a14799f0 con 0x55e5a1486210 2023-09-13T09:57:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.410+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a14b3ea0 con 0x55e5a1486f10 2023-09-13T09:57:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.410+0000 7fd1ad4d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a1484810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.410+0000 7fd1ad4d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a1484810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38920/0 (socket says 172.21.15.6:38920) 2023-09-13T09:57:52.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.410+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3410506160 learned_addr learned my addr 172.21.15.6:0/3410506160 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.411+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3410506160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 msgr2=0x55e5a14b3960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:57:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.411+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3410506160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a14b3960 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.411+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3410506160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 msgr2=0x55e5a147f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.411+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3410506160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a147f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.411+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3410506160 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5a11fbde0 con 0x55e5a1486210 2023-09-13T09:57:52.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.414+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3410506160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a1484810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4038040 tx=0x7fd1a400b540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de537f4d7e4ae971 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.414+0000 7fd193fff700 1 -- 172.21.15.6:0/3410506160 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a402aac0 con 0x55e5a1486210 2023-09-13T09:57:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.414+0000 7fd193fff700 1 -- 172.21.15.6:0/3410506160 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a401e040 con 0x55e5a1486210 2023-09-13T09:57:52.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.414+0000 7fd193fff700 1 -- 172.21.15.6:0/3410506160 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a4004bc0 con 0x55e5a1486210 2023-09-13T09:57:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.415+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3410506160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 msgr2=0x55e5a1484810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.415+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3410506160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a1484810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4038040 tx=0x7fd1a400b540 comp rx=0 tx=0).stop 2023-09-13T09:57:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.415+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3410506160 shutdown_connections 2023-09-13T09:57:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.415+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3410506160 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a147f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.415+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3410506160 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a1484810 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.415+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3410506160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a14b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.415+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3410506160 >> 172.21.15.6:0/3410506160 conn(0x55e5a13dbc80 msgr2=0x55e5a1477ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.418+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3410506160 shutdown_connections 2023-09-13T09:57:52.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.418+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3410506160 wait complete. 2023-09-13T09:57:52.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.418+0000 7fd1bb922b80 1 -- start start 2023-09-13T09:57:52.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.418+0000 7fd1bb922b80 1 Processor -- start 2023-09-13T09:57:52.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.418+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a14b2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.418+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a14b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.418+0000 7fd1bb922b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a14f6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a14f6a60 con 0x55e5a1487870 2023-09-13T09:57:52.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a14f6ba0 con 0x55e5a1486210 2023-09-13T09:57:52.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1bb922b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5a14f6d60 con 0x55e5a1486f10 2023-09-13T09:57:52.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1bb922b80 10 client.0 _ll_register_callbacks cb 0x55e5a136b680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:52.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1ad4d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a14b2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1adcda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a14f6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1accd8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a14b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1ad4d9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a14b2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38924/0 (socket says 172.21.15.6:38924) 2023-09-13T09:57:52.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1ad4d9700 1 -- 172.21.15.6:0/3357133273 learned_addr learned my addr 172.21.15.6:0/3357133273 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:52.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1adcda700 1 -- 172.21.15.6:0/3357133273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 msgr2=0x55e5a14b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1adcda700 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a14b3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1adcda700 1 -- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 msgr2=0x55e5a14b2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:52.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1adcda700 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a14b2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1adcda700 1 -- 172.21.15.6:0/3357133273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e5a13e77a0 con 0x55e5a1487870 2023-09-13T09:57:52.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a14b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:52.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1adcda700 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a14f6520 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000f890 tx=0x7fd1a000bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c98c5179120626 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:52.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd190ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:52.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd190ff9700 1 -- 172.21.15.6:0/3357133273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1a0024070 con 0x55e5a1487870 2023-09-13T09:57:52.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.419+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd1a0013040 con 0x55e5a1487870 2023-09-13T09:57:52.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd190ff9700 1 -- 172.21.15.6:0/3357133273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1a000b3e0 con 0x55e5a1487870 2023-09-13T09:57:52.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd190ff9700 1 -- 172.21.15.6:0/3357133273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1a0012040 con 0x55e5a1487870 2023-09-13T09:57:52.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 10 client.20304 fetch_fsmap learned FSMap version 64 2023-09-13T09:57:52.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55e5a11e4c60 con 0x55e5a1487870 2023-09-13T09:57:52.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd190ff9700 1 -- 172.21.15.6:0/3357133273 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd1a002e020 con 0x55e5a1487870 2023-09-13T09:57:52.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd190ff9700 1 -- 172.21.15.6:0/3357133273 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 64) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fd1a0027030 con 0x55e5a1487870 2023-09-13T09:57:52.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 10 client.20304 fetch_fsmap finished waiting for FSMap version 64 2023-09-13T09:57:52.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 10 client.20304 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:52.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 20 client.20304 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:52.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14f8720 0x55e5a14fab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 4 client.20304 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:57:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e5a1389050 con 0x55e5a14f8720 2023-09-13T09:57:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.420+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14f8720 0x55e5a14fab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd190ff9700 10 client.20304 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:52.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1ad4d9700 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14f8720 0x55e5a14fab40 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e44e5364136ef05 server_cookie=3a5c4d809a582974 in_seq=0 out_seq=0 2023-09-13T09:57:52.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd190ff9700 1 -- 172.21.15.6:0/3357133273 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e5a1389050 con 0x55e5a14f8720 2023-09-13T09:57:52.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd190ff9700 10 client.20304 handle_command_reply: tid=0 2023-09-13T09:57:52.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 client.20304 shutdown 2023-09-13T09:57:52.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 msgr2=0x55e5a14f6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a14f6520 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7fd1a000f890 tx=0x7fd1a000bb40 comp rx=0 tx=0).stop 2023-09-13T09:57:52.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 shutdown_connections 2023-09-13T09:57:52.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e5a14f8720 0x55e5a14fab40 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e5a1487870 0x55e5a14f6520 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd190ff9700 0 client.20304 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:52.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e5a1486210 0x55e5a14b2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 --2- 172.21.15.6:0/3357133273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e5a1486f10 0x55e5a14b3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 >> 172.21.15.6:0/3357133273 conn(0x55e5a13dbc80 msgr2=0x55e5a147f090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 shutdown_connections 2023-09-13T09:57:52.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.421+0000 7fd1bb922b80 1 -- 172.21.15.6:0/3357133273 wait complete. 2023-09-13T09:57:52.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1bb922b80 20 client.20304 trim_cache size 0 max 16384 2023-09-13T09:57:52.434 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:57:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1940a0640 msgr2=0x7fd1940a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1940a0640 0x7fd1940a2b00 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fd1a4005cd0 tx=0x7fd1a4005c20 comp rx=0 tx=0).stop 2023-09-13T09:57:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a8100eb0 msgr2=0x7fd1a8194de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:52.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a8100eb0 0x7fd1a8194de0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7fd198007bd0 tx=0x7fd198007ee0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 shutdown_connections 2023-09-13T09:57:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1a8101850 0x7fd1a819be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1a80ffcc0 0x7fd1a81948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1940a0640 0x7fd1940a2b00 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 --2- 172.21.15.6:0/1073237922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1a8100eb0 0x7fd1a8194de0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:52.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 >> 172.21.15.6:0/1073237922 conn(0x7fd1a80fb250 msgr2=0x7fd1a80fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:52.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 shutdown_connections 2023-09-13T09:57:52.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:52.422+0000 7fd1af73d700 1 -- 172.21.15.6:0/1073237922 wait complete. 2023-09-13T09:57:52.580 INFO:tasks.workunit.client.0.smithi006.stdout: 10 217476 36.70 MB/sec execute 192 sec latency 60.772 ms 2023-09-13T09:57:53.439 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:57:53.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:57:53.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 218288 36.75 MB/sec execute 193 sec latency 57.867 ms 2023-09-13T09:57:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.604+0000 7fcb5aae0700 1 -- 172.21.15.6:0/2366441841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb541004b0 msgr2=0x7fcb541028a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.604+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/2366441841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb541004b0 0x7fcb541028a0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fcb48009990 tx=0x7fcb48009ca0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 -- 172.21.15.6:0/2366441841 shutdown_connections 2023-09-13T09:57:53.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/2366441841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb54105920 0x7fcb54107de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/2366441841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb541004b0 0x7fcb541028a0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/2366441841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb54102e70 0x7fcb54105260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 -- 172.21.15.6:0/2366441841 >> 172.21.15.6:0/2366441841 conn(0x7fcb540fa510 msgr2=0x7fcb540fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 -- 172.21.15.6:0/2366441841 shutdown_connections 2023-09-13T09:57:53.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 -- 172.21.15.6:0/2366441841 wait complete. 2023-09-13T09:57:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 Processor -- start 2023-09-13T09:57:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.605+0000 7fcb5aae0700 1 -- start start 2023-09-13T09:57:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5aae0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb541004b0 0x7fcb54198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5aae0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb54102e70 0x7fcb54199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5aae0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb54105920 0x7fcb541a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5aae0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541a0900 con 0x7fcb54105920 2023-09-13T09:57:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5aae0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541a0a70 con 0x7fcb54102e70 2023-09-13T09:57:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5aae0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb541a0c30 con 0x7fcb541004b0 2023-09-13T09:57:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb54105920 0x7fcb541a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5887c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb541004b0 0x7fcb54198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5887c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb541004b0 0x7fcb54198dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48468/0 (socket says 172.21.15.6:48468) 2023-09-13T09:57:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb54105920 0x7fcb541a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45416/0 (socket says 172.21.15.6:45416) 2023-09-13T09:57:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5887c700 1 -- 172.21.15.6:0/886812072 learned_addr learned my addr 172.21.15.6:0/886812072 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 -- 172.21.15.6:0/886812072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb541004b0 msgr2=0x7fcb54198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb541004b0 0x7fcb54198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 -- 172.21.15.6:0/886812072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb54102e70 msgr2=0x7fcb54199300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:57:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb54102e70 0x7fcb54199300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 -- 172.21.15.6:0/886812072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb480095f0 con 0x7fcb54105920 2023-09-13T09:57:53.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.606+0000 7fcb5907d700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb54105920 0x7fcb541a0330 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00be20 tx=0x7fcb4c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.607+0000 7fcb51ffb700 1 -- 172.21.15.6:0/886812072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c00cc10 con 0x7fcb54105920 2023-09-13T09:57:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.607+0000 7fcb51ffb700 1 -- 172.21.15.6:0/886812072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb4c00cd70 con 0x7fcb54105920 2023-09-13T09:57:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.607+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb541a0f10 con 0x7fcb54105920 2023-09-13T09:57:53.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.607+0000 7fcb51ffb700 1 -- 172.21.15.6:0/886812072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c012760 con 0x7fcb54105920 2023-09-13T09:57:53.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.607+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb541a13c0 con 0x7fcb54105920 2023-09-13T09:57:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.610+0000 7fcb51ffb700 1 -- 172.21.15.6:0/886812072 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fcb4c014440 con 0x7fcb54105920 2023-09-13T09:57:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.611+0000 7fcb51ffb700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb440a0640 0x7fcb440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.611+0000 7fcb5887c700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb440a0640 0x7fcb440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.611+0000 7fcb51ffb700 1 -- 172.21.15.6:0/886812072 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb4c006e40 con 0x7fcb54105920 2023-09-13T09:57:53.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.611+0000 7fcb5887c700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb440a0640 0x7fcb440a2b00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800b2e0 tx=0x7fcb48005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 Processor -- start 2023-09-13T09:57:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 -- start start 2023-09-13T09:57:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x55799450b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x557994509d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450a290 0x55799450a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799445a800 con 0x55799450af90 2023-09-13T09:57:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557994458120 con 0x55799450b8f0 2023-09-13T09:57:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.612+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557994453a10 con 0x55799450a290 2023-09-13T09:57:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb5887c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x55799450b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x557994509d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x557994509d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38946/0 (socket says 172.21.15.6:38946) 2023-09-13T09:57:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 -- 172.21.15.6:0/3811971898 learned_addr learned my addr 172.21.15.6:0/3811971898 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb5887c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x55799450b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45424/0 (socket says 172.21.15.6:45424) 2023-09-13T09:57:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 -- 172.21.15.6:0/3811971898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450a290 msgr2=0x55799450a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450a290 0x55799450a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 -- 172.21.15.6:0/3811971898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 msgr2=0x55799450b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x55799450b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 -- 172.21.15.6:0/3811971898 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579942d36b0 con 0x55799450b8f0 2023-09-13T09:57:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb5887c700 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x55799450b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.613+0000 7fcb53fff700 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x557994509d50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009c60 tx=0x7fcb40009f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74630e85551242b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.614+0000 7fcb3effd700 1 -- 172.21.15.6:0/3811971898 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4000eb60 con 0x55799450b8f0 2023-09-13T09:57:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.614+0000 7fcb3effd700 1 -- 172.21.15.6:0/3811971898 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb40004cf0 con 0x55799450b8f0 2023-09-13T09:57:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.614+0000 7fcb3effd700 1 -- 172.21.15.6:0/3811971898 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb40005640 con 0x55799450b8f0 2023-09-13T09:57:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.614+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3811971898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 msgr2=0x557994509d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.614+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x557994509d50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcb40009c60 tx=0x7fcb40009f70 comp rx=0 tx=0).stop 2023-09-13T09:57:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3811971898 shutdown_connections 2023-09-13T09:57:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450a290 0x55799450a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x55799450b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3811971898 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x557994509d50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3811971898 >> 172.21.15.6:0/3811971898 conn(0x55799445fd00 msgr2=0x5579944fbf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3811971898 shutdown_connections 2023-09-13T09:57:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3811971898 wait complete. 2023-09-13T09:57:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 -- start start 2023-09-13T09:57:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.615+0000 7fcb66cc5b80 1 Processor -- start 2023-09-13T09:57:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994513820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450af90 0x557994513d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x55799451ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579943f1c30 con 0x55799450a290 2023-09-13T09:57:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579943f1930 con 0x55799450b8f0 2023-09-13T09:57:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579942d59a0 con 0x55799450af90 2023-09-13T09:57:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb66cc5b80 10 client.0 _ll_register_callbacks cb 0x5579943ef700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:53.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450af90 0x557994513d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5907d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x55799451ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb53fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450af90 0x557994513d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48480/0 (socket says 172.21.15.6:48480) 2023-09-13T09:57:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5907d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x55799451ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38950/0 (socket says 172.21.15.6:38950) 2023-09-13T09:57:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb53fff700 1 -- 172.21.15.6:0/1975440953 learned_addr learned my addr 172.21.15.6:0/1975440953 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5887c700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994513820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5887c700 1 -- 172.21.15.6:0/1975440953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450af90 msgr2=0x557994513d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5887c700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450af90 0x557994513d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5887c700 1 -- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 msgr2=0x55799451ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5887c700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x55799451ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5887c700 1 -- 172.21.15.6:0/1975440953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb40009910 con 0x55799450a290 2023-09-13T09:57:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb53fff700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450af90 0x557994513d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.616+0000 7fcb5907d700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x55799451ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb5887c700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994513820 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fcb48000c00 tx=0x7fcb4801a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a77c52870852132 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb33fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb33fff700 1 -- 172.21.15.6:0/1975440953 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4802b070 con 0x55799450a290 2023-09-13T09:57:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb33fff700 1 -- 172.21.15.6:0/1975440953 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb48026270 con 0x55799450a290 2023-09-13T09:57:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5579944f46f0 con 0x55799450a290 2023-09-13T09:57:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb33fff700 1 -- 172.21.15.6:0/1975440953 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb48026810 con 0x55799450a290 2023-09-13T09:57:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb66cc5b80 10 client.20316 fetch_fsmap learned FSMap version 65 2023-09-13T09:57:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55799446b820 con 0x55799450a290 2023-09-13T09:57:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb33fff700 1 -- 172.21.15.6:0/1975440953 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb48040080 con 0x55799450a290 2023-09-13T09:57:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb33fff700 1 -- 172.21.15.6:0/1975440953 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 65) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcb480318e0 con 0x55799450a290 2023-09-13T09:57:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb66cc5b80 10 client.20316 fetch_fsmap finished waiting for FSMap version 65 2023-09-13T09:57:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb66cc5b80 10 client.20316 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb66cc5b80 20 client.20316 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.617+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557994502810 0x557994504c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.618+0000 7fcb66cc5b80 4 client.20316 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.618+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55799444c9f0 con 0x557994502810 2023-09-13T09:57:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.618+0000 7fcb53fff700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557994502810 0x557994504c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.618+0000 7fcb53fff700 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557994502810 0x557994504c30 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47602fc8da6d8c9 server_cookie=50580416c38a4ca9 in_seq=0 out_seq=0 2023-09-13T09:57:53.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.618+0000 7fcb33fff700 10 client.20316 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.619+0000 7fcb33fff700 1 -- 172.21.15.6:0/1975440953 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55799444c9f0 con 0x557994502810 2023-09-13T09:57:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.619+0000 7fcb33fff700 10 client.20316 handle_command_reply: tid=0 2023-09-13T09:57:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.619+0000 7fcb66cc5b80 1 client.20316 shutdown 2023-09-13T09:57:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 msgr2=0x557994513820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994513820 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7fcb48000c00 tx=0x7fcb4801a050 comp rx=0 tx=0).stop 2023-09-13T09:57:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 shutdown_connections 2023-09-13T09:57:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450b8f0 0x55799451ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557994502810 0x557994504c30 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994513820 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb33fff700 0 client.20316 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/1975440953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450af90 0x557994513d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 >> 172.21.15.6:0/1975440953 conn(0x55799445fd00 msgr2=0x5579944f6870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 shutdown_connections 2023-09-13T09:57:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/1975440953 wait complete. 2023-09-13T09:57:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.620+0000 7fcb66cc5b80 20 client.20316 trim_cache size 0 max 16384 2023-09-13T09:57:53.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 Processor -- start 2023-09-13T09:57:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 -- start start 2023-09-13T09:57:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450a290 0x5579944f6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x557994509590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x557994509ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557994513390 con 0x55799450af90 2023-09-13T09:57:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579944fd3f0 con 0x55799450a290 2023-09-13T09:57:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.644+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5579944fda90 con 0x55799450b8f0 2023-09-13T09:57:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x557994509590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb53fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x557994509590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45438/0 (socket says 172.21.15.6:45438) 2023-09-13T09:57:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb53fff700 1 -- 172.21.15.6:0/3081099285 learned_addr learned my addr 172.21.15.6:0/3081099285 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5887c700 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450a290 0x5579944f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5907d700 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x557994509ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5887c700 1 -- 172.21.15.6:0/3081099285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 msgr2=0x557994509ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5887c700 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x557994509ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5887c700 1 -- 172.21.15.6:0/3081099285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 msgr2=0x557994509590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5887c700 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x557994509590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5887c700 1 -- 172.21.15.6:0/3081099285 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5579944fc230 con 0x55799450a290 2023-09-13T09:57:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb53fff700 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x557994509590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.645+0000 7fcb5887c700 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450a290 0x5579944f6970 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb48031cc0 tx=0x7fcb4800bfa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c9fd0c7160870cfd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.653+0000 7fcb3f7fe700 1 -- 172.21.15.6:0/3081099285 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4802b050 con 0x55799450a290 2023-09-13T09:57:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.653+0000 7fcb3f7fe700 1 -- 172.21.15.6:0/3081099285 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5579944f46f0 con 0x55799450a290 2023-09-13T09:57:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.653+0000 7fcb3f7fe700 1 -- 172.21.15.6:0/3081099285 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48026a20 con 0x55799450a290 2023-09-13T09:57:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.654+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3081099285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450a290 msgr2=0x5579944f6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.654+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450a290 0x5579944f6970 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcb48031cc0 tx=0x7fcb4800bfa0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3081099285 shutdown_connections 2023-09-13T09:57:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x557994509ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450a290 0x5579944f6970 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/3081099285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450af90 0x557994509590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3081099285 >> 172.21.15.6:0/3081099285 conn(0x55799445fd00 msgr2=0x557994511740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3081099285 shutdown_connections 2023-09-13T09:57:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/3081099285 wait complete. 2023-09-13T09:57:53.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 -- start start 2023-09-13T09:57:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.659+0000 7fcb66cc5b80 1 Processor -- start 2023-09-13T09:57:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994508900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450af90 0x557994508e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb66cc5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x55799457b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557994509700 con 0x55799450a290 2023-09-13T09:57:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799457b8e0 con 0x55799450af90 2023-09-13T09:57:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb66cc5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799457ba20 con 0x55799450b8f0 2023-09-13T09:57:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb66cc5b80 10 client.0 _ll_register_callbacks cb 0x5579943ef700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994508900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994508900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45442/0 (socket says 172.21.15.6:45442) 2023-09-13T09:57:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5907d700 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x55799457b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 -- 172.21.15.6:0/140566575 learned_addr learned my addr 172.21.15.6:0/140566575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb53fff700 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450af90 0x557994508e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 -- 172.21.15.6:0/140566575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 msgr2=0x55799457b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x55799457b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 -- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450af90 msgr2=0x557994508e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450af90 0x557994508e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.660+0000 7fcb5887c700 1 -- 172.21.15.6:0/140566575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5579942d36b0 con 0x55799450a290 2023-09-13T09:57:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb5887c700 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994508900 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800b680 tx=0x7fcb48031710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca27aee4be0a800 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb33fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:53.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb33fff700 1 -- 172.21.15.6:0/140566575 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4802b050 con 0x55799450a290 2023-09-13T09:57:53.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb33fff700 1 -- 172.21.15.6:0/140566575 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fcb480269a0 con 0x55799450a290 2023-09-13T09:57:53.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcb40004cf0 con 0x55799450a290 2023-09-13T09:57:53.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb33fff700 1 -- 172.21.15.6:0/140566575 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb48031e60 con 0x55799450a290 2023-09-13T09:57:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb66cc5b80 10 client.20322 fetch_fsmap learned FSMap version 65 2023-09-13T09:57:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x55799446b820 con 0x55799450a290 2023-09-13T09:57:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.661+0000 7fcb33fff700 1 -- 172.21.15.6:0/140566575 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fcb40004cf0 con 0x55799450a290 2023-09-13T09:57:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb33fff700 1 -- 172.21.15.6:0/140566575 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 65) v1 ==== 7890+0+0 (secure 0 0 0) 0x7fcb4803ca70 con 0x55799450a290 2023-09-13T09:57:53.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb66cc5b80 10 client.20322 fetch_fsmap finished waiting for FSMap version 65 2023-09-13T09:57:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb66cc5b80 10 client.20322 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb66cc5b80 20 client.20322 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55799457cfb0 0x55799457f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb66cc5b80 4 client.20322 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:57:53.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55799440d0d0 con 0x55799457cfb0 2023-09-13T09:57:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.662+0000 7fcb53fff700 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55799457cfb0 0x55799457f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.663+0000 7fcb33fff700 10 client.20322 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.663+0000 7fcb53fff700 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55799457cfb0 0x55799457f3d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=247f85514e15a526 server_cookie=87f09293e68e71c4 in_seq=0 out_seq=0 2023-09-13T09:57:53.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.666+0000 7fcb33fff700 1 -- 172.21.15.6:0/140566575 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55799440d0d0 con 0x55799457cfb0 2023-09-13T09:57:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.666+0000 7fcb33fff700 10 client.20322 handle_command_reply: tid=0 2023-09-13T09:57:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.666+0000 7fcb66cc5b80 1 client.20322 shutdown 2023-09-13T09:57:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 msgr2=0x557994508900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994508900 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800b680 tx=0x7fcb48031710 comp rx=0 tx=0).stop 2023-09-13T09:57:53.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 shutdown_connections 2023-09-13T09:57:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799450b8f0 0x55799457b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55799457cfb0 0x55799457f3d0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799450a290 0x557994508900 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb33fff700 0 client.20322 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 --2- 172.21.15.6:0/140566575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799450af90 0x557994508e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 >> 172.21.15.6:0/140566575 conn(0x55799445fd00 msgr2=0x5579945135d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 shutdown_connections 2023-09-13T09:57:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 1 -- 172.21.15.6:0/140566575 wait complete. 2023-09-13T09:57:53.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.667+0000 7fcb66cc5b80 20 client.20322 trim_cache size 0 max 16384 2023-09-13T09:57:53.677 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:57:53.677 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:57:53.677 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "a10bb777-33ed-4da8-ae17-af7b0fa9db04", 2023-09-13T09:57:53.677 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:57:53.677 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:57:53.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.668+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb440a0640 msgr2=0x7fcb440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.668+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb440a0640 0x7fcb440a2b00 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fcb4800b2e0 tx=0x7fcb48005fb0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.668+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb54105920 msgr2=0x7fcb541a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.668+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb54105920 0x7fcb541a0330 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c00be20 tx=0x7fcb4c009ed0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 shutdown_connections 2023-09-13T09:57:53.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fcb440a0640 0x7fcb440a2b00 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb54105920 0x7fcb541a0330 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb541004b0 0x7fcb54198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 --2- 172.21.15.6:0/886812072 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fcb54102e70 0x7fcb54199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 >> 172.21.15.6:0/886812072 conn(0x7fcb540fa510 msgr2=0x7fcb54104b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 shutdown_connections 2023-09-13T09:57:53.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.669+0000 7fcb5aae0700 1 -- 172.21.15.6:0/886812072 wait complete. 2023-09-13T09:57:53.685 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:57:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.853+0000 7f414efc8700 1 -- 172.21.15.6:0/236902404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148106ae0 msgr2=0x7f4148108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.853+0000 7f414efc8700 1 --2- 172.21.15.6:0/236902404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148106ae0 0x7f4148108f10 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f414000b0a0 tx=0x7f414000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.854+0000 7f414efc8700 1 -- 172.21.15.6:0/236902404 shutdown_connections 2023-09-13T09:57:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.854+0000 7f414efc8700 1 --2- 172.21.15.6:0/236902404 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148106ae0 0x7f4148108f10 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.854+0000 7f414efc8700 1 --2- 172.21.15.6:0/236902404 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4148101880 0x7f4148103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.854+0000 7f414efc8700 1 --2- 172.21.15.6:0/236902404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41481041b0 0x7f41481065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.854+0000 7f414efc8700 1 -- 172.21.15.6:0/236902404 >> 172.21.15.6:0/236902404 conn(0x7f41480fb210 msgr2=0x7f41480fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.854+0000 7f414efc8700 1 -- 172.21.15.6:0/236902404 shutdown_connections 2023-09-13T09:57:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.854+0000 7f414efc8700 1 -- 172.21.15.6:0/236902404 wait complete. 2023-09-13T09:57:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 Processor -- start 2023-09-13T09:57:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 -- start start 2023-09-13T09:57:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148101880 0x7f41481947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41481041b0 0x7f4148194cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4148106ae0 0x7f414819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414819c330 con 0x7f4148101880 2023-09-13T09:57:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414819c470 con 0x7f41481041b0 2023-09-13T09:57:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414efc8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414819c600 con 0x7f4148106ae0 2023-09-13T09:57:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414cd64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148101880 0x7f41481947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f4147fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41481041b0 0x7f4148194cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414cd64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148101880 0x7f41481947b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45456/0 (socket says 172.21.15.6:45456) 2023-09-13T09:57:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414cd64700 1 -- 172.21.15.6:0/1652630396 learned_addr learned my addr 172.21.15.6:0/1652630396 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.855+0000 7f414d565700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4148106ae0 0x7f414819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f414cd64700 1 -- 172.21.15.6:0/1652630396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4148106ae0 msgr2=0x7f414819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f414cd64700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4148106ae0 0x7f414819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f414cd64700 1 -- 172.21.15.6:0/1652630396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41481041b0 msgr2=0x7f4148194cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f414cd64700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41481041b0 0x7f4148194cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f414cd64700 1 -- 172.21.15.6:0/1652630396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4134009520 con 0x7f4148101880 2023-09-13T09:57:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f4147fff700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41481041b0 0x7f4148194cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f414cd64700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148101880 0x7f41481947b0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f413c012fc0 tx=0x7f413c0100c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f4145ffb700 1 -- 172.21.15.6:0/1652630396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00dba0 con 0x7f4148101880 2023-09-13T09:57:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f4145ffb700 1 -- 172.21.15.6:0/1652630396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f413c013040 con 0x7f4148101880 2023-09-13T09:57:53.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f4145ffb700 1 -- 172.21.15.6:0/1652630396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c00bc00 con 0x7f4148101880 2023-09-13T09:57:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.856+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4140009d00 con 0x7f4148101880 2023-09-13T09:57:53.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.857+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f414819cc00 con 0x7f4148101880 2023-09-13T09:57:53.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.860+0000 7f4145ffb700 1 -- 172.21.15.6:0/1652630396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f413c0106c0 con 0x7f4148101880 2023-09-13T09:57:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.861+0000 7f4145ffb700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f41380a0710 0x7f41380a2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.861+0000 7f4145ffb700 1 -- 172.21.15.6:0/1652630396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f413c0cf6c0 con 0x7f4148101880 2023-09-13T09:57:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.861+0000 7f4147fff700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f41380a0710 0x7f41380a2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.861+0000 7f415b1adb80 1 Processor -- start 2023-09-13T09:57:53.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.861+0000 7f415b1adb80 1 -- start start 2023-09-13T09:57:53.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028a700 0x56433028ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x5643302894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564330289a00 0x564330289e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f415b1adb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643301e2780 con 0x564330289a00 2023-09-13T09:57:53.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f415b1adb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643301e00a0 con 0x56433028a700 2023-09-13T09:57:53.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f415b1adb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643301db990 con 0x56433028b060 2023-09-13T09:57:53.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414d565700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564330289a00 0x564330289e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414cd64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028a700 0x56433028ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414cd64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028a700 0x56433028ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:38988/0 (socket says 172.21.15.6:38988) 2023-09-13T09:57:53.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414cd64700 1 -- 172.21.15.6:0/1674956460 learned_addr learned my addr 172.21.15.6:0/1674956460 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f4147fff700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f41380a0710 0x7f41380a2bd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4134009fd0 tx=0x7f4134009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f4147fff700 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x5643302894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414d565700 1 -- 172.21.15.6:0/1674956460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 msgr2=0x5643302894c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414d565700 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x5643302894c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414d565700 1 -- 172.21.15.6:0/1674956460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028a700 msgr2=0x56433028ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414d565700 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028a700 0x56433028ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414d565700 1 -- 172.21.15.6:0/1674956460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56433005b630 con 0x564330289a00 2023-09-13T09:57:53.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.862+0000 7f414cd64700 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028a700 0x56433028ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.863+0000 7f414d565700 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564330289a00 0x564330289e80 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f4140009fd0 tx=0x7f41400094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eb7f53363cf10a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.863+0000 7f4132ffd700 1 -- 172.21.15.6:0/1674956460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000e040 con 0x564330289a00 2023-09-13T09:57:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.863+0000 7f4132ffd700 1 -- 172.21.15.6:0/1674956460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f414000bdf0 con 0x564330289a00 2023-09-13T09:57:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.863+0000 7f4132ffd700 1 -- 172.21.15.6:0/1674956460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414001c6a0 con 0x564330289a00 2023-09-13T09:57:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 -- 172.21.15.6:0/1674956460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564330289a00 msgr2=0x564330289e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564330289a00 0x564330289e80 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f4140009fd0 tx=0x7f41400094f0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 -- 172.21.15.6:0/1674956460 shutdown_connections 2023-09-13T09:57:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564330289a00 0x564330289e80 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028a700 0x56433028ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 --2- 172.21.15.6:0/1674956460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x5643302894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 -- 172.21.15.6:0/1674956460 >> 172.21.15.6:0/1674956460 conn(0x5643301e7c80 msgr2=0x564330283f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 -- 172.21.15.6:0/1674956460 shutdown_connections 2023-09-13T09:57:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 -- 172.21.15.6:0/1674956460 wait complete. 2023-09-13T09:57:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 -- start start 2023-09-13T09:57:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.864+0000 7f415b1adb80 1 Processor -- start 2023-09-13T09:57:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x564330292f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x564330293470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433029a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f415b1adb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564330179bb0 con 0x56433028a700 2023-09-13T09:57:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f415b1adb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643301798b0 con 0x56433028b060 2023-09-13T09:57:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f415b1adb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433005d920 con 0x564330289a00 2023-09-13T09:57:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f415b1adb80 10 client.0 _ll_register_callbacks cb 0x564330177680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:53.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x564330293470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f414d565700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433029a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x564330293470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45474/0 (socket says 172.21.15.6:45474) 2023-09-13T09:57:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 -- 172.21.15.6:0/2335002682 learned_addr learned my addr 172.21.15.6:0/2335002682 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f414cd64700 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x564330292f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 -- 172.21.15.6:0/2335002682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 msgr2=0x564330292f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x564330292f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 -- 172.21.15.6:0/2335002682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 msgr2=0x56433029a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433029a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.865+0000 7f4147fff700 1 -- 172.21.15.6:0/2335002682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4148109b00 con 0x56433028a700 2023-09-13T09:57:53.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f4147fff700 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x564330293470 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f413400eb20 tx=0x7f4134013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f870f4eb9e1426c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f4127fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:57:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f4127fff700 1 -- 172.21.15.6:0/2335002682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4134021040 con 0x56433028a700 2023-09-13T09:57:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f4127fff700 1 -- 172.21.15.6:0/2335002682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f413401bca0 con 0x56433028a700 2023-09-13T09:57:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56433027c670 con 0x56433028a700 2023-09-13T09:57:53.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f4127fff700 1 -- 172.21.15.6:0/2335002682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f413401be60 con 0x56433028a700 2023-09-13T09:57:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f415b1adb80 10 client.20334 fetch_fsmap learned FSMap version 65 2023-09-13T09:57:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.866+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x5643301f37a0 con 0x56433028a700 2023-09-13T09:57:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.867+0000 7f4127fff700 1 -- 172.21.15.6:0/2335002682 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4134036080 con 0x56433028a700 2023-09-13T09:57:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.867+0000 7f4127fff700 1 -- 172.21.15.6:0/2335002682 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 65) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4134027550 con 0x56433028a700 2023-09-13T09:57:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.868+0000 7f415b1adb80 10 client.20334 fetch_fsmap finished waiting for FSMap version 65 2023-09-13T09:57:53.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.868+0000 7f415b1adb80 10 client.20334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.868+0000 7f415b1adb80 20 client.20334 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.868+0000 7f415b1adb80 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56433029ed80 0x5643302a11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.868+0000 7f415b1adb80 4 client.20334 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:57:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.868+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643301d4970 con 0x56433029ed80 2023-09-13T09:57:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.868+0000 7f414cd64700 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56433029ed80 0x5643302a11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.869+0000 7f414cd64700 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56433029ed80 0x5643302a11a0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c33363f039020c17 server_cookie=5e6e0bde1be3b147 in_seq=0 out_seq=0 2023-09-13T09:57:53.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.869+0000 7f4127fff700 10 client.20334 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f4127fff700 1 -- 172.21.15.6:0/2335002682 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5643301d4970 con 0x56433029ed80 2023-09-13T09:57:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f4127fff700 10 client.20334 handle_command_reply: tid=0 2023-09-13T09:57:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 client.20334 shutdown 2023-09-13T09:57:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 msgr2=0x564330293470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x564330293470 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f413400eb20 tx=0x7f4134013040 comp rx=0 tx=0).stop 2023-09-13T09:57:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 shutdown_connections 2023-09-13T09:57:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433029a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x564330292f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56433029ed80 0x5643302a11a0 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 --2- 172.21.15.6:0/2335002682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x564330293470 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f4127fff700 0 client.20334 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 >> 172.21.15.6:0/2335002682 conn(0x5643301e7c80 msgr2=0x564330283ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.872+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 shutdown_connections 2023-09-13T09:57:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.873+0000 7f415b1adb80 1 -- 172.21.15.6:0/2335002682 wait complete. 2023-09-13T09:57:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.873+0000 7f415b1adb80 20 client.20334 trim_cache size 0 max 16384 2023-09-13T09:57:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 Processor -- start 2023-09-13T09:57:53.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 -- start start 2023-09-13T09:57:53.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x5643302894c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433028d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643302923e0 con 0x56433028a700 2023-09-13T09:57:53.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433029eb20 con 0x56433028b060 2023-09-13T09:57:53.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f415b1adb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564330292aa0 con 0x564330289a00 2023-09-13T09:57:53.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f414cd64700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x5643302894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f414d565700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433028d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f414cd64700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x5643302894c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48534/0 (socket says 172.21.15.6:48534) 2023-09-13T09:57:53.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.897+0000 7f414cd64700 1 -- 172.21.15.6:0/650308499 learned_addr learned my addr 172.21.15.6:0/650308499 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f414d565700 1 -- 172.21.15.6:0/650308499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 msgr2=0x5643302894c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f414d565700 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x5643302894c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f414d565700 1 -- 172.21.15.6:0/650308499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 msgr2=0x56433029a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f414d565700 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f414d565700 1 -- 172.21.15.6:0/650308499 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564330007de0 con 0x56433028b060 2023-09-13T09:57:53.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f414cd64700 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x5643302894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f414d565700 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433028d9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f41400094c0 tx=0x7f414000b3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3790dddf316e163 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f41337fe700 1 -- 172.21.15.6:0/650308499 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000e040 con 0x56433028b060 2023-09-13T09:57:53.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f41337fe700 1 -- 172.21.15.6:0/650308499 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4140007960 con 0x56433028b060 2023-09-13T09:57:53.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.898+0000 7f41337fe700 1 -- 172.21.15.6:0/650308499 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4140005650 con 0x56433028b060 2023-09-13T09:57:53.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 -- 172.21.15.6:0/650308499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 msgr2=0x56433028d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433028d9c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f41400094c0 tx=0x7f414000b3b0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 -- 172.21.15.6:0/650308499 shutdown_connections 2023-09-13T09:57:53.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56433028b060 0x56433028d9c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564330289a00 0x5643302894c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 --2- 172.21.15.6:0/650308499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 -- 172.21.15.6:0/650308499 >> 172.21.15.6:0/650308499 conn(0x5643301e7c80 msgr2=0x564330290eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 -- 172.21.15.6:0/650308499 shutdown_connections 2023-09-13T09:57:53.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 -- 172.21.15.6:0/650308499 wait complete. 2023-09-13T09:57:53.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.899+0000 7f415b1adb80 1 -- start start 2023-09-13T09:57:53.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 1 Processor -- start 2023-09-13T09:57:53.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564330289a00 0x564330299df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x564330296890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564330296f70 con 0x56433028a700 2023-09-13T09:57:53.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643302970e0 con 0x564330289a00 2023-09-13T09:57:53.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643302972a0 con 0x56433028b060 2023-09-13T09:57:53.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f415b1adb80 10 client.0 _ll_register_callbacks cb 0x564330177680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:57:53.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f4147fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f414cd64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564330289a00 0x564330299df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f414d565700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x564330296890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f4147fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45486/0 (socket says 172.21.15.6:45486) 2023-09-13T09:57:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f414d565700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x564330296890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48542/0 (socket says 172.21.15.6:48542) 2023-09-13T09:57:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.900+0000 7f4147fff700 1 -- 172.21.15.6:0/289989390 learned_addr learned my addr 172.21.15.6:0/289989390 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:57:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f414d565700 1 -- 172.21.15.6:0/289989390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564330289a00 msgr2=0x564330299df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f414d565700 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564330289a00 0x564330299df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f414d565700 1 -- 172.21.15.6:0/289989390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 msgr2=0x56433029a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:57:53.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f414d565700 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f414d565700 1 -- 172.21.15.6:0/289989390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f413c09de70 con 0x56433028b060 2023-09-13T09:57:53.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f4147fff700 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:57:53.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f414d565700 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x564330296890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f414000d010 tx=0x7f4140003c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=765bf975473efe1e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:57:53.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f4127fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:57:53.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f4127fff700 1 -- 172.21.15.6:0/289989390 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414000e040 con 0x56433028b060 2023-09-13T09:57:53.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f4127fff700 1 -- 172.21.15.6:0/289989390 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4140003da0 con 0x56433028b060 2023-09-13T09:57:53.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f414000bdf0 con 0x56433028b060 2023-09-13T09:57:53.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f4127fff700 1 -- 172.21.15.6:0/289989390 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4140005560 con 0x56433028b060 2023-09-13T09:57:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f415b1adb80 10 client.29542 fetch_fsmap learned FSMap version 65 2023-09-13T09:57:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.901+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) v3 -- 0x56433005b630 con 0x56433028b060 2023-09-13T09:57:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f4127fff700 1 -- 172.21.15.6:0/289989390 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f414000bdf0 con 0x56433028b060 2023-09-13T09:57:53.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f4127fff700 1 -- 172.21.15.6:0/289989390 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 65) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f4140023070 con 0x56433028b060 2023-09-13T09:57:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f415b1adb80 10 client.29542 fetch_fsmap finished waiting for FSMap version 65 2023-09-13T09:57:53.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f415b1adb80 10 client.29542 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:57:53.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f415b1adb80 20 client.29542 populate_metadata read hostname 'smithi006' 2023-09-13T09:57:53.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f415b1adb80 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5643302f3ce0 0x5643302f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:57:53.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f415b1adb80 4 client.29542 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:57:53.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564330195050 con 0x5643302f3ce0 2023-09-13T09:57:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.902+0000 7f414cd64700 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5643302f3ce0 0x5643302f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:57:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.903+0000 7f4127fff700 10 client.29542 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.903+0000 7f414cd64700 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5643302f3ce0 0x5643302f60d0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0c6f33ee7ff5653 server_cookie=7018710ae8eb0968 in_seq=0 out_seq=0 2023-09-13T09:57:53.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f4127fff700 1 -- 172.21.15.6:0/289989390 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564330195050 con 0x5643302f3ce0 2023-09-13T09:57:53.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f4127fff700 10 client.29542 handle_command_reply: tid=0 2023-09-13T09:57:53.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 client.29542 shutdown 2023-09-13T09:57:53.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 msgr2=0x564330296890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x564330296890 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f414000d010 tx=0x7f4140003c30 comp rx=0 tx=0).stop 2023-09-13T09:57:53.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 shutdown_connections 2023-09-13T09:57:53.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56433028b060 0x564330296890 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564330289a00 0x564330299df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5643302f3ce0 0x5643302f60d0 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 --2- 172.21.15.6:0/289989390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56433028a700 0x56433029a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f4127fff700 0 client.29542 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:57:53.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 >> 172.21.15.6:0/289989390 conn(0x5643301e7c80 msgr2=0x564330292ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 shutdown_connections 2023-09-13T09:57:53.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 1 -- 172.21.15.6:0/289989390 wait complete. 2023-09-13T09:57:53.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.909+0000 7f415b1adb80 20 client.29542 trim_cache size 0 max 16384 2023-09-13T09:57:53.926 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:57:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:57:53.926 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:57:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "a10bb777-33ed-4da8-ae17-af7b0fa9db04": { 2023-09-13T09:57:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:57:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "a10bb777-33ed-4da8-ae17-af7b0fa9db04", 2023-09-13T09:57:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:57:53.927 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:57:53.928 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:57:53.928 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:57:53.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f41380a0710 msgr2=0x7f41380a2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f41380a0710 0x7f41380a2bd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4134009fd0 tx=0x7f4134009260 comp rx=0 tx=0).stop 2023-09-13T09:57:53.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148101880 msgr2=0x7f41481947b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:57:53.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148101880 0x7f41481947b0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f413c012fc0 tx=0x7f413c0100c0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 shutdown_connections 2023-09-13T09:57:53.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4148106ae0 0x7f414819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f41380a0710 0x7f41380a2bd0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4148101880 0x7f41481947b0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 --2- 172.21.15.6:0/1652630396 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f41481041b0 0x7f4148194cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:57:53.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 >> 172.21.15.6:0/1652630396 conn(0x7f41480fb210 msgr2=0x7f41481024f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:57:53.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 shutdown_connections 2023-09-13T09:57:53.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:57:53.910+0000 7f414efc8700 1 -- 172.21.15.6:0/1652630396 wait complete. 2023-09-13T09:57:53.931 INFO:tasks.cephfs.filesystem:scrub status for tag:a10bb777-33ed-4da8-ae17-af7b0fa9db04 - {'path': '/', 'tag': 'a10bb777-33ed-4da8-ae17-af7b0fa9db04', 'options': 'recursive,force'} 2023-09-13T09:57:54.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:53 smithi006 ceph-mon[98665]: pgmap v851: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 17 MiB/s wr, 969 op/s 2023-09-13T09:57:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:53 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:53 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:54.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:53 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:54.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:53 smithi053 ceph-mon[102373]: pgmap v851: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 17 MiB/s wr, 969 op/s 2023-09-13T09:57:54.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:53 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:54.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:53 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:54.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:53 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:53 smithi131 ceph-mon[102785]: pgmap v851: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 17 MiB/s wr, 969 op/s 2023-09-13T09:57:54.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:53 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:54.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:53 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:54.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:53 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:54.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 218949 36.77 MB/sec execute 194 sec latency 77.347 ms 2023-09-13T09:57:55.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:57:55.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:55.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:55.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:55.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:55.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:55.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:55.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:57:55.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:54 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:57:55.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:55.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:55.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:55.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:55.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:55.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:55.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.266 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:57:55.266 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.266 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.267 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.267 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:54 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:57:55.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:55.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:55.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:55.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:55.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:55.275 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:55.275 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.276 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.276 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:57:55.277 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.278 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.278 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.279 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:54 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:57:55.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 219597 36.76 MB/sec execute 195 sec latency 82.669 ms 2023-09-13T09:57:56.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:55 smithi006 ceph-mon[98665]: pgmap v852: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 917 op/s 2023-09-13T09:57:56.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:55 smithi053 ceph-mon[102373]: pgmap v852: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 917 op/s 2023-09-13T09:57:56.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:55 smithi131 ceph-mon[102785]: pgmap v852: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 17 MiB/s wr, 917 op/s 2023-09-13T09:57:56.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 220105 36.71 MB/sec execute 196 sec latency 174.816 ms 2023-09-13T09:57:57.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 220812 36.69 MB/sec execute 197 sec latency 117.407 ms 2023-09-13T09:57:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:57 smithi006 ceph-mon[98665]: pgmap v853: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-09-13T09:57:58.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:57 smithi053 ceph-mon[102373]: pgmap v853: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-09-13T09:57:58.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:57 smithi131 ceph-mon[102785]: pgmap v853: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 18 MiB/s wr, 1.01k op/s 2023-09-13T09:57:58.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 221619 36.76 MB/sec execute 198 sec latency 60.058 ms 2023-09-13T09:57:59.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:57:59 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:59.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:57:59 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:59.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:57:59 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:57:59.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 222297 36.77 MB/sec execute 199 sec latency 56.344 ms 2023-09-13T09:58:00.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:00 smithi131 ceph-mon[102785]: pgmap v854: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 827 op/s 2023-09-13T09:58:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:00 smithi006 ceph-mon[98665]: pgmap v854: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 827 op/s 2023-09-13T09:58:00.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:00 smithi053 ceph-mon[102373]: pgmap v854: 97 pgs: 97 active+clean; 1.1 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 827 op/s 2023-09-13T09:58:00.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 222851 36.71 MB/sec execute 200 sec latency 93.307 ms 2023-09-13T09:58:01.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 223541 36.69 MB/sec execute 201 sec latency 78.296 ms 2023-09-13T09:58:02.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:02 smithi131 ceph-mon[102785]: pgmap v855: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.0 MiB/s wr, 742 op/s 2023-09-13T09:58:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:02 smithi006 ceph-mon[98665]: pgmap v855: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.0 MiB/s wr, 742 op/s 2023-09-13T09:58:02.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:02 smithi053 ceph-mon[102373]: pgmap v855: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.0 MiB/s wr, 742 op/s 2023-09-13T09:58:02.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 224281 36.70 MB/sec execute 202 sec latency 80.245 ms 2023-09-13T09:58:03.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 225029 36.75 MB/sec execute 203 sec latency 66.518 ms 2023-09-13T09:58:04.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:04 smithi131 ceph-mon[102785]: pgmap v856: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.8 MiB/s wr, 758 op/s 2023-09-13T09:58:04.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:04 smithi006 ceph-mon[98665]: pgmap v856: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.8 MiB/s wr, 758 op/s 2023-09-13T09:58:04.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:04 smithi053 ceph-mon[102373]: pgmap v856: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 6.8 MiB/s wr, 758 op/s 2023-09-13T09:58:04.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 225689 36.78 MB/sec execute 204 sec latency 68.409 ms 2023-09-13T09:58:05.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:05 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:05 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:05 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:05.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:05 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:05.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:05 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:05.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:05 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:05 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:05 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:05 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:05.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 226214 36.71 MB/sec execute 205 sec latency 88.025 ms 2023-09-13T09:58:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:06 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:06 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:06 smithi006 ceph-mon[98665]: pgmap v857: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 586 op/s 2023-09-13T09:58:06.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:06 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:06.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:06 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:06.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:06 smithi053 ceph-mon[102373]: pgmap v857: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 586 op/s 2023-09-13T09:58:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:06 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:06 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:06 smithi131 ceph-mon[102785]: pgmap v857: 97 pgs: 97 active+clean; 1.1 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.7 MiB/s wr, 586 op/s 2023-09-13T09:58:06.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 226868 36.66 MB/sec execute 206 sec latency 72.842 ms 2023-09-13T09:58:07.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 227675 36.71 MB/sec execute 207 sec latency 77.350 ms 2023-09-13T09:58:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:08 smithi006 ceph-mon[98665]: pgmap v858: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 611 op/s 2023-09-13T09:58:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:08 smithi053 ceph-mon[102373]: pgmap v858: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 611 op/s 2023-09-13T09:58:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:08 smithi131 ceph-mon[102785]: pgmap v858: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 4.2 MiB/s wr, 611 op/s 2023-09-13T09:58:08.584 INFO:tasks.workunit.client.0.smithi006.stdout: 10 228431 36.73 MB/sec execute 208 sec latency 75.362 ms 2023-09-13T09:58:09.585 INFO:tasks.workunit.client.0.smithi006.stdout: 10 229077 36.74 MB/sec execute 209 sec latency 57.078 ms 2023-09-13T09:58:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:10 smithi006 ceph-mon[98665]: pgmap v859: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 488 op/s 2023-09-13T09:58:10.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:10 smithi053 ceph-mon[102373]: pgmap v859: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 488 op/s 2023-09-13T09:58:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:10 smithi131 ceph-mon[102785]: pgmap v859: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.5 MiB/s wr, 488 op/s 2023-09-13T09:58:10.585 INFO:tasks.workunit.client.0.smithi006.stdout: 10 229725 36.72 MB/sec execute 210 sec latency 62.088 ms 2023-09-13T09:58:11.585 INFO:tasks.workunit.client.0.smithi006.stdout: 10 230434 36.72 MB/sec execute 211 sec latency 60.670 ms 2023-09-13T09:58:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:12 smithi006 ceph-mon[98665]: pgmap v860: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 508 op/s 2023-09-13T09:58:12.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:12 smithi053 ceph-mon[102373]: pgmap v860: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 508 op/s 2023-09-13T09:58:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:12 smithi131 ceph-mon[102785]: pgmap v860: 97 pgs: 97 active+clean; 1.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 3.6 MiB/s wr, 508 op/s 2023-09-13T09:58:12.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 231079 36.72 MB/sec execute 212 sec latency 84.636 ms 2023-09-13T09:58:13.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 231704 36.72 MB/sec execute 213 sec latency 87.642 ms 2023-09-13T09:58:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:14 smithi006 ceph-mon[98665]: pgmap v861: 97 pgs: 97 active+clean; 1.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.3 MiB/s wr, 628 op/s 2023-09-13T09:58:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:14 smithi053 ceph-mon[102373]: pgmap v861: 97 pgs: 97 active+clean; 1.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.3 MiB/s wr, 628 op/s 2023-09-13T09:58:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:14 smithi131 ceph-mon[102785]: pgmap v861: 97 pgs: 97 active+clean; 1.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 4.3 MiB/s wr, 628 op/s 2023-09-13T09:58:14.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 232253 36.68 MB/sec execute 214 sec latency 107.554 ms 2023-09-13T09:58:15.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 232872 36.65 MB/sec execute 215 sec latency 75.524 ms 2023-09-13T09:58:16.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:16 smithi006 ceph-mon[98665]: pgmap v862: 97 pgs: 97 active+clean; 1.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 586 op/s 2023-09-13T09:58:16.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:16 smithi053 ceph-mon[102373]: pgmap v862: 97 pgs: 97 active+clean; 1.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 586 op/s 2023-09-13T09:58:16.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:16 smithi131 ceph-mon[102785]: pgmap v862: 97 pgs: 97 active+clean; 1.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 4.0 MiB/s wr, 586 op/s 2023-09-13T09:58:16.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 233052 36.53 MB/sec execute 216 sec latency 743.557 ms 2023-09-13T09:58:17.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 233369 36.43 MB/sec execute 217 sec latency 1042.687 ms 2023-09-13T09:58:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:18 smithi006 ceph-mon[98665]: pgmap v863: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 579 op/s 2023-09-13T09:58:18.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:18 smithi053 ceph-mon[102373]: pgmap v863: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 579 op/s 2023-09-13T09:58:18.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:18 smithi131 ceph-mon[102785]: pgmap v863: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 5.2 MiB/s wr, 579 op/s 2023-09-13T09:58:18.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 233682 36.33 MB/sec execute 218 sec latency 139.856 ms 2023-09-13T09:58:19.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 234236 36.30 MB/sec execute 219 sec latency 95.966 ms 2023-09-13T09:58:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:20 smithi006 ceph-mon[98665]: pgmap v864: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.4 MiB/s wr, 604 op/s 2023-09-13T09:58:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:20 smithi053 ceph-mon[102373]: pgmap v864: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.4 MiB/s wr, 604 op/s 2023-09-13T09:58:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:20 smithi131 ceph-mon[102785]: pgmap v864: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.4 MiB/s wr, 604 op/s 2023-09-13T09:58:20.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 234883 36.32 MB/sec execute 220 sec latency 73.941 ms 2023-09-13T09:58:21.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 235264 36.26 MB/sec execute 221 sec latency 285.101 ms 2023-09-13T09:58:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:22 smithi006 ceph-mon[98665]: pgmap v865: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 689 op/s 2023-09-13T09:58:22.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:22 smithi053 ceph-mon[102373]: pgmap v865: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 689 op/s 2023-09-13T09:58:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:22 smithi131 ceph-mon[102785]: pgmap v865: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 689 op/s 2023-09-13T09:58:22.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 235769 36.23 MB/sec execute 222 sec latency 117.166 ms 2023-09-13T09:58:23.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 236341 36.17 MB/sec execute 223 sec latency 111.183 ms 2023-09-13T09:58:23.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:58:24.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 -- 172.21.15.6:0/846572096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 msgr2=0x7fa4cc1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 --2- 172.21.15.6:0/846572096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc1000e0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0099c0 tx=0x7fa4bc009cd0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 -- 172.21.15.6:0/846572096 shutdown_connections 2023-09-13T09:58:24.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 --2- 172.21.15.6:0/846572096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4cc101850 0x7fa4cc108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 --2- 172.21.15.6:0/846572096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc1000e0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 --2- 172.21.15.6:0/846572096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4cc100eb0 0x7fa4cc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 -- 172.21.15.6:0/846572096 >> 172.21.15.6:0/846572096 conn(0x7fa4cc0fb250 msgr2=0x7fa4cc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 -- 172.21.15.6:0/846572096 shutdown_connections 2023-09-13T09:58:24.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.071+0000 7fa4d3905700 1 -- 172.21.15.6:0/846572096 wait complete. 2023-09-13T09:58:24.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 Processor -- start 2023-09-13T09:58:24.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 -- start start 2023-09-13T09:58:24.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4cc100eb0 0x7fa4cc196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4cc101850 0x7fa4cc19e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc19e630 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc19e770 con 0x7fa4cc100eb0 2023-09-13T09:58:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d3905700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4cc19e900 con 0x7fa4cc101850 2023-09-13T09:58:24.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc196ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45498/0 (socket says 172.21.15.6:45498) 2023-09-13T09:58:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 -- 172.21.15.6:0/1200350374 learned_addr learned my addr 172.21.15.6:0/1200350374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4cc101850 0x7fa4cc19e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 -- 172.21.15.6:0/1200350374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4cc101850 msgr2=0x7fa4cc19e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4cc101850 0x7fa4cc19e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 -- 172.21.15.6:0/1200350374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4cc100eb0 msgr2=0x7fa4cc196ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4cc100eb0 0x7fa4cc196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.072+0000 7fa4d16a1700 1 -- 172.21.15.6:0/1200350374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc0095f0 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.073+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc196ab0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009990 tx=0x7fa4bc00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.073+0000 7fa4c27fc700 1 -- 172.21.15.6:0/1200350374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc01d070 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.073+0000 7fa4c27fc700 1 -- 172.21.15.6:0/1200350374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4bc0054f0 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.073+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4cc19eb80 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.073+0000 7fa4c27fc700 1 -- 172.21.15.6:0/1200350374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4bc004b00 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.073+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4cc19efa0 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.076+0000 7fa4dfaeab80 1 Processor -- start 2023-09-13T09:58:24.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.076+0000 7fa4dfaeab80 1 -- start start 2023-09-13T09:58:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x5590826cae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559082623780 con 0x5590826cc060 2023-09-13T09:58:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590826210a0 con 0x5590826caa00 2023-09-13T09:58:24.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55908261c990 con 0x5590826cb700 2023-09-13T09:58:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826cbb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48558/0 (socket says 172.21.15.6:48558) 2023-09-13T09:58:24.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/952116394 learned_addr learned my addr 172.21.15.6:0/952116394 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/952116394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 msgr2=0x5590826cae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/952116394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x5590826cae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/952116394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 msgr2=0x5590826ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/952116394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.077+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/952116394 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55908249c630 con 0x5590826cb700 2023-09-13T09:58:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.078+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/952116394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826cbb20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4011680 tx=0x7fa4c4009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c5099d8ee06e26c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.078+0000 7fa4b77fe700 1 -- 172.21.15.6:0/952116394 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c400e040 con 0x5590826cb700 2023-09-13T09:58:24.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.078+0000 7fa4b77fe700 1 -- 172.21.15.6:0/952116394 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4c400f040 con 0x5590826cb700 2023-09-13T09:58:24.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.078+0000 7fa4b77fe700 1 -- 172.21.15.6:0/952116394 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c40048f0 con 0x5590826cb700 2023-09-13T09:58:24.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.078+0000 7fa4c27fc700 1 -- 172.21.15.6:0/1200350374 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa4bc00fb80 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/952116394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 msgr2=0x5590826cbb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/952116394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826cbb20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4011680 tx=0x7fa4c4009920 comp rx=0 tx=0).stop 2023-09-13T09:58:24.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/952116394 shutdown_connections 2023-09-13T09:58:24.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/952116394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x5590826cae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/952116394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826cbb20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/952116394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/952116394 >> 172.21.15.6:0/952116394 conn(0x559082628c80 msgr2=0x5590826c4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/952116394 shutdown_connections 2023-09-13T09:58:24.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/952116394 wait complete. 2023-09-13T09:58:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 -- start start 2023-09-13T09:58:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4c27fc700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4b80a0500 0x7fa4b80a29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 Processor -- start 2023-09-13T09:58:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4b80a0500 0x7fa4b80a29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4c27fc700 1 -- 172.21.15.6:0/1200350374 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa4bc0cc970 con 0x7fa4cc0ffcc0 2023-09-13T09:58:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x5590826d3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.079+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826db450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590825babb0 con 0x5590826cc060 2023-09-13T09:58:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590825ba8b0 con 0x5590826caa00 2023-09-13T09:58:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55908249e920 con 0x5590826cb700 2023-09-13T09:58:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4dfaeab80 10 client.0 _ll_register_callbacks cb 0x5590825b8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:24.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826db450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826db450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45516/0 (socket says 172.21.15.6:45516) 2023-09-13T09:58:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/3995784118 learned_addr learned my addr 172.21.15.6:0/3995784118 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4b80a0500 0x7fa4b80a29c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4004350 tx=0x7fa4c4011fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d0ea0700 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/3995784118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 msgr2=0x5590826d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d4410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/3995784118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 msgr2=0x5590826d3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x5590826d3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/3995784118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c4011330 con 0x5590826cc060 2023-09-13T09:58:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826db450 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4004320 tx=0x7fa4c4009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d478ebf34bbb1f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/3995784118 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4007c30 con 0x5590826cc060 2023-09-13T09:58:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/3995784118 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa4c4007d90 con 0x5590826cc060 2023-09-13T09:58:24.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.080+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5590826bd670 con 0x5590826cc060 2023-09-13T09:58:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/3995784118 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4c402b450 con 0x5590826cc060 2023-09-13T09:58:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 10 client.20346 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5590826347a0 con 0x5590826cc060 2023-09-13T09:58:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/3995784118 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5590826bd670 con 0x5590826cc060 2023-09-13T09:58:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/3995784118 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa4c40156b0 con 0x5590826cc060 2023-09-13T09:58:24.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 10 client.20346 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:24.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 10 client.20346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:24.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 20 client.20346 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:24.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826dfc90 0x5590826e20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 4 client.20346 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:24.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.081+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559082615970 con 0x5590826dfc90 2023-09-13T09:58:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.084+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826dfc90 0x5590826e20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.084+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826dfc90 0x5590826e20b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18ad3693c4ffddbf server_cookie=aede63b7d952bbc0 in_seq=0 out_seq=0 2023-09-13T09:58:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.084+0000 7fa4b4ff9700 10 client.20346 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/3995784118 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559082615970 con 0x5590826dfc90 2023-09-13T09:58:24.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4b4ff9700 10 client.20346 handle_command_reply: tid=0 2023-09-13T09:58:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 client.20346 shutdown 2023-09-13T09:58:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 msgr2=0x5590826db450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826db450 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4004320 tx=0x7fa4c4009920 comp rx=0 tx=0).stop 2023-09-13T09:58:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 shutdown_connections 2023-09-13T09:58:24.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826dfc90 0x5590826e20b0 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cc060 0x5590826db450 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4b4ff9700 0 client.20346 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x5590826d3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/3995784118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 >> 172.21.15.6:0/3995784118 conn(0x559082628c80 msgr2=0x5590826bf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 shutdown_connections 2023-09-13T09:58:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/3995784118 wait complete. 2023-09-13T09:58:24.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.086+0000 7fa4dfaeab80 20 client.20346 trim_cache size 0 max 16384 2023-09-13T09:58:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 Processor -- start 2023-09-13T09:58:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 -- start start 2023-09-13T09:58:24.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559082628c80 0x5590826ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826caa00 0x5590826d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d41c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590826c6fd0 con 0x5590826caa00 2023-09-13T09:58:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590826df7d0 con 0x559082628c80 2023-09-13T09:58:24.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.106+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590826c6350 con 0x5590826cb700 2023-09-13T09:58:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826caa00 0x5590826d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826caa00 0x5590826d3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45522/0 (socket says 172.21.15.6:45522) 2023-09-13T09:58:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 -- 172.21.15.6:0/1891429250 learned_addr learned my addr 172.21.15.6:0/1891429250 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559082628c80 0x5590826ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 -- 172.21.15.6:0/1891429250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 msgr2=0x5590826d41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 -- 172.21.15.6:0/1891429250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559082628c80 msgr2=0x5590826ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559082628c80 0x5590826ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 -- 172.21.15.6:0/1891429250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559082448de0 con 0x5590826caa00 2023-09-13T09:58:24.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4d0ea0700 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826caa00 0x5590826d3c80 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009c10 tx=0x7fa4c8009f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f204fe488670c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4b7fff700 1 -- 172.21.15.6:0/1891429250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011b70 con 0x5590826caa00 2023-09-13T09:58:24.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4b7fff700 1 -- 172.21.15.6:0/1891429250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4c8004510 con 0x5590826caa00 2023-09-13T09:58:24.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.107+0000 7fa4b7fff700 1 -- 172.21.15.6:0/1891429250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8005280 con 0x5590826caa00 2023-09-13T09:58:24.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/1891429250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826caa00 msgr2=0x5590826d3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826caa00 0x5590826d3c80 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8009c10 tx=0x7fa4c8009f20 comp rx=0 tx=0).stop 2023-09-13T09:58:24.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/1891429250 shutdown_connections 2023-09-13T09:58:24.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5590826cb700 0x5590826d41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559082628c80 0x5590826ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/1891429250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826caa00 0x5590826d3c80 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/1891429250 >> 172.21.15.6:0/1891429250 conn(0x5590826c5240 msgr2=0x5590826dbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/1891429250 shutdown_connections 2023-09-13T09:58:24.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.108+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/1891429250 wait complete. 2023-09-13T09:58:24.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 -- start start 2023-09-13T09:58:24.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 Processor -- start 2023-09-13T09:58:24.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559082628c80 0x5590827303f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x559082730930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cb700 0x559082737970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559082737eb0 con 0x5590826cb700 2023-09-13T09:58:24.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559082737ff0 con 0x5590826caa00 2023-09-13T09:58:24.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559082738180 con 0x559082628c80 2023-09-13T09:58:24.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4dfaeab80 10 client.0 _ll_register_callbacks cb 0x5590825b8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:24.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4d1ea2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cb700 0x559082737970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4d16a1700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559082628c80 0x5590827303f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4d0ea0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x559082730930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4d1ea2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cb700 0x559082737970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45530/0 (socket says 172.21.15.6:45530) 2023-09-13T09:58:24.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.109+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/739055232 learned_addr learned my addr 172.21.15.6:0/739055232 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/739055232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559082628c80 msgr2=0x5590827303f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559082628c80 0x5590827303f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/739055232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 msgr2=0x559082730930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x559082730930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4d1ea2700 1 -- 172.21.15.6:0/739055232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c8009890 con 0x5590826cb700 2023-09-13T09:58:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559082628c80 0x5590827303f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4d1ea2700 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cb700 0x559082737970 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40041e0 tx=0x7fa4c40094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf1b6b944601c70 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4b4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/739055232 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4015db0 con 0x5590826cb700 2023-09-13T09:58:24.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/739055232 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa4c4007e40 con 0x5590826cb700 2023-09-13T09:58:24.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa4c400f040 con 0x5590826cb700 2023-09-13T09:58:24.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/739055232 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4c4004a90 con 0x5590826cb700 2023-09-13T09:58:24.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4dfaeab80 10 client.20352 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.110+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x559082431c60 con 0x5590826cb700 2023-09-13T09:58:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/739055232 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa4c400f040 con 0x5590826cb700 2023-09-13T09:58:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/739055232 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fa4c40052f0 con 0x5590826cb700 2023-09-13T09:58:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4dfaeab80 10 client.20352 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4dfaeab80 10 client.20352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4dfaeab80 20 client.20352 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826cc060 0x55908273b860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4dfaeab80 4 client.20352 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:58:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.111+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5590825d6050 con 0x5590826cc060 2023-09-13T09:58:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.112+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826cc060 0x55908273b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.116+0000 7fa4b4ff9700 10 client.20352 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:24.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.116+0000 7fa4d16a1700 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826cc060 0x55908273b860 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12af4f401c3afd51 server_cookie=2a601a48ed3ba2de in_seq=0 out_seq=0 2023-09-13T09:58:24.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4b4ff9700 1 -- 172.21.15.6:0/739055232 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5590825d6050 con 0x5590826cc060 2023-09-13T09:58:24.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4b4ff9700 10 client.20352 handle_command_reply: tid=0 2023-09-13T09:58:24.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 client.20352 shutdown 2023-09-13T09:58:24.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cb700 msgr2=0x559082737970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cb700 0x559082737970 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40041e0 tx=0x7fa4c40094d0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 shutdown_connections 2023-09-13T09:58:24.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5590826cc060 0x55908273b860 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5590826cb700 0x559082737970 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559082628c80 0x5590827303f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4b4ff9700 0 client.20352 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:24.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 --2- 172.21.15.6:0/739055232 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5590826caa00 0x559082730930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 >> 172.21.15.6:0/739055232 conn(0x5590826c5240 msgr2=0x5590826d3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 shutdown_connections 2023-09-13T09:58:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 1 -- 172.21.15.6:0/739055232 wait complete. 2023-09-13T09:58:24.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.124+0000 7fa4dfaeab80 20 client.20352 trim_cache size 0 max 16384 2023-09-13T09:58:24.136 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:58:24.136 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:58:24.136 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:58:24.136 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:58:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4b80a0500 msgr2=0x7fa4b80a29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4b80a0500 0x7fa4b80a29c0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4004350 tx=0x7fa4c4011fd0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 msgr2=0x7fa4cc196ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc196ab0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc009990 tx=0x7fa4bc00f690 comp rx=0 tx=0).stop 2023-09-13T09:58:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 shutdown_connections 2023-09-13T09:58:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4cc101850 0x7fa4cc19e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa4b80a0500 0x7fa4b80a29c0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4cc0ffcc0 0x7fa4cc196ab0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 --2- 172.21.15.6:0/1200350374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa4cc100eb0 0x7fa4cc196ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.125+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 >> 172.21.15.6:0/1200350374 conn(0x7fa4cc0fb250 msgr2=0x7fa4cc104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.128+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 shutdown_connections 2023-09-13T09:58:24.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.128+0000 7fa4d3905700 1 -- 172.21.15.6:0/1200350374 wait complete. 2023-09-13T09:58:24.147 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:58:24.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:58:24.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:24 smithi006 ceph-mon[98665]: pgmap v866: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 15 MiB/s wr, 882 op/s 2023-09-13T09:58:24.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 -- 172.21.15.6:0/2213004118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 msgr2=0x7fdf081000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/2213004118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf081000e0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fdf0400b0d0 tx=0x7fdf0400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 -- 172.21.15.6:0/2213004118 shutdown_connections 2023-09-13T09:58:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/2213004118 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf08101850 0x7fdf08108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/2213004118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf081000e0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/2213004118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf08100eb0 0x7fdf08101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 -- 172.21.15.6:0/2213004118 >> 172.21.15.6:0/2213004118 conn(0x7fdf080fb210 msgr2=0x7fdf080fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 -- 172.21.15.6:0/2213004118 shutdown_connections 2023-09-13T09:58:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.298+0000 7fdf0fd15700 1 -- 172.21.15.6:0/2213004118 wait complete. 2023-09-13T09:58:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 Processor -- start 2023-09-13T09:58:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 -- start start 2023-09-13T09:58:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf08196bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf08100eb0 0x7fdf08197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf08101850 0x7fdf0819e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0819e740 con 0x7fdf080ffcc0 2023-09-13T09:58:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0819e880 con 0x7fdf08100eb0 2023-09-13T09:58:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0fd15700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0819ea10 con 0x7fdf08101850 2023-09-13T09:58:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf08196bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf08196bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45542/0 (socket says 172.21.15.6:45542) 2023-09-13T09:58:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 -- 172.21.15.6:0/3434349241 learned_addr learned my addr 172.21.15.6:0/3434349241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0d2b0700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf08100eb0 0x7fdf08197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0e2b2700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf08101850 0x7fdf0819e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 -- 172.21.15.6:0/3434349241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf08101850 msgr2=0x7fdf0819e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf08101850 0x7fdf0819e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 -- 172.21.15.6:0/3434349241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf08100eb0 msgr2=0x7fdf08197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf08100eb0 0x7fdf08197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.299+0000 7fdf0dab1700 1 -- 172.21.15.6:0/3434349241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef8009520 con 0x7fdf080ffcc0 2023-09-13T09:58:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.300+0000 7fdf0dab1700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf08196bc0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000f80 tx=0x7fdf04008ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.300+0000 7fdefeffd700 1 -- 172.21.15.6:0/3434349241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0400e040 con 0x7fdf080ffcc0 2023-09-13T09:58:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.300+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf00009520 con 0x7fdf080ffcc0 2023-09-13T09:58:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.300+0000 7fdefeffd700 1 -- 172.21.15.6:0/3434349241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdf0400be30 con 0x7fdf080ffcc0 2023-09-13T09:58:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.300+0000 7fdefeffd700 1 -- 172.21.15.6:0/3434349241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0401ba00 con 0x7fdf080ffcc0 2023-09-13T09:58:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.300+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf04009d00 con 0x7fdf080ffcc0 2023-09-13T09:58:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.301+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf0810b4d0 con 0x7fdf080ffcc0 2023-09-13T09:58:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.302+0000 7fdefeffd700 1 -- 172.21.15.6:0/3434349241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdf0401bb60 con 0x7fdf080ffcc0 2023-09-13T09:58:24.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.303+0000 7fdefeffd700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdef40a0640 0x7fdef40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.303+0000 7fdf0d2b0700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdef40a0640 0x7fdef40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.303+0000 7fdefeffd700 1 -- 172.21.15.6:0/3434349241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdf040cd420 con 0x7fdf080ffcc0 2023-09-13T09:58:24.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.304+0000 7fdf0d2b0700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdef40a0640 0x7fdef40a2b00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009df0 tx=0x7fdef8012040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.307+0000 7fdefeffd700 1 -- 172.21.15.6:0/3434349241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fdf040970b0 con 0x7fdf080ffcc0 2023-09-13T09:58:24.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:24 smithi053 ceph-mon[102373]: pgmap v866: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 15 MiB/s wr, 882 op/s 2023-09-13T09:58:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:24 smithi131 ceph-mon[102785]: pgmap v866: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 15 MiB/s wr, 882 op/s 2023-09-13T09:58:24.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 236865 36.13 MB/sec execute 224 sec latency 111.997 ms 2023-09-13T09:58:24.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.609+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf0810b710 con 0x7fdf080ffcc0 2023-09-13T09:58:24.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.610+0000 7fdefeffd700 1 -- 172.21.15.6:0/3434349241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+11343 (secure 0 0 0) 0x7fdf0409a6d0 con 0x7fdf080ffcc0 2023-09-13T09:58:24.611 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:58:24.611 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:57:57.567802+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:58:24.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.613+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdef40a0640 msgr2=0x7fdef40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.613+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdef40a0640 0x7fdef40a2b00 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fdef8009df0 tx=0x7fdef8012040 comp rx=0 tx=0).stop 2023-09-13T09:58:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.613+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 msgr2=0x7fdf08196bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.613+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf08196bc0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7fdf04000f80 tx=0x7fdf04008ec0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 shutdown_connections 2023-09-13T09:58:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf08101850 0x7fdf0819e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdef40a0640 0x7fdef40a2b00 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdf080ffcc0 0x7fdf08196bc0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 --2- 172.21.15.6:0/3434349241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdf08100eb0 0x7fdf08197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 >> 172.21.15.6:0/3434349241 conn(0x7fdf080fb210 msgr2=0x7fdf08068d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 shutdown_connections 2023-09-13T09:58:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.614+0000 7fdf0fd15700 1 -- 172.21.15.6:0/3434349241 wait complete. 2023-09-13T09:58:24.617 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2023-09-13T09:58:24.628 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:58:24.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 -- 172.21.15.6:0/3078777100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 msgr2=0x7f25081000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 --2- 172.21.15.6:0/3078777100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f25081000e0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f25040099c0 tx=0x7f2504009cd0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 -- 172.21.15.6:0/3078777100 shutdown_connections 2023-09-13T09:58:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 --2- 172.21.15.6:0/3078777100 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2508101850 0x7f2508108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 --2- 172.21.15.6:0/3078777100 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f25081000e0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 --2- 172.21.15.6:0/3078777100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 0x7f2508101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 -- 172.21.15.6:0/3078777100 >> 172.21.15.6:0/3078777100 conn(0x7f25080fb210 msgr2=0x7f25080fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 -- 172.21.15.6:0/3078777100 shutdown_connections 2023-09-13T09:58:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.777+0000 7f250fe81700 1 -- 172.21.15.6:0/3078777100 wait complete. 2023-09-13T09:58:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 Processor -- start 2023-09-13T09:58:24.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 -- start start 2023-09-13T09:58:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f2508196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 0x7f2508197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2508101850 0x7f250819e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250819e670 con 0x7f25080ffcc0 2023-09-13T09:58:24.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250819e7b0 con 0x7f2508101850 2023-09-13T09:58:24.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250fe81700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250819e940 con 0x7f2508100eb0 2023-09-13T09:58:24.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f2508196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250d41c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 0x7f2508197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f2508196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45554/0 (socket says 172.21.15.6:45554) 2023-09-13T09:58:24.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250d41c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 0x7f2508197030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48610/0 (socket says 172.21.15.6:48610) 2023-09-13T09:58:24.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 -- 172.21.15.6:0/693535823 learned_addr learned my addr 172.21.15.6:0/693535823 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250e41e700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2508101850 0x7f250819e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 -- 172.21.15.6:0/693535823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 msgr2=0x7f2508197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 0x7f2508197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 -- 172.21.15.6:0/693535823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2508101850 msgr2=0x7f250819e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2508101850 0x7f250819e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250dc1d700 1 -- 172.21.15.6:0/693535823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040095f0 con 0x7f25080ffcc0 2023-09-13T09:58:24.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.778+0000 7f250d41c700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 0x7f2508197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:24.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.779+0000 7f250dc1d700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f2508196af0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f2504009fd0 tx=0x7f250401ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.779+0000 7f24feffd700 1 -- 172.21.15.6:0/693535823 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504021070 con 0x7f25080ffcc0 2023-09-13T09:58:24.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.779+0000 7f24feffd700 1 -- 172.21.15.6:0/693535823 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25040054f0 con 0x7f25080ffcc0 2023-09-13T09:58:24.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.779+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25081020d0 con 0x7f25080ffcc0 2023-09-13T09:58:24.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.779+0000 7f24feffd700 1 -- 172.21.15.6:0/693535823 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2504004c90 con 0x7f25080ffcc0 2023-09-13T09:58:24.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.779+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2508102520 con 0x7f25080ffcc0 2023-09-13T09:58:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.781+0000 7f24feffd700 1 -- 172.21.15.6:0/693535823 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2504025070 con 0x7f25080ffcc0 2023-09-13T09:58:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.782+0000 7f24feffd700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24f40a0640 0x7f24f40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.782+0000 7f250d41c700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24f40a0640 0x7f24f40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.782+0000 7f24feffd700 1 -- 172.21.15.6:0/693535823 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f25040d0d60 con 0x7f25080ffcc0 2023-09-13T09:58:24.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 Processor -- start 2023-09-13T09:58:24.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f250d41c700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24f40a0640 0x7f24f40a2b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f24f8011490 tx=0x7f24f8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 -- start start 2023-09-13T09:58:24.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ed700 0x55a8d82edb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ee060 0x55a8d82ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82ece80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d8245780 con 0x55a8d82ee060 2023-09-13T09:58:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d82430a0 con 0x55a8d82eca00 2023-09-13T09:58:24.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f251c066b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d823e990 con 0x55a8d82ed700 2023-09-13T09:58:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f250dc1d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ed700 0x55a8d82edb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f250d41c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ee060 0x55a8d82ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.783+0000 7f250dc1d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ed700 0x55a8d82edb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48616/0 (socket says 172.21.15.6:48616) 2023-09-13T09:58:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250d41c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ee060 0x55a8d82ec4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45564/0 (socket says 172.21.15.6:45564) 2023-09-13T09:58:24.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250dc1d700 1 -- 172.21.15.6:0/2906940992 learned_addr learned my addr 172.21.15.6:0/2906940992 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250e41e700 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82ece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250dc1d700 1 -- 172.21.15.6:0/2906940992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 msgr2=0x55a8d82ece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250dc1d700 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82ece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250dc1d700 1 -- 172.21.15.6:0/2906940992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ee060 msgr2=0x55a8d82ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250dc1d700 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ee060 0x55a8d82ec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250dc1d700 1 -- 172.21.15.6:0/2906940992 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8d80be630 con 0x55a8d82ed700 2023-09-13T09:58:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f250dc1d700 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ed700 0x55a8d82edb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f250409b000 tx=0x7f2504005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dab6d104c5e5ef3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f24f3fff700 1 -- 172.21.15.6:0/2906940992 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250409e590 con 0x55a8d82ed700 2023-09-13T09:58:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f24f3fff700 1 -- 172.21.15.6:0/2906940992 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25040a23c0 con 0x55a8d82ed700 2023-09-13T09:58:24.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.784+0000 7f24f3fff700 1 -- 172.21.15.6:0/2906940992 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040a2200 con 0x55a8d82ed700 2023-09-13T09:58:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 -- 172.21.15.6:0/2906940992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ed700 msgr2=0x55a8d82edb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ed700 0x55a8d82edb20 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f250409b000 tx=0x7f2504005ef0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 -- 172.21.15.6:0/2906940992 shutdown_connections 2023-09-13T09:58:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82ece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.799 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ed700 0x55a8d82edb20 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 --2- 172.21.15.6:0/2906940992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ee060 0x55a8d82ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 -- 172.21.15.6:0/2906940992 >> 172.21.15.6:0/2906940992 conn(0x55a8d824ac80 msgr2=0x55a8d82e6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 -- 172.21.15.6:0/2906940992 shutdown_connections 2023-09-13T09:58:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 -- 172.21.15.6:0/2906940992 wait complete. 2023-09-13T09:58:24.800 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.785+0000 7f251c066b80 1 -- start start 2023-09-13T09:58:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 1 Processor -- start 2023-09-13T09:58:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82f60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 0x55a8d82fd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d81dcbb0 con 0x55a8d82ed700 2023-09-13T09:58:24.801 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d81dc8b0 con 0x55a8d82eca00 2023-09-13T09:58:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d80c0920 con 0x55a8d82ee060 2023-09-13T09:58:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f251c066b80 10 client.0 _ll_register_callbacks cb 0x55a8d81da680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f250d41c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82f60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f250d41c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82f60c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45570/0 (socket says 172.21.15.6:45570) 2023-09-13T09:58:24.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f250d41c700 1 -- 172.21.15.6:0/2901033231 learned_addr learned my addr 172.21.15.6:0/2901033231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.786+0000 7f250dc1d700 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f250d41c700 1 -- 172.21.15.6:0/2901033231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 msgr2=0x55a8d82fd100 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:58:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f250d41c700 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 0x55a8d82fd100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f250d41c700 1 -- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 msgr2=0x55a8d82f5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f250d41c700 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82f5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f250d41c700 1 -- 172.21.15.6:0/2901033231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2508102520 con 0x55a8d82ed700 2023-09-13T09:58:24.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f250dc1d700 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f250d41c700 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82f60c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f24f8003ad0 tx=0x7f24f80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b72318a1e5df868 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f24f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f24f17fa700 1 -- 172.21.15.6:0/2901033231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f801fca0 con 0x55a8d82ed700 2023-09-13T09:58:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a8d82df670 con 0x55a8d82ed700 2023-09-13T09:58:24.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f24f17fa700 1 -- 172.21.15.6:0/2901033231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f24f801fe00 con 0x55a8d82ed700 2023-09-13T09:58:24.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f24f17fa700 1 -- 172.21.15.6:0/2901033231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f24f8003e90 con 0x55a8d82ed700 2023-09-13T09:58:24.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f251c066b80 10 client.20370 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:24.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55a8d82567a0 con 0x55a8d82ed700 2023-09-13T09:58:24.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.787+0000 7f24f17fa700 1 -- 172.21.15.6:0/2901033231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a8d82df670 con 0x55a8d82ed700 2023-09-13T09:58:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f24f17fa700 1 -- 172.21.15.6:0/2901033231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f24f80286a0 con 0x55a8d82ed700 2023-09-13T09:58:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f251c066b80 10 client.20370 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f251c066b80 10 client.20370 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:58:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f251c066b80 20 client.20370 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:24.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f251c066b80 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8301980 0x55a8d8303da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f251c066b80 4 client.20370 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:24.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a8d8237970 con 0x55a8d8301980 2023-09-13T09:58:24.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f250dc1d700 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8301980 0x55a8d8303da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f24f17fa700 10 client.20370 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:24.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.788+0000 7f250dc1d700 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8301980 0x55a8d8303da0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=51c07b7120cfdc1e server_cookie=cc0eca0a0dace6b1 in_seq=0 out_seq=0 2023-09-13T09:58:24.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f24f17fa700 1 -- 172.21.15.6:0/2901033231 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a8d8237970 con 0x55a8d8301980 2023-09-13T09:58:24.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f24f17fa700 10 client.20370 handle_command_reply: tid=0 2023-09-13T09:58:24.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 client.20370 shutdown 2023-09-13T09:58:24.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 msgr2=0x55a8d82f60c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82f60c0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f24f8003ad0 tx=0x7f24f80047c0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 shutdown_connections 2023-09-13T09:58:24.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8301980 0x55a8d8303da0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 0x55a8d82fd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f24f17fa700 0 client.20370 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:24.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82eca00 0x55a8d82f5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 --2- 172.21.15.6:0/2901033231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82f60c0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.790+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 >> 172.21.15.6:0/2901033231 conn(0x55a8d824ac80 msgr2=0x55a8d82e17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.791+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 shutdown_connections 2023-09-13T09:58:24.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.791+0000 7f251c066b80 1 -- 172.21.15.6:0/2901033231 wait complete. 2023-09-13T09:58:24.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.791+0000 7f251c066b80 20 client.20370 trim_cache size 0 max 16384 2023-09-13T09:58:24.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 Processor -- start 2023-09-13T09:58:24.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 -- start start 2023-09-13T09:58:24.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82eca00 0x55a8d82ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ee060 0x55a8d82f0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d82f56f0 con 0x55a8d82ed700 2023-09-13T09:58:24.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d82e38e0 con 0x55a8d82ee060 2023-09-13T09:58:24.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.805+0000 7f251c066b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d82f4600 con 0x55a8d82eca00 2023-09-13T09:58:24.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82fd0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45578/0 (socket says 172.21.15.6:45578) 2023-09-13T09:58:24.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 -- 172.21.15.6:0/4024756783 learned_addr learned my addr 172.21.15.6:0/4024756783 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250e41e700 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ee060 0x55a8d82f0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 -- 172.21.15.6:0/4024756783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82eca00 msgr2=0x55a8d82ec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82eca00 0x55a8d82ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 -- 172.21.15.6:0/4024756783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ee060 msgr2=0x55a8d82f0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ee060 0x55a8d82f0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 -- 172.21.15.6:0/4024756783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a8d806ade0 con 0x55a8d82ed700 2023-09-13T09:58:24.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f250d41c700 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82fd0c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009410 tx=0x7f24f8004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fbe5f5797d1f9a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f24fcff9700 1 -- 172.21.15.6:0/4024756783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8038030 con 0x55a8d82ed700 2023-09-13T09:58:24.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f24fcff9700 1 -- 172.21.15.6:0/4024756783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f24f801f6e0 con 0x55a8d82ed700 2023-09-13T09:58:24.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.806+0000 7f24fcff9700 1 -- 172.21.15.6:0/4024756783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8032740 con 0x55a8d82ed700 2023-09-13T09:58:24.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 -- 172.21.15.6:0/4024756783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 msgr2=0x55a8d82fd0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82fd0c0 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009410 tx=0x7f24f8004180 comp rx=0 tx=0).stop 2023-09-13T09:58:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 -- 172.21.15.6:0/4024756783 shutdown_connections 2023-09-13T09:58:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ee060 0x55a8d82f0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82eca00 0x55a8d82ec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 --2- 172.21.15.6:0/4024756783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82ed700 0x55a8d82fd0c0 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 -- 172.21.15.6:0/4024756783 >> 172.21.15.6:0/4024756783 conn(0x55a8d824ac80 msgr2=0x55a8d82e6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 -- 172.21.15.6:0/4024756783 shutdown_connections 2023-09-13T09:58:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 -- 172.21.15.6:0/4024756783 wait complete. 2023-09-13T09:58:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.807+0000 7f251c066b80 1 -- start start 2023-09-13T09:58:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 1 Processor -- start 2023-09-13T09:58:24.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82eca00 0x55a8d82f8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ed700 0x55a8d82f9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 0x55a8d82fc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d82fc670 con 0x55a8d82eca00 2023-09-13T09:58:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d82fc7e0 con 0x55a8d82ed700 2023-09-13T09:58:24.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a8d82fc9a0 con 0x55a8d82ee060 2023-09-13T09:58:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f251c066b80 10 client.0 _ll_register_callbacks cb 0x55a8d81da680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250dc1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82eca00 0x55a8d82f8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250dc1d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82eca00 0x55a8d82f8bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45584/0 (socket says 172.21.15.6:45584) 2023-09-13T09:58:24.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250dc1d700 1 -- 172.21.15.6:0/1043941570 learned_addr learned my addr 172.21.15.6:0/1043941570 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250d41c700 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ed700 0x55a8d82f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250e41e700 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 0x55a8d82fc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250dc1d700 1 -- 172.21.15.6:0/1043941570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 msgr2=0x55a8d82fc130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250dc1d700 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 0x55a8d82fc130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.808+0000 7f250dc1d700 1 -- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ed700 msgr2=0x55a8d82f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:24.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f250dc1d700 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ed700 0x55a8d82f9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f250dc1d700 1 -- 172.21.15.6:0/1043941570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a8d82567a0 con 0x55a8d82eca00 2023-09-13T09:58:24.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f250dc1d700 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82eca00 0x55a8d82f8bd0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f250409e290 tx=0x7f250409aa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b022c4e4b7962b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:24.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f24f17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:24.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f24f17fa700 1 -- 172.21.15.6:0/1043941570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040bc040 con 0x55a8d82eca00 2023-09-13T09:58:24.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f24f17fa700 1 -- 172.21.15.6:0/1043941570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f250409e590 con 0x55a8d82eca00 2023-09-13T09:58:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25040a23c0 con 0x55a8d82eca00 2023-09-13T09:58:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f24f17fa700 1 -- 172.21.15.6:0/1043941570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25040a6570 con 0x55a8d82eca00 2023-09-13T09:58:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 10 client.20376 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55a8d8053c60 con 0x55a8d82eca00 2023-09-13T09:58:24.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f24f17fa700 1 -- 172.21.15.6:0/1043941570 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f25040a23c0 con 0x55a8d82eca00 2023-09-13T09:58:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f24f17fa700 1 -- 172.21.15.6:0/1043941570 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f250409da80 con 0x55a8d82eca00 2023-09-13T09:58:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 10 client.20376 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 10 client.20376 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:58:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 20 client.20376 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8356050 0x55a8d8358470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 4 client.20376 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.809+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a8d81f8050 con 0x55a8d8356050 2023-09-13T09:58:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.810+0000 7f250d41c700 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8356050 0x55a8d8358470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.810+0000 7f250d41c700 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8356050 0x55a8d8358470 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1af2322cb9afe54d server_cookie=d33442ef4b5f50dd in_seq=0 out_seq=0 2023-09-13T09:58:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.810+0000 7f24f17fa700 10 client.20376 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:24.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.814+0000 7f24f17fa700 1 -- 172.21.15.6:0/1043941570 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a8d81f8050 con 0x55a8d8356050 2023-09-13T09:58:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.814+0000 7f24f17fa700 10 client.20376 handle_command_reply: tid=0 2023-09-13T09:58:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.814+0000 7f251c066b80 1 client.20376 shutdown 2023-09-13T09:58:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.814+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82eca00 msgr2=0x55a8d82f8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.814+0000 7f251c066b80 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82eca00 0x55a8d82f8bd0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f250409e290 tx=0x7f250409aa00 comp rx=0 tx=0).stop 2023-09-13T09:58:24.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 shutdown_connections 2023-09-13T09:58:24.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55a8d8356050 0x55a8d8358470 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a8d82ee060 0x55a8d82fc130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f24f17fa700 0 client.20376 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:24.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a8d82eca00 0x55a8d82f8bd0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 --2- 172.21.15.6:0/1043941570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a8d82ed700 0x55a8d82f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 >> 172.21.15.6:0/1043941570 conn(0x55a8d824ac80 msgr2=0x55a8d82f0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 shutdown_connections 2023-09-13T09:58:24.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 1 -- 172.21.15.6:0/1043941570 wait complete. 2023-09-13T09:58:24.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.815+0000 7f251c066b80 20 client.20376 trim_cache size 0 max 16384 2023-09-13T09:58:24.837 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24f40a0640 msgr2=0x7f24f40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24f40a0640 0x7f24f40a2b00 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f24f8011490 tx=0x7f24f8009260 comp rx=0 tx=0).stop 2023-09-13T09:58:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 msgr2=0x7f2508196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f2508196af0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f2504009fd0 tx=0x7f250401ca40 comp rx=0 tx=0).stop 2023-09-13T09:58:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 shutdown_connections 2023-09-13T09:58:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2508101850 0x7f250819e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f24f40a0640 0x7f24f40a2b00 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25080ffcc0 0x7f2508196af0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 --2- 172.21.15.6:0/693535823 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2508100eb0 0x7f2508197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 >> 172.21.15.6:0/693535823 conn(0x7f25080fb210 msgr2=0x7f2508068cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 shutdown_connections 2023-09-13T09:58:24.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.816+0000 7f250fe81700 1 -- 172.21.15.6:0/693535823 wait complete. 2023-09-13T09:58:24.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:58:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 -- 172.21.15.6:0/221458280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c700ffcc0 msgr2=0x7f6c701000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:24.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 --2- 172.21.15.6:0/221458280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c700ffcc0 0x7f6c701000e0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800b0d0 tx=0x7f6c6800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 -- 172.21.15.6:0/221458280 shutdown_connections 2023-09-13T09:58:24.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 --2- 172.21.15.6:0/221458280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70101850 0x7f6c70108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 --2- 172.21.15.6:0/221458280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c700ffcc0 0x7f6c701000e0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 --2- 172.21.15.6:0/221458280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c70100eb0 0x7f6c70101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 -- 172.21.15.6:0/221458280 >> 172.21.15.6:0/221458280 conn(0x7f6c700fb250 msgr2=0x7f6c700fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 -- 172.21.15.6:0/221458280 shutdown_connections 2023-09-13T09:58:24.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.988+0000 7f6c74c17700 1 -- 172.21.15.6:0/221458280 wait complete. 2023-09-13T09:58:24.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 Processor -- start 2023-09-13T09:58:24.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 -- start start 2023-09-13T09:58:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c700ffcc0 0x7f6c70068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c70100eb0 0x7f6c7019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70101850 0x7f6c7019dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:24.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7019e790 con 0x7f6c70100eb0 2023-09-13T09:58:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7019e900 con 0x7f6c700ffcc0 2023-09-13T09:58:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c74c17700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7019eac0 con 0x7f6c70101850 2023-09-13T09:58:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c70100eb0 0x7f6c7019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c70100eb0 0x7f6c7019b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45598/0 (socket says 172.21.15.6:45598) 2023-09-13T09:58:24.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/931327955 learned_addr learned my addr 172.21.15.6:0/931327955 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.989+0000 7f6c6ed9d700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70101850 0x7f6c7019dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/931327955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70101850 msgr2=0x7f6c7019dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70101850 0x7f6c7019dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/931327955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c700ffcc0 msgr2=0x7f6c70068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c700ffcc0 0x7f6c70068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/931327955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68009d00 con 0x7f6c70100eb0 2023-09-13T09:58:25.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c70100eb0 0x7f6c7019b970 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400b530 tx=0x7f6c6400b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c5f7fe700 1 -- 172.21.15.6:0/931327955 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64011830 con 0x7f6c70100eb0 2023-09-13T09:58:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7019eda0 con 0x7f6c70100eb0 2023-09-13T09:58:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c5f7fe700 1 -- 172.21.15.6:0/931327955 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c64011e50 con 0x7f6c70100eb0 2023-09-13T09:58:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c5f7fe700 1 -- 172.21.15.6:0/931327955 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6400f2e0 con 0x7f6c70100eb0 2023-09-13T09:58:25.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.990+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7019f2f0 con 0x7f6c70100eb0 2023-09-13T09:58:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.992+0000 7f6c5f7fe700 1 -- 172.21.15.6:0/931327955 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f6c64010380 con 0x7f6c70100eb0 2023-09-13T09:58:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.993+0000 7f6c5f7fe700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c580a06c0 0x7f6c580a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.993+0000 7f6c6e59c700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c580a06c0 0x7f6c580a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.994+0000 7f6c5f7fe700 1 -- 172.21.15.6:0/931327955 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c640cb6d0 con 0x7f6c70100eb0 2023-09-13T09:58:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.994+0000 7f6c80dfcb80 1 Processor -- start 2023-09-13T09:58:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.994+0000 7f6c80dfcb80 1 -- start start 2023-09-13T09:58:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffab10 0x5615b0ffaf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b0ff98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ff9e10 0x5615b0ffa270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b0f4e780 con 0x5615b0ff9e10 2023-09-13T09:58:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b0f4c0a0 con 0x5615b0ffab10 2023-09-13T09:58:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b0f47990 con 0x5615b0ffb470 2023-09-13T09:58:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ff9e10 0x5615b0ffa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffab10 0x5615b0ffaf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffab10 0x5615b0ffaf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39128/0 (socket says 172.21.15.6:39128) 2023-09-13T09:58:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ff9e10 0x5615b0ffa270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45608/0 (socket says 172.21.15.6:45608) 2023-09-13T09:58:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6e59c700 1 -- 172.21.15.6:0/2994438812 learned_addr learned my addr 172.21.15.6:0/2994438812 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b0ff98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6e59c700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c580a06c0 0x7f6c580a2b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007a30 tx=0x7f6c6800b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2994438812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffab10 msgr2=0x5615b0ffaf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffab10 0x5615b0ffaf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2994438812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ff9e10 msgr2=0x5615b0ffa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ff9e10 0x5615b0ffa270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2994438812 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615b0dc7630 con 0x5615b0ffb470 2023-09-13T09:58:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.995+0000 7f6c6ed9d700 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ff9e10 0x5615b0ffa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.996+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b0ff98d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400b500 tx=0x7f6c64000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=704ef44f5dd908ed server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.996+0000 7f6c5cff9700 1 -- 172.21.15.6:0/2994438812 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64098e70 con 0x5615b0ffb470 2023-09-13T09:58:25.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.996+0000 7f6c5cff9700 1 -- 172.21.15.6:0/2994438812 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c6409cca0 con 0x5615b0ffb470 2023-09-13T09:58:25.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.996+0000 7f6c5cff9700 1 -- 172.21.15.6:0/2994438812 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64099330 con 0x5615b0ffb470 2023-09-13T09:58:25.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2994438812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 msgr2=0x5615b0ff98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b0ff98d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400b500 tx=0x7f6c64000bc0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2994438812 shutdown_connections 2023-09-13T09:58:25.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ff9e10 0x5615b0ffa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffab10 0x5615b0ffaf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2994438812 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b0ff98d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2994438812 >> 172.21.15.6:0/2994438812 conn(0x5615b0f53c80 msgr2=0x5615b0feff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2994438812 shutdown_connections 2023-09-13T09:58:25.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2994438812 wait complete. 2023-09-13T09:58:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 -- start start 2023-09-13T09:58:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.997+0000 7f6c80dfcb80 1 Processor -- start 2023-09-13T09:58:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 0x5615b1003390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b10038d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b100a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b0ee5bb0 con 0x5615b0ffab10 2023-09-13T09:58:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b0ee58b0 con 0x5615b0ff9e10 2023-09-13T09:58:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b0dc9920 con 0x5615b0ffb470 2023-09-13T09:58:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c80dfcb80 10 client.0 _ll_register_callbacks cb 0x5615b0ee3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b10038d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 0x5615b1003390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b10038d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45612/0 (socket says 172.21.15.6:45612) 2023-09-13T09:58:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2148541711 learned_addr learned my addr 172.21.15.6:0/2148541711 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6ed9d700 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b100a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 msgr2=0x5615b100a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b100a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2148541711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 msgr2=0x5615b1003390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 0x5615b1003390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2148541711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7019f2f0 con 0x5615b0ffab10 2023-09-13T09:58:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b10038d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f6c640a09b0 tx=0x7f6c6400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ffd2af90c7571 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.998+0000 7f6c55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c55ffb700 1 -- 172.21.15.6:0/2148541711 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c64098560 con 0x5615b0ffab10 2023-09-13T09:58:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5615b0fe8670 con 0x5615b0ffab10 2023-09-13T09:58:25.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c55ffb700 1 -- 172.21.15.6:0/2148541711 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c640990d0 con 0x5615b0ffab10 2023-09-13T09:58:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c55ffb700 1 -- 172.21.15.6:0/2148541711 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c64098ef0 con 0x5615b0ffab10 2023-09-13T09:58:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 10 client.20388 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5615b0f5f7a0 con 0x5615b0ffab10 2023-09-13T09:58:25.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c55ffb700 1 -- 172.21.15.6:0/2148541711 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5615b0fe8670 con 0x5615b0ffab10 2023-09-13T09:58:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c55ffb700 1 -- 172.21.15.6:0/2148541711 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6c64097dd0 con 0x5615b0ffab10 2023-09-13T09:58:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 10 client.20388 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 10 client.20388 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:58:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 20 client.20388 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b100ed90 0x5615b10111b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 4 client.20388 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:24.999+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5615b0f40970 con 0x5615b100ed90 2023-09-13T09:58:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.000+0000 7f6c6e59c700 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b100ed90 0x5615b10111b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.001+0000 7f6c55ffb700 10 client.20388 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:25.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.001+0000 7f6c6e59c700 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b100ed90 0x5615b10111b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=141d897a6de3c332 server_cookie=3e9d23750291e258 in_seq=0 out_seq=0 2023-09-13T09:58:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.004+0000 7f6c55ffb700 1 -- 172.21.15.6:0/2148541711 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5615b0f40970 con 0x5615b100ed90 2023-09-13T09:58:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.004+0000 7f6c55ffb700 10 client.20388 handle_command_reply: tid=0 2023-09-13T09:58:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.004+0000 7f6c80dfcb80 1 client.20388 shutdown 2023-09-13T09:58:25.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.004+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 msgr2=0x5615b10038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.004+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b10038d0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7f6c640a09b0 tx=0x7f6c6400be60 comp rx=0 tx=0).stop 2023-09-13T09:58:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 shutdown_connections 2023-09-13T09:58:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b100ed90 0x5615b10111b0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffb470 0x5615b100a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 0x5615b1003390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c55ffb700 0 client.20388 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2148541711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b10038d0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 >> 172.21.15.6:0/2148541711 conn(0x5615b0f53c80 msgr2=0x5615b0fea7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 shutdown_connections 2023-09-13T09:58:25.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2148541711 wait complete. 2023-09-13T09:58:25.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.005+0000 7f6c80dfcb80 20 client.20388 trim_cache size 0 max 16384 2023-09-13T09:58:25.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 Processor -- start 2023-09-13T09:58:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 -- start start 2023-09-13T09:58:25.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ff9e10 0x5615b0ff98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b100a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffb470 0x5615b1001ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b0ff1fd0 con 0x5615b0ffab10 2023-09-13T09:58:25.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b1001b10 con 0x5615b0ffb470 2023-09-13T09:58:25.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b1011810 con 0x5615b0ff9e10 2023-09-13T09:58:25.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b100a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b100a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45620/0 (socket says 172.21.15.6:45620) 2023-09-13T09:58:25.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2372786066 learned_addr learned my addr 172.21.15.6:0/2372786066 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.019+0000 7f6c6e59c700 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ff9e10 0x5615b0ff98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2372786066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ff9e10 msgr2=0x5615b0ff98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ff9e10 0x5615b0ff98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2372786066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffb470 msgr2=0x5615b1001ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffb470 0x5615b1001ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c6dd9b700 1 -- 172.21.15.6:0/2372786066 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5615b0d73de0 con 0x5615b0ffab10 2023-09-13T09:58:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c6dd9b700 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b100a830 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f6c640971c0 tx=0x7f6c64098d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1880e9a90d09f2a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c5d7fa700 1 -- 172.21.15.6:0/2372786066 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640a2020 con 0x5615b0ffab10 2023-09-13T09:58:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c5d7fa700 1 -- 172.21.15.6:0/2372786066 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c6409ddc0 con 0x5615b0ffab10 2023-09-13T09:58:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.020+0000 7f6c5d7fa700 1 -- 172.21.15.6:0/2372786066 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640990d0 con 0x5615b0ffab10 2023-09-13T09:58:25.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2372786066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 msgr2=0x5615b100a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b100a830 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7f6c640971c0 tx=0x7f6c64098d70 comp rx=0 tx=0).stop 2023-09-13T09:58:25.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2372786066 shutdown_connections 2023-09-13T09:58:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ffb470 0x5615b1001ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ff9e10 0x5615b0ff98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/2372786066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffab10 0x5615b100a830 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2372786066 >> 172.21.15.6:0/2372786066 conn(0x5615b0f53c80 msgr2=0x5615b0fefe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2372786066 shutdown_connections 2023-09-13T09:58:25.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/2372786066 wait complete. 2023-09-13T09:58:25.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 -- start start 2023-09-13T09:58:25.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.021+0000 7f6c80dfcb80 1 Processor -- start 2023-09-13T09:58:25.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 0x5615b1005ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffab10 0x5615b1006220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c80dfcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffb470 0x5615b1009240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b1009780 con 0x5615b0ffb470 2023-09-13T09:58:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b10098f0 con 0x5615b0ff9e10 2023-09-13T09:58:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c80dfcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5615b1009ab0 con 0x5615b0ffab10 2023-09-13T09:58:25.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c80dfcb80 10 client.0 _ll_register_callbacks cb 0x5615b0ee3680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffb470 0x5615b1009240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffab10 0x5615b1006220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffb470 0x5615b1009240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45628/0 (socket says 172.21.15.6:45628) 2023-09-13T09:58:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 -- 172.21.15.6:0/3362391486 learned_addr learned my addr 172.21.15.6:0/3362391486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6dd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffab10 0x5615b1006220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48680/0 (socket says 172.21.15.6:48680) 2023-09-13T09:58:25.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 -- 172.21.15.6:0/3362391486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffab10 msgr2=0x5615b1006220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffab10 0x5615b1006220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 -- 172.21.15.6:0/3362391486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 msgr2=0x5615b1005ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 0x5615b1005ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 -- 172.21.15.6:0/3362391486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5615b0f5f7a0 con 0x5615b0ffb470 2023-09-13T09:58:25.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c6ed9d700 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffb470 0x5615b1009240 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009fd0 tx=0x7f6c60012a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee2ec8784a1f62c9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.022+0000 7f6c55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c55ffb700 1 -- 172.21.15.6:0/3362391486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c60020070 con 0x5615b0ffb470 2023-09-13T09:58:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c55ffb700 1 -- 172.21.15.6:0/3362391486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6c60004830 con 0x5615b0ffb470 2023-09-13T09:58:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c6409cca0 con 0x5615b0ffb470 2023-09-13T09:58:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c55ffb700 1 -- 172.21.15.6:0/3362391486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c60017050 con 0x5615b0ffb470 2023-09-13T09:58:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 10 client.20394 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5615b0d5cc60 con 0x5615b0ffb470 2023-09-13T09:58:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c55ffb700 1 -- 172.21.15.6:0/3362391486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f6c6002a020 con 0x5615b0ffb470 2023-09-13T09:58:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c55ffb700 1 -- 172.21.15.6:0/3362391486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f6c60023030 con 0x5615b0ffb470 2023-09-13T09:58:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 10 client.20394 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 10 client.20394 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:58:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 20 client.20394 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b1063470 0x5615b1065890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 4 client.20394 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5615b0f01050 con 0x5615b1063470 2023-09-13T09:58:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.023+0000 7f6c6e59c700 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b1063470 0x5615b1065890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.024+0000 7f6c55ffb700 10 client.20394 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.024+0000 7f6c6e59c700 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b1063470 0x5615b1065890 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8f6fafea9d5037f5 server_cookie=6fb00ad15e6e0fde in_seq=0 out_seq=0 2023-09-13T09:58:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.024+0000 7f6c55ffb700 1 -- 172.21.15.6:0/3362391486 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5615b0f01050 con 0x5615b1063470 2023-09-13T09:58:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.024+0000 7f6c55ffb700 10 client.20394 handle_command_reply: tid=0 2023-09-13T09:58:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.024+0000 7f6c80dfcb80 1 client.20394 shutdown 2023-09-13T09:58:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.024+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffb470 msgr2=0x5615b1009240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.024+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffb470 0x5615b1009240 secure :-1 s=READY pgs=1707 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009fd0 tx=0x7f6c60012a20 comp rx=0 tx=0).stop 2023-09-13T09:58:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 shutdown_connections 2023-09-13T09:58:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5615b1063470 0x5615b1065890 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5615b0ffb470 0x5615b1009240 unknown :-1 s=CLOSED pgs=1707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c55ffb700 0 client.20394 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5615b0ff9e10 0x5615b1005ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 --2- 172.21.15.6:0/3362391486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5615b0ffab10 0x5615b1006220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 >> 172.21.15.6:0/3362391486 conn(0x5615b0f53c80 msgr2=0x5615b1001ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 shutdown_connections 2023-09-13T09:58:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 1 -- 172.21.15.6:0/3362391486 wait complete. 2023-09-13T09:58:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c80dfcb80 20 client.20394 trim_cache size 0 max 16384 2023-09-13T09:58:25.061 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:25.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c580a06c0 msgr2=0x7f6c580a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c580a06c0 0x7f6c580a2b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007a30 tx=0x7f6c6800b040 comp rx=0 tx=0).stop 2023-09-13T09:58:25.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c70100eb0 msgr2=0x7f6c7019b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c70100eb0 0x7f6c7019b970 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f6c6400b530 tx=0x7f6c6400b840 comp rx=0 tx=0).stop 2023-09-13T09:58:25.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 shutdown_connections 2023-09-13T09:58:25.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c70101850 0x7f6c7019dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f6c700ffcc0 0x7f6c70068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f6c580a06c0 0x7f6c580a2b80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 --2- 172.21.15.6:0/931327955 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6c70100eb0 0x7f6c7019b970 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 >> 172.21.15.6:0/931327955 conn(0x7f6c700fb250 msgr2=0x7f6c700fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.025+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 shutdown_connections 2023-09-13T09:58:25.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.026+0000 7f6c74c17700 1 -- 172.21.15.6:0/931327955 wait complete. 2023-09-13T09:58:25.065 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:58:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.204+0000 7f2c745d8700 1 -- 172.21.15.6:0/645475686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 msgr2=0x7f2c6c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.204+0000 7f2c745d8700 1 --2- 172.21.15.6:0/645475686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c101310 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c0099c0 tx=0x7f2c5c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.204+0000 7f2c745d8700 1 -- 172.21.15.6:0/645475686 shutdown_connections 2023-09-13T09:58:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.204+0000 7f2c745d8700 1 --2- 172.21.15.6:0/645475686 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c6c101850 0x7f2c6c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.204+0000 7f2c745d8700 1 --2- 172.21.15.6:0/645475686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c6c0ffcc0 0x7f2c6c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.204+0000 7f2c745d8700 1 --2- 172.21.15.6:0/645475686 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c101310 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.204+0000 7f2c745d8700 1 -- 172.21.15.6:0/645475686 >> 172.21.15.6:0/645475686 conn(0x7f2c6c0fb210 msgr2=0x7f2c6c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 -- 172.21.15.6:0/645475686 shutdown_connections 2023-09-13T09:58:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 -- 172.21.15.6:0/645475686 wait complete. 2023-09-13T09:58:25.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 Processor -- start 2023-09-13T09:58:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 -- start start 2023-09-13T09:58:25.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c6c0ffcc0 0x7f2c6c1948a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c194de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c6c101850 0x7f2c6c19be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c19c420 con 0x7f2c6c100eb0 2023-09-13T09:58:25.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c19c560 con 0x7f2c6c101850 2023-09-13T09:58:25.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.205+0000 7f2c745d8700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c6c19c6f0 con 0x7f2c6c0ffcc0 2023-09-13T09:58:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c194de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c194de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45640/0 (socket says 172.21.15.6:45640) 2023-09-13T09:58:25.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 -- 172.21.15.6:0/333843881 learned_addr learned my addr 172.21.15.6:0/333843881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c72374700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c6c0ffcc0 0x7f2c6c1948a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c72b75700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c6c101850 0x7f2c6c19be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 -- 172.21.15.6:0/333843881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c6c0ffcc0 msgr2=0x7f2c6c1948a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c6c0ffcc0 0x7f2c6c1948a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 -- 172.21.15.6:0/333843881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c6c101850 msgr2=0x7f2c6c19be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c6c101850 0x7f2c6c19be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 -- 172.21.15.6:0/333843881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c5c0095f0 con 0x7f2c6c100eb0 2023-09-13T09:58:25.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c71b73700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c194de0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009990 tx=0x7f2c5c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c637fe700 1 -- 172.21.15.6:0/333843881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c01d070 con 0x7f2c6c100eb0 2023-09-13T09:58:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c637fe700 1 -- 172.21.15.6:0/333843881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c5c005030 con 0x7f2c6c100eb0 2023-09-13T09:58:25.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c6c19c970 con 0x7f2c6c100eb0 2023-09-13T09:58:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c637fe700 1 -- 172.21.15.6:0/333843881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c004a70 con 0x7f2c6c100eb0 2023-09-13T09:58:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.206+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c19cdf0 con 0x7f2c6c100eb0 2023-09-13T09:58:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.208+0000 7f2c637fe700 1 -- 172.21.15.6:0/333843881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2c5c004cb0 con 0x7f2c6c100eb0 2023-09-13T09:58:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.209+0000 7f2c637fe700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2c580a28d0 0x7f2c580a4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.209+0000 7f2c637fe700 1 -- 172.21.15.6:0/333843881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2c5c0cc8c0 con 0x7f2c6c100eb0 2023-09-13T09:58:25.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.209+0000 7f2c72374700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2c580a28d0 0x7f2c580a4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.210+0000 7f2c72374700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2c580a28d0 0x7f2c580a4d90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c100d10 tx=0x7f2c68009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.210+0000 7f2c807bdb80 1 Processor -- start 2023-09-13T09:58:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c807bdb80 1 -- start start 2023-09-13T09:58:25.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbb700 0x559171dbbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbaa00 0x559171dbae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171d13780 con 0x559171dbc060 2023-09-13T09:58:25.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171d110a0 con 0x559171dbaa00 2023-09-13T09:58:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171d0c990 con 0x559171dbb700 2023-09-13T09:58:25.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dba4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45648/0 (socket says 172.21.15.6:45648) 2023-09-13T09:58:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 -- 172.21.15.6:0/859288937 learned_addr learned my addr 172.21.15.6:0/859288937 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c72374700 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbb700 0x559171dbbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c72b75700 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbaa00 0x559171dbae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 -- 172.21.15.6:0/859288937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbb700 msgr2=0x559171dbbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbb700 0x559171dbbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 -- 172.21.15.6:0/859288937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbaa00 msgr2=0x559171dbae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbaa00 0x559171dbae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 -- 172.21.15.6:0/859288937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559171b8c630 con 0x559171dbc060 2023-09-13T09:58:25.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c72b75700 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbaa00 0x559171dbae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:58:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.211+0000 7f2c71b73700 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dba4c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c09a080 tx=0x7f2c5c099fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31110ddce906ce83 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.212+0000 7f2c60ff9700 1 -- 172.21.15.6:0/859288937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c0a0070 con 0x559171dbc060 2023-09-13T09:58:25.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.212+0000 7f2c60ff9700 1 -- 172.21.15.6:0/859288937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c5c09df20 con 0x559171dbc060 2023-09-13T09:58:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.212+0000 7f2c60ff9700 1 -- 172.21.15.6:0/859288937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c5c09a350 con 0x559171dbc060 2023-09-13T09:58:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- 172.21.15.6:0/859288937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 msgr2=0x559171dba4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dba4c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c09a080 tx=0x7f2c5c099fe0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- 172.21.15.6:0/859288937 shutdown_connections 2023-09-13T09:58:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbaa00 0x559171dbae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbb700 0x559171dbbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/859288937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dba4c0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- 172.21.15.6:0/859288937 >> 172.21.15.6:0/859288937 conn(0x559171d18c80 msgr2=0x559171db4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- 172.21.15.6:0/859288937 shutdown_connections 2023-09-13T09:58:25.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- 172.21.15.6:0/859288937 wait complete. 2023-09-13T09:58:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- start start 2023-09-13T09:58:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 Processor -- start 2023-09-13T09:58:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc3b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc40c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dcb100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171caabb0 con 0x559171dbaa00 2023-09-13T09:58:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171caa8b0 con 0x559171dbb700 2023-09-13T09:58:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171b8e920 con 0x559171dbc060 2023-09-13T09:58:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.213+0000 7f2c807bdb80 10 client.0 _ll_register_callbacks cb 0x559171ca8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc3b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45654/0 (socket says 172.21.15.6:45654) 2023-09-13T09:58:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72b75700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dcb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 -- 172.21.15.6:0/2791867716 learned_addr learned my addr 172.21.15.6:0/2791867716 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 -- 172.21.15.6:0/2791867716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 msgr2=0x559171dcb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dcb100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 -- 172.21.15.6:0/2791867716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 msgr2=0x559171dc40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 -- 172.21.15.6:0/2791867716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c6c19cdf0 con 0x559171dbaa00 2023-09-13T09:58:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c72374700 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc3b80 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f2c6801dc00 tx=0x7f2c680047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a76c6a425fb93600 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:25.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c55ffb700 1 -- 172.21.15.6:0/2791867716 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68022070 con 0x559171dbaa00 2023-09-13T09:58:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.214+0000 7f2c55ffb700 1 -- 172.21.15.6:0/2791867716 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2c6801c690 con 0x559171dbaa00 2023-09-13T09:58:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559171dad670 con 0x559171dbaa00 2023-09-13T09:58:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c55ffb700 1 -- 172.21.15.6:0/2791867716 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c6801c850 con 0x559171dbaa00 2023-09-13T09:58:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 10 client.20406 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x559171d247a0 con 0x559171dbaa00 2023-09-13T09:58:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c55ffb700 1 -- 172.21.15.6:0/2791867716 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559171dad670 con 0x559171dbaa00 2023-09-13T09:58:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c55ffb700 1 -- 172.21.15.6:0/2791867716 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2c6802e070 con 0x559171dbaa00 2023-09-13T09:58:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 10 client.20406 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 10 client.20406 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:58:25.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 20 client.20406 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171dcf930 0x559171dd1d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 4 client.20406 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:25.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559171d05970 con 0x559171dcf930 2023-09-13T09:58:25.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.215+0000 7f2c71b73700 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171dcf930 0x559171dd1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.216+0000 7f2c55ffb700 10 client.20406 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.216+0000 7f2c71b73700 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171dcf930 0x559171dd1d50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=41143d20ab22963f server_cookie=34e5c534de55d9e1 in_seq=0 out_seq=0 2023-09-13T09:58:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c55ffb700 1 -- 172.21.15.6:0/2791867716 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559171d05970 con 0x559171dcf930 2023-09-13T09:58:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c55ffb700 10 client.20406 handle_command_reply: tid=0 2023-09-13T09:58:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 client.20406 shutdown 2023-09-13T09:58:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 msgr2=0x559171dc3b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc3b80 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f2c6801dc00 tx=0x7f2c680047c0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 shutdown_connections 2023-09-13T09:58:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171dcf930 0x559171dd1d50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dcb100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c55ffb700 0 client.20406 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc3b80 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/2791867716 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 >> 172.21.15.6:0/2791867716 conn(0x559171d18c80 msgr2=0x559171daf7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 shutdown_connections 2023-09-13T09:58:25.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 1 -- 172.21.15.6:0/2791867716 wait complete. 2023-09-13T09:58:25.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.217+0000 7f2c807bdb80 20 client.20406 trim_cache size 0 max 16384 2023-09-13T09:58:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 Processor -- start 2023-09-13T09:58:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 -- start start 2023-09-13T09:58:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbaa00 0x559171dba4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dcb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dbe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171dc3720 con 0x559171dbc060 2023-09-13T09:58:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171db6730 con 0x559171dbb700 2023-09-13T09:58:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171db6970 con 0x559171dbaa00 2023-09-13T09:58:25.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dcb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c72b75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dbe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dcb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39186/0 (socket says 172.21.15.6:39186) 2023-09-13T09:58:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c71b73700 1 -- 172.21.15.6:0/3897256145 learned_addr learned my addr 172.21.15.6:0/3897256145 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.232+0000 7f2c72b75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dbe8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45664/0 (socket says 172.21.15.6:45664) 2023-09-13T09:58:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c72b75700 1 -- 172.21.15.6:0/3897256145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbaa00 msgr2=0x559171dba4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c72b75700 1 --2- 172.21.15.6:0/3897256145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbaa00 0x559171dba4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c72b75700 1 -- 172.21.15.6:0/3897256145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 msgr2=0x559171dcb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c72b75700 1 --2- 172.21.15.6:0/3897256145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dcb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c72b75700 1 -- 172.21.15.6:0/3897256145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559171b38de0 con 0x559171dbc060 2023-09-13T09:58:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c72b75700 1 --2- 172.21.15.6:0/3897256145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dbe8e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f2c640094e0 tx=0x7f2c6400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92d0454403a833cb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c617fa700 1 -- 172.21.15.6:0/3897256145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6400e040 con 0x559171dbc060 2023-09-13T09:58:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c617fa700 1 -- 172.21.15.6:0/3897256145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c6400f040 con 0x559171dbc060 2023-09-13T09:58:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.233+0000 7f2c617fa700 1 -- 172.21.15.6:0/3897256145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64017670 con 0x559171dbc060 2023-09-13T09:58:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 -- 172.21.15.6:0/3897256145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 msgr2=0x559171dbe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/3897256145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dbe8e0 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f2c640094e0 tx=0x7f2c6400b040 comp rx=0 tx=0).stop 2023-09-13T09:58:25.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 -- 172.21.15.6:0/3897256145 shutdown_connections 2023-09-13T09:58:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/3897256145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbc060 0x559171dbe8e0 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/3897256145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbaa00 0x559171dba4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/3897256145 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dcb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 -- 172.21.15.6:0/3897256145 >> 172.21.15.6:0/3897256145 conn(0x559171d18c80 msgr2=0x559171dcb9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 -- 172.21.15.6:0/3897256145 shutdown_connections 2023-09-13T09:58:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 -- 172.21.15.6:0/3897256145 wait complete. 2023-09-13T09:58:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 -- start start 2023-09-13T09:58:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.234+0000 7f2c807bdb80 1 Processor -- start 2023-09-13T09:58:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc77b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171dcad10 con 0x559171dbaa00 2023-09-13T09:58:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171dcae80 con 0x559171dbb700 2023-09-13T09:58:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559171dcb040 con 0x559171dbc060 2023-09-13T09:58:25.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 10 client.0 _ll_register_callbacks cb 0x559171ca8680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc7270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45666/0 (socket says 172.21.15.6:45666) 2023-09-13T09:58:25.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c71b73700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 -- 172.21.15.6:0/111742739 learned_addr learned my addr 172.21.15.6:0/111742739 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72b75700 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 -- 172.21.15.6:0/111742739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 msgr2=0x559171dca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dca7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 -- 172.21.15.6:0/111742739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 msgr2=0x559171dc77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 -- 172.21.15.6:0/111742739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c640091c0 con 0x559171dbaa00 2023-09-13T09:58:25.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c72374700 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc7270 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f2c68011b60 tx=0x7f2c68026b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b39453de4fcddf36 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c55ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c55ffb700 1 -- 172.21.15.6:0/111742739 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c68022070 con 0x559171dbaa00 2023-09-13T09:58:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c55ffb700 1 -- 172.21.15.6:0/111742739 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2c68005030 con 0x559171dbaa00 2023-09-13T09:58:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.235+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c5c09df20 con 0x559171dbaa00 2023-09-13T09:58:25.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c55ffb700 1 -- 172.21.15.6:0/111742739 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c680051f0 con 0x559171dbaa00 2023-09-13T09:58:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 10 client.20412 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x559171b21c60 con 0x559171dbaa00 2023-09-13T09:58:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c55ffb700 1 -- 172.21.15.6:0/111742739 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2c5c09df20 con 0x559171dbaa00 2023-09-13T09:58:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c55ffb700 1 -- 172.21.15.6:0/111742739 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f2c6802e070 con 0x559171dbaa00 2023-09-13T09:58:25.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 10 client.20412 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 10 client.20412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:58:25.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 20 client.20412 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171e24bd0 0x559171e26ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 4 client.20412 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:25.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559171cc6050 con 0x559171e24bd0 2023-09-13T09:58:25.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.236+0000 7f2c71b73700 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171e24bd0 0x559171e26ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c55ffb700 10 client.20412 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:25.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c71b73700 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171e24bd0 0x559171e26ff0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5cbd04f0882be4be server_cookie=98d6ae988968e9e6 in_seq=0 out_seq=0 2023-09-13T09:58:25.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c55ffb700 1 -- 172.21.15.6:0/111742739 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559171cc6050 con 0x559171e24bd0 2023-09-13T09:58:25.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c55ffb700 10 client.20412 handle_command_reply: tid=0 2023-09-13T09:58:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 client.20412 shutdown 2023-09-13T09:58:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 msgr2=0x559171dc7270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc7270 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f2c68011b60 tx=0x7f2c68026b10 comp rx=0 tx=0).stop 2023-09-13T09:58:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 shutdown_connections 2023-09-13T09:58:25.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559171e24bd0 0x559171e26ff0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559171dbc060 0x559171dca7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c55ffb700 0 client.20412 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559171dbaa00 0x559171dc7270 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 --2- 172.21.15.6:0/111742739 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559171dbb700 0x559171dc77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 >> 172.21.15.6:0/111742739 conn(0x559171d18c80 msgr2=0x559171dbe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 shutdown_connections 2023-09-13T09:58:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 1 -- 172.21.15.6:0/111742739 wait complete. 2023-09-13T09:58:25.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.237+0000 7f2c807bdb80 20 client.20412 trim_cache size 0 max 16384 2023-09-13T09:58:25.276 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2c580a28d0 msgr2=0x7f2c580a4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2c580a28d0 0x7f2c580a4d90 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c100d10 tx=0x7f2c68009260 comp rx=0 tx=0).stop 2023-09-13T09:58:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 msgr2=0x7f2c6c194de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c194de0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009990 tx=0x7f2c5c00f690 comp rx=0 tx=0).stop 2023-09-13T09:58:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 shutdown_connections 2023-09-13T09:58:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2c6c101850 0x7f2c6c19be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2c6c0ffcc0 0x7f2c6c1948a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2c580a28d0 0x7f2c580a4d90 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 --2- 172.21.15.6:0/333843881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c6c100eb0 0x7f2c6c194de0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 >> 172.21.15.6:0/333843881 conn(0x7f2c6c0fb210 msgr2=0x7f2c6c104350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 shutdown_connections 2023-09-13T09:58:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.238+0000 7f2c745d8700 1 -- 172.21.15.6:0/333843881 wait complete. 2023-09-13T09:58:25.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:58:25.305 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:25 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3434349241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:58:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/1875374762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba80ffcc0 msgr2=0x7fdba81000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/1875374762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba80ffcc0 0x7fdba81000e0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0099c0 tx=0x7fdb9c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/1875374762 shutdown_connections 2023-09-13T09:58:25.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/1875374762 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdba8101850 0x7fdba8108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/1875374762 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba80ffcc0 0x7fdba81000e0 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/1875374762 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdba8100eb0 0x7fdba8101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/1875374762 >> 172.21.15.6:0/1875374762 conn(0x7fdba80fb250 msgr2=0x7fdba80fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/1875374762 shutdown_connections 2023-09-13T09:58:25.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.418+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/1875374762 wait complete. 2023-09-13T09:58:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 Processor -- start 2023-09-13T09:58:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 -- start start 2023-09-13T09:58:25.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdba80ffcc0 0x7fdba8068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba8100eb0 0x7fdba819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdba8101850 0x7fdba819de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba819e630 con 0x7fdba8100eb0 2023-09-13T09:58:25.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba819e7a0 con 0x7fdba8101850 2023-09-13T09:58:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbaf0f5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba819e960 con 0x7fdba80ffcc0 2023-09-13T09:58:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba8100eb0 0x7fdba819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbace91700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdba80ffcc0 0x7fdba8068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba8100eb0 0x7fdba819b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45682/0 (socket says 172.21.15.6:45682) 2023-09-13T09:58:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 -- 172.21.15.6:0/3744807389 learned_addr learned my addr 172.21.15.6:0/3744807389 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbad692700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdba8101850 0x7fdba819de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 -- 172.21.15.6:0/3744807389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdba80ffcc0 msgr2=0x7fdba8068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdba80ffcc0 0x7fdba8068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 -- 172.21.15.6:0/3744807389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdba8101850 msgr2=0x7fdba819de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdba8101850 0x7fdba819de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdba7fff700 1 -- 172.21.15.6:0/3744807389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c0095f0 con 0x7fdba8100eb0 2023-09-13T09:58:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.419+0000 7fdbad692700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdba8101850 0x7fdba819de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:58:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.420+0000 7fdba7fff700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba8100eb0 0x7fdba819b810 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400e9a0 tx=0x7fdb9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.420+0000 7fdba5ffb700 1 -- 172.21.15.6:0/3744807389 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94009790 con 0x7fdba8100eb0 2023-09-13T09:58:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.420+0000 7fdba5ffb700 1 -- 172.21.15.6:0/3744807389 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb9400cbd0 con 0x7fdba8100eb0 2023-09-13T09:58:25.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.420+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdba819ec40 con 0x7fdba8100eb0 2023-09-13T09:58:25.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.420+0000 7fdba5ffb700 1 -- 172.21.15.6:0/3744807389 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb94018680 con 0x7fdba8100eb0 2023-09-13T09:58:25.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.420+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba819f150 con 0x7fdba8100eb0 2023-09-13T09:58:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.423+0000 7fdba5ffb700 1 -- 172.21.15.6:0/3744807389 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdb9400cd40 con 0x7fdba8100eb0 2023-09-13T09:58:25.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.423+0000 7fdba5ffb700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb980a0640 0x7fdb980a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbace91700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb980a0640 0x7fdb980a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdba5ffb700 1 -- 172.21.15.6:0/3744807389 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb94014070 con 0x7fdba8100eb0 2023-09-13T09:58:25.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbace91700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb980a0640 0x7fdb980a2b00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009990 tx=0x7fdb9c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 Processor -- start 2023-09-13T09:58:25.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 -- start start 2023-09-13T09:58:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285b700 0x555c2285bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285c060 0x555c2285a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c227b3780 con 0x555c2285b700 2023-09-13T09:58:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c227b10a0 con 0x555c2285c060 2023-09-13T09:58:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.424+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c227ac990 con 0x555c2285aa00 2023-09-13T09:58:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285c060 0x555c2285a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285c060 0x555c2285a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39214/0 (socket says 172.21.15.6:39214) 2023-09-13T09:58:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 -- 172.21.15.6:0/3474554524 learned_addr learned my addr 172.21.15.6:0/3474554524 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdbad692700 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 -- 172.21.15.6:0/3474554524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 msgr2=0x555c2285ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdbace91700 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285b700 0x555c2285bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 -- 172.21.15.6:0/3474554524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285b700 msgr2=0x555c2285bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285b700 0x555c2285bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 -- 172.21.15.6:0/3474554524 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c2262c630 con 0x555c2285c060 2023-09-13T09:58:25.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdbace91700 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285b700 0x555c2285bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:58:25.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdba7fff700 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285c060 0x555c2285a4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb940a1120 tx=0x7fdb940991f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb175b9be8a51260 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.425+0000 7fdb92ffd700 1 -- 172.21.15.6:0/3474554524 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940995e0 con 0x555c2285c060 2023-09-13T09:58:25.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdb92ffd700 1 -- 172.21.15.6:0/3474554524 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb9409d410 con 0x555c2285c060 2023-09-13T09:58:25.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdb92ffd700 1 -- 172.21.15.6:0/3474554524 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb940842f0 con 0x555c2285c060 2023-09-13T09:58:25.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/3474554524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285c060 msgr2=0x555c2285a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285c060 0x555c2285a4c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fdb940a1120 tx=0x7fdb940991f0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/3474554524 shutdown_connections 2023-09-13T09:58:25.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285b700 0x555c2285bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/3474554524 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285c060 0x555c2285a4c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/3474554524 >> 172.21.15.6:0/3474554524 conn(0x555c227b8c80 msgr2=0x555c22854f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/3474554524 shutdown_connections 2023-09-13T09:58:25.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.426+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/3474554524 wait complete. 2023-09-13T09:58:25.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 -- start start 2023-09-13T09:58:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 Processor -- start 2023-09-13T09:58:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c22863e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c2286b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2274abb0 con 0x555c2285c060 2023-09-13T09:58:25.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2274a8b0 con 0x555c2285b700 2023-09-13T09:58:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2262e920 con 0x555c2285aa00 2023-09-13T09:58:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbbb2dab80 10 client.0 _ll_register_callbacks cb 0x555c22748680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbace91700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c22863e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228643d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39220/0 (socket says 172.21.15.6:39220) 2023-09-13T09:58:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdba7fff700 1 -- 172.21.15.6:0/2174876528 learned_addr learned my addr 172.21.15.6:0/2174876528 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.427+0000 7fdbad692700 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c2286b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbace91700 1 -- 172.21.15.6:0/2174876528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 msgr2=0x555c228643d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbace91700 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228643d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbace91700 1 -- 172.21.15.6:0/2174876528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 msgr2=0x555c2286b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbace91700 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c2286b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbace91700 1 -- 172.21.15.6:0/2174876528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba819f150 con 0x555c2285aa00 2023-09-13T09:58:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdba7fff700 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:25.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbace91700 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c22863e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d437dd57ee90d12 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdb87fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:58:25.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdb87fff700 1 -- 172.21.15.6:0/2174876528 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00f660 con 0x555c2285aa00 2023-09-13T09:58:25.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555c2284d670 con 0x555c2285aa00 2023-09-13T09:58:25.455 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdb87fff700 1 -- 172.21.15.6:0/2174876528 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb9c003e40 con 0x555c2285aa00 2023-09-13T09:58:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdb87fff700 1 -- 172.21.15.6:0/2174876528 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb9c00f7c0 con 0x555c2285aa00 2023-09-13T09:58:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbbb2dab80 10 client.29623 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.428+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x555c227c47a0 con 0x555c2285aa00 2023-09-13T09:58:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdb87fff700 1 -- 172.21.15.6:0/2174876528 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x555c2284d670 con 0x555c2285aa00 2023-09-13T09:58:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdb87fff700 1 -- 172.21.15.6:0/2174876528 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdb9c02d950 con 0x555c2285aa00 2023-09-13T09:58:25.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdbbb2dab80 10 client.29623 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdbbb2dab80 10 client.29623 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:58:25.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdbbb2dab80 20 client.29623 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c2286fb00 0x555c22871f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdbbb2dab80 4 client.29623 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:25.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555c227a5970 con 0x555c2286fb00 2023-09-13T09:58:25.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.429+0000 7fdba7fff700 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c2286fb00 0x555c22871f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.430+0000 7fdb87fff700 10 client.29623 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:25.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.430+0000 7fdba7fff700 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c2286fb00 0x555c22871f20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1189d0229758251d server_cookie=118fa5a115479734 in_seq=0 out_seq=0 2023-09-13T09:58:25.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdb87fff700 1 -- 172.21.15.6:0/2174876528 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555c227a5970 con 0x555c2286fb00 2023-09-13T09:58:25.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdb87fff700 10 client.29623 handle_command_reply: tid=0 2023-09-13T09:58:25.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 client.29623 shutdown 2023-09-13T09:58:25.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 msgr2=0x555c22863e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c22863e90 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c0098e0 tx=0x7fdb9c009310 comp rx=0 tx=0).stop 2023-09-13T09:58:25.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 shutdown_connections 2023-09-13T09:58:25.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c2286fb00 0x555c22871f20 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c2286b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdb87fff700 0 client.29623 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:25.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c22863e90 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2174876528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228643d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 >> 172.21.15.6:0/2174876528 conn(0x555c227b8c80 msgr2=0x555c2284f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 shutdown_connections 2023-09-13T09:58:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2174876528 wait complete. 2023-09-13T09:58:25.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.431+0000 7fdbbb2dab80 20 client.29623 trim_cache size 0 max 16384 2023-09-13T09:58:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 Processor -- start 2023-09-13T09:58:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 -- start start 2023-09-13T09:58:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c2286bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c22863c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c22856730 con 0x555c2285c060 2023-09-13T09:58:25.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c2285f4b0 con 0x555c2285b700 2023-09-13T09:58:25.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c22864f00 con 0x555c2285aa00 2023-09-13T09:58:25.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c22863c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdba7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c2286bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbace91700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c22863c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45706/0 (socket says 172.21.15.6:45706) 2023-09-13T09:58:25.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 -- 172.21.15.6:0/1448887225 learned_addr learned my addr 172.21.15.6:0/1448887225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 -- 172.21.15.6:0/1448887225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 msgr2=0x555c2285a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 --2- 172.21.15.6:0/1448887225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 -- 172.21.15.6:0/1448887225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 msgr2=0x555c2286bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 --2- 172.21.15.6:0/1448887225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c2286bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.445+0000 7fdbad692700 1 -- 172.21.15.6:0/1448887225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555c225d8de0 con 0x555c2285c060 2023-09-13T09:58:25.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.446+0000 7fdbad692700 1 --2- 172.21.15.6:0/1448887225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c22863c40 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009f70 tx=0x7fdba0007420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1de2990017cbdbf4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.446+0000 7fdb937fe700 1 -- 172.21.15.6:0/1448887225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0007e90 con 0x555c2285c060 2023-09-13T09:58:25.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.446+0000 7fdb937fe700 1 -- 172.21.15.6:0/1448887225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdba000f040 con 0x555c2285c060 2023-09-13T09:58:25.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.446+0000 7fdb937fe700 1 -- 172.21.15.6:0/1448887225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba0017410 con 0x555c2285c060 2023-09-13T09:58:25.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/1448887225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 msgr2=0x555c22863c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/1448887225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c22863c40 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fdba0009f70 tx=0x7fdba0007420 comp rx=0 tx=0).stop 2023-09-13T09:58:25.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/1448887225 shutdown_connections 2023-09-13T09:58:25.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/1448887225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285c060 0x555c22863c40 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/1448887225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285aa00 0x555c2285a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/1448887225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c2286bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/1448887225 >> 172.21.15.6:0/1448887225 conn(0x555c227b8c80 msgr2=0x555c22862b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/1448887225 shutdown_connections 2023-09-13T09:58:25.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/1448887225 wait complete. 2023-09-13T09:58:25.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- start start 2023-09-13T09:58:25.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 Processor -- start 2023-09-13T09:58:25.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285aa00 0x555c228bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285c060 0x555c228c71f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c228c7730 con 0x555c2285aa00 2023-09-13T09:58:25.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c228c7870 con 0x555c2285b700 2023-09-13T09:58:25.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x555c228c7a00 con 0x555c2285c060 2023-09-13T09:58:25.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbbb2dab80 10 client.0 _ll_register_callbacks cb 0x555c22748680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.447+0000 7fdbace91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285aa00 0x555c228bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285aa00 0x555c228bfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45708/0 (socket says 172.21.15.6:45708) 2023-09-13T09:58:25.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 -- 172.21.15.6:0/2011678230 learned_addr learned my addr 172.21.15.6:0/2011678230 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbad692700 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285c060 0x555c228c71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 -- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285c060 msgr2=0x555c228c71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285c060 0x555c228c71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 -- 172.21.15.6:0/2011678230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 msgr2=0x555c228c01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 -- 172.21.15.6:0/2011678230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdba0009c20 con 0x555c2285aa00 2023-09-13T09:58:25.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbace91700 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285aa00 0x555c228bfc70 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c005040 tx=0x7fdb9c02dbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1293e78b0e3d63e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdb87fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:25.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdb87fff700 1 -- 172.21.15.6:0/2011678230 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0368a0 con 0x555c2285aa00 2023-09-13T09:58:25.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdb87fff700 1 -- 172.21.15.6:0/2011678230 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdb9c03b030 con 0x555c2285aa00 2023-09-13T09:58:25.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb9409d410 con 0x555c2285aa00 2023-09-13T09:58:25.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdb87fff700 1 -- 172.21.15.6:0/2011678230 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb9c003ab0 con 0x555c2285aa00 2023-09-13T09:58:25.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbbb2dab80 10 client.20427 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x555c225c1c60 con 0x555c2285aa00 2023-09-13T09:58:25.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.448+0000 7fdb87fff700 1 -- 172.21.15.6:0/2011678230 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdb9409d410 con 0x555c2285aa00 2023-09-13T09:58:25.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdb87fff700 1 -- 172.21.15.6:0/2011678230 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fdb9c00f760 con 0x555c2285aa00 2023-09-13T09:58:25.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdbbb2dab80 10 client.20427 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdbbb2dab80 10 client.20427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:58:25.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdbbb2dab80 20 client.20427 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c228c9010 0x555c228cb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdbbb2dab80 4 client.20427 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:25.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x555c22766050 con 0x555c228c9010 2023-09-13T09:58:25.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdba7fff700 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c228c9010 0x555c228cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdb87fff700 10 client.20427 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:25.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.449+0000 7fdba7fff700 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c228c9010 0x555c228cb430 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=47917f4d24348344 server_cookie=a9c3572f0816fbe9 in_seq=0 out_seq=0 2023-09-13T09:58:25.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdb87fff700 1 -- 172.21.15.6:0/2011678230 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x555c22766050 con 0x555c228c9010 2023-09-13T09:58:25.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdb87fff700 10 client.20427 handle_command_reply: tid=0 2023-09-13T09:58:25.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 client.20427 shutdown 2023-09-13T09:58:25.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285aa00 msgr2=0x555c228bfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285aa00 0x555c228bfc70 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c005040 tx=0x7fdb9c02dbf0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 shutdown_connections 2023-09-13T09:58:25.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x555c228c9010 0x555c228cb430 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x555c2285c060 0x555c228c71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x555c2285aa00 0x555c228bfc70 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdb87fff700 0 client.20427 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:25.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 --2- 172.21.15.6:0/2011678230 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x555c2285b700 0x555c228c01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 >> 172.21.15.6:0/2011678230 conn(0x555c227b8c80 msgr2=0x555c2285e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 shutdown_connections 2023-09-13T09:58:25.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 1 -- 172.21.15.6:0/2011678230 wait complete. 2023-09-13T09:58:25.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.450+0000 7fdbbb2dab80 20 client.20427 trim_cache size 0 max 16384 2023-09-13T09:58:25.483 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:25.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb980a0640 msgr2=0x7fdb980a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb980a0640 0x7fdb980a2b00 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009990 tx=0x7fdb9c005fb0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba8100eb0 msgr2=0x7fdba819b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba8100eb0 0x7fdba819b810 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400e9a0 tx=0x7fdb9400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 shutdown_connections 2023-09-13T09:58:25.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdba8101850 0x7fdba819de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdba80ffcc0 0x7fdba8068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdb980a0640 0x7fdb980a2b00 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 --2- 172.21.15.6:0/3744807389 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdba8100eb0 0x7fdba819b810 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 >> 172.21.15.6:0/3744807389 conn(0x7fdba80fb250 msgr2=0x7fdba80fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 shutdown_connections 2023-09-13T09:58:25.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.451+0000 7fdbaf0f5700 1 -- 172.21.15.6:0/3744807389 wait complete. 2023-09-13T09:58:25.487 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:58:25.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:25 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3434349241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:58:25.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:25 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3434349241' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:58:25.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 237537 36.17 MB/sec execute 225 sec latency 77.064 ms 2023-09-13T09:58:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 -- 172.21.15.6:0/2912582420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 msgr2=0x7fc120108f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 --2- 172.21.15.6:0/2912582420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc120108f10 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fc118009990 tx=0x7fc118009ca0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 -- 172.21.15.6:0/2912582420 shutdown_connections 2023-09-13T09:58:25.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 --2- 172.21.15.6:0/2912582420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc120108f10 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 --2- 172.21.15.6:0/2912582420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 0x7fc120103c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 --2- 172.21.15.6:0/2912582420 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc120104170 0x7fc120106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 -- 172.21.15.6:0/2912582420 >> 172.21.15.6:0/2912582420 conn(0x7fc1200fb250 msgr2=0x7fc1200fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 -- 172.21.15.6:0/2912582420 shutdown_connections 2023-09-13T09:58:25.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.664+0000 7fc126546700 1 -- 172.21.15.6:0/2912582420 wait complete. 2023-09-13T09:58:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 Processor -- start 2023-09-13T09:58:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 -- start start 2023-09-13T09:58:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 0x7fc1201011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc120104170 0x7fc1200ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc1200ffd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1201004d0 con 0x7fc120106aa0 2023-09-13T09:58:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc120100640 con 0x7fc120104170 2023-09-13T09:58:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc126546700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1201a0a40 con 0x7fc120101840 2023-09-13T09:58:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc124ae3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc1200ffd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 0x7fc1201011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc120104170 0x7fc1200ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 0x7fc1201011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48776/0 (socket says 172.21.15.6:48776) 2023-09-13T09:58:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc11ffff700 1 -- 172.21.15.6:0/1849559601 learned_addr learned my addr 172.21.15.6:0/1849559601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc124ae3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc1200ffd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45726/0 (socket says 172.21.15.6:45726) 2023-09-13T09:58:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc124ae3700 1 -- 172.21.15.6:0/1849559601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 msgr2=0x7fc1201011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc124ae3700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 0x7fc1201011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc124ae3700 1 -- 172.21.15.6:0/1849559601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc120104170 msgr2=0x7fc1200ff7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc124ae3700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc120104170 0x7fc1200ff7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc124ae3700 1 -- 172.21.15.6:0/1849559601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1180095f0 con 0x7fc120106aa0 2023-09-13T09:58:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.665+0000 7fc11ffff700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 0x7fc1201011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:25.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.666+0000 7fc124ae3700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc1200ffd30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fc11800b680 tx=0x7fc118009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.666+0000 7fc11dffb700 1 -- 172.21.15.6:0/1849559601 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11801d070 con 0x7fc120106aa0 2023-09-13T09:58:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.666+0000 7fc11dffb700 1 -- 172.21.15.6:0/1849559601 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc118021410 con 0x7fc120106aa0 2023-09-13T09:58:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.666+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1201a0cc0 con 0x7fc120106aa0 2023-09-13T09:58:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.666+0000 7fc11dffb700 1 -- 172.21.15.6:0/1849559601 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc118017650 con 0x7fc120106aa0 2023-09-13T09:58:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.666+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1201a10e0 con 0x7fc120106aa0 2023-09-13T09:58:25.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.669+0000 7fc11dffb700 1 -- 172.21.15.6:0/1849559601 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc118021580 con 0x7fc120106aa0 2023-09-13T09:58:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.669+0000 7fc11dffb700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc10c0a0640 0x7fc10c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.669+0000 7fc11dffb700 1 -- 172.21.15.6:0/1849559601 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc1180ccdb0 con 0x7fc120106aa0 2023-09-13T09:58:25.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.669+0000 7fc11ffff700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc10c0a0640 0x7fc10c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 Processor -- start 2023-09-13T09:58:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 -- start start 2023-09-13T09:58:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c58700 0x55b432c58b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c574c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c57e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432bb0780 con 0x55b432c59060 2023-09-13T09:58:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432bae0a0 con 0x55b432c57a00 2023-09-13T09:58:25.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc13272bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432ba9990 con 0x55b432c58700 2023-09-13T09:58:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc11ffff700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc10c0a0640 0x7fc10c0a2b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc110009c10 tx=0x7fc11000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c574c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45732/0 (socket says 172.21.15.6:45732) 2023-09-13T09:58:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 -- 172.21.15.6:0/2855497891 learned_addr learned my addr 172.21.15.6:0/2855497891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc124ae3700 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c57e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc11ffff700 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c58700 0x55b432c58b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 -- 172.21.15.6:0/2855497891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c58700 msgr2=0x55b432c58b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c58700 0x55b432c58b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 -- 172.21.15.6:0/2855497891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 msgr2=0x55b432c57e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c57e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.670+0000 7fc1177fe700 1 -- 172.21.15.6:0/2855497891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b432a29630 con 0x55b432c59060 2023-09-13T09:58:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.671+0000 7fc1177fe700 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c574c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fc108009d80 tx=0x7fc108011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c77ffef02de35b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.671+0000 7fc1167fc700 1 -- 172.21.15.6:0/2855497891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108004230 con 0x55b432c59060 2023-09-13T09:58:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.671+0000 7fc1167fc700 1 -- 172.21.15.6:0/2855497891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc108004390 con 0x55b432c59060 2023-09-13T09:58:25.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.671+0000 7fc1167fc700 1 -- 172.21.15.6:0/2855497891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108019860 con 0x55b432c59060 2023-09-13T09:58:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.671+0000 7fc13272bb80 1 -- 172.21.15.6:0/2855497891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 msgr2=0x55b432c574c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.671+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c574c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7fc108009d80 tx=0x7fc108011720 comp rx=0 tx=0).stop 2023-09-13T09:58:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 -- 172.21.15.6:0/2855497891 shutdown_connections 2023-09-13T09:58:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c57e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c58700 0x55b432c58b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2855497891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c574c0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 -- 172.21.15.6:0/2855497891 >> 172.21.15.6:0/2855497891 conn(0x55b432bb5c80 msgr2=0x55b432c51f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 -- 172.21.15.6:0/2855497891 shutdown_connections 2023-09-13T09:58:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 -- 172.21.15.6:0/2855497891 wait complete. 2023-09-13T09:58:25.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 -- start start 2023-09-13T09:58:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.672+0000 7fc13272bb80 1 Processor -- start 2023-09-13T09:58:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c60ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c58700 0x55b432c61410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c68450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc13272bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432b47bb0 con 0x55b432c59060 2023-09-13T09:58:25.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc13272bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432b478b0 con 0x55b432c58700 2023-09-13T09:58:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc13272bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432a2b920 con 0x55b432c57a00 2023-09-13T09:58:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc13272bb80 10 client.0 _ll_register_callbacks cb 0x55b432b45680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c68450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c60ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c58700 0x55b432c61410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c60ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48790/0 (socket says 172.21.15.6:48790) 2023-09-13T09:58:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c58700 0x55b432c61410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39262/0 (socket says 172.21.15.6:39262) 2023-09-13T09:58:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c68450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45740/0 (socket says 172.21.15.6:45740) 2023-09-13T09:58:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc11ffff700 1 -- 172.21.15.6:0/907657463 learned_addr learned my addr 172.21.15.6:0/907657463 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 -- 172.21.15.6:0/907657463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 msgr2=0x55b432c60ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c60ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 -- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c58700 msgr2=0x55b432c61410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c58700 0x55b432c61410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 -- 172.21.15.6:0/907657463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1080099e0 con 0x55b432c59060 2023-09-13T09:58:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc1177fe700 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c58700 0x55b432c61410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc124ae3700 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c68450 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc1180ca8b0 tx=0x7fc118099f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5822a1d533ab0d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.673+0000 7fc0ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/907657463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11809e220 con 0x55b432c59060 2023-09-13T09:58:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/907657463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc11809e410 con 0x55b432c59060 2023-09-13T09:58:25.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b432c4a670 con 0x55b432c59060 2023-09-13T09:58:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/907657463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc1180a25c0 con 0x55b432c59060 2023-09-13T09:58:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 10 client.20439 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55b432bc17a0 con 0x55b432c59060 2023-09-13T09:58:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/907657463 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc1180b8030 con 0x55b432c59060 2023-09-13T09:58:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/907657463 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc118099ad0 con 0x55b432c59060 2023-09-13T09:58:25.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 10 client.20439 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 10 client.20439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 20 client.20439 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432c6c9d0 0x55b432c6edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 4 client.20439 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:25.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b432ba2970 con 0x55b432c6c9d0 2023-09-13T09:58:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.674+0000 7fc11ffff700 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432c6c9d0 0x55b432c6edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.675+0000 7fc11ffff700 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432c6c9d0 0x55b432c6edf0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2725443162d6899 server_cookie=280ae30f2556fbb5 in_seq=0 out_seq=0 2023-09-13T09:58:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.675+0000 7fc0ff7fe700 10 client.20439 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.677+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/907657463 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b432ba2970 con 0x55b432c6c9d0 2023-09-13T09:58:25.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.677+0000 7fc0ff7fe700 10 client.20439 handle_command_reply: tid=0 2023-09-13T09:58:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.677+0000 7fc13272bb80 1 client.20439 shutdown 2023-09-13T09:58:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 msgr2=0x55b432c68450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c68450 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7fc1180ca8b0 tx=0x7fc118099f40 comp rx=0 tx=0).stop 2023-09-13T09:58:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 shutdown_connections 2023-09-13T09:58:25.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432c6c9d0 0x55b432c6edf0 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c59060 0x55b432c68450 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c60ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc0ff7fe700 0 client.20439 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 --2- 172.21.15.6:0/907657463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c58700 0x55b432c61410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 >> 172.21.15.6:0/907657463 conn(0x55b432bb5c80 msgr2=0x55b432c4c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 shutdown_connections 2023-09-13T09:58:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 1 -- 172.21.15.6:0/907657463 wait complete. 2023-09-13T09:58:25.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.678+0000 7fc13272bb80 20 client.20439 trim_cache size 0 max 16384 2023-09-13T09:58:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 Processor -- start 2023-09-13T09:58:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 -- start start 2023-09-13T09:58:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c574c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c59060 0x55b432c60ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c60a40 con 0x55b432c58700 2023-09-13T09:58:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c5f5e0 con 0x55b432c57a00 2023-09-13T09:58:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc13272bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c53730 con 0x55b432c59060 2023-09-13T09:58:25.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.692+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45746/0 (socket says 172.21.15.6:45746) 2023-09-13T09:58:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 -- 172.21.15.6:0/3185917326 learned_addr learned my addr 172.21.15.6:0/3185917326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc124ae3700 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c59060 0x55b432c60ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 -- 172.21.15.6:0/3185917326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c59060 msgr2=0x55b432c60ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c59060 0x55b432c60ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 -- 172.21.15.6:0/3185917326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 msgr2=0x55b432c574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 -- 172.21.15.6:0/3185917326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b4329d5de0 con 0x55b432c58700 2023-09-13T09:58:25.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc1177fe700 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68410 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc1080097c0 tx=0x7fc108009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e55eedfde15662c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc116ffd700 1 -- 172.21.15.6:0/3185917326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108005240 con 0x55b432c58700 2023-09-13T09:58:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc116ffd700 1 -- 172.21.15.6:0/3185917326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc108003680 con 0x55b432c58700 2023-09-13T09:58:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.693+0000 7fc116ffd700 1 -- 172.21.15.6:0/3185917326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc108004700 con 0x55b432c58700 2023-09-13T09:58:25.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 -- 172.21.15.6:0/3185917326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 msgr2=0x55b432c68410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68410 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7fc1080097c0 tx=0x7fc108009ed0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 -- 172.21.15.6:0/3185917326 shutdown_connections 2023-09-13T09:58:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c59060 0x55b432c60ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c57a00 0x55b432c574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 --2- 172.21.15.6:0/3185917326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68410 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 -- 172.21.15.6:0/3185917326 >> 172.21.15.6:0/3185917326 conn(0x55b432bb5c80 msgr2=0x55b432c5b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 -- 172.21.15.6:0/3185917326 shutdown_connections 2023-09-13T09:58:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.694+0000 7fc13272bb80 1 -- 172.21.15.6:0/3185917326 wait complete. 2023-09-13T09:58:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 -- start start 2023-09-13T09:58:25.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 Processor -- start 2023-09-13T09:58:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c67bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c59060 0x55b432c64690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c64bd0 con 0x55b432c58700 2023-09-13T09:58:25.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c64d40 con 0x55b432c59060 2023-09-13T09:58:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b432c64f00 con 0x55b432c57a00 2023-09-13T09:58:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.695+0000 7fc13272bb80 10 client.0 _ll_register_callbacks cb 0x55b432b45680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc124ae3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c59060 0x55b432c64690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc1177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c67bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c67bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48804/0 (socket says 172.21.15.6:48804) 2023-09-13T09:58:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc124ae3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c59060 0x55b432c64690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39276/0 (socket says 172.21.15.6:39276) 2023-09-13T09:58:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 -- 172.21.15.6:0/2860776245 learned_addr learned my addr 172.21.15.6:0/2860776245 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 -- 172.21.15.6:0/2860776245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c59060 msgr2=0x55b432c64690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c59060 0x55b432c64690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 -- 172.21.15.6:0/2860776245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 msgr2=0x55b432c68130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 -- 172.21.15.6:0/2860776245 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b432a29630 con 0x55b432c57a00 2023-09-13T09:58:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc11ffff700 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c67bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55b432c6f660 tx=0x7fc110004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af7576c853bfb0a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:25.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc0ff7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:58:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/2860776245 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc110025e90 con 0x55b432c57a00 2023-09-13T09:58:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc108004390 con 0x55b432c57a00 2023-09-13T09:58:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.696+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/2860776245 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc11000ee20 con 0x55b432c57a00 2023-09-13T09:58:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/2860776245 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc110015450 con 0x55b432c57a00 2023-09-13T09:58:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 10 client.29647 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:25.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55b4329bec60 con 0x55b432c57a00 2023-09-13T09:58:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/2860776245 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc110041080 con 0x55b432c57a00 2023-09-13T09:58:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/2860776245 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fc110017760 con 0x55b432c57a00 2023-09-13T09:58:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 10 client.29647 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 10 client.29647 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:25.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 20 client.29647 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432cc1d10 0x55b432cc4130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 4 client.29647 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.697+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b432b63050 con 0x55b432cc1d10 2023-09-13T09:58:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.698+0000 7fc1177fe700 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432cc1d10 0x55b432cc4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:25.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.698+0000 7fc0ff7fe700 10 client.29647 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:25.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.698+0000 7fc1177fe700 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432cc1d10 0x55b432cc4130 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=112ca6154fe555fc server_cookie=693d1450ad0ec4f6 in_seq=0 out_seq=0 2023-09-13T09:58:25.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.701+0000 7fc0ff7fe700 1 -- 172.21.15.6:0/2860776245 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b432b63050 con 0x55b432cc1d10 2023-09-13T09:58:25.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.701+0000 7fc0ff7fe700 10 client.29647 handle_command_reply: tid=0 2023-09-13T09:58:25.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.701+0000 7fc13272bb80 1 client.29647 shutdown 2023-09-13T09:58:25.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 msgr2=0x55b432c67bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c67bf0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55b432c6f660 tx=0x7fc110004b40 comp rx=0 tx=0).stop 2023-09-13T09:58:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 shutdown_connections 2023-09-13T09:58:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b432c59060 0x55b432c64690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b432c57a00 0x55b432c67bf0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b432cc1d10 0x55b432cc4130 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 --2- 172.21.15.6:0/2860776245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b432c58700 0x55b432c68130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc0ff7fe700 0 client.29647 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 >> 172.21.15.6:0/2860776245 conn(0x55b432bb5c80 msgr2=0x55b432c60ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 shutdown_connections 2023-09-13T09:58:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 1 -- 172.21.15.6:0/2860776245 wait complete. 2023-09-13T09:58:25.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc13272bb80 20 client.29647 trim_cache size 0 max 16384 2023-09-13T09:58:25.721 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:25.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc10c0a0640 msgr2=0x7fc10c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc126546700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc10c0a0640 0x7fc10c0a2b00 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc110009c10 tx=0x7fc11000b040 comp rx=0 tx=0).stop 2023-09-13T09:58:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 msgr2=0x7fc1200ffd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.702+0000 7fc126546700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc1200ffd30 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7fc11800b680 tx=0x7fc118009580 comp rx=0 tx=0).stop 2023-09-13T09:58:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 shutdown_connections 2023-09-13T09:58:25.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc10c0a0640 0x7fc10c0a2b00 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc120106aa0 0x7fc1200ffd30 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc120101840 0x7fc1201011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 --2- 172.21.15.6:0/1849559601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc120104170 0x7fc1200ff7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 >> 172.21.15.6:0/1849559601 conn(0x7fc1200fb250 msgr2=0x7fc1201024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:25.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 shutdown_connections 2023-09-13T09:58:25.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:25.703+0000 7fc126546700 1 -- 172.21.15.6:0/1849559601 wait complete. 2023-09-13T09:58:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:26 smithi006 ceph-mon[98665]: pgmap v867: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 866 op/s 2023-09-13T09:58:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:26 smithi053 ceph-mon[102373]: pgmap v867: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 866 op/s 2023-09-13T09:58:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:26 smithi131 ceph-mon[102785]: pgmap v867: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 866 op/s 2023-09-13T09:58:26.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 238153 36.10 MB/sec execute 226 sec latency 64.754 ms 2023-09-13T09:58:26.725 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:58:26.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:58:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 -- 172.21.15.6:0/294113948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294101850 msgr2=0x7f4294108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 --2- 172.21.15.6:0/294113948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294101850 0x7f4294108100 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f428c00b0d0 tx=0x7f428c00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 -- 172.21.15.6:0/294113948 shutdown_connections 2023-09-13T09:58:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 --2- 172.21.15.6:0/294113948 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294101850 0x7f4294108100 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 --2- 172.21.15.6:0/294113948 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42940ffcc0 0x7f42941000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 --2- 172.21.15.6:0/294113948 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4294100eb0 0x7f4294101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 -- 172.21.15.6:0/294113948 >> 172.21.15.6:0/294113948 conn(0x7f42940fb250 msgr2=0x7f42940fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:26.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 -- 172.21.15.6:0/294113948 shutdown_connections 2023-09-13T09:58:26.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.881+0000 7f4298f2e700 1 -- 172.21.15.6:0/294113948 wait complete. 2023-09-13T09:58:26.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 Processor -- start 2023-09-13T09:58:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 -- start start 2023-09-13T09:58:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42940ffcc0 0x7f4294068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294100eb0 0x7f429419b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4294101850 0x7f429419dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429419e680 con 0x7f4294100eb0 2023-09-13T09:58:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429419e7f0 con 0x7f42940ffcc0 2023-09-13T09:58:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4298f2e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429419e9b0 con 0x7f4294101850 2023-09-13T09:58:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294100eb0 0x7f429419b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f429259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42940ffcc0 0x7f4294068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294100eb0 0x7f429419b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45766/0 (socket says 172.21.15.6:45766) 2023-09-13T09:58:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4291d9b700 1 -- 172.21.15.6:0/3522185327 learned_addr learned my addr 172.21.15.6:0/3522185327 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.882+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4294101850 0x7f429419dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4291d9b700 1 -- 172.21.15.6:0/3522185327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4294101850 msgr2=0x7f429419dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4291d9b700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4294101850 0x7f429419dee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4291d9b700 1 -- 172.21.15.6:0/3522185327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42940ffcc0 msgr2=0x7f4294068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4291d9b700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42940ffcc0 0x7f4294068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4291d9b700 1 -- 172.21.15.6:0/3522185327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c009d00 con 0x7f4294100eb0 2023-09-13T09:58:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f429259c700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42940ffcc0 0x7f4294068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4291d9b700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294100eb0 0x7f429419b8a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f428800e9a0 tx=0x7f428800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f42837fe700 1 -- 172.21.15.6:0/3522185327 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288009790 con 0x7f4294100eb0 2023-09-13T09:58:26.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429419ec90 con 0x7f4294100eb0 2023-09-13T09:58:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f42837fe700 1 -- 172.21.15.6:0/3522185327 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4288010430 con 0x7f4294100eb0 2023-09-13T09:58:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f42837fe700 1 -- 172.21.15.6:0/3522185327 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288018680 con 0x7f4294100eb0 2023-09-13T09:58:26.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.883+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429419f1a0 con 0x7f4294100eb0 2023-09-13T09:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.886+0000 7f42837fe700 1 -- 172.21.15.6:0/3522185327 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f42880105a0 con 0x7f4294100eb0 2023-09-13T09:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.886+0000 7f42837fe700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f427c0a0670 0x7f427c0a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.887+0000 7f42837fe700 1 -- 172.21.15.6:0/3522185327 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4288014070 con 0x7f4294100eb0 2023-09-13T09:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.887+0000 7f429259c700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f427c0a0670 0x7f427c0a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.887+0000 7f429259c700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f427c0a0670 0x7f427c0a2b30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4294100d10 tx=0x7f4284009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.887+0000 7f42a5113b80 1 Processor -- start 2023-09-13T09:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f42a5113b80 1 -- start start 2023-09-13T09:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ed8780 0x558730ed8ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed90e0 0x558730ed7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ed7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f42a5113b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730e30800 con 0x558730ed8780 2023-09-13T09:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f42a5113b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730e2e120 con 0x558730ed90e0 2023-09-13T09:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f42a5113b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730e29a10 con 0x558730ed7a80 2023-09-13T09:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed90e0 0x558730ed7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed90e0 0x558730ed7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39298/0 (socket says 172.21.15.6:39298) 2023-09-13T09:58:26.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f4291d9b700 1 -- 172.21.15.6:0/526383231 learned_addr learned my addr 172.21.15.6:0/526383231 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:26.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f4292d9d700 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ed7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.888+0000 7f429259c700 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ed8780 0x558730ed8ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4291d9b700 1 -- 172.21.15.6:0/526383231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 msgr2=0x558730ed7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4291d9b700 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ed7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4291d9b700 1 -- 172.21.15.6:0/526383231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ed8780 msgr2=0x558730ed8ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4291d9b700 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ed8780 0x558730ed8ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4291d9b700 1 -- 172.21.15.6:0/526383231 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558730ca96b0 con 0x558730ed90e0 2023-09-13T09:58:26.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4291d9b700 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed90e0 0x558730ed7540 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4288095a10 tx=0x7f4288099410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3968b4292c760eaf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:26.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4280ff9700 1 -- 172.21.15.6:0/526383231 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428809d170 con 0x558730ed90e0 2023-09-13T09:58:26.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4280ff9700 1 -- 172.21.15.6:0/526383231 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4288099510 con 0x558730ed90e0 2023-09-13T09:58:26.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.889+0000 7f4280ff9700 1 -- 172.21.15.6:0/526383231 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4288098a00 con 0x558730ed90e0 2023-09-13T09:58:26.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.890+0000 7f42a5113b80 1 -- 172.21.15.6:0/526383231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed90e0 msgr2=0x558730ed7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.890+0000 7f42a5113b80 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed90e0 0x558730ed7540 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4288095a10 tx=0x7f4288099410 comp rx=0 tx=0).stop 2023-09-13T09:58:26.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.890+0000 7f42a5113b80 1 -- 172.21.15.6:0/526383231 shutdown_connections 2023-09-13T09:58:26.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.890+0000 7f42a5113b80 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ed7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.890+0000 7f42a5113b80 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ed8780 0x558730ed8ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.890+0000 7f42a5113b80 1 --2- 172.21.15.6:0/526383231 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed90e0 0x558730ed7540 secure :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4288095a10 tx=0x7f4288099410 comp rx=0 tx=0).stop 2023-09-13T09:58:26.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.890+0000 7f42a5113b80 1 -- 172.21.15.6:0/526383231 >> 172.21.15.6:0/526383231 conn(0x558730e35d00 msgr2=0x558730ed1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:26.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.891+0000 7f42a5113b80 1 -- 172.21.15.6:0/526383231 shutdown_connections 2023-09-13T09:58:26.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.891+0000 7f42a5113b80 1 -- 172.21.15.6:0/526383231 wait complete. 2023-09-13T09:58:26.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.891+0000 7f42a5113b80 1 -- start start 2023-09-13T09:58:26.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.891+0000 7f42a5113b80 1 Processor -- start 2023-09-13T09:58:26.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ee46d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed8780 0x558730ee4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730ee1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f42a5113b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730dc7c30 con 0x558730ee11c0 2023-09-13T09:58:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f42a5113b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730dc7930 con 0x558730ed8780 2023-09-13T09:58:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f42a5113b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730cab9a0 con 0x558730ed7a80 2023-09-13T09:58:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f42a5113b80 10 client.0 _ll_register_callbacks cb 0x558730dc5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f429259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ee46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f429259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ee46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48836/0 (socket says 172.21.15.6:48836) 2023-09-13T09:58:26.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f4292d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730ee1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f429259c700 1 -- 172.21.15.6:0/3320351297 learned_addr learned my addr 172.21.15.6:0/3320351297 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:26.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.892+0000 7f4291d9b700 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed8780 0x558730ee4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4292d9d700 1 -- 172.21.15.6:0/3320351297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 msgr2=0x558730ee46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ee46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4292d9d700 1 -- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed8780 msgr2=0x558730ee4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed8780 0x558730ee4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4292d9d700 1 -- 172.21.15.6:0/3320351297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429419f1a0 con 0x558730ee11c0 2023-09-13T09:58:26.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4291d9b700 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed8780 0x558730ee4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:58:26.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730ee1640 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f428c007a30 tx=0x7f428c007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505d09e7d6f7ee18 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:26.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4279ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:26.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4279ffb700 1 -- 172.21.15.6:0/3320351297 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00e040 con 0x558730ee11c0 2023-09-13T09:58:26.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4279ffb700 1 -- 172.21.15.6:0/3320351297 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f428c004a90 con 0x558730ee11c0 2023-09-13T09:58:26.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558730eca6f0 con 0x558730ee11c0 2023-09-13T09:58:26.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f4279ffb700 1 -- 172.21.15.6:0/3320351297 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f428c009b80 con 0x558730ee11c0 2023-09-13T09:58:26.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f42a5113b80 10 client.20457 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.893+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x558730e41820 con 0x558730ee11c0 2023-09-13T09:58:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f4279ffb700 1 -- 172.21.15.6:0/3320351297 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558730eca6f0 con 0x558730ee11c0 2023-09-13T09:58:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f4279ffb700 1 -- 172.21.15.6:0/3320351297 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f428c00b100 con 0x558730ee11c0 2023-09-13T09:58:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f42a5113b80 10 client.20457 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:26.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f42a5113b80 10 client.20457 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f42a5113b80 20 client.20457 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730ee93f0 0x558730eeb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f42a5113b80 4 client.20457 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:26.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558730e229f0 con 0x558730ee93f0 2023-09-13T09:58:26.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.894+0000 7f429259c700 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730ee93f0 0x558730eeb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.895+0000 7f429259c700 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730ee93f0 0x558730eeb810 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15e54393a5da5b3f server_cookie=b547d10426ba3e4b in_seq=0 out_seq=0 2023-09-13T09:58:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.895+0000 7f4279ffb700 10 client.20457 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:26.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f4279ffb700 1 -- 172.21.15.6:0/3320351297 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558730e229f0 con 0x558730ee93f0 2023-09-13T09:58:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f4279ffb700 10 client.20457 handle_command_reply: tid=0 2023-09-13T09:58:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f42a5113b80 1 client.20457 shutdown 2023-09-13T09:58:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 msgr2=0x558730ee1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730ee1640 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f428c007a30 tx=0x7f428c007950 comp rx=0 tx=0).stop 2023-09-13T09:58:26.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 shutdown_connections 2023-09-13T09:58:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730ee93f0 0x558730eeb810 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.899+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730ee1640 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.900+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed7a80 0x558730ee46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.900+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3320351297 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed8780 0x558730ee4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.900+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 >> 172.21.15.6:0/3320351297 conn(0x558730e35d00 msgr2=0x558730ecc870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:26.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.900+0000 7f4279ffb700 0 client.20457 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.900+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 shutdown_connections 2023-09-13T09:58:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.900+0000 7f42a5113b80 1 -- 172.21.15.6:0/3320351297 wait complete. 2023-09-13T09:58:26.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.900+0000 7f42a5113b80 20 client.20457 trim_cache size 0 max 16384 2023-09-13T09:58:26.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.921+0000 7f42a5113b80 1 Processor -- start 2023-09-13T09:58:26.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f42a5113b80 1 -- start start 2023-09-13T09:58:26.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ed7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730edbb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730edc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f42a5113b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730ed3280 con 0x558730ee11c0 2023-09-13T09:58:26.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f42a5113b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730ece9b0 con 0x558730ed7a80 2023-09-13T09:58:26.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f42a5113b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730ee06a0 con 0x558730ed8780 2023-09-13T09:58:26.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4292d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730edc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730edbb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f429259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ed7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f429259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ed7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39310/0 (socket says 172.21.15.6:39310) 2023-09-13T09:58:26.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730edbb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48842/0 (socket says 172.21.15.6:48842) 2023-09-13T09:58:26.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f429259c700 1 -- 172.21.15.6:0/3324219172 learned_addr learned my addr 172.21.15.6:0/3324219172 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:26.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4292d9d700 1 -- 172.21.15.6:0/3324219172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 msgr2=0x558730edbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3324219172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730edbb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4292d9d700 1 -- 172.21.15.6:0/3324219172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 msgr2=0x558730ed7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3324219172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ed7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4292d9d700 1 -- 172.21.15.6:0/3324219172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558730c55e60 con 0x558730ee11c0 2023-09-13T09:58:26.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.922+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3324219172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730edc0c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f428c026e90 tx=0x7f428c009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2835aab295dd5ba4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:26.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42817fa700 1 -- 172.21.15.6:0/3324219172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00b2b0 con 0x558730ee11c0 2023-09-13T09:58:26.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42817fa700 1 -- 172.21.15.6:0/3324219172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f428c02b020 con 0x558730ee11c0 2023-09-13T09:58:26.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42817fa700 1 -- 172.21.15.6:0/3324219172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c0056d0 con 0x558730ee11c0 2023-09-13T09:58:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42a5113b80 1 -- 172.21.15.6:0/3324219172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 msgr2=0x558730edc0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3324219172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730edc0c0 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7f428c026e90 tx=0x7f428c009650 comp rx=0 tx=0).stop 2023-09-13T09:58:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42a5113b80 1 -- 172.21.15.6:0/3324219172 shutdown_connections 2023-09-13T09:58:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3324219172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730edc0c0 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3324219172 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ed7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3324219172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730edbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.923+0000 7f42a5113b80 1 -- 172.21.15.6:0/3324219172 >> 172.21.15.6:0/3324219172 conn(0x558730e35d00 msgr2=0x558730edfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 -- 172.21.15.6:0/3324219172 shutdown_connections 2023-09-13T09:58:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 -- 172.21.15.6:0/3324219172 wait complete. 2023-09-13T09:58:26.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 -- start start 2023-09-13T09:58:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 Processor -- start 2023-09-13T09:58:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ef12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730eef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730eefe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730ef03f0 con 0x558730ee11c0 2023-09-13T09:58:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730ef0560 con 0x558730ed7a80 2023-09-13T09:58:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558730ef0720 con 0x558730ed8780 2023-09-13T09:58:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f42a5113b80 10 client.0 _ll_register_callbacks cb 0x558730dc5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f4292d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730eefe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730eef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f429259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ef12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f429259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ef12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39316/0 (socket says 172.21.15.6:39316) 2023-09-13T09:58:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f4291d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730eef8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48848/0 (socket says 172.21.15.6:48848) 2023-09-13T09:58:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.924+0000 7f429259c700 1 -- 172.21.15.6:0/3089590550 learned_addr learned my addr 172.21.15.6:0/3089590550 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4292d9d700 1 -- 172.21.15.6:0/3089590550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 msgr2=0x558730eef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730eef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4292d9d700 1 -- 172.21.15.6:0/3089590550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 msgr2=0x558730ef12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ef12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4292d9d700 1 -- 172.21.15.6:0/3089590550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558730e41820 con 0x558730ee11c0 2023-09-13T09:58:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4292d9d700 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730eefe20 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f428c0061e0 tx=0x7f428c005380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fe290ca2796e2fd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:26.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4279ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4279ffb700 1 -- 172.21.15.6:0/3089590550 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f428c00e030 con 0x558730ee11c0 2023-09-13T09:58:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4279ffb700 1 -- 172.21.15.6:0/3089590550 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f428c02c030 con 0x558730ee11c0 2023-09-13T09:58:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4288099510 con 0x558730ee11c0 2023-09-13T09:58:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4279ffb700 1 -- 172.21.15.6:0/3089590550 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f428c003a00 con 0x558730ee11c0 2023-09-13T09:58:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f42a5113b80 10 client.20463 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:26.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x558730c3ece0 con 0x558730ee11c0 2023-09-13T09:58:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4279ffb700 1 -- 172.21.15.6:0/3089590550 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4288099510 con 0x558730ee11c0 2023-09-13T09:58:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.925+0000 7f4279ffb700 1 -- 172.21.15.6:0/3089590550 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f428c026580 con 0x558730ee11c0 2023-09-13T09:58:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.926+0000 7f42a5113b80 10 client.20463 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.926+0000 7f42a5113b80 10 client.20463 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:26.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.926+0000 7f42a5113b80 20 client.20463 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.926+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730f52f10 0x558730f55330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.926+0000 7f42a5113b80 4 client.20463 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:58:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.926+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558730de30d0 con 0x558730f52f10 2023-09-13T09:58:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.929+0000 7f429259c700 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730f52f10 0x558730f55330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:26.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.930+0000 7f429259c700 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730f52f10 0x558730f55330 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ec47e75b183b3cb server_cookie=20038e0692b50584 in_seq=0 out_seq=0 2023-09-13T09:58:26.940 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.930+0000 7f4279ffb700 10 client.20463 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f4279ffb700 1 -- 172.21.15.6:0/3089590550 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558730de30d0 con 0x558730f52f10 2023-09-13T09:58:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f4279ffb700 10 client.20463 handle_command_reply: tid=0 2023-09-13T09:58:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 client.20463 shutdown 2023-09-13T09:58:26.941 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 msgr2=0x558730eefe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730eefe20 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f428c0061e0 tx=0x7f428c005380 comp rx=0 tx=0).stop 2023-09-13T09:58:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 shutdown_connections 2023-09-13T09:58:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558730f52f10 0x558730f55330 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558730ee11c0 0x558730eefe20 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.942 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558730ed7a80 0x558730ef12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f4279ffb700 0 client.20463 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 --2- 172.21.15.6:0/3089590550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558730ed8780 0x558730eef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 >> 172.21.15.6:0/3089590550 conn(0x558730e35d00 msgr2=0x558730edbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 shutdown_connections 2023-09-13T09:58:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 1 -- 172.21.15.6:0/3089590550 wait complete. 2023-09-13T09:58:26.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.933+0000 7f42a5113b80 20 client.20463 trim_cache size 0 max 16384 2023-09-13T09:58:26.944 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:58:26.944 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:58:26.944 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "6998b4ee-7a23-488d-9065-a786c50363e5", 2023-09-13T09:58:26.944 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:58:26.945 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:58:26.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f427c0a0670 msgr2=0x7f427c0a2b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f427c0a0670 0x7f427c0a2b30 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f4294100d10 tx=0x7f4284009260 comp rx=0 tx=0).stop 2023-09-13T09:58:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294100eb0 msgr2=0x7f429419b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294100eb0 0x7f429419b8a0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f428800e9a0 tx=0x7f428800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 shutdown_connections 2023-09-13T09:58:26.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4294101850 0x7f429419dee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f42940ffcc0 0x7f4294068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f427c0a0670 0x7f427c0a2b30 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 --2- 172.21.15.6:0/3522185327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4294100eb0 0x7f429419b8a0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 >> 172.21.15.6:0/3522185327 conn(0x7f42940fb250 msgr2=0x7f42941042a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:26.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 shutdown_connections 2023-09-13T09:58:26.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:26.934+0000 7f4298f2e700 1 -- 172.21.15.6:0/3522185327 wait complete. 2023-09-13T09:58:26.950 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:58:27.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 -- 172.21.15.6:0/2054377993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318100e70 msgr2=0x7f43181012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 --2- 172.21.15.6:0/2054377993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318100e70 0x7f43181012d0 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f430c0099c0 tx=0x7f430c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 -- 172.21.15.6:0/2054377993 shutdown_connections 2023-09-13T09:58:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 --2- 172.21.15.6:0/2054377993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4318101810 0x7f43181080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 --2- 172.21.15.6:0/2054377993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f43180ffc80 0x7f43181000a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 --2- 172.21.15.6:0/2054377993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4318100e70 0x7f43181012d0 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 -- 172.21.15.6:0/2054377993 >> 172.21.15.6:0/2054377993 conn(0x7f43180fb1d0 msgr2=0x7f43180fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 -- 172.21.15.6:0/2054377993 shutdown_connections 2023-09-13T09:58:27.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 -- 172.21.15.6:0/2054377993 wait complete. 2023-09-13T09:58:27.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.104+0000 7f431dfc5700 1 Processor -- start 2023-09-13T09:58:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f431dfc5700 1 -- start start 2023-09-13T09:58:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f431dfc5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43180ffc80 0x7f4318103c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f431dfc5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4318100e70 0x7f4318102250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f431dfc5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4318101810 0x7f4318102790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f431dfc5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4318102f30 con 0x7f43180ffc80 2023-09-13T09:58:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f431dfc5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43181030a0 con 0x7f4318100e70 2023-09-13T09:58:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f431dfc5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43181a0aa0 con 0x7f4318101810 2023-09-13T09:58:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43180ffc80 0x7f4318103c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43180ffc80 0x7f4318103c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45806/0 (socket says 172.21.15.6:45806) 2023-09-13T09:58:27.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 -- 172.21.15.6:0/1014096311 learned_addr learned my addr 172.21.15.6:0/1014096311 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f4316ffd700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4318100e70 0x7f4318102250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 -- 172.21.15.6:0/1014096311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4318101810 msgr2=0x7f4318102790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T09:58:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4318101810 0x7f4318102790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 -- 172.21.15.6:0/1014096311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4318100e70 msgr2=0x7f4318102250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4318100e70 0x7f4318102250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.105+0000 7f43177fe700 1 -- 172.21.15.6:0/1014096311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f430c0095f0 con 0x7f43180ffc80 2023-09-13T09:58:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.106+0000 7f43177fe700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43180ffc80 0x7f4318103c10 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f430800e970 tx=0x7f430800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.106+0000 7f4314ff9700 1 -- 172.21.15.6:0/1014096311 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430800cbd0 con 0x7f43180ffc80 2023-09-13T09:58:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.106+0000 7f4314ff9700 1 -- 172.21.15.6:0/1014096311 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f430800eec0 con 0x7f43180ffc80 2023-09-13T09:58:27.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.106+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43181a0d80 con 0x7f43180ffc80 2023-09-13T09:58:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.106+0000 7f4314ff9700 1 -- 172.21.15.6:0/1014096311 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308003d10 con 0x7f43180ffc80 2023-09-13T09:58:27.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.106+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43181a1280 con 0x7f43180ffc80 2023-09-13T09:58:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.109+0000 7f4314ff9700 1 -- 172.21.15.6:0/1014096311 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f430800cd30 con 0x7f43180ffc80 2023-09-13T09:58:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 Processor -- start 2023-09-13T09:58:27.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 -- start start 2023-09-13T09:58:27.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f4314ff9700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43000a06c0 0x7f43000a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a7353330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a7351cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a7352690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a72a2780 con 0x55a1a7352210 2023-09-13T09:58:27.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a72a00a0 con 0x55a1a7352f10 2023-09-13T09:58:27.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f432a1aab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a729b990 con 0x55a1a7353870 2023-09-13T09:58:27.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f4317fff700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43000a06c0 0x7f43000a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f4314ff9700 1 -- 172.21.15.6:0/1014096311 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4308014070 con 0x7f43180ffc80 2023-09-13T09:58:27.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f4316ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a7351cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f4316ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a7351cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48868/0 (socket says 172.21.15.6:48868) 2023-09-13T09:58:27.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4316ffd700 1 -- 172.21.15.6:0/1711899010 learned_addr learned my addr 172.21.15.6:0/1711899010 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:27.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4317fff700 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a7352690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.110+0000 7f43177fe700 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a7353330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4316ffd700 1 -- 172.21.15.6:0/1711899010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 msgr2=0x55a1a7353330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:27.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4316ffd700 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a7353330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4316ffd700 1 -- 172.21.15.6:0/1711899010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 msgr2=0x55a1a7352690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:27.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4316ffd700 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a7352690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4316ffd700 1 -- 172.21.15.6:0/1711899010 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1a711b630 con 0x55a1a7353870 2023-09-13T09:58:27.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f43177fe700 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a7353330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:27.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4317fff700 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a7352690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:27.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4317fff700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43000a06c0 0x7f43000a2b80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4310009690 tx=0x7f43100091f0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:27.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f4316ffd700 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a7351cd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f430c0099c0 tx=0x7f430c005ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13c5ab0d5dabb056 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:27.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.111+0000 7f42fdffb700 1 -- 172.21.15.6:0/1711899010 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c00ba10 con 0x55a1a7353870 2023-09-13T09:58:27.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f42fdffb700 1 -- 172.21.15.6:0/1711899010 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f430c01e040 con 0x55a1a7353870 2023-09-13T09:58:27.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f42fdffb700 1 -- 172.21.15.6:0/1711899010 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c0039f0 con 0x55a1a7353870 2023-09-13T09:58:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 -- 172.21.15.6:0/1711899010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 msgr2=0x55a1a7351cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a7351cd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f430c0099c0 tx=0x7f430c005ee0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 -- 172.21.15.6:0/1711899010 shutdown_connections 2023-09-13T09:58:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a7352690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a7353330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1711899010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a7351cd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 -- 172.21.15.6:0/1711899010 >> 172.21.15.6:0/1711899010 conn(0x55a1a72a7c80 msgr2=0x55a1a7343f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 -- 172.21.15.6:0/1711899010 shutdown_connections 2023-09-13T09:58:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.112+0000 7f432a1aab80 1 -- 172.21.15.6:0/1711899010 wait complete. 2023-09-13T09:58:27.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 -- start start 2023-09-13T09:58:27.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 Processor -- start 2023-09-13T09:58:27.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352210 0x55a1a735b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a735bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7353870 0x55a1a7362c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a7239bb0 con 0x55a1a7353870 2023-09-13T09:58:27.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a72398b0 con 0x55a1a7352f10 2023-09-13T09:58:27.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a711d920 con 0x55a1a7352210 2023-09-13T09:58:27.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f432a1aab80 10 client.0 _ll_register_callbacks cb 0x55a1a7237680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:27.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.113+0000 7f43177fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352210 0x55a1a735b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f4317fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7353870 0x55a1a7362c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f43177fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352210 0x55a1a735b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48874/0 (socket says 172.21.15.6:48874) 2023-09-13T09:58:27.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f43177fe700 1 -- 172.21.15.6:0/1465289473 learned_addr learned my addr 172.21.15.6:0/1465289473 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:27.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f4317fff700 1 -- 172.21.15.6:0/1465289473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352210 msgr2=0x55a1a735b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:27.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f4317fff700 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352210 0x55a1a735b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f4317fff700 1 -- 172.21.15.6:0/1465289473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 msgr2=0x55a1a735bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:27.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f4317fff700 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a735bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f4317fff700 1 -- 172.21.15.6:0/1465289473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4318108a10 con 0x55a1a7353870 2023-09-13T09:58:27.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f4317fff700 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7353870 0x55a1a7362c30 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f4318104270 tx=0x7f4310009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db56509c9256e25 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:27.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f42f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:27.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f42f6ffd700 1 -- 172.21.15.6:0/1465289473 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4310004db0 con 0x55a1a7353870 2023-09-13T09:58:27.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1a733c670 con 0x55a1a7353870 2023-09-13T09:58:27.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f42f6ffd700 1 -- 172.21.15.6:0/1465289473 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4310003a00 con 0x55a1a7353870 2023-09-13T09:58:27.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f42f6ffd700 1 -- 172.21.15.6:0/1465289473 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4310003bc0 con 0x55a1a7353870 2023-09-13T09:58:27.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f432a1aab80 10 client.20475 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:27.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.114+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55a1a72b37a0 con 0x55a1a7353870 2023-09-13T09:58:27.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f42f6ffd700 1 -- 172.21.15.6:0/1465289473 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a1a733c670 con 0x55a1a7353870 2023-09-13T09:58:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f42f6ffd700 1 -- 172.21.15.6:0/1465289473 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4310004390 con 0x55a1a7353870 2023-09-13T09:58:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f432a1aab80 10 client.20475 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f432a1aab80 10 client.20475 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f432a1aab80 20 client.20475 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:27.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73674d0 0x55a1a73698f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f432a1aab80 4 client.20475 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:27.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.115+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1a7294970 con 0x55a1a73674d0 2023-09-13T09:58:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.124+0000 7f43177fe700 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73674d0 0x55a1a73698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.125+0000 7f42f6ffd700 10 client.20475 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.125+0000 7f43177fe700 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73674d0 0x55a1a73698f0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=253777b8244c6ca9 server_cookie=f5fd8929d87df29a in_seq=0 out_seq=0 2023-09-13T09:58:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f42f6ffd700 1 -- 172.21.15.6:0/1465289473 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a1a7294970 con 0x55a1a73674d0 2023-09-13T09:58:27.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f42f6ffd700 10 client.20475 handle_command_reply: tid=0 2023-09-13T09:58:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 client.20475 shutdown 2023-09-13T09:58:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7353870 msgr2=0x55a1a7362c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7353870 0x55a1a7362c30 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f4318104270 tx=0x7f4310009920 comp rx=0 tx=0).stop 2023-09-13T09:58:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 shutdown_connections 2023-09-13T09:58:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73674d0 0x55a1a73698f0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7353870 0x55a1a7362c30 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352210 0x55a1a735b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 --2- 172.21.15.6:0/1465289473 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352f10 0x55a1a735bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 >> 172.21.15.6:0/1465289473 conn(0x55a1a72a7c80 msgr2=0x55a1a733e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:27.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f42f6ffd700 0 client.20475 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:27.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 shutdown_connections 2023-09-13T09:58:27.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 1 -- 172.21.15.6:0/1465289473 wait complete. 2023-09-13T09:58:27.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.132+0000 7f432a1aab80 20 client.20475 trim_cache size 0 max 16384 2023-09-13T09:58:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 Processor -- start 2023-09-13T09:58:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 -- start start 2023-09-13T09:58:27.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352210 0x55a1a7351cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352f10 0x55a1a7362b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a73560f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a72949a0 con 0x55a1a7352f10 2023-09-13T09:58:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a735ab90 con 0x55a1a7352210 2023-09-13T09:58:27.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f432a1aab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a7345730 con 0x55a1a7353870 2023-09-13T09:58:27.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.154+0000 7f4316ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352f10 0x55a1a7362b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352f10 0x55a1a7362b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45826/0 (socket says 172.21.15.6:45826) 2023-09-13T09:58:27.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 -- 172.21.15.6:0/45259528 learned_addr learned my addr 172.21.15.6:0/45259528 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:27.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4317fff700 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a73560f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f43177fe700 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352210 0x55a1a7351cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 -- 172.21.15.6:0/45259528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 msgr2=0x55a1a73560f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a73560f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 -- 172.21.15.6:0/45259528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352210 msgr2=0x55a1a7351cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352210 0x55a1a7351cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 -- 172.21.15.6:0/45259528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1a736e560 con 0x55a1a7352f10 2023-09-13T09:58:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f4316ffd700 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352f10 0x55a1a7362b50 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f430c0098e0 tx=0x7f430c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54bfdb682cbd0197 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f42fe7fc700 1 -- 172.21.15.6:0/45259528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c00ba10 con 0x55a1a7352f10 2023-09-13T09:58:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f42fe7fc700 1 -- 172.21.15.6:0/45259528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f430c005940 con 0x55a1a7352f10 2023-09-13T09:58:27.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.155+0000 7f42fe7fc700 1 -- 172.21.15.6:0/45259528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430c003d00 con 0x55a1a7352f10 2023-09-13T09:58:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 -- 172.21.15.6:0/45259528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352f10 msgr2=0x55a1a7362b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352f10 0x55a1a7362b50 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f430c0098e0 tx=0x7f430c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 -- 172.21.15.6:0/45259528 shutdown_connections 2023-09-13T09:58:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7353870 0x55a1a73560f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7352210 0x55a1a7351cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 --2- 172.21.15.6:0/45259528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352f10 0x55a1a7362b50 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 -- 172.21.15.6:0/45259528 >> 172.21.15.6:0/45259528 conn(0x55a1a72a7c80 msgr2=0x55a1a7359590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:27.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 -- 172.21.15.6:0/45259528 shutdown_connections 2023-09-13T09:58:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.156+0000 7f432a1aab80 1 -- 172.21.15.6:0/45259528 wait complete. 2023-09-13T09:58:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 -- start start 2023-09-13T09:58:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 Processor -- start 2023-09-13T09:58:27.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a735e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352f10 0x55a1a735ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7353870 0x55a1a7361be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a7362120 con 0x55a1a7352210 2023-09-13T09:58:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a7362290 con 0x55a1a7353870 2023-09-13T09:58:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a7362450 con 0x55a1a7352f10 2023-09-13T09:58:27.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.157+0000 7f432a1aab80 10 client.0 _ll_register_callbacks cb 0x55a1a7344570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a735e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f4317fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7353870 0x55a1a7361be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a735e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45832/0 (socket says 172.21.15.6:45832) 2023-09-13T09:58:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 -- 172.21.15.6:0/985283792 learned_addr learned my addr 172.21.15.6:0/985283792 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:27.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 -- 172.21.15.6:0/985283792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352f10 msgr2=0x55a1a735ebc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:58:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352f10 0x55a1a735ebc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 -- 172.21.15.6:0/985283792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7353870 msgr2=0x55a1a7361be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7353870 0x55a1a7361be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 -- 172.21.15.6:0/985283792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a1a711b630 con 0x55a1a7352210 2023-09-13T09:58:27.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f43177fe700 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a735e680 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f4308005950 tx=0x7f43080097d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8930bb8f1812bc9a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:27.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f42f6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:27.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f42f6ffd700 1 -- 172.21.15.6:0/985283792 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4308095040 con 0x55a1a7352210 2023-09-13T09:58:27.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f42f6ffd700 1 -- 172.21.15.6:0/985283792 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f43080ace40 con 0x55a1a7352210 2023-09-13T09:58:27.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.158+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f430c01e040 con 0x55a1a7352210 2023-09-13T09:58:27.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f42f6ffd700 1 -- 172.21.15.6:0/985283792 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f430809d350 con 0x55a1a7352210 2023-09-13T09:58:27.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 10 client.20481 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:27.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55a1a70c7de0 con 0x55a1a7352210 2023-09-13T09:58:27.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f42f6ffd700 1 -- 172.21.15.6:0/985283792 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f430c01e040 con 0x55a1a7352210 2023-09-13T09:58:27.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f42f6ffd700 1 -- 172.21.15.6:0/985283792 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f430809a530 con 0x55a1a7352210 2023-09-13T09:58:27.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 10 client.20481 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:27.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 10 client.20481 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:27.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 20 client.20481 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:27.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73bc1d0 0x55a1a73be5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:27.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 4 client.20481 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:58:27.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a1a7255050 con 0x55a1a73bc1d0 2023-09-13T09:58:27.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.159+0000 7f4316ffd700 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73bc1d0 0x55a1a73be5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:27.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.160+0000 7f42f6ffd700 10 client.20481 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:27.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.160+0000 7f4316ffd700 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73bc1d0 0x55a1a73be5f0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56dbb62489b8b3be server_cookie=36e8d6cf053ac075 in_seq=0 out_seq=0 2023-09-13T09:58:27.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f42f6ffd700 1 -- 172.21.15.6:0/985283792 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55a1a7255050 con 0x55a1a73bc1d0 2023-09-13T09:58:27.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f42f6ffd700 10 client.20481 handle_command_reply: tid=0 2023-09-13T09:58:27.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 client.20481 shutdown 2023-09-13T09:58:27.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 msgr2=0x55a1a735e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a735e680 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f4308005950 tx=0x7f43080097d0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 shutdown_connections 2023-09-13T09:58:27.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a1a7353870 0x55a1a7361be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a1a73bc1d0 0x55a1a73be5f0 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a1a7352210 0x55a1a735e680 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 --2- 172.21.15.6:0/985283792 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a1a7352f10 0x55a1a735ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f42f6ffd700 0 client.20481 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:27.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 >> 172.21.15.6:0/985283792 conn(0x55a1a72a7c80 msgr2=0x55a1a73560f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:27.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 shutdown_connections 2023-09-13T09:58:27.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 1 -- 172.21.15.6:0/985283792 wait complete. 2023-09-13T09:58:27.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.162+0000 7f432a1aab80 20 client.20481 trim_cache size 0 max 16384 2023-09-13T09:58:27.177 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:58:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (0 inodes in the stack)", 2023-09-13T09:58:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:58:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "6998b4ee-7a23-488d-9065-a786c50363e5": { 2023-09-13T09:58:27.177 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:58:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "6998b4ee-7a23-488d-9065-a786c50363e5", 2023-09-13T09:58:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:58:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:58:27.178 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:58:27.178 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:58:27.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43000a06c0 msgr2=0x7f43000a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43000a06c0 0x7f43000a2b80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f4310009690 tx=0x7f43100091f0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43180ffc80 msgr2=0x7f4318103c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:27.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43180ffc80 0x7f4318103c10 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f430800e970 tx=0x7f430800ec80 comp rx=0 tx=0).stop 2023-09-13T09:58:27.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 shutdown_connections 2023-09-13T09:58:27.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4318101810 0x7f4318102790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f43000a06c0 0x7f43000a2b80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43180ffc80 0x7f4318103c10 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 --2- 172.21.15.6:0/1014096311 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4318100e70 0x7f4318102250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:27.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 >> 172.21.15.6:0/1014096311 conn(0x7f43180fb1d0 msgr2=0x7f43180692e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:27.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 shutdown_connections 2023-09-13T09:58:27.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:27.163+0000 7f431dfc5700 1 -- 172.21.15.6:0/1014096311 wait complete. 2023-09-13T09:58:27.182 INFO:tasks.cephfs.filesystem:scrub status for tag:6998b4ee-7a23-488d-9065-a786c50363e5 - {'path': '/', 'tag': '6998b4ee-7a23-488d-9065-a786c50363e5', 'options': 'recursive,force'} 2023-09-13T09:58:27.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 238824 36.14 MB/sec execute 227 sec latency 70.157 ms 2023-09-13T09:58:28.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: pgmap v868: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 842 op/s 2023-09-13T09:58:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:58:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.259 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.260 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:58:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.261 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:27 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: pgmap v868: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 842 op/s 2023-09-13T09:58:28.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:58:28.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.262 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.263 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.264 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:58:28.265 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.266 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:27 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: pgmap v868: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 842 op/s 2023-09-13T09:58:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:58:28.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.272 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.273 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:58:28.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.274 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:27 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:28.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 239375 36.10 MB/sec execute 228 sec latency 73.766 ms 2023-09-13T09:58:29.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:28 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:29.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:28 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:29.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:28 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:58:29.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 239900 36.10 MB/sec execute 229 sec latency 268.583 ms 2023-09-13T09:58:30.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:29 smithi006 ceph-mon[98665]: pgmap v869: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 868 op/s 2023-09-13T09:58:30.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:29 smithi053 ceph-mon[102373]: pgmap v869: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 868 op/s 2023-09-13T09:58:30.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:29 smithi131 ceph-mon[102785]: pgmap v869: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 868 op/s 2023-09-13T09:58:30.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 240608 36.09 MB/sec execute 230 sec latency 87.907 ms 2023-09-13T09:58:31.586 INFO:tasks.workunit.client.0.smithi006.stdout: 10 241171 36.07 MB/sec execute 231 sec latency 66.535 ms 2023-09-13T09:58:32.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:31 smithi006 ceph-mon[98665]: pgmap v870: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 773 op/s 2023-09-13T09:58:32.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:31 smithi053 ceph-mon[102373]: pgmap v870: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 773 op/s 2023-09-13T09:58:32.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:31 smithi131 ceph-mon[102785]: pgmap v870: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 11 MiB/s wr, 773 op/s 2023-09-13T09:58:32.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 241679 36.00 MB/sec execute 232 sec latency 198.174 ms 2023-09-13T09:58:33.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 242434 36.02 MB/sec execute 233 sec latency 64.930 ms 2023-09-13T09:58:34.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:33 smithi006 ceph-mon[98665]: pgmap v871: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.9 MiB/s wr, 759 op/s 2023-09-13T09:58:34.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:33 smithi053 ceph-mon[102373]: pgmap v871: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.9 MiB/s wr, 759 op/s 2023-09-13T09:58:34.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:33 smithi131 ceph-mon[102785]: pgmap v871: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.9 MiB/s wr, 759 op/s 2023-09-13T09:58:34.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 243207 36.08 MB/sec execute 234 sec latency 64.121 ms 2023-09-13T09:58:35.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 243818 36.06 MB/sec execute 235 sec latency 60.321 ms 2023-09-13T09:58:36.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:35 smithi006 ceph-mon[98665]: pgmap v872: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.1 MiB/s wr, 566 op/s 2023-09-13T09:58:36.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:35 smithi053 ceph-mon[102373]: pgmap v872: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.1 MiB/s wr, 566 op/s 2023-09-13T09:58:36.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:35 smithi131 ceph-mon[102785]: pgmap v872: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.1 MiB/s wr, 566 op/s 2023-09-13T09:58:36.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 244353 36.02 MB/sec execute 236 sec latency 69.244 ms 2023-09-13T09:58:37.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 245079 36.02 MB/sec execute 237 sec latency 98.446 ms 2023-09-13T09:58:38.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:37 smithi006 ceph-mon[98665]: pgmap v873: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 563 op/s 2023-09-13T09:58:38.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:37 smithi053 ceph-mon[102373]: pgmap v873: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 563 op/s 2023-09-13T09:58:38.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:37 smithi131 ceph-mon[102785]: pgmap v873: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.9 MiB/s wr, 563 op/s 2023-09-13T09:58:38.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 245877 36.06 MB/sec execute 238 sec latency 114.683 ms 2023-09-13T09:58:39.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 246574 36.10 MB/sec execute 239 sec latency 65.783 ms 2023-09-13T09:58:40.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:40 smithi006 ceph-mon[98665]: pgmap v874: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 538 op/s 2023-09-13T09:58:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:40.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:40 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:40.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:40 smithi053 ceph-mon[102373]: pgmap v874: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 538 op/s 2023-09-13T09:58:40.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:40.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:40.259 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:40 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:40 smithi131 ceph-mon[102785]: pgmap v874: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 538 op/s 2023-09-13T09:58:40.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:40.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:40 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:40.587 INFO:tasks.workunit.client.0.smithi006.stdout: 10 246937 36.03 MB/sec execute 240 sec latency 255.704 ms 2023-09-13T09:58:41.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:41 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:41.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:41 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:58:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:41 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:41 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:58:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:41 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:41.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:41 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:58:41.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 247256 35.94 MB/sec execute 241 sec latency 278.110 ms 2023-09-13T09:58:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:42 smithi006 ceph-mon[98665]: pgmap v875: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 460 op/s 2023-09-13T09:58:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:42 smithi053 ceph-mon[102373]: pgmap v875: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 460 op/s 2023-09-13T09:58:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:42 smithi131 ceph-mon[102785]: pgmap v875: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.4 MiB/s wr, 460 op/s 2023-09-13T09:58:42.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 247315 35.80 MB/sec execute 242 sec latency 748.251 ms 2023-09-13T09:58:43.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 247604 35.70 MB/sec execute 243 sec latency 285.470 ms 2023-09-13T09:58:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:44 smithi006 ceph-mon[98665]: pgmap v876: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.4 MiB/s wr, 585 op/s 2023-09-13T09:58:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:44 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:58:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:44 smithi053 ceph-mon[102373]: pgmap v876: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.4 MiB/s wr, 585 op/s 2023-09-13T09:58:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:44 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:58:44.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:44 smithi131 ceph-mon[102785]: pgmap v876: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.4 MiB/s wr, 585 op/s 2023-09-13T09:58:44.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:44 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:58:44.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 247984 35.63 MB/sec execute 244 sec latency 105.208 ms 2023-09-13T09:58:45.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:58:45.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:58:45.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:45 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:58:45.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:58:45.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:58:45.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:45 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:58:45.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-09-13T09:58:45.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:58:45.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:58:45.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:45 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:58:45.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 248769 35.64 MB/sec execute 245 sec latency 76.778 ms 2023-09-13T09:58:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:46 smithi006 ceph-mon[98665]: pgmap v877: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.4 MiB/s wr, 619 op/s 2023-09-13T09:58:46.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:46 smithi006 ceph-mon[98665]: Adjusting osd_memory_target on smithi131 to 196.2M 2023-09-13T09:58:46.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:46 smithi006 ceph-mon[98665]: Unable to set osd_memory_target on smithi131 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-09-13T09:58:46.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:46 smithi053 ceph-mon[102373]: pgmap v877: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.4 MiB/s wr, 619 op/s 2023-09-13T09:58:46.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:46 smithi053 ceph-mon[102373]: Adjusting osd_memory_target on smithi131 to 196.2M 2023-09-13T09:58:46.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:46 smithi053 ceph-mon[102373]: Unable to set osd_memory_target on smithi131 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-09-13T09:58:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:46 smithi131 ceph-mon[102785]: pgmap v877: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.4 MiB/s wr, 619 op/s 2023-09-13T09:58:46.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:46 smithi131 ceph-mon[102785]: Adjusting osd_memory_target on smithi131 to 196.2M 2023-09-13T09:58:46.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:46 smithi131 ceph-mon[102785]: Unable to set osd_memory_target on smithi131 to 205752422: error parsing value: Value '205752422' is below minimum 939524096 2023-09-13T09:58:46.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 249540 35.69 MB/sec execute 246 sec latency 75.728 ms 2023-09-13T09:58:47.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 250049 35.67 MB/sec execute 247 sec latency 98.530 ms 2023-09-13T09:58:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:48 smithi006 ceph-mon[98665]: pgmap v878: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 756 op/s 2023-09-13T09:58:48.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:48 smithi053 ceph-mon[102373]: pgmap v878: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 756 op/s 2023-09-13T09:58:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:48 smithi131 ceph-mon[102785]: pgmap v878: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 13 MiB/s wr, 756 op/s 2023-09-13T09:58:48.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 250591 35.64 MB/sec execute 248 sec latency 79.025 ms 2023-09-13T09:58:49.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 251135 35.60 MB/sec execute 249 sec latency 73.391 ms 2023-09-13T09:58:50.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:50 smithi053 ceph-mon[102373]: pgmap v879: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 744 op/s 2023-09-13T09:58:50.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:50 smithi006 ceph-mon[98665]: pgmap v879: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 744 op/s 2023-09-13T09:58:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:50 smithi131 ceph-mon[102785]: pgmap v879: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 744 op/s 2023-09-13T09:58:50.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 251902 35.60 MB/sec execute 250 sec latency 72.573 ms 2023-09-13T09:58:51.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 252601 35.68 MB/sec execute 251 sec latency 110.655 ms 2023-09-13T09:58:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:52 smithi006 ceph-mon[98665]: pgmap v880: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 754 op/s 2023-09-13T09:58:52.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:52 smithi053 ceph-mon[102373]: pgmap v880: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 754 op/s 2023-09-13T09:58:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:52 smithi131 ceph-mon[102785]: pgmap v880: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 14 MiB/s wr, 754 op/s 2023-09-13T09:58:52.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 253182 35.61 MB/sec execute 252 sec latency 67.411 ms 2023-09-13T09:58:53.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 253752 35.60 MB/sec execute 253 sec latency 71.447 ms 2023-09-13T09:58:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:54 smithi006 ceph-mon[98665]: pgmap v881: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 830 op/s 2023-09-13T09:58:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:54 smithi053 ceph-mon[102373]: pgmap v881: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 830 op/s 2023-09-13T09:58:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:54 smithi131 ceph-mon[102785]: pgmap v881: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 830 op/s 2023-09-13T09:58:54.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 254450 35.57 MB/sec execute 254 sec latency 77.984 ms 2023-09-13T09:58:55.588 INFO:tasks.workunit.client.0.smithi006.stdout: 10 255318 35.65 MB/sec execute 255 sec latency 57.589 ms 2023-09-13T09:58:56.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:56 smithi053 ceph-mon[102373]: pgmap v882: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 12 MiB/s wr, 751 op/s 2023-09-13T09:58:56.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:56 smithi006 ceph-mon[98665]: pgmap v882: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 12 MiB/s wr, 751 op/s 2023-09-13T09:58:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:56 smithi131 ceph-mon[102785]: pgmap v882: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 12 MiB/s wr, 751 op/s 2023-09-13T09:58:56.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 255968 35.67 MB/sec execute 256 sec latency 56.820 ms 2023-09-13T09:58:57.183 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:58:57.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 -- 172.21.15.6:0/2397621634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 msgr2=0x7f02e8107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 --2- 172.21.15.6:0/2397621634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e8107880 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f02e000b0d0 tx=0x7f02e000b3e0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 -- 172.21.15.6:0/2397621634 shutdown_connections 2023-09-13T09:58:57.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 --2- 172.21.15.6:0/2397621634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e8107880 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 --2- 172.21.15.6:0/2397621634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e80ff440 0x7f02e80ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 --2- 172.21.15.6:0/2397621634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e8100630 0x7f02e8100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 -- 172.21.15.6:0/2397621634 >> 172.21.15.6:0/2397621634 conn(0x7f02e80fa9b0 msgr2=0x7f02e80fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 -- 172.21.15.6:0/2397621634 shutdown_connections 2023-09-13T09:58:57.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.358+0000 7f02ef295700 1 -- 172.21.15.6:0/2397621634 wait complete. 2023-09-13T09:58:57.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 Processor -- start 2023-09-13T09:58:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 -- start start 2023-09-13T09:58:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e80ff440 0x7f02e8198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e8100630 0x7f02e8199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e81a0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e81a0950 con 0x7f02e8100fd0 2023-09-13T09:58:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e81a0a90 con 0x7f02e8100630 2023-09-13T09:58:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ef295700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e81a0c20 con 0x7f02e80ff440 2023-09-13T09:58:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed832700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e81a0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed031700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e80ff440 0x7f02e8198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed832700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e81a0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45846/0 (socket says 172.21.15.6:45846) 2023-09-13T09:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed832700 1 -- 172.21.15.6:0/2610286694 learned_addr learned my addr 172.21.15.6:0/2610286694 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed031700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e80ff440 0x7f02e8198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48898/0 (socket says 172.21.15.6:48898) 2023-09-13T09:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed832700 1 -- 172.21.15.6:0/2610286694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e80ff440 msgr2=0x7f02e8198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed832700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e80ff440 0x7f02e8198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.359+0000 7f02ed832700 1 -- 172.21.15.6:0/2610286694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e8100630 msgr2=0x7f02e8199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02ed832700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e8100630 0x7f02e8199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02ed832700 1 -- 172.21.15.6:0/2610286694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e0009d00 con 0x7f02e8100fd0 2023-09-13T09:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02ed031700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e80ff440 0x7f02e8198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:57.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02ed832700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e81a0380 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f02e0008ec0 tx=0x7f02e0008ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02de7fc700 1 -- 172.21.15.6:0/2610286694 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000e040 con 0x7f02e8100fd0 2023-09-13T09:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02de7fc700 1 -- 172.21.15.6:0/2610286694 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e000be30 con 0x7f02e8100fd0 2023-09-13T09:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e81a0ea0 con 0x7f02e8100fd0 2023-09-13T09:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02de7fc700 1 -- 172.21.15.6:0/2610286694 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e001b6c0 con 0x7f02e8100fd0 2023-09-13T09:58:57.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.360+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e81a12c0 con 0x7f02e8100fd0 2023-09-13T09:58:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.363+0000 7f02de7fc700 1 -- 172.21.15.6:0/2610286694 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f02e0024410 con 0x7f02e8100fd0 2023-09-13T09:58:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.364+0000 7f02de7fc700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02d40a06c0 0x7f02d40a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.364+0000 7f02de7fc700 1 -- 172.21.15.6:0/2610286694 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f02e00ccd00 con 0x7f02e8100fd0 2023-09-13T09:58:57.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.364+0000 7f02ed031700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02d40a06c0 0x7f02d40a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02ed031700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02d40a06c0 0x7f02d40a2b80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f02e8100490 tx=0x7f02e4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 Processor -- start 2023-09-13T09:58:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 -- start start 2023-09-13T09:58:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90cbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f9024780 con 0x55e3f90cd060 2023-09-13T09:58:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f90220a0 con 0x55e3f90cc700 2023-09-13T09:58:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f901d990 con 0x55e3f90cba00 2023-09-13T09:58:57.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02ec830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02ed031700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02ed832700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90cbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02ed031700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ccb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39376/0 (socket says 172.21.15.6:39376) 2023-09-13T09:58:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02ec830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45856/0 (socket says 172.21.15.6:45856) 2023-09-13T09:58:57.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.365+0000 7f02ed031700 1 -- 172.21.15.6:0/1857270678 learned_addr learned my addr 172.21.15.6:0/1857270678 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02ec830700 1 -- 172.21.15.6:0/1857270678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 msgr2=0x55e3f90cbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02ec830700 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90cbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02ec830700 1 -- 172.21.15.6:0/1857270678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 msgr2=0x55e3f90ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02ec830700 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02ec830700 1 -- 172.21.15.6:0/1857270678 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f8e9d630 con 0x55e3f90cd060 2023-09-13T09:58:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02ed832700 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02ec830700 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90cb4c0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009b50 tx=0x7f02d8009e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd66d7e2a0370436 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02d37fe700 1 -- 172.21.15.6:0/1857270678 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8004230 con 0x55e3f90cd060 2023-09-13T09:58:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02d37fe700 1 -- 172.21.15.6:0/1857270678 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02d800edc0 con 0x55e3f90cd060 2023-09-13T09:58:57.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.366+0000 7f02d37fe700 1 -- 172.21.15.6:0/1857270678 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8005020 con 0x55e3f90cd060 2023-09-13T09:58:57.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.367+0000 7f02fb47ab80 1 -- 172.21.15.6:0/1857270678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 msgr2=0x55e3f90cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.367+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90cb4c0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f02d8009b50 tx=0x7f02d8009e60 comp rx=0 tx=0).stop 2023-09-13T09:58:57.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.368+0000 7f02fb47ab80 1 -- 172.21.15.6:0/1857270678 shutdown_connections 2023-09-13T09:58:57.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.368+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90cbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.368+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.368+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/1857270678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90cb4c0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.368+0000 7f02fb47ab80 1 -- 172.21.15.6:0/1857270678 >> 172.21.15.6:0/1857270678 conn(0x55e3f9029c80 msgr2=0x55e3f90c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.370+0000 7f02fb47ab80 1 -- 172.21.15.6:0/1857270678 shutdown_connections 2023-09-13T09:58:57.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.370+0000 7f02fb47ab80 1 -- 172.21.15.6:0/1857270678 wait complete. 2023-09-13T09:58:57.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.370+0000 7f02fb47ab80 1 -- start start 2023-09-13T09:58:57.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.370+0000 7f02fb47ab80 1 Processor -- start 2023-09-13T09:58:57.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90dd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ddcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90e4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8fbbbb0 con 0x55e3f90cd060 2023-09-13T09:58:57.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8fbb8b0 con 0x55e3f90cc700 2023-09-13T09:58:57.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f8e9f920 con 0x55e3f90cba00 2023-09-13T09:58:57.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02fb47ab80 10 client.0 _ll_register_callbacks cb 0x55e3f8fb9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:57.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02ec830700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ddcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02ed031700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90dd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02ec830700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ddcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39382/0 (socket says 172.21.15.6:39382) 2023-09-13T09:58:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02ed031700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90dd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:48914/0 (socket says 172.21.15.6:48914) 2023-09-13T09:58:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.371+0000 7f02ec830700 1 -- 172.21.15.6:0/3692593795 learned_addr learned my addr 172.21.15.6:0/3692593795 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:57.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02ec830700 1 -- 172.21.15.6:0/3692593795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 msgr2=0x55e3f90dd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:57.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02ec830700 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90dd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02ec830700 1 -- 172.21.15.6:0/3692593795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 msgr2=0x55e3f90e4cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:58:57.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02ec830700 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90e4cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02ec830700 1 -- 172.21.15.6:0/3692593795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02d8009800 con 0x55e3f90cc700 2023-09-13T09:58:57.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02ed031700 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90dd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:57.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02ec830700 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ddcb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f02d800e630 tx=0x7f02d8004f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac1e97b4e87c3710 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.372+0000 7f02d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:58:57.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.374+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3692593795 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80048e0 con 0x55e3f90cc700 2023-09-13T09:58:57.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.374+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3692593795 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f02d8014070 con 0x55e3f90cc700 2023-09-13T09:58:57.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.374+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3f90be670 con 0x55e3f90cc700 2023-09-13T09:58:57.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.374+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3692593795 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02d8005230 con 0x55e3f90cc700 2023-09-13T09:58:57.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.374+0000 7f02fb47ab80 10 client.29699 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:57.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.374+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55e3f90357a0 con 0x55e3f90cc700 2023-09-13T09:58:57.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.375+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3692593795 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3f90be670 con 0x55e3f90cc700 2023-09-13T09:58:57.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.377+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3692593795 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f02d8018c50 con 0x55e3f90cc700 2023-09-13T09:58:57.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.377+0000 7f02fb47ab80 10 client.29699 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:57.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.377+0000 7f02fb47ab80 10 client.29699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:57.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.377+0000 7f02fb47ab80 20 client.29699 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:57.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.377+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f90e9370 0x55e3f90eb790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.377+0000 7f02fb47ab80 4 client.29699 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:57.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.377+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3f9016970 con 0x55e3f90e9370 2023-09-13T09:58:57.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.378+0000 7f02ed031700 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f90e9370 0x55e3f90eb790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.378+0000 7f02d0ff9700 10 client.29699 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:57.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.378+0000 7f02ed031700 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f90e9370 0x55e3f90eb790 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc7596daa66a623 server_cookie=33df4273bd8b4a0a in_seq=0 out_seq=0 2023-09-13T09:58:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.379+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3692593795 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e3f9016970 con 0x55e3f90e9370 2023-09-13T09:58:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.379+0000 7f02d0ff9700 10 client.29699 handle_command_reply: tid=0 2023-09-13T09:58:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.379+0000 7f02fb47ab80 1 client.29699 shutdown 2023-09-13T09:58:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.379+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 msgr2=0x55e3f90ddcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.379+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ddcb0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f02d800e630 tx=0x7f02d8004f60 comp rx=0 tx=0).stop 2023-09-13T09:58:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.379+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 shutdown_connections 2023-09-13T09:58:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.379+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f90e9370 0x55e3f90eb790 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cd060 0x55e3f90e4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90dd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02d0ff9700 0 client.29699 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3692593795 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90ddcb0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 >> 172.21.15.6:0/3692593795 conn(0x55e3f9029c80 msgr2=0x55e3f90c07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 shutdown_connections 2023-09-13T09:58:57.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3692593795 wait complete. 2023-09-13T09:58:57.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.380+0000 7f02fb47ab80 20 client.29699 trim_cache size 0 max 16384 2023-09-13T09:58:57.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 Processor -- start 2023-09-13T09:58:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 -- start start 2023-09-13T09:58:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cba00 0x55e3f90cb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90e4cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cd060 0x55e3f90dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f90c6810 con 0x55e3f90cba00 2023-09-13T09:58:57.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f90c7730 con 0x55e3f90cc700 2023-09-13T09:58:57.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f90e9140 con 0x55e3f90cd060 2023-09-13T09:58:57.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.400+0000 7f02ed031700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cba00 0x55e3f90cb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cba00 0x55e3f90cb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45864/0 (socket says 172.21.15.6:45864) 2023-09-13T09:58:57.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 -- 172.21.15.6:0/3833967043 learned_addr learned my addr 172.21.15.6:0/3833967043 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:57.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed832700 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cd060 0x55e3f90dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ec830700 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90e4cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 -- 172.21.15.6:0/3833967043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cd060 msgr2=0x55e3f90dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:57.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cd060 0x55e3f90dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 -- 172.21.15.6:0/3833967043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 msgr2=0x55e3f90e4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90e4cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 -- 172.21.15.6:0/3833967043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3f8e49de0 con 0x55e3f90cba00 2023-09-13T09:58:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ec830700 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:58:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02ed031700 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cba00 0x55e3f90cb4c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f02e4013010 tx=0x7f02e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f653498852b7e9c3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02d3fff700 1 -- 172.21.15.6:0/3833967043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e4024040 con 0x55e3f90cba00 2023-09-13T09:58:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02d3fff700 1 -- 172.21.15.6:0/3833967043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f02e40295b0 con 0x55e3f90cba00 2023-09-13T09:58:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.401+0000 7f02d3fff700 1 -- 172.21.15.6:0/3833967043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e401ecb0 con 0x55e3f90cba00 2023-09-13T09:58:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3833967043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cba00 msgr2=0x55e3f90cb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cba00 0x55e3f90cb4c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f02e4013010 tx=0x7f02e4014000 comp rx=0 tx=0).stop 2023-09-13T09:58:57.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3833967043 shutdown_connections 2023-09-13T09:58:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cd060 0x55e3f90dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cba00 0x55e3f90cb4c0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3833967043 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cc700 0x55e3f90e4cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3833967043 >> 172.21.15.6:0/3833967043 conn(0x55e3f9029c80 msgr2=0x55e3f90c5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3833967043 shutdown_connections 2023-09-13T09:58:57.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3833967043 wait complete. 2023-09-13T09:58:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.402+0000 7f02fb47ab80 1 -- start start 2023-09-13T09:58:57.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 1 Processor -- start 2023-09-13T09:58:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90e0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cc700 0x55e3f90e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cd060 0x55e3f90e43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f90e4910 con 0x55e3f90cc700 2023-09-13T09:58:57.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f90e4a80 con 0x55e3f90cd060 2023-09-13T09:58:57.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3f90e4c40 con 0x55e3f90cba00 2023-09-13T09:58:57.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02fb47ab80 10 client.0 _ll_register_callbacks cb 0x55e3f8fb9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:57.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02ec830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cc700 0x55e3f90e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02ec830700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cc700 0x55e3f90e13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45872/0 (socket says 172.21.15.6:45872) 2023-09-13T09:58:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02ed031700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90e0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02ec830700 1 -- 172.21.15.6:0/3696825804 learned_addr learned my addr 172.21.15.6:0/3696825804 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.403+0000 7f02ed832700 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cd060 0x55e3f90e43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02ec830700 1 -- 172.21.15.6:0/3696825804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 msgr2=0x55e3f90e0e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:57.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02ec830700 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90e0e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02ec830700 1 -- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cd060 msgr2=0x55e3f90e43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02ec830700 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cd060 0x55e3f90e43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02ec830700 1 -- 172.21.15.6:0/3696825804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e4017070 con 0x55e3f90cc700 2023-09-13T09:58:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02ec830700 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cc700 0x55e3f90e13b0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f02d8005cb0 tx=0x7f02d8024870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=751ffb5538dd279a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02d0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3696825804 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d8004ac0 con 0x55e3f90cc700 2023-09-13T09:58:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3696825804 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f02d8014040 con 0x55e3f90cc700 2023-09-13T09:58:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3f8fd7050 con 0x55e3f90cc700 2023-09-13T09:58:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3696825804 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f02d8005230 con 0x55e3f90cc700 2023-09-13T09:58:57.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02fb47ab80 10 client.20496 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.404+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55e3f8e32c60 con 0x55e3f90cc700 2023-09-13T09:58:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3696825804 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e3f8fd7050 con 0x55e3f90cc700 2023-09-13T09:58:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3696825804 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f02d8018590 con 0x55e3f90cc700 2023-09-13T09:58:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02fb47ab80 10 client.20496 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:57.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02fb47ab80 10 client.20496 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02fb47ab80 20 client.20496 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f913e230 0x55e3f9140650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02fb47ab80 4 client.20496 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:58:57.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e3f8e6af70 con 0x55e3f913e230 2023-09-13T09:58:57.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02ed031700 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f913e230 0x55e3f9140650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02d0ff9700 10 client.20496 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:57.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.405+0000 7f02ed031700 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f913e230 0x55e3f9140650 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4f7cbeedcffab07 server_cookie=41bad23f99988ee0 in_seq=0 out_seq=0 2023-09-13T09:58:57.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02d0ff9700 1 -- 172.21.15.6:0/3696825804 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e3f8e6af70 con 0x55e3f913e230 2023-09-13T09:58:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02d0ff9700 10 client.20496 handle_command_reply: tid=0 2023-09-13T09:58:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 client.20496 shutdown 2023-09-13T09:58:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cc700 msgr2=0x55e3f90e13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cc700 0x55e3f90e13b0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f02d8005cb0 tx=0x7f02d8024870 comp rx=0 tx=0).stop 2023-09-13T09:58:57.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 shutdown_connections 2023-09-13T09:58:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e3f90cd060 0x55e3f90e43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e3f90cba00 0x55e3f90e0e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e3f913e230 0x55e3f9140650 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 --2- 172.21.15.6:0/3696825804 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e3f90cc700 0x55e3f90e13b0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 >> 172.21.15.6:0/3696825804 conn(0x55e3f9029c80 msgr2=0x55e3f90cf920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02d0ff9700 0 client.20496 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 shutdown_connections 2023-09-13T09:58:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 1 -- 172.21.15.6:0/3696825804 wait complete. 2023-09-13T09:58:57.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.406+0000 7f02fb47ab80 20 client.20496 trim_cache size 0 max 16384 2023-09-13T09:58:57.425 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:58:57.425 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:58:57.425 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:58:57.425 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:58:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02d40a06c0 msgr2=0x7f02d40a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02d40a06c0 0x7f02d40a2b80 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f02e8100490 tx=0x7f02e4009260 comp rx=0 tx=0).stop 2023-09-13T09:58:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 msgr2=0x7f02e81a0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e81a0380 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7f02e0008ec0 tx=0x7f02e0008ef0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 shutdown_connections 2023-09-13T09:58:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f02d40a06c0 0x7f02d40a2b80 secure :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f02e8100490 tx=0x7f02e4009260 comp rx=0 tx=0).stop 2023-09-13T09:58:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f02e8100fd0 0x7f02e81a0380 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f02e80ff440 0x7f02e8198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 --2- 172.21.15.6:0/2610286694 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f02e8100630 0x7f02e8199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 >> 172.21.15.6:0/2610286694 conn(0x7f02e80fa9b0 msgr2=0x7f02e80fcb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 shutdown_connections 2023-09-13T09:58:57.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.407+0000 7f02ef295700 1 -- 172.21.15.6:0/2610286694 wait complete. 2023-09-13T09:58:57.429 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:58:57.430 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:58:57.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 256531 35.65 MB/sec execute 257 sec latency 62.227 ms 2023-09-13T09:58:57.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.597+0000 7f93f2d3a700 1 -- 172.21.15.6:0/3733024746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec0ff080 msgr2=0x7f93ec0ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.597+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/3733024746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec0ff080 0x7f93ec0ff4a0 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f93e00098f0 tx=0x7f93e0009c00 comp rx=0 tx=0).stop 2023-09-13T09:58:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 -- 172.21.15.6:0/3733024746 shutdown_connections 2023-09-13T09:58:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/3733024746 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ec1007a0 0x7f93ec105040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/3733024746 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec0ff080 0x7f93ec0ff4a0 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/3733024746 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0ffde0 0x7f93ec100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 -- 172.21.15.6:0/3733024746 >> 172.21.15.6:0/3733024746 conn(0x7f93ec0fa9b0 msgr2=0x7f93ec0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 -- 172.21.15.6:0/3733024746 shutdown_connections 2023-09-13T09:58:57.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 -- 172.21.15.6:0/3733024746 wait complete. 2023-09-13T09:58:57.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 Processor -- start 2023-09-13T09:58:57.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.598+0000 7f93f2d3a700 1 -- start start 2023-09-13T09:58:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f2d3a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ec0ff080 0x7f93ec19d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f2d3a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0ffde0 0x7f93ec19d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f2d3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec1007a0 0x7f93ec1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f2d3a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec1a4ca0 con 0x7f93ec1007a0 2023-09-13T09:58:57.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f2d3a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec1a4de0 con 0x7f93ec0ffde0 2023-09-13T09:58:57.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f2d3a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93ec1a4f70 con 0x7f93ec0ff080 2023-09-13T09:58:57.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec1007a0 0x7f93ec1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec1007a0 0x7f93ec1a46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45888/0 (socket says 172.21.15.6:45888) 2023-09-13T09:58:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 -- 172.21.15.6:0/2020654958 learned_addr learned my addr 172.21.15.6:0/2020654958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93ebfff700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0ffde0 0x7f93ec19d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f0ad6700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ec0ff080 0x7f93ec19d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 -- 172.21.15.6:0/2020654958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ec0ff080 msgr2=0x7f93ec19d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ec0ff080 0x7f93ec19d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 -- 172.21.15.6:0/2020654958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0ffde0 msgr2=0x7f93ec19d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0ffde0 0x7f93ec19d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 -- 172.21.15.6:0/2020654958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80095f0 con 0x7f93ec1007a0 2023-09-13T09:58:57.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.599+0000 7f93f12d7700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec1007a0 0x7f93ec1a46d0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f93e400ef30 tx=0x7f93e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.600+0000 7f93e9ffb700 1 -- 172.21.15.6:0/2020654958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4018070 con 0x7f93ec1007a0 2023-09-13T09:58:57.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.600+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e0009520 con 0x7f93ec1007a0 2023-09-13T09:58:57.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.600+0000 7f93e9ffb700 1 -- 172.21.15.6:0/2020654958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f93e400f040 con 0x7f93ec1007a0 2023-09-13T09:58:57.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.600+0000 7f93e9ffb700 1 -- 172.21.15.6:0/2020654958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e400cd00 con 0x7f93ec1007a0 2023-09-13T09:58:57.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.600+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93ec1a5570 con 0x7f93ec1007a0 2023-09-13T09:58:57.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.601+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93ec1047d0 con 0x7f93ec1007a0 2023-09-13T09:58:57.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.602+0000 7f93e9ffb700 1 -- 172.21.15.6:0/2020654958 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f93e4003a00 con 0x7f93ec1007a0 2023-09-13T09:58:57.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.603+0000 7f93e9ffb700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93dc0a0640 0x7f93dc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:57.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.603+0000 7f93e9ffb700 1 -- 172.21.15.6:0/2020654958 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f93e40cb710 con 0x7f93ec1007a0 2023-09-13T09:58:57.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.603+0000 7f93f0ad6700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93dc0a0640 0x7f93dc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:57.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.603+0000 7f93f0ad6700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93dc0a0640 0x7f93dc0a2b00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f93e0005e90 tx=0x7f93e0019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:57.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.609+0000 7f93e9ffb700 1 -- 172.21.15.6:0/2020654958 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f93e4095280 con 0x7f93ec1007a0 2023-09-13T09:58:57.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.958+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93ec112c50 con 0x7f93ec1007a0 2023-09-13T09:58:57.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.959+0000 7f93e9ffb700 1 -- 172.21.15.6:0/2020654958 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+11343 (secure 0 0 0) 0x7f93e40988a0 con 0x7f93ec1007a0 2023-09-13T09:58:57.961 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:58:57.961 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:57:57.567802+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:58:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.964+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93dc0a0640 msgr2=0x7f93dc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.964+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93dc0a0640 0x7f93dc0a2b00 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f93e0005e90 tx=0x7f93e0019040 comp rx=0 tx=0).stop 2023-09-13T09:58:57.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.964+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec1007a0 msgr2=0x7f93ec1a46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:57.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.964+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec1007a0 0x7f93ec1a46d0 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f93e400ef30 tx=0x7f93e400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.965+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 shutdown_connections 2023-09-13T09:58:57.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.965+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f93dc0a0640 0x7f93dc0a2b00 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.965+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93ec1007a0 0x7f93ec1a46d0 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.965+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f93ec0ff080 0x7f93ec19d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.965+0000 7f93f2d3a700 1 --2- 172.21.15.6:0/2020654958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f93ec0ffde0 0x7f93ec19d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:57.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.965+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 >> 172.21.15.6:0/2020654958 conn(0x7f93ec0fa9b0 msgr2=0x7f93ec0fb620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.966+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 shutdown_connections 2023-09-13T09:58:57.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:57.966+0000 7f93f2d3a700 1 -- 172.21.15.6:0/2020654958 wait complete. 2023-09-13T09:58:57.968 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2023-09-13T09:58:57.983 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:58:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 -- 172.21.15.6:0/1706669864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc101850 msgr2=0x7f8ddc108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 --2- 172.21.15.6:0/1706669864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc101850 0x7f8ddc108100 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f8dd400b0d0 tx=0x7f8dd400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 -- 172.21.15.6:0/1706669864 shutdown_connections 2023-09-13T09:58:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 --2- 172.21.15.6:0/1706669864 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc101850 0x7f8ddc108100 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 --2- 172.21.15.6:0/1706669864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc0ffcc0 0x7f8ddc1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 --2- 172.21.15.6:0/1706669864 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ddc100eb0 0x7f8ddc101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 -- 172.21.15.6:0/1706669864 >> 172.21.15.6:0/1706669864 conn(0x7f8ddc0fb250 msgr2=0x7f8ddc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 -- 172.21.15.6:0/1706669864 shutdown_connections 2023-09-13T09:58:58.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.152+0000 7f8de111e700 1 -- 172.21.15.6:0/1706669864 wait complete. 2023-09-13T09:58:58.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.153+0000 7f8de111e700 1 Processor -- start 2023-09-13T09:58:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.153+0000 7f8de111e700 1 -- start start 2023-09-13T09:58:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8de111e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc0ffcc0 0x7f8ddc196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8de111e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ddc100eb0 0x7f8ddc1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8de111e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc101850 0x7f8ddc19e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8de111e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc10b1e0 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8de111e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc10b350 con 0x7f8ddc100eb0 2023-09-13T09:58:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8de111e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc10b510 con 0x7f8ddc101850 2023-09-13T09:58:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc0ffcc0 0x7f8ddc196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc0ffcc0 0x7f8ddc196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45898/0 (socket says 172.21.15.6:45898) 2023-09-13T09:58:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 -- 172.21.15.6:0/2580110493 learned_addr learned my addr 172.21.15.6:0/2580110493 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8dda59c700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ddc100eb0 0x7f8ddc1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc101850 0x7f8ddc19e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 -- 172.21.15.6:0/2580110493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc101850 msgr2=0x7f8ddc19e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc101850 0x7f8ddc19e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 -- 172.21.15.6:0/2580110493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ddc100eb0 msgr2=0x7f8ddc1970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ddc100eb0 0x7f8ddc1970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 -- 172.21.15.6:0/2580110493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd4009d00 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc101850 0x7f8ddc19e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:58:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.154+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc0ffcc0 0x7f8ddc196ba0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00e970 tx=0x7f8dcc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.155+0000 7f8dc3fff700 1 -- 172.21.15.6:0/2580110493 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc009790 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.155+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc10b790 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.155+0000 7f8dc3fff700 1 -- 172.21.15.6:0/2580110493 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dcc00eec0 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.155+0000 7f8dc3fff700 1 -- 172.21.15.6:0/2580110493 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc003cf0 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.155+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc10bcf0 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.158+0000 7f8dc3fff700 1 -- 172.21.15.6:0/2580110493 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f8dcc00ccd0 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.158+0000 7f8dc3fff700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8dc40a0640 0x7f8dc40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.159+0000 7f8dc3fff700 1 -- 172.21.15.6:0/2580110493 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8dcc014070 con 0x7f8ddc0ffcc0 2023-09-13T09:58:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.159+0000 7f8dda59c700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8dc40a0640 0x7f8dc40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.159+0000 7f8dda59c700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8dc40a0640 0x7f8dc40a2b00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009c60 tx=0x7f8dd0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 Processor -- start 2023-09-13T09:58:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 -- start start 2023-09-13T09:58:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x55959989b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x559599899cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x55959989a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595997ea780 con 0x55959989af10 2023-09-13T09:58:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595997e80a0 con 0x55959989b870 2023-09-13T09:58:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ded303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595997e3990 con 0x55959989a210 2023-09-13T09:58:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ddad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x55959989b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ddad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x55959989b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45906/0 (socket says 172.21.15.6:45906) 2023-09-13T09:58:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ddad9d700 1 -- 172.21.15.6:0/4015243418 learned_addr learned my addr 172.21.15.6:0/4015243418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8dda59c700 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x559599899cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.160+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x55959989a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8ddad9d700 1 -- 172.21.15.6:0/4015243418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 msgr2=0x55959989a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x55959989a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8ddad9d700 1 -- 172.21.15.6:0/4015243418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 msgr2=0x559599899cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x559599899cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8ddad9d700 1 -- 172.21.15.6:0/4015243418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559599663630 con 0x55959989af10 2023-09-13T09:58:58.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x55959989b330 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0a1140 tx=0x7f8dcc098f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67d9f8408f47721 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8dc17fa700 1 -- 172.21.15.6:0/4015243418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc099600 con 0x55959989af10 2023-09-13T09:58:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8dc17fa700 1 -- 172.21.15.6:0/4015243418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dcc09d430 con 0x55959989af10 2023-09-13T09:58:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.161+0000 7f8dc17fa700 1 -- 172.21.15.6:0/4015243418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc084320 con 0x55959989af10 2023-09-13T09:58:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 -- 172.21.15.6:0/4015243418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 msgr2=0x55959989b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x55959989b330 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc0a1140 tx=0x7f8dcc098f60 comp rx=0 tx=0).stop 2023-09-13T09:58:58.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 -- 172.21.15.6:0/4015243418 shutdown_connections 2023-09-13T09:58:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x55959989a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x55959989b330 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 --2- 172.21.15.6:0/4015243418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x559599899cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 -- 172.21.15.6:0/4015243418 >> 172.21.15.6:0/4015243418 conn(0x5595997efc80 msgr2=0x55959988bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 -- 172.21.15.6:0/4015243418 shutdown_connections 2023-09-13T09:58:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.162+0000 7f8ded303b80 1 -- 172.21.15.6:0/4015243418 wait complete. 2023-09-13T09:58:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 -- start start 2023-09-13T09:58:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 Processor -- start 2023-09-13T09:58:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x5595998a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998aad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559599781bb0 con 0x55959989af10 2023-09-13T09:58:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595997818b0 con 0x55959989b870 2023-09-13T09:58:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559599665920 con 0x55959989a210 2023-09-13T09:58:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ded303b80 10 client.0 _ll_register_callbacks cb 0x55959977f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998a3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45912/0 (socket says 172.21.15.6:45912) 2023-09-13T09:58:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8dda59c700 1 -- 172.21.15.6:0/3134663257 learned_addr learned my addr 172.21.15.6:0/3134663257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x5595998a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.163+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998aad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dda59c700 1 -- 172.21.15.6:0/3134663257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 msgr2=0x5595998a37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dda59c700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x5595998a37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dda59c700 1 -- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 msgr2=0x5595998aad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dda59c700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998aad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dda59c700 1 -- 172.21.15.6:0/3134663257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc10bcf0 con 0x55959989af10 2023-09-13T09:58:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x5595998a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dda59c700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998a3cf0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0003900 tx=0x7f8dd00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1ecfa34528bc33 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dbeff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dbeff5700 1 -- 172.21.15.6:0/3134663257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0022070 con 0x55959989af10 2023-09-13T09:58:58.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dbeff5700 1 -- 172.21.15.6:0/3134663257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8dd001d620 con 0x55959989af10 2023-09-13T09:58:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559599884670 con 0x55959989af10 2023-09-13T09:58:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8dbeff5700 1 -- 172.21.15.6:0/3134663257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dd001d7e0 con 0x55959989af10 2023-09-13T09:58:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.164+0000 7f8ded303b80 10 client.20514 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.165+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5595997fb7a0 con 0x55959989af10 2023-09-13T09:58:58.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.165+0000 7f8dbeff5700 1 -- 172.21.15.6:0/3134663257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559599884670 con 0x55959989af10 2023-09-13T09:58:58.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8dbeff5700 1 -- 172.21.15.6:0/3134663257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8dd001d940 con 0x55959989af10 2023-09-13T09:58:58.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8ded303b80 10 client.20514 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8ded303b80 10 client.20514 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:58:58.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8ded303b80 20 client.20514 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8ded303b80 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5595998af5d0 0x5595998b19f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8ded303b80 4 client.20514 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:58.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595997dc970 con 0x5595998af5d0 2023-09-13T09:58:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.166+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5595998af5d0 0x5595998b19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.167+0000 7f8dbeff5700 10 client.20514 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.167+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5595998af5d0 0x5595998b19f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=931688470c44ee2 server_cookie=10a6cb64aa4b8b48 in_seq=0 out_seq=0 2023-09-13T09:58:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8dbeff5700 1 -- 172.21.15.6:0/3134663257 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5595997dc970 con 0x5595998af5d0 2023-09-13T09:58:58.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8dbeff5700 10 client.20514 handle_command_reply: tid=0 2023-09-13T09:58:58.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 client.20514 shutdown 2023-09-13T09:58:58.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 msgr2=0x5595998a3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998a3cf0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0003900 tx=0x7f8dd00047c0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 shutdown_connections 2023-09-13T09:58:58.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5595998af5d0 0x5595998b19f0 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998aad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8dbeff5700 0 client.20514 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x5595998a37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 --2- 172.21.15.6:0/3134663257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998a3cf0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 >> 172.21.15.6:0/3134663257 conn(0x5595997efc80 msgr2=0x5595998867f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 shutdown_connections 2023-09-13T09:58:58.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 1 -- 172.21.15.6:0/3134663257 wait complete. 2023-09-13T09:58:58.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.172+0000 7f8ded303b80 20 client.20514 trim_cache size 0 max 16384 2023-09-13T09:58:58.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 Processor -- start 2023-09-13T09:58:58.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 -- start start 2023-09-13T09:58:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x559599899cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998aacf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x55959989e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595998a3320 con 0x55959989af10 2023-09-13T09:58:58.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55959988da10 con 0x55959989b870 2023-09-13T09:58:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ded303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595998a4680 con 0x55959989a210 2023-09-13T09:58:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998aacf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8dda59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998aacf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45920/0 (socket says 172.21.15.6:45920) 2023-09-13T09:58:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8dda59c700 1 -- 172.21.15.6:0/2600932082 learned_addr learned my addr 172.21.15.6:0/2600932082 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.189+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x55959989e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dda59c700 1 -- 172.21.15.6:0/2600932082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 msgr2=0x559599899cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dda59c700 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x559599899cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dda59c700 1 -- 172.21.15.6:0/2600932082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 msgr2=0x55959989e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dda59c700 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x55959989e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dda59c700 1 -- 172.21.15.6:0/2600932082 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55959960fde0 con 0x55959989af10 2023-09-13T09:58:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dda59c700 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998aacf0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0013010 tx=0x7f8dd0009350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b75fd64b8c5f5d9c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dc1ffb700 1 -- 172.21.15.6:0/2600932082 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0037070 con 0x55959989af10 2023-09-13T09:58:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dc1ffb700 1 -- 172.21.15.6:0/2600932082 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dd00045e0 con 0x55959989af10 2023-09-13T09:58:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.190+0000 7f8dc1ffb700 1 -- 172.21.15.6:0/2600932082 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0022070 con 0x55959989af10 2023-09-13T09:58:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.191+0000 7f8ded303b80 1 -- 172.21.15.6:0/2600932082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 msgr2=0x5595998aacf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.191+0000 7f8ded303b80 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998aacf0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0013010 tx=0x7f8dd0009350 comp rx=0 tx=0).stop 2023-09-13T09:58:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.191+0000 7f8ded303b80 1 -- 172.21.15.6:0/2600932082 shutdown_connections 2023-09-13T09:58:58.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.191+0000 7f8ded303b80 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x55959989e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.191+0000 7f8ded303b80 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989a210 0x559599899cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.191+0000 7f8ded303b80 1 --2- 172.21.15.6:0/2600932082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989af10 0x5595998aacf0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.191+0000 7f8ded303b80 1 -- 172.21.15.6:0/2600932082 >> 172.21.15.6:0/2600932082 conn(0x5595997efc80 msgr2=0x5595998a37b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 -- 172.21.15.6:0/2600932082 shutdown_connections 2023-09-13T09:58:58.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 -- 172.21.15.6:0/2600932082 wait complete. 2023-09-13T09:58:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 -- start start 2023-09-13T09:58:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 Processor -- start 2023-09-13T09:58:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989a210 0x5595998a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989af10 0x5595998a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595998aa3d0 con 0x55959989a210 2023-09-13T09:58:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595998aa540 con 0x55959989b870 2023-09-13T09:58:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595998aa700 con 0x55959989af10 2023-09-13T09:58:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.192+0000 7f8ded303b80 10 client.0 _ll_register_callbacks cb 0x55959977f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998a9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39452/0 (socket says 172.21.15.6:39452) 2023-09-13T09:58:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 -- 172.21.15.6:0/576217217 learned_addr learned my addr 172.21.15.6:0/576217217 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8dda59c700 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989af10 0x5595998a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989a210 0x5595998a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 -- 172.21.15.6:0/576217217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989af10 msgr2=0x5595998a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989af10 0x5595998a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 -- 172.21.15.6:0/576217217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989a210 msgr2=0x5595998a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989a210 0x5595998a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 -- 172.21.15.6:0/576217217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595997fb7a0 con 0x55959989b870 2023-09-13T09:58:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8ddb59e700 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998a9e90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4015000 tx=0x7f8dd400bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb061dc85105548d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8dbeff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:58:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.193+0000 7f8dbeff5700 1 -- 172.21.15.6:0/576217217 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd4021070 con 0x55959989b870 2023-09-13T09:58:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.194+0000 7f8dbeff5700 1 -- 172.21.15.6:0/576217217 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f8dd4004a50 con 0x55959989b870 2023-09-13T09:58:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.194+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8dcc09d430 con 0x55959989b870 2023-09-13T09:58:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.194+0000 7f8dbeff5700 1 -- 172.21.15.6:0/576217217 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8dd400e040 con 0x55959989b870 2023-09-13T09:58:58.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.194+0000 7f8ded303b80 10 client.29729 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.194+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5595995f8c60 con 0x55959989b870 2023-09-13T09:58:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8dbeff5700 1 -- 172.21.15.6:0/576217217 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8dcc09d430 con 0x55959989b870 2023-09-13T09:58:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8dbeff5700 1 -- 172.21.15.6:0/576217217 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f8dd402d070 con 0x55959989b870 2023-09-13T09:58:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8ded303b80 10 client.29729 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8ded303b80 10 client.29729 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:58:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8ded303b80 20 client.29729 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8ded303b80 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559599891360 0x559599893780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8ded303b80 4 client.29729 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.196+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55959979d050 con 0x559599891360 2023-09-13T09:58:58.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.197+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559599891360 0x559599893780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.197+0000 7f8ddad9d700 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559599891360 0x559599893780 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=42bc36ca1a727f71 server_cookie=7fd242180a9b6ff1 in_seq=0 out_seq=0 2023-09-13T09:58:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.197+0000 7f8dbeff5700 10 client.29729 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8dbeff5700 1 -- 172.21.15.6:0/576217217 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55959979d050 con 0x559599891360 2023-09-13T09:58:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8dbeff5700 10 client.29729 handle_command_reply: tid=0 2023-09-13T09:58:58.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 client.29729 shutdown 2023-09-13T09:58:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 msgr2=0x5595998a9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998a9e90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4015000 tx=0x7f8dd400bcd0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 shutdown_connections 2023-09-13T09:58:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x559599891360 0x559599893780 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55959989b870 0x5595998a9e90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55959989a210 0x5595998a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8dbeff5700 0 client.29729 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:58:58.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 --2- 172.21.15.6:0/576217217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55959989af10 0x5595998a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 >> 172.21.15.6:0/576217217 conn(0x5595997efc80 msgr2=0x5595998a3750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 shutdown_connections 2023-09-13T09:58:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 1 -- 172.21.15.6:0/576217217 wait complete. 2023-09-13T09:58:58.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.199+0000 7f8ded303b80 20 client.29729 trim_cache size 0 max 16384 2023-09-13T09:58:58.210 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8dc40a0640 msgr2=0x7f8dc40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8dc40a0640 0x7f8dc40a2b00 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f8dd0009c60 tx=0x7f8dd0009260 comp rx=0 tx=0).stop 2023-09-13T09:58:58.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc0ffcc0 msgr2=0x7f8ddc196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc0ffcc0 0x7f8ddc196ba0 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc00e970 tx=0x7f8dcc00ec80 comp rx=0 tx=0).stop 2023-09-13T09:58:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 shutdown_connections 2023-09-13T09:58:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8ddc101850 0x7f8ddc19e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f8dc40a0640 0x7f8dc40a2b00 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ddc0ffcc0 0x7f8ddc196ba0 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 --2- 172.21.15.6:0/2580110493 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f8ddc100eb0 0x7f8ddc1970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 >> 172.21.15.6:0/2580110493 conn(0x7f8ddc0fb250 msgr2=0x7f8ddc0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 shutdown_connections 2023-09-13T09:58:58.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.200+0000 7f8de111e700 1 -- 172.21.15.6:0/2580110493 wait complete. 2023-09-13T09:58:58.216 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:58:58.250 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:58 smithi006 ceph-mon[98665]: pgmap v883: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.8 MiB/s wr, 674 op/s 2023-09-13T09:58:58.250 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:58:58 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2020654958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:58:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 -- 172.21.15.6:0/892093134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 msgr2=0x7f5f781012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/892093134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f781012e0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0099c0 tx=0x7f5f6c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 -- 172.21.15.6:0/892093134 shutdown_connections 2023-09-13T09:58:58.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/892093134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f78101820 0x7f5f781080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/892093134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f780ffc90 0x7f5f781000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/892093134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f781012e0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 -- 172.21.15.6:0/892093134 >> 172.21.15.6:0/892093134 conn(0x7f5f780fb220 msgr2=0x7f5f780fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 -- 172.21.15.6:0/892093134 shutdown_connections 2023-09-13T09:58:58.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 -- 172.21.15.6:0/892093134 wait complete. 2023-09-13T09:58:58.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 Processor -- start 2023-09-13T09:58:58.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.383+0000 7f5f7dc98700 1 -- start start 2023-09-13T09:58:58.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f7dc98700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f780ffc90 0x7f5f78196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f7dc98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f78196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f7dc98700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f78101820 0x7f5f7819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f7dc98700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7819e5d0 con 0x7f5f78100e80 2023-09-13T09:58:58.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f7dc98700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7819e710 con 0x7f5f780ffc90 2023-09-13T09:58:58.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f7dc98700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f7819e8a0 con 0x7f5f78101820 2023-09-13T09:58:58.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f78196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f780ffc90 0x7f5f78196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f78196f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45942/0 (socket says 172.21.15.6:45942) 2023-09-13T09:58:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 -- 172.21.15.6:0/3028843193 learned_addr learned my addr 172.21.15.6:0/3028843193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f77fff700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f78101820 0x7f5f7819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 -- 172.21.15.6:0/3028843193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f78101820 msgr2=0x7f5f7819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f78101820 0x7f5f7819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 -- 172.21.15.6:0/3028843193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f780ffc90 msgr2=0x7f5f78196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f780ffc90 0x7f5f78196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 -- 172.21.15.6:0/3028843193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0095f0 con 0x7f5f78100e80 2023-09-13T09:58:58.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f777fe700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f780ffc90 0x7f5f78196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.384+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f78196f90 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009990 tx=0x7f5f6c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.385+0000 7f5f74ff9700 1 -- 172.21.15.6:0/3028843193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c01d070 con 0x7f5f78100e80 2023-09-13T09:58:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.385+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7819eb20 con 0x7f5f78100e80 2023-09-13T09:58:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.385+0000 7f5f74ff9700 1 -- 172.21.15.6:0/3028843193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f6c005030 con 0x7f5f78100e80 2023-09-13T09:58:58.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.385+0000 7f5f74ff9700 1 -- 172.21.15.6:0/3028843193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c004a70 con 0x7f5f78100e80 2023-09-13T09:58:58.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.385+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f7819ef40 con 0x7f5f78100e80 2023-09-13T09:58:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 Processor -- start 2023-09-13T09:58:58.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 -- start start 2023-09-13T09:58:58.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127a5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a6060 0x5561127a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a4a00 0x5561127a4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561126fd780 con 0x5561127a6060 2023-09-13T09:58:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561126fb0a0 con 0x5561127a4a00 2023-09-13T09:58:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561126f6990 con 0x5561127a5700 2023-09-13T09:58:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f74ff9700 1 -- 172.21.15.6:0/3028843193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5f6c005410 con 0x7f5f78100e80 2023-09-13T09:58:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a6060 0x5561127a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a6060 0x5561127a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45948/0 (socket says 172.21.15.6:45948) 2023-09-13T09:58:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f777fe700 1 -- 172.21.15.6:0/1384096273 learned_addr learned my addr 172.21.15.6:0/1384096273 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f77fff700 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127a5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.390+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a4a00 0x5561127a4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f777fe700 1 -- 172.21.15.6:0/1384096273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 msgr2=0x5561127a5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f777fe700 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127a5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f777fe700 1 -- 172.21.15.6:0/1384096273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a4a00 msgr2=0x5561127a4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f777fe700 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a4a00 0x5561127a4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f777fe700 1 -- 172.21.15.6:0/1384096273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556112576630 con 0x5561127a6060 2023-09-13T09:58:58.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f77fff700 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:58:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f777fe700 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a6060 0x5561127a44c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5f680115c0 tx=0x7f5f680118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc58fd03bb35a1ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f74ff9700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5f600a06c0 0x7f5f600a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f5dffb700 1 -- 172.21.15.6:0/1384096273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68004220 con 0x5561127a6060 2023-09-13T09:58:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f77fff700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5f600a06c0 0x7f5f600a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f74ff9700 1 -- 172.21.15.6:0/3028843193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5f6c0cca20 con 0x7f5f78100e80 2023-09-13T09:58:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f5dffb700 1 -- 172.21.15.6:0/1384096273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f68004cf0 con 0x5561127a6060 2023-09-13T09:58:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.391+0000 7f5f5dffb700 1 -- 172.21.15.6:0/1384096273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68005650 con 0x5561127a6060 2023-09-13T09:58:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1384096273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a6060 msgr2=0x5561127a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f77fff700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5f600a06c0 0x7f5f600a2b80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009550 tx=0x7f5f7000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a6060 0x5561127a44c0 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f5f680115c0 tx=0x7f5f680118d0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1384096273 shutdown_connections 2023-09-13T09:58:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a4a00 0x5561127a4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127a5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1384096273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a6060 0x5561127a44c0 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1384096273 >> 172.21.15.6:0/1384096273 conn(0x556112702c80 msgr2=0x55611279ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1384096273 shutdown_connections 2023-09-13T09:58:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.392+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1384096273 wait complete. 2023-09-13T09:58:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.393+0000 7f5f89e7db80 1 -- start start 2023-09-13T09:58:58.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.393+0000 7f5f89e7db80 1 Processor -- start 2023-09-13T09:58:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a5700 0x5561127b2800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a6060 0x5561127b9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x556112694bb0 con 0x5561127a4a00 2023-09-13T09:58:58.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561126948b0 con 0x5561127a5700 2023-09-13T09:58:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x556112578920 con 0x5561127a6060 2023-09-13T09:58:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f89e7db80 10 client.0 _ll_register_callbacks cb 0x556112692680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a5700 0x5561127b2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a5700 0x5561127b2800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39480/0 (socket says 172.21.15.6:39480) 2023-09-13T09:58:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1569027064 learned_addr learned my addr 172.21.15.6:0/1569027064 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f777fe700 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b22c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45954/0 (socket says 172.21.15.6:45954) 2023-09-13T09:58:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f77fff700 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a6060 0x5561127b9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a6060 msgr2=0x5561127b9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a6060 0x5561127b9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1569027064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 msgr2=0x5561127b22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1569027064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f68009d50 con 0x5561127a5700 2023-09-13T09:58:58.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a5700 0x5561127b2800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0a1ca0 tx=0x7f5f6c00fdb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d6afa3e3efb34c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.394+0000 7f5f56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:58:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f56ffd700 1 -- 172.21.15.6:0/1569027064 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c099d30 con 0x5561127a5700 2023-09-13T09:58:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f56ffd700 1 -- 172.21.15.6:0/1569027064 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5f6c09a8f0 con 0x5561127a5700 2023-09-13T09:58:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556112797670 con 0x5561127a5700 2023-09-13T09:58:58.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f56ffd700 1 -- 172.21.15.6:0/1569027064 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f6c099b50 con 0x5561127a5700 2023-09-13T09:58:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 10 client.29741 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55611270e7a0 con 0x5561127a5700 2023-09-13T09:58:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f56ffd700 1 -- 172.21.15.6:0/1569027064 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x556112797670 con 0x5561127a5700 2023-09-13T09:58:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f56ffd700 1 -- 172.21.15.6:0/1569027064 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5f6c0996e0 con 0x5561127a5700 2023-09-13T09:58:58.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 10 client.29741 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 10 client.29741 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:58:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 20 client.29741 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x5561127c0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 4 client.29741 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:58.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.395+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561126ef970 con 0x5561127bdde0 2023-09-13T09:58:58.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.396+0000 7f5f777fe700 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x5561127c0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.396+0000 7f5f56ffd700 10 client.29741 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:58.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.396+0000 7f5f777fe700 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x5561127c0200 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7749d2dd42400f3 server_cookie=856fea50d743412f in_seq=0 out_seq=0 2023-09-13T09:58:58.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.397+0000 7f5f56ffd700 1 -- 172.21.15.6:0/1569027064 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561126ef970 con 0x5561127bdde0 2023-09-13T09:58:58.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.397+0000 7f5f56ffd700 10 client.29741 handle_command_reply: tid=0 2023-09-13T09:58:58.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.397+0000 7f5f89e7db80 1 client.29741 shutdown 2023-09-13T09:58:58.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a5700 msgr2=0x5561127b2800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a5700 0x5561127b2800 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c0a1ca0 tx=0x7f5f6c00fdb0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 shutdown_connections 2023-09-13T09:58:58.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x5561127c0200 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a6060 0x5561127b9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f56ffd700 0 client.29741 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:58.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1569027064 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a5700 0x5561127b2800 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 >> 172.21.15.6:0/1569027064 conn(0x556112702c80 msgr2=0x5561127997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 shutdown_connections 2023-09-13T09:58:58.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1569027064 wait complete. 2023-09-13T09:58:58.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.398+0000 7f5f89e7db80 20 client.29741 trim_cache size 0 max 16384 2023-09-13T09:58:58.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 Processor -- start 2023-09-13T09:58:58.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 -- start start 2023-09-13T09:58:58.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a4a00 0x5561127a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a5700 0x5561127b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127ba130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561127bd8f0 con 0x5561127a5700 2023-09-13T09:58:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561127abbe0 con 0x5561127a6060 2023-09-13T09:58:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561127a94f0 con 0x5561127a4a00 2023-09-13T09:58:58.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a5700 0x5561127b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f77fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127ba130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f76ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a5700 0x5561127b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45964/0 (socket says 172.21.15.6:45964) 2023-09-13T09:58:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1439659720 learned_addr learned my addr 172.21.15.6:0/1439659720 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.414+0000 7f5f777fe700 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a4a00 0x5561127a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1439659720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a4a00 msgr2=0x5561127a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a4a00 0x5561127a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1439659720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 msgr2=0x5561127ba130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127ba130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f76ffd700 1 -- 172.21.15.6:0/1439659720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556112522de0 con 0x5561127a5700 2023-09-13T09:58:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a5700 0x5561127b0900 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00bf40 tx=0x7f5f6c09a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f89efbe138edf1b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f5e7fc700 1 -- 172.21.15.6:0/1439659720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c0a0a90 con 0x5561127a5700 2023-09-13T09:58:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f5e7fc700 1 -- 172.21.15.6:0/1439659720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f6c0d24b0 con 0x5561127a5700 2023-09-13T09:58:58.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.415+0000 7f5f5e7fc700 1 -- 172.21.15.6:0/1439659720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c09e020 con 0x5561127a5700 2023-09-13T09:58:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.416+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1439659720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a5700 msgr2=0x5561127b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.416+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a5700 0x5561127b0900 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c00bf40 tx=0x7f5f6c09a810 comp rx=0 tx=0).stop 2023-09-13T09:58:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1439659720 shutdown_connections 2023-09-13T09:58:58.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127ba130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a4a00 0x5561127a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/1439659720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a5700 0x5561127b0900 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1439659720 >> 172.21.15.6:0/1439659720 conn(0x556112702c80 msgr2=0x5561127b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1439659720 shutdown_connections 2023-09-13T09:58:58.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 -- 172.21.15.6:0/1439659720 wait complete. 2023-09-13T09:58:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 -- start start 2023-09-13T09:58:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.417+0000 7f5f89e7db80 1 Processor -- start 2023-09-13T09:58:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f89e7db80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127b9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561127b0af0 con 0x5561127a4a00 2023-09-13T09:58:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561127b0c60 con 0x5561127a6060 2023-09-13T09:58:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f89e7db80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561127aef30 con 0x5561127a5700 2023-09-13T09:58:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f89e7db80 10 client.0 _ll_register_callbacks cb 0x556112692680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45968/0 (socket says 172.21.15.6:45968) 2023-09-13T09:58:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 -- 172.21.15.6:0/2287393588 learned_addr learned my addr 172.21.15.6:0/2287393588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f77fff700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 -- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 msgr2=0x5561127ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 -- 172.21.15.6:0/2287393588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 msgr2=0x5561127b9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127b9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f777fe700 1 -- 172.21.15.6:0/2287393588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55611270e7a0 con 0x5561127a4a00 2023-09-13T09:58:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.418+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:58:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f777fe700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b03e0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5f680092a0 tx=0x7f5f68005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6098622bea4a03 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f56ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f56ffd700 1 -- 172.21.15.6:0/2287393588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f68029d30 con 0x5561127a4a00 2023-09-13T09:58:58.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f56ffd700 1 -- 172.21.15.6:0/2287393588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5f680290b0 con 0x5561127a4a00 2023-09-13T09:58:58.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f68004cf0 con 0x5561127a4a00 2023-09-13T09:58:58.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f56ffd700 1 -- 172.21.15.6:0/2287393588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f68029e90 con 0x5561127a4a00 2023-09-13T09:58:58.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f89e7db80 10 client.20538 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55611250bc60 con 0x5561127a4a00 2023-09-13T09:58:58.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.419+0000 7f5f56ffd700 1 -- 172.21.15.6:0/2287393588 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5f68004cf0 con 0x5561127a4a00 2023-09-13T09:58:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f56ffd700 1 -- 172.21.15.6:0/2287393588 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f5f68026450 con 0x5561127a4a00 2023-09-13T09:58:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f89e7db80 10 client.20538 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f89e7db80 10 client.20538 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:58:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f89e7db80 20 client.20538 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x556112810b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f89e7db80 4 client.20538 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:58.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5561126b0050 con 0x5561127bdde0 2023-09-13T09:58:58.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x556112810b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f56ffd700 10 client.20538 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:58.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.420+0000 7f5f76ffd700 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x556112810b70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=775ad029f8c76cd0 server_cookie=f42d7b1ddb29bd46 in_seq=0 out_seq=0 2023-09-13T09:58:58.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f56ffd700 1 -- 172.21.15.6:0/2287393588 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5561126b0050 con 0x5561127bdde0 2023-09-13T09:58:58.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f56ffd700 10 client.20538 handle_command_reply: tid=0 2023-09-13T09:58:58.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 client.20538 shutdown 2023-09-13T09:58:58.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 msgr2=0x5561127b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b03e0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5f680092a0 tx=0x7f5f68005640 comp rx=0 tx=0).stop 2023-09-13T09:58:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 shutdown_connections 2023-09-13T09:58:58.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x5561127bdde0 0x556112810b70 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5561127a6060 0x5561127b9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5561127a4a00 0x5561127b03e0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 --2- 172.21.15.6:0/2287393588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5561127a5700 0x5561127ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 >> 172.21.15.6:0/2287393588 conn(0x556112702c80 msgr2=0x5561127abe30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f56ffd700 0 client.20538 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:58:58.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 shutdown_connections 2023-09-13T09:58:58.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 1 -- 172.21.15.6:0/2287393588 wait complete. 2023-09-13T09:58:58.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.421+0000 7f5f89e7db80 20 client.20538 trim_cache size 0 max 16384 2023-09-13T09:58:58.443 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:58.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5f600a06c0 msgr2=0x7f5f600a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5f600a06c0 0x7f5f600a2b80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f5f70009550 tx=0x7f5f7000b040 comp rx=0 tx=0).stop 2023-09-13T09:58:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 msgr2=0x7f5f78196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f78196f90 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c009990 tx=0x7f5f6c00f690 comp rx=0 tx=0).stop 2023-09-13T09:58:58.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 shutdown_connections 2023-09-13T09:58:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f78101820 0x7f5f7819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5f780ffc90 0x7f5f78196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5f600a06c0 0x7f5f600a2b80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 --2- 172.21.15.6:0/3028843193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f78100e80 0x7f5f78196f90 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 >> 172.21.15.6:0/3028843193 conn(0x7f5f780fb220 msgr2=0x7f5f78069160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 shutdown_connections 2023-09-13T09:58:58.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.422+0000 7f5f7dc98700 1 -- 172.21.15.6:0/3028843193 wait complete. 2023-09-13T09:58:58.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:58:58.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:58 smithi053 ceph-mon[102373]: pgmap v883: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.8 MiB/s wr, 674 op/s 2023-09-13T09:58:58.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:58:58 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2020654958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:58:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:58 smithi131 ceph-mon[102785]: pgmap v883: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.8 MiB/s wr, 674 op/s 2023-09-13T09:58:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:58:58 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2020654958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:58:58.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 257117 35.61 MB/sec execute 258 sec latency 96.681 ms 2023-09-13T09:58:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.651+0000 7f169c847700 1 -- 172.21.15.6:0/594297037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16980ffc70 msgr2=0x7f1698100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.651+0000 7f169c847700 1 --2- 172.21.15.6:0/594297037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16980ffc70 0x7f1698100090 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1688009920 tx=0x7f1688009c30 comp rx=0 tx=0).stop 2023-09-13T09:58:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.651+0000 7f169c847700 1 -- 172.21.15.6:0/594297037 shutdown_connections 2023-09-13T09:58:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.651+0000 7f169c847700 1 --2- 172.21.15.6:0/594297037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698101800 0x7f16981080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.651+0000 7f169c847700 1 --2- 172.21.15.6:0/594297037 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f16980ffc70 0x7f1698100090 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.651+0000 7f169c847700 1 --2- 172.21.15.6:0/594297037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1698100e60 0x7f16981012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.651+0000 7f169c847700 1 -- 172.21.15.6:0/594297037 >> 172.21.15.6:0/594297037 conn(0x7f16980fb1c0 msgr2=0x7f16980fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.652+0000 7f169c847700 1 -- 172.21.15.6:0/594297037 shutdown_connections 2023-09-13T09:58:58.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.652+0000 7f169c847700 1 -- 172.21.15.6:0/594297037 wait complete. 2023-09-13T09:58:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.652+0000 7f169c847700 1 Processor -- start 2023-09-13T09:58:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169c847700 1 -- start start 2023-09-13T09:58:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169c847700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16980ffc70 0x7f1698195a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169c847700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698100e60 0x7f1698195fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169c847700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1698101800 0x7f169819d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169c847700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169819d610 con 0x7f1698100e60 2023-09-13T09:58:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169c847700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169819d750 con 0x7f1698101800 2023-09-13T09:58:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169c847700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169819d8e0 con 0x7f16980ffc70 2023-09-13T09:58:58.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698100e60 0x7f1698195fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f169659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16980ffc70 0x7f1698195a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1696d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1698101800 0x7f169819d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698100e60 0x7f1698195fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45984/0 (socket says 172.21.15.6:45984) 2023-09-13T09:58:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 -- 172.21.15.6:0/3839397441 learned_addr learned my addr 172.21.15.6:0/3839397441 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 -- 172.21.15.6:0/3839397441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16980ffc70 msgr2=0x7f1698195a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16980ffc70 0x7f1698195a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 -- 172.21.15.6:0/3839397441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1698101800 msgr2=0x7f169819d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1698101800 0x7f169819d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.653+0000 7f1695d9b700 1 -- 172.21.15.6:0/3839397441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1690009d00 con 0x7f1698100e60 2023-09-13T09:58:58.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.654+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698100e60 0x7f1698195fd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f168400e9a0 tx=0x7f168400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.654+0000 7f168f7fe700 1 -- 172.21.15.6:0/3839397441 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684009790 con 0x7f1698100e60 2023-09-13T09:58:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.654+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1688009520 con 0x7f1698100e60 2023-09-13T09:58:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.654+0000 7f168f7fe700 1 -- 172.21.15.6:0/3839397441 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1684010430 con 0x7f1698100e60 2023-09-13T09:58:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.654+0000 7f168f7fe700 1 -- 172.21.15.6:0/3839397441 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684018680 con 0x7f1698100e60 2023-09-13T09:58:58.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.654+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169819df40 con 0x7f1698100e60 2023-09-13T09:58:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.656+0000 7f168f7fe700 1 -- 172.21.15.6:0/3839397441 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f16840105a0 con 0x7f1698100e60 2023-09-13T09:58:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.657+0000 7f168f7fe700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f167c0a0640 0x7f167c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.657+0000 7f168f7fe700 1 -- 172.21.15.6:0/3839397441 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1684014070 con 0x7f1698100e60 2023-09-13T09:58:58.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.657+0000 7f169659c700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f167c0a0640 0x7f167c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f169659c700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f167c0a0640 0x7f167c0a2b00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f16880098f0 tx=0x7f1688019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 Processor -- start 2023-09-13T09:58:58.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 -- start start 2023-09-13T09:58:58.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeff3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4220 0x55abaeff46a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4be0 0x55abaeff5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaef4a780 con 0x55abaeff4220 2023-09-13T09:58:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaef480a0 con 0x55abaeff4be0 2023-09-13T09:58:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.658+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaef43990 con 0x55abaeff38c0 2023-09-13T09:58:58.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4220 0x55abaeff46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f169659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeff3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4220 0x55abaeff46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45992/0 (socket says 172.21.15.6:45992) 2023-09-13T09:58:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 -- 172.21.15.6:0/3057171219 learned_addr learned my addr 172.21.15.6:0/3057171219 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1696d9d700 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4be0 0x55abaeff5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 -- 172.21.15.6:0/3057171219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 msgr2=0x55abaeff3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeff3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 -- 172.21.15.6:0/3057171219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4be0 msgr2=0x55abaeff5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4be0 0x55abaeff5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 -- 172.21.15.6:0/3057171219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abaedc3630 con 0x55abaeff4220 2023-09-13T09:58:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4220 0x55abaeff46a0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f1684095a10 tx=0x7f1684099410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a3722cecac15ff9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f168cff9700 1 -- 172.21.15.6:0/3057171219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168409d120 con 0x55abaeff4220 2023-09-13T09:58:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f168cff9700 1 -- 172.21.15.6:0/3057171219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1684099510 con 0x55abaeff4220 2023-09-13T09:58:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.659+0000 7f168cff9700 1 -- 172.21.15.6:0/3057171219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16840109f0 con 0x55abaeff4220 2023-09-13T09:58:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3057171219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4220 msgr2=0x55abaeff46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4220 0x55abaeff46a0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f1684095a10 tx=0x7f1684099410 comp rx=0 tx=0).stop 2023-09-13T09:58:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3057171219 shutdown_connections 2023-09-13T09:58:58.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4be0 0x55abaeff5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeff3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3057171219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4220 0x55abaeff46a0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3057171219 >> 172.21.15.6:0/3057171219 conn(0x55abaef4fc80 msgr2=0x55abaefebf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3057171219 shutdown_connections 2023-09-13T09:58:58.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.660+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3057171219 wait complete. 2023-09-13T09:58:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 -- start start 2023-09-13T09:58:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 Processor -- start 2023-09-13T09:58:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeffd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaeffd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf004720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaeee1bb0 con 0x55abaeff4be0 2023-09-13T09:58:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaeee18b0 con 0x55abaeff4220 2023-09-13T09:58:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaedc5920 con 0x55abaeff38c0 2023-09-13T09:58:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f16a8a2cb80 10 client.0 _ll_register_callbacks cb 0x55abaeedf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f1696d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf004720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f1696d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf004720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46000/0 (socket says 172.21.15.6:46000) 2023-09-13T09:58:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f1696d9d700 1 -- 172.21.15.6:0/3545742950 learned_addr learned my addr 172.21.15.6:0/3545742950 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f169659c700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeffd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.661+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaeffd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1696d9d700 1 -- 172.21.15.6:0/3545742950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 msgr2=0x55abaeffd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1696d9d700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeffd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1696d9d700 1 -- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 msgr2=0x55abaeffd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1696d9d700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaeffd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1696d9d700 1 -- 172.21.15.6:0/3545742950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169819df40 con 0x55abaeff4be0 2023-09-13T09:58:58.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1695d9b700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaeffd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:58:58.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1696d9d700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf004720 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f1690007870 tx=0x7f1690007b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb42aa0c3e4c5a63 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1679ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:58.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1679ffb700 1 -- 172.21.15.6:0/3545742950 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169000e070 con 0x55abaeff4be0 2023-09-13T09:58:58.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55abaefe4670 con 0x55abaeff4be0 2023-09-13T09:58:58.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1679ffb700 1 -- 172.21.15.6:0/3545742950 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1690004570 con 0x55abaeff4be0 2023-09-13T09:58:58.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1679ffb700 1 -- 172.21.15.6:0/3545742950 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1690004770 con 0x55abaeff4be0 2023-09-13T09:58:58.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f16a8a2cb80 10 client.20550 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55abaef5b7a0 con 0x55abaeff4be0 2023-09-13T09:58:58.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.662+0000 7f1679ffb700 1 -- 172.21.15.6:0/3545742950 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55abaefe4670 con 0x55abaeff4be0 2023-09-13T09:58:58.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f1679ffb700 1 -- 172.21.15.6:0/3545742950 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f169001e4d0 con 0x55abaeff4be0 2023-09-13T09:58:58.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f16a8a2cb80 10 client.20550 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f16a8a2cb80 10 client.20550 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:58:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f16a8a2cb80 20 client.20550 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf009020 0x55abaf00b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f16a8a2cb80 4 client.20550 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55abaef3c970 con 0x55abaf009020 2023-09-13T09:58:58.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f169659c700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf009020 0x55abaf00b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f1679ffb700 10 client.20550 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:58.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.663+0000 7f169659c700 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf009020 0x55abaf00b440 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=306cebbabc1d4861 server_cookie=504b2680aa6e3b9a in_seq=0 out_seq=0 2023-09-13T09:58:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f1679ffb700 1 -- 172.21.15.6:0/3545742950 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55abaef3c970 con 0x55abaf009020 2023-09-13T09:58:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f1679ffb700 10 client.20550 handle_command_reply: tid=0 2023-09-13T09:58:58.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 client.20550 shutdown 2023-09-13T09:58:58.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 msgr2=0x55abaf004720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf004720 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f1690007870 tx=0x7f1690007b80 comp rx=0 tx=0).stop 2023-09-13T09:58:58.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 shutdown_connections 2023-09-13T09:58:58.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf009020 0x55abaf00b440 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf004720 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaeffd1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/3545742950 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaeffd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.666+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 >> 172.21.15.6:0/3545742950 conn(0x55abaef4fc80 msgr2=0x55abaefe67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.667+0000 7f1679ffb700 0 client.20550 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.667+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 shutdown_connections 2023-09-13T09:58:58.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.667+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/3545742950 wait complete. 2023-09-13T09:58:58.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.667+0000 7f16a8a2cb80 20 client.20550 trim_cache size 0 max 16384 2023-09-13T09:58:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.686+0000 7f16a8a2cb80 1 Processor -- start 2023-09-13T09:58:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.686+0000 7f16a8a2cb80 1 -- start start 2023-09-13T09:58:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.686+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaf00b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.686+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaf004640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.686+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaeff7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaeffcd70 con 0x55abaeff4be0 2023-09-13T09:58:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaf004b80 con 0x55abaeff4220 2023-09-13T09:58:58.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaefed9f0 con 0x55abaeff38c0 2023-09-13T09:58:58.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaeff7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f169659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaf00b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaeff7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46008/0 (socket says 172.21.15.6:46008) 2023-09-13T09:58:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 -- 172.21.15.6:0/2262732008 learned_addr learned my addr 172.21.15.6:0/2262732008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1695d9b700 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaf004640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 -- 172.21.15.6:0/2262732008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 msgr2=0x55abaf00b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaf00b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 -- 172.21.15.6:0/2262732008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 msgr2=0x55abaf004640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaf004640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 -- 172.21.15.6:0/2262732008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55abaed6fde0 con 0x55abaeff4be0 2023-09-13T09:58:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f1696d9d700 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaeff7b90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f1690005c30 tx=0x7f169001e9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=444a8647e042b3d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.687+0000 7f168d7fa700 1 -- 172.21.15.6:0/2262732008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001ee00 con 0x55abaeff4be0 2023-09-13T09:58:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f168d7fa700 1 -- 172.21.15.6:0/2262732008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f169000f040 con 0x55abaeff4be0 2023-09-13T09:58:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f168d7fa700 1 -- 172.21.15.6:0/2262732008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001f440 con 0x55abaeff4be0 2023-09-13T09:58:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/2262732008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 msgr2=0x55abaeff7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaeff7b90 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f1690005c30 tx=0x7f169001e9d0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/2262732008 shutdown_connections 2023-09-13T09:58:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaeff7b90 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff38c0 0x55abaf00b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/2262732008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff4220 0x55abaf004640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/2262732008 >> 172.21.15.6:0/2262732008 conn(0x55abaef4fc80 msgr2=0x55abaeffbdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/2262732008 shutdown_connections 2023-09-13T09:58:58.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.688+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/2262732008 wait complete. 2023-09-13T09:58:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 -- start start 2023-09-13T09:58:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 Processor -- start 2023-09-13T09:58:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff38c0 0x55abaeffe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff4220 0x55abaeffeda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf003840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaf003d80 con 0x55abaeff4be0 2023-09-13T09:58:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaf003ef0 con 0x55abaeff38c0 2023-09-13T09:58:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55abaf0040b0 con 0x55abaeff4220 2023-09-13T09:58:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f16a8a2cb80 10 client.0 _ll_register_callbacks cb 0x55abaeedf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f1696d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf003840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f169659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff38c0 0x55abaeffe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f1696d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf003840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46014/0 (socket says 172.21.15.6:46014) 2023-09-13T09:58:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f1696d9d700 1 -- 172.21.15.6:0/1410074802 learned_addr learned my addr 172.21.15.6:0/1410074802 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.689+0000 7f1695d9b700 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff4220 0x55abaeffeda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1696d9d700 1 -- 172.21.15.6:0/1410074802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff4220 msgr2=0x55abaeffeda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1696d9d700 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff4220 0x55abaeffeda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1696d9d700 1 -- 172.21.15.6:0/1410074802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff38c0 msgr2=0x55abaeffe860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1696d9d700 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff38c0 0x55abaeffe860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1696d9d700 1 -- 172.21.15.6:0/1410074802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55abaef5b7a0 con 0x55abaeff4be0 2023-09-13T09:58:58.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1696d9d700 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf003840 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f1690007bc0 tx=0x7f169001e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f407601650638d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1679ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1679ffb700 1 -- 172.21.15.6:0/1410074802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001ea70 con 0x55abaeff4be0 2023-09-13T09:58:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1684099510 con 0x55abaeff4be0 2023-09-13T09:58:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1679ffb700 1 -- 172.21.15.6:0/1410074802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1690005620 con 0x55abaeff4be0 2023-09-13T09:58:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1679ffb700 1 -- 172.21.15.6:0/1410074802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f16900057e0 con 0x55abaeff4be0 2023-09-13T09:58:58.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f16a8a2cb80 10 client.20556 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55abaed58c60 con 0x55abaeff4be0 2023-09-13T09:58:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.690+0000 7f1679ffb700 1 -- 172.21.15.6:0/1410074802 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1690044020 con 0x55abaeff4be0 2023-09-13T09:58:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f1679ffb700 1 -- 172.21.15.6:0/1410074802 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f169001f440 con 0x55abaeff4be0 2023-09-13T09:58:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f16a8a2cb80 10 client.20556 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f16a8a2cb80 10 client.20556 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:58:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f16a8a2cb80 20 client.20556 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf05b9d0 0x55abaf05ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f16a8a2cb80 4 client.20556 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55abaeefd050 con 0x55abaf05b9d0 2023-09-13T09:58:58.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f169659c700 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf05b9d0 0x55abaf05ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f1679ffb700 10 client.20556 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:58.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.691+0000 7f169659c700 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf05b9d0 0x55abaf05ddc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a4d28a00617c9a41 server_cookie=188675ebe53800a in_seq=0 out_seq=0 2023-09-13T09:58:58.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f1679ffb700 1 -- 172.21.15.6:0/1410074802 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55abaeefd050 con 0x55abaf05b9d0 2023-09-13T09:58:58.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f1679ffb700 10 client.20556 handle_command_reply: tid=0 2023-09-13T09:58:58.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 client.20556 shutdown 2023-09-13T09:58:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 msgr2=0x55abaf003840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf003840 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7f1690007bc0 tx=0x7f169001e6c0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 shutdown_connections 2023-09-13T09:58:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55abaf05b9d0 0x55abaf05ddc0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55abaeff4be0 0x55abaf003840 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55abaeff38c0 0x55abaeffe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f1679ffb700 0 client.20556 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:58:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 --2- 172.21.15.6:0/1410074802 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55abaeff4220 0x55abaeffeda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 >> 172.21.15.6:0/1410074802 conn(0x55abaef4fc80 msgr2=0x55abaf004f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 shutdown_connections 2023-09-13T09:58:58.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 1 -- 172.21.15.6:0/1410074802 wait complete. 2023-09-13T09:58:58.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.693+0000 7f16a8a2cb80 20 client.20556 trim_cache size 0 max 16384 2023-09-13T09:58:58.708 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:58.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f167c0a0640 msgr2=0x7f167c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f167c0a0640 0x7f167c0a2b00 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f16880098f0 tx=0x7f1688019040 comp rx=0 tx=0).stop 2023-09-13T09:58:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698100e60 msgr2=0x7f1698195fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698100e60 0x7f1698195fd0 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f168400e9a0 tx=0x7f168400ecb0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 shutdown_connections 2023-09-13T09:58:58.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1698101800 0x7f169819d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16980ffc70 0x7f1698195a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f167c0a0640 0x7f167c0a2b00 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 --2- 172.21.15.6:0/3839397441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1698100e60 0x7f1698195fd0 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 >> 172.21.15.6:0/3839397441 conn(0x7f16980fb1c0 msgr2=0x7f16981044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 shutdown_connections 2023-09-13T09:58:58.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.694+0000 7f169c847700 1 -- 172.21.15.6:0/3839397441 wait complete. 2023-09-13T09:58:58.712 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:58:58.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 -- 172.21.15.6:0/1891479367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84100fd0 msgr2=0x7fbc84107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/1891479367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84100fd0 0x7fbc84107880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c009f90 tx=0x7fbc7c00b330 comp rx=0 tx=0).stop 2023-09-13T09:58:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 -- 172.21.15.6:0/1891479367 shutdown_connections 2023-09-13T09:58:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/1891479367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84100fd0 0x7fbc84107880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/1891479367 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc840ff440 0x7fbc840ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/1891479367 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc84100630 0x7fbc84100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 -- 172.21.15.6:0/1891479367 >> 172.21.15.6:0/1891479367 conn(0x7fbc840fa9b0 msgr2=0x7fbc840fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 -- 172.21.15.6:0/1891479367 shutdown_connections 2023-09-13T09:58:58.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.873+0000 7fbc89ffa700 1 -- 172.21.15.6:0/1891479367 wait complete. 2023-09-13T09:58:58.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.874+0000 7fbc89ffa700 1 Processor -- start 2023-09-13T09:58:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.874+0000 7fbc89ffa700 1 -- start start 2023-09-13T09:58:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc89ffa700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc840ff440 0x7fbc84195290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc89ffa700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc84100630 0x7fbc841957d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc89ffa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc84100fd0 0x7fbc8419c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc89ffa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8419ce10 con 0x7fbc84100fd0 2023-09-13T09:58:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc89ffa700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8419cf50 con 0x7fbc84100630 2023-09-13T09:58:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc89ffa700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8419d0e0 con 0x7fbc840ff440 2023-09-13T09:58:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc84100fd0 0x7fbc8419c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc840ff440 0x7fbc84195290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc84100fd0 0x7fbc8419c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46028/0 (socket says 172.21.15.6:46028) 2023-09-13T09:58:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc84100630 0x7fbc841957d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc83fff700 1 -- 172.21.15.6:0/3773129430 learned_addr learned my addr 172.21.15.6:0/3773129430 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc840ff440 0x7fbc84195290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49078/0 (socket says 172.21.15.6:49078) 2023-09-13T09:58:58.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc837fe700 1 -- 172.21.15.6:0/3773129430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc84100630 msgr2=0x7fbc841957d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc837fe700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc84100630 0x7fbc841957d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc837fe700 1 -- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc84100fd0 msgr2=0x7fbc8419c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc837fe700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc84100fd0 0x7fbc8419c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.875+0000 7fbc837fe700 1 -- 172.21.15.6:0/3773129430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc780095f0 con 0x7fbc840ff440 2023-09-13T09:58:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.876+0000 7fbc837fe700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc840ff440 0x7fbc84195290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbc84100490 tx=0x7fbc7400b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.876+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3773129430 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011830 con 0x7fbc840ff440 2023-09-13T09:58:58.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.876+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3773129430 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc74011e50 con 0x7fbc840ff440 2023-09-13T09:58:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.876+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7c009c40 con 0x7fbc840ff440 2023-09-13T09:58:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.876+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3773129430 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74010de0 con 0x7fbc840ff440 2023-09-13T09:58:58.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.876+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84067a30 con 0x7fbc840ff440 2023-09-13T09:58:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.879+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3773129430 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbc74010480 con 0x7fbc840ff440 2023-09-13T09:58:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.880+0000 7fbc80ff9700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc6c0a06c0 0x7fbc6c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.880+0000 7fbc80ff9700 1 -- 172.21.15.6:0/3773129430 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbc740cb4b0 con 0x7fbc840ff440 2023-09-13T09:58:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.880+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc6c0a06c0 0x7fbc6c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.880+0000 7fbc961dfb80 1 Processor -- start 2023-09-13T09:58:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc961dfb80 1 -- start start 2023-09-13T09:58:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc6c0a06c0 0x7fbc6c0a2b80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbc78005fd0 tx=0x7fbc78009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d2a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d2a870 0x559bc0d28cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29210 0x559bc0d29690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0c79780 con 0x559bc0d29f10 2023-09-13T09:58:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0c770a0 con 0x559bc0d2a870 2023-09-13T09:58:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0c72990 con 0x559bc0d29210 2023-09-13T09:58:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d2a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d2a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46032/0 (socket says 172.21.15.6:46032) 2023-09-13T09:58:58.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 -- 172.21.15.6:0/2081784201 learned_addr learned my addr 172.21.15.6:0/2081784201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc83fff700 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29210 0x559bc0d29690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d2a870 0x559bc0d28cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 -- 172.21.15.6:0/2081784201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29210 msgr2=0x559bc0d29690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29210 0x559bc0d29690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 -- 172.21.15.6:0/2081784201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d2a870 msgr2=0x559bc0d28cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d2a870 0x559bc0d28cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.881+0000 7fbc837fe700 1 -- 172.21.15.6:0/2081784201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bc0af2630 con 0x559bc0d29f10 2023-09-13T09:58:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.882+0000 7fbc837fe700 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d2a330 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbc74098be0 tx=0x7fbc74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dca0af62004c5f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.882+0000 7fbc69ffb700 1 -- 172.21.15.6:0/2081784201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740b6ea0 con 0x559bc0d29f10 2023-09-13T09:58:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.882+0000 7fbc69ffb700 1 -- 172.21.15.6:0/2081784201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc740985b0 con 0x559bc0d29f10 2023-09-13T09:58:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.882+0000 7fbc69ffb700 1 -- 172.21.15.6:0/2081784201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc74097110 con 0x559bc0d29f10 2023-09-13T09:58:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 -- 172.21.15.6:0/2081784201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 msgr2=0x559bc0d2a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d2a330 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbc74098be0 tx=0x7fbc74004750 comp rx=0 tx=0).stop 2023-09-13T09:58:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 -- 172.21.15.6:0/2081784201 shutdown_connections 2023-09-13T09:58:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29210 0x559bc0d29690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d2a330 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/2081784201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d2a870 0x559bc0d28cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 -- 172.21.15.6:0/2081784201 >> 172.21.15.6:0/2081784201 conn(0x559bc0c7ec80 msgr2=0x559bc0d1af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 -- 172.21.15.6:0/2081784201 shutdown_connections 2023-09-13T09:58:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 -- 172.21.15.6:0/2081784201 wait complete. 2023-09-13T09:58:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 -- start start 2023-09-13T09:58:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.883+0000 7fbc961dfb80 1 Processor -- start 2023-09-13T09:58:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d32640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29f10 0x559bc0d32b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d2a870 0x559bc0d39bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0c10bb0 con 0x559bc0d2a870 2023-09-13T09:58:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0c108b0 con 0x559bc0d29210 2023-09-13T09:58:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0af4920 con 0x559bc0d29f10 2023-09-13T09:58:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc961dfb80 10 client.0 _ll_register_callbacks cb 0x559bc0c0e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d32640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d2a870 0x559bc0d39bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29f10 0x559bc0d32b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d32640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39562/0 (socket says 172.21.15.6:39562) 2023-09-13T09:58:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d2a870 0x559bc0d39bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46042/0 (socket says 172.21.15.6:46042) 2023-09-13T09:58:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 -- 172.21.15.6:0/1343200065 learned_addr learned my addr 172.21.15.6:0/1343200065 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 -- 172.21.15.6:0/1343200065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29f10 msgr2=0x559bc0d32b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29f10 0x559bc0d32b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 -- 172.21.15.6:0/1343200065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d2a870 msgr2=0x559bc0d39bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d2a870 0x559bc0d39bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 -- 172.21.15.6:0/1343200065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84067a30 con 0x559bc0d29210 2023-09-13T09:58:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.884+0000 7fbc837fe700 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d32640 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400ba80 tx=0x7fbc74010fb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b0d42a99af2a08b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:58:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc62ffd700 1 -- 172.21.15.6:0/1343200065 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740b6ea0 con 0x559bc0d29210 2023-09-13T09:58:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559bc0d13670 con 0x559bc0d29210 2023-09-13T09:58:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc62ffd700 1 -- 172.21.15.6:0/1343200065 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbc7409ca80 con 0x559bc0d29210 2023-09-13T09:58:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc62ffd700 1 -- 172.21.15.6:0/1343200065 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc740cb2e0 con 0x559bc0d29210 2023-09-13T09:58:58.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 10 client.29774 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x559bc0c8a7a0 con 0x559bc0d29210 2023-09-13T09:58:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc62ffd700 1 -- 172.21.15.6:0/1343200065 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559bc0d13670 con 0x559bc0d29210 2023-09-13T09:58:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc62ffd700 1 -- 172.21.15.6:0/1343200065 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbc7407f080 con 0x559bc0d29210 2023-09-13T09:58:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 10 client.29774 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 10 client.29774 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:58:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 20 client.29774 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d3e040 0x559bc0d40430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 4 client.29774 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.885+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559bc0c6b970 con 0x559bc0d3e040 2023-09-13T09:58:58.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.886+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d3e040 0x559bc0d40430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.886+0000 7fbc62ffd700 10 client.29774 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.886+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d3e040 0x559bc0d40430 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=363f4d2092c4a7d6 server_cookie=2fbc7361bb84f2f2 in_seq=0 out_seq=0 2023-09-13T09:58:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc62ffd700 1 -- 172.21.15.6:0/1343200065 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559bc0c6b970 con 0x559bc0d3e040 2023-09-13T09:58:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc62ffd700 10 client.29774 handle_command_reply: tid=0 2023-09-13T09:58:58.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 client.29774 shutdown 2023-09-13T09:58:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 msgr2=0x559bc0d32640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d32640 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400ba80 tx=0x7fbc74010fb0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 shutdown_connections 2023-09-13T09:58:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d3e040 0x559bc0d40430 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d2a870 0x559bc0d39bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc62ffd700 0 client.29774 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d32640 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/1343200065 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d29f10 0x559bc0d32b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 >> 172.21.15.6:0/1343200065 conn(0x559bc0c7ec80 msgr2=0x559bc0d157f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 shutdown_connections 2023-09-13T09:58:58.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 1 -- 172.21.15.6:0/1343200065 wait complete. 2023-09-13T09:58:58.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.887+0000 7fbc961dfb80 20 client.29774 trim_cache size 0 max 16384 2023-09-13T09:58:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 Processor -- start 2023-09-13T09:58:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 -- start start 2023-09-13T09:58:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d28cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d39b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d2d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0d13650 con 0x559bc0d29f10 2023-09-13T09:58:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0d321b0 con 0x559bc0d29210 2023-09-13T09:58:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0d30360 con 0x559bc0d2a870 2023-09-13T09:58:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d39b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d28cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d39b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46048/0 (socket says 172.21.15.6:46048) 2023-09-13T09:58:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc82ffd700 1 -- 172.21.15.6:0/3705037877 learned_addr learned my addr 172.21.15.6:0/3705037877 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.906+0000 7fbc83fff700 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d2d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc82ffd700 1 -- 172.21.15.6:0/3705037877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 msgr2=0x559bc0d2d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d2d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc82ffd700 1 -- 172.21.15.6:0/3705037877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 msgr2=0x559bc0d28cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d28cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc82ffd700 1 -- 172.21.15.6:0/3705037877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bc0a9ede0 con 0x559bc0d29f10 2023-09-13T09:58:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc837fe700 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d28cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:58.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d39b80 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fbc78013010 tx=0x7fbc78014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dcc89b9279ad0e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc6a7fc700 1 -- 172.21.15.6:0/3705037877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc78022040 con 0x559bc0d29f10 2023-09-13T09:58:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc6a7fc700 1 -- 172.21.15.6:0/3705037877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc78023040 con 0x559bc0d29f10 2023-09-13T09:58:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.907+0000 7fbc6a7fc700 1 -- 172.21.15.6:0/3705037877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc7801d410 con 0x559bc0d29f10 2023-09-13T09:58:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3705037877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 msgr2=0x559bc0d39b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d39b80 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fbc78013010 tx=0x7fbc78014000 comp rx=0 tx=0).stop 2023-09-13T09:58:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3705037877 shutdown_connections 2023-09-13T09:58:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d2d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d28cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3705037877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d39b80 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3705037877 >> 172.21.15.6:0/3705037877 conn(0x559bc0c7ec80 msgr2=0x559bc0d31360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3705037877 shutdown_connections 2023-09-13T09:58:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3705037877 wait complete. 2023-09-13T09:58:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.908+0000 7fbc961dfb80 1 -- start start 2023-09-13T09:58:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 1 Processor -- start 2023-09-13T09:58:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d39870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d36310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d36850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0d36d90 con 0x559bc0d29f10 2023-09-13T09:58:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0d36f00 con 0x559bc0d29210 2023-09-13T09:58:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bc0d91e30 con 0x559bc0d2a870 2023-09-13T09:58:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc961dfb80 10 client.0 _ll_register_callbacks cb 0x559bc0c0e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:58.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d36310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d39870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d36310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46054/0 (socket says 172.21.15.6:46054) 2023-09-13T09:58:58.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc82ffd700 1 -- 172.21.15.6:0/3759265286 learned_addr learned my addr 172.21.15.6:0/3759265286 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc83fff700 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d36850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc837fe700 1 -- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 msgr2=0x559bc0d36850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc837fe700 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d36850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc837fe700 1 -- 172.21.15.6:0/3759265286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 msgr2=0x559bc0d36310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc837fe700 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d36310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.909+0000 7fbc837fe700 1 -- 172.21.15.6:0/3759265286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bc0c8a7a0 con 0x559bc0d29210 2023-09-13T09:58:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc837fe700 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d39870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbc740c92d0 tx=0x7fbc74098790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ed8e12bc5f3206 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc62ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:58:58.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc62ffd700 1 -- 172.21.15.6:0/3759265286 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc740b6ea0 con 0x559bc0d29210 2023-09-13T09:58:58.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbc740985b0 con 0x559bc0d29210 2023-09-13T09:58:58.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc62ffd700 1 -- 172.21.15.6:0/3759265286 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbc7407c020 con 0x559bc0d29210 2023-09-13T09:58:58.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc62ffd700 1 -- 172.21.15.6:0/3759265286 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc740a0cc0 con 0x559bc0d29210 2023-09-13T09:58:58.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc961dfb80 10 client.29780 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:58.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.910+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x7fbc78017070 con 0x559bc0d29210 2023-09-13T09:58:58.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc62ffd700 1 -- 172.21.15.6:0/3759265286 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbc740985b0 con 0x559bc0d29210 2023-09-13T09:58:58.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc62ffd700 1 -- 172.21.15.6:0/3759265286 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fbc740b3070 con 0x559bc0d29210 2023-09-13T09:58:58.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc961dfb80 10 client.29780 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:58.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc961dfb80 10 client.29780 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:58:58.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc961dfb80 20 client.29780 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:58.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d93370 0x559bc0d95790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:58.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc961dfb80 4 client.29780 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:58.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559bc0c2c050 con 0x559bc0d93370 2023-09-13T09:58:58.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.911+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d93370 0x559bc0d95790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc62ffd700 10 client.29780 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d93370 0x559bc0d95790 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f47fc0c20c94cb02 server_cookie=23bf52eabcbc9f40 in_seq=0 out_seq=0 2023-09-13T09:58:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc62ffd700 1 -- 172.21.15.6:0/3759265286 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x559bc0c2c050 con 0x559bc0d93370 2023-09-13T09:58:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc62ffd700 10 client.29780 handle_command_reply: tid=0 2023-09-13T09:58:58.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 client.29780 shutdown 2023-09-13T09:58:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 msgr2=0x559bc0d39870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d39870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fbc740c92d0 tx=0x7fbc74098790 comp rx=0 tx=0).stop 2023-09-13T09:58:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 shutdown_connections 2023-09-13T09:58:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x559bc0d93370 0x559bc0d95790 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559bc0d2a870 0x559bc0d36850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559bc0d29210 0x559bc0d39870 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc62ffd700 0 client.29780 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:58:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 --2- 172.21.15.6:0/3759265286 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559bc0d29f10 0x559bc0d36310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 >> 172.21.15.6:0/3759265286 conn(0x559bc0c7ec80 msgr2=0x559bc0d2d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 shutdown_connections 2023-09-13T09:58:58.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 1 -- 172.21.15.6:0/3759265286 wait complete. 2023-09-13T09:58:58.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.913+0000 7fbc961dfb80 20 client.29780 trim_cache size 0 max 16384 2023-09-13T09:58:58.933 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:58.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc6c0a06c0 msgr2=0x7fbc6c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc6c0a06c0 0x7fbc6c0a2b80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbc78005fd0 tx=0x7fbc78009310 comp rx=0 tx=0).stop 2023-09-13T09:58:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc840ff440 msgr2=0x7fbc84195290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc840ff440 0x7fbc84195290 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fbc84100490 tx=0x7fbc7400b730 comp rx=0 tx=0).stop 2023-09-13T09:58:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 shutdown_connections 2023-09-13T09:58:58.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbc6c0a06c0 0x7fbc6c0a2b80 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc84100fd0 0x7fbc8419c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc840ff440 0x7fbc84195290 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 --2- 172.21.15.6:0/3773129430 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbc84100630 0x7fbc841957d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:58.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 >> 172.21.15.6:0/3773129430 conn(0x7fbc840fa9b0 msgr2=0x7fbc84103af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:58.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 shutdown_connections 2023-09-13T09:58:58.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:58.914+0000 7fbc89ffa700 1 -- 172.21.15.6:0/3773129430 wait complete. 2023-09-13T09:58:58.937 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:58:59.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.099+0000 7f9196169700 1 -- 172.21.15.6:0/2680883922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190100eb0 msgr2=0x7f9190101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.099+0000 7f9196169700 1 --2- 172.21.15.6:0/2680883922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190100eb0 0x7f9190101310 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f9184009920 tx=0x7f9184009c30 comp rx=0 tx=0).stop 2023-09-13T09:58:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.099+0000 7f9196169700 1 -- 172.21.15.6:0/2680883922 shutdown_connections 2023-09-13T09:58:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.100+0000 7f9196169700 1 --2- 172.21.15.6:0/2680883922 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190101850 0x7f9190108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.100+0000 7f9196169700 1 --2- 172.21.15.6:0/2680883922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91900ffcc0 0x7f91901000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.100+0000 7f9196169700 1 --2- 172.21.15.6:0/2680883922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190100eb0 0x7f9190101310 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.100+0000 7f9196169700 1 -- 172.21.15.6:0/2680883922 >> 172.21.15.6:0/2680883922 conn(0x7f91900fb210 msgr2=0x7f91900fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.100+0000 7f9196169700 1 -- 172.21.15.6:0/2680883922 shutdown_connections 2023-09-13T09:58:59.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.100+0000 7f9196169700 1 -- 172.21.15.6:0/2680883922 wait complete. 2023-09-13T09:58:59.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.100+0000 7f9196169700 1 Processor -- start 2023-09-13T09:58:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f9196169700 1 -- start start 2023-09-13T09:58:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f9196169700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91900ffcc0 0x7f9190068cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f9196169700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190100eb0 0x7f9190069230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f9196169700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190101850 0x7f91900697b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f9196169700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190193c40 con 0x7f9190101850 2023-09-13T09:58:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f9196169700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190193db0 con 0x7f9190100eb0 2023-09-13T09:58:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f9196169700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9190193f70 con 0x7f91900ffcc0 2023-09-13T09:58:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f918effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190100eb0 0x7f9190069230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f918effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190100eb0 0x7f9190069230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39590/0 (socket says 172.21.15.6:39590) 2023-09-13T09:58:59.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f918effd700 1 -- 172.21.15.6:0/3495830733 learned_addr learned my addr 172.21.15.6:0/3495830733 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.102+0000 7f918ffff700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190101850 0x7f91900697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918f7fe700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91900ffcc0 0x7f9190068cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918effd700 1 -- 172.21.15.6:0/3495830733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91900ffcc0 msgr2=0x7f9190068cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918effd700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91900ffcc0 0x7f9190068cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918effd700 1 -- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190101850 msgr2=0x7f91900697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918effd700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190101850 0x7f91900697b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918effd700 1 -- 172.21.15.6:0/3495830733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9184009520 con 0x7f9190100eb0 2023-09-13T09:58:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918ffff700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190101850 0x7f91900697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:58:59.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.103+0000 7f918effd700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190100eb0 0x7f9190069230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9184009230 tx=0x7f918400b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.104+0000 7f918cff9700 1 -- 172.21.15.6:0/3495830733 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918400bc10 con 0x7f9190100eb0 2023-09-13T09:58:59.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.104+0000 7f918cff9700 1 -- 172.21.15.6:0/3495830733 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9184005500 con 0x7f9190100eb0 2023-09-13T09:58:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.104+0000 7f918cff9700 1 -- 172.21.15.6:0/3495830733 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184003ea0 con 0x7f9190100eb0 2023-09-13T09:58:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.104+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91901941f0 con 0x7f9190100eb0 2023-09-13T09:58:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.104+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9190194650 con 0x7f9190100eb0 2023-09-13T09:58:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.107+0000 7f918cff9700 1 -- 172.21.15.6:0/3495830733 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9184005040 con 0x7f9190100eb0 2023-09-13T09:58:59.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.108+0000 7f918cff9700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91780a0790 0x7f91780a2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.108+0000 7f91a234eb80 1 Processor -- start 2023-09-13T09:58:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.108+0000 7f918cff9700 1 -- 172.21.15.6:0/3495830733 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f91840dd640 con 0x7f9190100eb0 2023-09-13T09:58:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.108+0000 7f91a234eb80 1 -- start start 2023-09-13T09:58:59.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba445700 0x5594ba445b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba444e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f91a234eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba39d780 con 0x5594ba444a00 2023-09-13T09:58:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f91a234eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba39b0a0 con 0x5594ba446060 2023-09-13T09:58:59.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f91a234eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba396990 con 0x5594ba445700 2023-09-13T09:58:59.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba444e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba444e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46070/0 (socket says 172.21.15.6:46070) 2023-09-13T09:58:59.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 -- 172.21.15.6:0/885738905 learned_addr learned my addr 172.21.15.6:0/885738905 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:59.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 -- 172.21.15.6:0/885738905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba445700 msgr2=0x5594ba445b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:58:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 --2- 172.21.15.6:0/885738905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba445700 0x5594ba445b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 -- 172.21.15.6:0/885738905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 msgr2=0x5594ba4444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 --2- 172.21.15.6:0/885738905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 -- 172.21.15.6:0/885738905 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594ba216630 con 0x5594ba444a00 2023-09-13T09:58:59.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.109+0000 7f918ffff700 1 --2- 172.21.15.6:0/885738905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba444e80 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f9188003e50 tx=0x7f91880099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f90d3febc95288 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.110+0000 7f918f7fe700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91780a0790 0x7f91780a2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.110+0000 7f9175ffb700 1 -- 172.21.15.6:0/885738905 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880092d0 con 0x5594ba444a00 2023-09-13T09:58:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.110+0000 7f9175ffb700 1 -- 172.21.15.6:0/885738905 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f918800f040 con 0x5594ba444a00 2023-09-13T09:58:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.110+0000 7f9175ffb700 1 -- 172.21.15.6:0/885738905 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800e870 con 0x5594ba444a00 2023-09-13T09:58:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f918f7fe700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91780a0790 0x7f91780a2c50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9190100d10 tx=0x7f9180009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 -- 172.21.15.6:0/885738905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 msgr2=0x5594ba444e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 --2- 172.21.15.6:0/885738905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba444e80 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f9188003e50 tx=0x7f91880099e0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 -- 172.21.15.6:0/885738905 shutdown_connections 2023-09-13T09:58:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 --2- 172.21.15.6:0/885738905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba444e80 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 --2- 172.21.15.6:0/885738905 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba445700 0x5594ba445b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 --2- 172.21.15.6:0/885738905 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 -- 172.21.15.6:0/885738905 >> 172.21.15.6:0/885738905 conn(0x5594ba3a2c80 msgr2=0x5594ba43ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:59.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 -- 172.21.15.6:0/885738905 shutdown_connections 2023-09-13T09:58:59.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 -- 172.21.15.6:0/885738905 wait complete. 2023-09-13T09:58:59.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.111+0000 7f91a234eb80 1 -- start start 2023-09-13T09:58:59.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 1 Processor -- start 2023-09-13T09:58:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba44df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba44e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba446060 0x5594ba455510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba334bb0 con 0x5594ba444a00 2023-09-13T09:58:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba3348b0 con 0x5594ba445700 2023-09-13T09:58:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba218920 con 0x5594ba446060 2023-09-13T09:58:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f91a234eb80 10 client.0 _ll_register_callbacks cb 0x5594ba332680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba44df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba44df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46076/0 (socket says 172.21.15.6:46076) 2023-09-13T09:58:59.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 -- 172.21.15.6:0/819356039 learned_addr learned my addr 172.21.15.6:0/819356039 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:59.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918effd700 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba44e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918ffff700 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba446060 0x5594ba455510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 -- 172.21.15.6:0/819356039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba446060 msgr2=0x5594ba455510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:59.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba446060 0x5594ba455510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 -- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 msgr2=0x5594ba44e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba44e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.112+0000 7f918f7fe700 1 -- 172.21.15.6:0/819356039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9188003b00 con 0x5594ba444a00 2023-09-13T09:58:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f918f7fe700 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba44df90 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f918000e730 tx=0x7f91800047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b6075544614039 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:59.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f916effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:58:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f916effd700 1 -- 172.21.15.6:0/819356039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180004830 con 0x5594ba444a00 2023-09-13T09:58:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f916effd700 1 -- 172.21.15.6:0/819356039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9180004990 con 0x5594ba444a00 2023-09-13T09:58:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594ba437670 con 0x5594ba444a00 2023-09-13T09:58:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f916effd700 1 -- 172.21.15.6:0/819356039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9180004b50 con 0x5594ba444a00 2023-09-13T09:58:59.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f91a234eb80 10 client.20586 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:59.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5594ba3ae7a0 con 0x5594ba444a00 2023-09-13T09:58:59.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f916effd700 1 -- 172.21.15.6:0/819356039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5594ba437670 con 0x5594ba444a00 2023-09-13T09:58:59.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.113+0000 7f916effd700 1 -- 172.21.15.6:0/819356039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f9180024030 con 0x5594ba444a00 2023-09-13T09:58:59.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f91a234eb80 10 client.20586 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:59.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f91a234eb80 10 client.20586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f91a234eb80 20 client.20586 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f91a234eb80 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba459e20 0x5594ba45c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f91a234eb80 4 client.20586 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:58:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594ba38f970 con 0x5594ba459e20 2023-09-13T09:58:59.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f918effd700 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba459e20 0x5594ba45c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f916effd700 10 client.20586 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.114+0000 7f918effd700 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba459e20 0x5594ba45c240 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebab3484bb63d38 server_cookie=4b1d2b0fa378b4a0 in_seq=0 out_seq=0 2023-09-13T09:58:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f916effd700 1 -- 172.21.15.6:0/819356039 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594ba38f970 con 0x5594ba459e20 2023-09-13T09:58:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f916effd700 10 client.20586 handle_command_reply: tid=0 2023-09-13T09:58:59.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 client.20586 shutdown 2023-09-13T09:58:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 msgr2=0x5594ba44df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba44df90 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f918000e730 tx=0x7f91800047c0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 shutdown_connections 2023-09-13T09:58:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba446060 0x5594ba455510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba459e20 0x5594ba45c240 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba444a00 0x5594ba44df90 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 --2- 172.21.15.6:0/819356039 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba44e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f916effd700 0 client.20586 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.118+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 >> 172.21.15.6:0/819356039 conn(0x5594ba3a2c80 msgr2=0x5594ba43eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.119+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 shutdown_connections 2023-09-13T09:58:59.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.119+0000 7f91a234eb80 1 -- 172.21.15.6:0/819356039 wait complete. 2023-09-13T09:58:59.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.119+0000 7f91a234eb80 20 client.20586 trim_cache size 0 max 16384 2023-09-13T09:58:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 Processor -- start 2023-09-13T09:58:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 -- start start 2023-09-13T09:58:59.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 0x5594ba4444c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba445700 0x5594ba45c210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4554d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba440730 con 0x5594ba445700 2023-09-13T09:58:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba44bbe0 con 0x5594ba446060 2023-09-13T09:58:59.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.137+0000 7f91a234eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba4494d0 con 0x5594ba444a00 2023-09-13T09:58:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba445700 0x5594ba45c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba445700 0x5594ba45c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46088/0 (socket says 172.21.15.6:46088) 2023-09-13T09:58:59.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 -- 172.21.15.6:0/3284324269 learned_addr learned my addr 172.21.15.6:0/3284324269 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 -- 172.21.15.6:0/3284324269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 msgr2=0x5594ba4444c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:58:59.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 --2- 172.21.15.6:0/3284324269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 0x5594ba4444c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 -- 172.21.15.6:0/3284324269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 msgr2=0x5594ba4554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 --2- 172.21.15.6:0/3284324269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 -- 172.21.15.6:0/3284324269 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594ba1c2de0 con 0x5594ba445700 2023-09-13T09:58:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.138+0000 7f918effd700 1 --2- 172.21.15.6:0/3284324269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba445700 0x5594ba45c210 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f91840aae00 tx=0x7f91840dafc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f177dc262250dece server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:59.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.139+0000 7f91767fc700 1 -- 172.21.15.6:0/3284324269 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840aae70 con 0x5594ba445700 2023-09-13T09:58:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.139+0000 7f91767fc700 1 -- 172.21.15.6:0/3284324269 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f91840aeca0 con 0x5594ba445700 2023-09-13T09:58:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.139+0000 7f91767fc700 1 -- 172.21.15.6:0/3284324269 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9184003680 con 0x5594ba445700 2023-09-13T09:58:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.139+0000 7f91a234eb80 1 -- 172.21.15.6:0/3284324269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba445700 msgr2=0x5594ba45c210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.139+0000 7f91a234eb80 1 --2- 172.21.15.6:0/3284324269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba445700 0x5594ba45c210 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7f91840aae00 tx=0x7f91840dafc0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 -- 172.21.15.6:0/3284324269 shutdown_connections 2023-09-13T09:58:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 --2- 172.21.15.6:0/3284324269 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba446060 0x5594ba4554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 --2- 172.21.15.6:0/3284324269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 0x5594ba4444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 --2- 172.21.15.6:0/3284324269 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba445700 0x5594ba45c210 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 -- 172.21.15.6:0/3284324269 >> 172.21.15.6:0/3284324269 conn(0x5594ba3a2c80 msgr2=0x5594ba43eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:59.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 -- 172.21.15.6:0/3284324269 shutdown_connections 2023-09-13T09:58:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 -- 172.21.15.6:0/3284324269 wait complete. 2023-09-13T09:58:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 -- start start 2023-09-13T09:58:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.140+0000 7f91a234eb80 1 Processor -- start 2023-09-13T09:58:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 0x5594ba450c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba451170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f91a234eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba446060 0x5594ba454190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f91a234eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba4546d0 con 0x5594ba446060 2023-09-13T09:58:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f91a234eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba454840 con 0x5594ba445700 2023-09-13T09:58:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f91a234eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ba454a00 con 0x5594ba444a00 2023-09-13T09:58:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f91a234eb80 10 client.0 _ll_register_callbacks cb 0x5594ba332680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:58:59.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba451170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba451170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39616/0 (socket says 172.21.15.6:39616) 2023-09-13T09:58:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 -- 172.21.15.6:0/4214587874 learned_addr learned my addr 172.21.15.6:0/4214587874 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:58:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 -- 172.21.15.6:0/4214587874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 msgr2=0x5594ba450c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 0x5594ba450c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 -- 172.21.15.6:0/4214587874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba446060 msgr2=0x5594ba454190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:58:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba446060 0x5594ba454190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.141+0000 7f918effd700 1 -- 172.21.15.6:0/4214587874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9190194650 con 0x5594ba445700 2023-09-13T09:58:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.142+0000 7f918effd700 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba451170 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f91840094b0 tx=0x7f91840b2e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1705337cd0da3266 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:58:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.142+0000 7f916effd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:58:59.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.142+0000 7f916effd700 1 -- 172.21.15.6:0/4214587874 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91840aae70 con 0x5594ba445700 2023-09-13T09:58:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.142+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f918800f040 con 0x5594ba445700 2023-09-13T09:58:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.142+0000 7f916effd700 1 -- 172.21.15.6:0/4214587874 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9184003680 con 0x5594ba445700 2023-09-13T09:58:59.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.142+0000 7f916effd700 1 -- 172.21.15.6:0/4214587874 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f91840ab0d0 con 0x5594ba445700 2023-09-13T09:58:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 10 client.29798 fetch_fsmap learned FSMap version 66 2023-09-13T09:58:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5594ba1abc60 con 0x5594ba445700 2023-09-13T09:58:59.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f916effd700 1 -- 172.21.15.6:0/4214587874 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f918800f040 con 0x5594ba445700 2023-09-13T09:58:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f916effd700 1 -- 172.21.15.6:0/4214587874 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f91840b29c0 con 0x5594ba445700 2023-09-13T09:58:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 10 client.29798 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:58:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 10 client.29798 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:58:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 20 client.29798 populate_metadata read hostname 'smithi006' 2023-09-13T09:58:59.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba4ae150 0x5594ba4b0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:58:59.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 4 client.29798 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:58:59.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5594ba350050 con 0x5594ba4ae150 2023-09-13T09:58:59.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.144+0000 7f918f7fe700 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba4ae150 0x5594ba4b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:58:59.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.145+0000 7f916effd700 10 client.29798 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:59.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.145+0000 7f918f7fe700 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba4ae150 0x5594ba4b0570 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=def4a2efa21b5e90 server_cookie=12602cbf06b300b6 in_seq=0 out_seq=0 2023-09-13T09:58:59.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f916effd700 1 -- 172.21.15.6:0/4214587874 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5594ba350050 con 0x5594ba4ae150 2023-09-13T09:58:59.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f916effd700 10 client.29798 handle_command_reply: tid=0 2023-09-13T09:58:59.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 client.29798 shutdown 2023-09-13T09:58:59.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 msgr2=0x5594ba451170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba451170 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f91840094b0 tx=0x7f91840b2e50 comp rx=0 tx=0).stop 2023-09-13T09:58:59.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 shutdown_connections 2023-09-13T09:58:59.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5594ba4ae150 0x5594ba4b0570 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594ba446060 0x5594ba454190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f916effd700 0 client.29798 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:58:59.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594ba444a00 0x5594ba450c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 --2- 172.21.15.6:0/4214587874 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5594ba445700 0x5594ba451170 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 >> 172.21.15.6:0/4214587874 conn(0x5594ba3a2c80 msgr2=0x5594ba44be30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:59.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 shutdown_connections 2023-09-13T09:58:59.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.151+0000 7f91a234eb80 1 -- 172.21.15.6:0/4214587874 wait complete. 2023-09-13T09:58:59.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f91a234eb80 20 client.29798 trim_cache size 0 max 16384 2023-09-13T09:58:59.159 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:58:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91780a0790 msgr2=0x7f91780a2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91780a0790 0x7f91780a2c50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f9190100d10 tx=0x7f9180009260 comp rx=0 tx=0).stop 2023-09-13T09:58:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190100eb0 msgr2=0x7f9190069230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:58:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190100eb0 0x7f9190069230 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9184009230 tx=0x7f918400b810 comp rx=0 tx=0).stop 2023-09-13T09:58:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 shutdown_connections 2023-09-13T09:58:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f91780a0790 0x7f91780a2c50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9190101850 0x7f91900697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91900ffcc0 0x7f9190068cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 --2- 172.21.15.6:0/3495830733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9190100eb0 0x7f9190069230 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:58:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 >> 172.21.15.6:0/3495830733 conn(0x7f91900fb210 msgr2=0x7f919006fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:58:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.152+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 shutdown_connections 2023-09-13T09:58:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:58:59.153+0000 7f9196169700 1 -- 172.21.15.6:0/3495830733 wait complete. 2023-09-13T09:58:59.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 257838 35.61 MB/sec execute 259 sec latency 70.423 ms 2023-09-13T09:59:00.171 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:59:00.172 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:59:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.342+0000 7f74374b6700 1 -- 172.21.15.6:0/275941662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 msgr2=0x7f7430108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.342+0000 7f74374b6700 1 --2- 172.21.15.6:0/275941662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 0x7f7430108100 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f7428009f90 tx=0x7f742800b330 comp rx=0 tx=0).stop 2023-09-13T09:59:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.344+0000 7f74374b6700 1 -- 172.21.15.6:0/275941662 shutdown_connections 2023-09-13T09:59:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.344+0000 7f74374b6700 1 --2- 172.21.15.6:0/275941662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 0x7f7430108100 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.344+0000 7f74374b6700 1 --2- 172.21.15.6:0/275941662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74300ffcc0 0x7f74301000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.344+0000 7f74374b6700 1 --2- 172.21.15.6:0/275941662 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7430100eb0 0x7f7430101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.344+0000 7f74374b6700 1 -- 172.21.15.6:0/275941662 >> 172.21.15.6:0/275941662 conn(0x7f74300fb250 msgr2=0x7f74300fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.345+0000 7f74374b6700 1 -- 172.21.15.6:0/275941662 shutdown_connections 2023-09-13T09:59:00.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.345+0000 7f74374b6700 1 -- 172.21.15.6:0/275941662 wait complete. 2023-09-13T09:59:00.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 Processor -- start 2023-09-13T09:59:00.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 -- start start 2023-09-13T09:59:00.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7430100eb0 0x7f74301959d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 0x7f7430195f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f743019af70 0x7f743019d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743019d930 con 0x7f7430100eb0 2023-09-13T09:59:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743019da70 con 0x7f743019af70 2023-09-13T09:59:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f74374b6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f743019dc00 con 0x7f7430101850 2023-09-13T09:59:00.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f7435252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7430100eb0 0x7f74301959d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f7435252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7430100eb0 0x7f74301959d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46104/0 (socket says 172.21.15.6:46104) 2023-09-13T09:59:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f7435252700 1 -- 172.21.15.6:0/4056405537 learned_addr learned my addr 172.21.15.6:0/4056405537 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f7435a53700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f743019af70 0x7f743019d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.346+0000 7f7434a51700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 0x7f7430195f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f7435252700 1 -- 172.21.15.6:0/4056405537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 msgr2=0x7f7430195f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f7435252700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 0x7f7430195f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f7435252700 1 -- 172.21.15.6:0/4056405537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f743019af70 msgr2=0x7f743019d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f7435252700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f743019af70 0x7f743019d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f7435252700 1 -- 172.21.15.6:0/4056405537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7428009c40 con 0x7f7430100eb0 2023-09-13T09:59:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f7435252700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7430100eb0 0x7f74301959d0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f742c00d6d0 tx=0x7f742c00d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f74267fc700 1 -- 172.21.15.6:0/4056405537 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c00f890 con 0x7f7430100eb0 2023-09-13T09:59:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743019dee0 con 0x7f7430100eb0 2023-09-13T09:59:00.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f74267fc700 1 -- 172.21.15.6:0/4056405537 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f742c010460 con 0x7f7430100eb0 2023-09-13T09:59:00.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f74267fc700 1 -- 172.21.15.6:0/4056405537 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0195c0 con 0x7f7430100eb0 2023-09-13T09:59:00.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.347+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743019e330 con 0x7f7430100eb0 2023-09-13T09:59:00.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.349+0000 7f74267fc700 1 -- 172.21.15.6:0/4056405537 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f742c0105d0 con 0x7f7430100eb0 2023-09-13T09:59:00.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.350+0000 7f74267fc700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f741c0a0640 0x7f741c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.350+0000 7f74267fc700 1 -- 172.21.15.6:0/4056405537 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f742c0cb8c0 con 0x7f7430100eb0 2023-09-13T09:59:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.350+0000 7f7434a51700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f741c0a0640 0x7f741c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.351+0000 7f7434a51700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f741c0a0640 0x7f741c0a2b00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7420009c60 tx=0x7f7420009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.351+0000 7f744369bb80 1 Processor -- start 2023-09-13T09:59:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.351+0000 7f744369bb80 1 -- start start 2023-09-13T09:59:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f744369bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f744369bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f744369bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18ae0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f744369bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee1804800 con 0x562ee18af2f0 2023-09-13T09:59:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f744369bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee1802120 con 0x562ee18ae990 2023-09-13T09:59:00.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f744369bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee17fda10 con 0x562ee18adc90 2023-09-13T09:59:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39636/0 (socket says 172.21.15.6:39636) 2023-09-13T09:59:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 -- 172.21.15.6:0/4227238137 learned_addr learned my addr 172.21.15.6:0/4227238137 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435a53700 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18ae0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7434a51700 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 -- 172.21.15.6:0/4227238137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 msgr2=0x562ee18ae0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18ae0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 -- 172.21.15.6:0/4227238137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 msgr2=0x562ee18ad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18ad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.352+0000 7f7435252700 1 -- 172.21.15.6:0/4227238137 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ee167d6b0 con 0x562ee18ae990 2023-09-13T09:59:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.353+0000 7f7435252700 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18aedb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f742c095500 tx=0x7f742c098f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa9d1c8fb70cbb1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.353+0000 7f741b7fe700 1 -- 172.21.15.6:0/4227238137 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c099000 con 0x562ee18ae990 2023-09-13T09:59:00.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.353+0000 7f741b7fe700 1 -- 172.21.15.6:0/4227238137 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f742c09ce30 con 0x562ee18ae990 2023-09-13T09:59:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.353+0000 7f741b7fe700 1 -- 172.21.15.6:0/4227238137 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c098750 con 0x562ee18ae990 2023-09-13T09:59:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 -- 172.21.15.6:0/4227238137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 msgr2=0x562ee18aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18aedb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f742c095500 tx=0x7f742c098f00 comp rx=0 tx=0).stop 2023-09-13T09:59:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 -- 172.21.15.6:0/4227238137 shutdown_connections 2023-09-13T09:59:00.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18ae0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18aedb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 --2- 172.21.15.6:0/4227238137 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18ad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 -- 172.21.15.6:0/4227238137 >> 172.21.15.6:0/4227238137 conn(0x562ee1809d00 msgr2=0x562ee18a5f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 -- 172.21.15.6:0/4227238137 shutdown_connections 2023-09-13T09:59:00.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.354+0000 7f744369bb80 1 -- 172.21.15.6:0/4227238137 wait complete. 2023-09-13T09:59:00.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 -- start start 2023-09-13T09:59:00.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 Processor -- start 2023-09-13T09:59:00.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18b71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18ae990 0x562ee18b7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18af2f0 0x562ee18be740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee179bc30 con 0x562ee18adc90 2023-09-13T09:59:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee179b930 con 0x562ee18af2f0 2023-09-13T09:59:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee167f9a0 con 0x562ee18ae990 2023-09-13T09:59:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f744369bb80 10 client.0 _ll_register_callbacks cb 0x562ee1799700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f7435252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18b71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f7435252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18b71c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46118/0 (socket says 172.21.15.6:46118) 2023-09-13T09:59:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f7435252700 1 -- 172.21.15.6:0/1588382134 learned_addr learned my addr 172.21.15.6:0/1588382134 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.355+0000 7f7435a53700 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18af2f0 0x562ee18be740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7435252700 1 -- 172.21.15.6:0/1588382134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18ae990 msgr2=0x562ee18b7700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:59:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7435252700 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18ae990 0x562ee18b7700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7435252700 1 -- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18af2f0 msgr2=0x562ee18be740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7435252700 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18af2f0 0x562ee18be740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7435252700 1 -- 172.21.15.6:0/1588382134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743019e330 con 0x562ee18adc90 2023-09-13T09:59:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7435a53700 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18af2f0 0x562ee18be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7435252700 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18b71c0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f742c099660 tx=0x7f742c00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75e8ca91b4f50565 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7418ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:00.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7418ff9700 1 -- 172.21.15.6:0/1588382134 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c0984f0 con 0x562ee18adc90 2023-09-13T09:59:00.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7418ff9700 1 -- 172.21.15.6:0/1588382134 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f742c098650 con 0x562ee18adc90 2023-09-13T09:59:00.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ee189e6f0 con 0x562ee18adc90 2023-09-13T09:59:00.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f7418ff9700 1 -- 172.21.15.6:0/1588382134 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f742c0a0be0 con 0x562ee18adc90 2023-09-13T09:59:00.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f744369bb80 10 client.20601 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:00.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.356+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x562ee1815820 con 0x562ee18adc90 2023-09-13T09:59:00.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f7418ff9700 1 -- 172.21.15.6:0/1588382134 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x562ee189e6f0 con 0x562ee18adc90 2023-09-13T09:59:00.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f7418ff9700 1 -- 172.21.15.6:0/1588382134 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f742c098190 con 0x562ee18adc90 2023-09-13T09:59:00.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f744369bb80 10 client.20601 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:00.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f744369bb80 10 client.20601 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:00.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f744369bb80 20 client.20601 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:00.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f744369bb80 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee18c2ae0 0x562ee18c4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f744369bb80 4 client.20601 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:00.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ee17f69f0 con 0x562ee18c2ae0 2023-09-13T09:59:00.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f7434a51700 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee18c2ae0 0x562ee18c4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.357+0000 7f7418ff9700 10 client.20601 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.358+0000 7f7434a51700 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee18c2ae0 0x562ee18c4f00 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=986fce63c6f13cd0 server_cookie=4d4558ab526cb9ef in_seq=0 out_seq=0 2023-09-13T09:59:00.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.358+0000 7f7418ff9700 1 -- 172.21.15.6:0/1588382134 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562ee17f69f0 con 0x562ee18c2ae0 2023-09-13T09:59:00.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.358+0000 7f7418ff9700 10 client.20601 handle_command_reply: tid=0 2023-09-13T09:59:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.358+0000 7f744369bb80 1 client.20601 shutdown 2023-09-13T09:59:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 msgr2=0x562ee18b71c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18b71c0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f742c099660 tx=0x7f742c00ded0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 shutdown_connections 2023-09-13T09:59:00.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18af2f0 0x562ee18be740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee18c2ae0 0x562ee18c4f00 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18b71c0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 --2- 172.21.15.6:0/1588382134 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18ae990 0x562ee18b7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 >> 172.21.15.6:0/1588382134 conn(0x562ee1809d00 msgr2=0x562ee18a0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f7418ff9700 0 client.20601 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 shutdown_connections 2023-09-13T09:59:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.359+0000 7f744369bb80 1 -- 172.21.15.6:0/1588382134 wait complete. 2023-09-13T09:59:00.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.363+0000 7f744369bb80 20 client.20601 trim_cache size 0 max 16384 2023-09-13T09:59:00.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 Processor -- start 2023-09-13T09:59:00.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 -- start start 2023-09-13T09:59:00.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18b6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18be700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee18b6d30 con 0x562ee18af2f0 2023-09-13T09:59:00.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee18a8050 con 0x562ee18ae990 2023-09-13T09:59:00.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f744369bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee189e480 con 0x562ee18adc90 2023-09-13T09:59:00.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f7435a53700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f7435a53700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18b74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46128/0 (socket says 172.21.15.6:46128) 2023-09-13T09:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f7435a53700 1 -- 172.21.15.6:0/4000952036 learned_addr learned my addr 172.21.15.6:0/4000952036 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f7434a51700 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18be700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.386+0000 7f7435252700 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18b6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f7435a53700 1 -- 172.21.15.6:0/4000952036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 msgr2=0x562ee18b6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f7435a53700 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18b6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f7435a53700 1 -- 172.21.15.6:0/4000952036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 msgr2=0x562ee18be700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f7435a53700 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18be700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f7435a53700 1 -- 172.21.15.6:0/4000952036 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ee18b6140 con 0x562ee18af2f0 2023-09-13T09:59:00.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f7435a53700 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18b74b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f7428015000 tx=0x7f7428003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b18679df24c649 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f741bfff700 1 -- 172.21.15.6:0/4000952036 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742800e040 con 0x562ee18af2f0 2023-09-13T09:59:00.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f741bfff700 1 -- 172.21.15.6:0/4000952036 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74280077e0 con 0x562ee18af2f0 2023-09-13T09:59:00.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.387+0000 7f741bfff700 1 -- 172.21.15.6:0/4000952036 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7428005940 con 0x562ee18af2f0 2023-09-13T09:59:00.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 -- 172.21.15.6:0/4000952036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 msgr2=0x562ee18b74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18b74b0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f7428015000 tx=0x7f7428003ef0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 -- 172.21.15.6:0/4000952036 shutdown_connections 2023-09-13T09:59:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18af2f0 0x562ee18b74b0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18adc90 0x562ee18b6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 --2- 172.21.15.6:0/4000952036 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18be700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 -- 172.21.15.6:0/4000952036 >> 172.21.15.6:0/4000952036 conn(0x562ee1809d00 msgr2=0x562ee18b1b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 -- 172.21.15.6:0/4000952036 shutdown_connections 2023-09-13T09:59:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 -- 172.21.15.6:0/4000952036 wait complete. 2023-09-13T09:59:00.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 -- start start 2023-09-13T09:59:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.388+0000 7f744369bb80 1 Processor -- start 2023-09-13T09:59:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f744369bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18bb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f744369bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18bb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f744369bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18af2f0 0x562ee1916900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f744369bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee18be860 con 0x562ee18adc90 2023-09-13T09:59:00.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f744369bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee18be9d0 con 0x562ee18ae990 2023-09-13T09:59:00.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f744369bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ee18beb90 con 0x562ee18af2f0 2023-09-13T09:59:00.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f744369bb80 10 client.0 _ll_register_callbacks cb 0x562ee1799700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:00.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18bb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18bb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46130/0 (socket says 172.21.15.6:46130) 2023-09-13T09:59:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 -- 172.21.15.6:0/4255965164 learned_addr learned my addr 172.21.15.6:0/4255965164 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7434a51700 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18bb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435a53700 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18af2f0 0x562ee1916900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 -- 172.21.15.6:0/4255965164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18af2f0 msgr2=0x562ee1916900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18af2f0 0x562ee1916900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 -- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 msgr2=0x562ee18bb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18bb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 -- 172.21.15.6:0/4255965164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7430108a50 con 0x562ee18adc90 2023-09-13T09:59:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7435252700 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18bb300 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f742c095a70 tx=0x7f742c09de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=572c33f0d15cb6ae server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.389+0000 7f7418ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:00.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f7418ff9700 1 -- 172.21.15.6:0/4255965164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f742c09df50 con 0x562ee18adc90 2023-09-13T09:59:00.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f7418ff9700 1 -- 172.21.15.6:0/4255965164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f742c099000 con 0x562ee18adc90 2023-09-13T09:59:00.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f742c09ce30 con 0x562ee18adc90 2023-09-13T09:59:00.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f7418ff9700 1 -- 172.21.15.6:0/4255965164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f742c0a0be0 con 0x562ee18adc90 2023-09-13T09:59:00.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 10 client.20607 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:00.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x562ee18a6230 con 0x562ee18adc90 2023-09-13T09:59:00.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f7418ff9700 1 -- 172.21.15.6:0/4255965164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f742c09ce30 con 0x562ee18adc90 2023-09-13T09:59:00.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f7418ff9700 1 -- 172.21.15.6:0/4255965164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f742c0b8320 con 0x562ee18adc90 2023-09-13T09:59:00.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 10 client.20607 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:00.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 10 client.20607 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:00.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 20 client.20607 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:00.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee1918070 0x562ee191a490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 4 client.20607 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:59:00.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.390+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x562ee17b70d0 con 0x562ee1918070 2023-09-13T09:59:00.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.391+0000 7f7434a51700 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee1918070 0x562ee191a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.391+0000 7f7434a51700 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee1918070 0x562ee191a490 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eed15daa2b7719f server_cookie=47fb6908756d0664 in_seq=0 out_seq=0 2023-09-13T09:59:00.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.391+0000 7f7418ff9700 10 client.20607 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.393+0000 7f7418ff9700 1 -- 172.21.15.6:0/4255965164 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x562ee17b70d0 con 0x562ee1918070 2023-09-13T09:59:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.393+0000 7f7418ff9700 10 client.20607 handle_command_reply: tid=0 2023-09-13T09:59:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.393+0000 7f744369bb80 1 client.20607 shutdown 2023-09-13T09:59:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.393+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 msgr2=0x562ee18bb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.393+0000 7f744369bb80 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18bb300 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f742c095a70 tx=0x7f742c09de60 comp rx=0 tx=0).stop 2023-09-13T09:59:00.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 shutdown_connections 2023-09-13T09:59:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562ee18af2f0 0x562ee1916900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562ee1918070 0x562ee191a490 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562ee18adc90 0x562ee18bb300 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 --2- 172.21.15.6:0/4255965164 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562ee18ae990 0x562ee18bb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 >> 172.21.15.6:0/4255965164 conn(0x562ee1809d00 msgr2=0x562ee18b6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f7418ff9700 0 client.20607 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 shutdown_connections 2023-09-13T09:59:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 1 -- 172.21.15.6:0/4255965164 wait complete. 2023-09-13T09:59:00.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.396+0000 7f744369bb80 20 client.20607 trim_cache size 0 max 16384 2023-09-13T09:59:00.409 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:59:00.409 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:59:00.409 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "01b4c6a7-699f-4a3d-b91b-9fed32fe50b8", 2023-09-13T09:59:00.409 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:59:00.409 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:59:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f741c0a0640 msgr2=0x7f741c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f741c0a0640 0x7f741c0a2b00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7420009c60 tx=0x7f7420009260 comp rx=0 tx=0).stop 2023-09-13T09:59:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7430100eb0 msgr2=0x7f74301959d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7430100eb0 0x7f74301959d0 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f742c00d6d0 tx=0x7f742c00d9e0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 shutdown_connections 2023-09-13T09:59:00.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f743019af70 0x7f743019d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f741c0a0640 0x7f741c0a2b00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7430100eb0 0x7f74301959d0 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.399+0000 7f74374b6700 1 --2- 172.21.15.6:0/4056405537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7430101850 0x7f7430195f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.400+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 >> 172.21.15.6:0/4056405537 conn(0x7f74300fb250 msgr2=0x7f74300fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.400+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 shutdown_connections 2023-09-13T09:59:00.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.400+0000 7f74374b6700 1 -- 172.21.15.6:0/4056405537 wait complete. 2023-09-13T09:59:00.414 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:00 smithi006 ceph-mon[98665]: pgmap v884: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 580 op/s 2023-09-13T09:59:00.416 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:59:00.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:00 smithi053 ceph-mon[102373]: pgmap v884: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 580 op/s 2023-09-13T09:59:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:00 smithi131 ceph-mon[102785]: pgmap v884: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 4.0 MiB/s wr, 580 op/s 2023-09-13T09:59:00.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 258593 35.65 MB/sec execute 260 sec latency 69.267 ms 2023-09-13T09:59:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.607+0000 7f46a11dd700 1 -- 172.21.15.6:0/1587330202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 msgr2=0x7f469c104df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.607+0000 7f46a11dd700 1 --2- 172.21.15.6:0/1587330202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c104df0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f469400b0a0 tx=0x7f469400b3b0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.608+0000 7f46a11dd700 1 -- 172.21.15.6:0/1587330202 shutdown_connections 2023-09-13T09:59:00.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.608+0000 7f46a11dd700 1 --2- 172.21.15.6:0/1587330202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c104df0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.608+0000 7f46a11dd700 1 --2- 172.21.15.6:0/1587330202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f469c0ff630 0x7f469c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.608+0000 7f46a11dd700 1 --2- 172.21.15.6:0/1587330202 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f469c101fa0 0x7f469c104430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.608+0000 7f46a11dd700 1 -- 172.21.15.6:0/1587330202 >> 172.21.15.6:0/1587330202 conn(0x7f469c0fb250 msgr2=0x7f469c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.608+0000 7f46a11dd700 1 -- 172.21.15.6:0/1587330202 shutdown_connections 2023-09-13T09:59:00.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.608+0000 7f46a11dd700 1 -- 172.21.15.6:0/1587330202 wait complete. 2023-09-13T09:59:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 Processor -- start 2023-09-13T09:59:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 -- start start 2023-09-13T09:59:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f469c0ff630 0x7f469c0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f469c101fa0 0x7f469c070c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c071c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c072240 con 0x7f469c104970 2023-09-13T09:59:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c0723b0 con 0x7f469c101fa0 2023-09-13T09:59:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f46a11dd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469c072570 con 0x7f469c0ff630 2023-09-13T09:59:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.609+0000 7f469b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c071c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c071c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46148/0 (socket says 172.21.15.6:46148) 2023-09-13T09:59:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 -- 172.21.15.6:0/2530777794 learned_addr learned my addr 172.21.15.6:0/2530777794 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 -- 172.21.15.6:0/2530777794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f469c0ff630 msgr2=0x7f469c0706f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-09-13T09:59:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f469c0ff630 0x7f469c0706f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 -- 172.21.15.6:0/2530777794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f469c101fa0 msgr2=0x7f469c070c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f469c101fa0 0x7f469c070c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 -- 172.21.15.6:0/2530777794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4694009d00 con 0x7f469c104970 2023-09-13T09:59:00.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.610+0000 7f469b59e700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c071c70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f46940062a0 tx=0x7f4694004d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.611+0000 7f4683fff700 1 -- 172.21.15.6:0/2530777794 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469400e040 con 0x7f469c104970 2023-09-13T09:59:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.611+0000 7f4683fff700 1 -- 172.21.15.6:0/2530777794 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4694005250 con 0x7f469c104970 2023-09-13T09:59:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.611+0000 7f4683fff700 1 -- 172.21.15.6:0/2530777794 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4694004260 con 0x7f469c104970 2023-09-13T09:59:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.612+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469c072790 con 0x7f469c104970 2023-09-13T09:59:00.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.612+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c072ca0 con 0x7f469c104970 2023-09-13T09:59:00.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.615+0000 7f4683fff700 1 -- 172.21.15.6:0/2530777794 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4694005650 con 0x7f469c104970 2023-09-13T09:59:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.616+0000 7f4683fff700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46840a07c0 0x7f46840a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.616+0000 7f4683fff700 1 -- 172.21.15.6:0/2530777794 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46941107a0 con 0x7f469c104970 2023-09-13T09:59:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.617+0000 7f46ad3c2b80 1 Processor -- start 2023-09-13T09:59:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.617+0000 7f46ad3c2b80 1 -- start start 2023-09-13T09:59:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.617+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04864db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.617+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864e060 0x55f04864c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.617+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f04864ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0485a5780 con 0x55f04864e060 2023-09-13T09:59:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0485a30a0 con 0x55f04864ca00 2023-09-13T09:59:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04859e990 con 0x55f04864d700 2023-09-13T09:59:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04864db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04864db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49206/0 (socket says 172.21.15.6:49206) 2023-09-13T09:59:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 -- 172.21.15.6:0/60643949 learned_addr learned my addr 172.21.15.6:0/60643949 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469b59e700 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f04864ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 -- 172.21.15.6:0/60643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 msgr2=0x55f04864ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f04864ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 -- 172.21.15.6:0/60643949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864e060 msgr2=0x55f04864c4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:59:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864e060 0x55f04864c4c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.618+0000 7f469ad9d700 1 -- 172.21.15.6:0/60643949 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f04841e630 con 0x55f04864d700 2023-09-13T09:59:00.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.619+0000 7f469ad9d700 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04864db20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f468c00ac20 tx=0x7f468c00af30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=228bfc679ea09327 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.620+0000 7f46817fa700 1 -- 172.21.15.6:0/60643949 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c00fb90 con 0x55f04864d700 2023-09-13T09:59:00.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.620+0000 7f46817fa700 1 -- 172.21.15.6:0/60643949 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f468c00fcf0 con 0x55f04864d700 2023-09-13T09:59:00.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.620+0000 7f46817fa700 1 -- 172.21.15.6:0/60643949 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468c0106c0 con 0x55f04864d700 2023-09-13T09:59:00.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.620+0000 7f469ad9d700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46840a07c0 0x7f46840a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/60643949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 msgr2=0x55f04864db20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04864db20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f468c00ac20 tx=0x7f468c00af30 comp rx=0 tx=0).stop 2023-09-13T09:59:00.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f469ad9d700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46840a07c0 0x7f46840a2c80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f468c017000 tx=0x7f468c010bb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/60643949 shutdown_connections 2023-09-13T09:59:00.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f04864ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04864db20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/60643949 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864e060 0x55f04864c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.621+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/60643949 >> 172.21.15.6:0/60643949 conn(0x55f0485aac80 msgr2=0x55f048646f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/60643949 shutdown_connections 2023-09-13T09:59:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/60643949 wait complete. 2023-09-13T09:59:00.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 -- start start 2023-09-13T09:59:00.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 Processor -- start 2023-09-13T09:59:00.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f048655f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864d700 0x55f048656490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04853cbb0 con 0x55f04864ca00 2023-09-13T09:59:00.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04853c8b0 con 0x55f04864d700 2023-09-13T09:59:00.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f048420920 con 0x55f04864e060 2023-09-13T09:59:00.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f46ad3c2b80 10 client.0 _ll_register_callbacks cb 0x55f04853a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:00.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f048655f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.622+0000 7f469a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864d700 0x55f048656490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469b59e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f048655f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46156/0 (socket says 172.21.15.6:46156) 2023-09-13T09:59:00.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469ad9d700 1 -- 172.21.15.6:0/2291946907 learned_addr learned my addr 172.21.15.6:0/2291946907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469a59c700 1 -- 172.21.15.6:0/2291946907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 msgr2=0x55f04865d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469a59c700 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469a59c700 1 -- 172.21.15.6:0/2291946907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 msgr2=0x55f048655f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469a59c700 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f048655f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469a59c700 1 -- 172.21.15.6:0/2291946907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f468c00a850 con 0x55f04864d700 2023-09-13T09:59:00.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f469a59c700 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864d700 0x55f048656490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4690009e80 tx=0x7f469000b3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67fe17d095a446af server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f467eff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:59:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f467eff5700 1 -- 172.21.15.6:0/2291946907 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469000be60 con 0x55f04864d700 2023-09-13T09:59:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f467eff5700 1 -- 172.21.15.6:0/2291946907 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4690011420 con 0x55f04864d700 2023-09-13T09:59:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.623+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f04863f670 con 0x55f04864d700 2023-09-13T09:59:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f467eff5700 1 -- 172.21.15.6:0/2291946907 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46900115e0 con 0x55f04864d700 2023-09-13T09:59:00.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 10 client.29822 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55f0485b67a0 con 0x55f04864d700 2023-09-13T09:59:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f467eff5700 1 -- 172.21.15.6:0/2291946907 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f04863f670 con 0x55f04864d700 2023-09-13T09:59:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f467eff5700 1 -- 172.21.15.6:0/2291946907 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f46900197c0 con 0x55f04864d700 2023-09-13T09:59:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 10 client.29822 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:00.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 10 client.29822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:00.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 20 client.29822 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:00.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f048661e30 0x55f048664250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 4 client.29822 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:00.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f048597970 con 0x55f048661e30 2023-09-13T09:59:00.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.624+0000 7f469ad9d700 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f048661e30 0x55f048664250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.625+0000 7f467eff5700 10 client.29822 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.625+0000 7f469ad9d700 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f048661e30 0x55f048664250 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1251a776944c6032 server_cookie=911dde0f3b463dbb in_seq=0 out_seq=0 2023-09-13T09:59:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f467eff5700 1 -- 172.21.15.6:0/2291946907 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f048597970 con 0x55f048661e30 2023-09-13T09:59:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f467eff5700 10 client.29822 handle_command_reply: tid=0 2023-09-13T09:59:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 client.29822 shutdown 2023-09-13T09:59:00.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864d700 msgr2=0x55f048656490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864d700 0x55f048656490 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4690009e80 tx=0x7f469000b3c0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 shutdown_connections 2023-09-13T09:59:00.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f048661e30 0x55f048664250 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f048655f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f467eff5700 0 client.29822 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/2291946907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864d700 0x55f048656490 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 >> 172.21.15.6:0/2291946907 conn(0x55f0485aac80 msgr2=0x55f0486417f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 shutdown_connections 2023-09-13T09:59:00.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.631+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/2291946907 wait complete. 2023-09-13T09:59:00.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.632+0000 7f46ad3c2b80 20 client.29822 trim_cache size 0 max 16384 2023-09-13T09:59:00.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.662+0000 7f46ad3c2b80 1 Processor -- start 2023-09-13T09:59:00.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.664+0000 7f46ad3c2b80 1 -- start start 2023-09-13T09:59:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f04864c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04865d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864e060 0x55f048650980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0486489b0 con 0x55f04864ca00 2023-09-13T09:59:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f048647860 con 0x55f04864e060 2023-09-13T09:59:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0486570a0 con 0x55f04864d700 2023-09-13T09:59:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f469b59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864e060 0x55f048650980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f469b59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864e060 0x55f048650980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39690/0 (socket says 172.21.15.6:39690) 2023-09-13T09:59:00.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f469b59e700 1 -- 172.21.15.6:0/1157859505 learned_addr learned my addr 172.21.15.6:0/1157859505 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.665+0000 7f469a59c700 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04865d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f469b59e700 1 -- 172.21.15.6:0/1157859505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 msgr2=0x55f04865d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f469b59e700 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04865d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f469b59e700 1 -- 172.21.15.6:0/1157859505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 msgr2=0x55f04864c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f469b59e700 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f04864c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f469b59e700 1 -- 172.21.15.6:0/1157859505 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0483cade0 con 0x55f04864e060 2023-09-13T09:59:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f469b59e700 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864e060 0x55f048650980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f469410e5c0 tx=0x7f46940e4040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d724376138d253db server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f4681ffb700 1 -- 172.21.15.6:0/1157859505 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940de6d0 con 0x55f04864e060 2023-09-13T09:59:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f4681ffb700 1 -- 172.21.15.6:0/1157859505 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46940ddfd0 con 0x55f04864e060 2023-09-13T09:59:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.666+0000 7f4681ffb700 1 -- 172.21.15.6:0/1157859505 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940e5b20 con 0x55f04864e060 2023-09-13T09:59:00.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/1157859505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864e060 msgr2=0x55f048650980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864e060 0x55f048650980 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f469410e5c0 tx=0x7f46940e4040 comp rx=0 tx=0).stop 2023-09-13T09:59:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/1157859505 shutdown_connections 2023-09-13T09:59:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864e060 0x55f048650980 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864ca00 0x55f04864c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/1157859505 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864d700 0x55f04865d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/1157859505 >> 172.21.15.6:0/1157859505 conn(0x55f0485aac80 msgr2=0x55f048654b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/1157859505 shutdown_connections 2023-09-13T09:59:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.667+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/1157859505 wait complete. 2023-09-13T09:59:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 -- start start 2023-09-13T09:59:00.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 Processor -- start 2023-09-13T09:59:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f048657a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864d700 0x55f048657fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04865d430 con 0x55f04864d700 2023-09-13T09:59:00.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04865d5a0 con 0x55f04864ca00 2023-09-13T09:59:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f04865d760 con 0x55f04864e060 2023-09-13T09:59:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.668+0000 7f46ad3c2b80 10 client.0 _ll_register_callbacks cb 0x55f04853a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f048657a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469ad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f048657a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39694/0 (socket says 172.21.15.6:39694) 2023-09-13T09:59:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469ad9d700 1 -- 172.21.15.6:0/3862195128 learned_addr learned my addr 172.21.15.6:0/3862195128 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:00.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469b59e700 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469b59e700 1 -- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 msgr2=0x55f048657a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469b59e700 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f048657a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469b59e700 1 -- 172.21.15.6:0/3862195128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864d700 msgr2=0x55f048657fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469b59e700 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864d700 0x55f048657fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469b59e700 1 -- 172.21.15.6:0/3862195128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469c072ca0 con 0x55f04864e060 2023-09-13T09:59:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469ad9d700 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f048657a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f469b59e700 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865cef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f469410e5c0 tx=0x7f4694009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcfb029852e63cbe server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f467eff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:59:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.669+0000 7f467eff5700 1 -- 172.21.15.6:0/3862195128 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46940e5d20 con 0x55f04864e060 2023-09-13T09:59:00.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f468c00fcf0 con 0x55f04864e060 2023-09-13T09:59:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f467eff5700 1 -- 172.21.15.6:0/3862195128 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46940fd040 con 0x55f04864e060 2023-09-13T09:59:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f467eff5700 1 -- 172.21.15.6:0/3862195128 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46940f6360 con 0x55f04864e060 2023-09-13T09:59:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 10 client.29803 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55f0483b3c60 con 0x55f04864e060 2023-09-13T09:59:00.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f467eff5700 1 -- 172.21.15.6:0/3862195128 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46940ef080 con 0x55f04864e060 2023-09-13T09:59:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f467eff5700 1 -- 172.21.15.6:0/3862195128 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f46940d9dc0 con 0x55f04864e060 2023-09-13T09:59:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 10 client.29803 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 10 client.29803 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 20 client.29803 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:00.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0486c7f60 0x55f0486ca350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 4 client.29803 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:59:00.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f048558050 con 0x55f0486c7f60 2023-09-13T09:59:00.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.670+0000 7f469ad9d700 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0486c7f60 0x55f0486ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.671+0000 7f467eff5700 10 client.29803 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.671+0000 7f469ad9d700 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0486c7f60 0x55f0486ca350 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d3302b8eb25d0db server_cookie=c3c4ba54423a3194 in_seq=0 out_seq=0 2023-09-13T09:59:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f467eff5700 1 -- 172.21.15.6:0/3862195128 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f048558050 con 0x55f0486c7f60 2023-09-13T09:59:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f467eff5700 10 client.29803 handle_command_reply: tid=0 2023-09-13T09:59:00.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 client.29803 shutdown 2023-09-13T09:59:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 msgr2=0x55f04865cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865cef0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f469410e5c0 tx=0x7f4694009b80 comp rx=0 tx=0).stop 2023-09-13T09:59:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 shutdown_connections 2023-09-13T09:59:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f04864e060 0x55f04865cef0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f04864ca00 0x55f048657a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0486c7f60 0x55f0486ca350 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 --2- 172.21.15.6:0/3862195128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f04864d700 0x55f048657fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.673+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 >> 172.21.15.6:0/3862195128 conn(0x55f0485aac80 msgr2=0x55f048650980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f467eff5700 0 client.29803 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:00.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 shutdown_connections 2023-09-13T09:59:00.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f46ad3c2b80 1 -- 172.21.15.6:0/3862195128 wait complete. 2023-09-13T09:59:00.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f46ad3c2b80 20 client.29803 trim_cache size 0 max 16384 2023-09-13T09:59:00.686 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:59:00.686 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T09:59:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:59:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "01b4c6a7-699f-4a3d-b91b-9fed32fe50b8": { 2023-09-13T09:59:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:59:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "01b4c6a7-699f-4a3d-b91b-9fed32fe50b8", 2023-09-13T09:59:00.687 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:59:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:59:00.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:59:00.688 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:59:00.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46840a07c0 msgr2=0x7f46840a2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f46a11dd700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46840a07c0 0x7f46840a2c80 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f468c017000 tx=0x7f468c010bb0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 msgr2=0x7f469c071c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:00.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.674+0000 7f46a11dd700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c071c70 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f46940062a0 tx=0x7f4694004d30 comp rx=0 tx=0).stop 2023-09-13T09:59:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 shutdown_connections 2023-09-13T09:59:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46840a07c0 0x7f46840a2c80 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f469c104970 0x7f469c071c70 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f469c0ff630 0x7f469c0706f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 --2- 172.21.15.6:0/2530777794 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f469c101fa0 0x7f469c070c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 >> 172.21.15.6:0/2530777794 conn(0x7f469c0fb250 msgr2=0x7f469c1002e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 shutdown_connections 2023-09-13T09:59:00.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:00.675+0000 7f46a11dd700 1 -- 172.21.15.6:0/2530777794 wait complete. 2023-09-13T09:59:00.692 INFO:tasks.cephfs.filesystem:scrub status for tag:01b4c6a7-699f-4a3d-b91b-9fed32fe50b8 - {'path': '/', 'tag': '01b4c6a7-699f-4a3d-b91b-9fed32fe50b8', 'options': 'recursive,force'} 2023-09-13T09:59:01.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:01 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:01.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:01 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:01 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:01.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:01 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:01 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:01.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:01 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.522 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:01 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:01.523 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:01 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.523 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:01 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:01.523 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:01 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.524 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:01 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:01.524 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:01 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:01 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:01.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:01 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:01 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:01.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:01 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.526 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:01 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:01.526 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:01 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:01.593 INFO:tasks.workunit.client.0.smithi006.stdout: 10 259189 35.62 MB/sec execute 261 sec latency 77.529 ms 2023-09-13T09:59:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:59:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: pgmap v885: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 504 op/s 2023-09-13T09:59:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:02.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:02.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:02 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:59:02.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:02.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:02.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:02.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:02.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: pgmap v885: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 504 op/s 2023-09-13T09:59:02.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:02.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:02.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:02 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:59:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: pgmap v885: 97 pgs: 97 active+clean; 1.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 504 op/s 2023-09-13T09:59:02.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:02 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:02.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 259753 35.61 MB/sec execute 262 sec latency 238.840 ms 2023-09-13T09:59:03.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 260373 35.60 MB/sec execute 263 sec latency 282.264 ms 2023-09-13T09:59:04.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:04 smithi006 ceph-mon[98665]: pgmap v886: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 546 op/s 2023-09-13T09:59:04.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:04 smithi053 ceph-mon[102373]: pgmap v886: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 546 op/s 2023-09-13T09:59:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:04 smithi131 ceph-mon[102785]: pgmap v886: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 546 op/s 2023-09-13T09:59:04.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 261101 35.61 MB/sec execute 264 sec latency 48.101 ms 2023-09-13T09:59:05.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 261756 35.63 MB/sec execute 265 sec latency 84.989 ms 2023-09-13T09:59:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:06 smithi006 ceph-mon[98665]: pgmap v887: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 572 op/s 2023-09-13T09:59:06.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:06 smithi053 ceph-mon[102373]: pgmap v887: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 572 op/s 2023-09-13T09:59:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:06 smithi131 ceph-mon[102785]: pgmap v887: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 4.1 MiB/s wr, 572 op/s 2023-09-13T09:59:06.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 262341 35.60 MB/sec execute 266 sec latency 102.761 ms 2023-09-13T09:59:07.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 262951 35.59 MB/sec execute 267 sec latency 135.533 ms 2023-09-13T09:59:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:08 smithi053 ceph-mon[102373]: pgmap v888: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 530 op/s 2023-09-13T09:59:08.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:08 smithi006 ceph-mon[98665]: pgmap v888: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 530 op/s 2023-09-13T09:59:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:08 smithi131 ceph-mon[102785]: pgmap v888: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 530 op/s 2023-09-13T09:59:08.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 263578 35.59 MB/sec execute 268 sec latency 144.494 ms 2023-09-13T09:59:09.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 264297 35.59 MB/sec execute 269 sec latency 202.143 ms 2023-09-13T09:59:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:10 smithi006 ceph-mon[98665]: pgmap v889: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 496 op/s 2023-09-13T09:59:10.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:10 smithi053 ceph-mon[102373]: pgmap v889: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 496 op/s 2023-09-13T09:59:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:10 smithi131 ceph-mon[102785]: pgmap v889: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 496 op/s 2023-09-13T09:59:10.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 264990 35.59 MB/sec execute 270 sec latency 55.348 ms 2023-09-13T09:59:11.589 INFO:tasks.workunit.client.0.smithi006.stdout: 10 265626 35.59 MB/sec execute 271 sec latency 60.949 ms 2023-09-13T09:59:12.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:12 smithi053 ceph-mon[102373]: pgmap v890: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 484 op/s 2023-09-13T09:59:12.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:12 smithi006 ceph-mon[98665]: pgmap v890: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 484 op/s 2023-09-13T09:59:12.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:12 smithi131 ceph-mon[102785]: pgmap v890: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 484 op/s 2023-09-13T09:59:12.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 265989 35.54 MB/sec execute 272 sec latency 511.973 ms 2023-09-13T09:59:13.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 266108 35.43 MB/sec execute 273 sec latency 984.068 ms 2023-09-13T09:59:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:14 smithi053 ceph-mon[102373]: pgmap v891: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 570 op/s 2023-09-13T09:59:14.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:14 smithi006 ceph-mon[98665]: pgmap v891: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 570 op/s 2023-09-13T09:59:14.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:14 smithi131 ceph-mon[102785]: pgmap v891: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 4.1 MiB/s wr, 570 op/s 2023-09-13T09:59:14.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 266389 35.37 MB/sec execute 274 sec latency 138.030 ms 2023-09-13T09:59:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:15.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:15 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:15.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:15.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:15 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:15.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:15.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:15.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:15.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:15 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:15.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 266963 35.35 MB/sec execute 275 sec latency 132.808 ms 2023-09-13T09:59:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:16 smithi006 ceph-mon[98665]: pgmap v892: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 631 op/s 2023-09-13T09:59:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:16 smithi053 ceph-mon[102373]: pgmap v892: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 631 op/s 2023-09-13T09:59:16.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:16 smithi131 ceph-mon[102785]: pgmap v892: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.7 MiB/s wr, 631 op/s 2023-09-13T09:59:16.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 267521 35.34 MB/sec execute 276 sec latency 66.637 ms 2023-09-13T09:59:17.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 267887 35.27 MB/sec execute 277 sec latency 323.720 ms 2023-09-13T09:59:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:18 smithi006 ceph-mon[98665]: pgmap v893: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 658 op/s 2023-09-13T09:59:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:18 smithi053 ceph-mon[102373]: pgmap v893: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 658 op/s 2023-09-13T09:59:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:18 smithi131 ceph-mon[102785]: pgmap v893: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 658 op/s 2023-09-13T09:59:18.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 268275 35.22 MB/sec execute 278 sec latency 120.709 ms 2023-09-13T09:59:19.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 268883 35.18 MB/sec execute 279 sec latency 115.462 ms 2023-09-13T09:59:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:20 smithi006 ceph-mon[98665]: pgmap v894: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 801 op/s 2023-09-13T09:59:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:20 smithi053 ceph-mon[102373]: pgmap v894: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 801 op/s 2023-09-13T09:59:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:20 smithi131 ceph-mon[102785]: pgmap v894: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 14 MiB/s wr, 801 op/s 2023-09-13T09:59:20.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 269661 35.21 MB/sec execute 280 sec latency 80.380 ms 2023-09-13T09:59:21.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 270365 35.24 MB/sec execute 281 sec latency 58.953 ms 2023-09-13T09:59:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:22 smithi006 ceph-mon[98665]: pgmap v895: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 820 op/s 2023-09-13T09:59:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:22 smithi053 ceph-mon[102373]: pgmap v895: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 820 op/s 2023-09-13T09:59:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:22 smithi131 ceph-mon[102785]: pgmap v895: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 820 op/s 2023-09-13T09:59:22.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 270953 35.23 MB/sec execute 282 sec latency 69.698 ms 2023-09-13T09:59:23.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 271623 35.24 MB/sec execute 283 sec latency 61.339 ms 2023-09-13T09:59:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:24 smithi006 ceph-mon[98665]: pgmap v896: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 895 op/s 2023-09-13T09:59:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:24 smithi053 ceph-mon[102373]: pgmap v896: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 895 op/s 2023-09-13T09:59:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:24 smithi131 ceph-mon[102785]: pgmap v896: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 895 op/s 2023-09-13T09:59:24.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 272164 35.23 MB/sec execute 284 sec latency 160.471 ms 2023-09-13T09:59:25.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 272802 35.19 MB/sec execute 285 sec latency 111.710 ms 2023-09-13T09:59:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:26 smithi006 ceph-mon[98665]: pgmap v897: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 851 op/s 2023-09-13T09:59:26.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:26 smithi053 ceph-mon[102373]: pgmap v897: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 851 op/s 2023-09-13T09:59:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:26 smithi131 ceph-mon[102785]: pgmap v897: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 16 MiB/s wr, 851 op/s 2023-09-13T09:59:26.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 273533 35.24 MB/sec execute 286 sec latency 75.237 ms 2023-09-13T09:59:27.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 274124 35.21 MB/sec execute 287 sec latency 67.956 ms 2023-09-13T09:59:28.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:28 smithi006 ceph-mon[98665]: pgmap v898: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 819 op/s 2023-09-13T09:59:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:28 smithi053 ceph-mon[102373]: pgmap v898: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 819 op/s 2023-09-13T09:59:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:28 smithi131 ceph-mon[102785]: pgmap v898: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 12 MiB/s wr, 819 op/s 2023-09-13T09:59:28.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 274729 35.19 MB/sec execute 288 sec latency 91.060 ms 2023-09-13T09:59:29.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 275276 35.18 MB/sec execute 289 sec latency 155.653 ms 2023-09-13T09:59:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:30 smithi006 ceph-mon[98665]: pgmap v899: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 688 op/s 2023-09-13T09:59:30.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:30 smithi053 ceph-mon[102373]: pgmap v899: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 688 op/s 2023-09-13T09:59:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:30 smithi131 ceph-mon[102785]: pgmap v899: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 688 op/s 2023-09-13T09:59:30.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 276001 35.18 MB/sec execute 290 sec latency 144.487 ms 2023-09-13T09:59:30.693 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:59:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 -- 172.21.15.6:0/3382541058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0ffcc0 msgr2=0x7faa8c1000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3382541058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0ffcc0 0x7faa8c1000e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7faa88009990 tx=0x7faa88009ca0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 -- 172.21.15.6:0/3382541058 shutdown_connections 2023-09-13T09:59:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3382541058 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa8c101850 0x7faa8c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3382541058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c0ffcc0 0x7faa8c1000e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3382541058 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c100eb0 0x7faa8c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 -- 172.21.15.6:0/3382541058 >> 172.21.15.6:0/3382541058 conn(0x7faa8c0fb250 msgr2=0x7faa8c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:30.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 -- 172.21.15.6:0/3382541058 shutdown_connections 2023-09-13T09:59:30.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.855+0000 7faa93ec4700 1 -- 172.21.15.6:0/3382541058 wait complete. 2023-09-13T09:59:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 Processor -- start 2023-09-13T09:59:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 -- start start 2023-09-13T09:59:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa8c0ffcc0 0x7faa8c196a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c100eb0 0x7faa8c196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c101850 0x7faa8c19e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c19e5f0 con 0x7faa8c101850 2023-09-13T09:59:30.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c06a6d0 con 0x7faa8c0ffcc0 2023-09-13T09:59:30.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa93ec4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa8c06a860 con 0x7faa8c100eb0 2023-09-13T09:59:30.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa92461700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c101850 0x7faa8c19e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa92461700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c101850 0x7faa8c19e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46186/0 (socket says 172.21.15.6:46186) 2023-09-13T09:59:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa92461700 1 -- 172.21.15.6:0/3103446170 learned_addr learned my addr 172.21.15.6:0/3103446170 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.856+0000 7faa9145f700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c100eb0 0x7faa8c196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa91c60700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa8c0ffcc0 0x7faa8c196a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa92461700 1 -- 172.21.15.6:0/3103446170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c100eb0 msgr2=0x7faa8c196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa92461700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c100eb0 0x7faa8c196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa92461700 1 -- 172.21.15.6:0/3103446170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa8c0ffcc0 msgr2=0x7faa8c196a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa92461700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa8c0ffcc0 0x7faa8c196a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa92461700 1 -- 172.21.15.6:0/3103446170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa880095f0 con 0x7faa8c101850 2023-09-13T09:59:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa91c60700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa8c0ffcc0 0x7faa8c196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:59:30.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa92461700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c101850 0x7faa8c19e020 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7faa8400ef30 tx=0x7faa8400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa82ffd700 1 -- 172.21.15.6:0/3103446170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84018070 con 0x7faa8c101850 2023-09-13T09:59:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa82ffd700 1 -- 172.21.15.6:0/3103446170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa8400f040 con 0x7faa8c101850 2023-09-13T09:59:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.857+0000 7faa82ffd700 1 -- 172.21.15.6:0/3103446170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8400cdb0 con 0x7faa8c101850 2023-09-13T09:59:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.858+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa8c06aae0 con 0x7faa8c101850 2023-09-13T09:59:30.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.858+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c06af70 con 0x7faa8c101850 2023-09-13T09:59:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.861+0000 7faa82ffd700 1 -- 172.21.15.6:0/3103446170 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7faa84003a00 con 0x7faa8c101850 2023-09-13T09:59:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.861+0000 7faa82ffd700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa780a06c0 0x7faa780a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.861+0000 7faa82ffd700 1 -- 172.21.15.6:0/3103446170 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa840caf10 con 0x7faa8c101850 2023-09-13T09:59:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.861+0000 7faa91c60700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa780a06c0 0x7faa780a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.862+0000 7faa91c60700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa780a06c0 0x7faa780a2b80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7faa8800b2e0 tx=0x7faa88005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.862+0000 7faaa00a9b80 1 Processor -- start 2023-09-13T09:59:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faaa00a9b80 1 -- start start 2023-09-13T09:59:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71f700 0x559a2e71fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e720060 0x559a2e71e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e677780 con 0x559a2e71ea00 2023-09-13T09:59:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e6750a0 con 0x559a2e71f700 2023-09-13T09:59:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e670990 con 0x559a2e720060 2023-09-13T09:59:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa9145f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e720060 0x559a2e71e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa9145f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e720060 0x559a2e71e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49248/0 (socket says 172.21.15.6:49248) 2023-09-13T09:59:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa9145f700 1 -- 172.21.15.6:0/1712435519 learned_addr learned my addr 172.21.15.6:0/1712435519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa92461700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa92461700 1 -- 172.21.15.6:0/1712435519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e720060 msgr2=0x559a2e71e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa92461700 1 --2- 172.21.15.6:0/1712435519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e720060 0x559a2e71e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa92461700 1 -- 172.21.15.6:0/1712435519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71f700 msgr2=0x559a2e71fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa92461700 1 --2- 172.21.15.6:0/1712435519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71f700 0x559a2e71fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.863+0000 7faa92461700 1 -- 172.21.15.6:0/1712435519 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a2e4f0630 con 0x559a2e71ea00 2023-09-13T09:59:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.864+0000 7faa92461700 1 --2- 172.21.15.6:0/1712435519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71ee80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7faa840c8a10 tx=0x7faa84098500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcf0373cc9b7a1c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.864+0000 7faa77fff700 1 -- 172.21.15.6:0/1712435519 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84098db0 con 0x559a2e71ea00 2023-09-13T09:59:30.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.864+0000 7faa77fff700 1 -- 172.21.15.6:0/1712435519 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa840986b0 con 0x559a2e71ea00 2023-09-13T09:59:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.864+0000 7faa77fff700 1 -- 172.21.15.6:0/1712435519 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa84098910 con 0x559a2e71ea00 2023-09-13T09:59:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.865+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1712435519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 msgr2=0x559a2e71ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.865+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1712435519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71ee80 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7faa840c8a10 tx=0x7faa84098500 comp rx=0 tx=0).stop 2023-09-13T09:59:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.865+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1712435519 shutdown_connections 2023-09-13T09:59:30.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.865+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1712435519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71ee80 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.865+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1712435519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71f700 0x559a2e71fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.865+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1712435519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e720060 0x559a2e71e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.865+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1712435519 >> 172.21.15.6:0/1712435519 conn(0x559a2e67cc80 msgr2=0x559a2e718f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:30.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.866+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1712435519 shutdown_connections 2023-09-13T09:59:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.866+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1712435519 wait complete. 2023-09-13T09:59:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.866+0000 7faaa00a9b80 1 -- start start 2023-09-13T09:59:30.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.866+0000 7faaa00a9b80 1 Processor -- start 2023-09-13T09:59:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e728030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e728570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e72f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e60ebb0 con 0x559a2e72d5a0 2023-09-13T09:59:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e60e8b0 con 0x559a2e71ea00 2023-09-13T09:59:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e4f2920 con 0x559a2e71f700 2023-09-13T09:59:30.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faaa00a9b80 10 client.0 _ll_register_callbacks cb 0x559a2e60c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e728570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa91c60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e728030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e728570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49254/0 (socket says 172.21.15.6:49254) 2023-09-13T09:59:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 -- 172.21.15.6:0/1060297361 learned_addr learned my addr 172.21.15.6:0/1060297361 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:30.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa92461700 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e72f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 -- 172.21.15.6:0/1060297361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 msgr2=0x559a2e728030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e728030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 -- 172.21.15.6:0/1060297361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 msgr2=0x559a2e72f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e72f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa9145f700 1 -- 172.21.15.6:0/1060297361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa8c06af70 con 0x559a2e71f700 2023-09-13T09:59:30.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.867+0000 7faa92461700 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e72f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:59:30.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faa9145f700 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e728570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00be40 tx=0x7faa7c012730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=304206093c2d0e66 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:30.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faa757fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:59:30.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faa757fa700 1 -- 172.21.15.6:0/1060297361 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c004220 con 0x559a2e71f700 2023-09-13T09:59:30.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a2e711670 con 0x559a2e71f700 2023-09-13T09:59:30.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faa757fa700 1 -- 172.21.15.6:0/1060297361 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa7c004380 con 0x559a2e71f700 2023-09-13T09:59:30.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faa757fa700 1 -- 172.21.15.6:0/1060297361 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa7c004540 con 0x559a2e71f700 2023-09-13T09:59:30.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faaa00a9b80 10 client.29815 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:30.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x559a2e6887a0 con 0x559a2e71f700 2023-09-13T09:59:30.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faa757fa700 1 -- 172.21.15.6:0/1060297361 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559a2e711670 con 0x559a2e71f700 2023-09-13T09:59:30.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faa757fa700 1 -- 172.21.15.6:0/1060297361 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faa7c0109c0 con 0x559a2e71f700 2023-09-13T09:59:30.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faaa00a9b80 10 client.29815 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:30.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faaa00a9b80 10 client.29815 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:30.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.868+0000 7faaa00a9b80 20 client.29815 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:30.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.869+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e734340 0x559a2e736760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.869+0000 7faaa00a9b80 4 client.29815 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:30.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.869+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a2e669970 con 0x559a2e734340 2023-09-13T09:59:30.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.869+0000 7faa91c60700 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e734340 0x559a2e736760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.869+0000 7faa757fa700 10 client.29815 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:30.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.869+0000 7faa91c60700 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e734340 0x559a2e736760 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7af7db1860f8720 server_cookie=488138d1156eb062 in_seq=0 out_seq=0 2023-09-13T09:59:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faa757fa700 1 -- 172.21.15.6:0/1060297361 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a2e669970 con 0x559a2e734340 2023-09-13T09:59:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faa757fa700 10 client.29815 handle_command_reply: tid=0 2023-09-13T09:59:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 client.29815 shutdown 2023-09-13T09:59:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 msgr2=0x559a2e728570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e728570 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7faa7c00be40 tx=0x7faa7c012730 comp rx=0 tx=0).stop 2023-09-13T09:59:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 shutdown_connections 2023-09-13T09:59:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e734340 0x559a2e736760 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faa757fa700 0 client.29815 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e72f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e728030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1060297361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e728570 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 >> 172.21.15.6:0/1060297361 conn(0x559a2e67cc80 msgr2=0x559a2e7137f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 shutdown_connections 2023-09-13T09:59:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1060297361 wait complete. 2023-09-13T09:59:30.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.874+0000 7faaa00a9b80 20 client.29815 trim_cache size 0 max 16384 2023-09-13T09:59:30.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 Processor -- start 2023-09-13T09:59:30.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 -- start start 2023-09-13T09:59:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e743f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e72d5a0 0x559a2e722980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e725c90 con 0x559a2e71ea00 2023-09-13T09:59:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e7234e0 con 0x559a2e72d5a0 2023-09-13T09:59:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e728c90 con 0x559a2e71f700 2023-09-13T09:59:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faa91c60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faa9145f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e743f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faa91c60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46206/0 (socket says 172.21.15.6:46206) 2023-09-13T09:59:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faa9145f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e743f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49262/0 (socket says 172.21.15.6:49262) 2023-09-13T09:59:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faa91c60700 1 -- 172.21.15.6:0/3895819875 learned_addr learned my addr 172.21.15.6:0/3895819875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.897+0000 7faa92461700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e72d5a0 0x559a2e722980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa91c60700 1 -- 172.21.15.6:0/3895819875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 msgr2=0x559a2e743f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa91c60700 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e743f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa91c60700 1 -- 172.21.15.6:0/3895819875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e72d5a0 msgr2=0x559a2e722980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa91c60700 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e72d5a0 0x559a2e722980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa91c60700 1 -- 172.21.15.6:0/3895819875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a2e49cde0 con 0x559a2e71ea00 2023-09-13T09:59:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa9145f700 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e743f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa92461700 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e72d5a0 0x559a2e722980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa91c60700 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71e4c0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7faa88009990 tx=0x7faa88009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4627b49a98e692b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa80ff9700 1 -- 172.21.15.6:0/3895819875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8802c040 con 0x559a2e71ea00 2023-09-13T09:59:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa80ff9700 1 -- 172.21.15.6:0/3895819875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa8800bbb0 con 0x559a2e71ea00 2023-09-13T09:59:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.898+0000 7faa80ff9700 1 -- 172.21.15.6:0/3895819875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa8801e070 con 0x559a2e71ea00 2023-09-13T09:59:30.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 -- 172.21.15.6:0/3895819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 msgr2=0x559a2e71e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71e4c0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7faa88009990 tx=0x7faa88009ca0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 -- 172.21.15.6:0/3895819875 shutdown_connections 2023-09-13T09:59:30.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e72d5a0 0x559a2e722980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e71ea00 0x559a2e71e4c0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/3895819875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e743f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 -- 172.21.15.6:0/3895819875 >> 172.21.15.6:0/3895819875 conn(0x559a2e67cc80 msgr2=0x559a2e726bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 -- 172.21.15.6:0/3895819875 shutdown_connections 2023-09-13T09:59:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.899+0000 7faaa00a9b80 1 -- 172.21.15.6:0/3895819875 wait complete. 2023-09-13T09:59:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 -- start start 2023-09-13T09:59:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 Processor -- start 2023-09-13T09:59:30.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e741af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e742030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e743040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e743580 con 0x559a2e72d5a0 2023-09-13T09:59:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e7436f0 con 0x559a2e71ea00 2023-09-13T09:59:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a2e7438b0 con 0x559a2e71f700 2023-09-13T09:59:30.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faaa00a9b80 10 client.0 _ll_register_callbacks cb 0x559a2e60c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faa92461700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e743040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faa92461700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e743040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46216/0 (socket says 172.21.15.6:46216) 2023-09-13T09:59:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faa91c60700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e741af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faa92461700 1 -- 172.21.15.6:0/1661087029 learned_addr learned my addr 172.21.15.6:0/1661087029 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:30.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.900+0000 7faa9145f700 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e742030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa9145f700 1 -- 172.21.15.6:0/1661087029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 msgr2=0x559a2e741af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa9145f700 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e741af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa9145f700 1 -- 172.21.15.6:0/1661087029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 msgr2=0x559a2e743040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:30.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa9145f700 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e743040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa9145f700 1 -- 172.21.15.6:0/1661087029 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a2e6887a0 con 0x559a2e71f700 2023-09-13T09:59:30.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa92461700 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e743040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:30.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa757fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:59:30.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa9145f700 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e742030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa7c010df0 tx=0x7faa7c01a620 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78a975d298488a5c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:30.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa757fa700 1 -- 172.21.15.6:0/1661087029 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7c0052b0 con 0x559a2e71f700 2023-09-13T09:59:30.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa840986b0 con 0x559a2e71f700 2023-09-13T09:59:30.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa757fa700 1 -- 172.21.15.6:0/1661087029 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa7c005410 con 0x559a2e71f700 2023-09-13T09:59:30.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.901+0000 7faa757fa700 1 -- 172.21.15.6:0/1661087029 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa7c005c40 con 0x559a2e71f700 2023-09-13T09:59:30.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 10 client.29821 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:30.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x559a2e4f0630 con 0x559a2e71f700 2023-09-13T09:59:30.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faa757fa700 1 -- 172.21.15.6:0/1661087029 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa840986b0 con 0x559a2e71f700 2023-09-13T09:59:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faa757fa700 1 -- 172.21.15.6:0/1661087029 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7faa7c003680 con 0x559a2e71f700 2023-09-13T09:59:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 10 client.29821 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 10 client.29821 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 20 client.29821 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:30.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e78dac0 0x559a2e78fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:30.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 4 client.29821 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:59:30.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559a2e62a050 con 0x559a2e78dac0 2023-09-13T09:59:30.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.902+0000 7faa91c60700 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e78dac0 0x559a2e78fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:30.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.903+0000 7faa91c60700 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e78dac0 0x559a2e78fee0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d9d08bbaadf487 server_cookie=3d54e41fab471376 in_seq=0 out_seq=0 2023-09-13T09:59:30.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.903+0000 7faa757fa700 10 client.29821 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faa757fa700 1 -- 172.21.15.6:0/1661087029 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559a2e62a050 con 0x559a2e78dac0 2023-09-13T09:59:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faa757fa700 10 client.29821 handle_command_reply: tid=0 2023-09-13T09:59:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 client.29821 shutdown 2023-09-13T09:59:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 msgr2=0x559a2e742030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e742030 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7faa7c010df0 tx=0x7faa7c01a620 comp rx=0 tx=0).stop 2023-09-13T09:59:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 shutdown_connections 2023-09-13T09:59:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a2e78dac0 0x559a2e78fee0 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a2e72d5a0 0x559a2e743040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a2e71ea00 0x559a2e741af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faa757fa700 0 client.29821 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:30.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 --2- 172.21.15.6:0/1661087029 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a2e71f700 0x559a2e742030 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 >> 172.21.15.6:0/1661087029 conn(0x559a2e67cc80 msgr2=0x559a2e726bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:30.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 shutdown_connections 2023-09-13T09:59:30.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 1 -- 172.21.15.6:0/1661087029 wait complete. 2023-09-13T09:59:30.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.905+0000 7faaa00a9b80 20 client.29821 trim_cache size 0 max 16384 2023-09-13T09:59:30.922 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:59:30.922 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T09:59:30.922 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T09:59:30.922 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:59:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa780a06c0 msgr2=0x7faa780a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa780a06c0 0x7faa780a2b80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7faa8800b2e0 tx=0x7faa88005e80 comp rx=0 tx=0).stop 2023-09-13T09:59:30.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c101850 msgr2=0x7faa8c19e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c101850 0x7faa8c19e020 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7faa8400ef30 tx=0x7faa8400c3a0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 shutdown_connections 2023-09-13T09:59:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa780a06c0 0x7faa780a2b80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa8c101850 0x7faa8c19e020 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa8c0ffcc0 0x7faa8c196a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 --2- 172.21.15.6:0/3103446170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa8c100eb0 0x7faa8c196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 >> 172.21.15.6:0/3103446170 conn(0x7faa8c0fb250 msgr2=0x7faa8c104390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 shutdown_connections 2023-09-13T09:59:30.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:30.906+0000 7faa93ec4700 1 -- 172.21.15.6:0/3103446170 wait complete. 2023-09-13T09:59:30.927 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T09:59:30.927 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T09:59:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 -- 172.21.15.6:0/3572524832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 msgr2=0x7f337c1000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 --2- 172.21.15.6:0/3572524832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c1000c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f336c0099c0 tx=0x7f336c009cd0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 -- 172.21.15.6:0/3572524832 shutdown_connections 2023-09-13T09:59:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 --2- 172.21.15.6:0/3572524832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f337c101830 0x7f337c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 --2- 172.21.15.6:0/3572524832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c1000c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 --2- 172.21.15.6:0/3572524832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f337c100e90 0x7f337c1012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 -- 172.21.15.6:0/3572524832 >> 172.21.15.6:0/3572524832 conn(0x7f337c0fb250 msgr2=0x7f337c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 -- 172.21.15.6:0/3572524832 shutdown_connections 2023-09-13T09:59:31.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.071+0000 7f338089f700 1 -- 172.21.15.6:0/3572524832 wait complete. 2023-09-13T09:59:31.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.072+0000 7f338089f700 1 Processor -- start 2023-09-13T09:59:31.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.072+0000 7f338089f700 1 -- start start 2023-09-13T09:59:31.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f338089f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c0698e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f338089f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f337c100e90 0x7f337c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f338089f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f337c101830 0x7f337c19de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f338089f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c19e620 con 0x7f337c100e90 2023-09-13T09:59:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f338089f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c19e790 con 0x7f337c0ffca0 2023-09-13T09:59:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f338089f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f337c19e950 con 0x7f337c101830 2023-09-13T09:59:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c0698e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c0698e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39750/0 (socket says 172.21.15.6:39750) 2023-09-13T09:59:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 -- 172.21.15.6:0/1429908625 learned_addr learned my addr 172.21.15.6:0/1429908625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337ad9d700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f337c101830 0x7f337c19de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f3379d9b700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f337c100e90 0x7f337c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 -- 172.21.15.6:0/1429908625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f337c101830 msgr2=0x7f337c19de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f337c101830 0x7f337c19de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 -- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f337c100e90 msgr2=0x7f337c19b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f337c100e90 0x7f337c19b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 -- 172.21.15.6:0/1429908625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f336c0095f0 con 0x7f337c0ffca0 2023-09-13T09:59:31.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337ad9d700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f337c101830 0x7f337c19de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.073+0000 7f337a59c700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c0698e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f336c009990 tx=0x7f336c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.074+0000 7f336b7fe700 1 -- 172.21.15.6:0/1429908625 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c01d070 con 0x7f337c0ffca0 2023-09-13T09:59:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.074+0000 7f336b7fe700 1 -- 172.21.15.6:0/1429908625 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f336c005030 con 0x7f337c0ffca0 2023-09-13T09:59:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.074+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f337c19ebd0 con 0x7f337c0ffca0 2023-09-13T09:59:31.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.074+0000 7f336b7fe700 1 -- 172.21.15.6:0/1429908625 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336c004b30 con 0x7f337c0ffca0 2023-09-13T09:59:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.074+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f337c19eff0 con 0x7f337c0ffca0 2023-09-13T09:59:31.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.075+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337c106c20 con 0x7f337c0ffca0 2023-09-13T09:59:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.077+0000 7f336b7fe700 1 -- 172.21.15.6:0/1429908625 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f336c005410 con 0x7f337c0ffca0 2023-09-13T09:59:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.077+0000 7f336b7fe700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33640a0640 0x7f33640a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.077+0000 7f336b7fe700 1 -- 172.21.15.6:0/1429908625 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f336c0ccde0 con 0x7f337c0ffca0 2023-09-13T09:59:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.077+0000 7f3379d9b700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33640a0640 0x7f33640a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.078+0000 7f3379d9b700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33640a0640 0x7f33640a2b00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3370007c60 tx=0x7f33700073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.086+0000 7f336b7fe700 1 -- 172.21.15.6:0/1429908625 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f336c096950 con 0x7f337c0ffca0 2023-09-13T09:59:31.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.388+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f337c0008d0 con 0x7f337c0ffca0 2023-09-13T09:59:31.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.389+0000 7f336b7fe700 1 -- 172.21.15.6:0/1429908625 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+11343 (secure 0 0 0) 0x7f336c099f70 con 0x7f337c0ffca0 2023-09-13T09:59:31.391 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T09:59:31.391 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":66,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":66,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:57:57.567802+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T09:59:31.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33640a0640 msgr2=0x7f33640a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33640a0640 0x7f33640a2b00 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3370007c60 tx=0x7f33700073d0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 msgr2=0x7f337c0698e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c0698e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f336c009990 tx=0x7f336c00f690 comp rx=0 tx=0).stop 2023-09-13T09:59:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 shutdown_connections 2023-09-13T09:59:31.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f337c101830 0x7f337c19de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f337c0ffca0 0x7f337c0698e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f33640a0640 0x7f33640a2b00 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 --2- 172.21.15.6:0/1429908625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f337c100e90 0x7f337c19b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 >> 172.21.15.6:0/1429908625 conn(0x7f337c0fb250 msgr2=0x7f337c0fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 shutdown_connections 2023-09-13T09:59:31.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.392+0000 7f338089f700 1 -- 172.21.15.6:0/1429908625 wait complete. 2023-09-13T09:59:31.397 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 66 2023-09-13T09:59:31.407 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T09:59:31.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 -- 172.21.15.6:0/2822779588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac101850 msgr2=0x7fb6ac108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 --2- 172.21.15.6:0/2822779588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac101850 0x7fb6ac108100 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fb6a400b0d0 tx=0x7fb6a400b3e0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 -- 172.21.15.6:0/2822779588 shutdown_connections 2023-09-13T09:59:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 --2- 172.21.15.6:0/2822779588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac101850 0x7fb6ac108100 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 --2- 172.21.15.6:0/2822779588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ac0ffcc0 0x7fb6ac1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 --2- 172.21.15.6:0/2822779588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac100eb0 0x7fb6ac101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 -- 172.21.15.6:0/2822779588 >> 172.21.15.6:0/2822779588 conn(0x7fb6ac0fb210 msgr2=0x7fb6ac0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 -- 172.21.15.6:0/2822779588 shutdown_connections 2023-09-13T09:59:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.561+0000 7fb6b3110700 1 -- 172.21.15.6:0/2822779588 wait complete. 2023-09-13T09:59:31.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 Processor -- start 2023-09-13T09:59:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 -- start start 2023-09-13T09:59:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0ffcc0 0x7fb6ac195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac100eb0 0x7fb6ac195f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ac101850 0x7fb6ac19d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac19d5d0 con 0x7fb6ac100eb0 2023-09-13T09:59:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac19d710 con 0x7fb6ac0ffcc0 2023-09-13T09:59:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b3110700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac19d8a0 con 0x7fb6ac101850 2023-09-13T09:59:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac100eb0 0x7fb6ac195f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b0eac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0ffcc0 0x7fb6ac195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac100eb0 0x7fb6ac195f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46242/0 (socket says 172.21.15.6:46242) 2023-09-13T09:59:31.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 -- 172.21.15.6:0/414143418 learned_addr learned my addr 172.21.15.6:0/414143418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ac101850 0x7fb6ac19d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 -- 172.21.15.6:0/414143418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ac101850 msgr2=0x7fb6ac19d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ac101850 0x7fb6ac19d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 -- 172.21.15.6:0/414143418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0ffcc0 msgr2=0x7fb6ac195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0ffcc0 0x7fb6ac195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.562+0000 7fb6abfff700 1 -- 172.21.15.6:0/414143418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a4009d00 con 0x7fb6ac100eb0 2023-09-13T09:59:31.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.563+0000 7fb6abfff700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac100eb0 0x7fb6ac195f90 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fb69800e9a0 tx=0x7fb69800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.563+0000 7fb6a9ffb700 1 -- 172.21.15.6:0/414143418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698009790 con 0x7fb6ac100eb0 2023-09-13T09:59:31.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.563+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac068cd0 con 0x7fb6ac100eb0 2023-09-13T09:59:31.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.563+0000 7fb6a9ffb700 1 -- 172.21.15.6:0/414143418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb698010430 con 0x7fb6ac100eb0 2023-09-13T09:59:31.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.563+0000 7fb6a9ffb700 1 -- 172.21.15.6:0/414143418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb698018680 con 0x7fb6ac100eb0 2023-09-13T09:59:31.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.563+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac069230 con 0x7fb6ac100eb0 2023-09-13T09:59:31.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.565+0000 7fb6a9ffb700 1 -- 172.21.15.6:0/414143418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb6980105a0 con 0x7fb6ac100eb0 2023-09-13T09:59:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.566+0000 7fb6a9ffb700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb69c0a4ad0 0x7fb69c0a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.566+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb69c0a4ad0 0x7fb69c0a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.566+0000 7fb6a9ffb700 1 -- 172.21.15.6:0/414143418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb698014070 con 0x7fb6ac100eb0 2023-09-13T09:59:31.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.567+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb69c0a4ad0 0x7fb69c0a6f90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac100d10 tx=0x7fb6a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.567+0000 7fb6bf2f5b80 1 Processor -- start 2023-09-13T09:59:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.567+0000 7fb6bf2f5b80 1 -- start start 2023-09-13T09:59:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x56217859cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x56217859b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621784f4780 con 0x56217859d060 2023-09-13T09:59:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621784f20a0 con 0x56217859c700 2023-09-13T09:59:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621784ed990 con 0x56217859ba00 2023-09-13T09:59:31.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x56217859b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x56217859b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46250/0 (socket says 172.21.15.6:46250) 2023-09-13T09:59:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 -- 172.21.15.6:0/1897076262 learned_addr learned my addr 172.21.15.6:0/1897076262 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x56217859cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 -- 172.21.15.6:0/1897076262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 msgr2=0x56217859be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 -- 172.21.15.6:0/1897076262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 msgr2=0x56217859cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x56217859cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 -- 172.21.15.6:0/1897076262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56217836d630 con 0x56217859d060 2023-09-13T09:59:31.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.568+0000 7fb6abfff700 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x56217859b4c0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb6980959e0 tx=0x7fb6980993e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63533f4c4f75de18 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb696ffd700 1 -- 172.21.15.6:0/1897076262 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980994e0 con 0x56217859d060 2023-09-13T09:59:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb696ffd700 1 -- 172.21.15.6:0/1897076262 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb69809d310 con 0x56217859d060 2023-09-13T09:59:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb696ffd700 1 -- 172.21.15.6:0/1897076262 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980989d0 con 0x56217859d060 2023-09-13T09:59:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1897076262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 msgr2=0x56217859b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x56217859b4c0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fb6980959e0 tx=0x7fb6980993e0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1897076262 shutdown_connections 2023-09-13T09:59:31.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x56217859cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1897076262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x56217859b4c0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.569+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1897076262 >> 172.21.15.6:0/1897076262 conn(0x5621784f9c80 msgr2=0x562178595f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.570+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1897076262 shutdown_connections 2023-09-13T09:59:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.570+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1897076262 wait complete. 2023-09-13T09:59:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.570+0000 7fb6bf2f5b80 1 -- start start 2023-09-13T09:59:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.570+0000 7fb6bf2f5b80 1 Processor -- start 2023-09-13T09:59:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859ba00 0x5621785a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859c700 0x5621785a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x5621785ac4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217848bbb0 con 0x56217859d060 2023-09-13T09:59:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217848b8b0 con 0x56217859ba00 2023-09-13T09:59:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56217836f920 con 0x56217859c700 2023-09-13T09:59:31.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 10 client.0 _ll_register_callbacks cb 0x562178489680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x5621785ac4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b0eac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859ba00 0x5621785a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x5621785ac4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46258/0 (socket says 172.21.15.6:46258) 2023-09-13T09:59:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 -- 172.21.15.6:0/1333600341 learned_addr learned my addr 172.21.15.6:0/1333600341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 -- 172.21.15.6:0/1333600341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859c700 msgr2=0x5621785a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859c700 0x5621785a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 -- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859ba00 msgr2=0x5621785a4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859ba00 0x5621785a4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 -- 172.21.15.6:0/1333600341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac069230 con 0x56217859d060 2023-09-13T09:59:31.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859ba00 0x5621785a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:31.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x5621785ac4b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4008f80 tx=0x7fb6a4009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8323e04ac4274718 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb68bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:31.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb68bfff700 1 -- 172.21.15.6:0/1333600341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400e040 con 0x56217859d060 2023-09-13T09:59:31.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb68bfff700 1 -- 172.21.15.6:0/1333600341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb6a400bca0 con 0x56217859d060 2023-09-13T09:59:31.588 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.571+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56217858e670 con 0x56217859d060 2023-09-13T09:59:31.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb68bfff700 1 -- 172.21.15.6:0/1333600341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6a400be60 con 0x56217859d060 2023-09-13T09:59:31.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 10 client.20649 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:31.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5621785057a0 con 0x56217859d060 2023-09-13T09:59:31.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb68bfff700 1 -- 172.21.15.6:0/1333600341 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56217858e670 con 0x56217859d060 2023-09-13T09:59:31.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb68bfff700 1 -- 172.21.15.6:0/1333600341 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb6a400b100 con 0x56217859d060 2023-09-13T09:59:31.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 10 client.20649 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:31.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 10 client.20649 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:59:31.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 20 client.20649 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:31.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5621785b0d50 0x5621785b3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 4 client.20649 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:31.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621784e6970 con 0x5621785b0d50 2023-09-13T09:59:31.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.572+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5621785b0d50 0x5621785b3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.573+0000 7fb68bfff700 10 client.20649 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:59:31.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.573+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5621785b0d50 0x5621785b3170 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ce4b96ff5021c874 server_cookie=cd4b378bd52e158a in_seq=0 out_seq=0 2023-09-13T09:59:31.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb68bfff700 1 -- 172.21.15.6:0/1333600341 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5621784e6970 con 0x5621785b0d50 2023-09-13T09:59:31.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb68bfff700 10 client.20649 handle_command_reply: tid=0 2023-09-13T09:59:31.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 client.20649 shutdown 2023-09-13T09:59:31.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 msgr2=0x5621785ac4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x5621785ac4b0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4008f80 tx=0x7fb6a4009c80 comp rx=0 tx=0).stop 2023-09-13T09:59:31.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 shutdown_connections 2023-09-13T09:59:31.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5621785b0d50 0x5621785b3170 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x5621785ac4b0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859ba00 0x5621785a4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/1333600341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859c700 0x5621785a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 >> 172.21.15.6:0/1333600341 conn(0x5621784f9c80 msgr2=0x5621785907f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb68bfff700 0 client.20649 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:59:31.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 shutdown_connections 2023-09-13T09:59:31.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.578+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/1333600341 wait complete. 2023-09-13T09:59:31.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.579+0000 7fb6bf2f5b80 20 client.20649 trim_cache size 0 max 16384 2023-09-13T09:59:31.596 INFO:tasks.workunit.client.0.smithi006.stdout: 10 276807 35.24 MB/sec execute 291 sec latency 78.080 ms 2023-09-13T09:59:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 Processor -- start 2023-09-13T09:59:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 -- start start 2023-09-13T09:59:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859c700 0x5621785ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859d060 0x5621785a2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621785928e0 con 0x56217859c700 2023-09-13T09:59:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621785a2be0 con 0x56217859d060 2023-09-13T09:59:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621785a04f0 con 0x56217859ba00 2023-09-13T09:59:31.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859c700 0x5621785ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6abfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859c700 0x5621785ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46264/0 (socket says 172.21.15.6:46264) 2023-09-13T09:59:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6abfff700 1 -- 172.21.15.6:0/3307690222 learned_addr learned my addr 172.21.15.6:0/3307690222 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.595+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859d060 0x5621785a2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6abfff700 1 -- 172.21.15.6:0/3307690222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 msgr2=0x56217859b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6abfff700 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6abfff700 1 -- 172.21.15.6:0/3307690222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859d060 msgr2=0x5621785a2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6abfff700 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859d060 0x5621785a2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6abfff700 1 -- 172.21.15.6:0/3307690222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562178319de0 con 0x56217859c700 2023-09-13T09:59:31.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6abfff700 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859c700 0x5621785ac3d0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb698099470 tx=0x7fb69800c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d78bb988ce74e2d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6977fe700 1 -- 172.21.15.6:0/3307690222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980994e0 con 0x56217859c700 2023-09-13T09:59:31.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6977fe700 1 -- 172.21.15.6:0/3307690222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb6980a1550 con 0x56217859c700 2023-09-13T09:59:31.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.596+0000 7fb6977fe700 1 -- 172.21.15.6:0/3307690222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6980989d0 con 0x56217859c700 2023-09-13T09:59:31.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3307690222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859c700 msgr2=0x5621785ac3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859c700 0x5621785ac3d0 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fb698099470 tx=0x7fb69800c400 comp rx=0 tx=0).stop 2023-09-13T09:59:31.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3307690222 shutdown_connections 2023-09-13T09:59:31.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859d060 0x5621785a2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x56217859b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3307690222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859c700 0x5621785ac3d0 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3307690222 >> 172.21.15.6:0/3307690222 conn(0x5621784f9c80 msgr2=0x5621785a3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3307690222 shutdown_connections 2023-09-13T09:59:31.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3307690222 wait complete. 2023-09-13T09:59:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.597+0000 7fb6bf2f5b80 1 -- start start 2023-09-13T09:59:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 1 Processor -- start 2023-09-13T09:59:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x5621785aa3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x562178600b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x562178603100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562178603840 con 0x56217859d060 2023-09-13T09:59:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621786039b0 con 0x56217859c700 2023-09-13T09:59:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562178603b70 con 0x56217859ba00 2023-09-13T09:59:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6bf2f5b80 10 client.0 _ll_register_callbacks cb 0x562178489680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6b16ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x562178603100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6b16ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x562178603100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46272/0 (socket says 172.21.15.6:46272) 2023-09-13T09:59:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6b16ad700 1 -- 172.21.15.6:0/3396441144 learned_addr learned my addr 172.21.15.6:0/3396441144 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6b0eac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x5621785aa3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.598+0000 7fb6abfff700 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x562178600b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6b16ad700 1 -- 172.21.15.6:0/3396441144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 msgr2=0x5621785aa3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x5621785aa3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6b16ad700 1 -- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 msgr2=0x562178600b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x562178600b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6b16ad700 1 -- 172.21.15.6:0/3396441144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56217836d630 con 0x56217859d060 2023-09-13T09:59:31.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6b16ad700 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x562178603100 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4007a30 tx=0x7fb6a400b0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb147a3e0e90a29 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb68bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb68bfff700 1 -- 172.21.15.6:0/3396441144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a400e040 con 0x56217859d060 2023-09-13T09:59:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb68bfff700 1 -- 172.21.15.6:0/3396441144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb6a40052c0 con 0x56217859d060 2023-09-13T09:59:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb69809d310 con 0x56217859d060 2023-09-13T09:59:31.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb68bfff700 1 -- 172.21.15.6:0/3396441144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb6a4005480 con 0x56217859d060 2023-09-13T09:59:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6bf2f5b80 10 client.20655 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x562178302c60 con 0x56217859d060 2023-09-13T09:59:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.599+0000 7fb68bfff700 1 -- 172.21.15.6:0/3396441144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb69809d310 con 0x56217859d060 2023-09-13T09:59:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb68bfff700 1 -- 172.21.15.6:0/3396441144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fb6a40269b0 con 0x56217859d060 2023-09-13T09:59:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6bf2f5b80 10 client.20655 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6bf2f5b80 10 client.20655 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T09:59:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6bf2f5b80 20 client.20655 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562178605250 0x562178607670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6bf2f5b80 4 client.20655 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:59:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5621784a7050 con 0x562178605250 2023-09-13T09:59:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562178605250 0x562178607670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb68bfff700 10 client.20655 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T09:59:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.600+0000 7fb6b0eac700 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562178605250 0x562178607670 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=448cb166cf74080a server_cookie=c1dd865365c8a456 in_seq=0 out_seq=0 2023-09-13T09:59:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb68bfff700 1 -- 172.21.15.6:0/3396441144 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5621784a7050 con 0x562178605250 2023-09-13T09:59:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb68bfff700 10 client.20655 handle_command_reply: tid=0 2023-09-13T09:59:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 client.20655 shutdown 2023-09-13T09:59:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 msgr2=0x562178603100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x562178603100 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fb6a4007a30 tx=0x7fb6a400b0b0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 shutdown_connections 2023-09-13T09:59:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x562178605250 0x562178607670 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56217859d060 0x562178603100 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56217859ba00 0x5621785aa3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb68bfff700 0 client.20655 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T09:59:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 --2- 172.21.15.6:0/3396441144 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56217859c700 0x562178600b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 >> 172.21.15.6:0/3396441144 conn(0x5621784f9c80 msgr2=0x56217859f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 shutdown_connections 2023-09-13T09:59:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 1 -- 172.21.15.6:0/3396441144 wait complete. 2023-09-13T09:59:31.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.601+0000 7fb6bf2f5b80 20 client.20655 trim_cache size 0 max 16384 2023-09-13T09:59:31.618 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:59:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb69c0a4ad0 msgr2=0x7fb69c0a6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb69c0a4ad0 0x7fb69c0a6f90 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb6ac100d10 tx=0x7fb6a0009260 comp rx=0 tx=0).stop 2023-09-13T09:59:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac100eb0 msgr2=0x7fb6ac195f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac100eb0 0x7fb6ac195f90 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fb69800e9a0 tx=0x7fb69800ecb0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 shutdown_connections 2023-09-13T09:59:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb6ac101850 0x7fb6ac19d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb6ac0ffcc0 0x7fb6ac195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb69c0a4ad0 0x7fb69c0a6f90 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 --2- 172.21.15.6:0/414143418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac100eb0 0x7fb6ac195f90 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 >> 172.21.15.6:0/414143418 conn(0x7fb6ac0fb210 msgr2=0x7fb6ac0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 shutdown_connections 2023-09-13T09:59:31.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.602+0000 7fb6b3110700 1 -- 172.21.15.6:0/414143418 wait complete. 2023-09-13T09:59:31.622 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T09:59:31.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 -- 172.21.15.6:0/2449111634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 msgr2=0x7f47c4108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 --2- 172.21.15.6:0/2449111634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 0x7f47c4108100 secure :-1 s=READY pgs=1776 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b0d0 tx=0x7f47bc00b3e0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 -- 172.21.15.6:0/2449111634 shutdown_connections 2023-09-13T09:59:31.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 --2- 172.21.15.6:0/2449111634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 0x7f47c4108100 unknown :-1 s=CLOSED pgs=1776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 --2- 172.21.15.6:0/2449111634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 0x7f47c41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 --2- 172.21.15.6:0/2449111634 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c4100eb0 0x7f47c4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 -- 172.21.15.6:0/2449111634 >> 172.21.15.6:0/2449111634 conn(0x7f47c40fb250 msgr2=0x7f47c40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 -- 172.21.15.6:0/2449111634 shutdown_connections 2023-09-13T09:59:31.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.786+0000 7f47c9e55700 1 -- 172.21.15.6:0/2449111634 wait complete. 2023-09-13T09:59:31.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 Processor -- start 2023-09-13T09:59:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 -- start start 2023-09-13T09:59:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 0x7f47c4198de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c4100eb0 0x7f47c4199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 0x7f47c41a0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41a0960 con 0x7f47c4101850 2023-09-13T09:59:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41a0aa0 con 0x7f47c4100eb0 2023-09-13T09:59:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c9e55700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c41a0c30 con 0x7f47c40ffcc0 2023-09-13T09:59:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 0x7f47c4198de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.787+0000 7f47c2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c4100eb0 0x7f47c4199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 0x7f47c4198de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49336/0 (socket says 172.21.15.6:49336) 2023-09-13T09:59:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c2ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c4100eb0 0x7f47c4199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39808/0 (socket says 172.21.15.6:39808) 2023-09-13T09:59:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 -- 172.21.15.6:0/3793620842 learned_addr learned my addr 172.21.15.6:0/3793620842 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c3fff700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 0x7f47c41a0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 -- 172.21.15.6:0/3793620842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c4100eb0 msgr2=0x7f47c4199320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c4100eb0 0x7f47c4199320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 -- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 msgr2=0x7f47c41a0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 0x7f47c41a0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 -- 172.21.15.6:0/3793620842 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc009d00 con 0x7f47c40ffcc0 2023-09-13T09:59:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c37fe700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 0x7f47c4198de0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e970 tx=0x7f47b400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c0ff9700 1 -- 172.21.15.6:0/3793620842 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4009790 con 0x7f47c40ffcc0 2023-09-13T09:59:31.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c41a0f10 con 0x7f47c40ffcc0 2023-09-13T09:59:31.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c41a1340 con 0x7f47c40ffcc0 2023-09-13T09:59:31.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c0ff9700 1 -- 172.21.15.6:0/3793620842 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b400c7e0 con 0x7f47c40ffcc0 2023-09-13T09:59:31.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.788+0000 7f47c0ff9700 1 -- 172.21.15.6:0/3793620842 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4003be0 con 0x7f47c40ffcc0 2023-09-13T09:59:31.802 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.791+0000 7f47c0ff9700 1 -- 172.21.15.6:0/3793620842 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f47b4004220 con 0x7f47c40ffcc0 2023-09-13T09:59:31.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.792+0000 7f47c0ff9700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47ac0a0640 0x7f47ac0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.792+0000 7f47c0ff9700 1 -- 172.21.15.6:0/3793620842 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f47b4014070 con 0x7f47c40ffcc0 2023-09-13T09:59:31.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.792+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47ac0a0640 0x7f47ac0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.792+0000 7f47d603ab80 1 Processor -- start 2023-09-13T09:59:31.803 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.792+0000 7f47d603ab80 1 -- start start 2023-09-13T09:59:31.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47ac0a0640 0x7f47ac0a2b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009be0 tx=0x7f47b8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9ae2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9ae14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9ae1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.804 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47d603ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9a3a780 con 0x55e2b9ae2700 2023-09-13T09:59:31.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47d603ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9a380a0 con 0x55e2b9ae1a00 2023-09-13T09:59:31.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47d603ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9a33990 con 0x55e2b9ae3060 2023-09-13T09:59:31.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9ae2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9ae2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46290/0 (socket says 172.21.15.6:46290) 2023-09-13T09:59:31.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 -- 172.21.15.6:0/2161767308 learned_addr learned my addr 172.21.15.6:0/2161767308 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.805 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c3fff700 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9ae1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9ae14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 -- 172.21.15.6:0/2161767308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 msgr2=0x55e2b9ae14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9ae14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 -- 172.21.15.6:0/2161767308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 msgr2=0x55e2b9ae1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.806 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9ae1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 -- 172.21.15.6:0/2161767308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2b98b3630 con 0x55e2b9ae2700 2023-09-13T09:59:31.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9ae14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:59:31.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47c37fe700 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9ae2b20 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f47b4095a10 tx=0x7f47b4098e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b7b8c3aca7a2ee7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.793+0000 7f47a9ffb700 1 -- 172.21.15.6:0/2161767308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b409d170 con 0x55e2b9ae2700 2023-09-13T09:59:31.807 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47a9ffb700 1 -- 172.21.15.6:0/2161767308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b409d340 con 0x55e2b9ae2700 2023-09-13T09:59:31.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47a9ffb700 1 -- 172.21.15.6:0/2161767308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40979d0 con 0x55e2b9ae2700 2023-09-13T09:59:31.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 -- 172.21.15.6:0/2161767308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 msgr2=0x55e2b9ae2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9ae2b20 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f47b4095a10 tx=0x7f47b4098e70 comp rx=0 tx=0).stop 2023-09-13T09:59:31.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 -- 172.21.15.6:0/2161767308 shutdown_connections 2023-09-13T09:59:31.808 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9ae1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9ae2b20 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2161767308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9ae14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 -- 172.21.15.6:0/2161767308 >> 172.21.15.6:0/2161767308 conn(0x55e2b9a3fc80 msgr2=0x55e2b9adbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 -- 172.21.15.6:0/2161767308 shutdown_connections 2023-09-13T09:59:31.809 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.794+0000 7f47d603ab80 1 -- 172.21.15.6:0/2161767308 wait complete. 2023-09-13T09:59:31.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 -- start start 2023-09-13T09:59:31.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 Processor -- start 2023-09-13T09:59:31.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aeaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae2700 0x55e2b9aeb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9af2510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.810 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b99d1bb0 con 0x55e2b9ae1a00 2023-09-13T09:59:31.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b99d18b0 con 0x55e2b9ae3060 2023-09-13T09:59:31.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b98b5920 con 0x55e2b9ae2700 2023-09-13T09:59:31.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47d603ab80 10 client.0 _ll_register_callbacks cb 0x55e2b99cf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:31.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aeaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.811 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47c2ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae2700 0x55e2b9aeb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aeaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46296/0 (socket says 172.21.15.6:46296) 2023-09-13T09:59:31.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47c37fe700 1 -- 172.21.15.6:0/3781329993 learned_addr learned my addr 172.21.15.6:0/3781329993 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.795+0000 7f47c3fff700 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9af2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47c2ffd700 1 -- 172.21.15.6:0/3781329993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 msgr2=0x55e2b9af2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.812 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9af2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47c2ffd700 1 -- 172.21.15.6:0/3781329993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae1a00 msgr2=0x55e2b9aeaf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aeaf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47c2ffd700 1 -- 172.21.15.6:0/3781329993 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c41a1340 con 0x55e2b9ae2700 2023-09-13T09:59:31.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae2700 0x55e2b9aeb4d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47b80117d0 tx=0x7f47b80047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=574c3b15be46b681 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.813 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:59:31.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47a2ffd700 1 -- 172.21.15.6:0/3781329993 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b801ee30 con 0x55e2b9ae2700 2023-09-13T09:59:31.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e2b9ad4670 con 0x55e2b9ae2700 2023-09-13T09:59:31.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47a2ffd700 1 -- 172.21.15.6:0/3781329993 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f47b801f430 con 0x55e2b9ae2700 2023-09-13T09:59:31.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47a2ffd700 1 -- 172.21.15.6:0/3781329993 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b8004020 con 0x55e2b9ae2700 2023-09-13T09:59:31.814 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47d603ab80 10 client.29854 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:31.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.796+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55e2b9a4b7a0 con 0x55e2b9ae2700 2023-09-13T09:59:31.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47a2ffd700 1 -- 172.21.15.6:0/3781329993 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e2b9ad4670 con 0x55e2b9ae2700 2023-09-13T09:59:31.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47a2ffd700 1 -- 172.21.15.6:0/3781329993 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f47b801f5f0 con 0x55e2b9ae2700 2023-09-13T09:59:31.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47d603ab80 10 client.29854 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:31.815 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47d603ab80 10 client.29854 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:59:31.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47d603ab80 20 client.29854 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:31.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47d603ab80 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9af6e40 0x55e2b9af9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47d603ab80 4 client.29854 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:31.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e2b9a2c970 con 0x55e2b9af6e40 2023-09-13T09:59:31.816 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47c37fe700 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9af6e40 0x55e2b9af9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47c37fe700 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9af6e40 0x55e2b9af9260 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=fae849cee4ee1657 server_cookie=7713b60481d8ad30 in_seq=0 out_seq=0 2023-09-13T09:59:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.797+0000 7f47a2ffd700 10 client.29854 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:59:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47a2ffd700 1 -- 172.21.15.6:0/3781329993 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e2b9a2c970 con 0x55e2b9af6e40 2023-09-13T09:59:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47a2ffd700 10 client.29854 handle_command_reply: tid=0 2023-09-13T09:59:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 client.29854 shutdown 2023-09-13T09:59:31.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae2700 msgr2=0x55e2b9aeb4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae2700 0x55e2b9aeb4d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f47b80117d0 tx=0x7f47b80047c0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 shutdown_connections 2023-09-13T09:59:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9af6e40 0x55e2b9af9260 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9af2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aeaf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 --2- 172.21.15.6:0/3781329993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae2700 0x55e2b9aeb4d0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47a2ffd700 0 client.29854 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:59:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 >> 172.21.15.6:0/3781329993 conn(0x55e2b9a3fc80 msgr2=0x55e2b9ad67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 shutdown_connections 2023-09-13T09:59:31.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.798+0000 7f47d603ab80 1 -- 172.21.15.6:0/3781329993 wait complete. 2023-09-13T09:59:31.820 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.799+0000 7f47d603ab80 20 client.29854 trim_cache size 0 max 16384 2023-09-13T09:59:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 Processor -- start 2023-09-13T09:59:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 -- start start 2023-09-13T09:59:31.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae1a00 0x55e2b9ae14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9af24d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9aeaf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9af4180 con 0x55e2b9ae2700 2023-09-13T09:59:31.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9aeab00 con 0x55e2b9ae3060 2023-09-13T09:59:31.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47d603ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9adc810 con 0x55e2b9ae1a00 2023-09-13T09:59:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9af24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47c2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9af24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46304/0 (socket says 172.21.15.6:46304) 2023-09-13T09:59:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47c2ffd700 1 -- 172.21.15.6:0/2904316825 learned_addr learned my addr 172.21.15.6:0/2904316825 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.817+0000 7f47c3fff700 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9aeaf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47c2ffd700 1 -- 172.21.15.6:0/2904316825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae1a00 msgr2=0x55e2b9ae14c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:59:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae1a00 0x55e2b9ae14c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47c2ffd700 1 -- 172.21.15.6:0/2904316825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 msgr2=0x55e2b9aeaf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9aeaf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47c2ffd700 1 -- 172.21.15.6:0/2904316825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e2b985fde0 con 0x55e2b9ae2700 2023-09-13T09:59:31.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9af24d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f47b8005bc0 tx=0x7f47b8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f38df46f0b21410c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47aa7fc700 1 -- 172.21.15.6:0/2904316825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b801ec80 con 0x55e2b9ae2700 2023-09-13T09:59:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47aa7fc700 1 -- 172.21.15.6:0/2904316825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b8023070 con 0x55e2b9ae2700 2023-09-13T09:59:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.818+0000 7f47aa7fc700 1 -- 172.21.15.6:0/2904316825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8003680 con 0x55e2b9ae2700 2023-09-13T09:59:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 -- 172.21.15.6:0/2904316825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 msgr2=0x55e2b9af24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9af24d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f47b8005bc0 tx=0x7f47b8009040 comp rx=0 tx=0).stop 2023-09-13T09:59:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 -- 172.21.15.6:0/2904316825 shutdown_connections 2023-09-13T09:59:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae3060 0x55e2b9aeaf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae1a00 0x55e2b9ae14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 --2- 172.21.15.6:0/2904316825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9af24d0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 -- 172.21.15.6:0/2904316825 >> 172.21.15.6:0/2904316825 conn(0x55e2b9a3fc80 msgr2=0x55e2b9ae5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 -- 172.21.15.6:0/2904316825 shutdown_connections 2023-09-13T09:59:31.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.819+0000 7f47d603ab80 1 -- 172.21.15.6:0/2904316825 wait complete. 2023-09-13T09:59:31.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 -- start start 2023-09-13T09:59:31.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 Processor -- start 2023-09-13T09:59:31.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aee2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9aee830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9af1850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9af1d90 con 0x55e2b9ae2700 2023-09-13T09:59:31.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9af1f00 con 0x55e2b9ae1a00 2023-09-13T09:59:31.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e2b9af20c0 con 0x55e2b9ae3060 2023-09-13T09:59:31.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.820+0000 7f47d603ab80 10 client.0 _ll_register_callbacks cb 0x55e2b9adc570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:31.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aee2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aee2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39834/0 (socket says 172.21.15.6:39834) 2023-09-13T09:59:31.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 -- 172.21.15.6:0/1934145599 learned_addr learned my addr 172.21.15.6:0/1934145599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:31.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c3fff700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9af1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9aee830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 -- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 msgr2=0x55e2b9af1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9af1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 -- 172.21.15.6:0/1934145599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 msgr2=0x55e2b9aee830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:31.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9aee830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 -- 172.21.15.6:0/1934145599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e2b9a4b7a0 con 0x55e2b9ae1a00 2023-09-13T09:59:31.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9aee830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:31.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47c37fe700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aee2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005950 tx=0x7f47b4099690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=357d421c0f0a2a42 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:31.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:59:31.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47a2ffd700 1 -- 172.21.15.6:0/1934145599 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b40044d0 con 0x55e2b9ae1a00 2023-09-13T09:59:31.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.821+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47b409d340 con 0x55e2b9ae1a00 2023-09-13T09:59:31.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47a2ffd700 1 -- 172.21.15.6:0/1934145599 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f47b4003d40 con 0x55e2b9ae1a00 2023-09-13T09:59:31.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47a2ffd700 1 -- 172.21.15.6:0/1934145599 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b40978b0 con 0x55e2b9ae1a00 2023-09-13T09:59:31.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 10 client.29882 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:31.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55e2b9848c60 con 0x55e2b9ae1a00 2023-09-13T09:59:31.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47a2ffd700 1 -- 172.21.15.6:0/1934145599 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f47b409d340 con 0x55e2b9ae1a00 2023-09-13T09:59:31.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47a2ffd700 1 -- 172.21.15.6:0/1934145599 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f47b4099770 con 0x55e2b9ae1a00 2023-09-13T09:59:31.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 10 client.29882 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:31.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 10 client.29882 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T09:59:31.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 20 client.29882 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:31.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9b4b880 0x55e2b9b4dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:31.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 4 client.29882 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:59:31.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.822+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e2b99ed050 con 0x55e2b9b4b880 2023-09-13T09:59:31.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.823+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9b4b880 0x55e2b9b4dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:31.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.823+0000 7f47a2ffd700 10 client.29882 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T09:59:31.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.823+0000 7f47c2ffd700 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9b4b880 0x55e2b9b4dca0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=18fe53505e26a20f server_cookie=e556901116c2154b in_seq=0 out_seq=0 2023-09-13T09:59:31.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.823+0000 7f47a2ffd700 1 -- 172.21.15.6:0/1934145599 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e2b99ed050 con 0x55e2b9b4b880 2023-09-13T09:59:31.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.823+0000 7f47a2ffd700 10 client.29882 handle_command_reply: tid=0 2023-09-13T09:59:31.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.823+0000 7f47d603ab80 1 client.29882 shutdown 2023-09-13T09:59:31.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 msgr2=0x55e2b9aee2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aee2f0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f47b4005950 tx=0x7f47b4099690 comp rx=0 tx=0).stop 2023-09-13T09:59:31.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 shutdown_connections 2023-09-13T09:59:31.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55e2b9b4b880 0x55e2b9b4dca0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e2b9ae3060 0x55e2b9af1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47a2ffd700 0 client.29882 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T09:59:31.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e2b9ae1a00 0x55e2b9aee2f0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 --2- 172.21.15.6:0/1934145599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e2b9ae2700 0x55e2b9aee830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 >> 172.21.15.6:0/1934145599 conn(0x55e2b9a3fc80 msgr2=0x55e2b9aeaf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 shutdown_connections 2023-09-13T09:59:31.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 1 -- 172.21.15.6:0/1934145599 wait complete. 2023-09-13T09:59:31.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47d603ab80 20 client.29882 trim_cache size 0 max 16384 2023-09-13T09:59:31.842 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:59:31.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47ac0a0640 msgr2=0x7f47ac0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47c9e55700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47ac0a0640 0x7f47ac0a2b00 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009be0 tx=0x7f47b8009260 comp rx=0 tx=0).stop 2023-09-13T09:59:31.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 msgr2=0x7f47c4198de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:31.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.824+0000 7f47c9e55700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 0x7f47c4198de0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e970 tx=0x7f47b400ec80 comp rx=0 tx=0).stop 2023-09-13T09:59:31.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 shutdown_connections 2023-09-13T09:59:31.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f47ac0a0640 0x7f47ac0a2b00 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f47c4101850 0x7f47c41a0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47c40ffcc0 0x7f47c4198de0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 --2- 172.21.15.6:0/3793620842 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f47c4100eb0 0x7f47c4199320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 >> 172.21.15.6:0/3793620842 conn(0x7f47c40fb250 msgr2=0x7f47c4067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 shutdown_connections 2023-09-13T09:59:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:31.825+0000 7f47c9e55700 1 -- 172.21.15.6:0/3793620842 wait complete. 2023-09-13T09:59:31.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T09:59:32.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 -- 172.21.15.6:0/227406704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894101f70 msgr2=0x7fd8941023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 --2- 172.21.15.6:0/227406704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894101f70 0x7fd8941023d0 secure :-1 s=READY pgs=1779 cs=0 l=1 rev1=1 crypto rx=0x7fd8880099c0 tx=0x7fd888009cd0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 -- 172.21.15.6:0/227406704 shutdown_connections 2023-09-13T09:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 --2- 172.21.15.6:0/227406704 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd894102910 0x7fd8941091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 --2- 172.21.15.6:0/227406704 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd894100d80 0x7fd8941011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 --2- 172.21.15.6:0/227406704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894101f70 0x7fd8941023d0 unknown :-1 s=CLOSED pgs=1779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 -- 172.21.15.6:0/227406704 >> 172.21.15.6:0/227406704 conn(0x7fd8940fc310 msgr2=0x7fd8940fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 -- 172.21.15.6:0/227406704 shutdown_connections 2023-09-13T09:59:32.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.021+0000 7fd8993ab700 1 -- 172.21.15.6:0/227406704 wait complete. 2023-09-13T09:59:32.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 Processor -- start 2023-09-13T09:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 -- start start 2023-09-13T09:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd894100d80 0x7fd894196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd894101f70 0x7fd894196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894102910 0x7fd89419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419e620 con 0x7fd894102910 2023-09-13T09:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419e760 con 0x7fd894101f70 2023-09-13T09:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8993ab700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89419e8f0 con 0x7fd894100d80 2023-09-13T09:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894102910 0x7fd89419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894102910 0x7fd89419e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46328/0 (socket says 172.21.15.6:46328) 2023-09-13T09:59:32.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd894100d80 0x7fd894196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8937fe700 1 -- 172.21.15.6:0/2816636599 learned_addr learned my addr 172.21.15.6:0/2816636599 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.022+0000 7fd8927fc700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd894101f70 0x7fd894196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8937fe700 1 -- 172.21.15.6:0/2816636599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd894100d80 msgr2=0x7fd894196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8937fe700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd894100d80 0x7fd894196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8937fe700 1 -- 172.21.15.6:0/2816636599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd894101f70 msgr2=0x7fd894196fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8937fe700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd894101f70 0x7fd894196fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8937fe700 1 -- 172.21.15.6:0/2816636599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880095f0 con 0x7fd894102910 2023-09-13T09:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd894100d80 0x7fd894196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8927fc700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd894101f70 0x7fd894196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8937fe700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894102910 0x7fd89419e050 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00ef30 tx=0x7fd88c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd87bfff700 1 -- 172.21.15.6:0/2816636599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c018070 con 0x7fd894102910 2023-09-13T09:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd87bfff700 1 -- 172.21.15.6:0/2816636599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd88c00f040 con 0x7fd894102910 2023-09-13T09:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89419eb70 con 0x7fd894102910 2023-09-13T09:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd87bfff700 1 -- 172.21.15.6:0/2816636599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c00cd00 con 0x7fd894102910 2023-09-13T09:59:32.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.023+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89419f030 con 0x7fd894102910 2023-09-13T09:59:32.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.026+0000 7fd87bfff700 1 -- 172.21.15.6:0/2816636599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd88c003a00 con 0x7fd894102910 2023-09-13T09:59:32.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.027+0000 7fd87bfff700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd87c0a0640 0x7fd87c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.027+0000 7fd87bfff700 1 -- 172.21.15.6:0/2816636599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd88c0cb750 con 0x7fd894102910 2023-09-13T09:59:32.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.027+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd87c0a0640 0x7fd87c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd87c0a0640 0x7fd87c0a2b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd894101dd0 tx=0x7fd884009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 Processor -- start 2023-09-13T09:59:32.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 -- start start 2023-09-13T09:59:32.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05cb10 0x55a7bf05cf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf05c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7befb0780 con 0x55a7bf05cb10 2023-09-13T09:59:32.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7befae0a0 con 0x55a7bf05be10 2023-09-13T09:59:32.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7befa9990 con 0x55a7bf05d470 2023-09-13T09:59:32.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05cb10 0x55a7bf05cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05cb10 0x55a7bf05cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46332/0 (socket says 172.21.15.6:46332) 2023-09-13T09:59:32.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd892ffd700 1 -- 172.21.15.6:0/2567644559 learned_addr learned my addr 172.21.15.6:0/2567644559 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8927fc700 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.028+0000 7fd8937fe700 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf05c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd892ffd700 1 -- 172.21.15.6:0/2567644559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 msgr2=0x55a7bf05b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd892ffd700 1 -- 172.21.15.6:0/2567644559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 msgr2=0x55a7bf05c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf05c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd892ffd700 1 -- 172.21.15.6:0/2567644559 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7bee29630 con 0x55a7bf05cb10 2023-09-13T09:59:32.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd8927fc700 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05cb10 0x55a7bf05cf30 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fd8840043d0 tx=0x7fd884014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc38880e55f98df3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd8797fa700 1 -- 172.21.15.6:0/2567644559 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884003ce0 con 0x55a7bf05cb10 2023-09-13T09:59:32.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd8797fa700 1 -- 172.21.15.6:0/2567644559 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd884003e40 con 0x55a7bf05cb10 2023-09-13T09:59:32.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.029+0000 7fd8797fa700 1 -- 172.21.15.6:0/2567644559 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd884026900 con 0x55a7bf05cb10 2023-09-13T09:59:32.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2567644559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05cb10 msgr2=0x55a7bf05cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05cb10 0x55a7bf05cf30 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fd8840043d0 tx=0x7fd884014000 comp rx=0 tx=0).stop 2023-09-13T09:59:32.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2567644559 shutdown_connections 2023-09-13T09:59:32.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf05c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05cb10 0x55a7bf05cf30 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2567644559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2567644559 >> 172.21.15.6:0/2567644559 conn(0x55a7befb5c80 msgr2=0x55a7bf051f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2567644559 shutdown_connections 2023-09-13T09:59:32.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2567644559 wait complete. 2023-09-13T09:59:32.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.030+0000 7fd8a5590b80 1 -- start start 2023-09-13T09:59:32.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 1 Processor -- start 2023-09-13T09:59:32.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf0653b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf0658f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bef47bb0 con 0x55a7bf05d470 2023-09-13T09:59:32.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bef478b0 con 0x55a7bf05be10 2023-09-13T09:59:32.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bee2b920 con 0x55a7bf05cb10 2023-09-13T09:59:32.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8a5590b80 10 client.0 _ll_register_callbacks cb 0x55a7bef45680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:32.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf0653b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf0653b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39862/0 (socket says 172.21.15.6:39862) 2023-09-13T09:59:32.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 -- 172.21.15.6:0/2187648117 learned_addr learned my addr 172.21.15.6:0/2187648117 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd8937fe700 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 -- 172.21.15.6:0/2187648117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 msgr2=0x55a7bf0658f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T09:59:32.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf0658f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 -- 172.21.15.6:0/2187648117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 msgr2=0x55a7bf06c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.031+0000 7fd892ffd700 1 -- 172.21.15.6:0/2187648117 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd884017070 con 0x55a7bf05be10 2023-09-13T09:59:32.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd892ffd700 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf0653b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd884005320 tx=0x7fd884005350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4faf8192580ac42f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd876ff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:59:32.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd876ff5700 1 -- 172.21.15.6:0/2187648117 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88402a070 con 0x55a7bf05be10 2023-09-13T09:59:32.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a7bf04a670 con 0x55a7bf05be10 2023-09-13T09:59:32.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd876ff5700 1 -- 172.21.15.6:0/2187648117 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd8840056a0 con 0x55a7bf05be10 2023-09-13T09:59:32.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd876ff5700 1 -- 172.21.15.6:0/2187648117 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd88401ee00 con 0x55a7bf05be10 2023-09-13T09:59:32.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd8a5590b80 10 client.29894 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:32.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55a7befc17a0 con 0x55a7bf05be10 2023-09-13T09:59:32.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd876ff5700 1 -- 172.21.15.6:0/2187648117 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a7bf04a670 con 0x55a7bf05be10 2023-09-13T09:59:32.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.032+0000 7fd876ff5700 1 -- 172.21.15.6:0/2187648117 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd884024020 con 0x55a7bf05be10 2023-09-13T09:59:32.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8a5590b80 10 client.29894 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:32.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8a5590b80 10 client.29894 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:59:32.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8a5590b80 20 client.29894 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:32.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf071150 0x55a7bf073570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8a5590b80 4 client.29894 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:32.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7befa2970 con 0x55a7bf071150 2023-09-13T09:59:32.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8927fc700 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf071150 0x55a7bf073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd876ff5700 10 client.29894 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:59:32.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.033+0000 7fd8927fc700 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf071150 0x55a7bf073570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e9d1ffb20c90032 server_cookie=f824f41c239cf669 in_seq=0 out_seq=0 2023-09-13T09:59:32.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd876ff5700 1 -- 172.21.15.6:0/2187648117 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a7befa2970 con 0x55a7bf071150 2023-09-13T09:59:32.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd876ff5700 10 client.29894 handle_command_reply: tid=0 2023-09-13T09:59:32.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 client.29894 shutdown 2023-09-13T09:59:32.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 msgr2=0x55a7bf0653b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf0653b0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fd884005320 tx=0x7fd884005350 comp rx=0 tx=0).stop 2023-09-13T09:59:32.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 shutdown_connections 2023-09-13T09:59:32.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf071150 0x55a7bf073570 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd876ff5700 0 client.29894 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:59:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf0653b0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/2187648117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf0658f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 >> 172.21.15.6:0/2187648117 conn(0x55a7befb5c80 msgr2=0x55a7bf04c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 shutdown_connections 2023-09-13T09:59:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 1 -- 172.21.15.6:0/2187648117 wait complete. 2023-09-13T09:59:32.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.036+0000 7fd8a5590b80 20 client.29894 trim_cache size 0 max 16384 2023-09-13T09:59:32.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.053+0000 7fd8a5590b80 1 Processor -- start 2023-09-13T09:59:32.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8a5590b80 1 -- start start 2023-09-13T09:59:32.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05be10 0x55a7bf064020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05cb10 0x55a7bf06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bf060940 con 0x55a7bf05be10 2023-09-13T09:59:32.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bf070dd0 con 0x55a7bf05cb10 2023-09-13T09:59:32.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bf052d50 con 0x55a7bf05d470 2023-09-13T09:59:32.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05be10 0x55a7bf064020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49402/0 (socket says 172.21.15.6:49402) 2023-09-13T09:59:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 -- 172.21.15.6:0/1635332032 learned_addr learned my addr 172.21.15.6:0/1635332032 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8927fc700 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05cb10 0x55a7bf06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 -- 172.21.15.6:0/1635332032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05cb10 msgr2=0x55a7bf06c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05cb10 0x55a7bf06c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 -- 172.21.15.6:0/1635332032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05be10 msgr2=0x55a7bf064020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05be10 0x55a7bf064020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd8937fe700 1 -- 172.21.15.6:0/1635332032 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7bedd5de0 con 0x55a7bf05d470 2023-09-13T09:59:32.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.054+0000 7fd892ffd700 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05be10 0x55a7bf064020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.055+0000 7fd8937fe700 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05fdd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0c9570 tx=0x7fd88c0cb040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a0bc7f4cebbf15 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.055+0000 7fd879ffb700 1 -- 172.21.15.6:0/1635332032 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c01b320 con 0x55a7bf05d470 2023-09-13T09:59:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.055+0000 7fd879ffb700 1 -- 172.21.15.6:0/1635332032 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd88c0b8040 con 0x55a7bf05d470 2023-09-13T09:59:32.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.055+0000 7fd879ffb700 1 -- 172.21.15.6:0/1635332032 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c09cdb0 con 0x55a7bf05d470 2023-09-13T09:59:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- 172.21.15.6:0/1635332032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 msgr2=0x55a7bf05fdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05fdd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fd88c0c9570 tx=0x7fd88c0cb040 comp rx=0 tx=0).stop 2023-09-13T09:59:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- 172.21.15.6:0/1635332032 shutdown_connections 2023-09-13T09:59:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05d470 0x55a7bf05fdd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05be10 0x55a7bf064020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/1635332032 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05cb10 0x55a7bf06c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- 172.21.15.6:0/1635332032 >> 172.21.15.6:0/1635332032 conn(0x55a7befb5c80 msgr2=0x55a7bf051e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- 172.21.15.6:0/1635332032 shutdown_connections 2023-09-13T09:59:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- 172.21.15.6:0/1635332032 wait complete. 2023-09-13T09:59:32.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- start start 2023-09-13T09:59:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 Processor -- start 2023-09-13T09:59:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf068590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf068ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.067 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bf06c030 con 0x55a7bf05d470 2023-09-13T09:59:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bf06c1a0 con 0x55a7bf05be10 2023-09-13T09:59:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.056+0000 7fd8a5590b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7bf06c360 con 0x55a7bf05cb10 2023-09-13T09:59:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8a5590b80 10 client.0 _ll_register_callbacks cb 0x55a7bef45680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8927fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf068ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.068 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8937fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8927fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf068ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49408/0 (socket says 172.21.15.6:49408) 2023-09-13T09:59:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd892ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf068590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39876/0 (socket says 172.21.15.6:39876) 2023-09-13T09:59:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8927fc700 1 -- 172.21.15.6:0/766101644 learned_addr learned my addr 172.21.15.6:0/766101644 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8937fe700 1 -- 172.21.15.6:0/766101644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 msgr2=0x55a7bf068ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8937fe700 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf068ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8937fe700 1 -- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 msgr2=0x55a7bf068590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8937fe700 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf068590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8937fe700 1 -- 172.21.15.6:0/766101644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a7befc17a0 con 0x55a7bf05d470 2023-09-13T09:59:32.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd892ffd700 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf068590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8927fc700 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf068ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8937fe700 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06baf0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00ef00 tx=0x7fd88c004dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e0318d782d2539 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd876ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:32.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd876ff5700 1 -- 172.21.15.6:0/766101644 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88c098670 con 0x55a7bf05d470 2023-09-13T09:59:32.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd876ff5700 1 -- 172.21.15.6:0/766101644 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd88c099680 con 0x55a7bf05d470 2023-09-13T09:59:32.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.057+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd884003e40 con 0x55a7bf05d470 2023-09-13T09:59:32.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd876ff5700 1 -- 172.21.15.6:0/766101644 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd88c077ea0 con 0x55a7bf05d470 2023-09-13T09:59:32.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 10 client.20691 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:32.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x7fd89419f030 con 0x55a7bf05d470 2023-09-13T09:59:32.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd876ff5700 1 -- 172.21.15.6:0/766101644 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd884003e40 con 0x55a7bf05d470 2023-09-13T09:59:32.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd876ff5700 1 -- 172.21.15.6:0/766101644 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd88c061030 con 0x55a7bf05d470 2023-09-13T09:59:32.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 10 client.20691 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:32.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 10 client.20691 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T09:59:32.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 20 client.20691 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:32.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf0c5b00 0x55a7bf0c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 4 client.20691 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:59:32.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a7bef63050 con 0x55a7bf0c5b00 2023-09-13T09:59:32.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.058+0000 7fd892ffd700 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf0c5b00 0x55a7bf0c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.059+0000 7fd876ff5700 10 client.20691 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T09:59:32.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.059+0000 7fd892ffd700 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf0c5b00 0x55a7bf0c7f20 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=32f75ceed00fe1aa server_cookie=6b2793d53a1870ba in_seq=0 out_seq=0 2023-09-13T09:59:32.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd876ff5700 1 -- 172.21.15.6:0/766101644 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a7bef63050 con 0x55a7bf0c5b00 2023-09-13T09:59:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd876ff5700 10 client.20691 handle_command_reply: tid=0 2023-09-13T09:59:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 client.20691 shutdown 2023-09-13T09:59:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 msgr2=0x55a7bf06baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06baf0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00ef00 tx=0x7fd88c004dc0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 shutdown_connections 2023-09-13T09:59:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a7bf0c5b00 0x55a7bf0c7f20 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a7bf05d470 0x55a7bf06baf0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a7bf05be10 0x55a7bf068590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 --2- 172.21.15.6:0/766101644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a7bf05cb10 0x55a7bf068ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 >> 172.21.15.6:0/766101644 conn(0x55a7befb5c80 msgr2=0x55a7bf064020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd876ff5700 0 client.20691 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T09:59:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 shutdown_connections 2023-09-13T09:59:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 1 -- 172.21.15.6:0/766101644 wait complete. 2023-09-13T09:59:32.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.064+0000 7fd8a5590b80 20 client.20691 trim_cache size 0 max 16384 2023-09-13T09:59:32.079 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:59:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd87c0a0640 msgr2=0x7fd87c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd87c0a0640 0x7fd87c0a2b00 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fd894101dd0 tx=0x7fd884009260 comp rx=0 tx=0).stop 2023-09-13T09:59:32.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894102910 msgr2=0x7fd89419e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894102910 0x7fd89419e050 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fd88c00ef30 tx=0x7fd88c00c3a0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 shutdown_connections 2023-09-13T09:59:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd87c0a0640 0x7fd87c0a2b00 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd894102910 0x7fd89419e050 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd894100d80 0x7fd894196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 --2- 172.21.15.6:0/2816636599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd894101f70 0x7fd894196fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 >> 172.21.15.6:0/2816636599 conn(0x7fd8940fc310 msgr2=0x7fd8940fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 shutdown_connections 2023-09-13T09:59:32.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.065+0000 7fd8993ab700 1 -- 172.21.15.6:0/2816636599 wait complete. 2023-09-13T09:59:32.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T09:59:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 -- 172.21.15.6:0/317384450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc1041b0 msgr2=0x7f74dc104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 --2- 172.21.15.6:0/317384450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc1041b0 0x7f74dc104610 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f74c80099c0 tx=0x7f74c8009cd0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 -- 172.21.15.6:0/317384450 shutdown_connections 2023-09-13T09:59:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 --2- 172.21.15.6:0/317384450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74dc104b50 0x7f74dc10b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 --2- 172.21.15.6:0/317384450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74dc102fc0 0x7f74dc1033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 --2- 172.21.15.6:0/317384450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc1041b0 0x7f74dc104610 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 -- 172.21.15.6:0/317384450 >> 172.21.15.6:0/317384450 conn(0x7f74dc0fe510 msgr2=0x7f74dc100970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 -- 172.21.15.6:0/317384450 shutdown_connections 2023-09-13T09:59:32.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.233+0000 7f74e2efc700 1 -- 172.21.15.6:0/317384450 wait complete. 2023-09-13T09:59:32.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 Processor -- start 2023-09-13T09:59:32.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 -- start start 2023-09-13T09:59:32.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc102fc0 0x7f74dc198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74dc1041b0 0x7f74dc1991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74dc104b50 0x7f74dc1a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc1a07b0 con 0x7f74dc102fc0 2023-09-13T09:59:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc1a0920 con 0x7f74dc104b50 2023-09-13T09:59:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e2efc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc1a0ae0 con 0x7f74dc1041b0 2023-09-13T09:59:32.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e0c98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc102fc0 0x7f74dc198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e0c98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc102fc0 0x7f74dc198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46366/0 (socket says 172.21.15.6:46366) 2023-09-13T09:59:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74e0c98700 1 -- 172.21.15.6:0/98548450 learned_addr learned my addr 172.21.15.6:0/98548450 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.234+0000 7f74dbfff700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74dc1041b0 0x7f74dc1991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74dbfff700 1 -- 172.21.15.6:0/98548450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74dc104b50 msgr2=0x7f74dc1a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74dbfff700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74dc104b50 0x7f74dc1a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74dbfff700 1 -- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc102fc0 msgr2=0x7f74dc198c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74dbfff700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc102fc0 0x7f74dc198c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74dbfff700 1 -- 172.21.15.6:0/98548450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c80095f0 con 0x7f74dc1041b0 2023-09-13T09:59:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74e0c98700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc102fc0 0x7f74dc198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74dbfff700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74dc1041b0 0x7f74dc1991b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009fd0 tx=0x7f74c8009580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74d9ffb700 1 -- 172.21.15.6:0/98548450 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c801d070 con 0x7f74dc1041b0 2023-09-13T09:59:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc1a0d60 con 0x7f74dc1041b0 2023-09-13T09:59:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74d9ffb700 1 -- 172.21.15.6:0/98548450 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74c8005020 con 0x7f74dc1041b0 2023-09-13T09:59:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.235+0000 7f74d9ffb700 1 -- 172.21.15.6:0/98548450 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8004a90 con 0x7f74dc1041b0 2023-09-13T09:59:32.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.236+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc1a1120 con 0x7f74dc1041b0 2023-09-13T09:59:32.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.239+0000 7f74d9ffb700 1 -- 172.21.15.6:0/98548450 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f74c8005190 con 0x7f74dc1041b0 2023-09-13T09:59:32.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.239+0000 7f74d9ffb700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74cc0a0640 0x7f74cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.239+0000 7f74d9ffb700 1 -- 172.21.15.6:0/98548450 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74c80cc6a0 con 0x7f74dc1041b0 2023-09-13T09:59:32.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.239+0000 7f74e0c98700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74cc0a0640 0x7f74cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 Processor -- start 2023-09-13T09:59:32.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 -- start start 2023-09-13T09:59:32.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46faffb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fafe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fafee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fa57780 con 0x55f46faff700 2023-09-13T09:59:32.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fa550a0 con 0x55f46fafea00 2023-09-13T09:59:32.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fa50990 con 0x55f46fb00060 2023-09-13T09:59:32.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74e0c98700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74cc0a0640 0x7f74cc0a2b00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f74dc19a140 tx=0x7f74d0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fafe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fafe4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49430/0 (socket says 172.21.15.6:49430) 2023-09-13T09:59:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74dbfff700 1 -- 172.21.15.6:0/2329212442 learned_addr learned my addr 172.21.15.6:0/2329212442 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74e1499700 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fafee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74dbfff700 1 -- 172.21.15.6:0/2329212442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 msgr2=0x55f46fafee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.240+0000 7f74dbfff700 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fafee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74e0c98700 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46faffb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74dbfff700 1 -- 172.21.15.6:0/2329212442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 msgr2=0x55f46faffb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74dbfff700 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46faffb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74dbfff700 1 -- 172.21.15.6:0/2329212442 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f46f8d0630 con 0x55f46fb00060 2023-09-13T09:59:32.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74e0c98700 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46faffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:59:32.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74dbfff700 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fafe4c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f74c80963d0 tx=0x7f74c8099b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82fc892e9734c4d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74c6ffd700 1 -- 172.21.15.6:0/2329212442 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c809dd00 con 0x55f46fb00060 2023-09-13T09:59:32.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74c6ffd700 1 -- 172.21.15.6:0/2329212442 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74c80a1eb0 con 0x55f46fb00060 2023-09-13T09:59:32.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.241+0000 7f74c6ffd700 1 -- 172.21.15.6:0/2329212442 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c809a130 con 0x55f46fb00060 2023-09-13T09:59:32.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/2329212442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 msgr2=0x55f46fafe4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fafe4c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f74c80963d0 tx=0x7f74c8099b40 comp rx=0 tx=0).stop 2023-09-13T09:59:32.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/2329212442 shutdown_connections 2023-09-13T09:59:32.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fafee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46faffb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/2329212442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fafe4c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/2329212442 >> 172.21.15.6:0/2329212442 conn(0x55f46fa5cc80 msgr2=0x55f46faf8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/2329212442 shutdown_connections 2023-09-13T09:59:32.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/2329212442 wait complete. 2023-09-13T09:59:32.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 -- start start 2023-09-13T09:59:32.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.242+0000 7f74ef0e1b80 1 Processor -- start 2023-09-13T09:59:32.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fb07bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46fb080f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46f9eebb0 con 0x55f46faff700 2023-09-13T09:59:32.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46f9ee8b0 con 0x55f46fafea00 2023-09-13T09:59:32.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46f8d2920 con 0x55f46fb00060 2023-09-13T09:59:32.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74ef0e1b80 10 client.0 _ll_register_callbacks cb 0x55f46f9ec680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:32.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46fb080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46fb080f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46382/0 (socket says 172.21.15.6:46382) 2023-09-13T09:59:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 -- 172.21.15.6:0/401320670 learned_addr learned my addr 172.21.15.6:0/401320670 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74e0c98700 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fb07bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74e1499700 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 -- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 msgr2=0x55f46fb0f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 -- 172.21.15.6:0/401320670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 msgr2=0x55f46fb07bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fb07bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.243+0000 7f74dbfff700 1 -- 172.21.15.6:0/401320670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc1a1120 con 0x55f46faff700 2023-09-13T09:59:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74dbfff700 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46fb080f0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b580 tx=0x7f74c8099670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adfa04c73ab9f62b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74bbfff700 1 -- 172.21.15.6:0/401320670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8098010 con 0x55f46faff700 2023-09-13T09:59:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74bbfff700 1 -- 172.21.15.6:0/401320670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74c809dd00 con 0x55f46faff700 2023-09-13T09:59:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f46faf1670 con 0x55f46faff700 2023-09-13T09:59:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74bbfff700 1 -- 172.21.15.6:0/401320670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74c809a340 con 0x55f46faff700 2023-09-13T09:59:32.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 10 client.20700 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55f46fa687a0 con 0x55f46faff700 2023-09-13T09:59:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74bbfff700 1 -- 172.21.15.6:0/401320670 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f46faf1670 con 0x55f46faff700 2023-09-13T09:59:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74bbfff700 1 -- 172.21.15.6:0/401320670 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f74c8094ae0 con 0x55f46faff700 2023-09-13T09:59:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 10 client.20700 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:32.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 10 client.20700 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:59:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 20 client.20700 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb133d0 0x55f46fb157f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 4 client.20700 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.244+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f46fa49970 con 0x55f46fb133d0 2023-09-13T09:59:32.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.245+0000 7f74e0c98700 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb133d0 0x55f46fb157f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.245+0000 7f74bbfff700 10 client.20700 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:59:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.245+0000 7f74e0c98700 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb133d0 0x55f46fb157f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a15b630d681cfb75 server_cookie=4a3ecd9c195f95d9 in_seq=0 out_seq=0 2023-09-13T09:59:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74bbfff700 1 -- 172.21.15.6:0/401320670 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f46fa49970 con 0x55f46fb133d0 2023-09-13T09:59:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74bbfff700 10 client.20700 handle_command_reply: tid=0 2023-09-13T09:59:32.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 client.20700 shutdown 2023-09-13T09:59:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 msgr2=0x55f46fb080f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46fb080f0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f74c800b580 tx=0x7f74c8099670 comp rx=0 tx=0).stop 2023-09-13T09:59:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 shutdown_connections 2023-09-13T09:59:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb133d0 0x55f46fb157f0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46fafea00 0x55f46fb07bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/401320670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46faff700 0x55f46fb080f0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74bbfff700 0 client.20700 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:59:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.247+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 >> 172.21.15.6:0/401320670 conn(0x55f46fa5cc80 msgr2=0x55f46faf37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.248+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 shutdown_connections 2023-09-13T09:59:32.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.248+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/401320670 wait complete. 2023-09-13T09:59:32.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.248+0000 7f74ef0e1b80 20 client.20700 trim_cache size 0 max 16384 2023-09-13T09:59:32.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 Processor -- start 2023-09-13T09:59:32.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 -- start start 2023-09-13T09:59:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fafea00 0x55f46fafd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fb00060 0x55f46fafd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fb07720 con 0x55f46fb00060 2023-09-13T09:59:32.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fb15e50 con 0x55f46faff700 2023-09-13T09:59:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.262+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fb03450 con 0x55f46fafea00 2023-09-13T09:59:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fb00060 0x55f46fafd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fb00060 0x55f46fafd9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46392/0 (socket says 172.21.15.6:46392) 2023-09-13T09:59:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e0c98700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fafea00 0x55f46fafd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 -- 172.21.15.6:0/3538335710 learned_addr learned my addr 172.21.15.6:0/3538335710 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74dbfff700 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 -- 172.21.15.6:0/3538335710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fafea00 msgr2=0x55f46fafd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fafea00 0x55f46fafd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.274 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 -- 172.21.15.6:0/3538335710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 msgr2=0x55f46fb0f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 -- 172.21.15.6:0/3538335710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f46f87cde0 con 0x55f46fb00060 2023-09-13T09:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74dbfff700 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74e1499700 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fb00060 0x55f46fafd9f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009e20 tx=0x7f74d4014a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b18bc41dd7c4cdfb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.275 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74c77fe700 1 -- 172.21.15.6:0/3538335710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d400e040 con 0x55f46fb00060 2023-09-13T09:59:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74c77fe700 1 -- 172.21.15.6:0/3538335710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74d400f040 con 0x55f46fb00060 2023-09-13T09:59:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.263+0000 7f74c77fe700 1 -- 172.21.15.6:0/3538335710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40168f0 con 0x55f46fb00060 2023-09-13T09:59:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3538335710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fb00060 msgr2=0x55f46fafd9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fb00060 0x55f46fafd9f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009e20 tx=0x7f74d4014a40 comp rx=0 tx=0).stop 2023-09-13T09:59:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3538335710 shutdown_connections 2023-09-13T09:59:32.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fb00060 0x55f46fafd9f0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fafea00 0x55f46fafd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3538335710 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3538335710 >> 172.21.15.6:0/3538335710 conn(0x55f46fa5cc80 msgr2=0x55f46fb0fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3538335710 shutdown_connections 2023-09-13T09:59:32.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.264+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3538335710 wait complete. 2023-09-13T09:59:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 -- start start 2023-09-13T09:59:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 Processor -- start 2023-09-13T09:59:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fafea00 0x55f46fb0eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fb0c4c0 con 0x55f46fafea00 2023-09-13T09:59:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fb671b0 con 0x55f46faff700 2023-09-13T09:59:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f46fb672f0 con 0x55f46fb00060 2023-09-13T09:59:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74ef0e1b80 10 client.0 _ll_register_callbacks cb 0x55f46f9ec680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:32.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74e0c98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fafea00 0x55f46fb0eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74e0c98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fafea00 0x55f46fb0eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46394/0 (socket says 172.21.15.6:46394) 2023-09-13T09:59:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74e0c98700 1 -- 172.21.15.6:0/3024619204 learned_addr learned my addr 172.21.15.6:0/3024619204 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74dbfff700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.265+0000 7f74e1499700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74e0c98700 1 -- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 msgr2=0x55f46fb0bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74e0c98700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74e0c98700 1 -- 172.21.15.6:0/3024619204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 msgr2=0x55f46fb0b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74e0c98700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74e0c98700 1 -- 172.21.15.6:0/3024619204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d4014440 con 0x55f46fafea00 2023-09-13T09:59:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74dbfff700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74e0c98700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fafea00 0x55f46fb0eec0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x55f46fb16060 tx=0x7f74d00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eda02121a158927 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74bbfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74bbfff700 1 -- 172.21.15.6:0/3024619204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0023040 con 0x55f46fafea00 2023-09-13T09:59:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74bbfff700 1 -- 172.21.15.6:0/3024619204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f74d0004a40 con 0x55f46fafea00 2023-09-13T09:59:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74c80a1eb0 con 0x55f46fafea00 2023-09-13T09:59:32.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74bbfff700 1 -- 172.21.15.6:0/3024619204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d0004c00 con 0x55f46fafea00 2023-09-13T09:59:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74ef0e1b80 10 client.20706 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.266+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x55f46f865c60 con 0x55f46fafea00 2023-09-13T09:59:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74bbfff700 1 -- 172.21.15.6:0/3024619204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f74c80a1eb0 con 0x55f46fafea00 2023-09-13T09:59:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74bbfff700 1 -- 172.21.15.6:0/3024619204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f74d0003710 con 0x55f46fafea00 2023-09-13T09:59:32.283 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74ef0e1b80 10 client.20706 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74ef0e1b80 10 client.20706 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T09:59:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74ef0e1b80 20 client.20706 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb68cc0 0x55f46fb6b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74ef0e1b80 4 client.20706 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:59:32.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f46fa0a050 con 0x55f46fb68cc0 2023-09-13T09:59:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74dbfff700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb68cc0 0x55f46fb6b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74bbfff700 10 client.20706 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T09:59:32.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.267+0000 7f74dbfff700 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb68cc0 0x55f46fb6b0e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8deffbaed52baab9 server_cookie=d56e172a87b0dd33 in_seq=0 out_seq=0 2023-09-13T09:59:32.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.271+0000 7f74bbfff700 1 -- 172.21.15.6:0/3024619204 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f46fa0a050 con 0x55f46fb68cc0 2023-09-13T09:59:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.271+0000 7f74bbfff700 10 client.20706 handle_command_reply: tid=0 2023-09-13T09:59:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.271+0000 7f74ef0e1b80 1 client.20706 shutdown 2023-09-13T09:59:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.271+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fafea00 msgr2=0x55f46fb0eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.271+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fafea00 0x55f46fb0eec0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x55f46fb16060 tx=0x7f74d00047c0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.271+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 shutdown_connections 2023-09-13T09:59:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.271+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f46fb68cc0 0x55f46fb6b0e0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f46fb00060 0x55f46fb0bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74bbfff700 0 client.20706 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T09:59:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f46fafea00 0x55f46fb0eec0 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74ef0e1b80 1 --2- 172.21.15.6:0/3024619204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f46faff700 0x55f46fb0b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 >> 172.21.15.6:0/3024619204 conn(0x55f46fa5cc80 msgr2=0x55f46fb05b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 shutdown_connections 2023-09-13T09:59:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74ef0e1b80 1 -- 172.21.15.6:0/3024619204 wait complete. 2023-09-13T09:59:32.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74ef0e1b80 20 client.20706 trim_cache size 0 max 16384 2023-09-13T09:59:32.289 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:59:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74cc0a0640 msgr2=0x7f74cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74cc0a0640 0x7f74cc0a2b00 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f74dc19a140 tx=0x7f74d0009260 comp rx=0 tx=0).stop 2023-09-13T09:59:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74dc1041b0 msgr2=0x7f74dc1991b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74dc1041b0 0x7f74dc1991b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f74c8009fd0 tx=0x7f74c8009580 comp rx=0 tx=0).stop 2023-09-13T09:59:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 shutdown_connections 2023-09-13T09:59:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f74dc104b50 0x7f74dc1a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f74cc0a0640 0x7f74cc0a2b00 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74dc102fc0 0x7f74dc198c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 --2- 172.21.15.6:0/98548450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74dc1041b0 0x7f74dc1991b0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 >> 172.21.15.6:0/98548450 conn(0x7f74dc0fe510 msgr2=0x7f74dc1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 shutdown_connections 2023-09-13T09:59:32.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.272+0000 7f74e2efc700 1 -- 172.21.15.6:0/98548450 wait complete. 2023-09-13T09:59:32.294 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T09:59:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.441+0000 7fd19f6b7700 1 -- 172.21.15.6:0/4057652841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1980ffca0 msgr2=0x7fd1981000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.441+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/4057652841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1980ffca0 0x7fd1981000c0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7fd1940099c0 tx=0x7fd194009cd0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.441+0000 7fd19f6b7700 1 -- 172.21.15.6:0/4057652841 shutdown_connections 2023-09-13T09:59:32.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.441+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/4057652841 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd198101830 0x7fd1981080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.441+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/4057652841 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1980ffca0 0x7fd1981000c0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.441+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/4057652841 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd198100e90 0x7fd1981012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.441+0000 7fd19f6b7700 1 -- 172.21.15.6:0/4057652841 >> 172.21.15.6:0/4057652841 conn(0x7fd1980fb1f0 msgr2=0x7fd1980fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 -- 172.21.15.6:0/4057652841 shutdown_connections 2023-09-13T09:59:32.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 -- 172.21.15.6:0/4057652841 wait complete. 2023-09-13T09:59:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 Processor -- start 2023-09-13T09:59:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 -- start start 2023-09-13T09:59:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1980ffca0 0x7fd198069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd198100e90 0x7fd19819b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd198101830 0x7fd19819ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19819e590 con 0x7fd198101830 2023-09-13T09:59:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19819e700 con 0x7fd1980ffca0 2023-09-13T09:59:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.442+0000 7fd19f6b7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19819e8c0 con 0x7fd198100e90 2023-09-13T09:59:32.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd198101830 0x7fd19819ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd198101830 0x7fd19819ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46410/0 (socket says 172.21.15.6:46410) 2023-09-13T09:59:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 -- 172.21.15.6:0/2126351724 learned_addr learned my addr 172.21.15.6:0/2126351724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19cc52700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd198100e90 0x7fd19819b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 -- 172.21.15.6:0/2126351724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd198100e90 msgr2=0x7fd19819b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd198100e90 0x7fd19819b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 -- 172.21.15.6:0/2126351724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1980ffca0 msgr2=0x7fd198069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1980ffca0 0x7fd198069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 -- 172.21.15.6:0/2126351724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1940095f0 con 0x7fd198101830 2023-09-13T09:59:32.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19dc54700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd198101830 0x7fd19819ddf0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fd19000ef30 tx=0x7fd19000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd18e7fc700 1 -- 172.21.15.6:0/2126351724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190018070 con 0x7fd198101830 2023-09-13T09:59:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd18e7fc700 1 -- 172.21.15.6:0/2126351724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd19000f040 con 0x7fd198101830 2023-09-13T09:59:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19819eb40 con 0x7fd198101830 2023-09-13T09:59:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd18e7fc700 1 -- 172.21.15.6:0/2126351724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19000cdb0 con 0x7fd198101830 2023-09-13T09:59:32.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.443+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19819f000 con 0x7fd198101830 2023-09-13T09:59:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.446+0000 7fd18e7fc700 1 -- 172.21.15.6:0/2126351724 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd190003a00 con 0x7fd198101830 2023-09-13T09:59:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.447+0000 7fd18e7fc700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1840a0640 0x7fd1840a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.458 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.447+0000 7fd18e7fc700 1 -- 172.21.15.6:0/2126351724 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd1900cb860 con 0x7fd198101830 2023-09-13T09:59:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd19d453700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1840a0640 0x7fd1840a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 Processor -- start 2023-09-13T09:59:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 -- start start 2023-09-13T09:59:32.459 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x563117791ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x563117792490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x563117792e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631176ea780 con 0x5631177929d0 2023-09-13T09:59:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631176e80a0 con 0x563117792010 2023-09-13T09:59:32.460 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.448+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631176e3990 con 0x5631177916b0 2023-09-13T09:59:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19d453700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x563117791ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19d453700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x563117791ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49468/0 (socket says 172.21.15.6:49468) 2023-09-13T09:59:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19d453700 1 -- 172.21.15.6:0/3995866458 learned_addr learned my addr 172.21.15.6:0/3995866458 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x563117792e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19cc52700 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x563117792490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19dc54700 1 -- 172.21.15.6:0/3995866458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 msgr2=0x563117791ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x563117791ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19dc54700 1 -- 172.21.15.6:0/3995866458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 msgr2=0x563117792490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x563117792490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19dc54700 1 -- 172.21.15.6:0/3995866458 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563117563630 con 0x5631177929d0 2023-09-13T09:59:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x563117792e80 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fd19000ef00 tx=0x7fd190098ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeabaa7c55df7c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd1837fe700 1 -- 172.21.15.6:0/3995866458 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd190004ad0 con 0x5631177929d0 2023-09-13T09:59:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd1837fe700 1 -- 172.21.15.6:0/3995866458 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd19009c030 con 0x5631177929d0 2023-09-13T09:59:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.449+0000 7fd1837fe700 1 -- 172.21.15.6:0/3995866458 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1900a1070 con 0x5631177929d0 2023-09-13T09:59:32.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3995866458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 msgr2=0x563117792e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd19d453700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1840a0640 0x7fd1840a2b00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd1940058e0 tx=0x7fd194009510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x563117792e80 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fd19000ef00 tx=0x7fd190098ee0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3995866458 shutdown_connections 2023-09-13T09:59:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x563117792e80 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x563117791ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3995866458 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x563117792490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.450+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3995866458 >> 172.21.15.6:0/3995866458 conn(0x5631176efc80 msgr2=0x56311778bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.451+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3995866458 shutdown_connections 2023-09-13T09:59:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.451+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3995866458 wait complete. 2023-09-13T09:59:32.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.451+0000 7fd1ab89cb80 1 -- start start 2023-09-13T09:59:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.451+0000 7fd1ab89cb80 1 Processor -- start 2023-09-13T09:59:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.451+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631177916b0 0x5631177a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.451+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563117792010 0x5631177a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x5631177aac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563117681bb0 con 0x563117792010 2023-09-13T09:59:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631176818b0 con 0x5631177916b0 2023-09-13T09:59:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563117565920 con 0x5631177929d0 2023-09-13T09:59:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd1ab89cb80 10 client.0 _ll_register_callbacks cb 0x56311767f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:32.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19cc52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563117792010 0x5631177a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19cc52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563117792010 0x5631177a3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46420/0 (socket says 172.21.15.6:46420) 2023-09-13T09:59:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19cc52700 1 -- 172.21.15.6:0/3017833856 learned_addr learned my addr 172.21.15.6:0/3017833856 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x5631177aac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19d453700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631177916b0 0x5631177a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19dc54700 1 -- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631177916b0 msgr2=0x5631177a36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631177916b0 0x5631177a36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19dc54700 1 -- 172.21.15.6:0/3017833856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563117792010 msgr2=0x5631177a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563117792010 0x5631177a3bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19dc54700 1 -- 172.21.15.6:0/3017833856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19819f000 con 0x5631177929d0 2023-09-13T09:59:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19cc52700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563117792010 0x5631177a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:32.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x5631177aac30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x563117795720 tx=0x7fd19009d010 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6958fb29fc40cc72 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.452+0000 7fd180ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:59:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd180ff9700 1 -- 172.21.15.6:0/3017833856 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1900b5070 con 0x5631177929d0 2023-09-13T09:59:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd180ff9700 1 -- 172.21.15.6:0/3017833856 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd190004ad0 con 0x5631177929d0 2023-09-13T09:59:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563117784670 con 0x5631177929d0 2023-09-13T09:59:32.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd180ff9700 1 -- 172.21.15.6:0/3017833856 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd19001b320 con 0x5631177929d0 2023-09-13T09:59:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 10 client.29902 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5631176fb7a0 con 0x5631177929d0 2023-09-13T09:59:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd180ff9700 1 -- 172.21.15.6:0/3017833856 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd19007b070 con 0x5631177929d0 2023-09-13T09:59:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd180ff9700 1 -- 172.21.15.6:0/3017833856 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd190098610 con 0x5631177929d0 2023-09-13T09:59:32.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 10 client.29902 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 10 client.29902 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 20 client.29902 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631177af070 0x5631177b1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 4 client.29902 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:32.472 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.453+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5631176dc970 con 0x5631177af070 2023-09-13T09:59:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.454+0000 7fd19d453700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631177af070 0x5631177b1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.454+0000 7fd19d453700 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631177af070 0x5631177b1460 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e866e76bd67e28 server_cookie=282a394137817c49 in_seq=0 out_seq=0 2023-09-13T09:59:32.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.454+0000 7fd180ff9700 10 client.29902 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:32.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd180ff9700 1 -- 172.21.15.6:0/3017833856 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5631176dc970 con 0x5631177af070 2023-09-13T09:59:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd180ff9700 10 client.29902 handle_command_reply: tid=0 2023-09-13T09:59:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 client.29902 shutdown 2023-09-13T09:59:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 msgr2=0x5631177aac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x5631177aac30 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x563117795720 tx=0x7fd19009d010 comp rx=0 tx=0).stop 2023-09-13T09:59:32.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 shutdown_connections 2023-09-13T09:59:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x5631177aac30 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5631177916b0 0x5631177a36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631177af070 0x5631177b1460 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3017833856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563117792010 0x5631177a3bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd180ff9700 0 client.29902 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 >> 172.21.15.6:0/3017833856 conn(0x5631176efc80 msgr2=0x5631177867f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 shutdown_connections 2023-09-13T09:59:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.461+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3017833856 wait complete. 2023-09-13T09:59:32.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.462+0000 7fd1ab89cb80 20 client.29902 trim_cache size 0 max 16384 2023-09-13T09:59:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.476+0000 7fd1ab89cb80 1 Processor -- start 2023-09-13T09:59:32.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.476+0000 7fd1ab89cb80 1 -- start start 2023-09-13T09:59:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177916b0 0x5631177a2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x5631177aabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x56311779e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631176dc970 con 0x5631177916b0 2023-09-13T09:59:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563117795750 con 0x563117792010 2023-09-13T09:59:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631177a2b60 con 0x5631177929d0 2023-09-13T09:59:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177916b0 0x5631177a2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19cc52700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x5631177aabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177916b0 0x5631177a2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46428/0 (socket says 172.21.15.6:46428) 2023-09-13T09:59:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 -- 172.21.15.6:0/3875611533 learned_addr learned my addr 172.21.15.6:0/3875611533 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19dc54700 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x56311779e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 -- 172.21.15.6:0/3875611533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 msgr2=0x56311779e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x56311779e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 -- 172.21.15.6:0/3875611533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 msgr2=0x5631177aabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x5631177aabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.477+0000 7fd19d453700 1 -- 172.21.15.6:0/3875611533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56311750fde0 con 0x5631177916b0 2023-09-13T09:59:32.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.478+0000 7fd19d453700 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177916b0 0x5631177a2d60 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd1940095c0 tx=0x7fd19400b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86cc39f978e88ae server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.478+0000 7fd183fff700 1 -- 172.21.15.6:0/3875611533 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19402d040 con 0x5631177916b0 2023-09-13T09:59:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.478+0000 7fd183fff700 1 -- 172.21.15.6:0/3875611533 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd19401b070 con 0x5631177916b0 2023-09-13T09:59:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.478+0000 7fd183fff700 1 -- 172.21.15.6:0/3875611533 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd194005600 con 0x5631177916b0 2023-09-13T09:59:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3875611533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177916b0 msgr2=0x5631177a2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177916b0 0x5631177a2d60 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7fd1940095c0 tx=0x7fd19400b540 comp rx=0 tx=0).stop 2023-09-13T09:59:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3875611533 shutdown_connections 2023-09-13T09:59:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177929d0 0x56311779e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177916b0 0x5631177a2d60 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/3875611533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x5631177aabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3875611533 >> 172.21.15.6:0/3875611533 conn(0x5631176efc80 msgr2=0x56311778be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3875611533 shutdown_connections 2023-09-13T09:59:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/3875611533 wait complete. 2023-09-13T09:59:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 -- start start 2023-09-13T09:59:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.479+0000 7fd1ab89cb80 1 Processor -- start 2023-09-13T09:59:32.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x5631177a89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x5631177a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd1ab89cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x5631177a9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631177aa470 con 0x5631177929d0 2023-09-13T09:59:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631177aa5e0 con 0x563117792010 2023-09-13T09:59:32.490 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd1ab89cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5631177aa7a0 con 0x5631177916b0 2023-09-13T09:59:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd1ab89cb80 10 client.0 _ll_register_callbacks cb 0x56311767f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x5631177a9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x5631177a9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46436/0 (socket says 172.21.15.6:46436) 2023-09-13T09:59:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 -- 172.21.15.6:0/108252661 learned_addr learned my addr 172.21.15.6:0/108252661 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:32.491 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19d453700 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x5631177a89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 -- 172.21.15.6:0/108252661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 msgr2=0x5631177a89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x5631177a89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 -- 172.21.15.6:0/108252661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 msgr2=0x5631177a8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x5631177a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.492 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 -- 172.21.15.6:0/108252661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd198108a30 con 0x5631177929d0 2023-09-13T09:59:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd19dc54700 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x5631177a9f30 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd190095590 tx=0x7fd1900a0be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e207473a8f914065 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.480+0000 7fd180ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd180ff9700 1 -- 172.21.15.6:0/108252661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1900b5060 con 0x5631177929d0 2023-09-13T09:59:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd19009c030 con 0x5631177929d0 2023-09-13T09:59:32.493 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd180ff9700 1 -- 172.21.15.6:0/108252661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd190004ad0 con 0x5631177929d0 2023-09-13T09:59:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd180ff9700 1 -- 172.21.15.6:0/108252661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd190098790 con 0x5631177929d0 2023-09-13T09:59:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 10 client.20724 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5631174f8c60 con 0x5631177929d0 2023-09-13T09:59:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd180ff9700 1 -- 172.21.15.6:0/108252661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd19009c030 con 0x5631177929d0 2023-09-13T09:59:32.494 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd180ff9700 1 -- 172.21.15.6:0/108252661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7fd190095080 con 0x5631177929d0 2023-09-13T09:59:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 10 client.20724 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 10 client.20724 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 20 client.20724 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:32.495 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631178037b0 0x563117805bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 4 client.20724 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T09:59:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.481+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56311769d050 con 0x5631178037b0 2023-09-13T09:59:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.482+0000 7fd19d453700 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631178037b0 0x563117805bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.483+0000 7fd19d453700 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631178037b0 0x563117805bd0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=735073f8809b6ddc server_cookie=b6ca2e78cc3c22aa in_seq=0 out_seq=0 2023-09-13T09:59:32.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.483+0000 7fd180ff9700 10 client.20724 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.485+0000 7fd180ff9700 1 -- 172.21.15.6:0/108252661 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56311769d050 con 0x5631178037b0 2023-09-13T09:59:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd180ff9700 10 client.20724 handle_command_reply: tid=0 2023-09-13T09:59:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 client.20724 shutdown 2023-09-13T09:59:32.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 msgr2=0x5631177a9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x5631177a9f30 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7fd190095590 tx=0x7fd1900a0be0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 shutdown_connections 2023-09-13T09:59:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5631178037b0 0x563117805bd0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5631177929d0 0x5631177a9f30 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5631177916b0 0x5631177a89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 --2- 172.21.15.6:0/108252661 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563117792010 0x5631177a8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 >> 172.21.15.6:0/108252661 conn(0x5631176efc80 msgr2=0x56311779e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd180ff9700 0 client.20724 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:32.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 shutdown_connections 2023-09-13T09:59:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 1 -- 172.21.15.6:0/108252661 wait complete. 2023-09-13T09:59:32.501 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.486+0000 7fd1ab89cb80 20 client.20724 trim_cache size 0 max 16384 2023-09-13T09:59:32.501 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T09:59:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1840a0640 msgr2=0x7fd1840a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.502 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1840a0640 0x7fd1840a2b00 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fd1940058e0 tx=0x7fd194009510 comp rx=0 tx=0).stop 2023-09-13T09:59:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd198101830 msgr2=0x7fd19819ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd198101830 0x7fd19819ddf0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fd19000ef30 tx=0x7fd19000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 shutdown_connections 2023-09-13T09:59:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd1840a0640 0x7fd1840a2b00 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd198101830 0x7fd19819ddf0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd1980ffca0 0x7fd198069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 --2- 172.21.15.6:0/2126351724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd198100e90 0x7fd19819b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 >> 172.21.15.6:0/2126351724 conn(0x7fd1980fb1f0 msgr2=0x7fd1980fd520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 shutdown_connections 2023-09-13T09:59:32.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:32.487+0000 7fd19f6b7700 1 -- 172.21.15.6:0/2126351724 wait complete. 2023-09-13T09:59:32.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:32 smithi006 ceph-mon[98665]: pgmap v900: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 546 op/s 2023-09-13T09:59:32.505 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:32 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1429908625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:59:32.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:32 smithi053 ceph-mon[102373]: pgmap v900: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 546 op/s 2023-09-13T09:59:32.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:32 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1429908625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:59:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:32 smithi131 ceph-mon[102785]: pgmap v900: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 5.6 MiB/s wr, 546 op/s 2023-09-13T09:59:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:32 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1429908625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T09:59:32.591 INFO:tasks.workunit.client.0.smithi006.stdout: 10 277310 35.21 MB/sec execute 292 sec latency 89.852 ms 2023-09-13T09:59:33.506 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T09:59:33.507 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T09:59:33.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 277926 35.19 MB/sec execute 293 sec latency 93.194 ms 2023-09-13T09:59:33.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 -- 172.21.15.6:0/3024002869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100630 msgr2=0x7ff598100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 --2- 172.21.15.6:0/3024002869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100630 0x7ff598100a90 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7ff58000aad0 tx=0x7ff58000ade0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 -- 172.21.15.6:0/3024002869 shutdown_connections 2023-09-13T09:59:33.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 --2- 172.21.15.6:0/3024002869 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff598100fd0 0x7ff598107880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 --2- 172.21.15.6:0/3024002869 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5980ff440 0x7ff5980ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 --2- 172.21.15.6:0/3024002869 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100630 0x7ff598100a90 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 -- 172.21.15.6:0/3024002869 >> 172.21.15.6:0/3024002869 conn(0x7ff5980fa9b0 msgr2=0x7ff5980fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 -- 172.21.15.6:0/3024002869 shutdown_connections 2023-09-13T09:59:33.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 -- 172.21.15.6:0/3024002869 wait complete. 2023-09-13T09:59:33.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.668+0000 7ff59d350700 1 Processor -- start 2023-09-13T09:59:33.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff59d350700 1 -- start start 2023-09-13T09:59:33.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff59d350700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5980ff440 0x7ff598103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff59d350700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff598100630 0x7ff598101d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff59d350700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100fd0 0x7ff5981022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff59d350700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff598102a50 con 0x7ff598100fd0 2023-09-13T09:59:33.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff59d350700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff598102bc0 con 0x7ff598100630 2023-09-13T09:59:33.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff59d350700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5981a0ac0 con 0x7ff5980ff440 2023-09-13T09:59:33.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100fd0 0x7ff5981022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5980ff440 0x7ff598103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100fd0 0x7ff5981022b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46452/0 (socket says 172.21.15.6:46452) 2023-09-13T09:59:33.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 -- 172.21.15.6:0/2275827369 learned_addr learned my addr 172.21.15.6:0/2275827369 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff598100630 0x7ff598101d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 -- 172.21.15.6:0/2275827369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5980ff440 msgr2=0x7ff598103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5980ff440 0x7ff598103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 -- 172.21.15.6:0/2275827369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff598100630 msgr2=0x7ff598101d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff598100630 0x7ff598101d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.669+0000 7ff5977fe700 1 -- 172.21.15.6:0/2275827369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff58000a700 con 0x7ff598100fd0 2023-09-13T09:59:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.670+0000 7ff5977fe700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100fd0 0x7ff5981022b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff59000ef30 tx=0x7ff59000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.670+0000 7ff594ff9700 1 -- 172.21.15.6:0/2275827369 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590018070 con 0x7ff598100fd0 2023-09-13T09:59:33.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.670+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5981a0d40 con 0x7ff598100fd0 2023-09-13T09:59:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.670+0000 7ff594ff9700 1 -- 172.21.15.6:0/2275827369 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff59000f040 con 0x7ff598100fd0 2023-09-13T09:59:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.670+0000 7ff594ff9700 1 -- 172.21.15.6:0/2275827369 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000cd00 con 0x7ff598100fd0 2023-09-13T09:59:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.670+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5981a11a0 con 0x7ff598100fd0 2023-09-13T09:59:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.672+0000 7ff594ff9700 1 -- 172.21.15.6:0/2275827369 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff590003a00 con 0x7ff598100fd0 2023-09-13T09:59:33.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.673+0000 7ff594ff9700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5780a0640 0x7ff5780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.673+0000 7ff596ffd700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5780a0640 0x7ff5780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.673+0000 7ff594ff9700 1 -- 172.21.15.6:0/2275827369 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff5900cb740 con 0x7ff598100fd0 2023-09-13T09:59:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.673+0000 7ff596ffd700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5780a0640 0x7ff5780a2b00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff598100490 tx=0x7ff58800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 Processor -- start 2023-09-13T09:59:33.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 -- start start 2023-09-13T09:59:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b27780 0x557af8b27ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b280e0 0x557af8b26540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8a7f800 con 0x557af8b26a80 2023-09-13T09:59:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8a7d120 con 0x557af8b280e0 2023-09-13T09:59:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.674+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8a78a10 con 0x557af8b27780 2023-09-13T09:59:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b27780 0x557af8b27ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b27780 0x557af8b27ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49510/0 (socket says 172.21.15.6:49510) 2023-09-13T09:59:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 -- 172.21.15.6:0/818749776 learned_addr learned my addr 172.21.15.6:0/818749776 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b280e0 0x557af8b26540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff5977fe700 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 -- 172.21.15.6:0/818749776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b280e0 msgr2=0x557af8b26540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b280e0 0x557af8b26540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 -- 172.21.15.6:0/818749776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 msgr2=0x557af8b26f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 -- 172.21.15.6:0/818749776 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557af88f86b0 con 0x557af8b27780 2023-09-13T09:59:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.675+0000 7ff596ffd700 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b27780 0x557af8b27ba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff588010f70 tx=0x7ff588013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4fe62fa5e32474a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.676+0000 7ff58d7fa700 1 -- 172.21.15.6:0/818749776 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff588011db0 con 0x557af8b27780 2023-09-13T09:59:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.676+0000 7ff58d7fa700 1 -- 172.21.15.6:0/818749776 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff588015070 con 0x557af8b27780 2023-09-13T09:59:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.676+0000 7ff58d7fa700 1 -- 172.21.15.6:0/818749776 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58801c610 con 0x557af8b27780 2023-09-13T09:59:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 -- 172.21.15.6:0/818749776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b27780 msgr2=0x557af8b27ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b27780 0x557af8b27ba0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff588010f70 tx=0x7ff588013000 comp rx=0 tx=0).stop 2023-09-13T09:59:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 -- 172.21.15.6:0/818749776 shutdown_connections 2023-09-13T09:59:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b27780 0x557af8b27ba0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/818749776 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b280e0 0x557af8b26540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 -- 172.21.15.6:0/818749776 >> 172.21.15.6:0/818749776 conn(0x557af8a84d00 msgr2=0x557af8b20f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 -- 172.21.15.6:0/818749776 shutdown_connections 2023-09-13T09:59:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 -- 172.21.15.6:0/818749776 wait complete. 2023-09-13T09:59:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 -- start start 2023-09-13T09:59:33.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.677+0000 7ff5a9535b80 1 Processor -- start 2023-09-13T09:59:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b2ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b304d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b37510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8a16c30 con 0x557af8b26a80 2023-09-13T09:59:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8a16930 con 0x557af8b27780 2023-09-13T09:59:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af88fa9a0 con 0x557af8b280e0 2023-09-13T09:59:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5a9535b80 10 client.0 _ll_register_callbacks cb 0x557af8a14700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b304d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b304d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:39988/0 (socket says 172.21.15.6:39988) 2023-09-13T09:59:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 -- 172.21.15.6:0/3678890268 learned_addr learned my addr 172.21.15.6:0/3678890268 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff5977fe700 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b37510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 -- 172.21.15.6:0/3678890268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 msgr2=0x557af8b37510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b37510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 -- 172.21.15.6:0/3678890268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 msgr2=0x557af8b2ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b2ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.678+0000 7ff58e7fc700 1 -- 172.21.15.6:0/3678890268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff588010c50 con 0x557af8b27780 2023-09-13T09:59:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b304d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff580003ab0 tx=0x7ff580003940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53f7e954a2110ca7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff5867fc700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T09:59:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff5867fc700 1 -- 172.21.15.6:0/3678890268 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff580005280 con 0x557af8b27780 2023-09-13T09:59:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff5867fc700 1 -- 172.21.15.6:0/3678890268 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff580012070 con 0x557af8b27780 2023-09-13T09:59:33.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557af8b196f0 con 0x557af8b27780 2023-09-13T09:59:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff5867fc700 1 -- 172.21.15.6:0/3678890268 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5800053e0 con 0x557af8b27780 2023-09-13T09:59:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff5a9535b80 10 client.29939 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.679+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x557af8a90820 con 0x557af8b27780 2023-09-13T09:59:33.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5867fc700 1 -- 172.21.15.6:0/3678890268 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557af8b196f0 con 0x557af8b27780 2023-09-13T09:59:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5867fc700 1 -- 172.21.15.6:0/3678890268 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff580022430 con 0x557af8b27780 2023-09-13T09:59:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5a9535b80 10 client.29939 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:33.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5a9535b80 10 client.29939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5a9535b80 20 client.29939 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b3be30 0x557af8b3e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5a9535b80 4 client.29939 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557af8a719f0 con 0x557af8b3be30 2023-09-13T09:59:33.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.680+0000 7ff596ffd700 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b3be30 0x557af8b3e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.681+0000 7ff5867fc700 10 client.29939 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.681+0000 7ff596ffd700 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b3be30 0x557af8b3e250 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47d177bd72d3e58b server_cookie=ee1652b0bec7fedf in_seq=0 out_seq=0 2023-09-13T09:59:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5867fc700 1 -- 172.21.15.6:0/3678890268 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557af8a719f0 con 0x557af8b3be30 2023-09-13T09:59:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5867fc700 10 client.29939 handle_command_reply: tid=0 2023-09-13T09:59:33.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 client.29939 shutdown 2023-09-13T09:59:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 msgr2=0x557af8b304d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b304d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7ff580003ab0 tx=0x7ff580003940 comp rx=0 tx=0).stop 2023-09-13T09:59:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 shutdown_connections 2023-09-13T09:59:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b37510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b3be30 0x557af8b3e250 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b2ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3678890268 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b304d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5867fc700 0 client.29939 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 >> 172.21.15.6:0/3678890268 conn(0x557af8a84d00 msgr2=0x557af8b1b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 shutdown_connections 2023-09-13T09:59:33.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3678890268 wait complete. 2023-09-13T09:59:33.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.687+0000 7ff5a9535b80 20 client.29939 trim_cache size 0 max 16384 2023-09-13T09:59:33.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 Processor -- start 2023-09-13T09:59:33.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 -- start start 2023-09-13T09:59:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b374d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b2a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8b2e6a0 con 0x557af8b26a80 2023-09-13T09:59:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8b2dbc0 con 0x557af8b27780 2023-09-13T09:59:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.710+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8b2b4b0 con 0x557af8b280e0 2023-09-13T09:59:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46470/0 (socket says 172.21.15.6:46470) 2023-09-13T09:59:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 -- 172.21.15.6:0/3637488608 learned_addr learned my addr 172.21.15.6:0/3637488608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 -- 172.21.15.6:0/3637488608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 msgr2=0x557af8b2a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 --2- 172.21.15.6:0/3637488608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b2a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 -- 172.21.15.6:0/3637488608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 msgr2=0x557af8b374d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T09:59:33.715 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 --2- 172.21.15.6:0/3637488608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b374d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 -- 172.21.15.6:0/3637488608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557af88a4e60 con 0x557af8b26a80 2023-09-13T09:59:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff596ffd700 1 --2- 172.21.15.6:0/3637488608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26540 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff588010f70 tx=0x7ff58800ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd54b5c113a3792 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff58dffb700 1 -- 172.21.15.6:0/3637488608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58802c040 con 0x557af8b26a80 2023-09-13T09:59:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff58dffb700 1 -- 172.21.15.6:0/3637488608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff5880315a0 con 0x557af8b26a80 2023-09-13T09:59:33.716 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.711+0000 7ff58dffb700 1 -- 172.21.15.6:0/3637488608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58801e680 con 0x557af8b26a80 2023-09-13T09:59:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3637488608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 msgr2=0x557af8b26540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3637488608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26540 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7ff588010f70 tx=0x7ff58800ba30 comp rx=0 tx=0).stop 2023-09-13T09:59:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3637488608 shutdown_connections 2023-09-13T09:59:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3637488608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b2a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3637488608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b26540 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/3637488608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b374d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3637488608 >> 172.21.15.6:0/3637488608 conn(0x557af8a84d00 msgr2=0x557af8b2ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3637488608 shutdown_connections 2023-09-13T09:59:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 -- 172.21.15.6:0/3637488608 wait complete. 2023-09-13T09:59:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.712+0000 7ff5a9535b80 1 -- start start 2023-09-13T09:59:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 1 Processor -- start 2023-09-13T09:59:33.721 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b34380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b348c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b8fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8b34fd0 con 0x557af8b26a80 2023-09-13T09:59:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8b901b0 con 0x557af8b27780 2023-09-13T09:59:33.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557af8b90370 con 0x557af8b280e0 2023-09-13T09:59:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5a9535b80 10 client.0 _ll_register_callbacks cb 0x557af8a14700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b34380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b34380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46474/0 (socket says 172.21.15.6:46474) 2023-09-13T09:59:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 -- 172.21.15.6:0/1301765146 learned_addr learned my addr 172.21.15.6:0/1301765146 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5977fe700 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b8fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b348c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 -- 172.21.15.6:0/1301765146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 msgr2=0x557af8b8fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b8fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 -- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 msgr2=0x557af8b348c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b348c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 -- 172.21.15.6:0/1301765146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557af88f86b0 con 0x557af8b26a80 2023-09-13T09:59:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff596ffd700 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b34380 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff588011da0 tx=0x7ff588011bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75ad5b16b9bada9a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.713+0000 7ff5867fc700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5867fc700 1 -- 172.21.15.6:0/1301765146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff58802c050 con 0x557af8b26a80 2023-09-13T09:59:33.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5867fc700 1 -- 172.21.15.6:0/1301765146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff588017070 con 0x557af8b26a80 2023-09-13T09:59:33.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff588015070 con 0x557af8b26a80 2023-09-13T09:59:33.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5867fc700 1 -- 172.21.15.6:0/1301765146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff588004020 con 0x557af8b26a80 2023-09-13T09:59:33.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 10 client.20739 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:33.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x557af888dce0 con 0x557af8b26a80 2023-09-13T09:59:33.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5867fc700 1 -- 172.21.15.6:0/1301765146 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff588015070 con 0x557af8b26a80 2023-09-13T09:59:33.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5867fc700 1 -- 172.21.15.6:0/1301765146 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7ff588003680 con 0x557af8b26a80 2023-09-13T09:59:33.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 10 client.20739 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:33.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 10 client.20739 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:33.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 20 client.20739 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:33.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b91940 0x557af8b93d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 4 client.20739 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T09:59:33.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.714+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x557af8a320d0 con 0x557af8b91940 2023-09-13T09:59:33.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.718+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b91940 0x557af8b93d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.718+0000 7ff5867fc700 10 client.20739 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.718+0000 7ff58e7fc700 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b91940 0x557af8b93d30 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=209c9c67914ed12b server_cookie=647ec7b8ecdad428 in_seq=0 out_seq=0 2023-09-13T09:59:33.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.737+0000 7ff5867fc700 1 -- 172.21.15.6:0/1301765146 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557af8a320d0 con 0x557af8b91940 2023-09-13T09:59:33.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.737+0000 7ff5867fc700 10 client.20739 handle_command_reply: tid=0 2023-09-13T09:59:33.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.737+0000 7ff5a9535b80 1 client.20739 shutdown 2023-09-13T09:59:33.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.737+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 msgr2=0x557af8b34380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.737+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b34380 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7ff588011da0 tx=0x7ff588011bc0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 shutdown_connections 2023-09-13T09:59:33.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557af8b280e0 0x557af8b8fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557af8b91940 0x557af8b93d30 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557af8b26a80 0x557af8b34380 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 --2- 172.21.15.6:0/1301765146 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557af8b27780 0x557af8b348c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 >> 172.21.15.6:0/1301765146 conn(0x557af8a84d00 msgr2=0x557af8b2ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5867fc700 0 client.20739 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 shutdown_connections 2023-09-13T09:59:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.739+0000 7ff5a9535b80 1 -- 172.21.15.6:0/1301765146 wait complete. 2023-09-13T09:59:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff5a9535b80 20 client.20739 trim_cache size 0 max 16384 2023-09-13T09:59:33.743 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:59:33.744 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T09:59:33.744 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "cbda86dd-3b24-4bbe-92a0-3431d4ccb883", 2023-09-13T09:59:33.744 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T09:59:33.744 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:59:33.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5780a0640 msgr2=0x7ff5780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5780a0640 0x7ff5780a2b00 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7ff598100490 tx=0x7ff58800b410 comp rx=0 tx=0).stop 2023-09-13T09:59:33.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100fd0 msgr2=0x7ff5981022b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100fd0 0x7ff5981022b0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7ff59000ef30 tx=0x7ff59000c3a0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 shutdown_connections 2023-09-13T09:59:33.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff5780a0640 0x7ff5780a2b00 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff598100fd0 0x7ff5981022b0 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5980ff440 0x7ff598103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 --2- 172.21.15.6:0/2275827369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff598100630 0x7ff598101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.740+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 >> 172.21.15.6:0/2275827369 conn(0x7ff5980fa9b0 msgr2=0x7ff5980fcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.741+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 shutdown_connections 2023-09-13T09:59:33.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.741+0000 7ff59d350700 1 -- 172.21.15.6:0/2275827369 wait complete. 2023-09-13T09:59:33.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T09:59:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.928+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/468672429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0102950 msgr2=0x7f4aa0109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/468672429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0102950 0x7f4aa0109200 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800b0d0 tx=0x7f4a9800b3e0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/468672429 shutdown_connections 2023-09-13T09:59:33.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/468672429 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0102950 0x7f4aa0109200 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/468672429 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0100dc0 0x7f4aa01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/468672429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 0x7f4aa0102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/468672429 >> 172.21.15.6:0/468672429 conn(0x7f4aa00fc350 msgr2=0x7f4aa00fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/468672429 shutdown_connections 2023-09-13T09:59:33.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/468672429 wait complete. 2023-09-13T09:59:33.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.929+0000 7f4aa5c2e700 1 Processor -- start 2023-09-13T09:59:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4aa5c2e700 1 -- start start 2023-09-13T09:59:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4aa5c2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0100dc0 0x7f4aa0196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4aa5c2e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 0x7f4aa0197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4aa5c2e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0102950 0x7f4aa019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.935 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4aa5c2e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa019e6c0 con 0x7f4aa0100dc0 2023-09-13T09:59:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4aa5c2e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa019e800 con 0x7f4aa0102950 2023-09-13T09:59:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4aa5c2e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa019e990 con 0x7f4aa0101fb0 2023-09-13T09:59:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0100dc0 0x7f4aa0196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 0x7f4aa0197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0100dc0 0x7f4aa0196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46490/0 (socket says 172.21.15.6:46490) 2023-09-13T09:59:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/2544428617 learned_addr learned my addr 172.21.15.6:0/2544428617 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 0x7f4aa0197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49542/0 (socket says 172.21.15.6:49542) 2023-09-13T09:59:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9effd700 1 -- 172.21.15.6:0/2544428617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0102950 msgr2=0x7f4aa019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9effd700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0102950 0x7f4aa019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9effd700 1 -- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0100dc0 msgr2=0x7f4aa0196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9effd700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0100dc0 0x7f4aa0196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9effd700 1 -- 172.21.15.6:0/2544428617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009520 con 0x7f4aa0101fb0 2023-09-13T09:59:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.930+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0100dc0 0x7f4aa0196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:33.938 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.931+0000 7f4a9effd700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 0x7f4aa0197080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400e9f0 tx=0x7f4a9400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.931+0000 7f4a9cff9700 1 -- 172.21.15.6:0/2544428617 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400cb70 con 0x7f4aa0101fb0 2023-09-13T09:59:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.931+0000 7f4a9cff9700 1 -- 172.21.15.6:0/2544428617 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a940044e0 con 0x7f4aa0101fb0 2023-09-13T09:59:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.931+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a98009d00 con 0x7f4aa0101fb0 2023-09-13T09:59:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.931+0000 7f4a9cff9700 1 -- 172.21.15.6:0/2544428617 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94003d50 con 0x7f4aa0101fb0 2023-09-13T09:59:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.931+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa00732c0 con 0x7f4aa0101fb0 2023-09-13T09:59:33.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.934+0000 7f4a9cff9700 1 -- 172.21.15.6:0/2544428617 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4a94004020 con 0x7f4aa0101fb0 2023-09-13T09:59:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.935+0000 7f4a9cff9700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a880a0640 0x7f4a880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.935+0000 7f4a9cff9700 1 -- 172.21.15.6:0/2544428617 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a94014070 con 0x7f4aa0101fb0 2023-09-13T09:59:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a880a0640 0x7f4a880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 Processor -- start 2023-09-13T09:59:33.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 -- start start 2023-09-13T09:59:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a880a0640 0x7f4a880a2b00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000f5b0 tx=0x7f4a9000f8b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904582700 0x562904582b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904583060 0x5629045814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x562904581e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629044da780 con 0x562904582700 2023-09-13T09:59:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629044d80a0 con 0x562904583060 2023-09-13T09:59:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629044d3990 con 0x562904581a00 2023-09-13T09:59:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904582700 0x562904582b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904582700 0x562904582b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46496/0 (socket says 172.21.15.6:46496) 2023-09-13T09:59:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904583060 0x5629045814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3690588101 learned_addr learned my addr 172.21.15.6:0/3690588101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.936+0000 7f4a9ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x562904581e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3690588101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 msgr2=0x562904581e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x562904581e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3690588101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904583060 msgr2=0x5629045814c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904583060 0x5629045814c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/3690588101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562904353630 con 0x562904582700 2023-09-13T09:59:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9ffff700 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x562904581e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904582700 0x562904582b20 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000f0b0 tx=0x7f4a90017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9186442fc5e0f6b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a85ffb700 1 -- 172.21.15.6:0/3690588101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90026400 con 0x562904582700 2023-09-13T09:59:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a85ffb700 1 -- 172.21.15.6:0/3690588101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a90015040 con 0x562904582700 2023-09-13T09:59:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a85ffb700 1 -- 172.21.15.6:0/3690588101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90019920 con 0x562904582700 2023-09-13T09:59:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.937+0000 7f4a9effd700 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904583060 0x5629045814c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:59:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/3690588101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904582700 msgr2=0x562904582b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904582700 0x562904582b20 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000f0b0 tx=0x7f4a90017000 comp rx=0 tx=0).stop 2023-09-13T09:59:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/3690588101 shutdown_connections 2023-09-13T09:59:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x562904581e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904582700 0x562904582b20 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/3690588101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904583060 0x5629045814c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/3690588101 >> 172.21.15.6:0/3690588101 conn(0x5629044dfc80 msgr2=0x56290457bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.938+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/3690588101 shutdown_connections 2023-09-13T09:59:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.939+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/3690588101 wait complete. 2023-09-13T09:59:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.939+0000 7f4ab1e13b80 1 -- start start 2023-09-13T09:59:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.939+0000 7f4ab1e13b80 1 Processor -- start 2023-09-13T09:59:33.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904581a00 0x56290458afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x56290458b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904583060 0x562904592520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x562904471bb0 con 0x562904581a00 2023-09-13T09:59:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629044718b0 con 0x562904582700 2023-09-13T09:59:33.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562904355920 con 0x562904583060 2023-09-13T09:59:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4ab1e13b80 10 client.0 _ll_register_callbacks cb 0x56290446f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904581a00 0x56290458afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904581a00 0x56290458afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46502/0 (socket says 172.21.15.6:46502) 2023-09-13T09:59:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/2411279567 learned_addr learned my addr 172.21.15.6:0/2411279567 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9effd700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x56290458b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9ffff700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904583060 0x562904592520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/2411279567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904583060 msgr2=0x562904592520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904583060 0x562904592520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 msgr2=0x56290458b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x56290458b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/2411279567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a9001b410 con 0x562904581a00 2023-09-13T09:59:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9ffff700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904583060 0x562904592520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T09:59:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9effd700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x56290458b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T09:59:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904581a00 0x56290458afa0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000f390 tx=0x7f4a90019e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6a40ce61e08249b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.940+0000 7f4a7effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T09:59:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4a7effd700 1 -- 172.21.15.6:0/2411279567 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90005260 con 0x562904581a00 2023-09-13T09:59:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4a7effd700 1 -- 172.21.15.6:0/2411279567 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a900053c0 con 0x562904581a00 2023-09-13T09:59:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562904574670 con 0x562904581a00 2023-09-13T09:59:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4a7effd700 1 -- 172.21.15.6:0/2411279567 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a90005580 con 0x562904581a00 2023-09-13T09:59:33.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 10 client.20751 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5629044eb7a0 con 0x562904581a00 2023-09-13T09:59:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4a7effd700 1 -- 172.21.15.6:0/2411279567 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a9003e020 con 0x562904581a00 2023-09-13T09:59:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4a7effd700 1 -- 172.21.15.6:0/2411279567 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4a90026740 con 0x562904581a00 2023-09-13T09:59:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 10 client.20751 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:33.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 10 client.20751 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 20 client.20751 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562904596cd0 0x5629045990f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 4 client.20751 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T09:59:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5629044cc970 con 0x562904596cd0 2023-09-13T09:59:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.941+0000 7f4a9effd700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562904596cd0 0x5629045990f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.942+0000 7f4a7effd700 10 client.20751 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.942+0000 7f4a9effd700 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562904596cd0 0x5629045990f0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7368b34ff00a55f server_cookie=10453c45a1db4eee in_seq=0 out_seq=0 2023-09-13T09:59:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.947+0000 7f4a7effd700 1 -- 172.21.15.6:0/2411279567 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5629044cc970 con 0x562904596cd0 2023-09-13T09:59:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.947+0000 7f4a7effd700 10 client.20751 handle_command_reply: tid=0 2023-09-13T09:59:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.947+0000 7f4ab1e13b80 1 client.20751 shutdown 2023-09-13T09:59:33.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904581a00 msgr2=0x56290458afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904581a00 0x56290458afa0 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000f390 tx=0x7f4a90019e20 comp rx=0 tx=0).stop 2023-09-13T09:59:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 shutdown_connections 2023-09-13T09:59:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904583060 0x562904592520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x562904596cd0 0x5629045990f0 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904581a00 0x56290458afa0 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/2411279567 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x56290458b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 >> 172.21.15.6:0/2411279567 conn(0x5629044dfc80 msgr2=0x5629045767f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4a7effd700 0 client.20751 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 shutdown_connections 2023-09-13T09:59:33.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/2411279567 wait complete. 2023-09-13T09:59:33.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.948+0000 7f4ab1e13b80 20 client.20751 trim_cache size 0 max 16384 2023-09-13T09:59:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.972+0000 7f4ab1e13b80 1 Processor -- start 2023-09-13T09:59:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.972+0000 7f4ab1e13b80 1 -- start start 2023-09-13T09:59:33.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x5629045814c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x5629045924b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x562904588e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56290458ab10 con 0x562904583060 2023-09-13T09:59:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629045788e0 con 0x562904582700 2023-09-13T09:59:33.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562904588be0 con 0x562904581a00 2023-09-13T09:59:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x5629045814c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x5629045924b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x5629045814c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49564/0 (socket says 172.21.15.6:49564) 2023-09-13T09:59:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/1699207996 learned_addr learned my addr 172.21.15.6:0/1699207996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9effd700 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x5629045924b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40036/0 (socket says 172.21.15.6:40036) 2023-09-13T09:59:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/1699207996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 msgr2=0x5629045924b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x5629045924b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/1699207996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 msgr2=0x562904588e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x562904588e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.973+0000 7f4a9f7fe700 1 -- 172.21.15.6:0/1699207996 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629042ffde0 con 0x562904581a00 2023-09-13T09:59:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.974+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x5629045814c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4a90005cf0 tx=0x7f4a90005c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad222a2287729441 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.974+0000 7f4a867fc700 1 -- 172.21.15.6:0/1699207996 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90026d60 con 0x562904581a00 2023-09-13T09:59:33.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.974+0000 7f4a867fc700 1 -- 172.21.15.6:0/1699207996 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a9003e030 con 0x562904581a00 2023-09-13T09:59:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.974+0000 7f4a867fc700 1 -- 172.21.15.6:0/1699207996 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90026400 con 0x562904581a00 2023-09-13T09:59:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1699207996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 msgr2=0x5629045814c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x5629045814c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4a90005cf0 tx=0x7f4a90005c80 comp rx=0 tx=0).stop 2023-09-13T09:59:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1699207996 shutdown_connections 2023-09-13T09:59:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x562904588e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904581a00 0x5629045814c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1699207996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904582700 0x5629045924b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1699207996 >> 172.21.15.6:0/1699207996 conn(0x5629044dfc80 msgr2=0x562904589c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1699207996 shutdown_connections 2023-09-13T09:59:33.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1699207996 wait complete. 2023-09-13T09:59:33.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.975+0000 7f4ab1e13b80 1 -- start start 2023-09-13T09:59:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 1 Processor -- start 2023-09-13T09:59:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904581a00 0x562904592070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904582700 0x56290458eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x56290458f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56290458f730 con 0x562904583060 2023-09-13T09:59:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629045926f0 con 0x562904581a00 2023-09-13T09:59:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x562904592880 con 0x562904582700 2023-09-13T09:59:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4ab1e13b80 10 client.0 _ll_register_callbacks cb 0x56290446f680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T09:59:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904582700 0x56290458eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4a9ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x56290458f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4a9effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904582700 0x56290458eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49572/0 (socket says 172.21.15.6:49572) 2023-09-13T09:59:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4a9effd700 1 -- 172.21.15.6:0/1536486381 learned_addr learned my addr 172.21.15.6:0/1536486381 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T09:59:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.976+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904581a00 0x562904592070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a9effd700 1 -- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904581a00 msgr2=0x562904592070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a9effd700 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904581a00 0x562904592070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a9effd700 1 -- 172.21.15.6:0/1536486381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 msgr2=0x56290458f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T09:59:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a9effd700 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x56290458f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a9effd700 1 -- 172.21.15.6:0/1536486381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629044eb7a0 con 0x562904582700 2023-09-13T09:59:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a9ffff700 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x56290458f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T09:59:33.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a9effd700 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904582700 0x56290458eb10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400cfb0 tx=0x7f4a94009480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48841b3c1020e453 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T09:59:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a7effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T09:59:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a7effd700 1 -- 172.21.15.6:0/1536486381 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940b1040 con 0x562904582700 2023-09-13T09:59:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a7effd700 1 -- 172.21.15.6:0/1536486381 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a940a1790 con 0x562904582700 2023-09-13T09:59:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a90015040 con 0x562904582700 2023-09-13T09:59:33.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4a7effd700 1 -- 172.21.15.6:0/1536486381 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a94097ac0 con 0x562904582700 2023-09-13T09:59:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4ab1e13b80 10 client.29938 fetch_fsmap learned FSMap version 66 2023-09-13T09:59:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.977+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5629042e8c60 con 0x562904582700 2023-09-13T09:59:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4a7effd700 1 -- 172.21.15.6:0/1536486381 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a90015040 con 0x562904582700 2023-09-13T09:59:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4a7effd700 1 -- 172.21.15.6:0/1536486381 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 66) v1 ==== 7898+0+0 (secure 0 0 0) 0x7f4a9409d120 con 0x562904582700 2023-09-13T09:59:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4ab1e13b80 10 client.29938 fetch_fsmap finished waiting for FSMap version 66 2023-09-13T09:59:33.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4ab1e13b80 10 client.29938 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T09:59:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4ab1e13b80 20 client.29938 populate_metadata read hostname 'smithi006' 2023-09-13T09:59:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5629045ec340 0x5629045ee760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T09:59:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4ab1e13b80 4 client.29938 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T09:59:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56290448d050 con 0x5629045ec340 2023-09-13T09:59:33.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.980+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5629045ec340 0x5629045ee760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T09:59:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4a9f7fe700 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5629045ec340 0x5629045ee760 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=145a6da8a84142bc server_cookie=3184657e10358683 in_seq=0 out_seq=0 2023-09-13T09:59:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4a7effd700 10 client.29938 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4a7effd700 1 -- 172.21.15.6:0/1536486381 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x56290448d050 con 0x5629045ec340 2023-09-13T09:59:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4a7effd700 10 client.29938 handle_command_reply: tid=0 2023-09-13T09:59:33.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 client.29938 shutdown 2023-09-13T09:59:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904582700 msgr2=0x56290458eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904582700 0x56290458eb10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400cfb0 tx=0x7f4a94009480 comp rx=0 tx=0).stop 2023-09-13T09:59:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 shutdown_connections 2023-09-13T09:59:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5629045ec340 0x5629045ee760 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x562904583060 0x56290458f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x562904581a00 0x562904592070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4a7effd700 0 client.29938 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T09:59:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 --2- 172.21.15.6:0/1536486381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x562904582700 0x56290458eb10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.981+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 >> 172.21.15.6:0/1536486381 conn(0x5629044dfc80 msgr2=0x562904585980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 shutdown_connections 2023-09-13T09:59:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4ab1e13b80 1 -- 172.21.15.6:0/1536486381 wait complete. 2023-09-13T09:59:33.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4ab1e13b80 20 client.29938 trim_cache size 0 max 16384 2023-09-13T09:59:33.994 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T09:59:33.994 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (0 inodes in the stack)", 2023-09-13T09:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T09:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout: "cbda86dd-3b24-4bbe-92a0-3431d4ccb883": { 2023-09-13T09:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T09:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "cbda86dd-3b24-4bbe-92a0-3431d4ccb883", 2023-09-13T09:59:33.995 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T09:59:33.996 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:59:33.996 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T09:59:33.996 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T09:59:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a880a0640 msgr2=0x7f4a880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a880a0640 0x7f4a880a2b00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4a9000f5b0 tx=0x7f4a9000f8b0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 msgr2=0x7f4aa0197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T09:59:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 0x7f4aa0197080 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400e9f0 tx=0x7f4a9400ed00 comp rx=0 tx=0).stop 2023-09-13T09:59:33.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 shutdown_connections 2023-09-13T09:59:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4aa0102950 0x7f4aa019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a880a0640 0x7f4a880a2b00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4aa0100dc0 0x7f4aa0196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 --2- 172.21.15.6:0/2544428617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4aa0101fb0 0x7f4aa0197080 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T09:59:33.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.982+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 >> 172.21.15.6:0/2544428617 conn(0x7f4aa00fc350 msgr2=0x7f4aa00fe560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T09:59:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.983+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 shutdown_connections 2023-09-13T09:59:33.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T09:59:33.983+0000 7f4aa5c2e700 1 -- 172.21.15.6:0/2544428617 wait complete. 2023-09-13T09:59:34.000 INFO:tasks.cephfs.filesystem:scrub status for tag:cbda86dd-3b24-4bbe-92a0-3431d4ccb883 - {'path': '/', 'tag': 'cbda86dd-3b24-4bbe-92a0-3431d4ccb883', 'options': 'recursive,force'} 2023-09-13T09:59:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:34 smithi006 ceph-mon[98665]: pgmap v901: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 594 op/s 2023-09-13T09:59:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:34 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:34.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:34 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:34.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:34 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:34.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:34 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:34 smithi053 ceph-mon[102373]: pgmap v901: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 594 op/s 2023-09-13T09:59:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:34 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:34 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:34 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:34 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:34.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:34 smithi131 ceph-mon[102785]: pgmap v901: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 5.6 MiB/s wr, 594 op/s 2023-09-13T09:59:34.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:34 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:34.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:34 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:34.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:34 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:34.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:34 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:34.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 278507 35.16 MB/sec execute 294 sec latency 66.161 ms 2023-09-13T09:59:35.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T09:59:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T09:59:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:35 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T09:59:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T09:59:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:35 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T09:59:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T09:59:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:35 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T09:59:35.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 279364 35.21 MB/sec execute 295 sec latency 52.613 ms 2023-09-13T09:59:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:36 smithi006 ceph-mon[98665]: pgmap v902: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 503 op/s 2023-09-13T09:59:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:36 smithi053 ceph-mon[102373]: pgmap v902: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 503 op/s 2023-09-13T09:59:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:36 smithi131 ceph-mon[102785]: pgmap v902: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 503 op/s 2023-09-13T09:59:36.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 280263 35.27 MB/sec execute 296 sec latency 46.870 ms 2023-09-13T09:59:37.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 280766 35.23 MB/sec execute 297 sec latency 239.277 ms 2023-09-13T09:59:38.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:38 smithi006 ceph-mon[98665]: pgmap v903: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 539 op/s 2023-09-13T09:59:38.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:38 smithi131 ceph-mon[102785]: pgmap v903: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 539 op/s 2023-09-13T09:59:38.590 INFO:tasks.workunit.client.0.smithi006.stdout: 10 280850 35.13 MB/sec execute 298 sec latency 798.760 ms 2023-09-13T09:59:38.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:38 smithi053 ceph-mon[102373]: pgmap v903: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.9 MiB/s wr, 539 op/s 2023-09-13T09:59:39.592 INFO:tasks.workunit.client.0.smithi006.stdout: 10 281093 35.07 MB/sec execute 299 sec latency 668.026 ms 2023-09-13T09:59:39.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:39 smithi006 ceph-mon[98665]: pgmap v904: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 534 op/s 2023-09-13T09:59:39.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:39 smithi053 ceph-mon[102373]: pgmap v904: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 534 op/s 2023-09-13T09:59:39.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:39 smithi131 ceph-mon[102785]: pgmap v904: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 534 op/s 2023-09-13T09:59:40.592 INFO:tasks.workunit.client.0.smithi006.stdout: 10 281479 35.00 MB/sec execute 300 sec latency 117.358 ms 2023-09-13T09:59:41.592 INFO:tasks.workunit.client.0.smithi006.stdout: 10 282175 34.99 MB/sec execute 301 sec latency 71.198 ms 2023-09-13T09:59:42.006 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:41 smithi006 ceph-mon[98665]: pgmap v905: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 552 op/s 2023-09-13T09:59:42.007 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:41 smithi053 ceph-mon[102373]: pgmap v905: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 552 op/s 2023-09-13T09:59:42.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:41 smithi131 ceph-mon[102785]: pgmap v905: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 552 op/s 2023-09-13T09:59:42.592 INFO:tasks.workunit.client.0.smithi006.stdout: 10 283038 35.06 MB/sec execute 302 sec latency 55.977 ms 2023-09-13T09:59:43.592 INFO:tasks.workunit.client.0.smithi006.stdout: 10 283668 35.06 MB/sec execute 303 sec latency 69.878 ms 2023-09-13T09:59:44.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:43 smithi006 ceph-mon[98665]: pgmap v906: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 761 op/s 2023-09-13T09:59:44.258 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:43 smithi053 ceph-mon[102373]: pgmap v906: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 761 op/s 2023-09-13T09:59:44.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:43 smithi131 ceph-mon[102785]: pgmap v906: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 13 MiB/s wr, 761 op/s 2023-09-13T09:59:44.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 284191 35.04 MB/sec execute 304 sec latency 73.504 ms 2023-09-13T09:59:45.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:45.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:45.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:45.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:44 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:45.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:45.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:45.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:45.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:44 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:45.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:44 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:45.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 284814 35.01 MB/sec execute 305 sec latency 75.996 ms 2023-09-13T09:59:46.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:46 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T09:59:46.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:46 smithi006 ceph-mon[98665]: pgmap v907: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 834 op/s 2023-09-13T09:59:46.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:46 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:59:46.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:46 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T09:59:46.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:46 smithi053 ceph-mon[102373]: pgmap v907: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 834 op/s 2023-09-13T09:59:46.261 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:46 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:59:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:46 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T09:59:46.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:46 smithi131 ceph-mon[102785]: pgmap v907: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 834 op/s 2023-09-13T09:59:46.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:46 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T09:59:46.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 285483 34.99 MB/sec execute 306 sec latency 156.657 ms 2023-09-13T09:59:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:47 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:59:47.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:47 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:59:47.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:47 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:59:47.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:47 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:59:47.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:47 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:59:47.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:47 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:59:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:47 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T09:59:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:47 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T09:59:47.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:47 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T09:59:47.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 286262 35.05 MB/sec execute 307 sec latency 77.565 ms 2023-09-13T09:59:48.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:48 smithi006 ceph-mon[98665]: pgmap v908: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 867 op/s 2023-09-13T09:59:48.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:48 smithi053 ceph-mon[102373]: pgmap v908: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 867 op/s 2023-09-13T09:59:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:48 smithi131 ceph-mon[102785]: pgmap v908: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 867 op/s 2023-09-13T09:59:48.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 286950 35.07 MB/sec execute 308 sec latency 56.287 ms 2023-09-13T09:59:49.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:49 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:59:49.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:49 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:59:49.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:49 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:59:49.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 287458 35.05 MB/sec execute 309 sec latency 70.147 ms 2023-09-13T09:59:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:50 smithi006 ceph-mon[98665]: pgmap v909: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 804 op/s 2023-09-13T09:59:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:50 smithi053 ceph-mon[102373]: pgmap v909: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 804 op/s 2023-09-13T09:59:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:50 smithi131 ceph-mon[102785]: pgmap v909: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 14 MiB/s wr, 804 op/s 2023-09-13T09:59:50.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 288014 35.01 MB/sec execute 310 sec latency 78.252 ms 2023-09-13T09:59:51.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 288688 35.01 MB/sec execute 311 sec latency 120.422 ms 2023-09-13T09:59:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:52 smithi006 ceph-mon[98665]: pgmap v910: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 721 op/s 2023-09-13T09:59:52.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:52 smithi053 ceph-mon[102373]: pgmap v910: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 721 op/s 2023-09-13T09:59:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:52 smithi131 ceph-mon[102785]: pgmap v910: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 721 op/s 2023-09-13T09:59:52.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 289397 35.03 MB/sec execute 312 sec latency 152.271 ms 2023-09-13T09:59:53.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 290053 35.01 MB/sec execute 313 sec latency 49.255 ms 2023-09-13T09:59:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:54 smithi006 ceph-mon[98665]: pgmap v911: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 794 op/s 2023-09-13T09:59:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:54 smithi053 ceph-mon[102373]: pgmap v911: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 794 op/s 2023-09-13T09:59:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:54 smithi131 ceph-mon[102785]: pgmap v911: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 794 op/s 2023-09-13T09:59:54.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 290760 35.05 MB/sec execute 314 sec latency 66.563 ms 2023-09-13T09:59:55.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 291458 35.05 MB/sec execute 315 sec latency 62.708 ms 2023-09-13T09:59:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:56 smithi006 ceph-mon[98665]: pgmap v912: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.6 MiB/s wr, 639 op/s 2023-09-13T09:59:56.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:56 smithi053 ceph-mon[102373]: pgmap v912: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.6 MiB/s wr, 639 op/s 2023-09-13T09:59:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:56 smithi131 ceph-mon[102785]: pgmap v912: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 5.6 MiB/s wr, 639 op/s 2023-09-13T09:59:56.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 292053 35.07 MB/sec execute 316 sec latency 72.834 ms 2023-09-13T09:59:57.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 292505 35.01 MB/sec execute 317 sec latency 72.627 ms 2023-09-13T09:59:58.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:58 smithi006 ceph-mon[98665]: pgmap v913: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 551 op/s 2023-09-13T09:59:58.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:58 smithi053 ceph-mon[102373]: pgmap v913: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 551 op/s 2023-09-13T09:59:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:58 smithi131 ceph-mon[102785]: pgmap v913: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 551 op/s 2023-09-13T09:59:58.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 293123 34.98 MB/sec execute 318 sec latency 91.958 ms 2023-09-13T09:59:59.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 09:59:59 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:59:59.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 09:59:59 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:59:59.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 09:59:59 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T09:59:59.594 INFO:tasks.workunit.client.0.smithi006.stdout: 10 293834 34.98 MB/sec execute 319 sec latency 58.940 ms 2023-09-13T10:00:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:00 smithi006 ceph-mon[98665]: pgmap v914: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 472 op/s 2023-09-13T10:00:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:00 smithi006 ceph-mon[98665]: overall HEALTH_OK 2023-09-13T10:00:00.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:00 smithi053 ceph-mon[102373]: pgmap v914: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 472 op/s 2023-09-13T10:00:00.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:00 smithi053 ceph-mon[102373]: overall HEALTH_OK 2023-09-13T10:00:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:00 smithi131 ceph-mon[102785]: pgmap v914: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 472 op/s 2023-09-13T10:00:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:00 smithi131 ceph-mon[102785]: overall HEALTH_OK 2023-09-13T10:00:00.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 294673 35.03 MB/sec execute 320 sec latency 65.025 ms 2023-09-13T10:00:01.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 295321 35.07 MB/sec execute 321 sec latency 61.414 ms 2023-09-13T10:00:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:02 smithi006 ceph-mon[98665]: pgmap v915: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2023-09-13T10:00:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:02 smithi053 ceph-mon[102373]: pgmap v915: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2023-09-13T10:00:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:02 smithi131 ceph-mon[102785]: pgmap v915: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 480 op/s 2023-09-13T10:00:02.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 295725 35.00 MB/sec execute 322 sec latency 62.766 ms 2023-09-13T10:00:03.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 296239 34.97 MB/sec execute 323 sec latency 62.480 ms 2023-09-13T10:00:04.001 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:00:04.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 -- 172.21.15.6:0/463554204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7efc101820 msgr2=0x7f7efc1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/463554204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7efc101820 0x7f7efc1080d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009fc0 tx=0x7f7ef400b330 comp rx=0 tx=0).stop 2023-09-13T10:00:04.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 -- 172.21.15.6:0/463554204 shutdown_connections 2023-09-13T10:00:04.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/463554204 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7efc101820 0x7f7efc1080d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/463554204 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7efc0ffc90 0x7f7efc1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/463554204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 0x7f7efc1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 -- 172.21.15.6:0/463554204 >> 172.21.15.6:0/463554204 conn(0x7f7efc0fb220 msgr2=0x7f7efc0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 -- 172.21.15.6:0/463554204 shutdown_connections 2023-09-13T10:00:04.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.156+0000 7f7f02d6a700 1 -- 172.21.15.6:0/463554204 wait complete. 2023-09-13T10:00:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 Processor -- start 2023-09-13T10:00:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 -- start start 2023-09-13T10:00:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7efc0ffc90 0x7f7efc06f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 0x7f7efc06da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7efc101820 0x7f7efc06df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc1b4200 con 0x7f7efc100e80 2023-09-13T10:00:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc06e4c0 con 0x7f7efc101820 2023-09-13T10:00:04.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.157+0000 7f7f02d6a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7efc06e680 con 0x7f7efc0ffc90 2023-09-13T10:00:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 0x7f7efc06da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7efc0ffc90 0x7f7efc06f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 0x7f7efc06da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46532/0 (socket says 172.21.15.6:46532) 2023-09-13T10:00:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7efc0ffc90 0x7f7efc06f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49584/0 (socket says 172.21.15.6:49584) 2023-09-13T10:00:04.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 -- 172.21.15.6:0/289159174 learned_addr learned my addr 172.21.15.6:0/289159174 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 -- 172.21.15.6:0/289159174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7efc0ffc90 msgr2=0x7f7efc06f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7efc0ffc90 0x7f7efc06f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 -- 172.21.15.6:0/289159174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7efc101820 msgr2=0x7f7efc06df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7efc101820 0x7f7efc06df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 -- 172.21.15.6:0/289159174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80095f0 con 0x7f7efc100e80 2023-09-13T10:00:04.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7efbfff700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 0x7f7efc06da40 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800ec10 tx=0x7f7ee800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.158+0000 7f7ef9ffb700 1 -- 172.21.15.6:0/289159174 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee800cd40 con 0x7f7efc100e80 2023-09-13T10:00:04.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.159+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef4009c40 con 0x7f7efc100e80 2023-09-13T10:00:04.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.159+0000 7f7ef9ffb700 1 -- 172.21.15.6:0/289159174 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ee80044e0 con 0x7f7efc100e80 2023-09-13T10:00:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.159+0000 7f7ef9ffb700 1 -- 172.21.15.6:0/289159174 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8010690 con 0x7f7efc100e80 2023-09-13T10:00:04.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.159+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7efc1beea0 con 0x7f7efc100e80 2023-09-13T10:00:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.163+0000 7f7ef9ffb700 1 -- 172.21.15.6:0/289159174 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7ee8003710 con 0x7f7efc100e80 2023-09-13T10:00:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.163+0000 7f7f0ef4fb80 1 Processor -- start 2023-09-13T10:00:04.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.164+0000 7f7ef9ffb700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7eec0a0630 0x7f7eec0a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.164+0000 7f7ef9ffb700 1 -- 172.21.15.6:0/289159174 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ee8014070 con 0x7f7efc100e80 2023-09-13T10:00:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f0ef4fb80 1 -- start start 2023-09-13T10:00:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f01307700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7eec0a0630 0x7f7eec0a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x55925565bb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x55925565a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592555b3780 con 0x55925565c060 2023-09-13T10:00:04.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592555b10a0 con 0x55925565aa00 2023-09-13T10:00:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.165+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592555ac990 con 0x55925565b700 2023-09-13T10:00:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x55925565bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x55925565bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49592/0 (socket says 172.21.15.6:49592) 2023-09-13T10:00:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 -- 172.21.15.6:0/1525426341 learned_addr learned my addr 172.21.15.6:0/1525426341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7efbfff700 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x55925565a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f01307700 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 -- 172.21.15.6:0/1525426341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 msgr2=0x55925565ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 -- 172.21.15.6:0/1525426341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 msgr2=0x55925565a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x55925565a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 -- 172.21.15.6:0/1525426341 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55925542c630 con 0x55925565b700 2023-09-13T10:00:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7efbfff700 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x55925565a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:00:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f01307700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7eec0a0630 0x7f7eec0a2af0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009550 tx=0x7f7ef4007740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x55925565bb20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009d30 tx=0x7f7ef0011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1185dc67107abe66 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7ee6ffd700 1 -- 172.21.15.6:0/1525426341 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0004220 con 0x55925565b700 2023-09-13T10:00:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7ee6ffd700 1 -- 172.21.15.6:0/1525426341 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ef0004380 con 0x55925565b700 2023-09-13T10:00:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.166+0000 7f7ee6ffd700 1 -- 172.21.15.6:0/1525426341 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00197f0 con 0x55925565b700 2023-09-13T10:00:04.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.167+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1525426341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 msgr2=0x55925565bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.167+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x55925565bb20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009d30 tx=0x7f7ef0011720 comp rx=0 tx=0).stop 2023-09-13T10:00:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.169+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1525426341 shutdown_connections 2023-09-13T10:00:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.169+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.169+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x55925565bb20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.169+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1525426341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x55925565a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.169+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1525426341 >> 172.21.15.6:0/1525426341 conn(0x5592555b8c80 msgr2=0x559255654f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.171+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1525426341 shutdown_connections 2023-09-13T10:00:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.172+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1525426341 wait complete. 2023-09-13T10:00:04.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.172+0000 7f7f0ef4fb80 1 -- start start 2023-09-13T10:00:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.172+0000 7f7f0ef4fb80 1 Processor -- start 2023-09-13T10:00:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565aa00 0x559255663ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x559255664400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565c060 0x55925566b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55925554abb0 con 0x55925565aa00 2023-09-13T10:00:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55925554a8b0 con 0x55925565c060 2023-09-13T10:00:04.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55925542e920 con 0x55925565b700 2023-09-13T10:00:04.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f0ef4fb80 10 client.0 _ll_register_callbacks cb 0x559255548680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:04.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f01307700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565c060 0x55925566b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f01307700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565c060 0x55925566b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40068/0 (socket says 172.21.15.6:40068) 2023-09-13T10:00:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f01307700 1 -- 172.21.15.6:0/1524464276 learned_addr learned my addr 172.21.15.6:0/1524464276 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7efbfff700 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x559255664400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f01307700 1 -- 172.21.15.6:0/1524464276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 msgr2=0x559255664400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f01307700 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x559255664400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f01307700 1 -- 172.21.15.6:0/1524464276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565aa00 msgr2=0x559255663ec0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:00:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.173+0000 7f7f01307700 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565aa00 0x559255663ec0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.174+0000 7f7f01307700 1 -- 172.21.15.6:0/1524464276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef0009960 con 0x55925565c060 2023-09-13T10:00:04.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.174+0000 7f7f01307700 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565c060 0x55925566b440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4015000 tx=0x7f7ef400b680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80fa8464fa2c0264 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.174+0000 7f7edbfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:00:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.174+0000 7f7edbfff700 1 -- 172.21.15.6:0/1524464276 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400e070 con 0x55925565c060 2023-09-13T10:00:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.174+0000 7f7edbfff700 1 -- 172.21.15.6:0/1524464276 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ef400be00 con 0x55925565c060 2023-09-13T10:00:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.174+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55925564d670 con 0x55925565c060 2023-09-13T10:00:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7edbfff700 1 -- 172.21.15.6:0/1524464276 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ef4008030 con 0x55925565c060 2023-09-13T10:00:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 10 client.29963 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5592555c47a0 con 0x55925565c060 2023-09-13T10:00:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7edbfff700 1 -- 172.21.15.6:0/1524464276 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ef4039080 con 0x55925565c060 2023-09-13T10:00:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7edbfff700 1 -- 172.21.15.6:0/1524464276 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7ef401f670 con 0x55925565c060 2023-09-13T10:00:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 10 client.29963 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 10 client.29963 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 20 client.29963 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55925566fd40 0x559255672160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 4 client.29963 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.175+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592555a5970 con 0x55925566fd40 2023-09-13T10:00:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.182+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55925566fd40 0x559255672160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.183+0000 7f7edbfff700 10 client.29963 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:04.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.183+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55925566fd40 0x559255672160 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35c7681295e6474f server_cookie=c09eb6e7657c69d7 in_seq=0 out_seq=0 2023-09-13T10:00:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7edbfff700 1 -- 172.21.15.6:0/1524464276 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5592555a5970 con 0x55925566fd40 2023-09-13T10:00:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7edbfff700 10 client.29963 handle_command_reply: tid=0 2023-09-13T10:00:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 client.29963 shutdown 2023-09-13T10:00:04.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565c060 msgr2=0x55925566b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565c060 0x55925566b440 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4015000 tx=0x7f7ef400b680 comp rx=0 tx=0).stop 2023-09-13T10:00:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 shutdown_connections 2023-09-13T10:00:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565c060 0x55925566b440 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55925566fd40 0x559255672160 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565aa00 0x559255663ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7edbfff700 0 client.29963 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1524464276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565b700 0x559255664400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.184+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 >> 172.21.15.6:0/1524464276 conn(0x5592555b8c80 msgr2=0x559255654ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.185+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 shutdown_connections 2023-09-13T10:00:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.185+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1524464276 wait complete. 2023-09-13T10:00:04.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.185+0000 7f7f0ef4fb80 20 client.29963 trim_cache size 0 max 16384 2023-09-13T10:00:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.204+0000 7f7f0ef4fb80 1 Processor -- start 2023-09-13T10:00:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.204+0000 7f7f0ef4fb80 1 -- start start 2023-09-13T10:00:04.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565b700 0x55925566b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565c060 0x55925565e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559255663a90 con 0x55925565b700 2023-09-13T10:00:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559255661af0 con 0x55925565aa00 2023-09-13T10:00:04.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55925565f3e0 con 0x55925565c060 2023-09-13T10:00:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40074/0 (socket says 172.21.15.6:40074) 2023-09-13T10:00:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f00b06700 1 -- 172.21.15.6:0/3476623287 learned_addr learned my addr 172.21.15.6:0/3476623287 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f01307700 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565c060 0x55925565e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f01307700 1 -- 172.21.15.6:0/3476623287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 msgr2=0x55925565a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f01307700 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f01307700 1 -- 172.21.15.6:0/3476623287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565b700 msgr2=0x55925566b400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:00:04.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f01307700 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565b700 0x55925566b400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f01307700 1 -- 172.21.15.6:0/3476623287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592553d8de0 con 0x55925565c060 2023-09-13T10:00:04.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.205+0000 7f7f00b06700 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.206+0000 7f7f01307700 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565c060 0x55925565e880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4004d10 tx=0x7f7ef40060c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f25b665ed3ea5bd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.206+0000 7f7ee77fe700 1 -- 172.21.15.6:0/3476623287 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef400e070 con 0x55925565c060 2023-09-13T10:00:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.206+0000 7f7ee77fe700 1 -- 172.21.15.6:0/3476623287 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55925564d670 con 0x55925565c060 2023-09-13T10:00:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.206+0000 7f7ee77fe700 1 -- 172.21.15.6:0/3476623287 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef4008290 con 0x55925565c060 2023-09-13T10:00:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/3476623287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565c060 msgr2=0x55925565e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565c060 0x55925565e880 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4004d10 tx=0x7f7ef40060c0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/3476623287 shutdown_connections 2023-09-13T10:00:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565c060 0x55925565e880 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565aa00 0x55925565a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/3476623287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565b700 0x55925566b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/3476623287 >> 172.21.15.6:0/3476623287 conn(0x5592555b8c80 msgr2=0x559255661d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/3476623287 shutdown_connections 2023-09-13T10:00:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/3476623287 wait complete. 2023-09-13T10:00:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 -- start start 2023-09-13T10:00:04.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.207+0000 7f7f0ef4fb80 1 Processor -- start 2023-09-13T10:00:04.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565aa00 0x55925566af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565b700 0x559255667a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f0ef4fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x559255667f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559255668640 con 0x55925565c060 2023-09-13T10:00:04.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55925566b600 con 0x55925565b700 2023-09-13T10:00:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f0ef4fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55925566b790 con 0x55925565aa00 2023-09-13T10:00:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f0ef4fb80 10 client.0 _ll_register_callbacks cb 0x559255548680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565aa00 0x55925566af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565aa00 0x55925566af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49608/0 (socket says 172.21.15.6:49608) 2023-09-13T10:00:04.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 -- 172.21.15.6:0/1315831811 learned_addr learned my addr 172.21.15.6:0/1315831811 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f01307700 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x559255667f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7efbfff700 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565b700 0x559255667a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 -- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565b700 msgr2=0x559255667a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565b700 0x559255667a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 -- 172.21.15.6:0/1315831811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 msgr2=0x559255667f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x559255667f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.208+0000 7f7f00b06700 1 -- 172.21.15.6:0/1315831811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55925542c630 con 0x55925565aa00 2023-09-13T10:00:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f00b06700 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565aa00 0x55925566af80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0000c00 tx=0x7f7ef0005bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb5677ebc65ff01b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7edbfff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7edbfff700 1 -- 172.21.15.6:0/1315831811 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0029d00 con 0x55925565aa00 2023-09-13T10:00:04.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7edbfff700 1 -- 172.21.15.6:0/1315831811 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7ef0029120 con 0x55925565aa00 2023-09-13T10:00:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ef0004380 con 0x55925565aa00 2023-09-13T10:00:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7edbfff700 1 -- 172.21.15.6:0/1315831811 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ef0029e60 con 0x55925565aa00 2023-09-13T10:00:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 10 client.29956 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5592555c47a0 con 0x55925565aa00 2023-09-13T10:00:04.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7edbfff700 1 -- 172.21.15.6:0/1315831811 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7ef0004380 con 0x55925565aa00 2023-09-13T10:00:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7edbfff700 1 -- 172.21.15.6:0/1315831811 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f7ef0011440 con 0x55925565aa00 2023-09-13T10:00:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 10 client.29956 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 10 client.29956 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 20 client.29956 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:04.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5592556c52c0 0x5592556c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 4 client.29956 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:00:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.209+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559255566050 con 0x5592556c52c0 2023-09-13T10:00:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.210+0000 7f7efbfff700 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5592556c52c0 0x5592556c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.212+0000 7f7edbfff700 10 client.29956 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:04.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.212+0000 7f7efbfff700 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5592556c52c0 0x5592556c76e0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3a73883c044c88 server_cookie=7daf0e3fe8e6a7aa in_seq=0 out_seq=0 2023-09-13T10:00:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.213+0000 7f7edbfff700 1 -- 172.21.15.6:0/1315831811 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559255566050 con 0x5592556c52c0 2023-09-13T10:00:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.213+0000 7f7edbfff700 10 client.29956 handle_command_reply: tid=0 2023-09-13T10:00:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.213+0000 7f7f0ef4fb80 1 client.29956 shutdown 2023-09-13T10:00:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.213+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565aa00 msgr2=0x55925566af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.213+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565aa00 0x55925566af80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0000c00 tx=0x7f7ef0005bd0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 shutdown_connections 2023-09-13T10:00:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5592556c52c0 0x5592556c76e0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55925565c060 0x559255667f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55925565aa00 0x55925566af80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7edbfff700 0 client.29956 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 --2- 172.21.15.6:0/1315831811 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55925565b700 0x559255667a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 >> 172.21.15.6:0/1315831811 conn(0x5592555b8c80 msgr2=0x55925565e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 shutdown_connections 2023-09-13T10:00:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.216+0000 7f7f0ef4fb80 1 -- 172.21.15.6:0/1315831811 wait complete. 2023-09-13T10:00:04.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f0ef4fb80 20 client.29956 trim_cache size 0 max 16384 2023-09-13T10:00:04.229 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:00:04.229 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T10:00:04.229 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T10:00:04.230 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:00:04.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7eec0a0630 msgr2=0x7f7eec0a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7eec0a0630 0x7f7eec0a2af0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f7ef4009550 tx=0x7f7ef4007740 comp rx=0 tx=0).stop 2023-09-13T10:00:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 msgr2=0x7f7efc06da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 0x7f7efc06da40 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800ec10 tx=0x7f7ee800ef20 comp rx=0 tx=0).stop 2023-09-13T10:00:04.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 shutdown_connections 2023-09-13T10:00:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7efc101820 0x7f7efc06df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7efc0ffc90 0x7f7efc06f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f7eec0a0630 0x7f7eec0a2af0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 --2- 172.21.15.6:0/289159174 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7efc100e80 0x7f7efc06da40 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 >> 172.21.15.6:0/289159174 conn(0x7f7efc0fb220 msgr2=0x7f7efc0fba00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 shutdown_connections 2023-09-13T10:00:04.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.217+0000 7f7f02d6a700 1 -- 172.21.15.6:0/289159174 wait complete. 2023-09-13T10:00:04.234 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T10:00:04.234 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:00:04.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.406+0000 7fc473930700 1 -- 172.21.15.6:0/3330239394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 msgr2=0x7fc46c101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.406+0000 7fc473930700 1 --2- 172.21.15.6:0/3330239394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c101300 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fc45c0099c0 tx=0x7fc45c009cd0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.406+0000 7fc473930700 1 -- 172.21.15.6:0/3330239394 shutdown_connections 2023-09-13T10:00:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.406+0000 7fc473930700 1 --2- 172.21.15.6:0/3330239394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc46c101840 0x7fc46c1080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.406+0000 7fc473930700 1 --2- 172.21.15.6:0/3330239394 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc46c0ffcb0 0x7fc46c1000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.406+0000 7fc473930700 1 --2- 172.21.15.6:0/3330239394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c101300 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.406+0000 7fc473930700 1 -- 172.21.15.6:0/3330239394 >> 172.21.15.6:0/3330239394 conn(0x7fc46c0fb220 msgr2=0x7fc46c0fd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.407+0000 7fc473930700 1 -- 172.21.15.6:0/3330239394 shutdown_connections 2023-09-13T10:00:04.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.407+0000 7fc473930700 1 -- 172.21.15.6:0/3330239394 wait complete. 2023-09-13T10:00:04.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.407+0000 7fc473930700 1 Processor -- start 2023-09-13T10:00:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc473930700 1 -- start start 2023-09-13T10:00:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc473930700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c10b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc473930700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc46c101840 0x7fc46c109cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc473930700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc46c10a1f0 0x7fc46c10a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc473930700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c1a0de0 con 0x7fc46c100ea0 2023-09-13T10:00:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc473930700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c1a0f50 con 0x7fc46c10a1f0 2023-09-13T10:00:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc473930700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c1a1110 con 0x7fc46c101840 2023-09-13T10:00:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc4716cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c10b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc4716cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c10b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46566/0 (socket says 172.21.15.6:46566) 2023-09-13T10:00:04.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc4716cc700 1 -- 172.21.15.6:0/286014533 learned_addr learned my addr 172.21.15.6:0/286014533 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc470ecb700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc46c101840 0x7fc46c109cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.408+0000 7fc471ecd700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc46c10a1f0 0x7fc46c10a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4716cc700 1 -- 172.21.15.6:0/286014533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc46c101840 msgr2=0x7fc46c109cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4716cc700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc46c101840 0x7fc46c109cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4716cc700 1 -- 172.21.15.6:0/286014533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc46c10a1f0 msgr2=0x7fc46c10a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4716cc700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc46c10a1f0 0x7fc46c10a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4716cc700 1 -- 172.21.15.6:0/286014533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c0095f0 con 0x7fc46c100ea0 2023-09-13T10:00:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4716cc700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c10b670 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fc468006fd0 tx=0x7fc46800b730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4627fc700 1 -- 172.21.15.6:0/286014533 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46800be30 con 0x7fc46c100ea0 2023-09-13T10:00:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c1a13f0 con 0x7fc46c100ea0 2023-09-13T10:00:04.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c1a1950 con 0x7fc46c100ea0 2023-09-13T10:00:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4627fc700 1 -- 172.21.15.6:0/286014533 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc468011af0 con 0x7fc46c100ea0 2023-09-13T10:00:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.409+0000 7fc4627fc700 1 -- 172.21.15.6:0/286014533 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc468019a10 con 0x7fc46c100ea0 2023-09-13T10:00:04.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.410+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc450005320 con 0x7fc46c100ea0 2023-09-13T10:00:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.412+0000 7fc4627fc700 1 -- 172.21.15.6:0/286014533 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc468011c60 con 0x7fc46c100ea0 2023-09-13T10:00:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.412+0000 7fc4627fc700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4580a0640 0x7fc4580a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.412+0000 7fc4627fc700 1 -- 172.21.15.6:0/286014533 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc4680cb6a0 con 0x7fc46c100ea0 2023-09-13T10:00:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.412+0000 7fc470ecb700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4580a0640 0x7fc4580a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.413+0000 7fc470ecb700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4580a0640 0x7fc4580a2b00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc45c000c00 tx=0x7fc45c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.418+0000 7fc4627fc700 1 -- 172.21.15.6:0/286014533 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc468095180 con 0x7fc46c100ea0 2023-09-13T10:00:04.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:04 smithi053 ceph-mon[102373]: pgmap v916: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 581 op/s 2023-09-13T10:00:04.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:04 smithi006 ceph-mon[98665]: pgmap v916: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 581 op/s 2023-09-13T10:00:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:04 smithi131 ceph-mon[102785]: pgmap v916: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 4.1 MiB/s wr, 581 op/s 2023-09-13T10:00:04.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 296949 34.98 MB/sec execute 324 sec latency 116.468 ms 2023-09-13T10:00:04.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.756+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4500058a0 con 0x7fc46c100ea0 2023-09-13T10:00:04.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.757+0000 7fc4627fc700 1 -- 172.21.15.6:0/286014533 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+11339 (secure 0 0 0) 0x7fc4680987a0 con 0x7fc46c100ea0 2023-09-13T10:00:04.757 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:00:04.758 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":68,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":68,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T09:59:57.571029+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[1,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:00:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.760+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4580a0640 msgr2=0x7fc4580a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.760+0000 7fc473930700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4580a0640 0x7fc4580a2b00 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc45c000c00 tx=0x7fc45c005fd0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.760+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 msgr2=0x7fc46c10b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.760+0000 7fc473930700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c10b670 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fc468006fd0 tx=0x7fc46800b730 comp rx=0 tx=0).stop 2023-09-13T10:00:04.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 shutdown_connections 2023-09-13T10:00:04.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc46c10a1f0 0x7fc46c10a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4580a0640 0x7fc4580a2b00 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c100ea0 0x7fc46c10b670 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 --2- 172.21.15.6:0/286014533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc46c101840 0x7fc46c109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 >> 172.21.15.6:0/286014533 conn(0x7fc46c0fb220 msgr2=0x7fc46c104480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 shutdown_connections 2023-09-13T10:00:04.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.761+0000 7fc473930700 1 -- 172.21.15.6:0/286014533 wait complete. 2023-09-13T10:00:04.764 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 68 2023-09-13T10:00:04.780 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T10:00:04.943 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 -- 172.21.15.6:0/856871398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f84108050 msgr2=0x7f9f84108470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 --2- 172.21.15.6:0/856871398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f84108050 0x7f9f84108470 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009990 tx=0x7f9f74009ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 -- 172.21.15.6:0/856871398 shutdown_connections 2023-09-13T10:00:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 --2- 172.21.15.6:0/856871398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f841097c0 0x7f9f84110050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 --2- 172.21.15.6:0/856871398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f84108050 0x7f9f84108470 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 --2- 172.21.15.6:0/856871398 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f84108e00 0x7f9f84109280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 -- 172.21.15.6:0/856871398 >> 172.21.15.6:0/856871398 conn(0x7f9f8406dc70 msgr2=0x7f9f840700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 -- 172.21.15.6:0/856871398 shutdown_connections 2023-09-13T10:00:04.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.942+0000 7f9f8a867700 1 -- 172.21.15.6:0/856871398 wait complete. 2023-09-13T10:00:04.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.943+0000 7f9f8a867700 1 Processor -- start 2023-09-13T10:00:04.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.943+0000 7f9f8a867700 1 -- start start 2023-09-13T10:00:04.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f8a867700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84108050 0x7f9f8419f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f8a867700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f84108e00 0x7f9f8419f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f8a867700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f841097c0 0x7f9f841a6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f8a867700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841a6e00 con 0x7f9f841097c0 2023-09-13T10:00:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f8a867700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841a6f40 con 0x7f9f84108e00 2023-09-13T10:00:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f8a867700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f841a70d0 con 0x7f9f84108050 2023-09-13T10:00:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84108050 0x7f9f8419f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84108050 0x7f9f8419f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49634/0 (socket says 172.21.15.6:49634) 2023-09-13T10:00:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 -- 172.21.15.6:0/2693562768 learned_addr learned my addr 172.21.15.6:0/2693562768 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f88e04700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f841097c0 0x7f9f841a6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f837fe700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f84108e00 0x7f9f8419f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 -- 172.21.15.6:0/2693562768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f84108e00 msgr2=0x7f9f8419f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f84108e00 0x7f9f8419f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 -- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f841097c0 msgr2=0x7f9f841a6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f841097c0 0x7f9f841a6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.944+0000 7f9f83fff700 1 -- 172.21.15.6:0/2693562768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f740095f0 con 0x7f9f84108050 2023-09-13T10:00:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.945+0000 7f9f83fff700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84108050 0x7f9f8419f280 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9f740059d0 tx=0x7f9f74004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.945+0000 7f9f817fa700 1 -- 172.21.15.6:0/2693562768 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7401d070 con 0x7f9f84108050 2023-09-13T10:00:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.945+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f841a7350 con 0x7f9f84108050 2023-09-13T10:00:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.945+0000 7f9f817fa700 1 -- 172.21.15.6:0/2693562768 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f7400fb90 con 0x7f9f84108050 2023-09-13T10:00:04.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.945+0000 7f9f817fa700 1 -- 172.21.15.6:0/2693562768 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f740173f0 con 0x7f9f84108050 2023-09-13T10:00:04.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.945+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f841a77d0 con 0x7f9f84108050 2023-09-13T10:00:04.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.948+0000 7f9f817fa700 1 -- 172.21.15.6:0/2693562768 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9f7400fd00 con 0x7f9f84108050 2023-09-13T10:00:04.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.949+0000 7f9f817fa700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9f6c0a06c0 0x7f9f6c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.949+0000 7f9f817fa700 1 -- 172.21.15.6:0/2693562768 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9f740cd020 con 0x7f9f84108050 2023-09-13T10:00:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.949+0000 7f9f837fe700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9f6c0a06c0 0x7f9f6c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 Processor -- start 2023-09-13T10:00:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f837fe700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9f6c0a06c0 0x7f9f6c0a2b80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009c60 tx=0x7f9f78009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 -- start start 2023-09-13T10:00:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae5b10 0x55799cae5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799cae48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 0x55799cae5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ca39780 con 0x55799cae6470 2023-09-13T10:00:04.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ca370a0 con 0x55799cae5b10 2023-09-13T10:00:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799ca32990 con 0x55799cae4e10 2023-09-13T10:00:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.950+0000 7f9f837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799cae48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799cae48d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46590/0 (socket says 172.21.15.6:46590) 2023-09-13T10:00:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 -- 172.21.15.6:0/1510057280 learned_addr learned my addr 172.21.15.6:0/1510057280 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 -- 172.21.15.6:0/1510057280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 msgr2=0x55799cae5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 --2- 172.21.15.6:0/1510057280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 0x55799cae5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 -- 172.21.15.6:0/1510057280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae5b10 msgr2=0x55799cae5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 --2- 172.21.15.6:0/1510057280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae5b10 0x55799cae5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 -- 172.21.15.6:0/1510057280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55799c8b2630 con 0x55799cae6470 2023-09-13T10:00:04.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f837fe700 1 --2- 172.21.15.6:0/1510057280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799cae48d0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e4e0 tx=0x7f9f78014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fe0a14da9b1510 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f6a7fc700 1 -- 172.21.15.6:0/1510057280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7800ee30 con 0x55799cae6470 2023-09-13T10:00:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f6a7fc700 1 -- 172.21.15.6:0/1510057280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f78021070 con 0x55799cae6470 2023-09-13T10:00:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.951+0000 7f9f6a7fc700 1 -- 172.21.15.6:0/1510057280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7801d8b0 con 0x55799cae6470 2023-09-13T10:00:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.952+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/1510057280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 msgr2=0x55799cae48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.952+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/1510057280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799cae48d0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f9f7800e4e0 tx=0x7f9f78014000 comp rx=0 tx=0).stop 2023-09-13T10:00:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.952+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/1510057280 shutdown_connections 2023-09-13T10:00:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.952+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/1510057280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 0x55799cae5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.952+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/1510057280 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae5b10 0x55799cae5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.952+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/1510057280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799cae48d0 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.952+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/1510057280 >> 172.21.15.6:0/1510057280 conn(0x55799ca3ec80 msgr2=0x55799cadaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.954+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/1510057280 shutdown_connections 2023-09-13T10:00:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.955+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/1510057280 wait complete. 2023-09-13T10:00:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.955+0000 7f9f96a4cb80 1 -- start start 2023-09-13T10:00:04.963 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.955+0000 7f9f96a4cb80 1 Processor -- start 2023-09-13T10:00:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 0x55799caee300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae5b10 0x55799caee840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae6470 0x55799caf5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799c9d0bb0 con 0x55799cae5b10 2023-09-13T10:00:04.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799c9d08b0 con 0x55799cae4e10 2023-09-13T10:00:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799c8b4920 con 0x55799cae6470 2023-09-13T10:00:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f96a4cb80 10 client.0 _ll_register_callbacks cb 0x55799c9ce680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae5b10 0x55799caee840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae5b10 0x55799caee840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46596/0 (socket says 172.21.15.6:46596) 2023-09-13T10:00:04.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 -- 172.21.15.6:0/19071790 learned_addr learned my addr 172.21.15.6:0/19071790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f88e04700 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae6470 0x55799caf5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 -- 172.21.15.6:0/19071790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae6470 msgr2=0x55799caf5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae6470 0x55799caf5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 -- 172.21.15.6:0/19071790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 msgr2=0x55799caee300 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:00:04.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 0x55799caee300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.956+0000 7f9f837fe700 1 -- 172.21.15.6:0/19071790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f78017070 con 0x55799cae5b10 2023-09-13T10:00:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f837fe700 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae5b10 0x55799caee840 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9f7801d480 tx=0x7f9f7800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4689102f06e80989 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f637fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f637fe700 1 -- 172.21.15.6:0/19071790 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780052d0 con 0x55799cae5b10 2023-09-13T10:00:04.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f637fe700 1 -- 172.21.15.6:0/19071790 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9f78005430 con 0x55799cae5b10 2023-09-13T10:00:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55799cad3670 con 0x55799cae5b10 2023-09-13T10:00:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f637fe700 1 -- 172.21.15.6:0/19071790 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f78005610 con 0x55799cae5b10 2023-09-13T10:00:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f96a4cb80 10 client.20784 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55799ca4a7a0 con 0x55799cae5b10 2023-09-13T10:00:04.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.957+0000 7f9f637fe700 1 -- 172.21.15.6:0/19071790 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f7803d080 con 0x55799cae5b10 2023-09-13T10:00:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f637fe700 1 -- 172.21.15.6:0/19071790 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9f78003a10 con 0x55799cae5b10 2023-09-13T10:00:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f96a4cb80 10 client.20784 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f96a4cb80 10 client.20784 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:00:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f96a4cb80 20 client.20784 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:04.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799caf9f90 0x55799cafc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f96a4cb80 4 client.20784 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55799ca2b970 con 0x55799caf9f90 2023-09-13T10:00:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.958+0000 7f9f83fff700 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799caf9f90 0x55799cafc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.960+0000 7f9f83fff700 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799caf9f90 0x55799cafc3b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ca40abc98e9d24b2 server_cookie=466e55d951d42a91 in_seq=0 out_seq=0 2023-09-13T10:00:04.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.961+0000 7f9f637fe700 10 client.20784 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.963+0000 7f9f637fe700 1 -- 172.21.15.6:0/19071790 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55799ca2b970 con 0x55799caf9f90 2023-09-13T10:00:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.963+0000 7f9f637fe700 10 client.20784 handle_command_reply: tid=0 2023-09-13T10:00:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.963+0000 7f9f96a4cb80 1 client.20784 shutdown 2023-09-13T10:00:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae5b10 msgr2=0x55799caee840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae5b10 0x55799caee840 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9f7801d480 tx=0x7f9f7800ed70 comp rx=0 tx=0).stop 2023-09-13T10:00:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 shutdown_connections 2023-09-13T10:00:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799caf9f90 0x55799cafc3b0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae6470 0x55799caf5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f637fe700 0 client.20784 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:04.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 0x55799caee300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/19071790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae5b10 0x55799caee840 secure :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f9f7801d480 tx=0x7f9f7800ed70 comp rx=0 tx=0).stop 2023-09-13T10:00:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.964+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 >> 172.21.15.6:0/19071790 conn(0x55799ca3ec80 msgr2=0x55799cad57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.965+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 shutdown_connections 2023-09-13T10:00:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.967+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/19071790 wait complete. 2023-09-13T10:00:04.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.967+0000 7f9f96a4cb80 20 client.20784 trim_cache size 0 max 16384 2023-09-13T10:00:04.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.991+0000 7f9f96a4cb80 1 Processor -- start 2023-09-13T10:00:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.991+0000 7f9f96a4cb80 1 -- start start 2023-09-13T10:00:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 0x55799caed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cadc730 0x55799cadae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:04.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799cad78e0 con 0x55799cae6470 2023-09-13T10:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799cadbd90 con 0x55799cae4e10 2023-09-13T10:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799caebff0 con 0x55799cadc730 2023-09-13T10:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf5840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46602/0 (socket says 172.21.15.6:46602) 2023-09-13T10:00:04.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 -- 172.21.15.6:0/584503588 learned_addr learned my addr 172.21.15.6:0/584503588 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f83fff700 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 0x55799caed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f88e04700 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cadc730 0x55799cadae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 -- 172.21.15.6:0/584503588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cadc730 msgr2=0x55799cadae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cadc730 0x55799cadae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 -- 172.21.15.6:0/584503588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 msgr2=0x55799caed9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 0x55799caed9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 -- 172.21.15.6:0/584503588 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55799c85ede0 con 0x55799cae6470 2023-09-13T10:00:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f88e04700 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cadc730 0x55799cadae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:00:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.992+0000 7f9f837fe700 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf5840 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f9f78003e70 tx=0x7f9f78009aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f7622cc0bf61d22 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:04.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f6affd700 1 -- 172.21.15.6:0/584503588 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f780092d0 con 0x55799cae6470 2023-09-13T10:00:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f6affd700 1 -- 172.21.15.6:0/584503588 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55799cad3670 con 0x55799cae6470 2023-09-13T10:00:04.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f6affd700 1 -- 172.21.15.6:0/584503588 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f78003aa0 con 0x55799cae6470 2023-09-13T10:00:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/584503588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 msgr2=0x55799caf5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:04.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf5840 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f9f78003e70 tx=0x7f9f78009aa0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/584503588 shutdown_connections 2023-09-13T10:00:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cadc730 0x55799cadae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cae4e10 0x55799caed9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/584503588 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf5840 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.993+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/584503588 >> 172.21.15.6:0/584503588 conn(0x55799ca3ec80 msgr2=0x55799caed020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/584503588 shutdown_connections 2023-09-13T10:00:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/584503588 wait complete. 2023-09-13T10:00:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 -- start start 2023-09-13T10:00:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 Processor -- start 2023-09-13T10:00:05.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cadc730 0x55799caf17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 0x55799caf1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799caf5250 con 0x55799cae6470 2023-09-13T10:00:05.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799caf53c0 con 0x55799cadc730 2023-09-13T10:00:05.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55799caf5580 con 0x55799cae4e10 2023-09-13T10:00:05.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.994+0000 7f9f96a4cb80 10 client.0 _ll_register_callbacks cb 0x55799c9ce680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cadc730 0x55799caf17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cadc730 0x55799caf17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40132/0 (socket says 172.21.15.6:40132) 2023-09-13T10:00:05.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 -- 172.21.15.6:0/861701502 learned_addr learned my addr 172.21.15.6:0/861701502 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f837fe700 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 0x55799caf1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 -- 172.21.15.6:0/861701502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 msgr2=0x55799caf1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 0x55799caf1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 -- 172.21.15.6:0/861701502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 msgr2=0x55799caf4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 -- 172.21.15.6:0/861701502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55799ca4a7a0 con 0x55799cadc730 2023-09-13T10:00:05.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f637fe700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:00:05.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.995+0000 7f9f83fff700 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cadc730 0x55799caf17b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9f74096cf0 tx=0x7f9f74009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5df40ca08b037083 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.996+0000 7f9f637fe700 1 -- 172.21.15.6:0/861701502 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7409e620 con 0x55799cadc730 2023-09-13T10:00:05.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.996+0000 7f9f637fe700 1 -- 172.21.15.6:0/861701502 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9f740a27d0 con 0x55799cadc730 2023-09-13T10:00:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.996+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9f78021070 con 0x55799cadc730 2023-09-13T10:00:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.996+0000 7f9f637fe700 1 -- 172.21.15.6:0/861701502 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f74099ce0 con 0x55799cadc730 2023-09-13T10:00:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.996+0000 7f9f96a4cb80 10 client.29984 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.996+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55799c847c60 con 0x55799cadc730 2023-09-13T10:00:05.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f637fe700 1 -- 172.21.15.6:0/861701502 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9f78021070 con 0x55799cadc730 2023-09-13T10:00:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f637fe700 1 -- 172.21.15.6:0/861701502 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9f7409e160 con 0x55799cadc730 2023-09-13T10:00:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f96a4cb80 10 client.29984 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f96a4cb80 10 client.29984 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:00:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f96a4cb80 20 client.29984 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799cae1350 0x55799cae3770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f96a4cb80 4 client.29984 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:04.997+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55799c9ec050 con 0x55799cae1350 2023-09-13T10:00:05.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.000+0000 7f9f837fe700 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799cae1350 0x55799cae3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.009 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:05.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.001+0000 7f9f637fe700 10 client.29984 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:05.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.001+0000 7f9f837fe700 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799cae1350 0x55799cae3770 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a9acfea01250357c server_cookie=9fabbe1b09eff92 in_seq=0 out_seq=0 2023-09-13T10:00:05.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f637fe700 1 -- 172.21.15.6:0/861701502 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55799c9ec050 con 0x55799cae1350 2023-09-13T10:00:05.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f637fe700 10 client.29984 handle_command_reply: tid=0 2023-09-13T10:00:05.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 client.29984 shutdown 2023-09-13T10:00:05.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cadc730 msgr2=0x55799caf17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cadc730 0x55799caf17b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9f74096cf0 tx=0x7f9f74009ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 shutdown_connections 2023-09-13T10:00:05.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55799cae1350 0x55799cae3770 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55799cae6470 0x55799caf4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f637fe700 0 client.29984 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:05.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55799cadc730 0x55799caf17b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 --2- 172.21.15.6:0/861701502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55799cae4e10 0x55799caf1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 >> 172.21.15.6:0/861701502 conn(0x55799ca3ec80 msgr2=0x55799caed800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 shutdown_connections 2023-09-13T10:00:05.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 1 -- 172.21.15.6:0/861701502 wait complete. 2023-09-13T10:00:05.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.002+0000 7f9f96a4cb80 20 client.29984 trim_cache size 0 max 16384 2023-09-13T10:00:05.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.003+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9f6c0a06c0 msgr2=0x7f9f6c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.003+0000 7f9f8a867700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9f6c0a06c0 0x7f9f6c0a2b80 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9f78009c60 tx=0x7f9f78009260 comp rx=0 tx=0).stop 2023-09-13T10:00:05.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.003+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84108050 msgr2=0x7f9f8419f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.003+0000 7f9f8a867700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84108050 0x7f9f8419f280 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9f740059d0 tx=0x7f9f74004730 comp rx=0 tx=0).stop 2023-09-13T10:00:05.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 shutdown_connections 2023-09-13T10:00:05.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9f6c0a06c0 0x7f9f6c0a2b80 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9f841097c0 0x7f9f841a6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f84108050 0x7f9f8419f280 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 --2- 172.21.15.6:0/2693562768 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9f84108e00 0x7f9f8419f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 >> 172.21.15.6:0/2693562768 conn(0x7f9f8406dc70 msgr2=0x7f9f8410c390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 shutdown_connections 2023-09-13T10:00:05.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.004+0000 7f9f8a867700 1 -- 172.21.15.6:0/2693562768 wait complete. 2023-09-13T10:00:05.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T10:00:05.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.179+0000 7f15e44ec700 1 -- 172.21.15.6:0/575050283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1041d0 msgr2=0x7f15dc1065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.179+0000 7f15e44ec700 1 --2- 172.21.15.6:0/575050283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1041d0 0x7f15dc1065c0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f15cc009990 tx=0x7f15cc009ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.179+0000 7f15e44ec700 1 -- 172.21.15.6:0/575050283 shutdown_connections 2023-09-13T10:00:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.179+0000 7f15e44ec700 1 --2- 172.21.15.6:0/575050283 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15dc106b00 0x7f15dc108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.179+0000 7f15e44ec700 1 --2- 172.21.15.6:0/575050283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15dc1018a0 0x7f15dc103c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.179+0000 7f15e44ec700 1 --2- 172.21.15.6:0/575050283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1041d0 0x7f15dc1065c0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.179+0000 7f15e44ec700 1 -- 172.21.15.6:0/575050283 >> 172.21.15.6:0/575050283 conn(0x7f15dc0fb250 msgr2=0x7f15dc0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.180+0000 7f15e44ec700 1 -- 172.21.15.6:0/575050283 shutdown_connections 2023-09-13T10:00:05.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.180+0000 7f15e44ec700 1 -- 172.21.15.6:0/575050283 wait complete. 2023-09-13T10:00:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.180+0000 7f15e44ec700 1 Processor -- start 2023-09-13T10:00:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.180+0000 7f15e44ec700 1 -- start start 2023-09-13T10:00:05.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.180+0000 7f15e44ec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1018a0 0x7f15dc196a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.180+0000 7f15e44ec700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15dc1041d0 0x7f15dc196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e44ec700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15dc106b00 0x7f15dc19dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e44ec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc19e5c0 con 0x7f15dc1018a0 2023-09-13T10:00:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e44ec700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc19e700 con 0x7f15dc106b00 2023-09-13T10:00:05.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e44ec700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15dc19e890 con 0x7f15dc1041d0 2023-09-13T10:00:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1018a0 0x7f15dc196a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1018a0 0x7f15dc196a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46618/0 (socket says 172.21.15.6:46618) 2023-09-13T10:00:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 -- 172.21.15.6:0/3977335067 learned_addr learned my addr 172.21.15.6:0/3977335067 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2a89700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15dc106b00 0x7f15dc19dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e1a87700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15dc1041d0 0x7f15dc196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 -- 172.21.15.6:0/3977335067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15dc1041d0 msgr2=0x7f15dc196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15dc1041d0 0x7f15dc196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 -- 172.21.15.6:0/3977335067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15dc106b00 msgr2=0x7f15dc19dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15dc106b00 0x7f15dc19dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 -- 172.21.15.6:0/3977335067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc0095f0 con 0x7f15dc1018a0 2023-09-13T10:00:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15e2288700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1018a0 0x7f15dc196a40 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f15d800e9a0 tx=0x7f15d800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.181+0000 7f15d37fe700 1 -- 172.21.15.6:0/3977335067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8009790 con 0x7f15dc1018a0 2023-09-13T10:00:05.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.182+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15dc0ff6f0 con 0x7f15dc1018a0 2023-09-13T10:00:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.182+0000 7f15d37fe700 1 -- 172.21.15.6:0/3977335067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15d8010430 con 0x7f15dc1018a0 2023-09-13T10:00:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.182+0000 7f15d37fe700 1 -- 172.21.15.6:0/3977335067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8018680 con 0x7f15dc1018a0 2023-09-13T10:00:05.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.182+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc0ffc00 con 0x7f15dc1018a0 2023-09-13T10:00:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.184+0000 7f15d37fe700 1 -- 172.21.15.6:0/3977335067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f15d80105a0 con 0x7f15dc1018a0 2023-09-13T10:00:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.185+0000 7f15d37fe700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15c80a0640 0x7f15c80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.185+0000 7f15d37fe700 1 -- 172.21.15.6:0/3977335067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15d8014070 con 0x7f15dc1018a0 2023-09-13T10:00:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.186+0000 7f15e1a87700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15c80a0640 0x7f15c80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.186+0000 7f15f06d1b80 1 Processor -- start 2023-09-13T10:00:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.186+0000 7f15f06d1b80 1 -- start start 2023-09-13T10:00:05.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.186+0000 7f15e1a87700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15c80a0640 0x7f15c80a2b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00b680 tx=0x7f15cc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.186+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff2fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.186+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff2e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.186+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1fe87780 con 0x55ee1ff30060 2023-09-13T10:00:05.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1fe850a0 con 0x55ee1ff2f700 2023-09-13T10:00:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1fe80990 con 0x55ee1ff2ea00 2023-09-13T10:00:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff2e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e2288700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff2fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff2e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46628/0 (socket says 172.21.15.6:46628) 2023-09-13T10:00:05.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e2288700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff2fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40150/0 (socket says 172.21.15.6:40150) 2023-09-13T10:00:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 -- 172.21.15.6:0/341672354 learned_addr learned my addr 172.21.15.6:0/341672354 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e2a89700 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 -- 172.21.15.6:0/341672354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 msgr2=0x55ee1ff2ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 -- 172.21.15.6:0/341672354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 msgr2=0x55ee1ff2fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff2fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 -- 172.21.15.6:0/341672354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1fd00630 con 0x55ee1ff30060 2023-09-13T10:00:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e2288700 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff2fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15e1a87700 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff2e4c0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f15cc015000 tx=0x7f15cc024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55ee106c2939a39b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15d0ff9700 1 -- 172.21.15.6:0/341672354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc02f070 con 0x55ee1ff30060 2023-09-13T10:00:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15d0ff9700 1 -- 172.21.15.6:0/341672354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15cc022040 con 0x55ee1ff30060 2023-09-13T10:00:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.187+0000 7f15d0ff9700 1 -- 172.21.15.6:0/341672354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15cc004c50 con 0x55ee1ff30060 2023-09-13T10:00:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 -- 172.21.15.6:0/341672354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 msgr2=0x55ee1ff2e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff2e4c0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f15cc015000 tx=0x7f15cc024000 comp rx=0 tx=0).stop 2023-09-13T10:00:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 -- 172.21.15.6:0/341672354 shutdown_connections 2023-09-13T10:00:05.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff2fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/341672354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff2e4c0 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 -- 172.21.15.6:0/341672354 >> 172.21.15.6:0/341672354 conn(0x55ee1fe8cc80 msgr2=0x55ee1ff28f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.188+0000 7f15f06d1b80 1 -- 172.21.15.6:0/341672354 shutdown_connections 2023-09-13T10:00:05.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 -- 172.21.15.6:0/341672354 wait complete. 2023-09-13T10:00:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 -- start start 2023-09-13T10:00:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 Processor -- start 2023-09-13T10:00:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff37e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff38380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff30060 0x55ee1ff3f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1fe1ebb0 con 0x55ee1ff2ea00 2023-09-13T10:00:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1fe1e8b0 con 0x55ee1ff2f700 2023-09-13T10:00:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.189+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1fd02920 con 0x55ee1ff30060 2023-09-13T10:00:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15f06d1b80 10 client.0 _ll_register_callbacks cb 0x55ee1fe1c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff30060 0x55ee1ff3f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e1a87700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff38380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff30060 0x55ee1ff3f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49688/0 (socket says 172.21.15.6:49688) 2023-09-13T10:00:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 -- 172.21.15.6:0/161401129 learned_addr learned my addr 172.21.15.6:0/161401129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 -- 172.21.15.6:0/161401129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 msgr2=0x55ee1ff38380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff38380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 -- 172.21.15.6:0/161401129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 msgr2=0x55ee1ff37e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff37e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 -- 172.21.15.6:0/161401129 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc109b00 con 0x55ee1ff30060 2023-09-13T10:00:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e1a87700 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff38380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15e2a89700 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff30060 0x55ee1ff3f3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15d4011f60 tx=0x7f15d4014600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c854ad2f3d40616 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.190+0000 7f15c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15c5ffb700 1 -- 172.21.15.6:0/161401129 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400e040 con 0x55ee1ff30060 2023-09-13T10:00:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee1ff21670 con 0x55ee1ff30060 2023-09-13T10:00:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15c5ffb700 1 -- 172.21.15.6:0/161401129 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15d40090d0 con 0x55ee1ff30060 2023-09-13T10:00:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15c5ffb700 1 -- 172.21.15.6:0/161401129 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15d40092b0 con 0x55ee1ff30060 2023-09-13T10:00:05.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 10 client.29989 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55ee1fe987a0 con 0x55ee1ff30060 2023-09-13T10:00:05.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15c5ffb700 1 -- 172.21.15.6:0/161401129 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ee1ff21670 con 0x55ee1ff30060 2023-09-13T10:00:05.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15c5ffb700 1 -- 172.21.15.6:0/161401129 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f15d401c020 con 0x55ee1ff30060 2023-09-13T10:00:05.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 10 client.29989 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 10 client.29989 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:00:05.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 20 client.29989 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff43cc0 0x55ee1ff460e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 4 client.29989 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:05.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee1fe79970 con 0x55ee1ff43cc0 2023-09-13T10:00:05.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.191+0000 7f15e2288700 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff43cc0 0x55ee1ff460e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.192+0000 7f15c5ffb700 10 client.29989 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:05.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.192+0000 7f15e2288700 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff43cc0 0x55ee1ff460e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8660f8ca7759df6b server_cookie=5f72d164d8589eb3 in_seq=0 out_seq=0 2023-09-13T10:00:05.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.192+0000 7f15c5ffb700 1 -- 172.21.15.6:0/161401129 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ee1fe79970 con 0x55ee1ff43cc0 2023-09-13T10:00:05.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.192+0000 7f15c5ffb700 10 client.29989 handle_command_reply: tid=0 2023-09-13T10:00:05.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 client.29989 shutdown 2023-09-13T10:00:05.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff30060 msgr2=0x55ee1ff3f3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff30060 0x55ee1ff3f3c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f15d4011f60 tx=0x7f15d4014600 comp rx=0 tx=0).stop 2023-09-13T10:00:05.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 shutdown_connections 2023-09-13T10:00:05.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff43cc0 0x55ee1ff460e0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff30060 0x55ee1ff3f3c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15c5ffb700 0 client.29989 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:05.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff37e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/161401129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff38380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 >> 172.21.15.6:0/161401129 conn(0x55ee1fe8cc80 msgr2=0x55ee1ff237f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 shutdown_connections 2023-09-13T10:00:05.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 1 -- 172.21.15.6:0/161401129 wait complete. 2023-09-13T10:00:05.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.193+0000 7f15f06d1b80 20 client.29989 trim_cache size 0 max 16384 2023-09-13T10:00:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 Processor -- start 2023-09-13T10:00:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 -- start start 2023-09-13T10:00:05.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff30060 0x55ee1ff374f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1ff2a730 con 0x55ee1ff2ea00 2023-09-13T10:00:05.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1ff35b30 con 0x55ee1ff30060 2023-09-13T10:00:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1ff33420 con 0x55ee1ff2f700 2023-09-13T10:00:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15e2288700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15e2288700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46640/0 (socket says 172.21.15.6:46640) 2023-09-13T10:00:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15e2288700 1 -- 172.21.15.6:0/330269733 learned_addr learned my addr 172.21.15.6:0/330269733 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15e1a87700 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.210+0000 7f15e2a89700 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff30060 0x55ee1ff374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15e2288700 1 -- 172.21.15.6:0/330269733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2f700 msgr2=0x55ee1ff3f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15e2288700 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15e2288700 1 -- 172.21.15.6:0/330269733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff30060 msgr2=0x55ee1ff374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15e2288700 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff30060 0x55ee1ff374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15e2288700 1 -- 172.21.15.6:0/330269733 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee1fcacde0 con 0x55ee1ff2ea00 2023-09-13T10:00:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15e1a87700 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:00:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15e2288700 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2e4c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f15d8095fa0 tx=0x7f15d80c9710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9e235919cd05021 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15d17fa700 1 -- 172.21.15.6:0/330269733 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d80b0070 con 0x55ee1ff2ea00 2023-09-13T10:00:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15d17fa700 1 -- 172.21.15.6:0/330269733 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15d809d170 con 0x55ee1ff2ea00 2023-09-13T10:00:05.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.211+0000 7f15d17fa700 1 -- 172.21.15.6:0/330269733 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d8010880 con 0x55ee1ff2ea00 2023-09-13T10:00:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- 172.21.15.6:0/330269733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 msgr2=0x55ee1ff2e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2e4c0 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f15d8095fa0 tx=0x7f15d80c9710 comp rx=0 tx=0).stop 2023-09-13T10:00:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- 172.21.15.6:0/330269733 shutdown_connections 2023-09-13T10:00:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff30060 0x55ee1ff374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff2e4c0 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/330269733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- 172.21.15.6:0/330269733 >> 172.21.15.6:0/330269733 conn(0x55ee1fe8cc80 msgr2=0x55ee1ff36b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- 172.21.15.6:0/330269733 shutdown_connections 2023-09-13T10:00:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- 172.21.15.6:0/330269733 wait complete. 2023-09-13T10:00:05.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- start start 2023-09-13T10:00:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 Processor -- start 2023-09-13T10:00:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff3e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1ff3eb20 con 0x55ee1ff30060 2023-09-13T10:00:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1ff3ec90 con 0x55ee1ff2f700 2023-09-13T10:00:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee1ff3ee50 con 0x55ee1ff2ea00 2023-09-13T10:00:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15f06d1b80 10 client.0 _ll_register_callbacks cb 0x55ee1fe1c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.212+0000 7f15e2a89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff3e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff3e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46650/0 (socket says 172.21.15.6:46650) 2023-09-13T10:00:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 -- 172.21.15.6:0/2655805889 learned_addr learned my addr 172.21.15.6:0/2655805889 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2288700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e1a87700 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 -- 172.21.15.6:0/2655805889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 msgr2=0x55ee1ff3b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff3b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 -- 172.21.15.6:0/2655805889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 msgr2=0x55ee1ff3b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 -- 172.21.15.6:0/2655805889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15dc0ff6f0 con 0x55ee1ff30060 2023-09-13T10:00:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15e2a89700 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff3e5e0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f15d400b010 tx=0x7f15d40076d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f28e64bbfab91d48 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15c5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:05.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15c5ffb700 1 -- 172.21.15.6:0/2655805889 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d400e040 con 0x55ee1ff30060 2023-09-13T10:00:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15c5ffb700 1 -- 172.21.15.6:0/2655805889 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15d402d070 con 0x55ee1ff30060 2023-09-13T10:00:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.213+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15cc022040 con 0x55ee1ff30060 2023-09-13T10:00:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15c5ffb700 1 -- 172.21.15.6:0/2655805889 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15d4004970 con 0x55ee1ff30060 2023-09-13T10:00:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 10 client.20802 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55ee1fc95c60 con 0x55ee1ff30060 2023-09-13T10:00:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15c5ffb700 1 -- 172.21.15.6:0/2655805889 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f15cc022040 con 0x55ee1ff30060 2023-09-13T10:00:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15c5ffb700 1 -- 172.21.15.6:0/2655805889 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f15d4014320 con 0x55ee1ff30060 2023-09-13T10:00:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 10 client.20802 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 10 client.20802 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:00:05.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 20 client.20802 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff98970 0x55ee1ff9ad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 4 client.20802 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:05.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ee1fe3a050 con 0x55ee1ff98970 2023-09-13T10:00:05.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.214+0000 7f15e2288700 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff98970 0x55ee1ff9ad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15e2288700 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff98970 0x55ee1ff9ad90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=be1751f2e1afd96b server_cookie=e5c4c8611d6f4cdc in_seq=0 out_seq=0 2023-09-13T10:00:05.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15c5ffb700 10 client.20802 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:05.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15c5ffb700 1 -- 172.21.15.6:0/2655805889 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ee1fe3a050 con 0x55ee1ff98970 2023-09-13T10:00:05.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15c5ffb700 10 client.20802 handle_command_reply: tid=0 2023-09-13T10:00:05.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 client.20802 shutdown 2023-09-13T10:00:05.232 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 msgr2=0x55ee1ff3e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff3e5e0 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f15d400b010 tx=0x7f15d40076d0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 shutdown_connections 2023-09-13T10:00:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55ee1ff98970 0x55ee1ff9ad90 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ee1ff30060 0x55ee1ff3e5e0 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ee1ff2ea00 0x55ee1ff3b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15c5ffb700 0 client.20802 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 --2- 172.21.15.6:0/2655805889 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ee1ff2f700 0x55ee1ff3b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 >> 172.21.15.6:0/2655805889 conn(0x55ee1fe8cc80 msgr2=0x55ee1ff28e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 shutdown_connections 2023-09-13T10:00:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 1 -- 172.21.15.6:0/2655805889 wait complete. 2023-09-13T10:00:05.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.215+0000 7f15f06d1b80 20 client.20802 trim_cache size 0 max 16384 2023-09-13T10:00:05.235 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:05.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15c80a0640 msgr2=0x7f15c80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15c80a0640 0x7f15c80a2b00 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f15cc00b680 tx=0x7f15cc005fd0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1018a0 msgr2=0x7f15dc196a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1018a0 0x7f15dc196a40 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f15d800e9a0 tx=0x7f15d800ecb0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 shutdown_connections 2023-09-13T10:00:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15dc106b00 0x7f15dc19dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15c80a0640 0x7f15c80a2b00 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15dc1018a0 0x7f15dc196a40 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 --2- 172.21.15.6:0/3977335067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15dc1041d0 0x7f15dc196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 >> 172.21.15.6:0/3977335067 conn(0x7f15dc0fb250 msgr2=0x7f15dc102d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 shutdown_connections 2023-09-13T10:00:05.239 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.216+0000 7f15e44ec700 1 -- 172.21.15.6:0/3977335067 wait complete. 2023-09-13T10:00:05.239 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T10:00:05.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.393+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/817659405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c580ffcc0 msgr2=0x7f9c581000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.393+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/817659405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c580ffcc0 0x7f9c581000e0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f9c540099c0 tx=0x7f9c54009cd0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.393+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/817659405 shutdown_connections 2023-09-13T10:00:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.393+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/817659405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c58101850 0x7f9c58108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.393+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/817659405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c580ffcc0 0x7f9c581000e0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.393+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/817659405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 0x7f9c58101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.393+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/817659405 >> 172.21.15.6:0/817659405 conn(0x7f9c580fb250 msgr2=0x7f9c580fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.394+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/817659405 shutdown_connections 2023-09-13T10:00:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.394+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/817659405 wait complete. 2023-09-13T10:00:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.394+0000 7f9c5f8e2700 1 Processor -- start 2023-09-13T10:00:05.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.394+0000 7f9c5f8e2700 1 -- start start 2023-09-13T10:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5f8e2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c580ffcc0 0x7f9c58068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5f8e2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 0x7f9c5819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5f8e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c58101850 0x7f9c5819de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5f8e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5819e5b0 con 0x7f9c58101850 2023-09-13T10:00:05.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5f8e2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5819e720 con 0x7f9c58100eb0 2023-09-13T10:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5f8e2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5819e8e0 con 0x7f9c580ffcc0 2023-09-13T10:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5d67e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c580ffcc0 0x7f9c58068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5ce7d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 0x7f9c5819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5de7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c58101850 0x7f9c5819de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5d67e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c580ffcc0 0x7f9c58068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49714/0 (socket says 172.21.15.6:49714) 2023-09-13T10:00:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5d67e700 1 -- 172.21.15.6:0/1919867988 learned_addr learned my addr 172.21.15.6:0/1919867988 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5ce7d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 0x7f9c5819b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40186/0 (socket says 172.21.15.6:40186) 2023-09-13T10:00:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5de7f700 1 -- 172.21.15.6:0/1919867988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c580ffcc0 msgr2=0x7f9c58068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5de7f700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c580ffcc0 0x7f9c58068b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5de7f700 1 -- 172.21.15.6:0/1919867988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 msgr2=0x7f9c5819b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5de7f700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 0x7f9c5819b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5de7f700 1 -- 172.21.15.6:0/1919867988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540095f0 con 0x7f9c58101850 2023-09-13T10:00:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 0x7f9c5819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c580ffcc0 0x7f9c58068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c5de7f700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c58101850 0x7f9c5819de10 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000efc0 tx=0x7f9c5000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.395+0000 7f9c4e7fc700 1 -- 172.21.15.6:0/1919867988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c50018070 con 0x7f9c58101850 2023-09-13T10:00:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.396+0000 7f9c4e7fc700 1 -- 172.21.15.6:0/1919867988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c5000f040 con 0x7f9c58101850 2023-09-13T10:00:05.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.396+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c581955a0 con 0x7f9c58101850 2023-09-13T10:00:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.396+0000 7f9c4e7fc700 1 -- 172.21.15.6:0/1919867988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000cd40 con 0x7f9c58101850 2023-09-13T10:00:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.396+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c58195ab0 con 0x7f9c58101850 2023-09-13T10:00:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.398+0000 7f9c4e7fc700 1 -- 172.21.15.6:0/1919867988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f9c50003a00 con 0x7f9c58101850 2023-09-13T10:00:05.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.399+0000 7f9c4e7fc700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c440a0640 0x7f9c440a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.399+0000 7f9c4e7fc700 1 -- 172.21.15.6:0/1919867988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9c500cb760 con 0x7f9c58101850 2023-09-13T10:00:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.400+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c440a0640 0x7f9c440a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.400+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c440a0640 0x7f9c440a2b00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9c54004800 tx=0x7f9c5401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 Processor -- start 2023-09-13T10:00:05.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 -- start start 2023-09-13T10:00:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3ae5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 0x55c6f3ae44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3a3d780 con 0x55c6f3ae4a00 2023-09-13T10:00:05.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3a3b0a0 con 0x55c6f3ae6060 2023-09-13T10:00:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3a36990 con 0x55c6f3ae5700 2023-09-13T10:00:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c5de7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c5de7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46670/0 (socket says 172.21.15.6:46670) 2023-09-13T10:00:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c5de7f700 1 -- 172.21.15.6:0/2917401693 learned_addr learned my addr 172.21.15.6:0/2917401693 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.401+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3ae5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c5d67e700 1 -- 172.21.15.6:0/2917401693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 msgr2=0x55c6f3ae44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 0x55c6f3ae44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c5d67e700 1 -- 172.21.15.6:0/2917401693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae4a00 msgr2=0x55c6f3ae4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c5d67e700 1 -- 172.21.15.6:0/2917401693 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f38b6630 con 0x55c6f3ae5700 2023-09-13T10:00:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3ae5b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400b580 tx=0x7f9c5401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a42f258795e05bb server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c437fe700 1 -- 172.21.15.6:0/2917401693 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5402a070 con 0x55c6f3ae5700 2023-09-13T10:00:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c437fe700 1 -- 172.21.15.6:0/2917401693 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c5401e040 con 0x55c6f3ae5700 2023-09-13T10:00:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.402+0000 7f9c437fe700 1 -- 172.21.15.6:0/2917401693 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c54005280 con 0x55c6f3ae5700 2023-09-13T10:00:05.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/2917401693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 msgr2=0x55c6f3ae5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3ae5b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400b580 tx=0x7f9c5401f000 comp rx=0 tx=0).stop 2023-09-13T10:00:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/2917401693 shutdown_connections 2023-09-13T10:00:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3ae5b20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/2917401693 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 0x55c6f3ae44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/2917401693 >> 172.21.15.6:0/2917401693 conn(0x55c6f3a42c80 msgr2=0x55c6f3adef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/2917401693 shutdown_connections 2023-09-13T10:00:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/2917401693 wait complete. 2023-09-13T10:00:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.403+0000 7f9c6bac7b80 1 -- start start 2023-09-13T10:00:05.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 1 Processor -- start 2023-09-13T10:00:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3aede90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3aee3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f39d4bb0 con 0x55c6f3ae6060 2023-09-13T10:00:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f39d48b0 con 0x55c6f3ae4a00 2023-09-13T10:00:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f38b8920 con 0x55c6f3ae5700 2023-09-13T10:00:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c6bac7b80 10 client.0 _ll_register_callbacks cb 0x55c6f39d2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5d67e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3aede90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5ce7d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3aee3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5d67e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3aede90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40198/0 (socket says 172.21.15.6:40198) 2023-09-13T10:00:05.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5d67e700 1 -- 172.21.15.6:0/511022124 learned_addr learned my addr 172.21.15.6:0/511022124 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5de7f700 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5ce7d700 1 -- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 msgr2=0x55c6f3aede90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3aede90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5ce7d700 1 -- 172.21.15.6:0/511022124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae6060 msgr2=0x55c6f3af5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.404+0000 7f9c5ce7d700 1 -- 172.21.15.6:0/511022124 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c58108a50 con 0x55c6f3ae5700 2023-09-13T10:00:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3aede90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3aee3d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009e60 tx=0x7f9c4800b5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99337ac6a0b7bb37 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c40ff9700 1 -- 172.21.15.6:0/511022124 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48015050 con 0x55c6f3ae5700 2023-09-13T10:00:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c40ff9700 1 -- 172.21.15.6:0/511022124 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9c4800bcb0 con 0x55c6f3ae5700 2023-09-13T10:00:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c6f3ad7670 con 0x55c6f3ae5700 2023-09-13T10:00:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c40ff9700 1 -- 172.21.15.6:0/511022124 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c4800be70 con 0x55c6f3ae5700 2023-09-13T10:00:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c6bac7b80 10 client.30007 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.405+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55c6f3a4e7a0 con 0x55c6f3ae5700 2023-09-13T10:00:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c40ff9700 1 -- 172.21.15.6:0/511022124 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55c6f3ad7670 con 0x55c6f3ae5700 2023-09-13T10:00:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c40ff9700 1 -- 172.21.15.6:0/511022124 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9c48023620 con 0x55c6f3ae5700 2023-09-13T10:00:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c6bac7b80 10 client.30007 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c6bac7b80 10 client.30007 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:00:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c6bac7b80 20 client.30007 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3af9d20 0x55c6f3afc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c6bac7b80 4 client.30007 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.406+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c6f3a2f970 con 0x55c6f3af9d20 2023-09-13T10:00:05.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.407+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3af9d20 0x55c6f3afc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.410+0000 7f9c40ff9700 10 client.30007 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:05.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.410+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3af9d20 0x55c6f3afc140 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4807754ca32f5e18 server_cookie=12a648e1fb5d0c1c in_seq=0 out_seq=0 2023-09-13T10:00:05.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c40ff9700 1 -- 172.21.15.6:0/511022124 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c6f3a2f970 con 0x55c6f3af9d20 2023-09-13T10:00:05.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c40ff9700 10 client.30007 handle_command_reply: tid=0 2023-09-13T10:00:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 client.30007 shutdown 2023-09-13T10:00:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 msgr2=0x55c6f3aee3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3aee3d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9c48009e60 tx=0x7f9c4800b5a0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 shutdown_connections 2023-09-13T10:00:05.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3af9d20 0x55c6f3afc140 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3aede90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/511022124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae5700 0x55c6f3aee3d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c40ff9700 0 client.30007 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:05.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 >> 172.21.15.6:0/511022124 conn(0x55c6f3a42c80 msgr2=0x55c6f3ad97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 shutdown_connections 2023-09-13T10:00:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.411+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/511022124 wait complete. 2023-09-13T10:00:05.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.412+0000 7f9c6bac7b80 20 client.30007 trim_cache size 0 max 16384 2023-09-13T10:00:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 Processor -- start 2023-09-13T10:00:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 -- start start 2023-09-13T10:00:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3aed340 con 0x55c6f3ae5700 2023-09-13T10:00:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3aeda00 con 0x55c6f3ae6060 2023-09-13T10:00:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.426+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3ae1000 con 0x55c6f3ae4a00 2023-09-13T10:00:05.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49736/0 (socket says 172.21.15.6:49736) 2023-09-13T10:00:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 -- 172.21.15.6:0/209931561 learned_addr learned my addr 172.21.15.6:0/209931561 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5de7f700 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 -- 172.21.15.6:0/209931561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 msgr2=0x55c6f3af5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 -- 172.21.15.6:0/209931561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 msgr2=0x55c6f3af5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 -- 172.21.15.6:0/209931561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c6f3862de0 con 0x55c6f3ae4a00 2023-09-13T10:00:05.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae44c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9c540095c0 tx=0x7f9c54005940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8554fb6f873d110a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c43fff700 1 -- 172.21.15.6:0/209931561 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5402a040 con 0x55c6f3ae4a00 2023-09-13T10:00:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c43fff700 1 -- 172.21.15.6:0/209931561 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c540056e0 con 0x55c6f3ae4a00 2023-09-13T10:00:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.427+0000 7f9c43fff700 1 -- 172.21.15.6:0/209931561 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5400fc80 con 0x55c6f3ae4a00 2023-09-13T10:00:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/209931561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae4a00 msgr2=0x55c6f3ae44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae44c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f9c540095c0 tx=0x7f9c54005940 comp rx=0 tx=0).stop 2023-09-13T10:00:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/209931561 shutdown_connections 2023-09-13T10:00:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae6060 0x55c6f3af5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae4a00 0x55c6f3ae44c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/209931561 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/209931561 >> 172.21.15.6:0/209931561 conn(0x55c6f3a42c80 msgr2=0x55c6f3aecaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/209931561 shutdown_connections 2023-09-13T10:00:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.428+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/209931561 wait complete. 2023-09-13T10:00:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 -- start start 2023-09-13T10:00:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 Processor -- start 2023-09-13T10:00:05.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3af07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae6060 0x55c6f3af3d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3af4260 con 0x55c6f3ae5700 2023-09-13T10:00:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3af43d0 con 0x55c6f3ae4a00 2023-09-13T10:00:05.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c6f3af4590 con 0x55c6f3ae6060 2023-09-13T10:00:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c6bac7b80 10 client.0 _ll_register_callbacks cb 0x55c6f39d2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c5ce7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c5ce7d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46690/0 (socket says 172.21.15.6:46690) 2023-09-13T10:00:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c5ce7d700 1 -- 172.21.15.6:0/595069076 learned_addr learned my addr 172.21.15.6:0/595069076 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c5de7f700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae6060 0x55c6f3af3d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.429+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3af07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5ce7d700 1 -- 172.21.15.6:0/595069076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae6060 msgr2=0x55c6f3af3d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae6060 0x55c6f3af3d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5ce7d700 1 -- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 msgr2=0x55c6f3af07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3af07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5ce7d700 1 -- 172.21.15.6:0/595069076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c6f38b6630 con 0x55c6f3ae5700 2023-09-13T10:00:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5de7f700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae6060 0x55c6f3af3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3af07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c5ce7d700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af0d00 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9c48001eb0 tx=0x7f9c4800bd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd3442b30f4b8c4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c40ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:05.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c40ff9700 1 -- 172.21.15.6:0/595069076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48032070 con 0x55c6f3ae5700 2023-09-13T10:00:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c40ff9700 1 -- 172.21.15.6:0/595069076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f9c48000e40 con 0x55c6f3ae5700 2023-09-13T10:00:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c5401e040 con 0x55c6f3ae5700 2023-09-13T10:00:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c40ff9700 1 -- 172.21.15.6:0/595069076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c48015040 con 0x55c6f3ae5700 2023-09-13T10:00:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c6bac7b80 10 client.20817 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55c6f384bc60 con 0x55c6f3ae5700 2023-09-13T10:00:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.430+0000 7f9c40ff9700 1 -- 172.21.15.6:0/595069076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f9c5401e040 con 0x55c6f3ae5700 2023-09-13T10:00:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c40ff9700 1 -- 172.21.15.6:0/595069076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f9c48003680 con 0x55c6f3ae5700 2023-09-13T10:00:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c6bac7b80 10 client.20817 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c6bac7b80 10 client.20817 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:00:05.444 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c6bac7b80 20 client.20817 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3b4e220 0x55c6f3b50640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c6bac7b80 4 client.20817 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c6f39f0050 con 0x55c6f3b4e220 2023-09-13T10:00:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3b4e220 0x55c6f3b50640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.445 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c5d67e700 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3b4e220 0x55c6f3b50640 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=318b347d0e19d940 server_cookie=5fecef90f915dbe8 in_seq=0 out_seq=0 2023-09-13T10:00:05.446 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.431+0000 7f9c40ff9700 10 client.20817 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c40ff9700 1 -- 172.21.15.6:0/595069076 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c6f39f0050 con 0x55c6f3b4e220 2023-09-13T10:00:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c40ff9700 10 client.20817 handle_command_reply: tid=0 2023-09-13T10:00:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 client.20817 shutdown 2023-09-13T10:00:05.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 msgr2=0x55c6f3af0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af0d00 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f9c48001eb0 tx=0x7f9c4800bd40 comp rx=0 tx=0).stop 2023-09-13T10:00:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 shutdown_connections 2023-09-13T10:00:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55c6f3b4e220 0x55c6f3b50640 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c6f3ae6060 0x55c6f3af3d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c40ff9700 0 client.20817 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c6f3ae4a00 0x55c6f3af07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 --2- 172.21.15.6:0/595069076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c6f3ae5700 0x55c6f3af0d00 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.437+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 >> 172.21.15.6:0/595069076 conn(0x55c6f3a42c80 msgr2=0x55c6f3af5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 shutdown_connections 2023-09-13T10:00:05.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c6bac7b80 1 -- 172.21.15.6:0/595069076 wait complete. 2023-09-13T10:00:05.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c6bac7b80 20 client.20817 trim_cache size 0 max 16384 2023-09-13T10:00:05.450 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:05.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c440a0640 msgr2=0x7f9c440a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c440a0640 0x7f9c440a2b00 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f9c54004800 tx=0x7f9c5401a040 comp rx=0 tx=0).stop 2023-09-13T10:00:05.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c58101850 msgr2=0x7f9c5819de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c58101850 0x7f9c5819de10 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f9c5000efc0 tx=0x7f9c5000c3a0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 shutdown_connections 2023-09-13T10:00:05.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f9c440a0640 0x7f9c440a2b00 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c58101850 0x7f9c5819de10 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9c580ffcc0 0x7f9c58068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 --2- 172.21.15.6:0/1919867988 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f9c58100eb0 0x7f9c5819b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 >> 172.21.15.6:0/1919867988 conn(0x7f9c580fb250 msgr2=0x7f9c580fd4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 shutdown_connections 2023-09-13T10:00:05.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.438+0000 7f9c5f8e2700 1 -- 172.21.15.6:0/1919867988 wait complete. 2023-09-13T10:00:05.453 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:05 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/286014533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:00:05.454 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T10:00:05.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:05 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/286014533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:00:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:05 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/286014533' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:00:05.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 297701 35.00 MB/sec execute 325 sec latency 92.655 ms 2023-09-13T10:00:05.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 -- 172.21.15.6:0/131852600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0101fb0 msgr2=0x7f5ba0102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 --2- 172.21.15.6:0/131852600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0101fb0 0x7f5ba0102410 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f5b94009990 tx=0x7f5b94009ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 -- 172.21.15.6:0/131852600 shutdown_connections 2023-09-13T10:00:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 --2- 172.21.15.6:0/131852600 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ba0102950 0x7f5ba0109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 --2- 172.21.15.6:0/131852600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba0100dc0 0x7f5ba01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 --2- 172.21.15.6:0/131852600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0101fb0 0x7f5ba0102410 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 -- 172.21.15.6:0/131852600 >> 172.21.15.6:0/131852600 conn(0x7f5ba00fc350 msgr2=0x7f5ba00fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 -- 172.21.15.6:0/131852600 shutdown_connections 2023-09-13T10:00:05.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.623+0000 7f5ba4859700 1 -- 172.21.15.6:0/131852600 wait complete. 2023-09-13T10:00:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 Processor -- start 2023-09-13T10:00:05.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 -- start start 2023-09-13T10:00:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100dc0 0x7f5ba0196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ba0101fb0 0x7f5ba0196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba0102950 0x7f5ba019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba019e600 con 0x7f5ba0102950 2023-09-13T10:00:05.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba019e740 con 0x7f5ba0101fb0 2023-09-13T10:00:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5ba4859700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ba019e8d0 con 0x7f5ba0100dc0 2023-09-13T10:00:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5b9e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100dc0 0x7f5ba0196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5b9e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100dc0 0x7f5ba0196a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49756/0 (socket says 172.21.15.6:49756) 2023-09-13T10:00:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5b9e59c700 1 -- 172.21.15.6:0/1964613708 learned_addr learned my addr 172.21.15.6:0/1964613708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ba0101fb0 0x7f5ba0196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.624+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba0102950 0x7f5ba019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b9e59c700 1 -- 172.21.15.6:0/1964613708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ba0101fb0 msgr2=0x7f5ba0196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ba0101fb0 0x7f5ba0196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b9e59c700 1 -- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba0102950 msgr2=0x7f5ba019e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba0102950 0x7f5ba019e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b9e59c700 1 -- 172.21.15.6:0/1964613708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b90009520 con 0x7f5ba0100dc0 2023-09-13T10:00:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba0102950 0x7f5ba019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100dc0 0x7f5ba0196a80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000ea50 tx=0x7f5b9000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b8f7fe700 1 -- 172.21.15.6:0/1964613708 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9000eee0 con 0x7f5ba0100dc0 2023-09-13T10:00:05.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b98009c40 con 0x7f5ba0100dc0 2023-09-13T10:00:05.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b8f7fe700 1 -- 172.21.15.6:0/1964613708 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b9000cbd0 con 0x7f5ba0100dc0 2023-09-13T10:00:05.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5b8f7fe700 1 -- 172.21.15.6:0/1964613708 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b90018680 con 0x7f5ba0100dc0 2023-09-13T10:00:05.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.625+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b940095f0 con 0x7f5ba0100dc0 2023-09-13T10:00:05.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.627+0000 7f5b8f7fe700 1 -- 172.21.15.6:0/1964613708 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5b90010430 con 0x7f5ba0100dc0 2023-09-13T10:00:05.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.628+0000 7f5b8f7fe700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b880a0640 0x7f5b880a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.628+0000 7f5b8f7fe700 1 -- 172.21.15.6:0/1964613708 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5b90014070 con 0x7f5ba0100dc0 2023-09-13T10:00:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.628+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b880a0640 0x7f5b880a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.628+0000 7f5bb0a3eb80 1 Processor -- start 2023-09-13T10:00:05.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5bb0a3eb80 1 -- start start 2023-09-13T10:00:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b880a0640 0x7f5b880a2b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400b680 tx=0x7f5b94005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770b98f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770b978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770b98270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770aec780 con 0x560770b97e10 2023-09-13T10:00:05.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770aea0a0 con 0x560770b99470 2023-09-13T10:00:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770ae5990 con 0x560770b98b10 2023-09-13T10:00:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770b98270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770b98270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46714/0 (socket says 172.21.15.6:46714) 2023-09-13T10:00:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770b98f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/4214722828 learned_addr learned my addr 172.21.15.6:0/4214722828 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770b978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/4214722828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 msgr2=0x560770b98f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770b98f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/4214722828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 msgr2=0x560770b978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770b978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/4214722828 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560770965630 con 0x560770b97e10 2023-09-13T10:00:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.629+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770b98270 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f5b98007610 tx=0x7f5b98009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5932d092c9956a1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5b8cff9700 1 -- 172.21.15.6:0/4214722828 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98009100 con 0x560770b97e10 2023-09-13T10:00:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5b8cff9700 1 -- 172.21.15.6:0/4214722828 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b9800f040 con 0x560770b97e10 2023-09-13T10:00:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5b8cff9700 1 -- 172.21.15.6:0/4214722828 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98017d90 con 0x560770b97e10 2023-09-13T10:00:05.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/4214722828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 msgr2=0x560770b98270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770b98270 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f5b98007610 tx=0x7f5b98009920 comp rx=0 tx=0).stop 2023-09-13T10:00:05.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/4214722828 shutdown_connections 2023-09-13T10:00:05.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770b98270 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770b98f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/4214722828 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770b978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/4214722828 >> 172.21.15.6:0/4214722828 conn(0x560770af1c80 msgr2=0x560770b8df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.630+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/4214722828 shutdown_connections 2023-09-13T10:00:05.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/4214722828 wait complete. 2023-09-13T10:00:05.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 -- start start 2023-09-13T10:00:05.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 Processor -- start 2023-09-13T10:00:05.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b97e10 0x560770ba12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b98b10 0x560770ba1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770ba8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770a83bb0 con 0x560770b98b10 2023-09-13T10:00:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770a838b0 con 0x560770b97e10 2023-09-13T10:00:05.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770967920 con 0x560770b99470 2023-09-13T10:00:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5bb0a3eb80 10 client.0 _ll_register_callbacks cb 0x560770a81680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.631+0000 7f5b9e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b97e10 0x560770ba12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b97e10 0x560770ba12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40240/0 (socket says 172.21.15.6:40240) 2023-09-13T10:00:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9e59c700 1 -- 172.21.15.6:0/297122433 learned_addr learned my addr 172.21.15.6:0/297122433 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770ba8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b98b10 0x560770ba1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/297122433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b97e10 msgr2=0x560770ba12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b97e10 0x560770ba12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/297122433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b98b10 msgr2=0x560770ba1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b98b10 0x560770ba1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/297122433 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b98009260 con 0x560770b99470 2023-09-13T10:00:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b98b10 0x560770ba1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:00:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770ba8850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b980179a0 tx=0x7f5b98003cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fa450649aa402d7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:05.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b85ffb700 1 -- 172.21.15.6:0/297122433 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98009100 con 0x560770b99470 2023-09-13T10:00:05.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5b85ffb700 1 -- 172.21.15.6:0/297122433 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5b9800e900 con 0x560770b99470 2023-09-13T10:00:05.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.632+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560770b86670 con 0x560770b99470 2023-09-13T10:00:05.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5b85ffb700 1 -- 172.21.15.6:0/297122433 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b980176f0 con 0x560770b99470 2023-09-13T10:00:05.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 10 client.30025 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x560770afd7a0 con 0x560770b99470 2023-09-13T10:00:05.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5b85ffb700 1 -- 172.21.15.6:0/297122433 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560770b86670 con 0x560770b99470 2023-09-13T10:00:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5b85ffb700 1 -- 172.21.15.6:0/297122433 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b980045d0 con 0x560770b99470 2023-09-13T10:00:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 10 client.30025 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 10 client.30025 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:00:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 20 client.30025 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770bad090 0x560770baf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 4 client.30025 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560770ade970 con 0x560770bad090 2023-09-13T10:00:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.633+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770bad090 0x560770baf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.634+0000 7f5b85ffb700 10 client.30025 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:05.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.634+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770bad090 0x560770baf4b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5bc474bb8e87156d server_cookie=661ee64054c2ff7e in_seq=0 out_seq=0 2023-09-13T10:00:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5b85ffb700 1 -- 172.21.15.6:0/297122433 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560770ade970 con 0x560770bad090 2023-09-13T10:00:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5b85ffb700 10 client.30025 handle_command_reply: tid=0 2023-09-13T10:00:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 client.30025 shutdown 2023-09-13T10:00:05.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 msgr2=0x560770ba8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770ba8850 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f5b980179a0 tx=0x7f5b98003cb0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 shutdown_connections 2023-09-13T10:00:05.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770bad090 0x560770baf4b0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770ba8850 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b97e10 0x560770ba12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/297122433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b98b10 0x560770ba1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5b85ffb700 0 client.30025 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:05.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 >> 172.21.15.6:0/297122433 conn(0x560770af1c80 msgr2=0x560770b8dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 shutdown_connections 2023-09-13T10:00:05.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.637+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/297122433 wait complete. 2023-09-13T10:00:05.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.638+0000 7f5bb0a3eb80 20 client.30025 trim_cache size 0 max 16384 2023-09-13T10:00:05.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 Processor -- start 2023-09-13T10:00:05.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 -- start start 2023-09-13T10:00:05.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770baf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b98b10 0x560770ba8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770b8de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770b8ffd0 con 0x560770b97e10 2023-09-13T10:00:05.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770ba1f50 con 0x560770b98b10 2023-09-13T10:00:05.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.659+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770b9ef10 con 0x560770b99470 2023-09-13T10:00:05.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770b8de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9dd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b98b10 0x560770ba8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770b8de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49780/0 (socket says 172.21.15.6:49780) 2023-09-13T10:00:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/3167366517 learned_addr learned my addr 172.21.15.6:0/3167366517 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/3167366517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b98b10 msgr2=0x560770ba8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/3167366517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b98b10 0x560770ba8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/3167366517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 msgr2=0x560770baf480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:00:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/3167366517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770baf480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 -- 172.21.15.6:0/3167366517 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560770911de0 con 0x560770b99470 2023-09-13T10:00:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b9ed9d700 1 --2- 172.21.15.6:0/3167366517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770b8de60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5b98017fd0 tx=0x7f5b98017a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cead4e77ed437b2d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.660+0000 7f5b8d7fa700 1 -- 172.21.15.6:0/3167366517 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b98017460 con 0x560770b99470 2023-09-13T10:00:05.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5b8d7fa700 1 -- 172.21.15.6:0/3167366517 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b98024070 con 0x560770b99470 2023-09-13T10:00:05.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5b8d7fa700 1 -- 172.21.15.6:0/3167366517 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b9800e960 con 0x560770b99470 2023-09-13T10:00:05.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3167366517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 msgr2=0x560770b8de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3167366517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770b8de60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f5b98017fd0 tx=0x7f5b98017a60 comp rx=0 tx=0).stop 2023-09-13T10:00:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3167366517 shutdown_connections 2023-09-13T10:00:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3167366517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b99470 0x560770b8de60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3167366517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770b97e10 0x560770baf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3167366517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b98b10 0x560770ba8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.661+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3167366517 >> 172.21.15.6:0/3167366517 conn(0x560770af1c80 msgr2=0x560770b981f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3167366517 shutdown_connections 2023-09-13T10:00:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3167366517 wait complete. 2023-09-13T10:00:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 -- start start 2023-09-13T10:00:05.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 Processor -- start 2023-09-13T10:00:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770ba4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770ba47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770ba77f0 0x560770ba7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770ba81b0 con 0x560770ba77f0 2023-09-13T10:00:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770ba8320 con 0x560770b99470 2023-09-13T10:00:05.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560770ba84e0 con 0x560770b98b10 2023-09-13T10:00:05.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.662+0000 7f5bb0a3eb80 10 client.0 _ll_register_callbacks cb 0x560770a81680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770ba4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770ba77f0 0x560770ba7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770ba4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49782/0 (socket says 172.21.15.6:49782) 2023-09-13T10:00:05.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770ba77f0 0x560770ba7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46732/0 (socket says 172.21.15.6:46732) 2023-09-13T10:00:05.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 -- 172.21.15.6:0/3361077986 learned_addr learned my addr 172.21.15.6:0/3361077986 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770ba47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 -- 172.21.15.6:0/3361077986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 msgr2=0x560770ba47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770ba47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 -- 172.21.15.6:0/3361077986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770ba77f0 msgr2=0x560770ba7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770ba77f0 0x560770ba7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 -- 172.21.15.6:0/3361077986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560770afd7a0 con 0x560770b98b10 2023-09-13T10:00:05.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b9e59c700 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770ba4290 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5b90099560 tx=0x7f5b900b9040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c76d769ea95ac25e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b85ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:05.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b85ffb700 1 -- 172.21.15.6:0/3361077986 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b900a1920 con 0x560770b98b10 2023-09-13T10:00:05.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5b85ffb700 1 -- 172.21.15.6:0/3361077986 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5b9000cd40 con 0x560770b98b10 2023-09-13T10:00:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.663+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b9800f040 con 0x560770b98b10 2023-09-13T10:00:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5b85ffb700 1 -- 172.21.15.6:0/3361077986 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b90097c50 con 0x560770b98b10 2023-09-13T10:00:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 10 client.30031 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5607708fac60 con 0x560770b98b10 2023-09-13T10:00:05.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5b85ffb700 1 -- 172.21.15.6:0/3361077986 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5b9800f040 con 0x560770b98b10 2023-09-13T10:00:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5b85ffb700 1 -- 172.21.15.6:0/3361077986 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f5b900106e0 con 0x560770b98b10 2023-09-13T10:00:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 10 client.30031 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 10 client.30031 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:00:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 20 client.30031 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770c01e70 0x560770c04290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 4 client.30031 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560770a9f050 con 0x560770c01e70 2023-09-13T10:00:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.664+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770c01e70 0x560770c04290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5b9dd9b700 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770c01e70 0x560770c04290 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1c428e793a25ba43 server_cookie=699913215b0b60bf in_seq=0 out_seq=0 2023-09-13T10:00:05.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5b85ffb700 10 client.30031 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5b85ffb700 1 -- 172.21.15.6:0/3361077986 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560770a9f050 con 0x560770c01e70 2023-09-13T10:00:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5b85ffb700 10 client.30031 handle_command_reply: tid=0 2023-09-13T10:00:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 client.30031 shutdown 2023-09-13T10:00:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 msgr2=0x560770ba4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770ba4290 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5b90099560 tx=0x7f5b900b9040 comp rx=0 tx=0).stop 2023-09-13T10:00:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 shutdown_connections 2023-09-13T10:00:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x560770c01e70 0x560770c04290 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560770ba77f0 0x560770ba7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5b85ffb700 0 client.30031 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560770b98b10 0x560770ba4290 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 --2- 172.21.15.6:0/3361077986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560770b99470 0x560770ba47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.665+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 >> 172.21.15.6:0/3361077986 conn(0x560770af1c80 msgr2=0x560770b8de60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.666+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 shutdown_connections 2023-09-13T10:00:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.666+0000 7f5bb0a3eb80 1 -- 172.21.15.6:0/3361077986 wait complete. 2023-09-13T10:00:05.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.666+0000 7f5bb0a3eb80 20 client.30031 trim_cache size 0 max 16384 2023-09-13T10:00:05.681 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:05.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.666+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b880a0640 msgr2=0x7f5b880a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.666+0000 7f5ba4859700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b880a0640 0x7f5b880a2b00 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5b9400b680 tx=0x7f5b94005fd0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.666+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100dc0 msgr2=0x7f5ba0196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.666+0000 7f5ba4859700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100dc0 0x7f5ba0196a80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5b9000ea50 tx=0x7f5b9000ed60 comp rx=0 tx=0).stop 2023-09-13T10:00:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 shutdown_connections 2023-09-13T10:00:05.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5b880a0640 0x7f5b880a2b00 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ba0102950 0x7f5ba019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ba0100dc0 0x7f5ba0196a80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 --2- 172.21.15.6:0/1964613708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ba0101fb0 0x7f5ba0196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 >> 172.21.15.6:0/1964613708 conn(0x7f5ba00fc350 msgr2=0x7f5ba00fe610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 shutdown_connections 2023-09-13T10:00:05.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.668+0000 7f5ba4859700 1 -- 172.21.15.6:0/1964613708 wait complete. 2023-09-13T10:00:05.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T10:00:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 -- 172.21.15.6:0/605046385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c100fd0 msgr2=0x7f305c107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 --2- 172.21.15.6:0/605046385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c100fd0 0x7f305c107880 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f305400b0d0 tx=0x7f305400b3e0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 -- 172.21.15.6:0/605046385 shutdown_connections 2023-09-13T10:00:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 --2- 172.21.15.6:0/605046385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c100fd0 0x7f305c107880 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 --2- 172.21.15.6:0/605046385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c0ff440 0x7f305c0ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 --2- 172.21.15.6:0/605046385 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f305c100630 0x7f305c100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 -- 172.21.15.6:0/605046385 >> 172.21.15.6:0/605046385 conn(0x7f305c0fa9b0 msgr2=0x7f305c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 -- 172.21.15.6:0/605046385 shutdown_connections 2023-09-13T10:00:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.845+0000 7f3064387700 1 -- 172.21.15.6:0/605046385 wait complete. 2023-09-13T10:00:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 Processor -- start 2023-09-13T10:00:05.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 -- start start 2023-09-13T10:00:05.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c0ff440 0x7f305c1033d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f305c100630 0x7f305c101a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c100fd0 0x7f305c101f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c1026f0 con 0x7f305c0ff440 2023-09-13T10:00:05.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c102860 con 0x7f305c100630 2023-09-13T10:00:05.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3064387700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305c1a0be0 con 0x7f305c100fd0 2023-09-13T10:00:05.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3062123700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c0ff440 0x7f305c1033d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.846+0000 7f3062123700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c0ff440 0x7f305c1033d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46742/0 (socket says 172.21.15.6:46742) 2023-09-13T10:00:05.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062123700 1 -- 172.21.15.6:0/4134463933 learned_addr learned my addr 172.21.15.6:0/4134463933 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3061922700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f305c100630 0x7f305c101a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062924700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c100fd0 0x7f305c101f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062123700 1 -- 172.21.15.6:0/4134463933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c100fd0 msgr2=0x7f305c101f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062123700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c100fd0 0x7f305c101f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062123700 1 -- 172.21.15.6:0/4134463933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f305c100630 msgr2=0x7f305c101a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062123700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f305c100630 0x7f305c101a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062123700 1 -- 172.21.15.6:0/4134463933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3054009d00 con 0x7f305c0ff440 2023-09-13T10:00:05.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3061922700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f305c100630 0x7f305c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3062123700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c0ff440 0x7f305c1033d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f305800e970 tx=0x7f305800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f30537fe700 1 -- 172.21.15.6:0/4134463933 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058009790 con 0x7f305c0ff440 2023-09-13T10:00:05.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f305c1a0ec0 con 0x7f305c0ff440 2023-09-13T10:00:05.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c1a1340 con 0x7f305c0ff440 2023-09-13T10:00:05.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f30537fe700 1 -- 172.21.15.6:0/4134463933 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f305800c7e0 con 0x7f305c0ff440 2023-09-13T10:00:05.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.847+0000 7f30537fe700 1 -- 172.21.15.6:0/4134463933 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3058003b60 con 0x7f305c0ff440 2023-09-13T10:00:05.858 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.851+0000 7f30537fe700 1 -- 172.21.15.6:0/4134463933 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f3058018430 con 0x7f305c0ff440 2023-09-13T10:00:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.851+0000 7f30537fe700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30480a0640 0x7f30480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f30537fe700 1 -- 172.21.15.6:0/4134463933 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3058014070 con 0x7f305c0ff440 2023-09-13T10:00:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f307056cb80 1 Processor -- start 2023-09-13T10:00:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f307056cb80 1 -- start start 2023-09-13T10:00:05.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f3061922700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30480a0640 0x7f30480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f307056cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba6f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f307056cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6f870 0x55e00ba6dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f307056cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6e210 0x55e00ba6e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.852+0000 7f307056cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9be780 con 0x55e00ba6ef10 2023-09-13T10:00:05.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f307056cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9bc0a0 con 0x55e00ba6e210 2023-09-13T10:00:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f307056cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9b7990 con 0x55e00ba6f870 2023-09-13T10:00:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3061922700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6f870 0x55e00ba6dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3061922700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6f870 0x55e00ba6dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49806/0 (socket says 172.21.15.6:49806) 2023-09-13T10:00:05.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3061922700 1 -- 172.21.15.6:0/675223121 learned_addr learned my addr 172.21.15.6:0/675223121 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062924700 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6e210 0x55e00ba6e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062123700 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba6f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062924700 1 -- 172.21.15.6:0/675223121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6f870 msgr2=0x55e00ba6dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062924700 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6f870 0x55e00ba6dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062924700 1 -- 172.21.15.6:0/675223121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 msgr2=0x55e00ba6f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062924700 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba6f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062924700 1 -- 172.21.15.6:0/675223121 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00b837630 con 0x55e00ba6e210 2023-09-13T10:00:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062123700 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba6f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T10:00:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3061922700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30480a0640 0x7f30480a2b00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f304c011a00 tx=0x7f304c011dc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.853+0000 7f3062924700 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6e210 0x55e00ba6e670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3054009fd0 tx=0x7f3054009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c44218268d7c575 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.854+0000 7f3050d82700 1 -- 172.21.15.6:0/675223121 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305400e040 con 0x55e00ba6e210 2023-09-13T10:00:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.854+0000 7f3050d82700 1 -- 172.21.15.6:0/675223121 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3054009360 con 0x55e00ba6e210 2023-09-13T10:00:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.854+0000 7f3050d82700 1 -- 172.21.15.6:0/675223121 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3054003e00 con 0x55e00ba6e210 2023-09-13T10:00:05.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 -- 172.21.15.6:0/675223121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6e210 msgr2=0x55e00ba6e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6e210 0x55e00ba6e670 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f3054009fd0 tx=0x7f3054009c60 comp rx=0 tx=0).stop 2023-09-13T10:00:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 -- 172.21.15.6:0/675223121 shutdown_connections 2023-09-13T10:00:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6e210 0x55e00ba6e670 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba6f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 --2- 172.21.15.6:0/675223121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6f870 0x55e00ba6dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 -- 172.21.15.6:0/675223121 >> 172.21.15.6:0/675223121 conn(0x55e00b9c3c80 msgr2=0x55e00ba5ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 -- 172.21.15.6:0/675223121 shutdown_connections 2023-09-13T10:00:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 -- 172.21.15.6:0/675223121 wait complete. 2023-09-13T10:00:05.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 -- start start 2023-09-13T10:00:05.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.855+0000 7f307056cb80 1 Processor -- start 2023-09-13T10:00:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f307056cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba67120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f307056cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba67660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f307056cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba6c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f307056cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b955bb0 con 0x55e00ba6ef10 2023-09-13T10:00:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f307056cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b9558b0 con 0x55e00ba6f870 2023-09-13T10:00:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f307056cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00b839920 con 0x55e00ba6e210 2023-09-13T10:00:05.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f307056cb80 10 client.0 _ll_register_callbacks cb 0x55e00b953680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba67120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49810/0 (socket says 172.21.15.6:49810) 2023-09-13T10:00:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 -- 172.21.15.6:0/2402420658 learned_addr learned my addr 172.21.15.6:0/2402420658 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062924700 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba6c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 -- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 msgr2=0x55e00ba6c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba6c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 -- 172.21.15.6:0/2402420658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 msgr2=0x55e00ba67660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:00:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba67660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 -- 172.21.15.6:0/2402420658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f305c1081d0 con 0x55e00ba6e210 2023-09-13T10:00:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3062123700 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba67120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3058005950 tx=0x7f305809ac10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d871be96c56bcb28 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.856+0000 7f3045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f3045ffb700 1 -- 172.21.15.6:0/2402420658 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305809e170 con 0x55e00ba6e210 2023-09-13T10:00:05.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e00ba58670 con 0x55e00ba6e210 2023-09-13T10:00:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f3045ffb700 1 -- 172.21.15.6:0/2402420658 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f30580a2580 con 0x55e00ba6e210 2023-09-13T10:00:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f3045ffb700 1 -- 172.21.15.6:0/2402420658 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f305801f340 con 0x55e00ba6e210 2023-09-13T10:00:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 10 client.30043 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55e00b9cf7a0 con 0x55e00ba6e210 2023-09-13T10:00:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f3045ffb700 1 -- 172.21.15.6:0/2402420658 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3058064080 con 0x55e00ba6e210 2023-09-13T10:00:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f3045ffb700 1 -- 172.21.15.6:0/2402420658 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f3058066130 con 0x55e00ba6e210 2023-09-13T10:00:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 10 client.30043 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 10 client.30043 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:05.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 20 client.30043 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00ba8bc80 0x55e00ba8e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 4 client.30043 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.857+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e00b9b0970 con 0x55e00ba8bc80 2023-09-13T10:00:05.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.861+0000 7f3061922700 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00ba8bc80 0x55e00ba8e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.861+0000 7f3045ffb700 10 client.30043 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:05.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.861+0000 7f3061922700 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00ba8bc80 0x55e00ba8e0a0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c66a674dcdaadaa server_cookie=a778e90ac8367582 in_seq=0 out_seq=0 2023-09-13T10:00:05.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.863+0000 7f3045ffb700 1 -- 172.21.15.6:0/2402420658 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e00b9b0970 con 0x55e00ba8bc80 2023-09-13T10:00:05.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.863+0000 7f3045ffb700 10 client.30043 handle_command_reply: tid=0 2023-09-13T10:00:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 client.30043 shutdown 2023-09-13T10:00:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 msgr2=0x55e00ba67120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba67120 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f3058005950 tx=0x7f305809ac10 comp rx=0 tx=0).stop 2023-09-13T10:00:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 shutdown_connections 2023-09-13T10:00:05.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba6c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba67120 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00ba8bc80 0x55e00ba8e0a0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 --2- 172.21.15.6:0/2402420658 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6ef10 0x55e00ba67660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f3045ffb700 0 client.30043 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 >> 172.21.15.6:0/2402420658 conn(0x55e00b9c3c80 msgr2=0x55e00ba5a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 shutdown_connections 2023-09-13T10:00:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 1 -- 172.21.15.6:0/2402420658 wait complete. 2023-09-13T10:00:05.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.864+0000 7f307056cb80 20 client.30043 trim_cache size 0 max 16384 2023-09-13T10:00:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.880+0000 7f307056cb80 1 Processor -- start 2023-09-13T10:00:05.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.880+0000 7f307056cb80 1 -- start start 2023-09-13T10:00:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.880+0000 7f307056cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6e210 0x55e00ba6f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f307056cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6ef10 0x55e00ba6c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f307056cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba9b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f307056cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00ba6de00 con 0x55e00ba6e210 2023-09-13T10:00:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f307056cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00ba9bdc0 con 0x55e00ba6f870 2023-09-13T10:00:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f307056cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00ba68270 con 0x55e00ba6ef10 2023-09-13T10:00:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062123700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6e210 0x55e00ba6f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3061922700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6ef10 0x55e00ba6c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3061922700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6ef10 0x55e00ba6c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49818/0 (socket says 172.21.15.6:49818) 2023-09-13T10:00:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3061922700 1 -- 172.21.15.6:0/148772870 learned_addr learned my addr 172.21.15.6:0/148772870 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062924700 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba9b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062123700 1 -- 172.21.15.6:0/148772870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6ef10 msgr2=0x55e00ba6c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062123700 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6ef10 0x55e00ba6c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062123700 1 -- 172.21.15.6:0/148772870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 msgr2=0x55e00ba9b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062123700 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba9b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062123700 1 -- 172.21.15.6:0/148772870 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e00b7e3de0 con 0x55e00ba6e210 2023-09-13T10:00:05.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3061922700 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6ef10 0x55e00ba6c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3062123700 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6e210 0x55e00ba6f2f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f3058096f80 tx=0x7f305809e4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd0a5338ed950893 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.881+0000 7f3051583700 1 -- 172.21.15.6:0/148772870 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305809e170 con 0x55e00ba6e210 2023-09-13T10:00:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f3051583700 1 -- 172.21.15.6:0/148772870 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55e00ba58670 con 0x55e00ba6e210 2023-09-13T10:00:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f3051583700 1 -- 172.21.15.6:0/148772870 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30580a2200 con 0x55e00ba6e210 2023-09-13T10:00:05.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 -- 172.21.15.6:0/148772870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6e210 msgr2=0x55e00ba6f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6e210 0x55e00ba6f2f0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f3058096f80 tx=0x7f305809e4c0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 -- 172.21.15.6:0/148772870 shutdown_connections 2023-09-13T10:00:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6f870 0x55e00ba9b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6e210 0x55e00ba6f2f0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 --2- 172.21.15.6:0/148772870 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6ef10 0x55e00ba6c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 -- 172.21.15.6:0/148772870 >> 172.21.15.6:0/148772870 conn(0x55e00b9c3c80 msgr2=0x55e00ba5fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 -- 172.21.15.6:0/148772870 shutdown_connections 2023-09-13T10:00:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.882+0000 7f307056cb80 1 -- 172.21.15.6:0/148772870 wait complete. 2023-09-13T10:00:05.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 -- start start 2023-09-13T10:00:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 Processor -- start 2023-09-13T10:00:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba9af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6ef10 0x55e00ba9b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6f870 0x55e00bade8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00badee10 con 0x55e00ba6f870 2023-09-13T10:00:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00badef50 con 0x55e00ba6ef10 2023-09-13T10:00:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00badf0e0 con 0x55e00ba6e210 2023-09-13T10:00:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f307056cb80 10 client.0 _ll_register_callbacks cb 0x55e00b953680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:05.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f3062924700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6f870 0x55e00bade8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f3062123700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba9af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f3062924700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6f870 0x55e00bade8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46772/0 (socket says 172.21.15.6:46772) 2023-09-13T10:00:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f3062924700 1 -- 172.21.15.6:0/3944063876 learned_addr learned my addr 172.21.15.6:0/3944063876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:05.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f3061922700 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6ef10 0x55e00ba9b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f3062924700 1 -- 172.21.15.6:0/3944063876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 msgr2=0x55e00ba9af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.883+0000 7f3062924700 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba9af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3062924700 1 -- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6ef10 msgr2=0x55e00ba9b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:05.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3062924700 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6ef10 0x55e00ba9b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3062924700 1 -- 172.21.15.6:0/3944063876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f304c025040 con 0x55e00ba6f870 2023-09-13T10:00:05.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3062123700 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba9af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:05.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3062924700 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6f870 0x55e00bade8d0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f305400d010 tx=0x7f3054000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da14a90a1c7cacb9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:05.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3045ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:05.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3045ffb700 1 -- 172.21.15.6:0/3944063876 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305402a040 con 0x55e00ba6f870 2023-09-13T10:00:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3054009360 con 0x55e00ba6f870 2023-09-13T10:00:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3045ffb700 1 -- 172.21.15.6:0/3944063876 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f3054003c00 con 0x55e00ba6f870 2023-09-13T10:00:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3045ffb700 1 -- 172.21.15.6:0/3944063876 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f305400e040 con 0x55e00ba6f870 2023-09-13T10:00:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f307056cb80 10 client.20844 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:05.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55e00b9cf7a0 con 0x55e00ba6f870 2023-09-13T10:00:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.884+0000 7f3045ffb700 1 -- 172.21.15.6:0/3944063876 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f3054009360 con 0x55e00ba6f870 2023-09-13T10:00:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f3045ffb700 1 -- 172.21.15.6:0/3944063876 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f305400b100 con 0x55e00ba6f870 2023-09-13T10:00:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f307056cb80 10 client.20844 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:05.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f307056cb80 10 client.20844 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f307056cb80 20 client.20844 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f307056cb80 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00bae0670 0x55e00bae2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f307056cb80 4 client.20844 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e00b971050 con 0x55e00bae0670 2023-09-13T10:00:05.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f3062123700 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00bae0670 0x55e00bae2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:05.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f3045ffb700 10 client.20844 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:05.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.885+0000 7f3062123700 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00bae0670 0x55e00bae2a60 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3c55b7014da17ad server_cookie=b9fbcb141bb6fd64 in_seq=0 out_seq=0 2023-09-13T10:00:05.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f3045ffb700 1 -- 172.21.15.6:0/3944063876 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e00b971050 con 0x55e00bae0670 2023-09-13T10:00:05.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f3045ffb700 10 client.20844 handle_command_reply: tid=0 2023-09-13T10:00:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 client.20844 shutdown 2023-09-13T10:00:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6f870 msgr2=0x55e00bade8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6f870 0x55e00bade8d0 secure :-1 s=READY pgs=1818 cs=0 l=1 rev1=1 crypto rx=0x7f305400d010 tx=0x7f3054000f40 comp rx=0 tx=0).stop 2023-09-13T10:00:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 shutdown_connections 2023-09-13T10:00:05.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55e00bae0670 0x55e00bae2a60 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e00ba6f870 0x55e00bade8d0 unknown :-1 s=CLOSED pgs=1818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f3045ffb700 0 client.20844 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e00ba6e210 0x55e00ba9af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 --2- 172.21.15.6:0/3944063876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e00ba6ef10 0x55e00ba9b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 >> 172.21.15.6:0/3944063876 conn(0x55e00b9c3c80 msgr2=0x55e00ba66ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 shutdown_connections 2023-09-13T10:00:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 1 -- 172.21.15.6:0/3944063876 wait complete. 2023-09-13T10:00:05.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.888+0000 7f307056cb80 20 client.20844 trim_cache size 0 max 16384 2023-09-13T10:00:05.907 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:05.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30480a0640 msgr2=0x7f30480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30480a0640 0x7f30480a2b00 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f304c011a00 tx=0x7f304c011dc0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c0ff440 msgr2=0x7f305c1033d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:05.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c0ff440 0x7f305c1033d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f305800e970 tx=0x7f305800ec80 comp rx=0 tx=0).stop 2023-09-13T10:00:05.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 shutdown_connections 2023-09-13T10:00:05.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f305c100fd0 0x7f305c101f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30480a0640 0x7f30480a2b00 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f305c0ff440 0x7f305c1033d0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 --2- 172.21.15.6:0/4134463933 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f305c100630 0x7f305c101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 >> 172.21.15.6:0/4134463933 conn(0x7f305c0fa9b0 msgr2=0x7f305c0fb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:05.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 shutdown_connections 2023-09-13T10:00:05.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:05.890+0000 7f3064387700 1 -- 172.21.15.6:0/4134463933 wait complete. 2023-09-13T10:00:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:06 smithi006 ceph-mon[98665]: pgmap v917: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-13T10:00:06.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:06 smithi053 ceph-mon[102373]: pgmap v917: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-13T10:00:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:06 smithi131 ceph-mon[102785]: pgmap v917: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 515 op/s 2023-09-13T10:00:06.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 298387 35.03 MB/sec execute 326 sec latency 82.215 ms 2023-09-13T10:00:06.911 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T10:00:06.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T10:00:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.074+0000 7f150bfbf700 1 -- 172.21.15.6:0/3880431628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 msgr2=0x7f1504108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.074+0000 7f150bfbf700 1 --2- 172.21.15.6:0/3880431628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f1504108100 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f14fc00b0d0 tx=0x7f14fc00b3e0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.074+0000 7f150bfbf700 1 -- 172.21.15.6:0/3880431628 shutdown_connections 2023-09-13T10:00:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.074+0000 7f150bfbf700 1 --2- 172.21.15.6:0/3880431628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f1504108100 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.074+0000 7f150bfbf700 1 --2- 172.21.15.6:0/3880431628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f15040ffcc0 0x7f15041000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.074+0000 7f150bfbf700 1 --2- 172.21.15.6:0/3880431628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1504100eb0 0x7f1504101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.074+0000 7f150bfbf700 1 -- 172.21.15.6:0/3880431628 >> 172.21.15.6:0/3880431628 conn(0x7f15040fb210 msgr2=0x7f15040fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.075+0000 7f150bfbf700 1 -- 172.21.15.6:0/3880431628 shutdown_connections 2023-09-13T10:00:07.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.075+0000 7f150bfbf700 1 -- 172.21.15.6:0/3880431628 wait complete. 2023-09-13T10:00:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 Processor -- start 2023-09-13T10:00:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 -- start start 2023-09-13T10:00:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15040ffcc0 0x7f1504069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1504100eb0 0x7f150419b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f150419df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150419e6b0 con 0x7f1504101850 2023-09-13T10:00:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150419e820 con 0x7f1504100eb0 2023-09-13T10:00:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150bfbf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15041956a0 con 0x7f15040ffcc0 2023-09-13T10:00:07.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150a55c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f150419df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150955a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1504100eb0 0x7f150419b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150a55c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f150419df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46784/0 (socket says 172.21.15.6:46784) 2023-09-13T10:00:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f150a55c700 1 -- 172.21.15.6:0/2714250438 learned_addr learned my addr 172.21.15.6:0/2714250438 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.076+0000 7f1509d5b700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15040ffcc0 0x7f1504069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.077+0000 7f150a55c700 1 -- 172.21.15.6:0/2714250438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15040ffcc0 msgr2=0x7f1504069800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.077+0000 7f150a55c700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15040ffcc0 0x7f1504069800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.077+0000 7f150a55c700 1 -- 172.21.15.6:0/2714250438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1504100eb0 msgr2=0x7f150419b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.077+0000 7f150a55c700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1504100eb0 0x7f150419b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.077+0000 7f150a55c700 1 -- 172.21.15.6:0/2714250438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc009d00 con 0x7f1504101850 2023-09-13T10:00:07.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.077+0000 7f150a55c700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f150419df10 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f14fc007990 tx=0x7f14fc008eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.077+0000 7f14faffd700 1 -- 172.21.15.6:0/2714250438 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc00e040 con 0x7f1504101850 2023-09-13T10:00:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.078+0000 7f14faffd700 1 -- 172.21.15.6:0/2714250438 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14fc00be30 con 0x7f1504101850 2023-09-13T10:00:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.078+0000 7f14faffd700 1 -- 172.21.15.6:0/2714250438 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc01d6d0 con 0x7f1504101850 2023-09-13T10:00:07.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.078+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1504195920 con 0x7f1504101850 2023-09-13T10:00:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.078+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1504195de0 con 0x7f1504101850 2023-09-13T10:00:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.083+0000 7f14faffd700 1 -- 172.21.15.6:0/2714250438 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f14fc0051b0 con 0x7f1504101850 2023-09-13T10:00:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.083+0000 7f15181a4b80 1 Processor -- start 2023-09-13T10:00:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.084+0000 7f14faffd700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f14f00a0740 0x7f14f00a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.084+0000 7f150955a700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f14f00a0740 0x7f14f00a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.084+0000 7f14faffd700 1 -- 172.21.15.6:0/2714250438 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f14fc0cc580 con 0x7f1504101850 2023-09-13T10:00:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f15181a4b80 1 -- start start 2023-09-13T10:00:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e899f780 0x5617e899fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e89a00e0 0x5617e899e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899ea80 0x5617e899ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f15181a4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e88f7800 con 0x5617e899f780 2023-09-13T10:00:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f15181a4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e88f5120 con 0x5617e899ea80 2023-09-13T10:00:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f15181a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e88f0a10 con 0x5617e89a00e0 2023-09-13T10:00:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f1509d5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e899f780 0x5617e899fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f1509d5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e899f780 0x5617e899fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46790/0 (socket says 172.21.15.6:46790) 2023-09-13T10:00:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f1509d5b700 1 -- 172.21.15.6:0/4150131713 learned_addr learned my addr 172.21.15.6:0/4150131713 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.085+0000 7f150a55c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899ea80 0x5617e899ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f150955a700 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e89a00e0 0x5617e899e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f150a55c700 1 -- 172.21.15.6:0/4150131713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e89a00e0 msgr2=0x5617e899e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f150a55c700 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e89a00e0 0x5617e899e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f150a55c700 1 -- 172.21.15.6:0/4150131713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e899f780 msgr2=0x5617e899fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f150a55c700 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e899f780 0x5617e899fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f150a55c700 1 -- 172.21.15.6:0/4150131713 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617e87706b0 con 0x5617e899ea80 2023-09-13T10:00:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f1509d5b700 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e899f780 0x5617e899fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f150a55c700 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899ea80 0x5617e899ef00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f14fc099ce0 tx=0x7f14fc00b3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=143188782f27310d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f14effff700 1 -- 172.21.15.6:0/4150131713 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc09a450 con 0x5617e899ea80 2023-09-13T10:00:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f14effff700 1 -- 172.21.15.6:0/4150131713 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14fc099d50 con 0x5617e899ea80 2023-09-13T10:00:07.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.086+0000 7f14effff700 1 -- 172.21.15.6:0/4150131713 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0cc370 con 0x5617e899ea80 2023-09-13T10:00:07.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.087+0000 7f15181a4b80 1 -- 172.21.15.6:0/4150131713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899ea80 msgr2=0x5617e899ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.087+0000 7f15181a4b80 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899ea80 0x5617e899ef00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f14fc099ce0 tx=0x7f14fc00b3e0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.087+0000 7f15181a4b80 1 -- 172.21.15.6:0/4150131713 shutdown_connections 2023-09-13T10:00:07.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.087+0000 7f15181a4b80 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899ea80 0x5617e899ef00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.087+0000 7f15181a4b80 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e899f780 0x5617e899fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.087+0000 7f15181a4b80 1 --2- 172.21.15.6:0/4150131713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e89a00e0 0x5617e899e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.087+0000 7f15181a4b80 1 -- 172.21.15.6:0/4150131713 >> 172.21.15.6:0/4150131713 conn(0x5617e88fcd00 msgr2=0x5617e8998f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.088+0000 7f150955a700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f14f00a0740 0x7f14f00a2c00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009bf0 tx=0x7f14f4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.088+0000 7f15181a4b80 1 -- 172.21.15.6:0/4150131713 shutdown_connections 2023-09-13T10:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.088+0000 7f15181a4b80 1 -- 172.21.15.6:0/4150131713 wait complete. 2023-09-13T10:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.088+0000 7f15181a4b80 1 -- start start 2023-09-13T10:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.088+0000 7f15181a4b80 1 Processor -- start 2023-09-13T10:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89a82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89af320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f15181a4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e888ec30 con 0x5617e89a00e0 2023-09-13T10:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f15181a4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e888e930 con 0x5617e899f780 2023-09-13T10:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f15181a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e87729a0 con 0x5617e899ea80 2023-09-13T10:00:07.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f15181a4b80 10 client.0 _ll_register_callbacks cb 0x5617e888c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f1509d5b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f1509d5b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49850/0 (socket says 172.21.15.6:49850) 2023-09-13T10:00:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f1509d5b700 1 -- 172.21.15.6:0/184525340 learned_addr learned my addr 172.21.15.6:0/184525340 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.089+0000 7f150a55c700 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f150955a700 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89a82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f1509d5b700 1 -- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 msgr2=0x5617e89a82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f1509d5b700 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89a82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f1509d5b700 1 -- 172.21.15.6:0/184525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 msgr2=0x5617e89af320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f1509d5b700 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89af320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f1509d5b700 1 -- 172.21.15.6:0/184525340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1504195de0 con 0x5617e899ea80 2023-09-13T10:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f1509d5b700 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89a7da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15000116f0 tx=0x7f1500011a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=adfcc1a7222b2eee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f14ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f14ed7fa700 1 -- 172.21.15.6:0/184525340 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500016070 con 0x5617e899ea80 2023-09-13T10:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5617e89916f0 con 0x5617e899ea80 2023-09-13T10:00:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.090+0000 7f14ed7fa700 1 -- 172.21.15.6:0/184525340 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1500010640 con 0x5617e899ea80 2023-09-13T10:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.091+0000 7f14ed7fa700 1 -- 172.21.15.6:0/184525340 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1500010840 con 0x5617e899ea80 2023-09-13T10:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.093+0000 7f15181a4b80 10 client.30061 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.093+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5617e8908820 con 0x5617e899ea80 2023-09-13T10:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.093+0000 7f14ed7fa700 1 -- 172.21.15.6:0/184525340 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1500029080 con 0x5617e899ea80 2023-09-13T10:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.094+0000 7f14ed7fa700 1 -- 172.21.15.6:0/184525340 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1500025a70 con 0x5617e899ea80 2023-09-13T10:00:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.094+0000 7f15181a4b80 10 client.30061 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.094+0000 7f15181a4b80 10 client.30061 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.094+0000 7f15181a4b80 20 client.30061 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.094+0000 7f15181a4b80 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e89b3bd0 0x5617e89b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.094+0000 7f15181a4b80 4 client.30061 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.094+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5617e88e99f0 con 0x5617e89b3bd0 2023-09-13T10:00:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.099+0000 7f150955a700 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e89b3bd0 0x5617e89b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.100+0000 7f14ed7fa700 10 client.30061 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.100+0000 7f150955a700 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e89b3bd0 0x5617e89b5ff0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce21dc58e98ea0a8 server_cookie=3deed7381f2ce2a9 in_seq=0 out_seq=0 2023-09-13T10:00:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f14ed7fa700 1 -- 172.21.15.6:0/184525340 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5617e88e99f0 con 0x5617e89b3bd0 2023-09-13T10:00:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f14ed7fa700 10 client.30061 handle_command_reply: tid=0 2023-09-13T10:00:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 client.30061 shutdown 2023-09-13T10:00:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 msgr2=0x5617e89a7da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89a7da0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f15000116f0 tx=0x7f1500011a00 comp rx=0 tx=0).stop 2023-09-13T10:00:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 shutdown_connections 2023-09-13T10:00:07.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e89b3bd0 0x5617e89b5ff0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89af320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89a7da0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 --2- 172.21.15.6:0/184525340 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89a82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 >> 172.21.15.6:0/184525340 conn(0x5617e88fcd00 msgr2=0x5617e8993870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f14ed7fa700 0 client.30061 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 shutdown_connections 2023-09-13T10:00:07.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.104+0000 7f15181a4b80 1 -- 172.21.15.6:0/184525340 wait complete. 2023-09-13T10:00:07.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.105+0000 7f15181a4b80 20 client.30061 trim_cache size 0 max 16384 2023-09-13T10:00:07.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.129+0000 7f15181a4b80 1 Processor -- start 2023-09-13T10:00:07.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f15181a4b80 1 -- start start 2023-09-13T10:00:07.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e899e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f15181a4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e88e99f0 con 0x5617e89a00e0 2023-09-13T10:00:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f15181a4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e89a7250 con 0x5617e899f780 2023-09-13T10:00:07.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f15181a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e899a3d0 con 0x5617e899ea80 2023-09-13T10:00:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89a8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46808/0 (socket says 172.21.15.6:46808) 2023-09-13T10:00:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 -- 172.21.15.6:0/870533059 learned_addr learned my addr 172.21.15.6:0/870533059 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f1509d5b700 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e899e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150955a700 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 -- 172.21.15.6:0/870533059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 msgr2=0x5617e899e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e899e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 -- 172.21.15.6:0/870533059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 msgr2=0x5617e89af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.130+0000 7f150a55c700 1 -- 172.21.15.6:0/870533059 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5617e871ce60 con 0x5617e89a00e0 2023-09-13T10:00:07.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.131+0000 7f150a55c700 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89a8260 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0a1800 tx=0x7f14fc009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41dfc32e8bbc5b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.131+0000 7f14f8ff9700 1 -- 172.21.15.6:0/870533059 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc09a450 con 0x5617e89a00e0 2023-09-13T10:00:07.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.131+0000 7f14f8ff9700 1 -- 172.21.15.6:0/870533059 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14fc09db80 con 0x5617e89a00e0 2023-09-13T10:00:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.131+0000 7f14f8ff9700 1 -- 172.21.15.6:0/870533059 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc099fb0 con 0x5617e89a00e0 2023-09-13T10:00:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.132+0000 7f15181a4b80 1 -- 172.21.15.6:0/870533059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 msgr2=0x5617e89a8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.132+0000 7f15181a4b80 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89a8260 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f14fc0a1800 tx=0x7f14fc009a50 comp rx=0 tx=0).stop 2023-09-13T10:00:07.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.132+0000 7f15181a4b80 1 -- 172.21.15.6:0/870533059 shutdown_connections 2023-09-13T10:00:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.132+0000 7f15181a4b80 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e89a8260 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.132+0000 7f15181a4b80 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e899e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.132+0000 7f15181a4b80 1 --2- 172.21.15.6:0/870533059 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.132+0000 7f15181a4b80 1 -- 172.21.15.6:0/870533059 >> 172.21.15.6:0/870533059 conn(0x5617e88fcd00 msgr2=0x5617e89a7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.134+0000 7f15181a4b80 1 -- 172.21.15.6:0/870533059 shutdown_connections 2023-09-13T10:00:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.134+0000 7f15181a4b80 1 -- 172.21.15.6:0/870533059 wait complete. 2023-09-13T10:00:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 -- start start 2023-09-13T10:00:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 Processor -- start 2023-09-13T10:00:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89ac0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89ac5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e8a079f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e89acc40 con 0x5617e89a00e0 2023-09-13T10:00:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e8a07f30 con 0x5617e899f780 2023-09-13T10:00:07.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5617e8a08070 con 0x5617e899ea80 2023-09-13T10:00:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.135+0000 7f15181a4b80 10 client.0 _ll_register_callbacks cb 0x5617e888c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89ac0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f150955a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89ac5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89ac0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:49864/0 (socket says 172.21.15.6:49864) 2023-09-13T10:00:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 -- 172.21.15.6:0/2658339129 learned_addr learned my addr 172.21.15.6:0/2658339129 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f150a55c700 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e8a079f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 -- 172.21.15.6:0/2658339129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 msgr2=0x5617e89ac5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89ac5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 -- 172.21.15.6:0/2658339129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 msgr2=0x5617e8a079f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e8a079f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 -- 172.21.15.6:0/2658339129 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5617e87706b0 con 0x5617e899ea80 2023-09-13T10:00:07.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f150a55c700 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e8a079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f1509d5b700 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89ac0b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1500025e20 tx=0x7f1500011e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=258ac2c05bc5354e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.136+0000 7f14ed7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f14ed7fa700 1 -- 172.21.15.6:0/2658339129 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1500016040 con 0x5617e899ea80 2023-09-13T10:00:07.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f14ed7fa700 1 -- 172.21.15.6:0/2658339129 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15000055d0 con 0x5617e899ea80 2023-09-13T10:00:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f14fc099d50 con 0x5617e899ea80 2023-09-13T10:00:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f14ed7fa700 1 -- 172.21.15.6:0/2658339129 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1500031890 con 0x5617e899ea80 2023-09-13T10:00:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 10 client.30067 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x5617e8705ce0 con 0x5617e899ea80 2023-09-13T10:00:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f14ed7fa700 1 -- 172.21.15.6:0/2658339129 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f14fc099d50 con 0x5617e899ea80 2023-09-13T10:00:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f14ed7fa700 1 -- 172.21.15.6:0/2658339129 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7f1500003680 con 0x5617e899ea80 2023-09-13T10:00:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 10 client.30067 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 10 client.30067 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 20 client.30067 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e8a09ae0 0x5617e8a0bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.137+0000 7f15181a4b80 4 client.30067 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T10:00:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.138+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5617e88aa0d0 con 0x5617e8a09ae0 2023-09-13T10:00:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.140+0000 7f150955a700 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e8a09ae0 0x5617e8a0bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.144+0000 7f14ed7fa700 10 client.30067 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.144+0000 7f150955a700 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e8a09ae0 0x5617e8a0bf00 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1401b39aab6ebd server_cookie=c823d63c30ffff20 in_seq=0 out_seq=0 2023-09-13T10:00:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.146+0000 7f14ed7fa700 1 -- 172.21.15.6:0/2658339129 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5617e88aa0d0 con 0x5617e8a09ae0 2023-09-13T10:00:07.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.146+0000 7f14ed7fa700 10 client.30067 handle_command_reply: tid=0 2023-09-13T10:00:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.146+0000 7f15181a4b80 1 client.30067 shutdown 2023-09-13T10:00:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.146+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 msgr2=0x5617e89ac0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.146+0000 7f15181a4b80 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89ac0b0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1500025e20 tx=0x7f1500011e00 comp rx=0 tx=0).stop 2023-09-13T10:00:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 shutdown_connections 2023-09-13T10:00:07.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5617e8a09ae0 0x5617e8a0bf00 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5617e89a00e0 0x5617e8a079f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5617e899ea80 0x5617e89ac0b0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 --2- 172.21.15.6:0/2658339129 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5617e899f780 0x5617e89ac5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 >> 172.21.15.6:0/2658339129 conn(0x5617e88fcd00 msgr2=0x5617e899d530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f14ed7fa700 0 client.30067 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 shutdown_connections 2023-09-13T10:00:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 1 -- 172.21.15.6:0/2658339129 wait complete. 2023-09-13T10:00:07.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f15181a4b80 20 client.30067 trim_cache size 0 max 16384 2023-09-13T10:00:07.155 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:00:07.156 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T10:00:07.156 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "5dcaf118-0978-4746-91be-df55023a00b6", 2023-09-13T10:00:07.156 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T10:00:07.156 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:00:07.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f14f00a0740 msgr2=0x7f14f00a2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f14f00a0740 0x7f14f00a2c00 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f14f4009bf0 tx=0x7f14f4009260 comp rx=0 tx=0).stop 2023-09-13T10:00:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 msgr2=0x7f150419df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f150419df10 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f14fc007990 tx=0x7f14fc008eb0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 shutdown_connections 2023-09-13T10:00:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f14f00a0740 0x7f14f00a2c00 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1504101850 0x7f150419df10 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15040ffcc0 0x7f1504069800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 --2- 172.21.15.6:0/2714250438 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1504100eb0 0x7f150419b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.147+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 >> 172.21.15.6:0/2714250438 conn(0x7f15040fb210 msgr2=0x7f1504104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.148+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 shutdown_connections 2023-09-13T10:00:07.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.148+0000 7f150bfbf700 1 -- 172.21.15.6:0/2714250438 wait complete. 2023-09-13T10:00:07.162 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:00:07.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 -- 172.21.15.6:0/1352214766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 msgr2=0x7faa34106530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 --2- 172.21.15.6:0/1352214766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa34106530 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7faa280098f0 tx=0x7faa28009c00 comp rx=0 tx=0).stop 2023-09-13T10:00:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 -- 172.21.15.6:0/1352214766 shutdown_connections 2023-09-13T10:00:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 --2- 172.21.15.6:0/1352214766 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa34106a70 0x7faa34108ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 --2- 172.21.15.6:0/1352214766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa34101810 0x7faa34103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 --2- 172.21.15.6:0/1352214766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa34106530 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 -- 172.21.15.6:0/1352214766 >> 172.21.15.6:0/1352214766 conn(0x7faa340fb220 msgr2=0x7faa340fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 -- 172.21.15.6:0/1352214766 shutdown_connections 2023-09-13T10:00:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.325+0000 7faa39418700 1 -- 172.21.15.6:0/1352214766 wait complete. 2023-09-13T10:00:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 Processor -- start 2023-09-13T10:00:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 -- start start 2023-09-13T10:00:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa34101810 0x7faa34101180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa340ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa34106a70 0x7faa340ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa341004a0 con 0x7faa34104140 2023-09-13T10:00:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa34100610 con 0x7faa34101810 2023-09-13T10:00:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.326+0000 7faa39418700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa341a0af0 con 0x7faa34106a70 2023-09-13T10:00:07.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa340ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa32ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa34101810 0x7faa34101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa340ff7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46826/0 (socket says 172.21.15.6:46826) 2023-09-13T10:00:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 -- 172.21.15.6:0/1301872511 learned_addr learned my addr 172.21.15.6:0/1301872511 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa337fe700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa34106a70 0x7faa340ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 -- 172.21.15.6:0/1301872511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa34106a70 msgr2=0x7faa340ffd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa34106a70 0x7faa340ffd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 -- 172.21.15.6:0/1301872511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa34101810 msgr2=0x7faa34101180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa34101810 0x7faa34101180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 -- 172.21.15.6:0/1301872511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa28009520 con 0x7faa34104140 2023-09-13T10:00:07.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa327fc700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa340ff7c0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7faa28011040 tx=0x7faa2800b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa1bfff700 1 -- 172.21.15.6:0/1301872511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2801c070 con 0x7faa34104140 2023-09-13T10:00:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa1bfff700 1 -- 172.21.15.6:0/1301872511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa2800f7d0 con 0x7faa34104140 2023-09-13T10:00:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.327+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa341a0d70 con 0x7faa34104140 2023-09-13T10:00:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.328+0000 7faa1bfff700 1 -- 172.21.15.6:0/1301872511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280049c0 con 0x7faa34104140 2023-09-13T10:00:07.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.328+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa341a1190 con 0x7faa34104140 2023-09-13T10:00:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.330+0000 7faa1bfff700 1 -- 172.21.15.6:0/1301872511 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7faa28020070 con 0x7faa34104140 2023-09-13T10:00:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.331+0000 7faa1bfff700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa1c0a0640 0x7faa1c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.331+0000 7faa32ffd700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa1c0a0640 0x7faa1c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.331+0000 7faa1bfff700 1 -- 172.21.15.6:0/1301872511 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa280cc9b0 con 0x7faa34104140 2023-09-13T10:00:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa32ffd700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa1c0a0640 0x7faa1c0a2b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faa24009c60 tx=0x7faa24009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 Processor -- start 2023-09-13T10:00:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 -- start start 2023-09-13T10:00:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d5629f1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f2060 0x55d5629f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f0a00 0x55d5629f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d562949780 con 0x55d5629f1700 2023-09-13T10:00:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5629470a0 con 0x55d5629f2060 2023-09-13T10:00:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa455fdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d562942990 con 0x55d5629f0a00 2023-09-13T10:00:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d5629f1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d5629f1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46832/0 (socket says 172.21.15.6:46832) 2023-09-13T10:00:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa32ffd700 1 -- 172.21.15.6:0/50682461 learned_addr learned my addr 172.21.15.6:0/50682461 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa337fe700 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f0a00 0x55d5629f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.332+0000 7faa327fc700 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f2060 0x55d5629f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa32ffd700 1 -- 172.21.15.6:0/50682461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f0a00 msgr2=0x55d5629f0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa32ffd700 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f0a00 0x55d5629f0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa32ffd700 1 -- 172.21.15.6:0/50682461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f2060 msgr2=0x55d5629f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa32ffd700 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f2060 0x55d5629f04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa32ffd700 1 -- 172.21.15.6:0/50682461 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5627c2630 con 0x55d5629f1700 2023-09-13T10:00:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa337fe700 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f0a00 0x55d5629f0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa32ffd700 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d5629f1b20 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7faa2400e4e0 tx=0x7faa24014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3f67d2a677cb4e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa197fa700 1 -- 172.21.15.6:0/50682461 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2400ee00 con 0x55d5629f1700 2023-09-13T10:00:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa197fa700 1 -- 172.21.15.6:0/50682461 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa24021070 con 0x55d5629f1700 2023-09-13T10:00:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.333+0000 7faa197fa700 1 -- 172.21.15.6:0/50682461 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2401d7b0 con 0x55d5629f1700 2023-09-13T10:00:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 -- 172.21.15.6:0/50682461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 msgr2=0x55d5629f1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d5629f1b20 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7faa2400e4e0 tx=0x7faa24014000 comp rx=0 tx=0).stop 2023-09-13T10:00:07.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 -- 172.21.15.6:0/50682461 shutdown_connections 2023-09-13T10:00:07.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f0a00 0x55d5629f0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d5629f1b20 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 --2- 172.21.15.6:0/50682461 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f2060 0x55d5629f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 -- 172.21.15.6:0/50682461 >> 172.21.15.6:0/50682461 conn(0x55d56294ec80 msgr2=0x55d5629eaf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 -- 172.21.15.6:0/50682461 shutdown_connections 2023-09-13T10:00:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 -- 172.21.15.6:0/50682461 wait complete. 2023-09-13T10:00:07.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 -- start start 2023-09-13T10:00:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.334+0000 7faa455fdb80 1 Processor -- start 2023-09-13T10:00:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629f9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 0x55d5629fa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5628e0bb0 con 0x55d5629f0a00 2023-09-13T10:00:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5628e08b0 con 0x55d5629f1700 2023-09-13T10:00:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5627c4920 con 0x55d5629f2060 2023-09-13T10:00:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 10 client.0 _ll_register_callbacks cb 0x55d5628de680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629f9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629f9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46838/0 (socket says 172.21.15.6:46838) 2023-09-13T10:00:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 -- 172.21.15.6:0/1064111646 learned_addr learned my addr 172.21.15.6:0/1064111646 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa327fc700 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 0x55d5629fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa337fe700 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 -- 172.21.15.6:0/1064111646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 msgr2=0x55d562a014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 -- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 msgr2=0x55d5629fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 0x55d5629fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 -- 172.21.15.6:0/1064111646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa24017070 con 0x55d5629f0a00 2023-09-13T10:00:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa32ffd700 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629f9f60 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7faa2400e4b0 tx=0x7faa2400ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7470371c94a5436b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:07.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa16ff5700 1 -- 172.21.15.6:0/1064111646 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa24005310 con 0x55d5629f0a00 2023-09-13T10:00:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa16ff5700 1 -- 172.21.15.6:0/1064111646 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa24005470 con 0x55d5629f0a00 2023-09-13T10:00:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.335+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5629e3670 con 0x55d5629f0a00 2023-09-13T10:00:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa16ff5700 1 -- 172.21.15.6:0/1064111646 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa24005630 con 0x55d5629f0a00 2023-09-13T10:00:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 10 client.20874 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55d56295a7a0 con 0x55d5629f0a00 2023-09-13T10:00:07.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa16ff5700 1 -- 172.21.15.6:0/1064111646 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa2403d080 con 0x55d5629f0a00 2023-09-13T10:00:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa16ff5700 1 -- 172.21.15.6:0/1064111646 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faa2401c7e0 con 0x55d5629f0a00 2023-09-13T10:00:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 10 client.20874 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 10 client.20874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 20 client.20874 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:07.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a05cb0 0x55d562a080d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 4 client.20874 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d56293b970 con 0x55d562a05cb0 2023-09-13T10:00:07.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.336+0000 7faa327fc700 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a05cb0 0x55d562a080d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.342+0000 7faa16ff5700 10 client.20874 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.342+0000 7faa327fc700 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a05cb0 0x55d562a080d0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b2251e327d3d638 server_cookie=5a055b47c3439dc0 in_seq=0 out_seq=0 2023-09-13T10:00:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa16ff5700 1 -- 172.21.15.6:0/1064111646 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d56293b970 con 0x55d562a05cb0 2023-09-13T10:00:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa16ff5700 10 client.20874 handle_command_reply: tid=0 2023-09-13T10:00:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 client.20874 shutdown 2023-09-13T10:00:07.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 msgr2=0x55d5629f9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629f9f60 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7faa2400e4b0 tx=0x7faa2400ed40 comp rx=0 tx=0).stop 2023-09-13T10:00:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 shutdown_connections 2023-09-13T10:00:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a05cb0 0x55d562a080d0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629f9f60 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa16ff5700 0 client.20874 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 --2- 172.21.15.6:0/1064111646 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 0x55d5629fa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 >> 172.21.15.6:0/1064111646 conn(0x55d56294ec80 msgr2=0x55d5629e57f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.348+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 shutdown_connections 2023-09-13T10:00:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.349+0000 7faa455fdb80 1 -- 172.21.15.6:0/1064111646 wait complete. 2023-09-13T10:00:07.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.349+0000 7faa455fdb80 20 client.20874 trim_cache size 0 max 16384 2023-09-13T10:00:07.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 Processor -- start 2023-09-13T10:00:07.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 -- start start 2023-09-13T10:00:07.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f0a00 0x55d5629f04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d562a080a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5629ec970 con 0x55d5629f1700 2023-09-13T10:00:07.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5629f5490 con 0x55d5629f0a00 2023-09-13T10:00:07.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa455fdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d562a05980 con 0x55d5629f2060 2023-09-13T10:00:07.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d562a080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa327fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d562a080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46848/0 (socket says 172.21.15.6:46848) 2023-09-13T10:00:07.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa327fc700 1 -- 172.21.15.6:0/2849430008 learned_addr learned my addr 172.21.15.6:0/2849430008 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.368+0000 7faa337fe700 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa327fc700 1 -- 172.21.15.6:0/2849430008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 msgr2=0x55d562a014a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa327fc700 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa327fc700 1 -- 172.21.15.6:0/2849430008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f0a00 msgr2=0x55d5629f04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa327fc700 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f0a00 0x55d5629f04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa327fc700 1 -- 172.21.15.6:0/2849430008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d56276ede0 con 0x55d5629f1700 2023-09-13T10:00:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa327fc700 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d562a080a0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7faa28099ee0 tx=0x7faa280a0040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d79a83ca643f3a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa19ffb700 1 -- 172.21.15.6:0/2849430008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa280b81c0 con 0x55d5629f1700 2023-09-13T10:00:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa19ffb700 1 -- 172.21.15.6:0/2849430008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa2809e010 con 0x55d5629f1700 2023-09-13T10:00:07.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.369+0000 7faa19ffb700 1 -- 172.21.15.6:0/2849430008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa28098650 con 0x55d5629f1700 2023-09-13T10:00:07.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 -- 172.21.15.6:0/2849430008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 msgr2=0x55d562a080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d562a080a0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7faa28099ee0 tx=0x7faa280a0040 comp rx=0 tx=0).stop 2023-09-13T10:00:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 -- 172.21.15.6:0/2849430008 shutdown_connections 2023-09-13T10:00:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a014a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f0a00 0x55d5629f04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2849430008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f1700 0x55d562a080a0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 -- 172.21.15.6:0/2849430008 >> 172.21.15.6:0/2849430008 conn(0x55d56294ec80 msgr2=0x55d5629eae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 -- 172.21.15.6:0/2849430008 shutdown_connections 2023-09-13T10:00:07.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 -- 172.21.15.6:0/2849430008 wait complete. 2023-09-13T10:00:07.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 -- start start 2023-09-13T10:00:07.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.370+0000 7faa455fdb80 1 Processor -- start 2023-09-13T10:00:07.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629ff640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 0x55d5629ffb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa455fdb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a000c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa455fdb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d562a007a0 con 0x55d5629f0a00 2023-09-13T10:00:07.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa455fdb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d562a008e0 con 0x55d5629f1700 2023-09-13T10:00:07.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa455fdb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d562a00aa0 con 0x55d5629f2060 2023-09-13T10:00:07.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa455fdb80 10 client.0 _ll_register_callbacks cb 0x55d5628de680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:07.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629ff640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629ff640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46852/0 (socket says 172.21.15.6:46852) 2023-09-13T10:00:07.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 -- 172.21.15.6:0/2508880221 learned_addr learned my addr 172.21.15.6:0/2508880221 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:07.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa337fe700 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a000c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 -- 172.21.15.6:0/2508880221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 msgr2=0x55d562a000c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a000c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 -- 172.21.15.6:0/2508880221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 msgr2=0x55d5629ffb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 0x55d5629ffb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 -- 172.21.15.6:0/2508880221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa341a1190 con 0x55d5629f0a00 2023-09-13T10:00:07.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa337fe700 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa32ffd700 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629ff640 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7faa2400e4e0 tx=0x7faa2400ee60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed43e89e55d0ff1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.371+0000 7faa16ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa16ff5700 1 -- 172.21.15.6:0/2508880221 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2401d410 con 0x55d5629f0a00 2023-09-13T10:00:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa16ff5700 1 -- 172.21.15.6:0/2508880221 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7faa24005310 con 0x55d5629f0a00 2023-09-13T10:00:07.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa24021070 con 0x55d5629f0a00 2023-09-13T10:00:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa16ff5700 1 -- 172.21.15.6:0/2508880221 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa240054d0 con 0x55d5629f0a00 2023-09-13T10:00:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 10 client.20880 fetch_fsmap learned FSMap version 68 2023-09-13T10:00:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55d562757c60 con 0x55d5629f0a00 2023-09-13T10:00:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa16ff5700 1 -- 172.21.15.6:0/2508880221 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7faa24047020 con 0x55d5629f0a00 2023-09-13T10:00:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa16ff5700 1 -- 172.21.15.6:0/2508880221 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 68) v1 ==== 7890+0+0 (secure 0 0 0) 0x7faa2401d9a0 con 0x55d5629f0a00 2023-09-13T10:00:07.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 10 client.20880 fetch_fsmap finished waiting for FSMap version 68 2023-09-13T10:00:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 10 client.20880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 20 client.20880 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a5a260 0x55d562a5c680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 4 client.20880 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:00:07.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.372+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55d5628fc050 con 0x55d562a5a260 2023-09-13T10:00:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.376+0000 7faa327fc700 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a5a260 0x55d562a5c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.377+0000 7faa16ff5700 10 client.20880 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.377+0000 7faa327fc700 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a5a260 0x55d562a5c680 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eacc54426e52f8c server_cookie=edcb4b63445b39ab in_seq=0 out_seq=0 2023-09-13T10:00:07.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.381+0000 7faa16ff5700 1 -- 172.21.15.6:0/2508880221 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x55d5628fc050 con 0x55d562a5a260 2023-09-13T10:00:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.381+0000 7faa16ff5700 10 client.20880 handle_command_reply: tid=0 2023-09-13T10:00:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.381+0000 7faa455fdb80 1 client.20880 shutdown 2023-09-13T10:00:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.381+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 msgr2=0x55d5629ff640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.381+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629ff640 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7faa2400e4e0 tx=0x7faa2400ee60 comp rx=0 tx=0).stop 2023-09-13T10:00:07.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 shutdown_connections 2023-09-13T10:00:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55d5629f2060 0x55d562a000c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55d562a5a260 0x55d562a5c680 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55d5629f0a00 0x55d5629ff640 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 --2- 172.21.15.6:0/2508880221 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55d5629f1700 0x55d5629ffb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa16ff5700 0 client.20880 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 >> 172.21.15.6:0/2508880221 conn(0x55d56294ec80 msgr2=0x55d5629f8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 shutdown_connections 2023-09-13T10:00:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 1 -- 172.21.15.6:0/2508880221 wait complete. 2023-09-13T10:00:07.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa455fdb80 20 client.20880 trim_cache size 0 max 16384 2023-09-13T10:00:07.390 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:00:07.390 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (27 inodes in the stack)", 2023-09-13T10:00:07.390 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T10:00:07.390 INFO:teuthology.orchestra.run.smithi006.stdout: "5dcaf118-0978-4746-91be-df55023a00b6": { 2023-09-13T10:00:07.390 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T10:00:07.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "5dcaf118-0978-4746-91be-df55023a00b6", 2023-09-13T10:00:07.391 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T10:00:07.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:00:07.391 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:00:07.391 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:00:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa1c0a0640 msgr2=0x7faa1c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa39418700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa1c0a0640 0x7faa1c0a2b00 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faa24009c60 tx=0x7faa24009260 comp rx=0 tx=0).stop 2023-09-13T10:00:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 msgr2=0x7faa340ff7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.382+0000 7faa39418700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa340ff7c0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7faa28011040 tx=0x7faa2800b790 comp rx=0 tx=0).stop 2023-09-13T10:00:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.383+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 shutdown_connections 2023-09-13T10:00:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.383+0000 7faa39418700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa34106a70 0x7faa340ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.383+0000 7faa39418700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7faa34101810 0x7faa34101180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.383+0000 7faa39418700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7faa1c0a0640 0x7faa1c0a2b00 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.383+0000 7faa39418700 1 --2- 172.21.15.6:0/1301872511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa34104140 0x7faa340ff7c0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.383+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 >> 172.21.15.6:0/1301872511 conn(0x7faa340fb220 msgr2=0x7faa34102480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.385+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 shutdown_connections 2023-09-13T10:00:07.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:07.385+0000 7faa39418700 1 -- 172.21.15.6:0/1301872511 wait complete. 2023-09-13T10:00:07.403 INFO:tasks.cephfs.filesystem:scrub status for tag:5dcaf118-0978-4746-91be-df55023a00b6 - {'path': '/', 'tag': '5dcaf118-0978-4746-91be-df55023a00b6', 'options': 'recursive,force'} 2023-09-13T10:00:07.595 INFO:tasks.workunit.client.0.smithi006.stdout: 10 298888 35.02 MB/sec execute 327 sec latency 89.117 ms 2023-09-13T10:00:08.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: pgmap v918: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 510 op/s 2023-09-13T10:00:08.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T10:00:08.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:08.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:08 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.516 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: pgmap v918: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 510 op/s 2023-09-13T10:00:08.516 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T10:00:08.517 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.517 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.517 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.517 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.517 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.518 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.518 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.518 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.518 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.518 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.519 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.519 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.519 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.519 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:08.519 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.520 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:08 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: pgmap v918: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.6 MiB/s wr, 510 op/s 2023-09-13T10:00:08.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T10:00:08.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:08.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:08 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:08.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 299360 34.97 MB/sec execute 328 sec latency 218.448 ms 2023-09-13T10:00:09.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:09 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:09 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:09 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:09 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:09 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:09 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:00:09.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:09 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:09.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:09 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:09.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:09 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:09 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:09 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:09 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:00:09.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:09 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:09.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:09 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:09.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:09 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:09 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:09 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:09.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:09 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:00:09.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 299371 34.86 MB/sec execute 329 sec latency 1200.420 ms 2023-09-13T10:00:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:10 smithi006 ceph-mon[98665]: pgmap v919: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-13T10:00:10.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:10 smithi053 ceph-mon[102373]: pgmap v919: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-13T10:00:10.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:10 smithi131 ceph-mon[102785]: pgmap v919: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.2 MiB/s wr, 454 op/s 2023-09-13T10:00:10.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 299539 34.78 MB/sec execute 330 sec latency 1592.476 ms 2023-09-13T10:00:11.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 299899 34.73 MB/sec execute 331 sec latency 163.455 ms 2023-09-13T10:00:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:12 smithi006 ceph-mon[98665]: pgmap v920: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.8 MiB/s wr, 542 op/s 2023-09-13T10:00:12.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:12 smithi053 ceph-mon[102373]: pgmap v920: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.8 MiB/s wr, 542 op/s 2023-09-13T10:00:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:12 smithi131 ceph-mon[102785]: pgmap v920: 97 pgs: 97 active+clean; 1.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.8 MiB/s wr, 542 op/s 2023-09-13T10:00:12.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 300504 34.72 MB/sec execute 332 sec latency 72.723 ms 2023-09-13T10:00:13.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 301190 34.70 MB/sec execute 333 sec latency 92.031 ms 2023-09-13T10:00:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:14 smithi006 ceph-mon[98665]: pgmap v921: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 728 op/s 2023-09-13T10:00:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:14 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:00:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:14 smithi053 ceph-mon[102373]: pgmap v921: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 728 op/s 2023-09-13T10:00:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:14 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:00:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:14 smithi131 ceph-mon[102785]: pgmap v921: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 13 MiB/s wr, 728 op/s 2023-09-13T10:00:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:14 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:00:14.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 301756 34.71 MB/sec execute 334 sec latency 181.576 ms 2023-09-13T10:00:15.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 302512 34.75 MB/sec execute 335 sec latency 53.556 ms 2023-09-13T10:00:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:16 smithi006 ceph-mon[98665]: pgmap v922: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 16 MiB/s wr, 801 op/s 2023-09-13T10:00:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:16 smithi053 ceph-mon[102373]: pgmap v922: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 16 MiB/s wr, 801 op/s 2023-09-13T10:00:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:16 smithi131 ceph-mon[102785]: pgmap v922: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 16 MiB/s wr, 801 op/s 2023-09-13T10:00:16.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 303158 34.75 MB/sec execute 336 sec latency 59.605 ms 2023-09-13T10:00:17.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 303674 34.72 MB/sec execute 337 sec latency 67.927 ms 2023-09-13T10:00:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:18 smithi006 ceph-mon[98665]: pgmap v923: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 899 op/s 2023-09-13T10:00:18.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:18 smithi053 ceph-mon[102373]: pgmap v923: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 899 op/s 2023-09-13T10:00:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:18 smithi131 ceph-mon[102785]: pgmap v923: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 899 op/s 2023-09-13T10:00:18.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 304238 34.70 MB/sec execute 338 sec latency 64.246 ms 2023-09-13T10:00:19.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:19 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:19.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:19 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:19 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:19.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 304889 34.67 MB/sec execute 339 sec latency 67.006 ms 2023-09-13T10:00:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:20 smithi006 ceph-mon[98665]: pgmap v924: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 838 op/s 2023-09-13T10:00:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:20 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:20 smithi053 ceph-mon[102373]: pgmap v924: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 838 op/s 2023-09-13T10:00:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:20 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:20 smithi131 ceph-mon[102785]: pgmap v924: 97 pgs: 97 active+clean; 1.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 838 op/s 2023-09-13T10:00:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:20.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:20 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:20.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 305657 34.72 MB/sec execute 340 sec latency 54.592 ms 2023-09-13T10:00:21.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 306428 34.73 MB/sec execute 341 sec latency 61.687 ms 2023-09-13T10:00:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:22 smithi006 ceph-mon[98665]: pgmap v925: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 891 op/s 2023-09-13T10:00:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:22 smithi053 ceph-mon[102373]: pgmap v925: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 891 op/s 2023-09-13T10:00:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:22 smithi131 ceph-mon[102785]: pgmap v925: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 16 MiB/s wr, 891 op/s 2023-09-13T10:00:22.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 307113 34.78 MB/sec execute 342 sec latency 68.234 ms 2023-09-13T10:00:23.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 307559 34.75 MB/sec execute 343 sec latency 98.261 ms 2023-09-13T10:00:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:24 smithi006 ceph-mon[98665]: pgmap v926: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 851 op/s 2023-09-13T10:00:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:24 smithi053 ceph-mon[102373]: pgmap v926: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 851 op/s 2023-09-13T10:00:24.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:24 smithi131 ceph-mon[102785]: pgmap v926: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 14 MiB/s wr, 851 op/s 2023-09-13T10:00:24.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 308111 34.68 MB/sec execute 344 sec latency 68.202 ms 2023-09-13T10:00:25.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 308699 34.69 MB/sec execute 345 sec latency 255.550 ms 2023-09-13T10:00:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:26 smithi006 ceph-mon[98665]: pgmap v927: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.6 MiB/s wr, 742 op/s 2023-09-13T10:00:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:26 smithi053 ceph-mon[102373]: pgmap v927: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.6 MiB/s wr, 742 op/s 2023-09-13T10:00:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:26 smithi131 ceph-mon[102785]: pgmap v927: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 7.6 MiB/s wr, 742 op/s 2023-09-13T10:00:26.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 309440 34.68 MB/sec execute 346 sec latency 207.254 ms 2023-09-13T10:00:27.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 310156 34.72 MB/sec execute 347 sec latency 71.256 ms 2023-09-13T10:00:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:28 smithi006 ceph-mon[98665]: pgmap v928: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 577 op/s 2023-09-13T10:00:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:28 smithi053 ceph-mon[102373]: pgmap v928: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 577 op/s 2023-09-13T10:00:28.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:28 smithi131 ceph-mon[102785]: pgmap v928: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 3.8 MiB/s wr, 577 op/s 2023-09-13T10:00:28.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 310811 34.74 MB/sec execute 348 sec latency 74.745 ms 2023-09-13T10:00:29.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 311321 34.69 MB/sec execute 349 sec latency 164.928 ms 2023-09-13T10:00:30.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:30 smithi131 ceph-mon[102785]: pgmap v929: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 496 op/s 2023-09-13T10:00:30.601 INFO:tasks.workunit.client.0.smithi006.stdout: 10 311901 34.69 MB/sec execute 350 sec latency 123.988 ms 2023-09-13T10:00:30.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:30 smithi006 ceph-mon[98665]: pgmap v929: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 496 op/s 2023-09-13T10:00:30.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:30 smithi053 ceph-mon[102373]: pgmap v929: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.6 MiB/s wr, 496 op/s 2023-09-13T10:00:31.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 312625 34.69 MB/sec execute 351 sec latency 59.990 ms 2023-09-13T10:00:31.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:31 smithi053 ceph-mon[102373]: pgmap v930: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 532 op/s 2023-09-13T10:00:31.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:31 smithi006 ceph-mon[98665]: pgmap v930: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 532 op/s 2023-09-13T10:00:31.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:31 smithi131 ceph-mon[102785]: pgmap v930: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.8 MiB/s wr, 532 op/s 2023-09-13T10:00:32.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 313324 34.71 MB/sec execute 352 sec latency 64.349 ms 2023-09-13T10:00:33.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 313968 34.72 MB/sec execute 353 sec latency 77.887 ms 2023-09-13T10:00:34.277 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:34 smithi131 ceph-mon[102785]: pgmap v931: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 508 op/s 2023-09-13T10:00:34.513 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:34 smithi006 ceph-mon[98665]: pgmap v931: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 508 op/s 2023-09-13T10:00:34.516 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:34 smithi053 ceph-mon[102373]: pgmap v931: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.7 MiB/s wr, 508 op/s 2023-09-13T10:00:34.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 314241 34.65 MB/sec execute 354 sec latency 603.071 ms 2023-09-13T10:00:35.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 314373 34.58 MB/sec execute 355 sec latency 1003.647 ms 2023-09-13T10:00:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:36 smithi006 ceph-mon[98665]: pgmap v932: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 545 op/s 2023-09-13T10:00:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:36 smithi053 ceph-mon[102373]: pgmap v932: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 545 op/s 2023-09-13T10:00:36.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:36 smithi131 ceph-mon[102785]: pgmap v932: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 4.0 MiB/s wr, 545 op/s 2023-09-13T10:00:36.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 314735 34.56 MB/sec execute 356 sec latency 140.019 ms 2023-09-13T10:00:37.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:00:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 -- 172.21.15.6:0/1759562260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c101820 msgr2=0x7fe44c1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 --2- 172.21.15.6:0/1759562260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c101820 0x7fe44c1080d0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7fe44400b0d0 tx=0x7fe44400b3e0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 -- 172.21.15.6:0/1759562260 shutdown_connections 2023-09-13T10:00:37.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 --2- 172.21.15.6:0/1759562260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c101820 0x7fe44c1080d0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 --2- 172.21.15.6:0/1759562260 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe44c0ffc90 0x7fe44c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 --2- 172.21.15.6:0/1759562260 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c100e80 0x7fe44c1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 -- 172.21.15.6:0/1759562260 >> 172.21.15.6:0/1759562260 conn(0x7fe44c0fb220 msgr2=0x7fe44c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 -- 172.21.15.6:0/1759562260 shutdown_connections 2023-09-13T10:00:37.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.553+0000 7fe450e67700 1 -- 172.21.15.6:0/1759562260 wait complete. 2023-09-13T10:00:37.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 Processor -- start 2023-09-13T10:00:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 -- start start 2023-09-13T10:00:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0ffc90 0x7fe44c196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c100e80 0x7fe44c1970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe44c101820 0x7fe44c19e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c19e720 con 0x7fe44c100e80 2023-09-13T10:00:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c19e860 con 0x7fe44c101820 2023-09-13T10:00:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe450e67700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe44c19e9f0 con 0x7fe44c0ffc90 2023-09-13T10:00:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe449d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c100e80 0x7fe44c1970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe449d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c100e80 0x7fe44c1970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46868/0 (socket says 172.21.15.6:46868) 2023-09-13T10:00:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe44a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0ffc90 0x7fe44c196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe449d9b700 1 -- 172.21.15.6:0/2362840978 learned_addr learned my addr 172.21.15.6:0/2362840978 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.554+0000 7fe44ad9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe44c101820 0x7fe44c19e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe449d9b700 1 -- 172.21.15.6:0/2362840978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0ffc90 msgr2=0x7fe44c196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe449d9b700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0ffc90 0x7fe44c196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe449d9b700 1 -- 172.21.15.6:0/2362840978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe44c101820 msgr2=0x7fe44c19e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe449d9b700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe44c101820 0x7fe44c19e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe449d9b700 1 -- 172.21.15.6:0/2362840978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe444009d00 con 0x7fe44c100e80 2023-09-13T10:00:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe449d9b700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c100e80 0x7fe44c1970e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fe44000e9a0 tx=0x7fe44000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe43b7fe700 1 -- 172.21.15.6:0/2362840978 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440009790 con 0x7fe44c100e80 2023-09-13T10:00:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe44c19ecd0 con 0x7fe44c100e80 2023-09-13T10:00:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe43b7fe700 1 -- 172.21.15.6:0/2362840978 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe440010430 con 0x7fe44c100e80 2023-09-13T10:00:37.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe43b7fe700 1 -- 172.21.15.6:0/2362840978 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440018680 con 0x7fe44c100e80 2023-09-13T10:00:37.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.555+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c19f1d0 con 0x7fe44c100e80 2023-09-13T10:00:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.558+0000 7fe43b7fe700 1 -- 172.21.15.6:0/2362840978 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe4400105a0 con 0x7fe44c100e80 2023-09-13T10:00:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.558+0000 7fe43b7fe700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4340a0640 0x7fe4340a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.559+0000 7fe43b7fe700 1 -- 172.21.15.6:0/2362840978 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe440014070 con 0x7fe44c100e80 2023-09-13T10:00:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.559+0000 7fe44a59c700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4340a0640 0x7fe4340a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.559+0000 7fe44a59c700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4340a0640 0x7fe4340a2b00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe44c100ce0 tx=0x7fe43c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.559+0000 7fe45d04cb80 1 Processor -- start 2023-09-13T10:00:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe45d04cb80 1 -- start start 2023-09-13T10:00:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0edf2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0edf14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf1a00 0x559a0edf1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ed4a780 con 0x559a0edf2700 2023-09-13T10:00:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ed480a0 con 0x559a0edf3060 2023-09-13T10:00:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ed43990 con 0x559a0edf1a00 2023-09-13T10:00:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0edf14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0edf14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40400/0 (socket says 172.21.15.6:40400) 2023-09-13T10:00:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 -- 172.21.15.6:0/3520250753 learned_addr learned my addr 172.21.15.6:0/3520250753 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe44ad9d700 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf1a00 0x559a0edf1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 -- 172.21.15.6:0/3520250753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf1a00 msgr2=0x559a0edf1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf1a00 0x559a0edf1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 -- 172.21.15.6:0/3520250753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 msgr2=0x559a0edf2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0edf2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.560+0000 7fe449d9b700 1 -- 172.21.15.6:0/3520250753 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a0ebc3630 con 0x559a0edf3060 2023-09-13T10:00:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.561+0000 7fe449d9b700 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0edf14c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe440095a10 tx=0x7fe440099410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ac156118aef28d6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.562+0000 7fe438ff9700 1 -- 172.21.15.6:0/3520250753 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe44009d170 con 0x559a0edf3060 2023-09-13T10:00:37.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.562+0000 7fe438ff9700 1 -- 172.21.15.6:0/3520250753 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe440099510 con 0x559a0edf3060 2023-09-13T10:00:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.562+0000 7fe438ff9700 1 -- 172.21.15.6:0/3520250753 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe440098a00 con 0x559a0edf3060 2023-09-13T10:00:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3520250753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 msgr2=0x559a0edf14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0edf14c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe440095a10 tx=0x7fe440099410 comp rx=0 tx=0).stop 2023-09-13T10:00:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3520250753 shutdown_connections 2023-09-13T10:00:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf1a00 0x559a0edf1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0edf2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3520250753 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0edf14c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3520250753 >> 172.21.15.6:0/3520250753 conn(0x559a0ed4fc80 msgr2=0x559a0edebf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3520250753 shutdown_connections 2023-09-13T10:00:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.563+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3520250753 wait complete. 2023-09-13T10:00:37.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 -- start start 2023-09-13T10:00:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 Processor -- start 2023-09-13T10:00:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf2700 0x559a0edfb4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0ee02520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ece1bb0 con 0x559a0edf1a00 2023-09-13T10:00:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ece18b0 con 0x559a0edf3060 2023-09-13T10:00:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ebc5920 con 0x559a0edf2700 2023-09-13T10:00:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe45d04cb80 10 client.0 _ll_register_callbacks cb 0x559a0ecdf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe44a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe44a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfafa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46880/0 (socket says 172.21.15.6:46880) 2023-09-13T10:00:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe44a59c700 1 -- 172.21.15.6:0/4116001787 learned_addr learned my addr 172.21.15.6:0/4116001787 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.564+0000 7fe449d9b700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf2700 0x559a0edfb4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44a59c700 1 -- 172.21.15.6:0/4116001787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf2700 msgr2=0x559a0edfb4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44a59c700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf2700 0x559a0edfb4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44a59c700 1 -- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 msgr2=0x559a0ee02520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44ad9d700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0ee02520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44a59c700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0ee02520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44a59c700 1 -- 172.21.15.6:0/4116001787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe44c19f1d0 con 0x559a0edf1a00 2023-09-13T10:00:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe449d9b700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf2700 0x559a0edfb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:37.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44ad9d700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0ee02520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T10:00:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe44a59c700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfafa0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00e6b0 tx=0x7fe43c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ae97adaa15f36a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe431ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe431ffb700 1 -- 172.21.15.6:0/4116001787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c026630 con 0x559a0edf1a00 2023-09-13T10:00:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe431ffb700 1 -- 172.21.15.6:0/4116001787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe43c01c410 con 0x559a0edf1a00 2023-09-13T10:00:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559a0ede4670 con 0x559a0edf1a00 2023-09-13T10:00:37.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe431ffb700 1 -- 172.21.15.6:0/4116001787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe43c00ee80 con 0x559a0edf1a00 2023-09-13T10:00:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe45d04cb80 10 client.20889 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.565+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x559a0ed5b7a0 con 0x559a0edf1a00 2023-09-13T10:00:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe431ffb700 1 -- 172.21.15.6:0/4116001787 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559a0ede4670 con 0x559a0edf1a00 2023-09-13T10:00:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe431ffb700 1 -- 172.21.15.6:0/4116001787 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe43c01cb60 con 0x559a0edf1a00 2023-09-13T10:00:37.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe45d04cb80 10 client.20889 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe45d04cb80 10 client.20889 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe45d04cb80 20 client.20889 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee06dd0 0x559a0ee091f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe45d04cb80 4 client.20889 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:37.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559a0ed3c970 con 0x559a0ee06dd0 2023-09-13T10:00:37.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.566+0000 7fe449d9b700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee06dd0 0x559a0ee091f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.567+0000 7fe449d9b700 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee06dd0 0x559a0ee091f0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c5cba1be60ae14f server_cookie=b35e53e11e332737 in_seq=0 out_seq=0 2023-09-13T10:00:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.567+0000 7fe431ffb700 10 client.20889 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:37.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe431ffb700 1 -- 172.21.15.6:0/4116001787 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559a0ed3c970 con 0x559a0ee06dd0 2023-09-13T10:00:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe431ffb700 10 client.20889 handle_command_reply: tid=0 2023-09-13T10:00:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 client.20889 shutdown 2023-09-13T10:00:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 msgr2=0x559a0edfafa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfafa0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7fe43c00e6b0 tx=0x7fe43c004750 comp rx=0 tx=0).stop 2023-09-13T10:00:37.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 shutdown_connections 2023-09-13T10:00:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf3060 0x559a0ee02520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee06dd0 0x559a0ee091f0 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfafa0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/4116001787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf2700 0x559a0edfb4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe431ffb700 0 client.20889 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:37.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 >> 172.21.15.6:0/4116001787 conn(0x559a0ed4fc80 msgr2=0x559a0ede67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 shutdown_connections 2023-09-13T10:00:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 1 -- 172.21.15.6:0/4116001787 wait complete. 2023-09-13T10:00:37.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.578+0000 7fe45d04cb80 20 client.20889 trim_cache size 0 max 16384 2023-09-13T10:00:37.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 Processor -- start 2023-09-13T10:00:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 -- start start 2023-09-13T10:00:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf1a00 0x559a0edf14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0ee024e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0edf59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0eded370 con 0x559a0edf2700 2023-09-13T10:00:37.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ede88e0 con 0x559a0edf1a00 2023-09-13T10:00:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0edf6550 con 0x559a0edf3060 2023-09-13T10:00:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe449d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0ee024e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe44ad9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0edf59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe449d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0ee024e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46888/0 (socket says 172.21.15.6:46888) 2023-09-13T10:00:37.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.598+0000 7fe449d9b700 1 -- 172.21.15.6:0/2383296655 learned_addr learned my addr 172.21.15.6:0/2383296655 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe44a59c700 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf1a00 0x559a0edf14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe449d9b700 1 -- 172.21.15.6:0/2383296655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 msgr2=0x559a0edf59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe449d9b700 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0edf59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe449d9b700 1 -- 172.21.15.6:0/2383296655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf1a00 msgr2=0x559a0edf14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe449d9b700 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf1a00 0x559a0edf14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe449d9b700 1 -- 172.21.15.6:0/2383296655 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559a0eb6fde0 con 0x559a0edf2700 2023-09-13T10:00:37.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe449d9b700 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0ee024e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe4400c9b90 tx=0x7fe440095980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d39cde0e73b8d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe4397fa700 1 -- 172.21.15.6:0/2383296655 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400a1580 con 0x559a0edf2700 2023-09-13T10:00:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe4397fa700 1 -- 172.21.15.6:0/2383296655 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe4400978b0 con 0x559a0edf2700 2023-09-13T10:00:37.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.599+0000 7fe4397fa700 1 -- 172.21.15.6:0/2383296655 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4400a1350 con 0x559a0edf2700 2023-09-13T10:00:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 -- 172.21.15.6:0/2383296655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 msgr2=0x559a0ee024e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0ee024e0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fe4400c9b90 tx=0x7fe440095980 comp rx=0 tx=0).stop 2023-09-13T10:00:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 -- 172.21.15.6:0/2383296655 shutdown_connections 2023-09-13T10:00:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0edf59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf1a00 0x559a0edf14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/2383296655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf2700 0x559a0ee024e0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 -- 172.21.15.6:0/2383296655 >> 172.21.15.6:0/2383296655 conn(0x559a0ed4fc80 msgr2=0x559a0edf9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 -- 172.21.15.6:0/2383296655 shutdown_connections 2023-09-13T10:00:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.600+0000 7fe45d04cb80 1 -- 172.21.15.6:0/2383296655 wait complete. 2023-09-13T10:00:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 -- start start 2023-09-13T10:00:37.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 Processor -- start 2023-09-13T10:00:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf2700 0x559a0edfe850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0ee01870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ee01db0 con 0x559a0edf1a00 2023-09-13T10:00:37.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ee01f20 con 0x559a0edf2700 2023-09-13T10:00:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559a0ee020e0 con 0x559a0edf3060 2023-09-13T10:00:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe45d04cb80 10 client.0 _ll_register_callbacks cb 0x559a0ecdf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe44a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe44a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfe310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46894/0 (socket says 172.21.15.6:46894) 2023-09-13T10:00:37.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe44a59c700 1 -- 172.21.15.6:0/3861035582 learned_addr learned my addr 172.21.15.6:0/3861035582 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:37.610 INFO:tasks.workunit.client.0.smithi006.stdout: 10 315192 34.50 MB/sec execute 357 sec latency 82.949 ms 2023-09-13T10:00:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe449d9b700 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf2700 0x559a0edfe850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.601+0000 7fe44ad9d700 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0ee01870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe44a59c700 1 -- 172.21.15.6:0/3861035582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 msgr2=0x559a0ee01870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe44a59c700 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0ee01870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe44a59c700 1 -- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf2700 msgr2=0x559a0edfe850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe44a59c700 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf2700 0x559a0edfe850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe44a59c700 1 -- 172.21.15.6:0/3861035582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559a0ebc3630 con 0x559a0edf1a00 2023-09-13T10:00:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe44a59c700 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfe310 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fe43c01cf40 tx=0x7fe43c00ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a509a40aa3bd8103 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe431ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:37.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe431ffb700 1 -- 172.21.15.6:0/3861035582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c005450 con 0x559a0edf1a00 2023-09-13T10:00:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe431ffb700 1 -- 172.21.15.6:0/3861035582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe43c0055b0 con 0x559a0edf1a00 2023-09-13T10:00:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe440099510 con 0x559a0edf1a00 2023-09-13T10:00:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe431ffb700 1 -- 172.21.15.6:0/3861035582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe43c0047c0 con 0x559a0edf1a00 2023-09-13T10:00:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe45d04cb80 10 client.20895 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:37.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x559a0eb58c60 con 0x559a0edf1a00 2023-09-13T10:00:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.602+0000 7fe431ffb700 1 -- 172.21.15.6:0/3861035582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe440099510 con 0x559a0edf1a00 2023-09-13T10:00:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe431ffb700 1 -- 172.21.15.6:0/3861035582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fe43c01c970 con 0x559a0edf1a00 2023-09-13T10:00:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe45d04cb80 10 client.20895 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe45d04cb80 10 client.20895 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:37.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe45d04cb80 20 client.20895 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee5bba0 0x559a0ee5dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe45d04cb80 4 client.20895 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:00:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559a0ecfd050 con 0x559a0ee5bba0 2023-09-13T10:00:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe449d9b700 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee5bba0 0x559a0ee5dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe431ffb700 10 client.20895 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.603+0000 7fe449d9b700 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee5bba0 0x559a0ee5dfc0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cefddf99bf08b7 server_cookie=b8e1b1c0ef37799 in_seq=0 out_seq=0 2023-09-13T10:00:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe431ffb700 1 -- 172.21.15.6:0/3861035582 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559a0ecfd050 con 0x559a0ee5bba0 2023-09-13T10:00:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe431ffb700 10 client.20895 handle_command_reply: tid=0 2023-09-13T10:00:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 client.20895 shutdown 2023-09-13T10:00:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 msgr2=0x559a0edfe310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfe310 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fe43c01cf40 tx=0x7fe43c00ed50 comp rx=0 tx=0).stop 2023-09-13T10:00:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 shutdown_connections 2023-09-13T10:00:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559a0edf3060 0x559a0ee01870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559a0ee5bba0 0x559a0ee5dfc0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559a0edf1a00 0x559a0edfe310 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 --2- 172.21.15.6:0/3861035582 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559a0edf2700 0x559a0edfe850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 >> 172.21.15.6:0/3861035582 conn(0x559a0ed4fc80 msgr2=0x559a0edf59c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.608+0000 7fe431ffb700 0 client.20895 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 shutdown_connections 2023-09-13T10:00:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe45d04cb80 1 -- 172.21.15.6:0/3861035582 wait complete. 2023-09-13T10:00:37.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe45d04cb80 20 client.20895 trim_cache size 0 max 16384 2023-09-13T10:00:37.621 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:00:37.621 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T10:00:37.621 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T10:00:37.621 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:00:37.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4340a0640 msgr2=0x7fe4340a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4340a0640 0x7fe4340a2b00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fe44c100ce0 tx=0x7fe43c009260 comp rx=0 tx=0).stop 2023-09-13T10:00:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c100e80 msgr2=0x7fe44c1970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c100e80 0x7fe44c1970e0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7fe44000e9a0 tx=0x7fe44000ecb0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 shutdown_connections 2023-09-13T10:00:37.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe44c101820 0x7fe44c19e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe44c0ffc90 0x7fe44c196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4340a0640 0x7fe4340a2b00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 --2- 172.21.15.6:0/2362840978 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe44c100e80 0x7fe44c1970e0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.609+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 >> 172.21.15.6:0/2362840978 conn(0x7fe44c0fb220 msgr2=0x7fe44c0fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.610+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 shutdown_connections 2023-09-13T10:00:37.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.610+0000 7fe450e67700 1 -- 172.21.15.6:0/2362840978 wait complete. 2023-09-13T10:00:37.625 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T10:00:37.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:00:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 -- 172.21.15.6:0/282314952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 msgr2=0x7f85ec1000a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/282314952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec1000a0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009990 tx=0x7f85dc009ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 -- 172.21.15.6:0/282314952 shutdown_connections 2023-09-13T10:00:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/282314952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ec101810 0x7f85ec1080c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/282314952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec1000a0 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/282314952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ec100e70 0x7f85ec1012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 -- 172.21.15.6:0/282314952 >> 172.21.15.6:0/282314952 conn(0x7f85ec0fb1f0 msgr2=0x7f85ec0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 -- 172.21.15.6:0/282314952 shutdown_connections 2023-09-13T10:00:37.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.772+0000 7f85f0dc2700 1 -- 172.21.15.6:0/282314952 wait complete. 2023-09-13T10:00:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 Processor -- start 2023-09-13T10:00:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 -- start start 2023-09-13T10:00:37.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec06f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ec100e70 0x7f85ec06fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ec101810 0x7f85ec197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec072bc0 con 0x7f85ec0ffc80 2023-09-13T10:00:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec072d30 con 0x7f85ec100e70 2023-09-13T10:00:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.773+0000 7f85f0dc2700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec1983e0 con 0x7f85ec101810 2023-09-13T10:00:37.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec06f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec06f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46908/0 (socket says 172.21.15.6:46908) 2023-09-13T10:00:37.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 -- 172.21.15.6:0/1285156947 learned_addr learned my addr 172.21.15.6:0/1285156947 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:37.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ead9d700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ec101810 0x7f85ec197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85e9d9b700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ec100e70 0x7f85ec06fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 -- 172.21.15.6:0/1285156947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ec101810 msgr2=0x7f85ec197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ec101810 0x7f85ec197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 -- 172.21.15.6:0/1285156947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ec100e70 msgr2=0x7f85ec06fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ec100e70 0x7f85ec06fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:37.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 -- 172.21.15.6:0/1285156947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0095f0 con 0x7f85ec0ffc80 2023-09-13T10:00:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85e9d9b700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ec100e70 0x7f85ec06fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:00:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.774+0000 7f85ea59c700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec06f530 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0098e0 tx=0x7f85dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.775+0000 7f85db7fe700 1 -- 172.21.15.6:0/1285156947 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc01d070 con 0x7f85ec0ffc80 2023-09-13T10:00:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.775+0000 7f85db7fe700 1 -- 172.21.15.6:0/1285156947 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f85dc0054f0 con 0x7f85ec0ffc80 2023-09-13T10:00:37.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.775+0000 7f85db7fe700 1 -- 172.21.15.6:0/1285156947 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc004ca0 con 0x7f85ec0ffc80 2023-09-13T10:00:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.775+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec198660 con 0x7f85ec0ffc80 2023-09-13T10:00:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.775+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec198a60 con 0x7f85ec0ffc80 2023-09-13T10:00:37.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.776+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85ec106bb0 con 0x7f85ec0ffc80 2023-09-13T10:00:37.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.778+0000 7f85db7fe700 1 -- 172.21.15.6:0/1285156947 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f85dc00fc70 con 0x7f85ec0ffc80 2023-09-13T10:00:37.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.779+0000 7f85db7fe700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85d40a0640 0x7f85d40a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:37.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.779+0000 7f85e9d9b700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85d40a0640 0x7f85d40a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:37.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.779+0000 7f85db7fe700 1 -- 172.21.15.6:0/1285156947 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f85dc0ccfb0 con 0x7f85ec0ffc80 2023-09-13T10:00:37.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.780+0000 7f85e9d9b700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85d40a0640 0x7f85d40a2b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f85ec070650 tx=0x7f85e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:37.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:37.785+0000 7f85db7fe700 1 -- 172.21.15.6:0/1285156947 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f85dc05ae10 con 0x7f85ec0ffc80 2023-09-13T10:00:38.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.095+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85ec10a460 con 0x7f85ec0ffc80 2023-09-13T10:00:38.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.096+0000 7f85db7fe700 1 -- 172.21.15.6:0/1285156947 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+11336 (secure 0 0 0) 0x7f85dc09a5b0 con 0x7f85ec0ffc80 2023-09-13T10:00:38.097 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:00:38.097 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":70,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T10:00:12.571896+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:00:38.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85d40a0640 msgr2=0x7f85d40a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85d40a0640 0x7f85d40a2b00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f85ec070650 tx=0x7f85e0009260 comp rx=0 tx=0).stop 2023-09-13T10:00:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 msgr2=0x7f85ec06f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec06f530 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0098e0 tx=0x7f85dc004730 comp rx=0 tx=0).stop 2023-09-13T10:00:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 shutdown_connections 2023-09-13T10:00:38.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85ec101810 0x7f85ec197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f85d40a0640 0x7f85d40a2b00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f85ec0ffc80 0x7f85ec06f530 secure :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0098e0 tx=0x7f85dc004730 comp rx=0 tx=0).stop 2023-09-13T10:00:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 --2- 172.21.15.6:0/1285156947 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f85ec100e70 0x7f85ec06fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.098+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 >> 172.21.15.6:0/1285156947 conn(0x7f85ec0fb1f0 msgr2=0x7f85ec0fd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.099+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 shutdown_connections 2023-09-13T10:00:38.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.099+0000 7f85f0dc2700 1 -- 172.21.15.6:0/1285156947 wait complete. 2023-09-13T10:00:38.102 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-09-13T10:00:38.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T10:00:38.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.292+0000 7f4afc27f700 1 -- 172.21.15.6:0/3173340391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 msgr2=0x7f4af4104610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.292+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3173340391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4104610 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f4ae40099c0 tx=0x7f4ae4009cd0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.292+0000 7f4afc27f700 1 -- 172.21.15.6:0/3173340391 shutdown_connections 2023-09-13T10:00:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.292+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3173340391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4104b50 0x7f4af410b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.292+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3173340391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4102fc0 0x7f4af41033e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.292+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3173340391 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4104610 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.292+0000 7f4afc27f700 1 -- 172.21.15.6:0/3173340391 >> 172.21.15.6:0/3173340391 conn(0x7f4af40fe530 msgr2=0x7f4af4100970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.293+0000 7f4afc27f700 1 -- 172.21.15.6:0/3173340391 shutdown_connections 2023-09-13T10:00:38.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.293+0000 7f4afc27f700 1 -- 172.21.15.6:0/3173340391 wait complete. 2023-09-13T10:00:38.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.293+0000 7f4afc27f700 1 Processor -- start 2023-09-13T10:00:38.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4afc27f700 1 -- start start 2023-09-13T10:00:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4afc27f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4102fc0 0x7f4af4198e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4afc27f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4199370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4afc27f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4104b50 0x7f4af41a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4afc27f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af41a09b0 con 0x7f4af4102fc0 2023-09-13T10:00:38.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4afc27f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af41a0af0 con 0x7f4af41041b0 2023-09-13T10:00:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4afc27f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4af41a0c80 con 0x7f4af4104b50 2023-09-13T10:00:38.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4af981a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4199370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.294+0000 7f4af981a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4199370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40446/0 (socket says 172.21.15.6:40446) 2023-09-13T10:00:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4af981a700 1 -- 172.21.15.6:0/3288280954 learned_addr learned my addr 172.21.15.6:0/3288280954 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4afa81c700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4104b50 0x7f4af41a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4af981a700 1 -- 172.21.15.6:0/3288280954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4104b50 msgr2=0x7f4af41a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4af981a700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4104b50 0x7f4af41a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4af981a700 1 -- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4102fc0 msgr2=0x7f4af4198e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4af981a700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4102fc0 0x7f4af4198e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4af981a700 1 -- 172.21.15.6:0/3288280954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40095f0 con 0x7f4af41041b0 2023-09-13T10:00:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4af981a700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4199370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400b580 tx=0x7f4ae40057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4aeb7fe700 1 -- 172.21.15.6:0/3288280954 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae401d070 con 0x7f4af41041b0 2023-09-13T10:00:38.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4aeb7fe700 1 -- 172.21.15.6:0/3288280954 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4ae400f460 con 0x7f4af41041b0 2023-09-13T10:00:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.295+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4af41a0f00 con 0x7f4af41041b0 2023-09-13T10:00:38.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.296+0000 7f4aeb7fe700 1 -- 172.21.15.6:0/3288280954 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ae4021670 con 0x7f4af41041b0 2023-09-13T10:00:38.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.296+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af41a1340 con 0x7f4af41041b0 2023-09-13T10:00:38.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.299+0000 7f4aeb7fe700 1 -- 172.21.15.6:0/3288280954 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4ae400f5d0 con 0x7f4af41041b0 2023-09-13T10:00:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.300+0000 7f4aeb7fe700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae00a0690 0x7f4ae00a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.300+0000 7f4aeb7fe700 1 -- 172.21.15.6:0/3288280954 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4ae40cccc0 con 0x7f4af41041b0 2023-09-13T10:00:38.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.300+0000 7f4b08464b80 1 Processor -- start 2023-09-13T10:00:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.300+0000 7f4b08464b80 1 -- start start 2023-09-13T10:00:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bf3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 0x55f973bf1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bf2690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4b08464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973b42780 con 0x55f973bf2f10 2023-09-13T10:00:38.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4b08464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973b400a0 con 0x55f973bf2210 2023-09-13T10:00:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4b08464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973b3b990 con 0x55f973bf3870 2023-09-13T10:00:38.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4afa01b700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae00a0690 0x7f4ae00a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4afa01b700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae00a0690 0x7f4ae00a2b50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4af4104010 tx=0x7f4af0009250 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4afa01b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bf3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4afa01b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bf3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46928/0 (socket says 172.21.15.6:46928) 2023-09-13T10:00:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4afa01b700 1 -- 172.21.15.6:0/1798409952 learned_addr learned my addr 172.21.15.6:0/1798409952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.301+0000 7f4afa81c700 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bf2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4afa01b700 1 -- 172.21.15.6:0/1798409952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 msgr2=0x55f973bf1cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:00:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4afa01b700 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 0x55f973bf1cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4afa01b700 1 -- 172.21.15.6:0/1798409952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 msgr2=0x55f973bf2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4afa01b700 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bf2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4afa01b700 1 -- 172.21.15.6:0/1798409952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9739bb630 con 0x55f973bf2f10 2023-09-13T10:00:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4afa01b700 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bf3330 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f4af000d9c0 tx=0x7f4af0013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9a5de17ea9c3cbd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4ae8d82700 1 -- 172.21.15.6:0/1798409952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001a070 con 0x55f973bf2f10 2023-09-13T10:00:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4ae8d82700 1 -- 172.21.15.6:0/1798409952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af0015900 con 0x55f973bf2f10 2023-09-13T10:00:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.302+0000 7f4ae8d82700 1 -- 172.21.15.6:0/1798409952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001e9f0 con 0x55f973bf2f10 2023-09-13T10:00:38.325 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.303+0000 7f4b08464b80 1 -- 172.21.15.6:0/1798409952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 msgr2=0x55f973bf3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.303+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bf3330 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f4af000d9c0 tx=0x7f4af0013000 comp rx=0 tx=0).stop 2023-09-13T10:00:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.305+0000 7f4b08464b80 1 -- 172.21.15.6:0/1798409952 shutdown_connections 2023-09-13T10:00:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.305+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bf2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.305+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bf3330 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.305+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1798409952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 0x55f973bf1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.305+0000 7f4b08464b80 1 -- 172.21.15.6:0/1798409952 >> 172.21.15.6:0/1798409952 conn(0x55f973b47c80 msgr2=0x55f973be3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.306+0000 7f4b08464b80 1 -- 172.21.15.6:0/1798409952 shutdown_connections 2023-09-13T10:00:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.306+0000 7f4b08464b80 1 -- 172.21.15.6:0/1798409952 wait complete. 2023-09-13T10:00:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.306+0000 7f4b08464b80 1 -- start start 2023-09-13T10:00:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 1 Processor -- start 2023-09-13T10:00:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bfbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 0x55f973c02d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973ad9bb0 con 0x55f973bf2f10 2023-09-13T10:00:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973ad98b0 con 0x55f973bf2210 2023-09-13T10:00:38.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9739bd920 con 0x55f973bf3870 2023-09-13T10:00:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4b08464b80 10 client.0 _ll_register_callbacks cb 0x55f973ad7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4af981a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bfbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4afa01b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4afa01b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40456/0 (socket says 172.21.15.6:40456) 2023-09-13T10:00:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4afa01b700 1 -- 172.21.15.6:0/3012598575 learned_addr learned my addr 172.21.15.6:0/3012598575 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4afa81c700 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 0x55f973c02d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4afa01b700 1 -- 172.21.15.6:0/3012598575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 msgr2=0x55f973c02d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.307+0000 7f4afa01b700 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 0x55f973c02d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4afa01b700 1 -- 172.21.15.6:0/3012598575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 msgr2=0x55f973bfbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4afa01b700 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bfbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4afa01b700 1 -- 172.21.15.6:0/3012598575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af000d670 con 0x55f973bf2210 2023-09-13T10:00:38.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4af981a700 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bfbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4afa01b700 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb7b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4af0000c00 tx=0x7f4af0015ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a9471c1c5209c00 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4addffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:00:38.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4addffb700 1 -- 172.21.15.6:0/3012598575 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001a040 con 0x55f973bf2210 2023-09-13T10:00:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4addffb700 1 -- 172.21.15.6:0/3012598575 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4af0004020 con 0x55f973bf2210 2023-09-13T10:00:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.308+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f973bdc670 con 0x55f973bf2210 2023-09-13T10:00:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4addffb700 1 -- 172.21.15.6:0/3012598575 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af0004220 con 0x55f973bf2210 2023-09-13T10:00:38.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 10 client.30116 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55f973b537a0 con 0x55f973bf2210 2023-09-13T10:00:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4addffb700 1 -- 172.21.15.6:0/3012598575 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f973bdc670 con 0x55f973bf2210 2023-09-13T10:00:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4addffb700 1 -- 172.21.15.6:0/3012598575 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4af002f070 con 0x55f973bf2210 2023-09-13T10:00:38.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 10 client.30116 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 10 client.30116 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:00:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 20 client.30116 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bea760 0x55f973becb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 4 client.30116 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f973b34970 con 0x55f973bea760 2023-09-13T10:00:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.309+0000 7f4af981a700 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bea760 0x55f973becb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.310+0000 7f4af981a700 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bea760 0x55f973becb80 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=24f4db967b262636 server_cookie=81dd7969df2865bf in_seq=0 out_seq=0 2023-09-13T10:00:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.310+0000 7f4addffb700 10 client.30116 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4addffb700 1 -- 172.21.15.6:0/3012598575 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f973b34970 con 0x55f973bea760 2023-09-13T10:00:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4addffb700 10 client.30116 handle_command_reply: tid=0 2023-09-13T10:00:38.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 client.30116 shutdown 2023-09-13T10:00:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 msgr2=0x55f973bfb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb7b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4af0000c00 tx=0x7f4af0015ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 shutdown_connections 2023-09-13T10:00:38.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bea760 0x55f973becb80 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf3870 0x55f973c02d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4addffb700 0 client.30116 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb7b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 --2- 172.21.15.6:0/3012598575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973bfbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 >> 172.21.15.6:0/3012598575 conn(0x55f973b47c80 msgr2=0x55f973bde7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 shutdown_connections 2023-09-13T10:00:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 1 -- 172.21.15.6:0/3012598575 wait complete. 2023-09-13T10:00:38.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.316+0000 7f4b08464b80 20 client.30116 trim_cache size 0 max 16384 2023-09-13T10:00:38.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 Processor -- start 2023-09-13T10:00:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 -- start start 2023-09-13T10:00:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bea760 0x55f973bde8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2f10 0x55f973bfbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973bfac60 con 0x55f973bea760 2023-09-13T10:00:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973be5200 con 0x55f973bf2210 2023-09-13T10:00:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4b08464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973bfb320 con 0x55f973bf2f10 2023-09-13T10:00:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bea760 0x55f973bde8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4af981a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bea760 0x55f973bde8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46940/0 (socket says 172.21.15.6:46940) 2023-09-13T10:00:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 -- 172.21.15.6:0/2229054225 learned_addr learned my addr 172.21.15.6:0/2229054225 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa81c700 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2f10 0x55f973bfbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 -- 172.21.15.6:0/2229054225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2f10 msgr2=0x55f973bfbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2f10 0x55f973bfbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 -- 172.21.15.6:0/2229054225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 msgr2=0x55f973bfb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4afa01b700 1 -- 172.21.15.6:0/2229054225 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f973967de0 con 0x55f973bea760 2023-09-13T10:00:38.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.335+0000 7f4af981a700 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.336+0000 7f4afa01b700 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bea760 0x55f973bde8f0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f4af0004760 tx=0x7f4af0006e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec7f722b944ba58 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.336+0000 7f4ae9583700 1 -- 172.21.15.6:0/2229054225 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001a070 con 0x55f973bea760 2023-09-13T10:00:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.336+0000 7f4ae9583700 1 -- 172.21.15.6:0/2229054225 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af0015dd0 con 0x55f973bea760 2023-09-13T10:00:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.336+0000 7f4ae9583700 1 -- 172.21.15.6:0/2229054225 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001e860 con 0x55f973bea760 2023-09-13T10:00:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- 172.21.15.6:0/2229054225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bea760 msgr2=0x55f973bde8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bea760 0x55f973bde8f0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7f4af0004760 tx=0x7f4af0006e20 comp rx=0 tx=0).stop 2023-09-13T10:00:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- 172.21.15.6:0/2229054225 shutdown_connections 2023-09-13T10:00:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2f10 0x55f973bfbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bea760 0x55f973bde8f0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 --2- 172.21.15.6:0/2229054225 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bf2210 0x55f973bfb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- 172.21.15.6:0/2229054225 >> 172.21.15.6:0/2229054225 conn(0x55f973b47c80 msgr2=0x55f973bf6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- 172.21.15.6:0/2229054225 shutdown_connections 2023-09-13T10:00:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- 172.21.15.6:0/2229054225 wait complete. 2023-09-13T10:00:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- start start 2023-09-13T10:00:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 Processor -- start 2023-09-13T10:00:38.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bea760 0x55f973c5b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2210 0x55f973c5bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973c62b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973c63070 con 0x55f973bf2f10 2023-09-13T10:00:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973c631b0 con 0x55f973bea760 2023-09-13T10:00:38.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f973c63340 con 0x55f973bf2210 2023-09-13T10:00:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4b08464b80 10 client.0 _ll_register_callbacks cb 0x55f973ad7680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.337+0000 7f4afa81c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973c62b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa81c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973c62b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46948/0 (socket says 172.21.15.6:46948) 2023-09-13T10:00:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa01b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bea760 0x55f973c5b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa81c700 1 -- 172.21.15.6:0/1250024111 learned_addr learned my addr 172.21.15.6:0/1250024111 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4af981a700 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2210 0x55f973c5bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa01b700 1 -- 172.21.15.6:0/1250024111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2210 msgr2=0x55f973c5bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa01b700 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2210 0x55f973c5bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa01b700 1 -- 172.21.15.6:0/1250024111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 msgr2=0x55f973c62b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa01b700 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973c62b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa01b700 1 -- 172.21.15.6:0/1250024111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af41a1340 con 0x55f973bea760 2023-09-13T10:00:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4afa01b700 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bea760 0x55f973c5b5c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4af001e560 tx=0x7f4af0015860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=883fb2c37ae60e50 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4addffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:00:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4addffb700 1 -- 172.21.15.6:0/1250024111 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af001a070 con 0x55f973bea760 2023-09-13T10:00:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.338+0000 7f4addffb700 1 -- 172.21.15.6:0/1250024111 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4af0003e60 con 0x55f973bea760 2023-09-13T10:00:38.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.339+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4af0015900 con 0x55f973bea760 2023-09-13T10:00:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.339+0000 7f4addffb700 1 -- 172.21.15.6:0/1250024111 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af0004020 con 0x55f973bea760 2023-09-13T10:00:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.339+0000 7f4b08464b80 10 client.30122 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.339+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55f973b537a0 con 0x55f973bea760 2023-09-13T10:00:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.339+0000 7f4addffb700 1 -- 172.21.15.6:0/1250024111 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af0015900 con 0x55f973bea760 2023-09-13T10:00:38.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.340+0000 7f4addffb700 1 -- 172.21.15.6:0/1250024111 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4af002f070 con 0x55f973bea760 2023-09-13T10:00:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.340+0000 7f4b08464b80 10 client.30122 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.340+0000 7f4b08464b80 10 client.30122 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:00:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.340+0000 7f4b08464b80 20 client.30122 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.340+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bf3870 0x55f973c667e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.340+0000 7f4b08464b80 4 client.30122 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.340+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f973af5050 con 0x55f973bf3870 2023-09-13T10:00:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.342+0000 7f4af981a700 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bf3870 0x55f973c667e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.345+0000 7f4addffb700 10 client.30122 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.345+0000 7f4af981a700 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bf3870 0x55f973c667e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c07598224edab5bb server_cookie=715c9e75a9ddaafd in_seq=0 out_seq=0 2023-09-13T10:00:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.345+0000 7f4addffb700 1 -- 172.21.15.6:0/1250024111 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f973af5050 con 0x55f973bf3870 2023-09-13T10:00:38.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.345+0000 7f4addffb700 10 client.30122 handle_command_reply: tid=0 2023-09-13T10:00:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.345+0000 7f4b08464b80 1 client.30122 shutdown 2023-09-13T10:00:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.345+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bea760 msgr2=0x55f973c5b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.345+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bea760 0x55f973c5b5c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f4af001e560 tx=0x7f4af0015860 comp rx=0 tx=0).stop 2023-09-13T10:00:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 shutdown_connections 2023-09-13T10:00:38.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55f973bf3870 0x55f973c667e0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f973bf2f10 0x55f973c62b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f973bea760 0x55f973c5b5c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 --2- 172.21.15.6:0/1250024111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f973bf2210 0x55f973c5bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 >> 172.21.15.6:0/1250024111 conn(0x55f973b47c80 msgr2=0x55f973bfb560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4addffb700 0 client.30122 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:00:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 shutdown_connections 2023-09-13T10:00:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 1 -- 172.21.15.6:0/1250024111 wait complete. 2023-09-13T10:00:38.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4b08464b80 20 client.30122 trim_cache size 0 max 16384 2023-09-13T10:00:38.367 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae00a0690 msgr2=0x7f4ae00a2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae00a0690 0x7f4ae00a2b50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f4af4104010 tx=0x7f4af0009250 comp rx=0 tx=0).stop 2023-09-13T10:00:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 msgr2=0x7f4af4199370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.346+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4199370 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4ae400b580 tx=0x7f4ae40057f0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 shutdown_connections 2023-09-13T10:00:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4af4104b50 0x7f4af41a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4ae00a0690 0x7f4ae00a2b50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4af4102fc0 0x7f4af4198e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 --2- 172.21.15.6:0/3288280954 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4af41041b0 0x7f4af4199370 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 >> 172.21.15.6:0/3288280954 conn(0x7f4af40fe530 msgr2=0x7f4af4100730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 shutdown_connections 2023-09-13T10:00:38.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.347+0000 7f4afc27f700 1 -- 172.21.15.6:0/3288280954 wait complete. 2023-09-13T10:00:38.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T10:00:38.372 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:38 smithi006 ceph-mon[98665]: pgmap v933: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.9 MiB/s wr, 629 op/s 2023-09-13T10:00:38.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:38 smithi053 ceph-mon[102373]: pgmap v933: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.9 MiB/s wr, 629 op/s 2023-09-13T10:00:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:38 smithi131 ceph-mon[102785]: pgmap v933: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.9 MiB/s wr, 629 op/s 2023-09-13T10:00:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.525+0000 7fb020fe4700 1 -- 172.21.15.6:0/1125363722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 msgr2=0x7fb01c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.525+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1125363722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 0x7fb01c101310 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fb010009990 tx=0x7fb010009ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.525+0000 7fb020fe4700 1 -- 172.21.15.6:0/1125363722 shutdown_connections 2023-09-13T10:00:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.525+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1125363722 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01c101850 0x7fb01c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.525+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1125363722 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0ffcc0 0x7fb01c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.525+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1125363722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 0x7fb01c101310 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.525+0000 7fb020fe4700 1 -- 172.21.15.6:0/1125363722 >> 172.21.15.6:0/1125363722 conn(0x7fb01c0fb250 msgr2=0x7fb01c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.526+0000 7fb020fe4700 1 -- 172.21.15.6:0/1125363722 shutdown_connections 2023-09-13T10:00:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.526+0000 7fb020fe4700 1 -- 172.21.15.6:0/1125363722 wait complete. 2023-09-13T10:00:38.529 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.526+0000 7fb020fe4700 1 Processor -- start 2023-09-13T10:00:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.526+0000 7fb020fe4700 1 -- start start 2023-09-13T10:00:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb020fe4700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0ffcc0 0x7fb01c196a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb020fe4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 0x7fb01c196fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb020fe4700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01c101850 0x7fb01c19e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.530 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb020fe4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c19e600 con 0x7fb01c100eb0 2023-09-13T10:00:38.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb020fe4700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c19e740 con 0x7fb01c101850 2023-09-13T10:00:38.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb020fe4700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c19e8d0 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb019d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 0x7fb01c196fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0ffcc0 0x7fb01c196a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.531 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb019d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 0x7fb01c196fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46962/0 (socket says 172.21.15.6:46962) 2023-09-13T10:00:38.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb019d9b700 1 -- 172.21.15.6:0/1034219189 learned_addr learned my addr 172.21.15.6:0/1034219189 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01c101850 0x7fb01c19e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01a59c700 1 -- 172.21.15.6:0/1034219189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01c101850 msgr2=0x7fb01c19e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.532 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01a59c700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01c101850 0x7fb01c19e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01a59c700 1 -- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 msgr2=0x7fb01c196fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01a59c700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 0x7fb01c196fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01a59c700 1 -- 172.21.15.6:0/1034219189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0100095f0 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.533 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb01a59c700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0ffcc0 0x7fb01c196a80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00e9c0 tx=0x7fb00c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.527+0000 7fb00b7fe700 1 -- 172.21.15.6:0/1034219189 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c004220 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.528+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c108920 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.528+0000 7fb00b7fe700 1 -- 172.21.15.6:0/1034219189 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb00c004380 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.528+0000 7fb00b7fe700 1 -- 172.21.15.6:0/1034219189 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c003be0 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.534 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.528+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c108e80 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.530+0000 7fb00b7fe700 1 -- 172.21.15.6:0/1034219189 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb00c00c7c0 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.531+0000 7fb00b7fe700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0040a0640 0x7fb0040a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.531+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0040a0640 0x7fb0040a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.531+0000 7fb00b7fe700 1 -- 172.21.15.6:0/1034219189 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb00c014070 con 0x7fb01c0ffcc0 2023-09-13T10:00:38.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.531+0000 7fb02d1c9b80 1 Processor -- start 2023-09-13T10:00:38.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.531+0000 7fb02d1c9b80 1 -- start start 2023-09-13T10:00:38.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0040a0640 0x7fb0040a2b00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b2e0 tx=0x7fb010005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeed2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eee2a780 con 0x55b1eeed2700 2023-09-13T10:00:38.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eee280a0 con 0x55b1eeed1a00 2023-09-13T10:00:38.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eee23990 con 0x55b1eeed3060 2023-09-13T10:00:38.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeed2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeed2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46968/0 (socket says 172.21.15.6:46968) 2023-09-13T10:00:38.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb01a59c700 1 -- 172.21.15.6:0/1874601832 learned_addr learned my addr 172.21.15.6:0/1874601832 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 -- 172.21.15.6:0/1874601832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 msgr2=0x55b1eeed1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 -- 172.21.15.6:0/1874601832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 msgr2=0x55b1eeed2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeed2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 -- 172.21.15.6:0/1874601832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1eeca3630 con 0x55b1eeed3060 2023-09-13T10:00:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.532+0000 7fb019d9b700 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed14c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0100059d0 tx=0x7fb010024000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f61d5ce82b0ba34c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb008ff9700 1 -- 172.21.15.6:0/1874601832 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01002f070 con 0x55b1eeed3060 2023-09-13T10:00:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb008ff9700 1 -- 172.21.15.6:0/1874601832 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb010022040 con 0x55b1eeed3060 2023-09-13T10:00:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb008ff9700 1 -- 172.21.15.6:0/1874601832 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb010004bb0 con 0x55b1eeed3060 2023-09-13T10:00:38.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/1874601832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 msgr2=0x55b1eeed14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed14c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fb0100059d0 tx=0x7fb010024000 comp rx=0 tx=0).stop 2023-09-13T10:00:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/1874601832 shutdown_connections 2023-09-13T10:00:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeed2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/1874601832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed14c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.533+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/1874601832 >> 172.21.15.6:0/1874601832 conn(0x55b1eee2fc80 msgr2=0x55b1eeecbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/1874601832 shutdown_connections 2023-09-13T10:00:38.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/1874601832 wait complete. 2023-09-13T10:00:38.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 -- start start 2023-09-13T10:00:38.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 Processor -- start 2023-09-13T10:00:38.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed1a00 0x55b1eeedae40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed2700 0x55b1eeedb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeee23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eedc1bb0 con 0x55b1eeed1a00 2023-09-13T10:00:38.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eedc18b0 con 0x55b1eeed2700 2023-09-13T10:00:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eeca5920 con 0x55b1eeed3060 2023-09-13T10:00:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.534+0000 7fb02d1c9b80 10 client.0 _ll_register_callbacks cb 0x55b1eedbf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed1a00 0x55b1eeedae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed1a00 0x55b1eeedae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46974/0 (socket says 172.21.15.6:46974) 2023-09-13T10:00:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 -- 172.21.15.6:0/3173407326 learned_addr learned my addr 172.21.15.6:0/3173407326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeee23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb019d9b700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed2700 0x55b1eeedb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 -- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 msgr2=0x55b1eeee23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeee23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 -- 172.21.15.6:0/3173407326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed2700 msgr2=0x55b1eeedb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed2700 0x55b1eeedb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 -- 172.21.15.6:0/3173407326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c068170 con 0x55b1eeed1a00 2023-09-13T10:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb019d9b700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed2700 0x55b1eeedb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb01a59c700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed1a00 0x55b1eeedae40 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00f010 tx=0x7fb00c099040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9307c134f81e5aae server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb001ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb001ffb700 1 -- 172.21.15.6:0/3173407326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb00c099610 con 0x55b1eeed1a00 2023-09-13T10:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb001ffb700 1 -- 172.21.15.6:0/3173407326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb00c09d440 con 0x55b1eeed1a00 2023-09-13T10:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.535+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b1eeec4670 con 0x55b1eeed1a00 2023-09-13T10:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb001ffb700 1 -- 172.21.15.6:0/3173407326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb00c0a1680 con 0x55b1eeed1a00 2023-09-13T10:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 10 client.20925 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55b1eee3b7a0 con 0x55b1eeed1a00 2023-09-13T10:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb001ffb700 1 -- 172.21.15.6:0/3173407326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b1eeec4670 con 0x55b1eeed1a00 2023-09-13T10:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb001ffb700 1 -- 172.21.15.6:0/3173407326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb00c098b00 con 0x55b1eeed1a00 2023-09-13T10:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 10 client.20925 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 10 client.20925 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:00:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 20 client.20925 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eeee6c20 0x55b1eeee9040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 4 client.20925 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b1eee1c970 con 0x55b1eeee6c20 2023-09-13T10:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.536+0000 7fb019d9b700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eeee6c20 0x55b1eeee9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.537+0000 7fb019d9b700 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eeee6c20 0x55b1eeee9040 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=16cddc51ef42d0f server_cookie=d95588c697ba8c4c in_seq=0 out_seq=0 2023-09-13T10:00:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.537+0000 7fb001ffb700 10 client.20925 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.537+0000 7fb001ffb700 1 -- 172.21.15.6:0/3173407326 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b1eee1c970 con 0x55b1eeee6c20 2023-09-13T10:00:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb001ffb700 10 client.20925 handle_command_reply: tid=0 2023-09-13T10:00:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 client.20925 shutdown 2023-09-13T10:00:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed1a00 msgr2=0x55b1eeedae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed1a00 0x55b1eeedae40 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00f010 tx=0x7fb00c099040 comp rx=0 tx=0).stop 2023-09-13T10:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 shutdown_connections 2023-09-13T10:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eeee6c20 0x55b1eeee9040 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeee23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb001ffb700 0 client.20925 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed1a00 0x55b1eeedae40 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3173407326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed2700 0x55b1eeedb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 >> 172.21.15.6:0/3173407326 conn(0x55b1eee2fc80 msgr2=0x55b1eeec67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 shutdown_connections 2023-09-13T10:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3173407326 wait complete. 2023-09-13T10:00:38.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.538+0000 7fb02d1c9b80 20 client.20925 trim_cache size 0 max 16384 2023-09-13T10:00:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 Processor -- start 2023-09-13T10:00:38.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 -- start start 2023-09-13T10:00:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeee2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed9af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eeece000 con 0x55b1eeed2700 2023-09-13T10:00:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eeecd730 con 0x55b1eeed1a00 2023-09-13T10:00:38.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eeed6440 con 0x55b1eeed3060 2023-09-13T10:00:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb019d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeee2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb019d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeee2380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46984/0 (socket says 172.21.15.6:46984) 2023-09-13T10:00:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb019d9b700 1 -- 172.21.15.6:0/3713152968 learned_addr learned my addr 172.21.15.6:0/3713152968 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb01a59c700 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.554+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb019d9b700 1 -- 172.21.15.6:0/3713152968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 msgr2=0x55b1eeed9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb019d9b700 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed9af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb019d9b700 1 -- 172.21.15.6:0/3713152968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 msgr2=0x55b1eeed14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb019d9b700 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb019d9b700 1 -- 172.21.15.6:0/3713152968 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b1eec4fde0 con 0x55b1eeed2700 2023-09-13T10:00:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb01a59c700 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb019d9b700 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeee2380 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fb010000c00 tx=0x7fb010027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39732d558b7e9971 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb0097fa700 1 -- 172.21.15.6:0/3713152968 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01002f040 con 0x55b1eeed2700 2023-09-13T10:00:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb0097fa700 1 -- 172.21.15.6:0/3713152968 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb01003e440 con 0x55b1eeed2700 2023-09-13T10:00:38.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.555+0000 7fb0097fa700 1 -- 172.21.15.6:0/3713152968 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01000f9f0 con 0x55b1eeed2700 2023-09-13T10:00:38.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3713152968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 msgr2=0x55b1eeee2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeee2380 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fb010000c00 tx=0x7fb010027000 comp rx=0 tx=0).stop 2023-09-13T10:00:38.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3713152968 shutdown_connections 2023-09-13T10:00:38.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed3060 0x55b1eeed9af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeed14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3713152968 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed2700 0x55b1eeee2380 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3713152968 >> 172.21.15.6:0/3713152968 conn(0x55b1eee2fc80 msgr2=0x55b1eeecbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3713152968 shutdown_connections 2023-09-13T10:00:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3713152968 wait complete. 2023-09-13T10:00:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 -- start start 2023-09-13T10:00:38.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.556+0000 7fb02d1c9b80 1 Processor -- start 2023-09-13T10:00:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeeddc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed2700 0x55b1eeede150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb02d1c9b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed3060 0x55b1eeee1170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eeee16b0 con 0x55b1eeed3060 2023-09-13T10:00:38.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eeee1820 con 0x55b1eeed1a00 2023-09-13T10:00:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb02d1c9b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b1eeee19e0 con 0x55b1eeed2700 2023-09-13T10:00:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb02d1c9b80 10 client.0 _ll_register_callbacks cb 0x55b1eedbf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed3060 0x55b1eeee1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb019d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed2700 0x55b1eeede150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeeddc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb019d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed2700 0x55b1eeede150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50044/0 (socket says 172.21.15.6:50044) 2023-09-13T10:00:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed3060 0x55b1eeee1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46992/0 (socket says 172.21.15.6:46992) 2023-09-13T10:00:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01a59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeeddc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40512/0 (socket says 172.21.15.6:40512) 2023-09-13T10:00:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb019d9b700 1 -- 172.21.15.6:0/3126406881 learned_addr learned my addr 172.21.15.6:0/3126406881 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 -- 172.21.15.6:0/3126406881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed2700 msgr2=0x55b1eeede150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed2700 0x55b1eeede150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 -- 172.21.15.6:0/3126406881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 msgr2=0x55b1eeeddc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeeddc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 -- 172.21.15.6:0/3126406881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b1eee3b7a0 con 0x55b1eeed3060 2023-09-13T10:00:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb01ad9d700 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed3060 0x55b1eeee1170 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x55b1eeec8a80 tx=0x7fb014007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27794886f92cb7d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.557+0000 7fb001ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb001ffb700 1 -- 172.21.15.6:0/3126406881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01401c070 con 0x55b1eeed3060 2023-09-13T10:00:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb010022040 con 0x55b1eeed3060 2023-09-13T10:00:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb001ffb700 1 -- 172.21.15.6:0/3126406881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb014004bb0 con 0x55b1eeed3060 2023-09-13T10:00:38.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb001ffb700 1 -- 172.21.15.6:0/3126406881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb01400e040 con 0x55b1eeed3060 2023-09-13T10:00:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 10 client.20931 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55b1eeca3630 con 0x55b1eeed3060 2023-09-13T10:00:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb001ffb700 1 -- 172.21.15.6:0/3126406881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb010022040 con 0x55b1eeed3060 2023-09-13T10:00:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb001ffb700 1 -- 172.21.15.6:0/3126406881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb014021a70 con 0x55b1eeed3060 2023-09-13T10:00:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 10 client.20931 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:38.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 10 client.20931 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:00:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 20 client.20931 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eef3b600 0x55b1eef3da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 4 client.20931 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b1eeddd050 con 0x55b1eef3b600 2023-09-13T10:00:38.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.558+0000 7fb01a59c700 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eef3b600 0x55b1eef3da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb001ffb700 10 client.20931 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb01a59c700 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eef3b600 0x55b1eef3da20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=af02fe199ee74094 server_cookie=ef1a32d7059a7e8b in_seq=0 out_seq=0 2023-09-13T10:00:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb001ffb700 1 -- 172.21.15.6:0/3126406881 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b1eeddd050 con 0x55b1eef3b600 2023-09-13T10:00:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb001ffb700 10 client.20931 handle_command_reply: tid=0 2023-09-13T10:00:38.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 client.20931 shutdown 2023-09-13T10:00:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed3060 msgr2=0x55b1eeee1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed3060 0x55b1eeee1170 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x55b1eeec8a80 tx=0x7fb014007db0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 shutdown_connections 2023-09-13T10:00:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55b1eef3b600 0x55b1eef3da20 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b1eeed3060 0x55b1eeee1170 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb001ffb700 0 client.20931 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:00:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b1eeed1a00 0x55b1eeeddc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 --2- 172.21.15.6:0/3126406881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b1eeed2700 0x55b1eeede150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 >> 172.21.15.6:0/3126406881 conn(0x55b1eee2fc80 msgr2=0x55b1eeee2bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.579 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 shutdown_connections 2023-09-13T10:00:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 1 -- 172.21.15.6:0/3126406881 wait complete. 2023-09-13T10:00:38.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.559+0000 7fb02d1c9b80 20 client.20931 trim_cache size 0 max 16384 2023-09-13T10:00:38.580 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:38.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0040a0640 msgr2=0x7fb0040a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0040a0640 0x7fb0040a2b00 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fb01000b2e0 tx=0x7fb010005960 comp rx=0 tx=0).stop 2023-09-13T10:00:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0ffcc0 msgr2=0x7fb01c196a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0ffcc0 0x7fb01c196a80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb00c00e9c0 tx=0x7fb00c00ecd0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 shutdown_connections 2023-09-13T10:00:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb01c101850 0x7fb01c19e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb01c0ffcc0 0x7fb01c196a80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb0040a0640 0x7fb0040a2b00 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 --2- 172.21.15.6:0/1034219189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb01c100eb0 0x7fb01c196fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 >> 172.21.15.6:0/1034219189 conn(0x7fb01c0fb250 msgr2=0x7fb01c0fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 shutdown_connections 2023-09-13T10:00:38.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.560+0000 7fb020fe4700 1 -- 172.21.15.6:0/1034219189 wait complete. 2023-09-13T10:00:38.584 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T10:00:38.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 315906 34.50 MB/sec execute 358 sec latency 79.224 ms 2023-09-13T10:00:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 -- 172.21.15.6:0/244816074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4102910 msgr2=0x7f04a41091c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 --2- 172.21.15.6:0/244816074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4102910 0x7f04a41091c0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f049c00b0d0 tx=0x7f049c00b3e0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 -- 172.21.15.6:0/244816074 shutdown_connections 2023-09-13T10:00:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 --2- 172.21.15.6:0/244816074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4102910 0x7f04a41091c0 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 --2- 172.21.15.6:0/244816074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4100d80 0x7f04a41011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 --2- 172.21.15.6:0/244816074 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a4101f70 0x7f04a41023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 -- 172.21.15.6:0/244816074 >> 172.21.15.6:0/244816074 conn(0x7f04a40fc310 msgr2=0x7f04a40fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 -- 172.21.15.6:0/244816074 shutdown_connections 2023-09-13T10:00:38.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.732+0000 7f04abb1e700 1 -- 172.21.15.6:0/244816074 wait complete. 2023-09-13T10:00:38.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 Processor -- start 2023-09-13T10:00:38.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 -- start start 2023-09-13T10:00:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4100d80 0x7f04a4196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a4101f70 0x7f04a4197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4102910 0x7f04a419e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a419e6d0 con 0x7f04a4100d80 2023-09-13T10:00:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a419e810 con 0x7f04a4101f70 2023-09-13T10:00:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04abb1e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04a419e9a0 con 0x7f04a4102910 2023-09-13T10:00:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04a98ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4100d80 0x7f04a4196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04a98ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4100d80 0x7f04a4196b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47002/0 (socket says 172.21.15.6:47002) 2023-09-13T10:00:38.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04a98ba700 1 -- 172.21.15.6:0/4213539985 learned_addr learned my addr 172.21.15.6:0/4213539985 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04a90b9700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a4101f70 0x7f04a4197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.733+0000 7f04aa0bb700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4102910 0x7f04a419e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04a98ba700 1 -- 172.21.15.6:0/4213539985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4102910 msgr2=0x7f04a419e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04a98ba700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4102910 0x7f04a419e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04a98ba700 1 -- 172.21.15.6:0/4213539985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a4101f70 msgr2=0x7f04a4197090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04a98ba700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a4101f70 0x7f04a4197090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04a98ba700 1 -- 172.21.15.6:0/4213539985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f049c009d00 con 0x7f04a4100d80 2023-09-13T10:00:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04a98ba700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4100d80 0x7f04a4196b50 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f04a000e970 tx=0x7f04a000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f049affd700 1 -- 172.21.15.6:0/4213539985 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0009790 con 0x7f04a4100d80 2023-09-13T10:00:38.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f049affd700 1 -- 172.21.15.6:0/4213539985 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04a000c7e0 con 0x7f04a4100d80 2023-09-13T10:00:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04a419ec80 con 0x7f04a4100d80 2023-09-13T10:00:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f049affd700 1 -- 172.21.15.6:0/4213539985 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0003c70 con 0x7f04a4100d80 2023-09-13T10:00:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.734+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a419f190 con 0x7f04a4100d80 2023-09-13T10:00:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.736+0000 7f049affd700 1 -- 172.21.15.6:0/4213539985 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f04a000cc50 con 0x7f04a4100d80 2023-09-13T10:00:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.737+0000 7f049affd700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04900a06c0 0x7f04900a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.737+0000 7f04a90b9700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04900a06c0 0x7f04900a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.737+0000 7f049affd700 1 -- 172.21.15.6:0/4213539985 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04a0014070 con 0x7f04a4100d80 2023-09-13T10:00:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.738+0000 7f04a90b9700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04900a06c0 0x7f04900a2b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0494009c60 tx=0x7f0494009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.738+0000 7f04b7d03b80 1 Processor -- start 2023-09-13T10:00:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.738+0000 7f04b7d03b80 1 -- start start 2023-09-13T10:00:38.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5c700 0x56329cf5cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5d060 0x56329cf5b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf5be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329ceb4780 con 0x56329cf5d060 2023-09-13T10:00:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329ceb20a0 con 0x56329cf5ba00 2023-09-13T10:00:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cead990 con 0x56329cf5c700 2023-09-13T10:00:38.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a90b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5d060 0x56329cf5b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a90b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5d060 0x56329cf5b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47012/0 (socket says 172.21.15.6:47012) 2023-09-13T10:00:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a90b9700 1 -- 172.21.15.6:0/2429196338 learned_addr learned my addr 172.21.15.6:0/2429196338 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a98ba700 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5c700 0x56329cf5cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04aa0bb700 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf5be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a98ba700 1 -- 172.21.15.6:0/2429196338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 msgr2=0x56329cf5be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a98ba700 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf5be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a98ba700 1 -- 172.21.15.6:0/2429196338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5d060 msgr2=0x56329cf5b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a98ba700 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5d060 0x56329cf5b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a98ba700 1 -- 172.21.15.6:0/2429196338 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56329cd2d630 con 0x56329cf5c700 2023-09-13T10:00:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a90b9700 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5d060 0x56329cf5b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.739+0000 7f04a98ba700 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5c700 0x56329cf5cb20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04a0005950 tx=0x7f04a0003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa66298a08cc5bde server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f048ffff700 1 -- 172.21.15.6:0/2429196338 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a00994f0 con 0x56329cf5c700 2023-09-13T10:00:38.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f048ffff700 1 -- 172.21.15.6:0/2429196338 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04a009d320 con 0x56329cf5c700 2023-09-13T10:00:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f048ffff700 1 -- 172.21.15.6:0/2429196338 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0084210 con 0x56329cf5c700 2023-09-13T10:00:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2429196338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5c700 msgr2=0x56329cf5cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5c700 0x56329cf5cb20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04a0005950 tx=0x7f04a0003680 comp rx=0 tx=0).stop 2023-09-13T10:00:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2429196338 shutdown_connections 2023-09-13T10:00:38.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf5be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.740+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5c700 0x56329cf5cb20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2429196338 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5d060 0x56329cf5b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2429196338 >> 172.21.15.6:0/2429196338 conn(0x56329ceb9c80 msgr2=0x56329cf55f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2429196338 shutdown_connections 2023-09-13T10:00:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2429196338 wait complete. 2023-09-13T10:00:38.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 -- start start 2023-09-13T10:00:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 Processor -- start 2023-09-13T10:00:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5ba00 0x56329cf64f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.741+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5d060 0x56329cf6c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329ce4bbb0 con 0x56329cf5c700 2023-09-13T10:00:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329ce4b8b0 con 0x56329cf5d060 2023-09-13T10:00:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cd2f920 con 0x56329cf5ba00 2023-09-13T10:00:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04b7d03b80 10 client.0 _ll_register_callbacks cb 0x56329ce49680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5ba00 0x56329cf64f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5ba00 0x56329cf64f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50070/0 (socket says 172.21.15.6:50070) 2023-09-13T10:00:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 -- 172.21.15.6:0/2348126519 learned_addr learned my addr 172.21.15.6:0/2348126519 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04aa0bb700 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5d060 0x56329cf6c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a90b9700 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 -- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5d060 msgr2=0x56329cf6c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5d060 0x56329cf6c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 -- 172.21.15.6:0/2348126519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 msgr2=0x56329cf654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 -- 172.21.15.6:0/2348126519 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a419f190 con 0x56329cf5ba00 2023-09-13T10:00:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f04a98ba700 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5ba00 0x56329cf64f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f04a00c9850 tx=0x7f04a0099d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=45d6dc0f22b89792 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.742+0000 7f048d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f048d7fa700 1 -- 172.21.15.6:0/2348126519 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a0084210 con 0x56329cf5ba00 2023-09-13T10:00:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f048d7fa700 1 -- 172.21.15.6:0/2348126519 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04a00a1560 con 0x56329cf5ba00 2023-09-13T10:00:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56329cf4e670 con 0x56329cf5ba00 2023-09-13T10:00:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f048d7fa700 1 -- 172.21.15.6:0/2348126519 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04a00994f0 con 0x56329cf5ba00 2023-09-13T10:00:38.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 10 client.30151 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56329cec57a0 con 0x56329cf5ba00 2023-09-13T10:00:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f048d7fa700 1 -- 172.21.15.6:0/2348126519 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56329cf4e670 con 0x56329cf5ba00 2023-09-13T10:00:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f048d7fa700 1 -- 172.21.15.6:0/2348126519 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f04a00b1b10 con 0x56329cf5ba00 2023-09-13T10:00:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 10 client.30151 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:38.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 10 client.30151 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:00:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 20 client.30151 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf70810 0x56329cf72c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 4 client.30151 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.743+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56329cea6970 con 0x56329cf70810 2023-09-13T10:00:38.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.746+0000 7f04a90b9700 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf70810 0x56329cf72c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.747+0000 7f048d7fa700 10 client.30151 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.747+0000 7f04a90b9700 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf70810 0x56329cf72c30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bf71fb66aa9b3257 server_cookie=e6b120a352ea96e2 in_seq=0 out_seq=0 2023-09-13T10:00:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f048d7fa700 1 -- 172.21.15.6:0/2348126519 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56329cea6970 con 0x56329cf70810 2023-09-13T10:00:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f048d7fa700 10 client.30151 handle_command_reply: tid=0 2023-09-13T10:00:38.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 client.30151 shutdown 2023-09-13T10:00:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5ba00 msgr2=0x56329cf64f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5ba00 0x56329cf64f60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f04a00c9850 tx=0x7f04a0099d20 comp rx=0 tx=0).stop 2023-09-13T10:00:38.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 shutdown_connections 2023-09-13T10:00:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf70810 0x56329cf72c30 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5d060 0x56329cf6c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329cf5ba00 0x56329cf64f60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f048d7fa700 0 client.30151 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:38.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/2348126519 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 >> 172.21.15.6:0/2348126519 conn(0x56329ceb9c80 msgr2=0x56329cf507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 shutdown_connections 2023-09-13T10:00:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 1 -- 172.21.15.6:0/2348126519 wait complete. 2023-09-13T10:00:38.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.748+0000 7f04b7d03b80 20 client.30151 trim_cache size 0 max 16384 2023-09-13T10:00:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.765+0000 7f04b7d03b80 1 Processor -- start 2023-09-13T10:00:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.765+0000 7f04b7d03b80 1 -- start start 2023-09-13T10:00:38.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 0x56329cf5b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf64d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf65250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cf56810 con 0x56329cf5c700 2023-09-13T10:00:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cf64230 con 0x56329cf5ba00 2023-09-13T10:00:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cf636c0 con 0x56329ceb9c80 2023-09-13T10:00:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf65250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04a90b9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf64d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf65250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47028/0 (socket says 172.21.15.6:47028) 2023-09-13T10:00:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04a98ba700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 0x56329cf5b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 -- 172.21.15.6:0/3028091273 learned_addr learned my addr 172.21.15.6:0/3028091273 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04a90b9700 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf64d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40548/0 (socket says 172.21.15.6:40548) 2023-09-13T10:00:38.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 -- 172.21.15.6:0/3028091273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 msgr2=0x56329cf5b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 0x56329cf5b4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 -- 172.21.15.6:0/3028091273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 msgr2=0x56329cf64d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf64d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 -- 172.21.15.6:0/3028091273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56329ccd9de0 con 0x56329cf5c700 2023-09-13T10:00:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.766+0000 7f04aa0bb700 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf65250 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f049c009310 tx=0x7f049c009340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9f1139b7cbbff8d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f0498d82700 1 -- 172.21.15.6:0/3028091273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c021070 con 0x56329cf5c700 2023-09-13T10:00:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f0498d82700 1 -- 172.21.15.6:0/3028091273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f049c009460 con 0x56329cf5c700 2023-09-13T10:00:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f0498d82700 1 -- 172.21.15.6:0/3028091273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f049c00e040 con 0x56329cf5c700 2023-09-13T10:00:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f04b7d03b80 1 -- 172.21.15.6:0/3028091273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 msgr2=0x56329cf65250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf65250 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f049c009310 tx=0x7f049c009340 comp rx=0 tx=0).stop 2023-09-13T10:00:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f04b7d03b80 1 -- 172.21.15.6:0/3028091273 shutdown_connections 2023-09-13T10:00:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5c700 0x56329cf65250 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 0x56329cf5b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/3028091273 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5ba00 0x56329cf64d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.767+0000 7f04b7d03b80 1 -- 172.21.15.6:0/3028091273 >> 172.21.15.6:0/3028091273 conn(0x56329cf56240 msgr2=0x56329cf6cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.768+0000 7f04b7d03b80 1 -- 172.21.15.6:0/3028091273 shutdown_connections 2023-09-13T10:00:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.768+0000 7f04b7d03b80 1 -- 172.21.15.6:0/3028091273 wait complete. 2023-09-13T10:00:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.768+0000 7f04b7d03b80 1 -- start start 2023-09-13T10:00:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.768+0000 7f04b7d03b80 1 Processor -- start 2023-09-13T10:00:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.768+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 0x56329cfc0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.768+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5ba00 0x56329cfc1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04b7d03b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5c700 0x56329cfc8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cfc86b0 con 0x56329cf5ba00 2023-09-13T10:00:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cfc87f0 con 0x56329cf5c700 2023-09-13T10:00:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04b7d03b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56329cfc8980 con 0x56329ceb9c80 2023-09-13T10:00:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04b7d03b80 10 client.0 _ll_register_callbacks cb 0x56329ce49680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5ba00 0x56329cfc1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5ba00 0x56329cfc1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47032/0 (socket says 172.21.15.6:47032) 2023-09-13T10:00:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 -- 172.21.15.6:0/1464360649 learned_addr learned my addr 172.21.15.6:0/1464360649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04aa0bb700 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5c700 0x56329cfc8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 -- 172.21.15.6:0/1464360649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 msgr2=0x56329cfc0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 0x56329cfc0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 -- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5c700 msgr2=0x56329cfc8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5c700 0x56329cfc8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 -- 172.21.15.6:0/1464360649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04a4109b10 con 0x56329cf5ba00 2023-09-13T10:00:38.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04a90b9700 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5ba00 0x56329cfc1130 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f0494005d90 tx=0x7f04940047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629abffe30fc26cf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:38.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f048d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:38.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f048d7fa700 1 -- 172.21.15.6:0/1464360649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0494022040 con 0x56329cf5ba00 2023-09-13T10:00:38.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f048d7fa700 1 -- 172.21.15.6:0/1464360649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f049402b2b0 con 0x56329cf5ba00 2023-09-13T10:00:38.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.769+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04a009d320 con 0x56329cf5ba00 2023-09-13T10:00:38.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f048d7fa700 1 -- 172.21.15.6:0/1464360649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f049402b470 con 0x56329cf5ba00 2023-09-13T10:00:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 10 client.20949 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56329ccc2c60 con 0x56329cf5ba00 2023-09-13T10:00:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f048d7fa700 1 -- 172.21.15.6:0/1464360649 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04a009d320 con 0x56329cf5ba00 2023-09-13T10:00:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f048d7fa700 1 -- 172.21.15.6:0/1464360649 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0494028830 con 0x56329cf5ba00 2023-09-13T10:00:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 10 client.20949 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:38.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 10 client.20949 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:00:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 20 client.20949 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf5d060 0x56329cfcc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 4 client.20949 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56329ce67050 con 0x56329cf5d060 2023-09-13T10:00:38.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.770+0000 7f04a98ba700 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf5d060 0x56329cfcc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.771+0000 7f048d7fa700 10 client.20949 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:38.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.771+0000 7f04a98ba700 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf5d060 0x56329cfcc430 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5989459020486fb6 server_cookie=4d9461595ab8957 in_seq=0 out_seq=0 2023-09-13T10:00:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f048d7fa700 1 -- 172.21.15.6:0/1464360649 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56329ce67050 con 0x56329cf5d060 2023-09-13T10:00:38.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f048d7fa700 10 client.20949 handle_command_reply: tid=0 2023-09-13T10:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 client.20949 shutdown 2023-09-13T10:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5ba00 msgr2=0x56329cfc1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5ba00 0x56329cfc1130 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f0494005d90 tx=0x7f04940047c0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 shutdown_connections 2023-09-13T10:00:38.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x56329cf5d060 0x56329cfcc430 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56329cf5c700 0x56329cfc8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f048d7fa700 0 client.20949 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56329ceb9c80 0x56329cfc0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 --2- 172.21.15.6:0/1464360649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56329cf5ba00 0x56329cfc1130 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.790 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 >> 172.21.15.6:0/1464360649 conn(0x56329cf56240 msgr2=0x56329cf64d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 shutdown_connections 2023-09-13T10:00:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 1 -- 172.21.15.6:0/1464360649 wait complete. 2023-09-13T10:00:38.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.787+0000 7f04b7d03b80 20 client.20949 trim_cache size 0 max 16384 2023-09-13T10:00:38.791 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:38.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04900a06c0 msgr2=0x7f04900a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04900a06c0 0x7f04900a2b80 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0494009c60 tx=0x7f0494009260 comp rx=0 tx=0).stop 2023-09-13T10:00:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4100d80 msgr2=0x7f04a4196b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4100d80 0x7f04a4196b50 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f04a000e970 tx=0x7f04a000ec80 comp rx=0 tx=0).stop 2023-09-13T10:00:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 shutdown_connections 2023-09-13T10:00:38.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04a4102910 0x7f04a419e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04900a06c0 0x7f04900a2b80 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f04a4100d80 0x7f04a4196b50 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 --2- 172.21.15.6:0/4213539985 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f04a4101f70 0x7f04a4197090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 >> 172.21.15.6:0/4213539985 conn(0x7f04a40fc310 msgr2=0x7f04a40fe4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:38.794 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 shutdown_connections 2023-09-13T10:00:38.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.788+0000 7f04abb1e700 1 -- 172.21.15.6:0/4213539985 wait complete. 2023-09-13T10:00:38.803 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T10:00:38.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 -- 172.21.15.6:0/2351635738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece8100ef0 msgr2=0x7fece8101370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:38.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 --2- 172.21.15.6:0/2351635738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece8100ef0 0x7fece8101370 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009990 tx=0x7fecdc009ca0 comp rx=0 tx=0).stop 2023-09-13T10:00:38.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 -- 172.21.15.6:0/2351635738 shutdown_connections 2023-09-13T10:00:38.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 --2- 172.21.15.6:0/2351635738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece81018b0 0x7fece8108140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 --2- 172.21.15.6:0/2351635738 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece81001e0 0x7fece8100600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 --2- 172.21.15.6:0/2351635738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece8100ef0 0x7fece8101370 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 -- 172.21.15.6:0/2351635738 >> 172.21.15.6:0/2351635738 conn(0x7fece80fa9b0 msgr2=0x7fece80fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 -- 172.21.15.6:0/2351635738 shutdown_connections 2023-09-13T10:00:39.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.998+0000 7feceda34700 1 -- 172.21.15.6:0/2351635738 wait complete. 2023-09-13T10:00:39.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 Processor -- start 2023-09-13T10:00:39.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 -- start start 2023-09-13T10:00:39.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece81001e0 0x7fece810a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece8100ef0 0x7fece8108ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece81018b0 0x7fece8109000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece81097a0 con 0x7fece81018b0 2023-09-13T10:00:39.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8109910 con 0x7fece81001e0 2023-09-13T10:00:39.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7feceda34700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece81a0b30 con 0x7fece8100ef0 2023-09-13T10:00:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7fece77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece81018b0 0x7fece8109000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece81001e0 0x7fece810a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7fece77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece81018b0 0x7fece8109000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47048/0 (socket says 172.21.15.6:47048) 2023-09-13T10:00:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7fece67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece8100ef0 0x7fece8108ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7fece77fe700 1 -- 172.21.15.6:0/1005995817 learned_addr learned my addr 172.21.15.6:0/1005995817 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:38.999+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece81001e0 0x7fece810a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40568/0 (socket says 172.21.15.6:40568) 2023-09-13T10:00:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.000+0000 7fece77fe700 1 -- 172.21.15.6:0/1005995817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece8100ef0 msgr2=0x7fece8108ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.000+0000 7fece77fe700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece8100ef0 0x7fece8108ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.000+0000 7fece77fe700 1 -- 172.21.15.6:0/1005995817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece81001e0 msgr2=0x7fece810a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.000+0000 7fece77fe700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece81001e0 0x7fece810a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.000+0000 7fece77fe700 1 -- 172.21.15.6:0/1005995817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece0009c40 con 0x7fece81018b0 2023-09-13T10:00:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.000+0000 7fece67fc700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece8100ef0 0x7fece8108ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:39.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.000+0000 7fece77fe700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece81018b0 0x7fece8109000 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fece000c370 tx=0x7fece000c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.003+0000 7fececa32700 1 -- 172.21.15.6:0/1005995817 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0017070 con 0x7fece81018b0 2023-09-13T10:00:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.003+0000 7fececa32700 1 -- 172.21.15.6:0/1005995817 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fece000f040 con 0x7fece81018b0 2023-09-13T10:00:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.003+0000 7fececa32700 1 -- 172.21.15.6:0/1005995817 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000e050 con 0x7fece81018b0 2023-09-13T10:00:39.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.003+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc0095f0 con 0x7fece81018b0 2023-09-13T10:00:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.003+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece81a10e0 con 0x7fece81018b0 2023-09-13T10:00:39.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.007+0000 7fececa32700 1 -- 172.21.15.6:0/1005995817 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fece000cb60 con 0x7fece81018b0 2023-09-13T10:00:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.007+0000 7fececa32700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fecd00a0740 0x7fecd00a2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.008+0000 7fececa32700 1 -- 172.21.15.6:0/1005995817 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fece00cb070 con 0x7fece81018b0 2023-09-13T10:00:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.008+0000 7fece6ffd700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fecd00a0740 0x7fecd00a2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.008+0000 7fece6ffd700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fecd00a0740 0x7fecd00a2c00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fece8067b20 tx=0x7fecd8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 Processor -- start 2023-09-13T10:00:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 -- start start 2023-09-13T10:00:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c08a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a2060 0x55f7c08a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08a0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c07f9780 con 0x55f7c08a0a00 2023-09-13T10:00:39.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c07f70a0 con 0x55f7c08a2060 2023-09-13T10:00:39.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c07f2990 con 0x55f7c08a1700 2023-09-13T10:00:39.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fece77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08a0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c08a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fece77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08a0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47056/0 (socket says 172.21.15.6:47056) 2023-09-13T10:00:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c08a1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50106/0 (socket says 172.21.15.6:50106) 2023-09-13T10:00:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fece67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a2060 0x55f7c08a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.009+0000 7fece77fe700 1 -- 172.21.15.6:0/4077278788 learned_addr learned my addr 172.21.15.6:0/4077278788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7fece6ffd700 1 -- 172.21.15.6:0/4077278788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a2060 msgr2=0x55f7c08a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7fece6ffd700 1 --2- 172.21.15.6:0/4077278788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a2060 0x55f7c08a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7fece6ffd700 1 -- 172.21.15.6:0/4077278788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 msgr2=0x55f7c08a0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7fece6ffd700 1 --2- 172.21.15.6:0/4077278788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08a0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7fece6ffd700 1 -- 172.21.15.6:0/4077278788 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7c0672630 con 0x55f7c08a1700 2023-09-13T10:00:39.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7fece6ffd700 1 --2- 172.21.15.6:0/4077278788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c08a1b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fecd8010d90 tx=0x7fecd8013000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87afddd2b75b2d12 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7feccdffb700 1 -- 172.21.15.6:0/4077278788 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8011db0 con 0x55f7c08a1700 2023-09-13T10:00:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7feccdffb700 1 -- 172.21.15.6:0/4077278788 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd8015070 con 0x55f7c08a1700 2023-09-13T10:00:39.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.010+0000 7feccdffb700 1 -- 172.21.15.6:0/4077278788 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8003cc0 con 0x55f7c08a1700 2023-09-13T10:00:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.011+0000 7fecf9c19b80 1 -- 172.21.15.6:0/4077278788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 msgr2=0x55f7c08a1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.011+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/4077278788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c08a1b20 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fecd8010d90 tx=0x7fecd8013000 comp rx=0 tx=0).stop 2023-09-13T10:00:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 -- 172.21.15.6:0/4077278788 shutdown_connections 2023-09-13T10:00:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/4077278788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08a0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/4077278788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c08a1b20 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/4077278788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a2060 0x55f7c08a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 -- 172.21.15.6:0/4077278788 >> 172.21.15.6:0/4077278788 conn(0x55f7c07fec80 msgr2=0x55f7c089af10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 -- 172.21.15.6:0/4077278788 shutdown_connections 2023-09-13T10:00:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 -- 172.21.15.6:0/4077278788 wait complete. 2023-09-13T10:00:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 -- start start 2023-09-13T10:00:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.012+0000 7fecf9c19b80 1 Processor -- start 2023-09-13T10:00:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a0a00 0x55f7c08a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08aa450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c0790bb0 con 0x55f7c08a2060 2023-09-13T10:00:39.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c07908b0 con 0x55f7c08a1700 2023-09-13T10:00:39.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c0674920 con 0x55f7c08a0a00 2023-09-13T10:00:39.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fecf9c19b80 10 client.0 _ll_register_callbacks cb 0x55f7c078e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:39.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a0a00 0x55f7c08a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08aa450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a0a00 0x55f7c08a9f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50112/0 (socket says 172.21.15.6:50112) 2023-09-13T10:00:39.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece6ffd700 1 -- 172.21.15.6:0/2188068104 learned_addr learned my addr 172.21.15.6:0/2188068104 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece77fe700 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece6ffd700 1 -- 172.21.15.6:0/2188068104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 msgr2=0x55f7c08aa450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece6ffd700 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08aa450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece6ffd700 1 -- 172.21.15.6:0/2188068104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 msgr2=0x55f7c08b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.013+0000 7fece6ffd700 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fece6ffd700 1 -- 172.21.15.6:0/2188068104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd8010a70 con 0x55f7c08a0a00 2023-09-13T10:00:39.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fece6ffd700 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a0a00 0x55f7c08a9f10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecd8010a10 tx=0x7fecd8011de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffd594933ec845b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fecc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:39.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2188068104 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd8003e50 con 0x55f7c08a0a00 2023-09-13T10:00:39.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7c0893670 con 0x55f7c08a0a00 2023-09-13T10:00:39.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2188068104 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fecd8017070 con 0x55f7c08a0a00 2023-09-13T10:00:39.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2188068104 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecd8005050 con 0x55f7c08a0a00 2023-09-13T10:00:39.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fecf9c19b80 10 client.30166 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:39.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.014+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55f7c080a7a0 con 0x55f7c08a0a00 2023-09-13T10:00:39.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2188068104 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55f7c0893670 con 0x55f7c08a0a00 2023-09-13T10:00:39.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2188068104 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fecd803dae0 con 0x55f7c08a0a00 2023-09-13T10:00:39.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecf9c19b80 10 client.30166 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:39.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecf9c19b80 10 client.30166 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:00:39.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecf9c19b80 20 client.30166 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:39.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c08b5c50 0x55f7c08b8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecf9c19b80 4 client.30166 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7c07eb970 con 0x55f7c08b5c50 2023-09-13T10:00:39.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.015+0000 7fece67fc700 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c08b5c50 0x55f7c08b8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.016+0000 7fece67fc700 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c08b5c50 0x55f7c08b8070 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=66ed38e124b194c server_cookie=9a23bf4cd93c1ce9 in_seq=0 out_seq=0 2023-09-13T10:00:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.016+0000 7fecc6ffd700 10 client.30166 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2188068104 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f7c07eb970 con 0x55f7c08b5c50 2023-09-13T10:00:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecc6ffd700 10 client.30166 handle_command_reply: tid=0 2023-09-13T10:00:39.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 client.30166 shutdown 2023-09-13T10:00:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a0a00 msgr2=0x55f7c08a9f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a0a00 0x55f7c08a9f10 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fecd8010a10 tx=0x7fecd8011de0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 shutdown_connections 2023-09-13T10:00:39.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c08b5c50 0x55f7c08b8070 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecc6ffd700 0 client.30166 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a0a00 0x55f7c08a9f10 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2188068104 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08aa450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 >> 172.21.15.6:0/2188068104 conn(0x55f7c07fec80 msgr2=0x55f7c08957f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 shutdown_connections 2023-09-13T10:00:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2188068104 wait complete. 2023-09-13T10:00:39.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.017+0000 7fecf9c19b80 20 client.30166 trim_cache size 0 max 16384 2023-09-13T10:00:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 Processor -- start 2023-09-13T10:00:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 -- start start 2023-09-13T10:00:39.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a0a00 0x55f7c08a04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c089bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c08a9a80 con 0x55f7c08a2060 2023-09-13T10:00:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c08a5430 con 0x55f7c08a0a00 2023-09-13T10:00:39.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c08b59a0 con 0x55f7c08a1700 2023-09-13T10:00:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fece67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c089bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fece77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a0a00 0x55f7c08a04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fece67fc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c089bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50122/0 (socket says 172.21.15.6:50122) 2023-09-13T10:00:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fece77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47070/0 (socket says 172.21.15.6:47070) 2023-09-13T10:00:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a0a00 0x55f7c08a04c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40590/0 (socket says 172.21.15.6:40590) 2023-09-13T10:00:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.032+0000 7fece67fc700 1 -- 172.21.15.6:0/421733210 learned_addr learned my addr 172.21.15.6:0/421733210 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fece77fe700 1 -- 172.21.15.6:0/421733210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 msgr2=0x55f7c089bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fece77fe700 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c089bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fece77fe700 1 -- 172.21.15.6:0/421733210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a0a00 msgr2=0x55f7c08a04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fece77fe700 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a0a00 0x55f7c08a04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fece77fe700 1 -- 172.21.15.6:0/421733210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7c061ede0 con 0x55f7c08a2060 2023-09-13T10:00:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fece67fc700 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c089bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:39.042 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fece77fe700 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1450 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fece0094cb0 tx=0x7fece0083040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51bca4a128f1e5a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fecce7fc700 1 -- 172.21.15.6:0/421733210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00092e0 con 0x55f7c08a2060 2023-09-13T10:00:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fecce7fc700 1 -- 172.21.15.6:0/421733210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fece00112c0 con 0x55f7c08a2060 2023-09-13T10:00:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.033+0000 7fecce7fc700 1 -- 172.21.15.6:0/421733210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00a0890 con 0x55f7c08a2060 2023-09-13T10:00:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 -- 172.21.15.6:0/421733210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 msgr2=0x55f7c08b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.043 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1450 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7fece0094cb0 tx=0x7fece0083040 comp rx=0 tx=0).stop 2023-09-13T10:00:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 -- 172.21.15.6:0/421733210 shutdown_connections 2023-09-13T10:00:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a2060 0x55f7c08b1450 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a0a00 0x55f7c08a04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/421733210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a1700 0x55f7c089bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.044 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 -- 172.21.15.6:0/421733210 >> 172.21.15.6:0/421733210 conn(0x55f7c07fec80 msgr2=0x55f7c08a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 -- 172.21.15.6:0/421733210 shutdown_connections 2023-09-13T10:00:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 -- 172.21.15.6:0/421733210 wait complete. 2023-09-13T10:00:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.034+0000 7fecf9c19b80 1 -- start start 2023-09-13T10:00:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 1 Processor -- start 2023-09-13T10:00:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.045 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08ad380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a2060 0x55f7c08b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c08b08e0 con 0x55f7c08a0a00 2023-09-13T10:00:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c08b0a50 con 0x55f7c08a1700 2023-09-13T10:00:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7c08b0c10 con 0x55f7c08a2060 2023-09-13T10:00:39.046 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fecf9c19b80 10 client.0 _ll_register_callbacks cb 0x55f7c078e680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece67fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08ad380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08ace40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47072/0 (socket says 172.21.15.6:47072) 2023-09-13T10:00:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 -- 172.21.15.6:0/2672262086 learned_addr learned my addr 172.21.15.6:0/2672262086 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.047 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece77fe700 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a2060 0x55f7c08b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 -- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a2060 msgr2=0x55f7c08b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a2060 0x55f7c08b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 -- 172.21.15.6:0/2672262086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 msgr2=0x55f7c08ad380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08ad380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.048 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.035+0000 7fece6ffd700 1 -- 172.21.15.6:0/2672262086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece80feef0 con 0x55f7c08a0a00 2023-09-13T10:00:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fece6ffd700 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08ace40 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fecd803dec0 tx=0x7fecd8010820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274dff6d4641481f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecc6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2672262086 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd801e870 con 0x55f7c08a0a00 2023-09-13T10:00:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2672262086 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fecd8017040 con 0x55f7c08a0a00 2023-09-13T10:00:39.049 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fecd8015070 con 0x55f7c08a0a00 2023-09-13T10:00:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2672262086 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fecd801e9d0 con 0x55f7c08a0a00 2023-09-13T10:00:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecf9c19b80 10 client.20967 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x7fece81a10e0 con 0x55f7c08a0a00 2023-09-13T10:00:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.036+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2672262086 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fecd804c020 con 0x55f7c08a0a00 2023-09-13T10:00:39.050 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2672262086 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fecd803d450 con 0x55f7c08a0a00 2023-09-13T10:00:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecf9c19b80 10 client.20967 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecf9c19b80 10 client.20967 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:00:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecf9c19b80 20 client.20967 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c090a2f0 0x55f7c090c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecf9c19b80 4 client.20967 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:39.051 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f7c07ac050 con 0x55f7c090a2f0 2023-09-13T10:00:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fece67fc700 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c090a2f0 0x55f7c090c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fece67fc700 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c090a2f0 0x55f7c090c710 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fb7ab6ad7cf76abe server_cookie=91af14c6b44309b in_seq=0 out_seq=0 2023-09-13T10:00:39.052 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.037+0000 7fecc6ffd700 10 client.20967 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:39.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.043+0000 7fecc6ffd700 1 -- 172.21.15.6:0/2672262086 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f7c07ac050 con 0x55f7c090a2f0 2023-09-13T10:00:39.053 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.043+0000 7fecc6ffd700 10 client.20967 handle_command_reply: tid=0 2023-09-13T10:00:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.043+0000 7fecf9c19b80 1 client.20967 shutdown 2023-09-13T10:00:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 msgr2=0x55f7c08ace40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08ace40 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7fecd803dec0 tx=0x7fecd8010820 comp rx=0 tx=0).stop 2023-09-13T10:00:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 shutdown_connections 2023-09-13T10:00:39.054 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55f7c090a2f0 0x55f7c090c710 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f7c08a2060 0x55f7c08b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f7c08a0a00 0x55f7c08ace40 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecc6ffd700 0 client.20967 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:00:39.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 --2- 172.21.15.6:0/2672262086 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f7c08a1700 0x55f7c08ad380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.055 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 >> 172.21.15.6:0/2672262086 conn(0x55f7c07fec80 msgr2=0x55f7c08a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 shutdown_connections 2023-09-13T10:00:39.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 1 -- 172.21.15.6:0/2672262086 wait complete. 2023-09-13T10:00:39.056 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7fecf9c19b80 20 client.20967 trim_cache size 0 max 16384 2023-09-13T10:00:39.056 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:39.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fecd00a0740 msgr2=0x7fecd00a2c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fecd00a0740 0x7fecd00a2c00 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fece8067b20 tx=0x7fecd8007400 comp rx=0 tx=0).stop 2023-09-13T10:00:39.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece81018b0 msgr2=0x7fece8109000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece81018b0 0x7fece8109000 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7fece000c370 tx=0x7fece000c680 comp rx=0 tx=0).stop 2023-09-13T10:00:39.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 shutdown_connections 2023-09-13T10:00:39.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fecd00a0740 0x7fecd00a2c00 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fece81018b0 0x7fece8109000 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fece81001e0 0x7fece810a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 --2- 172.21.15.6:0/1005995817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fece8100ef0 0x7fece8108ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.044+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 >> 172.21.15.6:0/1005995817 conn(0x7fece80fa9b0 msgr2=0x7fece80fcc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.045+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 shutdown_connections 2023-09-13T10:00:39.060 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.045+0000 7feceda34700 1 -- 172.21.15.6:0/1005995817 wait complete. 2023-09-13T10:00:39.060 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:39 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1285156947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:00:39.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T10:00:39.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 -- 172.21.15.6:0/920315595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60101820 msgr2=0x7fdc601080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 --2- 172.21.15.6:0/920315595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60101820 0x7fdc601080d0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009f90 tx=0x7fdc5800b330 comp rx=0 tx=0).stop 2023-09-13T10:00:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 -- 172.21.15.6:0/920315595 shutdown_connections 2023-09-13T10:00:39.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 --2- 172.21.15.6:0/920315595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc60101820 0x7fdc601080d0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 --2- 172.21.15.6:0/920315595 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc600ffc90 0x7fdc601000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 --2- 172.21.15.6:0/920315595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60100e80 0x7fdc601012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 -- 172.21.15.6:0/920315595 >> 172.21.15.6:0/920315595 conn(0x7fdc600fb220 msgr2=0x7fdc600fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 -- 172.21.15.6:0/920315595 shutdown_connections 2023-09-13T10:00:39.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.228+0000 7fdc6517a700 1 -- 172.21.15.6:0/920315595 wait complete. 2023-09-13T10:00:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 Processor -- start 2023-09-13T10:00:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 -- start start 2023-09-13T10:00:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffc90 0x7fdc60195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60100e80 0x7fdc60195fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101820 0x7fdc6019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6019d5e0 con 0x7fdc60101820 2023-09-13T10:00:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6019d720 con 0x7fdc60100e80 2023-09-13T10:00:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.229+0000 7fdc6517a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6019d8b0 con 0x7fdc600ffc90 2023-09-13T10:00:39.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffc90 0x7fdc60195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60100e80 0x7fdc60195fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60100e80 0x7fdc60195fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40612/0 (socket says 172.21.15.6:40612) 2023-09-13T10:00:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffc90 0x7fdc60195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50140/0 (socket says 172.21.15.6:50140) 2023-09-13T10:00:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5e59c700 1 -- 172.21.15.6:0/220362327 learned_addr learned my addr 172.21.15.6:0/220362327 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101820 0x7fdc6019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 -- 172.21.15.6:0/220362327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60100e80 msgr2=0x7fdc60195fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60100e80 0x7fdc60195fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 -- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101820 msgr2=0x7fdc6019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101820 0x7fdc6019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.236 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 -- 172.21.15.6:0/220362327 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc54009520 con 0x7fdc600ffc90 2023-09-13T10:00:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101820 0x7fdc6019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60100e80 0x7fdc60195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffc90 0x7fdc60195a60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc50005fd0 tx=0x7fdc5000eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.237 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc47fff700 1 -- 172.21.15.6:0/220362327 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50004220 con 0x7fdc600ffc90 2023-09-13T10:00:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc58009c40 con 0x7fdc600ffc90 2023-09-13T10:00:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.230+0000 7fdc47fff700 1 -- 172.21.15.6:0/220362327 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc50004380 con 0x7fdc600ffc90 2023-09-13T10:00:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.231+0000 7fdc47fff700 1 -- 172.21.15.6:0/220362327 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc50003be0 con 0x7fdc600ffc90 2023-09-13T10:00:39.238 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.231+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6019df60 con 0x7fdc600ffc90 2023-09-13T10:00:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.233+0000 7fdc47fff700 1 -- 172.21.15.6:0/220362327 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdc50003d40 con 0x7fdc600ffc90 2023-09-13T10:00:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.234+0000 7fdc47fff700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.240 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.234+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.234+0000 7fdc47fff700 1 -- 172.21.15.6:0/220362327 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc50014070 con 0x7fdc600ffc90 2023-09-13T10:00:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.234+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009fd0 tx=0x7fdc54009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 Processor -- start 2023-09-13T10:00:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 -- start start 2023-09-13T10:00:39.241 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c65910 0x55b641c65d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c66270 0x55b641c646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c65070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641bbb780 con 0x55b641c66270 2023-09-13T10:00:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641bb90a0 con 0x55b641c64c10 2023-09-13T10:00:39.242 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.235+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641bb4990 con 0x55b641c65910 2023-09-13T10:00:39.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c65070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c65070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40622/0 (socket says 172.21.15.6:40622) 2023-09-13T10:00:39.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 -- 172.21.15.6:0/509256417 learned_addr learned my addr 172.21.15.6:0/509256417 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c66270 0x55b641c646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 -- 172.21.15.6:0/509256417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c65910 msgr2=0x55b641c65d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c65910 0x55b641c65d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c65910 0x55b641c65d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 -- 172.21.15.6:0/509256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c66270 msgr2=0x55b641c646d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c66270 0x55b641c646d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5f59e700 1 -- 172.21.15.6:0/509256417 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b641a34630 con 0x55b641c64c10 2023-09-13T10:00:39.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.237+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c66270 0x55b641c646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T10:00:39.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.238+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c65070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009b40 tx=0x7fdc58009b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9408ca19c9f81ce8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.245 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.245+0000 7fdc457fa700 1 -- 172.21.15.6:0/509256417 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5800e040 con 0x55b641c64c10 2023-09-13T10:00:39.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.245+0000 7fdc457fa700 1 -- 172.21.15.6:0/509256417 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc58007b80 con 0x55b641c64c10 2023-09-13T10:00:39.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.245+0000 7fdc457fa700 1 -- 172.21.15.6:0/509256417 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5801c640 con 0x55b641c64c10 2023-09-13T10:00:39.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 -- 172.21.15.6:0/509256417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 msgr2=0x55b641c65070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c65070 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009b40 tx=0x7fdc58009b70 comp rx=0 tx=0).stop 2023-09-13T10:00:39.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 -- 172.21.15.6:0/509256417 shutdown_connections 2023-09-13T10:00:39.250 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c65070 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c65910 0x55b641c65d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/509256417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c66270 0x55b641c646d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 -- 172.21.15.6:0/509256417 >> 172.21.15.6:0/509256417 conn(0x55b641bc0c80 msgr2=0x55b641c5cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 -- 172.21.15.6:0/509256417 shutdown_connections 2023-09-13T10:00:39.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 -- 172.21.15.6:0/509256417 wait complete. 2023-09-13T10:00:39.251 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.246+0000 7fdc7135fb80 1 -- start start 2023-09-13T10:00:39.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 1 Processor -- start 2023-09-13T10:00:39.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c6e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c75650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.252 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641b52bb0 con 0x55b641c65910 2023-09-13T10:00:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641b528b0 con 0x55b641c64c10 2023-09-13T10:00:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641a36920 con 0x55b641c66270 2023-09-13T10:00:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc7135fb80 10 client.0 _ll_register_callbacks cb 0x55b641b50680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.253 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47102/0 (socket says 172.21.15.6:47102) 2023-09-13T10:00:39.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 -- 172.21.15.6:0/2677322193 learned_addr learned my addr 172.21.15.6:0/2677322193 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c75650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 -- 172.21.15.6:0/2677322193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 msgr2=0x55b641c75650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c75650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.254 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 -- 172.21.15.6:0/2677322193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 msgr2=0x55b641c6e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c6e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 -- 172.21.15.6:0/2677322193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc60108a20 con 0x55b641c65910 2023-09-13T10:00:39.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6e610 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400fdb0 tx=0x7fdc540047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59784076e5c0e9c5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.247+0000 7fdc42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:39.255 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc42ff5700 1 -- 172.21.15.6:0/2677322193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54021070 con 0x55b641c65910 2023-09-13T10:00:39.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc42ff5700 1 -- 172.21.15.6:0/2677322193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc5400fde0 con 0x55b641c65910 2023-09-13T10:00:39.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b641c55670 con 0x55b641c65910 2023-09-13T10:00:39.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc42ff5700 1 -- 172.21.15.6:0/2677322193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc5401cbb0 con 0x55b641c65910 2023-09-13T10:00:39.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 10 client.20976 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:39.256 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55b641bcc7a0 con 0x55b641c65910 2023-09-13T10:00:39.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc42ff5700 1 -- 172.21.15.6:0/2677322193 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc54036080 con 0x55b641c65910 2023-09-13T10:00:39.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc42ff5700 1 -- 172.21.15.6:0/2677322193 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc54027420 con 0x55b641c65910 2023-09-13T10:00:39.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 10 client.20976 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:39.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 10 client.20976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:39.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 20 client.20976 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:39.257 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641c79ef0 0x55b641c7c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 4 client.20976 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:39.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.248+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b641bad970 con 0x55b641c79ef0 2023-09-13T10:00:39.258 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.249+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641c79ef0 0x55b641c7c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.250+0000 7fdc42ff5700 10 client.20976 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:39.259 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.250+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641c79ef0 0x55b641c7c310 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd36bc85744e427d server_cookie=1fc6ca4268f6e0f8 in_seq=0 out_seq=0 2023-09-13T10:00:39.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc42ff5700 1 -- 172.21.15.6:0/2677322193 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55b641bad970 con 0x55b641c79ef0 2023-09-13T10:00:39.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc42ff5700 10 client.20976 handle_command_reply: tid=0 2023-09-13T10:00:39.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 client.20976 shutdown 2023-09-13T10:00:39.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 msgr2=0x55b641c6e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6e610 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400fdb0 tx=0x7fdc540047c0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.260 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 shutdown_connections 2023-09-13T10:00:39.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c75650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c6e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641c79ef0 0x55b641c7c310 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/2677322193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6e610 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.261 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 >> 172.21.15.6:0/2677322193 conn(0x55b641bc0c80 msgr2=0x55b641c5cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc42ff5700 0 client.20976 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:39.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 shutdown_connections 2023-09-13T10:00:39.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.255+0000 7fdc7135fb80 1 -- 172.21.15.6:0/2677322193 wait complete. 2023-09-13T10:00:39.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.258+0000 7fdc7135fb80 20 client.20976 trim_cache size 0 max 16384 2023-09-13T10:00:39.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.275+0000 7fdc7135fb80 1 Processor -- start 2023-09-13T10:00:39.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.275+0000 7fdc7135fb80 1 -- start start 2023-09-13T10:00:39.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.275+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c64c10 0x55b641c75610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c66270 0x55b641c578f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641c6c880 con 0x55b641c65910 2023-09-13T10:00:39.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641c5f000 con 0x55b641c66270 2023-09-13T10:00:39.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641c6bdc0 con 0x55b641c64c10 2023-09-13T10:00:39.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47110/0 (socket says 172.21.15.6:47110) 2023-09-13T10:00:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 -- 172.21.15.6:0/1563466893 learned_addr learned my addr 172.21.15.6:0/1563466893 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c64c10 0x55b641c75610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c66270 0x55b641c578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 -- 172.21.15.6:0/1563466893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c64c10 msgr2=0x55b641c75610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c64c10 0x55b641c75610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 -- 172.21.15.6:0/1563466893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c66270 msgr2=0x55b641c578f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c66270 0x55b641c578f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 -- 172.21.15.6:0/1563466893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6419e0de0 con 0x55b641c65910 2023-09-13T10:00:39.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.276+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6cdf0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fdc54000c00 tx=0x7fdc54011500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a51b9670d810213 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.284 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.279+0000 7fdc45ffb700 1 -- 172.21.15.6:0/1563466893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54021070 con 0x55b641c65910 2023-09-13T10:00:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.279+0000 7fdc45ffb700 1 -- 172.21.15.6:0/1563466893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55b641c55670 con 0x55b641c65910 2023-09-13T10:00:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.279+0000 7fdc45ffb700 1 -- 172.21.15.6:0/1563466893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54032430 con 0x55b641c65910 2023-09-13T10:00:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.279+0000 7fdc7135fb80 1 -- 172.21.15.6:0/1563466893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 msgr2=0x55b641c6cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.285 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.279+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6cdf0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7fdc54000c00 tx=0x7fdc54011500 comp rx=0 tx=0).stop 2023-09-13T10:00:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- 172.21.15.6:0/1563466893 shutdown_connections 2023-09-13T10:00:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c66270 0x55b641c578f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c64c10 0x55b641c75610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/1563466893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c6cdf0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- 172.21.15.6:0/1563466893 >> 172.21.15.6:0/1563466893 conn(0x55b641bc0c80 msgr2=0x55b641c5cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- 172.21.15.6:0/1563466893 shutdown_connections 2023-09-13T10:00:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- 172.21.15.6:0/1563466893 wait complete. 2023-09-13T10:00:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- start start 2023-09-13T10:00:39.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 Processor -- start 2023-09-13T10:00:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c62650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c62b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c63ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641c640e0 con 0x55b641c65910 2023-09-13T10:00:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641c64250 con 0x55b641c64c10 2023-09-13T10:00:39.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.280+0000 7fdc7135fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b641c64410 con 0x55b641c66270 2023-09-13T10:00:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc7135fb80 10 client.0 _ll_register_callbacks cb 0x55b641b50680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c62b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c62b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47116/0 (socket says 172.21.15.6:47116) 2023-09-13T10:00:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 -- 172.21.15.6:0/3443840838 learned_addr learned my addr 172.21.15.6:0/3443840838 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:39.289 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5f59e700 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c63ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 -- 172.21.15.6:0/3443840838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 msgr2=0x55b641c63ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c63ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 -- 172.21.15.6:0/3443840838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 msgr2=0x55b641c62650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c62650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 -- 172.21.15.6:0/3443840838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b641bcc7a0 con 0x55b641c65910 2023-09-13T10:00:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc5e59c700 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c62b90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400fdb0 tx=0x7fdc5401cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f0a16304250b45 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc42ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc42ff5700 1 -- 172.21.15.6:0/3443840838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc54021050 con 0x55b641c65910 2023-09-13T10:00:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdc58007b80 con 0x55b641c65910 2023-09-13T10:00:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.281+0000 7fdc42ff5700 1 -- 172.21.15.6:0/3443840838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdc54027420 con 0x55b641c65910 2023-09-13T10:00:39.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc42ff5700 1 -- 172.21.15.6:0/3443840838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdc5400f610 con 0x55b641c65910 2023-09-13T10:00:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 10 client.20982 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55b6419c9c60 con 0x55b641c65910 2023-09-13T10:00:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc42ff5700 1 -- 172.21.15.6:0/3443840838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdc5404d020 con 0x55b641c65910 2023-09-13T10:00:39.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc42ff5700 1 -- 172.21.15.6:0/3443840838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fdc5403e460 con 0x55b641c65910 2023-09-13T10:00:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 10 client.20982 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 10 client.20982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 20 client.20982 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641cd0c30 0x55b641cd3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:39.293 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 4 client.20982 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:00:39.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b641b6e050 con 0x55b641cd0c30 2023-09-13T10:00:39.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.282+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641cd0c30 0x55b641cd3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:39.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.283+0000 7fdc42ff5700 10 client.20982 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:39.294 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.283+0000 7fdc5ed9d700 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641cd0c30 0x55b641cd3050 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71000f1b31c0eaf5 server_cookie=11498e2122fe4bec in_seq=0 out_seq=0 2023-09-13T10:00:39.295 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc42ff5700 1 -- 172.21.15.6:0/3443840838 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b641b6e050 con 0x55b641cd0c30 2023-09-13T10:00:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc42ff5700 10 client.20982 handle_command_reply: tid=0 2023-09-13T10:00:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 client.20982 shutdown 2023-09-13T10:00:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 msgr2=0x55b641c62b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c62b90 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7fdc5400fdb0 tx=0x7fdc5401cd10 comp rx=0 tx=0).stop 2023-09-13T10:00:39.296 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 shutdown_connections 2023-09-13T10:00:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55b641c66270 0x55b641c63ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55b641c64c10 0x55b641c62650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55b641cd0c30 0x55b641cd3050 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 --2- 172.21.15.6:0/3443840838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55b641c65910 0x55b641c62b90 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.297 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 >> 172.21.15.6:0/3443840838 conn(0x55b641bc0c80 msgr2=0x55b641c5ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc42ff5700 0 client.20982 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 shutdown_connections 2023-09-13T10:00:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 1 -- 172.21.15.6:0/3443840838 wait complete. 2023-09-13T10:00:39.298 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.292+0000 7fdc7135fb80 20 client.20982 trim_cache size 0 max 16384 2023-09-13T10:00:39.299 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:00:39.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 msgr2=0x7fdc480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fdc54009fd0 tx=0x7fdc54009260 comp rx=0 tx=0).stop 2023-09-13T10:00:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffc90 msgr2=0x7fdc60195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffc90 0x7fdc60195a60 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fdc50005fd0 tx=0x7fdc5000eca0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 shutdown_connections 2023-09-13T10:00:39.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdc480a0640 0x7fdc480a2b00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc60101820 0x7fdc6019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdc600ffc90 0x7fdc60195a60 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 --2- 172.21.15.6:0/220362327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdc60100e80 0x7fdc60195fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:39.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 >> 172.21.15.6:0/220362327 conn(0x7fdc600fb220 msgr2=0x7fdc600fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:39.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 shutdown_connections 2023-09-13T10:00:39.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:39.293+0000 7fdc6517a700 1 -- 172.21.15.6:0/220362327 wait complete. 2023-09-13T10:00:39.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:39 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1285156947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:00:39.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:39 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1285156947' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:00:39.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 316633 34.53 MB/sec execute 359 sec latency 54.828 ms 2023-09-13T10:00:40.309 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T10:00:40.310 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T10:00:40.338 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:40 smithi006 ceph-mon[98665]: pgmap v934: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 760 op/s 2023-09-13T10:00:40.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 -- 172.21.15.6:0/1241741333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef10100290 msgr2=0x7fef10108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.461 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 --2- 172.21.15.6:0/1241741333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef10100290 0x7fef10108120 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7fef0800b0a0 tx=0x7fef0800b3b0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 -- 172.21.15.6:0/1241741333 shutdown_connections 2023-09-13T10:00:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 --2- 172.21.15.6:0/1241741333 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef10100290 0x7fef10108120 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 --2- 172.21.15.6:0/1241741333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef101013c0 0x7fef101017e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 --2- 172.21.15.6:0/1241741333 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef100ff8f0 0x7fef100ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.462 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 -- 172.21.15.6:0/1241741333 >> 172.21.15.6:0/1241741333 conn(0x7fef100fb250 msgr2=0x7fef100fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 -- 172.21.15.6:0/1241741333 shutdown_connections 2023-09-13T10:00:40.463 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.460+0000 7fef1776a700 1 -- 172.21.15.6:0/1241741333 wait complete. 2023-09-13T10:00:40.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 Processor -- start 2023-09-13T10:00:40.464 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 -- start start 2023-09-13T10:00:40.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef100ff8f0 0x7fef10103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef10100290 0x7fef101022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef101013c0 0x7fef101027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10102f90 con 0x7fef100ff8f0 2023-09-13T10:00:40.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef10103100 con 0x7fef101013c0 2023-09-13T10:00:40.465 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef1776a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef101a0c90 con 0x7fef10100290 2023-09-13T10:00:40.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef15506700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef100ff8f0 0x7fef10103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef15506700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef100ff8f0 0x7fef10103c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47128/0 (socket says 172.21.15.6:47128) 2023-09-13T10:00:40.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef15506700 1 -- 172.21.15.6:0/1010870201 learned_addr learned my addr 172.21.15.6:0/1010870201 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef14d05700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef10100290 0x7fef101022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.461+0000 7fef15d07700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef101013c0 0x7fef101027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef15506700 1 -- 172.21.15.6:0/1010870201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef10100290 msgr2=0x7fef101022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef15506700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef10100290 0x7fef101022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef15506700 1 -- 172.21.15.6:0/1010870201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef101013c0 msgr2=0x7fef101027f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef15506700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef101013c0 0x7fef101027f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef15506700 1 -- 172.21.15.6:0/1010870201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef08009d00 con 0x7fef100ff8f0 2023-09-13T10:00:40.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef15506700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef100ff8f0 0x7fef10103c70 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00e970 tx=0x7fef0c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef067fc700 1 -- 172.21.15.6:0/1010870201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c009790 con 0x7fef100ff8f0 2023-09-13T10:00:40.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef101a0f70 con 0x7fef100ff8f0 2023-09-13T10:00:40.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef067fc700 1 -- 172.21.15.6:0/1010870201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef0c00c7e0 con 0x7fef100ff8f0 2023-09-13T10:00:40.468 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef067fc700 1 -- 172.21.15.6:0/1010870201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c003c70 con 0x7fef100ff8f0 2023-09-13T10:00:40.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.462+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef101a13f0 con 0x7fef100ff8f0 2023-09-13T10:00:40.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.465+0000 7fef067fc700 1 -- 172.21.15.6:0/1010870201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fef0c00cc50 con 0x7fef100ff8f0 2023-09-13T10:00:40.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.466+0000 7fef067fc700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feefc0a0640 0x7feefc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.466+0000 7fef14d05700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feefc0a0640 0x7feefc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.473 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.466+0000 7fef067fc700 1 -- 172.21.15.6:0/1010870201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef0c014070 con 0x7fef100ff8f0 2023-09-13T10:00:40.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef14d05700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feefc0a0640 0x7feefc0a2b00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef00009c60 tx=0x7fef00009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 Processor -- start 2023-09-13T10:00:40.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 -- start start 2023-09-13T10:00:40.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c0729cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.474 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729d0e0 0x561c0729b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729ba80 0x561c0729bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c071f4800 con 0x561c0729c780 2023-09-13T10:00:40.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c071f2120 con 0x561c0729d0e0 2023-09-13T10:00:40.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef2394fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c071eda10 con 0x561c0729ba80 2023-09-13T10:00:40.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef15506700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c0729cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.475 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef15506700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c0729cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47136/0 (socket says 172.21.15.6:47136) 2023-09-13T10:00:40.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.467+0000 7fef15506700 1 -- 172.21.15.6:0/2393627649 learned_addr learned my addr 172.21.15.6:0/2393627649 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7fef15d07700 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729ba80 0x561c0729bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7fef15506700 1 -- 172.21.15.6:0/2393627649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729ba80 msgr2=0x561c0729bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7fef15506700 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729ba80 0x561c0729bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7fef15506700 1 -- 172.21.15.6:0/2393627649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729d0e0 msgr2=0x561c0729b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.476 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7fef15506700 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729d0e0 0x561c0729b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7fef15506700 1 -- 172.21.15.6:0/2393627649 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c0706d6b0 con 0x561c0729c780 2023-09-13T10:00:40.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7fef15506700 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c0729cba0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0a1080 tx=0x7fef0c003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a55d0d886c30f4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7feefb7fe700 1 -- 172.21.15.6:0/2393627649 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c09d170 con 0x561c0729c780 2023-09-13T10:00:40.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7feefb7fe700 1 -- 172.21.15.6:0/2393627649 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef0c099540 con 0x561c0729c780 2023-09-13T10:00:40.477 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.468+0000 7feefb7fe700 1 -- 172.21.15.6:0/2393627649 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c0997a0 con 0x561c0729c780 2023-09-13T10:00:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 -- 172.21.15.6:0/2393627649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 msgr2=0x561c0729cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c0729cba0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0a1080 tx=0x7fef0c003710 comp rx=0 tx=0).stop 2023-09-13T10:00:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 -- 172.21.15.6:0/2393627649 shutdown_connections 2023-09-13T10:00:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729ba80 0x561c0729bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c0729cba0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.478 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 --2- 172.21.15.6:0/2393627649 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729d0e0 0x561c0729b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 -- 172.21.15.6:0/2393627649 >> 172.21.15.6:0/2393627649 conn(0x561c071f9d00 msgr2=0x561c07295f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 -- 172.21.15.6:0/2393627649 shutdown_connections 2023-09-13T10:00:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.469+0000 7fef2394fb80 1 -- 172.21.15.6:0/2393627649 wait complete. 2023-09-13T10:00:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 -- start start 2023-09-13T10:00:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 Processor -- start 2023-09-13T10:00:40.479 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 0x561c072a5020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072a5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072ac5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0718bc30 con 0x561c0729c780 2023-09-13T10:00:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0718b930 con 0x561c0729ba80 2023-09-13T10:00:40.480 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0706f9a0 con 0x561c0729d0e0 2023-09-13T10:00:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef2394fb80 10 client.0 _ll_register_callbacks cb 0x561c07189700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.470+0000 7fef14d05700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072a5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072a5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47144/0 (socket says 172.21.15.6:47144) 2023-09-13T10:00:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef15506700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 0x561c072a5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 -- 172.21.15.6:0/3539799630 learned_addr learned my addr 172.21.15.6:0/3539799630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.481 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef15d07700 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072ac5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 -- 172.21.15.6:0/3539799630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 msgr2=0x561c072ac5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072ac5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 -- 172.21.15.6:0/3539799630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 msgr2=0x561c072a5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 0x561c072a5020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 -- 172.21.15.6:0/3539799630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef101a13f0 con 0x561c0729c780 2023-09-13T10:00:40.482 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef14d05700 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072a5560 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fef00009b20 tx=0x7fef00004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a4da8bcb7e3a33 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7feef8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7feef8ff9700 1 -- 172.21.15.6:0/3539799630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef00004220 con 0x561c0729c780 2023-09-13T10:00:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.471+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c0728e6f0 con 0x561c0729c780 2023-09-13T10:00:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7feef8ff9700 1 -- 172.21.15.6:0/3539799630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef00023070 con 0x561c0729c780 2023-09-13T10:00:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7feef8ff9700 1 -- 172.21.15.6:0/3539799630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef00004380 con 0x561c0729c780 2023-09-13T10:00:40.483 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 10 client.20994 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x561c07205820 con 0x561c0729c780 2023-09-13T10:00:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7feef8ff9700 1 -- 172.21.15.6:0/3539799630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x561c0728e6f0 con 0x561c0729c780 2023-09-13T10:00:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7feef8ff9700 1 -- 172.21.15.6:0/3539799630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fef00003a10 con 0x561c0729c780 2023-09-13T10:00:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 10 client.20994 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 10 client.20994 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:40.484 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 20 client.20994 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c072b0db0 0x561c072b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.485 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 4 client.20994 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c071e69f0 con 0x561c072b0db0 2023-09-13T10:00:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.472+0000 7fef15506700 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c072b0db0 0x561c072b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.473+0000 7feef8ff9700 10 client.20994 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.473+0000 7fef15506700 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c072b0db0 0x561c072b31d0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e6de06ee59d0422 server_cookie=89da757ba3468125 in_seq=0 out_seq=0 2023-09-13T10:00:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7feef8ff9700 1 -- 172.21.15.6:0/3539799630 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c071e69f0 con 0x561c072b0db0 2023-09-13T10:00:40.486 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7feef8ff9700 10 client.20994 handle_command_reply: tid=0 2023-09-13T10:00:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 client.20994 shutdown 2023-09-13T10:00:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 msgr2=0x561c072a5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072a5560 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7fef00009b20 tx=0x7fef00004750 comp rx=0 tx=0).stop 2023-09-13T10:00:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 shutdown_connections 2023-09-13T10:00:40.487 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072ac5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 0x561c072a5020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c072b0db0 0x561c072b31d0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3539799630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072a5560 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7feef8ff9700 0 client.20994 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.488 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 >> 172.21.15.6:0/3539799630 conn(0x561c071f9d00 msgr2=0x561c07290870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 shutdown_connections 2023-09-13T10:00:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 1 -- 172.21.15.6:0/3539799630 wait complete. 2023-09-13T10:00:40.489 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.474+0000 7fef2394fb80 20 client.20994 trim_cache size 0 max 16384 2023-09-13T10:00:40.496 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.495+0000 7fef2394fb80 1 Processor -- start 2023-09-13T10:00:40.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.495+0000 7fef2394fb80 1 -- start start 2023-09-13T10:00:40.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 0x561c0729b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.497 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072ac560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c0729fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef2394fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c072a4bf0 con 0x561c0729c780 2023-09-13T10:00:40.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef2394fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c07297a90 con 0x561c0729ba80 2023-09-13T10:00:40.498 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef2394fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c072a42b0 con 0x561c0729d0e0 2023-09-13T10:00:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c0729fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c0729fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50208/0 (socket says 172.21.15.6:50208) 2023-09-13T10:00:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 -- 172.21.15.6:0/3166490241 learned_addr learned my addr 172.21.15.6:0/3166490241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 -- 172.21.15.6:0/3166490241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 msgr2=0x561c0729b540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:00:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 --2- 172.21.15.6:0/3166490241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 0x561c0729b540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.499 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 -- 172.21.15.6:0/3166490241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 msgr2=0x561c072ac560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 --2- 172.21.15.6:0/3166490241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.496+0000 7fef15d07700 1 -- 172.21.15.6:0/3166490241 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c0729c130 con 0x561c0729d0e0 2023-09-13T10:00:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.497+0000 7fef15d07700 1 --2- 172.21.15.6:0/3166490241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c0729fa60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fef0800b0a0 tx=0x7fef08009490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5554b2ec020bda58 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.497+0000 7feefbfff700 1 -- 172.21.15.6:0/3166490241 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800e040 con 0x561c0729d0e0 2023-09-13T10:00:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.497+0000 7feefbfff700 1 -- 172.21.15.6:0/3166490241 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef08007760 con 0x561c0729d0e0 2023-09-13T10:00:40.500 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.497+0000 7feefbfff700 1 -- 172.21.15.6:0/3166490241 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef08005430 con 0x561c0729d0e0 2023-09-13T10:00:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 -- 172.21.15.6:0/3166490241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 msgr2=0x561c0729fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3166490241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c0729fa60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fef0800b0a0 tx=0x7fef08009490 comp rx=0 tx=0).stop 2023-09-13T10:00:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 -- 172.21.15.6:0/3166490241 shutdown_connections 2023-09-13T10:00:40.503 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3166490241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c0729fa60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3166490241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729ba80 0x561c0729b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3166490241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729c780 0x561c072ac560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 -- 172.21.15.6:0/3166490241 >> 172.21.15.6:0/3166490241 conn(0x561c071f9d00 msgr2=0x561c072a5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 -- 172.21.15.6:0/3166490241 shutdown_connections 2023-09-13T10:00:40.504 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 -- 172.21.15.6:0/3166490241 wait complete. 2023-09-13T10:00:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.498+0000 7fef2394fb80 1 -- start start 2023-09-13T10:00:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 1 Processor -- start 2023-09-13T10:00:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729ba80 0x561c072a6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729c780 0x561c072ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.505 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072a7400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c072a7a90 con 0x561c0729ba80 2023-09-13T10:00:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0731e3b0 con 0x561c0729c780 2023-09-13T10:00:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c0731e4f0 con 0x561c0729d0e0 2023-09-13T10:00:40.506 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef2394fb80 10 client.0 _ll_register_callbacks cb 0x561c07189700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef15506700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729ba80 0x561c072a6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef15d07700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072a7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef14d05700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729c780 0x561c072ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef15506700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729ba80 0x561c072a6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47156/0 (socket says 172.21.15.6:47156) 2023-09-13T10:00:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef15d07700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072a7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50214/0 (socket says 172.21.15.6:50214) 2023-09-13T10:00:40.507 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef14d05700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729c780 0x561c072ac3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40682/0 (socket says 172.21.15.6:40682) 2023-09-13T10:00:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef15506700 1 -- 172.21.15.6:0/3101296207 learned_addr learned my addr 172.21.15.6:0/3101296207 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.499+0000 7fef15d07700 1 -- 172.21.15.6:0/3101296207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729c780 msgr2=0x561c072ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef15d07700 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729c780 0x561c072ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef15d07700 1 -- 172.21.15.6:0/3101296207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729ba80 msgr2=0x561c072a6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.508 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef15d07700 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729ba80 0x561c072a6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef15d07700 1 -- 172.21.15.6:0/3101296207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef10108b50 con 0x561c0729d0e0 2023-09-13T10:00:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef15d07700 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072a7400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef08003fd0 tx=0x7fef0800bf30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16cd8ee5478b17e2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7feef8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:00:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7feef8ff9700 1 -- 172.21.15.6:0/3101296207 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0800e040 con 0x561c0729d0e0 2023-09-13T10:00:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7feef8ff9700 1 -- 172.21.15.6:0/3101296207 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fef080053c0 con 0x561c0729d0e0 2023-09-13T10:00:40.509 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef0c099540 con 0x561c0729d0e0 2023-09-13T10:00:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7feef8ff9700 1 -- 172.21.15.6:0/3101296207 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef08005580 con 0x561c0729d0e0 2023-09-13T10:00:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef2394fb80 10 client.30205 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x561c07019e60 con 0x561c0729d0e0 2023-09-13T10:00:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.500+0000 7feef8ff9700 1 -- 172.21.15.6:0/3101296207 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef0c099540 con 0x561c0729d0e0 2023-09-13T10:00:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7feef8ff9700 1 -- 172.21.15.6:0/3101296207 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fef0800b0d0 con 0x561c0729d0e0 2023-09-13T10:00:40.510 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef2394fb80 10 client.30205 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef2394fb80 10 client.30205 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef2394fb80 20 client.30205 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c0731fc00 0x561c07321ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef2394fb80 4 client.30205 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T10:00:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x561c071a70d0 con 0x561c0731fc00 2023-09-13T10:00:40.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef15506700 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c0731fc00 0x561c07321ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7feef8ff9700 10 client.30205 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.501+0000 7fef15506700 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c0731fc00 0x561c07321ff0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c9ce94bb0bfd0a server_cookie=7ef0bfcce3bf22b6 in_seq=0 out_seq=0 2023-09-13T10:00:40.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:40 smithi053 ceph-mon[102373]: pgmap v934: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 760 op/s 2023-09-13T10:00:40.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7feef8ff9700 1 -- 172.21.15.6:0/3101296207 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x561c071a70d0 con 0x561c0731fc00 2023-09-13T10:00:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7feef8ff9700 10 client.30205 handle_command_reply: tid=0 2023-09-13T10:00:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 client.30205 shutdown 2023-09-13T10:00:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 msgr2=0x561c072a7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072a7400 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fef08003fd0 tx=0x7fef0800bf30 comp rx=0 tx=0).stop 2023-09-13T10:00:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 shutdown_connections 2023-09-13T10:00:40.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x561c0729d0e0 0x561c072a7400 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x561c0731fc00 0x561c07321ff0 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x561c0729ba80 0x561c072a6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 --2- 172.21.15.6:0/3101296207 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x561c0729c780 0x561c072ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7feef8ff9700 0 client.30205 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 >> 172.21.15.6:0/3101296207 conn(0x561c071f9d00 msgr2=0x561c072a4fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 shutdown_connections 2023-09-13T10:00:40.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 1 -- 172.21.15.6:0/3101296207 wait complete. 2023-09-13T10:00:40.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.505+0000 7fef2394fb80 20 client.30205 trim_cache size 0 max 16384 2023-09-13T10:00:40.516 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:00:40.517 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T10:00:40.517 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "e0e7ff38-ea44-4c2b-8488-a693c1f258dc", 2023-09-13T10:00:40.517 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T10:00:40.517 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:00:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feefc0a0640 msgr2=0x7feefc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feefc0a0640 0x7feefc0a2b00 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fef00009c60 tx=0x7fef00009260 comp rx=0 tx=0).stop 2023-09-13T10:00:40.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef100ff8f0 msgr2=0x7fef10103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef100ff8f0 0x7fef10103c70 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7fef0c00e970 tx=0x7fef0c00ec80 comp rx=0 tx=0).stop 2023-09-13T10:00:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 shutdown_connections 2023-09-13T10:00:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef101013c0 0x7fef101027f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7feefc0a0640 0x7feefc0a2b00 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef100ff8f0 0x7fef10103c70 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 --2- 172.21.15.6:0/1010870201 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef10100290 0x7fef101022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 >> 172.21.15.6:0/1010870201 conn(0x7fef100fb250 msgr2=0x7fef10068db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 shutdown_connections 2023-09-13T10:00:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.506+0000 7fef1776a700 1 -- 172.21.15.6:0/1010870201 wait complete. 2023-09-13T10:00:40.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:40 smithi131 ceph-mon[102785]: pgmap v934: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 760 op/s 2023-09-13T10:00:40.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:00:40.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 317338 34.54 MB/sec execute 360 sec latency 47.475 ms 2023-09-13T10:00:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 -- 172.21.15.6:0/652346416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c1020f0 msgr2=0x7fbb7c102550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 --2- 172.21.15.6:0/652346416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c1020f0 0x7fbb7c102550 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7fbb680098f0 tx=0x7fbb68009c00 comp rx=0 tx=0).stop 2023-09-13T10:00:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 -- 172.21.15.6:0/652346416 shutdown_connections 2023-09-13T10:00:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 --2- 172.21.15.6:0/652346416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c102a90 0x7fbb7c109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 --2- 172.21.15.6:0/652346416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb7c0ff080 0x7fbb7c0ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 --2- 172.21.15.6:0/652346416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c1020f0 0x7fbb7c102550 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 -- 172.21.15.6:0/652346416 >> 172.21.15.6:0/652346416 conn(0x7fbb7c0fa990 msgr2=0x7fbb7c0fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 -- 172.21.15.6:0/652346416 shutdown_connections 2023-09-13T10:00:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.725+0000 7fbb82d29700 1 -- 172.21.15.6:0/652346416 wait complete. 2023-09-13T10:00:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 Processor -- start 2023-09-13T10:00:40.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 -- start start 2023-09-13T10:00:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c0ff080 0x7fbb7c196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb7c1020f0 0x7fbb7c197030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c102a90 0x7fbb7c19e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c19e670 con 0x7fbb7c102a90 2023-09-13T10:00:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c19e7b0 con 0x7fbb7c0ff080 2023-09-13T10:00:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb82d29700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb7c19e940 con 0x7fbb7c1020f0 2023-09-13T10:00:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c0ff080 0x7fbb7c196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb7bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb7c1020f0 0x7fbb7c197030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb812c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c102a90 0x7fbb7c19e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c0ff080 0x7fbb7c196af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40694/0 (socket says 172.21.15.6:40694) 2023-09-13T10:00:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2814971486 learned_addr learned my addr 172.21.15.6:0/2814971486 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2814971486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb7c1020f0 msgr2=0x7fbb7c197030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb7c1020f0 0x7fbb7c197030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c102a90 msgr2=0x7fbb7c19e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c102a90 0x7fbb7c19e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2814971486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb68009520 con 0x7fbb7c0ff080 2023-09-13T10:00:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.726+0000 7fbb812c6700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c102a90 0x7fbb7c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:00:40.733 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.727+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c0ff080 0x7fbb7c196af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000e9f0 tx=0x7fbb7000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.727+0000 7fbb79ffb700 1 -- 172.21.15.6:0/2814971486 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70004220 con 0x7fbb7c0ff080 2023-09-13T10:00:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.727+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb7c19ec20 con 0x7fbb7c0ff080 2023-09-13T10:00:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.727+0000 7fbb79ffb700 1 -- 172.21.15.6:0/2814971486 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb70004380 con 0x7fbb7c0ff080 2023-09-13T10:00:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.727+0000 7fbb79ffb700 1 -- 172.21.15.6:0/2814971486 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70003be0 con 0x7fbb7c0ff080 2023-09-13T10:00:40.734 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.727+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c19f180 con 0x7fbb7c0ff080 2023-09-13T10:00:40.735 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.730+0000 7fbb79ffb700 1 -- 172.21.15.6:0/2814971486 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbb70003d40 con 0x7fbb7c0ff080 2023-09-13T10:00:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.731+0000 7fbb79ffb700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb6c0a0640 0x7fbb6c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.731+0000 7fbb79ffb700 1 -- 172.21.15.6:0/2814971486 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbb70014070 con 0x7fbb7c0ff080 2023-09-13T10:00:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.731+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb6c0a0640 0x7fbb6c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb6c0a0640 0x7fbb6c0a2b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800fa40 tx=0x7fbb68019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 Processor -- start 2023-09-13T10:00:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 -- start start 2023-09-13T10:00:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932bcb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 0x5652932bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bba00 0x5652932bbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x565293214780 con 0x5652932bba00 2023-09-13T10:00:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652932120a0 con 0x5652932bd060 2023-09-13T10:00:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56529320d990 con 0x5652932bc700 2023-09-13T10:00:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb80ac5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932bcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb80ac5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932bcb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50232/0 (socket says 172.21.15.6:50232) 2023-09-13T10:00:40.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb80ac5700 1 -- 172.21.15.6:0/3845681096 learned_addr learned my addr 172.21.15.6:0/3845681096 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb812c6700 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bba00 0x5652932bbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.732+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 0x5652932bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb80ac5700 1 -- 172.21.15.6:0/3845681096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 msgr2=0x5652932bb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 0x5652932bb4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb80ac5700 1 -- 172.21.15.6:0/3845681096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bba00 msgr2=0x5652932bbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bba00 0x5652932bbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb80ac5700 1 -- 172.21.15.6:0/3845681096 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56529308d630 con 0x5652932bc700 2023-09-13T10:00:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb812c6700 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bba00 0x5652932bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:00:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932bcb20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb700a0f80 tx=0x7fbb70003680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f6c4513dce4592 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb66ffd700 1 -- 172.21.15.6:0/3845681096 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb70099b40 con 0x5652932bc700 2023-09-13T10:00:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb66ffd700 1 -- 172.21.15.6:0/3845681096 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb70099440 con 0x5652932bc700 2023-09-13T10:00:40.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.733+0000 7fbb66ffd700 1 -- 172.21.15.6:0/3845681096 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb700998e0 con 0x5652932bc700 2023-09-13T10:00:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/3845681096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 msgr2=0x5652932bcb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932bcb20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbb700a0f80 tx=0x7fbb70003680 comp rx=0 tx=0).stop 2023-09-13T10:00:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/3845681096 shutdown_connections 2023-09-13T10:00:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bba00 0x5652932bbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932bcb20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/3845681096 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 0x5652932bb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/3845681096 >> 172.21.15.6:0/3845681096 conn(0x565293219c80 msgr2=0x5652932b5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/3845681096 shutdown_connections 2023-09-13T10:00:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/3845681096 wait complete. 2023-09-13T10:00:40.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 -- start start 2023-09-13T10:00:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.734+0000 7fbb8ef0eb80 1 Processor -- start 2023-09-13T10:00:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932c5490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bd060 0x5652932cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652931abbb0 con 0x5652932bc700 2023-09-13T10:00:40.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652931ab8b0 con 0x5652932bba00 2023-09-13T10:00:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56529308f920 con 0x5652932bd060 2023-09-13T10:00:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb8ef0eb80 10 client.0 _ll_register_callbacks cb 0x5652931a9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb80ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb80ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932c4f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40708/0 (socket says 172.21.15.6:40708) 2023-09-13T10:00:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2771907401 learned_addr learned my addr 172.21.15.6:0/2771907401 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.735+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932c5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.736+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2771907401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bd060 msgr2=0x5652932cc4d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:00:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.736+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bd060 0x5652932cc4d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.736+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2771907401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 msgr2=0x5652932c5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.736+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932c5490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.736+0000 7fbb80ac5700 1 -- 172.21.15.6:0/2771907401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c19f180 con 0x5652932bba00 2023-09-13T10:00:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.736+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932c4f50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbb700c97a0 tx=0x7fbb70004790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b69426231659b796 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:00:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2771907401 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7009d270 con 0x5652932bba00 2023-09-13T10:00:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2771907401 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbb700a14b0 con 0x5652932bba00 2023-09-13T10:00:40.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5652932ae670 con 0x5652932bba00 2023-09-13T10:00:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2771907401 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb700a1020 con 0x5652932bba00 2023-09-13T10:00:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb8ef0eb80 10 client.30212 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x5652932257a0 con 0x5652932bba00 2023-09-13T10:00:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.737+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2771907401 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5652932ae670 con 0x5652932bba00 2023-09-13T10:00:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2771907401 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbb7009dfb0 con 0x5652932bba00 2023-09-13T10:00:40.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb8ef0eb80 10 client.30212 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb8ef0eb80 10 client.30212 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb8ef0eb80 20 client.30212 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5652932d0820 0x5652932d2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb8ef0eb80 4 client.30212 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:00:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565293206970 con 0x5652932d0820 2023-09-13T10:00:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.738+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5652932d0820 0x5652932d2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.739+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5652932d0820 0x5652932d2c40 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b41ca0b7b6876321 server_cookie=e8313855ce11c985 in_seq=0 out_seq=0 2023-09-13T10:00:40.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.739+0000 7fbb5bfff700 10 client.30212 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2771907401 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565293206970 con 0x5652932d0820 2023-09-13T10:00:40.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb5bfff700 10 client.30212 handle_command_reply: tid=0 2023-09-13T10:00:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 client.30212 shutdown 2023-09-13T10:00:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 msgr2=0x5652932c4f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932c4f50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fbb700c97a0 tx=0x7fbb70004790 comp rx=0 tx=0).stop 2023-09-13T10:00:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 shutdown_connections 2023-09-13T10:00:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bd060 0x5652932cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932c4f50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5652932d0820 0x5652932d2c40 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2771907401 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932c5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb5bfff700 0 client.30212 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.756 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 >> 172.21.15.6:0/2771907401 conn(0x565293219c80 msgr2=0x5652932b07f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 shutdown_connections 2023-09-13T10:00:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2771907401 wait complete. 2023-09-13T10:00:40.757 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.744+0000 7fbb8ef0eb80 20 client.30212 trim_cache size 0 max 16384 2023-09-13T10:00:40.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 Processor -- start 2023-09-13T10:00:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 -- start start 2023-09-13T10:00:40.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bba00 0x5652932bb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932cc490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 0x5652932c3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652932b28e0 con 0x5652932bc700 2023-09-13T10:00:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652932c04f0 con 0x5652932bd060 2023-09-13T10:00:40.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.767+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652932c38e0 con 0x5652932bba00 2023-09-13T10:00:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932cc490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47192/0 (socket says 172.21.15.6:47192) 2023-09-13T10:00:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 -- 172.21.15.6:0/2682051723 learned_addr learned my addr 172.21.15.6:0/2682051723 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bba00 0x5652932bb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 -- 172.21.15.6:0/2682051723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bba00 msgr2=0x5652932bb4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bba00 0x5652932bb4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 -- 172.21.15.6:0/2682051723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 msgr2=0x5652932c3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 0x5652932c3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 -- 172.21.15.6:0/2682051723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565293039de0 con 0x5652932bc700 2023-09-13T10:00:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932cc490 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbb68005950 tx=0x7fbb68021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1315933a8e93d3a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.768+0000 7fbb677fe700 1 -- 172.21.15.6:0/2682051723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb6802b070 con 0x5652932bc700 2023-09-13T10:00:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb677fe700 1 -- 172.21.15.6:0/2682051723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb6802c040 con 0x5652932bc700 2023-09-13T10:00:40.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb677fe700 1 -- 172.21.15.6:0/2682051723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb68005310 con 0x5652932bc700 2023-09-13T10:00:40.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2682051723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 msgr2=0x5652932cc490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932cc490 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7fbb68005950 tx=0x7fbb68021000 comp rx=0 tx=0).stop 2023-09-13T10:00:40.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2682051723 shutdown_connections 2023-09-13T10:00:40.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bd060 0x5652932c3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bba00 0x5652932bb4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2682051723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bc700 0x5652932cc490 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2682051723 >> 172.21.15.6:0/2682051723 conn(0x565293219c80 msgr2=0x5652932b5e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2682051723 shutdown_connections 2023-09-13T10:00:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.769+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2682051723 wait complete. 2023-09-13T10:00:40.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 -- start start 2023-09-13T10:00:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 Processor -- start 2023-09-13T10:00:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932cc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bd060 0x5652932c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652932c8fa0 con 0x5652932bd060 2023-09-13T10:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652932c9110 con 0x5652932bba00 2023-09-13T10:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5652932c92d0 con 0x5652932bc700 2023-09-13T10:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.770+0000 7fbb8ef0eb80 10 client.0 _ll_register_callbacks cb 0x5652931a9680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bd060 0x5652932c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bd060 0x5652932c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47200/0 (socket says 172.21.15.6:47200) 2023-09-13T10:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb80ac5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 -- 172.21.15.6:0/2221234783 learned_addr learned my addr 172.21.15.6:0/2221234783 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb7bfff700 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932cc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 -- 172.21.15.6:0/2221234783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 msgr2=0x5652932cc2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932cc2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 -- 172.21.15.6:0/2221234783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 msgr2=0x5652932cbdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:00:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932cbdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 -- 172.21.15.6:0/2221234783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb7c109b30 con 0x5652932bd060 2023-09-13T10:00:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb812c6700 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bd060 0x5652932c88c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009bb0 tx=0x7fbb74004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fe00a40bc3865f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:00:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb5bfff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:00:40.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.771+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2221234783 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb740047f0 con 0x5652932bd060 2023-09-13T10:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbb70099440 con 0x5652932bd060 2023-09-13T10:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2221234783 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbb74007500 con 0x5652932bd060 2023-09-13T10:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2221234783 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbb740076c0 con 0x5652932bd060 2023-09-13T10:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 10 client.21015 fetch_fsmap learned FSMap version 70 2023-09-13T10:00:40.782 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x565293022c60 con 0x5652932bd060 2023-09-13T10:00:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2221234783 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbb70099440 con 0x5652932bd060 2023-09-13T10:00:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2221234783 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbb7400ea60 con 0x5652932bd060 2023-09-13T10:00:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 10 client.21015 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:00:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 10 client.21015 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:00:40.783 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 20 client.21015 populate_metadata read hostname 'smithi006' 2023-09-13T10:00:40.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x565293325d90 0x5652933281b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:00:40.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 4 client.21015 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:00:40.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.772+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5652931c7050 con 0x565293325d90 2023-09-13T10:00:40.784 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.773+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x565293325d90 0x5652933281b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.774+0000 7fbb5bfff700 10 client.21015 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.785 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.774+0000 7fbb80ac5700 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x565293325d90 0x5652933281b0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd1f33cd628a9535 server_cookie=fc15034b1ec66b09 in_seq=0 out_seq=0 2023-09-13T10:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.777+0000 7fbb5bfff700 1 -- 172.21.15.6:0/2221234783 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x5652931c7050 con 0x565293325d90 2023-09-13T10:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.777+0000 7fbb5bfff700 10 client.21015 handle_command_reply: tid=0 2023-09-13T10:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 client.21015 shutdown 2023-09-13T10:00:40.786 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bd060 msgr2=0x5652932c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bd060 0x5652932c88c0 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7fbb74009bb0 tx=0x7fbb74004040 comp rx=0 tx=0).stop 2023-09-13T10:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 shutdown_connections 2023-09-13T10:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x565293325d90 0x5652933281b0 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5652932bd060 0x5652932c88c0 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.787 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb5bfff700 0 client.21015 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5652932bba00 0x5652932cbdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 --2- 172.21.15.6:0/2221234783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5652932bc700 0x5652932cc2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 >> 172.21.15.6:0/2221234783 conn(0x565293219c80 msgr2=0x5652932c3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 shutdown_connections 2023-09-13T10:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 1 -- 172.21.15.6:0/2221234783 wait complete. 2023-09-13T10:00:40.788 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.778+0000 7fbb8ef0eb80 20 client.21015 trim_cache size 0 max 16384 2023-09-13T10:00:40.789 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:00:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (20 inodes in the stack)", 2023-09-13T10:00:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T10:00:40.789 INFO:teuthology.orchestra.run.smithi006.stdout: "e0e7ff38-ea44-4c2b-8488-a693c1f258dc": { 2023-09-13T10:00:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T10:00:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "e0e7ff38-ea44-4c2b-8488-a693c1f258dc", 2023-09-13T10:00:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T10:00:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:00:40.790 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:00:40.790 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:00:40.791 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb6c0a0640 msgr2=0x7fbb6c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb6c0a0640 0x7fbb6c0a2b00 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fbb6800fa40 tx=0x7fbb68019040 comp rx=0 tx=0).stop 2023-09-13T10:00:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c0ff080 msgr2=0x7fbb7c196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:00:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c0ff080 0x7fbb7c196af0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000e9f0 tx=0x7fbb7000ed00 comp rx=0 tx=0).stop 2023-09-13T10:00:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 shutdown_connections 2023-09-13T10:00:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbb6c0a0640 0x7fbb6c0a2b00 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb7c102a90 0x7fbb7c19e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbb7c0ff080 0x7fbb7c196af0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 --2- 172.21.15.6:0/2814971486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbb7c1020f0 0x7fbb7c197030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:00:40.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 >> 172.21.15.6:0/2814971486 conn(0x7fbb7c0fa990 msgr2=0x7fbb7c0fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:00:40.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 shutdown_connections 2023-09-13T10:00:40.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:00:40.779+0000 7fbb82d29700 1 -- 172.21.15.6:0/2814971486 wait complete. 2023-09-13T10:00:40.794 INFO:tasks.cephfs.filesystem:scrub status for tag:e0e7ff38-ea44-4c2b-8488-a693c1f258dc - {'path': '/', 'tag': 'e0e7ff38-ea44-4c2b-8488-a693c1f258dc', 'options': 'recursive,force'} 2023-09-13T10:00:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:41.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:41 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:41.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:41 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:41.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:41.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:41.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:41 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:41.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:41 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:41.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:41 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:41.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:41 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:41.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 317983 34.56 MB/sec execute 361 sec latency 57.268 ms 2023-09-13T10:00:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T10:00:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:42.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:42.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: pgmap v935: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 768 op/s 2023-09-13T10:00:42.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:42.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:42.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:00:42.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:42 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T10:00:42.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:42.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:42.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:42.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:42.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: pgmap v935: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 768 op/s 2023-09-13T10:00:42.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:42.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:42.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:00:42.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:42 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T10:00:42.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:42.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:42.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:42.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:42.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: pgmap v935: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 14 MiB/s wr, 768 op/s 2023-09-13T10:00:42.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:42.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:42.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:00:42.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:42 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:00:42.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 318606 34.54 MB/sec execute 362 sec latency 80.691 ms 2023-09-13T10:00:43.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 319263 34.54 MB/sec execute 363 sec latency 76.878 ms 2023-09-13T10:00:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:44 smithi006 ceph-mon[98665]: pgmap v936: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 837 op/s 2023-09-13T10:00:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:44 smithi053 ceph-mon[102373]: pgmap v936: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 837 op/s 2023-09-13T10:00:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:44 smithi131 ceph-mon[102785]: pgmap v936: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 14 MiB/s wr, 837 op/s 2023-09-13T10:00:44.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 319910 34.55 MB/sec execute 364 sec latency 58.262 ms 2023-09-13T10:00:45.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 320562 34.54 MB/sec execute 365 sec latency 57.982 ms 2023-09-13T10:00:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:46 smithi006 ceph-mon[98665]: pgmap v937: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 894 op/s 2023-09-13T10:00:46.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:46 smithi053 ceph-mon[102373]: pgmap v937: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 894 op/s 2023-09-13T10:00:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:46 smithi131 ceph-mon[102785]: pgmap v937: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 14 MiB/s wr, 894 op/s 2023-09-13T10:00:46.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 321249 34.53 MB/sec execute 366 sec latency 51.841 ms 2023-09-13T10:00:47.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:47 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:00:47.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:47 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:00:47.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:47 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:00:47.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 321853 34.54 MB/sec execute 367 sec latency 218.174 ms 2023-09-13T10:00:48.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:48 smithi053 ceph-mon[102373]: pgmap v938: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 883 op/s 2023-09-13T10:00:48.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:48 smithi006 ceph-mon[98665]: pgmap v938: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 883 op/s 2023-09-13T10:00:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:48 smithi131 ceph-mon[102785]: pgmap v938: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 14 MiB/s wr, 883 op/s 2023-09-13T10:00:48.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 322478 34.54 MB/sec execute 368 sec latency 163.165 ms 2023-09-13T10:00:49.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 323121 34.56 MB/sec execute 369 sec latency 58.121 ms 2023-09-13T10:00:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:50 smithi006 ceph-mon[98665]: pgmap v939: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.8 MiB/s wr, 723 op/s 2023-09-13T10:00:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:50.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:50 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:50 smithi053 ceph-mon[102373]: pgmap v939: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.8 MiB/s wr, 723 op/s 2023-09-13T10:00:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:50 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:50.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:50 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:50 smithi131 ceph-mon[102785]: pgmap v939: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 7.8 MiB/s wr, 723 op/s 2023-09-13T10:00:50.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:50.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:50 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:50.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 323627 34.54 MB/sec execute 370 sec latency 85.839 ms 2023-09-13T10:00:51.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 324181 34.51 MB/sec execute 371 sec latency 59.251 ms 2023-09-13T10:00:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:52 smithi006 ceph-mon[98665]: pgmap v940: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 590 op/s 2023-09-13T10:00:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:52.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:52 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:52.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:52 smithi053 ceph-mon[102373]: pgmap v940: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 590 op/s 2023-09-13T10:00:52.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:52.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:52 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:52 smithi131 ceph-mon[102785]: pgmap v940: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.1 MiB/s wr, 590 op/s 2023-09-13T10:00:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:52.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:52 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:52.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 324688 34.48 MB/sec execute 372 sec latency 127.547 ms 2023-09-13T10:00:53.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 325452 34.50 MB/sec execute 373 sec latency 89.214 ms 2023-09-13T10:00:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:54 smithi006 ceph-mon[98665]: pgmap v941: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 617 op/s 2023-09-13T10:00:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:54 smithi053 ceph-mon[102373]: pgmap v941: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 617 op/s 2023-09-13T10:00:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:54 smithi131 ceph-mon[102785]: pgmap v941: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.9 MiB/s wr, 617 op/s 2023-09-13T10:00:54.602 INFO:tasks.workunit.client.0.smithi006.stdout: 10 326196 34.52 MB/sec execute 374 sec latency 56.524 ms 2023-09-13T10:00:55.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:55.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:55.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:55.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:55.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:55 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:00:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:55.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:55.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:55 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:00:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:55.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:55.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:55.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:55.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:55 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:00:55.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 326750 34.51 MB/sec execute 375 sec latency 79.815 ms 2023-09-13T10:00:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:56 smithi006 ceph-mon[98665]: pgmap v942: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 537 op/s 2023-09-13T10:00:56.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:56 smithi053 ceph-mon[102373]: pgmap v942: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 537 op/s 2023-09-13T10:00:56.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:56 smithi131 ceph-mon[102785]: pgmap v942: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 3.7 MiB/s wr, 537 op/s 2023-09-13T10:00:56.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 327322 34.52 MB/sec execute 376 sec latency 59.611 ms 2023-09-13T10:00:57.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:57.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:57 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:57.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:57.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:57 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:57.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:57.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:57 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:00:57.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 327839 34.49 MB/sec execute 377 sec latency 83.459 ms 2023-09-13T10:00:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:00:58 smithi006 ceph-mon[98665]: pgmap v943: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 489 op/s 2023-09-13T10:00:58.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:00:58 smithi053 ceph-mon[102373]: pgmap v943: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 489 op/s 2023-09-13T10:00:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:00:58 smithi131 ceph-mon[102785]: pgmap v943: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.7 MiB/s wr, 489 op/s 2023-09-13T10:00:58.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 328354 34.46 MB/sec execute 378 sec latency 123.209 ms 2023-09-13T10:00:59.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 329070 34.48 MB/sec execute 379 sec latency 55.125 ms 2023-09-13T10:01:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:00 smithi006 ceph-mon[98665]: pgmap v944: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2023-09-13T10:01:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:01:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:01:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:00 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:01:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:00 smithi053 ceph-mon[102373]: pgmap v944: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2023-09-13T10:01:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:01:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:01:00.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:00 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:01:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:00 smithi131 ceph-mon[102785]: pgmap v944: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.5 MiB/s wr, 479 op/s 2023-09-13T10:01:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:01:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:01:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:00 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:01:00.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 329744 34.48 MB/sec execute 380 sec latency 56.379 ms 2023-09-13T10:01:01.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 330382 34.49 MB/sec execute 381 sec latency 80.136 ms 2023-09-13T10:01:02.498 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:02 smithi053 ceph-mon[102373]: pgmap v945: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 442 op/s 2023-09-13T10:01:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:02 smithi006 ceph-mon[98665]: pgmap v945: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 442 op/s 2023-09-13T10:01:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:02 smithi131 ceph-mon[102785]: pgmap v945: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 442 op/s 2023-09-13T10:01:02.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 330961 34.48 MB/sec execute 382 sec latency 86.622 ms 2023-09-13T10:01:03.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 331520 34.46 MB/sec execute 383 sec latency 100.951 ms 2023-09-13T10:01:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:04 smithi131 ceph-mon[102785]: pgmap v946: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 484 op/s 2023-09-13T10:01:04.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 332117 34.46 MB/sec execute 384 sec latency 58.513 ms 2023-09-13T10:01:04.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:04 smithi006 ceph-mon[98665]: pgmap v946: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 484 op/s 2023-09-13T10:01:04.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:04 smithi053 ceph-mon[102373]: pgmap v946: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 484 op/s 2023-09-13T10:01:05.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 332212 34.39 MB/sec execute 385 sec latency 882.288 ms 2023-09-13T10:01:05.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:05 smithi006 ceph-mon[98665]: pgmap v947: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 472 op/s 2023-09-13T10:01:05.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:05 smithi053 ceph-mon[102373]: pgmap v947: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 472 op/s 2023-09-13T10:01:05.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:05 smithi131 ceph-mon[102785]: pgmap v947: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 472 op/s 2023-09-13T10:01:06.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 332474 34.32 MB/sec execute 386 sec latency 902.328 ms 2023-09-13T10:01:07.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 332832 34.28 MB/sec execute 387 sec latency 121.027 ms 2023-09-13T10:01:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:08 smithi006 ceph-mon[98665]: pgmap v948: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.1 MiB/s wr, 566 op/s 2023-09-13T10:01:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:08 smithi053 ceph-mon[102373]: pgmap v948: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.1 MiB/s wr, 566 op/s 2023-09-13T10:01:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:08 smithi131 ceph-mon[102785]: pgmap v948: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.1 MiB/s wr, 566 op/s 2023-09-13T10:01:08.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 333612 34.30 MB/sec execute 388 sec latency 69.806 ms 2023-09-13T10:01:09.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 334253 34.31 MB/sec execute 389 sec latency 113.499 ms 2023-09-13T10:01:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:10 smithi006 ceph-mon[98665]: pgmap v949: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 649 op/s 2023-09-13T10:01:10.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:10 smithi053 ceph-mon[102373]: pgmap v949: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 649 op/s 2023-09-13T10:01:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:10 smithi131 ceph-mon[102785]: pgmap v949: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 649 op/s 2023-09-13T10:01:10.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 334556 34.28 MB/sec execute 390 sec latency 337.117 ms 2023-09-13T10:01:10.795 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:01:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 -- 172.21.15.6:0/1364421624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a600ffcc0 msgr2=0x7f4a601000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 --2- 172.21.15.6:0/1364421624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a600ffcc0 0x7f4a601000e0 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800b0d0 tx=0x7f4a5800b3e0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 -- 172.21.15.6:0/1364421624 shutdown_connections 2023-09-13T10:01:11.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 --2- 172.21.15.6:0/1364421624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a60101850 0x7f4a60108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 --2- 172.21.15.6:0/1364421624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a600ffcc0 0x7f4a601000e0 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 --2- 172.21.15.6:0/1364421624 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a60100eb0 0x7f4a60101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 -- 172.21.15.6:0/1364421624 >> 172.21.15.6:0/1364421624 conn(0x7f4a600fb210 msgr2=0x7f4a600fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 -- 172.21.15.6:0/1364421624 shutdown_connections 2023-09-13T10:01:11.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.998+0000 7f4a6616c700 1 -- 172.21.15.6:0/1364421624 wait complete. 2023-09-13T10:01:11.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 Processor -- start 2023-09-13T10:01:11.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 -- start start 2023-09-13T10:01:11.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a600ffcc0 0x7f4a60103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a60100eb0 0x7f4a60102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a60101850 0x7f4a601027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a60102f70 con 0x7f4a60100eb0 2023-09-13T10:01:11.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601030e0 con 0x7f4a600ffcc0 2023-09-13T10:01:11.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a6616c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a601a0cc0 con 0x7f4a60101850 2023-09-13T10:01:11.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:10.999+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a60100eb0 0x7f4a60102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a60100eb0 0x7f4a60102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47208/0 (socket says 172.21.15.6:47208) 2023-09-13T10:01:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 -- 172.21.15.6:0/550480078 learned_addr learned my addr 172.21.15.6:0/550480078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a600ffcc0 0x7f4a60103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 -- 172.21.15.6:0/550480078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a60101850 msgr2=0x7f4a601027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a60101850 0x7f4a601027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 -- 172.21.15.6:0/550480078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a600ffcc0 msgr2=0x7f4a60103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a600ffcc0 0x7f4a60103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 -- 172.21.15.6:0/550480078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a58009d00 con 0x7f4a60100eb0 2023-09-13T10:01:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5effd700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a60100eb0 0x7f4a60102290 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000b530 tx=0x7f4a5000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5cff9700 1 -- 172.21.15.6:0/550480078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50011830 con 0x7f4a60100eb0 2023-09-13T10:01:11.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5cff9700 1 -- 172.21.15.6:0/550480078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a50011e50 con 0x7f4a60100eb0 2023-09-13T10:01:11.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.000+0000 7f4a5cff9700 1 -- 172.21.15.6:0/550480078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5000f2e0 con 0x7f4a60100eb0 2023-09-13T10:01:11.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.008+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a601a0fa0 con 0x7f4a60100eb0 2023-09-13T10:01:11.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.008+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a601a14b0 con 0x7f4a60100eb0 2023-09-13T10:01:11.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.012+0000 7f4a72351b80 1 Processor -- start 2023-09-13T10:01:11.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a5cff9700 1 -- 172.21.15.6:0/550480078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4a50010380 con 0x7f4a60100eb0 2023-09-13T10:01:11.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a72351b80 1 -- start start 2023-09-13T10:01:11.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5adf10 0x55751b5ae330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5ae870 0x55751b5accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5ad690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a72351b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b4fd780 con 0x55751b5adf10 2023-09-13T10:01:11.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a72351b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b4fb0a0 con 0x55751b5ad210 2023-09-13T10:01:11.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a72351b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b4f6990 con 0x55751b5ae870 2023-09-13T10:01:11.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5ad690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a5ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5adf10 0x55751b5ae330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.013+0000 7f4a5effd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5ad690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40738/0 (socket says 172.21.15.6:40738) 2023-09-13T10:01:11.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.014+0000 7f4a5effd700 1 -- 172.21.15.6:0/3980316320 learned_addr learned my addr 172.21.15.6:0/3980316320 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.014+0000 7f4a5cff9700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a480a0640 0x7f4a480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.014+0000 7f4a5effd700 1 -- 172.21.15.6:0/3980316320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5ae870 msgr2=0x55751b5accd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:11.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.014+0000 7f4a5effd700 1 --2- 172.21.15.6:0/3980316320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5ae870 0x55751b5accd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.014+0000 7f4a5effd700 1 -- 172.21.15.6:0/3980316320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5adf10 msgr2=0x55751b5ae330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.014+0000 7f4a5effd700 1 --2- 172.21.15.6:0/3980316320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5adf10 0x55751b5ae330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.014+0000 7f4a5effd700 1 -- 172.21.15.6:0/3980316320 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55751b376630 con 0x55751b5ad210 2023-09-13T10:01:11.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.015+0000 7f4a5cff9700 1 -- 172.21.15.6:0/550480078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a500cb780 con 0x7f4a60100eb0 2023-09-13T10:01:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.015+0000 7f4a5effd700 1 --2- 172.21.15.6:0/3980316320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5ad690 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4a500c9170 tx=0x7f4a50021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7f073079661d6b7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.016+0000 7f4a45ffb700 1 -- 172.21.15.6:0/3980316320 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50098a60 con 0x55751b5ad210 2023-09-13T10:01:11.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.016+0000 7f4a45ffb700 1 -- 172.21.15.6:0/3980316320 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a50098880 con 0x55751b5ad210 2023-09-13T10:01:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.016+0000 7f4a45ffb700 1 -- 172.21.15.6:0/3980316320 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a50051fe0 con 0x55751b5ad210 2023-09-13T10:01:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 -- 172.21.15.6:0/3980316320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 msgr2=0x55751b5ad690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3980316320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5ad690 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4a500c9170 tx=0x7f4a50021000 comp rx=0 tx=0).stop 2023-09-13T10:01:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 -- 172.21.15.6:0/3980316320 shutdown_connections 2023-09-13T10:01:11.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3980316320 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5ad690 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3980316320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5adf10 0x55751b5ae330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3980316320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5ae870 0x55751b5accd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 -- 172.21.15.6:0/3980316320 >> 172.21.15.6:0/3980316320 conn(0x55751b502c80 msgr2=0x55751b59ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 -- 172.21.15.6:0/3980316320 shutdown_connections 2023-09-13T10:01:11.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 -- 172.21.15.6:0/3980316320 wait complete. 2023-09-13T10:01:11.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a5ffff700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a480a0640 0x7f4a480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.017+0000 7f4a72351b80 1 -- start start 2023-09-13T10:01:11.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.018+0000 7f4a72351b80 1 Processor -- start 2023-09-13T10:01:11.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ad210 0x55751b5b6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5b6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ae870 0x55751b5bdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a72351b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b494bb0 con 0x55751b5ad210 2023-09-13T10:01:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a72351b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b4948b0 con 0x55751b5ae870 2023-09-13T10:01:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a72351b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b378920 con 0x55751b5adf10 2023-09-13T10:01:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a72351b80 10 client.0 _ll_register_callbacks cb 0x55751b492680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:11.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a5ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ae870 0x55751b5bdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a5ffff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ae870 0x55751b5bdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40744/0 (socket says 172.21.15.6:40744) 2023-09-13T10:01:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.019+0000 7f4a5ffff700 1 -- 172.21.15.6:0/214942570 learned_addr learned my addr 172.21.15.6:0/214942570 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.020+0000 7f4a5effd700 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5b6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.020+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ad210 0x55751b5b6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.026 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.020+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/214942570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 msgr2=0x55751b5b6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.020+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5b6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.021+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/214942570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ae870 msgr2=0x55751b5bdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.021+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ae870 0x55751b5bdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.021+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/214942570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a601a14b0 con 0x55751b5ad210 2023-09-13T10:01:11.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.022+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ad210 0x55751b5b6680 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800b770 tx=0x7f4a58008f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0c914377f7c07aa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.022+0000 7f4a3effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.022+0000 7f4a5ffff700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a480a0640 0x7f4a480a2b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009fd0 tx=0x7f4a54009f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a3effd700 1 -- 172.21.15.6:0/214942570 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800e040 con 0x55751b5ad210 2023-09-13T10:01:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a3effd700 1 -- 172.21.15.6:0/214942570 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a5800baa0 con 0x55751b5ad210 2023-09-13T10:01:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55751b597670 con 0x55751b5ad210 2023-09-13T10:01:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a3effd700 1 -- 172.21.15.6:0/214942570 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a5800bc60 con 0x55751b5ad210 2023-09-13T10:01:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 10 client.21027 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55751b50e7a0 con 0x55751b5ad210 2023-09-13T10:01:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a3effd700 1 -- 172.21.15.6:0/214942570 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55751b597670 con 0x55751b5ad210 2023-09-13T10:01:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a3effd700 1 -- 172.21.15.6:0/214942570 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4a58022020 con 0x55751b5ad210 2023-09-13T10:01:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 10 client.21027 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 10 client.21027 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 20 client.21027 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b5d33c0 0x55751b5d57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 4 client.21027 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.023+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55751b4ef970 con 0x55751b5d33c0 2023-09-13T10:01:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.024+0000 7f4a5effd700 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b5d33c0 0x55751b5d57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.024+0000 7f4a3effd700 10 client.21027 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.024+0000 7f4a5effd700 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b5d33c0 0x55751b5d57e0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e9f9043a115d16 server_cookie=96ab899554ff289 in_seq=0 out_seq=0 2023-09-13T10:01:11.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.030+0000 7f4a3effd700 1 -- 172.21.15.6:0/214942570 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55751b4ef970 con 0x55751b5d33c0 2023-09-13T10:01:11.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.030+0000 7f4a3effd700 10 client.21027 handle_command_reply: tid=0 2023-09-13T10:01:11.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.030+0000 7f4a72351b80 1 client.21027 shutdown 2023-09-13T10:01:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.031+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ad210 msgr2=0x55751b5b6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.031+0000 7f4a72351b80 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ad210 0x55751b5b6680 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f4a5800b770 tx=0x7f4a58008f80 comp rx=0 tx=0).stop 2023-09-13T10:01:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 shutdown_connections 2023-09-13T10:01:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ae870 0x55751b5bdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b5d33c0 0x55751b5d57e0 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ad210 0x55751b5b6680 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 --2- 172.21.15.6:0/214942570 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5b6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a3effd700 0 client.21027 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 >> 172.21.15.6:0/214942570 conn(0x55751b502c80 msgr2=0x55751b5997f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 shutdown_connections 2023-09-13T10:01:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 1 -- 172.21.15.6:0/214942570 wait complete. 2023-09-13T10:01:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.033+0000 7f4a72351b80 20 client.21027 trim_cache size 0 max 16384 2023-09-13T10:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.063+0000 7f4a72351b80 1 Processor -- start 2023-09-13T10:01:11.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.066+0000 7f4a72351b80 1 -- start start 2023-09-13T10:01:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5bdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 0x55751b5b1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a72351b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b5b6250 con 0x55751b5ae870 2023-09-13T10:01:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a72351b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b5b4410 con 0x55751b5ad210 2023-09-13T10:01:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a72351b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b5b1cd0 con 0x55751b5adf10 2023-09-13T10:01:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40750/0 (socket says 172.21.15.6:40750) 2023-09-13T10:01:11.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/745322514 learned_addr learned my addr 172.21.15.6:0/745322514 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/745322514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 msgr2=0x55751b5bdbc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/745322514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5bdbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/745322514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 msgr2=0x55751b5b1130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/745322514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 0x55751b5b1130 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.067+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/745322514 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55751b322de0 con 0x55751b5ad210 2023-09-13T10:01:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.068+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/745322514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5accd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4a5801c430 tx=0x7f4a58005b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=727aa30dd8e509b8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.068+0000 7f4a467fc700 1 -- 172.21.15.6:0/745322514 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800e070 con 0x55751b5ad210 2023-09-13T10:01:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.068+0000 7f4a467fc700 1 -- 172.21.15.6:0/745322514 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a58029030 con 0x55751b5ad210 2023-09-13T10:01:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.068+0000 7f4a467fc700 1 -- 172.21.15.6:0/745322514 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a58003a00 con 0x55751b5ad210 2023-09-13T10:01:11.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.069+0000 7f4a72351b80 1 -- 172.21.15.6:0/745322514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 msgr2=0x55751b5accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.069+0000 7f4a72351b80 1 --2- 172.21.15.6:0/745322514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5accd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4a5801c430 tx=0x7f4a58005b60 comp rx=0 tx=0).stop 2023-09-13T10:01:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.070+0000 7f4a72351b80 1 -- 172.21.15.6:0/745322514 shutdown_connections 2023-09-13T10:01:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.070+0000 7f4a72351b80 1 --2- 172.21.15.6:0/745322514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 0x55751b5b1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.070+0000 7f4a72351b80 1 --2- 172.21.15.6:0/745322514 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5accd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.070+0000 7f4a72351b80 1 --2- 172.21.15.6:0/745322514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5bdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.070+0000 7f4a72351b80 1 -- 172.21.15.6:0/745322514 >> 172.21.15.6:0/745322514 conn(0x55751b502c80 msgr2=0x55751b59ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.072+0000 7f4a72351b80 1 -- 172.21.15.6:0/745322514 shutdown_connections 2023-09-13T10:01:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.072+0000 7f4a72351b80 1 -- 172.21.15.6:0/745322514 wait complete. 2023-09-13T10:01:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.072+0000 7f4a72351b80 1 -- start start 2023-09-13T10:01:11.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 1 Processor -- start 2023-09-13T10:01:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5bd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5bdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 0x55751b5ba000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b5ba710 con 0x55751b5ae870 2023-09-13T10:01:11.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b5ba880 con 0x55751b5ad210 2023-09-13T10:01:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55751b5baa40 con 0x55751b5adf10 2023-09-13T10:01:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a72351b80 10 client.0 _ll_register_callbacks cb 0x55751b492680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a5f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5bd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a5f7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5bd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40752/0 (socket says 172.21.15.6:40752) 2023-09-13T10:01:11.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.073+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/3367832887 learned_addr learned my addr 172.21.15.6:0/3367832887 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.074+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/3367832887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 msgr2=0x55751b5bdaa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:01:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.074+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5bdaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.074+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/3367832887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 msgr2=0x55751b5ba000 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.074+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 0x55751b5ba000 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.074+0000 7f4a5f7fe700 1 -- 172.21.15.6:0/3367832887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55751b50e7a0 con 0x55751b5ad210 2023-09-13T10:01:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.078+0000 7f4a5f7fe700 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5bd560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005890 tx=0x7f4a58007920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a682028528e1816e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.078+0000 7f4a3effd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:11.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.079+0000 7f4a3effd700 1 -- 172.21.15.6:0/3367832887 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a5800e070 con 0x55751b5ad210 2023-09-13T10:01:11.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.079+0000 7f4a3effd700 1 -- 172.21.15.6:0/3367832887 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a58003a00 con 0x55751b5ad210 2023-09-13T10:01:11.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.079+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a50098880 con 0x55751b5ad210 2023-09-13T10:01:11.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.085+0000 7f4a3effd700 1 -- 172.21.15.6:0/3367832887 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a5800be30 con 0x55751b5ad210 2023-09-13T10:01:11.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.085+0000 7f4a72351b80 10 client.30230 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:11.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.085+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55751b30bc60 con 0x55751b5ad210 2023-09-13T10:01:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a3effd700 1 -- 172.21.15.6:0/3367832887 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a50098880 con 0x55751b5ad210 2023-09-13T10:01:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a3effd700 1 -- 172.21.15.6:0/3367832887 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4a58019040 con 0x55751b5ad210 2023-09-13T10:01:11.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a72351b80 10 client.30230 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a72351b80 10 client.30230 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a72351b80 20 client.30230 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b6283b0 0x55751b62a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a72351b80 4 client.30230 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:01:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.089+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55751b4b0050 con 0x55751b6283b0 2023-09-13T10:01:11.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.092+0000 7f4a5effd700 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b6283b0 0x55751b62a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.092+0000 7f4a5effd700 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b6283b0 0x55751b62a7a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b425059304909b77 server_cookie=b28d52d9ee42455b in_seq=0 out_seq=0 2023-09-13T10:01:11.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.092+0000 7f4a3effd700 10 client.30230 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:11.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.117+0000 7f4a3effd700 1 -- 172.21.15.6:0/3367832887 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55751b4b0050 con 0x55751b6283b0 2023-09-13T10:01:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.117+0000 7f4a3effd700 10 client.30230 handle_command_reply: tid=0 2023-09-13T10:01:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.118+0000 7f4a72351b80 1 client.30230 shutdown 2023-09-13T10:01:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 msgr2=0x55751b5bd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5bd560 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f4a58005890 tx=0x7f4a58007920 comp rx=0 tx=0).stop 2023-09-13T10:01:11.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 shutdown_connections 2023-09-13T10:01:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55751b6283b0 0x55751b62a7a0 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55751b5ae870 0x55751b5ba000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55751b5ad210 0x55751b5bd560 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a3effd700 0 client.30230 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:11.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 --2- 172.21.15.6:0/3367832887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55751b5adf10 0x55751b5bdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 >> 172.21.15.6:0/3367832887 conn(0x55751b502c80 msgr2=0x55751b5b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 shutdown_connections 2023-09-13T10:01:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.119+0000 7f4a72351b80 1 -- 172.21.15.6:0/3367832887 wait complete. 2023-09-13T10:01:11.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.120+0000 7f4a72351b80 20 client.30230 trim_cache size 0 max 16384 2023-09-13T10:01:11.125 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:01:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T10:01:11.125 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T10:01:11.125 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:01:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a480a0640 msgr2=0x7f4a480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a480a0640 0x7f4a480a2b00 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f4a54009fd0 tx=0x7f4a54009f60 comp rx=0 tx=0).stop 2023-09-13T10:01:11.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a60100eb0 msgr2=0x7f4a60102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a60100eb0 0x7f4a60102290 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4a5000b530 tx=0x7f4a5000b840 comp rx=0 tx=0).stop 2023-09-13T10:01:11.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 shutdown_connections 2023-09-13T10:01:11.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a60101850 0x7f4a601027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a600ffcc0 0x7f4a60103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a480a0640 0x7f4a480a2b00 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 --2- 172.21.15.6:0/550480078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a60100eb0 0x7f4a60102290 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 >> 172.21.15.6:0/550480078 conn(0x7f4a600fb210 msgr2=0x7f4a60068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 shutdown_connections 2023-09-13T10:01:11.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.122+0000 7f4a6616c700 1 -- 172.21.15.6:0/550480078 wait complete. 2023-09-13T10:01:11.137 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T10:01:11.138 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:01:11.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 -- 172.21.15.6:0/1665358725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 msgr2=0x7ff380108130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 --2- 172.21.15.6:0/1665358725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff380108130 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7ff37800b0a0 tx=0x7ff37800b3b0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 -- 172.21.15.6:0/1665358725 shutdown_connections 2023-09-13T10:01:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 --2- 172.21.15.6:0/1665358725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff380108130 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 --2- 172.21.15.6:0/1665358725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff380101280 0x7ff3801016a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 --2- 172.21.15.6:0/1665358725 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3800ffed0 0x7ff380100350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 -- 172.21.15.6:0/1665358725 >> 172.21.15.6:0/1665358725 conn(0x7ff3800fa9c0 msgr2=0x7ff3800fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 -- 172.21.15.6:0/1665358725 shutdown_connections 2023-09-13T10:01:11.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.349+0000 7ff38515c700 1 -- 172.21.15.6:0/1665358725 wait complete. 2023-09-13T10:01:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.350+0000 7ff38515c700 1 Processor -- start 2023-09-13T10:01:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff38515c700 1 -- start start 2023-09-13T10:01:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff38515c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3800ffed0 0x7ff380196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff38515c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff3801970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff38515c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff380101280 0x7ff38019e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff38515c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38019e720 con 0x7ff380100890 2023-09-13T10:01:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff38515c700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38019e860 con 0x7ff380101280 2023-09-13T10:01:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff38515c700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38019e9f0 con 0x7ff3800ffed0 2023-09-13T10:01:11.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff3801970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff3801970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47238/0 (socket says 172.21.15.6:47238) 2023-09-13T10:01:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 -- 172.21.15.6:0/420709501 learned_addr learned my addr 172.21.15.6:0/420709501 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3800ffed0 0x7ff380196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37f59e700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff380101280 0x7ff38019e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 -- 172.21.15.6:0/420709501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3800ffed0 msgr2=0x7ff380196ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3800ffed0 0x7ff380196ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 -- 172.21.15.6:0/420709501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff380101280 msgr2=0x7ff38019e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff380101280 0x7ff38019e150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.351+0000 7ff37e59c700 1 -- 172.21.15.6:0/420709501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009d00 con 0x7ff380100890 2023-09-13T10:01:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.352+0000 7ff37e59c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff3801970e0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff37000b550 tx=0x7ff37000b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.352+0000 7ff367fff700 1 -- 172.21.15.6:0/420709501 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370011830 con 0x7ff380100890 2023-09-13T10:01:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.352+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38019ecd0 con 0x7ff380100890 2023-09-13T10:01:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.352+0000 7ff367fff700 1 -- 172.21.15.6:0/420709501 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff370011e50 con 0x7ff380100890 2023-09-13T10:01:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.352+0000 7ff367fff700 1 -- 172.21.15.6:0/420709501 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff370010e40 con 0x7ff380100890 2023-09-13T10:01:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.352+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38019f190 con 0x7ff380100890 2023-09-13T10:01:11.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.353+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff380107e70 con 0x7ff380100890 2023-09-13T10:01:11.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.354+0000 7ff367fff700 1 -- 172.21.15.6:0/420709501 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff370010380 con 0x7ff380100890 2023-09-13T10:01:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.355+0000 7ff367fff700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3680a0640 0x7ff3680a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.355+0000 7ff37ed9d700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3680a0640 0x7ff3680a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.355+0000 7ff367fff700 1 -- 172.21.15.6:0/420709501 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3700cbb80 con 0x7ff380100890 2023-09-13T10:01:11.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.356+0000 7ff37ed9d700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3680a0640 0x7ff3680a2b00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff374009a10 tx=0x7ff374009190 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.360+0000 7ff367fff700 1 -- 172.21.15.6:0/420709501 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff370095660 con 0x7ff380100890 2023-09-13T10:01:11.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 335001 34.26 MB/sec execute 391 sec latency 68.736 ms 2023-09-13T10:01:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.702+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff38010b5e0 con 0x7ff380100890 2023-09-13T10:01:11.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.703+0000 7ff367fff700 1 -- 172.21.15.6:0/420709501 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+11336 (secure 0 0 0) 0x7ff370098c80 con 0x7ff380100890 2023-09-13T10:01:11.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:01:11.705 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":70,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T10:00:12.571896+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:01:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.705+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3680a0640 msgr2=0x7ff3680a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.705+0000 7ff38515c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3680a0640 0x7ff3680a2b00 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff374009a10 tx=0x7ff374009190 comp rx=0 tx=0).stop 2023-09-13T10:01:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.705+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 msgr2=0x7ff3801970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.705+0000 7ff38515c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff3801970e0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7ff37000b550 tx=0x7ff37000b860 comp rx=0 tx=0).stop 2023-09-13T10:01:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 shutdown_connections 2023-09-13T10:01:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff380101280 0x7ff38019e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3800ffed0 0x7ff380196ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff3680a0640 0x7ff3680a2b00 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 --2- 172.21.15.6:0/420709501 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff380100890 0x7ff3801970e0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 >> 172.21.15.6:0/420709501 conn(0x7ff3800fa9c0 msgr2=0x7ff3800fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 shutdown_connections 2023-09-13T10:01:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.706+0000 7ff38515c700 1 -- 172.21.15.6:0/420709501 wait complete. 2023-09-13T10:01:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-09-13T10:01:11.724 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T10:01:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 -- 172.21.15.6:0/3869652277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18201008e0 msgr2=0x7f1820108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 --2- 172.21.15.6:0/3869652277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18201008e0 0x7f1820108180 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x7f181800b0a0 tx=0x7f181800b3b0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 -- 172.21.15.6:0/3869652277 shutdown_connections 2023-09-13T10:01:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 --2- 172.21.15.6:0/3869652277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18201008e0 0x7f1820108180 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 --2- 172.21.15.6:0/3869652277 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18201012d0 0x7f18201016f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 --2- 172.21.15.6:0/3869652277 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18200fff20 0x7f18201003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 -- 172.21.15.6:0/3869652277 >> 172.21.15.6:0/3869652277 conn(0x7f18200fa9b0 msgr2=0x7f18200fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 -- 172.21.15.6:0/3869652277 shutdown_connections 2023-09-13T10:01:11.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.883+0000 7f1826c56700 1 -- 172.21.15.6:0/3869652277 wait complete. 2023-09-13T10:01:11.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 Processor -- start 2023-09-13T10:01:11.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 -- start start 2023-09-13T10:01:11.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18200fff20 0x7f1820103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18201008e0 0x7f18201025c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18201012d0 0x7f1820102b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182019aa00 con 0x7f18200fff20 2023-09-13T10:01:11.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182019ab70 con 0x7f18201008e0 2023-09-13T10:01:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1826c56700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182019ad30 con 0x7f18201012d0 2023-09-13T10:01:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18200fff20 0x7f1820103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18200fff20 0x7f1820103f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47252/0 (socket says 172.21.15.6:47252) 2023-09-13T10:01:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 -- 172.21.15.6:0/1074786341 learned_addr learned my addr 172.21.15.6:0/1074786341 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f1817fff700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18201008e0 0x7f18201025c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18251f3700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18201012d0 0x7f1820102b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 -- 172.21.15.6:0/1074786341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18201012d0 msgr2=0x7f1820102b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18201012d0 0x7f1820102b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 -- 172.21.15.6:0/1074786341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18201008e0 msgr2=0x7f18201025c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18201008e0 0x7f18201025c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.884+0000 7f18249f2700 1 -- 172.21.15.6:0/1074786341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1818009d00 con 0x7f18200fff20 2023-09-13T10:01:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.885+0000 7f18249f2700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18200fff20 0x7f1820103f80 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f181c00e970 tx=0x7f181c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.885+0000 7f1815ffb700 1 -- 172.21.15.6:0/1074786341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c009790 con 0x7f18200fff20 2023-09-13T10:01:11.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.885+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182019b010 con 0x7f18200fff20 2023-09-13T10:01:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.885+0000 7f1815ffb700 1 -- 172.21.15.6:0/1074786341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f181c00c7e0 con 0x7f18200fff20 2023-09-13T10:01:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.885+0000 7f1815ffb700 1 -- 172.21.15.6:0/1074786341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c003c70 con 0x7f18200fff20 2023-09-13T10:01:11.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.885+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182019b520 con 0x7f18200fff20 2023-09-13T10:01:11.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.888+0000 7f1815ffb700 1 -- 172.21.15.6:0/1074786341 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f181c00cc50 con 0x7f18200fff20 2023-09-13T10:01:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.888+0000 7f1815ffb700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18080a0640 0x7f18080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.889+0000 7f1815ffb700 1 -- 172.21.15.6:0/1074786341 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f181c014070 con 0x7f18200fff20 2023-09-13T10:01:11.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.889+0000 7f1817fff700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18080a0640 0x7f18080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.889+0000 7f1817fff700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18080a0640 0x7f18080a2b00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1810009c60 tx=0x7f1810009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 Processor -- start 2023-09-13T10:01:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 -- start start 2023-09-13T10:01:11.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df5700 0x560518df5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 0x560518df44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df4a00 0x560518df4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518d4d780 con 0x560518df5700 2023-09-13T10:01:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518d4b0a0 con 0x560518df6060 2023-09-13T10:01:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.890+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518d46990 con 0x560518df4a00 2023-09-13T10:01:11.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df5700 0x560518df5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df5700 0x560518df5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47260/0 (socket says 172.21.15.6:47260) 2023-09-13T10:01:11.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 -- 172.21.15.6:0/4249644235 learned_addr learned my addr 172.21.15.6:0/4249644235 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18251f3700 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df4a00 0x560518df4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 -- 172.21.15.6:0/4249644235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df4a00 msgr2=0x560518df4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df4a00 0x560518df4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 -- 172.21.15.6:0/4249644235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 msgr2=0x560518df44c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:11.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 0x560518df44c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 -- 172.21.15.6:0/4249644235 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560518bc6630 con 0x560518df5700 2023-09-13T10:01:11.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f18249f2700 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df5700 0x560518df5b20 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f181c0a10b0 tx=0x7f181c099180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a540845fc878913 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.891+0000 7f1806ffd700 1 -- 172.21.15.6:0/4249644235 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c09d170 con 0x560518df5700 2023-09-13T10:01:11.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1806ffd700 1 -- 172.21.15.6:0/4249644235 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f181c0ace90 con 0x560518df5700 2023-09-13T10:01:11.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1806ffd700 1 -- 172.21.15.6:0/4249644235 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0840c0 con 0x560518df5700 2023-09-13T10:01:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 -- 172.21.15.6:0/4249644235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df5700 msgr2=0x560518df5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df5700 0x560518df5b20 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f181c0a10b0 tx=0x7f181c099180 comp rx=0 tx=0).stop 2023-09-13T10:01:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 -- 172.21.15.6:0/4249644235 shutdown_connections 2023-09-13T10:01:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df4a00 0x560518df4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df5700 0x560518df5b20 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/4249644235 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 0x560518df44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 -- 172.21.15.6:0/4249644235 >> 172.21.15.6:0/4249644235 conn(0x560518d52c80 msgr2=0x560518deef10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 -- 172.21.15.6:0/4249644235 shutdown_connections 2023-09-13T10:01:11.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.892+0000 7f1832e3bb80 1 -- 172.21.15.6:0/4249644235 wait complete. 2023-09-13T10:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 -- start start 2023-09-13T10:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 Processor -- start 2023-09-13T10:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518dfdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518dfe500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518e05540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518ce4bb0 con 0x560518df4a00 2023-09-13T10:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518ce48b0 con 0x560518df5700 2023-09-13T10:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518bc8920 con 0x560518df6060 2023-09-13T10:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.893+0000 7f1832e3bb80 10 client.0 _ll_register_callbacks cb 0x560518ce2680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518dfe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518dfe500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40790/0 (socket says 172.21.15.6:40790) 2023-09-13T10:01:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 -- 172.21.15.6:0/3214314175 learned_addr learned my addr 172.21.15.6:0/3214314175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f18249f2700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518dfdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f18251f3700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518e05540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 -- 172.21.15.6:0/3214314175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 msgr2=0x560518e05540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518e05540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 -- 172.21.15.6:0/3214314175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 msgr2=0x560518dfdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518dfdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f1817fff700 1 -- 172.21.15.6:0/3214314175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182019b520 con 0x560518df5700 2023-09-13T10:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.894+0000 7f18251f3700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518e05540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:11.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.897+0000 7f1817fff700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518dfe500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1810009b20 tx=0x7f18100047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a00dfb5aebaca906 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.897+0000 7f17fffff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.900+0000 7f17fffff700 1 -- 172.21.15.6:0/3214314175 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1810004220 con 0x560518df5700 2023-09-13T10:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.900+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560518de7670 con 0x560518df5700 2023-09-13T10:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.900+0000 7f17fffff700 1 -- 172.21.15.6:0/3214314175 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1810023070 con 0x560518df5700 2023-09-13T10:01:11.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.900+0000 7f17fffff700 1 -- 172.21.15.6:0/3214314175 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1810004380 con 0x560518df5700 2023-09-13T10:01:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.900+0000 7f1832e3bb80 10 client.30242 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.900+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x560518d5e7a0 con 0x560518df5700 2023-09-13T10:01:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f17fffff700 1 -- 172.21.15.6:0/3214314175 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560518de7670 con 0x560518df5700 2023-09-13T10:01:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f17fffff700 1 -- 172.21.15.6:0/3214314175 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f1810003be0 con 0x560518df5700 2023-09-13T10:01:11.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f1832e3bb80 10 client.30242 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f1832e3bb80 10 client.30242 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:01:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f1832e3bb80 20 client.30242 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e09d50 0x560518e0c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f1832e3bb80 4 client.30242 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:11.930 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560518d3f970 con 0x560518e09d50 2023-09-13T10:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.901+0000 7f18249f2700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e09d50 0x560518e0c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.902+0000 7f17fffff700 10 client.30242 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.902+0000 7f18249f2700 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e09d50 0x560518e0c170 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fe88351d46914a40 server_cookie=b7ad7d14df2ab0ab in_seq=0 out_seq=0 2023-09-13T10:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f17fffff700 1 -- 172.21.15.6:0/3214314175 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560518d3f970 con 0x560518e09d50 2023-09-13T10:01:11.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f17fffff700 10 client.30242 handle_command_reply: tid=0 2023-09-13T10:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 client.30242 shutdown 2023-09-13T10:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 msgr2=0x560518dfe500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518dfe500 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f1810009b20 tx=0x7f18100047c0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 shutdown_connections 2023-09-13T10:01:11.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e09d50 0x560518e0c170 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518e05540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518dfdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3214314175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518dfe500 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 >> 172.21.15.6:0/3214314175 conn(0x560518d52c80 msgr2=0x560518de97f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f17fffff700 0 client.30242 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 shutdown_connections 2023-09-13T10:01:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.903+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3214314175 wait complete. 2023-09-13T10:01:11.934 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.906+0000 7f1832e3bb80 20 client.30242 trim_cache size 0 max 16384 2023-09-13T10:01:11.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 Processor -- start 2023-09-13T10:01:11.944 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 -- start start 2023-09-13T10:01:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518df44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518e05500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518df8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518df0120 con 0x560518df4a00 2023-09-13T10:01:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518deb8e0 con 0x560518df5700 2023-09-13T10:01:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518dfec40 con 0x560518df6060 2023-09-13T10:01:11.946 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518df44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518df44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47272/0 (socket says 172.21.15.6:47272) 2023-09-13T10:01:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18249f2700 1 -- 172.21.15.6:0/3896643724 learned_addr learned my addr 172.21.15.6:0/3896643724 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f1817fff700 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518e05500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.947 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18251f3700 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518df8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18249f2700 1 -- 172.21.15.6:0/3896643724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 msgr2=0x560518df8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18249f2700 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518df8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18249f2700 1 -- 172.21.15.6:0/3896643724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 msgr2=0x560518e05500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.927+0000 7f18249f2700 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518e05500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.948 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.928+0000 7f18249f2700 1 -- 172.21.15.6:0/3896643724 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560518b72de0 con 0x560518df4a00 2023-09-13T10:01:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.928+0000 7f18249f2700 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518df44c0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f181c095fe0 tx=0x7f181c003710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d71fecef884a3f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.928+0000 7f18077fe700 1 -- 172.21.15.6:0/3896643724 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0a1660 con 0x560518df4a00 2023-09-13T10:01:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.928+0000 7f18077fe700 1 -- 172.21.15.6:0/3896643724 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f181c09d170 con 0x560518df4a00 2023-09-13T10:01:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.928+0000 7f18077fe700 1 -- 172.21.15.6:0/3896643724 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c099a30 con 0x560518df4a00 2023-09-13T10:01:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3896643724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 msgr2=0x560518df44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518df44c0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7f181c095fe0 tx=0x7f181c003710 comp rx=0 tx=0).stop 2023-09-13T10:01:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3896643724 shutdown_connections 2023-09-13T10:01:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df6060 0x560518df8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.950 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518df44c0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/3896643724 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df5700 0x560518e05500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3896643724 >> 172.21.15.6:0/3896643724 conn(0x560518d52c80 msgr2=0x560518dfdf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3896643724 shutdown_connections 2023-09-13T10:01:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 -- 172.21.15.6:0/3896643724 wait complete. 2023-09-13T10:01:11.951 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 -- start start 2023-09-13T10:01:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.929+0000 7f1832e3bb80 1 Processor -- start 2023-09-13T10:01:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518e009f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df5700 0x560518e00f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1832e3bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 0x560518e03f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518e04490 con 0x560518df4a00 2023-09-13T10:01:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518e04600 con 0x560518df6060 2023-09-13T10:01:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1832e3bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560518e047c0 con 0x560518df5700 2023-09-13T10:01:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1832e3bb80 10 client.0 _ll_register_callbacks cb 0x560518def570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518e009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518e009f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47278/0 (socket says 172.21.15.6:47278) 2023-09-13T10:01:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 -- 172.21.15.6:0/1041551621 learned_addr learned my addr 172.21.15.6:0/1041551621 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18251f3700 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 0x560518e03f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f1817fff700 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df5700 0x560518e00f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 -- 172.21.15.6:0/1041551621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df5700 msgr2=0x560518e00f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.954 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df5700 0x560518e00f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 -- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 msgr2=0x560518e03f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 0x560518e03f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 -- 172.21.15.6:0/1041551621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560518bc6630 con 0x560518df4a00 2023-09-13T10:01:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f18249f2700 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518e009f0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f181c0952f0 tx=0x7f181c097980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe45deb2412b8e0e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:11.955 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f17fffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.930+0000 7f17fffff700 1 -- 172.21.15.6:0/1041551621 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f181c0a1660 con 0x560518df4a00 2023-09-13T10:01:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f17fffff700 1 -- 172.21.15.6:0/1041551621 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f181c0652c0 con 0x560518df4a00 2023-09-13T10:01:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f181c0ace90 con 0x560518df4a00 2023-09-13T10:01:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f17fffff700 1 -- 172.21.15.6:0/1041551621 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f181c084290 con 0x560518df4a00 2023-09-13T10:01:11.956 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 10 client.21051 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:11.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x560518b5bc60 con 0x560518df4a00 2023-09-13T10:01:11.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f17fffff700 1 -- 172.21.15.6:0/1041551621 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f181c07d070 con 0x560518df4a00 2023-09-13T10:01:11.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f17fffff700 1 -- 172.21.15.6:0/1041551621 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f181c0a1150 con 0x560518df4a00 2023-09-13T10:01:11.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 10 client.21051 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:11.957 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 10 client.21051 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:01:11.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 20 client.21051 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:11.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e5deb0 0x560518e602a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:11.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 4 client.21051 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:11.958 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x560518d00050 con 0x560518e5deb0 2023-09-13T10:01:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.931+0000 7f1817fff700 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e5deb0 0x560518e602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.932+0000 7f17fffff700 10 client.21051 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.932+0000 7f1817fff700 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e5deb0 0x560518e602a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=1d772af97f70787f server_cookie=45e686b42b925a54 in_seq=0 out_seq=0 2023-09-13T10:01:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.935+0000 7f17fffff700 1 -- 172.21.15.6:0/1041551621 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x560518d00050 con 0x560518e5deb0 2023-09-13T10:01:11.959 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.935+0000 7f17fffff700 10 client.21051 handle_command_reply: tid=0 2023-09-13T10:01:11.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.935+0000 7f1832e3bb80 1 client.21051 shutdown 2023-09-13T10:01:11.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 msgr2=0x560518e009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518e009f0 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7f181c0952f0 tx=0x7f181c097980 comp rx=0 tx=0).stop 2023-09-13T10:01:11.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 shutdown_connections 2023-09-13T10:01:11.960 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x560518e5deb0 0x560518e602a0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560518df6060 0x560518e03f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f17fffff700 0 client.21051 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:11.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560518df4a00 0x560518e009f0 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.961 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 --2- 172.21.15.6:0/1041551621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560518df5700 0x560518e00f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 >> 172.21.15.6:0/1041551621 conn(0x560518d52c80 msgr2=0x560518dfdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 shutdown_connections 2023-09-13T10:01:11.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.937+0000 7f1832e3bb80 1 -- 172.21.15.6:0/1041551621 wait complete. 2023-09-13T10:01:11.962 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.938+0000 7f1832e3bb80 20 client.21051 trim_cache size 0 max 16384 2023-09-13T10:01:11.963 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18080a0640 msgr2=0x7f18080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18080a0640 0x7f18080a2b00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f1810009c60 tx=0x7f1810009260 comp rx=0 tx=0).stop 2023-09-13T10:01:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18200fff20 msgr2=0x7f1820103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18200fff20 0x7f1820103f80 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f181c00e970 tx=0x7f181c00ec80 comp rx=0 tx=0).stop 2023-09-13T10:01:11.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 shutdown_connections 2023-09-13T10:01:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18201012d0 0x7f1820102b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f18080a0640 0x7f18080a2b00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f18200fff20 0x7f1820103f80 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 --2- 172.21.15.6:0/1074786341 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f18201008e0 0x7f18201025c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:11.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 >> 172.21.15.6:0/1074786341 conn(0x7f18200fa9b0 msgr2=0x7f18200fcbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:11.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 shutdown_connections 2023-09-13T10:01:11.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:11.941+0000 7f1826c56700 1 -- 172.21.15.6:0/1074786341 wait complete. 2023-09-13T10:01:11.967 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T10:01:12.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 -- 172.21.15.6:0/729648852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484101850 msgr2=0x7f5484108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 --2- 172.21.15.6:0/729648852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484101850 0x7f5484108100 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f547c009f90 tx=0x7f547c00b330 comp rx=0 tx=0).stop 2023-09-13T10:01:12.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 -- 172.21.15.6:0/729648852 shutdown_connections 2023-09-13T10:01:12.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 --2- 172.21.15.6:0/729648852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484101850 0x7f5484108100 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 --2- 172.21.15.6:0/729648852 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f54840ffcc0 0x7f54841000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 --2- 172.21.15.6:0/729648852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5484100eb0 0x7f5484101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 -- 172.21.15.6:0/729648852 >> 172.21.15.6:0/729648852 conn(0x7f54840fb250 msgr2=0x7f54840fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 -- 172.21.15.6:0/729648852 shutdown_connections 2023-09-13T10:01:12.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.138+0000 7f5488cf7700 1 -- 172.21.15.6:0/729648852 wait complete. 2023-09-13T10:01:12.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 Processor -- start 2023-09-13T10:01:12.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 -- start start 2023-09-13T10:01:12.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54840ffcc0 0x7f54841949a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484100eb0 0x7f5484194ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5484101850 0x7f548419bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548419c520 con 0x7f54840ffcc0 2023-09-13T10:01:12.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548419c660 con 0x7f5484101850 2023-09-13T10:01:12.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.139+0000 7f5488cf7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f548419c7f0 con 0x7f5484100eb0 2023-09-13T10:01:12.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54840ffcc0 0x7f54841949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54840ffcc0 0x7f54841949a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47292/0 (socket says 172.21.15.6:47292) 2023-09-13T10:01:12.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 -- 172.21.15.6:0/3496604798 learned_addr learned my addr 172.21.15.6:0/3496604798 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f5482d9d700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5484101850 0x7f548419bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f5481d9b700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484100eb0 0x7f5484194ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 -- 172.21.15.6:0/3496604798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484100eb0 msgr2=0x7f5484194ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484100eb0 0x7f5484194ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 -- 172.21.15.6:0/3496604798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5484101850 msgr2=0x7f548419bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5484101850 0x7f548419bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 -- 172.21.15.6:0/3496604798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54780095f0 con 0x7f54840ffcc0 2023-09-13T10:01:12.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f5481d9b700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484100eb0 0x7f5484194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:01:12.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f5482d9d700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5484101850 0x7f548419bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f548259c700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54840ffcc0 0x7f54841949a0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f547400d980 tx=0x7f547400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f54737fe700 1 -- 172.21.15.6:0/3496604798 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547400b950 con 0x7f54840ffcc0 2023-09-13T10:01:12.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.140+0000 7f54737fe700 1 -- 172.21.15.6:0/3496604798 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5474007620 con 0x7f54840ffcc0 2023-09-13T10:01:12.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.141+0000 7f54737fe700 1 -- 172.21.15.6:0/3496604798 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f547400f3c0 con 0x7f54840ffcc0 2023-09-13T10:01:12.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.141+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f547c009c40 con 0x7f54840ffcc0 2023-09-13T10:01:12.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.142+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548419cdd0 con 0x7f54840ffcc0 2023-09-13T10:01:12.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.144+0000 7f54737fe700 1 -- 172.21.15.6:0/3496604798 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5474010640 con 0x7f54840ffcc0 2023-09-13T10:01:12.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.145+0000 7f54737fe700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f546c0a2850 0x7f546c0a4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.145+0000 7f54737fe700 1 -- 172.21.15.6:0/3496604798 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f54740cbc10 con 0x7f54840ffcc0 2023-09-13T10:01:12.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.145+0000 7f5481d9b700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f546c0a2850 0x7f546c0a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5481d9b700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f546c0a2850 0x7f546c0a4d10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5478005fd0 tx=0x7f5478009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 Processor -- start 2023-09-13T10:01:12.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 -- start start 2023-09-13T10:01:12.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x560239516f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 0x5602395158d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239515e10 0x560239516270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023946a780 con 0x560239517470 2023-09-13T10:01:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602394680a0 con 0x560239516b10 2023-09-13T10:01:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5494edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560239463990 con 0x560239515e10 2023-09-13T10:01:12.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f548259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x560239516f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f548259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x560239516f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40824/0 (socket says 172.21.15.6:40824) 2023-09-13T10:01:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f548259c700 1 -- 172.21.15.6:0/152591368 learned_addr learned my addr 172.21.15.6:0/152591368 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.146+0000 7f5482d9d700 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239515e10 0x560239516270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f5481d9b700 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 0x5602395158d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f548259c700 1 -- 172.21.15.6:0/152591368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239515e10 msgr2=0x560239516270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f548259c700 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239515e10 0x560239516270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f548259c700 1 -- 172.21.15.6:0/152591368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 msgr2=0x5602395158d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f548259c700 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 0x5602395158d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f548259c700 1 -- 172.21.15.6:0/152591368 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5602392e3630 con 0x560239516b10 2023-09-13T10:01:12.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f548259c700 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x560239516f30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54740a0ef0 tx=0x7f5474099020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33236023e26cee29 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f5470ff9700 1 -- 172.21.15.6:0/152591368 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740840b0 con 0x560239516b10 2023-09-13T10:01:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f5470ff9700 1 -- 172.21.15.6:0/152591368 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f547401a3b0 con 0x560239516b10 2023-09-13T10:01:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.147+0000 7f5470ff9700 1 -- 172.21.15.6:0/152591368 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740988a0 con 0x560239516b10 2023-09-13T10:01:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 -- 172.21.15.6:0/152591368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 msgr2=0x560239516f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.160 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x560239516f30 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f54740a0ef0 tx=0x7f5474099020 comp rx=0 tx=0).stop 2023-09-13T10:01:12.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 -- 172.21.15.6:0/152591368 shutdown_connections 2023-09-13T10:01:12.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239515e10 0x560239516270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x560239516f30 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 --2- 172.21.15.6:0/152591368 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 0x5602395158d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 -- 172.21.15.6:0/152591368 >> 172.21.15.6:0/152591368 conn(0x56023946fc80 msgr2=0x56023950bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.161 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 -- 172.21.15.6:0/152591368 shutdown_connections 2023-09-13T10:01:12.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.148+0000 7f5494edcb80 1 -- 172.21.15.6:0/152591368 wait complete. 2023-09-13T10:01:12.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 -- start start 2023-09-13T10:01:12.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 Processor -- start 2023-09-13T10:01:12.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239515e10 0x56023951f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x56023951f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 0x560239526920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560239401bb0 con 0x560239517470 2023-09-13T10:01:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602394018b0 con 0x560239515e10 2023-09-13T10:01:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5602392e5920 con 0x560239516b10 2023-09-13T10:01:12.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.149+0000 7f5494edcb80 10 client.0 _ll_register_callbacks cb 0x5602393ff680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239515e10 0x56023951f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239515e10 0x56023951f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40830/0 (socket says 172.21.15.6:40830) 2023-09-13T10:01:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 -- 172.21.15.6:0/828284996 learned_addr learned my addr 172.21.15.6:0/828284996 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f5481d9b700 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x56023951f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 -- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 msgr2=0x56023951f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.164 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x56023951f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 -- 172.21.15.6:0/828284996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 msgr2=0x560239526920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 0x560239526920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 -- 172.21.15.6:0/828284996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f548419cdd0 con 0x560239515e10 2023-09-13T10:01:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f5481d9b700 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x56023951f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f548259c700 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239515e10 0x56023951f3a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54740990b0 tx=0x7f5474084160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b9318fd5e50a85e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f5469ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:12.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f5469ffb700 1 -- 172.21.15.6:0/828284996 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740b5070 con 0x560239515e10 2023-09-13T10:01:12.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f5469ffb700 1 -- 172.21.15.6:0/828284996 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5474099ab0 con 0x560239515e10 2023-09-13T10:01:12.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.150+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560239504670 con 0x560239515e10 2023-09-13T10:01:12.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5469ffb700 1 -- 172.21.15.6:0/828284996 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f54740651a0 con 0x560239515e10 2023-09-13T10:01:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 10 client.30260 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56023947b7a0 con 0x560239515e10 2023-09-13T10:01:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5469ffb700 1 -- 172.21.15.6:0/828284996 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x560239504670 con 0x560239515e10 2023-09-13T10:01:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5469ffb700 1 -- 172.21.15.6:0/828284996 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f54740a0f90 con 0x560239515e10 2023-09-13T10:01:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 10 client.30260 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 10 client.30260 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 20 client.30260 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023952acf0 0x56023952d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 4 client.30260 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56023945c970 con 0x56023952acf0 2023-09-13T10:01:12.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.151+0000 7f5481d9b700 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023952acf0 0x56023952d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.152+0000 7f5469ffb700 10 client.30260 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.152+0000 7f5481d9b700 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023952acf0 0x56023952d110 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2584aa883b9d8d18 server_cookie=c7ab835dfbd07079 in_seq=0 out_seq=0 2023-09-13T10:01:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5469ffb700 1 -- 172.21.15.6:0/828284996 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56023945c970 con 0x56023952acf0 2023-09-13T10:01:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5469ffb700 10 client.30260 handle_command_reply: tid=0 2023-09-13T10:01:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 client.30260 shutdown 2023-09-13T10:01:12.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239515e10 msgr2=0x56023951f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239515e10 0x56023951f3a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f54740990b0 tx=0x7f5474084160 comp rx=0 tx=0).stop 2023-09-13T10:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 shutdown_connections 2023-09-13T10:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023952acf0 0x56023952d110 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239517470 0x560239526920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5469ffb700 0 client.30260 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239515e10 0x56023951f3a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 --2- 172.21.15.6:0/828284996 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x56023951f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 >> 172.21.15.6:0/828284996 conn(0x56023946fc80 msgr2=0x5602395067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 shutdown_connections 2023-09-13T10:01:12.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 1 -- 172.21.15.6:0/828284996 wait complete. 2023-09-13T10:01:12.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.153+0000 7f5494edcb80 20 client.30260 trim_cache size 0 max 16384 2023-09-13T10:01:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 Processor -- start 2023-09-13T10:01:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 -- start start 2023-09-13T10:01:12.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x56023951dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x5602395268e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239517470 0x560239519dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023951ef40 con 0x560239515e10 2023-09-13T10:01:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56023951db20 con 0x560239516b10 2023-09-13T10:01:12.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.171+0000 7f5494edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560239504430 con 0x560239517470 2023-09-13T10:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x56023951dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f5481d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x5602395268e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x56023951dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47314/0 (socket says 172.21.15.6:47314) 2023-09-13T10:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 -- 172.21.15.6:0/1633550374 learned_addr learned my addr 172.21.15.6:0/1633550374 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f5482d9d700 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239517470 0x560239519dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 -- 172.21.15.6:0/1633550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239517470 msgr2=0x560239519dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239517470 0x560239519dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 -- 172.21.15.6:0/1633550374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 msgr2=0x5602395268e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x5602395268e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 -- 172.21.15.6:0/1633550374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56023928fde0 con 0x560239515e10 2023-09-13T10:01:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f5481d9b700 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x5602395268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f548259c700 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x56023951dff0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f5474098f60 tx=0x7f5474099020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bc3783a4d077103 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f54717fa700 1 -- 172.21.15.6:0/1633550374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740651a0 con 0x560239515e10 2023-09-13T10:01:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f54717fa700 1 -- 172.21.15.6:0/1633550374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5474099ab0 con 0x560239515e10 2023-09-13T10:01:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.172+0000 7f54717fa700 1 -- 172.21.15.6:0/1633550374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54740a0f90 con 0x560239515e10 2023-09-13T10:01:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 -- 172.21.15.6:0/1633550374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 msgr2=0x56023951dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x56023951dff0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f5474098f60 tx=0x7f5474099020 comp rx=0 tx=0).stop 2023-09-13T10:01:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 -- 172.21.15.6:0/1633550374 shutdown_connections 2023-09-13T10:01:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239517470 0x560239519dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x56023951dff0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 --2- 172.21.15.6:0/1633550374 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239516b10 0x5602395268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 -- 172.21.15.6:0/1633550374 >> 172.21.15.6:0/1633550374 conn(0x56023946fc80 msgr2=0x56023950be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 -- 172.21.15.6:0/1633550374 shutdown_connections 2023-09-13T10:01:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.173+0000 7f5494edcb80 1 -- 172.21.15.6:0/1633550374 wait complete. 2023-09-13T10:01:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 -- start start 2023-09-13T10:01:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 Processor -- start 2023-09-13T10:01:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x5602395223a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x5602395228e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239517470 0x560239525900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560239525e40 con 0x560239515e10 2023-09-13T10:01:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560239525fb0 con 0x560239517470 2023-09-13T10:01:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560239526170 con 0x560239516b10 2023-09-13T10:01:12.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5494edcb80 10 client.0 _ll_register_callbacks cb 0x5602393ff680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5481d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x5602395228e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5481d9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x5602395228e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50374/0 (socket says 172.21.15.6:50374) 2023-09-13T10:01:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5481d9b700 1 -- 172.21.15.6:0/3664017356 learned_addr learned my addr 172.21.15.6:0/3664017356 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f5482d9d700 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239517470 0x560239525900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.174+0000 7f548259c700 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x5602395223a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5481d9b700 1 -- 172.21.15.6:0/3664017356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239517470 msgr2=0x560239525900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5481d9b700 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239517470 0x560239525900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5481d9b700 1 -- 172.21.15.6:0/3664017356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 msgr2=0x5602395223a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5481d9b700 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x5602395223a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5481d9b700 1 -- 172.21.15.6:0/3664017356 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5478012920 con 0x560239516b10 2023-09-13T10:01:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5481d9b700 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x5602395228e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5478009d90 tx=0x7f54780047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb3002202cfb12b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5469ffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5469ffb700 1 -- 172.21.15.6:0/3664017356 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5478025040 con 0x560239516b10 2023-09-13T10:01:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f547401a3b0 con 0x560239516b10 2023-09-13T10:01:12.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5469ffb700 1 -- 172.21.15.6:0/3664017356 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5478018070 con 0x560239516b10 2023-09-13T10:01:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5469ffb700 1 -- 172.21.15.6:0/3664017356 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5478004220 con 0x560239516b10 2023-09-13T10:01:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5494edcb80 10 client.30262 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.175+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56023947b7a0 con 0x560239516b10 2023-09-13T10:01:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5469ffb700 1 -- 172.21.15.6:0/3664017356 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f547401a3b0 con 0x560239516b10 2023-09-13T10:01:12.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5469ffb700 1 -- 172.21.15.6:0/3664017356 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f54780038e0 con 0x560239516b10 2023-09-13T10:01:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5494edcb80 10 client.30262 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5494edcb80 10 client.30262 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:01:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5494edcb80 20 client.30262 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5494edcb80 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023957f8f0 0x560239581d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5494edcb80 4 client.30262 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:12.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56023941d050 con 0x56023957f8f0 2023-09-13T10:01:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f548259c700 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023957f8f0 0x560239581d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f5469ffb700 10 client.30262 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.176+0000 7f548259c700 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023957f8f0 0x560239581d10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=5938f189ee12df4 server_cookie=87eb7b32ca1ecb0f in_seq=0 out_seq=0 2023-09-13T10:01:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5469ffb700 1 -- 172.21.15.6:0/3664017356 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56023941d050 con 0x56023957f8f0 2023-09-13T10:01:12.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5469ffb700 10 client.30262 handle_command_reply: tid=0 2023-09-13T10:01:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 client.30262 shutdown 2023-09-13T10:01:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 msgr2=0x5602395228e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x5602395228e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5478009d90 tx=0x7f54780047c0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 shutdown_connections 2023-09-13T10:01:12.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x56023957f8f0 0x560239581d10 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560239517470 0x560239525900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560239515e10 0x5602395223a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 --2- 172.21.15.6:0/3664017356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560239516b10 0x5602395228e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 >> 172.21.15.6:0/3664017356 conn(0x56023946fc80 msgr2=0x56023951dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5469ffb700 0 client.30262 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:12.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 shutdown_connections 2023-09-13T10:01:12.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 1 -- 172.21.15.6:0/3664017356 wait complete. 2023-09-13T10:01:12.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.177+0000 7f5494edcb80 20 client.30262 trim_cache size 0 max 16384 2023-09-13T10:01:12.194 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:12.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f546c0a2850 msgr2=0x7f546c0a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f546c0a2850 0x7f546c0a4d10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f5478005fd0 tx=0x7f5478009310 comp rx=0 tx=0).stop 2023-09-13T10:01:12.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54840ffcc0 msgr2=0x7f54841949a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54840ffcc0 0x7f54841949a0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f547400d980 tx=0x7f547400dc90 comp rx=0 tx=0).stop 2023-09-13T10:01:12.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 shutdown_connections 2023-09-13T10:01:12.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5484101850 0x7f548419bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f546c0a2850 0x7f546c0a4d10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f54840ffcc0 0x7f54841949a0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 --2- 172.21.15.6:0/3496604798 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5484100eb0 0x7f5484194ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 >> 172.21.15.6:0/3496604798 conn(0x7f54840fb250 msgr2=0x7f5484104300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 shutdown_connections 2023-09-13T10:01:12.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.178+0000 7f5488cf7700 1 -- 172.21.15.6:0/3496604798 wait complete. 2023-09-13T10:01:12.199 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T10:01:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 -- 172.21.15.6:0/3451706696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104b20 msgr2=0x7effa810b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 --2- 172.21.15.6:0/3451706696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104b20 0x7effa810b3d0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7effa000b0d0 tx=0x7effa000b3e0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 -- 172.21.15.6:0/3451706696 shutdown_connections 2023-09-13T10:01:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 --2- 172.21.15.6:0/3451706696 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104b20 0x7effa810b3d0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 --2- 172.21.15.6:0/3451706696 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 0x7effa81033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 --2- 172.21.15.6:0/3451706696 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effa8104180 0x7effa81045e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 -- 172.21.15.6:0/3451706696 >> 172.21.15.6:0/3451706696 conn(0x7effa80fe500 msgr2=0x7effa8100940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 -- 172.21.15.6:0/3451706696 shutdown_connections 2023-09-13T10:01:12.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.369+0000 7effacb44700 1 -- 172.21.15.6:0/3451706696 wait complete. 2023-09-13T10:01:12.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 Processor -- start 2023-09-13T10:01:12.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 -- start start 2023-09-13T10:01:12.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 0x7effa8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104180 0x7effa81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effa8104b20 0x7effa81a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81a08e0 con 0x7effa8104180 2023-09-13T10:01:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81a0a50 con 0x7effa8102f90 2023-09-13T10:01:12.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effacb44700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effa81a0c10 con 0x7effa8104b20 2023-09-13T10:01:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effa659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 0x7effa8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104180 0x7effa81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effa659c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 0x7effa8198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40858/0 (socket says 172.21.15.6:40858) 2023-09-13T10:01:12.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104180 0x7effa81992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47336/0 (socket says 172.21.15.6:47336) 2023-09-13T10:01:12.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effa659c700 1 -- 172.21.15.6:0/1904855891 learned_addr learned my addr 172.21.15.6:0/1904855891 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.370+0000 7effa6d9d700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effa8104b20 0x7effa81a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa5d9b700 1 -- 172.21.15.6:0/1904855891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effa8104b20 msgr2=0x7effa81a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa5d9b700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effa8104b20 0x7effa81a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa5d9b700 1 -- 172.21.15.6:0/1904855891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 msgr2=0x7effa8198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa5d9b700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 0x7effa8198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa5d9b700 1 -- 172.21.15.6:0/1904855891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effa0009d00 con 0x7effa8104180 2023-09-13T10:01:12.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa6d9d700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effa8104b20 0x7effa81a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa659c700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 0x7effa8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effa5d9b700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104180 0x7effa81992e0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e9f0 tx=0x7eff9c00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7eff977fe700 1 -- 172.21.15.6:0/1904855891 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c00c9c0 con 0x7effa8104180 2023-09-13T10:01:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7eff977fe700 1 -- 172.21.15.6:0/1904855891 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff9c010430 con 0x7effa8104180 2023-09-13T10:01:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effa81a0ef0 con 0x7effa8104180 2023-09-13T10:01:12.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7eff977fe700 1 -- 172.21.15.6:0/1904855891 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c018680 con 0x7effa8104180 2023-09-13T10:01:12.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.371+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa81a1310 con 0x7effa8104180 2023-09-13T10:01:12.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.374+0000 7eff977fe700 1 -- 172.21.15.6:0/1904855891 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7eff9c010860 con 0x7effa8104180 2023-09-13T10:01:12.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.375+0000 7eff977fe700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7eff900a0640 0x7eff900a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.375+0000 7effa659c700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7eff900a0640 0x7eff900a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.375+0000 7eff977fe700 1 -- 172.21.15.6:0/1904855891 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7eff9c014070 con 0x7effa8104180 2023-09-13T10:01:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effa659c700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7eff900a0640 0x7eff900a2b00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7effa819a270 tx=0x7eff98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 Processor -- start 2023-09-13T10:01:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 -- start start 2023-09-13T10:01:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b0700 0x5619899b0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b1060 0x5619899af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899afe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x561989908780 con 0x5619899b1060 2023-09-13T10:01:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619899060a0 con 0x5619899b0700 2023-09-13T10:01:12.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.376+0000 7effb8d29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561989901990 con 0x5619899afa00 2023-09-13T10:01:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b1060 0x5619899af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b1060 0x5619899af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47344/0 (socket says 172.21.15.6:47344) 2023-09-13T10:01:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 -- 172.21.15.6:0/3933635969 learned_addr learned my addr 172.21.15.6:0/3933635969 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa659c700 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b0700 0x5619899b0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 -- 172.21.15.6:0/3933635969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 msgr2=0x5619899afe80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899afe80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 -- 172.21.15.6:0/3933635969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b0700 msgr2=0x5619899b0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b0700 0x5619899b0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 -- 172.21.15.6:0/3933635969 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561989781630 con 0x5619899b1060 2023-09-13T10:01:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa659c700 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b0700 0x5619899b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.377+0000 7effa5d9b700 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b1060 0x5619899af4c0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c5b0 tx=0x7eff9c099080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2bdc944c8de4813 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.378+0000 7eff94ff9700 1 -- 172.21.15.6:0/3933635969 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c09d120 con 0x5619899b1060 2023-09-13T10:01:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.378+0000 7eff94ff9700 1 -- 172.21.15.6:0/3933635969 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff9c099bc0 con 0x5619899b1060 2023-09-13T10:01:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.378+0000 7eff94ff9700 1 -- 172.21.15.6:0/3933635969 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c0105a0 con 0x5619899b1060 2023-09-13T10:01:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.379+0000 7effb8d29b80 1 -- 172.21.15.6:0/3933635969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b1060 msgr2=0x5619899af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.379+0000 7effb8d29b80 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b1060 0x5619899af4c0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00c5b0 tx=0x7eff9c099080 comp rx=0 tx=0).stop 2023-09-13T10:01:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.379+0000 7effb8d29b80 1 -- 172.21.15.6:0/3933635969 shutdown_connections 2023-09-13T10:01:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.379+0000 7effb8d29b80 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899afe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.379+0000 7effb8d29b80 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b0700 0x5619899b0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.379+0000 7effb8d29b80 1 --2- 172.21.15.6:0/3933635969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b1060 0x5619899af4c0 unknown :-1 s=CLOSED pgs=1873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.379+0000 7effb8d29b80 1 -- 172.21.15.6:0/3933635969 >> 172.21.15.6:0/3933635969 conn(0x56198990dc80 msgr2=0x5619899a9f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.380+0000 7effb8d29b80 1 -- 172.21.15.6:0/3933635969 shutdown_connections 2023-09-13T10:01:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.380+0000 7effb8d29b80 1 -- 172.21.15.6:0/3933635969 wait complete. 2023-09-13T10:01:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.380+0000 7effb8d29b80 1 -- start start 2023-09-13T10:01:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.380+0000 7effb8d29b80 1 Processor -- start 2023-09-13T10:01:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effb8d29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198989fbb0 con 0x5619899b0700 2023-09-13T10:01:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effb8d29b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56198989f8b0 con 0x5619899b1060 2023-09-13T10:01:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effb8d29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x561989783920 con 0x5619899afa00 2023-09-13T10:01:12.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effb8d29b80 10 client.0 _ll_register_callbacks cb 0x56198989d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50400/0 (socket says 172.21.15.6:50400) 2023-09-13T10:01:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa659c700 1 -- 172.21.15.6:0/1046685183 learned_addr learned my addr 172.21.15.6:0/1046685183 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa5d9b700 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa6d9d700 1 -- 172.21.15.6:0/1046685183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 msgr2=0x5619899c1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa6d9d700 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa6d9d700 1 -- 172.21.15.6:0/1046685183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 msgr2=0x5619899c1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa6d9d700 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa6d9d700 1 -- 172.21.15.6:0/1046685183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effa81a1310 con 0x5619899b1060 2023-09-13T10:01:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7effa6d9d700 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c8cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7effa000b770 tx=0x7effa000bcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a28d04c5265733a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.381+0000 7eff8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.382+0000 7eff8dffb700 1 -- 172.21.15.6:0/1046685183 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa000e040 con 0x5619899b1060 2023-09-13T10:01:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.382+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5619899a2670 con 0x5619899b1060 2023-09-13T10:01:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.382+0000 7eff8dffb700 1 -- 172.21.15.6:0/1046685183 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7effa000be40 con 0x5619899b1060 2023-09-13T10:01:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.382+0000 7eff8dffb700 1 -- 172.21.15.6:0/1046685183 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7effa0005a80 con 0x5619899b1060 2023-09-13T10:01:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.382+0000 7effb8d29b80 10 client.30278 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.382+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x5619899197a0 con 0x5619899b1060 2023-09-13T10:01:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.382+0000 7eff8dffb700 1 -- 172.21.15.6:0/1046685183 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5619899a2670 con 0x5619899b1060 2023-09-13T10:01:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.383+0000 7eff8dffb700 1 -- 172.21.15.6:0/1046685183 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7effa0019070 con 0x5619899b1060 2023-09-13T10:01:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.383+0000 7effb8d29b80 10 client.30278 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.383+0000 7effb8d29b80 10 client.30278 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:01:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.383+0000 7effb8d29b80 20 client.30278 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.383+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5619899cd4f0 0x5619899cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.383+0000 7effb8d29b80 4 client.30278 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.383+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5619898fa970 con 0x5619899cd4f0 2023-09-13T10:01:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.384+0000 7effa659c700 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5619899cd4f0 0x5619899cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.384+0000 7eff8dffb700 10 client.30278 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.384+0000 7effa659c700 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5619899cd4f0 0x5619899cf910 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ea324d70f02ef807 server_cookie=34a71a633acf4492 in_seq=0 out_seq=0 2023-09-13T10:01:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.385+0000 7eff8dffb700 1 -- 172.21.15.6:0/1046685183 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5619898fa970 con 0x5619899cd4f0 2023-09-13T10:01:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.385+0000 7eff8dffb700 10 client.30278 handle_command_reply: tid=0 2023-09-13T10:01:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.385+0000 7effb8d29b80 1 client.30278 shutdown 2023-09-13T10:01:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.385+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 msgr2=0x5619899c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.385+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c8cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7effa000b770 tx=0x7effa000bcd0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 shutdown_connections 2023-09-13T10:01:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x5619899cd4f0 0x5619899cf910 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c8cd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7eff8dffb700 0 client.30278 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1046685183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 >> 172.21.15.6:0/1046685183 conn(0x56198990dc80 msgr2=0x5619899a47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 shutdown_connections 2023-09-13T10:01:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.386+0000 7effb8d29b80 1 -- 172.21.15.6:0/1046685183 wait complete. 2023-09-13T10:01:12.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.387+0000 7effb8d29b80 20 client.30278 trim_cache size 0 max 16384 2023-09-13T10:01:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.410+0000 7effb8d29b80 1 Processor -- start 2023-09-13T10:01:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.410+0000 7effb8d29b80 1 -- start start 2023-09-13T10:01:12.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899afa00 0x5619899af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899b1060 0x5619899c1500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effb8d29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619899c12c0 con 0x5619899b0700 2023-09-13T10:01:12.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effb8d29b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619899ab100 con 0x5619899afa00 2023-09-13T10:01:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effb8d29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619899a68e0 con 0x5619899b1060 2023-09-13T10:01:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47354/0 (socket says 172.21.15.6:47354) 2023-09-13T10:01:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 -- 172.21.15.6:0/915411447 learned_addr learned my addr 172.21.15.6:0/915411447 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa659c700 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899afa00 0x5619899af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa6d9d700 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899b1060 0x5619899c1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 -- 172.21.15.6:0/915411447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899b1060 msgr2=0x5619899c1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899b1060 0x5619899c1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 -- 172.21.15.6:0/915411447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899afa00 msgr2=0x5619899af4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899afa00 0x5619899af4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 -- 172.21.15.6:0/915411447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619899b00b0 con 0x5619899b0700 2023-09-13T10:01:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa659c700 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899afa00 0x5619899af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.411+0000 7effa5d9b700 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c8c90 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7eff9c099170 tx=0x7eff9c010c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc3241439df07e7c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7eff957fa700 1 -- 172.21.15.6:0/915411447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c09d120 con 0x5619899b0700 2023-09-13T10:01:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7eff957fa700 1 -- 172.21.15.6:0/915411447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff9c0994c0 con 0x5619899b0700 2023-09-13T10:01:12.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7eff957fa700 1 -- 172.21.15.6:0/915411447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff9c010690 con 0x5619899b0700 2023-09-13T10:01:12.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 -- 172.21.15.6:0/915411447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 msgr2=0x5619899c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c8c90 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7eff9c099170 tx=0x7eff9c010c60 comp rx=0 tx=0).stop 2023-09-13T10:01:12.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 -- 172.21.15.6:0/915411447 shutdown_connections 2023-09-13T10:01:12.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899b1060 0x5619899c1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899afa00 0x5619899af4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 --2- 172.21.15.6:0/915411447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c8c90 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 -- 172.21.15.6:0/915411447 >> 172.21.15.6:0/915411447 conn(0x56198990dc80 msgr2=0x5619899c95c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 -- 172.21.15.6:0/915411447 shutdown_connections 2023-09-13T10:01:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.412+0000 7effb8d29b80 1 -- 172.21.15.6:0/915411447 wait complete. 2023-09-13T10:01:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 -- start start 2023-09-13T10:01:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 Processor -- start 2023-09-13T10:01:12.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c4b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619899c80d0 con 0x5619899b0700 2023-09-13T10:01:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619899c8240 con 0x5619899b1060 2023-09-13T10:01:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619899c8400 con 0x5619899afa00 2023-09-13T10:01:12.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effb8d29b80 10 client.0 _ll_register_callbacks cb 0x56198989d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effa6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effa659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effa6d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40886/0 (socket says 172.21.15.6:40886) 2023-09-13T10:01:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.413+0000 7effa659c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50414/0 (socket says 172.21.15.6:50414) 2023-09-13T10:01:12.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7effa659c700 1 -- 172.21.15.6:0/1231431496 learned_addr learned my addr 172.21.15.6:0/1231431496 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7effa659c700 1 -- 172.21.15.6:0/1231431496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 msgr2=0x5619899c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7effa659c700 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7effa659c700 1 -- 172.21.15.6:0/1231431496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 msgr2=0x5619899c4b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:12.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7effa659c700 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c4b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7effa659c700 1 -- 172.21.15.6:0/1231431496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff980042f0 con 0x5619899afa00 2023-09-13T10:01:12.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7effa659c700 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c4630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff98013010 tx=0x7eff980047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcf54582a17aefe2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.414+0000 7eff8dffb700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:12.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.416+0000 7eff8dffb700 1 -- 172.21.15.6:0/1231431496 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff98024040 con 0x5619899afa00 2023-09-13T10:01:12.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.416+0000 7eff8dffb700 1 -- 172.21.15.6:0/1231431496 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7eff98003a60 con 0x5619899afa00 2023-09-13T10:01:12.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.416+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff9c099bc0 con 0x5619899afa00 2023-09-13T10:01:12.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.416+0000 7eff8dffb700 1 -- 172.21.15.6:0/1231431496 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff98029580 con 0x5619899afa00 2023-09-13T10:01:12.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.416+0000 7effb8d29b80 10 client.30277 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.416+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x561989781630 con 0x5619899afa00 2023-09-13T10:01:12.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.416+0000 7eff8dffb700 1 -- 172.21.15.6:0/1231431496 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7eff9c099bc0 con 0x5619899afa00 2023-09-13T10:01:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7eff8dffb700 1 -- 172.21.15.6:0/1231431496 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7eff9803bc70 con 0x5619899afa00 2023-09-13T10:01:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effb8d29b80 10 client.30277 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effb8d29b80 10 client.30277 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:01:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effb8d29b80 20 client.30277 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561989a21f80 0x561989a243a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effb8d29b80 4 client.30277 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5619898bb050 con 0x561989a21f80 2023-09-13T10:01:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effa5d9b700 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561989a21f80 0x561989a243a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7eff8dffb700 10 client.30277 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:12.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effa5d9b700 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561989a21f80 0x561989a243a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8490ceaa6b9f0ea9 server_cookie=1d0146fd09b25b89 in_seq=0 out_seq=0 2023-09-13T10:01:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7eff8dffb700 1 -- 172.21.15.6:0/1231431496 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5619898bb050 con 0x561989a21f80 2023-09-13T10:01:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7eff8dffb700 10 client.30277 handle_command_reply: tid=0 2023-09-13T10:01:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.417+0000 7effb8d29b80 1 client.30277 shutdown 2023-09-13T10:01:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.418+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 msgr2=0x5619899c4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.418+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c4630 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7eff98013010 tx=0x7eff980047c0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 shutdown_connections 2023-09-13T10:01:12.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x561989a21f80 0x561989a243a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5619899b1060 0x5619899c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5619899afa00 0x5619899c4630 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 --2- 172.21.15.6:0/1231431496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5619899b0700 0x5619899c4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 >> 172.21.15.6:0/1231431496 conn(0x56198990dc80 msgr2=0x5619899c1500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7eff8dffb700 0 client.30277 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:12.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 shutdown_connections 2023-09-13T10:01:12.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.419+0000 7effb8d29b80 1 -- 172.21.15.6:0/1231431496 wait complete. 2023-09-13T10:01:12.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.422+0000 7effb8d29b80 20 client.30277 trim_cache size 0 max 16384 2023-09-13T10:01:12.434 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7eff900a0640 msgr2=0x7eff900a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7eff900a0640 0x7eff900a2b00 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7effa819a270 tx=0x7eff98009260 comp rx=0 tx=0).stop 2023-09-13T10:01:12.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104180 msgr2=0x7effa81992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104180 0x7effa81992e0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7eff9c00e9f0 tx=0x7eff9c00ed00 comp rx=0 tx=0).stop 2023-09-13T10:01:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 shutdown_connections 2023-09-13T10:01:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7effa8104b20 0x7effa81a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7effa8102f90 0x7effa8198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7eff900a0640 0x7eff900a2b00 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 --2- 172.21.15.6:0/1904855891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7effa8104180 0x7effa81992e0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 >> 172.21.15.6:0/1904855891 conn(0x7effa80fe500 msgr2=0x7effa8100710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 shutdown_connections 2023-09-13T10:01:12.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.423+0000 7effacb44700 1 -- 172.21.15.6:0/1904855891 wait complete. 2023-09-13T10:01:12.439 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:12 smithi006 ceph-mon[98665]: pgmap v950: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 641 op/s 2023-09-13T10:01:12.439 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:12 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/420709501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:01:12.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T10:01:12.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:12 smithi053 ceph-mon[102373]: pgmap v950: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 641 op/s 2023-09-13T10:01:12.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:12 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/420709501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:01:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:12 smithi131 ceph-mon[102785]: pgmap v950: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 13 MiB/s wr, 641 op/s 2023-09-13T10:01:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:12 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/420709501' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:01:12.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 335446 34.22 MB/sec execute 392 sec latency 67.965 ms 2023-09-13T10:01:12.610 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 -- 172.21.15.6:0/2978871376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 msgr2=0x7f44941000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 --2- 172.21.15.6:0/2978871376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f44941000e0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f44840099c0 tx=0x7f4484009cd0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 -- 172.21.15.6:0/2978871376 shutdown_connections 2023-09-13T10:01:12.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 --2- 172.21.15.6:0/2978871376 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4494101850 0x7f4494108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 --2- 172.21.15.6:0/2978871376 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f44941000e0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 --2- 172.21.15.6:0/2978871376 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494100eb0 0x7f4494101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 -- 172.21.15.6:0/2978871376 >> 172.21.15.6:0/2978871376 conn(0x7f44940fb250 msgr2=0x7f44940fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 -- 172.21.15.6:0/2978871376 shutdown_connections 2023-09-13T10:01:12.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.609+0000 7f44989e7700 1 -- 172.21.15.6:0/2978871376 wait complete. 2023-09-13T10:01:12.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 Processor -- start 2023-09-13T10:01:12.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 -- start start 2023-09-13T10:01:12.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f4494195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4494100eb0 0x7f4494195e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494101850 0x7f449419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f449419d4d0 con 0x7f44940ffcc0 2023-09-13T10:01:12.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494068d30 con 0x7f4494101850 2023-09-13T10:01:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f44989e7700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4494068ec0 con 0x7f4494100eb0 2023-09-13T10:01:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f449259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f4494195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f449259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f4494195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47372/0 (socket says 172.21.15.6:47372) 2023-09-13T10:01:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f449259c700 1 -- 172.21.15.6:0/4293690608 learned_addr learned my addr 172.21.15.6:0/4293690608 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f4491d9b700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4494100eb0 0x7f4494195e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.610+0000 7f4492d9d700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494101850 0x7f449419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f449259c700 1 -- 172.21.15.6:0/4293690608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4494100eb0 msgr2=0x7f4494195e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f449259c700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4494100eb0 0x7f4494195e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f449259c700 1 -- 172.21.15.6:0/4293690608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494101850 msgr2=0x7f449419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f449259c700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494101850 0x7f449419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f449259c700 1 -- 172.21.15.6:0/4293690608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44840095f0 con 0x7f44940ffcc0 2023-09-13T10:01:12.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f4491d9b700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4494100eb0 0x7f4494195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f449259c700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f4494195950 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f4484009fd0 tx=0x7f4484009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f44837fe700 1 -- 172.21.15.6:0/4293690608 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448401d070 con 0x7f44940ffcc0 2023-09-13T10:01:12.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f44837fe700 1 -- 172.21.15.6:0/4293690608 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4484005030 con 0x7f44940ffcc0 2023-09-13T10:01:12.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4494069140 con 0x7f44940ffcc0 2023-09-13T10:01:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f44837fe700 1 -- 172.21.15.6:0/4293690608 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484004a90 con 0x7f44940ffcc0 2023-09-13T10:01:12.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.611+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940695f0 con 0x7f44940ffcc0 2023-09-13T10:01:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.615+0000 7f44837fe700 1 -- 172.21.15.6:0/4293690608 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f44840051a0 con 0x7f44940ffcc0 2023-09-13T10:01:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.616+0000 7f44837fe700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f447c0a0640 0x7f447c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.616+0000 7f44837fe700 1 -- 172.21.15.6:0/4293690608 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f44840cc900 con 0x7f44940ffcc0 2023-09-13T10:01:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.616+0000 7f44a4bccb80 1 Processor -- start 2023-09-13T10:01:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f44a4bccb80 1 -- start start 2023-09-13T10:01:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c238ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c239490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c239e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c191780 con 0x56275c239010 2023-09-13T10:01:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c18f0a0 con 0x56275c2399d0 2023-09-13T10:01:12.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c18a990 con 0x56275c2386b0 2023-09-13T10:01:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f4492d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c239e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c238ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c238ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50434/0 (socket says 172.21.15.6:50434) 2023-09-13T10:01:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f4492d9d700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c239e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40906/0 (socket says 172.21.15.6:40906) 2023-09-13T10:01:12.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 -- 172.21.15.6:0/847799051 learned_addr learned my addr 172.21.15.6:0/847799051 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 -- 172.21.15.6:0/847799051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 msgr2=0x56275c239e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 --2- 172.21.15.6:0/847799051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c239e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 -- 172.21.15.6:0/847799051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 msgr2=0x56275c239490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 --2- 172.21.15.6:0/847799051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c239490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.617+0000 7f449259c700 1 -- 172.21.15.6:0/847799051 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56275c00a630 con 0x56275c2386b0 2023-09-13T10:01:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.618+0000 7f449259c700 1 --2- 172.21.15.6:0/847799051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c238ad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4484096630 tx=0x7f44840965a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2838e5043da3ebb6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.618+0000 7f4480ff9700 1 -- 172.21.15.6:0/847799051 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840a0070 con 0x56275c2386b0 2023-09-13T10:01:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.618+0000 7f4480ff9700 1 -- 172.21.15.6:0/847799051 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f448409c020 con 0x56275c2386b0 2023-09-13T10:01:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.618+0000 7f4480ff9700 1 -- 172.21.15.6:0/847799051 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4484099620 con 0x56275c2386b0 2023-09-13T10:01:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.619+0000 7f44a4bccb80 1 -- 172.21.15.6:0/847799051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 msgr2=0x56275c238ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.619+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/847799051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c238ad0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4484096630 tx=0x7f44840965a0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.619+0000 7f4491d9b700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f447c0a0640 0x7f447c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.620+0000 7f4491d9b700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f447c0a0640 0x7f447c0a2b00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4488011550 tx=0x7f4488009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 -- 172.21.15.6:0/847799051 shutdown_connections 2023-09-13T10:01:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/847799051 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c239e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/847799051 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c238ad0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/847799051 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c239490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 -- 172.21.15.6:0/847799051 >> 172.21.15.6:0/847799051 conn(0x56275c196c80 msgr2=0x56275c232f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 -- 172.21.15.6:0/847799051 shutdown_connections 2023-09-13T10:01:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 -- 172.21.15.6:0/847799051 wait complete. 2023-09-13T10:01:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 -- start start 2023-09-13T10:01:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.623+0000 7f44a4bccb80 1 Processor -- start 2023-09-13T10:01:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c241ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c239010 0x56275c242020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c2399d0 0x56275c249060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c128bb0 con 0x56275c2399d0 2023-09-13T10:01:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c1288b0 con 0x56275c239010 2023-09-13T10:01:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c00c920 con 0x56275c2386b0 2023-09-13T10:01:12.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f44a4bccb80 10 client.0 _ll_register_callbacks cb 0x56275c126680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c239010 0x56275c242020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c239010 0x56275c242020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40908/0 (socket says 172.21.15.6:40908) 2023-09-13T10:01:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 -- 172.21.15.6:0/1714252783 learned_addr learned my addr 172.21.15.6:0/1714252783 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f449259c700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c241ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4492d9d700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c2399d0 0x56275c249060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 -- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 msgr2=0x56275c241ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c241ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 -- 172.21.15.6:0/1714252783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c2399d0 msgr2=0x56275c249060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c2399d0 0x56275c249060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4491d9b700 1 -- 172.21.15.6:0/1714252783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44940695f0 con 0x56275c239010 2023-09-13T10:01:12.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.624+0000 7f4492d9d700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c2399d0 0x56275c249060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:01:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f4491d9b700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c239010 0x56275c242020 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4488009c30 tx=0x7f44880047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fc375da33d0497d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f4479ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f4479ffb700 1 -- 172.21.15.6:0/1714252783 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800e730 con 0x56275c239010 2023-09-13T10:01:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f4479ffb700 1 -- 172.21.15.6:0/1714252783 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f448800e890 con 0x56275c239010 2023-09-13T10:01:12.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56275c22b670 con 0x56275c239010 2023-09-13T10:01:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f4479ffb700 1 -- 172.21.15.6:0/1714252783 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f448800ea50 con 0x56275c239010 2023-09-13T10:01:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f44a4bccb80 10 client.30296 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56275c1a27a0 con 0x56275c239010 2023-09-13T10:01:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.625+0000 7f4479ffb700 1 -- 172.21.15.6:0/1714252783 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56275c22b670 con 0x56275c239010 2023-09-13T10:01:12.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f4479ffb700 1 -- 172.21.15.6:0/1714252783 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f44880263b0 con 0x56275c239010 2023-09-13T10:01:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f44a4bccb80 10 client.30296 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f44a4bccb80 10 client.30296 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:01:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f44a4bccb80 20 client.30296 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c25e970 0x56275c260d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f44a4bccb80 4 client.30296 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56275c183970 con 0x56275c25e970 2023-09-13T10:01:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f449259c700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c25e970 0x56275c260d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f4479ffb700 10 client.30296 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:12.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.626+0000 7f449259c700 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c25e970 0x56275c260d90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5265c768e677ba78 server_cookie=4ac36da69d9b38ea in_seq=0 out_seq=0 2023-09-13T10:01:12.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f4479ffb700 1 -- 172.21.15.6:0/1714252783 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56275c183970 con 0x56275c25e970 2023-09-13T10:01:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f4479ffb700 10 client.30296 handle_command_reply: tid=0 2023-09-13T10:01:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 client.30296 shutdown 2023-09-13T10:01:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c239010 msgr2=0x56275c242020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c239010 0x56275c242020 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4488009c30 tx=0x7f44880047c0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 shutdown_connections 2023-09-13T10:01:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c25e970 0x56275c260d90 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c2399d0 0x56275c249060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c241ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1714252783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c239010 0x56275c242020 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.632+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 >> 172.21.15.6:0/1714252783 conn(0x56275c196c80 msgr2=0x56275c22d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.633+0000 7f4479ffb700 0 client.30296 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.633+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 shutdown_connections 2023-09-13T10:01:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.633+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1714252783 wait complete. 2023-09-13T10:01:12.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.633+0000 7f44a4bccb80 20 client.30296 trim_cache size 0 max 16384 2023-09-13T10:01:12.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 Processor -- start 2023-09-13T10:01:12.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 -- start start 2023-09-13T10:01:12.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2386b0 0x56275c232e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c248f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2399d0 0x56275c23c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c2416b0 con 0x56275c239010 2023-09-13T10:01:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c25bd60 con 0x56275c2386b0 2023-09-13T10:01:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c240f90 con 0x56275c2399d0 2023-09-13T10:01:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f449259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2386b0 0x56275c232e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f4491d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c248f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f449259c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2386b0 0x56275c232e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40914/0 (socket says 172.21.15.6:40914) 2023-09-13T10:01:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.651+0000 7f449259c700 1 -- 172.21.15.6:0/3959901583 learned_addr learned my addr 172.21.15.6:0/3959901583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f449259c700 1 -- 172.21.15.6:0/3959901583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2399d0 msgr2=0x56275c23c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f449259c700 1 --2- 172.21.15.6:0/3959901583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2399d0 0x56275c23c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f449259c700 1 -- 172.21.15.6:0/3959901583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 msgr2=0x56275c248f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f449259c700 1 --2- 172.21.15.6:0/3959901583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c248f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f449259c700 1 -- 172.21.15.6:0/3959901583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56275bfb6de0 con 0x56275c2386b0 2023-09-13T10:01:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f449259c700 1 --2- 172.21.15.6:0/3959901583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2386b0 0x56275c232e60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f44840ca400 tx=0x7f448401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bde196cd53638fdd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f44817fa700 1 -- 172.21.15.6:0/3959901583 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840a2110 con 0x56275c2386b0 2023-09-13T10:01:12.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f44817fa700 1 -- 172.21.15.6:0/3959901583 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f44840984d0 con 0x56275c2386b0 2023-09-13T10:01:12.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.652+0000 7f44817fa700 1 -- 172.21.15.6:0/3959901583 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44840a1c80 con 0x56275c2386b0 2023-09-13T10:01:12.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.653+0000 7f44a4bccb80 1 -- 172.21.15.6:0/3959901583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2386b0 msgr2=0x56275c232e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.653+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/3959901583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2386b0 0x56275c232e60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f44840ca400 tx=0x7f448401a040 comp rx=0 tx=0).stop 2023-09-13T10:01:12.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 -- 172.21.15.6:0/3959901583 shutdown_connections 2023-09-13T10:01:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/3959901583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2399d0 0x56275c23c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/3959901583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2386b0 0x56275c232e60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/3959901583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c248f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 -- 172.21.15.6:0/3959901583 >> 172.21.15.6:0/3959901583 conn(0x56275c196c80 msgr2=0x56275c239db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 -- 172.21.15.6:0/3959901583 shutdown_connections 2023-09-13T10:01:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 -- 172.21.15.6:0/3959901583 wait complete. 2023-09-13T10:01:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 -- start start 2023-09-13T10:01:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 Processor -- start 2023-09-13T10:01:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c246f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.655+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c2ae770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f44a4bccb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c2b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c23f5f0 con 0x56275c239010 2023-09-13T10:01:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c2b1200 con 0x56275c2399d0 2023-09-13T10:01:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f44a4bccb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56275c2b1370 con 0x56275c2386b0 2023-09-13T10:01:12.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f44a4bccb80 10 client.0 _ll_register_callbacks cb 0x56275c126680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4491d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c2ae770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4491d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c2ae770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47396/0 (socket says 172.21.15.6:47396) 2023-09-13T10:01:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4491d9b700 1 -- 172.21.15.6:0/1434340345 learned_addr learned my addr 172.21.15.6:0/1434340345 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4492d9d700 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c2b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f449259c700 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c246f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4492d9d700 1 -- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 msgr2=0x56275c246f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4492d9d700 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c246f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4492d9d700 1 -- 172.21.15.6:0/1434340345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 msgr2=0x56275c2ae770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4492d9d700 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c2ae770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.656+0000 7f4492d9d700 1 -- 172.21.15.6:0/1434340345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56275c00a630 con 0x56275c2399d0 2023-09-13T10:01:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.657+0000 7f4492d9d700 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c2b0cc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x56275c25e5c0 tx=0x7f448c006040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c20af50bb3433c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.657+0000 7f4479ffb700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f4479ffb700 1 -- 172.21.15.6:0/1434340345 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448c00e040 con 0x56275c2399d0 2023-09-13T10:01:12.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f4479ffb700 1 -- 172.21.15.6:0/1434340345 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f448c003cc0 con 0x56275c2399d0 2023-09-13T10:01:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f448409c020 con 0x56275c2399d0 2023-09-13T10:01:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f4479ffb700 1 -- 172.21.15.6:0/1434340345 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f448c003e80 con 0x56275c2399d0 2023-09-13T10:01:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 10 client.30302 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56275bf9fc60 con 0x56275c2399d0 2023-09-13T10:01:12.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f4479ffb700 1 -- 172.21.15.6:0/1434340345 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f448409c020 con 0x56275c2399d0 2023-09-13T10:01:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f4479ffb700 1 -- 172.21.15.6:0/1434340345 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f448c0045b0 con 0x56275c2399d0 2023-09-13T10:01:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 10 client.30302 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 10 client.30302 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:01:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 20 client.30302 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c2b2e70 0x56275c2b5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 4 client.30302 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.658+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56275c144050 con 0x56275c2b2e70 2023-09-13T10:01:12.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f449259c700 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c2b2e70 0x56275c2b5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f4479ffb700 10 client.30302 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:12.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f449259c700 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c2b2e70 0x56275c2b5290 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f28bec7bb6893f6 server_cookie=b9468469a4274fe1 in_seq=0 out_seq=0 2023-09-13T10:01:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f4479ffb700 1 -- 172.21.15.6:0/1434340345 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56275c144050 con 0x56275c2b2e70 2023-09-13T10:01:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f4479ffb700 10 client.30302 handle_command_reply: tid=0 2023-09-13T10:01:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f44a4bccb80 1 client.30302 shutdown 2023-09-13T10:01:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 msgr2=0x56275c2b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.659+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c2b0cc0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x56275c25e5c0 tx=0x7f448c006040 comp rx=0 tx=0).stop 2023-09-13T10:01:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 shutdown_connections 2023-09-13T10:01:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56275c2b2e70 0x56275c2b5290 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56275c2399d0 0x56275c2b0cc0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56275c2386b0 0x56275c246f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 --2- 172.21.15.6:0/1434340345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56275c239010 0x56275c2ae770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 >> 172.21.15.6:0/1434340345 conn(0x56275c196c80 msgr2=0x56275c232e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f4479ffb700 0 client.30302 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 shutdown_connections 2023-09-13T10:01:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 1 -- 172.21.15.6:0/1434340345 wait complete. 2023-09-13T10:01:12.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.660+0000 7f44a4bccb80 20 client.30302 trim_cache size 0 max 16384 2023-09-13T10:01:12.674 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f447c0a0640 msgr2=0x7f447c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f447c0a0640 0x7f447c0a2b00 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f4488011550 tx=0x7f4488009260 comp rx=0 tx=0).stop 2023-09-13T10:01:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 msgr2=0x7f4494195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f4494195950 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7f4484009fd0 tx=0x7f4484009580 comp rx=0 tx=0).stop 2023-09-13T10:01:12.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 shutdown_connections 2023-09-13T10:01:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4494101850 0x7f449419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f447c0a0640 0x7f447c0a2b00 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44940ffcc0 0x7f4494195950 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 --2- 172.21.15.6:0/4293690608 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4494100eb0 0x7f4494195e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 >> 172.21.15.6:0/4293690608 conn(0x7f44940fb250 msgr2=0x7f4494104340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 shutdown_connections 2023-09-13T10:01:12.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.663+0000 7f44989e7700 1 -- 172.21.15.6:0/4293690608 wait complete. 2023-09-13T10:01:12.682 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T10:01:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 -- 172.21.15.6:0/2004752537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4698100e80 msgr2=0x7f46981012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 --2- 172.21.15.6:0/2004752537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4698100e80 0x7f46981012e0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f468801a9d0 tx=0x7f468801ace0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 -- 172.21.15.6:0/2004752537 shutdown_connections 2023-09-13T10:01:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 --2- 172.21.15.6:0/2004752537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4698101820 0x7f46981080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 --2- 172.21.15.6:0/2004752537 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f46980ffc90 0x7f46981000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 --2- 172.21.15.6:0/2004752537 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4698100e80 0x7f46981012e0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 -- 172.21.15.6:0/2004752537 >> 172.21.15.6:0/2004752537 conn(0x7f46980fb220 msgr2=0x7f46980fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 -- 172.21.15.6:0/2004752537 shutdown_connections 2023-09-13T10:01:12.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.858+0000 7f469d5eb700 1 -- 172.21.15.6:0/2004752537 wait complete. 2023-09-13T10:01:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.859+0000 7f469d5eb700 1 Processor -- start 2023-09-13T10:01:12.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.859+0000 7f469d5eb700 1 -- start start 2023-09-13T10:01:12.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f469d5eb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46980ffc90 0x7f4698069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f469d5eb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4698100e80 0x7f46980696a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f469d5eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4698101820 0x7f4698069be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f469d5eb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698195d30 con 0x7f4698101820 2023-09-13T10:01:12.864 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f469d5eb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698195ea0 con 0x7f4698100e80 2023-09-13T10:01:12.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f469d5eb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4698196060 con 0x7f46980ffc90 2023-09-13T10:01:12.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46980ffc90 0x7f4698069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46980ffc90 0x7f4698069160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50464/0 (socket says 172.21.15.6:50464) 2023-09-13T10:01:12.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 -- 172.21.15.6:0/182841167 learned_addr learned my addr 172.21.15.6:0/182841167 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f46967fc700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4698100e80 0x7f46980696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 -- 172.21.15.6:0/182841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4698100e80 msgr2=0x7f46980696a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4698100e80 0x7f46980696a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 -- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4698101820 msgr2=0x7f4698069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4698101820 0x7f4698069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 -- 172.21.15.6:0/182841167 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f468801a600 con 0x7f46980ffc90 2023-09-13T10:01:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.860+0000 7f4696ffd700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46980ffc90 0x7f4698069160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f469000efc0 tx=0x7f469000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.861+0000 7f467ffff700 1 -- 172.21.15.6:0/182841167 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690018070 con 0x7f46980ffc90 2023-09-13T10:01:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.861+0000 7f467ffff700 1 -- 172.21.15.6:0/182841167 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f469000f040 con 0x7f46980ffc90 2023-09-13T10:01:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.861+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f469818d980 con 0x7f46980ffc90 2023-09-13T10:01:12.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.861+0000 7f467ffff700 1 -- 172.21.15.6:0/182841167 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690004310 con 0x7f46980ffc90 2023-09-13T10:01:12.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.861+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f469818dee0 con 0x7f46980ffc90 2023-09-13T10:01:12.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.866+0000 7f46a97d0b80 1 Processor -- start 2023-09-13T10:01:12.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46a97d0b80 1 -- start start 2023-09-13T10:01:12.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d48b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d474c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d47e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497ca0780 con 0x55a497d47a00 2023-09-13T10:01:12.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497c9e0a0 con 0x55a497d48700 2023-09-13T10:01:12.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497c99990 con 0x55a497d49060 2023-09-13T10:01:12.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d48b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46967fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d47e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46977fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d48b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:40940/0 (socket says 172.21.15.6:40940) 2023-09-13T10:01:12.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46977fe700 1 -- 172.21.15.6:0/3305766101 learned_addr learned my addr 172.21.15.6:0/3305766101 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46967fc700 1 -- 172.21.15.6:0/3305766101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 msgr2=0x55a497d474c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:12.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46967fc700 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d474c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46967fc700 1 -- 172.21.15.6:0/3305766101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 msgr2=0x55a497d48b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46967fc700 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d48b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46967fc700 1 -- 172.21.15.6:0/3305766101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a497b19630 con 0x55a497d47a00 2023-09-13T10:01:12.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.867+0000 7f46977fe700 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d48b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.868+0000 7f46967fc700 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d47e80 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f468801a9a0 tx=0x7f4688005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6c182b2f9d4bd1b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.868+0000 7f467d7fa700 1 -- 172.21.15.6:0/3305766101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688031050 con 0x55a497d47a00 2023-09-13T10:01:12.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.868+0000 7f467d7fa700 1 -- 172.21.15.6:0/3305766101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4688032040 con 0x55a497d47a00 2023-09-13T10:01:12.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.868+0000 7f467d7fa700 1 -- 172.21.15.6:0/3305766101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688036400 con 0x55a497d47a00 2023-09-13T10:01:12.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.868+0000 7f467ffff700 1 -- 172.21.15.6:0/182841167 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f469000ca70 con 0x7f46980ffc90 2023-09-13T10:01:12.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3305766101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 msgr2=0x55a497d47e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d47e80 secure :-1 s=READY pgs=1878 cs=0 l=1 rev1=1 crypto rx=0x7f468801a9a0 tx=0x7f4688005fb0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f467ffff700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46800a06c0 0x7f46800a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3305766101 shutdown_connections 2023-09-13T10:01:12.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d47e80 unknown :-1 s=CLOSED pgs=1878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d48b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3305766101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d474c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3305766101 >> 172.21.15.6:0/3305766101 conn(0x55a497ca5c80 msgr2=0x55a497d41f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f467ffff700 1 -- 172.21.15.6:0/182841167 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f46900cba00 con 0x7f46980ffc90 2023-09-13T10:01:12.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46977fe700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46800a06c0 0x7f46800a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3305766101 shutdown_connections 2023-09-13T10:01:12.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.869+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3305766101 wait complete. 2023-09-13T10:01:12.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46977fe700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46800a06c0 0x7f46800a2b80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f468c005d90 tx=0x7f468c00b400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 -- start start 2023-09-13T10:01:12.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 Processor -- start 2023-09-13T10:01:12.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d50f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d51440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d58480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497c37bb0 con 0x55a497d47a00 2023-09-13T10:01:12.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497c378b0 con 0x55a497d48700 2023-09-13T10:01:12.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497b1b920 con 0x55a497d49060 2023-09-13T10:01:12.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f46a97d0b80 10 client.0 _ll_register_callbacks cb 0x55a497c35680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d50f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d50f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47422/0 (socket says 172.21.15.6:47422) 2023-09-13T10:01:12.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.870+0000 7f4696ffd700 1 -- 172.21.15.6:0/722226907 learned_addr learned my addr 172.21.15.6:0/722226907 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f46977fe700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d58480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f46967fc700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d51440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f4696ffd700 1 -- 172.21.15.6:0/722226907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 msgr2=0x55a497d58480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f4696ffd700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d58480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f4696ffd700 1 -- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 msgr2=0x55a497d51440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f4696ffd700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d51440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f4696ffd700 1 -- 172.21.15.6:0/722226907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4698108a20 con 0x55a497d47a00 2023-09-13T10:01:12.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f46967fc700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d51440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:01:12.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f4696ffd700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d50f00 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f469000ef90 tx=0x7f4690098d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0f2184ee892d1e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f467aff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:12.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f467aff5700 1 -- 172.21.15.6:0/722226907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690099230 con 0x55a497d47a00 2023-09-13T10:01:12.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f467aff5700 1 -- 172.21.15.6:0/722226907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f469009d060 con 0x55a497d47a00 2023-09-13T10:01:12.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a497d3a670 con 0x55a497d47a00 2023-09-13T10:01:12.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f467aff5700 1 -- 172.21.15.6:0/722226907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46900a1210 con 0x55a497d47a00 2023-09-13T10:01:12.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f46a97d0b80 10 client.21105 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.871+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55a497cb17a0 con 0x55a497d47a00 2023-09-13T10:01:12.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f467aff5700 1 -- 172.21.15.6:0/722226907 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a497d3a670 con 0x55a497d47a00 2023-09-13T10:01:12.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f467aff5700 1 -- 172.21.15.6:0/722226907 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f46900a0d80 con 0x55a497d47a00 2023-09-13T10:01:12.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f46a97d0b80 10 client.21105 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f46a97d0b80 10 client.21105 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:12.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f46a97d0b80 20 client.21105 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497d5ccf0 0x55a497d5f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f46a97d0b80 4 client.21105 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a497c92970 con 0x55a497d5ccf0 2023-09-13T10:01:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.872+0000 7f46967fc700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497d5ccf0 0x55a497d5f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.873+0000 7f467aff5700 10 client.21105 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:12.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.873+0000 7f46967fc700 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497d5ccf0 0x55a497d5f110 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4591c50eb3faafa6 server_cookie=51149b7bfb86bf9c in_seq=0 out_seq=0 2023-09-13T10:01:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f467aff5700 1 -- 172.21.15.6:0/722226907 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a497c92970 con 0x55a497d5ccf0 2023-09-13T10:01:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f467aff5700 10 client.21105 handle_command_reply: tid=0 2023-09-13T10:01:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 client.21105 shutdown 2023-09-13T10:01:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 msgr2=0x55a497d50f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d50f00 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f469000ef90 tx=0x7f4690098d70 comp rx=0 tx=0).stop 2023-09-13T10:01:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 shutdown_connections 2023-09-13T10:01:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d58480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497d5ccf0 0x55a497d5f110 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d50f00 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/722226907 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d51440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f467aff5700 0 client.21105 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.877+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 >> 172.21.15.6:0/722226907 conn(0x55a497ca5c80 msgr2=0x55a497d41ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.878+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 shutdown_connections 2023-09-13T10:01:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.878+0000 7f46a97d0b80 1 -- 172.21.15.6:0/722226907 wait complete. 2023-09-13T10:01:12.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.878+0000 7f46a97d0b80 20 client.21105 trim_cache size 0 max 16384 2023-09-13T10:01:12.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.906+0000 7f46a97d0b80 1 Processor -- start 2023-09-13T10:01:12.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.906+0000 7f46a97d0b80 1 -- start start 2023-09-13T10:01:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d47a00 0x55a497d474c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d48700 0x55a497d58410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d4b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497d50a70 con 0x55a497d48700 2023-09-13T10:01:12.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497d43fd0 con 0x55a497d47a00 2023-09-13T10:01:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497d43730 con 0x55a497d49060 2023-09-13T10:01:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46967fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d48700 0x55a497d58410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d47a00 0x55a497d474c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46967fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d48700 0x55a497d58410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47432/0 (socket says 172.21.15.6:47432) 2023-09-13T10:01:12.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46967fc700 1 -- 172.21.15.6:0/3931016583 learned_addr learned my addr 172.21.15.6:0/3931016583 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46977fe700 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d4b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f4696ffd700 1 -- 172.21.15.6:0/3931016583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 msgr2=0x55a497d4b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f4696ffd700 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d4b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f4696ffd700 1 -- 172.21.15.6:0/3931016583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d48700 msgr2=0x55a497d58410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f4696ffd700 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d48700 0x55a497d58410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f4696ffd700 1 -- 172.21.15.6:0/3931016583 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a497ac5de0 con 0x55a497d47a00 2023-09-13T10:01:12.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.907+0000 7f46967fc700 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d48700 0x55a497d58410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f4696ffd700 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d47a00 0x55a497d474c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f46900c9820 tx=0x7f4690000f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=782f35d4e6335218 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f467dffb700 1 -- 172.21.15.6:0/3931016583 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f469009d060 con 0x55a497d47a00 2023-09-13T10:01:12.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f467dffb700 1 -- 172.21.15.6:0/3931016583 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f46900a1210 con 0x55a497d47a00 2023-09-13T10:01:12.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f467dffb700 1 -- 172.21.15.6:0/3931016583 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4690098540 con 0x55a497d47a00 2023-09-13T10:01:12.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3931016583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d47a00 msgr2=0x55a497d474c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d47a00 0x55a497d474c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f46900c9820 tx=0x7f4690000f40 comp rx=0 tx=0).stop 2023-09-13T10:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3931016583 shutdown_connections 2023-09-13T10:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d4b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d47a00 0x55a497d474c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/3931016583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d48700 0x55a497d58410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.908+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3931016583 >> 172.21.15.6:0/3931016583 conn(0x55a497ca5c80 msgr2=0x55a497d4fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.909+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3931016583 shutdown_connections 2023-09-13T10:01:12.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.909+0000 7f46a97d0b80 1 -- 172.21.15.6:0/3931016583 wait complete. 2023-09-13T10:01:12.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.909+0000 7f46a97d0b80 1 -- start start 2023-09-13T10:01:12.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.909+0000 7f46a97d0b80 1 Processor -- start 2023-09-13T10:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d54560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d54aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46a97d0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d57ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497d58000 con 0x55a497d47a00 2023-09-13T10:01:12.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497d58170 con 0x55a497d48700 2023-09-13T10:01:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46a97d0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a497d58330 con 0x55a497d49060 2023-09-13T10:01:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46a97d0b80 10 client.0 _ll_register_callbacks cb 0x55a497c35680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d54560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f4696ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d54560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47436/0 (socket says 172.21.15.6:47436) 2023-09-13T10:01:12.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f4696ffd700 1 -- 172.21.15.6:0/1421738168 learned_addr learned my addr 172.21.15.6:0/1421738168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46967fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d54aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46977fe700 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d57ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46967fc700 1 -- 172.21.15.6:0/1421738168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 msgr2=0x55a497d57ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46967fc700 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d57ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46967fc700 1 -- 172.21.15.6:0/1421738168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 msgr2=0x55a497d54560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46967fc700 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d54560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46967fc700 1 -- 172.21.15.6:0/1421738168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a497b19630 con 0x55a497d48700 2023-09-13T10:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f4696ffd700 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d54560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f46967fc700 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d54aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f468802e010 tx=0x7f468801a4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c140379eb9098608 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:12.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.910+0000 7f467aff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f467aff5700 1 -- 172.21.15.6:0/1421738168 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4688046070 con 0x55a497d48700 2023-09-13T10:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f467aff5700 1 -- 172.21.15.6:0/1421738168 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f468801cc40 con 0x55a497d48700 2023-09-13T10:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4688032040 con 0x55a497d48700 2023-09-13T10:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f467aff5700 1 -- 172.21.15.6:0/1421738168 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4688031040 con 0x55a497d48700 2023-09-13T10:01:12.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 10 client.30320 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55a497cb17a0 con 0x55a497d48700 2023-09-13T10:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f467aff5700 1 -- 172.21.15.6:0/1421738168 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4688032040 con 0x55a497d48700 2023-09-13T10:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f467aff5700 1 -- 172.21.15.6:0/1421738168 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4688054460 con 0x55a497d48700 2023-09-13T10:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 10 client.30320 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:12.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 10 client.30320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 20 client.30320 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497dba090 0x55a497dbc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 4 client.30320 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a497c53050 con 0x55a497dba090 2023-09-13T10:01:12.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.911+0000 7f4696ffd700 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497dba090 0x55a497dbc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.912+0000 7f467aff5700 10 client.30320 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:12.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.912+0000 7f4696ffd700 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497dba090 0x55a497dbc4b0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=481956c3ceba6f90 server_cookie=b746435aeec9d27d in_seq=0 out_seq=0 2023-09-13T10:01:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.916+0000 7f467aff5700 1 -- 172.21.15.6:0/1421738168 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a497c53050 con 0x55a497dba090 2023-09-13T10:01:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.916+0000 7f467aff5700 10 client.30320 handle_command_reply: tid=0 2023-09-13T10:01:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.916+0000 7f46a97d0b80 1 client.30320 shutdown 2023-09-13T10:01:12.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.916+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 msgr2=0x55a497d54aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.916+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d54aa0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f468802e010 tx=0x7f468801a4c0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 shutdown_connections 2023-09-13T10:01:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a497d49060 0x55a497d57ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55a497dba090 0x55a497dbc4b0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.928 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a497d47a00 0x55a497d54560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 --2- 172.21.15.6:0/1421738168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a497d48700 0x55a497d54aa0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f467aff5700 0 client.30320 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 >> 172.21.15.6:0/1421738168 conn(0x55a497ca5c80 msgr2=0x55a497d4b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 shutdown_connections 2023-09-13T10:01:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 1 -- 172.21.15.6:0/1421738168 wait complete. 2023-09-13T10:01:12.929 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f46a97d0b80 20 client.30320 trim_cache size 0 max 16384 2023-09-13T10:01:12.930 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46800a06c0 msgr2=0x7f46800a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f469d5eb700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46800a06c0 0x7f46800a2b80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f468c005d90 tx=0x7f468c00b400 comp rx=0 tx=0).stop 2023-09-13T10:01:12.931 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.918+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46980ffc90 msgr2=0x7f4698069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46980ffc90 0x7f4698069160 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f469000efc0 tx=0x7f469000c3a0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 shutdown_connections 2023-09-13T10:01:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f46800a06c0 0x7f46800a2b80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4698101820 0x7f4698069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.932 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46980ffc90 0x7f4698069160 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 --2- 172.21.15.6:0/182841167 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4698100e80 0x7f46980696a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 >> 172.21.15.6:0/182841167 conn(0x7f46980fb220 msgr2=0x7f46980fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 shutdown_connections 2023-09-13T10:01:12.933 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:12.919+0000 7f469d5eb700 1 -- 172.21.15.6:0/182841167 wait complete. 2023-09-13T10:01:13.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 335991 34.18 MB/sec execute 393 sec latency 127.362 ms 2023-09-13T10:01:13.938 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T10:01:13.939 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T10:01:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 -- 172.21.15.6:0/1594608855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 msgr2=0x7ff27c0ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 --2- 172.21.15.6:0/1594608855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c0ff4a0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7ff26c009990 tx=0x7ff26c009ca0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 -- 172.21.15.6:0/1594608855 shutdown_connections 2023-09-13T10:01:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 --2- 172.21.15.6:0/1594608855 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27c1007a0 0x7ff27c101020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 --2- 172.21.15.6:0/1594608855 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c0ff4a0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 --2- 172.21.15.6:0/1594608855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff27c0ffde0 0x7ff27c100260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 -- 172.21.15.6:0/1594608855 >> 172.21.15.6:0/1594608855 conn(0x7ff27c0fa9b0 msgr2=0x7ff27c0fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 -- 172.21.15.6:0/1594608855 shutdown_connections 2023-09-13T10:01:14.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.107+0000 7ff28221e700 1 -- 172.21.15.6:0/1594608855 wait complete. 2023-09-13T10:01:14.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 Processor -- start 2023-09-13T10:01:14.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 -- start start 2023-09-13T10:01:14.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff27c0ffde0 0x7ff27c199230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27c1007a0 0x7ff27c1a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c1a0830 con 0x7ff27c0ff080 2023-09-13T10:01:14.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c1a09a0 con 0x7ff27c1007a0 2023-09-13T10:01:14.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff28221e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff27c1a0b60 con 0x7ff27c0ffde0 2023-09-13T10:01:14.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47450/0 (socket says 172.21.15.6:47450) 2023-09-13T10:01:14.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff27b7fe700 1 -- 172.21.15.6:0/1888285413 learned_addr learned my addr 172.21.15.6:0/1888285413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.108+0000 7ff27bfff700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27c1007a0 0x7ff27c1a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27affd700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff27c0ffde0 0x7ff27c199230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27b7fe700 1 -- 172.21.15.6:0/1888285413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff27c0ffde0 msgr2=0x7ff27c199230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff27c0ffde0 0x7ff27c199230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27b7fe700 1 -- 172.21.15.6:0/1888285413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27c1007a0 msgr2=0x7ff27c1a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27c1007a0 0x7ff27c1a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27b7fe700 1 -- 172.21.15.6:0/1888285413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c0095f0 con 0x7ff27c0ff080 2023-09-13T10:01:14.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27bfff700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27c1007a0 0x7ff27c1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:14.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c198cf0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0059d0 tx=0x7ff26c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff278ff9700 1 -- 172.21.15.6:0/1888285413 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c01d070 con 0x7ff27c0ff080 2023-09-13T10:01:14.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27c1a0de0 con 0x7ff27c0ff080 2023-09-13T10:01:14.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff278ff9700 1 -- 172.21.15.6:0/1888285413 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff26c00fb90 con 0x7ff27c0ff080 2023-09-13T10:01:14.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff278ff9700 1 -- 172.21.15.6:0/1888285413 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0173f0 con 0x7ff27c0ff080 2023-09-13T10:01:14.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.109+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c1a11b0 con 0x7ff27c0ff080 2023-09-13T10:01:14.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.112+0000 7ff278ff9700 1 -- 172.21.15.6:0/1888285413 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff26c00fd00 con 0x7ff27c0ff080 2023-09-13T10:01:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.113+0000 7ff278ff9700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff2640a0640 0x7ff2640a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.113+0000 7ff278ff9700 1 -- 172.21.15.6:0/1888285413 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff26c0ccf70 con 0x7ff27c0ff080 2023-09-13T10:01:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.113+0000 7ff27affd700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff2640a0640 0x7ff2640a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff27affd700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff2640a0640 0x7ff2640a2b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff270009c60 tx=0x7ff270009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 Processor -- start 2023-09-13T10:01:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 -- start start 2023-09-13T10:01:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x563402322ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x563402321540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x563402321f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56340227a800 con 0x5634023230e0 2023-09-13T10:01:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563402278120 con 0x563402321a80 2023-09-13T10:01:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff28e403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563402273a10 con 0x563402322780 2023-09-13T10:01:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff27affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x563402321540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff27affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x563402321540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47460/0 (socket says 172.21.15.6:47460) 2023-09-13T10:01:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff27affd700 1 -- 172.21.15.6:0/830038788 learned_addr learned my addr 172.21.15.6:0/830038788 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff27bfff700 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x563402321f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.114+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x563402322ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff27affd700 1 -- 172.21.15.6:0/830038788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 msgr2=0x563402322ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.126 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff27affd700 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x563402322ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff27affd700 1 -- 172.21.15.6:0/830038788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 msgr2=0x563402321f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff27affd700 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x563402321f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff27affd700 1 -- 172.21.15.6:0/830038788 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634020f36b0 con 0x5634023230e0 2023-09-13T10:01:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff27affd700 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x563402321540 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7ff27000e4e0 tx=0x7ff270014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5750a7f384afee server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff261ffb700 1 -- 172.21.15.6:0/830038788 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27000ee00 con 0x5634023230e0 2023-09-13T10:01:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff261ffb700 1 -- 172.21.15.6:0/830038788 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff270021070 con 0x5634023230e0 2023-09-13T10:01:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.115+0000 7ff261ffb700 1 -- 172.21.15.6:0/830038788 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27001d7b0 con 0x5634023230e0 2023-09-13T10:01:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 -- 172.21.15.6:0/830038788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 msgr2=0x563402321540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x563402321540 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7ff27000e4e0 tx=0x7ff270014000 comp rx=0 tx=0).stop 2023-09-13T10:01:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 -- 172.21.15.6:0/830038788 shutdown_connections 2023-09-13T10:01:14.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x563402321f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x563402322ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 --2- 172.21.15.6:0/830038788 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x563402321540 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 -- 172.21.15.6:0/830038788 >> 172.21.15.6:0/830038788 conn(0x56340227fd00 msgr2=0x56340231bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 -- 172.21.15.6:0/830038788 shutdown_connections 2023-09-13T10:01:14.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.116+0000 7ff28e403b80 1 -- 172.21.15.6:0/830038788 wait complete. 2023-09-13T10:01:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 -- start start 2023-09-13T10:01:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 Processor -- start 2023-09-13T10:01:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x56340232b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x5634023324c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563402211c30 con 0x5634023230e0 2023-09-13T10:01:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563402211930 con 0x563402321a80 2023-09-13T10:01:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634020f59a0 con 0x563402322780 2023-09-13T10:01:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff28e403b80 10 client.0 _ll_register_callbacks cb 0x56340220f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:14.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff27bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x5634023324c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff27affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x56340232b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff27bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x5634023324c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47468/0 (socket says 172.21.15.6:47468) 2023-09-13T10:01:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff27affd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x56340232b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50520/0 (socket says 172.21.15.6:50520) 2023-09-13T10:01:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff27bfff700 1 -- 172.21.15.6:0/2331114033 learned_addr learned my addr 172.21.15.6:0/2331114033 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.117+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff27bfff700 1 -- 172.21.15.6:0/2331114033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 msgr2=0x56340232b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff27bfff700 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x56340232b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff27bfff700 1 -- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 msgr2=0x56340232af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff27bfff700 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff27bfff700 1 -- 172.21.15.6:0/2331114033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff270017070 con 0x5634023230e0 2023-09-13T10:01:14.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff27bfff700 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x5634023324c0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7ff274003d50 tx=0x7ff27400e7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9b5e95d2518d4f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff25affd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff25affd700 1 -- 172.21.15.6:0/2331114033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff274003bf0 con 0x5634023230e0 2023-09-13T10:01:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff25affd700 1 -- 172.21.15.6:0/2331114033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff2740092d0 con 0x5634023230e0 2023-09-13T10:01:14.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634023146f0 con 0x5634023230e0 2023-09-13T10:01:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff25affd700 1 -- 172.21.15.6:0/2331114033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff27400eec0 con 0x5634023230e0 2023-09-13T10:01:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff28e403b80 10 client.21123 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.118+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56340228b820 con 0x5634023230e0 2023-09-13T10:01:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff25affd700 1 -- 172.21.15.6:0/2331114033 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5634023146f0 con 0x5634023230e0 2023-09-13T10:01:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff25affd700 1 -- 172.21.15.6:0/2331114033 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff27401c020 con 0x5634023230e0 2023-09-13T10:01:14.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff28e403b80 10 client.21123 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff28e403b80 10 client.21123 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff28e403b80 20 client.21123 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff28e403b80 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563402336d40 0x563402339160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff28e403b80 4 client.21123 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:14.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56340226c9f0 con 0x563402336d40 2023-09-13T10:01:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.119+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563402336d40 0x563402339160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.120+0000 7ff25affd700 10 client.21123 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.120+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563402336d40 0x563402339160 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8699eba1ac1416cb server_cookie=63379ffda4f4a5cb in_seq=0 out_seq=0 2023-09-13T10:01:14.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.124+0000 7ff25affd700 1 -- 172.21.15.6:0/2331114033 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56340226c9f0 con 0x563402336d40 2023-09-13T10:01:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.124+0000 7ff25affd700 10 client.21123 handle_command_reply: tid=0 2023-09-13T10:01:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.124+0000 7ff28e403b80 1 client.21123 shutdown 2023-09-13T10:01:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.124+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 msgr2=0x5634023324c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.124+0000 7ff28e403b80 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x5634023324c0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7ff274003d50 tx=0x7ff27400e7d0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 shutdown_connections 2023-09-13T10:01:14.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x563402336d40 0x563402339160 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5634023230e0 0x5634023324c0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff25affd700 0 client.21123 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 --2- 172.21.15.6:0/2331114033 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563402322780 0x56340232b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 >> 172.21.15.6:0/2331114033 conn(0x56340227fd00 msgr2=0x563402316870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 shutdown_connections 2023-09-13T10:01:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 1 -- 172.21.15.6:0/2331114033 wait complete. 2023-09-13T10:01:14.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.125+0000 7ff28e403b80 20 client.21123 trim_cache size 0 max 16384 2023-09-13T10:01:14.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.152+0000 7ff28e403b80 1 Processor -- start 2023-09-13T10:01:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.152+0000 7ff28e403b80 1 -- start start 2023-09-13T10:01:14.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402321a80 0x563402321540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402322780 0x5634023323e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x563402315960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff28e403b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56340231d7b0 con 0x563402321a80 2023-09-13T10:01:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff28e403b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563402333430 con 0x563402322780 2023-09-13T10:01:14.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff28e403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563402329960 con 0x5634023230e0 2023-09-13T10:01:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402321a80 0x563402321540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402321a80 0x563402321540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47472/0 (socket says 172.21.15.6:47472) 2023-09-13T10:01:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 -- 172.21.15.6:0/906828875 learned_addr learned my addr 172.21.15.6:0/906828875 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27bfff700 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x563402315960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 -- 172.21.15.6:0/906828875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 msgr2=0x563402315960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x563402315960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 -- 172.21.15.6:0/906828875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402322780 msgr2=0x5634023323e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402322780 0x5634023323e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.153+0000 7ff27b7fe700 1 -- 172.21.15.6:0/906828875 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563402329ec0 con 0x563402321a80 2023-09-13T10:01:14.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.154+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402321a80 0x563402321540 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00b680 tx=0x7ff26c0cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f9dee4bf4cbb37 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.154+0000 7ff2627fc700 1 -- 172.21.15.6:0/906828875 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b6070 con 0x563402321a80 2023-09-13T10:01:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.154+0000 7ff2627fc700 1 -- 172.21.15.6:0/906828875 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff26c09a7a0 con 0x563402321a80 2023-09-13T10:01:14.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.154+0000 7ff2627fc700 1 -- 172.21.15.6:0/906828875 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b1070 con 0x563402321a80 2023-09-13T10:01:14.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 -- 172.21.15.6:0/906828875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402321a80 msgr2=0x563402321540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402321a80 0x563402321540 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7ff26c00b680 tx=0x7ff26c0cc040 comp rx=0 tx=0).stop 2023-09-13T10:01:14.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 -- 172.21.15.6:0/906828875 shutdown_connections 2023-09-13T10:01:14.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x563402315960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.162 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402321a80 0x563402321540 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 --2- 172.21.15.6:0/906828875 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402322780 0x5634023323e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 -- 172.21.15.6:0/906828875 >> 172.21.15.6:0/906828875 conn(0x56340227fd00 msgr2=0x56340232af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.163 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 -- 172.21.15.6:0/906828875 shutdown_connections 2023-09-13T10:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 -- 172.21.15.6:0/906828875 wait complete. 2023-09-13T10:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.155+0000 7ff28e403b80 1 -- start start 2023-09-13T10:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 1 Processor -- start 2023-09-13T10:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402322780 0x56340232d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x56340239bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56340239c0b0 con 0x563402322780 2023-09-13T10:01:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56340239c1f0 con 0x563402321a80 2023-09-13T10:01:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56340239c330 con 0x5634023230e0 2023-09-13T10:01:14.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff28e403b80 10 client.0 _ll_register_callbacks cb 0x56340220f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff27b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41000/0 (socket says 172.21.15.6:41000) 2023-09-13T10:01:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff27b7fe700 1 -- 172.21.15.6:0/3680961552 learned_addr learned my addr 172.21.15.6:0/3680961552 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff27affd700 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402322780 0x56340232d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.156+0000 7ff27bfff700 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x56340239bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.167 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff27b7fe700 1 -- 172.21.15.6:0/3680961552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 msgr2=0x56340239bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x56340239bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff27b7fe700 1 -- 172.21.15.6:0/3680961552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402322780 msgr2=0x56340232d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402322780 0x56340232d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff27b7fe700 1 -- 172.21.15.6:0/3680961552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff27c1a11b0 con 0x563402321a80 2023-09-13T10:01:14.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff27b7fe700 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232d350 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0caa70 tx=0x7ff26c005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bb771eb8254ec5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff25affd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff25affd700 1 -- 172.21.15.6:0/3680961552 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff26c0b6050 con 0x563402321a80 2023-09-13T10:01:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff270021070 con 0x563402321a80 2023-09-13T10:01:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff25affd700 1 -- 172.21.15.6:0/3680961552 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff26c099e90 con 0x563402321a80 2023-09-13T10:01:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff25affd700 1 -- 172.21.15.6:0/3680961552 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff26c0b1040 con 0x563402321a80 2023-09-13T10:01:14.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff28e403b80 10 client.30335 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.157+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56340209fe60 con 0x563402321a80 2023-09-13T10:01:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.158+0000 7ff25affd700 1 -- 172.21.15.6:0/3680961552 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff270021070 con 0x563402321a80 2023-09-13T10:01:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.158+0000 7ff25affd700 1 -- 172.21.15.6:0/3680961552 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7ff26c096590 con 0x563402321a80 2023-09-13T10:01:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.158+0000 7ff28e403b80 10 client.30335 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:14.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.158+0000 7ff28e403b80 10 client.30335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.159+0000 7ff28e403b80 20 client.30335 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.159+0000 7ff28e403b80 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56340239d830 0x56340239fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.159+0000 7ff28e403b80 4 client.30335 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T10:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.159+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56340222d0d0 con 0x56340239d830 2023-09-13T10:01:14.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.159+0000 7ff27affd700 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56340239d830 0x56340239fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.159+0000 7ff25affd700 10 client.30335 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.159+0000 7ff27affd700 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56340239d830 0x56340239fc20 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e61d3941f8c31141 server_cookie=649eb77f4dc8b72a in_seq=0 out_seq=0 2023-09-13T10:01:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff25affd700 1 -- 172.21.15.6:0/3680961552 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56340222d0d0 con 0x56340239d830 2023-09-13T10:01:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff25affd700 10 client.30335 handle_command_reply: tid=0 2023-09-13T10:01:14.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 client.30335 shutdown 2023-09-13T10:01:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 msgr2=0x56340232d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232d350 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0caa70 tx=0x7ff26c005ef0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 shutdown_connections 2023-09-13T10:01:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5634023230e0 0x56340239bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563402321a80 0x56340232d350 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56340239d830 0x56340239fc20 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 --2- 172.21.15.6:0/3680961552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563402322780 0x56340232d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff25affd700 0 client.30335 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 >> 172.21.15.6:0/3680961552 conn(0x56340227fd00 msgr2=0x563402320530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 shutdown_connections 2023-09-13T10:01:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 1 -- 172.21.15.6:0/3680961552 wait complete. 2023-09-13T10:01:14.176 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.162+0000 7ff28e403b80 20 client.30335 trim_cache size 0 max 16384 2023-09-13T10:01:14.176 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:01:14.176 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T10:01:14.177 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "4f144528-f9aa-435d-9018-7e6667708f86", 2023-09-13T10:01:14.177 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T10:01:14.177 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:01:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff2640a0640 msgr2=0x7ff2640a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff2640a0640 0x7ff2640a2b00 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff270009c60 tx=0x7ff270009260 comp rx=0 tx=0).stop 2023-09-13T10:01:14.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 msgr2=0x7ff27c198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c198cf0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7ff26c0059d0 tx=0x7ff26c004730 comp rx=0 tx=0).stop 2023-09-13T10:01:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 shutdown_connections 2023-09-13T10:01:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff27c1007a0 0x7ff27c1a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff2640a0640 0x7ff2640a2b00 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff27c0ff080 0x7ff27c198cf0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 --2- 172.21.15.6:0/1888285413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff27c0ffde0 0x7ff27c199230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 >> 172.21.15.6:0/1888285413 conn(0x7ff27c0fa9b0 msgr2=0x7ff27c0fc790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.163+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 shutdown_connections 2023-09-13T10:01:14.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.164+0000 7ff28221e700 1 -- 172.21.15.6:0/1888285413 wait complete. 2023-09-13T10:01:14.181 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:01:14.264 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:14 smithi006 ceph-mon[98665]: pgmap v951: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 15 MiB/s wr, 830 op/s 2023-09-13T10:01:14.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.361+0000 7f303eb2e700 1 -- 172.21.15.6:0/2469778572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038104230 msgr2=0x7f3038106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.361+0000 7f303eb2e700 1 --2- 172.21.15.6:0/2469778572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038104230 0x7f3038106620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3024009990 tx=0x7f3024009ca0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 -- 172.21.15.6:0/2469778572 shutdown_connections 2023-09-13T10:01:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 --2- 172.21.15.6:0/2469778572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3038106b60 0x7f3038108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 --2- 172.21.15.6:0/2469778572 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3038101900 0x7f3038103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 --2- 172.21.15.6:0/2469778572 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038104230 0x7f3038106620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 -- 172.21.15.6:0/2469778572 >> 172.21.15.6:0/2469778572 conn(0x7f30380fb250 msgr2=0x7f30380fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 -- 172.21.15.6:0/2469778572 shutdown_connections 2023-09-13T10:01:14.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 -- 172.21.15.6:0/2469778572 wait complete. 2023-09-13T10:01:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.362+0000 7f303eb2e700 1 Processor -- start 2023-09-13T10:01:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303eb2e700 1 -- start start 2023-09-13T10:01:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303eb2e700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038101900 0x7f3038101270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303eb2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3038104230 0x7f30380ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303eb2e700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3038106b60 0x7f30380ffdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303eb2e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038100590 con 0x7f3038104230 2023-09-13T10:01:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303eb2e700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3038100700 con 0x7f3038101900 2023-09-13T10:01:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303eb2e700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30381a0a90 con 0x7f3038106b60 2023-09-13T10:01:14.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038101900 0x7f3038101270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f3037fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3038104230 0x7f30380ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038101900 0x7f3038101270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41014/0 (socket says 172.21.15.6:41014) 2023-09-13T10:01:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 -- 172.21.15.6:0/3213794970 learned_addr learned my addr 172.21.15.6:0/3213794970 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303d0cb700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3038106b60 0x7f30380ffdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 -- 172.21.15.6:0/3213794970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3038106b60 msgr2=0x7f30380ffdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3038106b60 0x7f30380ffdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 -- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3038104230 msgr2=0x7f30380ff8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3038104230 0x7f30380ff8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f303c8ca700 1 -- 172.21.15.6:0/3213794970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240095f0 con 0x7f3038101900 2023-09-13T10:01:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.363+0000 7f3037fff700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3038104230 0x7f30380ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.364+0000 7f303c8ca700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038101900 0x7f3038101270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f302c00d950 tx=0x7f302c00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.364+0000 7f3035ffb700 1 -- 172.21.15.6:0/3213794970 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00f890 con 0x7f3038101900 2023-09-13T10:01:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.364+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30381a0d70 con 0x7f3038101900 2023-09-13T10:01:14.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.364+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30381a1210 con 0x7f3038101900 2023-09-13T10:01:14.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.364+0000 7f3035ffb700 1 -- 172.21.15.6:0/3213794970 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f302c010460 con 0x7f3038101900 2023-09-13T10:01:14.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.364+0000 7f3035ffb700 1 -- 172.21.15.6:0/3213794970 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c00e610 con 0x7f3038101900 2023-09-13T10:01:14.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.367+0000 7f3035ffb700 1 -- 172.21.15.6:0/3213794970 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f302c0105d0 con 0x7f3038101900 2023-09-13T10:01:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.368+0000 7f3035ffb700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30280a06c0 0x7f30280a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.368+0000 7f3035ffb700 1 -- 172.21.15.6:0/3213794970 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f302c0cbc10 con 0x7f3038101900 2023-09-13T10:01:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 Processor -- start 2023-09-13T10:01:14.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 -- start start 2023-09-13T10:01:14.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 0x5604964feb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964ff060 0x5604964fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fda00 0x5604964fde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560496456780 con 0x5604964fda00 2023-09-13T10:01:14.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604964540a0 con 0x5604964ff060 2023-09-13T10:01:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f304ad13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049644f990 con 0x5604964fe700 2023-09-13T10:01:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f303d0cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fda00 0x5604964fde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f303d0cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fda00 0x5604964fde80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47502/0 (socket says 172.21.15.6:47502) 2023-09-13T10:01:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f303d0cb700 1 -- 172.21.15.6:0/4047613416 learned_addr learned my addr 172.21.15.6:0/4047613416 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f3037fff700 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964ff060 0x5604964fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.369+0000 7f3037fff700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30280a06c0 0x7f30280a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.370+0000 7f3037fff700 1 -- 172.21.15.6:0/4047613416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 msgr2=0x5604964feb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.370+0000 7f3037fff700 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 0x5604964feb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.370+0000 7f3037fff700 1 -- 172.21.15.6:0/4047613416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fda00 msgr2=0x5604964fde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.370+0000 7f3037fff700 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fda00 0x5604964fde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.370+0000 7f3037fff700 1 -- 172.21.15.6:0/4047613416 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5604962cf630 con 0x5604964ff060 2023-09-13T10:01:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.370+0000 7f303d0cb700 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fda00 0x5604964fde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:14.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.370+0000 7f3037fff700 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964ff060 0x5604964fd4c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f302400b5c0 tx=0x7f302400f460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a162893892b64690 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.371+0000 7f3022ffd700 1 -- 172.21.15.6:0/4047613416 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302401d030 con 0x5604964ff060 2023-09-13T10:01:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.371+0000 7f3037fff700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30280a06c0 0x7f30280a2b80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f302401d000 tx=0x7f3024029000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.374+0000 7f3022ffd700 1 -- 172.21.15.6:0/4047613416 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f302402fad0 con 0x5604964ff060 2023-09-13T10:01:14.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.374+0000 7f3022ffd700 1 -- 172.21.15.6:0/4047613416 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240278c0 con 0x5604964ff060 2023-09-13T10:01:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.375+0000 7f304ad13b80 1 -- 172.21.15.6:0/4047613416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964ff060 msgr2=0x5604964fd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.375+0000 7f304ad13b80 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964ff060 0x5604964fd4c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f302400b5c0 tx=0x7f302400f460 comp rx=0 tx=0).stop 2023-09-13T10:01:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 -- 172.21.15.6:0/4047613416 shutdown_connections 2023-09-13T10:01:14.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fda00 0x5604964fde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 0x5604964feb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 --2- 172.21.15.6:0/4047613416 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964ff060 0x5604964fd4c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 -- 172.21.15.6:0/4047613416 >> 172.21.15.6:0/4047613416 conn(0x56049645bc80 msgr2=0x5604964f7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 -- 172.21.15.6:0/4047613416 shutdown_connections 2023-09-13T10:01:14.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 -- 172.21.15.6:0/4047613416 wait complete. 2023-09-13T10:01:14.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 -- start start 2023-09-13T10:01:14.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.377+0000 7f304ad13b80 1 Processor -- start 2023-09-13T10:01:14.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fda00 0x56049650f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fe700 0x56049650fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964ff060 0x560496516c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f304ad13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604963edbb0 con 0x5604964ff060 2023-09-13T10:01:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f304ad13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604963ed8b0 con 0x5604964fe700 2023-09-13T10:01:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f304ad13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604962d1920 con 0x5604964fda00 2023-09-13T10:01:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f304ad13b80 10 client.0 _ll_register_callbacks cb 0x5604963eb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f303c8ca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fda00 0x56049650f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f303c8ca700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fda00 0x56049650f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50558/0 (socket says 172.21.15.6:50558) 2023-09-13T10:01:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f303c8ca700 1 -- 172.21.15.6:0/1057883439 learned_addr learned my addr 172.21.15.6:0/1057883439 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f303d0cb700 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964ff060 0x560496516c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.378+0000 7f303c8ca700 1 -- 172.21.15.6:0/1057883439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fe700 msgr2=0x56049650fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f303c8ca700 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fe700 0x56049650fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f303c8ca700 1 -- 172.21.15.6:0/1057883439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964ff060 msgr2=0x560496516c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f303c8ca700 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964ff060 0x560496516c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f303c8ca700 1 -- 172.21.15.6:0/1057883439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3024020040 con 0x5604964fda00 2023-09-13T10:01:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f303c8ca700 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fda00 0x56049650f680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f302c0958b0 tx=0x7f302c099b30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5935b8e44725c1a8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f3017fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:14.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f3017fff700 1 -- 172.21.15.6:0/1057883439 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c010ad0 con 0x5604964fda00 2023-09-13T10:01:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5604964f0670 con 0x5604964fda00 2023-09-13T10:01:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f3017fff700 1 -- 172.21.15.6:0/1057883439 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f302c09d1e0 con 0x5604964fda00 2023-09-13T10:01:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f3017fff700 1 -- 172.21.15.6:0/1057883439 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f302c0a1420 con 0x5604964fda00 2023-09-13T10:01:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f304ad13b80 10 client.30334 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:14.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.379+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x5604964677a0 con 0x5604964fda00 2023-09-13T10:01:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f3017fff700 1 -- 172.21.15.6:0/1057883439 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5604964f0670 con 0x5604964fda00 2023-09-13T10:01:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f3017fff700 1 -- 172.21.15.6:0/1057883439 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f302c0a0f90 con 0x5604964fda00 2023-09-13T10:01:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f304ad13b80 10 client.30334 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f304ad13b80 10 client.30334 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:14.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f304ad13b80 20 client.30334 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56049652c400 0x56049652e820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f304ad13b80 4 client.30334 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560496448970 con 0x56049652c400 2023-09-13T10:01:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.380+0000 7f3037fff700 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56049652c400 0x56049652e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.381+0000 7f3017fff700 10 client.30334 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.381+0000 7f3037fff700 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56049652c400 0x56049652e820 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44ebf602ab19b184 server_cookie=52f7f9586047b8c9 in_seq=0 out_seq=0 2023-09-13T10:01:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.381+0000 7f3017fff700 1 -- 172.21.15.6:0/1057883439 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560496448970 con 0x56049652c400 2023-09-13T10:01:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.381+0000 7f3017fff700 10 client.30334 handle_command_reply: tid=0 2023-09-13T10:01:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.381+0000 7f304ad13b80 1 client.30334 shutdown 2023-09-13T10:01:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.382+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fda00 msgr2=0x56049650f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.382+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fda00 0x56049650f680 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f302c0958b0 tx=0x7f302c099b30 comp rx=0 tx=0).stop 2023-09-13T10:01:14.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 shutdown_connections 2023-09-13T10:01:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56049652c400 0x56049652e820 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964ff060 0x560496516c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fda00 0x56049650f680 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1057883439 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fe700 0x56049650fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 >> 172.21.15.6:0/1057883439 conn(0x56049645bc80 msgr2=0x5604964f27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f3017fff700 0 client.30334 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 shutdown_connections 2023-09-13T10:01:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 1 -- 172.21.15.6:0/1057883439 wait complete. 2023-09-13T10:01:14.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.383+0000 7f304ad13b80 20 client.30334 trim_cache size 0 max 16384 2023-09-13T10:01:14.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.406+0000 7f304ad13b80 1 Processor -- start 2023-09-13T10:01:14.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.406+0000 7f304ad13b80 1 -- start start 2023-09-13T10:01:14.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56049645bc80 0x5604964fd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496516bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fe700 0x56049650f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f304ad13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604964f0650 con 0x5604964fe700 2023-09-13T10:01:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f304ad13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049650eb30 con 0x5604964fda00 2023-09-13T10:01:14.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f304ad13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56049650f220 con 0x56049645bc80 2023-09-13T10:01:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fe700 0x56049650f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fe700 0x56049650f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47516/0 (socket says 172.21.15.6:47516) 2023-09-13T10:01:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303c8ca700 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56049645bc80 0x5604964fd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 -- 172.21.15.6:0/2607757177 learned_addr learned my addr 172.21.15.6:0/2607757177 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f3037fff700 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496516bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 -- 172.21.15.6:0/2607757177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56049645bc80 msgr2=0x5604964fd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56049645bc80 0x5604964fd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 -- 172.21.15.6:0/2607757177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 msgr2=0x560496516bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496516bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.407+0000 7f303d0cb700 1 -- 172.21.15.6:0/2607757177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56049627bde0 con 0x5604964fe700 2023-09-13T10:01:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.408+0000 7f303d0cb700 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fe700 0x56049650f430 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f3030009fd0 tx=0x7f3030007400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ae651fc42b0daa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.408+0000 7f30237fe700 1 -- 172.21.15.6:0/2607757177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030009b50 con 0x5604964fe700 2023-09-13T10:01:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.408+0000 7f30237fe700 1 -- 172.21.15.6:0/2607757177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f303000f040 con 0x5604964fe700 2023-09-13T10:01:14.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.408+0000 7f30237fe700 1 -- 172.21.15.6:0/2607757177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3030017790 con 0x5604964fe700 2023-09-13T10:01:14.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 -- 172.21.15.6:0/2607757177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fe700 msgr2=0x56049650f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fe700 0x56049650f430 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f3030009fd0 tx=0x7f3030007400 comp rx=0 tx=0).stop 2023-09-13T10:01:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 -- 172.21.15.6:0/2607757177 shutdown_connections 2023-09-13T10:01:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5604964fe700 0x56049650f430 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56049645bc80 0x5604964fd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 --2- 172.21.15.6:0/2607757177 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496516bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 -- 172.21.15.6:0/2607757177 >> 172.21.15.6:0/2607757177 conn(0x5604964f8240 msgr2=0x560496501980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 -- 172.21.15.6:0/2607757177 shutdown_connections 2023-09-13T10:01:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 -- 172.21.15.6:0/2607757177 wait complete. 2023-09-13T10:01:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 -- start start 2023-09-13T10:01:14.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.409+0000 7f304ad13b80 1 Processor -- start 2023-09-13T10:01:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56049645bc80 0x560496516810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496513450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f304ad13b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 0x560496513990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f304ad13b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560496513ed0 con 0x56049645bc80 2023-09-13T10:01:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f304ad13b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560496514040 con 0x5604964fda00 2023-09-13T10:01:14.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f304ad13b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5604965801e0 con 0x5604964fe700 2023-09-13T10:01:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f304ad13b80 10 client.0 _ll_register_callbacks cb 0x5604963eb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f303c8ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56049645bc80 0x560496516810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f303c8ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56049645bc80 0x560496516810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47518/0 (socket says 172.21.15.6:47518) 2023-09-13T10:01:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f303c8ca700 1 -- 172.21.15.6:0/1812068479 learned_addr learned my addr 172.21.15.6:0/1812068479 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:14.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f3037fff700 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496513450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.410+0000 7f303d0cb700 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 0x560496513990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3037fff700 1 -- 172.21.15.6:0/1812068479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 msgr2=0x560496513990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3037fff700 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 0x560496513990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3037fff700 1 -- 172.21.15.6:0/1812068479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56049645bc80 msgr2=0x560496516810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3037fff700 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56049645bc80 0x560496516810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3037fff700 1 -- 172.21.15.6:0/1812068479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3030009cb0 con 0x5604964fda00 2023-09-13T10:01:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3037fff700 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496513450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3024009990 tx=0x7f3024009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d4033159eb30bbfa server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3017fff700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3017fff700 1 -- 172.21.15.6:0/1812068479 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30240273f0 con 0x5604964fda00 2023-09-13T10:01:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f302402fad0 con 0x5604964fda00 2023-09-13T10:01:14.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3017fff700 1 -- 172.21.15.6:0/1812068479 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f302403baa0 con 0x5604964fda00 2023-09-13T10:01:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f3017fff700 1 -- 172.21.15.6:0/1812068479 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f302403bc60 con 0x5604964fda00 2023-09-13T10:01:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f304ad13b80 10 client.30350 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.411+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x560496264c60 con 0x5604964fda00 2023-09-13T10:01:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f3017fff700 1 -- 172.21.15.6:0/1812068479 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f302404c020 con 0x5604964fda00 2023-09-13T10:01:14.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f3017fff700 1 -- 172.21.15.6:0/1812068479 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f302403b420 con 0x5604964fda00 2023-09-13T10:01:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f304ad13b80 10 client.30350 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f304ad13b80 10 client.30350 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f304ad13b80 20 client.30350 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5604964ff060 0x5604965838b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:14.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f304ad13b80 4 client.30350 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:01:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560496409050 con 0x5604964ff060 2023-09-13T10:01:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.412+0000 7f303c8ca700 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5604964ff060 0x5604965838b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.413+0000 7f3017fff700 10 client.30350 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.413+0000 7f303c8ca700 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5604964ff060 0x5604965838b0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4233f537b981930c server_cookie=de1db544685be7a0 in_seq=0 out_seq=0 2023-09-13T10:01:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.417+0000 7f3017fff700 1 -- 172.21.15.6:0/1812068479 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x560496409050 con 0x5604964ff060 2023-09-13T10:01:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.417+0000 7f3017fff700 10 client.30350 handle_command_reply: tid=0 2023-09-13T10:01:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 client.30350 shutdown 2023-09-13T10:01:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 msgr2=0x560496513450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496513450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f3024009990 tx=0x7f3024009ca0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 shutdown_connections 2023-09-13T10:01:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5604964fe700 0x560496513990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5604964ff060 0x5604965838b0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56049645bc80 0x560496516810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f3017fff700 0 client.30350 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 --2- 172.21.15.6:0/1812068479 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5604964fda00 0x560496513450 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 >> 172.21.15.6:0/1812068479 conn(0x5604964f8240 msgr2=0x56049650f430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 shutdown_connections 2023-09-13T10:01:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 1 -- 172.21.15.6:0/1812068479 wait complete. 2023-09-13T10:01:14.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.418+0000 7f304ad13b80 20 client.30350 trim_cache size 0 max 16384 2023-09-13T10:01:14.430 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:01:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T10:01:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T10:01:14.430 INFO:teuthology.orchestra.run.smithi006.stdout: "4f144528-f9aa-435d-9018-7e6667708f86": { 2023-09-13T10:01:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T10:01:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "4f144528-f9aa-435d-9018-7e6667708f86", 2023-09-13T10:01:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T10:01:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:01:14.431 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:01:14.431 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:01:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30280a06c0 msgr2=0x7f30280a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30280a06c0 0x7f30280a2b80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f302401d000 tx=0x7f3024029000 comp rx=0 tx=0).stop 2023-09-13T10:01:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038101900 msgr2=0x7f3038101270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038101900 0x7f3038101270 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f302c00d950 tx=0x7f302c00dc60 comp rx=0 tx=0).stop 2023-09-13T10:01:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 shutdown_connections 2023-09-13T10:01:14.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3038106b60 0x7f30380ffdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f3038101900 0x7f3038101270 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f30280a06c0 0x7f30280a2b80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 --2- 172.21.15.6:0/3213794970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3038104230 0x7f30380ff8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 >> 172.21.15.6:0/3213794970 conn(0x7f30380fb250 msgr2=0x7f3038102d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:14.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 shutdown_connections 2023-09-13T10:01:14.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:14.419+0000 7f303eb2e700 1 -- 172.21.15.6:0/3213794970 wait complete. 2023-09-13T10:01:14.439 INFO:tasks.cephfs.filesystem:scrub status for tag:4f144528-f9aa-435d-9018-7e6667708f86 - {'path': '/', 'tag': '4f144528-f9aa-435d-9018-7e6667708f86', 'options': 'recursive,force'} 2023-09-13T10:01:14.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:14 smithi053 ceph-mon[102373]: pgmap v951: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 15 MiB/s wr, 830 op/s 2023-09-13T10:01:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:14 smithi131 ceph-mon[102785]: pgmap v951: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 15 MiB/s wr, 830 op/s 2023-09-13T10:01:14.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 336573 34.16 MB/sec execute 394 sec latency 130.109 ms 2023-09-13T10:01:15.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T10:01:15.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:15.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:15 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T10:01:15.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:15.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:15 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T10:01:15.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:15.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:15 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:15.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 337426 34.22 MB/sec execute 395 sec latency 82.647 ms 2023-09-13T10:01:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:16 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:16.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:16 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:16.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:16 smithi006 ceph-mon[98665]: pgmap v952: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 858 op/s 2023-09-13T10:01:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:16 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:16 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:16.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:16 smithi053 ceph-mon[102373]: pgmap v952: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 858 op/s 2023-09-13T10:01:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:16 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:16 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:16 smithi131 ceph-mon[102785]: pgmap v952: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 16 MiB/s wr, 858 op/s 2023-09-13T10:01:16.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 338105 34.26 MB/sec execute 396 sec latency 65.486 ms 2023-09-13T10:01:17.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 338486 34.21 MB/sec execute 397 sec latency 78.635 ms 2023-09-13T10:01:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:18 smithi006 ceph-mon[98665]: pgmap v953: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 916 op/s 2023-09-13T10:01:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:18 smithi053 ceph-mon[102373]: pgmap v953: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 916 op/s 2023-09-13T10:01:18.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:18 smithi131 ceph-mon[102785]: pgmap v953: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 16 MiB/s wr, 916 op/s 2023-09-13T10:01:18.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 338970 34.18 MB/sec execute 398 sec latency 79.385 ms 2023-09-13T10:01:19.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 339554 34.16 MB/sec execute 399 sec latency 63.527 ms 2023-09-13T10:01:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:20 smithi006 ceph-mon[98665]: pgmap v954: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 861 op/s 2023-09-13T10:01:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:20 smithi053 ceph-mon[102373]: pgmap v954: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 861 op/s 2023-09-13T10:01:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:20 smithi131 ceph-mon[102785]: pgmap v954: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 11 MiB/s wr, 861 op/s 2023-09-13T10:01:20.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 340328 34.17 MB/sec execute 400 sec latency 114.470 ms 2023-09-13T10:01:21.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 341109 34.21 MB/sec execute 401 sec latency 53.748 ms 2023-09-13T10:01:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:22 smithi006 ceph-mon[98665]: pgmap v955: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.6 MiB/s wr, 708 op/s 2023-09-13T10:01:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:22 smithi053 ceph-mon[102373]: pgmap v955: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.6 MiB/s wr, 708 op/s 2023-09-13T10:01:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:22 smithi131 ceph-mon[102785]: pgmap v955: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.6 MiB/s wr, 708 op/s 2023-09-13T10:01:22.603 INFO:tasks.workunit.client.0.smithi006.stdout: 10 341617 34.19 MB/sec execute 402 sec latency 84.016 ms 2023-09-13T10:01:23.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 342104 34.18 MB/sec execute 403 sec latency 69.044 ms 2023-09-13T10:01:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:24 smithi006 ceph-mon[98665]: pgmap v956: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.0 MiB/s wr, 721 op/s 2023-09-13T10:01:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:24 smithi053 ceph-mon[102373]: pgmap v956: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.0 MiB/s wr, 721 op/s 2023-09-13T10:01:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:24 smithi131 ceph-mon[102785]: pgmap v956: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 6.0 MiB/s wr, 721 op/s 2023-09-13T10:01:24.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 342594 34.15 MB/sec execute 404 sec latency 76.846 ms 2023-09-13T10:01:25.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 343225 34.14 MB/sec execute 405 sec latency 95.976 ms 2023-09-13T10:01:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:26 smithi053 ceph-mon[102373]: pgmap v957: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 623 op/s 2023-09-13T10:01:26.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:26 smithi006 ceph-mon[98665]: pgmap v957: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 623 op/s 2023-09-13T10:01:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:26 smithi131 ceph-mon[102785]: pgmap v957: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.4 MiB/s wr, 623 op/s 2023-09-13T10:01:26.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 343894 34.16 MB/sec execute 406 sec latency 82.489 ms 2023-09-13T10:01:27.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 344484 34.15 MB/sec execute 407 sec latency 77.966 ms 2023-09-13T10:01:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:28 smithi006 ceph-mon[98665]: pgmap v958: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 600 op/s 2023-09-13T10:01:28.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:28 smithi053 ceph-mon[102373]: pgmap v958: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 600 op/s 2023-09-13T10:01:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:28 smithi131 ceph-mon[102785]: pgmap v958: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 600 op/s 2023-09-13T10:01:28.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 344996 34.13 MB/sec execute 408 sec latency 74.203 ms 2023-09-13T10:01:29.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 345581 34.13 MB/sec execute 409 sec latency 97.732 ms 2023-09-13T10:01:30.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:30 smithi053 ceph-mon[102373]: pgmap v959: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 501 op/s 2023-09-13T10:01:30.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:01:30.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:01:30.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:01:30.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:01:30.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:30 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:01:30.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:30 smithi006 ceph-mon[98665]: pgmap v959: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 501 op/s 2023-09-13T10:01:30.514 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:01:30.515 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:01:30.515 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:01:30.515 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:01:30.515 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:30 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:01:30.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:30 smithi131 ceph-mon[102785]: pgmap v959: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 501 op/s 2023-09-13T10:01:30.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:01:30.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:01:30.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:01:30.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:01:30.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:30 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:01:30.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 346081 34.10 MB/sec execute 410 sec latency 288.844 ms 2023-09-13T10:01:31.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 346118 34.03 MB/sec execute 411 sec latency 1183.537 ms 2023-09-13T10:01:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:32 smithi006 ceph-mon[98665]: pgmap v960: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 439 op/s 2023-09-13T10:01:32.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:32 smithi053 ceph-mon[102373]: pgmap v960: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 439 op/s 2023-09-13T10:01:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:32 smithi131 ceph-mon[102785]: pgmap v960: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 2.9 MiB/s wr, 439 op/s 2023-09-13T10:01:32.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 346492 33.98 MB/sec execute 412 sec latency 865.029 ms 2023-09-13T10:01:33.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 346855 33.95 MB/sec execute 413 sec latency 173.306 ms 2023-09-13T10:01:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:34 smithi006 ceph-mon[98665]: pgmap v961: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 606 op/s 2023-09-13T10:01:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:34 smithi053 ceph-mon[102373]: pgmap v961: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 606 op/s 2023-09-13T10:01:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:34 smithi131 ceph-mon[102785]: pgmap v961: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.9 MiB/s wr, 606 op/s 2023-09-13T10:01:34.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 347505 33.99 MB/sec execute 414 sec latency 54.265 ms 2023-09-13T10:01:35.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 348148 33.96 MB/sec execute 415 sec latency 61.127 ms 2023-09-13T10:01:36.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:36 smithi006 ceph-mon[98665]: pgmap v962: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 607 op/s 2023-09-13T10:01:36.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:36 smithi053 ceph-mon[102373]: pgmap v962: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 607 op/s 2023-09-13T10:01:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:36 smithi131 ceph-mon[102785]: pgmap v962: 97 pgs: 97 active+clean; 1.3 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 11 MiB/s wr, 607 op/s 2023-09-13T10:01:36.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 348670 33.96 MB/sec execute 416 sec latency 82.298 ms 2023-09-13T10:01:37.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 349182 33.94 MB/sec execute 417 sec latency 75.399 ms 2023-09-13T10:01:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:38 smithi006 ceph-mon[98665]: pgmap v963: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 739 op/s 2023-09-13T10:01:38.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:38 smithi053 ceph-mon[102373]: pgmap v963: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 739 op/s 2023-09-13T10:01:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:38 smithi131 ceph-mon[102785]: pgmap v963: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 739 op/s 2023-09-13T10:01:38.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 349765 33.93 MB/sec execute 418 sec latency 81.851 ms 2023-09-13T10:01:39.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 350466 33.93 MB/sec execute 419 sec latency 77.710 ms 2023-09-13T10:01:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:40 smithi006 ceph-mon[98665]: pgmap v964: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 736 op/s 2023-09-13T10:01:40.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:40 smithi053 ceph-mon[102373]: pgmap v964: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 736 op/s 2023-09-13T10:01:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:40 smithi131 ceph-mon[102785]: pgmap v964: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 13 MiB/s wr, 736 op/s 2023-09-13T10:01:40.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 351107 33.94 MB/sec execute 420 sec latency 96.491 ms 2023-09-13T10:01:41.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 351777 33.95 MB/sec execute 421 sec latency 60.394 ms 2023-09-13T10:01:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:42 smithi006 ceph-mon[98665]: pgmap v965: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 674 op/s 2023-09-13T10:01:42.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:42 smithi053 ceph-mon[102373]: pgmap v965: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 674 op/s 2023-09-13T10:01:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:42 smithi131 ceph-mon[102785]: pgmap v965: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 12 MiB/s wr, 674 op/s 2023-09-13T10:01:42.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 352295 33.93 MB/sec execute 422 sec latency 124.830 ms 2023-09-13T10:01:43.604 INFO:tasks.workunit.client.0.smithi006.stdout: 10 352784 33.95 MB/sec execute 423 sec latency 90.510 ms 2023-09-13T10:01:44.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:01:44.491 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:44 smithi006 ceph-mon[98665]: pgmap v966: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 803 op/s 2023-09-13T10:01:44.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:44 smithi053 ceph-mon[102373]: pgmap v966: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 803 op/s 2023-09-13T10:01:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:44 smithi131 ceph-mon[102785]: pgmap v966: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 13 MiB/s wr, 803 op/s 2023-09-13T10:01:44.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 353256 33.94 MB/sec execute 424 sec latency 65.054 ms 2023-09-13T10:01:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 -- 172.21.15.6:0/2307485090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd600ffcc0 msgr2=0x7fbd601000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 --2- 172.21.15.6:0/2307485090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd600ffcc0 0x7fbd601000e0 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7fbd500099c0 tx=0x7fbd50009cd0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 -- 172.21.15.6:0/2307485090 shutdown_connections 2023-09-13T10:01:44.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 --2- 172.21.15.6:0/2307485090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd60101850 0x7fbd60108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 --2- 172.21.15.6:0/2307485090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd600ffcc0 0x7fbd601000e0 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 --2- 172.21.15.6:0/2307485090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60100eb0 0x7fbd60101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 -- 172.21.15.6:0/2307485090 >> 172.21.15.6:0/2307485090 conn(0x7fbd600fb250 msgr2=0x7fbd600fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:44.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 -- 172.21.15.6:0/2307485090 shutdown_connections 2023-09-13T10:01:44.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.627+0000 7fbd648b3700 1 -- 172.21.15.6:0/2307485090 wait complete. 2023-09-13T10:01:44.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 Processor -- start 2023-09-13T10:01:44.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 -- start start 2023-09-13T10:01:44.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600ffcc0 0x7fbd601959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60100eb0 0x7fbd60195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60101850 0x7fbd60067fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd60196640 con 0x7fbd60100eb0 2023-09-13T10:01:44.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600684f0 con 0x7fbd600ffcc0 2023-09-13T10:01:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd648b3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd600686b0 con 0x7fbd60101850 2023-09-13T10:01:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600ffcc0 0x7fbd601959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.628+0000 7fbd5ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60101850 0x7fbd60067fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60101850 0x7fbd60067fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50588/0 (socket says 172.21.15.6:50588) 2023-09-13T10:01:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600ffcc0 0x7fbd601959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41056/0 (socket says 172.21.15.6:41056) 2023-09-13T10:01:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/812768015 learned_addr learned my addr 172.21.15.6:0/812768015 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:44.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60100eb0 0x7fbd60195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/812768015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600ffcc0 msgr2=0x7fbd601959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600ffcc0 0x7fbd601959a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60100eb0 msgr2=0x7fbd60195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60100eb0 0x7fbd60195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/812768015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd500095f0 con 0x7fbd60101850 2023-09-13T10:01:44.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60101850 0x7fbd60067fb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800ef30 tx=0x7fbd5800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd4f7fe700 1 -- 172.21.15.6:0/812768015 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58018070 con 0x7fbd60101850 2023-09-13T10:01:44.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd4f7fe700 1 -- 172.21.15.6:0/812768015 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd5800f040 con 0x7fbd60101850 2023-09-13T10:01:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd4f7fe700 1 -- 172.21.15.6:0/812768015 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5800cd00 con 0x7fbd60101850 2023-09-13T10:01:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.629+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd60068930 con 0x7fbd60101850 2023-09-13T10:01:44.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.630+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd60068dc0 con 0x7fbd60101850 2023-09-13T10:01:44.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.633+0000 7fbd4f7fe700 1 -- 172.21.15.6:0/812768015 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fbd58003a00 con 0x7fbd60101850 2023-09-13T10:01:44.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.633+0000 7fbd4f7fe700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbd480a0640 0x7fbd480a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.634+0000 7fbd4f7fe700 1 -- 172.21.15.6:0/812768015 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbd580cb510 con 0x7fbd60101850 2023-09-13T10:01:44.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.634+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbd480a0640 0x7fbd480a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.634+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbd480a0640 0x7fbd480a2b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009990 tx=0x7fbd50005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.634+0000 7fbd70a98b80 1 Processor -- start 2023-09-13T10:01:44.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.634+0000 7fbd70a98b80 1 -- start start 2023-09-13T10:01:44.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.634+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c4ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c49a00 0x560927c49e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927ba2780 con 0x560927c4b060 2023-09-13T10:01:44.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927ba00a0 con 0x560927c4a700 2023-09-13T10:01:44.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927b9b990 con 0x560927c49a00 2023-09-13T10:01:44.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47542/0 (socket says 172.21.15.6:47542) 2023-09-13T10:01:44.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 -- 172.21.15.6:0/2141921215 learned_addr learned my addr 172.21.15.6:0/2141921215 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:44.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c4ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c49a00 0x560927c49e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 -- 172.21.15.6:0/2141921215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c49a00 msgr2=0x560927c49e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c49a00 0x560927c49e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 -- 172.21.15.6:0/2141921215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 msgr2=0x560927c4ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c4ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 -- 172.21.15.6:0/2141921215 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560927a1b630 con 0x560927c4b060 2023-09-13T10:01:44.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c494c0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009d20 tx=0x7fbd54011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3617c395ceb75 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd4cff9700 1 -- 172.21.15.6:0/2141921215 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd54019630 con 0x560927c4b060 2023-09-13T10:01:44.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd4cff9700 1 -- 172.21.15.6:0/2141921215 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd54019c50 con 0x560927c4b060 2023-09-13T10:01:44.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.635+0000 7fbd4cff9700 1 -- 172.21.15.6:0/2141921215 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5400ec40 con 0x560927c4b060 2023-09-13T10:01:44.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 -- 172.21.15.6:0/2141921215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 msgr2=0x560927c494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c494c0 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fbd54009d20 tx=0x7fbd54011720 comp rx=0 tx=0).stop 2023-09-13T10:01:44.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 -- 172.21.15.6:0/2141921215 shutdown_connections 2023-09-13T10:01:44.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c49a00 0x560927c49e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c4ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/2141921215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c494c0 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 -- 172.21.15.6:0/2141921215 >> 172.21.15.6:0/2141921215 conn(0x560927ba7c80 msgr2=0x560927c43f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:44.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 -- 172.21.15.6:0/2141921215 shutdown_connections 2023-09-13T10:01:44.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.636+0000 7fbd70a98b80 1 -- 172.21.15.6:0/2141921215 wait complete. 2023-09-13T10:01:44.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 -- start start 2023-09-13T10:01:44.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 Processor -- start 2023-09-13T10:01:44.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c52f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c53470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4b060 0x560927c5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927b39bb0 con 0x560927c49a00 2023-09-13T10:01:44.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927b398b0 con 0x560927c4a700 2023-09-13T10:01:44.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927a1d920 con 0x560927c4b060 2023-09-13T10:01:44.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd70a98b80 10 client.0 _ll_register_callbacks cb 0x560927b37680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:44.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c52f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c52f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47546/0 (socket says 172.21.15.6:47546) 2023-09-13T10:01:44.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 -- 172.21.15.6:0/998136431 learned_addr learned my addr 172.21.15.6:0/998136431 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:44.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c53470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4b060 0x560927c5a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 -- 172.21.15.6:0/998136431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4b060 msgr2=0x560927c5a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4b060 0x560927c5a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 -- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 msgr2=0x560927c53470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c53470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.637+0000 7fbd5e59c700 1 -- 172.21.15.6:0/998136431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd54009980 con 0x560927c49a00 2023-09-13T10:01:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c52f30 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fbd60100d10 tx=0x7fbd50009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd8a0c54ee44e61 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd45ffb700 1 -- 172.21.15.6:0/998136431 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50029050 con 0x560927c49a00 2023-09-13T10:01:44.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd45ffb700 1 -- 172.21.15.6:0/998136431 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbd5000f460 con 0x560927c49a00 2023-09-13T10:01:44.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560927c3c670 con 0x560927c49a00 2023-09-13T10:01:44.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd45ffb700 1 -- 172.21.15.6:0/998136431 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd50005720 con 0x560927c49a00 2023-09-13T10:01:44.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd70a98b80 10 client.21159 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:44.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x560927bb37a0 con 0x560927c49a00 2023-09-13T10:01:44.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd45ffb700 1 -- 172.21.15.6:0/998136431 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd5003d020 con 0x560927c49a00 2023-09-13T10:01:44.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd45ffb700 1 -- 172.21.15.6:0/998136431 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd50022710 con 0x560927c49a00 2023-09-13T10:01:44.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd70a98b80 10 client.21159 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:44.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd70a98b80 10 client.21159 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:44.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd70a98b80 20 client.21159 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:44.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.638+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927c5ed80 0x560927c611a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.639+0000 7fbd70a98b80 4 client.21159 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:44.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.639+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560927b94970 con 0x560927c5ed80 2023-09-13T10:01:44.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.639+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927c5ed80 0x560927c611a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.639+0000 7fbd45ffb700 10 client.21159 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:44.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.639+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927c5ed80 0x560927c611a0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a465600165945ca server_cookie=4c5b8facecfe63ee in_seq=0 out_seq=0 2023-09-13T10:01:44.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.641+0000 7fbd45ffb700 1 -- 172.21.15.6:0/998136431 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x560927b94970 con 0x560927c5ed80 2023-09-13T10:01:44.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.641+0000 7fbd45ffb700 10 client.21159 handle_command_reply: tid=0 2023-09-13T10:01:44.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.641+0000 7fbd70a98b80 1 client.21159 shutdown 2023-09-13T10:01:44.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 msgr2=0x560927c52f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c52f30 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fbd60100d10 tx=0x7fbd50009cd0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 shutdown_connections 2023-09-13T10:01:44.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4b060 0x560927c5a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927c5ed80 0x560927c611a0 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c52f30 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/998136431 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4a700 0x560927c53470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 >> 172.21.15.6:0/998136431 conn(0x560927ba7c80 msgr2=0x560927c3e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:44.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd45ffb700 0 client.21159 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:44.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 shutdown_connections 2023-09-13T10:01:44.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 1 -- 172.21.15.6:0/998136431 wait complete. 2023-09-13T10:01:44.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.642+0000 7fbd70a98b80 20 client.21159 trim_cache size 0 max 16384 2023-09-13T10:01:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 Processor -- start 2023-09-13T10:01:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 -- start start 2023-09-13T10:01:44.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c494c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c5a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4b060 0x560927c51bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927c5ea80 con 0x560927c49a00 2023-09-13T10:01:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927c518e0 con 0x560927c4b060 2023-09-13T10:01:44.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.661+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927c45730 con 0x560927c4a700 2023-09-13T10:01:44.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c494c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c494c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47554/0 (socket says 172.21.15.6:47554) 2023-09-13T10:01:44.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 -- 172.21.15.6:0/14438862 learned_addr learned my addr 172.21.15.6:0/14438862 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:44.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c5a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4b060 0x560927c51bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 -- 172.21.15.6:0/14438862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 msgr2=0x560927c5a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c5a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 -- 172.21.15.6:0/14438862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4b060 msgr2=0x560927c51bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4b060 0x560927c51bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 -- 172.21.15.6:0/14438862 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609279c7de0 con 0x560927c49a00 2023-09-13T10:01:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c494c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009ff0 tx=0x7fbd500057e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c87280a08c9567 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd4d7fa700 1 -- 172.21.15.6:0/14438862 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd50029040 con 0x560927c49a00 2023-09-13T10:01:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd4d7fa700 1 -- 172.21.15.6:0/14438862 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd5003d040 con 0x560927c49a00 2023-09-13T10:01:44.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.662+0000 7fbd4d7fa700 1 -- 172.21.15.6:0/14438862 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5000fbe0 con 0x560927c49a00 2023-09-13T10:01:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 -- 172.21.15.6:0/14438862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 msgr2=0x560927c494c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c494c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009ff0 tx=0x7fbd500057e0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 -- 172.21.15.6:0/14438862 shutdown_connections 2023-09-13T10:01:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c4b060 0x560927c51bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c49a00 0x560927c494c0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/14438862 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c5a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 -- 172.21.15.6:0/14438862 >> 172.21.15.6:0/14438862 conn(0x560927ba7c80 msgr2=0x560927c60d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 -- 172.21.15.6:0/14438862 shutdown_connections 2023-09-13T10:01:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.663+0000 7fbd70a98b80 1 -- 172.21.15.6:0/14438862 wait complete. 2023-09-13T10:01:44.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 -- start start 2023-09-13T10:01:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 Processor -- start 2023-09-13T10:01:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c49a00 0x560927c56290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c567d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c597f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927c59d30 con 0x560927c4b060 2023-09-13T10:01:44.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927c59ea0 con 0x560927c49a00 2023-09-13T10:01:44.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x560927c5a060 con 0x560927c4a700 2023-09-13T10:01:44.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd70a98b80 10 client.0 _ll_register_callbacks cb 0x560927b37680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:44.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5e59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c49a00 0x560927c56290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c597f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47564/0 (socket says 172.21.15.6:47564) 2023-09-13T10:01:44.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/3140542326 learned_addr learned my addr 172.21.15.6:0/3140542326 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:44.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5dd9b700 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c567d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/3140542326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 msgr2=0x560927c567d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c567d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/3140542326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c49a00 msgr2=0x560927c56290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:44.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c49a00 0x560927c56290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.664+0000 7fbd5ed9d700 1 -- 172.21.15.6:0/3140542326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560927bb37a0 con 0x560927c4b060 2023-09-13T10:01:44.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd5ed9d700 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c597f0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fbd58095720 tx=0x7fbd58099400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b23b750d7218826a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd45ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:44.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd45ffb700 1 -- 172.21.15.6:0/3140542326 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd58041070 con 0x560927c4b060 2023-09-13T10:01:44.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd45ffb700 1 -- 172.21.15.6:0/3140542326 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fbd58098cb0 con 0x560927c4b060 2023-09-13T10:01:44.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbd54019c50 con 0x560927c4b060 2023-09-13T10:01:44.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd45ffb700 1 -- 172.21.15.6:0/3140542326 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd5809cae0 con 0x560927c4b060 2023-09-13T10:01:44.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 10 client.21165 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:44.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x5609279b0c60 con 0x560927c4b060 2023-09-13T10:01:44.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd45ffb700 1 -- 172.21.15.6:0/3140542326 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fbd5807b080 con 0x560927c4b060 2023-09-13T10:01:44.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd45ffb700 1 -- 172.21.15.6:0/3140542326 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbd580b2070 con 0x560927c4b060 2023-09-13T10:01:44.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 10 client.21165 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:44.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 10 client.21165 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:44.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 20 client.21165 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:44.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927cb3d10 0x560927cb6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 4 client.21165 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:01:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.665+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x560927b55050 con 0x560927cb3d10 2023-09-13T10:01:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.666+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927cb3d10 0x560927cb6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.666+0000 7fbd5e59c700 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927cb3d10 0x560927cb6130 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6eb92bbcc321bb3 server_cookie=df625cb1e7e15714 in_seq=0 out_seq=0 2023-09-13T10:01:44.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.666+0000 7fbd45ffb700 10 client.21165 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.666+0000 7fbd45ffb700 1 -- 172.21.15.6:0/3140542326 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x560927b55050 con 0x560927cb3d10 2023-09-13T10:01:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.666+0000 7fbd45ffb700 10 client.21165 handle_command_reply: tid=0 2023-09-13T10:01:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.666+0000 7fbd70a98b80 1 client.21165 shutdown 2023-09-13T10:01:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 msgr2=0x560927c597f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c597f0 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7fbd58095720 tx=0x7fbd58099400 comp rx=0 tx=0).stop 2023-09-13T10:01:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 shutdown_connections 2023-09-13T10:01:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x560927cb3d10 0x560927cb6130 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x560927c4b060 0x560927c597f0 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x560927c49a00 0x560927c56290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 --2- 172.21.15.6:0/3140542326 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x560927c4a700 0x560927c567d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 >> 172.21.15.6:0/3140542326 conn(0x560927ba7c80 msgr2=0x560927c51bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd45ffb700 0 client.21165 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 shutdown_connections 2023-09-13T10:01:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.667+0000 7fbd70a98b80 1 -- 172.21.15.6:0/3140542326 wait complete. 2023-09-13T10:01:44.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd70a98b80 20 client.21165 trim_cache size 0 max 16384 2023-09-13T10:01:44.689 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:01:44.689 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T10:01:44.689 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T10:01:44.690 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:01:44.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbd480a0640 msgr2=0x7fbd480a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbd480a0640 0x7fbd480a2b00 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fbd50009990 tx=0x7fbd50005fb0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60101850 msgr2=0x7fbd60067fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60101850 0x7fbd60067fb0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbd5800ef30 tx=0x7fbd5800c3a0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 shutdown_connections 2023-09-13T10:01:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd60101850 0x7fbd60067fb0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fbd600ffcc0 0x7fbd601959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.692 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fbd480a0640 0x7fbd480a2b00 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 --2- 172.21.15.6:0/812768015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbd60100eb0 0x7fbd60195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 >> 172.21.15.6:0/812768015 conn(0x7fbd600fb250 msgr2=0x7fbd600fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:44.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 shutdown_connections 2023-09-13T10:01:44.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.668+0000 7fbd648b3700 1 -- 172.21.15.6:0/812768015 wait complete. 2023-09-13T10:01:44.693 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T10:01:44.694 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:01:44.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.853+0000 7fb878edc700 1 -- 172.21.15.6:0/3181399503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874106a70 msgr2=0x7fb874108ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.853+0000 7fb878edc700 1 --2- 172.21.15.6:0/3181399503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874106a70 0x7fb874108ee0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7fb86c00b0a0 tx=0x7fb86c00b3b0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.853+0000 7fb878edc700 1 -- 172.21.15.6:0/3181399503 shutdown_connections 2023-09-13T10:01:44.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.853+0000 7fb878edc700 1 --2- 172.21.15.6:0/3181399503 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874106a70 0x7fb874108ee0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.853+0000 7fb878edc700 1 --2- 172.21.15.6:0/3181399503 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb874101810 0x7fb874103c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.853+0000 7fb878edc700 1 --2- 172.21.15.6:0/3181399503 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb874104140 0x7fb874106530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.853+0000 7fb878edc700 1 -- 172.21.15.6:0/3181399503 >> 172.21.15.6:0/3181399503 conn(0x7fb8740fb220 msgr2=0x7fb8740fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:44.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.854+0000 7fb878edc700 1 -- 172.21.15.6:0/3181399503 shutdown_connections 2023-09-13T10:01:44.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.854+0000 7fb878edc700 1 -- 172.21.15.6:0/3181399503 wait complete. 2023-09-13T10:01:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.854+0000 7fb878edc700 1 Processor -- start 2023-09-13T10:01:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb878edc700 1 -- start start 2023-09-13T10:01:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb878edc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874101810 0x7fb874101180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb878edc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb874104140 0x7fb8740ff7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb878edc700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb874106a70 0x7fb8740ffd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb878edc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741004a0 con 0x7fb874101810 2023-09-13T10:01:44.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb878edc700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb874100610 con 0x7fb874104140 2023-09-13T10:01:44.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb878edc700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8741a0be0 con 0x7fb874106a70 2023-09-13T10:01:44.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb87259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874101810 0x7fb874101180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb87259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874101810 0x7fb874101180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47574/0 (socket says 172.21.15.6:47574) 2023-09-13T10:01:44.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb87259c700 1 -- 172.21.15.6:0/400912046 learned_addr learned my addr 172.21.15.6:0/400912046 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb871d9b700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb874104140 0x7fb8740ff7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb87259c700 1 -- 172.21.15.6:0/400912046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb874106a70 msgr2=0x7fb8740ffd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.862 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb87259c700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb874106a70 0x7fb8740ffd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb87259c700 1 -- 172.21.15.6:0/400912046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb874104140 msgr2=0x7fb8740ff7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.855+0000 7fb87259c700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb874104140 0x7fb8740ff7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:44.863 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.856+0000 7fb87259c700 1 -- 172.21.15.6:0/400912046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb86c009d00 con 0x7fb874101810 2023-09-13T10:01:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.856+0000 7fb87259c700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874101810 0x7fb874101180 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb86400e9a0 tx=0x7fb86400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.856+0000 7fb8637fe700 1 -- 172.21.15.6:0/400912046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb86400cbd0 con 0x7fb874101810 2023-09-13T10:01:44.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.856+0000 7fb8637fe700 1 -- 172.21.15.6:0/400912046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb86400cd30 con 0x7fb874101810 2023-09-13T10:01:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.856+0000 7fb8637fe700 1 -- 172.21.15.6:0/400912046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb864018680 con 0x7fb874101810 2023-09-13T10:01:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.856+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8741a0ec0 con 0x7fb874101810 2023-09-13T10:01:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.856+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8741a12f0 con 0x7fb874101810 2023-09-13T10:01:44.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.858+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8740fcda0 con 0x7fb874101810 2023-09-13T10:01:44.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.859+0000 7fb8637fe700 1 -- 172.21.15.6:0/400912046 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb864010430 con 0x7fb874101810 2023-09-13T10:01:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.860+0000 7fb8637fe700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb85c0a0640 0x7fb85c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.860+0000 7fb871d9b700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb85c0a0640 0x7fb85c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.860+0000 7fb8637fe700 1 -- 172.21.15.6:0/400912046 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb864014070 con 0x7fb874101810 2023-09-13T10:01:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.860+0000 7fb871d9b700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb85c0a0640 0x7fb85c0a2b00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb868007be0 tx=0x7fb8680073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:44.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:44.863+0000 7fb8637fe700 1 -- 172.21.15.6:0/400912046 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fb864095d50 con 0x7fb874101810 2023-09-13T10:01:45.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.171+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb87410c850 con 0x7fb874101810 2023-09-13T10:01:45.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.172+0000 7fb8637fe700 1 -- 172.21.15.6:0/400912046 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+11336 (secure 0 0 0) 0x7fb864099370 con 0x7fb874101810 2023-09-13T10:01:45.173 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:01:45.173 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":70,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":70,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T10:00:12.571896+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:01:45.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.174+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb85c0a0640 msgr2=0x7fb85c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.174+0000 7fb878edc700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb85c0a0640 0x7fb85c0a2b00 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fb868007be0 tx=0x7fb8680073d0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.174+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874101810 msgr2=0x7fb874101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.174+0000 7fb878edc700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874101810 0x7fb874101180 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fb86400e9a0 tx=0x7fb86400ecb0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 shutdown_connections 2023-09-13T10:01:45.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb874106a70 0x7fb8740ffd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb85c0a0640 0x7fb85c0a2b00 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb874101810 0x7fb874101180 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 --2- 172.21.15.6:0/400912046 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb874104140 0x7fb8740ff7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 >> 172.21.15.6:0/400912046 conn(0x7fb8740fb220 msgr2=0x7fb8741024a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 shutdown_connections 2023-09-13T10:01:45.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.177+0000 7fb878edc700 1 -- 172.21.15.6:0/400912046 wait complete. 2023-09-13T10:01:45.180 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 70 2023-09-13T10:01:45.193 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T10:01:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 -- 172.21.15.6:0/3711498414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81013c0 msgr2=0x7f68f81017e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/3711498414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81013c0 0x7f68f81017e0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f68e8009990 tx=0x7f68e8009ca0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 -- 172.21.15.6:0/3711498414 shutdown_connections 2023-09-13T10:01:45.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/3711498414 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f8100290 0x7f68f8108120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/3711498414 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f81013c0 0x7f68f81017e0 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/3711498414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68f80ff8f0 0x7f68f80ffd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 -- 172.21.15.6:0/3711498414 >> 172.21.15.6:0/3711498414 conn(0x7f68f80fb250 msgr2=0x7f68f80fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 -- 172.21.15.6:0/3711498414 shutdown_connections 2023-09-13T10:01:45.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.365+0000 7f68fe8cb700 1 -- 172.21.15.6:0/3711498414 wait complete. 2023-09-13T10:01:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 Processor -- start 2023-09-13T10:01:45.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 -- start start 2023-09-13T10:01:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ff8f0 0x7f68f8195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8100290 0x7f68f8196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68f81013c0 0x7f68f819d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f819d6d0 con 0x7f68f8100290 2023-09-13T10:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f819d810 con 0x7f68f80ff8f0 2023-09-13T10:01:45.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fe8cb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68f819d9a0 con 0x7f68f81013c0 2023-09-13T10:01:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8100290 0x7f68f8196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ff8f0 0x7f68f8195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68fce68700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68f81013c0 0x7f68f819d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8100290 0x7f68f8196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47592/0 (socket says 172.21.15.6:47592) 2023-09-13T10:01:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.366+0000 7f68f77fe700 1 -- 172.21.15.6:0/769551434 learned_addr learned my addr 172.21.15.6:0/769551434 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f77fe700 1 -- 172.21.15.6:0/769551434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68f81013c0 msgr2=0x7f68f819d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f77fe700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68f81013c0 0x7f68f819d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f77fe700 1 -- 172.21.15.6:0/769551434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ff8f0 msgr2=0x7f68f8195b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f77fe700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ff8f0 0x7f68f8195b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f77fe700 1 -- 172.21.15.6:0/769551434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68e80095f0 con 0x7f68f8100290 2023-09-13T10:01:45.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f77fe700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8100290 0x7f68f8196090 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00eab0 tx=0x7f68ec00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f57fa700 1 -- 172.21.15.6:0/769551434 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec013070 con 0x7f68f8100290 2023-09-13T10:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68f8068dd0 con 0x7f68f8100290 2023-09-13T10:01:45.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f8069330 con 0x7f68f8100290 2023-09-13T10:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f57fa700 1 -- 172.21.15.6:0/769551434 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68ec00be80 con 0x7f68f8100290 2023-09-13T10:01:45.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.367+0000 7f68f57fa700 1 -- 172.21.15.6:0/769551434 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0163b0 con 0x7f68f8100290 2023-09-13T10:01:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.372+0000 7f690aab0b80 1 Processor -- start 2023-09-13T10:01:45.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.372+0000 7f690aab0b80 1 -- start start 2023-09-13T10:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.372+0000 7f68f57fa700 1 -- 172.21.15.6:0/769551434 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f68ec00b9c0 con 0x7f68f8100290 2023-09-13T10:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 0x557e38b73b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b72e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f690aab0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38acb780 con 0x557e38b73700 2023-09-13T10:01:45.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f690aab0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38ac90a0 con 0x557e38b74060 2023-09-13T10:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f690aab0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38ac4990 con 0x557e38b72a00 2023-09-13T10:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b72e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.382 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41120/0 (socket says 172.21.15.6:41120) 2023-09-13T10:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 -- 172.21.15.6:0/2260970109 learned_addr learned my addr 172.21.15.6:0/2260970109 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f57fa700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f68e00a4ad0 0x7f68e00a6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 -- 172.21.15.6:0/2260970109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 msgr2=0x557e38b72e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 --2- 172.21.15.6:0/2260970109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b72e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 -- 172.21.15.6:0/2260970109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 msgr2=0x557e38b73b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 --2- 172.21.15.6:0/2260970109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 0x557e38b73b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.384 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.373+0000 7f68f7fff700 1 -- 172.21.15.6:0/2260970109 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e38944630 con 0x557e38b74060 2023-09-13T10:01:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.374+0000 7f68f57fa700 1 -- 172.21.15.6:0/769551434 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f68ec0cae10 con 0x7f68f8100290 2023-09-13T10:01:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.374+0000 7f68fce68700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f68e00a4ad0 0x7f68e00a6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.374+0000 7f68fce68700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f68e00a4ad0 0x7f68e00a6f90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009ec0 tx=0x7f68f0009920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.379+0000 7f68f7fff700 1 --2- 172.21.15.6:0/2260970109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b724c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68f8100d30 tx=0x7f68e8005ea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eeb20737192b01e0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.379+0000 7f68de7fc700 1 -- 172.21.15.6:0/2260970109 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e801d070 con 0x557e38b74060 2023-09-13T10:01:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.379+0000 7f68de7fc700 1 -- 172.21.15.6:0/2260970109 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68e801e040 con 0x557e38b74060 2023-09-13T10:01:45.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.379+0000 7f68de7fc700 1 -- 172.21.15.6:0/2260970109 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e80048f0 con 0x557e38b74060 2023-09-13T10:01:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 -- 172.21.15.6:0/2260970109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 msgr2=0x557e38b724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 --2- 172.21.15.6:0/2260970109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b724c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f68f8100d30 tx=0x7f68e8005ea0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 -- 172.21.15.6:0/2260970109 shutdown_connections 2023-09-13T10:01:45.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 --2- 172.21.15.6:0/2260970109 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b72e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 --2- 172.21.15.6:0/2260970109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 0x557e38b73b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 --2- 172.21.15.6:0/2260970109 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b724c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 -- 172.21.15.6:0/2260970109 >> 172.21.15.6:0/2260970109 conn(0x557e38ad0c80 msgr2=0x557e38b6cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 -- 172.21.15.6:0/2260970109 shutdown_connections 2023-09-13T10:01:45.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.380+0000 7f690aab0b80 1 -- 172.21.15.6:0/2260970109 wait complete. 2023-09-13T10:01:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 -- start start 2023-09-13T10:01:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 Processor -- start 2023-09-13T10:01:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b73700 0x557e38b7c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b83430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38a62bb0 con 0x557e38b72a00 2023-09-13T10:01:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38a628b0 con 0x557e38b74060 2023-09-13T10:01:45.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38946920 con 0x557e38b73700 2023-09-13T10:01:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.381+0000 7f690aab0b80 10 client.0 _ll_register_callbacks cb 0x557e38a60680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b73700 0x557e38b7c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b73700 0x557e38b7c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50658/0 (socket says 172.21.15.6:50658) 2023-09-13T10:01:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 -- 172.21.15.6:0/3043990284 learned_addr learned my addr 172.21.15.6:0/3043990284 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68fce68700 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b83430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 -- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 msgr2=0x557e38b83430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b83430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 -- 172.21.15.6:0/3043990284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 msgr2=0x557e38b7beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 -- 172.21.15.6:0/3043990284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f8108b50 con 0x557e38b73700 2023-09-13T10:01:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68f77fe700 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b73700 0x557e38b7c3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ea80 tx=0x7f68ec098af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27d4fb5b0030e576 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.382+0000 7f68d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f68d77fe700 1 -- 172.21.15.6:0/3043990284 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0948f0 con 0x557e38b73700 2023-09-13T10:01:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e38b65670 con 0x557e38b73700 2023-09-13T10:01:45.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f68d77fe700 1 -- 172.21.15.6:0/3043990284 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f68ec098cb0 con 0x557e38b73700 2023-09-13T10:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f68d77fe700 1 -- 172.21.15.6:0/3043990284 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68ec098380 con 0x557e38b73700 2023-09-13T10:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 10 client.30373 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x557e38adc7a0 con 0x557e38b73700 2023-09-13T10:01:45.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f68d77fe700 1 -- 172.21.15.6:0/3043990284 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x557e38b65670 con 0x557e38b73700 2023-09-13T10:01:45.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f68d77fe700 1 -- 172.21.15.6:0/3043990284 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68ec0830b0 con 0x557e38b73700 2023-09-13T10:01:45.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 10 client.30373 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:45.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 10 client.30373 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:01:45.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 20 client.30373 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:45.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38b87d30 0x557e38b8a150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 4 client.30373 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:45.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.383+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e38abd970 con 0x557e38b87d30 2023-09-13T10:01:45.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.387+0000 7f68f7fff700 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38b87d30 0x557e38b8a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.390+0000 7f68d77fe700 10 client.30373 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:45.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.390+0000 7f68f7fff700 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38b87d30 0x557e38b8a150 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2d53b66c708cf2a8 server_cookie=63d5ab44b2693df3 in_seq=0 out_seq=0 2023-09-13T10:01:45.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f68d77fe700 1 -- 172.21.15.6:0/3043990284 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e38abd970 con 0x557e38b87d30 2023-09-13T10:01:45.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f68d77fe700 10 client.30373 handle_command_reply: tid=0 2023-09-13T10:01:45.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 client.30373 shutdown 2023-09-13T10:01:45.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b73700 msgr2=0x557e38b7c3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b73700 0x557e38b7c3f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00ea80 tx=0x7f68ec098af0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 shutdown_connections 2023-09-13T10:01:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38b87d30 0x557e38b8a150 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b83430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f68d77fe700 0 client.30373 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:45.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3043990284 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b73700 0x557e38b7c3f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 >> 172.21.15.6:0/3043990284 conn(0x557e38ad0c80 msgr2=0x557e38b677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 shutdown_connections 2023-09-13T10:01:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 1 -- 172.21.15.6:0/3043990284 wait complete. 2023-09-13T10:01:45.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.393+0000 7f690aab0b80 20 client.30373 trim_cache size 0 max 16384 2023-09-13T10:01:45.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 Processor -- start 2023-09-13T10:01:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 -- start start 2023-09-13T10:01:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b724c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 0x557e38b83350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b7bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38abd970 con 0x557e38b73700 2023-09-13T10:01:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38b65670 con 0x557e38b74060 2023-09-13T10:01:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.415+0000 7f690aab0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38b7b360 con 0x557e38b72a00 2023-09-13T10:01:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b724c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b724c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50664/0 (socket says 172.21.15.6:50664) 2023-09-13T10:01:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 -- 172.21.15.6:0/3697743904 learned_addr learned my addr 172.21.15.6:0/3697743904 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68fce68700 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b7bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 -- 172.21.15.6:0/3697743904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 msgr2=0x557e38b7bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b7bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 -- 172.21.15.6:0/3697743904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 msgr2=0x557e38b83350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 0x557e38b83350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 -- 172.21.15.6:0/3697743904 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e388f0de0 con 0x557e38b72a00 2023-09-13T10:01:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.416+0000 7f68f7fff700 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b724c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68f8100d30 tx=0x7f68e80058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4231b402917c9ab8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.417+0000 7f68fce68700 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b7bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.417+0000 7f68deffd700 1 -- 172.21.15.6:0/3697743904 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e801d040 con 0x557e38b72a00 2023-09-13T10:01:45.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.417+0000 7f68deffd700 1 -- 172.21.15.6:0/3697743904 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68e80056f0 con 0x557e38b72a00 2023-09-13T10:01:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.417+0000 7f68deffd700 1 -- 172.21.15.6:0/3697743904 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e8004d20 con 0x557e38b72a00 2023-09-13T10:01:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 -- 172.21.15.6:0/3697743904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 msgr2=0x557e38b724c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b724c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f68f8100d30 tx=0x7f68e80058e0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 -- 172.21.15.6:0/3697743904 shutdown_connections 2023-09-13T10:01:45.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b74060 0x557e38b7bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b72a00 0x557e38b724c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 --2- 172.21.15.6:0/3697743904 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b73700 0x557e38b83350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 -- 172.21.15.6:0/3697743904 >> 172.21.15.6:0/3697743904 conn(0x557e38ad0c80 msgr2=0x557e38b768e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 -- 172.21.15.6:0/3697743904 shutdown_connections 2023-09-13T10:01:45.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 -- 172.21.15.6:0/3697743904 wait complete. 2023-09-13T10:01:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.418+0000 7f690aab0b80 1 -- start start 2023-09-13T10:01:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 1 Processor -- start 2023-09-13T10:01:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b73700 0x557e38b7f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b74060 0x557e38b82a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38b82f50 con 0x557e38b72a00 2023-09-13T10:01:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38b830c0 con 0x557e38b73700 2023-09-13T10:01:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e38b83280 con 0x557e38b74060 2023-09-13T10:01:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f690aab0b80 10 client.0 _ll_register_callbacks cb 0x557e38a60680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f68f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47616/0 (socket says 172.21.15.6:47616) 2023-09-13T10:01:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.419+0000 7f68f7fff700 1 -- 172.21.15.6:0/1524335547 learned_addr learned my addr 172.21.15.6:0/1524335547 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.420+0000 7f68f7fff700 1 -- 172.21.15.6:0/1524335547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b74060 msgr2=0x557e38b82a10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:01:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.420+0000 7f68f7fff700 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b74060 0x557e38b82a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.420+0000 7f68f7fff700 1 -- 172.21.15.6:0/1524335547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b73700 msgr2=0x557e38b7f9f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:01:45.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.420+0000 7f68f7fff700 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b73700 0x557e38b7f9f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.420+0000 7f68f7fff700 1 -- 172.21.15.6:0/1524335547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68f0008da0 con 0x557e38b72a00 2023-09-13T10:01:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.422+0000 7f68f7fff700 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7f4b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f68e80098e0 tx=0x7f68e800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceb9e356e114a0b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.422+0000 7f68d77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f68d77fe700 1 -- 172.21.15.6:0/1524335547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68e801d050 con 0x557e38b72a00 2023-09-13T10:01:45.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f68d77fe700 1 -- 172.21.15.6:0/1524335547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f68e800f870 con 0x557e38b72a00 2023-09-13T10:01:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f68e801e040 con 0x557e38b72a00 2023-09-13T10:01:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f68d77fe700 1 -- 172.21.15.6:0/1524335547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68e800fa30 con 0x557e38b72a00 2023-09-13T10:01:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 10 client.21180 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x557e38944630 con 0x557e38b72a00 2023-09-13T10:01:45.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f68d77fe700 1 -- 172.21.15.6:0/1524335547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f68e8044020 con 0x557e38b72a00 2023-09-13T10:01:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f68d77fe700 1 -- 172.21.15.6:0/1524335547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f68e8033040 con 0x557e38b72a00 2023-09-13T10:01:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 10 client.21180 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 10 client.21180 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:01:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 20 client.21180 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38be5280 0x557e38be7670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 4 client.21180 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.423+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557e38a7e050 con 0x557e38be5280 2023-09-13T10:01:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.424+0000 7f68f77fe700 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38be5280 0x557e38be7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.424+0000 7f68f77fe700 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38be5280 0x557e38be7670 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a947c5c528f5b4c6 server_cookie=4a6265ed5a9b520d in_seq=0 out_seq=0 2023-09-13T10:01:45.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.424+0000 7f68d77fe700 10 client.21180 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f68d77fe700 1 -- 172.21.15.6:0/1524335547 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557e38a7e050 con 0x557e38be5280 2023-09-13T10:01:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f68d77fe700 10 client.21180 handle_command_reply: tid=0 2023-09-13T10:01:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 client.21180 shutdown 2023-09-13T10:01:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 msgr2=0x557e38b7f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7f4b0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f68e80098e0 tx=0x7f68e800bf00 comp rx=0 tx=0).stop 2023-09-13T10:01:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 shutdown_connections 2023-09-13T10:01:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x557e38be5280 0x557e38be7670 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e38b74060 0x557e38b82a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e38b72a00 0x557e38b7f4b0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 --2- 172.21.15.6:0/1524335547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e38b73700 0x557e38b7f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 >> 172.21.15.6:0/1524335547 conn(0x557e38ad0c80 msgr2=0x557e38b7bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f68d77fe700 0 client.21180 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:01:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 shutdown_connections 2023-09-13T10:01:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.425+0000 7f690aab0b80 1 -- 172.21.15.6:0/1524335547 wait complete. 2023-09-13T10:01:45.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f690aab0b80 20 client.21180 trim_cache size 0 max 16384 2023-09-13T10:01:45.437 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f68e00a4ad0 msgr2=0x7f68e00a6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f68e00a4ad0 0x7f68e00a6f90 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f68f0009ec0 tx=0x7f68f0009920 comp rx=0 tx=0).stop 2023-09-13T10:01:45.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8100290 msgr2=0x7f68f8196090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8100290 0x7f68f8196090 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f68ec00eab0 tx=0x7f68ec00edc0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 shutdown_connections 2023-09-13T10:01:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68f81013c0 0x7f68f819d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f68f80ff8f0 0x7f68f8195b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f68e00a4ad0 0x7f68e00a6f90 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 --2- 172.21.15.6:0/769551434 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f68f8100290 0x7f68f8196090 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.426+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 >> 172.21.15.6:0/769551434 conn(0x7f68f80fb250 msgr2=0x7f68f8104400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.427+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 shutdown_connections 2023-09-13T10:01:45.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.427+0000 7f68fe8cb700 1 -- 172.21.15.6:0/769551434 wait complete. 2023-09-13T10:01:45.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T10:01:45.449 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:45 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/400912046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:01:45.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:45 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/400912046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:01:45.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:45 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/400912046' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:01:45.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 353898 33.93 MB/sec execute 425 sec latency 74.786 ms 2023-09-13T10:01:45.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 -- 172.21.15.6:0/58497354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a300ffca0 msgr2=0x7f4a301000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 --2- 172.21.15.6:0/58497354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a300ffca0 0x7f4a301000c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009990 tx=0x7f4a20009ca0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 -- 172.21.15.6:0/58497354 shutdown_connections 2023-09-13T10:01:45.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 --2- 172.21.15.6:0/58497354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a30101830 0x7f4a301080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 --2- 172.21.15.6:0/58497354 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a300ffca0 0x7f4a301000c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 --2- 172.21.15.6:0/58497354 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a30100e90 0x7f4a301012f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 -- 172.21.15.6:0/58497354 >> 172.21.15.6:0/58497354 conn(0x7f4a300fb1f0 msgr2=0x7f4a300fd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 -- 172.21.15.6:0/58497354 shutdown_connections 2023-09-13T10:01:45.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.618+0000 7f4a37232700 1 -- 172.21.15.6:0/58497354 wait complete. 2023-09-13T10:01:45.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.619+0000 7f4a37232700 1 Processor -- start 2023-09-13T10:01:45.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a37232700 1 -- start start 2023-09-13T10:01:45.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a37232700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a300ffca0 0x7f4a30069d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a37232700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a30100e90 0x7f4a3019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a37232700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a30101830 0x7f4a301a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a37232700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301a0880 con 0x7f4a30101830 2023-09-13T10:01:45.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a37232700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301a09f0 con 0x7f4a300ffca0 2023-09-13T10:01:45.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a37232700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a301a0bb0 con 0x7f4a30100e90 2023-09-13T10:01:45.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a357cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a30101830 0x7f4a301a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a30100e90 0x7f4a3019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a30100e90 0x7f4a3019dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50684/0 (socket says 172.21.15.6:50684) 2023-09-13T10:01:45.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a2ffff700 1 -- 172.21.15.6:0/2708238002 learned_addr learned my addr 172.21.15.6:0/2708238002 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a357cf700 1 -- 172.21.15.6:0/2708238002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a30100e90 msgr2=0x7f4a3019dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a357cf700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a30100e90 0x7f4a3019dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a357cf700 1 -- 172.21.15.6:0/2708238002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a300ffca0 msgr2=0x7f4a30069d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.620+0000 7f4a357cf700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a300ffca0 0x7f4a30069d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.621+0000 7f4a357cf700 1 -- 172.21.15.6:0/2708238002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a200095f0 con 0x7f4a30101830 2023-09-13T10:01:45.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.621+0000 7f4a357cf700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a30101830 0x7f4a301a01a0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800be00 tx=0x7f4a28009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.621+0000 7f4a2dffb700 1 -- 172.21.15.6:0/2708238002 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800cc10 con 0x7f4a30101830 2023-09-13T10:01:45.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.621+0000 7f4a2dffb700 1 -- 172.21.15.6:0/2708238002 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a2800cd70 con 0x7f4a30101830 2023-09-13T10:01:45.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.621+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a301a0e90 con 0x7f4a30101830 2023-09-13T10:01:45.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.621+0000 7f4a2dffb700 1 -- 172.21.15.6:0/2708238002 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a28012720 con 0x7f4a30101830 2023-09-13T10:01:45.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.621+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a301a1330 con 0x7f4a30101830 2023-09-13T10:01:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.624+0000 7f4a2dffb700 1 -- 172.21.15.6:0/2708238002 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4a28014a00 con 0x7f4a30101830 2023-09-13T10:01:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.624+0000 7f4a2dffb700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a180a0640 0x7f4a180a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.625+0000 7f4a2dffb700 1 -- 172.21.15.6:0/2708238002 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a280cb460 con 0x7f4a30101830 2023-09-13T10:01:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.625+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a180a0640 0x7f4a180a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.625+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a180a0640 0x7f4a180a2b00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098e0 tx=0x7f4a20005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 Processor -- start 2023-09-13T10:01:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 -- start start 2023-09-13T10:01:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723dedb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723dece80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723d45780 con 0x563723ded700 2023-09-13T10:01:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723d430a0 con 0x563723dee060 2023-09-13T10:01:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a43417b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723d3e990 con 0x563723deca00 2023-09-13T10:01:45.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723dedb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723dedb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47636/0 (socket says 172.21.15.6:47636) 2023-09-13T10:01:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 -- 172.21.15.6:0/2772624709 learned_addr learned my addr 172.21.15.6:0/2772624709 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a357cf700 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723dece80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 -- 172.21.15.6:0/2772624709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 msgr2=0x563723dece80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723dece80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 -- 172.21.15.6:0/2772624709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 msgr2=0x563723dec4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dec4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.635 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a34fce700 1 -- 172.21.15.6:0/2772624709 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563723bbe630 con 0x563723ded700 2023-09-13T10:01:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a357cf700 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723dece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:01:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.626+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:01:45.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.627+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723dedb20 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f4a20015000 tx=0x7f4a2001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223c1beea7ac069 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.627+0000 7f4a16ffd700 1 -- 172.21.15.6:0/2772624709 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2001d070 con 0x563723ded700 2023-09-13T10:01:45.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.627+0000 7f4a16ffd700 1 -- 172.21.15.6:0/2772624709 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a20005590 con 0x563723ded700 2023-09-13T10:01:45.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.627+0000 7f4a16ffd700 1 -- 172.21.15.6:0/2772624709 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000faa0 con 0x563723ded700 2023-09-13T10:01:45.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.627+0000 7f4a43417b80 1 -- 172.21.15.6:0/2772624709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 msgr2=0x563723dedb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.627+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723dedb20 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7f4a20015000 tx=0x7f4a2001d000 comp rx=0 tx=0).stop 2023-09-13T10:01:45.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 -- 172.21.15.6:0/2772624709 shutdown_connections 2023-09-13T10:01:45.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723dece80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723dedb20 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2772624709 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dec4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 -- 172.21.15.6:0/2772624709 >> 172.21.15.6:0/2772624709 conn(0x563723d4ac80 msgr2=0x563723de6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 -- 172.21.15.6:0/2772624709 shutdown_connections 2023-09-13T10:01:45.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 -- 172.21.15.6:0/2772624709 wait complete. 2023-09-13T10:01:45.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 -- start start 2023-09-13T10:01:45.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.628+0000 7f4a43417b80 1 Processor -- start 2023-09-13T10:01:45.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723df5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a43417b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723cdcbb0 con 0x563723ded700 2023-09-13T10:01:45.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a43417b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723cdc8b0 con 0x563723dee060 2023-09-13T10:01:45.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a43417b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723bc0920 con 0x563723deca00 2023-09-13T10:01:45.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a43417b80 10 client.0 _ll_register_callbacks cb 0x563723cda680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:45.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723df5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a357cf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723df5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50696/0 (socket says 172.21.15.6:50696) 2023-09-13T10:01:45.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 -- 172.21.15.6:0/1031157413 learned_addr learned my addr 172.21.15.6:0/1031157413 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 -- 172.21.15.6:0/1031157413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 msgr2=0x563723dfc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 -- 172.21.15.6:0/1031157413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 msgr2=0x563723df5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a34fce700 1 -- 172.21.15.6:0/1031157413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a30108a30 con 0x563723deca00 2023-09-13T10:01:45.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T10:01:45.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.629+0000 7f4a357cf700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a34fce700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723df5140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a20005aa0 tx=0x7f4a2000f4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc98cccaf4fa8672 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:45.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a0ffff700 1 -- 172.21.15.6:0/1031157413 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000fa20 con 0x563723deca00 2023-09-13T10:01:45.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563723ddf670 con 0x563723deca00 2023-09-13T10:01:45.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a0ffff700 1 -- 172.21.15.6:0/1031157413 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a2000fb80 con 0x563723deca00 2023-09-13T10:01:45.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a0ffff700 1 -- 172.21.15.6:0/1031157413 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a2000fd40 con 0x563723deca00 2023-09-13T10:01:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a43417b80 10 client.30388 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x563723d567a0 con 0x563723deca00 2023-09-13T10:01:45.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.630+0000 7f4a0ffff700 1 -- 172.21.15.6:0/1031157413 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563723ddf670 con 0x563723deca00 2023-09-13T10:01:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a0ffff700 1 -- 172.21.15.6:0/1031157413 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4a20024420 con 0x563723deca00 2023-09-13T10:01:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a43417b80 10 client.30388 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a43417b80 10 client.30388 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:01:45.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a43417b80 20 client.30388 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a43417b80 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e017b0 0x563723e03bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a43417b80 4 client.30388 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:45.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563723d37970 con 0x563723e017b0 2023-09-13T10:01:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e017b0 0x563723e03bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a0ffff700 10 client.30388 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:45.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.631+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e017b0 0x563723e03bd0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9ed1709315287397 server_cookie=d0680fdc7e35d180 in_seq=0 out_seq=0 2023-09-13T10:01:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.632+0000 7f4a0ffff700 1 -- 172.21.15.6:0/1031157413 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563723d37970 con 0x563723e017b0 2023-09-13T10:01:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.632+0000 7f4a0ffff700 10 client.30388 handle_command_reply: tid=0 2023-09-13T10:01:45.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.632+0000 7f4a43417b80 1 client.30388 shutdown 2023-09-13T10:01:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.632+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 msgr2=0x563723df5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.632+0000 7f4a43417b80 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723df5140 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f4a20005aa0 tx=0x7f4a2000f4d0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 shutdown_connections 2023-09-13T10:01:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e017b0 0x563723e03bd0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723deca00 0x563723df5140 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a0ffff700 0 client.30388 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 --2- 172.21.15.6:0/1031157413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 >> 172.21.15.6:0/1031157413 conn(0x563723d4ac80 msgr2=0x563723de17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 shutdown_connections 2023-09-13T10:01:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 1 -- 172.21.15.6:0/1031157413 wait complete. 2023-09-13T10:01:45.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.633+0000 7f4a43417b80 20 client.30388 trim_cache size 0 max 16384 2023-09-13T10:01:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.649+0000 7f4a43417b80 1 Processor -- start 2023-09-13T10:01:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.649+0000 7f4a43417b80 1 -- start start 2023-09-13T10:01:45.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723deca00 0x563723dec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723ded700 0x563723dfc680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a43417b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723de8fd0 con 0x563723deca00 2023-09-13T10:01:45.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a43417b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723de7a30 con 0x563723dee060 2023-09-13T10:01:45.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a43417b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723de38e0 con 0x563723ded700 2023-09-13T10:01:45.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723deca00 0x563723dec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723deca00 0x563723dec4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47650/0 (socket says 172.21.15.6:47650) 2023-09-13T10:01:45.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 -- 172.21.15.6:0/2567434293 learned_addr learned my addr 172.21.15.6:0/2567434293 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723ded700 0x563723dfc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a357cf700 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 -- 172.21.15.6:0/2567434293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723ded700 msgr2=0x563723dfc680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723ded700 0x563723dfc680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 -- 172.21.15.6:0/2567434293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 msgr2=0x563723dfcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfcfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.650+0000 7f4a34fce700 1 -- 172.21.15.6:0/2567434293 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563723b6ade0 con 0x563723deca00 2023-09-13T10:01:45.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.651+0000 7f4a34fce700 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723deca00 0x563723dec4c0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000b8a0 tx=0x7f4a20005ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f65f7cce185c7d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.651+0000 7f4a177fe700 1 -- 172.21.15.6:0/2567434293 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2001d040 con 0x563723deca00 2023-09-13T10:01:45.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.651+0000 7f4a177fe700 1 -- 172.21.15.6:0/2567434293 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a2003c020 con 0x563723deca00 2023-09-13T10:01:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.651+0000 7f4a177fe700 1 -- 172.21.15.6:0/2567434293 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2000fbf0 con 0x563723deca00 2023-09-13T10:01:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 -- 172.21.15.6:0/2567434293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723deca00 msgr2=0x563723dec4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723deca00 0x563723dec4c0 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4a2000b8a0 tx=0x7f4a20005ca0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 -- 172.21.15.6:0/2567434293 shutdown_connections 2023-09-13T10:01:45.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723dee060 0x563723dfcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723deca00 0x563723dec4c0 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 --2- 172.21.15.6:0/2567434293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723ded700 0x563723dfc680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 -- 172.21.15.6:0/2567434293 >> 172.21.15.6:0/2567434293 conn(0x563723d4ac80 msgr2=0x563723dfddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 -- 172.21.15.6:0/2567434293 shutdown_connections 2023-09-13T10:01:45.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 -- 172.21.15.6:0/2567434293 wait complete. 2023-09-13T10:01:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 -- start start 2023-09-13T10:01:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.652+0000 7f4a43417b80 1 Processor -- start 2023-09-13T10:01:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723deca00 0x563723df68a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a43417b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723dee060 0x563723dfb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a43417b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723dfbcf0 con 0x563723ded700 2023-09-13T10:01:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a43417b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723dfbe60 con 0x563723deca00 2023-09-13T10:01:45.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a43417b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563723dfc020 con 0x563723dee060 2023-09-13T10:01:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a43417b80 10 client.0 _ll_register_callbacks cb 0x563723cda680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a34fce700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723deca00 0x563723df68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df6de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47658/0 (socket says 172.21.15.6:47658) 2023-09-13T10:01:45.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 -- 172.21.15.6:0/4005451708 learned_addr learned my addr 172.21.15.6:0/4005451708 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a357cf700 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723dee060 0x563723dfb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 -- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723dee060 msgr2=0x563723dfb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723dee060 0x563723dfb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.674 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 -- 172.21.15.6:0/4005451708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723deca00 msgr2=0x563723df68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723deca00 0x563723df68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a2ffff700 1 -- 172.21.15.6:0/4005451708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563723d567a0 con 0x563723ded700 2023-09-13T10:01:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.653+0000 7f4a357cf700 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723dee060 0x563723dfb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:45.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a2ffff700 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df6de0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f4a24004790 tx=0x7f4a2401bbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49b3a468bb1051e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a0ffff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a0ffff700 1 -- 172.21.15.6:0/4005451708 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a24016040 con 0x563723ded700 2023-09-13T10:01:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a0ffff700 1 -- 172.21.15.6:0/4005451708 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4a24004a30 con 0x563723ded700 2023-09-13T10:01:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4a20005590 con 0x563723ded700 2023-09-13T10:01:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a0ffff700 1 -- 172.21.15.6:0/4005451708 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a24004bf0 con 0x563723ded700 2023-09-13T10:01:45.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 10 client.21192 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:45.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x563723b53c60 con 0x563723ded700 2023-09-13T10:01:45.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a0ffff700 1 -- 172.21.15.6:0/4005451708 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4a20005590 con 0x563723ded700 2023-09-13T10:01:45.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a0ffff700 1 -- 172.21.15.6:0/4005451708 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f4a24010910 con 0x563723ded700 2023-09-13T10:01:45.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 10 client.21192 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 10 client.21192 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:01:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 20 client.21192 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e9a160 0x563723e9c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 4 client.21192 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.654+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563723cf8050 con 0x563723e9a160 2023-09-13T10:01:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.655+0000 7f4a34fce700 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e9a160 0x563723e9c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.655+0000 7f4a0ffff700 10 client.21192 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.655+0000 7f4a34fce700 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e9a160 0x563723e9c580 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d611a6a5e9648a0e server_cookie=1763fe116deabf34 in_seq=0 out_seq=0 2023-09-13T10:01:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.655+0000 7f4a0ffff700 1 -- 172.21.15.6:0/4005451708 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563723cf8050 con 0x563723e9a160 2023-09-13T10:01:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.655+0000 7f4a0ffff700 10 client.21192 handle_command_reply: tid=0 2023-09-13T10:01:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.655+0000 7f4a43417b80 1 client.21192 shutdown 2023-09-13T10:01:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 msgr2=0x563723df6de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df6de0 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f4a24004790 tx=0x7f4a2401bbe0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 shutdown_connections 2023-09-13T10:01:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563723e9a160 0x563723e9c580 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563723dee060 0x563723dfb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563723deca00 0x563723df68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a0ffff700 0 client.21192 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:01:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 --2- 172.21.15.6:0/4005451708 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563723ded700 0x563723df6de0 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 >> 172.21.15.6:0/4005451708 conn(0x563723d4ac80 msgr2=0x563723dfcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 shutdown_connections 2023-09-13T10:01:45.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 1 -- 172.21.15.6:0/4005451708 wait complete. 2023-09-13T10:01:45.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.656+0000 7f4a43417b80 20 client.21192 trim_cache size 0 max 16384 2023-09-13T10:01:45.683 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:45.684 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a180a0640 msgr2=0x7f4a180a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a180a0640 0x7f4a180a2b00 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f4a200098e0 tx=0x7f4a20005fb0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a30101830 msgr2=0x7f4a301a01a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a30101830 0x7f4a301a01a0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800be00 tx=0x7f4a28009ed0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 shutdown_connections 2023-09-13T10:01:45.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4a180a0640 0x7f4a180a2b00 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4a30101830 0x7f4a301a01a0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4a300ffca0 0x7f4a30069d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 --2- 172.21.15.6:0/2708238002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4a30100e90 0x7f4a3019dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 >> 172.21.15.6:0/2708238002 conn(0x7f4a300fb1f0 msgr2=0x7f4a300fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 shutdown_connections 2023-09-13T10:01:45.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.662+0000 7f4a37232700 1 -- 172.21.15.6:0/2708238002 wait complete. 2023-09-13T10:01:45.687 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T10:01:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 -- 172.21.15.6:0/3165894599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 msgr2=0x7f152c108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 --2- 172.21.15.6:0/3165894599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c108100 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f152400b0d0 tx=0x7f152400b3e0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 -- 172.21.15.6:0/3165894599 shutdown_connections 2023-09-13T10:01:45.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 --2- 172.21.15.6:0/3165894599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c108100 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 --2- 172.21.15.6:0/3165894599 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152c0ffcc0 0x7f152c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 --2- 172.21.15.6:0/3165894599 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c100eb0 0x7f152c101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 -- 172.21.15.6:0/3165894599 >> 172.21.15.6:0/3165894599 conn(0x7f152c0fb210 msgr2=0x7f152c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 -- 172.21.15.6:0/3165894599 shutdown_connections 2023-09-13T10:01:45.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.865+0000 7f1530bd6700 1 -- 172.21.15.6:0/3165894599 wait complete. 2023-09-13T10:01:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 Processor -- start 2023-09-13T10:01:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 -- start start 2023-09-13T10:01:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0ffcc0 0x7f152c10a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152c100eb0 0x7f152c108c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c109150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1098f0 con 0x7f152c101850 2023-09-13T10:01:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c109a60 con 0x7f152c100eb0 2023-09-13T10:01:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f1530bd6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f152c1a0bc0 con 0x7f152c0ffcc0 2023-09-13T10:01:45.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f152ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c109150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f152ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c109150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47672/0 (socket says 172.21.15.6:47672) 2023-09-13T10:01:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152ad9d700 1 -- 172.21.15.6:0/4154169701 learned_addr learned my addr 172.21.15.6:0/4154169701 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.866+0000 7f152a59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0ffcc0 0x7f152c10a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f1521d9b700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152c100eb0 0x7f152c108c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152ad9d700 1 -- 172.21.15.6:0/4154169701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0ffcc0 msgr2=0x7f152c10a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152ad9d700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0ffcc0 0x7f152c10a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152ad9d700 1 -- 172.21.15.6:0/4154169701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152c100eb0 msgr2=0x7f152c108c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152ad9d700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152c100eb0 0x7f152c108c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152ad9d700 1 -- 172.21.15.6:0/4154169701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1524009d00 con 0x7f152c101850 2023-09-13T10:01:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152a59c700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0ffcc0 0x7f152c10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f152ad9d700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c109150 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f1524008eb0 tx=0x7f1524008ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f1523fff700 1 -- 172.21.15.6:0/4154169701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152400e040 con 0x7f152c101850 2023-09-13T10:01:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f152c1a0e40 con 0x7f152c101850 2023-09-13T10:01:45.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f1523fff700 1 -- 172.21.15.6:0/4154169701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f152400bdb0 con 0x7f152c101850 2023-09-13T10:01:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f1523fff700 1 -- 172.21.15.6:0/4154169701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f152401d470 con 0x7f152c101850 2023-09-13T10:01:45.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.867+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f152c1a1270 con 0x7f152c101850 2023-09-13T10:01:45.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.870+0000 7f1523fff700 1 -- 172.21.15.6:0/4154169701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1524005020 con 0x7f152c101850 2023-09-13T10:01:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.871+0000 7f1523fff700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15180a0640 0x7f15180a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.871+0000 7f152a59c700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15180a0640 0x7f15180a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.871+0000 7f1523fff700 1 -- 172.21.15.6:0/4154169701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f15240ccb10 con 0x7f152c101850 2023-09-13T10:01:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.871+0000 7f152a59c700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15180a0640 0x7f15180a2b00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f152c100d10 tx=0x7f151c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.871+0000 7f153cdbbb80 1 Processor -- start 2023-09-13T10:01:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f153cdbbb80 1 -- start start 2023-09-13T10:01:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0ad700 0x55a71c0adb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ae060 0x55a71c0ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0aca00 0x55a71c0ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c005780 con 0x55a71c0ad700 2023-09-13T10:01:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c0030a0 con 0x55a71c0ae060 2023-09-13T10:01:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71bffe990 con 0x55a71c0aca00 2023-09-13T10:01:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0ad700 0x55a71c0adb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0ad700 0x55a71c0adb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47678/0 (socket says 172.21.15.6:47678) 2023-09-13T10:01:45.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 -- 172.21.15.6:0/291477300 learned_addr learned my addr 172.21.15.6:0/291477300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f1521d9b700 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ae060 0x55a71c0ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152ad9d700 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0aca00 0x55a71c0ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 -- 172.21.15.6:0/291477300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0aca00 msgr2=0x55a71c0ace80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0aca00 0x55a71c0ace80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 -- 172.21.15.6:0/291477300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ae060 msgr2=0x55a71c0ac4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ae060 0x55a71c0ac4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.872+0000 7f152a59c700 1 -- 172.21.15.6:0/291477300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a71be7e630 con 0x55a71c0ad700 2023-09-13T10:01:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.873+0000 7f152a59c700 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0ad700 0x55a71c0adb20 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f151c0043d0 tx=0x7f151c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f45dabac9205361 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.873+0000 7f1520d99700 1 -- 172.21.15.6:0/291477300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c003ce0 con 0x55a71c0ad700 2023-09-13T10:01:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.873+0000 7f1520d99700 1 -- 172.21.15.6:0/291477300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f151c003e40 con 0x55a71c0ad700 2023-09-13T10:01:45.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.873+0000 7f1520d99700 1 -- 172.21.15.6:0/291477300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c026900 con 0x55a71c0ad700 2023-09-13T10:01:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 -- 172.21.15.6:0/291477300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0ad700 msgr2=0x55a71c0adb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0ad700 0x55a71c0adb20 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f151c0043d0 tx=0x7f151c014000 comp rx=0 tx=0).stop 2023-09-13T10:01:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 -- 172.21.15.6:0/291477300 shutdown_connections 2023-09-13T10:01:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0aca00 0x55a71c0ace80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0ad700 0x55a71c0adb20 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/291477300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ae060 0x55a71c0ac4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 -- 172.21.15.6:0/291477300 >> 172.21.15.6:0/291477300 conn(0x55a71c00ac80 msgr2=0x55a71c0a6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 -- 172.21.15.6:0/291477300 shutdown_connections 2023-09-13T10:01:45.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 -- 172.21.15.6:0/291477300 wait complete. 2023-09-13T10:01:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.874+0000 7f153cdbbb80 1 -- start start 2023-09-13T10:01:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 1 Processor -- start 2023-09-13T10:01:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71bf9cbb0 con 0x55a71c0aca00 2023-09-13T10:01:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71bf9c8b0 con 0x55a71c0ad700 2023-09-13T10:01:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71be80920 con 0x55a71c0ae060 2023-09-13T10:01:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f153cdbbb80 10 client.0 _ll_register_callbacks cb 0x55a71bf9a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:45.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47684/0 (socket says 172.21.15.6:47684) 2023-09-13T10:01:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 -- 172.21.15.6:0/3581632745 learned_addr learned my addr 172.21.15.6:0/3581632745 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f1521d9b700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152ad9d700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 -- 172.21.15.6:0/3581632745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 msgr2=0x55a71c0bd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 -- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 msgr2=0x55a71c0b64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152a59c700 1 -- 172.21.15.6:0/3581632745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f151c017070 con 0x55a71c0aca00 2023-09-13T10:01:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.875+0000 7f152ad9d700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:45.892 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f152a59c700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b5f60 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f151c005320 tx=0x7f151c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5be15e1ae276ee2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f1511ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f1511ffb700 1 -- 172.21.15.6:0/3581632745 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c02a070 con 0x55a71c0aca00 2023-09-13T10:01:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f1511ffb700 1 -- 172.21.15.6:0/3581632745 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f151c0048e0 con 0x55a71c0aca00 2023-09-13T10:01:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a71c09f670 con 0x55a71c0aca00 2023-09-13T10:01:45.893 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f1511ffb700 1 -- 172.21.15.6:0/3581632745 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f151c004aa0 con 0x55a71c0aca00 2023-09-13T10:01:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 10 client.21204 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55a71c0167a0 con 0x55a71c0aca00 2023-09-13T10:01:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f1511ffb700 1 -- 172.21.15.6:0/3581632745 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55a71c09f670 con 0x55a71c0aca00 2023-09-13T10:01:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f1511ffb700 1 -- 172.21.15.6:0/3581632745 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f151c024020 con 0x55a71c0aca00 2023-09-13T10:01:45.894 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 10 client.21204 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 10 client.21204 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:01:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 20 client.21204 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c0c1c50 0x55a71c0c4070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 4 client.21204 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.876+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a71bff7970 con 0x55a71c0c1c50 2023-09-13T10:01:45.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.877+0000 7f1521d9b700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c0c1c50 0x55a71c0c4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.877+0000 7f1511ffb700 10 client.21204 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.877+0000 7f1521d9b700 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c0c1c50 0x55a71c0c4070 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9874277101c4a196 server_cookie=16e8931da282f82d in_seq=0 out_seq=0 2023-09-13T10:01:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.878+0000 7f1511ffb700 1 -- 172.21.15.6:0/3581632745 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a71bff7970 con 0x55a71c0c1c50 2023-09-13T10:01:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.878+0000 7f1511ffb700 10 client.21204 handle_command_reply: tid=0 2023-09-13T10:01:45.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.878+0000 7f153cdbbb80 1 client.21204 shutdown 2023-09-13T10:01:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.878+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 msgr2=0x55a71c0b5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.878+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b5f60 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f151c005320 tx=0x7f151c005d50 comp rx=0 tx=0).stop 2023-09-13T10:01:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.882+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 shutdown_connections 2023-09-13T10:01:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.882+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c0c1c50 0x55a71c0c4070 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.882+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.883+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b5f60 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.883+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/3581632745 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.882+0000 7f1511ffb700 0 client.21204 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.883+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 >> 172.21.15.6:0/3581632745 conn(0x55a71c00ac80 msgr2=0x55a71c0a17f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.883+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 shutdown_connections 2023-09-13T10:01:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.883+0000 7f153cdbbb80 1 -- 172.21.15.6:0/3581632745 wait complete. 2023-09-13T10:01:45.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.883+0000 7f153cdbbb80 20 client.21204 trim_cache size 0 max 16384 2023-09-13T10:01:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.899+0000 7f153cdbbb80 1 Processor -- start 2023-09-13T10:01:45.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.899+0000 7f153cdbbb80 1 -- start start 2023-09-13T10:01:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0ac4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c0a87c0 con 0x55a71c0aca00 2023-09-13T10:01:45.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c0b14b0 con 0x55a71c0ad700 2023-09-13T10:01:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c0a8970 con 0x55a71c0ae060 2023-09-13T10:01:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0ac4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f1521d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0ac4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47692/0 (socket says 172.21.15.6:47692) 2023-09-13T10:01:45.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 -- 172.21.15.6:0/2154334806 learned_addr learned my addr 172.21.15.6:0/2154334806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152ad9d700 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 -- 172.21.15.6:0/2154334806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 msgr2=0x55a71c0b3de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0b3de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 -- 172.21.15.6:0/2154334806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 msgr2=0x55a71c0bd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0bd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.900+0000 7f152a59c700 1 -- 172.21.15.6:0/2154334806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a71be2ade0 con 0x55a71c0aca00 2023-09-13T10:01:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.901+0000 7f152a59c700 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0ac4c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f151c0043d0 tx=0x7f151c009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd1ff494a56c6f6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.901+0000 7f152159a700 1 -- 172.21.15.6:0/2154334806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c02a070 con 0x55a71c0aca00 2023-09-13T10:01:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.901+0000 7f152159a700 1 -- 172.21.15.6:0/2154334806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f151c02b040 con 0x55a71c0aca00 2023-09-13T10:01:45.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.901+0000 7f152159a700 1 -- 172.21.15.6:0/2154334806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c01e840 con 0x55a71c0aca00 2023-09-13T10:01:45.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- 172.21.15.6:0/2154334806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 msgr2=0x55a71c0ac4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0ac4c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f151c0043d0 tx=0x7f151c009e90 comp rx=0 tx=0).stop 2023-09-13T10:01:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- 172.21.15.6:0/2154334806 shutdown_connections 2023-09-13T10:01:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0b3de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0ac4c0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/2154334806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0bd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- 172.21.15.6:0/2154334806 >> 172.21.15.6:0/2154334806 conn(0x55a71c00ac80 msgr2=0x55a71c0b4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- 172.21.15.6:0/2154334806 shutdown_connections 2023-09-13T10:01:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- 172.21.15.6:0/2154334806 wait complete. 2023-09-13T10:01:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- start start 2023-09-13T10:01:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 Processor -- start 2023-09-13T10:01:45.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c0bbff0 con 0x55a71c0aca00 2023-09-13T10:01:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c0bc160 con 0x55a71c0ad700 2023-09-13T10:01:45.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.902+0000 7f153cdbbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a71c0bc320 con 0x55a71c0ae060 2023-09-13T10:01:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f153cdbbb80 10 client.0 _ll_register_callbacks cb 0x55a71bf9a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f1521d9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47698/0 (socket says 172.21.15.6:47698) 2023-09-13T10:01:45.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 -- 172.21.15.6:0/1963588497 learned_addr learned my addr 172.21.15.6:0/1963588497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152ad9d700 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 -- 172.21.15.6:0/1963588497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 msgr2=0x55a71c0bbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 -- 172.21.15.6:0/1963588497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 msgr2=0x55a71c0b8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:45.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 -- 172.21.15.6:0/1963588497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a71c0167a0 con 0x55a71c0aca00 2023-09-13T10:01:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f152a59c700 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b8550 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f151c016040 tx=0x7f151c005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717ff0bf472f5286 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f1511ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f1511ffb700 1 -- 172.21.15.6:0/1963588497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f151c02a040 con 0x55a71c0aca00 2023-09-13T10:01:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f151c003e40 con 0x55a71c0aca00 2023-09-13T10:01:45.915 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.903+0000 7f1511ffb700 1 -- 172.21.15.6:0/1963588497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f151c0052d0 con 0x55a71c0aca00 2023-09-13T10:01:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f1511ffb700 1 -- 172.21.15.6:0/1963588497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f151c01e7d0 con 0x55a71c0aca00 2023-09-13T10:01:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 10 client.21210 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55a71be13c60 con 0x55a71c0aca00 2023-09-13T10:01:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f1511ffb700 1 -- 172.21.15.6:0/1963588497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f151c003e40 con 0x55a71c0aca00 2023-09-13T10:01:45.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f1511ffb700 1 -- 172.21.15.6:0/1963588497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f151c024040 con 0x55a71c0aca00 2023-09-13T10:01:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 10 client.21210 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 10 client.21210 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:01:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 20 client.21210 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c115a70 0x55a71c117e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:45.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 4 client.21210 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a71bfb8050 con 0x55a71c115a70 2023-09-13T10:01:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.904+0000 7f1521d9b700 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c115a70 0x55a71c117e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.905+0000 7f1511ffb700 10 client.21210 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.905+0000 7f1521d9b700 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c115a70 0x55a71c117e60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f7c9e6467136742f server_cookie=a9be2a30e0920078 in_seq=0 out_seq=0 2023-09-13T10:01:45.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f1511ffb700 1 -- 172.21.15.6:0/1963588497 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55a71bfb8050 con 0x55a71c115a70 2023-09-13T10:01:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f1511ffb700 10 client.21210 handle_command_reply: tid=0 2023-09-13T10:01:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 client.21210 shutdown 2023-09-13T10:01:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 msgr2=0x55a71c0b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b8550 secure :-1 s=READY pgs=1905 cs=0 l=1 rev1=1 crypto rx=0x7f151c016040 tx=0x7f151c005ce0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 shutdown_connections 2023-09-13T10:01:45.919 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55a71c115a70 0x55a71c117e60 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55a71c0ae060 0x55a71c0bbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55a71c0aca00 0x55a71c0b8550 unknown :-1 s=CLOSED pgs=1905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 --2- 172.21.15.6:0/1963588497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55a71c0ad700 0x55a71c0b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 >> 172.21.15.6:0/1963588497 conn(0x55a71c00ac80 msgr2=0x55a71c0b0920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.920 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f1511ffb700 0 client.21210 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:01:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 shutdown_connections 2023-09-13T10:01:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 1 -- 172.21.15.6:0/1963588497 wait complete. 2023-09-13T10:01:45.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.907+0000 7f153cdbbb80 20 client.21210 trim_cache size 0 max 16384 2023-09-13T10:01:45.921 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:45.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15180a0640 msgr2=0x7f15180a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15180a0640 0x7f15180a2b00 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f152c100d10 tx=0x7f151c009260 comp rx=0 tx=0).stop 2023-09-13T10:01:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 msgr2=0x7f152c109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c109150 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f1524008eb0 tx=0x7f1524008ee0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 shutdown_connections 2023-09-13T10:01:45.923 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f15180a0640 0x7f15180a2b00 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f152c101850 0x7f152c109150 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f152c0ffcc0 0x7f152c10a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 --2- 172.21.15.6:0/4154169701 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f152c100eb0 0x7f152c108c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 >> 172.21.15.6:0/4154169701 conn(0x7f152c0fb210 msgr2=0x7f152c1042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:45.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 shutdown_connections 2023-09-13T10:01:45.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:45.908+0000 7f1530bd6700 1 -- 172.21.15.6:0/4154169701 wait complete. 2023-09-13T10:01:45.926 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T10:01:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 -- 172.21.15.6:0/3262964517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 msgr2=0x7fb4d81023e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 --2- 172.21.15.6:0/3262964517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81023e0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc0099c0 tx=0x7fb4cc009cd0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 -- 172.21.15.6:0/3262964517 shutdown_connections 2023-09-13T10:01:46.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 --2- 172.21.15.6:0/3262964517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4d8102920 0x7fb4d81091d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 --2- 172.21.15.6:0/3262964517 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4d8100d90 0x7fb4d81011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 --2- 172.21.15.6:0/3262964517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81023e0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 -- 172.21.15.6:0/3262964517 >> 172.21.15.6:0/3262964517 conn(0x7fb4d80fc300 msgr2=0x7fb4d80fe740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 -- 172.21.15.6:0/3262964517 shutdown_connections 2023-09-13T10:01:46.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.087+0000 7fb4dea57700 1 -- 172.21.15.6:0/3262964517 wait complete. 2023-09-13T10:01:46.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 Processor -- start 2023-09-13T10:01:46.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 -- start start 2023-09-13T10:01:46.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4d8100d90 0x7fb4d8196b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4d8102920 0x7fb4d819e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d819e6f0 con 0x7fb4d8101f80 2023-09-13T10:01:46.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d819e830 con 0x7fb4d8100d90 2023-09-13T10:01:46.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dea57700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4d819e9c0 con 0x7fb4d8102920 2023-09-13T10:01:46.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47714/0 (socket says 172.21.15.6:47714) 2023-09-13T10:01:46.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4d77fe700 1 -- 172.21.15.6:0/2649748243 learned_addr learned my addr 172.21.15.6:0/2649748243 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4d8102920 0x7fb4d819e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.088+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4d8100d90 0x7fb4d8196b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dcff4700 1 -- 172.21.15.6:0/2649748243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4d8100d90 msgr2=0x7fb4d8196b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4d8100d90 0x7fb4d8196b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dcff4700 1 -- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 msgr2=0x7fb4d81970b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81970b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dcff4700 1 -- 172.21.15.6:0/2649748243 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4cc0095f0 con 0x7fb4d8102920 2023-09-13T10:01:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:46.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4d8102920 0x7fb4d819e120 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000b330 tx=0x7fb4d000b640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4d57fa700 1 -- 172.21.15.6:0/2649748243 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0015070 con 0x7fb4d8102920 2023-09-13T10:01:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4d8072ee0 con 0x7fb4d8102920 2023-09-13T10:01:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4d57fa700 1 -- 172.21.15.6:0/2649748243 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4d000bdd0 con 0x7fb4d8102920 2023-09-13T10:01:46.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4d57fa700 1 -- 172.21.15.6:0/2649748243 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0007c20 con 0x7fb4d8102920 2023-09-13T10:01:46.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.089+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d80733a0 con 0x7fb4d8102920 2023-09-13T10:01:46.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.092+0000 7fb4d57fa700 1 -- 172.21.15.6:0/2649748243 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fb4d0007500 con 0x7fb4d8102920 2023-09-13T10:01:46.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 Processor -- start 2023-09-13T10:01:46.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4d57fa700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb4c00a0640 0x7fb4c00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 -- start start 2023-09-13T10:01:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4d57fa700 1 -- 172.21.15.6:0/2649748243 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb4d00cf410 con 0x7fb4d8102920 2023-09-13T10:01:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3deb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3dde80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e336780 con 0x56532e3de700 2023-09-13T10:01:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e3340a0 con 0x56532e3dda00 2023-09-13T10:01:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e32f990 con 0x56532e3df060 2023-09-13T10:01:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.093+0000 7fb4d7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3deb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3deb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47718/0 (socket says 172.21.15.6:47718) 2023-09-13T10:01:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 -- 172.21.15.6:0/1411779454 learned_addr learned my addr 172.21.15.6:0/1411779454 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb4c00a0640 0x7fb4c00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3dde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 -- 172.21.15.6:0/1411779454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 msgr2=0x56532e3dd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3dd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 -- 172.21.15.6:0/1411779454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 msgr2=0x56532e3dde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3dde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 -- 172.21.15.6:0/1411779454 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56532e1af630 con 0x56532e3de700 2023-09-13T10:01:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb4c00a0640 0x7fb4c00a2b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004800 tx=0x7fb4cc00bc80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3deb20 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009ac0 tx=0x7fb4c8009dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=734133cfae5de6f2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4be7fc700 1 -- 172.21.15.6:0/1411779454 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c8009590 con 0x56532e3de700 2023-09-13T10:01:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.094+0000 7fb4be7fc700 1 -- 172.21.15.6:0/1411779454 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4c8017c60 con 0x56532e3de700 2023-09-13T10:01:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.095+0000 7fb4be7fc700 1 -- 172.21.15.6:0/1411779454 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4c801f880 con 0x56532e3de700 2023-09-13T10:01:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.095+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1411779454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 msgr2=0x56532e3deb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.095+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3deb20 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fb4c8009ac0 tx=0x7fb4c8009dd0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1411779454 shutdown_connections 2023-09-13T10:01:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3dde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3deb20 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1411779454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3dd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1411779454 >> 172.21.15.6:0/1411779454 conn(0x56532e33bc80 msgr2=0x56532e3d7f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1411779454 shutdown_connections 2023-09-13T10:01:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1411779454 wait complete. 2023-09-13T10:01:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 -- start start 2023-09-13T10:01:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.096+0000 7fb4eac3cb80 1 Processor -- start 2023-09-13T10:01:46.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3f7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3f8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3ff480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e2cdbb0 con 0x56532e3de700 2023-09-13T10:01:46.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e2cd8b0 con 0x56532e3dda00 2023-09-13T10:01:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e1b1920 con 0x56532e3df060 2023-09-13T10:01:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4eac3cb80 10 client.0 _ll_register_callbacks cb 0x56532e2cb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3f8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47728/0 (socket says 172.21.15.6:47728) 2023-09-13T10:01:46.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3f7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 -- 172.21.15.6:0/1400040958 learned_addr learned my addr 172.21.15.6:0/1400040958 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3ff480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 -- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 msgr2=0x56532e3ff480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3ff480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 -- 172.21.15.6:0/1400040958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 msgr2=0x56532e3f7f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3f7f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.097+0000 7fb4d77fe700 1 -- 172.21.15.6:0/1400040958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4c80096f0 con 0x56532e3de700 2023-09-13T10:01:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3f8440 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00f650 tx=0x7fb4cc005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e256fa116f1eb637 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:46.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4b77fe700 1 -- 172.21.15.6:0/1400040958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc005230 con 0x56532e3de700 2023-09-13T10:01:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4b77fe700 1 -- 172.21.15.6:0/1400040958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb4cc005390 con 0x56532e3de700 2023-09-13T10:01:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56532e3d0670 con 0x56532e3de700 2023-09-13T10:01:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4b77fe700 1 -- 172.21.15.6:0/1400040958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4cc005550 con 0x56532e3de700 2023-09-13T10:01:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4eac3cb80 10 client.21222 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:46.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56532e3477a0 con 0x56532e3de700 2023-09-13T10:01:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4b77fe700 1 -- 172.21.15.6:0/1400040958 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4cc041080 con 0x56532e3de700 2023-09-13T10:01:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4b77fe700 1 -- 172.21.15.6:0/1400040958 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb4cc028cd0 con 0x56532e3de700 2023-09-13T10:01:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4eac3cb80 10 client.21222 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4eac3cb80 10 client.21222 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:01:46.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.098+0000 7fb4eac3cb80 20 client.21222 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.099+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e403d00 0x56532e406120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.099+0000 7fb4eac3cb80 4 client.21222 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.099+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56532e328970 con 0x56532e403d00 2023-09-13T10:01:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.099+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e403d00 0x56532e406120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.099+0000 7fb4b77fe700 10 client.21222 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.099+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e403d00 0x56532e406120 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=234a4eba39c49743 server_cookie=6460e9909b8a247a in_seq=0 out_seq=0 2023-09-13T10:01:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4b77fe700 1 -- 172.21.15.6:0/1400040958 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56532e328970 con 0x56532e403d00 2023-09-13T10:01:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4b77fe700 10 client.21222 handle_command_reply: tid=0 2023-09-13T10:01:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 client.21222 shutdown 2023-09-13T10:01:46.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 msgr2=0x56532e3f8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3f8440 secure :-1 s=READY pgs=1908 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00f650 tx=0x7fb4cc005fb0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 shutdown_connections 2023-09-13T10:01:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e403d00 0x56532e406120 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3df060 0x56532e3ff480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4b77fe700 0 client.21222 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3f7f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/1400040958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3de700 0x56532e3f8440 unknown :-1 s=CLOSED pgs=1908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 >> 172.21.15.6:0/1400040958 conn(0x56532e33bc80 msgr2=0x56532e3d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 shutdown_connections 2023-09-13T10:01:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.100+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/1400040958 wait complete. 2023-09-13T10:01:46.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.101+0000 7fb4eac3cb80 20 client.21222 trim_cache size 0 max 16384 2023-09-13T10:01:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 Processor -- start 2023-09-13T10:01:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 -- start start 2023-09-13T10:01:46.127 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3dda00 0x56532e3dd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3de700 0x56532e3ff440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3f7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e3d8c80 con 0x56532e3df060 2023-09-13T10:01:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e3f73b0 con 0x56532e3de700 2023-09-13T10:01:46.128 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e3f7aa0 con 0x56532e3dda00 2023-09-13T10:01:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4dcff4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3f7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4dcff4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3f7ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47738/0 (socket says 172.21.15.6:47738) 2023-09-13T10:01:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4dcff4700 1 -- 172.21.15.6:0/2862517960 learned_addr learned my addr 172.21.15.6:0/2862517960 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3dda00 0x56532e3dd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.129 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.119+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3de700 0x56532e3ff440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4dcff4700 1 -- 172.21.15.6:0/2862517960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3dda00 msgr2=0x56532e3dd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3dda00 0x56532e3dd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4dcff4700 1 -- 172.21.15.6:0/2862517960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3de700 msgr2=0x56532e3ff440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3de700 0x56532e3ff440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4dcff4700 1 -- 172.21.15.6:0/2862517960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56532e15bde0 con 0x56532e3df060 2023-09-13T10:01:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3f7ec0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00cd230 tx=0x7fb4d009c590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af48826145b055ac server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4beffd700 1 -- 172.21.15.6:0/2862517960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0010300 con 0x56532e3df060 2023-09-13T10:01:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4beffd700 1 -- 172.21.15.6:0/2862517960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4d009cbb0 con 0x56532e3df060 2023-09-13T10:01:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.120+0000 7fb4beffd700 1 -- 172.21.15.6:0/2862517960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d009af50 con 0x56532e3df060 2023-09-13T10:01:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/2862517960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 msgr2=0x56532e3f7ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3f7ec0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fb4d00cd230 tx=0x7fb4d009c590 comp rx=0 tx=0).stop 2023-09-13T10:01:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/2862517960 shutdown_connections 2023-09-13T10:01:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3f7ec0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3dda00 0x56532e3dd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/2862517960 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3de700 0x56532e3ff440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/2862517960 >> 172.21.15.6:0/2862517960 conn(0x56532e33bc80 msgr2=0x56532e3d7e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/2862517960 shutdown_connections 2023-09-13T10:01:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/2862517960 wait complete. 2023-09-13T10:01:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 -- start start 2023-09-13T10:01:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.121+0000 7fb4eac3cb80 1 Processor -- start 2023-09-13T10:01:46.133 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3fee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3de700 0x56532e3ff3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4eac3cb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3fb910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e3fc020 con 0x56532e3df060 2023-09-13T10:01:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e3fc190 con 0x56532e3dda00 2023-09-13T10:01:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4eac3cb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56532e3fc350 con 0x56532e3de700 2023-09-13T10:01:46.134 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4eac3cb80 10 client.0 _ll_register_callbacks cb 0x56532e2cb680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3fb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4d7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3fee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3fb910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47744/0 (socket says 172.21.15.6:47744) 2023-09-13T10:01:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4d7fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3fee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41264/0 (socket says 172.21.15.6:41264) 2023-09-13T10:01:46.135 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 -- 172.21.15.6:0/307542620 learned_addr learned my addr 172.21.15.6:0/307542620 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4d77fe700 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3de700 0x56532e3ff3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 -- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3de700 msgr2=0x56532e3ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3de700 0x56532e3ff3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 -- 172.21.15.6:0/307542620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 msgr2=0x56532e3fee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.136 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3fee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 -- 172.21.15.6:0/307542620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4d80733a0 con 0x56532e3df060 2023-09-13T10:01:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4dcff4700 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3fb910 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009510 tx=0x7fb4d0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be728dcc2baf7328 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.122+0000 7fb4b77fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4b77fe700 1 -- 172.21.15.6:0/307542620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d00a4c20 con 0x56532e3df060 2023-09-13T10:01:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4b77fe700 1 -- 172.21.15.6:0/307542620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fb4d0010300 con 0x56532e3df060 2023-09-13T10:01:46.137 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb4c8017c60 con 0x56532e3df060 2023-09-13T10:01:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4b77fe700 1 -- 172.21.15.6:0/307542620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4d0009560 con 0x56532e3df060 2023-09-13T10:01:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 10 client.21228 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56532e144c60 con 0x56532e3df060 2023-09-13T10:01:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4b77fe700 1 -- 172.21.15.6:0/307542620 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fb4d007f080 con 0x56532e3df060 2023-09-13T10:01:46.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4b77fe700 1 -- 172.21.15.6:0/307542620 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fb4d00b8070 con 0x56532e3df060 2023-09-13T10:01:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 10 client.21228 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 10 client.21228 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:01:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 20 client.21228 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e458e40 0x56532e45b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 4 client.21228 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.123+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56532e2e9050 con 0x56532e458e40 2023-09-13T10:01:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e458e40 0x56532e45b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4d7fff700 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e458e40 0x56532e45b260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f787401dc2f4292 server_cookie=d7027add6b9a4990 in_seq=0 out_seq=0 2023-09-13T10:01:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4b77fe700 10 client.21228 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4b77fe700 1 -- 172.21.15.6:0/307542620 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56532e2e9050 con 0x56532e458e40 2023-09-13T10:01:46.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4b77fe700 10 client.21228 handle_command_reply: tid=0 2023-09-13T10:01:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 client.21228 shutdown 2023-09-13T10:01:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 msgr2=0x56532e3fb910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3fb910 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fb4d0009510 tx=0x7fb4d0007f40 comp rx=0 tx=0).stop 2023-09-13T10:01:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 shutdown_connections 2023-09-13T10:01:46.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x56532e458e40 0x56532e45b260 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56532e3df060 0x56532e3fb910 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56532e3dda00 0x56532e3fee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 --2- 172.21.15.6:0/307542620 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56532e3de700 0x56532e3ff3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 >> 172.21.15.6:0/307542620 conn(0x56532e33bc80 msgr2=0x56532e3e1920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4b77fe700 0 client.21228 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:01:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.124+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 shutdown_connections 2023-09-13T10:01:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4eac3cb80 1 -- 172.21.15.6:0/307542620 wait complete. 2023-09-13T10:01:46.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4eac3cb80 20 client.21228 trim_cache size 0 max 16384 2023-09-13T10:01:46.143 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb4c00a0640 msgr2=0x7fb4c00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb4c00a0640 0x7fb4c00a2b00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc004800 tx=0x7fb4cc00bc80 comp rx=0 tx=0).stop 2023-09-13T10:01:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4d8102920 msgr2=0x7fb4d819e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4d8102920 0x7fb4d819e120 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000b330 tx=0x7fb4d000b640 comp rx=0 tx=0).stop 2023-09-13T10:01:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 shutdown_connections 2023-09-13T10:01:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4d8102920 0x7fb4d819e120 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fb4d8100d90 0x7fb4d8196b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fb4c00a0640 0x7fb4c00a2b00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 --2- 172.21.15.6:0/2649748243 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4d8101f80 0x7fb4d81970b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.125+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 >> 172.21.15.6:0/2649748243 conn(0x7fb4d80fc300 msgr2=0x7fb4d81054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.126+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 shutdown_connections 2023-09-13T10:01:46.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.126+0000 7fb4dea57700 1 -- 172.21.15.6:0/2649748243 wait complete. 2023-09-13T10:01:46.147 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T10:01:46.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 -- 172.21.15.6:0/1292332512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44102960 msgr2=0x7f0b44109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/1292332512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44102960 0x7f0b44109210 secure :-1 s=READY pgs=1911 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00b0d0 tx=0x7f0b3c00b3e0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 -- 172.21.15.6:0/1292332512 shutdown_connections 2023-09-13T10:01:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/1292332512 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44102960 0x7f0b44109210 unknown :-1 s=CLOSED pgs=1911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/1292332512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b44100dd0 0x7f0b441011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/1292332512 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44101fc0 0x7f0b44102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 -- 172.21.15.6:0/1292332512 >> 172.21.15.6:0/1292332512 conn(0x7f0b440fc320 msgr2=0x7f0b440fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 -- 172.21.15.6:0/1292332512 shutdown_connections 2023-09-13T10:01:46.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.312+0000 7f0b4a45b700 1 -- 172.21.15.6:0/1292332512 wait complete. 2023-09-13T10:01:46.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 Processor -- start 2023-09-13T10:01:46.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 -- start start 2023-09-13T10:01:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b44100dd0 0x7f0b44198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44101fc0 0x7f0b441992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44102960 0x7f0b441a0310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b441a08e0 con 0x7f0b44101fc0 2023-09-13T10:01:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b441a0a50 con 0x7f0b44102960 2023-09-13T10:01:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.313+0000 7f0b4a45b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b441a0c10 con 0x7f0b44100dd0 2023-09-13T10:01:46.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44101fc0 0x7f0b441992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44101fc0 0x7f0b441992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47756/0 (socket says 172.21.15.6:47756) 2023-09-13T10:01:46.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 -- 172.21.15.6:0/2049673405 learned_addr learned my addr 172.21.15.6:0/2049673405 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b44100dd0 0x7f0b44198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b489f8700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44102960 0x7f0b441a0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 -- 172.21.15.6:0/2049673405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b44100dd0 msgr2=0x7f0b44198da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b44100dd0 0x7f0b44198da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 -- 172.21.15.6:0/2049673405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44102960 msgr2=0x7f0b441a0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44102960 0x7f0b441a0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 -- 172.21.15.6:0/2049673405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b3c009d00 con 0x7f0b44101fc0 2023-09-13T10:01:46.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b489f8700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44102960 0x7f0b441a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:01:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b43fff700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b44100dd0 0x7f0b44198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b437fe700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44101fc0 0x7f0b441992e0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800e9a0 tx=0x7f0b3800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b417fa700 1 -- 172.21.15.6:0/2049673405 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38009790 con 0x7f0b44101fc0 2023-09-13T10:01:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b417fa700 1 -- 172.21.15.6:0/2049673405 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b3800cbd0 con 0x7f0b44101fc0 2023-09-13T10:01:46.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b441a0ef0 con 0x7f0b44101fc0 2023-09-13T10:01:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b417fa700 1 -- 172.21.15.6:0/2049673405 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38018680 con 0x7f0b44101fc0 2023-09-13T10:01:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.314+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b441a1310 con 0x7f0b44101fc0 2023-09-13T10:01:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.317+0000 7f0b417fa700 1 -- 172.21.15.6:0/2049673405 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f0b3800cd40 con 0x7f0b44101fc0 2023-09-13T10:01:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.317+0000 7f0b417fa700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b2c0a0640 0x7f0b2c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.318+0000 7f0b417fa700 1 -- 172.21.15.6:0/2049673405 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0b38014070 con 0x7f0b44101fc0 2023-09-13T10:01:46.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.318+0000 7f0b43fff700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b2c0a0640 0x7f0b2c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.318+0000 7f0b43fff700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b2c0a0640 0x7f0b2c0a2b00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0b4419a270 tx=0x7f0b34009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.318+0000 7f0b56640b80 1 Processor -- start 2023-09-13T10:01:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.318+0000 7f0b56640b80 1 -- start start 2023-09-13T10:01:46.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c21ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c2194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c219e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b56640b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c172780 con 0x55974c21b060 2023-09-13T10:01:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b56640b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c1700a0 con 0x55974c219a00 2023-09-13T10:01:46.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b56640b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c16b990 con 0x55974c21a700 2023-09-13T10:01:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c2194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c2194c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47764/0 (socket says 172.21.15.6:47764) 2023-09-13T10:01:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 -- 172.21.15.6:0/603347257 learned_addr learned my addr 172.21.15.6:0/603347257 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b489f8700 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c219e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 -- 172.21.15.6:0/603347257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 msgr2=0x55974c21ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c21ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 -- 172.21.15.6:0/603347257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 msgr2=0x55974c219e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c219e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 -- 172.21.15.6:0/603347257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974bfeb630 con 0x55974c21b060 2023-09-13T10:01:46.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b489f8700 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c219e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:01:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b437fe700 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c2194c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f0b380960c0 tx=0x7f0b38095ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=566a3f7859326192 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.319+0000 7f0b2a7fc700 1 -- 172.21.15.6:0/603347257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38082ea0 con 0x55974c21b060 2023-09-13T10:01:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b2a7fc700 1 -- 172.21.15.6:0/603347257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b38099650 con 0x55974c21b060 2023-09-13T10:01:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b2a7fc700 1 -- 172.21.15.6:0/603347257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38098b40 con 0x55974c21b060 2023-09-13T10:01:46.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b56640b80 1 -- 172.21.15.6:0/603347257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 msgr2=0x55974c2194c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b56640b80 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c2194c0 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f0b380960c0 tx=0x7f0b38095ac0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b56640b80 1 -- 172.21.15.6:0/603347257 shutdown_connections 2023-09-13T10:01:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b56640b80 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c219e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b56640b80 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c21ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b56640b80 1 --2- 172.21.15.6:0/603347257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c2194c0 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.320+0000 7f0b56640b80 1 -- 172.21.15.6:0/603347257 >> 172.21.15.6:0/603347257 conn(0x55974c177c80 msgr2=0x55974c213f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 -- 172.21.15.6:0/603347257 shutdown_connections 2023-09-13T10:01:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 -- 172.21.15.6:0/603347257 wait complete. 2023-09-13T10:01:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 -- start start 2023-09-13T10:01:46.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 Processor -- start 2023-09-13T10:01:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c222f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c2234a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c109bb0 con 0x55974c21b060 2023-09-13T10:01:46.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c1098b0 con 0x55974c219a00 2023-09-13T10:01:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.321+0000 7f0b56640b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974bfed920 con 0x55974c21a700 2023-09-13T10:01:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b56640b80 10 client.0 _ll_register_callbacks cb 0x55974c107680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c2234a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c222f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b489f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c2234a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50824/0 (socket says 172.21.15.6:50824) 2023-09-13T10:01:46.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 -- 172.21.15.6:0/529495609 learned_addr learned my addr 172.21.15.6:0/529495609 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 -- 172.21.15.6:0/529495609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 msgr2=0x55974c222f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c222f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 -- 172.21.15.6:0/529495609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 msgr2=0x55974c22a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 -- 172.21.15.6:0/529495609 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b441a1310 con 0x55974c21a700 2023-09-13T10:01:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b437fe700 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c2234a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0b38099cb0 tx=0x7f0b38099e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=13b283e50b18a50d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b237fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:46.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b237fe700 1 -- 172.21.15.6:0/529495609 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b380a1430 con 0x55974c21a700 2023-09-13T10:01:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b237fe700 1 -- 172.21.15.6:0/529495609 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0b3809d480 con 0x55974c21a700 2023-09-13T10:01:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.322+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55974c20c670 con 0x55974c21a700 2023-09-13T10:01:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b237fe700 1 -- 172.21.15.6:0/529495609 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b380a16c0 con 0x55974c21a700 2023-09-13T10:01:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 10 client.30439 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:46.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55974c1837a0 con 0x55974c21a700 2023-09-13T10:01:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b237fe700 1 -- 172.21.15.6:0/529495609 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55974c20c670 con 0x55974c21a700 2023-09-13T10:01:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b237fe700 1 -- 172.21.15.6:0/529495609 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b380985b0 con 0x55974c21a700 2023-09-13T10:01:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 10 client.30439 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 10 client.30439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:46.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 20 client.30439 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c22eb00 0x55974c230f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 4 client.30439 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55974c164970 con 0x55974c22eb00 2023-09-13T10:01:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.323+0000 7f0b43fff700 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c22eb00 0x55974c230f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.324+0000 7f0b237fe700 10 client.30439 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.324+0000 7f0b43fff700 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c22eb00 0x55974c230f20 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d43069061bc88ff server_cookie=8046dcecd78b30fc in_seq=0 out_seq=0 2023-09-13T10:01:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.325+0000 7f0b237fe700 1 -- 172.21.15.6:0/529495609 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55974c164970 con 0x55974c22eb00 2023-09-13T10:01:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.325+0000 7f0b237fe700 10 client.30439 handle_command_reply: tid=0 2023-09-13T10:01:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 client.30439 shutdown 2023-09-13T10:01:46.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 msgr2=0x55974c2234a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c2234a0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0b38099cb0 tx=0x7f0b38099e10 comp rx=0 tx=0).stop 2023-09-13T10:01:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 shutdown_connections 2023-09-13T10:01:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c22eb00 0x55974c230f20 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c222f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 --2- 172.21.15.6:0/529495609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21a700 0x55974c2234a0 secure :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0b38099cb0 tx=0x7f0b38099e10 comp rx=0 tx=0).stop 2023-09-13T10:01:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 >> 172.21.15.6:0/529495609 conn(0x55974c177c80 msgr2=0x55974c20e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.326+0000 7f0b237fe700 0 client.30439 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.327+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 shutdown_connections 2023-09-13T10:01:46.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.328+0000 7f0b56640b80 1 -- 172.21.15.6:0/529495609 wait complete. 2023-09-13T10:01:46.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.330+0000 7f0b56640b80 20 client.30439 trim_cache size 0 max 16384 2023-09-13T10:01:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 Processor -- start 2023-09-13T10:01:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 -- start start 2023-09-13T10:01:46.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c2194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21d920 0x55974c21dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c21e2c0 con 0x55974c21b060 2023-09-13T10:01:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c223bc0 con 0x55974c219a00 2023-09-13T10:01:46.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.346+0000 7f0b56640b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c215730 con 0x55974c21d920 2023-09-13T10:01:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c2194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47780/0 (socket says 172.21.15.6:47780) 2023-09-13T10:01:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c2194c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41300/0 (socket says 172.21.15.6:41300) 2023-09-13T10:01:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b489f8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21d920 0x55974c21dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 -- 172.21.15.6:0/3089912078 learned_addr learned my addr 172.21.15.6:0/3089912078 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 -- 172.21.15.6:0/3089912078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21d920 msgr2=0x55974c21dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 --2- 172.21.15.6:0/3089912078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21d920 0x55974c21dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 -- 172.21.15.6:0/3089912078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 msgr2=0x55974c2194c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 --2- 172.21.15.6:0/3089912078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c2194c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 -- 172.21.15.6:0/3089912078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55974bf97de0 con 0x55974c21b060 2023-09-13T10:01:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b437fe700 1 --2- 172.21.15.6:0/3089912078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4a0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f0b380a1190 tx=0x7f0b380979f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d79952a3c7c4adc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.347+0000 7f0b2affd700 1 -- 172.21.15.6:0/3089912078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b38097ad0 con 0x55974c21b060 2023-09-13T10:01:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b2affd700 1 -- 172.21.15.6:0/3089912078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b3809d480 con 0x55974c21b060 2023-09-13T10:01:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b2affd700 1 -- 172.21.15.6:0/3089912078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b380985b0 con 0x55974c21b060 2023-09-13T10:01:46.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 -- 172.21.15.6:0/3089912078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 msgr2=0x55974c22a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 --2- 172.21.15.6:0/3089912078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4a0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7f0b380a1190 tx=0x7f0b380979f0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 -- 172.21.15.6:0/3089912078 shutdown_connections 2023-09-13T10:01:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 --2- 172.21.15.6:0/3089912078 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c21d920 0x55974c21dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 --2- 172.21.15.6:0/3089912078 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c219a00 0x55974c2194c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 --2- 172.21.15.6:0/3089912078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21b060 0x55974c22a4a0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 -- 172.21.15.6:0/3089912078 >> 172.21.15.6:0/3089912078 conn(0x55974c177c80 msgr2=0x55974c221bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 -- 172.21.15.6:0/3089912078 shutdown_connections 2023-09-13T10:01:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.348+0000 7f0b56640b80 1 -- 172.21.15.6:0/3089912078 wait complete. 2023-09-13T10:01:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 -- start start 2023-09-13T10:01:46.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 Processor -- start 2023-09-13T10:01:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c219a00 0x55974c226130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c21b060 0x55974c226670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21d920 0x55974c229690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c229bd0 con 0x55974c21d920 2023-09-13T10:01:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c229d40 con 0x55974c21b060 2023-09-13T10:01:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.349+0000 7f0b56640b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55974c229f00 con 0x55974c219a00 2023-09-13T10:01:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b56640b80 10 client.0 _ll_register_callbacks cb 0x55974c107680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21d920 0x55974c229690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b437fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c21b060 0x55974c226670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b43fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c219a00 0x55974c226130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21d920 0x55974c229690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47786/0 (socket says 172.21.15.6:47786) 2023-09-13T10:01:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 -- 172.21.15.6:0/1589790727 learned_addr learned my addr 172.21.15.6:0/1589790727 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b43fff700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c219a00 0x55974c226130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50836/0 (socket says 172.21.15.6:50836) 2023-09-13T10:01:46.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b437fe700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c21b060 0x55974c226670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41308/0 (socket says 172.21.15.6:41308) 2023-09-13T10:01:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 -- 172.21.15.6:0/1589790727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c219a00 msgr2=0x55974c226130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c219a00 0x55974c226130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 -- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c21b060 msgr2=0x55974c226670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c21b060 0x55974c226670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 -- 172.21.15.6:0/1589790727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55974c1837a0 con 0x55974c21d920 2023-09-13T10:01:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b43fff700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c219a00 0x55974c226130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b489f8700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21d920 0x55974c229690 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00b0d0 tx=0x7f0b3c007710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4879c796c45705f1 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b237fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b237fe700 1 -- 172.21.15.6:0/1589790727 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b3c028040 con 0x55974c21d920 2023-09-13T10:01:46.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b237fe700 1 -- 172.21.15.6:0/1589790727 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f0b3c004a50 con 0x55974c21d920 2023-09-13T10:01:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.350+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b38099650 con 0x55974c21d920 2023-09-13T10:01:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b237fe700 1 -- 172.21.15.6:0/1589790727 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b3c00e040 con 0x55974c21d920 2023-09-13T10:01:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 10 client.21246 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x55974bf80c60 con 0x55974c21d920 2023-09-13T10:01:46.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b237fe700 1 -- 172.21.15.6:0/1589790727 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f0b3c03c080 con 0x55974c21d920 2023-09-13T10:01:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b237fe700 1 -- 172.21.15.6:0/1589790727 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f0b3c00b100 con 0x55974c21d920 2023-09-13T10:01:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 10 client.21246 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 10 client.21246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 20 client.21246 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:46.364 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c283870 0x55974c285c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 4 client.21246 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:01:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55974c125050 con 0x55974c283870 2023-09-13T10:01:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.351+0000 7f0b43fff700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c283870 0x55974c285c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.352+0000 7f0b237fe700 10 client.21246 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:46.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.352+0000 7f0b43fff700 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c283870 0x55974c285c90 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a29af4ee4c234ac7 server_cookie=68ffbfaa39031916 in_seq=0 out_seq=0 2023-09-13T10:01:46.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b237fe700 1 -- 172.21.15.6:0/1589790727 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55974c125050 con 0x55974c283870 2023-09-13T10:01:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b237fe700 10 client.21246 handle_command_reply: tid=0 2023-09-13T10:01:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 client.21246 shutdown 2023-09-13T10:01:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21d920 msgr2=0x55974c229690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21d920 0x55974c229690 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f0b3c00b0d0 tx=0x7f0b3c007710 comp rx=0 tx=0).stop 2023-09-13T10:01:46.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 shutdown_connections 2023-09-13T10:01:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55974c283870 0x55974c285c90 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55974c21d920 0x55974c229690 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55974c219a00 0x55974c226130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 --2- 172.21.15.6:0/1589790727 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55974c21b060 0x55974c226670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 >> 172.21.15.6:0/1589790727 conn(0x55974c177c80 msgr2=0x55974c222f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b237fe700 0 client.21246 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 shutdown_connections 2023-09-13T10:01:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 1 -- 172.21.15.6:0/1589790727 wait complete. 2023-09-13T10:01:46.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.357+0000 7f0b56640b80 20 client.21246 trim_cache size 0 max 16384 2023-09-13T10:01:46.370 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:01:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b2c0a0640 msgr2=0x7f0b2c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b2c0a0640 0x7f0b2c0a2b00 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f0b4419a270 tx=0x7f0b34009260 comp rx=0 tx=0).stop 2023-09-13T10:01:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44101fc0 msgr2=0x7f0b441992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:46.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44101fc0 0x7f0b441992e0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f0b3800e9a0 tx=0x7f0b3800ecb0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 shutdown_connections 2023-09-13T10:01:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0b44102960 0x7f0b441a0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b44100dd0 0x7f0b44198da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f0b2c0a0640 0x7f0b2c0a2b00 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 --2- 172.21.15.6:0/2049673405 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0b44101fc0 0x7f0b441992e0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 >> 172.21.15.6:0/2049673405 conn(0x7f0b440fc320 msgr2=0x7f0b44107850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 shutdown_connections 2023-09-13T10:01:46.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:46.358+0000 7f0b4a45b700 1 -- 172.21.15.6:0/2049673405 wait complete. 2023-09-13T10:01:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:46 smithi006 ceph-mon[98665]: pgmap v967: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 659 op/s 2023-09-13T10:01:46.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:46 smithi053 ceph-mon[102373]: pgmap v967: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 659 op/s 2023-09-13T10:01:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:46 smithi131 ceph-mon[102785]: pgmap v967: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.4 MiB/s wr, 659 op/s 2023-09-13T10:01:46.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 354549 33.93 MB/sec execute 426 sec latency 66.186 ms 2023-09-13T10:01:47.375 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T10:01:47.375 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T10:01:47.535 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 -- 172.21.15.6:0/2931334188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83280ff7b0 msgr2=0x7f83280ffc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 --2- 172.21.15.6:0/2931334188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83280ff7b0 0x7f83280ffc60 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f832000b0a0 tx=0x7f832000b3b0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 -- 172.21.15.6:0/2931334188 shutdown_connections 2023-09-13T10:01:47.536 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 --2- 172.21.15.6:0/2931334188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83280ff7b0 0x7f83280ffc60 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 --2- 172.21.15.6:0/2931334188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8328101290 0x7f83281016b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 --2- 172.21.15.6:0/2931334188 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83280fee10 0x7f83280ff270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 -- 172.21.15.6:0/2931334188 >> 172.21.15.6:0/2931334188 conn(0x7f83280fa9b0 msgr2=0x7f83280fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 -- 172.21.15.6:0/2931334188 shutdown_connections 2023-09-13T10:01:47.537 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.535+0000 7f832ef16700 1 -- 172.21.15.6:0/2931334188 wait complete. 2023-09-13T10:01:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 Processor -- start 2023-09-13T10:01:47.538 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 -- start start 2023-09-13T10:01:47.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83280fee10 0x7f8328198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280ff7b0 0x7f8328199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8328101290 0x7f83281a02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281a08c0 con 0x7f8328101290 2023-09-13T10:01:47.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281a0a00 con 0x7f83280fee10 2023-09-13T10:01:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832ef16700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83281a0b90 con 0x7f83280ff7b0 2023-09-13T10:01:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f8327fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280ff7b0 0x7f8328199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.536+0000 7f832d4b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8328101290 0x7f83281a02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.542 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8328101290 0x7f83281a02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47796/0 (socket says 172.21.15.6:47796) 2023-09-13T10:01:47.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 -- 172.21.15.6:0/2734600443 learned_addr learned my addr 172.21.15.6:0/2734600443 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 -- 172.21.15.6:0/2734600443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280ff7b0 msgr2=0x7f8328199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280ff7b0 0x7f8328199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.543 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 -- 172.21.15.6:0/2734600443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83280fee10 msgr2=0x7f8328198d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T10:01:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83280fee10 0x7f8328198d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 -- 172.21.15.6:0/2734600443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8320009d00 con 0x7f8328101290 2023-09-13T10:01:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f8327fff700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280ff7b0 0x7f8328199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832d4b3700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8328101290 0x7f83281a02f0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f832000b780 tx=0x7f832000bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f8325ffb700 1 -- 172.21.15.6:0/2734600443 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832000e040 con 0x7f8328101290 2023-09-13T10:01:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8328102230 con 0x7f8328101290 2023-09-13T10:01:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f8325ffb700 1 -- 172.21.15.6:0/2734600443 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8320004c50 con 0x7f8328101290 2023-09-13T10:01:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.537+0000 7f8325ffb700 1 -- 172.21.15.6:0/2734600443 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320005370 con 0x7f8328101290 2023-09-13T10:01:47.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.538+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8328102790 con 0x7f8328101290 2023-09-13T10:01:47.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.542+0000 7f8325ffb700 1 -- 172.21.15.6:0/2734600443 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f832001d9c0 con 0x7f8328101290 2023-09-13T10:01:47.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.543+0000 7f8325ffb700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f83180a0640 0x7f83180a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.543+0000 7f8325ffb700 1 -- 172.21.15.6:0/2734600443 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f83200ccbb0 con 0x7f8328101290 2023-09-13T10:01:47.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.543+0000 7f832ccb2700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f83180a0640 0x7f83180a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.551 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.544+0000 7f832ccb2700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f83180a0640 0x7f83180a2b00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f831c009af0 tx=0x7f831c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.544+0000 7f833b0fbb80 1 Processor -- start 2023-09-13T10:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.544+0000 7f833b0fbb80 1 -- start start 2023-09-13T10:01:47.552 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.544+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x564189101ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.544+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189100540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189100f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564189059800 con 0x564189100a80 2023-09-13T10:01:47.553 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564189057120 con 0x564189101780 2023-09-13T10:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564189052a10 con 0x5641891020e0 2023-09-13T10:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x564189101ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x564189101ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41326/0 (socket says 172.21.15.6:41326) 2023-09-13T10:01:47.554 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 -- 172.21.15.6:0/244158674 learned_addr learned my addr 172.21.15.6:0/244158674 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832d4b3700 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189100f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 -- 172.21.15.6:0/244158674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 msgr2=0x564189100540 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:01:47.555 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189100540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 -- 172.21.15.6:0/244158674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 msgr2=0x564189100f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189100f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 -- 172.21.15.6:0/244158674 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564188ed26b0 con 0x564189101780 2023-09-13T10:01:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832d4b3700 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.556 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.545+0000 7f832ccb2700 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x564189101ba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f831c00eb70 tx=0x7f831c011000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b91d597587504b2 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.546+0000 7f8312ffd700 1 -- 172.21.15.6:0/244158674 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c010ac0 con 0x564189101780 2023-09-13T10:01:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.546+0000 7f8312ffd700 1 -- 172.21.15.6:0/244158674 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f831c00ee80 con 0x564189101780 2023-09-13T10:01:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.546+0000 7f8312ffd700 1 -- 172.21.15.6:0/244158674 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c0054c0 con 0x564189101780 2023-09-13T10:01:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 -- 172.21.15.6:0/244158674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 msgr2=0x564189101ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.557 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x564189101ba0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f831c00eb70 tx=0x7f831c011000 comp rx=0 tx=0).stop 2023-09-13T10:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 -- 172.21.15.6:0/244158674 shutdown_connections 2023-09-13T10:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189100f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x564189101ba0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.558 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/244158674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189100540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 -- 172.21.15.6:0/244158674 >> 172.21.15.6:0/244158674 conn(0x56418905ed00 msgr2=0x5641890faf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 -- 172.21.15.6:0/244158674 shutdown_connections 2023-09-13T10:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 -- 172.21.15.6:0/244158674 wait complete. 2023-09-13T10:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 -- start start 2023-09-13T10:01:47.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.547+0000 7f833b0fbb80 1 Processor -- start 2023-09-13T10:01:47.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189100a80 0x564189109fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x56418910a510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189111550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564188ff0c30 con 0x564189101780 2023-09-13T10:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564188ff0930 con 0x564189100a80 2023-09-13T10:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564188ed49a0 con 0x5641891020e0 2023-09-13T10:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f833b0fbb80 10 client.0 _ll_register_callbacks cb 0x564188fee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189111550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189111550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50862/0 (socket says 172.21.15.6:50862) 2023-09-13T10:01:47.561 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 -- 172.21.15.6:0/4248643628 learned_addr learned my addr 172.21.15.6:0/4248643628 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832ccb2700 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189100a80 0x564189109fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 -- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189100a80 msgr2=0x564189109fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189100a80 0x564189109fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 -- 172.21.15.6:0/4248643628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 msgr2=0x56418910a510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:01:47.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x56418910a510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.548+0000 7f832d4b3700 1 -- 172.21.15.6:0/4248643628 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f831c00e820 con 0x5641891020e0 2023-09-13T10:01:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f832d4b3700 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189111550 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8320096e50 tx=0x7f832000b3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=672895701635346f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f8307fff700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:47.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f8307fff700 1 -- 172.21.15.6:0/4248643628 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320011390 con 0x5641891020e0 2023-09-13T10:01:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f8307fff700 1 -- 172.21.15.6:0/4248643628 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f832009aae0 con 0x5641891020e0 2023-09-13T10:01:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5641890f36f0 con 0x5641891020e0 2023-09-13T10:01:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f8307fff700 1 -- 172.21.15.6:0/4248643628 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83200850b0 con 0x5641891020e0 2023-09-13T10:01:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f833b0fbb80 10 client.30454 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56418906a820 con 0x5641891020e0 2023-09-13T10:01:47.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f8307fff700 1 -- 172.21.15.6:0/4248643628 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f83200b6080 con 0x5641891020e0 2023-09-13T10:01:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.549+0000 7f8307fff700 1 -- 172.21.15.6:0/4248643628 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f83200b8120 con 0x5641891020e0 2023-09-13T10:01:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f833b0fbb80 10 client.30454 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f833b0fbb80 10 client.30454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f833b0fbb80 20 client.30454 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:47.565 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564189115ad0 0x564189117ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f833b0fbb80 4 client.30454 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56418904b9f0 con 0x564189115ad0 2023-09-13T10:01:47.566 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f832ccb2700 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564189115ad0 0x564189117ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f8307fff700 10 client.30454 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.550+0000 7f832ccb2700 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564189115ad0 0x564189117ec0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f00f5cd8c0f7aa1b server_cookie=99375a631d4373f8 in_seq=0 out_seq=0 2023-09-13T10:01:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.554+0000 7f8307fff700 1 -- 172.21.15.6:0/4248643628 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56418904b9f0 con 0x564189115ad0 2023-09-13T10:01:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.554+0000 7f8307fff700 10 client.30454 handle_command_reply: tid=0 2023-09-13T10:01:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.554+0000 7f833b0fbb80 1 client.30454 shutdown 2023-09-13T10:01:47.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 msgr2=0x564189111550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189111550 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8320096e50 tx=0x7f832000b3b0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 shutdown_connections 2023-09-13T10:01:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5641891020e0 0x564189111550 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189100a80 0x564189109fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x564189115ad0 0x564189117ec0 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4248643628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x56418910a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f8307fff700 0 client.30454 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 >> 172.21.15.6:0/4248643628 conn(0x56418905ed00 msgr2=0x5641890f5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.570 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 shutdown_connections 2023-09-13T10:01:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4248643628 wait complete. 2023-09-13T10:01:47.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.555+0000 7f833b0fbb80 20 client.30454 trim_cache size 0 max 16384 2023-09-13T10:01:47.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 Processor -- start 2023-09-13T10:01:47.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 -- start start 2023-09-13T10:01:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56418905ed00 0x5641890f5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189111510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x5641890ffc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641890f79b0 con 0x564189100a80 2023-09-13T10:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x564189109480 con 0x564189101780 2023-09-13T10:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641890fc3f0 con 0x56418905ed00 2023-09-13T10:01:47.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f8327fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189111510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.580+0000 7f832ccb2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56418905ed00 0x5641890f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189111510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47816/0 (socket says 172.21.15.6:47816) 2023-09-13T10:01:47.584 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f832ccb2700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56418905ed00 0x5641890f5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50868/0 (socket says 172.21.15.6:50868) 2023-09-13T10:01:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 -- 172.21.15.6:0/868428668 learned_addr learned my addr 172.21.15.6:0/868428668 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f832d4b3700 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x5641890ffc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 -- 172.21.15.6:0/868428668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56418905ed00 msgr2=0x5641890f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.585 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56418905ed00 0x5641890f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 -- 172.21.15.6:0/868428668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 msgr2=0x5641890ffc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x5641890ffc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 -- 172.21.15.6:0/868428668 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564188e7ee60 con 0x564189100a80 2023-09-13T10:01:47.586 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f8327fff700 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189111510 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f8314009fd0 tx=0x7f8314011820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548040bf0e35d17c server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f83137fe700 1 -- 172.21.15.6:0/868428668 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8314019630 con 0x564189100a80 2023-09-13T10:01:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f83137fe700 1 -- 172.21.15.6:0/868428668 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f8314019c50 con 0x564189100a80 2023-09-13T10:01:47.587 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.581+0000 7f83137fe700 1 -- 172.21.15.6:0/868428668 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831400fde0 con 0x564189100a80 2023-09-13T10:01:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 -- 172.21.15.6:0/868428668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 msgr2=0x564189111510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189111510 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f8314009fd0 tx=0x7f8314011820 comp rx=0 tx=0).stop 2023-09-13T10:01:47.589 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 -- 172.21.15.6:0/868428668 shutdown_connections 2023-09-13T10:01:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x564189101780 0x5641890ffc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56418905ed00 0x5641890f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/868428668 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189100a80 0x564189111510 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.590 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 -- 172.21.15.6:0/868428668 >> 172.21.15.6:0/868428668 conn(0x5641890fb2c0 msgr2=0x5641890ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 -- 172.21.15.6:0/868428668 shutdown_connections 2023-09-13T10:01:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.582+0000 7f833b0fbb80 1 -- 172.21.15.6:0/868428668 wait complete. 2023-09-13T10:01:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 -- start start 2023-09-13T10:01:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 Processor -- start 2023-09-13T10:01:47.591 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56418905ed00 0x56418910ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564189100a80 0x56418910f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x564189110230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x564189110770 con 0x564189101780 2023-09-13T10:01:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5641891108e0 con 0x56418905ed00 2023-09-13T10:01:47.592 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.583+0000 7f833b0fbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x564189110aa0 con 0x564189100a80 2023-09-13T10:01:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f833b0fbb80 10 client.0 _ll_register_callbacks cb 0x564188fee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x564189110230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f8327fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564189100a80 0x56418910f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x564189110230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47824/0 (socket says 172.21.15.6:47824) 2023-09-13T10:01:47.593 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 -- 172.21.15.6:0/4099694529 learned_addr learned my addr 172.21.15.6:0/4099694529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832ccb2700 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56418905ed00 0x56418910ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 -- 172.21.15.6:0/4099694529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564189100a80 msgr2=0x56418910f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564189100a80 0x56418910f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 -- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56418905ed00 msgr2=0x56418910ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56418905ed00 0x56418910ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f832d4b3700 1 -- 172.21.15.6:0/4099694529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8314009db0 con 0x564189101780 2023-09-13T10:01:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.584+0000 7f8327fff700 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564189100a80 0x56418910f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f832d4b3700 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x564189110230 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f83200062a0 tx=0x7f83200a2160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb772638292770 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.595 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f8307fff700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:01:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f8307fff700 1 -- 172.21.15.6:0/4099694529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8320009b80 con 0x564189101780 2023-09-13T10:01:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f8307fff700 1 -- 172.21.15.6:0/4099694529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f832009aae0 con 0x564189101780 2023-09-13T10:01:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f831c00ee80 con 0x564189101780 2023-09-13T10:01:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f8307fff700 1 -- 172.21.15.6:0/4099694529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83200850b0 con 0x564189101780 2023-09-13T10:01:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f833b0fbb80 10 client.21261 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x564188e67ce0 con 0x564189101780 2023-09-13T10:01:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f8307fff700 1 -- 172.21.15.6:0/4099694529 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f831c00ee80 con 0x564189101780 2023-09-13T10:01:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f8307fff700 1 -- 172.21.15.6:0/4099694529 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f83200998d0 con 0x564189101780 2023-09-13T10:01:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.585+0000 7f833b0fbb80 10 client.21261 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f833b0fbb80 10 client.21261 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f833b0fbb80 20 client.21261 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5641891020e0 0x564189167cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f833b0fbb80 4 client.21261 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T10:01:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x56418900c0d0 con 0x5641891020e0 2023-09-13T10:01:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f832ccb2700 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5641891020e0 0x564189167cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f8307fff700 10 client.21261 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.586+0000 7f832ccb2700 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5641891020e0 0x564189167cf0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef580fe8bf9c5a59 server_cookie=840f3521f49814d5 in_seq=0 out_seq=0 2023-09-13T10:01:47.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.590+0000 7f8307fff700 1 -- 172.21.15.6:0/4099694529 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56418900c0d0 con 0x5641891020e0 2023-09-13T10:01:47.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.590+0000 7f8307fff700 10 client.21261 handle_command_reply: tid=0 2023-09-13T10:01:47.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.590+0000 7f833b0fbb80 1 client.21261 shutdown 2023-09-13T10:01:47.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.590+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 msgr2=0x564189110230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.590+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x564189110230 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f83200062a0 tx=0x7f83200a2160 comp rx=0 tx=0).stop 2023-09-13T10:01:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 shutdown_connections 2023-09-13T10:01:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5641891020e0 0x564189167cf0 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x564189101780 0x564189110230 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f8307fff700 0 client.21261 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56418905ed00 0x56418910ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f833b0fbb80 1 --2- 172.21.15.6:0/4099694529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564189100a80 0x56418910f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 >> 172.21.15.6:0/4099694529 conn(0x5641890fb2c0 msgr2=0x5641890ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.592+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 shutdown_connections 2023-09-13T10:01:47.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.593+0000 7f833b0fbb80 1 -- 172.21.15.6:0/4099694529 wait complete. 2023-09-13T10:01:47.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f833b0fbb80 20 client.21261 trim_cache size 0 max 16384 2023-09-13T10:01:47.603 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:01:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T10:01:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "a81b4e5b-5a43-4f65-a007-2cde83f3990e", 2023-09-13T10:01:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T10:01:47.604 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:01:47.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f83180a0640 msgr2=0x7f83180a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f83180a0640 0x7f83180a2b00 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f831c009af0 tx=0x7f831c009260 comp rx=0 tx=0).stop 2023-09-13T10:01:47.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8328101290 msgr2=0x7f83281a02f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8328101290 0x7f83281a02f0 secure :-1 s=READY pgs=1917 cs=0 l=1 rev1=1 crypto rx=0x7f832000b780 tx=0x7f832000bab0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 shutdown_connections 2023-09-13T10:01:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f83180a0640 0x7f83180a2b00 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8328101290 0x7f83281a02f0 unknown :-1 s=CLOSED pgs=1917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f83280fee10 0x7f8328198d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 --2- 172.21.15.6:0/2734600443 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83280ff7b0 0x7f8328199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 >> 172.21.15.6:0/2734600443 conn(0x7f83280fa9b0 msgr2=0x7f83280fc5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.598+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 shutdown_connections 2023-09-13T10:01:47.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.599+0000 7f832ef16700 1 -- 172.21.15.6:0/2734600443 wait complete. 2023-09-13T10:01:47.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 355320 33.96 MB/sec execute 427 sec latency 50.183 ms 2023-09-13T10:01:47.613 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:01:47.817 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 -- 172.21.15.6:0/2231316773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030100eb0 msgr2=0x7f7030101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 --2- 172.21.15.6:0/2231316773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030100eb0 0x7f7030101310 secure :-1 s=READY pgs=1920 cs=0 l=1 rev1=1 crypto rx=0x7f70240099c0 tx=0x7f7024009cd0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 -- 172.21.15.6:0/2231316773 shutdown_connections 2023-09-13T10:01:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 --2- 172.21.15.6:0/2231316773 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7030101850 0x7f7030108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 --2- 172.21.15.6:0/2231316773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70300ffcc0 0x7f70301000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.818 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 --2- 172.21.15.6:0/2231316773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030100eb0 0x7f7030101310 unknown :-1 s=CLOSED pgs=1920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 -- 172.21.15.6:0/2231316773 >> 172.21.15.6:0/2231316773 conn(0x7f70300fb250 msgr2=0x7f70300fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 -- 172.21.15.6:0/2231316773 shutdown_connections 2023-09-13T10:01:47.819 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.816+0000 7f70355bb700 1 -- 172.21.15.6:0/2231316773 wait complete. 2023-09-13T10:01:47.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 Processor -- start 2023-09-13T10:01:47.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 -- start start 2023-09-13T10:01:47.821 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300ffcc0 0x7f7030195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030100eb0 0x7f7030195ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030101850 0x7f703019cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703019d500 con 0x7f7030101850 2023-09-13T10:01:47.822 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703019d640 con 0x7f70300ffcc0 2023-09-13T10:01:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.817+0000 7f70355bb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f703019d7d0 con 0x7f7030100eb0 2023-09-13T10:01:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030101850 0x7f703019cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030101850 0x7f703019cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47836/0 (socket says 172.21.15.6:47836) 2023-09-13T10:01:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 -- 172.21.15.6:0/1440180217 learned_addr learned my addr 172.21.15.6:0/1440180217 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702e7fc700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030100eb0 0x7f7030195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702effd700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300ffcc0 0x7f7030195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 -- 172.21.15.6:0/1440180217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030100eb0 msgr2=0x7f7030195ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030100eb0 0x7f7030195ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 -- 172.21.15.6:0/1440180217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300ffcc0 msgr2=0x7f7030195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300ffcc0 0x7f7030195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 -- 172.21.15.6:0/1440180217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70240095f0 con 0x7f7030101850 2023-09-13T10:01:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702e7fc700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030100eb0 0x7f7030195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.818+0000 7f702f7fe700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030101850 0x7f703019cf30 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f702800ef30 tx=0x7f702800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.819+0000 7f7017fff700 1 -- 172.21.15.6:0/1440180217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028018070 con 0x7f7030101850 2023-09-13T10:01:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.819+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f703019da50 con 0x7f7030101850 2023-09-13T10:01:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.819+0000 7f7017fff700 1 -- 172.21.15.6:0/1440180217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f702800f040 con 0x7f7030101850 2023-09-13T10:01:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.819+0000 7f7017fff700 1 -- 172.21.15.6:0/1440180217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702800cd00 con 0x7f7030101850 2023-09-13T10:01:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.819+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703019df60 con 0x7f7030101850 2023-09-13T10:01:47.831 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.822+0000 7f7017fff700 1 -- 172.21.15.6:0/1440180217 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7028003a00 con 0x7f7030101850 2023-09-13T10:01:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.822+0000 7f7017fff700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70180a0640 0x7f70180a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f7017fff700 1 -- 172.21.15.6:0/1440180217 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f70280cb740 con 0x7f7030101850 2023-09-13T10:01:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f702effd700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70180a0640 0x7f70180a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 Processor -- start 2023-09-13T10:01:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 -- start start 2023-09-13T10:01:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f528b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f529060 0x56237f5274c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f527e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f480780 con 0x56237f529060 2023-09-13T10:01:47.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f47e0a0 con 0x56237f528700 2023-09-13T10:01:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f70417a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f479990 con 0x56237f527a00 2023-09-13T10:01:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.823+0000 7f702effd700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70180a0640 0x7f70180a2b00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7030100d10 tx=0x7f7020009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f529060 0x56237f5274c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f527e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f529060 0x56237f5274c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47842/0 (socket says 172.21.15.6:47842) 2023-09-13T10:01:47.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f527e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50898/0 (socket says 172.21.15.6:50898) 2023-09-13T10:01:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702e7fc700 1 -- 172.21.15.6:0/2812201030 learned_addr learned my addr 172.21.15.6:0/2812201030 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702effd700 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f528b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 -- 172.21.15.6:0/2812201030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 msgr2=0x56237f528b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f528b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 -- 172.21.15.6:0/2812201030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f529060 msgr2=0x56237f5274c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f529060 0x56237f5274c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 -- 172.21.15.6:0/2812201030 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56237f2f9630 con 0x56237f527a00 2023-09-13T10:01:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702e7fc700 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f529060 0x56237f5274c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f702f7fe700 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f527e80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f70280c9190 tx=0x7f7028098a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc1f9296a926c4df server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f70157fa700 1 -- 172.21.15.6:0/2812201030 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f702801b320 con 0x56237f527a00 2023-09-13T10:01:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f70157fa700 1 -- 172.21.15.6:0/2812201030 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7028099610 con 0x56237f527a00 2023-09-13T10:01:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.824+0000 7f70157fa700 1 -- 172.21.15.6:0/2812201030 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70280a0f60 con 0x56237f527a00 2023-09-13T10:01:47.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 -- 172.21.15.6:0/2812201030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 msgr2=0x56237f527e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f527e80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f70280c9190 tx=0x7f7028098a50 comp rx=0 tx=0).stop 2023-09-13T10:01:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 -- 172.21.15.6:0/2812201030 shutdown_connections 2023-09-13T10:01:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f527e80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f528b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2812201030 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f529060 0x56237f5274c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 -- 172.21.15.6:0/2812201030 >> 172.21.15.6:0/2812201030 conn(0x56237f485c80 msgr2=0x56237f521f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 -- 172.21.15.6:0/2812201030 shutdown_connections 2023-09-13T10:01:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.825+0000 7f70417a0b80 1 -- 172.21.15.6:0/2812201030 wait complete. 2023-09-13T10:01:47.841 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 -- start start 2023-09-13T10:01:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 Processor -- start 2023-09-13T10:01:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f537dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.842 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f528700 0x56237f53a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f53c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f417bb0 con 0x56237f528700 2023-09-13T10:01:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f4178b0 con 0x56237f529060 2023-09-13T10:01:47.843 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f2fb920 con 0x56237f527a00 2023-09-13T10:01:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f70417a0b80 10 client.0 _ll_register_callbacks cb 0x56237f415680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f702effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f537dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f702effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f537dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50902/0 (socket says 172.21.15.6:50902) 2023-09-13T10:01:47.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f702effd700 1 -- 172.21.15.6:0/2326880859 learned_addr learned my addr 172.21.15.6:0/2326880859 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.826+0000 7f702f7fe700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f53c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702e7fc700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f528700 0x56237f53a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702f7fe700 1 -- 172.21.15.6:0/2326880859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 msgr2=0x56237f537dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702f7fe700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f537dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702f7fe700 1 -- 172.21.15.6:0/2326880859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f528700 msgr2=0x56237f53a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702f7fe700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f528700 0x56237f53a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702f7fe700 1 -- 172.21.15.6:0/2326880859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f703019df60 con 0x56237f529060 2023-09-13T10:01:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702e7fc700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f528700 0x56237f53a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702effd700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f537dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f702f7fe700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f53c870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f70280990d0 tx=0x7f7028099780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d9caec2bcc6c81 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f7012ff5700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:01:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f7012ff5700 1 -- 172.21.15.6:0/2326880859 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7028098600 con 0x56237f529060 2023-09-13T10:01:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.827+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56237f51a670 con 0x56237f529060 2023-09-13T10:01:47.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f7012ff5700 1 -- 172.21.15.6:0/2326880859 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7028098f10 con 0x56237f529060 2023-09-13T10:01:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f7012ff5700 1 -- 172.21.15.6:0/2326880859 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70280a0f60 con 0x56237f529060 2023-09-13T10:01:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 10 client.30482 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:47.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56237f4917a0 con 0x56237f529060 2023-09-13T10:01:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f7012ff5700 1 -- 172.21.15.6:0/2326880859 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x56237f51a670 con 0x56237f529060 2023-09-13T10:01:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f7012ff5700 1 -- 172.21.15.6:0/2326880859 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7028094e90 con 0x56237f529060 2023-09-13T10:01:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 10 client.30482 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 10 client.30482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:47.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 20 client.30482 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f540c70 0x56237f543090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 4 client.30482 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:01:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.828+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56237f472970 con 0x56237f540c70 2023-09-13T10:01:47.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.829+0000 7f702effd700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f540c70 0x56237f543090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.829+0000 7f702effd700 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f540c70 0x56237f543090 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c5bc7fb29dfed21 server_cookie=9a30a6b3f760b5bc in_seq=0 out_seq=0 2023-09-13T10:01:47.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.829+0000 7f7012ff5700 10 client.30482 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.833+0000 7f7012ff5700 1 -- 172.21.15.6:0/2326880859 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56237f472970 con 0x56237f540c70 2023-09-13T10:01:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.833+0000 7f7012ff5700 10 client.30482 handle_command_reply: tid=0 2023-09-13T10:01:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.833+0000 7f70417a0b80 1 client.30482 shutdown 2023-09-13T10:01:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 msgr2=0x56237f53c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f53c870 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f70280990d0 tx=0x7f7028099780 comp rx=0 tx=0).stop 2023-09-13T10:01:47.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 shutdown_connections 2023-09-13T10:01:47.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f53c870 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f527a00 0x56237f537dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f540c70 0x56237f543090 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 --2- 172.21.15.6:0/2326880859 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f528700 0x56237f53a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f7012ff5700 0 client.30482 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 >> 172.21.15.6:0/2326880859 conn(0x56237f485c80 msgr2=0x56237f51c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 shutdown_connections 2023-09-13T10:01:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.835+0000 7f70417a0b80 1 -- 172.21.15.6:0/2326880859 wait complete. 2023-09-13T10:01:47.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.836+0000 7f70417a0b80 20 client.30482 trim_cache size 0 max 16384 2023-09-13T10:01:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 Processor -- start 2023-09-13T10:01:47.865 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 -- start start 2023-09-13T10:01:47.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f527a00 0x56237f5274c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f539de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.866 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f529060 0x56237f53c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f53d7e0 con 0x56237f527a00 2023-09-13T10:01:47.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f52e1b0 con 0x56237f528700 2023-09-13T10:01:47.867 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f70417a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f52e870 con 0x56237f529060 2023-09-13T10:01:47.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f702effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f527a00 0x56237f5274c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f702effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f527a00 0x56237f5274c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47856/0 (socket says 172.21.15.6:47856) 2023-09-13T10:01:47.868 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f702effd700 1 -- 172.21.15.6:0/3571136543 learned_addr learned my addr 172.21.15.6:0/3571136543 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f702e7fc700 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f539de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.858+0000 7f702f7fe700 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f529060 0x56237f53c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f702effd700 1 -- 172.21.15.6:0/3571136543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f529060 msgr2=0x56237f53c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f702effd700 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f529060 0x56237f53c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f702effd700 1 -- 172.21.15.6:0/3571136543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 msgr2=0x56237f539de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f702effd700 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f539de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f702effd700 1 -- 172.21.15.6:0/3571136543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56237f2a5de0 con 0x56237f527a00 2023-09-13T10:01:47.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f702effd700 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f527a00 0x56237f5274c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f70200117d0 tx=0x7f7020014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8639d881e6852f28 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f7015ffb700 1 -- 172.21.15.6:0/3571136543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020022040 con 0x56237f527a00 2023-09-13T10:01:47.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f7015ffb700 1 -- 172.21.15.6:0/3571136543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7020023040 con 0x56237f527a00 2023-09-13T10:01:47.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.859+0000 7f7015ffb700 1 -- 172.21.15.6:0/3571136543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7020004440 con 0x56237f527a00 2023-09-13T10:01:47.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 -- 172.21.15.6:0/3571136543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f527a00 msgr2=0x56237f5274c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f527a00 0x56237f5274c0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f70200117d0 tx=0x7f7020014000 comp rx=0 tx=0).stop 2023-09-13T10:01:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 -- 172.21.15.6:0/3571136543 shutdown_connections 2023-09-13T10:01:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f529060 0x56237f53c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f527a00 0x56237f5274c0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 --2- 172.21.15.6:0/3571136543 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f528700 0x56237f539de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 -- 172.21.15.6:0/3571136543 >> 172.21.15.6:0/3571136543 conn(0x56237f485c80 msgr2=0x56237f53d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 -- 172.21.15.6:0/3571136543 shutdown_connections 2023-09-13T10:01:47.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 -- 172.21.15.6:0/3571136543 wait complete. 2023-09-13T10:01:47.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 -- start start 2023-09-13T10:01:47.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.860+0000 7f70417a0b80 1 Processor -- start 2023-09-13T10:01:47.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f528700 0x56237f539cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f5382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f70417a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f538810 0x56237f538c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f70417a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f53a330 con 0x56237f538810 2023-09-13T10:01:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f70417a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f594a90 con 0x56237f529060 2023-09-13T10:01:47.877 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f70417a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x56237f594bd0 con 0x56237f528700 2023-09-13T10:01:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f70417a0b80 10 client.0 _ll_register_callbacks cb 0x56237f415680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:01:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f5382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f528700 0x56237f539cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f528700 0x56237f539cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50916/0 (socket says 172.21.15.6:50916) 2023-09-13T10:01:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f5382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41388/0 (socket says 172.21.15.6:41388) 2023-09-13T10:01:47.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 -- 172.21.15.6:0/281598577 learned_addr learned my addr 172.21.15.6:0/281598577 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:01:47.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702f7fe700 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f538810 0x56237f538c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 -- 172.21.15.6:0/281598577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 msgr2=0x56237f5382d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f5382d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 -- 172.21.15.6:0/281598577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f538810 msgr2=0x56237f538c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:01:47.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f538810 0x56237f538c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 -- 172.21.15.6:0/281598577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7020017070 con 0x56237f528700 2023-09-13T10:01:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702f7fe700 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f538810 0x56237f538c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:01:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f702effd700 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f528700 0x56237f539cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70200097c0 tx=0x7f702002cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c144164fb52fb3e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:01:47.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.861+0000 7f7012ff5700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:01:47.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f7012ff5700 1 -- 172.21.15.6:0/281598577 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70200043c0 con 0x56237f528700 2023-09-13T10:01:47.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f7012ff5700 1 -- 172.21.15.6:0/281598577 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f702002b0f0 con 0x56237f528700 2023-09-13T10:01:47.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7028099610 con 0x56237f528700 2023-09-13T10:01:47.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f7012ff5700 1 -- 172.21.15.6:0/281598577 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7020004520 con 0x56237f528700 2023-09-13T10:01:47.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f70417a0b80 10 client.30478 fetch_fsmap learned FSMap version 70 2023-09-13T10:01:47.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) v3 -- 0x56237f28ec60 con 0x56237f528700 2023-09-13T10:01:47.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f7012ff5700 1 -- 172.21.15.6:0/281598577 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7028099610 con 0x56237f528700 2023-09-13T10:01:47.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.862+0000 7f7012ff5700 1 -- 172.21.15.6:0/281598577 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 70) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7020042020 con 0x56237f528700 2023-09-13T10:01:47.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f70417a0b80 10 client.30478 fetch_fsmap finished waiting for FSMap version 70 2023-09-13T10:01:47.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f70417a0b80 10 client.30478 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:01:47.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f70417a0b80 20 client.30478 populate_metadata read hostname 'smithi006' 2023-09-13T10:01:47.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f70417a0b80 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f532250 0x56237f534670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:01:47.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f70417a0b80 4 client.30478 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:01:47.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56237f433050 con 0x56237f532250 2023-09-13T10:01:47.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f702e7fc700 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f532250 0x56237f534670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:01:47.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f7012ff5700 10 client.30478 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.863+0000 7f702e7fc700 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f532250 0x56237f534670 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=606940be3a8f9c0f server_cookie=54eeda5846c7c4cd in_seq=0 out_seq=0 2023-09-13T10:01:47.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f7012ff5700 1 -- 172.21.15.6:0/281598577 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56237f433050 con 0x56237f532250 2023-09-13T10:01:47.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f7012ff5700 10 client.30478 handle_command_reply: tid=0 2023-09-13T10:01:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 client.30478 shutdown 2023-09-13T10:01:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f528700 msgr2=0x56237f539cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f528700 0x56237f539cc0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f70200097c0 tx=0x7f702002cf40 comp rx=0 tx=0).stop 2023-09-13T10:01:47.889 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 shutdown_connections 2023-09-13T10:01:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x56237f532250 0x56237f534670 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x56237f538810 0x56237f538c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f7012ff5700 0 client.30478 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:01:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x56237f528700 0x56237f539cc0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.890 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 --2- 172.21.15.6:0/281598577 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x56237f529060 0x56237f5382d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 >> 172.21.15.6:0/281598577 conn(0x56237f485c80 msgr2=0x56237f53c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 shutdown_connections 2023-09-13T10:01:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 1 -- 172.21.15.6:0/281598577 wait complete. 2023-09-13T10:01:47.891 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.866+0000 7f70417a0b80 20 client.30478 trim_cache size 0 max 16384 2023-09-13T10:01:47.892 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:01:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "IDLE (waiting for more scrubs)", 2023-09-13T10:01:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T10:01:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "a81b4e5b-5a43-4f65-a007-2cde83f3990e": { 2023-09-13T10:01:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T10:01:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "a81b4e5b-5a43-4f65-a007-2cde83f3990e", 2023-09-13T10:01:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T10:01:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:01:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:01:47.893 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:01:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70180a0640 msgr2=0x7f70180a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70180a0640 0x7f70180a2b00 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7030100d10 tx=0x7f7020009260 comp rx=0 tx=0).stop 2023-09-13T10:01:47.895 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030101850 msgr2=0x7f703019cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:01:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030101850 0x7f703019cf30 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f702800ef30 tx=0x7f702800c3a0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 shutdown_connections 2023-09-13T10:01:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f70180a0640 0x7f70180a2b00 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.896 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7030101850 0x7f703019cf30 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f70300ffcc0 0x7f7030195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 --2- 172.21.15.6:0/1440180217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7030100eb0 0x7f7030195ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:01:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 >> 172.21.15.6:0/1440180217 conn(0x7f70300fb250 msgr2=0x7f70300fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:01:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 shutdown_connections 2023-09-13T10:01:47.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:01:47.867+0000 7f70355bb700 1 -- 172.21.15.6:0/1440180217 wait complete. 2023-09-13T10:01:47.898 INFO:tasks.cephfs.filesystem:scrub status for tag:a81b4e5b-5a43-4f65-a007-2cde83f3990e - {'path': '/', 'tag': 'a81b4e5b-5a43-4f65-a007-2cde83f3990e', 'options': 'recursive,force'} 2023-09-13T10:01:48.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:48 smithi006 ceph-mon[98665]: pgmap v968: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 648 op/s 2023-09-13T10:01:48.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:48 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:48.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:48 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:48 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:48.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:48 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:48 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:48.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:48 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:48 smithi053 ceph-mon[102373]: pgmap v968: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 648 op/s 2023-09-13T10:01:48.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:48 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:48.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:48 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:48 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:48.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:48 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:48 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:48.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:48 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:48 smithi131 ceph-mon[102785]: pgmap v968: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.3 MiB/s wr, 648 op/s 2023-09-13T10:01:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:48 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:48 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:48 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:48 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:48 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:48.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:48 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:48.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 355943 33.96 MB/sec execute 428 sec latency 84.000 ms 2023-09-13T10:01:49.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T10:01:49.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:49.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:49.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:49.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:49.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:01:49.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:49 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:49.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T10:01:49.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:49.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:49.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:49.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:49.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:01:49.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:49 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:49.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T10:01:49.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:49.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:49.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:49.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:49.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:01:49.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:01:49.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:49 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:49.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 356542 33.95 MB/sec execute 429 sec latency 70.290 ms 2023-09-13T10:01:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:50 smithi006 ceph-mon[98665]: pgmap v969: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 499 op/s 2023-09-13T10:01:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:50 smithi053 ceph-mon[102373]: pgmap v969: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 499 op/s 2023-09-13T10:01:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:50 smithi131 ceph-mon[102785]: pgmap v969: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.3 MiB/s wr, 499 op/s 2023-09-13T10:01:50.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 357245 33.97 MB/sec execute 430 sec latency 66.389 ms 2023-09-13T10:01:51.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 357839 33.96 MB/sec execute 431 sec latency 95.064 ms 2023-09-13T10:01:52.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:52 smithi006 ceph-mon[98665]: pgmap v970: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 453 op/s 2023-09-13T10:01:52.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:52 smithi053 ceph-mon[102373]: pgmap v970: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 453 op/s 2023-09-13T10:01:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:52 smithi131 ceph-mon[102785]: pgmap v970: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 453 op/s 2023-09-13T10:01:52.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 358472 33.95 MB/sec execute 432 sec latency 83.284 ms 2023-09-13T10:01:53.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 359050 33.95 MB/sec execute 433 sec latency 249.110 ms 2023-09-13T10:01:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:54 smithi006 ceph-mon[98665]: pgmap v971: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 605 op/s 2023-09-13T10:01:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:54 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:54.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:54 smithi053 ceph-mon[102373]: pgmap v971: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 605 op/s 2023-09-13T10:01:54.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:54 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:54 smithi131 ceph-mon[102785]: pgmap v971: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 605 op/s 2023-09-13T10:01:54.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:54 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:54.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 359600 33.94 MB/sec execute 434 sec latency 156.068 ms 2023-09-13T10:01:55.605 INFO:tasks.workunit.client.0.smithi006.stdout: 10 360199 33.94 MB/sec execute 435 sec latency 89.264 ms 2023-09-13T10:01:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:56 smithi006 ceph-mon[98665]: pgmap v972: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 511 op/s 2023-09-13T10:01:56.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:56 smithi053 ceph-mon[102373]: pgmap v972: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 511 op/s 2023-09-13T10:01:56.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:56 smithi131 ceph-mon[102785]: pgmap v972: 97 pgs: 97 active+clean; 1.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 511 op/s 2023-09-13T10:01:56.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 360780 33.93 MB/sec execute 436 sec latency 98.126 ms 2023-09-13T10:01:57.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 361350 33.92 MB/sec execute 437 sec latency 84.171 ms 2023-09-13T10:01:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:58 smithi006 ceph-mon[98665]: pgmap v973: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 570 op/s 2023-09-13T10:01:58.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:58 smithi053 ceph-mon[102373]: pgmap v973: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 570 op/s 2023-09-13T10:01:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:58 smithi131 ceph-mon[102785]: pgmap v973: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 3.9 MiB/s wr, 570 op/s 2023-09-13T10:01:58.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 361971 33.92 MB/sec execute 438 sec latency 133.824 ms 2023-09-13T10:01:59.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:01:59 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:59.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:01:59 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:59.528 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:01:59 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:01:59.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 362485 33.92 MB/sec execute 439 sec latency 185.874 ms 2023-09-13T10:02:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:00 smithi006 ceph-mon[98665]: pgmap v974: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 506 op/s 2023-09-13T10:02:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:00.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:00.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:00 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:00.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:00 smithi053 ceph-mon[102373]: pgmap v974: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 506 op/s 2023-09-13T10:02:00.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:00.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:00 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:00 smithi131 ceph-mon[102785]: pgmap v974: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.4 MiB/s wr, 506 op/s 2023-09-13T10:02:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:00.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:00 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:00.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 362990 33.89 MB/sec execute 440 sec latency 189.032 ms 2023-09-13T10:02:01.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:01 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:02:01.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:01 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:02:01.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:01 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:02:01.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 363237 33.84 MB/sec execute 441 sec latency 570.699 ms 2023-09-13T10:02:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:02 smithi006 ceph-mon[98665]: pgmap v975: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 495 op/s 2023-09-13T10:02:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:02:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:02:02.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:02:02.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:02 smithi053 ceph-mon[102373]: pgmap v975: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 495 op/s 2023-09-13T10:02:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:02:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:02:02.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:02:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:02 smithi131 ceph-mon[102785]: pgmap v975: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.5 MiB/s wr, 495 op/s 2023-09-13T10:02:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:02:02.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:02:02.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:02:02.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 363279 33.77 MB/sec execute 442 sec latency 1361.931 ms 2023-09-13T10:02:03.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 363583 33.74 MB/sec execute 443 sec latency 450.547 ms 2023-09-13T10:02:04.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:04 smithi006 ceph-mon[98665]: pgmap v976: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.0 MiB/s wr, 576 op/s 2023-09-13T10:02:04.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:04 smithi053 ceph-mon[102373]: pgmap v976: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.0 MiB/s wr, 576 op/s 2023-09-13T10:02:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:04 smithi131 ceph-mon[102785]: pgmap v976: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.0 MiB/s wr, 576 op/s 2023-09-13T10:02:04.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 363979 33.70 MB/sec execute 444 sec latency 146.762 ms 2023-09-13T10:02:05.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 364539 33.70 MB/sec execute 445 sec latency 110.339 ms 2023-09-13T10:02:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:06 smithi006 ceph-mon[98665]: pgmap v977: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 557 op/s 2023-09-13T10:02:06.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:06 smithi053 ceph-mon[102373]: pgmap v977: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 557 op/s 2023-09-13T10:02:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:06 smithi131 ceph-mon[102785]: pgmap v977: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 557 op/s 2023-09-13T10:02:06.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 365124 33.71 MB/sec execute 446 sec latency 121.631 ms 2023-09-13T10:02:07.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 365590 33.69 MB/sec execute 447 sec latency 55.061 ms 2023-09-13T10:02:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:08 smithi006 ceph-mon[98665]: pgmap v978: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 15 MiB/s wr, 628 op/s 2023-09-13T10:02:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:08 smithi053 ceph-mon[102373]: pgmap v978: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 15 MiB/s wr, 628 op/s 2023-09-13T10:02:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:08 smithi131 ceph-mon[102785]: pgmap v978: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 15 MiB/s wr, 628 op/s 2023-09-13T10:02:08.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 366116 33.66 MB/sec execute 448 sec latency 66.650 ms 2023-09-13T10:02:09.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 366833 33.65 MB/sec execute 449 sec latency 83.960 ms 2023-09-13T10:02:10.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:10 smithi006 ceph-mon[98665]: pgmap v979: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 745 op/s 2023-09-13T10:02:10.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:10 smithi053 ceph-mon[102373]: pgmap v979: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 745 op/s 2023-09-13T10:02:10.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:10 smithi131 ceph-mon[102785]: pgmap v979: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 16 MiB/s wr, 745 op/s 2023-09-13T10:02:10.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 367525 33.67 MB/sec execute 450 sec latency 78.390 ms 2023-09-13T10:02:11.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 368145 33.68 MB/sec execute 451 sec latency 43.092 ms 2023-09-13T10:02:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:12 smithi006 ceph-mon[98665]: pgmap v980: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 16 MiB/s wr, 761 op/s 2023-09-13T10:02:12.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:12 smithi053 ceph-mon[102373]: pgmap v980: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 16 MiB/s wr, 761 op/s 2023-09-13T10:02:12.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:12 smithi131 ceph-mon[102785]: pgmap v980: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 16 MiB/s wr, 761 op/s 2023-09-13T10:02:12.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 368665 33.68 MB/sec execute 452 sec latency 85.145 ms 2023-09-13T10:02:13.606 INFO:tasks.workunit.client.0.smithi006.stdout: 10 369215 33.66 MB/sec execute 453 sec latency 81.908 ms 2023-09-13T10:02:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:14 smithi006 ceph-mon[98665]: pgmap v981: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 781 op/s 2023-09-13T10:02:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:14 smithi053 ceph-mon[102373]: pgmap v981: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 781 op/s 2023-09-13T10:02:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:14 smithi131 ceph-mon[102785]: pgmap v981: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 17 MiB/s wr, 781 op/s 2023-09-13T10:02:14.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 369734 33.65 MB/sec execute 454 sec latency 73.633 ms 2023-09-13T10:02:15.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 370218 33.63 MB/sec execute 455 sec latency 225.748 ms 2023-09-13T10:02:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:16 smithi053 ceph-mon[102373]: pgmap v982: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 739 op/s 2023-09-13T10:02:16.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:16 smithi006 ceph-mon[98665]: pgmap v982: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 739 op/s 2023-09-13T10:02:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:16 smithi131 ceph-mon[102785]: pgmap v982: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 12 MiB/s wr, 739 op/s 2023-09-13T10:02:16.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 370751 33.61 MB/sec execute 456 sec latency 175.562 ms 2023-09-13T10:02:17.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 371356 33.62 MB/sec execute 457 sec latency 102.060 ms 2023-09-13T10:02:17.899 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:02:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 -- 172.21.15.6:0/814909721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd50100e80 msgr2=0x7fdd501012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 --2- 172.21.15.6:0/814909721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd50100e80 0x7fdd501012e0 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009990 tx=0x7fdd44009ca0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 -- 172.21.15.6:0/814909721 shutdown_connections 2023-09-13T10:02:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 --2- 172.21.15.6:0/814909721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd50101820 0x7fdd501080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 --2- 172.21.15.6:0/814909721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd500ffc90 0x7fdd501000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 --2- 172.21.15.6:0/814909721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd50100e80 0x7fdd501012e0 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 -- 172.21.15.6:0/814909721 >> 172.21.15.6:0/814909721 conn(0x7fdd500fb220 msgr2=0x7fdd500fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 -- 172.21.15.6:0/814909721 shutdown_connections 2023-09-13T10:02:18.059 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.056+0000 7fdd564bb700 1 -- 172.21.15.6:0/814909721 wait complete. 2023-09-13T10:02:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.057+0000 7fdd564bb700 1 Processor -- start 2023-09-13T10:02:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.057+0000 7fdd564bb700 1 -- start start 2023-09-13T10:02:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd564bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd500ffc90 0x7fdd50196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd564bb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd50100e80 0x7fdd50197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd564bb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd50101820 0x7fdd5019e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd564bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5019e6c0 con 0x7fdd500ffc90 2023-09-13T10:02:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd564bb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd5019e800 con 0x7fdd50101820 2023-09-13T10:02:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd564bb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50108890 con 0x7fdd50100e80 2023-09-13T10:02:18.062 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd500ffc90 0x7fdd50196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd500ffc90 0x7fdd50196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47884/0 (socket says 172.21.15.6:47884) 2023-09-13T10:02:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3832955497 learned_addr learned my addr 172.21.15.6:0/3832955497 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd54a58700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd50101820 0x7fdd5019e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.063 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.058+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd50100e80 0x7fdd50197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3832955497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd50100e80 msgr2=0x7fdd50197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd50100e80 0x7fdd50197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3832955497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd50101820 msgr2=0x7fdd5019e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.064 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd50101820 0x7fdd5019e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3832955497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd440095f0 con 0x7fdd500ffc90 2023-09-13T10:02:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd500ffc90 0x7fdd50196b40 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000e970 tx=0x7fdd4000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4d7fa700 1 -- 172.21.15.6:0/3832955497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40009790 con 0x7fdd500ffc90 2023-09-13T10:02:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd50108b70 con 0x7fdd500ffc90 2023-09-13T10:02:18.065 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4d7fa700 1 -- 172.21.15.6:0/3832955497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd4000c7e0 con 0x7fdd500ffc90 2023-09-13T10:02:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd4d7fa700 1 -- 172.21.15.6:0/3832955497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40003c70 con 0x7fdd500ffc90 2023-09-13T10:02:18.066 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.059+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd50109080 con 0x7fdd500ffc90 2023-09-13T10:02:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.062+0000 7fdd4d7fa700 1 -- 172.21.15.6:0/3832955497 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fdd4000cc50 con 0x7fdd500ffc90 2023-09-13T10:02:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.063+0000 7fdd4d7fa700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd380a0640 0x7fdd380a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.063+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd380a0640 0x7fdd380a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.069 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.063+0000 7fdd4d7fa700 1 -- 172.21.15.6:0/3832955497 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd40014070 con 0x7fdd500ffc90 2023-09-13T10:02:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.063+0000 7fdd626a0b80 1 Processor -- start 2023-09-13T10:02:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.063+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd380a0640 0x7fdd380a2b00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005950 tx=0x7fdd440058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.063+0000 7fdd626a0b80 1 -- start start 2023-09-13T10:02:18.070 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465286b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465287060 0x5594652854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465285e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594651de780 con 0x559465285a00 2023-09-13T10:02:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594651dc0a0 con 0x559465286700 2023-09-13T10:02:18.071 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594651d7990 con 0x559465287060 2023-09-13T10:02:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465287060 0x5594652854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465287060 0x5594652854c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50948/0 (socket says 172.21.15.6:50948) 2023-09-13T10:02:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd54a58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465285e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/2745931601 learned_addr learned my addr 172.21.15.6:0/2745931601 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465286b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/2745931601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 msgr2=0x559465286b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465286b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/2745931601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 msgr2=0x559465285e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465285e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/2745931601 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559465057630 con 0x559465287060 2023-09-13T10:02:18.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd54a58700 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465285e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.064+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465287060 0x5594652854c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdd44015000 tx=0x7fdd44020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8b11145df0bdff server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd367fc700 1 -- 172.21.15.6:0/2745931601 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4400b7e0 con 0x559465287060 2023-09-13T10:02:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd367fc700 1 -- 172.21.15.6:0/2745931601 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd4401e040 con 0x559465287060 2023-09-13T10:02:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd367fc700 1 -- 172.21.15.6:0/2745931601 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44004b80 con 0x559465287060 2023-09-13T10:02:18.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd626a0b80 1 -- 172.21.15.6:0/2745931601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465287060 msgr2=0x5594652854c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465287060 0x5594652854c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdd44015000 tx=0x7fdd44020000 comp rx=0 tx=0).stop 2023-09-13T10:02:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd626a0b80 1 -- 172.21.15.6:0/2745931601 shutdown_connections 2023-09-13T10:02:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465285e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465286b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.075 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/2745931601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465287060 0x5594652854c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.065+0000 7fdd626a0b80 1 -- 172.21.15.6:0/2745931601 >> 172.21.15.6:0/2745931601 conn(0x5594651e3c80 msgr2=0x55946527ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.066+0000 7fdd626a0b80 1 -- 172.21.15.6:0/2745931601 shutdown_connections 2023-09-13T10:02:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.066+0000 7fdd626a0b80 1 -- 172.21.15.6:0/2745931601 wait complete. 2023-09-13T10:02:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.066+0000 7fdd626a0b80 1 -- start start 2023-09-13T10:02:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.066+0000 7fdd626a0b80 1 Processor -- start 2023-09-13T10:02:18.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465285a00 0x55946528ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465286700 0x55946528f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465287060 0x5594652964b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559465175bb0 con 0x559465286700 2023-09-13T10:02:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594651758b0 con 0x559465287060 2023-09-13T10:02:18.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559465059920 con 0x559465285a00 2023-09-13T10:02:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd626a0b80 10 client.0 _ll_register_callbacks cb 0x559465173680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465285a00 0x55946528ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465285a00 0x55946528ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:50952/0 (socket says 172.21.15.6:50952) 2023-09-13T10:02:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3131405386 learned_addr learned my addr 172.21.15.6:0/3131405386 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465286700 0x55946528f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3131405386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465287060 msgr2=0x5594652964b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465287060 0x5594652964b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3131405386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465286700 msgr2=0x55946528f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465286700 0x55946528f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3131405386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd50069320 con 0x559465285a00 2023-09-13T10:02:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465285a00 0x55946528ef30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdd400c9850 tx=0x7fdd40003dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b090646eed282e8 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.067+0000 7fdd2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:02:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3131405386 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400b0070 con 0x559465285a00 2023-09-13T10:02:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3131405386 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd4009d370 con 0x559465285a00 2023-09-13T10:02:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559465278670 con 0x559465285a00 2023-09-13T10:02:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3131405386 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4009d170 con 0x559465285a00 2023-09-13T10:02:18.082 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 10 client.30490 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x5594651ef7a0 con 0x559465285a00 2023-09-13T10:02:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3131405386 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd40063080 con 0x559465285a00 2023-09-13T10:02:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3131405386 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fdd40065140 con 0x559465285a00 2023-09-13T10:02:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 10 client.30490 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 10 client.30490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:18.083 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 20 client.30490 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:18.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55946529ace0 0x55946529d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 4 client.30490 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:18.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.068+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594651d0970 con 0x55946529ace0 2023-09-13T10:02:18.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.069+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55946529ace0 0x55946529d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.084 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.069+0000 7fdd2f7fe700 10 client.30490 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:18.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.069+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55946529ace0 0x55946529d100 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fede6d7d7e56b658 server_cookie=400a68a5d69038a0 in_seq=0 out_seq=0 2023-09-13T10:02:18.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3131405386 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594651d0970 con 0x55946529ace0 2023-09-13T10:02:18.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd2f7fe700 10 client.30490 handle_command_reply: tid=0 2023-09-13T10:02:18.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 client.30490 shutdown 2023-09-13T10:02:18.085 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465285a00 msgr2=0x55946528ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465285a00 0x55946528ef30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdd400c9850 tx=0x7fdd40003dd0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 shutdown_connections 2023-09-13T10:02:18.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465287060 0x5594652964b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465285a00 0x55946528ef30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55946529ace0 0x55946529d100 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3131405386 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465286700 0x55946528f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd2f7fe700 0 client.30490 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:18.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 >> 172.21.15.6:0/3131405386 conn(0x5594651e3c80 msgr2=0x55946527a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 shutdown_connections 2023-09-13T10:02:18.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3131405386 wait complete. 2023-09-13T10:02:18.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.070+0000 7fdd626a0b80 20 client.30490 trim_cache size 0 max 16384 2023-09-13T10:02:18.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 Processor -- start 2023-09-13T10:02:18.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 -- start start 2023-09-13T10:02:18.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594651e3c80 0x5594652854c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465285a00 0x559465296470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465286700 0x55946528ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559465280810 con 0x5594651e3c80 2023-09-13T10:02:18.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559465280a30 con 0x559465285a00 2023-09-13T10:02:18.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.090+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594652900b0 con 0x559465286700 2023-09-13T10:02:18.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594651e3c80 0x5594652854c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594651e3c80 0x5594652854c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47906/0 (socket says 172.21.15.6:47906) 2023-09-13T10:02:18.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3546081613 learned_addr learned my addr 172.21.15.6:0/3546081613 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd54a58700 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465286700 0x55946528ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465285a00 0x559465296470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3546081613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465286700 msgr2=0x55946528ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465286700 0x55946528ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3546081613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465285a00 msgr2=0x559465296470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465285a00 0x559465296470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 -- 172.21.15.6:0/3546081613 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559465003de0 con 0x5594651e3c80 2023-09-13T10:02:18.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594651e3c80 0x5594652854c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fdd40095a40 tx=0x7fdd40097af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=997caee5ab8ca978 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd36ffd700 1 -- 172.21.15.6:0/3546081613 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400b0070 con 0x5594651e3c80 2023-09-13T10:02:18.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd36ffd700 1 -- 172.21.15.6:0/3546081613 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559465278670 con 0x5594651e3c80 2023-09-13T10:02:18.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.091+0000 7fdd36ffd700 1 -- 172.21.15.6:0/3546081613 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd400a1120 con 0x5594651e3c80 2023-09-13T10:02:18.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3546081613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594651e3c80 msgr2=0x5594652854c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594651e3c80 0x5594652854c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fdd40095a40 tx=0x7fdd40097af0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3546081613 shutdown_connections 2023-09-13T10:02:18.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559465286700 0x55946528ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5594651e3c80 0x5594652854c0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3546081613 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465285a00 0x559465296470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3546081613 >> 172.21.15.6:0/3546081613 conn(0x559465280240 msgr2=0x55946528ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3546081613 shutdown_connections 2023-09-13T10:02:18.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.092+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3546081613 wait complete. 2023-09-13T10:02:18.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 -- start start 2023-09-13T10:02:18.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 Processor -- start 2023-09-13T10:02:18.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594651e3c80 0x5594652960b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465292b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465293090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594652968d0 con 0x559465285a00 2023-09-13T10:02:18.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559465293600 con 0x559465286700 2023-09-13T10:02:18.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594652937c0 con 0x5594651e3c80 2023-09-13T10:02:18.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd626a0b80 10 client.0 _ll_register_callbacks cb 0x559465173680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:18.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd4f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465292b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd4f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465292b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47914/0 (socket says 172.21.15.6:47914) 2023-09-13T10:02:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd4ffff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594651e3c80 0x5594652960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/3025996847 learned_addr learned my addr 172.21.15.6:0/3025996847 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.093+0000 7fdd54a58700 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465293090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/3025996847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594651e3c80 msgr2=0x5594652960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594651e3c80 0x5594652960b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 msgr2=0x559465293090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465293090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd4f7fe700 1 -- 172.21.15.6:0/3025996847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594651ef7a0 con 0x559465285a00 2023-09-13T10:02:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594651e3c80 0x5594652960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd4f7fe700 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465292b50 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fdd44015000 tx=0x7fdd44005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8316f1c2225a7a16 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd2f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:18.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3025996847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44003c40 con 0x559465285a00 2023-09-13T10:02:18.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3025996847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fdd4403ba50 con 0x559465285a00 2023-09-13T10:02:18.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd4401e040 con 0x559465285a00 2023-09-13T10:02:18.105 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3025996847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd4403bc10 con 0x559465285a00 2023-09-13T10:02:18.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd626a0b80 10 client.21297 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:18.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.094+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x559464fecc60 con 0x559465285a00 2023-09-13T10:02:18.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3025996847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fdd4401e040 con 0x559465285a00 2023-09-13T10:02:18.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3025996847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fdd4400bb90 con 0x559465285a00 2023-09-13T10:02:18.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd626a0b80 10 client.21297 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:18.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd626a0b80 10 client.21297 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:18.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd626a0b80 20 client.21297 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:18.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559465287060 0x5594652f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd626a0b80 4 client.21297 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:02:18.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559465191050 con 0x559465287060 2023-09-13T10:02:18.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.095+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559465287060 0x5594652f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.096+0000 7fdd4ffff700 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559465287060 0x5594652f21e0 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b6ffbdabc42494a server_cookie=974373d0bdc5d41e in_seq=0 out_seq=0 2023-09-13T10:02:18.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.096+0000 7fdd2f7fe700 10 client.21297 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.101+0000 7fdd2f7fe700 1 -- 172.21.15.6:0/3025996847 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x559465191050 con 0x559465287060 2023-09-13T10:02:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.101+0000 7fdd2f7fe700 10 client.21297 handle_command_reply: tid=0 2023-09-13T10:02:18.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.101+0000 7fdd626a0b80 1 client.21297 shutdown 2023-09-13T10:02:18.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 msgr2=0x559465292b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465292b50 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7fdd44015000 tx=0x7fdd44005c80 comp rx=0 tx=0).stop 2023-09-13T10:02:18.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 shutdown_connections 2023-09-13T10:02:18.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559465286700 0x559465293090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5594651e3c80 0x5594652960b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x559465287060 0x5594652f21e0 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 --2- 172.21.15.6:0/3025996847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559465285a00 0x559465292b50 unknown :-1 s=CLOSED pgs=1926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd2f7fe700 0 client.21297 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 >> 172.21.15.6:0/3025996847 conn(0x559465280240 msgr2=0x55946528ece0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.111 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 shutdown_connections 2023-09-13T10:02:18.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 1 -- 172.21.15.6:0/3025996847 wait complete. 2023-09-13T10:02:18.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.102+0000 7fdd626a0b80 20 client.21297 trim_cache size 0 max 16384 2023-09-13T10:02:18.112 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:02:18.112 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T10:02:18.113 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T10:02:18.113 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:02:18.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd380a0640 msgr2=0x7fdd380a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd380a0640 0x7fdd380a2b00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005950 tx=0x7fdd440058e0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd500ffc90 msgr2=0x7fdd50196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd500ffc90 0x7fdd50196b40 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000e970 tx=0x7fdd4000ec80 comp rx=0 tx=0).stop 2023-09-13T10:02:18.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 shutdown_connections 2023-09-13T10:02:18.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fdd50101820 0x7fdd5019e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fdd380a0640 0x7fdd380a2b00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdd500ffc90 0x7fdd50196b40 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 --2- 172.21.15.6:0/3832955497 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd50100e80 0x7fdd50197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 >> 172.21.15.6:0/3832955497 conn(0x7fdd500fb220 msgr2=0x7fdd500fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 shutdown_connections 2023-09-13T10:02:18.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.103+0000 7fdd564bb700 1 -- 172.21.15.6:0/3832955497 wait complete. 2023-09-13T10:02:18.118 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T10:02:18.119 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:02:18.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:18 smithi006 ceph-mon[98665]: pgmap v983: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 613 op/s 2023-09-13T10:02:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 -- 172.21.15.6:0/2590381237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 msgr2=0x7fa884103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 --2- 172.21.15.6:0/2590381237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884103ca0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fa874009990 tx=0x7fa874009ca0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 -- 172.21.15.6:0/2590381237 shutdown_connections 2023-09-13T10:02:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 --2- 172.21.15.6:0/2590381237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa884106b10 0x7fa884108f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 --2- 172.21.15.6:0/2590381237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884103ca0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 --2- 172.21.15.6:0/2590381237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa8841041e0 0x7fa8841065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 -- 172.21.15.6:0/2590381237 >> 172.21.15.6:0/2590381237 conn(0x7fa8840fb220 msgr2=0x7fa8840fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 -- 172.21.15.6:0/2590381237 shutdown_connections 2023-09-13T10:02:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.259+0000 7fa888ebd700 1 -- 172.21.15.6:0/2590381237 wait complete. 2023-09-13T10:02:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 Processor -- start 2023-09-13T10:02:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 -- start start 2023-09-13T10:02:18.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884101220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8841041e0 0x7fa8840ff860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa884106b10 0x7fa8840ffda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa884100540 con 0x7fa8841018b0 2023-09-13T10:02:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841006b0 con 0x7fa884106b10 2023-09-13T10:02:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.260+0000 7fa888ebd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841a0af0 con 0x7fa8841041e0 2023-09-13T10:02:18.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884101220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884101220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47926/0 (socket says 172.21.15.6:47926) 2023-09-13T10:02:18.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 -- 172.21.15.6:0/4132913378 learned_addr learned my addr 172.21.15.6:0/4132913378 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa881d9b700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8841041e0 0x7fa8840ff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa882d9d700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa884106b10 0x7fa8840ffda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 -- 172.21.15.6:0/4132913378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8841041e0 msgr2=0x7fa8840ff860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8841041e0 0x7fa8840ff860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 -- 172.21.15.6:0/4132913378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa884106b10 msgr2=0x7fa8840ffda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa884106b10 0x7fa8840ffda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 -- 172.21.15.6:0/4132913378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c009c40 con 0x7fa8841018b0 2023-09-13T10:02:18.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa88259c700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884101220 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa87400b680 tx=0x7fa874005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa8737fe700 1 -- 172.21.15.6:0/4132913378 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87401d070 con 0x7fa8841018b0 2023-09-13T10:02:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8740095f0 con 0x7fa8841018b0 2023-09-13T10:02:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.261+0000 7fa8737fe700 1 -- 172.21.15.6:0/4132913378 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fa874022470 con 0x7fa8841018b0 2023-09-13T10:02:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.262+0000 7fa8737fe700 1 -- 172.21.15.6:0/4132913378 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa874017650 con 0x7fa8841018b0 2023-09-13T10:02:18.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.262+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8841a1060 con 0x7fa8841018b0 2023-09-13T10:02:18.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.263+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa88410c5c0 con 0x7fa8841018b0 2023-09-13T10:02:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.265+0000 7fa8737fe700 1 -- 172.21.15.6:0/4132913378 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fa8740225e0 con 0x7fa8841018b0 2023-09-13T10:02:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.265+0000 7fa8737fe700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa86c0a0640 0x7fa86c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.265+0000 7fa8737fe700 1 -- 172.21.15.6:0/4132913378 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fa8740cd780 con 0x7fa8841018b0 2023-09-13T10:02:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.266+0000 7fa881d9b700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa86c0a0640 0x7fa86c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.266+0000 7fa881d9b700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa86c0a0640 0x7fa86c0a2b00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa878009c60 tx=0x7fa878009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.269+0000 7fa8737fe700 1 -- 172.21.15.6:0/4132913378 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fa8740972f0 con 0x7fa8841018b0 2023-09-13T10:02:18.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:18 smithi053 ceph-mon[102373]: pgmap v983: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 613 op/s 2023-09-13T10:02:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:18 smithi131 ceph-mon[102785]: pgmap v983: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.0 MiB/s wr, 613 op/s 2023-09-13T10:02:18.559 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.559+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa88410c800 con 0x7fa8841018b0 2023-09-13T10:02:18.560 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.559+0000 7fa8737fe700 1 -- 172.21.15.6:0/4132913378 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+11348 (secure 0 0 0) 0x7fa8740ba070 con 0x7fa8841018b0 2023-09-13T10:02:18.560 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:02:18.560 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":73,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":73,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T10:01:57.189672+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":6,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[0,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:02:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.561+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa86c0a0640 msgr2=0x7fa86c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.562 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.561+0000 7fa888ebd700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa86c0a0640 0x7fa86c0a2b00 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fa878009c60 tx=0x7fa878009260 comp rx=0 tx=0).stop 2023-09-13T10:02:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.561+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 msgr2=0x7fa884101220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.561+0000 7fa888ebd700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884101220 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7fa87400b680 tx=0x7fa874005740 comp rx=0 tx=0).stop 2023-09-13T10:02:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 shutdown_connections 2023-09-13T10:02:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fa884106b10 0x7fa8840ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.563 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fa86c0a0640 0x7fa86c0a2b00 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8841018b0 0x7fa884101220 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 --2- 172.21.15.6:0/4132913378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8841041e0 0x7fa8840ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 >> 172.21.15.6:0/4132913378 conn(0x7fa8840fb220 msgr2=0x7fa884102d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 shutdown_connections 2023-09-13T10:02:18.564 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.562+0000 7fa888ebd700 1 -- 172.21.15.6:0/4132913378 wait complete. 2023-09-13T10:02:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 73 2023-09-13T10:02:18.578 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T10:02:18.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 372044 33.61 MB/sec execute 458 sec latency 93.022 ms 2023-09-13T10:02:18.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 -- 172.21.15.6:0/2491530783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 msgr2=0x7f6614108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.722 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 --2- 172.21.15.6:0/2491530783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 0x7f6614108100 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f660c009f90 tx=0x7f660c00b330 comp rx=0 tx=0).stop 2023-09-13T10:02:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 -- 172.21.15.6:0/2491530783 shutdown_connections 2023-09-13T10:02:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 --2- 172.21.15.6:0/2491530783 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 0x7f6614108100 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 --2- 172.21.15.6:0/2491530783 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66140ffcc0 0x7f66141000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 --2- 172.21.15.6:0/2491530783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 0x7f6614101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 -- 172.21.15.6:0/2491530783 >> 172.21.15.6:0/2491530783 conn(0x7f66140fb250 msgr2=0x7f66140fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 -- 172.21.15.6:0/2491530783 shutdown_connections 2023-09-13T10:02:18.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.721+0000 7f6619f29700 1 -- 172.21.15.6:0/2491530783 wait complete. 2023-09-13T10:02:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 Processor -- start 2023-09-13T10:02:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 -- start start 2023-09-13T10:02:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66140ffcc0 0x7f6614196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 0x7f6614197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 0x7f661419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661419e6c0 con 0x7f6614100eb0 2023-09-13T10:02:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661419e800 con 0x7f66140ffcc0 2023-09-13T10:02:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6619f29700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661419e990 con 0x7f6614101850 2023-09-13T10:02:18.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f660bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 0x7f6614197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f660bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 0x7f6614197080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47942/0 (socket says 172.21.15.6:47942) 2023-09-13T10:02:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f6613fff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 0x7f661419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f660bfff700 1 -- 172.21.15.6:0/3299281721 learned_addr learned my addr 172.21.15.6:0/3299281721 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.722+0000 7f66137fe700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66140ffcc0 0x7f6614196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f660bfff700 1 -- 172.21.15.6:0/3299281721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 msgr2=0x7f661419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f660bfff700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 0x7f661419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f660bfff700 1 -- 172.21.15.6:0/3299281721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66140ffcc0 msgr2=0x7f6614196b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f660bfff700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66140ffcc0 0x7f6614196b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f660bfff700 1 -- 172.21.15.6:0/3299281721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c009c40 con 0x7f6614100eb0 2023-09-13T10:02:18.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f6613fff700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 0x7f661419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f660bfff700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 0x7f6614197080 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00e9a0 tx=0x7f65fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f66117fa700 1 -- 172.21.15.6:0/3299281721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc009790 con 0x7f6614100eb0 2023-09-13T10:02:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f661419ec70 con 0x7f6614100eb0 2023-09-13T10:02:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f66117fa700 1 -- 172.21.15.6:0/3299281721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65fc00ce80 con 0x7f6614100eb0 2023-09-13T10:02:18.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f66117fa700 1 -- 172.21.15.6:0/3299281721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc018680 con 0x7f6614100eb0 2023-09-13T10:02:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.723+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661419f1d0 con 0x7f6614100eb0 2023-09-13T10:02:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.725+0000 7f66117fa700 1 -- 172.21.15.6:0/3299281721 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f65fc010430 con 0x7f6614100eb0 2023-09-13T10:02:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.726+0000 7f66117fa700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66000a0640 0x7f66000a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.726+0000 7f66117fa700 1 -- 172.21.15.6:0/3299281721 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f65fc014070 con 0x7f6614100eb0 2023-09-13T10:02:18.732 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.726+0000 7f66137fe700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66000a0640 0x7f66000a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f66137fe700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66000a0640 0x7f66000a2b00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6614100d10 tx=0x7f6604009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 Processor -- start 2023-09-13T10:02:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 -- start start 2023-09-13T10:02:18.738 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc7ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc7d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc7e270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cbd2780 con 0x55ab3cc7f470 2023-09-13T10:02:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cbd00a0 con 0x55ab3cc7eb10 2023-09-13T10:02:18.739 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f662610eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cbcb990 con 0x55ab3cc7de10 2023-09-13T10:02:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f660bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc7d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f66137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc7ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f660bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc7d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47950/0 (socket says 172.21.15.6:47950) 2023-09-13T10:02:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f660bfff700 1 -- 172.21.15.6:0/1040442529 learned_addr learned my addr 172.21.15.6:0/1040442529 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f6613fff700 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc7e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f660bfff700 1 -- 172.21.15.6:0/1040442529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 msgr2=0x55ab3cc7e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f660bfff700 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc7e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f660bfff700 1 -- 172.21.15.6:0/1040442529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 msgr2=0x55ab3cc7ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.727+0000 7f660bfff700 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc7ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.741 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.728+0000 7f660bfff700 1 -- 172.21.15.6:0/1040442529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab3ca4b630 con 0x55ab3cc7f470 2023-09-13T10:02:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.728+0000 7f66137fe700 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc7ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.728+0000 7f660bfff700 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc7d8d0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0994e0 tx=0x7f65fc098fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6c0dd858558db4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.728+0000 7f6609ffb700 1 -- 172.21.15.6:0/1040442529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc099550 con 0x55ab3cc7f470 2023-09-13T10:02:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.728+0000 7f6609ffb700 1 -- 172.21.15.6:0/1040442529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65fc09d380 con 0x55ab3cc7f470 2023-09-13T10:02:18.742 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.728+0000 7f6609ffb700 1 -- 172.21.15.6:0/1040442529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc010830 con 0x55ab3cc7f470 2023-09-13T10:02:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 -- 172.21.15.6:0/1040442529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 msgr2=0x55ab3cc7d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc7d8d0 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f65fc0994e0 tx=0x7f65fc098fb0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 -- 172.21.15.6:0/1040442529 shutdown_connections 2023-09-13T10:02:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc7e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.743 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc7ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 --2- 172.21.15.6:0/1040442529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc7d8d0 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 -- 172.21.15.6:0/1040442529 >> 172.21.15.6:0/1040442529 conn(0x55ab3cbd7c80 msgr2=0x55ab3cc73f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 -- 172.21.15.6:0/1040442529 shutdown_connections 2023-09-13T10:02:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 -- 172.21.15.6:0/1040442529 wait complete. 2023-09-13T10:02:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.729+0000 7f662610eb80 1 -- start start 2023-09-13T10:02:18.744 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 1 Processor -- start 2023-09-13T10:02:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc87400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc87940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc8e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cb69bb0 con 0x55ab3cc7f470 2023-09-13T10:02:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cb698b0 con 0x55ab3cc7eb10 2023-09-13T10:02:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3ca4d920 con 0x55ab3cc7de10 2023-09-13T10:02:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f662610eb80 10 client.0 _ll_register_callbacks cb 0x55ab3cb67680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc8e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f660bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc87940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.746 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc8e980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47958/0 (socket says 172.21.15.6:47958) 2023-09-13T10:02:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f66137fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc87400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f660bfff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc87940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41480/0 (socket says 172.21.15.6:41480) 2023-09-13T10:02:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 -- 172.21.15.6:0/3424924778 learned_addr learned my addr 172.21.15.6:0/3424924778 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 -- 172.21.15.6:0/3424924778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 msgr2=0x55ab3cc87400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc87400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 -- 172.21.15.6:0/3424924778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 msgr2=0x55ab3cc87940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc87940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.730+0000 7f6613fff700 1 -- 172.21.15.6:0/3424924778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f661419f1d0 con 0x55ab3cc7f470 2023-09-13T10:02:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f6613fff700 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc8e980 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f660c003c30 tx=0x7f660c003c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91b788a189fa8432 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f65f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f65f2ffd700 1 -- 172.21.15.6:0/3424924778 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c00e040 con 0x55ab3cc7f470 2023-09-13T10:02:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f65f2ffd700 1 -- 172.21.15.6:0/3424924778 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f660c00b9f0 con 0x55ab3cc7f470 2023-09-13T10:02:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab3cc6c670 con 0x55ab3cc7f470 2023-09-13T10:02:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f65f2ffd700 1 -- 172.21.15.6:0/3424924778 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f660c00bbb0 con 0x55ab3cc7f470 2023-09-13T10:02:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 10 client.21315 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55ab3cbe37a0 con 0x55ab3cc7f470 2023-09-13T10:02:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f65f2ffd700 1 -- 172.21.15.6:0/3424924778 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55ab3cc6c670 con 0x55ab3cc7f470 2023-09-13T10:02:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f65f2ffd700 1 -- 172.21.15.6:0/3424924778 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f660c019070 con 0x55ab3cc7f470 2023-09-13T10:02:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 10 client.21315 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 10 client.21315 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:02:18.750 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 20 client.21315 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cc932a0 0x55ab3cc956c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 4 client.21315 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.731+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab3cbc4970 con 0x55ab3cc932a0 2023-09-13T10:02:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.732+0000 7f66137fe700 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cc932a0 0x55ab3cc956c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.751 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.732+0000 7f66137fe700 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cc932a0 0x55ab3cc956c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=fe8fe00eb5424897 server_cookie=104e5b96cf851107 in_seq=0 out_seq=0 2023-09-13T10:02:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.732+0000 7f65f2ffd700 10 client.21315 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f65f2ffd700 1 -- 172.21.15.6:0/3424924778 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55ab3cbc4970 con 0x55ab3cc932a0 2023-09-13T10:02:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f65f2ffd700 10 client.21315 handle_command_reply: tid=0 2023-09-13T10:02:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 client.21315 shutdown 2023-09-13T10:02:18.752 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 msgr2=0x55ab3cc8e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc8e980 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7f660c003c30 tx=0x7f660c003c60 comp rx=0 tx=0).stop 2023-09-13T10:02:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 shutdown_connections 2023-09-13T10:02:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cc932a0 0x55ab3cc956c0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cc8e980 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f65f2ffd700 0 client.21315 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc87400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 --2- 172.21.15.6:0/3424924778 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc87940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.736+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 >> 172.21.15.6:0/3424924778 conn(0x55ab3cbd7c80 msgr2=0x55ab3cc6e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.737+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 shutdown_connections 2023-09-13T10:02:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.737+0000 7f662610eb80 1 -- 172.21.15.6:0/3424924778 wait complete. 2023-09-13T10:02:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.737+0000 7f662610eb80 20 client.21315 trim_cache size 0 max 16384 2023-09-13T10:02:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.751+0000 7f662610eb80 1 Processor -- start 2023-09-13T10:02:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.751+0000 7f662610eb80 1 -- start start 2023-09-13T10:02:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f662610eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc74fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f662610eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc8e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f662610eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7f470 0x55ab3cc86070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f662610eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cc8ede0 con 0x55ab3cc7eb10 2023-09-13T10:02:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f662610eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cc759f0 con 0x55ab3cc7f470 2023-09-13T10:02:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f662610eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cc88580 con 0x55ab3cc7de10 2023-09-13T10:02:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc8e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc8e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47964/0 (socket says 172.21.15.6:47964) 2023-09-13T10:02:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f66137fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc74fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.761 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 -- 172.21.15.6:0/755960120 learned_addr learned my addr 172.21.15.6:0/755960120 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f6613fff700 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7f470 0x55ab3cc86070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 -- 172.21.15.6:0/755960120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 msgr2=0x55ab3cc74fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc74fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 -- 172.21.15.6:0/755960120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7f470 msgr2=0x55ab3cc86070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.762 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7f470 0x55ab3cc86070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 -- 172.21.15.6:0/755960120 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab3c9f7de0 con 0x55ab3cc7eb10 2023-09-13T10:02:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660bfff700 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc8e8a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f65fc01e000 tx=0x7f65fc010b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c0f85270ddd1ab server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.752+0000 7f660a7fc700 1 -- 172.21.15.6:0/755960120 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc099550 con 0x55ab3cc7eb10 2023-09-13T10:02:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f660a7fc700 1 -- 172.21.15.6:0/755960120 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65fc0b0020 con 0x55ab3cc7eb10 2023-09-13T10:02:18.763 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f660a7fc700 1 -- 172.21.15.6:0/755960120 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65fc0840b0 con 0x55ab3cc7eb10 2023-09-13T10:02:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f662610eb80 1 -- 172.21.15.6:0/755960120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7eb10 msgr2=0x55ab3cc8e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f662610eb80 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc8e8a0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f65fc01e000 tx=0x7f65fc010b10 comp rx=0 tx=0).stop 2023-09-13T10:02:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f662610eb80 1 -- 172.21.15.6:0/755960120 shutdown_connections 2023-09-13T10:02:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f662610eb80 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7f470 0x55ab3cc86070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f662610eb80 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7de10 0x55ab3cc74fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.764 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f662610eb80 1 --2- 172.21.15.6:0/755960120 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7eb10 0x55ab3cc8e8a0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.753+0000 7f662610eb80 1 -- 172.21.15.6:0/755960120 >> 172.21.15.6:0/755960120 conn(0x55ab3cbd7c80 msgr2=0x55ab3cc73e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.754+0000 7f662610eb80 1 -- 172.21.15.6:0/755960120 shutdown_connections 2023-09-13T10:02:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.754+0000 7f662610eb80 1 -- 172.21.15.6:0/755960120 wait complete. 2023-09-13T10:02:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.754+0000 7f662610eb80 1 -- start start 2023-09-13T10:02:18.765 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.754+0000 7f662610eb80 1 Processor -- start 2023-09-13T10:02:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f662610eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7de10 0x55ab3cc8c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f662610eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7eb10 0x55ab3cce30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f662610eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cce56c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f662610eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cce5e00 con 0x55ab3cc7f470 2023-09-13T10:02:18.766 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f662610eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cce5f70 con 0x55ab3cc7de10 2023-09-13T10:02:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f662610eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab3cce6130 con 0x55ab3cc7eb10 2023-09-13T10:02:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f662610eb80 10 client.0 _ll_register_callbacks cb 0x55ab3cb67680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7de10 0x55ab3cc8c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f6613fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cce56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.767 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7de10 0x55ab3cc8c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41492/0 (socket says 172.21.15.6:41492) 2023-09-13T10:02:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 -- 172.21.15.6:0/4288098089 learned_addr learned my addr 172.21.15.6:0/4288098089 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f660bfff700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7eb10 0x55ab3cce30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 -- 172.21.15.6:0/4288098089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7eb10 msgr2=0x55ab3cce30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7eb10 0x55ab3cce30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.768 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 -- 172.21.15.6:0/4288098089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 msgr2=0x55ab3cce56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cce56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f66137fe700 1 -- 172.21.15.6:0/4288098089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65fc095040 con 0x55ab3cc7de10 2023-09-13T10:02:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f6613fff700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cce56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.755+0000 7f660bfff700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7eb10 0x55ab3cce30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.769 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.756+0000 7f66137fe700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7de10 0x55ab3cc8c890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55ab3cc95fa0 tx=0x7f66040047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c6abb31b4a5c5ca server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.756+0000 7f65f2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:02:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.757+0000 7f65f2ffd700 1 -- 172.21.15.6:0/4288098089 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604022040 con 0x55ab3cc7de10 2023-09-13T10:02:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.757+0000 7f65f2ffd700 1 -- 172.21.15.6:0/4288098089 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f6604004220 con 0x55ab3cc7de10 2023-09-13T10:02:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.757+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65fc09d380 con 0x55ab3cc7de10 2023-09-13T10:02:18.770 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.757+0000 7f65f2ffd700 1 -- 172.21.15.6:0/4288098089 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f660402b5b0 con 0x55ab3cc7de10 2023-09-13T10:02:18.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.757+0000 7f662610eb80 10 client.30524 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:18.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55ab3c9e0c60 con 0x55ab3cc7de10 2023-09-13T10:02:18.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f65f2ffd700 1 -- 172.21.15.6:0/4288098089 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f65fc09d380 con 0x55ab3cc7de10 2023-09-13T10:02:18.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f65f2ffd700 1 -- 172.21.15.6:0/4288098089 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f660401d690 con 0x55ab3cc7de10 2023-09-13T10:02:18.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f662610eb80 10 client.30524 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f662610eb80 10 client.30524 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:02:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f662610eb80 20 client.30524 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f662610eb80 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cce7b90 0x55ab3cce9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f662610eb80 4 client.30524 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.758+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ab3cb85050 con 0x55ab3cce7b90 2023-09-13T10:02:18.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.759+0000 7f660bfff700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cce7b90 0x55ab3cce9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.759+0000 7f660bfff700 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cce7b90 0x55ab3cce9fb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=cbd80fda7c9507f server_cookie=8d941824b52c04d1 in_seq=0 out_seq=0 2023-09-13T10:02:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.759+0000 7f65f2ffd700 10 client.30524 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:18.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f65f2ffd700 1 -- 172.21.15.6:0/4288098089 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ab3cb85050 con 0x55ab3cce7b90 2023-09-13T10:02:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f65f2ffd700 10 client.30524 handle_command_reply: tid=0 2023-09-13T10:02:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 client.30524 shutdown 2023-09-13T10:02:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7de10 msgr2=0x55ab3cc8c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7de10 0x55ab3cc8c890 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55ab3cc95fa0 tx=0x7f66040047c0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 shutdown_connections 2023-09-13T10:02:18.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x55ab3cce7b90 0x55ab3cce9fb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55ab3cc7f470 0x55ab3cce56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f65f2ffd700 0 client.30524 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:18.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55ab3cc7de10 0x55ab3cc8c890 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 --2- 172.21.15.6:0/4288098089 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55ab3cc7eb10 0x55ab3cce30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 >> 172.21.15.6:0/4288098089 conn(0x55ab3cbd7c80 msgr2=0x55ab3cc86070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 shutdown_connections 2023-09-13T10:02:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 1 -- 172.21.15.6:0/4288098089 wait complete. 2023-09-13T10:02:18.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.760+0000 7f662610eb80 20 client.30524 trim_cache size 0 max 16384 2023-09-13T10:02:18.777 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66000a0640 msgr2=0x7f66000a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66000a0640 0x7f66000a2b00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6614100d10 tx=0x7f6604009310 comp rx=0 tx=0).stop 2023-09-13T10:02:18.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 msgr2=0x7f6614197080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 0x7f6614197080 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f65fc00e9a0 tx=0x7f65fc00ecb0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 shutdown_connections 2023-09-13T10:02:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6614101850 0x7f661419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f66140ffcc0 0x7f6614196b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f66000a0640 0x7f66000a2b00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 --2- 172.21.15.6:0/3299281721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6614100eb0 0x7f6614197080 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 >> 172.21.15.6:0/3299281721 conn(0x7f66140fb250 msgr2=0x7f6614068cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 shutdown_connections 2023-09-13T10:02:18.781 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.761+0000 7f6619f29700 1 -- 172.21.15.6:0/3299281721 wait complete. 2023-09-13T10:02:18.782 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T10:02:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/984340648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0104230 msgr2=0x7fc7e0106620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/984340648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0104230 0x7fc7e0106620 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009990 tx=0x7fc7d0009ca0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/984340648 shutdown_connections 2023-09-13T10:02:18.964 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/984340648 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7e0106b60 0x7fc7e0108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/984340648 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e0101900 0x7fc7e0103cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/984340648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0104230 0x7fc7e0106620 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/984340648 >> 172.21.15.6:0/984340648 conn(0x7fc7e00fb250 msgr2=0x7fc7e00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/984340648 shutdown_connections 2023-09-13T10:02:18.965 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.961+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/984340648 wait complete. 2023-09-13T10:02:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 Processor -- start 2023-09-13T10:02:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 -- start start 2023-09-13T10:02:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0101900 0x7fc7e0198d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7e0104230 0x7fc7e0199250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e0106b60 0x7fc7e01a0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01a0850 con 0x7fc7e0101900 2023-09-13T10:02:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01a09c0 con 0x7fc7e0106b60 2023-09-13T10:02:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e7e3f700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7e01a0b80 con 0x7fc7e0104230 2023-09-13T10:02:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e5bdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0101900 0x7fc7e0198d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e5bdb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0101900 0x7fc7e0198d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47982/0 (socket says 172.21.15.6:47982) 2023-09-13T10:02:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e5bdb700 1 -- 172.21.15.6:0/2512661630 learned_addr learned my addr 172.21.15.6:0/2512661630 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7e0104230 0x7fc7e0199250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.962+0000 7fc7e63dc700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e0106b60 0x7fc7e01a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e5bdb700 1 -- 172.21.15.6:0/2512661630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7e0104230 msgr2=0x7fc7e0199250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7e0104230 0x7fc7e0199250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e5bdb700 1 -- 172.21.15.6:0/2512661630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e0106b60 msgr2=0x7fc7e01a0280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e0106b60 0x7fc7e01a0280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e5bdb700 1 -- 172.21.15.6:0/2512661630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7d00095f0 con 0x7fc7e0101900 2023-09-13T10:02:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7e0104230 0x7fc7e0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e63dc700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e0106b60 0x7fc7e01a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:02:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0101900 0x7fc7e0198d10 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b530 tx=0x7fc7dc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7d6ffd700 1 -- 172.21.15.6:0/2512661630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc011830 con 0x7fc7e0101900 2023-09-13T10:02:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7d6ffd700 1 -- 172.21.15.6:0/2512661630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7dc011e50 con 0x7fc7e0101900 2023-09-13T10:02:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7e01a0e60 con 0x7fc7e0101900 2023-09-13T10:02:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7d6ffd700 1 -- 172.21.15.6:0/2512661630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7dc00f2e0 con 0x7fc7e0101900 2023-09-13T10:02:18.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.963+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e01a1300 con 0x7fc7e0101900 2023-09-13T10:02:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.966+0000 7fc7d6ffd700 1 -- 172.21.15.6:0/2512661630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc7dc010380 con 0x7fc7e0101900 2023-09-13T10:02:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.967+0000 7fc7d6ffd700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc7cc0a0640 0x7fc7cc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.967+0000 7fc7d6ffd700 1 -- 172.21.15.6:0/2512661630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc7dc0cb750 con 0x7fc7e0101900 2023-09-13T10:02:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.967+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc7cc0a0640 0x7fc7cc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.967+0000 7fc7f4024b80 1 Processor -- start 2023-09-13T10:02:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.967+0000 7fc7f4024b80 1 -- start start 2023-09-13T10:02:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.967+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3c95330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3c93cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94210 0x55bda3c94690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc7cc0a0640 0x7fc7cc0a2b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000b2e0 tx=0x7fc7d0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3be4780 con 0x55bda3c94210 2023-09-13T10:02:18.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3be20a0 con 0x55bda3c95870 2023-09-13T10:02:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3bdd990 con 0x55bda3c94f10 2023-09-13T10:02:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e63dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94210 0x55bda3c94690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e53da700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3c93cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e63dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94210 0x55bda3c94690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47990/0 (socket says 172.21.15.6:47990) 2023-09-13T10:02:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e63dc700 1 -- 172.21.15.6:0/1630088800 learned_addr learned my addr 172.21.15.6:0/1630088800 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3c95330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e53da700 1 -- 172.21.15.6:0/1630088800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 msgr2=0x55bda3c95330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e53da700 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3c95330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e53da700 1 -- 172.21.15.6:0/1630088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94210 msgr2=0x55bda3c94690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e53da700 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94210 0x55bda3c94690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e53da700 1 -- 172.21.15.6:0/1630088800 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bda3a5d630 con 0x55bda3c95870 2023-09-13T10:02:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.968+0000 7fc7e63dc700 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94210 0x55bda3c94690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.981 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.969+0000 7fc7e53da700 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3c93cd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0000c00 tx=0x7fc7d0020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3967b51d29a93136 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.969+0000 7fc7cbfff700 1 -- 172.21.15.6:0/1630088800 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d002b070 con 0x55bda3c95870 2023-09-13T10:02:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.969+0000 7fc7cbfff700 1 -- 172.21.15.6:0/1630088800 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d001e040 con 0x55bda3c95870 2023-09-13T10:02:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.969+0000 7fc7cbfff700 1 -- 172.21.15.6:0/1630088800 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00173f0 con 0x55bda3c95870 2023-09-13T10:02:18.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 -- 172.21.15.6:0/1630088800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 msgr2=0x55bda3c93cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3c93cd0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0000c00 tx=0x7fc7d0020000 comp rx=0 tx=0).stop 2023-09-13T10:02:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 -- 172.21.15.6:0/1630088800 shutdown_connections 2023-09-13T10:02:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94210 0x55bda3c94690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3c95330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/1630088800 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3c93cd0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 -- 172.21.15.6:0/1630088800 >> 172.21.15.6:0/1630088800 conn(0x55bda3be9c80 msgr2=0x55bda3c85f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 -- 172.21.15.6:0/1630088800 shutdown_connections 2023-09-13T10:02:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 -- 172.21.15.6:0/1630088800 wait complete. 2023-09-13T10:02:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 -- start start 2023-09-13T10:02:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.970+0000 7fc7f4024b80 1 Processor -- start 2023-09-13T10:02:18.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94210 0x55bda3c9d690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3c9dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3ca4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3b7bbb0 con 0x55bda3c94f10 2023-09-13T10:02:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3b7b8b0 con 0x55bda3c95870 2023-09-13T10:02:18.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3a5f920 con 0x55bda3c94210 2023-09-13T10:02:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7f4024b80 10 client.0 _ll_register_callbacks cb 0x55bda3b79680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3c9dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e5bdb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94210 0x55bda3c9d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e63dc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3ca4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3c9dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47998/0 (socket says 172.21.15.6:47998) 2023-09-13T10:02:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 -- 172.21.15.6:0/852300071 learned_addr learned my addr 172.21.15.6:0/852300071 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 -- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94210 msgr2=0x55bda3c9d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94210 0x55bda3c9d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 -- 172.21.15.6:0/852300071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 msgr2=0x55bda3ca4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3ca4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 -- 172.21.15.6:0/852300071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e0109b20 con 0x55bda3c94f10 2023-09-13T10:02:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94210 0x55bda3c9d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7e53da700 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3c9dbd0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009ce0 tx=0x7fc7d0024850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca8a3b67485e4104 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.971+0000 7fc7c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7c97fa700 1 -- 172.21.15.6:0/852300071 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d002b040 con 0x55bda3c94f10 2023-09-13T10:02:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7c97fa700 1 -- 172.21.15.6:0/852300071 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc7d0017880 con 0x55bda3c94f10 2023-09-13T10:02:18.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bda3c7e670 con 0x55bda3c94f10 2023-09-13T10:02:18.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7c97fa700 1 -- 172.21.15.6:0/852300071 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7d0017a40 con 0x55bda3c94f10 2023-09-13T10:02:18.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 10 client.21333 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:18.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55bda3bf57a0 con 0x55bda3c94f10 2023-09-13T10:02:18.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7c97fa700 1 -- 172.21.15.6:0/852300071 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0047080 con 0x55bda3c94f10 2023-09-13T10:02:18.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7c97fa700 1 -- 172.21.15.6:0/852300071 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fc7d0043cc0 con 0x55bda3c94f10 2023-09-13T10:02:18.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 10 client.21333 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:18.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 10 client.21333 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:02:18.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 20 client.21333 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:18.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cab490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:18.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 4 client.21333 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:18.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.972+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bda3bd6970 con 0x55bda3ca9070 2023-09-13T10:02:18.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.973+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cab490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:18.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.973+0000 7fc7c97fa700 10 client.21333 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:18.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.973+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cab490 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=85fec7ae9bd658ee server_cookie=f30104534385c609 in_seq=0 out_seq=0 2023-09-13T10:02:18.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7c97fa700 1 -- 172.21.15.6:0/852300071 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bda3bd6970 con 0x55bda3ca9070 2023-09-13T10:02:18.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7c97fa700 10 client.21333 handle_command_reply: tid=0 2023-09-13T10:02:18.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 client.21333 shutdown 2023-09-13T10:02:18.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 msgr2=0x55bda3c9dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:18.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3c9dbd0 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0009ce0 tx=0x7fc7d0024850 comp rx=0 tx=0).stop 2023-09-13T10:02:18.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 shutdown_connections 2023-09-13T10:02:18.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cab490 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c95870 0x55bda3ca4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94210 0x55bda3c9d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7c97fa700 0 client.21333 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/852300071 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3c9dbd0 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 >> 172.21.15.6:0/852300071 conn(0x55bda3be9c80 msgr2=0x55bda3c807f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 shutdown_connections 2023-09-13T10:02:18.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 1 -- 172.21.15.6:0/852300071 wait complete. 2023-09-13T10:02:18.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.974+0000 7fc7f4024b80 20 client.21333 trim_cache size 0 max 16384 2023-09-13T10:02:19.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 Processor -- start 2023-09-13T10:02:19.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 -- start start 2023-09-13T10:02:19.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3c93cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3ca4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c95870 0x55bda3ca5500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3c9d230 con 0x55bda3c95870 2023-09-13T10:02:19.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3c828e0 con 0x55bda3c94210 2023-09-13T10:02:19.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.990+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3c88000 con 0x55bda3c94f10 2023-09-13T10:02:19.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3ca4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e63dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c95870 0x55bda3ca5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e5bdb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3c93cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3ca4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51060/0 (socket says 172.21.15.6:51060) 2023-09-13T10:02:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e63dc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c95870 0x55bda3ca5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48008/0 (socket says 172.21.15.6:48008) 2023-09-13T10:02:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 -- 172.21.15.6:0/2097614966 learned_addr learned my addr 172.21.15.6:0/2097614966 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e5bdb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3c93cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41528/0 (socket says 172.21.15.6:41528) 2023-09-13T10:02:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 -- 172.21.15.6:0/2097614966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 msgr2=0x55bda3c93cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3c93cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 -- 172.21.15.6:0/2097614966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c95870 msgr2=0x55bda3ca5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c95870 0x55bda3ca5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 -- 172.21.15.6:0/2097614966 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bda3a09de0 con 0x55bda3c94f10 2023-09-13T10:02:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e63dc700 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c95870 0x55bda3ca5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3ca4bd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0005850 tx=0x7fc7d0004660 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93797a05ca90ba8d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7d4ff9700 1 -- 172.21.15.6:0/2097614966 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d002b070 con 0x55bda3c94f10 2023-09-13T10:02:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7d4ff9700 1 -- 172.21.15.6:0/2097614966 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55bda3c7e670 con 0x55bda3c94f10 2023-09-13T10:02:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.991+0000 7fc7d4ff9700 1 -- 172.21.15.6:0/2097614966 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d00179f0 con 0x55bda3c94f10 2023-09-13T10:02:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2097614966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 msgr2=0x55bda3ca4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3ca4bd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0005850 tx=0x7fc7d0004660 comp rx=0 tx=0).stop 2023-09-13T10:02:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2097614966 shutdown_connections 2023-09-13T10:02:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c95870 0x55bda3ca5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3c93cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2097614966 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c94f10 0x55bda3ca4bd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2097614966 >> 172.21.15.6:0/2097614966 conn(0x55bda3be9c80 msgr2=0x55bda3c9c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2097614966 shutdown_connections 2023-09-13T10:02:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2097614966 wait complete. 2023-09-13T10:02:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.992+0000 7fc7f4024b80 1 -- start start 2023-09-13T10:02:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 1 Processor -- start 2023-09-13T10:02:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3ca0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3ca0940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c95870 0x55bda3ca3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3ca3ea0 con 0x55bda3c94f10 2023-09-13T10:02:19.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3ca4010 con 0x55bda3c94210 2023-09-13T10:02:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda3ca41d0 con 0x55bda3c95870 2023-09-13T10:02:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7f4024b80 10 client.0 _ll_register_callbacks cb 0x55bda3b79680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3ca0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3ca0940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48010/0 (socket says 172.21.15.6:48010) 2023-09-13T10:02:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 -- 172.21.15.6:0/2058873539 learned_addr learned my addr 172.21.15.6:0/2058873539 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3ca0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e63dc700 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c95870 0x55bda3ca3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 -- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c95870 msgr2=0x55bda3ca3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c95870 0x55bda3ca3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 -- 172.21.15.6:0/2058873539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 msgr2=0x55bda3ca0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3ca0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.993+0000 7fc7e53da700 1 -- 172.21.15.6:0/2058873539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7d8009170 con 0x55bda3c94f10 2023-09-13T10:02:19.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7e53da700 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3ca0940 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0031040 tx=0x7fc7d000ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef56e6da274410a7 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7c97fa700 1 -- 172.21.15.6:0/2058873539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7d002b040 con 0x55bda3c94f10 2023-09-13T10:02:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7c97fa700 1 -- 172.21.15.6:0/2058873539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc7d002f990 con 0x55bda3c94f10 2023-09-13T10:02:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7d001e040 con 0x55bda3c94f10 2023-09-13T10:02:19.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7c97fa700 1 -- 172.21.15.6:0/2058873539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7d002fb90 con 0x55bda3c94f10 2023-09-13T10:02:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 10 client.21339 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55bda3bf57a0 con 0x55bda3c94f10 2023-09-13T10:02:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7c97fa700 1 -- 172.21.15.6:0/2058873539 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc7d0053080 con 0x55bda3c94f10 2023-09-13T10:02:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7c97fa700 1 -- 172.21.15.6:0/2058873539 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fc7d004c060 con 0x55bda3c94f10 2023-09-13T10:02:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 10 client.21339 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:19.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 10 client.21339 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:02:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 20 client.21339 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 4 client.21339 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.994+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55bda3b97050 con 0x55bda3ca9070 2023-09-13T10:02:19.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7c97fa700 10 client.21339 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7e5bdb700 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cff460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=6062253c956e6419 server_cookie=5e04f24bb56c5502 in_seq=0 out_seq=0 2023-09-13T10:02:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7c97fa700 1 -- 172.21.15.6:0/2058873539 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55bda3b97050 con 0x55bda3ca9070 2023-09-13T10:02:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7c97fa700 10 client.21339 handle_command_reply: tid=0 2023-09-13T10:02:19.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7f4024b80 1 client.21339 shutdown 2023-09-13T10:02:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 msgr2=0x55bda3ca0940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.995+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3ca0940 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7fc7d0031040 tx=0x7fc7d000ff30 comp rx=0 tx=0).stop 2023-09-13T10:02:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 shutdown_connections 2023-09-13T10:02:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x55bda3ca9070 0x55bda3cff460 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55bda3c95870 0x55bda3ca3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55bda3c94210 0x55bda3ca0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7c97fa700 0 client.21339 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 --2- 172.21.15.6:0/2058873539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55bda3c94f10 0x55bda3ca0940 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 >> 172.21.15.6:0/2058873539 conn(0x55bda3be9c80 msgr2=0x55bda3c9d630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 shutdown_connections 2023-09-13T10:02:19.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 1 -- 172.21.15.6:0/2058873539 wait complete. 2023-09-13T10:02:19.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7f4024b80 20 client.21339 trim_cache size 0 max 16384 2023-09-13T10:02:19.018 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:19.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc7cc0a0640 msgr2=0x7fc7cc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc7cc0a0640 0x7fc7cc0a2b00 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc7d000b2e0 tx=0x7fc7d0005fb0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0101900 msgr2=0x7fc7e0198d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0101900 0x7fc7e0198d10 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fc7dc00b530 tx=0x7fc7dc00b840 comp rx=0 tx=0).stop 2023-09-13T10:02:19.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 shutdown_connections 2023-09-13T10:02:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc7e0106b60 0x7fc7e01a0280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc7cc0a0640 0x7fc7cc0a2b00 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc7e0101900 0x7fc7e0198d10 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 --2- 172.21.15.6:0/2512661630 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7e0104230 0x7fc7e0199250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 >> 172.21.15.6:0/2512661630 conn(0x7fc7e00fb250 msgr2=0x7fc7e00fff80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 shutdown_connections 2023-09-13T10:02:19.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:18.996+0000 7fc7e7e3f700 1 -- 172.21.15.6:0/2512661630 wait complete. 2023-09-13T10:02:19.022 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T10:02:19.117 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:19 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4132913378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:02:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 -- 172.21.15.6:0/715415159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28500ffcc0 msgr2=0x7f28501000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 --2- 172.21.15.6:0/715415159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28500ffcc0 0x7f28501000e0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f28400099c0 tx=0x7f2840009cd0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 -- 172.21.15.6:0/715415159 shutdown_connections 2023-09-13T10:02:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 --2- 172.21.15.6:0/715415159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2850101850 0x7f2850108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.165 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 --2- 172.21.15.6:0/715415159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28500ffcc0 0x7f28501000e0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 --2- 172.21.15.6:0/715415159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2850100eb0 0x7f2850101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 -- 172.21.15.6:0/715415159 >> 172.21.15.6:0/715415159 conn(0x7f28500fb250 msgr2=0x7f28500fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 -- 172.21.15.6:0/715415159 shutdown_connections 2023-09-13T10:02:19.166 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.164+0000 7f2855656700 1 -- 172.21.15.6:0/715415159 wait complete. 2023-09-13T10:02:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 Processor -- start 2023-09-13T10:02:19.168 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 -- start start 2023-09-13T10:02:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28500ffcc0 0x7f2850198c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2850100eb0 0x7f28501991d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2850101850 0x7f28501a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a0800 con 0x7f2850101850 2023-09-13T10:02:19.169 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a0970 con 0x7f2850100eb0 2023-09-13T10:02:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f2855656700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28501a0b30 con 0x7f28500ffcc0 2023-09-13T10:02:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f284effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28500ffcc0 0x7f2850198c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.165+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2850101850 0x7f28501a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28500ffcc0 0x7f2850198c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51078/0 (socket says 172.21.15.6:51078) 2023-09-13T10:02:19.170 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2850101850 0x7f28501a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48028/0 (socket says 172.21.15.6:48028) 2023-09-13T10:02:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284effd700 1 -- 172.21.15.6:0/1925297987 learned_addr learned my addr 172.21.15.6:0/1925297987 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284f7fe700 1 -- 172.21.15.6:0/1925297987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28500ffcc0 msgr2=0x7f2850198c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284f7fe700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28500ffcc0 0x7f2850198c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284f7fe700 1 -- 172.21.15.6:0/1925297987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2850100eb0 msgr2=0x7f28501991d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284f7fe700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2850100eb0 0x7f28501991d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.171 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284f7fe700 1 -- 172.21.15.6:0/1925297987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28400095f0 con 0x7f2850101850 2023-09-13T10:02:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f284f7fe700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2850101850 0x7f28501a0230 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f284800efc0 tx=0x7f284800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f2837fff700 1 -- 172.21.15.6:0/1925297987 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848018070 con 0x7f2850101850 2023-09-13T10:02:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f2837fff700 1 -- 172.21.15.6:0/1925297987 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f284800f040 con 0x7f2850101850 2023-09-13T10:02:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f2837fff700 1 -- 172.21.15.6:0/1925297987 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284800cdf0 con 0x7f2850101850 2023-09-13T10:02:19.172 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28501a0db0 con 0x7f2850101850 2023-09-13T10:02:19.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.166+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501a1270 con 0x7f2850101850 2023-09-13T10:02:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.169+0000 7f2837fff700 1 -- 172.21.15.6:0/1925297987 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2848003a00 con 0x7f2850101850 2023-09-13T10:02:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 Processor -- start 2023-09-13T10:02:19.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f2837fff700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f28380a06c0 0x7f28380a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 -- start start 2023-09-13T10:02:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f2837fff700 1 -- 172.21.15.6:0/1925297987 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f28480cb7e0 con 0x7f2850101850 2023-09-13T10:02:19.182 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f284effd700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f28380a06c0 0x7f28380a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff5db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.183 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff5c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889feb5780 con 0x55889ff5ca00 2023-09-13T10:02:19.184 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889feb30a0 con 0x55889ff5e060 2023-09-13T10:02:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.170+0000 7f286183bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889feae990 con 0x55889ff5d700 2023-09-13T10:02:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48036/0 (socket says 172.21.15.6:48036) 2023-09-13T10:02:19.185 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 -- 172.21.15.6:0/1691737035 learned_addr learned my addr 172.21.15.6:0/1691737035 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284effd700 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff5db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 -- 172.21.15.6:0/1691737035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 msgr2=0x55889ff5db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff5db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.186 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284effd700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f28380a06c0 0x7f28380a2b80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2840004800 tx=0x7f2840005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 -- 172.21.15.6:0/1691737035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 msgr2=0x55889ff5c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff5c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 -- 172.21.15.6:0/1691737035 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55889fd2e630 con 0x55889ff5ca00 2023-09-13T10:02:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f284f7fe700 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5ce80 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f28480090a0 tx=0x7f2848098e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe132ba8c11ac5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.187 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f28357fa700 1 -- 172.21.15.6:0/1691737035 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848099710 con 0x55889ff5ca00 2023-09-13T10:02:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f28357fa700 1 -- 172.21.15.6:0/1691737035 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2848099010 con 0x55889ff5ca00 2023-09-13T10:02:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.171+0000 7f28357fa700 1 -- 172.21.15.6:0/1691737035 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28480b1210 con 0x55889ff5ca00 2023-09-13T10:02:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 -- 172.21.15.6:0/1691737035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 msgr2=0x55889ff5ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5ce80 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f28480090a0 tx=0x7f2848098e60 comp rx=0 tx=0).stop 2023-09-13T10:02:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 -- 172.21.15.6:0/1691737035 shutdown_connections 2023-09-13T10:02:19.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5ce80 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff5db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 --2- 172.21.15.6:0/1691737035 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff5c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 -- 172.21.15.6:0/1691737035 >> 172.21.15.6:0/1691737035 conn(0x55889febac80 msgr2=0x55889ff56f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 -- 172.21.15.6:0/1691737035 shutdown_connections 2023-09-13T10:02:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 -- 172.21.15.6:0/1691737035 wait complete. 2023-09-13T10:02:19.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.172+0000 7f286183bb80 1 -- start start 2023-09-13T10:02:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 1 Processor -- start 2023-09-13T10:02:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff65f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff664c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff6d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889fe4cbb0 con 0x55889ff5ca00 2023-09-13T10:02:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889fe4c8b0 con 0x55889ff5e060 2023-09-13T10:02:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889fd30920 con 0x55889ff5d700 2023-09-13T10:02:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f286183bb80 10 client.0 _ll_register_callbacks cb 0x55889fe4a680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff65f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff65f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48038/0 (socket says 172.21.15.6:48038) 2023-09-13T10:02:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 -- 172.21.15.6:0/190667908 learned_addr learned my addr 172.21.15.6:0/190667908 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284e7fc700 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284f7fe700 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff6d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 -- 172.21.15.6:0/190667908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 msgr2=0x55889ff664c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff664c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 -- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 msgr2=0x55889ff6d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff6d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.173+0000 7f284effd700 1 -- 172.21.15.6:0/190667908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501a1270 con 0x55889ff5ca00 2023-09-13T10:02:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f284effd700 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff65f80 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f28400098e0 tx=0x7f2840021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db77bdc7b6e108f server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f2832ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f2832ff5700 1 -- 172.21.15.6:0/190667908 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000fe70 con 0x55889ff5ca00 2023-09-13T10:02:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f2832ff5700 1 -- 172.21.15.6:0/190667908 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f284002b040 con 0x55889ff5ca00 2023-09-13T10:02:19.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55889ff4f670 con 0x55889ff5ca00 2023-09-13T10:02:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f2832ff5700 1 -- 172.21.15.6:0/190667908 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f284003a440 con 0x55889ff5ca00 2023-09-13T10:02:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 10 client.21351 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:19.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55889fec67a0 con 0x55889ff5ca00 2023-09-13T10:02:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f2832ff5700 1 -- 172.21.15.6:0/190667908 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f284003e020 con 0x55889ff5ca00 2023-09-13T10:02:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f2832ff5700 1 -- 172.21.15.6:0/190667908 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2840038490 con 0x55889ff5ca00 2023-09-13T10:02:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 10 client.21351 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 10 client.21351 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:02:19.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 20 client.21351 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ff71cc0 0x55889ff740e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 4 client.21351 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.174+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55889fea7970 con 0x55889ff71cc0 2023-09-13T10:02:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.175+0000 7f284e7fc700 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ff71cc0 0x55889ff740e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.175+0000 7f2832ff5700 10 client.21351 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:19.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.175+0000 7f284e7fc700 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ff71cc0 0x55889ff740e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7f0958ba811cdff6 server_cookie=72b295aa0a36ff09 in_seq=0 out_seq=0 2023-09-13T10:02:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f2832ff5700 1 -- 172.21.15.6:0/190667908 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55889fea7970 con 0x55889ff71cc0 2023-09-13T10:02:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f2832ff5700 10 client.21351 handle_command_reply: tid=0 2023-09-13T10:02:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 client.21351 shutdown 2023-09-13T10:02:19.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 msgr2=0x55889ff65f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff65f80 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f28400098e0 tx=0x7f2840021000 comp rx=0 tx=0).stop 2023-09-13T10:02:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 shutdown_connections 2023-09-13T10:02:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ff71cc0 0x55889ff740e0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff6d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff65f80 unknown :-1 s=CLOSED pgs=1940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f2832ff5700 0 client.21351 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 --2- 172.21.15.6:0/190667908 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff664c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 >> 172.21.15.6:0/190667908 conn(0x55889febac80 msgr2=0x55889ff517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 shutdown_connections 2023-09-13T10:02:19.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 1 -- 172.21.15.6:0/190667908 wait complete. 2023-09-13T10:02:19.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.179+0000 7f286183bb80 20 client.21351 trim_cache size 0 max 16384 2023-09-13T10:02:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.197+0000 7f286183bb80 1 Processor -- start 2023-09-13T10:02:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.197+0000 7f286183bb80 1 -- start start 2023-09-13T10:02:19.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f286183bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f286183bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff6d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f286183bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff65d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f286183bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ff57810 con 0x55889ff5ca00 2023-09-13T10:02:19.206 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f286183bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ff61510 con 0x55889ff5e060 2023-09-13T10:02:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f286183bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ff719c0 con 0x55889ff5d700 2023-09-13T10:02:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48046/0 (socket says 172.21.15.6:48046) 2023-09-13T10:02:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 -- 172.21.15.6:0/2697550975 learned_addr learned my addr 172.21.15.6:0/2697550975 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.207 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284f7fe700 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff65d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 -- 172.21.15.6:0/2697550975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 msgr2=0x55889ff6d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff6d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 -- 172.21.15.6:0/2697550975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 msgr2=0x55889ff65d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff65d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.208 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 -- 172.21.15.6:0/2697550975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55889fcdade0 con 0x55889ff5ca00 2023-09-13T10:02:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.198+0000 7f284effd700 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5c4c0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f2840038810 tx=0x7f2840009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1c45962bfee0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f2835ffb700 1 -- 172.21.15.6:0/2697550975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840038a80 con 0x55889ff5ca00 2023-09-13T10:02:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f2835ffb700 1 -- 172.21.15.6:0/2697550975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x55889ff4f670 con 0x55889ff5ca00 2023-09-13T10:02:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f2835ffb700 1 -- 172.21.15.6:0/2697550975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284003aea0 con 0x55889ff5ca00 2023-09-13T10:02:19.209 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f286183bb80 1 -- 172.21.15.6:0/2697550975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 msgr2=0x55889ff5c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f286183bb80 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5c4c0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f2840038810 tx=0x7f2840009310 comp rx=0 tx=0).stop 2023-09-13T10:02:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f286183bb80 1 -- 172.21.15.6:0/2697550975 shutdown_connections 2023-09-13T10:02:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f286183bb80 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5e060 0x55889ff65d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f286183bb80 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5ca00 0x55889ff5c4c0 unknown :-1 s=CLOSED pgs=1941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f286183bb80 1 --2- 172.21.15.6:0/2697550975 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff5d700 0x55889ff6d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.199+0000 7f286183bb80 1 -- 172.21.15.6:0/2697550975 >> 172.21.15.6:0/2697550975 conn(0x55889febac80 msgr2=0x55889ff60980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.201+0000 7f286183bb80 1 -- 172.21.15.6:0/2697550975 shutdown_connections 2023-09-13T10:02:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.201+0000 7f286183bb80 1 -- 172.21.15.6:0/2697550975 wait complete. 2023-09-13T10:02:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 -- start start 2023-09-13T10:02:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 Processor -- start 2023-09-13T10:02:19.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5ca00 0x55889ff69390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5e060 0x55889ff698d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff6c8f0 0x55889ff6cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ff6d2b0 con 0x55889ff5e060 2023-09-13T10:02:19.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ff6d420 con 0x55889ff5ca00 2023-09-13T10:02:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889ff6d5e0 con 0x55889ff6c8f0 2023-09-13T10:02:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f284e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5e060 0x55889ff698d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f284e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5e060 0x55889ff698d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48054/0 (socket says 172.21.15.6:48054) 2023-09-13T10:02:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f284e7fc700 1 -- 172.21.15.6:0/2728404248 learned_addr learned my addr 172.21.15.6:0/2728404248 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f286183bb80 10 client.0 _ll_register_callbacks cb 0x55889ff57570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f284f7fe700 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff6c8f0 0x55889ff6cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.202+0000 7f284effd700 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5ca00 0x55889ff69390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f284e7fc700 1 -- 172.21.15.6:0/2728404248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff6c8f0 msgr2=0x55889ff6cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f284e7fc700 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff6c8f0 0x55889ff6cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f284e7fc700 1 -- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5ca00 msgr2=0x55889ff69390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f284e7fc700 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5ca00 0x55889ff69390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f284e7fc700 1 -- 172.21.15.6:0/2728404248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284000fe70 con 0x55889ff5e060 2023-09-13T10:02:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f284e7fc700 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5e060 0x55889ff698d0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x55889ff74990 tx=0x7f2844009b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911d1e9f5918d900 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f2832ff5700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:19.215 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f2832ff5700 1 -- 172.21.15.6:0/2728404248 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844004230 con 0x55889ff5e060 2023-09-13T10:02:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f2832ff5700 1 -- 172.21.15.6:0/2728404248 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2844016070 con 0x55889ff5e060 2023-09-13T10:02:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2848099010 con 0x55889ff5e060 2023-09-13T10:02:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f2832ff5700 1 -- 172.21.15.6:0/2728404248 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2844004390 con 0x55889ff5e060 2023-09-13T10:02:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f286183bb80 10 client.21357 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:19.216 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55889fcc3c60 con 0x55889ff5e060 2023-09-13T10:02:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.203+0000 7f2832ff5700 1 -- 172.21.15.6:0/2728404248 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2848099010 con 0x55889ff5e060 2023-09-13T10:02:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.204+0000 7f2832ff5700 1 -- 172.21.15.6:0/2728404248 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2844019cd0 con 0x55889ff5e060 2023-09-13T10:02:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.204+0000 7f286183bb80 10 client.21357 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.204+0000 7f286183bb80 10 client.21357 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:02:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.204+0000 7f286183bb80 20 client.21357 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.204+0000 7f286183bb80 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ffc70f0 0x55889ffc9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.204+0000 7f286183bb80 4 client.21357 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:19.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.204+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55889fe68050 con 0x55889ffc70f0 2023-09-13T10:02:19.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.209+0000 7f284effd700 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ffc70f0 0x55889ffc9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.209+0000 7f2832ff5700 10 client.21357 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.209+0000 7f284effd700 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ffc70f0 0x55889ffc9510 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=716051538f76f92d server_cookie=baeacba92e19686b in_seq=0 out_seq=0 2023-09-13T10:02:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.209+0000 7f2832ff5700 1 -- 172.21.15.6:0/2728404248 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55889fe68050 con 0x55889ffc70f0 2023-09-13T10:02:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.209+0000 7f2832ff5700 10 client.21357 handle_command_reply: tid=0 2023-09-13T10:02:19.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 client.21357 shutdown 2023-09-13T10:02:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5e060 msgr2=0x55889ff698d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5e060 0x55889ff698d0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x55889ff74990 tx=0x7f2844009b40 comp rx=0 tx=0).stop 2023-09-13T10:02:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 shutdown_connections 2023-09-13T10:02:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x55889ffc70f0 0x55889ffc9510 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55889ff6c8f0 0x55889ff6cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f2832ff5700 0 client.21357 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55889ff5ca00 0x55889ff69390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 --2- 172.21.15.6:0/2728404248 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55889ff5e060 0x55889ff698d0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 >> 172.21.15.6:0/2728404248 conn(0x55889febac80 msgr2=0x55889ff65d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 shutdown_connections 2023-09-13T10:02:19.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 1 -- 172.21.15.6:0/2728404248 wait complete. 2023-09-13T10:02:19.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f286183bb80 20 client.21357 trim_cache size 0 max 16384 2023-09-13T10:02:19.223 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.210+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f28380a06c0 msgr2=0x7f28380a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f28380a06c0 0x7f28380a2b80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f2840004800 tx=0x7f2840005fb0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2850101850 msgr2=0x7f28501a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2850101850 0x7f28501a0230 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f284800efc0 tx=0x7f284800c3a0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 shutdown_connections 2023-09-13T10:02:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f28380a06c0 0x7f28380a2b80 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2850101850 0x7f28501a0230 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f28500ffcc0 0x7f2850198c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 --2- 172.21.15.6:0/1925297987 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2850100eb0 0x7f28501991d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 >> 172.21.15.6:0/1925297987 conn(0x7f28500fb250 msgr2=0x7f28500fbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 shutdown_connections 2023-09-13T10:02:19.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.211+0000 7f2855656700 1 -- 172.21.15.6:0/1925297987 wait complete. 2023-09-13T10:02:19.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T10:02:19.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 -- 172.21.15.6:0/3743271436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c100eb0 msgr2=0x7f2d4c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/3743271436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c100eb0 0x7f2d4c101310 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7f2d3c0099c0 tx=0x7f2d3c009cd0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 -- 172.21.15.6:0/3743271436 shutdown_connections 2023-09-13T10:02:19.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/3743271436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d4c101850 0x7f2d4c108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/3743271436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d4c0ffcc0 0x7f2d4c1000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/3743271436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c100eb0 0x7f2d4c101310 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 -- 172.21.15.6:0/3743271436 >> 172.21.15.6:0/3743271436 conn(0x7f2d4c0fb250 msgr2=0x7f2d4c0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 -- 172.21.15.6:0/3743271436 shutdown_connections 2023-09-13T10:02:19.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.363+0000 7f2d53fe6700 1 -- 172.21.15.6:0/3743271436 wait complete. 2023-09-13T10:02:19.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 Processor -- start 2023-09-13T10:02:19.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 -- start start 2023-09-13T10:02:19.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d4c0ffcc0 0x7f2d4c198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d4c100eb0 0x7f2d4c1991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c101850 0x7f2d4c1a01f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c1a07c0 con 0x7f2d4c101850 2023-09-13T10:02:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c1a0930 con 0x7f2d4c0ffcc0 2023-09-13T10:02:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d53fe6700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4c1a0af0 con 0x7f2d4c100eb0 2023-09-13T10:02:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c101850 0x7f2d4c1a01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c101850 0x7f2d4c1a01f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48070/0 (socket says 172.21.15.6:48070) 2023-09-13T10:02:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 -- 172.21.15.6:0/2519014316 learned_addr learned my addr 172.21.15.6:0/2519014316 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d51d82700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d4c0ffcc0 0x7f2d4c198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d51581700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d4c100eb0 0x7f2d4c1991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 -- 172.21.15.6:0/2519014316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d4c100eb0 msgr2=0x7f2d4c1991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d4c100eb0 0x7f2d4c1991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 -- 172.21.15.6:0/2519014316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d4c0ffcc0 msgr2=0x7f2d4c198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d4c0ffcc0 0x7f2d4c198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.364+0000 7f2d52583700 1 -- 172.21.15.6:0/2519014316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c0095f0 con 0x7f2d4c101850 2023-09-13T10:02:19.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.365+0000 7f2d52583700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c101850 0x7f2d4c1a01f0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400e940 tx=0x7f2d4400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.365+0000 7f2d42ffd700 1 -- 172.21.15.6:0/2519014316 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d440097b0 con 0x7f2d4c101850 2023-09-13T10:02:19.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.365+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d4c1a0dd0 con 0x7f2d4c101850 2023-09-13T10:02:19.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.365+0000 7f2d42ffd700 1 -- 172.21.15.6:0/2519014316 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d44005020 con 0x7f2d4c101850 2023-09-13T10:02:19.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.365+0000 7f2d42ffd700 1 -- 172.21.15.6:0/2519014316 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4400cc40 con 0x7f2d4c101850 2023-09-13T10:02:19.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.365+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c1a1220 con 0x7f2d4c101850 2023-09-13T10:02:19.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.368+0000 7f2d42ffd700 1 -- 172.21.15.6:0/2519014316 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2d44005400 con 0x7f2d4c101850 2023-09-13T10:02:19.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.369+0000 7f2d42ffd700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d380a0640 0x7f2d380a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.369+0000 7f2d51d82700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d380a0640 0x7f2d380a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.369+0000 7f2d42ffd700 1 -- 172.21.15.6:0/2519014316 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2d44014070 con 0x7f2d4c101850 2023-09-13T10:02:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.370+0000 7f2d51d82700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d380a0640 0x7f2d380a2b00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c19a150 tx=0x7f2d4800d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.370+0000 7f2d601cbb80 1 Processor -- start 2023-09-13T10:02:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.370+0000 7f2d601cbb80 1 -- start start 2023-09-13T10:02:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840940700 0x55e840940b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e84093f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e840898780 con 0x55e84093fa00 2023-09-13T10:02:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8408960a0 con 0x55e840941060 2023-09-13T10:02:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e840891990 con 0x55e840940700 2023-09-13T10:02:19.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48078/0 (socket says 172.21.15.6:48078) 2023-09-13T10:02:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 -- 172.21.15.6:0/1967667463 learned_addr learned my addr 172.21.15.6:0/1967667463 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d51d82700 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840940700 0x55e840940b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d51581700 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e84093f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 -- 172.21.15.6:0/1967667463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840940700 msgr2=0x55e840940b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840940700 0x55e840940b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 -- 172.21.15.6:0/1967667463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 msgr2=0x55e84093f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e84093f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 -- 172.21.15.6:0/1967667463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e840711630 con 0x55e84093fa00 2023-09-13T10:02:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.371+0000 7f2d52583700 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093fe80 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f2d44095ab0 tx=0x7f2d44098f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b6e0c141e001458 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.379 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.372+0000 7f2d37fff700 1 -- 172.21.15.6:0/1967667463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d44099cb0 con 0x55e84093fa00 2023-09-13T10:02:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.372+0000 7f2d37fff700 1 -- 172.21.15.6:0/1967667463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d440995b0 con 0x55e84093fa00 2023-09-13T10:02:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.372+0000 7f2d37fff700 1 -- 172.21.15.6:0/1967667463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d440840c0 con 0x55e84093fa00 2023-09-13T10:02:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.373+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1967667463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 msgr2=0x55e84093fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.373+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093fe80 secure :-1 s=READY pgs=1945 cs=0 l=1 rev1=1 crypto rx=0x7f2d44095ab0 tx=0x7f2d44098f10 comp rx=0 tx=0).stop 2023-09-13T10:02:19.380 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.373+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1967667463 shutdown_connections 2023-09-13T10:02:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.373+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093fe80 unknown :-1 s=CLOSED pgs=1945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.373+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840940700 0x55e840940b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.373+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1967667463 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e84093f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.381 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.373+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1967667463 >> 172.21.15.6:0/1967667463 conn(0x55e84089dc80 msgr2=0x55e840939f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.385 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.375+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1967667463 shutdown_connections 2023-09-13T10:02:19.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.375+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1967667463 wait complete. 2023-09-13T10:02:19.386 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 -- start start 2023-09-13T10:02:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 Processor -- start 2023-09-13T10:02:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e84093fa00 0x55e840948f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.387 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e8409494b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e8409504f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84082fbb0 con 0x55e840940700 2023-09-13T10:02:19.388 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84082f8b0 con 0x55e840941060 2023-09-13T10:02:19.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.376+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e840713920 con 0x55e84093fa00 2023-09-13T10:02:19.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d601cbb80 10 client.0 _ll_register_callbacks cb 0x55e84082d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:19.389 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e84093fa00 0x55e840948f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e84093fa00 0x55e840948f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51134/0 (socket says 172.21.15.6:51134) 2023-09-13T10:02:19.390 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 -- 172.21.15.6:0/1662848379 learned_addr learned my addr 172.21.15.6:0/1662848379 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51581700 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e8409494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d52583700 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e8409504f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 -- 172.21.15.6:0/1662848379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 msgr2=0x55e8409504f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e8409504f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 -- 172.21.15.6:0/1662848379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 msgr2=0x55e8409494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e8409494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.377+0000 7f2d51d82700 1 -- 172.21.15.6:0/1662848379 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d4c1a1220 con 0x55e84093fa00 2023-09-13T10:02:19.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d51d82700 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e84093fa00 0x55e840948f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2d48018ac0 tx=0x7f2d48004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=603ffd4f112050cf server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d357fa700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:02:19.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d357fa700 1 -- 172.21.15.6:0/1662848379 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48010040 con 0x55e84093fa00 2023-09-13T10:02:19.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d357fa700 1 -- 172.21.15.6:0/1662848379 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2d48003c00 con 0x55e84093fa00 2023-09-13T10:02:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e840932670 con 0x55e84093fa00 2023-09-13T10:02:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d357fa700 1 -- 172.21.15.6:0/1662848379 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d48003dc0 con 0x55e84093fa00 2023-09-13T10:02:19.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d601cbb80 10 client.30565 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55e8408a97a0 con 0x55e84093fa00 2023-09-13T10:02:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.378+0000 7f2d357fa700 1 -- 172.21.15.6:0/1662848379 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d48033020 con 0x55e84093fa00 2023-09-13T10:02:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d357fa700 1 -- 172.21.15.6:0/1662848379 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2d480045c0 con 0x55e84093fa00 2023-09-13T10:02:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d601cbb80 10 client.30565 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:19.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d601cbb80 10 client.30565 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:02:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d601cbb80 20 client.30565 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e840955a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d601cbb80 4 client.30565 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e84088a970 con 0x55e8409535e0 2023-09-13T10:02:19.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.379+0000 7f2d51581700 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e840955a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.380+0000 7f2d51581700 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e840955a00 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97733f2dc0a73431 server_cookie=c9cb45e259887a74 in_seq=0 out_seq=0 2023-09-13T10:02:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.380+0000 7f2d357fa700 10 client.30565 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d357fa700 1 -- 172.21.15.6:0/1662848379 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e84088a970 con 0x55e8409535e0 2023-09-13T10:02:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d357fa700 10 client.30565 handle_command_reply: tid=0 2023-09-13T10:02:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 client.30565 shutdown 2023-09-13T10:02:19.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e84093fa00 msgr2=0x55e840948f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e84093fa00 0x55e840948f70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f2d48018ac0 tx=0x7f2d48004ad0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 shutdown_connections 2023-09-13T10:02:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e840955a00 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840941060 0x55e8409504f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e84093fa00 0x55e840948f70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d357fa700 0 client.30565 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/1662848379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e8409494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 >> 172.21.15.6:0/1662848379 conn(0x55e84089dc80 msgr2=0x55e8409347f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 shutdown_connections 2023-09-13T10:02:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 1 -- 172.21.15.6:0/1662848379 wait complete. 2023-09-13T10:02:19.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.381+0000 7f2d601cbb80 20 client.30565 trim_cache size 0 max 16384 2023-09-13T10:02:19.403 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 Processor -- start 2023-09-13T10:02:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 -- start start 2023-09-13T10:02:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840940700 0x55e84093afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e8409504b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.404 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e840948b20 con 0x55e84093fa00 2023-09-13T10:02:19.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e8409444f0 con 0x55e840940700 2023-09-13T10:02:19.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e840953330 con 0x55e840941060 2023-09-13T10:02:19.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d51d82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d51d82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48088/0 (socket says 172.21.15.6:48088) 2023-09-13T10:02:19.405 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.397+0000 7f2d51d82700 1 -- 172.21.15.6:0/3430195424 learned_addr learned my addr 172.21.15.6:0/3430195424 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d52583700 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e8409504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d51d82700 1 -- 172.21.15.6:0/3430195424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 msgr2=0x55e8409504b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d51d82700 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e8409504b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d51d82700 1 -- 172.21.15.6:0/3430195424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840940700 msgr2=0x55e84093afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d51d82700 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840940700 0x55e84093afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d51d82700 1 -- 172.21.15.6:0/3430195424 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e8406bdde0 con 0x55e84093fa00 2023-09-13T10:02:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d52583700 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e8409504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T10:02:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d51d82700 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093f4c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f2d48004970 tx=0x7f2d48000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba3ec8b1f6f89e5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d40ff9700 1 -- 172.21.15.6:0/3430195424 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48010040 con 0x55e84093fa00 2023-09-13T10:02:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d40ff9700 1 -- 172.21.15.6:0/3430195424 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d48033030 con 0x55e84093fa00 2023-09-13T10:02:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.398+0000 7f2d40ff9700 1 -- 172.21.15.6:0/3430195424 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48008cd0 con 0x55e84093fa00 2023-09-13T10:02:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 -- 172.21.15.6:0/3430195424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 msgr2=0x55e84093f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093f4c0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f2d48004970 tx=0x7f2d48000f40 comp rx=0 tx=0).stop 2023-09-13T10:02:19.408 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 -- 172.21.15.6:0/3430195424 shutdown_connections 2023-09-13T10:02:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e8409504b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e84093fa00 0x55e84093f4c0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/3430195424 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e840940700 0x55e84093afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 -- 172.21.15.6:0/3430195424 >> 172.21.15.6:0/3430195424 conn(0x55e84089dc80 msgr2=0x55e840939ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.399+0000 7f2d601cbb80 1 -- 172.21.15.6:0/3430195424 shutdown_connections 2023-09-13T10:02:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.400+0000 7f2d601cbb80 1 -- 172.21.15.6:0/3430195424 wait complete. 2023-09-13T10:02:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.400+0000 7f2d601cbb80 1 -- start start 2023-09-13T10:02:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.400+0000 7f2d601cbb80 1 Processor -- start 2023-09-13T10:02:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.400+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e84093fa00 0x55e84094b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.411 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e84094bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d601cbb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e84094ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.412 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84094f2a0 con 0x55e840940700 2023-09-13T10:02:19.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84094f410 con 0x55e84093fa00 2023-09-13T10:02:19.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d601cbb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e84094f5d0 con 0x55e840941060 2023-09-13T10:02:19.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d601cbb80 10 client.0 _ll_register_callbacks cb 0x55e84082d680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:19.413 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e84093fa00 0x55e84094b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e84093fa00 0x55e84094b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41616/0 (socket says 172.21.15.6:41616) 2023-09-13T10:02:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 -- 172.21.15.6:0/4267899114 learned_addr learned my addr 172.21.15.6:0/4267899114 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51581700 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e84094bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d52583700 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e84094ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.414 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 -- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 msgr2=0x55e84094ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e84094ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 -- 172.21.15.6:0/4267899114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 msgr2=0x55e84094bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e84094bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 -- 172.21.15.6:0/4267899114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e8408a97a0 con 0x55e84093fa00 2023-09-13T10:02:19.415 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d51d82700 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e84093fa00 0x55e84094b800 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800d010 tx=0x7f2d48008c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8932d15ca9e59d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.401+0000 7f2d357fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:02:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.402+0000 7f2d357fa700 1 -- 172.21.15.6:0/4267899114 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48010040 con 0x55e84093fa00 2023-09-13T10:02:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.402+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2d440995b0 con 0x55e84093fa00 2023-09-13T10:02:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.402+0000 7f2d357fa700 1 -- 172.21.15.6:0/4267899114 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2d48034080 con 0x55e84093fa00 2023-09-13T10:02:19.416 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.402+0000 7f2d357fa700 1 -- 172.21.15.6:0/4267899114 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2d4800bb30 con 0x55e84093fa00 2023-09-13T10:02:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.402+0000 7f2d601cbb80 10 client.30566 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:19.417 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.402+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55e8406a6c60 con 0x55e84093fa00 2023-09-13T10:02:19.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.408+0000 7f2d357fa700 1 -- 172.21.15.6:0/4267899114 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2d48053020 con 0x55e84093fa00 2023-09-13T10:02:19.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.408+0000 7f2d357fa700 1 -- 172.21.15.6:0/4267899114 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2d48040070 con 0x55e84093fa00 2023-09-13T10:02:19.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.409+0000 7f2d601cbb80 10 client.30566 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:19.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.409+0000 7f2d601cbb80 10 client.30566 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:02:19.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.409+0000 7f2d601cbb80 20 client.30566 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:19.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.409+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e8409ab4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.409+0000 7f2d601cbb80 4 client.30566 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.409+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e84084b050 con 0x55e8409535e0 2023-09-13T10:02:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.409+0000 7f2d51581700 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e8409ab4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.410+0000 7f2d357fa700 10 client.30566 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.410+0000 7f2d51581700 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e8409ab4c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bc2bd7bd5415237c server_cookie=13c50c738c57171 in_seq=0 out_seq=0 2023-09-13T10:02:19.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d357fa700 1 -- 172.21.15.6:0/4267899114 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e84084b050 con 0x55e8409535e0 2023-09-13T10:02:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d357fa700 10 client.30566 handle_command_reply: tid=0 2023-09-13T10:02:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 client.30566 shutdown 2023-09-13T10:02:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e84093fa00 msgr2=0x55e84094b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e84093fa00 0x55e84094b800 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f2d4800d010 tx=0x7f2d48008c20 comp rx=0 tx=0).stop 2023-09-13T10:02:19.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 shutdown_connections 2023-09-13T10:02:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x55e8409535e0 0x55e8409ab4c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55e840941060 0x55e84094ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55e84093fa00 0x55e84094b800 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d357fa700 0 client.30566 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:19.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 --2- 172.21.15.6:0/4267899114 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55e840940700 0x55e84094bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.411+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 >> 172.21.15.6:0/4267899114 conn(0x55e84089dc80 msgr2=0x55e840947bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.412+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 shutdown_connections 2023-09-13T10:02:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.412+0000 7f2d601cbb80 1 -- 172.21.15.6:0/4267899114 wait complete. 2023-09-13T10:02:19.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.412+0000 7f2d601cbb80 20 client.30566 trim_cache size 0 max 16384 2023-09-13T10:02:19.423 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d380a0640 msgr2=0x7f2d380a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d380a0640 0x7f2d380a2b00 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f2d4c19a150 tx=0x7f2d4800d040 comp rx=0 tx=0).stop 2023-09-13T10:02:19.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c101850 msgr2=0x7f2d4c1a01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c101850 0x7f2d4c1a01f0 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f2d4400e940 tx=0x7f2d4400ec50 comp rx=0 tx=0).stop 2023-09-13T10:02:19.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 shutdown_connections 2023-09-13T10:02:19.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2d380a0640 0x7f2d380a2b00 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2d4c101850 0x7f2d4c1a01f0 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2d4c0ffcc0 0x7f2d4c198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 --2- 172.21.15.6:0/2519014316 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d4c100eb0 0x7f2d4c1991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 >> 172.21.15.6:0/2519014316 conn(0x7f2d4c0fb250 msgr2=0x7f2d4c0fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 shutdown_connections 2023-09-13T10:02:19.426 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.415+0000 7f2d53fe6700 1 -- 172.21.15.6:0/2519014316 wait complete. 2023-09-13T10:02:19.431 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T10:02:19.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:19 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4132913378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:02:19.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:19 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4132913378' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:02:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.594+0000 7f219fdf5700 1 -- 172.21.15.6:0/2259108168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21980ffcc0 msgr2=0x7f21981000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.594+0000 7f219fdf5700 1 --2- 172.21.15.6:0/2259108168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21980ffcc0 0x7f21981000e0 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f21940099c0 tx=0x7f2194009cd0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.599 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.594+0000 7f219fdf5700 1 -- 172.21.15.6:0/2259108168 shutdown_connections 2023-09-13T10:02:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.594+0000 7f219fdf5700 1 --2- 172.21.15.6:0/2259108168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2198101850 0x7f2198108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.594+0000 7f219fdf5700 1 --2- 172.21.15.6:0/2259108168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21980ffcc0 0x7f21981000e0 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.600 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.594+0000 7f219fdf5700 1 --2- 172.21.15.6:0/2259108168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2198100eb0 0x7f2198101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.594+0000 7f219fdf5700 1 -- 172.21.15.6:0/2259108168 >> 172.21.15.6:0/2259108168 conn(0x7f21980fb250 msgr2=0x7f21980fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.595+0000 7f219fdf5700 1 -- 172.21.15.6:0/2259108168 shutdown_connections 2023-09-13T10:02:19.601 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.595+0000 7f219fdf5700 1 -- 172.21.15.6:0/2259108168 wait complete. 2023-09-13T10:02:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.595+0000 7f219fdf5700 1 Processor -- start 2023-09-13T10:02:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.595+0000 7f219fdf5700 1 -- start start 2023-09-13T10:02:19.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219fdf5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21980ffcc0 0x7f2198103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219fdf5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2198100eb0 0x7f2198102290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219fdf5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2198101850 0x7f21981027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219fdf5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2198102f70 con 0x7f2198100eb0 2023-09-13T10:02:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219fdf5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21981030e0 con 0x7f2198101850 2023-09-13T10:02:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219fdf5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21981a0b90 con 0x7f21980ffcc0 2023-09-13T10:02:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2198100eb0 0x7f2198102290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.604 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2198100eb0 0x7f2198102290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48108/0 (socket says 172.21.15.6:48108) 2023-09-13T10:02:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 -- 172.21.15.6:0/1811215013 learned_addr learned my addr 172.21.15.6:0/1811215013 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219db91700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21980ffcc0 0x7f2198103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219e392700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2198101850 0x7f21981027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 -- 172.21.15.6:0/1811215013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21980ffcc0 msgr2=0x7f2198103c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.605 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21980ffcc0 0x7f2198103c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 -- 172.21.15.6:0/1811215013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2198101850 msgr2=0x7f21981027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2198101850 0x7f21981027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.606 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 -- 172.21.15.6:0/1811215013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188009520 con 0x7f2198100eb0 2023-09-13T10:02:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.596+0000 7f219d390700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2198100eb0 0x7f2198102290 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f218800eb30 tx=0x7f218800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.607 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.597+0000 7f218effd700 1 -- 172.21.15.6:0/1811215013 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188009880 con 0x7f2198100eb0 2023-09-13T10:02:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.597+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21940095f0 con 0x7f2198100eb0 2023-09-13T10:02:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.597+0000 7f218effd700 1 -- 172.21.15.6:0/1811215013 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f21880044e0 con 0x7f2198100eb0 2023-09-13T10:02:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.597+0000 7f218effd700 1 -- 172.21.15.6:0/1811215013 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2188003d80 con 0x7f2198100eb0 2023-09-13T10:02:19.608 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.597+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21981a1190 con 0x7f2198100eb0 2023-09-13T10:02:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.599+0000 7f218effd700 1 -- 172.21.15.6:0/1811215013 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2188003f20 con 0x7f2198100eb0 2023-09-13T10:02:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.600+0000 7f218effd700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21840a0640 0x7f21840a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.600+0000 7f218effd700 1 -- 172.21.15.6:0/1811215013 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2188014070 con 0x7f2198100eb0 2023-09-13T10:02:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.600+0000 7f219db91700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21840a0640 0x7f21840a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.600+0000 7f219db91700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21840a0640 0x7f21840a2b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2194009990 tx=0x7f2194005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.600+0000 7f21abfdab80 1 Processor -- start 2023-09-13T10:02:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f21abfdab80 1 -- start start 2023-09-13T10:02:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f08b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f07e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f21abfdab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90e60780 con 0x557e90f07a00 2023-09-13T10:02:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f21abfdab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90e5e0a0 con 0x557e90f08700 2023-09-13T10:02:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f21abfdab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90e59990 con 0x557e90f09060 2023-09-13T10:02:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f07e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f07e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48118/0 (socket says 172.21.15.6:48118) 2023-09-13T10:02:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 -- 172.21.15.6:0/2447685774 learned_addr learned my addr 172.21.15.6:0/2447685774 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219d390700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219db91700 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f08b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 -- 172.21.15.6:0/2447685774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 msgr2=0x557e90f074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 -- 172.21.15.6:0/2447685774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 msgr2=0x557e90f08b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f08b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.601+0000 7f219e392700 1 -- 172.21.15.6:0/2447685774 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e90cd9630 con 0x557e90f07a00 2023-09-13T10:02:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f219e392700 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f07e80 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f219000a400 tx=0x7f2190009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a7ba2b24c0242a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f2183fff700 1 -- 172.21.15.6:0/2447685774 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190010040 con 0x557e90f07a00 2023-09-13T10:02:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f2183fff700 1 -- 172.21.15.6:0/2447685774 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2190014ae0 con 0x557e90f07a00 2023-09-13T10:02:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f2183fff700 1 -- 172.21.15.6:0/2447685774 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190013a90 con 0x557e90f07a00 2023-09-13T10:02:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f21abfdab80 1 -- 172.21.15.6:0/2447685774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 msgr2=0x557e90f07e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f07e80 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f219000a400 tx=0x7f2190009650 comp rx=0 tx=0).stop 2023-09-13T10:02:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f21abfdab80 1 -- 172.21.15.6:0/2447685774 shutdown_connections 2023-09-13T10:02:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f07e80 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f08b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2447685774 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.602+0000 7f21abfdab80 1 -- 172.21.15.6:0/2447685774 >> 172.21.15.6:0/2447685774 conn(0x557e90e65c80 msgr2=0x557e90f01f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 -- 172.21.15.6:0/2447685774 shutdown_connections 2023-09-13T10:02:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 -- 172.21.15.6:0/2447685774 wait complete. 2023-09-13T10:02:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 -- start start 2023-09-13T10:02:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 Processor -- start 2023-09-13T10:02:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f10ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f11410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f18450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.622 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90df7bb0 con 0x557e90f07a00 2023-09-13T10:02:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.603+0000 7f21abfdab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90df78b0 con 0x557e90f08700 2023-09-13T10:02:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f21abfdab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90cdb920 con 0x557e90f09060 2023-09-13T10:02:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f21abfdab80 10 client.0 _ll_register_callbacks cb 0x557e90df5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f10ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f10ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48120/0 (socket says 172.21.15.6:48120) 2023-09-13T10:02:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 -- 172.21.15.6:0/728890455 learned_addr learned my addr 172.21.15.6:0/728890455 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219e392700 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f18450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219d390700 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f11410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 -- 172.21.15.6:0/728890455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 msgr2=0x557e90f18450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f18450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 -- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 msgr2=0x557e90f11410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f11410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 -- 172.21.15.6:0/728890455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2190009c60 con 0x557e90f07a00 2023-09-13T10:02:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f219db91700 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f10ed0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f2198100d10 tx=0x7f219401a050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba7ffd1767a9244 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f21817fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f21817fa700 1 -- 172.21.15.6:0/728890455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219402b050 con 0x557e90f07a00 2023-09-13T10:02:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f21817fa700 1 -- 172.21.15.6:0/728890455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f219400f460 con 0x557e90f07a00 2023-09-13T10:02:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.604+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e90efa670 con 0x557e90f07a00 2023-09-13T10:02:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21817fa700 1 -- 172.21.15.6:0/728890455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2194005720 con 0x557e90f07a00 2023-09-13T10:02:19.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 10 client.21387 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x557e90e717a0 con 0x557e90f07a00 2023-09-13T10:02:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21817fa700 1 -- 172.21.15.6:0/728890455 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f219403f020 con 0x557e90f07a00 2023-09-13T10:02:19.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21817fa700 1 -- 172.21.15.6:0/728890455 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f21940247e0 con 0x557e90f07a00 2023-09-13T10:02:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 10 client.21387 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 10 client.21387 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 20 client.21387 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:19.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f1cd20 0x557e90f1f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 4 client.21387 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e90e52970 con 0x557e90f1cd20 2023-09-13T10:02:19.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.605+0000 7f219d390700 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f1cd20 0x557e90f1f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.606+0000 7f21817fa700 10 client.21387 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:19.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.606+0000 7f219d390700 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f1cd20 0x557e90f1f140 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4dd16779267c2a65 server_cookie=b9331aadaf6f8b75 in_seq=0 out_seq=0 2023-09-13T10:02:19.632 INFO:tasks.workunit.client.0.smithi006.stdout: 10 372596 33.61 MB/sec execute 459 sec latency 75.736 ms 2023-09-13T10:02:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.609+0000 7f21817fa700 1 -- 172.21.15.6:0/728890455 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557e90e52970 con 0x557e90f1cd20 2023-09-13T10:02:19.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.609+0000 7f21817fa700 10 client.21387 handle_command_reply: tid=0 2023-09-13T10:02:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.609+0000 7f21abfdab80 1 client.21387 shutdown 2023-09-13T10:02:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.609+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 msgr2=0x557e90f10ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.609+0000 7f21abfdab80 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f10ed0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f2198100d10 tx=0x7f219401a050 comp rx=0 tx=0).stop 2023-09-13T10:02:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 shutdown_connections 2023-09-13T10:02:19.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f18450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f1cd20 0x557e90f1f140 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f10ed0 unknown :-1 s=CLOSED pgs=1950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21817fa700 0 client.21387 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 --2- 172.21.15.6:0/728890455 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f11410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 >> 172.21.15.6:0/728890455 conn(0x557e90e65c80 msgr2=0x557e90f01ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 shutdown_connections 2023-09-13T10:02:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 1 -- 172.21.15.6:0/728890455 wait complete. 2023-09-13T10:02:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.610+0000 7f21abfdab80 20 client.21387 trim_cache size 0 max 16384 2023-09-13T10:02:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 Processor -- start 2023-09-13T10:02:19.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 -- start start 2023-09-13T10:02:19.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f07a00 0x557e90f074c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f02fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f09060 0x557e90f18410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90f02e40 con 0x557e90f09060 2023-09-13T10:02:19.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90f0c410 con 0x557e90f08700 2023-09-13T10:02:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f21abfdab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90f1ca20 con 0x557e90f07a00 2023-09-13T10:02:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f09060 0x557e90f18410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f09060 0x557e90f18410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48132/0 (socket says 172.21.15.6:48132) 2023-09-13T10:02:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 -- 172.21.15.6:0/584738712 learned_addr learned my addr 172.21.15.6:0/584738712 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219db91700 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f07a00 0x557e90f074c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 -- 172.21.15.6:0/584738712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f07a00 msgr2=0x557e90f074c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f07a00 0x557e90f074c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 -- 172.21.15.6:0/584738712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 msgr2=0x557e90f02fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f02fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.646 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.627+0000 7f219e392700 1 -- 172.21.15.6:0/584738712 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e90c85de0 con 0x557e90f09060 2023-09-13T10:02:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.628+0000 7f219e392700 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f09060 0x557e90f18410 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f2190004b10 tx=0x7f2190009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ae8b853fdbb923 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.628+0000 7f218cff9700 1 -- 172.21.15.6:0/584738712 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190010040 con 0x557e90f09060 2023-09-13T10:02:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.628+0000 7f218cff9700 1 -- 172.21.15.6:0/584738712 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2190023070 con 0x557e90f09060 2023-09-13T10:02:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.628+0000 7f218cff9700 1 -- 172.21.15.6:0/584738712 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2190013e40 con 0x557e90f09060 2023-09-13T10:02:19.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.628+0000 7f21abfdab80 1 -- 172.21.15.6:0/584738712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f09060 msgr2=0x557e90f18410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.628+0000 7f21abfdab80 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f09060 0x557e90f18410 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f2190004b10 tx=0x7f2190009f70 comp rx=0 tx=0).stop 2023-09-13T10:02:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 -- 172.21.15.6:0/584738712 shutdown_connections 2023-09-13T10:02:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f09060 0x557e90f18410 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f07a00 0x557e90f074c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 --2- 172.21.15.6:0/584738712 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f02fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.648 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 -- 172.21.15.6:0/584738712 >> 172.21.15.6:0/584738712 conn(0x557e90e65c80 msgr2=0x557e90f01ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 -- 172.21.15.6:0/584738712 shutdown_connections 2023-09-13T10:02:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 -- 172.21.15.6:0/584738712 wait complete. 2023-09-13T10:02:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 -- start start 2023-09-13T10:02:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.629+0000 7f21abfdab80 1 Processor -- start 2023-09-13T10:02:19.649 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f14110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f14650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f21abfdab80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f17670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f21abfdab80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90f17bb0 con 0x557e90f07a00 2023-09-13T10:02:19.650 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f21abfdab80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90f17d20 con 0x557e90f08700 2023-09-13T10:02:19.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f21abfdab80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e90f17ee0 con 0x557e90f09060 2023-09-13T10:02:19.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f21abfdab80 10 client.0 _ll_register_callbacks cb 0x557e90df5680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:19.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f14110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219d390700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f14650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219d390700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f14650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41660/0 (socket says 172.21.15.6:41660) 2023-09-13T10:02:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f14110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48134/0 (socket says 172.21.15.6:48134) 2023-09-13T10:02:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 -- 172.21.15.6:0/2367905952 learned_addr learned my addr 172.21.15.6:0/2367905952 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219e392700 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f17670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 -- 172.21.15.6:0/2367905952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 msgr2=0x557e90f17670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f17670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 -- 172.21.15.6:0/2367905952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 msgr2=0x557e90f14650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f14650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.630+0000 7f219db91700 1 -- 172.21.15.6:0/2367905952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557e90cd9630 con 0x557e90f07a00 2023-09-13T10:02:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f219db91700 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f14110 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f21940058e0 tx=0x7f2194024640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3dbaa04c5832ea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21817fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:19.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21817fa700 1 -- 172.21.15.6:0/2367905952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219402b040 con 0x557e90f07a00 2023-09-13T10:02:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21817fa700 1 -- 172.21.15.6:0/2367905952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2194040080 con 0x557e90f07a00 2023-09-13T10:02:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2190014ae0 con 0x557e90f07a00 2023-09-13T10:02:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21817fa700 1 -- 172.21.15.6:0/2367905952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f219400bb80 con 0x557e90f07a00 2023-09-13T10:02:19.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 10 client.21393 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x557e90c6ec60 con 0x557e90f07a00 2023-09-13T10:02:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21817fa700 1 -- 172.21.15.6:0/2367905952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2190014ae0 con 0x557e90f07a00 2023-09-13T10:02:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21817fa700 1 -- 172.21.15.6:0/2367905952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f2194042070 con 0x557e90f07a00 2023-09-13T10:02:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 10 client.21393 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 10 client.21393 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:19.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 20 client.21393 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:19.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f71590 0x557e90f739b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:19.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 4 client.21393 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:19.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.631+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x557e90e13050 con 0x557e90f71590 2023-09-13T10:02:19.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.633+0000 7f219d390700 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f71590 0x557e90f739b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:19.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.633+0000 7f219d390700 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f71590 0x557e90f739b0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fa38f8bb7bd391c server_cookie=5ac5e1a3ffab891d in_seq=0 out_seq=0 2023-09-13T10:02:19.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.633+0000 7f21817fa700 10 client.21393 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:19.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21817fa700 1 -- 172.21.15.6:0/2367905952 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x557e90e13050 con 0x557e90f71590 2023-09-13T10:02:19.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21817fa700 10 client.21393 handle_command_reply: tid=0 2023-09-13T10:02:19.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 client.21393 shutdown 2023-09-13T10:02:19.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 msgr2=0x557e90f14110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f14110 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f21940058e0 tx=0x7f2194024640 comp rx=0 tx=0).stop 2023-09-13T10:02:19.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 shutdown_connections 2023-09-13T10:02:19.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x557e90f09060 0x557e90f17670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x557e90f71590 0x557e90f739b0 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x557e90f07a00 0x557e90f14110 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 --2- 172.21.15.6:0/2367905952 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x557e90f08700 0x557e90f14650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21817fa700 0 client.21393 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:19.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 >> 172.21.15.6:0/2367905952 conn(0x557e90e65c80 msgr2=0x557e90f0ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 shutdown_connections 2023-09-13T10:02:19.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 1 -- 172.21.15.6:0/2367905952 wait complete. 2023-09-13T10:02:19.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.636+0000 7f21abfdab80 20 client.21393 trim_cache size 0 max 16384 2023-09-13T10:02:19.660 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21840a0640 msgr2=0x7f21840a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21840a0640 0x7f21840a2b00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f2194009990 tx=0x7f2194005fb0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2198100eb0 msgr2=0x7f2198102290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2198100eb0 0x7f2198102290 secure :-1 s=READY pgs=1948 cs=0 l=1 rev1=1 crypto rx=0x7f218800eb30 tx=0x7f218800ee40 comp rx=0 tx=0).stop 2023-09-13T10:02:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 shutdown_connections 2023-09-13T10:02:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2198101850 0x7f21981027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21980ffcc0 0x7f2198103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f21840a0640 0x7f21840a2b00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 --2- 172.21.15.6:0/1811215013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2198100eb0 0x7f2198102290 unknown :-1 s=CLOSED pgs=1948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:19.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 >> 172.21.15.6:0/1811215013 conn(0x7f21980fb250 msgr2=0x7f2198067fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 shutdown_connections 2023-09-13T10:02:19.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:19.637+0000 7f219fdf5700 1 -- 172.21.15.6:0/1811215013 wait complete. 2023-09-13T10:02:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:20 smithi006 ceph-mon[98665]: pgmap v984: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 636 op/s 2023-09-13T10:02:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:20 smithi053 ceph-mon[102373]: pgmap v984: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 636 op/s 2023-09-13T10:02:20.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:20 smithi131 ceph-mon[102785]: pgmap v984: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 5.7 MiB/s wr, 636 op/s 2023-09-13T10:02:20.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 373114 33.60 MB/sec execute 460 sec latency 126.935 ms 2023-09-13T10:02:20.666 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-09-13T10:02:20.666 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-09-13T10:02:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.828+0000 7fca959ed700 1 -- 172.21.15.6:0/4228992928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 msgr2=0x7fca9010b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.828+0000 7fca959ed700 1 --2- 172.21.15.6:0/4228992928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca9010b1b0 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7fca88009990 tx=0x7fca88009ca0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.828+0000 7fca959ed700 1 -- 172.21.15.6:0/4228992928 shutdown_connections 2023-09-13T10:02:20.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.828+0000 7fca959ed700 1 --2- 172.21.15.6:0/4228992928 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9010e130 0x7fca901105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.828+0000 7fca959ed700 1 --2- 172.21.15.6:0/4228992928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca9010b1b0 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.828+0000 7fca959ed700 1 --2- 172.21.15.6:0/4228992928 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9010b6f0 0x7fca9010dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.828+0000 7fca959ed700 1 -- 172.21.15.6:0/4228992928 >> 172.21.15.6:0/4228992928 conn(0x7fca9006dc70 msgr2=0x7fca900700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:20.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.829+0000 7fca959ed700 1 -- 172.21.15.6:0/4228992928 shutdown_connections 2023-09-13T10:02:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.829+0000 7fca959ed700 1 -- 172.21.15.6:0/4228992928 wait complete. 2023-09-13T10:02:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.829+0000 7fca959ed700 1 Processor -- start 2023-09-13T10:02:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca959ed700 1 -- start start 2023-09-13T10:02:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca959ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca90108840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.833 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca959ed700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9010b6f0 0x7fca901a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca959ed700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9010e130 0x7fca901a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca959ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901a2c40 con 0x7fca90108dc0 2023-09-13T10:02:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca959ed700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901a2db0 con 0x7fca9010e130 2023-09-13T10:02:20.834 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca959ed700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca901a2f70 con 0x7fca9010b6f0 2023-09-13T10:02:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca90108840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca8effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca90108840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48148/0 (socket says 172.21.15.6:48148) 2023-09-13T10:02:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca8effd700 1 -- 172.21.15.6:0/3409940159 learned_addr learned my addr 172.21.15.6:0/3409940159 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:20.835 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9010b6f0 0x7fca901a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.830+0000 7fca8f7fe700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9010e130 0x7fca901a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca8effd700 1 -- 172.21.15.6:0/3409940159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9010b6f0 msgr2=0x7fca901a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca8effd700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9010b6f0 0x7fca901a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.836 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca8effd700 1 -- 172.21.15.6:0/3409940159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9010e130 msgr2=0x7fca901a2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca8effd700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9010e130 0x7fca901a2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca8effd700 1 -- 172.21.15.6:0/3409940159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca880095f0 con 0x7fca90108dc0 2023-09-13T10:02:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca8effd700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca90108840 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fca8800b680 tx=0x7fca88004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:20.837 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca949eb700 1 -- 172.21.15.6:0/3409940159 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8801d070 con 0x7fca90108dc0 2023-09-13T10:02:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca901a31f0 con 0x7fca90108dc0 2023-09-13T10:02:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca949eb700 1 -- 172.21.15.6:0/3409940159 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca880054f0 con 0x7fca90108dc0 2023-09-13T10:02:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.831+0000 7fca949eb700 1 -- 172.21.15.6:0/3409940159 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88004c60 con 0x7fca90108dc0 2023-09-13T10:02:20.838 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.832+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca901a3710 con 0x7fca90108dc0 2023-09-13T10:02:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.835+0000 7fca949eb700 1 -- 172.21.15.6:0/3409940159 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fca8800fc40 con 0x7fca90108dc0 2023-09-13T10:02:20.839 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.836+0000 7fca949eb700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca780a06c0 0x7fca780a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.836+0000 7fca949eb700 1 -- 172.21.15.6:0/3409940159 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fca880ccf40 con 0x7fca90108dc0 2023-09-13T10:02:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.836+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca780a06c0 0x7fca780a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.836+0000 7fcaa1bd2b80 1 Processor -- start 2023-09-13T10:02:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca780a06c0 0x7fca780a2b80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fca901085b0 tx=0x7fca84009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fcaa1bd2b80 1 -- start start 2023-09-13T10:02:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecb780 0x558fe8ecbba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.844 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecc0e0 0x558fe8eca540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8ecaf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8e23800 con 0x558fe8ecc0e0 2023-09-13T10:02:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8e21120 con 0x558fe8ecaa80 2023-09-13T10:02:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8e1ca10 con 0x558fe8ecb780 2023-09-13T10:02:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fca8e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecc0e0 0x558fe8eca540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.845 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.837+0000 7fca8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecb780 0x558fe8ecbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecb780 0x558fe8ecbba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51210/0 (socket says 172.21.15.6:51210) 2023-09-13T10:02:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 -- 172.21.15.6:0/2848742820 learned_addr learned my addr 172.21.15.6:0/2848742820 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8f7fe700 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8ecaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 -- 172.21.15.6:0/2848742820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 msgr2=0x558fe8ecaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:20.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8ecaf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 -- 172.21.15.6:0/2848742820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecc0e0 msgr2=0x558fe8eca540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecc0e0 0x558fe8eca540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 -- 172.21.15.6:0/2848742820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fe8c9c6b0 con 0x558fe8ecb780 2023-09-13T10:02:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecc0e0 0x558fe8eca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:20.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca8effd700 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecb780 0x558fe8ecbba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca88097180 tx=0x7fca88005ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3528ba2d350bd37b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:20.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca75ffb700 1 -- 172.21.15.6:0/2848742820 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88005660 con 0x558fe8ecb780 2023-09-13T10:02:20.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca75ffb700 1 -- 172.21.15.6:0/2848742820 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca8809ae10 con 0x558fe8ecb780 2023-09-13T10:02:20.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.838+0000 7fca75ffb700 1 -- 172.21.15.6:0/2848742820 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca88099e60 con 0x558fe8ecb780 2023-09-13T10:02:20.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/2848742820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecb780 msgr2=0x558fe8ecbba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecb780 0x558fe8ecbba0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fca88097180 tx=0x7fca88005ef0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/2848742820 shutdown_connections 2023-09-13T10:02:20.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8ecaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecb780 0x558fe8ecbba0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/2848742820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecc0e0 0x558fe8eca540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/2848742820 >> 172.21.15.6:0/2848742820 conn(0x558fe8e28d00 msgr2=0x558fe8ec4f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:20.849 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/2848742820 shutdown_connections 2023-09-13T10:02:20.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.839+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/2848742820 wait complete. 2023-09-13T10:02:20.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 -- start start 2023-09-13T10:02:20.850 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 Processor -- start 2023-09-13T10:02:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecaa80 0x558fe8f17c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f181b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecc0e0 0x558fe8f1f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8dbac30 con 0x558fe8ecb780 2023-09-13T10:02:20.851 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8dba930 con 0x558fe8ecc0e0 2023-09-13T10:02:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8c9e9a0 con 0x558fe8ecaa80 2023-09-13T10:02:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fcaa1bd2b80 10 client.0 _ll_register_callbacks cb 0x558fe8db8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fca8e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f181b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fca8e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f181b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48164/0 (socket says 172.21.15.6:48164) 2023-09-13T10:02:20.852 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fca8e7fc700 1 -- 172.21.15.6:0/963603488 learned_addr learned my addr 172.21.15.6:0/963603488 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.840+0000 7fca8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecaa80 0x558fe8f17c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8f7fe700 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecc0e0 0x558fe8f1f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8e7fc700 1 -- 172.21.15.6:0/963603488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecaa80 msgr2=0x558fe8f17c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecaa80 0x558fe8f17c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8e7fc700 1 -- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecc0e0 msgr2=0x558fe8f1f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:20.853 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecc0e0 0x558fe8f1f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8e7fc700 1 -- 172.21.15.6:0/963603488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca901a3710 con 0x558fe8ecb780 2023-09-13T10:02:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8effd700 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecaa80 0x558fe8f17c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f181b0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fca84011fd0 tx=0x7fca840047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7585fd190940b505 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca6effd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:20.854 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca6effd700 1 -- 172.21.15.6:0/963603488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca84022070 con 0x558fe8ecb780 2023-09-13T10:02:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca6effd700 1 -- 172.21.15.6:0/963603488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fca8401d410 con 0x558fe8ecb780 2023-09-13T10:02:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558fe8ebd6f0 con 0x558fe8ecb780 2023-09-13T10:02:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fca6effd700 1 -- 172.21.15.6:0/963603488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca840045a0 con 0x558fe8ecb780 2023-09-13T10:02:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fcaa1bd2b80 10 client.21405 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:20.855 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.841+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x558fe8e34820 con 0x558fe8ecb780 2023-09-13T10:02:20.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fca6effd700 1 -- 172.21.15.6:0/963603488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x558fe8ebd6f0 con 0x558fe8ecb780 2023-09-13T10:02:20.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fca6effd700 1 -- 172.21.15.6:0/963603488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fca84031730 con 0x558fe8ecb780 2023-09-13T10:02:20.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fcaa1bd2b80 10 client.21405 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:20.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fcaa1bd2b80 10 client.21405 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:20.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fcaa1bd2b80 20 client.21405 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:20.856 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8f23aa0 0x558fe8f25ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fcaa1bd2b80 4 client.21405 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:20.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558fe8e159f0 con 0x558fe8f23aa0 2023-09-13T10:02:20.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.842+0000 7fca8effd700 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8f23aa0 0x558fe8f25ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.843+0000 7fca6effd700 10 client.21405 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:20.857 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.843+0000 7fca8effd700 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8f23aa0 0x558fe8f25ec0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fba358b653a0dc82 server_cookie=7798786c17b3d623 in_seq=0 out_seq=0 2023-09-13T10:02:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fca6effd700 1 -- 172.21.15.6:0/963603488 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558fe8e159f0 con 0x558fe8f23aa0 2023-09-13T10:02:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fca6effd700 10 client.21405 handle_command_reply: tid=0 2023-09-13T10:02:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 client.21405 shutdown 2023-09-13T10:02:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 msgr2=0x558fe8f181b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.859 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f181b0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fca84011fd0 tx=0x7fca840047c0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 shutdown_connections 2023-09-13T10:02:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecc0e0 0x558fe8f1f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8ecaa80 0x558fe8f17c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8f23aa0 0x558fe8f25ec0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.860 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/963603488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f181b0 unknown :-1 s=CLOSED pgs=1955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fca6effd700 0 client.21405 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 >> 172.21.15.6:0/963603488 conn(0x558fe8e28d00 msgr2=0x558fe8ebf870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 shutdown_connections 2023-09-13T10:02:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/963603488 wait complete. 2023-09-13T10:02:20.861 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.847+0000 7fcaa1bd2b80 20 client.21405 trim_cache size 0 max 16384 2023-09-13T10:02:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 Processor -- start 2023-09-13T10:02:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 -- start start 2023-09-13T10:02:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8ebf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.869 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecaa80 0x558fe8f1f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecb780 0x558fe8ec9c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8ed3110 con 0x558fe8ecaa80 2023-09-13T10:02:20.870 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8ebd6d0 con 0x558fe8ecb780 2023-09-13T10:02:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.868+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8ec1960 con 0x558fe8e28d00 2023-09-13T10:02:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecaa80 0x558fe8f1f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8ebf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecaa80 0x558fe8f1f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48172/0 (socket says 172.21.15.6:48172) 2023-09-13T10:02:20.871 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8e7fc700 1 -- 172.21.15.6:0/993092251 learned_addr learned my addr 172.21.15.6:0/993092251 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8ebf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51224/0 (socket says 172.21.15.6:51224) 2023-09-13T10:02:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8effd700 1 -- 172.21.15.6:0/993092251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecb780 msgr2=0x558fe8ec9c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:02:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8effd700 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecb780 0x558fe8ec9c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8effd700 1 -- 172.21.15.6:0/993092251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecaa80 msgr2=0x558fe8f1f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:20.872 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8effd700 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecaa80 0x558fe8f1f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8effd700 1 -- 172.21.15.6:0/993092251 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558fe8c48e60 con 0x558fe8e28d00 2023-09-13T10:02:20.873 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.869+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecaa80 0x558fe8f1f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.871+0000 7fca8effd700 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8ebf970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fca88096c10 tx=0x7fca880cc040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e528eec3b006cc35 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.871+0000 7fca767fc700 1 -- 172.21.15.6:0/993092251 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8809a790 con 0x558fe8e28d00 2023-09-13T10:02:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.871+0000 7fca767fc700 1 -- 172.21.15.6:0/993092251 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca8809e540 con 0x558fe8e28d00 2023-09-13T10:02:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.871+0000 7fca767fc700 1 -- 172.21.15.6:0/993092251 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880a24c0 con 0x558fe8e28d00 2023-09-13T10:02:20.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.872+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/993092251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 msgr2=0x558fe8ebf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.872+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8ebf970 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fca88096c10 tx=0x7fca880cc040 comp rx=0 tx=0).stop 2023-09-13T10:02:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.874+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/993092251 shutdown_connections 2023-09-13T10:02:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.874+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecb780 0x558fe8ec9c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.874+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8ebf970 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.874+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/993092251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecaa80 0x558fe8f1f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.874+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/993092251 >> 172.21.15.6:0/993092251 conn(0x558fe8ec52c0 msgr2=0x558fe8ec9530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.876+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/993092251 shutdown_connections 2023-09-13T10:02:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.876+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/993092251 wait complete. 2023-09-13T10:02:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 -- start start 2023-09-13T10:02:20.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 Processor -- start 2023-09-13T10:02:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8f1c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8f1cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f1dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8f1e0e0 con 0x558fe8ecb780 2023-09-13T10:02:20.879 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8f1e250 con 0x558fe8ecaa80 2023-09-13T10:02:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.877+0000 7fcaa1bd2b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558fe8f1e410 con 0x558fe8e28d00 2023-09-13T10:02:20.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fcaa1bd2b80 10 client.0 _ll_register_callbacks cb 0x558fe8db8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8f1c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8f1cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8f1cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41700/0 (socket says 172.21.15.6:41700) 2023-09-13T10:02:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8f1c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51228/0 (socket says 172.21.15.6:51228) 2023-09-13T10:02:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f1dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8e7fc700 1 -- 172.21.15.6:0/3190726719 learned_addr learned my addr 172.21.15.6:0/3190726719 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:20.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 -- 172.21.15.6:0/3190726719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 msgr2=0x558fe8f1cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8f1cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 -- 172.21.15.6:0/3190726719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 msgr2=0x558fe8f1dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f1dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 -- 172.21.15.6:0/3190726719 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558fe8e34820 con 0x558fe8e28d00 2023-09-13T10:02:20.883 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8f7fe700 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f1dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.878+0000 7fca8effd700 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8f1c650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x558fe8e238c0 tx=0x7fca88009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f00a89a2c77db8e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fca6effd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:02:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fca6effd700 1 -- 172.21.15.6:0/3190726719 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca880a2460 con 0x558fe8e28d00 2023-09-13T10:02:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fca6effd700 1 -- 172.21.15.6:0/3190726719 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fca880a26f0 con 0x558fe8e28d00 2023-09-13T10:02:20.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fca8809ae10 con 0x558fe8e28d00 2023-09-13T10:02:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fca6effd700 1 -- 172.21.15.6:0/3190726719 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca8809a790 con 0x558fe8e28d00 2023-09-13T10:02:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fcaa1bd2b80 10 client.30604 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x558fe8c9c6b0 con 0x558fe8e28d00 2023-09-13T10:02:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.879+0000 7fca6effd700 1 -- 172.21.15.6:0/3190726719 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fca8807f080 con 0x558fe8e28d00 2023-09-13T10:02:20.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.880+0000 7fca6effd700 1 -- 172.21.15.6:0/3190726719 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7fca880a0400 con 0x558fe8e28d00 2023-09-13T10:02:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.880+0000 7fcaa1bd2b80 10 client.30604 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.880+0000 7fcaa1bd2b80 10 client.30604 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.880+0000 7fcaa1bd2b80 20 client.30604 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.880+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8ecc0e0 0x558fe8f7bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:20.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.880+0000 7fcaa1bd2b80 4 client.30604 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-09-13T10:02:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.880+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x558fe8dd60d0 con 0x558fe8ecc0e0 2023-09-13T10:02:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.882+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8ecc0e0 0x558fe8f7bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:20.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.887+0000 7fca8e7fc700 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8ecc0e0 0x558fe8f7bb50 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46c5a6589942ae46 server_cookie=3283cb788b383172 in_seq=0 out_seq=0 2023-09-13T10:02:20.888 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.887+0000 7fca6effd700 10 client.30604 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:20.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.895+0000 7fca6effd700 1 -- 172.21.15.6:0/3190726719 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x558fe8dd60d0 con 0x558fe8ecc0e0 2023-09-13T10:02:20.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.895+0000 7fca6effd700 10 client.30604 handle_command_reply: tid=0 2023-09-13T10:02:20.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.895+0000 7fcaa1bd2b80 1 client.30604 shutdown 2023-09-13T10:02:20.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 msgr2=0x558fe8f1c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8f1c650 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x558fe8e238c0 tx=0x7fca88009310 comp rx=0 tx=0).stop 2023-09-13T10:02:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 shutdown_connections 2023-09-13T10:02:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x558fe8ecc0e0 0x558fe8f7bb50 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558fe8ecb780 0x558fe8f1dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fca6effd700 0 client.30604 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:20.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558fe8e28d00 0x558fe8f1c650 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 --2- 172.21.15.6:0/3190726719 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558fe8ecaa80 0x558fe8f1cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 >> 172.21.15.6:0/3190726719 conn(0x558fe8ec52c0 msgr2=0x558fe8ec9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:20.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 shutdown_connections 2023-09-13T10:02:20.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 1 -- 172.21.15.6:0/3190726719 wait complete. 2023-09-13T10:02:20.900 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fcaa1bd2b80 20 client.30604 trim_cache size 0 max 16384 2023-09-13T10:02:20.900 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:02:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: "return_code": 0, 2023-09-13T10:02:20.900 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_tag": "c3d9f9d2-d2c5-44ae-9bf3-a39c979b22dd", 2023-09-13T10:02:20.901 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": "asynchronous" 2023-09-13T10:02:20.901 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:02:20.901 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca780a06c0 msgr2=0x7fca780a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fca959ed700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca780a06c0 0x7fca780a2b80 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fca901085b0 tx=0x7fca84009260 comp rx=0 tx=0).stop 2023-09-13T10:02:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 msgr2=0x7fca90108840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fca959ed700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca90108840 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fca8800b680 tx=0x7fca88004730 comp rx=0 tx=0).stop 2023-09-13T10:02:20.902 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 shutdown_connections 2023-09-13T10:02:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.896+0000 7fca959ed700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fca9010e130 0x7fca901a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.897+0000 7fca959ed700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fca780a06c0 0x7fca780a2b80 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.897+0000 7fca959ed700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca90108dc0 0x7fca90108840 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.897+0000 7fca959ed700 1 --2- 172.21.15.6:0/3409940159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9010b6f0 0x7fca901a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.897+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 >> 172.21.15.6:0/3409940159 conn(0x7fca9006dc70 msgr2=0x7fca9010a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:20.903 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.897+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 shutdown_connections 2023-09-13T10:02:20.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:20.897+0000 7fca959ed700 1 -- 172.21.15.6:0/3409940159 wait complete. 2023-09-13T10:02:20.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:02:21.072 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 -- 172.21.15.6:0/3398462835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508100dc0 msgr2=0x7f05081011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 --2- 172.21.15.6:0/3398462835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508100dc0 0x7f05081011e0 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f04f80099c0 tx=0x7f04f8009cd0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 -- 172.21.15.6:0/3398462835 shutdown_connections 2023-09-13T10:02:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 --2- 172.21.15.6:0/3398462835 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508102950 0x7f0508109200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 --2- 172.21.15.6:0/3398462835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508100dc0 0x7f05081011e0 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.073 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 --2- 172.21.15.6:0/3398462835 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508101fb0 0x7f0508102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 -- 172.21.15.6:0/3398462835 >> 172.21.15.6:0/3398462835 conn(0x7f05080fc330 msgr2=0x7f05080fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 -- 172.21.15.6:0/3398462835 shutdown_connections 2023-09-13T10:02:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.071+0000 7f050dc64700 1 -- 172.21.15.6:0/3398462835 wait complete. 2023-09-13T10:02:21.074 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 Processor -- start 2023-09-13T10:02:21.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 -- start start 2023-09-13T10:02:21.076 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508100dc0 0x7f0508196ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508101fb0 0x7f0508196ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508102950 0x7f050819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819e630 con 0x7f0508101fb0 2023-09-13T10:02:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819e770 con 0x7f0508100dc0 2023-09-13T10:02:21.077 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.072+0000 7f050dc64700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f050819e900 con 0x7f0508102950 2023-09-13T10:02:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508101fb0 0x7f0508196ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508101fb0 0x7f0508196ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48190/0 (socket says 172.21.15.6:48190) 2023-09-13T10:02:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 -- 172.21.15.6:0/1130871063 learned_addr learned my addr 172.21.15.6:0/1130871063 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f05077fe700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508100dc0 0x7f0508196ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.078 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0507fff700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508102950 0x7f050819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 -- 172.21.15.6:0/1130871063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508102950 msgr2=0x7f050819e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508102950 0x7f050819e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 -- 172.21.15.6:0/1130871063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508100dc0 msgr2=0x7f0508196ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508100dc0 0x7f0508196ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.079 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 -- 172.21.15.6:0/1130871063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f80095f0 con 0x7f0508101fb0 2023-09-13T10:02:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0506ffd700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508101fb0 0x7f0508196ff0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00e9a0 tx=0x7f04fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0504ff9700 1 -- 172.21.15.6:0/1130871063 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc009790 con 0x7f0508101fb0 2023-09-13T10:02:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f050819ebe0 con 0x7f0508101fb0 2023-09-13T10:02:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0504ff9700 1 -- 172.21.15.6:0/1130871063 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04fc010430 con 0x7f0508101fb0 2023-09-13T10:02:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050819f140 con 0x7f0508101fb0 2023-09-13T10:02:21.080 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.073+0000 7f0504ff9700 1 -- 172.21.15.6:0/1130871063 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc018680 con 0x7f0508101fb0 2023-09-13T10:02:21.081 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.076+0000 7f0504ff9700 1 -- 172.21.15.6:0/1130871063 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f04fc00ca10 con 0x7f0508101fb0 2023-09-13T10:02:21.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.076+0000 7f0504ff9700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04f00a0640 0x7f04f00a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.086 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.077+0000 7f0504ff9700 1 -- 172.21.15.6:0/1130871063 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04fc014070 con 0x7f0508101fb0 2023-09-13T10:02:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.077+0000 7f05077fe700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04f00a0640 0x7f04f00a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.077+0000 7f05077fe700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04f00a0640 0x7f04f00a2b00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009990 tx=0x7f04f8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.077+0000 7f0519e49b80 1 Processor -- start 2023-09-13T10:02:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.077+0000 7f0519e49b80 1 -- start start 2023-09-13T10:02:21.087 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de4c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de4c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de4c3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0519e49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de41c780 con 0x55f0de4c5060 2023-09-13T10:02:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0519e49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de41a0a0 con 0x55f0de4c4700 2023-09-13T10:02:21.088 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0519e49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de415990 con 0x55f0de4c3a00 2023-09-13T10:02:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de4c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de4c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48198/0 (socket says 172.21.15.6:48198) 2023-09-13T10:02:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 -- 172.21.15.6:0/644775241 learned_addr learned my addr 172.21.15.6:0/644775241 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f05077fe700 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de4c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.089 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0507fff700 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de4c3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 -- 172.21.15.6:0/644775241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 msgr2=0x55f0de4c3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de4c3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 -- 172.21.15.6:0/644775241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 msgr2=0x55f0de4c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.090 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de4c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 -- 172.21.15.6:0/644775241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0de295630 con 0x55f0de4c5060 2023-09-13T10:02:21.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.078+0000 7f0506ffd700 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de4c34c0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00c2d0 tx=0x7f04fc098ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80b2f396c69e3b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:21.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f04edffb700 1 -- 172.21.15.6:0/644775241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc09d2a0 con 0x55f0de4c5060 2023-09-13T10:02:21.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f04edffb700 1 -- 172.21.15.6:0/644775241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04fc0a14e0 con 0x55f0de4c5060 2023-09-13T10:02:21.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f04edffb700 1 -- 172.21.15.6:0/644775241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc098960 con 0x55f0de4c5060 2023-09-13T10:02:21.091 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f0519e49b80 1 -- 172.21.15.6:0/644775241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 msgr2=0x55f0de4c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f0519e49b80 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de4c34c0 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00c2d0 tx=0x7f04fc098ec0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f0519e49b80 1 -- 172.21.15.6:0/644775241 shutdown_connections 2023-09-13T10:02:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f0519e49b80 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de4c3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f0519e49b80 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de4c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.092 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f0519e49b80 1 --2- 172.21.15.6:0/644775241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de4c34c0 unknown :-1 s=CLOSED pgs=1958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.079+0000 7f0519e49b80 1 -- 172.21.15.6:0/644775241 >> 172.21.15.6:0/644775241 conn(0x55f0de421c80 msgr2=0x55f0de4bdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 -- 172.21.15.6:0/644775241 shutdown_connections 2023-09-13T10:02:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 -- 172.21.15.6:0/644775241 wait complete. 2023-09-13T10:02:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 -- start start 2023-09-13T10:02:21.093 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 Processor -- start 2023-09-13T10:02:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c3a00 0x55f0de4ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c4700 0x55f0de4cd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c5060 0x55f0de4d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de3b3bb0 con 0x55f0de4c4700 2023-09-13T10:02:21.094 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de3b38b0 con 0x55f0de4c3a00 2023-09-13T10:02:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de297920 con 0x55f0de4c5060 2023-09-13T10:02:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.080+0000 7f0519e49b80 10 client.0 _ll_register_callbacks cb 0x55f0de3b1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c4700 0x55f0de4cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f05077fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c3a00 0x55f0de4ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.095 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c4700 0x55f0de4cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48204/0 (socket says 172.21.15.6:48204) 2023-09-13T10:02:21.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f05077fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c3a00 0x55f0de4ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41726/0 (socket says 172.21.15.6:41726) 2023-09-13T10:02:21.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 -- 172.21.15.6:0/446621963 learned_addr learned my addr 172.21.15.6:0/446621963 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:21.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0507fff700 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c5060 0x55f0de4d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 -- 172.21.15.6:0/446621963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c5060 msgr2=0x55f0de4d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.096 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c5060 0x55f0de4d4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 -- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c3a00 msgr2=0x55f0de4ccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c3a00 0x55f0de4ccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 -- 172.21.15.6:0/446621963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f050819f140 con 0x55f0de4c4700 2023-09-13T10:02:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f05077fe700 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c3a00 0x55f0de4ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:21.097 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0506ffd700 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c4700 0x55f0de4cd520 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00e970 tx=0x7f04fc0992d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d580729a71c99ba6 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f04e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f04e6ffd700 1 -- 172.21.15.6:0/446621963 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04fc098b60 con 0x55f0de4c4700 2023-09-13T10:02:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f04e6ffd700 1 -- 172.21.15.6:0/446621963 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04fc0b7240 con 0x55f0de4c4700 2023-09-13T10:02:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.081+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0de4b6670 con 0x55f0de4c4700 2023-09-13T10:02:21.098 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f04e6ffd700 1 -- 172.21.15.6:0/446621963 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04fc09d320 con 0x55f0de4c4700 2023-09-13T10:02:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 10 client.21423 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55f0de42d7a0 con 0x55f0de4c4700 2023-09-13T10:02:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f04e6ffd700 1 -- 172.21.15.6:0/446621963 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04fc063070 con 0x55f0de4c4700 2023-09-13T10:02:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f04e6ffd700 1 -- 172.21.15.6:0/446621963 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f04fc098460 con 0x55f0de4c4700 2023-09-13T10:02:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 10 client.21423 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:21.099 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 10 client.21423 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 20 client.21423 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de4d8ad0 0x55f0de4daef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 4 client.21423 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0de40e970 con 0x55f0de4d8ad0 2023-09-13T10:02:21.100 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.082+0000 7f05077fe700 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de4d8ad0 0x55f0de4daef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.083+0000 7f05077fe700 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de4d8ad0 0x55f0de4daef0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9deb3a4904fd67c server_cookie=8872f13842abb9b1 in_seq=0 out_seq=0 2023-09-13T10:02:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.083+0000 7f04e6ffd700 10 client.21423 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.085+0000 7f04e6ffd700 1 -- 172.21.15.6:0/446621963 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f0de40e970 con 0x55f0de4d8ad0 2023-09-13T10:02:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.085+0000 7f04e6ffd700 10 client.21423 handle_command_reply: tid=0 2023-09-13T10:02:21.101 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.085+0000 7f0519e49b80 1 client.21423 shutdown 2023-09-13T10:02:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.085+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c4700 msgr2=0x55f0de4cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.085+0000 7f0519e49b80 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c4700 0x55f0de4cd520 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00e970 tx=0x7f04fc0992d0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 shutdown_connections 2023-09-13T10:02:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c5060 0x55f0de4d4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.102 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c3a00 0x55f0de4ccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de4d8ad0 0x55f0de4daef0 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 --2- 172.21.15.6:0/446621963 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c4700 0x55f0de4cd520 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f04e6ffd700 0 client.21423 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 >> 172.21.15.6:0/446621963 conn(0x55f0de421c80 msgr2=0x55f0de4b87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:21.103 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 shutdown_connections 2023-09-13T10:02:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 1 -- 172.21.15.6:0/446621963 wait complete. 2023-09-13T10:02:21.104 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.086+0000 7f0519e49b80 20 client.21423 trim_cache size 0 max 16384 2023-09-13T10:02:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 Processor -- start 2023-09-13T10:02:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 -- start start 2023-09-13T10:02:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c3a00 0x55f0de4c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c4700 0x55f0de4ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.106 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c5060 0x55f0de4cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de4bf730 con 0x55f0de4c3a00 2023-09-13T10:02:21.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de4cab80 con 0x55f0de4c5060 2023-09-13T10:02:21.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0519e49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de4c8470 con 0x55f0de4c4700 2023-09-13T10:02:21.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f05077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c3a00 0x55f0de4c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.107 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f05077fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c3a00 0x55f0de4c34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48210/0 (socket says 172.21.15.6:48210) 2023-09-13T10:02:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f05077fe700 1 -- 172.21.15.6:0/1494519755 learned_addr learned my addr 172.21.15.6:0/1494519755 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0507fff700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c5060 0x55f0de4cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.104+0000 7f0506ffd700 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c4700 0x55f0de4ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f05077fe700 1 -- 172.21.15.6:0/1494519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c4700 msgr2=0x55f0de4ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.108 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f05077fe700 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c4700 0x55f0de4ccfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f05077fe700 1 -- 172.21.15.6:0/1494519755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c5060 msgr2=0x55f0de4cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f05077fe700 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c5060 0x55f0de4cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f05077fe700 1 -- 172.21.15.6:0/1494519755 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0de241de0 con 0x55f0de4c3a00 2023-09-13T10:02:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f05077fe700 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c3a00 0x55f0de4c34c0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b8c0 tx=0x7f04f8021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6353441251e89154 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f04ee7fc700 1 -- 172.21.15.6:0/1494519755 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8029040 con 0x55f0de4c3a00 2023-09-13T10:02:21.109 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f04ee7fc700 1 -- 172.21.15.6:0/1494519755 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04f802a040 con 0x55f0de4c3a00 2023-09-13T10:02:21.110 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.105+0000 7f04ee7fc700 1 -- 172.21.15.6:0/1494519755 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f800f460 con 0x55f0de4c3a00 2023-09-13T10:02:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 -- 172.21.15.6:0/1494519755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c3a00 msgr2=0x55f0de4c34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c3a00 0x55f0de4c34c0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f04f800b8c0 tx=0x7f04f8021000 comp rx=0 tx=0).stop 2023-09-13T10:02:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 -- 172.21.15.6:0/1494519755 shutdown_connections 2023-09-13T10:02:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c5060 0x55f0de4cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.113 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c3a00 0x55f0de4c34c0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 --2- 172.21.15.6:0/1494519755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c4700 0x55f0de4ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 -- 172.21.15.6:0/1494519755 >> 172.21.15.6:0/1494519755 conn(0x55f0de421c80 msgr2=0x55f0de4cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 -- 172.21.15.6:0/1494519755 shutdown_connections 2023-09-13T10:02:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 -- 172.21.15.6:0/1494519755 wait complete. 2023-09-13T10:02:21.114 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.106+0000 7f0519e49b80 1 -- start start 2023-09-13T10:02:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 1 Processor -- start 2023-09-13T10:02:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de52aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de52cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de52f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de52fdd0 con 0x55f0de4c5060 2023-09-13T10:02:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de52ff40 con 0x55f0de4c4700 2023-09-13T10:02:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0de530100 con 0x55f0de4c3a00 2023-09-13T10:02:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0519e49b80 10 client.0 _ll_register_callbacks cb 0x55f0de3b1680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f05077fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de52aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0507fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de52f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f05077fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de52aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51272/0 (socket says 172.21.15.6:51272) 2023-09-13T10:02:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f05077fe700 1 -- 172.21.15.6:0/3587415790 learned_addr learned my addr 172.21.15.6:0/3587415790 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f0506ffd700 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de52cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.107+0000 7f05077fe700 1 -- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 msgr2=0x55f0de52cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f05077fe700 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de52cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f05077fe700 1 -- 172.21.15.6:0/3587415790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 msgr2=0x55f0de52f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f05077fe700 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de52f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f05077fe700 1 -- 172.21.15.6:0/3587415790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0508109b50 con 0x55f0de4c3a00 2023-09-13T10:02:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f05077fe700 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de52aa90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005040 tx=0x7f04f8005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad412d8f6f2a58e3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f04e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:02:21.118 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f04e6ffd700 1 -- 172.21.15.6:0/3587415790 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f8029040 con 0x55f0de4c3a00 2023-09-13T10:02:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f04e6ffd700 1 -- 172.21.15.6:0/3587415790 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f04f8033550 con 0x55f0de4c3a00 2023-09-13T10:02:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04fc0a14e0 con 0x55f0de4c3a00 2023-09-13T10:02:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f04e6ffd700 1 -- 172.21.15.6:0/3587415790 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04f8033a70 con 0x55f0de4c3a00 2023-09-13T10:02:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f0519e49b80 10 client.30622 fetch_fsmap learned FSMap version 73 2023-09-13T10:02:21.119 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.108+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55f0de22ac60 con 0x55f0de4c3a00 2023-09-13T10:02:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f04e6ffd700 1 -- 172.21.15.6:0/3587415790 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f04fc0a14e0 con 0x55f0de4c3a00 2023-09-13T10:02:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f04e6ffd700 1 -- 172.21.15.6:0/3587415790 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 73) v1 ==== 7910+0+0 (secure 0 0 0) 0x7f04f800fd00 con 0x55f0de4c3a00 2023-09-13T10:02:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f0519e49b80 10 client.30622 fetch_fsmap finished waiting for FSMap version 73 2023-09-13T10:02:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f0519e49b80 10 client.30622 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:21.120 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f0519e49b80 20 client.30622 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f0519e49b80 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de531630 0x55f0de533a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f0519e49b80 4 client.30622 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:02:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f0de3cf050 con 0x55f0de531630 2023-09-13T10:02:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.109+0000 7f0506ffd700 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de531630 0x55f0de533a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:21.121 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.110+0000 7f04e6ffd700 10 client.30622 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:21.122 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.110+0000 7f0506ffd700 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de531630 0x55f0de533a20 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b689f2bb5b34d8d server_cookie=cc24f6eced0e0966 in_seq=0 out_seq=0 2023-09-13T10:02:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f04e6ffd700 1 -- 172.21.15.6:0/3587415790 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+265 (crc 0 0 0) 0x55f0de3cf050 con 0x55f0de531630 2023-09-13T10:02:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f04e6ffd700 10 client.30622 handle_command_reply: tid=0 2023-09-13T10:02:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 client.30622 shutdown 2023-09-13T10:02:21.123 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 msgr2=0x55f0de52aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de52aa90 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f04f8005040 tx=0x7f04f8005a90 comp rx=0 tx=0).stop 2023-09-13T10:02:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 shutdown_connections 2023-09-13T10:02:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55f0de531630 0x55f0de533a20 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55f0de4c5060 0x55f0de52f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.124 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55f0de4c3a00 0x55f0de52aa90 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f04e6ffd700 0 client.30622 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 --2- 172.21.15.6:0/3587415790 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55f0de4c4700 0x55f0de52cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 >> 172.21.15.6:0/3587415790 conn(0x55f0de421c80 msgr2=0x55f0de4c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 shutdown_connections 2023-09-13T10:02:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 1 -- 172.21.15.6:0/3587415790 wait complete. 2023-09-13T10:02:21.125 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.122+0000 7f0519e49b80 20 client.30622 trim_cache size 0 max 16384 2023-09-13T10:02:21.126 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:02:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "scrub active (4 inodes in the stack)", 2023-09-13T10:02:21.126 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": { 2023-09-13T10:02:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "c3d9f9d2-d2c5-44ae-9bf3-a39c979b22dd": { 2023-09-13T10:02:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/", 2023-09-13T10:02:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "tag": "c3d9f9d2-d2c5-44ae-9bf3-a39c979b22dd", 2023-09-13T10:02:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: "options": "recursive,force" 2023-09-13T10:02:21.127 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:02:21.129 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:02:21.129 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:02:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04f00a0640 msgr2=0x7f04f00a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04f00a0640 0x7f04f00a2b00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009990 tx=0x7f04f8005fb0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508101fb0 msgr2=0x7f0508196ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508101fb0 0x7f0508196ff0 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f04fc00e9a0 tx=0x7f04fc00ecb0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 shutdown_connections 2023-09-13T10:02:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0508102950 0x7f050819e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f0508100dc0 0x7f0508196ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f04f00a0640 0x7f04f00a2b00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 --2- 172.21.15.6:0/1130871063 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0508101fb0 0x7f0508196ff0 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 >> 172.21.15.6:0/1130871063 conn(0x7f05080fc330 msgr2=0x7f05080fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 shutdown_connections 2023-09-13T10:02:21.132 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:21.123+0000 7f050dc64700 1 -- 172.21.15.6:0/1130871063 wait complete. 2023-09-13T10:02:21.136 INFO:tasks.cephfs.filesystem:scrub status for tag:c3d9f9d2-d2c5-44ae-9bf3-a39c979b22dd - {'path': '/', 'tag': 'c3d9f9d2-d2c5-44ae-9bf3-a39c979b22dd', 'options': 'recursive,force'} 2023-09-13T10:02:21.507 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:02:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: 2023-09-13T10:02:21.102+0000 7fd590cef700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x30000001a78 [2,head] /volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/T1.XLS auth v16619 ap=1 s=260096 n(v0 rc2023-09-13T09:52:41.896111+0000 b260096 1=1+0) (iversion lock) caps={24971=pAsLsXsFscr/-@19} | ptrwaiter=0 request=0 lock=0 caps=1 replicated=0 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5621df309b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000001a78:[<0x30000001a71/T1.XLS v14448>,<0x30000001931/PM v56617>,<0x3000000192e/~dmtmp v6881>,<0x30000000001/client6 v4853>,<0x30000000000/clients v3115>,<0x10000000005/tmp v2261>,<0x100000001fb/client.0 v2292>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v312>,<0x10000000001/sv_1 v43>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x30000001a78:[<0x30000001a71/T1.XLS v16619>,<0x30000001931/PM v64736>,<0x3000000192e/~dmtmp v8188>,<0x30000000001/client6 v5444>,<0x30000000000/clients v3463>,<0x10000000005/tmp v2427>,<0x100000001fb/client.0 v2454>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v334>,<0x10000000001/sv_1 v41>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-09-13T10:02:21.507 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:02:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: 2023-09-13T10:02:21.103+0000 7fd590cef700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x30000001a8d [2,head] /volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/MOVED.DOC auth v16535 ap=1 s=260096 n(v0 rc2023-09-13T09:52:41.966110+0000 b260096 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24971=0-4194304@1} caps={24971=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@83},l=24971 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5621df52b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000001a8d:[<0x30000001a71/MOVED.DOC v11673>,<0x30000001931/PM v56617>,<0x3000000192e/~dmtmp v6881>,<0x30000000001/client6 v4853>,<0x30000000000/clients v3115>,<0x10000000005/tmp v2261>,<0x100000001fb/client.0 v2292>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v312>,<0x10000000001/sv_1 v43>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x30000001a8d:[<0x30000001a71/MOVED.DOC v16535>,<0x30000001931/PM v64736>,<0x3000000192e/~dmtmp v8188>,<0x30000000001/client6 v5444>,<0x30000000000/clients v3463>,<0x10000000005/tmp v2427>,<0x100000001fb/client.0 v2454>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v334>,<0x10000000001/sv_1 v41>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-09-13T10:02:21.508 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:02:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: 2023-09-13T10:02:21.104+0000 7fd590cef700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x30000001a81 [2,head] /volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/EVENTS.DOC auth v16533 ap=1 s=260096 n(v0 rc2023-09-13T09:52:41.927110+0000 b260096 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24971=0-4194304@1} caps={24971=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@83},l=24971 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 waiter=0 authpin=1 scrubqueue=0 0x5621df69a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000001a81:[<0x30000001a71/EVENTS.DOC v11671>,<0x30000001931/PM v56617>,<0x3000000192e/~dmtmp v6881>,<0x30000000001/client6 v4853>,<0x30000000000/clients v3115>,<0x10000000005/tmp v2261>,<0x100000001fb/client.0 v2292>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v312>,<0x10000000001/sv_1 v43>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x30000001a81:[<0x30000001a71/EVENTS.DOC v16533>,<0x30000001931/PM v64736>,<0x3000000192e/~dmtmp v8188>,<0x30000000001/client6 v5444>,<0x30000000000/clients v3463>,<0x10000000005/tmp v2427>,<0x100000001fb/client.0 v2454>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v334>,<0x10000000001/sv_1 v41>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-09-13T10:02:21.508 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:02:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: 2023-09-13T10:02:21.172+0000 7fd590cef700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x30000001955 [2,head] /volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/PCMAGCD.XLS auth{0=1} v8407 ap=1 s=260096 n(v0 rc2023-09-13T10:01:56.734386+0000 b260096 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24971=0-4194304@1} caps={24971=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@70},l=24971 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5621df30ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x30000001955:[<0x30000001951/PCMAGCD.XLS v6431>,<0x30000001910/EXCEL v33260>,<0x3000000190f/~dmtmp v9570>,<0x30000000001/client2 v4554>,<0x30000000000/clients v2930>,<0x10000000005/tmp v2184>,<0x100000001fb/client.0 v2169>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v300>,<0x10000000001/sv_1 v43>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x30000001955:[<0x30000001951/PCMAGCD.XLS v8407>,<0x30000001910/EXCEL v41694>,<0x3000000190f/~dmtmp v12339>,<0x30000000001/client2 v5460>,<0x30000000000/clients v3463>,<0x10000000005/tmp v2427>,<0x100000001fb/client.0 v2454>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v334>,<0x10000000001/sv_1 v41>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-09-13T10:02:21.508 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:02:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: 2023-09-13T10:02:21.173+0000 7fd590cef700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x3000000195e [2,head] /volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/SALES.XLS auth{0=1} v8405 ap=1 s=260096 n(v0 rc2023-09-13T10:01:58.088373+0000 b260096 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={24971=0-4194304@1} caps={24971=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@70},l=24971 | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=1 dirty=1 authpin=1 scrubqueue=0 0x5621dee63080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x3000000195e:[<0x30000001951/SALES.XLS v6429>,<0x30000001910/EXCEL v33260>,<0x3000000190f/~dmtmp v9570>,<0x30000000001/client2 v4554>,<0x30000000000/clients v2930>,<0x10000000005/tmp v2184>,<0x100000001fb/client.0 v2169>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v300>,<0x10000000001/sv_1 v43>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","memoryvalue":"(3)0x3000000195e:[<0x30000001951/SALES.XLS v8405>,<0x30000001910/EXCEL v41694>,<0x3000000190f/~dmtmp v12339>,<0x30000000001/client2 v5460>,<0x30000000000/clients v3463>,<0x10000000005/tmp v2427>,<0x100000001fb/client.0 v2454>,<0x100000001fa/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1 v334>,<0x10000000001/sv_1 v41>,<0x10000000000/_nogroup v69>,<0x1/volumes v76>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-09-13T10:02:21.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 373593 33.60 MB/sec execute 461 sec latency 106.804 ms 2023-09-13T10:02:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: pgmap v985: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-09-13T10:02:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub queued for path: / 2023-09-13T10:02:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:02:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:02:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:02:22.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:02:22.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:02:22.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: active paths [/] 2023-09-13T10:02:22.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: Scrub error on inode 0x30000001a78 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/T1.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: Scrub error on inode 0x30000001a8d (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/MOVED.DOC) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: Scrub error on inode 0x30000001a81 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/EVENTS.DOC) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: Scrub error on inode 0x30000001955 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/PCMAGCD.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: Scrub error on inode 0x3000000195e (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/SALES.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:22 smithi006 ceph-mon[98665]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: pgmap v985: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-09-13T10:02:22.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub queued for path: / 2023-09-13T10:02:22.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:02:22.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:02:22.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:02:22.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:02:22.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:02:22.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: active paths [/] 2023-09-13T10:02:22.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: Scrub error on inode 0x30000001a78 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/T1.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.513 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: Scrub error on inode 0x30000001a8d (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/MOVED.DOC) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: Scrub error on inode 0x30000001a81 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/EVENTS.DOC) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: Scrub error on inode 0x30000001955 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/PCMAGCD.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.514 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: Scrub error on inode 0x3000000195e (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/SALES.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.515 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:22 smithi053 ceph-mon[102373]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: pgmap v985: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-09-13T10:02:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub queued for path: / 2023-09-13T10:02:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:02:22.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:02:22.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:02:22.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:02:22.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:02:22.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: active paths [/] 2023-09-13T10:02:22.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: Scrub error on inode 0x30000001a78 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/T1.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: Scrub error on inode 0x30000001a8d (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/MOVED.DOC) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: Scrub error on inode 0x30000001a81 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/EVENTS.DOC) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: Scrub error on inode 0x30000001955 (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/PCMAGCD.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: Scrub error on inode 0x3000000195e (/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/SALES.XLS) see mds.h log and `damage ls` output for details 2023-09-13T10:02:22.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:22 smithi131 ceph-mon[102785]: scrub summary: idle+waiting paths [/] 2023-09-13T10:02:22.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 374130 33.59 MB/sec execute 462 sec latency 73.833 ms 2023-09-13T10:02:23.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 374689 33.57 MB/sec execute 463 sec latency 82.567 ms 2023-09-13T10:02:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:24 smithi053 ceph-mon[102373]: pgmap v986: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 509 op/s 2023-09-13T10:02:24.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:24 smithi006 ceph-mon[98665]: pgmap v986: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 509 op/s 2023-09-13T10:02:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:24 smithi131 ceph-mon[102785]: pgmap v986: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 3.6 MiB/s wr, 509 op/s 2023-09-13T10:02:24.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 375201 33.54 MB/sec execute 464 sec latency 111.671 ms 2023-09-13T10:02:25.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 375975 33.57 MB/sec execute 465 sec latency 74.477 ms 2023-09-13T10:02:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:26 smithi006 ceph-mon[98665]: pgmap v987: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 478 op/s 2023-09-13T10:02:26.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:26 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a[98641]: 2023-09-13T10:02:26.123+0000 7f7c8e871700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-09-13T10:02:26.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:26 smithi053 ceph-mon[102373]: pgmap v987: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 478 op/s 2023-09-13T10:02:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:26 smithi131 ceph-mon[102785]: pgmap v987: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.2 MiB/s wr, 478 op/s 2023-09-13T10:02:26.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 376718 33.59 MB/sec execute 466 sec latency 60.761 ms 2023-09-13T10:02:27.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:27 smithi053 ceph-mon[102373]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-09-13T10:02:27.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:27 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:active 2023-09-13T10:02:27.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:27 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:27.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:27 smithi006 ceph-mon[98665]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-09-13T10:02:27.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:27 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:active 2023-09-13T10:02:27.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:27 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:27.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:27 smithi131 ceph-mon[102785]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-09-13T10:02:27.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:27 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] up:active 2023-09-13T10:02:27.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:27 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:27.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 376777 33.53 MB/sec execute 467 sec latency 690.017 ms 2023-09-13T10:02:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:28 smithi006 ceph-mon[98665]: pgmap v988: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 443 op/s 2023-09-13T10:02:28.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:28 smithi053 ceph-mon[102373]: pgmap v988: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 443 op/s 2023-09-13T10:02:28.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:28 smithi131 ceph-mon[102785]: pgmap v988: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 443 op/s 2023-09-13T10:02:28.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 377097 33.50 MB/sec execute 468 sec latency 794.008 ms 2023-09-13T10:02:29.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 377341 33.45 MB/sec execute 469 sec latency 181.812 ms 2023-09-13T10:02:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:30 smithi006 ceph-mon[98665]: pgmap v989: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.9 MiB/s wr, 636 op/s 2023-09-13T10:02:30.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:30 smithi053 ceph-mon[102373]: pgmap v989: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.9 MiB/s wr, 636 op/s 2023-09-13T10:02:30.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:30 smithi131 ceph-mon[102785]: pgmap v989: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 7.9 MiB/s wr, 636 op/s 2023-09-13T10:02:30.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 377855 33.44 MB/sec execute 470 sec latency 65.309 ms 2023-09-13T10:02:31.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 378569 33.44 MB/sec execute 471 sec latency 58.066 ms 2023-09-13T10:02:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:32 smithi006 ceph-mon[98665]: pgmap v990: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.0 MiB/s wr, 523 op/s 2023-09-13T10:02:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:32 smithi053 ceph-mon[102373]: pgmap v990: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.0 MiB/s wr, 523 op/s 2023-09-13T10:02:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:32 smithi131 ceph-mon[102785]: pgmap v990: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 8.0 MiB/s wr, 523 op/s 2023-09-13T10:02:32.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 379188 33.43 MB/sec execute 472 sec latency 118.375 ms 2023-09-13T10:02:33.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 379946 33.46 MB/sec execute 473 sec latency 59.778 ms 2023-09-13T10:02:34.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:34 smithi006 ceph-mon[98665]: pgmap v991: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 725 op/s 2023-09-13T10:02:34.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:34 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:34 smithi053 ceph-mon[102373]: pgmap v991: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 725 op/s 2023-09-13T10:02:34.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:34 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:34 smithi131 ceph-mon[102785]: pgmap v991: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 12 MiB/s wr, 725 op/s 2023-09-13T10:02:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:34 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:34.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 380504 33.46 MB/sec execute 474 sec latency 71.821 ms 2023-09-13T10:02:35.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:35.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:35.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:35.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:35.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:35 smithi053 ceph-mon[102373]: scrub summary: idle 2023-09-13T10:02:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:35.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:35.509 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:35 smithi006 ceph-mon[98665]: scrub summary: idle 2023-09-13T10:02:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:35.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:35.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:35 smithi131 ceph-mon[102785]: scrub summary: idle 2023-09-13T10:02:35.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 381014 33.44 MB/sec execute 475 sec latency 67.625 ms 2023-09-13T10:02:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:36 smithi006 ceph-mon[98665]: pgmap v992: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 720 op/s 2023-09-13T10:02:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:36 smithi053 ceph-mon[102373]: pgmap v992: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 720 op/s 2023-09-13T10:02:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:36 smithi131 ceph-mon[102785]: pgmap v992: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 12 MiB/s wr, 720 op/s 2023-09-13T10:02:36.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 381657 33.45 MB/sec execute 476 sec latency 47.714 ms 2023-09-13T10:02:37.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 382243 33.43 MB/sec execute 477 sec latency 210.855 ms 2023-09-13T10:02:38.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:38 smithi006 ceph-mon[98665]: pgmap v993: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 752 op/s 2023-09-13T10:02:38.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:38 smithi053 ceph-mon[102373]: pgmap v993: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 752 op/s 2023-09-13T10:02:38.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:38 smithi131 ceph-mon[102785]: pgmap v993: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 13 MiB/s wr, 752 op/s 2023-09-13T10:02:38.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 382872 33.42 MB/sec execute 478 sec latency 94.185 ms 2023-09-13T10:02:39.607 INFO:tasks.workunit.client.0.smithi006.stdout: 10 383631 33.47 MB/sec execute 479 sec latency 91.810 ms 2023-09-13T10:02:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:40 smithi006 ceph-mon[98665]: pgmap v994: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 821 op/s 2023-09-13T10:02:40.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:40 smithi053 ceph-mon[102373]: pgmap v994: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 821 op/s 2023-09-13T10:02:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:40 smithi131 ceph-mon[102785]: pgmap v994: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 13 MiB/s wr, 821 op/s 2023-09-13T10:02:40.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 384262 33.47 MB/sec execute 480 sec latency 51.259 ms 2023-09-13T10:02:41.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 384720 33.44 MB/sec execute 481 sec latency 82.966 ms 2023-09-13T10:02:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:42 smithi053 ceph-mon[102373]: pgmap v995: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.7 MiB/s wr, 651 op/s 2023-09-13T10:02:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:42 smithi006 ceph-mon[98665]: pgmap v995: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.7 MiB/s wr, 651 op/s 2023-09-13T10:02:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:42 smithi131 ceph-mon[102785]: pgmap v995: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 8.7 MiB/s wr, 651 op/s 2023-09-13T10:02:42.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 385302 33.43 MB/sec execute 482 sec latency 101.009 ms 2023-09-13T10:02:43.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 385908 33.43 MB/sec execute 483 sec latency 84.734 ms 2023-09-13T10:02:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:44 smithi006 ceph-mon[98665]: pgmap v996: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 711 op/s 2023-09-13T10:02:44.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:44 smithi053 ceph-mon[102373]: pgmap v996: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 711 op/s 2023-09-13T10:02:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:44 smithi131 ceph-mon[102785]: pgmap v996: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.2 MiB/s wr, 711 op/s 2023-09-13T10:02:44.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 386760 33.46 MB/sec execute 484 sec latency 60.214 ms 2023-09-13T10:02:45.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 387358 33.46 MB/sec execute 485 sec latency 86.538 ms 2023-09-13T10:02:46.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:46 smithi053 ceph-mon[102373]: pgmap v997: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 560 op/s 2023-09-13T10:02:46.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:46 smithi006 ceph-mon[98665]: pgmap v997: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 560 op/s 2023-09-13T10:02:46.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:46 smithi131 ceph-mon[102785]: pgmap v997: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.6 MiB/s wr, 560 op/s 2023-09-13T10:02:46.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 387860 33.46 MB/sec execute 486 sec latency 75.027 ms 2023-09-13T10:02:47.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 388430 33.48 MB/sec execute 487 sec latency 115.884 ms 2023-09-13T10:02:48.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:48 smithi006 ceph-mon[98665]: pgmap v998: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 508 op/s 2023-09-13T10:02:48.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:48 smithi053 ceph-mon[102373]: pgmap v998: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 508 op/s 2023-09-13T10:02:48.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:48 smithi131 ceph-mon[102785]: pgmap v998: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 4.0 MiB/s wr, 508 op/s 2023-09-13T10:02:48.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 389088 33.47 MB/sec execute 488 sec latency 77.295 ms 2023-09-13T10:02:49.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 389709 33.48 MB/sec execute 489 sec latency 71.163 ms 2023-09-13T10:02:50.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:50 smithi006 ceph-mon[98665]: pgmap v999: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 511 op/s 2023-09-13T10:02:50.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:50 smithi053 ceph-mon[102373]: pgmap v999: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 511 op/s 2023-09-13T10:02:50.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:50 smithi131 ceph-mon[102785]: pgmap v999: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 511 op/s 2023-09-13T10:02:50.609 INFO:tasks.workunit.client.0.smithi006.stdout: 10 390218 33.47 MB/sec execute 490 sec latency 76.722 ms 2023-09-13T10:02:51.137 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-09-13T10:02:51.286 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.284+0000 7f4b09f89700 1 -- 172.21.15.6:0/4027283805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100630 msgr2=0x7f4b04100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.284+0000 7f4b09f89700 1 --2- 172.21.15.6:0/4027283805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100630 0x7f4b04100a90 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009920 tx=0x7f4af8009c30 comp rx=0 tx=0).stop 2023-09-13T10:02:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.284+0000 7f4b09f89700 1 -- 172.21.15.6:0/4027283805 shutdown_connections 2023-09-13T10:02:51.287 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.284+0000 7f4b09f89700 1 --2- 172.21.15.6:0/4027283805 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b04100fd0 0x7f4b04107880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.284+0000 7f4b09f89700 1 --2- 172.21.15.6:0/4027283805 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b040ff440 0x7f4b040ff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.284+0000 7f4b09f89700 1 --2- 172.21.15.6:0/4027283805 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100630 0x7f4b04100a90 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.284+0000 7f4b09f89700 1 -- 172.21.15.6:0/4027283805 >> 172.21.15.6:0/4027283805 conn(0x7f4b040fa9b0 msgr2=0x7f4b040fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.285+0000 7f4b09f89700 1 -- 172.21.15.6:0/4027283805 shutdown_connections 2023-09-13T10:02:51.288 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.285+0000 7f4b09f89700 1 -- 172.21.15.6:0/4027283805 wait complete. 2023-09-13T10:02:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.285+0000 7f4b09f89700 1 Processor -- start 2023-09-13T10:02:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b09f89700 1 -- start start 2023-09-13T10:02:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b09f89700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b040ff440 0x7f4b04196090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.290 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b09f89700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b04100630 0x7f4b041946d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b09f89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100fd0 0x7f4b04194c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b09f89700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041953b0 con 0x7f4b04100fd0 2023-09-13T10:02:51.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b09f89700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b04195520 con 0x7f4b04100630 2023-09-13T10:02:51.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b09f89700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b041a0b60 con 0x7f4b040ff440 2023-09-13T10:02:51.291 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100fd0 0x7f4b04194c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b02ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b04100630 0x7f4b041946d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.292 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b040ff440 0x7f4b04196090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.299 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100fd0 0x7f4b04194c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48232/0 (socket says 172.21.15.6:48232) 2023-09-13T10:02:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b02ffd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b04100630 0x7f4b041946d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41754/0 (socket says 172.21.15.6:41754) 2023-09-13T10:02:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b040ff440 0x7f4b04196090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51282/0 (socket says 172.21.15.6:51282) 2023-09-13T10:02:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 -- 172.21.15.6:0/2105823547 learned_addr learned my addr 172.21.15.6:0/2105823547 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.300 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 -- 172.21.15.6:0/2105823547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b040ff440 msgr2=0x7f4b04196090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b040ff440 0x7f4b04196090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 -- 172.21.15.6:0/2105823547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b04100630 msgr2=0x7f4b041946d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b04100630 0x7f4b041946d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.301 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.286+0000 7f4b03fff700 1 -- 172.21.15.6:0/2105823547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4af8009520 con 0x7f4b04100fd0 2023-09-13T10:02:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.287+0000 7f4b03fff700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100fd0 0x7f4b04194c10 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00c110 tx=0x7f4afc00c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.287+0000 7f4b00ff9700 1 -- 172.21.15.6:0/2105823547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc017070 con 0x7f4b04100fd0 2023-09-13T10:02:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.287+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b041a0de0 con 0x7f4b04100fd0 2023-09-13T10:02:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.287+0000 7f4b00ff9700 1 -- 172.21.15.6:0/2105823547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4afc00e050 con 0x7f4b04100fd0 2023-09-13T10:02:51.302 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.287+0000 7f4b00ff9700 1 -- 172.21.15.6:0/2105823547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0078f0 con 0x7f4b04100fd0 2023-09-13T10:02:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.287+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b041a1270 con 0x7f4b04100fd0 2023-09-13T10:02:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.289+0000 7f4b00ff9700 1 -- 172.21.15.6:0/2105823547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4afc007a50 con 0x7f4b04100fd0 2023-09-13T10:02:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.290+0000 7f4b00ff9700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4aec0a0640 0x7f4aec0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.290+0000 7f4b037fe700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4aec0a0640 0x7f4aec0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.303 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.290+0000 7f4b00ff9700 1 -- 172.21.15.6:0/2105823547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4afc0cb610 con 0x7f4b04100fd0 2023-09-13T10:02:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b037fe700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4aec0a0640 0x7f4aec0a2b00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4b04100490 tx=0x7f4af4010040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 Processor -- start 2023-09-13T10:02:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 -- start start 2023-09-13T10:02:51.304 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4e2b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e3060 0x55c16c4e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e1a00 0x55c16c4e1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c43a780 con 0x55c16c4e3060 2023-09-13T10:02:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c4380a0 con 0x55c16c4e1a00 2023-09-13T10:02:51.305 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c433990 con 0x55c16c4e2700 2023-09-13T10:02:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.291+0000 7f4b02ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e3060 0x55c16c4e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4e2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4e2b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51290/0 (socket says 172.21.15.6:51290) 2023-09-13T10:02:51.306 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 -- 172.21.15.6:0/1094327303 learned_addr learned my addr 172.21.15.6:0/1094327303 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b02ffd700 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e3060 0x55c16c4e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48240/0 (socket says 172.21.15.6:48240) 2023-09-13T10:02:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b03fff700 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e1a00 0x55c16c4e1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 -- 172.21.15.6:0/1094327303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e1a00 msgr2=0x55c16c4e1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e1a00 0x55c16c4e1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.307 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 -- 172.21.15.6:0/1094327303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e3060 msgr2=0x55c16c4e14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e3060 0x55c16c4e14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 -- 172.21.15.6:0/1094327303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c16c2b3630 con 0x55c16c4e2700 2023-09-13T10:02:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b02ffd700 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e3060 0x55c16c4e14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:51.308 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4e2b20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4af400af60 tx=0x7f4af4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67013292633b061a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4ae9ffb700 1 -- 172.21.15.6:0/1094327303 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4020070 con 0x55c16c4e2700 2023-09-13T10:02:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4ae9ffb700 1 -- 172.21.15.6:0/1094327303 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af401b190 con 0x55c16c4e2700 2023-09-13T10:02:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.292+0000 7f4ae9ffb700 1 -- 172.21.15.6:0/1094327303 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4013040 con 0x55c16c4e2700 2023-09-13T10:02:51.309 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1094327303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 msgr2=0x55c16c4e2b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4e2b20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f4af400af60 tx=0x7f4af4014000 comp rx=0 tx=0).stop 2023-09-13T10:02:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1094327303 shutdown_connections 2023-09-13T10:02:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e1a00 0x55c16c4e1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.310 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4e2b20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1094327303 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e3060 0x55c16c4e14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1094327303 >> 172.21.15.6:0/1094327303 conn(0x55c16c43fc80 msgr2=0x55c16c4dbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1094327303 shutdown_connections 2023-09-13T10:02:51.311 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.293+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1094327303 wait complete. 2023-09-13T10:02:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 -- start start 2023-09-13T10:02:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 Processor -- start 2023-09-13T10:02:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e1a00 0x55c16c4eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4eb410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.312 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e3060 0x55c16c4f2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c3d1bb0 con 0x55c16c4e1a00 2023-09-13T10:02:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c3d18b0 con 0x55c16c4e3060 2023-09-13T10:02:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c2b5920 con 0x55c16c4e2700 2023-09-13T10:02:51.313 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.294+0000 7f4b1616eb80 10 client.0 _ll_register_callbacks cb 0x55c16c3cf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e1a00 0x55c16c4eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e1a00 0x55c16c4eaed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48242/0 (socket says 172.21.15.6:48242) 2023-09-13T10:02:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 -- 172.21.15.6:0/3943864081 learned_addr learned my addr 172.21.15.6:0/3943864081 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.314 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b02ffd700 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4eb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b03fff700 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e3060 0x55c16c4f2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 -- 172.21.15.6:0/3943864081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 msgr2=0x55c16c4eb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.315 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4eb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 -- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e3060 msgr2=0x55c16c4f2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e3060 0x55c16c4f2450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.316 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 -- 172.21.15.6:0/3943864081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4af400ecd0 con 0x55c16c4e1a00 2023-09-13T10:02:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b037fe700 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e1a00 0x55c16c4eaed0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f4af401bd40 tx=0x7f4af401bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20ac0319775268e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4ae2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/3943864081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4020040 con 0x55c16c4e1a00 2023-09-13T10:02:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/3943864081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4af4024ca0 con 0x55c16c4e1a00 2023-09-13T10:02:51.317 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c16c4d4670 con 0x55c16c4e1a00 2023-09-13T10:02:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/3943864081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4af4013040 con 0x55c16c4e1a00 2023-09-13T10:02:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b1616eb80 10 client.21441 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.295+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x55c16c44b7a0 con 0x55c16c4e1a00 2023-09-13T10:02:51.318 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/3943864081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af403c080 con 0x55c16c4e1a00 2023-09-13T10:02:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/3943864081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4af402b070 con 0x55c16c4e1a00 2023-09-13T10:02:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4b1616eb80 10 client.21441 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:51.319 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4b1616eb80 10 client.21441 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4b1616eb80 20 client.21441 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4f6ba0 0x55c16c4f8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.320 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4b1616eb80 4 client.21441 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c16c42c970 con 0x55c16c4f6ba0 2023-09-13T10:02:51.321 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.296+0000 7f4b02ffd700 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4f6ba0 0x55c16c4f8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.328 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.298+0000 7f4ae2ffd700 10 client.21441 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.298+0000 7f4b02ffd700 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4f6ba0 0x55c16c4f8fc0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b7d34ba4460f92 server_cookie=106152e7898ebfdf in_seq=0 out_seq=0 2023-09-13T10:02:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.300+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/3943864081 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c16c42c970 con 0x55c16c4f6ba0 2023-09-13T10:02:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.300+0000 7f4ae2ffd700 10 client.21441 handle_command_reply: tid=0 2023-09-13T10:02:51.329 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.300+0000 7f4b1616eb80 1 client.21441 shutdown 2023-09-13T10:02:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.300+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e1a00 msgr2=0x55c16c4eaed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.300+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e1a00 0x55c16c4eaed0 secure :-1 s=READY pgs=1963 cs=0 l=1 rev1=1 crypto rx=0x7f4af401bd40 tx=0x7f4af401bd70 comp rx=0 tx=0).stop 2023-09-13T10:02:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 shutdown_connections 2023-09-13T10:02:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e3060 0x55c16c4f2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.330 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4f6ba0 0x55c16c4f8fc0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e1a00 0x55c16c4eaed0 unknown :-1 s=CLOSED pgs=1963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4ae2ffd700 0 client.21441 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/3943864081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e2700 0x55c16c4eb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.331 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 >> 172.21.15.6:0/3943864081 conn(0x55c16c43fc80 msgr2=0x55c16c4d67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 shutdown_connections 2023-09-13T10:02:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 1 -- 172.21.15.6:0/3943864081 wait complete. 2023-09-13T10:02:51.332 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.301+0000 7f4b1616eb80 20 client.21441 trim_cache size 0 max 16384 2023-09-13T10:02:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 Processor -- start 2023-09-13T10:02:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 -- start start 2023-09-13T10:02:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c43fc80 0x55c16c4e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4f2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e2700 0x55c16c4eac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c4e9610 con 0x55c16c43fc80 2023-09-13T10:02:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c4e6420 con 0x55c16c4e2700 2023-09-13T10:02:51.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c4f68a0 con 0x55c16c4e1a00 2023-09-13T10:02:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c43fc80 0x55c16c4e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.335 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c43fc80 0x55c16c4e14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48250/0 (socket says 172.21.15.6:48250) 2023-09-13T10:02:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b037fe700 1 -- 172.21.15.6:0/1133309737 learned_addr learned my addr 172.21.15.6:0/1133309737 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.320+0000 7f4b02ffd700 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b03fff700 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e2700 0x55c16c4eac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b037fe700 1 -- 172.21.15.6:0/1133309737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 msgr2=0x55c16c4f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4f2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b037fe700 1 -- 172.21.15.6:0/1133309737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e2700 msgr2=0x55c16c4eac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e2700 0x55c16c4eac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b037fe700 1 -- 172.21.15.6:0/1133309737 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c16c25fde0 con 0x55c16c43fc80 2023-09-13T10:02:51.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b03fff700 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e2700 0x55c16c4eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:02:51.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c43fc80 0x55c16c4e14c0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f4af400eac0 tx=0x7f4af401b300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39af3117d2c43768 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4aea7fc700 1 -- 172.21.15.6:0/1133309737 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4020070 con 0x55c16c43fc80 2023-09-13T10:02:51.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4aea7fc700 1 -- 172.21.15.6:0/1133309737 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af401be90 con 0x55c16c43fc80 2023-09-13T10:02:51.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.321+0000 7f4aea7fc700 1 -- 172.21.15.6:0/1133309737 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4af4004f50 con 0x55c16c43fc80 2023-09-13T10:02:51.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1133309737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c43fc80 msgr2=0x55c16c4e14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c43fc80 0x55c16c4e14c0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f4af400eac0 tx=0x7f4af401b300 comp rx=0 tx=0).stop 2023-09-13T10:02:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1133309737 shutdown_connections 2023-09-13T10:02:51.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c4e2700 0x55c16c4eac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c43fc80 0x55c16c4e14c0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1133309737 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1133309737 >> 172.21.15.6:0/1133309737 conn(0x55c16c4dc240 msgr2=0x55c16c4e58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1133309737 shutdown_connections 2023-09-13T10:02:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.322+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1133309737 wait complete. 2023-09-13T10:02:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 -- start start 2023-09-13T10:02:51.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 Processor -- start 2023-09-13T10:02:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c43fc80 0x55c16c4f2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4eee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e2700 0x55c16c4ef400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.343 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c54a9c0 con 0x55c16c4e2700 2023-09-13T10:02:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c54ab00 con 0x55c16c43fc80 2023-09-13T10:02:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c16c54ac70 con 0x55c16c4e1a00 2023-09-13T10:02:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b1616eb80 10 client.0 _ll_register_callbacks cb 0x55c16c3cf680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:51.344 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b03fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e2700 0x55c16c4ef400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b02ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4eee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b037fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c43fc80 0x55c16c4f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b02ffd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4eee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51312/0 (socket says 172.21.15.6:51312) 2023-09-13T10:02:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.323+0000 7f4b02ffd700 1 -- 172.21.15.6:0/1832581913 learned_addr learned my addr 172.21.15.6:0/1832581913 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.345 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b03fff700 1 -- 172.21.15.6:0/1832581913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 msgr2=0x55c16c4eee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b03fff700 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4eee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b03fff700 1 -- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c43fc80 msgr2=0x55c16c4f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b03fff700 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c43fc80 0x55c16c4f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b03fff700 1 -- 172.21.15.6:0/1832581913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c16c44b7a0 con 0x55c16c4e2700 2023-09-13T10:02:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c43fc80 0x55c16c4f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:02:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b02ffd700 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:02:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b03fff700 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e2700 0x55c16c4ef400 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0c9110 tx=0x7f4afc009490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad80c4620bb9a97d server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4ae2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1832581913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4afc09cbe0 con 0x55c16c4e2700 2023-09-13T10:02:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1832581913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4afc0a0e20 con 0x55c16c4e2700 2023-09-13T10:02:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4af401b190 con 0x55c16c4e2700 2023-09-13T10:02:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1832581913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4afc099010 con 0x55c16c4e2700 2023-09-13T10:02:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b1616eb80 10 client.21447 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.324+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x55c16c248c60 con 0x55c16c4e2700 2023-09-13T10:02:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1832581913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4af401b190 con 0x55c16c4e2700 2023-09-13T10:02:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1832581913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f4afc0a0990 con 0x55c16c4e2700 2023-09-13T10:02:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4b1616eb80 10 client.21447 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4b1616eb80 10 client.21447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4b1616eb80 20 client.21447 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4e3060 0x55c16c54e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4b1616eb80 4 client.21447 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2023-09-13T10:02:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.325+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c16c3ed050 con 0x55c16c4e3060 2023-09-13T10:02:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.326+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4e3060 0x55c16c54e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.329+0000 7f4ae2ffd700 10 client.21447 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:51.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.329+0000 7f4b037fe700 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4e3060 0x55c16c54e6a0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bef2955bd49011a6 server_cookie=166ba618911ce53b in_seq=0 out_seq=0 2023-09-13T10:02:51.352 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.332+0000 7f4ae2ffd700 1 -- 172.21.15.6:0/1832581913 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c16c3ed050 con 0x55c16c4e3060 2023-09-13T10:02:51.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.332+0000 7f4ae2ffd700 10 client.21447 handle_command_reply: tid=0 2023-09-13T10:02:51.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.333+0000 7f4b1616eb80 1 client.21447 shutdown 2023-09-13T10:02:51.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e2700 msgr2=0x55c16c4ef400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e2700 0x55c16c4ef400 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f4afc0c9110 tx=0x7f4afc009490 comp rx=0 tx=0).stop 2023-09-13T10:02:51.353 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 shutdown_connections 2023-09-13T10:02:51.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x55c16c4e3060 0x55c16c54e6a0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x55c16c4e2700 0x55c16c4ef400 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x55c16c43fc80 0x55c16c4f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 --2- 172.21.15.6:0/1832581913 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55c16c4e1a00 0x55c16c4eee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.354 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4ae2ffd700 0 client.21447 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 >> 172.21.15.6:0/1832581913 conn(0x55c16c4dc240 msgr2=0x55c16c4eac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 shutdown_connections 2023-09-13T10:02:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 1 -- 172.21.15.6:0/1832581913 wait complete. 2023-09-13T10:02:51.355 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.334+0000 7f4b1616eb80 20 client.21447 trim_cache size 0 max 16384 2023-09-13T10:02:51.356 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:02:51.356 INFO:teuthology.orchestra.run.smithi006.stdout: "status": "no active scrubs running", 2023-09-13T10:02:51.356 INFO:teuthology.orchestra.run.smithi006.stdout: "scrubs": {} 2023-09-13T10:02:51.356 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:02:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4aec0a0640 msgr2=0x7f4aec0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4aec0a0640 0x7f4aec0a2b00 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4b04100490 tx=0x7f4af4010040 comp rx=0 tx=0).stop 2023-09-13T10:02:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100fd0 msgr2=0x7f4b04194c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.357 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100fd0 0x7f4b04194c10 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f4afc00c110 tx=0x7f4afc00c420 comp rx=0 tx=0).stop 2023-09-13T10:02:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 shutdown_connections 2023-09-13T10:02:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4aec0a0640 0x7f4aec0a2b00 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4b04100fd0 0x7f4b04194c10 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b040ff440 0x7f4b04196090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 --2- 172.21.15.6:0/2105823547 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4b04100630 0x7f4b041946d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 >> 172.21.15.6:0/2105823547 conn(0x7f4b040fa9b0 msgr2=0x7f4b040fccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 shutdown_connections 2023-09-13T10:02:51.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.335+0000 7f4b09f89700 1 -- 172.21.15.6:0/2105823547 wait complete. 2023-09-13T10:02:51.360 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-09-13T10:02:51.360 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:02:51.511 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 -- 172.21.15.6:0/2592332287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 msgr2=0x7fde84101330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.512 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 --2- 172.21.15.6:0/2592332287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 0x7fde84101330 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fde780098f0 tx=0x7fde78009c00 comp rx=0 tx=0).stop 2023-09-13T10:02:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 -- 172.21.15.6:0/2592332287 shutdown_connections 2023-09-13T10:02:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 --2- 172.21.15.6:0/2592332287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 0x7fde840691c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 --2- 172.21.15.6:0/2592332287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde840ffce0 0x7fde84100100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.513 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 --2- 172.21.15.6:0/2592332287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 0x7fde84101330 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 -- 172.21.15.6:0/2592332287 >> 172.21.15.6:0/2592332287 conn(0x7fde840fb230 msgr2=0x7fde840fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 -- 172.21.15.6:0/2592332287 shutdown_connections 2023-09-13T10:02:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.507+0000 7fde8906a700 1 -- 172.21.15.6:0/2592332287 wait complete. 2023-09-13T10:02:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 Processor -- start 2023-09-13T10:02:51.514 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 -- start start 2023-09-13T10:02:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde840ffce0 0x7fde84196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 0x7fde84196fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 0x7fde8419e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.515 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8419e620 con 0x7fde84101870 2023-09-13T10:02:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8419e760 con 0x7fde840ffce0 2023-09-13T10:02:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.508+0000 7fde8906a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8419e8f0 con 0x7fde84100ed0 2023-09-13T10:02:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 0x7fde8419e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8359e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 0x7fde8419e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48274/0 (socket says 172.21.15.6:48274) 2023-09-13T10:02:51.516 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8359e700 1 -- 172.21.15.6:0/3004692820 learned_addr learned my addr 172.21.15.6:0/3004692820 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8259c700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 0x7fde84196fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde82d9d700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde840ffce0 0x7fde84196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8259c700 1 -- 172.21.15.6:0/3004692820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde840ffce0 msgr2=0x7fde84196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8259c700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde840ffce0 0x7fde84196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.517 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8259c700 1 -- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 msgr2=0x7fde8419e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8259c700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 0x7fde8419e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8259c700 1 -- 172.21.15.6:0/3004692820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde78009520 con 0x7fde84100ed0 2023-09-13T10:02:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8359e700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 0x7fde8419e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8259c700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 0x7fde84196fe0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde78009230 tx=0x7fde7800b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.518 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde6bfff700 1 -- 172.21.15.6:0/3004692820 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7801c070 con 0x7fde84100ed0 2023-09-13T10:02:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde6bfff700 1 -- 172.21.15.6:0/3004692820 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fde7800f860 con 0x7fde84100ed0 2023-09-13T10:02:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8419eb70 con 0x7fde84100ed0 2023-09-13T10:02:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.509+0000 7fde6bfff700 1 -- 172.21.15.6:0/3004692820 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde78003a40 con 0x7fde84100ed0 2023-09-13T10:02:51.519 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.510+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8419ef90 con 0x7fde84100ed0 2023-09-13T10:02:51.520 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.511+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde84108ac0 con 0x7fde84100ed0 2023-09-13T10:02:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.513+0000 7fde6bfff700 1 -- 172.21.15.6:0/3004692820 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fde78020070 con 0x7fde84100ed0 2023-09-13T10:02:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.513+0000 7fde6bfff700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fde6c0a0640 0x7fde6c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.521 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.513+0000 7fde6bfff700 1 -- 172.21.15.6:0/3004692820 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fde780cc840 con 0x7fde84100ed0 2023-09-13T10:02:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.513+0000 7fde82d9d700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fde6c0a0640 0x7fde6c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.514+0000 7fde82d9d700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fde6c0a0640 0x7fde6c0a2b00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fde84100d30 tx=0x7fde7400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.522 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.516+0000 7fde6bfff700 1 -- 172.21.15.6:0/3004692820 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fde78096350 con 0x7fde84100ed0 2023-09-13T10:02:51.608 INFO:tasks.workunit.client.0.smithi006.stdout: 10 390811 33.47 MB/sec execute 491 sec latency 85.109 ms 2023-09-13T10:02:51.792 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.790+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fde8402cfc0 con 0x7fde84100ed0 2023-09-13T10:02:51.793 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.791+0000 7fde6bfff700 1 -- 172.21.15.6:0/3004692820 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+11352 (secure 0 0 0) 0x7fde78099970 con 0x7fde84100ed0 2023-09-13T10:02:51.793 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:02:51.793 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":75,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":75,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T10:02:32.207526+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":369,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:02:51.795 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fde6c0a0640 msgr2=0x7fde6c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fde6c0a0640 0x7fde6c0a2b00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fde84100d30 tx=0x7fde7400b410 comp rx=0 tx=0).stop 2023-09-13T10:02:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 msgr2=0x7fde84196fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 0x7fde84196fe0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fde78009230 tx=0x7fde7800b790 comp rx=0 tx=0).stop 2023-09-13T10:02:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 shutdown_connections 2023-09-13T10:02:51.796 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fde6c0a0640 0x7fde6c0a2b00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fde84101870 0x7fde8419e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fde840ffce0 0x7fde84196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 --2- 172.21.15.6:0/3004692820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde84100ed0 0x7fde84196fe0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 >> 172.21.15.6:0/3004692820 conn(0x7fde840fb230 msgr2=0x7fde840fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.797 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 shutdown_connections 2023-09-13T10:02:51.798 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.794+0000 7fde8906a700 1 -- 172.21.15.6:0/3004692820 wait complete. 2023-09-13T10:02:51.798 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 75 2023-09-13T10:02:51.812 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:4 damage ls 2023-09-13T10:02:51.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 -- 172.21.15.6:0/3138417944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0101f70 msgr2=0x7f80c01023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 --2- 172.21.15.6:0/3138417944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0101f70 0x7f80c01023d0 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7f80b40099c0 tx=0x7f80b4009cd0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.968 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 -- 172.21.15.6:0/3138417944 shutdown_connections 2023-09-13T10:02:51.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 --2- 172.21.15.6:0/3138417944 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c0102910 0x7f80c01091c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 --2- 172.21.15.6:0/3138417944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c0100d80 0x7f80c01011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 --2- 172.21.15.6:0/3138417944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0101f70 0x7f80c01023d0 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 -- 172.21.15.6:0/3138417944 >> 172.21.15.6:0/3138417944 conn(0x7f80c00fc310 msgr2=0x7f80c00fe730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.969 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 -- 172.21.15.6:0/3138417944 shutdown_connections 2023-09-13T10:02:51.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.966+0000 7f80c4f64700 1 -- 172.21.15.6:0/3138417944 wait complete. 2023-09-13T10:02:51.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 Processor -- start 2023-09-13T10:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 -- start start 2023-09-13T10:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c0100d80 0x7f80c0196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c0101f70 0x7f80c0197060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0102910 0x7f80c019e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c019e6a0 con 0x7f80c0102910 2023-09-13T10:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c019e7e0 con 0x7f80c0100d80 2023-09-13T10:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.967+0000 7f80c4f64700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c019e970 con 0x7f80c0101f70 2023-09-13T10:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0102910 0x7f80c019e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0102910 0x7f80c019e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48284/0 (socket says 172.21.15.6:48284) 2023-09-13T10:02:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 -- 172.21.15.6:0/2167284300 learned_addr learned my addr 172.21.15.6:0/2167284300 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bdd9b700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c0101f70 0x7f80c0197060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 -- 172.21.15.6:0/2167284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c0101f70 msgr2=0x7f80c0197060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c0101f70 0x7f80c0197060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 -- 172.21.15.6:0/2167284300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c0100d80 msgr2=0x7f80c0196b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T10:02:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c0100d80 0x7f80c0196b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 -- 172.21.15.6:0/2167284300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40095f0 con 0x7f80c0102910 2023-09-13T10:02:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bdd9b700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c0101f70 0x7f80c0197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T10:02:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80bed9d700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0102910 0x7f80c019e0d0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f80b800b780 tx=0x7f80b800bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80af7fe700 1 -- 172.21.15.6:0/2167284300 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800f840 con 0x7f80c0102910 2023-09-13T10:02:51.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.968+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c019ec50 con 0x7f80c0102910 2023-09-13T10:02:51.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.969+0000 7f80af7fe700 1 -- 172.21.15.6:0/2167284300 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80b800fe60 con 0x7f80c0102910 2023-09-13T10:02:51.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.969+0000 7f80af7fe700 1 -- 172.21.15.6:0/2167284300 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b800d3d0 con 0x7f80c0102910 2023-09-13T10:02:51.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.969+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c019f110 con 0x7f80c0102910 2023-09-13T10:02:51.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.971+0000 7f80af7fe700 1 -- 172.21.15.6:0/2167284300 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f80b800f9a0 con 0x7f80c0102910 2023-09-13T10:02:51.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.972+0000 7f80af7fe700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80a80a0640 0x7f80a80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.983 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.972+0000 7f80be59c700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80a80a0640 0x7f80a80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.972+0000 7f80af7fe700 1 -- 172.21.15.6:0/2167284300 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f80b80cb990 con 0x7f80c0102910 2023-09-13T10:02:51.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.972+0000 7f80be59c700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80a80a0640 0x7f80a80a2b00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f80c0101dd0 tx=0x7f80b0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.973+0000 7f80d1149b80 1 Processor -- start 2023-09-13T10:02:51.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.973+0000 7f80d1149b80 1 -- start start 2023-09-13T10:02:51.984 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece5fb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece60060 0x5612ece5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece5ea00 0x5612ece5ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80d1149b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ecdb7780 con 0x5612ece5ea00 2023-09-13T10:02:51.985 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80d1149b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ecdb50a0 con 0x5612ece5f700 2023-09-13T10:02:51.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80d1149b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ecdb0990 con 0x5612ece60060 2023-09-13T10:02:51.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece5ea00 0x5612ece5ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bdd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece60060 0x5612ece5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece5ea00 0x5612ece5ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48294/0 (socket says 172.21.15.6:48294) 2023-09-13T10:02:51.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 -- 172.21.15.6:0/3106974175 learned_addr learned my addr 172.21.15.6:0/3106974175 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 -- 172.21.15.6:0/3106974175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece60060 msgr2=0x5612ece5e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 --2- 172.21.15.6:0/3106974175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece60060 0x5612ece5e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 -- 172.21.15.6:0/3106974175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 msgr2=0x5612ece5fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 --2- 172.21.15.6:0/3106974175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece5fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 -- 172.21.15.6:0/3106974175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612ecc30630 con 0x5612ece5ea00 2023-09-13T10:02:51.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80bed9d700 1 --2- 172.21.15.6:0/3106974175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece5ea00 0x5612ece5ee80 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009fd0 tx=0x7f80b8099830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdece5771fea51a5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.974+0000 7f80acff9700 1 -- 172.21.15.6:0/3106974175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80a11a0 con 0x5612ece5ea00 2023-09-13T10:02:51.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80acff9700 1 -- 172.21.15.6:0/3106974175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80b809b030 con 0x5612ece5ea00 2023-09-13T10:02:51.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80acff9700 1 -- 172.21.15.6:0/3106974175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80a0d10 con 0x5612ece5ea00 2023-09-13T10:02:51.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80d1149b80 1 -- 172.21.15.6:0/3106974175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece5ea00 msgr2=0x5612ece5ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3106974175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece5ea00 0x5612ece5ee80 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f80b8009fd0 tx=0x7f80b8099830 comp rx=0 tx=0).stop 2023-09-13T10:02:51.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80d1149b80 1 -- 172.21.15.6:0/3106974175 shutdown_connections 2023-09-13T10:02:51.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3106974175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece5ea00 0x5612ece5ee80 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3106974175 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece5fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3106974175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece60060 0x5612ece5e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.975+0000 7f80d1149b80 1 -- 172.21.15.6:0/3106974175 >> 172.21.15.6:0/3106974175 conn(0x5612ecdbcc80 msgr2=0x5612ece58f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:51.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 -- 172.21.15.6:0/3106974175 shutdown_connections 2023-09-13T10:02:51.990 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 -- 172.21.15.6:0/3106974175 wait complete. 2023-09-13T10:02:51.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 -- start start 2023-09-13T10:02:51.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 Processor -- start 2023-09-13T10:02:51.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece67f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece684b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ecd4ebb0 con 0x5612ece60060 2023-09-13T10:02:51.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ecd4e8b0 con 0x5612ece5f700 2023-09-13T10:02:51.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ecc32920 con 0x5612ece5ea00 2023-09-13T10:02:51.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80d1149b80 10 client.0 _ll_register_callbacks cb 0x5612ecd4c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:51.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48298/0 (socket says 172.21.15.6:48298) 2023-09-13T10:02:51.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80be59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece67f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.976+0000 7f80bed9d700 1 -- 172.21.15.6:0/3572480148 learned_addr learned my addr 172.21.15.6:0/3572480148 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:51.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80bed9d700 1 -- 172.21.15.6:0/3572480148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 msgr2=0x5612ece67f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80bed9d700 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece67f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80bed9d700 1 -- 172.21.15.6:0/3572480148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 msgr2=0x5612ece684b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80bed9d700 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece684b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80bed9d700 1 -- 172.21.15.6:0/3572480148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c019f110 con 0x5612ece60060 2023-09-13T10:02:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80bed9d700 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6f4f0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f80b80992f0 tx=0x7f80b8095500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84f9ed7054eb965 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:51.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80a5ffb700 1 -- 172.21.15.6:0/3572480148 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80a0d10 con 0x5612ece60060 2023-09-13T10:02:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80a5ffb700 1 -- 172.21.15.6:0/3572480148 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f80b80a0e70 con 0x5612ece60060 2023-09-13T10:02:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5612ece51670 con 0x5612ece60060 2023-09-13T10:02:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80a5ffb700 1 -- 172.21.15.6:0/3572480148 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80b80b1220 con 0x5612ece60060 2023-09-13T10:02:51.995 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80d1149b80 10 client.21465 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:51.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x5612ecdc87a0 con 0x5612ece60060 2023-09-13T10:02:51.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.977+0000 7f80a5ffb700 1 -- 172.21.15.6:0/3572480148 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5612ece51670 con 0x5612ece60060 2023-09-13T10:02:51.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80a5ffb700 1 -- 172.21.15.6:0/3572480148 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f80b809dca0 con 0x5612ece60060 2023-09-13T10:02:51.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80d1149b80 10 client.21465 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:51.996 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80d1149b80 10 client.21465 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:02:51.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80d1149b80 20 client.21465 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:51.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ece739b0 0x5612ece75dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:51.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80d1149b80 4 client.21465 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:51.997 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5612ecda9970 con 0x5612ece739b0 2023-09-13T10:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80be59c700 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ece739b0 0x5612ece75dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80a5ffb700 10 client.21465 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.978+0000 7f80be59c700 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ece739b0 0x5612ece75dd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=34d7aa272269ddc6 server_cookie=b25594ead7f4110c in_seq=0 out_seq=0 2023-09-13T10:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80a5ffb700 1 -- 172.21.15.6:0/3572480148 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5612ecda9970 con 0x5612ece739b0 2023-09-13T10:02:51.998 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80a5ffb700 10 client.21465 handle_command_reply: tid=0 2023-09-13T10:02:51.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 client.21465 shutdown 2023-09-13T10:02:51.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 msgr2=0x5612ece6f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:51.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6f4f0 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f80b80992f0 tx=0x7f80b8095500 comp rx=0 tx=0).stop 2023-09-13T10:02:51.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 shutdown_connections 2023-09-13T10:02:51.999 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ece739b0 0x5612ece75dd0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6f4f0 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80a5ffb700 0 client.21465 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece67f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 --2- 172.21.15.6:0/3572480148 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece684b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.000 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 >> 172.21.15.6:0/3572480148 conn(0x5612ecdbcc80 msgr2=0x5612ece537f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 shutdown_connections 2023-09-13T10:02:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 1 -- 172.21.15.6:0/3572480148 wait complete. 2023-09-13T10:02:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.980+0000 7f80d1149b80 20 client.21465 trim_cache size 0 max 16384 2023-09-13T10:02:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 Processor -- start 2023-09-13T10:02:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 -- start start 2023-09-13T10:02:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece5e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece6f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece65e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ece67ae0 con 0x5612ece60060 2023-09-13T10:02:52.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ece558e0 con 0x5612ece5f700 2023-09-13T10:02:52.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80d1149b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ece5aa10 con 0x5612ece5ea00 2023-09-13T10:02:52.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80be59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece5e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80bdd9b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece6f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80be59c700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece5e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51358/0 (socket says 172.21.15.6:51358) 2023-09-13T10:02:52.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80be59c700 1 -- 172.21.15.6:0/1646197806 learned_addr learned my addr 172.21.15.6:0/1646197806 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:51.999+0000 7f80bed9d700 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece65e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80be59c700 1 -- 172.21.15.6:0/1646197806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 msgr2=0x5612ece6f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80be59c700 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece6f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80be59c700 1 -- 172.21.15.6:0/1646197806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 msgr2=0x5612ece65e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80be59c700 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece65e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80be59c700 1 -- 172.21.15.6:0/1646197806 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5612ecbdcde0 con 0x5612ece5ea00 2023-09-13T10:02:52.010 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80be59c700 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece5e4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5612ece766b0 tx=0x7f80b0011000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57e500e417a84ea9 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80ad7fa700 1 -- 172.21.15.6:0/1646197806 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0022040 con 0x5612ece5ea00 2023-09-13T10:02:52.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80ad7fa700 1 -- 172.21.15.6:0/1646197806 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80b0009760 con 0x5612ece5ea00 2023-09-13T10:02:52.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.000+0000 7f80ad7fa700 1 -- 172.21.15.6:0/1646197806 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b00109f0 con 0x5612ece5ea00 2023-09-13T10:02:52.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 -- 172.21.15.6:0/1646197806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 msgr2=0x5612ece5e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece5e4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5612ece766b0 tx=0x7f80b0011000 comp rx=0 tx=0).stop 2023-09-13T10:02:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 -- 172.21.15.6:0/1646197806 shutdown_connections 2023-09-13T10:02:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece65e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5ea00 0x5612ece5e4c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.012 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 --2- 172.21.15.6:0/1646197806 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5f700 0x5612ece6f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 -- 172.21.15.6:0/1646197806 >> 172.21.15.6:0/1646197806 conn(0x5612ecdbcc80 msgr2=0x5612ece58e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 -- 172.21.15.6:0/1646197806 shutdown_connections 2023-09-13T10:02:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 -- 172.21.15.6:0/1646197806 wait complete. 2023-09-13T10:02:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.001+0000 7f80d1149b80 1 -- start start 2023-09-13T10:02:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 1 Processor -- start 2023-09-13T10:02:52.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5ea00 0x5612ece6b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5f700 0x5612ece6bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ece6eef0 con 0x5612ece60060 2023-09-13T10:02:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ece6f060 con 0x5612ece5ea00 2023-09-13T10:02:52.014 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5612ece6f1d0 con 0x5612ece5f700 2023-09-13T10:02:52.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80d1149b80 10 client.0 _ll_register_callbacks cb 0x5612ecd4c680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:52.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48314/0 (socket says 172.21.15.6:48314) 2023-09-13T10:02:52.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 -- 172.21.15.6:0/93058157 learned_addr learned my addr 172.21.15.6:0/93058157 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.015 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bdd9b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5f700 0x5612ece6bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80be59c700 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5ea00 0x5612ece6b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 -- 172.21.15.6:0/93058157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5f700 msgr2=0x5612ece6bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5f700 0x5612ece6bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 -- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5ea00 msgr2=0x5612ece6b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5ea00 0x5612ece6b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bed9d700 1 -- 172.21.15.6:0/93058157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b000eb40 con 0x5612ece60060 2023-09-13T10:02:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.002+0000 7f80bdd9b700 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5f700 0x5612ece6bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80bed9d700 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6e9b0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f80b80990c0 tx=0x7f80b8098340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce195e3a8e90904e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.017 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80a5ffb700 1 -- 172.21.15.6:0/93058157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8098410 con 0x5612ece60060 2023-09-13T10:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80a5ffb700 1 -- 172.21.15.6:0/93058157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f80b80a0f20 con 0x5612ece60060 2023-09-13T10:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f80b809b030 con 0x5612ece60060 2023-09-13T10:02:52.018 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80a5ffb700 1 -- 172.21.15.6:0/93058157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f80b8098620 con 0x5612ece60060 2023-09-13T10:02:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 10 client.21471 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x5612ecbc5c60 con 0x5612ece60060 2023-09-13T10:02:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80a5ffb700 1 -- 172.21.15.6:0/93058157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f80b809b030 con 0x5612ece60060 2023-09-13T10:02:52.019 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80a5ffb700 1 -- 172.21.15.6:0/93058157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f80b8094f20 con 0x5612ece60060 2023-09-13T10:02:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 10 client.21471 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 10 client.21471 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.e 2023-09-13T10:02:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 20 client.21471 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ecec8360 0x5612ececa750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.020 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 4 client.21471 mds_command: new command op to 24455 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.003+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 --> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5612ecd6a050 con 0x5612ecec8360 2023-09-13T10:02:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.004+0000 7f80be59c700 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ecec8360 0x5612ececa750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.004+0000 7f80a5ffb700 10 client.21471 ms_handle_connect on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:52.021 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.004+0000 7f80be59c700 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ecec8360 0x5612ececa750 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=2e4f5cd87f7452e2 server_cookie=4834e974f2c3ab7c in_seq=0 out_seq=0 2023-09-13T10:02:52.022 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80a5ffb700 1 -- 172.21.15.6:0/93058157 <== mds.4 v2:172.21.15.53:6834/460375736 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5612ecd6a050 con 0x5612ecec8360 2023-09-13T10:02:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80a5ffb700 10 client.21471 handle_command_reply: tid=0 2023-09-13T10:02:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 client.21471 shutdown 2023-09-13T10:02:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 msgr2=0x5612ece6e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6e9b0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f80b80990c0 tx=0x7f80b8098340 comp rx=0 tx=0).stop 2023-09-13T10:02:52.023 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 shutdown_connections 2023-09-13T10:02:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:6834/460375736,v1:172.21.15.53:6835/460375736] conn(0x5612ecec8360 0x5612ececa750 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5612ece60060 0x5612ece6e9b0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80a5ffb700 0 client.21471 ms_handle_reset on v2:172.21.15.53:6834/460375736 2023-09-13T10:02:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5612ece5ea00 0x5612ece6b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 --2- 172.21.15.6:0/93058157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5612ece5f700 0x5612ece6bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.024 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 >> 172.21.15.6:0/93058157 conn(0x5612ecdbcc80 msgr2=0x5612ece65e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 shutdown_connections 2023-09-13T10:02:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 1 -- 172.21.15.6:0/93058157 wait complete. 2023-09-13T10:02:52.025 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.006+0000 7f80d1149b80 20 client.21471 trim_cache size 0 max 16384 2023-09-13T10:02:52.025 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:52.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80a80a0640 msgr2=0x7f80a80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80a80a0640 0x7f80a80a2b00 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f80c0101dd0 tx=0x7f80b0009260 comp rx=0 tx=0).stop 2023-09-13T10:02:52.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0102910 msgr2=0x7f80c019e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.027 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0102910 0x7f80c019e0d0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7f80b800b780 tx=0x7f80b800bb40 comp rx=0 tx=0).stop 2023-09-13T10:02:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 shutdown_connections 2023-09-13T10:02:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f80a80a0640 0x7f80a80a2b00 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80c0102910 0x7f80c019e0d0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.028 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f80c0100d80 0x7f80c0196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 --2- 172.21.15.6:0/2167284300 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c0101f70 0x7f80c0197060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 >> 172.21.15.6:0/2167284300 conn(0x7f80c00fc310 msgr2=0x7f80c00fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 shutdown_connections 2023-09-13T10:02:52.029 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.007+0000 7f80c4f64700 1 -- 172.21.15.6:0/2167284300 wait complete. 2023-09-13T10:02:52.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:3 damage ls 2023-09-13T10:02:52.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 -- 172.21.15.6:0/61269019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00ffcc0 msgr2=0x7ff8d01000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 --2- 172.21.15.6:0/61269019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00ffcc0 0x7ff8d01000e0 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0099c0 tx=0x7ff8cc009cd0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.173 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 -- 172.21.15.6:0/61269019 shutdown_connections 2023-09-13T10:02:52.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 --2- 172.21.15.6:0/61269019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8d0101850 0x7ff8d0108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 --2- 172.21.15.6:0/61269019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d00ffcc0 0x7ff8d01000e0 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.174 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 --2- 172.21.15.6:0/61269019 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d0100eb0 0x7ff8d0101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 -- 172.21.15.6:0/61269019 >> 172.21.15.6:0/61269019 conn(0x7ff8d00fb250 msgr2=0x7ff8d00fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 -- 172.21.15.6:0/61269019 shutdown_connections 2023-09-13T10:02:52.175 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.171+0000 7ff8d781b700 1 -- 172.21.15.6:0/61269019 wait complete. 2023-09-13T10:02:52.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 Processor -- start 2023-09-13T10:02:52.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 -- start start 2023-09-13T10:02:52.177 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d00ffcc0 0x7ff8d0068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0100eb0 0x7ff8d019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8d0101850 0x7ff8d019de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d019e5a0 con 0x7ff8d0100eb0 2023-09-13T10:02:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0195590 con 0x7ff8d00ffcc0 2023-09-13T10:02:52.178 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d781b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d0195750 con 0x7ff8d0101850 2023-09-13T10:02:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d4db6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0100eb0 0x7ff8d019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d4db6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0100eb0 0x7ff8d019b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48324/0 (socket says 172.21.15.6:48324) 2023-09-13T10:02:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d4db6700 1 -- 172.21.15.6:0/2809846388 learned_addr learned my addr 172.21.15.6:0/2809846388 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.172+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8d0101850 0x7ff8d019de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.179 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d4db6700 1 -- 172.21.15.6:0/2809846388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8d0101850 msgr2=0x7ff8d019de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d4db6700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8d0101850 0x7ff8d019de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d4db6700 1 -- 172.21.15.6:0/2809846388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d00ffcc0 msgr2=0x7ff8d0068b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d4db6700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d00ffcc0 0x7ff8d0068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d4db6700 1 -- 172.21.15.6:0/2809846388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0095f0 con 0x7ff8d0100eb0 2023-09-13T10:02:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d4db6700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0100eb0 0x7ff8d019b7c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000e9a0 tx=0x7ff8c000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.180 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8c67fc700 1 -- 172.21.15.6:0/2809846388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0009790 con 0x7ff8d0100eb0 2023-09-13T10:02:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d0195a30 con 0x7ff8d0100eb0 2023-09-13T10:02:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8c67fc700 1 -- 172.21.15.6:0/2809846388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8c000cbd0 con 0x7ff8d0100eb0 2023-09-13T10:02:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8c67fc700 1 -- 172.21.15.6:0/2809846388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0018680 con 0x7ff8d0100eb0 2023-09-13T10:02:52.181 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.173+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d0195f90 con 0x7ff8d0100eb0 2023-09-13T10:02:52.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.176+0000 7ff8c67fc700 1 -- 172.21.15.6:0/2809846388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff8c000cd40 con 0x7ff8d0100eb0 2023-09-13T10:02:52.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.177+0000 7ff8c67fc700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8bc0a0640 0x7ff8bc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.188 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.177+0000 7ff8c67fc700 1 -- 172.21.15.6:0/2809846388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff8c0014070 con 0x7ff8d0100eb0 2023-09-13T10:02:52.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.177+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8bc0a0640 0x7ff8bc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.177+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8bc0a0640 0x7ff8bc0a2b00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0058e0 tx=0x7ff8cc000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.177+0000 7ff8e3a00b80 1 Processor -- start 2023-09-13T10:02:52.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8e3a00b80 1 -- start start 2023-09-13T10:02:52.189 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f54b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f55060 0x563140f534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f53a00 0x563140f53e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140eac780 con 0x563140f54700 2023-09-13T10:02:52.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140eaa0a0 con 0x563140f55060 2023-09-13T10:02:52.190 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140ea5990 con 0x563140f53a00 2023-09-13T10:02:52.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d55b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f54b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d55b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f54b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48332/0 (socket says 172.21.15.6:48332) 2023-09-13T10:02:52.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d55b7700 1 -- 172.21.15.6:0/392509531 learned_addr learned my addr 172.21.15.6:0/392509531 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f53a00 0x563140f53e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.191 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d4db6700 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f55060 0x563140f534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d5db8700 1 -- 172.21.15.6:0/392509531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f55060 msgr2=0x563140f534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f55060 0x563140f534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d5db8700 1 -- 172.21.15.6:0/392509531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 msgr2=0x563140f54b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f54b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.192 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.178+0000 7ff8d5db8700 1 -- 172.21.15.6:0/392509531 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563140d25630 con 0x563140f53a00 2023-09-13T10:02:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.179+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f53a00 0x563140f53e80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8011580 tx=0x7ff8c8009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b93ecef5b0128051 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.179+0000 7ff8bb7fe700 1 -- 172.21.15.6:0/392509531 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800e040 con 0x563140f53a00 2023-09-13T10:02:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.179+0000 7ff8bb7fe700 1 -- 172.21.15.6:0/392509531 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8c800f040 con 0x563140f53a00 2023-09-13T10:02:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.179+0000 7ff8bb7fe700 1 -- 172.21.15.6:0/392509531 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c80043f0 con 0x563140f53a00 2023-09-13T10:02:52.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/392509531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f53a00 msgr2=0x563140f53e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f53a00 0x563140f53e80 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8011580 tx=0x7ff8c8009920 comp rx=0 tx=0).stop 2023-09-13T10:02:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/392509531 shutdown_connections 2023-09-13T10:02:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f53a00 0x563140f53e80 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f54b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/392509531 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f55060 0x563140f534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/392509531 >> 172.21.15.6:0/392509531 conn(0x563140eb1c80 msgr2=0x563140f4df10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/392509531 shutdown_connections 2023-09-13T10:02:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/392509531 wait complete. 2023-09-13T10:02:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 -- start start 2023-09-13T10:02:52.195 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.180+0000 7ff8e3a00b80 1 Processor -- start 2023-09-13T10:02:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f53a00 0x563140f5cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f5d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140e43bb0 con 0x563140f54700 2023-09-13T10:02:52.196 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140e438b0 con 0x563140f53a00 2023-09-13T10:02:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140d27920 con 0x563140f55060 2023-09-13T10:02:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8e3a00b80 10 client.0 _ll_register_callbacks cb 0x563140e41680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d55b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f53a00 0x563140f5cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d5db8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d55b7700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f53a00 0x563140f5cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41862/0 (socket says 172.21.15.6:41862) 2023-09-13T10:02:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d55b7700 1 -- 172.21.15.6:0/1842218363 learned_addr learned my addr 172.21.15.6:0/1842218363 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d5db8700 1 -- 172.21.15.6:0/1842218363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f53a00 msgr2=0x563140f5cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f53a00 0x563140f5cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d5db8700 1 -- 172.21.15.6:0/1842218363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 msgr2=0x563140f5d440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:02:52.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f5d440 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d5db8700 1 -- 172.21.15.6:0/1842218363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c8011230 con 0x563140f55060 2023-09-13T10:02:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.181+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f53a00 0x563140f5cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000f80 tx=0x7ff8c8011ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fbe402467d3970a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2023-09-13T10:02:52.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/1842218363 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800e040 con 0x563140f55060 2023-09-13T10:02:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/1842218363 <== mon.1 v2:172.21.15.131:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff8c8003d80 con 0x563140f55060 2023-09-13T10:02:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563140f46670 con 0x563140f55060 2023-09-13T10:02:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/1842218363 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8c80041b0 con 0x563140f55060 2023-09-13T10:02:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8e3a00b80 10 client.30673 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:52.200 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x563140ebd7a0 con 0x563140f55060 2023-09-13T10:02:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/1842218363 <== mon.1 v2:172.21.15.131:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x563140f46670 con 0x563140f55060 2023-09-13T10:02:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/1842218363 <== mon.1 v2:172.21.15.131:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff8c801b020 con 0x563140f55060 2023-09-13T10:02:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8e3a00b80 10 client.30673 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.182+0000 7ff8e3a00b80 10 client.30673 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:02:52.201 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.183+0000 7ff8e3a00b80 20 client.30673 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.183+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140f68db0 0x563140f6b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.183+0000 7ff8e3a00b80 4 client.30673 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.183+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563140e9e970 con 0x563140f68db0 2023-09-13T10:02:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.183+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140f68db0 0x563140f6b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.183+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140f68db0 0x563140f6b1d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=45aa68ba56dccf1 server_cookie=81ca6bdd19b7958f in_seq=0 out_seq=0 2023-09-13T10:02:52.202 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.183+0000 7ff8b8ff9700 10 client.30673 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/1842218363 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x563140e9e970 con 0x563140f68db0 2023-09-13T10:02:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8b8ff9700 10 client.30673 handle_command_reply: tid=0 2023-09-13T10:02:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 client.30673 shutdown 2023-09-13T10:02:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 msgr2=0x563140f64480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.203 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64480 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8000f80 tx=0x7ff8c8011ef0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 shutdown_connections 2023-09-13T10:02:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140f68db0 0x563140f6b1d0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64480 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f53a00 0x563140f5cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.204 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8b8ff9700 0 client.30673 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/1842218363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f54700 0x563140f5d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 >> 172.21.15.6:0/1842218363 conn(0x563140eb1c80 msgr2=0x563140f4dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 shutdown_connections 2023-09-13T10:02:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.184+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/1842218363 wait complete. 2023-09-13T10:02:52.205 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.185+0000 7ff8e3a00b80 20 client.30673 trim_cache size 0 max 16384 2023-09-13T10:02:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 Processor -- start 2023-09-13T10:02:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 -- start start 2023-09-13T10:02:52.210 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f534c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f643a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140f50000 con 0x563140f53a00 2023-09-13T10:02:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140f660f0 con 0x563140f54700 2023-09-13T10:02:52.211 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.207+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140f4f760 con 0x563140f55060 2023-09-13T10:02:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d55b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d5db8700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d55b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f534c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48344/0 (socket says 172.21.15.6:48344) 2023-09-13T10:02:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d4db6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.212 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d55b7700 1 -- 172.21.15.6:0/942711876 learned_addr learned my addr 172.21.15.6:0/942711876 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d5db8700 1 -- 172.21.15.6:0/942711876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 msgr2=0x563140f643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d5db8700 1 -- 172.21.15.6:0/942711876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 msgr2=0x563140f534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f534c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.213 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d5db8700 1 -- 172.21.15.6:0/942711876 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563140cd1de0 con 0x563140f55060 2023-09-13T10:02:52.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:52.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8007be0 tx=0x7ff8c8009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfad7fddd098f5b0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.208+0000 7ff8bbfff700 1 -- 172.21.15.6:0/942711876 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8007700 con 0x563140f55060 2023-09-13T10:02:52.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8bbfff700 1 -- 172.21.15.6:0/942711876 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8c802c030 con 0x563140f55060 2023-09-13T10:02:52.214 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8bbfff700 1 -- 172.21.15.6:0/942711876 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8027ce0 con 0x563140f55060 2023-09-13T10:02:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/942711876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 msgr2=0x563140f64d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64d70 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8007be0 tx=0x7ff8c8009570 comp rx=0 tx=0).stop 2023-09-13T10:02:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/942711876 shutdown_connections 2023-09-13T10:02:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f64d70 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/942711876 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/942711876 >> 172.21.15.6:0/942711876 conn(0x563140eb1c80 msgr2=0x563140f5bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/942711876 shutdown_connections 2023-09-13T10:02:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.209+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/942711876 wait complete. 2023-09-13T10:02:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 -- start start 2023-09-13T10:02:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 Processor -- start 2023-09-13T10:02:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f5fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f60370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f63390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140f638d0 con 0x563140f53a00 2023-09-13T10:02:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140f63a40 con 0x563140f54700 2023-09-13T10:02:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x563140f63c00 con 0x563140f55060 2023-09-13T10:02:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.210+0000 7ff8e3a00b80 10 client.0 _ll_register_callbacks cb 0x563140e41680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f60370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.222 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d55b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f5fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f60370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41876/0 (socket says 172.21.15.6:41876) 2023-09-13T10:02:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 -- 172.21.15.6:0/576453930 learned_addr learned my addr 172.21.15.6:0/576453930 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f63390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 -- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 msgr2=0x563140f63390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f63390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 -- 172.21.15.6:0/576453930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 msgr2=0x563140f5fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f5fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 -- 172.21.15.6:0/576453930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d0108a50 con 0x563140f54700 2023-09-13T10:02:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f5fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d5db8700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f63390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:52.224 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8d4db6700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f60370 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0099350 tx=0x7ff8c0095270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20d8f564844a018b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:02:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/576453930 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c0082ea0 con 0x563140f54700 2023-09-13T10:02:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/576453930 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff8c0099650 con 0x563140f54700 2023-09-13T10:02:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.211+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8c800f040 con 0x563140f54700 2023-09-13T10:02:52.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/576453930 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8c009d480 con 0x563140f54700 2023-09-13T10:02:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 10 client.30653 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x563140ebd7a0 con 0x563140f54700 2023-09-13T10:02:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/576453930 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff8c0063080 con 0x563140f54700 2023-09-13T10:02:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/576453930 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7ff8c00840b0 con 0x563140f54700 2023-09-13T10:02:52.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 10 client.30653 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 10 client.30653 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.c 2023-09-13T10:02:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 20 client.30653 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140fbda00 0x563140fbfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 4 client.30653 mds_command: new command op to 24466 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:52.227 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 --> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563140e5f050 con 0x563140fbda00 2023-09-13T10:02:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.212+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140fbda00 0x563140fbfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8d55b7700 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140fbda00 0x563140fbfe20 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2a26783c5ea66586 server_cookie=749dd6dc7a94b11a in_seq=0 out_seq=0 2023-09-13T10:02:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8b8ff9700 10 client.30653 ms_handle_connect on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8b8ff9700 1 -- 172.21.15.6:0/576453930 <== mds.3 v2:172.21.15.131:6836/687345485 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563140e5f050 con 0x563140fbda00 2023-09-13T10:02:52.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8b8ff9700 10 client.30653 handle_command_reply: tid=0 2023-09-13T10:02:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 client.30653 shutdown 2023-09-13T10:02:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 msgr2=0x563140f60370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f60370 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0099350 tx=0x7ff8c0095270 comp rx=0 tx=0).stop 2023-09-13T10:02:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 shutdown_connections 2023-09-13T10:02:52.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:6836/687345485,v1:172.21.15.131:6837/687345485] conn(0x563140fbda00 0x563140fbfe20 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x563140f55060 0x563140f63390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8b8ff9700 0 client.30653 ms_handle_reset on v2:172.21.15.131:6836/687345485 2023-09-13T10:02:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x563140f53a00 0x563140f5fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 --2- 172.21.15.6:0/576453930 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x563140f54700 0x563140f60370 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 >> 172.21.15.6:0/576453930 conn(0x563140eb1c80 msgr2=0x563140f5ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 shutdown_connections 2023-09-13T10:02:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.213+0000 7ff8e3a00b80 1 -- 172.21.15.6:0/576453930 wait complete. 2023-09-13T10:02:52.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8e3a00b80 20 client.30653 trim_cache size 0 max 16384 2023-09-13T10:02:52.231 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8bc0a0640 msgr2=0x7ff8bc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8bc0a0640 0x7ff8bc0a2b00 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0058e0 tx=0x7ff8cc000bc0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0100eb0 msgr2=0x7ff8d019b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.233 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0100eb0 0x7ff8d019b7c0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7ff8c000e9a0 tx=0x7ff8c000ecb0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 shutdown_connections 2023-09-13T10:02:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8d0101850 0x7ff8d019de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff8d00ffcc0 0x7ff8d0068b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8bc0a0640 0x7ff8bc0a2b00 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.234 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 --2- 172.21.15.6:0/2809846388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8d0100eb0 0x7ff8d019b7c0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 >> 172.21.15.6:0/2809846388 conn(0x7ff8d00fb250 msgr2=0x7ff8d01043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 shutdown_connections 2023-09-13T10:02:52.235 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.214+0000 7ff8d781b700 1 -- 172.21.15.6:0/2809846388 wait complete. 2023-09-13T10:02:52.235 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-09-13T10:02:52.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:52 smithi053 ceph-mon[102373]: pgmap v1000: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 431 op/s 2023-09-13T10:02:52.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:52 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3004692820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:02:52.510 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:52 smithi006 ceph-mon[98665]: pgmap v1000: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 431 op/s 2023-09-13T10:02:52.511 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:52 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3004692820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:02:52.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:52 smithi131 ceph-mon[102785]: pgmap v1000: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.2 MiB/s wr, 431 op/s 2023-09-13T10:02:52.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:52 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3004692820' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:02:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.572+0000 7f298270b700 1 -- 172.21.15.6:0/979029287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 msgr2=0x7f297c07a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.572+0000 7f298270b700 1 --2- 172.21.15.6:0/979029287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c07a950 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7f296c008580 tx=0x7f296c00ac60 comp rx=0 tx=0).stop 2023-09-13T10:02:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.593+0000 7f298270b700 1 -- 172.21.15.6:0/979029287 shutdown_connections 2023-09-13T10:02:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.593+0000 7f298270b700 1 --2- 172.21.15.6:0/979029287 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c07a950 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.593+0000 7f298270b700 1 --2- 172.21.15.6:0/979029287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f297c072c10 0x7f297c073030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.602 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.593+0000 7f298270b700 1 --2- 172.21.15.6:0/979029287 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f297c075af0 0x7f297c077f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.603 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.593+0000 7f298270b700 1 -- 172.21.15.6:0/979029287 >> 172.21.15.6:0/979029287 conn(0x7f297c06dc70 msgr2=0x7f297c0700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 391137 33.43 MB/sec execute 492 sec latency 369.538 ms 2023-09-13T10:02:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.612+0000 7f298270b700 1 -- 172.21.15.6:0/979029287 shutdown_connections 2023-09-13T10:02:52.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.613+0000 7f298270b700 1 -- 172.21.15.6:0/979029287 wait complete. 2023-09-13T10:02:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.613+0000 7f298270b700 1 Processor -- start 2023-09-13T10:02:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.613+0000 7f298270b700 1 -- start start 2023-09-13T10:02:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.614+0000 7f298270b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f297c072c10 0x7f297c1b09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.614+0000 7f298270b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f297c075af0 0x7f297c1b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.614+0000 7f298270b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c1b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.614+0000 7f298270b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c1b5aa0 con 0x7f297c0784c0 2023-09-13T10:02:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.614+0000 7f298270b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c1b5c10 con 0x7f297c075af0 2023-09-13T10:02:52.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.614+0000 7f298270b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f297c1b5dd0 con 0x7f297c072c10 2023-09-13T10:02:52.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.615+0000 7f2980ca8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c1b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.615+0000 7f2980ca8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c1b5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48366/0 (socket says 172.21.15.6:48366) 2023-09-13T10:02:52.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.615+0000 7f2980ca8700 1 -- 172.21.15.6:0/185549747 learned_addr learned my addr 172.21.15.6:0/185549747 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.625+0000 7f297b7fe700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f297c075af0 0x7f297c1b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.625+0000 7f297bfff700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f297c072c10 0x7f297c1b09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.625+0000 7f2980ca8700 1 -- 172.21.15.6:0/185549747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f297c072c10 msgr2=0x7f297c1b09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.625+0000 7f2980ca8700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f297c072c10 0x7f297c1b09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.625+0000 7f2980ca8700 1 -- 172.21.15.6:0/185549747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f297c075af0 msgr2=0x7f297c1b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.628 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.625+0000 7f2980ca8700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f297c075af0 0x7f297c1b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.625+0000 7f2980ca8700 1 -- 172.21.15.6:0/185549747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c008230 con 0x7f297c0784c0 2023-09-13T10:02:52.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.641+0000 7f2980ca8700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c1b5480 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f296c00af30 tx=0x7f296c00a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.645+0000 7f29797fa700 1 -- 172.21.15.6:0/185549747 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c00bc60 con 0x7f297c0784c0 2023-09-13T10:02:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.645+0000 7f29797fa700 1 -- 172.21.15.6:0/185549747 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f296c023070 con 0x7f297c0784c0 2023-09-13T10:02:52.647 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.645+0000 7f29797fa700 1 -- 172.21.15.6:0/185549747 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f296c005400 con 0x7f297c0784c0 2023-09-13T10:02:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.646+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f297c1b6050 con 0x7f297c0784c0 2023-09-13T10:02:52.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.646+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297c1b6480 con 0x7f297c0784c0 2023-09-13T10:02:52.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 Processor -- start 2023-09-13T10:02:52.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 -- start start 2023-09-13T10:02:52.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef43330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 0x559efef41cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42210 0x559efef42670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efee92780 con 0x559efef42f10 2023-09-13T10:02:52.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efee900a0 con 0x559efef43870 2023-09-13T10:02:52.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.652+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efee8b990 con 0x559efef42210 2023-09-13T10:02:52.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.655+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef43330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.655+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef43330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48370/0 (socket says 172.21.15.6:48370) 2023-09-13T10:02:52.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.655+0000 7f297b7fe700 1 -- 172.21.15.6:0/1135090418 learned_addr learned my addr 172.21.15.6:0/1135090418 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.657+0000 7f29797fa700 1 -- 172.21.15.6:0/185549747 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f296c025030 con 0x7f297c0784c0 2023-09-13T10:02:52.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.658+0000 7f29797fa700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f29640a0840 0x7f29640a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.658+0000 7f29797fa700 1 -- 172.21.15.6:0/185549747 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f296c0cc4c0 con 0x7f297c0784c0 2023-09-13T10:02:52.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.659+0000 7f297b7fe700 1 -- 172.21.15.6:0/1135090418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42210 msgr2=0x559efef42670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.659+0000 7f297b7fe700 1 --2- 172.21.15.6:0/1135090418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42210 0x559efef42670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.659+0000 7f297b7fe700 1 -- 172.21.15.6:0/1135090418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 msgr2=0x559efef41cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.659+0000 7f297b7fe700 1 --2- 172.21.15.6:0/1135090418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 0x559efef41cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.659+0000 7f297b7fe700 1 -- 172.21.15.6:0/1135090418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559efed0b630 con 0x559efef42f10 2023-09-13T10:02:52.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.660+0000 7f297b7fe700 1 --2- 172.21.15.6:0/1135090418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef43330 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f297000bf00 tx=0x7f2970009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d33c1f5ad37b530 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.661+0000 7f29627fc700 1 -- 172.21.15.6:0/1135090418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970016410 con 0x559efef42f10 2023-09-13T10:02:52.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.661+0000 7f29627fc700 1 -- 172.21.15.6:0/1135090418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2970011050 con 0x559efef42f10 2023-09-13T10:02:52.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.661+0000 7f29627fc700 1 -- 172.21.15.6:0/1135090418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970015810 con 0x559efef42f10 2023-09-13T10:02:52.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.662+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1135090418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 msgr2=0x559efef43330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.662+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1135090418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef43330 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f297000bf00 tx=0x7f2970009520 comp rx=0 tx=0).stop 2023-09-13T10:02:52.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.667+0000 7f2980ca8700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f29640a0840 0x7f29640a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.673 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.668+0000 7f2980ca8700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f29640a0840 0x7f29640a2d00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f296c096820 tx=0x7f296c00ae00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1135090418 shutdown_connections 2023-09-13T10:02:52.675 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1135090418 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42210 0x559efef42670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1135090418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef43330 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1135090418 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 0x559efef41cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1135090418 >> 172.21.15.6:0/1135090418 conn(0x559efee97c80 msgr2=0x559efef33f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1135090418 shutdown_connections 2023-09-13T10:02:52.676 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1135090418 wait complete. 2023-09-13T10:02:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.674+0000 7f298e8f0b80 1 -- start start 2023-09-13T10:02:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 1 Processor -- start 2023-09-13T10:02:52.678 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef3b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 0x559efef3b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 0x559efef40790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efee29bb0 con 0x559efef42210 2023-09-13T10:02:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efee298b0 con 0x559efef43870 2023-09-13T10:02:52.679 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efed0d920 con 0x559efef42f10 2023-09-13T10:02:52.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f298e8f0b80 10 client.0 _ll_register_callbacks cb 0x559efee27680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:52.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef3b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef3b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48378/0 (socket says 172.21.15.6:48378) 2023-09-13T10:02:52.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.675+0000 7f297b7fe700 1 -- 172.21.15.6:0/505428171 learned_addr learned my addr 172.21.15.6:0/505428171 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.680 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f297b7fe700 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 0x559efef40790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f297b7fe700 1 -- 172.21.15.6:0/505428171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 msgr2=0x559efef3b760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:02:52.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f297b7fe700 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 0x559efef3b760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f297b7fe700 1 -- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 msgr2=0x559efef40790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.681 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f297b7fe700 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 0x559efef40790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f297b7fe700 1 -- 172.21.15.6:0/505428171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f297000bbb0 con 0x559efef42210 2023-09-13T10:02:52.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f297b7fe700 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef3b220 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f2970005c80 tx=0x7f297000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ab6bbcc9b2a4a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.682 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.676+0000 7f295b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.677+0000 7f295b7fe700 1 -- 172.21.15.6:0/505428171 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970016b40 con 0x559efef42210 2023-09-13T10:02:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.677+0000 7f295b7fe700 1 -- 172.21.15.6:0/505428171 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2970016ca0 con 0x559efef42210 2023-09-13T10:02:52.683 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.677+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559efef2c670 con 0x559efef42210 2023-09-13T10:02:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.696+0000 7f295b7fe700 1 -- 172.21.15.6:0/505428171 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2970004030 con 0x559efef42210 2023-09-13T10:02:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.698+0000 7f298e8f0b80 10 client.21498 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:52.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.698+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x559efeea37a0 con 0x559efef42210 2023-09-13T10:02:52.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f295b7fe700 1 -- 172.21.15.6:0/505428171 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559efef2c670 con 0x559efef42210 2023-09-13T10:02:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f295b7fe700 1 -- 172.21.15.6:0/505428171 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f2970015590 con 0x559efef42210 2023-09-13T10:02:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f298e8f0b80 10 client.21498 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f298e8f0b80 10 client.21498 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:02:52.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f298e8f0b80 20 client.21498 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:52.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efef5fca0 0x559efef620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f298e8f0b80 4 client.21498 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:52.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.716+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559efee84970 con 0x559efef5fca0 2023-09-13T10:02:52.740 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.738+0000 7f297bfff700 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efef5fca0 0x559efef620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.787+0000 7f295b7fe700 10 client.21498 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:52.789 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.787+0000 7f297bfff700 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efef5fca0 0x559efef620c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5a1b53e0080898b server_cookie=a82208e70467816d in_seq=0 out_seq=0 2023-09-13T10:02:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.826+0000 7f295b7fe700 1 -- 172.21.15.6:0/505428171 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559efee84970 con 0x559efef5fca0 2023-09-13T10:02:52.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.826+0000 7f295b7fe700 10 client.21498 handle_command_reply: tid=0 2023-09-13T10:02:52.832 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.830+0000 7f298e8f0b80 1 client.21498 shutdown 2023-09-13T10:02:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.838+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 msgr2=0x559efef3b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.840 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.838+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef3b220 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f2970005c80 tx=0x7f297000d040 comp rx=0 tx=0).stop 2023-09-13T10:02:52.846 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 shutdown_connections 2023-09-13T10:02:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efef5fca0 0x559efef620c0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef43870 0x559efef40790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef3b220 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.847 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/505428171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 0x559efef3b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 >> 172.21.15.6:0/505428171 conn(0x559efee97c80 msgr2=0x559efef2e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f295b7fe700 0 client.21498 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 shutdown_connections 2023-09-13T10:02:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 1 -- 172.21.15.6:0/505428171 wait complete. 2023-09-13T10:02:52.848 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.845+0000 7f298e8f0b80 20 client.21498 trim_cache size 0 max 16384 2023-09-13T10:02:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.870+0000 7f298e8f0b80 1 Processor -- start 2023-09-13T10:02:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.870+0000 7f298e8f0b80 1 -- start start 2023-09-13T10:02:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.870+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef42210 0x559efef432f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.874 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef6f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef43870 0x559efef46690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efef5f7f0 con 0x559efef42f10 2023-09-13T10:02:52.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efef308e0 con 0x559efef42210 2023-09-13T10:02:52.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efef35350 con 0x559efef43870 2023-09-13T10:02:52.875 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef43870 0x559efef46690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef43870 0x559efef46690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51442/0 (socket says 172.21.15.6:51442) 2023-09-13T10:02:52.876 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.871+0000 7f297b7fe700 1 -- 172.21.15.6:0/513884315 learned_addr learned my addr 172.21.15.6:0/513884315 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.878 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.873+0000 7f297bfff700 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef6f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.880+0000 7f297b7fe700 1 -- 172.21.15.6:0/513884315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef42210 msgr2=0x559efef432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.880+0000 7f297b7fe700 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef42210 0x559efef432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.880+0000 7f297b7fe700 1 -- 172.21.15.6:0/513884315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 msgr2=0x559efef6f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.880+0000 7f297b7fe700 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef6f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.882 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.880+0000 7f297b7fe700 1 -- 172.21.15.6:0/513884315 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559efecb7de0 con 0x559efef43870 2023-09-13T10:02:52.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.882+0000 7f297b7fe700 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef43870 0x559efef46690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f297000beb0 tx=0x7f2970000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f133ebb34ac731 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.894+0000 7f2962ffd700 1 -- 172.21.15.6:0/513884315 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970015570 con 0x559efef43870 2023-09-13T10:02:52.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.894+0000 7f2962ffd700 1 -- 172.21.15.6:0/513884315 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2970015ef0 con 0x559efef43870 2023-09-13T10:02:52.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.894+0000 7f2962ffd700 1 -- 172.21.15.6:0/513884315 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970004030 con 0x559efef43870 2023-09-13T10:02:52.897 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.895+0000 7f298e8f0b80 1 -- 172.21.15.6:0/513884315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef43870 msgr2=0x559efef46690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.895+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef43870 0x559efef46690 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f297000beb0 tx=0x7f2970000bc0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.895+0000 7f298e8f0b80 1 -- 172.21.15.6:0/513884315 shutdown_connections 2023-09-13T10:02:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.895+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef43870 0x559efef46690 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f297000beb0 tx=0x7f2970000bc0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.898 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.895+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef42210 0x559efef432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.895+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/513884315 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42f10 0x559efef6f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.899 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.895+0000 7f298e8f0b80 1 -- 172.21.15.6:0/513884315 >> 172.21.15.6:0/513884315 conn(0x559efee97c80 msgr2=0x559efef33e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:52.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.909+0000 7f298e8f0b80 1 -- 172.21.15.6:0/513884315 shutdown_connections 2023-09-13T10:02:52.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.911+0000 7f298e8f0b80 1 -- 172.21.15.6:0/513884315 wait complete. 2023-09-13T10:02:52.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.911+0000 7f298e8f0b80 1 -- start start 2023-09-13T10:02:52.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 1 Processor -- start 2023-09-13T10:02:52.916 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef6e260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 0x559efef6e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef6ece0 0x559efefb21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efefb2730 con 0x559efef42210 2023-09-13T10:02:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efefb2870 con 0x559efef6ece0 2023-09-13T10:02:52.917 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x559efefb2a00 con 0x559efef42f10 2023-09-13T10:02:52.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.912+0000 7f298e8f0b80 10 client.0 _ll_register_callbacks cb 0x559efee27680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:52.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.914+0000 7f297bfff700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 0x559efef6e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.918 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.914+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef6ece0 0x559efefb21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.920+0000 7f297b7fe700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef6ece0 0x559efefb21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41918/0 (socket says 172.21.15.6:41918) 2023-09-13T10:02:52.921 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.920+0000 7f297b7fe700 1 -- 172.21.15.6:0/1125974168 learned_addr learned my addr 172.21.15.6:0/1125974168 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:52.922 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.920+0000 7f297b7fe700 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef6e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.922+0000 7f297b7fe700 1 -- 172.21.15.6:0/1125974168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 msgr2=0x559efef6e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.922+0000 7f297b7fe700 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 0x559efef6e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.922+0000 7f297b7fe700 1 -- 172.21.15.6:0/1125974168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef6ece0 msgr2=0x559efefb21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.922+0000 7f297b7fe700 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef6ece0 0x559efefb21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:52.924 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.922+0000 7f297b7fe700 1 -- 172.21.15.6:0/1125974168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559efeea37a0 con 0x559efef42210 2023-09-13T10:02:52.925 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.923+0000 7f297b7fe700 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef6e260 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f297003c040 tx=0x7f2970009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6458a51a5ebd7a server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.923+0000 7f295b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.923+0000 7f295b7fe700 1 -- 172.21.15.6:0/1125974168 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2970015570 con 0x559efef42210 2023-09-13T10:02:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.923+0000 7f295b7fe700 1 -- 172.21.15.6:0/1125974168 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f29700156d0 con 0x559efef42210 2023-09-13T10:02:52.926 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.923+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559efee45050 con 0x559efef42210 2023-09-13T10:02:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.924+0000 7f295b7fe700 1 -- 172.21.15.6:0/1125974168 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2970004030 con 0x559efef42210 2023-09-13T10:02:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.925+0000 7f298e8f0b80 10 client.21504 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:52.927 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.925+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x559efeca0c60 con 0x559efef42210 2023-09-13T10:02:52.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.933+0000 7f295b7fe700 1 -- 172.21.15.6:0/1125974168 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x559efee45050 con 0x559efef42210 2023-09-13T10:02:52.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.933+0000 7f295b7fe700 1 -- 172.21.15.6:0/1125974168 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f297004f470 con 0x559efef42210 2023-09-13T10:02:52.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.934+0000 7f298e8f0b80 10 client.21504 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:52.936 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.934+0000 7f298e8f0b80 10 client.21504 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-09-13T10:02:52.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.934+0000 7f298e8f0b80 20 client.21504 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:52.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.934+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efefb3e10 0x559efefb6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:52.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.934+0000 7f298e8f0b80 4 client.21504 mds_command: new command op to 24482 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:52.937 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.934+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 --> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x559efecd8f70 con 0x559efefb3e10 2023-09-13T10:02:52.945 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.944+0000 7f297bfff700 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efefb3e10 0x559efefb6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:52.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.972+0000 7f297bfff700 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efefb3e10 0x559efefb6200 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bb51432cbae03f57 server_cookie=3036e72508277473 in_seq=0 out_seq=0 2023-09-13T10:02:52.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:52.974+0000 7f295b7fe700 10 client.21504 ms_handle_connect on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:53.001 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.000+0000 7f295b7fe700 1 -- 172.21.15.6:0/1125974168 <== mds.2 v2:172.21.15.53:6836/1211463882 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+1167 (crc 0 0 0) 0x559efecd8f70 con 0x559efefb3e10 2023-09-13T10:02:53.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.000+0000 7f295b7fe700 10 client.21504 handle_command_reply: tid=0 2023-09-13T10:02:53.002 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.000+0000 7f298e8f0b80 1 client.21504 shutdown 2023-09-13T10:02:53.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 msgr2=0x559efef6e260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef6e260 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f297003c040 tx=0x7f2970009520 comp rx=0 tx=0).stop 2023-09-13T10:02:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 shutdown_connections 2023-09-13T10:02:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.53:6836/1211463882,v1:172.21.15.53:6837/1211463882] conn(0x559efefb3e10 0x559efefb6200 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x559efef6ece0 0x559efefb21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x559efef42210 0x559efef6e260 secure :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f297003c040 tx=0x7f2970009520 comp rx=0 tx=0).stop 2023-09-13T10:02:53.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 --2- 172.21.15.6:0/1125974168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x559efef42f10 0x559efef6e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.009 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.004+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 >> 172.21.15.6:0/1125974168 conn(0x559efee97c80 msgr2=0x559efef46690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.009+0000 7f295b7fe700 0 client.21504 ms_handle_reset on v2:172.21.15.53:6836/1211463882 2023-09-13T10:02:53.011 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.010+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 shutdown_connections 2023-09-13T10:02:53.013 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.012+0000 7f298e8f0b80 1 -- 172.21.15.6:0/1125974168 wait complete. 2023-09-13T10:02:53.016 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.015+0000 7f298e8f0b80 20 client.21504 trim_cache size 0 max 16384 2023-09-13T10:02:53.017 INFO:teuthology.orchestra.run.smithi006.stdout:[ 2023-09-13T10:02:53.017 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:02:53.017 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-09-13T10:02:53.018 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 579024295, 2023-09-13T10:02:53.018 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3298534889822, 2023-09-13T10:02:53.018 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/SALES.XLS" 2023-09-13T10:02:53.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:02:53.018 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:02:53.019 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-09-13T10:02:53.019 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 846908525, 2023-09-13T10:02:53.019 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3298534889813, 2023-09-13T10:02:53.019 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/PCMAGCD.XLS" 2023-09-13T10:02:53.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:02:53.020 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:02:53.020 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-09-13T10:02:53.021 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 2230955380, 2023-09-13T10:02:53.022 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3298534890113, 2023-09-13T10:02:53.022 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/EVENTS.DOC" 2023-09-13T10:02:53.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:02:53.023 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:02:53.023 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-09-13T10:02:53.023 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 2490734392, 2023-09-13T10:02:53.024 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3298534890125, 2023-09-13T10:02:53.024 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/MOVED.DOC" 2023-09-13T10:02:53.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:02:53.024 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:02:53.024 INFO:teuthology.orchestra.run.smithi006.stdout: "damage_type": "backtrace", 2023-09-13T10:02:53.025 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 3671277100, 2023-09-13T10:02:53.025 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 3298534890104, 2023-09-13T10:02:53.025 INFO:teuthology.orchestra.run.smithi006.stdout: "path": "/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/T1.XLS" 2023-09-13T10:02:53.025 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:02:53.025 INFO:teuthology.orchestra.run.smithi006.stdout:] 2023-09-13T10:02:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.027+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f29640a0840 msgr2=0x7f29640a2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.027+0000 7f298270b700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f29640a0840 0x7f29640a2d00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f296c096820 tx=0x7f296c00ae00 comp rx=0 tx=0).stop 2023-09-13T10:02:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.027+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 msgr2=0x7f297c1b5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.028+0000 7f298270b700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c1b5480 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f296c00af30 tx=0x7f296c00a2a0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.029+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 shutdown_connections 2023-09-13T10:02:53.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.029+0000 7f298270b700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f29640a0840 0x7f29640a2d00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.029+0000 7f298270b700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f297c0784c0 0x7f297c1b5480 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.029+0000 7f298270b700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f297c072c10 0x7f297c1b09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.029+0000 7f298270b700 1 --2- 172.21.15.6:0/185549747 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f297c075af0 0x7f297c1b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.029+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 >> 172.21.15.6:0/185549747 conn(0x7f297c06dc70 msgr2=0x7f297c077310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.034 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.032+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 shutdown_connections 2023-09-13T10:02:53.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.032+0000 7f298270b700 1 -- 172.21.15.6:0/185549747 wait complete. 2023-09-13T10:02:53.071 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-09-13T10:02:53.322 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.320+0000 7f86efbc0700 1 -- 172.21.15.6:0/1981953470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e8108dc0 msgr2=0x7f86e810b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.323 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.320+0000 7f86efbc0700 1 --2- 172.21.15.6:0/1981953470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e8108dc0 0x7f86e810b1b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f86e000b0a0 tx=0x7f86e000b3b0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.326+0000 7f86efbc0700 1 -- 172.21.15.6:0/1981953470 shutdown_connections 2023-09-13T10:02:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.326+0000 7f86efbc0700 1 --2- 172.21.15.6:0/1981953470 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e810e130 0x7f86e81105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.326+0000 7f86efbc0700 1 --2- 172.21.15.6:0/1981953470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e8108dc0 0x7f86e810b1b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.326+0000 7f86efbc0700 1 --2- 172.21.15.6:0/1981953470 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 0x7f86e810dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.333 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.326+0000 7f86efbc0700 1 -- 172.21.15.6:0/1981953470 >> 172.21.15.6:0/1981953470 conn(0x7f86e806dc70 msgr2=0x7f86e80700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.334 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.333+0000 7f86efbc0700 1 -- 172.21.15.6:0/1981953470 shutdown_connections 2023-09-13T10:02:53.336 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.334+0000 7f86efbc0700 1 -- 172.21.15.6:0/1981953470 wait complete. 2023-09-13T10:02:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.335+0000 7f86efbc0700 1 Processor -- start 2023-09-13T10:02:53.337 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.335+0000 7f86efbc0700 1 -- start start 2023-09-13T10:02:53.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.335+0000 7f86efbc0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e8108dc0 0x7f86e819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.335+0000 7f86efbc0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 0x7f86e819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86efbc0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e810e130 0x7f86e81a68d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.338 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86efbc0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e81a6ea0 con 0x7f86e810b6f0 2023-09-13T10:02:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86efbc0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e8111030 con 0x7f86e810e130 2023-09-13T10:02:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86efbc0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e81111c0 con 0x7f86e8108dc0 2023-09-13T10:02:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 0x7f86e819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.339 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 0x7f86e819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48406/0 (socket says 172.21.15.6:48406) 2023-09-13T10:02:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 -- 172.21.15.6:0/2568931765 learned_addr learned my addr 172.21.15.6:0/2568931765 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 -- 172.21.15.6:0/2568931765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e8108dc0 msgr2=0x7f86e819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e8108dc0 0x7f86e819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 -- 172.21.15.6:0/2568931765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e810e130 msgr2=0x7f86e81a68d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.340 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e810e130 0x7f86e81a68d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.341 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.336+0000 7f86ed15b700 1 -- 172.21.15.6:0/2568931765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009d00 con 0x7f86e810b6f0 2023-09-13T10:02:53.342 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.340+0000 7f86ed15b700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 0x7f86e819f860 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f86d8007f10 tx=0x7f86d8009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.350 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.349+0000 7f86deffd700 1 -- 172.21.15.6:0/2568931765 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8018070 con 0x7f86e810b6f0 2023-09-13T10:02:53.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.349+0000 7f86deffd700 1 -- 172.21.15.6:0/2568931765 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86d8013e10 con 0x7f86e810b6f0 2023-09-13T10:02:53.351 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.349+0000 7f86deffd700 1 -- 172.21.15.6:0/2568931765 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8005020 con 0x7f86e810b6f0 2023-09-13T10:02:53.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.350+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e81114a0 con 0x7f86e810b6f0 2023-09-13T10:02:53.356 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.350+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e8111930 con 0x7f86e810b6f0 2023-09-13T10:02:53.358 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.356+0000 7f86deffd700 1 -- 172.21.15.6:0/2568931765 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f86d801c070 con 0x7f86e810b6f0 2023-09-13T10:02:53.359 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.358+0000 7f86deffd700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86d40a07c0 0x7f86d40a2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.358+0000 7f86deffd700 1 -- 172.21.15.6:0/2568931765 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f86d80d31e0 con 0x7f86e810b6f0 2023-09-13T10:02:53.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 Processor -- start 2023-09-13T10:02:53.361 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 -- start start 2023-09-13T10:02:53.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d67388b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673874c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d67387e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d672e0780 con 0x558d67388700 2023-09-13T10:02:53.362 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d672de0a0 con 0x558d67387a00 2023-09-13T10:02:53.363 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d672d9990 con 0x558d67389060 2023-09-13T10:02:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86ed95c700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86d40a07c0 0x7f86d40a2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.365 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.360+0000 7f86ed95c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d67388b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ed95c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d67388b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48414/0 (socket says 172.21.15.6:48414) 2023-09-13T10:02:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ed95c700 1 -- 172.21.15.6:0/2958584457 learned_addr learned my addr 172.21.15.6:0/2958584457 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ee15d700 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d67387e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ed15b700 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673874c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.366 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ee15d700 1 -- 172.21.15.6:0/2958584457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 msgr2=0x558d673874c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ee15d700 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673874c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ee15d700 1 -- 172.21.15.6:0/2958584457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 msgr2=0x558d67388b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ee15d700 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d67388b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ee15d700 1 -- 172.21.15.6:0/2958584457 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d67159630 con 0x558d67387a00 2023-09-13T10:02:53.367 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.361+0000 7f86ee15d700 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d67387e80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b9b0 tx=0x7f86e400bcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=617b97d9ec6fdd9b server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.362+0000 7f86d3fff700 1 -- 172.21.15.6:0/2958584457 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4004220 con 0x558d67387a00 2023-09-13T10:02:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.362+0000 7f86d3fff700 1 -- 172.21.15.6:0/2958584457 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86e400be50 con 0x558d67387a00 2023-09-13T10:02:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.362+0000 7f86d3fff700 1 -- 172.21.15.6:0/2958584457 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400dc90 con 0x558d67387a00 2023-09-13T10:02:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 -- 172.21.15.6:0/2958584457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 msgr2=0x558d67387e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d67387e80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b9b0 tx=0x7f86e400bcc0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86ed95c700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86d40a07c0 0x7f86d40a2c80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86e0007fd0 tx=0x7f86e0007d70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 -- 172.21.15.6:0/2958584457 shutdown_connections 2023-09-13T10:02:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d67387e80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d67388b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/2958584457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673874c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 -- 172.21.15.6:0/2958584457 >> 172.21.15.6:0/2958584457 conn(0x558d672e5c80 msgr2=0x558d67381f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 -- 172.21.15.6:0/2958584457 shutdown_connections 2023-09-13T10:02:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.363+0000 7f86fbda5b80 1 -- 172.21.15.6:0/2958584457 wait complete. 2023-09-13T10:02:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 -- start start 2023-09-13T10:02:53.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 Processor -- start 2023-09-13T10:02:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d673a1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.371 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673a9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d67277bb0 con 0x558d67388700 2023-09-13T10:02:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d672778b0 con 0x558d67387a00 2023-09-13T10:02:53.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d6715b920 con 0x558d67389060 2023-09-13T10:02:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.364+0000 7f86fbda5b80 10 client.0 _ll_register_callbacks cb 0x558d67275680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d673a1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d673a1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41944/0 (socket says 172.21.15.6:41944) 2023-09-13T10:02:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 -- 172.21.15.6:0/1204832573 learned_addr learned my addr 172.21.15.6:0/1204832573 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ee15d700 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673a9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 -- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 msgr2=0x558d673a9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673a9470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 -- 172.21.15.6:0/1204832573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 msgr2=0x558d673a2430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-13T10:02:53.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a2430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.365+0000 7f86ed95c700 1 -- 172.21.15.6:0/1204832573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e400b610 con 0x558d67387a00 2023-09-13T10:02:53.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.366+0000 7f86ed95c700 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d673a1ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f86e0015000 tx=0x7f86e0022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7e3133faa7d4413e server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.366+0000 7f86d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.53:3300/0 2023-09-13T10:02:53.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.368+0000 7f86d17fa700 1 -- 172.21.15.6:0/1204832573 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e000e040 con 0x558d67387a00 2023-09-13T10:02:53.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.368+0000 7f86d17fa700 1 -- 172.21.15.6:0/1204832573 <== mon.2 v2:172.21.15.53:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f86e0007de0 con 0x558d67387a00 2023-09-13T10:02:53.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.368+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d6737a670 con 0x558d67387a00 2023-09-13T10:02:53.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.369+0000 7f86d17fa700 1 -- 172.21.15.6:0/1204832573 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86e001fe70 con 0x558d67387a00 2023-09-13T10:02:53.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.375+0000 7f86fbda5b80 10 client.30674 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:53.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.375+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x558d672f17a0 con 0x558d67387a00 2023-09-13T10:02:53.383 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.381+0000 7f86d17fa700 1 -- 172.21.15.6:0/1204832573 <== mon.2 v2:172.21.15.53:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86e003a020 con 0x558d67387a00 2023-09-13T10:02:53.391 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.388+0000 7f86d17fa700 1 -- 172.21.15.6:0/1204832573 <== mon.2 v2:172.21.15.53:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f86e002a070 con 0x558d67387a00 2023-09-13T10:02:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.388+0000 7f86fbda5b80 10 client.30674 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:53.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.388+0000 7f86fbda5b80 10 client.30674 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:02:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.388+0000 7f86fbda5b80 20 client.30674 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.389+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d673add70 0x558d673b0190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.389+0000 7f86fbda5b80 4 client.30674 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.389+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d672d2970 con 0x558d673add70 2023-09-13T10:02:53.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.389+0000 7f86ed15b700 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d673add70 0x558d673b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.389+0000 7f86d17fa700 10 client.30674 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:53.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.389+0000 7f86ed15b700 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d673add70 0x558d673b0190 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4cfb93fcfdab748 server_cookie=61f20594a8d24723 in_seq=0 out_seq=0 2023-09-13T10:02:53.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.390+0000 7f86d17fa700 1 -- 172.21.15.6:0/1204832573 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558d672d2970 con 0x558d673add70 2023-09-13T10:02:53.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.390+0000 7f86d17fa700 10 client.30674 handle_command_reply: tid=0 2023-09-13T10:02:53.395 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.390+0000 7f86fbda5b80 1 client.30674 shutdown 2023-09-13T10:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 msgr2=0x558d673a1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d673a1ef0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f86e0015000 tx=0x7f86e0022040 comp rx=0 tx=0).stop 2023-09-13T10:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 shutdown_connections 2023-09-13T10:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d673add70 0x558d673b0190 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d67389060 0x558d673a9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67387a00 0x558d673a1ef0 secure :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f86e0015000 tx=0x7f86e0022040 comp rx=0 tx=0).stop 2023-09-13T10:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1204832573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a2430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 >> 172.21.15.6:0/1204832573 conn(0x558d672e5c80 msgr2=0x558d67381ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86d17fa700 0 client.30674 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:53.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 shutdown_connections 2023-09-13T10:02:53.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1204832573 wait complete. 2023-09-13T10:02:53.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.393+0000 7f86fbda5b80 20 client.30674 trim_cache size 0 max 16384 2023-09-13T10:02:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 Processor -- start 2023-09-13T10:02:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 -- start start 2023-09-13T10:02:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67388700 0x558d673874c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67389060 0x558d673a9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d6738bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d673a1ac0 con 0x558d67389060 2023-09-13T10:02:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d67383fd0 con 0x558d67388700 2023-09-13T10:02:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d673ab0e0 con 0x558d6738b8a0 2023-09-13T10:02:53.420 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86ee15d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d6738bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86ee15d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d6738bd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51480/0 (socket says 172.21.15.6:51480) 2023-09-13T10:02:53.421 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.416+0000 7f86ee15d700 1 -- 172.21.15.6:0/4250093393 learned_addr learned my addr 172.21.15.6:0/4250093393 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.422 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.417+0000 7f86ee15d700 1 -- 172.21.15.6:0/4250093393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67388700 msgr2=0x558d673874c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.417+0000 7f86ee15d700 1 --2- 172.21.15.6:0/4250093393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67388700 0x558d673874c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.417+0000 7f86ee15d700 1 -- 172.21.15.6:0/4250093393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67389060 msgr2=0x558d673a9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.417+0000 7f86ee15d700 1 --2- 172.21.15.6:0/4250093393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67389060 0x558d673a9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.423 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.417+0000 7f86ee15d700 1 -- 172.21.15.6:0/4250093393 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d673b4dc0 con 0x558d6738b8a0 2023-09-13T10:02:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.420+0000 7f86ee15d700 1 --2- 172.21.15.6:0/4250093393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d6738bd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b3c0 tx=0x7f86e4005ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c603d7f734b6ab5 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.421+0000 7f86dcd82700 1 -- 172.21.15.6:0/4250093393 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4004300 con 0x558d6738b8a0 2023-09-13T10:02:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.421+0000 7f86dcd82700 1 -- 172.21.15.6:0/4250093393 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86e401e070 con 0x558d6738b8a0 2023-09-13T10:02:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.421+0000 7f86dcd82700 1 -- 172.21.15.6:0/4250093393 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e4003be0 con 0x558d6738b8a0 2023-09-13T10:02:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 -- 172.21.15.6:0/4250093393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 msgr2=0x558d6738bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/4250093393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d6738bd20 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f86e400b3c0 tx=0x7f86e4005ee0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 -- 172.21.15.6:0/4250093393 shutdown_connections 2023-09-13T10:02:53.427 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/4250093393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d6738bd20 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/4250093393 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67388700 0x558d673874c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/4250093393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67389060 0x558d673a9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 -- 172.21.15.6:0/4250093393 >> 172.21.15.6:0/4250093393 conn(0x558d672e5c80 msgr2=0x558d673a9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 -- 172.21.15.6:0/4250093393 shutdown_connections 2023-09-13T10:02:53.428 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 -- 172.21.15.6:0/4250093393 wait complete. 2023-09-13T10:02:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 -- start start 2023-09-13T10:02:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.422+0000 7f86fbda5b80 1 Processor -- start 2023-09-13T10:02:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67389060 0x558d673a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86fbda5b80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d673a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.429 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d673a68b0 con 0x558d67388700 2023-09-13T10:02:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d673a96a0 con 0x558d67389060 2023-09-13T10:02:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86fbda5b80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d673a9830 con 0x558d6738b8a0 2023-09-13T10:02:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86fbda5b80 10 client.0 _ll_register_callbacks cb 0x558d67275680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86ed95c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86ed95c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48432/0 (socket says 172.21.15.6:48432) 2023-09-13T10:02:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.423+0000 7f86ed95c700 1 -- 172.21.15.6:0/1142256000 learned_addr learned my addr 172.21.15.6:0/1142256000 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86ed95c700 1 -- 172.21.15.6:0/1142256000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 msgr2=0x558d673a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86ed95c700 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d673a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86ed95c700 1 -- 172.21.15.6:0/1142256000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67389060 msgr2=0x558d673a5c90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-09-13T10:02:53.431 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86ed95c700 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67389060 0x558d673a5c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86ed95c700 1 -- 172.21.15.6:0/1142256000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d67159630 con 0x558d67388700 2023-09-13T10:02:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86ed95c700 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a9020 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f86e001fab0 tx=0x7f86e002b750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a490268d5577e80 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86d17fa700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:53.433 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86d17fa700 1 -- 172.21.15.6:0/1142256000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e0003c00 con 0x558d67388700 2023-09-13T10:02:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86d17fa700 1 -- 172.21.15.6:0/1142256000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f86e003b080 con 0x558d67388700 2023-09-13T10:02:53.433 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f86e400be50 con 0x558d67388700 2023-09-13T10:02:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86d17fa700 1 -- 172.21.15.6:0/1142256000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f86e002b950 con 0x558d67388700 2023-09-13T10:02:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86fbda5b80 10 client.21516 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.424+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x558d67105de0 con 0x558d67388700 2023-09-13T10:02:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.425+0000 7f86d17fa700 1 -- 172.21.15.6:0/1142256000 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86e400be50 con 0x558d67388700 2023-09-13T10:02:53.434 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.426+0000 7f86d17fa700 1 -- 172.21.15.6:0/1142256000 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f86e0036650 con 0x558d67388700 2023-09-13T10:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.426+0000 7f86fbda5b80 10 client.21516 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.426+0000 7f86fbda5b80 10 client.21516 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-09-13T10:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.426+0000 7f86fbda5b80 20 client.21516 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.426+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d67403160 0x558d67405620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.435 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.426+0000 7f86fbda5b80 4 client.21516 mds_command: new command op to 24484 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.426+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 --> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x558d67293050 con 0x558d67403160 2023-09-13T10:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.428+0000 7f86ed15b700 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d67403160 0x558d67405620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.429+0000 7f86d17fa700 10 client.21516 ms_handle_connect on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.429+0000 7f86ed15b700 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d67403160 0x558d67405620 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e5ae92c5b9953b52 server_cookie=20fb65b72db8b107 in_seq=0 out_seq=0 2023-09-13T10:02:53.436 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86d17fa700 1 -- 172.21.15.6:0/1142256000 <== mds.1 v2:172.21.15.131:6838/381550019 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558d67293050 con 0x558d67403160 2023-09-13T10:02:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86d17fa700 10 client.21516 handle_command_reply: tid=0 2023-09-13T10:02:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 client.21516 shutdown 2023-09-13T10:02:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 msgr2=0x558d673a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.437 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a9020 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7f86e001fab0 tx=0x7f86e002b750 comp rx=0 tx=0).stop 2023-09-13T10:02:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 shutdown_connections 2023-09-13T10:02:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.131:6838/381550019,v1:172.21.15.131:6839/381550019] conn(0x558d67403160 0x558d67405620 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x558d6738b8a0 0x558d673a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x558d67388700 0x558d673a9020 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.438 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 --2- 172.21.15.6:0/1142256000 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x558d67389060 0x558d673a5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 >> 172.21.15.6:0/1142256000 conn(0x558d672e5c80 msgr2=0x558d673a1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86d17fa700 0 client.21516 ms_handle_reset on v2:172.21.15.131:6838/381550019 2023-09-13T10:02:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 shutdown_connections 2023-09-13T10:02:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 1 -- 172.21.15.6:0/1142256000 wait complete. 2023-09-13T10:02:53.439 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.430+0000 7f86fbda5b80 20 client.21516 trim_cache size 0 max 16384 2023-09-13T10:02:53.440 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.434+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86d40a07c0 msgr2=0x7f86d40a2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.434+0000 7f86efbc0700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86d40a07c0 0x7f86d40a2c80 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f86e0007fd0 tx=0x7f86e0007d70 comp rx=0 tx=0).stop 2023-09-13T10:02:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.434+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 msgr2=0x7f86e819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.434+0000 7f86efbc0700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 0x7f86e819f860 secure :-1 s=READY pgs=1978 cs=0 l=1 rev1=1 crypto rx=0x7f86d8007f10 tx=0x7f86d8009520 comp rx=0 tx=0).stop 2023-09-13T10:02:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 shutdown_connections 2023-09-13T10:02:53.441 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86e810e130 0x7f86e81a68d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86e8108dc0 0x7f86e819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86d40a07c0 0x7f86d40a2c80 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 --2- 172.21.15.6:0/2568931765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86e810b6f0 0x7f86e819f860 unknown :-1 s=CLOSED pgs=1978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.442 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 >> 172.21.15.6:0/2568931765 conn(0x7f86e806dc70 msgr2=0x7f86e810a760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 shutdown_connections 2023-09-13T10:02:53.443 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.437+0000 7f86efbc0700 1 -- 172.21.15.6:0/2568931765 wait complete. 2023-09-13T10:02:53.456 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-09-13T10:02:53.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 391151 33.36 MB/sec execute 493 sec latency 1088.758 ms 2023-09-13T10:02:53.623 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.622+0000 7f5ae4846700 1 -- 172.21.15.6:0/2029364337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ae0072c10 msgr2=0x7f5ae0073030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.622+0000 7f5ae4846700 1 --2- 172.21.15.6:0/2029364337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ae0072c10 0x7f5ae0073030 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000b0a0 tx=0x7f5ad000b3b0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.622+0000 7f5ae4846700 1 -- 172.21.15.6:0/2029364337 shutdown_connections 2023-09-13T10:02:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.622+0000 7f5ae4846700 1 --2- 172.21.15.6:0/2029364337 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ae00784c0 0x7f5ae007a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.624 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.622+0000 7f5ae4846700 1 --2- 172.21.15.6:0/2029364337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ae0072c10 0x7f5ae0073030 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.622+0000 7f5ae4846700 1 --2- 172.21.15.6:0/2029364337 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae0075af0 0x7f5ae0077f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.625 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.622+0000 7f5ae4846700 1 -- 172.21.15.6:0/2029364337 >> 172.21.15.6:0/2029364337 conn(0x7f5ae006dc70 msgr2=0x7f5ae00700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.624+0000 7f5ae4846700 1 -- 172.21.15.6:0/2029364337 shutdown_connections 2023-09-13T10:02:53.626 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.624+0000 7f5ae4846700 1 -- 172.21.15.6:0/2029364337 wait complete. 2023-09-13T10:02:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 Processor -- start 2023-09-13T10:02:53.627 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 -- start start 2023-09-13T10:02:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ae0072c10 0x7f5ae01b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ae0075af0 0x7f5ae01b2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.629 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae00784c0 0x7f5ae01b9c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01ba230 con 0x7f5ae0075af0 2023-09-13T10:02:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01ba370 con 0x7f5ae0072c10 2023-09-13T10:02:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ae4846700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae01ba500 con 0x7f5ae00784c0 2023-09-13T10:02:53.630 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5aded9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae00784c0 0x7f5ae01b9c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5aded9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae00784c0 0x7f5ae01b9c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51500/0 (socket says 172.21.15.6:51500) 2023-09-13T10:02:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5aded9d700 1 -- 172.21.15.6:0/1992793263 learned_addr learned my addr 172.21.15.6:0/1992793263 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.625+0000 7f5ade59c700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ae0072c10 0x7f5ae01b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.631 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.626+0000 7f5ade59c700 1 -- 172.21.15.6:0/1992793263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae00784c0 msgr2=0x7f5ae01b9c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.626+0000 7f5ade59c700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae00784c0 0x7f5ae01b9c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.626+0000 7f5ade59c700 1 -- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ae0075af0 msgr2=0x7f5ae01b2bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-09-13T10:02:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.626+0000 7f5ade59c700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ae0075af0 0x7f5ae01b2bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.632 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.626+0000 7f5ade59c700 1 -- 172.21.15.6:0/1992793263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad8009520 con 0x7f5ae0072c10 2023-09-13T10:02:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.626+0000 7f5aded9d700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae00784c0 0x7f5ae01b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.626+0000 7f5ade59c700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ae0072c10 0x7f5ae01b26b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000b070 tx=0x7f5ad000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.627+0000 7f5ad77fe700 1 -- 172.21.15.6:0/1992793263 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000e040 con 0x7f5ae0072c10 2023-09-13T10:02:53.633 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.627+0000 7f5ad77fe700 1 -- 172.21.15.6:0/1992793263 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ad0003e10 con 0x7f5ae0072c10 2023-09-13T10:02:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.627+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad0009d00 con 0x7f5ae0072c10 2023-09-13T10:02:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.627+0000 7f5ad77fe700 1 -- 172.21.15.6:0/1992793263 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad001b750 con 0x7f5ae0072c10 2023-09-13T10:02:53.634 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.627+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae01baaf0 con 0x7f5ae0072c10 2023-09-13T10:02:53.636 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.630+0000 7f5ad77fe700 1 -- 172.21.15.6:0/1992793263 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f5ad001d470 con 0x7f5ae0072c10 2023-09-13T10:02:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.631+0000 7f5ad77fe700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5acc0a0840 0x7f5acc0a2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.631+0000 7f5addd9b700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5acc0a0840 0x7f5acc0a2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.637 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.631+0000 7f5ad77fe700 1 -- 172.21.15.6:0/1992793263 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ad00ccb20 con 0x7f5ae0072c10 2023-09-13T10:02:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5addd9b700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5acc0a0840 0x7f5acc0a2d00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009730 tx=0x7f5ac8006cb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 Processor -- start 2023-09-13T10:02:53.638 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 -- start start 2023-09-13T10:02:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9eb9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9eb84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb8a00 0x5593c9eb8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.639 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9e11780 con 0x5593c9eba060 2023-09-13T10:02:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9e0f0a0 con 0x5593c9eb9700 2023-09-13T10:02:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.632+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9e0a990 con 0x5593c9eb8a00 2023-09-13T10:02:53.640 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb8a00 0x5593c9eb8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5addd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9eb84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb8a00 0x5593c9eb8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51504/0 (socket says 172.21.15.6:51504) 2023-09-13T10:02:53.641 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5ade59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9eb9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 -- 172.21.15.6:0/2901865565 learned_addr learned my addr 172.21.15.6:0/2901865565 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5addd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9eb84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48454/0 (socket says 172.21.15.6:48454) 2023-09-13T10:02:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 -- 172.21.15.6:0/2901865565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 msgr2=0x5593c9eb9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.642 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9eb9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 -- 172.21.15.6:0/2901865565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 msgr2=0x5593c9eb84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9eb84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.643 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 -- 172.21.15.6:0/2901865565 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c9c8a630 con 0x5593c9eb8a00 2023-09-13T10:02:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5addd9b700 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9eb84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:02:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5aded9d700 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb8a00 0x5593c9eb8e80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80117b0 tx=0x7f5ad8011ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a73a192791ad34a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.633+0000 7f5ad4ff9700 1 -- 172.21.15.6:0/2901865565 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8004020 con 0x5593c9eb8a00 2023-09-13T10:02:53.644 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.634+0000 7f5ad4ff9700 1 -- 172.21.15.6:0/2901865565 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ad8003680 con 0x5593c9eb8a00 2023-09-13T10:02:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.634+0000 7f5ad4ff9700 1 -- 172.21.15.6:0/2901865565 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800f7e0 con 0x5593c9eb8a00 2023-09-13T10:02:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.634+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/2901865565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb8a00 msgr2=0x5593c9eb8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.645 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.634+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb8a00 0x5593c9eb8e80 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80117b0 tx=0x7f5ad8011ac0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/2901865565 shutdown_connections 2023-09-13T10:02:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb8a00 0x5593c9eb8e80 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.651 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9eb9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/2901865565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9eb84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/2901865565 >> 172.21.15.6:0/2901865565 conn(0x5593c9e16c80 msgr2=0x5593c9eb2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/2901865565 shutdown_connections 2023-09-13T10:02:53.652 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/2901865565 wait complete. 2023-09-13T10:02:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.640+0000 7f5af0a2bb80 1 -- start start 2023-09-13T10:02:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 1 Processor -- start 2023-09-13T10:02:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb8a00 0x5593c9ec1f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9ec24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.653 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9da8bb0 con 0x5593c9eb8a00 2023-09-13T10:02:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9da88b0 con 0x5593c9eb9700 2023-09-13T10:02:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9c8c920 con 0x5593c9eba060 2023-09-13T10:02:53.654 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5af0a2bb80 10 client.0 _ll_register_callbacks cb 0x5593c9da6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5ade59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb8a00 0x5593c9ec1f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5ade59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb8a00 0x5593c9ec1f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48456/0 (socket says 172.21.15.6:48456) 2023-09-13T10:02:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5ade59c700 1 -- 172.21.15.6:0/3644894999 learned_addr learned my addr 172.21.15.6:0/3644894999 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.655 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5aded9d700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.641+0000 7f5addd9b700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9ec24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5ade59c700 1 -- 172.21.15.6:0/3644894999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 msgr2=0x5593c9ec94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5ade59c700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.656 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5ade59c700 1 -- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 msgr2=0x5593c9ec24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5ade59c700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9ec24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5ade59c700 1 -- 172.21.15.6:0/3644894999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad8011460 con 0x5593c9eb8a00 2023-09-13T10:02:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5aded9d700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:02:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5ade59c700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb8a00 0x5593c9ec1f60 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0096df0 tx=0x7f5ad000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45b46d747a2b8f46 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.657 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.642+0000 7f5ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.643+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/3644894999 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad0024510 con 0x5593c9eb8a00 2023-09-13T10:02:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.643+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/3644894999 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ad009e1b0 con 0x5593c9eb8a00 2023-09-13T10:02:53.658 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.643+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5593c9eab670 con 0x5593c9eb8a00 2023-09-13T10:02:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/3644894999 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ad00a2360 con 0x5593c9eb8a00 2023-09-13T10:02:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 10 client.21525 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x5593c9e227a0 con 0x5593c9eb8a00 2023-09-13T10:02:53.659 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/3644894999 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x5593c9eab670 con 0x5593c9eb8a00 2023-09-13T10:02:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/3644894999 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5ad00b8120 con 0x5593c9eb8a00 2023-09-13T10:02:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 10 client.21525 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 10 client.21525 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:53.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 20 client.21525 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9ecd930 0x5593c9ecfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 4 client.21525 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-09-13T10:02:53.661 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.645+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5593c9e03970 con 0x5593c9ecd930 2023-09-13T10:02:53.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.654+0000 7f5addd9b700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9ecd930 0x5593c9ecfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.655+0000 7f5addd9b700 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9ecd930 0x5593c9ecfd50 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55487d9d3f3d461b server_cookie=c1a87febb42dd3b5 in_seq=0 out_seq=0 2023-09-13T10:02:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.655+0000 7f5ac5ffb700 10 client.21525 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/3644894999 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5593c9e03970 con 0x5593c9ecd930 2023-09-13T10:02:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5ac5ffb700 10 client.21525 handle_command_reply: tid=0 2023-09-13T10:02:53.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 client.21525 shutdown 2023-09-13T10:02:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb8a00 msgr2=0x5593c9ec1f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb8a00 0x5593c9ec1f60 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0096df0 tx=0x7f5ad000b3b0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 shutdown_connections 2023-09-13T10:02:53.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9ecd930 0x5593c9ecfd50 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb8a00 0x5593c9ec1f60 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5ac5ffb700 0 client.21525 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3644894999 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb9700 0x5593c9ec24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 >> 172.21.15.6:0/3644894999 conn(0x5593c9e16c80 msgr2=0x5593c9eb2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 shutdown_connections 2023-09-13T10:02:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3644894999 wait complete. 2023-09-13T10:02:53.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.657+0000 7f5af0a2bb80 20 client.21525 trim_cache size 0 max 16384 2023-09-13T10:02:53.677 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 Processor -- start 2023-09-13T10:02:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 -- start start 2023-09-13T10:02:53.685 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9eb84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb9700 0x5593c9eb3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.686 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec9470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9ec1450 con 0x5593c9eb9700 2023-09-13T10:02:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9ec1b00 con 0x5593c9eb8a00 2023-09-13T10:02:53.687 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9ebd470 con 0x5593c9eba060 2023-09-13T10:02:53.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5addd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb9700 0x5593c9eb3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5aded9d700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec9470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.688 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5addd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb9700 0x5593c9eb3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48466/0 (socket says 172.21.15.6:48466) 2023-09-13T10:02:53.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.676+0000 7f5addd9b700 1 -- 172.21.15.6:0/3238374865 learned_addr learned my addr 172.21.15.6:0/3238374865 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5addd9b700 1 -- 172.21.15.6:0/3238374865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 msgr2=0x5593c9ec9470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.689 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5addd9b700 1 --2- 172.21.15.6:0/3238374865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec9470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5addd9b700 1 -- 172.21.15.6:0/3238374865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 msgr2=0x5593c9eb84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.690 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5addd9b700 1 --2- 172.21.15.6:0/3238374865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9eb84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5addd9b700 1 -- 172.21.15.6:0/3238374865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5593c9c36de0 con 0x5593c9eb9700 2023-09-13T10:02:53.691 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5addd9b700 1 --2- 172.21.15.6:0/3238374865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb9700 0x5593c9eb3fb0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x5593c9ed06a0 tx=0x7f5ac8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f728f37b667263dc server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5ad57fa700 1 -- 172.21.15.6:0/3238374865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8029030 con 0x5593c9eb9700 2023-09-13T10:02:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5ad57fa700 1 -- 172.21.15.6:0/3238374865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ac801b040 con 0x5593c9eb9700 2023-09-13T10:02:53.693 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.677+0000 7f5ad57fa700 1 -- 172.21.15.6:0/3238374865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac801a040 con 0x5593c9eb9700 2023-09-13T10:02:53.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3238374865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb9700 msgr2=0x5593c9eb3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3238374865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb9700 0x5593c9eb3fb0 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x5593c9ed06a0 tx=0x7f5ac8011000 comp rx=0 tx=0).stop 2023-09-13T10:02:53.694 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3238374865 shutdown_connections 2023-09-13T10:02:53.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3238374865 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eba060 0x5593c9ec9470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3238374865 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9eb84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.695 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/3238374865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eb9700 0x5593c9eb3fb0 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3238374865 >> 172.21.15.6:0/3238374865 conn(0x5593c9e16c80 msgr2=0x5593c9ec0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3238374865 shutdown_connections 2023-09-13T10:02:53.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/3238374865 wait complete. 2023-09-13T10:02:53.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 -- start start 2023-09-13T10:02:53.696 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.678+0000 7f5af0a2bb80 1 Processor -- start 2023-09-13T10:02:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9ec3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb9700 0x5593c9ec3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5af0a2bb80 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9ec8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.697 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9ec89d0 con 0x5593c9eba060 2023-09-13T10:02:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9ec8b40 con 0x5593c9eb8a00 2023-09-13T10:02:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5af0a2bb80 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5593c9ec8d00 con 0x5593c9eb9700 2023-09-13T10:02:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5af0a2bb80 10 client.0 _ll_register_callbacks cb 0x5593c9da6680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-09-13T10:02:53.698 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9ec8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5ade59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9ec3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9ec8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48474/0 (socket says 172.21.15.6:48474) 2023-09-13T10:02:53.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 -- 172.21.15.6:0/358494650 learned_addr learned my addr 172.21.15.6:0/358494650 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:02:53.699 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5ade59c700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9ec3620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.53:3300/0 says I am v2:172.21.15.6:41994/0 (socket says 172.21.15.6:41994) 2023-09-13T10:02:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5addd9b700 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb9700 0x5593c9ec3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 -- 172.21.15.6:0/358494650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb9700 msgr2=0x5593c9ec3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb9700 0x5593c9ec3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 -- 172.21.15.6:0/358494650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 msgr2=0x5593c9ec3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-13T10:02:53.700 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9ec3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 -- 172.21.15.6:0/358494650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac8025bd0 con 0x5593c9eba060 2023-09-13T10:02:53.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5aded9d700 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9ec8490 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8011e10 tx=0x7f5ad80092f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21b6d1d64c39cfbd server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:02:53.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.679+0000 7f5ac5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.6:3300/0 2023-09-13T10:02:53.701 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/358494650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8003ac0 con 0x5593c9eba060 2023-09-13T10:02:53.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ad8003680 con 0x5593c9eba060 2023-09-13T10:02:53.702 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/358494650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f5ad8003c20 con 0x5593c9eba060 2023-09-13T10:02:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/358494650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ad8003de0 con 0x5593c9eba060 2023-09-13T10:02:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 10 client.21531 fetch_fsmap learned FSMap version 75 2023-09-13T10:02:53.703 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=4+}) v3 -- 0x5593c9c1fc60 con 0x5593c9eba060 2023-09-13T10:02:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/358494650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f5ad8003680 con 0x5593c9eba060 2023-09-13T10:02:53.704 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/358494650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== fsmap(e 75) v1 ==== 7914+0+0 (secure 0 0 0) 0x7f5ad8021040 con 0x5593c9eba060 2023-09-13T10:02:53.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 10 client.21531 fetch_fsmap finished waiting for FSMap version 75 2023-09-13T10:02:53.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 10 client.21531 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-09-13T10:02:53.705 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 20 client.21531 populate_metadata read hostname 'smithi006' 2023-09-13T10:02:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9f334b0 0x5593c9f358d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:02:53.706 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 4 client.21531 mds_command: new command op to 24521 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2023-09-13T10:02:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.680+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 --> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5593c9dc4050 con 0x5593c9f334b0 2023-09-13T10:02:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.681+0000 7f5ade59c700 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9f334b0 0x5593c9f358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:02:53.707 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.683+0000 7f5ac5ffb700 10 client.21531 ms_handle_connect on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:53.708 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.683+0000 7f5ade59c700 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9f334b0 0x5593c9f358d0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f036a117e43da179 server_cookie=5509cd3918dadb4d in_seq=0 out_seq=0 2023-09-13T10:02:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5ac5ffb700 1 -- 172.21.15.6:0/358494650 <== mds.0 v2:172.21.15.53:6838/1050659050 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5593c9dc4050 con 0x5593c9f334b0 2023-09-13T10:02:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5ac5ffb700 10 client.21531 handle_command_reply: tid=0 2023-09-13T10:02:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 client.21531 shutdown 2023-09-13T10:02:53.710 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 msgr2=0x5593c9ec8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9ec8490 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8011e10 tx=0x7f5ad80092f0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.711 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 shutdown_connections 2023-09-13T10:02:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.53:6838/1050659050,v1:172.21.15.53:6839/1050659050] conn(0x5593c9f334b0 0x5593c9f358d0 crc :-1 s=READY pgs=366 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x5593c9eba060 0x5593c9ec8490 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5ac5ffb700 0 client.21531 ms_handle_reset on v2:172.21.15.53:6838/1050659050 2023-09-13T10:02:53.712 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x5593c9eb8a00 0x5593c9ec3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 --2- 172.21.15.6:0/358494650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5593c9eb9700 0x5593c9ec3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.686+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 >> 172.21.15.6:0/358494650 conn(0x5593c9e16c80 msgr2=0x5593c9eb2e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.713 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 shutdown_connections 2023-09-13T10:02:53.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5af0a2bb80 1 -- 172.21.15.6:0/358494650 wait complete. 2023-09-13T10:02:53.714 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5af0a2bb80 20 client.21531 trim_cache size 0 max 16384 2023-09-13T10:02:53.715 INFO:teuthology.orchestra.run.smithi006.stdout:[] 2023-09-13T10:02:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5acc0a0840 msgr2=0x7f5acc0a2d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5acc0a0840 0x7f5acc0a2d00 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f5ac8009730 tx=0x7f5ac8006cb0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.717 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ae0072c10 msgr2=0x7f5ae01b26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:02:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ae0072c10 0x7f5ae01b26b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000b070 tx=0x7f5ad000bce0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 shutdown_connections 2023-09-13T10:02:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ae00784c0 0x7f5ae01b9c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.718 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f5ae0072c10 0x7f5ae01b26b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f5acc0a0840 0x7f5acc0a2d00 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 --2- 172.21.15.6:0/1992793263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5ae0075af0 0x7f5ae01b2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:02:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 >> 172.21.15.6:0/1992793263 conn(0x7f5ae006dc70 msgr2=0x7f5ae00791d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:02:53.719 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 shutdown_connections 2023-09-13T10:02:53.720 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:02:53.687+0000 7f5ae4846700 1 -- 172.21.15.6:0/1992793263 wait complete. 2023-09-13T10:02:53.720 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 579024295, 'ino': 3298534889822, 'path': '/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/SALES.XLS'}, {'damage_type': 'backtrace', 'id': 846908525, 'ino': 3298534889813, 'path': '/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client2/~dmtmp/EXCEL/PCMAGCD.XLS'}, {'damage_type': 'backtrace', 'id': 2230955380, 'ino': 3298534890113, 'path': '/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/EVENTS.DOC'}, {'damage_type': 'backtrace', 'id': 2490734392, 'ino': 3298534890125, 'path': '/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/MOVED.DOC'}, {'damage_type': 'backtrace', 'id': 3671277100, 'ino': 3298534890104, 'path': '/volumes/_nogroup/sv_1/27cc069e-eed5-4b2b-909b-b3e0cb2f28c1/client.0/tmp/clients/client6/~dmtmp/PM/T1.XLS'}] 2023-09-13T10:02:53.720 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-09-13T10:02:54.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:54 smithi006 ceph-mon[98665]: pgmap v1001: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 470 op/s 2023-09-13T10:02:54.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:54 smithi053 ceph-mon[102373]: pgmap v1001: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 470 op/s 2023-09-13T10:02:54.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:54 smithi131 ceph-mon[102785]: pgmap v1001: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.5 MiB/s wr, 470 op/s 2023-09-13T10:02:54.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 391359 33.31 MB/sec execute 494 sec latency 629.975 ms 2023-09-13T10:02:55.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 391720 33.29 MB/sec execute 495 sec latency 117.124 ms 2023-09-13T10:02:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:56 smithi006 ceph-mon[98665]: pgmap v1002: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.9 MiB/s wr, 539 op/s 2023-09-13T10:02:56.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:56 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:56.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:56 smithi053 ceph-mon[102373]: pgmap v1002: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.9 MiB/s wr, 539 op/s 2023-09-13T10:02:56.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:56 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:56 smithi131 ceph-mon[102785]: pgmap v1002: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.9 MiB/s wr, 539 op/s 2023-09-13T10:02:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:56 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:02:56.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 392383 33.29 MB/sec execute 496 sec latency 62.846 ms 2023-09-13T10:02:57.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 392982 33.29 MB/sec execute 497 sec latency 85.284 ms 2023-09-13T10:02:58.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:02:58 smithi006 ceph-mon[98665]: pgmap v1003: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 609 op/s 2023-09-13T10:02:58.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:02:58 smithi053 ceph-mon[102373]: pgmap v1003: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 609 op/s 2023-09-13T10:02:58.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:02:58 smithi131 ceph-mon[102785]: pgmap v1003: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 609 op/s 2023-09-13T10:02:58.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 393534 33.28 MB/sec execute 498 sec latency 98.057 ms 2023-09-13T10:02:59.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 394108 33.29 MB/sec execute 499 sec latency 102.711 ms 2023-09-13T10:03:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:00 smithi006 ceph-mon[98665]: pgmap v1004: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 791 op/s 2023-09-13T10:03:00.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:00 smithi053 ceph-mon[102373]: pgmap v1004: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 791 op/s 2023-09-13T10:03:00.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:00 smithi131 ceph-mon[102785]: pgmap v1004: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 15 MiB/s wr, 791 op/s 2023-09-13T10:03:00.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 394628 33.29 MB/sec execute 500 sec latency 88.261 ms 2023-09-13T10:03:01.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:01 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:01.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:01 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:01.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:01 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:01.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 395203 33.26 MB/sec execute 501 sec latency 65.120 ms 2023-09-13T10:03:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:02 smithi006 ceph-mon[98665]: pgmap v1005: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 727 op/s 2023-09-13T10:03:02.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:02 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:03:02.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:02 smithi053 ceph-mon[102373]: pgmap v1005: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 727 op/s 2023-09-13T10:03:02.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:02 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:03:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:02 smithi131 ceph-mon[102785]: pgmap v1005: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 14 MiB/s wr, 727 op/s 2023-09-13T10:03:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:02 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:03:02.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 395760 33.24 MB/sec execute 502 sec latency 94.039 ms 2023-09-13T10:03:03.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 396374 33.27 MB/sec execute 503 sec latency 83.601 ms 2023-09-13T10:03:03.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:03.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:03 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:03.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:03 smithi006 ceph-mon[98665]: pgmap v1006: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 713 op/s 2023-09-13T10:03:03.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:03.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:03 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:03.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:03 smithi053 ceph-mon[102373]: pgmap v1006: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 713 op/s 2023-09-13T10:03:03.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:03.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:03 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:03.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:03 smithi131 ceph-mon[102785]: pgmap v1006: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 14 MiB/s wr, 713 op/s 2023-09-13T10:03:04.441 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:04.441 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.442 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.442 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.442 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.442 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.442 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.443 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:03:04.443 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:03:04.443 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:04 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 396985 33.25 MB/sec execute 504 sec latency 110.842 ms 2023-09-13T10:03:04.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:04.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:03:04.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:03:04.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:04 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:04.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:04.760 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:03:04.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:03:04.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:04 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:03:05.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 397505 33.25 MB/sec execute 505 sec latency 149.108 ms 2023-09-13T10:03:05.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:05 smithi006 ceph-mon[98665]: pgmap v1007: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 15 MiB/s wr, 820 op/s 2023-09-13T10:03:05.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:05 smithi053 ceph-mon[102373]: pgmap v1007: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 15 MiB/s wr, 820 op/s 2023-09-13T10:03:05.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:05 smithi131 ceph-mon[102785]: pgmap v1007: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 15 MiB/s wr, 820 op/s 2023-09-13T10:03:06.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 398179 33.26 MB/sec execute 506 sec latency 66.916 ms 2023-09-13T10:03:07.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 398774 33.26 MB/sec execute 507 sec latency 86.913 ms 2023-09-13T10:03:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:08 smithi006 ceph-mon[98665]: pgmap v1008: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 663 op/s 2023-09-13T10:03:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:08 smithi053 ceph-mon[102373]: pgmap v1008: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 663 op/s 2023-09-13T10:03:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:08 smithi131 ceph-mon[102785]: pgmap v1008: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 10 MiB/s wr, 663 op/s 2023-09-13T10:03:08.612 INFO:tasks.workunit.client.0.smithi006.stdout: 10 399393 33.25 MB/sec execute 508 sec latency 90.361 ms 2023-09-13T10:03:09.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:09 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:09.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:09 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:09.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:09 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:09.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 399959 33.26 MB/sec execute 509 sec latency 79.986 ms 2023-09-13T10:03:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:10 smithi006 ceph-mon[98665]: pgmap v1009: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.9 MiB/s wr, 654 op/s 2023-09-13T10:03:10.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:10 smithi053 ceph-mon[102373]: pgmap v1009: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.9 MiB/s wr, 654 op/s 2023-09-13T10:03:10.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:10 smithi131 ceph-mon[102785]: pgmap v1009: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.9 MiB/s wr, 654 op/s 2023-09-13T10:03:10.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 400673 33.25 MB/sec execute 510 sec latency 59.288 ms 2023-09-13T10:03:11.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 401215 33.26 MB/sec execute 511 sec latency 73.204 ms 2023-09-13T10:03:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:12 smithi006 ceph-mon[98665]: pgmap v1010: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 428 op/s 2023-09-13T10:03:12.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:12 smithi053 ceph-mon[102373]: pgmap v1010: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 428 op/s 2023-09-13T10:03:12.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:12 smithi131 ceph-mon[102785]: pgmap v1010: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.0 MiB/s wr, 428 op/s 2023-09-13T10:03:12.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 401812 33.25 MB/sec execute 512 sec latency 78.102 ms 2023-09-13T10:03:13.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 402328 33.23 MB/sec execute 513 sec latency 103.524 ms 2023-09-13T10:03:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:14 smithi006 ceph-mon[98665]: pgmap v1011: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 431 op/s 2023-09-13T10:03:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:14 smithi053 ceph-mon[102373]: pgmap v1011: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 431 op/s 2023-09-13T10:03:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:14 smithi131 ceph-mon[102785]: pgmap v1011: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 431 op/s 2023-09-13T10:03:14.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 402969 33.24 MB/sec execute 514 sec latency 98.557 ms 2023-09-13T10:03:15.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 403452 33.22 MB/sec execute 515 sec latency 91.718 ms 2023-09-13T10:03:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:16 smithi006 ceph-mon[98665]: pgmap v1012: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 568 op/s 2023-09-13T10:03:16.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:16 smithi053 ceph-mon[102373]: pgmap v1012: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 568 op/s 2023-09-13T10:03:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:16 smithi131 ceph-mon[102785]: pgmap v1012: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.0 MiB/s wr, 568 op/s 2023-09-13T10:03:16.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 404121 33.22 MB/sec execute 516 sec latency 87.003 ms 2023-09-13T10:03:17.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 404756 33.24 MB/sec execute 517 sec latency 78.274 ms 2023-09-13T10:03:18.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:18 smithi053 ceph-mon[102373]: pgmap v1013: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 422 op/s 2023-09-13T10:03:18.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:18 smithi006 ceph-mon[98665]: pgmap v1013: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 422 op/s 2023-09-13T10:03:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:18 smithi131 ceph-mon[102785]: pgmap v1013: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.1 MiB/s wr, 422 op/s 2023-09-13T10:03:18.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 405366 33.24 MB/sec execute 518 sec latency 72.282 ms 2023-09-13T10:03:19.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 405866 33.23 MB/sec execute 519 sec latency 89.424 ms 2023-09-13T10:03:20.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:20 smithi053 ceph-mon[102373]: pgmap v1014: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 521 op/s 2023-09-13T10:03:20.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:20 smithi006 ceph-mon[98665]: pgmap v1014: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 521 op/s 2023-09-13T10:03:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:20 smithi131 ceph-mon[102785]: pgmap v1014: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.7 MiB/s wr, 521 op/s 2023-09-13T10:03:20.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 406289 33.20 MB/sec execute 520 sec latency 72.803 ms 2023-09-13T10:03:21.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 406823 33.18 MB/sec execute 521 sec latency 166.135 ms 2023-09-13T10:03:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:22 smithi006 ceph-mon[98665]: pgmap v1015: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 434 op/s 2023-09-13T10:03:22.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:22 smithi053 ceph-mon[102373]: pgmap v1015: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 434 op/s 2023-09-13T10:03:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:22 smithi131 ceph-mon[102785]: pgmap v1015: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.1 MiB/s wr, 434 op/s 2023-09-13T10:03:22.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 407386 33.17 MB/sec execute 522 sec latency 186.911 ms 2023-09-13T10:03:23.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 408073 33.19 MB/sec execute 523 sec latency 81.100 ms 2023-09-13T10:03:24.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:24 smithi006 ceph-mon[98665]: pgmap v1016: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 450 op/s 2023-09-13T10:03:24.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:24 smithi053 ceph-mon[102373]: pgmap v1016: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 450 op/s 2023-09-13T10:03:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:24 smithi131 ceph-mon[102785]: pgmap v1016: 97 pgs: 97 active+clean; 1.3 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 3.1 MiB/s wr, 450 op/s 2023-09-13T10:03:24.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 408684 33.19 MB/sec execute 524 sec latency 65.686 ms 2023-09-13T10:03:25.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 409253 33.19 MB/sec execute 525 sec latency 65.853 ms 2023-09-13T10:03:26.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:26 smithi053 ceph-mon[102373]: pgmap v1017: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 537 op/s 2023-09-13T10:03:26.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:26 smithi006 ceph-mon[98665]: pgmap v1017: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 537 op/s 2023-09-13T10:03:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:26 smithi131 ceph-mon[102785]: pgmap v1017: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 3.8 MiB/s wr, 537 op/s 2023-09-13T10:03:26.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 409674 33.17 MB/sec execute 526 sec latency 87.256 ms 2023-09-13T10:03:27.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 410195 33.17 MB/sec execute 527 sec latency 120.230 ms 2023-09-13T10:03:28.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:28 smithi053 ceph-mon[102373]: pgmap v1018: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 422 op/s 2023-09-13T10:03:28.513 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:28 smithi006 ceph-mon[98665]: pgmap v1018: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 422 op/s 2023-09-13T10:03:28.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:28 smithi131 ceph-mon[102785]: pgmap v1018: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.1 MiB/s wr, 422 op/s 2023-09-13T10:03:28.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 410480 33.14 MB/sec execute 528 sec latency 559.950 ms 2023-09-13T10:03:29.614 INFO:tasks.workunit.client.0.smithi006.stdout: 10 410504 33.08 MB/sec execute 529 sec latency 1498.358 ms 2023-09-13T10:03:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:30 smithi006 ceph-mon[98665]: pgmap v1019: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 447 op/s 2023-09-13T10:03:30.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:30 smithi053 ceph-mon[102373]: pgmap v1019: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 447 op/s 2023-09-13T10:03:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:30 smithi131 ceph-mon[102785]: pgmap v1019: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 3.1 MiB/s wr, 447 op/s 2023-09-13T10:03:30.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 410707 33.03 MB/sec execute 530 sec latency 1518.839 ms 2023-09-13T10:03:31.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 410910 32.99 MB/sec execute 531 sec latency 157.770 ms 2023-09-13T10:03:32.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:32 smithi006 ceph-mon[98665]: pgmap v1020: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 472 op/s 2023-09-13T10:03:32.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:32 smithi053 ceph-mon[102373]: pgmap v1020: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 472 op/s 2023-09-13T10:03:32.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:32 smithi131 ceph-mon[102785]: pgmap v1020: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.2 MiB/s wr, 472 op/s 2023-09-13T10:03:32.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 411330 32.98 MB/sec execute 532 sec latency 120.321 ms 2023-09-13T10:03:33.614 INFO:tasks.workunit.client.0.smithi006.stdout: 10 412048 33.00 MB/sec execute 533 sec latency 80.996 ms 2023-09-13T10:03:34.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:34 smithi053 ceph-mon[102373]: pgmap v1021: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 596 op/s 2023-09-13T10:03:34.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:34 smithi006 ceph-mon[98665]: pgmap v1021: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 596 op/s 2023-09-13T10:03:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:34 smithi131 ceph-mon[102785]: pgmap v1021: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 12 MiB/s wr, 596 op/s 2023-09-13T10:03:34.613 INFO:tasks.workunit.client.0.smithi006.stdout: 10 412662 33.01 MB/sec execute 534 sec latency 75.127 ms 2023-09-13T10:03:35.614 INFO:tasks.workunit.client.0.smithi006.stdout: 10 413225 33.00 MB/sec execute 535 sec latency 73.124 ms 2023-09-13T10:03:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:36 smithi006 ceph-mon[98665]: pgmap v1022: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 879 op/s 2023-09-13T10:03:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:36 smithi053 ceph-mon[102373]: pgmap v1022: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 879 op/s 2023-09-13T10:03:36.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:36 smithi131 ceph-mon[102785]: pgmap v1022: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 18 MiB/s wr, 879 op/s 2023-09-13T10:03:36.614 INFO:tasks.workunit.client.0.smithi006.stdout: 10 413777 32.99 MB/sec execute 536 sec latency 73.720 ms 2023-09-13T10:03:37.614 INFO:tasks.workunit.client.0.smithi006.stdout: 10 414376 32.99 MB/sec execute 537 sec latency 70.824 ms 2023-09-13T10:03:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:38 smithi006 ceph-mon[98665]: pgmap v1023: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 17 MiB/s wr, 790 op/s 2023-09-13T10:03:38.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:38 smithi053 ceph-mon[102373]: pgmap v1023: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 17 MiB/s wr, 790 op/s 2023-09-13T10:03:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:38 smithi131 ceph-mon[102785]: pgmap v1023: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 17 MiB/s wr, 790 op/s 2023-09-13T10:03:38.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 414940 32.99 MB/sec execute 538 sec latency 122.785 ms 2023-09-13T10:03:39.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 415510 32.98 MB/sec execute 539 sec latency 131.770 ms 2023-09-13T10:03:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:40 smithi006 ceph-mon[98665]: pgmap v1024: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 839 op/s 2023-09-13T10:03:40.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:40 smithi053 ceph-mon[102373]: pgmap v1024: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 839 op/s 2023-09-13T10:03:40.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:40 smithi131 ceph-mon[102785]: pgmap v1024: 97 pgs: 97 active+clean; 1.2 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 17 MiB/s wr, 839 op/s 2023-09-13T10:03:40.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 416178 32.99 MB/sec execute 540 sec latency 62.645 ms 2023-09-13T10:03:41.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 416839 33.00 MB/sec execute 541 sec latency 74.070 ms 2023-09-13T10:03:42.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:42 smithi006 ceph-mon[98665]: pgmap v1025: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 17 MiB/s wr, 863 op/s 2023-09-13T10:03:42.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:42 smithi053 ceph-mon[102373]: pgmap v1025: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 17 MiB/s wr, 863 op/s 2023-09-13T10:03:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:42 smithi131 ceph-mon[102785]: pgmap v1025: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 17 MiB/s wr, 863 op/s 2023-09-13T10:03:42.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 417270 32.99 MB/sec execute 542 sec latency 77.410 ms 2023-09-13T10:03:43.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 417736 32.96 MB/sec execute 543 sec latency 103.234 ms 2023-09-13T10:03:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:44 smithi006 ceph-mon[98665]: pgmap v1026: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 752 op/s 2023-09-13T10:03:44.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:44 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:44 smithi053 ceph-mon[102373]: pgmap v1026: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 752 op/s 2023-09-13T10:03:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:44 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:44 smithi131 ceph-mon[102785]: pgmap v1026: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 13 MiB/s wr, 752 op/s 2023-09-13T10:03:44.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:44 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:03:44.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 418255 32.94 MB/sec execute 544 sec latency 98.748 ms 2023-09-13T10:03:45.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 419066 32.96 MB/sec execute 545 sec latency 71.323 ms 2023-09-13T10:03:46.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:46 smithi006 ceph-mon[98665]: pgmap v1027: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.8 MiB/s wr, 746 op/s 2023-09-13T10:03:46.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:46 smithi053 ceph-mon[102373]: pgmap v1027: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.8 MiB/s wr, 746 op/s 2023-09-13T10:03:46.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:46 smithi131 ceph-mon[102785]: pgmap v1027: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.8 MiB/s wr, 746 op/s 2023-09-13T10:03:46.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 419753 32.99 MB/sec execute 546 sec latency 229.638 ms 2023-09-13T10:03:47.615 INFO:tasks.workunit.client.0.smithi006.stdout: 10 420275 32.98 MB/sec execute 547 sec latency 83.797 ms 2023-09-13T10:03:48.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:48 smithi131 ceph-mon[102785]: pgmap v1028: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 427 op/s 2023-09-13T10:03:48.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 420746 32.96 MB/sec execute 548 sec latency 102.306 ms 2023-09-13T10:03:48.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:48 smithi006 ceph-mon[98665]: pgmap v1028: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 427 op/s 2023-09-13T10:03:48.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:48 smithi053 ceph-mon[102373]: pgmap v1028: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 2.8 MiB/s wr, 427 op/s 2023-09-13T10:03:49.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 421208 32.95 MB/sec execute 549 sec latency 154.912 ms 2023-09-13T10:03:50.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:50 smithi131 ceph-mon[102785]: pgmap v1029: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 470 op/s 2023-09-13T10:03:50.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 421757 32.93 MB/sec execute 550 sec latency 71.832 ms 2023-09-13T10:03:50.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:50 smithi053 ceph-mon[102373]: pgmap v1029: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 470 op/s 2023-09-13T10:03:50.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:50 smithi006 ceph-mon[98665]: pgmap v1029: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 470 op/s 2023-09-13T10:03:51.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 422443 32.94 MB/sec execute 551 sec latency 71.359 ms 2023-09-13T10:03:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:52 smithi131 ceph-mon[102785]: pgmap v1030: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 456 op/s 2023-09-13T10:03:52.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 423214 32.95 MB/sec execute 552 sec latency 86.557 ms 2023-09-13T10:03:52.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:52 smithi053 ceph-mon[102373]: pgmap v1030: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 456 op/s 2023-09-13T10:03:52.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:52 smithi006 ceph-mon[98665]: pgmap v1030: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.4 MiB/s wr, 456 op/s 2023-09-13T10:03:53.620 INFO:tasks.workunit.client.0.smithi006.stdout: 10 423813 32.95 MB/sec execute 553 sec latency 67.523 ms 2023-09-13T10:03:54.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 424430 32.96 MB/sec execute 554 sec latency 79.523 ms 2023-09-13T10:03:54.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:54 smithi006 ceph-mon[98665]: pgmap v1031: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 437 op/s 2023-09-13T10:03:54.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:54 smithi053 ceph-mon[102373]: pgmap v1031: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 437 op/s 2023-09-13T10:03:54.773 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:54 smithi131 ceph-mon[102785]: pgmap v1031: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 3.2 MiB/s wr, 437 op/s 2023-09-13T10:03:55.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 424935 32.95 MB/sec execute 555 sec latency 61.604 ms 2023-09-13T10:03:56.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 425461 32.93 MB/sec execute 556 sec latency 93.646 ms 2023-09-13T10:03:56.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:56 smithi053 ceph-mon[102373]: pgmap v1032: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 499 op/s 2023-09-13T10:03:56.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:56 smithi006 ceph-mon[98665]: pgmap v1032: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 499 op/s 2023-09-13T10:03:56.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:56 smithi131 ceph-mon[102785]: pgmap v1032: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 3.7 MiB/s wr, 499 op/s 2023-09-13T10:03:57.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 426151 32.95 MB/sec execute 557 sec latency 78.245 ms 2023-09-13T10:03:58.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 426743 32.94 MB/sec execute 558 sec latency 79.424 ms 2023-09-13T10:03:58.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:03:58 smithi006 ceph-mon[98665]: pgmap v1033: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 445 op/s 2023-09-13T10:03:58.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:03:58 smithi053 ceph-mon[102373]: pgmap v1033: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 445 op/s 2023-09-13T10:03:58.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:03:58 smithi131 ceph-mon[102785]: pgmap v1033: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 3.3 MiB/s wr, 445 op/s 2023-09-13T10:03:59.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 426877 32.89 MB/sec execute 559 sec latency 790.657 ms 2023-09-13T10:04:00.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 426984 32.84 MB/sec execute 560 sec latency 1186.871 ms 2023-09-13T10:04:00.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:00 smithi053 ceph-mon[102373]: pgmap v1034: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 492 op/s 2023-09-13T10:04:00.761 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:00 smithi006 ceph-mon[98665]: pgmap v1034: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 492 op/s 2023-09-13T10:04:00.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:00 smithi131 ceph-mon[102785]: pgmap v1034: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.6 MiB/s wr, 492 op/s 2023-09-13T10:04:01.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 427298 32.83 MB/sec execute 561 sec latency 176.544 ms 2023-09-13T10:04:01.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:01 smithi053 ceph-mon[102373]: pgmap v1035: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 469 op/s 2023-09-13T10:04:01.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:01 smithi006 ceph-mon[98665]: pgmap v1035: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 469 op/s 2023-09-13T10:04:01.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:01 smithi131 ceph-mon[102785]: pgmap v1035: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.4 MiB/s wr, 469 op/s 2023-09-13T10:04:02.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 427599 32.79 MB/sec execute 562 sec latency 128.129 ms 2023-09-13T10:04:03.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 428320 32.80 MB/sec execute 563 sec latency 78.558 ms 2023-09-13T10:04:04.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:04 smithi053 ceph-mon[102373]: pgmap v1036: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 529 op/s 2023-09-13T10:04:04.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:04 smithi006 ceph-mon[98665]: pgmap v1036: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 529 op/s 2023-09-13T10:04:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:04 smithi131 ceph-mon[102785]: pgmap v1036: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.4 MiB/s wr, 529 op/s 2023-09-13T10:04:04.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 428871 32.80 MB/sec execute 564 sec latency 60.806 ms 2023-09-13T10:04:05.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:04:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:05.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:05 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:05.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:04:05.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:05.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:05 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:05.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:04:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:05.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:05 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:05.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 429372 32.79 MB/sec execute 565 sec latency 84.737 ms 2023-09-13T10:04:06.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:06 smithi053 ceph-mon[102373]: pgmap v1037: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 756 op/s 2023-09-13T10:04:06.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:06.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:06 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:06 smithi006 ceph-mon[98665]: pgmap v1037: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 756 op/s 2023-09-13T10:04:06.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:06.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:06 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:06 smithi131 ceph-mon[102785]: pgmap v1037: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 15 MiB/s wr, 756 op/s 2023-09-13T10:04:06.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:06.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:06 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:06.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 429856 32.77 MB/sec execute 566 sec latency 107.187 ms 2023-09-13T10:04:07.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 430519 32.78 MB/sec execute 567 sec latency 80.198 ms 2023-09-13T10:04:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:08 smithi006 ceph-mon[98665]: pgmap v1038: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 769 op/s 2023-09-13T10:04:08.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:04:08.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:04:08.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:08 smithi053 ceph-mon[102373]: pgmap v1038: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 769 op/s 2023-09-13T10:04:08.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:04:08.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:04:08.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:08 smithi131 ceph-mon[102785]: pgmap v1038: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 15 MiB/s wr, 769 op/s 2023-09-13T10:04:08.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:04:08.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:04:08.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:04:08.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 431184 32.79 MB/sec execute 568 sec latency 64.744 ms 2023-09-13T10:04:09.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 431716 32.77 MB/sec execute 569 sec latency 69.355 ms 2023-09-13T10:04:10.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:10 smithi053 ceph-mon[102373]: pgmap v1039: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 748 op/s 2023-09-13T10:04:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:10 smithi006 ceph-mon[98665]: pgmap v1039: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 748 op/s 2023-09-13T10:04:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:10 smithi131 ceph-mon[102785]: pgmap v1039: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 748 op/s 2023-09-13T10:04:10.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 432401 32.79 MB/sec execute 570 sec latency 48.922 ms 2023-09-13T10:04:11.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 433029 32.78 MB/sec execute 571 sec latency 78.843 ms 2023-09-13T10:04:12.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:12 smithi006 ceph-mon[98665]: pgmap v1040: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 756 op/s 2023-09-13T10:04:12.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:12 smithi053 ceph-mon[102373]: pgmap v1040: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 756 op/s 2023-09-13T10:04:12.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:12 smithi131 ceph-mon[102785]: pgmap v1040: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 15 MiB/s wr, 756 op/s 2023-09-13T10:04:12.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 433600 32.78 MB/sec execute 572 sec latency 61.695 ms 2023-09-13T10:04:13.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 434277 32.79 MB/sec execute 573 sec latency 82.121 ms 2023-09-13T10:04:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:14 smithi053 ceph-mon[102373]: pgmap v1041: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 760 op/s 2023-09-13T10:04:14.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:14 smithi006 ceph-mon[98665]: pgmap v1041: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 760 op/s 2023-09-13T10:04:14.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:14 smithi131 ceph-mon[102785]: pgmap v1041: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 13 MiB/s wr, 760 op/s 2023-09-13T10:04:14.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 435014 32.80 MB/sec execute 574 sec latency 105.574 ms 2023-09-13T10:04:15.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 435623 32.81 MB/sec execute 575 sec latency 75.243 ms 2023-09-13T10:04:16.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:16 smithi006 ceph-mon[98665]: pgmap v1042: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 737 op/s 2023-09-13T10:04:16.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:16 smithi053 ceph-mon[102373]: pgmap v1042: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 737 op/s 2023-09-13T10:04:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:16 smithi131 ceph-mon[102785]: pgmap v1042: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 10 MiB/s wr, 737 op/s 2023-09-13T10:04:16.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 436166 32.80 MB/sec execute 576 sec latency 84.756 ms 2023-09-13T10:04:17.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 436745 32.79 MB/sec execute 577 sec latency 72.451 ms 2023-09-13T10:04:18.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:18 smithi053 ceph-mon[102373]: pgmap v1043: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 514 op/s 2023-09-13T10:04:18.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:18 smithi006 ceph-mon[98665]: pgmap v1043: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 514 op/s 2023-09-13T10:04:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:18 smithi131 ceph-mon[102785]: pgmap v1043: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.4 MiB/s wr, 514 op/s 2023-09-13T10:04:18.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 437322 32.79 MB/sec execute 578 sec latency 59.133 ms 2023-09-13T10:04:19.616 INFO:tasks.workunit.client.0.smithi006.stdout: 10 438086 32.80 MB/sec execute 579 sec latency 94.107 ms 2023-09-13T10:04:20.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:20 smithi006 ceph-mon[98665]: pgmap v1044: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 479 op/s 2023-09-13T10:04:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:20 smithi053 ceph-mon[102373]: pgmap v1044: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 479 op/s 2023-09-13T10:04:20.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:20 smithi131 ceph-mon[102785]: pgmap v1044: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.4 MiB/s wr, 479 op/s 2023-09-13T10:04:20.617 INFO:tasks.workunit.client.0.smithi006.stdout: 10 438692 32.80 MB/sec execute 580 sec latency 70.620 ms 2023-09-13T10:04:21.617 INFO:tasks.workunit.client.0.smithi006.stdout: 10 439323 32.80 MB/sec execute 581 sec latency 68.330 ms 2023-09-13T10:04:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:22 smithi006 ceph-mon[98665]: pgmap v1045: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 491 op/s 2023-09-13T10:04:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:22 smithi053 ceph-mon[102373]: pgmap v1045: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 491 op/s 2023-09-13T10:04:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:22 smithi131 ceph-mon[102785]: pgmap v1045: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 3.5 MiB/s wr, 491 op/s 2023-09-13T10:04:22.617 INFO:tasks.workunit.client.0.smithi006.stdout: 10 439791 32.79 MB/sec execute 582 sec latency 298.199 ms 2023-09-13T10:04:23.617 INFO:tasks.workunit.client.0.smithi006.stdout: 10 440288 32.79 MB/sec execute 583 sec latency 319.860 ms 2023-09-13T10:04:24.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:24 smithi006 ceph-mon[98665]: pgmap v1046: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 465 op/s 2023-09-13T10:04:25.475 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:24 smithi131 ceph-mon[102785]: pgmap v1046: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 465 op/s 2023-09-13T10:04:25.475 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:24 smithi053 ceph-mon[102373]: pgmap v1046: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 3.2 MiB/s wr, 465 op/s 2023-09-13T10:04:25.475 INFO:tasks.workunit.client.0.smithi006.stdout: 10 440775 32.77 MB/sec execute 584 sec latency 224.817 ms 2023-09-13T10:04:25.620 INFO:tasks.workunit.client.0.smithi006.stdout: 10 440895 32.72 MB/sec execute 585 sec latency 798.792 ms 2023-09-13T10:04:26.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:26 smithi006 ceph-mon[98665]: pgmap v1047: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 529 op/s 2023-09-13T10:04:26.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:26 smithi053 ceph-mon[102373]: pgmap v1047: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 529 op/s 2023-09-13T10:04:26.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:26 smithi131 ceph-mon[102785]: pgmap v1047: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 3.8 MiB/s wr, 529 op/s 2023-09-13T10:04:26.620 INFO:tasks.workunit.client.0.smithi006.stdout: 10 441191 32.70 MB/sec execute 586 sec latency 160.965 ms 2023-09-13T10:04:27.620 INFO:tasks.workunit.client.0.smithi006.stdout: 10 441676 32.69 MB/sec execute 587 sec latency 120.405 ms 2023-09-13T10:04:28.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:28 smithi006 ceph-mon[98665]: pgmap v1048: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 499 op/s 2023-09-13T10:04:28.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:28 smithi053 ceph-mon[102373]: pgmap v1048: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 499 op/s 2023-09-13T10:04:28.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:28 smithi131 ceph-mon[102785]: pgmap v1048: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 5.4 MiB/s wr, 499 op/s 2023-09-13T10:04:28.620 INFO:tasks.workunit.client.0.smithi006.stdout: 10 442251 32.69 MB/sec execute 588 sec latency 48.006 ms 2023-09-13T10:04:29.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:29 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:29.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:29 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:29.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:29 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:29.621 INFO:tasks.workunit.client.0.smithi006.stdout: 10 442801 32.68 MB/sec execute 589 sec latency 112.922 ms 2023-09-13T10:04:30.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:30 smithi006 ceph-mon[98665]: pgmap v1049: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.2 MiB/s wr, 586 op/s 2023-09-13T10:04:30.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:30 smithi053 ceph-mon[102373]: pgmap v1049: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.2 MiB/s wr, 586 op/s 2023-09-13T10:04:30.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:30 smithi131 ceph-mon[102785]: pgmap v1049: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 8.2 MiB/s wr, 586 op/s 2023-09-13T10:04:30.621 INFO:tasks.workunit.client.0.smithi006.stdout: 10 443115 32.65 MB/sec execute 590 sec latency 421.468 ms 2023-09-13T10:04:31.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 443566 32.63 MB/sec execute 591 sec latency 106.325 ms 2023-09-13T10:04:32.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:32 smithi053 ceph-mon[102373]: pgmap v1050: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 683 op/s 2023-09-13T10:04:32.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:32 smithi006 ceph-mon[98665]: pgmap v1050: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 683 op/s 2023-09-13T10:04:32.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:32 smithi131 ceph-mon[102785]: pgmap v1050: 97 pgs: 97 active+clean; 1.3 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 11 MiB/s wr, 683 op/s 2023-09-13T10:04:32.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 444271 32.65 MB/sec execute 592 sec latency 76.029 ms 2023-09-13T10:04:33.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 444853 32.66 MB/sec execute 593 sec latency 105.191 ms 2023-09-13T10:04:34.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:34 smithi053 ceph-mon[102373]: pgmap v1051: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 631 op/s 2023-09-13T10:04:34.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:34 smithi006 ceph-mon[98665]: pgmap v1051: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 631 op/s 2023-09-13T10:04:34.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:34 smithi131 ceph-mon[102785]: pgmap v1051: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 11 MiB/s wr, 631 op/s 2023-09-13T10:04:34.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 445410 32.65 MB/sec execute 594 sec latency 69.480 ms 2023-09-13T10:04:35.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 445893 32.63 MB/sec execute 595 sec latency 69.659 ms 2023-09-13T10:04:36.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:36 smithi006 ceph-mon[98665]: pgmap v1052: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 758 op/s 2023-09-13T10:04:36.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:36 smithi053 ceph-mon[102373]: pgmap v1052: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 758 op/s 2023-09-13T10:04:36.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:36 smithi131 ceph-mon[102785]: pgmap v1052: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 13 MiB/s wr, 758 op/s 2023-09-13T10:04:36.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 446507 32.63 MB/sec execute 596 sec latency 69.773 ms 2023-09-13T10:04:37.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 447136 32.64 MB/sec execute 597 sec latency 108.236 ms 2023-09-13T10:04:38.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:38 smithi006 ceph-mon[98665]: pgmap v1053: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 744 op/s 2023-09-13T10:04:38.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:38 smithi053 ceph-mon[102373]: pgmap v1053: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 744 op/s 2023-09-13T10:04:38.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:38 smithi131 ceph-mon[102785]: pgmap v1053: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 744 op/s 2023-09-13T10:04:38.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 447868 32.67 MB/sec execute 598 sec latency 48.772 ms 2023-09-13T10:04:39.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:39 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:39.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:39 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:39.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:39 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:39.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 448362 32.67 MB/sec execute 599 sec latency 70.379 ms 2023-09-13T10:04:40.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:40 smithi006 ceph-mon[98665]: pgmap v1054: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 709 op/s 2023-09-13T10:04:40.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:40 smithi053 ceph-mon[102373]: pgmap v1054: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 709 op/s 2023-09-13T10:04:40.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:40 smithi131 ceph-mon[102785]: pgmap v1054: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 11 MiB/s wr, 709 op/s 2023-09-13T10:04:40.622 INFO:tasks.workunit.client.0.smithi006.stdout: 10 cleanup 600 sec 2023-09-13T10:04:41.433 INFO:tasks.workunit.client.0.smithi006.stdout: 0 cleanup 601 sec 2023-09-13T10:04:41.433 INFO:tasks.workunit.client.0.smithi006.stdout: 2023-09-13T10:04:41.434 INFO:tasks.workunit.client.0.smithi006.stdout: Operation Count AvgLat MaxLat 2023-09-13T10:04:41.434 INFO:tasks.workunit.client.0.smithi006.stdout: ---------------------------------------- 2023-09-13T10:04:41.434 INFO:tasks.workunit.client.0.smithi006.stdout: NTCreateX 626309 4.056 1518.834 2023-09-13T10:04:41.434 INFO:tasks.workunit.client.0.smithi006.stdout: Close 459946 0.002 0.199 2023-09-13T10:04:41.434 INFO:tasks.workunit.client.0.smithi006.stdout: Rename 26529 17.072 1435.159 2023-09-13T10:04:41.435 INFO:tasks.workunit.client.0.smithi006.stdout: Unlink 126602 4.567 472.363 2023-09-13T10:04:41.435 INFO:tasks.workunit.client.0.smithi006.stdout: Deltree 10 182.906 389.148 2023-09-13T10:04:41.435 INFO:tasks.workunit.client.0.smithi006.stdout: Mkdir 5 0.007 0.008 2023-09-13T10:04:41.435 INFO:tasks.workunit.client.0.smithi006.stdout: Qpathinfo 567858 2.951 1592.464 2023-09-13T10:04:41.435 INFO:tasks.workunit.client.0.smithi006.stdout: Qfileinfo 99258 0.001 0.071 2023-09-13T10:04:41.436 INFO:tasks.workunit.client.0.smithi006.stdout: Qfsinfo 104131 0.853 97.777 2023-09-13T10:04:41.436 INFO:tasks.workunit.client.0.smithi006.stdout: Sfileinfo 51010 0.119 164.259 2023-09-13T10:04:41.436 INFO:tasks.workunit.client.0.smithi006.stdout: Find 219510 0.301 475.715 2023-09-13T10:04:41.437 INFO:tasks.workunit.client.0.smithi006.stdout: WriteX 311070 0.057 966.919 2023-09-13T10:04:41.437 INFO:tasks.workunit.client.0.smithi006.stdout: ReadX 981899 0.028 690.010 2023-09-13T10:04:41.437 INFO:tasks.workunit.client.0.smithi006.stdout: LockX 2038 3.164 172.377 2023-09-13T10:04:41.437 INFO:tasks.workunit.client.0.smithi006.stdout: UnlockX 2038 2.671 104.086 2023-09-13T10:04:41.437 INFO:tasks.workunit.client.0.smithi006.stdout: Flush 43891 11.932 1199.571 2023-09-13T10:04:41.438 INFO:tasks.workunit.client.0.smithi006.stdout: 2023-09-13T10:04:41.438 INFO:tasks.workunit.client.0.smithi006.stdout:Throughput 32.6715 MB/sec 10 clients 10 procs max_latency=1592.476 ms 2023-09-13T10:04:41.438 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-09-13T10:04:41.439 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-13T10:04:42.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:42 smithi006 ceph-mon[98665]: pgmap v1055: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.6 MiB/s wr, 653 op/s 2023-09-13T10:04:42.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:42 smithi053 ceph-mon[102373]: pgmap v1055: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.6 MiB/s wr, 653 op/s 2023-09-13T10:04:42.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:42 smithi131 ceph-mon[102785]: pgmap v1055: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.6 MiB/s wr, 653 op/s 2023-09-13T10:04:43.170 INFO:tasks.workunit:Stopping ['suites/dbench.sh'] on client.0... 2023-09-13T10:04:43.170 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-09-13T10:04:43.452 DEBUG:teuthology.parallel:result is None 2023-09-13T10:04:43.453 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-09-13T10:04:43.492 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-09-13T10:04:43.492 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-09-13T10:04:43.503 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-09-13T10:04:43.503 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-09-13T10:04:43.504 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-09-13T10:04:43.513 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T10:04:43.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/3401019327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f080ffc70 msgr2=0x7f1f08100090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:43.662 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/3401019327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f080ffc70 0x7f1f08100090 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f1ef80099c0 tx=0x7f1ef8009cd0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/3401019327 shutdown_connections 2023-09-13T10:04:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/3401019327 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f08101800 0x7f1f081080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.663 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/3401019327 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f080ffc70 0x7f1f08100090 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/3401019327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f08100e60 0x7f1f081012c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/3401019327 >> 172.21.15.6:0/3401019327 conn(0x7f1f080fb1c0 msgr2=0x7f1f080fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:43.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/3401019327 shutdown_connections 2023-09-13T10:04:43.664 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/3401019327 wait complete. 2023-09-13T10:04:43.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 Processor -- start 2023-09-13T10:04:43.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.658+0000 7f1f0dbbf700 1 -- start start 2023-09-13T10:04:43.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f080ffc70 0x7f1f08069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:43.665 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f08100e60 0x7f1f0819dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f08101800 0x7f1f081a0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f081a0860 con 0x7f1f08100e60 2023-09-13T10:04:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f081a09d0 con 0x7f1f080ffc70 2023-09-13T10:04:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f081a0b90 con 0x7f1f08101800 2023-09-13T10:04:43.666 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f08100e60 0x7f1f0819dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f08100e60 0x7f1f0819dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48502/0 (socket says 172.21.15.6:48502) 2023-09-13T10:04:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 -- 172.21.15.6:0/2748102440 learned_addr learned my addr 172.21.15.6:0/2748102440 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:04:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f077fe700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f080ffc70 0x7f1f08069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f07fff700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f08101800 0x7f1f081a0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:43.667 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 -- 172.21.15.6:0/2748102440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f08101800 msgr2=0x7f1f081a0180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:43.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f08101800 0x7f1f081a0180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 -- 172.21.15.6:0/2748102440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f080ffc70 msgr2=0x7f1f08069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:43.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f080ffc70 0x7f1f08069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 -- 172.21.15.6:0/2748102440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ef80095f0 con 0x7f1f08100e60 2023-09-13T10:04:43.668 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f06ffd700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f08100e60 0x7f1f0819dc30 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b530 tx=0x7f1efc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f04ff9700 1 -- 172.21.15.6:0/2748102440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc011830 con 0x7f1f08100e60 2023-09-13T10:04:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f04ff9700 1 -- 172.21.15.6:0/2748102440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1efc011e50 con 0x7f1f08100e60 2023-09-13T10:04:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f081a0e70 con 0x7f1f08100e60 2023-09-13T10:04:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f04ff9700 1 -- 172.21.15.6:0/2748102440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1efc00f2e0 con 0x7f1f08100e60 2023-09-13T10:04:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.659+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f081a1340 con 0x7f1f08100e60 2023-09-13T10:04:43.669 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.660+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f081072b0 con 0x7f1f08100e60 2023-09-13T10:04:43.670 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.661+0000 7f1f04ff9700 1 -- 172.21.15.6:0/2748102440 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1efc0105a0 con 0x7f1f08100e60 2023-09-13T10:04:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.662+0000 7f1f04ff9700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1ef00a06c0 0x7f1ef00a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.662+0000 7f1f077fe700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1ef00a06c0 0x7f1ef00a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.662+0000 7f1f04ff9700 1 -- 172.21.15.6:0/2748102440 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f1efc0cb550 con 0x7f1f08100e60 2023-09-13T10:04:43.671 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.662+0000 7f1f077fe700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1ef00a06c0 0x7f1ef00a2b80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009f50 tx=0x7f1ef800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:43.672 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.666+0000 7f1f04ff9700 1 -- 172.21.15.6:0/2748102440 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1efc095030 con 0x7f1f08100e60 2023-09-13T10:04:43.880 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.878+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1f0810b500 con 0x7f1f08100e60 2023-09-13T10:04:43.881 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.880+0000 7f1f04ff9700 1 -- 172.21.15.6:0/2748102440 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22537 (secure 0 0 0) 0x7f1efc098650 con 0x7f1f08100e60 2023-09-13T10:04:43.882 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:04:43.882 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:40:08.835826+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T10:04:43.884 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1ef00a06c0 msgr2=0x7f1ef00a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:43.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1ef00a06c0 0x7f1ef00a2b80 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8009f50 tx=0x7f1ef800b540 comp rx=0 tx=0).stop 2023-09-13T10:04:43.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f08100e60 msgr2=0x7f1f0819dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:43.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f08100e60 0x7f1f0819dc30 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f1efc00b530 tx=0x7f1efc00b840 comp rx=0 tx=0).stop 2023-09-13T10:04:43.885 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 shutdown_connections 2023-09-13T10:04:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f08101800 0x7f1f081a0180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f1f080ffc70 0x7f1f08069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f1ef00a06c0 0x7f1ef00a2b80 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 --2- 172.21.15.6:0/2748102440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f08100e60 0x7f1f0819dc30 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:43.886 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 >> 172.21.15.6:0/2748102440 conn(0x7f1f080fb1c0 msgr2=0x7f1f081043f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:43.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 shutdown_connections 2023-09-13T10:04:43.887 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:43.882+0000 7f1f0dbbf700 1 -- 172.21.15.6:0/2748102440 wait complete. 2023-09-13T10:04:43.897 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T10:04:43.897 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T10:04:44.030 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 -- 172.21.15.6:0/2451960729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6400ffcc0 msgr2=0x7fd6401000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 --2- 172.21.15.6:0/2451960729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6400ffcc0 0x7fd6401000e0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7fd6340099c0 tx=0x7fd634009cd0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 -- 172.21.15.6:0/2451960729 shutdown_connections 2023-09-13T10:04:44.031 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 --2- 172.21.15.6:0/2451960729 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd640101850 0x7fd640108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 --2- 172.21.15.6:0/2451960729 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd6400ffcc0 0x7fd6401000e0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 --2- 172.21.15.6:0/2451960729 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd640100eb0 0x7fd640101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 -- 172.21.15.6:0/2451960729 >> 172.21.15.6:0/2451960729 conn(0x7fd6400fb250 msgr2=0x7fd6400fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 -- 172.21.15.6:0/2451960729 shutdown_connections 2023-09-13T10:04:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 -- 172.21.15.6:0/2451960729 wait complete. 2023-09-13T10:04:44.033 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 Processor -- start 2023-09-13T10:04:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.029+0000 7fd645fac700 1 -- start start 2023-09-13T10:04:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd645fac700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6400ffcc0 0x7fd640068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd645fac700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd640100eb0 0x7fd64019b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd645fac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd640101850 0x7fd64019de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd645fac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64019e630 con 0x7fd640101850 2023-09-13T10:04:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd645fac700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64019e7a0 con 0x7fd640100eb0 2023-09-13T10:04:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd645fac700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd64019e960 con 0x7fd6400ffcc0 2023-09-13T10:04:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd640101850 0x7fd64019de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.036 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd640101850 0x7fd64019de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48518/0 (socket says 172.21.15.6:48518) 2023-09-13T10:04:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 -- 172.21.15.6:0/813461625 learned_addr learned my addr 172.21.15.6:0/813461625 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:04:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63effd700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd640100eb0 0x7fd64019b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63f7fe700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6400ffcc0 0x7fd640068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 -- 172.21.15.6:0/813461625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6400ffcc0 msgr2=0x7fd640068b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.037 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6400ffcc0 0x7fd640068b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 -- 172.21.15.6:0/813461625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd640100eb0 msgr2=0x7fd64019b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd640100eb0 0x7fd64019b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 -- 172.21.15.6:0/813461625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6340095f0 con 0x7fd640101850 2023-09-13T10:04:44.038 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63ffff700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd640101850 0x7fd64019de60 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fd638007ee0 tx=0x7fd63800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63cff9700 1 -- 172.21.15.6:0/813461625 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638017070 con 0x7fd640101850 2023-09-13T10:04:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63cff9700 1 -- 172.21.15.6:0/813461625 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fd63800f040 con 0x7fd640101850 2023-09-13T10:04:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.030+0000 7fd63cff9700 1 -- 172.21.15.6:0/813461625 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd638005740 con 0x7fd640101850 2023-09-13T10:04:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.031+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd64019ec40 con 0x7fd640101850 2023-09-13T10:04:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.031+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd64019f100 con 0x7fd640101850 2023-09-13T10:04:44.039 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.032+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd64010b520 con 0x7fd640101850 2023-09-13T10:04:44.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.033+0000 7fd63cff9700 1 -- 172.21.15.6:0/813461625 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fd63800dc60 con 0x7fd640101850 2023-09-13T10:04:44.040 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.034+0000 7fd63cff9700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6280a0640 0x7fd6280a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.034+0000 7fd63cff9700 1 -- 172.21.15.6:0/813461625 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fd6380cba30 con 0x7fd640101850 2023-09-13T10:04:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.034+0000 7fd63f7fe700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6280a0640 0x7fd6280a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.034+0000 7fd63f7fe700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6280a0640 0x7fd6280a2b00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd634009990 tx=0x7fd63401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:44.041 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.037+0000 7fd63cff9700 1 -- 172.21.15.6:0/813461625 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fd638095510 con 0x7fd640101850 2023-09-13T10:04:44.243 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.242+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd640106c10 con 0x7fd640101850 2023-09-13T10:04:44.244 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.242+0000 7fd63cff9700 1 -- 172.21.15.6:0/813461625 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd638098b30 con 0x7fd640101850 2023-09-13T10:04:44.244 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T10:04:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6280a0640 msgr2=0x7fd6280a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.246 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6280a0640 0x7fd6280a2b00 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd634009990 tx=0x7fd63401a040 comp rx=0 tx=0).stop 2023-09-13T10:04:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd640101850 msgr2=0x7fd64019de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd640101850 0x7fd64019de60 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7fd638007ee0 tx=0x7fd63800d3b0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 shutdown_connections 2023-09-13T10:04:44.247 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fd6280a0640 0x7fd6280a2b00 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd640101850 0x7fd64019de60 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6400ffcc0 0x7fd640068b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 --2- 172.21.15.6:0/813461625 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fd640100eb0 0x7fd64019b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 >> 172.21.15.6:0/813461625 conn(0x7fd6400fb250 msgr2=0x7fd6400fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:44.248 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 shutdown_connections 2023-09-13T10:04:44.249 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.244+0000 7fd645fac700 1 -- 172.21.15.6:0/813461625 wait complete. 2023-09-13T10:04:44.259 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T10:04:44.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 -- 172.21.15.6:0/3729135082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 msgr2=0x7f7a140ff4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.392 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 --2- 172.21.15.6:0/3729135082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a140ff4a0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7f7a04009990 tx=0x7f7a04009ca0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 -- 172.21.15.6:0/3729135082 shutdown_connections 2023-09-13T10:04:44.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 --2- 172.21.15.6:0/3729135082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a141029f0 0x7f7a141092a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 --2- 172.21.15.6:0/3729135082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a140ff4a0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 --2- 172.21.15.6:0/3729135082 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a14102050 0x7f7a141024b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.393 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 -- 172.21.15.6:0/3729135082 >> 172.21.15.6:0/3729135082 conn(0x7f7a140fa990 msgr2=0x7f7a140fcdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:44.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 -- 172.21.15.6:0/3729135082 shutdown_connections 2023-09-13T10:04:44.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.390+0000 7f7a19384700 1 -- 172.21.15.6:0/3729135082 wait complete. 2023-09-13T10:04:44.394 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 Processor -- start 2023-09-13T10:04:44.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 -- start start 2023-09-13T10:04:44.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a14198d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a14102050 0x7f7a14199280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a141029f0 0x7f7a141a02b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141a0880 con 0x7f7a140ff080 2023-09-13T10:04:44.397 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141a09f0 con 0x7f7a141029f0 2023-09-13T10:04:44.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a19384700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a141a0bb0 con 0x7f7a14102050 2023-09-13T10:04:44.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a12ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a14198d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a12ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a14198d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48528/0 (socket says 172.21.15.6:48528) 2023-09-13T10:04:44.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a12ffd700 1 -- 172.21.15.6:0/388128227 learned_addr learned my addr 172.21.15.6:0/388128227 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:04:44.398 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a127fc700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a14102050 0x7f7a14199280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.391+0000 7f7a137fe700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a141029f0 0x7f7a141a02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a12ffd700 1 -- 172.21.15.6:0/388128227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a14102050 msgr2=0x7f7a14199280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a12ffd700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a14102050 0x7f7a14199280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a12ffd700 1 -- 172.21.15.6:0/388128227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a141029f0 msgr2=0x7f7a141a02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a12ffd700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a141029f0 0x7f7a141a02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a12ffd700 1 -- 172.21.15.6:0/388128227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a040095f0 con 0x7f7a140ff080 2023-09-13T10:04:44.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a12ffd700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a14198d40 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f7a040095c0 tx=0x7f7a0400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:44.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f79fbfff700 1 -- 172.21.15.6:0/388128227 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a0401d070 con 0x7f7a140ff080 2023-09-13T10:04:44.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f79fbfff700 1 -- 172.21.15.6:0/388128227 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f7a04005030 con 0x7f7a140ff080 2023-09-13T10:04:44.400 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a141a0e30 con 0x7f7a140ff080 2023-09-13T10:04:44.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f79fbfff700 1 -- 172.21.15.6:0/388128227 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a04004ab0 con 0x7f7a140ff080 2023-09-13T10:04:44.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.392+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a141a11f0 con 0x7f7a140ff080 2023-09-13T10:04:44.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.393+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a141933b0 con 0x7f7a140ff080 2023-09-13T10:04:44.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.394+0000 7f79fbfff700 1 -- 172.21.15.6:0/388128227 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f7a04004c50 con 0x7f7a140ff080 2023-09-13T10:04:44.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.395+0000 7f79fbfff700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79fc0a06c0 0x7f79fc0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.401 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.395+0000 7f7a127fc700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79fc0a06c0 0x7f79fc0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.395+0000 7f79fbfff700 1 -- 172.21.15.6:0/388128227 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f7a040cce60 con 0x7f7a140ff080 2023-09-13T10:04:44.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.395+0000 7f7a127fc700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79fc0a06c0 0x7f79fc0a2b80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7a08005950 tx=0x7f7a0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:44.402 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.398+0000 7f79fbfff700 1 -- 172.21.15.6:0/388128227 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f7a040969d0 con 0x7f7a140ff080 2023-09-13T10:04:44.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:44 smithi053 ceph-mon[102373]: pgmap v1056: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 517 op/s 2023-09-13T10:04:44.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:44 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:44.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:44 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2748102440' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:04:44.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:44 smithi006 ceph-mon[98665]: pgmap v1056: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 517 op/s 2023-09-13T10:04:44.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:44 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:44.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:44 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2748102440' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:04:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:44 smithi131 ceph-mon[102785]: pgmap v1056: 97 pgs: 97 active+clean; 1.2 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 5.8 MiB/s wr, 517 op/s 2023-09-13T10:04:44.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:44 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:44.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:44 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2748102440' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:04:44.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.607+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a1410c750 con 0x7f7a140ff080 2023-09-13T10:04:44.609 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.607+0000 7f79fbfff700 1 -- 172.21.15.6:0/388128227 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a04099ff0 con 0x7f7a140ff080 2023-09-13T10:04:44.610 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T10:04:44.611 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.609+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79fc0a06c0 msgr2=0x7f79fc0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.609+0000 7f7a19384700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79fc0a06c0 0x7f79fc0a2b80 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7a08005950 tx=0x7f7a0800b410 comp rx=0 tx=0).stop 2023-09-13T10:04:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.609+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 msgr2=0x7f7a14198d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.609+0000 7f7a19384700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a14198d40 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7f7a040095c0 tx=0x7f7a0400f690 comp rx=0 tx=0).stop 2023-09-13T10:04:44.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 shutdown_connections 2023-09-13T10:04:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7a141029f0 0x7f7a141a02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f79fc0a06c0 0x7f79fc0a2b80 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a140ff080 0x7f7a14198d40 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 --2- 172.21.15.6:0/388128227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a14102050 0x7f7a14199280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 >> 172.21.15.6:0/388128227 conn(0x7f7a140fa990 msgr2=0x7f7a14107990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:44.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 shutdown_connections 2023-09-13T10:04:44.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.610+0000 7f7a19384700 1 -- 172.21.15.6:0/388128227 wait complete. 2023-09-13T10:04:44.624 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T10:04:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 -- 172.21.15.6:0/1556556139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c102950 msgr2=0x7fc48c109200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.771 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 --2- 172.21.15.6:0/1556556139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c102950 0x7fc48c109200 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7fc48400b0d0 tx=0x7fc48400b3e0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 -- 172.21.15.6:0/1556556139 shutdown_connections 2023-09-13T10:04:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 --2- 172.21.15.6:0/1556556139 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c102950 0x7fc48c109200 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 --2- 172.21.15.6:0/1556556139 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc48c100dc0 0x7fc48c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 --2- 172.21.15.6:0/1556556139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc48c101fb0 0x7fc48c102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.772 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 -- 172.21.15.6:0/1556556139 >> 172.21.15.6:0/1556556139 conn(0x7fc48c0fc330 msgr2=0x7fc48c0fe770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 -- 172.21.15.6:0/1556556139 shutdown_connections 2023-09-13T10:04:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 -- 172.21.15.6:0/1556556139 wait complete. 2023-09-13T10:04:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.767+0000 7fc493cd3700 1 Processor -- start 2023-09-13T10:04:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc493cd3700 1 -- start start 2023-09-13T10:04:44.773 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc493cd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c100dc0 0x7fc48c074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc493cd3700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc48c101fb0 0x7fc48c0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc493cd3700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc48c102950 0x7fc48c0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc493cd3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c073d80 con 0x7fc48c100dc0 2023-09-13T10:04:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc493cd3700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c073ef0 con 0x7fc48c102950 2023-09-13T10:04:44.774 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc493cd3700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48c1a0b90 con 0x7fc48c101fb0 2023-09-13T10:04:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c100dc0 0x7fc48c074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c100dc0 0x7fc48c074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48542/0 (socket says 172.21.15.6:48542) 2023-09-13T10:04:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 -- 172.21.15.6:0/2888961262 learned_addr learned my addr 172.21.15.6:0/2888961262 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:04:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc492270700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc48c102950 0x7fc48c0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.775 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc49126e700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc48c101fb0 0x7fc48c0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 -- 172.21.15.6:0/2888961262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc48c101fb0 msgr2=0x7fc48c0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc48c101fb0 0x7fc48c0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 -- 172.21.15.6:0/2888961262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc48c102950 msgr2=0x7fc48c0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc48c102950 0x7fc48c0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:44.776 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 -- 172.21.15.6:0/2888961262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc484009d00 con 0x7fc48c100dc0 2023-09-13T10:04:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc492270700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc48c102950 0x7fc48c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:04:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc491a6f700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c100dc0 0x7fc48c074a60 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00e970 tx=0x7fc47c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.768+0000 7fc482ffd700 1 -- 172.21.15.6:0/2888961262 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c009790 con 0x7fc48c100dc0 2023-09-13T10:04:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.769+0000 7fc482ffd700 1 -- 172.21.15.6:0/2888961262 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fc47c00c7e0 con 0x7fc48c100dc0 2023-09-13T10:04:44.777 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.769+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48c1a0e70 con 0x7fc48c100dc0 2023-09-13T10:04:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.769+0000 7fc482ffd700 1 -- 172.21.15.6:0/2888961262 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c003c70 con 0x7fc48c100dc0 2023-09-13T10:04:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.769+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48c1a1290 con 0x7fc48c100dc0 2023-09-13T10:04:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.770+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48c10c5e0 con 0x7fc48c100dc0 2023-09-13T10:04:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.771+0000 7fc482ffd700 1 -- 172.21.15.6:0/2888961262 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fc47c00cc50 con 0x7fc48c100dc0 2023-09-13T10:04:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.771+0000 7fc482ffd700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4780a0640 0x7fc4780a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.771+0000 7fc482ffd700 1 -- 172.21.15.6:0/2888961262 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fc47c014070 con 0x7fc48c100dc0 2023-09-13T10:04:44.779 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.771+0000 7fc49126e700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4780a0640 0x7fc4780a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.772+0000 7fc49126e700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4780a0640 0x7fc4780a2b00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc488009c60 tx=0x7fc488009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:44.780 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:44.776+0000 7fc482ffd700 1 -- 172.21.15.6:0/2888961262 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fc47c095880 con 0x7fc48c100dc0 2023-09-13T10:04:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.002+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc48c107c40 con 0x7fc48c100dc0 2023-09-13T10:04:45.004 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.002+0000 7fc482ffd700 1 -- 172.21.15.6:0/2888961262 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc47c003dd0 con 0x7fc48c100dc0 2023-09-13T10:04:45.005 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T10:04:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4780a0640 msgr2=0x7fc4780a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:45.006 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4780a0640 0x7fc4780a2b00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fc488009c60 tx=0x7fc488009260 comp rx=0 tx=0).stop 2023-09-13T10:04:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c100dc0 msgr2=0x7fc48c074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c100dc0 0x7fc48c074a60 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00e970 tx=0x7fc47c00ec80 comp rx=0 tx=0).stop 2023-09-13T10:04:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 shutdown_connections 2023-09-13T10:04:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fc48c102950 0x7fc48c0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.007 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fc4780a0640 0x7fc4780a2b00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc48c100dc0 0x7fc48c074a60 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 --2- 172.21.15.6:0/2888961262 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc48c101fb0 0x7fc48c0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 >> 172.21.15.6:0/2888961262 conn(0x7fc48c0fc330 msgr2=0x7fc48c0fe550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 shutdown_connections 2023-09-13T10:04:45.008 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.005+0000 7fc493cd3700 1 -- 172.21.15.6:0/2888961262 wait complete. 2023-09-13T10:04:45.019 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-09-13T10:04:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 -- 172.21.15.6:0/3550137141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc101820 msgr2=0x7f86fc1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 --2- 172.21.15.6:0/3550137141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc101820 0x7f86fc1080d0 secure :-1 s=READY pgs=1992 cs=0 l=1 rev1=1 crypto rx=0x7f86f400b0d0 tx=0x7f86f400b3e0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 -- 172.21.15.6:0/3550137141 shutdown_connections 2023-09-13T10:04:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 --2- 172.21.15.6:0/3550137141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc101820 0x7f86fc1080d0 unknown :-1 s=CLOSED pgs=1992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 --2- 172.21.15.6:0/3550137141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86fc0ffc90 0x7f86fc1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 --2- 172.21.15.6:0/3550137141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86fc100e80 0x7f86fc1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 -- 172.21.15.6:0/3550137141 >> 172.21.15.6:0/3550137141 conn(0x7f86fc0fb220 msgr2=0x7f86fc0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:45.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 -- 172.21.15.6:0/3550137141 shutdown_connections 2023-09-13T10:04:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 -- 172.21.15.6:0/3550137141 wait complete. 2023-09-13T10:04:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.146+0000 7f8702813700 1 Processor -- start 2023-09-13T10:04:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8702813700 1 -- start start 2023-09-13T10:04:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8702813700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0ffc90 0x7f86fc103c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:45.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8702813700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86fc100e80 0x7f86fc102260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8702813700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86fc101820 0x7f86fc1027a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8702813700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc102f40 con 0x7f86fc0ffc90 2023-09-13T10:04:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8702813700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc1030b0 con 0x7f86fc101820 2023-09-13T10:04:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8702813700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc1a0c10 con 0x7f86fc100e80 2023-09-13T10:04:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0ffc90 0x7f86fc103c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:45.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0ffc90 0x7f86fc103c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48556/0 (socket says 172.21.15.6:48556) 2023-09-13T10:04:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 -- 172.21.15.6:0/514188809 learned_addr learned my addr 172.21.15.6:0/514188809 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:04:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f8700db0700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86fc101820 0x7f86fc1027a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fb7fe700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86fc100e80 0x7f86fc102260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:45.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 -- 172.21.15.6:0/514188809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86fc100e80 msgr2=0x7f86fc102260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86fc100e80 0x7f86fc102260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 -- 172.21.15.6:0/514188809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86fc101820 msgr2=0x7f86fc1027a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86fc101820 0x7f86fc1027a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 -- 172.21.15.6:0/514188809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4009d00 con 0x7f86fc0ffc90 2023-09-13T10:04:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fb7fe700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86fc100e80 0x7f86fc102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:04:45.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.147+0000 7f86fbfff700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0ffc90 0x7f86fc103c20 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00d980 tx=0x7f86ec00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.148+0000 7f86f97fa700 1 -- 172.21.15.6:0/514188809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec004020 con 0x7f86fc0ffc90 2023-09-13T10:04:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.148+0000 7f86f97fa700 1 -- 172.21.15.6:0/514188809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86ec009730 con 0x7f86fc0ffc90 2023-09-13T10:04:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.148+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc1a0ef0 con 0x7f86fc0ffc90 2023-09-13T10:04:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.148+0000 7f86f97fa700 1 -- 172.21.15.6:0/514188809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ec003a80 con 0x7f86fc0ffc90 2023-09-13T10:04:45.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.148+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc1a1370 con 0x7f86fc0ffc90 2023-09-13T10:04:45.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.149+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc10b500 con 0x7f86fc0ffc90 2023-09-13T10:04:45.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.150+0000 7f86f97fa700 1 -- 172.21.15.6:0/514188809 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f86ec0098a0 con 0x7f86fc0ffc90 2023-09-13T10:04:45.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.150+0000 7f86f97fa700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86e40a06c0 0x7f86e40a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:04:45.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.151+0000 7f86fb7fe700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86e40a06c0 0x7f86e40a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:04:45.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.151+0000 7f86f97fa700 1 -- 172.21.15.6:0/514188809 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f86ec0cbbc0 con 0x7f86fc0ffc90 2023-09-13T10:04:45.158 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.151+0000 7f86fb7fe700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86e40a06c0 0x7f86e40a2b80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009cb0 tx=0x7f86f0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:04:45.159 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.154+0000 7f86f97fa700 1 -- 172.21.15.6:0/514188809 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f86ec095720 con 0x7f86fc0ffc90 2023-09-13T10:04:45.424 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.423+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f86fc10b720 con 0x7f86fc0ffc90 2023-09-13T10:04:45.432 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.431+0000 7f86f97fa700 1 -- 172.21.15.6:0/514188809 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) v1 ==== 81+0+729885 (secure 0 0 0) 0x7f86ec098d40 con 0x7f86fc0ffc90 2023-09-13T10:04:45.443 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:04:45.444 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:04:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "epoch": 18, 2023-09-13T10:04:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "active_gid": 14152, 2023-09-13T10:04:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "active_name": "x", 2023-09-13T10:04:45.444 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addrs": { 2023-09-13T10:04:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-09-13T10:04:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-09-13T10:04:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6800", 2023-09-13T10:04:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1364175161 2023-09-13T10:04:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2023-09-13T10:04:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:6801", 2023-09-13T10:04:45.446 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1364175161 2023-09-13T10:04:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "active_addr": "172.21.15.6:6801/1364175161", 2023-09-13T10:04:45.447 INFO:teuthology.orchestra.run.smithi006.stdout: "active_change": "2023-09-13T09:32:06.061995+0000", 2023-09-13T10:04:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "active_mgr_features": 4540138322906710015, 2023-09-13T10:04:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "available": true, 2023-09-13T10:04:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "standbys": [ 2023-09-13T10:04:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.448 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24109, 2023-09-13T10:04:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "z", 2023-09-13T10:04:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540138322906710015, 2023-09-13T10:04:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2023-09-13T10:04:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2023-09-13T10:04:45.449 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:45.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2023-09-13T10:04:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.452 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.453 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.454 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.455 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.456 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.457 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.458 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:45.459 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.460 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.461 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.463 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.464 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.465 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.466 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2023-09-13T10:04:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2023-09-13T10:04:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.467 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.468 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2023-09-13T10:04:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.469 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2023-09-13T10:04:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2023-09-13T10:04:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.470 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2023-09-13T10:04:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.471 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2023-09-13T10:04:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.472 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2023-09-13T10:04:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2023-09-13T10:04:45.473 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.474 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.475 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2023-09-13T10:04:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.476 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2023-09-13T10:04:45.477 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2023-09-13T10:04:45.477 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.477 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.478 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.478 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.478 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2023-09-13T10:04:45.478 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.478 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.479 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.479 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.479 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2023-09-13T10:04:45.479 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2023-09-13T10:04:45.479 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.480 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.480 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.480 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2023-09-13T10:04:45.480 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.480 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.480 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.481 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2023-09-13T10:04:45.481 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.481 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.481 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.482 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2023-09-13T10:04:45.482 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2023-09-13T10:04:45.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.482 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.483 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.483 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.483 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.483 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.483 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2023-09-13T10:04:45.483 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.484 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.484 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.484 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.484 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2023-09-13T10:04:45.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2023-09-13T10:04:45.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.485 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.485 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.485 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.486 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.486 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.486 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.486 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-13T10:04:45.486 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.487 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2023-09-13T10:04:45.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2023-09-13T10:04:45.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.488 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.489 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.489 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.489 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.489 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2023-09-13T10:04:45.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.490 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.490 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.490 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.490 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.491 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2023-09-13T10:04:45.491 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:45.491 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:45.491 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.491 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2023-09-13T10:04:45.492 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2023-09-13T10:04:45.492 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.492 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.492 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.492 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.492 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.493 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.493 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.493 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2023-09-13T10:04:45.493 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.493 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.494 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.494 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.494 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2023-09-13T10:04:45.494 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2023-09-13T10:04:45.494 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.495 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.495 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.495 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2023-09-13T10:04:45.495 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.495 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.496 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.496 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2023-09-13T10:04:45.496 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-13T10:04:45.496 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.496 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.497 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.497 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2023-09-13T10:04:45.497 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2023-09-13T10:04:45.497 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:45.498 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.498 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.498 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:45.498 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-09-13T10:04:45.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-09-13T10:04:45.499 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.499 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-13T10:04:45.499 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-13T10:04:45.500 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.500 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.500 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.500 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2023-09-13T10:04:45.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2023-09-13T10:04:45.501 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:45.501 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.501 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.501 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2023-09-13T10:04:45.502 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:45.502 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2023-09-13T10:04:45.502 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.502 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-13T10:04:45.503 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.503 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.503 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.503 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.504 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2023-09-13T10:04:45.504 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2023-09-13T10:04:45.504 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.504 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.505 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.505 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2023-09-13T10:04:45.505 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.506 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.506 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.506 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-13T10:04:45.506 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-13T10:04:45.507 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.507 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.507 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.508 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2023-09-13T10:04:45.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2023-09-13T10:04:45.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:45.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.509 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.509 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2023-09-13T10:04:45.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2023-09-13T10:04:45.509 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2023-09-13T10:04:45.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.510 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2023-09-13T10:04:45.510 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-13T10:04:45.510 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.510 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.511 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.511 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2023-09-13T10:04:45.511 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2023-09-13T10:04:45.511 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.511 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2023-09-13T10:04:45.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.512 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2023-09-13T10:04:45.513 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-13T10:04:45.513 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.513 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.513 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2023-09-13T10:04:45.513 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2023-09-13T10:04:45.514 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:45.514 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.514 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.514 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:45.514 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-09-13T10:04:45.515 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-09-13T10:04:45.515 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.515 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-13T10:04:45.515 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-13T10:04:45.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.516 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.516 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:45.516 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:45.516 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.516 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.517 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.517 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.517 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.517 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.518 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.518 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.518 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.518 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.518 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.518 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.519 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.519 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.519 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.520 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:45.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:45.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.520 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.521 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.521 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.521 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.522 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.522 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.522 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.522 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.522 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.523 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:45.523 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:45.523 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.523 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.524 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.524 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:45.524 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.524 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.524 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.524 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.525 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.525 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.525 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.525 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.525 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.526 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.526 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.526 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.526 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.526 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.527 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:45.527 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:45.527 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.527 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.528 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.528 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.528 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.528 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.529 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.529 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.529 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.529 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.530 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.530 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.530 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2023-09-13T10:04:45.530 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2023-09-13T10:04:45.531 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:45.531 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.531 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.532 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:45.532 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.532 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.532 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.532 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-13T10:04:45.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.533 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.533 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.533 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-09-13T10:04:45.533 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-09-13T10:04:45.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.534 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.534 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.534 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2023-09-13T10:04:45.534 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.534 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.535 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.535 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2023-09-13T10:04:45.535 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2023-09-13T10:04:45.535 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap" 2023-09-13T10:04:45.535 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2023-09-13T10:04:45.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.537 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2023-09-13T10:04:45.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2023-09-13T10:04:45.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.538 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.539 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.539 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.539 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.540 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-13T10:04:45.540 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.540 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.541 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.541 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.541 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:45.542 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:45.542 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.542 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.543 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.543 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:45.543 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.543 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.544 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.544 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-13T10:04:45.544 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.544 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.545 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.545 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.545 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2023-09-13T10:04:45.545 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2023-09-13T10:04:45.545 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.546 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.546 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.546 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:45.546 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:45.546 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.546 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-13T10:04:45.547 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-13T10:04:45.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.547 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.547 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.548 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2023-09-13T10:04:45.548 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2023-09-13T10:04:45.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:45.548 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.548 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.549 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:45.549 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.549 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.549 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.549 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-13T10:04:45.549 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.550 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.550 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.551 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2023-09-13T10:04:45.551 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:45.551 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:45.551 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.552 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2023-09-13T10:04:45.552 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2023-09-13T10:04:45.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:45.552 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.552 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-09-13T10:04:45.553 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.553 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.553 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.553 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-13T10:04:45.553 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.554 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.554 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2023-09-13T10:04:45.554 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2023-09-13T10:04:45.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.555 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.555 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2023-09-13T10:04:45.555 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.556 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-13T10:04:45.556 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.556 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.556 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.556 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.557 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2023-09-13T10:04:45.557 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2023-09-13T10:04:45.557 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.557 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.557 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.557 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2023-09-13T10:04:45.558 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.558 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.558 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.558 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-13T10:04:45.558 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.559 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.559 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.559 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.559 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2023-09-13T10:04:45.559 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2023-09-13T10:04:45.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.560 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.560 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.560 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.560 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.561 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.561 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.561 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-13T10:04:45.561 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-13T10:04:45.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.561 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.562 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2023-09-13T10:04:45.562 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2023-09-13T10:04:45.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.562 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.563 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.563 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:45.563 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.563 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.563 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.563 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-13T10:04:45.564 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.564 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.564 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.564 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.564 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2023-09-13T10:04:45.565 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2023-09-13T10:04:45.565 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:45.565 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.566 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2023-09-13T10:04:45.566 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.566 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.566 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.566 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-13T10:04:45.567 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.567 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.567 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.567 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.567 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2023-09-13T10:04:45.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2023-09-13T10:04:45.568 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.568 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.568 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.568 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.569 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.569 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.569 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-13T10:04:45.570 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.570 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.570 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.570 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.570 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2023-09-13T10:04:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2023-09-13T10:04:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-13T10:04:45.573 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.573 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.573 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.573 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.574 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2023-09-13T10:04:45.574 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2023-09-13T10:04:45.574 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.574 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.575 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.575 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.575 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.575 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.576 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.576 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-13T10:04:45.576 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.576 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.577 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.577 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2023-09-13T10:04:45.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2023-09-13T10:04:45.578 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.578 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.578 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.578 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-13T10:04:45.579 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.579 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.579 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.579 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:45.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.580 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.580 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2023-09-13T10:04:45.580 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2023-09-13T10:04:45.580 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-13T10:04:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.581 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.582 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2023-09-13T10:04:45.582 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.582 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.582 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.582 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.583 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2023-09-13T10:04:45.583 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2023-09-13T10:04:45.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.583 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.583 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.583 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-13T10:04:45.584 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.584 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.584 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.584 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2023-09-13T10:04:45.584 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.585 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.585 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.585 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2023-09-13T10:04:45.585 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2023-09-13T10:04:45.585 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.586 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.586 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-13T10:04:45.586 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.586 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.587 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.587 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:45.587 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.587 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.587 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.588 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2023-09-13T10:04:45.588 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2023-09-13T10:04:45.588 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.588 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.588 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.589 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-13T10:04:45.589 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.589 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.589 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.589 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2023-09-13T10:04:45.589 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.590 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.590 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.590 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2023-09-13T10:04:45.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2023-09-13T10:04:45.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.591 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.591 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-13T10:04:45.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.592 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.592 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2023-09-13T10:04:45.592 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.592 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.593 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.593 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2023-09-13T10:04:45.593 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2023-09-13T10:04:45.593 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.594 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.594 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.594 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-13T10:04:45.594 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.594 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.595 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.595 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2023-09-13T10:04:45.595 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.595 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.595 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.596 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2023-09-13T10:04:45.596 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2023-09-13T10:04:45.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.597 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-13T10:04:45.597 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.597 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.597 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.597 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2023-09-13T10:04:45.597 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.598 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.598 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.599 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2023-09-13T10:04:45.599 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2023-09-13T10:04:45.599 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.599 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.599 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.600 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-13T10:04:45.600 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.600 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.600 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.600 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2023-09-13T10:04:45.601 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.601 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.601 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.601 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.602 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2023-09-13T10:04:45.602 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2023-09-13T10:04:45.602 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.602 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.602 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.603 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-13T10:04:45.603 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.603 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.603 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.604 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2023-09-13T10:04:45.604 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.604 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.604 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.605 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2023-09-13T10:04:45.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2023-09-13T10:04:45.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.605 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.606 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-13T10:04:45.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.606 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.607 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.607 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:45.607 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.608 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2023-09-13T10:04:45.608 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2023-09-13T10:04:45.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.609 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.609 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.609 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-09-13T10:04:45.609 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.610 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.610 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.610 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2023-09-13T10:04:45.611 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.611 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.611 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.611 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.611 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2023-09-13T10:04:45.612 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2023-09-13T10:04:45.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.612 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.612 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.613 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-13T10:04:45.613 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.613 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.613 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.614 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:45.614 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.614 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.614 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.615 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2023-09-13T10:04:45.615 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2023-09-13T10:04:45.615 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.615 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.616 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-13T10:04:45.616 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.616 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.616 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.617 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2023-09-13T10:04:45.617 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.617 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.617 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.617 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.617 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2023-09-13T10:04:45.618 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2023-09-13T10:04:45.618 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.618 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.618 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.618 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-13T10:04:45.619 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.619 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.619 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.619 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2023-09-13T10:04:45.619 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.620 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.620 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2023-09-13T10:04:45.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2023-09-13T10:04:45.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.621 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.622 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2023-09-13T10:04:45.622 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.622 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.623 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2023-09-13T10:04:45.623 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2023-09-13T10:04:45.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.623 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.624 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:45.624 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.624 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.624 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-13T10:04:45.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.625 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.625 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.625 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2023-09-13T10:04:45.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2023-09-13T10:04:45.626 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.626 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.626 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2023-09-13T10:04:45.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.627 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.627 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-13T10:04:45.627 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.627 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.628 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.628 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.628 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2023-09-13T10:04:45.628 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2023-09-13T10:04:45.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.628 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.629 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.629 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2023-09-13T10:04:45.629 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.629 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.629 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.630 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-13T10:04:45.630 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.630 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.630 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.630 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2023-09-13T10:04:45.631 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2023-09-13T10:04:45.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.631 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.631 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2023-09-13T10:04:45.632 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.632 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.632 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.632 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2023-09-13T10:04:45.632 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.632 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.633 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.633 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2023-09-13T10:04:45.633 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2023-09-13T10:04:45.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.634 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.634 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.634 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.634 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.634 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.635 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.635 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-13T10:04:45.635 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.635 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.635 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.636 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2023-09-13T10:04:45.636 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2023-09-13T10:04:45.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.636 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.636 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.637 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:45.637 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.637 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.637 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.638 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2023-09-13T10:04:45.638 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.638 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.638 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.639 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2023-09-13T10:04:45.639 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2023-09-13T10:04:45.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.639 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.640 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:45.640 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.640 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.640 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.641 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2023-09-13T10:04:45.641 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.641 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.641 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.642 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2023-09-13T10:04:45.642 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2023-09-13T10:04:45.642 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.642 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.643 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.643 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.643 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.643 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.643 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.644 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-09-13T10:04:45.644 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.644 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.645 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:45.645 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:45.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.645 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.646 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.646 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.646 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.647 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.647 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.647 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.647 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.647 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.648 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.648 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.648 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.648 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.649 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.649 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.649 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.649 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.650 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2023-09-13T10:04:45.650 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2023-09-13T10:04:45.650 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.650 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.651 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.651 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.651 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.651 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.652 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.652 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-13T10:04:45.652 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.652 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.652 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.653 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:45.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:45.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.654 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.654 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.654 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.654 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-13T10:04:45.655 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.655 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.655 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:45.656 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:45.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.656 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.656 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.656 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:45.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.657 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.657 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.657 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.657 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.657 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.658 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.658 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.658 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.658 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.658 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.658 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.659 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.659 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.659 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.659 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:45.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:45.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.660 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.660 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.660 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.660 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.660 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.661 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.661 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.661 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.661 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.661 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.661 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.662 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-13T10:04:45.662 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-13T10:04:45.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.662 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.662 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.663 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.663 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.663 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.663 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-13T10:04:45.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.664 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.664 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-13T10:04:45.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-13T10:04:45.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.665 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.665 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2023-09-13T10:04:45.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.666 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.666 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-13T10:04:45.666 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.666 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.667 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.667 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2023-09-13T10:04:45.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2023-09-13T10:04:45.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.668 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.668 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.668 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:45.668 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.668 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.668 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.669 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2023-09-13T10:04:45.669 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.669 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.669 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.669 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2023-09-13T10:04:45.670 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2023-09-13T10:04:45.670 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.670 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.670 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:45.671 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.671 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.671 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.671 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-13T10:04:45.671 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.672 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.672 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.672 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.672 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2023-09-13T10:04:45.672 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2023-09-13T10:04:45.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.673 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.673 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.673 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.673 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.674 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.674 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2023-09-13T10:04:45.674 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.674 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.675 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.675 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-09-13T10:04:45.675 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-09-13T10:04:45.675 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.676 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.676 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.676 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2023-09-13T10:04:45.676 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.677 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2023-09-13T10:04:45.677 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2023-09-13T10:04:45.677 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.677 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2023-09-13T10:04:45.678 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.678 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.679 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2023-09-13T10:04:45.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2023-09-13T10:04:45.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.679 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.679 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-13T10:04:45.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.680 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.680 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.681 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-13T10:04:45.681 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.681 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.681 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.681 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.682 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2023-09-13T10:04:45.682 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2023-09-13T10:04:45.682 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.682 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.683 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-13T10:04:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.684 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2023-09-13T10:04:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2023-09-13T10:04:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.685 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-13T10:04:45.686 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.687 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2023-09-13T10:04:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2023-09-13T10:04:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.688 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.689 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-13T10:04:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.690 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.691 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2023-09-13T10:04:45.691 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2023-09-13T10:04:45.691 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.691 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.692 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.692 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.692 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.692 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.693 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-13T10:04:45.693 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.693 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2023-09-13T10:04:45.694 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2023-09-13T10:04:45.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.694 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.694 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.694 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.695 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.695 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.695 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-13T10:04:45.695 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.697 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.697 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.697 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2023-09-13T10:04:45.698 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2023-09-13T10:04:45.698 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.698 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.698 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.698 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2023-09-13T10:04:45.699 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.699 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.699 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2023-09-13T10:04:45.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.700 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.700 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2023-09-13T10:04:45.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2023-09-13T10:04:45.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-13T10:04:45.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.703 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2023-09-13T10:04:45.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2023-09-13T10:04:45.703 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.703 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.704 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.704 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-13T10:04:45.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.705 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.705 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.705 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2023-09-13T10:04:45.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2023-09-13T10:04:45.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.706 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.706 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.706 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.707 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.707 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.707 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.707 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-13T10:04:45.707 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.708 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2023-09-13T10:04:45.708 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2023-09-13T10:04:45.708 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.709 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.709 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.709 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2023-09-13T10:04:45.710 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.710 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.711 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2023-09-13T10:04:45.711 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2023-09-13T10:04:45.711 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.713 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-13T10:04:45.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.713 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.713 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.714 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2023-09-13T10:04:45.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2023-09-13T10:04:45.714 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.715 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.715 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.716 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.716 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-13T10:04:45.716 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.716 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.717 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.717 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.717 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.717 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.718 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2023-09-13T10:04:45.718 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:45.718 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:45.718 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.719 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:45.719 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:45.719 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.719 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.719 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.720 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.720 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.720 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.720 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.721 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.722 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.722 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.722 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.722 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.723 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.723 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.723 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.723 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.724 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:45.724 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:45.724 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.724 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.725 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.725 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.725 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.725 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.726 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.726 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.726 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.726 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.726 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.727 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:45.727 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:45.727 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.727 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.727 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.727 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:45.728 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.728 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.728 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.728 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.728 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.729 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.729 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.729 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.729 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.729 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.730 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.730 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.730 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.730 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.730 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:45.731 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:45.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.731 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.731 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.732 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.732 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.732 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.733 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.733 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2023-09-13T10:04:45.733 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2023-09-13T10:04:45.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.734 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2023-09-13T10:04:45.734 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.734 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.734 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-13T10:04:45.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.735 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.736 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2023-09-13T10:04:45.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2023-09-13T10:04:45.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.736 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.737 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2023-09-13T10:04:45.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-13T10:04:45.737 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.738 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.738 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.738 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.738 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.739 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.739 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2023-09-13T10:04:45.739 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:45.739 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:45.740 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.740 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-13T10:04:45.740 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-13T10:04:45.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.740 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.741 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:45.741 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.741 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.742 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.742 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.742 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.742 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.743 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.743 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2023-09-13T10:04:45.743 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-13T10:04:45.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.743 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.744 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.744 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.744 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.744 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.744 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.745 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.745 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.745 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.745 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.745 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.746 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-13T10:04:45.746 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-13T10:04:45.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.747 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.748 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.748 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.748 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.748 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.749 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.749 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2023-09-13T10:04:45.749 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2023-09-13T10:04:45.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.750 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.750 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.751 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.751 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.751 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.751 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.752 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.752 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.752 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.753 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-13T10:04:45.753 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-13T10:04:45.753 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.753 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.754 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.754 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.755 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.755 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.755 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.755 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.756 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.756 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.756 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2023-09-13T10:04:45.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-13T10:04:45.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.757 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.757 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.757 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.758 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.758 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.758 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.758 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.758 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.759 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.759 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-13T10:04:45.759 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-13T10:04:45.759 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.760 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.760 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.760 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.760 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.761 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.761 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.761 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.761 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.762 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.762 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-13T10:04:45.763 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-13T10:04:45.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.763 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.763 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.764 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.764 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.764 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.764 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.764 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.764 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.765 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.765 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.765 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-13T10:04:45.765 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-13T10:04:45.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.766 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.766 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.766 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.766 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.766 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.767 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.767 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.767 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.767 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.767 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.768 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-13T10:04:45.768 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-13T10:04:45.768 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.768 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.769 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.769 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.769 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.769 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.769 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.770 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.770 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.770 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.770 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.770 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-13T10:04:45.770 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-13T10:04:45.771 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.771 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.771 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.771 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.771 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.772 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.772 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.772 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.772 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.772 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.773 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-13T10:04:45.773 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-13T10:04:45.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.773 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.774 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.774 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.775 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.776 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-13T10:04:45.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-13T10:04:45.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.776 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.776 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.777 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.777 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.777 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.777 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.778 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.778 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-13T10:04:45.778 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-13T10:04:45.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.779 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.779 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.780 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.780 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.780 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.780 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.781 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2023-09-13T10:04:45.781 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-13T10:04:45.781 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.781 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.782 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.782 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:45.782 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.782 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.782 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.783 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.783 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.783 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.783 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.784 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-13T10:04:45.784 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-13T10:04:45.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.784 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.784 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.785 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.785 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.785 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.785 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.786 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.786 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.786 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.787 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2023-09-13T10:04:45.787 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2023-09-13T10:04:45.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.787 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.788 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.789 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.789 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.789 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.789 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.790 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2023-09-13T10:04:45.790 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-13T10:04:45.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.790 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.791 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.791 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:45.791 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.791 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.792 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.792 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.792 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.792 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.793 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.793 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.793 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-13T10:04:45.793 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-13T10:04:45.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.794 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.794 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.795 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.795 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.795 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.795 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.796 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.796 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.796 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.797 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-13T10:04:45.797 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-13T10:04:45.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.797 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.797 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.797 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.798 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.798 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.798 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.798 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.799 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.799 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.799 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.799 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-13T10:04:45.799 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-13T10:04:45.799 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.800 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.800 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.800 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.800 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.800 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.801 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.801 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.801 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.801 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.801 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.802 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-13T10:04:45.802 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-13T10:04:45.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.802 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.802 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.803 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2023-09-13T10:04:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-13T10:04:45.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.805 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.807 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-13T10:04:45.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-13T10:04:45.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.807 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.807 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.808 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.808 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.808 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.808 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.809 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.809 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-13T10:04:45.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-13T10:04:45.810 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.810 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.811 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.811 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.811 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.811 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.811 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.812 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.812 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-13T10:04:45.812 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-13T10:04:45.812 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.812 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.813 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.813 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.813 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.813 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.813 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.813 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.814 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.814 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.814 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.814 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.814 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-13T10:04:45.815 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-13T10:04:45.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.815 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.815 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.815 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.815 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.816 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.816 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.816 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.816 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.817 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.817 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.817 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.817 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-13T10:04:45.817 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-13T10:04:45.818 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.818 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.818 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.818 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.819 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.819 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.819 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.819 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.819 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.820 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.820 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.820 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-13T10:04:45.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-13T10:04:45.821 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.822 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.822 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.822 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.823 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.823 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.823 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.823 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-13T10:04:45.824 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-13T10:04:45.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.824 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.825 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.825 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.825 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.825 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.825 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.826 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.826 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.827 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-13T10:04:45.827 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-13T10:04:45.827 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.827 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.828 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.828 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.828 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.828 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.829 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.829 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.829 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.829 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.829 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.830 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2023-09-13T10:04:45.830 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-13T10:04:45.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.830 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.831 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.831 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.831 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.831 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.831 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.832 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.832 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.832 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.833 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-13T10:04:45.833 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-13T10:04:45.833 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.833 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.834 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-13T10:04:45.834 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.834 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.834 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.834 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.835 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.835 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.835 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.835 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.835 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-13T10:04:45.835 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-13T10:04:45.836 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.836 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.836 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.836 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:45.836 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.837 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.837 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.837 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.837 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.838 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-13T10:04:45.838 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-13T10:04:45.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.838 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.839 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.839 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2023-09-13T10:04:45.839 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.839 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.840 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.840 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.840 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.840 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-13T10:04:45.841 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-13T10:04:45.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.841 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.841 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.841 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2023-09-13T10:04:45.842 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.842 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.842 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.843 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.843 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.843 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.844 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.844 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2023-09-13T10:04:45.844 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-13T10:04:45.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.845 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.845 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.846 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.846 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.847 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.847 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.847 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.848 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-13T10:04:45.848 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-13T10:04:45.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.849 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.849 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.849 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:45.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.850 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.850 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.851 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.851 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.851 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.851 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.852 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2023-09-13T10:04:45.852 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-13T10:04:45.852 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.852 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.852 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.853 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.853 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.853 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.854 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.854 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.854 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.855 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.855 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.856 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2023-09-13T10:04:45.856 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-13T10:04:45.856 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.857 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.857 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.857 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.858 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.858 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.859 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.859 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.859 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.859 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.860 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.860 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-13T10:04:45.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-13T10:04:45.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.861 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.861 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.861 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:45.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.863 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.863 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.864 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.864 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-13T10:04:45.865 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-13T10:04:45.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.865 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.865 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.866 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:45.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.867 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.867 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.867 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.867 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.868 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.868 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.868 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-13T10:04:45.868 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-13T10:04:45.868 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.868 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.869 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.869 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:45.869 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.869 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.869 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.870 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.870 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.870 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.870 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.871 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2023-09-13T10:04:45.871 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2023-09-13T10:04:45.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.871 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.871 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.872 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.872 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.872 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.872 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.872 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.872 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.873 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.873 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.873 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2023-09-13T10:04:45.873 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2023-09-13T10:04:45.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.874 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.874 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.874 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.874 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.875 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.875 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.875 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.875 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.875 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.876 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2023-09-13T10:04:45.876 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2023-09-13T10:04:45.876 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.876 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.876 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.877 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.877 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.877 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.877 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2023-09-13T10:04:45.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.878 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.878 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.878 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2023-09-13T10:04:45.878 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2023-09-13T10:04:45.879 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.879 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.879 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.879 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2023-09-13T10:04:45.879 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.880 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.880 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.880 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.880 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.880 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.881 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-09-13T10:04:45.881 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-09-13T10:04:45.881 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.881 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.882 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.882 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.882 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.882 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.882 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.883 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.883 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.884 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:45.884 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:45.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.884 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.884 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.884 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.885 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.885 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.885 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.885 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.885 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.885 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.886 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.886 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.886 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.886 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.886 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.887 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.887 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.887 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.887 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:45.888 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:45.888 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.888 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.888 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.889 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.889 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.889 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.889 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.889 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.890 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.890 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.890 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.891 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:45.891 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:45.891 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.891 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.891 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.892 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:45.892 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.892 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.892 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.892 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.893 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.893 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.893 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.893 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.894 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.894 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.894 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.894 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.895 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.895 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.895 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.895 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:45.896 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:45.896 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.896 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.896 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.897 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.897 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.897 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.897 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.898 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.898 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.898 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.898 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.899 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.899 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2023-09-13T10:04:45.899 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2023-09-13T10:04:45.899 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.899 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.900 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.900 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.900 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.900 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.901 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.901 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2023-09-13T10:04:45.901 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.901 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.901 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.902 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2023-09-13T10:04:45.902 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2023-09-13T10:04:45.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.902 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.903 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.903 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.903 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.903 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.905 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.905 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.905 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.905 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.905 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.906 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:45.906 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:45.906 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.906 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.907 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.907 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-09-13T10:04:45.907 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.907 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.907 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.908 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.908 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.908 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.908 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.908 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.908 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:45.909 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:45.909 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.909 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.909 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.909 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2023-09-13T10:04:45.910 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.910 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.910 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.910 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.910 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.911 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.911 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.911 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.911 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-09-13T10:04:45.911 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-09-13T10:04:45.911 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.912 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.912 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.912 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.912 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.912 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.913 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.913 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.913 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.913 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.914 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2023-09-13T10:04:45.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2023-09-13T10:04:45.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.914 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.914 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2023-09-13T10:04:45.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.915 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.915 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.915 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.916 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.916 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-09-13T10:04:45.916 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-09-13T10:04:45.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.917 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.917 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.917 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2023-09-13T10:04:45.917 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.918 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.918 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.918 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.918 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2023-09-13T10:04:45.918 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.918 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.919 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.919 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-09-13T10:04:45.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-09-13T10:04:45.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.920 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.920 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.920 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-09-13T10:04:45.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-09-13T10:04:45.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-09-13T10:04:45.921 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.921 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.921 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.921 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.922 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.922 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.922 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2023-09-13T10:04:45.922 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2023-09-13T10:04:45.922 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.923 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.923 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.923 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.923 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.923 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.923 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.924 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.924 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.924 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.924 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.924 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.925 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.925 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.925 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-09-13T10:04:45.925 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:45.925 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:45.926 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.926 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2023-09-13T10:04:45.926 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2023-09-13T10:04:45.926 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.926 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.927 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.927 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.927 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.927 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.927 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.927 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2023-09-13T10:04:45.928 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.928 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.928 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.928 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.928 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:45.929 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:45.929 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.929 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.929 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.930 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.930 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.930 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.930 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.930 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.931 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.931 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.931 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.931 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.932 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.932 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.932 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.932 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.932 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.933 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:45.933 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:45.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.934 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.934 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.935 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.935 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.935 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.935 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.936 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:45.936 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:45.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.937 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:45.938 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.938 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.938 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.939 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.939 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.939 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.939 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.939 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.940 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.940 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.940 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.941 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.941 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:45.942 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:45.942 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.942 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.942 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.943 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.943 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.943 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.943 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.943 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.944 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.944 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.944 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.944 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2023-09-13T10:04:45.944 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2023-09-13T10:04:45.945 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.945 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2023-09-13T10:04:45.945 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.946 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.946 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.946 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-13T10:04:45.946 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.946 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.947 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.947 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2023-09-13T10:04:45.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2023-09-13T10:04:45.947 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.947 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.948 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2023-09-13T10:04:45.948 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.948 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.948 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.949 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-13T10:04:45.949 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.949 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.949 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.949 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.949 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2023-09-13T10:04:45.950 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2023-09-13T10:04:45.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.950 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.950 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.950 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2023-09-13T10:04:45.951 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.951 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.951 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2023-09-13T10:04:45.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.951 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.952 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.952 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2023-09-13T10:04:45.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2023-09-13T10:04:45.952 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-09-13T10:04:45.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.953 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.953 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.954 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-13T10:04:45.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.954 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.954 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.955 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2023-09-13T10:04:45.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2023-09-13T10:04:45.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.955 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.955 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:45.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.956 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-13T10:04:45.956 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.957 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.957 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.957 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:45.957 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:45.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.958 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.958 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.958 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:45.958 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.958 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2023-09-13T10:04:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2023-09-13T10:04:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2023-09-13T10:04:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2023-09-13T10:04:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-13T10:04:45.961 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2023-09-13T10:04:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:45.963 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.964 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.965 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.966 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.966 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.966 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.966 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.967 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.967 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.967 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.967 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:45.969 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:45.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.970 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.970 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.971 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.971 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.972 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.972 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:45.972 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:45.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.973 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.973 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.973 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:45.973 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.974 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.974 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:45.974 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:45.974 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:45.975 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:45.975 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:45.975 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:45.975 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:45.976 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:45.976 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.976 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.977 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:45.977 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:45.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:45.977 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:45.978 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:45.978 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.978 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.978 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.979 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.979 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.979 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2023-09-13T10:04:45.980 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2023-09-13T10:04:45.980 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.980 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-09-13T10:04:45.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.981 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.981 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.982 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.982 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.982 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2023-09-13T10:04:45.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2023-09-13T10:04:45.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.983 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.983 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2023-09-13T10:04:45.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.983 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.984 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.984 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.984 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.984 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.984 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:45.985 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:45.985 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.985 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.985 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.985 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:45.986 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.986 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.986 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.986 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:45.986 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.986 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.987 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.987 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.987 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:45.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.987 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:45.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2023-09-13T10:04:45.988 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2023-09-13T10:04:45.988 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2023-09-13T10:04:45.988 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:45.988 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2023-09-13T10:04:45.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2023-09-13T10:04:45.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:45.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2023-09-13T10:04:45.989 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-13T10:04:45.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.990 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.991 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2023-09-13T10:04:45.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2023-09-13T10:04:45.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2023-09-13T10:04:45.992 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.992 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-13T10:04:45.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.993 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.993 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.994 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2023-09-13T10:04:45.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2023-09-13T10:04:45.994 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:45.994 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.994 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:45.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:45.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.995 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.995 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2023-09-13T10:04:45.995 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:45.997 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:45.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:45.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:45.997 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:45.997 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:45.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2023-09-13T10:04:45.998 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2023-09-13T10:04:45.998 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:45.998 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:45.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-13T10:04:45.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:45.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:45.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:45.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.000 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.000 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.000 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.001 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.001 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.001 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.002 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.002 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.002 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.002 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.002 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.003 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.003 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.003 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.004 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.004 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.004 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.004 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.005 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.005 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.005 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.005 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.005 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.006 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.006 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.006 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.007 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.007 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.008 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.008 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.008 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.008 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.009 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.009 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.009 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.010 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.010 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.010 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.010 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.011 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.011 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.011 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.012 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.012 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.012 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.013 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.013 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.013 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.013 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.014 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.014 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.014 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.014 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.014 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.014 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.015 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2023-09-13T10:04:46.015 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2023-09-13T10:04:46.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.015 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.016 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.016 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.016 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.016 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.016 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2023-09-13T10:04:46.017 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.017 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.017 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2023-09-13T10:04:46.018 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2023-09-13T10:04:46.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.018 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2023-09-13T10:04:46.018 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2023-09-13T10:04:46.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.020 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.020 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-09-13T10:04:46.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-09-13T10:04:46.020 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.021 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2023-09-13T10:04:46.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.022 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.022 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-13T10:04:46.022 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.022 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.023 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2023-09-13T10:04:46.023 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2023-09-13T10:04:46.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.023 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:46.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:46.024 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2023-09-13T10:04:46.024 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-13T10:04:46.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.025 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.025 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2023-09-13T10:04:46.025 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2023-09-13T10:04:46.026 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.026 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.026 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.026 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.027 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.027 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2023-09-13T10:04:46.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.028 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.028 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2023-09-13T10:04:46.028 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2023-09-13T10:04:46.028 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.028 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.029 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.029 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2023-09-13T10:04:46.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.029 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.029 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-13T10:04:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.030 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2023-09-13T10:04:46.031 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.032 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.034 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.035 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.036 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.041 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.042 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.043 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.044 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.046 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.047 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2023-09-13T10:04:46.048 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.049 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.050 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.051 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.052 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.053 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.054 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.055 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.057 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.058 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.059 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.062 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2023-09-13T10:04:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.063 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2023-09-13T10:04:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2023-09-13T10:04:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2023-09-13T10:04:46.064 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-13T10:04:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.065 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2023-09-13T10:04:46.066 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2023-09-13T10:04:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.067 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2023-09-13T10:04:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-13T10:04:46.068 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.069 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.070 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.071 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.072 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.073 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.077 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.079 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.080 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.081 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.082 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.083 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.084 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.085 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2023-09-13T10:04:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.086 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2023-09-13T10:04:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2023-09-13T10:04:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.087 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2023-09-13T10:04:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2023-09-13T10:04:46.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-13T10:04:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.091 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.092 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.093 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.094 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.095 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.097 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.098 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.101 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.102 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2023-09-13T10:04:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2023-09-13T10:04:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2023-09-13T10:04:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-13T10:04:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2023-09-13T10:04:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2023-09-13T10:04:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2023-09-13T10:04:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2023-09-13T10:04:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2023-09-13T10:04:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2023-09-13T10:04:46.109 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2023-09-13T10:04:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2023-09-13T10:04:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.111 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2023-09-13T10:04:46.112 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2023-09-13T10:04:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.113 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2023-09-13T10:04:46.114 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.115 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2023-09-13T10:04:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2023-09-13T10:04:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.116 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2023-09-13T10:04:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-13T10:04:46.118 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-13T10:04:46.118 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.118 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.118 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.118 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.119 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.119 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2023-09-13T10:04:46.119 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.119 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.119 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.120 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.120 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.120 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.121 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.121 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.122 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.122 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.122 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.122 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.122 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.123 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.125 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.126 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.127 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.128 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.128 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.128 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.129 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.129 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.129 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.129 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.129 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.129 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.130 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.131 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.132 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2023-09-13T10:04:46.133 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.134 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.135 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.136 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.138 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.139 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.139 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.139 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.139 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.140 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.140 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.140 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.140 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.141 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.141 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.141 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.142 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.142 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.142 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.143 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.143 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.144 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.144 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.144 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.144 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.144 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.145 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.145 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.145 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.146 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.146 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.146 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.147 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.148 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.149 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2023-09-13T10:04:46.150 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.150 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.150 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.150 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.151 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.152 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.153 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.153 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.153 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.153 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.154 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.154 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.154 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.154 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.154 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.155 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.155 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.155 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.156 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.156 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.156 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.157 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.158 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.159 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.160 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.160 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.160 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.160 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.160 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.160 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.162 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.162 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.164 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.164 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.164 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.165 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-09-13T10:04:46.165 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.165 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.165 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.165 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2023-09-13T10:04:46.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2023-09-13T10:04:46.166 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.166 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.166 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.166 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.167 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.167 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.167 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.167 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-13T10:04:46.167 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.168 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.168 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.168 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.168 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.168 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.168 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.169 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.169 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.169 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.169 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.169 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.170 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.170 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.170 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.170 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.170 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.170 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.171 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.171 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.171 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.171 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.171 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.172 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.172 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.172 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.172 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.172 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.172 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.173 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.173 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.173 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.173 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.174 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.174 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.174 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.174 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.174 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.175 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.175 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.175 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.176 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.176 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.176 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.176 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.176 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.177 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.177 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.177 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.177 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.177 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.178 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.178 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.178 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.179 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.180 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.182 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.182 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.182 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.183 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2023-09-13T10:04:46.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-09-13T10:04:46.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.185 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.185 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-09-13T10:04:46.185 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2023-09-13T10:04:46.185 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2023-09-13T10:04:46.186 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.186 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2023-09-13T10:04:46.186 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.186 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.187 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.187 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.187 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.187 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2023-09-13T10:04:46.188 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.188 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.188 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.188 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.189 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.190 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.190 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.190 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.190 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.190 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.191 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.191 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.191 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.191 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.191 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.191 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.192 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.192 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.192 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.192 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.193 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.193 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.193 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.194 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.194 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.195 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.195 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.195 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.196 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.196 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.196 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.197 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.198 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.198 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.198 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.198 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.198 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.199 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.199 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.199 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.199 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.200 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.200 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.200 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.201 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.201 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2023-09-13T10:04:46.202 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.202 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.202 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.202 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.203 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.203 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.203 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.204 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.204 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.204 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.204 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.204 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.205 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.205 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.205 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.205 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.205 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.206 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.206 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.206 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.207 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.207 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.207 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.209 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.210 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.210 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.210 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.211 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.211 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.212 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.212 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.212 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.212 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.213 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.213 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.213 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.213 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.213 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.214 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.214 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.214 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.215 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.215 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.216 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.216 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.216 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.217 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.217 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.218 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2023-09-13T10:04:46.218 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.218 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.219 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.219 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.219 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.220 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.221 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.221 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.221 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.221 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.222 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.222 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.222 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.223 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.223 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.223 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.225 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.225 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.225 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.225 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.225 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.225 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.226 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.226 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.226 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.226 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.226 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.227 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.227 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.227 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.227 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.227 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.228 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.228 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.228 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.228 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.228 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.229 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.229 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.229 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.229 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.229 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.230 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.230 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.233 INFO:teuthology.orchestra.run.smithi006.stdout: "noautoscale": { 2023-09-13T10:04:46.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "noautoscale", 2023-09-13T10:04:46.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "global autoscale flag", 2023-09-13T10:04:46.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-13T10:04:46.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.235 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:46.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:46.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:46.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.238 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2023-09-13T10:04:46.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2023-09-13T10:04:46.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-09-13T10:04:46.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2023-09-13T10:04:46.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2023-09-13T10:04:46.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-13T10:04:46.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.240 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.241 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.241 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2023-09-13T10:04:46.241 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.241 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.242 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.242 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2023-09-13T10:04:46.242 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2023-09-13T10:04:46.242 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.242 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.243 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.243 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.243 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.243 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.243 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.244 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-13T10:04:46.244 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.245 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-09-13T10:04:46.245 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-09-13T10:04:46.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.246 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.246 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.246 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.246 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.248 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.248 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.248 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.249 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.250 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.250 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.250 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.250 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.251 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.251 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.251 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.251 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.251 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.252 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.252 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.253 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.255 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.255 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.256 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.256 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.256 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.257 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.258 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.258 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.258 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.258 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.258 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.259 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.259 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.259 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.260 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.260 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.261 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.261 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.261 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.262 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.262 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.262 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.262 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.263 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.263 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2023-09-13T10:04:46.263 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2023-09-13T10:04:46.263 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.263 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.263 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.264 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2023-09-13T10:04:46.264 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.264 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.264 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.264 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2023-09-13T10:04:46.265 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.265 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.265 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.265 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.265 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:46.266 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:46.266 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.266 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.266 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:46.267 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.267 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.267 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2023-09-13T10:04:46.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.268 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.269 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2023-09-13T10:04:46.269 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.269 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.270 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.270 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2023-09-13T10:04:46.270 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2023-09-13T10:04:46.270 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.270 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.271 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.271 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.271 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.272 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.272 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.272 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.272 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.272 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2023-09-13T10:04:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2023-09-13T10:04:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.273 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.274 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.274 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.274 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-13T10:04:46.274 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-13T10:04:46.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.275 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.275 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.275 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.275 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.275 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.276 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.276 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.276 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.276 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.276 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.276 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.277 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.277 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.277 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.277 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.277 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.278 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.278 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.279 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.280 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.280 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.281 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.281 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.282 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.282 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.282 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.283 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.283 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.283 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.283 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.284 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.284 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.284 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.284 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.285 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.285 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.285 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.285 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.285 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.286 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.286 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.286 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.286 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.287 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.287 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.287 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.288 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.288 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.289 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.289 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.289 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.290 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.290 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.290 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.290 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.291 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2023-09-13T10:04:46.291 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2023-09-13T10:04:46.291 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.291 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.291 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.291 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.292 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.292 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.292 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.292 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.292 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.293 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.293 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.293 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.293 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-13T10:04:46.294 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-13T10:04:46.294 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.294 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2023-09-13T10:04:46.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.296 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2023-09-13T10:04:46.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2023-09-13T10:04:46.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.297 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.297 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2023-09-13T10:04:46.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.298 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.298 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.298 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.298 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.298 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.299 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:46.299 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:46.299 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.299 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.299 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-09-13T10:04:46.300 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.300 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-13T10:04:46.300 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.301 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.301 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:46.301 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:46.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.302 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2023-09-13T10:04:46.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-13T10:04:46.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.303 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.304 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2023-09-13T10:04:46.304 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2023-09-13T10:04:46.304 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.305 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2023-09-13T10:04:46.305 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.305 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.305 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.306 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.306 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.306 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.306 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.307 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-09-13T10:04:46.307 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-09-13T10:04:46.307 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.307 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.307 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.308 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2023-09-13T10:04:46.308 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.308 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.308 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.308 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2023-09-13T10:04:46.309 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2023-09-13T10:04:46.309 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.309 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.309 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.310 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-09-13T10:04:46.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-09-13T10:04:46.310 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.310 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-09-13T10:04:46.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-09-13T10:04:46.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-09-13T10:04:46.311 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.311 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.312 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.313 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-09-13T10:04:46.313 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.313 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.313 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.314 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.314 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.314 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.314 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.314 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.315 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.315 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.317 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.317 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.318 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.318 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.318 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.318 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.319 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.319 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.319 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.319 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.320 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.320 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.320 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.321 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.321 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.322 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.322 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.322 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.322 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.323 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.323 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.323 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.324 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.324 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.324 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.325 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.325 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.326 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.326 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.326 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.326 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.327 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.327 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.327 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.328 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.329 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.329 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.329 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.330 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.330 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.330 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.330 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.330 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.331 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.331 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2023-09-13T10:04:46.331 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2023-09-13T10:04:46.331 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.332 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.332 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.332 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:46.332 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.332 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.332 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.333 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.333 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.333 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.333 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.334 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2023-09-13T10:04:46.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2023-09-13T10:04:46.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.335 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.335 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.335 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.335 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.336 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.336 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.336 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2023-09-13T10:04:46.336 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2023-09-13T10:04:46.337 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.337 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.337 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.337 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.337 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.337 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.338 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.338 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.338 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.338 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.338 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.339 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.339 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.339 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.339 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2023-09-13T10:04:46.339 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.340 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.340 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.340 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2023-09-13T10:04:46.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2023-09-13T10:04:46.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.341 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.341 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.341 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.341 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.342 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.342 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.342 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.342 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.342 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.343 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-09-13T10:04:46.343 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-09-13T10:04:46.343 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.343 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.343 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.343 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.344 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.344 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.344 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.344 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.344 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.344 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.345 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.345 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.345 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.345 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.345 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.346 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.346 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.346 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.346 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.346 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.346 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.347 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.347 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.347 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.347 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.347 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.348 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.348 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.348 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.348 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.348 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.348 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.349 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.349 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.349 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.350 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.350 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.350 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.350 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.351 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.351 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.352 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.352 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.353 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.353 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.353 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.354 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.354 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.354 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.354 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.355 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.355 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.355 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.355 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.355 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.356 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.356 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.356 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.356 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.357 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.357 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.357 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.357 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.358 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.358 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.358 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.358 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.359 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.359 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.359 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.360 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.360 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:46.360 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:46.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.361 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.361 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.361 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.361 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.362 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.362 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.362 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.363 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:46.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:46.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.364 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.364 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.364 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.365 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.365 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.365 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.365 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.365 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.365 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.366 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.366 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.366 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.366 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2023-09-13T10:04:46.367 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.367 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.367 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.367 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.368 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.368 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.368 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.368 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.369 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.369 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.369 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.369 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.369 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.370 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.370 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.370 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.370 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.370 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.370 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.371 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.371 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.372 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.372 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.372 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.372 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.373 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.373 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.373 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.373 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.373 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.373 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.374 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.374 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.374 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.375 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.375 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.375 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.375 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.375 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.375 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.376 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.376 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.376 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.376 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.376 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.377 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.377 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.377 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.378 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.378 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.379 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.379 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.379 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.380 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.380 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.381 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.381 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.381 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.381 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2023-09-13T10:04:46.382 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.382 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.382 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.382 INFO:teuthology.orchestra.run.smithi006.stdout: "drive_group_interval": { 2023-09-13T10:04:46.382 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "drive_group_interval", 2023-09-13T10:04:46.383 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.383 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.383 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.383 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300.0", 2023-09-13T10:04:46.383 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.383 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.384 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.384 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-13T10:04:46.384 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.384 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.384 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.385 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.385 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.385 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.386 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.386 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.387 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.387 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.387 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.387 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.387 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.388 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.389 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.390 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.391 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.392 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.392 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.393 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.393 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.393 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.394 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.394 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.394 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.394 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.395 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.395 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.395 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.395 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.395 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.396 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.396 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.396 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.398 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.398 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.399 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.399 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.399 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.399 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.400 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.400 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.400 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.401 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2023-09-13T10:04:46.401 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2023-09-13T10:04:46.401 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.401 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.402 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.402 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2023-09-13T10:04:46.402 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.402 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.402 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.402 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-13T10:04:46.403 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.403 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.403 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.403 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.404 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.404 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.404 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2023-09-13T10:04:46.404 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.404 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.404 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.405 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.405 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.405 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.405 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.405 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.406 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.406 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.406 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.406 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.406 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.406 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.407 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.407 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.407 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.407 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.407 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.408 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.408 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.408 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.408 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.409 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.409 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.409 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.409 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.410 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.410 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.410 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.410 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.410 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.411 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.411 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.411 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.411 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.411 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.412 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.412 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.412 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.412 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.412 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.412 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.413 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.413 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.413 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.413 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.413 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.414 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.414 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.415 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.415 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.416 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.416 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.416 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.416 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.416 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.417 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.417 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.417 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.417 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.418 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2023-09-13T10:04:46.418 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2023-09-13T10:04:46.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.418 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.419 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.419 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.419 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.419 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.419 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.420 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.420 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2023-09-13T10:04:46.421 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2023-09-13T10:04:46.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.421 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2023-09-13T10:04:46.422 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.422 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.422 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.423 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.423 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.423 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2023-09-13T10:04:46.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2023-09-13T10:04:46.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.425 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.425 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.425 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.425 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.426 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.426 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.426 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.426 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2023-09-13T10:04:46.427 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2023-09-13T10:04:46.427 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.427 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.427 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.427 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.428 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.428 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.428 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.428 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.429 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.429 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.429 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.429 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2023-09-13T10:04:46.430 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2023-09-13T10:04:46.430 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.430 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.430 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.431 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.431 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.431 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.432 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.432 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.432 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.432 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.433 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.433 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.433 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2023-09-13T10:04:46.433 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2023-09-13T10:04:46.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.434 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.434 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.434 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.435 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.435 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.435 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.435 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.435 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.436 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.436 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.436 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.436 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2023-09-13T10:04:46.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2023-09-13T10:04:46.437 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.437 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.437 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.437 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.437 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.438 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.438 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.438 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.438 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.438 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.439 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.439 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.439 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2023-09-13T10:04:46.439 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2023-09-13T10:04:46.439 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.440 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.440 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.440 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.440 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.440 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.441 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.441 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.441 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.441 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.441 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.442 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.442 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2023-09-13T10:04:46.442 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2023-09-13T10:04:46.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.443 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.443 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.443 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:46.443 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2023-09-13T10:04:46.443 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.444 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.444 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.444 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.444 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.445 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2023-09-13T10:04:46.445 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2023-09-13T10:04:46.445 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.445 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.445 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.445 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.446 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.446 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.446 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.446 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.446 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.447 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.447 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.447 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.447 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2023-09-13T10:04:46.447 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2023-09-13T10:04:46.448 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.448 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.448 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.448 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.448 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.449 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.449 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.449 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.449 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.449 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.449 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.450 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2023-09-13T10:04:46.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2023-09-13T10:04:46.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.450 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.451 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.451 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.451 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.451 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.452 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.452 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.453 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.453 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2023-09-13T10:04:46.453 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.453 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.453 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.454 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2023-09-13T10:04:46.454 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2023-09-13T10:04:46.454 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.454 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.455 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.455 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.455 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.455 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2023-09-13T10:04:46.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.456 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.457 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2023-09-13T10:04:46.457 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2023-09-13T10:04:46.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.457 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.458 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.458 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.458 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2023-09-13T10:04:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.459 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.460 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.460 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.460 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.461 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.461 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.461 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.461 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.461 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.461 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.462 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.462 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.462 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.462 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.462 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.463 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.463 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.463 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.463 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.463 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.464 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.464 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.465 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.465 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.465 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.465 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.466 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.466 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.466 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.467 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.467 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.468 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.468 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.468 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.468 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.469 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.469 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.469 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.469 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.470 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.470 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.470 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.470 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.471 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.471 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.471 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.472 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.472 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.472 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.473 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.473 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.473 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.473 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.473 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.474 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.474 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.474 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.474 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.474 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.475 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.475 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.475 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2023-09-13T10:04:46.475 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.475 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.476 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.476 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.476 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.476 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.476 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.477 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.477 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.477 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.478 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.478 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.478 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.478 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.478 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.479 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.479 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.479 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.479 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.479 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.480 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.480 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.480 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.480 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.481 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.481 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.481 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.481 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.481 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.482 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.482 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.482 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.482 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.482 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.483 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.483 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.483 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.483 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.483 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.483 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.484 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.484 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.484 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.484 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.485 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.485 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.485 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.485 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.486 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.486 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.486 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.486 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.486 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.486 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.487 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.487 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.487 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.488 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.488 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.488 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.488 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.488 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.489 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.489 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.490 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2023-09-13T10:04:46.490 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.490 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.491 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.491 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.491 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.491 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.491 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.492 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.492 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.492 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.492 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.492 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.492 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.493 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.493 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.493 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.493 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.494 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.495 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.495 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.495 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.495 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.496 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.496 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.497 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.497 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.497 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.497 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.498 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.498 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.498 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.499 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.499 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.499 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.499 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.500 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.500 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.500 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.500 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.501 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.501 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.501 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.501 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.501 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.502 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.502 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.502 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.502 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.503 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.503 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.503 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.503 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.504 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.504 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.504 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.504 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.504 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.505 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.505 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.505 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.506 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.506 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.507 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2023-09-13T10:04:46.507 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.507 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.507 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.507 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2023-09-13T10:04:46.508 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2023-09-13T10:04:46.508 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.508 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.508 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.508 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-13T10:04:46.509 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.509 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.509 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.509 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.509 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.509 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.510 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.510 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.510 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:46.510 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:46.510 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.511 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.511 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2023-09-13T10:04:46.511 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.511 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.512 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.512 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.512 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.512 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.513 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.513 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.513 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.514 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.514 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.514 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.514 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.514 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.514 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.515 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.515 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.515 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.515 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.515 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.516 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.516 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.516 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.517 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.518 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.518 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.519 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.519 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.520 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.520 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.520 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.520 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.521 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.521 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.521 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.521 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.522 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.522 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.522 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.522 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.522 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.523 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.523 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.525 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.525 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.525 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.525 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.525 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.526 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.526 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.526 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.526 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.526 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.527 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.527 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.527 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.527 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.527 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.528 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2023-09-13T10:04:46.528 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.528 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.528 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.528 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2023-09-13T10:04:46.529 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2023-09-13T10:04:46.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.529 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.529 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.530 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.530 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.530 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.530 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-13T10:04:46.530 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.531 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.531 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.531 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2023-09-13T10:04:46.531 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2023-09-13T10:04:46.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.532 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.532 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.533 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.533 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.533 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-13T10:04:46.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.534 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.534 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.534 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2023-09-13T10:04:46.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2023-09-13T10:04:46.535 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.535 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.535 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.536 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.536 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-13T10:04:46.536 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.536 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.537 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2023-09-13T10:04:46.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2023-09-13T10:04:46.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.538 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.538 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.539 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.539 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-13T10:04:46.539 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.540 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.540 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2023-09-13T10:04:46.540 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2023-09-13T10:04:46.540 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.540 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.541 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.541 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.542 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-13T10:04:46.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.542 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.543 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2023-09-13T10:04:46.543 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2023-09-13T10:04:46.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.544 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.544 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.545 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.545 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.545 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.545 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.546 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.546 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.546 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.547 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2023-09-13T10:04:46.547 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2023-09-13T10:04:46.547 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.547 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.547 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.548 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.548 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.548 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.548 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.548 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.549 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.549 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.549 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.549 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.549 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2023-09-13T10:04:46.550 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2023-09-13T10:04:46.550 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.550 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.550 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.550 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-13T10:04:46.551 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.551 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.551 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.551 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.551 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.552 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.552 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.552 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.552 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-09-13T10:04:46.552 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-09-13T10:04:46.552 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.553 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.553 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.553 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.553 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.553 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.554 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.554 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.554 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.554 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.554 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.554 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.555 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:46.555 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:46.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.555 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.555 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.556 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2023-09-13T10:04:46.556 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2023-09-13T10:04:46.556 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.556 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.556 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.556 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.557 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.557 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2023-09-13T10:04:46.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2023-09-13T10:04:46.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.558 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.558 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2023-09-13T10:04:46.558 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.559 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.559 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.559 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.559 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.559 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.560 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.560 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2023-09-13T10:04:46.560 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2023-09-13T10:04:46.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.560 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.561 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.561 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.561 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.561 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.562 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.562 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.562 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.562 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.562 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2023-09-13T10:04:46.563 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2023-09-13T10:04:46.563 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.563 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.563 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.563 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.564 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.564 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.564 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.564 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.564 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.565 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.565 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.565 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.565 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.565 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.566 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.566 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.566 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.566 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.566 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.566 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.567 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.567 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.567 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.567 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.567 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.568 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.568 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.568 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.568 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.569 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.569 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.569 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.570 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.570 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.570 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.571 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.571 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.571 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.571 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.572 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.572 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.572 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.572 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.573 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.573 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.573 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.573 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.574 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.574 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.574 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.574 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.574 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.575 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.575 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.575 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.575 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.576 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.576 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.576 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.576 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.576 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.577 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.577 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.577 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.578 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.578 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.578 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.578 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.579 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.579 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.579 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.580 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.580 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.580 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2023-09-13T10:04:46.581 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2023-09-13T10:04:46.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.581 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.581 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.582 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.582 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.582 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.582 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.582 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.583 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.583 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.583 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2023-09-13T10:04:46.583 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2023-09-13T10:04:46.583 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.584 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.584 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.584 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.584 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.584 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.585 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.585 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.585 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.585 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.585 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.585 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.586 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2023-09-13T10:04:46.586 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2023-09-13T10:04:46.586 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.586 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.586 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.587 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-13T10:04:46.587 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.587 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.587 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.587 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.587 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.588 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.588 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.588 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.588 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.588 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.589 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2023-09-13T10:04:46.589 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.589 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.589 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.589 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.590 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.590 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.590 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.591 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.591 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.591 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.591 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.591 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.592 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.592 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.592 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.592 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.592 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.593 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.593 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.593 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.593 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.593 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.593 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.594 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.594 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.594 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.594 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.594 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.595 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.595 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.595 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.595 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.595 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.596 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.596 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.596 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.597 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.597 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.597 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.597 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.597 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.598 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.598 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.598 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.598 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.598 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.598 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.599 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.599 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.599 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.599 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.599 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.600 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.600 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.600 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.600 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.601 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.601 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.601 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.601 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.601 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.601 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.602 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.602 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.602 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.602 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.603 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.603 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.603 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.603 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-09-13T10:04:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.604 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.605 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.606 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.607 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.608 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.608 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.609 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.609 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.609 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.610 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.610 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.610 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.610 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.611 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.611 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.611 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.611 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.611 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.612 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.612 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.612 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.612 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.612 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.613 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.613 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.613 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.613 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.613 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.614 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.614 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.614 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.614 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.614 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.615 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.615 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.615 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.615 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.616 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.616 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.617 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.617 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.617 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.618 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.618 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.618 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.619 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.619 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.619 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.619 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.620 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2023-09-13T10:04:46.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2023-09-13T10:04:46.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2023-09-13T10:04:46.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.621 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-13T10:04:46.622 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.622 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.622 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2023-09-13T10:04:46.623 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2023-09-13T10:04:46.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.623 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:46.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.624 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.624 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-13T10:04:46.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.625 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.625 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.625 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.625 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2023-09-13T10:04:46.626 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.626 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.626 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.626 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2023-09-13T10:04:46.626 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2023-09-13T10:04:46.627 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:46.627 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.627 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.627 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2023-09-13T10:04:46.627 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.628 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.628 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.628 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.628 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.628 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.628 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.629 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2023-09-13T10:04:46.629 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2023-09-13T10:04:46.629 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.629 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.630 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.630 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.630 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.630 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.630 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.630 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.631 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.631 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.631 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.631 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.631 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:46.632 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:46.632 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.632 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.632 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.632 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:46.633 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.633 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.633 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.633 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.633 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.633 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.634 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.634 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.634 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.634 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.635 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.635 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.635 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.635 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.635 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.636 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.636 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.636 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.636 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.636 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.636 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.638 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.639 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.639 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.639 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.640 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.640 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.640 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.640 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.640 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.641 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.641 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.641 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.641 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.642 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.642 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.642 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.642 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.643 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.643 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.643 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.643 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.643 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.644 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.644 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.644 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.644 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.644 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.645 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.645 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.645 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.645 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.646 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.646 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.646 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.646 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.647 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.647 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.647 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.647 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.647 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.648 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.648 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.648 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.648 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.649 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2023-09-13T10:04:46.649 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2023-09-13T10:04:46.649 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.649 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.650 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.650 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.650 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.650 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.651 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.651 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.651 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.652 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.652 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.652 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.652 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2023-09-13T10:04:46.652 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2023-09-13T10:04:46.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.653 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2023-09-13T10:04:46.653 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.654 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.654 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.654 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.654 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.655 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.655 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2023-09-13T10:04:46.655 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2023-09-13T10:04:46.655 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.655 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.656 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.656 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-13T10:04:46.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.656 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.656 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.657 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.658 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.658 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:46.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.658 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.658 INFO:teuthology.orchestra.run.smithi006.stdout: "gid": 24116, 2023-09-13T10:04:46.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "y", 2023-09-13T10:04:46.659 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr_features": 4540138322906710015, 2023-09-13T10:04:46.659 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2023-09-13T10:04:46.659 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.659 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2023-09-13T10:04:46.659 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.660 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.660 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.660 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:46.660 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:46.660 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.661 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.661 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.661 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:46.661 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.661 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.661 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.662 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2023-09-13T10:04:46.662 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.662 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.662 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.663 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.663 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.663 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.663 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.663 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.663 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.664 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.664 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.664 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.664 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.664 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.665 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.665 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.665 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.665 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.665 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.665 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.666 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.666 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.666 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.666 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.666 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.667 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.667 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.667 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.667 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.668 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.668 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.668 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.668 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.668 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.670 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.671 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.671 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.671 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.671 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.671 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.672 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.672 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.672 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.672 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.672 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.673 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.673 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.673 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.673 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.674 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.674 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.674 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.674 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.675 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.675 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.675 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.675 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.675 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.676 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.676 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2023-09-13T10:04:46.676 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2023-09-13T10:04:46.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.677 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.677 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.677 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.678 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.678 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2023-09-13T10:04:46.678 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.679 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.679 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.679 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2023-09-13T10:04:46.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2023-09-13T10:04:46.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.680 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2023-09-13T10:04:46.681 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.681 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.681 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.681 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2023-09-13T10:04:46.681 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.682 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.682 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.682 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.682 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2023-09-13T10:04:46.683 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2023-09-13T10:04:46.683 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.683 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.683 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.684 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.684 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.684 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.684 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2023-09-13T10:04:46.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.685 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.685 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.685 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2023-09-13T10:04:46.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2023-09-13T10:04:46.686 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.686 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.686 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.687 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.687 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2023-09-13T10:04:46.687 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.688 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.688 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2023-09-13T10:04:46.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2023-09-13T10:04:46.689 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.689 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2023-09-13T10:04:46.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.690 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.690 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.690 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2023-09-13T10:04:46.691 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.691 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.691 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.691 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2023-09-13T10:04:46.691 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2023-09-13T10:04:46.692 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.692 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.692 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.692 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.692 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.693 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.693 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.693 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2023-09-13T10:04:46.693 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.694 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.694 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.694 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2023-09-13T10:04:46.694 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2023-09-13T10:04:46.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.694 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.695 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.695 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.695 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.695 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.696 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-13T10:04:46.696 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.696 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.696 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.697 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2023-09-13T10:04:46.697 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2023-09-13T10:04:46.697 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.697 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.697 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.698 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.698 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.698 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.698 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.698 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2023-09-13T10:04:46.698 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.699 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.699 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.699 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.700 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2023-09-13T10:04:46.700 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.700 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.700 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.701 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2023-09-13T10:04:46.701 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2023-09-13T10:04:46.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.702 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.702 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.702 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2023-09-13T10:04:46.703 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.703 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.703 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.703 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2023-09-13T10:04:46.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2023-09-13T10:04:46.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.704 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.704 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.704 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2023-09-13T10:04:46.704 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.704 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.705 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.705 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2023-09-13T10:04:46.705 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-13T10:04:46.705 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.705 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.706 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.706 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2023-09-13T10:04:46.706 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2023-09-13T10:04:46.706 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:46.706 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.707 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.707 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:46.707 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-09-13T10:04:46.707 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-09-13T10:04:46.707 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.707 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-13T10:04:46.708 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-13T10:04:46.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.708 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2023-09-13T10:04:46.709 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2023-09-13T10:04:46.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:46.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.709 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2023-09-13T10:04:46.709 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:46.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2023-09-13T10:04:46.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.710 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-13T10:04:46.710 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.710 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.711 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2023-09-13T10:04:46.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2023-09-13T10:04:46.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.712 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.712 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2023-09-13T10:04:46.712 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.713 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.713 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-13T10:04:46.713 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-13T10:04:46.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.714 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.714 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.714 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2023-09-13T10:04:46.714 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2023-09-13T10:04:46.715 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.715 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.715 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.715 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2023-09-13T10:04:46.716 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2023-09-13T10:04:46.716 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2023-09-13T10:04:46.716 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.716 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2023-09-13T10:04:46.716 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-13T10:04:46.717 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.717 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.717 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2023-09-13T10:04:46.718 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2023-09-13T10:04:46.718 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.718 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.718 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.719 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2023-09-13T10:04:46.719 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.719 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.719 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.720 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2023-09-13T10:04:46.720 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-13T10:04:46.720 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.720 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.720 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.721 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2023-09-13T10:04:46.721 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2023-09-13T10:04:46.721 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:46.721 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.722 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.722 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:46.722 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-09-13T10:04:46.723 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-09-13T10:04:46.723 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.723 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-13T10:04:46.723 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-13T10:04:46.725 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.725 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.725 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.726 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.726 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.726 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.726 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.726 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.727 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.727 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.727 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.727 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.727 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.728 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.728 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.728 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.728 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.728 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.728 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.729 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.729 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.729 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.729 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.729 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.730 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.730 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.730 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.730 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.730 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.730 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.731 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.731 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.731 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.731 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.731 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.732 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.732 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.732 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.732 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.732 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.732 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.733 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.733 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.733 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.733 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.733 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.734 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.734 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.734 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.734 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.734 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.734 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.735 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.735 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.736 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.736 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.736 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.737 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.737 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.738 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.738 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.738 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2023-09-13T10:04:46.738 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2023-09-13T10:04:46.738 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.739 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.739 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.739 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:46.739 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.739 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.739 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.740 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-13T10:04:46.740 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.740 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.740 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.741 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-09-13T10:04:46.741 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-09-13T10:04:46.741 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.741 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.741 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2023-09-13T10:04:46.742 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.742 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.742 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.742 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2023-09-13T10:04:46.742 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2023-09-13T10:04:46.743 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap" 2023-09-13T10:04:46.743 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.743 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2023-09-13T10:04:46.743 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.743 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.743 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.744 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.744 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2023-09-13T10:04:46.744 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2023-09-13T10:04:46.744 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.744 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.745 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.745 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.745 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.745 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.745 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.745 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-13T10:04:46.746 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.746 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.746 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:46.747 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:46.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.747 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.748 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:46.748 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.748 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.748 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.749 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-13T10:04:46.749 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.749 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.749 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.749 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.749 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2023-09-13T10:04:46.750 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2023-09-13T10:04:46.750 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.750 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.750 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.751 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-13T10:04:46.752 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-13T10:04:46.752 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.752 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.752 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.753 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2023-09-13T10:04:46.753 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2023-09-13T10:04:46.753 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:46.753 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.753 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.754 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:46.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.754 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.754 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.755 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-13T10:04:46.755 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.755 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.755 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.755 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.756 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.756 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2023-09-13T10:04:46.757 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.757 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.757 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.757 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2023-09-13T10:04:46.758 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2023-09-13T10:04:46.758 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.758 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.758 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.759 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-09-13T10:04:46.759 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.759 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.759 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.760 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-13T10:04:46.760 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.760 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.760 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.761 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2023-09-13T10:04:46.761 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2023-09-13T10:04:46.761 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.761 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.761 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.761 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2023-09-13T10:04:46.762 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.762 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.762 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.762 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-13T10:04:46.762 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.763 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.763 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.763 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2023-09-13T10:04:46.763 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2023-09-13T10:04:46.764 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.764 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.764 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.764 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2023-09-13T10:04:46.765 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.765 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.765 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.765 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-13T10:04:46.765 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.766 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.766 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2023-09-13T10:04:46.766 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2023-09-13T10:04:46.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.767 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.767 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.767 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.768 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.768 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-13T10:04:46.768 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-13T10:04:46.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.768 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.768 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.769 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2023-09-13T10:04:46.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2023-09-13T10:04:46.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.769 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.769 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.770 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:46.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.770 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.770 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.770 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-13T10:04:46.770 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.771 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.771 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.771 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.771 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2023-09-13T10:04:46.771 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2023-09-13T10:04:46.772 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:46.772 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.772 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.772 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2023-09-13T10:04:46.772 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.772 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.773 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.773 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-13T10:04:46.773 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.773 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.774 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.774 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2023-09-13T10:04:46.774 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2023-09-13T10:04:46.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.774 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.775 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.775 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.775 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.775 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.775 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-13T10:04:46.776 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.776 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.776 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.776 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2023-09-13T10:04:46.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2023-09-13T10:04:46.777 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.777 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.778 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.778 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.778 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-13T10:04:46.778 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.778 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.779 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.779 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2023-09-13T10:04:46.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2023-09-13T10:04:46.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.780 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.780 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.780 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.781 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-13T10:04:46.781 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.782 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.782 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2023-09-13T10:04:46.782 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2023-09-13T10:04:46.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.783 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.783 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-13T10:04:46.783 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.783 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.783 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.784 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:46.784 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.784 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.784 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.785 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.785 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2023-09-13T10:04:46.785 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2023-09-13T10:04:46.785 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.786 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.786 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.786 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-13T10:04:46.786 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.786 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.787 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.787 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2023-09-13T10:04:46.787 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.788 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.788 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.788 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.788 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2023-09-13T10:04:46.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2023-09-13T10:04:46.789 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.789 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.789 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.789 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-13T10:04:46.790 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.790 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.790 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.790 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2023-09-13T10:04:46.791 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.791 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.791 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.792 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2023-09-13T10:04:46.792 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2023-09-13T10:04:46.792 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.792 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.792 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.793 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-13T10:04:46.793 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.793 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.793 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.794 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:46.794 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.794 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.794 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.795 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.795 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2023-09-13T10:04:46.795 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2023-09-13T10:04:46.795 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.796 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.796 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.796 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-13T10:04:46.796 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.797 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.797 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.797 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2023-09-13T10:04:46.797 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.798 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.798 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.798 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2023-09-13T10:04:46.798 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2023-09-13T10:04:46.798 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.799 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.799 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.799 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-13T10:04:46.799 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.799 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.800 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.800 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2023-09-13T10:04:46.800 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.800 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.800 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.801 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2023-09-13T10:04:46.801 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2023-09-13T10:04:46.801 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.801 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.801 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.802 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-13T10:04:46.802 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.802 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.802 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.802 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2023-09-13T10:04:46.803 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.803 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.803 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.803 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.803 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2023-09-13T10:04:46.803 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2023-09-13T10:04:46.804 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.804 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.804 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.804 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-13T10:04:46.804 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.804 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.805 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.805 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2023-09-13T10:04:46.805 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.805 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.805 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.806 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.806 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2023-09-13T10:04:46.806 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2023-09-13T10:04:46.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.806 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.807 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.807 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-13T10:04:46.807 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.807 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.807 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.807 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2023-09-13T10:04:46.808 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.808 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.808 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.808 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2023-09-13T10:04:46.808 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2023-09-13T10:04:46.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.809 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.809 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.809 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-13T10:04:46.809 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.810 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.810 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2023-09-13T10:04:46.810 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.810 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.811 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.811 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.811 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2023-09-13T10:04:46.811 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2023-09-13T10:04:46.811 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.812 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.812 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.812 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-13T10:04:46.812 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.812 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.812 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.813 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:46.813 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.813 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.813 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2023-09-13T10:04:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2023-09-13T10:04:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.814 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-09-13T10:04:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2023-09-13T10:04:46.815 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2023-09-13T10:04:46.816 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2023-09-13T10:04:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.817 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-13T10:04:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:46.818 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2023-09-13T10:04:46.819 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2023-09-13T10:04:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.820 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-13T10:04:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2023-09-13T10:04:46.821 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.822 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2023-09-13T10:04:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2023-09-13T10:04:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.823 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-13T10:04:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.824 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2023-09-13T10:04:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2023-09-13T10:04:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2023-09-13T10:04:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.826 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.827 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2023-09-13T10:04:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.828 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2023-09-13T10:04:46.829 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2023-09-13T10:04:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.830 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-13T10:04:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.831 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2023-09-13T10:04:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2023-09-13T10:04:46.832 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2023-09-13T10:04:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.833 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-13T10:04:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2023-09-13T10:04:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2023-09-13T10:04:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.835 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2023-09-13T10:04:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-13T10:04:46.836 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2023-09-13T10:04:46.837 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2023-09-13T10:04:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2023-09-13T10:04:46.838 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2023-09-13T10:04:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.839 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2023-09-13T10:04:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2023-09-13T10:04:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.840 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.841 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-13T10:04:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.842 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2023-09-13T10:04:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2023-09-13T10:04:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.843 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2023-09-13T10:04:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2023-09-13T10:04:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2023-09-13T10:04:46.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2023-09-13T10:04:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.847 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2023-09-13T10:04:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2023-09-13T10:04:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.848 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.849 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-09-13T10:04:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.850 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.851 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.852 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.853 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.854 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2023-09-13T10:04:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2023-09-13T10:04:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.855 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.856 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-13T10:04:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.857 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.858 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-13T10:04:46.860 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.864 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.865 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.867 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.868 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.869 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-13T10:04:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-13T10:04:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.870 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-13T10:04:46.871 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-13T10:04:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-13T10:04:46.872 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2023-09-13T10:04:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.873 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-13T10:04:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2023-09-13T10:04:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2023-09-13T10:04:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.875 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2023-09-13T10:04:46.876 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2023-09-13T10:04:46.877 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2023-09-13T10:04:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:46.878 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-13T10:04:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.879 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2023-09-13T10:04:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2023-09-13T10:04:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.880 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.881 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2023-09-13T10:04:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.882 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-09-13T10:04:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-09-13T10:04:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2023-09-13T10:04:46.883 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2023-09-13T10:04:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2023-09-13T10:04:46.884 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2023-09-13T10:04:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.885 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2023-09-13T10:04:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2023-09-13T10:04:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.886 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-13T10:04:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-13T10:04:46.887 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.888 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2023-09-13T10:04:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2023-09-13T10:04:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.889 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.890 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-13T10:04:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.891 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2023-09-13T10:04:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2023-09-13T10:04:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.892 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.893 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-13T10:04:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.894 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2023-09-13T10:04:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2023-09-13T10:04:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.895 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.896 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-13T10:04:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.897 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2023-09-13T10:04:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2023-09-13T10:04:46.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.899 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.899 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.899 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.899 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.900 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-13T10:04:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2023-09-13T10:04:46.901 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2023-09-13T10:04:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.902 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-13T10:04:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.903 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2023-09-13T10:04:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2023-09-13T10:04:46.904 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2023-09-13T10:04:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.905 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2023-09-13T10:04:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2023-09-13T10:04:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2023-09-13T10:04:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.907 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.908 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-13T10:04:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.909 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2023-09-13T10:04:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2023-09-13T10:04:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.910 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.911 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.911 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.911 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.911 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-13T10:04:46.911 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.912 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.912 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2023-09-13T10:04:46.912 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2023-09-13T10:04:46.913 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.913 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.913 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.913 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.913 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.913 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.914 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.914 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-13T10:04:46.914 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.914 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.914 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.915 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2023-09-13T10:04:46.915 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2023-09-13T10:04:46.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.916 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.916 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.916 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2023-09-13T10:04:46.917 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.917 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2023-09-13T10:04:46.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2023-09-13T10:04:46.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.918 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-13T10:04:46.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.920 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2023-09-13T10:04:46.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2023-09-13T10:04:46.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.921 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.922 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.922 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.922 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-13T10:04:46.922 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.922 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.923 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.923 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.924 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2023-09-13T10:04:46.924 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.924 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.924 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.925 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:46.925 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:46.925 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.925 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.925 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.926 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.926 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.926 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.926 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.926 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.927 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.927 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.927 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.927 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.929 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.929 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.929 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.929 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.929 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.930 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.930 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.930 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:46.930 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:46.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.931 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.931 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.931 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.931 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.931 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.931 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.932 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.932 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.932 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.932 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.932 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.933 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:46.933 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:46.933 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.933 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.933 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.934 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:46.934 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.934 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.934 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:46.934 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:46.935 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:46.935 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:46.935 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:46.935 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:46.936 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:46.936 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:46.936 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.936 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.937 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.937 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.937 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:46.937 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:46.938 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.938 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.938 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.938 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.939 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.939 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.939 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.939 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.940 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.940 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.940 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.941 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2023-09-13T10:04:46.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2023-09-13T10:04:46.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.942 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.942 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.942 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2023-09-13T10:04:46.942 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.943 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.943 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.943 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-13T10:04:46.943 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.943 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.943 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2023-09-13T10:04:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2023-09-13T10:04:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:46.944 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2023-09-13T10:04:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-13T10:04:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.946 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2023-09-13T10:04:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:46.947 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-13T10:04:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-13T10:04:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.949 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:46.949 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.949 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.949 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.949 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.950 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2023-09-13T10:04:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-13T10:04:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.951 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.952 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.952 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.952 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.952 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.952 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-13T10:04:46.953 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-13T10:04:46.954 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.954 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.954 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.954 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.954 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.955 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.955 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.955 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.955 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.955 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.956 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.956 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.956 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2023-09-13T10:04:46.956 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2023-09-13T10:04:46.956 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.956 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.957 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.957 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:46.957 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.957 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.957 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.958 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.958 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.958 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.958 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.958 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.959 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-13T10:04:46.959 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-13T10:04:46.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.959 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.959 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.960 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.960 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.960 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.960 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.961 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.961 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.961 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.962 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.962 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2023-09-13T10:04:46.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-13T10:04:46.963 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.963 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.963 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.963 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.964 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.964 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.965 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-13T10:04:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-13T10:04:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.966 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.967 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.968 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.968 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.968 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.969 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.969 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.969 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.970 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.970 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-13T10:04:46.970 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-13T10:04:46.970 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.971 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.971 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.971 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.971 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.971 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.972 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.972 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.972 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.973 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-13T10:04:46.973 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-13T10:04:46.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.974 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.974 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.975 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-13T10:04:46.976 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-13T10:04:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.978 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-13T10:04:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-13T10:04:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.979 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.981 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.981 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-13T10:04:46.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-13T10:04:46.982 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.982 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.982 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.982 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.983 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.983 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.983 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.983 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.983 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.983 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.984 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.984 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.984 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-13T10:04:46.984 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-13T10:04:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.985 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.986 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-13T10:04:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-13T10:04:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.987 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.988 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2023-09-13T10:04:46.989 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-13T10:04:46.990 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.990 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.990 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.990 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:46.990 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-13T10:04:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-13T10:04:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:46.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.993 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.993 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:46.993 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.993 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.994 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.994 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.994 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.994 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2023-09-13T10:04:46.995 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2023-09-13T10:04:46.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:46.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.996 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.997 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:46.997 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:46.997 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:46.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:46.997 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2023-09-13T10:04:46.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-13T10:04:46.998 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:46.998 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:46.998 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:46.998 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:46.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:46.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:46.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:46.999 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:46.999 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.000 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.000 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-13T10:04:47.001 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-13T10:04:47.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.001 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.002 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.002 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.002 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.002 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.003 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.003 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.003 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-13T10:04:47.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-13T10:04:47.004 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.004 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.004 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.004 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.005 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.005 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.005 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.006 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.006 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-13T10:04:47.006 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-13T10:04:47.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.006 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.007 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.007 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.007 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.007 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.008 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.008 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.008 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.008 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.009 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-13T10:04:47.009 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-13T10:04:47.009 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.010 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.011 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.011 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.011 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.011 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.012 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.012 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.012 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.012 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2023-09-13T10:04:47.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-13T10:04:47.013 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.013 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.013 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.013 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.014 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.014 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.014 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.014 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.015 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.015 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-13T10:04:47.015 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-13T10:04:47.016 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.016 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.016 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.016 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.016 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.017 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.017 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.017 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.017 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.018 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.018 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-13T10:04:47.018 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-13T10:04:47.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.019 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.019 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.019 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.020 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.020 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.020 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.020 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-13T10:04:47.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-13T10:04:47.021 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.021 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.021 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.022 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.022 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.022 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.022 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.022 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-13T10:04:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-13T10:04:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.023 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.025 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-13T10:04:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-13T10:04:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.026 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-13T10:04:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-13T10:04:47.028 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.029 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-13T10:04:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-13T10:04:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.032 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.033 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-13T10:04:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-13T10:04:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.034 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.035 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.036 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2023-09-13T10:04:47.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-13T10:04:47.037 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.037 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.037 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.038 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.038 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.039 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.039 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-13T10:04:47.040 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-13T10:04:47.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-13T10:04:47.041 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.041 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.041 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.042 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.042 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.042 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.043 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-13T10:04:47.043 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-13T10:04:47.043 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.044 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.044 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.044 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:47.044 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.044 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.045 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.045 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.045 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.045 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.046 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-13T10:04:47.046 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-13T10:04:47.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.047 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.047 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2023-09-13T10:04:47.048 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.048 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.048 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-13T10:04:47.049 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-13T10:04:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2023-09-13T10:04:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.050 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.051 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2023-09-13T10:04:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-13T10:04:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.052 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.053 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.053 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.053 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.053 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.053 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.054 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.054 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.054 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.054 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-13T10:04:47.054 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-13T10:04:47.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.055 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.055 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.055 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:47.055 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.056 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.056 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.056 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.056 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.056 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.056 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.057 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2023-09-13T10:04:47.057 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-13T10:04:47.057 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.057 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.057 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.058 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.058 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.058 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.058 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.058 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.059 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.059 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2023-09-13T10:04:47.059 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-13T10:04:47.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.060 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.060 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.060 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.061 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.062 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-13T10:04:47.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-13T10:04:47.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.062 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:47.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.063 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.064 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-13T10:04:47.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-13T10:04:47.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.065 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:47.065 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.066 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.066 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.066 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.067 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-13T10:04:47.067 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-13T10:04:47.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.068 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:47.068 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.069 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.069 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.069 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.070 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.070 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2023-09-13T10:04:47.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2023-09-13T10:04:47.070 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.071 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.071 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.071 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.071 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.071 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.072 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.072 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.072 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.072 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.073 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.073 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2023-09-13T10:04:47.073 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2023-09-13T10:04:47.073 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.074 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.074 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.074 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.075 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.075 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.076 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2023-09-13T10:04:47.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2023-09-13T10:04:47.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.077 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.077 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.077 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.078 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2023-09-13T10:04:47.078 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.078 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.079 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.079 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.079 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2023-09-13T10:04:47.079 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2023-09-13T10:04:47.079 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.080 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.080 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.080 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2023-09-13T10:04:47.080 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.081 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.081 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.081 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.081 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.082 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.082 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.082 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-09-13T10:04:47.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-09-13T10:04:47.083 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.083 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.083 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.084 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.084 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.084 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.084 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.084 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.084 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.085 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.085 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.085 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.085 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.086 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.086 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.086 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.086 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.086 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.087 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.087 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.087 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.087 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.087 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.087 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.088 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.088 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.088 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.088 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.088 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.089 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.089 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.089 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.089 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.089 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.089 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.090 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.090 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.090 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.090 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.090 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.091 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.091 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.091 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.092 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.092 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.093 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.093 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.093 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.093 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.094 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.094 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.094 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.094 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.094 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.095 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.095 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.095 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.095 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.095 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.095 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.096 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.096 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.096 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.096 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.096 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.097 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.097 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.097 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.097 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.097 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.097 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.098 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.098 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.098 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2023-09-13T10:04:47.098 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2023-09-13T10:04:47.098 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.099 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.099 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.099 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.099 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.099 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.100 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2023-09-13T10:04:47.100 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.100 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.100 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.100 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.101 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2023-09-13T10:04:47.101 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2023-09-13T10:04:47.101 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.101 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.101 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.102 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.103 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.103 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.103 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:47.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:47.104 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.104 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.104 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.104 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-09-13T10:04:47.105 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.105 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.105 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.105 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.106 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.106 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.106 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:47.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:47.107 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.107 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.107 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.107 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2023-09-13T10:04:47.108 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.108 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.108 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.108 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.108 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.109 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.109 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.109 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.109 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-09-13T10:04:47.109 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-09-13T10:04:47.110 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.110 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.110 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.110 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.111 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.111 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.111 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.111 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.112 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.112 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.112 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2023-09-13T10:04:47.113 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2023-09-13T10:04:47.113 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.113 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.113 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.114 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2023-09-13T10:04:47.114 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.114 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.115 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.115 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.115 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.115 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.116 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.116 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-09-13T10:04:47.116 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-09-13T10:04:47.117 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.117 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.117 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.117 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2023-09-13T10:04:47.117 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.118 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.118 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.118 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.118 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2023-09-13T10:04:47.118 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.119 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.119 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.119 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.119 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.119 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.120 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-09-13T10:04:47.120 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-09-13T10:04:47.120 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.120 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.120 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.120 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-09-13T10:04:47.121 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-09-13T10:04:47.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-09-13T10:04:47.121 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.121 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.121 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.122 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.122 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.122 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.122 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2023-09-13T10:04:47.122 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2023-09-13T10:04:47.122 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.123 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.123 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.123 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.123 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.123 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.124 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.124 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.124 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.124 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.124 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.124 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.125 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.125 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.125 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-09-13T10:04:47.125 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.125 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.126 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.126 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2023-09-13T10:04:47.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2023-09-13T10:04:47.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2023-09-13T10:04:47.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.128 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.129 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.130 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.130 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.131 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.131 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.134 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.134 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.134 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.134 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.134 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.135 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.135 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.135 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.135 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.136 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.136 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.136 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.137 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.137 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.137 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.137 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.138 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.138 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.138 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.138 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.139 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.139 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.139 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.139 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.139 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.140 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.140 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.140 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.140 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.141 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.141 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.141 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.141 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.141 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.142 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.142 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.142 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.142 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.143 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.143 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.143 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.144 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.144 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.144 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.145 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2023-09-13T10:04:47.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2023-09-13T10:04:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.146 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2023-09-13T10:04:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.147 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-13T10:04:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.148 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2023-09-13T10:04:47.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2023-09-13T10:04:47.149 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.149 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.149 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.149 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2023-09-13T10:04:47.150 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.150 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.150 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.150 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-13T10:04:47.151 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.151 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.151 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.151 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.151 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2023-09-13T10:04:47.152 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2023-09-13T10:04:47.152 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.152 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.152 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2023-09-13T10:04:47.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.153 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.153 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.153 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2023-09-13T10:04:47.153 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.153 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.154 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.154 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.154 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2023-09-13T10:04:47.154 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2023-09-13T10:04:47.154 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.155 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.155 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.155 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-09-13T10:04:47.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.156 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.156 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.156 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-13T10:04:47.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.158 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2023-09-13T10:04:47.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2023-09-13T10:04:47.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.159 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.159 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-13T10:04:47.159 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.160 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.160 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.160 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.160 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:47.160 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:47.161 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.161 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.161 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.161 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:47.161 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.161 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.162 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.162 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2023-09-13T10:04:47.162 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.162 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.162 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.163 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.163 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2023-09-13T10:04:47.163 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2023-09-13T10:04:47.163 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.163 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.163 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.164 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2023-09-13T10:04:47.164 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.164 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.164 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.164 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-13T10:04:47.165 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.165 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.165 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.165 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.165 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.166 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.166 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2023-09-13T10:04:47.166 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.166 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.166 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.167 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.167 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.167 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.167 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.168 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.168 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.168 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.168 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.168 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.168 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.170 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.171 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.172 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.172 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.172 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.172 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.173 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.173 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.173 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.173 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.174 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.174 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.174 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.175 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.175 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.175 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.175 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.175 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.175 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.176 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.176 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.176 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.177 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.177 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.177 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.178 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.178 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.178 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.178 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.179 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.179 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.179 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.180 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2023-09-13T10:04:47.180 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2023-09-13T10:04:47.180 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.180 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.180 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.181 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-09-13T10:04:47.181 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.181 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.181 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.182 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.182 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.182 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.182 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.182 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.183 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2023-09-13T10:04:47.183 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2023-09-13T10:04:47.183 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.183 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.184 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.184 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2023-09-13T10:04:47.184 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.184 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.184 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.185 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.185 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.185 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.185 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.186 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:47.186 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:47.186 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.187 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.187 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.187 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:47.187 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.188 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.188 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.188 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.188 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.189 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.189 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.189 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.190 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.190 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.190 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2023-09-13T10:04:47.190 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2023-09-13T10:04:47.191 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2023-09-13T10:04:47.191 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.191 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2023-09-13T10:04:47.191 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2023-09-13T10:04:47.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2023-09-13T10:04:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-13T10:04:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.193 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2023-09-13T10:04:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2023-09-13T10:04:47.194 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2023-09-13T10:04:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.195 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-13T10:04:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.196 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.197 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2023-09-13T10:04:47.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2023-09-13T10:04:47.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.197 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.197 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.198 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.198 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.198 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2023-09-13T10:04:47.198 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.199 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.199 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:47.199 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:47.199 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.200 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.200 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.200 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2023-09-13T10:04:47.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2023-09-13T10:04:47.200 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-13T10:04:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.201 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.202 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.203 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.204 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.205 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.206 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.207 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.208 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.209 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.210 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.211 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.214 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.215 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2023-09-13T10:04:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2023-09-13T10:04:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2023-09-13T10:04:47.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.218 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2023-09-13T10:04:47.219 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2023-09-13T10:04:47.219 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.219 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.219 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2023-09-13T10:04:47.220 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.220 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.220 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2023-09-13T10:04:47.221 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.221 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-09-13T10:04:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-09-13T10:04:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2023-09-13T10:04:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-13T10:04:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2023-09-13T10:04:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2023-09-13T10:04:47.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2023-09-13T10:04:47.226 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-13T10:04:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2023-09-13T10:04:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2023-09-13T10:04:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2023-09-13T10:04:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2023-09-13T10:04:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2023-09-13T10:04:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2023-09-13T10:04:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-13T10:04:47.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.233 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2023-09-13T10:04:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.234 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.235 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.236 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.242 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.242 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.242 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.243 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.243 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.243 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.243 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.243 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.243 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.244 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.244 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.244 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.244 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.244 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.245 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.245 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.245 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.245 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.245 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.245 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.246 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.246 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.246 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.246 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.246 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.247 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.247 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.247 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.247 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.247 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2023-09-13T10:04:47.248 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.248 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.248 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.248 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.249 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.250 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.250 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.250 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.250 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.250 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.251 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.251 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.251 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.251 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.251 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.252 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.252 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.252 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.252 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.252 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.253 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.253 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.253 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.253 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.254 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.254 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.254 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.254 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.254 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.255 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.255 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.255 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.255 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.255 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.256 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.256 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.256 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.256 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.257 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.257 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.257 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.257 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.258 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.258 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.258 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.258 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.258 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.259 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.259 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.259 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.260 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.260 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.261 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.261 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.262 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.262 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.263 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.263 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.263 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.263 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.264 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.264 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2023-09-13T10:04:47.264 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.265 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.265 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.265 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2023-09-13T10:04:47.265 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2023-09-13T10:04:47.265 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.266 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.266 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.266 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2023-09-13T10:04:47.266 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.266 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.266 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.267 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-13T10:04:47.267 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.267 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.267 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.267 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.268 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2023-09-13T10:04:47.268 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2023-09-13T10:04:47.268 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.268 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.268 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.269 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:47.269 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2023-09-13T10:04:47.269 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.269 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.269 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-13T10:04:47.269 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.270 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.270 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.270 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.270 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.270 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.271 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.271 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.271 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.271 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.271 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.272 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.272 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.272 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.272 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.272 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.272 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.273 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.273 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.273 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.273 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.274 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.274 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.274 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.276 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.277 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.277 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.278 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.278 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.278 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.279 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.279 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.279 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.279 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.279 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.280 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.280 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.280 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.280 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.280 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.280 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.281 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.281 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.281 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.281 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.281 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.282 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.282 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.282 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.282 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.283 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.283 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.283 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.283 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.283 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.284 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.284 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2023-09-13T10:04:47.284 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.284 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.285 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.285 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2023-09-13T10:04:47.285 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2023-09-13T10:04:47.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.286 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2023-09-13T10:04:47.286 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.286 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.286 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2023-09-13T10:04:47.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-13T10:04:47.287 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.287 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.288 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.288 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.288 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.288 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.289 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.289 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.289 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.290 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.290 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.290 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.290 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.291 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.291 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.291 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.292 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.292 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.292 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.293 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.294 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.294 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.295 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.295 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.295 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.295 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.296 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.296 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.296 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.296 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.296 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.296 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.297 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.297 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.297 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.297 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.297 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.298 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.299 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.299 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.299 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.299 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.299 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.300 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.300 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.300 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.300 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.300 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.300 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.301 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.301 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.301 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.301 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.301 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.302 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.302 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.302 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.302 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2023-09-13T10:04:47.302 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2023-09-13T10:04:47.303 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.303 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.303 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.303 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.303 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.304 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.304 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.304 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2023-09-13T10:04:47.304 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-13T10:04:47.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.305 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.305 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.305 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2023-09-13T10:04:47.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2023-09-13T10:04:47.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.306 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2023-09-13T10:04:47.306 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.306 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.306 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.307 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2023-09-13T10:04:47.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.307 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.308 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2023-09-13T10:04:47.308 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2023-09-13T10:04:47.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.308 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.308 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.308 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2023-09-13T10:04:47.309 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2023-09-13T10:04:47.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.310 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.310 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2023-09-13T10:04:47.310 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2023-09-13T10:04:47.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.311 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.311 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.311 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.311 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.311 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.312 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.312 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2023-09-13T10:04:47.312 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.312 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.312 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.313 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.313 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2023-09-13T10:04:47.313 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2023-09-13T10:04:47.313 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.313 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.313 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.314 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2023-09-13T10:04:47.314 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.314 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.314 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-13T10:04:47.315 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-13T10:04:47.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.315 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.316 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.316 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2023-09-13T10:04:47.316 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.316 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.316 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.317 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.317 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.317 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.317 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.317 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.318 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.318 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.318 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.318 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.318 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.319 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.319 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.319 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.319 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.320 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.320 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.320 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.320 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.320 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.320 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.321 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.321 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.321 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.321 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.322 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.322 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.322 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.322 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.322 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.323 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.323 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.323 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.323 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.324 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.324 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.324 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.324 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.324 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.325 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.325 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.325 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.325 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.325 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.326 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.326 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.326 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.326 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.327 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.327 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.327 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.327 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.328 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.328 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.329 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.330 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.330 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.331 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.331 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.331 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.332 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.332 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.332 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.333 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.333 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2023-09-13T10:04:47.333 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.333 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.333 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.333 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.334 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.335 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.335 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.335 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.335 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.336 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.336 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.336 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.336 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.336 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.336 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.337 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.337 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.337 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.337 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.338 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.338 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.338 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.338 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.339 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.339 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.339 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.340 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.340 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.340 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.340 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.340 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.341 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.341 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.341 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.341 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.341 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.342 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.342 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.342 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.342 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.343 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.343 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.343 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.343 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.344 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.344 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.344 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.344 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.345 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.345 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.346 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.346 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.346 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.346 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.347 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.347 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.347 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.347 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2023-09-13T10:04:47.347 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.347 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.348 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.348 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.348 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.348 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.348 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.349 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.349 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.349 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.349 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.349 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.350 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.350 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.350 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.350 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.350 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.350 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.351 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.351 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.351 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.351 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.351 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.352 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.352 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.352 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.352 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.353 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.353 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.353 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.354 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.354 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.354 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.355 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.355 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.356 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.356 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.356 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.356 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.356 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.357 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.357 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.357 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.357 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.357 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.358 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.358 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.358 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.358 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.359 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.359 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.359 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.359 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.360 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.360 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.360 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.360 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.361 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.361 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.361 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.361 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.361 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.362 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.362 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.362 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.363 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.363 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-09-13T10:04:47.363 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.364 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.364 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.364 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2023-09-13T10:04:47.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2023-09-13T10:04:47.365 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.365 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.365 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.365 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.366 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.366 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.366 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.366 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-13T10:04:47.366 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.367 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.367 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.367 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.367 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.368 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.369 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.370 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.371 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.372 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.372 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.372 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.372 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.372 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.372 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.373 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.373 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.373 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.373 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.373 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.374 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.375 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.376 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.377 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.378 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.379 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2023-09-13T10:04:47.380 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-09-13T10:04:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.381 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-09-13T10:04:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2023-09-13T10:04:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2023-09-13T10:04:47.382 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2023-09-13T10:04:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.383 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2023-09-13T10:04:47.384 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.385 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.386 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.387 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.391 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.391 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.391 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.391 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.393 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.393 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.393 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.393 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.394 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.394 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.394 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.394 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.394 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.395 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.395 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.395 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.395 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.396 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.396 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.396 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.396 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.397 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.397 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.397 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.397 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.398 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.398 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.398 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.398 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.398 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.399 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.399 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.399 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.400 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.400 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.400 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.400 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2023-09-13T10:04:47.401 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.401 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.401 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.401 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.402 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.402 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.402 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.403 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.403 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.403 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.403 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.403 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.404 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.404 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.404 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.404 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.404 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.405 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.405 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.405 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.405 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.405 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.405 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.406 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.406 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.406 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.406 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.406 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.407 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.407 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.407 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.407 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.407 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.408 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.408 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.408 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.408 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.408 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.408 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.409 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.409 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.409 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.409 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.410 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.411 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.412 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.412 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.412 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.413 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.413 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.413 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.413 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.413 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.414 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.414 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.415 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.415 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.415 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.415 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2023-09-13T10:04:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.416 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.417 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.418 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.419 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.421 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.422 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.423 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.424 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.425 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.426 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.428 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.429 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.430 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "noautoscale": { 2023-09-13T10:04:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "noautoscale", 2023-09-13T10:04:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.431 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.432 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "global autoscale flag", 2023-09-13T10:04:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-13T10:04:47.433 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:47.434 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.435 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.436 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.437 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2023-09-13T10:04:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2023-09-13T10:04:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.438 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-09-13T10:04:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2023-09-13T10:04:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2023-09-13T10:04:47.439 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-13T10:04:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2023-09-13T10:04:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.441 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2023-09-13T10:04:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2023-09-13T10:04:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.442 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-13T10:04:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.443 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-09-13T10:04:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-09-13T10:04:47.444 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.445 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.447 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.448 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.449 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.450 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.451 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.452 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.453 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.454 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.455 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.456 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.457 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.458 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.459 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2023-09-13T10:04:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2023-09-13T10:04:47.460 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2023-09-13T10:04:47.461 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2023-09-13T10:04:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.462 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:47.463 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.464 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2023-09-13T10:04:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.465 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2023-09-13T10:04:47.466 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2023-09-13T10:04:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2023-09-13T10:04:47.467 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.468 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.469 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2023-09-13T10:04:47.470 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2023-09-13T10:04:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.471 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.472 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-13T10:04:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-13T10:04:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.473 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.474 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.475 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.476 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.477 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.478 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.479 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.480 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.481 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.482 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.483 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.484 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.485 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.486 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.487 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2023-09-13T10:04:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2023-09-13T10:04:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-13T10:04:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-13T10:04:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2023-09-13T10:04:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.491 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.492 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2023-09-13T10:04:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2023-09-13T10:04:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.493 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2023-09-13T10:04:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.495 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-09-13T10:04:47.496 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.497 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-13T10:04:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.498 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.499 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2023-09-13T10:04:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.500 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-13T10:04:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.501 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2023-09-13T10:04:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2023-09-13T10:04:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.502 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2023-09-13T10:04:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.503 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.504 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-09-13T10:04:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-09-13T10:04:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.505 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2023-09-13T10:04:47.506 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2023-09-13T10:04:47.507 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2023-09-13T10:04:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.508 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-09-13T10:04:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-09-13T10:04:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.509 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-09-13T10:04:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-09-13T10:04:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-09-13T10:04:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.510 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.511 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-09-13T10:04:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.512 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.513 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.514 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.515 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.516 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.518 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.519 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.520 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.521 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.522 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.523 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.524 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.525 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2023-09-13T10:04:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2023-09-13T10:04:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.526 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.527 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.528 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2023-09-13T10:04:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2023-09-13T10:04:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.529 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.530 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.531 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2023-09-13T10:04:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2023-09-13T10:04:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.532 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.534 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.535 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2023-09-13T10:04:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2023-09-13T10:04:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2023-09-13T10:04:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.537 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.538 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.539 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-09-13T10:04:47.540 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-09-13T10:04:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.541 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.543 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.544 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.545 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.545 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.545 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.545 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.545 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.546 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.546 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.546 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.546 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.547 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.547 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.547 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.547 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.547 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.548 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.548 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.548 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.548 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.549 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.549 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.549 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.549 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.549 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.549 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.550 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.550 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.550 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.550 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.550 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.551 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.551 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.551 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.551 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.552 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.552 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.552 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.552 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.552 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.553 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.553 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.553 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.553 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.553 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.553 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.554 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.554 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.554 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.554 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.554 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.555 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.555 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.555 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.555 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.555 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.556 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.556 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.556 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.556 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.556 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.556 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.557 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.557 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.557 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.557 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:47.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:47.558 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.558 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.558 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.558 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.559 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.559 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.559 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.559 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.559 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.560 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.560 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.560 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.560 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:47.560 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:47.560 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.561 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.561 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.561 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.561 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.561 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.562 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.562 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.562 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.562 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.562 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.563 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.563 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.563 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.563 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2023-09-13T10:04:47.563 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.564 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.564 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.564 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.564 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.564 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.564 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.565 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.565 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.565 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.565 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.565 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.566 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.566 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.566 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.566 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.566 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.567 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.567 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.567 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.567 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.568 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.568 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.568 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.568 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.568 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.569 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.569 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.569 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.569 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.570 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.570 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.570 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.570 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.570 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.571 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.571 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.571 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.571 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.572 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.572 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.572 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.572 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.572 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.573 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.573 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.573 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.573 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.574 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.574 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.574 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.574 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.575 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.575 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.575 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.575 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.575 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.576 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.576 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.576 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.577 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.577 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.577 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.578 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.578 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.578 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.578 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.579 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.579 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.580 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.580 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.580 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2023-09-13T10:04:47.580 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.581 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.581 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.581 INFO:teuthology.orchestra.run.smithi006.stdout: "drive_group_interval": { 2023-09-13T10:04:47.581 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "drive_group_interval", 2023-09-13T10:04:47.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.582 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.582 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.582 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300.0", 2023-09-13T10:04:47.582 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.582 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.582 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.583 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-13T10:04:47.583 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.583 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.583 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.583 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.584 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.584 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.584 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.584 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.584 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.585 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.585 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.585 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.585 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.585 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.586 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.586 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.586 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.586 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.586 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.587 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.587 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.587 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.587 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.587 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.587 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.588 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.588 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.588 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.588 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.589 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.589 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.589 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.589 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.589 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.590 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.590 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.590 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.590 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.590 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.591 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.591 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.591 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.591 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.591 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.592 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.592 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.592 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.592 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.593 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.594 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.594 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.594 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.594 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.594 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.595 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.595 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.595 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.595 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.595 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.596 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.596 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.596 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.596 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.596 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.596 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2023-09-13T10:04:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2023-09-13T10:04:47.597 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2023-09-13T10:04:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.598 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-13T10:04:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.599 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.600 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2023-09-13T10:04:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.601 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.602 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.603 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.604 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.605 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.606 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.607 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.608 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.609 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.610 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.611 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.612 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.613 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.614 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.615 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.616 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.616 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.616 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.616 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.617 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2023-09-13T10:04:47.617 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2023-09-13T10:04:47.617 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.617 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.618 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.618 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.618 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.618 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.619 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.619 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.619 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.619 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.620 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.620 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2023-09-13T10:04:47.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2023-09-13T10:04:47.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.620 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2023-09-13T10:04:47.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.621 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.621 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.622 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.622 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.622 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.622 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.622 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2023-09-13T10:04:47.622 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2023-09-13T10:04:47.623 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.623 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.623 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.623 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.623 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.624 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.624 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.624 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.624 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.625 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2023-09-13T10:04:47.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2023-09-13T10:04:47.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.626 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.626 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.626 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.627 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.627 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.627 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.627 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.627 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.628 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2023-09-13T10:04:47.628 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2023-09-13T10:04:47.628 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.628 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.628 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.628 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.629 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.629 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.629 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.629 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.629 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.630 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.630 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.630 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.630 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2023-09-13T10:04:47.630 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2023-09-13T10:04:47.631 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.631 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.631 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.631 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.631 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.632 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.632 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.632 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.632 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.632 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.633 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.633 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2023-09-13T10:04:47.633 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2023-09-13T10:04:47.633 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.633 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.634 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.634 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.634 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.634 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.634 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.635 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.635 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.635 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.635 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.635 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.636 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2023-09-13T10:04:47.636 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2023-09-13T10:04:47.636 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.636 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.636 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.636 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.637 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.637 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.637 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.637 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.637 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.638 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.638 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.638 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.638 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2023-09-13T10:04:47.638 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2023-09-13T10:04:47.639 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.639 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.639 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.639 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2023-09-13T10:04:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.641 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.641 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.641 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.641 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2023-09-13T10:04:47.641 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2023-09-13T10:04:47.642 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.642 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.642 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.642 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.642 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.643 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.643 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.643 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.643 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.644 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.644 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.644 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2023-09-13T10:04:47.644 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2023-09-13T10:04:47.645 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.645 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.645 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.645 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.646 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.646 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.646 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.646 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.647 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.647 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.647 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.648 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2023-09-13T10:04:47.648 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2023-09-13T10:04:47.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.648 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.648 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.649 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.649 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.649 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.649 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.650 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.650 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.650 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.651 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.651 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.652 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.652 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2023-09-13T10:04:47.652 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.652 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.652 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.653 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2023-09-13T10:04:47.653 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2023-09-13T10:04:47.653 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.653 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.654 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.654 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.654 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.654 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2023-09-13T10:04:47.654 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.655 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.655 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.655 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.655 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2023-09-13T10:04:47.655 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2023-09-13T10:04:47.656 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.656 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.656 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.656 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.656 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.656 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.657 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.657 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2023-09-13T10:04:47.657 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.657 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.658 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.658 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.658 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.658 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.658 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.659 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.659 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.659 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.660 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.660 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.660 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.660 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.661 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.661 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.661 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.661 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.661 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.662 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.662 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.662 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.662 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.662 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.662 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.663 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.663 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.663 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.663 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.663 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.664 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.664 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.665 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.665 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.665 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.666 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.666 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.666 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.667 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.667 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.667 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.667 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.667 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.668 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.668 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.668 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.668 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.668 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.668 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.669 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.669 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.669 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.669 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.669 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.669 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.670 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.670 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.670 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.670 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.671 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.671 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.671 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2023-09-13T10:04:47.672 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.672 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.672 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.672 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.673 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.673 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.673 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.673 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.673 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.674 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.674 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.674 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.674 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.674 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.675 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.675 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.675 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.675 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.676 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.676 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.676 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.676 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.676 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.677 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.677 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.677 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.677 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.678 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.678 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.678 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.678 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.678 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.679 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.679 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.679 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.679 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.680 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.680 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.680 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.680 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.680 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.681 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.681 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.681 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.681 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.682 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.682 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.682 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.682 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.683 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.683 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.683 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.683 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.684 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.684 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.684 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.684 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.685 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.685 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.685 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.685 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.685 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.685 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.686 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.686 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.686 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.686 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.686 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.687 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.687 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.687 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.687 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.687 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.688 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2023-09-13T10:04:47.688 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.689 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.689 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.689 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.689 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.690 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.690 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.690 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.690 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.690 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.690 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.691 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.691 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.691 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.691 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.691 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.692 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.692 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.692 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.692 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.692 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.693 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.693 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.693 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.694 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.694 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.694 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.694 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.694 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.695 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.695 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.695 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.695 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.696 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.696 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.696 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.697 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.697 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.697 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.697 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.697 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.698 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.698 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.698 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.698 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.698 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.699 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.699 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.701 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.701 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.701 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.702 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.702 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.703 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2023-09-13T10:04:47.704 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.704 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.704 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.704 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2023-09-13T10:04:47.704 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2023-09-13T10:04:47.705 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.705 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.705 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.705 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-13T10:04:47.705 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.706 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.706 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.706 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.706 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.706 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.707 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.707 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.707 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:47.707 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:47.707 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.708 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.708 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.708 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2023-09-13T10:04:47.708 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.708 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.709 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.709 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.709 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.709 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.709 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.710 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.710 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.710 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.710 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.711 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.711 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.711 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.711 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.711 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.712 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.712 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.712 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.713 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.713 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.713 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.713 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.714 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.714 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.714 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.714 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.715 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.715 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.715 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.715 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.716 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.716 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.716 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.716 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.717 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.717 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.717 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.717 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.718 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.718 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.718 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.719 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.719 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.720 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.721 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.721 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.721 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.721 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.722 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.722 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.722 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.722 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.723 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.723 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.723 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.723 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.723 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.724 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.724 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.724 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.724 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.724 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.725 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.725 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.725 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.725 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.725 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.725 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.726 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.726 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.726 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.726 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.726 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.727 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.727 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.727 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.727 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2023-09-13T10:04:47.727 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.728 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.728 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.728 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2023-09-13T10:04:47.728 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2023-09-13T10:04:47.728 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.729 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.729 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.729 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.729 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.729 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.729 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.730 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-13T10:04:47.730 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.730 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.730 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.731 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2023-09-13T10:04:47.731 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2023-09-13T10:04:47.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.731 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.731 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.731 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.732 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.732 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-13T10:04:47.732 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.733 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.733 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.733 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2023-09-13T10:04:47.733 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2023-09-13T10:04:47.733 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.734 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.734 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.734 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.735 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-13T10:04:47.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.735 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.736 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2023-09-13T10:04:47.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2023-09-13T10:04:47.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.736 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.736 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.737 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-13T10:04:47.738 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.738 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.738 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.739 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.739 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2023-09-13T10:04:47.739 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2023-09-13T10:04:47.739 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.740 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.740 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.740 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.740 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.740 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.741 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.741 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-13T10:04:47.741 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.741 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.742 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.742 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2023-09-13T10:04:47.742 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2023-09-13T10:04:47.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.743 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.743 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.744 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.744 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.744 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.744 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.745 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.745 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.745 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.745 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.746 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2023-09-13T10:04:47.746 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2023-09-13T10:04:47.746 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.747 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.749 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.750 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.750 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.750 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.750 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.751 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.751 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.751 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.751 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2023-09-13T10:04:47.752 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2023-09-13T10:04:47.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.752 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.753 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-13T10:04:47.754 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.754 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.754 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.755 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.755 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.755 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.755 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.756 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.756 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-09-13T10:04:47.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-09-13T10:04:47.757 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.757 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.758 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.758 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.758 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.758 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.759 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.759 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.759 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:47.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2023-09-13T10:04:47.761 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2023-09-13T10:04:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2023-09-13T10:04:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2023-09-13T10:04:47.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2023-09-13T10:04:47.764 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.765 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2023-09-13T10:04:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2023-09-13T10:04:47.766 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.767 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.768 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2023-09-13T10:04:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2023-09-13T10:04:47.769 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.770 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.771 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.772 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.772 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.772 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.772 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.772 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.773 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.774 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.775 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.775 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.775 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.775 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.776 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.776 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.776 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.777 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.777 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.777 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.778 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.778 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.778 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.779 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.779 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.780 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.781 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.782 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.782 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.783 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.783 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.783 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.784 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.784 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.784 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.784 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.785 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.785 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.785 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.786 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.786 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.786 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.787 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.787 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.787 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.787 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.788 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.788 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.789 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.789 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.789 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.790 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.790 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.790 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.790 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.790 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.791 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2023-09-13T10:04:47.791 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2023-09-13T10:04:47.791 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.792 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.792 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.792 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.792 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.792 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.793 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.793 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.793 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.793 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.793 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.794 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.794 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2023-09-13T10:04:47.794 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2023-09-13T10:04:47.794 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.795 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.795 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.795 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.795 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.795 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.796 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.796 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.796 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.796 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.796 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.797 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2023-09-13T10:04:47.797 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2023-09-13T10:04:47.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.797 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.798 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-13T10:04:47.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.799 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.799 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.799 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.799 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.800 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.800 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.801 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.801 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.801 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2023-09-13T10:04:47.801 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.802 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.802 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.802 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.802 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.803 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.803 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.803 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.803 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.804 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.804 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.804 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.804 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.804 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.805 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.805 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.805 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.805 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.806 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.806 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.806 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.806 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.806 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.807 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.807 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.807 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.807 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.808 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.808 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.808 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.808 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.808 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.809 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.809 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.809 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.809 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.809 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.810 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.810 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.810 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.810 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.810 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.810 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.811 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.811 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.811 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.812 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.812 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.812 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.812 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.813 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.813 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.813 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.814 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.814 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.814 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.814 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.814 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.815 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.815 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.815 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.815 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.816 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.816 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.816 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.817 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.817 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.817 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.817 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.817 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.818 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.818 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.818 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.818 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.819 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.819 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-09-13T10:04:47.819 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.819 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.819 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.820 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.820 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.822 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.822 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.822 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.822 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.823 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.823 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.823 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.823 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.823 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.825 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.825 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.825 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.825 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.826 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.826 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.826 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.827 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.827 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.827 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.827 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.827 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.828 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.828 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.828 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.829 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.829 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.829 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.830 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.830 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.830 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.831 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.831 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.831 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.831 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.832 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.832 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.832 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.832 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.833 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.833 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.834 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.834 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.834 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.835 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.835 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.835 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.835 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.836 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.836 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.836 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.836 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.836 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.837 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.837 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.837 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2023-09-13T10:04:47.838 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2023-09-13T10:04:47.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.838 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.839 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.839 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2023-09-13T10:04:47.839 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.840 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.840 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-13T10:04:47.840 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.840 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.841 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2023-09-13T10:04:47.841 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2023-09-13T10:04:47.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.841 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.842 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.842 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:47.842 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.842 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.843 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.843 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-13T10:04:47.843 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.843 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.843 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.844 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.844 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2023-09-13T10:04:47.845 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.845 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.845 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.846 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2023-09-13T10:04:47.846 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2023-09-13T10:04:47.846 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:47.846 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.847 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.847 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2023-09-13T10:04:47.847 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.847 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.847 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.848 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.848 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.848 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.848 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.849 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2023-09-13T10:04:47.849 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2023-09-13T10:04:47.849 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.850 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.850 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.850 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.850 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.851 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.851 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.851 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.852 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.852 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.853 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:47.853 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:47.853 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.853 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.854 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.854 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:47.854 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.855 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.855 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.856 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.856 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.856 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.856 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.857 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.857 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.857 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.858 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.858 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.858 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.858 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.858 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.859 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.859 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.859 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.859 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.859 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.859 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.860 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.860 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.860 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.860 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.860 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.861 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.861 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.862 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.862 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.863 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.863 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.863 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.864 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.864 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.864 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.865 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.865 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.865 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.865 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.866 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.866 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.866 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.866 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.867 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.867 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.867 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.867 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.868 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.868 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.868 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.869 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.869 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.869 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.870 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.870 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.870 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.871 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.871 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.871 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.871 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.871 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.871 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.872 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.872 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2023-09-13T10:04:47.872 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2023-09-13T10:04:47.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.873 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.873 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.873 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.873 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.873 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.874 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.874 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.874 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.874 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.874 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.875 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2023-09-13T10:04:47.875 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2023-09-13T10:04:47.875 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.875 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.875 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.876 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2023-09-13T10:04:47.876 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.876 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.876 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.876 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.877 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.877 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.877 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.877 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2023-09-13T10:04:47.877 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2023-09-13T10:04:47.878 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.878 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.878 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-13T10:04:47.878 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.879 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.879 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.879 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.879 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.879 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.880 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:47.880 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.881 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.881 INFO:teuthology.orchestra.run.smithi006.stdout: "modules": [ 2023-09-13T10:04:47.881 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-09-13T10:04:47.881 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard", 2023-09-13T10:04:47.881 INFO:teuthology.orchestra.run.smithi006.stdout: "iostat", 2023-09-13T10:04:47.881 INFO:teuthology.orchestra.run.smithi006.stdout: "nfs", 2023-09-13T10:04:47.882 INFO:teuthology.orchestra.run.smithi006.stdout: "restful" 2023-09-13T10:04:47.882 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.882 INFO:teuthology.orchestra.run.smithi006.stdout: "available_modules": [ 2023-09-13T10:04:47.882 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.882 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "alerts", 2023-09-13T10:04:47.883 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.883 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.883 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.883 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:47.883 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:47.883 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.884 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.884 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.884 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:47.884 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.884 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.885 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.885 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How frequently to reexamine health status", 2023-09-13T10:04:47.885 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.885 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.885 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.886 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.886 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.886 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.887 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.887 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.887 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.887 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.887 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.888 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.888 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.888 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.888 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.888 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.889 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.889 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.889 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.889 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.889 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.890 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.890 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.890 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.891 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.891 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.891 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.891 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.891 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.892 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.893 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.894 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.894 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.894 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.894 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.894 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.895 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.895 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.895 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.895 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.896 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.896 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.896 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.896 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.896 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.897 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.897 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.897 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.898 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.898 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.898 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.898 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.899 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.899 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.899 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.899 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.900 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.900 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.900 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.900 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.901 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_destination": { 2023-09-13T10:04:47.901 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_destination", 2023-09-13T10:04:47.901 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.902 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.902 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.902 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.902 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.903 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.903 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.903 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email address to send alerts to", 2023-09-13T10:04:47.903 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.904 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.904 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.904 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.904 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_from_name": { 2023-09-13T10:04:47.905 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_from_name", 2023-09-13T10:04:47.905 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.905 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.905 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.905 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "Ceph", 2023-09-13T10:04:47.906 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.906 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.906 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.906 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Email From: name", 2023-09-13T10:04:47.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.907 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.907 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.907 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.907 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_host": { 2023-09-13T10:04:47.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_host", 2023-09-13T10:04:47.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.908 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.908 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.909 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.909 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP server", 2023-09-13T10:04:47.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.909 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.909 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.910 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_password": { 2023-09-13T10:04:47.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_password", 2023-09-13T10:04:47.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.910 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.910 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.911 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.911 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.911 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.911 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.911 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Password to authenticate with", 2023-09-13T10:04:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_port": { 2023-09-13T10:04:47.912 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_port", 2023-09-13T10:04:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "465", 2023-09-13T10:04:47.913 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP port", 2023-09-13T10:04:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.914 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.915 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.915 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_sender": { 2023-09-13T10:04:47.915 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_sender", 2023-09-13T10:04:47.915 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.915 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.916 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.916 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.916 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SMTP envelope sender", 2023-09-13T10:04:47.917 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.917 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.917 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_ssl": { 2023-09-13T10:04:47.918 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_ssl", 2023-09-13T10:04:47.918 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.918 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use SSL to connect to SMTP server", 2023-09-13T10:04:47.919 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.919 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.920 INFO:teuthology.orchestra.run.smithi006.stdout: "smtp_user": { 2023-09-13T10:04:47.920 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "smtp_user", 2023-09-13T10:04:47.920 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.920 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.921 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.921 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.921 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.921 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.921 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.922 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "User to authenticate as", 2023-09-13T10:04:47.922 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.922 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.922 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.923 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.923 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "balancer", 2023-09-13T10:04:47.923 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.923 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.924 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.924 INFO:teuthology.orchestra.run.smithi006.stdout: "active": { 2023-09-13T10:04:47.924 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "active", 2023-09-13T10:04:47.924 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.924 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.924 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.925 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:47.925 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.925 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.926 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.926 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically balance PGs across cluster", 2023-09-13T10:04:47.926 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.926 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.927 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_time": { 2023-09-13T10:04:47.927 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_time", 2023-09-13T10:04:47.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.927 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0000", 2023-09-13T10:04:47.928 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.928 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.928 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.929 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "beginning time of day to automatically balance", 2023-09-13T10:04:47.929 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-13T10:04:47.929 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.929 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.930 INFO:teuthology.orchestra.run.smithi006.stdout: "begin_weekday": { 2023-09-13T10:04:47.930 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "begin_weekday", 2023-09-13T10:04:47.930 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:47.930 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.931 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.931 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:47.931 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-09-13T10:04:47.931 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-09-13T10:04:47.933 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.933 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-09-13T10:04:47.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-13T10:04:47.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.934 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.934 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_max_iterations": { 2023-09-13T10:04:47.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_max_iterations", 2023-09-13T10:04:47.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:47.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.935 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.935 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "25", 2023-09-13T10:04:47.935 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:47.935 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "250", 2023-09-13T10:04:47.935 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.936 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-09-13T10:04:47.936 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.936 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.936 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_metrics": { 2023-09-13T10:04:47.937 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_metrics", 2023-09-13T10:04:47.937 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.937 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "pgs,objects,bytes", 2023-09-13T10:04:47.938 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.938 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.938 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.938 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-09-13T10:04:47.939 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-09-13T10:04:47.939 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.939 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.940 INFO:teuthology.orchestra.run.smithi006.stdout: "crush_compat_step": { 2023-09-13T10:04:47.940 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crush_compat_step", 2023-09-13T10:04:47.940 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.940 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.941 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.941 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.5", 2023-09-13T10:04:47.941 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0.001", 2023-09-13T10:04:47.941 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "0.999", 2023-09-13T10:04:47.942 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.942 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "aggressiveness of optimization", 2023-09-13T10:04:47.942 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-09-13T10:04:47.942 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.943 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.943 INFO:teuthology.orchestra.run.smithi006.stdout: "end_time": { 2023-09-13T10:04:47.943 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_time", 2023-09-13T10:04:47.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.944 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.944 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2359", 2023-09-13T10:04:47.944 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.944 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ending time of day to automatically balance", 2023-09-13T10:04:47.945 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-09-13T10:04:47.945 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.945 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.946 INFO:teuthology.orchestra.run.smithi006.stdout: "end_weekday": { 2023-09-13T10:04:47.946 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "end_weekday", 2023-09-13T10:04:47.946 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:47.946 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.946 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.947 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:47.947 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "0", 2023-09-13T10:04:47.947 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "6", 2023-09-13T10:04:47.947 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.947 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-09-13T10:04:47.948 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-09-13T10:04:47.948 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.948 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.948 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.948 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:47.949 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:47.949 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.949 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.949 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.949 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.949 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.950 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.950 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.950 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.950 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.950 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.951 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.951 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.951 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.951 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.951 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.951 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.952 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.952 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.952 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:47.952 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:47.953 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.953 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.953 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.954 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.954 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.954 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.954 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.954 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.955 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.955 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.955 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:47.955 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:47.955 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.955 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.956 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.956 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:47.956 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.956 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.956 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.957 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:47.957 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:47.957 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:47.957 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:47.957 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:47.958 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:47.958 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.958 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.958 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.958 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.958 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.959 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:47.959 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:47.959 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.959 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.960 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.960 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.960 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.960 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.960 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:47.961 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.961 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.961 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.961 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.961 INFO:teuthology.orchestra.run.smithi006.stdout: "min_score": { 2023-09-13T10:04:47.962 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_score", 2023-09-13T10:04:47.962 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.962 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.962 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.962 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:47.963 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.963 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.963 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.963 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-09-13T10:04:47.963 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.964 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.964 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.964 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-09-13T10:04:47.964 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-09-13T10:04:47.965 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.965 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.965 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.965 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "upmap", 2023-09-13T10:04:47.965 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.966 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.966 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:47.966 INFO:teuthology.orchestra.run.smithi006.stdout: "crush-compat", 2023-09-13T10:04:47.966 INFO:teuthology.orchestra.run.smithi006.stdout: "none", 2023-09-13T10:04:47.967 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap" 2023-09-13T10:04:47.967 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:47.967 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Balancer mode", 2023-09-13T10:04:47.967 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.968 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.968 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.968 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.968 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_ids": { 2023-09-13T10:04:47.968 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_ids", 2023-09-13T10:04:47.969 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:47.969 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.969 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.969 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:47.970 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.970 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.970 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.970 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-09-13T10:04:47.971 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.971 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.971 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.971 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:47.972 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:47.972 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.972 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.973 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.973 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:47.973 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.973 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.973 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.974 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-09-13T10:04:47.974 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.974 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.974 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.975 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.975 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_deviation": { 2023-09-13T10:04:47.975 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_deviation", 2023-09-13T10:04:47.976 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.976 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.976 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.976 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:47.977 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:47.977 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.977 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.977 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "deviation below which no optimization is attempted", 2023-09-13T10:04:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-09-13T10:04:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.978 INFO:teuthology.orchestra.run.smithi006.stdout: "upmap_max_optimizations": { 2023-09-13T10:04:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "upmap_max_optimizations", 2023-09-13T10:04:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.979 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-09-13T10:04:47.980 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:47.981 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cephadm", 2023-09-13T10:04:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:47.982 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_down_multiplier": { 2023-09-13T10:04:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_down_multiplier", 2023-09-13T10:04:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.983 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-09-13T10:04:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.984 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-09-13T10:04:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.985 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_refresh_rate": { 2023-09-13T10:04:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_refresh_rate", 2023-09-13T10:04:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.986 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "20", 2023-09-13T10:04:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-09-13T10:04:47.987 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: "agent_starting_port": { 2023-09-13T10:04:47.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "agent_starting_port", 2023-09-13T10:04:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4721", 2023-09-13T10:04:47.989 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-09-13T10:04:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.990 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.991 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.991 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.991 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_ptrace": { 2023-09-13T10:04:47.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_ptrace", 2023-09-13T10:04:47.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:47.992 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.992 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.992 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:47.992 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.993 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-09-13T10:04:47.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-09-13T10:04:47.993 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.993 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.994 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_interval": { 2023-09-13T10:04:47.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_interval", 2023-09-13T10:04:47.994 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:47.994 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.994 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:47.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.995 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.995 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to autotune daemon memory", 2023-09-13T10:04:47.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.996 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.996 INFO:teuthology.orchestra.run.smithi006.stdout: "autotune_memory_target_ratio": { 2023-09-13T10:04:47.996 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "autotune_memory_target_ratio", 2023-09-13T10:04:47.997 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:47.997 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:47.997 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:47.997 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0.7", 2023-09-13T10:04:47.997 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:47.998 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:47.998 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:47.998 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-09-13T10:04:47.998 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:47.999 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:47.999 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:47.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:47.999 INFO:teuthology.orchestra.run.smithi006.stdout: "cgroups_split": { 2023-09-13T10:04:47.999 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cgroups_split", 2023-09-13T10:04:48.000 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.000 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.000 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.000 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.000 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.001 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.001 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.001 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-09-13T10:04:48.001 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.002 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.002 INFO:teuthology.orchestra.run.smithi006.stdout: "config_checks_enabled": { 2023-09-13T10:04:48.002 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_checks_enabled", 2023-09-13T10:04:48.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.003 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.003 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.003 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.004 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.004 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-09-13T10:04:48.004 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.005 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.005 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.005 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.005 INFO:teuthology.orchestra.run.smithi006.stdout: "config_dashboard": { 2023-09-13T10:04:48.005 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_dashboard", 2023-09-13T10:04:48.006 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.006 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.006 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.006 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.007 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.007 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.007 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.007 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-09-13T10:04:48.007 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_alertmanager": { 2023-09-13T10:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_alertmanager", 2023-09-13T10:04:48.008 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.009 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.009 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.009 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-09-13T10:04:48.009 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.009 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.010 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.010 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:48.010 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.010 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.010 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.011 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_base": { 2023-09-13T10:04:48.011 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_base", 2023-09-13T10:04:48.011 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.011 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.011 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.012 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph", 2023-09-13T10:04:48.012 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.012 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.013 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.013 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Container image name, without the tag", 2023-09-13T10:04:48.013 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.014 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.014 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.014 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_elasticsearch": { 2023-09-13T10:04:48.014 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_elasticsearch", 2023-09-13T10:04:48.015 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.015 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.015 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.015 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-09-13T10:04:48.016 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.016 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.016 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.016 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "elasticsearch container image", 2023-09-13T10:04:48.016 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.017 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.017 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.017 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.017 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_grafana": { 2023-09-13T10:04:48.017 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_grafana", 2023-09-13T10:04:48.018 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.018 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-09-13T10:04:48.018 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.018 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.019 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:48.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.019 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.020 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.020 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_haproxy": { 2023-09-13T10:04:48.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_haproxy", 2023-09-13T10:04:48.020 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.020 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.020 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.021 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-09-13T10:04:48.021 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.021 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.021 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "HAproxy container image", 2023-09-13T10:04:48.021 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.022 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.022 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_agent": { 2023-09-13T10:04:48.022 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_agent", 2023-09-13T10:04:48.023 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.023 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.023 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-09-13T10:04:48.023 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.024 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.024 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger agent container image", 2023-09-13T10:04:48.024 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.025 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.025 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_collector": { 2023-09-13T10:04:48.025 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_collector", 2023-09-13T10:04:48.025 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.025 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.026 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.026 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-09-13T10:04:48.026 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.026 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.026 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.026 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger collector container image", 2023-09-13T10:04:48.027 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.027 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.027 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_jaeger_query": { 2023-09-13T10:04:48.028 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_jaeger_query", 2023-09-13T10:04:48.028 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.028 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.028 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-09-13T10:04:48.028 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.029 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.029 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.029 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Jaeger query container image", 2023-09-13T10:04:48.029 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.030 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.030 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.030 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_keepalived": { 2023-09-13T10:04:48.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_keepalived", 2023-09-13T10:04:48.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.030 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.031 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.031 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-09-13T10:04:48.031 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.031 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.032 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Keepalived container image", 2023-09-13T10:04:48.032 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.032 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.033 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.033 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_loki": { 2023-09-13T10:04:48.033 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_loki", 2023-09-13T10:04:48.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.034 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-09-13T10:04:48.034 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.034 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Loki container image", 2023-09-13T10:04:48.035 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.035 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.035 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.035 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_node_exporter": { 2023-09-13T10:04:48.036 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_node_exporter", 2023-09-13T10:04:48.036 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.036 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.036 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.036 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-09-13T10:04:48.037 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.037 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.037 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.037 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:48.037 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.038 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.038 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.038 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.038 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_nvmeof": { 2023-09-13T10:04:48.039 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_nvmeof", 2023-09-13T10:04:48.039 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.039 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.039 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.039 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/ceph/nvmeof:0.0.3", 2023-09-13T10:04:48.040 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.040 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.040 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.040 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Nvme-of container image", 2023-09-13T10:04:48.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.041 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.041 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.041 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_prometheus": { 2023-09-13T10:04:48.042 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_prometheus", 2023-09-13T10:04:48.042 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.042 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.043 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.043 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-09-13T10:04:48.043 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.043 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.043 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.044 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Prometheus container image", 2023-09-13T10:04:48.044 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.044 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.045 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.045 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_promtail": { 2023-09-13T10:04:48.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_promtail", 2023-09-13T10:04:48.046 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.046 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.046 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.047 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-09-13T10:04:48.047 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.047 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.048 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.048 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Promtail container image", 2023-09-13T10:04:48.048 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.049 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.049 INFO:teuthology.orchestra.run.smithi006.stdout: "container_image_snmp_gateway": { 2023-09-13T10:04:48.050 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_image_snmp_gateway", 2023-09-13T10:04:48.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.051 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-09-13T10:04:48.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.051 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.051 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.052 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "SNMP Gateway container image", 2023-09-13T10:04:48.052 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.052 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.052 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.052 INFO:teuthology.orchestra.run.smithi006.stdout: "container_init": { 2023-09-13T10:04:48.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "container_init", 2023-09-13T10:04:48.053 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.053 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.053 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.053 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.053 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.054 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.054 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.054 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Run podman/docker with `--init`", 2023-09-13T10:04:48.054 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.054 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.055 INFO:teuthology.orchestra.run.smithi006.stdout: "daemon_cache_timeout": { 2023-09-13T10:04:48.055 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "daemon_cache_timeout", 2023-09-13T10:04:48.055 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.056 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:48.056 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.056 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.056 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.057 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-09-13T10:04:48.057 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.057 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.057 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.058 INFO:teuthology.orchestra.run.smithi006.stdout: "default_cephadm_command_timeout": { 2023-09-13T10:04:48.058 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_cephadm_command_timeout", 2023-09-13T10:04:48.058 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.058 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.058 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.058 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "900", 2023-09-13T10:04:48.059 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.059 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.059 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.059 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-09-13T10:04:48.059 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.060 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.060 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_registry": { 2023-09-13T10:04:48.060 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "default_registry", 2023-09-13T10:04:48.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.061 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.061 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.061 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "docker.io", 2023-09-13T10:04:48.061 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.062 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-09-13T10:04:48.062 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.062 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.063 INFO:teuthology.orchestra.run.smithi006.stdout: "device_cache_timeout": { 2023-09-13T10:04:48.063 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_cache_timeout", 2023-09-13T10:04:48.063 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.063 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.064 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1800", 2023-09-13T10:04:48.064 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.064 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.064 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache device inventory", 2023-09-13T10:04:48.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.065 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.065 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.065 INFO:teuthology.orchestra.run.smithi006.stdout: "device_enhanced_scan": { 2023-09-13T10:04:48.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_enhanced_scan", 2023-09-13T10:04:48.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.066 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.066 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.066 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.067 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.067 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use libstoragemgmt during device scans", 2023-09-13T10:04:48.067 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.067 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.068 INFO:teuthology.orchestra.run.smithi006.stdout: "facts_cache_timeout": { 2023-09-13T10:04:48.068 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "facts_cache_timeout", 2023-09-13T10:04:48.068 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.069 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:48.069 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.069 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.069 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.069 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "seconds to cache host facts data", 2023-09-13T10:04:48.070 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.070 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.070 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.071 INFO:teuthology.orchestra.run.smithi006.stdout: "host_check_interval": { 2023-09-13T10:04:48.071 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "host_check_interval", 2023-09-13T10:04:48.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.071 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.071 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.072 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:48.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.072 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.072 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to perform a host check", 2023-09-13T10:04:48.073 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.073 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.073 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.073 INFO:teuthology.orchestra.run.smithi006.stdout: "inventory_list_all": { 2023-09-13T10:04:48.074 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "inventory_list_all", 2023-09-13T10:04:48.074 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.074 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.075 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.075 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.075 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.075 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-09-13T10:04:48.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.076 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.077 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.078 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.079 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.079 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.079 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.079 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.080 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.080 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.080 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.080 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.080 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.080 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.081 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.081 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.081 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.081 INFO:teuthology.orchestra.run.smithi006.stdout: "log_refresh_metadata": { 2023-09-13T10:04:48.081 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_refresh_metadata", 2023-09-13T10:04:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-09-13T10:04:48.083 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.084 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.085 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.086 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-09-13T10:04:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.087 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.088 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.089 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.090 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.091 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.092 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.093 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.093 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.093 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.093 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.094 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf": { 2023-09-13T10:04:48.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-09-13T10:04:48.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.094 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-09-13T10:04:48.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.096 INFO:teuthology.orchestra.run.smithi006.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-09-13T10:04:48.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-09-13T10:04:48.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.097 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "*", 2023-09-13T10:04:48.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-09-13T10:04:48.098 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.098 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.099 INFO:teuthology.orchestra.run.smithi006.stdout: "max_count_per_host": { 2023-09-13T10:04:48.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_count_per_host", 2023-09-13T10:04:48.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:48.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of daemons per service per host", 2023-09-13T10:04:48.101 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.101 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.101 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.102 INFO:teuthology.orchestra.run.smithi006.stdout: "max_osd_draining_count": { 2023-09-13T10:04:48.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_osd_draining_count", 2023-09-13T10:04:48.102 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.102 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.102 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.103 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:48.103 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.103 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.103 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.103 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-09-13T10:04:48.104 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.104 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.104 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.104 INFO:teuthology.orchestra.run.smithi006.stdout: "migration_current": { 2023-09-13T10:04:48.105 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "migration_current", 2023-09-13T10:04:48.105 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.105 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.105 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.105 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.106 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.106 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.106 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.106 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "internal - do not modify", 2023-09-13T10:04:48.106 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.107 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.107 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.108 INFO:teuthology.orchestra.run.smithi006.stdout: "mode": { 2023-09-13T10:04:48.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mode", 2023-09-13T10:04:48.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.108 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.108 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "root", 2023-09-13T10:04:48.109 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.109 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.109 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm-package", 2023-09-13T10:04:48.110 INFO:teuthology.orchestra.run.smithi006.stdout: "root" 2023-09-13T10:04:48.110 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.110 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "mode for remote execution of cephadm", 2023-09-13T10:04:48.110 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.110 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.111 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.111 INFO:teuthology.orchestra.run.smithi006.stdout: "prometheus_alerts_path": { 2023-09-13T10:04:48.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus_alerts_path", 2023-09-13T10:04:48.112 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.112 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.112 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.112 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-09-13T10:04:48.112 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.113 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.113 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.113 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-09-13T10:04:48.113 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.114 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_insecure": { 2023-09-13T10:04:48.115 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_insecure", 2023-09-13T10:04:48.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.115 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.116 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.116 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.117 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-09-13T10:04:48.117 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.117 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.117 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.118 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.118 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_password": { 2023-09-13T10:04:48.118 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_password", 2023-09-13T10:04:48.118 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.119 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.119 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.119 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.119 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.120 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.120 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-09-13T10:04:48.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.121 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.121 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.121 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_url": { 2023-09-13T10:04:48.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_url", 2023-09-13T10:04:48.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.122 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.122 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.122 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.122 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.123 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-09-13T10:04:48.123 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.124 INFO:teuthology.orchestra.run.smithi006.stdout: "registry_username": { 2023-09-13T10:04:48.124 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "registry_username", 2023-09-13T10:04:48.124 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.125 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.125 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-09-13T10:04:48.126 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.126 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.126 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.126 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.126 INFO:teuthology.orchestra.run.smithi006.stdout: "secure_monitoring_stack": { 2023-09-13T10:04:48.127 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "secure_monitoring_stack", 2023-09-13T10:04:48.127 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.127 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.127 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.128 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.128 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.128 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.128 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-09-13T10:04:48.128 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.129 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.129 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.129 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.129 INFO:teuthology.orchestra.run.smithi006.stdout: "service_discovery_port": { 2023-09-13T10:04:48.129 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "service_discovery_port", 2023-09-13T10:04:48.129 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.130 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.130 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.130 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8765", 2023-09-13T10:04:48.130 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.130 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.131 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.131 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "cephadm service discovery port", 2023-09-13T10:04:48.131 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.131 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.131 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.132 INFO:teuthology.orchestra.run.smithi006.stdout: "ssh_config_file": { 2023-09-13T10:04:48.132 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssh_config_file", 2023-09-13T10:04:48.132 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.132 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.133 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.133 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.133 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.133 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.133 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.133 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-09-13T10:04:48.134 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.134 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.134 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.134 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.134 INFO:teuthology.orchestra.run.smithi006.stdout: "use_agent": { 2023-09-13T10:04:48.135 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_agent", 2023-09-13T10:04:48.135 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.135 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.135 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.135 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.136 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.136 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.136 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.136 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-09-13T10:04:48.136 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.136 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.137 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.137 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.137 INFO:teuthology.orchestra.run.smithi006.stdout: "use_repo_digest": { 2023-09-13T10:04:48.137 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "use_repo_digest", 2023-09-13T10:04:48.137 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.138 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.138 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.138 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.138 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.138 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.139 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.139 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-09-13T10:04:48.139 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.139 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.139 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.139 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.140 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_failed_host_check": { 2023-09-13T10:04:48.140 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_failed_host_check", 2023-09-13T10:04:48.140 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.140 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.141 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.141 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.141 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.141 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.141 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.142 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if the host check fails", 2023-09-13T10:04:48.142 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.142 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.142 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.143 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_daemons": { 2023-09-13T10:04:48.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_daemons", 2023-09-13T10:04:48.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.143 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.144 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.144 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.144 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.144 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.144 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.145 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-09-13T10:04:48.145 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.145 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.145 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.146 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_on_stray_hosts": { 2023-09-13T10:04:48.146 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_on_stray_hosts", 2023-09-13T10:04:48.146 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.146 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.147 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.147 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.147 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.147 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.147 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.148 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-09-13T10:04:48.148 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.148 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.148 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.149 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.149 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.149 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.149 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.149 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crash", 2023-09-13T10:04:48.150 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.150 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.150 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.150 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.151 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.151 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.151 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.151 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.152 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.152 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.152 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.152 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.153 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.153 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.153 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.153 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.153 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.154 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.154 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.154 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.154 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.154 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.155 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.155 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.155 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.155 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.155 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.155 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.156 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.156 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.156 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.156 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.156 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.157 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.157 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.157 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.157 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.157 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.157 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.158 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.158 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.158 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.158 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.158 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.159 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.159 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.159 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.159 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.160 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.160 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.160 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.160 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.160 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.161 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.161 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.161 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.161 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.161 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.161 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.162 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.162 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.162 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.162 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.162 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.163 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.163 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.163 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.163 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.163 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.163 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.164 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.164 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.164 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.164 INFO:teuthology.orchestra.run.smithi006.stdout: "retain_interval": { 2023-09-13T10:04:48.164 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retain_interval", 2023-09-13T10:04:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "31536000", 2023-09-13T10:04:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.165 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.166 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.166 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain crashes before pruning them", 2023-09-13T10:04:48.166 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.166 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.166 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.167 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.167 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_recent_interval": { 2023-09-13T10:04:48.167 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_recent_interval", 2023-09-13T10:04:48.167 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.168 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.168 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.168 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1209600", 2023-09-13T10:04:48.168 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.168 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.168 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.169 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "time interval in which to warn about recent crashes", 2023-09-13T10:04:48.169 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.169 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.169 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.169 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.170 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.170 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.170 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.170 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dashboard", 2023-09-13T10:04:48.170 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.170 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.171 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.171 INFO:teuthology.orchestra.run.smithi006.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-09-13T10:04:48.171 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-09-13T10:04:48.171 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.171 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.172 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.172 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:48.172 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.172 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.172 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.172 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.173 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.173 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.173 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.173 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_HOST": { 2023-09-13T10:04:48.174 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_HOST", 2023-09-13T10:04:48.174 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.174 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.174 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.174 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.175 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.175 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.175 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.175 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.175 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.176 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.176 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.176 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.176 INFO:teuthology.orchestra.run.smithi006.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-09-13T10:04:48.176 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-09-13T10:04:48.176 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.177 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.177 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.177 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.177 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.177 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.178 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.178 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.178 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.178 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.178 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.178 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.179 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_ENABLED": { 2023-09-13T10:04:48.179 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_ENABLED", 2023-09-13T10:04:48.179 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.179 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.179 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.180 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.180 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.180 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.180 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.181 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.181 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.181 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.181 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.182 INFO:teuthology.orchestra.run.smithi006.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-09-13T10:04:48.182 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-09-13T10:04:48.182 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.182 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.183 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.183 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.183 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.183 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.183 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.184 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.184 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.184 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.184 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.184 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.185 INFO:teuthology.orchestra.run.smithi006.stdout: "ENABLE_BROWSABLE_API": { 2023-09-13T10:04:48.185 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ENABLE_BROWSABLE_API", 2023-09-13T10:04:48.185 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.185 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.186 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.186 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.186 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.186 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.186 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.187 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.187 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.187 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.187 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.188 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.188 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-09-13T10:04:48.188 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-09-13T10:04:48.188 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.189 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.189 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.189 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.189 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.189 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.190 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.190 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.190 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.190 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.191 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.191 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.191 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-09-13T10:04:48.191 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-09-13T10:04:48.192 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.192 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.192 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.192 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.193 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.193 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.193 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.193 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.194 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.194 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.194 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.194 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.194 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-09-13T10:04:48.194 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-09-13T10:04:48.195 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.195 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.195 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.195 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.195 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.196 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.196 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.196 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.196 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.196 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.196 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.197 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.197 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-09-13T10:04:48.197 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-09-13T10:04:48.197 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.197 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.198 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.198 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.198 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.198 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.198 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.198 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.199 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.199 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.199 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.199 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.199 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_NFS": { 2023-09-13T10:04:48.200 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-09-13T10:04:48.200 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.200 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.200 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.200 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.200 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.201 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.201 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.201 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.201 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.202 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.202 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.202 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RBD": { 2023-09-13T10:04:48.202 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-09-13T10:04:48.202 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.202 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.203 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.203 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.203 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.203 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.203 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.203 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.204 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.204 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.204 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.204 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.204 INFO:teuthology.orchestra.run.smithi006.stdout: "FEATURE_TOGGLE_RGW": { 2023-09-13T10:04:48.205 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-09-13T10:04:48.205 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.205 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.205 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.205 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.205 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.206 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.206 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.206 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.206 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.206 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.207 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.207 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.207 INFO:teuthology.orchestra.run.smithi006.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-09-13T10:04:48.207 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-09-13T10:04:48.207 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.208 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.209 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.209 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.209 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.209 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.209 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_PASSWORD": { 2023-09-13T10:04:48.210 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_PASSWORD", 2023-09-13T10:04:48.210 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.210 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.210 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.210 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:48.211 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.211 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.211 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.211 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.211 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.212 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.212 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.212 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.212 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-09-13T10:04:48.212 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-09-13T10:04:48.212 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.213 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.213 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.213 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.213 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.214 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.214 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.214 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.214 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.214 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.215 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.215 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.215 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_URL": { 2023-09-13T10:04:48.215 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_URL", 2023-09-13T10:04:48.215 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.216 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.216 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.216 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.216 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.217 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.217 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.217 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.217 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.217 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.217 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.218 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.218 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_API_USERNAME": { 2023-09-13T10:04:48.218 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_API_USERNAME", 2023-09-13T10:04:48.218 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.220 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.220 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.220 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.220 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.221 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.221 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.221 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-09-13T10:04:48.221 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-09-13T10:04:48.222 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.222 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.222 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.222 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.222 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.223 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.223 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.223 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.223 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.224 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.224 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.224 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.225 INFO:teuthology.orchestra.run.smithi006.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-09-13T10:04:48.225 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-09-13T10:04:48.225 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.225 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.226 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.226 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.226 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.226 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.227 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.227 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.227 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.227 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.227 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.228 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.228 INFO:teuthology.orchestra.run.smithi006.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-09-13T10:04:48.228 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-09-13T10:04:48.228 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.228 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.228 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.229 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.229 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.229 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.229 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.229 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.230 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.230 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.230 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.230 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.230 INFO:teuthology.orchestra.run.smithi006.stdout: "ISSUE_TRACKER_API_KEY": { 2023-09-13T10:04:48.231 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-09-13T10:04:48.231 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.231 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.231 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.231 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.231 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.232 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.232 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.232 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.232 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.232 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.232 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.233 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.233 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_HOST": { 2023-09-13T10:04:48.233 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_HOST", 2023-09-13T10:04:48.233 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.233 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.234 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.234 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.234 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.234 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.234 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.234 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.235 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.235 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.235 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.235 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.235 INFO:teuthology.orchestra.run.smithi006.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-09-13T10:04:48.236 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-09-13T10:04:48.236 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.236 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.236 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.236 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.236 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.237 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.237 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.237 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.237 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.237 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.238 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.238 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.238 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-09-13T10:04:48.238 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-09-13T10:04:48.238 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.238 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.239 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.239 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.239 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.239 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.239 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.240 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.240 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.240 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.240 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.240 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.240 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-09-13T10:04:48.241 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-09-13T10:04:48.241 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.241 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.241 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.241 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.242 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.242 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.242 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.242 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.242 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.242 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.243 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.243 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.243 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-09-13T10:04:48.243 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-09-13T10:04:48.243 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.244 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.244 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.244 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.244 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.244 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.244 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.245 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.245 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.245 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.245 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.245 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.246 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-09-13T10:04:48.246 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-09-13T10:04:48.246 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.246 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.246 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.246 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.247 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.247 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.247 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.247 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.247 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.247 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.248 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.248 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.248 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-09-13T10:04:48.248 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-09-13T10:04:48.248 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.249 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.249 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.249 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.249 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.249 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.249 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.250 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.250 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.250 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.251 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.251 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-09-13T10:04:48.251 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-09-13T10:04:48.251 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.251 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.252 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.252 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.252 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.252 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.253 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.253 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.253 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.253 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.253 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.254 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.254 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-09-13T10:04:48.254 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-09-13T10:04:48.254 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.254 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.255 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.255 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.255 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.255 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.256 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.256 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.256 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.256 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.256 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.257 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.257 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_ENABLED": { 2023-09-13T10:04:48.257 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_ENABLED", 2023-09-13T10:04:48.257 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.258 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.258 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.258 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.258 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.259 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.259 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.259 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.259 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.259 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.260 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.260 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.260 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-09-13T10:04:48.260 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-09-13T10:04:48.261 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.261 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.261 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.261 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-09-13T10:04:48.262 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.262 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.262 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.262 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.263 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.263 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.263 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.264 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.264 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-09-13T10:04:48.264 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-09-13T10:04:48.264 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.264 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.265 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.265 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:48.265 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.265 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.265 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.265 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.266 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.266 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.266 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.266 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.266 INFO:teuthology.orchestra.run.smithi006.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-09-13T10:04:48.267 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-09-13T10:04:48.267 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.267 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.267 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.267 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8", 2023-09-13T10:04:48.267 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.268 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.268 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.268 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.268 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.268 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.268 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.269 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.269 INFO:teuthology.orchestra.run.smithi006.stdout: "REST_REQUESTS_TIMEOUT": { 2023-09-13T10:04:48.269 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-09-13T10:04:48.269 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.269 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.270 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.270 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "45", 2023-09-13T10:04:48.270 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.270 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.270 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.270 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.271 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.271 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.271 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.271 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.271 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ACCESS_KEY": { 2023-09-13T10:04:48.272 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ACCESS_KEY", 2023-09-13T10:04:48.272 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.272 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.272 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.272 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.272 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.273 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.273 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.273 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.273 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.273 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.274 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.274 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.274 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-09-13T10:04:48.274 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-09-13T10:04:48.274 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.275 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.275 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.275 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "admin", 2023-09-13T10:04:48.275 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.275 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.275 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.276 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.276 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.276 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.276 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.276 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.277 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SECRET_KEY": { 2023-09-13T10:04:48.277 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SECRET_KEY", 2023-09-13T10:04:48.277 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.277 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.277 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.277 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.278 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.278 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.278 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.278 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.278 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.279 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.279 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.279 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.279 INFO:teuthology.orchestra.run.smithi006.stdout: "RGW_API_SSL_VERIFY": { 2023-09-13T10:04:48.279 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "RGW_API_SSL_VERIFY", 2023-09-13T10:04:48.279 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.280 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.280 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.280 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.280 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.280 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.281 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.281 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.281 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.281 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.281 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.282 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-09-13T10:04:48.282 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-09-13T10:04:48.282 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.282 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.282 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.283 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:48.283 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.283 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.283 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.284 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.284 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.284 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.284 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.285 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.285 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-09-13T10:04:48.285 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-09-13T10:04:48.285 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.285 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.286 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.286 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:48.287 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.287 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.287 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.287 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.287 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.288 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.288 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.288 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.288 INFO:teuthology.orchestra.run.smithi006.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-09-13T10:04:48.289 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-09-13T10:04:48.289 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.289 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.289 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.290 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:48.290 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.290 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.290 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.291 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.291 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.291 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.292 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.292 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.292 INFO:teuthology.orchestra.run.smithi006.stdout: "cross_origin_url": { 2023-09-13T10:04:48.293 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cross_origin_url", 2023-09-13T10:04:48.293 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.293 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.294 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.294 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.295 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.295 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.296 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.296 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.297 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "crt_file": { 2023-09-13T10:04:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "crt_file", 2023-09-13T10:04:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.298 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.299 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.300 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.301 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.301 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.301 INFO:teuthology.orchestra.run.smithi006.stdout: "debug": { 2023-09-13T10:04:48.301 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "debug", 2023-09-13T10:04:48.302 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.302 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.302 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.302 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.302 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.303 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.303 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.303 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Enable/disable debug options", 2023-09-13T10:04:48.303 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.304 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.304 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.304 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.304 INFO:teuthology.orchestra.run.smithi006.stdout: "jwt_token_ttl": { 2023-09-13T10:04:48.305 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "jwt_token_ttl", 2023-09-13T10:04:48.305 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.305 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.305 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.306 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "28800", 2023-09-13T10:04:48.306 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.306 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.306 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.306 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.307 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.307 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.307 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.307 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.307 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-09-13T10:04:48.308 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-09-13T10:04:48.308 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.308 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.308 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.309 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.309 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.309 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.309 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.309 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.309 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.310 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.310 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.310 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.311 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.311 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.311 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.312 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.312 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.312 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.312 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.312 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.312 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.313 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.313 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.313 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.313 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.313 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.314 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.314 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.314 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.314 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.315 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.315 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.315 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.315 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.315 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.316 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.316 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.316 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.316 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.317 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.317 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.317 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.317 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.318 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.318 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.319 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.319 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.319 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.319 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.320 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.320 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.320 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.321 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.321 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.321 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.321 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.322 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.322 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.322 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.323 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.323 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.323 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.323 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.324 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.324 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.324 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.324 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.325 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.325 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.325 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.325 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.325 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.326 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.326 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.326 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.327 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.327 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.327 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.328 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.328 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.328 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.328 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.329 INFO:teuthology.orchestra.run.smithi006.stdout: "motd": { 2023-09-13T10:04:48.329 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "motd", 2023-09-13T10:04:48.329 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.330 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.330 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.330 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.331 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "The message of the day", 2023-09-13T10:04:48.332 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.332 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.332 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.333 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.333 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect_resolve_ip_addr": { 2023-09-13T10:04:48.333 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "redirect_resolve_ip_addr", 2023-09-13T10:04:48.334 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.334 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.334 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.334 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.335 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.335 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.336 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.336 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.336 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.336 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.337 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.337 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.337 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:48.338 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:48.338 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.338 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.338 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.338 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-09-13T10:04:48.339 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.339 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.339 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.339 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.339 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.340 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.340 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.340 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.341 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:48.341 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:48.341 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.342 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.342 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.342 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8080", 2023-09-13T10:04:48.342 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.343 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.343 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.343 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.343 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.343 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.343 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.344 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.344 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-09-13T10:04:48.344 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-09-13T10:04:48.344 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.345 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.345 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.345 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.345 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.345 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.346 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.346 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.346 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.346 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.346 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.346 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.347 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl_server_port": { 2023-09-13T10:04:48.347 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl_server_port", 2023-09-13T10:04:48.347 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.347 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.347 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.348 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8443", 2023-09-13T10:04:48.348 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.348 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.348 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.348 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.348 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.349 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.349 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.349 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-09-13T10:04:48.349 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-09-13T10:04:48.350 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.350 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.350 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.350 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "redirect", 2023-09-13T10:04:48.350 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.351 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.351 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.351 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.351 INFO:teuthology.orchestra.run.smithi006.stdout: "redirect" 2023-09-13T10:04:48.351 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.351 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.352 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.352 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.352 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.352 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.352 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-09-13T10:04:48.353 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-09-13T10:04:48.353 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.353 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.353 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.353 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-09-13T10:04:48.353 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-09-13T10:04:48.354 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-09-13T10:04:48.354 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.354 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.354 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.354 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.355 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.355 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.355 INFO:teuthology.orchestra.run.smithi006.stdout: "url_prefix": { 2023-09-13T10:04:48.355 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url_prefix", 2023-09-13T10:04:48.355 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.357 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.357 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.357 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.358 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.358 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.358 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.358 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.358 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.359 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.359 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.359 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.359 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.360 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.360 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-09-13T10:04:48.360 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.360 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.361 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.361 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_monitoring": { 2023-09-13T10:04:48.361 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_monitoring", 2023-09-13T10:04:48.361 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.361 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.361 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.362 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.362 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.362 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.362 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.363 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "monitor device health metrics", 2023-09-13T10:04:48.363 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.363 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.363 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.363 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.364 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.364 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.364 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.364 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.365 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.365 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.365 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.365 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.366 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.366 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.366 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.366 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.367 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.367 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.367 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.367 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.368 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.368 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.368 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.368 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.369 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.369 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.369 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.369 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.370 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.370 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.370 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.370 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.371 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.371 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.371 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.371 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.372 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.372 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.372 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.372 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.373 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.373 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.373 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.373 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.373 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.373 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.374 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.374 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.374 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.374 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.374 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.375 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.375 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.375 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.375 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.375 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.376 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.376 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.376 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.376 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.376 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.376 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.377 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.377 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.377 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.377 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.377 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.378 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.378 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.378 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.378 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mark_out_threshold": { 2023-09-13T10:04:48.379 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mark_out_threshold", 2023-09-13T10:04:48.379 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.379 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.379 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.379 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "2419200", 2023-09-13T10:04:48.380 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.380 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.380 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.380 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-09-13T10:04:48.380 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.381 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.381 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.381 INFO:teuthology.orchestra.run.smithi006.stdout: "pool_name": { 2023-09-13T10:04:48.381 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pool_name", 2023-09-13T10:04:48.381 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.382 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.382 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.382 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "device_health_metrics", 2023-09-13T10:04:48.382 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.382 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.383 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.383 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name of pool in which to store device health metrics", 2023-09-13T10:04:48.383 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.383 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.383 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.384 INFO:teuthology.orchestra.run.smithi006.stdout: "retention_period": { 2023-09-13T10:04:48.384 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "retention_period", 2023-09-13T10:04:48.384 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.384 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.384 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.385 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15552000", 2023-09-13T10:04:48.385 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.385 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.385 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.385 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long to retain device health metrics", 2023-09-13T10:04:48.385 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.386 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.386 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.386 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.386 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_frequency": { 2023-09-13T10:04:48.386 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_frequency", 2023-09-13T10:04:48.387 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.387 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.387 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.387 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-09-13T10:04:48.387 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.388 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.388 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.388 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to scrape device health metrics", 2023-09-13T10:04:48.388 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.388 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.388 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.389 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.389 INFO:teuthology.orchestra.run.smithi006.stdout: "self_heal": { 2023-09-13T10:04:48.389 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "self_heal", 2023-09-13T10:04:48.389 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.389 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.390 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.390 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.390 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.390 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.390 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.390 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-09-13T10:04:48.391 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.391 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.391 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.391 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.392 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:48.392 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:48.392 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.392 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.393 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.393 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:48.393 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.393 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.393 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.393 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how frequently to wake up and check device health", 2023-09-13T10:04:48.394 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.394 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.394 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.395 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.395 INFO:teuthology.orchestra.run.smithi006.stdout: "warn_threshold": { 2023-09-13T10:04:48.395 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "warn_threshold", 2023-09-13T10:04:48.395 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.395 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.395 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.396 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7257600", 2023-09-13T10:04:48.396 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.396 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.396 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.397 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-09-13T10:04:48.397 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.397 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.397 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.397 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "diskprediction_local", 2023-09-13T10:04:48.398 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.399 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.400 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.401 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.401 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.401 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.401 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.402 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.402 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.402 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.402 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.403 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.403 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.403 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.403 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.403 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.404 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.404 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.404 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.405 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.405 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.405 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.406 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.406 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.406 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.407 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.407 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.407 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.408 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.408 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.408 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.409 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.409 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.409 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.409 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.409 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.410 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.410 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.410 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.410 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.410 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.410 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.411 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.411 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.411 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.411 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.411 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.412 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.413 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.414 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: "predict_interval": { 2023-09-13T10:04:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predict_interval", 2023-09-13T10:04:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.415 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "86400", 2023-09-13T10:04:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.416 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: "predictor_model": { 2023-09-13T10:04:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "predictor_model", 2023-09-13T10:04:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "prophetstor", 2023-09-13T10:04:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.418 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.419 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.420 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "600", 2023-09-13T10:04:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.421 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.422 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.422 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.422 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.422 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.423 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.423 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "influx", 2023-09-13T10:04:48.423 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": false, 2023-09-13T10:04:48.423 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "influxdb python module not found", 2023-09-13T10:04:48.423 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.424 INFO:teuthology.orchestra.run.smithi006.stdout: "batch_size": { 2023-09-13T10:04:48.424 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "batch_size", 2023-09-13T10:04:48.424 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.424 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.425 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.425 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5000", 2023-09-13T10:04:48.425 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.425 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.426 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.426 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-09-13T10:04:48.426 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.427 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.427 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.427 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.427 INFO:teuthology.orchestra.run.smithi006.stdout: "database": { 2023-09-13T10:04:48.427 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "database", 2023-09-13T10:04:48.428 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.428 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.428 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.428 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "ceph", 2023-09-13T10:04:48.428 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.429 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.429 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.430 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-09-13T10:04:48.430 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.430 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.430 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.431 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.431 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": { 2023-09-13T10:04:48.431 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "hostname", 2023-09-13T10:04:48.432 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.432 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.433 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.433 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.433 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.434 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.434 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.434 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server hostname", 2023-09-13T10:04:48.435 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.435 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.435 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.435 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.435 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:48.436 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:48.436 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.437 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.437 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.437 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "30", 2023-09-13T10:04:48.438 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "5", 2023-09-13T10:04:48.438 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.438 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.439 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-09-13T10:04:48.439 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.439 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.440 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.440 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.441 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.441 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.442 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.442 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.443 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.443 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.443 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.443 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.443 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.443 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.444 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.444 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.444 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.444 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.445 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.445 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.445 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.445 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.445 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.446 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.446 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.446 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.447 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.447 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.447 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.447 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.447 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.448 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.449 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.450 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.450 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.450 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.450 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.451 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.451 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.451 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.451 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.451 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.452 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.452 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.452 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.453 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.453 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.453 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.453 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.453 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.453 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.454 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.454 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.454 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.454 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.455 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.455 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.455 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.455 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.456 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.456 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.456 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.456 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.456 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.457 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.457 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.457 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.457 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.457 INFO:teuthology.orchestra.run.smithi006.stdout: "password": { 2023-09-13T10:04:48.458 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "password", 2023-09-13T10:04:48.458 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.458 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.458 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.458 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.459 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.459 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.459 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.459 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "password of InfluxDB server user", 2023-09-13T10:04:48.460 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.460 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.460 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.460 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.461 INFO:teuthology.orchestra.run.smithi006.stdout: "port": { 2023-09-13T10:04:48.461 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "port", 2023-09-13T10:04:48.461 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.461 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.462 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.462 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "8086", 2023-09-13T10:04:48.462 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.462 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.462 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.463 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "InfluxDB server port", 2023-09-13T10:04:48.463 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.463 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.463 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.464 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.464 INFO:teuthology.orchestra.run.smithi006.stdout: "ssl": { 2023-09-13T10:04:48.464 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ssl", 2023-09-13T10:04:48.464 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.465 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.465 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.465 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "false", 2023-09-13T10:04:48.465 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.466 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.466 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.466 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-09-13T10:04:48.466 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.467 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.467 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.467 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.467 INFO:teuthology.orchestra.run.smithi006.stdout: "threads": { 2023-09-13T10:04:48.467 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threads", 2023-09-13T10:04:48.468 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.468 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.468 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.469 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:48.469 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:48.469 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "32", 2023-09-13T10:04:48.469 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.470 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-09-13T10:04:48.470 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.470 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.471 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.471 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.471 INFO:teuthology.orchestra.run.smithi006.stdout: "username": { 2023-09-13T10:04:48.472 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "username", 2023-09-13T10:04:48.472 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.472 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.472 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.473 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.473 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.473 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.473 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.473 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "username of InfluxDB server user", 2023-09-13T10:04:48.474 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.474 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.474 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.474 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.475 INFO:teuthology.orchestra.run.smithi006.stdout: "verify_ssl": { 2023-09-13T10:04:48.475 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "verify_ssl", 2023-09-13T10:04:48.475 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.476 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.476 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.477 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "true", 2023-09-13T10:04:48.477 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.477 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.478 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.478 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-09-13T10:04:48.478 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.479 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.479 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.479 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.480 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.480 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.480 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "insights", 2023-09-13T10:04:48.481 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.481 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.481 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.481 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.481 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.482 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.482 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.482 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.482 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.483 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.483 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.483 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.483 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.483 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.484 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.484 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.484 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.484 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.484 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.485 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.485 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.485 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.486 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.486 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.486 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.486 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.487 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.487 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.487 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.487 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.488 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.488 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.488 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.488 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.488 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.489 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.489 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.489 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.490 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.490 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.490 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.490 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.491 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.491 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.491 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.492 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.492 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.492 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.493 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.493 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.493 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.493 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.493 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.494 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.494 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.494 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.494 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.494 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.495 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.495 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.495 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.495 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.496 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.496 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.496 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.497 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.497 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.497 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.497 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.498 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "iostat", 2023-09-13T10:04:48.499 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.500 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.501 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.502 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.503 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.504 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.505 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.506 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.507 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.508 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.509 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.510 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.511 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.512 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.513 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.514 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.514 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.514 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.515 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.515 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.515 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.515 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.516 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.516 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.516 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.517 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.517 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.517 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.517 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.517 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.518 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.518 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.518 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.518 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.519 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.519 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.519 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.520 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.520 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.520 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.521 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "k8sevents", 2023-09-13T10:04:48.521 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.521 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.521 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.522 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_event_retention_days": { 2023-09-13T10:04:48.522 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "ceph_event_retention_days", 2023-09-13T10:04:48.522 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.522 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.523 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.523 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "7", 2023-09-13T10:04:48.523 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.524 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.524 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.524 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Days to hold ceph event information within local cache", 2023-09-13T10:04:48.524 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.525 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.525 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.525 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.525 INFO:teuthology.orchestra.run.smithi006.stdout: "config_check_secs": { 2023-09-13T10:04:48.526 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "config_check_secs", 2023-09-13T10:04:48.526 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.526 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.526 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.526 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:48.527 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "10", 2023-09-13T10:04:48.527 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.527 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.527 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-09-13T10:04:48.527 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.528 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.528 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.528 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.529 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.529 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.529 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.530 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.530 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.530 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.530 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.531 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.531 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.531 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.531 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.531 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.532 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.532 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.532 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.532 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.533 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.533 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.533 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.533 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.533 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.534 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.534 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.534 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.535 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.535 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.535 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.535 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.536 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.536 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.536 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.537 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.537 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.537 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.537 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.537 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.538 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.538 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.538 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.539 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.539 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.539 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.539 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.540 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.540 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.540 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.540 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.540 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.541 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.541 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.541 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.542 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.542 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.542 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.542 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.543 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.543 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.543 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.544 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.544 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.544 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.545 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.545 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.545 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.546 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.546 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.547 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.547 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.547 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.548 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.548 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.548 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "localpool", 2023-09-13T10:04:48.549 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.549 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.549 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.549 INFO:teuthology.orchestra.run.smithi006.stdout: "failure_domain": { 2023-09-13T10:04:48.550 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "failure_domain", 2023-09-13T10:04:48.550 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.550 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.550 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.551 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "host", 2023-09-13T10:04:48.551 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.551 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.551 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.552 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "failure domain for any created local pool", 2023-09-13T10:04:48.552 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-09-13T10:04:48.553 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.553 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.553 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.553 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.554 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.554 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.554 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.554 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.555 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.555 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.555 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.555 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.555 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.556 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.556 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.556 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.556 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.556 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.557 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.557 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.557 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.558 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.558 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.558 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.558 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.559 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.559 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.559 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.559 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.560 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.560 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.560 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.560 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.560 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.561 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.561 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.561 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.561 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.561 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.562 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.562 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.562 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.563 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.563 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.563 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.564 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.564 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.564 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.564 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.564 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.564 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.565 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.565 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.565 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.565 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.566 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.566 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.566 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.566 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.566 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.567 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.567 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.567 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.567 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.568 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.568 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.568 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.568 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.568 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.569 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.569 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.569 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.569 INFO:teuthology.orchestra.run.smithi006.stdout: "min_size": { 2023-09-13T10:04:48.570 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "min_size", 2023-09-13T10:04:48.570 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.570 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.570 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.570 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.571 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.571 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.571 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.571 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default min_size for any created local pool", 2023-09-13T10:04:48.571 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-09-13T10:04:48.572 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.572 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.572 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.572 INFO:teuthology.orchestra.run.smithi006.stdout: "num_rep": { 2023-09-13T10:04:48.573 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "num_rep", 2023-09-13T10:04:48.573 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.573 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.573 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.573 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3", 2023-09-13T10:04:48.574 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.574 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.574 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.575 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default replica count for any created local pool", 2023-09-13T10:04:48.575 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.575 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.575 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.576 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.576 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_num": { 2023-09-13T10:04:48.576 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_num", 2023-09-13T10:04:48.577 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.577 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.577 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.577 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "128", 2023-09-13T10:04:48.578 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.578 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.578 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.579 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "default pg_num for any created local pool", 2023-09-13T10:04:48.579 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.579 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.579 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.580 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.580 INFO:teuthology.orchestra.run.smithi006.stdout: "prefix": { 2023-09-13T10:04:48.580 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prefix", 2023-09-13T10:04:48.581 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.581 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.581 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.581 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.582 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.582 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.582 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.582 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "name prefix for any created local pool", 2023-09-13T10:04:48.583 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.583 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.583 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.584 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.584 INFO:teuthology.orchestra.run.smithi006.stdout: "subtree": { 2023-09-13T10:04:48.584 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "subtree", 2023-09-13T10:04:48.585 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.585 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.585 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "rack", 2023-09-13T10:04:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.586 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "CRUSH level for which to create a local pool", 2023-09-13T10:04:48.587 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-09-13T10:04:48.588 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.588 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.588 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.588 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.589 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.589 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.589 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mds_autoscaler", 2023-09-13T10:04:48.589 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.590 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.590 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.590 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.590 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.590 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.591 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.591 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.591 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.591 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.592 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.592 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.592 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.592 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.593 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.593 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.593 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.593 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.594 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.594 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.594 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.594 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.595 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.595 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.595 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.596 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.596 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.596 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.596 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.596 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.597 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.597 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.597 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.597 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.597 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.598 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.598 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.598 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.599 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.599 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.599 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.600 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.600 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.600 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.601 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.601 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.601 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.601 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.602 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.602 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.602 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.602 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.603 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.603 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.603 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.603 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.604 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.604 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.604 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.605 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.605 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.605 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.605 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.605 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.606 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.606 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.606 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.606 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.607 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.607 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.607 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.607 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.607 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.608 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.608 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.608 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirroring", 2023-09-13T10:04:48.609 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.609 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.609 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.609 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.610 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.610 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.610 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.610 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.611 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.611 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.611 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.611 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.612 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.612 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.612 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.613 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.613 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.613 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.614 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.614 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.614 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.615 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.615 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.615 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.615 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.616 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.616 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.616 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.616 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.617 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.617 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.617 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.618 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.618 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.618 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.619 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.620 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.620 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.620 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.621 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.621 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.621 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.621 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.622 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.623 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.624 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.624 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.624 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.625 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.625 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.625 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.625 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.625 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.626 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.626 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.626 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.627 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.627 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.627 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.627 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.628 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.628 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.629 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.629 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.629 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "nfs", 2023-09-13T10:04:48.629 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.629 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.630 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.630 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.630 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.630 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.630 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.631 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.631 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.631 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.632 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.632 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.632 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.632 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.632 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.632 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.633 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.633 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.633 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.633 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.634 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.634 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.634 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.634 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.634 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.635 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.635 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.635 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.635 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.635 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.636 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.636 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.636 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.637 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.637 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.637 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.637 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.637 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.638 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.638 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.638 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.638 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.638 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.639 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.639 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.639 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.640 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.640 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.640 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.640 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.640 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.640 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.641 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.641 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.641 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.641 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.641 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.642 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.642 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.642 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.643 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.643 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.644 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.644 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.644 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.644 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.644 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.645 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.645 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.645 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.645 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.646 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.646 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.647 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.647 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.647 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-09-13T10:04:48.647 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.647 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.648 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.648 INFO:teuthology.orchestra.run.smithi006.stdout: "fail_fs": { 2023-09-13T10:04:48.648 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "fail_fs", 2023-09-13T10:04:48.648 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.649 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.649 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.649 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.649 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.649 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.650 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.650 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-09-13T10:04:48.650 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.651 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.651 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.651 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.651 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.652 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.652 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.652 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.653 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.653 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.653 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.653 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.654 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.654 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.654 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.654 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.655 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.655 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.655 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.655 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.656 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.656 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.656 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.657 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.657 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.657 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.657 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.658 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.658 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.659 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.659 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.659 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.659 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.659 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.660 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.660 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.660 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.660 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.660 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.661 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.661 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.661 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.661 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.661 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.661 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.662 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.662 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.662 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.662 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.662 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.663 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.663 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.663 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.663 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.663 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.663 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.664 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.664 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.664 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.664 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.664 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.665 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.665 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.665 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.665 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.665 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.666 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.666 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.666 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.666 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.666 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.667 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.667 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.667 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.667 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator": { 2023-09-13T10:04:48.667 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "orchestrator", 2023-09-13T10:04:48.667 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.668 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.668 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.668 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.668 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.668 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.669 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.669 INFO:teuthology.orchestra.run.smithi006.stdout: "cephadm", 2023-09-13T10:04:48.669 INFO:teuthology.orchestra.run.smithi006.stdout: "rook", 2023-09-13T10:04:48.669 INFO:teuthology.orchestra.run.smithi006.stdout: "test_orchestrator" 2023-09-13T10:04:48.669 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.669 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Orchestrator backend", 2023-09-13T10:04:48.670 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.670 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.670 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.670 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.671 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.671 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.671 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_perf_query", 2023-09-13T10:04:48.671 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.671 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.671 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.672 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.672 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.672 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.672 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.672 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.673 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.673 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.673 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.673 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.673 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.673 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.674 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.674 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.674 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.674 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.674 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.675 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.675 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.675 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.675 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.675 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.676 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.676 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.676 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.676 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.676 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.676 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.677 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.677 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.677 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.677 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.677 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.678 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.678 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.678 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.678 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.679 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.679 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.679 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.680 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.680 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.680 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.680 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.681 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.682 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.683 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.684 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.685 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.686 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "osd_support", 2023-09-13T10:04:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.687 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.688 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.689 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.690 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.691 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.692 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.693 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.694 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.695 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.696 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.697 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.698 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.699 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.700 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.701 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.702 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "pg_autoscaler", 2023-09-13T10:04:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.704 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.705 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.706 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.707 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.708 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.709 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.710 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.711 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.712 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.713 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.714 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.715 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.716 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.717 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.718 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.719 INFO:teuthology.orchestra.run.smithi006.stdout: "noautoscale": { 2023-09-13T10:04:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "noautoscale", 2023-09-13T10:04:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.720 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.721 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "global autoscale flag", 2023-09-13T10:04:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-09-13T10:04:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.722 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.723 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.724 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.725 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "threshold": { 2023-09-13T10:04:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "threshold", 2023-09-13T10:04:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:48.726 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "3.0", 2023-09-13T10:04:48.727 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1.0", 2023-09-13T10:04:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "scaling threshold", 2023-09-13T10:04:48.728 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-09-13T10:04:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.729 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "progress", 2023-09-13T10:04:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.730 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_pg_recovery_event": { 2023-09-13T10:04:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_pg_recovery_event", 2023-09-13T10:04:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.731 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.732 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow the module to show pg recovery progress", 2023-09-13T10:04:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.733 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-09-13T10:04:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-09-13T10:04:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.734 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.735 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.736 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.737 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.738 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.739 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.740 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.741 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.742 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.743 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.744 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.745 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.746 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.747 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.748 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "max_completed_events": { 2023-09-13T10:04:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_completed_events", 2023-09-13T10:04:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.749 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "50", 2023-09-13T10:04:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.750 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "number of past completed events to remember", 2023-09-13T10:04:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.751 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "sleep_interval": { 2023-09-13T10:04:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "sleep_interval", 2023-09-13T10:04:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.752 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "5", 2023-09-13T10:04:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.753 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "how long the module is going to sleep", 2023-09-13T10:04:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.754 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "prometheus", 2023-09-13T10:04:48.755 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "cache": { 2023-09-13T10:04:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "cache", 2023-09-13T10:04:48.756 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.757 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.758 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.759 INFO:teuthology.orchestra.run.smithi006.stdout: "exclude_perf_counters": { 2023-09-13T10:04:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "exclude_perf_counters", 2023-09-13T10:04:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.760 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.761 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-09-13T10:04:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-09-13T10:04:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.762 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.763 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.764 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.765 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.766 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.767 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.768 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.769 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.769 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.769 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.769 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.769 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.770 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.770 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.770 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.770 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.770 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.770 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.771 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.771 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.771 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.771 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.771 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.772 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.772 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.772 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.772 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.772 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.772 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.773 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.773 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.773 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.773 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.774 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.774 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.774 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.774 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.774 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.774 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.775 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.775 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.775 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.775 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.775 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.776 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.776 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.776 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools": { 2023-09-13T10:04:48.776 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools", 2023-09-13T10:04:48.776 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.777 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.778 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.779 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_stats_pools_refresh_interval": { 2023-09-13T10:04:48.779 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-09-13T10:04:48.779 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.779 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.779 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.780 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300", 2023-09-13T10:04:48.780 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.780 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.780 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.780 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.780 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.781 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.781 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.781 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.781 INFO:teuthology.orchestra.run.smithi006.stdout: "scrape_interval": { 2023-09-13T10:04:48.781 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "scrape_interval", 2023-09-13T10:04:48.782 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:48.782 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.782 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.782 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15.0", 2023-09-13T10:04:48.782 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.782 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.783 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.783 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.783 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.783 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.783 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.784 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.784 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:48.784 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:48.784 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.785 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.785 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.785 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "::", 2023-09-13T10:04:48.785 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.785 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.786 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.786 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-09-13T10:04:48.786 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.786 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:48.787 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "9283", 2023-09-13T10:04:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.788 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-09-13T10:04:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.789 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: "stale_cache_strategy": { 2023-09-13T10:04:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stale_cache_strategy", 2023-09-13T10:04:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.790 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "log", 2023-09-13T10:04:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.791 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_behaviour": { 2023-09-13T10:04:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_behaviour", 2023-09-13T10:04:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.793 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "default", 2023-09-13T10:04:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.794 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: "default", 2023-09-13T10:04:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: "error" 2023-09-13T10:04:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.795 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.796 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: "standby_error_status_code": { 2023-09-13T10:04:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "standby_error_status_code", 2023-09-13T10:04:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.797 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "500", 2023-09-13T10:04:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "400", 2023-09-13T10:04:48.798 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "599", 2023-09-13T10:04:48.799 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.799 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.799 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.799 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.800 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.800 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.801 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-09-13T10:04:48.801 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.801 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.801 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.801 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.802 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.802 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.802 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.802 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.802 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.803 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.803 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.803 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.803 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.803 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.803 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.804 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.804 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.804 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.804 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.804 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.805 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.805 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.805 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.805 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.805 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.806 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.806 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.806 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.806 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.807 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.807 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.807 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.807 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.807 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.807 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.808 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.808 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.808 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.808 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.809 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.809 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.809 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.809 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.809 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.810 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.810 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.810 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.810 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.811 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.811 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.811 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.811 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.811 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.812 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.812 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.812 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.812 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.813 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.813 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.813 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.814 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.814 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.814 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.814 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.814 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.815 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.815 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.815 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.815 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.816 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.816 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.816 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_snap_create": { 2023-09-13T10:04:48.817 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_snap_create", 2023-09-13T10:04:48.817 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.817 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.817 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.818 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10", 2023-09-13T10:04:48.818 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.818 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.818 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.819 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.819 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.819 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.819 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.820 INFO:teuthology.orchestra.run.smithi006.stdout: "mirror_snapshot_schedule": { 2023-09-13T10:04:48.820 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "mirror_snapshot_schedule", 2023-09-13T10:04:48.820 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.821 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.821 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.821 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.821 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.821 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.822 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.822 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.822 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.822 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.822 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.823 INFO:teuthology.orchestra.run.smithi006.stdout: "trash_purge_schedule": { 2023-09-13T10:04:48.823 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "trash_purge_schedule", 2023-09-13T10:04:48.824 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.824 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.824 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.824 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.824 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.824 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.825 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.825 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.825 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.826 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.826 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.826 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.826 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.826 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.826 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.827 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "restful", 2023-09-13T10:04:48.827 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.827 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.828 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.828 INFO:teuthology.orchestra.run.smithi006.stdout: "enable_auth": { 2023-09-13T10:04:48.828 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enable_auth", 2023-09-13T10:04:48.828 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.828 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.829 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.829 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.829 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.829 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.830 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.830 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.830 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.830 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.830 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.831 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.831 INFO:teuthology.orchestra.run.smithi006.stdout: "key_file": { 2023-09-13T10:04:48.831 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "key_file", 2023-09-13T10:04:48.831 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.832 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.832 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.832 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.832 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.833 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.833 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.833 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.833 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.834 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.834 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.834 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.834 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.835 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.835 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.835 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.835 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.835 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.835 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.836 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.836 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.836 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.836 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.836 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.837 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.837 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.837 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.837 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.837 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.837 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.838 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.838 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.838 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.838 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.838 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.839 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.839 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.839 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.839 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.839 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.839 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.840 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.840 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.840 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.840 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.841 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.841 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.841 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.841 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.841 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.841 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.842 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.842 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.842 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.842 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.842 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.843 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.843 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.843 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.843 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.843 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.844 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.844 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.844 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.844 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.844 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.844 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.845 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.845 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.845 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.845 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.845 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.845 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.846 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.846 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.846 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.846 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.846 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.847 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.847 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.847 INFO:teuthology.orchestra.run.smithi006.stdout: "server_addr": { 2023-09-13T10:04:48.847 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_addr", 2023-09-13T10:04:48.847 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.847 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.848 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.848 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.848 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.848 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.848 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.849 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.849 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.849 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.849 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.849 INFO:teuthology.orchestra.run.smithi006.stdout: "server_port": { 2023-09-13T10:04:48.850 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "server_port", 2023-09-13T10:04:48.850 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.850 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.850 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.850 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.851 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.851 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.851 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.851 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.851 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.851 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.852 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.852 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.852 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.853 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rgw", 2023-09-13T10:04:48.853 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.853 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.853 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.853 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.853 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.854 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.854 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.854 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.854 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.855 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.855 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.855 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.855 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.856 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.856 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.856 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.856 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.856 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.856 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.857 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.857 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.857 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.857 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.858 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.858 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.858 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.858 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.859 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.859 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.859 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.859 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.860 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.860 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.860 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.860 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.860 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.861 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.861 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.861 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.862 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.862 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.862 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.862 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.862 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.863 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.863 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.863 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.863 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.863 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.864 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.864 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.864 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.864 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.864 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.864 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.865 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.865 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.865 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.865 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.866 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.866 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.866 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.866 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.867 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.867 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.867 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.867 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.868 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.868 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.868 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.869 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.869 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rook", 2023-09-13T10:04:48.869 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.870 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.870 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.870 INFO:teuthology.orchestra.run.smithi006.stdout: "drive_group_interval": { 2023-09-13T10:04:48.870 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "drive_group_interval", 2023-09-13T10:04:48.871 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:48.871 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.871 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.871 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "300.0", 2023-09-13T10:04:48.872 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.872 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.872 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.872 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-09-13T10:04:48.872 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.872 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.873 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.873 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.873 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.873 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.874 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.874 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.874 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.874 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.874 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.875 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.875 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.875 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.875 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.875 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.875 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.876 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.876 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.876 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.876 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.876 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.876 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.877 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.877 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.877 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.877 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.878 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.878 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.878 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.878 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.878 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.879 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.879 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.879 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.879 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.879 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.880 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.880 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.880 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.880 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.880 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.880 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.881 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.881 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.881 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.881 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.881 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.882 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.882 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.882 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.882 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.882 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.882 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.883 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.883 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.883 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.883 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.884 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.884 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.884 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.884 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.884 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.884 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.885 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.885 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.885 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.885 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.885 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.886 INFO:teuthology.orchestra.run.smithi006.stdout: "storage_class": { 2023-09-13T10:04:48.886 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "storage_class", 2023-09-13T10:04:48.886 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.886 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.886 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.887 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "local", 2023-09-13T10:04:48.887 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.887 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.887 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.887 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-09-13T10:04:48.888 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.888 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.888 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.888 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.889 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.889 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.889 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "selftest", 2023-09-13T10:04:48.889 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.890 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.890 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.890 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.890 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.890 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.890 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.891 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.891 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.891 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.891 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.891 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.892 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.892 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.892 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.892 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.892 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.892 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.893 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.893 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.893 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.893 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.893 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.894 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.894 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.894 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.894 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.895 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.895 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.895 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.895 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.895 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.896 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.896 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.896 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.896 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.896 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.897 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.897 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.897 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.898 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.898 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.898 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.898 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.899 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.899 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.899 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.899 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.900 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.900 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.900 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.900 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.901 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.901 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.901 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.901 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.902 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.902 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.902 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.903 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.903 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.903 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.904 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.904 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.904 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.905 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.905 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.906 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.906 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.906 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.906 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.907 INFO:teuthology.orchestra.run.smithi006.stdout: "roption1": { 2023-09-13T10:04:48.907 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption1", 2023-09-13T10:04:48.907 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.908 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.908 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.908 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.908 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.908 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.909 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.909 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.909 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.909 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.910 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.910 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.910 INFO:teuthology.orchestra.run.smithi006.stdout: "roption2": { 2023-09-13T10:04:48.910 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "roption2", 2023-09-13T10:04:48.910 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.911 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.911 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.911 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "xyz", 2023-09-13T10:04:48.911 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.911 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.912 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.912 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.912 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.913 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.913 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.913 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.913 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption1": { 2023-09-13T10:04:48.914 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption1", 2023-09-13T10:04:48.914 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.914 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.915 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.915 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.915 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.915 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.916 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption2": { 2023-09-13T10:04:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption2", 2023-09-13T10:04:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.917 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.918 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.918 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.918 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.919 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.919 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.919 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.920 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.920 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.920 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.921 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption3": { 2023-09-13T10:04:48.921 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption3", 2023-09-13T10:04:48.921 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "float", 2023-09-13T10:04:48.922 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.922 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.922 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.924 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.924 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.925 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.925 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.925 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.926 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.926 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.927 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption4": { 2023-09-13T10:04:48.927 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption4", 2023-09-13T10:04:48.927 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.928 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.928 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.928 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.929 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.929 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.930 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.930 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.930 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.930 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.931 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.931 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.931 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption5": { 2023-09-13T10:04:48.931 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption5", 2023-09-13T10:04:48.931 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.931 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.932 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.932 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.932 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.932 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.932 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.933 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.933 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.933 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.933 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.933 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.933 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption6": { 2023-09-13T10:04:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption6", 2023-09-13T10:04:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.934 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:48.935 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.935 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.935 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.935 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.935 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.935 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.936 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.936 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.936 INFO:teuthology.orchestra.run.smithi006.stdout: "rwoption7": { 2023-09-13T10:04:48.936 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rwoption7", 2023-09-13T10:04:48.936 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:48.936 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.937 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.937 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.937 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "1", 2023-09-13T10:04:48.937 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "42", 2023-09-13T10:04:48.937 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.938 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.938 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.938 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.938 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.939 INFO:teuthology.orchestra.run.smithi006.stdout: "testkey": { 2023-09-13T10:04:48.939 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testkey", 2023-09-13T10:04:48.939 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.939 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.939 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.939 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.940 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.940 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.940 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.940 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.940 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.941 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.941 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.941 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.941 INFO:teuthology.orchestra.run.smithi006.stdout: "testlkey": { 2023-09-13T10:04:48.941 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testlkey", 2023-09-13T10:04:48.941 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.942 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.942 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.942 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.942 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.942 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.943 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.943 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.943 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.943 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.943 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.943 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.944 INFO:teuthology.orchestra.run.smithi006.stdout: "testnewline": { 2023-09-13T10:04:48.944 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "testnewline", 2023-09-13T10:04:48.944 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.944 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.944 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.945 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.945 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.945 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.945 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.945 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.945 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.946 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.946 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.946 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.946 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.946 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.947 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.947 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snap_schedule", 2023-09-13T10:04:48.947 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.947 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.947 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.948 INFO:teuthology.orchestra.run.smithi006.stdout: "allow_m_granularity": { 2023-09-13T10:04:48.948 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "allow_m_granularity", 2023-09-13T10:04:48.948 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.948 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.948 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.948 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.949 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.949 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.949 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.949 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "allow minute scheduled snapshots", 2023-09-13T10:04:48.949 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.950 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.950 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.950 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.950 INFO:teuthology.orchestra.run.smithi006.stdout: "dump_on_update": { 2023-09-13T10:04:48.950 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "dump_on_update", 2023-09-13T10:04:48.950 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.951 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.951 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.951 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.951 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.951 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.952 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.952 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "dump database to debug log on update", 2023-09-13T10:04:48.952 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.952 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.952 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.952 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.953 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.953 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.953 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.953 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.953 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.954 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.954 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.954 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.954 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.955 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.955 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.955 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.955 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.955 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.955 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.956 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.956 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.956 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.956 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.956 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.957 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.957 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.957 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.957 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.957 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.957 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.958 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.958 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.958 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.958 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.958 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.959 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.959 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.959 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.959 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.959 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.959 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.960 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.961 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.961 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.961 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.961 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.961 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.962 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.962 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.962 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.962 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.962 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.962 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.963 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.963 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.963 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.963 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.963 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.964 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.964 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.964 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.964 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.964 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.964 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.965 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.965 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.965 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.965 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.965 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.966 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.966 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.966 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.966 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "stats", 2023-09-13T10:04:48.967 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.967 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.967 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.967 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.967 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.967 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.968 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.968 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.968 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.968 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.968 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.969 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.969 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.969 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.969 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.969 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.969 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.970 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.970 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.970 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.970 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.970 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.970 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.971 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.971 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.971 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.971 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.971 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.972 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.972 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.972 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.972 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.972 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.972 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.973 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.973 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.973 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.973 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.973 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.974 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.974 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.974 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.974 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.974 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.974 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.975 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.975 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.975 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.975 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.975 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.976 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.976 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.976 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.976 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.976 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.977 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.977 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.977 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.977 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.977 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.977 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.978 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.978 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.980 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.981 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.981 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.981 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.981 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.981 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.982 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.982 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.982 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.982 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.982 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.983 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.983 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.983 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "status", 2023-09-13T10:04:48.983 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.983 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.984 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.984 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:48.984 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:48.984 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.984 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.984 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.985 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:48.985 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.985 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.985 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.985 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.986 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.986 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.986 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.986 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.986 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.987 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.987 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.987 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.987 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.987 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.988 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.989 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.989 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.989 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.989 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.989 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.990 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.990 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.990 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.990 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.990 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:48.991 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:48.991 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.991 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.991 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.991 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:48.991 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.992 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.992 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:48.992 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:48.992 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:48.992 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:48.993 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:48.993 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:48.993 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:48.993 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:48.993 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.993 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.994 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.994 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.994 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.994 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:48.994 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:48.995 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:48.995 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.995 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:48.995 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:48.995 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.995 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.996 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:48.996 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:48.996 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:48.996 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:48.996 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:48.997 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.997 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:48.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:48.997 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:48.997 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telegraf", 2023-09-13T10:04:48.997 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:48.998 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:48.998 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:48.998 INFO:teuthology.orchestra.run.smithi006.stdout: "address": { 2023-09-13T10:04:48.998 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "address", 2023-09-13T10:04:48.998 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:48.999 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:48.999 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:48.999 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-09-13T10:04:48.999 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:48.999 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:48.999 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.000 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.000 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.000 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.000 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.000 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.001 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:49.001 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:49.001 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:49.001 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.001 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.001 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "15", 2023-09-13T10:04:49.002 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.002 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.002 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.002 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.002 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.002 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.003 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.003 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:49.003 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:49.003 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.004 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.004 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.004 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.004 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.004 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.004 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.005 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.005 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.005 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.005 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.005 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.006 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.006 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.006 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.006 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.006 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.007 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.007 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:49.007 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:49.007 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.007 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.008 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.008 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.008 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.008 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.008 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.009 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.009 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.009 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.009 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.009 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:49.010 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:49.010 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.010 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.010 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.010 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:49.010 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.011 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.011 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.011 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.011 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.011 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.011 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.012 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.012 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.012 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.012 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.012 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.013 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.013 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.013 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:49.013 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:49.014 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.014 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.014 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.014 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.014 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.015 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.015 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.015 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.015 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.015 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.015 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.016 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.016 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.016 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.016 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.016 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "telemetry", 2023-09-13T10:04:49.017 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:49.017 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:49.017 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:49.017 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_basic": { 2023-09-13T10:04:49.017 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_basic", 2023-09-13T10:04:49.017 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.018 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.018 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.018 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:49.018 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.018 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.018 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.019 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share basic cluster information (size, version)", 2023-09-13T10:04:49.019 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.019 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.019 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.019 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.019 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_crash": { 2023-09-13T10:04:49.020 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_crash", 2023-09-13T10:04:49.020 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.020 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.020 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.020 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:49.020 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.021 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.021 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.021 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-09-13T10:04:49.021 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.021 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.022 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.022 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.022 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_device": { 2023-09-13T10:04:49.022 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_device", 2023-09-13T10:04:49.022 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.023 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.023 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.023 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "True", 2023-09-13T10:04:49.023 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.023 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.023 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.024 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-09-13T10:04:49.024 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.024 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.024 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.024 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.025 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_ident": { 2023-09-13T10:04:49.025 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_ident", 2023-09-13T10:04:49.025 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.025 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.025 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.025 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.026 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.026 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.026 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.026 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-09-13T10:04:49.026 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.027 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.027 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.027 INFO:teuthology.orchestra.run.smithi006.stdout: "channel_perf": { 2023-09-13T10:04:49.027 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "channel_perf", 2023-09-13T10:04:49.027 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.028 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.028 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.028 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.028 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.028 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.029 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.029 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Share various performance metrics of a cluster", 2023-09-13T10:04:49.029 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.029 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.029 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.029 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.030 INFO:teuthology.orchestra.run.smithi006.stdout: "contact": { 2023-09-13T10:04:49.030 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "contact", 2023-09-13T10:04:49.030 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.030 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.030 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.031 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.031 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.031 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.031 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.031 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.031 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.032 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.032 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.032 INFO:teuthology.orchestra.run.smithi006.stdout: "description": { 2023-09-13T10:04:49.032 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "description", 2023-09-13T10:04:49.033 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.033 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.033 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.033 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.033 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.033 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.034 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.034 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.034 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.034 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.034 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.035 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.035 INFO:teuthology.orchestra.run.smithi006.stdout: "device_url": { 2023-09-13T10:04:49.035 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "device_url", 2023-09-13T10:04:49.035 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.035 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.035 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.036 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-09-13T10:04:49.036 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.036 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.036 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.036 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.036 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.037 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.037 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.037 INFO:teuthology.orchestra.run.smithi006.stdout: "enabled": { 2023-09-13T10:04:49.037 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "enabled", 2023-09-13T10:04:49.038 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.038 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.038 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.038 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.038 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.038 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.039 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.039 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.039 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.039 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.039 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.040 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.040 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:49.040 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:49.040 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:49.040 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.040 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.041 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "24", 2023-09-13T10:04:49.041 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "8", 2023-09-13T10:04:49.041 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.041 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.041 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.041 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.042 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.042 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.042 INFO:teuthology.orchestra.run.smithi006.stdout: "last_opt_revision": { 2023-09-13T10:04:49.042 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "last_opt_revision", 2023-09-13T10:04:49.043 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:49.043 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.043 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.043 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "1", 2023-09-13T10:04:49.043 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.043 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.044 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.044 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.044 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.044 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.044 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.045 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard": { 2023-09-13T10:04:49.045 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard", 2023-09-13T10:04:49.045 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.045 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.045 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.046 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.046 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.046 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.046 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.046 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.046 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.047 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.047 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.047 INFO:teuthology.orchestra.run.smithi006.stdout: "leaderboard_description": { 2023-09-13T10:04:49.047 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "leaderboard_description", 2023-09-13T10:04:49.048 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.048 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.048 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.048 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.048 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.048 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.049 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.049 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.049 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.049 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.049 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.050 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:49.050 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:49.050 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.050 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.050 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.050 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.051 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.051 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.051 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.051 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.051 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.052 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.052 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.052 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.052 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.052 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.052 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.053 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.053 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.053 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.053 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:49.053 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:49.054 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.054 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.054 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.054 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.054 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.055 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.055 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.055 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.055 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.055 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.055 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.056 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:49.056 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:49.056 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.056 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.056 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.057 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:49.057 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.057 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.057 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.057 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.058 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.058 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.058 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.058 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.058 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.058 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.059 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.059 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.059 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.059 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.060 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:49.060 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:49.060 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.060 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.060 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.060 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.061 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.061 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.061 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.061 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.061 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.061 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.062 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.062 INFO:teuthology.orchestra.run.smithi006.stdout: "organization": { 2023-09-13T10:04:49.062 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "organization", 2023-09-13T10:04:49.062 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.063 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.063 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.063 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.063 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.063 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.063 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.064 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.064 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.064 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.064 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.064 INFO:teuthology.orchestra.run.smithi006.stdout: "proxy": { 2023-09-13T10:04:49.065 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "proxy", 2023-09-13T10:04:49.065 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.065 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.065 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.065 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.066 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.066 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.066 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.066 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.066 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.066 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.067 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.067 INFO:teuthology.orchestra.run.smithi006.stdout: "url": { 2023-09-13T10:04:49.067 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "url", 2023-09-13T10:04:49.067 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.068 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.068 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.068 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-09-13T10:04:49.068 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.068 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.068 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.069 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.069 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.069 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.069 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.069 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.069 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.070 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.070 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "test_orchestrator", 2023-09-13T10:04:49.070 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:49.070 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:49.071 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:49.071 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:49.071 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:49.071 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.071 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.071 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.072 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.072 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.072 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.072 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.072 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.072 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.073 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.073 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.073 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.073 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.073 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.073 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.074 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.074 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.074 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.074 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.074 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:49.075 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:49.075 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.075 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.075 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.075 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.076 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.076 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.076 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.076 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.076 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.076 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.077 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.077 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.077 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:49.077 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:49.077 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.077 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.078 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.078 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:49.078 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.078 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.078 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.079 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.079 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.079 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.079 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.079 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.079 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.080 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.080 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.080 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.080 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.080 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.080 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.083 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.083 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.083 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.083 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.083 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.083 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-09-13T10:04:49.084 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:49.084 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:49.084 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:49.084 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:49.084 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:49.084 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.085 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.085 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.085 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.085 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.085 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.086 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.086 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.086 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.086 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.086 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.086 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.087 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.087 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.087 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.087 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.087 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.088 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.088 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:49.088 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:49.088 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.088 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.089 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.089 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.089 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.089 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.089 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.089 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.090 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.090 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.090 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.090 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:49.090 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:49.091 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.091 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.091 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.091 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:49.091 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.092 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.092 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.092 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.092 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.092 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.092 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.093 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.093 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.093 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.093 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.093 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.093 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.094 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.094 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.094 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:49.094 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:49.094 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.095 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.095 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.095 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.095 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.095 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.095 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.096 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.097 INFO:teuthology.orchestra.run.smithi006.stdout: "max_concurrent_clones": { 2023-09-13T10:04:49.097 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "max_concurrent_clones", 2023-09-13T10:04:49.097 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:49.097 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.097 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.097 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "4", 2023-09-13T10:04:49.098 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.098 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.098 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.098 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Number of asynchronous cloner threads", 2023-09-13T10:04:49.098 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.099 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.099 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.099 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.099 INFO:teuthology.orchestra.run.smithi006.stdout: "snapshot_clone_delay": { 2023-09-13T10:04:49.099 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "snapshot_clone_delay", 2023-09-13T10:04:49.099 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:49.100 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.100 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.100 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "0", 2023-09-13T10:04:49.100 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.100 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.100 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.101 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-09-13T10:04:49.101 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.101 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.101 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.101 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.102 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.102 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.102 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.102 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix", 2023-09-13T10:04:49.102 INFO:teuthology.orchestra.run.smithi006.stdout: "can_run": true, 2023-09-13T10:04:49.102 INFO:teuthology.orchestra.run.smithi006.stdout: "error_string": "", 2023-09-13T10:04:49.103 INFO:teuthology.orchestra.run.smithi006.stdout: "module_options": { 2023-09-13T10:04:49.103 INFO:teuthology.orchestra.run.smithi006.stdout: "discovery_interval": { 2023-09-13T10:04:49.103 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "discovery_interval", 2023-09-13T10:04:49.103 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "uint", 2023-09-13T10:04:49.103 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.104 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.104 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "100", 2023-09-13T10:04:49.104 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.104 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.104 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.104 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.105 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.105 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.105 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.105 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.105 INFO:teuthology.orchestra.run.smithi006.stdout: "identifier": { 2023-09-13T10:04:49.106 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "identifier", 2023-09-13T10:04:49.106 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.106 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.106 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.106 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.107 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.107 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.107 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.107 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.107 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.108 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.108 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.108 INFO:teuthology.orchestra.run.smithi006.stdout: "interval": { 2023-09-13T10:04:49.108 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "interval", 2023-09-13T10:04:49.108 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "secs", 2023-09-13T10:04:49.108 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.109 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.109 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "60", 2023-09-13T10:04:49.109 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.109 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.109 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.109 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.110 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.110 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.110 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.110 INFO:teuthology.orchestra.run.smithi006.stdout: "log_level": { 2023-09-13T10:04:49.111 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_level", 2023-09-13T10:04:49.111 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.111 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.111 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.111 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.111 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.112 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.112 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.112 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.112 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.112 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.113 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.113 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.113 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.113 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.113 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.113 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.114 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.114 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.114 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.114 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster": { 2023-09-13T10:04:49.114 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster", 2023-09-13T10:04:49.115 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.115 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.115 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.115 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.115 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.115 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.116 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.116 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.116 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.116 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.116 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.117 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_cluster_level": { 2023-09-13T10:04:49.117 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_cluster_level", 2023-09-13T10:04:49.117 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.117 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.118 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.118 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "info", 2023-09-13T10:04:49.118 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.118 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.118 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [ 2023-09-13T10:04:49.118 INFO:teuthology.orchestra.run.smithi006.stdout: "", 2023-09-13T10:04:49.119 INFO:teuthology.orchestra.run.smithi006.stdout: "critical", 2023-09-13T10:04:49.119 INFO:teuthology.orchestra.run.smithi006.stdout: "debug", 2023-09-13T10:04:49.119 INFO:teuthology.orchestra.run.smithi006.stdout: "error", 2023-09-13T10:04:49.119 INFO:teuthology.orchestra.run.smithi006.stdout: "info", 2023-09-13T10:04:49.119 INFO:teuthology.orchestra.run.smithi006.stdout: "warning" 2023-09-13T10:04:49.119 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.120 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.120 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.120 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.120 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.121 INFO:teuthology.orchestra.run.smithi006.stdout: "log_to_file": { 2023-09-13T10:04:49.121 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "log_to_file", 2023-09-13T10:04:49.121 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "bool", 2023-09-13T10:04:49.121 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.121 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 1, 2023-09-13T10:04:49.121 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "False", 2023-09-13T10:04:49.122 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.122 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.122 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.122 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.122 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.123 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.123 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.123 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.123 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_host": { 2023-09-13T10:04:49.123 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_host", 2023-09-13T10:04:49.123 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.124 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.124 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.124 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "", 2023-09-13T10:04:49.124 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.124 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.125 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.125 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.125 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.125 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.125 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.125 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.126 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_port": { 2023-09-13T10:04:49.126 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_port", 2023-09-13T10:04:49.126 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "int", 2023-09-13T10:04:49.126 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.126 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.127 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "10051", 2023-09-13T10:04:49.127 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.127 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.127 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.127 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.127 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.128 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.128 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.128 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.128 INFO:teuthology.orchestra.run.smithi006.stdout: "zabbix_sender": { 2023-09-13T10:04:49.128 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "zabbix_sender", 2023-09-13T10:04:49.128 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "str", 2023-09-13T10:04:49.129 INFO:teuthology.orchestra.run.smithi006.stdout: "level": "advanced", 2023-09-13T10:04:49.129 INFO:teuthology.orchestra.run.smithi006.stdout: "flags": 0, 2023-09-13T10:04:49.129 INFO:teuthology.orchestra.run.smithi006.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-09-13T10:04:49.129 INFO:teuthology.orchestra.run.smithi006.stdout: "min": "", 2023-09-13T10:04:49.129 INFO:teuthology.orchestra.run.smithi006.stdout: "max": "", 2023-09-13T10:04:49.130 INFO:teuthology.orchestra.run.smithi006.stdout: "enum_allowed": [], 2023-09-13T10:04:49.130 INFO:teuthology.orchestra.run.smithi006.stdout: "desc": "", 2023-09-13T10:04:49.130 INFO:teuthology.orchestra.run.smithi006.stdout: "long_desc": "", 2023-09-13T10:04:49.130 INFO:teuthology.orchestra.run.smithi006.stdout: "tags": [], 2023-09-13T10:04:49.130 INFO:teuthology.orchestra.run.smithi006.stdout: "see_also": [] 2023-09-13T10:04:49.131 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.131 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.131 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.131 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.131 INFO:teuthology.orchestra.run.smithi006.stdout: "services": { 2023-09-13T10:04:49.131 INFO:teuthology.orchestra.run.smithi006.stdout: "dashboard": "https://172.21.15.6:8443/" 2023-09-13T10:04:49.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.132 INFO:teuthology.orchestra.run.smithi006.stdout: "always_on_modules": { 2023-09-13T10:04:49.132 INFO:teuthology.orchestra.run.smithi006.stdout: "octopus": [ 2023-09-13T10:04:49.132 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-09-13T10:04:49.132 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-09-13T10:04:49.132 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-09-13T10:04:49.133 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-09-13T10:04:49.133 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-09-13T10:04:49.133 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-09-13T10:04:49.133 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-09-13T10:04:49.133 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-09-13T10:04:49.134 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-09-13T10:04:49.134 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-09-13T10:04:49.134 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.134 INFO:teuthology.orchestra.run.smithi006.stdout: "pacific": [ 2023-09-13T10:04:49.134 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-09-13T10:04:49.134 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-09-13T10:04:49.135 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-09-13T10:04:49.135 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-09-13T10:04:49.135 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-09-13T10:04:49.135 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-09-13T10:04:49.135 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-09-13T10:04:49.135 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-09-13T10:04:49.136 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-09-13T10:04:49.136 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-09-13T10:04:49.136 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.136 INFO:teuthology.orchestra.run.smithi006.stdout: "quincy": [ 2023-09-13T10:04:49.136 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-09-13T10:04:49.137 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-09-13T10:04:49.137 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-09-13T10:04:49.137 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-09-13T10:04:49.137 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-09-13T10:04:49.137 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-09-13T10:04:49.137 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-09-13T10:04:49.138 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-09-13T10:04:49.138 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-09-13T10:04:49.138 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-09-13T10:04:49.138 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2023-09-13T10:04:49.138 INFO:teuthology.orchestra.run.smithi006.stdout: "reef": [ 2023-09-13T10:04:49.138 INFO:teuthology.orchestra.run.smithi006.stdout: "balancer", 2023-09-13T10:04:49.139 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2023-09-13T10:04:49.139 INFO:teuthology.orchestra.run.smithi006.stdout: "devicehealth", 2023-09-13T10:04:49.139 INFO:teuthology.orchestra.run.smithi006.stdout: "orchestrator", 2023-09-13T10:04:49.139 INFO:teuthology.orchestra.run.smithi006.stdout: "pg_autoscaler", 2023-09-13T10:04:49.139 INFO:teuthology.orchestra.run.smithi006.stdout: "progress", 2023-09-13T10:04:49.140 INFO:teuthology.orchestra.run.smithi006.stdout: "rbd_support", 2023-09-13T10:04:49.140 INFO:teuthology.orchestra.run.smithi006.stdout: "status", 2023-09-13T10:04:49.140 INFO:teuthology.orchestra.run.smithi006.stdout: "telemetry", 2023-09-13T10:04:49.140 INFO:teuthology.orchestra.run.smithi006.stdout: "volumes" 2023-09-13T10:04:49.140 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:49.140 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.141 INFO:teuthology.orchestra.run.smithi006.stdout: "last_failure_osd_epoch": 3, 2023-09-13T10:04:49.141 INFO:teuthology.orchestra.run.smithi006.stdout: "active_clients": [ 2023-09-13T10:04:49.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.141 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "devicehealth", 2023-09-13T10:04:49.141 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-09-13T10:04:49.141 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.142 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-09-13T10:04:49.142 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-09-13T10:04:49.142 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 387840949 2023-09-13T10:04:49.142 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.142 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:49.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.143 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "libcephsqlite", 2023-09-13T10:04:49.143 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-09-13T10:04:49.143 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.143 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-09-13T10:04:49.144 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-09-13T10:04:49.144 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 2304956462 2023-09-13T10:04:49.144 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.144 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:49.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.145 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "rbd_support", 2023-09-13T10:04:49.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-09-13T10:04:49.145 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.145 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-09-13T10:04:49.145 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-09-13T10:04:49.146 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 806949827 2023-09-13T10:04:49.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.146 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:49.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:49.146 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.147 INFO:teuthology.orchestra.run.smithi006.stdout: "name": "volumes", 2023-09-13T10:04:49.147 INFO:teuthology.orchestra.run.smithi006.stdout: "addrvec": [ 2023-09-13T10:04:49.147 INFO:teuthology.orchestra.run.smithi006.stdout: { 2023-09-13T10:04:49.147 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v2", 2023-09-13T10:04:49.147 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "172.21.15.6:0", 2023-09-13T10:04:49.147 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 4283798169 2023-09-13T10:04:49.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.148 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:49.148 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:49.148 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2023-09-13T10:04:49.148 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:04:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86e40a06c0 msgr2=0x7f86e40a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:49.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86e40a06c0 0x7f86e40a2b80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009cb0 tx=0x7f86f0009260 comp rx=0 tx=0).stop 2023-09-13T10:04:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0ffc90 msgr2=0x7f86fc103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:04:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0ffc90 0x7f86fc103c20 secure :-1 s=READY pgs=1993 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00d980 tx=0x7f86ec00dc90 comp rx=0 tx=0).stop 2023-09-13T10:04:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 shutdown_connections 2023-09-13T10:04:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86fc101820 0x7f86fc1027a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:49.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86e40a06c0 0x7f86e40a2b80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0ffc90 0x7f86fc103c20 unknown :-1 s=CLOSED pgs=1993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 --2- 172.21.15.6:0/514188809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86fc100e80 0x7f86fc102260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:04:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 >> 172.21.15.6:0/514188809 conn(0x7f86fc0fb220 msgr2=0x7f86fc067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:04:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 shutdown_connections 2023-09-13T10:04:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:04:45.436+0000 7f8702813700 1 -- 172.21.15.6:0/514188809 wait complete. 2023-09-13T10:04:49.152 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:45 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/813461625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.152 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:45 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/388128227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.152 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:45 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2888961262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.153 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:45 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/813461625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.154 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:45 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/388128227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.154 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:45 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2888961262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.154 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:46 smithi131 ceph-mon[102785]: pgmap v1057: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.5 MiB/s wr, 544 op/s 2023-09-13T10:04:49.154 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:46 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:49.155 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:46 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/514188809' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-13T10:04:49.155 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:48 smithi131 ceph-mon[102785]: pgmap v1058: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 420 op/s 2023-09-13T10:04:49.155 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:45 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/813461625' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.155 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:45 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/388128227' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.155 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:45 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2888961262' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T10:04:49.156 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:46 smithi053 ceph-mon[102373]: pgmap v1057: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.5 MiB/s wr, 544 op/s 2023-09-13T10:04:49.156 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:46 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:49.156 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:46 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/514188809' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-13T10:04:49.156 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:48 smithi053 ceph-mon[102373]: pgmap v1058: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 420 op/s 2023-09-13T10:04:49.163 DEBUG:tasks.check_counter:Getting stats from a 2023-09-13T10:04:49.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.a perf dump 2023-09-13T10:04:49.164 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:46 smithi006 ceph-mon[98665]: pgmap v1057: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 5.5 MiB/s wr, 544 op/s 2023-09-13T10:04:49.164 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:46 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:49.164 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:46 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/514188809' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-09-13T10:04:49.164 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:48 smithi006 ceph-mon[98665]: pgmap v1058: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 2.8 MiB/s wr, 420 op/s 2023-09-13T10:04:49.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:49 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:49.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:49 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:49.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:49 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:49.773 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T10:04:50.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:50 smithi006 ceph-mon[98665]: pgmap v1059: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2023-09-13T10:04:50.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:50 smithi053 ceph-mon[102373]: pgmap v1059: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2023-09-13T10:04:50.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:50 smithi131 ceph-mon[102785]: pgmap v1059: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 2.1 MiB/s wr, 323 op/s 2023-09-13T10:04:50.994 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:04:50.994 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:04:50.994 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2749, 2023-09-13T10:04:50.994 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2751, 2023-09-13T10:04:50.995 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 67519132, 2023-09-13T10:04:50.995 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 854940, 2023-09-13T10:04:50.995 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 8, 2023-09-13T10:04:50.995 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 4, 2023-09-13T10:04:50.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.286085665, 2023-09-13T10:04:50.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.066879258, 2023-09-13T10:04:50.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.106600336, 2023-09-13T10:04:50.996 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.089305395, 2023-09-13T10:04:50.997 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:50.997 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2749, 2023-09-13T10:04:50.997 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.112279932, 2023-09-13T10:04:50.997 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000040843 2023-09-13T10:04:50.997 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:50.998 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-13T10:04:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2023-09-13T10:04:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:04:50.999 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2477, 2023-09-13T10:04:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2414, 2023-09-13T10:04:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 110486451, 2023-09-13T10:04:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 874538, 2023-09-13T10:04:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 6, 2023-09-13T10:04:51.000 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 5, 2023-09-13T10:04:51.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.284133588, 2023-09-13T10:04:51.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.061144764, 2023-09-13T10:04:51.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.140580027, 2023-09-13T10:04:51.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.066935648, 2023-09-13T10:04:51.001 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:51.002 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2413, 2023-09-13T10:04:51.002 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.117749706, 2023-09-13T10:04:51.002 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000048798 2023-09-13T10:04:51.002 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.003 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:51.003 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.003 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.003 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.003 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.004 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 931408, 2023-09-13T10:04:51.004 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 259312 2023-09-13T10:04:51.004 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.004 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:04:51.004 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1165, 2023-09-13T10:04:51.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1487, 2023-09-13T10:04:51.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 75794054, 2023-09-13T10:04:51.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 1008840, 2023-09-13T10:04:51.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 6, 2023-09-13T10:04:51.005 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 5, 2023-09-13T10:04:51.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.151394697, 2023-09-13T10:04:51.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.042524017, 2023-09-13T10:04:51.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.065723461, 2023-09-13T10:04:51.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.032828918, 2023-09-13T10:04:51.006 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:51.007 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1486, 2023-09-13T10:04:51.007 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.084018024, 2023-09-13T10:04:51.007 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000056539 2023-09-13T10:04:51.007 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.007 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:51.008 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.008 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.008 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.008 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.008 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-09-13T10:04:51.009 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 648080 2023-09-13T10:04:51.009 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.009 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-09-13T10:04:51.009 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2023-09-13T10:04:51.009 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-09-13T10:04:51.010 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.010 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2023-09-13T10:04:51.010 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-09-13T10:04:51.010 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-09-13T10:04:51.010 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 10089, 2023-09-13T10:04:51.011 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.384900702, 2023-09-13T10:04:51.011 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000038150 2023-09-13T10:04:51.011 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.011 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.011 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2023-09-13T10:04:51.012 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-09-13T10:04:51.012 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-09-13T10:04:51.012 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.012 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.012 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.013 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.013 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.013 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2023-09-13T10:04:51.013 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2023-09-13T10:04:51.014 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2023-09-13T10:04:51.014 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2023-09-13T10:04:51.014 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.014 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.014 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.015 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.015 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2023-09-13T10:04:51.015 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2023-09-13T10:04:51.017 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2023-09-13T10:04:51.017 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2023-09-13T10:04:51.017 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2023-09-13T10:04:51.017 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2023-09-13T10:04:51.017 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2023-09-13T10:04:51.018 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 19908, 2023-09-13T10:04:51.018 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 0, 2023-09-13T10:04:51.018 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 0, 2023-09-13T10:04:51.018 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 19908, 2023-09-13T10:04:51.018 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 19908, 2023-09-13T10:04:51.019 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 7308, 2023-09-13T10:04:51.019 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2023-09-13T10:04:51.019 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2023-09-13T10:04:51.019 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 1, 2023-09-13T10:04:51.019 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2023-09-13T10:04:51.020 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2023-09-13T10:04:51.020 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2023-09-13T10:04:51.020 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2023-09-13T10:04:51.020 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:04:51.020 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2023-09-13T10:04:51.021 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2023-09-13T10:04:51.021 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2023-09-13T10:04:51.021 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2023-09-13T10:04:51.021 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2023-09-13T10:04:51.022 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2023-09-13T10:04:51.022 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2023-09-13T10:04:51.022 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2023-09-13T10:04:51.022 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2023-09-13T10:04:51.022 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2023-09-13T10:04:51.023 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2023-09-13T10:04:51.023 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2023-09-13T10:04:51.023 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2023-09-13T10:04:51.023 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2023-09-13T10:04:51.023 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2023-09-13T10:04:51.024 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2023-09-13T10:04:51.024 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:04:51.024 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:04:51.024 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2023-09-13T10:04:51.024 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:04:51.025 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2023-09-13T10:04:51.025 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2023-09-13T10:04:51.025 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2023-09-13T10:04:51.025 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2023-09-13T10:04:51.025 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2023-09-13T10:04:51.026 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:04:51.026 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:04:51.026 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:04:51.026 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2023-09-13T10:04:51.027 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2023-09-13T10:04:51.027 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2023-09-13T10:04:51.027 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2023-09-13T10:04:51.027 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.027 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2023-09-13T10:04:51.028 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2023-09-13T10:04:51.028 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2023-09-13T10:04:51.028 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2023-09-13T10:04:51.028 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2023-09-13T10:04:51.028 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2023-09-13T10:04:51.029 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2023-09-13T10:04:51.029 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2023-09-13T10:04:51.029 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:04:51.029 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2023-09-13T10:04:51.029 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2023-09-13T10:04:51.030 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2023-09-13T10:04:51.030 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2023-09-13T10:04:51.030 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2023-09-13T10:04:51.030 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:04:51.030 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:04:51.031 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2023-09-13T10:04:51.031 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2023-09-13T10:04:51.031 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:04:51.031 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2023-09-13T10:04:51.031 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2023-09-13T10:04:51.032 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2023-09-13T10:04:51.032 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2023-09-13T10:04:51.032 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2023-09-13T10:04:51.032 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2023-09-13T10:04:51.033 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2023-09-13T10:04:51.033 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2023-09-13T10:04:51.033 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2023-09-13T10:04:51.033 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2023-09-13T10:04:51.033 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 154430, 2023-09-13T10:04:51.034 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2023-09-13T10:04:51.034 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2023-09-13T10:04:51.034 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2023-09-13T10:04:51.034 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2023-09-13T10:04:51.034 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2023-09-13T10:04:51.035 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 137, 2023-09-13T10:04:51.035 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 14, 2023-09-13T10:04:51.035 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2023-09-13T10:04:51.035 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2023-09-13T10:04:51.035 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 72032335, 2023-09-13T10:04:51.036 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 255434653, 2023-09-13T10:04:51.036 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 255434054, 2023-09-13T10:04:51.036 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2023-09-13T10:04:51.036 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.037 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.037 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.037 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 154430 2023-09-13T10:04:51.037 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.038 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2023-09-13T10:04:51.038 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 276, 2023-09-13T10:04:51.038 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 27101, 2023-09-13T10:04:51.038 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 26825, 2023-09-13T10:04:51.038 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 19, 2023-09-13T10:04:51.039 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 172, 2023-09-13T10:04:51.039 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 153, 2023-09-13T10:04:51.039 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 19908, 2023-09-13T10:04:51.039 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 27671, 2023-09-13T10:04:51.039 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 7763, 2023-09-13T10:04:51.040 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2023-09-13T10:04:51.040 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2023-09-13T10:04:51.040 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2023-09-13T10:04:51.040 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 70636, 2023-09-13T10:04:51.040 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 207152 2023-09-13T10:04:51.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.041 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2023-09-13T10:04:51.041 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2023-09-13T10:04:51.041 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2023-09-13T10:04:51.041 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2023-09-13T10:04:51.042 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2023-09-13T10:04:51.042 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2023-09-13T10:04:51.042 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2023-09-13T10:04:51.042 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.043 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.043 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.043 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.043 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2023-09-13T10:04:51.043 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.044 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.044 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.044 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.044 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2023-09-13T10:04:51.044 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.045 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.045 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.045 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.045 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2023-09-13T10:04:51.045 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.046 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.046 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.046 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.046 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2023-09-13T10:04:51.046 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.047 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.047 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.047 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.047 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2023-09-13T10:04:51.047 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2023-09-13T10:04:51.048 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2023-09-13T10:04:51.049 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.050 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.050 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.050 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.050 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2023-09-13T10:04:51.051 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.051 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.051 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.051 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.051 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2023-09-13T10:04:51.052 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.052 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.052 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.052 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.052 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2023-09-13T10:04:51.053 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.053 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.053 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.053 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.053 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2023-09-13T10:04:51.054 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.054 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.054 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.054 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.054 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2023-09-13T10:04:51.055 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.055 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.055 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.055 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.055 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2023-09-13T10:04:51.056 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.056 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.056 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.056 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.057 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2023-09-13T10:04:51.057 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.057 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.057 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.057 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.058 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2023-09-13T10:04:51.058 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.058 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.058 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.058 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.059 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2023-09-13T10:04:51.059 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.059 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.059 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.059 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.060 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2023-09-13T10:04:51.060 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.060 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.060 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.060 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.061 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2023-09-13T10:04:51.061 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.061 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.061 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.061 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.062 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2023-09-13T10:04:51.062 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.062 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.062 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.062 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.063 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2023-09-13T10:04:51.063 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.063 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.063 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.063 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.064 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2023-09-13T10:04:51.064 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.064 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.064 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.064 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.065 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2023-09-13T10:04:51.065 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.065 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.065 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.065 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.066 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2023-09-13T10:04:51.066 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.066 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.066 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.066 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.067 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2023-09-13T10:04:51.067 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.067 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.067 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.067 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.068 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2023-09-13T10:04:51.068 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.068 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.068 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.068 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.069 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2023-09-13T10:04:51.069 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.069 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.069 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.070 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.070 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2023-09-13T10:04:51.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.070 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.070 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.071 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2023-09-13T10:04:51.071 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.071 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.071 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.072 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:04:51.072 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:04:51.072 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2023-09-13T10:04:51.072 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.073 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.073 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.073 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.073 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.073 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2023-09-13T10:04:51.074 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2023-09-13T10:04:51.074 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 1, 2023-09-13T10:04:51.074 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 0, 2023-09-13T10:04:51.074 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2023-09-13T10:04:51.074 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2023-09-13T10:04:51.075 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2023-09-13T10:04:51.075 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2023-09-13T10:04:51.075 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 2875, 2023-09-13T10:04:51.075 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2023-09-13T10:04:51.076 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-09-13T10:04:51.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:04:51.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-09-13T10:04:51.076 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:04:51.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:04:51.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:04:51.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:04:51.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:04:51.077 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:04:51.078 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:04:51.078 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:04:51.078 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:04:51.078 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:04:51.078 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:04:51.079 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:04:51.079 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:04:51.079 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-09-13T10:04:51.079 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:04:51.079 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-09-13T10:04:51.080 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:04:51.080 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:04:51.080 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:04:51.080 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:04:51.080 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:04:51.081 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:04:51.081 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:04:51.081 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-09-13T10:04:51.081 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:04:51.081 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:04:51.082 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:04:51.082 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-09-13T10:04:51.082 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-09-13T10:04:51.082 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-09-13T10:04:51.082 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:04:51.083 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:04:51.083 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:04:51.083 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:04:51.083 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 252232, 2023-09-13T10:04:51.083 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 362, 2023-09-13T10:04:51.084 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-09-13T10:04:51.084 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-09-13T10:04:51.084 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-09-13T10:04:51.084 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-09-13T10:04:51.084 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:04:51.085 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-09-13T10:04:51.085 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:04:51.085 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-09-13T10:04:51.085 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 7824, 2023-09-13T10:04:51.085 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 165, 2023-09-13T10:04:51.086 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:04:51.086 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:04:51.086 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-09-13T10:04:51.086 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-09-13T10:04:51.086 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 14731440, 2023-09-13T10:04:51.087 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 118068, 2023-09-13T10:04:51.087 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-09-13T10:04:51.087 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-09-13T10:04:51.087 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-09-13T10:04:51.087 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-09-13T10:04:51.088 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.088 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2023-09-13T10:04:51.088 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2023-09-13T10:04:51.088 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2023-09-13T10:04:51.089 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 5887, 2023-09-13T10:04:51.089 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2023-09-13T10:04:51.089 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2023-09-13T10:04:51.089 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 5887, 2023-09-13T10:04:51.089 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2023-09-13T10:04:51.089 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 5887, 2023-09-13T10:04:51.090 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 11.424883655, 2023-09-13T10:04:51.090 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.001940697 2023-09-13T10:04:51.090 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.090 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2023-09-13T10:04:51.091 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2023-09-13T10:04:51.091 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 5887, 2023-09-13T10:04:51.091 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 5888 2023-09-13T10:04:51.091 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.091 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 5887, 2023-09-13T10:04:51.092 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 5887, 2023-09-13T10:04:51.092 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2023-09-13T10:04:51.092 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2023-09-13T10:04:51.092 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2023-09-13T10:04:51.092 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 3060, 2023-09-13T10:04:51.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2023-09-13T10:04:51.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 2825, 2023-09-13T10:04:51.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2023-09-13T10:04:51.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2023-09-13T10:04:51.093 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2023-09-13T10:04:51.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2023-09-13T10:04:51.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2023-09-13T10:04:51.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2023-09-13T10:04:51.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2023-09-13T10:04:51.094 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2023-09-13T10:04:51.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2023-09-13T10:04:51.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2023-09-13T10:04:51.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2023-09-13T10:04:51.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2023-09-13T10:04:51.095 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:04:51.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2023-09-13T10:04:51.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:04:51.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2023-09-13T10:04:51.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2023-09-13T10:04:51.096 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2023-09-13T10:04:51.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:04:51.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2023-09-13T10:04:51.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:04:51.097 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2023-09-13T10:04:51.097 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2023-09-13T10:04:51.098 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2023-09-13T10:04:51.098 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2023-09-13T10:04:51.098 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2023-09-13T10:04:51.098 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2023-09-13T10:04:51.098 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2023-09-13T10:04:51.099 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2023-09-13T10:04:51.099 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2023-09-13T10:04:51.099 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2023-09-13T10:04:51.099 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2023-09-13T10:04:51.099 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2023-09-13T10:04:51.100 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2023-09-13T10:04:51.100 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2023-09-13T10:04:51.100 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2023-09-13T10:04:51.100 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2023-09-13T10:04:51.100 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2023-09-13T10:04:51.101 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 88, 2023-09-13T10:04:51.101 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2023-09-13T10:04:51.101 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 4, 2023-09-13T10:04:51.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 11, 2023-09-13T10:04:51.101 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 11, 2023-09-13T10:04:51.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 0, 2023-09-13T10:04:51.102 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2023-09-13T10:04:51.102 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2023-09-13T10:04:51.102 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2023-09-13T10:04:51.102 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2023-09-13T10:04:51.103 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.103 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2023-09-13T10:04:51.103 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2023-09-13T10:04:51.103 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:04:51.103 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2023-09-13T10:04:51.104 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2023-09-13T10:04:51.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.104 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2023-09-13T10:04:51.104 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2023-09-13T10:04:51.104 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.105 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2023-09-13T10:04:51.105 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2023-09-13T10:04:51.105 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2023-09-13T10:04:51.105 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2023-09-13T10:04:51.105 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2023-09-13T10:04:51.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2023-09-13T10:04:51.106 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2023-09-13T10:04:51.106 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.106 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:04:51.106 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:51.107 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-09-13T10:04:51.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:51.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 6387, 2023-09-13T10:04:51.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 253196571, 2023-09-13T10:04:51.107 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 6387, 2023-09-13T10:04:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 6387, 2023-09-13T10:04:51.108 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 253196571, 2023-09-13T10:04:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.109 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2023-09-13T10:04:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-09-13T10:04:51.110 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:51.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:51.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:51.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:51.111 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:51.111 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 5887, 2023-09-13T10:04:51.112 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 251243245, 2023-09-13T10:04:51.112 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 5887, 2023-09-13T10:04:51.112 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 251243245, 2023-09-13T10:04:51.112 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:51.112 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.113 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.113 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.113 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.113 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.113 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2023-09-13T10:04:51.114 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:51.114 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2023-09-13T10:04:51.114 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:51.114 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:51.114 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:51.115 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:51.115 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:51.115 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 5887, 2023-09-13T10:04:51.115 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 5887, 2023-09-13T10:04:51.115 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 5887, 2023-09-13T10:04:51.116 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 5887, 2023-09-13T10:04:51.116 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:51.116 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.116 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.116 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.117 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.117 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.117 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:04:51.117 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:51.117 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-09-13T10:04:51.118 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:51.118 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:51.118 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:51.118 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:51.118 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:51.119 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:51.119 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:51.119 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-09-13T10:04:51.119 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-09-13T10:04:51.119 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:51.120 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.120 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.120 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.120 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.120 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:51.121 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x563569470960": { 2023-09-13T10:04:51.121 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:51.121 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-09-13T10:04:51.121 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:51.121 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:51.122 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:51.122 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:51.122 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:51.122 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:51.122 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:51.123 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-09-13T10:04:51.123 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-09-13T10:04:51.123 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:51.123 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:51.123 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:51.124 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:51.124 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.124 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:51.124 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:04:51.342 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2023-09-13T10:04:51.342 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2023-09-13T10:04:51.343 DEBUG:tasks.check_counter:Getting stats from d 2023-09-13T10:04:51.343 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.d perf dump 2023-09-13T10:04:51.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:51 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:51.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:51 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:51.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:51 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:51.905 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T10:04:52.366 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:52 smithi006 ceph-mon[98665]: pgmap v1060: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 276 op/s 2023-09-13T10:04:52.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:52 smithi053 ceph-mon[102373]: pgmap v1060: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 276 op/s 2023-09-13T10:04:52.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:52 smithi131 ceph-mon[102785]: pgmap v1060: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.7 MiB/s wr, 276 op/s 2023-09-13T10:04:53.369 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:04:53.369 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:04:53.369 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 435, 2023-09-13T10:04:53.369 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 432, 2023-09-13T10:04:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 532672, 2023-09-13T10:04:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 260608, 2023-09-13T10:04:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-09-13T10:04:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2023-09-13T10:04:53.370 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.057642148, 2023-09-13T10:04:53.371 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.022239192, 2023-09-13T10:04:53.371 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.020461825, 2023-09-13T10:04:53.371 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.010968711, 2023-09-13T10:04:53.371 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:53.371 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 431, 2023-09-13T10:04:53.372 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.024644759, 2023-09-13T10:04:53.372 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000057180 2023-09-13T10:04:53.372 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.372 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:53.372 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:53.373 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:53.373 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:53.373 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.373 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 532672, 2023-09-13T10:04:53.373 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 260608 2023-09-13T10:04:53.374 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.374 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:04:53.374 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 6, 2023-09-13T10:04:53.374 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 332, 2023-09-13T10:04:53.374 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 3264, 2023-09-13T10:04:53.375 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 211168, 2023-09-13T10:04:53.375 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-09-13T10:04:53.375 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2023-09-13T10:04:53.375 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.021494563, 2023-09-13T10:04:53.375 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.016402070, 2023-09-13T10:04:53.375 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002034127, 2023-09-13T10:04:53.376 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-13T10:04:53.376 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:53.376 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 331, 2023-09-13T10:04:53.376 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.025165804, 2023-09-13T10:04:53.376 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000076029 2023-09-13T10:04:53.377 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.377 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:53.377 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:53.377 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:53.378 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:53.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.378 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-09-13T10:04:53.378 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 211168 2023-09-13T10:04:53.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.379 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:04:53.379 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 0, 2023-09-13T10:04:53.379 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2, 2023-09-13T10:04:53.379 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 0, 2023-09-13T10:04:53.379 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 0, 2023-09-13T10:04:53.380 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2023-09-13T10:04:53.380 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2023-09-13T10:04:53.380 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.000566797, 2023-09-13T10:04:53.380 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000000000, 2023-09-13T10:04:53.380 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000467594, 2023-09-13T10:04:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-13T10:04:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:53.381 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:53.382 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-13T10:04:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2023-09-13T10:04:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-09-13T10:04:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2023-09-13T10:04:53.383 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-09-13T10:04:53.384 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.384 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-09-13T10:04:53.384 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:04:53.384 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-09-13T10:04:53.384 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:04:53.385 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:04:53.385 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:04:53.385 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:04:53.385 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:04:53.385 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:04:53.385 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:04:53.386 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:04:53.386 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:04:53.386 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:04:53.386 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:04:53.387 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:04:53.387 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:04:53.387 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-09-13T10:04:53.387 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:04:53.388 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-09-13T10:04:53.388 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:04:53.388 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:04:53.388 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:04:53.388 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:04:53.388 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:04:53.389 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:04:53.389 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:04:53.389 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-09-13T10:04:53.389 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:04:53.389 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:04:53.390 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:04:53.390 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-09-13T10:04:53.390 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-09-13T10:04:53.390 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-09-13T10:04:53.390 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:04:53.390 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:04:53.391 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:04:53.391 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:04:53.391 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148704, 2023-09-13T10:04:53.391 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 29, 2023-09-13T10:04:53.391 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-09-13T10:04:53.392 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-09-13T10:04:53.392 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-09-13T10:04:53.392 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-09-13T10:04:53.392 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:04:53.392 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-09-13T10:04:53.392 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:04:53.393 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-09-13T10:04:53.393 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2023-09-13T10:04:53.393 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2023-09-13T10:04:53.393 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:04:53.394 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:04:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-09-13T10:04:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-09-13T10:04:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2023-09-13T10:04:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2023-09-13T10:04:53.395 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-09-13T10:04:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-09-13T10:04:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-09-13T10:04:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-09-13T10:04:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:04:53.396 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-09-13T10:04:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 437, 2023-09-13T10:04:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 471164, 2023-09-13T10:04:53.397 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 437, 2023-09-13T10:04:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 437, 2023-09-13T10:04:53.398 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 471164, 2023-09-13T10:04:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:53.399 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:53.400 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:04:53.876 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-09-13T10:04:53.877 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-09-13T10:04:53.877 DEBUG:tasks.check_counter:Getting stats from g 2023-09-13T10:04:53.878 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.g perf dump 2023-09-13T10:04:54.443 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T10:04:54.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:54 smithi053 ceph-mon[102373]: pgmap v1061: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.0 MiB/s wr, 173 op/s 2023-09-13T10:04:54.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:54 smithi053 ceph-mon[102373]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:54 smithi006 ceph-mon[98665]: pgmap v1061: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.0 MiB/s wr, 173 op/s 2023-09-13T10:04:54.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:54 smithi006 ceph-mon[98665]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:54 smithi131 ceph-mon[102785]: pgmap v1061: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 962 KiB/s rd, 1.0 MiB/s wr, 173 op/s 2023-09-13T10:04:54.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:54 smithi131 ceph-mon[102785]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-09-13T10:04:56.257 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:56 smithi006 ceph-mon[98665]: pgmap v1062: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 755 KiB/s wr, 139 op/s 2023-09-13T10:04:56.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:56 smithi053 ceph-mon[102373]: pgmap v1062: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 755 KiB/s wr, 139 op/s 2023-09-13T10:04:56.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:56 smithi131 ceph-mon[102785]: pgmap v1062: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 738 KiB/s rd, 755 KiB/s wr, 139 op/s 2023-09-13T10:04:56.808 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:04:56.808 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:04:56.809 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 3134, 2023-09-13T10:04:56.809 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 3070, 2023-09-13T10:04:56.809 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 102398060, 2023-09-13T10:04:56.810 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 1079112, 2023-09-13T10:04:56.810 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 7, 2023-09-13T10:04:56.810 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 3, 2023-09-13T10:04:56.810 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.356678533, 2023-09-13T10:04:56.811 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.102369710, 2023-09-13T10:04:56.811 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.142694478, 2023-09-13T10:04:56.811 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.089210545, 2023-09-13T10:04:56.811 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:56.812 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3069, 2023-09-13T10:04:56.812 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.165043014, 2023-09-13T10:04:56.812 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000053777 2023-09-13T10:04:56.813 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.813 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:56.813 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.814 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.815 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.815 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.815 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 938368, 2023-09-13T10:04:56.815 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 260560 2023-09-13T10:04:56.816 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.816 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:04:56.816 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2155, 2023-09-13T10:04:56.816 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 2479, 2023-09-13T10:04:56.816 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 105409563, 2023-09-13T10:04:56.817 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 1318723, 2023-09-13T10:04:56.817 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 7, 2023-09-13T10:04:56.817 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 6, 2023-09-13T10:04:56.817 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.236544245, 2023-09-13T10:04:56.817 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.054792566, 2023-09-13T10:04:56.818 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.108101918, 2023-09-13T10:04:56.818 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.058454038, 2023-09-13T10:04:56.818 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:56.818 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 2478, 2023-09-13T10:04:56.818 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.099043240, 2023-09-13T10:04:56.819 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000039969 2023-09-13T10:04:56.819 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.819 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:56.819 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.819 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.819 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.820 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-09-13T10:04:56.820 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 650016 2023-09-13T10:04:56.820 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.820 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:04:56.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 1124, 2023-09-13T10:04:56.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 1126, 2023-09-13T10:04:56.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 131256506, 2023-09-13T10:04:56.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 349576, 2023-09-13T10:04:56.821 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 7, 2023-09-13T10:04:56.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 5, 2023-09-13T10:04:56.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.166668365, 2023-09-13T10:04:56.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.021821904, 2023-09-13T10:04:56.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.104974109, 2023-09-13T10:04:56.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.031921608, 2023-09-13T10:04:56.822 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:56.823 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 1124, 2023-09-13T10:04:56.823 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.080297776, 2023-09-13T10:04:56.823 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000071439 2023-09-13T10:04:56.823 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.823 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:56.824 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.824 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.824 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.824 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.824 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-13T10:04:56.824 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 0 2023-09-13T10:04:56.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.825 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-09-13T10:04:56.825 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 1, 2023-09-13T10:04:56.825 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-09-13T10:04:56.825 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.826 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-MDSRank": { 2023-09-13T10:04:56.826 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-09-13T10:04:56.826 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-09-13T10:04:56.826 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 10098, 2023-09-13T10:04:56.826 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.497873773, 2023-09-13T10:04:56.827 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000049304 2023-09-13T10:04:56.827 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.827 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.827 INFO:teuthology.orchestra.run.smithi006.stdout: "finisher-PurgeQueue": { 2023-09-13T10:04:56.827 INFO:teuthology.orchestra.run.smithi006.stdout: "queue_len": 0, 2023-09-13T10:04:56.828 INFO:teuthology.orchestra.run.smithi006.stdout: "complete_latency": { 2023-09-13T10:04:56.828 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.828 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.828 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.828 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.828 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.829 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2023-09-13T10:04:56.829 INFO:teuthology.orchestra.run.smithi006.stdout: "request": 0, 2023-09-13T10:04:56.829 INFO:teuthology.orchestra.run.smithi006.stdout: "reply": 0, 2023-09-13T10:04:56.829 INFO:teuthology.orchestra.run.smithi006.stdout: "reply_latency": { 2023-09-13T10:04:56.829 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.830 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.830 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.830 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.830 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_reply": 0, 2023-09-13T10:04:56.830 INFO:teuthology.orchestra.run.smithi006.stdout: "forward": 0, 2023-09-13T10:04:56.831 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_complete": 0, 2023-09-13T10:04:56.831 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_fetch_keys": 0, 2023-09-13T10:04:56.831 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_commit": 0, 2023-09-13T10:04:56.831 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_split": 0, 2023-09-13T10:04:56.831 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_merge": 0, 2023-09-13T10:04:56.832 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes": 24459, 2023-09-13T10:04:56.832 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_top": 0, 2023-09-13T10:04:56.832 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_bottom": 0, 2023-09-13T10:04:56.832 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pin_tail": 24459, 2023-09-13T10:04:56.832 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_pinned": 24459, 2023-09-13T10:04:56.832 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_expired": 12264, 2023-09-13T10:04:56.833 INFO:teuthology.orchestra.run.smithi006.stdout: "inodes_with_caps": 0, 2023-09-13T10:04:56.833 INFO:teuthology.orchestra.run.smithi006.stdout: "caps": 0, 2023-09-13T10:04:56.833 INFO:teuthology.orchestra.run.smithi006.stdout: "subtrees": 1, 2023-09-13T10:04:56.833 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse": 0, 2023-09-13T10:04:56.833 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_hit": 0, 2023-09-13T10:04:56.834 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_forward": 0, 2023-09-13T10:04:56.834 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_discover": 0, 2023-09-13T10:04:56.834 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:04:56.834 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_remote_ino": 0, 2023-09-13T10:04:56.834 INFO:teuthology.orchestra.run.smithi006.stdout: "traverse_lock": 0, 2023-09-13T10:04:56.835 INFO:teuthology.orchestra.run.smithi006.stdout: "load_cent": 0, 2023-09-13T10:04:56.835 INFO:teuthology.orchestra.run.smithi006.stdout: "q": 0, 2023-09-13T10:04:56.835 INFO:teuthology.orchestra.run.smithi006.stdout: "exported": 0, 2023-09-13T10:04:56.835 INFO:teuthology.orchestra.run.smithi006.stdout: "exported_inodes": 0, 2023-09-13T10:04:56.835 INFO:teuthology.orchestra.run.smithi006.stdout: "imported": 0, 2023-09-13T10:04:56.835 INFO:teuthology.orchestra.run.smithi006.stdout: "imported_inodes": 0, 2023-09-13T10:04:56.836 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_dir_fetch": 0, 2023-09-13T10:04:56.836 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_backtrace_fetch": 0, 2023-09-13T10:04:56.836 INFO:teuthology.orchestra.run.smithi006.stdout: "openino_peer_discover": 0, 2023-09-13T10:04:56.836 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rfiles": 0, 2023-09-13T10:04:56.836 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rbytes": 0, 2023-09-13T10:04:56.837 INFO:teuthology.orchestra.run.smithi006.stdout: "root_rsnaps": 0, 2023-09-13T10:04:56.837 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_fetch": 0, 2023-09-13T10:04:56.837 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_set_tag": 0, 2023-09-13T10:04:56.837 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:04:56.837 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:04:56.838 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_inodes": 0, 2023-09-13T10:04:56.838 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:04:56.838 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_dirfrag_rstats": 0, 2023-09-13T10:04:56.838 INFO:teuthology.orchestra.run.smithi006.stdout: "scrub_file_inodes": 0, 2023-09-13T10:04:56.838 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_inode_file_caps": 0, 2023-09-13T10:04:56.838 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_revoke": 0, 2023-09-13T10:04:56.839 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_grant": 0, 2023-09-13T10:04:56.839 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:04:56.839 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:04:56.839 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:04:56.839 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps": 0, 2023-09-13T10:04:56.840 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_caps_dirty": 0, 2023-09-13T10:04:56.840 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_cap_release": 0, 2023-09-13T10:04:56.840 INFO:teuthology.orchestra.run.smithi006.stdout: "process_request_cap_release": 0 2023-09-13T10:04:56.840 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.840 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_cache": { 2023-09-13T10:04:56.840 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update": 0, 2023-09-13T10:04:56.841 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_update_receipt": 0, 2023-09-13T10:04:56.841 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_try_discover": 0, 2023-09-13T10:04:56.841 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_send_discover": 0, 2023-09-13T10:04:56.841 INFO:teuthology.orchestra.run.smithi006.stdout: "dir_handle_discover": 0, 2023-09-13T10:04:56.841 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays": 0, 2023-09-13T10:04:56.842 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_delayed": 0, 2023-09-13T10:04:56.842 INFO:teuthology.orchestra.run.smithi006.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:04:56.842 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_created": 0, 2023-09-13T10:04:56.842 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_enqueued": 0, 2023-09-13T10:04:56.842 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_reintegrated": 0, 2023-09-13T10:04:56.843 INFO:teuthology.orchestra.run.smithi006.stdout: "strays_migrated": 0, 2023-09-13T10:04:56.843 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_processing": 0, 2023-09-13T10:04:56.843 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:04:56.843 INFO:teuthology.orchestra.run.smithi006.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:04:56.843 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_started": 0, 2023-09-13T10:04:56.843 INFO:teuthology.orchestra.run.smithi006.stdout: "recovery_completed": 0, 2023-09-13T10:04:56.844 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:04:56.844 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_exportdir": 0, 2023-09-13T10:04:56.844 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_flush": 0, 2023-09-13T10:04:56.844 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragmentdir": 0, 2023-09-13T10:04:56.844 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_fragstats": 0, 2023-09-13T10:04:56.845 INFO:teuthology.orchestra.run.smithi006.stdout: "ireq_inodestats": 0 2023-09-13T10:04:56.845 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.845 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_log": { 2023-09-13T10:04:56.845 INFO:teuthology.orchestra.run.smithi006.stdout: "evlrg": 0, 2023-09-13T10:04:56.845 INFO:teuthology.orchestra.run.smithi006.stdout: "evadd": 0, 2023-09-13T10:04:56.846 INFO:teuthology.orchestra.run.smithi006.stdout: "evex": 0, 2023-09-13T10:04:56.846 INFO:teuthology.orchestra.run.smithi006.stdout: "evtrm": 0, 2023-09-13T10:04:56.846 INFO:teuthology.orchestra.run.smithi006.stdout: "ev": 170907, 2023-09-13T10:04:56.846 INFO:teuthology.orchestra.run.smithi006.stdout: "evexg": 0, 2023-09-13T10:04:56.846 INFO:teuthology.orchestra.run.smithi006.stdout: "evexd": 0, 2023-09-13T10:04:56.847 INFO:teuthology.orchestra.run.smithi006.stdout: "segadd": 0, 2023-09-13T10:04:56.847 INFO:teuthology.orchestra.run.smithi006.stdout: "segex": 0, 2023-09-13T10:04:56.847 INFO:teuthology.orchestra.run.smithi006.stdout: "segtrm": 0, 2023-09-13T10:04:56.847 INFO:teuthology.orchestra.run.smithi006.stdout: "seg": 133, 2023-09-13T10:04:56.847 INFO:teuthology.orchestra.run.smithi006.stdout: "segmjr": 15, 2023-09-13T10:04:56.847 INFO:teuthology.orchestra.run.smithi006.stdout: "segexg": 0, 2023-09-13T10:04:56.848 INFO:teuthology.orchestra.run.smithi006.stdout: "segexd": 0, 2023-09-13T10:04:56.848 INFO:teuthology.orchestra.run.smithi006.stdout: "expos": 116845798, 2023-09-13T10:04:56.848 INFO:teuthology.orchestra.run.smithi006.stdout: "wrpos": 340685485, 2023-09-13T10:04:56.848 INFO:teuthology.orchestra.run.smithi006.stdout: "rdpos": 340684347, 2023-09-13T10:04:56.848 INFO:teuthology.orchestra.run.smithi006.stdout: "jlat": { 2023-09-13T10:04:56.849 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.849 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.849 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.849 INFO:teuthology.orchestra.run.smithi006.stdout: "replayed": 170907 2023-09-13T10:04:56.849 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.850 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_mem": { 2023-09-13T10:04:56.850 INFO:teuthology.orchestra.run.smithi006.stdout: "ino": 345, 2023-09-13T10:04:56.850 INFO:teuthology.orchestra.run.smithi006.stdout: "ino+": 36717, 2023-09-13T10:04:56.850 INFO:teuthology.orchestra.run.smithi006.stdout: "ino-": 36372, 2023-09-13T10:04:56.850 INFO:teuthology.orchestra.run.smithi006.stdout: "dir": 17, 2023-09-13T10:04:56.851 INFO:teuthology.orchestra.run.smithi006.stdout: "dir+": 153, 2023-09-13T10:04:56.851 INFO:teuthology.orchestra.run.smithi006.stdout: "dir-": 136, 2023-09-13T10:04:56.851 INFO:teuthology.orchestra.run.smithi006.stdout: "dn": 24459, 2023-09-13T10:04:56.851 INFO:teuthology.orchestra.run.smithi006.stdout: "dn+": 37126, 2023-09-13T10:04:56.851 INFO:teuthology.orchestra.run.smithi006.stdout: "dn-": 12667, 2023-09-13T10:04:56.852 INFO:teuthology.orchestra.run.smithi006.stdout: "cap": 0, 2023-09-13T10:04:56.852 INFO:teuthology.orchestra.run.smithi006.stdout: "cap+": 0, 2023-09-13T10:04:56.852 INFO:teuthology.orchestra.run.smithi006.stdout: "cap-": 0, 2023-09-13T10:04:56.852 INFO:teuthology.orchestra.run.smithi006.stdout: "rss": 75912, 2023-09-13T10:04:56.852 INFO:teuthology.orchestra.run.smithi006.stdout: "heap": 207152 2023-09-13T10:04:56.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.853 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_server": { 2023-09-13T10:04:56.853 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_client_request": 0, 2023-09-13T10:04:56.853 INFO:teuthology.orchestra.run.smithi006.stdout: "dispatch_server_request": 0, 2023-09-13T10:04:56.853 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_request": 0, 2023-09-13T10:04:56.853 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_client_session": 0, 2023-09-13T10:04:56.854 INFO:teuthology.orchestra.run.smithi006.stdout: "handle_peer_request": 0, 2023-09-13T10:04:56.854 INFO:teuthology.orchestra.run.smithi006.stdout: "req_create_latency": { 2023-09-13T10:04:56.854 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.854 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.854 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.855 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getattr_latency": { 2023-09-13T10:04:56.855 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.855 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.855 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.855 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.856 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getfilelock_latency": { 2023-09-13T10:04:56.856 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.856 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.856 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.856 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.857 INFO:teuthology.orchestra.run.smithi006.stdout: "req_link_latency": { 2023-09-13T10:04:56.857 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.857 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.857 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.857 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.858 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookup_latency": { 2023-09-13T10:04:56.858 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.858 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.858 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.858 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.859 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookuphash_latency": { 2023-09-13T10:04:56.859 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.859 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.859 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.859 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.859 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupino_latency": { 2023-09-13T10:04:56.860 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.860 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.860 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.860 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.860 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupname_latency": { 2023-09-13T10:04:56.861 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.861 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.861 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.861 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.861 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupparent_latency": { 2023-09-13T10:04:56.861 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.862 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.862 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.862 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.862 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lookupsnap_latency": { 2023-09-13T10:04:56.862 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.863 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.863 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.863 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.863 INFO:teuthology.orchestra.run.smithi006.stdout: "req_lssnap_latency": { 2023-09-13T10:04:56.863 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.864 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.864 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.864 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.864 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mkdir_latency": { 2023-09-13T10:04:56.864 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.864 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.865 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.865 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.865 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mknod_latency": { 2023-09-13T10:04:56.865 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.866 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.866 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.866 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.866 INFO:teuthology.orchestra.run.smithi006.stdout: "req_mksnap_latency": { 2023-09-13T10:04:56.867 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.868 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.868 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.869 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.869 INFO:teuthology.orchestra.run.smithi006.stdout: "req_open_latency": { 2023-09-13T10:04:56.869 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.869 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.870 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.870 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.870 INFO:teuthology.orchestra.run.smithi006.stdout: "req_readdir_latency": { 2023-09-13T10:04:56.870 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.870 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.871 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.871 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.871 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rename_latency": { 2023-09-13T10:04:56.871 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.871 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.872 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.872 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.872 INFO:teuthology.orchestra.run.smithi006.stdout: "req_renamesnap_latency": { 2023-09-13T10:04:56.872 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.872 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.873 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.873 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.873 INFO:teuthology.orchestra.run.smithi006.stdout: "req_snapdiff_latency": { 2023-09-13T10:04:56.873 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.873 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.874 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.874 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.874 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmdir_latency": { 2023-09-13T10:04:56.874 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.874 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.875 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.875 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.875 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmsnap_latency": { 2023-09-13T10:04:56.875 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.875 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.876 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.876 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.876 INFO:teuthology.orchestra.run.smithi006.stdout: "req_rmxattr_latency": { 2023-09-13T10:04:56.876 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.876 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.876 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.877 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.877 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setattr_latency": { 2023-09-13T10:04:56.877 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.877 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.877 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.878 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.878 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setdirlayout_latency": { 2023-09-13T10:04:56.878 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.878 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.878 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.879 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setfilelock_latency": { 2023-09-13T10:04:56.879 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.879 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.879 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.879 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.880 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setlayout_latency": { 2023-09-13T10:04:56.880 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.880 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.880 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.880 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.881 INFO:teuthology.orchestra.run.smithi006.stdout: "req_setxattr_latency": { 2023-09-13T10:04:56.881 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.881 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.881 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.881 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.882 INFO:teuthology.orchestra.run.smithi006.stdout: "req_symlink_latency": { 2023-09-13T10:04:56.882 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.882 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.882 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.882 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.882 INFO:teuthology.orchestra.run.smithi006.stdout: "req_unlink_latency": { 2023-09-13T10:04:56.883 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.883 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.883 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.883 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.883 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:04:56.884 INFO:teuthology.orchestra.run.smithi006.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:04:56.884 INFO:teuthology.orchestra.run.smithi006.stdout: "req_getvxattr_latency": { 2023-09-13T10:04:56.884 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.884 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.884 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.885 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.885 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.885 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_sessions": { 2023-09-13T10:04:56.885 INFO:teuthology.orchestra.run.smithi006.stdout: "session_count": 1, 2023-09-13T10:04:56.885 INFO:teuthology.orchestra.run.smithi006.stdout: "session_add": 1, 2023-09-13T10:04:56.886 INFO:teuthology.orchestra.run.smithi006.stdout: "session_remove": 0, 2023-09-13T10:04:56.886 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_open": 1, 2023-09-13T10:04:56.886 INFO:teuthology.orchestra.run.smithi006.stdout: "sessions_stale": 0, 2023-09-13T10:04:56.886 INFO:teuthology.orchestra.run.smithi006.stdout: "total_load": 0, 2023-09-13T10:04:56.886 INFO:teuthology.orchestra.run.smithi006.stdout: "average_load": 0, 2023-09-13T10:04:56.887 INFO:teuthology.orchestra.run.smithi006.stdout: "avg_session_uptime": 2883, 2023-09-13T10:04:56.887 INFO:teuthology.orchestra.run.smithi006.stdout: "mdthresh_evicted": 0 2023-09-13T10:04:56.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.887 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-09-13T10:04:56.887 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:04:56.887 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-09-13T10:04:56.888 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:04:56.888 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:04:56.888 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:04:56.888 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:04:56.888 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:04:56.889 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:04:56.889 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:04:56.889 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:04:56.889 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:04:56.889 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:04:56.890 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:04:56.890 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:04:56.890 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:04:56.890 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-09-13T10:04:56.890 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:04:56.891 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-09-13T10:04:56.891 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:04:56.891 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:04:56.891 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:04:56.891 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:04:56.891 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:04:56.892 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:04:56.892 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:04:56.892 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-09-13T10:04:56.892 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:04:56.892 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:04:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:04:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-09-13T10:04:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-09-13T10:04:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-09-13T10:04:56.893 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:04:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:04:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:04:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:04:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 252367, 2023-09-13T10:04:56.894 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 416, 2023-09-13T10:04:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-09-13T10:04:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-09-13T10:04:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-09-13T10:04:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-09-13T10:04:56.895 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:04:56.896 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-09-13T10:04:56.896 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:04:56.896 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-09-13T10:04:56.896 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 7824, 2023-09-13T10:04:56.896 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 165, 2023-09-13T10:04:56.897 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:04:56.897 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:04:56.897 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-09-13T10:04:56.897 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-09-13T10:04:56.897 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 18064984, 2023-09-13T10:04:56.897 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 143570, 2023-09-13T10:04:56.898 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-09-13T10:04:56.898 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-09-13T10:04:56.898 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-09-13T10:04:56.898 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-09-13T10:04:56.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.899 INFO:teuthology.orchestra.run.smithi006.stdout: "objecter": { 2023-09-13T10:04:56.899 INFO:teuthology.orchestra.run.smithi006.stdout: "op_active": 0, 2023-09-13T10:04:56.899 INFO:teuthology.orchestra.run.smithi006.stdout: "op_laggy": 0, 2023-09-13T10:04:56.899 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send": 5906, 2023-09-13T10:04:56.899 INFO:teuthology.orchestra.run.smithi006.stdout: "op_send_bytes": 21, 2023-09-13T10:04:56.900 INFO:teuthology.orchestra.run.smithi006.stdout: "op_resend": 3, 2023-09-13T10:04:56.900 INFO:teuthology.orchestra.run.smithi006.stdout: "op_reply": 5906, 2023-09-13T10:04:56.900 INFO:teuthology.orchestra.run.smithi006.stdout: "op_latency": { 2023-09-13T10:04:56.900 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 5906, 2023-09-13T10:04:56.900 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 16.806829370, 2023-09-13T10:04:56.901 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.002845721 2023-09-13T10:04:56.901 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.901 INFO:teuthology.orchestra.run.smithi006.stdout: "op_inflight": 0, 2023-09-13T10:04:56.901 INFO:teuthology.orchestra.run.smithi006.stdout: "oplen_avg": { 2023-09-13T10:04:56.901 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 5906, 2023-09-13T10:04:56.902 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 5907 2023-09-13T10:04:56.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.902 INFO:teuthology.orchestra.run.smithi006.stdout: "op": 5906, 2023-09-13T10:04:56.902 INFO:teuthology.orchestra.run.smithi006.stdout: "op_r": 5906, 2023-09-13T10:04:56.902 INFO:teuthology.orchestra.run.smithi006.stdout: "op_w": 0, 2023-09-13T10:04:56.902 INFO:teuthology.orchestra.run.smithi006.stdout: "op_rmw": 0, 2023-09-13T10:04:56.903 INFO:teuthology.orchestra.run.smithi006.stdout: "op_pg": 0, 2023-09-13T10:04:56.903 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_stat": 3115, 2023-09-13T10:04:56.903 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_create": 0, 2023-09-13T10:04:56.903 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_read": 2789, 2023-09-13T10:04:56.903 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_write": 0, 2023-09-13T10:04:56.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writefull": 0, 2023-09-13T10:04:56.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_writesame": 0, 2023-09-13T10:04:56.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_append": 0, 2023-09-13T10:04:56.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_zero": 0, 2023-09-13T10:04:56.904 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_truncate": 0, 2023-09-13T10:04:56.905 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_delete": 0, 2023-09-13T10:04:56.905 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_mapext": 0, 2023-09-13T10:04:56.905 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_sparse_read": 0, 2023-09-13T10:04:56.905 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_clonerange": 0, 2023-09-13T10:04:56.905 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_getxattr": 1, 2023-09-13T10:04:56.906 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_setxattr": 0, 2023-09-13T10:04:56.906 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:04:56.906 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_rmxattr": 0, 2023-09-13T10:04:56.906 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:04:56.906 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_call": 0, 2023-09-13T10:04:56.906 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_watch": 0, 2023-09-13T10:04:56.907 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_notify": 0, 2023-09-13T10:04:56.907 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:04:56.907 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls": 0, 2023-09-13T10:04:56.907 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:04:56.907 INFO:teuthology.orchestra.run.smithi006.stdout: "osdop_other": 0, 2023-09-13T10:04:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_active": 0, 2023-09-13T10:04:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_send": 0, 2023-09-13T10:04:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_resend": 0, 2023-09-13T10:04:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: "linger_ping": 0, 2023-09-13T10:04:56.908 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_active": 0, 2023-09-13T10:04:56.909 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_send": 0, 2023-09-13T10:04:56.909 INFO:teuthology.orchestra.run.smithi006.stdout: "poolop_resend": 0, 2023-09-13T10:04:56.909 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_active": 0, 2023-09-13T10:04:56.909 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_send": 0, 2023-09-13T10:04:56.909 INFO:teuthology.orchestra.run.smithi006.stdout: "poolstat_resend": 0, 2023-09-13T10:04:56.909 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_active": 0, 2023-09-13T10:04:56.910 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_send": 0, 2023-09-13T10:04:56.910 INFO:teuthology.orchestra.run.smithi006.stdout: "statfs_resend": 0, 2023-09-13T10:04:56.910 INFO:teuthology.orchestra.run.smithi006.stdout: "command_active": 0, 2023-09-13T10:04:56.910 INFO:teuthology.orchestra.run.smithi006.stdout: "command_send": 0, 2023-09-13T10:04:56.910 INFO:teuthology.orchestra.run.smithi006.stdout: "command_resend": 0, 2023-09-13T10:04:56.911 INFO:teuthology.orchestra.run.smithi006.stdout: "map_epoch": 88, 2023-09-13T10:04:56.911 INFO:teuthology.orchestra.run.smithi006.stdout: "map_full": 0, 2023-09-13T10:04:56.911 INFO:teuthology.orchestra.run.smithi006.stdout: "map_inc": 4, 2023-09-13T10:04:56.911 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_sessions": 11, 2023-09-13T10:04:56.911 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_open": 12, 2023-09-13T10:04:56.911 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_session_close": 1, 2023-09-13T10:04:56.912 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_laggy": 0, 2023-09-13T10:04:56.912 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_wr": 0, 2023-09-13T10:04:56.912 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_rd": 2, 2023-09-13T10:04:56.912 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_del": 0 2023-09-13T10:04:56.912 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.913 INFO:teuthology.orchestra.run.smithi006.stdout: "oft": { 2023-09-13T10:04:56.913 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_objs": 0, 2023-09-13T10:04:56.913 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:04:56.913 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_updates": 0, 2023-09-13T10:04:56.913 INFO:teuthology.orchestra.run.smithi006.stdout: "omap_total_removes": 0 2023-09-13T10:04:56.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.914 INFO:teuthology.orchestra.run.smithi006.stdout: "osd-slow-ops": { 2023-09-13T10:04:56.914 INFO:teuthology.orchestra.run.smithi006.stdout: "slow_ops_count": 0 2023-09-13T10:04:56.914 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.914 INFO:teuthology.orchestra.run.smithi006.stdout: "purge_queue": { 2023-09-13T10:04:56.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops": 0, 2023-09-13T10:04:56.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_ops_high_water": 0, 2023-09-13T10:04:56.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing": 0, 2023-09-13T10:04:56.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executing_high_water": 0, 2023-09-13T10:04:56.915 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_executed": 0, 2023-09-13T10:04:56.916 INFO:teuthology.orchestra.run.smithi006.stdout: "pq_item_in_journal": 0 2023-09-13T10:04:56.916 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.916 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:04:56.916 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:56.916 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-09-13T10:04:56.917 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:56.917 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 6409, 2023-09-13T10:04:56.917 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 338458928, 2023-09-13T10:04:56.917 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:56.917 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 6409, 2023-09-13T10:04:56.917 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:56.918 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:56.918 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 6409, 2023-09-13T10:04:56.918 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 338458928, 2023-09-13T10:04:56.918 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:56.918 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.919 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.919 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.919 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.919 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.919 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_bytes": { 2023-09-13T10:04:56.920 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:56.920 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-09-13T10:04:56.920 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:56.920 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:56.920 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:56.920 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:56.921 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:56.921 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 5906, 2023-09-13T10:04:56.921 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 336494713, 2023-09-13T10:04:56.921 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 5906, 2023-09-13T10:04:56.921 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 336494713, 2023-09-13T10:04:56.922 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:56.922 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.922 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.922 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.922 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.923 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.923 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-objecter_ops": { 2023-09-13T10:04:56.923 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:56.923 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 1024, 2023-09-13T10:04:56.923 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:56.924 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:56.924 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:56.924 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:56.924 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:56.924 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 5906, 2023-09-13T10:04:56.924 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 5906, 2023-09-13T10:04:56.925 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 5906, 2023-09-13T10:04:56.925 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 5906, 2023-09-13T10:04:56.925 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:56.925 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.925 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.926 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.926 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.926 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.926 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:04:56.926 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:56.927 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-09-13T10:04:56.927 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:56.927 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:56.927 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:56.927 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:56.927 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:56.928 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:56.928 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:56.928 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-09-13T10:04:56.928 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-09-13T10:04:56.928 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:56.929 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.929 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.929 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.929 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.929 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:56.930 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-write_buf_throttle-0x55843168c960": { 2023-09-13T10:04:56.930 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:56.930 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 3758096384, 2023-09-13T10:04:56.930 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:56.930 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 0, 2023-09-13T10:04:56.930 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 0, 2023-09-13T10:04:56.931 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:56.931 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 0, 2023-09-13T10:04:56.931 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:56.931 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:56.931 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 0, 2023-09-13T10:04:56.932 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 0, 2023-09-13T10:04:56.932 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:56.932 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:56.932 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:56.932 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:56.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.933 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:56.933 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:04:57.217 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2023-09-13T10:04:57.218 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2023-09-13T10:04:57.218 DEBUG:tasks.check_counter:Getting stats from j 2023-09-13T10:04:57.218 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.j perf dump 2023-09-13T10:04:57.786 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.a/config 2023-09-13T10:04:58.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:04:58 smithi006 ceph-mon[98665]: pgmap v1063: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 2.9 MiB/s wr, 111 op/s 2023-09-13T10:04:58.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:04:58 smithi053 ceph-mon[102373]: pgmap v1063: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 2.9 MiB/s wr, 111 op/s 2023-09-13T10:04:58.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:04:58 smithi131 ceph-mon[102785]: pgmap v1063: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 2.9 MiB/s wr, 111 op/s 2023-09-13T10:04:59.169 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2023-09-13T10:04:59.169 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:04:59.170 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 4, 2023-09-13T10:04:59.170 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 4, 2023-09-13T10:04:59.170 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 2944, 2023-09-13T10:04:59.170 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 448, 2023-09-13T10:04:59.171 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-09-13T10:04:59.171 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 0, 2023-09-13T10:04:59.171 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.001899492, 2023-09-13T10:04:59.171 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.000045845, 2023-09-13T10:04:59.172 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.000691593, 2023-09-13T10:04:59.172 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-13T10:04:59.172 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:59.172 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 3, 2023-09-13T10:04:59.173 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000840226, 2023-09-13T10:04:59.173 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000280075 2023-09-13T10:04:59.173 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.173 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:59.174 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:59.174 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:59.174 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:59.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.175 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-09-13T10:04:59.175 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 448 2023-09-13T10:04:59.175 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.176 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:04:59.176 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 437, 2023-09-13T10:04:59.176 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 434, 2023-09-13T10:04:59.176 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 533216, 2023-09-13T10:04:59.177 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 261856, 2023-09-13T10:04:59.177 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 2, 2023-09-13T10:04:59.177 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 1, 2023-09-13T10:04:59.177 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.055711790, 2023-09-13T10:04:59.177 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.022526512, 2023-09-13T10:04:59.178 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.019985913, 2023-09-13T10:04:59.178 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.010154907, 2023-09-13T10:04:59.178 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:59.178 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 433, 2023-09-13T10:04:59.178 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.031146509, 2023-09-13T10:04:59.179 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000071931 2023-09-13T10:04:59.179 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.179 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:59.179 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:59.179 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:59.180 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:59.180 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.180 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 533216, 2023-09-13T10:04:59.180 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 261856 2023-09-13T10:04:59.181 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.181 INFO:teuthology.orchestra.run.smithi006.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:04:59.181 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_messages": 2, 2023-09-13T10:04:59.182 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages": 332, 2023-09-13T10:04:59.182 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_bytes": 320, 2023-09-13T10:04:59.182 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_bytes": 211072, 2023-09-13T10:04:59.182 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_created_connections": 4, 2023-09-13T10:04:59.183 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_active_connections": 2, 2023-09-13T10:04:59.183 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_total_time": 0.021521274, 2023-09-13T10:04:59.183 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_send_time": 0.016293159, 2023-09-13T10:04:59.183 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_recv_time": 0.002181553, 2023-09-13T10:04:59.184 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-09-13T10:04:59.184 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:04:59.184 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 330, 2023-09-13T10:04:59.184 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.038663194, 2023-09-13T10:04:59.185 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000117161 2023-09-13T10:04:59.185 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.185 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:04:59.185 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:59.185 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:59.186 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:59.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.186 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_recv_encrypted_bytes": 320, 2023-09-13T10:04:59.186 INFO:teuthology.orchestra.run.smithi006.stdout: "msgr_send_encrypted_bytes": 211072 2023-09-13T10:04:59.186 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.187 INFO:teuthology.orchestra.run.smithi006.stdout: "cct": { 2023-09-13T10:04:59.187 INFO:teuthology.orchestra.run.smithi006.stdout: "total_workers": 0, 2023-09-13T10:04:59.187 INFO:teuthology.orchestra.run.smithi006.stdout: "unhealthy_workers": 0 2023-09-13T10:04:59.187 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.187 INFO:teuthology.orchestra.run.smithi006.stdout: "mempool": { 2023-09-13T10:04:59.188 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:04:59.188 INFO:teuthology.orchestra.run.smithi006.stdout: "bloom_filter_items": 0, 2023-09-13T10:04:59.188 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:04:59.188 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:04:59.188 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:04:59.189 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:04:59.189 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:04:59.189 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:04:59.189 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:04:59.189 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:04:59.189 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:04:59.190 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:04:59.190 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:04:59.190 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:04:59.190 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:04:59.191 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_extent_items": 0, 2023-09-13T10:04:59.191 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:04:59.191 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_blob_items": 0, 2023-09-13T10:04:59.191 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:04:59.191 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:04:59.192 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:04:59.192 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:04:59.192 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:04:59.192 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:04:59.192 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:04:59.193 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_txc_items": 0, 2023-09-13T10:04:59.193 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:04:59.193 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:04:59.193 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:04:59.193 INFO:teuthology.orchestra.run.smithi006.stdout: "bluestore_writing_items": 0, 2023-09-13T10:04:59.194 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_bytes": 0, 2023-09-13T10:04:59.194 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_items": 0, 2023-09-13T10:04:59.194 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:04:59.194 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:04:59.194 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:04:59.195 INFO:teuthology.orchestra.run.smithi006.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:04:59.195 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_bytes": 148704, 2023-09-13T10:04:59.195 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_anon_items": 29, 2023-09-13T10:04:59.195 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_bytes": 0, 2023-09-13T10:04:59.195 INFO:teuthology.orchestra.run.smithi006.stdout: "buffer_meta_items": 0, 2023-09-13T10:04:59.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_bytes": 0, 2023-09-13T10:04:59.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_items": 0, 2023-09-13T10:04:59.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:04:59.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_mapbl_items": 0, 2023-09-13T10:04:59.196 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:04:59.197 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_pglog_items": 0, 2023-09-13T10:04:59.197 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_bytes": 0, 2023-09-13T10:04:59.197 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_items": 0, 2023-09-13T10:04:59.197 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:04:59.198 INFO:teuthology.orchestra.run.smithi006.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:04:59.198 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_bytes": 0, 2023-09-13T10:04:59.198 INFO:teuthology.orchestra.run.smithi006.stdout: "pgmap_items": 0, 2023-09-13T10:04:59.198 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_bytes": 928, 2023-09-13T10:04:59.198 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_co_items": 2, 2023-09-13T10:04:59.199 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_bytes": 0, 2023-09-13T10:04:59.199 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_1_items": 0, 2023-09-13T10:04:59.199 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_bytes": 0, 2023-09-13T10:04:59.199 INFO:teuthology.orchestra.run.smithi006.stdout: "unittest_2_items": 0 2023-09-13T10:04:59.200 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2023-09-13T10:04:59.200 INFO:teuthology.orchestra.run.smithi006.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:04:59.200 INFO:teuthology.orchestra.run.smithi006.stdout: "val": 0, 2023-09-13T10:04:59.201 INFO:teuthology.orchestra.run.smithi006.stdout: "max": 104857600, 2023-09-13T10:04:59.201 INFO:teuthology.orchestra.run.smithi006.stdout: "get_started": 0, 2023-09-13T10:04:59.201 INFO:teuthology.orchestra.run.smithi006.stdout: "get": 439, 2023-09-13T10:04:59.201 INFO:teuthology.orchestra.run.smithi006.stdout: "get_sum": 471424, 2023-09-13T10:04:59.202 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_fail": 0, 2023-09-13T10:04:59.202 INFO:teuthology.orchestra.run.smithi006.stdout: "get_or_fail_success": 439, 2023-09-13T10:04:59.202 INFO:teuthology.orchestra.run.smithi006.stdout: "take": 0, 2023-09-13T10:04:59.203 INFO:teuthology.orchestra.run.smithi006.stdout: "take_sum": 0, 2023-09-13T10:04:59.203 INFO:teuthology.orchestra.run.smithi006.stdout: "put": 439, 2023-09-13T10:04:59.203 INFO:teuthology.orchestra.run.smithi006.stdout: "put_sum": 471424, 2023-09-13T10:04:59.203 INFO:teuthology.orchestra.run.smithi006.stdout: "wait": { 2023-09-13T10:04:59.203 INFO:teuthology.orchestra.run.smithi006.stdout: "avgcount": 0, 2023-09-13T10:04:59.204 INFO:teuthology.orchestra.run.smithi006.stdout: "sum": 0.000000000, 2023-09-13T10:04:59.204 INFO:teuthology.orchestra.run.smithi006.stdout: "avgtime": 0.000000000 2023-09-13T10:04:59.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:59.204 INFO:teuthology.orchestra.run.smithi006.stdout: } 2023-09-13T10:04:59.204 INFO:teuthology.orchestra.run.smithi006.stdout:} 2023-09-13T10:04:59.564 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-09-13T10:04:59.565 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-09-13T10:04:59.565 DEBUG:tasks.check_counter:Getting stats from b 2023-09-13T10:04:59.565 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.b perf dump 2023-09-13T10:05:00.289 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T10:05:00.505 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:00 smithi053 ceph-mon[102373]: pgmap v1064: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 6.0 MiB/s wr, 122 op/s 2023-09-13T10:05:00.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:00 smithi006 ceph-mon[98665]: pgmap v1064: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 6.0 MiB/s wr, 122 op/s 2023-09-13T10:05:00.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:00 smithi131 ceph-mon[102785]: pgmap v1064: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 233 KiB/s rd, 6.0 MiB/s wr, 122 op/s 2023-09-13T10:05:01.708 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-13T10:05:01.709 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:01.709 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 121323, 2023-09-13T10:05:01.709 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 123825, 2023-09-13T10:05:01.709 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 30406761, 2023-09-13T10:05:01.709 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 200489015, 2023-09-13T10:05:01.710 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 212, 2023-09-13T10:05:01.710 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 4, 2023-09-13T10:05:01.710 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 9.297852061, 2023-09-13T10:05:01.710 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 3.220812923, 2023-09-13T10:05:01.710 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 4.500752200, 2023-09-13T10:05:01.711 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.933680648, 2023-09-13T10:05:01.711 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:01.711 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 123824, 2023-09-13T10:05:01.711 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 29.352306891, 2023-09-13T10:05:01.712 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000237048 2023-09-13T10:05:01.712 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.712 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:01.712 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 156325, 2023-09-13T10:05:01.712 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.034558358, 2023-09-13T10:05:01.713 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000221 2023-09-13T10:05:01.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.713 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 6320, 2023-09-13T10:05:01.713 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 345968 2023-09-13T10:05:01.713 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.714 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:01.714 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 233852, 2023-09-13T10:05:01.714 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 242977, 2023-09-13T10:05:01.715 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 65299115, 2023-09-13T10:05:01.715 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 210486473, 2023-09-13T10:05:01.715 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 8, 2023-09-13T10:05:01.715 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:01.716 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 17.319310974, 2023-09-13T10:05:01.716 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 7.265415089, 2023-09-13T10:05:01.716 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 9.636025876, 2023-09-13T10:05:01.716 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.958510088, 2023-09-13T10:05:01.716 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:01.717 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 242982, 2023-09-13T10:05:01.717 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 35.699840950, 2023-09-13T10:05:01.717 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000146923 2023-09-13T10:05:01.717 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.718 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:01.718 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 380356, 2023-09-13T10:05:01.718 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.070423341, 2023-09-13T10:05:01.718 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000185 2023-09-13T10:05:01.718 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.719 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 981216, 2023-09-13T10:05:01.719 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 321696 2023-09-13T10:05:01.719 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.719 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 478084, 2023-09-13T10:05:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 735333, 2023-09-13T10:05:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 156503713, 2023-09-13T10:05:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 581688635, 2023-09-13T10:05:01.720 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 152, 2023-09-13T10:05:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 11, 2023-09-13T10:05:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 36.826533808, 2023-09-13T10:05:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 16.379127261, 2023-09-13T10:05:01.721 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 28.374076640, 2023-09-13T10:05:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.108601877, 2023-09-13T10:05:01.722 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:01.723 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 735325, 2023-09-13T10:05:01.723 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 193.044254232, 2023-09-13T10:05:01.723 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000262529 2023-09-13T10:05:01.723 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.723 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:01.724 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 987388, 2023-09-13T10:05:01.724 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.216079449, 2023-09-13T10:05:01.724 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000218 2023-09-13T10:05:01.724 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.724 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 131841216, 2023-09-13T10:05:01.725 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 485069024 2023-09-13T10:05:01.725 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.725 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2023-09-13T10:05:01.725 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 1, 2023-09-13T10:05:01.725 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2023-09-13T10:05:01.726 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.726 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-MDSRank": { 2023-09-13T10:05:01.726 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:01.726 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:01.727 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 107938, 2023-09-13T10:05:01.727 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 236.349259477, 2023-09-13T10:05:01.727 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.002189676 2023-09-13T10:05:01.727 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.727 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.728 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:01.728 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:01.728 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:01.729 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 71558, 2023-09-13T10:05:01.729 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 22.828053202, 2023-09-13T10:05:01.729 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000319014 2023-09-13T10:05:01.729 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.729 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.730 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2023-09-13T10:05:01.730 INFO:teuthology.orchestra.run.smithi053.stdout: "request": 286093, 2023-09-13T10:05:01.730 INFO:teuthology.orchestra.run.smithi053.stdout: "reply": 266524, 2023-09-13T10:05:01.730 INFO:teuthology.orchestra.run.smithi053.stdout: "reply_latency": { 2023-09-13T10:05:01.730 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 266524, 2023-09-13T10:05:01.731 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 1983.238209494, 2023-09-13T10:05:01.731 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.007441124 2023-09-13T10:05:01.732 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.732 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_reply": 0, 2023-09-13T10:05:01.732 INFO:teuthology.orchestra.run.smithi053.stdout: "forward": 19569, 2023-09-13T10:05:01.732 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_complete": 0, 2023-09-13T10:05:01.733 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:01.733 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_commit": 174, 2023-09-13T10:05:01.733 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_split": 14, 2023-09-13T10:05:01.733 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_merge": 15, 2023-09-13T10:05:01.733 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes": 1928, 2023-09-13T10:05:01.734 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_top": 1108, 2023-09-13T10:05:01.734 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_bottom": 553, 2023-09-13T10:05:01.734 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pin_tail": 267, 2023-09-13T10:05:01.734 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pinned": 345, 2023-09-13T10:05:01.735 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_expired": 496, 2023-09-13T10:05:01.735 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_with_caps": 8, 2023-09-13T10:05:01.735 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": 8, 2023-09-13T10:05:01.735 INFO:teuthology.orchestra.run.smithi053.stdout: "subtrees": 6, 2023-09-13T10:05:01.735 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse": 448079, 2023-09-13T10:05:01.736 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_hit": 268403, 2023-09-13T10:05:01.736 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_forward": 19564, 2023-09-13T10:05:01.736 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_discover": 51, 2023-09-13T10:05:01.736 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:01.737 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:01.737 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_lock": 2961, 2023-09-13T10:05:01.737 INFO:teuthology.orchestra.run.smithi053.stdout: "load_cent": 7329, 2023-09-13T10:05:01.738 INFO:teuthology.orchestra.run.smithi053.stdout: "q": 2, 2023-09-13T10:05:01.738 INFO:teuthology.orchestra.run.smithi053.stdout: "exported": 12, 2023-09-13T10:05:01.738 INFO:teuthology.orchestra.run.smithi053.stdout: "exported_inodes": 211, 2023-09-13T10:05:01.738 INFO:teuthology.orchestra.run.smithi053.stdout: "imported": 12, 2023-09-13T10:05:01.738 INFO:teuthology.orchestra.run.smithi053.stdout: "imported_inodes": 355, 2023-09-13T10:05:01.739 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:01.739 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_backtrace_fetch": 4351, 2023-09-13T10:05:01.739 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_peer_discover": 0, 2023-09-13T10:05:01.739 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rfiles": 4, 2023-09-13T10:05:01.740 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rbytes": 246, 2023-09-13T10:05:01.740 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rsnaps": 0, 2023-09-13T10:05:01.740 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_fetch": 4351, 2023-09-13T10:05:01.740 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:01.741 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:01.741 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:01.741 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_inodes": 835, 2023-09-13T10:05:01.741 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_base_inodes": 42, 2023-09-13T10:05:01.742 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dirfrag_rstats": 793, 2023-09-13T10:05:01.742 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_file_inodes": 3516, 2023-09-13T10:05:01.742 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_inode_file_caps": 31, 2023-09-13T10:05:01.742 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_revoke": 29332, 2023-09-13T10:05:01.742 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_grant": 176641, 2023-09-13T10:05:01.743 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:01.743 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:01.743 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:01.743 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps": 71259, 2023-09-13T10:05:01.743 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps_dirty": 27962, 2023-09-13T10:05:01.744 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_cap_release": 6595, 2023-09-13T10:05:01.744 INFO:teuthology.orchestra.run.smithi053.stdout: "process_request_cap_release": 164793 2023-09-13T10:05:01.744 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.744 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache": { 2023-09-13T10:05:01.744 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update": 125, 2023-09-13T10:05:01.745 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update_receipt": 266, 2023-09-13T10:05:01.745 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_try_discover": 149, 2023-09-13T10:05:01.745 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_send_discover": 279, 2023-09-13T10:05:01.745 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_handle_discover": 230, 2023-09-13T10:05:01.746 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays": 7, 2023-09-13T10:05:01.746 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:01.746 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:01.746 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_created": 41748, 2023-09-13T10:05:01.746 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_enqueued": 41741, 2023-09-13T10:05:01.747 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:01.747 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_migrated": 0, 2023-09-13T10:05:01.747 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:01.748 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:01.748 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:01.748 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_started": 0, 2023-09-13T10:05:01.748 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_completed": 0, 2023-09-13T10:05:01.748 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_enqueue_scrub": 42, 2023-09-13T10:05:01.749 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_exportdir": 12, 2023-09-13T10:05:01.749 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_flush": 0, 2023-09-13T10:05:01.749 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragmentdir": 29, 2023-09-13T10:05:01.749 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:01.749 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_inodestats": 0 2023-09-13T10:05:01.750 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.750 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log": { 2023-09-13T10:05:01.750 INFO:teuthology.orchestra.run.smithi053.stdout: "evlrg": 0, 2023-09-13T10:05:01.750 INFO:teuthology.orchestra.run.smithi053.stdout: "evadd": 192616, 2023-09-13T10:05:01.750 INFO:teuthology.orchestra.run.smithi053.stdout: "evex": 87335, 2023-09-13T10:05:01.751 INFO:teuthology.orchestra.run.smithi053.stdout: "evtrm": 86031, 2023-09-13T10:05:01.751 INFO:teuthology.orchestra.run.smithi053.stdout: "ev": 106585, 2023-09-13T10:05:01.751 INFO:teuthology.orchestra.run.smithi053.stdout: "evexg": 0, 2023-09-13T10:05:01.751 INFO:teuthology.orchestra.run.smithi053.stdout: "evexd": 1304, 2023-09-13T10:05:01.751 INFO:teuthology.orchestra.run.smithi053.stdout: "segadd": 233, 2023-09-13T10:05:01.751 INFO:teuthology.orchestra.run.smithi053.stdout: "segex": 104, 2023-09-13T10:05:01.752 INFO:teuthology.orchestra.run.smithi053.stdout: "segtrm": 102, 2023-09-13T10:05:01.752 INFO:teuthology.orchestra.run.smithi053.stdout: "seg": 131, 2023-09-13T10:05:01.752 INFO:teuthology.orchestra.run.smithi053.stdout: "segmjr": 9, 2023-09-13T10:05:01.752 INFO:teuthology.orchestra.run.smithi053.stdout: "segexg": 0, 2023-09-13T10:05:01.752 INFO:teuthology.orchestra.run.smithi053.stdout: "segexd": 2, 2023-09-13T10:05:01.753 INFO:teuthology.orchestra.run.smithi053.stdout: "expos": 156674203, 2023-09-13T10:05:01.753 INFO:teuthology.orchestra.run.smithi053.stdout: "wrpos": 379194888, 2023-09-13T10:05:01.753 INFO:teuthology.orchestra.run.smithi053.stdout: "rdpos": 0, 2023-09-13T10:05:01.753 INFO:teuthology.orchestra.run.smithi053.stdout: "jlat": { 2023-09-13T10:05:01.753 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 61550, 2023-09-13T10:05:01.754 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 671.652457326, 2023-09-13T10:05:01.754 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.010912306 2023-09-13T10:05:01.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.754 INFO:teuthology.orchestra.run.smithi053.stdout: "replayed": 0 2023-09-13T10:05:01.754 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.754 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mem": { 2023-09-13T10:05:01.755 INFO:teuthology.orchestra.run.smithi053.stdout: "ino": 293, 2023-09-13T10:05:01.755 INFO:teuthology.orchestra.run.smithi053.stdout: "ino+": 42045, 2023-09-13T10:05:01.755 INFO:teuthology.orchestra.run.smithi053.stdout: "ino-": 41752, 2023-09-13T10:05:01.755 INFO:teuthology.orchestra.run.smithi053.stdout: "dir": 41, 2023-09-13T10:05:01.755 INFO:teuthology.orchestra.run.smithi053.stdout: "dir+": 370, 2023-09-13T10:05:01.756 INFO:teuthology.orchestra.run.smithi053.stdout: "dir-": 329, 2023-09-13T10:05:01.756 INFO:teuthology.orchestra.run.smithi053.stdout: "dn": 1940, 2023-09-13T10:05:01.756 INFO:teuthology.orchestra.run.smithi053.stdout: "dn+": 77397, 2023-09-13T10:05:01.756 INFO:teuthology.orchestra.run.smithi053.stdout: "dn-": 75457, 2023-09-13T10:05:01.756 INFO:teuthology.orchestra.run.smithi053.stdout: "cap": 2, 2023-09-13T10:05:01.757 INFO:teuthology.orchestra.run.smithi053.stdout: "cap+": 44734, 2023-09-13T10:05:01.757 INFO:teuthology.orchestra.run.smithi053.stdout: "cap-": 44732, 2023-09-13T10:05:01.757 INFO:teuthology.orchestra.run.smithi053.stdout: "rss": 93284, 2023-09-13T10:05:01.757 INFO:teuthology.orchestra.run.smithi053.stdout: "heap": 207152 2023-09-13T10:05:01.757 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.758 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_server": { 2023-09-13T10:05:01.758 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_client_request": 449405, 2023-09-13T10:05:01.758 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_server_request": 7896, 2023-09-13T10:05:01.758 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_request": 286093, 2023-09-13T10:05:01.758 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_session": 4940, 2023-09-13T10:05:01.759 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_peer_request": 48001, 2023-09-13T10:05:01.759 INFO:teuthology.orchestra.run.smithi053.stdout: "req_create_latency": { 2023-09-13T10:05:01.759 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 41578, 2023-09-13T10:05:01.759 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 206.572232370, 2023-09-13T10:05:01.759 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.004968306 2023-09-13T10:05:01.760 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.760 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getattr_latency": { 2023-09-13T10:05:01.760 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 36516, 2023-09-13T10:05:01.760 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 699.887612641, 2023-09-13T10:05:01.760 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.019166601 2023-09-13T10:05:01.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.761 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:01.761 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.761 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.761 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.761 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.762 INFO:teuthology.orchestra.run.smithi053.stdout: "req_link_latency": { 2023-09-13T10:05:01.762 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.762 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.762 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.762 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.763 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookup_latency": { 2023-09-13T10:05:01.763 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 71207, 2023-09-13T10:05:01.763 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 219.127725955, 2023-09-13T10:05:01.763 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.003077334 2023-09-13T10:05:01.763 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.764 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:01.764 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.764 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.764 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.764 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.765 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupino_latency": { 2023-09-13T10:05:01.765 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1, 2023-09-13T10:05:01.765 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000426739, 2023-09-13T10:05:01.765 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000426739 2023-09-13T10:05:01.765 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.765 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupname_latency": { 2023-09-13T10:05:01.766 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.766 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.766 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.766 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.766 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:01.767 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.767 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.767 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.767 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.767 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:01.768 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.768 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.768 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.768 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.768 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lssnap_latency": { 2023-09-13T10:05:01.769 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.769 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.769 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.769 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.769 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mkdir_latency": { 2023-09-13T10:05:01.769 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 7, 2023-09-13T10:05:01.770 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.016892938, 2023-09-13T10:05:01.770 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.002413276 2023-09-13T10:05:01.770 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.770 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mknod_latency": { 2023-09-13T10:05:01.770 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.771 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.771 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.771 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.771 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mksnap_latency": { 2023-09-13T10:05:01.771 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.772 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.772 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.772 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.772 INFO:teuthology.orchestra.run.smithi053.stdout: "req_open_latency": { 2023-09-13T10:05:01.772 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.772 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.773 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.773 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.773 INFO:teuthology.orchestra.run.smithi053.stdout: "req_readdir_latency": { 2023-09-13T10:05:01.773 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 66504, 2023-09-13T10:05:01.773 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 634.505842078, 2023-09-13T10:05:01.774 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.009540867 2023-09-13T10:05:01.774 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.774 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rename_latency": { 2023-09-13T10:05:01.774 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 7636, 2023-09-13T10:05:01.774 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 44.394484938, 2023-09-13T10:05:01.775 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.005813840 2023-09-13T10:05:01.775 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.775 INFO:teuthology.orchestra.run.smithi053.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:01.775 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.775 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.775 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.776 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.776 INFO:teuthology.orchestra.run.smithi053.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:01.776 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.776 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.776 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.777 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmdir_latency": { 2023-09-13T10:05:01.777 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 30, 2023-09-13T10:05:01.777 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.371951836, 2023-09-13T10:05:01.777 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.012398394 2023-09-13T10:05:01.777 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.778 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:01.778 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.778 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.778 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.778 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.779 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:01.779 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.782 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.782 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.782 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.782 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setattr_latency": { 2023-09-13T10:05:01.782 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 53, 2023-09-13T10:05:01.783 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 1.538519252, 2023-09-13T10:05:01.783 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.029028665 2023-09-13T10:05:01.783 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.783 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:01.783 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.784 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.784 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.784 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.784 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:01.784 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1268, 2023-09-13T10:05:01.785 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 4.439548586, 2023-09-13T10:05:01.785 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.003501221 2023-09-13T10:05:01.785 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.785 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setlayout_latency": { 2023-09-13T10:05:01.785 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.786 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.786 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.786 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.786 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setxattr_latency": { 2023-09-13T10:05:01.786 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 6, 2023-09-13T10:05:01.786 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.021728563, 2023-09-13T10:05:01.787 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.003621427 2023-09-13T10:05:01.787 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.787 INFO:teuthology.orchestra.run.smithi053.stdout: "req_symlink_latency": { 2023-09-13T10:05:01.787 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.787 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.788 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.789 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.789 INFO:teuthology.orchestra.run.smithi053.stdout: "req_unlink_latency": { 2023-09-13T10:05:01.789 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 41718, 2023-09-13T10:05:01.789 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 172.361243598, 2023-09-13T10:05:01.790 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.004131579 2023-09-13T10:05:01.790 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.790 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:01.790 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:01.790 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:01.791 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.791 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.791 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.791 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.791 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.792 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessions": { 2023-09-13T10:05:01.792 INFO:teuthology.orchestra.run.smithi053.stdout: "session_count": 1, 2023-09-13T10:05:01.792 INFO:teuthology.orchestra.run.smithi053.stdout: "session_add": 2, 2023-09-13T10:05:01.792 INFO:teuthology.orchestra.run.smithi053.stdout: "session_remove": 1, 2023-09-13T10:05:01.792 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_open": 1, 2023-09-13T10:05:01.792 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_stale": 0, 2023-09-13T10:05:01.793 INFO:teuthology.orchestra.run.smithi053.stdout: "total_load": 22146, 2023-09-13T10:05:01.793 INFO:teuthology.orchestra.run.smithi053.stdout: "average_load": 22146, 2023-09-13T10:05:01.793 INFO:teuthology.orchestra.run.smithi053.stdout: "avg_session_uptime": 1527, 2023-09-13T10:05:01.793 INFO:teuthology.orchestra.run.smithi053.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:01.793 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.794 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2023-09-13T10:05:01.794 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:01.794 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:01.794 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:01.794 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:01.795 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:01.795 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:01.795 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:01.795 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:01.795 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:01.795 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:01.796 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:01.796 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:01.796 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:01.796 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:01.796 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:01.797 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:01.797 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:01.797 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:01.797 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:01.798 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:01.798 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:01.798 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:01.798 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:01.798 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:01.799 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:01.799 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:01.799 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:01.799 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:01.799 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:01.800 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:01.800 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:01.800 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2023-09-13T10:05:01.800 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:01.800 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:01.800 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:01.801 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:01.801 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 3293869, 2023-09-13T10:05:01.801 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 1125, 2023-09-13T10:05:01.801 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 352, 2023-09-13T10:05:01.801 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 4, 2023-09-13T10:05:01.802 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2023-09-13T10:05:01.802 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2023-09-13T10:05:01.802 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:01.802 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:01.802 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:01.803 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:01.803 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:01.803 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 165, 2023-09-13T10:05:01.803 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:01.803 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:01.803 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:01.804 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2023-09-13T10:05:01.804 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 2769473, 2023-09-13T10:05:01.804 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 88873, 2023-09-13T10:05:01.804 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:01.804 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2023-09-13T10:05:01.805 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:01.805 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2023-09-13T10:05:01.805 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.805 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter": { 2023-09-13T10:05:01.805 INFO:teuthology.orchestra.run.smithi053.stdout: "op_active": 0, 2023-09-13T10:05:01.806 INFO:teuthology.orchestra.run.smithi053.stdout: "op_laggy": 0, 2023-09-13T10:05:01.806 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send": 112954, 2023-09-13T10:05:01.806 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send_bytes": 383242548, 2023-09-13T10:05:01.806 INFO:teuthology.orchestra.run.smithi053.stdout: "op_resend": 31, 2023-09-13T10:05:01.806 INFO:teuthology.orchestra.run.smithi053.stdout: "op_reply": 112954, 2023-09-13T10:05:01.807 INFO:teuthology.orchestra.run.smithi053.stdout: "op_latency": { 2023-09-13T10:05:01.807 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 112954, 2023-09-13T10:05:01.807 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 1050.155005768, 2023-09-13T10:05:01.807 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.009297191 2023-09-13T10:05:01.807 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.807 INFO:teuthology.orchestra.run.smithi053.stdout: "op_inflight": 0, 2023-09-13T10:05:01.808 INFO:teuthology.orchestra.run.smithi053.stdout: "oplen_avg": { 2023-09-13T10:05:01.808 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 112954, 2023-09-13T10:05:01.808 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 114131 2023-09-13T10:05:01.808 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.808 INFO:teuthology.orchestra.run.smithi053.stdout: "op": 112954, 2023-09-13T10:05:01.809 INFO:teuthology.orchestra.run.smithi053.stdout: "op_r": 5935, 2023-09-13T10:05:01.809 INFO:teuthology.orchestra.run.smithi053.stdout: "op_w": 107019, 2023-09-13T10:05:01.809 INFO:teuthology.orchestra.run.smithi053.stdout: "op_rmw": 0, 2023-09-13T10:05:01.809 INFO:teuthology.orchestra.run.smithi053.stdout: "op_pg": 0, 2023-09-13T10:05:01.809 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_stat": 0, 2023-09-13T10:05:01.810 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_create": 206, 2023-09-13T10:05:01.810 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_read": 1542, 2023-09-13T10:05:01.810 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_write": 63050, 2023-09-13T10:05:01.810 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writefull": 789, 2023-09-13T10:05:01.810 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writesame": 0, 2023-09-13T10:05:01.811 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_append": 0, 2023-09-13T10:05:01.811 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_zero": 0, 2023-09-13T10:05:01.811 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_truncate": 14, 2023-09-13T10:05:01.811 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_delete": 42493, 2023-09-13T10:05:01.811 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_mapext": 0, 2023-09-13T10:05:01.811 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:01.812 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:01.812 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_getxattr": 4393, 2023-09-13T10:05:01.812 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_setxattr": 412, 2023-09-13T10:05:01.812 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:01.812 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:01.813 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:01.813 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_call": 0, 2023-09-13T10:05:01.813 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_watch": 0, 2023-09-13T10:05:01.813 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_notify": 0, 2023-09-13T10:05:01.813 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:01.814 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls": 0, 2023-09-13T10:05:01.814 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:01.814 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_other": 0, 2023-09-13T10:05:01.814 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_active": 0, 2023-09-13T10:05:01.814 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_send": 0, 2023-09-13T10:05:01.815 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_resend": 0, 2023-09-13T10:05:01.815 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_ping": 0, 2023-09-13T10:05:01.815 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_active": 0, 2023-09-13T10:05:01.815 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_send": 0, 2023-09-13T10:05:01.815 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_resend": 0, 2023-09-13T10:05:01.815 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_active": 0, 2023-09-13T10:05:01.816 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_send": 0, 2023-09-13T10:05:01.816 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_resend": 0, 2023-09-13T10:05:01.816 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_active": 0, 2023-09-13T10:05:01.816 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_send": 0, 2023-09-13T10:05:01.816 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_resend": 0, 2023-09-13T10:05:01.817 INFO:teuthology.orchestra.run.smithi053.stdout: "command_active": 0, 2023-09-13T10:05:01.817 INFO:teuthology.orchestra.run.smithi053.stdout: "command_send": 0, 2023-09-13T10:05:01.817 INFO:teuthology.orchestra.run.smithi053.stdout: "command_resend": 0, 2023-09-13T10:05:01.817 INFO:teuthology.orchestra.run.smithi053.stdout: "map_epoch": 88, 2023-09-13T10:05:01.817 INFO:teuthology.orchestra.run.smithi053.stdout: "map_full": 0, 2023-09-13T10:05:01.818 INFO:teuthology.orchestra.run.smithi053.stdout: "map_inc": 5, 2023-09-13T10:05:01.818 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_sessions": 12, 2023-09-13T10:05:01.818 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_open": 12, 2023-09-13T10:05:01.818 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_close": 0, 2023-09-13T10:05:01.818 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_laggy": 0, 2023-09-13T10:05:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_wr": 911, 2023-09-13T10:05:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_rd": 0, 2023-09-13T10:05:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_del": 321 2023-09-13T10:05:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "oft": { 2023-09-13T10:05:01.819 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_objs": 1, 2023-09-13T10:05:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_updates": 0, 2023-09-13T10:05:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_removes": 0 2023-09-13T10:05:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.820 INFO:teuthology.orchestra.run.smithi053.stdout: "osd-slow-ops": { 2023-09-13T10:05:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_ops_count": 0 2023-09-13T10:05:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "purge_queue": { 2023-09-13T10:05:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:01.821 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops_high_water": 6, 2023-09-13T10:05:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing": 0, 2023-09-13T10:05:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_high_water": 6, 2023-09-13T10:05:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed": 41741, 2023-09-13T10:05:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:01.822 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:01.823 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 833255, 2023-09-13T10:05:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 159700072, 2023-09-13T10:05:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 833255, 2023-09-13T10:05:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:01.824 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 833255, 2023-09-13T10:05:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 159700072, 2023-09-13T10:05:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.825 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.826 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.826 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.826 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:01.826 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:01.826 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:01.827 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:01.827 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:01.827 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:01.827 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:01.827 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:01.828 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 112954, 2023-09-13T10:05:01.828 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 387458389, 2023-09-13T10:05:01.828 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 112954, 2023-09-13T10:05:01.828 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 387458389, 2023-09-13T10:05:01.828 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:01.829 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.829 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.829 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.829 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.829 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.829 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:01.830 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:01.830 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 1024, 2023-09-13T10:05:01.830 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:01.830 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:01.830 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:01.831 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:01.831 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:01.831 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 112954, 2023-09-13T10:05:01.831 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 112954, 2023-09-13T10:05:01.831 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 112954, 2023-09-13T10:05:01.832 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 112954, 2023-09-13T10:05:01.832 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:01.832 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.832 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.832 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.832 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.833 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.833 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:01.833 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:01.833 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:01.833 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:01.834 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 41741, 2023-09-13T10:05:01.834 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 4215841, 2023-09-13T10:05:01.834 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:01.834 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 41741, 2023-09-13T10:05:01.834 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:01.834 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:01.835 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 1500, 2023-09-13T10:05:01.835 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 4215841, 2023-09-13T10:05:01.835 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:01.835 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.835 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.836 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.836 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.836 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:01.836 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle-0x56261d726640": { 2023-09-13T10:05:01.836 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 148001, 2023-09-13T10:05:01.837 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:01.837 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:01.837 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 192616, 2023-09-13T10:05:01.837 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 375000584, 2023-09-13T10:05:01.837 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:01.838 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 192616, 2023-09-13T10:05:01.838 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:01.838 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:01.838 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 61550, 2023-09-13T10:05:01.838 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 374852583, 2023-09-13T10:05:01.838 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:01.839 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:01.839 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:01.839 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:01.839 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.839 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:01.840 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-13T10:05:02.084 INFO:tasks.check_counter:Daemon mds.b mds.exported=12 2023-09-13T10:05:02.085 INFO:tasks.check_counter:Daemon mds.b mds.imported=12 2023-09-13T10:05:02.085 DEBUG:tasks.check_counter:Getting stats from e 2023-09-13T10:05:02.085 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.e perf dump 2023-09-13T10:05:02.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:02 smithi006 ceph-mon[98665]: pgmap v1065: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 8.6 MiB/s wr, 166 op/s 2023-09-13T10:05:02.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:02 smithi053 ceph-mon[102373]: pgmap v1065: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 8.6 MiB/s wr, 166 op/s 2023-09-13T10:05:02.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:02 smithi131 ceph-mon[102785]: pgmap v1065: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 170 KiB/s rd, 8.6 MiB/s wr, 166 op/s 2023-09-13T10:05:02.655 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T10:05:03.861 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-13T10:05:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 129180, 2023-09-13T10:05:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 127709, 2023-09-13T10:05:03.862 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 35678561, 2023-09-13T10:05:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 138473298, 2023-09-13T10:05:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 11, 2023-09-13T10:05:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 9.461158850, 2023-09-13T10:05:03.863 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 3.634306561, 2023-09-13T10:05:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 5.052274458, 2023-09-13T10:05:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.457126338, 2023-09-13T10:05:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 127707, 2023-09-13T10:05:03.864 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 28.265009507, 2023-09-13T10:05:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000221327 2023-09-13T10:05:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 185183, 2023-09-13T10:05:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.039495065, 2023-09-13T10:05:03.865 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000213 2023-09-13T10:05:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-13T10:05:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 0 2023-09-13T10:05:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.866 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 365236, 2023-09-13T10:05:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 563776, 2023-09-13T10:05:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 119906896, 2023-09-13T10:05:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 533231747, 2023-09-13T10:05:03.867 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 15, 2023-09-13T10:05:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 29.494997742, 2023-09-13T10:05:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 12.935938696, 2023-09-13T10:05:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 24.216496696, 2023-09-13T10:05:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.260496648, 2023-09-13T10:05:03.868 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 563774, 2023-09-13T10:05:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 166.780392085, 2023-09-13T10:05:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000295828 2023-09-13T10:05:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.869 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 743001, 2023-09-13T10:05:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.182102073, 2023-09-13T10:05:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000245 2023-09-13T10:05:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.870 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 97868576, 2023-09-13T10:05:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 411690032 2023-09-13T10:05:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 185853, 2023-09-13T10:05:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 155242, 2023-09-13T10:05:03.871 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 47619291, 2023-09-13T10:05:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 176415641, 2023-09-13T10:05:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 92, 2023-09-13T10:05:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 9, 2023-09-13T10:05:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 13.499080601, 2023-09-13T10:05:03.872 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 5.445709132, 2023-09-13T10:05:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 7.692905412, 2023-09-13T10:05:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.733503707, 2023-09-13T10:05:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 155242, 2023-09-13T10:05:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 25.096424873, 2023-09-13T10:05:03.873 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000161660 2023-09-13T10:05:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 267108, 2023-09-13T10:05:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.054454001, 2023-09-13T10:05:03.874 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000203 2023-09-13T10:05:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 964816, 2023-09-13T10:05:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 310880 2023-09-13T10:05:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2023-09-13T10:05:03.875 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 1, 2023-09-13T10:05:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2023-09-13T10:05:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-MDSRank": { 2023-09-13T10:05:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:03.876 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 93871, 2023-09-13T10:05:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 180.368294955, 2023-09-13T10:05:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.001921448 2023-09-13T10:05:03.877 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:03.878 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 62240, 2023-09-13T10:05:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 16.375366316, 2023-09-13T10:05:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000263100 2023-09-13T10:05:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.879 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2023-09-13T10:05:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "request": 206571, 2023-09-13T10:05:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "reply": 204531, 2023-09-13T10:05:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "reply_latency": { 2023-09-13T10:05:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 204531, 2023-09-13T10:05:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 964.748747210, 2023-09-13T10:05:03.880 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.004716882 2023-09-13T10:05:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_reply": 0, 2023-09-13T10:05:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "forward": 2040, 2023-09-13T10:05:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_complete": 2, 2023-09-13T10:05:03.881 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_commit": 119, 2023-09-13T10:05:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_split": 9, 2023-09-13T10:05:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_merge": 14, 2023-09-13T10:05:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes": 1417, 2023-09-13T10:05:03.882 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_top": 730, 2023-09-13T10:05:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_bottom": 332, 2023-09-13T10:05:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pin_tail": 355, 2023-09-13T10:05:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pinned": 371, 2023-09-13T10:05:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_expired": 364, 2023-09-13T10:05:03.883 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_with_caps": 2, 2023-09-13T10:05:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": 2, 2023-09-13T10:05:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "subtrees": 6, 2023-09-13T10:05:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse": 333893, 2023-09-13T10:05:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_hit": 184511, 2023-09-13T10:05:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_forward": 2033, 2023-09-13T10:05:03.884 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_discover": 53, 2023-09-13T10:05:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_lock": 3859, 2023-09-13T10:05:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "load_cent": 3773, 2023-09-13T10:05:03.885 INFO:teuthology.orchestra.run.smithi053.stdout: "q": 0, 2023-09-13T10:05:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "exported": 14, 2023-09-13T10:05:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "exported_inodes": 182, 2023-09-13T10:05:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "imported": 14, 2023-09-13T10:05:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "imported_inodes": 441, 2023-09-13T10:05:03.886 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_backtrace_fetch": 3326, 2023-09-13T10:05:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_peer_discover": 0, 2023-09-13T10:05:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rfiles": 736, 2023-09-13T10:05:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rbytes": 212049369, 2023-09-13T10:05:03.887 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rsnaps": 0, 2023-09-13T10:05:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_fetch": 3326, 2023-09-13T10:05:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_inodes": 360, 2023-09-13T10:05:03.888 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:05:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dirfrag_rstats": 360, 2023-09-13T10:05:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_file_inodes": 2966, 2023-09-13T10:05:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_inode_file_caps": 14, 2023-09-13T10:05:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_revoke": 11202, 2023-09-13T10:05:03.889 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_grant": 150486, 2023-09-13T10:05:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps": 54607, 2023-09-13T10:05:03.890 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps_dirty": 28056, 2023-09-13T10:05:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_cap_release": 6175, 2023-09-13T10:05:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "process_request_cap_release": 145307 2023-09-13T10:05:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache": { 2023-09-13T10:05:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update": 23, 2023-09-13T10:05:03.891 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update_receipt": 571, 2023-09-13T10:05:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_try_discover": 302, 2023-09-13T10:05:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_send_discover": 590, 2023-09-13T10:05:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_handle_discover": 72, 2023-09-13T10:05:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays": 6, 2023-09-13T10:05:03.892 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_created": 36615, 2023-09-13T10:05:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_enqueued": 36609, 2023-09-13T10:05:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:03.893 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_migrated": 0, 2023-09-13T10:05:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_started": 0, 2023-09-13T10:05:03.894 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_completed": 0, 2023-09-13T10:05:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:05:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_exportdir": 15, 2023-09-13T10:05:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_flush": 0, 2023-09-13T10:05:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragmentdir": 23, 2023-09-13T10:05:03.895 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_inodestats": 0 2023-09-13T10:05:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log": { 2023-09-13T10:05:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "evlrg": 0, 2023-09-13T10:05:03.896 INFO:teuthology.orchestra.run.smithi053.stdout: "evadd": 171561, 2023-09-13T10:05:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "evex": 65777, 2023-09-13T10:05:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "evtrm": 61451, 2023-09-13T10:05:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "ev": 110110, 2023-09-13T10:05:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "evexg": 0, 2023-09-13T10:05:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "evexd": 4326, 2023-09-13T10:05:03.897 INFO:teuthology.orchestra.run.smithi053.stdout: "segadd": 209, 2023-09-13T10:05:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "segex": 81, 2023-09-13T10:05:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "segtrm": 75, 2023-09-13T10:05:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "seg": 134, 2023-09-13T10:05:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "segmjr": 9, 2023-09-13T10:05:03.898 INFO:teuthology.orchestra.run.smithi053.stdout: "segexg": 0, 2023-09-13T10:05:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "segexd": 6, 2023-09-13T10:05:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "expos": 116845798, 2023-09-13T10:05:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "wrpos": 341559802, 2023-09-13T10:05:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "rdpos": 0, 2023-09-13T10:05:03.899 INFO:teuthology.orchestra.run.smithi053.stdout: "jlat": { 2023-09-13T10:05:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 51692, 2023-09-13T10:05:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 493.294422266, 2023-09-13T10:05:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.009542954 2023-09-13T10:05:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.900 INFO:teuthology.orchestra.run.smithi053.stdout: "replayed": 0 2023-09-13T10:05:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mem": { 2023-09-13T10:05:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "ino": 362, 2023-09-13T10:05:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "ino+": 36779, 2023-09-13T10:05:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "ino-": 36417, 2023-09-13T10:05:03.901 INFO:teuthology.orchestra.run.smithi053.stdout: "dir": 35, 2023-09-13T10:05:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "dir+": 462, 2023-09-13T10:05:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "dir-": 427, 2023-09-13T10:05:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "dn": 1454, 2023-09-13T10:05:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "dn+": 69295, 2023-09-13T10:05:03.902 INFO:teuthology.orchestra.run.smithi053.stdout: "dn-": 67841, 2023-09-13T10:05:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "cap": 2, 2023-09-13T10:05:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "cap+": 39912, 2023-09-13T10:05:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "cap-": 39910, 2023-09-13T10:05:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "rss": 71352, 2023-09-13T10:05:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: "heap": 198960 2023-09-13T10:05:03.903 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_server": { 2023-09-13T10:05:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_client_request": 291271, 2023-09-13T10:05:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_server_request": 7826, 2023-09-13T10:05:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_request": 206571, 2023-09-13T10:05:03.904 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_session": 4420, 2023-09-13T10:05:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_peer_request": 22988, 2023-09-13T10:05:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "req_create_latency": { 2023-09-13T10:05:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 36412, 2023-09-13T10:05:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 172.194329167, 2023-09-13T10:05:03.905 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.004729054 2023-09-13T10:05:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getattr_latency": { 2023-09-13T10:05:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 79, 2023-09-13T10:05:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.792415869, 2023-09-13T10:05:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.010030580 2023-09-13T10:05:03.906 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.907 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "req_link_latency": { 2023-09-13T10:05:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.908 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookup_latency": { 2023-09-13T10:05:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 68251, 2023-09-13T10:05:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 149.562636060, 2023-09-13T10:05:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.002191361 2023-09-13T10:05:03.909 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.910 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupino_latency": { 2023-09-13T10:05:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1, 2023-09-13T10:05:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000136604, 2023-09-13T10:05:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000136604 2023-09-13T10:05:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.911 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupname_latency": { 2023-09-13T10:05:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.912 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:03.913 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lssnap_latency": { 2023-09-13T10:05:03.914 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.915 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.915 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.915 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.915 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mkdir_latency": { 2023-09-13T10:05:03.915 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.915 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.916 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.916 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.916 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mknod_latency": { 2023-09-13T10:05:03.916 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.916 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.917 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.917 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.917 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mksnap_latency": { 2023-09-13T10:05:03.917 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.917 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.917 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.918 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.918 INFO:teuthology.orchestra.run.smithi053.stdout: "req_open_latency": { 2023-09-13T10:05:03.918 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.918 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.918 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.919 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.919 INFO:teuthology.orchestra.run.smithi053.stdout: "req_readdir_latency": { 2023-09-13T10:05:03.919 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 54474, 2023-09-13T10:05:03.919 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 463.955839130, 2023-09-13T10:05:03.919 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.008517014 2023-09-13T10:05:03.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.920 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rename_latency": { 2023-09-13T10:05:03.920 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 7660, 2023-09-13T10:05:03.920 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 40.049623982, 2023-09-13T10:05:03.920 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.005228410 2023-09-13T10:05:03.920 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.921 INFO:teuthology.orchestra.run.smithi053.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:03.921 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.921 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.921 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.921 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.922 INFO:teuthology.orchestra.run.smithi053.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:03.922 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.922 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.922 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.922 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.922 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmdir_latency": { 2023-09-13T10:05:03.923 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 20, 2023-09-13T10:05:03.923 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.164038841, 2023-09-13T10:05:03.923 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.008201942 2023-09-13T10:05:03.923 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.923 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:03.924 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.924 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.924 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.924 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.924 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:03.924 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.925 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.925 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.925 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.925 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setattr_latency": { 2023-09-13T10:05:03.925 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 15, 2023-09-13T10:05:03.926 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.451978209, 2023-09-13T10:05:03.926 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.030131880 2023-09-13T10:05:03.926 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.926 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:03.926 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.927 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.927 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.927 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.927 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:03.927 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1024, 2023-09-13T10:05:03.928 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 2.203766759, 2023-09-13T10:05:03.928 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.002152115 2023-09-13T10:05:03.928 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.928 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setlayout_latency": { 2023-09-13T10:05:03.928 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.928 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.929 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.929 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.929 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setxattr_latency": { 2023-09-13T10:05:03.929 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.929 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.930 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.930 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.930 INFO:teuthology.orchestra.run.smithi053.stdout: "req_symlink_latency": { 2023-09-13T10:05:03.930 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.930 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.931 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.931 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.931 INFO:teuthology.orchestra.run.smithi053.stdout: "req_unlink_latency": { 2023-09-13T10:05:03.931 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 36595, 2023-09-13T10:05:03.931 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 135.373982589, 2023-09-13T10:05:03.931 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.003699248 2023-09-13T10:05:03.932 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.932 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:03.932 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:03.932 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:03.932 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.933 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.933 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.933 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.933 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.933 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessions": { 2023-09-13T10:05:03.934 INFO:teuthology.orchestra.run.smithi053.stdout: "session_count": 1, 2023-09-13T10:05:03.934 INFO:teuthology.orchestra.run.smithi053.stdout: "session_add": 1, 2023-09-13T10:05:03.934 INFO:teuthology.orchestra.run.smithi053.stdout: "session_remove": 0, 2023-09-13T10:05:03.934 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_open": 1, 2023-09-13T10:05:03.934 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_stale": 0, 2023-09-13T10:05:03.935 INFO:teuthology.orchestra.run.smithi053.stdout: "total_load": 20328, 2023-09-13T10:05:03.935 INFO:teuthology.orchestra.run.smithi053.stdout: "average_load": 20328, 2023-09-13T10:05:03.935 INFO:teuthology.orchestra.run.smithi053.stdout: "avg_session_uptime": 1530, 2023-09-13T10:05:03.935 INFO:teuthology.orchestra.run.smithi053.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:03.935 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.936 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2023-09-13T10:05:03.936 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:03.936 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:03.936 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:03.936 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:03.936 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:03.937 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:03.937 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:03.937 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:03.937 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:03.937 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:03.938 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:03.938 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:03.938 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:03.938 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:03.938 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:03.939 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:03.939 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:03.939 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:03.939 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:03.939 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:03.939 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:03.940 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:03.940 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:03.940 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:03.940 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:03.940 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:03.941 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:03.941 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:03.941 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:03.941 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:03.941 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:03.941 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2023-09-13T10:05:03.942 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:03.942 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:03.942 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:03.942 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:03.942 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 2948847, 2023-09-13T10:05:03.943 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 1129, 2023-09-13T10:05:03.943 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 792, 2023-09-13T10:05:03.943 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 9, 2023-09-13T10:05:03.943 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2023-09-13T10:05:03.943 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2023-09-13T10:05:03.943 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:03.944 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:03.944 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:03.944 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:03.944 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:03.944 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 165, 2023-09-13T10:05:03.945 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:03.945 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:03.945 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:03.945 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2023-09-13T10:05:03.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 2117541, 2023-09-13T10:05:03.945 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 64753, 2023-09-13T10:05:03.946 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:03.946 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2023-09-13T10:05:03.946 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:03.946 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2023-09-13T10:05:03.946 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.947 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter": { 2023-09-13T10:05:03.947 INFO:teuthology.orchestra.run.smithi053.stdout: "op_active": 0, 2023-09-13T10:05:03.947 INFO:teuthology.orchestra.run.smithi053.stdout: "op_laggy": 0, 2023-09-13T10:05:03.947 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send": 95849, 2023-09-13T10:05:03.947 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send_bytes": 344491521, 2023-09-13T10:05:03.948 INFO:teuthology.orchestra.run.smithi053.stdout: "op_resend": 33, 2023-09-13T10:05:03.948 INFO:teuthology.orchestra.run.smithi053.stdout: "op_reply": 95849, 2023-09-13T10:05:03.948 INFO:teuthology.orchestra.run.smithi053.stdout: "op_latency": { 2023-09-13T10:05:03.948 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 95849, 2023-09-13T10:05:03.948 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 849.235641840, 2023-09-13T10:05:03.948 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.008860140 2023-09-13T10:05:03.949 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.949 INFO:teuthology.orchestra.run.smithi053.stdout: "op_inflight": 0, 2023-09-13T10:05:03.949 INFO:teuthology.orchestra.run.smithi053.stdout: "oplen_avg": { 2023-09-13T10:05:03.949 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 95849, 2023-09-13T10:05:03.949 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 96821 2023-09-13T10:05:03.950 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.950 INFO:teuthology.orchestra.run.smithi053.stdout: "op": 95849, 2023-09-13T10:05:03.950 INFO:teuthology.orchestra.run.smithi053.stdout: "op_r": 4681, 2023-09-13T10:05:03.950 INFO:teuthology.orchestra.run.smithi053.stdout: "op_w": 91168, 2023-09-13T10:05:03.950 INFO:teuthology.orchestra.run.smithi053.stdout: "op_rmw": 0, 2023-09-13T10:05:03.951 INFO:teuthology.orchestra.run.smithi053.stdout: "op_pg": 0, 2023-09-13T10:05:03.951 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_stat": 0, 2023-09-13T10:05:03.951 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_create": 145, 2023-09-13T10:05:03.951 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_read": 1353, 2023-09-13T10:05:03.951 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_write": 53045, 2023-09-13T10:05:03.951 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writefull": 757, 2023-09-13T10:05:03.952 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writesame": 0, 2023-09-13T10:05:03.952 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_append": 0, 2023-09-13T10:05:03.952 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_zero": 0, 2023-09-13T10:05:03.952 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_truncate": 9, 2023-09-13T10:05:03.952 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_delete": 36804, 2023-09-13T10:05:03.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_mapext": 0, 2023-09-13T10:05:03.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:03.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:03.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_getxattr": 3328, 2023-09-13T10:05:03.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_setxattr": 290, 2023-09-13T10:05:03.953 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:03.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:03.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:03.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_call": 0, 2023-09-13T10:05:03.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_watch": 0, 2023-09-13T10:05:03.954 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_notify": 0, 2023-09-13T10:05:03.955 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:03.955 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls": 0, 2023-09-13T10:05:03.955 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:03.955 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_other": 0, 2023-09-13T10:05:03.955 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_active": 0, 2023-09-13T10:05:03.955 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_send": 0, 2023-09-13T10:05:03.957 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_resend": 0, 2023-09-13T10:05:03.958 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_ping": 0, 2023-09-13T10:05:03.958 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_active": 0, 2023-09-13T10:05:03.958 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_send": 0, 2023-09-13T10:05:03.958 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_resend": 0, 2023-09-13T10:05:03.958 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_active": 0, 2023-09-13T10:05:03.959 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_send": 0, 2023-09-13T10:05:03.959 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_resend": 0, 2023-09-13T10:05:03.959 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_active": 0, 2023-09-13T10:05:03.959 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_send": 0, 2023-09-13T10:05:03.959 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_resend": 0, 2023-09-13T10:05:03.960 INFO:teuthology.orchestra.run.smithi053.stdout: "command_active": 0, 2023-09-13T10:05:03.960 INFO:teuthology.orchestra.run.smithi053.stdout: "command_send": 0, 2023-09-13T10:05:03.960 INFO:teuthology.orchestra.run.smithi053.stdout: "command_resend": 0, 2023-09-13T10:05:03.960 INFO:teuthology.orchestra.run.smithi053.stdout: "map_epoch": 88, 2023-09-13T10:05:03.960 INFO:teuthology.orchestra.run.smithi053.stdout: "map_full": 0, 2023-09-13T10:05:03.960 INFO:teuthology.orchestra.run.smithi053.stdout: "map_inc": 4, 2023-09-13T10:05:03.961 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_sessions": 12, 2023-09-13T10:05:03.961 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_open": 12, 2023-09-13T10:05:03.961 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_close": 0, 2023-09-13T10:05:03.961 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_laggy": 0, 2023-09-13T10:05:03.961 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_wr": 791, 2023-09-13T10:05:03.962 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_rd": 4, 2023-09-13T10:05:03.962 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_del": 295 2023-09-13T10:05:03.962 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.962 INFO:teuthology.orchestra.run.smithi053.stdout: "oft": { 2023-09-13T10:05:03.962 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_objs": 1, 2023-09-13T10:05:03.962 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:03.963 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_updates": 0, 2023-09-13T10:05:03.963 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_removes": 0 2023-09-13T10:05:03.963 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.963 INFO:teuthology.orchestra.run.smithi053.stdout: "osd-slow-ops": { 2023-09-13T10:05:03.963 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_ops_count": 0 2023-09-13T10:05:03.964 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.964 INFO:teuthology.orchestra.run.smithi053.stdout: "purge_queue": { 2023-09-13T10:05:03.964 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:03.964 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops_high_water": 6, 2023-09-13T10:05:03.964 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing": 0, 2023-09-13T10:05:03.965 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_high_water": 6, 2023-09-13T10:05:03.965 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed": 36609, 2023-09-13T10:05:03.965 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:03.965 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.965 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:03.965 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:03.966 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:03.966 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:03.966 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 680265, 2023-09-13T10:05:03.966 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 129220292, 2023-09-13T10:05:03.966 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:03.967 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 680265, 2023-09-13T10:05:03.967 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:03.967 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:03.967 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 680265, 2023-09-13T10:05:03.967 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 129220292, 2023-09-13T10:05:03.968 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:03.968 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.968 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.968 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.968 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.968 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.969 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:03.969 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:03.969 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:03.969 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:03.969 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:03.970 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:03.970 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:03.970 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:03.970 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 95849, 2023-09-13T10:05:03.970 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 348188998, 2023-09-13T10:05:03.971 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 95849, 2023-09-13T10:05:03.971 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 348188998, 2023-09-13T10:05:03.971 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:03.971 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.971 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.971 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.972 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.972 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.972 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:03.972 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:03.972 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 1024, 2023-09-13T10:05:03.973 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:03.973 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:03.973 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:03.973 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:03.973 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:03.973 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 95849, 2023-09-13T10:05:03.974 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 95849, 2023-09-13T10:05:03.974 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 95849, 2023-09-13T10:05:03.974 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 95849, 2023-09-13T10:05:03.974 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:03.974 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.975 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.975 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.975 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.975 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.975 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:03.976 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:03.976 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:03.976 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:03.976 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 36609, 2023-09-13T10:05:03.976 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 3697509, 2023-09-13T10:05:03.976 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:03.977 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 36609, 2023-09-13T10:05:03.977 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:03.977 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:03.977 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 1353, 2023-09-13T10:05:03.977 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 3697509, 2023-09-13T10:05:03.978 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:03.978 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.978 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.978 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.978 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.978 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:03.979 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle-0x557152e3e640": { 2023-09-13T10:05:03.979 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:03.979 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:03.979 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:03.979 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 171561, 2023-09-13T10:05:03.980 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 337365498, 2023-09-13T10:05:03.980 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:03.980 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 171561, 2023-09-13T10:05:03.980 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:03.980 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:03.981 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 51692, 2023-09-13T10:05:03.981 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 337365498, 2023-09-13T10:05:03.981 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:03.981 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:03.981 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:03.981 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:03.982 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.982 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:03.982 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-13T10:05:04.219 INFO:tasks.check_counter:Daemon mds.e mds.exported=14 2023-09-13T10:05:04.219 INFO:tasks.check_counter:Daemon mds.e mds.imported=14 2023-09-13T10:05:04.219 DEBUG:tasks.check_counter:Getting stats from h 2023-09-13T10:05:04.220 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.h perf dump 2023-09-13T10:05:04.246 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:04 smithi053 ceph-mon[102373]: pgmap v1066: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 8.9 MiB/s wr, 201 op/s 2023-09-13T10:05:04.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:04 smithi006 ceph-mon[98665]: pgmap v1066: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 8.9 MiB/s wr, 201 op/s 2023-09-13T10:05:04.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:04 smithi131 ceph-mon[102785]: pgmap v1066: 97 pgs: 97 active+clean; 1.1 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 217 KiB/s rd, 8.9 MiB/s wr, 201 op/s 2023-09-13T10:05:04.784 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T10:05:06.022 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-13T10:05:06.022 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:06.023 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 463063, 2023-09-13T10:05:06.023 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 706772, 2023-09-13T10:05:06.023 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 155331298, 2023-09-13T10:05:06.023 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 771693145, 2023-09-13T10:05:06.023 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 19, 2023-09-13T10:05:06.024 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:06.024 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 36.640275060, 2023-09-13T10:05:06.024 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 16.316828872, 2023-09-13T10:05:06.024 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 27.957899873, 2023-09-13T10:05:06.024 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 2.223620611, 2023-09-13T10:05:06.025 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:06.025 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 706768, 2023-09-13T10:05:06.025 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 153.229654135, 2023-09-13T10:05:06.025 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000216803 2023-09-13T10:05:06.025 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.026 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:06.026 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 870024, 2023-09-13T10:05:06.026 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.184443651, 2023-09-13T10:05:06.026 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000211 2023-09-13T10:05:06.026 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.027 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 140268304, 2023-09-13T10:05:06.027 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 532549456 2023-09-13T10:05:06.027 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.027 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:06.027 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 392894, 2023-09-13T10:05:06.028 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 416575, 2023-09-13T10:05:06.028 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 91733250, 2023-09-13T10:05:06.028 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 273713842, 2023-09-13T10:05:06.028 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 9, 2023-09-13T10:05:06.028 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 6, 2023-09-13T10:05:06.029 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 24.979660319, 2023-09-13T10:05:06.029 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 9.977243647, 2023-09-13T10:05:06.029 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 15.841598319, 2023-09-13T10:05:06.029 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.788561539, 2023-09-13T10:05:06.029 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:06.030 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 416576, 2023-09-13T10:05:06.030 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 52.486845029, 2023-09-13T10:05:06.030 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000125995 2023-09-13T10:05:06.030 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.031 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:06.031 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 699146, 2023-09-13T10:05:06.031 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.133748830, 2023-09-13T10:05:06.031 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000191 2023-09-13T10:05:06.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.032 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-09-13T10:05:06.032 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 658624 2023-09-13T10:05:06.032 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.032 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:06.033 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 330575, 2023-09-13T10:05:06.033 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 349163, 2023-09-13T10:05:06.033 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 81341489, 2023-09-13T10:05:06.033 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 159614239, 2023-09-13T10:05:06.034 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 90, 2023-09-13T10:05:06.034 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 10, 2023-09-13T10:05:06.034 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 21.034127361, 2023-09-13T10:05:06.034 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 8.472893039, 2023-09-13T10:05:06.034 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 13.971848467, 2023-09-13T10:05:06.035 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 1.056893454, 2023-09-13T10:05:06.035 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:06.035 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 349162, 2023-09-13T10:05:06.035 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 38.523561830, 2023-09-13T10:05:06.036 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000110331 2023-09-13T10:05:06.036 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.036 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:06.036 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 617618, 2023-09-13T10:05:06.036 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.117747039, 2023-09-13T10:05:06.037 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000190 2023-09-13T10:05:06.037 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.037 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 973136, 2023-09-13T10:05:06.037 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 308000 2023-09-13T10:05:06.038 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.038 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2023-09-13T10:05:06.038 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 1, 2023-09-13T10:05:06.038 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2023-09-13T10:05:06.039 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.039 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-MDSRank": { 2023-09-13T10:05:06.039 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:06.040 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:06.040 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 173508, 2023-09-13T10:05:06.040 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 207.043344647, 2023-09-13T10:05:06.040 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.001193278 2023-09-13T10:05:06.040 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.041 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.041 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:06.041 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:06.041 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:06.042 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 60414, 2023-09-13T10:05:06.042 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 17.504175344, 2023-09-13T10:05:06.042 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000289737 2023-09-13T10:05:06.042 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.043 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.043 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2023-09-13T10:05:06.043 INFO:teuthology.orchestra.run.smithi053.stdout: "request": 271643, 2023-09-13T10:05:06.043 INFO:teuthology.orchestra.run.smithi053.stdout: "reply": 230931, 2023-09-13T10:05:06.043 INFO:teuthology.orchestra.run.smithi053.stdout: "reply_latency": { 2023-09-13T10:05:06.043 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 230931, 2023-09-13T10:05:06.044 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 1361.099016114, 2023-09-13T10:05:06.044 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.005893964 2023-09-13T10:05:06.044 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.044 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_reply": 0, 2023-09-13T10:05:06.044 INFO:teuthology.orchestra.run.smithi053.stdout: "forward": 40712, 2023-09-13T10:05:06.045 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_complete": 0, 2023-09-13T10:05:06.045 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:06.045 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_commit": 127, 2023-09-13T10:05:06.046 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_split": 10, 2023-09-13T10:05:06.046 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_merge": 12, 2023-09-13T10:05:06.046 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes": 1338, 2023-09-13T10:05:06.046 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_top": 676, 2023-09-13T10:05:06.046 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_bottom": 330, 2023-09-13T10:05:06.047 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pin_tail": 332, 2023-09-13T10:05:06.047 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pinned": 361, 2023-09-13T10:05:06.047 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_expired": 1824, 2023-09-13T10:05:06.047 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_with_caps": 1, 2023-09-13T10:05:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": 1, 2023-09-13T10:05:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: "subtrees": 6, 2023-09-13T10:05:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse": 391657, 2023-09-13T10:05:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_hit": 213989, 2023-09-13T10:05:06.048 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_forward": 40704, 2023-09-13T10:05:06.049 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_discover": 117, 2023-09-13T10:05:06.049 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:06.049 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:06.049 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_lock": 2509, 2023-09-13T10:05:06.050 INFO:teuthology.orchestra.run.smithi053.stdout: "load_cent": 5162, 2023-09-13T10:05:06.050 INFO:teuthology.orchestra.run.smithi053.stdout: "q": 0, 2023-09-13T10:05:06.050 INFO:teuthology.orchestra.run.smithi053.stdout: "exported": 24, 2023-09-13T10:05:06.050 INFO:teuthology.orchestra.run.smithi053.stdout: "exported_inodes": 1146, 2023-09-13T10:05:06.050 INFO:teuthology.orchestra.run.smithi053.stdout: "imported": 17, 2023-09-13T10:05:06.051 INFO:teuthology.orchestra.run.smithi053.stdout: "imported_inodes": 155, 2023-09-13T10:05:06.051 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:06.051 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_backtrace_fetch": 4151, 2023-09-13T10:05:06.051 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_peer_discover": 0, 2023-09-13T10:05:06.051 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rfiles": 736, 2023-09-13T10:05:06.052 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rbytes": 212049369, 2023-09-13T10:05:06.052 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rsnaps": 0, 2023-09-13T10:05:06.052 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_fetch": 4151, 2023-09-13T10:05:06.052 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:06.052 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:06.053 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:06.053 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_inodes": 943, 2023-09-13T10:05:06.053 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:05:06.053 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dirfrag_rstats": 943, 2023-09-13T10:05:06.053 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_file_inodes": 3208, 2023-09-13T10:05:06.054 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_inode_file_caps": 42, 2023-09-13T10:05:06.054 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_revoke": 60387, 2023-09-13T10:05:06.054 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_grant": 196281, 2023-09-13T10:05:06.054 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:06.055 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:06.055 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:06.055 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps": 113045, 2023-09-13T10:05:06.055 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps_dirty": 32401, 2023-09-13T10:05:06.055 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_cap_release": 6957, 2023-09-13T10:05:06.056 INFO:teuthology.orchestra.run.smithi053.stdout: "process_request_cap_release": 135717 2023-09-13T10:05:06.056 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.056 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache": { 2023-09-13T10:05:06.057 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update": 34, 2023-09-13T10:05:06.057 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update_receipt": 464, 2023-09-13T10:05:06.057 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_try_discover": 239, 2023-09-13T10:05:06.058 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_send_discover": 558, 2023-09-13T10:05:06.058 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_handle_discover": 299, 2023-09-13T10:05:06.058 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays": 10, 2023-09-13T10:05:06.058 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:06.058 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:06.059 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_created": 35539, 2023-09-13T10:05:06.059 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_enqueued": 35529, 2023-09-13T10:05:06.059 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:06.059 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_migrated": 0, 2023-09-13T10:05:06.060 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:06.060 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:06.060 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:06.060 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_started": 0, 2023-09-13T10:05:06.060 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_completed": 0, 2023-09-13T10:05:06.060 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:05:06.061 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_exportdir": 24, 2023-09-13T10:05:06.061 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_flush": 0, 2023-09-13T10:05:06.061 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragmentdir": 22, 2023-09-13T10:05:06.061 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:06.061 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_inodestats": 0 2023-09-13T10:05:06.062 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.062 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log": { 2023-09-13T10:05:06.062 INFO:teuthology.orchestra.run.smithi053.stdout: "evlrg": 0, 2023-09-13T10:05:06.062 INFO:teuthology.orchestra.run.smithi053.stdout: "evadd": 210815, 2023-09-13T10:05:06.062 INFO:teuthology.orchestra.run.smithi053.stdout: "evex": 108336, 2023-09-13T10:05:06.063 INFO:teuthology.orchestra.run.smithi053.stdout: "evtrm": 98321, 2023-09-13T10:05:06.063 INFO:teuthology.orchestra.run.smithi053.stdout: "ev": 112494, 2023-09-13T10:05:06.063 INFO:teuthology.orchestra.run.smithi053.stdout: "evexg": 0, 2023-09-13T10:05:06.063 INFO:teuthology.orchestra.run.smithi053.stdout: "evexd": 10015, 2023-09-13T10:05:06.063 INFO:teuthology.orchestra.run.smithi053.stdout: "segadd": 249, 2023-09-13T10:05:06.064 INFO:teuthology.orchestra.run.smithi053.stdout: "segex": 121, 2023-09-13T10:05:06.064 INFO:teuthology.orchestra.run.smithi053.stdout: "segtrm": 110, 2023-09-13T10:05:06.064 INFO:teuthology.orchestra.run.smithi053.stdout: "seg": 139, 2023-09-13T10:05:06.064 INFO:teuthology.orchestra.run.smithi053.stdout: "segmjr": 10, 2023-09-13T10:05:06.064 INFO:teuthology.orchestra.run.smithi053.stdout: "segexg": 0, 2023-09-13T10:05:06.064 INFO:teuthology.orchestra.run.smithi053.stdout: "segexd": 11, 2023-09-13T10:05:06.065 INFO:teuthology.orchestra.run.smithi053.stdout: "expos": 213493304, 2023-09-13T10:05:06.065 INFO:teuthology.orchestra.run.smithi053.stdout: "wrpos": 450638518, 2023-09-13T10:05:06.065 INFO:teuthology.orchestra.run.smithi053.stdout: "rdpos": 0, 2023-09-13T10:05:06.065 INFO:teuthology.orchestra.run.smithi053.stdout: "jlat": { 2023-09-13T10:05:06.065 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 93021, 2023-09-13T10:05:06.066 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 628.286940725, 2023-09-13T10:05:06.066 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.006754248 2023-09-13T10:05:06.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.066 INFO:teuthology.orchestra.run.smithi053.stdout: "replayed": 0 2023-09-13T10:05:06.066 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.067 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mem": { 2023-09-13T10:05:06.067 INFO:teuthology.orchestra.run.smithi053.stdout: "ino": 46, 2023-09-13T10:05:06.067 INFO:teuthology.orchestra.run.smithi053.stdout: "ino+": 36565, 2023-09-13T10:05:06.067 INFO:teuthology.orchestra.run.smithi053.stdout: "ino-": 36519, 2023-09-13T10:05:06.068 INFO:teuthology.orchestra.run.smithi053.stdout: "dir": 45, 2023-09-13T10:05:06.068 INFO:teuthology.orchestra.run.smithi053.stdout: "dir+": 519, 2023-09-13T10:05:06.068 INFO:teuthology.orchestra.run.smithi053.stdout: "dir-": 474, 2023-09-13T10:05:06.068 INFO:teuthology.orchestra.run.smithi053.stdout: "dn": 1073, 2023-09-13T10:05:06.068 INFO:teuthology.orchestra.run.smithi053.stdout: "dn+": 79239, 2023-09-13T10:05:06.069 INFO:teuthology.orchestra.run.smithi053.stdout: "dn-": 78166, 2023-09-13T10:05:06.069 INFO:teuthology.orchestra.run.smithi053.stdout: "cap": 1, 2023-09-13T10:05:06.069 INFO:teuthology.orchestra.run.smithi053.stdout: "cap+": 42090, 2023-09-13T10:05:06.069 INFO:teuthology.orchestra.run.smithi053.stdout: "cap-": 42089, 2023-09-13T10:05:06.069 INFO:teuthology.orchestra.run.smithi053.stdout: "rss": 82020, 2023-09-13T10:05:06.070 INFO:teuthology.orchestra.run.smithi053.stdout: "heap": 198960 2023-09-13T10:05:06.070 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.070 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_server": { 2023-09-13T10:05:06.070 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_client_request": 361547, 2023-09-13T10:05:06.070 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_server_request": 63958, 2023-09-13T10:05:06.071 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_request": 271643, 2023-09-13T10:05:06.071 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_session": 5142, 2023-09-13T10:05:06.071 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_peer_request": 132771, 2023-09-13T10:05:06.071 INFO:teuthology.orchestra.run.smithi053.stdout: "req_create_latency": { 2023-09-13T10:05:06.071 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 36094, 2023-09-13T10:05:06.072 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 159.283232952, 2023-09-13T10:05:06.072 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.004413011 2023-09-13T10:05:06.072 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.072 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getattr_latency": { 2023-09-13T10:05:06.072 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 15451, 2023-09-13T10:05:06.073 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 164.886820992, 2023-09-13T10:05:06.073 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.010671595 2023-09-13T10:05:06.073 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.073 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:06.073 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.074 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.074 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.074 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.074 INFO:teuthology.orchestra.run.smithi053.stdout: "req_link_latency": { 2023-09-13T10:05:06.074 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.075 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.075 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.075 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.075 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookup_latency": { 2023-09-13T10:05:06.075 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 77619, 2023-09-13T10:05:06.076 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 339.375569786, 2023-09-13T10:05:06.076 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.004372325 2023-09-13T10:05:06.076 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.076 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:06.076 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.077 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.077 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.077 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.077 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupino_latency": { 2023-09-13T10:05:06.078 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.078 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.078 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.078 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.078 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupname_latency": { 2023-09-13T10:05:06.079 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.079 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.079 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.079 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.079 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:06.080 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.080 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.080 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.080 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.080 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:06.081 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.081 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.081 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.081 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.081 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lssnap_latency": { 2023-09-13T10:05:06.082 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.082 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.082 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.082 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.082 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mkdir_latency": { 2023-09-13T10:05:06.083 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 112, 2023-09-13T10:05:06.083 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 1.234089525, 2023-09-13T10:05:06.083 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.011018656 2023-09-13T10:05:06.083 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.083 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mknod_latency": { 2023-09-13T10:05:06.084 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.084 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.084 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.084 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.084 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mksnap_latency": { 2023-09-13T10:05:06.085 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.085 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.085 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.085 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.086 INFO:teuthology.orchestra.run.smithi053.stdout: "req_open_latency": { 2023-09-13T10:05:06.086 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 9, 2023-09-13T10:05:06.086 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.018377644, 2023-09-13T10:05:06.086 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.002041960 2023-09-13T10:05:06.086 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.087 INFO:teuthology.orchestra.run.smithi053.stdout: "req_readdir_latency": { 2023-09-13T10:05:06.087 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 58084, 2023-09-13T10:05:06.087 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 519.259743578, 2023-09-13T10:05:06.087 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.008939806 2023-09-13T10:05:06.087 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.088 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rename_latency": { 2023-09-13T10:05:06.088 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 7200, 2023-09-13T10:05:06.088 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 33.763967779, 2023-09-13T10:05:06.088 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.004689439 2023-09-13T10:05:06.088 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.089 INFO:teuthology.orchestra.run.smithi053.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:06.089 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.089 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.089 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.089 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.090 INFO:teuthology.orchestra.run.smithi053.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:06.090 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.090 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.090 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.090 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.091 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmdir_latency": { 2023-09-13T10:05:06.091 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 44, 2023-09-13T10:05:06.091 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.715086516, 2023-09-13T10:05:06.091 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.016251966 2023-09-13T10:05:06.091 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.092 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:06.092 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.092 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.092 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.092 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.093 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:06.093 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.093 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.093 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.093 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.094 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setattr_latency": { 2023-09-13T10:05:06.094 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 32, 2023-09-13T10:05:06.094 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.950559925, 2023-09-13T10:05:06.094 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.029704997 2023-09-13T10:05:06.094 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.095 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:06.095 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.095 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.095 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.095 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.096 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:06.096 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 780, 2023-09-13T10:05:06.096 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 1.693756090, 2023-09-13T10:05:06.096 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.002171482 2023-09-13T10:05:06.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.097 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setlayout_latency": { 2023-09-13T10:05:06.097 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.097 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.097 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.097 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.098 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setxattr_latency": { 2023-09-13T10:05:06.098 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.098 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.098 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.098 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.099 INFO:teuthology.orchestra.run.smithi053.stdout: "req_symlink_latency": { 2023-09-13T10:05:06.099 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.099 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.099 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.099 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.100 INFO:teuthology.orchestra.run.smithi053.stdout: "req_unlink_latency": { 2023-09-13T10:05:06.100 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 35506, 2023-09-13T10:05:06.100 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 139.917811327, 2023-09-13T10:05:06.100 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.003940680 2023-09-13T10:05:06.100 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.101 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:06.101 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:06.101 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:06.101 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.101 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.102 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.102 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.102 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.102 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessions": { 2023-09-13T10:05:06.102 INFO:teuthology.orchestra.run.smithi053.stdout: "session_count": 1, 2023-09-13T10:05:06.102 INFO:teuthology.orchestra.run.smithi053.stdout: "session_add": 2, 2023-09-13T10:05:06.103 INFO:teuthology.orchestra.run.smithi053.stdout: "session_remove": 1, 2023-09-13T10:05:06.103 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_open": 1, 2023-09-13T10:05:06.103 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_stale": 0, 2023-09-13T10:05:06.103 INFO:teuthology.orchestra.run.smithi053.stdout: "total_load": 19407, 2023-09-13T10:05:06.104 INFO:teuthology.orchestra.run.smithi053.stdout: "average_load": 19407, 2023-09-13T10:05:06.104 INFO:teuthology.orchestra.run.smithi053.stdout: "avg_session_uptime": 2894, 2023-09-13T10:05:06.104 INFO:teuthology.orchestra.run.smithi053.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:06.104 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.104 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2023-09-13T10:05:06.104 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:06.105 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:06.105 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:06.105 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:06.105 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:06.105 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:06.106 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:06.106 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:06.106 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:06.106 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:06.106 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:06.107 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:06.107 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:06.107 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:06.107 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:06.107 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:06.108 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:06.108 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:06.108 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:06.108 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:06.108 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:06.108 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:06.109 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:06.109 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:06.109 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:06.109 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:06.109 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:06.110 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:06.110 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:06.110 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:06.110 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:06.110 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2023-09-13T10:05:06.111 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:06.111 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:06.111 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:06.111 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:06.111 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 2722221, 2023-09-13T10:05:06.112 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 1045, 2023-09-13T10:05:06.112 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 264, 2023-09-13T10:05:06.112 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 3, 2023-09-13T10:05:06.112 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2023-09-13T10:05:06.112 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2023-09-13T10:05:06.112 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:06.113 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:06.113 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:06.113 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:06.113 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:06.113 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 165, 2023-09-13T10:05:06.114 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:06.114 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:06.114 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:06.114 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2023-09-13T10:05:06.114 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 2022345, 2023-09-13T10:05:06.115 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 61027, 2023-09-13T10:05:06.115 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:06.115 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2023-09-13T10:05:06.115 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:06.115 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2023-09-13T10:05:06.116 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.116 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter": { 2023-09-13T10:05:06.116 INFO:teuthology.orchestra.run.smithi053.stdout: "op_active": 0, 2023-09-13T10:05:06.116 INFO:teuthology.orchestra.run.smithi053.stdout: "op_laggy": 0, 2023-09-13T10:05:06.116 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send": 136755, 2023-09-13T10:05:06.116 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send_bytes": 453731190, 2023-09-13T10:05:06.117 INFO:teuthology.orchestra.run.smithi053.stdout: "op_resend": 29, 2023-09-13T10:05:06.117 INFO:teuthology.orchestra.run.smithi053.stdout: "op_reply": 136755, 2023-09-13T10:05:06.117 INFO:teuthology.orchestra.run.smithi053.stdout: "op_latency": { 2023-09-13T10:05:06.117 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 136755, 2023-09-13T10:05:06.117 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 962.408490557, 2023-09-13T10:05:06.118 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.007037464 2023-09-13T10:05:06.118 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.118 INFO:teuthology.orchestra.run.smithi053.stdout: "op_inflight": 0, 2023-09-13T10:05:06.118 INFO:teuthology.orchestra.run.smithi053.stdout: "oplen_avg": { 2023-09-13T10:05:06.118 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 136755, 2023-09-13T10:05:06.119 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 137753 2023-09-13T10:05:06.119 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.119 INFO:teuthology.orchestra.run.smithi053.stdout: "op": 136755, 2023-09-13T10:05:06.119 INFO:teuthology.orchestra.run.smithi053.stdout: "op_r": 5407, 2023-09-13T10:05:06.119 INFO:teuthology.orchestra.run.smithi053.stdout: "op_w": 131348, 2023-09-13T10:05:06.119 INFO:teuthology.orchestra.run.smithi053.stdout: "op_rmw": 0, 2023-09-13T10:05:06.120 INFO:teuthology.orchestra.run.smithi053.stdout: "op_pg": 0, 2023-09-13T10:05:06.120 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_stat": 0, 2023-09-13T10:05:06.120 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_create": 160, 2023-09-13T10:05:06.120 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_read": 1256, 2023-09-13T10:05:06.120 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_write": 94278, 2023-09-13T10:05:06.121 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writefull": 702, 2023-09-13T10:05:06.121 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writesame": 0, 2023-09-13T10:05:06.121 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_append": 0, 2023-09-13T10:05:06.121 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_zero": 0, 2023-09-13T10:05:06.121 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_truncate": 10, 2023-09-13T10:05:06.122 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_delete": 35778, 2023-09-13T10:05:06.122 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_mapext": 0, 2023-09-13T10:05:06.122 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:06.122 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:06.122 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_getxattr": 4151, 2023-09-13T10:05:06.123 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_setxattr": 320, 2023-09-13T10:05:06.123 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:06.123 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:06.123 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:06.123 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_call": 0, 2023-09-13T10:05:06.124 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_watch": 0, 2023-09-13T10:05:06.124 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_notify": 0, 2023-09-13T10:05:06.124 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:06.124 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls": 0, 2023-09-13T10:05:06.124 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:06.125 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_other": 0, 2023-09-13T10:05:06.125 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_active": 0, 2023-09-13T10:05:06.125 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_send": 0, 2023-09-13T10:05:06.125 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_resend": 0, 2023-09-13T10:05:06.126 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_ping": 0, 2023-09-13T10:05:06.126 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_active": 0, 2023-09-13T10:05:06.126 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_send": 0, 2023-09-13T10:05:06.126 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_resend": 0, 2023-09-13T10:05:06.126 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_active": 0, 2023-09-13T10:05:06.127 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_send": 0, 2023-09-13T10:05:06.127 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_resend": 0, 2023-09-13T10:05:06.127 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_active": 0, 2023-09-13T10:05:06.127 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_send": 0, 2023-09-13T10:05:06.127 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_resend": 0, 2023-09-13T10:05:06.128 INFO:teuthology.orchestra.run.smithi053.stdout: "command_active": 0, 2023-09-13T10:05:06.128 INFO:teuthology.orchestra.run.smithi053.stdout: "command_send": 0, 2023-09-13T10:05:06.128 INFO:teuthology.orchestra.run.smithi053.stdout: "command_resend": 0, 2023-09-13T10:05:06.128 INFO:teuthology.orchestra.run.smithi053.stdout: "map_epoch": 88, 2023-09-13T10:05:06.128 INFO:teuthology.orchestra.run.smithi053.stdout: "map_full": 0, 2023-09-13T10:05:06.129 INFO:teuthology.orchestra.run.smithi053.stdout: "map_inc": 4, 2023-09-13T10:05:06.129 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_sessions": 12, 2023-09-13T10:05:06.129 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_open": 12, 2023-09-13T10:05:06.129 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_close": 0, 2023-09-13T10:05:06.129 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_laggy": 0, 2023-09-13T10:05:06.130 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_wr": 803, 2023-09-13T10:05:06.130 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_rd": 0, 2023-09-13T10:05:06.130 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_del": 295 2023-09-13T10:05:06.130 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.131 INFO:teuthology.orchestra.run.smithi053.stdout: "oft": { 2023-09-13T10:05:06.131 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_objs": 1, 2023-09-13T10:05:06.131 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:06.131 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_updates": 0, 2023-09-13T10:05:06.131 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_removes": 0 2023-09-13T10:05:06.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.132 INFO:teuthology.orchestra.run.smithi053.stdout: "osd-slow-ops": { 2023-09-13T10:05:06.132 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_ops_count": 0 2023-09-13T10:05:06.132 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.132 INFO:teuthology.orchestra.run.smithi053.stdout: "purge_queue": { 2023-09-13T10:05:06.132 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:06.133 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops_high_water": 6, 2023-09-13T10:05:06.133 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing": 0, 2023-09-13T10:05:06.133 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_high_water": 6, 2023-09-13T10:05:06.133 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed": 35529, 2023-09-13T10:05:06.133 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:06.134 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.134 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:06.134 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:06.134 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:06.134 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:06.135 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 1186528, 2023-09-13T10:05:06.135 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 203313126, 2023-09-13T10:05:06.135 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:06.135 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 1186528, 2023-09-13T10:05:06.135 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:06.136 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:06.136 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 1186528, 2023-09-13T10:05:06.136 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 203313126, 2023-09-13T10:05:06.136 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:06.136 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.137 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.137 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.137 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.137 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.137 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:06.138 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:06.138 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:06.138 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:06.138 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:06.138 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:06.139 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:06.139 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:06.139 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 136755, 2023-09-13T10:05:06.139 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 457319619, 2023-09-13T10:05:06.139 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 136755, 2023-09-13T10:05:06.140 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 457319619, 2023-09-13T10:05:06.140 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:06.140 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.140 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.140 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.141 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.141 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.141 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:06.141 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:06.141 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 1024, 2023-09-13T10:05:06.142 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:06.142 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:06.142 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:06.142 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:06.142 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:06.143 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 136755, 2023-09-13T10:05:06.143 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 136755, 2023-09-13T10:05:06.143 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 136755, 2023-09-13T10:05:06.143 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 136755, 2023-09-13T10:05:06.143 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:06.144 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.144 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.144 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.144 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.144 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.144 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:06.145 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:06.145 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:06.145 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:06.145 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 35529, 2023-09-13T10:05:06.145 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 3588429, 2023-09-13T10:05:06.146 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:06.146 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 35529, 2023-09-13T10:05:06.146 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:06.146 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:06.146 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 1257, 2023-09-13T10:05:06.147 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 3588429, 2023-09-13T10:05:06.147 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:06.147 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.147 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.147 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.148 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.148 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:06.148 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle-0x5621debce640": { 2023-09-13T10:05:06.148 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:06.148 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:06.149 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:06.149 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 210815, 2023-09-13T10:05:06.149 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 446444214, 2023-09-13T10:05:06.149 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:06.149 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 210815, 2023-09-13T10:05:06.149 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:06.150 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:06.150 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 93021, 2023-09-13T10:05:06.150 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 446444214, 2023-09-13T10:05:06.150 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:06.150 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:06.151 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:06.151 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:06.151 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.151 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:06.151 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-13T10:05:06.393 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:06 smithi053 ceph-mon[102373]: pgmap v1067: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 8.9 MiB/s wr, 239 op/s 2023-09-13T10:05:06.446 INFO:tasks.check_counter:Daemon mds.h mds.exported=24 2023-09-13T10:05:06.446 INFO:tasks.check_counter:Daemon mds.h mds.imported=17 2023-09-13T10:05:06.446 DEBUG:tasks.check_counter:Getting stats from k 2023-09-13T10:05:06.447 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.k perf dump 2023-09-13T10:05:06.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:06 smithi006 ceph-mon[98665]: pgmap v1067: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 8.9 MiB/s wr, 239 op/s 2023-09-13T10:05:06.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:06 smithi131 ceph-mon[102785]: pgmap v1067: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 8.9 MiB/s wr, 239 op/s 2023-09-13T10:05:07.052 INFO:teuthology.orchestra.run.smithi053.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.b/config 2023-09-13T10:05:08.185 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:08 smithi053 ceph-mon[102373]: pgmap v1068: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 8.9 MiB/s wr, 247 op/s 2023-09-13T10:05:08.185 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:08 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:05:08.380 INFO:teuthology.orchestra.run.smithi053.stdout:{ 2023-09-13T10:05:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 4170, 2023-09-13T10:05:08.380 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 4170, 2023-09-13T10:05:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 206712722, 2023-09-13T10:05:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 1296081, 2023-09-13T10:05:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 8, 2023-09-13T10:05:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 4, 2023-09-13T10:05:08.381 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.464143930, 2023-09-13T10:05:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.091605114, 2023-09-13T10:05:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.216365914, 2023-09-13T10:05:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.127131645, 2023-09-13T10:05:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:08.382 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 4169, 2023-09-13T10:05:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.399010400, 2023-09-13T10:05:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000095708 2023-09-13T10:05:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.383 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-09-13T10:05:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 448 2023-09-13T10:05:08.384 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 1638, 2023-09-13T10:05:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 1574, 2023-09-13T10:05:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 112383116, 2023-09-13T10:05:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 616134, 2023-09-13T10:05:08.385 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 6, 2023-09-13T10:05:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.211431805, 2023-09-13T10:05:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.044402709, 2023-09-13T10:05:08.386 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.114222893, 2023-09-13T10:05:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.044290837, 2023-09-13T10:05:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1573, 2023-09-13T10:05:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.209603330, 2023-09-13T10:05:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000133250 2023-09-13T10:05:08.387 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.388 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 941168, 2023-09-13T10:05:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 265264 2023-09-13T10:05:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_messages": 747, 2023-09-13T10:05:08.389 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages": 1079, 2023-09-13T10:05:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_bytes": 88270290, 2023-09-13T10:05:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_bytes": 885798, 2023-09-13T10:05:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_created_connections": 7, 2023-09-13T10:05:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:08.390 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_total_time": 0.131955544, 2023-09-13T10:05:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_send_time": 0.024901524, 2023-09-13T10:05:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_recv_time": 0.076809561, 2023-09-13T10:05:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_running_fast_dispatch_time": 0.021970583, 2023-09-13T10:05:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:08.391 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 1077, 2023-09-13T10:05:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.167394010, 2023-09-13T10:05:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000155426 2023-09-13T10:05:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.392 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_recv_encrypted_bytes": 160, 2023-09-13T10:05:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: "msgr_send_encrypted_bytes": 653792 2023-09-13T10:05:08.393 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "cct": { 2023-09-13T10:05:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "total_workers": 1, 2023-09-13T10:05:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "unhealthy_workers": 0 2023-09-13T10:05:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.394 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-MDSRank": { 2023-09-13T10:05:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 10249, 2023-09-13T10:05:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.818077857, 2023-09-13T10:05:08.395 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000079820 2023-09-13T10:05:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "queue_len": 0, 2023-09-13T10:05:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "complete_latency": { 2023-09-13T10:05:08.396 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.397 INFO:teuthology.orchestra.run.smithi053.stdout: "mds": { 2023-09-13T10:05:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "request": 0, 2023-09-13T10:05:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "reply": 0, 2023-09-13T10:05:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "reply_latency": { 2023-09-13T10:05:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.398 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_reply": 0, 2023-09-13T10:05:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "forward": 0, 2023-09-13T10:05:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_complete": 0, 2023-09-13T10:05:08.399 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_commit": 0, 2023-09-13T10:05:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_split": 0, 2023-09-13T10:05:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_merge": 0, 2023-09-13T10:05:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes": 22063, 2023-09-13T10:05:08.400 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_top": 0, 2023-09-13T10:05:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_bottom": 0, 2023-09-13T10:05:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pin_tail": 22063, 2023-09-13T10:05:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_pinned": 22063, 2023-09-13T10:05:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_expired": 24623, 2023-09-13T10:05:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "inodes_with_caps": 0, 2023-09-13T10:05:08.401 INFO:teuthology.orchestra.run.smithi053.stdout: "caps": 0, 2023-09-13T10:05:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "subtrees": 1, 2023-09-13T10:05:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse": 0, 2023-09-13T10:05:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_hit": 0, 2023-09-13T10:05:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_forward": 0, 2023-09-13T10:05:08.402 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_discover": 0, 2023-09-13T10:05:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "traverse_lock": 0, 2023-09-13T10:05:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "load_cent": 0, 2023-09-13T10:05:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "q": 0, 2023-09-13T10:05:08.403 INFO:teuthology.orchestra.run.smithi053.stdout: "exported": 0, 2023-09-13T10:05:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "exported_inodes": 0, 2023-09-13T10:05:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "imported": 0, 2023-09-13T10:05:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "imported_inodes": 0, 2023-09-13T10:05:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:08.404 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_backtrace_fetch": 0, 2023-09-13T10:05:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "openino_peer_discover": 0, 2023-09-13T10:05:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rfiles": 0, 2023-09-13T10:05:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rbytes": 0, 2023-09-13T10:05:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "root_rsnaps": 0, 2023-09-13T10:05:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_fetch": 0, 2023-09-13T10:05:08.405 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_inodes": 0, 2023-09-13T10:05:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:05:08.406 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_dirfrag_rstats": 0, 2023-09-13T10:05:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "scrub_file_inodes": 0, 2023-09-13T10:05:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_inode_file_caps": 0, 2023-09-13T10:05:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_revoke": 0, 2023-09-13T10:05:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_grant": 0, 2023-09-13T10:05:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:08.407 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps": 0, 2023-09-13T10:05:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_caps_dirty": 0, 2023-09-13T10:05:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_cap_release": 0, 2023-09-13T10:05:08.408 INFO:teuthology.orchestra.run.smithi053.stdout: "process_request_cap_release": 0 2023-09-13T10:05:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_cache": { 2023-09-13T10:05:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update": 0, 2023-09-13T10:05:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_update_receipt": 0, 2023-09-13T10:05:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_try_discover": 0, 2023-09-13T10:05:08.409 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_send_discover": 0, 2023-09-13T10:05:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "dir_handle_discover": 0, 2023-09-13T10:05:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays": 0, 2023-09-13T10:05:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:08.410 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_created": 0, 2023-09-13T10:05:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_enqueued": 0, 2023-09-13T10:05:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "strays_migrated": 0, 2023-09-13T10:05:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:08.411 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_started": 0, 2023-09-13T10:05:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "recovery_completed": 0, 2023-09-13T10:05:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:05:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_exportdir": 0, 2023-09-13T10:05:08.412 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_flush": 0, 2023-09-13T10:05:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragmentdir": 0, 2023-09-13T10:05:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "ireq_inodestats": 0 2023-09-13T10:05:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.413 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_log": { 2023-09-13T10:05:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "evlrg": 0, 2023-09-13T10:05:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "evadd": 0, 2023-09-13T10:05:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "evex": 0, 2023-09-13T10:05:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "evtrm": 0, 2023-09-13T10:05:08.414 INFO:teuthology.orchestra.run.smithi053.stdout: "ev": 222725, 2023-09-13T10:05:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "evexg": 0, 2023-09-13T10:05:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "evexd": 0, 2023-09-13T10:05:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "segadd": 0, 2023-09-13T10:05:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "segex": 0, 2023-09-13T10:05:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "segtrm": 0, 2023-09-13T10:05:08.415 INFO:teuthology.orchestra.run.smithi053.stdout: "seg": 131, 2023-09-13T10:05:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "segmjr": 20, 2023-09-13T10:05:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "segexg": 0, 2023-09-13T10:05:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "segexd": 0, 2023-09-13T10:05:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "expos": 218749417, 2023-09-13T10:05:08.416 INFO:teuthology.orchestra.run.smithi053.stdout: "wrpos": 408949468, 2023-09-13T10:05:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "rdpos": 408948330, 2023-09-13T10:05:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "jlat": { 2023-09-13T10:05:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.417 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "replayed": 222725 2023-09-13T10:05:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_mem": { 2023-09-13T10:05:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "ino": 24, 2023-09-13T10:05:08.418 INFO:teuthology.orchestra.run.smithi053.stdout: "ino+": 46511, 2023-09-13T10:05:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "ino-": 46487, 2023-09-13T10:05:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "dir": 22, 2023-09-13T10:05:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "dir+": 107, 2023-09-13T10:05:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "dir-": 85, 2023-09-13T10:05:08.419 INFO:teuthology.orchestra.run.smithi053.stdout: "dn": 22063, 2023-09-13T10:05:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "dn+": 47082, 2023-09-13T10:05:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "dn-": 25019, 2023-09-13T10:05:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "cap": 0, 2023-09-13T10:05:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "cap+": 0, 2023-09-13T10:05:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "cap-": 0, 2023-09-13T10:05:08.420 INFO:teuthology.orchestra.run.smithi053.stdout: "rss": 77864, 2023-09-13T10:05:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "heap": 207152 2023-09-13T10:05:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_server": { 2023-09-13T10:05:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_client_request": 0, 2023-09-13T10:05:08.421 INFO:teuthology.orchestra.run.smithi053.stdout: "dispatch_server_request": 0, 2023-09-13T10:05:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_request": 0, 2023-09-13T10:05:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_client_session": 0, 2023-09-13T10:05:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "handle_peer_request": 0, 2023-09-13T10:05:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "req_create_latency": { 2023-09-13T10:05:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.422 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getattr_latency": { 2023-09-13T10:05:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.423 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.424 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "req_link_latency": { 2023-09-13T10:05:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.425 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookup_latency": { 2023-09-13T10:05:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.426 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.427 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupino_latency": { 2023-09-13T10:05:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.428 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupname_latency": { 2023-09-13T10:05:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.429 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.430 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.431 INFO:teuthology.orchestra.run.smithi053.stdout: "req_lssnap_latency": { 2023-09-13T10:05:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mkdir_latency": { 2023-09-13T10:05:08.432 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mknod_latency": { 2023-09-13T10:05:08.433 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "req_mksnap_latency": { 2023-09-13T10:05:08.434 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "req_open_latency": { 2023-09-13T10:05:08.435 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "req_readdir_latency": { 2023-09-13T10:05:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.436 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rename_latency": { 2023-09-13T10:05:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.437 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.438 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.439 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmdir_latency": { 2023-09-13T10:05:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.440 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.441 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.442 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setattr_latency": { 2023-09-13T10:05:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.443 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.444 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.445 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setlayout_latency": { 2023-09-13T10:05:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.446 INFO:teuthology.orchestra.run.smithi053.stdout: "req_setxattr_latency": { 2023-09-13T10:05:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "req_symlink_latency": { 2023-09-13T10:05:08.447 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "req_unlink_latency": { 2023-09-13T10:05:08.448 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:08.449 INFO:teuthology.orchestra.run.smithi053.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.450 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_sessions": { 2023-09-13T10:05:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "session_count": 1, 2023-09-13T10:05:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "session_add": 2, 2023-09-13T10:05:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "session_remove": 1, 2023-09-13T10:05:08.451 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_open": 1, 2023-09-13T10:05:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "sessions_stale": 0, 2023-09-13T10:05:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "total_load": 0, 2023-09-13T10:05:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "average_load": 0, 2023-09-13T10:05:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "avg_session_uptime": 2895, 2023-09-13T10:05:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:08.452 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "mempool": { 2023-09-13T10:05:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:08.453 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:08.454 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:08.455 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:08.456 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:08.457 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:08.458 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_items": 0, 2023-09-13T10:05:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:08.459 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_bytes": 242237, 2023-09-13T10:05:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_anon_items": 97, 2023-09-13T10:05:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_bytes": 0, 2023-09-13T10:05:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "buffer_meta_items": 0, 2023-09-13T10:05:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_bytes": 0, 2023-09-13T10:05:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_items": 0, 2023-09-13T10:05:08.460 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:08.461 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_items": 165, 2023-09-13T10:05:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "pgmap_items": 0, 2023-09-13T10:05:08.462 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_bytes": 15615995, 2023-09-13T10:05:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "mds_co_items": 89776, 2023-09-13T10:05:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_1_items": 0, 2023-09-13T10:05:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: "unittest_2_items": 0 2023-09-13T10:05:08.463 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "objecter": { 2023-09-13T10:05:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "op_active": 0, 2023-09-13T10:05:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "op_laggy": 0, 2023-09-13T10:05:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send": 6040, 2023-09-13T10:05:08.464 INFO:teuthology.orchestra.run.smithi053.stdout: "op_send_bytes": 21, 2023-09-13T10:05:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "op_resend": 3, 2023-09-13T10:05:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "op_reply": 6040, 2023-09-13T10:05:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "op_latency": { 2023-09-13T10:05:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 6040, 2023-09-13T10:05:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 13.609749582, 2023-09-13T10:05:08.465 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.002253269 2023-09-13T10:05:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "op_inflight": 0, 2023-09-13T10:05:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "oplen_avg": { 2023-09-13T10:05:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 6040, 2023-09-13T10:05:08.466 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 6041 2023-09-13T10:05:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "op": 6040, 2023-09-13T10:05:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "op_r": 6040, 2023-09-13T10:05:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "op_w": 0, 2023-09-13T10:05:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "op_rmw": 0, 2023-09-13T10:05:08.467 INFO:teuthology.orchestra.run.smithi053.stdout: "op_pg": 0, 2023-09-13T10:05:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_stat": 3150, 2023-09-13T10:05:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_create": 0, 2023-09-13T10:05:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_read": 2888, 2023-09-13T10:05:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_write": 0, 2023-09-13T10:05:08.468 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writefull": 0, 2023-09-13T10:05:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_writesame": 0, 2023-09-13T10:05:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_append": 0, 2023-09-13T10:05:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_zero": 0, 2023-09-13T10:05:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_truncate": 0, 2023-09-13T10:05:08.469 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_delete": 0, 2023-09-13T10:05:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_mapext": 0, 2023-09-13T10:05:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_getxattr": 1, 2023-09-13T10:05:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_setxattr": 0, 2023-09-13T10:05:08.470 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_call": 0, 2023-09-13T10:05:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_watch": 0, 2023-09-13T10:05:08.471 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_notify": 0, 2023-09-13T10:05:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls": 0, 2023-09-13T10:05:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "osdop_other": 0, 2023-09-13T10:05:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_active": 0, 2023-09-13T10:05:08.472 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_send": 0, 2023-09-13T10:05:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_resend": 0, 2023-09-13T10:05:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "linger_ping": 0, 2023-09-13T10:05:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_active": 0, 2023-09-13T10:05:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_send": 0, 2023-09-13T10:05:08.473 INFO:teuthology.orchestra.run.smithi053.stdout: "poolop_resend": 0, 2023-09-13T10:05:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_active": 0, 2023-09-13T10:05:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_send": 0, 2023-09-13T10:05:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "poolstat_resend": 0, 2023-09-13T10:05:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_active": 0, 2023-09-13T10:05:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_send": 0, 2023-09-13T10:05:08.474 INFO:teuthology.orchestra.run.smithi053.stdout: "statfs_resend": 0, 2023-09-13T10:05:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "command_active": 0, 2023-09-13T10:05:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "command_send": 0, 2023-09-13T10:05:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "command_resend": 0, 2023-09-13T10:05:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "map_epoch": 88, 2023-09-13T10:05:08.475 INFO:teuthology.orchestra.run.smithi053.stdout: "map_full": 0, 2023-09-13T10:05:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "map_inc": 4, 2023-09-13T10:05:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_sessions": 11, 2023-09-13T10:05:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_open": 12, 2023-09-13T10:05:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_session_close": 1, 2023-09-13T10:05:08.476 INFO:teuthology.orchestra.run.smithi053.stdout: "osd_laggy": 0, 2023-09-13T10:05:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_wr": 0, 2023-09-13T10:05:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_rd": 2, 2023-09-13T10:05:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_del": 0 2023-09-13T10:05:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "oft": { 2023-09-13T10:05:08.477 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_objs": 0, 2023-09-13T10:05:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_updates": 0, 2023-09-13T10:05:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "omap_total_removes": 0 2023-09-13T10:05:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.478 INFO:teuthology.orchestra.run.smithi053.stdout: "osd-slow-ops": { 2023-09-13T10:05:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "slow_ops_count": 0 2023-09-13T10:05:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "purge_queue": { 2023-09-13T10:05:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_ops_high_water": 0, 2023-09-13T10:05:08.479 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing": 0, 2023-09-13T10:05:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executing_high_water": 0, 2023-09-13T10:05:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_executed": 0, 2023-09-13T10:05:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.480 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 6551, 2023-09-13T10:05:08.481 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 406747744, 2023-09-13T10:05:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 6551, 2023-09-13T10:05:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 6551, 2023-09-13T10:05:08.482 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 406747744, 2023-09-13T10:05:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.483 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 104857600, 2023-09-13T10:05:08.484 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 6040, 2023-09-13T10:05:08.485 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 404758870, 2023-09-13T10:05:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 6040, 2023-09-13T10:05:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 404758870, 2023-09-13T10:05:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.486 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:08.487 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 1024, 2023-09-13T10:05:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:08.488 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 6040, 2023-09-13T10:05:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 6040, 2023-09-13T10:05:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 6040, 2023-09-13T10:05:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 6040, 2023-09-13T10:05:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:08.489 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.490 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:08.491 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 0, 2023-09-13T10:05:08.492 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 0, 2023-09-13T10:05:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.493 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.494 INFO:teuthology.orchestra.run.smithi053.stdout: }, 2023-09-13T10:05:08.494 INFO:teuthology.orchestra.run.smithi053.stdout: "throttle-write_buf_throttle-0x55d706b1a960": { 2023-09-13T10:05:08.494 INFO:teuthology.orchestra.run.smithi053.stdout: "val": 0, 2023-09-13T10:05:08.494 INFO:teuthology.orchestra.run.smithi053.stdout: "max": 3758096384, 2023-09-13T10:05:08.494 INFO:teuthology.orchestra.run.smithi053.stdout: "get_started": 0, 2023-09-13T10:05:08.494 INFO:teuthology.orchestra.run.smithi053.stdout: "get": 0, 2023-09-13T10:05:08.495 INFO:teuthology.orchestra.run.smithi053.stdout: "get_sum": 0, 2023-09-13T10:05:08.495 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:08.495 INFO:teuthology.orchestra.run.smithi053.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:08.495 INFO:teuthology.orchestra.run.smithi053.stdout: "take": 0, 2023-09-13T10:05:08.495 INFO:teuthology.orchestra.run.smithi053.stdout: "take_sum": 0, 2023-09-13T10:05:08.496 INFO:teuthology.orchestra.run.smithi053.stdout: "put": 0, 2023-09-13T10:05:08.496 INFO:teuthology.orchestra.run.smithi053.stdout: "put_sum": 0, 2023-09-13T10:05:08.496 INFO:teuthology.orchestra.run.smithi053.stdout: "wait": { 2023-09-13T10:05:08.496 INFO:teuthology.orchestra.run.smithi053.stdout: "avgcount": 0, 2023-09-13T10:05:08.496 INFO:teuthology.orchestra.run.smithi053.stdout: "sum": 0.000000000, 2023-09-13T10:05:08.496 INFO:teuthology.orchestra.run.smithi053.stdout: "avgtime": 0.000000000 2023-09-13T10:05:08.497 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.497 INFO:teuthology.orchestra.run.smithi053.stdout: } 2023-09-13T10:05:08.497 INFO:teuthology.orchestra.run.smithi053.stdout:} 2023-09-13T10:05:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:08 smithi006 ceph-mon[98665]: pgmap v1068: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 8.9 MiB/s wr, 247 op/s 2023-09-13T10:05:08.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:08 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:05:08.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:08 smithi131 ceph-mon[102785]: pgmap v1068: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 8.9 MiB/s wr, 247 op/s 2023-09-13T10:05:08.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:08 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-09-13T10:05:08.822 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-09-13T10:05:08.822 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-09-13T10:05:08.822 DEBUG:tasks.check_counter:Getting stats from c 2023-09-13T10:05:08.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.c perf dump 2023-09-13T10:05:09.269 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:09 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:05:09.270 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:09 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:05:09.271 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:09 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:05:09.454 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T10:05:09.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:05:09.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:05:09.508 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:09 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:05:09.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:09 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-09-13T10:05:09.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:09 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-09-13T10:05:09.509 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:09 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' 2023-09-13T10:05:10.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:10 smithi053 ceph-mon[102373]: pgmap v1069: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 6.4 MiB/s wr, 213 op/s 2023-09-13T10:05:10.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:10 smithi006 ceph-mon[98665]: pgmap v1069: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 6.4 MiB/s wr, 213 op/s 2023-09-13T10:05:10.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:10 smithi131 ceph-mon[102785]: pgmap v1069: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 6.4 MiB/s wr, 213 op/s 2023-09-13T10:05:11.105 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-09-13T10:05:11.105 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:11.106 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 132530, 2023-09-13T10:05:11.106 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 119874, 2023-09-13T10:05:11.106 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 36701190, 2023-09-13T10:05:11.106 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 145081437, 2023-09-13T10:05:11.107 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 15, 2023-09-13T10:05:11.107 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 4, 2023-09-13T10:05:11.107 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 8.861471096, 2023-09-13T10:05:11.107 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 3.613734821, 2023-09-13T10:05:11.107 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 4.660176257, 2023-09-13T10:05:11.107 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 1.347705562, 2023-09-13T10:05:11.108 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:11.108 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 119872, 2023-09-13T10:05:11.108 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 7.543917641, 2023-09-13T10:05:11.108 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000062933 2023-09-13T10:05:11.108 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.109 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:11.109 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 182332, 2023-09-13T10:05:11.109 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.029575175, 2023-09-13T10:05:11.109 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000162 2023-09-13T10:05:11.109 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.110 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-13T10:05:11.110 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2023-09-13T10:05:11.110 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.110 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:11.110 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 255631, 2023-09-13T10:05:11.111 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 229212, 2023-09-13T10:05:11.111 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 66072094, 2023-09-13T10:05:11.111 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 156050226, 2023-09-13T10:05:11.111 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 8, 2023-09-13T10:05:11.111 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 7, 2023-09-13T10:05:11.111 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 13.539619370, 2023-09-13T10:05:11.112 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 5.095455676, 2023-09-13T10:05:11.112 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 9.272437428, 2023-09-13T10:05:11.112 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.902916552, 2023-09-13T10:05:11.112 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:11.112 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 229212, 2023-09-13T10:05:11.113 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 13.462966903, 2023-09-13T10:05:11.113 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000058735 2023-09-13T10:05:11.113 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.113 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:11.113 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 423700, 2023-09-13T10:05:11.114 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.063504144, 2023-09-13T10:05:11.114 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000149 2023-09-13T10:05:11.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.114 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 970288, 2023-09-13T10:05:11.114 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 318336 2023-09-13T10:05:11.114 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.115 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:11.115 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 357525, 2023-09-13T10:05:11.115 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 503508, 2023-09-13T10:05:11.115 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 114415656, 2023-09-13T10:05:11.115 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 441633289, 2023-09-13T10:05:11.116 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 94, 2023-09-13T10:05:11.116 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 7, 2023-09-13T10:05:11.116 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 22.656262901, 2023-09-13T10:05:11.116 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 10.039166152, 2023-09-13T10:05:11.117 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 18.981915064, 2023-09-13T10:05:11.117 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.593158612, 2023-09-13T10:05:11.117 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:11.117 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 503506, 2023-09-13T10:05:11.117 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 55.729566196, 2023-09-13T10:05:11.118 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000110683 2023-09-13T10:05:11.118 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.118 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:11.118 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 730970, 2023-09-13T10:05:11.118 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.117894283, 2023-09-13T10:05:11.118 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000161 2023-09-13T10:05:11.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.119 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 88510880, 2023-09-13T10:05:11.119 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 375461360 2023-09-13T10:05:11.119 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.119 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-09-13T10:05:11.120 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2023-09-13T10:05:11.120 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-09-13T10:05:11.120 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.120 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2023-09-13T10:05:11.120 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:11.120 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:11.121 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 86302, 2023-09-13T10:05:11.121 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 76.062156232, 2023-09-13T10:05:11.121 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000881348 2023-09-13T10:05:11.121 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.121 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.122 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:11.122 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:11.122 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:11.122 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 49527, 2023-09-13T10:05:11.122 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 3.912198583, 2023-09-13T10:05:11.123 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000078991 2023-09-13T10:05:11.123 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.123 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.123 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2023-09-13T10:05:11.123 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 170740, 2023-09-13T10:05:11.124 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 153757, 2023-09-13T10:05:11.124 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2023-09-13T10:05:11.124 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 153757, 2023-09-13T10:05:11.124 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 549.173440382, 2023-09-13T10:05:11.124 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.003571697 2023-09-13T10:05:11.124 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.125 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2023-09-13T10:05:11.125 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 16983, 2023-09-13T10:05:11.125 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 0, 2023-09-13T10:05:11.125 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:11.125 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 126, 2023-09-13T10:05:11.126 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 11, 2023-09-13T10:05:11.126 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 18, 2023-09-13T10:05:11.126 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 1052, 2023-09-13T10:05:11.126 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 683, 2023-09-13T10:05:11.126 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 339, 2023-09-13T10:05:11.127 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 30, 2023-09-13T10:05:11.127 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 76, 2023-09-13T10:05:11.127 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 918, 2023-09-13T10:05:11.127 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 0, 2023-09-13T10:05:11.127 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 0, 2023-09-13T10:05:11.127 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 6, 2023-09-13T10:05:11.128 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 338920, 2023-09-13T10:05:11.128 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 161808, 2023-09-13T10:05:11.128 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 16974, 2023-09-13T10:05:11.128 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 83, 2023-09-13T10:05:11.128 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:11.129 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:11.129 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 5467, 2023-09-13T10:05:11.129 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 1000, 2023-09-13T10:05:11.129 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 1, 2023-09-13T10:05:11.129 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 17, 2023-09-13T10:05:11.129 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 351, 2023-09-13T10:05:11.130 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 24, 2023-09-13T10:05:11.130 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 629, 2023-09-13T10:05:11.130 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:11.130 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 2753, 2023-09-13T10:05:11.130 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 1, 2023-09-13T10:05:11.131 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 736, 2023-09-13T10:05:11.131 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 212049369, 2023-09-13T10:05:11.131 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 0, 2023-09-13T10:05:11.131 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 2753, 2023-09-13T10:05:11.131 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:11.132 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:11.132 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:11.132 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 160, 2023-09-13T10:05:11.132 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:05:11.132 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 160, 2023-09-13T10:05:11.133 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 2593, 2023-09-13T10:05:11.133 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 18, 2023-09-13T10:05:11.133 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 15116, 2023-09-13T10:05:11.133 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 126172, 2023-09-13T10:05:11.133 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:11.134 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:11.134 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:11.134 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 54754, 2023-09-13T10:05:11.134 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 25178, 2023-09-13T10:05:11.134 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 6502, 2023-09-13T10:05:11.135 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 138200 2023-09-13T10:05:11.135 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.135 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2023-09-13T10:05:11.135 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 536, 2023-09-13T10:05:11.135 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 167, 2023-09-13T10:05:11.136 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 107, 2023-09-13T10:05:11.136 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 199, 2023-09-13T10:05:11.136 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 555, 2023-09-13T10:05:11.136 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 8, 2023-09-13T10:05:11.136 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:11.136 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:11.137 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 26985, 2023-09-13T10:05:11.137 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 26977, 2023-09-13T10:05:11.137 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:11.137 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 0, 2023-09-13T10:05:11.137 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:11.138 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:11.138 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:11.138 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2023-09-13T10:05:11.138 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2023-09-13T10:05:11.138 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:05:11.139 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 17, 2023-09-13T10:05:11.139 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2023-09-13T10:05:11.139 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 29, 2023-09-13T10:05:11.139 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:11.139 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0 2023-09-13T10:05:11.140 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.140 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2023-09-13T10:05:11.140 INFO:teuthology.orchestra.run.smithi131.stdout: "evlrg": 0, 2023-09-13T10:05:11.140 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 154943, 2023-09-13T10:05:11.140 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 57227, 2023-09-13T10:05:11.140 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 49161, 2023-09-13T10:05:11.141 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 105782, 2023-09-13T10:05:11.141 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2023-09-13T10:05:11.141 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 8066, 2023-09-13T10:05:11.141 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 201, 2023-09-13T10:05:11.141 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 73, 2023-09-13T10:05:11.142 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 63, 2023-09-13T10:05:11.142 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 138, 2023-09-13T10:05:11.142 INFO:teuthology.orchestra.run.smithi131.stdout: "segmjr": 9, 2023-09-13T10:05:11.142 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2023-09-13T10:05:11.142 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 10, 2023-09-13T10:05:11.142 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 72032335, 2023-09-13T10:05:11.143 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 256120342, 2023-09-13T10:05:11.143 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 0, 2023-09-13T10:05:11.143 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2023-09-13T10:05:11.143 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 44823, 2023-09-13T10:05:11.143 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 360.452802368, 2023-09-13T10:05:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.008041692 2023-09-13T10:05:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 0 2023-09-13T10:05:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2023-09-13T10:05:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 43, 2023-09-13T10:05:11.145 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 27304, 2023-09-13T10:05:11.145 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 27261, 2023-09-13T10:05:11.145 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 41, 2023-09-13T10:05:11.145 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 256, 2023-09-13T10:05:11.145 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 215, 2023-09-13T10:05:11.146 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 1060, 2023-09-13T10:05:11.146 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 46300, 2023-09-13T10:05:11.146 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 45240, 2023-09-13T10:05:11.146 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 0, 2023-09-13T10:05:11.146 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 29803, 2023-09-13T10:05:11.147 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 29803, 2023-09-13T10:05:11.147 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 74320, 2023-09-13T10:05:11.147 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 198960 2023-09-13T10:05:11.147 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.147 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2023-09-13T10:05:11.147 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 288413, 2023-09-13T10:05:11.148 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 13224, 2023-09-13T10:05:11.148 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 170740, 2023-09-13T10:05:11.148 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 4087, 2023-09-13T10:05:11.148 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 50895, 2023-09-13T10:05:11.148 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2023-09-13T10:05:11.149 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 26807, 2023-09-13T10:05:11.149 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 202.916157462, 2023-09-13T10:05:11.149 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.007569521 2023-09-13T10:05:11.149 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.149 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2023-09-13T10:05:11.149 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 4019, 2023-09-13T10:05:11.150 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 72.010086654, 2023-09-13T10:05:11.150 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.017917413 2023-09-13T10:05:11.150 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.150 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:11.150 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.151 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.151 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.151 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.151 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2023-09-13T10:05:11.151 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.151 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.152 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.152 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.152 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2023-09-13T10:05:11.152 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 45809, 2023-09-13T10:05:11.152 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 56.575969796, 2023-09-13T10:05:11.153 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001235040 2023-09-13T10:05:11.153 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.153 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:11.153 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.153 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.154 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.154 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.154 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2023-09-13T10:05:11.154 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.154 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.154 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.155 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.155 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2023-09-13T10:05:11.155 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.155 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.155 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.156 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.156 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:11.156 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.156 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.156 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.157 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.157 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:11.157 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.157 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.157 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.158 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2023-09-13T10:05:11.158 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.158 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.158 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.158 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.159 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2023-09-13T10:05:11.159 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.159 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.159 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.160 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.160 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2023-09-13T10:05:11.160 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.161 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.161 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.161 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.161 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2023-09-13T10:05:11.161 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.162 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.162 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.162 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.162 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2023-09-13T10:05:11.162 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.163 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.163 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.163 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.163 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2023-09-13T10:05:11.163 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 43089, 2023-09-13T10:05:11.163 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 77.981763125, 2023-09-13T10:05:11.164 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001809783 2023-09-13T10:05:11.164 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.164 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2023-09-13T10:05:11.164 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 6392, 2023-09-13T10:05:11.164 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 33.314261910, 2023-09-13T10:05:11.165 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.005211868 2023-09-13T10:05:11.165 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.165 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:11.165 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.165 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.166 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.166 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.166 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:11.166 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.166 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.166 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.167 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.167 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2023-09-13T10:05:11.167 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 10, 2023-09-13T10:05:11.167 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.099795517, 2023-09-13T10:05:11.167 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.009979551 2023-09-13T10:05:11.168 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.168 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:11.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.168 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.168 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.169 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:11.169 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.169 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.169 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.169 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.170 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2023-09-13T10:05:11.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 36, 2023-09-13T10:05:11.170 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.647557796, 2023-09-13T10:05:11.170 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.017987716 2023-09-13T10:05:11.170 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.171 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:11.171 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.171 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.171 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.171 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.172 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:11.172 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 620, 2023-09-13T10:05:11.172 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.898971163, 2023-09-13T10:05:11.172 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001449953 2023-09-13T10:05:11.172 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.172 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2023-09-13T10:05:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.173 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2023-09-13T10:05:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.174 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2023-09-13T10:05:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2023-09-13T10:05:11.175 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 26975, 2023-09-13T10:05:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 104.728876959, 2023-09-13T10:05:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.003882442 2023-09-13T10:05:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:11.176 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.177 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2023-09-13T10:05:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 1, 2023-09-13T10:05:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 1, 2023-09-13T10:05:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 0, 2023-09-13T10:05:11.178 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 1, 2023-09-13T10:05:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2023-09-13T10:05:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 14659, 2023-09-13T10:05:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 14659, 2023-09-13T10:05:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 1528, 2023-09-13T10:05:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:11.179 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-09-13T10:05:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:11.180 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:11.181 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:11.182 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:11.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:11.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:11.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:11.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:11.183 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:11.184 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:11.184 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:11.184 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:11.184 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:11.184 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:11.184 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:11.185 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:11.185 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:11.185 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:11.185 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:11.185 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:11.186 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-09-13T10:05:11.186 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:11.186 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:11.186 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:11.186 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:11.187 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 306657, 2023-09-13T10:05:11.187 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 138, 2023-09-13T10:05:11.187 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 440, 2023-09-13T10:05:11.187 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 5, 2023-09-13T10:05:11.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-09-13T10:05:11.187 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-09-13T10:05:11.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:11.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:11.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:11.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:11.188 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:11.189 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 165, 2023-09-13T10:05:11.189 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:11.189 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:11.189 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:11.189 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-09-13T10:05:11.189 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 986254, 2023-09-13T10:05:11.190 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 14055, 2023-09-13T10:05:11.190 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:11.190 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-09-13T10:05:11.190 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:11.190 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-09-13T10:05:11.191 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.191 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2023-09-13T10:05:11.191 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2023-09-13T10:05:11.191 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2023-09-13T10:05:11.191 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 77939, 2023-09-13T10:05:11.191 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 257908362, 2023-09-13T10:05:11.192 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 27, 2023-09-13T10:05:11.192 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 77939, 2023-09-13T10:05:11.192 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2023-09-13T10:05:11.192 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 77939, 2023-09-13T10:05:11.192 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 648.582223020, 2023-09-13T10:05:11.193 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.008321664 2023-09-13T10:05:11.193 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.193 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2023-09-13T10:05:11.193 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2023-09-13T10:05:11.193 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 77939, 2023-09-13T10:05:11.194 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 78821 2023-09-13T10:05:11.194 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.194 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 77939, 2023-09-13T10:05:11.194 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 3794, 2023-09-13T10:05:11.194 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 74145, 2023-09-13T10:05:11.195 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2023-09-13T10:05:11.195 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2023-09-13T10:05:11.195 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 0, 2023-09-13T10:05:11.195 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 98, 2023-09-13T10:05:11.195 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 1041, 2023-09-13T10:05:11.195 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 45864, 2023-09-13T10:05:11.196 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 598, 2023-09-13T10:05:11.196 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2023-09-13T10:05:11.196 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2023-09-13T10:05:11.196 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2023-09-13T10:05:11.196 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 11, 2023-09-13T10:05:11.197 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 27160, 2023-09-13T10:05:11.197 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2023-09-13T10:05:11.197 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:11.197 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:11.197 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 2753, 2023-09-13T10:05:11.197 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 196, 2023-09-13T10:05:11.198 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:11.198 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:11.198 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:11.198 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2023-09-13T10:05:11.198 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2023-09-13T10:05:11.199 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2023-09-13T10:05:11.199 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:11.199 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2023-09-13T10:05:11.199 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:11.199 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2023-09-13T10:05:11.199 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2023-09-13T10:05:11.200 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2023-09-13T10:05:11.200 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2023-09-13T10:05:11.200 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2023-09-13T10:05:11.200 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2023-09-13T10:05:11.200 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2023-09-13T10:05:11.201 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2023-09-13T10:05:11.201 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2023-09-13T10:05:11.201 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2023-09-13T10:05:11.201 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2023-09-13T10:05:11.201 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2023-09-13T10:05:11.202 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2023-09-13T10:05:11.202 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2023-09-13T10:05:11.202 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2023-09-13T10:05:11.202 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2023-09-13T10:05:11.202 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2023-09-13T10:05:11.202 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 88, 2023-09-13T10:05:11.203 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2023-09-13T10:05:11.203 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 4, 2023-09-13T10:05:11.203 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 12, 2023-09-13T10:05:11.203 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 12, 2023-09-13T10:05:11.203 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2023-09-13T10:05:11.204 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2023-09-13T10:05:11.204 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 809, 2023-09-13T10:05:11.204 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 0, 2023-09-13T10:05:11.204 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 291 2023-09-13T10:05:11.204 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.204 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2023-09-13T10:05:11.205 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 1, 2023-09-13T10:05:11.205 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:11.205 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2023-09-13T10:05:11.205 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2023-09-13T10:05:11.205 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.206 INFO:teuthology.orchestra.run.smithi131.stdout: "osd-slow-ops": { 2023-09-13T10:05:11.206 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 0 2023-09-13T10:05:11.206 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.206 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2023-09-13T10:05:11.206 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:11.207 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 6, 2023-09-13T10:05:11.207 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2023-09-13T10:05:11.207 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 6, 2023-09-13T10:05:11.207 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 26977, 2023-09-13T10:05:11.207 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:11.208 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.208 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:11.208 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:11.208 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:11.209 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:11.209 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 745682, 2023-09-13T10:05:11.209 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 138344924, 2023-09-13T10:05:11.209 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:11.210 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 745682, 2023-09-13T10:05:11.210 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:11.210 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:11.210 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 745682, 2023-09-13T10:05:11.210 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 138344924, 2023-09-13T10:05:11.211 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:11.211 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.211 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.211 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.211 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.211 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.212 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:11.212 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:11.212 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:11.212 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:11.213 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:11.213 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:11.213 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:11.213 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:11.213 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 77939, 2023-09-13T10:05:11.213 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 260633039, 2023-09-13T10:05:11.214 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 77939, 2023-09-13T10:05:11.214 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 260633039, 2023-09-13T10:05:11.214 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:11.214 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.214 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.215 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.215 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.215 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.215 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:11.215 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:11.216 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2023-09-13T10:05:11.216 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:11.216 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:11.216 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:11.216 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:11.216 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:11.217 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 77939, 2023-09-13T10:05:11.217 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 77939, 2023-09-13T10:05:11.217 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 77939, 2023-09-13T10:05:11.217 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 77939, 2023-09-13T10:05:11.217 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:11.218 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.218 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.218 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.218 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.218 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.218 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:11.219 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:11.219 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:11.219 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:11.219 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 26977, 2023-09-13T10:05:11.219 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 2724677, 2023-09-13T10:05:11.220 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:11.220 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 26977, 2023-09-13T10:05:11.220 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:11.220 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:11.220 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 1041, 2023-09-13T10:05:11.220 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 2724677, 2023-09-13T10:05:11.221 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:11.221 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.221 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.221 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.221 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.222 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:11.222 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x55a26c618640": { 2023-09-13T10:05:11.222 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:11.222 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:11.222 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:11.223 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 154943, 2023-09-13T10:05:11.223 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 251926038, 2023-09-13T10:05:11.223 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:11.223 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 154943, 2023-09-13T10:05:11.223 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:11.223 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:11.224 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 44823, 2023-09-13T10:05:11.224 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 251926038, 2023-09-13T10:05:11.224 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:11.224 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:11.224 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:11.225 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:11.225 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.225 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:11.225 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-09-13T10:05:11.517 INFO:tasks.check_counter:Daemon mds.c mds.exported=17 2023-09-13T10:05:11.517 INFO:tasks.check_counter:Daemon mds.c mds.imported=24 2023-09-13T10:05:11.517 DEBUG:tasks.check_counter:Getting stats from f 2023-09-13T10:05:11.518 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.f perf dump 2023-09-13T10:05:12.076 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T10:05:12.475 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:12 smithi131 ceph-mon[102785]: pgmap v1070: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 3.0 MiB/s wr, 157 op/s 2023-09-13T10:05:12.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:12 smithi053 ceph-mon[102373]: pgmap v1070: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 3.0 MiB/s wr, 157 op/s 2023-09-13T10:05:12.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:12 smithi006 ceph-mon[98665]: pgmap v1070: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 220 KiB/s rd, 3.0 MiB/s wr, 157 op/s 2023-09-13T10:05:13.322 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-09-13T10:05:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 3476, 2023-09-13T10:05:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 3412, 2023-09-13T10:05:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 110880133, 2023-09-13T10:05:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 1187230, 2023-09-13T10:05:13.323 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 7, 2023-09-13T10:05:13.324 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 3, 2023-09-13T10:05:13.324 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.344548251, 2023-09-13T10:05:13.324 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.081595824, 2023-09-13T10:05:13.324 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.143057120, 2023-09-13T10:05:13.324 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.098119574, 2023-09-13T10:05:13.325 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:13.325 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3411, 2023-09-13T10:05:13.325 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.209469443, 2023-09-13T10:05:13.325 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000061409 2023-09-13T10:05:13.325 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.326 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:13.326 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.326 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.326 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.326 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.327 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 941056, 2023-09-13T10:05:13.327 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 264800 2023-09-13T10:05:13.327 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.327 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:13.327 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 1532, 2023-09-13T10:05:13.327 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 1861, 2023-09-13T10:05:13.328 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 147191492, 2023-09-13T10:05:13.328 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 1215964, 2023-09-13T10:05:13.328 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 8, 2023-09-13T10:05:13.328 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 6, 2023-09-13T10:05:13.328 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.194582233, 2023-09-13T10:05:13.329 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.039845403, 2023-09-13T10:05:13.329 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.104024773, 2023-09-13T10:05:13.329 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.039504175, 2023-09-13T10:05:13.329 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:13.329 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1860, 2023-09-13T10:05:13.329 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.145432848, 2023-09-13T10:05:13.330 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000078189 2023-09-13T10:05:13.330 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.330 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:13.330 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.331 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.331 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.331 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 3264, 2023-09-13T10:05:13.331 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 741312 2023-09-13T10:05:13.331 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.332 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:13.332 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 1577, 2023-09-13T10:05:13.332 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 1579, 2023-09-13T10:05:13.332 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 119548420, 2023-09-13T10:05:13.332 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 490454, 2023-09-13T10:05:13.333 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 6, 2023-09-13T10:05:13.333 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:13.333 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.176344131, 2023-09-13T10:05:13.333 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.036790275, 2023-09-13T10:05:13.333 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.085734386, 2023-09-13T10:05:13.333 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.043631674, 2023-09-13T10:05:13.334 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:13.334 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1577, 2023-09-13T10:05:13.334 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.076466259, 2023-09-13T10:05:13.334 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000048488 2023-09-13T10:05:13.335 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.335 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:13.335 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.335 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.335 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.336 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-13T10:05:13.336 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2023-09-13T10:05:13.336 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.337 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-09-13T10:05:13.337 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2023-09-13T10:05:13.337 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-09-13T10:05:13.337 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.338 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2023-09-13T10:05:13.338 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:13.338 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:13.339 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 10281, 2023-09-13T10:05:13.339 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.506849605, 2023-09-13T10:05:13.339 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000049299 2023-09-13T10:05:13.340 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.340 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.340 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:13.341 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:13.341 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:13.341 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.342 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.342 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.342 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.343 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.343 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2023-09-13T10:05:13.343 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 0, 2023-09-13T10:05:13.344 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 0, 2023-09-13T10:05:13.344 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2023-09-13T10:05:13.344 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.345 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.345 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.345 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.346 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2023-09-13T10:05:13.346 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 0, 2023-09-13T10:05:13.346 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 0, 2023-09-13T10:05:13.347 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:13.347 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 0, 2023-09-13T10:05:13.347 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 0, 2023-09-13T10:05:13.347 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 0, 2023-09-13T10:05:13.348 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 23165, 2023-09-13T10:05:13.348 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 158, 2023-09-13T10:05:13.348 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 17771, 2023-09-13T10:05:13.348 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 5236, 2023-09-13T10:05:13.348 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 22939, 2023-09-13T10:05:13.348 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 18724, 2023-09-13T10:05:13.349 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 0, 2023-09-13T10:05:13.349 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 0, 2023-09-13T10:05:13.349 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 2, 2023-09-13T10:05:13.349 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 0, 2023-09-13T10:05:13.349 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 0, 2023-09-13T10:05:13.350 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 0, 2023-09-13T10:05:13.350 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 0, 2023-09-13T10:05:13.350 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:13.350 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:13.350 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 0, 2023-09-13T10:05:13.351 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 0, 2023-09-13T10:05:13.351 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 0, 2023-09-13T10:05:13.351 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 0, 2023-09-13T10:05:13.351 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 0, 2023-09-13T10:05:13.351 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 0, 2023-09-13T10:05:13.351 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 0, 2023-09-13T10:05:13.352 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:13.352 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 0, 2023-09-13T10:05:13.352 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 0, 2023-09-13T10:05:13.352 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 4, 2023-09-13T10:05:13.352 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 246, 2023-09-13T10:05:13.353 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 0, 2023-09-13T10:05:13.353 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 0, 2023-09-13T10:05:13.353 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:13.353 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:13.353 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:13.354 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 0, 2023-09-13T10:05:13.354 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:05:13.354 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 0, 2023-09-13T10:05:13.354 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 0, 2023-09-13T10:05:13.354 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 0, 2023-09-13T10:05:13.354 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 0, 2023-09-13T10:05:13.355 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 0, 2023-09-13T10:05:13.355 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:13.355 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:13.355 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:13.355 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 0, 2023-09-13T10:05:13.356 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 0, 2023-09-13T10:05:13.356 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 0, 2023-09-13T10:05:13.356 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 0 2023-09-13T10:05:13.356 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.356 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2023-09-13T10:05:13.357 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 0, 2023-09-13T10:05:13.357 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 0, 2023-09-13T10:05:13.357 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 0, 2023-09-13T10:05:13.357 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 0, 2023-09-13T10:05:13.357 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 0, 2023-09-13T10:05:13.357 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 0, 2023-09-13T10:05:13.358 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:13.358 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:13.358 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 0, 2023-09-13T10:05:13.358 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 0, 2023-09-13T10:05:13.358 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:13.359 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 0, 2023-09-13T10:05:13.359 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:13.359 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:13.359 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:13.359 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2023-09-13T10:05:13.360 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2023-09-13T10:05:13.360 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:05:13.360 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 0, 2023-09-13T10:05:13.360 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2023-09-13T10:05:13.360 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 0, 2023-09-13T10:05:13.360 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:13.361 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0 2023-09-13T10:05:13.361 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.361 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2023-09-13T10:05:13.361 INFO:teuthology.orchestra.run.smithi131.stdout: "evlrg": 0, 2023-09-13T10:05:13.361 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 0, 2023-09-13T10:05:13.362 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 0, 2023-09-13T10:05:13.362 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 0, 2023-09-13T10:05:13.362 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 192617, 2023-09-13T10:05:13.362 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2023-09-13T10:05:13.362 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 0, 2023-09-13T10:05:13.363 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 0, 2023-09-13T10:05:13.363 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 0, 2023-09-13T10:05:13.363 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 0, 2023-09-13T10:05:13.363 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 131, 2023-09-13T10:05:13.363 INFO:teuthology.orchestra.run.smithi131.stdout: "segmjr": 17, 2023-09-13T10:05:13.364 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2023-09-13T10:05:13.364 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 0, 2023-09-13T10:05:13.364 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 156674203, 2023-09-13T10:05:13.364 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 379196026, 2023-09-13T10:05:13.364 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 379194888, 2023-09-13T10:05:13.364 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2023-09-13T10:05:13.365 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.365 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.365 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.365 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.365 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 192617 2023-09-13T10:05:13.366 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.366 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2023-09-13T10:05:13.366 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 30, 2023-09-13T10:05:13.366 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 41863, 2023-09-13T10:05:13.366 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 41833, 2023-09-13T10:05:13.367 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 25, 2023-09-13T10:05:13.367 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 197, 2023-09-13T10:05:13.367 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 172, 2023-09-13T10:05:13.367 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 23165, 2023-09-13T10:05:13.367 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 42326, 2023-09-13T10:05:13.368 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 19161, 2023-09-13T10:05:13.368 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 0, 2023-09-13T10:05:13.368 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 0, 2023-09-13T10:05:13.368 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 0, 2023-09-13T10:05:13.368 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 74656, 2023-09-13T10:05:13.368 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 207152 2023-09-13T10:05:13.369 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.369 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2023-09-13T10:05:13.369 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 0, 2023-09-13T10:05:13.369 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 0, 2023-09-13T10:05:13.369 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 0, 2023-09-13T10:05:13.370 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 0, 2023-09-13T10:05:13.370 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 0, 2023-09-13T10:05:13.370 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2023-09-13T10:05:13.370 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.370 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.373 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.373 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.373 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2023-09-13T10:05:13.374 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.374 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.374 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.374 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.374 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:13.375 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.375 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.375 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.375 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.375 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2023-09-13T10:05:13.375 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.376 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.376 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.376 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.376 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2023-09-13T10:05:13.376 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.377 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.377 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.377 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.377 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:13.377 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.377 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.378 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.378 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.378 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2023-09-13T10:05:13.378 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.378 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.379 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.379 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.379 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2023-09-13T10:05:13.379 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.379 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.380 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.380 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.380 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:13.380 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.380 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.380 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.381 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:13.381 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.381 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.381 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.381 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.382 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2023-09-13T10:05:13.382 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.382 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.382 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.382 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.383 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2023-09-13T10:05:13.383 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.383 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.383 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.383 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.383 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2023-09-13T10:05:13.384 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.384 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.384 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.384 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.384 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2023-09-13T10:05:13.385 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.385 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.385 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.385 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.385 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2023-09-13T10:05:13.385 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.386 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.386 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.386 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.386 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2023-09-13T10:05:13.386 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.387 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.387 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.387 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.387 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2023-09-13T10:05:13.388 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.388 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.388 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.388 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.388 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:13.389 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.389 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.389 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.389 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.389 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:13.389 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.390 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.390 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.390 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.390 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2023-09-13T10:05:13.390 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.391 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.391 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.391 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.391 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:13.391 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.391 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.392 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.392 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.392 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:13.392 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.392 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.393 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.393 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.393 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2023-09-13T10:05:13.393 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.393 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.394 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.394 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:13.394 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.394 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.394 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.395 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:13.395 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.395 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.395 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.396 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.396 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2023-09-13T10:05:13.396 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.396 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.396 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.397 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2023-09-13T10:05:13.397 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.397 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.397 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.397 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.398 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2023-09-13T10:05:13.398 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.398 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.398 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.398 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.399 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2023-09-13T10:05:13.399 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.399 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.399 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.400 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:13.400 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:13.400 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:13.400 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.400 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.400 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.401 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.401 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2023-09-13T10:05:13.401 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 1, 2023-09-13T10:05:13.401 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 2, 2023-09-13T10:05:13.402 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 1, 2023-09-13T10:05:13.402 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 2, 2023-09-13T10:05:13.402 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2023-09-13T10:05:13.402 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 0, 2023-09-13T10:05:13.402 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 0, 2023-09-13T10:05:13.402 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 4169, 2023-09-13T10:05:13.403 INFO:teuthology.orchestra.run.smithi131.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:13.403 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.403 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-09-13T10:05:13.403 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:13.403 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:13.404 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:13.404 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:13.404 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:13.404 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:13.404 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:13.404 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:13.405 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:13.405 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:13.405 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:13.405 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:13.405 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:13.406 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:13.406 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:13.406 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:13.406 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:13.406 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:13.407 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:13.407 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:13.407 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:13.407 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:13.407 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:13.408 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:13.408 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:13.408 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:13.408 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:13.408 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:13.409 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:13.409 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:13.409 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:13.409 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-09-13T10:05:13.409 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:13.409 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:13.410 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:13.410 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:13.410 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 241317, 2023-09-13T10:05:13.410 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 91, 2023-09-13T10:05:13.410 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2023-09-13T10:05:13.411 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2023-09-13T10:05:13.411 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-09-13T10:05:13.411 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-09-13T10:05:13.411 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:13.411 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:13.412 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:13.412 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:13.412 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:13.412 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 165, 2023-09-13T10:05:13.412 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:13.412 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:13.413 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:13.413 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-09-13T10:05:13.413 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 16407118, 2023-09-13T10:05:13.413 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 93834, 2023-09-13T10:05:13.413 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:13.413 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-09-13T10:05:13.414 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:13.414 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-09-13T10:05:13.414 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.414 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2023-09-13T10:05:13.414 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2023-09-13T10:05:13.415 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2023-09-13T10:05:13.415 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 6069, 2023-09-13T10:05:13.415 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 26, 2023-09-13T10:05:13.415 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 4, 2023-09-13T10:05:13.415 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 6069, 2023-09-13T10:05:13.416 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2023-09-13T10:05:13.416 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 6069, 2023-09-13T10:05:13.416 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 21.182585554, 2023-09-13T10:05:13.416 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.003490292 2023-09-13T10:05:13.416 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.416 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2023-09-13T10:05:13.417 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2023-09-13T10:05:13.417 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 6069, 2023-09-13T10:05:13.417 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 6070 2023-09-13T10:05:13.417 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.417 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 6069, 2023-09-13T10:05:13.417 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 6069, 2023-09-13T10:05:13.418 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 0, 2023-09-13T10:05:13.418 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2023-09-13T10:05:13.418 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2023-09-13T10:05:13.418 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 3230, 2023-09-13T10:05:13.418 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 0, 2023-09-13T10:05:13.419 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 2836, 2023-09-13T10:05:13.419 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 0, 2023-09-13T10:05:13.419 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 0, 2023-09-13T10:05:13.419 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2023-09-13T10:05:13.419 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2023-09-13T10:05:13.420 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2023-09-13T10:05:13.420 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 0, 2023-09-13T10:05:13.420 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 0, 2023-09-13T10:05:13.420 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2023-09-13T10:05:13.420 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:13.420 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:13.421 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 2, 2023-09-13T10:05:13.421 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 0, 2023-09-13T10:05:13.421 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:13.421 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:13.421 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:13.421 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2023-09-13T10:05:13.422 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2023-09-13T10:05:13.422 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2023-09-13T10:05:13.422 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:13.422 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2023-09-13T10:05:13.422 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:13.423 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2023-09-13T10:05:13.423 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2023-09-13T10:05:13.423 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2023-09-13T10:05:13.423 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2023-09-13T10:05:13.423 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2023-09-13T10:05:13.424 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2023-09-13T10:05:13.424 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2023-09-13T10:05:13.424 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2023-09-13T10:05:13.424 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2023-09-13T10:05:13.424 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2023-09-13T10:05:13.424 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2023-09-13T10:05:13.425 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2023-09-13T10:05:13.425 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2023-09-13T10:05:13.425 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2023-09-13T10:05:13.425 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2023-09-13T10:05:13.425 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2023-09-13T10:05:13.426 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2023-09-13T10:05:13.426 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 88, 2023-09-13T10:05:13.426 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2023-09-13T10:05:13.426 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 4, 2023-09-13T10:05:13.426 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 11, 2023-09-13T10:05:13.427 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 11, 2023-09-13T10:05:13.427 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2023-09-13T10:05:13.427 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2023-09-13T10:05:13.427 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 0, 2023-09-13T10:05:13.427 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 2, 2023-09-13T10:05:13.427 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 0 2023-09-13T10:05:13.428 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.428 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2023-09-13T10:05:13.428 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 0, 2023-09-13T10:05:13.428 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:13.428 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2023-09-13T10:05:13.429 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2023-09-13T10:05:13.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.429 INFO:teuthology.orchestra.run.smithi131.stdout: "osd-slow-ops": { 2023-09-13T10:05:13.429 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 0 2023-09-13T10:05:13.429 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.430 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2023-09-13T10:05:13.430 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:13.430 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 0, 2023-09-13T10:05:13.430 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2023-09-13T10:05:13.430 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 0, 2023-09-13T10:05:13.430 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 0, 2023-09-13T10:05:13.431 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:13.431 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.431 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:13.431 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:13.431 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:13.432 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:13.432 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 6581, 2023-09-13T10:05:13.432 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 376998924, 2023-09-13T10:05:13.432 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:13.432 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 6581, 2023-09-13T10:05:13.432 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:13.433 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:13.433 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 6581, 2023-09-13T10:05:13.433 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 376998924, 2023-09-13T10:05:13.433 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:13.433 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.434 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.434 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.434 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.434 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.434 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:13.434 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:13.435 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:13.435 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:13.435 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:13.435 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:13.435 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:13.436 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:13.436 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 6069, 2023-09-13T10:05:13.436 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 375003957, 2023-09-13T10:05:13.436 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 6069, 2023-09-13T10:05:13.436 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 375003957, 2023-09-13T10:05:13.436 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:13.437 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.437 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.437 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.437 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.437 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.438 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:13.438 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:13.438 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2023-09-13T10:05:13.438 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:13.438 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:13.439 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:13.439 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:13.439 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:13.440 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 6069, 2023-09-13T10:05:13.440 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 6069, 2023-09-13T10:05:13.440 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 6069, 2023-09-13T10:05:13.440 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 6069, 2023-09-13T10:05:13.441 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:13.441 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.441 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.442 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.442 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.443 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:13.443 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:13.443 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:13.444 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:13.444 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:13.444 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:13.445 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:13.445 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:13.445 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:13.446 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:13.446 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2023-09-13T10:05:13.446 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2023-09-13T10:05:13.447 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:13.447 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.448 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.448 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.448 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:13.449 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x55a7dd1f2960": { 2023-09-13T10:05:13.449 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:13.449 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:13.449 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:13.450 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:13.450 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:13.450 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:13.450 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:13.450 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:13.451 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:13.451 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2023-09-13T10:05:13.451 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2023-09-13T10:05:13.451 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:13.451 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:13.452 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:13.452 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:13.452 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.452 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:13.452 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-09-13T10:05:13.633 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2023-09-13T10:05:13.634 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2023-09-13T10:05:13.634 DEBUG:tasks.check_counter:Getting stats from i 2023-09-13T10:05:13.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.i perf dump 2023-09-13T10:05:14.195 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T10:05:14.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:14 smithi006 ceph-mon[98665]: pgmap v1071: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 384 KiB/s wr, 97 op/s 2023-09-13T10:05:14.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:14 smithi053 ceph-mon[102373]: pgmap v1071: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 384 KiB/s wr, 97 op/s 2023-09-13T10:05:14.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:14 smithi131 ceph-mon[102785]: pgmap v1071: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 384 KiB/s wr, 97 op/s 2023-09-13T10:05:15.390 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-09-13T10:05:15.390 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:15.390 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 219957, 2023-09-13T10:05:15.391 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 230255, 2023-09-13T10:05:15.391 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 53555731, 2023-09-13T10:05:15.391 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 267026331, 2023-09-13T10:05:15.391 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 13, 2023-09-13T10:05:15.391 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:15.392 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 13.789860029, 2023-09-13T10:05:15.392 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 5.533017068, 2023-09-13T10:05:15.392 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 7.445749521, 2023-09-13T10:05:15.392 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 1.893047746, 2023-09-13T10:05:15.393 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:15.393 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 230254, 2023-09-13T10:05:15.393 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 14.484552191, 2023-09-13T10:05:15.393 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000062906 2023-09-13T10:05:15.394 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.394 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:15.394 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 337223, 2023-09-13T10:05:15.394 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.056279008, 2023-09-13T10:05:15.395 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000166 2023-09-13T10:05:15.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.395 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 2944, 2023-09-13T10:05:15.395 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 448 2023-09-13T10:05:15.395 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.395 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:15.396 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 641175, 2023-09-13T10:05:15.396 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 903096, 2023-09-13T10:05:15.396 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 200784198, 2023-09-13T10:05:15.396 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 619537240, 2023-09-13T10:05:15.396 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 19, 2023-09-13T10:05:15.397 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 7, 2023-09-13T10:05:15.397 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 38.171372583, 2023-09-13T10:05:15.397 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 16.832931000, 2023-09-13T10:05:15.397 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 27.652227686, 2023-09-13T10:05:15.397 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 1.056606671, 2023-09-13T10:05:15.398 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:15.398 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 903092, 2023-09-13T10:05:15.398 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 74.941344969, 2023-09-13T10:05:15.399 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000082983 2023-09-13T10:05:15.399 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.399 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:15.399 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1322514, 2023-09-13T10:05:15.400 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.194489486, 2023-09-13T10:05:15.400 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000147 2023-09-13T10:05:15.400 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.400 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 136499840, 2023-09-13T10:05:15.401 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 478447680 2023-09-13T10:05:15.401 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.401 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:15.401 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 91771, 2023-09-13T10:05:15.402 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 99084, 2023-09-13T10:05:15.402 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 28076932, 2023-09-13T10:05:15.402 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 154703448, 2023-09-13T10:05:15.402 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 86, 2023-09-13T10:05:15.402 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 9, 2023-09-13T10:05:15.403 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 6.050314682, 2023-09-13T10:05:15.403 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 2.140172820, 2023-09-13T10:05:15.403 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 2.625789184, 2023-09-13T10:05:15.403 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 1.408843784, 2023-09-13T10:05:15.403 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:15.404 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 99085, 2023-09-13T10:05:15.404 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 9.350034862, 2023-09-13T10:05:15.404 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000094363 2023-09-13T10:05:15.404 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.404 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:15.405 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 106850, 2023-09-13T10:05:15.405 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.018984025, 2023-09-13T10:05:15.405 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000177 2023-09-13T10:05:15.405 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.405 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 976624, 2023-09-13T10:05:15.406 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 320064 2023-09-13T10:05:15.406 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.406 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-09-13T10:05:15.406 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2023-09-13T10:05:15.406 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-09-13T10:05:15.407 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.407 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2023-09-13T10:05:15.407 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:15.407 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:15.407 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 134176, 2023-09-13T10:05:15.408 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 142.892568511, 2023-09-13T10:05:15.408 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001064963 2023-09-13T10:05:15.409 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.409 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.410 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:15.410 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:15.410 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:15.411 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 86321, 2023-09-13T10:05:15.411 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 9.668369547, 2023-09-13T10:05:15.411 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000112004 2023-09-13T10:05:15.411 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.411 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.412 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2023-09-13T10:05:15.412 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 295945, 2023-09-13T10:05:15.412 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 276874, 2023-09-13T10:05:15.412 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2023-09-13T10:05:15.412 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 276874, 2023-09-13T10:05:15.413 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 1276.330880344, 2023-09-13T10:05:15.413 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.004609789 2023-09-13T10:05:15.413 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.413 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2023-09-13T10:05:15.413 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 19071, 2023-09-13T10:05:15.414 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 1, 2023-09-13T10:05:15.414 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:15.414 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 88, 2023-09-13T10:05:15.414 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 5, 2023-09-13T10:05:15.414 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 9, 2023-09-13T10:05:15.414 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 712, 2023-09-13T10:05:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 332, 2023-09-13T10:05:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 150, 2023-09-13T10:05:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 230, 2023-09-13T10:05:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 233, 2023-09-13T10:05:15.415 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 923, 2023-09-13T10:05:15.416 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 0, 2023-09-13T10:05:15.416 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 0, 2023-09-13T10:05:15.416 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 6, 2023-09-13T10:05:15.416 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 494780, 2023-09-13T10:05:15.416 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 289204, 2023-09-13T10:05:15.417 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 19064, 2023-09-13T10:05:15.417 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 70, 2023-09-13T10:05:15.417 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:15.417 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:15.417 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 5672, 2023-09-13T10:05:15.418 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 2000, 2023-09-13T10:05:15.418 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 2, 2023-09-13T10:05:15.418 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 17, 2023-09-13T10:05:15.418 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 375, 2023-09-13T10:05:15.418 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 17, 2023-09-13T10:05:15.419 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 685, 2023-09-13T10:05:15.419 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:15.419 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 2413, 2023-09-13T10:05:15.419 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 0, 2023-09-13T10:05:15.419 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 736, 2023-09-13T10:05:15.419 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 212049369, 2023-09-13T10:05:15.420 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 0, 2023-09-13T10:05:15.420 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 2413, 2023-09-13T10:05:15.420 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:15.420 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:15.420 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:15.421 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 340, 2023-09-13T10:05:15.421 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:05:15.421 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 340, 2023-09-13T10:05:15.421 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 2073, 2023-09-13T10:05:15.421 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 28, 2023-09-13T10:05:15.422 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 21043, 2023-09-13T10:05:15.422 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 182784, 2023-09-13T10:05:15.422 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:15.422 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:15.423 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:15.423 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 72043, 2023-09-13T10:05:15.423 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 34322, 2023-09-13T10:05:15.423 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 7403, 2023-09-13T10:05:15.423 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 188237 2023-09-13T10:05:15.424 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.424 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2023-09-13T10:05:15.424 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 17, 2023-09-13T10:05:15.424 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 176, 2023-09-13T10:05:15.425 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 112, 2023-09-13T10:05:15.425 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 195, 2023-09-13T10:05:15.425 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 665, 2023-09-13T10:05:15.425 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 11, 2023-09-13T10:05:15.425 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:15.426 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:15.426 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 46358, 2023-09-13T10:05:15.426 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 46347, 2023-09-13T10:05:15.427 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:15.427 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 0, 2023-09-13T10:05:15.427 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:15.427 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:15.428 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:15.428 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2023-09-13T10:05:15.428 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2023-09-13T10:05:15.429 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:05:15.429 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 18, 2023-09-13T10:05:15.429 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2023-09-13T10:05:15.429 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 14, 2023-09-13T10:05:15.430 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:15.430 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0 2023-09-13T10:05:15.430 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.431 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2023-09-13T10:05:15.431 INFO:teuthology.orchestra.run.smithi131.stdout: "evlrg": 0, 2023-09-13T10:05:15.431 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 222725, 2023-09-13T10:05:15.431 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 125772, 2023-09-13T10:05:15.432 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 122901, 2023-09-13T10:05:15.432 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 99824, 2023-09-13T10:05:15.432 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2023-09-13T10:05:15.432 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 2871, 2023-09-13T10:05:15.433 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 288, 2023-09-13T10:05:15.433 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 160, 2023-09-13T10:05:15.433 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 157, 2023-09-13T10:05:15.433 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 131, 2023-09-13T10:05:15.434 INFO:teuthology.orchestra.run.smithi131.stdout: "segmjr": 9, 2023-09-13T10:05:15.434 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2023-09-13T10:05:15.434 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 3, 2023-09-13T10:05:15.434 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 218749417, 2023-09-13T10:05:15.435 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 408949468, 2023-09-13T10:05:15.435 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 0, 2023-09-13T10:05:15.435 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2023-09-13T10:05:15.435 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 73990, 2023-09-13T10:05:15.435 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 579.852938887, 2023-09-13T10:05:15.436 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.007836909 2023-09-13T10:05:15.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.436 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 0 2023-09-13T10:05:15.436 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.436 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2023-09-13T10:05:15.437 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 44, 2023-09-13T10:05:15.437 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 46774, 2023-09-13T10:05:15.437 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 46730, 2023-09-13T10:05:15.437 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 42, 2023-09-13T10:05:15.437 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 225, 2023-09-13T10:05:15.438 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 183, 2023-09-13T10:05:15.438 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 712, 2023-09-13T10:05:15.438 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 79027, 2023-09-13T10:05:15.438 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 78315, 2023-09-13T10:05:15.438 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 0, 2023-09-13T10:05:15.439 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 48348, 2023-09-13T10:05:15.439 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 48348, 2023-09-13T10:05:15.439 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 77372, 2023-09-13T10:05:15.439 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 198960 2023-09-13T10:05:15.439 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.439 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2023-09-13T10:05:15.440 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 479357, 2023-09-13T10:05:15.440 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 12239, 2023-09-13T10:05:15.440 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 295945, 2023-09-13T10:05:15.440 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 7509, 2023-09-13T10:05:15.440 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 60555, 2023-09-13T10:05:15.441 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2023-09-13T10:05:15.441 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 46245, 2023-09-13T10:05:15.441 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 182.008699633, 2023-09-13T10:05:15.441 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.003935748 2023-09-13T10:05:15.441 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.442 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2023-09-13T10:05:15.442 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 27396, 2023-09-13T10:05:15.442 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 417.833719479, 2023-09-13T10:05:15.442 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.015251632 2023-09-13T10:05:15.442 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.443 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:15.443 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.443 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.443 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.444 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2023-09-13T10:05:15.444 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.444 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.444 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.445 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2023-09-13T10:05:15.445 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 76925, 2023-09-13T10:05:15.445 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 107.795368501, 2023-09-13T10:05:15.445 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.001401304 2023-09-13T10:05:15.445 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.446 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:15.446 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.446 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.446 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.446 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.447 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2023-09-13T10:05:15.447 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.447 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.447 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.447 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.448 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2023-09-13T10:05:15.448 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.448 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.448 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.449 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:15.449 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.449 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.449 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.449 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.450 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:15.450 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.450 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.450 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.450 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.451 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2023-09-13T10:05:15.451 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.451 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.451 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.451 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.452 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2023-09-13T10:05:15.452 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.452 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.452 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.452 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.453 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2023-09-13T10:05:15.453 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.453 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.453 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.453 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.453 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2023-09-13T10:05:15.454 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.454 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.454 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.454 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.455 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2023-09-13T10:05:15.455 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.455 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.455 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.456 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.456 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2023-09-13T10:05:15.456 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 67425, 2023-09-13T10:05:15.456 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 419.557184344, 2023-09-13T10:05:15.456 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.006222575 2023-09-13T10:05:15.457 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.457 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2023-09-13T10:05:15.457 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 10191, 2023-09-13T10:05:15.457 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 36.668319254, 2023-09-13T10:05:15.457 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.003598108 2023-09-13T10:05:15.458 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.458 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:15.458 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.458 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.459 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.459 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.459 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:15.459 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.460 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.460 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.460 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.460 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2023-09-13T10:05:15.460 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 20, 2023-09-13T10:05:15.461 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.114202674, 2023-09-13T10:05:15.461 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.005710133 2023-09-13T10:05:15.461 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.461 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:15.462 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.462 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.462 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.462 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.462 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:15.463 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.463 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.464 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.464 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.465 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2023-09-13T10:05:15.465 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 22, 2023-09-13T10:05:15.465 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.360176057, 2023-09-13T10:05:15.465 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.016371638 2023-09-13T10:05:15.465 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.466 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:15.466 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.466 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.466 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.466 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.467 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:15.467 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 2312, 2023-09-13T10:05:15.467 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 2.027345973, 2023-09-13T10:05:15.467 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000876879 2023-09-13T10:05:15.467 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.468 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2023-09-13T10:05:15.468 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.468 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.468 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.469 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.469 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2023-09-13T10:05:15.469 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.469 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.470 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.470 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.470 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2023-09-13T10:05:15.471 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.471 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.471 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.471 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.471 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2023-09-13T10:05:15.472 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 46338, 2023-09-13T10:05:15.472 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 109.965864429, 2023-09-13T10:05:15.472 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.002373124 2023-09-13T10:05:15.472 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.472 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:15.473 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:15.473 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:15.473 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.473 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.473 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.473 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.474 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.474 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2023-09-13T10:05:15.474 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 1, 2023-09-13T10:05:15.475 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 2, 2023-09-13T10:05:15.475 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 1, 2023-09-13T10:05:15.475 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 1, 2023-09-13T10:05:15.475 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2023-09-13T10:05:15.475 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 21478, 2023-09-13T10:05:15.475 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 21478, 2023-09-13T10:05:15.476 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 1466, 2023-09-13T10:05:15.476 INFO:teuthology.orchestra.run.smithi131.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:15.476 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.476 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-09-13T10:05:15.476 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:15.477 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:15.477 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:15.477 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:15.477 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:15.477 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:15.478 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:15.478 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:15.478 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:15.478 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:15.478 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:15.478 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:15.479 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:15.479 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:15.479 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:15.479 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:15.479 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:15.480 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:15.480 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:15.480 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:15.480 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:15.480 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:15.480 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:15.481 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:15.481 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:15.481 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:15.481 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:15.481 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:15.482 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:15.482 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:15.482 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:15.482 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-09-13T10:05:15.482 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:15.483 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:15.483 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:15.483 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:15.483 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 299485, 2023-09-13T10:05:15.483 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 137, 2023-09-13T10:05:15.484 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 264, 2023-09-13T10:05:15.484 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 3, 2023-09-13T10:05:15.484 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-09-13T10:05:15.484 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-09-13T10:05:15.484 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:15.484 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:15.485 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:15.485 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:15.485 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:15.485 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 165, 2023-09-13T10:05:15.485 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:15.486 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:15.486 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:15.486 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-09-13T10:05:15.486 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 689392, 2023-09-13T10:05:15.486 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 8935, 2023-09-13T10:05:15.487 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:15.487 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-09-13T10:05:15.487 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:15.487 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-09-13T10:05:15.487 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.488 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2023-09-13T10:05:15.488 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2023-09-13T10:05:15.488 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2023-09-13T10:05:15.488 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 127431, 2023-09-13T10:05:15.488 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 412744996, 2023-09-13T10:05:15.489 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 27, 2023-09-13T10:05:15.489 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 127431, 2023-09-13T10:05:15.489 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2023-09-13T10:05:15.489 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 127431, 2023-09-13T10:05:15.489 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 991.613521290, 2023-09-13T10:05:15.489 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.007781572 2023-09-13T10:05:15.490 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.490 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2023-09-13T10:05:15.490 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2023-09-13T10:05:15.490 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 127431, 2023-09-13T10:05:15.490 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 128359 2023-09-13T10:05:15.491 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.491 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 127431, 2023-09-13T10:05:15.491 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 3971, 2023-09-13T10:05:15.491 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 123460, 2023-09-13T10:05:15.492 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2023-09-13T10:05:15.492 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2023-09-13T10:05:15.492 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 4, 2023-09-13T10:05:15.492 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 124, 2023-09-13T10:05:15.492 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 1557, 2023-09-13T10:05:15.493 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 75546, 2023-09-13T10:05:15.493 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 854, 2023-09-13T10:05:15.493 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2023-09-13T10:05:15.493 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2023-09-13T10:05:15.494 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2023-09-13T10:05:15.494 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 5, 2023-09-13T10:05:15.494 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 46552, 2023-09-13T10:05:15.494 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2023-09-13T10:05:15.494 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:15.495 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:15.495 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 2414, 2023-09-13T10:05:15.495 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 248, 2023-09-13T10:05:15.495 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:15.496 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:15.496 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:15.496 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2023-09-13T10:05:15.496 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2023-09-13T10:05:15.497 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2023-09-13T10:05:15.497 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:15.497 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2023-09-13T10:05:15.497 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:15.498 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2023-09-13T10:05:15.498 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2023-09-13T10:05:15.498 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2023-09-13T10:05:15.498 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2023-09-13T10:05:15.498 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2023-09-13T10:05:15.499 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2023-09-13T10:05:15.499 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2023-09-13T10:05:15.499 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2023-09-13T10:05:15.499 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2023-09-13T10:05:15.499 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2023-09-13T10:05:15.500 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2023-09-13T10:05:15.500 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2023-09-13T10:05:15.500 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2023-09-13T10:05:15.501 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2023-09-13T10:05:15.501 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2023-09-13T10:05:15.501 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2023-09-13T10:05:15.501 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2023-09-13T10:05:15.501 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 88, 2023-09-13T10:05:15.502 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2023-09-13T10:05:15.502 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 4, 2023-09-13T10:05:15.502 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 12, 2023-09-13T10:05:15.503 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 12, 2023-09-13T10:05:15.503 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2023-09-13T10:05:15.503 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2023-09-13T10:05:15.503 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 740, 2023-09-13T10:05:15.504 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 2, 2023-09-13T10:05:15.504 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 313 2023-09-13T10:05:15.504 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.504 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2023-09-13T10:05:15.504 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 1, 2023-09-13T10:05:15.505 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:15.505 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2023-09-13T10:05:15.505 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2023-09-13T10:05:15.505 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.505 INFO:teuthology.orchestra.run.smithi131.stdout: "osd-slow-ops": { 2023-09-13T10:05:15.506 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 0 2023-09-13T10:05:15.506 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.506 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2023-09-13T10:05:15.506 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:15.506 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 6, 2023-09-13T10:05:15.507 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2023-09-13T10:05:15.507 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 6, 2023-09-13T10:05:15.507 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 46347, 2023-09-13T10:05:15.507 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:15.507 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.508 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:15.508 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:15.508 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:15.508 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:15.508 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 952899, 2023-09-13T10:05:15.508 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 178604924, 2023-09-13T10:05:15.509 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:15.509 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 952899, 2023-09-13T10:05:15.509 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:15.509 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:15.509 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 952899, 2023-09-13T10:05:15.510 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 178604924, 2023-09-13T10:05:15.510 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:15.510 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.510 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.510 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.511 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.511 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.511 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:15.511 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:15.511 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:15.511 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:15.512 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:15.512 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:15.512 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:15.512 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:15.512 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 127431, 2023-09-13T10:05:15.513 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 417426027, 2023-09-13T10:05:15.513 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 127431, 2023-09-13T10:05:15.513 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 417426027, 2023-09-13T10:05:15.513 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:15.513 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.514 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.514 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.514 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.514 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.514 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:15.515 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:15.515 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2023-09-13T10:05:15.515 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:15.515 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:15.515 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:15.515 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:15.516 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:15.516 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 127431, 2023-09-13T10:05:15.516 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 127431, 2023-09-13T10:05:15.516 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 127431, 2023-09-13T10:05:15.516 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 127431, 2023-09-13T10:05:15.517 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:15.517 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.517 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.517 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.517 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.517 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.518 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:15.518 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:15.518 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:15.518 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:15.518 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 46347, 2023-09-13T10:05:15.519 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 4681047, 2023-09-13T10:05:15.519 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:15.519 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 46347, 2023-09-13T10:05:15.519 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:15.519 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:15.519 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 1556, 2023-09-13T10:05:15.520 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 4681047, 2023-09-13T10:05:15.520 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:15.520 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.520 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.520 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.521 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.521 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:15.521 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x5619ab092640": { 2023-09-13T10:05:15.521 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:15.521 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:15.521 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:15.522 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 222725, 2023-09-13T10:05:15.522 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 404755164, 2023-09-13T10:05:15.522 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:15.522 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 222725, 2023-09-13T10:05:15.522 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:15.523 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:15.523 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 73990, 2023-09-13T10:05:15.523 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 404755164, 2023-09-13T10:05:15.523 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:15.523 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:15.524 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:15.524 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:15.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.524 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:15.524 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-09-13T10:05:16.041 INFO:tasks.check_counter:Daemon mds.i mds.exported=17 2023-09-13T10:05:16.042 INFO:tasks.check_counter:Daemon mds.i mds.imported=17 2023-09-13T10:05:16.042 DEBUG:tasks.check_counter:Getting stats from l 2023-09-13T10:05:16.042 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:4a754ac981aa956c0a6fd67e5140c9a1c7d53ab5 shell --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da -- ceph daemon mds.l perf dump 2023-09-13T10:05:16.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:16 smithi053 ceph-mon[102373]: pgmap v1072: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 63 KiB/s wr, 59 op/s 2023-09-13T10:05:16.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:16 smithi006 ceph-mon[98665]: pgmap v1072: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 63 KiB/s wr, 59 op/s 2023-09-13T10:05:16.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:16 smithi131 ceph-mon[102785]: pgmap v1072: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 63 KiB/s wr, 59 op/s 2023-09-13T10:05:16.603 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/mon.c/config 2023-09-13T10:05:17.856 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2023-09-13T10:05:17.856 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-0": { 2023-09-13T10:05:17.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 1692, 2023-09-13T10:05:17.856 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 1628, 2023-09-13T10:05:17.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 141502484, 2023-09-13T10:05:17.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 633811, 2023-09-13T10:05:17.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 7, 2023-09-13T10:05:17.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 3, 2023-09-13T10:05:17.857 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.218447880, 2023-09-13T10:05:17.858 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.043113830, 2023-09-13T10:05:17.858 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.124446187, 2023-09-13T10:05:17.858 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.041841104, 2023-09-13T10:05:17.858 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:17.858 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 1627, 2023-09-13T10:05:17.859 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.125172928, 2023-09-13T10:05:17.859 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000076934 2023-09-13T10:05:17.859 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.859 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:17.859 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.860 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.860 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.860 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.860 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 941984, 2023-09-13T10:05:17.860 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 267136 2023-09-13T10:05:17.861 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.861 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-1": { 2023-09-13T10:05:17.861 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 1987, 2023-09-13T10:05:17.861 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 2319, 2023-09-13T10:05:17.861 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 176666986, 2023-09-13T10:05:17.862 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 1274167, 2023-09-13T10:05:17.862 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 7, 2023-09-13T10:05:17.862 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 6, 2023-09-13T10:05:17.862 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.229287578, 2023-09-13T10:05:17.862 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.053157742, 2023-09-13T10:05:17.863 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.111979561, 2023-09-13T10:05:17.863 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.050170745, 2023-09-13T10:05:17.863 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:17.863 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 2318, 2023-09-13T10:05:17.863 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.110647308, 2023-09-13T10:05:17.864 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000047733 2023-09-13T10:05:17.864 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.864 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:17.864 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.864 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.864 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.865 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 3104, 2023-09-13T10:05:17.865 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 657760 2023-09-13T10:05:17.865 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.865 INFO:teuthology.orchestra.run.smithi131.stdout: "AsyncMessenger::Worker-2": { 2023-09-13T10:05:17.866 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_messages": 3029, 2023-09-13T10:05:17.866 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages": 3031, 2023-09-13T10:05:17.866 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_bytes": 130923437, 2023-09-13T10:05:17.866 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_bytes": 942077, 2023-09-13T10:05:17.866 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_created_connections": 6, 2023-09-13T10:05:17.867 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_active_connections": 5, 2023-09-13T10:05:17.867 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_total_time": 0.312014221, 2023-09-13T10:05:17.867 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_send_time": 0.061704274, 2023-09-13T10:05:17.867 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_recv_time": 0.137665453, 2023-09-13T10:05:17.867 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_running_fast_dispatch_time": 0.090666631, 2023-09-13T10:05:17.868 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_messages_queue_lat": { 2023-09-13T10:05:17.868 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 3029, 2023-09-13T10:05:17.868 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.132811278, 2023-09-13T10:05:17.868 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000043846 2023-09-13T10:05:17.868 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.868 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_handle_ack_lat": { 2023-09-13T10:05:17.869 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.869 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.869 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.869 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.869 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_recv_encrypted_bytes": 0, 2023-09-13T10:05:17.870 INFO:teuthology.orchestra.run.smithi131.stdout: "msgr_send_encrypted_bytes": 0 2023-09-13T10:05:17.870 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.870 INFO:teuthology.orchestra.run.smithi131.stdout: "cct": { 2023-09-13T10:05:17.870 INFO:teuthology.orchestra.run.smithi131.stdout: "total_workers": 1, 2023-09-13T10:05:17.870 INFO:teuthology.orchestra.run.smithi131.stdout: "unhealthy_workers": 0 2023-09-13T10:05:17.871 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.871 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-MDSRank": { 2023-09-13T10:05:17.871 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:17.871 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:17.871 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 10634, 2023-09-13T10:05:17.871 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.409274541, 2023-09-13T10:05:17.872 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000038487 2023-09-13T10:05:17.872 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.872 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.872 INFO:teuthology.orchestra.run.smithi131.stdout: "finisher-PurgeQueue": { 2023-09-13T10:05:17.872 INFO:teuthology.orchestra.run.smithi131.stdout: "queue_len": 0, 2023-09-13T10:05:17.872 INFO:teuthology.orchestra.run.smithi131.stdout: "complete_latency": { 2023-09-13T10:05:17.873 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.873 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.873 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.873 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.873 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.874 INFO:teuthology.orchestra.run.smithi131.stdout: "mds": { 2023-09-13T10:05:17.874 INFO:teuthology.orchestra.run.smithi131.stdout: "request": 0, 2023-09-13T10:05:17.874 INFO:teuthology.orchestra.run.smithi131.stdout: "reply": 0, 2023-09-13T10:05:17.874 INFO:teuthology.orchestra.run.smithi131.stdout: "reply_latency": { 2023-09-13T10:05:17.874 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.875 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.875 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.875 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.875 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_reply": 0, 2023-09-13T10:05:17.875 INFO:teuthology.orchestra.run.smithi131.stdout: "forward": 0, 2023-09-13T10:05:17.875 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_complete": 0, 2023-09-13T10:05:17.876 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_fetch_keys": 0, 2023-09-13T10:05:17.876 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_commit": 0, 2023-09-13T10:05:17.876 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_split": 0, 2023-09-13T10:05:17.876 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_merge": 0, 2023-09-13T10:05:17.876 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes": 23113, 2023-09-13T10:05:17.877 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_top": 0, 2023-09-13T10:05:17.877 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_bottom": 0, 2023-09-13T10:05:17.877 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pin_tail": 23113, 2023-09-13T10:05:17.877 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_pinned": 23113, 2023-09-13T10:05:17.877 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_expired": 12553, 2023-09-13T10:05:17.877 INFO:teuthology.orchestra.run.smithi131.stdout: "inodes_with_caps": 0, 2023-09-13T10:05:17.878 INFO:teuthology.orchestra.run.smithi131.stdout: "caps": 0, 2023-09-13T10:05:17.878 INFO:teuthology.orchestra.run.smithi131.stdout: "subtrees": 1, 2023-09-13T10:05:17.878 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse": 0, 2023-09-13T10:05:17.878 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_hit": 0, 2023-09-13T10:05:17.878 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_forward": 0, 2023-09-13T10:05:17.879 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_discover": 0, 2023-09-13T10:05:17.879 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_dir_fetch": 0, 2023-09-13T10:05:17.879 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_remote_ino": 0, 2023-09-13T10:05:17.879 INFO:teuthology.orchestra.run.smithi131.stdout: "traverse_lock": 0, 2023-09-13T10:05:17.879 INFO:teuthology.orchestra.run.smithi131.stdout: "load_cent": 0, 2023-09-13T10:05:17.880 INFO:teuthology.orchestra.run.smithi131.stdout: "q": 0, 2023-09-13T10:05:17.880 INFO:teuthology.orchestra.run.smithi131.stdout: "exported": 0, 2023-09-13T10:05:17.880 INFO:teuthology.orchestra.run.smithi131.stdout: "exported_inodes": 0, 2023-09-13T10:05:17.880 INFO:teuthology.orchestra.run.smithi131.stdout: "imported": 0, 2023-09-13T10:05:17.880 INFO:teuthology.orchestra.run.smithi131.stdout: "imported_inodes": 0, 2023-09-13T10:05:17.880 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_dir_fetch": 0, 2023-09-13T10:05:17.881 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_backtrace_fetch": 0, 2023-09-13T10:05:17.881 INFO:teuthology.orchestra.run.smithi131.stdout: "openino_peer_discover": 0, 2023-09-13T10:05:17.881 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rfiles": 0, 2023-09-13T10:05:17.881 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rbytes": 0, 2023-09-13T10:05:17.881 INFO:teuthology.orchestra.run.smithi131.stdout: "root_rsnaps": 0, 2023-09-13T10:05:17.882 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_fetch": 0, 2023-09-13T10:05:17.882 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_set_tag": 0, 2023-09-13T10:05:17.882 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_backtrace_repaired": 0, 2023-09-13T10:05:17.882 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_inotable_repaired": 0, 2023-09-13T10:05:17.882 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_inodes": 0, 2023-09-13T10:05:17.883 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dir_base_inodes": 0, 2023-09-13T10:05:17.883 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_dirfrag_rstats": 0, 2023-09-13T10:05:17.883 INFO:teuthology.orchestra.run.smithi131.stdout: "scrub_file_inodes": 0, 2023-09-13T10:05:17.883 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_inode_file_caps": 0, 2023-09-13T10:05:17.883 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_revoke": 0, 2023-09-13T10:05:17.884 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_grant": 0, 2023-09-13T10:05:17.884 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_trunc": 0, 2023-09-13T10:05:17.884 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-09-13T10:05:17.884 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_cap_op_flush_ack": 0, 2023-09-13T10:05:17.884 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps": 0, 2023-09-13T10:05:17.884 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_caps_dirty": 0, 2023-09-13T10:05:17.885 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_cap_release": 0, 2023-09-13T10:05:17.885 INFO:teuthology.orchestra.run.smithi131.stdout: "process_request_cap_release": 0 2023-09-13T10:05:17.885 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.885 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_cache": { 2023-09-13T10:05:17.885 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update": 0, 2023-09-13T10:05:17.886 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_update_receipt": 0, 2023-09-13T10:05:17.886 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_try_discover": 0, 2023-09-13T10:05:17.886 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_send_discover": 0, 2023-09-13T10:05:17.886 INFO:teuthology.orchestra.run.smithi131.stdout: "dir_handle_discover": 0, 2023-09-13T10:05:17.886 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays": 0, 2023-09-13T10:05:17.886 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_delayed": 0, 2023-09-13T10:05:17.887 INFO:teuthology.orchestra.run.smithi131.stdout: "num_strays_enqueuing": 0, 2023-09-13T10:05:17.887 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_created": 0, 2023-09-13T10:05:17.887 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_enqueued": 0, 2023-09-13T10:05:17.887 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_reintegrated": 0, 2023-09-13T10:05:17.887 INFO:teuthology.orchestra.run.smithi131.stdout: "strays_migrated": 0, 2023-09-13T10:05:17.887 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_processing": 0, 2023-09-13T10:05:17.888 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_enqueued": 0, 2023-09-13T10:05:17.888 INFO:teuthology.orchestra.run.smithi131.stdout: "num_recovering_prioritized": 0, 2023-09-13T10:05:17.888 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_started": 0, 2023-09-13T10:05:17.888 INFO:teuthology.orchestra.run.smithi131.stdout: "recovery_completed": 0, 2023-09-13T10:05:17.888 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_enqueue_scrub": 0, 2023-09-13T10:05:17.889 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_exportdir": 0, 2023-09-13T10:05:17.889 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_flush": 0, 2023-09-13T10:05:17.889 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragmentdir": 0, 2023-09-13T10:05:17.889 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_fragstats": 0, 2023-09-13T10:05:17.889 INFO:teuthology.orchestra.run.smithi131.stdout: "ireq_inodestats": 0 2023-09-13T10:05:17.890 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.890 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_log": { 2023-09-13T10:05:17.890 INFO:teuthology.orchestra.run.smithi131.stdout: "evlrg": 0, 2023-09-13T10:05:17.890 INFO:teuthology.orchestra.run.smithi131.stdout: "evadd": 0, 2023-09-13T10:05:17.890 INFO:teuthology.orchestra.run.smithi131.stdout: "evex": 0, 2023-09-13T10:05:17.891 INFO:teuthology.orchestra.run.smithi131.stdout: "evtrm": 0, 2023-09-13T10:05:17.891 INFO:teuthology.orchestra.run.smithi131.stdout: "ev": 210815, 2023-09-13T10:05:17.891 INFO:teuthology.orchestra.run.smithi131.stdout: "evexg": 0, 2023-09-13T10:05:17.891 INFO:teuthology.orchestra.run.smithi131.stdout: "evexd": 0, 2023-09-13T10:05:17.891 INFO:teuthology.orchestra.run.smithi131.stdout: "segadd": 0, 2023-09-13T10:05:17.892 INFO:teuthology.orchestra.run.smithi131.stdout: "segex": 0, 2023-09-13T10:05:17.892 INFO:teuthology.orchestra.run.smithi131.stdout: "segtrm": 0, 2023-09-13T10:05:17.892 INFO:teuthology.orchestra.run.smithi131.stdout: "seg": 139, 2023-09-13T10:05:17.892 INFO:teuthology.orchestra.run.smithi131.stdout: "segmjr": 19, 2023-09-13T10:05:17.892 INFO:teuthology.orchestra.run.smithi131.stdout: "segexg": 0, 2023-09-13T10:05:17.892 INFO:teuthology.orchestra.run.smithi131.stdout: "segexd": 0, 2023-09-13T10:05:17.893 INFO:teuthology.orchestra.run.smithi131.stdout: "expos": 213493304, 2023-09-13T10:05:17.893 INFO:teuthology.orchestra.run.smithi131.stdout: "wrpos": 450638518, 2023-09-13T10:05:17.893 INFO:teuthology.orchestra.run.smithi131.stdout: "rdpos": 450637380, 2023-09-13T10:05:17.893 INFO:teuthology.orchestra.run.smithi131.stdout: "jlat": { 2023-09-13T10:05:17.893 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.894 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.894 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.894 INFO:teuthology.orchestra.run.smithi131.stdout: "replayed": 210815 2023-09-13T10:05:17.894 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.894 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_mem": { 2023-09-13T10:05:17.895 INFO:teuthology.orchestra.run.smithi131.stdout: "ino": 23, 2023-09-13T10:05:17.895 INFO:teuthology.orchestra.run.smithi131.stdout: "ino+": 36256, 2023-09-13T10:05:17.895 INFO:teuthology.orchestra.run.smithi131.stdout: "ino-": 36233, 2023-09-13T10:05:17.895 INFO:teuthology.orchestra.run.smithi131.stdout: "dir": 21, 2023-09-13T10:05:17.895 INFO:teuthology.orchestra.run.smithi131.stdout: "dir+": 225, 2023-09-13T10:05:17.896 INFO:teuthology.orchestra.run.smithi131.stdout: "dir-": 204, 2023-09-13T10:05:17.896 INFO:teuthology.orchestra.run.smithi131.stdout: "dn": 23113, 2023-09-13T10:05:17.896 INFO:teuthology.orchestra.run.smithi131.stdout: "dn+": 36985, 2023-09-13T10:05:17.896 INFO:teuthology.orchestra.run.smithi131.stdout: "dn-": 13872, 2023-09-13T10:05:17.896 INFO:teuthology.orchestra.run.smithi131.stdout: "cap": 0, 2023-09-13T10:05:17.896 INFO:teuthology.orchestra.run.smithi131.stdout: "cap+": 0, 2023-09-13T10:05:17.897 INFO:teuthology.orchestra.run.smithi131.stdout: "cap-": 0, 2023-09-13T10:05:17.897 INFO:teuthology.orchestra.run.smithi131.stdout: "rss": 76200, 2023-09-13T10:05:17.897 INFO:teuthology.orchestra.run.smithi131.stdout: "heap": 207152 2023-09-13T10:05:17.897 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.897 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_server": { 2023-09-13T10:05:17.898 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_client_request": 0, 2023-09-13T10:05:17.898 INFO:teuthology.orchestra.run.smithi131.stdout: "dispatch_server_request": 0, 2023-09-13T10:05:17.898 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_request": 0, 2023-09-13T10:05:17.898 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_client_session": 0, 2023-09-13T10:05:17.898 INFO:teuthology.orchestra.run.smithi131.stdout: "handle_peer_request": 0, 2023-09-13T10:05:17.898 INFO:teuthology.orchestra.run.smithi131.stdout: "req_create_latency": { 2023-09-13T10:05:17.899 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.899 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.899 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.899 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.899 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getattr_latency": { 2023-09-13T10:05:17.900 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.900 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.900 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.900 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.900 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getfilelock_latency": { 2023-09-13T10:05:17.900 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.901 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.901 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.901 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.901 INFO:teuthology.orchestra.run.smithi131.stdout: "req_link_latency": { 2023-09-13T10:05:17.901 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.902 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.902 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.902 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.902 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookup_latency": { 2023-09-13T10:05:17.902 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.903 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.903 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.903 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.903 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookuphash_latency": { 2023-09-13T10:05:17.903 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.903 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.904 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.904 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.904 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupino_latency": { 2023-09-13T10:05:17.904 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.904 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.904 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.905 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.905 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupname_latency": { 2023-09-13T10:05:17.905 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.905 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.905 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.906 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.906 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupparent_latency": { 2023-09-13T10:05:17.906 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.906 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.906 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.907 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lookupsnap_latency": { 2023-09-13T10:05:17.907 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.907 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.907 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.907 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.908 INFO:teuthology.orchestra.run.smithi131.stdout: "req_lssnap_latency": { 2023-09-13T10:05:17.908 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.908 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.908 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.908 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.908 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mkdir_latency": { 2023-09-13T10:05:17.909 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.909 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.909 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.909 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.909 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mknod_latency": { 2023-09-13T10:05:17.910 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.910 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.910 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.910 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.910 INFO:teuthology.orchestra.run.smithi131.stdout: "req_mksnap_latency": { 2023-09-13T10:05:17.911 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.911 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.911 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.911 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.911 INFO:teuthology.orchestra.run.smithi131.stdout: "req_open_latency": { 2023-09-13T10:05:17.911 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.912 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.912 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.912 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.912 INFO:teuthology.orchestra.run.smithi131.stdout: "req_readdir_latency": { 2023-09-13T10:05:17.912 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.913 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.913 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.913 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.913 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rename_latency": { 2023-09-13T10:05:17.913 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.914 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.914 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.914 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.914 INFO:teuthology.orchestra.run.smithi131.stdout: "req_renamesnap_latency": { 2023-09-13T10:05:17.914 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.915 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.915 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.915 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.915 INFO:teuthology.orchestra.run.smithi131.stdout: "req_snapdiff_latency": { 2023-09-13T10:05:17.915 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.915 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.916 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.916 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.916 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmdir_latency": { 2023-09-13T10:05:17.916 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.916 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.917 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.917 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.917 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmsnap_latency": { 2023-09-13T10:05:17.917 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.917 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.918 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.918 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.918 INFO:teuthology.orchestra.run.smithi131.stdout: "req_rmxattr_latency": { 2023-09-13T10:05:17.918 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.918 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.918 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.919 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.919 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setattr_latency": { 2023-09-13T10:05:17.919 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.919 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.919 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.920 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.920 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setdirlayout_latency": { 2023-09-13T10:05:17.920 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.920 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.920 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.921 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setfilelock_latency": { 2023-09-13T10:05:17.921 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.921 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.921 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.921 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.922 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setlayout_latency": { 2023-09-13T10:05:17.922 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.922 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.922 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.922 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.923 INFO:teuthology.orchestra.run.smithi131.stdout: "req_setxattr_latency": { 2023-09-13T10:05:17.923 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.923 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.923 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.923 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.924 INFO:teuthology.orchestra.run.smithi131.stdout: "req_symlink_latency": { 2023-09-13T10:05:17.924 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.924 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.924 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.924 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.924 INFO:teuthology.orchestra.run.smithi131.stdout: "req_unlink_latency": { 2023-09-13T10:05:17.925 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.925 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.925 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.925 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.925 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_revoke_eviction": 0, 2023-09-13T10:05:17.926 INFO:teuthology.orchestra.run.smithi131.stdout: "cap_acquisition_throttle": 0, 2023-09-13T10:05:17.926 INFO:teuthology.orchestra.run.smithi131.stdout: "req_getvxattr_latency": { 2023-09-13T10:05:17.926 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.926 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.926 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.926 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.927 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.927 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_sessions": { 2023-09-13T10:05:17.927 INFO:teuthology.orchestra.run.smithi131.stdout: "session_count": 1, 2023-09-13T10:05:17.927 INFO:teuthology.orchestra.run.smithi131.stdout: "session_add": 2, 2023-09-13T10:05:17.927 INFO:teuthology.orchestra.run.smithi131.stdout: "session_remove": 1, 2023-09-13T10:05:17.928 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_open": 1, 2023-09-13T10:05:17.928 INFO:teuthology.orchestra.run.smithi131.stdout: "sessions_stale": 0, 2023-09-13T10:05:17.928 INFO:teuthology.orchestra.run.smithi131.stdout: "total_load": 0, 2023-09-13T10:05:17.928 INFO:teuthology.orchestra.run.smithi131.stdout: "average_load": 0, 2023-09-13T10:05:17.928 INFO:teuthology.orchestra.run.smithi131.stdout: "avg_session_uptime": 2895, 2023-09-13T10:05:17.928 INFO:teuthology.orchestra.run.smithi131.stdout: "mdthresh_evicted": 0 2023-09-13T10:05:17.929 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.929 INFO:teuthology.orchestra.run.smithi131.stdout: "mempool": { 2023-09-13T10:05:17.929 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_bytes": 0, 2023-09-13T10:05:17.929 INFO:teuthology.orchestra.run.smithi131.stdout: "bloom_filter_items": 0, 2023-09-13T10:05:17.929 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_bytes": 0, 2023-09-13T10:05:17.930 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_alloc_items": 0, 2023-09-13T10:05:17.930 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_bytes": 0, 2023-09-13T10:05:17.930 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_data_items": 0, 2023-09-13T10:05:17.930 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_bytes": 0, 2023-09-13T10:05:17.930 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_onode_items": 0, 2023-09-13T10:05:17.930 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_bytes": 0, 2023-09-13T10:05:17.931 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_meta_items": 0, 2023-09-13T10:05:17.931 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_bytes": 0, 2023-09-13T10:05:17.931 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_other_items": 0, 2023-09-13T10:05:17.931 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_bytes": 0, 2023-09-13T10:05:17.931 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_cache_buffer_items": 0, 2023-09-13T10:05:17.932 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_bytes": 0, 2023-09-13T10:05:17.932 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_extent_items": 0, 2023-09-13T10:05:17.932 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_bytes": 0, 2023-09-13T10:05:17.932 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_blob_items": 0, 2023-09-13T10:05:17.932 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_bytes": 0, 2023-09-13T10:05:17.932 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_shared_blob_items": 0, 2023-09-13T10:05:17.933 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_bytes": 0, 2023-09-13T10:05:17.933 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_inline_bl_items": 0, 2023-09-13T10:05:17.933 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_bytes": 0, 2023-09-13T10:05:17.933 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_fsck_items": 0, 2023-09-13T10:05:17.933 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_bytes": 0, 2023-09-13T10:05:17.934 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_txc_items": 0, 2023-09-13T10:05:17.934 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_bytes": 0, 2023-09-13T10:05:17.934 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_deferred_items": 0, 2023-09-13T10:05:17.934 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_bytes": 0, 2023-09-13T10:05:17.934 INFO:teuthology.orchestra.run.smithi131.stdout: "bluestore_writing_items": 0, 2023-09-13T10:05:17.934 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_bytes": 0, 2023-09-13T10:05:17.935 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_items": 0, 2023-09-13T10:05:17.935 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_bytes": 0, 2023-09-13T10:05:17.935 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_reader_items": 0, 2023-09-13T10:05:17.935 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_bytes": 0, 2023-09-13T10:05:17.935 INFO:teuthology.orchestra.run.smithi131.stdout: "bluefs_file_writer_items": 0, 2023-09-13T10:05:17.936 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_bytes": 242140, 2023-09-13T10:05:17.936 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_anon_items": 95, 2023-09-13T10:05:17.936 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_bytes": 0, 2023-09-13T10:05:17.936 INFO:teuthology.orchestra.run.smithi131.stdout: "buffer_meta_items": 0, 2023-09-13T10:05:17.936 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_bytes": 0, 2023-09-13T10:05:17.936 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_items": 0, 2023-09-13T10:05:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_bytes": 0, 2023-09-13T10:05:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_mapbl_items": 0, 2023-09-13T10:05:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_bytes": 0, 2023-09-13T10:05:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_pglog_items": 0, 2023-09-13T10:05:17.937 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_bytes": 7824, 2023-09-13T10:05:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_items": 165, 2023-09-13T10:05:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_bytes": 0, 2023-09-13T10:05:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_mapping_items": 0, 2023-09-13T10:05:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_bytes": 0, 2023-09-13T10:05:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: "pgmap_items": 0, 2023-09-13T10:05:17.938 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_bytes": 16351746, 2023-09-13T10:05:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_co_items": 93810, 2023-09-13T10:05:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_bytes": 0, 2023-09-13T10:05:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_1_items": 0, 2023-09-13T10:05:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_bytes": 0, 2023-09-13T10:05:17.939 INFO:teuthology.orchestra.run.smithi131.stdout: "unittest_2_items": 0 2023-09-13T10:05:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: "objecter": { 2023-09-13T10:05:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: "op_active": 0, 2023-09-13T10:05:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: "op_laggy": 0, 2023-09-13T10:05:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send": 6190, 2023-09-13T10:05:17.940 INFO:teuthology.orchestra.run.smithi131.stdout: "op_send_bytes": 21, 2023-09-13T10:05:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: "op_resend": 3, 2023-09-13T10:05:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: "op_reply": 6190, 2023-09-13T10:05:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: "op_latency": { 2023-09-13T10:05:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 6190, 2023-09-13T10:05:17.941 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 17.532656851, 2023-09-13T10:05:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.002832416 2023-09-13T10:05:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: "op_inflight": 0, 2023-09-13T10:05:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: "oplen_avg": { 2023-09-13T10:05:17.942 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 6190, 2023-09-13T10:05:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 6191 2023-09-13T10:05:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: "op": 6190, 2023-09-13T10:05:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: "op_r": 6190, 2023-09-13T10:05:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: "op_w": 0, 2023-09-13T10:05:17.943 INFO:teuthology.orchestra.run.smithi131.stdout: "op_rmw": 0, 2023-09-13T10:05:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: "op_pg": 0, 2023-09-13T10:05:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_stat": 3158, 2023-09-13T10:05:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_create": 0, 2023-09-13T10:05:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_read": 3030, 2023-09-13T10:05:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_write": 0, 2023-09-13T10:05:17.944 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writefull": 0, 2023-09-13T10:05:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_writesame": 0, 2023-09-13T10:05:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_append": 0, 2023-09-13T10:05:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_zero": 0, 2023-09-13T10:05:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_truncate": 0, 2023-09-13T10:05:17.945 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_delete": 0, 2023-09-13T10:05:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_mapext": 0, 2023-09-13T10:05:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_sparse_read": 0, 2023-09-13T10:05:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_clonerange": 0, 2023-09-13T10:05:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_getxattr": 1, 2023-09-13T10:05:17.946 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_setxattr": 0, 2023-09-13T10:05:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_cmpxattr": 0, 2023-09-13T10:05:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_rmxattr": 0, 2023-09-13T10:05:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_resetxattrs": 0, 2023-09-13T10:05:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_call": 0, 2023-09-13T10:05:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_watch": 0, 2023-09-13T10:05:17.947 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_notify": 0, 2023-09-13T10:05:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_src_cmpxattr": 0, 2023-09-13T10:05:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls": 0, 2023-09-13T10:05:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_pgls_filter": 0, 2023-09-13T10:05:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: "osdop_other": 0, 2023-09-13T10:05:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_active": 0, 2023-09-13T10:05:17.948 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_send": 0, 2023-09-13T10:05:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_resend": 0, 2023-09-13T10:05:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: "linger_ping": 0, 2023-09-13T10:05:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_active": 0, 2023-09-13T10:05:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_send": 0, 2023-09-13T10:05:17.949 INFO:teuthology.orchestra.run.smithi131.stdout: "poolop_resend": 0, 2023-09-13T10:05:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_active": 0, 2023-09-13T10:05:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_send": 0, 2023-09-13T10:05:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: "poolstat_resend": 0, 2023-09-13T10:05:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_active": 0, 2023-09-13T10:05:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_send": 0, 2023-09-13T10:05:17.950 INFO:teuthology.orchestra.run.smithi131.stdout: "statfs_resend": 0, 2023-09-13T10:05:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: "command_active": 0, 2023-09-13T10:05:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: "command_send": 0, 2023-09-13T10:05:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: "command_resend": 0, 2023-09-13T10:05:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: "map_epoch": 88, 2023-09-13T10:05:17.951 INFO:teuthology.orchestra.run.smithi131.stdout: "map_full": 0, 2023-09-13T10:05:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: "map_inc": 4, 2023-09-13T10:05:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_sessions": 11, 2023-09-13T10:05:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_open": 11, 2023-09-13T10:05:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_session_close": 0, 2023-09-13T10:05:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_laggy": 0, 2023-09-13T10:05:17.952 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_wr": 0, 2023-09-13T10:05:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_rd": 2, 2023-09-13T10:05:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_del": 0 2023-09-13T10:05:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: "oft": { 2023-09-13T10:05:17.953 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_objs": 0, 2023-09-13T10:05:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_kv_pairs": 0, 2023-09-13T10:05:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_updates": 0, 2023-09-13T10:05:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: "omap_total_removes": 0 2023-09-13T10:05:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: "osd-slow-ops": { 2023-09-13T10:05:17.954 INFO:teuthology.orchestra.run.smithi131.stdout: "slow_ops_count": 0 2023-09-13T10:05:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: "purge_queue": { 2023-09-13T10:05:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops": 0, 2023-09-13T10:05:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_ops_high_water": 0, 2023-09-13T10:05:17.955 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing": 0, 2023-09-13T10:05:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executing_high_water": 0, 2023-09-13T10:05:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_executed": 0, 2023-09-13T10:05:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: "pq_item_in_journal": 0 2023-09-13T10:05:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.956 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-09-13T10:05:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 6704, 2023-09-13T10:05:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 448460597, 2023-09-13T10:05:17.957 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 6704, 2023-09-13T10:05:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 6704, 2023-09-13T10:05:17.958 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 448460597, 2023-09-13T10:05:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.959 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_bytes": { 2023-09-13T10:05:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 104857600, 2023-09-13T10:05:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:17.960 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 6190, 2023-09-13T10:05:17.961 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 446444219, 2023-09-13T10:05:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 6190, 2023-09-13T10:05:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 446444219, 2023-09-13T10:05:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.962 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-objecter_ops": { 2023-09-13T10:05:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:17.963 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 1024, 2023-09-13T10:05:17.964 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:17.964 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:17.964 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:17.964 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:17.964 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:17.965 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 6190, 2023-09-13T10:05:17.965 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 6190, 2023-09-13T10:05:17.965 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 6190, 2023-09-13T10:05:17.965 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 6190, 2023-09-13T10:05:17.966 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:17.966 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.966 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.966 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.966 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.967 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.967 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle": { 2023-09-13T10:05:17.967 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:17.967 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:17.967 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:17.967 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:17.968 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:17.968 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:17.968 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:17.968 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:17.968 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:17.969 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2023-09-13T10:05:17.969 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2023-09-13T10:05:17.969 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:17.969 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.969 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.969 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.970 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.970 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2023-09-13T10:05:17.970 INFO:teuthology.orchestra.run.smithi131.stdout: "throttle-write_buf_throttle-0x555b5cea0960": { 2023-09-13T10:05:17.970 INFO:teuthology.orchestra.run.smithi131.stdout: "val": 0, 2023-09-13T10:05:17.970 INFO:teuthology.orchestra.run.smithi131.stdout: "max": 3758096384, 2023-09-13T10:05:17.971 INFO:teuthology.orchestra.run.smithi131.stdout: "get_started": 0, 2023-09-13T10:05:17.971 INFO:teuthology.orchestra.run.smithi131.stdout: "get": 0, 2023-09-13T10:05:17.971 INFO:teuthology.orchestra.run.smithi131.stdout: "get_sum": 0, 2023-09-13T10:05:17.971 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_fail": 0, 2023-09-13T10:05:17.971 INFO:teuthology.orchestra.run.smithi131.stdout: "get_or_fail_success": 0, 2023-09-13T10:05:17.972 INFO:teuthology.orchestra.run.smithi131.stdout: "take": 0, 2023-09-13T10:05:17.972 INFO:teuthology.orchestra.run.smithi131.stdout: "take_sum": 0, 2023-09-13T10:05:17.972 INFO:teuthology.orchestra.run.smithi131.stdout: "put": 0, 2023-09-13T10:05:17.972 INFO:teuthology.orchestra.run.smithi131.stdout: "put_sum": 0, 2023-09-13T10:05:17.972 INFO:teuthology.orchestra.run.smithi131.stdout: "wait": { 2023-09-13T10:05:17.972 INFO:teuthology.orchestra.run.smithi131.stdout: "avgcount": 0, 2023-09-13T10:05:17.973 INFO:teuthology.orchestra.run.smithi131.stdout: "sum": 0.000000000, 2023-09-13T10:05:17.973 INFO:teuthology.orchestra.run.smithi131.stdout: "avgtime": 0.000000000 2023-09-13T10:05:17.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.973 INFO:teuthology.orchestra.run.smithi131.stdout: } 2023-09-13T10:05:17.973 INFO:teuthology.orchestra.run.smithi131.stdout:} 2023-09-13T10:05:18.265 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-09-13T10:05:18.265 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-09-13T10:05:18.265 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-09-13T10:05:18.275 INFO:tasks.kclient:Unmounting kernel clients... 2023-09-13T10:05:18.275 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T10:05:18.276 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T10:05:18.300 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T10:05:18.300 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T10:05:18.361 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T10:05:18.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:18 smithi006 ceph-mon[98665]: pgmap v1073: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 27 KiB/s wr, 21 op/s 2023-09-13T10:05:18.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:18 smithi053 ceph-mon[102373]: pgmap v1073: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 27 KiB/s wr, 21 op/s 2023-09-13T10:05:18.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:18 smithi131 ceph-mon[102785]: pgmap v1073: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 27 KiB/s wr, 21 op/s 2023-09-13T10:05:18.539 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2733150764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec102940 msgr2=0x7f82ec1091f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2733150764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec102940 0x7f82ec1091f0 secure :-1 s=READY pgs=1994 cs=0 l=1 rev1=1 crypto rx=0x7f82e400b0d0 tx=0x7f82e400b3e0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2733150764 shutdown_connections 2023-09-13T10:05:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2733150764 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec102940 0x7f82ec1091f0 unknown :-1 s=CLOSED pgs=1994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2733150764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ec100db0 0x7f82ec1011d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.540 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2733150764 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ec101fa0 0x7f82ec102400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2733150764 >> 172.21.15.6:0/2733150764 conn(0x7f82ec0fc320 msgr2=0x7f82ec0fe760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2733150764 shutdown_connections 2023-09-13T10:05:18.541 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.538+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2733150764 wait complete. 2023-09-13T10:05:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.539+0000 7f82f3d5a700 1 Processor -- start 2023-09-13T10:05:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.539+0000 7f82f3d5a700 1 -- start start 2023-09-13T10:05:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec100db0 0x7f82ec074a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ec101fa0 0x7f82ec0730a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.544 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ec102940 0x7f82ec0735e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec073d80 con 0x7f82ec100db0 2023-09-13T10:05:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec073ef0 con 0x7f82ec102940 2023-09-13T10:05:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82ec1a0bb0 con 0x7f82ec101fa0 2023-09-13T10:05:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec100db0 0x7f82ec074a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.545 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec100db0 0x7f82ec074a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48570/0 (socket says 172.21.15.6:48570) 2023-09-13T10:05:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 -- 172.21.15.6:0/2327374068 learned_addr learned my addr 172.21.15.6:0/2327374068 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f12f5700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ec101fa0 0x7f82ec0730a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f22f7700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ec102940 0x7f82ec0735e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 -- 172.21.15.6:0/2327374068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ec101fa0 msgr2=0x7f82ec0730a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.546 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ec101fa0 0x7f82ec0730a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 -- 172.21.15.6:0/2327374068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ec102940 msgr2=0x7f82ec0735e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ec102940 0x7f82ec0735e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 -- 172.21.15.6:0/2327374068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e4009d00 con 0x7f82ec100db0 2023-09-13T10:05:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f22f7700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ec102940 0x7f82ec0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-13T10:05:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f1af6700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec100db0 0x7f82ec074a60 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f82e800d980 tx=0x7f82e800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:18.547 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82e2ffd700 1 -- 172.21.15.6:0/2327374068 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e800de60 con 0x7f82ec100db0 2023-09-13T10:05:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82e2ffd700 1 -- 172.21.15.6:0/2327374068 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f82e80044e0 con 0x7f82ec100db0 2023-09-13T10:05:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82ec1a0e90 con 0x7f82ec100db0 2023-09-13T10:05:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82e2ffd700 1 -- 172.21.15.6:0/2327374068 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82e8003be0 con 0x7f82ec100db0 2023-09-13T10:05:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.540+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82ec1a12b0 con 0x7f82ec100db0 2023-09-13T10:05:18.548 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.541+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82ec10c5d0 con 0x7f82ec100db0 2023-09-13T10:05:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.542+0000 7f82e2ffd700 1 -- 172.21.15.6:0/2327374068 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f82e8009bb0 con 0x7f82ec100db0 2023-09-13T10:05:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.543+0000 7f82e2ffd700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82d80a0640 0x7f82d80a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.543+0000 7f82f12f5700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82d80a0640 0x7f82d80a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.549 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.543+0000 7f82e2ffd700 1 -- 172.21.15.6:0/2327374068 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f82e80cb9c0 con 0x7f82ec100db0 2023-09-13T10:05:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.544+0000 7f82f12f5700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82d80a0640 0x7f82d80a2b00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f82dc005950 tx=0x7f82dc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:18.550 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.547+0000 7f82e2ffd700 1 -- 172.21.15.6:0/2327374068 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f82e80954a0 con 0x7f82ec100db0 2023-09-13T10:05:18.754 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.753+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f82ec107c10 con 0x7f82ec100db0 2023-09-13T10:05:18.755 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.755+0000 7f82e2ffd700 1 -- 172.21.15.6:0/2327374068 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22537 (secure 0 0 0) 0x7f82e8009940 con 0x7f82ec100db0 2023-09-13T10:05:18.756 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:05:18.756 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:40:08.835826+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T10:05:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82d80a0640 msgr2=0x7f82d80a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82d80a0640 0x7f82d80a2b00 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f82dc005950 tx=0x7f82dc0058e0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec100db0 msgr2=0x7f82ec074a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec100db0 0x7f82ec074a60 secure :-1 s=READY pgs=1995 cs=0 l=1 rev1=1 crypto rx=0x7f82e800d980 tx=0x7f82e800dd40 comp rx=0 tx=0).stop 2023-09-13T10:05:18.758 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 shutdown_connections 2023-09-13T10:05:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f82ec102940 0x7f82ec0735e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f82d80a0640 0x7f82d80a2b00 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82ec100db0 0x7f82ec074a60 unknown :-1 s=CLOSED pgs=1995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 --2- 172.21.15.6:0/2327374068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82ec101fa0 0x7f82ec0730a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.759 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 >> 172.21.15.6:0/2327374068 conn(0x7f82ec0fc320 msgr2=0x7f82ec0fe4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 shutdown_connections 2023-09-13T10:05:18.760 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.757+0000 7f82f3d5a700 1 -- 172.21.15.6:0/2327374068 wait complete. 2023-09-13T10:05:18.771 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-13T09:34:16.614229+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-13T09:38:07.130107+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-09-13T09:38:08.498784+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-13T10:05:18.771 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-13T10:05:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 -- 172.21.15.6:0/649247090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 msgr2=0x7f4bd4108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/649247090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd4108100 secure :-1 s=READY pgs=1996 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc00b0d0 tx=0x7f4bcc00b3e0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.904 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 -- 172.21.15.6:0/649247090 shutdown_connections 2023-09-13T10:05:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/649247090 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd4108100 unknown :-1 s=CLOSED pgs=1996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/649247090 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bd40ffcc0 0x7f4bd41000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/649247090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bd4100eb0 0x7f4bd4101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 -- 172.21.15.6:0/649247090 >> 172.21.15.6:0/649247090 conn(0x7f4bd40fb250 msgr2=0x7f4bd40fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:18.905 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 -- 172.21.15.6:0/649247090 shutdown_connections 2023-09-13T10:05:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.901+0000 7f4bda0fb700 1 -- 172.21.15.6:0/649247090 wait complete. 2023-09-13T10:05:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 Processor -- start 2023-09-13T10:05:18.906 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 -- start start 2023-09-13T10:05:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bd40ffcc0 0x7f4bd4198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.907 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bd4100eb0 0x7f4bd4199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd41a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd41a0900 con 0x7f4bd4101850 2023-09-13T10:05:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd41a0a70 con 0x7f4bd40ffcc0 2023-09-13T10:05:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bda0fb700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bd41a0c30 con 0x7f4bd4100eb0 2023-09-13T10:05:18.908 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd41a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd41a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48588/0 (socket says 172.21.15.6:48588) 2023-09-13T10:05:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd3fff700 1 -- 172.21.15.6:0/241435352 learned_addr learned my addr 172.21.15.6:0/241435352 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd2ffd700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bd4100eb0 0x7f4bd4199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd37fe700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bd40ffcc0 0x7f4bd4198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.909 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd3fff700 1 -- 172.21.15.6:0/241435352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bd4100eb0 msgr2=0x7f4bd4199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd3fff700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bd4100eb0 0x7f4bd4199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd3fff700 1 -- 172.21.15.6:0/241435352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bd40ffcc0 msgr2=0x7f4bd4198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:18.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.902+0000 7f4bd3fff700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bd40ffcc0 0x7f4bd4198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:18.910 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.903+0000 7f4bd3fff700 1 -- 172.21.15.6:0/241435352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bcc009d00 con 0x7f4bd4101850 2023-09-13T10:05:18.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.903+0000 7f4bd3fff700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd41a0330 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc007a00 tx=0x7f4bcc009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:18.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.903+0000 7f4bd0ff9700 1 -- 172.21.15.6:0/241435352 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc00e040 con 0x7f4bd4101850 2023-09-13T10:05:18.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.903+0000 7f4bd0ff9700 1 -- 172.21.15.6:0/241435352 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f4bcc01dd50 con 0x7f4bd4101850 2023-09-13T10:05:18.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.903+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bd41a0eb0 con 0x7f4bd4101850 2023-09-13T10:05:18.911 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.903+0000 7f4bd0ff9700 1 -- 172.21.15.6:0/241435352 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bcc0123f0 con 0x7f4bd4101850 2023-09-13T10:05:18.912 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.903+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bd41a1270 con 0x7f4bd4101850 2023-09-13T10:05:18.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.904+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bd410b530 con 0x7f4bd4101850 2023-09-13T10:05:18.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.905+0000 7f4bd0ff9700 1 -- 172.21.15.6:0/241435352 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4bcc01b450 con 0x7f4bd4101850 2023-09-13T10:05:18.913 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.906+0000 7f4bd0ff9700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4bbc0a0640 0x7f4bbc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.906+0000 7f4bd0ff9700 1 -- 172.21.15.6:0/241435352 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f4bcc0cda80 con 0x7f4bd4101850 2023-09-13T10:05:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.906+0000 7f4bd37fe700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4bbc0a0640 0x7f4bbc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.906+0000 7f4bd37fe700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4bbc0a0640 0x7f4bbc0a2b00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4bd419a290 tx=0x7f4bc400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:18.914 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:18.910+0000 7f4bd0ff9700 1 -- 172.21.15.6:0/241435352 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4bcc097590 con 0x7f4bd4101850 2023-09-13T10:05:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.111+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4bd41a1400 con 0x7f4bd4101850 2023-09-13T10:05:19.112 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.112+0000 7f4bd0ff9700 1 -- 172.21.15.6:0/241435352 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v88) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4bcc095e60 con 0x7f4bd4101850 2023-09-13T10:05:19.113 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2023-09-13T10:05:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4bbc0a0640 msgr2=0x7f4bbc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.115 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4bbc0a0640 0x7f4bbc0a2b00 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4bd419a290 tx=0x7f4bc400b410 comp rx=0 tx=0).stop 2023-09-13T10:05:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 msgr2=0x7f4bd41a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd41a0330 secure :-1 s=READY pgs=1997 cs=0 l=1 rev1=1 crypto rx=0x7f4bcc007a00 tx=0x7f4bcc009440 comp rx=0 tx=0).stop 2023-09-13T10:05:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 shutdown_connections 2023-09-13T10:05:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f4bbc0a0640 0x7f4bbc0a2b00 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.116 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bd4101850 0x7f4bd41a0330 unknown :-1 s=CLOSED pgs=1997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4bd40ffcc0 0x7f4bd4198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 --2- 172.21.15.6:0/241435352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4bd4100eb0 0x7f4bd4199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 >> 172.21.15.6:0/241435352 conn(0x7f4bd40fb250 msgr2=0x7f4bd4067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 shutdown_connections 2023-09-13T10:05:19.117 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.114+0000 7f4bda0fb700 1 -- 172.21.15.6:0/241435352 wait complete. 2023-09-13T10:05:19.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-13T10:05:19.262 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 -- 172.21.15.6:0/1365509986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7780101850 msgr2=0x7f7780108100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 --2- 172.21.15.6:0/1365509986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7780101850 0x7f7780108100 secure :-1 s=READY pgs=1998 cs=0 l=1 rev1=1 crypto rx=0x7f777800b0d0 tx=0x7f777800b3e0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 -- 172.21.15.6:0/1365509986 shutdown_connections 2023-09-13T10:05:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 --2- 172.21.15.6:0/1365509986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7780101850 0x7f7780108100 unknown :-1 s=CLOSED pgs=1998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 --2- 172.21.15.6:0/1365509986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77800ffcc0 0x7f77801000e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.263 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 --2- 172.21.15.6:0/1365509986 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7780100eb0 0x7f7780101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 -- 172.21.15.6:0/1365509986 >> 172.21.15.6:0/1365509986 conn(0x7f77800fb250 msgr2=0x7f77800fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 -- 172.21.15.6:0/1365509986 shutdown_connections 2023-09-13T10:05:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.257+0000 7f778779b700 1 -- 172.21.15.6:0/1365509986 wait complete. 2023-09-13T10:05:19.264 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 Processor -- start 2023-09-13T10:05:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 -- start start 2023-09-13T10:05:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77800ffcc0 0x7f77801944a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7780100eb0 0x7f77801949e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7780101850 0x7f7780191030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.265 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77801917d0 con 0x7f77800ffcc0 2023-09-13T10:05:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780191940 con 0x7f7780100eb0 2023-09-13T10:05:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f778779b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7780191b00 con 0x7f7780101850 2023-09-13T10:05:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77800ffcc0 0x7f77801944a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77800ffcc0 0x7f77801944a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48598/0 (socket says 172.21.15.6:48598) 2023-09-13T10:05:19.266 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 -- 172.21.15.6:0/3479797041 learned_addr learned my addr 172.21.15.6:0/3479797041 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785d38700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7780101850 0x7f7780191030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7784d36700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7780100eb0 0x7f77801949e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 -- 172.21.15.6:0/3479797041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7780101850 msgr2=0x7f7780191030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.267 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7780101850 0x7f7780191030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 -- 172.21.15.6:0/3479797041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7780100eb0 msgr2=0x7f77801949e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7780100eb0 0x7f77801949e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.258+0000 7f7785537700 1 -- 172.21.15.6:0/3479797041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7778009d00 con 0x7f77800ffcc0 2023-09-13T10:05:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.259+0000 7f7785537700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77800ffcc0 0x7f77801944a0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f777c00d980 tx=0x7f777c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:19.268 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.259+0000 7f77727fc700 1 -- 172.21.15.6:0/3479797041 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c004020 con 0x7f77800ffcc0 2023-09-13T10:05:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.259+0000 7f77727fc700 1 -- 172.21.15.6:0/3479797041 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f777c009730 con 0x7f77800ffcc0 2023-09-13T10:05:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.259+0000 7f77727fc700 1 -- 172.21.15.6:0/3479797041 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f777c003a80 con 0x7f77800ffcc0 2023-09-13T10:05:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.259+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77801a5280 con 0x7f77800ffcc0 2023-09-13T10:05:19.269 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.259+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77801a5760 con 0x7f77800ffcc0 2023-09-13T10:05:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.260+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778010b4e0 con 0x7f77800ffcc0 2023-09-13T10:05:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.261+0000 7f77727fc700 1 -- 172.21.15.6:0/3479797041 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f777c0098a0 con 0x7f77800ffcc0 2023-09-13T10:05:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.261+0000 7f77727fc700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f776c0a06c0 0x7f776c0a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.261+0000 7f77727fc700 1 -- 172.21.15.6:0/3479797041 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f777c0cbbe0 con 0x7f77800ffcc0 2023-09-13T10:05:19.270 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.261+0000 7f7784d36700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f776c0a06c0 0x7f776c0a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.262+0000 7f7784d36700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f776c0a06c0 0x7f776c0a2b80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7774005ea0 tx=0x7f7774005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:19.271 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.265+0000 7f77727fc700 1 -- 172.21.15.6:0/3479797041 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f777c095740 con 0x7f77800ffcc0 2023-09-13T10:05:19.466 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.466+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f77801a59e0 con 0x7f77800ffcc0 2023-09-13T10:05:19.467 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.466+0000 7f77727fc700 1 -- 172.21.15.6:0/3479797041 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v88) v1 ==== 104+0+11 (secure 0 0 0) 0x7f777c098d60 con 0x7f77800ffcc0 2023-09-13T10:05:19.467 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2023-09-13T10:05:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f776c0a06c0 msgr2=0x7f776c0a2b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f776c0a06c0 0x7f776c0a2b80 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f7774005ea0 tx=0x7f7774005e30 comp rx=0 tx=0).stop 2023-09-13T10:05:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77800ffcc0 msgr2=0x7f77801944a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.469 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77800ffcc0 0x7f77801944a0 secure :-1 s=READY pgs=1999 cs=0 l=1 rev1=1 crypto rx=0x7f777c00d980 tx=0x7f777c00dc90 comp rx=0 tx=0).stop 2023-09-13T10:05:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 shutdown_connections 2023-09-13T10:05:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7780101850 0x7f7780191030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f776c0a06c0 0x7f776c0a2b80 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.470 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f77800ffcc0 0x7f77801944a0 unknown :-1 s=CLOSED pgs=1999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 --2- 172.21.15.6:0/3479797041 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f7780100eb0 0x7f77801949e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 >> 172.21.15.6:0/3479797041 conn(0x7f77800fb250 msgr2=0x7f7780067fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 shutdown_connections 2023-09-13T10:05:19.471 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.468+0000 7f778779b700 1 -- 172.21.15.6:0/3479797041 wait complete. 2023-09-13T10:05:19.480 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:19 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2327374068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:05:19.480 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:19 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/241435352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T10:05:19.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-13T10:05:19.506 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:19 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2327374068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:05:19.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:19 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/241435352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T10:05:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:19 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2327374068' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:05:19.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:19 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/241435352' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-09-13T10:05:19.612 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2868600237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac101840 msgr2=0x7ff3ac103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2868600237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac101840 0x7ff3ac103c30 secure :-1 s=READY pgs=2000 cs=0 l=1 rev1=1 crypto rx=0x7ff3a0009990 tx=0x7ff3a0009ca0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2868600237 shutdown_connections 2023-09-13T10:05:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2868600237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac106aa0 0x7ff3ac108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.613 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2868600237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac101840 0x7ff3ac103c30 unknown :-1 s=CLOSED pgs=2000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2868600237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac104170 0x7ff3ac106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2868600237 >> 172.21.15.6:0/2868600237 conn(0x7ff3ac0fb250 msgr2=0x7ff3ac0fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2868600237 shutdown_connections 2023-09-13T10:05:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2868600237 wait complete. 2023-09-13T10:05:19.614 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 Processor -- start 2023-09-13T10:05:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.610+0000 7ff3b30d0700 1 -- start start 2023-09-13T10:05:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b30d0700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac101840 0x7ff3ac196a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b30d0700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac104170 0x7ff3ac196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b30d0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac106aa0 0x7ff3ac19dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.615 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b30d0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac19e5a0 con 0x7ff3ac106aa0 2023-09-13T10:05:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b30d0700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac19e6e0 con 0x7ff3ac104170 2023-09-13T10:05:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b30d0700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3ac19e870 con 0x7ff3ac101840 2023-09-13T10:05:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac106aa0 0x7ff3ac19dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac106aa0 0x7ff3ac19dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48616/0 (socket says 172.21.15.6:48616) 2023-09-13T10:05:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 -- 172.21.15.6:0/2180716250 learned_addr learned my addr 172.21.15.6:0/2180716250 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:19.616 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b0e6c700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac101840 0x7ff3ac196a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3abfff700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac104170 0x7ff3ac196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 -- 172.21.15.6:0/2180716250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac101840 msgr2=0x7ff3ac196a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac101840 0x7ff3ac196a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 -- 172.21.15.6:0/2180716250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac104170 msgr2=0x7ff3ac196f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.617 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac104170 0x7ff3ac196f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 -- 172.21.15.6:0/2180716250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3a00095f0 con 0x7ff3ac106aa0 2023-09-13T10:05:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b166d700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac106aa0 0x7ff3ac19dfd0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400ef30 tx=0x7ff3a400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3a9ffb700 1 -- 172.21.15.6:0/2180716250 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4018070 con 0x7ff3ac106aa0 2023-09-13T10:05:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3ac19eaf0 con 0x7ff3ac106aa0 2023-09-13T10:05:19.618 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3a9ffb700 1 -- 172.21.15.6:0/2180716250 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff3a400f040 con 0x7ff3ac106aa0 2023-09-13T10:05:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.611+0000 7ff3a9ffb700 1 -- 172.21.15.6:0/2180716250 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a400cdb0 con 0x7ff3ac106aa0 2023-09-13T10:05:19.619 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.612+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3ac19f000 con 0x7ff3ac106aa0 2023-09-13T10:05:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.613+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3ac0fcdd0 con 0x7ff3ac106aa0 2023-09-13T10:05:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.614+0000 7ff3a9ffb700 1 -- 172.21.15.6:0/2180716250 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff3a4003a00 con 0x7ff3ac106aa0 2023-09-13T10:05:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.615+0000 7ff3a9ffb700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff39c0a0640 0x7ff39c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.620 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.615+0000 7ff3a9ffb700 1 -- 172.21.15.6:0/2180716250 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff3a40cc190 con 0x7ff3ac106aa0 2023-09-13T10:05:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.615+0000 7ff3b0e6c700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff39c0a0640 0x7ff39c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.615+0000 7ff3b0e6c700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff39c0a0640 0x7ff39c0a2b00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b2e0 tx=0x7ff3a0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:19.621 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.618+0000 7ff3a9ffb700 1 -- 172.21.15.6:0/2180716250 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff3a4095d00 con 0x7ff3ac106aa0 2023-09-13T10:05:19.823 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.822+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3ac10c5a0 con 0x7ff3ac106aa0 2023-09-13T10:05:19.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.823+0000 7ff3a9ffb700 1 -- 172.21.15.6:0/2180716250 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v88) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3a4099320 con 0x7ff3ac106aa0 2023-09-13T10:05:19.824 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 64 2023-09-13T10:05:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff39c0a0640 msgr2=0x7ff39c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff39c0a0640 0x7ff39c0a2b00 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7ff3a000b2e0 tx=0x7ff3a0005fb0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.826 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac106aa0 msgr2=0x7ff3ac19dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac106aa0 0x7ff3ac19dfd0 secure :-1 s=READY pgs=2001 cs=0 l=1 rev1=1 crypto rx=0x7ff3a400ef30 tx=0x7ff3a400c3a0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 shutdown_connections 2023-09-13T10:05:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff39c0a0640 0x7ff39c0a2b00 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3ac106aa0 0x7ff3ac19dfd0 unknown :-1 s=CLOSED pgs=2001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.827 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3ac101840 0x7ff3ac196a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 --2- 172.21.15.6:0/2180716250 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff3ac104170 0x7ff3ac196f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 >> 172.21.15.6:0/2180716250 conn(0x7ff3ac0fb250 msgr2=0x7ff3ac1024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 shutdown_connections 2023-09-13T10:05:19.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.825+0000 7ff3b30d0700 1 -- 172.21.15.6:0/2180716250 wait complete. 2023-09-13T10:05:19.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-13T10:05:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 -- 172.21.15.6:0/3222381923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 msgr2=0x7f4240103c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 --2- 172.21.15.6:0/3222381923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240103c30 secure :-1 s=READY pgs=2002 cs=0 l=1 rev1=1 crypto rx=0x7f4234009990 tx=0x7f4234009ca0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 -- 172.21.15.6:0/3222381923 shutdown_connections 2023-09-13T10:05:19.966 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 --2- 172.21.15.6:0/3222381923 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4240106aa0 0x7f4240108f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 --2- 172.21.15.6:0/3222381923 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240103c30 unknown :-1 s=CLOSED pgs=2002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 --2- 172.21.15.6:0/3222381923 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4240104170 0x7f4240106560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 -- 172.21.15.6:0/3222381923 >> 172.21.15.6:0/3222381923 conn(0x7f42400fb250 msgr2=0x7f42400fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 -- 172.21.15.6:0/3222381923 shutdown_connections 2023-09-13T10:05:19.967 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.965+0000 7f4247920700 1 -- 172.21.15.6:0/3222381923 wait complete. 2023-09-13T10:05:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 Processor -- start 2023-09-13T10:05:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 -- start start 2023-09-13T10:05:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240196a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.970 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4240104170 0x7f4240196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4240106aa0 0x7f424019dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019e5b0 con 0x7f4240101840 2023-09-13T10:05:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019e6f0 con 0x7f4240106aa0 2023-09-13T10:05:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4247920700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f424019e880 con 0x7f4240104170 2023-09-13T10:05:19.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240196a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240196a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48626/0 (socket says 172.21.15.6:48626) 2023-09-13T10:05:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 -- 172.21.15.6:0/4025734055 learned_addr learned my addr 172.21.15.6:0/4025734055 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4245ebd700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4240106aa0 0x7f424019dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4244ebb700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4240104170 0x7f4240196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 -- 172.21.15.6:0/4025734055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4240104170 msgr2=0x7f4240196f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4240104170 0x7f4240196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 -- 172.21.15.6:0/4025734055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4240106aa0 msgr2=0x7f424019dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4240106aa0 0x7f424019dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 -- 172.21.15.6:0/4025734055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340095f0 con 0x7f4240101840 2023-09-13T10:05:19.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f4245ebd700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4240106aa0 0x7f424019dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-13T10:05:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42456bc700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240196a30 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f42340098e0 tx=0x7f423400f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.966+0000 7f42327fc700 1 -- 172.21.15.6:0/4025734055 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423401d070 con 0x7f4240101840 2023-09-13T10:05:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.967+0000 7f42327fc700 1 -- 172.21.15.6:0/4025734055 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f423400fb70 con 0x7f4240101840 2023-09-13T10:05:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.967+0000 7f42327fc700 1 -- 172.21.15.6:0/4025734055 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234017650 con 0x7f4240101840 2023-09-13T10:05:19.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.967+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f424019eb00 con 0x7f4240101840 2023-09-13T10:05:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.967+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424019eed0 con 0x7f4240101840 2023-09-13T10:05:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.968+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42400fcdd0 con 0x7f4240101840 2023-09-13T10:05:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.969+0000 7f42327fc700 1 -- 172.21.15.6:0/4025734055 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f4234022470 con 0x7f4240101840 2023-09-13T10:05:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.969+0000 7f42327fc700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f422c0a0640 0x7f422c0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:19.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.970+0000 7f4244ebb700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f422c0a0640 0x7f422c0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.970+0000 7f42327fc700 1 -- 172.21.15.6:0/4025734055 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f42340ccff0 con 0x7f4240101840 2023-09-13T10:05:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.970+0000 7f4244ebb700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f422c0a0640 0x7f422c0a2b00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f423c005950 tx=0x7f423c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:19.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:19.974+0000 7f42327fc700 1 -- 172.21.15.6:0/4025734055 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f4234096c00 con 0x7f4240101840 2023-09-13T10:05:20.193 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.192+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f424010c5a0 con 0x7f4240101840 2023-09-13T10:05:20.194 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.192+0000 7f42327fc700 1 -- 172.21.15.6:0/4025734055 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v88) v1 ==== 81+0+580 (secure 0 0 0) 0x7f423409a220 con 0x7f4240101840 2023-09-13T10:05:20.194 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1368467670 2023-09-14T09:32:06.061871+0000 2023-09-13T10:05:20.194 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/1676430765 2023-09-14T09:32:06.061871+0000 2023-09-13T10:05:20.195 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4035146106 2023-09-14T09:32:06.061871+0000 2023-09-13T10:05:20.195 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/788659299 2023-09-14T09:31:39.439757+0000 2023-09-13T10:05:20.195 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1844413257 2023-09-14T09:31:39.439757+0000 2023-09-13T10:05:20.195 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1602117516 2023-09-14T09:31:39.439757+0000 2023-09-13T10:05:20.195 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2818405814 2023-09-14T09:31:39.439757+0000 2023-09-13T10:05:20.196 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/1676430765 2023-09-14T09:32:06.061871+0000 2023-09-13T10:05:20.196 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/311769615 2023-09-14T09:32:06.061871+0000 2023-09-13T10:05:20.196 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2818405814 2023-09-14T09:31:39.439757+0000 2023-09-13T10:05:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f422c0a0640 msgr2=0x7f422c0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f422c0a0640 0x7f422c0a2b00 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f423c005950 tx=0x7f423c0058e0 comp rx=0 tx=0).stop 2023-09-13T10:05:20.197 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 msgr2=0x7f4240196a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240196a30 secure :-1 s=READY pgs=2003 cs=0 l=1 rev1=1 crypto rx=0x7f42340098e0 tx=0x7f423400f740 comp rx=0 tx=0).stop 2023-09-13T10:05:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 shutdown_connections 2023-09-13T10:05:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f4240106aa0 0x7f424019dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f422c0a0640 0x7f422c0a2b00 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:20.198 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4240101840 0x7f4240196a30 unknown :-1 s=CLOSED pgs=2003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 --2- 172.21.15.6:0/4025734055 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4240104170 0x7f4240196f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 >> 172.21.15.6:0/4025734055 conn(0x7f42400fb250 msgr2=0x7f42401024b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 shutdown_connections 2023-09-13T10:05:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:20.194+0000 7f4247920700 1 -- 172.21.15.6:0/4025734055 wait complete. 2023-09-13T10:05:20.199 INFO:teuthology.orchestra.run.smithi006.stderr:listed 10 entries 2023-09-13T10:05:20.207 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-09-13T10:05:20.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T10:05:20.208 DEBUG:teuthology.orchestra.run.smithi006:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-09-13T10:05:20.464 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi006.front.sepia.ceph.com 2023-09-13T10:05:20.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T10:05:20.465 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-13T10:05:20.466 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:20 smithi006 ceph-mon[98665]: pgmap v1074: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 170 B/s wr, 11 op/s 2023-09-13T10:05:20.466 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:20 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/3479797041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T10:05:20.467 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:20 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2180716250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T10:05:20.467 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:20 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/4025734055' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-13T10:05:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:20 smithi053 ceph-mon[102373]: pgmap v1074: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 170 B/s wr, 11 op/s 2023-09-13T10:05:20.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:20 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/3479797041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T10:05:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:20 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2180716250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T10:05:20.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:20 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/4025734055' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-13T10:05:20.532 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:20 smithi131 ceph-mon[102785]: pgmap v1074: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 170 B/s wr, 11 op/s 2023-09-13T10:05:20.532 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:20 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/3479797041' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-09-13T10:05:20.532 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:20 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2180716250' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-09-13T10:05:20.532 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:20 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/4025734055' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-09-13T10:05:20.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T10:05:20.608 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-09-13T10:05:20.695 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-13T10:05:20.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T10:05:20.695 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-13T10:05:20.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T10:05:20.969 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-09-13T10:05:21.185 INFO:tasks.kclient:Unmounting kernel clients... 2023-09-13T10:05:21.185 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2023-09-13T10:05:21.185 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-13T10:05:21.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16287360k,nr_inodes=4071840,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=36,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1440 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700,uid=1000,gid=1265 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/663876eadb39f5bb5fa5f1e100a158ab6cfadd58546f9aac7ca9b8e288a6d17d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/663876eadb39f5bb5fa5f1e100a158ab6cfadd58546f9aac7ca9b8e288a6d17d/diff,workdir=/var/lib/containers/storage/overlay/663876eadb39f5bb5fa5f1e100a158ab6cfadd58546f9aac7ca9b8e288a6d17d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f2cb827937cd17a3cbebee070cfe950436fbf45f0c6b748f20c7e72c929a98ff/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/f2cb827937cd17a3cbebee070cfe950436fbf45f0c6b748f20c7e72c929a98ff/diff,workdir=/var/lib/containers/storage/overlay/f2cb827937cd17a3cbebee070cfe950436fbf45f0c6b748f20c7e72c929a98ff/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3261172k,mode=700 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,relatime 0 0 overlay /var/lib/containers/storage/overlay/e44c6e761ff470dc269fe3e0604d334c3306d5fdb4cd26c93e17de849b6e3b81/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/e44c6e761ff470dc269fe3e0604d334c3306d5fdb4cd26c93e17de849b6e3b81/diff,workdir=/var/lib/containers/storage/overlay/e44c6e761ff470dc269fe3e0604d334c3306d5fdb4cd26c93e17de849b6e3b81/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/cc6711ef3585dee62c2aecfaba40f6d82c7ec6891d466f92b261171a131e6894/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/cc6711ef3585dee62c2aecfaba40f6d82c7ec6891d466f92b261171a131e6894/diff,workdir=/var/lib/containers/storage/overlay/cc6711ef3585dee62c2aecfaba40f6d82c7ec6891d466f92b261171a131e6894/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/f34db74a9c8b56312b54c42a14000338c51b569099e2269f352e659ca709671c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/f34db74a9c8b56312b54c42a14000338c51b569099e2269f352e659ca709671c/diff,workdir=/var/lib/containers/storage/overlay/f34db74a9c8b56312b54c42a14000338c51b569099e2269f352e659ca709671c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/536f3605c9d9b7df829b158e57bc9848b4494cb9883bb8d4b90ce33911f0b6f3/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/536f3605c9d9b7df829b158e57bc9848b4494cb9883bb8d4b90ce33911f0b6f3/diff,workdir=/var/lib/containers/storage/overlay/536f3605c9d9b7df829b158e57bc9848b4494cb9883bb8d4b90ce33911f0b6f3/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/9dab22c97d060efee9c30d407b8123c343aeeef37907edee80e3c683f9f88d43/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/9dab22c97d060efee9c30d407b8123c343aeeef37907edee80e3c683f9f88d43/diff,workdir=/var/lib/containers/storage/overlay/9dab22c97d060efee9c30d407b8123c343aeeef37907edee80e3c683f9f88d43/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a784c0e041065ccd458dc72530900ea4ca57cf80f8356d6c6e82fec2622641cf/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/a784c0e041065ccd458dc72530900ea4ca57cf80f8356d6c6e82fec2622641cf/diff,workdir=/var/lib/containers/storage/overlay/a784c0e041065ccd458dc72530900ea4ca57cf80f8356d6c6e82fec2622641cf/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/81c5fea0875227fabc4c545bae2bdba096d3bd07baf4e95da5e370d43043eb74/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/81c5fea0875227fabc4c545bae2bdba096d3bd07baf4e95da5e370d43043eb74/diff,workdir=/var/lib/containers/storage/overlay/81c5fea0875227fabc4c545bae2bdba096d3bd07baf4e95da5e370d43043eb74/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/e8d8926c4a35bca07884827f0750ca08fd44f2eed352734d16abdad0ed527c36/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/72AXSKQPOCAT3R7NON3JYMNCGQ:/var/lib/containers/storage/overlay/l/H3BPN4IKMWY2NP3UFLE4CIRTR2,upperdir=/var/lib/containers/storage/overlay/e8d8926c4a35bca07884827f0750ca08fd44f2eed352734d16abdad0ed527c36/diff,workdir=/var/lib/containers/storage/overlay/e8d8926c4a35bca07884827f0750ca08fd44f2eed352734d16abdad0ed527c36/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2023-09-13T10:05:21.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T10:05:21.289 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2023-09-13T10:05:21.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-13T10:05:21.354 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2023-09-13T10:05:21.398 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2023-09-13T10:05:21.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T10:05:21.400 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-09-13T10:05:21.410 INFO:tasks.cephadm:Teardown begin 2023-09-13T10:05:21.410 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-13T10:05:21.411 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:05:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 -- 172.21.15.6:0/2604955154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c101820 msgr2=0x7fe42c1080d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 --2- 172.21.15.6:0/2604955154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c101820 0x7fe42c1080d0 secure :-1 s=READY pgs=2004 cs=0 l=1 rev1=1 crypto rx=0x7fe42400b0d0 tx=0x7fe42400b3e0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 -- 172.21.15.6:0/2604955154 shutdown_connections 2023-09-13T10:05:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 --2- 172.21.15.6:0/2604955154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c101820 0x7fe42c1080d0 unknown :-1 s=CLOSED pgs=2004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 --2- 172.21.15.6:0/2604955154 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe42c0ffc90 0x7fe42c1000b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 --2- 172.21.15.6:0/2604955154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c100e80 0x7fe42c1012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 -- 172.21.15.6:0/2604955154 >> 172.21.15.6:0/2604955154 conn(0x7fe42c0fb220 msgr2=0x7fe42c0fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:21.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 -- 172.21.15.6:0/2604955154 shutdown_connections 2023-09-13T10:05:21.569 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.566+0000 7fe43118b700 1 -- 172.21.15.6:0/2604955154 wait complete. 2023-09-13T10:05:21.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.567+0000 7fe43118b700 1 Processor -- start 2023-09-13T10:05:21.571 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.567+0000 7fe43118b700 1 -- start start 2023-09-13T10:05:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe43118b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0ffc90 0x7fe42c068b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe43118b700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe42c100e80 0x7fe42c19b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe43118b700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c101820 0x7fe42c19df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe43118b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c19e6b0 con 0x7fe42c0ffc90 2023-09-13T10:05:21.572 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe43118b700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c19e820 con 0x7fe42c100e80 2023-09-13T10:05:21.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe43118b700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe42c19e9e0 con 0x7fe42c101820 2023-09-13T10:05:21.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0ffc90 0x7fe42c068b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0ffc90 0x7fe42c068b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48640/0 (socket says 172.21.15.6:48640) 2023-09-13T10:05:21.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 -- 172.21.15.6:0/2426922510 learned_addr learned my addr 172.21.15.6:0/2426922510 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:21.573 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42a59c700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe42c100e80 0x7fe42c19b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42b59e700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c101820 0x7fe42c19df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 -- 172.21.15.6:0/2426922510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c101820 msgr2=0x7fe42c19df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c101820 0x7fe42c19df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 -- 172.21.15.6:0/2426922510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe42c100e80 msgr2=0x7fe42c19b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.574 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe42c100e80 0x7fe42c19b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 -- 172.21.15.6:0/2426922510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe424009d00 con 0x7fe42c0ffc90 2023-09-13T10:05:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe42ad9d700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0ffc90 0x7fe42c068b20 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00d980 tx=0x7fe41c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe413fff700 1 -- 172.21.15.6:0/2426922510 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c004020 con 0x7fe42c0ffc90 2023-09-13T10:05:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe42c19ecc0 con 0x7fe42c0ffc90 2023-09-13T10:05:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe413fff700 1 -- 172.21.15.6:0/2426922510 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fe41c009730 con 0x7fe42c0ffc90 2023-09-13T10:05:21.575 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.568+0000 7fe413fff700 1 -- 172.21.15.6:0/2426922510 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41c003a30 con 0x7fe42c0ffc90 2023-09-13T10:05:21.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.569+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42c19f1d0 con 0x7fe42c0ffc90 2023-09-13T10:05:21.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.569+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe42c1071d0 con 0x7fe42c0ffc90 2023-09-13T10:05:21.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.570+0000 7fe413fff700 1 -- 172.21.15.6:0/2426922510 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fe41c0098a0 con 0x7fe42c0ffc90 2023-09-13T10:05:21.576 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.571+0000 7fe413fff700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4140a0640 0x7fe4140a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.571+0000 7fe413fff700 1 -- 172.21.15.6:0/2426922510 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7fe41c0cbc90 con 0x7fe42c0ffc90 2023-09-13T10:05:21.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.571+0000 7fe42a59c700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4140a0640 0x7fe4140a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.572+0000 7fe42a59c700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4140a0640 0x7fe4140a2b00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe420009c40 tx=0x7fe420009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:21.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.574+0000 7fe413fff700 1 -- 172.21.15.6:0/2426922510 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fe41c095710 con 0x7fe42c0ffc90 2023-09-13T10:05:21.824 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.824+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe42c02cfa0 con 0x7fe42c0ffc90 2023-09-13T10:05:21.825 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.825+0000 7fe413fff700 1 -- 172.21.15.6:0/2426922510 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+11363 (secure 0 0 0) 0x7fe41c098d30 con 0x7fe42c0ffc90 2023-09-13T10:05:21.826 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:05:21.826 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":87,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":87,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T10:04:52.212130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":369,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:05:21.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4140a0640 msgr2=0x7fe4140a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.828 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4140a0640 0x7fe4140a2b00 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe420009c40 tx=0x7fe420009260 comp rx=0 tx=0).stop 2023-09-13T10:05:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0ffc90 msgr2=0x7fe42c068b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0ffc90 0x7fe42c068b20 secure :-1 s=READY pgs=2005 cs=0 l=1 rev1=1 crypto rx=0x7fe41c00d980 tx=0x7fe41c00dc90 comp rx=0 tx=0).stop 2023-09-13T10:05:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 shutdown_connections 2023-09-13T10:05:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe42c101820 0x7fe42c19df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.829 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fe4140a0640 0x7fe4140a2b00 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe42c0ffc90 0x7fe42c068b20 unknown :-1 s=CLOSED pgs=2005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 --2- 172.21.15.6:0/2426922510 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fe42c100e80 0x7fe42c19b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 >> 172.21.15.6:0/2426922510 conn(0x7fe42c0fb220 msgr2=0x7fe42c104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 shutdown_connections 2023-09-13T10:05:21.830 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.827+0000 7fe43118b700 1 -- 172.21.15.6:0/2426922510 wait complete. 2023-09-13T10:05:21.831 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 87 2023-09-13T10:05:21.841 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-13T10:05:21.971 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 -- 172.21.15.6:0/2500627171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d00ffc90 msgr2=0x7f86d01000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 --2- 172.21.15.6:0/2500627171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d00ffc90 0x7f86d01000b0 secure :-1 s=READY pgs=2006 cs=0 l=1 rev1=1 crypto rx=0x7f86cc0099c0 tx=0x7f86cc009cd0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 -- 172.21.15.6:0/2500627171 shutdown_connections 2023-09-13T10:05:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 --2- 172.21.15.6:0/2500627171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d0101820 0x7f86d01080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.972 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 --2- 172.21.15.6:0/2500627171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d00ffc90 0x7f86d01000b0 unknown :-1 s=CLOSED pgs=2006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 --2- 172.21.15.6:0/2500627171 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86d0100e80 0x7f86d01012e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 -- 172.21.15.6:0/2500627171 >> 172.21.15.6:0/2500627171 conn(0x7f86d00fb220 msgr2=0x7f86d00fd640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 -- 172.21.15.6:0/2500627171 shutdown_connections 2023-09-13T10:05:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 -- 172.21.15.6:0/2500627171 wait complete. 2023-09-13T10:05:21.973 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 Processor -- start 2023-09-13T10:05:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.969+0000 7f86d7c82700 1 -- start start 2023-09-13T10:05:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d7c82700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00ffc90 0x7f86d0196a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d7c82700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d0100e80 0x7f86d0196fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d7c82700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86d0101820 0x7f86d019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.974 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d7c82700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d019e5e0 con 0x7f86d0100e80 2023-09-13T10:05:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d7c82700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d019e720 con 0x7f86d0101820 2023-09-13T10:05:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d7c82700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86d019e8b0 con 0x7f86d00ffc90 2023-09-13T10:05:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d0100e80 0x7f86d0196fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d0100e80 0x7f86d0196fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48656/0 (socket says 172.21.15.6:48656) 2023-09-13T10:05:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 -- 172.21.15.6:0/200094726 learned_addr learned my addr 172.21.15.6:0/200094726 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:21.975 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d5a1e700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00ffc90 0x7f86d0196a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d621f700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86d0101820 0x7f86d019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 -- 172.21.15.6:0/200094726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00ffc90 msgr2=0x7f86d0196a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00ffc90 0x7f86d0196a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 -- 172.21.15.6:0/200094726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86d0101820 msgr2=0x7f86d019e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:21.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86d0101820 0x7f86d019e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 -- 172.21.15.6:0/200094726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0095f0 con 0x7f86d0100e80 2023-09-13T10:05:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d521d700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d0100e80 0x7f86d0196fa0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f86c000e9a0 tx=0x7f86c000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86c6ffd700 1 -- 172.21.15.6:0/200094726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0009790 con 0x7f86d0100e80 2023-09-13T10:05:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86c6ffd700 1 -- 172.21.15.6:0/200094726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f86c000cbd0 con 0x7f86d0100e80 2023-09-13T10:05:21.977 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86d019eb90 con 0x7f86d0100e80 2023-09-13T10:05:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.970+0000 7f86c6ffd700 1 -- 172.21.15.6:0/200094726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c0018680 con 0x7f86d0100e80 2023-09-13T10:05:21.978 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.971+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86d019f0a0 con 0x7f86d0100e80 2023-09-13T10:05:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.971+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86d010b4c0 con 0x7f86d0100e80 2023-09-13T10:05:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.973+0000 7f86c6ffd700 1 -- 172.21.15.6:0/200094726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f86c000cd40 con 0x7f86d0100e80 2023-09-13T10:05:21.979 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.973+0000 7f86c6ffd700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86bc0a0640 0x7f86bc0a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.974+0000 7f86d5a1e700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86bc0a0640 0x7f86bc0a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.974+0000 7f86c6ffd700 1 -- 172.21.15.6:0/200094726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f86c0014070 con 0x7f86d0100e80 2023-09-13T10:05:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.974+0000 7f86d5a1e700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86bc0a0640 0x7f86bc0a2b00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009990 tx=0x7f86cc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:21.980 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:21.977+0000 7f86c6ffd700 1 -- 172.21.15.6:0/200094726 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f86c0095e80 con 0x7f86d0100e80 2023-09-13T10:05:22.225 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.225+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f86d010b6b0 con 0x7f86d0100e80 2023-09-13T10:05:22.226 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.226+0000 7f86c6ffd700 1 -- 172.21.15.6:0/200094726 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+11363 (secure 0 0 0) 0x7f86c00994a0 con 0x7f86d0100e80 2023-09-13T10:05:22.227 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:05:22.227 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":87,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14568,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6835/1678170367","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6834","nonce":1678170367},{"type":"v1","addr":"172.21.15.6:6835","nonce":1678170367}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14580,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6837/1215201331","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6836","nonce":1215201331},{"type":"v1","addr":"172.21.15.6:6837","nonce":1215201331}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":87,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-09-13T09:38:09.116270+0000","modified":"2023-09-13T10:04:52.212130+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24521,"mds_1":24484,"mds_2":24482,"mds_3":24466,"mds_4":24455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14634":{"gid":14634,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6839/565321366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6838","nonce":565321366},{"type":"v1","addr":"172.21.15.6:6839","nonce":565321366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14646":{"gid":14646,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.6:6841/1420340613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6840","nonce":1420340613},{"type":"v1","addr":"172.21.15.6:6841","nonce":1420340613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24412":{"gid":24412,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6833/4209861668","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":4209861668},{"type":"v1","addr":"172.21.15.131:6833","nonce":4209861668}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24428":{"gid":24428,"name":"k","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.53:6833/162812581","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6832","nonce":162812581},{"type":"v1","addr":"172.21.15.53:6833","nonce":162812581}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24454":{"gid":24454,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6835/487237413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":487237413},{"type":"v1","addr":"172.21.15.131:6835","nonce":487237413}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24455":{"gid":24455,"name":"e","rank":4,"incarnation":25,"state":"up:active","state_seq":8,"addr":"172.21.15.53:6835/460375736","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6834","nonce":460375736},{"type":"v1","addr":"172.21.15.53:6835","nonce":460375736}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24466":{"gid":24466,"name":"c","rank":3,"incarnation":23,"state":"up:active","state_seq":7,"addr":"172.21.15.131:6837/687345485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6836","nonce":687345485},{"type":"v1","addr":"172.21.15.131:6837","nonce":687345485}]},"join_fscid":-1,"export_targets":[0,1,2,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24482":{"gid":24482,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":369,"addr":"172.21.15.53:6837/1211463882","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6836","nonce":1211463882},{"type":"v1","addr":"172.21.15.53:6837","nonce":1211463882}]},"join_fscid":-1,"export_targets":[0,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24484":{"gid":24484,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":5,"addr":"172.21.15.131:6839/381550019","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6838","nonce":381550019},{"type":"v1","addr":"172.21.15.131:6839","nonce":381550019}]},"join_fscid":-1,"export_targets":[2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24521":{"gid":24521,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.53:6839/1050659050","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6838","nonce":1050659050},{"type":"v1","addr":"172.21.15.53:6839","nonce":1050659050}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-13T10:05:22.228 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86bc0a0640 msgr2=0x7f86bc0a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86bc0a0640 0x7f86bc0a2b00 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f86cc009990 tx=0x7f86cc01a040 comp rx=0 tx=0).stop 2023-09-13T10:05:22.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d0100e80 msgr2=0x7f86d0196fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d0100e80 0x7f86d0196fa0 secure :-1 s=READY pgs=2007 cs=0 l=1 rev1=1 crypto rx=0x7f86c000e9a0 tx=0x7f86c000ed60 comp rx=0 tx=0).stop 2023-09-13T10:05:22.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 shutdown_connections 2023-09-13T10:05:22.229 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f86d0101820 0x7f86d019e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86d00ffc90 0x7f86d0196a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f86bc0a0640 0x7f86bc0a2b00 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 --2- 172.21.15.6:0/200094726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86d0100e80 0x7f86d0196fa0 unknown :-1 s=CLOSED pgs=2007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 >> 172.21.15.6:0/200094726 conn(0x7f86d00fb220 msgr2=0x7f86d0067ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:22.230 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 shutdown_connections 2023-09-13T10:05:22.231 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.228+0000 7f86d7c82700 1 -- 172.21.15.6:0/200094726 wait complete. 2023-09-13T10:05:22.231 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 87 2023-09-13T10:05:22.241 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-13T10:05:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/4122238369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 msgr2=0x7f2e68100080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/4122238369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68100080 secure :-1 s=READY pgs=2008 cs=0 l=1 rev1=1 crypto rx=0x7f2e580099c0 tx=0x7f2e58009cd0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/4122238369 shutdown_connections 2023-09-13T10:05:22.368 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/4122238369 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e681017f0 0x7f2e681080a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/4122238369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68100080 unknown :-1 s=CLOSED pgs=2008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/4122238369 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e68100e50 0x7f2e681012b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/4122238369 >> 172.21.15.6:0/4122238369 conn(0x7f2e680fb190 msgr2=0x7f2e680fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/4122238369 shutdown_connections 2023-09-13T10:05:22.369 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/4122238369 wait complete. 2023-09-13T10:05:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 Processor -- start 2023-09-13T10:05:22.370 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.367+0000 7f2e6d5a5700 1 -- start start 2023-09-13T10:05:22.372 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68198c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e68100e50 0x7f2e681991b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e681017f0 0x7f2e681a01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e681a07b0 con 0x7f2e680ffc60 2023-09-13T10:05:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e681a0920 con 0x7f2e681017f0 2023-09-13T10:05:22.373 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e681a0ae0 con 0x7f2e68100e50 2023-09-13T10:05:22.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68198c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68198c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48668/0 (socket says 172.21.15.6:48668) 2023-09-13T10:05:22.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 -- 172.21.15.6:0/1896846785 learned_addr learned my addr 172.21.15.6:0/1896846785 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:22.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e667fc700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e68100e50 0x7f2e681991b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.374 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e677fe700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e681017f0 0x7f2e681a01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 -- 172.21.15.6:0/1896846785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e68100e50 msgr2=0x7f2e681991b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e68100e50 0x7f2e681991b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 -- 172.21.15.6:0/1896846785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e681017f0 msgr2=0x7f2e681a01e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e681017f0 0x7f2e681a01e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.375 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 -- 172.21.15.6:0/1896846785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e580095f0 con 0x7f2e680ffc60 2023-09-13T10:05:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e66ffd700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68198c70 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009fd0 tx=0x7f2e5800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e5ffff700 1 -- 172.21.15.6:0/1896846785 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e5801d070 con 0x7f2e680ffc60 2023-09-13T10:05:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e681a0d60 con 0x7f2e680ffc60 2023-09-13T10:05:22.376 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e5ffff700 1 -- 172.21.15.6:0/1896846785 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f2e580054f0 con 0x7f2e680ffc60 2023-09-13T10:05:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e5ffff700 1 -- 172.21.15.6:0/1896846785 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e58004bd0 con 0x7f2e680ffc60 2023-09-13T10:05:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.368+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e681a1190 con 0x7f2e680ffc60 2023-09-13T10:05:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.369+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e6810b470 con 0x7f2e680ffc60 2023-09-13T10:05:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.371+0000 7f2e5ffff700 1 -- 172.21.15.6:0/1896846785 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f2e5800fb80 con 0x7f2e680ffc60 2023-09-13T10:05:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.371+0000 7f2e5ffff700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e540a0640 0x7f2e540a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.377 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.371+0000 7f2e5ffff700 1 -- 172.21.15.6:0/1896846785 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7f2e580cce50 con 0x7f2e680ffc60 2023-09-13T10:05:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.371+0000 7f2e667fc700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e540a0640 0x7f2e540a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.372+0000 7f2e667fc700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e540a0640 0x7f2e540a2b00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009c60 tx=0x7f2e50009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:22.378 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.375+0000 7f2e5ffff700 1 -- 172.21.15.6:0/1896846785 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f2e580969c0 con 0x7f2e680ffc60 2023-09-13T10:05:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:22 smithi006 ceph-mon[98665]: pgmap v1075: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9 op/s 2023-09-13T10:05:22.506 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:22 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2426922510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:05:22.507 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:22 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/200094726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:05:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:22 smithi053 ceph-mon[102373]: pgmap v1075: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9 op/s 2023-09-13T10:05:22.507 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:22 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2426922510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:05:22.508 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:22 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/200094726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:05:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:22 smithi131 ceph-mon[102785]: pgmap v1075: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 9 op/s 2023-09-13T10:05:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:22 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2426922510' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:05:22.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:22 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/200094726' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-09-13T10:05:22.577 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.576+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e6810b680 con 0x7f2e680ffc60 2023-09-13T10:05:22.578 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.578+0000 7f2e5ffff700 1 -- 172.21.15.6:0/1896846785 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+22537 (secure 0 0 0) 0x7f2e58099fe0 con 0x7f2e680ffc60 2023-09-13T10:05:22.579 INFO:teuthology.orchestra.run.smithi006.stdout: 2023-09-13T10:05:22.579 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":88,"fsid":"27a2bbd4-5218-11ee-9ab8-7b867c8bd7da","created":"2023-09-13T09:31:04.146607+0000","modified":"2023-09-13T09:40:08.835826+0000","last_up_change":"2023-09-13T09:37:26.680422+0000","last_in_change":"2023-09-13T09:37:08.834239+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-13T09:34:16.614229+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-09-13T09:38:07.130107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-09-13T09:38:08.498784+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"14f623c2-a72c-4bae-a3d6-1655d183ae8d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6803","nonce":84174625}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6805","nonce":84174625}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6809","nonce":84174625}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":84174625},{"type":"v1","addr":"172.21.15.6:6807","nonce":84174625}]},"public_addr":"172.21.15.6:6803/84174625","cluster_addr":"172.21.15.6:6805/84174625","heartbeat_back_addr":"172.21.15.6:6809/84174625","heartbeat_front_addr":"172.21.15.6:6807/84174625","state":["exists","up"]},{"osd":1,"uuid":"ef1e644c-ae97-44af-9d69-43f58e7e946d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6800","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6801","nonce":1769951158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6802","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6803","nonce":1769951158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6806","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6807","nonce":1769951158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6804","nonce":1769951158},{"type":"v1","addr":"172.21.15.53:6805","nonce":1769951158}]},"public_addr":"172.21.15.53:6801/1769951158","cluster_addr":"172.21.15.53:6803/1769951158","heartbeat_back_addr":"172.21.15.53:6807/1769951158","heartbeat_front_addr":"172.21.15.53:6805/1769951158","state":["exists","up"]},{"osd":2,"uuid":"cc5a4835-e11d-4ae2-b317-7a00e34f74a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6801","nonce":2103696562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6803","nonce":2103696562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6807","nonce":2103696562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2103696562},{"type":"v1","addr":"172.21.15.131:6805","nonce":2103696562}]},"public_addr":"172.21.15.131:6801/2103696562","cluster_addr":"172.21.15.131:6803/2103696562","heartbeat_back_addr":"172.21.15.131:6807/2103696562","heartbeat_front_addr":"172.21.15.131:6805/2103696562","state":["exists","up"]},{"osd":3,"uuid":"b740401d-7c68-4954-9789-b811d2effbba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6811","nonce":1518323952}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6813","nonce":1518323952}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6817","nonce":1518323952}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":1518323952},{"type":"v1","addr":"172.21.15.6:6815","nonce":1518323952}]},"public_addr":"172.21.15.6:6811/1518323952","cluster_addr":"172.21.15.6:6813/1518323952","heartbeat_back_addr":"172.21.15.6:6817/1518323952","heartbeat_front_addr":"172.21.15.6:6815/1518323952","state":["exists","up"]},{"osd":4,"uuid":"8cd56f57-462e-434f-ba13-a93b66fca25c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6808","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6809","nonce":2094793371}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6810","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6811","nonce":2094793371}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6814","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6815","nonce":2094793371}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6812","nonce":2094793371},{"type":"v1","addr":"172.21.15.53:6813","nonce":2094793371}]},"public_addr":"172.21.15.53:6809/2094793371","cluster_addr":"172.21.15.53:6811/2094793371","heartbeat_back_addr":"172.21.15.53:6815/2094793371","heartbeat_front_addr":"172.21.15.53:6813/2094793371","state":["exists","up"]},{"osd":5,"uuid":"ead82706-9475-49d1-9e7c-f39c498e8b42","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6809","nonce":2492626170}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6811","nonce":2492626170}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6815","nonce":2492626170}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":2492626170},{"type":"v1","addr":"172.21.15.131:6813","nonce":2492626170}]},"public_addr":"172.21.15.131:6809/2492626170","cluster_addr":"172.21.15.131:6811/2492626170","heartbeat_back_addr":"172.21.15.131:6815/2492626170","heartbeat_front_addr":"172.21.15.131:6813/2492626170","state":["exists","up"]},{"osd":6,"uuid":"6340a542-4e1e-4a78-800c-e087c081a161","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6819","nonce":830400555}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6821","nonce":830400555}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6825","nonce":830400555}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":830400555},{"type":"v1","addr":"172.21.15.6:6823","nonce":830400555}]},"public_addr":"172.21.15.6:6819/830400555","cluster_addr":"172.21.15.6:6821/830400555","heartbeat_back_addr":"172.21.15.6:6825/830400555","heartbeat_front_addr":"172.21.15.6:6823/830400555","state":["exists","up"]},{"osd":7,"uuid":"fa7b97d8-bb41-4f66-b13a-30bd0b6304b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6816","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6817","nonce":1921263469}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6818","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6819","nonce":1921263469}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6822","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6823","nonce":1921263469}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6820","nonce":1921263469},{"type":"v1","addr":"172.21.15.53:6821","nonce":1921263469}]},"public_addr":"172.21.15.53:6817/1921263469","cluster_addr":"172.21.15.53:6819/1921263469","heartbeat_back_addr":"172.21.15.53:6823/1921263469","heartbeat_front_addr":"172.21.15.53:6821/1921263469","state":["exists","up"]},{"osd":8,"uuid":"489e288d-c0f6-43f0-b2c3-38ac78ae9d97","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6817","nonce":2882379120}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6819","nonce":2882379120}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6823","nonce":2882379120}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2882379120},{"type":"v1","addr":"172.21.15.131:6821","nonce":2882379120}]},"public_addr":"172.21.15.131:6817/2882379120","cluster_addr":"172.21.15.131:6819/2882379120","heartbeat_back_addr":"172.21.15.131:6823/2882379120","heartbeat_front_addr":"172.21.15.131:6821/2882379120","state":["exists","up"]},{"osd":9,"uuid":"8ff38aca-937b-4412-8179-dd5de05c99cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6827","nonce":3414335215}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6829","nonce":3414335215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6832","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6833","nonce":3414335215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6830","nonce":3414335215},{"type":"v1","addr":"172.21.15.6:6831","nonce":3414335215}]},"public_addr":"172.21.15.6:6827/3414335215","cluster_addr":"172.21.15.6:6829/3414335215","heartbeat_back_addr":"172.21.15.6:6833/3414335215","heartbeat_front_addr":"172.21.15.6:6831/3414335215","state":["exists","up"]},{"osd":10,"uuid":"0df1df73-c7bd-4263-8c5e-6e3b5183bd8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":71,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6824","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6825","nonce":382405178}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6826","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6827","nonce":382405178}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6830","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6831","nonce":382405178}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.53:6828","nonce":382405178},{"type":"v1","addr":"172.21.15.53:6829","nonce":382405178}]},"public_addr":"172.21.15.53:6825/382405178","cluster_addr":"172.21.15.53:6827/382405178","heartbeat_back_addr":"172.21.15.53:6831/382405178","heartbeat_front_addr":"172.21.15.53:6829/382405178","state":["exists","up"]},{"osd":11,"uuid":"ea94feef-e76d-4855-a60a-8fdf41e23135","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":79,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6825","nonce":4273429519}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6827","nonce":4273429519}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6831","nonce":4273429519}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":4273429519},{"type":"v1","addr":"172.21.15.131:6829","nonce":4273429519}]},"public_addr":"172.21.15.131:6825/4273429519","cluster_addr":"172.21.15.131:6827/4273429519","heartbeat_back_addr":"172.21.15.131:6831/4273429519","heartbeat_front_addr":"172.21.15.131:6829/4273429519","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:30.747326+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:33:51.690839+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:13.158715+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:34.310798+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:34:54.758241+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:16.124720+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:38.262348+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:35:58.958839+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:21.473337+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:36:42.896723+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:03.496988+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-13T09:37:25.511119+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11}]},{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.0","mappings":[{"from":5,"to":9},{"from":4,"to":8}]},{"pgid":"3.1b","mappings":[{"from":4,"to":8}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.25","mappings":[{"from":5,"to":9}]},{"pgid":"3.28","mappings":[{"from":3,"to":6}]},{"pgid":"3.31","mappings":[{"from":4,"to":6}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/1368467670":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6800/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/4035146106":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/788659299":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1844413257":"2023-09-14T09:31:39.439757+0000","172.21.15.6:0/1602117516":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6800/2818405814":"2023-09-14T09:31:39.439757+0000","172.21.15.6:6801/1676430765":"2023-09-14T09:32:06.061871+0000","172.21.15.6:0/311769615":"2023-09-14T09:32:06.061871+0000","172.21.15.6:6801/2818405814":"2023-09-14T09:31:39.439757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-13T10:05:22.580 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e540a0640 msgr2=0x7f2e540a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e540a0640 0x7f2e540a2b00 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f2e50009c60 tx=0x7f2e50009260 comp rx=0 tx=0).stop 2023-09-13T10:05:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 msgr2=0x7f2e68198c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68198c70 secure :-1 s=READY pgs=2009 cs=0 l=1 rev1=1 crypto rx=0x7f2e58009fd0 tx=0x7f2e5800f690 comp rx=0 tx=0).stop 2023-09-13T10:05:22.581 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 shutdown_connections 2023-09-13T10:05:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f2e681017f0 0x7f2e681a01e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f2e540a0640 0x7f2e540a2b00 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2e680ffc60 0x7f2e68198c70 unknown :-1 s=CLOSED pgs=2009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 --2- 172.21.15.6:0/1896846785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2e68100e50 0x7f2e681991b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.582 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 >> 172.21.15.6:0/1896846785 conn(0x7f2e680fb190 msgr2=0x7f2e680692a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 shutdown_connections 2023-09-13T10:05:22.583 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.580+0000 7f2e6d5a5700 1 -- 172.21.15.6:0/1896846785 wait complete. 2023-09-13T10:05:22.593 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-13T10:05:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 -- 172.21.15.6:0/3046438141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff898100d80 msgr2=0x7ff8981011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/3046438141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff898100d80 0x7ff8981011e0 secure :-1 s=READY pgs=2010 cs=0 l=1 rev1=1 crypto rx=0x7ff8880099c0 tx=0x7ff888009cd0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 -- 172.21.15.6:0/3046438141 shutdown_connections 2023-09-13T10:05:22.723 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/3046438141 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898101720 0x7ff898107fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/3046438141 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff8980ffb90 0x7ff8980fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/3046438141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff898100d80 0x7ff8981011e0 unknown :-1 s=CLOSED pgs=2010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 -- 172.21.15.6:0/3046438141 >> 172.21.15.6:0/3046438141 conn(0x7ff8980fb100 msgr2=0x7ff8980fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 -- 172.21.15.6:0/3046438141 shutdown_connections 2023-09-13T10:05:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.720+0000 7ff89d6dd700 1 -- 172.21.15.6:0/3046438141 wait complete. 2023-09-13T10:05:22.724 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 Processor -- start 2023-09-13T10:05:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 -- start start 2023-09-13T10:05:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980ffb90 0x7ff898194770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff898100d80 0x7ff898194cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898101720 0x7ff89819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.725 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89819c2f0 con 0x7ff8980ffb90 2023-09-13T10:05:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89819c430 con 0x7ff898101720 2023-09-13T10:05:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff89d6dd700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89819c5c0 con 0x7ff898100d80 2023-09-13T10:05:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980ffb90 0x7ff898194770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980ffb90 0x7ff898194770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48680/0 (socket says 172.21.15.6:48680) 2023-09-13T10:05:22.726 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 -- 172.21.15.6:0/22074415 learned_addr learned my addr 172.21.15.6:0/22074415 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff8977fe700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898101720 0x7ff89819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff8967fc700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff898100d80 0x7ff898194cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 -- 172.21.15.6:0/22074415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff898100d80 msgr2=0x7ff898194cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff898100d80 0x7ff898194cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.727 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 -- 172.21.15.6:0/22074415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898101720 msgr2=0x7ff89819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898101720 0x7ff89819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.721+0000 7ff896ffd700 1 -- 172.21.15.6:0/22074415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880095f0 con 0x7ff8980ffb90 2023-09-13T10:05:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.722+0000 7ff896ffd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980ffb90 0x7ff898194770 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7ff880009c70 tx=0x7ff880009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.722+0000 7ff88ffff700 1 -- 172.21.15.6:0/22074415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88001d070 con 0x7ff8980ffb90 2023-09-13T10:05:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.722+0000 7ff88ffff700 1 -- 172.21.15.6:0/22074415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7ff880015040 con 0x7ff8980ffb90 2023-09-13T10:05:22.728 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.722+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89819c8a0 con 0x7ff8980ffb90 2023-09-13T10:05:22.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.722+0000 7ff88ffff700 1 -- 172.21.15.6:0/22074415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8800039f0 con 0x7ff8980ffb90 2023-09-13T10:05:22.729 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.722+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89819cdb0 con 0x7ff8980ffb90 2023-09-13T10:05:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.723+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff898107120 con 0x7ff8980ffb90 2023-09-13T10:05:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.724+0000 7ff88ffff700 1 -- 172.21.15.6:0/22074415 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7ff880007980 con 0x7ff8980ffb90 2023-09-13T10:05:22.730 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.725+0000 7ff88ffff700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8840a0640 0x7ff8840a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.725+0000 7ff8967fc700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8840a0640 0x7ff8840a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.725+0000 7ff88ffff700 1 -- 172.21.15.6:0/22074415 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8306+0+0 (secure 0 0 0) 0x7ff8800cf310 con 0x7ff8980ffb90 2023-09-13T10:05:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.725+0000 7ff8967fc700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8840a0640 0x7ff8840a2b00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b580 tx=0x7ff888005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:22.731 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.729+0000 7ff88ffff700 1 -- 172.21.15.6:0/22074415 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7ff880098e20 con 0x7ff8980ffb90 2023-09-13T10:05:22.976 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.976+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7ff89810a340 con 0x7ff8980ffb90 2023-09-13T10:05:22.982 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.982+0000 7ff88ffff700 1 -- 172.21.15.6:0/22074415 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) v1 ==== 161+0+0 (secure 0 0 0) 0x7ff88009c440 con 0x7ff8980ffb90 2023-09-13T10:05:22.986 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8840a0640 msgr2=0x7ff8840a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8840a0640 0x7ff8840a2b00 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff88800b580 tx=0x7ff888005fb0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980ffb90 msgr2=0x7ff898194770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980ffb90 0x7ff898194770 secure :-1 s=READY pgs=2011 cs=0 l=1 rev1=1 crypto rx=0x7ff880009c70 tx=0x7ff880009f80 comp rx=0 tx=0).stop 2023-09-13T10:05:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 shutdown_connections 2023-09-13T10:05:22.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7ff898101720 0x7ff89819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7ff8840a0640 0x7ff8840a2b00 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8980ffb90 0x7ff898194770 unknown :-1 s=CLOSED pgs=2011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 --2- 172.21.15.6:0/22074415 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff898100d80 0x7ff898194cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 >> 172.21.15.6:0/22074415 conn(0x7ff8980fb100 msgr2=0x7ff898104260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:22.988 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 shutdown_connections 2023-09-13T10:05:22.989 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:22.986+0000 7ff89d6dd700 1 -- 172.21.15.6:0/22074415 wait complete. 2023-09-13T10:05:22.989 INFO:teuthology.orchestra.run.smithi006.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-13T10:05:23.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-13T10:05:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.135+0000 7f106aff9700 1 -- 172.21.15.6:0/1101390084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 msgr2=0x7f10641000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:23.138 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.135+0000 7f106aff9700 1 --2- 172.21.15.6:0/1101390084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 0x7f10641000e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f10580099c0 tx=0x7f1058009cd0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.135+0000 7f106aff9700 1 -- 172.21.15.6:0/1101390084 shutdown_connections 2023-09-13T10:05:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.135+0000 7f106aff9700 1 --2- 172.21.15.6:0/1101390084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064101850 0x7f1064108100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.135+0000 7f106aff9700 1 --2- 172.21.15.6:0/1101390084 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 0x7f10641000e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.135+0000 7f106aff9700 1 --2- 172.21.15.6:0/1101390084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1064100eb0 0x7f1064101310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.139 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.135+0000 7f106aff9700 1 -- 172.21.15.6:0/1101390084 >> 172.21.15.6:0/1101390084 conn(0x7f10640fb250 msgr2=0x7f10640fd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 -- 172.21.15.6:0/1101390084 shutdown_connections 2023-09-13T10:05:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 -- 172.21.15.6:0/1101390084 wait complete. 2023-09-13T10:05:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 Processor -- start 2023-09-13T10:05:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 -- start start 2023-09-13T10:05:23.140 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 0x7f1064196a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064100eb0 0x7f1064196fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1064101850 0x7f106419e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106419e610 con 0x7f1064100eb0 2023-09-13T10:05:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106419e750 con 0x7f10640ffcc0 2023-09-13T10:05:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f106aff9700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106419e8e0 con 0x7f1064101850 2023-09-13T10:05:23.141 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f1063fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064100eb0 0x7f1064196fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.136+0000 7f1068d95700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 0x7f1064196a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1063fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064100eb0 0x7f1064196fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48716/0 (socket says 172.21.15.6:48716) 2023-09-13T10:05:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1063fff700 1 -- 172.21.15.6:0/1133075498 learned_addr learned my addr 172.21.15.6:0/1133075498 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1069596700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1064101850 0x7f106419e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:23.142 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1068d95700 1 -- 172.21.15.6:0/1133075498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1064101850 msgr2=0x7f106419e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1068d95700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1064101850 0x7f106419e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1068d95700 1 -- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064100eb0 msgr2=0x7f1064196fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1068d95700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064100eb0 0x7f1064196fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1068d95700 1 -- 172.21.15.6:0/1133075498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c009c40 con 0x7f10640ffcc0 2023-09-13T10:05:23.143 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1063fff700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064100eb0 0x7f1064196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:05:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1068d95700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 0x7f1064196a90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f1058009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1061ffb700 1 -- 172.21.15.6:0/1133075498 <== mon.2 v2:172.21.15.53:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105801d070 con 0x7f10640ffcc0 2023-09-13T10:05:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1061ffb700 1 -- 172.21.15.6:0/1133075498 <== mon.2 v2:172.21.15.53:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f1058005020 con 0x7f10640ffcc0 2023-09-13T10:05:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10580095f0 con 0x7f10640ffcc0 2023-09-13T10:05:23.144 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f1061ffb700 1 -- 172.21.15.6:0/1133075498 <== mon.2 v2:172.21.15.53:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058004990 con 0x7f10640ffcc0 2023-09-13T10:05:23.145 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.137+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106419ed90 con 0x7f10640ffcc0 2023-09-13T10:05:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.138+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1064107d40 con 0x7f10640ffcc0 2023-09-13T10:05:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.140+0000 7f1061ffb700 1 -- 172.21.15.6:0/1133075498 <== mon.2 v2:172.21.15.53:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f1058005190 con 0x7f10640ffcc0 2023-09-13T10:05:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.141+0000 7f1061ffb700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10540a0640 0x7f10540a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.141+0000 7f1063fff700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10540a0640 0x7f10540a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.141+0000 7f1061ffb700 1 -- 172.21.15.6:0/1133075498 <== mon.2 v2:172.21.15.53:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8736+0+0 (secure 0 0 0) 0x7f10580cc9b0 con 0x7f10640ffcc0 2023-09-13T10:05:23.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.141+0000 7f1063fff700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10540a0640 0x7f10540a2b00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1050011550 tx=0x7f1050009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:23.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.144+0000 7f1061ffb700 1 -- 172.21.15.6:0/1133075498 <== mon.2 v2:172.21.15.53:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f1058096380 con 0x7f10640ffcc0 2023-09-13T10:05:23.256 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-a[150610]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.257 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-a[150610]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.257 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mds[150635]: -- 172.21.15.6:0/3959192800 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5595b6b0d1e0 con 0x5595b6ae2800 2023-09-13T10:05:23.257 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-a[150610]: starting mds.a at 2023-09-13T10:05:23.257 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-g[150228]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.258 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-g[150228]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.258 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mds[150252]: -- 172.21.15.6:0/1687722635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560dc3fb51e0 con 0x560dc3f8ac00 2023-09-13T10:05:23.258 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-g[150228]: starting mds.g at 2023-09-13T10:05:23.258 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:22 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a[98641]: 2023-09-13T10:05:22.977+0000 7f7c8c06c700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T10:05:23.396 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.395+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f106410b720 con 0x7f10640ffcc0 2023-09-13T10:05:23.506 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-k[138743]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.507 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-k[138743]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.507 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mds[138767]: -- 172.21.15.53:0/475044853 <== mon.2 v2:172.21.15.53:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5611ab68f1e0 con 0x5611ab664800 2023-09-13T10:05:23.507 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-k[138743]: starting mds.k at 2023-09-13T10:05:23.507 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.508 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.508 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mds[139795]: -- 172.21.15.53:0/3471767839 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5559fe60b1e0 con 0x5559fe5e0800 2023-09-13T10:05:23.508 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: starting mds.b at 2023-09-13T10:05:23.508 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-e[139084]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.509 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-e[139084]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.509 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mds[139108]: -- 172.21.15.53:0/369816392 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5603f0c231e0 con 0x5603f0bf8c00 2023-09-13T10:05:23.509 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-e[139084]: starting mds.e at 2023-09-13T10:05:23.509 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.510 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.510 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mds[139448]: -- 172.21.15.53:0/1066386127 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557b759551e0 con 0x557b7592ac00 2023-09-13T10:05:23.510 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: starting mds.h at 2023-09-13T10:05:23.510 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1896846785' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:05:23.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/22074415' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-09-13T10:05:23.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-09-13T10:05:23.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T10:05:23.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-09-13T10:05:23.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: osdmap e89: 12 total, 12 up, 12 in 2023-09-13T10:05:23.511 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/22074415' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-09-13T10:05:23.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-09-13T10:05:23.512 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:23 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T10:05:23.519 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-f[140636]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.519 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-f[140636]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.520 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mds[140660]: -- 172.21.15.131:0/1389116695 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558049c871e0 con 0x558049c5c800 2023-09-13T10:05:23.520 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-f[140636]: starting mds.f at 2023-09-13T10:05:23.520 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-i[141313]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.520 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-i[141313]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.521 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-i[141313]: starting mds.i at 2023-09-13T10:05:23.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1896846785' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:05:23.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/22074415' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-09-13T10:05:23.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-09-13T10:05:23.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T10:05:23.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-09-13T10:05:23.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: osdmap e89: 12 total, 12 up, 12 in 2023-09-13T10:05:23.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/22074415' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-09-13T10:05:23.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-09-13T10:05:23.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T10:05:23.523 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-c[140975]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.523 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-c[140975]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.523 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mds[140999]: -- 172.21.15.131:0/2286092588 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5570700bd1e0 con 0x557070093000 2023-09-13T10:05:23.523 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-c[140975]: starting mds.c at 2023-09-13T10:05:23.524 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-l[140298]: ignoring --setuser ceph since I am not root 2023-09-13T10:05:23.524 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-l[140298]: ignoring --setgroup ceph since I am not root 2023-09-13T10:05:23.524 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-mds[140322]: -- 172.21.15.131:0/1844826831 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ee4c85f1e0 con 0x55ee4c834800 2023-09-13T10:05:23.524 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:05:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-l[140298]: starting mds.l at 2023-09-13T10:05:23.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1896846785' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-09-13T10:05:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/22074415' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-09-13T10:05:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-09-13T10:05:23.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-09-13T10:05:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: Health check cleared: MDS_DAMAGE (was: 1 MDSs report damaged metadata) 2023-09-13T10:05:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: osdmap e89: 12 total, 12 up, 12 in 2023-09-13T10:05:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/22074415' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-09-13T10:05:23.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-09-13T10:05:23.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:23 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T10:05:23.987 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.986+0000 7f1061ffb700 1 -- 172.21.15.6:0/1133075498 <== mon.2 v2:172.21.15.53:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v89) v1 ==== 104+0+0 (secure 0 0 0) 0x7f10580999a0 con 0x7f10640ffcc0 2023-09-13T10:05:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.991+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10540a0640 msgr2=0x7f10540a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:23.991 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.991+0000 7f106aff9700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10540a0640 0x7f10540a2b00 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f1050011550 tx=0x7f1050009260 comp rx=0 tx=0).stop 2023-09-13T10:05:23.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.991+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 msgr2=0x7f1064196a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:23.992 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.991+0000 7f106aff9700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 0x7f1064196a90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f10580098e0 tx=0x7f1058009580 comp rx=0 tx=0).stop 2023-09-13T10:05:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 shutdown_connections 2023-09-13T10:05:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1064101850 0x7f106419e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f10640ffcc0 0x7f1064196a90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f10540a0640 0x7f10540a2b00 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.993 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 --2- 172.21.15.6:0/1133075498 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1064100eb0 0x7f1064196fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:23.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 >> 172.21.15.6:0/1133075498 conn(0x7f10640fb250 msgr2=0x7f10640fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:23.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 shutdown_connections 2023-09-13T10:05:23.994 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:23.992+0000 7f106aff9700 1 -- 172.21.15.6:0/1133075498 wait complete. 2023-09-13T10:05:24.008 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-13T10:05:24.147 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 -- 172.21.15.6:0/1582008436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010a920 msgr2=0x7fef2010cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:24.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 --2- 172.21.15.6:0/1582008436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010a920 0x7fef2010cdb0 secure :-1 s=READY pgs=2018 cs=0 l=1 rev1=1 crypto rx=0x7fef100074e0 tx=0x7fef1000af90 comp rx=0 tx=0).stop 2023-09-13T10:05:24.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 -- 172.21.15.6:0/1582008436 shutdown_connections 2023-09-13T10:05:24.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 --2- 172.21.15.6:0/1582008436 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef2010d440 0x7fef2010f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:24.148 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 --2- 172.21.15.6:0/1582008436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef20107f20 0x7fef2010a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:24.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 --2- 172.21.15.6:0/1582008436 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010a920 0x7fef2010cdb0 unknown :-1 s=CLOSED pgs=2018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:24.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 -- 172.21.15.6:0/1582008436 >> 172.21.15.6:0/1582008436 conn(0x7fef2006df60 msgr2=0x7fef200703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:24.149 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 -- 172.21.15.6:0/1582008436 shutdown_connections 2023-09-13T10:05:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 -- 172.21.15.6:0/1582008436 wait complete. 2023-09-13T10:05:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 Processor -- start 2023-09-13T10:05:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.145+0000 7fef25369700 1 -- start start 2023-09-13T10:05:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef25369700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef20107f20 0x7fef2019f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:24.150 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef25369700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef2010a920 0x7fef2019f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef25369700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010d440 0x7fef201a6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef25369700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef201a6e60 con 0x7fef2010d440 2023-09-13T10:05:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef25369700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef201a6fa0 con 0x7fef2010a920 2023-09-13T10:05:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef25369700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef201a7130 con 0x7fef20107f20 2023-09-13T10:05:24.151 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010d440 0x7fef201a6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1effd700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef20107f20 0x7fef2019f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1e7fc700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef2010a920 0x7fef2019f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010d440 0x7fef201a6890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48736/0 (socket says 172.21.15.6:48736) 2023-09-13T10:05:24.152 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 -- 172.21.15.6:0/378325237 learned_addr learned my addr 172.21.15.6:0/378325237 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:24.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 -- 172.21.15.6:0/378325237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef20107f20 msgr2=0x7fef2019f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:24.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef20107f20 0x7fef2019f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:24.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 -- 172.21.15.6:0/378325237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef2010a920 msgr2=0x7fef2019f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:24.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef2010a920 0x7fef2019f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:24.153 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 -- 172.21.15.6:0/378325237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef100071c0 con 0x7fef2010d440 2023-09-13T10:05:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1e7fc700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef2010a920 0x7fef2019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:05:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef1f7fe700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010d440 0x7fef201a6890 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fef1400e940 tx=0x7fef1400ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.146+0000 7fef07fff700 1 -- 172.21.15.6:0/378325237 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef140097b0 con 0x7fef2010d440 2023-09-13T10:05:24.154 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.147+0000 7fef07fff700 1 -- 172.21.15.6:0/378325237 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7fef14005020 con 0x7fef2010d440 2023-09-13T10:05:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.147+0000 7fef07fff700 1 -- 172.21.15.6:0/378325237 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400cc40 con 0x7fef2010d440 2023-09-13T10:05:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.147+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef201a7410 con 0x7fef2010d440 2023-09-13T10:05:24.155 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.147+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef201a78d0 con 0x7fef2010d440 2023-09-13T10:05:24.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.148+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef2006fae0 con 0x7fef2010d440 2023-09-13T10:05:24.156 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.149+0000 7fef07fff700 1 -- 172.21.15.6:0/378325237 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7fef14005400 con 0x7fef2010d440 2023-09-13T10:05:24.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.149+0000 7fef07fff700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef080a0640 0x7fef080a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:24.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.149+0000 7fef1effd700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef080a0640 0x7fef080a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:24.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.149+0000 7fef07fff700 1 -- 172.21.15.6:0/378325237 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 8736+0+0 (secure 0 0 0) 0x7fef14014070 con 0x7fef2010d440 2023-09-13T10:05:24.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.150+0000 7fef1effd700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef080a0640 0x7fef080a2b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fef18009550 tx=0x7fef180091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:24.157 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.153+0000 7fef07fff700 1 -- 172.21.15.6:0/378325237 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7fef14095aa0 con 0x7fef2010d440 2023-09-13T10:05:24.360 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:24.359+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef20112bb0 con 0x7fef2010d440 2023-09-13T10:05:24.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: pgmap v1076: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-09-13T10:05:24.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/1133075498' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T10:05:24.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T10:05:24.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-09-13T10:05:24.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-09-13T10:05:24.520 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: Cluster is now healthy 2023-09-13T10:05:24.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.6:6838/1753529828,v1:172.21.15.6:6840/1753529828] up:boot 2023-09-13T10:05:24.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.6:6839/2692589009,v1:172.21.15.6:6841/2692589009] up:boot 2023-09-13T10:05:24.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6834/4285249372,v1:172.21.15.53:6839/4285249372] up:boot 2023-09-13T10:05:24.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6835/3547866276,v1:172.21.15.53:6838/3547866276] up:boot 2023-09-13T10:05:24.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6833/592062793,v1:172.21.15.53:6837/592062793] up:boot 2023-09-13T10:05:24.521 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.53:6832/2688946102,v1:172.21.15.53:6836/2688946102] up:boot 2023-09-13T10:05:24.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6835/1246219468,v1:172.21.15.131:6839/1246219468] up:boot 2023-09-13T10:05:24.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6833/973502883,v1:172.21.15.131:6837/973502883] up:boot 2023-09-13T10:05:24.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6832/2385768243,v1:172.21.15.131:6836/2385768243] up:boot 2023-09-13T10:05:24.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: mds.? [v2:172.21.15.131:6834/454748584,v1:172.21.15.131:6838/454748584] up:boot 2023-09-13T10:05:24.522 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-09-13T10:05:24.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: fsmap 12 up:standby 2023-09-13T10:05:24.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-13T10:05:24.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-13T10:05:24.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-13T10:05:24.523 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-13T10:05:24.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-13T10:05:24.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-13T10:05:24.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-13T10:05:24.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T10:05:24.524 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-13T10:05:24.525 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:24 smithi131 ceph-mon[102785]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-13T10:05:24.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: pgmap v1076: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-09-13T10:05:24.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/1133075498' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T10:05:24.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T10:05:24.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-09-13T10:05:24.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-09-13T10:05:24.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: Cluster is now healthy 2023-09-13T10:05:24.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.6:6838/1753529828,v1:172.21.15.6:6840/1753529828] up:boot 2023-09-13T10:05:24.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.6:6839/2692589009,v1:172.21.15.6:6841/2692589009] up:boot 2023-09-13T10:05:24.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6834/4285249372,v1:172.21.15.53:6839/4285249372] up:boot 2023-09-13T10:05:24.758 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6835/3547866276,v1:172.21.15.53:6838/3547866276] up:boot 2023-09-13T10:05:24.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6833/592062793,v1:172.21.15.53:6837/592062793] up:boot 2023-09-13T10:05:24.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.53:6832/2688946102,v1:172.21.15.53:6836/2688946102] up:boot 2023-09-13T10:05:24.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6835/1246219468,v1:172.21.15.131:6839/1246219468] up:boot 2023-09-13T10:05:24.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6833/973502883,v1:172.21.15.131:6837/973502883] up:boot 2023-09-13T10:05:24.759 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6832/2385768243,v1:172.21.15.131:6836/2385768243] up:boot 2023-09-13T10:05:24.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: mds.? [v2:172.21.15.131:6834/454748584,v1:172.21.15.131:6838/454748584] up:boot 2023-09-13T10:05:24.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-09-13T10:05:24.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: fsmap 12 up:standby 2023-09-13T10:05:24.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-13T10:05:24.760 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-13T10:05:24.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-13T10:05:24.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-13T10:05:24.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-13T10:05:24.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-13T10:05:24.761 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-13T10:05:24.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T10:05:24.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-13T10:05:24.762 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:24 smithi053 ceph-mon[102373]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-13T10:05:24.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: pgmap v1076: 97 pgs: 97 active+clean; 1.0 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 255 B/s wr, 10 op/s 2023-09-13T10:05:24.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/1133075498' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T10:05:24.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-09-13T10:05:24.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-09-13T10:05:24.763 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-09-13T10:05:24.764 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: Cluster is now healthy 2023-09-13T10:05:24.764 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.6:6838/1753529828,v1:172.21.15.6:6840/1753529828] up:boot 2023-09-13T10:05:24.764 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.6:6839/2692589009,v1:172.21.15.6:6841/2692589009] up:boot 2023-09-13T10:05:24.764 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6834/4285249372,v1:172.21.15.53:6839/4285249372] up:boot 2023-09-13T10:05:24.764 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6835/3547866276,v1:172.21.15.53:6838/3547866276] up:boot 2023-09-13T10:05:24.764 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6833/592062793,v1:172.21.15.53:6837/592062793] up:boot 2023-09-13T10:05:24.765 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.53:6832/2688946102,v1:172.21.15.53:6836/2688946102] up:boot 2023-09-13T10:05:24.765 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6835/1246219468,v1:172.21.15.131:6839/1246219468] up:boot 2023-09-13T10:05:24.765 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6833/973502883,v1:172.21.15.131:6837/973502883] up:boot 2023-09-13T10:05:24.765 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6832/2385768243,v1:172.21.15.131:6836/2385768243] up:boot 2023-09-13T10:05:24.765 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: mds.? [v2:172.21.15.131:6834/454748584,v1:172.21.15.131:6838/454748584] up:boot 2023-09-13T10:05:24.766 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-09-13T10:05:24.766 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: fsmap 12 up:standby 2023-09-13T10:05:24.766 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-09-13T10:05:24.766 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-09-13T10:05:24.766 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-09-13T10:05:24.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-09-13T10:05:24.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-09-13T10:05:24.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-09-13T10:05:24.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-09-13T10:05:24.767 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-09-13T10:05:24.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-09-13T10:05:24.768 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:24 smithi006 ceph-mon[98665]: from='mgr.14152 172.21.15.6:0/3058509219' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-09-13T10:05:25.272 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.271+0000 7fef07fff700 1 -- 172.21.15.6:0/378325237 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v90) v1 ==== 181+0+0 (secure 0 0 0) 0x7fef14005190 con 0x7fef2010d440 2023-09-13T10:05:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef080a0640 msgr2=0x7fef080a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef080a0640 0x7fef080a2b00 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fef18009550 tx=0x7fef180091b0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010d440 msgr2=0x7fef201a6890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010d440 0x7fef201a6890 secure :-1 s=READY pgs=2019 cs=0 l=1 rev1=1 crypto rx=0x7fef1400e940 tx=0x7fef1400ec50 comp rx=0 tx=0).stop 2023-09-13T10:05:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 shutdown_connections 2023-09-13T10:05:25.277 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7fef080a0640 0x7fef080a2b00 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef2010d440 0x7fef201a6890 unknown :-1 s=CLOSED pgs=2019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef20107f20 0x7fef2019f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 --2- 172.21.15.6:0/378325237 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7fef2010a920 0x7fef2019f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.275+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 >> 172.21.15.6:0/378325237 conn(0x7fef2006df60 msgr2=0x7fef20108b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.276+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 shutdown_connections 2023-09-13T10:05:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.276+0000 7fef25369700 1 -- 172.21.15.6:0/378325237 wait complete. 2023-09-13T10:05:25.279 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_metadata' removed 2023-09-13T10:05:25.298 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-13T10:05:25.447 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 -- 172.21.15.6:0/404033034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 msgr2=0x7f5914108150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:25.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 --2- 172.21.15.6:0/404033034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 0x7f5914108150 secure :-1 s=READY pgs=2020 cs=0 l=1 rev1=1 crypto rx=0x7f590c009990 tx=0x7f590c009ca0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 -- 172.21.15.6:0/404033034 shutdown_connections 2023-09-13T10:05:25.448 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 --2- 172.21.15.6:0/404033034 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 0x7f5914108150 unknown :-1 s=CLOSED pgs=2020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 --2- 172.21.15.6:0/404033034 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59141012a0 0x7f59141016c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 --2- 172.21.15.6:0/404033034 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 0x7f5914100370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 -- 172.21.15.6:0/404033034 >> 172.21.15.6:0/404033034 conn(0x7f59140fa9a0 msgr2=0x7f59140fce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 -- 172.21.15.6:0/404033034 shutdown_connections 2023-09-13T10:05:25.449 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.445+0000 7f591a250700 1 -- 172.21.15.6:0/404033034 wait complete. 2023-09-13T10:05:25.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 Processor -- start 2023-09-13T10:05:25.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 -- start start 2023-09-13T10:05:25.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 0x7f5914196a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:25.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 0x7f5914196f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:25.450 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 --2- >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59141012a0 0x7f591419e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591419e5d0 con 0x7f59141008b0 2023-09-13T10:05:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 -- --> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591419e710 con 0x7f59141012a0 2023-09-13T10:05:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f591a250700 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f591419e8a0 con 0x7f59140ffef0 2023-09-13T10:05:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5912ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 0x7f5914196f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:25.451 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f59137fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 0x7f5914196a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f59137fe700 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 0x7f5914196a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.6:51800/0 (socket says 172.21.15.6:51800) 2023-09-13T10:05:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f59137fe700 1 -- 172.21.15.6:0/2742236973 learned_addr learned my addr 172.21.15.6:0/2742236973 (peer_addr_for_me v2:172.21.15.6:0/0) 2023-09-13T10:05:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5913fff700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59141012a0 0x7f591419e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5912ffd700 1 -- 172.21.15.6:0/2742236973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 msgr2=0x7f5914196a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:25.452 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5912ffd700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 0x7f5914196a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5912ffd700 1 -- 172.21.15.6:0/2742236973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59141012a0 msgr2=0x7f591419e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5912ffd700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59141012a0 0x7f591419e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5912ffd700 1 -- 172.21.15.6:0/2742236973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f590c0095f0 con 0x7f59141008b0 2023-09-13T10:05:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f59137fe700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 0x7f5914196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:05:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.446+0000 7f5913fff700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59141012a0 0x7f591419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-13T10:05:25.453 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.447+0000 7f5912ffd700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 0x7f5914196f90 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00e9c0 tx=0x7f58fc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.447+0000 7f5910ff9700 1 -- 172.21.15.6:0/2742236973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc004220 con 0x7f59141008b0 2023-09-13T10:05:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.447+0000 7f5910ff9700 1 -- 172.21.15.6:0/2742236973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1105+0+0 (secure 0 0 0) 0x7f58fc004380 con 0x7f59141008b0 2023-09-13T10:05:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.447+0000 7f5910ff9700 1 -- 172.21.15.6:0/2742236973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58fc003be0 con 0x7f59141008b0 2023-09-13T10:05:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.447+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f591419eb80 con 0x7f59141008b0 2023-09-13T10:05:25.454 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.447+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f591419f040 con 0x7f59141008b0 2023-09-13T10:05:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.448+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f591410b500 con 0x7f59141008b0 2023-09-13T10:05:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.449+0000 7f5910ff9700 1 -- 172.21.15.6:0/2742236973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 135258+0+0 (secure 0 0 0) 0x7f58fc003d40 con 0x7f59141008b0 2023-09-13T10:05:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.449+0000 7f5910ff9700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f59000a0640 0x7f59000a2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-13T10:05:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.450+0000 7f59137fe700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f59000a0640 0x7f59000a2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-13T10:05:25.456 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.450+0000 7f5910ff9700 1 -- 172.21.15.6:0/2742236973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8182+0+0 (secure 0 0 0) 0x7f58fc014070 con 0x7f59141008b0 2023-09-13T10:05:25.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.450+0000 7f59137fe700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f59000a0640 0x7f59000a2b00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5904003ef0 tx=0x7f590400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-13T10:05:25.457 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.454+0000 7f5910ff9700 1 -- 172.21.15.6:0/2742236973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179712 (secure 0 0 0) 0x7f58fc095940 con 0x7f59141008b0 2023-09-13T10:05:25.519 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:25 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/378325237' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-13T10:05:25.660 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:25.659+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f591410b710 con 0x7f59141008b0 2023-09-13T10:05:25.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:25 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/378325237' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-13T10:05:25.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:25 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/378325237' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-13T10:05:26.273 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.272+0000 7f5910ff9700 1 -- 172.21.15.6:0/2742236973 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v91) v1 ==== 169+0+0 (secure 0 0 0) 0x7f58fc098f60 con 0x7f59141008b0 2023-09-13T10:05:26.279 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f59000a0640 msgr2=0x7f59000a2b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:26.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f59000a0640 0x7f59000a2b00 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f5904003ef0 tx=0x7f590400b040 comp rx=0 tx=0).stop 2023-09-13T10:05:26.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 msgr2=0x7f5914196f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-13T10:05:26.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 0x7f5914196f90 secure :-1 s=READY pgs=2021 cs=0 l=1 rev1=1 crypto rx=0x7f58fc00e9c0 tx=0x7f58fc00ecd0 comp rx=0 tx=0).stop 2023-09-13T10:05:26.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 shutdown_connections 2023-09-13T10:05:26.280 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.53:3300/0,v1:172.21.15.53:6789/0] conn(0x7f59141012a0 0x7f591419e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f59140ffef0 0x7f5914196a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:6800/1364175161,v1:172.21.15.6:6801/1364175161] conn(0x7f59000a0640 0x7f59000a2b00 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 --2- 172.21.15.6:0/2742236973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f59141008b0 0x7f5914196f90 unknown :-1 s=CLOSED pgs=2021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-13T10:05:26.281 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 >> 172.21.15.6:0/2742236973 conn(0x7f59140fa9a0 msgr2=0x7f59140fee20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-13T10:05:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.278+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 shutdown_connections 2023-09-13T10:05:26.282 INFO:teuthology.orchestra.run.smithi006.stderr:2023-09-13T10:05:26.279+0000 7f591a250700 1 -- 172.21.15.6:0/2742236973 wait complete. 2023-09-13T10:05:26.284 INFO:teuthology.orchestra.run.smithi006.stderr:pool 'cephfs_data' removed 2023-09-13T10:05:26.301 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-13T10:05:26.349 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-13T10:05:26.478 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-13T10:05:26.584 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:26 smithi131 ceph-mon[102785]: pgmap v1078: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-09-13T10:05:26.585 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/378325237' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-09-13T10:05:26.585 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:26 smithi131 ceph-mon[102785]: osdmap e90: 12 total, 12 up, 12 in 2023-09-13T10:05:26.586 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:26 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2742236973' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-13T10:05:26.591 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-09-13T10:05:26.592 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-13T10:05:26.613 DEBUG:teuthology.orchestra.run.smithi053:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-13T10:05:27.288 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:26 smithi053 ceph-mon[102373]: pgmap v1078: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-09-13T10:05:27.289 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/378325237' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-09-13T10:05:27.289 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:26 smithi053 ceph-mon[102373]: osdmap e90: 12 total, 12 up, 12 in 2023-09-13T10:05:27.289 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:26 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2742236973' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-13T10:05:27.290 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:26 smithi006 ceph-mon[98665]: pgmap v1078: 97 pgs: 97 active+clean; 1.0 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2023-09-13T10:05:27.290 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/378325237' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-09-13T10:05:27.290 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:26 smithi006 ceph-mon[98665]: osdmap e90: 12 total, 12 up, 12 in 2023-09-13T10:05:27.290 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:26 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2742236973' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-09-13T10:05:27.333 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-09-13T10:05:27.370 INFO:tasks.cephadm:Stopping all daemons... 2023-09-13T10:05:27.371 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-09-13T10:05:27.372 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a 2023-09-13T10:05:27.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:27 smithi053 ceph-mon[102373]: from='client.? 172.21.15.6:0/2742236973' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-09-13T10:05:27.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:27 smithi053 ceph-mon[102373]: osdmap e91: 12 total, 12 up, 12 in 2023-09-13T10:05:27.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:27 smithi006 ceph-mon[98665]: from='client.? 172.21.15.6:0/2742236973' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-09-13T10:05:27.758 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:27 smithi006 ceph-mon[98665]: osdmap e91: 12 total, 12 up, 12 in 2023-09-13T10:05:27.759 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:27 smithi006 systemd[1]: Stopping Ceph mon.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:27.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:27 smithi131 ceph-mon[102785]: from='client.? 172.21.15.6:0/2742236973' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2023-09-13T10:05:27.770 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:27 smithi131 ceph-mon[102785]: osdmap e91: 12 total, 12 up, 12 in 2023-09-13T10:05:28.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:28 smithi006 ceph-mon[98665]: pgmap v1081: 1 pgs: 1 active+clean; 577 KiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T10:05:28.756 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:28 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a[98641]: 2023-09-13T10:05:28.521+0000 7f7c91877700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:28.757 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:28 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a[98641]: 2023-09-13T10:05:28.521+0000 7f7c91877700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-09-13T10:05:28.757 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:28 smithi053 ceph-mon[102373]: pgmap v1081: 1 pgs: 1 active+clean; 577 KiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T10:05:28.769 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:28 smithi131 ceph-mon[102785]: pgmap v1081: 1 pgs: 1 active+clean; 577 KiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail 2023-09-13T10:05:29.256 INFO:journalctl@ceph.mon.a.smithi006.stdout:Sep 13 10:05:29 smithi006 bash[199187]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-a 2023-09-13T10:05:29.369 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.a.service' 2023-09-13T10:05:29.421 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:29.421 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-09-13T10:05:29.422 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-09-13T10:05:29.422 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.b 2023-09-13T10:05:29.756 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:29 smithi053 systemd[1]: Stopping Ceph mon.b for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:30.256 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-b[102349]: 2023-09-13T10:05:29.835+0000 7f703231b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:30.257 INFO:journalctl@ceph.mon.b.smithi053.stdout:Sep 13 10:05:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-b[102349]: 2023-09-13T10:05:29.835+0000 7f703231b700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-09-13T10:05:30.479 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.b.service' 2023-09-13T10:05:30.533 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:30.533 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-09-13T10:05:30.534 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-09-13T10:05:30.534 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.c 2023-09-13T10:05:31.019 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:30 smithi131 systemd[1]: Stopping Ceph mon.c for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:31.359 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-c[102761]: 2023-09-13T10:05:31.058+0000 7f0e6f44f700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:31.359 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-c[102761]: 2023-09-13T10:05:31.058+0000 7f0e6f44f700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-09-13T10:05:31.684 INFO:journalctl@ceph.mon.c.smithi131.stdout:Sep 13 10:05:31 smithi131 bash[151023]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mon-c 2023-09-13T10:05:31.874 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mon.c.service' 2023-09-13T10:05:31.931 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:31.932 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-09-13T10:05:31.932 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-09-13T10:05:31.932 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.x 2023-09-13T10:05:32.256 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 10:05:31 smithi006 systemd[1]: Stopping Ceph mgr.x for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:32.648 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 10:05:32 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T10:05:32.299+0000 7fc3d3342700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:32.648 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 10:05:32 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x[98910]: 2023-09-13T10:05:32.299+0000 7fc3d3342700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-09-13T10:05:32.932 INFO:journalctl@ceph.mgr.x.smithi006.stdout:Sep 13 10:05:32 smithi006 bash[199335]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-x 2023-09-13T10:05:32.938 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.x.service' 2023-09-13T10:05:32.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:32.978 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-09-13T10:05:32.979 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-09-13T10:05:32.979 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.y 2023-09-13T10:05:33.402 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 10:05:33 smithi053 systemd[1]: Stopping Ceph mgr.y for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:33.693 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 10:05:33 smithi053 bash[148343]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-y 2023-09-13T10:05:33.882 INFO:journalctl@ceph.mgr.y.smithi053.stdout:Sep 13 10:05:33 smithi053 systemd[1]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-09-13T10:05:33.886 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.y.service' 2023-09-13T10:05:33.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:33.925 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-09-13T10:05:33.925 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-09-13T10:05:33.926 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.z 2023-09-13T10:05:34.269 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 10:05:33 smithi131 systemd[1]: Stopping Ceph mgr.z for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:34.769 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 10:05:34 smithi131 bash[151172]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mgr-z 2023-09-13T10:05:34.770 INFO:journalctl@ceph.mgr.z.smithi131.stdout:Sep 13 10:05:34 smithi131 systemd[1]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-09-13T10:05:34.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mgr.z.service' 2023-09-13T10:05:34.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:34.859 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-09-13T10:05:34.859 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-09-13T10:05:34.860 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.0 2023-09-13T10:05:35.217 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 10:05:34 smithi006 systemd[1]: Stopping Ceph osd.0 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:35.506 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 10:05:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-0[116505]: 2023-09-13T10:05:35.215+0000 7f3984dda700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:35.507 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 10:05:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-0[116505]: 2023-09-13T10:05:35.215+0000 7f3984dda700 -1 osd.0 91 *** Got signal Terminated *** 2023-09-13T10:05:35.507 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 10:05:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-0[116505]: 2023-09-13T10:05:35.215+0000 7f3984dda700 -1 osd.0 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:05:41.001 INFO:journalctl@ceph.osd.0.smithi006.stdout:Sep 13 10:05:40 smithi006 bash[199474]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-0 2023-09-13T10:05:42.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.0.service' 2023-09-13T10:05:42.519 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:42.519 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-09-13T10:05:42.520 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-09-13T10:05:42.520 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.1 2023-09-13T10:05:42.885 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 10:05:42 smithi053 systemd[1]: Stopping Ceph osd.1 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:43.256 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 10:05:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-1[107437]: 2023-09-13T10:05:42.883+0000 7f3942809700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:43.257 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 10:05:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-1[107437]: 2023-09-13T10:05:42.883+0000 7f3942809700 -1 osd.1 91 *** Got signal Terminated *** 2023-09-13T10:05:43.257 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 10:05:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-1[107437]: 2023-09-13T10:05:42.883+0000 7f3942809700 -1 osd.1 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:05:48.869 INFO:journalctl@ceph.osd.1.smithi053.stdout:Sep 13 10:05:48 smithi053 bash[148493]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-1 2023-09-13T10:05:50.345 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.1.service' 2023-09-13T10:05:50.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:50.389 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-09-13T10:05:50.389 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-09-13T10:05:50.389 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.2 2023-09-13T10:05:50.762 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 10:05:50 smithi131 systemd[1]: Stopping Ceph osd.2 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:51.019 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 10:05:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-2[108588]: 2023-09-13T10:05:50.761+0000 7f19b7163700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:51.019 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 10:05:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-2[108588]: 2023-09-13T10:05:50.761+0000 7f19b7163700 -1 osd.2 91 *** Got signal Terminated *** 2023-09-13T10:05:51.019 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 10:05:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-2[108588]: 2023-09-13T10:05:50.761+0000 7f19b7163700 -1 osd.2 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:05:57.019 INFO:journalctl@ceph.osd.2.smithi131.stdout:Sep 13 10:05:56 smithi131 bash[151320]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-2 2023-09-13T10:05:58.183 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.2.service' 2023-09-13T10:05:58.226 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:05:58.226 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-09-13T10:05:58.227 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-09-13T10:05:58.227 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.3 2023-09-13T10:05:58.598 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:05:58 smithi006 systemd[1]: Stopping Ceph osd.3 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:05:59.006 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:05:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T10:05:58.596+0000 7f767e69d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:05:59.006 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:05:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T10:05:58.596+0000 7f767e69d700 -1 osd.3 91 *** Got signal Terminated *** 2023-09-13T10:05:59.007 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:05:58 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T10:05:58.596+0000 7f767e69d700 -1 osd.3 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:01.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:00.969+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:01.756 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:06:01 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T10:06:01.421+0000 7f7679c91700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.191623+0000 front 2023-09-13T10:05:40.191668+0000 (oldest deadline 2023-09-13T10:06:01.291747+0000) 2023-09-13T10:06:02.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:01.964+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:02.442 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:02 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:02.010+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:02.756 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:06:02 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T10:06:02.440+0000 7f7679c91700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.191623+0000 front 2023-09-13T10:05:40.191668+0000 (oldest deadline 2023-09-13T10:06:01.291747+0000) 2023-09-13T10:06:02.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:02.427+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:03.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:02.956+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:03.416 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:03 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:03.018+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:03.417 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:06:03 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3[124434]: 2023-09-13T10:06:03.415+0000 7f7679c91700 -1 osd.3 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.191623+0000 front 2023-09-13T10:05:40.191668+0000 (oldest deadline 2023-09-13T10:06:01.291747+0000) 2023-09-13T10:06:03.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:03.389+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:04.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:04 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:04.001+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:04.380 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:04 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:04.067+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:04.381 INFO:journalctl@ceph.osd.3.smithi006.stdout:Sep 13 10:06:04 smithi006 bash[199746]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-3 2023-09-13T10:06:04.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:04 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:04.235+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:04.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:04 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:04.414+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:05.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:04 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:04.983+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:05.438 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:05 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:05.033+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:05.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:05 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:05.228+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:05.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:05 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:05.379+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:05.877 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.3.service' 2023-09-13T10:06:05.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:05.921 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-09-13T10:06:05.921 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-09-13T10:06:05.922 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.4 2023-09-13T10:06:06.160 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:06 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:06.011+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:06.256 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 10:06:05 smithi053 systemd[1]: Stopping Ceph osd.4 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:06:06.257 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:06 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:06.196+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:06.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:06 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:06.006+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:06.506 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:06 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:06.158+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:06.756 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 10:06:06 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-4[115961]: 2023-09-13T10:06:06.288+0000 7f8ab2de7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:06:06.757 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 10:06:06 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-4[115961]: 2023-09-13T10:06:06.288+0000 7f8ab2de7700 -1 osd.4 91 *** Got signal Terminated *** 2023-09-13T10:06:06.757 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 10:06:06 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-4[115961]: 2023-09-13T10:06:06.288+0000 7f8ab2de7700 -1 osd.4 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:06.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:06 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:06.426+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:07.256 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:06 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:06.984+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:07.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:07 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:07.149+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:07.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:06 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:06.973+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:07.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:07 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:07.163+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:07.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:07 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:07.446+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:08.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:07 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:07.955+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:08.506 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:08 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:08.022+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:08.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:08 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:08.136+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:08.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:08 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:08.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:08.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:08 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:08.433+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:09.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:08.999+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:09.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:08.999+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:09.506 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:09 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:09.042+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:09.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:09 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:09.123+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:09.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:09 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:09.097+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:09.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:09.430+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:10.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:09.965+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:10.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:09 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:09.965+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:10.329 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:10.048+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:10.329 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:10.048+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:10.506 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:10 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:10.052+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:10.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:10 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:10.094+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:10.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:10 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:10.328+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:10.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:10 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:10.425+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:10.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:10 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:10.304+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:11.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:10 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:10.957+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:11.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:10 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:10.957+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:11.377 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:11 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:11.077+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:11.377 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:11 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:11.077+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:11.506 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:11 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:11.057+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:11.507 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:11 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:11.020+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:11.507 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:11 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:11.020+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:11.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:11 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:11.376+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:11.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:11.324+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:11.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:11.448+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:11.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:11.448+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:12.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:11.937+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:12.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:11 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:11.937+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:12.332 INFO:journalctl@ceph.osd.4.smithi053.stdout:Sep 13 10:06:12 smithi053 bash[148766]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-4 2023-09-13T10:06:12.333 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:12 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:12.097+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:12.333 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:12 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:12.097+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:12.333 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:12 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:12.330+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:12.506 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:12 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:12.105+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:12.507 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:12 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:12.070+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:12.507 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:12 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:12.070+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:12.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:12.307+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:12.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:12.479+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:12.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:12.479+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:13.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:12.934+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:13.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:12 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:12.934+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:13.506 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:13.042+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:13.507 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:13.042+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:13.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:13.101+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:13.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:13 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:13.101+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:13.509 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:13 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:13.311+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:13.509 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:13 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:13.128+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:13.509 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:13 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:13.129+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:13.637 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.4.service' 2023-09-13T10:06:13.681 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:13.682 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-09-13T10:06:13.682 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-09-13T10:06:13.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.5 2023-09-13T10:06:13.715 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:13.355+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:13.716 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:13.456+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:13.716 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:13.456+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:14.019 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:13 smithi131 systemd[1]: Stopping Ceph osd.5 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:06:14.019 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:13.935+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:14.020 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:13 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:13.935+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:14.392 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:14.065+0000 7f4ee355e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:06:14.393 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:14.065+0000 7f4ee355e700 -1 osd.5 91 *** Got signal Terminated *** 2023-09-13T10:06:14.393 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:14.065+0000 7f4ee355e700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:14.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:14.276+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:14.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:14.103+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:14.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:14 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:14.103+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:14.508 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:14.051+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:14.508 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:14.051+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:14.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:14.127+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:14.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:14.127+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:14.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:14.391+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:14.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:14.467+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:14.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:14.467+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:15.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:14.888+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:15.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:14 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:14.888+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:15.506 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:15.012+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:15.507 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:15.012+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:15.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:15.125+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:15.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:15.125+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:15.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:15 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:15.227+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:15.509 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:15 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:15.092+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:15.509 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:15 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:15.092+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:15.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:15 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:15.417+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:15.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:15 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:15.489+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:15.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:15 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:15.489+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:16.256 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:15.986+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:16.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:15 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:15.986+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:16.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:16 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:16.083+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:16.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:16 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:16.083+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:16.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:15 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:15.900+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:16.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:15 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:15.900+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:16.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:16.245+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:16.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:16.044+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:16.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:16 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:16.044+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:16.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:16.446+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:16.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:16.524+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:16.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:16.524+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:17.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:17.099+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:17.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:17.099+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:17.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:16 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:16.957+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:17.258 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:16 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:16.957+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:17.258 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:16 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:16.957+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:17.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:16.923+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:17.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:16.923+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:17.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:16 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:16.923+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:50.694930+0000 front 2023-09-13T10:05:50.694993+0000 (oldest deadline 2023-09-13T10:06:16.595220+0000) 2023-09-13T10:06:17.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:17 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:17.087+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:17.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:17 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:17.087+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:17.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:17 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:17.291+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:17.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:17 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:17.291+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:17.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:17 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:17.467+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:17.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:17 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:17.467+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:17.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:17 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:17.505+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:17.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:17 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:17.505+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:18.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:17.928+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:18.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:17.928+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:18.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:17 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:17.928+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:18.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:18.142+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:18.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:18.142+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:18.259 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:18.142+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:18.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:17 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:17.895+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:18.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:17 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:17.895+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:18.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:17 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:17.895+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:50.694930+0000 front 2023-09-13T10:05:50.694993+0000 (oldest deadline 2023-09-13T10:06:16.595220+0000) 2023-09-13T10:06:18.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:18 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:18.093+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:18.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:18 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:18.093+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:18.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:18 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:18.093+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:18.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:18 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:18.340+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:18.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:18 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:18.340+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:18.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:18.433+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:18.770 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:18.433+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:18.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:18.510+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:18.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:18.510+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:18.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:18.510+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:19.191 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:18.926+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:19.191 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:18.926+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:19.191 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:18 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:18.926+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:19.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:18.862+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:34.991475+0000 front 2023-09-13T10:05:34.991485+0000 (oldest deadline 2023-09-13T10:06:00.891564+0000) 2023-09-13T10:06:19.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:18.862+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:44.893628+0000 front 2023-09-13T10:05:44.893662+0000 (oldest deadline 2023-09-13T10:06:08.993700+0000) 2023-09-13T10:06:19.270 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:18 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5[117122]: 2023-09-13T10:06:18.862+0000 7f4edc34d700 -1 osd.5 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:50.694930+0000 front 2023-09-13T10:05:50.694993+0000 (oldest deadline 2023-09-13T10:06:16.595220+0000) 2023-09-13T10:06:19.506 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:19.189+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:19.506 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:19.189+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:19.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:19.189+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:19.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:19 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:19.378+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:19.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:19 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:19.378+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:19.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:19 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:19.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:19.509 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:19 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:19.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:19.509 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:19 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:19.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:19.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:19 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:19.423+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:19.770 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:19 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:19.423+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:19.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:19 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:19.552+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:19.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:19 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:19.552+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:19.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:19 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:19.552+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:20.214 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:19.929+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:20.215 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:19.929+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:20.215 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:19.929+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:20.269 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 10:06:19 smithi131 bash[151596]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-5 2023-09-13T10:06:20.424 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:20 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:20.137+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:20.424 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:20 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:20.137+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:20.424 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:20 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:20.137+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:20.506 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:20.213+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:20.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:20.213+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:20.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:20.213+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:20.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:20 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:20.424+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:20.757 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:20 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:20.424+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:20.770 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:20 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:20.460+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:20.770 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:20 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:20.460+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:20.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:20 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:20.538+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:20.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:20 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:20.538+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:20.771 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:20 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:20.538+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:21.166 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:20.887+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:21.166 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:20.887+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:21.167 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:20 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:20.887+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:21.190 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.5.service' 2023-09-13T10:06:21.270 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:21.271 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-09-13T10:06:21.271 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-09-13T10:06:21.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.6 2023-09-13T10:06:21.416 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:21.116+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:21.417 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:21.116+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:21.417 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:21.116+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:21.506 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:21 smithi006 systemd[1]: Stopping Ceph osd.6 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:06:21.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:21.165+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:21.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:21.165+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:21.507 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:21.165+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:21.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:21 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:21.420+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:21.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:21 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:21.420+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:21.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:21.415+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:21.757 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:21 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:21.415+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:21.916 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:21.642+0000 7f6865161700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:06:21.916 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:21.642+0000 7f6865161700 -1 osd.6 91 *** Got signal Terminated *** 2023-09-13T10:06:21.917 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:21.642+0000 7f6865161700 -1 osd.6 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:21.917 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:21.915+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:22.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:21 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:21.529+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:22.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:21 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:21.529+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:22.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:21 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:21.529+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:22.256 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:21.915+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:22.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:21 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:21.915+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:22.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:22 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:22.143+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:22.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:22 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:22.143+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:22.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:22 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:22.143+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:22.437 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:22 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:22.158+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:22.437 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:22 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:22.158+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:22.438 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:22 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:22.158+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:22.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:22 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:22.437+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:22.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:22 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:22.437+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:22.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:22 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:22.440+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:22.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:22 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:22.440+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:22.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:22 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:22.551+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:22.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:22 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:22.551+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:22.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:22 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:22.551+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:23.256 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:22 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:22.952+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:23.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:22 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:22.952+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:23.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:22 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:22.952+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:23.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:23.114+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:23.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:23.114+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:23.259 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:23.114+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:23.434 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:23.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:23.435 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:23.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:23.435 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:23.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:23.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:23.434+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:23.757 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:23 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:23.434+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:23.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:23.395+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:23.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:23.395+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:23.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:23.544+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:23.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:23.544+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:23.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:23 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:23.544+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:24.256 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:23.917+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:24.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:23.917+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:24.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:23 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:23.917+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:24.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:24 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:24.071+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:24.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:24 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:24.071+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:24.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:24 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:24.071+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:24.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:24.401+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:24.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:24.401+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:24.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:24.178+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:24.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:24.178+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:24.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:24.178+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:24.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:24.178+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:24.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:24 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:24.376+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:24.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:24 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:24.376+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:24.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:24 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:24.576+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:24.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:24 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:24.576+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:24.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:24 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:24.576+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:25.256 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:24 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:24.897+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:25.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:24 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:24.897+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:25.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:24 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:24.897+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:25.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:25 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:25.061+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:25.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:25 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:25.061+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:25.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:25 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:25.061+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:25.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:25 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:25.372+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:25.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:25 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:25.372+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:25.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:25 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:25.160+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:25.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:25 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:25.160+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:25.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:25 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:25.160+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:25.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:25 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:25.160+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:25.589 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:25.333+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:25.590 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:25.333+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:25.590 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:25.333+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:26.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:25.589+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:26.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:25.589+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:26.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:25.589+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:26.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:25 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:25.589+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:26.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:26 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:26.027+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:26.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:26 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:26.027+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:26.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:26 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:26.027+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:26.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:25 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:25.892+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:36.934705+0000 front 2023-09-13T10:05:36.934770+0000 (oldest deadline 2023-09-13T10:06:01.034832+0000) 2023-09-13T10:06:26.257 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:25 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:25.892+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.136105+0000 front 2023-09-13T10:05:45.136088+0000 (oldest deadline 2023-09-13T10:06:10.436149+0000) 2023-09-13T10:06:26.258 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:25 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:25.892+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:54.537314+0000 front 2023-09-13T10:05:54.537295+0000 (oldest deadline 2023-09-13T10:06:16.237133+0000) 2023-09-13T10:06:26.258 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:25 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6[133174]: 2023-09-13T10:06:25.892+0000 7f6860755700 -1 osd.6 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:02.638384+0000 front 2023-09-13T10:06:02.638357+0000 (oldest deadline 2023-09-13T10:06:24.938513+0000) 2023-09-13T10:06:26.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:26 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:26.355+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:26.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:26 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:26.355+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:26.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:26 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:26.185+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:26.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:26 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:26.185+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:26.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:26 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:26.185+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:26.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:26 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:26.185+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:26.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:26 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:26.332+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:26.769 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:26 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:26.332+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:26.770 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:26 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:26.332+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:26.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:26 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:26.581+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:26.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:26 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:26.581+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:26.771 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:26 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:26.581+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:26.771 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:26 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:26.581+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:27.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:27 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:27.000+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:27.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:27 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:27.000+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:27.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:27 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:27.000+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:27.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:27 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:27.398+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:27.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:27 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:27.398+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:27.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:27 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:27.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:27.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:27 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:27.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:27.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:27 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:27.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:27.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:27 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:27.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:27.613 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:27 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:27.324+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:27.613 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:27 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:27.324+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:27.614 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:27 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:27.324+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:27.756 INFO:journalctl@ceph.osd.6.smithi006.stdout:Sep 13 10:06:27 smithi006 bash[200023]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-6 2023-09-13T10:06:28.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:27 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:27.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:28.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:27 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:27.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:28.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:27 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:27.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:28.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:27 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:27.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:28.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:27 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:27.984+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:28.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:27 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:27.984+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:28.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:27 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:27.984+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:28.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:27 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:27.984+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:28.432 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:28.166+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:28.433 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:28.166+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:28.433 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:28.166+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:28.433 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:28.166+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:28.650 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:28 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:28.305+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:28.650 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:28 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:28.305+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:28.650 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:28 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:28.305+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:28.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:28.432+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:28.757 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:28.432+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:28.792 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.6.service' 2023-09-13T10:06:28.834 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:28.834 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-09-13T10:06:28.835 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-09-13T10:06:28.835 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.7 2023-09-13T10:06:29.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:28 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:28.649+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:29.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:28 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:28.649+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:29.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:28 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:28.649+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:29.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:28 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:28.649+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:29.158 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:28 smithi053 systemd[1]: Stopping Ceph osd.7 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:06:29.159 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:29.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:29.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:29 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:29.020+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:29.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:29 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:29.020+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:29.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:29 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:29.020+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:29.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:29 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:29.020+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:29.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:29.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:29.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:29.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:29.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:29.157+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:29.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:29.200+0000 7f5c300fd700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:06:29.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:29.200+0000 7f5c300fd700 -1 osd.7 91 *** Got signal Terminated *** 2023-09-13T10:06:29.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:29.200+0000 7f5c300fd700 -1 osd.7 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:29.509 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:29.386+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:29.509 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:29.386+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:29.509 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:29 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:29.386+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:02.835203+0000 front 2023-09-13T10:06:02.835319+0000 (oldest deadline 2023-09-13T10:06:28.735333+0000) 2023-09-13T10:06:29.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:29 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:29.265+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:29.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:29 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:29.265+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:29.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:29 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:29.265+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:30.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:29 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:29.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:30.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:29 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:29.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:30.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:29 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:29.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:30.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:29 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:29.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:30.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:30 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:30.382+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:30.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:30 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:30.382+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:30.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:30 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:30.382+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:02.835203+0000 front 2023-09-13T10:06:02.835319+0000 (oldest deadline 2023-09-13T10:06:28.735333+0000) 2023-09-13T10:06:30.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:30 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:30.158+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:30.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:30 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:30.158+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:30.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:30 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:30.158+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:30.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:30 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:30.158+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:30.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.013+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:30.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.013+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:30.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.013+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:30.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.013+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:30.614 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:30 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:30.276+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:30.615 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:30 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:30.276+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:30.615 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:30 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:30.276+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:31.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:30 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:30.614+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:31.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:30 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:30.614+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:31.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:30 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:30.614+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:31.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:30 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:30.614+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:31.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:31.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:31.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:31.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:30 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:30.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:31.414 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:31 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:31.144+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:31.414 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:31 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:31.144+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:31.414 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:31 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:31.144+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:31.415 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:31 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:31.144+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:31.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:31.233+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:31.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:31.233+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:31.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:31.233+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:31.756 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:31 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:31.413+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:31.757 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:31 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:31.413+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:31.757 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:31 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:31.413+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:02.835203+0000 front 2023-09-13T10:06:02.835319+0000 (oldest deadline 2023-09-13T10:06:28.735333+0000) 2023-09-13T10:06:32.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:31.570+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:32.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:31.570+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:32.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:31.570+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:32.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:31 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:31.570+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:32.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:31.994+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:32.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:31.994+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:32.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:31.994+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:32.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:31 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:31.994+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:32.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:32.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:32.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:32.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:32.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:32.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:32.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:32.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:32.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:32.397+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:32.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:32.397+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:32.508 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:32.397+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:02.835203+0000 front 2023-09-13T10:06:02.835319+0000 (oldest deadline 2023-09-13T10:06:28.735333+0000) 2023-09-13T10:06:32.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:32 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:32.193+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:32.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:32 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:32.193+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:32.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:32 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:32.193+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:33.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:32 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:32.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:33.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:32 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:32.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:33.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:32 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:32.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:33.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:32 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:32.612+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:33.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.002+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:33.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.002+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:33.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.002+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:33.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.002+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:33.506 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:33.378+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:45.431089+0000 front 2023-09-13T10:05:45.431118+0000 (oldest deadline 2023-09-13T10:06:09.531233+0000) 2023-09-13T10:06:33.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:33.378+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:51.232808+0000 front 2023-09-13T10:05:51.232732+0000 (oldest deadline 2023-09-13T10:06:16.433570+0000) 2023-09-13T10:06:33.507 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7[124735]: 2023-09-13T10:06:33.378+0000 7f5c28eec700 -1 osd.7 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:02.835203+0000 front 2023-09-13T10:06:02.835319+0000 (oldest deadline 2023-09-13T10:06:28.735333+0000) 2023-09-13T10:06:33.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:33.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:33.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:33.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:33.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:33.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:33.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:33.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:33.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:33 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:33.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:33.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:33.237+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:33.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:33.237+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:33.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:33.237+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:34.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:33.643+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:34.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:33.643+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:34.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:33.643+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:34.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:33.643+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:34.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:33 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:33.643+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:34.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.989+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:34.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.989+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:34.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.989+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:34.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.989+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:34.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:33 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:33.989+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:34.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:34 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:34.155+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:34.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:34 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:34.155+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:34.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:34 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:34.155+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:34.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:34 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:34.155+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:34.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:34 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:34.155+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:34.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:34.268+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:34.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:34.268+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:34.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:34.268+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:34.521 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:34.268+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:34.980 INFO:journalctl@ceph.osd.7.smithi053.stdout:Sep 13 10:06:34 smithi053 bash[149034]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-7 2023-09-13T10:06:35.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:34.648+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:35.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:34.648+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:35.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:34.648+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:35.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:34.648+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:35.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:34 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:34.648+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:35.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:34.967+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:35.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:34.967+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:35.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:34.967+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:35.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:34.967+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:35.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:34 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:34.967+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:35.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:35 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:35.128+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:35.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:35 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:35.128+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:35.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:35 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:35.128+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:35.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:35 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:35.128+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:35.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:35 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:35.128+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:35.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:35.223+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:35.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:35.223+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:35.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:35.223+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:35.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:35.223+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:36.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:35.598+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:36.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:35.599+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:36.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:35.599+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:36.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:35.599+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:36.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:35 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:35.599+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:36.246 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:36 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:36.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:36.247 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:36 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:36.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:36.247 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:36 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:36.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:36.247 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:36 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:36.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:36.247 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:36 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:36.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:36.254 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.7.service' 2023-09-13T10:06:36.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:35.952+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:36.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:35.952+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:36.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:35.952+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:36.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:35.952+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:36.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:35 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:35.952+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:36.297 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:36.298 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-09-13T10:06:36.298 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-09-13T10:06:36.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.8 2023-09-13T10:06:36.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:36.175+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:36.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:36.175+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:36.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:36.175+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:36.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:36.175+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:36.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 systemd[1]: Stopping Ceph osd.8 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:06:37.019 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:36.662+0000 7f5a709c7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:06:37.020 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:36.662+0000 7f5a709c7700 -1 osd.8 91 *** Got signal Terminated *** 2023-09-13T10:06:37.020 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:36.662+0000 7f5a709c7700 -1 osd.8 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:37.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:36.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:37.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:36.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:37.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:36.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:37.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:36.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:37.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:36 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:36.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:37.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:36.921+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:37.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:36.921+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:37.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:36.921+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:37.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:36.921+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:37.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:36 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:36.921+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:37.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:37 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:37.109+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:37.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:37 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:37.109+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:37.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:37 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:37.109+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:37.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:37 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:37.109+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:37.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:37 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:37.109+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:37.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:37.135+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:37.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:37.135+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:37.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:37.135+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:37.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:37.135+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:38.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:37.627+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:38.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:37.627+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:38.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:37.627+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:38.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:37.627+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:38.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:37 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:37.627+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:38.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:37.935+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:38.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:37.935+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:38.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:37.935+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:38.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:37.935+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:38.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:37 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:37.935+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:38.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:38 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:38.151+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:38.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:38 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:38.151+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:38.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:38 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:38.151+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:38.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:38 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:38.151+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:38.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:38 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:38.151+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:38.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:38.166+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:38.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:38.166+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:38.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:38.166+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:38.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:38.166+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:39.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:38.596+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:39.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:38.596+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:39.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:38.596+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:39.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:38.596+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:39.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:38 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:38.596+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:39.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:38.920+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:39.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:38.920+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:39.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:38.920+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:39.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:38.920+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:39.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:38 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:38.920+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:39.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:39 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:39.149+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:39.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:39 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:39.149+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:39.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:39 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:39.149+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:39.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:39 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:39.149+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:39.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:39 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:39.149+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:39.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:39.186+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:39.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:39.186+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:39.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:39.186+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:39.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:39.186+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:40.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:39.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:40.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:39.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:40.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:39.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:40.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:39.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:40.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:39.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:40.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:39 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:39.965+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:40.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:39 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:39.965+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:40.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:39 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:39.965+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:40.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:39 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:39.965+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:40.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:39 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:39.965+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:40.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:40 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:40.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:40.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:40 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:40.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:40.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:40 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:40.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:40.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:40 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:40.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:40.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:40 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:40.132+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:40.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:40.216+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:40.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:40.216+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:40.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:40.216+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:40.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:40.216+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:41.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:40.592+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:41.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:40.592+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:41.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:40.592+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:41.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:40.592+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:41.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:40.592+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:41.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:40 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:40.592+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:41.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:41 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:41.114+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:41.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:41 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:41.114+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:41.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:41 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:41.114+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:41.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:41 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:41.114+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:41.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:41 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:41.114+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:41.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:41 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:41.114+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:41.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:41 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:41.006+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:41.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:41 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:41.006+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:41.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:41 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:41.006+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:41.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:41 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:41.006+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:41.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:41 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:41.006+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:41.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:41.235+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.579657+0000 front 2023-09-13T10:05:47.579675+0000 (oldest deadline 2023-09-13T10:06:09.879651+0000) 2023-09-13T10:06:41.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:41.235+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.180803+0000 front 2023-09-13T10:05:52.180835+0000 (oldest deadline 2023-09-13T10:06:16.880932+0000) 2023-09-13T10:06:41.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:41.235+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.182124+0000 front 2023-09-13T10:05:59.182276+0000 (oldest deadline 2023-09-13T10:06:25.082097+0000) 2023-09-13T10:06:41.520 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8[125304]: 2023-09-13T10:06:41.235+0000 7f5a6c7bc700 -1 osd.8 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:10.983626+0000 front 2023-09-13T10:06:10.983554+0000 (oldest deadline 2023-09-13T10:06:33.883653+0000) 2023-09-13T10:06:42.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:41.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:42.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:41.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:42.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:41.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:42.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:41.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:42.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:41.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:42.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:41 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:41.595+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:42.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:42.161+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:42.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:42.161+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:42.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:42.161+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:42.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:42.161+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:42.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:42.161+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:42.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:42 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:42.161+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:42.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.014+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:42.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.014+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:42.508 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.014+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:42.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.014+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:42.509 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.014+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:42.519 INFO:journalctl@ceph.osd.8.smithi131.stdout:Sep 13 10:06:42 smithi131 bash[151858]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-8 2023-09-13T10:06:43.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:42 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:42.606+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:43.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:42 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:42.606+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:43.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:42 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:42.606+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:43.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:42 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:42.606+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:43.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:42 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:42.606+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:43.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:42 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:42.606+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:43.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.996+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:43.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.996+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:43.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.996+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:43.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.996+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:43.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.996+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:43.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:42 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:42.996+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:17.017382+0000 front 2023-09-13T10:06:17.017304+0000 (oldest deadline 2023-09-13T10:06:42.317269+0000) 2023-09-13T10:06:43.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:43 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:43.186+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:43.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:43 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:43.186+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:43.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:43 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:43.186+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:43.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:43 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:43.186+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:43.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:43 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:43.186+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:43.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:43 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:43.186+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:43.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:43 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:43.639+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:43.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:43 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:43.639+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:43.770 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:43 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:43.639+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:43.771 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:43 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:43.639+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:43.771 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:43 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:43.639+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:43.771 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:43 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:43.639+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:43.803 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.8.service' 2023-09-13T10:06:43.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:43.844 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-09-13T10:06:43.845 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-09-13T10:06:43.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.9 2023-09-13T10:06:44.233 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:43 smithi006 systemd[1]: Stopping Ceph osd.9 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:06:44.234 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:43.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:44.235 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:43.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:44.235 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:43.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:44.235 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:43.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:44.236 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:43.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:44.236 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:43 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:43.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:17.017382+0000 front 2023-09-13T10:06:17.017304+0000 (oldest deadline 2023-09-13T10:06:42.317269+0000) 2023-09-13T10:06:44.236 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.232+0000 7ff62be1d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:06:44.237 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.232+0000 7ff62be1d700 -1 osd.9 91 *** Got signal Terminated *** 2023-09-13T10:06:44.237 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.232+0000 7ff62be1d700 -1 osd.9 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:44.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:44 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:44.212+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:44.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:44 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:44.212+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:44.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:44 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:44.212+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:44.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:44 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:44.212+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:44.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:44 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:44.212+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:44.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:44 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:44.212+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:45.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:44.664+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:45.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:44.664+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:45.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:44.664+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:45.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:44.664+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:45.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:44.664+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:45.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:44.664+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:45.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.962+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:45.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.962+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:45.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.962+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:45.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.962+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:45.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.962+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:45.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:44 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:44.962+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:17.017382+0000 front 2023-09-13T10:06:17.017304+0000 (oldest deadline 2023-09-13T10:06:42.317269+0000) 2023-09-13T10:06:45.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:45 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:45.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:45.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:45 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:45.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:45.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:45 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:45.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:45.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:45 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:45.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:45.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:45 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:45.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:45.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:45 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:45.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:46.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:45 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:45.669+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:46.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:45 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:45.669+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:46.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:45 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:45.669+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:46.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:45 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:45.669+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:46.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:45 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:45.669+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:46.022 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:45 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:45.669+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:46.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:45 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:45.956+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:46.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:45 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:45.956+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:46.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:45 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:45.956+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:46.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:45 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:45.956+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:46.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:45 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:45.956+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:46.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:45 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:45.956+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:17.017382+0000 front 2023-09-13T10:06:17.017304+0000 (oldest deadline 2023-09-13T10:06:42.317269+0000) 2023-09-13T10:06:46.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:46 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:46.200+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:46.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:46 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:46.200+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:46.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:46 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:46.200+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:46.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:46 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:46.200+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:46.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:46 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:46.200+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:46.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:46 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:46.200+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:47.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:46 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:46.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:47.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:46 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:46.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:47.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:46 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:46.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:47.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:46 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:46.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:47.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:46 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:46.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:47.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:46 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:46.638+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:47.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:46 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:46.948+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:47.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:46 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:46.948+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:47.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:46 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:46.948+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:47.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:46 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:46.948+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:47.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:46 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:46.948+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:47.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:46 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:46.948+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:17.017382+0000 front 2023-09-13T10:06:17.017304+0000 (oldest deadline 2023-09-13T10:06:42.317269+0000) 2023-09-13T10:06:47.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:47 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:47.176+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:47.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:47 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:47.176+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:47.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:47 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:47.176+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:47.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:47 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:47.176+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:47.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:47 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:47.176+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:47.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:47 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:47.176+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:48.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:47 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:47.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:48.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:47 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:47.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:48.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:47 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:47.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:48.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:47 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:47.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:48.022 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:47 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:47.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:48.023 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:47 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:47.607+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:48.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:47 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:47.963+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:48.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:47 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:47.963+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:48.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:47 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:47.963+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:48.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:47 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:47.963+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:48.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:47 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:47.963+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:48.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:47 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:47.963+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:17.017382+0000 front 2023-09-13T10:06:17.017304+0000 (oldest deadline 2023-09-13T10:06:42.317269+0000) 2023-09-13T10:06:48.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:48 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:48.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:48.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:48 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:48.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:48.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:48 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:48.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:48.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:48 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:48.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:48.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:48 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:48.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:48.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:48 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:48.180+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:49.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:48.587+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:49.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:48.587+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:49.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:48.587+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:49.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:48.587+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:49.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:48.587+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:49.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:48.587+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:49.256 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:48 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:48.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:40.110709+0000 front 2023-09-13T10:05:40.110735+0000 (oldest deadline 2023-09-13T10:06:05.410877+0000) 2023-09-13T10:06:49.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:48 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:48.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:47.112502+0000 front 2023-09-13T10:05:47.112841+0000 (oldest deadline 2023-09-13T10:06:12.412616+0000) 2023-09-13T10:06:49.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:48 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:48.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:52.413360+0000 front 2023-09-13T10:05:52.413389+0000 (oldest deadline 2023-09-13T10:06:17.713401+0000) 2023-09-13T10:06:49.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:48 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:48.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:03.515337+0000 front 2023-09-13T10:06:03.515359+0000 (oldest deadline 2023-09-13T10:06:27.615521+0000) 2023-09-13T10:06:49.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:48 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:48.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:07.616343+0000 front 2023-09-13T10:06:07.616461+0000 (oldest deadline 2023-09-13T10:06:33.516180+0000) 2023-09-13T10:06:49.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:48 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:48.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:17.017382+0000 front 2023-09-13T10:06:17.017304+0000 (oldest deadline 2023-09-13T10:06:42.317269+0000) 2023-09-13T10:06:49.258 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:48 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9[142010]: 2023-09-13T10:06:48.987+0000 7ff62540d700 -1 osd.9 91 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-09-13T10:06:26.418192+0000 front 2023-09-13T10:06:26.418229+0000 (oldest deadline 2023-09-13T10:06:48.718236+0000) 2023-09-13T10:06:49.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:49 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:49.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:49.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:49 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:49.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:49.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:49 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:49.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:49.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:49 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:49.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:49.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:49 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:49.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:49.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:49 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:49.168+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:50.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:49 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:49.628+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:50.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:49 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:49.628+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:50.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:49 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:49.628+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:50.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:49 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:49.628+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:50.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:49 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:49.628+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:50.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:49 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:49.628+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:50.257 INFO:journalctl@ceph.osd.9.smithi006.stdout:Sep 13 10:06:50 smithi006 bash[200291]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-9 2023-09-13T10:06:50.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:50 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:50.124+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:50.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:50 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:50.124+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:50.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:50 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:50.124+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:50.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:50 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:50.124+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:50.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:50 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:50.124+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:50.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:50 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:50.124+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:51.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:50.678+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:51.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:50.678+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:51.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:50.678+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:51.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:50.678+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:51.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:50.678+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:51.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:50 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:50.678+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:51.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:51.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:51.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:51.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:51.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:51.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:51.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:51.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:51.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:51.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:51.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:51.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:51.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:51.127+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-09-13T10:06:26.257005+0000 front 2023-09-13T10:06:26.257090+0000 (oldest deadline 2023-09-13T10:06:50.356914+0000) 2023-09-13T10:06:51.662 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.9.service' 2023-09-13T10:06:51.716 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:51.717 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-09-13T10:06:51.717 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-09-13T10:06:51.717 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.10 2023-09-13T10:06:52.006 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:51 smithi053 systemd[1]: Stopping Ceph osd.10 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:06:52.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:51 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:51.640+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:52.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:51 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:51.640+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:52.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:51 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:51.640+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:52.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:51 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:51.640+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:52.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:51 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:51.640+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:52.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:51 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:51.640+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:52.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.082+0000 7ff686466700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:06:52.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.082+0000 7ff686466700 -1 osd.10 91 *** Got signal Terminated *** 2023-09-13T10:06:52.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.082+0000 7ff686466700 -1 osd.10 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:06:52.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:52.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:52.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:52.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:52.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:52.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:52.509 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:52 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:52.148+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-09-13T10:06:26.257005+0000 front 2023-09-13T10:06:26.257090+0000 (oldest deadline 2023-09-13T10:06:50.356914+0000) 2023-09-13T10:06:53.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:52.617+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:53.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:52.617+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:53.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:52.617+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:53.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:52.617+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:53.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:52.617+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:53.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:52.617+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:53.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:53.156+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:53.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:53.156+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:53.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:53.156+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:53.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:53.156+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:53.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:53.156+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:53.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:53.156+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:53.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:53 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:53.156+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-09-13T10:06:26.257005+0000 front 2023-09-13T10:06:26.257090+0000 (oldest deadline 2023-09-13T10:06:50.356914+0000) 2023-09-13T10:06:54.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:53 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:53.653+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:54.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:53 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:53.653+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:54.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:53 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:53.653+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:54.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:53 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:53.653+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:54.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:53 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:53.653+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:54.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:53 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:53.653+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:54.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:54.140+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:54.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:54.140+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:54.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:54.140+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:54.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:54.140+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:54.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:54.140+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:54.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:54.140+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:54.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:54 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:54.140+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-09-13T10:06:26.257005+0000 front 2023-09-13T10:06:26.257090+0000 (oldest deadline 2023-09-13T10:06:50.356914+0000) 2023-09-13T10:06:55.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:54 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:54.623+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:55.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:54 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:54.623+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:55.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:54 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:54.623+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:55.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:54 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:54.623+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:55.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:54 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:54.623+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:55.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:54 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:54.623+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:55.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:55 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:55.106+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:55.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:55 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:55.106+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:55.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:55 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:55.106+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:55.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:55 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:55.106+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:55.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:55 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:55.106+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:55.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:55 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:55.106+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:55.508 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:55 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:55.106+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-09-13T10:06:26.257005+0000 front 2023-09-13T10:06:26.257090+0000 (oldest deadline 2023-09-13T10:06:50.356914+0000) 2023-09-13T10:06:56.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:55 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:55.665+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:56.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:55 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:55.665+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:56.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:55 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:55.665+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:56.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:55 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:55.665+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:56.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:55 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:55.665+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:56.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:55 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:55.665+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:56.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:56 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:56.130+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.646156+0000 front 2023-09-13T10:05:38.645993+0000 (oldest deadline 2023-09-13T10:06:03.345997+0000) 2023-09-13T10:06:56.506 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:56 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:56.130+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:43.346479+0000 front 2023-09-13T10:05:43.346510+0000 (oldest deadline 2023-09-13T10:06:09.747462+0000) 2023-09-13T10:06:56.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:56 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:56.130+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.549229+0000 front 2023-09-13T10:05:55.549253+0000 (oldest deadline 2023-09-13T10:06:17.249392+0000) 2023-09-13T10:06:56.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:56 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:56.130+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:06:01.350857+0000 front 2023-09-13T10:06:01.350898+0000 (oldest deadline 2023-09-13T10:06:24.151594+0000) 2023-09-13T10:06:56.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:56 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:56.130+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.653909+0000 front 2023-09-13T10:06:08.653938+0000 (oldest deadline 2023-09-13T10:06:32.154173+0000) 2023-09-13T10:06:56.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:56 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:56.130+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:15.655485+0000 front 2023-09-13T10:06:15.655538+0000 (oldest deadline 2023-09-13T10:06:40.355567+0000) 2023-09-13T10:06:56.507 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:56 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10[132714]: 2023-09-13T10:06:56.130+0000 7ff68225b700 -1 osd.10 91 heartbeat_check: no reply from 172.21.15.6:6822 osd.6 since back 2023-09-13T10:06:26.257005+0000 front 2023-09-13T10:06:26.257090+0000 (oldest deadline 2023-09-13T10:06:50.356914+0000) 2023-09-13T10:06:57.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:56 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:56.703+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:57.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:56 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:56.703+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:57.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:56 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:56.703+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:57.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:56 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:56.703+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:57.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:56 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:56.703+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:57.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:56 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:56.703+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:57.964 INFO:journalctl@ceph.osd.10.smithi053.stdout:Sep 13 10:06:57 smithi053 bash[149296]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-10 2023-09-13T10:06:58.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:57.718+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:58.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:57.718+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:58.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:57.718+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:58.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:57.718+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:58.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:57.718+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:58.022 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:57.718+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:58.022 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:57 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:57.718+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6820 osd.7 since back 2023-09-13T10:06:31.749487+0000 front 2023-09-13T10:06:31.749525+0000 (oldest deadline 2023-09-13T10:06:57.049409+0000) 2023-09-13T10:06:59.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:58 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:58.750+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:06:59.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:58 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:58.750+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:06:59.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:58 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:58.750+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:06:59.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:58 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:58.750+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:06:59.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:58 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:58.750+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:06:59.020 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:58 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:58.750+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:06:59.021 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:58 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:58.750+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6820 osd.7 since back 2023-09-13T10:06:31.749487+0000 front 2023-09-13T10:06:31.749525+0000 (oldest deadline 2023-09-13T10:06:57.049409+0000) 2023-09-13T10:06:59.442 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.10.service' 2023-09-13T10:06:59.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:06:59.485 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-09-13T10:06:59.486 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-09-13T10:06:59.486 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.11 2023-09-13T10:06:59.769 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 systemd[1]: Stopping Ceph osd.11 for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:00.269 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.800+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:07:00.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.800+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:07:00.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.800+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:07:00.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.800+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:07:00.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.800+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:07:00.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.800+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:07:00.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.800+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6820 osd.7 since back 2023-09-13T10:06:31.749487+0000 front 2023-09-13T10:06:31.749525+0000 (oldest deadline 2023-09-13T10:06:57.049409+0000) 2023-09-13T10:07:00.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.841+0000 7f9b12f89700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:00.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.841+0000 7f9b12f89700 -1 osd.11 91 *** Got signal Terminated *** 2023-09-13T10:07:00.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:06:59 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:06:59.841+0000 7f9b12f89700 -1 osd.11 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-09-13T10:07:01.269 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:00.803+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:07:01.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:00.803+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:07:01.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:00.803+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:07:01.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:00.803+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:07:01.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:00.803+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:07:01.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:00.803+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:07:01.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:00 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:00.803+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6820 osd.7 since back 2023-09-13T10:06:31.749487+0000 front 2023-09-13T10:06:31.749525+0000 (oldest deadline 2023-09-13T10:06:57.049409+0000) 2023-09-13T10:07:02.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:01.814+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:07:02.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:01.814+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:07:02.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:01.814+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:07:02.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:01.814+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:07:02.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:01.814+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:07:02.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:01.814+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:07:02.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:01 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:01.814+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6820 osd.7 since back 2023-09-13T10:06:31.749487+0000 front 2023-09-13T10:06:31.749525+0000 (oldest deadline 2023-09-13T10:06:57.049409+0000) 2023-09-13T10:07:03.269 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:07:03.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:07:03.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:07:03.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:07:03.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:07:03.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:07:03.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6820 osd.7 since back 2023-09-13T10:06:31.749487+0000 front 2023-09-13T10:06:31.749525+0000 (oldest deadline 2023-09-13T10:06:57.049409+0000) 2023-09-13T10:07:03.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:02 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:02.849+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.8 since back 2023-09-13T10:06:37.049859+0000 front 2023-09-13T10:06:37.049870+0000 (oldest deadline 2023-09-13T10:07:02.349978+0000) 2023-09-13T10:07:04.269 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2023-09-13T10:05:38.838961+0000 front 2023-09-13T10:05:38.838929+0000 (oldest deadline 2023-09-13T10:06:02.338919+0000) 2023-09-13T10:07:04.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6804 osd.1 since back 2023-09-13T10:05:46.242197+0000 front 2023-09-13T10:05:46.242101+0000 (oldest deadline 2023-09-13T10:06:10.942105+0000) 2023-09-13T10:07:04.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6804 osd.2 since back 2023-09-13T10:05:55.543794+0000 front 2023-09-13T10:05:55.543706+0000 (oldest deadline 2023-09-13T10:06:18.443915+0000) 2023-09-13T10:07:04.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.6:6814 osd.3 since back 2023-09-13T10:05:59.544911+0000 front 2023-09-13T10:05:59.544951+0000 (oldest deadline 2023-09-13T10:06:24.844997+0000) 2023-09-13T10:07:04.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6812 osd.4 since back 2023-09-13T10:06:08.946038+0000 front 2023-09-13T10:06:08.946069+0000 (oldest deadline 2023-09-13T10:06:33.045867+0000) 2023-09-13T10:07:04.270 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6812 osd.5 since back 2023-09-13T10:06:18.946890+0000 front 2023-09-13T10:06:18.946943+0000 (oldest deadline 2023-09-13T10:06:40.047000+0000) 2023-09-13T10:07:04.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.53:6820 osd.7 since back 2023-09-13T10:06:31.749487+0000 front 2023-09-13T10:06:31.749525+0000 (oldest deadline 2023-09-13T10:06:57.049409+0000) 2023-09-13T10:07:04.271 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:03 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11[134119]: 2023-09-13T10:07:03.809+0000 7f9b0dd7c700 -1 osd.11 91 heartbeat_check: no reply from 172.21.15.131:6820 osd.8 since back 2023-09-13T10:06:37.049859+0000 front 2023-09-13T10:06:37.049870+0000 (oldest deadline 2023-09-13T10:07:02.349978+0000) 2023-09-13T10:07:06.019 INFO:journalctl@ceph.osd.11.smithi131.stdout:Sep 13 10:07:05 smithi131 bash[152120]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-osd-11 2023-09-13T10:07:06.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@osd.11.service' 2023-09-13T10:07:07.029 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:07.029 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-09-13T10:07:07.030 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-09-13T10:07:07.030 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.a 2023-09-13T10:07:07.397 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:07:07 smithi006 systemd[1]: Stopping Ceph mds.a for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:07.756 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:07:07 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-a[150610]: 2023-09-13T10:07:07.396+0000 7f926546c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:07.757 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:07:07 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-a[150610]: 2023-09-13T10:07:07.396+0000 7f926546c700 -1 mds.a *** got signal Terminated *** 2023-09-13T10:07:11.369 INFO:journalctl@ceph.mds.a.smithi006.stdout:Sep 13 10:07:11 smithi006 bash[200566]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-a 2023-09-13T10:07:11.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.a.service' 2023-09-13T10:07:11.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:11.605 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-09-13T10:07:11.606 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-09-13T10:07:11.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.d 2023-09-13T10:07:11.979 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 10:07:11 smithi006 systemd[1]: Stopping Ceph mds.d for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:12.256 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 10:07:11 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-d[149642]: 2023-09-13T10:07:11.978+0000 7fb1cce97700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:12.257 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 10:07:11 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-d[149642]: 2023-09-13T10:07:11.978+0000 7fb1cce97700 -1 mds.d *** got signal Terminated *** 2023-09-13T10:07:14.256 INFO:journalctl@ceph.mds.d.smithi006.stdout:Sep 13 10:07:14 smithi006 bash[200707]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-d 2023-09-13T10:07:14.364 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.d.service' 2023-09-13T10:07:14.400 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:14.401 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-09-13T10:07:14.401 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-09-13T10:07:14.402 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.g 2023-09-13T10:07:14.756 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:07:14 smithi006 systemd[1]: Stopping Ceph mds.g for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:15.256 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:07:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-g[150228]: 2023-09-13T10:07:14.777+0000 7fb39574e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:15.257 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:07:14 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-g[150228]: 2023-09-13T10:07:14.777+0000 7fb39574e700 -1 mds.g *** got signal Terminated *** 2023-09-13T10:07:19.257 INFO:journalctl@ceph.mds.g.smithi006.stdout:Sep 13 10:07:19 smithi006 bash[200851]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-g 2023-09-13T10:07:19.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.g.service' 2023-09-13T10:07:19.367 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:19.367 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-09-13T10:07:19.368 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-09-13T10:07:19.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.j 2023-09-13T10:07:19.754 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 10:07:19 smithi006 systemd[1]: Stopping Ceph mds.j for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:20.007 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 10:07:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-j[149277]: 2023-09-13T10:07:19.753+0000 7f740e465700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:20.007 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 10:07:19 smithi006 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-j[149277]: 2023-09-13T10:07:19.753+0000 7f740e465700 -1 mds.j *** got signal Terminated *** 2023-09-13T10:07:24.006 INFO:journalctl@ceph.mds.j.smithi006.stdout:Sep 13 10:07:23 smithi006 bash[200999]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-j 2023-09-13T10:07:24.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.j.service' 2023-09-13T10:07:24.066 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:24.066 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-09-13T10:07:24.066 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-09-13T10:07:24.067 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.b 2023-09-13T10:07:24.438 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:07:24 smithi053 systemd[1]: Stopping Ceph mds.b for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:24.756 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:07:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: 2023-09-13T10:07:24.437+0000 7f02fc168700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:24.757 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:07:24 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b[139770]: 2023-09-13T10:07:24.437+0000 7f02fc168700 -1 mds.b *** got signal Terminated *** 2023-09-13T10:07:27.756 INFO:journalctl@ceph.mds.b.smithi053.stdout:Sep 13 10:07:27 smithi053 bash[149571]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-b 2023-09-13T10:07:27.765 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.b.service' 2023-09-13T10:07:27.803 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:27.804 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-09-13T10:07:27.804 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-09-13T10:07:27.804 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.e 2023-09-13T10:07:28.195 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:07:27 smithi053 systemd[1]: Stopping Ceph mds.e for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:28.506 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:07:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-e[139084]: 2023-09-13T10:07:28.195+0000 7f9d29964700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:28.507 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:07:28 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-e[139084]: 2023-09-13T10:07:28.195+0000 7f9d29964700 -1 mds.e *** got signal Terminated *** 2023-09-13T10:07:31.506 INFO:journalctl@ceph.mds.e.smithi053.stdout:Sep 13 10:07:31 smithi053 bash[149719]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-e 2023-09-13T10:07:31.688 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.e.service' 2023-09-13T10:07:31.725 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:31.725 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-09-13T10:07:31.726 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-09-13T10:07:31.726 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.h 2023-09-13T10:07:32.007 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:07:31 smithi053 systemd[1]: Stopping Ceph mds.h for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:32.506 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:07:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: 2023-09-13T10:07:32.101+0000 7f4a5e392700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:32.507 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:07:32 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h[139424]: 2023-09-13T10:07:32.101+0000 7f4a5e392700 -1 mds.h *** got signal Terminated *** 2023-09-13T10:07:35.748 INFO:journalctl@ceph.mds.h.smithi053.stdout:Sep 13 10:07:35 smithi053 bash[149863]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-h 2023-09-13T10:07:35.755 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.h.service' 2023-09-13T10:07:35.790 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:35.790 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-09-13T10:07:35.790 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-09-13T10:07:35.791 DEBUG:teuthology.orchestra.run.smithi053:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.k 2023-09-13T10:07:36.006 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:07:35 smithi053 systemd[1]: Stopping Ceph mds.k for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:36.506 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:07:36 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-k[138743]: 2023-09-13T10:07:36.176+0000 7f3637793700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:36.507 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:07:36 smithi053 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-k[138743]: 2023-09-13T10:07:36.176+0000 7f3637793700 -1 mds.k *** got signal Terminated *** 2023-09-13T10:07:39.509 INFO:journalctl@ceph.mds.k.smithi053.stdout:Sep 13 10:07:39 smithi053 bash[150009]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-k 2023-09-13T10:07:39.555 DEBUG:teuthology.orchestra.run.smithi053:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.k.service' 2023-09-13T10:07:39.595 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:39.595 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-09-13T10:07:39.596 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-09-13T10:07:39.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.c 2023-09-13T10:07:39.970 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:07:39 smithi131 systemd[1]: Stopping Ceph mds.c for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:40.269 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:07:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-c[140975]: 2023-09-13T10:07:39.968+0000 7fd9b5f5e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:40.269 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:07:39 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-c[140975]: 2023-09-13T10:07:39.968+0000 7fd9b5f5e700 -1 mds.c *** got signal Terminated *** 2023-09-13T10:07:43.738 INFO:journalctl@ceph.mds.c.smithi131.stdout:Sep 13 10:07:43 smithi131 bash[152394]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-c 2023-09-13T10:07:43.745 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.c.service' 2023-09-13T10:07:43.782 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:43.783 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-09-13T10:07:43.783 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-09-13T10:07:43.783 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.f 2023-09-13T10:07:44.019 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:07:43 smithi131 systemd[1]: Stopping Ceph mds.f for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:44.519 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:07:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-f[140636]: 2023-09-13T10:07:44.159+0000 7ffb22dab700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:44.520 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:07:44 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-f[140636]: 2023-09-13T10:07:44.159+0000 7ffb22dab700 -1 mds.f *** got signal Terminated *** 2023-09-13T10:07:47.735 INFO:journalctl@ceph.mds.f.smithi131.stdout:Sep 13 10:07:47 smithi131 bash[152541]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-f 2023-09-13T10:07:47.740 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.f.service' 2023-09-13T10:07:47.776 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:47.777 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-09-13T10:07:47.777 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-09-13T10:07:47.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.i 2023-09-13T10:07:48.019 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 10:07:47 smithi131 systemd[1]: Stopping Ceph mds.i for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:48.522 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 10:07:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-i[141313]: 2023-09-13T10:07:48.158+0000 7feba9e00700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:48.522 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 10:07:48 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-i[141313]: 2023-09-13T10:07:48.158+0000 7feba9e00700 -1 mds.i *** got signal Terminated *** 2023-09-13T10:07:51.769 INFO:journalctl@ceph.mds.i.smithi131.stdout:Sep 13 10:07:51 smithi131 bash[152688]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-i 2023-09-13T10:07:51.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.i.service' 2023-09-13T10:07:51.819 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:51.819 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-09-13T10:07:51.820 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-09-13T10:07:51.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.l 2023-09-13T10:07:52.222 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:07:51 smithi131 systemd[1]: Stopping Ceph mds.l for 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da... 2023-09-13T10:07:52.519 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:07:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-l[140298]: 2023-09-13T10:07:52.221+0000 7fa5a3e87700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-09-13T10:07:52.519 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:07:52 smithi131 ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-l[140298]: 2023-09-13T10:07:52.221+0000 7fa5a3e87700 -1 mds.l *** got signal Terminated *** 2023-09-13T10:07:55.566 INFO:journalctl@ceph.mds.l.smithi131.stdout:Sep 13 10:07:55 smithi131 bash[152836]: ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da-mds-l 2023-09-13T10:07:55.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-27a2bbd4-5218-11ee-9ab8-7b867c8bd7da@mds.l.service' 2023-09-13T10:07:55.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-09-13T10:07:55.797 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-09-13T10:07:55.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da --force --keep-logs 2023-09-13T10:07:56.111 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T10:07:57.760 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da --force --keep-logs 2023-09-13T10:07:58.072 INFO:teuthology.orchestra.run.smithi053.stdout:Deleting cluster with fsid: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T10:07:59.812 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da --force --keep-logs 2023-09-13T10:08:00.233 INFO:teuthology.orchestra.run.smithi131.stdout:Deleting cluster with fsid: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T10:08:01.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-13T10:08:01.867 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-13T10:08:01.904 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-09-13T10:08:01.935 INFO:tasks.cephadm:Archiving crash dumps... 2023-09-13T10:08:01.937 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi006/crash 2023-09-13T10:08:01.938 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash -- . 2023-09-13T10:08:01.977 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash: Cannot open: No such file or directory 2023-09-13T10:08:01.978 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now 2023-09-13T10:08:01.979 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi053/crash 2023-09-13T10:08:01.981 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash -- . 2023-09-13T10:08:02.030 INFO:teuthology.orchestra.run.smithi053.stderr:tar: /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash: Cannot open: No such file or directory 2023-09-13T10:08:02.207 INFO:teuthology.orchestra.run.smithi053.stderr:tar: Error is not recoverable: exiting now 2023-09-13T10:08:02.281 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi131/crash 2023-09-13T10:08:02.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash -- . 2023-09-13T10:08:02.371 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/crash: Cannot open: No such file or directory 2023-09-13T10:08:02.372 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now 2023-09-13T10:08:02.373 INFO:tasks.cephadm:Checking cluster log for badness... 2023-09-13T10:08:02.373 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-09-13T10:08:02.415 INFO:teuthology.orchestra.run.smithi006.stderr:grep: /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph.log: No such file or directory 2023-09-13T10:08:02.417 INFO:tasks.cephadm:Compressing logs... 2023-09-13T10:08:02.417 DEBUG:teuthology.orchestra.run.smithi006:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-13T10:08:02.460 DEBUG:teuthology.orchestra.run.smithi053:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-13T10:08:02.462 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-13T10:08:02.488 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-09-13T10:08:02.489 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-13T10:08:02.489 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.0.log 2023-09-13T10:08:02.490 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.g.log 2023-09-13T10:08:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.a.log 2023-09-13T10:08:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.6.log 2023-09-13T10:08:02.491 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.a.log: --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.3.log 2023-09-13T10:08:02.492 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.6.log: /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.d.log 2023-09-13T10:08:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.d.log: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-13T10:08:02.495 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.x.log 2023-09-13T10:08:02.496 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.9.log 2023-09-13T10:08:02.504 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2023-09-13T10:08:02.505 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-13T10:08:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.x.log: /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.9.log: 94.6% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.d.log.gz 2023-09-13T10:08:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log 2023-09-13T10:08:02.514 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.5.log 2023-09-13T10:08:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.2.log 2023-09-13T10:08:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.11.log 2023-09-13T10:08:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.z.log 2023-09-13T10:08:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.8.log 2023-09-13T10:08:02.515 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.f.log 2023-09-13T10:08:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.c.log 2023-09-13T10:08:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.i.log 2023-09-13T10:08:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.c.log 2023-09-13T10:08:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log 2023-09-13T10:08:02.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.i.log: /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.l.log 2023-09-13T10:08:02.517 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.j.log 2023-09-13T10:08:02.517 INFO:teuthology.orchestra.run.smithi006.stderr: 91.0% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log.gz 2023-09-13T10:08:02.517 INFO:teuthology.orchestra.run.smithi053.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-09-13T10:08:02.518 INFO:teuthology.orchestra.run.smithi053.stderr:: No such file or directory 2023-09-13T10:08:02.518 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log: /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.l.log: 93.4% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.z.log.gz 2023-09-13T10:08:02.527 INFO:teuthology.orchestra.run.smithi053.stderr:gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.10.log 2023-09-13T10:08:02.528 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.h.log 2023-09-13T10:08:02.528 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.e.log 2023-09-13T10:08:02.528 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.4.log 2023-09-13T10:08:02.528 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.1.log 2023-09-13T10:08:02.529 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.a.log 2023-09-13T10:08:02.529 INFO:teuthology.orchestra.run.smithi006.stderr: 94.6% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.j.log.gz 2023-09-13T10:08:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.k.log 2023-09-13T10:08:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log 2023-09-13T10:08:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.7.log 2023-09-13T10:08:02.531 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.b.log 2023-09-13T10:08:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.b.log 2023-09-13T10:08:02.532 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.y.log 2023-09-13T10:08:02.536 INFO:teuthology.orchestra.run.smithi053.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.b.log: /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.y.log: 93.3% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.y.log.gz 2023-09-13T10:08:02.910 INFO:teuthology.orchestra.run.smithi006.stderr:/var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.a.log: 89.8% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mgr.x.log.gz 2023-09-13T10:08:02.934 INFO:teuthology.orchestra.run.smithi053.stderr: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-13T10:08:02.967 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log.gz 2023-09-13T10:08:03.063 INFO:teuthology.orchestra.run.smithi053.stderr: 90.9% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-volume.log.gz 2023-09-13T10:08:03.075 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-09-13T10:08:04.633 INFO:teuthology.orchestra.run.smithi006.stderr: 90.4% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.a.log.gz 2023-09-13T10:08:06.157 INFO:teuthology.orchestra.run.smithi131.stderr: 92.0% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.c.log.gz 2023-09-13T10:08:12.531 INFO:teuthology.orchestra.run.smithi006.stderr: 95.2% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.a.log.gz 2023-09-13T10:08:14.590 INFO:teuthology.orchestra.run.smithi006.stderr: 95.2% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.g.log.gz 2023-09-13T10:08:22.399 INFO:teuthology.orchestra.run.smithi053.stderr: 93.7% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mon.b.log.gz 2023-09-13T10:08:24.280 INFO:teuthology.orchestra.run.smithi006.stderr: 93.8% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.0.log.gz 2023-09-13T10:08:25.611 INFO:teuthology.orchestra.run.smithi006.stderr: 93.9% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.9.log.gz 2023-09-13T10:08:26.684 INFO:teuthology.orchestra.run.smithi006.stderr: 93.8% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.6.log.gz 2023-09-13T10:08:32.600 INFO:teuthology.orchestra.run.smithi006.stderr: 93.8% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.3.log.gz 2023-09-13T10:08:32.603 INFO:teuthology.orchestra.run.smithi006.stderr: 2023-09-13T10:08:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:real 0m30.127s 2023-09-13T10:08:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:user 1m59.545s 2023-09-13T10:08:32.603 INFO:teuthology.orchestra.run.smithi006.stderr:sys 0m4.092s 2023-09-13T10:08:52.812 INFO:teuthology.orchestra.run.smithi131.stderr: 95.5% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.l.log.gz 2023-09-13T10:08:56.616 INFO:teuthology.orchestra.run.smithi131.stderr: 95.1% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.f.log.gz 2023-09-13T10:09:07.790 INFO:teuthology.orchestra.run.smithi053.stderr: 95.2% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.k.log.gz 2023-09-13T10:09:15.929 INFO:teuthology.orchestra.run.smithi131.stderr: 93.8% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.2.log.gz 2023-09-13T10:09:15.949 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.11.log.gz 2023-09-13T10:09:22.588 INFO:teuthology.orchestra.run.smithi053.stderr: 93.9% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.4.log.gz 2023-09-13T10:09:28.645 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.1.log.gz 2023-09-13T10:09:34.332 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.5.log.gz 2023-09-13T10:09:36.364 INFO:teuthology.orchestra.run.smithi131.stderr: 93.9% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.8.log.gz 2023-09-13T10:09:40.452 INFO:teuthology.orchestra.run.smithi053.stderr: 93.7% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.10.log.gz 2023-09-13T10:09:43.413 INFO:teuthology.orchestra.run.smithi053.stderr: 93.8% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-osd.7.log.gz 2023-09-13T10:12:05.866 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.c.log.gz 2023-09-13T10:13:33.854 INFO:teuthology.orchestra.run.smithi131.stderr: 93.2% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.i.log.gz 2023-09-13T10:13:33.973 INFO:teuthology.orchestra.run.smithi131.stderr: 2023-09-13T10:13:33.973 INFO:teuthology.orchestra.run.smithi131.stderr:real 5m31.493s 2023-09-13T10:13:33.973 INFO:teuthology.orchestra.run.smithi131.stderr:user 7m11.485s 2023-09-13T10:13:33.973 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m18.012s 2023-09-13T10:15:10.277 INFO:teuthology.orchestra.run.smithi053.stderr: 93.1% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.e.log.gz 2023-09-13T10:16:01.823 INFO:teuthology.orchestra.run.smithi053.stderr: 93.1% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.b.log.gz 2023-09-13T10:16:28.794 INFO:teuthology.orchestra.run.smithi053.stderr: 93.2% -- replaced with /var/log/ceph/27a2bbd4-5218-11ee-9ab8-7b867c8bd7da/ceph-mds.h.log.gz 2023-09-13T10:16:28.796 INFO:teuthology.orchestra.run.smithi053.stderr: 2023-09-13T10:16:28.796 INFO:teuthology.orchestra.run.smithi053.stderr:real 8m26.316s 2023-09-13T10:16:28.797 INFO:teuthology.orchestra.run.smithi053.stderr:user 11m13.764s 2023-09-13T10:16:28.797 INFO:teuthology.orchestra.run.smithi053.stderr:sys 0m24.928s 2023-09-13T10:16:28.797 INFO:tasks.cephadm:Archiving logs... 2023-09-13T10:16:28.798 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi006/log 2023-09-13T10:16:28.799 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-13T10:16:42.801 DEBUG:teuthology.misc:Transferring archived files from smithi053:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi053/log 2023-09-13T10:16:42.803 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-13T10:18:20.019 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi131/log 2023-09-13T10:18:20.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-13T10:19:25.382 INFO:tasks.cephadm:Removing cluster... 2023-09-13T10:19:25.383 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da --force 2023-09-13T10:19:25.706 INFO:teuthology.orchestra.run.smithi006.stdout:Deleting cluster with fsid: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T10:19:26.302 DEBUG:teuthology.orchestra.run.smithi053:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da --force 2023-09-13T10:19:27.133 INFO:teuthology.orchestra.run.smithi053.stdout:Deleting cluster with fsid: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T10:19:28.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da --force 2023-09-13T10:19:29.128 INFO:teuthology.orchestra.run.smithi131.stdout:Deleting cluster with fsid: 27a2bbd4-5218-11ee-9ab8-7b867c8bd7da 2023-09-13T10:19:30.032 INFO:tasks.cephadm:Removing cephadm ... 2023-09-13T10:19:30.033 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-13T10:19:30.055 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-13T10:19:30.096 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/cephadm 2023-09-13T10:19:30.121 INFO:tasks.cephadm:Teardown complete 2023-09-13T10:19:30.121 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-13T10:19:30.133 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-13T10:19:30.133 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-13T10:19:30.136 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-13T10:19:30.139 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-13T10:19:30.281 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-13T10:19:30.292 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-13T10:19:30.292 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T10:19:30.295 DEBUG:teuthology.orchestra.run.smithi053:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T10:19:30.298 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-13T10:19:30.313 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2023-09-13T10:19:30.313 INFO:teuthology.orchestra.run.smithi053.stderr:bash: ntpq: command not found 2023-09-13T10:19:30.314 INFO:teuthology.orchestra.run.smithi131.stderr:bash: ntpq: command not found 2023-09-13T10:19:30.317 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T10:19:30.317 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2023-09-13T10:19:30.318 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 -308us[ -308us] +/- 89ms 2023-09-13T10:19:30.318 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv02.front.sepia.ceph.com 3 6 377 16 -598us[ -589us] +/- 49ms 2023-09-13T10:19:30.318 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 17 +1375us[+1383us] +/- 88ms 2023-09-13T10:19:30.318 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T10:19:30.333 INFO:teuthology.orchestra.run.smithi053.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T10:19:30.333 INFO:teuthology.orchestra.run.smithi053.stdout:=============================================================================== 2023-09-13T10:19:30.334 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -311us[ -311us] +/- 89ms 2023-09-13T10:19:30.334 INFO:teuthology.orchestra.run.smithi053.stdout:^* hv02.front.sepia.ceph.com 3 6 377 18 -578us[ -572us] +/- 49ms 2023-09-13T10:19:30.334 INFO:teuthology.orchestra.run.smithi053.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 20 +1373us[+1379us] +/- 88ms 2023-09-13T10:19:30.334 INFO:teuthology.orchestra.run.smithi053.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T10:19:30.344 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-13T10:19:30.344 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2023-09-13T10:19:30.344 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 -282us[ -282us] +/- 89ms 2023-09-13T10:19:30.345 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -560us[ -515us] +/- 49ms 2023-09-13T10:19:30.345 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 +1408us[+1408us] +/- 88ms 2023-09-13T10:19:30.345 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2023-09-13T10:19:30.346 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-13T10:19:30.357 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-13T10:19:30.358 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-13T10:19:30.369 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-13T10:19:30.490 DEBUG:teuthology.orchestra.run.smithi053:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-13T10:19:30.664 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-13T10:19:30.837 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T10:19:30.876 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T10:19:30.878 DEBUG:teuthology.orchestra.run.smithi053:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T10:19:30.914 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T10:19:30.915 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-13T10:19:30.946 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T10:19:30.947 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-13T10:19:30.964 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-13T10:19:30.975 INFO:teuthology.task.internal:Duration was 3680.936951 seconds 2023-09-13T10:19:30.975 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-13T10:19:31.023 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-13T10:19:31.023 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-13T10:19:31.026 DEBUG:teuthology.orchestra.run.smithi053:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-13T10:19:31.028 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-13T10:19:31.078 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T10:19:31.100 INFO:teuthology.orchestra.run.smithi053.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T10:19:31.116 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-13T10:19:31.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-13T10:19:31.546 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2023-09-13T10:19:31.547 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-13T10:19:31.576 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi053.front.sepia.ceph.com 2023-09-13T10:19:31.576 DEBUG:teuthology.orchestra.run.smithi053:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-13T10:19:31.624 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2023-09-13T10:19:31.625 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-13T10:19:31.662 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-13T10:19:31.662 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-13T10:19:31.665 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-13T10:19:31.668 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-13T10:19:31.759 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-13T10:19:31.760 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-13T10:19:31.762 DEBUG:teuthology.orchestra.run.smithi053:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-13T10:19:31.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-13T10:19:31.893 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-13T10:19:31.910 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-13T10:19:31.911 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-13T10:19:31.939 DEBUG:teuthology.orchestra.run.smithi053:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-13T10:19:31.969 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-13T10:19:32.002 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-13T10:19:32.013 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-13T10:19:32.016 DEBUG:teuthology.orchestra.run.smithi053:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-13T10:19:32.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-13T10:19:32.041 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2023-09-13T10:19:32.051 INFO:teuthology.orchestra.run.smithi053.stdout:kernel.core_pattern = core 2023-09-13T10:19:32.185 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2023-09-13T10:19:32.200 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-13T10:19:32.217 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T10:19:32.218 DEBUG:teuthology.orchestra.run.smithi053:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-13T10:19:32.234 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T10:19:32.235 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-13T10:19:32.250 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-13T10:19:32.251 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-13T10:19:32.262 INFO:teuthology.task.internal:Transferring archived files... 2023-09-13T10:19:32.264 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi006 2023-09-13T10:19:32.265 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-13T10:19:32.313 DEBUG:teuthology.misc:Transferring archived files from smithi053:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi053 2023-09-13T10:19:32.314 DEBUG:teuthology.orchestra.run.smithi053:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-13T10:19:32.359 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924/remote/smithi131 2023-09-13T10:19:32.359 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-13T10:19:32.401 INFO:teuthology.task.internal:Removing archive directory... 2023-09-13T10:19:32.401 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-13T10:19:32.404 DEBUG:teuthology.orchestra.run.smithi053:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-13T10:19:32.406 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-13T10:19:32.450 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-13T10:19:32.464 INFO:teuthology.task.internal:Not uploading archives. 2023-09-13T10:19:32.465 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-13T10:19:32.476 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-13T10:19:32.476 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-13T10:19:32.479 DEBUG:teuthology.orchestra.run.smithi053:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-13T10:19:32.481 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-13T10:19:32.494 INFO:teuthology.orchestra.run.smithi006.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 10:19 /home/ubuntu/cephtest 2023-09-13T10:19:32.496 INFO:teuthology.orchestra.run.smithi053.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 10:19 /home/ubuntu/cephtest 2023-09-13T10:19:32.506 INFO:teuthology.orchestra.run.smithi131.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 10:19 /home/ubuntu/cephtest 2023-09-13T10:19:32.507 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-13T10:19:32.520 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-13T10:19:32.547 INFO:teuthology.nuke:Checking targets against current locks 2023-09-13T10:19:32.576 DEBUG:teuthology.nuke:shortname: smithi006 2023-09-13T10:19:32.577 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T10:19:32.603 DEBUG:teuthology.nuke:shortname: smithi053 2023-09-13T10:19:32.603 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T10:19:32.608 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 09:12:57.113098', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T10:19:32.625 DEBUG:teuthology.nuke:shortname: smithi131 2023-09-13T10:19:32.626 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-13T10:19:32.635 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi053.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 09:12:57.114468', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T10:19:32.660 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-09-12_12:12:15-fs-wip-rishabh-2023sep12-b2-testing-default-smithi/7394924', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-13 09:12:57.115668', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-13T10:19:32.672 INFO:teuthology.orchestra.console.smithi006:Power off 2023-09-13T10:19:32.673 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T10:19:32.697 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2023-09-13T10:19:32.697 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:32.722 INFO:teuthology.orchestra.console.smithi053:Power off 2023-09-13T10:19:32.723 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T10:19:32.738 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-09-13T10:19:32.748 DEBUG:teuthology.orchestra.console.smithi053:power off output: Chassis Power Control: Down/Off 2023-09-13T10:19:32.748 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:32.770 INFO:teuthology.orchestra.console.smithi131:Power off 2023-09-13T10:19:32.771 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-13T10:19:32.782 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-09-13T10:19:32.796 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2023-09-13T10:19:32.797 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:32.823 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-09-13T10:19:36.739 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:36.783 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:36.825 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:36.851 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-09-13T10:19:36.895 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is on 2023-09-13T10:19:36.936 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2023-09-13T10:19:40.854 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:40.896 DEBUG:teuthology.orchestra.console.smithi053:pexpect command: ipmitool -H smithi053.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:40.938 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:40.965 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2023-09-13T10:19:41.010 DEBUG:teuthology.orchestra.console.smithi053:check power output: Chassis Power is off 2023-09-13T10:19:41.048 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2023-09-13T10:19:41.113 INFO:teuthology.orchestra.console.smithi053:Power off completed 2023-09-13T10:19:41.149 INFO:teuthology.orchestra.console.smithi131:Power off completed 2023-09-13T10:19:44.970 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-13T10:19:45.082 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2023-09-13T10:19:45.183 INFO:teuthology.orchestra.console.smithi006:Power off completed 2023-09-13T10:19:45.288 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} ms_mode/secure wsync/yes} objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/no 5-workunit/suites/dbench}} duration: 3680.9369509220123 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_rishabh@teuthology status: fail success: false 2023-09-13T10:19:45.288 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-13T10:19:45.381 INFO:teuthology.run:FAIL